2023-07-06T21:24:40.738 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-06T21:24:40.739 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --archive /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249 --owner scheduled_rishabh@teuthology --verbose --name rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi -- /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249/orig.config.yaml 2023-07-06T21:24:40.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T21:24:40.878 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249 branch: wip-rishabh-CephManager-in-CephFSTestCase description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: null first_in_suite: false job_id: '7328249' kernel: client: branch: testing flavor: default kdb: true sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-CephManager-in-CephFSTestCase ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-CephManager-in-CephFSTestCase sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-CephManager-in-CephFSTestCase suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCGh6RzmvW0LNZxxY/5BzuRMJiLLWmj07AGtdHV8B7eE5bAoke+2j3Bce8/TNdZMEfA2Xm6EQ0h8YobfoKgHjRM= smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLHJXxRw1EQ6ZypCaOEujvNGKSNwsbniQv3/PY+e+Br1Cvwgg6EhYVUzQ2VCR2IMFNQRUOX1mXQ3CWsg+O/eF6g= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b53f236c1077f1d295baafb9e0ca9a4b447019d7 timestamp: 2023-07-06_19:46:43 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-06T21:24:40.879 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa; will attempt to use it 2023-07-06T21:24:40.880 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa/tasks 2023-07-06T21:24:40.880 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-06T21:24:40.882 INFO:teuthology.task.internal:Checking packages... 2023-07-06T21:24:40.911 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '0a781ef0807ae9473fb1306ef07036226ca4f1a6' 2023-07-06T21:24:40.912 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-06T21:24:40.912 INFO:teuthology.packaging:ref: None 2023-07-06T21:24:40.912 INFO:teuthology.packaging:tag: None 2023-07-06T21:24:40.913 INFO:teuthology.packaging:branch: wip-rishabh-CephManager-in-CephFSTestCase 2023-07-06T21:24:40.913 INFO:teuthology.packaging:sha1: 0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-06T21:24:40.913 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-CephManager-in-CephFSTestCase 2023-07-06T21:24:41.126 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4488-g0a781ef0-1jammy 2023-07-06T21:24:41.126 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-06T21:24:41.136 INFO:teuthology.task.internal:no buildpackages task found 2023-07-06T21:24:41.136 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-06T21:24:41.141 INFO:teuthology.task.internal:Saving configuration 2023-07-06T21:24:41.157 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-06T21:24:41.168 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T21:24:41.198 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 21:18:53.761621', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPmiaT5mAnBhJT1WuQsaR/9KWjgIHg1TrfqMgC1qtmWZ'} 2023-07-06T21:24:41.222 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 21:18:53.763527', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBPo6xCsZKwleqicn5nmNbbV3YSr5u/L+0J+EblGa91M'} 2023-07-06T21:24:41.222 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-06T21:24:41.228 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-06T21:24:41.229 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-06T21:24:41.229 INFO:teuthology.run_tasks:Running task console_log... 2023-07-06T21:24:41.310 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb03dbb0280>, signals=[15]) 2023-07-06T21:24:41.311 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-06T21:24:41.319 INFO:teuthology.task.internal:Opening connections... 2023-07-06T21:24:41.321 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T21:24:41.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:24:41.404 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2023-07-06T21:24:41.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:24:41.480 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-06T21:24:41.487 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2023-07-06T21:24:41.492 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2023-07-06T21:24:41.493 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-07-06T21:24:41.537 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-06T21:24:41.538 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Ubuntu" 2023-07-06T21:24:41.538 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="22.04" 2023-07-06T21:24:41.538 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-06T21:24:41.538 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_CODENAME=jammy 2023-07-06T21:24:41.538 INFO:teuthology.orchestra.run.smithi055.stdout:ID=ubuntu 2023-07-06T21:24:41.538 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE=debian 2023-07-06T21:24:41.538 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-06T21:24:41.539 INFO:teuthology.orchestra.run.smithi055.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-06T21:24:41.539 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-06T21:24:41.539 INFO:teuthology.orchestra.run.smithi055.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-06T21:24:41.539 INFO:teuthology.orchestra.run.smithi055.stdout:UBUNTU_CODENAME=jammy 2023-07-06T21:24:41.540 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-07-06T21:24:41.569 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2023-07-06T21:24:41.574 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2023-07-06T21:24:41.574 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-07-06T21:24:41.620 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-06T21:24:41.621 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2023-07-06T21:24:41.621 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="22.04" 2023-07-06T21:24:41.621 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-06T21:24:41.621 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=jammy 2023-07-06T21:24:41.621 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2023-07-06T21:24:41.621 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2023-07-06T21:24:41.621 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-06T21:24:41.622 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-06T21:24:41.622 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-06T21:24:41.622 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-06T21:24:41.622 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=jammy 2023-07-06T21:24:41.622 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-07-06T21:24:41.644 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-06T21:24:41.653 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-06T21:24:41.658 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-06T21:24:41.659 DEBUG:teuthology.orchestra.run.smithi055:> test '!' -e /home/ubuntu/cephtest 2023-07-06T21:24:41.661 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2023-07-06T21:24:41.665 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-06T21:24:41.671 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-06T21:24:41.672 DEBUG:teuthology.orchestra.run.smithi055:> test -z $(ls -A /var/lib/ceph) 2023-07-06T21:24:41.711 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2023-07-06T21:24:41.791 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-06T21:24:41.853 INFO:teuthology.run_tasks:Running task kernel... 2023-07-06T21:24:41.868 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'} 2023-07-06T21:24:41.869 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-07-06T21:24:41.869 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-07-06T21:24:41.870 DEBUG:teuthology.orchestra.run.smithi055:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-06T21:24:41.870 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-06T21:24:41.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T21:24:41.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-07-06T21:24:41.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T21:24:41.878 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-07-06T21:24:42.088 DEBUG:teuthology.task.kernel:sha1 for client.0 is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-06T21:24:42.088 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-06T21:24:42.089 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2023-07-06T21:24:42.094 INFO:teuthology.orchestra.run.smithi055.stdout:5.15.0-56-generic 2023-07-06T21:24:42.094 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-06T21:24:42.095 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-06T21:24:42.095 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-07-06T21:24:42.096 DEBUG:teuthology.orchestra.run.smithi055:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-06T21:24:42.154 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-07-06T21:24:42.184 DEBUG:teuthology.task.kernel:sha1 for client.1 is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-06T21:24:42.184 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-06T21:24:42.184 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2023-07-06T21:24:42.190 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-56-generic 2023-07-06T21:24:42.191 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-06T21:24:42.191 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-06T21:24:42.192 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-07-06T21:24:42.192 DEBUG:teuthology.orchestra.run.smithi138:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-06T21:24:42.254 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-07-06T21:24:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-07-06T21:24:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-07-06T21:24:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-07-06T21:24:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:hint: 2023-07-06T21:24:42.288 INFO:teuthology.orchestra.run.smithi055.stderr:hint: git config --global init.defaultBranch 2023-07-06T21:24:42.288 INFO:teuthology.orchestra.run.smithi055.stderr:hint: 2023-07-06T21:24:42.288 INFO:teuthology.orchestra.run.smithi055.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-07-06T21:24:42.288 INFO:teuthology.orchestra.run.smithi055.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-07-06T21:24:42.288 INFO:teuthology.orchestra.run.smithi055.stderr:hint: 2023-07-06T21:24:42.288 INFO:teuthology.orchestra.run.smithi055.stderr:hint: git branch -m 2023-07-06T21:24:42.289 INFO:teuthology.orchestra.run.smithi055.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-06T21:24:42.290 DEBUG:teuthology.orchestra.run.smithi055:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-06T21:24:42.357 DEBUG:teuthology.orchestra.run.smithi055:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-06T21:24:42.402 INFO:teuthology.orchestra.run.smithi138.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-07-06T21:24:42.403 INFO:teuthology.orchestra.run.smithi138.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-07-06T21:24:42.403 INFO:teuthology.orchestra.run.smithi138.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-07-06T21:24:42.403 INFO:teuthology.orchestra.run.smithi138.stderr:hint: 2023-07-06T21:24:42.403 INFO:teuthology.orchestra.run.smithi138.stderr:hint: git config --global init.defaultBranch 2023-07-06T21:24:42.404 INFO:teuthology.orchestra.run.smithi138.stderr:hint: 2023-07-06T21:24:42.404 INFO:teuthology.orchestra.run.smithi138.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-07-06T21:24:42.404 INFO:teuthology.orchestra.run.smithi138.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-07-06T21:24:42.405 INFO:teuthology.orchestra.run.smithi138.stderr:hint: 2023-07-06T21:24:42.405 INFO:teuthology.orchestra.run.smithi138.stderr:hint: git branch -m 2023-07-06T21:24:42.406 INFO:teuthology.orchestra.run.smithi138.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-06T21:24:42.407 DEBUG:teuthology.orchestra.run.smithi138:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-06T21:24:42.409 DEBUG:teuthology.orchestra.run.smithi055:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-06T21:24:42.478 DEBUG:teuthology.orchestra.run.smithi138:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-06T21:24:42.534 DEBUG:teuthology.orchestra.run.smithi138:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-06T21:27:04.472 INFO:teuthology.orchestra.run.smithi055.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-06T21:27:04.473 INFO:teuthology.orchestra.run.smithi055.stderr: * [new branch] main -> origin/main 2023-07-06T21:27:04.505 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190312 -> 20190312 2023-07-06T21:27:04.505 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190416 -> 20190416 2023-07-06T21:27:04.505 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190514 -> 20190514 2023-07-06T21:27:04.505 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190618 -> 20190618 2023-07-06T21:27:04.506 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190717 -> 20190717 2023-07-06T21:27:04.506 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190815 -> 20190815 2023-07-06T21:27:04.506 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190923 -> 20190923 2023-07-06T21:27:04.506 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20191022 -> 20191022 2023-07-06T21:27:04.506 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20191215 -> 20191215 2023-07-06T21:27:04.506 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200122 -> 20200122 2023-07-06T21:27:04.506 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200316 -> 20200316 2023-07-06T21:27:04.506 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200421 -> 20200421 2023-07-06T21:27:04.507 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200519 -> 20200519 2023-07-06T21:27:04.507 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200619 -> 20200619 2023-07-06T21:27:04.507 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200721 -> 20200721 2023-07-06T21:27:04.507 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200817 -> 20200817 2023-07-06T21:27:04.507 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200918 -> 20200918 2023-07-06T21:27:04.507 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20201022 -> 20201022 2023-07-06T21:27:04.507 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20201118 -> 20201118 2023-07-06T21:27:04.508 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20201218 -> 20201218 2023-07-06T21:27:04.508 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210208 -> 20210208 2023-07-06T21:27:04.508 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210315 -> 20210315 2023-07-06T21:27:04.508 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210511 -> 20210511 2023-07-06T21:27:04.508 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210716 -> 20210716 2023-07-06T21:27:04.508 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210818 -> 20210818 2023-07-06T21:27:04.510 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210919 -> 20210919 2023-07-06T21:27:04.511 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20211027 -> 20211027 2023-07-06T21:27:04.511 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20211216 -> 20211216 2023-07-06T21:27:04.511 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220209 -> 20220209 2023-07-06T21:27:04.511 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220310 -> 20220310 2023-07-06T21:27:04.511 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220411 -> 20220411 2023-07-06T21:27:04.511 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220509 -> 20220509 2023-07-06T21:27:04.512 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220610 -> 20220610 2023-07-06T21:27:04.512 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220708 -> 20220708 2023-07-06T21:27:04.512 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220815 -> 20220815 2023-07-06T21:27:04.512 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220913 -> 20220913 2023-07-06T21:27:04.512 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20221012 -> 20221012 2023-07-06T21:27:04.512 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20221109 -> 20221109 2023-07-06T21:27:04.513 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20221214 -> 20221214 2023-07-06T21:27:04.513 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230117 -> 20230117 2023-07-06T21:27:04.513 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230210 -> 20230210 2023-07-06T21:27:04.513 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230310 -> 20230310 2023-07-06T21:27:04.513 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230404 -> 20230404 2023-07-06T21:27:04.513 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230515 -> 20230515 2023-07-06T21:27:04.513 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230625 -> 20230625 2023-07-06T21:27:06.700 INFO:teuthology.orchestra.run.smithi138.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-06T21:27:06.700 INFO:teuthology.orchestra.run.smithi138.stderr: * [new branch] main -> origin/main 2023-07-06T21:27:06.729 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190312 -> 20190312 2023-07-06T21:27:06.730 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190416 -> 20190416 2023-07-06T21:27:06.730 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190514 -> 20190514 2023-07-06T21:27:06.730 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190618 -> 20190618 2023-07-06T21:27:06.730 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190717 -> 20190717 2023-07-06T21:27:06.730 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190815 -> 20190815 2023-07-06T21:27:06.730 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190923 -> 20190923 2023-07-06T21:27:06.731 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20191022 -> 20191022 2023-07-06T21:27:06.731 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20191215 -> 20191215 2023-07-06T21:27:06.731 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200122 -> 20200122 2023-07-06T21:27:06.731 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200316 -> 20200316 2023-07-06T21:27:06.731 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200421 -> 20200421 2023-07-06T21:27:06.733 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200519 -> 20200519 2023-07-06T21:27:06.734 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200619 -> 20200619 2023-07-06T21:27:06.734 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200721 -> 20200721 2023-07-06T21:27:06.734 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200817 -> 20200817 2023-07-06T21:27:06.734 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200918 -> 20200918 2023-07-06T21:27:06.734 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20201022 -> 20201022 2023-07-06T21:27:06.734 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20201118 -> 20201118 2023-07-06T21:27:06.734 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20201218 -> 20201218 2023-07-06T21:27:06.735 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210208 -> 20210208 2023-07-06T21:27:06.735 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210315 -> 20210315 2023-07-06T21:27:06.735 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210511 -> 20210511 2023-07-06T21:27:06.735 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210716 -> 20210716 2023-07-06T21:27:06.735 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210818 -> 20210818 2023-07-06T21:27:06.735 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210919 -> 20210919 2023-07-06T21:27:06.735 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20211027 -> 20211027 2023-07-06T21:27:06.735 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20211216 -> 20211216 2023-07-06T21:27:06.736 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220209 -> 20220209 2023-07-06T21:27:06.736 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220310 -> 20220310 2023-07-06T21:27:06.736 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220411 -> 20220411 2023-07-06T21:27:06.736 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220509 -> 20220509 2023-07-06T21:27:06.736 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220610 -> 20220610 2023-07-06T21:27:06.736 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220708 -> 20220708 2023-07-06T21:27:06.736 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220815 -> 20220815 2023-07-06T21:27:06.737 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220913 -> 20220913 2023-07-06T21:27:06.737 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20221012 -> 20221012 2023-07-06T21:27:06.737 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20221109 -> 20221109 2023-07-06T21:27:06.737 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20221214 -> 20221214 2023-07-06T21:27:06.737 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230117 -> 20230117 2023-07-06T21:27:06.738 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230210 -> 20230210 2023-07-06T21:27:06.738 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230310 -> 20230310 2023-07-06T21:27:06.738 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230404 -> 20230404 2023-07-06T21:27:06.739 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230515 -> 20230515 2023-07-06T21:27:06.739 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230625 -> 20230625 2023-07-06T21:27:07.957 INFO:teuthology.orchestra.run.smithi055.stderr:Updating files: 47% (1409/2977) Updating files: 48% (1429/2977) Updating files: 49% (1459/2977) Updating files: 50% (1489/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1952/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 81% (2429/2977) Updating files: 82% (2442/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-06T21:27:07.962 INFO:teuthology.orchestra.run.smithi055.stdout:HEAD is now at 0bab5dfb Merge tag 'iwlwifi-fw-2023-06-29' of http://git.kernel.org/pub/scm/linux/kernel/git/iwlwifi/linux-firmware 2023-07-06T21:27:07.981 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-06T21:27:07.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-06T21:27:08.151 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/ 2023-07-06T21:27:08.151 DEBUG:teuthology.orchestra.run.smithi055:> rm -f /tmp/linux-image.deb && echo linux-image-6.4.0-g84139c18d56f_6.4.0-g84139c18d56f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/ --input-file=- 2023-07-06T21:27:08.153 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi055.front.sepia.ceph.com to complete... 2023-07-06T21:27:09.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06 21:27:09 URL:https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/linux-image-6.4.0-g84139c18d56f_6.4.0-g84139c18d56f-1_amd64.deb [38588998/38588998] -> "/tmp/linux-image.deb" [1] 2023-07-06T21:27:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:FINISHED --2023-07-06 21:27:09-- 2023-07-06T21:27:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:Total wall clock time: 1.7s 2023-07-06T21:27:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:Downloaded: 1 files, 37M in 1.5s (25.0 MB/s) 2023-07-06T21:27:09.869 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-06T21:27:09.869 DEBUG:teuthology.orchestra.run.smithi055:> sudo dpkg -i /tmp/linux-image.deb 2023-07-06T21:27:09.992 INFO:teuthology.orchestra.run.smithi138.stderr:Updating files: 50% (1500/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1955/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 82% (2442/2977) Updating files: 82% (2447/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-06T21:27:09.996 INFO:teuthology.orchestra.run.smithi138.stdout:HEAD is now at 0bab5dfb Merge tag 'iwlwifi-fw-2023-06-29' of http://git.kernel.org/pub/scm/linux/kernel/git/iwlwifi/linux-firmware 2023-07-06T21:27:10.014 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.1... 2023-07-06T21:27:10.014 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-06T21:27:10.122 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package linux-image-6.4.0-g84139c18d56f. 2023-07-06T21:27:10.157 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/ 2023-07-06T21:27:10.158 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /tmp/linux-image.deb && echo linux-image-6.4.0-g84139c18d56f_6.4.0-g84139c18d56f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/ --input-file=- 2023-07-06T21:27:10.161 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi138.front.sepia.ceph.com to complete... 2023-07-06T21:27:12.140 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-07-06T21:27:12.144 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-06T21:27:12.251 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking linux-image-6.4.0-g84139c18d56f (6.4.0-g84139c18d56f-1) ... 2023-07-06T21:27:13.495 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06 21:27:13 URL:https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/linux-image-6.4.0-g84139c18d56f_6.4.0-g84139c18d56f-1_amd64.deb [38588998/38588998] -> "/tmp/linux-image.deb" [1] 2023-07-06T21:27:13.496 INFO:teuthology.orchestra.run.smithi138.stderr:FINISHED --2023-07-06 21:27:13-- 2023-07-06T21:27:13.496 INFO:teuthology.orchestra.run.smithi138.stderr:Total wall clock time: 3.3s 2023-07-06T21:27:13.496 INFO:teuthology.orchestra.run.smithi138.stderr:Downloaded: 1 files, 37M in 3.1s (12.0 MB/s) 2023-07-06T21:27:13.498 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.1... 2023-07-06T21:27:13.498 DEBUG:teuthology.orchestra.run.smithi138:> sudo dpkg -i /tmp/linux-image.deb 2023-07-06T21:27:13.804 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-image-6.4.0-g84139c18d56f. 2023-07-06T21:27:15.805 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-07-06T21:27:15.809 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-06T21:27:15.905 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-6.4.0-g84139c18d56f (6.4.0-g84139c18d56f-1) ... 2023-07-06T21:27:15.948 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up linux-image-6.4.0-g84139c18d56f (6.4.0-g84139c18d56f-1) ... 2023-07-06T21:27:16.055 INFO:teuthology.orchestra.run.smithi055.stderr:update-initramfs: Generating /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-06T21:27:19.496 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-6.4.0-g84139c18d56f (6.4.0-g84139c18d56f-1) ... 2023-07-06T21:27:19.603 INFO:teuthology.orchestra.run.smithi138.stderr:update-initramfs: Generating /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-06T21:27:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:Sourcing file `/etc/default/grub' 2023-07-06T21:27:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-06T21:27:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:Generating grub configuration file ... 2023-07-06T21:27:35.410 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-06T21:27:35.429 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-06T21:27:35.723 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-06T21:27:35.736 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-06T21:27:35.796 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-06T21:27:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-06T21:27:35.944 INFO:teuthology.orchestra.run.smithi055.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-06T21:27:35.945 INFO:teuthology.orchestra.run.smithi055.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-06T21:27:35.945 INFO:teuthology.orchestra.run.smithi055.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-06T21:27:35.983 INFO:teuthology.orchestra.run.smithi055.stderr:done 2023-07-06T21:27:36.146 DEBUG:teuthology.orchestra.run.smithi055:> dpkg-deb -c /tmp/linux-image.deb 2023-07-06T21:27:36.154 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./ 2023-07-06T21:27:36.155 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./boot/ 2023-07-06T21:27:36.155 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 4323582 2023-06-30 10:38 ./boot/System.map-6.4.0-g84139c18d56f 2023-07-06T21:27:36.167 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 167337 2023-06-30 10:38 ./boot/config-6.4.0-g84139c18d56f 2023-07-06T21:27:36.167 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11237632 2023-06-30 10:38 ./boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-06T21:27:36.187 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/ 2023-07-06T21:27:36.187 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/ 2023-07-06T21:27:36.187 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/postinst.d/ 2023-07-06T21:27:36.188 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/postrm.d/ 2023-07-06T21:27:36.188 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/preinst.d/ 2023-07-06T21:27:36.188 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/prerm.d/ 2023-07-06T21:27:36.188 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/ 2023-07-06T21:27:36.188 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/ 2023-07-06T21:27:36.188 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/ 2023-07-06T21:27:36.188 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/ 2023-07-06T21:27:36.189 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/ 2023-07-06T21:27:36.189 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/ 2023-07-06T21:27:36.189 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ 2023-07-06T21:27:36.189 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 490385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-06T21:27:36.189 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-06T21:27:36.189 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-06T21:27:36.189 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-06T21:27:36.190 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 92385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-06T21:27:36.190 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 106729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-06T21:27:36.190 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 152241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-06T21:27:36.191 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-06T21:27:36.192 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-06T21:27:36.192 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-06T21:27:36.192 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-06T21:27:36.192 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-06T21:27:36.192 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-06T21:27:36.192 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-06T21:27:36.193 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-06T21:27:36.193 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-06T21:27:36.193 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-06T21:27:36.193 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-06T21:27:36.193 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-06T21:27:36.193 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-06T21:27:36.193 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/ 2023-07-06T21:27:36.193 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/ 2023-07-06T21:27:36.194 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/ 2023-07-06T21:27:36.194 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-06T21:27:36.194 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpuid.ko 2023-07-06T21:27:36.194 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/msr.ko 2023-07-06T21:27:36.194 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/ 2023-07-06T21:27:36.194 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 346513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-06T21:27:36.194 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 972233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-06T21:27:36.195 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2209953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-06T21:27:36.198 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ 2023-07-06T21:27:36.198 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/af_alg.ko 2023-07-06T21:27:36.198 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/algif_hash.ko 2023-07-06T21:27:36.198 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/algif_skcipher.ko 2023-07-06T21:27:36.198 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-06T21:27:36.198 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-06T21:27:36.198 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-06T21:27:36.199 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/asymmetric_keys/ 2023-07-06T21:27:36.199 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-06T21:27:36.199 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/ 2023-07-06T21:27:36.199 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-06T21:27:36.199 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-06T21:27:36.199 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-06T21:27:36.199 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-06T21:27:36.200 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-06T21:27:36.200 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-06T21:27:36.200 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-06T21:27:36.200 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-06T21:27:36.200 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-06T21:27:36.200 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-06T21:27:36.200 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-06T21:27:36.200 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-06T21:27:36.201 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-06T21:27:36.201 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-06T21:27:36.201 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-06T21:27:36.201 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-06T21:27:36.201 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-06T21:27:36.201 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-06T21:27:36.201 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cryptd.ko 2023-07-06T21:27:36.202 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-06T21:27:36.202 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_simd.ko 2023-07-06T21:27:36.202 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-06T21:27:36.202 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-06T21:27:36.202 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-06T21:27:36.202 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-06T21:27:36.205 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-06T21:27:36.205 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-06T21:27:36.205 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-06T21:27:36.205 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-06T21:27:36.206 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lrw.ko 2023-07-06T21:27:36.206 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-06T21:27:36.206 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-06T21:27:36.206 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-06T21:27:36.206 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-06T21:27:36.206 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-06T21:27:36.207 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-06T21:27:36.207 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-06T21:27:36.207 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-06T21:27:36.208 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-06T21:27:36.208 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 149193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-06T21:27:36.220 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-06T21:27:36.221 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-06T21:27:36.221 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-06T21:27:36.221 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-06T21:27:36.221 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-06T21:27:36.221 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-06T21:27:36.221 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-06T21:27:36.222 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xts.ko 2023-07-06T21:27:36.222 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-06T21:27:36.222 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ 2023-07-06T21:27:36.222 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ 2023-07-06T21:27:36.222 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_extlog.ko 2023-07-06T21:27:36.222 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-06T21:27:36.222 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-06T21:27:36.222 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/apei/ 2023-07-06T21:27:36.223 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/apei/einj.ko 2023-07-06T21:27:36.223 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-06T21:27:36.223 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-06T21:27:36.223 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-06T21:27:36.223 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-06T21:27:36.223 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 98369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-06T21:27:36.223 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ 2023-07-06T21:27:36.224 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-06T21:27:36.224 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 88625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci.ko 2023-07-06T21:27:36.224 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-06T21:27:36.224 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 85193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci.ko 2023-07-06T21:27:36.224 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-06T21:27:36.224 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-06T21:27:36.224 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-06T21:27:36.224 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-06T21:27:36.225 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-06T21:27:36.225 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-06T21:27:36.225 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-06T21:27:36.225 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-06T21:27:36.225 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-06T21:27:36.225 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-06T21:27:36.225 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-06T21:27:36.225 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-06T21:27:36.226 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-06T21:27:36.226 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-06T21:27:36.226 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-06T21:27:36.226 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-06T21:27:36.226 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-06T21:27:36.226 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-06T21:27:36.226 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_legacy.ko 2023-07-06T21:27:36.227 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-06T21:27:36.227 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-06T21:27:36.227 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-06T21:27:36.227 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-06T21:27:36.227 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-06T21:27:36.227 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-06T21:27:36.227 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-06T21:27:36.227 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-06T21:27:36.228 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-06T21:27:36.228 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-06T21:27:36.228 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-06T21:27:36.228 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-06T21:27:36.228 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-06T21:27:36.228 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_radisys.ko 2023-07-06T21:27:36.228 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-06T21:27:36.229 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rz1000.ko 2023-07-06T21:27:36.229 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-06T21:27:36.229 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-06T21:27:36.229 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-06T21:27:36.229 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-06T21:27:36.229 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-06T21:27:36.229 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-06T21:27:36.229 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-06T21:27:36.230 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-06T21:27:36.230 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-06T21:27:36.230 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-06T21:27:36.230 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-06T21:27:36.230 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-06T21:27:36.230 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-06T21:27:36.230 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-06T21:27:36.230 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-06T21:27:36.231 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-06T21:27:36.231 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-06T21:27:36.231 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-06T21:27:36.231 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-06T21:27:36.231 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-06T21:27:36.231 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ 2023-07-06T21:27:36.231 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-06T21:27:36.232 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/ 2023-07-06T21:27:36.232 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 121681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-06T21:27:36.232 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/ 2023-07-06T21:27:36.232 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/ 2023-07-06T21:27:36.232 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 113617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-06T21:27:36.232 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/ 2023-07-06T21:27:36.232 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 968129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-06T21:27:36.233 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 173225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-06T21:27:36.233 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/ 2023-07-06T21:27:36.233 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 94297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-06T21:27:36.233 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 114169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-06T21:27:36.233 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/ 2023-07-06T21:27:36.233 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 110361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-06T21:27:36.233 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-06T21:27:36.233 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 257529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-06T21:27:36.234 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/ 2023-07-06T21:27:36.234 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 98193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-06T21:27:36.234 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/ 2023-07-06T21:27:36.234 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-06T21:27:36.234 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ 2023-07-06T21:27:36.234 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/applicom.ko 2023-07-06T21:27:36.234 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-06T21:27:36.234 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/ 2023-07-06T21:27:36.235 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-06T21:27:36.235 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-06T21:27:36.235 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-06T21:27:36.235 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-06T21:27:36.235 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-06T21:27:36.235 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ 2023-07-06T21:27:36.235 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-06T21:27:36.236 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 147705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-06T21:27:36.236 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-06T21:27:36.236 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 139057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-06T21:27:36.236 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-06T21:27:36.236 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-06T21:27:36.236 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-06T21:27:36.236 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/ 2023-07-06T21:27:36.237 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 84121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-06T21:27:36.237 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/nvram.ko 2023-07-06T21:27:36.237 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-06T21:27:36.237 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-06T21:27:36.237 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/ 2023-07-06T21:27:36.237 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-06T21:27:36.237 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-06T21:27:36.237 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-06T21:27:36.238 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-06T21:27:36.238 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-06T21:27:36.238 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-06T21:27:36.238 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-06T21:27:36.238 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/ 2023-07-06T21:27:36.238 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-06T21:27:36.238 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-06T21:27:36.238 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-06T21:27:36.239 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/ 2023-07-06T21:27:36.239 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-palmas.ko 2023-07-06T21:27:36.239 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-si5351.ko 2023-07-06T21:27:36.239 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-twl6040.ko 2023-07-06T21:27:36.239 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-wm831x.ko 2023-07-06T21:27:36.239 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/ 2023-07-06T21:27:36.239 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-06T21:27:36.240 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-06T21:27:36.240 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-06T21:27:36.240 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ 2023-07-06T21:27:36.240 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ 2023-07-06T21:27:36.240 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-06T21:27:36.240 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 231713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-06T21:27:36.240 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/ 2023-07-06T21:27:36.241 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/ 2023-07-06T21:27:36.241 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-06T21:27:36.241 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 396457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-06T21:27:36.241 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-06T21:27:36.241 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-06T21:27:36.241 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-06T21:27:36.241 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-06T21:27:36.241 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/ 2023-07-06T21:27:36.242 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-06T21:27:36.242 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/ 2023-07-06T21:27:36.242 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-06T21:27:36.242 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ 2023-07-06T21:27:36.242 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/ 2023-07-06T21:27:36.242 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-06T21:27:36.242 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ 2023-07-06T21:27:36.242 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 122649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-06T21:27:36.243 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ 2023-07-06T21:27:36.243 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 75521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-06T21:27:36.243 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-06T21:27:36.243 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-06T21:27:36.243 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-06T21:27:36.243 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-06T21:27:36.243 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-06T21:27:36.244 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-06T21:27:36.244 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-06T21:27:36.244 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-06T21:27:36.244 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-06T21:27:36.244 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-06T21:27:36.245 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-06T21:27:36.245 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-06T21:27:36.245 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/ 2023-07-06T21:27:36.245 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-gpio.ko 2023-07-06T21:27:36.245 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max14577.ko 2023-07-06T21:27:36.245 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max77693.ko 2023-07-06T21:27:36.245 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max8997.ko 2023-07-06T21:27:36.245 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-palmas.ko 2023-07-06T21:27:36.246 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-06T21:27:36.246 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-06T21:27:36.246 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/ 2023-07-06T21:27:36.246 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-06T21:27:36.246 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/efi/ 2023-07-06T21:27:36.246 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-06T21:27:36.246 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-06T21:27:36.246 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/ 2023-07-06T21:27:36.247 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-06T21:27:36.247 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-06T21:27:36.247 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-arizona.ko 2023-07-06T21:27:36.247 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-da9052.ko 2023-07-06T21:27:36.247 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-da9055.ko 2023-07-06T21:27:36.247 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-dln2.ko 2023-07-06T21:27:36.247 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-06T21:27:36.248 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-generic.ko 2023-07-06T21:27:36.248 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-06T21:27:36.248 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-06T21:27:36.248 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-kempld.ko 2023-07-06T21:27:36.248 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-06T21:27:36.248 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max7300.ko 2023-07-06T21:27:36.248 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max730x.ko 2023-07-06T21:27:36.248 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max732x.ko 2023-07-06T21:27:36.249 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-06T21:27:36.249 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-06T21:27:36.249 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-06T21:27:36.249 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-06T21:27:36.249 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-sch.ko 2023-07-06T21:27:36.249 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-06T21:27:36.249 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-06T21:27:36.250 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-06T21:27:36.250 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-06T21:27:36.250 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-06T21:27:36.250 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-vx855.ko 2023-07-06T21:27:36.250 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-06T21:27:36.250 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-06T21:27:36.250 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-06T21:27:36.250 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/ 2023-07-06T21:27:36.251 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-a4tech.ko 2023-07-06T21:27:36.251 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-apple.ko 2023-07-06T21:27:36.251 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-06T21:27:36.251 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-06T21:27:36.251 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-06T21:27:36.251 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-belkin.ko 2023-07-06T21:27:36.251 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cherry.ko 2023-07-06T21:27:36.251 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-chicony.ko 2023-07-06T21:27:36.252 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cp2112.ko 2023-07-06T21:27:36.252 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cypress.ko 2023-07-06T21:27:36.252 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-06T21:27:36.252 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-06T21:27:36.252 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-06T21:27:36.252 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-06T21:27:36.252 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ezkey.ko 2023-07-06T21:27:36.253 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-06T21:27:36.253 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-generic.ko 2023-07-06T21:27:36.253 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-06T21:27:36.253 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-06T21:27:36.253 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-06T21:27:36.253 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-06T21:27:36.253 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-06T21:27:36.253 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-06T21:27:36.254 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-06T21:27:36.254 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kensington.ko 2023-07-06T21:27:36.254 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-06T21:27:36.254 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-06T21:27:36.254 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-06T21:27:36.254 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-06T21:27:36.254 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-06T21:27:36.255 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lg-g15.ko 2023-07-06T21:27:36.255 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-06T21:27:36.255 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-06T21:27:36.255 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech.ko 2023-07-06T21:27:36.255 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-magicmouse.ko 2023-07-06T21:27:36.255 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-microsoft.ko 2023-07-06T21:27:36.255 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-monterey.ko 2023-07-06T21:27:36.255 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-06T21:27:36.256 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ntrig.ko 2023-07-06T21:27:36.256 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-06T21:27:36.256 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-06T21:27:36.256 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-06T21:27:36.256 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-06T21:27:36.256 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-06T21:27:36.256 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-06T21:27:36.256 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-06T21:27:36.257 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-06T21:27:36.257 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-06T21:27:36.257 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-06T21:27:36.257 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-06T21:27:36.257 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-06T21:27:36.257 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-06T21:27:36.257 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-06T21:27:36.258 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-06T21:27:36.258 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-06T21:27:36.258 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-06T21:27:36.258 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-06T21:27:36.258 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-06T21:27:36.258 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-06T21:27:36.258 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-06T21:27:36.258 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-06T21:27:36.259 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-06T21:27:36.259 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-06T21:27:36.259 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-06T21:27:36.259 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-06T21:27:36.259 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-06T21:27:36.259 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-06T21:27:36.259 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-06T21:27:36.259 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-06T21:27:36.260 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-06T21:27:36.260 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-06T21:27:36.260 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-06T21:27:36.260 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-06T21:27:36.260 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-06T21:27:36.260 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 143585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-06T21:27:36.260 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-06T21:27:36.261 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-06T21:27:36.261 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-06T21:27:36.261 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 261881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid.ko 2023-07-06T21:27:36.261 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-06T21:27:36.261 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/ 2023-07-06T21:27:36.261 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 125425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-06T21:27:36.261 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-06T21:27:36.261 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-06T21:27:36.262 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 217401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-06T21:27:36.262 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/ 2023-07-06T21:27:36.262 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-06T21:27:36.262 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-06T21:27:36.262 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 292697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-06T21:27:36.286 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ 2023-07-06T21:27:36.287 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-06T21:27:36.287 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-06T21:27:36.287 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-06T21:27:36.287 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-06T21:27:36.287 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-06T21:27:36.288 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-06T21:27:36.288 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-06T21:27:36.288 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 97977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-06T21:27:36.288 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-06T21:27:36.288 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-06T21:27:36.288 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-06T21:27:36.288 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-06T21:27:36.288 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-06T21:27:36.289 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-06T21:27:36.289 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 74433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-06T21:27:36.289 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-06T21:27:36.289 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 65321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-06T21:27:36.289 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-06T21:27:36.289 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-06T21:27:36.289 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-06T21:27:36.290 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-06T21:27:36.290 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-06T21:27:36.290 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-06T21:27:36.290 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-06T21:27:36.290 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-06T21:27:36.290 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-06T21:27:36.290 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-06T21:27:36.290 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-06T21:27:36.291 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 99601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-06T21:27:36.291 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-06T21:27:36.291 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-06T21:27:36.291 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-06T21:27:36.291 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc2103.ko 2023-07-06T21:27:36.291 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-06T21:27:36.291 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-06T21:27:36.291 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 94641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-06T21:27:36.292 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-06T21:27:36.292 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-06T21:27:36.292 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-06T21:27:36.292 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-06T21:27:36.292 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-06T21:27:36.292 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-06T21:27:36.292 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-06T21:27:36.293 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hih6130.ko 2023-07-06T21:27:36.293 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-06T21:27:36.293 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-06T21:27:36.293 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-06T21:27:36.293 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-06T21:27:36.293 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-06T21:27:36.293 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-06T21:27:36.293 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-06T21:27:36.294 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 129025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-06T21:27:36.294 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/jc42.ko 2023-07-06T21:27:36.294 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-06T21:27:36.294 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-06T21:27:36.294 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-06T21:27:36.294 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-06T21:27:36.294 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-06T21:27:36.294 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-06T21:27:36.295 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-06T21:27:36.295 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-06T21:27:36.295 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-06T21:27:36.295 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-06T21:27:36.295 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-06T21:27:36.295 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-06T21:27:36.295 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-06T21:27:36.295 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-06T21:27:36.296 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-06T21:27:36.296 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-06T21:27:36.296 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-06T21:27:36.296 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-06T21:27:36.296 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-06T21:27:36.296 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-06T21:27:36.296 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-06T21:27:36.297 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-06T21:27:36.297 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-06T21:27:36.297 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-06T21:27:36.297 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-06T21:27:36.297 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-06T21:27:36.297 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-06T21:27:36.297 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-06T21:27:36.297 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-06T21:27:36.298 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-06T21:27:36.298 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-06T21:27:36.298 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-06T21:27:36.298 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-06T21:27:36.298 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-06T21:27:36.298 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-06T21:27:36.298 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-06T21:27:36.299 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 114753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-06T21:27:36.299 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-06T21:27:36.299 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-06T21:27:36.299 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 82337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-06T21:27:36.299 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-06T21:27:36.299 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-06T21:27:36.299 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ 2023-07-06T21:27:36.299 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-06T21:27:36.300 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-06T21:27:36.300 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-06T21:27:36.300 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-06T21:27:36.300 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-06T21:27:36.300 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-06T21:27:36.300 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-06T21:27:36.300 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 79465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-06T21:27:36.300 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-06T21:27:36.301 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-06T21:27:36.301 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-06T21:27:36.301 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-06T21:27:36.301 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-06T21:27:36.301 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-06T21:27:36.301 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-06T21:27:36.301 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-06T21:27:36.301 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-06T21:27:36.302 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-06T21:27:36.302 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-06T21:27:36.302 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-06T21:27:36.302 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smm665.ko 2023-07-06T21:27:36.302 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-06T21:27:36.302 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-06T21:27:36.302 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-06T21:27:36.303 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-06T21:27:36.303 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-06T21:27:36.303 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-06T21:27:36.303 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-06T21:27:36.303 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-06T21:27:36.303 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-06T21:27:36.303 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-06T21:27:36.303 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-06T21:27:36.304 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-06T21:27:36.304 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-06T21:27:36.304 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-06T21:27:36.304 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-06T21:27:36.304 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-06T21:27:36.304 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-06T21:27:36.304 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-06T21:27:36.304 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 119505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-06T21:27:36.305 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-06T21:27:36.305 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-06T21:27:36.305 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-06T21:27:36.305 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-06T21:27:36.305 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/ 2023-07-06T21:27:36.305 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/ 2023-07-06T21:27:36.305 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-06T21:27:36.306 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-06T21:27:36.306 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/ 2023-07-06T21:27:36.306 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-06T21:27:36.306 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-06T21:27:36.306 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-06T21:27:36.306 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-06T21:27:36.306 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-06T21:27:36.306 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-06T21:27:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-06T21:27:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-06T21:27:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-06T21:27:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-06T21:27:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-06T21:27:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-06T21:27:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-06T21:27:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-06T21:27:36.308 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-06T21:27:36.308 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-06T21:27:36.308 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-06T21:27:36.308 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-06T21:27:36.308 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-06T21:27:36.308 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-06T21:27:36.308 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-06T21:27:36.309 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-06T21:27:36.309 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-06T21:27:36.309 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-06T21:27:36.309 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-06T21:27:36.310 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-06T21:27:36.310 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-06T21:27:36.310 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-06T21:27:36.310 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-06T21:27:36.310 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-06T21:27:36.310 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-06T21:27:36.311 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-06T21:27:36.311 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-06T21:27:36.311 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-06T21:27:36.311 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-06T21:27:36.311 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-06T21:27:36.311 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-06T21:27:36.311 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-06T21:27:36.311 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-06T21:27:36.312 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-06T21:27:36.312 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/ 2023-07-06T21:27:36.312 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-06T21:27:36.312 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-06T21:27:36.312 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-06T21:27:36.312 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ 2023-07-06T21:27:36.312 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ 2023-07-06T21:27:36.313 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 264521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-06T21:27:36.313 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 849289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-06T21:27:36.313 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-06T21:27:36.313 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 320385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-06T21:27:36.313 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 96969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-06T21:27:36.313 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 271697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-06T21:27:36.313 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-06T21:27:36.313 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ 2023-07-06T21:27:36.314 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-06T21:27:36.314 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 492561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-06T21:27:36.314 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/ 2023-07-06T21:27:36.314 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 419217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-06T21:27:36.314 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/ 2023-07-06T21:27:36.314 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 738161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-06T21:27:36.314 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ 2023-07-06T21:27:36.314 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 296665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-06T21:27:36.315 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-06T21:27:36.315 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 153681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-06T21:27:36.315 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/usnic/ 2023-07-06T21:27:36.315 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 169017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-06T21:27:36.315 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ 2023-07-06T21:27:36.315 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-06T21:27:36.315 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 263177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-06T21:27:36.316 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ 2023-07-06T21:27:36.316 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-06T21:27:36.316 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ 2023-07-06T21:27:36.316 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 111993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-06T21:27:36.316 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ 2023-07-06T21:27:36.316 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 129081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-06T21:27:36.316 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ 2023-07-06T21:27:36.317 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 129553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-06T21:27:36.317 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/ 2023-07-06T21:27:36.317 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/evbug.ko 2023-07-06T21:27:36.317 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/ff-memless.ko 2023-07-06T21:27:36.317 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ 2023-07-06T21:27:36.317 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-06T21:27:36.317 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-06T21:27:36.317 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-06T21:27:36.318 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-06T21:27:36.318 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-06T21:27:36.318 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-06T21:27:36.318 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/ 2023-07-06T21:27:36.318 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-06T21:27:36.318 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-06T21:27:36.318 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-06T21:27:36.319 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-06T21:27:36.319 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-06T21:27:36.319 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-06T21:27:36.319 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-06T21:27:36.319 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lm8323.ko 2023-07-06T21:27:36.319 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lm8333.ko 2023-07-06T21:27:36.319 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-06T21:27:36.319 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-06T21:27:36.320 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-06T21:27:36.320 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-06T21:27:36.320 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-06T21:27:36.320 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-06T21:27:36.320 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/qt1070.ko 2023-07-06T21:27:36.320 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/qt2160.ko 2023-07-06T21:27:36.320 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-06T21:27:36.320 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/stowaway.ko 2023-07-06T21:27:36.321 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-06T21:27:36.321 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-06T21:27:36.321 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-06T21:27:36.321 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-06T21:27:36.321 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-06T21:27:36.321 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/matrix-keymap.ko 2023-07-06T21:27:36.321 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/ 2023-07-06T21:27:36.322 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-06T21:27:36.322 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-06T21:27:36.322 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 123681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-06T21:27:36.322 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-06T21:27:36.322 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-06T21:27:36.322 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 334505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/psmouse.ko 2023-07-06T21:27:36.322 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-06T21:27:36.322 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-06T21:27:36.323 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-06T21:27:36.323 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-06T21:27:36.323 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/ 2023-07-06T21:27:36.323 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-06T21:27:36.323 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ 2023-07-06T21:27:36.323 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-06T21:27:36.323 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-06T21:27:36.323 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ct82c710.ko 2023-07-06T21:27:36.324 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-06T21:27:36.324 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/parkbd.ko 2023-07-06T21:27:36.324 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/pcips2.ko 2023-07-06T21:27:36.324 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ps2mult.ko 2023-07-06T21:27:36.324 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-06T21:27:36.324 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serport.ko 2023-07-06T21:27:36.324 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-06T21:27:36.325 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/ 2023-07-06T21:27:36.325 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/ 2023-07-06T21:27:36.325 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-06T21:27:36.325 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/ 2023-07-06T21:27:36.325 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-88pm860x.ko 2023-07-06T21:27:36.325 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-adp5520.ko 2023-07-06T21:27:36.325 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-bd2802.ko 2023-07-06T21:27:36.325 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-06T21:27:36.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-da903x.ko 2023-07-06T21:27:36.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-da9052.ko 2023-07-06T21:27:36.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-gpio.ko 2023-07-06T21:27:36.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-06T21:27:36.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3533.ko 2023-07-06T21:27:36.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm355x.ko 2023-07-06T21:27:36.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3642.ko 2023-07-06T21:27:36.327 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-06T21:27:36.327 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp8788.ko 2023-07-06T21:27:36.327 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-max8997.ko 2023-07-06T21:27:36.327 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-mc13783.ko 2023-07-06T21:27:36.327 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-06T21:27:36.327 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca9532.ko 2023-07-06T21:27:36.327 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca955x.ko 2023-07-06T21:27:36.327 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca963x.ko 2023-07-06T21:27:36.328 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-06T21:27:36.328 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-tca6507.ko 2023-07-06T21:27:36.328 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-06T21:27:36.328 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-wm8350.ko 2023-07-06T21:27:36.328 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ 2023-07-06T21:27:36.328 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-06T21:27:36.328 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-06T21:27:36.328 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-06T21:27:36.329 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-06T21:27:36.329 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-06T21:27:36.329 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-06T21:27:36.329 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-06T21:27:36.329 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-06T21:27:36.329 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/ 2023-07-06T21:27:36.329 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/ 2023-07-06T21:27:36.329 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 631833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-06T21:27:36.330 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-06T21:27:36.330 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 86145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bufio.ko 2023-07-06T21:27:36.330 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-06T21:27:36.330 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 154273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-06T21:27:36.330 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 105673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-06T21:27:36.330 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-06T21:27:36.330 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-era.ko 2023-07-06T21:27:36.331 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-06T21:27:36.331 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-06T21:27:36.331 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log.ko 2023-07-06T21:27:36.331 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-mirror.ko 2023-07-06T21:27:36.331 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 77617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-06T21:27:36.331 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-06T21:27:36.331 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-06T21:27:36.331 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-region-hash.ko 2023-07-06T21:27:36.332 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-06T21:27:36.332 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-06T21:27:36.332 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-snapshot.ko 2023-07-06T21:27:36.332 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-06T21:27:36.332 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 182185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-06T21:27:36.332 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-06T21:27:36.332 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-zero.ko 2023-07-06T21:27:36.332 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-06T21:27:36.333 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-06T21:27:36.333 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-06T21:27:36.333 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/ 2023-07-06T21:27:36.333 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 192841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-06T21:27:36.333 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-06T21:27:36.333 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 111465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-06T21:27:36.333 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 157993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-06T21:27:36.334 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 392889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-06T21:27:36.334 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/ 2023-07-06T21:27:36.334 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/ 2023-07-06T21:27:36.334 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 174497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-06T21:27:36.334 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-06T21:27:36.334 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-06T21:27:36.334 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-06T21:27:36.334 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 123305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-06T21:27:36.335 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 76121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-06T21:27:36.335 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-06T21:27:36.335 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/ 2023-07-06T21:27:36.335 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm800.ko 2023-07-06T21:27:36.335 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm805.ko 2023-07-06T21:27:36.335 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm80x.ko 2023-07-06T21:27:36.335 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/arizona-i2c.ko 2023-07-06T21:27:36.335 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 121833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/arizona.ko 2023-07-06T21:27:36.336 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/bcm590xx.ko 2023-07-06T21:27:36.336 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-06T21:27:36.336 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/dln2.ko 2023-07-06T21:27:36.336 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/janz-cmodio.ko 2023-07-06T21:27:36.336 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/kempld-core.ko 2023-07-06T21:27:36.336 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lm3533-core.ko 2023-07-06T21:27:36.336 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-06T21:27:36.337 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lp3943.ko 2023-07-06T21:27:36.337 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-06T21:27:36.337 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-06T21:27:36.337 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/max8907.ko 2023-07-06T21:27:36.337 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-06T21:27:36.337 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-06T21:27:36.337 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/menf21bmc.ko 2023-07-06T21:27:36.338 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-06T21:27:36.338 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-06T21:27:36.338 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633.ko 2023-07-06T21:27:36.338 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-06T21:27:36.338 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/retu-mfd.ko 2023-07-06T21:27:36.338 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 76545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/si476x-core.ko 2023-07-06T21:27:36.338 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-06T21:27:36.338 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-06T21:27:36.339 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/tps65010.ko 2023-07-06T21:27:36.339 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/tps6507x.ko 2023-07-06T21:27:36.339 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-06T21:27:36.339 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-06T21:27:36.339 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-06T21:27:36.339 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wm8994.ko 2023-07-06T21:27:36.339 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ 2023-07-06T21:27:36.339 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-06T21:27:36.340 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ad525x_dpot.ko 2023-07-06T21:27:36.340 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/ 2023-07-06T21:27:36.340 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-06T21:27:36.340 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-06T21:27:36.340 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-06T21:27:36.340 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-06T21:27:36.340 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/ 2023-07-06T21:27:36.341 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-06T21:27:36.341 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/core.ko 2023-07-06T21:27:36.341 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/ 2023-07-06T21:27:36.341 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-06T21:27:36.341 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ds1682.ko 2023-07-06T21:27:36.341 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/dummy-irq.ko 2023-07-06T21:27:36.341 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/echo/ 2023-07-06T21:27:36.341 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/echo/echo.ko 2023-07-06T21:27:36.342 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/ 2023-07-06T21:27:36.342 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-06T21:27:36.342 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-06T21:27:36.342 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-06T21:27:36.342 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-06T21:27:36.342 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-06T21:27:36.342 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/genwqe/ 2023-07-06T21:27:36.342 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 152073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-06T21:27:36.343 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hmc6352.ko 2023-07-06T21:27:36.343 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-06T21:27:36.343 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ibmasm/ 2023-07-06T21:27:36.343 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-06T21:27:36.343 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ics932s401.ko 2023-07-06T21:27:36.343 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-06T21:27:36.343 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-06T21:27:36.343 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/ 2023-07-06T21:27:36.344 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-06T21:27:36.344 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-06T21:27:36.344 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/ 2023-07-06T21:27:36.344 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 124569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-06T21:27:36.344 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-06T21:27:36.344 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 304465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-06T21:27:36.344 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/phantom.ko 2023-07-06T21:27:36.345 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ti-st/ 2023-07-06T21:27:36.345 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 74609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-06T21:27:36.345 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-06T21:27:36.345 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-06T21:27:36.345 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-06T21:27:36.345 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-06T21:27:36.345 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/ 2023-07-06T21:27:36.345 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 180817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-06T21:27:36.346 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ 2023-07-06T21:27:36.346 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/ 2023-07-06T21:27:36.346 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 487993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-06T21:27:36.346 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/ 2023-07-06T21:27:36.346 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/ 2023-07-06T21:27:36.346 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 102129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-06T21:27:36.346 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-06T21:27:36.346 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-06T21:27:36.347 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-06T21:27:36.347 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 447289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-06T21:27:36.347 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-06T21:27:36.347 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-06T21:27:36.347 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ 2023-07-06T21:27:36.347 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/ 2023-07-06T21:27:36.347 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-06T21:27:36.347 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-06T21:27:36.348 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 130489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-06T21:27:36.348 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-06T21:27:36.348 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ 2023-07-06T21:27:36.348 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-06T21:27:36.348 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-06T21:27:36.348 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-06T21:27:36.348 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 99049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-06T21:27:36.349 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/ 2023-07-06T21:27:36.349 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-06T21:27:36.349 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/ 2023-07-06T21:27:36.349 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-06T21:27:36.349 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/ 2023-07-06T21:27:36.349 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-06T21:27:36.349 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/ 2023-07-06T21:27:36.349 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-06T21:27:36.350 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/ 2023-07-06T21:27:36.350 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-06T21:27:36.350 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-06T21:27:36.350 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 87345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-06T21:27:36.350 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/ 2023-07-06T21:27:36.350 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-06T21:27:36.350 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 97321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-06T21:27:36.350 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-06T21:27:36.351 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 104585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-06T21:27:36.351 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-06T21:27:36.351 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 90257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-06T21:27:36.351 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-06T21:27:36.351 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-06T21:27:36.351 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-06T21:27:36.351 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/ 2023-07-06T21:27:36.352 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-06T21:27:36.352 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 176817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-06T21:27:36.352 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-06T21:27:36.352 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1422209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-06T21:27:36.352 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 127993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-06T21:27:36.352 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-06T21:27:36.352 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 131241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-06T21:27:36.353 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 312097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-06T21:27:36.353 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/ 2023-07-06T21:27:36.353 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-06T21:27:36.353 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 323601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-06T21:27:36.353 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/ 2023-07-06T21:27:36.353 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-06T21:27:36.353 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 193433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-06T21:27:36.354 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-06T21:27:36.354 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 345929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-06T21:27:36.354 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-06T21:27:36.354 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1038969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-06T21:27:36.354 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-06T21:27:36.354 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 166113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-06T21:27:36.354 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-06T21:27:36.354 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-06T21:27:36.355 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/ 2023-07-06T21:27:36.355 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-06T21:27:36.355 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 203537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-06T21:27:36.355 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/ 2023-07-06T21:27:36.355 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-06T21:27:36.355 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-06T21:27:36.355 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-06T21:27:36.355 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 141161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-06T21:27:36.356 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-06T21:27:36.356 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-06T21:27:36.356 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-06T21:27:36.356 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/ 2023-07-06T21:27:36.356 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-06T21:27:36.356 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-06T21:27:36.356 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-06T21:27:36.356 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-06T21:27:36.357 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/ 2023-07-06T21:27:36.357 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-06T21:27:36.357 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 281033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-06T21:27:36.357 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-06T21:27:36.357 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-06T21:27:36.357 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fujitsu/ 2023-07-06T21:27:36.357 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-06T21:27:36.358 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ 2023-07-06T21:27:36.358 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 90465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-06T21:27:36.358 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-06T21:27:36.358 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 295713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-06T21:27:36.358 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-06T21:27:36.358 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 584001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-06T21:27:36.358 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-06T21:27:36.358 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 246321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-06T21:27:36.359 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-06T21:27:36.359 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 922401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-06T21:27:36.359 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-06T21:27:36.359 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 301689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-06T21:27:36.359 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/ 2023-07-06T21:27:36.359 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 514641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-06T21:27:36.359 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-06T21:27:36.359 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 93593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-06T21:27:36.360 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-06T21:27:36.360 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 734081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-06T21:27:36.399 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-06T21:27:36.400 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 151865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-06T21:27:36.400 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 86921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-06T21:27:36.400 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/ 2023-07-06T21:27:36.400 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-06T21:27:36.400 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 102385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-06T21:27:36.400 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 122681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-06T21:27:36.401 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/ 2023-07-06T21:27:36.401 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-06T21:27:36.401 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 710481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-06T21:27:36.401 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 280513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-06T21:27:36.401 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-06T21:27:36.401 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-06T21:27:36.401 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1054153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-06T21:27:36.402 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ 2023-07-06T21:27:36.402 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-06T21:27:36.402 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-06T21:27:36.402 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-06T21:27:36.402 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 95665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-06T21:27:36.402 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/ 2023-07-06T21:27:36.402 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-06T21:27:36.402 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-06T21:27:36.403 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ 2023-07-06T21:27:36.403 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-06T21:27:36.403 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-06T21:27:36.403 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/ 2023-07-06T21:27:36.403 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 150905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-06T21:27:36.403 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/ 2023-07-06T21:27:36.403 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 136785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-06T21:27:36.404 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/ 2023-07-06T21:27:36.404 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-06T21:27:36.404 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-06T21:27:36.404 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/ 2023-07-06T21:27:36.404 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-06T21:27:36.404 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 227113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-06T21:27:36.404 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 87081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-06T21:27:36.405 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-06T21:27:36.405 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 671393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-06T21:27:36.405 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/ 2023-07-06T21:27:36.405 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-06T21:27:36.405 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/ 2023-07-06T21:27:36.405 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-06T21:27:36.405 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-06T21:27:36.405 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-06T21:27:36.406 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 189817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-06T21:27:36.406 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/ 2023-07-06T21:27:36.406 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-06T21:27:36.406 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 104241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-06T21:27:36.406 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/ 2023-07-06T21:27:36.406 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 893097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-06T21:27:36.406 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/ 2023-07-06T21:27:36.406 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-06T21:27:36.407 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/ 2023-07-06T21:27:36.407 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-06T21:27:36.407 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-06T21:27:36.407 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/ 2023-07-06T21:27:36.407 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-06T21:27:36.407 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-06T21:27:36.407 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-06T21:27:36.408 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-06T21:27:36.408 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/ 2023-07-06T21:27:36.408 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-06T21:27:36.408 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-06T21:27:36.408 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-06T21:27:36.408 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-06T21:27:36.408 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 480865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-06T21:27:36.408 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/ 2023-07-06T21:27:36.409 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 103457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-06T21:27:36.409 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 166121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-06T21:27:36.409 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-06T21:27:36.409 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-06T21:27:36.409 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/ 2023-07-06T21:27:36.409 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-06T21:27:36.409 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/ 2023-07-06T21:27:36.410 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 86465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-06T21:27:36.410 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/ 2023-07-06T21:27:36.410 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-06T21:27:36.410 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-06T21:27:36.410 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/ 2023-07-06T21:27:36.410 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-06T21:27:36.410 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-06T21:27:36.410 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/ 2023-07-06T21:27:36.411 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-06T21:27:36.411 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/ 2023-07-06T21:27:36.411 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/defxx.ko 2023-07-06T21:27:36.411 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/skfp/ 2023-07-06T21:27:36.411 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 216913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-06T21:27:36.411 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 77169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-06T21:27:36.411 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/ 2023-07-06T21:27:36.411 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 234553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-06T21:27:36.412 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/ 2023-07-06T21:27:36.412 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-06T21:27:36.412 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-06T21:27:36.412 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ 2023-07-06T21:27:36.412 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-06T21:27:36.412 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-06T21:27:36.412 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-06T21:27:36.413 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/ 2023-07-06T21:27:36.413 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-06T21:27:36.413 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-06T21:27:36.413 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-06T21:27:36.413 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-06T21:27:36.413 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-06T21:27:36.413 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-06T21:27:36.413 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-06T21:27:36.414 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/ 2023-07-06T21:27:36.414 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-06T21:27:36.414 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-06T21:27:36.414 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ 2023-07-06T21:27:36.414 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-06T21:27:36.414 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-06T21:27:36.414 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-06T21:27:36.414 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-06T21:27:36.415 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-06T21:27:36.415 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-06T21:27:36.415 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-06T21:27:36.415 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-06T21:27:36.415 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-06T21:27:36.415 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-06T21:27:36.415 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-06T21:27:36.415 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 75865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-06T21:27:36.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-06T21:27:36.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 92249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-06T21:27:36.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-06T21:27:36.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-06T21:27:36.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-06T21:27:36.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-06T21:27:36.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-06T21:27:36.416 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/plip/ 2023-07-06T21:27:36.417 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/plip/plip.ko 2023-07-06T21:27:36.417 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ 2023-07-06T21:27:36.417 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-06T21:27:36.417 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-06T21:27:36.417 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-06T21:27:36.417 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-06T21:27:36.417 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-06T21:27:36.418 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-06T21:27:36.418 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-06T21:27:36.418 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-06T21:27:36.418 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sb1000.ko 2023-07-06T21:27:36.418 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/ 2023-07-06T21:27:36.418 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-06T21:27:36.418 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-06T21:27:36.418 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-06T21:27:36.419 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/ 2023-07-06T21:27:36.419 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 104985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-06T21:27:36.419 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-06T21:27:36.419 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-06T21:27:36.419 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-06T21:27:36.419 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-06T21:27:36.419 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-06T21:27:36.419 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-06T21:27:36.420 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/ 2023-07-06T21:27:36.420 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 120497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-06T21:27:36.420 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/ 2023-07-06T21:27:36.420 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 290161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-06T21:27:36.420 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/ 2023-07-06T21:27:36.420 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 143801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-06T21:27:36.420 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ 2023-07-06T21:27:36.420 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-06T21:27:36.421 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/ 2023-07-06T21:27:36.421 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/ 2023-07-06T21:27:36.421 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 256953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-06T21:27:36.421 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 102057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-06T21:27:36.421 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/ 2023-07-06T21:27:36.421 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 129129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-06T21:27:36.421 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-06T21:27:36.421 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-06T21:27:36.422 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-06T21:27:36.422 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/ 2023-07-06T21:27:36.422 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/ 2023-07-06T21:27:36.422 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-06T21:27:36.422 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-06T21:27:36.422 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-06T21:27:36.422 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pci-stub.ko 2023-07-06T21:27:36.423 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-06T21:27:36.423 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/ 2023-07-06T21:27:36.423 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-06T21:27:36.423 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 143713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia.ko 2023-07-06T21:27:36.423 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-06T21:27:36.423 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-06T21:27:36.423 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-06T21:27:36.423 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 112913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-06T21:27:36.424 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/ 2023-07-06T21:27:36.424 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/broadcom/ 2023-07-06T21:27:36.424 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-06T21:27:36.424 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/samsung/ 2023-07-06T21:27:36.424 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-06T21:27:36.424 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/ 2023-07-06T21:27:36.424 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/ 2023-07-06T21:27:36.424 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-06T21:27:36.425 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/ 2023-07-06T21:27:36.425 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/ 2023-07-06T21:27:36.425 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-06T21:27:36.425 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-06T21:27:36.425 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-06T21:27:36.425 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-06T21:27:36.425 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-06T21:27:36.425 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-06T21:27:36.426 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-06T21:27:36.426 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/ 2023-07-06T21:27:36.426 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-06T21:27:36.426 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-06T21:27:36.426 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-06T21:27:36.426 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-06T21:27:36.426 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-06T21:27:36.427 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 106393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-06T21:27:36.427 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-06T21:27:36.427 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-06T21:27:36.427 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-06T21:27:36.427 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-06T21:27:36.427 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-06T21:27:36.427 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-06T21:27:36.427 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-06T21:27:36.428 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/ 2023-07-06T21:27:36.428 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-06T21:27:36.428 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-06T21:27:36.428 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-06T21:27:36.428 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-06T21:27:36.428 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-06T21:27:36.428 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-06T21:27:36.428 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-06T21:27:36.429 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-06T21:27:36.429 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-06T21:27:36.429 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-06T21:27:36.429 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-06T21:27:36.429 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-06T21:27:36.429 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-06T21:27:36.429 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/ 2023-07-06T21:27:36.429 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ 2023-07-06T21:27:36.430 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-06T21:27:36.430 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-06T21:27:36.430 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-06T21:27:36.430 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-06T21:27:36.430 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-06T21:27:36.430 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-06T21:27:36.430 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/da9030_battery.ko 2023-07-06T21:27:36.430 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/da9052-battery.ko 2023-07-06T21:27:36.431 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-06T21:27:36.431 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-06T21:27:36.431 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-06T21:27:36.431 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-06T21:27:36.431 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/gpio-charger.ko 2023-07-06T21:27:36.431 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-06T21:27:36.431 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-06T21:27:36.432 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max14577_charger.ko 2023-07-06T21:27:36.432 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max17040_battery.ko 2023-07-06T21:27:36.432 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max17042_battery.ko 2023-07-06T21:27:36.432 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max8903_charger.ko 2023-07-06T21:27:36.432 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max8925_power.ko 2023-07-06T21:27:36.432 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-06T21:27:36.432 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/sbs-battery.ko 2023-07-06T21:27:36.432 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/test_power.ko 2023-07-06T21:27:36.433 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-06T21:27:36.433 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-06T21:27:36.433 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm831x_power.ko 2023-07-06T21:27:36.433 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm8350_power.ko 2023-07-06T21:27:36.433 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/ 2023-07-06T21:27:36.433 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-06T21:27:36.433 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-06T21:27:36.433 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/ 2023-07-06T21:27:36.434 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/ 2023-07-06T21:27:36.434 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-06T21:27:36.434 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-06T21:27:36.434 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-06T21:27:36.434 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-06T21:27:36.434 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ 2023-07-06T21:27:36.434 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 64609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-06T21:27:36.434 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-06T21:27:36.435 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/ 2023-07-06T21:27:36.435 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-06T21:27:36.435 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-06T21:27:36.435 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-06T21:27:36.435 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-06T21:27:36.435 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9052.ko 2023-07-06T21:27:36.435 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9055.ko 2023-07-06T21:27:36.436 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9063.ko 2023-07-06T21:27:36.436 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-06T21:27:36.436 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-06T21:27:36.436 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-06T21:27:36.436 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-06T21:27:36.436 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-06T21:27:36.436 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-06T21:27:36.436 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-06T21:27:36.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-06T21:27:36.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-06T21:27:36.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-06T21:27:36.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-06T21:27:36.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-06T21:27:36.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-06T21:27:36.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-06T21:27:36.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-06T21:27:36.438 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-06T21:27:36.438 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-06T21:27:36.438 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-06T21:27:36.438 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-06T21:27:36.438 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8907.ko 2023-07-06T21:27:36.438 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8925.ko 2023-07-06T21:27:36.438 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8997.ko 2023-07-06T21:27:36.438 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8998.ko 2023-07-06T21:27:36.439 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-06T21:27:36.439 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-06T21:27:36.439 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-palmas.ko 2023-07-06T21:27:36.439 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-06T21:27:36.439 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-06T21:27:36.439 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-06T21:27:36.439 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-06T21:27:36.440 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-06T21:27:36.440 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-06T21:27:36.440 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-06T21:27:36.440 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-06T21:27:36.440 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-06T21:27:36.440 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-06T21:27:36.440 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-06T21:27:36.440 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-06T21:27:36.441 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-06T21:27:36.441 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-06T21:27:36.441 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-06T21:27:36.441 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-06T21:27:36.441 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-06T21:27:36.441 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-06T21:27:36.441 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-06T21:27:36.441 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ 2023-07-06T21:27:36.442 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 77641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-06T21:27:36.442 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-06T21:27:36.442 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-06T21:27:36.442 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 135169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-06T21:27:36.442 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-06T21:27:36.442 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/ 2023-07-06T21:27:36.442 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 272353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-06T21:27:36.442 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-06T21:27:36.443 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/ 2023-07-06T21:27:36.443 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 356201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-06T21:27:36.443 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 295801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-06T21:27:36.443 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic94xx/ 2023-07-06T21:27:36.443 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 189321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-06T21:27:36.443 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-06T21:27:36.443 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/ 2023-07-06T21:27:36.443 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 106569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-06T21:27:36.444 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-06T21:27:36.444 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/ 2023-07-06T21:27:36.444 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 246897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-06T21:27:36.444 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/ 2023-07-06T21:27:36.444 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1172185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-06T21:27:36.444 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/ 2023-07-06T21:27:36.444 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 237169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-06T21:27:36.445 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/ 2023-07-06T21:27:36.445 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 115393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-06T21:27:36.445 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-06T21:27:36.445 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/ 2023-07-06T21:27:36.445 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 308889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-06T21:27:36.445 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/ 2023-07-06T21:27:36.445 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-06T21:27:36.445 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 76193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-06T21:27:36.446 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-06T21:27:36.446 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-06T21:27:36.446 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 141873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-06T21:27:36.446 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 75529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-06T21:27:36.446 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-06T21:27:36.446 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/ 2023-07-06T21:27:36.446 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 212401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-06T21:27:36.446 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-06T21:27:36.447 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/ 2023-07-06T21:27:36.447 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-06T21:27:36.447 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 155089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-06T21:27:36.447 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fdomain.ko 2023-07-06T21:27:36.447 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/ 2023-07-06T21:27:36.447 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 262073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-06T21:27:36.447 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 201793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-06T21:27:36.448 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-06T21:27:36.448 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-06T21:27:36.448 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/imm.ko 2023-07-06T21:27:36.448 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-06T21:27:36.448 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 266521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-06T21:27:36.448 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-06T21:27:36.448 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/ 2023-07-06T21:27:36.448 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 317249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-06T21:27:36.449 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-06T21:27:36.449 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-06T21:27:36.449 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/ 2023-07-06T21:27:36.449 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 308313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-06T21:27:36.449 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 140225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-06T21:27:36.449 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-06T21:27:36.449 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/ 2023-07-06T21:27:36.449 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 213041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-06T21:27:36.450 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/ 2023-07-06T21:27:36.450 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2193865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-06T21:27:36.450 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/ 2023-07-06T21:27:36.450 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-06T21:27:36.450 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-06T21:27:36.450 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 310729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-06T21:27:36.450 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 84697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-06T21:27:36.450 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/ 2023-07-06T21:27:36.451 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 659577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-06T21:27:36.451 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/ 2023-07-06T21:27:36.451 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 119929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-06T21:27:36.451 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-06T21:27:36.451 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/ 2023-07-06T21:27:36.451 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-06T21:27:36.451 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-06T21:27:36.451 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-06T21:27:36.452 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-06T21:27:36.452 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/ 2023-07-06T21:27:36.452 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 361433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-06T21:27:36.452 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 123489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-06T21:27:36.452 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ppa.ko 2023-07-06T21:27:36.452 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-06T21:27:36.452 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/ 2023-07-06T21:27:36.453 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1850945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-06T21:27:36.453 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 85313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-06T21:27:36.453 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/ 2023-07-06T21:27:36.453 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 558865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-06T21:27:36.453 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qlogicfas408.ko 2023-07-06T21:27:36.453 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-06T21:27:36.453 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 238737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-06T21:27:36.453 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 171865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-06T21:27:36.454 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 270161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-06T21:27:36.454 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 94353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-06T21:27:36.454 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-06T21:27:36.454 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-06T21:27:36.454 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-06T21:27:36.454 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 115785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-06T21:27:36.454 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-06T21:27:36.454 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-06T21:27:36.455 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 162121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-06T21:27:36.455 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-06T21:27:36.455 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-06T21:27:36.455 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-06T21:27:36.455 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/xen-scsifront.ko 2023-07-06T21:27:36.455 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ 2023-07-06T21:27:36.455 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 127025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-06T21:27:36.456 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/ 2023-07-06T21:27:36.456 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/ 2023-07-06T21:27:36.456 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 733905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-06T21:27:36.456 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/ 2023-07-06T21:27:36.456 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-06T21:27:36.456 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-06T21:27:36.456 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-06T21:27:36.457 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 920793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-06T21:27:36.457 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-06T21:27:36.457 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 122537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-06T21:27:36.457 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/ 2023-07-06T21:27:36.457 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 75641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-06T21:27:36.457 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/ 2023-07-06T21:27:36.457 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/ 2023-07-06T21:27:36.457 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-06T21:27:36.458 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-06T21:27:36.458 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-06T21:27:36.458 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-06T21:27:36.458 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-06T21:27:36.458 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-06T21:27:36.458 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-06T21:27:36.458 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-06T21:27:36.458 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-06T21:27:36.459 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-06T21:27:36.459 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-06T21:27:36.459 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-06T21:27:36.459 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-06T21:27:36.459 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-06T21:27:36.459 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-06T21:27:36.459 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-06T21:27:36.460 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-06T21:27:36.460 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ 2023-07-06T21:27:36.460 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ 2023-07-06T21:27:36.460 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-06T21:27:36.460 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/moxa.ko 2023-07-06T21:27:36.460 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/mxser.ko 2023-07-06T21:27:36.460 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 107545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-06T21:27:36.460 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-06T21:27:36.461 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-06T21:27:36.461 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/ 2023-07-06T21:27:36.461 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/ 2023-07-06T21:27:36.461 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-06T21:27:36.461 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-06T21:27:36.461 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-06T21:27:36.461 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/altera_uart.ko 2023-07-06T21:27:36.461 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-06T21:27:36.462 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-06T21:27:36.462 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/ 2023-07-06T21:27:36.462 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 103017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-06T21:27:36.462 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/rp2.ko 2023-07-06T21:27:36.462 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-06T21:27:36.462 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-06T21:27:36.462 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/ 2023-07-06T21:27:36.463 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ 2023-07-06T21:27:36.463 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 519393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-06T21:27:36.463 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ 2023-07-06T21:27:36.463 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-06T21:27:36.463 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-06T21:27:36.463 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/ 2023-07-06T21:27:36.463 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-06T21:27:36.463 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-06T21:27:36.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-06T21:27:36.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-06T21:27:36.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_mf624.ko 2023-07-06T21:27:36.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_netx.ko 2023-07-06T21:27:36.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-06T21:27:36.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-06T21:27:36.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-06T21:27:36.464 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/ 2023-07-06T21:27:36.465 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/c67x00/ 2023-07-06T21:27:36.465 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-06T21:27:36.465 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ 2023-07-06T21:27:36.465 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 142529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-06T21:27:36.465 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-06T21:27:36.465 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-06T21:27:36.465 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-06T21:27:36.465 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/ 2023-07-06T21:27:36.466 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 85457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-06T21:27:36.466 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-06T21:27:36.466 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-06T21:27:36.466 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-06T21:27:36.466 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/common/ 2023-07-06T21:27:36.466 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/common/ulpi.ko 2023-07-06T21:27:36.466 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc2/ 2023-07-06T21:27:36.467 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-06T21:27:36.467 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/ 2023-07-06T21:27:36.467 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-06T21:27:36.467 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-06T21:27:36.467 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 441593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-06T21:27:36.467 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/ 2023-07-06T21:27:36.467 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/ 2023-07-06T21:27:36.467 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-06T21:27:36.468 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-06T21:27:36.468 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-06T21:27:36.468 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-06T21:27:36.468 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-06T21:27:36.468 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-06T21:27:36.468 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 91929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-06T21:27:36.468 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-06T21:27:36.468 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 118017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-06T21:27:36.469 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-06T21:27:36.469 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-06T21:27:36.469 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-06T21:27:36.469 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-06T21:27:36.469 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 84193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-06T21:27:36.469 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-06T21:27:36.469 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-06T21:27:36.469 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-06T21:27:36.470 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/ 2023-07-06T21:27:36.470 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-06T21:27:36.470 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-06T21:27:36.470 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-06T21:27:36.470 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-06T21:27:36.470 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-06T21:27:36.470 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-06T21:27:36.470 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-06T21:27:36.471 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-06T21:27:36.471 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-06T21:27:36.471 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-06T21:27:36.471 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-06T21:27:36.471 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-06T21:27:36.471 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-06T21:27:36.472 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-06T21:27:36.472 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 157009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-06T21:27:36.472 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/ 2023-07-06T21:27:36.472 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-06T21:27:36.472 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-06T21:27:36.472 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 157665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-06T21:27:36.472 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-06T21:27:36.472 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-06T21:27:36.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-06T21:27:36.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-06T21:27:36.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 76033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-06T21:27:36.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 75017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-06T21:27:36.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-06T21:27:36.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 65793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-06T21:27:36.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-06T21:27:36.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-06T21:27:36.474 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 146001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-06T21:27:36.474 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/ 2023-07-06T21:27:36.474 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-06T21:27:36.474 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-06T21:27:36.474 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 87625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-06T21:27:36.474 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-06T21:27:36.474 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-06T21:27:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811_cs.ko 2023-07-06T21:27:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-06T21:27:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-06T21:27:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/ 2023-07-06T21:27:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-06T21:27:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-06T21:27:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ 2023-07-06T21:27:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-06T21:27:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-06T21:27:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-06T21:27:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/cytherm.ko 2023-07-06T21:27:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ehset.ko 2023-07-06T21:27:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-06T21:27:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-06T21:27:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-06T21:27:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-06T21:27:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-06T21:27:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-06T21:27:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-06T21:27:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-06T21:27:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/lvstest.ko 2023-07-06T21:27:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/ 2023-07-06T21:27:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 64841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-06T21:27:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-06T21:27:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-06T21:27:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-06T21:27:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-06T21:27:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbtest.ko 2023-07-06T21:27:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-06T21:27:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-06T21:27:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/mon/ 2023-07-06T21:27:36.479 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/mon/usbmon.ko 2023-07-06T21:27:36.479 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/musb/ 2023-07-06T21:27:36.479 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 295049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-06T21:27:36.479 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/ 2023-07-06T21:27:36.479 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-06T21:27:36.479 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-06T21:27:36.480 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-06T21:27:36.480 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-06T21:27:36.480 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ 2023-07-06T21:27:36.480 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-06T21:27:36.480 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-06T21:27:36.480 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-06T21:27:36.480 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-06T21:27:36.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-06T21:27:36.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-06T21:27:36.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-06T21:27:36.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-06T21:27:36.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-06T21:27:36.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/f81232.ko 2023-07-06T21:27:36.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 174841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-06T21:27:36.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-06T21:27:36.482 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 136945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-06T21:27:36.482 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 124465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-06T21:27:36.482 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-06T21:27:36.482 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-06T21:27:36.482 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-06T21:27:36.482 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-06T21:27:36.482 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 107417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-06T21:27:36.482 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-06T21:27:36.483 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-06T21:27:36.483 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-06T21:27:36.483 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-06T21:27:36.483 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/metro-usb.ko 2023-07-06T21:27:36.483 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-06T21:27:36.483 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-06T21:27:36.483 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mxuport.ko 2023-07-06T21:27:36.483 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-06T21:27:36.484 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-06T21:27:36.484 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-06T21:27:36.484 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 189337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-06T21:27:36.484 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-06T21:27:36.484 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-06T21:27:36.484 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-06T21:27:36.484 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-06T21:27:36.485 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-06T21:27:36.485 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-06T21:27:36.485 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-06T21:27:36.485 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-06T21:27:36.485 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-06T21:27:36.485 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-06T21:27:36.485 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-06T21:27:36.485 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-06T21:27:36.486 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-06T21:27:36.486 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-06T21:27:36.486 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 122913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usbserial.ko 2023-07-06T21:27:36.486 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-06T21:27:36.486 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-06T21:27:36.486 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-06T21:27:36.486 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-06T21:27:36.486 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ 2023-07-06T21:27:36.487 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-06T21:27:36.487 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-06T21:27:36.487 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-06T21:27:36.487 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-06T21:27:36.487 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-06T21:27:36.487 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-06T21:27:36.487 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-06T21:27:36.487 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-06T21:27:36.488 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-06T21:27:36.488 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-06T21:27:36.488 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-06T21:27:36.488 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-06T21:27:36.488 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-06T21:27:36.488 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-06T21:27:36.488 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 177153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-06T21:27:36.489 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/ 2023-07-06T21:27:36.489 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 65761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-06T21:27:36.489 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-06T21:27:36.489 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 105401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-06T21:27:36.489 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/ 2023-07-06T21:27:36.489 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/ 2023-07-06T21:27:36.489 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 145817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-06T21:27:36.489 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-06T21:27:36.490 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 97969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-06T21:27:36.490 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 75249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-06T21:27:36.490 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/ 2023-07-06T21:27:36.490 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 96017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-06T21:27:36.490 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-06T21:27:36.490 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-06T21:27:36.490 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 85753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-06T21:27:36.490 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/ 2023-07-06T21:27:36.491 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/ 2023-07-06T21:27:36.491 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-06T21:27:36.491 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-06T21:27:36.491 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-06T21:27:36.491 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-06T21:27:36.491 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-06T21:27:36.491 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-06T21:27:36.491 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-06T21:27:36.492 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/bd6107.ko 2023-07-06T21:27:36.492 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-06T21:27:36.492 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-06T21:27:36.492 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-06T21:27:36.492 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-06T21:27:36.492 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-06T21:27:36.492 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-06T21:27:36.493 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-06T21:27:36.493 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-06T21:27:36.493 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-06T21:27:36.493 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-06T21:27:36.493 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-06T21:27:36.493 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-06T21:27:36.493 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-06T21:27:36.493 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/ 2023-07-06T21:27:36.494 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ 2023-07-06T21:27:36.494 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-06T21:27:36.494 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-06T21:27:36.494 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-06T21:27:36.494 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-06T21:27:36.494 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/ 2023-07-06T21:27:36.494 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-06T21:27:36.494 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-06T21:27:36.495 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-06T21:27:36.495 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-06T21:27:36.495 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-06T21:27:36.495 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-06T21:27:36.495 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-06T21:27:36.495 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-06T21:27:36.495 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-06T21:27:36.495 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-06T21:27:36.496 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-06T21:27:36.496 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-06T21:27:36.496 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ 2023-07-06T21:27:36.496 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/acquirewdt.ko 2023-07-06T21:27:36.496 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/advantechwdt.ko 2023-07-06T21:27:36.496 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-06T21:27:36.496 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-06T21:27:36.496 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-06T21:27:36.497 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-06T21:27:36.497 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-06T21:27:36.497 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-06T21:27:36.497 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/dw_wdt.ko 2023-07-06T21:27:36.497 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-06T21:27:36.497 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-06T21:27:36.497 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-06T21:27:36.498 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-06T21:27:36.498 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-06T21:27:36.498 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-06T21:27:36.498 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-06T21:27:36.498 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-06T21:27:36.498 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-06T21:27:36.499 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-06T21:27:36.499 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-06T21:27:36.499 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-06T21:27:36.499 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-06T21:27:36.499 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-06T21:27:36.499 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-06T21:27:36.499 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-06T21:27:36.499 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-06T21:27:36.500 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-06T21:27:36.500 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-06T21:27:36.500 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-06T21:27:36.500 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/retu_wdt.ko 2023-07-06T21:27:36.500 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-06T21:27:36.500 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-06T21:27:36.500 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-06T21:27:36.500 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-06T21:27:36.501 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-06T21:27:36.501 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-06T21:27:36.501 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-06T21:27:36.501 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-06T21:27:36.501 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-06T21:27:36.501 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-06T21:27:36.501 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-06T21:27:36.502 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-06T21:27:36.502 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-06T21:27:36.502 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-06T21:27:36.502 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-06T21:27:36.502 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-06T21:27:36.502 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-06T21:27:36.502 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-06T21:27:36.502 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/ 2023-07-06T21:27:36.503 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-06T21:27:36.503 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-06T21:27:36.503 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-06T21:27:36.503 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/ 2023-07-06T21:27:36.503 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 176353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-06T21:27:36.503 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-06T21:27:36.503 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-scsiback.ko 2023-07-06T21:27:36.503 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/ 2023-07-06T21:27:36.504 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-06T21:27:36.504 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ 2023-07-06T21:27:36.504 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/ 2023-07-06T21:27:36.504 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 165513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-06T21:27:36.504 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/adfs/ 2023-07-06T21:27:36.504 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/adfs/adfs.ko 2023-07-06T21:27:36.504 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/ 2023-07-06T21:27:36.504 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 162625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-06T21:27:36.505 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/afs/ 2023-07-06T21:27:36.505 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 924297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/afs/kafs.ko 2023-07-06T21:27:36.505 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/autofs/ 2023-07-06T21:27:36.505 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/autofs/autofs4.ko 2023-07-06T21:27:36.505 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/ 2023-07-06T21:27:36.505 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 64417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-06T21:27:36.505 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/bfs/ 2023-07-06T21:27:36.505 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/bfs/bfs.ko 2023-07-06T21:27:36.506 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-06T21:27:36.506 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/ 2023-07-06T21:27:36.506 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 3447409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-06T21:27:36.506 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/ 2023-07-06T21:27:36.506 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 300025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-06T21:27:36.506 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ 2023-07-06T21:27:36.506 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1308201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-06T21:27:36.506 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/ 2023-07-06T21:27:36.507 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 99337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-06T21:27:36.507 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/configfs/ 2023-07-06T21:27:36.507 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 105969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/configfs/configfs.ko 2023-07-06T21:27:36.507 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/ 2023-07-06T21:27:36.507 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-06T21:27:36.507 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/ 2023-07-06T21:27:36.507 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 631425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-06T21:27:36.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/efs/ 2023-07-06T21:27:36.508 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/efs/efs.ko 2023-07-06T21:27:36.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/ 2023-07-06T21:27:36.508 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1473049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-06T21:27:36.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/ 2023-07-06T21:27:36.508 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-06T21:27:36.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/freevxfs/ 2023-07-06T21:27:36.508 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/freevxfs/freevxfs.ko 2023-07-06T21:27:36.509 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/ 2023-07-06T21:27:36.509 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 218713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-06T21:27:36.509 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/ 2023-07-06T21:27:36.509 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-06T21:27:36.509 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/ 2023-07-06T21:27:36.509 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1221129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-06T21:27:36.509 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/ 2023-07-06T21:27:36.509 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 141241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-06T21:27:36.510 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/ 2023-07-06T21:27:36.510 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 221561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-06T21:27:36.510 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hpfs/ 2023-07-06T21:27:36.510 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 193585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hpfs/hpfs.ko 2023-07-06T21:27:36.510 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/ 2023-07-06T21:27:36.510 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 74393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-06T21:27:36.510 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/ 2023-07-06T21:27:36.510 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 420425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-06T21:27:36.511 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/ 2023-07-06T21:27:36.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 276953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-06T21:27:36.537 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/ 2023-07-06T21:27:36.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 87841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-06T21:27:36.537 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/ 2023-07-06T21:27:36.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 128665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-06T21:27:36.538 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/ 2023-07-06T21:27:36.538 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/ 2023-07-06T21:27:36.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-06T21:27:36.538 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/ 2023-07-06T21:27:36.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-06T21:27:36.538 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/ 2023-07-06T21:27:36.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 117705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-06T21:27:36.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1002089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-06T21:27:36.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv2.ko 2023-07-06T21:27:36.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 119289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-06T21:27:36.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2003425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-06T21:27:36.539 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/ 2023-07-06T21:27:36.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-06T21:27:36.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-06T21:27:36.539 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/ 2023-07-06T21:27:36.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1407977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-06T21:27:36.540 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/ 2023-07-06T21:27:36.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 589433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-06T21:27:36.540 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/ 2023-07-06T21:27:36.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-06T21:27:36.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-06T21:27:36.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-06T21:27:36.541 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-06T21:27:36.541 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-06T21:27:36.541 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-06T21:27:36.541 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-06T21:27:36.541 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-06T21:27:36.541 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-06T21:27:36.541 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-06T21:27:36.541 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-06T21:27:36.542 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_ascii.ko 2023-07-06T21:27:36.542 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-06T21:27:36.542 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-06T21:27:36.542 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-06T21:27:36.542 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-06T21:27:36.542 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-06T21:27:36.542 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-06T21:27:36.542 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-06T21:27:36.543 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-06T21:27:36.543 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-06T21:27:36.543 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-06T21:27:36.543 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-06T21:27:36.543 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-06T21:27:36.543 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-06T21:27:36.543 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-06T21:27:36.544 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-06T21:27:36.544 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-06T21:27:36.544 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-06T21:27:36.544 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-06T21:27:36.544 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 94137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-06T21:27:36.544 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 142673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-06T21:27:36.544 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 165745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-06T21:27:36.544 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 118121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-06T21:27:36.545 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-06T21:27:36.545 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-06T21:27:36.545 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-06T21:27:36.545 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-06T21:27:36.545 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-06T21:27:36.545 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-06T21:27:36.545 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-06T21:27:36.545 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-06T21:27:36.546 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-06T21:27:36.546 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-06T21:27:36.546 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-06T21:27:36.546 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-06T21:27:36.546 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-06T21:27:36.546 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-06T21:27:36.546 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-06T21:27:36.546 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-06T21:27:36.547 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ntfs/ 2023-07-06T21:27:36.547 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 219081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ntfs/ntfs.ko 2023-07-06T21:27:36.547 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ 2023-07-06T21:27:36.547 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ 2023-07-06T21:27:36.547 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 241241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-06T21:27:36.547 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ 2023-07-06T21:27:36.547 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 439625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-06T21:27:36.548 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ 2023-07-06T21:27:36.548 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-06T21:27:36.548 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2511665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-06T21:27:36.548 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-06T21:27:36.548 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-06T21:27:36.548 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-06T21:27:36.548 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/omfs/ 2023-07-06T21:27:36.548 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/omfs/omfs.ko 2023-07-06T21:27:36.549 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/ 2023-07-06T21:27:36.549 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 320689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-06T21:27:36.549 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ 2023-07-06T21:27:36.549 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-06T21:27:36.549 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx4/ 2023-07-06T21:27:36.549 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx4/qnx4.ko 2023-07-06T21:27:36.549 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx6/ 2023-07-06T21:27:36.549 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx6/qnx6.ko 2023-07-06T21:27:36.550 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/ 2023-07-06T21:27:36.550 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_tree.ko 2023-07-06T21:27:36.550 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_v1.ko 2023-07-06T21:27:36.550 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_v2.ko 2023-07-06T21:27:36.550 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/ 2023-07-06T21:27:36.550 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 530697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-06T21:27:36.550 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/ 2023-07-06T21:27:36.551 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-06T21:27:36.551 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/ 2023-07-06T21:27:36.551 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/ 2023-07-06T21:27:36.551 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2622729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-06T21:27:36.551 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/ 2023-07-06T21:27:36.551 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-06T21:27:36.551 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-06T21:27:36.551 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/ 2023-07-06T21:27:36.552 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 131689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-06T21:27:36.552 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/ 2023-07-06T21:27:36.552 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-06T21:27:36.552 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/ 2023-07-06T21:27:36.552 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 248257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-06T21:27:36.552 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ 2023-07-06T21:27:36.552 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 160857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-06T21:27:36.552 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/ 2023-07-06T21:27:36.553 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 3854977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-06T21:27:36.553 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/ 2023-07-06T21:27:36.553 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/locking/ 2023-07-06T21:27:36.553 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/locking/locktorture.ko 2023-07-06T21:27:36.553 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/time/ 2023-07-06T21:27:36.553 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/time/test_udelay.ko 2023-07-06T21:27:36.553 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-06T21:27:36.554 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ 2023-07-06T21:27:36.554 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-06T21:27:36.554 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc7.ko 2023-07-06T21:27:36.554 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-06T21:27:36.554 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/ 2023-07-06T21:27:36.554 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-06T21:27:36.554 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-06T21:27:36.554 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/interval_tree_test.ko 2023-07-06T21:27:36.555 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-06T21:27:36.555 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-06T21:27:36.555 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/ 2023-07-06T21:27:36.555 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-06T21:27:36.555 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-06T21:27:36.555 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/ 2023-07-06T21:27:36.555 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-06T21:27:36.555 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/memory-notifier-error-inject.ko 2023-07-06T21:27:36.556 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/notifier-error-inject.ko 2023-07-06T21:27:36.556 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/percpu_test.ko 2023-07-06T21:27:36.556 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/pm-notifier-error-inject.ko 2023-07-06T21:27:36.556 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/ 2023-07-06T21:27:36.556 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 142369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-06T21:27:36.556 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/rbtree_test.ko 2023-07-06T21:27:36.556 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/ 2023-07-06T21:27:36.556 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-06T21:27:36.557 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test-kstrtox.ko 2023-07-06T21:27:36.557 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test-string_helpers.ko 2023-07-06T21:27:36.557 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 4760825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_bpf.ko 2023-07-06T21:27:36.557 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_firmware.ko 2023-07-06T21:27:36.557 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_module.ko 2023-07-06T21:27:36.557 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_user_copy.ko 2023-07-06T21:27:36.557 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-06T21:27:36.558 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-06T21:27:36.558 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-06T21:27:36.558 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/xz/ 2023-07-06T21:27:36.558 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/xz/xz_dec_test.ko 2023-07-06T21:27:36.558 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/mm/ 2023-07-06T21:27:36.558 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-06T21:27:36.558 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ 2023-07-06T21:27:36.558 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/ 2023-07-06T21:27:36.559 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-06T21:27:36.559 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-06T21:27:36.559 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-06T21:27:36.559 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-06T21:27:36.559 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-06T21:27:36.559 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-06T21:27:36.559 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-06T21:27:36.559 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-06T21:27:36.560 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/ 2023-07-06T21:27:36.560 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-06T21:27:36.560 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-06T21:27:36.560 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-06T21:27:36.560 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-06T21:27:36.560 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-06T21:27:36.560 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/ 2023-07-06T21:27:36.560 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-06T21:27:36.561 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/ 2023-07-06T21:27:36.561 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 191801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-06T21:27:36.561 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-06T21:27:36.561 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-06T21:27:36.561 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-06T21:27:36.561 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/ 2023-07-06T21:27:36.561 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 652553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-06T21:27:36.562 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/ 2023-07-06T21:27:36.562 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-06T21:27:36.562 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 769841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-06T21:27:36.562 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ 2023-07-06T21:27:36.562 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-06T21:27:36.562 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-06T21:27:36.562 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-06T21:27:36.562 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-06T21:27:36.563 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-06T21:27:36.563 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-06T21:27:36.563 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-06T21:27:36.563 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-06T21:27:36.563 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-06T21:27:36.563 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-06T21:27:36.563 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-06T21:27:36.563 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-06T21:27:36.564 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-06T21:27:36.564 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-06T21:27:36.564 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-06T21:27:36.564 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-06T21:27:36.564 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-06T21:27:36.564 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-06T21:27:36.564 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-06T21:27:36.564 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-06T21:27:36.565 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-06T21:27:36.565 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-06T21:27:36.565 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-06T21:27:36.565 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/ 2023-07-06T21:27:36.565 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1030233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-06T21:27:36.565 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/core/ 2023-07-06T21:27:36.565 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 124729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-06T21:27:36.565 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/ 2023-07-06T21:27:36.566 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 189745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-06T21:27:36.566 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-06T21:27:36.566 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-06T21:27:36.566 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-06T21:27:36.566 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/ 2023-07-06T21:27:36.566 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 380473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-06T21:27:36.566 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-06T21:27:36.567 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-06T21:27:36.567 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-06T21:27:36.567 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-06T21:27:36.567 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/hsr/ 2023-07-06T21:27:36.567 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 99825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/hsr/hsr.ko 2023-07-06T21:27:36.567 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ 2023-07-06T21:27:36.567 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ 2023-07-06T21:27:36.567 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-06T21:27:36.568 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 245857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-06T21:27:36.568 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-06T21:27:36.568 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ 2023-07-06T21:27:36.568 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-06T21:27:36.568 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-06T21:27:36.568 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-06T21:27:36.568 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-06T21:27:36.568 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-06T21:27:36.569 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-06T21:27:36.569 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-06T21:27:36.569 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-06T21:27:36.569 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-06T21:27:36.569 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-06T21:27:36.569 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ 2023-07-06T21:27:36.569 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-06T21:27:36.569 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-06T21:27:36.570 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-06T21:27:36.570 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-06T21:27:36.570 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-06T21:27:36.570 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-06T21:27:36.570 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-06T21:27:36.570 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-06T21:27:36.570 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-06T21:27:36.571 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-06T21:27:36.571 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-06T21:27:36.571 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-06T21:27:36.571 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-06T21:27:36.571 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-06T21:27:36.571 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-06T21:27:36.571 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-06T21:27:36.571 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-06T21:27:36.572 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-06T21:27:36.572 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-06T21:27:36.572 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-06T21:27:36.572 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-06T21:27:36.572 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-06T21:27:36.572 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-06T21:27:36.572 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-06T21:27:36.572 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-06T21:27:36.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-06T21:27:36.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-06T21:27:36.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-06T21:27:36.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-06T21:27:36.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-06T21:27:36.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-06T21:27:36.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-06T21:27:36.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-06T21:27:36.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-06T21:27:36.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-06T21:27:36.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-06T21:27:36.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-06T21:27:36.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-06T21:27:36.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-06T21:27:36.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-06T21:27:36.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-06T21:27:36.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-06T21:27:36.575 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ 2023-07-06T21:27:36.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-06T21:27:36.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-06T21:27:36.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-06T21:27:36.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_gre.ko 2023-07-06T21:27:36.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 91481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-06T21:27:36.576 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-06T21:27:36.576 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-06T21:27:36.576 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-06T21:27:36.576 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/mip6.ko 2023-07-06T21:27:36.576 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ 2023-07-06T21:27:36.576 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-06T21:27:36.576 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-06T21:27:36.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-06T21:27:36.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-06T21:27:36.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-06T21:27:36.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-06T21:27:36.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-06T21:27:36.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-06T21:27:36.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-06T21:27:36.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-06T21:27:36.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-06T21:27:36.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-06T21:27:36.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-06T21:27:36.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-06T21:27:36.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-06T21:27:36.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-06T21:27:36.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-06T21:27:36.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-06T21:27:36.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-06T21:27:36.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-06T21:27:36.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-06T21:27:36.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-06T21:27:36.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-06T21:27:36.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-06T21:27:36.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-06T21:27:36.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-06T21:27:36.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-06T21:27:36.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-06T21:27:36.580 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/key/ 2023-07-06T21:27:36.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-06T21:27:36.580 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/ 2023-07-06T21:27:36.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 120753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-06T21:27:36.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-06T21:27:36.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-06T21:27:36.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-06T21:27:36.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-06T21:27:36.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-06T21:27:36.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-06T21:27:36.581 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/lapb/ 2023-07-06T21:27:36.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/lapb/lapb.ko 2023-07-06T21:27:36.581 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/ 2023-07-06T21:27:36.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-06T21:27:36.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 267209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc2.ko 2023-07-06T21:27:36.582 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/ 2023-07-06T21:27:36.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 280401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-06T21:27:36.582 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/ 2023-07-06T21:27:36.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-06T21:27:36.582 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ 2023-07-06T21:27:36.582 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ 2023-07-06T21:27:36.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 117977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-06T21:27:36.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-06T21:27:36.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-06T21:27:36.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-06T21:27:36.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 102033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-06T21:27:36.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 103121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-06T21:27:36.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 104593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-06T21:27:36.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 105129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-06T21:27:36.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 114393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-06T21:27:36.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-06T21:27:36.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 111161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-06T21:27:36.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 114681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-06T21:27:36.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 114329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-06T21:27:36.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 113153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-06T21:27:36.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 116217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-06T21:27:36.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-06T21:27:36.585 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ 2023-07-06T21:27:36.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 410337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-06T21:27:36.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-06T21:27:36.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-06T21:27:36.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-06T21:27:36.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-06T21:27:36.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-06T21:27:36.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-06T21:27:36.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-06T21:27:36.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-06T21:27:36.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-06T21:27:36.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-06T21:27:36.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-06T21:27:36.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-06T21:27:36.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-06T21:27:36.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-06T21:27:36.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 397737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-06T21:27:36.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-06T21:27:36.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-06T21:27:36.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-06T21:27:36.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 117737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-06T21:27:36.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-06T21:27:36.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-06T21:27:36.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-06T21:27:36.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-06T21:27:36.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-06T21:27:36.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 65737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-06T21:27:36.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-06T21:27:36.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-06T21:27:36.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-06T21:27:36.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 86993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-06T21:27:36.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-06T21:27:36.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-06T21:27:36.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 91777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-06T21:27:36.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-06T21:27:36.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-06T21:27:36.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-06T21:27:36.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-06T21:27:36.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-06T21:27:36.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-06T21:27:36.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 584713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-06T21:27:36.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-06T21:27:36.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-06T21:27:36.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-06T21:27:36.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-06T21:27:36.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-06T21:27:36.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-06T21:27:36.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-06T21:27:36.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-06T21:27:36.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-06T21:27:36.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-06T21:27:36.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-06T21:27:36.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-06T21:27:36.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-06T21:27:36.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-06T21:27:36.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-06T21:27:36.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-06T21:27:36.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-06T21:27:36.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-06T21:27:36.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_osf.ko 2023-07-06T21:27:36.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-06T21:27:36.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-06T21:27:36.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-06T21:27:36.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-06T21:27:36.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-06T21:27:36.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_synproxy.ko 2023-07-06T21:27:36.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tproxy.ko 2023-07-06T21:27:36.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 85113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/x_tables.ko 2023-07-06T21:27:36.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-06T21:27:36.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-06T21:27:36.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-06T21:27:36.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-06T21:27:36.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-06T21:27:36.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-06T21:27:36.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-06T21:27:36.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-06T21:27:36.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-06T21:27:36.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-06T21:27:36.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-06T21:27:36.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-06T21:27:36.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-06T21:27:36.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-06T21:27:36.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-06T21:27:36.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-06T21:27:36.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-06T21:27:36.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-06T21:27:36.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-06T21:27:36.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-06T21:27:36.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-06T21:27:36.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-06T21:27:36.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-06T21:27:36.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-06T21:27:36.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-06T21:27:36.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-06T21:27:36.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-06T21:27:36.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-06T21:27:36.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-06T21:27:36.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-06T21:27:36.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-06T21:27:36.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-06T21:27:36.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-06T21:27:36.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-06T21:27:36.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-06T21:27:36.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-06T21:27:36.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-06T21:27:36.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-06T21:27:36.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-06T21:27:36.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-06T21:27:36.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-06T21:27:36.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-06T21:27:36.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-06T21:27:36.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-06T21:27:36.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-06T21:27:36.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-06T21:27:36.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-06T21:27:36.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-06T21:27:36.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-06T21:27:36.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-06T21:27:36.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-06T21:27:36.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-06T21:27:36.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-06T21:27:36.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-06T21:27:36.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-06T21:27:36.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-06T21:27:36.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-06T21:27:36.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-06T21:27:36.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-06T21:27:36.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-06T21:27:36.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-06T21:27:36.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-06T21:27:36.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-06T21:27:36.602 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-06T21:27:36.602 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-06T21:27:36.602 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-06T21:27:36.602 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-06T21:27:36.602 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-06T21:27:36.602 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-06T21:27:36.602 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpudp.ko 2023-07-06T21:27:36.602 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-06T21:27:36.603 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-06T21:27:36.603 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/ 2023-07-06T21:27:36.603 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-06T21:27:36.603 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/ 2023-07-06T21:27:36.603 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-06T21:27:36.603 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/ 2023-07-06T21:27:36.603 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 378153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-06T21:27:36.604 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-06T21:27:36.604 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-06T21:27:36.604 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-06T21:27:36.604 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/ 2023-07-06T21:27:36.604 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-06T21:27:36.604 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/ 2023-07-06T21:27:36.604 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 110073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/phonet.ko 2023-07-06T21:27:36.604 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/pn_pep.ko 2023-07-06T21:27:36.605 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/ 2023-07-06T21:27:36.605 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 249033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-06T21:27:36.605 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 165081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-06T21:27:36.605 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-06T21:27:36.605 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rxrpc/ 2023-07-06T21:27:36.605 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 807465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rxrpc/rxrpc.ko 2023-07-06T21:27:36.605 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/ 2023-07-06T21:27:36.605 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-06T21:27:36.606 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-06T21:27:36.606 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-06T21:27:36.606 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-06T21:27:36.606 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-06T21:27:36.606 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-06T21:27:36.606 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-06T21:27:36.606 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-06T21:27:36.606 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-06T21:27:36.607 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-06T21:27:36.607 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-06T21:27:36.607 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-06T21:27:36.607 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_cgroup.ko 2023-07-06T21:27:36.607 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-06T21:27:36.607 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-06T21:27:36.607 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-06T21:27:36.608 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-06T21:27:36.608 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-06T21:27:36.608 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-06T21:27:36.608 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-06T21:27:36.608 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-06T21:27:36.608 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-06T21:27:36.608 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-06T21:27:36.608 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-06T21:27:36.609 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-06T21:27:36.609 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-06T21:27:36.609 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-06T21:27:36.609 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq_codel.ko 2023-07-06T21:27:36.609 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-06T21:27:36.609 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-06T21:27:36.609 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-06T21:27:36.609 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-06T21:27:36.610 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-06T21:27:36.610 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-06T21:27:36.610 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-06T21:27:36.610 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-06T21:27:36.610 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-06T21:27:36.610 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-06T21:27:36.610 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-06T21:27:36.610 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-06T21:27:36.611 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-06T21:27:36.611 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-06T21:27:36.611 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-06T21:27:36.611 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-06T21:27:36.611 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-06T21:27:36.611 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-06T21:27:36.611 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/ 2023-07-06T21:27:36.611 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 929385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-06T21:27:36.612 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-06T21:27:36.612 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/ 2023-07-06T21:27:36.612 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/ 2023-07-06T21:27:36.612 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 328057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-06T21:27:36.612 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-06T21:27:36.612 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1426529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-06T21:27:36.612 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/ 2023-07-06T21:27:36.613 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 681721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-06T21:27:36.613 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/ 2023-07-06T21:27:36.613 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-06T21:27:36.613 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 855089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-06T21:27:36.613 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/ 2023-07-06T21:27:36.613 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-06T21:27:36.613 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/ 2023-07-06T21:27:36.613 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-06T21:27:36.614 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-06T21:27:36.614 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 92689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-06T21:27:36.614 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-06T21:27:36.614 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-06T21:27:36.614 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/x25/ 2023-07-06T21:27:36.614 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 125225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/x25/x25.ko 2023-07-06T21:27:36.614 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/ 2023-07-06T21:27:36.614 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_algo.ko 2023-07-06T21:27:36.615 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-06T21:27:36.615 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_user.ko 2023-07-06T21:27:36.615 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/ 2023-07-06T21:27:36.615 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/ 2023-07-06T21:27:36.615 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-06T21:27:36.615 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 637389 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-06T21:27:36.615 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 623128 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-06T21:27:36.616 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7605 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-06T21:27:36.616 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.alias.bin 2023-07-06T21:27:36.616 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9788 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-06T21:27:36.616 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68530 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-06T21:27:36.616 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 146380 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-06T21:27:36.616 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 232618 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-06T21:27:36.616 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 210 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-06T21:27:36.616 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-06T21:27:36.617 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 879 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-06T21:27:36.617 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 251868 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-06T21:27:36.617 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 306661 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-06T21:27:36.617 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/ 2023-07-06T21:27:36.617 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/ 2023-07-06T21:27:36.617 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/doc/ 2023-07-06T21:27:36.617 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/ 2023-07-06T21:27:36.617 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 170 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/changelog.Debian.gz 2023-07-06T21:27:36.618 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 691 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/copyright 2023-07-06T21:27:36.619 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-06T21:27:36.619 INFO:teuthology.task.kernel:searching for kernel 6.4.0-g84139c18d56f 2023-07-06T21:27:36.619 DEBUG:teuthology.orchestra.run.smithi055:> egrep '(submenu|menuentry.*6.4.0-g84139c18d56f).*{' /boot/grub/grub.cfg 2023-07-06T21:27:36.626 INFO:teuthology.orchestra.run.smithi055.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-06T21:27:36.626 INFO:teuthology.orchestra.run.smithi055.stdout: menuentry 'Ubuntu, with Linux 6.4.0-g84139c18d56f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-g84139c18d56f-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-06T21:27:36.626 INFO:teuthology.orchestra.run.smithi055.stdout: menuentry 'Ubuntu, with Linux 6.4.0-g84139c18d56f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-g84139c18d56f-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-06T21:27:36.627 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-06T21:27:36.627 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.4.0-g84139c18d56f 2023-07-06T21:27:36.627 DEBUG:teuthology.orchestra.run.smithi055:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-06T21:27:36.669 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi055.front.sepia.ceph.com to complete... 2023-07-06T21:27:37.096 INFO:teuthology.orchestra.run.smithi055.stderr:Sourcing file `/etc/default/grub' 2023-07-06T21:27:37.097 INFO:teuthology.orchestra.run.smithi055.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-06T21:27:37.111 INFO:teuthology.orchestra.run.smithi055.stderr:Generating grub configuration file ... 2023-07-06T21:27:37.299 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-06T21:27:37.305 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-06T21:27:37.522 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-06T21:27:37.527 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-06T21:27:37.568 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-06T21:27:37.574 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-06T21:27:37.698 INFO:teuthology.orchestra.run.smithi055.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-06T21:27:37.699 INFO:teuthology.orchestra.run.smithi055.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-06T21:27:37.699 INFO:teuthology.orchestra.run.smithi055.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-06T21:27:37.719 INFO:teuthology.orchestra.run.smithi055.stderr:done 2023-07-06T21:27:38.985 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub' 2023-07-06T21:27:38.995 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-06T21:27:39.026 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2023-07-06T21:27:39.326 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-06T21:27:39.354 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-06T21:27:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-06T21:27:39.651 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-06T21:27:39.713 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-06T21:27:39.718 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-06T21:27:39.855 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-06T21:27:39.856 INFO:teuthology.orchestra.run.smithi138.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-06T21:27:39.856 INFO:teuthology.orchestra.run.smithi138.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-06T21:27:39.901 INFO:teuthology.orchestra.run.smithi138.stderr:done 2023-07-06T21:27:40.109 DEBUG:teuthology.orchestra.run.smithi138:> dpkg-deb -c /tmp/linux-image.deb 2023-07-06T21:27:40.116 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./ 2023-07-06T21:27:40.116 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./boot/ 2023-07-06T21:27:40.117 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 4323582 2023-06-30 10:38 ./boot/System.map-6.4.0-g84139c18d56f 2023-07-06T21:27:40.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 167337 2023-06-30 10:38 ./boot/config-6.4.0-g84139c18d56f 2023-07-06T21:27:40.128 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11237632 2023-06-30 10:38 ./boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-06T21:27:40.147 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/ 2023-07-06T21:27:40.147 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/ 2023-07-06T21:27:40.147 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/postinst.d/ 2023-07-06T21:27:40.147 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/postrm.d/ 2023-07-06T21:27:40.148 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/preinst.d/ 2023-07-06T21:27:40.148 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/prerm.d/ 2023-07-06T21:27:40.148 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/ 2023-07-06T21:27:40.148 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/ 2023-07-06T21:27:40.148 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/ 2023-07-06T21:27:40.148 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/ 2023-07-06T21:27:40.148 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/ 2023-07-06T21:27:40.149 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/ 2023-07-06T21:27:40.149 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ 2023-07-06T21:27:40.149 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 490385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-06T21:27:40.151 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-06T21:27:40.151 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-06T21:27:40.151 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-06T21:27:40.151 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 92385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-06T21:27:40.151 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 106729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-06T21:27:40.152 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 152241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-06T21:27:40.152 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-06T21:27:40.152 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-06T21:27:40.152 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-06T21:27:40.152 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-06T21:27:40.152 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-06T21:27:40.152 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-06T21:27:40.153 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-06T21:27:40.153 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-06T21:27:40.153 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-06T21:27:40.153 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-06T21:27:40.153 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-06T21:27:40.153 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-06T21:27:40.153 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-06T21:27:40.154 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/ 2023-07-06T21:27:40.154 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/ 2023-07-06T21:27:40.154 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/ 2023-07-06T21:27:40.154 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-06T21:27:40.154 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpuid.ko 2023-07-06T21:27:40.154 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/msr.ko 2023-07-06T21:27:40.154 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/ 2023-07-06T21:27:40.154 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 346513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-06T21:27:40.155 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 972233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-06T21:27:40.155 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2209953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-06T21:27:40.163 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ 2023-07-06T21:27:40.163 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/af_alg.ko 2023-07-06T21:27:40.163 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/algif_hash.ko 2023-07-06T21:27:40.163 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/algif_skcipher.ko 2023-07-06T21:27:40.163 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-06T21:27:40.163 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-06T21:27:40.164 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-06T21:27:40.164 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/asymmetric_keys/ 2023-07-06T21:27:40.164 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-06T21:27:40.164 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/ 2023-07-06T21:27:40.164 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-06T21:27:40.164 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-06T21:27:40.164 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-06T21:27:40.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-06T21:27:40.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-06T21:27:40.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-06T21:27:40.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-06T21:27:40.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-06T21:27:40.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-06T21:27:40.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-06T21:27:40.165 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-06T21:27:40.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-06T21:27:40.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-06T21:27:40.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-06T21:27:40.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-06T21:27:40.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-06T21:27:40.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-06T21:27:40.166 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-06T21:27:40.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cryptd.ko 2023-07-06T21:27:40.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-06T21:27:40.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_simd.ko 2023-07-06T21:27:40.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-06T21:27:40.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-06T21:27:40.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-06T21:27:40.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-06T21:27:40.167 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-06T21:27:40.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-06T21:27:40.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-06T21:27:40.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-06T21:27:40.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lrw.ko 2023-07-06T21:27:40.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-06T21:27:40.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-06T21:27:40.168 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-06T21:27:40.169 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-06T21:27:40.169 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-06T21:27:40.169 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-06T21:27:40.169 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-06T21:27:40.169 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-06T21:27:40.169 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-06T21:27:40.169 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 149193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-06T21:27:40.169 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-06T21:27:40.170 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-06T21:27:40.170 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-06T21:27:40.170 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-06T21:27:40.170 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-06T21:27:40.170 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-06T21:27:40.170 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-06T21:27:40.170 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xts.ko 2023-07-06T21:27:40.171 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-06T21:27:40.171 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ 2023-07-06T21:27:40.171 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ 2023-07-06T21:27:40.171 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_extlog.ko 2023-07-06T21:27:40.171 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-06T21:27:40.171 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-06T21:27:40.171 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/apei/ 2023-07-06T21:27:40.171 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/apei/einj.ko 2023-07-06T21:27:40.172 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-06T21:27:40.172 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-06T21:27:40.172 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-06T21:27:40.172 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-06T21:27:40.172 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 98369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-06T21:27:40.172 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ 2023-07-06T21:27:40.172 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-06T21:27:40.173 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 88625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci.ko 2023-07-06T21:27:40.173 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-06T21:27:40.173 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci.ko 2023-07-06T21:27:40.173 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-06T21:27:40.173 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-06T21:27:40.173 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-06T21:27:40.173 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-06T21:27:40.173 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-06T21:27:40.174 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-06T21:27:40.174 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-06T21:27:40.174 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-06T21:27:40.174 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-06T21:27:40.174 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-06T21:27:40.174 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-06T21:27:40.174 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-06T21:27:40.175 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-06T21:27:40.175 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-06T21:27:40.175 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-06T21:27:40.175 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-06T21:27:40.175 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-06T21:27:40.175 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-06T21:27:40.175 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_legacy.ko 2023-07-06T21:27:40.175 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-06T21:27:40.176 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-06T21:27:40.176 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-06T21:27:40.176 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-06T21:27:40.176 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-06T21:27:40.176 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-06T21:27:40.176 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-06T21:27:40.176 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-06T21:27:40.177 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-06T21:27:40.177 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-06T21:27:40.177 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-06T21:27:40.177 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-06T21:27:40.177 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-06T21:27:40.177 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_radisys.ko 2023-07-06T21:27:40.177 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-06T21:27:40.177 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rz1000.ko 2023-07-06T21:27:40.178 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-06T21:27:40.178 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-06T21:27:40.178 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-06T21:27:40.178 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-06T21:27:40.178 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-06T21:27:40.179 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-06T21:27:40.179 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-06T21:27:40.179 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-06T21:27:40.179 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-06T21:27:40.179 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-06T21:27:40.179 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-06T21:27:40.179 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-06T21:27:40.179 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-06T21:27:40.180 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-06T21:27:40.180 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-06T21:27:40.180 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-06T21:27:40.180 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-06T21:27:40.180 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-06T21:27:40.180 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-06T21:27:40.180 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-06T21:27:40.181 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ 2023-07-06T21:27:40.181 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-06T21:27:40.181 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/ 2023-07-06T21:27:40.181 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 121681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-06T21:27:40.181 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/ 2023-07-06T21:27:40.181 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/ 2023-07-06T21:27:40.181 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 113617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-06T21:27:40.181 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/ 2023-07-06T21:27:40.182 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 968129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-06T21:27:40.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 173225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-06T21:27:40.218 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/ 2023-07-06T21:27:40.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 94297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-06T21:27:40.218 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 114169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-06T21:27:40.218 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/ 2023-07-06T21:27:40.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 110361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-06T21:27:40.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-06T21:27:40.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 257529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-06T21:27:40.219 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/ 2023-07-06T21:27:40.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 98193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-06T21:27:40.219 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/ 2023-07-06T21:27:40.219 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-06T21:27:40.220 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ 2023-07-06T21:27:40.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/applicom.ko 2023-07-06T21:27:40.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-06T21:27:40.220 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/ 2023-07-06T21:27:40.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-06T21:27:40.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-06T21:27:40.220 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-06T21:27:40.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-06T21:27:40.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-06T21:27:40.221 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ 2023-07-06T21:27:40.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-06T21:27:40.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 147705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-06T21:27:40.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-06T21:27:40.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 139057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-06T21:27:40.221 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-06T21:27:40.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-06T21:27:40.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-06T21:27:40.222 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/ 2023-07-06T21:27:40.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 84121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-06T21:27:40.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/nvram.ko 2023-07-06T21:27:40.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-06T21:27:40.222 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-06T21:27:40.223 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/ 2023-07-06T21:27:40.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-06T21:27:40.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-06T21:27:40.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-06T21:27:40.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-06T21:27:40.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-06T21:27:40.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-06T21:27:40.223 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-06T21:27:40.224 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/ 2023-07-06T21:27:40.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-06T21:27:40.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-06T21:27:40.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-06T21:27:40.224 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/ 2023-07-06T21:27:40.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-palmas.ko 2023-07-06T21:27:40.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-si5351.ko 2023-07-06T21:27:40.224 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-twl6040.ko 2023-07-06T21:27:40.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-wm831x.ko 2023-07-06T21:27:40.225 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/ 2023-07-06T21:27:40.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-06T21:27:40.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-06T21:27:40.225 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-06T21:27:40.225 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ 2023-07-06T21:27:40.225 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ 2023-07-06T21:27:40.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-06T21:27:40.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 231713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-06T21:27:40.226 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/ 2023-07-06T21:27:40.226 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/ 2023-07-06T21:27:40.226 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-06T21:27:40.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 396457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-06T21:27:40.226 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-06T21:27:40.226 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-06T21:27:40.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-06T21:27:40.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-06T21:27:40.227 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/ 2023-07-06T21:27:40.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-06T21:27:40.227 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/ 2023-07-06T21:27:40.227 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-06T21:27:40.227 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ 2023-07-06T21:27:40.228 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/ 2023-07-06T21:27:40.228 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-06T21:27:40.228 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ 2023-07-06T21:27:40.228 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 122649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-06T21:27:40.228 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ 2023-07-06T21:27:40.228 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 75521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-06T21:27:40.228 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-06T21:27:40.229 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-06T21:27:40.229 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-06T21:27:40.229 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-06T21:27:40.229 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-06T21:27:40.229 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-06T21:27:40.229 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-06T21:27:40.229 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-06T21:27:40.229 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-06T21:27:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-06T21:27:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-06T21:27:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-06T21:27:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/ 2023-07-06T21:27:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-gpio.ko 2023-07-06T21:27:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max14577.ko 2023-07-06T21:27:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max77693.ko 2023-07-06T21:27:40.230 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max8997.ko 2023-07-06T21:27:40.231 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-palmas.ko 2023-07-06T21:27:40.231 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-06T21:27:40.231 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-06T21:27:40.231 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/ 2023-07-06T21:27:40.231 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-06T21:27:40.231 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/efi/ 2023-07-06T21:27:40.231 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-06T21:27:40.232 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-06T21:27:40.232 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/ 2023-07-06T21:27:40.232 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-06T21:27:40.232 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-06T21:27:40.232 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-arizona.ko 2023-07-06T21:27:40.232 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-da9052.ko 2023-07-06T21:27:40.232 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-da9055.ko 2023-07-06T21:27:40.232 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-dln2.ko 2023-07-06T21:27:40.233 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-06T21:27:40.233 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-generic.ko 2023-07-06T21:27:40.233 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-06T21:27:40.233 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-06T21:27:40.233 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-kempld.ko 2023-07-06T21:27:40.233 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-06T21:27:40.233 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max7300.ko 2023-07-06T21:27:40.234 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max730x.ko 2023-07-06T21:27:40.234 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max732x.ko 2023-07-06T21:27:40.234 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-06T21:27:40.234 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-06T21:27:40.234 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-06T21:27:40.234 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-06T21:27:40.234 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-sch.ko 2023-07-06T21:27:40.234 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-06T21:27:40.235 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-06T21:27:40.235 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-06T21:27:40.235 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-06T21:27:40.235 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-06T21:27:40.235 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-vx855.ko 2023-07-06T21:27:40.235 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-06T21:27:40.235 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-06T21:27:40.235 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-06T21:27:40.236 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/ 2023-07-06T21:27:40.236 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-a4tech.ko 2023-07-06T21:27:40.236 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-apple.ko 2023-07-06T21:27:40.236 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-06T21:27:40.236 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-06T21:27:40.236 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-06T21:27:40.236 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-belkin.ko 2023-07-06T21:27:40.237 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cherry.ko 2023-07-06T21:27:40.237 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-chicony.ko 2023-07-06T21:27:40.237 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cp2112.ko 2023-07-06T21:27:40.237 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cypress.ko 2023-07-06T21:27:40.237 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-06T21:27:40.237 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-06T21:27:40.237 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-06T21:27:40.238 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-06T21:27:40.238 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ezkey.ko 2023-07-06T21:27:40.238 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-06T21:27:40.238 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-generic.ko 2023-07-06T21:27:40.238 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-06T21:27:40.238 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-06T21:27:40.238 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-06T21:27:40.238 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-06T21:27:40.239 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-06T21:27:40.239 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-06T21:27:40.239 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-06T21:27:40.239 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kensington.ko 2023-07-06T21:27:40.239 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-06T21:27:40.239 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-06T21:27:40.239 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-06T21:27:40.239 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-06T21:27:40.240 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-06T21:27:40.240 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lg-g15.ko 2023-07-06T21:27:40.240 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-06T21:27:40.240 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 100681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-06T21:27:40.240 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech.ko 2023-07-06T21:27:40.240 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-magicmouse.ko 2023-07-06T21:27:40.240 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-microsoft.ko 2023-07-06T21:27:40.241 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-monterey.ko 2023-07-06T21:27:40.241 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-06T21:27:40.241 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ntrig.ko 2023-07-06T21:27:40.241 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-06T21:27:40.241 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-06T21:27:40.241 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-06T21:27:40.241 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-06T21:27:40.241 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-06T21:27:40.242 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-06T21:27:40.242 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-06T21:27:40.242 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-06T21:27:40.242 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-06T21:27:40.242 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-06T21:27:40.242 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-06T21:27:40.242 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-06T21:27:40.242 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-06T21:27:40.243 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-06T21:27:40.243 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-06T21:27:40.243 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-06T21:27:40.243 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-06T21:27:40.243 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-06T21:27:40.243 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-06T21:27:40.243 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-06T21:27:40.244 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-06T21:27:40.244 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-06T21:27:40.244 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-06T21:27:40.244 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-06T21:27:40.244 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-06T21:27:40.244 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-06T21:27:40.244 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-06T21:27:40.244 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-06T21:27:40.245 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-06T21:27:40.245 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-06T21:27:40.245 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-06T21:27:40.245 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-06T21:27:40.245 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-06T21:27:40.245 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-06T21:27:40.245 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-06T21:27:40.245 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 143585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-06T21:27:40.246 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-06T21:27:40.246 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-06T21:27:40.246 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-06T21:27:40.246 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 261881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid.ko 2023-07-06T21:27:40.246 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-06T21:27:40.246 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/ 2023-07-06T21:27:40.246 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 125425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-06T21:27:40.247 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-06T21:27:40.247 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-06T21:27:40.247 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 217401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-06T21:27:40.247 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/ 2023-07-06T21:27:40.247 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-06T21:27:40.247 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-06T21:27:40.247 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 292697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-06T21:27:40.247 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ 2023-07-06T21:27:40.248 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-06T21:27:40.248 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-06T21:27:40.248 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-06T21:27:40.248 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-06T21:27:40.248 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-06T21:27:40.248 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-06T21:27:40.248 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-06T21:27:40.249 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 97977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-06T21:27:40.249 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-06T21:27:40.249 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-06T21:27:40.249 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-06T21:27:40.249 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-06T21:27:40.249 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-06T21:27:40.249 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-06T21:27:40.249 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 74433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-06T21:27:40.250 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-06T21:27:40.250 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-06T21:27:40.250 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-06T21:27:40.250 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-06T21:27:40.250 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-06T21:27:40.250 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-06T21:27:40.250 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-06T21:27:40.250 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-06T21:27:40.251 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-06T21:27:40.251 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-06T21:27:40.251 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-06T21:27:40.251 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-06T21:27:40.251 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-06T21:27:40.251 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 99601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-06T21:27:40.251 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-06T21:27:40.251 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-06T21:27:40.252 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-06T21:27:40.252 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc2103.ko 2023-07-06T21:27:40.252 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-06T21:27:40.252 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-06T21:27:40.252 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 94641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-06T21:27:40.252 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-06T21:27:40.252 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-06T21:27:40.253 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-06T21:27:40.253 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-06T21:27:40.253 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-06T21:27:40.253 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-06T21:27:40.253 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-06T21:27:40.253 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hih6130.ko 2023-07-06T21:27:40.253 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-06T21:27:40.253 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-06T21:27:40.254 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-06T21:27:40.254 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-06T21:27:40.254 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-06T21:27:40.254 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-06T21:27:40.254 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-06T21:27:40.254 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 129025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-06T21:27:40.254 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/jc42.ko 2023-07-06T21:27:40.254 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-06T21:27:40.255 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-06T21:27:40.255 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-06T21:27:40.255 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-06T21:27:40.255 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-06T21:27:40.255 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-06T21:27:40.255 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-06T21:27:40.255 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-06T21:27:40.255 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-06T21:27:40.256 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-06T21:27:40.256 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-06T21:27:40.256 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-06T21:27:40.256 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-06T21:27:40.256 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-06T21:27:40.256 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-06T21:27:40.256 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-06T21:27:40.257 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-06T21:27:40.257 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-06T21:27:40.257 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-06T21:27:40.257 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-06T21:27:40.257 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-06T21:27:40.257 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-06T21:27:40.257 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-06T21:27:40.257 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-06T21:27:40.258 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-06T21:27:40.258 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-06T21:27:40.258 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-06T21:27:40.258 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-06T21:27:40.258 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-06T21:27:40.258 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-06T21:27:40.258 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-06T21:27:40.258 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-06T21:27:40.259 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-06T21:27:40.259 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-06T21:27:40.259 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-06T21:27:40.259 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-06T21:27:40.259 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 114753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-06T21:27:40.259 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-06T21:27:40.259 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-06T21:27:40.260 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 82337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-06T21:27:40.260 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-06T21:27:40.260 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-06T21:27:40.260 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ 2023-07-06T21:27:40.260 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-06T21:27:40.260 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-06T21:27:40.260 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-06T21:27:40.260 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-06T21:27:40.261 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-06T21:27:40.261 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-06T21:27:40.261 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-06T21:27:40.261 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 79465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-06T21:27:40.261 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-06T21:27:40.261 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-06T21:27:40.261 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-06T21:27:40.261 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-06T21:27:40.262 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-06T21:27:40.262 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-06T21:27:40.262 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-06T21:27:40.262 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-06T21:27:40.262 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-06T21:27:40.262 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-06T21:27:40.262 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-06T21:27:40.262 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-06T21:27:40.263 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smm665.ko 2023-07-06T21:27:40.263 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-06T21:27:40.263 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-06T21:27:40.263 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-06T21:27:40.263 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-06T21:27:40.263 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-06T21:27:40.263 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-06T21:27:40.264 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-06T21:27:40.264 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-06T21:27:40.264 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-06T21:27:40.264 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-06T21:27:40.264 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-06T21:27:40.264 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-06T21:27:40.264 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-06T21:27:40.265 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-06T21:27:40.265 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-06T21:27:40.265 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-06T21:27:40.265 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-06T21:27:40.265 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-06T21:27:40.265 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 119505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-06T21:27:40.265 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-06T21:27:40.265 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-06T21:27:40.266 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-06T21:27:40.266 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-06T21:27:40.266 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/ 2023-07-06T21:27:40.266 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/ 2023-07-06T21:27:40.266 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-06T21:27:40.266 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-06T21:27:40.266 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/ 2023-07-06T21:27:40.267 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-06T21:27:40.267 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-06T21:27:40.267 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-06T21:27:40.267 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-06T21:27:40.267 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-06T21:27:40.267 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-06T21:27:40.267 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-06T21:27:40.267 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-06T21:27:40.268 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-06T21:27:40.268 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-06T21:27:40.268 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-06T21:27:40.268 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-06T21:27:40.268 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-06T21:27:40.268 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-06T21:27:40.268 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-06T21:27:40.268 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-06T21:27:40.269 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-06T21:27:40.269 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-06T21:27:40.269 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-06T21:27:40.269 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-06T21:27:40.269 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-06T21:27:40.269 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-06T21:27:40.269 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-06T21:27:40.270 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-06T21:27:40.270 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-06T21:27:40.270 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-06T21:27:40.270 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-06T21:27:40.270 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-06T21:27:40.270 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-06T21:27:40.270 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-06T21:27:40.270 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-06T21:27:40.271 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-06T21:27:40.271 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-06T21:27:40.271 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-06T21:27:40.271 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-06T21:27:40.271 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-06T21:27:40.271 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-06T21:27:40.271 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-06T21:27:40.271 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-06T21:27:40.272 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-06T21:27:40.272 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/ 2023-07-06T21:27:40.272 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-06T21:27:40.272 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-06T21:27:40.272 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-06T21:27:40.272 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ 2023-07-06T21:27:40.272 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ 2023-07-06T21:27:40.273 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 264521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-06T21:27:40.273 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 849289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-06T21:27:40.273 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-06T21:27:40.273 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 320385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-06T21:27:40.273 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 96969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-06T21:27:40.273 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 271697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-06T21:27:40.273 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-06T21:27:40.273 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ 2023-07-06T21:27:40.274 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-06T21:27:40.274 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 492561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-06T21:27:40.274 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/ 2023-07-06T21:27:40.274 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 419217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-06T21:27:40.274 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/ 2023-07-06T21:27:40.274 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 738161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-06T21:27:40.274 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ 2023-07-06T21:27:40.275 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 296665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-06T21:27:40.275 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-06T21:27:40.275 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 153681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-06T21:27:40.275 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/usnic/ 2023-07-06T21:27:40.275 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 169017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-06T21:27:40.275 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ 2023-07-06T21:27:40.275 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-06T21:27:40.275 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 263177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-06T21:27:40.276 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ 2023-07-06T21:27:40.276 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 100225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-06T21:27:40.276 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ 2023-07-06T21:27:40.276 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 111993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-06T21:27:40.276 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ 2023-07-06T21:27:40.276 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 129081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-06T21:27:40.276 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ 2023-07-06T21:27:40.277 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 129553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-06T21:27:40.277 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/ 2023-07-06T21:27:40.277 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/evbug.ko 2023-07-06T21:27:40.277 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/ff-memless.ko 2023-07-06T21:27:40.277 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ 2023-07-06T21:27:40.277 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-06T21:27:40.277 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-06T21:27:40.277 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-06T21:27:40.278 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-06T21:27:40.278 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-06T21:27:40.278 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-06T21:27:40.278 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/ 2023-07-06T21:27:40.278 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-06T21:27:40.278 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-06T21:27:40.278 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-06T21:27:40.278 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-06T21:27:40.279 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-06T21:27:40.279 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-06T21:27:40.279 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-06T21:27:40.279 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lm8323.ko 2023-07-06T21:27:40.279 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lm8333.ko 2023-07-06T21:27:40.279 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-06T21:27:40.279 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-06T21:27:40.279 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-06T21:27:40.280 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-06T21:27:40.280 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-06T21:27:40.280 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-06T21:27:40.280 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/qt1070.ko 2023-07-06T21:27:40.280 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/qt2160.ko 2023-07-06T21:27:40.280 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-06T21:27:40.280 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/stowaway.ko 2023-07-06T21:27:40.281 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-06T21:27:40.281 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-06T21:27:40.281 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-06T21:27:40.281 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-06T21:27:40.281 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-06T21:27:40.281 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/matrix-keymap.ko 2023-07-06T21:27:40.281 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/ 2023-07-06T21:27:40.281 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-06T21:27:40.282 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-06T21:27:40.282 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 123681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-06T21:27:40.282 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-06T21:27:40.282 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-06T21:27:40.282 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 334505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/psmouse.ko 2023-07-06T21:27:40.282 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-06T21:27:40.282 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-06T21:27:40.282 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-06T21:27:40.283 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-06T21:27:40.283 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/ 2023-07-06T21:27:40.283 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-06T21:27:40.283 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ 2023-07-06T21:27:40.283 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-06T21:27:40.283 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-06T21:27:40.283 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ct82c710.ko 2023-07-06T21:27:40.284 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-06T21:27:40.284 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/parkbd.ko 2023-07-06T21:27:40.284 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/pcips2.ko 2023-07-06T21:27:40.284 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ps2mult.ko 2023-07-06T21:27:40.284 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-06T21:27:40.284 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serport.ko 2023-07-06T21:27:40.284 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-06T21:27:40.284 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/ 2023-07-06T21:27:40.285 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/ 2023-07-06T21:27:40.285 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-06T21:27:40.285 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/ 2023-07-06T21:27:40.285 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-88pm860x.ko 2023-07-06T21:27:40.285 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-adp5520.ko 2023-07-06T21:27:40.285 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-bd2802.ko 2023-07-06T21:27:40.285 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-06T21:27:40.286 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-da903x.ko 2023-07-06T21:27:40.286 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-da9052.ko 2023-07-06T21:27:40.286 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-gpio.ko 2023-07-06T21:27:40.286 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-06T21:27:40.286 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3533.ko 2023-07-06T21:27:40.286 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm355x.ko 2023-07-06T21:27:40.286 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3642.ko 2023-07-06T21:27:40.286 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-06T21:27:40.287 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp8788.ko 2023-07-06T21:27:40.287 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-max8997.ko 2023-07-06T21:27:40.287 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-mc13783.ko 2023-07-06T21:27:40.287 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-06T21:27:40.287 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca9532.ko 2023-07-06T21:27:40.287 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca955x.ko 2023-07-06T21:27:40.287 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca963x.ko 2023-07-06T21:27:40.287 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-06T21:27:40.288 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-tca6507.ko 2023-07-06T21:27:40.288 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-06T21:27:40.288 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-wm8350.ko 2023-07-06T21:27:40.288 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ 2023-07-06T21:27:40.288 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-06T21:27:40.288 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-06T21:27:40.288 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-06T21:27:40.289 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-06T21:27:40.289 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-06T21:27:40.289 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-06T21:27:40.289 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-06T21:27:40.289 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-06T21:27:40.289 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/ 2023-07-06T21:27:40.289 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/ 2023-07-06T21:27:40.289 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 631833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-06T21:27:40.290 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-06T21:27:40.290 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 86145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bufio.ko 2023-07-06T21:27:40.290 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-06T21:27:40.290 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 154273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-06T21:27:40.290 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 105673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-06T21:27:40.290 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-06T21:27:40.290 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-era.ko 2023-07-06T21:27:40.290 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-06T21:27:40.291 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-06T21:27:40.291 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log.ko 2023-07-06T21:27:40.291 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-mirror.ko 2023-07-06T21:27:40.291 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 77617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-06T21:27:40.291 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-06T21:27:40.291 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-06T21:27:40.291 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-region-hash.ko 2023-07-06T21:27:40.291 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-06T21:27:40.292 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-06T21:27:40.292 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-snapshot.ko 2023-07-06T21:27:40.292 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-06T21:27:40.292 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 182185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-06T21:27:40.292 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-06T21:27:40.292 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-zero.ko 2023-07-06T21:27:40.292 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-06T21:27:40.293 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-06T21:27:40.293 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-06T21:27:40.293 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/ 2023-07-06T21:27:40.293 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 192841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-06T21:27:40.293 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-06T21:27:40.293 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 111465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-06T21:27:40.293 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 157993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-06T21:27:40.293 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 392889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-06T21:27:40.294 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/ 2023-07-06T21:27:40.294 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/ 2023-07-06T21:27:40.294 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 174497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-06T21:27:40.294 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-06T21:27:40.294 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-06T21:27:40.294 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-06T21:27:40.294 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 123305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-06T21:27:40.294 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 76121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-06T21:27:40.295 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-06T21:27:40.295 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/ 2023-07-06T21:27:40.295 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm800.ko 2023-07-06T21:27:40.295 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm805.ko 2023-07-06T21:27:40.295 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm80x.ko 2023-07-06T21:27:40.295 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/arizona-i2c.ko 2023-07-06T21:27:40.295 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 121833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/arizona.ko 2023-07-06T21:27:40.295 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/bcm590xx.ko 2023-07-06T21:27:40.296 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-06T21:27:40.296 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/dln2.ko 2023-07-06T21:27:40.296 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/janz-cmodio.ko 2023-07-06T21:27:40.296 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/kempld-core.ko 2023-07-06T21:27:40.296 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lm3533-core.ko 2023-07-06T21:27:40.296 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-06T21:27:40.296 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lp3943.ko 2023-07-06T21:27:40.297 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-06T21:27:40.297 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-06T21:27:40.297 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/max8907.ko 2023-07-06T21:27:40.297 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-06T21:27:40.297 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-06T21:27:40.297 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/menf21bmc.ko 2023-07-06T21:27:40.297 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-06T21:27:40.297 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-06T21:27:40.298 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633.ko 2023-07-06T21:27:40.298 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-06T21:27:40.298 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/retu-mfd.ko 2023-07-06T21:27:40.298 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 76545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/si476x-core.ko 2023-07-06T21:27:40.298 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-06T21:27:40.298 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-06T21:27:40.298 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/tps65010.ko 2023-07-06T21:27:40.298 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/tps6507x.ko 2023-07-06T21:27:40.299 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-06T21:27:40.299 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-06T21:27:40.299 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-06T21:27:40.299 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wm8994.ko 2023-07-06T21:27:40.299 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ 2023-07-06T21:27:40.299 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-06T21:27:40.299 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ad525x_dpot.ko 2023-07-06T21:27:40.299 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/ 2023-07-06T21:27:40.300 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-06T21:27:40.300 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-06T21:27:40.300 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-06T21:27:40.300 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-06T21:27:40.300 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/ 2023-07-06T21:27:40.300 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-06T21:27:40.300 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/core.ko 2023-07-06T21:27:40.301 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/ 2023-07-06T21:27:40.301 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-06T21:27:40.301 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ds1682.ko 2023-07-06T21:27:40.301 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/dummy-irq.ko 2023-07-06T21:27:40.301 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/echo/ 2023-07-06T21:27:40.301 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/echo/echo.ko 2023-07-06T21:27:40.301 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/ 2023-07-06T21:27:40.301 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-06T21:27:40.302 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-06T21:27:40.302 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-06T21:27:40.302 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-06T21:27:40.302 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-06T21:27:40.302 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/genwqe/ 2023-07-06T21:27:40.302 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 152073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-06T21:27:40.302 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hmc6352.ko 2023-07-06T21:27:40.303 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-06T21:27:40.303 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ibmasm/ 2023-07-06T21:27:40.303 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-06T21:27:40.303 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ics932s401.ko 2023-07-06T21:27:40.303 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-06T21:27:40.303 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-06T21:27:40.303 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/ 2023-07-06T21:27:40.303 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-06T21:27:40.304 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-06T21:27:40.304 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/ 2023-07-06T21:27:40.304 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 124569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-06T21:27:40.304 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-06T21:27:40.304 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 304465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-06T21:27:40.304 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/phantom.ko 2023-07-06T21:27:40.304 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ti-st/ 2023-07-06T21:27:40.304 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 74609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-06T21:27:40.305 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-06T21:27:40.305 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-06T21:27:40.305 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-06T21:27:40.305 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-06T21:27:40.305 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/ 2023-07-06T21:27:40.305 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 180817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-06T21:27:40.305 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ 2023-07-06T21:27:40.305 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/ 2023-07-06T21:27:40.306 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 487993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-06T21:27:40.306 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/ 2023-07-06T21:27:40.306 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/ 2023-07-06T21:27:40.306 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 102129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-06T21:27:40.306 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-06T21:27:40.306 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-06T21:27:40.306 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-06T21:27:40.307 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 447289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-06T21:27:40.307 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-06T21:27:40.307 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-06T21:27:40.307 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ 2023-07-06T21:27:40.307 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/ 2023-07-06T21:27:40.307 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-06T21:27:40.307 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-06T21:27:40.307 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 130489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-06T21:27:40.308 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-06T21:27:40.308 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ 2023-07-06T21:27:40.308 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-06T21:27:40.308 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-06T21:27:40.308 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-06T21:27:40.308 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 99049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-06T21:27:40.308 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/ 2023-07-06T21:27:40.308 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-06T21:27:40.309 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/ 2023-07-06T21:27:40.309 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-06T21:27:40.309 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/ 2023-07-06T21:27:40.309 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-06T21:27:40.309 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/ 2023-07-06T21:27:40.309 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-06T21:27:40.309 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/ 2023-07-06T21:27:40.309 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-06T21:27:40.310 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-06T21:27:40.310 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 87345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-06T21:27:40.310 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/ 2023-07-06T21:27:40.310 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-06T21:27:40.310 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 97321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-06T21:27:40.310 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-06T21:27:40.310 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 104585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-06T21:27:40.311 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-06T21:27:40.311 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 90257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-06T21:27:40.311 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-06T21:27:40.311 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-06T21:27:40.365 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-06T21:27:40.365 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/ 2023-07-06T21:27:40.365 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-06T21:27:40.365 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 176817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-06T21:27:40.366 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-06T21:27:40.366 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1422209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-06T21:27:40.366 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 127993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-06T21:27:40.366 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-06T21:27:40.366 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 131241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-06T21:27:40.366 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 312097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-06T21:27:40.366 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/ 2023-07-06T21:27:40.367 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-06T21:27:40.367 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 323601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-06T21:27:40.367 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/ 2023-07-06T21:27:40.367 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-06T21:27:40.367 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 193433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-06T21:27:40.367 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-06T21:27:40.367 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 345929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-06T21:27:40.368 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-06T21:27:40.368 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1038969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-06T21:27:40.368 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-06T21:27:40.368 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 166113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-06T21:27:40.368 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-06T21:27:40.368 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-06T21:27:40.368 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/ 2023-07-06T21:27:40.368 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-06T21:27:40.369 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 203537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-06T21:27:40.369 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/ 2023-07-06T21:27:40.369 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-06T21:27:40.369 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-06T21:27:40.369 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-06T21:27:40.369 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 141161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-06T21:27:40.369 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-06T21:27:40.370 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-06T21:27:40.370 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-06T21:27:40.370 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/ 2023-07-06T21:27:40.370 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-06T21:27:40.370 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-06T21:27:40.370 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-06T21:27:40.370 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-06T21:27:40.370 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/ 2023-07-06T21:27:40.371 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-06T21:27:40.371 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 281033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-06T21:27:40.371 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-06T21:27:40.371 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-06T21:27:40.371 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fujitsu/ 2023-07-06T21:27:40.371 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-06T21:27:40.371 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ 2023-07-06T21:27:40.372 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 90465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-06T21:27:40.372 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-06T21:27:40.372 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 295713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-06T21:27:40.372 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-06T21:27:40.372 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 584001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-06T21:27:40.372 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-06T21:27:40.372 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 246321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-06T21:27:40.372 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-06T21:27:40.373 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 922401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-06T21:27:40.373 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-06T21:27:40.373 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 301689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-06T21:27:40.373 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/ 2023-07-06T21:27:40.373 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 514641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-06T21:27:40.373 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-06T21:27:40.373 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 93593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-06T21:27:40.373 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-06T21:27:40.374 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 734081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-06T21:27:40.374 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-06T21:27:40.374 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 151865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-06T21:27:40.374 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 86921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-06T21:27:40.374 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/ 2023-07-06T21:27:40.374 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-06T21:27:40.374 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 102385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-06T21:27:40.375 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 122681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-06T21:27:40.375 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/ 2023-07-06T21:27:40.375 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-06T21:27:40.375 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 710481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-06T21:27:40.375 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 280513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-06T21:27:40.375 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-06T21:27:40.375 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-06T21:27:40.375 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1054153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-06T21:27:40.376 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ 2023-07-06T21:27:40.376 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-06T21:27:40.376 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-06T21:27:40.376 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-06T21:27:40.376 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 95665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-06T21:27:40.376 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/ 2023-07-06T21:27:40.376 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-06T21:27:40.377 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-06T21:27:40.377 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ 2023-07-06T21:27:40.377 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-06T21:27:40.377 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-06T21:27:40.377 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/ 2023-07-06T21:27:40.377 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 150905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-06T21:27:40.377 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/ 2023-07-06T21:27:40.378 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 136785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-06T21:27:40.378 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/ 2023-07-06T21:27:40.378 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-06T21:27:40.378 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-06T21:27:40.378 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/ 2023-07-06T21:27:40.378 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-06T21:27:40.378 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 227113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-06T21:27:40.378 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 87081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-06T21:27:40.379 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-06T21:27:40.379 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 671393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-06T21:27:40.379 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/ 2023-07-06T21:27:40.379 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-06T21:27:40.379 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/ 2023-07-06T21:27:40.379 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-06T21:27:40.379 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-06T21:27:40.380 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-06T21:27:40.380 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 189817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-06T21:27:40.380 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/ 2023-07-06T21:27:40.380 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-06T21:27:40.380 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 104241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-06T21:27:40.380 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/ 2023-07-06T21:27:40.380 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 893097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-06T21:27:40.380 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/ 2023-07-06T21:27:40.381 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-06T21:27:40.381 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/ 2023-07-06T21:27:40.381 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-06T21:27:40.381 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-06T21:27:40.381 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/ 2023-07-06T21:27:40.381 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-06T21:27:40.381 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-06T21:27:40.381 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-06T21:27:40.382 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-06T21:27:40.382 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/ 2023-07-06T21:27:40.382 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-06T21:27:40.382 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-06T21:27:40.382 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-06T21:27:40.382 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-06T21:27:40.382 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 480865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-06T21:27:40.383 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/ 2023-07-06T21:27:40.383 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 103457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-06T21:27:40.383 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 166121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-06T21:27:40.383 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-06T21:27:40.383 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-06T21:27:40.383 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/ 2023-07-06T21:27:40.383 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-06T21:27:40.383 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/ 2023-07-06T21:27:40.384 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 86465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-06T21:27:40.384 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/ 2023-07-06T21:27:40.384 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-06T21:27:40.384 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-06T21:27:40.384 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/ 2023-07-06T21:27:40.384 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-06T21:27:40.384 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-06T21:27:40.385 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/ 2023-07-06T21:27:40.385 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-06T21:27:40.385 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/ 2023-07-06T21:27:40.385 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/defxx.ko 2023-07-06T21:27:40.385 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/skfp/ 2023-07-06T21:27:40.385 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 216913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-06T21:27:40.385 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 77169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-06T21:27:40.385 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/ 2023-07-06T21:27:40.386 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 234553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-06T21:27:40.386 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/ 2023-07-06T21:27:40.386 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-06T21:27:40.386 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-06T21:27:40.386 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ 2023-07-06T21:27:40.386 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-06T21:27:40.386 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-06T21:27:40.386 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-06T21:27:40.387 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/ 2023-07-06T21:27:40.387 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-06T21:27:40.387 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-06T21:27:40.387 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-06T21:27:40.387 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-06T21:27:40.387 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-06T21:27:40.387 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-06T21:27:40.387 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-06T21:27:40.388 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/ 2023-07-06T21:27:40.388 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-06T21:27:40.388 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-06T21:27:40.388 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ 2023-07-06T21:27:40.388 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-06T21:27:40.388 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-06T21:27:40.388 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-06T21:27:40.389 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-06T21:27:40.389 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-06T21:27:40.389 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-06T21:27:40.389 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-06T21:27:40.389 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-06T21:27:40.389 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-06T21:27:40.389 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-06T21:27:40.389 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-06T21:27:40.390 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 75865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-06T21:27:40.390 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-06T21:27:40.390 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 92249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-06T21:27:40.390 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-06T21:27:40.390 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-06T21:27:40.390 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-06T21:27:40.390 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-06T21:27:40.390 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-06T21:27:40.391 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/plip/ 2023-07-06T21:27:40.391 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/plip/plip.ko 2023-07-06T21:27:40.391 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ 2023-07-06T21:27:40.391 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-06T21:27:40.391 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-06T21:27:40.391 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-06T21:27:40.391 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-06T21:27:40.392 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-06T21:27:40.392 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-06T21:27:40.392 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-06T21:27:40.392 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-06T21:27:40.392 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sb1000.ko 2023-07-06T21:27:40.392 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/ 2023-07-06T21:27:40.392 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-06T21:27:40.392 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-06T21:27:40.393 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-06T21:27:40.393 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/ 2023-07-06T21:27:40.393 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 104985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-06T21:27:40.393 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-06T21:27:40.393 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-06T21:27:40.393 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-06T21:27:40.393 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-06T21:27:40.394 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-06T21:27:40.394 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-06T21:27:40.394 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/ 2023-07-06T21:27:40.394 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 120497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-06T21:27:40.394 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/ 2023-07-06T21:27:40.394 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 290161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-06T21:27:40.394 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/ 2023-07-06T21:27:40.394 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 143801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-06T21:27:40.395 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ 2023-07-06T21:27:40.395 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-06T21:27:40.395 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/ 2023-07-06T21:27:40.395 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/ 2023-07-06T21:27:40.395 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 256953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-06T21:27:40.395 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 102057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-06T21:27:40.395 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/ 2023-07-06T21:27:40.395 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 129129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-06T21:27:40.396 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-06T21:27:40.396 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-06T21:27:40.396 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-06T21:27:40.396 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/ 2023-07-06T21:27:40.396 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/ 2023-07-06T21:27:40.396 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-06T21:27:40.396 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-06T21:27:40.396 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-06T21:27:40.397 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pci-stub.ko 2023-07-06T21:27:40.397 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-06T21:27:40.397 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/ 2023-07-06T21:27:40.397 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-06T21:27:40.397 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 143713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia.ko 2023-07-06T21:27:40.397 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-06T21:27:40.397 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-06T21:27:40.398 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-06T21:27:40.398 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 112913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-06T21:27:40.398 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/ 2023-07-06T21:27:40.398 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/broadcom/ 2023-07-06T21:27:40.398 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-06T21:27:40.398 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/samsung/ 2023-07-06T21:27:40.398 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-06T21:27:40.398 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/ 2023-07-06T21:27:40.399 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/ 2023-07-06T21:27:40.399 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-06T21:27:40.399 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/ 2023-07-06T21:27:40.399 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/ 2023-07-06T21:27:40.399 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-06T21:27:40.399 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-06T21:27:40.399 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-06T21:27:40.399 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-06T21:27:40.400 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-06T21:27:40.400 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-06T21:27:40.400 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-06T21:27:40.400 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/ 2023-07-06T21:27:40.400 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-06T21:27:40.400 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-06T21:27:40.400 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-06T21:27:40.401 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-06T21:27:40.401 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-06T21:27:40.401 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 106393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-06T21:27:40.401 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-06T21:27:40.401 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-06T21:27:40.401 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-06T21:27:40.401 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-06T21:27:40.402 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-06T21:27:40.402 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-06T21:27:40.402 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-06T21:27:40.402 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/ 2023-07-06T21:27:40.402 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-06T21:27:40.402 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-06T21:27:40.402 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-06T21:27:40.402 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-06T21:27:40.403 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-06T21:27:40.403 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-06T21:27:40.403 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-06T21:27:40.403 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-06T21:27:40.403 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-06T21:27:40.403 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-06T21:27:40.403 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-06T21:27:40.403 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-06T21:27:40.404 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-06T21:27:40.404 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/ 2023-07-06T21:27:40.404 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ 2023-07-06T21:27:40.404 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-06T21:27:40.404 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-06T21:27:40.404 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-06T21:27:40.404 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-06T21:27:40.405 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-06T21:27:40.405 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-06T21:27:40.405 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/da9030_battery.ko 2023-07-06T21:27:40.405 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/da9052-battery.ko 2023-07-06T21:27:40.405 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-06T21:27:40.405 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-06T21:27:40.405 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-06T21:27:40.405 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-06T21:27:40.406 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/gpio-charger.ko 2023-07-06T21:27:40.406 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-06T21:27:40.406 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-06T21:27:40.406 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max14577_charger.ko 2023-07-06T21:27:40.406 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max17040_battery.ko 2023-07-06T21:27:40.406 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max17042_battery.ko 2023-07-06T21:27:40.406 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max8903_charger.ko 2023-07-06T21:27:40.407 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max8925_power.ko 2023-07-06T21:27:40.407 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-06T21:27:40.407 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/sbs-battery.ko 2023-07-06T21:27:40.407 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/test_power.ko 2023-07-06T21:27:40.407 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-06T21:27:40.407 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-06T21:27:40.407 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm831x_power.ko 2023-07-06T21:27:40.407 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm8350_power.ko 2023-07-06T21:27:40.408 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/ 2023-07-06T21:27:40.408 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-06T21:27:40.408 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-06T21:27:40.408 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/ 2023-07-06T21:27:40.408 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/ 2023-07-06T21:27:40.408 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-06T21:27:40.408 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-06T21:27:40.408 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-06T21:27:40.409 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-06T21:27:40.409 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ 2023-07-06T21:27:40.409 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 64609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-06T21:27:40.409 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-06T21:27:40.409 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/ 2023-07-06T21:27:40.409 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-06T21:27:40.409 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-06T21:27:40.410 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-06T21:27:40.410 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-06T21:27:40.410 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9052.ko 2023-07-06T21:27:40.410 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9055.ko 2023-07-06T21:27:40.410 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9063.ko 2023-07-06T21:27:40.410 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-06T21:27:40.410 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-06T21:27:40.410 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-06T21:27:40.411 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-06T21:27:40.411 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-06T21:27:40.411 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-06T21:27:40.411 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-06T21:27:40.411 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-06T21:27:40.411 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-06T21:27:40.411 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-06T21:27:40.411 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-06T21:27:40.412 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-06T21:27:40.412 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-06T21:27:40.412 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-06T21:27:40.412 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-06T21:27:40.412 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-06T21:27:40.412 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-06T21:27:40.412 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-06T21:27:40.413 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-06T21:27:40.413 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8907.ko 2023-07-06T21:27:40.413 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8925.ko 2023-07-06T21:27:40.413 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8997.ko 2023-07-06T21:27:40.413 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8998.ko 2023-07-06T21:27:40.413 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-06T21:27:40.413 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-06T21:27:40.413 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-palmas.ko 2023-07-06T21:27:40.414 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-06T21:27:40.414 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-06T21:27:40.414 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-06T21:27:40.414 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-06T21:27:40.414 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-06T21:27:40.414 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-06T21:27:40.414 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-06T21:27:40.414 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-06T21:27:40.415 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-06T21:27:40.415 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-06T21:27:40.415 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-06T21:27:40.415 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-06T21:27:40.415 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-06T21:27:40.415 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-06T21:27:40.415 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-06T21:27:40.416 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-06T21:27:40.416 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-06T21:27:40.416 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-06T21:27:40.416 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-06T21:27:40.416 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ 2023-07-06T21:27:40.416 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 77641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-06T21:27:40.416 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-06T21:27:40.416 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-06T21:27:40.417 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 135169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-06T21:27:40.417 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-06T21:27:40.417 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/ 2023-07-06T21:27:40.417 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 272353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-06T21:27:40.417 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 100617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-06T21:27:40.417 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/ 2023-07-06T21:27:40.417 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 356201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-06T21:27:40.417 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 295801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-06T21:27:40.418 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic94xx/ 2023-07-06T21:27:40.418 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 189321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-06T21:27:40.418 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-06T21:27:40.418 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/ 2023-07-06T21:27:40.418 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 106569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-06T21:27:40.418 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-06T21:27:40.418 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/ 2023-07-06T21:27:40.419 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 246897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-06T21:27:40.419 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/ 2023-07-06T21:27:40.419 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1172185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-06T21:27:40.419 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/ 2023-07-06T21:27:40.419 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 237169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-06T21:27:40.419 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/ 2023-07-06T21:27:40.419 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 115393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-06T21:27:40.419 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-06T21:27:40.420 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/ 2023-07-06T21:27:40.420 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 308889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-06T21:27:40.420 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/ 2023-07-06T21:27:40.420 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-06T21:27:40.420 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 76193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-06T21:27:40.420 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-06T21:27:40.420 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-06T21:27:40.420 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 141873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-06T21:27:40.421 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 75529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-06T21:27:40.421 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-06T21:27:40.421 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/ 2023-07-06T21:27:40.421 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 212401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-06T21:27:40.421 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-06T21:27:40.421 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/ 2023-07-06T21:27:40.421 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-06T21:27:40.422 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 155089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-06T21:27:40.422 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fdomain.ko 2023-07-06T21:27:40.422 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/ 2023-07-06T21:27:40.422 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 262073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-06T21:27:40.422 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 201793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-06T21:27:40.422 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-06T21:27:40.422 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-06T21:27:40.422 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/imm.ko 2023-07-06T21:27:40.423 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-06T21:27:40.423 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 266521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-06T21:27:40.423 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-06T21:27:40.423 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/ 2023-07-06T21:27:40.423 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 317249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-06T21:27:40.423 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-06T21:27:40.423 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-06T21:27:40.423 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/ 2023-07-06T21:27:40.424 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 308313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-06T21:27:40.424 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 140225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-06T21:27:40.424 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-06T21:27:40.424 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/ 2023-07-06T21:27:40.424 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 213041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-06T21:27:40.424 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/ 2023-07-06T21:27:40.424 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2193865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-06T21:27:40.425 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/ 2023-07-06T21:27:40.425 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-06T21:27:40.425 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-06T21:27:40.425 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 310729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-06T21:27:40.425 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 84697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-06T21:27:40.425 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/ 2023-07-06T21:27:40.425 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 659577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-06T21:27:40.425 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/ 2023-07-06T21:27:40.426 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 119929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-06T21:27:40.426 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-06T21:27:40.426 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/ 2023-07-06T21:27:40.426 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-06T21:27:40.426 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-06T21:27:40.426 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-06T21:27:40.426 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-06T21:27:40.426 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/ 2023-07-06T21:27:40.427 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 361433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-06T21:27:40.427 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 123489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-06T21:27:40.427 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ppa.ko 2023-07-06T21:27:40.427 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-06T21:27:40.427 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/ 2023-07-06T21:27:40.427 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1850945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-06T21:27:40.427 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-06T21:27:40.427 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/ 2023-07-06T21:27:40.428 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 558865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-06T21:27:40.428 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qlogicfas408.ko 2023-07-06T21:27:40.428 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-06T21:27:40.428 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 238737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-06T21:27:40.428 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 171865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-06T21:27:40.428 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 270161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-06T21:27:40.428 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 94353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-06T21:27:40.429 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-06T21:27:40.429 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-06T21:27:40.429 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-06T21:27:40.429 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 115785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-06T21:27:40.429 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-06T21:27:40.429 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-06T21:27:40.429 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 162121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-06T21:27:40.429 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-06T21:27:40.430 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-06T21:27:40.430 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-06T21:27:40.430 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/xen-scsifront.ko 2023-07-06T21:27:40.430 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ 2023-07-06T21:27:40.430 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 127025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-06T21:27:40.430 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/ 2023-07-06T21:27:40.430 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/ 2023-07-06T21:27:40.431 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 733905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-06T21:27:40.431 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/ 2023-07-06T21:27:40.431 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-06T21:27:40.431 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-06T21:27:40.431 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-06T21:27:40.431 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 920793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-06T21:27:40.431 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-06T21:27:40.431 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 122537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-06T21:27:40.432 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/ 2023-07-06T21:27:40.432 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 75641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-06T21:27:40.432 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/ 2023-07-06T21:27:40.432 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/ 2023-07-06T21:27:40.432 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-06T21:27:40.432 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-06T21:27:40.432 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-06T21:27:40.432 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-06T21:27:40.433 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-06T21:27:40.433 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-06T21:27:40.433 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-06T21:27:40.433 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-06T21:27:40.433 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-06T21:27:40.433 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-06T21:27:40.433 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-06T21:27:40.434 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-06T21:27:40.434 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-06T21:27:40.434 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-06T21:27:40.434 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-06T21:27:40.434 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-06T21:27:40.434 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-06T21:27:40.434 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ 2023-07-06T21:27:40.434 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ 2023-07-06T21:27:40.435 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-06T21:27:40.435 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/moxa.ko 2023-07-06T21:27:40.435 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/mxser.ko 2023-07-06T21:27:40.435 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 107545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-06T21:27:40.435 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-06T21:27:40.435 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-06T21:27:40.435 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/ 2023-07-06T21:27:40.435 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/ 2023-07-06T21:27:40.436 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-06T21:27:40.436 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-06T21:27:40.436 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-06T21:27:40.436 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/altera_uart.ko 2023-07-06T21:27:40.436 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-06T21:27:40.436 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-06T21:27:40.436 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/ 2023-07-06T21:27:40.437 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 103017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-06T21:27:40.437 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/rp2.ko 2023-07-06T21:27:40.437 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-06T21:27:40.437 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 100185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-06T21:27:40.437 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/ 2023-07-06T21:27:40.437 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ 2023-07-06T21:27:40.437 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 519393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-06T21:27:40.437 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ 2023-07-06T21:27:40.438 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-06T21:27:40.438 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-06T21:27:40.438 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/ 2023-07-06T21:27:40.438 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-06T21:27:40.438 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-06T21:27:40.438 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-06T21:27:40.438 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-06T21:27:40.438 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_mf624.ko 2023-07-06T21:27:40.439 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_netx.ko 2023-07-06T21:27:40.439 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-06T21:27:40.439 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-06T21:27:40.439 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-06T21:27:40.439 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/ 2023-07-06T21:27:40.439 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/c67x00/ 2023-07-06T21:27:40.439 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-06T21:27:40.439 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ 2023-07-06T21:27:40.440 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 142529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-06T21:27:40.440 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-06T21:27:40.440 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-06T21:27:40.440 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-06T21:27:40.440 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/ 2023-07-06T21:27:40.440 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-06T21:27:40.440 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-06T21:27:40.441 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-06T21:27:40.441 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-06T21:27:40.441 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/common/ 2023-07-06T21:27:40.441 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/common/ulpi.ko 2023-07-06T21:27:40.441 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc2/ 2023-07-06T21:27:40.441 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-06T21:27:40.441 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/ 2023-07-06T21:27:40.441 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-06T21:27:40.442 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-06T21:27:40.442 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 441593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-06T21:27:40.442 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/ 2023-07-06T21:27:40.442 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/ 2023-07-06T21:27:40.442 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-06T21:27:40.442 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-06T21:27:40.442 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-06T21:27:40.443 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-06T21:27:40.443 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-06T21:27:40.443 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-06T21:27:40.443 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 91929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-06T21:27:40.443 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-06T21:27:40.443 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 118017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-06T21:27:40.443 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-06T21:27:40.443 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-06T21:27:40.444 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-06T21:27:40.444 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-06T21:27:40.444 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 84193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-06T21:27:40.444 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-06T21:27:40.444 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-06T21:27:40.444 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-06T21:27:40.444 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/ 2023-07-06T21:27:40.444 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-06T21:27:40.445 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-06T21:27:40.445 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-06T21:27:40.445 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-06T21:27:40.445 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-06T21:27:40.445 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-06T21:27:40.445 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-06T21:27:40.445 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-06T21:27:40.446 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-06T21:27:40.446 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-06T21:27:40.446 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-06T21:27:40.446 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-06T21:27:40.446 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-06T21:27:40.446 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-06T21:27:40.446 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 157009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-06T21:27:40.446 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/ 2023-07-06T21:27:40.447 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-06T21:27:40.447 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-06T21:27:40.447 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 157665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-06T21:27:40.447 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-06T21:27:40.447 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-06T21:27:40.447 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-06T21:27:40.447 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-06T21:27:40.447 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 76033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-06T21:27:40.448 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 75017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-06T21:27:40.448 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-06T21:27:40.448 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-06T21:27:40.448 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-06T21:27:40.448 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-06T21:27:40.448 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 146001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-06T21:27:40.448 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/ 2023-07-06T21:27:40.449 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-06T21:27:40.449 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-06T21:27:40.449 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 87625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-06T21:27:40.449 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-06T21:27:40.449 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-06T21:27:40.449 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811_cs.ko 2023-07-06T21:27:40.449 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-06T21:27:40.449 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-06T21:27:40.450 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/ 2023-07-06T21:27:40.450 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-06T21:27:40.450 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-06T21:27:40.450 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ 2023-07-06T21:27:40.450 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-06T21:27:40.450 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-06T21:27:40.450 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-06T21:27:40.450 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/cytherm.ko 2023-07-06T21:27:40.451 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ehset.ko 2023-07-06T21:27:40.451 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-06T21:27:40.451 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-06T21:27:40.451 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-06T21:27:40.451 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-06T21:27:40.451 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-06T21:27:40.451 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-06T21:27:40.452 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-06T21:27:40.452 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-06T21:27:40.452 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/lvstest.ko 2023-07-06T21:27:40.452 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/ 2023-07-06T21:27:40.452 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 64841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-06T21:27:40.452 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-06T21:27:40.452 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-06T21:27:40.452 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-06T21:27:40.453 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-06T21:27:40.453 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbtest.ko 2023-07-06T21:27:40.453 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-06T21:27:40.453 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-06T21:27:40.453 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/mon/ 2023-07-06T21:27:40.453 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/mon/usbmon.ko 2023-07-06T21:27:40.453 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/musb/ 2023-07-06T21:27:40.453 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 295049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-06T21:27:40.454 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/ 2023-07-06T21:27:40.454 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-06T21:27:40.454 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-06T21:27:40.454 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-06T21:27:40.454 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-06T21:27:40.454 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ 2023-07-06T21:27:40.454 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-06T21:27:40.455 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-06T21:27:40.455 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-06T21:27:40.455 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-06T21:27:40.455 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-06T21:27:40.455 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-06T21:27:40.455 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-06T21:27:40.455 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-06T21:27:40.455 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-06T21:27:40.456 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/f81232.ko 2023-07-06T21:27:40.456 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 174841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-06T21:27:40.456 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-06T21:27:40.456 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 136945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-06T21:27:40.456 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 124465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-06T21:27:40.456 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-06T21:27:40.456 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-06T21:27:40.456 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-06T21:27:40.457 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-06T21:27:40.457 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 107417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-06T21:27:40.457 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-06T21:27:40.457 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-06T21:27:40.457 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-06T21:27:40.457 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-06T21:27:40.457 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/metro-usb.ko 2023-07-06T21:27:40.457 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-06T21:27:40.458 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-06T21:27:40.458 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mxuport.ko 2023-07-06T21:27:40.458 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-06T21:27:40.458 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-06T21:27:40.458 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-06T21:27:40.458 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 189337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-06T21:27:40.458 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-06T21:27:40.459 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-06T21:27:40.459 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-06T21:27:40.459 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-06T21:27:40.459 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-06T21:27:40.459 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-06T21:27:40.459 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-06T21:27:40.459 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-06T21:27:40.459 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-06T21:27:40.460 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-06T21:27:40.460 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-06T21:27:40.460 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-06T21:27:40.460 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-06T21:27:40.460 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-06T21:27:40.460 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 122913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usbserial.ko 2023-07-06T21:27:40.460 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-06T21:27:40.460 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-06T21:27:40.461 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-06T21:27:40.461 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-06T21:27:40.461 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ 2023-07-06T21:27:40.461 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-06T21:27:40.461 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-06T21:27:40.461 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-06T21:27:40.461 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-06T21:27:40.461 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-06T21:27:40.462 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-06T21:27:40.462 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-06T21:27:40.462 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-06T21:27:40.462 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-06T21:27:40.462 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-06T21:27:40.462 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-06T21:27:40.462 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-06T21:27:40.463 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-06T21:27:40.463 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-06T21:27:40.463 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 177153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-06T21:27:40.463 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/ 2023-07-06T21:27:40.463 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-06T21:27:40.463 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-06T21:27:40.463 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 105401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-06T21:27:40.463 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/ 2023-07-06T21:27:40.464 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/ 2023-07-06T21:27:40.464 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 145817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-06T21:27:40.464 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-06T21:27:40.464 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 97969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-06T21:27:40.464 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 75249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-06T21:27:40.464 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/ 2023-07-06T21:27:40.464 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 96017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-06T21:27:40.464 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-06T21:27:40.465 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-06T21:27:40.465 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-06T21:27:40.465 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/ 2023-07-06T21:27:40.465 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/ 2023-07-06T21:27:40.465 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-06T21:27:40.465 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-06T21:27:40.465 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-06T21:27:40.466 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-06T21:27:40.466 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-06T21:27:40.466 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-06T21:27:40.466 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-06T21:27:40.466 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/bd6107.ko 2023-07-06T21:27:40.466 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-06T21:27:40.466 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-06T21:27:40.466 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-06T21:27:40.467 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-06T21:27:40.467 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-06T21:27:40.467 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-06T21:27:40.467 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-06T21:27:40.467 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-06T21:27:40.467 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-06T21:27:40.467 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-06T21:27:40.467 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-06T21:27:40.468 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-06T21:27:40.468 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-06T21:27:40.468 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/ 2023-07-06T21:27:40.468 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ 2023-07-06T21:27:40.468 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-06T21:27:40.468 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-06T21:27:40.468 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-06T21:27:40.469 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-06T21:27:40.469 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/ 2023-07-06T21:27:40.469 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-06T21:27:40.469 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-06T21:27:40.469 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-06T21:27:40.469 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-06T21:27:40.469 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-06T21:27:40.469 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-06T21:27:40.470 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-06T21:27:40.470 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-06T21:27:40.470 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-06T21:27:40.470 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-06T21:27:40.470 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-06T21:27:40.470 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-06T21:27:40.470 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ 2023-07-06T21:27:40.470 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/acquirewdt.ko 2023-07-06T21:27:40.471 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/advantechwdt.ko 2023-07-06T21:27:40.471 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-06T21:27:40.471 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-06T21:27:40.471 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-06T21:27:40.471 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-06T21:27:40.471 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-06T21:27:40.471 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-06T21:27:40.472 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/dw_wdt.ko 2023-07-06T21:27:40.472 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-06T21:27:40.472 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-06T21:27:40.472 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-06T21:27:40.472 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-06T21:27:40.472 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-06T21:27:40.473 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-06T21:27:40.473 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-06T21:27:40.473 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-06T21:27:40.473 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-06T21:27:40.473 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-06T21:27:40.473 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-06T21:27:40.473 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-06T21:27:40.473 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-06T21:27:40.474 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-06T21:27:40.474 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-06T21:27:40.474 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-06T21:27:40.474 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-06T21:27:40.474 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-06T21:27:40.474 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-06T21:27:40.474 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-06T21:27:40.475 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/retu_wdt.ko 2023-07-06T21:27:40.475 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-06T21:27:40.475 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-06T21:27:40.475 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-06T21:27:40.475 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-06T21:27:40.475 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-06T21:27:40.475 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-06T21:27:40.475 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-06T21:27:40.476 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-06T21:27:40.476 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-06T21:27:40.476 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-06T21:27:40.476 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-06T21:27:40.476 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-06T21:27:40.476 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-06T21:27:40.476 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-06T21:27:40.476 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-06T21:27:40.477 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-06T21:27:40.477 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-06T21:27:40.477 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-06T21:27:40.477 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/ 2023-07-06T21:27:40.477 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-06T21:27:40.477 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-06T21:27:40.477 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-06T21:27:40.478 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/ 2023-07-06T21:27:40.478 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 176353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-06T21:27:40.478 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-06T21:27:40.478 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-scsiback.ko 2023-07-06T21:27:40.478 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/ 2023-07-06T21:27:40.478 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-06T21:27:40.478 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ 2023-07-06T21:27:40.478 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/ 2023-07-06T21:27:40.479 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 165513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-06T21:27:40.479 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/adfs/ 2023-07-06T21:27:40.479 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/adfs/adfs.ko 2023-07-06T21:27:40.479 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/ 2023-07-06T21:27:40.479 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 162625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-06T21:27:40.479 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/afs/ 2023-07-06T21:27:40.479 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 924297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/afs/kafs.ko 2023-07-06T21:27:40.479 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/autofs/ 2023-07-06T21:27:40.480 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 100761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/autofs/autofs4.ko 2023-07-06T21:27:40.480 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/ 2023-07-06T21:27:40.480 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 64417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-06T21:27:40.480 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/bfs/ 2023-07-06T21:27:40.480 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/bfs/bfs.ko 2023-07-06T21:27:40.480 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-06T21:27:40.480 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/ 2023-07-06T21:27:40.480 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 3447409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-06T21:27:40.481 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/ 2023-07-06T21:27:40.481 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 300025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-06T21:27:40.481 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ 2023-07-06T21:27:40.481 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1308201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-06T21:27:40.481 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/ 2023-07-06T21:27:40.481 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 99337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-06T21:27:40.481 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/configfs/ 2023-07-06T21:27:40.482 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 105969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/configfs/configfs.ko 2023-07-06T21:27:40.482 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/ 2023-07-06T21:27:40.482 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-06T21:27:40.482 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/ 2023-07-06T21:27:40.482 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 631425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-06T21:27:40.482 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/efs/ 2023-07-06T21:27:40.482 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/efs/efs.ko 2023-07-06T21:27:40.482 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/ 2023-07-06T21:27:40.483 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1473049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-06T21:27:40.483 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/ 2023-07-06T21:27:40.483 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-06T21:27:40.483 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/freevxfs/ 2023-07-06T21:27:40.483 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/freevxfs/freevxfs.ko 2023-07-06T21:27:40.483 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/ 2023-07-06T21:27:40.483 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 218713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-06T21:27:40.483 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/ 2023-07-06T21:27:40.484 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-06T21:27:40.484 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/ 2023-07-06T21:27:40.484 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1221129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-06T21:27:40.484 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/ 2023-07-06T21:27:40.484 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 141241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-06T21:27:40.484 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/ 2023-07-06T21:27:40.484 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 221561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-06T21:27:40.485 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hpfs/ 2023-07-06T21:27:40.485 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 193585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hpfs/hpfs.ko 2023-07-06T21:27:40.485 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/ 2023-07-06T21:27:40.485 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 74393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-06T21:27:40.485 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/ 2023-07-06T21:27:40.485 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 420425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-06T21:27:40.485 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/ 2023-07-06T21:27:40.485 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 276953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-06T21:27:40.486 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/ 2023-07-06T21:27:40.486 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 87841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-06T21:27:40.486 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/ 2023-07-06T21:27:40.486 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 128665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-06T21:27:40.486 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/ 2023-07-06T21:27:40.486 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/ 2023-07-06T21:27:40.486 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-06T21:27:40.486 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/ 2023-07-06T21:27:40.487 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-06T21:27:40.487 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/ 2023-07-06T21:27:40.487 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 117705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-06T21:27:40.487 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1002089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-06T21:27:40.487 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv2.ko 2023-07-06T21:27:40.487 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 119289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-06T21:27:40.487 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2003425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-06T21:27:40.488 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/ 2023-07-06T21:27:40.488 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-06T21:27:40.488 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-06T21:27:40.488 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/ 2023-07-06T21:27:40.488 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1407977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-06T21:27:40.488 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/ 2023-07-06T21:27:40.488 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 589433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-06T21:27:40.488 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/ 2023-07-06T21:27:40.489 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-06T21:27:40.489 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-06T21:27:40.489 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-06T21:27:40.489 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-06T21:27:40.489 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-06T21:27:40.489 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-06T21:27:40.489 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-06T21:27:40.489 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-06T21:27:40.490 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-06T21:27:40.490 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-06T21:27:40.490 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-06T21:27:40.490 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_ascii.ko 2023-07-06T21:27:40.490 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-06T21:27:40.490 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-06T21:27:40.490 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-06T21:27:40.490 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-06T21:27:40.491 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-06T21:27:40.491 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-06T21:27:40.491 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-06T21:27:40.491 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-06T21:27:40.491 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-06T21:27:40.491 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-06T21:27:40.491 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-06T21:27:40.492 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-06T21:27:40.492 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-06T21:27:40.492 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-06T21:27:40.492 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-06T21:27:40.492 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-06T21:27:40.492 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-06T21:27:40.492 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-06T21:27:40.492 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 94137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-06T21:27:40.493 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 142673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-06T21:27:40.493 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 165745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-06T21:27:40.493 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 118121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-06T21:27:40.493 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-06T21:27:40.493 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-06T21:27:40.493 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-06T21:27:40.493 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-06T21:27:40.494 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-06T21:27:40.494 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-06T21:27:40.494 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-06T21:27:40.494 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-06T21:27:40.494 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-06T21:27:40.494 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-06T21:27:40.494 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-06T21:27:40.494 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-06T21:27:40.495 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-06T21:27:40.495 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-06T21:27:40.495 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-06T21:27:40.495 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-06T21:27:40.495 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ntfs/ 2023-07-06T21:27:40.495 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 219081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ntfs/ntfs.ko 2023-07-06T21:27:40.495 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ 2023-07-06T21:27:40.495 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ 2023-07-06T21:27:40.496 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 241241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-06T21:27:40.496 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ 2023-07-06T21:27:40.496 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 439625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-06T21:27:40.496 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ 2023-07-06T21:27:40.496 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-06T21:27:40.496 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2511665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-06T21:27:40.496 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-06T21:27:40.497 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-06T21:27:40.497 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-06T21:27:40.497 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/omfs/ 2023-07-06T21:27:40.497 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/omfs/omfs.ko 2023-07-06T21:27:40.497 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/ 2023-07-06T21:27:40.497 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 320689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-06T21:27:40.497 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ 2023-07-06T21:27:40.497 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-06T21:27:40.498 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx4/ 2023-07-06T21:27:40.498 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx4/qnx4.ko 2023-07-06T21:27:40.498 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx6/ 2023-07-06T21:27:40.498 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx6/qnx6.ko 2023-07-06T21:27:40.498 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/ 2023-07-06T21:27:40.498 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_tree.ko 2023-07-06T21:27:40.498 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_v1.ko 2023-07-06T21:27:40.498 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_v2.ko 2023-07-06T21:27:40.499 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/ 2023-07-06T21:27:40.499 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 530697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-06T21:27:40.499 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/ 2023-07-06T21:27:40.499 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-06T21:27:40.499 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/ 2023-07-06T21:27:40.499 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/ 2023-07-06T21:27:40.499 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2622729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-06T21:27:40.499 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/ 2023-07-06T21:27:40.500 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-06T21:27:40.500 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-06T21:27:40.500 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/ 2023-07-06T21:27:40.500 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 131689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-06T21:27:40.500 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/ 2023-07-06T21:27:40.500 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-06T21:27:40.500 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/ 2023-07-06T21:27:40.501 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 248257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-06T21:27:40.501 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ 2023-07-06T21:27:40.501 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 160857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-06T21:27:40.501 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/ 2023-07-06T21:27:40.501 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 3854977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-06T21:27:40.501 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/ 2023-07-06T21:27:40.501 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/locking/ 2023-07-06T21:27:40.501 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/locking/locktorture.ko 2023-07-06T21:27:40.502 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/time/ 2023-07-06T21:27:40.502 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/time/test_udelay.ko 2023-07-06T21:27:40.502 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-06T21:27:40.502 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ 2023-07-06T21:27:40.502 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-06T21:27:40.502 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc7.ko 2023-07-06T21:27:40.502 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-06T21:27:40.503 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/ 2023-07-06T21:27:40.503 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-06T21:27:40.503 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-06T21:27:40.503 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/interval_tree_test.ko 2023-07-06T21:27:40.503 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-06T21:27:40.503 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-06T21:27:40.503 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/ 2023-07-06T21:27:40.503 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-06T21:27:40.504 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-06T21:27:40.504 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/ 2023-07-06T21:27:40.504 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-06T21:27:40.504 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/memory-notifier-error-inject.ko 2023-07-06T21:27:40.504 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/notifier-error-inject.ko 2023-07-06T21:27:40.504 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/percpu_test.ko 2023-07-06T21:27:40.504 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/pm-notifier-error-inject.ko 2023-07-06T21:27:40.504 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/ 2023-07-06T21:27:40.505 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 142369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-06T21:27:40.505 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/rbtree_test.ko 2023-07-06T21:27:40.505 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/ 2023-07-06T21:27:40.505 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-06T21:27:40.505 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test-kstrtox.ko 2023-07-06T21:27:40.505 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test-string_helpers.ko 2023-07-06T21:27:40.505 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 4760825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_bpf.ko 2023-07-06T21:27:40.528 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_firmware.ko 2023-07-06T21:27:40.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_module.ko 2023-07-06T21:27:40.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_user_copy.ko 2023-07-06T21:27:40.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-06T21:27:40.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-06T21:27:40.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-06T21:27:40.529 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/xz/ 2023-07-06T21:27:40.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/xz/xz_dec_test.ko 2023-07-06T21:27:40.530 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/mm/ 2023-07-06T21:27:40.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-06T21:27:40.530 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ 2023-07-06T21:27:40.530 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/ 2023-07-06T21:27:40.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-06T21:27:40.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-06T21:27:40.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-06T21:27:40.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-06T21:27:40.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-06T21:27:40.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-06T21:27:40.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-06T21:27:40.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-06T21:27:40.531 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/ 2023-07-06T21:27:40.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-06T21:27:40.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-06T21:27:40.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-06T21:27:40.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-06T21:27:40.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-06T21:27:40.532 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/ 2023-07-06T21:27:40.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-06T21:27:40.532 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/ 2023-07-06T21:27:40.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 191801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-06T21:27:40.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-06T21:27:40.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-06T21:27:40.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-06T21:27:40.533 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/ 2023-07-06T21:27:40.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 652553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-06T21:27:40.533 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/ 2023-07-06T21:27:40.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-06T21:27:40.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 769841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-06T21:27:40.534 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ 2023-07-06T21:27:40.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-06T21:27:40.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-06T21:27:40.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-06T21:27:40.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-06T21:27:40.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-06T21:27:40.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-06T21:27:40.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-06T21:27:40.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-06T21:27:40.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-06T21:27:40.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-06T21:27:40.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-06T21:27:40.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-06T21:27:40.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-06T21:27:40.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-06T21:27:40.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-06T21:27:40.536 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-06T21:27:40.536 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-06T21:27:40.536 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-06T21:27:40.536 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-06T21:27:40.536 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-06T21:27:40.536 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-06T21:27:40.536 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-06T21:27:40.537 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-06T21:27:40.537 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/ 2023-07-06T21:27:40.537 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1030233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-06T21:27:40.537 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/core/ 2023-07-06T21:27:40.537 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 124729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-06T21:27:40.537 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/ 2023-07-06T21:27:40.537 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 189745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-06T21:27:40.537 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-06T21:27:40.538 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-06T21:27:40.538 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-06T21:27:40.538 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/ 2023-07-06T21:27:40.538 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 380473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-06T21:27:40.538 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-06T21:27:40.538 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-06T21:27:40.538 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-06T21:27:40.539 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-06T21:27:40.539 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/hsr/ 2023-07-06T21:27:40.539 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 99825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/hsr/hsr.ko 2023-07-06T21:27:40.539 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ 2023-07-06T21:27:40.539 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ 2023-07-06T21:27:40.540 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-06T21:27:40.540 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 245857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-06T21:27:40.540 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-06T21:27:40.540 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ 2023-07-06T21:27:40.540 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-06T21:27:40.540 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-06T21:27:40.541 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-06T21:27:40.541 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-06T21:27:40.541 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-06T21:27:40.541 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-06T21:27:40.541 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-06T21:27:40.541 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-06T21:27:40.541 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-06T21:27:40.541 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-06T21:27:40.542 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ 2023-07-06T21:27:40.542 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-06T21:27:40.542 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-06T21:27:40.542 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-06T21:27:40.542 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-06T21:27:40.542 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-06T21:27:40.542 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-06T21:27:40.543 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-06T21:27:40.543 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-06T21:27:40.543 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-06T21:27:40.543 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-06T21:27:40.543 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-06T21:27:40.543 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-06T21:27:40.543 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-06T21:27:40.543 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-06T21:27:40.544 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-06T21:27:40.544 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-06T21:27:40.544 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-06T21:27:40.544 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-06T21:27:40.544 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-06T21:27:40.544 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-06T21:27:40.544 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-06T21:27:40.545 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-06T21:27:40.545 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-06T21:27:40.545 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-06T21:27:40.545 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-06T21:27:40.545 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-06T21:27:40.545 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-06T21:27:40.545 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-06T21:27:40.545 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-06T21:27:40.546 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-06T21:27:40.546 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-06T21:27:40.546 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-06T21:27:40.546 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-06T21:27:40.546 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-06T21:27:40.546 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-06T21:27:40.546 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-06T21:27:40.547 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-06T21:27:40.547 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-06T21:27:40.547 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-06T21:27:40.547 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-06T21:27:40.547 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-06T21:27:40.547 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-06T21:27:40.547 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ 2023-07-06T21:27:40.547 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-06T21:27:40.548 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-06T21:27:40.548 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-06T21:27:40.548 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_gre.ko 2023-07-06T21:27:40.548 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 91481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-06T21:27:40.548 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-06T21:27:40.548 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-06T21:27:40.548 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-06T21:27:40.549 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/mip6.ko 2023-07-06T21:27:40.549 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ 2023-07-06T21:27:40.549 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-06T21:27:40.549 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-06T21:27:40.549 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-06T21:27:40.549 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-06T21:27:40.549 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-06T21:27:40.549 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-06T21:27:40.550 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-06T21:27:40.550 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-06T21:27:40.550 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-06T21:27:40.550 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-06T21:27:40.550 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-06T21:27:40.550 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-06T21:27:40.550 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-06T21:27:40.551 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-06T21:27:40.551 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-06T21:27:40.551 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-06T21:27:40.551 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-06T21:27:40.551 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-06T21:27:40.551 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-06T21:27:40.551 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-06T21:27:40.551 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-06T21:27:40.552 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-06T21:27:40.552 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-06T21:27:40.552 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-06T21:27:40.552 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-06T21:27:40.552 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-06T21:27:40.552 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-06T21:27:40.552 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-06T21:27:40.552 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/key/ 2023-07-06T21:27:40.553 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-06T21:27:40.553 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/ 2023-07-06T21:27:40.553 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 120753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-06T21:27:40.553 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-06T21:27:40.553 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-06T21:27:40.553 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-06T21:27:40.553 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-06T21:27:40.554 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-06T21:27:40.554 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-06T21:27:40.554 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/lapb/ 2023-07-06T21:27:40.554 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/lapb/lapb.ko 2023-07-06T21:27:40.554 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/ 2023-07-06T21:27:40.554 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-06T21:27:40.554 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 267209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc2.ko 2023-07-06T21:27:40.554 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/ 2023-07-06T21:27:40.555 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 280401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-06T21:27:40.555 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/ 2023-07-06T21:27:40.555 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-06T21:27:40.555 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ 2023-07-06T21:27:40.555 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ 2023-07-06T21:27:40.555 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 117977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-06T21:27:40.555 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-06T21:27:40.556 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-06T21:27:40.556 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-06T21:27:40.556 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 102033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-06T21:27:40.556 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 103121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-06T21:27:40.556 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 104593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-06T21:27:40.556 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 105129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-06T21:27:40.556 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 114393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-06T21:27:40.556 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-06T21:27:40.557 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 111161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-06T21:27:40.557 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 114681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-06T21:27:40.557 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 114329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-06T21:27:40.557 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 113153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-06T21:27:40.557 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 116217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-06T21:27:40.557 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-06T21:27:40.557 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ 2023-07-06T21:27:40.558 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 410337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-06T21:27:40.558 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-06T21:27:40.558 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-06T21:27:40.558 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-06T21:27:40.558 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-06T21:27:40.558 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-06T21:27:40.558 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-06T21:27:40.559 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-06T21:27:40.559 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-06T21:27:40.559 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-06T21:27:40.559 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-06T21:27:40.559 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-06T21:27:40.559 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-06T21:27:40.559 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-06T21:27:40.559 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-06T21:27:40.560 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 397737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-06T21:27:40.560 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-06T21:27:40.560 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-06T21:27:40.560 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-06T21:27:40.560 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 117737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-06T21:27:40.560 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-06T21:27:40.560 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-06T21:27:40.560 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-06T21:27:40.561 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-06T21:27:40.561 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-06T21:27:40.561 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-06T21:27:40.561 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-06T21:27:40.561 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-06T21:27:40.561 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-06T21:27:40.561 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 86993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-06T21:27:40.562 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-06T21:27:40.562 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-06T21:27:40.562 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 91777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-06T21:27:40.562 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-06T21:27:40.562 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-06T21:27:40.562 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-06T21:27:40.562 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-06T21:27:40.562 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-06T21:27:40.563 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-06T21:27:40.563 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 584713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-06T21:27:40.563 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-06T21:27:40.563 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-06T21:27:40.563 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-06T21:27:40.563 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-06T21:27:40.563 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-06T21:27:40.563 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-06T21:27:40.564 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-06T21:27:40.564 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-06T21:27:40.564 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-06T21:27:40.564 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-06T21:27:40.564 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-06T21:27:40.564 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-06T21:27:40.564 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-06T21:27:40.565 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-06T21:27:40.565 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-06T21:27:40.565 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-06T21:27:40.565 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-06T21:27:40.565 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-06T21:27:40.565 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_osf.ko 2023-07-06T21:27:40.565 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-06T21:27:40.565 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-06T21:27:40.566 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-06T21:27:40.566 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-06T21:27:40.566 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-06T21:27:40.566 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_synproxy.ko 2023-07-06T21:27:40.566 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tproxy.ko 2023-07-06T21:27:40.566 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/x_tables.ko 2023-07-06T21:27:40.566 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-06T21:27:40.567 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-06T21:27:40.567 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-06T21:27:40.567 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-06T21:27:40.567 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-06T21:27:40.567 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-06T21:27:40.567 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-06T21:27:40.567 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-06T21:27:40.567 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-06T21:27:40.568 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-06T21:27:40.568 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-06T21:27:40.568 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-06T21:27:40.568 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-06T21:27:40.568 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-06T21:27:40.568 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-06T21:27:40.568 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-06T21:27:40.569 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-06T21:27:40.569 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-06T21:27:40.569 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-06T21:27:40.569 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-06T21:27:40.569 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-06T21:27:40.569 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-06T21:27:40.569 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-06T21:27:40.569 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-06T21:27:40.570 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-06T21:27:40.570 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-06T21:27:40.570 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-06T21:27:40.570 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-06T21:27:40.570 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-06T21:27:40.570 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-06T21:27:40.570 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-06T21:27:40.570 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-06T21:27:40.571 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-06T21:27:40.571 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-06T21:27:40.571 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-06T21:27:40.571 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-06T21:27:40.571 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-06T21:27:40.571 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-06T21:27:40.571 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-06T21:27:40.572 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-06T21:27:40.572 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-06T21:27:40.572 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-06T21:27:40.572 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-06T21:27:40.572 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-06T21:27:40.572 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-06T21:27:40.572 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-06T21:27:40.572 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-06T21:27:40.573 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-06T21:27:40.573 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-06T21:27:40.573 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-06T21:27:40.573 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-06T21:27:40.573 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-06T21:27:40.573 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-06T21:27:40.573 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-06T21:27:40.574 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-06T21:27:40.574 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-06T21:27:40.574 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-06T21:27:40.574 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-06T21:27:40.574 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-06T21:27:40.574 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-06T21:27:40.574 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-06T21:27:40.574 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-06T21:27:40.575 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-06T21:27:40.575 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-06T21:27:40.575 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-06T21:27:40.575 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-06T21:27:40.575 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-06T21:27:40.575 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-06T21:27:40.575 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-06T21:27:40.575 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpudp.ko 2023-07-06T21:27:40.576 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-06T21:27:40.576 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-06T21:27:40.576 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/ 2023-07-06T21:27:40.576 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-06T21:27:40.576 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/ 2023-07-06T21:27:40.576 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-06T21:27:40.576 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/ 2023-07-06T21:27:40.577 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 378153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-06T21:27:40.577 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-06T21:27:40.577 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-06T21:27:40.577 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-06T21:27:40.577 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/ 2023-07-06T21:27:40.577 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-06T21:27:40.577 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/ 2023-07-06T21:27:40.577 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 110073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/phonet.ko 2023-07-06T21:27:40.578 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/pn_pep.ko 2023-07-06T21:27:40.578 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/ 2023-07-06T21:27:40.578 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 249033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-06T21:27:40.578 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 165081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-06T21:27:40.578 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-06T21:27:40.578 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rxrpc/ 2023-07-06T21:27:40.578 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 807465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rxrpc/rxrpc.ko 2023-07-06T21:27:40.578 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/ 2023-07-06T21:27:40.579 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-06T21:27:40.579 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-06T21:27:40.579 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-06T21:27:40.579 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-06T21:27:40.579 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-06T21:27:40.579 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-06T21:27:40.579 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-06T21:27:40.579 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-06T21:27:40.580 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-06T21:27:40.580 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-06T21:27:40.580 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-06T21:27:40.580 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-06T21:27:40.580 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_cgroup.ko 2023-07-06T21:27:40.580 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-06T21:27:40.580 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-06T21:27:40.580 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-06T21:27:40.581 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-06T21:27:40.581 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-06T21:27:40.581 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-06T21:27:40.581 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-06T21:27:40.581 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-06T21:27:40.581 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-06T21:27:40.581 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-06T21:27:40.582 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-06T21:27:40.582 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-06T21:27:40.582 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-06T21:27:40.582 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-06T21:27:40.582 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq_codel.ko 2023-07-06T21:27:40.582 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-06T21:27:40.582 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-06T21:27:40.582 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-06T21:27:40.583 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-06T21:27:40.583 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-06T21:27:40.583 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-06T21:27:40.583 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-06T21:27:40.583 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-06T21:27:40.583 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-06T21:27:40.583 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-06T21:27:40.583 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-06T21:27:40.584 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-06T21:27:40.584 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-06T21:27:40.584 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-06T21:27:40.584 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-06T21:27:40.584 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-06T21:27:40.584 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-06T21:27:40.584 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-06T21:27:40.584 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/ 2023-07-06T21:27:40.585 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 929385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-06T21:27:40.585 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-06T21:27:40.585 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/ 2023-07-06T21:27:40.585 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/ 2023-07-06T21:27:40.585 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 328057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-06T21:27:40.585 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-06T21:27:40.585 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1426529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-06T21:27:40.586 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/ 2023-07-06T21:27:40.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 681721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-06T21:27:40.586 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/ 2023-07-06T21:27:40.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-06T21:27:40.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 855089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-06T21:27:40.586 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/ 2023-07-06T21:27:40.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-06T21:27:40.586 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/ 2023-07-06T21:27:40.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-06T21:27:40.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-06T21:27:40.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 92689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-06T21:27:40.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-06T21:27:40.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-06T21:27:40.587 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/x25/ 2023-07-06T21:27:40.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 125225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/x25/x25.ko 2023-07-06T21:27:40.588 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/ 2023-07-06T21:27:40.588 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_algo.ko 2023-07-06T21:27:40.588 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-06T21:27:40.588 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_user.ko 2023-07-06T21:27:40.588 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/ 2023-07-06T21:27:40.588 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/ 2023-07-06T21:27:40.588 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-06T21:27:40.588 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 637389 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-06T21:27:40.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 623128 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-06T21:27:40.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7605 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-06T21:27:40.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.alias.bin 2023-07-06T21:27:40.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9788 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-06T21:27:40.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68530 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-06T21:27:40.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 146380 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-06T21:27:40.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 232618 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-06T21:27:40.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 210 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-06T21:27:40.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-06T21:27:40.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 879 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-06T21:27:40.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 251868 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-06T21:27:40.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 306661 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-06T21:27:40.590 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/ 2023-07-06T21:27:40.590 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/ 2023-07-06T21:27:40.590 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/doc/ 2023-07-06T21:27:40.590 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/ 2023-07-06T21:27:40.591 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 170 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/changelog.Debian.gz 2023-07-06T21:27:40.591 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 691 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/copyright 2023-07-06T21:27:40.592 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-06T21:27:40.592 INFO:teuthology.task.kernel:searching for kernel 6.4.0-g84139c18d56f 2023-07-06T21:27:40.592 DEBUG:teuthology.orchestra.run.smithi138:> egrep '(submenu|menuentry.*6.4.0-g84139c18d56f).*{' /boot/grub/grub.cfg 2023-07-06T21:27:40.599 INFO:teuthology.orchestra.run.smithi138.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-06T21:27:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: menuentry 'Ubuntu, with Linux 6.4.0-g84139c18d56f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-g84139c18d56f-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-06T21:27:40.599 INFO:teuthology.orchestra.run.smithi138.stdout: menuentry 'Ubuntu, with Linux 6.4.0-g84139c18d56f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-g84139c18d56f-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-06T21:27:40.600 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-06T21:27:40.600 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.4.0-g84139c18d56f 2023-07-06T21:27:40.600 DEBUG:teuthology.orchestra.run.smithi138:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-06T21:27:40.644 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi138.front.sepia.ceph.com to complete... 2023-07-06T21:27:40.994 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub' 2023-07-06T21:27:40.996 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-06T21:27:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2023-07-06T21:27:41.220 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-06T21:27:41.226 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-06T21:27:41.464 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-06T21:27:41.469 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-06T21:27:41.508 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-06T21:27:41.513 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-06T21:27:41.627 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-06T21:27:41.628 INFO:teuthology.orchestra.run.smithi138.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-06T21:27:41.628 INFO:teuthology.orchestra.run.smithi138.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-06T21:27:41.637 INFO:teuthology.orchestra.run.smithi138.stderr:done 2023-07-06T21:28:08.880 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-06T21:28:08.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-06T21:28:08.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:28:12.772 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-07-06T21:28:12.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-07-06T21:28:12.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:28:27.248 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-06T21:28:31.092 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-07-06T21:28:36.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-06T21:28:36.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:28:40.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-07-06T21:28:40.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:28:43.156 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-07-06T21:28:55.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-07-06T21:28:55.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:29:13.584 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-07-06T21:29:28.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-07-06T21:29:28.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:29:28.969 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-07-06T21:29:29.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-07-06T21:29:29.936 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.4.0-g84139c18d56f"... 2023-07-06T21:29:29.936 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2023-07-06T21:29:29.945 INFO:teuthology.orchestra.run.smithi138.stdout:6.4.0-g84139c18d56f 2023-07-06T21:29:29.946 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-06T21:29:29.946 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-06T21:29:29.946 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-06T21:29:30.948 DEBUG:teuthology.parallel:result is None 2023-07-06T21:29:36.256 DEBUG:teuthology.orchestra.remote:timed out 2023-07-06T21:29:48.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-06T21:29:48.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:29:48.462 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-07-06T21:29:49.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-06T21:29:49.282 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-g84139c18d56f"... 2023-07-06T21:29:49.282 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2023-07-06T21:29:49.330 INFO:teuthology.orchestra.run.smithi055.stdout:6.4.0-g84139c18d56f 2023-07-06T21:29:49.331 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-06T21:29:49.331 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-06T21:29:49.331 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-06T21:29:50.332 DEBUG:teuthology.parallel:result is None 2023-07-06T21:29:50.332 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-06T21:29:50.343 INFO:teuthology.task.internal:Creating test directory... 2023-07-06T21:29:50.344 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-06T21:29:50.348 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-06T21:29:50.358 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-06T21:29:50.369 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-06T21:29:50.375 INFO:teuthology.task.internal:Creating archive directory... 2023-07-06T21:29:50.376 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-06T21:29:50.405 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-06T21:29:50.441 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-06T21:29:50.452 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-06T21:29:50.453 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-06T21:29:50.481 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-06T21:29:50.572 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-06T21:29:50.595 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-06T21:29:50.608 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-06T21:29:50.620 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-06T21:29:50.623 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-06T21:29:50.635 INFO:teuthology.task.internal:Configuring sudo... 2023-07-06T21:29:50.635 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-06T21:29:50.639 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-06T21:29:50.662 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-06T21:29:50.672 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-06T21:29:50.672 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-06T21:29:50.709 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-06T21:29:50.719 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-06T21:29:50.771 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-06T21:29:50.827 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:29:50.828 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-06T21:29:50.901 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-06T21:29:50.912 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-06T21:29:50.964 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:29:50.965 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-06T21:29:51.043 DEBUG:teuthology.orchestra.run.smithi055:> sudo service rsyslog restart 2023-07-06T21:29:51.047 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2023-07-06T21:29:51.178 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-06T21:29:51.187 INFO:teuthology.task.internal:Starting timer... 2023-07-06T21:29:51.188 INFO:teuthology.run_tasks:Running task pcp... 2023-07-06T21:29:51.202 INFO:teuthology.run_tasks:Running task selinux... 2023-07-06T21:29:51.214 DEBUG:teuthology.task.selinux:Excluding smithi055: OS 'ubuntu' does not support SELinux 2023-07-06T21:29:51.215 DEBUG:teuthology.task.selinux:Excluding smithi138: OS 'ubuntu' does not support SELinux 2023-07-06T21:29:51.215 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-06T21:29:51.215 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-07-06T21:29:51.216 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-06T21:29:51.216 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-06T21:29:51.228 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-06T21:29:51.229 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-06T21:29:51.249 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-06T21:29:51.250 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi055.front.sepia.ceph.com,smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-06T21:38:17.470 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi055.front.sepia.ceph.com'), Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2023-07-06T21:38:17.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-06T21:38:17.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:38:17.556 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-07-06T21:38:17.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-06T21:38:17.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-07-06T21:38:17.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:38:17.804 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-07-06T21:38:17.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-07-06T21:38:17.963 INFO:teuthology.run_tasks:Running task clock... 2023-07-06T21:38:17.980 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-06T21:38:17.981 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-06T21:38:17.982 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-06T21:38:17.985 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-06T21:38:17.985 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-06T21:38:18.023 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-07-06T21:38:18.023 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: Command line: ntpd -gq 2023-07-06T21:38:18.023 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: ---------------------------------------------------- 2023-07-06T21:38:18.024 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: ntp-4 is maintained by Network Time Foundation, 2023-07-06T21:38:18.024 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-07-06T21:38:18.024 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: corporation. Support and training for ntp-4 are 2023-07-06T21:38:18.024 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: available at https://www.nwtime.org/support 2023-07-06T21:38:18.024 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: ---------------------------------------------------- 2023-07-06T21:38:18.025 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: proto: precision = 0.042 usec (-24) 2023-07-06T21:38:18.025 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: basedate set to 2022-02-04 2023-07-06T21:38:18.025 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: gps base set to 2022-02-06 (week 2196) 2023-07-06T21:38:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-06T21:38:18.026 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-06T21:38:18.026 INFO:teuthology.orchestra.run.smithi055.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-06T21:38:18.027 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: restrict ::: KOD does nothing without LIMITED. 2023-07-06T21:38:18.027 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: Listen and drop on 0 v6wildcard [::]:123 2023-07-06T21:38:18.027 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-06T21:38:18.028 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: Listen normally on 2 lo 127.0.0.1:123 2023-07-06T21:38:18.028 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: Listen normally on 3 ens1f0 172.21.15.55:123 2023-07-06T21:38:18.028 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: Listen normally on 4 lo [::1]:123 2023-07-06T21:38:18.028 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2606%4]:123 2023-07-06T21:38:18.028 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:18 ntpd[27265]: Listening on routing socket on fd #22 for interface updates 2023-07-06T21:38:18.044 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-07-06T21:38:18.044 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: Command line: ntpd -gq 2023-07-06T21:38:18.044 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: ---------------------------------------------------- 2023-07-06T21:38:18.044 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: ntp-4 is maintained by Network Time Foundation, 2023-07-06T21:38:18.045 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-07-06T21:38:18.045 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: corporation. Support and training for ntp-4 are 2023-07-06T21:38:18.045 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: available at https://www.nwtime.org/support 2023-07-06T21:38:18.045 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: ---------------------------------------------------- 2023-07-06T21:38:18.046 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: proto: precision = 0.046 usec (-24) 2023-07-06T21:38:18.046 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: basedate set to 2022-02-04 2023-07-06T21:38:18.046 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: gps base set to 2022-02-06 (week 2196) 2023-07-06T21:38:18.046 INFO:teuthology.orchestra.run.smithi138.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-06T21:38:18.047 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-06T21:38:18.047 INFO:teuthology.orchestra.run.smithi138.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-06T21:38:18.048 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: restrict ::: KOD does nothing without LIMITED. 2023-07-06T21:38:18.048 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: Listen and drop on 0 v6wildcard [::]:123 2023-07-06T21:38:18.048 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-06T21:38:18.048 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: Listen normally on 2 lo 127.0.0.1:123 2023-07-06T21:38:18.049 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: Listen normally on 3 enp3s0f1 172.21.15.138:123 2023-07-06T21:38:18.049 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: Listen normally on 4 lo [::1]:123 2023-07-06T21:38:18.049 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f71%5]:123 2023-07-06T21:38:18.049 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:18 ntpd[27373]: Listening on routing socket on fd #22 for interface updates 2023-07-06T21:38:19.024 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:19.024 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:19.024 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:19.024 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:19.024 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:19.025 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:19.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:19.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:19.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:19.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:19.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:19.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:19.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:19.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:19.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:19.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:19.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:19.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:19 ntpd[27265]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:20.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:20 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:20.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:20 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:20.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:20 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:20.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:20 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:20.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:20 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:20.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:20 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:20.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:20 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:20.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:20 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:20.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:20 ntpd[27373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:20.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:20 ntpd[27373]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:20.047 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:20 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:20.047 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:20 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:20.047 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:20 ntpd[27373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:20.047 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:20 ntpd[27373]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:21.025 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:21.025 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:21.025 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:21.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:21.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:21.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:21.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:21.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:21.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:21.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:21.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:21.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:21.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:21.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:21.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:21.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:21.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:21.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:21 ntpd[27265]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:21.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:21 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:21.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:21 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:21.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:21 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:21.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:21 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:21.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:21 ntpd[27373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:21.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:21 ntpd[27373]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:22.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:22 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:22.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:22 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:22.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:22 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:22.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:22 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:22.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:22 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:22.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:22 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:22.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:22 ntpd[27373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:22.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:22 ntpd[27373]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:22.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:22 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:22.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:22 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:22.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:22 ntpd[27373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:22.047 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:22 ntpd[27373]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:23.025 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:23.025 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:23.025 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:23.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:23.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:23.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:23.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:23.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:23.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:23.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:23.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:23.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:23.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:23.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:23.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:23.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:23.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:23.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:23.028 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:23.028 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:23 ntpd[27265]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:23.044 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:23 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:23.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:23 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:23.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:23 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:23.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:23 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:23.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:23 ntpd[27373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:23.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:23 ntpd[27373]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:24.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:24 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:24.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:24 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:24.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:24 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:24.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:24 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:24.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:24 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:24.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:24 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:24.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:24 ntpd[27373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:24.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:24 ntpd[27373]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:24.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:24 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:24.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:24 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:24.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:24 ntpd[27373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:24.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:24 ntpd[27373]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:25.024 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:25 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:25.024 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:25 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:25.024 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:25 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:25.024 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:25 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:25.025 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:25 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:25.025 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:25 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:25.025 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:25 ntpd[27265]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:25.025 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:25 ntpd[27265]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:25.025 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:25 ntpd[27265]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:25.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:25 ntpd[27265]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:25.026 INFO:teuthology.orchestra.run.smithi055.stdout: 6 Jul 21:38:25 ntpd[27265]: ntpd: time slew -0.000690 s 2023-07-06T21:38:25.026 INFO:teuthology.orchestra.run.smithi055.stdout:ntpd: time slew -0.000690s 2023-07-06T21:38:25.026 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:25 ntpd[27265]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-06T21:38:25.027 INFO:teuthology.orchestra.run.smithi055.stderr: 6 Jul 21:38:25 ntpd[27265]: can't open /var/log/ntpstats/loopstats.20230706: Permission denied 2023-07-06T21:38:25.044 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:25 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:25.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:25 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:25.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:25 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:25.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:25 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:25.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:25 ntpd[27373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:25.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:25 ntpd[27373]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:25.169 INFO:teuthology.orchestra.run.smithi055.stdout: remote refid st t when poll reach delay offset jitter 2023-07-06T21:38:25.169 INFO:teuthology.orchestra.run.smithi055.stdout:============================================================================== 2023-07-06T21:38:25.170 INFO:teuthology.orchestra.run.smithi055.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-06T21:38:25.170 INFO:teuthology.orchestra.run.smithi055.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-06T21:38:25.170 INFO:teuthology.orchestra.run.smithi055.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-06T21:38:25.170 INFO:teuthology.orchestra.run.smithi055.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-06T21:38:26.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:26 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:26.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:26 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:26.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:26 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:26.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:26 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:26.045 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:26 ntpd[27373]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-06T21:38:26.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:26 ntpd[27373]: can't open /var/log/ntpstats/rawstats.20230706: Permission denied 2023-07-06T21:38:26.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:26 ntpd[27373]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-06T21:38:26.046 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:26 ntpd[27373]: can't open /var/log/ntpstats/peerstats.20230706: Permission denied 2023-07-06T21:38:26.046 INFO:teuthology.orchestra.run.smithi138.stdout: 6 Jul 21:38:26 ntpd[27373]: ntpd: time slew +0.000343 s 2023-07-06T21:38:26.046 INFO:teuthology.orchestra.run.smithi138.stdout:ntpd: time slew +0.000343s 2023-07-06T21:38:26.047 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:26 ntpd[27373]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-06T21:38:26.047 INFO:teuthology.orchestra.run.smithi138.stderr: 6 Jul 21:38:26 ntpd[27373]: can't open /var/log/ntpstats/loopstats.20230706: Permission denied 2023-07-06T21:38:26.183 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2023-07-06T21:38:26.183 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2023-07-06T21:38:26.184 INFO:teuthology.orchestra.run.smithi138.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-06T21:38:26.184 INFO:teuthology.orchestra.run.smithi138.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-06T21:38:26.184 INFO:teuthology.orchestra.run.smithi138.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-06T21:38:26.184 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-06T21:38:26.185 INFO:teuthology.run_tasks:Running task install... 2023-07-06T21:38:26.193 DEBUG:teuthology.task.install:project ceph 2023-07-06T21:38:26.193 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}} 2023-07-06T21:38:26.193 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'} 2023-07-06T21:38:26.194 INFO:teuthology.task.install:Using flavor: default 2023-07-06T21:38:26.201 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-06T21:38:26.202 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-06T21:38:26.203 DEBUG:teuthology.orchestra.run.smithi055:> sudo apt-key list | grep Ceph 2023-07-06T21:38:26.203 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-key list | grep Ceph 2023-07-06T21:38:26.317 INFO:teuthology.orchestra.run.smithi055.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-07-06T21:38:26.335 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-07-06T21:38:26.373 INFO:teuthology.orchestra.run.smithi055.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-06T21:38:26.373 INFO:teuthology.orchestra.run.smithi055.stdout:uid [ unknown] Ceph.com (release key) 2023-07-06T21:38:26.374 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-06T21:38:26.374 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-06T21:38:26.375 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-06T21:38:26.389 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-06T21:38:26.389 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph.com (release key) 2023-07-06T21:38:26.390 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-06T21:38:26.390 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-06T21:38:26.390 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-06T21:38:26.526 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default/ 2023-07-06T21:38:26.526 INFO:teuthology.task.install.deb:Package version is 18.0.0-4488-g0a781ef0-1jammy 2023-07-06T21:38:26.592 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default/ 2023-07-06T21:38:26.593 INFO:teuthology.task.install.deb:Package version is 18.0.0-4488-g0a781ef0-1jammy 2023-07-06T21:38:26.694 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:38:26.695 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-06T21:38:26.698 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:38:26.698 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-06T21:38:26.715 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2023-07-06T21:38:26.719 DEBUG:teuthology.orchestra.run.smithi055:> sudo apt-get update 2023-07-06T21:38:26.910 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-07-06T21:38:26.915 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-07-06T21:38:26.933 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-07-06T21:38:26.948 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy InRelease 2023-07-06T21:38:26.957 INFO:teuthology.orchestra.run.smithi055.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy InRelease 2023-07-06T21:38:26.969 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-07-06T21:38:26.977 INFO:teuthology.orchestra.run.smithi055.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-07-06T21:38:26.983 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-07-06T21:38:26.991 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy Release.gpg 2023-07-06T21:38:26.999 INFO:teuthology.orchestra.run.smithi055.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy Release.gpg 2023-07-06T21:38:27.011 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2023-07-06T21:38:27.020 INFO:teuthology.orchestra.run.smithi055.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-07-06T21:38:27.023 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-07-06T21:38:27.044 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-07-06T21:38:27.057 INFO:teuthology.orchestra.run.smithi055.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2023-07-06T21:38:27.100 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-07-06T21:38:27.101 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-07-06T21:38:27.181 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-07-06T21:38:27.556 INFO:teuthology.orchestra.run.smithi055.stdout:Fetched 28.5 kB in 1s (46.8 kB/s) 2023-07-06T21:38:27.604 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 28.5 kB in 1s (42.4 kB/s) 2023-07-06T21:38:28.459 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2023-07-06T21:38:28.475 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-07-06T21:38:28.478 DEBUG:teuthology.orchestra.run.smithi055:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4488-g0a781ef0-1jammy cephadm=18.0.0-4488-g0a781ef0-1jammy ceph-mds=18.0.0-4488-g0a781ef0-1jammy ceph-mgr=18.0.0-4488-g0a781ef0-1jammy ceph-common=18.0.0-4488-g0a781ef0-1jammy ceph-fuse=18.0.0-4488-g0a781ef0-1jammy ceph-test=18.0.0-4488-g0a781ef0-1jammy ceph-volume=18.0.0-4488-g0a781ef0-1jammy radosgw=18.0.0-4488-g0a781ef0-1jammy python3-rados=18.0.0-4488-g0a781ef0-1jammy python3-rgw=18.0.0-4488-g0a781ef0-1jammy python3-cephfs=18.0.0-4488-g0a781ef0-1jammy python3-rbd=18.0.0-4488-g0a781ef0-1jammy libcephfs2=18.0.0-4488-g0a781ef0-1jammy libcephfs-dev=18.0.0-4488-g0a781ef0-1jammy librados2=18.0.0-4488-g0a781ef0-1jammy librbd1=18.0.0-4488-g0a781ef0-1jammy rbd-fuse=18.0.0-4488-g0a781ef0-1jammy python3-cephfs=18.0.0-4488-g0a781ef0-1jammy cephfs-shell=18.0.0-4488-g0a781ef0-1jammy cephfs-top=18.0.0-4488-g0a781ef0-1jammy cephfs-mirror=18.0.0-4488-g0a781ef0-1jammy 2023-07-06T21:38:28.494 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4488-g0a781ef0-1jammy cephadm=18.0.0-4488-g0a781ef0-1jammy ceph-mds=18.0.0-4488-g0a781ef0-1jammy ceph-mgr=18.0.0-4488-g0a781ef0-1jammy ceph-common=18.0.0-4488-g0a781ef0-1jammy ceph-fuse=18.0.0-4488-g0a781ef0-1jammy ceph-test=18.0.0-4488-g0a781ef0-1jammy ceph-volume=18.0.0-4488-g0a781ef0-1jammy radosgw=18.0.0-4488-g0a781ef0-1jammy python3-rados=18.0.0-4488-g0a781ef0-1jammy python3-rgw=18.0.0-4488-g0a781ef0-1jammy python3-cephfs=18.0.0-4488-g0a781ef0-1jammy python3-rbd=18.0.0-4488-g0a781ef0-1jammy libcephfs2=18.0.0-4488-g0a781ef0-1jammy libcephfs-dev=18.0.0-4488-g0a781ef0-1jammy librados2=18.0.0-4488-g0a781ef0-1jammy librbd1=18.0.0-4488-g0a781ef0-1jammy rbd-fuse=18.0.0-4488-g0a781ef0-1jammy python3-cephfs=18.0.0-4488-g0a781ef0-1jammy cephfs-shell=18.0.0-4488-g0a781ef0-1jammy cephfs-top=18.0.0-4488-g0a781ef0-1jammy cephfs-mirror=18.0.0-4488-g0a781ef0-1jammy 2023-07-06T21:38:28.557 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2023-07-06T21:38:28.574 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-07-06T21:38:28.721 INFO:teuthology.orchestra.run.smithi055.stdout:Building dependency tree... 2023-07-06T21:38:28.722 INFO:teuthology.orchestra.run.smithi055.stdout:Reading state information... 2023-07-06T21:38:28.730 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2023-07-06T21:38:28.731 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2023-07-06T21:38:28.873 INFO:teuthology.orchestra.run.smithi055.stdout:The following packages were automatically installed and are no longer required: 2023-07-06T21:38:28.874 INFO:teuthology.orchestra.run.smithi055.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-06T21:38:28.874 INFO:teuthology.orchestra.run.smithi055.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-06T21:38:28.874 INFO:teuthology.orchestra.run.smithi055.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-06T21:38:28.874 INFO:teuthology.orchestra.run.smithi055.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-06T21:38:28.877 INFO:teuthology.orchestra.run.smithi055.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-06T21:38:28.877 INFO:teuthology.orchestra.run.smithi055.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-06T21:38:28.877 INFO:teuthology.orchestra.run.smithi055.stdout:The following additional packages will be installed: 2023-07-06T21:38:28.877 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-06T21:38:28.878 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-07-06T21:38:28.878 INFO:teuthology.orchestra.run.smithi055.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-06T21:38:28.878 INFO:teuthology.orchestra.run.smithi055.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-07-06T21:38:28.878 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-07-06T21:38:28.878 INFO:teuthology.orchestra.run.smithi055.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-07-06T21:38:28.878 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-07-06T21:38:28.878 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-07-06T21:38:28.878 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-07-06T21:38:28.879 INFO:teuthology.orchestra.run.smithi055.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-07-06T21:38:28.879 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-07-06T21:38:28.879 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-07-06T21:38:28.879 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-07-06T21:38:28.879 INFO:teuthology.orchestra.run.smithi055.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-06T21:38:28.879 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-07-06T21:38:28.879 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-07-06T21:38:28.880 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-07-06T21:38:28.880 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-07-06T21:38:28.880 INFO:teuthology.orchestra.run.smithi055.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-06T21:38:28.880 INFO:teuthology.orchestra.run.smithi055.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-07-06T21:38:28.880 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-07-06T21:38:28.880 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-07-06T21:38:28.880 INFO:teuthology.orchestra.run.smithi055.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-06T21:38:28.880 INFO:teuthology.orchestra.run.smithi055.stdout:Suggested packages: 2023-07-06T21:38:28.881 INFO:teuthology.orchestra.run.smithi055.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-07-06T21:38:28.881 INFO:teuthology.orchestra.run.smithi055.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-07-06T21:38:28.881 INFO:teuthology.orchestra.run.smithi055.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-07-06T21:38:28.881 INFO:teuthology.orchestra.run.smithi055.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-07-06T21:38:28.881 INFO:teuthology.orchestra.run.smithi055.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-07-06T21:38:28.881 INFO:teuthology.orchestra.run.smithi055.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-07-06T21:38:28.881 INFO:teuthology.orchestra.run.smithi055.stdout: python3-watchdog 2023-07-06T21:38:28.881 INFO:teuthology.orchestra.run.smithi055.stdout:Recommended packages: 2023-07-06T21:38:28.882 INFO:teuthology.orchestra.run.smithi055.stdout: btrfs-tools 2023-07-06T21:38:28.882 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2023-07-06T21:38:28.883 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-06T21:38:28.883 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-06T21:38:28.883 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-06T21:38:28.883 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-06T21:38:28.883 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-06T21:38:28.883 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-06T21:38:28.883 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2023-07-06T21:38:28.883 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-06T21:38:28.884 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-07-06T21:38:28.884 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-06T21:38:28.884 INFO:teuthology.orchestra.run.smithi138.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-07-06T21:38:28.884 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-07-06T21:38:28.884 INFO:teuthology.orchestra.run.smithi138.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-07-06T21:38:28.884 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-07-06T21:38:28.884 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-07-06T21:38:28.885 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-07-06T21:38:28.885 INFO:teuthology.orchestra.run.smithi138.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-07-06T21:38:28.885 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-07-06T21:38:28.885 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-07-06T21:38:28.885 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-07-06T21:38:28.885 INFO:teuthology.orchestra.run.smithi138.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-06T21:38:28.885 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-07-06T21:38:28.885 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-07-06T21:38:28.886 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-07-06T21:38:28.886 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-07-06T21:38:28.886 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-06T21:38:28.886 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-07-06T21:38:28.886 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-07-06T21:38:28.886 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-07-06T21:38:28.886 INFO:teuthology.orchestra.run.smithi138.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-06T21:38:28.886 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2023-07-06T21:38:28.887 INFO:teuthology.orchestra.run.smithi138.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-07-06T21:38:28.887 INFO:teuthology.orchestra.run.smithi138.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-07-06T21:38:28.887 INFO:teuthology.orchestra.run.smithi138.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-07-06T21:38:28.887 INFO:teuthology.orchestra.run.smithi138.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-07-06T21:38:28.887 INFO:teuthology.orchestra.run.smithi138.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-07-06T21:38:28.887 INFO:teuthology.orchestra.run.smithi138.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-07-06T21:38:28.887 INFO:teuthology.orchestra.run.smithi138.stdout: python3-watchdog 2023-07-06T21:38:28.887 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2023-07-06T21:38:28.888 INFO:teuthology.orchestra.run.smithi138.stdout: btrfs-tools 2023-07-06T21:38:29.021 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2023-07-06T21:38:29.021 INFO:teuthology.orchestra.run.smithi138.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-06T21:38:29.022 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-06T21:38:29.022 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-06T21:38:29.023 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-07-06T21:38:29.023 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-06T21:38:29.023 INFO:teuthology.orchestra.run.smithi138.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-07-06T21:38:29.023 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-07-06T21:38:29.024 INFO:teuthology.orchestra.run.smithi138.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-07-06T21:38:29.024 INFO:teuthology.orchestra.run.smithi138.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-07-06T21:38:29.024 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-06T21:38:29.024 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-07-06T21:38:29.024 INFO:teuthology.orchestra.run.smithi138.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-07-06T21:38:29.024 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-07-06T21:38:29.024 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-07-06T21:38:29.025 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-07-06T21:38:29.025 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-07-06T21:38:29.025 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-07-06T21:38:29.025 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-07-06T21:38:29.025 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-07-06T21:38:29.025 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-07-06T21:38:29.025 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-06T21:38:29.025 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-07-06T21:38:29.026 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-07-06T21:38:29.026 INFO:teuthology.orchestra.run.smithi138.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-07-06T21:38:29.026 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-07-06T21:38:29.026 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-07-06T21:38:29.026 INFO:teuthology.orchestra.run.smithi138.stdout: socat xmlstarlet 2023-07-06T21:38:29.027 INFO:teuthology.orchestra.run.smithi055.stdout:The following NEW packages will be installed: 2023-07-06T21:38:29.027 INFO:teuthology.orchestra.run.smithi055.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-06T21:38:29.028 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-06T21:38:29.028 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-06T21:38:29.028 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-07-06T21:38:29.028 INFO:teuthology.orchestra.run.smithi055.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-06T21:38:29.028 INFO:teuthology.orchestra.run.smithi055.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-07-06T21:38:29.028 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-07-06T21:38:29.028 INFO:teuthology.orchestra.run.smithi055.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-07-06T21:38:29.029 INFO:teuthology.orchestra.run.smithi055.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-07-06T21:38:29.029 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-06T21:38:29.029 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-07-06T21:38:29.029 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-07-06T21:38:29.029 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-07-06T21:38:29.029 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-07-06T21:38:29.029 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-07-06T21:38:29.029 INFO:teuthology.orchestra.run.smithi055.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-07-06T21:38:29.030 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-07-06T21:38:29.030 INFO:teuthology.orchestra.run.smithi055.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-07-06T21:38:29.030 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-07-06T21:38:29.030 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-07-06T21:38:29.030 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-06T21:38:29.030 INFO:teuthology.orchestra.run.smithi055.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-07-06T21:38:29.030 INFO:teuthology.orchestra.run.smithi055.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-07-06T21:38:29.031 INFO:teuthology.orchestra.run.smithi055.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-07-06T21:38:29.031 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-07-06T21:38:29.031 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-07-06T21:38:29.031 INFO:teuthology.orchestra.run.smithi055.stdout: socat xmlstarlet 2023-07-06T21:38:29.091 INFO:teuthology.orchestra.run.smithi055.stdout:0 upgraded, 115 newly installed, 0 to remove and 207 not upgraded. 2023-07-06T21:38:29.092 INFO:teuthology.orchestra.run.smithi055.stdout:Need to get 183 MB of archives. 2023-07-06T21:38:29.092 INFO:teuthology.orchestra.run.smithi055.stdout:After this operation, 820 MB of additional disk space will be used. 2023-07-06T21:38:29.092 INFO:teuthology.orchestra.run.smithi055.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-07-06T21:38:29.109 INFO:teuthology.orchestra.run.smithi055.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-07-06T21:38:29.119 INFO:teuthology.orchestra.run.smithi055.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-07-06T21:38:29.159 INFO:teuthology.orchestra.run.smithi055.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-07-06T21:38:29.168 INFO:teuthology.orchestra.run.smithi055.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-07-06T21:38:29.168 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 115 newly installed, 0 to remove and 207 not upgraded. 2023-07-06T21:38:29.168 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 183 MB of archives. 2023-07-06T21:38:29.169 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 820 MB of additional disk space will be used. 2023-07-06T21:38:29.169 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4488-g0a781ef0-1jammy [3,401 kB] 2023-07-06T21:38:29.185 INFO:teuthology.orchestra.run.smithi055.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-07-06T21:38:29.186 INFO:teuthology.orchestra.run.smithi055.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-07-06T21:38:29.196 INFO:teuthology.orchestra.run.smithi055.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-07-06T21:38:29.219 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-07-06T21:38:29.232 INFO:teuthology.orchestra.run.smithi055.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-07-06T21:38:29.234 INFO:teuthology.orchestra.run.smithi055.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-07-06T21:38:29.242 INFO:teuthology.orchestra.run.smithi055.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-07-06T21:38:29.246 INFO:teuthology.orchestra.run.smithi055.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4488-g0a781ef0-1jammy [3,401 kB] 2023-07-06T21:38:29.279 INFO:teuthology.orchestra.run.smithi055.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-07-06T21:38:29.301 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-07-06T21:38:29.320 INFO:teuthology.orchestra.run.smithi055.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-07-06T21:38:29.348 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-07-06T21:38:29.392 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4488-g0a781ef0-1jammy [3,095 kB] 2023-07-06T21:38:29.396 INFO:teuthology.orchestra.run.smithi055.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-07-06T21:38:29.398 INFO:teuthology.orchestra.run.smithi055.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-07-06T21:38:29.398 INFO:teuthology.orchestra.run.smithi055.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-07-06T21:38:29.401 INFO:teuthology.orchestra.run.smithi055.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-07-06T21:38:29.401 INFO:teuthology.orchestra.run.smithi055.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-07-06T21:38:29.402 INFO:teuthology.orchestra.run.smithi055.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-07-06T21:38:29.402 INFO:teuthology.orchestra.run.smithi055.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-07-06T21:38:29.403 INFO:teuthology.orchestra.run.smithi055.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-07-06T21:38:29.437 INFO:teuthology.orchestra.run.smithi055.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-07-06T21:38:29.438 INFO:teuthology.orchestra.run.smithi055.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-07-06T21:38:29.495 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4488-g0a781ef0-1jammy [656 kB] 2023-07-06T21:38:29.509 INFO:teuthology.orchestra.run.smithi055.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-07-06T21:38:29.513 INFO:teuthology.orchestra.run.smithi055.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-07-06T21:38:29.515 INFO:teuthology.orchestra.run.smithi055.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-07-06T21:38:29.516 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4488-g0a781ef0-1jammy [344 kB] 2023-07-06T21:38:29.517 INFO:teuthology.orchestra.run.smithi055.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-07-06T21:38:29.522 INFO:teuthology.orchestra.run.smithi055.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-06T21:38:29.522 INFO:teuthology.orchestra.run.smithi055.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-07-06T21:38:29.522 INFO:teuthology.orchestra.run.smithi055.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-07-06T21:38:29.527 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4488-g0a781ef0-1jammy [22.9 kB] 2023-07-06T21:38:29.528 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4488-g0a781ef0-1jammy [170 kB] 2023-07-06T21:38:29.528 INFO:teuthology.orchestra.run.smithi055.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-07-06T21:38:29.531 INFO:teuthology.orchestra.run.smithi055.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-07-06T21:38:29.534 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4488-g0a781ef0-1jammy [49.0 kB] 2023-07-06T21:38:29.536 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4488-g0a781ef0-1jammy [318 kB] 2023-07-06T21:38:29.542 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-07-06T21:38:29.551 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4488-g0a781ef0-1jammy [6,063 kB] 2023-07-06T21:38:29.565 INFO:teuthology.orchestra.run.smithi055.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-07-06T21:38:29.585 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-07-06T21:38:29.661 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-07-06T21:38:29.672 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-07-06T21:38:29.673 INFO:teuthology.orchestra.run.smithi055.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-07-06T21:38:29.673 INFO:teuthology.orchestra.run.smithi055.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-07-06T21:38:29.674 INFO:teuthology.orchestra.run.smithi055.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-07-06T21:38:29.674 INFO:teuthology.orchestra.run.smithi055.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-07-06T21:38:29.677 INFO:teuthology.orchestra.run.smithi055.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-07-06T21:38:29.681 INFO:teuthology.orchestra.run.smithi055.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-07-06T21:38:29.682 INFO:teuthology.orchestra.run.smithi055.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-07-06T21:38:29.684 INFO:teuthology.orchestra.run.smithi055.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-07-06T21:38:29.690 INFO:teuthology.orchestra.run.smithi055.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-07-06T21:38:29.695 INFO:teuthology.orchestra.run.smithi055.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-07-06T21:38:29.718 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-07-06T21:38:29.732 INFO:teuthology.orchestra.run.smithi055.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-07-06T21:38:29.770 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4488-g0a781ef0-1jammy [102 kB] 2023-07-06T21:38:29.771 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4488-g0a781ef0-1jammy [429 kB] 2023-07-06T21:38:29.784 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4488-g0a781ef0-1jammy [22.3 MB] 2023-07-06T21:38:29.822 INFO:teuthology.orchestra.run.smithi055.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-07-06T21:38:29.884 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-07-06T21:38:29.893 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-07-06T21:38:29.919 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-07-06T21:38:29.922 INFO:teuthology.orchestra.run.smithi055.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-07-06T21:38:29.923 INFO:teuthology.orchestra.run.smithi055.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-07-06T21:38:29.924 INFO:teuthology.orchestra.run.smithi055.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-07-06T21:38:29.925 INFO:teuthology.orchestra.run.smithi055.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-06T21:38:29.925 INFO:teuthology.orchestra.run.smithi055.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-07-06T21:38:29.926 INFO:teuthology.orchestra.run.smithi055.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-07-06T21:38:29.947 INFO:teuthology.orchestra.run.smithi055.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-07-06T21:38:29.949 INFO:teuthology.orchestra.run.smithi055.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-07-06T21:38:29.950 INFO:teuthology.orchestra.run.smithi055.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-07-06T21:38:30.001 INFO:teuthology.orchestra.run.smithi055.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-07-06T21:38:30.020 INFO:teuthology.orchestra.run.smithi055.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-07-06T21:38:30.047 INFO:teuthology.orchestra.run.smithi055.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-07-06T21:38:30.058 INFO:teuthology.orchestra.run.smithi055.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-07-06T21:38:30.063 INFO:teuthology.orchestra.run.smithi055.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-07-06T21:38:30.071 INFO:teuthology.orchestra.run.smithi055.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-07-06T21:38:30.074 INFO:teuthology.orchestra.run.smithi055.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-07-06T21:38:30.078 INFO:teuthology.orchestra.run.smithi055.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-07-06T21:38:30.091 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-07-06T21:38:30.104 INFO:teuthology.orchestra.run.smithi055.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-07-06T21:38:30.111 INFO:teuthology.orchestra.run.smithi055.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-07-06T21:38:30.114 INFO:teuthology.orchestra.run.smithi055.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-07-06T21:38:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-07-06T21:38:30.258 INFO:teuthology.orchestra.run.smithi055.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-07-06T21:38:30.268 INFO:teuthology.orchestra.run.smithi055.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-07-06T21:38:30.268 INFO:teuthology.orchestra.run.smithi055.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-07-06T21:38:30.286 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-07-06T21:38:30.290 INFO:teuthology.orchestra.run.smithi055.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-07-06T21:38:30.297 INFO:teuthology.orchestra.run.smithi055.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-07-06T21:38:30.298 INFO:teuthology.orchestra.run.smithi055.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-06T21:38:30.298 INFO:teuthology.orchestra.run.smithi055.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-07-06T21:38:30.299 INFO:teuthology.orchestra.run.smithi055.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-07-06T21:38:30.301 INFO:teuthology.orchestra.run.smithi055.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-07-06T21:38:30.302 INFO:teuthology.orchestra.run.smithi055.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-07-06T21:38:30.349 INFO:teuthology.orchestra.run.smithi055.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-07-06T21:38:30.387 INFO:teuthology.orchestra.run.smithi055.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-07-06T21:38:30.393 INFO:teuthology.orchestra.run.smithi055.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-07-06T21:38:30.442 INFO:teuthology.orchestra.run.smithi055.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-07-06T21:38:30.447 INFO:teuthology.orchestra.run.smithi055.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-07-06T21:38:30.540 INFO:teuthology.orchestra.run.smithi055.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4488-g0a781ef0-1jammy [3,095 kB] 2023-07-06T21:38:30.602 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4488-g0a781ef0-1jammy [6,824 kB] 2023-07-06T21:38:30.650 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-07-06T21:38:30.658 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-07-06T21:38:30.660 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-07-06T21:38:30.671 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-07-06T21:38:30.673 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-07-06T21:38:30.674 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-07-06T21:38:30.676 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-07-06T21:38:30.678 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-07-06T21:38:30.679 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-07-06T21:38:30.845 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-07-06T21:38:30.861 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4488-g0a781ef0-1jammy [226 kB] 2023-07-06T21:38:30.867 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4488-g0a781ef0-1jammy [114 kB] 2023-07-06T21:38:30.871 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4488-g0a781ef0-1jammy [1,468 kB] 2023-07-06T21:38:30.930 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4488-g0a781ef0-1jammy [9,879 kB] 2023-07-06T21:38:31.197 INFO:teuthology.orchestra.run.smithi055.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4488-g0a781ef0-1jammy [656 kB] 2023-07-06T21:38:31.276 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-07-06T21:38:31.285 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-07-06T21:38:31.291 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-07-06T21:38:31.295 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-07-06T21:38:31.313 INFO:teuthology.orchestra.run.smithi138.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-06T21:38:31.316 INFO:teuthology.orchestra.run.smithi138.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-07-06T21:38:31.318 INFO:teuthology.orchestra.run.smithi138.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-07-06T21:38:31.319 INFO:teuthology.orchestra.run.smithi138.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4488-g0a781ef0-1jammy [31.5 MB] 2023-07-06T21:38:31.325 INFO:teuthology.orchestra.run.smithi055.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4488-g0a781ef0-1jammy [344 kB] 2023-07-06T21:38:31.360 INFO:teuthology.orchestra.run.smithi138.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-07-06T21:38:31.374 INFO:teuthology.orchestra.run.smithi138.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-07-06T21:38:31.378 INFO:teuthology.orchestra.run.smithi138.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-07-06T21:38:31.395 INFO:teuthology.orchestra.run.smithi055.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4488-g0a781ef0-1jammy [22.9 kB] 2023-07-06T21:38:31.398 INFO:teuthology.orchestra.run.smithi055.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4488-g0a781ef0-1jammy [170 kB] 2023-07-06T21:38:31.422 INFO:teuthology.orchestra.run.smithi055.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4488-g0a781ef0-1jammy [49.0 kB] 2023-07-06T21:38:31.426 INFO:teuthology.orchestra.run.smithi055.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4488-g0a781ef0-1jammy [318 kB] 2023-07-06T21:38:31.491 INFO:teuthology.orchestra.run.smithi055.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4488-g0a781ef0-1jammy [6,063 kB] 2023-07-06T21:38:31.632 INFO:teuthology.orchestra.run.smithi138.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-07-06T21:38:31.715 INFO:teuthology.orchestra.run.smithi138.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-07-06T21:38:31.805 INFO:teuthology.orchestra.run.smithi138.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-07-06T21:38:31.862 INFO:teuthology.orchestra.run.smithi138.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-07-06T21:38:31.984 INFO:teuthology.orchestra.run.smithi138.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-07-06T21:38:32.071 INFO:teuthology.orchestra.run.smithi138.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-07-06T21:38:32.089 INFO:teuthology.orchestra.run.smithi138.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-07-06T21:38:32.118 INFO:teuthology.orchestra.run.smithi138.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-07-06T21:38:32.130 INFO:teuthology.orchestra.run.smithi138.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-07-06T21:38:32.168 INFO:teuthology.orchestra.run.smithi138.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-07-06T21:38:32.176 INFO:teuthology.orchestra.run.smithi138.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-07-06T21:38:32.313 INFO:teuthology.orchestra.run.smithi055.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4488-g0a781ef0-1jammy [102 kB] 2023-07-06T21:38:32.320 INFO:teuthology.orchestra.run.smithi055.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4488-g0a781ef0-1jammy [429 kB] 2023-07-06T21:38:32.361 INFO:teuthology.orchestra.run.smithi055.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4488-g0a781ef0-1jammy [22.3 MB] 2023-07-06T21:38:32.367 INFO:teuthology.orchestra.run.smithi138.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-07-06T21:38:32.747 INFO:teuthology.orchestra.run.smithi138.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4488-g0a781ef0-1jammy [3,592 B] 2023-07-06T21:38:32.747 INFO:teuthology.orchestra.run.smithi138.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4488-g0a781ef0-1jammy [810 kB] 2023-07-06T21:38:32.779 INFO:teuthology.orchestra.run.smithi138.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4488-g0a781ef0-1jammy [2,160 kB] 2023-07-06T21:38:32.898 INFO:teuthology.orchestra.run.smithi138.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4488-g0a781ef0-1jammy [214 kB] 2023-07-06T21:38:32.910 INFO:teuthology.orchestra.run.smithi138.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4488-g0a781ef0-1jammy [124 kB] 2023-07-06T21:38:32.915 INFO:teuthology.orchestra.run.smithi138.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4488-g0a781ef0-1jammy [1,841 kB] 2023-07-06T21:38:33.019 INFO:teuthology.orchestra.run.smithi138.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4488-g0a781ef0-1jammy [8,615 kB] 2023-07-06T21:38:33.177 INFO:teuthology.orchestra.run.smithi138.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-07-06T21:38:33.178 INFO:teuthology.orchestra.run.smithi138.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-07-06T21:38:33.179 INFO:teuthology.orchestra.run.smithi138.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-07-06T21:38:33.180 INFO:teuthology.orchestra.run.smithi138.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-06T21:38:33.180 INFO:teuthology.orchestra.run.smithi138.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-07-06T21:38:33.182 INFO:teuthology.orchestra.run.smithi138.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-07-06T21:38:33.205 INFO:teuthology.orchestra.run.smithi138.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-07-06T21:38:33.207 INFO:teuthology.orchestra.run.smithi138.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-07-06T21:38:33.207 INFO:teuthology.orchestra.run.smithi138.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-07-06T21:38:33.278 INFO:teuthology.orchestra.run.smithi138.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-07-06T21:38:33.443 INFO:teuthology.orchestra.run.smithi138.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-07-06T21:38:33.492 INFO:teuthology.orchestra.run.smithi138.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4488-g0a781ef0-1jammy [3,724 B] 2023-07-06T21:38:33.493 INFO:teuthology.orchestra.run.smithi138.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4488-g0a781ef0-1jammy [47.4 MB] 2023-07-06T21:38:33.701 INFO:teuthology.orchestra.run.smithi138.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-07-06T21:38:33.733 INFO:teuthology.orchestra.run.smithi138.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-07-06T21:38:33.760 INFO:teuthology.orchestra.run.smithi138.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-07-06T21:38:33.814 INFO:teuthology.orchestra.run.smithi138.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-07-06T21:38:33.833 INFO:teuthology.orchestra.run.smithi138.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-07-06T21:38:33.860 INFO:teuthology.orchestra.run.smithi138.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-07-06T21:38:33.989 INFO:teuthology.orchestra.run.smithi138.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-07-06T21:38:34.020 INFO:teuthology.orchestra.run.smithi138.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-07-06T21:38:34.041 INFO:teuthology.orchestra.run.smithi138.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-07-06T21:38:34.048 INFO:teuthology.orchestra.run.smithi138.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-07-06T21:38:34.191 INFO:teuthology.orchestra.run.smithi055.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4488-g0a781ef0-1jammy [6,824 kB] 2023-07-06T21:38:34.252 INFO:teuthology.orchestra.run.smithi138.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-07-06T21:38:34.701 INFO:teuthology.orchestra.run.smithi055.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4488-g0a781ef0-1jammy [226 kB] 2023-07-06T21:38:34.714 INFO:teuthology.orchestra.run.smithi138.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-07-06T21:38:34.716 INFO:teuthology.orchestra.run.smithi055.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4488-g0a781ef0-1jammy [114 kB] 2023-07-06T21:38:34.719 INFO:teuthology.orchestra.run.smithi138.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-07-06T21:38:34.727 INFO:teuthology.orchestra.run.smithi055.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4488-g0a781ef0-1jammy [1,468 kB] 2023-07-06T21:38:34.835 INFO:teuthology.orchestra.run.smithi055.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4488-g0a781ef0-1jammy [9,879 kB] 2023-07-06T21:38:34.845 INFO:teuthology.orchestra.run.smithi138.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-07-06T21:38:34.893 INFO:teuthology.orchestra.run.smithi138.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-07-06T21:38:34.893 INFO:teuthology.orchestra.run.smithi138.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-06T21:38:34.898 INFO:teuthology.orchestra.run.smithi138.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-07-06T21:38:34.900 INFO:teuthology.orchestra.run.smithi138.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-07-06T21:38:34.916 INFO:teuthology.orchestra.run.smithi138.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-07-06T21:38:34.923 INFO:teuthology.orchestra.run.smithi138.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-07-06T21:38:34.984 INFO:teuthology.orchestra.run.smithi138.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-07-06T21:38:35.149 INFO:teuthology.orchestra.run.smithi138.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-07-06T21:38:35.315 INFO:teuthology.orchestra.run.smithi138.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-07-06T21:38:35.569 INFO:teuthology.orchestra.run.smithi055.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4488-g0a781ef0-1jammy [31.5 MB] 2023-07-06T21:38:35.593 INFO:teuthology.orchestra.run.smithi138.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-07-06T21:38:35.619 INFO:teuthology.orchestra.run.smithi138.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-07-06T21:38:36.278 INFO:teuthology.orchestra.run.smithi138.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4488-g0a781ef0-1jammy [231 kB] 2023-07-06T21:38:36.280 INFO:teuthology.orchestra.run.smithi138.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4488-g0a781ef0-1jammy [216 kB] 2023-07-06T21:38:36.288 INFO:teuthology.orchestra.run.smithi138.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4488-g0a781ef0-1jammy [23.8 kB] 2023-07-06T21:38:36.289 INFO:teuthology.orchestra.run.smithi138.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4488-g0a781ef0-1jammy [13.1 kB] 2023-07-06T21:38:36.291 INFO:teuthology.orchestra.run.smithi138.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4488-g0a781ef0-1jammy [28.4 kB] 2023-07-06T21:38:36.292 INFO:teuthology.orchestra.run.smithi138.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4488-g0a781ef0-1jammy [12.0 MB] 2023-07-06T21:38:36.990 INFO:teuthology.orchestra.run.smithi138.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4488-g0a781ef0-1jammy [82.1 kB] 2023-07-06T21:38:37.529 INFO:teuthology.orchestra.run.smithi055.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4488-g0a781ef0-1jammy [3,592 B] 2023-07-06T21:38:37.529 INFO:teuthology.orchestra.run.smithi055.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4488-g0a781ef0-1jammy [810 kB] 2023-07-06T21:38:37.541 INFO:teuthology.orchestra.run.smithi055.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4488-g0a781ef0-1jammy [2,160 kB] 2023-07-06T21:38:37.553 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 183 MB in 8s (22.9 MB/s) 2023-07-06T21:38:37.614 INFO:teuthology.orchestra.run.smithi055.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4488-g0a781ef0-1jammy [214 kB] 2023-07-06T21:38:37.621 INFO:teuthology.orchestra.run.smithi055.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4488-g0a781ef0-1jammy [124 kB] 2023-07-06T21:38:37.625 INFO:teuthology.orchestra.run.smithi055.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4488-g0a781ef0-1jammy [1,841 kB] 2023-07-06T21:38:37.675 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-06T21:38:37.687 INFO:teuthology.orchestra.run.smithi055.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4488-g0a781ef0-1jammy [8,615 kB] 2023-07-06T21:38:37.743 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132931 files and directories currently installed.) 2023-07-06T21:38:37.747 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-07-06T21:38:37.790 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-07-06T21:38:37.975 INFO:teuthology.orchestra.run.smithi055.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4488-g0a781ef0-1jammy [3,724 B] 2023-07-06T21:38:37.975 INFO:teuthology.orchestra.run.smithi055.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4488-g0a781ef0-1jammy [47.4 MB] 2023-07-06T21:38:38.093 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-06T21:38:38.106 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-07-06T21:38:38.143 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-06T21:38:38.445 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cmd2. 2023-07-06T21:38:38.459 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-07-06T21:38:38.504 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-07-06T21:38:38.798 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libfmt8:amd64. 2023-07-06T21:38:38.811 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-07-06T21:38:38.890 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-06T21:38:39.218 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-07-06T21:38:39.233 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-07-06T21:38:39.276 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-06T21:38:39.613 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-06T21:38:39.694 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-07-06T21:38:39.694 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-06T21:38:40.007 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-06T21:38:40.022 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-07-06T21:38:40.066 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-06T21:38:40.380 INFO:teuthology.orchestra.run.smithi055.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4488-g0a781ef0-1jammy [231 kB] 2023-07-06T21:38:40.398 INFO:teuthology.orchestra.run.smithi055.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4488-g0a781ef0-1jammy [216 kB] 2023-07-06T21:38:40.418 INFO:teuthology.orchestra.run.smithi055.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4488-g0a781ef0-1jammy [23.8 kB] 2023-07-06T21:38:40.419 INFO:teuthology.orchestra.run.smithi055.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4488-g0a781ef0-1jammy [13.1 kB] 2023-07-06T21:38:40.419 INFO:teuthology.orchestra.run.smithi055.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4488-g0a781ef0-1jammy [28.4 kB] 2023-07-06T21:38:40.420 INFO:teuthology.orchestra.run.smithi055.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4488-g0a781ef0-1jammy [12.0 MB] 2023-07-06T21:38:40.745 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-06T21:38:40.760 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-06T21:38:40.811 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-06T21:38:41.127 INFO:teuthology.orchestra.run.smithi055.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rishabh-CephManager-in-CephFSTestCase/0a781ef0807ae9473fb1306ef07036226ca4f1a6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4488-g0a781ef0-1jammy [82.1 kB] 2023-07-06T21:38:41.197 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-06T21:38:41.212 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-06T21:38:41.256 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-06T21:38:41.559 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-06T21:38:41.573 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-06T21:38:41.609 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-06T21:38:41.713 INFO:teuthology.orchestra.run.smithi055.stdout:Fetched 183 MB in 12s (15.1 MB/s) 2023-07-06T21:38:41.861 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-06T21:38:41.920 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-07-06T21:38:41.933 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132931 files and directories currently installed.) 2023-07-06T21:38:41.934 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-07-06T21:38:41.936 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-07-06T21:38:41.976 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-07-06T21:38:41.978 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-06T21:38:42.288 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-06T21:38:42.298 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librados2. 2023-07-06T21:38:42.301 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-07-06T21:38:42.312 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../011-librados2_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:42.346 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-06T21:38:42.356 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librados2 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:42.641 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cmd2. 2023-07-06T21:38:42.655 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-07-06T21:38:42.699 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-07-06T21:38:42.808 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librbd1. 2023-07-06T21:38:42.823 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../012-librbd1_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:42.867 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librbd1 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:43.044 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libfmt8:amd64. 2023-07-06T21:38:43.059 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-07-06T21:38:43.144 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-06T21:38:43.270 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs2. 2023-07-06T21:38:43.284 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:43.320 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs2 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:43.464 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-07-06T21:38:43.479 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-07-06T21:38:43.523 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-06T21:38:43.597 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rados. 2023-07-06T21:38:43.611 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:43.655 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rados (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:43.935 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-06T21:38:43.950 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-07-06T21:38:43.985 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-06T21:38:44.008 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-06T21:38:44.022 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:38:44.066 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-argparse (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:44.305 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-06T21:38:44.318 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cephfs. 2023-07-06T21:38:44.319 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-07-06T21:38:44.332 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:44.363 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-06T21:38:44.377 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cephfs (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:44.663 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-06T21:38:44.676 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:38:44.721 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-common (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:44.809 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-06T21:38:44.824 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-06T21:38:44.867 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-06T21:38:45.058 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-prettytable. 2023-07-06T21:38:45.071 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-07-06T21:38:45.116 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-07-06T21:38:45.279 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-06T21:38:45.294 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-06T21:38:45.337 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-06T21:38:45.368 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rbd. 2023-07-06T21:38:45.383 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:45.418 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rbd (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:45.674 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-06T21:38:45.689 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-06T21:38:45.732 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-06T21:38:45.905 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-06T21:38:45.919 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-07-06T21:38:45.963 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-06T21:38:46.194 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-07-06T21:38:46.209 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-07-06T21:38:46.244 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-06T21:38:46.291 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librgw2. 2023-07-06T21:38:46.305 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../021-librgw2_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:46.349 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librgw2 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:46.574 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librados2. 2023-07-06T21:38:46.589 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../011-librados2_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:46.632 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librados2 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:46.802 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rgw. 2023-07-06T21:38:46.816 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:46.860 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rgw (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:47.085 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librbd1. 2023-07-06T21:38:47.100 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../012-librbd1_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:47.143 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librbd1 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:47.196 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liboath0:amd64. 2023-07-06T21:38:47.211 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-07-06T21:38:47.254 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-07-06T21:38:47.513 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libcephfs2. 2023-07-06T21:38:47.527 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:47.566 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libradosstriper1. 2023-07-06T21:38:47.571 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libcephfs2 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:47.580 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:47.624 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libradosstriper1 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:47.849 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rados. 2023-07-06T21:38:47.864 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:47.907 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rados (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:48.044 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-common. 2023-07-06T21:38:48.058 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:48.102 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-common (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:48.226 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-06T21:38:48.241 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:38:48.285 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-ceph-argparse (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:48.520 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cephfs. 2023-07-06T21:38:48.535 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:48.570 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cephfs (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:48.865 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-06T21:38:48.880 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:38:48.923 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-ceph-common (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:49.226 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-prettytable. 2023-07-06T21:38:49.241 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-07-06T21:38:49.258 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-base. 2023-07-06T21:38:49.272 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:49.276 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-07-06T21:38:49.325 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-base (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:49.529 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rbd. 2023-07-06T21:38:49.543 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:49.587 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rbd (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:49.965 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-06T21:38:49.979 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-07-06T21:38:49.995 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-07-06T21:38:50.009 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-07-06T21:38:50.023 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-06T21:38:50.053 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-07-06T21:38:50.343 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librgw2. 2023-07-06T21:38:50.344 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cheroot. 2023-07-06T21:38:50.356 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../021-librgw2_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:50.357 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-07-06T21:38:50.398 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-06T21:38:50.400 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librgw2 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:50.853 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rgw. 2023-07-06T21:38:50.859 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-07-06T21:38:50.867 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:50.872 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-07-06T21:38:50.911 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rgw (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:50.917 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-07-06T21:38:51.203 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.text. 2023-07-06T21:38:51.217 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-07-06T21:38:51.253 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-07-06T21:38:51.381 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package liboath0:amd64. 2023-07-06T21:38:51.396 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-07-06T21:38:51.448 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-07-06T21:38:51.514 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-07-06T21:38:51.528 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-07-06T21:38:51.573 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-07-06T21:38:51.759 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libradosstriper1. 2023-07-06T21:38:51.774 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:51.817 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libradosstriper1 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:51.859 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempora. 2023-07-06T21:38:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-07-06T21:38:51.917 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-07-06T21:38:52.229 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-portend. 2023-07-06T21:38:52.243 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-07-06T21:38:52.245 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-common. 2023-07-06T21:38:52.260 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:52.287 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-07-06T21:38:52.304 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-common (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:52.573 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-07-06T21:38:52.588 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-07-06T21:38:52.623 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-07-06T21:38:52.925 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-06T21:38:52.940 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-07-06T21:38:52.984 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-07-06T21:38:53.329 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-natsort. 2023-07-06T21:38:53.344 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-07-06T21:38:53.387 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-07-06T21:38:53.409 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-base. 2023-07-06T21:38:53.425 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:38:53.469 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-base (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:38:53.707 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-logutils. 2023-07-06T21:38:53.722 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-07-06T21:38:53.757 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-07-06T21:38:54.060 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-06T21:38:54.074 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-07-06T21:38:54.118 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-07-06T21:38:54.172 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-07-06T21:38:54.186 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-07-06T21:38:54.230 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-07-06T21:38:54.421 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-mako. 2023-07-06T21:38:54.435 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-07-06T21:38:54.479 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-06T21:38:54.542 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cheroot. 2023-07-06T21:38:54.556 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-07-06T21:38:54.600 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-06T21:38:54.808 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-06T21:38:54.822 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-06T21:38:54.866 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-06T21:38:54.919 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-07-06T21:38:54.934 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-07-06T21:38:54.978 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-07-06T21:38:55.168 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-06T21:38:55.183 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-07-06T21:38:55.235 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-07-06T21:38:55.255 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jaraco.text. 2023-07-06T21:38:55.270 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-07-06T21:38:55.306 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-07-06T21:38:55.505 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webob. 2023-07-06T21:38:55.519 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-07-06T21:38:55.563 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-07-06T21:38:55.575 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-07-06T21:38:55.590 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-07-06T21:38:55.633 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-07-06T21:38:55.920 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-tempora. 2023-07-06T21:38:55.934 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-07-06T21:38:55.978 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-07-06T21:38:55.991 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-waitress. 2023-07-06T21:38:56.005 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-07-06T21:38:56.051 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-06T21:38:56.322 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-portend. 2023-07-06T21:38:56.337 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-07-06T21:38:56.360 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempita. 2023-07-06T21:38:56.374 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-07-06T21:38:56.381 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-07-06T21:38:56.418 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-07-06T21:38:56.642 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-07-06T21:38:56.658 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-07-06T21:38:56.692 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-07-06T21:38:56.730 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-paste. 2023-07-06T21:38:56.744 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-07-06T21:38:56.788 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-07-06T21:38:57.003 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-06T21:38:57.018 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-07-06T21:38:57.061 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-07-06T21:38:57.116 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-06T21:38:57.130 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-07-06T21:38:57.174 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-07-06T21:38:57.406 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-natsort. 2023-07-06T21:38:57.421 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-07-06T21:38:57.473 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-07-06T21:38:57.477 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-06T21:38:57.491 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-07-06T21:38:57.535 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-07-06T21:38:57.768 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-logutils. 2023-07-06T21:38:57.783 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-07-06T21:38:57.818 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-07-06T21:38:57.830 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webtest. 2023-07-06T21:38:57.845 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-07-06T21:38:57.888 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-07-06T21:38:58.070 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-06T21:38:58.086 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-07-06T21:38:58.129 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-07-06T21:38:58.199 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pecan. 2023-07-06T21:38:58.214 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-07-06T21:38:58.258 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-07-06T21:38:58.415 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-mako. 2023-07-06T21:38:58.430 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-07-06T21:38:58.474 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-06T21:38:58.629 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-certifi. 2023-07-06T21:38:58.644 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-07-06T21:38:58.687 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-07-06T21:38:58.810 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-06T21:38:58.825 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-06T21:38:58.868 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-06T21:38:58.982 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-idna. 2023-07-06T21:38:58.996 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-07-06T21:38:59.057 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-idna (3.3-1) ... 2023-07-06T21:38:59.171 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-06T21:38:59.186 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-07-06T21:38:59.221 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-07-06T21:38:59.335 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-urllib3. 2023-07-06T21:38:59.350 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-07-06T21:38:59.393 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-07-06T21:38:59.524 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-webob. 2023-07-06T21:38:59.539 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-07-06T21:38:59.582 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-07-06T21:38:59.680 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests. 2023-07-06T21:38:59.694 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-07-06T21:38:59.738 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-06T21:38:59.910 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-waitress. 2023-07-06T21:38:59.925 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-07-06T21:38:59.971 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-06T21:39:00.058 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-06T21:39:00.072 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-07-06T21:39:00.115 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-06T21:39:00.271 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-tempita. 2023-07-06T21:39:00.286 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-07-06T21:39:00.329 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-07-06T21:39:00.427 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-06T21:39:00.441 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:00.485 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:00.624 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-paste. 2023-07-06T21:39:00.639 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-07-06T21:39:00.682 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-07-06T21:39:01.023 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-06T21:39:01.038 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:01.073 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:01.376 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-openssl. 2023-07-06T21:39:01.391 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-07-06T21:39:01.434 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-07-06T21:39:01.711 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-06T21:39:01.726 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-07-06T21:39:01.769 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-07-06T21:39:01.770 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr. 2023-07-06T21:39:01.785 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:01.837 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:02.056 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-06T21:39:02.070 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-07-06T21:39:02.113 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-07-06T21:39:02.425 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-webtest. 2023-07-06T21:39:02.440 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-07-06T21:39:02.508 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-07-06T21:39:02.766 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mon. 2023-07-06T21:39:02.780 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:02.803 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pecan. 2023-07-06T21:39:02.815 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mon (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:02.817 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-07-06T21:39:02.852 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-07-06T21:39:03.190 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-certifi. 2023-07-06T21:39:03.206 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-07-06T21:39:03.241 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-07-06T21:39:03.527 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-idna. 2023-07-06T21:39:03.542 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-07-06T21:39:03.585 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-idna (3.3-1) ... 2023-07-06T21:39:03.594 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-osd. 2023-07-06T21:39:03.608 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:03.685 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-osd (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:03.896 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-urllib3. 2023-07-06T21:39:03.911 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-07-06T21:39:03.954 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-07-06T21:39:04.299 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-requests. 2023-07-06T21:39:04.314 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-07-06T21:39:04.358 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-06T21:39:04.669 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-06T21:39:04.684 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-07-06T21:39:04.727 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-06T21:39:04.997 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-06T21:39:05.006 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph. 2023-07-06T21:39:05.012 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:05.020 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../061-ceph_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:05.055 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:05.063 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:05.358 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-fuse. 2023-07-06T21:39:05.372 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:05.385 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-06T21:39:05.399 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:05.408 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-fuse (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:05.435 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:05.744 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mds. 2023-07-06T21:39:05.759 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:05.762 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-openssl. 2023-07-06T21:39:05.777 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-07-06T21:39:05.803 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mds (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:05.821 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-07-06T21:39:06.132 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr. 2023-07-06T21:39:06.147 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:06.173 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephadm. 2023-07-06T21:39:06.187 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../064-cephadm_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:06.190 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:06.231 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephadm (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:06.534 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-06T21:39:06.549 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-07-06T21:39:06.552 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mon. 2023-07-06T21:39:06.567 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:06.592 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-07-06T21:39:06.610 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mon (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:06.895 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-babel-localedata. 2023-07-06T21:39:06.910 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-07-06T21:39:06.953 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-06T21:39:07.497 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-osd. 2023-07-06T21:39:07.512 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:07.555 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-osd (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:07.858 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-babel. 2023-07-06T21:39:07.872 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-07-06T21:39:07.916 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-07-06T21:39:08.202 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jinja2. 2023-07-06T21:39:08.216 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-07-06T21:39:08.252 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-07-06T21:39:08.606 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-06T21:39:08.619 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:08.656 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:08.767 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph. 2023-07-06T21:39:08.782 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../061-ceph_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:08.825 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:08.992 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-06T21:39:09.005 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-07-06T21:39:09.042 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-07-06T21:39:09.128 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-fuse. 2023-07-06T21:39:09.143 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:09.186 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-fuse (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:09.312 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-06T21:39:09.326 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-07-06T21:39:09.361 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-06T21:39:09.539 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mds. 2023-07-06T21:39:09.554 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:09.589 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mds (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:09.681 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-routes. 2023-07-06T21:39:09.695 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-07-06T21:39:09.739 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-07-06T21:39:09.942 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package cephadm. 2023-07-06T21:39:09.958 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../064-cephadm_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:10.001 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking cephadm (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:10.043 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-06T21:39:10.057 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:10.101 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:10.295 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-06T21:39:10.311 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-07-06T21:39:10.353 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-07-06T21:39:10.530 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-07-06T21:39:10.543 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-07-06T21:39:10.588 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-06T21:39:10.648 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python-babel-localedata. 2023-07-06T21:39:10.664 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-07-06T21:39:10.706 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-06T21:39:11.225 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-joblib. 2023-07-06T21:39:11.238 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-07-06T21:39:11.274 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-07-06T21:39:11.603 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-07-06T21:39:11.616 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-07-06T21:39:11.661 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-07-06T21:39:11.695 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-babel. 2023-07-06T21:39:11.709 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-07-06T21:39:11.753 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-07-06T21:39:11.973 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn. 2023-07-06T21:39:11.986 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-07-06T21:39:12.031 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-06T21:39:12.056 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jinja2. 2023-07-06T21:39:12.070 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-07-06T21:39:12.114 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-07-06T21:39:12.468 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-06T21:39:12.483 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:12.526 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:12.689 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-06T21:39:12.703 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:12.862 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-06T21:39:12.878 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-07-06T21:39:12.921 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-07-06T21:39:13.207 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-06T21:39:13.223 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-07-06T21:39:13.265 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-06T21:39:13.535 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-routes. 2023-07-06T21:39:13.550 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-07-06T21:39:13.584 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-07-06T21:39:13.726 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cachetools. 2023-07-06T21:39:13.740 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-07-06T21:39:13.776 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-07-06T21:39:13.880 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-06T21:39:13.895 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:13.930 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:14.062 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-06T21:39:14.077 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-07-06T21:39:14.120 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-07-06T21:39:14.316 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-07-06T21:39:14.331 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-07-06T21:39:14.374 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-06T21:39:14.426 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-06T21:39:14.441 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-07-06T21:39:14.476 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-07-06T21:39:14.712 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rsa. 2023-07-06T21:39:14.728 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-07-06T21:39:14.762 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rsa (4.8-1) ... 2023-07-06T21:39:14.861 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-joblib. 2023-07-06T21:39:14.877 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-07-06T21:39:14.920 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-07-06T21:39:15.161 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-google-auth. 2023-07-06T21:39:15.175 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-07-06T21:39:15.218 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-07-06T21:39:15.357 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-07-06T21:39:15.372 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-07-06T21:39:15.423 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-07-06T21:39:15.514 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-06T21:39:15.529 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-07-06T21:39:15.564 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-06T21:39:15.734 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-sklearn. 2023-07-06T21:39:15.750 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-07-06T21:39:15.793 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-06T21:39:15.834 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-websocket. 2023-07-06T21:39:15.849 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-07-06T21:39:15.892 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-07-06T21:39:16.213 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-06T21:39:16.228 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-07-06T21:39:16.271 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-06T21:39:16.493 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-06T21:39:16.507 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:16.551 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:16.978 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-06T21:39:16.991 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:17.028 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:17.331 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-06T21:39:17.344 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-07-06T21:39:17.389 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-06T21:39:17.721 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cachetools. 2023-07-06T21:39:17.726 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-06T21:39:17.735 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-07-06T21:39:17.740 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-07-06T21:39:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-07-06T21:39:17.784 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-06T21:39:18.108 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-06T21:39:18.123 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-07-06T21:39:18.138 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package jq. 2023-07-06T21:39:18.151 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-07-06T21:39:18.166 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-07-06T21:39:18.196 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-07-06T21:39:18.441 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package socat. 2023-07-06T21:39:18.455 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-07-06T21:39:18.499 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-07-06T21:39:18.502 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-06T21:39:18.518 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-07-06T21:39:18.561 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-07-06T21:39:18.803 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package xmlstarlet. 2023-07-06T21:39:18.817 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-07-06T21:39:18.847 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rsa. 2023-07-06T21:39:18.861 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-07-06T21:39:18.862 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-07-06T21:39:18.897 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rsa (4.8-1) ... 2023-07-06T21:39:19.224 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-test. 2023-07-06T21:39:19.238 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:19.269 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-google-auth. 2023-07-06T21:39:19.283 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-test (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:19.284 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-07-06T21:39:19.327 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-07-06T21:39:19.614 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-06T21:39:19.629 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-07-06T21:39:19.663 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-06T21:39:19.908 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-websocket. 2023-07-06T21:39:19.923 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-07-06T21:39:19.958 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-07-06T21:39:20.270 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-06T21:39:20.286 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-07-06T21:39:20.328 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-06T21:39:21.008 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-06T21:39:21.022 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:21.058 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:21.129 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-volume. 2023-07-06T21:39:21.144 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:21.179 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-volume (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:21.369 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-06T21:39:21.383 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-07-06T21:39:21.428 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-06T21:39:21.764 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-06T21:39:21.777 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-06T21:39:21.779 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-07-06T21:39:21.792 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:21.823 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-06T21:39:21.835 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephfs-mirror (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:22.067 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package jq. 2023-07-06T21:39:22.082 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-07-06T21:39:22.116 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-07-06T21:39:22.155 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-colorama. 2023-07-06T21:39:22.170 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-07-06T21:39:22.213 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-07-06T21:39:22.353 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package socat. 2023-07-06T21:39:22.368 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-07-06T21:39:22.463 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-07-06T21:39:22.475 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephfs-shell. 2023-07-06T21:39:22.490 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:22.533 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephfs-shell (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:22.778 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephfs-top. 2023-07-06T21:39:22.793 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:22.836 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephfs-top (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:22.873 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package xmlstarlet. 2023-07-06T21:39:22.888 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-07-06T21:39:22.931 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-07-06T21:39:23.089 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-06T21:39:23.104 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:23.148 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs-dev (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:23.235 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-test. 2023-07-06T21:39:23.249 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:23.293 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-test (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:23.510 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package nvme-cli. 2023-07-06T21:39:23.525 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-07-06T21:39:23.568 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-07-06T21:39:23.915 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-06T21:39:23.931 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-07-06T21:39:23.966 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-07-06T21:39:24.378 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-iniconfig. 2023-07-06T21:39:24.393 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-07-06T21:39:24.436 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-07-06T21:39:24.714 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastescript. 2023-07-06T21:39:24.729 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-07-06T21:39:24.772 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-06T21:39:25.068 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pluggy. 2023-07-06T21:39:25.080 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-volume. 2023-07-06T21:39:25.083 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-07-06T21:39:25.096 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:25.118 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-07-06T21:39:25.139 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-volume (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:25.404 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-psutil. 2023-07-06T21:39:25.419 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-07-06T21:39:25.463 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-07-06T21:39:25.560 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-06T21:39:25.576 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:25.619 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking cephfs-mirror (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:25.800 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-py. 2023-07-06T21:39:25.815 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-07-06T21:39:25.857 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-py (1.10.0-1) ... 2023-07-06T21:39:25.930 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-colorama. 2023-07-06T21:39:25.946 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-07-06T21:39:25.988 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-07-06T21:39:26.170 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pygments. 2023-07-06T21:39:26.185 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-07-06T21:39:26.228 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-07-06T21:39:26.233 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package cephfs-shell. 2023-07-06T21:39:26.248 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:26.291 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking cephfs-shell (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:26.529 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package cephfs-top. 2023-07-06T21:39:26.544 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4488-g0a781ef0-1jammy_all.deb ... 2023-07-06T21:39:26.587 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking cephfs-top (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:26.708 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-06T21:39:26.723 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-07-06T21:39:26.758 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-07-06T21:39:26.840 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-06T21:39:26.855 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:26.898 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libcephfs-dev (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:27.069 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-toml. 2023-07-06T21:39:27.085 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-07-06T21:39:27.127 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-07-06T21:39:27.243 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package nvme-cli. 2023-07-06T21:39:27.258 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-07-06T21:39:27.301 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-07-06T21:39:27.456 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pytest. 2023-07-06T21:39:27.471 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-07-06T21:39:27.514 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-07-06T21:39:27.664 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-06T21:39:27.680 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-07-06T21:39:27.722 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-07-06T21:39:27.851 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplejson. 2023-07-06T21:39:27.867 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-07-06T21:39:27.910 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-07-06T21:39:28.150 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-iniconfig. 2023-07-06T21:39:28.166 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-07-06T21:39:28.179 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-06T21:39:28.195 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-07-06T21:39:28.208 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-07-06T21:39:28.238 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-07-06T21:39:28.511 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pastescript. 2023-07-06T21:39:28.526 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-07-06T21:39:28.578 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-06T21:39:28.898 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pluggy. 2023-07-06T21:39:28.900 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package radosgw. 2023-07-06T21:39:28.914 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-07-06T21:39:28.914 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../113-radosgw_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:28.956 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-07-06T21:39:28.959 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking radosgw (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:29.250 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-psutil. 2023-07-06T21:39:29.266 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-07-06T21:39:29.301 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-07-06T21:39:29.562 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package rbd-fuse. 2023-07-06T21:39:29.578 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:29.620 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking rbd-fuse (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:29.662 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-py. 2023-07-06T21:39:29.678 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-07-06T21:39:29.720 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-py (1.10.0-1) ... 2023-07-06T21:39:29.914 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-07-06T21:39:30.040 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pygments. 2023-07-06T21:39:30.056 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-07-06T21:39:30.098 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-07-06T21:39:30.185 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-06T21:39:30.311 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-07-06T21:39:30.535 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-06T21:39:30.550 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-07-06T21:39:30.567 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-07-06T21:39:30.593 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-07-06T21:39:30.947 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-toml. 2023-07-06T21:39:30.962 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-07-06T21:39:30.982 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-07-06T21:39:31.005 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-07-06T21:39:31.316 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pytest. 2023-07-06T21:39:31.331 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-07-06T21:39:31.374 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-07-06T21:39:31.617 INFO:teuthology.orchestra.run.smithi138.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-07-06T21:39:31.630 INFO:teuthology.orchestra.run.smithi138.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-07-06T21:39:31.689 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephadm (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:31.711 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-simplejson. 2023-07-06T21:39:31.726 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-07-06T21:39:31.769 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-07-06T21:39:32.047 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-06T21:39:32.062 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-07-06T21:39:32.105 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-07-06T21:39:32.435 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user cephadm....done 2023-07-06T21:39:32.591 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-06T21:39:32.915 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-07-06T21:39:33.009 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package radosgw. 2023-07-06T21:39:33.024 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../113-radosgw_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:33.067 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking radosgw (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:33.166 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-07-06T21:39:33.284 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-07-06T21:39:33.544 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-06T21:39:33.812 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package rbd-fuse. 2023-07-06T21:39:33.813 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-07-06T21:39:33.828 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4488-g0a781ef0-1jammy_amd64.deb ... 2023-07-06T21:39:33.862 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking rbd-fuse (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:33.972 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-py (1.10.0-1) ... 2023-07-06T21:39:34.165 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-07-06T21:39:34.274 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-07-06T21:39:34.442 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-06T21:39:34.568 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-07-06T21:39:34.651 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-07-06T21:39:34.837 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-07-06T21:39:34.928 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-07-06T21:39:35.196 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-07-06T21:39:35.275 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-07-06T21:39:35.481 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-07-06T21:39:35.740 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-07-06T21:39:36.011 INFO:teuthology.orchestra.run.smithi055.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-07-06T21:39:36.024 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-07-06T21:39:36.025 INFO:teuthology.orchestra.run.smithi055.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-07-06T21:39:36.121 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up cephadm (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:36.301 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-argparse (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:36.560 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-06T21:39:36.686 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-07-06T21:39:36.725 INFO:teuthology.orchestra.run.smithi055.stdout:Adding system user cephadm....done 2023-07-06T21:39:36.894 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-06T21:39:36.946 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-07-06T21:39:37.222 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-06T21:39:37.281 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-07-06T21:39:37.349 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-07-06T21:39:37.679 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-07-06T21:39:37.708 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-06T21:39:37.834 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-07-06T21:39:37.855 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-07-06T21:39:38.103 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-07-06T21:39:38.266 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-06T21:39:38.371 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-07-06T21:39:38.542 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-07-06T21:39:38.668 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-py (1.10.0-1) ... 2023-07-06T21:39:38.705 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-07-06T21:39:39.003 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-07-06T21:39:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-07-06T21:39:39.399 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-07-06T21:39:39.631 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-07-06T21:39:39.667 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-07-06T21:39:39.793 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-07-06T21:39:39.894 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-06T21:39:39.908 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-07-06T21:39:40.209 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-07-06T21:39:40.212 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-07-06T21:39:40.477 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-07-06T21:39:40.614 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-07-06T21:39:40.753 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-07-06T21:39:40.865 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-07-06T21:39:41.020 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-ceph-argparse (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:41.259 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-06T21:39:41.296 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-06T21:39:41.431 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-07-06T21:39:41.560 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-07-06T21:39:41.699 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-07-06T21:39:41.878 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-06T21:39:41.966 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-06T21:39:42.092 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-07-06T21:39:42.238 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-07-06T21:39:42.468 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-06T21:39:42.498 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-07-06T21:39:42.594 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-07-06T21:39:42.624 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-common (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:42.863 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-07-06T21:39:42.917 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-idna (3.3-1) ... 2023-07-06T21:39:43.130 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-07-06T21:39:43.244 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-06T21:39:43.448 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-07-06T21:39:44.167 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-07-06T21:39:44.443 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-07-06T21:39:44.468 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-06T21:39:44.569 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-07-06T21:39:44.577 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-toml (0.10.2-1) ... 2023-07-06T21:39:44.695 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-06T21:39:44.853 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-06T21:39:44.979 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-07-06T21:39:45.005 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-07-06T21:39:45.105 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-07-06T21:39:45.397 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-07-06T21:39:45.398 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-07-06T21:39:45.665 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-07-06T21:39:45.667 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-07-06T21:39:45.918 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-06T21:39:46.044 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-06T21:39:46.067 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-06T21:39:46.170 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-07-06T21:39:46.376 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-07-06T21:39:46.480 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-07-06T21:39:46.711 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-06T21:39:46.740 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-07-06T21:39:47.025 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-07-06T21:39:47.054 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-07-06T21:39:47.305 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-07-06T21:39:47.360 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-06T21:39:47.431 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-ceph-common (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:47.619 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-07-06T21:39:47.732 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-idna (3.3-1) ... 2023-07-06T21:39:47.904 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-06T21:39:48.046 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-07-06T21:39:48.100 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-06T21:39:48.331 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-06T21:39:48.449 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-06T21:39:48.742 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-07-06T21:39:49.044 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-07-06T21:39:49.320 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-07-06T21:39:49.389 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-06T21:39:49.524 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-toml (0.10.2-1) ... 2023-07-06T21:39:49.733 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-07-06T21:39:49.866 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-06T21:39:49.973 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-06T21:39:49.992 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-07-06T21:39:50.099 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-07-06T21:39:50.118 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-07-06T21:39:50.428 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-07-06T21:39:50.518 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-07-06T21:39:50.696 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-07-06T21:39:50.794 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-portend (3.0.0-1) ... 2023-07-06T21:39:50.947 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-06T21:39:51.054 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-06T21:39:51.073 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-06T21:39:51.180 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-07-06T21:39:51.199 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-07-06T21:39:51.506 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-07-06T21:39:51.517 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-07-06T21:39:51.785 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-07-06T21:39:51.817 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-06T21:39:52.061 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-07-06T21:39:52.093 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-07-06T21:39:52.202 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rsa (4.8-1) ... 2023-07-06T21:39:52.312 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-06T21:39:52.478 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-07-06T21:39:52.556 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-07-06T21:39:52.755 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-06T21:39:52.831 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-06T21:39:52.974 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-07-06T21:39:53.023 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-07-06T21:39:53.267 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-06T21:39:53.392 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-06T21:39:53.416 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-06T21:39:53.694 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-07-06T21:39:53.709 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-07-06T21:39:54.003 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-07-06T21:39:54.045 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-06T21:39:54.188 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librados2 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:54.271 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-07-06T21:39:54.297 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librgw2 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:54.493 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:54.619 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs2 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:54.670 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-07-06T21:39:54.746 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libradosstriper1 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:54.872 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-07-06T21:39:54.916 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-06T21:39:55.041 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-07-06T21:39:55.149 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librbd1 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:55.284 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-modules-core (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:55.385 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-fuse (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:55.451 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-07-06T21:39:55.592 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-06T21:39:55.593 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-06T21:39:55.728 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-portend (3.0.0-1) ... 2023-07-06T21:39:55.995 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-06T21:39:56.096 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-07-06T21:39:56.270 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs-dev (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:56.396 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rados (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:56.431 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-07-06T21:39:56.514 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephfs-top (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:56.632 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-06T21:39:56.749 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-06T21:39:57.033 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-07-06T21:39:57.159 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rsa (4.8-1) ... 2023-07-06T21:39:57.444 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-07-06T21:39:57.728 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-06T21:39:57.914 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rbd (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:57.979 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-07-06T21:39:58.032 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up rbd-fuse (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rgw (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:58.284 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cephfs (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:58.364 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-06T21:39:58.411 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephfs-shell (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:58.537 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-common (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:58.666 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-07-06T21:39:59.034 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-06T21:39:59.057 INFO:teuthology.orchestra.run.smithi138.stdout:Adding group ceph....done 2023-07-06T21:39:59.160 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librados2 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:59.311 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librgw2 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:59.450 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user ceph....done 2023-07-06T21:39:59.522 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:59.649 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libcephfs2 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:59.654 INFO:teuthology.orchestra.run.smithi138.stdout:Setting system user ceph properties....done 2023-07-06T21:39:59.675 INFO:teuthology.orchestra.run.smithi138.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-06T21:39:59.775 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libradosstriper1 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:39:59.810 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-06T21:39:59.901 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-07-06T21:40:00.211 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librbd1 (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:00.224 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-06T21:40:00.328 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-modules-core (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:00.438 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-fuse (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:00.640 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-06T21:40:00.640 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-06T21:40:00.898 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephfs-mirror (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:01.106 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-06T21:40:01.107 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-06T21:40:01.339 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libcephfs-dev (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:01.466 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rados (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:01.592 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up cephfs-top (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:01.717 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-06T21:40:01.783 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-test (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:01.885 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up radosgw (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:02.140 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-06T21:40:02.141 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-06T21:40:03.064 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rbd (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:03.120 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-base (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:03.181 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up rbd-fuse (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:03.308 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rgw (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:03.433 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cephfs (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:03.470 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-06T21:40:03.559 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up cephfs-shell (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:04.069 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-common (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:04.181 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mds (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:04.420 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-06T21:40:04.420 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-06T21:40:04.589 INFO:teuthology.orchestra.run.smithi055.stdout:Adding group ceph....done 2023-07-06T21:40:04.873 INFO:teuthology.orchestra.run.smithi055.stdout:Adding system user ceph....done 2023-07-06T21:40:05.060 INFO:teuthology.orchestra.run.smithi055.stdout:Setting system user ceph properties....done 2023-07-06T21:40:05.066 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:05.077 INFO:teuthology.orchestra.run.smithi055.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-06T21:40:05.225 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-06T21:40:05.270 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-06T21:40:05.271 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-06T21:40:05.649 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-06T21:40:05.951 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-osd (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:06.362 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-06T21:40:06.362 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-06T21:40:06.437 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up cephfs-mirror (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:06.652 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-06T21:40:06.652 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-06T21:40:07.012 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:07.162 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:07.305 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mon (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:07.321 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-test (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:07.430 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up radosgw (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:07.514 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-06T21:40:07.514 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-06T21:40:07.693 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-06T21:40:07.693 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-06T21:40:08.174 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-cephadm (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:08.308 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:08.427 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-dashboard (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:08.570 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-volume (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:08.683 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-base (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:08.696 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-06T21:40:09.046 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-06T21:40:09.760 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mds (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:09.791 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-06T21:40:10.007 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-06T21:40:10.008 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-06T21:40:10.254 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-06T21:40:10.258 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-06T21:40:10.334 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-07-06T21:40:10.489 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2023-07-06T21:40:10.490 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2023-07-06T21:40:10.632 INFO:teuthology.orchestra.run.smithi138.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-07-06T21:40:10.632 INFO:teuthology.orchestra.run.smithi138.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-07-06T21:40:10.632 INFO:teuthology.orchestra.run.smithi138.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-07-06T21:40:10.632 INFO:teuthology.orchestra.run.smithi138.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-07-06T21:40:10.632 INFO:teuthology.orchestra.run.smithi138.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-07-06T21:40:10.633 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2023-07-06T21:40:10.633 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-06T21:40:10.633 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-06T21:40:10.633 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-06T21:40:10.633 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-06T21:40:10.634 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-06T21:40:10.634 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-06T21:40:10.634 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2023-07-06T21:40:10.635 INFO:teuthology.orchestra.run.smithi138.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-07-06T21:40:10.635 INFO:teuthology.orchestra.run.smithi138.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-07-06T21:40:10.635 INFO:teuthology.orchestra.run.smithi138.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-07-06T21:40:10.635 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-07-06T21:40:10.635 INFO:teuthology.orchestra.run.smithi138.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-06T21:40:10.636 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2023-07-06T21:40:10.636 INFO:teuthology.orchestra.run.smithi138.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-07-06T21:40:10.636 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-07-06T21:40:10.636 INFO:teuthology.orchestra.run.smithi138.stdout: libengine-pkcs11-openssl 2023-07-06T21:40:10.678 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:10.679 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2023-07-06T21:40:10.680 INFO:teuthology.orchestra.run.smithi138.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-07-06T21:40:10.680 INFO:teuthology.orchestra.run.smithi138.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-07-06T21:40:10.681 INFO:teuthology.orchestra.run.smithi138.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-07-06T21:40:10.682 INFO:teuthology.orchestra.run.smithi138.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-07-06T21:40:10.682 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-07-06T21:40:10.682 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-07-06T21:40:10.682 INFO:teuthology.orchestra.run.smithi138.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-06T21:40:10.683 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages will be upgraded: 2023-07-06T21:40:10.683 INFO:teuthology.orchestra.run.smithi138.stdout: libssl3 2023-07-06T21:40:10.821 INFO:teuthology.orchestra.run.smithi138.stdout:1 upgraded, 39 newly installed, 0 to remove and 206 not upgraded. 2023-07-06T21:40:10.821 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 54.6 MB of archives. 2023-07-06T21:40:10.822 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 202 MB of additional disk space will be used. 2023-07-06T21:40:10.822 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-07-06T21:40:10.889 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-06T21:40:10.889 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-06T21:40:10.920 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-07-06T21:40:10.985 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-07-06T21:40:10.996 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-07-06T21:40:10.997 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-07-06T21:40:10.999 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-07-06T21:40:11.000 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-07-06T21:40:11.000 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-07-06T21:40:11.002 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-07-06T21:40:11.002 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-07-06T21:40:11.037 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-07-06T21:40:11.038 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-07-06T21:40:11.088 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-07-06T21:40:11.378 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-07-06T21:40:11.380 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-07-06T21:40:11.381 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-07-06T21:40:11.383 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-07-06T21:40:11.383 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-07-06T21:40:11.387 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-07-06T21:40:11.389 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-07-06T21:40:11.397 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-07-06T21:40:11.431 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-07-06T21:40:11.571 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-osd (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:11.601 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-07-06T21:40:11.601 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-07-06T21:40:11.612 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-07-06T21:40:11.633 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-07-06T21:40:11.637 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-07-06T21:40:11.637 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-07-06T21:40:11.638 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-07-06T21:40:11.639 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-07-06T21:40:11.651 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-07-06T21:40:11.653 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-07-06T21:40:11.841 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-07-06T21:40:11.859 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-07-06T21:40:11.859 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-07-06T21:40:11.859 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-07-06T21:40:11.877 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-07-06T21:40:11.878 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-07-06T21:40:11.889 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-06T21:40:11.890 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-06T21:40:11.976 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-07-06T21:40:11.977 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-07-06T21:40:12.354 INFO:teuthology.orchestra.run.smithi138.stdout:Preconfiguring packages ... 2023-07-06T21:40:12.502 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 54.6 MB in 1s (42.4 MB/s) 2023-07-06T21:40:12.556 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:12.649 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package flex. 2023-07-06T21:40:12.682 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139903 files and directories currently installed.) 2023-07-06T21:40:12.725 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-07-06T21:40:12.833 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mon (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:12.865 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking flex (2.6.4-8build2) ... 2023-07-06T21:40:13.346 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-06T21:40:13.346 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-06T21:40:13.435 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-06T21:40:13.614 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-07-06T21:40:14.014 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-cephadm (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:14.028 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-06T21:40:14.156 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:14.282 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-dashboard (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:14.425 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-volume (18.0.0-4488-g0a781ef0-1jammy) ... 2023-07-06T21:40:14.574 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package bison. 2023-07-06T21:40:14.576 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-06T21:40:14.647 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139976 files and directories currently installed.) 2023-07-06T21:40:14.651 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-07-06T21:40:14.694 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-07-06T21:40:15.096 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-06T21:40:15.109 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-07-06T21:40:15.154 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-07-06T21:40:15.343 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-06T21:40:15.491 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package dump. 2023-07-06T21:40:15.505 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-07-06T21:40:15.541 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking dump (0.4b47-3) ... 2023-07-06T21:40:15.820 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package indent. 2023-07-06T21:40:15.833 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-07-06T21:40:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-06T21:40:15.858 DEBUG:teuthology.orchestra.run.smithi055:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-06T21:40:15.878 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking indent (2.2.12-1build2) ... 2023-07-06T21:40:15.941 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2023-07-06T21:40:16.100 INFO:teuthology.orchestra.run.smithi055.stdout:Building dependency tree... 2023-07-06T21:40:16.101 INFO:teuthology.orchestra.run.smithi055.stdout:Reading state information... 2023-07-06T21:40:16.139 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-06T21:40:16.153 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-07-06T21:40:16.197 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-06T21:40:16.248 INFO:teuthology.orchestra.run.smithi055.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-07-06T21:40:16.248 INFO:teuthology.orchestra.run.smithi055.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-07-06T21:40:16.248 INFO:teuthology.orchestra.run.smithi055.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-07-06T21:40:16.248 INFO:teuthology.orchestra.run.smithi055.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-07-06T21:40:16.248 INFO:teuthology.orchestra.run.smithi055.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-07-06T21:40:16.249 INFO:teuthology.orchestra.run.smithi055.stdout:The following packages were automatically installed and are no longer required: 2023-07-06T21:40:16.249 INFO:teuthology.orchestra.run.smithi055.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-06T21:40:16.249 INFO:teuthology.orchestra.run.smithi055.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-06T21:40:16.249 INFO:teuthology.orchestra.run.smithi055.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-06T21:40:16.250 INFO:teuthology.orchestra.run.smithi055.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-06T21:40:16.250 INFO:teuthology.orchestra.run.smithi055.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-06T21:40:16.250 INFO:teuthology.orchestra.run.smithi055.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-06T21:40:16.251 INFO:teuthology.orchestra.run.smithi055.stdout:The following additional packages will be installed: 2023-07-06T21:40:16.251 INFO:teuthology.orchestra.run.smithi055.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-07-06T21:40:16.251 INFO:teuthology.orchestra.run.smithi055.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-07-06T21:40:16.251 INFO:teuthology.orchestra.run.smithi055.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-07-06T21:40:16.251 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-07-06T21:40:16.251 INFO:teuthology.orchestra.run.smithi055.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-06T21:40:16.252 INFO:teuthology.orchestra.run.smithi055.stdout:Suggested packages: 2023-07-06T21:40:16.252 INFO:teuthology.orchestra.run.smithi055.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-07-06T21:40:16.252 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-07-06T21:40:16.252 INFO:teuthology.orchestra.run.smithi055.stdout: libengine-pkcs11-openssl 2023-07-06T21:40:16.297 INFO:teuthology.orchestra.run.smithi055.stdout:The following NEW packages will be installed: 2023-07-06T21:40:16.299 INFO:teuthology.orchestra.run.smithi055.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-07-06T21:40:16.299 INFO:teuthology.orchestra.run.smithi055.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-07-06T21:40:16.299 INFO:teuthology.orchestra.run.smithi055.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-07-06T21:40:16.299 INFO:teuthology.orchestra.run.smithi055.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-07-06T21:40:16.300 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-07-06T21:40:16.300 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-07-06T21:40:16.300 INFO:teuthology.orchestra.run.smithi055.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-06T21:40:16.300 INFO:teuthology.orchestra.run.smithi055.stdout:The following packages will be upgraded: 2023-07-06T21:40:16.301 INFO:teuthology.orchestra.run.smithi055.stdout: libssl3 2023-07-06T21:40:16.484 INFO:teuthology.orchestra.run.smithi055.stdout:1 upgraded, 39 newly installed, 0 to remove and 206 not upgraded. 2023-07-06T21:40:16.485 INFO:teuthology.orchestra.run.smithi055.stdout:Need to get 54.6 MB of archives. 2023-07-06T21:40:16.485 INFO:teuthology.orchestra.run.smithi055.stdout:After this operation, 202 MB of additional disk space will be used. 2023-07-06T21:40:16.485 INFO:teuthology.orchestra.run.smithi055.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-07-06T21:40:16.510 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-06T21:40:16.524 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-07-06T21:40:16.569 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-06T21:40:16.830 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-06T21:40:16.844 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-07-06T21:40:16.888 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-07-06T21:40:16.962 INFO:teuthology.orchestra.run.smithi055.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-07-06T21:40:17.219 INFO:teuthology.orchestra.run.smithi055.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-07-06T21:40:17.242 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libfl2:amd64. 2023-07-06T21:40:17.253 INFO:teuthology.orchestra.run.smithi055.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-07-06T21:40:17.255 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-07-06T21:40:17.256 INFO:teuthology.orchestra.run.smithi055.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-07-06T21:40:17.261 INFO:teuthology.orchestra.run.smithi055.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-07-06T21:40:17.264 INFO:teuthology.orchestra.run.smithi055.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-07-06T21:40:17.265 INFO:teuthology.orchestra.run.smithi055.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-07-06T21:40:17.268 INFO:teuthology.orchestra.run.smithi055.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-07-06T21:40:17.270 INFO:teuthology.orchestra.run.smithi055.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-07-06T21:40:17.300 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-07-06T21:40:17.435 INFO:teuthology.orchestra.run.smithi055.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-07-06T21:40:17.435 INFO:teuthology.orchestra.run.smithi055.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-07-06T21:40:17.536 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-07-06T21:40:17.550 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-07-06T21:40:17.595 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-06T21:40:17.679 INFO:teuthology.orchestra.run.smithi055.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-07-06T21:40:17.848 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjson-perl. 2023-07-06T21:40:17.861 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-07-06T21:40:18.299 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-07-06T21:40:18.620 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libllvm14:amd64. 2023-07-06T21:40:18.633 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-07-06T21:40:18.670 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-06T21:40:18.721 INFO:teuthology.orchestra.run.smithi055.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-07-06T21:40:18.723 INFO:teuthology.orchestra.run.smithi055.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-07-06T21:40:18.724 INFO:teuthology.orchestra.run.smithi055.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-07-06T21:40:18.727 INFO:teuthology.orchestra.run.smithi055.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-07-06T21:40:18.727 INFO:teuthology.orchestra.run.smithi055.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-07-06T21:40:18.732 INFO:teuthology.orchestra.run.smithi055.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-07-06T21:40:18.733 INFO:teuthology.orchestra.run.smithi055.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-07-06T21:40:18.749 INFO:teuthology.orchestra.run.smithi055.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-07-06T21:40:18.913 INFO:teuthology.orchestra.run.smithi055.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-07-06T21:40:19.637 INFO:teuthology.orchestra.run.smithi055.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-07-06T21:40:19.637 INFO:teuthology.orchestra.run.smithi055.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-07-06T21:40:19.664 INFO:teuthology.orchestra.run.smithi055.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-07-06T21:40:19.741 INFO:teuthology.orchestra.run.smithi055.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-07-06T21:40:19.749 INFO:teuthology.orchestra.run.smithi055.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-07-06T21:40:19.750 INFO:teuthology.orchestra.run.smithi055.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-07-06T21:40:19.750 INFO:teuthology.orchestra.run.smithi055.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-07-06T21:40:19.751 INFO:teuthology.orchestra.run.smithi055.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-07-06T21:40:19.779 INFO:teuthology.orchestra.run.smithi055.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-07-06T21:40:19.782 INFO:teuthology.orchestra.run.smithi055.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-07-06T21:40:20.064 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-06T21:40:20.079 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-06T21:40:20.123 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-06T21:40:20.334 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-06T21:40:20.349 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-06T21:40:20.392 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-06T21:40:20.410 INFO:teuthology.orchestra.run.smithi055.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-07-06T21:40:20.492 INFO:teuthology.orchestra.run.smithi055.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-07-06T21:40:20.493 INFO:teuthology.orchestra.run.smithi055.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-07-06T21:40:20.493 INFO:teuthology.orchestra.run.smithi055.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-07-06T21:40:20.582 INFO:teuthology.orchestra.run.smithi055.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-07-06T21:40:20.590 INFO:teuthology.orchestra.run.smithi055.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-07-06T21:40:20.737 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-06T21:40:20.753 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-06T21:40:20.795 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-06T21:40:21.045 INFO:teuthology.orchestra.run.smithi055.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-07-06T21:40:21.048 INFO:teuthology.orchestra.run.smithi055.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-07-06T21:40:21.132 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-06T21:40:21.147 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-07-06T21:40:21.182 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-06T21:40:21.456 INFO:teuthology.orchestra.run.smithi055.stdout:Preconfiguring packages ... 2023-07-06T21:40:21.468 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-06T21:40:21.483 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-07-06T21:40:21.560 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-06T21:40:21.622 INFO:teuthology.orchestra.run.smithi055.stdout:Fetched 54.6 MB in 5s (11.5 MB/s) 2023-07-06T21:40:21.767 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package flex. 2023-07-06T21:40:21.841 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139903 files and directories currently installed.) 2023-07-06T21:40:21.845 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-07-06T21:40:21.882 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking flex (2.6.4-8build2) ... 2023-07-06T21:40:21.921 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-06T21:40:21.936 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-06T21:40:21.980 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-06T21:40:22.316 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-06T21:40:22.332 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-06T21:40:22.366 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-06T21:40:22.452 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-06T21:40:22.605 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-07-06T21:40:22.653 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-06T21:40:22.668 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-06T21:40:22.711 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-06T21:40:22.961 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-06T21:40:22.964 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-06T21:40:22.979 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-06T21:40:23.090 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-06T21:40:23.522 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package bison. 2023-07-06T21:40:23.597 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139976 files and directories currently installed.) 2023-07-06T21:40:23.601 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-07-06T21:40:23.644 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-06T21:40:23.649 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-07-06T21:40:23.659 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-07-06T21:40:23.703 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-07-06T21:40:24.067 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-06T21:40:24.081 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package modemmanager. 2023-07-06T21:40:24.081 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-07-06T21:40:24.096 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-06T21:40:24.125 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-07-06T21:40:24.139 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-06T21:40:24.695 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package dump. 2023-07-06T21:40:24.711 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-07-06T21:40:24.753 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking dump (0.4b47-3) ... 2023-07-06T21:40:24.771 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package network-manager. 2023-07-06T21:40:24.786 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-07-06T21:40:24.837 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-07-06T21:40:25.023 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package indent. 2023-07-06T21:40:25.039 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-07-06T21:40:25.073 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking indent (2.2.12-1build2) ... 2023-07-06T21:40:25.275 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-06T21:40:25.291 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-07-06T21:40:25.333 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-06T21:40:25.446 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ppp. 2023-07-06T21:40:25.460 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-07-06T21:40:25.679 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-06T21:40:25.697 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-07-06T21:40:25.738 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-06T21:40:25.806 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-07-06T21:40:25.998 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-06T21:40:26.014 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-07-06T21:40:26.057 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-07-06T21:40:26.135 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package pptp-linux. 2023-07-06T21:40:26.149 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-07-06T21:40:26.193 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-07-06T21:40:26.343 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libfl2:amd64. 2023-07-06T21:40:26.359 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-07-06T21:40:26.393 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-07-06T21:40:26.438 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-06T21:40:26.452 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-07-06T21:40:26.497 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-07-06T21:40:26.637 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-07-06T21:40:26.652 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-07-06T21:40:26.698 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-06T21:40:26.800 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-06T21:40:26.814 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-07-06T21:40:26.858 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-client-common (238) ... 2023-07-06T21:40:26.950 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libjson-perl. 2023-07-06T21:40:26.966 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-07-06T21:40:27.009 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-07-06T21:40:27.188 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-client-14. 2023-07-06T21:40:27.202 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-06T21:40:27.246 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-06T21:40:27.279 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libllvm14:amd64. 2023-07-06T21:40:27.294 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-07-06T21:40:27.329 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-06T21:40:27.735 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-common. 2023-07-06T21:40:27.749 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-07-06T21:40:27.809 INFO:teuthology.orchestra.run.smithi138.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-06T21:40:27.850 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-common (238) ... 2023-07-06T21:40:28.438 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-14. 2023-07-06T21:40:28.453 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-06T21:40:28.491 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-06T21:40:28.757 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-06T21:40:28.772 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-06T21:40:28.815 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-06T21:40:29.059 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-06T21:40:29.078 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-06T21:40:29.117 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-06T21:40:29.421 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-06T21:40:29.436 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-06T21:40:29.470 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-06T21:40:29.560 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql. 2023-07-06T21:40:29.576 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-07-06T21:40:29.618 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql (14+238) ... 2023-07-06T21:40:29.799 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-06T21:40:29.813 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-07-06T21:40:29.857 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-06T21:40:29.871 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-client. 2023-07-06T21:40:29.885 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-07-06T21:40:29.929 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-client (14+238) ... 2023-07-06T21:40:30.140 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-06T21:40:30.155 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-07-06T21:40:30.177 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-06T21:40:30.192 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-07-06T21:40:30.198 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-contrib (14+238) ... 2023-07-06T21:40:30.227 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-06T21:40:30.548 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-06T21:40:30.562 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-06T21:40:30.576 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package tcl8.6. 2023-07-06T21:40:30.590 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-07-06T21:40:30.604 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-06T21:40:30.635 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-06T21:40:30.929 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package tcl. 2023-07-06T21:40:30.943 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-07-06T21:40:30.958 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-06T21:40:30.974 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-06T21:40:30.992 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-07-06T21:40:31.016 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-06T21:40:31.302 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-06T21:40:31.316 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package wpasupplicant. 2023-07-06T21:40:31.318 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-06T21:40:31.330 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-07-06T21:40:31.352 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-06T21:40:31.374 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-06T21:40:31.555 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-06T21:40:31.570 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-06T21:40:31.613 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-06T21:40:31.756 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-06T21:40:31.769 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-07-06T21:40:31.813 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-07-06T21:40:32.134 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-06T21:40:32.149 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-07-06T21:40:32.174 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-06T21:40:32.189 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-07-06T21:40:32.192 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-07-06T21:40:32.240 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-06T21:40:32.507 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-client-common (238) ... 2023-07-06T21:40:32.545 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package modemmanager. 2023-07-06T21:40:32.561 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-06T21:40:32.595 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-06T21:40:32.715 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up flex (2.6.4-8build2) ... 2023-07-06T21:40:32.845 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-06T21:40:32.959 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-06T21:40:33.061 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-07-06T21:40:33.186 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-06T21:40:33.219 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package network-manager. 2023-07-06T21:40:33.234 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-07-06T21:40:33.286 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-07-06T21:40:33.329 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-06T21:40:33.777 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ppp. 2023-07-06T21:40:33.793 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-07-06T21:40:34.179 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-07-06T21:40:34.327 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-06T21:40:34.420 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-06T21:40:34.490 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package pptp-linux. 2023-07-06T21:40:34.504 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-07-06T21:40:34.549 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-07-06T21:40:34.890 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-06T21:40:34.890 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-06T21:40:34.960 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-06T21:40:34.974 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-07-06T21:40:35.010 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-07-06T21:40:35.313 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-06T21:40:35.329 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-07-06T21:40:35.394 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-client-common (238) ... 2023-07-06T21:40:35.649 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-07-06T21:40:35.701 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-client-14. 2023-07-06T21:40:35.717 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-06T21:40:35.759 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-06T21:40:35.775 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-06T21:40:35.901 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-07-06T21:40:36.027 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-07-06T21:40:36.145 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-07-06T21:40:36.247 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-common. 2023-07-06T21:40:36.263 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-07-06T21:40:36.271 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-06T21:40:36.325 INFO:teuthology.orchestra.run.smithi055.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-06T21:40:36.356 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-common (238) ... 2023-07-06T21:40:36.397 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-07-06T21:40:36.898 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-14. 2023-07-06T21:40:36.914 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-06T21:40:36.967 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-06T21:40:37.054 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-06T21:40:37.213 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up dump (0.4b47-3) ... 2023-07-06T21:40:37.309 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-06T21:40:37.374 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-06T21:40:37.500 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-06T21:40:37.618 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up tcl (8.6.11+1build2) ... 2023-07-06T21:40:37.727 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjson-perl (4.04000-1) ... 2023-07-06T21:40:37.853 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-07-06T21:40:37.945 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-07-06T21:40:38.016 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up indent (2.2.12-1build2) ... 2023-07-06T21:40:38.060 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql. 2023-07-06T21:40:38.075 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-07-06T21:40:38.118 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql (14+238) ... 2023-07-06T21:40:38.141 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-06T21:40:38.309 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-06T21:40:38.321 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-client. 2023-07-06T21:40:38.336 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-07-06T21:40:38.371 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-client (14+238) ... 2023-07-06T21:40:38.427 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-06T21:40:38.536 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-07-06T21:40:38.615 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-06T21:40:38.630 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-07-06T21:40:38.674 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-contrib (14+238) ... 2023-07-06T21:40:38.704 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-client (14+238) ... 2023-07-06T21:40:38.830 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-07-06T21:40:39.035 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package tcl8.6. 2023-07-06T21:40:39.051 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-07-06T21:40:39.093 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-06T21:40:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package tcl. 2023-07-06T21:40:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-07-06T21:40:39.417 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-07-06T21:40:39.447 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:40:39.447 INFO:teuthology.orchestra.run.smithi138.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-06T21:40:39.448 INFO:teuthology.orchestra.run.smithi138.stdout:which means they are currently configured by ifupdown: 2023-07-06T21:40:39.448 INFO:teuthology.orchestra.run.smithi138.stdout:- enp3s0f1 2023-07-06T21:40:39.448 INFO:teuthology.orchestra.run.smithi138.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-06T21:40:39.448 INFO:teuthology.orchestra.run.smithi138.stdout:remove their configuration from /etc/network/interfaces. 2023-07-06T21:40:39.448 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:40:39.579 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-06T21:40:39.782 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package wpasupplicant. 2023-07-06T21:40:39.798 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-07-06T21:40:39.841 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-06T21:40:39.999 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-06T21:40:40.179 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-06T21:40:40.195 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-07-06T21:40:40.229 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-07-06T21:40:40.425 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-06T21:40:40.591 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-06T21:40:40.606 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-07-06T21:40:40.658 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-06T21:40:40.942 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-client-common (238) ... 2023-07-06T21:40:41.131 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up flex (2.6.4-8build2) ... 2023-07-06T21:40:41.166 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-06T21:40:41.257 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-06T21:40:41.317 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-06T21:40:41.383 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-06T21:40:41.468 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-07-06T21:40:41.509 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-07-06T21:40:41.594 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-common (238) ... 2023-07-06T21:40:41.635 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-06T21:40:41.761 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-06T21:40:42.508 INFO:teuthology.orchestra.run.smithi138.stdout:Adding user postgres to group ssl-cert 2023-07-06T21:40:42.768 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:40:42.768 INFO:teuthology.orchestra.run.smithi138.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-06T21:40:42.790 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-06T21:40:42.885 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-06T21:40:43.037 INFO:teuthology.orchestra.run.smithi138.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-06T21:40:43.037 INFO:teuthology.orchestra.run.smithi138.stdout:Removing obsolete dictionary files: 2023-07-06T21:40:43.271 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-06T21:40:43.272 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-06T21:40:43.813 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-06T21:40:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-07-06T21:40:44.131 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-06T21:40:44.257 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-07-06T21:40:44.303 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-06T21:40:44.392 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-07-06T21:40:44.518 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-07-06T21:40:44.644 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-06T21:40:44.649 INFO:teuthology.orchestra.run.smithi138.stdout:Creating new PostgreSQL cluster 14/main ... 2023-07-06T21:40:44.665 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-07-06T21:40:44.717 INFO:teuthology.orchestra.run.smithi138.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-06T21:40:44.717 INFO:teuthology.orchestra.run.smithi138.stdout:This user must also own the server process. 2023-07-06T21:40:44.717 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:40:44.717 INFO:teuthology.orchestra.run.smithi138.stdout:The database cluster will be initialized with locale "en_US". 2023-07-06T21:40:44.718 INFO:teuthology.orchestra.run.smithi138.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-06T21:40:44.718 INFO:teuthology.orchestra.run.smithi138.stdout:The default text search configuration will be set to "english". 2023-07-06T21:40:44.718 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:40:44.718 INFO:teuthology.orchestra.run.smithi138.stdout:Data page checksums are disabled. 2023-07-06T21:40:44.718 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:40:44.718 INFO:teuthology.orchestra.run.smithi138.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-07-06T21:40:44.719 INFO:teuthology.orchestra.run.smithi138.stdout:creating subdirectories ... ok 2023-07-06T21:40:44.719 INFO:teuthology.orchestra.run.smithi138.stdout:selecting dynamic shared memory implementation ... posix 2023-07-06T21:40:44.742 INFO:teuthology.orchestra.run.smithi138.stdout:selecting default max_connections ... 100 2023-07-06T21:40:44.770 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-07-06T21:40:44.777 INFO:teuthology.orchestra.run.smithi138.stdout:selecting default shared_buffers ... 128MB 2023-07-06T21:40:44.789 INFO:teuthology.orchestra.run.smithi138.stdout:selecting default time zone ... Etc/UTC 2023-07-06T21:40:44.790 INFO:teuthology.orchestra.run.smithi138.stdout:creating configuration files ... ok 2023-07-06T21:40:44.966 INFO:teuthology.orchestra.run.smithi138.stdout:running bootstrap script ... ok 2023-07-06T21:40:45.426 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-06T21:40:45.552 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up dump (0.4b47-3) ... 2023-07-06T21:40:45.605 INFO:teuthology.orchestra.run.smithi138.stdout:performing post-bootstrap initialization ... ok 2023-07-06T21:40:45.648 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-06T21:40:45.712 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-06T21:40:45.830 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-06T21:40:45.939 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up tcl (8.6.11+1build2) ... 2023-07-06T21:40:46.057 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libjson-perl (4.04000-1) ... 2023-07-06T21:40:46.126 INFO:teuthology.orchestra.run.smithi138.stdout:syncing data to disk ... ok 2023-07-06T21:40:46.183 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-07-06T21:40:46.274 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-07-06T21:40:46.336 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up indent (2.2.12-1build2) ... 2023-07-06T21:40:46.461 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-06T21:40:46.638 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-06T21:40:46.747 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-06T21:40:46.764 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-06T21:40:46.848 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-07-06T21:40:47.050 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-client (14+238) ... 2023-07-06T21:40:47.176 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-07-06T21:40:47.822 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:40:47.823 INFO:teuthology.orchestra.run.smithi055.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-06T21:40:47.823 INFO:teuthology.orchestra.run.smithi055.stdout:which means they are currently configured by ifupdown: 2023-07-06T21:40:47.823 INFO:teuthology.orchestra.run.smithi055.stdout:- ens1f0 2023-07-06T21:40:47.823 INFO:teuthology.orchestra.run.smithi055.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-06T21:40:47.823 INFO:teuthology.orchestra.run.smithi055.stdout:remove their configuration from /etc/network/interfaces. 2023-07-06T21:40:47.823 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:40:47.962 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-06T21:40:48.376 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-06T21:40:48.821 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-06T21:40:49.687 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-06T21:40:49.880 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-06T21:40:50.006 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-07-06T21:40:50.093 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-06T21:40:50.116 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-common (238) ... 2023-07-06T21:40:50.219 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-contrib (14+238) ... 2023-07-06T21:40:50.345 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql (14+238) ... 2023-07-06T21:40:50.488 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-06T21:40:50.622 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-06T21:40:50.879 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-06T21:40:50.879 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-06T21:40:50.989 INFO:teuthology.orchestra.run.smithi055.stdout:Adding user postgres to group ssl-cert 2023-07-06T21:40:51.262 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:40:51.262 INFO:teuthology.orchestra.run.smithi055.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-06T21:40:51.514 INFO:teuthology.orchestra.run.smithi055.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-06T21:40:51.514 INFO:teuthology.orchestra.run.smithi055.stdout:Removing obsolete dictionary files: 2023-07-06T21:40:51.700 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-06T21:40:52.011 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-06T21:40:52.162 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-06T21:40:52.298 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-06T21:40:52.785 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-06T21:40:53.137 INFO:teuthology.orchestra.run.smithi055.stdout:Creating new PostgreSQL cluster 14/main ... 2023-07-06T21:40:53.158 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-07-06T21:40:53.205 INFO:teuthology.orchestra.run.smithi055.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-06T21:40:53.205 INFO:teuthology.orchestra.run.smithi055.stdout:This user must also own the server process. 2023-07-06T21:40:53.205 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:40:53.205 INFO:teuthology.orchestra.run.smithi055.stdout:The database cluster will be initialized with locale "en_US". 2023-07-06T21:40:53.205 INFO:teuthology.orchestra.run.smithi055.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-06T21:40:53.205 INFO:teuthology.orchestra.run.smithi055.stdout:The default text search configuration will be set to "english". 2023-07-06T21:40:53.206 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:40:53.206 INFO:teuthology.orchestra.run.smithi055.stdout:Data page checksums are disabled. 2023-07-06T21:40:53.206 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:40:53.206 INFO:teuthology.orchestra.run.smithi055.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-07-06T21:40:53.207 INFO:teuthology.orchestra.run.smithi055.stdout:creating subdirectories ... ok 2023-07-06T21:40:53.207 INFO:teuthology.orchestra.run.smithi055.stdout:selecting dynamic shared memory implementation ... posix 2023-07-06T21:40:53.230 INFO:teuthology.orchestra.run.smithi055.stdout:selecting default max_connections ... 100 2023-07-06T21:40:53.265 INFO:teuthology.orchestra.run.smithi055.stdout:selecting default shared_buffers ... 128MB 2023-07-06T21:40:53.280 INFO:teuthology.orchestra.run.smithi055.stdout:selecting default time zone ... Etc/UTC 2023-07-06T21:40:53.280 INFO:teuthology.orchestra.run.smithi055.stdout:creating configuration files ... ok 2023-07-06T21:40:53.378 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-07-06T21:40:53.470 INFO:teuthology.orchestra.run.smithi055.stdout:running bootstrap script ... ok 2023-07-06T21:40:53.479 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-07-06T21:40:54.139 INFO:teuthology.orchestra.run.smithi055.stdout:performing post-bootstrap initialization ... ok 2023-07-06T21:40:54.193 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-06T21:40:54.197 DEBUG:teuthology.parallel:result is None 2023-07-06T21:40:54.675 INFO:teuthology.orchestra.run.smithi055.stdout:syncing data to disk ... ok 2023-07-06T21:40:55.256 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-06T21:40:58.411 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-06T21:40:58.537 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-contrib (14+238) ... 2023-07-06T21:40:58.654 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql (14+238) ... 2023-07-06T21:40:58.764 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-06T21:40:58.881 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-06T21:40:59.159 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-06T21:40:59.159 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-06T21:40:59.968 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-06T21:41:00.287 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-06T21:41:00.430 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-06T21:41:01.834 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-07-06T21:41:01.918 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-07-06T21:41:02.614 INFO:teuthology.orchestra.run.smithi055.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-06T21:41:02.618 DEBUG:teuthology.parallel:result is None 2023-07-06T21:41:02.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-06T21:41:02.841 DEBUG:teuthology.orchestra.run.smithi055:> dpkg-query -W -f '${Version}' ceph 2023-07-06T21:41:02.865 INFO:teuthology.orchestra.run.smithi055.stdout:18.0.0-4488-g0a781ef0-1jammy 2023-07-06T21:41:02.866 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4488-g0a781ef0-1jammy 2023-07-06T21:41:02.866 INFO:teuthology.task.install:The correct ceph version 18.0.0-4488-g0a781ef0-1jammy is installed. 2023-07-06T21:41:02.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0a781ef0807ae9473fb1306ef07036226ca4f1a6 2023-07-06T21:41:03.004 DEBUG:teuthology.orchestra.run.smithi138:> dpkg-query -W -f '${Version}' ceph 2023-07-06T21:41:03.028 INFO:teuthology.orchestra.run.smithi138.stdout:18.0.0-4488-g0a781ef0-1jammy 2023-07-06T21:41:03.028 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4488-g0a781ef0-1jammy 2023-07-06T21:41:03.029 INFO:teuthology.task.install:The correct ceph version 18.0.0-4488-g0a781ef0-1jammy is installed. 2023-07-06T21:41:03.029 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-06T21:41:03.030 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:03.030 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-06T21:41:03.051 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:03.052 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-06T21:41:03.096 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-06T21:41:03.097 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:03.097 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/daemon-helper 2023-07-06T21:41:03.118 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-06T21:41:03.184 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:03.185 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2023-07-06T21:41:03.208 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-06T21:41:03.271 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-06T21:41:03.271 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:03.272 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-06T21:41:03.293 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-06T21:41:03.356 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:03.357 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-06T21:41:03.379 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-06T21:41:03.447 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-06T21:41:03.447 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:03.447 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/stdin-killer 2023-07-06T21:41:03.468 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-06T21:41:03.533 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:03.533 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2023-07-06T21:41:03.555 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-06T21:41:03.623 INFO:teuthology.run_tasks:Running task ceph... 2023-07-06T21:41:03.711 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-06T21:41:03.712 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 777 /var/log/ceph 2023-07-06T21:41:03.715 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2023-07-06T21:41:03.736 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-06T21:41:03.736 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-06T21:41:03.779 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-06T21:41:03.802 INFO:tasks.ceph:Creating extra log directories... 2023-07-06T21:41:03.802 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-06T21:41:03.843 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-06T21:41:03.879 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-06T21:41:03.879 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-06T21:41:03.880 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-06T21:41:03.880 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:03.881 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-06T21:41:03.912 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-06T21:41:04.007 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:04.007 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-06T21:41:04.016 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-06T21:41:04.113 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-06T21:41:04.113 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-06T21:41:04.113 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249', 'branch': 'wip-rishabh-CephManager-in-CephFSTestCase', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': None, 'first_in_suite': False, 'job_id': '7328249', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-CephManager-in-CephFSTestCase'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-CephManager-in-CephFSTestCase', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-CephManager-in-CephFSTestCase', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_0a781ef0807ae9473fb1306ef07036226ca4f1a6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi055.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCGh6RzmvW0LNZxxY/5BzuRMJiLLWmj07AGtdHV8B7eE5bAoke+2j3Bce8/TNdZMEfA2Xm6EQ0h8YobfoKgHjRM=', 'smithi138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLHJXxRw1EQ6ZypCaOEujvNGKSNwsbniQv3/PY+e+Br1Cvwgg6EhYVUzQ2VCR2IMFNQRUOX1mXQ3CWsg+O/eF6g='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0a781ef0807ae9473fb1306ef07036226ca4f1a6'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b53f236c1077f1d295baafb9e0ca9a4b447019d7', 'timestamp': '2023-07-06_19:46:43', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-06T21:41:04.114 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-06T21:41:04.118 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-06T21:41:04.127 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/run/ceph 2023-07-06T21:41:04.167 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2023-07-06T21:41:04.194 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:04.194 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/scratch_devs of=/dev/stdout 2023-07-06T21:41:04.237 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-06T21:41:04.237 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_1 2023-07-06T21:41:04.290 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-06T21:41:04.290 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T21:41:04.290 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 881 Links: 1 2023-07-06T21:41:04.291 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T21:41:04.291 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-07-06 21:34:43.631265193 +0000 2023-07-06T21:41:04.291 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-07-06 21:34:43.231268761 +0000 2023-07-06T21:41:04.291 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-07-06 21:34:43.231268761 +0000 2023-07-06T21:41:04.291 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2023-07-06 21:34:43.231268761 +0000 2023-07-06T21:41:04.291 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-06T21:41:04.353 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-07-06T21:41:04.353 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-07-06T21:41:04.353 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000447756 s, 1.1 MB/s 2023-07-06T21:41:04.354 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-06T21:41:04.407 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_2 2023-07-06T21:41:04.457 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-06T21:41:04.458 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T21:41:04.458 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 896 Links: 1 2023-07-06T21:41:04.458 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T21:41:04.458 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-07-06 21:34:44.295259269 +0000 2023-07-06T21:41:04.458 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-07-06 21:34:43.895262838 +0000 2023-07-06T21:41:04.459 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-07-06 21:34:43.895262838 +0000 2023-07-06T21:41:04.459 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2023-07-06 21:34:43.895262838 +0000 2023-07-06T21:41:04.459 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-06T21:41:04.521 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-07-06T21:41:04.521 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-07-06T21:41:04.521 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000455576 s, 1.1 MB/s 2023-07-06T21:41:04.523 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-06T21:41:04.575 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_3 2023-07-06T21:41:04.626 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-06T21:41:04.626 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T21:41:04.626 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 914 Links: 1 2023-07-06T21:41:04.626 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T21:41:04.626 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-07-06 21:34:45.159251562 +0000 2023-07-06T21:41:04.627 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-07-06 21:34:44.567256843 +0000 2023-07-06T21:41:04.627 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-07-06 21:34:44.567256843 +0000 2023-07-06T21:41:04.627 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2023-07-06 21:34:44.567256843 +0000 2023-07-06T21:41:04.627 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-06T21:41:04.690 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-07-06T21:41:04.690 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-07-06T21:41:04.691 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000521086 s, 983 kB/s 2023-07-06T21:41:04.693 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-06T21:41:04.752 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_4 2023-07-06T21:41:04.802 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-06T21:41:04.802 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T21:41:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 930 Links: 1 2023-07-06T21:41:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T21:41:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-07-06 21:34:45.827245602 +0000 2023-07-06T21:41:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-07-06 21:34:45.423249207 +0000 2023-07-06T21:41:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-07-06 21:34:45.423249207 +0000 2023-07-06T21:41:04.803 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2023-07-06 21:34:45.423249207 +0000 2023-07-06T21:41:04.803 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-06T21:41:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-07-06T21:41:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-07-06T21:41:04.865 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000448256 s, 1.1 MB/s 2023-07-06T21:41:04.867 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-06T21:41:04.919 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T21:41:04.920 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:04.920 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2023-07-06T21:41:04.928 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-06T21:41:04.929 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2023-07-06T21:41:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-06T21:41:04.979 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T21:41:04.980 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 898 Links: 1 2023-07-06T21:41:04.980 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T21:41:04.980 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2023-07-06 21:34:41.510861757 +0000 2023-07-06T21:41:04.980 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2023-07-06 21:34:41.118865258 +0000 2023-07-06T21:41:04.980 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2023-07-06 21:34:41.118865258 +0000 2023-07-06T21:41:04.980 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2023-07-06 21:34:41.118865258 +0000 2023-07-06T21:41:04.981 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-06T21:41:05.042 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2023-07-06T21:41:05.042 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2023-07-06T21:41:05.042 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000411365 s, 1.2 MB/s 2023-07-06T21:41:05.044 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-06T21:41:05.097 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2023-07-06T21:41:05.151 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-06T21:41:05.151 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T21:41:05.151 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 913 Links: 1 2023-07-06T21:41:05.152 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T21:41:05.152 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2023-07-06 21:34:42.194855647 +0000 2023-07-06T21:41:05.152 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2023-07-06 21:34:41.778859363 +0000 2023-07-06T21:41:05.152 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2023-07-06 21:34:41.778859363 +0000 2023-07-06T21:41:05.152 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2023-07-06 21:34:41.778859363 +0000 2023-07-06T21:41:05.153 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-06T21:41:05.218 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2023-07-06T21:41:05.218 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2023-07-06T21:41:05.218 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000389277 s, 1.3 MB/s 2023-07-06T21:41:05.220 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-06T21:41:05.273 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2023-07-06T21:41:05.323 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-06T21:41:05.323 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T21:41:05.323 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 930 Links: 1 2023-07-06T21:41:05.323 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T21:41:05.323 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2023-07-06 21:34:42.898849358 +0000 2023-07-06T21:41:05.324 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2023-07-06 21:34:42.478853111 +0000 2023-07-06T21:41:05.324 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2023-07-06 21:34:42.478853111 +0000 2023-07-06T21:41:05.324 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2023-07-06 21:34:42.478853111 +0000 2023-07-06T21:41:05.324 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-06T21:41:05.385 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2023-07-06T21:41:05.386 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2023-07-06T21:41:05.386 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000654362 s, 782 kB/s 2023-07-06T21:41:05.387 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-06T21:41:05.442 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2023-07-06T21:41:05.491 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-06T21:41:05.491 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T21:41:05.492 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 950 Links: 1 2023-07-06T21:41:05.492 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T21:41:05.492 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2023-07-06 21:34:43.146847143 +0000 2023-07-06T21:41:05.492 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2023-07-06 21:34:43.142847180 +0000 2023-07-06T21:41:05.492 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2023-07-06 21:34:43.142847180 +0000 2023-07-06T21:41:05.492 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2023-07-06 21:34:43.142847180 +0000 2023-07-06T21:41:05.493 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-06T21:41:05.556 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2023-07-06T21:41:05.556 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2023-07-06T21:41:05.556 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.00063968 s, 800 kB/s 2023-07-06T21:41:05.556 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-06T21:41:05.609 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T21:41:05.609 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-06T21:41:05.609 INFO:tasks.ceph:Generating config... 2023-07-06T21:41:05.612 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-06T21:41:05.613 INFO:tasks.ceph:[client] debug client = 20 2023-07-06T21:41:05.613 INFO:tasks.ceph:[client] debug ms = 1 2023-07-06T21:41:05.614 INFO:tasks.ceph:[client] pid file = 2023-07-06T21:41:05.614 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-06T21:41:05.615 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-06T21:41:05.616 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-06T21:41:05.617 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-06T21:41:05.617 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-06T21:41:05.618 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-06T21:41:05.618 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-06T21:41:05.618 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-06T21:41:05.618 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-06T21:41:05.618 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-06T21:41:05.619 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-06T21:41:05.619 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-06T21:41:05.619 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-06T21:41:05.619 INFO:tasks.ceph:[mgr] debug client = 20 2023-07-06T21:41:05.619 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-07-06T21:41:05.620 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-06T21:41:05.620 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-06T21:41:05.620 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-06T21:41:05.620 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-06T21:41:05.620 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-06T21:41:05.621 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-06T21:41:05.621 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-06T21:41:05.621 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-06T21:41:05.621 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-07-06T21:41:05.621 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-07-06T21:41:05.622 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-06T21:41:05.622 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-06T21:41:05.622 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-07-06T21:41:05.622 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-06T21:41:05.622 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-06T21:41:05.623 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-06T21:41:05.623 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-06T21:41:05.623 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-06T21:41:05.624 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-06T21:41:05.624 INFO:tasks.ceph:Setting up mon.a... 2023-07-06T21:41:05.624 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-06T21:41:05.673 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.keyring 2023-07-06T21:41:05.687 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-06T21:41:05.737 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-06T21:41:05.805 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.55'), ('mon.b', '172.21.15.138'), ('mon.c', '[v2:172.21.15.138:3301,v1:172.21.15.138:6790]')] 2023-07-06T21:41:05.806 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.55,172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-06T21:41:05.807 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:05.807 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-06T21:41:05.857 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.55 --add b 172.21.15.138 --addv c '[v2:172.21.15.138:3301,v1:172.21.15.138:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-06T21:41:05.949 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-06T21:41:05.949 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: generated fsid c64f3ef1-e769-47b3-ae15-a714e4e7c4f7 2023-07-06T21:41:05.950 INFO:teuthology.orchestra.run.smithi055.stdout:setting min_mon_release = pacific 2023-07-06T21:41:05.950 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 0 2023-07-06T21:41:05.950 INFO:teuthology.orchestra.run.smithi055.stdout:fsid c64f3ef1-e769-47b3-ae15-a714e4e7c4f7 2023-07-06T21:41:05.950 INFO:teuthology.orchestra.run.smithi055.stdout:last_changed 2023-07-06T21:41:05.949613+0000 2023-07-06T21:41:05.950 INFO:teuthology.orchestra.run.smithi055.stdout:created 2023-07-06T21:41:05.949613+0000 2023-07-06T21:41:05.950 INFO:teuthology.orchestra.run.smithi055.stdout:min_mon_release 16 (pacific) 2023-07-06T21:41:05.950 INFO:teuthology.orchestra.run.smithi055.stdout:election_strategy: 1 2023-07-06T21:41:05.951 INFO:teuthology.orchestra.run.smithi055.stdout:0: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.a 2023-07-06T21:41:05.951 INFO:teuthology.orchestra.run.smithi055.stdout:1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.b 2023-07-06T21:41:05.951 INFO:teuthology.orchestra.run.smithi055.stdout:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2023-07-06T21:41:05.951 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-06T21:41:05.952 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-06T21:41:05.961 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c64f3ef1-e769-47b3-ae15-a714e4e7c4f7... 2023-07-06T21:41:05.962 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-06T21:41:06.007 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-06T21:41:06.050 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2023-07-06T21:41:06.051 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2023-07-06T21:41:06.051 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-06T21:41:06.051 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2023-07-06T21:41:06.051 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.051 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2023-07-06T21:41:06.052 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.052 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2023-07-06T21:41:06.052 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.052 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2023-07-06T21:41:06.052 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2023-07-06T21:41:06.052 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.053 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2023-07-06T21:41:06.053 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2023-07-06T21:41:06.053 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.053 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-06T21:41:06.054 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2023-07-06T21:41:06.054 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.054 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2023-07-06T21:41:06.054 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-06T21:41:06.055 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.055 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2023-07-06T21:41:06.055 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.055 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2023-07-06T21:41:06.056 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2023-07-06T21:41:06.056 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2023-07-06T21:41:06.056 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2023-07-06T21:41:06.056 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2023-07-06T21:41:06.056 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2023-07-06T21:41:06.056 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2023-07-06T21:41:06.056 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-06T21:41:06.057 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-06T21:41:06.057 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2023-07-06T21:41:06.057 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.057 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-06T21:41:06.057 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.058 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2023-07-06T21:41:06.058 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.058 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2023-07-06T21:41:06.058 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.058 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2023-07-06T21:41:06.058 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2023-07-06T21:41:06.059 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2023-07-06T21:41:06.059 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790]" 2023-07-06T21:41:06.059 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2023-07-06T21:41:06.059 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = c64f3ef1-e769-47b3-ae15-a714e4e7c4f7 2023-07-06T21:41:06.059 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.059 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2023-07-06T21:41:06.059 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2023-07-06T21:41:06.059 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.060 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2023-07-06T21:41:06.060 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2023-07-06T21:41:06.060 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2023-07-06T21:41:06.060 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.060 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2023-07-06T21:41:06.060 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2023-07-06T21:41:06.060 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.061 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2023-07-06T21:41:06.061 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2023-07-06T21:41:06.061 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2023-07-06T21:41:06.061 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.061 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2023-07-06T21:41:06.061 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2023-07-06T21:41:06.061 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.062 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2023-07-06T21:41:06.062 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.062 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2023-07-06T21:41:06.062 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.062 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2023-07-06T21:41:06.062 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.062 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2023-07-06T21:41:06.062 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2023-07-06T21:41:06.063 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.063 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2023-07-06T21:41:06.063 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2023-07-06T21:41:06.063 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2023-07-06T21:41:06.063 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2023-07-06T21:41:06.063 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 20 2023-07-06T21:41:06.063 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 20 2023-07-06T21:41:06.064 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-07-06T21:41:06.064 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2023-07-06T21:41:06.064 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 10 2023-07-06T21:41:06.064 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2023-07-06T21:41:06.064 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2023-07-06T21:41:06.064 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2023-07-06T21:41:06.065 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2023-07-06T21:41:06.065 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2023-07-06T21:41:06.065 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2023-07-06T21:41:06.065 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.065 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2023-07-06T21:41:06.066 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-07-06T21:41:06.066 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2023-07-06T21:41:06.066 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2023-07-06T21:41:06.066 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2023-07-06T21:41:06.066 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2023-07-06T21:41:06.067 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2023-07-06T21:41:06.067 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2023-07-06T21:41:06.067 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2023-07-06T21:41:06.068 INFO:teuthology.orchestra.run.smithi055.stdout: debug finisher = 20 2023-07-06T21:41:06.068 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.068 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2023-07-06T21:41:06.068 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-07-06T21:41:06.069 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2023-07-06T21:41:06.069 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2023-07-06T21:41:06.069 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2023-07-06T21:41:06.069 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2023-07-06T21:41:06.069 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2023-07-06T21:41:06.069 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2023-07-06T21:41:06.070 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2023-07-06T21:41:06.070 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2023-07-06T21:41:06.070 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2023-07-06T21:41:06.070 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.070 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-06T21:41:06.071 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2023-07-06T21:41:06.071 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2023-07-06T21:41:06.071 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.071 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2023-07-06T21:41:06.071 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-06T21:41:06.071 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-06T21:41:06.071 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.072 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2023-07-06T21:41:06.072 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2023-07-06T21:41:06.072 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.072 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2023-07-06T21:41:06.072 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2023-07-06T21:41:06.073 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:06.073 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2023-07-06T21:41:06.073 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2023-07-06T21:41:06.073 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2023-07-06T21:41:06.073 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2023-07-06T21:41:06.073 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-06T21:41:06.073 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-06T21:41:06.074 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2023-07-06T21:41:06.074 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2023-07-06T21:41:06.074 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-07-06T21:41:06.074 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2023-07-06T21:41:06.074 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2023-07-06T21:41:06.074 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2023-07-06T21:41:06.074 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2023-07-06T21:41:06.075 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2023-07-06T21:41:06.075 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2023-07-06T21:41:06.075 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2023-07-06T21:41:06.075 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2023-07-06T21:41:06.075 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2023-07-06T21:41:06.075 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2023-07-06T21:41:06.076 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2023-07-06T21:41:06.076 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2023-07-06T21:41:06.076 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2023-07-06T21:41:06.076 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-07-06T21:41:06.076 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2023-07-06T21:41:06.076 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2023-07-06T21:41:06.077 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2023-07-06T21:41:06.077 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2023-07-06T21:41:06.077 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2023-07-06T21:41:06.077 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2023-07-06T21:41:06.077 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2023-07-06T21:41:06.079 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2023-07-06T21:41:06.079 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2023-07-06T21:41:06.079 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-06T21:41:06.079 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2023-07-06T21:41:06.080 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.080 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2023-07-06T21:41:06.080 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.081 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2023-07-06T21:41:06.081 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.081 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2023-07-06T21:41:06.081 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2023-07-06T21:41:06.081 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.082 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2023-07-06T21:41:06.082 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2023-07-06T21:41:06.082 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.082 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-06T21:41:06.082 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2023-07-06T21:41:06.082 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.082 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2023-07-06T21:41:06.083 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-06T21:41:06.083 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.083 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2023-07-06T21:41:06.083 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.083 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2023-07-06T21:41:06.083 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2023-07-06T21:41:06.083 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2023-07-06T21:41:06.083 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2023-07-06T21:41:06.084 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2023-07-06T21:41:06.084 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2023-07-06T21:41:06.084 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2023-07-06T21:41:06.084 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-06T21:41:06.084 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-06T21:41:06.084 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2023-07-06T21:41:06.085 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.085 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-06T21:41:06.085 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.085 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2023-07-06T21:41:06.085 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.085 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2023-07-06T21:41:06.085 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.085 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2023-07-06T21:41:06.086 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2023-07-06T21:41:06.086 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2023-07-06T21:41:06.086 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = "172.21.15.55,172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790]" 2023-07-06T21:41:06.086 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on skipped message = False 2023-07-06T21:41:06.086 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = c64f3ef1-e769-47b3-ae15-a714e4e7c4f7 2023-07-06T21:41:06.086 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.086 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2023-07-06T21:41:06.086 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2023-07-06T21:41:06.087 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.087 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2023-07-06T21:41:06.087 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2023-07-06T21:41:06.087 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2023-07-06T21:41:06.087 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.087 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2023-07-06T21:41:06.088 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2023-07-06T21:41:06.088 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.088 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2023-07-06T21:41:06.088 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2023-07-06T21:41:06.088 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2023-07-06T21:41:06.088 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.089 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2023-07-06T21:41:06.089 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2023-07-06T21:41:06.089 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.089 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2023-07-06T21:41:06.089 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.089 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2023-07-06T21:41:06.089 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.089 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2023-07-06T21:41:06.090 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.090 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2023-07-06T21:41:06.090 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2023-07-06T21:41:06.090 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.090 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2023-07-06T21:41:06.090 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2023-07-06T21:41:06.090 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2023-07-06T21:41:06.090 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2023-07-06T21:41:06.091 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 20 2023-07-06T21:41:06.091 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 20 2023-07-06T21:41:06.091 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-07-06T21:41:06.091 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2023-07-06T21:41:06.091 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 10 2023-07-06T21:41:06.091 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2023-07-06T21:41:06.092 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2023-07-06T21:41:06.092 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2023-07-06T21:41:06.093 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2023-07-06T21:41:06.093 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2023-07-06T21:41:06.093 INFO:teuthology.orchestra.run.smithi138.stdout: osd op complaint time = 180 2023-07-06T21:41:06.093 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.094 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2023-07-06T21:41:06.094 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-07-06T21:41:06.094 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2023-07-06T21:41:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2023-07-06T21:41:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2023-07-06T21:41:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2023-07-06T21:41:06.095 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2023-07-06T21:41:06.096 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2023-07-06T21:41:06.096 INFO:teuthology.orchestra.run.smithi138.stdout: debug client = 20 2023-07-06T21:41:06.096 INFO:teuthology.orchestra.run.smithi138.stdout: debug finisher = 20 2023-07-06T21:41:06.096 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.096 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2023-07-06T21:41:06.096 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-07-06T21:41:06.096 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2023-07-06T21:41:06.097 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2023-07-06T21:41:06.097 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2023-07-06T21:41:06.097 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2023-07-06T21:41:06.097 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2023-07-06T21:41:06.097 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2023-07-06T21:41:06.097 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2023-07-06T21:41:06.098 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2023-07-06T21:41:06.098 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2023-07-06T21:41:06.098 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.098 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-06T21:41:06.098 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2023-07-06T21:41:06.099 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2023-07-06T21:41:06.099 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.099 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2023-07-06T21:41:06.099 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-06T21:41:06.099 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-06T21:41:06.099 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.099 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2023-07-06T21:41:06.100 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2023-07-06T21:41:06.100 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.100 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2023-07-06T21:41:06.100 INFO:teuthology.orchestra.run.smithi138.stdout: mon op complaint time = 120 2023-07-06T21:41:06.100 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-07-06T21:41:06.101 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2023-07-06T21:41:06.101 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2023-07-06T21:41:06.101 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2023-07-06T21:41:06.101 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2023-07-06T21:41:06.101 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-06T21:41:06.102 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-06T21:41:06.102 INFO:teuthology.orchestra.run.smithi138.stdout: client mount timeout = 600 2023-07-06T21:41:06.102 INFO:teuthology.orchestra.run.smithi138.stdout: debug client = 20 2023-07-06T21:41:06.102 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-07-06T21:41:06.102 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = "" 2023-07-06T21:41:06.103 INFO:teuthology.orchestra.run.smithi138.stdout: rados mon op timeout = 900 2023-07-06T21:41:06.103 INFO:teuthology.orchestra.run.smithi138.stdout: rados osd op timeout = 900 2023-07-06T21:41:06.103 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2023-07-06T21:41:06.103 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.b] 2023-07-06T21:41:06.103 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.c] 2023-07-06T21:41:06.103 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.a] 2023-07-06T21:41:06.104 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.c] 2023-07-06T21:41:06.104 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.b] 2023-07-06T21:41:06.104 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.d] 2023-07-06T21:41:06.104 INFO:teuthology.orchestra.run.smithi138.stdout:[mds] 2023-07-06T21:41:06.104 INFO:teuthology.orchestra.run.smithi138.stdout: debug mds = 20 2023-07-06T21:41:06.104 INFO:teuthology.orchestra.run.smithi138.stdout: debug mds balancer = 20 2023-07-06T21:41:06.104 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-07-06T21:41:06.105 INFO:teuthology.orchestra.run.smithi138.stdout: mds debug frag = True 2023-07-06T21:41:06.105 INFO:teuthology.orchestra.run.smithi138.stdout: mds debug scatterstat = True 2023-07-06T21:41:06.105 INFO:teuthology.orchestra.run.smithi138.stdout: mds op complaint time = 180 2023-07-06T21:41:06.105 INFO:teuthology.orchestra.run.smithi138.stdout: mds verify scatter = True 2023-07-06T21:41:06.105 INFO:teuthology.orchestra.run.smithi138.stdout: osd op complaint time = 180 2023-07-06T21:41:06.106 INFO:teuthology.orchestra.run.smithi138.stdout: rados mon op timeout = 900 2023-07-06T21:41:06.106 INFO:teuthology.orchestra.run.smithi138.stdout: rados osd op timeout = 900 2023-07-06T21:41:06.106 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-06T21:41:06.107 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-06T21:41:06.184 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-06T21:41:06.184 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:06.184 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-06T21:41:06.193 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:06.194 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-06T21:41:06.248 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T21:41:06.249 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:06.249 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-06T21:41:06.249 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-06T21:41:06.322 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:06.323 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-06T21:41:06.372 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2023-07-06T21:41:06.373 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:06.373 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-06T21:41:06.373 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-06T21:41:06.409 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:06.409 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-06T21:41:06.462 INFO:tasks.ceph:Setting up mon nodes... 2023-07-06T21:41:06.463 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-06T21:41:06.463 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-06T21:41:06.521 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-06T21:41:06.526 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-06T21:41:06.586 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-06T21:41:06.611 INFO:tasks.ceph:Setting up mds nodes... 2023-07-06T21:41:06.611 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-06T21:41:06.670 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-06T21:41:06.674 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-06T21:41:06.696 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-06T21:41:06.798 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-06T21:41:06.802 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-06T21:41:06.824 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-06T21:41:06.883 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-06T21:41:06.888 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-06T21:41:06.911 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-06T21:41:07.014 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-06T21:41:07.019 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-06T21:41:07.039 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-06T21:41:07.040 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-06T21:41:07.085 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-06T21:41:07.104 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-06T21:41:07.148 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-06T21:41:07.166 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-06T21:41:07.210 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-06T21:41:07.227 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-06T21:41:07.312 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-06T21:41:07.329 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-06T21:41:07.330 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-06T21:41:07.330 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-06T21:41:07.351 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T21:41:07.352 INFO:tasks.ceph:role: osd.0 2023-07-06T21:41:07.352 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T21:41:07.352 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-06T21:41:07.441 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T21:41:07.441 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T21:41:07.441 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T21:41:07.441 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T21:41:07.441 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T21:41:07.442 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2023-07-06T21:41:07.442 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T21:41:07.442 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T21:41:07.442 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T21:41:07.442 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T21:41:08.745 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2023-07-06T21:41:08.748 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2023-07-06T21:41:08.748 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-06T21:41:08.786 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-06T21:41:08.846 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: /sbin/restorecon: command not found 2023-07-06T21:41:08.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T21:41:08.848 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-06T21:41:08.910 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T21:41:08.911 INFO:tasks.ceph:role: osd.1 2023-07-06T21:41:08.911 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T21:41:08.911 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-06T21:41:09.002 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T21:41:09.003 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T21:41:09.003 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T21:41:09.003 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T21:41:09.003 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T21:41:09.003 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2023-07-06T21:41:09.003 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T21:41:09.003 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T21:41:09.004 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T21:41:09.004 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T21:41:10.303 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2023-07-06T21:41:10.307 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2023-07-06T21:41:10.308 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-06T21:41:10.345 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-06T21:41:10.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T21:41:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: /sbin/restorecon: command not found 2023-07-06T21:41:10.412 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-06T21:41:10.477 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T21:41:10.478 INFO:tasks.ceph:role: osd.2 2023-07-06T21:41:10.478 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T21:41:10.479 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-06T21:41:10.571 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T21:41:10.571 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T21:41:10.571 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T21:41:10.572 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T21:41:10.572 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T21:41:10.572 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2023-07-06T21:41:10.572 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T21:41:10.572 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T21:41:10.572 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T21:41:10.572 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T21:41:11.872 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2023-07-06T21:41:11.875 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2023-07-06T21:41:11.876 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-06T21:41:11.909 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-06T21:41:11.971 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: /sbin/restorecon: command not found 2023-07-06T21:41:11.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T21:41:11.972 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-06T21:41:12.039 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T21:41:12.039 INFO:tasks.ceph:role: osd.3 2023-07-06T21:41:12.039 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T21:41:12.040 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-06T21:41:12.132 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T21:41:12.133 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T21:41:12.133 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T21:41:12.133 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T21:41:12.133 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T21:41:12.133 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2023-07-06T21:41:12.133 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T21:41:12.133 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T21:41:12.134 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T21:41:12.134 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T21:41:13.437 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2023-07-06T21:41:13.440 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2023-07-06T21:41:13.440 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-06T21:41:13.473 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-06T21:41:13.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T21:41:13.536 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: /sbin/restorecon: command not found 2023-07-06T21:41:13.537 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T21:41:13.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:13.666+0000 7f63e4ce8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-06T21:41:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:13.666+0000 7f63e4ce8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-06T21:41:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:13.666+0000 7f63e4ce8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-06T21:41:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:13.666+0000 7f63e4ce8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-06T21:41:13.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:13.666+0000 7f63e4ce8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-06T21:41:13.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:13.670+0000 7f63e4ce8640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-06T21:41:16.673 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-06T21:41:16.696 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T21:41:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:16.794+0000 7fdcb3085640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-06T21:41:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:16.798+0000 7fdcb3085640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-06T21:41:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:16.798+0000 7fdcb3085640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-06T21:41:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:16.798+0000 7fdcb3085640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-06T21:41:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:16.798+0000 7fdcb3085640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-06T21:41:16.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:16.798+0000 7fdcb3085640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-06T21:41:19.831 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-06T21:41:19.853 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T21:41:19.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:19.950+0000 7fd51383d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-06T21:41:19.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:19.950+0000 7fd51383d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-06T21:41:19.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:19.950+0000 7fd51383d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-06T21:41:19.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:19.950+0000 7fd51383d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-06T21:41:19.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:19.950+0000 7fd51383d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-06T21:41:19.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:19.950+0000 7fd51383d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-06T21:41:22.943 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-06T21:41:22.967 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T21:41:23.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:23.066+0000 7f57c3095640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-06T21:41:23.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:23.070+0000 7f57c3095640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-06T21:41:23.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:23.070+0000 7f57c3095640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-06T21:41:23.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:23.070+0000 7f57c3095640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-06T21:41:23.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:23.070+0000 7f57c3095640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-06T21:41:23.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:23.070+0000 7f57c3095640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-06T21:41:26.067 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-06T21:41:26.090 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-06T21:41:26.113 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T21:41:26.114 INFO:tasks.ceph:role: osd.4 2023-07-06T21:41:26.114 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2023-07-06T21:41:26.114 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-06T21:41:26.184 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T21:41:26.185 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T21:41:26.185 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T21:41:26.185 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T21:41:26.185 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T21:41:26.185 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2023-07-06T21:41:26.185 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T21:41:26.185 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T21:41:26.186 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T21:41:26.186 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T21:41:26.653 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2023-07-06T21:41:26.658 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2023-07-06T21:41:26.658 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-06T21:41:26.767 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-06T21:41:26.785 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2023-07-06T21:41:26.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T21:41:26.786 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-06T21:41:26.852 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T21:41:26.852 INFO:tasks.ceph:role: osd.5 2023-07-06T21:41:26.852 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2023-07-06T21:41:26.853 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-06T21:41:26.924 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T21:41:26.924 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T21:41:26.924 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T21:41:26.924 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T21:41:26.924 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T21:41:26.925 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2023-07-06T21:41:26.925 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T21:41:26.925 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T21:41:26.925 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T21:41:26.925 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T21:41:27.415 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2023-07-06T21:41:27.418 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2023-07-06T21:41:27.418 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-06T21:41:27.543 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-06T21:41:27.562 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2023-07-06T21:41:27.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T21:41:27.564 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-06T21:41:27.628 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T21:41:27.628 INFO:tasks.ceph:role: osd.6 2023-07-06T21:41:27.629 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com 2023-07-06T21:41:27.629 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-06T21:41:27.698 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T21:41:27.699 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T21:41:27.699 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T21:41:27.699 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T21:41:27.699 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T21:41:27.699 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2023-07-06T21:41:27.699 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T21:41:27.700 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T21:41:27.700 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T21:41:27.700 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T21:41:28.186 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2023-07-06T21:41:28.189 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2023-07-06T21:41:28.189 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-06T21:41:28.309 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-06T21:41:28.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T21:41:28.330 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2023-07-06T21:41:28.331 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-06T21:41:28.399 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T21:41:28.399 INFO:tasks.ceph:role: osd.7 2023-07-06T21:41:28.400 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com 2023-07-06T21:41:28.400 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-06T21:41:28.471 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T21:41:28.471 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T21:41:28.471 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T21:41:28.471 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T21:41:28.472 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T21:41:28.472 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2023-07-06T21:41:28.472 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T21:41:28.472 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T21:41:28.472 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T21:41:28.472 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T21:41:28.926 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2023-07-06T21:41:28.929 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2023-07-06T21:41:28.930 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-06T21:41:29.038 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-06T21:41:29.055 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2023-07-06T21:41:29.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T21:41:29.057 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T21:41:29.181 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:29.180+0000 7f59da02b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-06T21:41:29.183 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:29.184+0000 7f59da02b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-06T21:41:29.183 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:29.184+0000 7f59da02b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-06T21:41:29.184 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:29.184+0000 7f59da02b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-06T21:41:29.184 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:29.184+0000 7f59da02b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-06T21:41:29.187 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:29.188+0000 7f59da02b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-06T21:41:32.178 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-06T21:41:32.199 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T21:41:32.296 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:32.296+0000 7f7f52edc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-06T21:41:32.297 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:32.296+0000 7f7f52edc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-06T21:41:32.297 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:32.296+0000 7f7f52edc640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-06T21:41:32.297 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:32.296+0000 7f7f52edc640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-06T21:41:32.298 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:32.296+0000 7f7f52edc640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-06T21:41:32.298 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:32.300+0000 7f7f52edc640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-06T21:41:34.116 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:41:34.120 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:41:35.297 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-06T21:41:35.318 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T21:41:35.416 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:35.416+0000 7f93c2e2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-06T21:41:35.417 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:35.416+0000 7f93c2e2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-06T21:41:35.417 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:35.416+0000 7f93c2e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-06T21:41:35.418 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:35.416+0000 7f93c2e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-06T21:41:35.418 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:35.416+0000 7f93c2e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-06T21:41:35.418 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:35.420+0000 7f93c2e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-06T21:41:38.400 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-06T21:41:38.420 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T21:41:38.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:38.520+0000 7f165d7fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-06T21:41:38.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:38.520+0000 7f165d7fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-06T21:41:38.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:38.520+0000 7f165d7fd640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-06T21:41:38.521 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:38.520+0000 7f165d7fd640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-06T21:41:38.521 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:38.520+0000 7f165d7fd640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-06T21:41:38.523 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:38.520+0000 7f165d7fd640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-06T21:41:41.496 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-06T21:41:41.517 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-06T21:41:41.517 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:41.518 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-06T21:41:41.542 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:41.542 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-06T21:41:41.610 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:41.610 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-06T21:41:41.677 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:41.678 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-06T21:41:41.741 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:41.741 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-06T21:41:41.805 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:41.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-06T21:41:41.869 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:41.870 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-06T21:41:41.933 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:41.934 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-06T21:41:41.955 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:41.955 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-06T21:41:42.023 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:42.023 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-06T21:41:42.090 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:42.090 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-06T21:41:42.158 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:42.158 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-06T21:41:42.220 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:42.220 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-06T21:41:42.286 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:42.286 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-06T21:41:42.346 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:42.346 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-06T21:41:42.355 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:42.356 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-06T21:41:42.409 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:42.409 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-06T21:41:42.417 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:42.418 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-06T21:41:42.465 INFO:tasks.ceph:Adding keys to all mons... 2023-07-06T21:41:42.466 DEBUG:teuthology.orchestra.run.smithi055:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-06T21:41:42.469 DEBUG:teuthology.orchestra.run.smithi138:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-06T21:41:42.509 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.y] 2023-07-06T21:41:42.510 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDyNKdkLH8aHxAAzzX5YxumCYWYqo0rQfFA9g== 2023-07-06T21:41:42.510 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2023-07-06T21:41:42.510 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDyNKdkWjb1JxAAMmLy+dPO5qyorBnuzazx6A== 2023-07-06T21:41:42.510 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2023-07-06T21:41:42.510 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDyNKdkvOSfLxAAMEoqAPg1pb47e5a1G1QtAw== 2023-07-06T21:41:42.511 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.0] 2023-07-06T21:41:42.511 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQD5NKdkSIfzJxAAlXiG8PWFXQqIeugbdp7Eiw== 2023-07-06T21:41:42.511 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.1] 2023-07-06T21:41:42.511 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQD8NKdkv2iwLxAAxjFucMwaaH66wPQpoYSTGw== 2023-07-06T21:41:42.511 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.2] 2023-07-06T21:41:42.511 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQD/NKdk5w7XOBAAuiup4mcC02ZMCPHCU1Cl3A== 2023-07-06T21:41:42.511 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.3] 2023-07-06T21:41:42.512 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQADNadksvRLBBAAE1YX9VgA8pWARIEZL8tbsQ== 2023-07-06T21:41:42.512 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.x] 2023-07-06T21:41:42.512 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDyNKdk+RUVIxAAyQpmGAeL8K+Cy+fgK5BmCQ== 2023-07-06T21:41:42.512 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2023-07-06T21:41:42.512 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDyNKdkpLLENBAAxMASh3qbELQMJ3XbPEX0Zw== 2023-07-06T21:41:42.512 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2023-07-06T21:41:42.512 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDzNKdkeQIBARAApXT5zWLUqqMSdwYygZeatw== 2023-07-06T21:41:42.513 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.4] 2023-07-06T21:41:42.513 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAJNadkn2HsChAAgwb7B9lHOMq2h0BNuhB/AQ== 2023-07-06T21:41:42.513 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.5] 2023-07-06T21:41:42.513 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAMNadkbonPERAA2PLg4NMr+4eW+FDAfPig1A== 2023-07-06T21:41:42.513 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.6] 2023-07-06T21:41:42.513 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAPNadkQw76GBAAY9SIgsTUHqvThwjdpjuwpw== 2023-07-06T21:41:42.513 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.7] 2023-07-06T21:41:42.514 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQASNadkr3gRHxAALbPUtIgImIK1UUoe6vcyjg== 2023-07-06T21:41:42.514 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-07-06T21:41:42.514 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDzNKdkaZgiBRAAvyBUd+qHLh/wwhgoE1MsVA== 2023-07-06T21:41:42.514 INFO:teuthology.orchestra.run.smithi055.stdout:[client.2] 2023-07-06T21:41:42.514 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDzNKdkgt/fCBAAlQY94DrR/nFTIVwSFCEToQ== 2023-07-06T21:41:42.514 INFO:teuthology.orchestra.run.smithi055.stdout:[client.1] 2023-07-06T21:41:42.514 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDzNKdkOBqoDBAASIhzvCqkSAFLX2oc99MYqw== 2023-07-06T21:41:42.514 INFO:teuthology.orchestra.run.smithi055.stdout:[client.3] 2023-07-06T21:41:42.515 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDzNKdkd5zAEhAAU0Qo6NROIKRSlOncFUoTxQ== 2023-07-06T21:41:42.524 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.y] 2023-07-06T21:41:42.524 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDyNKdkLH8aHxAAzzX5YxumCYWYqo0rQfFA9g== 2023-07-06T21:41:42.524 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.a] 2023-07-06T21:41:42.525 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDyNKdkWjb1JxAAMmLy+dPO5qyorBnuzazx6A== 2023-07-06T21:41:42.525 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.c] 2023-07-06T21:41:42.525 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDyNKdkvOSfLxAAMEoqAPg1pb47e5a1G1QtAw== 2023-07-06T21:41:42.525 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.0] 2023-07-06T21:41:42.525 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQD5NKdkSIfzJxAAlXiG8PWFXQqIeugbdp7Eiw== 2023-07-06T21:41:42.525 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.1] 2023-07-06T21:41:42.525 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQD8NKdkv2iwLxAAxjFucMwaaH66wPQpoYSTGw== 2023-07-06T21:41:42.526 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.2] 2023-07-06T21:41:42.526 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQD/NKdk5w7XOBAAuiup4mcC02ZMCPHCU1Cl3A== 2023-07-06T21:41:42.526 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.3] 2023-07-06T21:41:42.526 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQADNadksvRLBBAAE1YX9VgA8pWARIEZL8tbsQ== 2023-07-06T21:41:42.526 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.x] 2023-07-06T21:41:42.526 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDyNKdk+RUVIxAAyQpmGAeL8K+Cy+fgK5BmCQ== 2023-07-06T21:41:42.526 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.b] 2023-07-06T21:41:42.527 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDyNKdkpLLENBAAxMASh3qbELQMJ3XbPEX0Zw== 2023-07-06T21:41:42.527 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.d] 2023-07-06T21:41:42.527 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDzNKdkeQIBARAApXT5zWLUqqMSdwYygZeatw== 2023-07-06T21:41:42.527 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.4] 2023-07-06T21:41:42.527 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAJNadkn2HsChAAgwb7B9lHOMq2h0BNuhB/AQ== 2023-07-06T21:41:42.527 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.5] 2023-07-06T21:41:42.527 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAMNadkbonPERAA2PLg4NMr+4eW+FDAfPig1A== 2023-07-06T21:41:42.528 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.6] 2023-07-06T21:41:42.528 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAPNadkQw76GBAAY9SIgsTUHqvThwjdpjuwpw== 2023-07-06T21:41:42.528 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.7] 2023-07-06T21:41:42.528 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQASNadkr3gRHxAALbPUtIgImIK1UUoe6vcyjg== 2023-07-06T21:41:42.528 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2023-07-06T21:41:42.528 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDzNKdkaZgiBRAAvyBUd+qHLh/wwhgoE1MsVA== 2023-07-06T21:41:42.528 INFO:teuthology.orchestra.run.smithi138.stdout:[client.2] 2023-07-06T21:41:42.529 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDzNKdkgt/fCBAAlQY94DrR/nFTIVwSFCEToQ== 2023-07-06T21:41:42.529 INFO:teuthology.orchestra.run.smithi138.stdout:[client.1] 2023-07-06T21:41:42.529 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDzNKdkOBqoDBAASIhzvCqkSAFLX2oc99MYqw== 2023-07-06T21:41:42.529 INFO:teuthology.orchestra.run.smithi138.stdout:[client.3] 2023-07-06T21:41:42.529 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDzNKdkd5zAEhAAU0Qo6NROIKRSlOncFUoTxQ== 2023-07-06T21:41:42.530 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-06T21:41:42.559 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-06T21:41:42.629 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T21:41:42.632 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T21:41:42.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T21:41:42.694 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T21:41:42.750 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:42.755 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:42.809 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:42.813 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:42.867 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:42.871 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:42.926 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:42.930 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:42.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-06T21:41:42.989 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-06T21:41:43.043 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T21:41:43.047 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T21:41:43.104 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T21:41:43.107 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T21:41:43.164 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:43.167 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:43.221 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:43.225 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:43.279 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:43.282 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:43.336 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:43.340 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T21:41:43.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T21:41:43.399 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T21:41:43.456 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T21:41:43.460 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T21:41:43.516 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T21:41:43.520 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T21:41:43.577 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T21:41:43.580 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T21:41:43.637 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-06T21:41:43.637 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-06T21:41:43.658 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-06T21:41:43.776 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-06T21:41:43.797 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-06T21:41:43.817 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-06T21:41:43.930 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-06T21:41:43.950 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-06T21:41:44.013 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-06T21:41:44.127 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-06T21:41:44.148 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-06T21:41:44.151 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-06T21:41:44.202 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-06T21:41:44.203 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-06T21:41:44.204 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-06T21:41:44.208 INFO:tasks.ceph.mon.a:Started 2023-07-06T21:41:44.208 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-06T21:41:44.208 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-06T21:41:44.245 INFO:tasks.ceph.mon.b:Started 2023-07-06T21:41:44.245 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-06T21:41:44.245 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-06T21:41:44.248 INFO:tasks.ceph.mon.c:Started 2023-07-06T21:41:44.249 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-06T21:41:44.249 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-06T21:41:44.250 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-06T21:41:44.254 INFO:tasks.ceph.mgr.y:Started 2023-07-06T21:41:44.254 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-06T21:41:44.254 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-06T21:41:44.257 INFO:tasks.ceph.mgr.x:Started 2023-07-06T21:41:44.258 INFO:tasks.ceph:Setting crush tunables to default 2023-07-06T21:41:44.258 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd crush tunables default 2023-07-06T21:41:44.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84c246d640 1 Processor -- start 2023-07-06T21:41:44.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84c246d640 1 -- start start 2023-07-06T21:41:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84c246d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0cc6e0 0x7f84bc0b3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84c246d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f84bc0b3e50 0x7f84bc0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84c246d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc0b2490 con 0x7f84bc0b76c0 2023-07-06T21:41:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84c246d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0b4290 con 0x7f84bc0b3e50 2023-07-06T21:41:44.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84c246d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0ce9d0 con 0x7f84bc0cc6e0 2023-07-06T21:41:44.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84bbfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f84bc0b76c0 0x7f84bc0ce2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55224/0 (socket says 172.21.15.55:55224) 2023-07-06T21:41:44.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84bbfff640 1 -- 172.21.15.55:0/2029114827 learned_addr learned my addr 172.21.15.55:0/2029114827 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:41:44.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84c0a0a640 1 --2- 172.21.15.55:0/2029114827 >> v2:172.21.15.138:3300/0 conn(0x7f84bc0b3e50 0x7f84bc0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:44.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84c0a0a640 1 -- 172.21.15.55:0/2029114827 >> v2:172.21.15.138:3300/0 conn(0x7f84bc0b3e50 msgr2=0x7f84bc0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-06T21:41:44.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84c0a0a640 1 -- 172.21.15.55:0/2029114827 >> v2:172.21.15.138:3300/0 conn(0x7f84bc0b3e50 msgr2=0x7f84bc0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-06T21:41:44.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84c0a0a640 1 --2- 172.21.15.55:0/2029114827 >> v2:172.21.15.138:3300/0 conn(0x7f84bc0b3e50 0x7f84bc0d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-06T21:41:44.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84bb7fe640 1 --2- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0cc6e0 0x7f84bc0b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:44.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84c0a0a640 1 --2- 172.21.15.55:0/2029114827 >> v2:172.21.15.138:3300/0 conn(0x7f84bc0b3e50 0x7f84bc0d0020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:41:44.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84bb7fe640 1 -- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0cc6e0 msgr2=0x7f84bc0b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-06T21:41:44.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84bb7fe640 1 -- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0cc6e0 msgr2=0x7f84bc0b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-06T21:41:44.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84bb7fe640 1 --2- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0cc6e0 0x7f84bc0b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-06T21:41:44.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.398+0000 7f84bb7fe640 1 --2- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0cc6e0 0x7f84bc0b3910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:41:44.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.590+0000 7f84baffd640 1 -- 172.21.15.55:0/2029114827 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361550094 0 0) 0x7f84bc0b2490 con 0x7f84bc0b76c0 2023-07-06T21:41:44.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.590+0000 7f84baffd640 1 -- 172.21.15.55:0/2029114827 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84a4003530 con 0x7f84bc0b76c0 2023-07-06T21:41:44.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84baffd640 1 -- 172.21.15.55:0/2029114827 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3025197714 0 0) 0x7f84a4003530 con 0x7f84bc0b76c0 2023-07-06T21:41:44.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84baffd640 1 -- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0cc6e0 msgr2=0x7f84bc0b3910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T21:41:44.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84baffd640 1 --2- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0cc6e0 0x7f84bc0b3910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:44.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84baffd640 1 -- 172.21.15.55:0/2029114827 >> v2:172.21.15.138:3300/0 conn(0x7f84bc0b3e50 msgr2=0x7f84bc0d0020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T21:41:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84baffd640 1 --2- 172.21.15.55:0/2029114827 >> v2:172.21.15.138:3300/0 conn(0x7f84bc0b3e50 0x7f84bc0d0020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84baffd640 1 -- 172.21.15.55:0/2029114827 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0ccbe0 con 0x7f84bc0b76c0 2023-07-06T21:41:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84baffd640 1 -- 172.21.15.55:0/2029114827 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f84ac001680 con 0x7f84bc0b76c0 2023-07-06T21:41:44.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84baffd640 1 -- 172.21.15.55:0/2029114827 >> v1:172.21.15.55:6789/0 conn(0x7f84bc0b76c0 legacy=0x7f84bc0ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:44.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84baffd640 1 --2- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0cc6e0 0x7f84a4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:44.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84baffd640 1 --2- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84a4003fb0 0x7f84a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:44.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84baffd640 1 --2- 172.21.15.55:0/2029114827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84a4004d10 0x7f84a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:44.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84baffd640 1 -- 172.21.15.55:0/2029114827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0b4290 con 0x7f84a4004d10 2023-07-06T21:41:44.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84baffd640 1 -- 172.21.15.55:0/2029114827 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0ce9d0 con 0x7f84a4003fb0 2023-07-06T21:41:44.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84baffd640 1 -- 172.21.15.55:0/2029114827 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a400bb20 con 0x7f84bc0cc6e0 2023-07-06T21:41:44.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84bb7fe640 1 --2- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84a4003fb0 0x7f84a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:44.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84c0a0a640 1 --2- 172.21.15.55:0/2029114827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84a4004d10 0x7f84a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:44.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84bbfff640 1 --2- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0cc6e0 0x7f84a4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:44.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84bb7fe640 1 -- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0cc6e0 msgr2=0x7f84a4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:41:44.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84bb7fe640 1 --2- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0cc6e0 0x7f84a4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:44.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84bb7fe640 1 -- 172.21.15.55:0/2029114827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84a4004d10 msgr2=0x7f84a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:41:44.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84bb7fe640 1 --2- 172.21.15.55:0/2029114827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84a4004d10 0x7f84a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:44.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.594+0000 7f84bb7fe640 1 -- 172.21.15.55:0/2029114827 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a4003530 con 0x7f84a4003fb0 2023-07-06T21:41:44.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.598+0000 7f84bb7fe640 1 --2- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84a4003fb0 0x7f84a40047d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f84b0000ee0 tx=0x7f84b001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62384a62b25794f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:44.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.598+0000 7f84baffd640 1 -- 172.21.15.55:0/2029114827 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b00ab610 con 0x7f84a4003fb0 2023-07-06T21:41:44.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.598+0000 7f84baffd640 1 -- 172.21.15.55:0/2029114827 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b00ab770 con 0x7f84a4003fb0 2023-07-06T21:41:44.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.598+0000 7f84baffd640 1 -- 172.21.15.55:0/2029114827 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b00abb20 con 0x7f84a4003fb0 2023-07-06T21:41:44.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.598+0000 7f84c246d640 1 -- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84a4003fb0 msgr2=0x7f84a40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:44.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.598+0000 7f84c246d640 1 --2- 172.21.15.55:0/2029114827 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84a4003fb0 0x7f84a40047d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f84b0000ee0 tx=0x7f84b001c4d0 comp rx=0 tx=0).stop 2023-07-06T21:41:44.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.598+0000 7f84c0a0a640 1 -- 172.21.15.55:0/2029114827 reap_dead start 2023-07-06T21:41:44.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.598+0000 7f84c246d640 1 -- 172.21.15.55:0/2029114827 shutdown_connections 2023-07-06T21:41:44.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.598+0000 7f84c246d640 1 -- 172.21.15.55:0/2029114827 >> 172.21.15.55:0/2029114827 conn(0x7f84bc0d2120 msgr2=0x7f84bc0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:44.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.598+0000 7f84c246d640 1 -- 172.21.15.55:0/2029114827 shutdown_connections 2023-07-06T21:41:44.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.598+0000 7f84c246d640 1 -- 172.21.15.55:0/2029114827 wait complete. 2023-07-06T21:41:44.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84c246d640 1 Processor -- start 2023-07-06T21:41:44.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84c246d640 1 -- start start 2023-07-06T21:41:44.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84c246d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84a4003fb0 0x7f84bc15e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:44.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84c246d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0c81f0 0x7f84bc157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:44.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84c246d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc1584d0 0x7f84bc1f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:44.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84c246d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc158940 con 0x7f84bc1584d0 2023-07-06T21:41:44.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84c246d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc14fed0 con 0x7f84a4003fb0 2023-07-06T21:41:44.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84c246d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0c8660 con 0x7f84bc0c81f0 2023-07-06T21:41:44.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84c0a0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc1584d0 0x7f84bc1f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:44.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84bbfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84a4003fb0 0x7f84bc15e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:44.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84bbfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84a4003fb0 0x7f84bc15e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:56826/0 (socket says 172.21.15.55:56826) 2023-07-06T21:41:44.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84bbfff640 1 -- 172.21.15.55:0/771458038 learned_addr learned my addr 172.21.15.55:0/771458038 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:41:44.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84bb7fe640 1 --2- 172.21.15.55:0/771458038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0c81f0 0x7f84bc157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:44.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84bbfff640 1 -- 172.21.15.55:0/771458038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0c81f0 msgr2=0x7f84bc157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:44.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84bbfff640 1 --2- 172.21.15.55:0/771458038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0c81f0 0x7f84bc157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:44.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84bbfff640 1 -- 172.21.15.55:0/771458038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc1584d0 msgr2=0x7f84bc1f0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:44.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84bbfff640 1 --2- 172.21.15.55:0/771458038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc1584d0 0x7f84bc1f0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:44.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84bbfff640 1 -- 172.21.15.55:0/771458038 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0c7150 con 0x7f84a4003fb0 2023-07-06T21:41:44.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.602+0000 7f84c0a0a640 1 --2- 172.21.15.55:0/771458038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc1584d0 0x7f84bc1f0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:41:44.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.606+0000 7f84bbfff640 1 --2- 172.21.15.55:0/771458038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84a4003fb0 0x7f84bc15e680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f84ac011900 tx=0x7f84ac011dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:44.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.606+0000 7f84b8ff9640 1 -- 172.21.15.55:0/771458038 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac001bd0 con 0x7f84a4003fb0 2023-07-06T21:41:44.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.606+0000 7f84b8ff9640 1 -- 172.21.15.55:0/771458038 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac00fb20 con 0x7f84a4003fb0 2023-07-06T21:41:44.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.606+0000 7f84b8ff9640 1 -- 172.21.15.55:0/771458038 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac00fed0 con 0x7f84a4003fb0 2023-07-06T21:41:44.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.606+0000 7f84c246d640 1 -- 172.21.15.55:0/771458038 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc0c7430 con 0x7f84a4003fb0 2023-07-06T21:41:44.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.606+0000 7f84c246d640 1 -- 172.21.15.55:0/771458038 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc0c79f0 con 0x7f84a4003fb0 2023-07-06T21:41:44.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.606+0000 7f84b8ff9640 1 -- 172.21.15.55:0/771458038 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f84ac01f460 con 0x7f84a4003fb0 2023-07-06T21:41:44.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.606+0000 7f84b8ff9640 1 -- 172.21.15.55:0/771458038 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f84ac015670 con 0x7f84a4003fb0 2023-07-06T21:41:44.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.606+0000 7f84c246d640 1 -- 172.21.15.55:0/771458038 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc04d790 con 0x7f84a4003fb0 2023-07-06T21:41:44.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.618+0000 7f84b8ff9640 1 -- 172.21.15.55:0/771458038 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f84ac010040 con 0x7f84a4003fb0 2023-07-06T21:41:44.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.706+0000 7f84c246d640 1 -- 172.21.15.55:0/771458038 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f84bc0b4520 con 0x7f84a4003fb0 2023-07-06T21:41:44.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.714+0000 7f84b8ff9640 1 -- 172.21.15.55:0/771458038 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f84ac01f8a0 con 0x7f84a4003fb0 2023-07-06T21:41:44.719 INFO:teuthology.orchestra.run.smithi055.stderr:adjusted tunables profile to default 2023-07-06T21:41:44.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.714+0000 7f84c246d640 1 -- 172.21.15.55:0/771458038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84a4003fb0 msgr2=0x7f84bc15e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:44.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.714+0000 7f84c246d640 1 --2- 172.21.15.55:0/771458038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84a4003fb0 0x7f84bc15e680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f84ac011900 tx=0x7f84ac011dc0 comp rx=0 tx=0).stop 2023-07-06T21:41:44.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.714+0000 7f84c246d640 1 -- 172.21.15.55:0/771458038 shutdown_connections 2023-07-06T21:41:44.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.714+0000 7f84c246d640 1 --2- 172.21.15.55:0/771458038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc1584d0 0x7f84bc1f0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:44.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.714+0000 7f84c246d640 1 --2- 172.21.15.55:0/771458038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84bc0c81f0 0x7f84bc157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:44.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.714+0000 7f84c246d640 1 --2- 172.21.15.55:0/771458038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84a4003fb0 0x7f84bc15e680 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:44.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.714+0000 7f84c246d640 1 -- 172.21.15.55:0/771458038 >> 172.21.15.55:0/771458038 conn(0x7f84bc0d2120 msgr2=0x7f84bc0694f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:44.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.718+0000 7f84c246d640 1 -- 172.21.15.55:0/771458038 shutdown_connections 2023-07-06T21:41:44.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:44.718+0000 7f84c246d640 1 -- 172.21.15.55:0/771458038 wait complete. 2023-07-06T21:41:44.748 INFO:tasks.ceph:check_enable_crimson: False 2023-07-06T21:41:44.748 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-06T21:41:44.749 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:44.749 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-06T21:41:44.770 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:44.770 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-06T21:41:44.821 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:44.818+0000 7f947aa46180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:41:44.833 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:44.833 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-06T21:41:44.897 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:41:44.897 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-06T21:41:44.960 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:44.961 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-06T21:41:44.981 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:44.982 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-06T21:41:45.047 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:45.047 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-06T21:41:45.110 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:41:45.110 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-06T21:41:45.170 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new f52bc3c8-676c-4db2-a570-b168fb976d30 0 2023-07-06T21:41:45.199 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:45.200+0000 7f3582ad9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:41:45.335 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f24865c5640 1 Processor -- start 2023-07-06T21:41:45.335 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f24865c5640 1 -- start start 2023-07-06T21:41:45.337 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f24865c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f248015b850 0x7f24800cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.337 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f24865c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24800b3f80 0x7f24800d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.337 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f24865c5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24800b2b80 con 0x7f24800ccd30 2023-07-06T21:41:45.337 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f24865c5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24800cff30 con 0x7f24800b3f80 2023-07-06T21:41:45.338 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f24865c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24800b22e0 con 0x7f248015b850 2023-07-06T21:41:45.338 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f247ffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f248015b850 0x7f24800cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.338 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f247ffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f248015b850 0x7f24800cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:42410/0 (socket says 172.21.15.138:42410) 2023-07-06T21:41:45.338 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f247ffff640 1 -- 172.21.15.138:0/2638410231 learned_addr learned my addr 172.21.15.138:0/2638410231 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-07-06T21:41:45.338 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f2484b62640 1 --2- 172.21.15.138:0/2638410231 >> v2:172.21.15.55:3300/0 conn(0x7f24800b3f80 0x7f24800d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.338 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f247ffff640 1 -- 172.21.15.138:0/2638410231 >> v2:172.21.15.55:3300/0 conn(0x7f24800b3f80 msgr2=0x7f24800d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:41:45.338 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f247ffff640 1 --2- 172.21.15.138:0/2638410231 >> v2:172.21.15.55:3300/0 conn(0x7f24800b3f80 0x7f24800d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.339 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f247ffff640 1 -- 172.21.15.138:0/2638410231 >> v1:172.21.15.55:6789/0 conn(0x7f24800ccd30 legacy=0x7f24800b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:45.339 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.336+0000 7f247ffff640 1 -- 172.21.15.138:0/2638410231 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24800b25c0 con 0x7f248015b850 2023-07-06T21:41:45.340 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.340+0000 7f247ffff640 1 --2- 172.21.15.138:0/2638410231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f248015b850 0x7f24800cc7f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2470009870 tx=0x7f247001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68040fe1a54eae9f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:45.341 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.340+0000 7f247effd640 1 -- 172.21.15.138:0/2638410231 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24700ad680 con 0x7f248015b850 2023-07-06T21:41:45.341 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.340+0000 7f247effd640 1 -- 172.21.15.138:0/2638410231 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24700ad7e0 con 0x7f248015b850 2023-07-06T21:41:45.342 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.340+0000 7f247effd640 1 -- 172.21.15.138:0/2638410231 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24700adb70 con 0x7f248015b850 2023-07-06T21:41:45.342 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.340+0000 7f24865c5640 1 -- 172.21.15.138:0/2638410231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f248015b850 msgr2=0x7f24800cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:45.342 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.340+0000 7f24865c5640 1 --2- 172.21.15.138:0/2638410231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f248015b850 0x7f24800cc7f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2470009870 tx=0x7f247001c3f0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.342 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.340+0000 7f24865c5640 1 -- 172.21.15.138:0/2638410231 shutdown_connections 2023-07-06T21:41:45.342 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.340+0000 7f24865c5640 1 --2- 172.21.15.138:0/2638410231 >> v2:172.21.15.55:3300/0 conn(0x7f24800b3f80 0x7f24800d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.342 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.340+0000 7f24865c5640 1 --2- 172.21.15.138:0/2638410231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f248015b850 0x7f24800cc7f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.342 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.340+0000 7f24865c5640 1 -- 172.21.15.138:0/2638410231 >> 172.21.15.138:0/2638410231 conn(0x7f24800cec20 msgr2=0x7f24800cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.340+0000 7f24865c5640 1 -- 172.21.15.138:0/2638410231 shutdown_connections 2023-07-06T21:41:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.340+0000 7f24865c5640 1 -- 172.21.15.138:0/2638410231 wait complete. 2023-07-06T21:41:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f24865c5640 1 Processor -- start 2023-07-06T21:41:45.343 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f24865c5640 1 -- start start 2023-07-06T21:41:45.344 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f24865c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24800b3f80 0x7f248015a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f24865c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24800ccd30 0x7f24801435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f24865c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f248015b850 0x7f24800c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f24865c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24800c97b0 con 0x7f24800ccd30 2023-07-06T21:41:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f24865c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24800c9a30 con 0x7f24800b3f80 2023-07-06T21:41:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f24865c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24800c9d10 con 0x7f248015b850 2023-07-06T21:41:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f247ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24800b3f80 0x7f248015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f2484b62640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f248015b850 0x7f24800c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.346 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f2484b62640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f248015b850 0x7f24800c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:42412/0 (socket says 172.21.15.138:42412) 2023-07-06T21:41:45.346 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f2484b62640 1 -- 172.21.15.138:0/785481887 learned_addr learned my addr 172.21.15.138:0/785481887 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-07-06T21:41:45.346 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f247f7fe640 1 --2- 172.21.15.138:0/785481887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24800ccd30 0x7f24801435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.347 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f247ffff640 1 -- 172.21.15.138:0/785481887 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f248015b850 msgr2=0x7f24800c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:45.347 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f247ffff640 1 --2- 172.21.15.138:0/785481887 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f248015b850 0x7f24800c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.347 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f247ffff640 1 -- 172.21.15.138:0/785481887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24800ccd30 msgr2=0x7f24801435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f247ffff640 1 --2- 172.21.15.138:0/785481887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24800ccd30 0x7f24801435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f247ffff640 1 -- 172.21.15.138:0/785481887 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24700094d0 con 0x7f24800b3f80 2023-07-06T21:41:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f2484b62640 1 --2- 172.21.15.138:0/785481887 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f248015b850 0x7f24800c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:41:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f247ffff640 1 --2- 172.21.15.138:0/785481887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24800b3f80 0x7f248015a300 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f24700ac000 tx=0x7f2470019190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f247cff9640 1 -- 172.21.15.138:0/785481887 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24700add60 con 0x7f24800b3f80 2023-07-06T21:41:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f247cff9640 1 -- 172.21.15.138:0/785481887 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24700b6460 con 0x7f24800b3f80 2023-07-06T21:41:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f247cff9640 1 -- 172.21.15.138:0/785481887 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24700b6810 con 0x7f24800b3f80 2023-07-06T21:41:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f24865c5640 1 -- 172.21.15.138:0/785481887 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248015bda0 con 0x7f24800b3f80 2023-07-06T21:41:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f24865c5640 1 -- 172.21.15.138:0/785481887 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24800ca2d0 con 0x7f24800b3f80 2023-07-06T21:41:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f247cff9640 1 -- 172.21.15.138:0/785481887 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f24700b4070 con 0x7f24800b3f80 2023-07-06T21:41:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.344+0000 7f247cff9640 1 -- 172.21.15.138:0/785481887 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f24700b8c10 con 0x7f24800b3f80 2023-07-06T21:41:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.348+0000 7f24865c5640 1 -- 172.21.15.138:0/785481887 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2480066d60 con 0x7f24800b3f80 2023-07-06T21:41:45.350 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.348+0000 7f247cff9640 1 -- 172.21.15.138:0/785481887 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f24700b2070 con 0x7f24800b3f80 2023-07-06T21:41:45.386 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:45.382+0000 7f947aa46180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:41:45.415 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.416+0000 7f24865c5640 1 -- 172.21.15.138:0/785481887 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f52bc3c8-676c-4db2-a570-b168fb976d30", "id": 0} v 0) v1 -- 0x7f24800b3420 con 0x7f24800b3f80 2023-07-06T21:41:45.423 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.424+0000 7f247cff9640 1 -- 172.21.15.138:0/785481887 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f52bc3c8-676c-4db2-a570-b168fb976d30", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f24700b8430 con 0x7f24800b3f80 2023-07-06T21:41:45.423 INFO:teuthology.orchestra.run.smithi138.stdout:0 2023-07-06T21:41:45.424 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.424+0000 7f24865c5640 1 -- 172.21.15.138:0/785481887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24800b3f80 msgr2=0x7f248015a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:45.424 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.424+0000 7f24865c5640 1 --2- 172.21.15.138:0/785481887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24800b3f80 0x7f248015a300 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f24700ac000 tx=0x7f2470019190 comp rx=0 tx=0).stop 2023-07-06T21:41:45.424 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.424+0000 7f24865c5640 1 -- 172.21.15.138:0/785481887 shutdown_connections 2023-07-06T21:41:45.424 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.424+0000 7f24865c5640 1 --2- 172.21.15.138:0/785481887 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f248015b850 0x7f24800c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.425 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.424+0000 7f24865c5640 1 --2- 172.21.15.138:0/785481887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24800ccd30 0x7f24801435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.425 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.424+0000 7f24865c5640 1 --2- 172.21.15.138:0/785481887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24800b3f80 0x7f248015a300 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.425 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.424+0000 7f24865c5640 1 -- 172.21.15.138:0/785481887 >> 172.21.15.138:0/785481887 conn(0x7f24800cec20 msgr2=0x7f24800b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:45.425 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.424+0000 7f24865c5640 1 -- 172.21.15.138:0/785481887 shutdown_connections 2023-07-06T21:41:45.425 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.424+0000 7f24865c5640 1 -- 172.21.15.138:0/785481887 wait complete. 2023-07-06T21:41:45.443 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 56a9f777-b856-4820-af52-809cbee7ba1f 1 2023-07-06T21:41:45.580 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb715f37640 1 Processor -- start 2023-07-06T21:41:45.581 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb715f37640 1 -- start start 2023-07-06T21:41:45.582 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb715f37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7100b3cc0 0x7fb7100b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.582 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb715f37640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb7100d0020 0x7fb7100d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.583 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb715f37640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7100693f0 con 0x7fb710159960 2023-07-06T21:41:45.583 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb715f37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb710159d30 con 0x7fb7100b3cc0 2023-07-06T21:41:45.583 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb715f37640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7100b4670 con 0x7fb7100d0020 2023-07-06T21:41:45.583 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb70f7fe640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fb710159960 0x7fb7100cc890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:41256/0 (socket says 172.21.15.138:41256) 2023-07-06T21:41:45.584 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb70f7fe640 1 -- 172.21.15.138:0/2709052186 learned_addr learned my addr 172.21.15.138:0/2709052186 (peer_addr_for_me v1:172.21.15.138:0/0) 2023-07-06T21:41:45.584 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb70ffff640 1 --2- 172.21.15.138:0/2709052186 >> v2:172.21.15.138:3300/0 conn(0x7fb7100d0020 0x7fb7100d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.584 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb70effd640 1 --2- 172.21.15.138:0/2709052186 >> v2:172.21.15.55:3300/0 conn(0x7fb7100b3cc0 0x7fb7100b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.584 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb70ffff640 1 -- 172.21.15.138:0/2709052186 >> v2:172.21.15.55:3300/0 conn(0x7fb7100b3cc0 msgr2=0x7fb7100b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:41:45.585 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb70ffff640 1 --2- 172.21.15.138:0/2709052186 >> v2:172.21.15.55:3300/0 conn(0x7fb7100b3cc0 0x7fb7100b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.585 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb70ffff640 1 -- 172.21.15.138:0/2709052186 >> v1:172.21.15.138:6789/0 conn(0x7fb710159960 legacy=0x7fb7100cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:45.585 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb70ffff640 1 -- 172.21.15.138:0/2709052186 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710069f70 con 0x7fb7100d0020 2023-07-06T21:41:45.585 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.580+0000 7fb70e7fc640 1 -- 172.21.15.138:0/2709052186 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911017326 0 0) 0x7fb7100693f0 con 0x7fb710159960 2023-07-06T21:41:45.593 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.584+0000 7fb70ffff640 1 --2- 172.21.15.138:0/2709052186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7100d0020 0x7fb7100d04a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb7100cc820 tx=0x7fb70801c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3de2bdad6a9b5f6e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:45.593 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.584+0000 7fb70e7fc640 1 -- 172.21.15.138:0/2709052186 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7080a57d0 con 0x7fb7100d0020 2023-07-06T21:41:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.584+0000 7fb70e7fc640 1 -- 172.21.15.138:0/2709052186 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7080a5930 con 0x7fb7100d0020 2023-07-06T21:41:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.584+0000 7fb70e7fc640 1 -- 172.21.15.138:0/2709052186 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7080a5cc0 con 0x7fb7100d0020 2023-07-06T21:41:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.584+0000 7fb715f37640 1 -- 172.21.15.138:0/2709052186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7100d0020 msgr2=0x7fb7100d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.584+0000 7fb715f37640 1 --2- 172.21.15.138:0/2709052186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7100d0020 0x7fb7100d04a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb7100cc820 tx=0x7fb70801c910 comp rx=0 tx=0).stop 2023-07-06T21:41:45.595 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.584+0000 7fb715f37640 1 -- 172.21.15.138:0/2709052186 shutdown_connections 2023-07-06T21:41:45.595 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.584+0000 7fb715f37640 1 --2- 172.21.15.138:0/2709052186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7100d0020 0x7fb7100d04a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.595 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.584+0000 7fb715f37640 1 --2- 172.21.15.138:0/2709052186 >> v2:172.21.15.55:3300/0 conn(0x7fb7100b3cc0 0x7fb7100b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.595 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.584+0000 7fb715f37640 1 -- 172.21.15.138:0/2709052186 >> 172.21.15.138:0/2709052186 conn(0x7fb7100cecc0 msgr2=0x7fb7100cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:45.595 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.584+0000 7fb715f37640 1 -- 172.21.15.138:0/2709052186 shutdown_connections 2023-07-06T21:41:45.595 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.584+0000 7fb715f37640 1 -- 172.21.15.138:0/2709052186 wait complete. 2023-07-06T21:41:45.595 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb715f37640 1 Processor -- start 2023-07-06T21:41:45.596 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb715f37640 1 -- start start 2023-07-06T21:41:45.596 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb715f37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7100b3cc0 0x7fb7100cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.596 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb715f37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7100d0020 0x7fb71015b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.596 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb715f37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb710159960 0x7fb710151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.596 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb715f37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100c6dd0 con 0x7fb7100b3cc0 2023-07-06T21:41:45.596 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb715f37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100cc210 con 0x7fb710159960 2023-07-06T21:41:45.597 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb715f37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100c61c0 con 0x7fb7100d0020 2023-07-06T21:41:45.597 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb70ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb710159960 0x7fb710151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.597 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb70effd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7100d0020 0x7fb71015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.597 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb70ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb710159960 0x7fb710151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38254/0 (socket says 172.21.15.138:38254) 2023-07-06T21:41:45.597 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb70ffff640 1 -- 172.21.15.138:0/3915437782 learned_addr learned my addr 172.21.15.138:0/3915437782 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-07-06T21:41:45.597 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb70f7fe640 1 --2- 172.21.15.138:0/3915437782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7100b3cc0 0x7fb7100cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.597 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb70effd640 1 -- 172.21.15.138:0/3915437782 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb710159960 msgr2=0x7fb710151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:45.598 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb70effd640 1 --2- 172.21.15.138:0/3915437782 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb710159960 0x7fb710151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.598 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb70effd640 1 -- 172.21.15.138:0/3915437782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7100b3cc0 msgr2=0x7fb7100cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:45.598 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb70effd640 1 --2- 172.21.15.138:0/3915437782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7100b3cc0 0x7fb7100cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.598 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb70effd640 1 -- 172.21.15.138:0/3915437782 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708009a70 con 0x7fb7100d0020 2023-07-06T21:41:45.598 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb70ffff640 1 --2- 172.21.15.138:0/3915437782 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb710159960 0x7fb710151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:41:45.598 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb70f7fe640 1 --2- 172.21.15.138:0/3915437782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7100b3cc0 0x7fb7100cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:41:45.598 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.588+0000 7fb70effd640 1 --2- 172.21.15.138:0/3915437782 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7100d0020 0x7fb71015b090 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb70400e870 tx=0x7fb70400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:45.599 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.592+0000 7fb6f7fff640 1 -- 172.21.15.138:0/3915437782 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70400ee60 con 0x7fb7100d0020 2023-07-06T21:41:45.599 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.592+0000 7fb6f7fff640 1 -- 172.21.15.138:0/3915437782 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70400c940 con 0x7fb7100d0020 2023-07-06T21:41:45.599 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.592+0000 7fb6f7fff640 1 -- 172.21.15.138:0/3915437782 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70400ccd0 con 0x7fb7100d0020 2023-07-06T21:41:45.599 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.592+0000 7fb715f37640 1 -- 172.21.15.138:0/3915437782 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7100c64a0 con 0x7fb7100d0020 2023-07-06T21:41:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.592+0000 7fb715f37640 1 -- 172.21.15.138:0/3915437782 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7100c6a60 con 0x7fb7100d0020 2023-07-06T21:41:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.592+0000 7fb6f7fff640 1 -- 172.21.15.138:0/3915437782 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb704013770 con 0x7fb7100d0020 2023-07-06T21:41:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.592+0000 7fb6f7fff640 1 -- 172.21.15.138:0/3915437782 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fb70401cad0 con 0x7fb7100d0020 2023-07-06T21:41:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.592+0000 7fb715f37640 1 -- 172.21.15.138:0/3915437782 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb710066d60 con 0x7fb7100d0020 2023-07-06T21:41:45.601 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:45.586+0000 7f947aa46180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:41:45.601 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.596+0000 7fb6f7fff640 1 -- 172.21.15.138:0/3915437782 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb704021060 con 0x7fb7100d0020 2023-07-06T21:41:45.663 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.664+0000 7fb715f37640 1 -- 172.21.15.138:0/3915437782 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd new", "uuid": "56a9f777-b856-4820-af52-809cbee7ba1f", "id": 1} v 0) v1 -- 0x7fb71006af10 con 0x7fb7100d0020 2023-07-06T21:41:45.668 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.668+0000 7fb6f7fff640 1 -- 172.21.15.138:0/3915437782 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56a9f777-b856-4820-af52-809cbee7ba1f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb704017070 con 0x7fb7100d0020 2023-07-06T21:41:45.669 INFO:teuthology.orchestra.run.smithi138.stdout:1 2023-07-06T21:41:45.670 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.668+0000 7fb715f37640 1 -- 172.21.15.138:0/3915437782 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7100d0020 msgr2=0x7fb71015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:45.670 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.668+0000 7fb715f37640 1 --2- 172.21.15.138:0/3915437782 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7100d0020 0x7fb71015b090 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb70400e870 tx=0x7fb70400ed30 comp rx=0 tx=0).stop 2023-07-06T21:41:45.670 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.668+0000 7fb715f37640 1 -- 172.21.15.138:0/3915437782 shutdown_connections 2023-07-06T21:41:45.670 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.668+0000 7fb715f37640 1 --2- 172.21.15.138:0/3915437782 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb710159960 0x7fb710151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.670 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.668+0000 7fb715f37640 1 --2- 172.21.15.138:0/3915437782 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7100d0020 0x7fb71015b090 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.671 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.668+0000 7fb715f37640 1 --2- 172.21.15.138:0/3915437782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7100b3cc0 0x7fb7100cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.671 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.668+0000 7fb715f37640 1 -- 172.21.15.138:0/3915437782 >> 172.21.15.138:0/3915437782 conn(0x7fb7100cecc0 msgr2=0x7fb710158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:45.671 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.668+0000 7fb715f37640 1 -- 172.21.15.138:0/3915437782 shutdown_connections 2023-07-06T21:41:45.671 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.668+0000 7fb715f37640 1 -- 172.21.15.138:0/3915437782 wait complete. 2023-07-06T21:41:45.689 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new e748d632-246c-4f6a-8093-9c18f6a67cd9 2 2023-07-06T21:41:45.754 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:45.752+0000 7f3582ad9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:41:45.826 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.824+0000 7f30f4b59640 1 Processor -- start 2023-07-06T21:41:45.826 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.824+0000 7f30f4b59640 1 -- start start 2023-07-06T21:41:45.828 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30f4b59640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30f015b850 0x7f30f00cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.829 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30f4b59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f30f00ccd30 0x7f30f00b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.829 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30f4b59640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f30f00b3db0 0x7f30f015f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.829 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30f4b59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f00b4210 con 0x7f30f00ccd30 2023-07-06T21:41:45.830 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30f4b59640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f00b2b80 con 0x7f30f00b3db0 2023-07-06T21:41:45.830 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30f4b59640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00cff30 con 0x7f30f015b850 2023-07-06T21:41:45.830 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30ee59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30f015b850 0x7f30f00cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.830 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30eed9d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f30f00b3db0 0x7f30f015f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.831 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30ee59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30f015b850 0x7f30f00cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:42424/0 (socket says 172.21.15.138:42424) 2023-07-06T21:41:45.831 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30ee59c640 1 -- 172.21.15.138:0/518271142 learned_addr learned my addr 172.21.15.138:0/518271142 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-07-06T21:41:45.831 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30e7fff640 1 --2- 172.21.15.138:0/518271142 >> v2:172.21.15.55:3300/0 conn(0x7f30f00ccd30 0x7f30f00b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.831 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30ee59c640 1 -- 172.21.15.138:0/518271142 >> v2:172.21.15.138:3300/0 conn(0x7f30f00b3db0 msgr2=0x7f30f015f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:41:45.832 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30ee59c640 1 --2- 172.21.15.138:0/518271142 >> v2:172.21.15.138:3300/0 conn(0x7f30f00b3db0 0x7f30f015f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.832 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30ee59c640 1 -- 172.21.15.138:0/518271142 >> v2:172.21.15.55:3300/0 conn(0x7f30f00ccd30 msgr2=0x7f30f00b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:41:45.832 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30ee59c640 1 --2- 172.21.15.138:0/518271142 >> v2:172.21.15.55:3300/0 conn(0x7f30f00ccd30 0x7f30f00b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.833 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30ee59c640 1 -- 172.21.15.138:0/518271142 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f00b22e0 con 0x7f30f015b850 2023-07-06T21:41:45.833 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.828+0000 7f30eed9d640 1 --2- 172.21.15.138:0/518271142 >> v2:172.21.15.138:3300/0 conn(0x7f30f00b3db0 0x7f30f015f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:41:45.837 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30ee59c640 1 --2- 172.21.15.138:0/518271142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30f015b850 0x7f30f00cc7f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f30f0160550 tx=0x7f30e001c0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3883aa41b66ab58 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:45.837 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30edd9b640 1 -- 172.21.15.138:0/518271142 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e00ab600 con 0x7f30f015b850 2023-07-06T21:41:45.838 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30edd9b640 1 -- 172.21.15.138:0/518271142 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e00a7050 con 0x7f30f015b850 2023-07-06T21:41:45.838 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30edd9b640 1 -- 172.21.15.138:0/518271142 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e00ab980 con 0x7f30f015b850 2023-07-06T21:41:45.838 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30f4b59640 1 -- 172.21.15.138:0/518271142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30f015b850 msgr2=0x7f30f00cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:45.838 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30f4b59640 1 --2- 172.21.15.138:0/518271142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30f015b850 0x7f30f00cc7f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f30f0160550 tx=0x7f30e001c0f0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.839 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30f4b59640 1 -- 172.21.15.138:0/518271142 shutdown_connections 2023-07-06T21:41:45.839 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30f4b59640 1 --2- 172.21.15.138:0/518271142 >> v2:172.21.15.138:3300/0 conn(0x7f30f00b3db0 0x7f30f015f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.839 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30f4b59640 1 --2- 172.21.15.138:0/518271142 >> v2:172.21.15.55:3300/0 conn(0x7f30f00ccd30 0x7f30f00b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.840 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30f4b59640 1 --2- 172.21.15.138:0/518271142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30f015b850 0x7f30f00cc7f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.840 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30f4b59640 1 -- 172.21.15.138:0/518271142 >> 172.21.15.138:0/518271142 conn(0x7f30f00cec20 msgr2=0x7f30f00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:45.840 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30f4b59640 1 -- 172.21.15.138:0/518271142 shutdown_connections 2023-07-06T21:41:45.840 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30f4b59640 1 -- 172.21.15.138:0/518271142 wait complete. 2023-07-06T21:41:45.841 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30f4b59640 1 Processor -- start 2023-07-06T21:41:45.841 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.832+0000 7f30f4b59640 1 -- start start 2023-07-06T21:41:45.841 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30f4b59640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30f00b3db0 0x7f30f015d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.841 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30f4b59640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30f00ccd30 0x7f30f0153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.842 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30f4b59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30f015b850 0x7f30f0152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:45.842 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30f4b59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00ca720 con 0x7f30f015b850 2023-07-06T21:41:45.842 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30f4b59640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00cb2a0 con 0x7f30f00ccd30 2023-07-06T21:41:45.842 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30f4b59640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00ca970 con 0x7f30f00b3db0 2023-07-06T21:41:45.843 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30e7fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30f00ccd30 0x7f30f0153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.843 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30e7fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30f00ccd30 0x7f30f0153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38272/0 (socket says 172.21.15.138:38272) 2023-07-06T21:41:45.843 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30e7fff640 1 -- 172.21.15.138:0/1458666666 learned_addr learned my addr 172.21.15.138:0/1458666666 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-07-06T21:41:45.843 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30eed9d640 1 --2- 172.21.15.138:0/1458666666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30f015b850 0x7f30f0152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.844 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30e7fff640 1 -- 172.21.15.138:0/1458666666 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30f00b3db0 msgr2=0x7f30f015d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:45.844 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30ee59c640 1 --2- 172.21.15.138:0/1458666666 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30f00b3db0 0x7f30f015d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:45.844 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30e7fff640 1 --2- 172.21.15.138:0/1458666666 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30f00b3db0 0x7f30f015d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.845 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30e7fff640 1 -- 172.21.15.138:0/1458666666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30f015b850 msgr2=0x7f30f0152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:45.845 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30e7fff640 1 --2- 172.21.15.138:0/1458666666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30f015b850 0x7f30f0152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.845 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30e7fff640 1 -- 172.21.15.138:0/1458666666 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e8009a70 con 0x7f30f00ccd30 2023-07-06T21:41:45.845 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30ee59c640 1 --2- 172.21.15.138:0/1458666666 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30f00b3db0 0x7f30f015d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:41:45.846 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30e7fff640 1 --2- 172.21.15.138:0/1458666666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30f00ccd30 0x7f30f0153390 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f30d800d7d0 tx=0x7f30d800dbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:45.846 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30e6ffd640 1 -- 172.21.15.138:0/1458666666 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d800b6c0 con 0x7f30f00ccd30 2023-07-06T21:41:45.846 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30e6ffd640 1 -- 172.21.15.138:0/1458666666 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d800b820 con 0x7f30f00ccd30 2023-07-06T21:41:45.846 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30e6ffd640 1 -- 172.21.15.138:0/1458666666 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d800bbd0 con 0x7f30f00ccd30 2023-07-06T21:41:45.847 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30f4b59640 1 -- 172.21.15.138:0/1458666666 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e00094d0 con 0x7f30f00ccd30 2023-07-06T21:41:45.847 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30f4b59640 1 -- 172.21.15.138:0/1458666666 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f015bda0 con 0x7f30f00ccd30 2023-07-06T21:41:45.847 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30e6ffd640 1 -- 172.21.15.138:0/1458666666 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f30d801e760 con 0x7f30f00ccd30 2023-07-06T21:41:45.847 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30e6ffd640 1 -- 172.21.15.138:0/1458666666 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f30d801ee30 con 0x7f30f00ccd30 2023-07-06T21:41:45.848 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.836+0000 7f30f4b59640 1 -- 172.21.15.138:0/1458666666 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f0066d60 con 0x7f30f00ccd30 2023-07-06T21:41:45.849 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.840+0000 7f30e6ffd640 1 -- 172.21.15.138:0/1458666666 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f30d801ea10 con 0x7f30f00ccd30 2023-07-06T21:41:45.906 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.904+0000 7f30f4b59640 1 -- 172.21.15.138:0/1458666666 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e748d632-246c-4f6a-8093-9c18f6a67cd9", "id": 2} v 0) v1 -- 0x7f30f00b3420 con 0x7f30f00ccd30 2023-07-06T21:41:45.914 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.912+0000 7f30e6ffd640 1 -- 172.21.15.138:0/1458666666 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e748d632-246c-4f6a-8093-9c18f6a67cd9", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f30d8028430 con 0x7f30f00ccd30 2023-07-06T21:41:45.915 INFO:teuthology.orchestra.run.smithi138.stdout:2 2023-07-06T21:41:45.915 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.916+0000 7f30f4b59640 1 -- 172.21.15.138:0/1458666666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30f00ccd30 msgr2=0x7f30f0153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:45.916 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.916+0000 7f30f4b59640 1 --2- 172.21.15.138:0/1458666666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30f00ccd30 0x7f30f0153390 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f30d800d7d0 tx=0x7f30d800dbd0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.916 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.916+0000 7f30f4b59640 1 -- 172.21.15.138:0/1458666666 shutdown_connections 2023-07-06T21:41:45.916 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.916+0000 7f30f4b59640 1 --2- 172.21.15.138:0/1458666666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30f015b850 0x7f30f0152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.916 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.916+0000 7f30f4b59640 1 --2- 172.21.15.138:0/1458666666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30f00ccd30 0x7f30f0153390 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.916 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.916+0000 7f30f4b59640 1 --2- 172.21.15.138:0/1458666666 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30f00b3db0 0x7f30f015d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:45.917 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.916+0000 7f30f4b59640 1 -- 172.21.15.138:0/1458666666 >> 172.21.15.138:0/1458666666 conn(0x7f30f00cec20 msgr2=0x7f30f00693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:45.917 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.916+0000 7f30f4b59640 1 -- 172.21.15.138:0/1458666666 shutdown_connections 2023-07-06T21:41:45.917 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:45.916+0000 7f30f4b59640 1 -- 172.21.15.138:0/1458666666 wait complete. 2023-07-06T21:41:45.934 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 80a88ca7-dd19-435d-a84c-52f3299bfc8c 3 2023-07-06T21:41:45.959 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:45.956+0000 7f3582ad9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:41:46.072 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f786d296640 1 Processor -- start 2023-07-06T21:41:46.072 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f786d296640 1 -- start start 2023-07-06T21:41:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f786d296640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7868158850 0x7f78680cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f786d296640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f78680ca130 0x7f78680ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f786d296640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78680b2aa0 con 0x7f78680703e0 2023-07-06T21:41:46.074 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f786d296640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7868158c20 con 0x7f78680ca130 2023-07-06T21:41:46.075 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f786d296640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78680c8db0 con 0x7f7868158850 2023-07-06T21:41:46.075 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f7866ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7868158850 0x7f78680cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.075 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f785ffff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f78680ca130 0x7f78680ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.076 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f7866ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7868158850 0x7f78680cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:42446/0 (socket says 172.21.15.138:42446) 2023-07-06T21:41:46.076 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f7866ffd640 1 -- 172.21.15.138:0/4011657002 learned_addr learned my addr 172.21.15.138:0/4011657002 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-07-06T21:41:46.076 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f78677fe640 1 --1- 172.21.15.138:0/4011657002 >> v1:172.21.15.138:6789/0 conn(0x7f78680703e0 0x7f786806eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:41262/0 (socket says 172.21.15.138:41262) 2023-07-06T21:41:46.076 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f7866ffd640 1 -- 172.21.15.138:0/4011657002 >> v2:172.21.15.138:3300/0 conn(0x7f78680ca130 msgr2=0x7f78680ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:41:46.077 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f7866ffd640 1 --2- 172.21.15.138:0/4011657002 >> v2:172.21.15.138:3300/0 conn(0x7f78680ca130 0x7f78680ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.077 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f7866ffd640 1 -- 172.21.15.138:0/4011657002 >> v1:172.21.15.138:6789/0 conn(0x7f78680703e0 legacy=0x7f786806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.077 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f7866ffd640 1 -- 172.21.15.138:0/4011657002 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78680c9090 con 0x7f7868158850 2023-07-06T21:41:46.078 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.072+0000 7f785ffff640 1 --2- 172.21.15.138:0/4011657002 >> v2:172.21.15.138:3300/0 conn(0x7f78680ca130 0x7f78680ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:41:46.083 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.076+0000 7f7866ffd640 1 --2- 172.21.15.138:0/4011657002 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7868158850 0x7f78680cca30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7858009870 tx=0x7f785801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61ad3cfce24a82ec server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:46.083 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.076+0000 7f78667fc640 1 -- 172.21.15.138:0/4011657002 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78580a8a30 con 0x7f7868158850 2023-07-06T21:41:46.084 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.076+0000 7f78667fc640 1 -- 172.21.15.138:0/4011657002 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78580a8b90 con 0x7f7868158850 2023-07-06T21:41:46.084 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.076+0000 7f78667fc640 1 -- 172.21.15.138:0/4011657002 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78580b0440 con 0x7f7868158850 2023-07-06T21:41:46.084 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.076+0000 7f786d296640 1 -- 172.21.15.138:0/4011657002 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7868158850 msgr2=0x7f78680cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.084 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.076+0000 7f786d296640 1 --2- 172.21.15.138:0/4011657002 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7868158850 0x7f78680cca30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7858009870 tx=0x7f785801ed30 comp rx=0 tx=0).stop 2023-07-06T21:41:46.085 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.076+0000 7f786d296640 1 -- 172.21.15.138:0/4011657002 shutdown_connections 2023-07-06T21:41:46.085 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.076+0000 7f786d296640 1 --2- 172.21.15.138:0/4011657002 >> v2:172.21.15.138:3300/0 conn(0x7f78680ca130 0x7f78680ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.085 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.076+0000 7f786d296640 1 --2- 172.21.15.138:0/4011657002 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7868158850 0x7f78680cca30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.085 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.076+0000 7f786d296640 1 -- 172.21.15.138:0/4011657002 >> 172.21.15.138:0/4011657002 conn(0x7f78680cea70 msgr2=0x7f78680ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:46.086 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.076+0000 7f786d296640 1 -- 172.21.15.138:0/4011657002 shutdown_connections 2023-07-06T21:41:46.086 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.076+0000 7f786d296640 1 -- 172.21.15.138:0/4011657002 wait complete. 2023-07-06T21:41:46.086 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f786d296640 1 Processor -- start 2023-07-06T21:41:46.087 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f786d296640 1 -- start start 2023-07-06T21:41:46.087 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f786d296640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78680703e0 0x7f78680b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.087 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f786d296640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78680ca130 0x7f78681ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.087 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f786d296640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7868158850 0x7f78681efde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.087 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f786d296640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7868153990 con 0x7f78680ca130 2023-07-06T21:41:46.088 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f786d296640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78681521d0 con 0x7f7868158850 2023-07-06T21:41:46.088 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f786d296640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78681524b0 con 0x7f78680703e0 2023-07-06T21:41:46.088 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f7866ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78680703e0 0x7f78680b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.088 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f7866ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78680703e0 0x7f78680b2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:42462/0 (socket says 172.21.15.138:42462) 2023-07-06T21:41:46.088 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f7866ffd640 1 -- 172.21.15.138:0/2572881320 learned_addr learned my addr 172.21.15.138:0/2572881320 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-07-06T21:41:46.088 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f78677fe640 1 --2- 172.21.15.138:0/2572881320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7868158850 0x7f78681efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.088 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f785ffff640 1 --2- 172.21.15.138:0/2572881320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78680ca130 0x7f78681ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.089 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f7866ffd640 1 -- 172.21.15.138:0/2572881320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7868158850 msgr2=0x7f78681efde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.089 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f7866ffd640 1 --2- 172.21.15.138:0/2572881320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7868158850 0x7f78681efde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.089 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f7866ffd640 1 -- 172.21.15.138:0/2572881320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78680ca130 msgr2=0x7f78681ef8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.089 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f7866ffd640 1 --2- 172.21.15.138:0/2572881320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78680ca130 0x7f78681ef8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.089 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f7866ffd640 1 -- 172.21.15.138:0/2572881320 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785000d8c0 con 0x7f78680703e0 2023-07-06T21:41:46.089 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f785ffff640 1 --2- 172.21.15.138:0/2572881320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78680ca130 0x7f78681ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:41:46.089 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f7866ffd640 1 --2- 172.21.15.138:0/2572881320 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78680703e0 0x7f78680b2ef0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f78580b3040 tx=0x7f785801bad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:46.090 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f785f7fe640 1 -- 172.21.15.138:0/2572881320 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78580b9620 con 0x7f78680703e0 2023-07-06T21:41:46.090 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f785f7fe640 1 -- 172.21.15.138:0/2572881320 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78580b97a0 con 0x7f78680703e0 2023-07-06T21:41:46.090 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f786d296640 1 -- 172.21.15.138:0/2572881320 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78580094d0 con 0x7f78680703e0 2023-07-06T21:41:46.090 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f785f7fe640 1 -- 172.21.15.138:0/2572881320 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78580b9b50 con 0x7f78680703e0 2023-07-06T21:41:46.090 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f786d296640 1 -- 172.21.15.138:0/2572881320 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7868152a70 con 0x7f78680703e0 2023-07-06T21:41:46.090 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f785f7fe640 1 -- 172.21.15.138:0/2572881320 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f78580b7070 con 0x7f78680703e0 2023-07-06T21:41:46.091 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.080+0000 7f785f7fe640 1 -- 172.21.15.138:0/2572881320 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f78580b9cb0 con 0x7f78680703e0 2023-07-06T21:41:46.091 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.084+0000 7f786d296640 1 -- 172.21.15.138:0/2572881320 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7868066d60 con 0x7f78680703e0 2023-07-06T21:41:46.091 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.084+0000 7f785f7fe640 1 -- 172.21.15.138:0/2572881320 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f78580b5070 con 0x7f78680703e0 2023-07-06T21:41:46.150 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.148+0000 7f786d296640 1 -- 172.21.15.138:0/2572881320 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd new", "uuid": "80a88ca7-dd19-435d-a84c-52f3299bfc8c", "id": 3} v 0) v1 -- 0x7f786806cd30 con 0x7f78680703e0 2023-07-06T21:41:46.157 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.156+0000 7f785f7fe640 1 -- 172.21.15.138:0/2572881320 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "80a88ca7-dd19-435d-a84c-52f3299bfc8c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f78580c47d0 con 0x7f78680703e0 2023-07-06T21:41:46.158 INFO:teuthology.orchestra.run.smithi138.stdout:3 2023-07-06T21:41:46.159 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.156+0000 7f786d296640 1 -- 172.21.15.138:0/2572881320 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78680703e0 msgr2=0x7f78680b2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.159 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.156+0000 7f786d296640 1 --2- 172.21.15.138:0/2572881320 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78680703e0 0x7f78680b2ef0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f78580b3040 tx=0x7f785801bad0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.159 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.156+0000 7f786d296640 1 -- 172.21.15.138:0/2572881320 shutdown_connections 2023-07-06T21:41:46.159 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.156+0000 7f786d296640 1 --2- 172.21.15.138:0/2572881320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7868158850 0x7f78681efde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.159 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.156+0000 7f786d296640 1 --2- 172.21.15.138:0/2572881320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78680ca130 0x7f78681ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.156+0000 7f786d296640 1 --2- 172.21.15.138:0/2572881320 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78680703e0 0x7f78680b2ef0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.156+0000 7f786d296640 1 -- 172.21.15.138:0/2572881320 >> 172.21.15.138:0/2572881320 conn(0x7f78680cea70 msgr2=0x7f78680cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.160+0000 7f786d296640 1 -- 172.21.15.138:0/2572881320 shutdown_connections 2023-07-06T21:41:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.160+0000 7f786d296640 1 -- 172.21.15.138:0/2572881320 wait complete. 2023-07-06T21:41:46.177 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 58bc816d-379a-4c71-9f72-cd12ced7710d 4 2023-07-06T21:41:46.281 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:46.278+0000 7f947aa46180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:41:46.346 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:46.342+0000 7f947aa46180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:41:46.359 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc917e9c640 1 Processor -- start 2023-07-06T21:41:46.359 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc917e9c640 1 -- start start 2023-07-06T21:41:46.361 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc917e9c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc91015b850 0x7fc9100cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.361 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc917e9c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9100ccd30 0x7fc9100b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.361 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc917e9c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9100b2b80 con 0x7fc9100b3db0 2023-07-06T21:41:46.361 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc917e9c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9100cff30 con 0x7fc9100ccd30 2023-07-06T21:41:46.362 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc917e9c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9100b41d0 con 0x7fc91015b850 2023-07-06T21:41:46.362 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc915c38640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc91015b850 0x7fc9100cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.362 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc915c38640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc91015b850 0x7fc9100cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38302/0 (socket says 172.21.15.138:38302) 2023-07-06T21:41:46.362 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc915c38640 1 -- 172.21.15.138:0/2068983982 learned_addr learned my addr 172.21.15.138:0/2068983982 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-07-06T21:41:46.362 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc915437640 1 --2- 172.21.15.138:0/2068983982 >> v2:172.21.15.55:3300/0 conn(0x7fc9100ccd30 0x7fc9100b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.362 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc915c38640 1 -- 172.21.15.138:0/2068983982 >> v2:172.21.15.55:3300/0 conn(0x7fc9100ccd30 msgr2=0x7fc9100b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:41:46.362 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc915c38640 1 --2- 172.21.15.138:0/2068983982 >> v2:172.21.15.55:3300/0 conn(0x7fc9100ccd30 0x7fc9100b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.363 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc915c38640 1 -- 172.21.15.138:0/2068983982 >> v1:172.21.15.55:6789/0 conn(0x7fc9100b3db0 legacy=0x7fc91015f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.363 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.360+0000 7fc915c38640 1 -- 172.21.15.138:0/2068983982 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9100b22e0 con 0x7fc91015b850 2023-07-06T21:41:46.364 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.364+0000 7fc915c38640 1 --2- 172.21.15.138:0/2068983982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc91015b850 0x7fc9100cc7f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc9100b48d0 tx=0x7fc90c01c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4530eb8c08e04b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:46.364 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.364+0000 7fc914c36640 1 -- 172.21.15.138:0/2068983982 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c0ac410 con 0x7fc91015b850 2023-07-06T21:41:46.364 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.364+0000 7fc914c36640 1 -- 172.21.15.138:0/2068983982 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c0ac570 con 0x7fc91015b850 2023-07-06T21:41:46.365 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.364+0000 7fc914c36640 1 -- 172.21.15.138:0/2068983982 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c0ac900 con 0x7fc91015b850 2023-07-06T21:41:46.365 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.364+0000 7fc917e9c640 1 -- 172.21.15.138:0/2068983982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc91015b850 msgr2=0x7fc9100cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.366 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.364+0000 7fc917e9c640 1 --2- 172.21.15.138:0/2068983982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc91015b850 0x7fc9100cc7f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc9100b48d0 tx=0x7fc90c01c3b0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.366 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.364+0000 7fc917e9c640 1 -- 172.21.15.138:0/2068983982 shutdown_connections 2023-07-06T21:41:46.366 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.364+0000 7fc917e9c640 1 --2- 172.21.15.138:0/2068983982 >> v2:172.21.15.55:3300/0 conn(0x7fc9100ccd30 0x7fc9100b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.366 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.364+0000 7fc917e9c640 1 --2- 172.21.15.138:0/2068983982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc91015b850 0x7fc9100cc7f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.366 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.364+0000 7fc917e9c640 1 -- 172.21.15.138:0/2068983982 >> 172.21.15.138:0/2068983982 conn(0x7fc9100cec20 msgr2=0x7fc9100cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:46.366 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.364+0000 7fc917e9c640 1 -- 172.21.15.138:0/2068983982 shutdown_connections 2023-07-06T21:41:46.366 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.364+0000 7fc917e9c640 1 -- 172.21.15.138:0/2068983982 wait complete. 2023-07-06T21:41:46.367 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc917e9c640 1 Processor -- start 2023-07-06T21:41:46.367 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc917e9c640 1 -- start start 2023-07-06T21:41:46.368 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc917e9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9100b3db0 0x7fc9101589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.368 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc917e9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9100ccd30 0x7fc9101515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.368 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc917e9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc91015b850 0x7fc910152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.368 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc917e9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100cc240 con 0x7fc9100ccd30 2023-07-06T21:41:46.369 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc917e9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9101571c0 con 0x7fc91015b850 2023-07-06T21:41:46.369 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc917e9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc910156890 con 0x7fc9100b3db0 2023-07-06T21:41:46.370 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc916439640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc91015b850 0x7fc910152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.371 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc915437640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9100ccd30 0x7fc9101515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.371 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc915c38640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9100b3db0 0x7fc9101589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.371 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc915437640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9100ccd30 0x7fc9101515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.138:54984/0 (socket says 172.21.15.138:54984) 2023-07-06T21:41:46.371 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc916439640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc91015b850 0x7fc910152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38304/0 (socket says 172.21.15.138:38304) 2023-07-06T21:41:46.372 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc915437640 1 -- 172.21.15.138:0/3773125159 learned_addr learned my addr 172.21.15.138:0/3773125159 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-07-06T21:41:46.372 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc916439640 1 -- 172.21.15.138:0/3773125159 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9100b3db0 msgr2=0x7fc9101589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.372 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc916439640 1 --2- 172.21.15.138:0/3773125159 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9100b3db0 0x7fc9101589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.372 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc916439640 1 -- 172.21.15.138:0/3773125159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9100ccd30 msgr2=0x7fc9101515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.372 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc916439640 1 --2- 172.21.15.138:0/3773125159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9100ccd30 0x7fc9101515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.373 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc916439640 1 -- 172.21.15.138:0/3773125159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c0094d0 con 0x7fc91015b850 2023-07-06T21:41:46.373 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc915437640 1 --2- 172.21.15.138:0/3773125159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9100ccd30 0x7fc9101515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:41:46.373 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc915c38640 1 --2- 172.21.15.138:0/3773125159 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9100b3db0 0x7fc9101589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:41:46.374 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc916439640 1 --2- 172.21.15.138:0/3773125159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc91015b850 0x7fc910152090 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc90800c690 tx=0x7fc90800cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:46.374 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc9067fc640 1 -- 172.21.15.138:0/3773125159 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908003bd0 con 0x7fc91015b850 2023-07-06T21:41:46.374 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc9067fc640 1 -- 172.21.15.138:0/3773125159 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc908003d50 con 0x7fc91015b850 2023-07-06T21:41:46.374 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc9067fc640 1 -- 172.21.15.138:0/3773125159 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908005310 con 0x7fc91015b850 2023-07-06T21:41:46.375 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc917e9c640 1 -- 172.21.15.138:0/3773125159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91015bda0 con 0x7fc91015b850 2023-07-06T21:41:46.375 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc917e9c640 1 -- 172.21.15.138:0/3773125159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc910156e50 con 0x7fc91015b850 2023-07-06T21:41:46.375 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc9067fc640 1 -- 172.21.15.138:0/3773125159 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc908005770 con 0x7fc91015b850 2023-07-06T21:41:46.375 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc9067fc640 1 -- 172.21.15.138:0/3773125159 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc908012420 con 0x7fc91015b850 2023-07-06T21:41:46.376 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.368+0000 7fc917e9c640 1 -- 172.21.15.138:0/3773125159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc910066d60 con 0x7fc91015b850 2023-07-06T21:41:46.376 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.372+0000 7fc9067fc640 1 -- 172.21.15.138:0/3773125159 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc90800a640 con 0x7fc91015b850 2023-07-06T21:41:46.410 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:46.406+0000 7f947aa46180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:41:46.438 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.436+0000 7fc917e9c640 1 -- 172.21.15.138:0/3773125159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd new", "uuid": "58bc816d-379a-4c71-9f72-cd12ced7710d", "id": 4} v 0) v1 -- 0x7fc9100b3420 con 0x7fc91015b850 2023-07-06T21:41:46.444 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.444+0000 7fc9067fc640 1 -- 172.21.15.138:0/3773125159 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58bc816d-379a-4c71-9f72-cd12ced7710d", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc90800a7e0 con 0x7fc91015b850 2023-07-06T21:41:46.445 INFO:teuthology.orchestra.run.smithi138.stdout:4 2023-07-06T21:41:46.447 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.444+0000 7fc917e9c640 1 -- 172.21.15.138:0/3773125159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc91015b850 msgr2=0x7fc910152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.447 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.444+0000 7fc917e9c640 1 --2- 172.21.15.138:0/3773125159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc91015b850 0x7fc910152090 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc90800c690 tx=0x7fc90800cb50 comp rx=0 tx=0).stop 2023-07-06T21:41:46.447 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.444+0000 7fc917e9c640 1 -- 172.21.15.138:0/3773125159 shutdown_connections 2023-07-06T21:41:46.447 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.444+0000 7fc917e9c640 1 --2- 172.21.15.138:0/3773125159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc91015b850 0x7fc910152090 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.447 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.444+0000 7fc917e9c640 1 --2- 172.21.15.138:0/3773125159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9100ccd30 0x7fc9101515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.447 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.444+0000 7fc917e9c640 1 --2- 172.21.15.138:0/3773125159 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9100b3db0 0x7fc9101589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.448 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.444+0000 7fc917e9c640 1 -- 172.21.15.138:0/3773125159 >> 172.21.15.138:0/3773125159 conn(0x7fc9100cec20 msgr2=0x7fc9100b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:46.448 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.444+0000 7fc917e9c640 1 -- 172.21.15.138:0/3773125159 shutdown_connections 2023-07-06T21:41:46.448 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.444+0000 7fc917e9c640 1 -- 172.21.15.138:0/3773125159 wait complete. 2023-07-06T21:41:46.464 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new d36bd7b6-07dc-4d35-ab89-0755e0225a2f 5 2023-07-06T21:41:46.503 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:46.498+0000 7f947aa46180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:41:46.566 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:46.562+0000 7f947aa46180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:41:46.603 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.604+0000 7f310293d640 1 Processor -- start 2023-07-06T21:41:46.604 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.604+0000 7f310293d640 1 -- start start 2023-07-06T21:41:46.604 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:46.604+0000 7f3582ad9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:41:46.605 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.604+0000 7f310293d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30fc0d0630 0x7f30fc15fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.605 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.604+0000 7f310293d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30fc0cc740 con 0x7f30fc0ce200 2023-07-06T21:41:46.605 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.604+0000 7f310293d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30fc0ccc90 con 0x7f30fc0b1250 2023-07-06T21:41:46.605 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.604+0000 7f310293d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0b29c0 con 0x7f30fc0d0630 2023-07-06T21:41:46.605 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.604+0000 7f310113a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30fc0d0630 0x7f30fc15fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.606 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.604+0000 7f310193b640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f30fc0b1250 0x7f30fc15f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58320/0 (socket says 172.21.15.138:58320) 2023-07-06T21:41:46.606 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.604+0000 7f310193b640 1 -- 172.21.15.138:0/609809786 learned_addr learned my addr 172.21.15.138:0/609809786 (peer_addr_for_me v1:172.21.15.138:0/0) 2023-07-06T21:41:46.606 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.604+0000 7f310113a640 1 -- 172.21.15.138:0/609809786 >> v1:172.21.15.138:6789/0 conn(0x7f30fc0b1250 legacy=0x7f30fc15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.607 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.604+0000 7f310113a640 1 -- 172.21.15.138:0/609809786 >> v1:172.21.15.55:6789/0 conn(0x7f30fc0ce200 legacy=0x7f30fc0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.607 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.604+0000 7f3100939640 1 -- 172.21.15.138:0/609809786 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213121879 0 0) 0x7f30fc0cc740 con 0x7f30fc0ce200 2023-07-06T21:41:46.607 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.604+0000 7f310113a640 1 -- 172.21.15.138:0/609809786 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc0d1d10 con 0x7f30fc0d0630 2023-07-06T21:41:46.608 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.608+0000 7f310113a640 1 --2- 172.21.15.138:0/609809786 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30fc0d0630 0x7f30fc15fa90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009770 tx=0x7f30ec01c260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c932d8df2dc2a31 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:46.609 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.608+0000 7f3100939640 1 -- 172.21.15.138:0/609809786 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec0ab600 con 0x7f30fc0d0630 2023-07-06T21:41:46.609 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.608+0000 7f3100939640 1 -- 172.21.15.138:0/609809786 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec0a7050 con 0x7f30fc0d0630 2023-07-06T21:41:46.609 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.608+0000 7f3100939640 1 -- 172.21.15.138:0/609809786 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec0ab980 con 0x7f30fc0d0630 2023-07-06T21:41:46.610 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.608+0000 7f310293d640 1 -- 172.21.15.138:0/609809786 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30fc0d0630 msgr2=0x7f30fc15fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.610 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.608+0000 7f310293d640 1 --2- 172.21.15.138:0/609809786 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30fc0d0630 0x7f30fc15fa90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009770 tx=0x7f30ec01c260 comp rx=0 tx=0).stop 2023-07-06T21:41:46.610 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.608+0000 7f310293d640 1 -- 172.21.15.138:0/609809786 shutdown_connections 2023-07-06T21:41:46.611 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.608+0000 7f310293d640 1 --2- 172.21.15.138:0/609809786 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30fc0d0630 0x7f30fc15fa90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.611 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.608+0000 7f310293d640 1 -- 172.21.15.138:0/609809786 >> 172.21.15.138:0/609809786 conn(0x7f30fc0b3b60 msgr2=0x7f30fc0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:46.611 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.608+0000 7f310293d640 1 -- 172.21.15.138:0/609809786 shutdown_connections 2023-07-06T21:41:46.611 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.608+0000 7f310293d640 1 -- 172.21.15.138:0/609809786 wait complete. 2023-07-06T21:41:46.611 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310293d640 1 Processor -- start 2023-07-06T21:41:46.612 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310293d640 1 -- start start 2023-07-06T21:41:46.613 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310293d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc0b1250 0x7f30fc0c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.613 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310293d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30fc0ce200 0x7f30fc14c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.613 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310293d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30fc0d0630 0x7f30fc0cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.614 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310293d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc14c690 con 0x7f30fc0b1250 2023-07-06T21:41:46.614 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310293d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0c6b70 con 0x7f30fc0ce200 2023-07-06T21:41:46.614 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310293d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0c6e50 con 0x7f30fc0d0630 2023-07-06T21:41:46.614 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310213c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30fc0d0630 0x7f30fc0cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.614 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310113a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30fc0ce200 0x7f30fc14c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.614 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310213c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30fc0d0630 0x7f30fc0cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:48846/0 (socket says 172.21.15.138:48846) 2023-07-06T21:41:46.614 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310213c640 1 -- 172.21.15.138:0/59627816 learned_addr learned my addr 172.21.15.138:0/59627816 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-07-06T21:41:46.615 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310193b640 1 --2- 172.21.15.138:0/59627816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc0b1250 0x7f30fc0c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.615 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310113a640 1 -- 172.21.15.138:0/59627816 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30fc0d0630 msgr2=0x7f30fc0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.615 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310113a640 1 --2- 172.21.15.138:0/59627816 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30fc0d0630 0x7f30fc0cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.615 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310113a640 1 -- 172.21.15.138:0/59627816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc0b1250 msgr2=0x7f30fc0c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.615 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310113a640 1 --2- 172.21.15.138:0/59627816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc0b1250 0x7f30fc0c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.616 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310113a640 1 -- 172.21.15.138:0/59627816 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec009420 con 0x7f30fc0ce200 2023-07-06T21:41:46.616 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310113a640 1 --2- 172.21.15.138:0/59627816 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30fc0ce200 0x7f30fc14c150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0ab000 tx=0x7f30ec01aaa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:46.618 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f30f27fc640 1 -- 172.21.15.138:0/59627816 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec0b7650 con 0x7f30fc0ce200 2023-07-06T21:41:46.618 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f30f27fc640 1 -- 172.21.15.138:0/59627816 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec0b77b0 con 0x7f30fc0ce200 2023-07-06T21:41:46.618 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f30f27fc640 1 -- 172.21.15.138:0/59627816 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec0b7b40 con 0x7f30fc0ce200 2023-07-06T21:41:46.619 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310293d640 1 -- 172.21.15.138:0/59627816 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30fc0c7130 con 0x7f30fc0ce200 2023-07-06T21:41:46.619 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310293d640 1 -- 172.21.15.138:0/59627816 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30fc0cc3a0 con 0x7f30fc0ce200 2023-07-06T21:41:46.619 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f30f27fc640 1 -- 172.21.15.138:0/59627816 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f30ec0c0400 con 0x7f30fc0ce200 2023-07-06T21:41:46.620 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f30f27fc640 1 -- 172.21.15.138:0/59627816 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f30ec0b5980 con 0x7f30fc0ce200 2023-07-06T21:41:46.620 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.612+0000 7f310293d640 1 -- 172.21.15.138:0/59627816 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30fc04d790 con 0x7f30fc0ce200 2023-07-06T21:41:46.620 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.616+0000 7f30f27fc640 1 -- 172.21.15.138:0/59627816 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f30ec0bb020 con 0x7f30fc0ce200 2023-07-06T21:41:46.660 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:46.654+0000 7f947aa46180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:41:46.668 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:46.668+0000 7f3582ad9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:41:46.682 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.680+0000 7f310293d640 1 -- 172.21.15.138:0/59627816 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d36bd7b6-07dc-4d35-ab89-0755e0225a2f", "id": 5} v 0) v1 -- 0x7f30fc157730 con 0x7f30fc0ce200 2023-07-06T21:41:46.687 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.688+0000 7f30f27fc640 1 -- 172.21.15.138:0/59627816 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d36bd7b6-07dc-4d35-ab89-0755e0225a2f", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f30ec0b0070 con 0x7f30fc0ce200 2023-07-06T21:41:46.687 INFO:teuthology.orchestra.run.smithi138.stdout:5 2023-07-06T21:41:46.688 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.688+0000 7f310293d640 1 -- 172.21.15.138:0/59627816 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30fc0ce200 msgr2=0x7f30fc14c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.688+0000 7f310293d640 1 --2- 172.21.15.138:0/59627816 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30fc0ce200 0x7f30fc14c150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0ab000 tx=0x7f30ec01aaa0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.688+0000 7f310293d640 1 -- 172.21.15.138:0/59627816 shutdown_connections 2023-07-06T21:41:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.688+0000 7f310293d640 1 --2- 172.21.15.138:0/59627816 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30fc0d0630 0x7f30fc0cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.688+0000 7f310293d640 1 --2- 172.21.15.138:0/59627816 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30fc0ce200 0x7f30fc14c150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.688+0000 7f310293d640 1 --2- 172.21.15.138:0/59627816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc0b1250 0x7f30fc0c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.688+0000 7f310293d640 1 -- 172.21.15.138:0/59627816 >> 172.21.15.138:0/59627816 conn(0x7f30fc0b3b60 msgr2=0x7f30fc159910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.688+0000 7f310293d640 1 -- 172.21.15.138:0/59627816 shutdown_connections 2023-07-06T21:41:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.688+0000 7f310293d640 1 -- 172.21.15.138:0/59627816 wait complete. 2023-07-06T21:41:46.707 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 82f034e6-2722-4de8-9bee-aaf08182f83c 6 2023-07-06T21:41:46.724 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:46.718+0000 7f947aa46180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:41:46.733 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:46.732+0000 7f3582ad9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:41:46.824 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:46.824+0000 7f3582ad9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:41:46.843 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d8329c640 1 Processor -- start 2023-07-06T21:41:46.844 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d8329c640 1 -- start start 2023-07-06T21:41:46.844 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d8329c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d7c0b3870 0x7f0d7c0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.845 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d8329c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7c0b4210 con 0x7f0d7c0d03c0 2023-07-06T21:41:46.845 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d8329c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7c0b2b80 con 0x7f0d7c15b850 2023-07-06T21:41:46.845 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d8329c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7c0cff30 con 0x7f0d7c0b3870 2023-07-06T21:41:46.845 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d81038640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f0d7c15b850 0x7f0d7c0cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58330/0 (socket says 172.21.15.138:58330) 2023-07-06T21:41:46.845 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d81038640 1 -- 172.21.15.138:0/1305812208 learned_addr learned my addr 172.21.15.138:0/1305812208 (peer_addr_for_me v1:172.21.15.138:0/0) 2023-07-06T21:41:46.845 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d80837640 1 --2- 172.21.15.138:0/1305812208 >> v2:172.21.15.55:3300/0 conn(0x7f0d7c0b3870 0x7f0d7c0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.846 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d73fff640 1 -- 172.21.15.138:0/1305812208 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980169298 0 0) 0x7f0d7c0b2b80 con 0x7f0d7c15b850 2023-07-06T21:41:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d73fff640 1 -- 172.21.15.138:0/1305812208 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d68003530 con 0x7f0d7c15b850 2023-07-06T21:41:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d73fff640 1 -- 172.21.15.138:0/1305812208 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956011592 0 0) 0x7f0d7c0b4210 con 0x7f0d7c0d03c0 2023-07-06T21:41:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d73fff640 1 -- 172.21.15.138:0/1305812208 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d7c0b2b80 con 0x7f0d7c0d03c0 2023-07-06T21:41:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d80837640 1 -- 172.21.15.138:0/1305812208 >> v1:172.21.15.138:6789/0 conn(0x7f0d7c15b850 legacy=0x7f0d7c0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d80837640 1 -- 172.21.15.138:0/1305812208 >> v1:172.21.15.55:6789/0 conn(0x7f0d7c0d03c0 legacy=0x7f0d7c0d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.844+0000 7f0d80837640 1 -- 172.21.15.138:0/1305812208 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c0b22e0 con 0x7f0d7c0b3870 2023-07-06T21:41:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.848+0000 7f0d80837640 1 --2- 172.21.15.138:0/1305812208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c0b3870 0x7f0d7c0b3cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0097c0 tx=0x7f0d6c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c122c4bca0a00e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.848+0000 7f0d73fff640 1 -- 172.21.15.138:0/1305812208 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0ab600 con 0x7f0d7c0b3870 2023-07-06T21:41:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.848+0000 7f0d73fff640 1 -- 172.21.15.138:0/1305812208 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c0a7050 con 0x7f0d7c0b3870 2023-07-06T21:41:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.848+0000 7f0d73fff640 1 -- 172.21.15.138:0/1305812208 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0ab980 con 0x7f0d7c0b3870 2023-07-06T21:41:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 -- 172.21.15.138:0/1305812208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c0b3870 msgr2=0x7f0d7c0b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 --2- 172.21.15.138:0/1305812208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c0b3870 0x7f0d7c0b3cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0097c0 tx=0x7f0d6c01c330 comp rx=0 tx=0).stop 2023-07-06T21:41:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 -- 172.21.15.138:0/1305812208 shutdown_connections 2023-07-06T21:41:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 --2- 172.21.15.138:0/1305812208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c0b3870 0x7f0d7c0b3cd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 -- 172.21.15.138:0/1305812208 >> 172.21.15.138:0/1305812208 conn(0x7f0d7c0cec20 msgr2=0x7f0d7c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 -- 172.21.15.138:0/1305812208 shutdown_connections 2023-07-06T21:41:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 -- 172.21.15.138:0/1305812208 wait complete. 2023-07-06T21:41:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 Processor -- start 2023-07-06T21:41:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 -- start start 2023-07-06T21:41:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c0b3870 0x7f0d7c14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d7c0d03c0 0x7f0d7c0693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d7c15b850 0x7f0d7c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c150110 con 0x7f0d7c0b3870 2023-07-06T21:41:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c1528e0 con 0x7f0d7c15b850 2023-07-06T21:41:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d8329c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0c5b70 con 0x7f0d7c0d03c0 2023-07-06T21:41:46.858 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d81839640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d7c15b850 0x7f0d7c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.858 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d81038640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c0b3870 0x7f0d7c14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.858 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d80837640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d7c0d03c0 0x7f0d7c0693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:46.859 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d81839640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d7c15b850 0x7f0d7c069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48222/0 (socket says 172.21.15.138:48222) 2023-07-06T21:41:46.859 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.852+0000 7f0d81839640 1 -- 172.21.15.138:0/1279888494 learned_addr learned my addr 172.21.15.138:0/1279888494 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-07-06T21:41:46.859 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d81839640 1 -- 172.21.15.138:0/1279888494 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d7c0d03c0 msgr2=0x7f0d7c0693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.859 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d81839640 1 --2- 172.21.15.138:0/1279888494 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d7c0d03c0 0x7f0d7c0693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.859 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d81839640 1 -- 172.21.15.138:0/1279888494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c0b3870 msgr2=0x7f0d7c14f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d81839640 1 --2- 172.21.15.138:0/1279888494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c0b3870 0x7f0d7c14f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d81839640 1 -- 172.21.15.138:0/1279888494 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c009420 con 0x7f0d7c15b850 2023-07-06T21:41:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d81038640 1 --2- 172.21.15.138:0/1279888494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c0b3870 0x7f0d7c14f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:41:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d80837640 1 --2- 172.21.15.138:0/1279888494 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d7c0d03c0 0x7f0d7c0693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:41:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d81839640 1 --2- 172.21.15.138:0/1279888494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d7c15b850 0x7f0d7c069930 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400c7a0 tx=0x7f0d7400cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d71ffb640 1 -- 172.21.15.138:0/1279888494 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74003bd0 con 0x7f0d7c15b850 2023-07-06T21:41:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d71ffb640 1 -- 172.21.15.138:0/1279888494 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d74003d50 con 0x7f0d7c15b850 2023-07-06T21:41:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d8329c640 1 -- 172.21.15.138:0/1279888494 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7c0c6380 con 0x7f0d7c15b850 2023-07-06T21:41:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d71ffb640 1 -- 172.21.15.138:0/1279888494 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7400aa90 con 0x7f0d7c15b850 2023-07-06T21:41:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d71ffb640 1 -- 172.21.15.138:0/1279888494 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0d740050d0 con 0x7f0d7c15b850 2023-07-06T21:41:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d8329c640 1 -- 172.21.15.138:0/1279888494 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7c0c60a0 con 0x7f0d7c15b850 2023-07-06T21:41:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d71ffb640 1 -- 172.21.15.138:0/1279888494 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f0d74012ba0 con 0x7f0d7c15b850 2023-07-06T21:41:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.856+0000 7f0d8329c640 1 -- 172.21.15.138:0/1279888494 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7c150250 con 0x7f0d7c15b850 2023-07-06T21:41:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.860+0000 7f0d71ffb640 1 -- 172.21.15.138:0/1279888494 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0d7c150250 con 0x7f0d7c15b850 2023-07-06T21:41:46.885 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:46.882+0000 7f947aa46180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:41:46.901 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:46.900+0000 7f3582ad9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:41:46.938 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.936+0000 7f0d8329c640 1 -- 172.21.15.138:0/1279888494 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd new", "uuid": "82f034e6-2722-4de8-9bee-aaf08182f83c", "id": 6} v 0) v1 -- 0x7f0d7c066d60 con 0x7f0d7c15b850 2023-07-06T21:41:46.946 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.944+0000 7f0d71ffb640 1 -- 172.21.15.138:0/1279888494 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "82f034e6-2722-4de8-9bee-aaf08182f83c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0d74012d60 con 0x7f0d7c15b850 2023-07-06T21:41:46.946 INFO:teuthology.orchestra.run.smithi138.stdout:6 2023-07-06T21:41:46.947 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.948+0000 7f0d8329c640 1 -- 172.21.15.138:0/1279888494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d7c15b850 msgr2=0x7f0d7c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:46.947 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.948+0000 7f0d8329c640 1 --2- 172.21.15.138:0/1279888494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d7c15b850 0x7f0d7c069930 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400c7a0 tx=0x7f0d7400cc60 comp rx=0 tx=0).stop 2023-07-06T21:41:46.948 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.948+0000 7f0d8329c640 1 -- 172.21.15.138:0/1279888494 shutdown_connections 2023-07-06T21:41:46.948 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.948+0000 7f0d8329c640 1 --2- 172.21.15.138:0/1279888494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d7c15b850 0x7f0d7c069930 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.948 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.948+0000 7f0d8329c640 1 --2- 172.21.15.138:0/1279888494 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d7c0d03c0 0x7f0d7c0693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.948 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.948+0000 7f0d8329c640 1 --2- 172.21.15.138:0/1279888494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c0b3870 0x7f0d7c14f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:46.948 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.948+0000 7f0d8329c640 1 -- 172.21.15.138:0/1279888494 >> 172.21.15.138:0/1279888494 conn(0x7f0d7c0cec20 msgr2=0x7f0d7c153260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:46.948 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.948+0000 7f0d8329c640 1 -- 172.21.15.138:0/1279888494 shutdown_connections 2023-07-06T21:41:46.948 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:46.948+0000 7f0d8329c640 1 -- 172.21.15.138:0/1279888494 wait complete. 2023-07-06T21:41:46.957 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:46.954+0000 7f947aa46180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:41:46.965 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new fa2efd3b-1c49-438b-98dd-ba6fcc2fca76 7 2023-07-06T21:41:46.994 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:46.992+0000 7f3582ad9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:41:47.056 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:47.056+0000 7f3582ad9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:41:47.130 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.128+0000 7f3598996640 1 Processor -- start 2023-07-06T21:41:47.130 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.128+0000 7f3598996640 1 -- start start 2023-07-06T21:41:47.131 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f3598996640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f359415b850 0x7f35940cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:47.132 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f3598996640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35940b3f80 0x7f35940d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:47.132 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f3598996640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35940b2b80 con 0x7f35940ccd30 2023-07-06T21:41:47.132 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f3598996640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35940cff30 con 0x7f35940b3f80 2023-07-06T21:41:47.132 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f3598996640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35940b22e0 con 0x7f359415b850 2023-07-06T21:41:47.133 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f359259c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f359415b850 0x7f35940cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:47.133 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f3591d9b640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f35940ccd30 0x7f35940b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:58342/0 (socket says 172.21.15.138:58342) 2023-07-06T21:41:47.133 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f3591d9b640 1 -- 172.21.15.138:0/2244880696 learned_addr learned my addr 172.21.15.138:0/2244880696 (peer_addr_for_me v1:172.21.15.138:0/0) 2023-07-06T21:41:47.133 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f3592d9d640 1 --2- 172.21.15.138:0/2244880696 >> v2:172.21.15.55:3300/0 conn(0x7f35940b3f80 0x7f35940d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:47.133 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f359259c640 1 -- 172.21.15.138:0/2244880696 >> v2:172.21.15.55:3300/0 conn(0x7f35940b3f80 msgr2=0x7f35940d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:41:47.134 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f359259c640 1 --2- 172.21.15.138:0/2244880696 >> v2:172.21.15.55:3300/0 conn(0x7f35940b3f80 0x7f35940d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.134 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f359259c640 1 -- 172.21.15.138:0/2244880696 >> v1:172.21.15.138:6789/0 conn(0x7f35940ccd30 legacy=0x7f35940b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:47.134 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f359159a640 1 -- 172.21.15.138:0/2244880696 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830290711 0 0) 0x7f35940b2b80 con 0x7f35940ccd30 2023-07-06T21:41:47.134 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f359259c640 1 -- 172.21.15.138:0/2244880696 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35940b25c0 con 0x7f359415b850 2023-07-06T21:41:47.134 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.132+0000 7f3592d9d640 1 --2- 172.21.15.138:0/2244880696 >> v2:172.21.15.55:3300/0 conn(0x7f35940b3f80 0x7f35940d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:41:47.135 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.136+0000 7f359259c640 1 --2- 172.21.15.138:0/2244880696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f359415b850 0x7f35940cc7f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35840097c0 tx=0x7f358401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2fd2fc32ca34bbe server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:47.135 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.136+0000 7f359159a640 1 -- 172.21.15.138:0/2244880696 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840ab600 con 0x7f359415b850 2023-07-06T21:41:47.136 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.136+0000 7f359159a640 1 -- 172.21.15.138:0/2244880696 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35840a7050 con 0x7f359415b850 2023-07-06T21:41:47.136 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.136+0000 7f359159a640 1 -- 172.21.15.138:0/2244880696 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840ab980 con 0x7f359415b850 2023-07-06T21:41:47.136 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.136+0000 7f3598996640 1 -- 172.21.15.138:0/2244880696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f359415b850 msgr2=0x7f35940cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:47.137 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.136+0000 7f3598996640 1 --2- 172.21.15.138:0/2244880696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f359415b850 0x7f35940cc7f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35840097c0 tx=0x7f358401c330 comp rx=0 tx=0).stop 2023-07-06T21:41:47.137 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.136+0000 7f3598996640 1 -- 172.21.15.138:0/2244880696 shutdown_connections 2023-07-06T21:41:47.137 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.136+0000 7f3598996640 1 --2- 172.21.15.138:0/2244880696 >> v2:172.21.15.55:3300/0 conn(0x7f35940b3f80 0x7f35940d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.137 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.136+0000 7f3598996640 1 --2- 172.21.15.138:0/2244880696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f359415b850 0x7f35940cc7f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.137 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.136+0000 7f3598996640 1 -- 172.21.15.138:0/2244880696 >> 172.21.15.138:0/2244880696 conn(0x7f35940cec20 msgr2=0x7f35940cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:47.137 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.136+0000 7f3598996640 1 -- 172.21.15.138:0/2244880696 shutdown_connections 2023-07-06T21:41:47.137 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.136+0000 7f3598996640 1 -- 172.21.15.138:0/2244880696 wait complete. 2023-07-06T21:41:47.138 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.136+0000 7f3598996640 1 Processor -- start 2023-07-06T21:41:47.138 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.136+0000 7f3598996640 1 -- start start 2023-07-06T21:41:47.139 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3598996640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35940b3f80 0x7f3594141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:47.139 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3598996640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35940ccd30 0x7f3594143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:47.140 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3598996640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f359415b850 0x7f359415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:47.140 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3598996640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35940c8870 con 0x7f359415b850 2023-07-06T21:41:47.140 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3598996640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35941607f0 con 0x7f35940ccd30 2023-07-06T21:41:47.140 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3598996640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35941440e0 con 0x7f35940b3f80 2023-07-06T21:41:47.140 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f359259c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35940b3f80 0x7f3594141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:47.140 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3591d9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35940ccd30 0x7f3594143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:47.141 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f359259c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35940b3f80 0x7f3594141140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:48868/0 (socket says 172.21.15.138:48868) 2023-07-06T21:41:47.141 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f359259c640 1 -- 172.21.15.138:0/550637585 learned_addr learned my addr 172.21.15.138:0/550637585 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-07-06T21:41:47.141 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3592d9d640 1 --2- 172.21.15.138:0/550637585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f359415b850 0x7f359415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:47.142 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f359259c640 1 -- 172.21.15.138:0/550637585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35940ccd30 msgr2=0x7f3594143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:47.142 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f359259c640 1 --2- 172.21.15.138:0/550637585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35940ccd30 0x7f3594143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.142 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f359259c640 1 -- 172.21.15.138:0/550637585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f359415b850 msgr2=0x7f359415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:47.142 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f359259c640 1 --2- 172.21.15.138:0/550637585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f359415b850 0x7f359415bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.142 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f359259c640 1 -- 172.21.15.138:0/550637585 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3584009420 con 0x7f35940b3f80 2023-07-06T21:41:47.143 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f359259c640 1 --2- 172.21.15.138:0/550637585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35940b3f80 0x7f3594141140 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f35840097c0 tx=0x7f35840190d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:47.143 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3582ffd640 1 -- 172.21.15.138:0/550637585 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584004030 con 0x7f35940b3f80 2023-07-06T21:41:47.143 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3582ffd640 1 -- 172.21.15.138:0/550637585 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3584004190 con 0x7f35940b3f80 2023-07-06T21:41:47.143 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3598996640 1 -- 172.21.15.138:0/550637585 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359415bda0 con 0x7f35940b3f80 2023-07-06T21:41:47.143 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3582ffd640 1 -- 172.21.15.138:0/550637585 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584004500 con 0x7f35940b3f80 2023-07-06T21:41:47.143 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3598996640 1 -- 172.21.15.138:0/550637585 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3594143b20 con 0x7f35940b3f80 2023-07-06T21:41:47.143 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3582ffd640 1 -- 172.21.15.138:0/550637585 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f35840b2050 con 0x7f35940b3f80 2023-07-06T21:41:47.144 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3582ffd640 1 -- 172.21.15.138:0/550637585 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f35840b55f0 con 0x7f35940b3f80 2023-07-06T21:41:47.144 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.140+0000 7f3598996640 1 -- 172.21.15.138:0/550637585 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3594066d60 con 0x7f35940b3f80 2023-07-06T21:41:47.144 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.144+0000 7f3582ffd640 1 -- 172.21.15.138:0/550637585 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f35840c4060 con 0x7f35940b3f80 2023-07-06T21:41:47.209 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.208+0000 7f3598996640 1 -- 172.21.15.138:0/550637585 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fa2efd3b-1c49-438b-98dd-ba6fcc2fca76", "id": 7} v 0) v1 -- 0x7f35940d0550 con 0x7f35940b3f80 2023-07-06T21:41:47.215 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.216+0000 7f3582ffd640 1 -- 172.21.15.138:0/550637585 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa2efd3b-1c49-438b-98dd-ba6fcc2fca76", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f35840b0070 con 0x7f35940b3f80 2023-07-06T21:41:47.216 INFO:teuthology.orchestra.run.smithi138.stdout:7 2023-07-06T21:41:47.216 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:47.216+0000 7f3582ad9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:41:47.217 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.216+0000 7f3598996640 1 -- 172.21.15.138:0/550637585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35940b3f80 msgr2=0x7f3594141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:47.217 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.216+0000 7f3598996640 1 --2- 172.21.15.138:0/550637585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35940b3f80 0x7f3594141140 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f35840097c0 tx=0x7f35840190d0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.217 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.216+0000 7f3598996640 1 -- 172.21.15.138:0/550637585 shutdown_connections 2023-07-06T21:41:47.218 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.216+0000 7f3598996640 1 --2- 172.21.15.138:0/550637585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f359415b850 0x7f359415bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.218 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.216+0000 7f3598996640 1 --2- 172.21.15.138:0/550637585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35940ccd30 0x7f3594143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.218 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.216+0000 7f3598996640 1 --2- 172.21.15.138:0/550637585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35940b3f80 0x7f3594141140 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.218 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.216+0000 7f3598996640 1 -- 172.21.15.138:0/550637585 >> 172.21.15.138:0/550637585 conn(0x7f35940cec20 msgr2=0x7f359415ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:47.218 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.216+0000 7f3598996640 1 -- 172.21.15.138:0/550637585 shutdown_connections 2023-07-06T21:41:47.218 INFO:teuthology.orchestra.run.smithi138.stderr:2023-07-06T21:41:47.216+0000 7f3598996640 1 -- 172.21.15.138:0/550637585 wait complete. 2023-07-06T21:41:47.236 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-06T21:41:47.236 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-06T21:41:47.240 INFO:tasks.ceph.osd.0:Started 2023-07-06T21:41:47.240 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-06T21:41:47.240 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-06T21:41:47.244 INFO:tasks.ceph.osd.1:Started 2023-07-06T21:41:47.244 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-06T21:41:47.244 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-06T21:41:47.247 INFO:tasks.ceph.osd.2:Started 2023-07-06T21:41:47.248 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-06T21:41:47.248 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-06T21:41:47.251 INFO:tasks.ceph.osd.3:Started 2023-07-06T21:41:47.251 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-06T21:41:47.252 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-06T21:41:47.255 INFO:tasks.ceph.osd.4:Started 2023-07-06T21:41:47.255 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-06T21:41:47.256 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-06T21:41:47.259 INFO:tasks.ceph.osd.5:Started 2023-07-06T21:41:47.259 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-06T21:41:47.259 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-06T21:41:47.263 INFO:tasks.ceph.osd.6:Started 2023-07-06T21:41:47.263 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-06T21:41:47.263 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-06T21:41:47.268 INFO:tasks.ceph.osd.7:Started 2023-07-06T21:41:47.269 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:41:47.289 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:47.288+0000 7f3582ad9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:41:47.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f92528d8640 1 Processor -- start 2023-07-06T21:41:47.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f92528d8640 1 -- start start 2023-07-06T21:41:47.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f92528d8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f924c0ca450 0x7f924c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:47.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f92528d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f924c0b3730 0x7f924c15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:47.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f92528d8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924c159cd0 con 0x7f924c0712f0 2023-07-06T21:41:47.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f92528d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924c0693f0 con 0x7f924c0b3730 2023-07-06T21:41:47.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f92528d8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924c06aca0 con 0x7f924c0ca450 2023-07-06T21:41:47.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f9250e75640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f924c0b3730 0x7f924c15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:47.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f9250e75640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f924c0b3730 0x7f924c15d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49280/0 (socket says 172.21.15.55:49280) 2023-07-06T21:41:47.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f9250e75640 1 -- 172.21.15.55:0/695529062 learned_addr learned my addr 172.21.15.55:0/695529062 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:41:47.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f924b7fe640 1 --2- 172.21.15.55:0/695529062 >> v2:172.21.15.138:3300/0 conn(0x7f924c0ca450 0x7f924c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:47.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f9250e75640 1 -- 172.21.15.55:0/695529062 >> v2:172.21.15.138:3300/0 conn(0x7f924c0ca450 msgr2=0x7f924c06a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:41:47.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f9250e75640 1 --2- 172.21.15.55:0/695529062 >> v2:172.21.15.138:3300/0 conn(0x7f924c0ca450 0x7f924c06a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f9250e75640 1 -- 172.21.15.55:0/695529062 >> v1:172.21.15.138:6789/0 conn(0x7f924c0712f0 legacy=0x7f924c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:47.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f9250e75640 1 -- 172.21.15.55:0/695529062 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c0696b0 con 0x7f924c0b3730 2023-07-06T21:41:47.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.466+0000 7f924affd640 1 -- 172.21.15.55:0/695529062 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846090897 0 0) 0x7f924c159cd0 con 0x7f924c0712f0 2023-07-06T21:41:47.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.470+0000 7f9250e75640 1 --2- 172.21.15.55:0/695529062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f924c0b3730 0x7f924c15d3e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f924c071a70 tx=0x7f924401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bd1d024e8364a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:47.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.470+0000 7f924affd640 1 -- 172.21.15.55:0/695529062 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92440a5860 con 0x7f924c0b3730 2023-07-06T21:41:47.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.470+0000 7f924affd640 1 -- 172.21.15.55:0/695529062 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92440a59c0 con 0x7f924c0b3730 2023-07-06T21:41:47.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.470+0000 7f924affd640 1 -- 172.21.15.55:0/695529062 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92440a5d50 con 0x7f924c0b3730 2023-07-06T21:41:47.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.470+0000 7f92528d8640 1 -- 172.21.15.55:0/695529062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f924c0b3730 msgr2=0x7f924c15d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:47.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.470+0000 7f92528d8640 1 --2- 172.21.15.55:0/695529062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f924c0b3730 0x7f924c15d3e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f924c071a70 tx=0x7f924401c9a0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.470+0000 7f92528d8640 1 -- 172.21.15.55:0/695529062 shutdown_connections 2023-07-06T21:41:47.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.470+0000 7f92528d8640 1 --2- 172.21.15.55:0/695529062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f924c0b3730 0x7f924c15d3e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.470+0000 7f92528d8640 1 --2- 172.21.15.55:0/695529062 >> v2:172.21.15.138:3300/0 conn(0x7f924c0ca450 0x7f924c06a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.470+0000 7f92528d8640 1 -- 172.21.15.55:0/695529062 >> 172.21.15.55:0/695529062 conn(0x7f924c0cded0 msgr2=0x7f924c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:47.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.470+0000 7f92528d8640 1 -- 172.21.15.55:0/695529062 shutdown_connections 2023-07-06T21:41:47.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.470+0000 7f92528d8640 1 -- 172.21.15.55:0/695529062 wait complete. 2023-07-06T21:41:47.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f92528d8640 1 Processor -- start 2023-07-06T21:41:47.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f92528d8640 1 -- start start 2023-07-06T21:41:47.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f92528d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f924c0712f0 0x7f924c153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:47.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f92528d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f924c0b3730 0x7f924c0cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:47.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f92528d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f924c0ca450 0x7f924c0c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:47.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f92528d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c153540 con 0x7f924c0ca450 2023-07-06T21:41:47.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f92528d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c15a250 con 0x7f924c0b3730 2023-07-06T21:41:47.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f92528d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924c0ccf70 con 0x7f924c0712f0 2023-07-06T21:41:47.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f9250e75640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f924c0ca450 0x7f924c0c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:47.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f9250e75640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f924c0ca450 0x7f924c0c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49284/0 (socket says 172.21.15.55:49284) 2023-07-06T21:41:47.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f9250e75640 1 -- 172.21.15.55:0/3124346709 learned_addr learned my addr 172.21.15.55:0/3124346709 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:41:47.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f924b7fe640 1 --2- 172.21.15.55:0/3124346709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f924c0b3730 0x7f924c0cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:47.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f924bfff640 1 --2- 172.21.15.55:0/3124346709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f924c0712f0 0x7f924c153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:47.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f9250e75640 1 -- 172.21.15.55:0/3124346709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f924c0712f0 msgr2=0x7f924c153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:47.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f9250e75640 1 --2- 172.21.15.55:0/3124346709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f924c0712f0 0x7f924c153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f9250e75640 1 -- 172.21.15.55:0/3124346709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f924c0b3730 msgr2=0x7f924c0cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:47.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f9250e75640 1 --2- 172.21.15.55:0/3124346709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f924c0b3730 0x7f924c0cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f9250e75640 1 -- 172.21.15.55:0/3124346709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9244009b30 con 0x7f924c0ca450 2023-07-06T21:41:47.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f924b7fe640 1 --2- 172.21.15.55:0/3124346709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f924c0b3730 0x7f924c0cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:41:47.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f924bfff640 1 --2- 172.21.15.55:0/3124346709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f924c0712f0 0x7f924c153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:41:47.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f9250e75640 1 --2- 172.21.15.55:0/3124346709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f924c0ca450 0x7f924c0c93b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f92440195b0 tx=0x7f9244019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:47.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f9248ff9640 1 -- 172.21.15.55:0/3124346709 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92440b8670 con 0x7f924c0ca450 2023-07-06T21:41:47.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f9248ff9640 1 -- 172.21.15.55:0/3124346709 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92440b8810 con 0x7f924c0ca450 2023-07-06T21:41:47.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f92528d8640 1 -- 172.21.15.55:0/3124346709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924c0cd250 con 0x7f924c0ca450 2023-07-06T21:41:47.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.474+0000 7f9248ff9640 1 -- 172.21.15.55:0/3124346709 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92440b8bc0 con 0x7f924c0ca450 2023-07-06T21:41:47.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.478+0000 7f92528d8640 1 -- 172.21.15.55:0/3124346709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924c159ee0 con 0x7f924c0ca450 2023-07-06T21:41:47.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.478+0000 7f9248ff9640 1 -- 172.21.15.55:0/3124346709 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f92440c2740 con 0x7f924c0ca450 2023-07-06T21:41:47.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.478+0000 7f9248ff9640 1 -- 172.21.15.55:0/3124346709 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f92440b6b10 con 0x7f924c0ca450 2023-07-06T21:41:47.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.478+0000 7f92528d8640 1 -- 172.21.15.55:0/3124346709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924c066d60 con 0x7f924c0ca450 2023-07-06T21:41:47.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.490+0000 7f9248ff9640 1 -- 172.21.15.55:0/3124346709 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f92440b6d60 con 0x7f924c0ca450 2023-07-06T21:41:47.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.550+0000 7f92528d8640 1 -- 172.21.15.55:0/3124346709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f924c15a390 con 0x7f924c0ca450 2023-07-06T21:41:47.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.550+0000 7f9248ff9640 1 -- 172.21.15.55:0/3124346709 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f92440c7020 con 0x7f924c0ca450 2023-07-06T21:41:47.554 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:41:47.555 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":10,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:41:47.210486+0000","last_up_change":"0.000000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:41:47.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.550+0000 7f92528d8640 1 -- 172.21.15.55:0/3124346709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f924c0ca450 msgr2=0x7f924c0c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:47.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.550+0000 7f92528d8640 1 --2- 172.21.15.55:0/3124346709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f924c0ca450 0x7f924c0c93b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f92440195b0 tx=0x7f9244019740 comp rx=0 tx=0).stop 2023-07-06T21:41:47.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.550+0000 7f92528d8640 1 -- 172.21.15.55:0/3124346709 shutdown_connections 2023-07-06T21:41:47.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.550+0000 7f92528d8640 1 --2- 172.21.15.55:0/3124346709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f924c0ca450 0x7f924c0c93b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.550+0000 7f92528d8640 1 --2- 172.21.15.55:0/3124346709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f924c0b3730 0x7f924c0cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.550+0000 7f92528d8640 1 --2- 172.21.15.55:0/3124346709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f924c0712f0 0x7f924c153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:47.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.550+0000 7f92528d8640 1 -- 172.21.15.55:0/3124346709 >> 172.21.15.55:0/3124346709 conn(0x7f924c0cded0 msgr2=0x7f924c0b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:47.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.550+0000 7f92528d8640 1 -- 172.21.15.55:0/3124346709 shutdown_connections 2023-07-06T21:41:47.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:41:47.550+0000 7f92528d8640 1 -- 172.21.15.55:0/3124346709 wait complete. 2023-07-06T21:41:47.574 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-06T21:41:47.575 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-06T21:41:47.603 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:41:47.603 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:41:47.604 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:41:47.639 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:47.634+0000 7f947aa46180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:41:47.778 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:47.774+0000 7f947aa46180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:41:47.904 INFO:tasks.ceph.osd.5.smithi138.stderr:2023-07-06T21:41:47.904+0000 7f8aad4f7640 -1 Falling back to public interface 2023-07-06T21:41:47.905 INFO:tasks.ceph.osd.6.smithi138.stderr:2023-07-06T21:41:47.904+0000 7f812f62b640 -1 Falling back to public interface 2023-07-06T21:41:47.946 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-07-06T21:41:47.942+0000 7f7db93ef640 -1 Falling back to public interface 2023-07-06T21:41:47.952 INFO:tasks.ceph.osd.7.smithi138.stderr:2023-07-06T21:41:47.952+0000 7fdba4d67640 -1 Falling back to public interface 2023-07-06T21:41:47.953 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:47.950+0000 7f947aa46180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:41:47.960 INFO:tasks.ceph.osd.4.smithi138.stderr:2023-07-06T21:41:47.960+0000 7f7e2e48e640 -1 Falling back to public interface 2023-07-06T21:41:47.971 INFO:tasks.ceph.osd.3.smithi055.stderr:2023-07-06T21:41:47.966+0000 7f89c0e2b640 -1 Falling back to public interface 2023-07-06T21:41:47.973 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:41:47.974 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:41:47.974 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:41:47.974 INFO:tasks.ceph.osd.1.smithi055.stderr:2023-07-06T21:41:47.970+0000 7f3a5a67e640 -1 Falling back to public interface 2023-07-06T21:41:47.974 INFO:tasks.ceph.osd.2.smithi055.stderr:2023-07-06T21:41:47.970+0000 7f1caeea7640 -1 Falling back to public interface 2023-07-06T21:41:48.033 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:48.031+0000 7f3582ad9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:41:48.036 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:48.030+0000 7f947aa46180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:41:48.165 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:48.163+0000 7f3582ad9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:41:48.178 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:48.174+0000 7f947aa46180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:41:48.353 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:48.351+0000 7f3582ad9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:41:48.379 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-06T21:41:48.425 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:48.423+0000 7f3582ad9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:41:48.511 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.505+0000 7fbfe44cb640 1 Processor -- start 2023-07-06T21:41:48.511 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.505+0000 7fbfe44cb640 1 -- start start 2023-07-06T21:41:48.513 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.505+0000 7fbfe44cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfdc0b3b80 0x7fbfdc06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:48.513 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.505+0000 7fbfe44cb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbfdc0cffb0 0x7fbfdc0d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:48.513 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.505+0000 7fbfe44cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc0ccef0 con 0x7fbfdc0cc750 2023-07-06T21:41:48.514 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.505+0000 7fbfe44cb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc0ccc10 con 0x7fbfdc0cffb0 2023-07-06T21:41:48.514 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.505+0000 7fbfe44cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0cf000 con 0x7fbfdc0b3b80 2023-07-06T21:41:48.514 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.505+0000 7fbfe2a68640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbfdc0cffb0 0x7fbfdc0d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:48.514 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.505+0000 7fbfe2267640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfdc0b3b80 0x7fbfdc06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:48.515 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.505+0000 7fbfe2267640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfdc0b3b80 0x7fbfdc06a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:53296/0 (socket says 172.21.15.55:53296) 2023-07-06T21:41:48.515 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.505+0000 7fbfe2a68640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbfdc0cffb0 0x7fbfdc0d03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:56876/0 (socket says 172.21.15.55:56876) 2023-07-06T21:41:48.515 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.505+0000 7fbfe2267640 1 -- 172.21.15.55:0/1148459875 learned_addr learned my addr 172.21.15.55:0/1148459875 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:41:48.516 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.509+0000 7fbfe2267640 1 -- 172.21.15.55:0/1148459875 >> v2:172.21.15.138:3300/0 conn(0x7fbfdc0cffb0 msgr2=0x7fbfdc0d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:41:48.516 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.509+0000 7fbfe2267640 1 --2- 172.21.15.55:0/1148459875 >> v2:172.21.15.138:3300/0 conn(0x7fbfdc0cffb0 0x7fbfdc0d03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:48.516 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.509+0000 7fbfe2267640 1 -- 172.21.15.55:0/1148459875 >> v1:172.21.15.138:6789/0 conn(0x7fbfdc0cc750 legacy=0x7fbfdc0b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:48.516 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.509+0000 7fbfe2267640 1 -- 172.21.15.55:0/1148459875 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc0cf2e0 con 0x7fbfdc0b3b80 2023-07-06T21:41:48.516 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.509+0000 7fbfe2a68640 1 --2- 172.21.15.55:0/1148459875 >> v2:172.21.15.138:3300/0 conn(0x7fbfdc0cffb0 0x7fbfdc0d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:41:48.517 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.509+0000 7fbfe2267640 1 --2- 172.21.15.55:0/1148459875 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfdc0b3b80 0x7fbfdc06a990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009870 tx=0x7fbfd801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dd2a59009a0d51 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:48.517 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.509+0000 7fbfe1265640 1 -- 172.21.15.55:0/1148459875 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80ab600 con 0x7fbfdc0b3b80 2023-07-06T21:41:48.518 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.509+0000 7fbfe1265640 1 -- 172.21.15.55:0/1148459875 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd80a7050 con 0x7fbfdc0b3b80 2023-07-06T21:41:48.518 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.509+0000 7fbfe1265640 1 -- 172.21.15.55:0/1148459875 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80ab980 con 0x7fbfdc0b3b80 2023-07-06T21:41:48.518 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.509+0000 7fbfe44cb640 1 -- 172.21.15.55:0/1148459875 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfdc0b3b80 msgr2=0x7fbfdc06a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:48.518 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.509+0000 7fbfe44cb640 1 --2- 172.21.15.55:0/1148459875 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfdc0b3b80 0x7fbfdc06a990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009870 tx=0x7fbfd801c540 comp rx=0 tx=0).stop 2023-07-06T21:41:48.518 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe44cb640 1 -- 172.21.15.55:0/1148459875 shutdown_connections 2023-07-06T21:41:48.519 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe44cb640 1 --2- 172.21.15.55:0/1148459875 >> v2:172.21.15.138:3300/0 conn(0x7fbfdc0cffb0 0x7fbfdc0d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:48.519 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe44cb640 1 --2- 172.21.15.55:0/1148459875 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfdc0b3b80 0x7fbfdc06a990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:48.519 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe44cb640 1 -- 172.21.15.55:0/1148459875 >> 172.21.15.55:0/1148459875 conn(0x7fbfdc0717b0 msgr2=0x7fbfdc069e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:48.519 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe44cb640 1 -- 172.21.15.55:0/1148459875 shutdown_connections 2023-07-06T21:41:48.519 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe44cb640 1 -- 172.21.15.55:0/1148459875 wait complete. 2023-07-06T21:41:48.520 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe44cb640 1 Processor -- start 2023-07-06T21:41:48.521 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe44cb640 1 -- start start 2023-07-06T21:41:48.521 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe44cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfdc0b3b80 0x7fbfdc0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:48.521 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe44cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cc750 0x7fbfdc153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:48.521 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe44cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfdc0cffb0 0x7fbfdc1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:48.521 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe44cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc15cf00 con 0x7fbfdc0cc750 2023-07-06T21:41:48.521 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe44cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc154970 con 0x7fbfdc0cffb0 2023-07-06T21:41:48.521 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe44cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0cad20 con 0x7fbfdc0b3b80 2023-07-06T21:41:48.522 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe1a66640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cc750 0x7fbfdc153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:48.522 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe1a66640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cc750 0x7fbfdc153b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49294/0 (socket says 172.21.15.55:49294) 2023-07-06T21:41:48.522 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe1a66640 1 -- 172.21.15.55:0/2015591358 learned_addr learned my addr 172.21.15.55:0/2015591358 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:41:48.522 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe2267640 1 --2- 172.21.15.55:0/2015591358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfdc0b3b80 0x7fbfdc0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:48.522 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe2a68640 1 --2- 172.21.15.55:0/2015591358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfdc0cffb0 0x7fbfdc1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:48.522 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe1a66640 1 -- 172.21.15.55:0/2015591358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfdc0b3b80 msgr2=0x7fbfdc0cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:48.522 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe1a66640 1 --2- 172.21.15.55:0/2015591358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfdc0b3b80 0x7fbfdc0cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:48.523 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe1a66640 1 -- 172.21.15.55:0/2015591358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfdc0cffb0 msgr2=0x7fbfdc1540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:48.523 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe1a66640 1 --2- 172.21.15.55:0/2015591358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfdc0cffb0 0x7fbfdc1540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:48.523 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.513+0000 7fbfe1a66640 1 -- 172.21.15.55:0/2015591358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4009a70 con 0x7fbfdc0cc750 2023-07-06T21:41:48.524 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.517+0000 7fbfe1a66640 1 --2- 172.21.15.55:0/2015591358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cc750 0x7fbfdc153b60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c390 tx=0x7fbfcc00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:48.524 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.517+0000 7fbfd2ffd640 1 -- 172.21.15.55:0/2015591358 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0052d0 con 0x7fbfdc0cc750 2023-07-06T21:41:48.524 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.517+0000 7fbfd2ffd640 1 -- 172.21.15.55:0/2015591358 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc005430 con 0x7fbfdc0cc750 2023-07-06T21:41:48.525 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.517+0000 7fbfd2ffd640 1 -- 172.21.15.55:0/2015591358 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc003820 con 0x7fbfdc0cc750 2023-07-06T21:41:48.525 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.517+0000 7fbfe44cb640 1 -- 172.21.15.55:0/2015591358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd80094d0 con 0x7fbfdc0cc750 2023-07-06T21:41:48.525 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.517+0000 7fbfe44cb640 1 -- 172.21.15.55:0/2015591358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc0cb2e0 con 0x7fbfdc0cc750 2023-07-06T21:41:48.525 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.517+0000 7fbfd2ffd640 1 -- 172.21.15.55:0/2015591358 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbfcc003c80 con 0x7fbfdc0cc750 2023-07-06T21:41:48.525 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.517+0000 7fbfd2ffd640 1 -- 172.21.15.55:0/2015591358 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fbfcc012af0 con 0x7fbfdc0cc750 2023-07-06T21:41:48.526 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.517+0000 7fbfe44cb640 1 -- 172.21.15.55:0/2015591358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc066d60 con 0x7fbfdc0cc750 2023-07-06T21:41:48.526 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.517+0000 7fbfd2ffd640 1 -- 172.21.15.55:0/2015591358 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fbfcc017070 con 0x7fbfdc0cc750 2023-07-06T21:41:48.563 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:48.559+0000 7f3582ad9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:41:48.583 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.577+0000 7fbfe44cb640 1 -- 172.21.15.55:0/2015591358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfdc15bba0 con 0x7fbfdc0cc750 2023-07-06T21:41:48.583 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.577+0000 7fbfd2ffd640 1 -- 172.21.15.55:0/2015591358 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fbfcc012420 con 0x7fbfdc0cc750 2023-07-06T21:41:48.584 INFO:teuthology.misc.health.smithi055.stdout: 2023-07-06T21:41:48.584 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":10,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:41:47.210486+0000","last_up_change":"0.000000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:41:48.585 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.577+0000 7fbfe44cb640 1 -- 172.21.15.55:0/2015591358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cc750 msgr2=0x7fbfdc153b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:48.585 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.577+0000 7fbfe44cb640 1 --2- 172.21.15.55:0/2015591358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cc750 0x7fbfdc153b60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c390 tx=0x7fbfcc00c790 comp rx=0 tx=0).stop 2023-07-06T21:41:48.585 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.577+0000 7fbfe44cb640 1 -- 172.21.15.55:0/2015591358 shutdown_connections 2023-07-06T21:41:48.585 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.577+0000 7fbfe44cb640 1 --2- 172.21.15.55:0/2015591358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfdc0cffb0 0x7fbfdc1540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:48.585 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.577+0000 7fbfe44cb640 1 --2- 172.21.15.55:0/2015591358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cc750 0x7fbfdc153b60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:48.586 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.577+0000 7fbfe44cb640 1 --2- 172.21.15.55:0/2015591358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfdc0b3b80 0x7fbfdc0cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:48.586 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.577+0000 7fbfe44cb640 1 -- 172.21.15.55:0/2015591358 >> 172.21.15.55:0/2015591358 conn(0x7fbfdc0717b0 msgr2=0x7fbfdc0ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:48.586 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.577+0000 7fbfe44cb640 1 -- 172.21.15.55:0/2015591358 shutdown_connections 2023-07-06T21:41:48.586 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:48.577+0000 7fbfe44cb640 1 -- 172.21.15.55:0/2015591358 wait complete. 2023-07-06T21:41:48.602 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-06T21:41:48.886 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:48.881+0000 7f947aa46180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:41:48.977 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:48.973+0000 7f947aa46180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:41:49.174 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:49.169+0000 7f947aa46180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:41:49.223 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:49.219+0000 7f3582ad9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:41:49.262 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:49.257+0000 7f947aa46180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:41:49.308 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:49.307+0000 7f3582ad9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:41:49.499 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:49.495+0000 7f3582ad9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:41:49.557 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:49.553+0000 7f947aa46180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:41:49.584 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:49.583+0000 7f3582ad9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:41:49.628 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:49.621+0000 7f947aa46180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:41:49.870 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:49.867+0000 7f3582ad9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:41:49.937 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:41:49.935+0000 7f3582ad9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:41:50.648 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:50.641+0000 7f942184b640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-06T21:41:50.651 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:41:50.645+0000 7f942184b640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-06T21:41:51.754 INFO:tasks.ceph.osd.6.smithi138.stderr:2023-07-06T21:41:51.751+0000 7f812f62b640 -1 osd.6 0 log_to_monitors true 2023-07-06T21:41:51.838 INFO:tasks.ceph.osd.7.smithi138.stderr:2023-07-06T21:41:51.835+0000 7fdba4d67640 -1 osd.7 0 log_to_monitors true 2023-07-06T21:41:51.838 INFO:tasks.ceph.osd.5.smithi138.stderr:2023-07-06T21:41:51.835+0000 7f8aad4f7640 -1 osd.5 0 log_to_monitors true 2023-07-06T21:41:51.865 INFO:tasks.ceph.osd.3.smithi055.stderr:2023-07-06T21:41:51.857+0000 7f89c0e2b640 -1 osd.3 0 log_to_monitors true 2023-07-06T21:41:51.873 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-07-06T21:41:51.865+0000 7f7db93ef640 -1 osd.0 0 log_to_monitors true 2023-07-06T21:41:51.916 INFO:tasks.ceph.osd.4.smithi138.stderr:2023-07-06T21:41:51.915+0000 7f7e2e48e640 -1 osd.4 0 log_to_monitors true 2023-07-06T21:41:51.954 INFO:tasks.ceph.osd.2.smithi055.stderr:2023-07-06T21:41:51.949+0000 7f1caeea7640 -1 osd.2 0 log_to_monitors true 2023-07-06T21:41:52.005 INFO:tasks.ceph.osd.1.smithi055.stderr:2023-07-06T21:41:52.001+0000 7f3a5a67e640 -1 osd.1 0 log_to_monitors true 2023-07-06T21:41:55.408 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-06T21:41:55.652 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.645+0000 7fed36dad640 1 Processor -- start 2023-07-06T21:41:55.653 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.645+0000 7fed36dad640 1 -- start start 2023-07-06T21:41:55.654 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.649+0000 7fed36dad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed300b3b80 0x7fed300b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:55.655 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.649+0000 7fed36dad640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fed300b4790 0x7fed300d18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:55.655 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.649+0000 7fed36dad640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed300d1420 con 0x7fed300cc750 2023-07-06T21:41:55.655 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.649+0000 7fed36dad640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed300b4490 con 0x7fed300b4790 2023-07-06T21:41:55.655 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.649+0000 7fed36dad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed300d0810 con 0x7fed300b3b80 2023-07-06T21:41:55.655 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.649+0000 7fed34b49640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed300b3b80 0x7fed300b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:55.656 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.649+0000 7fed34b49640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed300b3b80 0x7fed300b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:36154/0 (socket says 172.21.15.55:36154) 2023-07-06T21:41:55.656 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.649+0000 7fed34b49640 1 -- 172.21.15.55:0/4134969281 learned_addr learned my addr 172.21.15.55:0/4134969281 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:41:55.656 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.649+0000 7fed34b49640 1 -- 172.21.15.55:0/4134969281 >> v2:172.21.15.138:3300/0 conn(0x7fed300b4790 msgr2=0x7fed300d18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:41:55.657 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.649+0000 7fed2f7fe640 1 -- 172.21.15.55:0/4134969281 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702758555 0 0) 0x7fed300d1420 con 0x7fed300cc750 2023-07-06T21:41:55.657 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.649+0000 7fed2ffff640 1 --2- 172.21.15.55:0/4134969281 >> v2:172.21.15.138:3300/0 conn(0x7fed300b4790 0x7fed300d18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:55.657 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.649+0000 7fed34b49640 1 --2- 172.21.15.55:0/4134969281 >> v2:172.21.15.138:3300/0 conn(0x7fed300b4790 0x7fed300d18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:55.657 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.649+0000 7fed34b49640 1 -- 172.21.15.55:0/4134969281 >> v1:172.21.15.55:6789/0 conn(0x7fed300cc750 legacy=0x7fed300b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:55.658 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.653+0000 7fed34b49640 1 -- 172.21.15.55:0/4134969281 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed300d0af0 con 0x7fed300b3b80 2023-07-06T21:41:55.658 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.653+0000 7fed2ffff640 1 --2- 172.21.15.55:0/4134969281 >> v2:172.21.15.138:3300/0 conn(0x7fed300b4790 0x7fed300d18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:41:55.662 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.657+0000 7fed34b49640 1 --2- 172.21.15.55:0/4134969281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed300b3b80 0x7fed300b3f50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed18009870 tx=0x7fed1801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e12551642d736bfc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:55.663 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.657+0000 7fed2f7fe640 1 -- 172.21.15.55:0/4134969281 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed180a7070 con 0x7fed300b3b80 2023-07-06T21:41:55.663 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.657+0000 7fed2f7fe640 1 -- 172.21.15.55:0/4134969281 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed180ab430 con 0x7fed300b3b80 2023-07-06T21:41:55.663 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.657+0000 7fed2f7fe640 1 -- 172.21.15.55:0/4134969281 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed180a7070 con 0x7fed300b3b80 2023-07-06T21:41:55.664 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.657+0000 7fed36dad640 1 -- 172.21.15.55:0/4134969281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed300b3b80 msgr2=0x7fed300b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:55.664 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.657+0000 7fed36dad640 1 --2- 172.21.15.55:0/4134969281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed300b3b80 0x7fed300b3f50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed18009870 tx=0x7fed1801c540 comp rx=0 tx=0).stop 2023-07-06T21:41:55.664 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.657+0000 7fed36dad640 1 -- 172.21.15.55:0/4134969281 shutdown_connections 2023-07-06T21:41:55.665 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.657+0000 7fed36dad640 1 --2- 172.21.15.55:0/4134969281 >> v2:172.21.15.138:3300/0 conn(0x7fed300b4790 0x7fed300d18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:55.665 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.657+0000 7fed36dad640 1 --2- 172.21.15.55:0/4134969281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed300b3b80 0x7fed300b3f50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:55.665 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.657+0000 7fed36dad640 1 -- 172.21.15.55:0/4134969281 >> 172.21.15.55:0/4134969281 conn(0x7fed30069e40 msgr2=0x7fed3006a240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:55.665 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.657+0000 7fed36dad640 1 -- 172.21.15.55:0/4134969281 shutdown_connections 2023-07-06T21:41:55.665 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.657+0000 7fed36dad640 1 -- 172.21.15.55:0/4134969281 wait complete. 2023-07-06T21:41:55.667 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.661+0000 7fed36dad640 1 Processor -- start 2023-07-06T21:41:55.667 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.661+0000 7fed36dad640 1 -- start start 2023-07-06T21:41:55.669 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.661+0000 7fed36dad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed300b3b80 0x7fed30200bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:55.669 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.661+0000 7fed36dad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed300b4790 0x7fed300b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:55.669 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.661+0000 7fed36dad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed300cc750 0x7fed300b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:55.670 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.661+0000 7fed36dad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed300b68d0 con 0x7fed300cc750 2023-07-06T21:41:55.670 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.661+0000 7fed36dad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed300b7b50 con 0x7fed300b3b80 2023-07-06T21:41:55.670 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.665+0000 7fed36dad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed300b5b10 con 0x7fed300b4790 2023-07-06T21:41:55.671 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.665+0000 7fed34b49640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed300b3b80 0x7fed30200bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:55.671 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.665+0000 7fed34b49640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed300b3b80 0x7fed30200bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:50482/0 (socket says 172.21.15.55:50482) 2023-07-06T21:41:55.671 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.665+0000 7fed34b49640 1 -- 172.21.15.55:0/3202939035 learned_addr learned my addr 172.21.15.55:0/3202939035 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:41:55.671 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.665+0000 7fed3534a640 1 --2- 172.21.15.55:0/3202939035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed300cc750 0x7fed300b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:55.671 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.665+0000 7fed34b49640 1 -- 172.21.15.55:0/3202939035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed300b4790 msgr2=0x7fed300b7000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:41:55.671 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.665+0000 7fed34b49640 1 --2- 172.21.15.55:0/3202939035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed300b4790 0x7fed300b7000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:55.671 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.665+0000 7fed34b49640 1 -- 172.21.15.55:0/3202939035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed300cc750 msgr2=0x7fed300b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:55.672 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.665+0000 7fed34b49640 1 --2- 172.21.15.55:0/3202939035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed300cc750 0x7fed300b7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:55.672 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.665+0000 7fed34b49640 1 -- 172.21.15.55:0/3202939035 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed180094d0 con 0x7fed300b3b80 2023-07-06T21:41:55.672 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.665+0000 7fed34b49640 1 --2- 172.21.15.55:0/3202939035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed300b3b80 0x7fed30200bc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fed1801abf0 tx=0x7fed1801ad80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:55.672 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.665+0000 7fed2d7fa640 1 -- 172.21.15.55:0/3202939035 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed18003c70 con 0x7fed300b3b80 2023-07-06T21:41:55.673 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.665+0000 7fed36dad640 1 -- 172.21.15.55:0/3202939035 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed300d1f70 con 0x7fed300b3b80 2023-07-06T21:41:55.673 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.665+0000 7fed36dad640 1 -- 172.21.15.55:0/3202939035 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed300b60d0 con 0x7fed300b3b80 2023-07-06T21:41:55.673 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.669+0000 7fed2d7fa640 1 -- 172.21.15.55:0/3202939035 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed18003dd0 con 0x7fed300b3b80 2023-07-06T21:41:55.674 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.669+0000 7fed2d7fa640 1 -- 172.21.15.55:0/3202939035 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed180ab7a0 con 0x7fed300b3b80 2023-07-06T21:41:55.675 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.669+0000 7fed26ffd640 1 -- 172.21.15.55:0/3202939035 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed08005260 con 0x7fed300b3b80 2023-07-06T21:41:55.676 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.669+0000 7fed2d7fa640 1 -- 172.21.15.55:0/3202939035 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7fed180ab9c0 con 0x7fed300b3b80 2023-07-06T21:41:55.677 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.673+0000 7fed2d7fa640 1 --2- 172.21.15.55:0/3202939035 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fed100661f0 0x7fed100686a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:41:55.678 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.673+0000 7fed2d7fa640 1 -- 172.21.15.55:0/3202939035 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fed1811d0b0 con 0x7fed300b3b80 2023-07-06T21:41:55.678 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.673+0000 7fed2ffff640 1 --2- 172.21.15.55:0/3202939035 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fed100661f0 0x7fed100686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:41:55.679 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.673+0000 7fed2ffff640 1 --2- 172.21.15.55:0/3202939035 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fed100661f0 0x7fed100686a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fed30157d90 tx=0x7fed28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:41:55.686 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:55.681+0000 7fed2d7fa640 1 -- 172.21.15.55:0/3202939035 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed180eb5b0 con 0x7fed300b3b80 2023-07-06T21:41:56.019 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:56.013+0000 7fed26ffd640 1 -- 172.21.15.55:0/3202939035 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed08005510 con 0x7fed300b3b80 2023-07-06T21:41:56.020 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:56.013+0000 7fed2d7fa640 1 -- 172.21.15.55:0/3202939035 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fed180eebd0 con 0x7fed300b3b80 2023-07-06T21:41:56.023 INFO:teuthology.misc.health.smithi055.stdout: 2023-07-06T21:41:56.023 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":12,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:41:53.653381+0000","last_up_change":"0.000000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:41:56.027 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:56.021+0000 7fed26ffd640 1 -- 172.21.15.55:0/3202939035 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fed100661f0 msgr2=0x7fed100686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:56.027 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:56.021+0000 7fed26ffd640 1 --2- 172.21.15.55:0/3202939035 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fed100661f0 0x7fed100686a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fed30157d90 tx=0x7fed28008040 comp rx=0 tx=0).stop 2023-07-06T21:41:56.027 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:56.021+0000 7fed26ffd640 1 -- 172.21.15.55:0/3202939035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed300b3b80 msgr2=0x7fed30200bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:41:56.027 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:56.021+0000 7fed26ffd640 1 --2- 172.21.15.55:0/3202939035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed300b3b80 0x7fed30200bc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fed1801abf0 tx=0x7fed1801ad80 comp rx=0 tx=0).stop 2023-07-06T21:41:56.028 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:56.021+0000 7fed26ffd640 1 -- 172.21.15.55:0/3202939035 shutdown_connections 2023-07-06T21:41:56.028 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:56.021+0000 7fed26ffd640 1 --2- 172.21.15.55:0/3202939035 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fed100661f0 0x7fed100686a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:56.028 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:56.021+0000 7fed26ffd640 1 --2- 172.21.15.55:0/3202939035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed300cc750 0x7fed300b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:56.028 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:56.021+0000 7fed26ffd640 1 --2- 172.21.15.55:0/3202939035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed300b4790 0x7fed300b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:56.029 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:56.021+0000 7fed26ffd640 1 --2- 172.21.15.55:0/3202939035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed300b3b80 0x7fed30200bc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:41:56.029 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:56.021+0000 7fed26ffd640 1 -- 172.21.15.55:0/3202939035 >> 172.21.15.55:0/3202939035 conn(0x7fed30069e40 msgr2=0x7fed3014b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:41:56.029 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:56.021+0000 7fed26ffd640 1 -- 172.21.15.55:0/3202939035 shutdown_connections 2023-07-06T21:41:56.029 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:41:56.021+0000 7fed26ffd640 1 -- 172.21.15.55:0/3202939035 wait complete. 2023-07-06T21:41:56.068 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-06T21:41:56.133 INFO:tasks.ceph.osd.7.smithi138.stderr:2023-07-06T21:41:56.131+0000 7fdba0d0e640 -1 osd.7 0 waiting for initial osdmap 2023-07-06T21:41:56.142 INFO:tasks.ceph.osd.6.smithi138.stderr:2023-07-06T21:41:56.139+0000 7f812abbd640 -1 osd.6 0 waiting for initial osdmap 2023-07-06T21:41:56.172 INFO:tasks.ceph.osd.7.smithi138.stderr:2023-07-06T21:41:56.171+0000 7fdb98b41640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T21:41:56.177 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-07-06T21:41:56.169+0000 7f7db5396640 -1 osd.0 0 waiting for initial osdmap 2023-07-06T21:41:56.185 INFO:tasks.ceph.osd.5.smithi138.stderr:2023-07-06T21:41:56.183+0000 7f8aa949c640 -1 osd.5 0 waiting for initial osdmap 2023-07-06T21:41:56.196 INFO:tasks.ceph.osd.6.smithi138.stderr:2023-07-06T21:41:56.195+0000 7f81229f0640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T21:41:56.207 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-07-06T21:41:56.201+0000 7f7dad1c9640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T21:41:56.208 INFO:tasks.ceph.osd.4.smithi138.stderr:2023-07-06T21:41:56.207+0000 7f7e2a435640 -1 osd.4 0 waiting for initial osdmap 2023-07-06T21:41:56.221 INFO:tasks.ceph.osd.3.smithi055.stderr:2023-07-06T21:41:56.213+0000 7f89bc39c640 -1 osd.3 0 waiting for initial osdmap 2023-07-06T21:41:56.224 INFO:tasks.ceph.osd.5.smithi138.stderr:2023-07-06T21:41:56.223+0000 7f8aa12cf640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T21:41:56.256 INFO:tasks.ceph.osd.4.smithi138.stderr:2023-07-06T21:41:56.255+0000 7f7e22268640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T21:41:56.257 INFO:tasks.ceph.osd.1.smithi055.stderr:2023-07-06T21:41:56.249+0000 7f3a56623640 -1 osd.1 0 waiting for initial osdmap 2023-07-06T21:41:56.266 INFO:tasks.ceph.osd.3.smithi055.stderr:2023-07-06T21:41:56.261+0000 7f89b41cf640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T21:41:56.275 INFO:tasks.ceph.osd.2.smithi055.stderr:2023-07-06T21:41:56.269+0000 7f1caae4c640 -1 osd.2 0 waiting for initial osdmap 2023-07-06T21:41:56.298 INFO:tasks.ceph.osd.1.smithi055.stderr:2023-07-06T21:41:56.293+0000 7f3a4e456640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T21:41:56.310 INFO:tasks.ceph.osd.2.smithi055.stderr:2023-07-06T21:41:56.305+0000 7f1ca2c7f640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T21:42:02.874 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:03.016 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.012+0000 7fa0b95d2640 1 Processor -- start 2023-07-06T21:42:03.016 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.012+0000 7fa0b95d2640 1 -- start start 2023-07-06T21:42:03.017 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.012+0000 7fa0b95d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0b41454a0 0x7fa0b40ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:03.017 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.012+0000 7fa0b95d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b40caf90 con 0x7fa0b406ac10 2023-07-06T21:42:03.018 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.012+0000 7fa0b95d2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b40cb270 con 0x7fa0b40caa30 2023-07-06T21:42:03.018 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.012+0000 7fa0b95d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40cb550 con 0x7fa0b41454a0 2023-07-06T21:42:03.019 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.016+0000 7fa0b37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa0b406ac10 0x7fa0b41654c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49046/0 (socket says 172.21.15.55:49046) 2023-07-06T21:42:03.019 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.016+0000 7fa0b37fe640 1 -- 172.21.15.55:0/4185617512 learned_addr learned my addr 172.21.15.55:0/4185617512 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:03.019 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.016+0000 7fa0b2ffd640 1 --2- 172.21.15.55:0/4185617512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0b41454a0 0x7fa0b40ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:03.019 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.016+0000 7fa0b27fc640 1 -- 172.21.15.55:0/4185617512 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043231779 0 0) 0x7fa0b40caf90 con 0x7fa0b406ac10 2023-07-06T21:42:03.019 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.016+0000 7fa0b27fc640 1 -- 172.21.15.55:0/4185617512 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0a0003530 con 0x7fa0b406ac10 2023-07-06T21:42:03.019 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.016+0000 7fa0b27fc640 1 -- 172.21.15.55:0/4185617512 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242103723 0 0) 0x7fa0b40cb270 con 0x7fa0b40caa30 2023-07-06T21:42:03.020 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.016+0000 7fa0b27fc640 1 -- 172.21.15.55:0/4185617512 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b40caf90 con 0x7fa0b40caa30 2023-07-06T21:42:03.020 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.016+0000 7fa0b2ffd640 1 -- 172.21.15.55:0/4185617512 >> v1:172.21.15.138:6789/0 conn(0x7fa0b40caa30 legacy=0x7fa0b406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:03.020 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.016+0000 7fa0b2ffd640 1 -- 172.21.15.55:0/4185617512 >> v1:172.21.15.55:6789/0 conn(0x7fa0b406ac10 legacy=0x7fa0b41654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:03.020 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.016+0000 7fa0b27fc640 1 -- 172.21.15.55:0/4185617512 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3682465835 0 0) 0x7fa0a0003530 con 0x7fa0b406ac10 2023-07-06T21:42:03.020 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.016+0000 7fa0b2ffd640 1 -- 172.21.15.55:0/4185617512 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b40cb830 con 0x7fa0b41454a0 2023-07-06T21:42:03.021 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.016+0000 7fa0b2ffd640 1 --2- 172.21.15.55:0/4185617512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0b41454a0 0x7fa0b40ca4f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40097d0 tx=0x7fa0a401c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ced743b0f1e088d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:03.022 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b27fc640 1 -- 172.21.15.55:0/4185617512 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac001a00 con 0x7fa0b41454a0 2023-07-06T21:42:03.022 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b27fc640 1 -- 172.21.15.55:0/4185617512 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a40a7050 con 0x7fa0b41454a0 2023-07-06T21:42:03.022 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b27fc640 1 -- 172.21.15.55:0/4185617512 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a40ab620 con 0x7fa0b41454a0 2023-07-06T21:42:03.023 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 -- 172.21.15.55:0/4185617512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0b41454a0 msgr2=0x7fa0b40ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:03.023 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 --2- 172.21.15.55:0/4185617512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0b41454a0 0x7fa0b40ca4f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40097d0 tx=0x7fa0a401c390 comp rx=0 tx=0).stop 2023-07-06T21:42:03.024 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 -- 172.21.15.55:0/4185617512 shutdown_connections 2023-07-06T21:42:03.024 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 --2- 172.21.15.55:0/4185617512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0b41454a0 0x7fa0b40ca4f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:03.024 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 -- 172.21.15.55:0/4185617512 >> 172.21.15.55:0/4185617512 conn(0x7fa0b40992c0 msgr2=0x7fa0b4089f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:03.024 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 -- 172.21.15.55:0/4185617512 shutdown_connections 2023-07-06T21:42:03.024 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 -- 172.21.15.55:0/4185617512 wait complete. 2023-07-06T21:42:03.025 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 Processor -- start 2023-07-06T21:42:03.025 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 -- start start 2023-07-06T21:42:03.026 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0b406ac10 0x7fa0b40ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:03.026 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b40caa30 0x7fa0b40c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:03.026 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0b41454a0 0x7fa0b40c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:03.026 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b415ab30 con 0x7fa0b40caa30 2023-07-06T21:42:03.027 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40c6f70 con 0x7fa0b406ac10 2023-07-06T21:42:03.027 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0b95d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40c7250 con 0x7fa0b41454a0 2023-07-06T21:42:03.027 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.020+0000 7fa0abfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b40caa30 0x7fa0b40c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:03.027 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0abfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b40caa30 0x7fa0b40c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40598/0 (socket says 172.21.15.55:40598) 2023-07-06T21:42:03.027 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0abfff640 1 -- 172.21.15.55:0/967862514 learned_addr learned my addr 172.21.15.55:0/967862514 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:03.027 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0b37fe640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0b41454a0 0x7fa0b40c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:03.027 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0b2ffd640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0b406ac10 0x7fa0b40ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:03.028 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0abfff640 1 -- 172.21.15.55:0/967862514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0b41454a0 msgr2=0x7fa0b40c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:03.028 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0abfff640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0b41454a0 0x7fa0b40c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:03.028 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0abfff640 1 -- 172.21.15.55:0/967862514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0b406ac10 msgr2=0x7fa0b40ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:03.028 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0abfff640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0b406ac10 0x7fa0b40ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:03.028 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0abfff640 1 -- 172.21.15.55:0/967862514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a40093b0 con 0x7fa0b40caa30 2023-07-06T21:42:03.028 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0b2ffd640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0b406ac10 0x7fa0b40ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:03.029 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0abfff640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b40caa30 0x7fa0b40c8b70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00c490 tx=0x7fa09c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:03.029 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0ab7fe640 1 -- 172.21.15.55:0/967862514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0052d0 con 0x7fa0b40caa30 2023-07-06T21:42:03.030 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0ab7fe640 1 -- 172.21.15.55:0/967862514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c005430 con 0x7fa0b40caa30 2023-07-06T21:42:03.030 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0ab7fe640 1 -- 172.21.15.55:0/967862514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c012870 con 0x7fa0b40caa30 2023-07-06T21:42:03.030 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0b95d2640 1 -- 172.21.15.55:0/967862514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b40c7530 con 0x7fa0b40caa30 2023-07-06T21:42:03.030 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0b95d2640 1 -- 172.21.15.55:0/967862514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b40c95f0 con 0x7fa0b40caa30 2023-07-06T21:42:03.030 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0b95d2640 1 -- 172.21.15.55:0/967862514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b40c7720 con 0x7fa0b40caa30 2023-07-06T21:42:03.031 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0ab7fe640 1 -- 172.21.15.55:0/967862514 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa09c0129d0 con 0x7fa0b40caa30 2023-07-06T21:42:03.031 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0ab7fe640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa094066280 0x7fa094068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:03.031 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.024+0000 7fa0ab7fe640 1 -- 172.21.15.55:0/967862514 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa09c0834f0 con 0x7fa0b40caa30 2023-07-06T21:42:03.031 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.028+0000 7fa0b2ffd640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa094066280 0x7fa094068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:03.031 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.028+0000 7fa0b2ffd640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa094066280 0x7fa094068730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40ad000 tx=0x7fa0a40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:03.034 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.032+0000 7fa0ab7fe640 1 -- 172.21.15.55:0/967862514 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa09c050d80 con 0x7fa0b40caa30 2023-07-06T21:42:03.191 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.188+0000 7fa0b95d2640 1 -- 172.21.15.55:0/967862514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0b406a710 con 0x7fa0b40caa30 2023-07-06T21:42:03.191 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.188+0000 7fa0ab7fe640 1 -- 172.21.15.55:0/967862514 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7fa09c0543a0 con 0x7fa0b40caa30 2023-07-06T21:42:03.192 INFO:teuthology.misc.health.smithi055.stdout: 2023-07-06T21:42:03.192 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":16,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:00.324960+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:03.194 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.188+0000 7fa0b95d2640 1 -- 172.21.15.55:0/967862514 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa094066280 msgr2=0x7fa094068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:03.194 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.188+0000 7fa0b95d2640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa094066280 0x7fa094068730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40ad000 tx=0x7fa0a40a6000 comp rx=0 tx=0).stop 2023-07-06T21:42:03.194 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.188+0000 7fa0b95d2640 1 -- 172.21.15.55:0/967862514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b40caa30 msgr2=0x7fa0b40c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:03.194 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.188+0000 7fa0b95d2640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b40caa30 0x7fa0b40c8b70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00c490 tx=0x7fa09c00c950 comp rx=0 tx=0).stop 2023-07-06T21:42:03.194 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.188+0000 7fa0b95d2640 1 -- 172.21.15.55:0/967862514 shutdown_connections 2023-07-06T21:42:03.194 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.188+0000 7fa0b95d2640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa094066280 0x7fa094068730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:03.195 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.188+0000 7fa0b95d2640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0b41454a0 0x7fa0b40c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:03.195 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.188+0000 7fa0b95d2640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b40caa30 0x7fa0b40c8b70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:03.195 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.188+0000 7fa0b95d2640 1 --2- 172.21.15.55:0/967862514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0b406ac10 0x7fa0b40ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:03.195 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.188+0000 7fa0b95d2640 1 -- 172.21.15.55:0/967862514 >> 172.21.15.55:0/967862514 conn(0x7fa0b40992c0 msgr2=0x7fa0b41584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:03.195 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.192+0000 7fa0b95d2640 1 -- 172.21.15.55:0/967862514 shutdown_connections 2023-07-06T21:42:03.195 INFO:teuthology.misc.health.smithi055.stderr:2023-07-06T21:42:03.192+0000 7fa0b95d2640 1 -- 172.21.15.55:0/967862514 wait complete. 2023-07-06T21:42:03.211 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-06T21:42:03.212 INFO:tasks.ceph:Creating RBD pool 2023-07-06T21:42:03.212 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-06T21:42:03.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.348+0000 7f1a1947b640 1 Processor -- start 2023-07-06T21:42:03.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.348+0000 7f1a1947b640 1 -- start start 2023-07-06T21:42:03.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.348+0000 7f1a1947b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a14070020 0x7f1a140ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:03.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.348+0000 7f1a1947b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a140cef40 0x7f1a140c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:03.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.348+0000 7f1a1947b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1415fe80 con 0x7f1a1415bb90 2023-07-06T21:42:03.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.348+0000 7f1a1947b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1415f620 con 0x7f1a14070020 2023-07-06T21:42:03.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.348+0000 7f1a1947b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1415bf60 con 0x7f1a140cef40 2023-07-06T21:42:03.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.348+0000 7f1a0bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a14070020 0x7f1a140ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:03.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.352+0000 7f1a0bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a14070020 0x7f1a140ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45630/0 (socket says 172.21.15.55:45630) 2023-07-06T21:42:03.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.352+0000 7f1a0bfff640 1 -- 172.21.15.55:0/2140977561 learned_addr learned my addr 172.21.15.55:0/2140977561 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:03.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.352+0000 7f1a137fe640 1 --2- 172.21.15.55:0/2140977561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a140cef40 0x7f1a140c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:03.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.352+0000 7f1a0bfff640 1 -- 172.21.15.55:0/2140977561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a140cef40 msgr2=0x7f1a140c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:03.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.352+0000 7f1a0bfff640 1 --2- 172.21.15.55:0/2140977561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a140cef40 0x7f1a140c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:03.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.352+0000 7f1a0bfff640 1 -- 172.21.15.55:0/2140977561 >> v1:172.21.15.138:6789/0 conn(0x7f1a1415bb90 legacy=0x7f1a1406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:03.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.352+0000 7f1a0bfff640 1 -- 172.21.15.55:0/2140977561 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140cf440 con 0x7f1a14070020 2023-07-06T21:42:03.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.352+0000 7f1a0bfff640 1 --2- 172.21.15.55:0/2140977561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a14070020 0x7f1a140ce030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009870 tx=0x7f19fc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953559a7ee4f4728 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:03.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.352+0000 7f1a127fc640 1 -- 172.21.15.55:0/2140977561 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0ab600 con 0x7f1a14070020 2023-07-06T21:42:03.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.352+0000 7f1a127fc640 1 -- 172.21.15.55:0/2140977561 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc0a7050 con 0x7f1a14070020 2023-07-06T21:42:03.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.352+0000 7f1a127fc640 1 -- 172.21.15.55:0/2140977561 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0ab980 con 0x7f1a14070020 2023-07-06T21:42:03.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 -- 172.21.15.55:0/2140977561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a14070020 msgr2=0x7f1a140ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:03.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 --2- 172.21.15.55:0/2140977561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a14070020 0x7f1a140ce030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009870 tx=0x7f19fc01c540 comp rx=0 tx=0).stop 2023-07-06T21:42:03.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 -- 172.21.15.55:0/2140977561 shutdown_connections 2023-07-06T21:42:03.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 --2- 172.21.15.55:0/2140977561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a140cef40 0x7f1a140c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:03.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 --2- 172.21.15.55:0/2140977561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a14070020 0x7f1a140ce030 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:03.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 -- 172.21.15.55:0/2140977561 >> 172.21.15.55:0/2140977561 conn(0x7f1a140cbd70 msgr2=0x7f1a140ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:03.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 -- 172.21.15.55:0/2140977561 shutdown_connections 2023-07-06T21:42:03.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 -- 172.21.15.55:0/2140977561 wait complete. 2023-07-06T21:42:03.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 Processor -- start 2023-07-06T21:42:03.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 -- start start 2023-07-06T21:42:03.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a14070020 0x7f1a140b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:03.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a140cef40 0x7f1a140b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:03.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1415bb90 0x7f1a1414a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:03.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140b1b60 con 0x7f1a140cef40 2023-07-06T21:42:03.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140b1e40 con 0x7f1a14070020 2023-07-06T21:42:03.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a1947b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140b2120 con 0x7f1a1415bb90 2023-07-06T21:42:03.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a0bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a140cef40 0x7f1a140b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:03.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a0bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a140cef40 0x7f1a140b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45646/0 (socket says 172.21.15.55:45646) 2023-07-06T21:42:03.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a0bfff640 1 -- 172.21.15.55:0/3130304396 learned_addr learned my addr 172.21.15.55:0/3130304396 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:03.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a137fe640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1415bb90 0x7f1a1414a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:03.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a12ffd640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a14070020 0x7f1a140b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:03.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a0bfff640 1 -- 172.21.15.55:0/3130304396 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1415bb90 msgr2=0x7f1a1414a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a0bfff640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1415bb90 0x7f1a1414a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a0bfff640 1 -- 172.21.15.55:0/3130304396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a14070020 msgr2=0x7f1a140b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a0bfff640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a14070020 0x7f1a140b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a0bfff640 1 -- 172.21.15.55:0/3130304396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc0094d0 con 0x7f1a140cef40 2023-07-06T21:42:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.356+0000 7f1a12ffd640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a14070020 0x7f1a140b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.360+0000 7f1a0bfff640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a140cef40 0x7f1a140b14d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0ae040 tx=0x7f19fc0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.360+0000 7f1a0b7fe640 1 -- 172.21.15.55:0/3130304396 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0b4420 con 0x7f1a140cef40 2023-07-06T21:42:03.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.360+0000 7f1a0b7fe640 1 -- 172.21.15.55:0/3130304396 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc0b4580 con 0x7f1a140cef40 2023-07-06T21:42:03.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.360+0000 7f1a0b7fe640 1 -- 172.21.15.55:0/3130304396 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0b4930 con 0x7f1a140cef40 2023-07-06T21:42:03.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.360+0000 7f1a1947b640 1 -- 172.21.15.55:0/3130304396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a140b2400 con 0x7f1a140cef40 2023-07-06T21:42:03.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.360+0000 7f1a1947b640 1 -- 172.21.15.55:0/3130304396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1414aaa0 con 0x7f1a140cef40 2023-07-06T21:42:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.360+0000 7f1a1947b640 1 -- 172.21.15.55:0/3130304396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a14066d60 con 0x7f1a140cef40 2023-07-06T21:42:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.360+0000 7f1a0b7fe640 1 -- 172.21.15.55:0/3130304396 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f19fc0b2070 con 0x7f1a140cef40 2023-07-06T21:42:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.360+0000 7f1a0b7fe640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f19f4066280 0x7f19f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.360+0000 7f1a0b7fe640 1 -- 172.21.15.55:0/3130304396 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f19fc11cad0 con 0x7f1a140cef40 2023-07-06T21:42:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.360+0000 7f1a12ffd640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f19f4066280 0x7f19f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:03.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.364+0000 7f1a12ffd640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f19f4066280 0x7f19f4068730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a04000f70 tx=0x7f1a04009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:03.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.364+0000 7f1a0b7fe640 1 -- 172.21.15.55:0/3130304396 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19fc0ea380 con 0x7f1a140cef40 2023-07-06T21:42:03.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:03.524+0000 7f1a1947b640 1 -- 172.21.15.55:0/3130304396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f1a140b28b0 con 0x7f1a140cef40 2023-07-06T21:42:04.249 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:42:04.253 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:42:04.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.396+0000 7f1a0b7fe640 1 -- 172.21.15.55:0/3130304396 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f19fc0ba020 con 0x7f1a140cef40 2023-07-06T21:42:04.402 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'rbd' created 2023-07-06T21:42:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.400+0000 7f1a1947b640 1 -- 172.21.15.55:0/3130304396 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f19f4066280 msgr2=0x7f19f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.400+0000 7f1a1947b640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f19f4066280 0x7f19f4068730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a04000f70 tx=0x7f1a04009040 comp rx=0 tx=0).stop 2023-07-06T21:42:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.400+0000 7f1a1947b640 1 -- 172.21.15.55:0/3130304396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a140cef40 msgr2=0x7f1a140b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:04.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.400+0000 7f1a1947b640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a140cef40 0x7f1a140b14d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0ae040 tx=0x7f19fc0192e0 comp rx=0 tx=0).stop 2023-07-06T21:42:04.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.400+0000 7f1a1947b640 1 -- 172.21.15.55:0/3130304396 shutdown_connections 2023-07-06T21:42:04.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.400+0000 7f1a1947b640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f19f4066280 0x7f19f4068730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:04.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.400+0000 7f1a1947b640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1415bb90 0x7f1a1414a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:04.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.400+0000 7f1a1947b640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a140cef40 0x7f1a140b14d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:04.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.400+0000 7f1a1947b640 1 --2- 172.21.15.55:0/3130304396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a14070020 0x7f1a140b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:04.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.400+0000 7f1a1947b640 1 -- 172.21.15.55:0/3130304396 >> 172.21.15.55:0/3130304396 conn(0x7f1a140cbd70 msgr2=0x7f1a140c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:04.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.400+0000 7f1a1947b640 1 -- 172.21.15.55:0/3130304396 shutdown_connections 2023-07-06T21:42:04.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.400+0000 7f1a1947b640 1 -- 172.21.15.55:0/3130304396 wait complete. 2023-07-06T21:42:04.428 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-06T21:42:04.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76d5300640 1 Processor -- start 2023-07-06T21:42:04.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76d5300640 1 -- start start 2023-07-06T21:42:04.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76d5300640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f76d00b3c90 0x7f76d00ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:04.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76d5300640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d00ccd50 con 0x7f76d00d1d30 2023-07-06T21:42:04.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76d5300640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d0069ea0 con 0x7f76d00b18a0 2023-07-06T21:42:04.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76d5300640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d00cd0a0 con 0x7f76d00b3c90 2023-07-06T21:42:04.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76cf7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f76d00d1d30 0x7f76d00cfee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38168/0 (socket says 172.21.15.55:38168) 2023-07-06T21:42:04.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76cf7fe640 1 -- 172.21.15.55:0/3642589927 learned_addr learned my addr 172.21.15.55:0/3642589927 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:04.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76ceffd640 1 --2- 172.21.15.55:0/3642589927 >> v2:172.21.15.138:3300/0 conn(0x7f76d00b3c90 0x7f76d00ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:04.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76ce7fc640 1 -- 172.21.15.55:0/3642589927 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706886440 0 0) 0x7f76d00ccd50 con 0x7f76d00d1d30 2023-07-06T21:42:04.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76ce7fc640 1 -- 172.21.15.55:0/3642589927 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76bc003530 con 0x7f76d00d1d30 2023-07-06T21:42:04.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76ce7fc640 1 -- 172.21.15.55:0/3642589927 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949180623 0 0) 0x7f76d0069ea0 con 0x7f76d00b18a0 2023-07-06T21:42:04.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76ce7fc640 1 -- 172.21.15.55:0/3642589927 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76d00ccd50 con 0x7f76d00b18a0 2023-07-06T21:42:04.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76ceffd640 1 -- 172.21.15.55:0/3642589927 >> v1:172.21.15.138:6789/0 conn(0x7f76d00b18a0 legacy=0x7f76d00b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:04.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76ceffd640 1 -- 172.21.15.55:0/3642589927 >> v1:172.21.15.55:6789/0 conn(0x7f76d00d1d30 legacy=0x7f76d00cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:04.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.572+0000 7f76ceffd640 1 -- 172.21.15.55:0/3642589927 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d006a140 con 0x7f76d00b3c90 2023-07-06T21:42:04.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.576+0000 7f76ceffd640 1 --2- 172.21.15.55:0/3642589927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d00b3c90 0x7f76d00ce460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76c00097c0 tx=0x7f76c001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edd37aabf6eb3fce server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:04.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.576+0000 7f76ce7fc640 1 -- 172.21.15.55:0/3642589927 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c00ab670 con 0x7f76d00b3c90 2023-07-06T21:42:04.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.576+0000 7f76ce7fc640 1 -- 172.21.15.55:0/3642589927 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c00ab7d0 con 0x7f76d00b3c90 2023-07-06T21:42:04.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.576+0000 7f76ce7fc640 1 -- 172.21.15.55:0/3642589927 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c00abb40 con 0x7f76d00b3c90 2023-07-06T21:42:04.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.576+0000 7f76d5300640 1 -- 172.21.15.55:0/3642589927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d00b3c90 msgr2=0x7f76d00ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:04.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.576+0000 7f76d5300640 1 --2- 172.21.15.55:0/3642589927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d00b3c90 0x7f76d00ce460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76c00097c0 tx=0x7f76c001c450 comp rx=0 tx=0).stop 2023-07-06T21:42:04.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.576+0000 7f76d5300640 1 -- 172.21.15.55:0/3642589927 shutdown_connections 2023-07-06T21:42:04.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.576+0000 7f76d5300640 1 --2- 172.21.15.55:0/3642589927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d00b3c90 0x7f76d00ce460 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:04.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.576+0000 7f76d5300640 1 -- 172.21.15.55:0/3642589927 >> 172.21.15.55:0/3642589927 conn(0x7f76d006bf40 msgr2=0x7f76d00cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:04.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.576+0000 7f76d5300640 1 -- 172.21.15.55:0/3642589927 shutdown_connections 2023-07-06T21:42:04.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.576+0000 7f76d5300640 1 -- 172.21.15.55:0/3642589927 wait complete. 2023-07-06T21:42:04.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76d5300640 1 Processor -- start 2023-07-06T21:42:04.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76d5300640 1 -- start start 2023-07-06T21:42:04.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76d5300640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76d00b18a0 0x7f76d00c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:04.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76d5300640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d00b3c90 0x7f76d014f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:04.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76d5300640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76d00d1d30 0x7f76d0155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:04.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76d5300640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d00c77b0 con 0x7f76d00b18a0 2023-07-06T21:42:04.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76d5300640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d00c7a90 con 0x7f76d00b3c90 2023-07-06T21:42:04.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76d5300640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d00c7d70 con 0x7f76d00d1d30 2023-07-06T21:42:04.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76ceffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76d00b18a0 0x7f76d00c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:04.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76ceffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76d00b18a0 0x7f76d00c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45650/0 (socket says 172.21.15.55:45650) 2023-07-06T21:42:04.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76ceffd640 1 -- 172.21.15.55:0/1893190725 learned_addr learned my addr 172.21.15.55:0/1893190725 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:04.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76c7fff640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d00b3c90 0x7f76d014f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:04.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76cf7fe640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76d00d1d30 0x7f76d0155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:04.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76ceffd640 1 -- 172.21.15.55:0/1893190725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76d00d1d30 msgr2=0x7f76d0155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:04.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76ceffd640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76d00d1d30 0x7f76d0155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:04.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76ceffd640 1 -- 172.21.15.55:0/1893190725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d00b3c90 msgr2=0x7f76d014f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:04.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76ceffd640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d00b3c90 0x7f76d014f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:04.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76ceffd640 1 -- 172.21.15.55:0/1893190725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c0009420 con 0x7f76d00b18a0 2023-07-06T21:42:04.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76c7fff640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d00b3c90 0x7f76d014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:04.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76ceffd640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76d00b18a0 0x7f76d00c71d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f76c00ad040 tx=0x7f76c00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:04.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76c77fe640 1 -- 172.21.15.55:0/1893190725 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c0004450 con 0x7f76d00b18a0 2023-07-06T21:42:04.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76c77fe640 1 -- 172.21.15.55:0/1893190725 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c00ab940 con 0x7f76d00b18a0 2023-07-06T21:42:04.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76d5300640 1 -- 172.21.15.55:0/1893190725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d00c8050 con 0x7f76d00b18a0 2023-07-06T21:42:04.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76c77fe640 1 -- 172.21.15.55:0/1893190725 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c00abcd0 con 0x7f76d00b18a0 2023-07-06T21:42:04.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.580+0000 7f76d5300640 1 -- 172.21.15.55:0/1893190725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d014fd20 con 0x7f76d00b18a0 2023-07-06T21:42:04.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.584+0000 7f76d5300640 1 -- 172.21.15.55:0/1893190725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d00c9ae0 con 0x7f76d00b18a0 2023-07-06T21:42:04.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.584+0000 7f76c77fe640 1 -- 172.21.15.55:0/1893190725 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76c0003620 con 0x7f76d00b18a0 2023-07-06T21:42:04.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.584+0000 7f76c77fe640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f76b0066280 0x7f76b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:04.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.584+0000 7f76c77fe640 1 -- 172.21.15.55:0/1893190725 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f76c011db30 con 0x7f76d00b18a0 2023-07-06T21:42:04.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.584+0000 7f76c7fff640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f76b0066280 0x7f76b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:04.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.584+0000 7f76c7fff640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f76b0066280 0x7f76b0068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f76d00b7630 tx=0x7f76b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:04.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.588+0000 7f76c77fe640 1 -- 172.21.15.55:0/1893190725 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76d00c9ae0 con 0x7f76d00b18a0 2023-07-06T21:42:04.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:04.752+0000 7f76d5300640 1 -- 172.21.15.55:0/1893190725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f76d00c9ae0 con 0x7f76d00b18a0 2023-07-06T21:42:05.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.408+0000 7f76c77fe640 1 -- 172.21.15.55:0/1893190725 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f76d00c9ae0 con 0x7f76d00b18a0 2023-07-06T21:42:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-06T21:42:05.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.408+0000 7f76d5300640 1 -- 172.21.15.55:0/1893190725 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f76b0066280 msgr2=0x7f76b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.408+0000 7f76d5300640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f76b0066280 0x7f76b0068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f76d00b7630 tx=0x7f76b8009040 comp rx=0 tx=0).stop 2023-07-06T21:42:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.408+0000 7f76d5300640 1 -- 172.21.15.55:0/1893190725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76d00b18a0 msgr2=0x7f76d00c71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:05.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.408+0000 7f76d5300640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76d00b18a0 0x7f76d00c71d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f76c00ad040 tx=0x7f76c00191f0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.408+0000 7f76d5300640 1 -- 172.21.15.55:0/1893190725 shutdown_connections 2023-07-06T21:42:05.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.408+0000 7f76d5300640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f76b0066280 0x7f76b0068730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.408+0000 7f76d5300640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76d00d1d30 0x7f76d0155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.408+0000 7f76d5300640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d00b3c90 0x7f76d014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.408+0000 7f76d5300640 1 --2- 172.21.15.55:0/1893190725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76d00b18a0 0x7f76d00c71d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.408+0000 7f76d5300640 1 -- 172.21.15.55:0/1893190725 >> 172.21.15.55:0/1893190725 conn(0x7f76d006bf40 msgr2=0x7f76d0156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:05.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.408+0000 7f76d5300640 1 -- 172.21.15.55:0/1893190725 shutdown_connections 2023-07-06T21:42:05.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.408+0000 7f76d5300640 1 -- 172.21.15.55:0/1893190725 wait complete. 2023-07-06T21:42:05.436 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-06T21:42:05.436 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T21:42:05.437 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T21:42:05.440 INFO:tasks.ceph.mds.a:Started 2023-07-06T21:42:05.441 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T21:42:05.441 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T21:42:05.444 INFO:tasks.ceph.mds.c:Started 2023-07-06T21:42:05.444 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T21:42:05.445 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T21:42:05.448 INFO:tasks.ceph.mds.b:Started 2023-07-06T21:42:05.449 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T21:42:05.449 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T21:42:05.454 INFO:tasks.ceph.mds.d:Started 2023-07-06T21:42:05.454 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-06T21:42:05.455 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:05.546 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-07-06T21:42:05.546 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T21:42:05.561 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-07-06T21:42:05.562 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-07-06T21:42:05.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.608+0000 7f7dc8303640 1 Processor -- start 2023-07-06T21:42:05.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.608+0000 7f7dc8303640 1 -- start start 2023-07-06T21:42:05.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.608+0000 7f7dc8303640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dc0158400 0x7f7dc00c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:05.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.608+0000 7f7dc8303640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7dc00c9680 0x7f7dc0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:05.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.608+0000 7f7dc8303640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7dc00710c0 0x7f7dc00cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:05.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.608+0000 7f7dc8303640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc006fae0 con 0x7f7dc00710c0 2023-07-06T21:42:05.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.608+0000 7f7dc8303640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc006fdc0 con 0x7f7dc00c9680 2023-07-06T21:42:05.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.608+0000 7f7dc8303640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc00700a0 con 0x7f7dc0158400 2023-07-06T21:42:05.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.608+0000 7f7dc68a0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7dc00710c0 0x7f7dc00cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:05.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.608+0000 7f7dc68a0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7dc00710c0 0x7f7dc00cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45684/0 (socket says 172.21.15.55:45684) 2023-07-06T21:42:05.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.608+0000 7f7dc68a0640 1 -- 172.21.15.55:0/2315784683 learned_addr learned my addr 172.21.15.55:0/2315784683 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:05.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.608+0000 7f7dc609f640 1 --2- 172.21.15.55:0/2315784683 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dc0158400 0x7f7dc00c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:05.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.608+0000 7f7dc589e640 1 --2- 172.21.15.55:0/2315784683 >> v2:172.21.15.138:3300/0 conn(0x7f7dc00c9680 0x7f7dc0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:05.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc68a0640 1 -- 172.21.15.55:0/2315784683 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dc0158400 msgr2=0x7f7dc00c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:05.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc68a0640 1 --2- 172.21.15.55:0/2315784683 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dc0158400 0x7f7dc00c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc68a0640 1 -- 172.21.15.55:0/2315784683 >> v2:172.21.15.138:3300/0 conn(0x7f7dc00c9680 msgr2=0x7f7dc0070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:05.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc68a0640 1 --2- 172.21.15.55:0/2315784683 >> v2:172.21.15.138:3300/0 conn(0x7f7dc00c9680 0x7f7dc0070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc68a0640 1 -- 172.21.15.55:0/2315784683 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc0070380 con 0x7f7dc00710c0 2023-07-06T21:42:05.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc609f640 1 --2- 172.21.15.55:0/2315784683 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dc0158400 0x7f7dc00c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:05.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc68a0640 1 --2- 172.21.15.55:0/2315784683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dc00710c0 0x7f7dc00cbaa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7dc006d570 tx=0x7f7db801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805b87e5f102080b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:05.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc509d640 1 -- 172.21.15.55:0/2315784683 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db80a5840 con 0x7f7dc00710c0 2023-07-06T21:42:05.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc509d640 1 -- 172.21.15.55:0/2315784683 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db80a59a0 con 0x7f7dc00710c0 2023-07-06T21:42:05.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc509d640 1 -- 172.21.15.55:0/2315784683 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db80a5d30 con 0x7f7dc00710c0 2023-07-06T21:42:05.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc8303640 1 -- 172.21.15.55:0/2315784683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dc00710c0 msgr2=0x7f7dc00cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:05.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc8303640 1 --2- 172.21.15.55:0/2315784683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dc00710c0 0x7f7dc00cbaa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7dc006d570 tx=0x7f7db801c9a0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc8303640 1 -- 172.21.15.55:0/2315784683 shutdown_connections 2023-07-06T21:42:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc8303640 1 --2- 172.21.15.55:0/2315784683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dc00710c0 0x7f7dc00cbaa0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc8303640 1 --2- 172.21.15.55:0/2315784683 >> v2:172.21.15.138:3300/0 conn(0x7f7dc00c9680 0x7f7dc0070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc8303640 1 --2- 172.21.15.55:0/2315784683 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dc0158400 0x7f7dc00c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc8303640 1 -- 172.21.15.55:0/2315784683 >> 172.21.15.55:0/2315784683 conn(0x7f7dc00cded0 msgr2=0x7f7dc00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.612+0000 7f7dc8303640 1 -- 172.21.15.55:0/2315784683 shutdown_connections 2023-07-06T21:42:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc8303640 1 -- 172.21.15.55:0/2315784683 wait complete. 2023-07-06T21:42:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc8303640 1 Processor -- start 2023-07-06T21:42:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc8303640 1 -- start start 2023-07-06T21:42:05.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc8303640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dc00710c0 0x7f7dc00c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:05.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc8303640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dc00c9680 0x7f7dc0158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:05.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc8303640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dc0158400 0x7f7dc0161810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:05.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc8303640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc00c5570 con 0x7f7dc00c9680 2023-07-06T21:42:05.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc8303640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc015b4c0 con 0x7f7dc00710c0 2023-07-06T21:42:05.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc8303640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc015b7a0 con 0x7f7dc0158400 2023-07-06T21:42:05.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc589e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dc00c9680 0x7f7dc0158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:05.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc609f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dc00710c0 0x7f7dc00c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:05.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc589e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dc00c9680 0x7f7dc0158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45698/0 (socket says 172.21.15.55:45698) 2023-07-06T21:42:05.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc589e640 1 -- 172.21.15.55:0/4196319155 learned_addr learned my addr 172.21.15.55:0/4196319155 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc68a0640 1 --2- 172.21.15.55:0/4196319155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dc0158400 0x7f7dc0161810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc589e640 1 -- 172.21.15.55:0/4196319155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dc0158400 msgr2=0x7f7dc0161810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc589e640 1 --2- 172.21.15.55:0/4196319155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dc0158400 0x7f7dc0161810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc589e640 1 -- 172.21.15.55:0/4196319155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dc00710c0 msgr2=0x7f7dc00c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc589e640 1 --2- 172.21.15.55:0/4196319155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dc00710c0 0x7f7dc00c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc589e640 1 -- 172.21.15.55:0/4196319155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db8009b30 con 0x7f7dc00c9680 2023-07-06T21:42:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc609f640 1 --2- 172.21.15.55:0/4196319155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dc00710c0 0x7f7dc00c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:05.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7dc589e640 1 --2- 172.21.15.55:0/4196319155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dc00c9680 0x7f7dc0158c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7db000d800 tx=0x7f7db000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:05.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.616+0000 7f7db6ffd640 1 -- 172.21.15.55:0/4196319155 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db00096a0 con 0x7f7dc00c9680 2023-07-06T21:42:05.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.620+0000 7f7db6ffd640 1 -- 172.21.15.55:0/4196319155 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db0009800 con 0x7f7dc00c9680 2023-07-06T21:42:05.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.620+0000 7f7db6ffd640 1 -- 172.21.15.55:0/4196319155 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0009b70 con 0x7f7dc00c9680 2023-07-06T21:42:05.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.620+0000 7f7dc8303640 1 -- 172.21.15.55:0/4196319155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc015ba80 con 0x7f7dc00c9680 2023-07-06T21:42:05.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.620+0000 7f7dc8303640 1 -- 172.21.15.55:0/4196319155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc015bd60 con 0x7f7dc00c9680 2023-07-06T21:42:05.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.620+0000 7f7dc8303640 1 -- 172.21.15.55:0/4196319155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc006c580 con 0x7f7dc00c9680 2023-07-06T21:42:05.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.620+0000 7f7db6ffd640 1 -- 172.21.15.55:0/4196319155 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7db0009cd0 con 0x7f7dc00c9680 2023-07-06T21:42:05.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.620+0000 7f7db6ffd640 1 --2- 172.21.15.55:0/4196319155 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7da40662b0 0x7f7da4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:05.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.620+0000 7f7db6ffd640 1 -- 172.21.15.55:0/4196319155 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7db0083fa0 con 0x7f7dc00c9680 2023-07-06T21:42:05.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.620+0000 7f7dc609f640 1 --2- 172.21.15.55:0/4196319155 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7da40662b0 0x7f7da4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:05.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.620+0000 7f7dc609f640 1 --2- 172.21.15.55:0/4196319155 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7da40662b0 0x7f7da4068760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc004630 tx=0x7f7dbc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.624+0000 7f7db6ffd640 1 -- 172.21.15.55:0/4196319155 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7db0051810 con 0x7f7dc00c9680 2023-07-06T21:42:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.780+0000 7f7dc8303640 1 -- 172.21.15.55:0/4196319155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7dc00c56b0 con 0x7f7dc00c9680 2023-07-06T21:42:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.784+0000 7f7db6ffd640 1 -- 172.21.15.55:0/4196319155 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14637 (secure 0 0 0) 0x7f7dc00c56b0 con 0x7f7dc00c9680 2023-07-06T21:42:05.787 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:05.787 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":18,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:05.398670+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.784+0000 7f7dc8303640 1 -- 172.21.15.55:0/4196319155 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7da40662b0 msgr2=0x7f7da4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.784+0000 7f7dc8303640 1 --2- 172.21.15.55:0/4196319155 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7da40662b0 0x7f7da4068760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc004630 tx=0x7f7dbc008040 comp rx=0 tx=0).stop 2023-07-06T21:42:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.784+0000 7f7dc8303640 1 -- 172.21.15.55:0/4196319155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dc00c9680 msgr2=0x7f7dc0158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.784+0000 7f7dc8303640 1 --2- 172.21.15.55:0/4196319155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dc00c9680 0x7f7dc0158c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7db000d800 tx=0x7f7db000dcc0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.784+0000 7f7dc8303640 1 -- 172.21.15.55:0/4196319155 shutdown_connections 2023-07-06T21:42:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.784+0000 7f7dc8303640 1 --2- 172.21.15.55:0/4196319155 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7da40662b0 0x7f7da4068760 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.784+0000 7f7dc8303640 1 --2- 172.21.15.55:0/4196319155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dc0158400 0x7f7dc0161810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.784+0000 7f7dc8303640 1 --2- 172.21.15.55:0/4196319155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dc00c9680 0x7f7dc0158c30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.784+0000 7f7dc8303640 1 --2- 172.21.15.55:0/4196319155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dc00710c0 0x7f7dc00c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.784+0000 7f7dc8303640 1 -- 172.21.15.55:0/4196319155 >> 172.21.15.55:0/4196319155 conn(0x7f7dc00cded0 msgr2=0x7f7dc01575b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.784+0000 7f7dc8303640 1 -- 172.21.15.55:0/4196319155 shutdown_connections 2023-07-06T21:42:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.784+0000 7f7dc8303640 1 -- 172.21.15.55:0/4196319155 wait complete. 2023-07-06T21:42:05.807 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:42:05.808 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:42:05.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b8d974640 1 Processor -- start 2023-07-06T21:42:05.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b8d974640 1 -- start start 2023-07-06T21:42:05.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b8d974640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b8815b850 0x7f6b880cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:05.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b8d974640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b880ccd30 0x7f6b880b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:05.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b8d974640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b880b4210 con 0x7f6b880b3db0 2023-07-06T21:42:05.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b8d974640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b880b2b80 con 0x7f6b8815b850 2023-07-06T21:42:05.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b8d974640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880cff30 con 0x7f6b880ccd30 2023-07-06T21:42:05.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b86ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b8815b850 0x7f6b880cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:05.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b86ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b8815b850 0x7f6b880cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45700/0 (socket says 172.21.15.55:45700) 2023-07-06T21:42:05.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b86ffd640 1 -- 172.21.15.55:0/1760149991 learned_addr learned my addr 172.21.15.55:0/1760149991 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:05.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b7ffff640 1 --2- 172.21.15.55:0/1760149991 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b880ccd30 0x7f6b880b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:05.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b86ffd640 1 -- 172.21.15.55:0/1760149991 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b880ccd30 msgr2=0x7f6b880b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:05.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b86ffd640 1 --2- 172.21.15.55:0/1760149991 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b880ccd30 0x7f6b880b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b86ffd640 1 -- 172.21.15.55:0/1760149991 >> v1:172.21.15.138:6789/0 conn(0x7f6b880b3db0 legacy=0x7f6b8815f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:05.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.952+0000 7f6b86ffd640 1 -- 172.21.15.55:0/1760149991 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b880b22e0 con 0x7f6b8815b850 2023-07-06T21:42:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.956+0000 7f6b86ffd640 1 --2- 172.21.15.55:0/1760149991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b8815b850 0x7f6b880cc7f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009870 tx=0x7f6b7801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96058bc234215327 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.956+0000 7f6b867fc640 1 -- 172.21.15.55:0/1760149991 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b780ab5f0 con 0x7f6b8815b850 2023-07-06T21:42:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.956+0000 7f6b867fc640 1 -- 172.21.15.55:0/1760149991 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b780ab750 con 0x7f6b8815b850 2023-07-06T21:42:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.956+0000 7f6b867fc640 1 -- 172.21.15.55:0/1760149991 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b780abae0 con 0x7f6b8815b850 2023-07-06T21:42:05.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.956+0000 7f6b8d974640 1 -- 172.21.15.55:0/1760149991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b8815b850 msgr2=0x7f6b880cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:05.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.956+0000 7f6b8d974640 1 --2- 172.21.15.55:0/1760149991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b8815b850 0x7f6b880cc7f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009870 tx=0x7f6b7801c3f0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.956+0000 7f6b8d974640 1 -- 172.21.15.55:0/1760149991 shutdown_connections 2023-07-06T21:42:05.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.956+0000 7f6b8d974640 1 --2- 172.21.15.55:0/1760149991 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b880ccd30 0x7f6b880b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.956+0000 7f6b8d974640 1 --2- 172.21.15.55:0/1760149991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b8815b850 0x7f6b880cc7f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.956+0000 7f6b8d974640 1 -- 172.21.15.55:0/1760149991 >> 172.21.15.55:0/1760149991 conn(0x7f6b880cec20 msgr2=0x7f6b880cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.956+0000 7f6b8d974640 1 -- 172.21.15.55:0/1760149991 shutdown_connections 2023-07-06T21:42:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.956+0000 7f6b8d974640 1 -- 172.21.15.55:0/1760149991 wait complete. 2023-07-06T21:42:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b8d974640 1 Processor -- start 2023-07-06T21:42:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b8d974640 1 -- start start 2023-07-06T21:42:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b8d974640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b880b3db0 0x7f6b8815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b8d974640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b880ccd30 0x7f6b88156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b8d974640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b8815b850 0x7f6b88151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b8d974640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b88152f50 con 0x7f6b880b3db0 2023-07-06T21:42:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b8d974640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8815a1f0 con 0x7f6b880ccd30 2023-07-06T21:42:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b8d974640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b88152900 con 0x7f6b8815b850 2023-07-06T21:42:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b86ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b880b3db0 0x7f6b8815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b86ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b880b3db0 0x7f6b8815aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45706/0 (socket says 172.21.15.55:45706) 2023-07-06T21:42:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b86ffd640 1 -- 172.21.15.55:0/1132814604 learned_addr learned my addr 172.21.15.55:0/1132814604 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b7ffff640 1 --2- 172.21.15.55:0/1132814604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b880ccd30 0x7f6b88156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b877fe640 1 --2- 172.21.15.55:0/1132814604 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b8815b850 0x7f6b88151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b86ffd640 1 -- 172.21.15.55:0/1132814604 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b8815b850 msgr2=0x7f6b88151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b86ffd640 1 --2- 172.21.15.55:0/1132814604 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b8815b850 0x7f6b88151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b86ffd640 1 -- 172.21.15.55:0/1132814604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b880ccd30 msgr2=0x7f6b88156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b86ffd640 1 --2- 172.21.15.55:0/1132814604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b880ccd30 0x7f6b88156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b86ffd640 1 -- 172.21.15.55:0/1132814604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780094d0 con 0x7f6b880b3db0 2023-07-06T21:42:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b86ffd640 1 --2- 172.21.15.55:0/1132814604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b880b3db0 0x7f6b8815aca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b780ad040 tx=0x7f6b7801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b84ff9640 1 -- 172.21.15.55:0/1132814604 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b780be5f0 con 0x7f6b880b3db0 2023-07-06T21:42:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b84ff9640 1 -- 172.21.15.55:0/1132814604 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b780be750 con 0x7f6b880b3db0 2023-07-06T21:42:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b84ff9640 1 -- 172.21.15.55:0/1132814604 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b780beb00 con 0x7f6b880b3db0 2023-07-06T21:42:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b8d974640 1 -- 172.21.15.55:0/1132814604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8815bda0 con 0x7f6b880b3db0 2023-07-06T21:42:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.960+0000 7f6b8d974640 1 -- 172.21.15.55:0/1132814604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8815a4d0 con 0x7f6b880b3db0 2023-07-06T21:42:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.964+0000 7f6b7dffb640 1 -- 172.21.15.55:0/1132814604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b88066d60 con 0x7f6b880b3db0 2023-07-06T21:42:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.964+0000 7f6b84ff9640 1 -- 172.21.15.55:0/1132814604 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b780b4600 con 0x7f6b880b3db0 2023-07-06T21:42:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.964+0000 7f6b84ff9640 1 --2- 172.21.15.55:0/1132814604 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b680662b0 0x7f6b68068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.964+0000 7f6b84ff9640 1 -- 172.21.15.55:0/1132814604 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6b780a8050 con 0x7f6b880b3db0 2023-07-06T21:42:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.964+0000 7f6b7ffff640 1 --2- 172.21.15.55:0/1132814604 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b680662b0 0x7f6b68068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.964+0000 7f6b7ffff640 1 --2- 172.21.15.55:0/1132814604 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b680662b0 0x7f6b68068760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b8815c1a0 tx=0x7f6b70009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:05.968+0000 7f6b84ff9640 1 -- 172.21.15.55:0/1132814604 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b780ec0a0 con 0x7f6b880b3db0 2023-07-06T21:42:06.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.124+0000 7f6b7dffb640 1 -- 172.21.15.55:0/1132814604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b880b3420 con 0x7f6b880b3db0 2023-07-06T21:42:06.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.124+0000 7f6b84ff9640 1 -- 172.21.15.55:0/1132814604 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b780ef6c0 con 0x7f6b880b3db0 2023-07-06T21:42:06.129 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:42:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.124+0000 7f6b7dffb640 1 -- 172.21.15.55:0/1132814604 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b680662b0 msgr2=0x7f6b68068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.124+0000 7f6b7dffb640 1 --2- 172.21.15.55:0/1132814604 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b680662b0 0x7f6b68068760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b8815c1a0 tx=0x7f6b70009190 comp rx=0 tx=0).stop 2023-07-06T21:42:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.124+0000 7f6b7dffb640 1 -- 172.21.15.55:0/1132814604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b880b3db0 msgr2=0x7f6b8815aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.124+0000 7f6b7dffb640 1 --2- 172.21.15.55:0/1132814604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b880b3db0 0x7f6b8815aca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b780ad040 tx=0x7f6b7801ac30 comp rx=0 tx=0).stop 2023-07-06T21:42:06.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.124+0000 7f6b7dffb640 1 -- 172.21.15.55:0/1132814604 shutdown_connections 2023-07-06T21:42:06.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.128+0000 7f6b7dffb640 1 --2- 172.21.15.55:0/1132814604 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b680662b0 0x7f6b68068760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.128+0000 7f6b7dffb640 1 --2- 172.21.15.55:0/1132814604 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b8815b850 0x7f6b88151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.128+0000 7f6b7dffb640 1 --2- 172.21.15.55:0/1132814604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b880ccd30 0x7f6b88156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.128+0000 7f6b7dffb640 1 --2- 172.21.15.55:0/1132814604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b880b3db0 0x7f6b8815aca0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.128+0000 7f6b7dffb640 1 -- 172.21.15.55:0/1132814604 >> 172.21.15.55:0/1132814604 conn(0x7f6b880cec20 msgr2=0x7f6b881541a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.128+0000 7f6b7dffb640 1 -- 172.21.15.55:0/1132814604 shutdown_connections 2023-07-06T21:42:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.128+0000 7f6b7dffb640 1 -- 172.21.15.55:0/1132814604 wait complete. 2023-07-06T21:42:06.150 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:42:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.292+0000 7f4686c18640 1 Processor -- start 2023-07-06T21:42:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.292+0000 7f4686c18640 1 -- start start 2023-07-06T21:42:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.292+0000 7f4686c18640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46800cd140 0x7f4680163380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.292+0000 7f4686c18640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4680158c20 con 0x7f4680158850 2023-07-06T21:42:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.292+0000 7f4686c18640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46800c8db0 con 0x7f46800ca130 2023-07-06T21:42:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.292+0000 7f4686c18640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46800c9090 con 0x7f46800cd140 2023-07-06T21:42:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.292+0000 7f46849b4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4680158850 0x7f46800cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38174/0 (socket says 172.21.15.55:38174) 2023-07-06T21:42:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.292+0000 7f46849b4640 1 -- 172.21.15.55:0/4185875975 learned_addr learned my addr 172.21.15.55:0/4185875975 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.292+0000 7f46851b5640 1 --2- 172.21.15.55:0/4185875975 >> v2:172.21.15.55:3300/0 conn(0x7f46800cd140 0x7f4680163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.292+0000 7f46851b5640 1 -- 172.21.15.55:0/4185875975 >> v1:172.21.15.138:6789/0 conn(0x7f46800ca130 legacy=0x7f46800703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.292+0000 7f46851b5640 1 -- 172.21.15.55:0/4185875975 >> v1:172.21.15.55:6789/0 conn(0x7f4680158850 legacy=0x7f46800cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.292+0000 7f46851b5640 1 -- 172.21.15.55:0/4185875975 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46800c9370 con 0x7f46800cd140 2023-07-06T21:42:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.292+0000 7f467f7fe640 1 -- 172.21.15.55:0/4185875975 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619263425 0 0) 0x7f4680158c20 con 0x7f4680158850 2023-07-06T21:42:06.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.296+0000 7f46851b5640 1 --2- 172.21.15.55:0/4185875975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46800cd140 0x7f4680163380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4678009d90 tx=0x7f467801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a26388f9e00734a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:06.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.296+0000 7f467f7fe640 1 -- 172.21.15.55:0/4185875975 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46780a6800 con 0x7f46800cd140 2023-07-06T21:42:06.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.296+0000 7f467f7fe640 1 -- 172.21.15.55:0/4185875975 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46780a6960 con 0x7f46800cd140 2023-07-06T21:42:06.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.296+0000 7f467f7fe640 1 -- 172.21.15.55:0/4185875975 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46780a6cf0 con 0x7f46800cd140 2023-07-06T21:42:06.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.296+0000 7f4686c18640 1 -- 172.21.15.55:0/4185875975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46800cd140 msgr2=0x7f4680163380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.296+0000 7f4686c18640 1 --2- 172.21.15.55:0/4185875975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46800cd140 0x7f4680163380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4678009d90 tx=0x7f467801c9e0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.296+0000 7f4686c18640 1 -- 172.21.15.55:0/4185875975 shutdown_connections 2023-07-06T21:42:06.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.296+0000 7f4686c18640 1 --2- 172.21.15.55:0/4185875975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46800cd140 0x7f4680163380 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.296+0000 7f4686c18640 1 -- 172.21.15.55:0/4185875975 >> 172.21.15.55:0/4185875975 conn(0x7f46800cea70 msgr2=0x7f46800ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.296+0000 7f4686c18640 1 -- 172.21.15.55:0/4185875975 shutdown_connections 2023-07-06T21:42:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.296+0000 7f4686c18640 1 -- 172.21.15.55:0/4185875975 wait complete. 2023-07-06T21:42:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f4686c18640 1 Processor -- start 2023-07-06T21:42:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f4686c18640 1 -- start start 2023-07-06T21:42:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f4686c18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46800ca130 0x7f46800c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f4686c18640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46800cd140 0x7f46800ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f4686c18640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4680158850 0x7f46800adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f4686c18640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46800c58d0 con 0x7f46800ca130 2023-07-06T21:42:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f4686c18640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46800c5b70 con 0x7f46800cd140 2023-07-06T21:42:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f4686c18640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46800c5e50 con 0x7f4680158850 2023-07-06T21:42:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f46849b4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46800ca130 0x7f46800c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:06.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f46849b4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46800ca130 0x7f46800c3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45712/0 (socket says 172.21.15.55:45712) 2023-07-06T21:42:06.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f467ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46800cd140 0x7f46800ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:06.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f46849b4640 1 -- 172.21.15.55:0/1419386698 learned_addr learned my addr 172.21.15.55:0/1419386698 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:06.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f46851b5640 1 --2- 172.21.15.55:0/1419386698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4680158850 0x7f46800adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:06.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f46849b4640 1 -- 172.21.15.55:0/1419386698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4680158850 msgr2=0x7f46800adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f46849b4640 1 --2- 172.21.15.55:0/1419386698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4680158850 0x7f46800adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f46849b4640 1 -- 172.21.15.55:0/1419386698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46800cd140 msgr2=0x7f46800ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f46849b4640 1 --2- 172.21.15.55:0/1419386698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46800cd140 0x7f46800ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f46849b4640 1 -- 172.21.15.55:0/1419386698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4678009a70 con 0x7f46800ca130 2023-07-06T21:42:06.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f46849b4640 1 --2- 172.21.15.55:0/1419386698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46800ca130 0x7f46800c3e50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f467400c410 tx=0x7f467400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:06.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f467d7fa640 1 -- 172.21.15.55:0/1419386698 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740074e0 con 0x7f46800ca130 2023-07-06T21:42:06.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f467d7fa640 1 -- 172.21.15.55:0/1419386698 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4674007640 con 0x7f46800ca130 2023-07-06T21:42:06.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f467d7fa640 1 -- 172.21.15.55:0/1419386698 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674004a30 con 0x7f46800ca130 2023-07-06T21:42:06.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f4686c18640 1 -- 172.21.15.55:0/1419386698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46800c6130 con 0x7f46800ca130 2023-07-06T21:42:06.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f4686c18640 1 -- 172.21.15.55:0/1419386698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46800c4390 con 0x7f46800ca130 2023-07-06T21:42:06.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.300+0000 7f4686c18640 1 -- 172.21.15.55:0/1419386698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4680066d60 con 0x7f46800ca130 2023-07-06T21:42:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.304+0000 7f467d7fa640 1 -- 172.21.15.55:0/1419386698 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4674004b90 con 0x7f46800ca130 2023-07-06T21:42:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.304+0000 7f467d7fa640 1 --2- 172.21.15.55:0/1419386698 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f46640662b0 0x7f4664068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.304+0000 7f467d7fa640 1 -- 172.21.15.55:0/1419386698 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4674083580 con 0x7f46800ca130 2023-07-06T21:42:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.304+0000 7f467ffff640 1 --2- 172.21.15.55:0/1419386698 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f46640662b0 0x7f4664068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.304+0000 7f467ffff640 1 --2- 172.21.15.55:0/1419386698 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f46640662b0 0x7f4664068760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f468006cbd0 tx=0x7f466c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.308+0000 7f467d7fa640 1 -- 172.21.15.55:0/1419386698 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4674050e90 con 0x7f46800ca130 2023-07-06T21:42:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.468+0000 7f4686c18640 1 -- 172.21.15.55:0/1419386698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f46800c8100 con 0x7f46800ca130 2023-07-06T21:42:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.468+0000 7f467d7fa640 1 -- 172.21.15.55:0/1419386698 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f46740544b0 con 0x7f46800ca130 2023-07-06T21:42:06.472 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:42:06.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.468+0000 7f4686c18640 1 -- 172.21.15.55:0/1419386698 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f46640662b0 msgr2=0x7f4664068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.468+0000 7f4686c18640 1 --2- 172.21.15.55:0/1419386698 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f46640662b0 0x7f4664068760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f468006cbd0 tx=0x7f466c009040 comp rx=0 tx=0).stop 2023-07-06T21:42:06.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.468+0000 7f4686c18640 1 -- 172.21.15.55:0/1419386698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46800ca130 msgr2=0x7f46800c3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.468+0000 7f4686c18640 1 --2- 172.21.15.55:0/1419386698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46800ca130 0x7f46800c3e50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f467400c410 tx=0x7f467400c8d0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.468+0000 7f4686c18640 1 -- 172.21.15.55:0/1419386698 shutdown_connections 2023-07-06T21:42:06.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.468+0000 7f4686c18640 1 --2- 172.21.15.55:0/1419386698 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f46640662b0 0x7f4664068760 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.468+0000 7f4686c18640 1 --2- 172.21.15.55:0/1419386698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4680158850 0x7f46800adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.468+0000 7f4686c18640 1 --2- 172.21.15.55:0/1419386698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46800cd140 0x7f46800ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.468+0000 7f4686c18640 1 --2- 172.21.15.55:0/1419386698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46800ca130 0x7f46800c3e50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.468+0000 7f4686c18640 1 -- 172.21.15.55:0/1419386698 >> 172.21.15.55:0/1419386698 conn(0x7f46800cea70 msgr2=0x7f468006eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:06.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.468+0000 7f4686c18640 1 -- 172.21.15.55:0/1419386698 shutdown_connections 2023-07-06T21:42:06.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.468+0000 7f4686c18640 1 -- 172.21.15.55:0/1419386698 wait complete. 2023-07-06T21:42:06.492 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:42:06.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.632+0000 7f4e831fa640 1 Processor -- start 2023-07-06T21:42:06.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.632+0000 7f4e831fa640 1 -- start start 2023-07-06T21:42:06.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.632+0000 7f4e831fa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4e7c06f2e0 0x7f4e7c0cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:06.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.632+0000 7f4e831fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e7c0cf9c0 0x7f4e7c0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:06.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.632+0000 7f4e831fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7c0cfe60 con 0x7f4e7c15bc30 2023-07-06T21:42:06.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.632+0000 7f4e831fa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7c0cc800 con 0x7f4e7c06f2e0 2023-07-06T21:42:06.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.632+0000 7f4e831fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c15f750 con 0x7f4e7c0cf9c0 2023-07-06T21:42:06.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.636+0000 7f4e7bfff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4e7c06f2e0 0x7f4e7c0cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:06.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.636+0000 7f4e81797640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e7c0cf9c0 0x7f4e7c0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:06.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.636+0000 7f4e80f96640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f4e7c15bc30 0x7f4e7c06ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:38180/0 (socket says 172.21.15.55:38180) 2023-07-06T21:42:06.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.636+0000 7f4e80f96640 1 -- 172.21.15.55:0/1887795528 learned_addr learned my addr 172.21.15.55:0/1887795528 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:06.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.636+0000 7f4e81797640 1 -- 172.21.15.55:0/1887795528 >> v2:172.21.15.138:3300/0 conn(0x7f4e7c06f2e0 msgr2=0x7f4e7c0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:06.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.636+0000 7f4e81797640 1 --2- 172.21.15.55:0/1887795528 >> v2:172.21.15.138:3300/0 conn(0x7f4e7c06f2e0 0x7f4e7c0cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.636+0000 7f4e81797640 1 -- 172.21.15.55:0/1887795528 >> v1:172.21.15.138:6789/0 conn(0x7f4e7c15bc30 legacy=0x7f4e7c06ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.636+0000 7f4e81797640 1 -- 172.21.15.55:0/1887795528 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c15fa30 con 0x7f4e7c0cf9c0 2023-07-06T21:42:06.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.636+0000 7f4e7bfff640 1 --2- 172.21.15.55:0/1887795528 >> v2:172.21.15.138:3300/0 conn(0x7f4e7c06f2e0 0x7f4e7c0cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:06.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.636+0000 7f4e7b7fe640 1 -- 172.21.15.55:0/1887795528 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630845729 0 0) 0x7f4e7c0cfe60 con 0x7f4e7c15bc30 2023-07-06T21:42:06.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.636+0000 7f4e81797640 1 --2- 172.21.15.55:0/1887795528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e7c0cf9c0 0x7f4e7c0ce0a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009d90 tx=0x7f4e7401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cd84cefc5e6d5ae server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:06.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.636+0000 7f4e7b7fe640 1 -- 172.21.15.55:0/1887795528 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e740a59e0 con 0x7f4e7c0cf9c0 2023-07-06T21:42:06.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.636+0000 7f4e7b7fe640 1 -- 172.21.15.55:0/1887795528 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e740a5b40 con 0x7f4e7c0cf9c0 2023-07-06T21:42:06.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.636+0000 7f4e7b7fe640 1 -- 172.21.15.55:0/1887795528 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e740ad440 con 0x7f4e7c0cf9c0 2023-07-06T21:42:06.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 -- 172.21.15.55:0/1887795528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e7c0cf9c0 msgr2=0x7f4e7c0ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 --2- 172.21.15.55:0/1887795528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e7c0cf9c0 0x7f4e7c0ce0a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009d90 tx=0x7f4e7401c920 comp rx=0 tx=0).stop 2023-07-06T21:42:06.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 -- 172.21.15.55:0/1887795528 shutdown_connections 2023-07-06T21:42:06.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 --2- 172.21.15.55:0/1887795528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e7c0cf9c0 0x7f4e7c0ce0a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 --2- 172.21.15.55:0/1887795528 >> v2:172.21.15.138:3300/0 conn(0x7f4e7c06f2e0 0x7f4e7c0cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 -- 172.21.15.55:0/1887795528 >> 172.21.15.55:0/1887795528 conn(0x7f4e7c0b2840 msgr2=0x7f4e7c0d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:06.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 -- 172.21.15.55:0/1887795528 shutdown_connections 2023-07-06T21:42:06.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 -- 172.21.15.55:0/1887795528 wait complete. 2023-07-06T21:42:06.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 Processor -- start 2023-07-06T21:42:06.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 -- start start 2023-07-06T21:42:06.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e7c06f2e0 0x7f4e7c06dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:06.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e7c0cf9c0 0x7f4e7c1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:06.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e7c15bc30 0x7f4e7c06a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:06.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c1527b0 con 0x7f4e7c15bc30 2023-07-06T21:42:06.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c157c90 con 0x7f4e7c06f2e0 2023-07-06T21:42:06.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e831fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c155310 con 0x7f4e7c0cf9c0 2023-07-06T21:42:06.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e81797640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e7c15bc30 0x7f4e7c06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:06.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e81797640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e7c15bc30 0x7f4e7c06a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45722/0 (socket says 172.21.15.55:45722) 2023-07-06T21:42:06.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.640+0000 7f4e81797640 1 -- 172.21.15.55:0/3423751138 learned_addr learned my addr 172.21.15.55:0/3423751138 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:06.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e80f96640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e7c06f2e0 0x7f4e7c06dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:06.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e7bfff640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e7c0cf9c0 0x7f4e7c1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:06.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e81797640 1 -- 172.21.15.55:0/3423751138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e7c0cf9c0 msgr2=0x7f4e7c1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e81797640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e7c0cf9c0 0x7f4e7c1581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e81797640 1 -- 172.21.15.55:0/3423751138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e7c06f2e0 msgr2=0x7f4e7c06dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e81797640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e7c06f2e0 0x7f4e7c06dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e81797640 1 -- 172.21.15.55:0/3423751138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e68009420 con 0x7f4e7c15bc30 2023-07-06T21:42:06.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e80f96640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e7c06f2e0 0x7f4e7c06dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:06.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e81797640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e7c15bc30 0x7f4e7c06a500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4e7401afd0 tx=0x7f4e740196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:06.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e797fa640 1 -- 172.21.15.55:0/3423751138 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e740add70 con 0x7f4e7c15bc30 2023-07-06T21:42:06.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e797fa640 1 -- 172.21.15.55:0/3423751138 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e74009450 con 0x7f4e7c15bc30 2023-07-06T21:42:06.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e831fa640 1 -- 172.21.15.55:0/3423751138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e74009a70 con 0x7f4e7c15bc30 2023-07-06T21:42:06.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e797fa640 1 -- 172.21.15.55:0/3423751138 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e740b9690 con 0x7f4e7c15bc30 2023-07-06T21:42:06.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e831fa640 1 -- 172.21.15.55:0/3423751138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7c06dbb0 con 0x7f4e7c15bc30 2023-07-06T21:42:06.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e831fa640 1 -- 172.21.15.55:0/3423751138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7c1602b0 con 0x7f4e7c15bc30 2023-07-06T21:42:06.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e797fa640 1 -- 172.21.15.55:0/3423751138 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e740b97f0 con 0x7f4e7c15bc30 2023-07-06T21:42:06.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e797fa640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4e60066280 0x7f4e60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e797fa640 1 -- 172.21.15.55:0/3423751138 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4e7411f150 con 0x7f4e7c15bc30 2023-07-06T21:42:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.644+0000 7f4e80f96640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4e60066280 0x7f4e60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.648+0000 7f4e80f96640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4e60066280 0x7f4e60068730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4e70007fd0 tx=0x7f4e70009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:06.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.648+0000 7f4e797fa640 1 -- 172.21.15.55:0/3423751138 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e7c1602b0 con 0x7f4e7c15bc30 2023-07-06T21:42:06.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.836+0000 7f4e831fa640 1 -- 172.21.15.55:0/3423751138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e7c1602b0 con 0x7f4e7c15bc30 2023-07-06T21:42:06.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.836+0000 7f4e797fa640 1 -- 172.21.15.55:0/3423751138 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f4e740b2de0 con 0x7f4e7c15bc30 2023-07-06T21:42:06.842 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:06.842 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/720785920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":720785920},{"type":"v1","addr":"172.21.15.138:6834","nonce":720785920}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3780018439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3780018439},{"type":"v1","addr":"172.21.15.138:6835","nonce":3780018439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/690984517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":690984517},{"type":"v1","addr":"172.21.15.55:6837","nonce":690984517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4297,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1421414378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1421414378},{"type":"v1","addr":"172.21.15.55:6836","nonce":1421414378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-06T21:42:06.842 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 3 2023-07-06T21:42:06.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.840+0000 7f4e831fa640 1 -- 172.21.15.55:0/3423751138 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4e60066280 msgr2=0x7f4e60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.840+0000 7f4e831fa640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4e60066280 0x7f4e60068730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4e70007fd0 tx=0x7f4e70009040 comp rx=0 tx=0).stop 2023-07-06T21:42:06.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.840+0000 7f4e831fa640 1 -- 172.21.15.55:0/3423751138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e7c15bc30 msgr2=0x7f4e7c06a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:06.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.840+0000 7f4e831fa640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e7c15bc30 0x7f4e7c06a500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4e7401afd0 tx=0x7f4e740196c0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.840+0000 7f4e831fa640 1 -- 172.21.15.55:0/3423751138 shutdown_connections 2023-07-06T21:42:06.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.840+0000 7f4e831fa640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4e60066280 0x7f4e60068730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.840+0000 7f4e831fa640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e7c15bc30 0x7f4e7c06a500 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.840+0000 7f4e831fa640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e7c0cf9c0 0x7f4e7c1581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.840+0000 7f4e831fa640 1 --2- 172.21.15.55:0/3423751138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e7c06f2e0 0x7f4e7c06dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:06.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.840+0000 7f4e831fa640 1 -- 172.21.15.55:0/3423751138 >> 172.21.15.55:0/3423751138 conn(0x7f4e7c0b2840 msgr2=0x7f4e7c0b5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:06.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.840+0000 7f4e831fa640 1 -- 172.21.15.55:0/3423751138 shutdown_connections 2023-07-06T21:42:06.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:06.840+0000 7f4e831fa640 1 -- 172.21.15.55:0/3423751138 wait complete. 2023-07-06T21:42:06.863 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:07.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.000+0000 7f45a4ddb640 1 Processor -- start 2023-07-06T21:42:07.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.000+0000 7f45a4ddb640 1 -- start start 2023-07-06T21:42:07.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.000+0000 7f45a4ddb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45a015bc30 0x7f45a006ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.000+0000 7f45a4ddb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f45a00cfb90 0x7f45a00ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.000+0000 7f45a4ddb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a015f750 con 0x7f45a006f110 2023-07-06T21:42:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.000+0000 7f45a4ddb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a00cc800 con 0x7f45a015bc30 2023-07-06T21:42:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.000+0000 7f45a4ddb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a006f580 con 0x7f45a00cfb90 2023-07-06T21:42:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.000+0000 7f459e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45a015bc30 0x7f45a006ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.004+0000 7f459e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45a015bc30 0x7f45a006ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45734/0 (socket says 172.21.15.55:45734) 2023-07-06T21:42:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.004+0000 7f459e59c640 1 -- 172.21.15.55:0/2752378707 learned_addr learned my addr 172.21.15.55:0/2752378707 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.004+0000 7f459ed9d640 1 --2- 172.21.15.55:0/2752378707 >> v2:172.21.15.138:3300/0 conn(0x7f45a00cfb90 0x7f45a00ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.004+0000 7f459e59c640 1 -- 172.21.15.55:0/2752378707 >> v2:172.21.15.138:3300/0 conn(0x7f45a00cfb90 msgr2=0x7f45a00ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.004+0000 7f459e59c640 1 --2- 172.21.15.55:0/2752378707 >> v2:172.21.15.138:3300/0 conn(0x7f45a00cfb90 0x7f45a00ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.004+0000 7f459e59c640 1 -- 172.21.15.55:0/2752378707 >> v1:172.21.15.55:6789/0 conn(0x7f45a006f110 legacy=0x7f45a00cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.004+0000 7f459e59c640 1 -- 172.21.15.55:0/2752378707 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a015fa30 con 0x7f45a015bc30 2023-07-06T21:42:07.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.004+0000 7f459e59c640 1 --2- 172.21.15.55:0/2752378707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a015bc30 0x7f45a006ebd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45a00b56b0 tx=0x7f459001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f20fb44e01d5287 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:07.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.004+0000 7f459dd9b640 1 -- 172.21.15.55:0/2752378707 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45900aa430 con 0x7f45a015bc30 2023-07-06T21:42:07.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.004+0000 7f459dd9b640 1 -- 172.21.15.55:0/2752378707 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45900aa590 con 0x7f45a015bc30 2023-07-06T21:42:07.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.004+0000 7f459dd9b640 1 -- 172.21.15.55:0/2752378707 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45900aa920 con 0x7f45a015bc30 2023-07-06T21:42:07.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.004+0000 7f45a4ddb640 1 -- 172.21.15.55:0/2752378707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a015bc30 msgr2=0x7f45a006ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.004+0000 7f45a4ddb640 1 --2- 172.21.15.55:0/2752378707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a015bc30 0x7f45a006ebd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45a00b56b0 tx=0x7f459001c4d0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f45a4ddb640 1 -- 172.21.15.55:0/2752378707 shutdown_connections 2023-07-06T21:42:07.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f45a4ddb640 1 --2- 172.21.15.55:0/2752378707 >> v2:172.21.15.138:3300/0 conn(0x7f45a00cfb90 0x7f45a00ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f45a4ddb640 1 --2- 172.21.15.55:0/2752378707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a015bc30 0x7f45a006ebd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f45a4ddb640 1 -- 172.21.15.55:0/2752378707 >> 172.21.15.55:0/2752378707 conn(0x7f45a00b2840 msgr2=0x7f45a00d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:07.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f45a4ddb640 1 -- 172.21.15.55:0/2752378707 shutdown_connections 2023-07-06T21:42:07.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f45a4ddb640 1 -- 172.21.15.55:0/2752378707 wait complete. 2023-07-06T21:42:07.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f45a4ddb640 1 Processor -- start 2023-07-06T21:42:07.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f45a4ddb640 1 -- start start 2023-07-06T21:42:07.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f45a4ddb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a006f110 0x7f45a014da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f45a4ddb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a00cfb90 0x7f45a00c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f45a4ddb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a015bc30 0x7f45a00c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f45a4ddb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a014b380 con 0x7f45a015bc30 2023-07-06T21:42:07.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f45a4ddb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a0148800 con 0x7f45a006f110 2023-07-06T21:42:07.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f45a4ddb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a0148ae0 con 0x7f45a00cfb90 2023-07-06T21:42:07.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f459ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a015bc30 0x7f45a00c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f459ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a015bc30 0x7f45a00c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45750/0 (socket says 172.21.15.55:45750) 2023-07-06T21:42:07.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f459ed9d640 1 -- 172.21.15.55:0/1370567220 learned_addr learned my addr 172.21.15.55:0/1370567220 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:07.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f459e59c640 1 --2- 172.21.15.55:0/1370567220 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a006f110 0x7f45a014da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f4597fff640 1 --2- 172.21.15.55:0/1370567220 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a00cfb90 0x7f45a00c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f459ed9d640 1 -- 172.21.15.55:0/1370567220 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a00cfb90 msgr2=0x7f45a00c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f459ed9d640 1 --2- 172.21.15.55:0/1370567220 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a00cfb90 0x7f45a00c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f459ed9d640 1 -- 172.21.15.55:0/1370567220 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a006f110 msgr2=0x7f45a014da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f459ed9d640 1 --2- 172.21.15.55:0/1370567220 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a006f110 0x7f45a014da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.008+0000 7f459ed9d640 1 -- 172.21.15.55:0/1370567220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45900094d0 con 0x7f45a015bc30 2023-07-06T21:42:07.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.012+0000 7f459ed9d640 1 --2- 172.21.15.55:0/1370567220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a015bc30 0x7f45a00c6ab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4598007e30 tx=0x7f459800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:07.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.012+0000 7f4596ffd640 1 -- 172.21.15.55:0/1370567220 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598014620 con 0x7f45a015bc30 2023-07-06T21:42:07.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.012+0000 7f4596ffd640 1 -- 172.21.15.55:0/1370567220 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459800ee90 con 0x7f45a015bc30 2023-07-06T21:42:07.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.012+0000 7f4596ffd640 1 -- 172.21.15.55:0/1370567220 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45980149c0 con 0x7f45a015bc30 2023-07-06T21:42:07.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.012+0000 7f45a4ddb640 1 -- 172.21.15.55:0/1370567220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a0148dc0 con 0x7f45a015bc30 2023-07-06T21:42:07.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.012+0000 7f45a4ddb640 1 -- 172.21.15.55:0/1370567220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a0149380 con 0x7f45a015bc30 2023-07-06T21:42:07.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.012+0000 7f45a4ddb640 1 -- 172.21.15.55:0/1370567220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a0066d60 con 0x7f45a015bc30 2023-07-06T21:42:07.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.012+0000 7f4596ffd640 1 -- 172.21.15.55:0/1370567220 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4598014b20 con 0x7f45a015bc30 2023-07-06T21:42:07.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.012+0000 7f4596ffd640 1 --2- 172.21.15.55:0/1370567220 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4580066280 0x7f4580068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.012+0000 7f4596ffd640 1 -- 172.21.15.55:0/1370567220 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4598084220 con 0x7f45a015bc30 2023-07-06T21:42:07.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.016+0000 7f459e59c640 1 --2- 172.21.15.55:0/1370567220 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4580066280 0x7f4580068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.016+0000 7f459e59c640 1 --2- 172.21.15.55:0/1370567220 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4580066280 0x7f4580068730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f45900ae000 tx=0x7f45900b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:07.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.016+0000 7f4596ffd640 1 -- 172.21.15.55:0/1370567220 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4598051aa0 con 0x7f45a015bc30 2023-07-06T21:42:07.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.176+0000 7f45a4ddb640 1 -- 172.21.15.55:0/1370567220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45a00d0f40 con 0x7f45a015bc30 2023-07-06T21:42:07.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.176+0000 7f4596ffd640 1 -- 172.21.15.55:0/1370567220 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14624 (secure 0 0 0) 0x7f45980550c0 con 0x7f45a015bc30 2023-07-06T21:42:07.180 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:07.180 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:06.405608+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.176+0000 7f45a4ddb640 1 -- 172.21.15.55:0/1370567220 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4580066280 msgr2=0x7f4580068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.176+0000 7f45a4ddb640 1 --2- 172.21.15.55:0/1370567220 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4580066280 0x7f4580068730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f45900ae000 tx=0x7f45900b5040 comp rx=0 tx=0).stop 2023-07-06T21:42:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.176+0000 7f45a4ddb640 1 -- 172.21.15.55:0/1370567220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a015bc30 msgr2=0x7f45a00c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.176+0000 7f45a4ddb640 1 --2- 172.21.15.55:0/1370567220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a015bc30 0x7f45a00c6ab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4598007e30 tx=0x7f459800e4b0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.176+0000 7f45a4ddb640 1 -- 172.21.15.55:0/1370567220 shutdown_connections 2023-07-06T21:42:07.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.176+0000 7f45a4ddb640 1 --2- 172.21.15.55:0/1370567220 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4580066280 0x7f4580068730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.176+0000 7f45a4ddb640 1 --2- 172.21.15.55:0/1370567220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a015bc30 0x7f45a00c6ab0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.176+0000 7f45a4ddb640 1 --2- 172.21.15.55:0/1370567220 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a00cfb90 0x7f45a00c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.176+0000 7f45a4ddb640 1 --2- 172.21.15.55:0/1370567220 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a006f110 0x7f45a014da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.176+0000 7f45a4ddb640 1 -- 172.21.15.55:0/1370567220 >> 172.21.15.55:0/1370567220 conn(0x7f45a00b2840 msgr2=0x7f45a00b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:07.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.176+0000 7f45a4ddb640 1 -- 172.21.15.55:0/1370567220 shutdown_connections 2023-07-06T21:42:07.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.176+0000 7f45a4ddb640 1 -- 172.21.15.55:0/1370567220 wait complete. 2023-07-06T21:42:07.201 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:42:07.202 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:42:07.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa688574640 1 Processor -- start 2023-07-06T21:42:07.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa688574640 1 -- start start 2023-07-06T21:42:07.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa688574640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa680156180 0x7fa6800ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa688574640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6800cbeb0 0x7fa68006ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa688574640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6800cc310 con 0x7fa68006e9d0 2023-07-06T21:42:07.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa688574640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa680160250 con 0x7fa680156180 2023-07-06T21:42:07.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa688574640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68006f390 con 0x7fa6800cbeb0 2023-07-06T21:42:07.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa685b0f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa68006e9d0 0x7fa6800cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38196/0 (socket says 172.21.15.55:38196) 2023-07-06T21:42:07.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa685b0f640 1 -- 172.21.15.55:0/4221219523 learned_addr learned my addr 172.21.15.55:0/4221219523 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:07.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa686310640 1 --2- 172.21.15.55:0/4221219523 >> v2:172.21.15.138:3300/0 conn(0x7fa680156180 0x7fa6800ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa686b11640 1 --2- 172.21.15.55:0/4221219523 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6800cbeb0 0x7fa68006ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa68530e640 1 -- 172.21.15.55:0/4221219523 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963497700 0 0) 0x7fa6800cc310 con 0x7fa68006e9d0 2023-07-06T21:42:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa68530e640 1 -- 172.21.15.55:0/4221219523 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa66c003530 con 0x7fa68006e9d0 2023-07-06T21:42:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa68530e640 1 -- 172.21.15.55:0/4221219523 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 915005303 0 0) 0x7fa66c003530 con 0x7fa68006e9d0 2023-07-06T21:42:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa686310640 1 -- 172.21.15.55:0/4221219523 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6800cbeb0 msgr2=0x7fa68006ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa686310640 1 --2- 172.21.15.55:0/4221219523 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6800cbeb0 0x7fa68006ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa686310640 1 -- 172.21.15.55:0/4221219523 >> v1:172.21.15.55:6789/0 conn(0x7fa68006e9d0 legacy=0x7fa6800cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.344+0000 7fa686310640 1 -- 172.21.15.55:0/4221219523 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68015f5d0 con 0x7fa680156180 2023-07-06T21:42:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.348+0000 7fa686310640 1 --2- 172.21.15.55:0/4221219523 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa680156180 0x7fa6800ca610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0097c0 tx=0x7fa67c01c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=661fe566579d327b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.348+0000 7fa68530e640 1 -- 172.21.15.55:0/4221219523 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670001680 con 0x7fa680156180 2023-07-06T21:42:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.348+0000 7fa68530e640 1 -- 172.21.15.55:0/4221219523 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c0a7050 con 0x7fa680156180 2023-07-06T21:42:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.348+0000 7fa68530e640 1 -- 172.21.15.55:0/4221219523 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0ab620 con 0x7fa680156180 2023-07-06T21:42:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.348+0000 7fa688574640 1 -- 172.21.15.55:0/4221219523 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa680156180 msgr2=0x7fa6800ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.348+0000 7fa688574640 1 --2- 172.21.15.55:0/4221219523 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa680156180 0x7fa6800ca610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0097c0 tx=0x7fa67c01c2e0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.348+0000 7fa688574640 1 -- 172.21.15.55:0/4221219523 shutdown_connections 2023-07-06T21:42:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.348+0000 7fa688574640 1 --2- 172.21.15.55:0/4221219523 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6800cbeb0 0x7fa68006ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.348+0000 7fa688574640 1 --2- 172.21.15.55:0/4221219523 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa680156180 0x7fa6800ca610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.348+0000 7fa688574640 1 -- 172.21.15.55:0/4221219523 >> 172.21.15.55:0/4221219523 conn(0x7fa6800d0c50 msgr2=0x7fa6800cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:07.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.348+0000 7fa688574640 1 -- 172.21.15.55:0/4221219523 shutdown_connections 2023-07-06T21:42:07.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.348+0000 7fa688574640 1 -- 172.21.15.55:0/4221219523 wait complete. 2023-07-06T21:42:07.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa688574640 1 Processor -- start 2023-07-06T21:42:07.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa688574640 1 -- start start 2023-07-06T21:42:07.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa688574640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa68006e9d0 0x7fa6801f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa688574640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6800cbeb0 0x7fa68014fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa688574640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa680156180 0x7fa6800ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa688574640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6801508f0 con 0x7fa680156180 2023-07-06T21:42:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa688574640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6801f3c30 con 0x7fa6800cbeb0 2023-07-06T21:42:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa688574640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800b0600 con 0x7fa68006e9d0 2023-07-06T21:42:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa686b11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa680156180 0x7fa6800ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa686b11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa680156180 0x7fa6800ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45758/0 (socket says 172.21.15.55:45758) 2023-07-06T21:42:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa686b11640 1 -- 172.21.15.55:0/1972646483 learned_addr learned my addr 172.21.15.55:0/1972646483 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa685b0f640 1 --2- 172.21.15.55:0/1972646483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6800cbeb0 0x7fa68014fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa686310640 1 --2- 172.21.15.55:0/1972646483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa68006e9d0 0x7fa6801f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa686b11640 1 -- 172.21.15.55:0/1972646483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa68006e9d0 msgr2=0x7fa6801f36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa686b11640 1 --2- 172.21.15.55:0/1972646483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa68006e9d0 0x7fa6801f36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa686b11640 1 -- 172.21.15.55:0/1972646483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6800cbeb0 msgr2=0x7fa68014fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa686b11640 1 --2- 172.21.15.55:0/1972646483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6800cbeb0 0x7fa68014fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa686b11640 1 -- 172.21.15.55:0/1972646483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c009420 con 0x7fa680156180 2023-07-06T21:42:07.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa686b11640 1 --2- 172.21.15.55:0/1972646483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa680156180 0x7fa6800ca5f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa67800efc0 tx=0x7fa67800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:07.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa676ffd640 1 -- 172.21.15.55:0/1972646483 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678014480 con 0x7fa680156180 2023-07-06T21:42:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa676ffd640 1 -- 172.21.15.55:0/1972646483 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67800f040 con 0x7fa680156180 2023-07-06T21:42:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa676ffd640 1 -- 172.21.15.55:0/1972646483 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678014820 con 0x7fa680156180 2023-07-06T21:42:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa688574640 1 -- 172.21.15.55:0/1972646483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6800b08e0 con 0x7fa680156180 2023-07-06T21:42:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa688574640 1 -- 172.21.15.55:0/1972646483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6800b0ea0 con 0x7fa680156180 2023-07-06T21:42:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.352+0000 7fa688574640 1 -- 172.21.15.55:0/1972646483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa680066d60 con 0x7fa680156180 2023-07-06T21:42:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.356+0000 7fa676ffd640 1 -- 172.21.15.55:0/1972646483 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa678014980 con 0x7fa680156180 2023-07-06T21:42:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.356+0000 7fa676ffd640 1 --2- 172.21.15.55:0/1972646483 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa664066280 0x7fa664068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.356+0000 7fa676ffd640 1 -- 172.21.15.55:0/1972646483 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa678084630 con 0x7fa680156180 2023-07-06T21:42:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.356+0000 7fa686310640 1 --2- 172.21.15.55:0/1972646483 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa664066280 0x7fa664068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.356+0000 7fa686310640 1 --2- 172.21.15.55:0/1972646483 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa664066280 0x7fa664068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0ad000 tx=0x7fa67c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.360+0000 7fa676ffd640 1 -- 172.21.15.55:0/1972646483 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa678051d60 con 0x7fa680156180 2023-07-06T21:42:07.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.516+0000 7fa688574640 1 -- 172.21.15.55:0/1972646483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa6800cd930 con 0x7fa680156180 2023-07-06T21:42:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.516+0000 7fa676ffd640 1 -- 172.21.15.55:0/1972646483 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa678055380 con 0x7fa680156180 2023-07-06T21:42:07.520 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:42:07.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.516+0000 7fa688574640 1 -- 172.21.15.55:0/1972646483 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa664066280 msgr2=0x7fa664068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.516+0000 7fa688574640 1 --2- 172.21.15.55:0/1972646483 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa664066280 0x7fa664068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0ad000 tx=0x7fa67c008040 comp rx=0 tx=0).stop 2023-07-06T21:42:07.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.516+0000 7fa688574640 1 -- 172.21.15.55:0/1972646483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa680156180 msgr2=0x7fa6800ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.516+0000 7fa688574640 1 --2- 172.21.15.55:0/1972646483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa680156180 0x7fa6800ca5f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa67800efc0 tx=0x7fa67800c490 comp rx=0 tx=0).stop 2023-07-06T21:42:07.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.516+0000 7fa688574640 1 -- 172.21.15.55:0/1972646483 shutdown_connections 2023-07-06T21:42:07.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.516+0000 7fa688574640 1 --2- 172.21.15.55:0/1972646483 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa664066280 0x7fa664068730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.516+0000 7fa688574640 1 --2- 172.21.15.55:0/1972646483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa680156180 0x7fa6800ca5f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.516+0000 7fa688574640 1 --2- 172.21.15.55:0/1972646483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6800cbeb0 0x7fa68014fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.516+0000 7fa688574640 1 --2- 172.21.15.55:0/1972646483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa68006e9d0 0x7fa6801f36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.516+0000 7fa688574640 1 -- 172.21.15.55:0/1972646483 >> 172.21.15.55:0/1972646483 conn(0x7fa6800d0c50 msgr2=0x7fa680155560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:07.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.516+0000 7fa688574640 1 -- 172.21.15.55:0/1972646483 shutdown_connections 2023-07-06T21:42:07.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.516+0000 7fa688574640 1 -- 172.21.15.55:0/1972646483 wait complete. 2023-07-06T21:42:07.540 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:42:07.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafd8e93640 1 Processor -- start 2023-07-06T21:42:07.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafd8e93640 1 -- start start 2023-07-06T21:42:07.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafd8e93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafd406fff0 0x7fafd4070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafd8e93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fafd40b2ca0 0x7fafd40b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafd8e93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd40cd490 con 0x7fafd41597d0 2023-07-06T21:42:07.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafd8e93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd4070960 con 0x7fafd40b2ca0 2023-07-06T21:42:07.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafd8e93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd415cf60 con 0x7fafd406fff0 2023-07-06T21:42:07.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafd259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fafd41597d0 0x7fafd40ca6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38202/0 (socket says 172.21.15.55:38202) 2023-07-06T21:42:07.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafd259c640 1 -- 172.21.15.55:0/3871552937 learned_addr learned my addr 172.21.15.55:0/3871552937 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:07.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafd2d9d640 1 --2- 172.21.15.55:0/3871552937 >> v2:172.21.15.55:3300/0 conn(0x7fafd40b2ca0 0x7fafd40b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafcbfff640 1 --2- 172.21.15.55:0/3871552937 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafd406fff0 0x7fafd4070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafd2d9d640 1 -- 172.21.15.55:0/3871552937 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafd406fff0 msgr2=0x7fafd4070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:07.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafd2d9d640 1 --2- 172.21.15.55:0/3871552937 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafd406fff0 0x7fafd4070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafd2d9d640 1 -- 172.21.15.55:0/3871552937 >> v1:172.21.15.55:6789/0 conn(0x7fafd41597d0 legacy=0x7fafd40ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.684+0000 7fafd2d9d640 1 -- 172.21.15.55:0/3871552937 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd40ccb60 con 0x7fafd40b2ca0 2023-07-06T21:42:07.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.688+0000 7fafd2d9d640 1 --2- 172.21.15.55:0/3871552937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd40b2ca0 0x7fafd40b3120 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009d90 tx=0x7fafcc01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd91dbc6efccf8e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:07.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.688+0000 7fafd1d9b640 1 -- 172.21.15.55:0/3871552937 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd40b3e70 con 0x7fafd40b2ca0 2023-07-06T21:42:07.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.688+0000 7fafd1d9b640 1 -- 172.21.15.55:0/3871552937 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc0a5950 con 0x7fafd40b2ca0 2023-07-06T21:42:07.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.688+0000 7fafd1d9b640 1 -- 172.21.15.55:0/3871552937 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0a5ce0 con 0x7fafd40b2ca0 2023-07-06T21:42:07.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.688+0000 7fafd8e93640 1 -- 172.21.15.55:0/3871552937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd40b2ca0 msgr2=0x7fafd40b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.688+0000 7fafd8e93640 1 --2- 172.21.15.55:0/3871552937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd40b2ca0 0x7fafd40b3120 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009d90 tx=0x7fafcc01c890 comp rx=0 tx=0).stop 2023-07-06T21:42:07.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.688+0000 7fafd8e93640 1 -- 172.21.15.55:0/3871552937 shutdown_connections 2023-07-06T21:42:07.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.688+0000 7fafd8e93640 1 --2- 172.21.15.55:0/3871552937 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafd406fff0 0x7fafd4070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.688+0000 7fafd8e93640 1 --2- 172.21.15.55:0/3871552937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd40b2ca0 0x7fafd40b3120 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.688+0000 7fafd8e93640 1 -- 172.21.15.55:0/3871552937 >> 172.21.15.55:0/3871552937 conn(0x7fafd40cb970 msgr2=0x7fafd40cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:07.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.688+0000 7fafd8e93640 1 -- 172.21.15.55:0/3871552937 shutdown_connections 2023-07-06T21:42:07.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.688+0000 7fafd8e93640 1 -- 172.21.15.55:0/3871552937 wait complete. 2023-07-06T21:42:07.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.688+0000 7fafd8e93640 1 Processor -- start 2023-07-06T21:42:07.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafd8e93640 1 -- start start 2023-07-06T21:42:07.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafd8e93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafd406fff0 0x7fafd4149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafd8e93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd40b2ca0 0x7fafd414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafd8e93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafd414e6b0 0x7fafd40c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafd8e93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd414d0f0 con 0x7fafd40b2ca0 2023-07-06T21:42:07.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafd8e93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd414bb10 con 0x7fafd414e6b0 2023-07-06T21:42:07.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafd8e93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd414bdf0 con 0x7fafd406fff0 2023-07-06T21:42:07.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafcbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd40b2ca0 0x7fafd414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafcbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd40b2ca0 0x7fafd414cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45782/0 (socket says 172.21.15.55:45782) 2023-07-06T21:42:07.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafcbfff640 1 -- 172.21.15.55:0/4254470804 learned_addr learned my addr 172.21.15.55:0/4254470804 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:07.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafd259c640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafd406fff0 0x7fafd4149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafd2d9d640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafd414e6b0 0x7fafd40c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafcbfff640 1 -- 172.21.15.55:0/4254470804 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafd406fff0 msgr2=0x7fafd4149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafcbfff640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafd406fff0 0x7fafd4149e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafcbfff640 1 -- 172.21.15.55:0/4254470804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafd414e6b0 msgr2=0x7fafd40c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafcbfff640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafd414e6b0 0x7fafd40c2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafcbfff640 1 -- 172.21.15.55:0/4254470804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc009a70 con 0x7fafd40b2ca0 2023-07-06T21:42:07.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafd2d9d640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafd414e6b0 0x7fafd40c2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:07.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafcbfff640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd40b2ca0 0x7fafd414cbb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00d800 tx=0x7fafbc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:07.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafcaffd640 1 -- 172.21.15.55:0/4254470804 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc00b6c0 con 0x7fafd40b2ca0 2023-07-06T21:42:07.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafcaffd640 1 -- 172.21.15.55:0/4254470804 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc00b820 con 0x7fafd40b2ca0 2023-07-06T21:42:07.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafd8e93640 1 -- 172.21.15.55:0/4254470804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd414c0d0 con 0x7fafd40b2ca0 2023-07-06T21:42:07.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafcaffd640 1 -- 172.21.15.55:0/4254470804 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc00bb90 con 0x7fafd40b2ca0 2023-07-06T21:42:07.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafd8e93640 1 -- 172.21.15.55:0/4254470804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd414c690 con 0x7fafd40b2ca0 2023-07-06T21:42:07.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.692+0000 7fafd8e93640 1 -- 172.21.15.55:0/4254470804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd414c850 con 0x7fafd40b2ca0 2023-07-06T21:42:07.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.696+0000 7fafcaffd640 1 -- 172.21.15.55:0/4254470804 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fafbc00bcf0 con 0x7fafd40b2ca0 2023-07-06T21:42:07.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.696+0000 7fafcaffd640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fafb4066280 0x7fafb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:07.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.696+0000 7fafcaffd640 1 -- 172.21.15.55:0/4254470804 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fafbc083ec0 con 0x7fafd40b2ca0 2023-07-06T21:42:07.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.696+0000 7fafd259c640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fafb4066280 0x7fafb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:07.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.696+0000 7fafd259c640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fafb4066280 0x7fafb4068730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fafc4005890 tx=0x7fafc4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.700+0000 7fafcaffd640 1 -- 172.21.15.55:0/4254470804 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fafbc055110 con 0x7fafd40b2ca0 2023-07-06T21:42:07.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.856+0000 7fafd8e93640 1 -- 172.21.15.55:0/4254470804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fafd4066d60 con 0x7fafd40b2ca0 2023-07-06T21:42:07.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.856+0000 7fafcaffd640 1 -- 172.21.15.55:0/4254470804 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fafbc054ca0 con 0x7fafd40b2ca0 2023-07-06T21:42:07.860 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:42:07.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.856+0000 7fafd8e93640 1 -- 172.21.15.55:0/4254470804 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fafb4066280 msgr2=0x7fafb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.856+0000 7fafd8e93640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fafb4066280 0x7fafb4068730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fafc4005890 tx=0x7fafc4009040 comp rx=0 tx=0).stop 2023-07-06T21:42:07.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.856+0000 7fafd8e93640 1 -- 172.21.15.55:0/4254470804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd40b2ca0 msgr2=0x7fafd414cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:07.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.856+0000 7fafd8e93640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd40b2ca0 0x7fafd414cbb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00d800 tx=0x7fafbc00dcc0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.856+0000 7fafd8e93640 1 -- 172.21.15.55:0/4254470804 shutdown_connections 2023-07-06T21:42:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.856+0000 7fafd8e93640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fafb4066280 0x7fafb4068730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.856+0000 7fafd8e93640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafd414e6b0 0x7fafd40c2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.856+0000 7fafd8e93640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd40b2ca0 0x7fafd414cbb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.856+0000 7fafd8e93640 1 --2- 172.21.15.55:0/4254470804 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafd406fff0 0x7fafd4149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.856+0000 7fafd8e93640 1 -- 172.21.15.55:0/4254470804 >> 172.21.15.55:0/4254470804 conn(0x7fafd40cb970 msgr2=0x7fafd40b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.856+0000 7fafd8e93640 1 -- 172.21.15.55:0/4254470804 shutdown_connections 2023-07-06T21:42:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:07.856+0000 7fafd8e93640 1 -- 172.21.15.55:0/4254470804 wait complete. 2023-07-06T21:42:07.881 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T21:42:08.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.020+0000 7f925866d640 1 Processor -- start 2023-07-06T21:42:08.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.020+0000 7f925866d640 1 -- start start 2023-07-06T21:42:08.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.020+0000 7f925866d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925015b9d0 0x7f925015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:08.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.020+0000 7f925866d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92500b4420 0x7f92500ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:08.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.020+0000 7f925866d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925006a160 con 0x7f92500ce340 2023-07-06T21:42:08.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.020+0000 7f925866d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925015bda0 con 0x7f92500b4420 2023-07-06T21:42:08.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.020+0000 7f925866d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9250069590 con 0x7f925015b9d0 2023-07-06T21:42:08.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.020+0000 7f9256c0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92500b4420 0x7f92500ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:08.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.020+0000 7f9256c0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92500b4420 0x7f92500ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45784/0 (socket says 172.21.15.55:45784) 2023-07-06T21:42:08.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.020+0000 7f9256c0a640 1 -- 172.21.15.55:0/3327275827 learned_addr learned my addr 172.21.15.55:0/3327275827 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:08.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.020+0000 7f9256409640 1 --2- 172.21.15.55:0/3327275827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925015b9d0 0x7f925015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:08.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.020+0000 7f9256c0a640 1 -- 172.21.15.55:0/3327275827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925015b9d0 msgr2=0x7f925015f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:08.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f9256c0a640 1 --2- 172.21.15.55:0/3327275827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925015b9d0 0x7f925015f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f9256c0a640 1 -- 172.21.15.55:0/3327275827 >> v1:172.21.15.138:6789/0 conn(0x7f92500ce340 legacy=0x7f92500b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:08.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f9256c0a640 1 -- 172.21.15.55:0/3327275827 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250069830 con 0x7f92500b4420 2023-07-06T21:42:08.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f9256c0a640 1 --2- 172.21.15.55:0/3327275827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92500b4420 0x7f92500ce770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9248009e50 tx=0x7f924801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea2f7c3bfe54bbc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:08.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f9255407640 1 -- 172.21.15.55:0/3327275827 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480a58a0 con 0x7f92500b4420 2023-07-06T21:42:08.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f9255407640 1 -- 172.21.15.55:0/3327275827 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92480a5a00 con 0x7f92500b4420 2023-07-06T21:42:08.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f9255407640 1 -- 172.21.15.55:0/3327275827 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480a5d90 con 0x7f92500b4420 2023-07-06T21:42:08.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f925866d640 1 -- 172.21.15.55:0/3327275827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92500b4420 msgr2=0x7f92500ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:08.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f925866d640 1 --2- 172.21.15.55:0/3327275827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92500b4420 0x7f92500ce770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9248009e50 tx=0x7f924801c9e0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f925866d640 1 -- 172.21.15.55:0/3327275827 shutdown_connections 2023-07-06T21:42:08.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f925866d640 1 --2- 172.21.15.55:0/3327275827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92500b4420 0x7f92500ce770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f925866d640 1 --2- 172.21.15.55:0/3327275827 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925015b9d0 0x7f925015f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f925866d640 1 -- 172.21.15.55:0/3327275827 >> 172.21.15.55:0/3327275827 conn(0x7f92500ced10 msgr2=0x7f92500cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:08.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f925866d640 1 -- 172.21.15.55:0/3327275827 shutdown_connections 2023-07-06T21:42:08.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.024+0000 7f925866d640 1 -- 172.21.15.55:0/3327275827 wait complete. 2023-07-06T21:42:08.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f925866d640 1 Processor -- start 2023-07-06T21:42:08.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f925866d640 1 -- start start 2023-07-06T21:42:08.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f925866d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92500b4420 0x7f9250150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:08.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f925866d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92500ce340 0x7f92500c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:08.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f925866d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925015b9d0 0x7f92500c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:08.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f925866d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925014f670 con 0x7f92500ce340 2023-07-06T21:42:08.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f925866d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925014fe40 con 0x7f92500b4420 2023-07-06T21:42:08.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f925866d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92500b5b70 con 0x7f925015b9d0 2023-07-06T21:42:08.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f9255c08640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92500ce340 0x7f92500c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:08.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f9255c08640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92500ce340 0x7f92500c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45796/0 (socket says 172.21.15.55:45796) 2023-07-06T21:42:08.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f9255c08640 1 -- 172.21.15.55:0/54255467 learned_addr learned my addr 172.21.15.55:0/54255467 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:08.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f9256409640 1 --2- 172.21.15.55:0/54255467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92500b4420 0x7f9250150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:08.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f9256c0a640 1 --2- 172.21.15.55:0/54255467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925015b9d0 0x7f92500c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:08.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f9255c08640 1 -- 172.21.15.55:0/54255467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925015b9d0 msgr2=0x7f92500c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:08.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f9255c08640 1 --2- 172.21.15.55:0/54255467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925015b9d0 0x7f92500c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f9255c08640 1 -- 172.21.15.55:0/54255467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92500b4420 msgr2=0x7f9250150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:08.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f9255c08640 1 --2- 172.21.15.55:0/54255467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92500b4420 0x7f9250150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f9255c08640 1 -- 172.21.15.55:0/54255467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9248009b30 con 0x7f92500ce340 2023-07-06T21:42:08.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f9255c08640 1 --2- 172.21.15.55:0/54255467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92500ce340 0x7f92500c5ba0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f924000c500 tx=0x7f924000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:08.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f9246ffd640 1 -- 172.21.15.55:0/54255467 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240005220 con 0x7f92500ce340 2023-07-06T21:42:08.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f9246ffd640 1 -- 172.21.15.55:0/54255467 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9240005380 con 0x7f92500ce340 2023-07-06T21:42:08.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f9246ffd640 1 -- 172.21.15.55:0/54255467 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240007270 con 0x7f92500ce340 2023-07-06T21:42:08.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f925866d640 1 -- 172.21.15.55:0/54255467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9250150eb0 con 0x7f92500ce340 2023-07-06T21:42:08.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.028+0000 7f925866d640 1 -- 172.21.15.55:0/54255467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925014fb60 con 0x7f92500ce340 2023-07-06T21:42:08.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.032+0000 7f925866d640 1 -- 172.21.15.55:0/54255467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9250066d60 con 0x7f92500ce340 2023-07-06T21:42:08.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.032+0000 7f9246ffd640 1 -- 172.21.15.55:0/54255467 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92400073d0 con 0x7f92500ce340 2023-07-06T21:42:08.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.032+0000 7f9246ffd640 1 --2- 172.21.15.55:0/54255467 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9234066280 0x7f9234068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:08.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.032+0000 7f9246ffd640 1 -- 172.21.15.55:0/54255467 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9240083200 con 0x7f92500ce340 2023-07-06T21:42:08.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.032+0000 7f9256409640 1 --2- 172.21.15.55:0/54255467 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9234066280 0x7f9234068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:08.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.036+0000 7f9256409640 1 --2- 172.21.15.55:0/54255467 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9234066280 0x7f9234068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f924c0079c0 tx=0x7f924c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:08.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.036+0000 7f9246ffd640 1 -- 172.21.15.55:0/54255467 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92400509f0 con 0x7f92500ce340 2023-07-06T21:42:08.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.204+0000 7f925866d640 1 -- 172.21.15.55:0/54255467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f925006ac10 con 0x7f92500ce340 2023-07-06T21:42:08.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.204+0000 7f9246ffd640 1 -- 172.21.15.55:0/54255467 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9240054010 con 0x7f92500ce340 2023-07-06T21:42:08.209 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:08.209 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T21:42:08.209 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:42:08.210 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-07-06T21:42:08.210 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-07-06T21:42:08.210 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:42:08.211 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:42:08.211 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-07-06T21:42:08.211 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-07-06T21:42:08.211 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:42:08.212 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T21:42:08.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.204+0000 7f925866d640 1 -- 172.21.15.55:0/54255467 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9234066280 msgr2=0x7f9234068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:08.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.204+0000 7f925866d640 1 --2- 172.21.15.55:0/54255467 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9234066280 0x7f9234068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f924c0079c0 tx=0x7f924c008040 comp rx=0 tx=0).stop 2023-07-06T21:42:08.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.204+0000 7f925866d640 1 -- 172.21.15.55:0/54255467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92500ce340 msgr2=0x7f92500c5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:08.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.204+0000 7f925866d640 1 --2- 172.21.15.55:0/54255467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92500ce340 0x7f92500c5ba0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f924000c500 tx=0x7f924000c9c0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.204+0000 7f925866d640 1 -- 172.21.15.55:0/54255467 shutdown_connections 2023-07-06T21:42:08.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.204+0000 7f925866d640 1 --2- 172.21.15.55:0/54255467 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9234066280 0x7f9234068730 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.204+0000 7f925866d640 1 --2- 172.21.15.55:0/54255467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925015b9d0 0x7f92500c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.204+0000 7f925866d640 1 --2- 172.21.15.55:0/54255467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92500ce340 0x7f92500c5ba0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.204+0000 7f925866d640 1 --2- 172.21.15.55:0/54255467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92500b4420 0x7f9250150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.204+0000 7f925866d640 1 -- 172.21.15.55:0/54255467 >> 172.21.15.55:0/54255467 conn(0x7f92500ced10 msgr2=0x7f92500ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:08.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.204+0000 7f925866d640 1 -- 172.21.15.55:0/54255467 shutdown_connections 2023-07-06T21:42:08.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.204+0000 7f925866d640 1 -- 172.21.15.55:0/54255467 wait complete. 2023-07-06T21:42:08.229 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T21:42:08.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T21:42:08.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.372+0000 7f4390fc5640 1 Processor -- start 2023-07-06T21:42:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.372+0000 7f4390fc5640 1 -- start start 2023-07-06T21:42:08.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.372+0000 7f4390fc5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f438c15b930 0x7f438c0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:08.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.372+0000 7f4390fc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f438c0cc2e0 0x7f438c0ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:08.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.372+0000 7f4390fc5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c0b5880 con 0x7f438c0ce790 2023-07-06T21:42:08.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.372+0000 7f4390fc5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438c0b5b60 con 0x7f438c15b930 2023-07-06T21:42:08.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.372+0000 7f4390fc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c0cdcb0 con 0x7f438c0cc2e0 2023-07-06T21:42:08.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.376+0000 7f438a59c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f438c15b930 0x7f438c0cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.376+0000 7f438ad9d640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f438c0ce790 0x7f438c0ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:38194/0 (socket says 172.21.15.55:38194) 2023-07-06T21:42:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.376+0000 7f438ad9d640 1 -- 172.21.15.55:0/327192662 learned_addr learned my addr 172.21.15.55:0/327192662 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.376+0000 7f4389d9b640 1 --2- 172.21.15.55:0/327192662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f438c0cc2e0 0x7f438c0ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:08.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.376+0000 7f438a59c640 1 -- 172.21.15.55:0/327192662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f438c0cc2e0 msgr2=0x7f438c0ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:08.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.376+0000 7f438a59c640 1 --2- 172.21.15.55:0/327192662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f438c0cc2e0 0x7f438c0ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.376+0000 7f438a59c640 1 -- 172.21.15.55:0/327192662 >> v1:172.21.15.138:6789/0 conn(0x7f438c0ce790 legacy=0x7f438c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:08.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.376+0000 7f438a59c640 1 -- 172.21.15.55:0/327192662 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c0cdf90 con 0x7f438c15b930 2023-07-06T21:42:08.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.376+0000 7f438959a640 1 -- 172.21.15.55:0/327192662 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137867983 0 0) 0x7f438c0b5880 con 0x7f438c0ce790 2023-07-06T21:42:08.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.376+0000 7f4389d9b640 1 --2- 172.21.15.55:0/327192662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f438c0cc2e0 0x7f438c0ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:08.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.376+0000 7f438a59c640 1 --2- 172.21.15.55:0/327192662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f438c15b930 0x7f438c0cc9e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f437c0097c0 tx=0x7f437c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edc20b3f05de0ed server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:08.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f438959a640 1 -- 172.21.15.55:0/327192662 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c0ab670 con 0x7f438c15b930 2023-07-06T21:42:08.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f438959a640 1 -- 172.21.15.55:0/327192662 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c0ab7d0 con 0x7f438c15b930 2023-07-06T21:42:08.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f438959a640 1 -- 172.21.15.55:0/327192662 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c0abb60 con 0x7f438c15b930 2023-07-06T21:42:08.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 -- 172.21.15.55:0/327192662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f438c15b930 msgr2=0x7f438c0cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:08.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 --2- 172.21.15.55:0/327192662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f438c15b930 0x7f438c0cc9e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f437c0097c0 tx=0x7f437c01c450 comp rx=0 tx=0).stop 2023-07-06T21:42:08.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 -- 172.21.15.55:0/327192662 shutdown_connections 2023-07-06T21:42:08.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 --2- 172.21.15.55:0/327192662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f438c0cc2e0 0x7f438c0ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 --2- 172.21.15.55:0/327192662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f438c15b930 0x7f438c0cc9e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 -- 172.21.15.55:0/327192662 >> 172.21.15.55:0/327192662 conn(0x7f438c0d0c60 msgr2=0x7f438c0b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:08.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 -- 172.21.15.55:0/327192662 shutdown_connections 2023-07-06T21:42:08.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 -- 172.21.15.55:0/327192662 wait complete. 2023-07-06T21:42:08.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 Processor -- start 2023-07-06T21:42:08.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 -- start start 2023-07-06T21:42:08.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f438c0ce790 0x7f438c146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:08.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f438c15b930 0x7f438c149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:08.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438c14ae20 0x7f438c149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:08.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c14ff80 con 0x7f438c14ae20 2023-07-06T21:42:08.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c150260 con 0x7f438c15b930 2023-07-06T21:42:08.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f4390fc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c14a620 con 0x7f438c0ce790 2023-07-06T21:42:08.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f438ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438c14ae20 0x7f438c149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:08.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f438ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438c14ae20 0x7f438c149fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45798/0 (socket says 172.21.15.55:45798) 2023-07-06T21:42:08.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.380+0000 7f438ad9d640 1 -- 172.21.15.55:0/4273304996 learned_addr learned my addr 172.21.15.55:0/4273304996 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:08.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f438a59c640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f438c0ce790 0x7f438c146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:08.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f4389d9b640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f438c15b930 0x7f438c149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:08.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f438ad9d640 1 -- 172.21.15.55:0/4273304996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f438c0ce790 msgr2=0x7f438c146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:08.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f438ad9d640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f438c0ce790 0x7f438c146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f438ad9d640 1 -- 172.21.15.55:0/4273304996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f438c15b930 msgr2=0x7f438c149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:08.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f438ad9d640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f438c15b930 0x7f438c149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:08.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f438ad9d640 1 -- 172.21.15.55:0/4273304996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4380009420 con 0x7f438c14ae20 2023-07-06T21:42:08.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f4389d9b640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f438c15b930 0x7f438c149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:08.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f438ad9d640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438c14ae20 0x7f438c149fb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4384001570 tx=0x7f438400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:08.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f437affd640 1 -- 172.21.15.55:0/4273304996 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438400a640 con 0x7f438c14ae20 2023-07-06T21:42:08.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f437affd640 1 -- 172.21.15.55:0/4273304996 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438400a7c0 con 0x7f438c14ae20 2023-07-06T21:42:08.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f437affd640 1 -- 172.21.15.55:0/4273304996 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438400ab70 con 0x7f438c14ae20 2023-07-06T21:42:08.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f4390fc5640 1 -- 172.21.15.55:0/4273304996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437c009420 con 0x7f438c14ae20 2023-07-06T21:42:08.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f4390fc5640 1 -- 172.21.15.55:0/4273304996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c147490 con 0x7f438c14ae20 2023-07-06T21:42:08.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f4390fc5640 1 -- 172.21.15.55:0/4273304996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c066d60 con 0x7f438c14ae20 2023-07-06T21:42:08.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.384+0000 7f437affd640 1 -- 172.21.15.55:0/4273304996 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f438400acd0 con 0x7f438c14ae20 2023-07-06T21:42:08.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.388+0000 7f437affd640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f436c066280 0x7f436c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:08.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.388+0000 7f437affd640 1 -- 172.21.15.55:0/4273304996 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4384082f00 con 0x7f438c14ae20 2023-07-06T21:42:08.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.388+0000 7f438a59c640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f436c066280 0x7f436c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:08.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.388+0000 7f438a59c640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f436c066280 0x7f436c068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f437c0af000 tx=0x7f437c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:08.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.392+0000 7f437affd640 1 -- 172.21.15.55:0/4273304996 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4384050770 con 0x7f438c14ae20 2023-07-06T21:42:08.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:08.548+0000 7f4390fc5640 1 -- 172.21.15.55:0/4273304996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f438c0cc790 con 0x7f438c14ae20 2023-07-06T21:42:09.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.436+0000 7f437affd640 1 -- 172.21.15.55:0/4273304996 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4384018020 con 0x7f438c14ae20 2023-07-06T21:42:09.441 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-07-06T21:42:09.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.440+0000 7f4390fc5640 1 -- 172.21.15.55:0/4273304996 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f436c066280 msgr2=0x7f436c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:09.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.440+0000 7f4390fc5640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f436c066280 0x7f436c068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f437c0af000 tx=0x7f437c0a7000 comp rx=0 tx=0).stop 2023-07-06T21:42:09.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.440+0000 7f4390fc5640 1 -- 172.21.15.55:0/4273304996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438c14ae20 msgr2=0x7f438c149fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:09.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.440+0000 7f4390fc5640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438c14ae20 0x7f438c149fb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4384001570 tx=0x7f438400cca0 comp rx=0 tx=0).stop 2023-07-06T21:42:09.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.444+0000 7f4390fc5640 1 -- 172.21.15.55:0/4273304996 shutdown_connections 2023-07-06T21:42:09.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.444+0000 7f4390fc5640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f436c066280 0x7f436c068730 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:09.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.444+0000 7f4390fc5640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438c14ae20 0x7f438c149fb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:09.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.444+0000 7f4390fc5640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f438c15b930 0x7f438c149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:09.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.444+0000 7f4390fc5640 1 --2- 172.21.15.55:0/4273304996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f438c0ce790 0x7f438c146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:09.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.444+0000 7f4390fc5640 1 -- 172.21.15.55:0/4273304996 >> 172.21.15.55:0/4273304996 conn(0x7f438c0d0c60 msgr2=0x7f438c0ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:09.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.444+0000 7f4390fc5640 1 -- 172.21.15.55:0/4273304996 shutdown_connections 2023-07-06T21:42:09.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.444+0000 7f4390fc5640 1 -- 172.21.15.55:0/4273304996 wait complete. 2023-07-06T21:42:09.473 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-07-06T21:42:09.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.620+0000 7fb92eb03640 1 Processor -- start 2023-07-06T21:42:09.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.620+0000 7fb92eb03640 1 -- start start 2023-07-06T21:42:09.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92eb03640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb92815b8c0 0x7fb9280cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:09.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92eb03640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb92815bc90 0x7fb9280cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:09.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92eb03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9280cc0b0 0x7fb92815f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:09.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92eb03640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9280cdd30 con 0x7fb9280cc0b0 2023-07-06T21:42:09.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92eb03640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9280cc510 con 0x7fb92815bc90 2023-07-06T21:42:09.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92eb03640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280cdf80 con 0x7fb92815b8c0 2023-07-06T21:42:09.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92d0a0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9280cc0b0 0x7fb92815f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:09.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92d0a0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9280cc0b0 0x7fb92815f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45808/0 (socket says 172.21.15.55:45808) 2023-07-06T21:42:09.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92d0a0640 1 -- 172.21.15.55:0/124028865 learned_addr learned my addr 172.21.15.55:0/124028865 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:09.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92c89f640 1 --2- 172.21.15.55:0/124028865 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb92815b8c0 0x7fb9280cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:09.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb927fff640 1 --2- 172.21.15.55:0/124028865 >> v2:172.21.15.138:3300/0 conn(0x7fb92815bc90 0x7fb9280cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:09.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92d0a0640 1 -- 172.21.15.55:0/124028865 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb92815b8c0 msgr2=0x7fb9280cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:09.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92d0a0640 1 --2- 172.21.15.55:0/124028865 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb92815b8c0 0x7fb9280cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:09.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92d0a0640 1 -- 172.21.15.55:0/124028865 >> v2:172.21.15.138:3300/0 conn(0x7fb92815bc90 msgr2=0x7fb9280cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:09.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92d0a0640 1 --2- 172.21.15.55:0/124028865 >> v2:172.21.15.138:3300/0 conn(0x7fb92815bc90 0x7fb9280cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:09.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb92d0a0640 1 -- 172.21.15.55:0/124028865 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9280ce260 con 0x7fb9280cc0b0 2023-07-06T21:42:09.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.624+0000 7fb927fff640 1 --2- 172.21.15.55:0/124028865 >> v2:172.21.15.138:3300/0 conn(0x7fb92815bc90 0x7fb9280cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:09.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb92d0a0640 1 --2- 172.21.15.55:0/124028865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9280cc0b0 0x7fb92815f6c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb9280735c0 tx=0x7fb92001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e0cfe2675dba90 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:09.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb9277fe640 1 -- 172.21.15.55:0/124028865 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200a6480 con 0x7fb9280cc0b0 2023-07-06T21:42:09.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb9277fe640 1 -- 172.21.15.55:0/124028865 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9200a65e0 con 0x7fb9280cc0b0 2023-07-06T21:42:09.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb9277fe640 1 -- 172.21.15.55:0/124028865 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200a6970 con 0x7fb9280cc0b0 2023-07-06T21:42:09.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb92eb03640 1 -- 172.21.15.55:0/124028865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9280cc0b0 msgr2=0x7fb92815f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:09.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb92eb03640 1 --2- 172.21.15.55:0/124028865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9280cc0b0 0x7fb92815f6c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb9280735c0 tx=0x7fb92001c6e0 comp rx=0 tx=0).stop 2023-07-06T21:42:09.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb92eb03640 1 -- 172.21.15.55:0/124028865 shutdown_connections 2023-07-06T21:42:09.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb92eb03640 1 --2- 172.21.15.55:0/124028865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9280cc0b0 0x7fb92815f6c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:09.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb92eb03640 1 --2- 172.21.15.55:0/124028865 >> v2:172.21.15.138:3300/0 conn(0x7fb92815bc90 0x7fb9280cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:09.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb92eb03640 1 --2- 172.21.15.55:0/124028865 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb92815b8c0 0x7fb9280cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:09.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb92eb03640 1 -- 172.21.15.55:0/124028865 >> 172.21.15.55:0/124028865 conn(0x7fb9280ccbe0 msgr2=0x7fb9280ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:09.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb92eb03640 1 -- 172.21.15.55:0/124028865 shutdown_connections 2023-07-06T21:42:09.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb92eb03640 1 -- 172.21.15.55:0/124028865 wait complete. 2023-07-06T21:42:09.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb92eb03640 1 Processor -- start 2023-07-06T21:42:09.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.628+0000 7fb92eb03640 1 -- start start 2023-07-06T21:42:09.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb92eb03640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9280cc0b0 0x7fb92815a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:09.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb92eb03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb92815b8c0 0x7fb9280c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:09.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb92eb03640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb92815bc90 0x7fb9280c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:09.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb92eb03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92815c2d0 con 0x7fb92815b8c0 2023-07-06T21:42:09.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb92eb03640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92815c5b0 con 0x7fb9280cc0b0 2023-07-06T21:42:09.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb92eb03640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb928159ff0 con 0x7fb92815bc90 2023-07-06T21:42:09.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb927fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb92815b8c0 0x7fb9280c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:09.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb927fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb92815b8c0 0x7fb9280c4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45818/0 (socket says 172.21.15.55:45818) 2023-07-06T21:42:09.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb927fff640 1 -- 172.21.15.55:0/4270483066 learned_addr learned my addr 172.21.15.55:0/4270483066 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:09.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb92d0a0640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb92815bc90 0x7fb9280c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:09.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb92c89f640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9280cc0b0 0x7fb92815a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:09.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb927fff640 1 -- 172.21.15.55:0/4270483066 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb92815bc90 msgr2=0x7fb9280c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:09.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb927fff640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb92815bc90 0x7fb9280c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:09.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb927fff640 1 -- 172.21.15.55:0/4270483066 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9280cc0b0 msgr2=0x7fb92815a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:09.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb927fff640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9280cc0b0 0x7fb92815a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:09.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb927fff640 1 -- 172.21.15.55:0/4270483066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb920009b30 con 0x7fb92815b8c0 2023-07-06T21:42:09.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb92c89f640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9280cc0b0 0x7fb92815a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:09.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb92d0a0640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb92815bc90 0x7fb9280c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:09.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb927fff640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb92815b8c0 0x7fb9280c4060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb91400d800 tx=0x7fb91400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:09.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb9257fa640 1 -- 172.21.15.55:0/4270483066 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9140096c0 con 0x7fb92815b8c0 2023-07-06T21:42:09.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb9257fa640 1 -- 172.21.15.55:0/4270483066 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb914009820 con 0x7fb92815b8c0 2023-07-06T21:42:09.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb92eb03640 1 -- 172.21.15.55:0/4270483066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92815a2d0 con 0x7fb92815b8c0 2023-07-06T21:42:09.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb9257fa640 1 -- 172.21.15.55:0/4270483066 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914009bd0 con 0x7fb92815b8c0 2023-07-06T21:42:09.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb92eb03640 1 -- 172.21.15.55:0/4270483066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92815c890 con 0x7fb92815b8c0 2023-07-06T21:42:09.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.632+0000 7fb92eb03640 1 -- 172.21.15.55:0/4270483066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92815af00 con 0x7fb92815b8c0 2023-07-06T21:42:09.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.636+0000 7fb9257fa640 1 -- 172.21.15.55:0/4270483066 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb914009d30 con 0x7fb92815b8c0 2023-07-06T21:42:09.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.636+0000 7fb9257fa640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb90c066280 0x7fb90c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:09.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.636+0000 7fb9257fa640 1 -- 172.21.15.55:0/4270483066 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb914083ff0 con 0x7fb92815b8c0 2023-07-06T21:42:09.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.636+0000 7fb92c89f640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb90c066280 0x7fb90c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:09.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.636+0000 7fb92c89f640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb90c066280 0x7fb90c068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb91c004660 tx=0x7fb91c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:09.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.640+0000 7fb9257fa640 1 -- 172.21.15.55:0/4270483066 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9140515b0 con 0x7fb92815b8c0 2023-07-06T21:42:09.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:09.796+0000 7fb92eb03640 1 -- 172.21.15.55:0/4270483066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fb928066d60 con 0x7fb92815b8c0 2023-07-06T21:42:10.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.452+0000 7fb9257fa640 1 -- 172.21.15.55:0/4270483066 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7fb914054bd0 con 0x7fb92815b8c0 2023-07-06T21:42:10.467 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-07-06T21:42:10.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.468+0000 7fb92eb03640 1 -- 172.21.15.55:0/4270483066 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb90c066280 msgr2=0x7fb90c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:10.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.468+0000 7fb92eb03640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb90c066280 0x7fb90c068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb91c004660 tx=0x7fb91c008040 comp rx=0 tx=0).stop 2023-07-06T21:42:10.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.468+0000 7fb92eb03640 1 -- 172.21.15.55:0/4270483066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb92815b8c0 msgr2=0x7fb9280c4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:10.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.468+0000 7fb92eb03640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb92815b8c0 0x7fb9280c4060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb91400d800 tx=0x7fb91400dcc0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.468+0000 7fb92eb03640 1 -- 172.21.15.55:0/4270483066 shutdown_connections 2023-07-06T21:42:10.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.468+0000 7fb92eb03640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb90c066280 0x7fb90c068730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.468+0000 7fb92eb03640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb92815bc90 0x7fb9280c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.468+0000 7fb92eb03640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb92815b8c0 0x7fb9280c4060 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.468+0000 7fb92eb03640 1 --2- 172.21.15.55:0/4270483066 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9280cc0b0 0x7fb92815a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.468+0000 7fb92eb03640 1 -- 172.21.15.55:0/4270483066 >> 172.21.15.55:0/4270483066 conn(0x7fb9280ccbe0 msgr2=0x7fb9280cf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:10.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.468+0000 7fb92eb03640 1 -- 172.21.15.55:0/4270483066 shutdown_connections 2023-07-06T21:42:10.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.468+0000 7fb92eb03640 1 -- 172.21.15.55:0/4270483066 wait complete. 2023-07-06T21:42:10.502 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T21:42:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f590626d640 1 Processor -- start 2023-07-06T21:42:10.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f590626d640 1 -- start start 2023-07-06T21:42:10.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f590626d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f59000cd140 0x7f5900163380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:10.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f590626d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5900158c20 con 0x7f59000ca130 2023-07-06T21:42:10.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f590626d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59000c8db0 con 0x7f5900158850 2023-07-06T21:42:10.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f590626d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59000c9090 con 0x7f59000cd140 2023-07-06T21:42:10.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58ff7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f59000ca130 0x7f59000703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38216/0 (socket says 172.21.15.55:38216) 2023-07-06T21:42:10.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58ff7fe640 1 -- 172.21.15.55:0/3238472329 learned_addr learned my addr 172.21.15.55:0/3238472329 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f590480a640 1 --2- 172.21.15.55:0/3238472329 >> v2:172.21.15.138:3300/0 conn(0x7f59000cd140 0x7f5900163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 -- 172.21.15.55:0/3238472329 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121238776 0 0) 0x7f5900158c20 con 0x7f59000ca130 2023-07-06T21:42:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 -- 172.21.15.55:0/3238472329 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58e8003530 con 0x7f59000ca130 2023-07-06T21:42:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 -- 172.21.15.55:0/3238472329 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 790419463 0 0) 0x7f58e8003530 con 0x7f59000ca130 2023-07-06T21:42:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 -- 172.21.15.55:0/3238472329 >> v2:172.21.15.138:3300/0 conn(0x7f59000cd140 msgr2=0x7f5900163380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 --2- 172.21.15.55:0/3238472329 >> v2:172.21.15.138:3300/0 conn(0x7f59000cd140 0x7f5900163380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 -- 172.21.15.55:0/3238472329 >> v1:172.21.15.138:6789/0 conn(0x7f5900158850 legacy=0x7f59000cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 -- 172.21.15.55:0/3238472329 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59000c9370 con 0x7f59000ca130 2023-07-06T21:42:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 -- 172.21.15.55:0/3238472329 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f58f4001680 con 0x7f59000ca130 2023-07-06T21:42:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 -- 172.21.15.55:0/3238472329 >> v1:172.21.15.55:6789/0 conn(0x7f59000ca130 legacy=0x7f59000703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 --2- 172.21.15.55:0/3238472329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58e8003980 0x7f58e8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 --2- 172.21.15.55:0/3238472329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e8004370 0x7f58e8004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:10.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 --2- 172.21.15.55:0/3238472329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58e8005030 0x7f58e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:10.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 -- 172.21.15.55:0/3238472329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59000c9090 con 0x7f58e8004370 2023-07-06T21:42:10.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 -- 172.21.15.55:0/3238472329 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e800bf80 con 0x7f58e8003980 2023-07-06T21:42:10.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58feffd640 1 -- 172.21.15.55:0/3238472329 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e800c140 con 0x7f58e8005030 2023-07-06T21:42:10.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58ff7fe640 1 --2- 172.21.15.55:0/3238472329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e8004370 0x7f58e8004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:10.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58fffff640 1 --2- 172.21.15.55:0/3238472329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58e8003980 0x7f58e8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:10.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f590480a640 1 --2- 172.21.15.55:0/3238472329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58e8005030 0x7f58e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:10.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58ff7fe640 1 -- 172.21.15.55:0/3238472329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58e8005030 msgr2=0x7f58e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:10.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58ff7fe640 1 --2- 172.21.15.55:0/3238472329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f58e8005030 0x7f58e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58ff7fe640 1 -- 172.21.15.55:0/3238472329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58e8003980 msgr2=0x7f58e8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:10.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58ff7fe640 1 --2- 172.21.15.55:0/3238472329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58e8003980 0x7f58e8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f58ff7fe640 1 -- 172.21.15.55:0/3238472329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e8003530 con 0x7f58e8004370 2023-07-06T21:42:10.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.648+0000 7f590480a640 1 -- 172.21.15.55:0/3238472329 reap_dead start 2023-07-06T21:42:10.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.652+0000 7f58ff7fe640 1 --2- 172.21.15.55:0/3238472329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e8004370 0x7f58e8004830 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c190 tx=0x7f58f401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfa41dcba0e9511 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:10.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.652+0000 7f58feffd640 1 -- 172.21.15.55:0/3238472329 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4005ae0 con 0x7f58e8004370 2023-07-06T21:42:10.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.652+0000 7f58feffd640 1 -- 172.21.15.55:0/3238472329 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f4005c60 con 0x7f58e8004370 2023-07-06T21:42:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.652+0000 7f58feffd640 1 -- 172.21.15.55:0/3238472329 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f40a5a00 con 0x7f58e8004370 2023-07-06T21:42:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.652+0000 7f590626d640 1 -- 172.21.15.55:0/3238472329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e8004370 msgr2=0x7f58e8004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.652+0000 7f590626d640 1 --2- 172.21.15.55:0/3238472329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e8004370 0x7f58e8004830 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c190 tx=0x7f58f401cbd0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.652+0000 7f590626d640 1 -- 172.21.15.55:0/3238472329 shutdown_connections 2023-07-06T21:42:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.652+0000 7f590626d640 1 --2- 172.21.15.55:0/3238472329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e8004370 0x7f58e8004830 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.652+0000 7f590626d640 1 -- 172.21.15.55:0/3238472329 >> 172.21.15.55:0/3238472329 conn(0x7f59000cea70 msgr2=0x7f59000ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.652+0000 7f590626d640 1 -- 172.21.15.55:0/3238472329 shutdown_connections 2023-07-06T21:42:10.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.652+0000 7f590626d640 1 -- 172.21.15.55:0/3238472329 wait complete. 2023-07-06T21:42:10.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f590626d640 1 Processor -- start 2023-07-06T21:42:10.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f590626d640 1 -- start start 2023-07-06T21:42:10.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f590626d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58e8004370 0x7f59000c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:10.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f590626d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59001f7a20 0x7f59001f8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:10.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f590626d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59000c7730 0x7f59000c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:10.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f590626d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5900159160 con 0x7f59001f7a20 2023-07-06T21:42:10.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f590626d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59000c6c70 con 0x7f58e8004370 2023-07-06T21:42:10.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f590626d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59000c80e0 con 0x7f59000c7730 2023-07-06T21:42:10.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f58ff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59001f7a20 0x7f59001f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:10.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f58ff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59001f7a20 0x7f59001f8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45838/0 (socket says 172.21.15.55:45838) 2023-07-06T21:42:10.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f58ff7fe640 1 -- 172.21.15.55:0/3928630675 learned_addr learned my addr 172.21.15.55:0/3928630675 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:10.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f58fffff640 1 --2- 172.21.15.55:0/3928630675 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58e8004370 0x7f59000c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:10.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f590480a640 1 --2- 172.21.15.55:0/3928630675 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59000c7730 0x7f59000c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:10.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f58ff7fe640 1 -- 172.21.15.55:0/3928630675 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59000c7730 msgr2=0x7f59000c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:10.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f58ff7fe640 1 --2- 172.21.15.55:0/3928630675 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59000c7730 0x7f59000c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f58ff7fe640 1 -- 172.21.15.55:0/3928630675 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58e8004370 msgr2=0x7f59000c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:10.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f58ff7fe640 1 --2- 172.21.15.55:0/3928630675 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58e8004370 0x7f59000c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f58ff7fe640 1 -- 172.21.15.55:0/3928630675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59000c59a0 con 0x7f59001f7a20 2023-07-06T21:42:10.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f58ff7fe640 1 --2- 172.21.15.55:0/3928630675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59001f7a20 0x7f59001f8340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c190 tx=0x7f58e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:10.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f58fcff9640 1 -- 172.21.15.55:0/3928630675 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f40b4070 con 0x7f59001f7a20 2023-07-06T21:42:10.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f58fcff9640 1 -- 172.21.15.55:0/3928630675 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f40a57c0 con 0x7f59001f7a20 2023-07-06T21:42:10.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f58fcff9640 1 -- 172.21.15.55:0/3928630675 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f40a5b70 con 0x7f59001f7a20 2023-07-06T21:42:10.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f590626d640 1 -- 172.21.15.55:0/3928630675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59000c5bd0 con 0x7f59001f7a20 2023-07-06T21:42:10.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.656+0000 7f590626d640 1 -- 172.21.15.55:0/3928630675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59000c6190 con 0x7f59001f7a20 2023-07-06T21:42:10.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.660+0000 7f590626d640 1 -- 172.21.15.55:0/3928630675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5900066d60 con 0x7f59001f7a20 2023-07-06T21:42:10.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.660+0000 7f58fcff9640 1 -- 172.21.15.55:0/3928630675 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f58f40a5cd0 con 0x7f59001f7a20 2023-07-06T21:42:10.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.660+0000 7f58fcff9640 1 --2- 172.21.15.55:0/3928630675 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f58ec066280 0x7f58ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:10.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.660+0000 7f58fcff9640 1 -- 172.21.15.55:0/3928630675 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f58f411d6b0 con 0x7f59001f7a20 2023-07-06T21:42:10.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.660+0000 7f58fffff640 1 --2- 172.21.15.55:0/3928630675 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f58ec066280 0x7f58ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:10.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.660+0000 7f58fffff640 1 --2- 172.21.15.55:0/3928630675 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f58ec066280 0x7f58ec068730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58f00014e0 tx=0x7f58f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:10.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.664+0000 7f58fcff9640 1 -- 172.21.15.55:0/3928630675 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58f40eaba0 con 0x7f59001f7a20 2023-07-06T21:42:10.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.852+0000 7f590626d640 1 -- 172.21.15.55:0/3928630675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f590006cd30 con 0x7f59001f7a20 2023-07-06T21:42:10.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.860+0000 7f58fcff9640 1 -- 172.21.15.55:0/3928630675 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f58f411be60 con 0x7f59001f7a20 2023-07-06T21:42:10.866 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 3 and data pool 4 2023-07-06T21:42:10.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.864+0000 7f590626d640 1 -- 172.21.15.55:0/3928630675 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f58ec066280 msgr2=0x7f58ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:10.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.864+0000 7f590626d640 1 --2- 172.21.15.55:0/3928630675 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f58ec066280 0x7f58ec068730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58f00014e0 tx=0x7f58f0009040 comp rx=0 tx=0).stop 2023-07-06T21:42:10.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.864+0000 7f590626d640 1 -- 172.21.15.55:0/3928630675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59001f7a20 msgr2=0x7f59001f8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:10.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.864+0000 7f590626d640 1 --2- 172.21.15.55:0/3928630675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59001f7a20 0x7f59001f8340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c190 tx=0x7f58e8005800 comp rx=0 tx=0).stop 2023-07-06T21:42:10.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.864+0000 7f590626d640 1 -- 172.21.15.55:0/3928630675 shutdown_connections 2023-07-06T21:42:10.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.864+0000 7f590626d640 1 --2- 172.21.15.55:0/3928630675 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f58ec066280 0x7f58ec068730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.864+0000 7f590626d640 1 --2- 172.21.15.55:0/3928630675 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59000c7730 0x7f59000c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.864+0000 7f590626d640 1 --2- 172.21.15.55:0/3928630675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59001f7a20 0x7f59001f8340 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c190 tx=0x7f58e8005800 comp rx=0 tx=0).stop 2023-07-06T21:42:10.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.864+0000 7f590626d640 1 --2- 172.21.15.55:0/3928630675 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58e8004370 0x7f59000c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:10.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.864+0000 7f590626d640 1 -- 172.21.15.55:0/3928630675 >> 172.21.15.55:0/3928630675 conn(0x7f59000cea70 msgr2=0x7f59000cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:10.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.872+0000 7f590626d640 1 -- 172.21.15.55:0/3928630675 shutdown_connections 2023-07-06T21:42:10.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:10.880+0000 7f590626d640 1 -- 172.21.15.55:0/3928630675 wait complete. 2023-07-06T21:42:10.914 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-07-06T21:42:10.914 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-07-06T21:42:11.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.056+0000 7f066a12c640 1 Processor -- start 2023-07-06T21:42:11.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.056+0000 7f066a12c640 1 -- start start 2023-07-06T21:42:11.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f066a12c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f06640b3c90 0x7f06640ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:11.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f066a12c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06640b18a0 0x7f06640b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:11.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f066a12c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06640d1d30 0x7f066415f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:11.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f066a12c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06640cd0a0 con 0x7f06640b18a0 2023-07-06T21:42:11.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f066a12c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06640ccd50 con 0x7f06640b3c90 2023-07-06T21:42:11.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f066a12c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0664069ea0 con 0x7f06640d1d30 2023-07-06T21:42:11.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f0662ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06640b18a0 0x7f06640b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:11.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f0662ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06640b18a0 0x7f06640b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45848/0 (socket says 172.21.15.55:45848) 2023-07-06T21:42:11.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f0662ffd640 1 -- 172.21.15.55:0/2288871258 learned_addr learned my addr 172.21.15.55:0/2288871258 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:11.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f0663fff640 1 --2- 172.21.15.55:0/2288871258 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06640d1d30 0x7f066415f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:11.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f06637fe640 1 --2- 172.21.15.55:0/2288871258 >> v2:172.21.15.138:3300/0 conn(0x7f06640b3c90 0x7f06640ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:11.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f0662ffd640 1 -- 172.21.15.55:0/2288871258 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06640d1d30 msgr2=0x7f066415f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:11.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f0662ffd640 1 --2- 172.21.15.55:0/2288871258 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06640d1d30 0x7f066415f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:11.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f0662ffd640 1 -- 172.21.15.55:0/2288871258 >> v2:172.21.15.138:3300/0 conn(0x7f06640b3c90 msgr2=0x7f06640ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:11.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f0662ffd640 1 --2- 172.21.15.55:0/2288871258 >> v2:172.21.15.138:3300/0 conn(0x7f06640b3c90 0x7f06640ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:11.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f0662ffd640 1 -- 172.21.15.55:0/2288871258 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06640b45a0 con 0x7f06640b18a0 2023-07-06T21:42:11.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f06637fe640 1 --2- 172.21.15.55:0/2288871258 >> v2:172.21.15.138:3300/0 conn(0x7f06640b3c90 0x7f06640ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:11.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.060+0000 7f0662ffd640 1 --2- 172.21.15.55:0/2288871258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06640b18a0 0x7f06640b4060 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f066408b300 tx=0x7f065801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f98700a0367dfba server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:11.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f06627fc640 1 -- 172.21.15.55:0/2288871258 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06580ab600 con 0x7f06640b18a0 2023-07-06T21:42:11.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f06627fc640 1 -- 172.21.15.55:0/2288871258 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06580a7050 con 0x7f06640b18a0 2023-07-06T21:42:11.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f06627fc640 1 -- 172.21.15.55:0/2288871258 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06580ab980 con 0x7f06640b18a0 2023-07-06T21:42:11.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 -- 172.21.15.55:0/2288871258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06640b18a0 msgr2=0x7f06640b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:11.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 --2- 172.21.15.55:0/2288871258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06640b18a0 0x7f06640b4060 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f066408b300 tx=0x7f065801c210 comp rx=0 tx=0).stop 2023-07-06T21:42:11.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 -- 172.21.15.55:0/2288871258 shutdown_connections 2023-07-06T21:42:11.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 --2- 172.21.15.55:0/2288871258 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06640d1d30 0x7f066415f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:11.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 --2- 172.21.15.55:0/2288871258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06640b18a0 0x7f06640b4060 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:11.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 --2- 172.21.15.55:0/2288871258 >> v2:172.21.15.138:3300/0 conn(0x7f06640b3c90 0x7f06640ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:11.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 -- 172.21.15.55:0/2288871258 >> 172.21.15.55:0/2288871258 conn(0x7f066406bf40 msgr2=0x7f06640cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:11.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 -- 172.21.15.55:0/2288871258 shutdown_connections 2023-07-06T21:42:11.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 -- 172.21.15.55:0/2288871258 wait complete. 2023-07-06T21:42:11.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 Processor -- start 2023-07-06T21:42:11.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 -- start start 2023-07-06T21:42:11.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06640b18a0 0x7f06641f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:11.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06640b3c90 0x7f06640b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:11.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06640d1d30 0x7f06640b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:11.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06640701c0 con 0x7f06640b3c90 2023-07-06T21:42:11.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066406f5b0 con 0x7f06640b18a0 2023-07-06T21:42:11.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f066a12c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066406f890 con 0x7f06640d1d30 2023-07-06T21:42:11.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f0662ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06640b3c90 0x7f06640b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:11.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f0662ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06640b3c90 0x7f06640b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45852/0 (socket says 172.21.15.55:45852) 2023-07-06T21:42:11.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.064+0000 7f0662ffd640 1 -- 172.21.15.55:0/3694043411 learned_addr learned my addr 172.21.15.55:0/3694043411 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:11.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f06637fe640 1 --2- 172.21.15.55:0/3694043411 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06640b18a0 0x7f06641f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:11.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f0663fff640 1 --2- 172.21.15.55:0/3694043411 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06640d1d30 0x7f06640b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:11.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f0662ffd640 1 -- 172.21.15.55:0/3694043411 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06640d1d30 msgr2=0x7f06640b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:11.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f0662ffd640 1 --2- 172.21.15.55:0/3694043411 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06640d1d30 0x7f06640b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:11.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f0662ffd640 1 -- 172.21.15.55:0/3694043411 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06640b18a0 msgr2=0x7f06641f7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:11.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f0662ffd640 1 --2- 172.21.15.55:0/3694043411 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06640b18a0 0x7f06641f7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:11.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f0662ffd640 1 -- 172.21.15.55:0/3694043411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06580094d0 con 0x7f06640b3c90 2023-07-06T21:42:11.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f0662ffd640 1 --2- 172.21.15.55:0/3694043411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06640b3c90 0x7f06640b5970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f065801a8c0 tx=0x7f0658018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:11.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f064bfff640 1 -- 172.21.15.55:0/3694043411 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06580b37d0 con 0x7f06640b3c90 2023-07-06T21:42:11.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f064bfff640 1 -- 172.21.15.55:0/3694043411 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06580b3930 con 0x7f06640b3c90 2023-07-06T21:42:11.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f064bfff640 1 -- 172.21.15.55:0/3694043411 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06580b3ca0 con 0x7f06640b3c90 2023-07-06T21:42:11.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f066a12c640 1 -- 172.21.15.55:0/3694043411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066406fb70 con 0x7f06640b3c90 2023-07-06T21:42:11.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f066a12c640 1 -- 172.21.15.55:0/3694043411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06641f8090 con 0x7f06640b3c90 2023-07-06T21:42:11.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f066a12c640 1 -- 172.21.15.55:0/3694043411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0664066d60 con 0x7f06640b3c90 2023-07-06T21:42:11.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.068+0000 7f064bfff640 1 -- 172.21.15.55:0/3694043411 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06580b2070 con 0x7f06640b3c90 2023-07-06T21:42:11.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.072+0000 7f064bfff640 1 --2- 172.21.15.55:0/3694043411 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0650066280 0x7f0650068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:11.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.072+0000 7f064bfff640 1 -- 172.21.15.55:0/3694043411 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f065811deb0 con 0x7f06640b3c90 2023-07-06T21:42:11.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.072+0000 7f06637fe640 1 --2- 172.21.15.55:0/3694043411 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0650066280 0x7f0650068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:11.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.072+0000 7f06637fe640 1 --2- 172.21.15.55:0/3694043411 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0650066280 0x7f0650068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f06640c54f0 tx=0x7f0654008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:11.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.076+0000 7f064bfff640 1 -- 172.21.15.55:0/3694043411 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06580eb340 con 0x7f06640b3c90 2023-07-06T21:42:11.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.244+0000 7f066a12c640 1 -- 172.21.15.55:0/3694043411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f06640c5920 con 0x7f06640b3c90 2023-07-06T21:42:11.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.864+0000 7f064bfff640 1 -- 172.21.15.55:0/3694043411 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7f06580b0020 con 0x7f06640b3c90 2023-07-06T21:42:11.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.868+0000 7f066a12c640 1 -- 172.21.15.55:0/3694043411 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0650066280 msgr2=0x7f0650068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:11.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.868+0000 7f066a12c640 1 --2- 172.21.15.55:0/3694043411 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0650066280 0x7f0650068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f06640c54f0 tx=0x7f0654008040 comp rx=0 tx=0).stop 2023-07-06T21:42:11.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.868+0000 7f066a12c640 1 -- 172.21.15.55:0/3694043411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06640b3c90 msgr2=0x7f06640b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:11.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.868+0000 7f066a12c640 1 --2- 172.21.15.55:0/3694043411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06640b3c90 0x7f06640b5970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f065801a8c0 tx=0x7f0658018fb0 comp rx=0 tx=0).stop 2023-07-06T21:42:11.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.868+0000 7f066a12c640 1 -- 172.21.15.55:0/3694043411 shutdown_connections 2023-07-06T21:42:11.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.868+0000 7f066a12c640 1 --2- 172.21.15.55:0/3694043411 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0650066280 0x7f0650068730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:11.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.868+0000 7f066a12c640 1 --2- 172.21.15.55:0/3694043411 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06640d1d30 0x7f06640b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:11.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.868+0000 7f066a12c640 1 --2- 172.21.15.55:0/3694043411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06640b3c90 0x7f06640b5970 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:11.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.868+0000 7f066a12c640 1 --2- 172.21.15.55:0/3694043411 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06640b18a0 0x7f06641f7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:11.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.868+0000 7f066a12c640 1 -- 172.21.15.55:0/3694043411 >> 172.21.15.55:0/3694043411 conn(0x7f066406bf40 msgr2=0x7f06641582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:11.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.868+0000 7f066a12c640 1 -- 172.21.15.55:0/3694043411 shutdown_connections 2023-07-06T21:42:11.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:11.868+0000 7f066a12c640 1 -- 172.21.15.55:0/3694043411 wait complete. 2023-07-06T21:42:11.896 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T21:42:12.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f383aa93640 1 Processor -- start 2023-07-06T21:42:12.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f383aa93640 1 -- start start 2023-07-06T21:42:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f383aa93640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f38340c8ee0 0x7f38340c9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f383aa93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38340ccc70 0x7f38340cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f383aa93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38340c9870 con 0x7f38341586d0 2023-07-06T21:42:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f383aa93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383406cd50 con 0x7f38340ccc70 2023-07-06T21:42:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f383aa93640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38340cd630 con 0x7f38340c8ee0 2023-07-06T21:42:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f3839030640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38340ccc70 0x7f38340cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f383882f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f38341586d0 0x7f383406c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38226/0 (socket says 172.21.15.55:38226) 2023-07-06T21:42:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f383882f640 1 -- 172.21.15.55:0/3876481290 learned_addr learned my addr 172.21.15.55:0/3876481290 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f3833fff640 1 --2- 172.21.15.55:0/3876481290 >> v2:172.21.15.138:3300/0 conn(0x7f38340c8ee0 0x7f38340c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f3839030640 1 -- 172.21.15.55:0/3876481290 >> v2:172.21.15.138:3300/0 conn(0x7f38340c8ee0 msgr2=0x7f38340c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f3839030640 1 --2- 172.21.15.55:0/3876481290 >> v2:172.21.15.138:3300/0 conn(0x7f38340c8ee0 0x7f38340c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f3839030640 1 -- 172.21.15.55:0/3876481290 >> v1:172.21.15.55:6789/0 conn(0x7f38341586d0 legacy=0x7f383406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f3839030640 1 -- 172.21.15.55:0/3876481290 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3834158aa0 con 0x7f38340ccc70 2023-07-06T21:42:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f38337fe640 1 -- 172.21.15.55:0/3876481290 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172645000 0 0) 0x7f3828001120 con 0x7f38341586d0 2023-07-06T21:42:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.048+0000 7f3833fff640 1 --2- 172.21.15.55:0/3876481290 >> v2:172.21.15.138:3300/0 conn(0x7f38340c8ee0 0x7f38340c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:12.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.052+0000 7f3839030640 1 --2- 172.21.15.55:0/3876481290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38340ccc70 0x7f38340cd0f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3834069c50 tx=0x7f382c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fece1d51a0994735 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.052+0000 7f38337fe640 1 -- 172.21.15.55:0/3876481290 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c0a5910 con 0x7f38340ccc70 2023-07-06T21:42:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.052+0000 7f38337fe640 1 -- 172.21.15.55:0/3876481290 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c0a5a70 con 0x7f38340ccc70 2023-07-06T21:42:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.052+0000 7f38337fe640 1 -- 172.21.15.55:0/3876481290 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c0a5e00 con 0x7f38340ccc70 2023-07-06T21:42:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.052+0000 7f383aa93640 1 -- 172.21.15.55:0/3876481290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38340ccc70 msgr2=0x7f38340cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.052+0000 7f383aa93640 1 --2- 172.21.15.55:0/3876481290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38340ccc70 0x7f38340cd0f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3834069c50 tx=0x7f382c01c850 comp rx=0 tx=0).stop 2023-07-06T21:42:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.052+0000 7f383aa93640 1 -- 172.21.15.55:0/3876481290 shutdown_connections 2023-07-06T21:42:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.052+0000 7f383aa93640 1 --2- 172.21.15.55:0/3876481290 >> v2:172.21.15.138:3300/0 conn(0x7f38340c8ee0 0x7f38340c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.052+0000 7f383aa93640 1 --2- 172.21.15.55:0/3876481290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38340ccc70 0x7f38340cd0f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.052+0000 7f383aa93640 1 -- 172.21.15.55:0/3876481290 >> 172.21.15.55:0/3876481290 conn(0x7f38340cdea0 msgr2=0x7f38340ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.052+0000 7f383aa93640 1 -- 172.21.15.55:0/3876481290 shutdown_connections 2023-07-06T21:42:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.052+0000 7f383aa93640 1 -- 172.21.15.55:0/3876481290 wait complete. 2023-07-06T21:42:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.052+0000 7f383aa93640 1 Processor -- start 2023-07-06T21:42:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383aa93640 1 -- start start 2023-07-06T21:42:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383aa93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38340c8ee0 0x7f38340be2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383aa93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38340ccc70 0x7f38340c10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383aa93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38341586d0 0x7f38341ef450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:12.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383aa93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38341477d0 con 0x7f38340c8ee0 2023-07-06T21:42:12.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383aa93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38340c17b0 con 0x7f38341586d0 2023-07-06T21:42:12.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383aa93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38341ef990 con 0x7f38340ccc70 2023-07-06T21:42:12.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383882f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38340c8ee0 0x7f38340be2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:12.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383882f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38340c8ee0 0x7f38340be2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45868/0 (socket says 172.21.15.55:45868) 2023-07-06T21:42:12.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383882f640 1 -- 172.21.15.55:0/2198557006 learned_addr learned my addr 172.21.15.55:0/2198557006 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:12.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f3839030640 1 --2- 172.21.15.55:0/2198557006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38341586d0 0x7f38341ef450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f3833fff640 1 --2- 172.21.15.55:0/2198557006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38340ccc70 0x7f38340c10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383882f640 1 -- 172.21.15.55:0/2198557006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38340ccc70 msgr2=0x7f38340c10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383882f640 1 --2- 172.21.15.55:0/2198557006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38340ccc70 0x7f38340c10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383882f640 1 -- 172.21.15.55:0/2198557006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38341586d0 msgr2=0x7f38341ef450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383882f640 1 --2- 172.21.15.55:0/2198557006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38341586d0 0x7f38341ef450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383882f640 1 -- 172.21.15.55:0/2198557006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c009a70 con 0x7f38340c8ee0 2023-07-06T21:42:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383882f640 1 --2- 172.21.15.55:0/2198557006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38340c8ee0 0x7f38340be2d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f382800c780 tx=0x7f382800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f38317fa640 1 -- 172.21.15.55:0/2198557006 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38280072d0 con 0x7f38340c8ee0 2023-07-06T21:42:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f38317fa640 1 -- 172.21.15.55:0/2198557006 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3828007450 con 0x7f38340c8ee0 2023-07-06T21:42:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f38317fa640 1 -- 172.21.15.55:0/2198557006 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38280047f0 con 0x7f38340c8ee0 2023-07-06T21:42:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383aa93640 1 -- 172.21.15.55:0/2198557006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3834146e30 con 0x7f38340c8ee0 2023-07-06T21:42:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383aa93640 1 -- 172.21.15.55:0/2198557006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38341473f0 con 0x7f38340c8ee0 2023-07-06T21:42:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.056+0000 7f383aa93640 1 -- 172.21.15.55:0/2198557006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3834066d60 con 0x7f38340c8ee0 2023-07-06T21:42:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.060+0000 7f38317fa640 1 -- 172.21.15.55:0/2198557006 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3828004950 con 0x7f38340c8ee0 2023-07-06T21:42:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.060+0000 7f38317fa640 1 --2- 172.21.15.55:0/2198557006 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3818066280 0x7f3818068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.060+0000 7f38317fa640 1 -- 172.21.15.55:0/2198557006 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f3828082f10 con 0x7f38340c8ee0 2023-07-06T21:42:12.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.060+0000 7f3833fff640 1 --2- 172.21.15.55:0/2198557006 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3818066280 0x7f3818068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:12.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.060+0000 7f3833fff640 1 --2- 172.21.15.55:0/2198557006 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3818066280 0x7f3818068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3820006fd0 tx=0x7f3820008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:12.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.064+0000 7f38317fa640 1 -- 172.21.15.55:0/2198557006 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38280502c0 con 0x7f38340c8ee0 2023-07-06T21:42:12.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:12.220+0000 7f383aa93640 1 -- 172.21.15.55:0/2198557006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f38340c9870 con 0x7f38340c8ee0 2023-07-06T21:42:13.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:13.880+0000 7f38317fa640 1 -- 172.21.15.55:0/2198557006 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f38340c9870 con 0x7f38340c8ee0 2023-07-06T21:42:13.888 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data_ec' created 2023-07-06T21:42:13.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:13.892+0000 7f383aa93640 1 -- 172.21.15.55:0/2198557006 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3818066280 msgr2=0x7f3818068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:13.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:13.892+0000 7f383aa93640 1 --2- 172.21.15.55:0/2198557006 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3818066280 0x7f3818068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3820006fd0 tx=0x7f3820008040 comp rx=0 tx=0).stop 2023-07-06T21:42:13.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:13.892+0000 7f383aa93640 1 -- 172.21.15.55:0/2198557006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38340c8ee0 msgr2=0x7f38340be2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:13.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:13.892+0000 7f383aa93640 1 --2- 172.21.15.55:0/2198557006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38340c8ee0 0x7f38340be2d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f382800c780 tx=0x7f382800cc40 comp rx=0 tx=0).stop 2023-07-06T21:42:13.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:13.892+0000 7f383aa93640 1 -- 172.21.15.55:0/2198557006 shutdown_connections 2023-07-06T21:42:13.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:13.892+0000 7f383aa93640 1 --2- 172.21.15.55:0/2198557006 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3818066280 0x7f3818068730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:13.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:13.892+0000 7f383aa93640 1 --2- 172.21.15.55:0/2198557006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38341586d0 0x7f38341ef450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:13.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:13.892+0000 7f383aa93640 1 --2- 172.21.15.55:0/2198557006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38340ccc70 0x7f38340c10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:13.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:13.892+0000 7f383aa93640 1 --2- 172.21.15.55:0/2198557006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38340c8ee0 0x7f38340be2d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:13.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:13.892+0000 7f383aa93640 1 -- 172.21.15.55:0/2198557006 >> 172.21.15.55:0/2198557006 conn(0x7f38340cdea0 msgr2=0x7f3834070640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:13.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:13.892+0000 7f383aa93640 1 -- 172.21.15.55:0/2198557006 shutdown_connections 2023-07-06T21:42:13.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:13.892+0000 7f383aa93640 1 -- 172.21.15.55:0/2198557006 wait complete. 2023-07-06T21:42:13.918 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-07-06T21:42:14.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.064+0000 7f6a70dfa640 1 Processor -- start 2023-07-06T21:42:14.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.064+0000 7f6a70dfa640 1 -- start start 2023-07-06T21:42:14.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.064+0000 7f6a70dfa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a6c0c89b0 0x7f6a6c0c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:14.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.064+0000 7f6a70dfa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6c158b50 con 0x7f6a6c0cbfa0 2023-07-06T21:42:14.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.064+0000 7f6a70dfa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6c0c9350 con 0x7f6a6c158780 2023-07-06T21:42:14.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.064+0000 7f6a70dfa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6c06fb00 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.064+0000 7f6a6ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a6c0c89b0 0x7f6a6c0c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:14.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.064+0000 7f6a6ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a6c0c89b0 0x7f6a6c0c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43612/0 (socket says 172.21.15.55:43612) 2023-07-06T21:42:14.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.064+0000 7f6a6ad9d640 1 -- 172.21.15.55:0/620690788 learned_addr learned my addr 172.21.15.55:0/620690788 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:14.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.068+0000 7f6a6ad9d640 1 -- 172.21.15.55:0/620690788 >> v1:172.21.15.138:6789/0 conn(0x7f6a6c158780 legacy=0x7f6a6c0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:14.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.068+0000 7f6a6ad9d640 1 -- 172.21.15.55:0/620690788 >> v1:172.21.15.55:6789/0 conn(0x7f6a6c0cbfa0 legacy=0x7f6a6c06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:14.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.068+0000 7f6a6ad9d640 1 -- 172.21.15.55:0/620690788 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c06b390 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.068+0000 7f6a69d9b640 1 -- 172.21.15.55:0/620690788 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103214926 0 0) 0x7f6a6c158b50 con 0x7f6a6c0cbfa0 2023-07-06T21:42:14.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.068+0000 7f6a6ad9d640 1 --2- 172.21.15.55:0/620690788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a6c0c89b0 0x7f6a6c0c8e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400d150 tx=0x7f6a6401eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf45b3ef753c631e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:14.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.068+0000 7f6a69d9b640 1 -- 172.21.15.55:0/620690788 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400b2d0 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.068+0000 7f6a69d9b640 1 -- 172.21.15.55:0/620690788 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6400b430 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.068+0000 7f6a69d9b640 1 -- 172.21.15.55:0/620690788 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a640a7b60 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.068+0000 7f6a70dfa640 1 -- 172.21.15.55:0/620690788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a6c0c89b0 msgr2=0x7f6a6c0c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:14.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.068+0000 7f6a70dfa640 1 --2- 172.21.15.55:0/620690788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a6c0c89b0 0x7f6a6c0c8e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400d150 tx=0x7f6a6401eb80 comp rx=0 tx=0).stop 2023-07-06T21:42:14.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a70dfa640 1 -- 172.21.15.55:0/620690788 shutdown_connections 2023-07-06T21:42:14.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a70dfa640 1 --2- 172.21.15.55:0/620690788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a6c0c89b0 0x7f6a6c0c8e10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:14.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a70dfa640 1 -- 172.21.15.55:0/620690788 >> 172.21.15.55:0/620690788 conn(0x7f6a6c0cde30 msgr2=0x7f6a6c0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:14.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a70dfa640 1 -- 172.21.15.55:0/620690788 shutdown_connections 2023-07-06T21:42:14.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a70dfa640 1 -- 172.21.15.55:0/620690788 wait complete. 2023-07-06T21:42:14.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a70dfa640 1 Processor -- start 2023-07-06T21:42:14.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a70dfa640 1 -- start start 2023-07-06T21:42:14.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a70dfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a6c0c89b0 0x7f6a6c152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:14.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a70dfa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a6c0cbfa0 0x7f6a6c14c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:14.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a70dfa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a6c158780 0x7f6a6c153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:14.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a70dfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c1517b0 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a70dfa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c151a90 con 0x7f6a6c158780 2023-07-06T21:42:14.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a70dfa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c151d70 con 0x7f6a6c0cbfa0 2023-07-06T21:42:14.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a6a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a6c0c89b0 0x7f6a6c152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:14.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a6a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a6c0c89b0 0x7f6a6c152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43618/0 (socket says 172.21.15.55:43618) 2023-07-06T21:42:14.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a6a59c640 1 -- 172.21.15.55:0/583588471 learned_addr learned my addr 172.21.15.55:0/583588471 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:14.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a6ad9d640 1 --2- 172.21.15.55:0/583588471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a6c158780 0x7f6a6c153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:14.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a63fff640 1 --2- 172.21.15.55:0/583588471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a6c0cbfa0 0x7f6a6c14c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:14.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a6a59c640 1 -- 172.21.15.55:0/583588471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a6c0cbfa0 msgr2=0x7f6a6c14c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:14.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a6a59c640 1 --2- 172.21.15.55:0/583588471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a6c0cbfa0 0x7f6a6c14c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:14.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a6a59c640 1 -- 172.21.15.55:0/583588471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a6c158780 msgr2=0x7f6a6c153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:14.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.072+0000 7f6a6a59c640 1 --2- 172.21.15.55:0/583588471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a6c158780 0x7f6a6c153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:14.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.076+0000 7f6a6a59c640 1 -- 172.21.15.55:0/583588471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6400bd40 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.076+0000 7f6a6a59c640 1 --2- 172.21.15.55:0/583588471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a6c0c89b0 0x7f6a6c152850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00c3c0 tx=0x7f6a5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:14.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.076+0000 7f6a62ffd640 1 -- 172.21.15.55:0/583588471 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0052d0 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.076+0000 7f6a62ffd640 1 -- 172.21.15.55:0/583588471 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c005430 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.076+0000 7f6a62ffd640 1 -- 172.21.15.55:0/583588471 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c003840 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.076+0000 7f6a70dfa640 1 -- 172.21.15.55:0/583588471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6c152050 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.076+0000 7f6a70dfa640 1 -- 172.21.15.55:0/583588471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6c14cb00 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.076+0000 7f6a70dfa640 1 -- 172.21.15.55:0/583588471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6c152570 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.076+0000 7f6a62ffd640 1 -- 172.21.15.55:0/583588471 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a5c0039a0 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.076+0000 7f6a62ffd640 1 --2- 172.21.15.55:0/583588471 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6a4c0662b0 0x7f6a4c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:14.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.076+0000 7f6a62ffd640 1 -- 172.21.15.55:0/583588471 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f6a5c0834e0 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.076+0000 7f6a63fff640 1 --2- 172.21.15.55:0/583588471 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6a4c0662b0 0x7f6a4c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:14.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.080+0000 7f6a63fff640 1 --2- 172.21.15.55:0/583588471 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6a4c0662b0 0x7f6a4c068760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c1f7af0 tx=0x7f6a54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:14.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.080+0000 7f6a62ffd640 1 -- 172.21.15.55:0/583588471 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6a6c152570 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.236+0000 7f6a70dfa640 1 -- 172.21.15.55:0/583588471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f6a6c152570 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.880+0000 7f6a62ffd640 1 -- 172.21.15.55:0/583588471 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6a6c152570 con 0x7f6a6c0c89b0 2023-07-06T21:42:14.886 INFO:teuthology.orchestra.run.smithi055.stderr:set pool 5 allow_ec_overwrites to true 2023-07-06T21:42:14.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.896+0000 7f6a70dfa640 1 -- 172.21.15.55:0/583588471 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6a4c0662b0 msgr2=0x7f6a4c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:14.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.900+0000 7f6a70dfa640 1 --2- 172.21.15.55:0/583588471 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6a4c0662b0 0x7f6a4c068760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c1f7af0 tx=0x7f6a54009040 comp rx=0 tx=0).stop 2023-07-06T21:42:14.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.900+0000 7f6a70dfa640 1 -- 172.21.15.55:0/583588471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a6c0c89b0 msgr2=0x7f6a6c152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:14.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.900+0000 7f6a70dfa640 1 --2- 172.21.15.55:0/583588471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a6c0c89b0 0x7f6a6c152850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00c3c0 tx=0x7f6a5c00c880 comp rx=0 tx=0).stop 2023-07-06T21:42:14.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.900+0000 7f6a70dfa640 1 -- 172.21.15.55:0/583588471 shutdown_connections 2023-07-06T21:42:14.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.900+0000 7f6a70dfa640 1 --2- 172.21.15.55:0/583588471 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6a4c0662b0 0x7f6a4c068760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:14.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.900+0000 7f6a70dfa640 1 --2- 172.21.15.55:0/583588471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a6c158780 0x7f6a6c153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:14.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.900+0000 7f6a70dfa640 1 --2- 172.21.15.55:0/583588471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a6c0cbfa0 0x7f6a6c14c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:14.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.900+0000 7f6a70dfa640 1 --2- 172.21.15.55:0/583588471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a6c0c89b0 0x7f6a6c152850 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:14.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.900+0000 7f6a70dfa640 1 -- 172.21.15.55:0/583588471 >> 172.21.15.55:0/583588471 conn(0x7f6a6c0cde30 msgr2=0x7f6a6c070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:14.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.904+0000 7f6a70dfa640 1 -- 172.21.15.55:0/583588471 shutdown_connections 2023-07-06T21:42:14.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:14.904+0000 7f6a70dfa640 1 -- 172.21.15.55:0/583588471 wait complete. 2023-07-06T21:42:14.942 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-07-06T21:42:15.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.084+0000 7f0a7187b640 1 Processor -- start 2023-07-06T21:42:15.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.084+0000 7f0a7187b640 1 -- start start 2023-07-06T21:42:15.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.084+0000 7f0a7187b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a6c06fff0 0x7f0a6c070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.084+0000 7f0a7187b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6c0cd490 con 0x7f0a6c0b2ca0 2023-07-06T21:42:15.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.084+0000 7f0a7187b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6c070960 con 0x7f0a6c1597d0 2023-07-06T21:42:15.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.084+0000 7f0a7187b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c15cf60 con 0x7f0a6c06fff0 2023-07-06T21:42:15.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.084+0000 7f0a6b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0a6c0b2ca0 0x7f0a6c0b3120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59252/0 (socket says 172.21.15.55:59252) 2023-07-06T21:42:15.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.084+0000 7f0a6b7fe640 1 -- 172.21.15.55:0/65614528 learned_addr learned my addr 172.21.15.55:0/65614528 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:15.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.084+0000 7f0a63fff640 1 --2- 172.21.15.55:0/65614528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a6c06fff0 0x7f0a6c070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.088+0000 7f0a6a7fc640 1 -- 172.21.15.55:0/65614528 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009015859 0 0) 0x7f0a6c0cd490 con 0x7f0a6c0b2ca0 2023-07-06T21:42:15.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.088+0000 7f0a6a7fc640 1 -- 172.21.15.55:0/65614528 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a58003530 con 0x7f0a6c0b2ca0 2023-07-06T21:42:15.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.088+0000 7f0a6a7fc640 1 -- 172.21.15.55:0/65614528 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771582001 0 0) 0x7f0a6c070960 con 0x7f0a6c1597d0 2023-07-06T21:42:15.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.088+0000 7f0a6a7fc640 1 -- 172.21.15.55:0/65614528 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a6c0cd490 con 0x7f0a6c1597d0 2023-07-06T21:42:15.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.088+0000 7f0a63fff640 1 -- 172.21.15.55:0/65614528 >> v1:172.21.15.138:6789/0 conn(0x7f0a6c1597d0 legacy=0x7f0a6c0ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.088+0000 7f0a63fff640 1 -- 172.21.15.55:0/65614528 >> v1:172.21.15.55:6789/0 conn(0x7f0a6c0b2ca0 legacy=0x7f0a6c0b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.088+0000 7f0a63fff640 1 -- 172.21.15.55:0/65614528 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c0ccb60 con 0x7f0a6c06fff0 2023-07-06T21:42:15.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.088+0000 7f0a63fff640 1 --2- 172.21.15.55:0/65614528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a6c06fff0 0x7f0a6c070420 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0a540097f0 tx=0x7f0a5401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e285c595eeeec25 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:15.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.088+0000 7f0a6a7fc640 1 -- 172.21.15.55:0/65614528 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a540ab600 con 0x7f0a6c06fff0 2023-07-06T21:42:15.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.088+0000 7f0a6a7fc640 1 -- 172.21.15.55:0/65614528 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a540ab760 con 0x7f0a6c06fff0 2023-07-06T21:42:15.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.088+0000 7f0a6a7fc640 1 -- 172.21.15.55:0/65614528 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a540abaf0 con 0x7f0a6c06fff0 2023-07-06T21:42:15.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 -- 172.21.15.55:0/65614528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a6c06fff0 msgr2=0x7f0a6c070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 --2- 172.21.15.55:0/65614528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a6c06fff0 0x7f0a6c070420 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0a540097f0 tx=0x7f0a5401c400 comp rx=0 tx=0).stop 2023-07-06T21:42:15.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 -- 172.21.15.55:0/65614528 shutdown_connections 2023-07-06T21:42:15.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 --2- 172.21.15.55:0/65614528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a6c06fff0 0x7f0a6c070420 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 -- 172.21.15.55:0/65614528 >> 172.21.15.55:0/65614528 conn(0x7f0a6c0cb970 msgr2=0x7f0a6c0cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:15.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 -- 172.21.15.55:0/65614528 shutdown_connections 2023-07-06T21:42:15.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 -- 172.21.15.55:0/65614528 wait complete. 2023-07-06T21:42:15.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 Processor -- start 2023-07-06T21:42:15.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 -- start start 2023-07-06T21:42:15.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a6c06fff0 0x7f0a6c14b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a6c0b2ca0 0x7f0a6c14e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a6c0c7c70 0x7f0a6c14eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0c6bd0 con 0x7f0a6c06fff0 2023-07-06T21:42:15.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0c6eb0 con 0x7f0a6c0b2ca0 2023-07-06T21:42:15.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a7187b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0c7190 con 0x7f0a6c0c7c70 2023-07-06T21:42:15.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a6affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a6c06fff0 0x7f0a6c14b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a6affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a6c06fff0 0x7f0a6c14b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43624/0 (socket says 172.21.15.55:43624) 2023-07-06T21:42:15.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a6affd640 1 -- 172.21.15.55:0/2273979853 learned_addr learned my addr 172.21.15.55:0/2273979853 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:15.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a63fff640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a6c0b2ca0 0x7f0a6c14e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.092+0000 7f0a6b7fe640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a6c0c7c70 0x7f0a6c14eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a6affd640 1 -- 172.21.15.55:0/2273979853 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a6c0c7c70 msgr2=0x7f0a6c14eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a6affd640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a6c0c7c70 0x7f0a6c14eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a6affd640 1 -- 172.21.15.55:0/2273979853 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a6c0b2ca0 msgr2=0x7f0a6c14e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a6affd640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a6c0b2ca0 0x7f0a6c14e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a6affd640 1 -- 172.21.15.55:0/2273979853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a54009420 con 0x7f0a6c06fff0 2023-07-06T21:42:15.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a63fff640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a6c0b2ca0 0x7f0a6c14e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:15.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a6b7fe640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a6c0c7c70 0x7f0a6c14eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:15.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a6affd640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a6c06fff0 0x7f0a6c14b660 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00c430 tx=0x7f0a5c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:15.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a68ff9640 1 -- 172.21.15.55:0/2273979853 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0052d0 con 0x7f0a6c06fff0 2023-07-06T21:42:15.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a68ff9640 1 -- 172.21.15.55:0/2273979853 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c005450 con 0x7f0a6c06fff0 2023-07-06T21:42:15.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a68ff9640 1 -- 172.21.15.55:0/2273979853 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c003840 con 0x7f0a6c06fff0 2023-07-06T21:42:15.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a7187b640 1 -- 172.21.15.55:0/2273979853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6c0c7470 con 0x7f0a6c06fff0 2023-07-06T21:42:15.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a7187b640 1 -- 172.21.15.55:0/2273979853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6c14bba0 con 0x7f0a6c06fff0 2023-07-06T21:42:15.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a7187b640 1 -- 172.21.15.55:0/2273979853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6c066d60 con 0x7f0a6c06fff0 2023-07-06T21:42:15.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a68ff9640 1 -- 172.21.15.55:0/2273979853 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a5c0039a0 con 0x7f0a6c06fff0 2023-07-06T21:42:15.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a68ff9640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a4c0662b0 0x7f0a4c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a68ff9640 1 -- 172.21.15.55:0/2273979853 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f0a5c083620 con 0x7f0a6c06fff0 2023-07-06T21:42:15.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.096+0000 7f0a63fff640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a4c0662b0 0x7f0a4c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.100+0000 7f0a63fff640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a4c0662b0 0x7f0a4c068760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0a540af000 tx=0x7f0a540a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:15.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.100+0000 7f0a68ff9640 1 -- 172.21.15.55:0/2273979853 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a5c0507c0 con 0x7f0a6c06fff0 2023-07-06T21:42:15.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.292+0000 7f0a7187b640 1 -- 172.21.15.55:0/2273979853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f0a6c0c7920 con 0x7f0a6c06fff0 2023-07-06T21:42:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.296+0000 7f0a68ff9640 1 -- 172.21.15.55:0/2273979853 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f0a5c053de0 con 0x7f0a6c06fff0 2023-07-06T21:42:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:added data pool 5 to fsmap 2023-07-06T21:42:15.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.300+0000 7f0a7187b640 1 -- 172.21.15.55:0/2273979853 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a4c0662b0 msgr2=0x7f0a4c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.300+0000 7f0a7187b640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a4c0662b0 0x7f0a4c068760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0a540af000 tx=0x7f0a540a7000 comp rx=0 tx=0).stop 2023-07-06T21:42:15.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.300+0000 7f0a7187b640 1 -- 172.21.15.55:0/2273979853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a6c06fff0 msgr2=0x7f0a6c14b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.300+0000 7f0a7187b640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a6c06fff0 0x7f0a6c14b660 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00c430 tx=0x7f0a5c00c8f0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.300+0000 7f0a7187b640 1 -- 172.21.15.55:0/2273979853 shutdown_connections 2023-07-06T21:42:15.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.300+0000 7f0a7187b640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a4c0662b0 0x7f0a4c068760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.300+0000 7f0a7187b640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a6c0c7c70 0x7f0a6c14eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.300+0000 7f0a7187b640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a6c0b2ca0 0x7f0a6c14e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.300+0000 7f0a7187b640 1 --2- 172.21.15.55:0/2273979853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a6c06fff0 0x7f0a6c14b660 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.300+0000 7f0a7187b640 1 -- 172.21.15.55:0/2273979853 >> 172.21.15.55:0/2273979853 conn(0x7f0a6c0cb970 msgr2=0x7f0a6c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.300+0000 7f0a7187b640 1 -- 172.21.15.55:0/2273979853 shutdown_connections 2023-07-06T21:42:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.300+0000 7f0a7187b640 1 -- 172.21.15.55:0/2273979853 wait complete. 2023-07-06T21:42:15.324 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:42:15.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.464+0000 7f062d8cb640 1 Processor -- start 2023-07-06T21:42:15.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.464+0000 7f062d8cb640 1 -- start start 2023-07-06T21:42:15.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.464+0000 7f062d8cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06280b7cd0 0x7f06280ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.464+0000 7f062d8cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06280cecf0 con 0x7f06280ccab0 2023-07-06T21:42:15.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.464+0000 7f062d8cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06280d1d90 con 0x7f06280b1fe0 2023-07-06T21:42:15.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.464+0000 7f062d8cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06280d2310 con 0x7f06280b7cd0 2023-07-06T21:42:15.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.464+0000 7f0626ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06280b7cd0 0x7f06280ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.464+0000 7f061e7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f06280ccab0 0x7f06280b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59258/0 (socket says 172.21.15.55:59258) 2023-07-06T21:42:15.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.464+0000 7f0626ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06280b7cd0 0x7f06280ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43634/0 (socket says 172.21.15.55:43634) 2023-07-06T21:42:15.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.464+0000 7f061e7fc640 1 -- 172.21.15.55:0/78278439 learned_addr learned my addr 172.21.15.55:0/78278439 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:15.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.464+0000 7f0626ffd640 1 -- 172.21.15.55:0/78278439 >> v1:172.21.15.138:6789/0 conn(0x7f06280b1fe0 legacy=0x7f062815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:15.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.464+0000 7f0626ffd640 1 -- 172.21.15.55:0/78278439 >> v1:172.21.15.55:6789/0 conn(0x7f06280ccab0 legacy=0x7f06280b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.464+0000 7f0626ffd640 1 -- 172.21.15.55:0/78278439 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06280d2030 con 0x7f06280b7cd0 2023-07-06T21:42:15.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.464+0000 7f06267fc640 1 -- 172.21.15.55:0/78278439 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822811543 0 0) 0x7f06280cecf0 con 0x7f06280ccab0 2023-07-06T21:42:15.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.468+0000 7f0626ffd640 1 --2- 172.21.15.55:0/78278439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06280b7cd0 0x7f06280ce610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f06180097c0 tx=0x7f061801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fee60a9969a7df server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:15.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.468+0000 7f06267fc640 1 -- 172.21.15.55:0/78278439 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06180ab600 con 0x7f06280b7cd0 2023-07-06T21:42:15.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.468+0000 7f06267fc640 1 -- 172.21.15.55:0/78278439 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06180a7050 con 0x7f06280b7cd0 2023-07-06T21:42:15.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.468+0000 7f06267fc640 1 -- 172.21.15.55:0/78278439 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06180ab980 con 0x7f06280b7cd0 2023-07-06T21:42:15.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.468+0000 7f062d8cb640 1 -- 172.21.15.55:0/78278439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06280b7cd0 msgr2=0x7f06280ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.468+0000 7f062d8cb640 1 --2- 172.21.15.55:0/78278439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06280b7cd0 0x7f06280ce610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f06180097c0 tx=0x7f061801c3b0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.468+0000 7f062d8cb640 1 -- 172.21.15.55:0/78278439 shutdown_connections 2023-07-06T21:42:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.468+0000 7f062d8cb640 1 --2- 172.21.15.55:0/78278439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06280b7cd0 0x7f06280ce610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.468+0000 7f062d8cb640 1 -- 172.21.15.55:0/78278439 >> 172.21.15.55:0/78278439 conn(0x7f06280ceee0 msgr2=0x7f06280cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.468+0000 7f062d8cb640 1 -- 172.21.15.55:0/78278439 shutdown_connections 2023-07-06T21:42:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.468+0000 7f062d8cb640 1 -- 172.21.15.55:0/78278439 wait complete. 2023-07-06T21:42:15.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f062d8cb640 1 Processor -- start 2023-07-06T21:42:15.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f062d8cb640 1 -- start start 2023-07-06T21:42:15.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f062d8cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06280b1fe0 0x7f062814a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f062d8cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06280b7cd0 0x7f06281f6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f062d8cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06280ccab0 0x7f06281f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f062d8cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0628151ae0 con 0x7f06280ccab0 2023-07-06T21:42:15.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f062d8cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0628150220 con 0x7f06280b7cd0 2023-07-06T21:42:15.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f062d8cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06281f5ad0 con 0x7f06280b1fe0 2023-07-06T21:42:15.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f06277fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06280ccab0 0x7f06281f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f06277fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06280ccab0 0x7f06281f71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43650/0 (socket says 172.21.15.55:43650) 2023-07-06T21:42:15.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f06277fe640 1 -- 172.21.15.55:0/3886646295 learned_addr learned my addr 172.21.15.55:0/3886646295 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:15.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f061e7fc640 1 --2- 172.21.15.55:0/3886646295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06280b7cd0 0x7f06281f6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f0626ffd640 1 --2- 172.21.15.55:0/3886646295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06280b1fe0 0x7f062814a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f06277fe640 1 -- 172.21.15.55:0/3886646295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06280b1fe0 msgr2=0x7f062814a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f06277fe640 1 --2- 172.21.15.55:0/3886646295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06280b1fe0 0x7f062814a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f06277fe640 1 -- 172.21.15.55:0/3886646295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06280b7cd0 msgr2=0x7f06281f6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f06277fe640 1 --2- 172.21.15.55:0/3886646295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06280b7cd0 0x7f06281f6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f06277fe640 1 -- 172.21.15.55:0/3886646295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618009420 con 0x7f06280ccab0 2023-07-06T21:42:15.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f06277fe640 1 --2- 172.21.15.55:0/3886646295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06280ccab0 0x7f06281f71b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f062000c410 tx=0x7f062000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:15.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f0624ff9640 1 -- 172.21.15.55:0/3886646295 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620003600 con 0x7f06280ccab0 2023-07-06T21:42:15.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f0624ff9640 1 -- 172.21.15.55:0/3886646295 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0620003760 con 0x7f06280ccab0 2023-07-06T21:42:15.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f0624ff9640 1 -- 172.21.15.55:0/3886646295 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620003b10 con 0x7f06280ccab0 2023-07-06T21:42:15.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f062d8cb640 1 -- 172.21.15.55:0/3886646295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062814aa80 con 0x7f06280ccab0 2023-07-06T21:42:15.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f062d8cb640 1 -- 172.21.15.55:0/3886646295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0628156230 con 0x7f06280ccab0 2023-07-06T21:42:15.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.472+0000 7f062d8cb640 1 -- 172.21.15.55:0/3886646295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0628151c20 con 0x7f06280ccab0 2023-07-06T21:42:15.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.476+0000 7f0624ff9640 1 -- 172.21.15.55:0/3886646295 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0620003c70 con 0x7f06280ccab0 2023-07-06T21:42:15.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.476+0000 7f0624ff9640 1 --2- 172.21.15.55:0/3886646295 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0608066280 0x7f0608068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.476+0000 7f0624ff9640 1 -- 172.21.15.55:0/3886646295 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f06200831f0 con 0x7f06280ccab0 2023-07-06T21:42:15.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.476+0000 7f0626ffd640 1 --2- 172.21.15.55:0/3886646295 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0608066280 0x7f0608068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.476+0000 7f0626ffd640 1 --2- 172.21.15.55:0/3886646295 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0608066280 0x7f0608068730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f06180ad000 tx=0x7f06180a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:15.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.480+0000 7f0624ff9640 1 -- 172.21.15.55:0/3886646295 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0628151c20 con 0x7f06280ccab0 2023-07-06T21:42:15.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.672+0000 7f062d8cb640 1 -- 172.21.15.55:0/3886646295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0628151c20 con 0x7f06280ccab0 2023-07-06T21:42:15.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.676+0000 7f0624ff9640 1 -- 172.21.15.55:0/3886646295 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4667 (secure 0 0 0) 0x7f0628151c20 con 0x7f06280ccab0 2023-07-06T21:42:15.679 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:15.680 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/720785920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":720785920},{"type":"v1","addr":"172.21.15.138:6834","nonce":720785920}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3780018439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3780018439},{"type":"v1","addr":"172.21.15.138:6835","nonce":3780018439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/690984517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":690984517},{"type":"v1","addr":"172.21.15.55:6837","nonce":690984517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:42:10.854280+0000","modified":"2023-07-06T21:42:15.295705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/1421414378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1421414378},{"type":"v1","addr":"172.21.15.55:6836","nonce":1421414378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-06T21:42:15.681 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 7 2023-07-06T21:42:15.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.676+0000 7f062d8cb640 1 -- 172.21.15.55:0/3886646295 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0608066280 msgr2=0x7f0608068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.676+0000 7f062d8cb640 1 --2- 172.21.15.55:0/3886646295 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0608066280 0x7f0608068730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f06180ad000 tx=0x7f06180a6000 comp rx=0 tx=0).stop 2023-07-06T21:42:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.676+0000 7f062d8cb640 1 -- 172.21.15.55:0/3886646295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06280ccab0 msgr2=0x7f06281f71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.676+0000 7f062d8cb640 1 --2- 172.21.15.55:0/3886646295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06280ccab0 0x7f06281f71b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f062000c410 tx=0x7f062000c8d0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.676+0000 7f062d8cb640 1 -- 172.21.15.55:0/3886646295 shutdown_connections 2023-07-06T21:42:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.676+0000 7f062d8cb640 1 --2- 172.21.15.55:0/3886646295 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0608066280 0x7f0608068730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.676+0000 7f062d8cb640 1 --2- 172.21.15.55:0/3886646295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06280ccab0 0x7f06281f71b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.676+0000 7f062d8cb640 1 --2- 172.21.15.55:0/3886646295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06280b7cd0 0x7f06281f6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.676+0000 7f062d8cb640 1 --2- 172.21.15.55:0/3886646295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06280b1fe0 0x7f062814a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.676+0000 7f062d8cb640 1 -- 172.21.15.55:0/3886646295 >> 172.21.15.55:0/3886646295 conn(0x7f06280ceee0 msgr2=0x7f0628157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.676+0000 7f062d8cb640 1 -- 172.21.15.55:0/3886646295 shutdown_connections 2023-07-06T21:42:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.676+0000 7f062d8cb640 1 -- 172.21.15.55:0/3886646295 wait complete. 2023-07-06T21:42:15.700 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.840+0000 7fd0f4b1e640 1 Processor -- start 2023-07-06T21:42:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.840+0000 7fd0f4b1e640 1 -- start start 2023-07-06T21:42:15.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.840+0000 7fd0f4b1e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd0f01587d0 0x7fd0f0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.840+0000 7fd0f4b1e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0f00710c0 0x7fd0f00cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.840+0000 7fd0f4b1e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f006fae0 con 0x7fd0f0158400 2023-07-06T21:42:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.840+0000 7fd0f4b1e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f006fdc0 con 0x7fd0f01587d0 2023-07-06T21:42:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.840+0000 7fd0f4b1e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f00700a0 con 0x7fd0f00710c0 2023-07-06T21:42:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.844+0000 7fd0eed9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0f00710c0 0x7fd0f00cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.844+0000 7fd0ee59c640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fd0f0158400 0x7fd0f00c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:60976/0 (socket says 172.21.15.55:60976) 2023-07-06T21:42:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.844+0000 7fd0ee59c640 1 -- 172.21.15.55:0/3273195740 learned_addr learned my addr 172.21.15.55:0/3273195740 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.844+0000 7fd0e7fff640 1 --2- 172.21.15.55:0/3273195740 >> v2:172.21.15.138:3300/0 conn(0x7fd0f01587d0 0x7fd0f0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.844+0000 7fd0edd9b640 1 -- 172.21.15.55:0/3273195740 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820261623 0 0) 0x7fd0f006fae0 con 0x7fd0f0158400 2023-07-06T21:42:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.844+0000 7fd0e7fff640 1 -- 172.21.15.55:0/3273195740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0f00710c0 msgr2=0x7fd0f00cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.844+0000 7fd0e7fff640 1 --2- 172.21.15.55:0/3273195740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0f00710c0 0x7fd0f00cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.844+0000 7fd0e7fff640 1 -- 172.21.15.55:0/3273195740 >> v1:172.21.15.138:6789/0 conn(0x7fd0f0158400 legacy=0x7fd0f00c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.844+0000 7fd0e7fff640 1 -- 172.21.15.55:0/3273195740 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f0070380 con 0x7fd0f01587d0 2023-07-06T21:42:15.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.844+0000 7fd0eed9d640 1 --2- 172.21.15.55:0/3273195740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0f00710c0 0x7fd0f00cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:15.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.844+0000 7fd0e7fff640 1 --2- 172.21.15.55:0/3273195740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f01587d0 0x7fd0f0070b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80097c0 tx=0x7fd0d801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c5511e698c17506 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:15.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0edd9b640 1 -- 172.21.15.55:0/3273195740 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80ad660 con 0x7fd0f01587d0 2023-07-06T21:42:15.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0edd9b640 1 -- 172.21.15.55:0/3273195740 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d80ad7c0 con 0x7fd0f01587d0 2023-07-06T21:42:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0edd9b640 1 -- 172.21.15.55:0/3273195740 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80adb50 con 0x7fd0f01587d0 2023-07-06T21:42:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/3273195740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f01587d0 msgr2=0x7fd0f0070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 --2- 172.21.15.55:0/3273195740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f01587d0 0x7fd0f0070b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80097c0 tx=0x7fd0d801c450 comp rx=0 tx=0).stop 2023-07-06T21:42:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/3273195740 shutdown_connections 2023-07-06T21:42:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 --2- 172.21.15.55:0/3273195740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0f00710c0 0x7fd0f00cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 --2- 172.21.15.55:0/3273195740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f01587d0 0x7fd0f0070b80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/3273195740 >> 172.21.15.55:0/3273195740 conn(0x7fd0f00cded0 msgr2=0x7fd0f00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:15.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/3273195740 shutdown_connections 2023-07-06T21:42:15.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/3273195740 wait complete. 2023-07-06T21:42:15.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 Processor -- start 2023-07-06T21:42:15.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 -- start start 2023-07-06T21:42:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0f00710c0 0x7fd0f014b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0f0158400 0x7fd0f01502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f01587d0 0x7fd0f014c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f014b800 con 0x7fd0f0158400 2023-07-06T21:42:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f00c4fa0 con 0x7fd0f01587d0 2023-07-06T21:42:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0f4b1e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f014f6f0 con 0x7fd0f00710c0 2023-07-06T21:42:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0e7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0f0158400 0x7fd0f01502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0e7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0f0158400 0x7fd0f01502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43656/0 (socket says 172.21.15.55:43656) 2023-07-06T21:42:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.848+0000 7fd0e7fff640 1 -- 172.21.15.55:0/994916813 learned_addr learned my addr 172.21.15.55:0/994916813 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0ee59c640 1 --2- 172.21.15.55:0/994916813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0f00710c0 0x7fd0f014b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0eed9d640 1 --2- 172.21.15.55:0/994916813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f01587d0 0x7fd0f014c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0e7fff640 1 -- 172.21.15.55:0/994916813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0f00710c0 msgr2=0x7fd0f014b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0e7fff640 1 --2- 172.21.15.55:0/994916813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0f00710c0 0x7fd0f014b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0e7fff640 1 -- 172.21.15.55:0/994916813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f01587d0 msgr2=0x7fd0f014c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0e7fff640 1 --2- 172.21.15.55:0/994916813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f01587d0 0x7fd0f014c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0e7fff640 1 -- 172.21.15.55:0/994916813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e8009a70 con 0x7fd0f0158400 2023-07-06T21:42:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0e7fff640 1 --2- 172.21.15.55:0/994916813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0f0158400 0x7fd0f01502e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80b0040 tx=0x7fd0d80191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0e6ffd640 1 -- 172.21.15.55:0/994916813 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80b6610 con 0x7fd0f0158400 2023-07-06T21:42:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0e6ffd640 1 -- 172.21.15.55:0/994916813 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d80b6790 con 0x7fd0f0158400 2023-07-06T21:42:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0e6ffd640 1 -- 172.21.15.55:0/994916813 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80b6b40 con 0x7fd0f0158400 2023-07-06T21:42:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/994916813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d8009420 con 0x7fd0f0158400 2023-07-06T21:42:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/994916813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f00c54d0 con 0x7fd0f0158400 2023-07-06T21:42:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/994916813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f006c580 con 0x7fd0f0158400 2023-07-06T21:42:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0e6ffd640 1 -- 172.21.15.55:0/994916813 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0d80b4040 con 0x7fd0f0158400 2023-07-06T21:42:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.852+0000 7fd0e6ffd640 1 --2- 172.21.15.55:0/994916813 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd0d00662b0 0x7fd0d0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.856+0000 7fd0e6ffd640 1 -- 172.21.15.55:0/994916813 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd0d811e3e0 con 0x7fd0f0158400 2023-07-06T21:42:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.856+0000 7fd0ee59c640 1 --2- 172.21.15.55:0/994916813 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd0d00662b0 0x7fd0d0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.856+0000 7fd0ee59c640 1 --2- 172.21.15.55:0/994916813 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd0d00662b0 0x7fd0d0068760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0000f70 tx=0x7fd0e0007b80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:15.860+0000 7fd0e6ffd640 1 -- 172.21.15.55:0/994916813 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0d80eb600 con 0x7fd0f0158400 2023-07-06T21:42:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.012+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/994916813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0f0066d60 con 0x7fd0f0158400 2023-07-06T21:42:16.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.012+0000 7fd0e6ffd640 1 -- 172.21.15.55:0/994916813 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fd0d80eec20 con 0x7fd0f0158400 2023-07-06T21:42:16.018 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:16.019 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:15.295464+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:16.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.016+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/994916813 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd0d00662b0 msgr2=0x7fd0d0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.016+0000 7fd0f4b1e640 1 --2- 172.21.15.55:0/994916813 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd0d00662b0 0x7fd0d0068760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0000f70 tx=0x7fd0e0007b80 comp rx=0 tx=0).stop 2023-07-06T21:42:16.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.016+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/994916813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0f0158400 msgr2=0x7fd0f01502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.016+0000 7fd0f4b1e640 1 --2- 172.21.15.55:0/994916813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0f0158400 0x7fd0f01502e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80b0040 tx=0x7fd0d80191f0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.016+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/994916813 shutdown_connections 2023-07-06T21:42:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.016+0000 7fd0f4b1e640 1 --2- 172.21.15.55:0/994916813 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd0d00662b0 0x7fd0d0068760 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.016+0000 7fd0f4b1e640 1 --2- 172.21.15.55:0/994916813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0f01587d0 0x7fd0f014c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.016+0000 7fd0f4b1e640 1 --2- 172.21.15.55:0/994916813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0f0158400 0x7fd0f01502e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.016+0000 7fd0f4b1e640 1 --2- 172.21.15.55:0/994916813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0f00710c0 0x7fd0f014b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.016+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/994916813 >> 172.21.15.55:0/994916813 conn(0x7fd0f00cded0 msgr2=0x7fd0f00addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.016+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/994916813 shutdown_connections 2023-07-06T21:42:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.016+0000 7fd0f4b1e640 1 -- 172.21.15.55:0/994916813 wait complete. 2023-07-06T21:42:16.040 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:16.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.176+0000 7f60f5737640 1 Processor -- start 2023-07-06T21:42:16.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.176+0000 7f60f5737640 1 -- start start 2023-07-06T21:42:16.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60f5737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60f0158440 0x7f60f00b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60f5737640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60f0158810 0x7f60f00c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60f5737640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f00b1c30 con 0x7f60f00c8710 2023-07-06T21:42:16.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60f5737640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f006fcb0 con 0x7f60f0158810 2023-07-06T21:42:16.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60f5737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f00b1eb0 con 0x7f60f0158440 2023-07-06T21:42:16.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60e7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60f0158810 0x7f60f00c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60e7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60f0158810 0x7f60f00c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43670/0 (socket says 172.21.15.55:43670) 2023-07-06T21:42:16.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60ef7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f60f00c8710 0x7f60f00b2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59264/0 (socket says 172.21.15.55:59264) 2023-07-06T21:42:16.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60e7fff640 1 -- 172.21.15.55:0/1312402328 learned_addr learned my addr 172.21.15.55:0/1312402328 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:16.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60eeffd640 1 --2- 172.21.15.55:0/1312402328 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60f0158440 0x7f60f00b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60e7fff640 1 -- 172.21.15.55:0/1312402328 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60f0158440 msgr2=0x7f60f00b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:16.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60e7fff640 1 --2- 172.21.15.55:0/1312402328 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60f0158440 0x7f60f00b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60e7fff640 1 -- 172.21.15.55:0/1312402328 >> v1:172.21.15.55:6789/0 conn(0x7f60f00c8710 legacy=0x7f60f00b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60e7fff640 1 -- 172.21.15.55:0/1312402328 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f00b2190 con 0x7f60f0158810 2023-07-06T21:42:16.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.180+0000 7f60ee7fc640 1 -- 172.21.15.55:0/1312402328 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933013472 0 0) 0x7f60f00b1c30 con 0x7f60f00c8710 2023-07-06T21:42:16.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.184+0000 7f60e7fff640 1 --2- 172.21.15.55:0/1312402328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60f0158810 0x7f60f00c81d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f60d800bb10 tx=0x7f60d801ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51dd44fde47ba38 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:16.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.184+0000 7f60ee7fc640 1 -- 172.21.15.55:0/1312402328 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80a7c80 con 0x7f60f0158810 2023-07-06T21:42:16.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.184+0000 7f60ee7fc640 1 -- 172.21.15.55:0/1312402328 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d80a7de0 con 0x7f60f0158810 2023-07-06T21:42:16.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.184+0000 7f60ee7fc640 1 -- 172.21.15.55:0/1312402328 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80af660 con 0x7f60f0158810 2023-07-06T21:42:16.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.184+0000 7f60f5737640 1 -- 172.21.15.55:0/1312402328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60f0158810 msgr2=0x7f60f00c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.184+0000 7f60f5737640 1 --2- 172.21.15.55:0/1312402328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60f0158810 0x7f60f00c81d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f60d800bb10 tx=0x7f60d801ec10 comp rx=0 tx=0).stop 2023-07-06T21:42:16.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.184+0000 7f60f5737640 1 -- 172.21.15.55:0/1312402328 shutdown_connections 2023-07-06T21:42:16.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.184+0000 7f60f5737640 1 --2- 172.21.15.55:0/1312402328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60f0158810 0x7f60f00c81d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.184+0000 7f60f5737640 1 --2- 172.21.15.55:0/1312402328 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60f0158440 0x7f60f00b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.184+0000 7f60f5737640 1 -- 172.21.15.55:0/1312402328 >> 172.21.15.55:0/1312402328 conn(0x7f60f00ca690 msgr2=0x7f60f00caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:16.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.184+0000 7f60f5737640 1 -- 172.21.15.55:0/1312402328 shutdown_connections 2023-07-06T21:42:16.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.184+0000 7f60f5737640 1 -- 172.21.15.55:0/1312402328 wait complete. 2023-07-06T21:42:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.184+0000 7f60f5737640 1 Processor -- start 2023-07-06T21:42:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.184+0000 7f60f5737640 1 -- start start 2023-07-06T21:42:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60f5737640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60f00c8710 0x7f60f01506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60f5737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60f0158440 0x7f60f0147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60f5737640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60f0158810 0x7f60f006b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60f5737640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f006b910 con 0x7f60f00c8710 2023-07-06T21:42:16.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60f5737640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f006a6a0 con 0x7f60f0158810 2023-07-06T21:42:16.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60f5737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f006af40 con 0x7f60f0158440 2023-07-06T21:42:16.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60eeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60f00c8710 0x7f60f01506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60eeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60f00c8710 0x7f60f01506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43674/0 (socket says 172.21.15.55:43674) 2023-07-06T21:42:16.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60eeffd640 1 -- 172.21.15.55:0/1259054930 learned_addr learned my addr 172.21.15.55:0/1259054930 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:16.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60ef7fe640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60f0158810 0x7f60f006b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60e7fff640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60f0158440 0x7f60f0147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60eeffd640 1 -- 172.21.15.55:0/1259054930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60f0158440 msgr2=0x7f60f0147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60eeffd640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60f0158440 0x7f60f0147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60eeffd640 1 -- 172.21.15.55:0/1259054930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60f0158810 msgr2=0x7f60f006b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60eeffd640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60f0158810 0x7f60f006b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60eeffd640 1 -- 172.21.15.55:0/1259054930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d800b770 con 0x7f60f00c8710 2023-07-06T21:42:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60e7fff640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60f0158440 0x7f60f0147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60ef7fe640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60f0158810 0x7f60f006b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60eeffd640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60f00c8710 0x7f60f01506b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f60e000e930 tx=0x7f60e000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60e77fe640 1 -- 172.21.15.55:0/1259054930 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0009690 con 0x7f60f00c8710 2023-07-06T21:42:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60e77fe640 1 -- 172.21.15.55:0/1259054930 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e000ca00 con 0x7f60f00c8710 2023-07-06T21:42:16.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60f5737640 1 -- 172.21.15.55:0/1259054930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f0150d00 con 0x7f60f00c8710 2023-07-06T21:42:16.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60e77fe640 1 -- 172.21.15.55:0/1259054930 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000cd70 con 0x7f60f00c8710 2023-07-06T21:42:16.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60f5737640 1 -- 172.21.15.55:0/1259054930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f006abd0 con 0x7f60f00c8710 2023-07-06T21:42:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60f5737640 1 -- 172.21.15.55:0/1259054930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f004d790 con 0x7f60f00c8710 2023-07-06T21:42:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.188+0000 7f60e77fe640 1 -- 172.21.15.55:0/1259054930 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f60e0013470 con 0x7f60f00c8710 2023-07-06T21:42:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.192+0000 7f60e77fe640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f60d0066280 0x7f60d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.192+0000 7f60e77fe640 1 -- 172.21.15.55:0/1259054930 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f60e0084690 con 0x7f60f00c8710 2023-07-06T21:42:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.192+0000 7f60e7fff640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f60d0066280 0x7f60d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.192+0000 7f60e7fff640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f60d0066280 0x7f60d0068730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f60d80b1000 tx=0x7f60d80a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:16.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.196+0000 7f60e77fe640 1 -- 172.21.15.55:0/1259054930 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60e00518d0 con 0x7f60f00c8710 2023-07-06T21:42:16.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.352+0000 7f60f5737640 1 -- 172.21.15.55:0/1259054930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60f00c4530 con 0x7f60f00c8710 2023-07-06T21:42:16.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.356+0000 7f60e77fe640 1 -- 172.21.15.55:0/1259054930 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f60e0054ef0 con 0x7f60f00c8710 2023-07-06T21:42:16.359 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:16.359 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:15.295464+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.356+0000 7f60f5737640 1 -- 172.21.15.55:0/1259054930 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f60d0066280 msgr2=0x7f60d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.356+0000 7f60f5737640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f60d0066280 0x7f60d0068730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f60d80b1000 tx=0x7f60d80a9070 comp rx=0 tx=0).stop 2023-07-06T21:42:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.356+0000 7f60f5737640 1 -- 172.21.15.55:0/1259054930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60f00c8710 msgr2=0x7f60f01506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.356+0000 7f60f5737640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60f00c8710 0x7f60f01506b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f60e000e930 tx=0x7f60e000edf0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.356+0000 7f60f5737640 1 -- 172.21.15.55:0/1259054930 shutdown_connections 2023-07-06T21:42:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.356+0000 7f60f5737640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f60d0066280 0x7f60d0068730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.356+0000 7f60f5737640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60f0158810 0x7f60f006b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.356+0000 7f60f5737640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60f0158440 0x7f60f0147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.356+0000 7f60f5737640 1 --2- 172.21.15.55:0/1259054930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60f00c8710 0x7f60f01506b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.356+0000 7f60f5737640 1 -- 172.21.15.55:0/1259054930 >> 172.21.15.55:0/1259054930 conn(0x7f60f00ca690 msgr2=0x7f60f00b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.356+0000 7f60f5737640 1 -- 172.21.15.55:0/1259054930 shutdown_connections 2023-07-06T21:42:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.356+0000 7f60f5737640 1 -- 172.21.15.55:0/1259054930 wait complete. 2023-07-06T21:42:16.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:42:16.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.532+0000 7f5ef4026640 1 Processor -- start 2023-07-06T21:42:16.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef4026640 1 -- start start 2023-07-06T21:42:16.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef4026640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5eec15f4e0 0x7f5eec0b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef4026640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eec0b4250 0x7f5eec15c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef4026640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eec06a160 con 0x7f5eec15b9d0 2023-07-06T21:42:16.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef4026640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eec15bda0 con 0x7f5eec15f4e0 2023-07-06T21:42:16.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef4026640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec0b46b0 con 0x7f5eec0b4250 2023-07-06T21:42:16.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef1dc2640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5eec15b9d0 0x7f5eec0ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59280/0 (socket says 172.21.15.55:59280) 2023-07-06T21:42:16.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef1dc2640 1 -- 172.21.15.55:0/366201247 learned_addr learned my addr 172.21.15.55:0/366201247 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:16.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 -- 172.21.15.55:0/366201247 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750753358 0 0) 0x7f5eec06a160 con 0x7f5eec15b9d0 2023-07-06T21:42:16.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 -- 172.21.15.55:0/366201247 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed8003530 con 0x7f5eec15b9d0 2023-07-06T21:42:16.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef15c1640 1 --2- 172.21.15.55:0/366201247 >> v2:172.21.15.138:3300/0 conn(0x7f5eec15f4e0 0x7f5eec0b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef25c3640 1 --2- 172.21.15.55:0/366201247 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eec0b4250 0x7f5eec15c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 -- 172.21.15.55:0/366201247 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1207931349 0 0) 0x7f5ed8003530 con 0x7f5eec15b9d0 2023-07-06T21:42:16.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 -- 172.21.15.55:0/366201247 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eec0b4250 msgr2=0x7f5eec15c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:16.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 --2- 172.21.15.55:0/366201247 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eec0b4250 0x7f5eec15c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 -- 172.21.15.55:0/366201247 >> v2:172.21.15.138:3300/0 conn(0x7f5eec15f4e0 msgr2=0x7f5eec0b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:16.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 --2- 172.21.15.55:0/366201247 >> v2:172.21.15.138:3300/0 conn(0x7f5eec15f4e0 0x7f5eec0b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 -- 172.21.15.55:0/366201247 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec069590 con 0x7f5eec15b9d0 2023-07-06T21:42:16.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 -- 172.21.15.55:0/366201247 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f5ee8001680 con 0x7f5eec15b9d0 2023-07-06T21:42:16.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 -- 172.21.15.55:0/366201247 >> v1:172.21.15.55:6789/0 conn(0x7f5eec15b9d0 legacy=0x7f5eec0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 --2- 172.21.15.55:0/366201247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed8003980 0x7f5ed8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 --2- 172.21.15.55:0/366201247 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ed80047d0 0x7f5ed8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 --2- 172.21.15.55:0/366201247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed8005180 0x7f5ed800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 -- 172.21.15.55:0/366201247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec15bda0 con 0x7f5ed8005180 2023-07-06T21:42:16.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 -- 172.21.15.55:0/366201247 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec0b46b0 con 0x7f5ed8003980 2023-07-06T21:42:16.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef0dc0640 1 -- 172.21.15.55:0/366201247 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed800bf80 con 0x7f5ed80047d0 2023-07-06T21:42:16.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef15c1640 1 --2- 172.21.15.55:0/366201247 >> v2:172.21.15.138:3300/0 conn(0x7f5eec15f4e0 0x7f5eec0b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:16.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef25c3640 1 --2- 172.21.15.55:0/366201247 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eec0b4250 0x7f5eec15c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:16.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef25c3640 1 --2- 172.21.15.55:0/366201247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed8005180 0x7f5ed800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef25c3640 1 -- 172.21.15.55:0/366201247 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ed80047d0 msgr2=0x7f5ed8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:16.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef25c3640 1 --2- 172.21.15.55:0/366201247 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ed80047d0 0x7f5ed8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef1dc2640 1 --2- 172.21.15.55:0/366201247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed8003980 0x7f5ed8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef25c3640 1 -- 172.21.15.55:0/366201247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed8003980 msgr2=0x7f5ed8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:16.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef25c3640 1 --2- 172.21.15.55:0/366201247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed8003980 0x7f5ed8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef25c3640 1 -- 172.21.15.55:0/366201247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed8003530 con 0x7f5ed8005180 2023-07-06T21:42:16.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.536+0000 7f5ef1dc2640 1 --2- 172.21.15.55:0/366201247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed8003980 0x7f5ed8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:16.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.540+0000 7f5ef25c3640 1 --2- 172.21.15.55:0/366201247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed8005180 0x7f5ed800b990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0b4620 tx=0x7f5ee401ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a383f60bcb30cb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:16.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.540+0000 7f5ef0dc0640 1 -- 172.21.15.55:0/366201247 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4003ba0 con 0x7f5ed8005180 2023-07-06T21:42:16.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.540+0000 7f5ef0dc0640 1 -- 172.21.15.55:0/366201247 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee4003d00 con 0x7f5ed8005180 2023-07-06T21:42:16.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.540+0000 7f5ef0dc0640 1 -- 172.21.15.55:0/366201247 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4004250 con 0x7f5ed8005180 2023-07-06T21:42:16.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.540+0000 7f5ef4026640 1 -- 172.21.15.55:0/366201247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed8005180 msgr2=0x7f5ed800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.540+0000 7f5ef4026640 1 --2- 172.21.15.55:0/366201247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed8005180 0x7f5ed800b990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0b4620 tx=0x7f5ee401ccf0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.540+0000 7f5ef25c3640 1 -- 172.21.15.55:0/366201247 reap_dead start 2023-07-06T21:42:16.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.540+0000 7f5ef4026640 1 -- 172.21.15.55:0/366201247 shutdown_connections 2023-07-06T21:42:16.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.540+0000 7f5ef4026640 1 -- 172.21.15.55:0/366201247 >> 172.21.15.55:0/366201247 conn(0x7f5eec0ced10 msgr2=0x7f5eec0cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:16.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.540+0000 7f5ef4026640 1 -- 172.21.15.55:0/366201247 shutdown_connections 2023-07-06T21:42:16.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.540+0000 7f5ef4026640 1 -- 172.21.15.55:0/366201247 wait complete. 2023-07-06T21:42:16.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef4026640 1 Processor -- start 2023-07-06T21:42:16.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef4026640 1 -- start start 2023-07-06T21:42:16.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef4026640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed8005180 0x7f5eec15e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef4026640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eec1f43d0 0x7f5eec14add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef4026640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eec14b310 0x7f5eec0d2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef4026640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec0ca3b0 con 0x7f5ed8005180 2023-07-06T21:42:16.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef4026640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec0ca690 con 0x7f5eec1f43d0 2023-07-06T21:42:16.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef4026640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec1532a0 con 0x7f5eec14b310 2023-07-06T21:42:16.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef1dc2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed8005180 0x7f5eec15e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef1dc2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed8005180 0x7f5eec15e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43696/0 (socket says 172.21.15.55:43696) 2023-07-06T21:42:16.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef1dc2640 1 -- 172.21.15.55:0/2015243092 learned_addr learned my addr 172.21.15.55:0/2015243092 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:16.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef15c1640 1 --2- 172.21.15.55:0/2015243092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eec1f43d0 0x7f5eec14add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef25c3640 1 --2- 172.21.15.55:0/2015243092 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eec14b310 0x7f5eec0d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef1dc2640 1 -- 172.21.15.55:0/2015243092 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eec14b310 msgr2=0x7f5eec0d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef1dc2640 1 --2- 172.21.15.55:0/2015243092 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eec14b310 0x7f5eec0d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef1dc2640 1 -- 172.21.15.55:0/2015243092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eec1f43d0 msgr2=0x7f5eec14add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef1dc2640 1 --2- 172.21.15.55:0/2015243092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eec1f43d0 0x7f5eec14add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef1dc2640 1 -- 172.21.15.55:0/2015243092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec1f4be0 con 0x7f5ed8005180 2023-07-06T21:42:16.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef1dc2640 1 --2- 172.21.15.55:0/2015243092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed8005180 0x7f5eec15e000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8007fd0 tx=0x7f5ee800dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:16.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ee27fc640 1 -- 172.21.15.55:0/2015243092 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80074e0 con 0x7f5ed8005180 2023-07-06T21:42:16.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ee27fc640 1 -- 172.21.15.55:0/2015243092 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee8007640 con 0x7f5ed8005180 2023-07-06T21:42:16.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ee27fc640 1 -- 172.21.15.55:0/2015243092 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80049f0 con 0x7f5ed8005180 2023-07-06T21:42:16.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef4026640 1 -- 172.21.15.55:0/2015243092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eec1f4ec0 con 0x7f5ed8005180 2023-07-06T21:42:16.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.544+0000 7f5ef4026640 1 -- 172.21.15.55:0/2015243092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eec1f4840 con 0x7f5ed8005180 2023-07-06T21:42:16.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.548+0000 7f5ef4026640 1 -- 172.21.15.55:0/2015243092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eec066d60 con 0x7f5ed8005180 2023-07-06T21:42:16.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.548+0000 7f5ee27fc640 1 -- 172.21.15.55:0/2015243092 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ee8004b50 con 0x7f5ed8005180 2023-07-06T21:42:16.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.548+0000 7f5ee27fc640 1 --2- 172.21.15.55:0/2015243092 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5ed0066280 0x7f5ed0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.548+0000 7f5ee27fc640 1 -- 172.21.15.55:0/2015243092 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5ee8083930 con 0x7f5ed8005180 2023-07-06T21:42:16.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.548+0000 7f5ef15c1640 1 --2- 172.21.15.55:0/2015243092 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5ed0066280 0x7f5ed0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.548+0000 7f5ef15c1640 1 --2- 172.21.15.55:0/2015243092 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5ed0066280 0x7f5ed0068730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5eec156030 tx=0x7f5edc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:16.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.552+0000 7f5ee27fc640 1 -- 172.21.15.55:0/2015243092 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ee8050ad0 con 0x7f5ed8005180 2023-07-06T21:42:16.567 INFO:tasks.ceph.mds.a.smithi055.stderr:2023-07-06T21:42:16.564+0000 7ff7c2b71640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T21:42:16.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.740+0000 7f5ef4026640 1 -- 172.21.15.55:0/2015243092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5eec06ac10 con 0x7f5ed8005180 2023-07-06T21:42:16.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.740+0000 7f5ee27fc640 1 -- 172.21.15.55:0/2015243092 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4667 (secure 0 0 0) 0x7f5ee80540f0 con 0x7f5ed8005180 2023-07-06T21:42:16.745 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:16.745 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/720785920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":720785920},{"type":"v1","addr":"172.21.15.138:6834","nonce":720785920}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3780018439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3780018439},{"type":"v1","addr":"172.21.15.138:6835","nonce":3780018439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/690984517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":690984517},{"type":"v1","addr":"172.21.15.55:6837","nonce":690984517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:42:10.854280+0000","modified":"2023-07-06T21:42:15.295705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/1421414378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1421414378},{"type":"v1","addr":"172.21.15.55:6836","nonce":1421414378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-06T21:42:16.745 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 7 2023-07-06T21:42:16.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.744+0000 7f5ef4026640 1 -- 172.21.15.55:0/2015243092 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5ed0066280 msgr2=0x7f5ed0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.744+0000 7f5ef4026640 1 --2- 172.21.15.55:0/2015243092 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5ed0066280 0x7f5ed0068730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5eec156030 tx=0x7f5edc008040 comp rx=0 tx=0).stop 2023-07-06T21:42:16.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.744+0000 7f5ef4026640 1 -- 172.21.15.55:0/2015243092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed8005180 msgr2=0x7f5eec15e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.744+0000 7f5ef4026640 1 --2- 172.21.15.55:0/2015243092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed8005180 0x7f5eec15e000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8007fd0 tx=0x7f5ee800dc80 comp rx=0 tx=0).stop 2023-07-06T21:42:16.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.744+0000 7f5ef4026640 1 -- 172.21.15.55:0/2015243092 shutdown_connections 2023-07-06T21:42:16.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.744+0000 7f5ef4026640 1 --2- 172.21.15.55:0/2015243092 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5ed0066280 0x7f5ed0068730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.744+0000 7f5ef4026640 1 --2- 172.21.15.55:0/2015243092 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eec14b310 0x7f5eec0d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.744+0000 7f5ef4026640 1 --2- 172.21.15.55:0/2015243092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eec1f43d0 0x7f5eec14add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.744+0000 7f5ef4026640 1 --2- 172.21.15.55:0/2015243092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed8005180 0x7f5eec15e000 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.744+0000 7f5ef4026640 1 -- 172.21.15.55:0/2015243092 >> 172.21.15.55:0/2015243092 conn(0x7f5eec0ced10 msgr2=0x7f5eec159ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:16.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.744+0000 7f5ef4026640 1 -- 172.21.15.55:0/2015243092 shutdown_connections 2023-07-06T21:42:16.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.744+0000 7f5ef4026640 1 -- 172.21.15.55:0/2015243092 wait complete. 2023-07-06T21:42:16.766 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:16.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.904+0000 7f761b848640 1 Processor -- start 2023-07-06T21:42:16.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.904+0000 7f761b848640 1 -- start start 2023-07-06T21:42:16.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.904+0000 7f761b848640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76140b1fe0 0x7f7614166ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.904+0000 7f761b848640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76140cd1c0 con 0x7f76140ce610 2023-07-06T21:42:16.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f761b848640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76140cecf0 con 0x7f76140b7cd0 2023-07-06T21:42:16.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f761b848640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76140d2310 con 0x7f76140b1fe0 2023-07-06T21:42:16.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f7618de3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f76140ce610 0x7f76140b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59296/0 (socket says 172.21.15.55:59296) 2023-07-06T21:42:16.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f7618de3640 1 -- 172.21.15.55:0/588749836 learned_addr learned my addr 172.21.15.55:0/588749836 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:16.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 -- 172.21.15.55:0/588749836 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885470413 0 0) 0x7f76140cd1c0 con 0x7f76140ce610 2023-07-06T21:42:16.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f7619de5640 1 --2- 172.21.15.55:0/588749836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76140b1fe0 0x7f7614166ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 -- 172.21.15.55:0/588749836 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7600003530 con 0x7f76140ce610 2023-07-06T21:42:16.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 -- 172.21.15.55:0/588749836 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4256075346 0 0) 0x7f7600003530 con 0x7f76140ce610 2023-07-06T21:42:16.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 -- 172.21.15.55:0/588749836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76140b1fe0 msgr2=0x7f7614166ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:16.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 --2- 172.21.15.55:0/588749836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76140b1fe0 0x7f7614166ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 -- 172.21.15.55:0/588749836 >> v1:172.21.15.138:6789/0 conn(0x7f76140b7cd0 legacy=0x7f76140ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 -- 172.21.15.55:0/588749836 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76140cea60 con 0x7f76140ce610 2023-07-06T21:42:16.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 -- 172.21.15.55:0/588749836 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f7604001680 con 0x7f76140ce610 2023-07-06T21:42:16.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 -- 172.21.15.55:0/588749836 >> v1:172.21.15.55:6789/0 conn(0x7f76140ce610 legacy=0x7f76140b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 --2- 172.21.15.55:0/588749836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76000039b0 0x7f7600003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 --2- 172.21.15.55:0/588749836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7600004350 0x7f7600004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 --2- 172.21.15.55:0/588749836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76140b1fe0 0x7f7600005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 -- 172.21.15.55:0/588749836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760000ba40 con 0x7f76000039b0 2023-07-06T21:42:16.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 -- 172.21.15.55:0/588749836 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760000bb80 con 0x7f7600004350 2023-07-06T21:42:16.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f760bfff640 1 -- 172.21.15.55:0/588749836 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760000bd10 con 0x7f76140b1fe0 2023-07-06T21:42:16.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f76195e4640 1 --2- 172.21.15.55:0/588749836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76000039b0 0x7f7600003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f7618de3640 1 --2- 172.21.15.55:0/588749836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7600004350 0x7f7600004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f7619de5640 1 --2- 172.21.15.55:0/588749836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76140b1fe0 0x7f7600005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f76195e4640 1 -- 172.21.15.55:0/588749836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76140b1fe0 msgr2=0x7f7600005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f76195e4640 1 --2- 172.21.15.55:0/588749836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76140b1fe0 0x7f7600005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f76195e4640 1 -- 172.21.15.55:0/588749836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7600004350 msgr2=0x7f7600004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f76195e4640 1 --2- 172.21.15.55:0/588749836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7600004350 0x7f7600004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f76195e4640 1 -- 172.21.15.55:0/588749836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600003530 con 0x7f76000039b0 2023-07-06T21:42:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f7619de5640 1 --2- 172.21.15.55:0/588749836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76140b1fe0 0x7f7600005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.908+0000 7f7618de3640 1 --2- 172.21.15.55:0/588749836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7600004350 0x7f7600004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:16.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.912+0000 7f76195e4640 1 --2- 172.21.15.55:0/588749836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76000039b0 0x7f7600003d80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7610001940 tx=0x7f761001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875f9c800ebb1367 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.912+0000 7f760bfff640 1 -- 172.21.15.55:0/588749836 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76100ab600 con 0x7f76000039b0 2023-07-06T21:42:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.912+0000 7f760bfff640 1 -- 172.21.15.55:0/588749836 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76100a7050 con 0x7f76000039b0 2023-07-06T21:42:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.912+0000 7f760bfff640 1 -- 172.21.15.55:0/588749836 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76100ab9c0 con 0x7f76000039b0 2023-07-06T21:42:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.912+0000 7f761b848640 1 -- 172.21.15.55:0/588749836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76000039b0 msgr2=0x7f7600003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.912+0000 7f761b848640 1 --2- 172.21.15.55:0/588749836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76000039b0 0x7f7600003d80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7610001940 tx=0x7f761001c560 comp rx=0 tx=0).stop 2023-07-06T21:42:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.912+0000 7f7619de5640 1 -- 172.21.15.55:0/588749836 reap_dead start 2023-07-06T21:42:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.912+0000 7f761b848640 1 -- 172.21.15.55:0/588749836 shutdown_connections 2023-07-06T21:42:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.912+0000 7f761b848640 1 -- 172.21.15.55:0/588749836 >> 172.21.15.55:0/588749836 conn(0x7f76140ceee0 msgr2=0x7f76140cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.912+0000 7f761b848640 1 -- 172.21.15.55:0/588749836 shutdown_connections 2023-07-06T21:42:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.912+0000 7f761b848640 1 -- 172.21.15.55:0/588749836 wait complete. 2023-07-06T21:42:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.912+0000 7f761b848640 1 Processor -- start 2023-07-06T21:42:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.912+0000 7f761b848640 1 -- start start 2023-07-06T21:42:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f761b848640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76000039b0 0x7f7614150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f761b848640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7614150650 0x7f761414ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f761b848640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76140c9530 0x7f761415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f761b848640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761415f2f0 con 0x7f76140c9530 2023-07-06T21:42:16.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f761b848640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76140b6990 con 0x7f76000039b0 2023-07-06T21:42:16.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f761b848640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7614150470 con 0x7f7614150650 2023-07-06T21:42:16.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f7619de5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76140c9530 0x7f761415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f7619de5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76140c9530 0x7f761415a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43716/0 (socket says 172.21.15.55:43716) 2023-07-06T21:42:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f7619de5640 1 -- 172.21.15.55:0/2076616153 learned_addr learned my addr 172.21.15.55:0/2076616153 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f7618de3640 1 --2- 172.21.15.55:0/2076616153 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7614150650 0x7f761414ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f76195e4640 1 --2- 172.21.15.55:0/2076616153 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76000039b0 0x7f7614150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f7619de5640 1 -- 172.21.15.55:0/2076616153 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7614150650 msgr2=0x7f761414ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f7619de5640 1 --2- 172.21.15.55:0/2076616153 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7614150650 0x7f761414ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f7619de5640 1 -- 172.21.15.55:0/2076616153 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76000039b0 msgr2=0x7f7614150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f7619de5640 1 --2- 172.21.15.55:0/2076616153 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76000039b0 0x7f7614150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f7619de5640 1 -- 172.21.15.55:0/2076616153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761415b890 con 0x7f76140c9530 2023-07-06T21:42:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f7619de5640 1 --2- 172.21.15.55:0/2076616153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76140c9530 0x7f761415a770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f76140b2420 tx=0x7f760c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:16.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f7609ffb640 1 -- 172.21.15.55:0/2076616153 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c00e050 con 0x7f76140c9530 2023-07-06T21:42:16.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f7609ffb640 1 -- 172.21.15.55:0/2076616153 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c00f040 con 0x7f76140c9530 2023-07-06T21:42:16.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f761b848640 1 -- 172.21.15.55:0/2076616153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761415bb70 con 0x7f76140c9530 2023-07-06T21:42:16.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f7609ffb640 1 -- 172.21.15.55:0/2076616153 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c003be0 con 0x7f76140c9530 2023-07-06T21:42:16.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f761b848640 1 -- 172.21.15.55:0/2076616153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76140b6620 con 0x7f76140c9530 2023-07-06T21:42:16.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.916+0000 7f761b848640 1 -- 172.21.15.55:0/2076616153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7614066d60 con 0x7f76140c9530 2023-07-06T21:42:16.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.920+0000 7f7609ffb640 1 -- 172.21.15.55:0/2076616153 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f760c015650 con 0x7f76140c9530 2023-07-06T21:42:16.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.920+0000 7f7609ffb640 1 --2- 172.21.15.55:0/2076616153 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f75f80662b0 0x7f75f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:16.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.920+0000 7f7609ffb640 1 -- 172.21.15.55:0/2076616153 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f760c083c80 con 0x7f76140c9530 2023-07-06T21:42:16.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.920+0000 7f76195e4640 1 --2- 172.21.15.55:0/2076616153 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f75f80662b0 0x7f75f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:16.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.920+0000 7f76195e4640 1 --2- 172.21.15.55:0/2076616153 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f75f80662b0 0x7f75f8068760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f76100ad000 tx=0x7f7610001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:16.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:16.924+0000 7f7609ffb640 1 -- 172.21.15.55:0/2076616153 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f760c050eb0 con 0x7f76140c9530 2023-07-06T21:42:17.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.080+0000 7f761b848640 1 -- 172.21.15.55:0/2076616153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76140b3690 con 0x7f76140c9530 2023-07-06T21:42:17.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.080+0000 7f7609ffb640 1 -- 172.21.15.55:0/2076616153 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f760c0544d0 con 0x7f76140c9530 2023-07-06T21:42:17.085 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:17.086 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:15.295464+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:17.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.084+0000 7f761b848640 1 -- 172.21.15.55:0/2076616153 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f75f80662b0 msgr2=0x7f75f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.084+0000 7f761b848640 1 --2- 172.21.15.55:0/2076616153 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f75f80662b0 0x7f75f8068760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f76100ad000 tx=0x7f7610001330 comp rx=0 tx=0).stop 2023-07-06T21:42:17.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.084+0000 7f761b848640 1 -- 172.21.15.55:0/2076616153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76140c9530 msgr2=0x7f761415a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.084+0000 7f761b848640 1 --2- 172.21.15.55:0/2076616153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76140c9530 0x7f761415a770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f76140b2420 tx=0x7f760c009f90 comp rx=0 tx=0).stop 2023-07-06T21:42:17.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.084+0000 7f761b848640 1 -- 172.21.15.55:0/2076616153 shutdown_connections 2023-07-06T21:42:17.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.084+0000 7f761b848640 1 --2- 172.21.15.55:0/2076616153 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f75f80662b0 0x7f75f8068760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.084+0000 7f761b848640 1 --2- 172.21.15.55:0/2076616153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76140c9530 0x7f761415a770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.084+0000 7f761b848640 1 --2- 172.21.15.55:0/2076616153 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7614150650 0x7f761414ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.084+0000 7f761b848640 1 --2- 172.21.15.55:0/2076616153 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76000039b0 0x7f7614150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.084+0000 7f761b848640 1 -- 172.21.15.55:0/2076616153 >> 172.21.15.55:0/2076616153 conn(0x7f76140ceee0 msgr2=0x7f76140cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:17.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.084+0000 7f761b848640 1 -- 172.21.15.55:0/2076616153 shutdown_connections 2023-07-06T21:42:17.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.084+0000 7f761b848640 1 -- 172.21.15.55:0/2076616153 wait complete. 2023-07-06T21:42:17.509 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T21:42:10.854280+0000', 'modified': '2023-07-06T21:42:15.295705+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6836/1421414378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 1421414378}, {'type': 'v1', 'addr': '172.21.15.55:6836', 'nonce': 1421414378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-07-06T21:42:17.510 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T21:42:17.510 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-06T21:42:17.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcde759e640 1 Processor -- start 2023-07-06T21:42:17.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcde759e640 1 -- start start 2023-07-06T21:42:17.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcde759e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcde80b1250 0x7fcde815f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcde759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcde80d0630 0x7fcde815f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcde759e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde80cc740 con 0x7fcde815fe00 2023-07-06T21:42:17.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcde759e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde8160240 con 0x7fcde80d0630 2023-07-06T21:42:17.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcde759e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde80ccc90 con 0x7fcde80b1250 2023-07-06T21:42:17.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcddffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcde80d0630 0x7fcde815f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcddffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcde80d0630 0x7fcde815f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43726/0 (socket says 172.21.15.55:43726) 2023-07-06T21:42:17.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcddffff640 1 -- 172.21.15.55:0/3219520368 learned_addr learned my addr 172.21.15.55:0/3219520368 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:17.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcde659c640 1 --2- 172.21.15.55:0/3219520368 >> v2:172.21.15.138:3300/0 conn(0x7fcde80b1250 0x7fcde815f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcddffff640 1 -- 172.21.15.55:0/3219520368 >> v2:172.21.15.138:3300/0 conn(0x7fcde80b1250 msgr2=0x7fcde815f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:17.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcddffff640 1 --2- 172.21.15.55:0/3219520368 >> v2:172.21.15.138:3300/0 conn(0x7fcde80b1250 0x7fcde815f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcddffff640 1 -- 172.21.15.55:0/3219520368 >> v1:172.21.15.55:6789/0 conn(0x7fcde815fe00 legacy=0x7fcde80b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcddffff640 1 -- 172.21.15.55:0/3219520368 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde80d1d10 con 0x7fcde80d0630 2023-07-06T21:42:17.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.656+0000 7fcde5d9b640 1 -- 172.21.15.55:0/3219520368 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297199899 0 0) 0x7fcde80cc740 con 0x7fcde815fe00 2023-07-06T21:42:17.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.660+0000 7fcddffff640 1 --2- 172.21.15.55:0/3219520368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80d0630 0x7fcde815f8c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcde808a100 tx=0x7fcdd001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01bcc2ba1870f80 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:17.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.660+0000 7fcde5d9b640 1 -- 172.21.15.55:0/3219520368 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00ab5f0 con 0x7fcde80d0630 2023-07-06T21:42:17.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.660+0000 7fcde5d9b640 1 -- 172.21.15.55:0/3219520368 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd00ab750 con 0x7fcde80d0630 2023-07-06T21:42:17.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.660+0000 7fcde5d9b640 1 -- 172.21.15.55:0/3219520368 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00abae0 con 0x7fcde80d0630 2023-07-06T21:42:17.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.660+0000 7fcde759e640 1 -- 172.21.15.55:0/3219520368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80d0630 msgr2=0x7fcde815f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.660+0000 7fcde759e640 1 --2- 172.21.15.55:0/3219520368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80d0630 0x7fcde815f8c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcde808a100 tx=0x7fcdd001c500 comp rx=0 tx=0).stop 2023-07-06T21:42:17.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.660+0000 7fcde759e640 1 -- 172.21.15.55:0/3219520368 shutdown_connections 2023-07-06T21:42:17.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.660+0000 7fcde759e640 1 --2- 172.21.15.55:0/3219520368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80d0630 0x7fcde815f8c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.660+0000 7fcde759e640 1 --2- 172.21.15.55:0/3219520368 >> v2:172.21.15.138:3300/0 conn(0x7fcde80b1250 0x7fcde815f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.660+0000 7fcde759e640 1 -- 172.21.15.55:0/3219520368 >> 172.21.15.55:0/3219520368 conn(0x7fcde80b3b60 msgr2=0x7fcde80b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:17.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.660+0000 7fcde759e640 1 -- 172.21.15.55:0/3219520368 shutdown_connections 2023-07-06T21:42:17.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.660+0000 7fcde759e640 1 -- 172.21.15.55:0/3219520368 wait complete. 2023-07-06T21:42:17.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcde759e640 1 Processor -- start 2023-07-06T21:42:17.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcde759e640 1 -- start start 2023-07-06T21:42:17.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcde759e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcde80b1250 0x7fcde8151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcde759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80d0630 0x7fcde80c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcde759e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcde815fe00 0x7fcde80b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcde759e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde80b6e20 con 0x7fcde80d0630 2023-07-06T21:42:17.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcde759e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde80b7100 con 0x7fcde80b1250 2023-07-06T21:42:17.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcde759e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde80b73e0 con 0x7fcde815fe00 2023-07-06T21:42:17.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcddffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80d0630 0x7fcde80c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcddffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80d0630 0x7fcde80c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43742/0 (socket says 172.21.15.55:43742) 2023-07-06T21:42:17.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcddffff640 1 -- 172.21.15.55:0/4051070694 learned_addr learned my addr 172.21.15.55:0/4051070694 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:17.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcde6d9d640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcde815fe00 0x7fcde80b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcde659c640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcde80b1250 0x7fcde8151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcddffff640 1 -- 172.21.15.55:0/4051070694 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcde815fe00 msgr2=0x7fcde80b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcddffff640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcde815fe00 0x7fcde80b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcddffff640 1 -- 172.21.15.55:0/4051070694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcde80b1250 msgr2=0x7fcde8151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcddffff640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcde80b1250 0x7fcde8151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcddffff640 1 -- 172.21.15.55:0/4051070694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd00094d0 con 0x7fcde80d0630 2023-07-06T21:42:17.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcde659c640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcde80b1250 0x7fcde8151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:17.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcde6d9d640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcde815fe00 0x7fcde80b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:17.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcddffff640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80d0630 0x7fcde80c9120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcdd001abb0 tx=0x7fcdd001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:17.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcddeffd640 1 -- 172.21.15.55:0/4051070694 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00abcd0 con 0x7fcde80d0630 2023-07-06T21:42:17.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcddeffd640 1 -- 172.21.15.55:0/4051070694 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd00b8070 con 0x7fcde80d0630 2023-07-06T21:42:17.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcddeffd640 1 -- 172.21.15.55:0/4051070694 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0004220 con 0x7fcde80d0630 2023-07-06T21:42:17.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcde759e640 1 -- 172.21.15.55:0/4051070694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde80c7290 con 0x7fcde80d0630 2023-07-06T21:42:17.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.664+0000 7fcde759e640 1 -- 172.21.15.55:0/4051070694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde8151da0 con 0x7fcde80d0630 2023-07-06T21:42:17.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.668+0000 7fcddeffd640 1 -- 172.21.15.55:0/4051070694 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcdd0004380 con 0x7fcde80d0630 2023-07-06T21:42:17.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.668+0000 7fcddeffd640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcdc80662b0 0x7fcdc8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.668+0000 7fcddeffd640 1 -- 172.21.15.55:0/4051070694 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcdd00a8050 con 0x7fcde80d0630 2023-07-06T21:42:17.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.668+0000 7fcdf0126000 1 Processor -- start 2023-07-06T21:42:17.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.668+0000 7fcde659c640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcdc80662b0 0x7fcdc8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.668+0000 7fcdf0126000 1 -- start start 2023-07-06T21:42:17.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.668+0000 7fcde659c640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcdc80662b0 0x7fcdc8068760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80097a0 tx=0x7fcdd8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:17.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 0x559f671ecb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ed050 0x559f671a2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671a2d80 0x559f671a3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f6706aac0 con 0x559f671ed050 2023-07-06T21:42:17.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f66fa4840 con 0x559f671ec740 2023-07-06T21:42:17.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f66ff82e0 con 0x559f671a2d80 2023-07-06T21:42:17.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcddffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ed050 0x559f671a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcddffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ed050 0x559f671a2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43756/0 (socket says 172.21.15.55:43756) 2023-07-06T21:42:17.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcddffff640 1 -- 172.21.15.55:0/764526168 learned_addr learned my addr 172.21.15.55:0/764526168 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:17.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcde659c640 1 --2- 172.21.15.55:0/764526168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 0x559f671ecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcde6d9d640 1 --2- 172.21.15.55:0/764526168 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671a2d80 0x559f671a3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcddffff640 1 -- 172.21.15.55:0/764526168 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671a2d80 msgr2=0x559f671a3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:17.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcddffff640 1 --2- 172.21.15.55:0/764526168 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671a2d80 0x559f671a3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcddffff640 1 -- 172.21.15.55:0/764526168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 msgr2=0x559f671ecb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:17.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcddffff640 1 --2- 172.21.15.55:0/764526168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 0x559f671ecb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcddffff640 1 -- 172.21.15.55:0/764526168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f66ced890 con 0x559f671ed050 2023-07-06T21:42:17.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcde6d9d640 1 --2- 172.21.15.55:0/764526168 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671a2d80 0x559f671a3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:17.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcddffff640 1 --2- 172.21.15.55:0/764526168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ed050 0x559f671a2840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00eec80 tx=0x7fcdd00abf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b095c439aede23b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:17.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdc7fff640 1 -- 172.21.15.55:0/764526168 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00f72d0 con 0x559f671ed050 2023-07-06T21:42:17.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdc7fff640 1 -- 172.21.15.55:0/764526168 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd00ed320 con 0x559f671ed050 2023-07-06T21:42:17.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdc7fff640 1 -- 172.21.15.55:0/764526168 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00f6e40 con 0x559f671ed050 2023-07-06T21:42:17.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 -- 172.21.15.55:0/764526168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ed050 msgr2=0x559f671a2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 --2- 172.21.15.55:0/764526168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ed050 0x559f671a2840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00eec80 tx=0x7fcdd00abf70 comp rx=0 tx=0).stop 2023-07-06T21:42:17.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 -- 172.21.15.55:0/764526168 shutdown_connections 2023-07-06T21:42:17.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 --2- 172.21.15.55:0/764526168 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671a2d80 0x559f671a3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 --2- 172.21.15.55:0/764526168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ed050 0x559f671a2840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 --2- 172.21.15.55:0/764526168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 0x559f671ecb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 -- 172.21.15.55:0/764526168 >> 172.21.15.55:0/764526168 conn(0x559f6719a800 msgr2=0x559f671a9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:17.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 -- 172.21.15.55:0/764526168 shutdown_connections 2023-07-06T21:42:17.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 -- 172.21.15.55:0/764526168 wait complete. 2023-07-06T21:42:17.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 -- start start 2023-07-06T21:42:17.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.672+0000 7fcdf0126000 1 Processor -- start 2023-07-06T21:42:17.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671a2d80 0x559f671a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ec740 0x559f671a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671ed050 0x559f671ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f66ff1380 con 0x559f671ec740 2023-07-06T21:42:17.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f66fadae0 con 0x559f671a2d80 2023-07-06T21:42:17.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f66fad780 con 0x559f671ed050 2023-07-06T21:42:17.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 10 client.0 _ll_register_callbacks cb 0x559f6718ee30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T21:42:17.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcddffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ec740 0x559f671a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcddffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ec740 0x559f671a89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43768/0 (socket says 172.21.15.55:43768) 2023-07-06T21:42:17.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcddffff640 1 -- 172.21.15.55:0/2499873408 learned_addr learned my addr 172.21.15.55:0/2499873408 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:17.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcde659c640 1 --2- 172.21.15.55:0/2499873408 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671a2d80 0x559f671a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcde6d9d640 1 --2- 172.21.15.55:0/2499873408 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671ed050 0x559f671ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcddffff640 1 -- 172.21.15.55:0/2499873408 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671ed050 msgr2=0x559f671ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:17.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcddffff640 1 --2- 172.21.15.55:0/2499873408 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671ed050 0x559f671ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcddffff640 1 -- 172.21.15.55:0/2499873408 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671a2d80 msgr2=0x559f671a8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:17.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcddffff640 1 --2- 172.21.15.55:0/2499873408 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671a2d80 0x559f671a8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcddffff640 1 -- 172.21.15.55:0/2499873408 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde8151da0 con 0x559f671ec740 2023-07-06T21:42:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcddffff640 1 --2- 172.21.15.55:0/2499873408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ec740 0x559f671a89d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcdd001c9e0 tx=0x7fcdd0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5845474af7b1034 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T21:42:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdc57fa640 1 -- 172.21.15.55:0/2499873408 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00f6e40 con 0x559f671ec740 2023-07-06T21:42:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdc57fa640 1 -- 172.21.15.55:0/2499873408 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcdd00f6fa0 con 0x559f671ec740 2023-07-06T21:42:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 1 -- 172.21.15.55:0/2499873408 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f66fb8a20 con 0x559f671ec740 2023-07-06T21:42:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdc57fa640 1 -- 172.21.15.55:0/2499873408 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdd0102b80 con 0x559f671ec740 2023-07-06T21:42:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 10 client.4443 fetch_fsmap learned FSMap version 7 2023-07-06T21:42:17.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 1 -- 172.21.15.55:0/2499873408 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x559f66fb5d10 con 0x559f671ec740 2023-07-06T21:42:17.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdc57fa640 1 -- 172.21.15.55:0/2499873408 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f66fb8a20 con 0x559f671ec740 2023-07-06T21:42:17.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdc57fa640 1 -- 172.21.15.55:0/2499873408 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fcdd00bc070 con 0x559f671ec740 2023-07-06T21:42:17.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 10 client.4443 fetch_fsmap finished waiting for FSMap version 7 2023-07-06T21:42:17.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 10 client.4443 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-06T21:42:17.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 20 client.4443 populate_metadata read hostname 'smithi055' 2023-07-06T21:42:17.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 1 --2- 172.21.15.55:0/2499873408 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x559f671fb7b0 0x559f671fdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 4 client.4443 mds_command: new command op to 4297 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T21:42:17.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdf0126000 1 -- 172.21.15.55:0/2499873408 --> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f67020710 con 0x559f671fb7b0 2023-07-06T21:42:17.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcde659c640 1 --2- 172.21.15.55:0/2499873408 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x559f671fb7b0 0x559f671fdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcde659c640 1 --2- 172.21.15.55:0/2499873408 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x559f671fb7b0 0x559f671fdb90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1c26b4e5f1ef3b8 server_cookie=6c9c2ad3cf1094ef in_seq=0 out_seq=0 2023-07-06T21:42:17.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.676+0000 7fcdc57fa640 10 client.4443 ms_handle_connect on v2:172.21.15.55:6834/1421414378 2023-07-06T21:42:17.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdc57fa640 1 -- 172.21.15.55:0/2499873408 <== mds.0 v2:172.21.15.55:6834/1421414378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559f67020710 con 0x559f671fb7b0 2023-07-06T21:42:17.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdc57fa640 10 client.4443 handle_command_reply: tid=0 2023-07-06T21:42:17.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdf0126000 1 client.4443 shutdown 2023-07-06T21:42:17.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdf0126000 1 -- 172.21.15.55:0/2499873408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ec740 msgr2=0x559f671a89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdf0126000 1 --2- 172.21.15.55:0/2499873408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ec740 0x559f671a89d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcdd001c9e0 tx=0x7fcdd0000bd0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdf0126000 1 -- 172.21.15.55:0/2499873408 shutdown_connections 2023-07-06T21:42:17.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdf0126000 1 --2- 172.21.15.55:0/2499873408 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671ed050 0x559f671ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdf0126000 1 --2- 172.21.15.55:0/2499873408 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x559f671fb7b0 0x559f671fdb90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdf0126000 1 --2- 172.21.15.55:0/2499873408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ec740 0x559f671a89d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdf0126000 1 --2- 172.21.15.55:0/2499873408 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671a2d80 0x559f671a8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdc57fa640 0 client.4443 ms_handle_reset on v2:172.21.15.55:6834/1421414378 2023-07-06T21:42:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdf0126000 1 -- 172.21.15.55:0/2499873408 >> 172.21.15.55:0/2499873408 conn(0x559f6719a800 msgr2=0x559f671a1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdf0126000 1 -- 172.21.15.55:0/2499873408 shutdown_connections 2023-07-06T21:42:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdf0126000 1 -- 172.21.15.55:0/2499873408 wait complete. 2023-07-06T21:42:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.680+0000 7fcdf0126000 20 client.4443 trim_cache size 0 max 16384 2023-07-06T21:42:17.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 Processor -- start 2023-07-06T21:42:17.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 -- start start 2023-07-06T21:42:17.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671a2d80 0x559f671a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 0x559f671a2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ed050 0x559f671fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f66cae940 con 0x559f671ed050 2023-07-06T21:42:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f672001f0 con 0x559f671ec740 2023-07-06T21:42:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f66f8ea80 con 0x559f671a2d80 2023-07-06T21:42:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcde6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ed050 0x559f671fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcde6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ed050 0x559f671fbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43784/0 (socket says 172.21.15.55:43784) 2023-07-06T21:42:17.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcde6d9d640 1 -- 172.21.15.55:0/2979472750 learned_addr learned my addr 172.21.15.55:0/2979472750 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:17.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcde6d9d640 1 -- 172.21.15.55:0/2979472750 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671a2d80 msgr2=0x559f671a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:17.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcde6d9d640 1 --2- 172.21.15.55:0/2979472750 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671a2d80 0x559f671a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcde6d9d640 1 -- 172.21.15.55:0/2979472750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 msgr2=0x559f671a2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:17.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcde6d9d640 1 --2- 172.21.15.55:0/2979472750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 0x559f671a2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcde6d9d640 1 -- 172.21.15.55:0/2979472750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f671a5450 con 0x559f671ed050 2023-07-06T21:42:17.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcde6d9d640 1 --2- 172.21.15.55:0/2979472750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ed050 0x559f671fbb80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcde0007fd0 tx=0x7fcde0005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481be3801d7b9390 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:17.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcddcff9640 1 -- 172.21.15.55:0/2979472750 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0001e30 con 0x559f671ed050 2023-07-06T21:42:17.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcddcff9640 1 -- 172.21.15.55:0/2979472750 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde000d030 con 0x559f671ed050 2023-07-06T21:42:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcddcff9640 1 -- 172.21.15.55:0/2979472750 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0015470 con 0x559f671ed050 2023-07-06T21:42:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 -- 172.21.15.55:0/2979472750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ed050 msgr2=0x559f671fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 --2- 172.21.15.55:0/2979472750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ed050 0x559f671fbb80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcde0007fd0 tx=0x7fcde0005670 comp rx=0 tx=0).stop 2023-07-06T21:42:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 -- 172.21.15.55:0/2979472750 shutdown_connections 2023-07-06T21:42:17.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 --2- 172.21.15.55:0/2979472750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671ed050 0x559f671fbb80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 --2- 172.21.15.55:0/2979472750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 0x559f671a2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 --2- 172.21.15.55:0/2979472750 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671a2d80 0x559f671a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 -- 172.21.15.55:0/2979472750 >> 172.21.15.55:0/2979472750 conn(0x559f6719a800 msgr2=0x559f671a1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:17.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 -- 172.21.15.55:0/2979472750 shutdown_connections 2023-07-06T21:42:17.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.696+0000 7fcdf0126000 1 -- 172.21.15.55:0/2979472750 wait complete. 2023-07-06T21:42:17.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 1 -- start start 2023-07-06T21:42:17.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 1 Processor -- start 2023-07-06T21:42:17.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671a2d80 0x559f671ff280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 0x559f67206ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671ed050 0x559f67207530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f66fc0320 con 0x559f671a2d80 2023-07-06T21:42:17.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f671a9d60 con 0x559f671ec740 2023-07-06T21:42:17.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f671a7b30 con 0x559f671ed050 2023-07-06T21:42:17.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 10 client.0 _ll_register_callbacks cb 0x559f66fb57f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T21:42:17.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcde659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671a2d80 0x559f671ff280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcde659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671a2d80 0x559f671ff280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43794/0 (socket says 172.21.15.55:43794) 2023-07-06T21:42:17.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcde659c640 1 -- 172.21.15.55:0/1934865275 learned_addr learned my addr 172.21.15.55:0/1934865275 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:17.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcde659c640 1 -- 172.21.15.55:0/1934865275 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671ed050 msgr2=0x559f67207530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:17.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcde659c640 1 --2- 172.21.15.55:0/1934865275 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671ed050 0x559f67207530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcddffff640 1 --2- 172.21.15.55:0/1934865275 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 0x559f67206ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcde659c640 1 -- 172.21.15.55:0/1934865275 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 msgr2=0x559f67206ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:17.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcde659c640 1 --2- 172.21.15.55:0/1934865275 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 0x559f67206ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcde659c640 1 -- 172.21.15.55:0/1934865275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde0003e30 con 0x559f671a2d80 2023-07-06T21:42:17.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcddffff640 1 --2- 172.21.15.55:0/1934865275 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 0x559f67206ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:17.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcde659c640 1 --2- 172.21.15.55:0/1934865275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671a2d80 0x559f671ff280 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x559f670715b0 tx=0x7fcdd80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602325dd468ab3bd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:17.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T21:42:17.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdc57fa640 1 -- 172.21.15.55:0/1934865275 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd801d040 con 0x559f671a2d80 2023-07-06T21:42:17.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdc57fa640 1 -- 172.21.15.55:0/1934865275 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcdd80059a0 con 0x559f671a2d80 2023-07-06T21:42:17.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 1 -- 172.21.15.55:0/1934865275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f671a66e0 con 0x559f671a2d80 2023-07-06T21:42:17.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdc57fa640 1 -- 172.21.15.55:0/1934865275 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdd80270e0 con 0x559f671a2d80 2023-07-06T21:42:17.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 10 client.4449 fetch_fsmap learned FSMap version 7 2023-07-06T21:42:17.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 1 -- 172.21.15.55:0/1934865275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x559f66f9bfa0 con 0x559f671a2d80 2023-07-06T21:42:17.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdc57fa640 1 -- 172.21.15.55:0/1934865275 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f671a66e0 con 0x559f671a2d80 2023-07-06T21:42:17.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdc57fa640 1 -- 172.21.15.55:0/1934865275 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fcdd8027240 con 0x559f671a2d80 2023-07-06T21:42:17.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 10 client.4449 fetch_fsmap finished waiting for FSMap version 7 2023-07-06T21:42:17.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 10 client.4449 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-06T21:42:17.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 20 client.4449 populate_metadata read hostname 'smithi055' 2023-07-06T21:42:17.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 1 --2- 172.21.15.55:0/1934865275 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x559f6724a420 0x559f6724a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 4 client.4449 mds_command: new command op to 4297 tid=0[{"prefix": "status"}] 2023-07-06T21:42:17.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdf0126000 1 -- 172.21.15.55:0/1934865275 --> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559f66fefcd0 con 0x559f6724a420 2023-07-06T21:42:17.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcddffff640 1 --2- 172.21.15.55:0/1934865275 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x559f6724a420 0x559f6724a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcddffff640 1 --2- 172.21.15.55:0/1934865275 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x559f6724a420 0x559f6724a7f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91939e369ea4001f server_cookie=9e8ee7de75f85000 in_seq=0 out_seq=0 2023-07-06T21:42:17.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.700+0000 7fcdc57fa640 10 client.4449 ms_handle_connect on v2:172.21.15.55:6834/1421414378 2023-07-06T21:42:17.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdc57fa640 1 -- 172.21.15.55:0/1934865275 <== mds.0 v2:172.21.15.55:6834/1421414378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x559f66fefcd0 con 0x559f6724a420 2023-07-06T21:42:17.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdc57fa640 10 client.4449 handle_command_reply: tid=0 2023-07-06T21:42:17.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdf0126000 1 client.4449 shutdown 2023-07-06T21:42:17.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdf0126000 1 -- 172.21.15.55:0/1934865275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671a2d80 msgr2=0x559f671ff280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdf0126000 1 --2- 172.21.15.55:0/1934865275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671a2d80 0x559f671ff280 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x559f670715b0 tx=0x7fcdd80046d0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdf0126000 1 -- 172.21.15.55:0/1934865275 shutdown_connections 2023-07-06T21:42:17.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdf0126000 1 --2- 172.21.15.55:0/1934865275 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559f671ed050 0x559f67207530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdf0126000 1 --2- 172.21.15.55:0/1934865275 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f671ec740 0x559f67206ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdf0126000 1 --2- 172.21.15.55:0/1934865275 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x559f6724a420 0x559f6724a7f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdf0126000 1 --2- 172.21.15.55:0/1934865275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559f671a2d80 0x559f671ff280 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdf0126000 1 -- 172.21.15.55:0/1934865275 >> 172.21.15.55:0/1934865275 conn(0x559f6719a800 msgr2=0x559f671a1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:17.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdc57fa640 0 client.4449 ms_handle_reset on v2:172.21.15.55:6834/1421414378 2023-07-06T21:42:17.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdf0126000 1 -- 172.21.15.55:0/1934865275 shutdown_connections 2023-07-06T21:42:17.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdf0126000 1 -- 172.21.15.55:0/1934865275 wait complete. 2023-07-06T21:42:17.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcdf0126000 20 client.4449 trim_cache size 0 max 16384 2023-07-06T21:42:17.729 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T21:42:17.729 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c64f3ef1-e769-47b3-ae15-a714e4e7c4f7", 2023-07-06T21:42:17.730 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-07-06T21:42:17.730 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 4297, 2023-07-06T21:42:17.731 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-07-06T21:42:17.731 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-07-06T21:42:17.731 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-07-06T21:42:17.732 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 6.8469502379999998, 2023-07-06T21:42:17.732 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 7, 2023-07-06T21:42:17.732 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 27, 2023-07-06T21:42:17.732 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 26, 2023-07-06T21:42:17.733 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 12.157025903999999 2023-07-06T21:42:17.733 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T21:42:17.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcde759e640 1 -- 172.21.15.55:0/4051070694 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcdc80662b0 msgr2=0x7fcdc8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcde759e640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcdc80662b0 0x7fcdc8068760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80097a0 tx=0x7fcdd8008040 comp rx=0 tx=0).stop 2023-07-06T21:42:17.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcde759e640 1 -- 172.21.15.55:0/4051070694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80d0630 msgr2=0x7fcde80c9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcde759e640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80d0630 0x7fcde80c9120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcdd001abb0 tx=0x7fcdd001ad40 comp rx=0 tx=0).stop 2023-07-06T21:42:17.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcde759e640 1 -- 172.21.15.55:0/4051070694 shutdown_connections 2023-07-06T21:42:17.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcde759e640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcdc80662b0 0x7fcdc8068760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcde759e640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcde815fe00 0x7fcde80b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcde759e640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80d0630 0x7fcde80c9120 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcde759e640 1 --2- 172.21.15.55:0/4051070694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcde80b1250 0x7fcde8151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcde759e640 1 -- 172.21.15.55:0/4051070694 >> 172.21.15.55:0/4051070694 conn(0x7fcde80b3b60 msgr2=0x7fcde815f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcde759e640 1 -- 172.21.15.55:0/4051070694 shutdown_connections 2023-07-06T21:42:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.704+0000 7fcde759e640 1 -- 172.21.15.55:0/4051070694 wait complete. 2023-07-06T21:42:17.740 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-06T21:42:17.741 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-06T21:42:17.742 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T21:42:17.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.879+0000 7f7fbb46d640 1 Processor -- start 2023-07-06T21:42:17.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.879+0000 7f7fbb46d640 1 -- start start 2023-07-06T21:42:17.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fbb46d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fb40cb4a0 0x7f7fb415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fbb46d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7fb415f740 0x7f7fb40ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fbb46d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7fb40cbc70 0x7f7fb40cc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fbb46d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb40b5b50 con 0x7f7fb40cbc70 2023-07-06T21:42:17.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fbb46d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb415d130 con 0x7f7fb415f740 2023-07-06T21:42:17.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fbb46d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40cc5b0 con 0x7f7fb40cb4a0 2023-07-06T21:42:17.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fb9a0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7fb40cbc70 0x7f7fb40cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fb9a0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7fb40cbc70 0x7f7fb40cc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43796/0 (socket says 172.21.15.55:43796) 2023-07-06T21:42:17.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fb9a0a640 1 -- 172.21.15.55:0/2622840062 learned_addr learned my addr 172.21.15.55:0/2622840062 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:17.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fb9209640 1 --2- 172.21.15.55:0/2622840062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fb40cb4a0 0x7f7fb415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fb8a08640 1 --2- 172.21.15.55:0/2622840062 >> v2:172.21.15.138:3300/0 conn(0x7f7fb415f740 0x7f7fb40ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fb9a0a640 1 -- 172.21.15.55:0/2622840062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fb40cb4a0 msgr2=0x7f7fb415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:17.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fb9a0a640 1 --2- 172.21.15.55:0/2622840062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fb40cb4a0 0x7f7fb415cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fb9a0a640 1 -- 172.21.15.55:0/2622840062 >> v2:172.21.15.138:3300/0 conn(0x7f7fb415f740 msgr2=0x7f7fb40ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:17.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fb9a0a640 1 --2- 172.21.15.55:0/2622840062 >> v2:172.21.15.138:3300/0 conn(0x7f7fb415f740 0x7f7fb40ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.883+0000 7f7fb9a0a640 1 -- 172.21.15.55:0/2622840062 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb40cc8e0 con 0x7f7fb40cbc70 2023-07-06T21:42:17.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fb9a0a640 1 --2- 172.21.15.55:0/2622840062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fb40cbc70 0x7f7fb40cc070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40cdbc0 tx=0x7f7fac01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca49e8f7cb975e07 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:17.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fabfff640 1 -- 172.21.15.55:0/2622840062 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac0a5740 con 0x7f7fb40cbc70 2023-07-06T21:42:17.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fabfff640 1 -- 172.21.15.55:0/2622840062 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac0a58a0 con 0x7f7fb40cbc70 2023-07-06T21:42:17.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fabfff640 1 -- 172.21.15.55:0/2622840062 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac0a5c30 con 0x7f7fb40cbc70 2023-07-06T21:42:17.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fbb46d640 1 -- 172.21.15.55:0/2622840062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fb40cbc70 msgr2=0x7f7fb40cc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fbb46d640 1 --2- 172.21.15.55:0/2622840062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fb40cbc70 0x7f7fb40cc070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40cdbc0 tx=0x7f7fac01c9d0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fbb46d640 1 -- 172.21.15.55:0/2622840062 shutdown_connections 2023-07-06T21:42:17.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fbb46d640 1 --2- 172.21.15.55:0/2622840062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fb40cbc70 0x7f7fb40cc070 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fbb46d640 1 --2- 172.21.15.55:0/2622840062 >> v2:172.21.15.138:3300/0 conn(0x7f7fb415f740 0x7f7fb40ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fbb46d640 1 --2- 172.21.15.55:0/2622840062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fb40cb4a0 0x7f7fb415cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fbb46d640 1 -- 172.21.15.55:0/2622840062 >> 172.21.15.55:0/2622840062 conn(0x7f7fb406ee80 msgr2=0x7f7fb406f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:17.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fbb46d640 1 -- 172.21.15.55:0/2622840062 shutdown_connections 2023-07-06T21:42:17.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fbb46d640 1 -- 172.21.15.55:0/2622840062 wait complete. 2023-07-06T21:42:17.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fbb46d640 1 Processor -- start 2023-07-06T21:42:17.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.887+0000 7f7fbb46d640 1 -- start start 2023-07-06T21:42:17.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fbb46d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fb40cb4a0 0x7f7fb40c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fbb46d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fb40cbc70 0x7f7fb4147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fbb46d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fb415f740 0x7f7fb41f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fbb46d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb41f54a0 con 0x7f7fb415f740 2023-07-06T21:42:17.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fbb46d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40c7780 con 0x7f7fb40cb4a0 2023-07-06T21:42:17.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fbb46d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb41f5680 con 0x7f7fb40cbc70 2023-07-06T21:42:17.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fb9a0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fb415f740 0x7f7fb41f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fb9209640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fb40cb4a0 0x7f7fb40c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fb9209640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fb40cb4a0 0x7f7fb40c71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:46572/0 (socket says 172.21.15.55:46572) 2023-07-06T21:42:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fb9209640 1 -- 172.21.15.55:0/4166479419 learned_addr learned my addr 172.21.15.55:0/4166479419 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fb8a08640 1 --2- 172.21.15.55:0/4166479419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fb40cbc70 0x7f7fb4147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fb9209640 1 -- 172.21.15.55:0/4166479419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fb40cbc70 msgr2=0x7f7fb4147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fb9209640 1 --2- 172.21.15.55:0/4166479419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fb40cbc70 0x7f7fb4147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fb9209640 1 -- 172.21.15.55:0/4166479419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fb415f740 msgr2=0x7f7fb41f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:17.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fb9209640 1 --2- 172.21.15.55:0/4166479419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fb415f740 0x7f7fb41f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:17.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fb9209640 1 -- 172.21.15.55:0/4166479419 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac009b30 con 0x7f7fb40cb4a0 2023-07-06T21:42:17.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fb9209640 1 --2- 172.21.15.55:0/4166479419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fb40cb4a0 0x7f7fb40c71a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000d830 tx=0x7f7fb000dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:17.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fa9ffb640 1 -- 172.21.15.55:0/4166479419 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb00096a0 con 0x7f7fb40cb4a0 2023-07-06T21:42:17.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fa9ffb640 1 -- 172.21.15.55:0/4166479419 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb0009800 con 0x7f7fb40cb4a0 2023-07-06T21:42:17.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fa9ffb640 1 -- 172.21.15.55:0/4166479419 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0009b70 con 0x7f7fb40cb4a0 2023-07-06T21:42:17.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fbb46d640 1 -- 172.21.15.55:0/4166479419 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb41f5960 con 0x7f7fb40cb4a0 2023-07-06T21:42:17.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fbb46d640 1 -- 172.21.15.55:0/4166479419 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb41f5110 con 0x7f7fb40cb4a0 2023-07-06T21:42:17.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.891+0000 7f7fbb46d640 1 -- 172.21.15.55:0/4166479419 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb4066d60 con 0x7f7fb40cb4a0 2023-07-06T21:42:17.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.895+0000 7f7fa9ffb640 1 -- 172.21.15.55:0/4166479419 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fb0014410 con 0x7f7fb40cb4a0 2023-07-06T21:42:17.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.895+0000 7f7fa9ffb640 1 --2- 172.21.15.55:0/4166479419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7f98066280 0x7f7f98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:17.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.895+0000 7f7fa9ffb640 1 -- 172.21.15.55:0/4166479419 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7fb0084f40 con 0x7f7fb40cb4a0 2023-07-06T21:42:17.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.895+0000 7f7fb8a08640 1 --2- 172.21.15.55:0/4166479419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7f98066280 0x7f7f98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:17.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.895+0000 7f7fb8a08640 1 --2- 172.21.15.55:0/4166479419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7f98066280 0x7f7f98068730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7fb415b7a0 tx=0x7f7fa4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:17.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:17.899+0000 7f7fa9ffb640 1 -- 172.21.15.55:0/4166479419 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fb0052160 con 0x7f7fb40cb4a0 2023-07-06T21:42:18.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:18.091+0000 7f7fbb46d640 1 -- 172.21.15.55:0/4166479419 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7fb40cee60 con 0x7f7fb40cb4a0 2023-07-06T21:42:18.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:18.095+0000 7f7fa9ffb640 1 -- 172.21.15.55:0/4166479419 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7fb0055780 con 0x7f7fb40cb4a0 2023-07-06T21:42:18.100 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-06T21:42:18.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:18.095+0000 7f7fbb46d640 1 -- 172.21.15.55:0/4166479419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7f98066280 msgr2=0x7f7f98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:18.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:18.095+0000 7f7fbb46d640 1 --2- 172.21.15.55:0/4166479419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7f98066280 0x7f7f98068730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7fb415b7a0 tx=0x7f7fa4008040 comp rx=0 tx=0).stop 2023-07-06T21:42:18.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:18.095+0000 7f7fbb46d640 1 -- 172.21.15.55:0/4166479419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fb40cb4a0 msgr2=0x7f7fb40c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:18.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:18.095+0000 7f7fbb46d640 1 --2- 172.21.15.55:0/4166479419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fb40cb4a0 0x7f7fb40c71a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000d830 tx=0x7f7fb000dcf0 comp rx=0 tx=0).stop 2023-07-06T21:42:18.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:18.095+0000 7f7fbb46d640 1 -- 172.21.15.55:0/4166479419 shutdown_connections 2023-07-06T21:42:18.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:18.095+0000 7f7fbb46d640 1 --2- 172.21.15.55:0/4166479419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7f98066280 0x7f7f98068730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:18.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:18.095+0000 7f7fbb46d640 1 --2- 172.21.15.55:0/4166479419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fb415f740 0x7f7fb41f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:18.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:18.095+0000 7f7fbb46d640 1 --2- 172.21.15.55:0/4166479419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fb40cbc70 0x7f7fb4147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:18.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:18.095+0000 7f7fbb46d640 1 --2- 172.21.15.55:0/4166479419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fb40cb4a0 0x7f7fb40c71a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:18.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:18.095+0000 7f7fbb46d640 1 -- 172.21.15.55:0/4166479419 >> 172.21.15.55:0/4166479419 conn(0x7f7fb406ee80 msgr2=0x7f7fb4157e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:18.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:18.095+0000 7f7fbb46d640 1 -- 172.21.15.55:0/4166479419 shutdown_connections 2023-07-06T21:42:18.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:18.095+0000 7f7fbb46d640 1 -- 172.21.15.55:0/4166479419 wait complete. 2023-07-06T21:42:18.120 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T21:42:18.121 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T21:42:18.121 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-07-06T21:42:18.121 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-07-06T21:42:18.122 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-06T21:42:18.122 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T21:42:18.122 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-06T21:42:18.122 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T21:42:18.123 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-07-06T21:42:18.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:18.123 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-07-06T21:42:18.133 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T21:42:18.133 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T21:42:18.133 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T21:42:18.133 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:18.133 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T21:42:18.133 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:18.134 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:18.134 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:18.134 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-07-06T21:42:18.134 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:18.134 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:18.135 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-07-06T21:42:18.135 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T21:42:18.135 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:18.135 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-07-06T21:42:18.135 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-06T21:42:18.135 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42418sec preferred_lft 42418sec 2023-07-06T21:42:18.135 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-07-06T21:42:18.136 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:18.136 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:18.136 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:18.136 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-07-06T21:42:18.136 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T21:42:18.136 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:84:fe:b8:21 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:18.136 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T21:42:18.137 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:18.138 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-06T21:42:18.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:18.139 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:42:18.140 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:42:18.140 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add name ceph-brx type bridge 2023-07-06T21:42:18.141 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr flush dev ceph-brx 2023-07-06T21:42:18.141 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set ceph-brx up 2023-07-06T21:42:18.141 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-06T21:42:18.142 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:42:18.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:18.259 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T21:42:18.280 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-07-06T21:42:18.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:18.282 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-07-06T21:42:19.231 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-07-06T21:42:19.232 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T21:42:19.232 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-06T21:42:19.232 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T21:42:19.232 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-06T21:42:19.232 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T21:42:19.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:19.233 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:42:19.233 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:42:19.234 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T21:42:19.234 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T21:42:19.234 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T21:42:19.235 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:42:19.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:19.294 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T21:42:19.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:19.306 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2023-07-06T21:42:19.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:19.356 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:42:19.356 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:42:19.357 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-06T21:42:19.357 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-07-06T21:42:19.357 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:42:19.446 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-07-06T21:42:19.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:19.447 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:42:19.447 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:42:19.447 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-07-06T21:42:19.448 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-06T21:42:19.448 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-07-06T21:42:19.448 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-07-06T21:42:19.448 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-07-06T21:42:19.449 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:42:19.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:19.625 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:42:19.625 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:42:19.625 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-07-06T21:42:19.626 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.0 master ceph-brx 2023-07-06T21:42:19.626 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:42:19.669 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-07-06T21:42:19.670 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:42:19.670 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-07-06T21:42:19.723 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-07-06T21:42:19.723 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:42:19.724 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-07-06T21:42:19.775 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2023-07-06T21:42:19.839 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-06T21:42:19.840 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-06T21:42:19.901 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-06T21:42:19.902 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-06T21:42:19.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:19.904 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2023-07-06T21:42:19.957 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-06T21:42:19.958 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-07-06T21:42:20.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2023-07-06T21:42:20.022 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-06T21:42:20.023 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-06T21:42:20.091 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-06T21:42:20.093 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-06T21:42:20.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:20.094 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2023-07-06T21:42:20.112 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi055.stderr:2023-07-06T21:42:20.107+0000 7fc8d6244580 -1 init, newargv = 0x559353c617c0 newargc=15 2023-07-06T21:42:20.112 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi055.stderr:ceph-fuse[44068]: starting ceph client 2023-07-06T21:42:20.122 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi055.stderr:ceph-fuse[44068]: starting fuse 2023-07-06T21:42:21.222 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2023-07-06T21:42:21.248 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-06T21:42:21.250 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-06T21:42:21.312 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-06T21:42:21.313 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-06T21:42:21.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:21.314 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2023-07-06T21:42:21.371 INFO:teuthology.orchestra.run.smithi055.stdout:42 2023-07-06T21:42:21.371 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-06T21:42:21.372 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-06T21:42:21.372 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2023-07-06T21:42:21.373 DEBUG:teuthology.orchestra.run.smithi055:> import re 2023-07-06T21:42:21.373 DEBUG:teuthology.orchestra.run.smithi055:> import os 2023-07-06T21:42:21.373 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2023-07-06T21:42:21.374 DEBUG:teuthology.orchestra.run.smithi055:> 2023-07-06T21:42:21.374 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2023-07-06T21:42:21.374 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-07-06T21:42:21.374 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2023-07-06T21:42:21.375 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-07-06T21:42:21.375 DEBUG:teuthology.orchestra.run.smithi055:> 2023-07-06T21:42:21.375 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2023-07-06T21:42:21.375 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2023-07-06T21:42:21.376 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2023-07-06T21:42:21.376 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2023-07-06T21:42:21.376 DEBUG:teuthology.orchestra.run.smithi055:> 2023-07-06T21:42:21.377 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2023-07-06T21:42:21.377 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-06T21:42:21.377 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-06T21:42:21.377 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-06T21:42:21.378 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2023-07-06T21:42:21.378 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2023-07-06T21:42:21.378 DEBUG:teuthology.orchestra.run.smithi055:> return f 2023-07-06T21:42:21.378 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-06T21:42:21.379 DEBUG:teuthology.orchestra.run.smithi055:> 2023-07-06T21:42:21.379 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.admin")) 2023-07-06T21:42:21.379 DEBUG:teuthology.orchestra.run.smithi055:> ' 2023-07-06T21:42:21.503 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.admin.44068.asok 2023-07-06T21:42:21.686 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44068.asok 2023-07-06T21:42:21.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:21.686 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44068.asok status 2023-07-06T21:42:21.871 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T21:42:21.872 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2023-07-06T21:42:21.872 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "0a781ef0807ae9473fb1306ef07036226ca4f1a6", 2023-07-06T21:42:21.872 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.0.0-4488-g0a781ef0 (0a781ef0807ae9473fb1306ef07036226ca4f1a6) reef (dev)", 2023-07-06T21:42:21.872 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "admin", 2023-07-06T21:42:21.872 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2023-07-06T21:42:21.872 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-07-06T21:42:21.873 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "44068", 2023-07-06T21:42:21.873 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2023-07-06T21:42:21.873 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:42:21.873 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2023-07-06T21:42:21.873 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2023-07-06T21:42:21.873 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 4461, 2023-07-06T21:42:21.874 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2023-07-06T21:42:21.874 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2023-07-06T21:42:21.874 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2023-07-06T21:42:21.874 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 4461 2023-07-06T21:42:21.875 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:42:21.875 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2023-07-06T21:42:21.875 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2023-07-06T21:42:21.875 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2023-07-06T21:42:21.875 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 3942111174 2023-07-06T21:42:21.876 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:42:21.876 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:42:21.876 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2023-07-06T21:42:21.876 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2023-07-06T21:42:21.876 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2023-07-06T21:42:21.876 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 3942111174 2023-07-06T21:42:21.876 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:42:21.877 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.4461 192.168.0.1:0/3942111174", 2023-07-06T21:42:21.877 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/3942111174", 2023-07-06T21:42:21.877 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2023-07-06T21:42:21.877 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 7, 2023-07-06T21:42:21.877 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 27, 2023-07-06T21:42:21.877 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2023-07-06T21:42:21.877 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2023-07-06T21:42:21.877 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2023-07-06T21:42:21.878 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T21:42:21.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:21.887 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2023-07-06T21:42:21.887 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-07-06T21:42:21.897 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2023-07-06T21:42:21.898 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-07-06T21:42:21.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:21.898 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-07-06T21:42:21.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:21.960 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-07-06T21:42:22.038 INFO:teuthology.orchestra.run.smithi055.stdout:# file: . 2023-07-06T21:42:22.038 INFO:teuthology.orchestra.run.smithi055.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-07-06T21:42:22.038 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:22.039 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:42:22.039 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:42:22.090 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:22.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6d0099f640 1 Processor -- start 2023-07-06T21:42:22.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6d0099f640 1 -- start start 2023-07-06T21:42:22.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6d0099f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6cfc0b7cd0 0x7f6cfc0ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6d0099f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc0cecf0 con 0x7f6cfc0ccab0 2023-07-06T21:42:22.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6d0099f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc0d1d90 con 0x7f6cfc0b1fe0 2023-07-06T21:42:22.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6d0099f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc0d2310 con 0x7f6cfc0b7cd0 2023-07-06T21:42:22.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6cfc0ccab0 0x7f6cfc0b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59312/0 (socket says 172.21.15.55:59312) 2023-07-06T21:42:22.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf3fff640 1 -- 172.21.15.55:0/3207433627 learned_addr learned my addr 172.21.15.55:0/3207433627 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:22.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 -- 172.21.15.55:0/3207433627 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860623587 0 0) 0x7f6cfc0cecf0 con 0x7f6cfc0ccab0 2023-07-06T21:42:22.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 -- 172.21.15.55:0/3207433627 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ce8003530 con 0x7f6cfc0ccab0 2023-07-06T21:42:22.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cfa59c640 1 --2- 172.21.15.55:0/3207433627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6cfc0b7cd0 0x7f6cfc0ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 -- 172.21.15.55:0/3207433627 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1877615201 0 0) 0x7f6ce8003530 con 0x7f6cfc0ccab0 2023-07-06T21:42:22.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 -- 172.21.15.55:0/3207433627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6cfc0b7cd0 msgr2=0x7f6cfc0ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:22.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 --2- 172.21.15.55:0/3207433627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6cfc0b7cd0 0x7f6cfc0ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 -- 172.21.15.55:0/3207433627 >> v1:172.21.15.138:6789/0 conn(0x7f6cfc0b1fe0 legacy=0x7f6cfc15f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 -- 172.21.15.55:0/3207433627 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc0d2030 con 0x7f6cfc0ccab0 2023-07-06T21:42:22.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 -- 172.21.15.55:0/3207433627 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f6ce4001680 con 0x7f6cfc0ccab0 2023-07-06T21:42:22.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 -- 172.21.15.55:0/3207433627 >> v1:172.21.15.55:6789/0 conn(0x7f6cfc0ccab0 legacy=0x7f6cfc0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 --2- 172.21.15.55:0/3207433627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce80039b0 0x7f6ce8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 --2- 172.21.15.55:0/3207433627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6cfc0b7cd0 0x7f6ce80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 --2- 172.21.15.55:0/3207433627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce8004d10 0x7f6ce8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 -- 172.21.15.55:0/3207433627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce800bb20 con 0x7f6ce80039b0 2023-07-06T21:42:22.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 -- 172.21.15.55:0/3207433627 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce800bc90 con 0x7f6ce8004d10 2023-07-06T21:42:22.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf9d9b640 1 -- 172.21.15.55:0/3207433627 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce800be50 con 0x7f6cfc0b7cd0 2023-07-06T21:42:22.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cfa59c640 1 --2- 172.21.15.55:0/3207433627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce80039b0 0x7f6ce8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cf3fff640 1 --2- 172.21.15.55:0/3207433627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6cfc0b7cd0 0x7f6ce80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cfad9d640 1 --2- 172.21.15.55:0/3207433627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce8004d10 0x7f6ce8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.271+0000 7f6cfa59c640 1 -- 172.21.15.55:0/3207433627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6cfc0b7cd0 msgr2=0x7f6ce80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:22.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6cfa59c640 1 --2- 172.21.15.55:0/3207433627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6cfc0b7cd0 0x7f6ce80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6cfa59c640 1 -- 172.21.15.55:0/3207433627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce8004d10 msgr2=0x7f6ce8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:22.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6cfa59c640 1 --2- 172.21.15.55:0/3207433627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce8004d10 0x7f6ce8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6cfa59c640 1 -- 172.21.15.55:0/3207433627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce8003530 con 0x7f6ce80039b0 2023-07-06T21:42:22.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6cfa59c640 1 --2- 172.21.15.55:0/3207433627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce80039b0 0x7f6ce8003dc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00ba30 tx=0x7f6cec01c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd52755b2bfc7b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:22.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6cf9d9b640 1 -- 172.21.15.55:0/3207433627 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0ae410 con 0x7f6ce80039b0 2023-07-06T21:42:22.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6cf9d9b640 1 -- 172.21.15.55:0/3207433627 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec0a8030 con 0x7f6ce80039b0 2023-07-06T21:42:22.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6cf9d9b640 1 -- 172.21.15.55:0/3207433627 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0ae7b0 con 0x7f6ce80039b0 2023-07-06T21:42:22.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6d0099f640 1 -- 172.21.15.55:0/3207433627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce80039b0 msgr2=0x7f6ce8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6d0099f640 1 --2- 172.21.15.55:0/3207433627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce80039b0 0x7f6ce8003dc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00ba30 tx=0x7f6cec01c680 comp rx=0 tx=0).stop 2023-07-06T21:42:22.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6cfad9d640 1 -- 172.21.15.55:0/3207433627 reap_dead start 2023-07-06T21:42:22.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6d0099f640 1 -- 172.21.15.55:0/3207433627 shutdown_connections 2023-07-06T21:42:22.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6d0099f640 1 -- 172.21.15.55:0/3207433627 >> 172.21.15.55:0/3207433627 conn(0x7f6cfc0ceee0 msgr2=0x7f6cfc0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:22.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6d0099f640 1 -- 172.21.15.55:0/3207433627 shutdown_connections 2023-07-06T21:42:22.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.275+0000 7f6d0099f640 1 -- 172.21.15.55:0/3207433627 wait complete. 2023-07-06T21:42:22.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6d0099f640 1 Processor -- start 2023-07-06T21:42:22.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6d0099f640 1 -- start start 2023-07-06T21:42:22.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6d0099f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce80039b0 0x7f6cfc15e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6d0099f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cfc154ca0 0x7f6cfc0693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6d0099f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6cfc155110 0x7f6cfc069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6d0099f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc155890 con 0x7f6cfc154ca0 2023-07-06T21:42:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6d0099f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc0b6ec0 con 0x7f6ce80039b0 2023-07-06T21:42:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6d0099f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc15de10 con 0x7f6cfc155110 2023-07-06T21:42:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cf3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cfc154ca0 0x7f6cfc0693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cf3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cfc154ca0 0x7f6cfc0693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43828/0 (socket says 172.21.15.55:43828) 2023-07-06T21:42:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cf3fff640 1 -- 172.21.15.55:0/1368609332 learned_addr learned my addr 172.21.15.55:0/1368609332 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:22.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cfa59c640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce80039b0 0x7f6cfc15e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cfad9d640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6cfc155110 0x7f6cfc069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cf3fff640 1 -- 172.21.15.55:0/1368609332 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6cfc155110 msgr2=0x7f6cfc069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cf3fff640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6cfc155110 0x7f6cfc069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cf3fff640 1 -- 172.21.15.55:0/1368609332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce80039b0 msgr2=0x7f6cfc15e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cf3fff640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce80039b0 0x7f6cfc15e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cf3fff640 1 -- 172.21.15.55:0/1368609332 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc15e0f0 con 0x7f6cfc154ca0 2023-07-06T21:42:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cfad9d640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6cfc155110 0x7f6cfc069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cf3fff640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cfc154ca0 0x7f6cfc0693f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4007290 tx=0x7f6ce4007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cf2ffd640 1 -- 172.21.15.55:0/1368609332 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce400f960 con 0x7f6cfc154ca0 2023-07-06T21:42:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cf2ffd640 1 -- 172.21.15.55:0/1368609332 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce400fac0 con 0x7f6cfc154ca0 2023-07-06T21:42:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6d0099f640 1 -- 172.21.15.55:0/1368609332 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cfc15e3d0 con 0x7f6cfc154ca0 2023-07-06T21:42:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6cf2ffd640 1 -- 172.21.15.55:0/1368609332 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce400fe50 con 0x7f6cfc154ca0 2023-07-06T21:42:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.279+0000 7f6d0099f640 1 -- 172.21.15.55:0/1368609332 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cfc0b62e0 con 0x7f6cfc154ca0 2023-07-06T21:42:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.283+0000 7f6d0099f640 1 -- 172.21.15.55:0/1368609332 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cfc15dc70 con 0x7f6cfc154ca0 2023-07-06T21:42:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.283+0000 7f6cf2ffd640 1 -- 172.21.15.55:0/1368609332 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ce401d460 con 0x7f6cfc154ca0 2023-07-06T21:42:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.283+0000 7f6cf2ffd640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6cdc0662b0 0x7f6cdc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.283+0000 7f6cf2ffd640 1 -- 172.21.15.55:0/1368609332 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6ce4084240 con 0x7f6cfc154ca0 2023-07-06T21:42:22.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.283+0000 7f6cfa59c640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6cdc0662b0 0x7f6cdc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.283+0000 7f6cfa59c640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6cdc0662b0 0x7f6cdc068760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0b0000 tx=0x7f6cec0046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:22.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.287+0000 7f6cf2ffd640 1 -- 172.21.15.55:0/1368609332 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6cfc15dc70 con 0x7f6cfc154ca0 2023-07-06T21:42:22.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.443+0000 7f6d0099f640 1 -- 172.21.15.55:0/1368609332 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cfc15dc70 con 0x7f6cfc154ca0 2023-07-06T21:42:22.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.447+0000 7f6cf2ffd640 1 -- 172.21.15.55:0/1368609332 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f6cfc15dc70 con 0x7f6cfc154ca0 2023-07-06T21:42:22.451 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:22.451 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:15.295464+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:22.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.447+0000 7f6d0099f640 1 -- 172.21.15.55:0/1368609332 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6cdc0662b0 msgr2=0x7f6cdc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.447+0000 7f6d0099f640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6cdc0662b0 0x7f6cdc068760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0b0000 tx=0x7f6cec0046d0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.447+0000 7f6d0099f640 1 -- 172.21.15.55:0/1368609332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cfc154ca0 msgr2=0x7f6cfc0693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.447+0000 7f6d0099f640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cfc154ca0 0x7f6cfc0693f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4007290 tx=0x7f6ce4007690 comp rx=0 tx=0).stop 2023-07-06T21:42:22.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.447+0000 7f6d0099f640 1 -- 172.21.15.55:0/1368609332 shutdown_connections 2023-07-06T21:42:22.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.447+0000 7f6d0099f640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6cdc0662b0 0x7f6cdc068760 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.447+0000 7f6d0099f640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6cfc155110 0x7f6cfc069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.447+0000 7f6d0099f640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cfc154ca0 0x7f6cfc0693f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.447+0000 7f6d0099f640 1 --2- 172.21.15.55:0/1368609332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce80039b0 0x7f6cfc15e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.447+0000 7f6d0099f640 1 -- 172.21.15.55:0/1368609332 >> 172.21.15.55:0/1368609332 conn(0x7f6cfc0ceee0 msgr2=0x7f6cfc15f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:22.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.447+0000 7f6d0099f640 1 -- 172.21.15.55:0/1368609332 shutdown_connections 2023-07-06T21:42:22.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.447+0000 7f6d0099f640 1 -- 172.21.15.55:0/1368609332 wait complete. 2023-07-06T21:42:22.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:42:08.597013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:42:09.843890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T21:42:12.918111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T21:42:22.472 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:42:22.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.611+0000 7f2ec4a96640 1 Processor -- start 2023-07-06T21:42:22.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.611+0000 7f2ec4a96640 1 -- start start 2023-07-06T21:42:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.615+0000 7f2ec4a96640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2ec0158850 0x7f2ec00cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.615+0000 7f2ec4a96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec00ca130 0x7f2ec00ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.615+0000 7f2ec4a96640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec00b2aa0 con 0x7f2ec00703e0 2023-07-06T21:42:22.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.615+0000 7f2ec4a96640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec0158c20 con 0x7f2ec0158850 2023-07-06T21:42:22.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.615+0000 7f2ec4a96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec00c8db0 con 0x7f2ec00ca130 2023-07-06T21:42:22.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.615+0000 7f2eb7fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec00ca130 0x7f2ec00ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.615+0000 7f2ebe59c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2ec0158850 0x7f2ec00cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.615+0000 7f2eb7fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec00ca130 0x7f2ec00ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:39178/0 (socket says 172.21.15.55:39178) 2023-07-06T21:42:22.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.615+0000 7f2eb7fff640 1 -- 172.21.15.55:0/824566248 learned_addr learned my addr 172.21.15.55:0/824566248 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:22.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.615+0000 7f2eb7fff640 1 -- 172.21.15.55:0/824566248 >> v2:172.21.15.138:3300/0 conn(0x7f2ec0158850 msgr2=0x7f2ec00cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:22.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.615+0000 7f2eb7fff640 1 --2- 172.21.15.55:0/824566248 >> v2:172.21.15.138:3300/0 conn(0x7f2ec0158850 0x7f2ec00cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.615+0000 7f2eb7fff640 1 -- 172.21.15.55:0/824566248 >> v1:172.21.15.138:6789/0 conn(0x7f2ec00703e0 legacy=0x7f2ec006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.615+0000 7f2eb7fff640 1 -- 172.21.15.55:0/824566248 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec00c9090 con 0x7f2ec00ca130 2023-07-06T21:42:22.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.619+0000 7f2eb7fff640 1 --2- 172.21.15.55:0/824566248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec00ca130 0x7f2ec00ccf70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009870 tx=0x7f2ea8020f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48212cad5374c197 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:22.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.619+0000 7f2ebdd9b640 1 -- 172.21.15.55:0/824566248 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80aac40 con 0x7f2ec00ca130 2023-07-06T21:42:22.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.619+0000 7f2ebdd9b640 1 -- 172.21.15.55:0/824566248 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea80aada0 con 0x7f2ec00ca130 2023-07-06T21:42:22.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.619+0000 7f2ebdd9b640 1 -- 172.21.15.55:0/824566248 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80b2660 con 0x7f2ec00ca130 2023-07-06T21:42:22.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.619+0000 7f2ec4a96640 1 -- 172.21.15.55:0/824566248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec00ca130 msgr2=0x7f2ec00ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.619+0000 7f2ec4a96640 1 --2- 172.21.15.55:0/824566248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec00ca130 0x7f2ec00ccf70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009870 tx=0x7f2ea8020f40 comp rx=0 tx=0).stop 2023-07-06T21:42:22.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.619+0000 7f2ec4a96640 1 -- 172.21.15.55:0/824566248 shutdown_connections 2023-07-06T21:42:22.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.619+0000 7f2ec4a96640 1 --2- 172.21.15.55:0/824566248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec00ca130 0x7f2ec00ccf70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.619+0000 7f2ec4a96640 1 --2- 172.21.15.55:0/824566248 >> v2:172.21.15.138:3300/0 conn(0x7f2ec0158850 0x7f2ec00cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.619+0000 7f2ec4a96640 1 -- 172.21.15.55:0/824566248 >> 172.21.15.55:0/824566248 conn(0x7f2ec00cea70 msgr2=0x7f2ec00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:22.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.619+0000 7f2ec4a96640 1 -- 172.21.15.55:0/824566248 shutdown_connections 2023-07-06T21:42:22.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.619+0000 7f2ec4a96640 1 -- 172.21.15.55:0/824566248 wait complete. 2023-07-06T21:42:22.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.619+0000 7f2ec4a96640 1 Processor -- start 2023-07-06T21:42:22.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.619+0000 7f2ec4a96640 1 -- start start 2023-07-06T21:42:22.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2ec4a96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec00703e0 0x7f2ec01ec3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2ec4a96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ec00ca130 0x7f2ec009b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2ec4a96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec0158850 0x7f2ec00c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2ec4a96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec009a490 con 0x7f2ec00ca130 2023-07-06T21:42:22.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2ec4a96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec00c5940 con 0x7f2ec00703e0 2023-07-06T21:42:22.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2ec4a96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec00c85e0 con 0x7f2ec0158850 2023-07-06T21:42:22.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2eb7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ec00ca130 0x7f2ec009b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2eb7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ec00ca130 0x7f2ec009b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43840/0 (socket says 172.21.15.55:43840) 2023-07-06T21:42:22.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2eb7fff640 1 -- 172.21.15.55:0/3172929352 learned_addr learned my addr 172.21.15.55:0/3172929352 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:22.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2ebe59c640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec00703e0 0x7f2ec01ec3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2ebed9d640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec0158850 0x7f2ec00c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2eb7fff640 1 -- 172.21.15.55:0/3172929352 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec0158850 msgr2=0x7f2ec00c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2eb7fff640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec0158850 0x7f2ec00c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2eb7fff640 1 -- 172.21.15.55:0/3172929352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec00703e0 msgr2=0x7f2ec01ec3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2eb7fff640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec00703e0 0x7f2ec01ec3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2eb7fff640 1 -- 172.21.15.55:0/3172929352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea80094d0 con 0x7f2ec00ca130 2023-07-06T21:42:22.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2ebe59c640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec00703e0 0x7f2ec01ec3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:22.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2eb7fff640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ec00ca130 0x7f2ec009b850 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80b5040 tx=0x7f2ea801dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:22.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2eb6ffd640 1 -- 172.21.15.55:0/3172929352 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80b2dd0 con 0x7f2ec00ca130 2023-07-06T21:42:22.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2eb6ffd640 1 -- 172.21.15.55:0/3172929352 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea80bd460 con 0x7f2ec00ca130 2023-07-06T21:42:22.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2eb6ffd640 1 -- 172.21.15.55:0/3172929352 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80bd810 con 0x7f2ec00ca130 2023-07-06T21:42:22.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2ec4a96640 1 -- 172.21.15.55:0/3172929352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec01ec920 con 0x7f2ec00ca130 2023-07-06T21:42:22.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2ec4a96640 1 -- 172.21.15.55:0/3172929352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec00c5280 con 0x7f2ec00ca130 2023-07-06T21:42:22.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.623+0000 7f2ec4a96640 1 -- 172.21.15.55:0/3172929352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec00c5a80 con 0x7f2ec00ca130 2023-07-06T21:42:22.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.627+0000 7f2eb6ffd640 1 -- 172.21.15.55:0/3172929352 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ea80ba3f0 con 0x7f2ec00ca130 2023-07-06T21:42:22.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.627+0000 7f2eb6ffd640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2ea0066280 0x7f2ea0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.627+0000 7f2eb6ffd640 1 -- 172.21.15.55:0/3172929352 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2ea8123960 con 0x7f2ec00ca130 2023-07-06T21:42:22.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.627+0000 7f2ebe59c640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2ea0066280 0x7f2ea0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.627+0000 7f2ebe59c640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2ea0066280 0x7f2ea0068730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009b10 tx=0x7f2eb0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:22.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.631+0000 7f2eb6ffd640 1 -- 172.21.15.55:0/3172929352 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ea80f0a50 con 0x7f2ec00ca130 2023-07-06T21:42:22.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.795+0000 7f2ec4a96640 1 -- 172.21.15.55:0/3172929352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ec00c9620 con 0x7f2ec00ca130 2023-07-06T21:42:22.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.795+0000 7f2eb6ffd640 1 -- 172.21.15.55:0/3172929352 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ea80f4070 con 0x7f2ec00ca130 2023-07-06T21:42:22.800 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:42:22.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.795+0000 7f2ec4a96640 1 -- 172.21.15.55:0/3172929352 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2ea0066280 msgr2=0x7f2ea0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.795+0000 7f2ec4a96640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2ea0066280 0x7f2ea0068730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009b10 tx=0x7f2eb0008040 comp rx=0 tx=0).stop 2023-07-06T21:42:22.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.795+0000 7f2ec4a96640 1 -- 172.21.15.55:0/3172929352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ec00ca130 msgr2=0x7f2ec009b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.795+0000 7f2ec4a96640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ec00ca130 0x7f2ec009b850 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80b5040 tx=0x7f2ea801dce0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.795+0000 7f2ec4a96640 1 -- 172.21.15.55:0/3172929352 shutdown_connections 2023-07-06T21:42:22.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.795+0000 7f2ec4a96640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2ea0066280 0x7f2ea0068730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.795+0000 7f2ec4a96640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec0158850 0x7f2ec00c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.795+0000 7f2ec4a96640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ec00ca130 0x7f2ec009b850 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.795+0000 7f2ec4a96640 1 --2- 172.21.15.55:0/3172929352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec00703e0 0x7f2ec01ec3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.795+0000 7f2ec4a96640 1 -- 172.21.15.55:0/3172929352 >> 172.21.15.55:0/3172929352 conn(0x7f2ec00cea70 msgr2=0x7f2ec00b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:22.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.795+0000 7f2ec4a96640 1 -- 172.21.15.55:0/3172929352 shutdown_connections 2023-07-06T21:42:22.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.795+0000 7f2ec4a96640 1 -- 172.21.15.55:0/3172929352 wait complete. 2023-07-06T21:42:22.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:42:22.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.963+0000 7fa0c9e34640 1 Processor -- start 2023-07-06T21:42:22.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.963+0000 7fa0c9e34640 1 -- start start 2023-07-06T21:42:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.963+0000 7fa0c9e34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0c40709a0 0x7fa0c40cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.963+0000 7fa0c9e34640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa0c40cbe60 0x7fa0c40b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.963+0000 7fa0c9e34640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c40cc300 con 0x7fa0c4070d70 2023-07-06T21:42:22.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.963+0000 7fa0c9e34640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c40cc5e0 con 0x7fa0c40cbe60 2023-07-06T21:42:22.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.963+0000 7fa0c9e34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40cc8c0 con 0x7fa0c40709a0 2023-07-06T21:42:22.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.967+0000 7fa0c2ffd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa0c40cbe60 0x7fa0c40b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.967+0000 7fa0c2ffd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa0c40cbe60 0x7fa0c40b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:46618/0 (socket says 172.21.15.55:46618) 2023-07-06T21:42:22.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.967+0000 7fa0c2ffd640 1 -- 172.21.15.55:0/1612000498 learned_addr learned my addr 172.21.15.55:0/1612000498 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:22.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.967+0000 7fa0c37fe640 1 --2- 172.21.15.55:0/1612000498 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0c40709a0 0x7fa0c40cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.967+0000 7fa0c27fc640 1 -- 172.21.15.55:0/1612000498 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616163938 0 0) 0x7fa0c40cc300 con 0x7fa0c4070d70 2023-07-06T21:42:22.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.967+0000 7fa0c27fc640 1 -- 172.21.15.55:0/1612000498 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0ac003530 con 0x7fa0c4070d70 2023-07-06T21:42:22.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.967+0000 7fa0c37fe640 1 -- 172.21.15.55:0/1612000498 >> v2:172.21.15.138:3300/0 conn(0x7fa0c40cbe60 msgr2=0x7fa0c40b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:22.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.967+0000 7fa0c37fe640 1 --2- 172.21.15.55:0/1612000498 >> v2:172.21.15.138:3300/0 conn(0x7fa0c40cbe60 0x7fa0c40b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.967+0000 7fa0c37fe640 1 -- 172.21.15.55:0/1612000498 >> v1:172.21.15.138:6789/0 conn(0x7fa0c4070d70 legacy=0x7fa0c415d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.967+0000 7fa0c37fe640 1 -- 172.21.15.55:0/1612000498 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c40ccba0 con 0x7fa0c40709a0 2023-07-06T21:42:22.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.967+0000 7fa0c37fe640 1 --2- 172.21.15.55:0/1612000498 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0c40709a0 0x7fa0c40cb920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40097c0 tx=0x7fa0b401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0d5cd9306032d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:22.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.967+0000 7fa0c27fc640 1 -- 172.21.15.55:0/1612000498 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40ab600 con 0x7fa0c40709a0 2023-07-06T21:42:22.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.967+0000 7fa0c27fc640 1 -- 172.21.15.55:0/1612000498 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b40a7050 con 0x7fa0c40709a0 2023-07-06T21:42:22.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.967+0000 7fa0c27fc640 1 -- 172.21.15.55:0/1612000498 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40ab960 con 0x7fa0c40709a0 2023-07-06T21:42:22.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 -- 172.21.15.55:0/1612000498 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0c40709a0 msgr2=0x7fa0c40cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 --2- 172.21.15.55:0/1612000498 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0c40709a0 0x7fa0c40cb920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40097c0 tx=0x7fa0b401c480 comp rx=0 tx=0).stop 2023-07-06T21:42:22.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 -- 172.21.15.55:0/1612000498 shutdown_connections 2023-07-06T21:42:22.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 --2- 172.21.15.55:0/1612000498 >> v2:172.21.15.138:3300/0 conn(0x7fa0c40cbe60 0x7fa0c40b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 --2- 172.21.15.55:0/1612000498 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0c40709a0 0x7fa0c40cb920 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 -- 172.21.15.55:0/1612000498 >> 172.21.15.55:0/1612000498 conn(0x7fa0c40cea70 msgr2=0x7fa0c40ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:22.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 -- 172.21.15.55:0/1612000498 shutdown_connections 2023-07-06T21:42:22.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 -- 172.21.15.55:0/1612000498 wait complete. 2023-07-06T21:42:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 Processor -- start 2023-07-06T21:42:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 -- start start 2023-07-06T21:42:22.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0c40709a0 0x7fa0c40c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0c4070d70 0x7fa0c4156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0c40cbe60 0x7fa0c40af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c4158460 con 0x7fa0c40cbe60 2023-07-06T21:42:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c41577e0 con 0x7fa0c4070d70 2023-07-06T21:42:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c9e34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c4157ac0 con 0x7fa0c40709a0 2023-07-06T21:42:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.971+0000 7fa0c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0c40cbe60 0x7fa0c40af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0c40cbe60 0x7fa0c40af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43842/0 (socket says 172.21.15.55:43842) 2023-07-06T21:42:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0c3fff640 1 -- 172.21.15.55:0/2063659932 learned_addr learned my addr 172.21.15.55:0/2063659932 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:22.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0c37fe640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0c40709a0 0x7fa0c40c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0c2ffd640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0c4070d70 0x7fa0c4156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0c3fff640 1 -- 172.21.15.55:0/2063659932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0c40709a0 msgr2=0x7fa0c40c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0c3fff640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0c40709a0 0x7fa0c40c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0c3fff640 1 -- 172.21.15.55:0/2063659932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0c4070d70 msgr2=0x7fa0c4156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:22.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0c3fff640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0c4070d70 0x7fa0c4156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:22.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0c3fff640 1 -- 172.21.15.55:0/2063659932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b4009420 con 0x7fa0c40cbe60 2023-07-06T21:42:22.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0c2ffd640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0c4070d70 0x7fa0c4156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:22.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0c3fff640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0c40cbe60 0x7fa0c40af8b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00c790 tx=0x7fa0bc00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:22.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0abfff640 1 -- 172.21.15.55:0/2063659932 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc00cea0 con 0x7fa0c40cbe60 2023-07-06T21:42:22.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0abfff640 1 -- 172.21.15.55:0/2063659932 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc003b80 con 0x7fa0c40cbe60 2023-07-06T21:42:22.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0c9e34640 1 -- 172.21.15.55:0/2063659932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c4157da0 con 0x7fa0c40cbe60 2023-07-06T21:42:22.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0abfff640 1 -- 172.21.15.55:0/2063659932 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc00a850 con 0x7fa0c40cbe60 2023-07-06T21:42:22.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0c9e34640 1 -- 172.21.15.55:0/2063659932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c40c4080 con 0x7fa0c40cbe60 2023-07-06T21:42:22.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0c9e34640 1 -- 172.21.15.55:0/2063659932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c41585a0 con 0x7fa0c40cbe60 2023-07-06T21:42:22.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0abfff640 1 -- 172.21.15.55:0/2063659932 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa0bc00a9b0 con 0x7fa0c40cbe60 2023-07-06T21:42:22.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.975+0000 7fa0abfff640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa0b0066280 0x7fa0b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:22.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.979+0000 7fa0abfff640 1 -- 172.21.15.55:0/2063659932 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa0bc083e40 con 0x7fa0c40cbe60 2023-07-06T21:42:22.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.979+0000 7fa0c37fe640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa0b0066280 0x7fa0b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:22.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.979+0000 7fa0c37fe640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa0b0066280 0x7fa0b0068730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40ad000 tx=0x7fa0b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:22.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:22.979+0000 7fa0abfff640 1 -- 172.21.15.55:0/2063659932 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0c41585a0 con 0x7fa0c40cbe60 2023-07-06T21:42:23.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.135+0000 7fa0c9e34640 1 -- 172.21.15.55:0/2063659932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa0c41585a0 con 0x7fa0c40cbe60 2023-07-06T21:42:23.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.135+0000 7fa0abfff640 1 -- 172.21.15.55:0/2063659932 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0c41585a0 con 0x7fa0c40cbe60 2023-07-06T21:42:23.142 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:42:23.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.139+0000 7fa0c9e34640 1 -- 172.21.15.55:0/2063659932 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa0b0066280 msgr2=0x7fa0b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.139+0000 7fa0c9e34640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa0b0066280 0x7fa0b0068730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40ad000 tx=0x7fa0b4008040 comp rx=0 tx=0).stop 2023-07-06T21:42:23.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.139+0000 7fa0c9e34640 1 -- 172.21.15.55:0/2063659932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0c40cbe60 msgr2=0x7fa0c40af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.139+0000 7fa0c9e34640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0c40cbe60 0x7fa0c40af8b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00c790 tx=0x7fa0bc00cc50 comp rx=0 tx=0).stop 2023-07-06T21:42:23.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.139+0000 7fa0c9e34640 1 -- 172.21.15.55:0/2063659932 shutdown_connections 2023-07-06T21:42:23.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.139+0000 7fa0c9e34640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa0b0066280 0x7fa0b0068730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.139+0000 7fa0c9e34640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0c40cbe60 0x7fa0c40af8b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.139+0000 7fa0c9e34640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0c4070d70 0x7fa0c4156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.139+0000 7fa0c9e34640 1 --2- 172.21.15.55:0/2063659932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0c40709a0 0x7fa0c40c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.139+0000 7fa0c9e34640 1 -- 172.21.15.55:0/2063659932 >> 172.21.15.55:0/2063659932 conn(0x7fa0c40cea70 msgr2=0x7fa0c40ad0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:23.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.139+0000 7fa0c9e34640 1 -- 172.21.15.55:0/2063659932 shutdown_connections 2023-07-06T21:42:23.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.139+0000 7fa0c9e34640 1 -- 172.21.15.55:0/2063659932 wait complete. 2023-07-06T21:42:23.162 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:42:23.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.303+0000 7fec09bd2640 1 Processor -- start 2023-07-06T21:42:23.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.303+0000 7fec09bd2640 1 -- start start 2023-07-06T21:42:23.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.303+0000 7fec09bd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec040b3870 0x7fec040b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.303+0000 7fec09bd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec040b4210 con 0x7fec0415b850 2023-07-06T21:42:23.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.303+0000 7fec09bd2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec040b2b80 con 0x7fec040d03c0 2023-07-06T21:42:23.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.303+0000 7fec09bd2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec040cff30 con 0x7fec040b3870 2023-07-06T21:42:23.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.303+0000 7fec02ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec040b3870 0x7fec040b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:23.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.303+0000 7fec037fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fec0415b850 0x7fec040cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57434/0 (socket says 172.21.15.55:57434) 2023-07-06T21:42:23.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.303+0000 7fec037fe640 1 -- 172.21.15.55:0/1314488733 learned_addr learned my addr 172.21.15.55:0/1314488733 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:23.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.303+0000 7fec02ffd640 1 -- 172.21.15.55:0/1314488733 >> v1:172.21.15.138:6789/0 conn(0x7fec040d03c0 legacy=0x7fec040d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:23.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.303+0000 7fec02ffd640 1 -- 172.21.15.55:0/1314488733 >> v1:172.21.15.55:6789/0 conn(0x7fec0415b850 legacy=0x7fec040cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.303+0000 7fec02ffd640 1 -- 172.21.15.55:0/1314488733 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec040b22e0 con 0x7fec040b3870 2023-07-06T21:42:23.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.303+0000 7fec027fc640 1 -- 172.21.15.55:0/1314488733 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1795283730 0 0) 0x7fec040b4210 con 0x7fec0415b850 2023-07-06T21:42:23.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.307+0000 7fec02ffd640 1 --2- 172.21.15.55:0/1314488733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec040b3870 0x7fec040b3cd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7febf80097c0 tx=0x7febf801c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08984ede6c9ffaa server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:23.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.307+0000 7fec027fc640 1 -- 172.21.15.55:0/1314488733 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80ab600 con 0x7fec040b3870 2023-07-06T21:42:23.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.307+0000 7fec027fc640 1 -- 172.21.15.55:0/1314488733 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf80a7050 con 0x7fec040b3870 2023-07-06T21:42:23.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.307+0000 7fec027fc640 1 -- 172.21.15.55:0/1314488733 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80ab980 con 0x7fec040b3870 2023-07-06T21:42:23.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.307+0000 7fec09bd2640 1 -- 172.21.15.55:0/1314488733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec040b3870 msgr2=0x7fec040b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.307+0000 7fec09bd2640 1 --2- 172.21.15.55:0/1314488733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec040b3870 0x7fec040b3cd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7febf80097c0 tx=0x7febf801c2f0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.307+0000 7fec09bd2640 1 -- 172.21.15.55:0/1314488733 shutdown_connections 2023-07-06T21:42:23.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.307+0000 7fec09bd2640 1 --2- 172.21.15.55:0/1314488733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec040b3870 0x7fec040b3cd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.307+0000 7fec09bd2640 1 -- 172.21.15.55:0/1314488733 >> 172.21.15.55:0/1314488733 conn(0x7fec040cec20 msgr2=0x7fec040cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:23.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.307+0000 7fec09bd2640 1 -- 172.21.15.55:0/1314488733 shutdown_connections 2023-07-06T21:42:23.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.307+0000 7fec09bd2640 1 -- 172.21.15.55:0/1314488733 wait complete. 2023-07-06T21:42:23.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec09bd2640 1 Processor -- start 2023-07-06T21:42:23.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec09bd2640 1 -- start start 2023-07-06T21:42:23.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec09bd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec040b3870 0x7fec04153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec09bd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec040d03c0 0x7fec04159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec09bd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0415b850 0x7fec04141cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec09bd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec04155560 con 0x7fec0415b850 2023-07-06T21:42:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec09bd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec04152b60 con 0x7fec040b3870 2023-07-06T21:42:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec09bd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec04157f10 con 0x7fec040d03c0 2023-07-06T21:42:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec03fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0415b850 0x7fec04141cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec037fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec040b3870 0x7fec04153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec03fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0415b850 0x7fec04141cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59644/0 (socket says 172.21.15.55:59644) 2023-07-06T21:42:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec03fff640 1 -- 172.21.15.55:0/185916420 learned_addr learned my addr 172.21.15.55:0/185916420 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec02ffd640 1 --2- 172.21.15.55:0/185916420 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec040d03c0 0x7fec04159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec03fff640 1 -- 172.21.15.55:0/185916420 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec040d03c0 msgr2=0x7fec04159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec03fff640 1 --2- 172.21.15.55:0/185916420 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec040d03c0 0x7fec04159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec03fff640 1 -- 172.21.15.55:0/185916420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec040b3870 msgr2=0x7fec04153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec03fff640 1 --2- 172.21.15.55:0/185916420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec040b3870 0x7fec04153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec03fff640 1 -- 172.21.15.55:0/185916420 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf8009420 con 0x7fec0415b850 2023-07-06T21:42:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec03fff640 1 --2- 172.21.15.55:0/185916420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0415b850 0x7fec04141cc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7febfc00c7b0 tx=0x7febfc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7febebfff640 1 -- 172.21.15.55:0/185916420 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc004bc0 con 0x7fec0415b850 2023-07-06T21:42:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7febebfff640 1 -- 172.21.15.55:0/185916420 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc004d20 con 0x7fec0415b850 2023-07-06T21:42:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec09bd2640 1 -- 172.21.15.55:0/185916420 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0415a830 con 0x7fec0415b850 2023-07-06T21:42:23.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7febebfff640 1 -- 172.21.15.55:0/185916420 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc00aa90 con 0x7fec0415b850 2023-07-06T21:42:23.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.311+0000 7fec09bd2640 1 -- 172.21.15.55:0/185916420 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec04157ba0 con 0x7fec0415b850 2023-07-06T21:42:23.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.315+0000 7fec09bd2640 1 -- 172.21.15.55:0/185916420 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec04066d60 con 0x7fec0415b850 2023-07-06T21:42:23.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.315+0000 7febebfff640 1 -- 172.21.15.55:0/185916420 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7febfc00abf0 con 0x7fec0415b850 2023-07-06T21:42:23.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.315+0000 7febebfff640 1 --2- 172.21.15.55:0/185916420 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7febf00662b0 0x7febf0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.315+0000 7febebfff640 1 -- 172.21.15.55:0/185916420 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7febfc083ff0 con 0x7fec0415b850 2023-07-06T21:42:23.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.315+0000 7fec037fe640 1 --2- 172.21.15.55:0/185916420 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7febf00662b0 0x7febf0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:23.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.315+0000 7fec037fe640 1 --2- 172.21.15.55:0/185916420 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7febf00662b0 0x7febf0068760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7febf4007fd0 tx=0x7febf4007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:23.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.319+0000 7febebfff640 1 -- 172.21.15.55:0/185916420 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7febfc051230 con 0x7fec0415b850 2023-07-06T21:42:23.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.471+0000 7fec09bd2640 1 -- 172.21.15.55:0/185916420 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec04158050 con 0x7fec0415b850 2023-07-06T21:42:23.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.475+0000 7febebfff640 1 -- 172.21.15.55:0/185916420 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7febfc054850 con 0x7fec0415b850 2023-07-06T21:42:23.479 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:23.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.475+0000 7fec09bd2640 1 -- 172.21.15.55:0/185916420 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7febf00662b0 msgr2=0x7febf0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.475+0000 7fec09bd2640 1 --2- 172.21.15.55:0/185916420 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7febf00662b0 0x7febf0068760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7febf4007fd0 tx=0x7febf4007d60 comp rx=0 tx=0).stop 2023-07-06T21:42:23.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.475+0000 7fec09bd2640 1 -- 172.21.15.55:0/185916420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0415b850 msgr2=0x7fec04141cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.475+0000 7fec09bd2640 1 --2- 172.21.15.55:0/185916420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0415b850 0x7fec04141cc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7febfc00c7b0 tx=0x7febfc00cc70 comp rx=0 tx=0).stop 2023-07-06T21:42:23.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.475+0000 7fec09bd2640 1 -- 172.21.15.55:0/185916420 shutdown_connections 2023-07-06T21:42:23.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.475+0000 7fec09bd2640 1 --2- 172.21.15.55:0/185916420 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7febf00662b0 0x7febf0068760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.475+0000 7fec09bd2640 1 --2- 172.21.15.55:0/185916420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0415b850 0x7fec04141cc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.475+0000 7fec09bd2640 1 --2- 172.21.15.55:0/185916420 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec040d03c0 0x7fec04159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.475+0000 7fec09bd2640 1 --2- 172.21.15.55:0/185916420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec040b3870 0x7fec04153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.475+0000 7fec09bd2640 1 -- 172.21.15.55:0/185916420 >> 172.21.15.55:0/185916420 conn(0x7fec040cec20 msgr2=0x7fec040693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:23.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.475+0000 7fec09bd2640 1 -- 172.21.15.55:0/185916420 shutdown_connections 2023-07-06T21:42:23.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.475+0000 7fec09bd2640 1 -- 172.21.15.55:0/185916420 wait complete. 2023-07-06T21:42:23.499 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:42:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.639+0000 7f3fd0b00640 1 Processor -- start 2023-07-06T21:42:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.639+0000 7f3fd0b00640 1 -- start start 2023-07-06T21:42:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.639+0000 7f3fd0b00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3fcc0ca130 0x7f3fcc0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.639+0000 7f3fd0b00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3fcc0cd140 0x7f3fcc070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.639+0000 7f3fd0b00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fcc158c20 con 0x7f3fcc158850 2023-07-06T21:42:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.639+0000 7f3fd0b00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fcc0b2aa0 con 0x7f3fcc0cd140 2023-07-06T21:42:23.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.639+0000 7f3fd0b00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fcc0c8db0 con 0x7f3fcc0ca130 2023-07-06T21:42:23.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.639+0000 7f3fcad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3fcc0cd140 0x7f3fcc070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:23.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.639+0000 7f3fcad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3fcc0cd140 0x7f3fcc070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59654/0 (socket says 172.21.15.55:59654) 2023-07-06T21:42:23.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.639+0000 7f3fcad9d640 1 -- 172.21.15.55:0/3774873072 learned_addr learned my addr 172.21.15.55:0/3774873072 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:23.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.639+0000 7f3fcad9d640 1 -- 172.21.15.55:0/3774873072 >> v2:172.21.15.138:3300/0 conn(0x7f3fcc0ca130 msgr2=0x7f3fcc0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:23.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.639+0000 7f3fcad9d640 1 --2- 172.21.15.55:0/3774873072 >> v2:172.21.15.138:3300/0 conn(0x7f3fcc0ca130 0x7f3fcc0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.639+0000 7f3fcad9d640 1 -- 172.21.15.55:0/3774873072 >> v1:172.21.15.138:6789/0 conn(0x7f3fcc158850 legacy=0x7f3fcc0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:23.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.639+0000 7f3fcad9d640 1 -- 172.21.15.55:0/3774873072 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc0c9090 con 0x7f3fcc0cd140 2023-07-06T21:42:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.643+0000 7f3fcad9d640 1 --2- 172.21.15.55:0/3774873072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fcc0cd140 0x7f3fcc070920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc071490 tx=0x7f3fc401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d55951bc638f69 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:23.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.643+0000 7f3fc9d9b640 1 -- 172.21.15.55:0/3774873072 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400b2d0 con 0x7f3fcc0cd140 2023-07-06T21:42:23.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.643+0000 7f3fc9d9b640 1 -- 172.21.15.55:0/3774873072 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc400b430 con 0x7f3fcc0cd140 2023-07-06T21:42:23.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.643+0000 7f3fc9d9b640 1 -- 172.21.15.55:0/3774873072 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc40a7c50 con 0x7f3fcc0cd140 2023-07-06T21:42:23.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.643+0000 7f3fd0b00640 1 -- 172.21.15.55:0/3774873072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fcc0cd140 msgr2=0x7f3fcc070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.643+0000 7f3fd0b00640 1 --2- 172.21.15.55:0/3774873072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fcc0cd140 0x7f3fcc070920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc071490 tx=0x7f3fc401eb60 comp rx=0 tx=0).stop 2023-07-06T21:42:23.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.643+0000 7f3fd0b00640 1 -- 172.21.15.55:0/3774873072 shutdown_connections 2023-07-06T21:42:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.643+0000 7f3fd0b00640 1 --2- 172.21.15.55:0/3774873072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fcc0cd140 0x7f3fcc070920 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.643+0000 7f3fd0b00640 1 --2- 172.21.15.55:0/3774873072 >> v2:172.21.15.138:3300/0 conn(0x7f3fcc0ca130 0x7f3fcc0703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.643+0000 7f3fd0b00640 1 -- 172.21.15.55:0/3774873072 >> 172.21.15.55:0/3774873072 conn(0x7f3fcc0cea70 msgr2=0x7f3fcc0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.643+0000 7f3fd0b00640 1 -- 172.21.15.55:0/3774873072 shutdown_connections 2023-07-06T21:42:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.643+0000 7f3fd0b00640 1 -- 172.21.15.55:0/3774873072 wait complete. 2023-07-06T21:42:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fd0b00640 1 Processor -- start 2023-07-06T21:42:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fd0b00640 1 -- start start 2023-07-06T21:42:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fd0b00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fcc0ca130 0x7f3fcc1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fd0b00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fcc0cd140 0x7f3fcc0aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fd0b00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fcc158850 0x7f3fcc0693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fd0b00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0adb10 con 0x7f3fcc158850 2023-07-06T21:42:23.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fd0b00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0ae970 con 0x7f3fcc0ca130 2023-07-06T21:42:23.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fd0b00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0add60 con 0x7f3fcc0cd140 2023-07-06T21:42:23.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fcad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fcc158850 0x7f3fcc0693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:23.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fcad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fcc158850 0x7f3fcc0693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59658/0 (socket says 172.21.15.55:59658) 2023-07-06T21:42:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fca59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fcc0ca130 0x7f3fcc1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fcad9d640 1 -- 172.21.15.55:0/1078587234 learned_addr learned my addr 172.21.15.55:0/1078587234 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fc1d9b640 1 --2- 172.21.15.55:0/1078587234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fcc0cd140 0x7f3fcc0aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fcad9d640 1 -- 172.21.15.55:0/1078587234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fcc0cd140 msgr2=0x7f3fcc0aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fcad9d640 1 --2- 172.21.15.55:0/1078587234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fcc0cd140 0x7f3fcc0aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fcad9d640 1 -- 172.21.15.55:0/1078587234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fcc0ca130 msgr2=0x7f3fcc1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fcad9d640 1 --2- 172.21.15.55:0/1078587234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fcc0ca130 0x7f3fcc1533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.647+0000 7f3fcad9d640 1 -- 172.21.15.55:0/1078587234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc400bd40 con 0x7f3fcc158850 2023-07-06T21:42:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.651+0000 7f3fcad9d640 1 --2- 172.21.15.55:0/1078587234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fcc158850 0x7f3fcc0693f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40b1040 tx=0x7f3fc401b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.651+0000 7f3fc37fe640 1 -- 172.21.15.55:0/1078587234 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4009800 con 0x7f3fcc158850 2023-07-06T21:42:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.651+0000 7f3fc37fe640 1 -- 172.21.15.55:0/1078587234 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc4009960 con 0x7f3fcc158850 2023-07-06T21:42:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.651+0000 7f3fc37fe640 1 -- 172.21.15.55:0/1078587234 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4009d50 con 0x7f3fcc158850 2023-07-06T21:42:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.651+0000 7f3fd0b00640 1 -- 172.21.15.55:0/1078587234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fcc0ae040 con 0x7f3fcc158850 2023-07-06T21:42:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.651+0000 7f3fd0b00640 1 -- 172.21.15.55:0/1078587234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fcc0ae600 con 0x7f3fcc158850 2023-07-06T21:42:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.651+0000 7f3fd0b00640 1 -- 172.21.15.55:0/1078587234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fcc1631b0 con 0x7f3fcc158850 2023-07-06T21:42:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.651+0000 7f3fc37fe640 1 -- 172.21.15.55:0/1078587234 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3fc40b9430 con 0x7f3fcc158850 2023-07-06T21:42:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.651+0000 7f3fc37fe640 1 --2- 172.21.15.55:0/1078587234 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3fac0662b0 0x7f3fac068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.651+0000 7f3fc37fe640 1 -- 172.21.15.55:0/1078587234 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3fc411f4d0 con 0x7f3fcc158850 2023-07-06T21:42:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.651+0000 7f3fca59c640 1 --2- 172.21.15.55:0/1078587234 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3fac0662b0 0x7f3fac068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.655+0000 7f3fca59c640 1 --2- 172.21.15.55:0/1078587234 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3fac0662b0 0x7f3fac068760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40098e0 tx=0x7f3fb4009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:23.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.655+0000 7f3fc37fe640 1 -- 172.21.15.55:0/1078587234 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3fc40ec670 con 0x7f3fcc158850 2023-07-06T21:42:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.807+0000 7f3fd0b00640 1 -- 172.21.15.55:0/1078587234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3fcc1631b0 con 0x7f3fcc158850 2023-07-06T21:42:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.811+0000 7f3fc37fe640 1 -- 172.21.15.55:0/1078587234 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3fc40efc90 con 0x7f3fcc158850 2023-07-06T21:42:23.815 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:42:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.811+0000 7f3fd0b00640 1 -- 172.21.15.55:0/1078587234 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3fac0662b0 msgr2=0x7f3fac068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.811+0000 7f3fd0b00640 1 --2- 172.21.15.55:0/1078587234 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3fac0662b0 0x7f3fac068760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40098e0 tx=0x7f3fb4009060 comp rx=0 tx=0).stop 2023-07-06T21:42:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.811+0000 7f3fd0b00640 1 -- 172.21.15.55:0/1078587234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fcc158850 msgr2=0x7f3fcc0693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.811+0000 7f3fd0b00640 1 --2- 172.21.15.55:0/1078587234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fcc158850 0x7f3fcc0693f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40b1040 tx=0x7f3fc401b900 comp rx=0 tx=0).stop 2023-07-06T21:42:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.811+0000 7f3fd0b00640 1 -- 172.21.15.55:0/1078587234 shutdown_connections 2023-07-06T21:42:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.811+0000 7f3fd0b00640 1 --2- 172.21.15.55:0/1078587234 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3fac0662b0 0x7f3fac068760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.811+0000 7f3fd0b00640 1 --2- 172.21.15.55:0/1078587234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fcc158850 0x7f3fcc0693f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.811+0000 7f3fd0b00640 1 --2- 172.21.15.55:0/1078587234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3fcc0cd140 0x7f3fcc0aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.811+0000 7f3fd0b00640 1 --2- 172.21.15.55:0/1078587234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fcc0ca130 0x7f3fcc1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.811+0000 7f3fd0b00640 1 -- 172.21.15.55:0/1078587234 >> 172.21.15.55:0/1078587234 conn(0x7f3fcc0cea70 msgr2=0x7f3fcc0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.811+0000 7f3fd0b00640 1 -- 172.21.15.55:0/1078587234 shutdown_connections 2023-07-06T21:42:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.811+0000 7f3fd0b00640 1 -- 172.21.15.55:0/1078587234 wait complete. 2023-07-06T21:42:23.836 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T21:42:23.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.975+0000 7f13bc26d640 1 Processor -- start 2023-07-06T21:42:23.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.975+0000 7f13bc26d640 1 -- start start 2023-07-06T21:42:23.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.975+0000 7f13bc26d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13b40709a0 0x7f13b40cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.975+0000 7f13bc26d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13b40cbe60 0x7f13b40b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.975+0000 7f13bc26d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b40cc300 con 0x7f13b4070d70 2023-07-06T21:42:23.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.975+0000 7f13bc26d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b40cc5e0 con 0x7f13b40cbe60 2023-07-06T21:42:23.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.975+0000 7f13bc26d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b40cc8c0 con 0x7f13b40709a0 2023-07-06T21:42:23.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.975+0000 7f13b9808640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13b40cbe60 0x7f13b40b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:23.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.979+0000 7f13ba80a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f13b4070d70 0x7f13b415d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57440/0 (socket says 172.21.15.55:57440) 2023-07-06T21:42:23.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.979+0000 7f13b9808640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13b40cbe60 0x7f13b40b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59662/0 (socket says 172.21.15.55:59662) 2023-07-06T21:42:23.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.979+0000 7f13ba80a640 1 -- 172.21.15.55:0/4050004211 learned_addr learned my addr 172.21.15.55:0/4050004211 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:23.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.979+0000 7f13ba009640 1 --2- 172.21.15.55:0/4050004211 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13b40709a0 0x7f13b40cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:23.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.979+0000 7f13b9808640 1 -- 172.21.15.55:0/4050004211 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13b40709a0 msgr2=0x7f13b40cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.979+0000 7f13b9808640 1 --2- 172.21.15.55:0/4050004211 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13b40709a0 0x7f13b40cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.979+0000 7f13b9808640 1 -- 172.21.15.55:0/4050004211 >> v1:172.21.15.55:6789/0 conn(0x7f13b4070d70 legacy=0x7f13b415d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.979+0000 7f13b9808640 1 -- 172.21.15.55:0/4050004211 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b40ccba0 con 0x7f13b40cbe60 2023-07-06T21:42:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.979+0000 7f13b9007640 1 -- 172.21.15.55:0/4050004211 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546535915 0 0) 0x7f13b40cc300 con 0x7f13b4070d70 2023-07-06T21:42:23.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.979+0000 7f13b9808640 1 --2- 172.21.15.55:0/4050004211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b40cbe60 0x7f13b40b0c30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f13a40097c0 tx=0x7f13a401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cffd08249c4327 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:23.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.979+0000 7f13b9007640 1 -- 172.21.15.55:0/4050004211 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40ab600 con 0x7f13b40cbe60 2023-07-06T21:42:23.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.979+0000 7f13b9007640 1 -- 172.21.15.55:0/4050004211 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a40a7050 con 0x7f13b40cbe60 2023-07-06T21:42:23.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.979+0000 7f13b9007640 1 -- 172.21.15.55:0/4050004211 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40ab980 con 0x7f13b40cbe60 2023-07-06T21:42:23.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 -- 172.21.15.55:0/4050004211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b40cbe60 msgr2=0x7f13b40b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:23.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 --2- 172.21.15.55:0/4050004211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b40cbe60 0x7f13b40b0c30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f13a40097c0 tx=0x7f13a401c480 comp rx=0 tx=0).stop 2023-07-06T21:42:23.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 -- 172.21.15.55:0/4050004211 shutdown_connections 2023-07-06T21:42:23.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 --2- 172.21.15.55:0/4050004211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b40cbe60 0x7f13b40b0c30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 --2- 172.21.15.55:0/4050004211 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13b40709a0 0x7f13b40cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:23.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 -- 172.21.15.55:0/4050004211 >> 172.21.15.55:0/4050004211 conn(0x7f13b40cea70 msgr2=0x7f13b40ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:23.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 -- 172.21.15.55:0/4050004211 shutdown_connections 2023-07-06T21:42:23.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 -- 172.21.15.55:0/4050004211 wait complete. 2023-07-06T21:42:23.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 Processor -- start 2023-07-06T21:42:23.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 -- start start 2023-07-06T21:42:23.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b40709a0 0x7f13b415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13b4070d70 0x7f13b415cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13b40cbe60 0x7f13b40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:23.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b40c42c0 con 0x7f13b40709a0 2023-07-06T21:42:23.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b415d2b0 con 0x7f13b40cbe60 2023-07-06T21:42:23.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13bc26d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4069f30 con 0x7f13b4070d70 2023-07-06T21:42:24.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13ba009640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b40709a0 0x7f13b415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13ba009640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b40709a0 0x7f13b415ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59674/0 (socket says 172.21.15.55:59674) 2023-07-06T21:42:24.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13ba009640 1 -- 172.21.15.55:0/1453057165 learned_addr learned my addr 172.21.15.55:0/1453057165 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:24.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13ba80a640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13b40cbe60 0x7f13b40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13b9808640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13b4070d70 0x7f13b415cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13ba009640 1 -- 172.21.15.55:0/1453057165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13b4070d70 msgr2=0x7f13b415cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13ba009640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13b4070d70 0x7f13b415cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13ba009640 1 -- 172.21.15.55:0/1453057165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13b40cbe60 msgr2=0x7f13b40ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13ba009640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13b40cbe60 0x7f13b40ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13ba009640 1 -- 172.21.15.55:0/1453057165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a4009420 con 0x7f13b40709a0 2023-07-06T21:42:24.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13ba80a640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13b40cbe60 0x7f13b40ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:24.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.983+0000 7f13ba009640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b40709a0 0x7f13b415ae50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f13b000e960 tx=0x7f13b000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:24.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.987+0000 7f13aaffd640 1 -- 172.21.15.55:0/1453057165 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0009690 con 0x7f13b40709a0 2023-07-06T21:42:24.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.987+0000 7f13aaffd640 1 -- 172.21.15.55:0/1453057165 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b000ca00 con 0x7f13b40709a0 2023-07-06T21:42:24.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.987+0000 7f13aaffd640 1 -- 172.21.15.55:0/1453057165 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b000cd70 con 0x7f13b40709a0 2023-07-06T21:42:24.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.987+0000 7f13bc26d640 1 -- 172.21.15.55:0/1453057165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b406a210 con 0x7f13b40709a0 2023-07-06T21:42:24.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.987+0000 7f13bc26d640 1 -- 172.21.15.55:0/1453057165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b406a7d0 con 0x7f13b40709a0 2023-07-06T21:42:24.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.987+0000 7f13bc26d640 1 -- 172.21.15.55:0/1453057165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b4066d60 con 0x7f13b40709a0 2023-07-06T21:42:24.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.987+0000 7f13aaffd640 1 -- 172.21.15.55:0/1453057165 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f13b0013470 con 0x7f13b40709a0 2023-07-06T21:42:24.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.987+0000 7f13aaffd640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f13980662b0 0x7f1398068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.987+0000 7f13aaffd640 1 -- 172.21.15.55:0/1453057165 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f13b0084190 con 0x7f13b40709a0 2023-07-06T21:42:24.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.987+0000 7f13b9808640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f13980662b0 0x7f1398068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.987+0000 7f13b9808640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f13980662b0 0x7f1398068760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f13a40ad000 tx=0x7f13a40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:24.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:23.991+0000 7f13aaffd640 1 -- 172.21.15.55:0/1453057165 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f13b00513b0 con 0x7f13b40709a0 2023-07-06T21:42:24.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.147+0000 7f13bc26d640 1 -- 172.21.15.55:0/1453057165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f13b40c7e50 con 0x7f13b40709a0 2023-07-06T21:42:24.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.147+0000 7f13aaffd640 1 -- 172.21.15.55:0/1453057165 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f13b00549d0 con 0x7f13b40709a0 2023-07-06T21:42:24.154 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.151+0000 7f13bc26d640 1 -- 172.21.15.55:0/1453057165 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f13980662b0 msgr2=0x7f1398068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.151+0000 7f13bc26d640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f13980662b0 0x7f1398068760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f13a40ad000 tx=0x7f13a40a6000 comp rx=0 tx=0).stop 2023-07-06T21:42:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.151+0000 7f13bc26d640 1 -- 172.21.15.55:0/1453057165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b40709a0 msgr2=0x7f13b415ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.151+0000 7f13bc26d640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b40709a0 0x7f13b415ae50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f13b000e960 tx=0x7f13b000ee20 comp rx=0 tx=0).stop 2023-07-06T21:42:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.151+0000 7f13bc26d640 1 -- 172.21.15.55:0/1453057165 shutdown_connections 2023-07-06T21:42:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.151+0000 7f13bc26d640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f13980662b0 0x7f1398068760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.151+0000 7f13bc26d640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13b40cbe60 0x7f13b40ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.151+0000 7f13bc26d640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13b4070d70 0x7f13b415cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.151+0000 7f13bc26d640 1 --2- 172.21.15.55:0/1453057165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b40709a0 0x7f13b415ae50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.151+0000 7f13bc26d640 1 -- 172.21.15.55:0/1453057165 >> 172.21.15.55:0/1453057165 conn(0x7f13b40cea70 msgr2=0x7f13b40af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.151+0000 7f13bc26d640 1 -- 172.21.15.55:0/1453057165 shutdown_connections 2023-07-06T21:42:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.151+0000 7f13bc26d640 1 -- 172.21.15.55:0/1453057165 wait complete. 2023-07-06T21:42:24.175 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T21:42:24.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.311+0000 7fbd35111640 1 Processor -- start 2023-07-06T21:42:24.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.311+0000 7fbd35111640 1 -- start start 2023-07-06T21:42:24.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.315+0000 7fbd35111640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd3006fff0 0x7fbd30070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.315+0000 7fbd35111640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd300b2ca0 0x7fbd300b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.315+0000 7fbd35111640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd300cd490 con 0x7fbd301597d0 2023-07-06T21:42:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.315+0000 7fbd35111640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd30070960 con 0x7fbd3006fff0 2023-07-06T21:42:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.315+0000 7fbd35111640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3015cf60 con 0x7fbd300b2ca0 2023-07-06T21:42:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.315+0000 7fbd27fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd3006fff0 0x7fbd30070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.315+0000 7fbd27fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd3006fff0 0x7fbd30070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59680/0 (socket says 172.21.15.55:59680) 2023-07-06T21:42:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.315+0000 7fbd27fff640 1 -- 172.21.15.55:0/2772774515 learned_addr learned my addr 172.21.15.55:0/2772774515 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.315+0000 7fbd2f59e640 1 --2- 172.21.15.55:0/2772774515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd300b2ca0 0x7fbd300b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.315+0000 7fbd27fff640 1 -- 172.21.15.55:0/2772774515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd300b2ca0 msgr2=0x7fbd300b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.315+0000 7fbd27fff640 1 --2- 172.21.15.55:0/2772774515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd300b2ca0 0x7fbd300b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.315+0000 7fbd27fff640 1 -- 172.21.15.55:0/2772774515 >> v1:172.21.15.138:6789/0 conn(0x7fbd301597d0 legacy=0x7fbd300ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.315+0000 7fbd27fff640 1 -- 172.21.15.55:0/2772774515 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd300ccb60 con 0x7fbd3006fff0 2023-07-06T21:42:24.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.315+0000 7fbd2f59e640 1 --2- 172.21.15.55:0/2772774515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd300b2ca0 0x7fbd300b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:24.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.319+0000 7fbd27fff640 1 --2- 172.21.15.55:0/2772774515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd3006fff0 0x7fbd30070420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009870 tx=0x7fbd1801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b01e6b1e79a74de server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:24.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.319+0000 7fbd2e59c640 1 -- 172.21.15.55:0/2772774515 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd300b3e70 con 0x7fbd3006fff0 2023-07-06T21:42:24.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.319+0000 7fbd2e59c640 1 -- 172.21.15.55:0/2772774515 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd180ab600 con 0x7fbd3006fff0 2023-07-06T21:42:24.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.319+0000 7fbd2e59c640 1 -- 172.21.15.55:0/2772774515 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180ab990 con 0x7fbd3006fff0 2023-07-06T21:42:24.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.319+0000 7fbd35111640 1 -- 172.21.15.55:0/2772774515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd3006fff0 msgr2=0x7fbd30070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.319+0000 7fbd35111640 1 --2- 172.21.15.55:0/2772774515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd3006fff0 0x7fbd30070420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009870 tx=0x7fbd1801c440 comp rx=0 tx=0).stop 2023-07-06T21:42:24.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.319+0000 7fbd35111640 1 -- 172.21.15.55:0/2772774515 shutdown_connections 2023-07-06T21:42:24.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.319+0000 7fbd35111640 1 --2- 172.21.15.55:0/2772774515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd300b2ca0 0x7fbd300b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.319+0000 7fbd35111640 1 --2- 172.21.15.55:0/2772774515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd3006fff0 0x7fbd30070420 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.319+0000 7fbd35111640 1 -- 172.21.15.55:0/2772774515 >> 172.21.15.55:0/2772774515 conn(0x7fbd300cb970 msgr2=0x7fbd300cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.319+0000 7fbd35111640 1 -- 172.21.15.55:0/2772774515 shutdown_connections 2023-07-06T21:42:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.319+0000 7fbd35111640 1 -- 172.21.15.55:0/2772774515 wait complete. 2023-07-06T21:42:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.319+0000 7fbd35111640 1 Processor -- start 2023-07-06T21:42:24.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.319+0000 7fbd35111640 1 -- start start 2023-07-06T21:42:24.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd35111640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd3006fff0 0x7fbd301f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd35111640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd300b2ca0 0x7fbd30154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd35111640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30154ca0 0x7fbd300b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd35111640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300c75b0 con 0x7fbd3006fff0 2023-07-06T21:42:24.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd35111640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd301f7610 con 0x7fbd30154ca0 2023-07-06T21:42:24.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd35111640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd301f78f0 con 0x7fbd300b2ca0 2023-07-06T21:42:24.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd2ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd3006fff0 0x7fbd301f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd2ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd3006fff0 0x7fbd301f6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59686/0 (socket says 172.21.15.55:59686) 2023-07-06T21:42:24.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd2ed9d640 1 -- 172.21.15.55:0/1007370518 learned_addr learned my addr 172.21.15.55:0/1007370518 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd27fff640 1 --2- 172.21.15.55:0/1007370518 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd300b2ca0 0x7fbd30154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd2f59e640 1 --2- 172.21.15.55:0/1007370518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30154ca0 0x7fbd300b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd2ed9d640 1 -- 172.21.15.55:0/1007370518 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd300b2ca0 msgr2=0x7fbd30154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd2ed9d640 1 --2- 172.21.15.55:0/1007370518 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd300b2ca0 0x7fbd30154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd2ed9d640 1 -- 172.21.15.55:0/1007370518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30154ca0 msgr2=0x7fbd300b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd2ed9d640 1 --2- 172.21.15.55:0/1007370518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30154ca0 0x7fbd300b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd2ed9d640 1 -- 172.21.15.55:0/1007370518 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd180094d0 con 0x7fbd3006fff0 2023-07-06T21:42:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd2ed9d640 1 --2- 172.21.15.55:0/1007370518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd3006fff0 0x7fbd301f6d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000b410 tx=0x7fbd2000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd277fe640 1 -- 172.21.15.55:0/1007370518 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20004020 con 0x7fbd3006fff0 2023-07-06T21:42:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd277fe640 1 -- 172.21.15.55:0/1007370518 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20004180 con 0x7fbd3006fff0 2023-07-06T21:42:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd35111640 1 -- 172.21.15.55:0/1007370518 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd301f7bd0 con 0x7fbd3006fff0 2023-07-06T21:42:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd277fe640 1 -- 172.21.15.55:0/1007370518 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20011630 con 0x7fbd3006fff0 2023-07-06T21:42:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd35111640 1 -- 172.21.15.55:0/1007370518 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd301f7250 con 0x7fbd3006fff0 2023-07-06T21:42:24.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd35111640 1 -- 172.21.15.55:0/1007370518 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd300cd900 con 0x7fbd3006fff0 2023-07-06T21:42:24.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.323+0000 7fbd277fe640 1 -- 172.21.15.55:0/1007370518 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd20011790 con 0x7fbd3006fff0 2023-07-06T21:42:24.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.327+0000 7fbd277fe640 1 --2- 172.21.15.55:0/1007370518 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbd100662b0 0x7fbd10068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.327+0000 7fbd277fe640 1 -- 172.21.15.55:0/1007370518 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbd20083e10 con 0x7fbd3006fff0 2023-07-06T21:42:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.327+0000 7fbd27fff640 1 --2- 172.21.15.55:0/1007370518 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbd100662b0 0x7fbd10068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.327+0000 7fbd27fff640 1 --2- 172.21.15.55:0/1007370518 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbd100662b0 0x7fbd10068760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd180af000 tx=0x7fbd180a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:24.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.331+0000 7fbd277fe640 1 -- 172.21.15.55:0/1007370518 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbd300cd900 con 0x7fbd3006fff0 2023-07-06T21:42:24.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.495+0000 7fbd35111640 1 -- 172.21.15.55:0/1007370518 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbd300cd900 con 0x7fbd3006fff0 2023-07-06T21:42:24.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.499+0000 7fbd277fe640 1 -- 172.21.15.55:0/1007370518 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbd300cd900 con 0x7fbd3006fff0 2023-07-06T21:42:24.503 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2023-07-06T21:42:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.499+0000 7fbd35111640 1 -- 172.21.15.55:0/1007370518 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbd100662b0 msgr2=0x7fbd10068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.499+0000 7fbd35111640 1 --2- 172.21.15.55:0/1007370518 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbd100662b0 0x7fbd10068760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd180af000 tx=0x7fbd180a7000 comp rx=0 tx=0).stop 2023-07-06T21:42:24.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.499+0000 7fbd35111640 1 -- 172.21.15.55:0/1007370518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd3006fff0 msgr2=0x7fbd301f6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.499+0000 7fbd35111640 1 --2- 172.21.15.55:0/1007370518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd3006fff0 0x7fbd301f6d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000b410 tx=0x7fbd2000b8d0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.499+0000 7fbd35111640 1 -- 172.21.15.55:0/1007370518 shutdown_connections 2023-07-06T21:42:24.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.499+0000 7fbd35111640 1 --2- 172.21.15.55:0/1007370518 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbd100662b0 0x7fbd10068760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.499+0000 7fbd35111640 1 --2- 172.21.15.55:0/1007370518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30154ca0 0x7fbd300b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.499+0000 7fbd35111640 1 --2- 172.21.15.55:0/1007370518 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd300b2ca0 0x7fbd30154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.499+0000 7fbd35111640 1 --2- 172.21.15.55:0/1007370518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd3006fff0 0x7fbd301f6d10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.499+0000 7fbd35111640 1 -- 172.21.15.55:0/1007370518 >> 172.21.15.55:0/1007370518 conn(0x7fbd300cb970 msgr2=0x7fbd300cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:24.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.499+0000 7fbd35111640 1 -- 172.21.15.55:0/1007370518 shutdown_connections 2023-07-06T21:42:24.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.499+0000 7fbd35111640 1 -- 172.21.15.55:0/1007370518 wait complete. 2023-07-06T21:42:24.523 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:42:24.524 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:42:24.532 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:24.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff82a3e9640 1 Processor -- start 2023-07-06T21:42:24.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff82a3e9640 1 -- start start 2023-07-06T21:42:24.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff82a3e9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8240b7cd0 0x7ff8240ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff82a3e9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff8240b1fe0 0x7ff82415f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff82a3e9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8240cecf0 con 0x7ff8240ccab0 2023-07-06T21:42:24.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff82a3e9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8240d2310 con 0x7ff8240b1fe0 2023-07-06T21:42:24.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff82a3e9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240b80a0 con 0x7ff8240b7cd0 2023-07-06T21:42:24.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff8237fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff8240ccab0 0x7ff8240b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57456/0 (socket says 172.21.15.55:57456) 2023-07-06T21:42:24.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff8237fe640 1 -- 172.21.15.55:0/2488064762 learned_addr learned my addr 172.21.15.55:0/2488064762 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:24.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff823fff640 1 --2- 172.21.15.55:0/2488064762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8240b7cd0 0x7ff8240ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff828986640 1 --2- 172.21.15.55:0/2488064762 >> v2:172.21.15.138:3300/0 conn(0x7ff8240b1fe0 0x7ff82415f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 -- 172.21.15.55:0/2488064762 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476604225 0 0) 0x7ff8240cecf0 con 0x7ff8240ccab0 2023-07-06T21:42:24.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 -- 172.21.15.55:0/2488064762 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff80c003530 con 0x7ff8240ccab0 2023-07-06T21:42:24.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 -- 172.21.15.55:0/2488064762 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1798983663 0 0) 0x7ff80c003530 con 0x7ff8240ccab0 2023-07-06T21:42:24.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 -- 172.21.15.55:0/2488064762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8240b7cd0 msgr2=0x7ff8240ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:24.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 --2- 172.21.15.55:0/2488064762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8240b7cd0 0x7ff8240ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 -- 172.21.15.55:0/2488064762 >> v2:172.21.15.138:3300/0 conn(0x7ff8240b1fe0 msgr2=0x7ff82415f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:24.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 --2- 172.21.15.55:0/2488064762 >> v2:172.21.15.138:3300/0 conn(0x7ff8240b1fe0 0x7ff82415f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 -- 172.21.15.55:0/2488064762 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8240d1d90 con 0x7ff8240ccab0 2023-07-06T21:42:24.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 -- 172.21.15.55:0/2488064762 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7ff818001680 con 0x7ff8240ccab0 2023-07-06T21:42:24.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 -- 172.21.15.55:0/2488064762 >> v1:172.21.15.55:6789/0 conn(0x7ff8240ccab0 legacy=0x7ff8240b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 --2- 172.21.15.55:0/2488064762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c003980 0x7ff80c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 --2- 172.21.15.55:0/2488064762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff80c004360 0x7ff80c004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 --2- 172.21.15.55:0/2488064762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff80c004f40 0x7ff80c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 -- 172.21.15.55:0/2488064762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240b80a0 con 0x7ff80c004360 2023-07-06T21:42:24.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 -- 172.21.15.55:0/2488064762 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c00bed0 con 0x7ff80c004f40 2023-07-06T21:42:24.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff822ffd640 1 -- 172.21.15.55:0/2488064762 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c00c010 con 0x7ff80c003980 2023-07-06T21:42:24.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff823fff640 1 --2- 172.21.15.55:0/2488064762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8240b7cd0 0x7ff8240ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff8237fe640 1 --2- 172.21.15.55:0/2488064762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff80c004360 0x7ff80c004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff828986640 1 --2- 172.21.15.55:0/2488064762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff80c004f40 0x7ff80c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff823fff640 1 --2- 172.21.15.55:0/2488064762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c003980 0x7ff80c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff8237fe640 1 -- 172.21.15.55:0/2488064762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c003980 msgr2=0x7ff80c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff8237fe640 1 --2- 172.21.15.55:0/2488064762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c003980 0x7ff80c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff8237fe640 1 -- 172.21.15.55:0/2488064762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff80c004f40 msgr2=0x7ff80c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff8237fe640 1 --2- 172.21.15.55:0/2488064762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff80c004f40 0x7ff80c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff8237fe640 1 -- 172.21.15.55:0/2488064762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c003530 con 0x7ff80c004360 2023-07-06T21:42:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.711+0000 7ff828986640 1 --2- 172.21.15.55:0/2488064762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff80c004f40 0x7ff80c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:24.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.715+0000 7ff8237fe640 1 --2- 172.21.15.55:0/2488064762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff80c004360 0x7ff80c004830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff81800c270 tx=0x7ff81801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17df031f85105fbe server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:24.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.715+0000 7ff822ffd640 1 -- 172.21.15.55:0/2488064762 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8180058e0 con 0x7ff80c004360 2023-07-06T21:42:24.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.715+0000 7ff822ffd640 1 -- 172.21.15.55:0/2488064762 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff818005a40 con 0x7ff80c004360 2023-07-06T21:42:24.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.715+0000 7ff822ffd640 1 -- 172.21.15.55:0/2488064762 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff818005e50 con 0x7ff80c004360 2023-07-06T21:42:24.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.715+0000 7ff82a3e9640 1 -- 172.21.15.55:0/2488064762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff80c004360 msgr2=0x7ff80c004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.715+0000 7ff82a3e9640 1 --2- 172.21.15.55:0/2488064762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff80c004360 0x7ff80c004830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff81800c270 tx=0x7ff81801cc60 comp rx=0 tx=0).stop 2023-07-06T21:42:24.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.715+0000 7ff828986640 1 -- 172.21.15.55:0/2488064762 reap_dead start 2023-07-06T21:42:24.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.715+0000 7ff82a3e9640 1 -- 172.21.15.55:0/2488064762 shutdown_connections 2023-07-06T21:42:24.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.715+0000 7ff82a3e9640 1 -- 172.21.15.55:0/2488064762 >> 172.21.15.55:0/2488064762 conn(0x7ff8240ceee0 msgr2=0x7ff8240cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:24.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.715+0000 7ff82a3e9640 1 -- 172.21.15.55:0/2488064762 shutdown_connections 2023-07-06T21:42:24.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.715+0000 7ff82a3e9640 1 -- 172.21.15.55:0/2488064762 wait complete. 2023-07-06T21:42:24.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff82a3e9640 1 Processor -- start 2023-07-06T21:42:24.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff82a3e9640 1 -- start start 2023-07-06T21:42:24.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff82a3e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff80c004360 0x7ff8240cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff82a3e9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff824159100 0x7ff8240c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff82a3e9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8240b63a0 0x7ff8240b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff82a3e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240cbce0 con 0x7ff80c004360 2023-07-06T21:42:24.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff82a3e9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240cbfc0 con 0x7ff824159100 2023-07-06T21:42:24.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff82a3e9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240cc2a0 con 0x7ff8240b63a0 2023-07-06T21:42:24.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff823fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff80c004360 0x7ff8240cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff823fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff80c004360 0x7ff8240cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59696/0 (socket says 172.21.15.55:59696) 2023-07-06T21:42:24.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff823fff640 1 -- 172.21.15.55:0/3338572898 learned_addr learned my addr 172.21.15.55:0/3338572898 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:24.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff8237fe640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff824159100 0x7ff8240c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff828986640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8240b63a0 0x7ff8240b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff823fff640 1 -- 172.21.15.55:0/3338572898 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8240b63a0 msgr2=0x7ff8240b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff823fff640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8240b63a0 0x7ff8240b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff823fff640 1 -- 172.21.15.55:0/3338572898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff824159100 msgr2=0x7ff8240c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff823fff640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff824159100 0x7ff8240c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff823fff640 1 -- 172.21.15.55:0/3338572898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff824156380 con 0x7ff80c004360 2023-07-06T21:42:24.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff8237fe640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff824159100 0x7ff8240c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:24.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff823fff640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff80c004360 0x7ff8240cb6e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff8140115f0 tx=0x7ff8140116e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:24.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff820ff9640 1 -- 172.21.15.55:0/3338572898 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814015870 con 0x7ff80c004360 2023-07-06T21:42:24.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff820ff9640 1 -- 172.21.15.55:0/3338572898 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8140159d0 con 0x7ff80c004360 2023-07-06T21:42:24.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff82a3e9640 1 -- 172.21.15.55:0/3338572898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8240c8c90 con 0x7ff80c004360 2023-07-06T21:42:24.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff820ff9640 1 -- 172.21.15.55:0/3338572898 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814015d80 con 0x7ff80c004360 2023-07-06T21:42:24.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.719+0000 7ff82a3e9640 1 -- 172.21.15.55:0/3338572898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8240b59a0 con 0x7ff80c004360 2023-07-06T21:42:24.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.723+0000 7ff82a3e9640 1 -- 172.21.15.55:0/3338572898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8241561e0 con 0x7ff80c004360 2023-07-06T21:42:24.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.723+0000 7ff820ff9640 1 -- 172.21.15.55:0/3338572898 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8140143e0 con 0x7ff80c004360 2023-07-06T21:42:24.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.723+0000 7ff820ff9640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff810066280 0x7ff810068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:24.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.723+0000 7ff820ff9640 1 -- 172.21.15.55:0/3338572898 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff814084260 con 0x7ff80c004360 2023-07-06T21:42:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.723+0000 7ff8237fe640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff810066280 0x7ff810068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.723+0000 7ff8237fe640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff810066280 0x7ff810068730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff8180aa000 tx=0x7ff818001a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.727+0000 7ff820ff9640 1 -- 172.21.15.55:0/3338572898 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8241561e0 con 0x7ff80c004360 2023-07-06T21:42:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.883+0000 7ff82a3e9640 1 -- 172.21.15.55:0/3338572898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8241561e0 con 0x7ff80c004360 2023-07-06T21:42:24.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.883+0000 7ff820ff9640 1 -- 172.21.15.55:0/3338572898 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7ff8241561e0 con 0x7ff80c004360 2023-07-06T21:42:24.889 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:24.889 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:15.295464+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:24.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.887+0000 7ff82a3e9640 1 -- 172.21.15.55:0/3338572898 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff810066280 msgr2=0x7ff810068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.887+0000 7ff82a3e9640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff810066280 0x7ff810068730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff8180aa000 tx=0x7ff818001a80 comp rx=0 tx=0).stop 2023-07-06T21:42:24.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.887+0000 7ff82a3e9640 1 -- 172.21.15.55:0/3338572898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff80c004360 msgr2=0x7ff8240cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:24.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.887+0000 7ff82a3e9640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff80c004360 0x7ff8240cb6e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff8140115f0 tx=0x7ff8140116e0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.887+0000 7ff82a3e9640 1 -- 172.21.15.55:0/3338572898 shutdown_connections 2023-07-06T21:42:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.887+0000 7ff82a3e9640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff810066280 0x7ff810068730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.887+0000 7ff82a3e9640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8240b63a0 0x7ff8240b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.887+0000 7ff82a3e9640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff824159100 0x7ff8240c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.887+0000 7ff82a3e9640 1 --2- 172.21.15.55:0/3338572898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff80c004360 0x7ff8240cb6e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.887+0000 7ff82a3e9640 1 -- 172.21.15.55:0/3338572898 >> 172.21.15.55:0/3338572898 conn(0x7ff8240ceee0 msgr2=0x7ff8240b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.887+0000 7ff82a3e9640 1 -- 172.21.15.55:0/3338572898 shutdown_connections 2023-07-06T21:42:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:24.887+0000 7ff82a3e9640 1 -- 172.21.15.55:0/3338572898 wait complete. 2023-07-06T21:42:24.910 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:42:08.597013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:42:09.843890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T21:42:12.918111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T21:42:24.912 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:42:25.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.051+0000 7f32a5448640 1 Processor -- start 2023-07-06T21:42:25.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.051+0000 7f32a5448640 1 -- start start 2023-07-06T21:42:25.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f32a5448640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f32a00709a0 0x7f32a00cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f32a5448640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f32a00cbe60 0x7f32a00b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f32a5448640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a00cc300 con 0x7f32a0070d70 2023-07-06T21:42:25.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f32a5448640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a00cc5e0 con 0x7f32a00709a0 2023-07-06T21:42:25.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f32a5448640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a00cc8c0 con 0x7f32a00cbe60 2023-07-06T21:42:25.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f329effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f32a00709a0 0x7f32a00cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f329f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f32a0070d70 0x7f32a015d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57462/0 (socket says 172.21.15.55:57462) 2023-07-06T21:42:25.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f329effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f32a00709a0 0x7f32a00cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59712/0 (socket says 172.21.15.55:59712) 2023-07-06T21:42:25.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f329f7fe640 1 -- 172.21.15.55:0/1562063162 learned_addr learned my addr 172.21.15.55:0/1562063162 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:25.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f3297fff640 1 --2- 172.21.15.55:0/1562063162 >> v2:172.21.15.138:3300/0 conn(0x7f32a00cbe60 0x7f32a00b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f329effd640 1 -- 172.21.15.55:0/1562063162 >> v2:172.21.15.138:3300/0 conn(0x7f32a00cbe60 msgr2=0x7f32a00b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:25.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f329effd640 1 --2- 172.21.15.55:0/1562063162 >> v2:172.21.15.138:3300/0 conn(0x7f32a00cbe60 0x7f32a00b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f329effd640 1 -- 172.21.15.55:0/1562063162 >> v1:172.21.15.55:6789/0 conn(0x7f32a0070d70 legacy=0x7f32a015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f329e7fc640 1 -- 172.21.15.55:0/1562063162 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317001054 0 0) 0x7f32a00cc300 con 0x7f32a0070d70 2023-07-06T21:42:25.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f329effd640 1 -- 172.21.15.55:0/1562063162 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a00ccba0 con 0x7f32a00709a0 2023-07-06T21:42:25.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.055+0000 7f3297fff640 1 --2- 172.21.15.55:0/1562063162 >> v2:172.21.15.138:3300/0 conn(0x7f32a00cbe60 0x7f32a00b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:25.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.059+0000 7f329effd640 1 --2- 172.21.15.55:0/1562063162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a00709a0 0x7f32a00cb920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f32a00ca7c0 tx=0x7f329001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330f8e7eb86ae563 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:25.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.059+0000 7f329e7fc640 1 -- 172.21.15.55:0/1562063162 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32900ab600 con 0x7f32a00709a0 2023-07-06T21:42:25.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.059+0000 7f329e7fc640 1 -- 172.21.15.55:0/1562063162 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32900a7050 con 0x7f32a00709a0 2023-07-06T21:42:25.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.059+0000 7f329e7fc640 1 -- 172.21.15.55:0/1562063162 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32900ab980 con 0x7f32a00709a0 2023-07-06T21:42:25.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.059+0000 7f32a5448640 1 -- 172.21.15.55:0/1562063162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a00709a0 msgr2=0x7f32a00cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.059+0000 7f32a5448640 1 --2- 172.21.15.55:0/1562063162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a00709a0 0x7f32a00cb920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f32a00ca7c0 tx=0x7f329001c460 comp rx=0 tx=0).stop 2023-07-06T21:42:25.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.059+0000 7f32a5448640 1 -- 172.21.15.55:0/1562063162 shutdown_connections 2023-07-06T21:42:25.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.059+0000 7f32a5448640 1 --2- 172.21.15.55:0/1562063162 >> v2:172.21.15.138:3300/0 conn(0x7f32a00cbe60 0x7f32a00b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.059+0000 7f32a5448640 1 --2- 172.21.15.55:0/1562063162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a00709a0 0x7f32a00cb920 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.059+0000 7f32a5448640 1 -- 172.21.15.55:0/1562063162 >> 172.21.15.55:0/1562063162 conn(0x7f32a00cea70 msgr2=0x7f32a00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:25.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.059+0000 7f32a5448640 1 -- 172.21.15.55:0/1562063162 shutdown_connections 2023-07-06T21:42:25.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.059+0000 7f32a5448640 1 -- 172.21.15.55:0/1562063162 wait complete. 2023-07-06T21:42:25.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.059+0000 7f32a5448640 1 Processor -- start 2023-07-06T21:42:25.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.059+0000 7f32a5448640 1 -- start start 2023-07-06T21:42:25.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f32a5448640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a00709a0 0x7f32a014a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f32a5448640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32a0070d70 0x7f32a014a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f32a5448640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32a00cbe60 0x7f32a00c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f32a5448640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a00c3960 con 0x7f32a00709a0 2023-07-06T21:42:25.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f32a5448640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a015c6b0 con 0x7f32a0070d70 2023-07-06T21:42:25.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f32a5448640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a015c3d0 con 0x7f32a00cbe60 2023-07-06T21:42:25.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f329effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a00709a0 0x7f32a014a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f329effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a00709a0 0x7f32a014a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59714/0 (socket says 172.21.15.55:59714) 2023-07-06T21:42:25.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f329effd640 1 -- 172.21.15.55:0/549646645 learned_addr learned my addr 172.21.15.55:0/549646645 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:25.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f3297fff640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32a0070d70 0x7f32a014a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f329f7fe640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32a00cbe60 0x7f32a00c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f329effd640 1 -- 172.21.15.55:0/549646645 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32a00cbe60 msgr2=0x7f32a00c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f329effd640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32a00cbe60 0x7f32a00c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f329effd640 1 -- 172.21.15.55:0/549646645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32a0070d70 msgr2=0x7f32a014a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f329effd640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32a0070d70 0x7f32a014a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f329effd640 1 -- 172.21.15.55:0/549646645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3290009420 con 0x7f32a00709a0 2023-07-06T21:42:25.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f3297fff640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32a0070d70 0x7f32a014a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:25.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f329f7fe640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32a00cbe60 0x7f32a00c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:25.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f329effd640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a00709a0 0x7f32a014a350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f32900ae040 tx=0x7f329001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:25.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f32977fe640 1 -- 172.21.15.55:0/549646645 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32900b7650 con 0x7f32a00709a0 2023-07-06T21:42:25.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f32977fe640 1 -- 172.21.15.55:0/549646645 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32900b77b0 con 0x7f32a00709a0 2023-07-06T21:42:25.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f32977fe640 1 -- 172.21.15.55:0/549646645 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32900b7b60 con 0x7f32a00709a0 2023-07-06T21:42:25.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f32a5448640 1 -- 172.21.15.55:0/549646645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a014af20 con 0x7f32a00709a0 2023-07-06T21:42:25.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f32a5448640 1 -- 172.21.15.55:0/549646645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a014b200 con 0x7f32a00709a0 2023-07-06T21:42:25.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f32a5448640 1 -- 172.21.15.55:0/549646645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a0066d60 con 0x7f32a00709a0 2023-07-06T21:42:25.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.063+0000 7f32977fe640 1 -- 172.21.15.55:0/549646645 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f32900b7cc0 con 0x7f32a00709a0 2023-07-06T21:42:25.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.067+0000 7f32977fe640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3280066280 0x7f3280068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.067+0000 7f32977fe640 1 -- 172.21.15.55:0/549646645 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f329011e9b0 con 0x7f32a00709a0 2023-07-06T21:42:25.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.067+0000 7f3297fff640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3280066280 0x7f3280068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.067+0000 7f3297fff640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3280066280 0x7f3280068730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32a00c7c70 tx=0x7f3288008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:25.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.071+0000 7f32977fe640 1 -- 172.21.15.55:0/549646645 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f32900ebaa0 con 0x7f32a00709a0 2023-07-06T21:42:25.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.223+0000 7f32a5448640 1 -- 172.21.15.55:0/549646645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32a00b0780 con 0x7f32a00709a0 2023-07-06T21:42:25.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.227+0000 7f32977fe640 1 -- 172.21.15.55:0/549646645 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32900ef0c0 con 0x7f32a00709a0 2023-07-06T21:42:25.231 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:42:25.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.227+0000 7f32a5448640 1 -- 172.21.15.55:0/549646645 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3280066280 msgr2=0x7f3280068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.227+0000 7f32a5448640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3280066280 0x7f3280068730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32a00c7c70 tx=0x7f3288008040 comp rx=0 tx=0).stop 2023-07-06T21:42:25.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.227+0000 7f32a5448640 1 -- 172.21.15.55:0/549646645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a00709a0 msgr2=0x7f32a014a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.227+0000 7f32a5448640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a00709a0 0x7f32a014a350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f32900ae040 tx=0x7f329001aca0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.227+0000 7f32a5448640 1 -- 172.21.15.55:0/549646645 shutdown_connections 2023-07-06T21:42:25.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.227+0000 7f32a5448640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3280066280 0x7f3280068730 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.227+0000 7f32a5448640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32a00cbe60 0x7f32a00c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.227+0000 7f32a5448640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32a0070d70 0x7f32a014a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.227+0000 7f32a5448640 1 --2- 172.21.15.55:0/549646645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a00709a0 0x7f32a014a350 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.227+0000 7f32a5448640 1 -- 172.21.15.55:0/549646645 >> 172.21.15.55:0/549646645 conn(0x7f32a00cea70 msgr2=0x7f32a00af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:25.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.227+0000 7f32a5448640 1 -- 172.21.15.55:0/549646645 shutdown_connections 2023-07-06T21:42:25.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.227+0000 7f32a5448640 1 -- 172.21.15.55:0/549646645 wait complete. 2023-07-06T21:42:25.252 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:42:25.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f130367b640 1 Processor -- start 2023-07-06T21:42:25.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f130367b640 1 -- start start 2023-07-06T21:42:25.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f130367b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12fc156180 0x7f12fc0ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f130367b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f12fc06e9d0 0x7f12fc06ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f130367b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f12fc0cb7a0 0x7f12fc0cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f130367b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12fc160250 con 0x7f12fc06e9d0 2023-07-06T21:42:25.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f130367b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12fc06f360 con 0x7f12fc0cb7a0 2023-07-06T21:42:25.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f130367b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc15f5d0 con 0x7f12fc156180 2023-07-06T21:42:25.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f1300c16640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f12fc06e9d0 0x7f12fc06ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f1300c16640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f12fc06e9d0 0x7f12fc06ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59728/0 (socket says 172.21.15.55:59728) 2023-07-06T21:42:25.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f1300c16640 1 -- 172.21.15.55:0/845311377 learned_addr learned my addr 172.21.15.55:0/845311377 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:25.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f1301c18640 1 --2- 172.21.15.55:0/845311377 >> v2:172.21.15.138:3300/0 conn(0x7f12fc0cb7a0 0x7f12fc0cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f1301417640 1 --2- 172.21.15.55:0/845311377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12fc156180 0x7f12fc0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f1300c16640 1 -- 172.21.15.55:0/845311377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12fc156180 msgr2=0x7f12fc0ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:25.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f1300c16640 1 --2- 172.21.15.55:0/845311377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12fc156180 0x7f12fc0ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f1300c16640 1 -- 172.21.15.55:0/845311377 >> v2:172.21.15.138:3300/0 conn(0x7f12fc0cb7a0 msgr2=0x7f12fc0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f1300c16640 1 --2- 172.21.15.55:0/845311377 >> v2:172.21.15.138:3300/0 conn(0x7f12fc0cb7a0 0x7f12fc0cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f1300c16640 1 -- 172.21.15.55:0/845311377 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc15f8b0 con 0x7f12fc06e9d0 2023-07-06T21:42:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f1301417640 1 --2- 172.21.15.55:0/845311377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12fc156180 0x7f12fc0ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.395+0000 7f1301c18640 1 --2- 172.21.15.55:0/845311377 >> v2:172.21.15.138:3300/0 conn(0x7f12fc0cb7a0 0x7f12fc0cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:25.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f1300c16640 1 --2- 172.21.15.55:0/845311377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12fc06e9d0 0x7f12fc06ee20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f12fc072220 tx=0x7f12ec01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8025a1e24cf1661 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:25.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f12f3fff640 1 -- 172.21.15.55:0/845311377 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0ab600 con 0x7f12fc06e9d0 2023-07-06T21:42:25.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f12f3fff640 1 -- 172.21.15.55:0/845311377 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec0ab760 con 0x7f12fc06e9d0 2023-07-06T21:42:25.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f12f3fff640 1 -- 172.21.15.55:0/845311377 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0abaf0 con 0x7f12fc06e9d0 2023-07-06T21:42:25.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f130367b640 1 -- 172.21.15.55:0/845311377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12fc06e9d0 msgr2=0x7f12fc06ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f130367b640 1 --2- 172.21.15.55:0/845311377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12fc06e9d0 0x7f12fc06ee20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f12fc072220 tx=0x7f12ec01c440 comp rx=0 tx=0).stop 2023-07-06T21:42:25.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f130367b640 1 -- 172.21.15.55:0/845311377 shutdown_connections 2023-07-06T21:42:25.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f130367b640 1 --2- 172.21.15.55:0/845311377 >> v2:172.21.15.138:3300/0 conn(0x7f12fc0cb7a0 0x7f12fc0cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f130367b640 1 --2- 172.21.15.55:0/845311377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12fc06e9d0 0x7f12fc06ee20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f130367b640 1 --2- 172.21.15.55:0/845311377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12fc156180 0x7f12fc0ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f130367b640 1 -- 172.21.15.55:0/845311377 >> 172.21.15.55:0/845311377 conn(0x7f12fc0d0c50 msgr2=0x7f12fc0cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:25.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f130367b640 1 -- 172.21.15.55:0/845311377 shutdown_connections 2023-07-06T21:42:25.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f130367b640 1 -- 172.21.15.55:0/845311377 wait complete. 2023-07-06T21:42:25.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f130367b640 1 Processor -- start 2023-07-06T21:42:25.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.399+0000 7f130367b640 1 -- start start 2023-07-06T21:42:25.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f130367b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f12fc06e9d0 0x7f12fc155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f130367b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12fc0cb7a0 0x7f12fc0afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f130367b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12fc156180 0x7f12fc0c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f130367b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc149ef0 con 0x7f12fc156180 2023-07-06T21:42:25.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f130367b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc155ad0 con 0x7f12fc06e9d0 2023-07-06T21:42:25.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f130367b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc14ebe0 con 0x7f12fc0cb7a0 2023-07-06T21:42:25.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f1301c18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12fc156180 0x7f12fc0c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f1301c18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12fc156180 0x7f12fc0c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59736/0 (socket says 172.21.15.55:59736) 2023-07-06T21:42:25.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f1301c18640 1 -- 172.21.15.55:0/1706686197 learned_addr learned my addr 172.21.15.55:0/1706686197 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:25.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f1300c16640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12fc0cb7a0 0x7f12fc0afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f1301417640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f12fc06e9d0 0x7f12fc155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f1301c18640 1 -- 172.21.15.55:0/1706686197 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12fc0cb7a0 msgr2=0x7f12fc0afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f1301c18640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12fc0cb7a0 0x7f12fc0afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f1301c18640 1 -- 172.21.15.55:0/1706686197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f12fc06e9d0 msgr2=0x7f12fc155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f1301c18640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f12fc06e9d0 0x7f12fc155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f1301c18640 1 -- 172.21.15.55:0/1706686197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec0094d0 con 0x7f12fc156180 2023-07-06T21:42:25.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f1301417640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f12fc06e9d0 0x7f12fc155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f1301c18640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12fc156180 0x7f12fc0c5b00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f12f4007e10 tx=0x7f12f400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f12f1ffb640 1 -- 172.21.15.55:0/1706686197 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4003ba0 con 0x7f12fc156180 2023-07-06T21:42:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f12f1ffb640 1 -- 172.21.15.55:0/1706686197 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f400f040 con 0x7f12fc156180 2023-07-06T21:42:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f12f1ffb640 1 -- 172.21.15.55:0/1706686197 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f400de80 con 0x7f12fc156180 2023-07-06T21:42:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f130367b640 1 -- 172.21.15.55:0/1706686197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12fc14eec0 con 0x7f12fc156180 2023-07-06T21:42:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f130367b640 1 -- 172.21.15.55:0/1706686197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12fc14f480 con 0x7f12fc156180 2023-07-06T21:42:25.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f130367b640 1 -- 172.21.15.55:0/1706686197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12fc14f670 con 0x7f12fc156180 2023-07-06T21:42:25.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.403+0000 7f12f1ffb640 1 -- 172.21.15.55:0/1706686197 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12f4004030 con 0x7f12fc156180 2023-07-06T21:42:25.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.407+0000 7f12f1ffb640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f12e0066280 0x7f12e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.407+0000 7f12f1ffb640 1 -- 172.21.15.55:0/1706686197 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f12f4084410 con 0x7f12fc156180 2023-07-06T21:42:25.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.407+0000 7f1301417640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f12e0066280 0x7f12e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.407+0000 7f1301417640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f12e0066280 0x7f12e0068730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f12f800b990 tx=0x7f12f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:25.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.411+0000 7f12f1ffb640 1 -- 172.21.15.55:0/1706686197 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12f4051520 con 0x7f12fc156180 2023-07-06T21:42:25.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.563+0000 7f130367b640 1 -- 172.21.15.55:0/1706686197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f12fc066d60 con 0x7f12fc156180 2023-07-06T21:42:25.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.563+0000 7f12f1ffb640 1 -- 172.21.15.55:0/1706686197 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f12f401a020 con 0x7f12fc156180 2023-07-06T21:42:25.571 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:42:25.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.567+0000 7f130367b640 1 -- 172.21.15.55:0/1706686197 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f12e0066280 msgr2=0x7f12e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.567+0000 7f130367b640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f12e0066280 0x7f12e0068730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f12f800b990 tx=0x7f12f8008040 comp rx=0 tx=0).stop 2023-07-06T21:42:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.567+0000 7f130367b640 1 -- 172.21.15.55:0/1706686197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12fc156180 msgr2=0x7f12fc0c5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.567+0000 7f130367b640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12fc156180 0x7f12fc0c5b00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f12f4007e10 tx=0x7f12f400d4a0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.567+0000 7f130367b640 1 -- 172.21.15.55:0/1706686197 shutdown_connections 2023-07-06T21:42:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.567+0000 7f130367b640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f12e0066280 0x7f12e0068730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.567+0000 7f130367b640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12fc156180 0x7f12fc0c5b00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.567+0000 7f130367b640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12fc0cb7a0 0x7f12fc0afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.567+0000 7f130367b640 1 --2- 172.21.15.55:0/1706686197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f12fc06e9d0 0x7f12fc155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.567+0000 7f130367b640 1 -- 172.21.15.55:0/1706686197 >> 172.21.15.55:0/1706686197 conn(0x7f12fc0d0c50 msgr2=0x7f12fc15e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.567+0000 7f130367b640 1 -- 172.21.15.55:0/1706686197 shutdown_connections 2023-07-06T21:42:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.567+0000 7f130367b640 1 -- 172.21.15.55:0/1706686197 wait complete. 2023-07-06T21:42:25.591 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:42:25.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.731+0000 7fcf99807640 1 Processor -- start 2023-07-06T21:42:25.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.731+0000 7fcf99807640 1 -- start start 2023-07-06T21:42:25.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf99807640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf940ca130 0x7fcf940703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf99807640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf940cd140 0x7fcf94070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf99807640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf94158c20 con 0x7fcf94158850 2023-07-06T21:42:25.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf99807640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf940b2aa0 con 0x7fcf940ca130 2023-07-06T21:42:25.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf99807640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940c8db0 con 0x7fcf940cd140 2023-07-06T21:42:25.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf927fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf940ca130 0x7fcf940703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf927fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf940ca130 0x7fcf940703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59742/0 (socket says 172.21.15.55:59742) 2023-07-06T21:42:25.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf927fc640 1 -- 172.21.15.55:0/1525709025 learned_addr learned my addr 172.21.15.55:0/1525709025 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf937fe640 1 --2- 172.21.15.55:0/1525709025 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf940cd140 0x7fcf94070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf927fc640 1 -- 172.21.15.55:0/1525709025 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf940cd140 msgr2=0x7fcf94070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf927fc640 1 --2- 172.21.15.55:0/1525709025 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf940cd140 0x7fcf94070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf927fc640 1 -- 172.21.15.55:0/1525709025 >> v1:172.21.15.138:6789/0 conn(0x7fcf94158850 legacy=0x7fcf940cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf927fc640 1 -- 172.21.15.55:0/1525709025 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf940c9090 con 0x7fcf940ca130 2023-07-06T21:42:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf937fe640 1 --2- 172.21.15.55:0/1525709025 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf940cd140 0x7fcf94070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf927fc640 1 --2- 172.21.15.55:0/1525709025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf940ca130 0x7fcf940703e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009870 tx=0x7fcf8801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68ed1091a43742c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf91ffb640 1 -- 172.21.15.55:0/1525709025 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf880a89b0 con 0x7fcf940ca130 2023-07-06T21:42:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf91ffb640 1 -- 172.21.15.55:0/1525709025 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf880a8b10 con 0x7fcf940ca130 2023-07-06T21:42:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.735+0000 7fcf91ffb640 1 -- 172.21.15.55:0/1525709025 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf880a8ea0 con 0x7fcf940ca130 2023-07-06T21:42:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 -- 172.21.15.55:0/1525709025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf940ca130 msgr2=0x7fcf940703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 --2- 172.21.15.55:0/1525709025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf940ca130 0x7fcf940703e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009870 tx=0x7fcf8801ecf0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 -- 172.21.15.55:0/1525709025 shutdown_connections 2023-07-06T21:42:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 --2- 172.21.15.55:0/1525709025 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf940cd140 0x7fcf94070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 --2- 172.21.15.55:0/1525709025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf940ca130 0x7fcf940703e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 -- 172.21.15.55:0/1525709025 >> 172.21.15.55:0/1525709025 conn(0x7fcf940cea70 msgr2=0x7fcf940ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:25.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 -- 172.21.15.55:0/1525709025 shutdown_connections 2023-07-06T21:42:25.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 -- 172.21.15.55:0/1525709025 wait complete. 2023-07-06T21:42:25.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 Processor -- start 2023-07-06T21:42:25.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 -- start start 2023-07-06T21:42:25.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf940ca130 0x7fcf940afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf940cd140 0x7fcf94155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf94158850 0x7fcf940c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940af6b0 con 0x7fcf940cd140 2023-07-06T21:42:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940aea30 con 0x7fcf94158850 2023-07-06T21:42:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf99807640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940aed10 con 0x7fcf940ca130 2023-07-06T21:42:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf927fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf940cd140 0x7fcf94155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf927fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf940cd140 0x7fcf94155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59750/0 (socket says 172.21.15.55:59750) 2023-07-06T21:42:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf927fc640 1 -- 172.21.15.55:0/1932272210 learned_addr learned my addr 172.21.15.55:0/1932272210 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf937fe640 1 --2- 172.21.15.55:0/1932272210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf94158850 0x7fcf940c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.739+0000 7fcf92ffd640 1 --2- 172.21.15.55:0/1932272210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf940ca130 0x7fcf940afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf927fc640 1 -- 172.21.15.55:0/1932272210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf940ca130 msgr2=0x7fcf940afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf927fc640 1 --2- 172.21.15.55:0/1932272210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf940ca130 0x7fcf940afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf927fc640 1 -- 172.21.15.55:0/1932272210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf94158850 msgr2=0x7fcf940c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf927fc640 1 --2- 172.21.15.55:0/1932272210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf94158850 0x7fcf940c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf927fc640 1 -- 172.21.15.55:0/1932272210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf880094d0 con 0x7fcf940cd140 2023-07-06T21:42:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf927fc640 1 --2- 172.21.15.55:0/1932272210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf940cd140 0x7fcf94155670 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcf880b3040 tx=0x7fcf8801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf7bfff640 1 -- 172.21.15.55:0/1932272210 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf880a89b0 con 0x7fcf940cd140 2023-07-06T21:42:25.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf7bfff640 1 -- 172.21.15.55:0/1932272210 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf880bb480 con 0x7fcf940cd140 2023-07-06T21:42:25.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf7bfff640 1 -- 172.21.15.55:0/1932272210 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf880bb850 con 0x7fcf940cd140 2023-07-06T21:42:25.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf99807640 1 -- 172.21.15.55:0/1932272210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf940aeff0 con 0x7fcf940cd140 2023-07-06T21:42:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf99807640 1 -- 172.21.15.55:0/1932272210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf94156100 con 0x7fcf940cd140 2023-07-06T21:42:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf99807640 1 -- 172.21.15.55:0/1932272210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf940af7f0 con 0x7fcf940cd140 2023-07-06T21:42:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf7bfff640 1 -- 172.21.15.55:0/1932272210 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf880bb9b0 con 0x7fcf940cd140 2023-07-06T21:42:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf7bfff640 1 --2- 172.21.15.55:0/1932272210 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcf80066280 0x7fcf80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf7bfff640 1 -- 172.21.15.55:0/1932272210 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf88122970 con 0x7fcf940cd140 2023-07-06T21:42:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.743+0000 7fcf92ffd640 1 --2- 172.21.15.55:0/1932272210 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcf80066280 0x7fcf80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.747+0000 7fcf92ffd640 1 --2- 172.21.15.55:0/1932272210 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcf80066280 0x7fcf80068730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400b810 tx=0x7fcf84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.747+0000 7fcf7bfff640 1 -- 172.21.15.55:0/1932272210 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf940af7f0 con 0x7fcf940cd140 2023-07-06T21:42:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.903+0000 7fcf99807640 1 -- 172.21.15.55:0/1932272210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf940af7f0 con 0x7fcf940cd140 2023-07-06T21:42:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.903+0000 7fcf7bfff640 1 -- 172.21.15.55:0/1932272210 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcf940af7f0 con 0x7fcf940cd140 2023-07-06T21:42:25.908 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:25.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.903+0000 7fcf99807640 1 -- 172.21.15.55:0/1932272210 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcf80066280 msgr2=0x7fcf80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.903+0000 7fcf99807640 1 --2- 172.21.15.55:0/1932272210 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcf80066280 0x7fcf80068730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400b810 tx=0x7fcf84008040 comp rx=0 tx=0).stop 2023-07-06T21:42:25.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.903+0000 7fcf99807640 1 -- 172.21.15.55:0/1932272210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf940cd140 msgr2=0x7fcf94155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:25.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.903+0000 7fcf99807640 1 --2- 172.21.15.55:0/1932272210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf940cd140 0x7fcf94155670 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcf880b3040 tx=0x7fcf8801ba90 comp rx=0 tx=0).stop 2023-07-06T21:42:25.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.903+0000 7fcf99807640 1 -- 172.21.15.55:0/1932272210 shutdown_connections 2023-07-06T21:42:25.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.903+0000 7fcf99807640 1 --2- 172.21.15.55:0/1932272210 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcf80066280 0x7fcf80068730 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.903+0000 7fcf99807640 1 --2- 172.21.15.55:0/1932272210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf94158850 0x7fcf940c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.903+0000 7fcf99807640 1 --2- 172.21.15.55:0/1932272210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf940cd140 0x7fcf94155670 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.903+0000 7fcf99807640 1 --2- 172.21.15.55:0/1932272210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf940ca130 0x7fcf940afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:25.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.903+0000 7fcf99807640 1 -- 172.21.15.55:0/1932272210 >> 172.21.15.55:0/1932272210 conn(0x7fcf940cea70 msgr2=0x7fcf940c4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:25.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.903+0000 7fcf99807640 1 -- 172.21.15.55:0/1932272210 shutdown_connections 2023-07-06T21:42:25.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:25.903+0000 7fcf99807640 1 -- 172.21.15.55:0/1932272210 wait complete. 2023-07-06T21:42:25.928 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:42:26.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.067+0000 7f0aa6920640 1 Processor -- start 2023-07-06T21:42:26.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.067+0000 7f0aa6920640 1 -- start start 2023-07-06T21:42:26.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.071+0000 7f0aa6920640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aa00b1250 0x7f0aa015f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.071+0000 7f0aa6920640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0aa00d0630 0x7f0aa015f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.071+0000 7f0aa6920640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa00cc740 con 0x7f0aa015fe00 2023-07-06T21:42:26.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.071+0000 7f0aa6920640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa00ccc90 con 0x7f0aa00d0630 2023-07-06T21:42:26.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.071+0000 7f0aa6920640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00d1d10 con 0x7f0aa00b1250 2023-07-06T21:42:26.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.071+0000 7f0aa591e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aa00b1250 0x7f0aa015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.071+0000 7f0aa611f640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f0aa015fe00 0x7f0aa00b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:47454/0 (socket says 172.21.15.55:47454) 2023-07-06T21:42:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.071+0000 7f0aa611f640 1 -- 172.21.15.55:0/1325804004 learned_addr learned my addr 172.21.15.55:0/1325804004 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.071+0000 7f0aa511d640 1 --2- 172.21.15.55:0/1325804004 >> v2:172.21.15.138:3300/0 conn(0x7f0aa00d0630 0x7f0aa015f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.071+0000 7f0aa591e640 1 -- 172.21.15.55:0/1325804004 >> v2:172.21.15.138:3300/0 conn(0x7f0aa00d0630 msgr2=0x7f0aa015f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.071+0000 7f0aa591e640 1 --2- 172.21.15.55:0/1325804004 >> v2:172.21.15.138:3300/0 conn(0x7f0aa00d0630 0x7f0aa015f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.071+0000 7f0aa591e640 1 -- 172.21.15.55:0/1325804004 >> v1:172.21.15.138:6789/0 conn(0x7f0aa015fe00 legacy=0x7f0aa00b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.071+0000 7f0aa591e640 1 -- 172.21.15.55:0/1325804004 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa00cc9b0 con 0x7f0aa00b1250 2023-07-06T21:42:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.071+0000 7f0aa511d640 1 --2- 172.21.15.55:0/1325804004 >> v2:172.21.15.138:3300/0 conn(0x7f0aa00d0630 0x7f0aa015f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.075+0000 7f0aa591e640 1 --2- 172.21.15.55:0/1325804004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aa00b1250 0x7f0aa015f380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0097c0 tx=0x7f0a9c01c280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=379f4ea6994cabfb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.075+0000 7f0aa491c640 1 -- 172.21.15.55:0/1325804004 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0ab600 con 0x7f0aa00b1250 2023-07-06T21:42:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.075+0000 7f0aa491c640 1 -- 172.21.15.55:0/1325804004 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c0a7050 con 0x7f0aa00b1250 2023-07-06T21:42:26.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.075+0000 7f0aa491c640 1 -- 172.21.15.55:0/1325804004 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0ab980 con 0x7f0aa00b1250 2023-07-06T21:42:26.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.075+0000 7f0aa6920640 1 -- 172.21.15.55:0/1325804004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aa00b1250 msgr2=0x7f0aa015f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.075+0000 7f0aa6920640 1 --2- 172.21.15.55:0/1325804004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aa00b1250 0x7f0aa015f380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0097c0 tx=0x7f0a9c01c280 comp rx=0 tx=0).stop 2023-07-06T21:42:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.075+0000 7f0aa6920640 1 -- 172.21.15.55:0/1325804004 shutdown_connections 2023-07-06T21:42:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.075+0000 7f0aa6920640 1 --2- 172.21.15.55:0/1325804004 >> v2:172.21.15.138:3300/0 conn(0x7f0aa00d0630 0x7f0aa015f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.075+0000 7f0aa6920640 1 --2- 172.21.15.55:0/1325804004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aa00b1250 0x7f0aa015f380 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.075+0000 7f0aa6920640 1 -- 172.21.15.55:0/1325804004 >> 172.21.15.55:0/1325804004 conn(0x7f0aa00b3b60 msgr2=0x7f0aa00b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.075+0000 7f0aa6920640 1 -- 172.21.15.55:0/1325804004 shutdown_connections 2023-07-06T21:42:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.075+0000 7f0aa6920640 1 -- 172.21.15.55:0/1325804004 wait complete. 2023-07-06T21:42:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.075+0000 7f0aa6920640 1 Processor -- start 2023-07-06T21:42:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.075+0000 7f0aa6920640 1 -- start start 2023-07-06T21:42:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa6920640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aa00b1250 0x7f0aa0148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa6920640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aa00d0630 0x7f0aa00694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa6920640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aa015fe00 0x7f0aa00699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa6920640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00cb310 con 0x7f0aa00d0630 2023-07-06T21:42:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa6920640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00c9fe0 con 0x7f0aa00b1250 2023-07-06T21:42:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa6920640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00cb7a0 con 0x7f0aa015fe00 2023-07-06T21:42:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa511d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aa00d0630 0x7f0aa00694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa511d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aa00d0630 0x7f0aa00694a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59762/0 (socket says 172.21.15.55:59762) 2023-07-06T21:42:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa511d640 1 -- 172.21.15.55:0/3211643573 learned_addr learned my addr 172.21.15.55:0/3211643573 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:26.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa591e640 1 --2- 172.21.15.55:0/3211643573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aa00b1250 0x7f0aa0148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa611f640 1 --2- 172.21.15.55:0/3211643573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aa015fe00 0x7f0aa00699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa511d640 1 -- 172.21.15.55:0/3211643573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aa015fe00 msgr2=0x7f0aa00699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa511d640 1 --2- 172.21.15.55:0/3211643573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aa015fe00 0x7f0aa00699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa511d640 1 -- 172.21.15.55:0/3211643573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aa00b1250 msgr2=0x7f0aa0148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa511d640 1 --2- 172.21.15.55:0/3211643573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aa00b1250 0x7f0aa0148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa511d640 1 -- 172.21.15.55:0/3211643573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a90009420 con 0x7f0aa00d0630 2023-07-06T21:42:26.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa511d640 1 --2- 172.21.15.55:0/3211643573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aa00d0630 0x7f0aa00694a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000ebe0 tx=0x7f0a9000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:26.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0a967fc640 1 -- 172.21.15.55:0/3211643573 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9000eee0 con 0x7f0aa00d0630 2023-07-06T21:42:26.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0a967fc640 1 -- 172.21.15.55:0/3211643573 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9000cc30 con 0x7f0aa00d0630 2023-07-06T21:42:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0a967fc640 1 -- 172.21.15.55:0/3211643573 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a90013470 con 0x7f0aa00d0630 2023-07-06T21:42:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa6920640 1 -- 172.21.15.55:0/3211643573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c009420 con 0x7f0aa00d0630 2023-07-06T21:42:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa6920640 1 -- 172.21.15.55:0/3211643573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa00cacc0 con 0x7f0aa00d0630 2023-07-06T21:42:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.079+0000 7f0aa6920640 1 -- 172.21.15.55:0/3211643573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa00d17d0 con 0x7f0aa00d0630 2023-07-06T21:42:26.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.083+0000 7f0a967fc640 1 -- 172.21.15.55:0/3211643573 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a900135d0 con 0x7f0aa00d0630 2023-07-06T21:42:26.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.083+0000 7f0a967fc640 1 --2- 172.21.15.55:0/3211643573 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a84066280 0x7f0a84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.083+0000 7f0a967fc640 1 -- 172.21.15.55:0/3211643573 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0a90084630 con 0x7f0aa00d0630 2023-07-06T21:42:26.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.083+0000 7f0aa591e640 1 --2- 172.21.15.55:0/3211643573 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a84066280 0x7f0a84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.083+0000 7f0aa591e640 1 --2- 172.21.15.55:0/3211643573 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a84066280 0x7f0a84068730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0ad000 tx=0x7f0a9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:26.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.087+0000 7f0a967fc640 1 -- 172.21.15.55:0/3211643573 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0aa00d17d0 con 0x7f0aa00d0630 2023-07-06T21:42:26.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.243+0000 7f0aa6920640 1 -- 172.21.15.55:0/3211643573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0aa00d17d0 con 0x7f0aa00d0630 2023-07-06T21:42:26.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.243+0000 7f0a967fc640 1 -- 172.21.15.55:0/3211643573 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0aa00d17d0 con 0x7f0aa00d0630 2023-07-06T21:42:26.247 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:42:26.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.243+0000 7f0aa6920640 1 -- 172.21.15.55:0/3211643573 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a84066280 msgr2=0x7f0a84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.243+0000 7f0aa6920640 1 --2- 172.21.15.55:0/3211643573 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a84066280 0x7f0a84068730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0ad000 tx=0x7f0a9c008040 comp rx=0 tx=0).stop 2023-07-06T21:42:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.243+0000 7f0aa6920640 1 -- 172.21.15.55:0/3211643573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aa00d0630 msgr2=0x7f0aa00694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.243+0000 7f0aa6920640 1 --2- 172.21.15.55:0/3211643573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aa00d0630 0x7f0aa00694a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000ebe0 tx=0x7f0a9000c520 comp rx=0 tx=0).stop 2023-07-06T21:42:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.243+0000 7f0aa6920640 1 -- 172.21.15.55:0/3211643573 shutdown_connections 2023-07-06T21:42:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.243+0000 7f0aa6920640 1 --2- 172.21.15.55:0/3211643573 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a84066280 0x7f0a84068730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.243+0000 7f0aa6920640 1 --2- 172.21.15.55:0/3211643573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aa015fe00 0x7f0aa00699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.243+0000 7f0aa6920640 1 --2- 172.21.15.55:0/3211643573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aa00d0630 0x7f0aa00694a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.243+0000 7f0aa6920640 1 --2- 172.21.15.55:0/3211643573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aa00b1250 0x7f0aa0148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.243+0000 7f0aa6920640 1 -- 172.21.15.55:0/3211643573 >> 172.21.15.55:0/3211643573 conn(0x7f0aa00b3b60 msgr2=0x7f0aa00cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:26.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.243+0000 7f0aa6920640 1 -- 172.21.15.55:0/3211643573 shutdown_connections 2023-07-06T21:42:26.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.243+0000 7f0aa6920640 1 -- 172.21.15.55:0/3211643573 wait complete. 2023-07-06T21:42:26.268 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T21:42:26.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f4155fe9640 1 Processor -- start 2023-07-06T21:42:26.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f4155fe9640 1 -- start start 2023-07-06T21:42:26.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f4155fe9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4150156180 0x7f41500ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f4155fe9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f415006e9d0 0x7f415006ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f4155fe9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41500cb7a0 0x7f41500cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f4155fe9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4150160250 con 0x7f415006e9d0 2023-07-06T21:42:26.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f4155fe9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415006f390 con 0x7f4150156180 2023-07-06T21:42:26.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f4155fe9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415015f5d0 con 0x7f41500cb7a0 2023-07-06T21:42:26.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f414effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f415006e9d0 0x7f415006ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f414effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f415006e9d0 0x7f415006ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59776/0 (socket says 172.21.15.55:59776) 2023-07-06T21:42:26.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f414effd640 1 -- 172.21.15.55:0/1932722193 learned_addr learned my addr 172.21.15.55:0/1932722193 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:26.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f414f7fe640 1 --2- 172.21.15.55:0/1932722193 >> v2:172.21.15.138:3300/0 conn(0x7f4150156180 0x7f41500ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f414ffff640 1 --2- 172.21.15.55:0/1932722193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41500cb7a0 0x7f41500cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f414effd640 1 -- 172.21.15.55:0/1932722193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41500cb7a0 msgr2=0x7f41500cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:26.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f414effd640 1 --2- 172.21.15.55:0/1932722193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41500cb7a0 0x7f41500cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f414effd640 1 -- 172.21.15.55:0/1932722193 >> v2:172.21.15.138:3300/0 conn(0x7f4150156180 msgr2=0x7f41500ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:26.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f414effd640 1 --2- 172.21.15.55:0/1932722193 >> v2:172.21.15.138:3300/0 conn(0x7f4150156180 0x7f41500ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f414effd640 1 -- 172.21.15.55:0/1932722193 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415015f8b0 con 0x7f415006e9d0 2023-07-06T21:42:26.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.411+0000 7f414ffff640 1 --2- 172.21.15.55:0/1932722193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41500cb7a0 0x7f41500cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:26.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.415+0000 7f414effd640 1 --2- 172.21.15.55:0/1932722193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f415006e9d0 0x7f415006ee50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4150071c90 tx=0x7f414401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91adfdb2251fcc6d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:26.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.415+0000 7f414e7fc640 1 -- 172.21.15.55:0/1932722193 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440ab600 con 0x7f415006e9d0 2023-07-06T21:42:26.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.415+0000 7f414e7fc640 1 -- 172.21.15.55:0/1932722193 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41440ab760 con 0x7f415006e9d0 2023-07-06T21:42:26.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.415+0000 7f414e7fc640 1 -- 172.21.15.55:0/1932722193 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440abaf0 con 0x7f415006e9d0 2023-07-06T21:42:26.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.415+0000 7f4155fe9640 1 -- 172.21.15.55:0/1932722193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f415006e9d0 msgr2=0x7f415006ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.415+0000 7f4155fe9640 1 --2- 172.21.15.55:0/1932722193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f415006e9d0 0x7f415006ee50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4150071c90 tx=0x7f414401c440 comp rx=0 tx=0).stop 2023-07-06T21:42:26.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.415+0000 7f4155fe9640 1 -- 172.21.15.55:0/1932722193 shutdown_connections 2023-07-06T21:42:26.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.415+0000 7f4155fe9640 1 --2- 172.21.15.55:0/1932722193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41500cb7a0 0x7f41500cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.415+0000 7f4155fe9640 1 --2- 172.21.15.55:0/1932722193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f415006e9d0 0x7f415006ee50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.415+0000 7f4155fe9640 1 --2- 172.21.15.55:0/1932722193 >> v2:172.21.15.138:3300/0 conn(0x7f4150156180 0x7f41500ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.415+0000 7f4155fe9640 1 -- 172.21.15.55:0/1932722193 >> 172.21.15.55:0/1932722193 conn(0x7f41500d0c50 msgr2=0x7f41500cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:26.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.415+0000 7f4155fe9640 1 -- 172.21.15.55:0/1932722193 shutdown_connections 2023-07-06T21:42:26.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.415+0000 7f4155fe9640 1 -- 172.21.15.55:0/1932722193 wait complete. 2023-07-06T21:42:26.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f4155fe9640 1 Processor -- start 2023-07-06T21:42:26.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f4155fe9640 1 -- start start 2023-07-06T21:42:26.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f4155fe9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f415006e9d0 0x7f415014fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f4155fe9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41500cb7a0 0x7f4150150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f4155fe9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4150156180 0x7f415015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f4155fe9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415014f9a0 con 0x7f4150156180 2023-07-06T21:42:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f4155fe9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4150150b50 con 0x7f41500cb7a0 2023-07-06T21:42:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f4155fe9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415014ed90 con 0x7f415006e9d0 2023-07-06T21:42:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f414ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4150156180 0x7f415015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f414ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4150156180 0x7f415015d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59792/0 (socket says 172.21.15.55:59792) 2023-07-06T21:42:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f414ffff640 1 -- 172.21.15.55:0/45475892 learned_addr learned my addr 172.21.15.55:0/45475892 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f414f7fe640 1 --2- 172.21.15.55:0/45475892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f415006e9d0 0x7f415014fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f414effd640 1 --2- 172.21.15.55:0/45475892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41500cb7a0 0x7f4150150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f414ffff640 1 -- 172.21.15.55:0/45475892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f415006e9d0 msgr2=0x7f415014fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f414ffff640 1 --2- 172.21.15.55:0/45475892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f415006e9d0 0x7f415014fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f414ffff640 1 -- 172.21.15.55:0/45475892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41500cb7a0 msgr2=0x7f4150150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f414ffff640 1 --2- 172.21.15.55:0/45475892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41500cb7a0 0x7f4150150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f414ffff640 1 -- 172.21.15.55:0/45475892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41440094d0 con 0x7f4150156180 2023-07-06T21:42:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f414ffff640 1 --2- 172.21.15.55:0/45475892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4150156180 0x7f415015d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f414800cef0 tx=0x7f414800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:26.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f4137fff640 1 -- 172.21.15.55:0/45475892 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414800d840 con 0x7f4150156180 2023-07-06T21:42:26.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f4137fff640 1 -- 172.21.15.55:0/45475892 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414800d9a0 con 0x7f4150156180 2023-07-06T21:42:26.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f4137fff640 1 -- 172.21.15.55:0/45475892 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414800dd50 con 0x7f4150156180 2023-07-06T21:42:26.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f4155fe9640 1 -- 172.21.15.55:0/45475892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415014f070 con 0x7f4150156180 2023-07-06T21:42:26.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.419+0000 7f4155fe9640 1 -- 172.21.15.55:0/45475892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415014f630 con 0x7f4150156180 2023-07-06T21:42:26.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.423+0000 7f4155fe9640 1 -- 172.21.15.55:0/45475892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4150066d60 con 0x7f4150156180 2023-07-06T21:42:26.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.423+0000 7f4137fff640 1 -- 172.21.15.55:0/45475892 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f414801e3b0 con 0x7f4150156180 2023-07-06T21:42:26.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.423+0000 7f4137fff640 1 --2- 172.21.15.55:0/45475892 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f413c0662b0 0x7f413c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.423+0000 7f4137fff640 1 -- 172.21.15.55:0/45475892 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f41480849b0 con 0x7f4150156180 2023-07-06T21:42:26.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.423+0000 7f414f7fe640 1 --2- 172.21.15.55:0/45475892 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f413c0662b0 0x7f413c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.423+0000 7f414f7fe640 1 --2- 172.21.15.55:0/45475892 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f413c0662b0 0x7f413c068760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f41400079c0 tx=0x7f4140008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.427+0000 7f4137fff640 1 -- 172.21.15.55:0/45475892 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4148051be0 con 0x7f4150156180 2023-07-06T21:42:26.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.583+0000 7f4155fe9640 1 -- 172.21.15.55:0/45475892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f41500cd930 con 0x7f4150156180 2023-07-06T21:42:26.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.583+0000 7f4137fff640 1 -- 172.21.15.55:0/45475892 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f414801a020 con 0x7f4150156180 2023-07-06T21:42:26.590 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:26.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.587+0000 7f4155fe9640 1 -- 172.21.15.55:0/45475892 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f413c0662b0 msgr2=0x7f413c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.587+0000 7f4155fe9640 1 --2- 172.21.15.55:0/45475892 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f413c0662b0 0x7f413c068760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f41400079c0 tx=0x7f4140008040 comp rx=0 tx=0).stop 2023-07-06T21:42:26.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.587+0000 7f4155fe9640 1 -- 172.21.15.55:0/45475892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4150156180 msgr2=0x7f415015d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.587+0000 7f4155fe9640 1 --2- 172.21.15.55:0/45475892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4150156180 0x7f415015d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f414800cef0 tx=0x7f414800a710 comp rx=0 tx=0).stop 2023-07-06T21:42:26.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.587+0000 7f4155fe9640 1 -- 172.21.15.55:0/45475892 shutdown_connections 2023-07-06T21:42:26.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.587+0000 7f4155fe9640 1 --2- 172.21.15.55:0/45475892 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f413c0662b0 0x7f413c068760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.587+0000 7f4155fe9640 1 --2- 172.21.15.55:0/45475892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4150156180 0x7f415015d3c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.587+0000 7f4155fe9640 1 --2- 172.21.15.55:0/45475892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41500cb7a0 0x7f4150150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.587+0000 7f4155fe9640 1 --2- 172.21.15.55:0/45475892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f415006e9d0 0x7f415014fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.587+0000 7f4155fe9640 1 -- 172.21.15.55:0/45475892 >> 172.21.15.55:0/45475892 conn(0x7f41500d0c50 msgr2=0x7f4150159bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.587+0000 7f4155fe9640 1 -- 172.21.15.55:0/45475892 shutdown_connections 2023-07-06T21:42:26.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.587+0000 7f4155fe9640 1 -- 172.21.15.55:0/45475892 wait complete. 2023-07-06T21:42:26.611 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T21:42:26.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae15a19640 1 Processor -- start 2023-07-06T21:42:26.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae15a19640 1 -- start start 2023-07-06T21:42:26.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae15a19640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fae1015b8a0 0x7fae100d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae15a19640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae100b4040 0x7fae100b5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae15a19640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae100ccca0 con 0x7fae100ce1a0 2023-07-06T21:42:26.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae15a19640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae100b5000 con 0x7fae100b4040 2023-07-06T21:42:26.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae15a19640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1015bc70 con 0x7fae1015b8a0 2023-07-06T21:42:26.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae0f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae100b4040 0x7fae100b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae0f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae100b4040 0x7fae100b5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59794/0 (socket says 172.21.15.55:59794) 2023-07-06T21:42:26.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae0f7fe640 1 -- 172.21.15.55:0/3479024114 learned_addr learned my addr 172.21.15.55:0/3479024114 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:26.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae0effd640 1 --2- 172.21.15.55:0/3479024114 >> v2:172.21.15.138:3300/0 conn(0x7fae1015b8a0 0x7fae100d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae0f7fe640 1 -- 172.21.15.55:0/3479024114 >> v2:172.21.15.138:3300/0 conn(0x7fae1015b8a0 msgr2=0x7fae100d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:26.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae0f7fe640 1 --2- 172.21.15.55:0/3479024114 >> v2:172.21.15.138:3300/0 conn(0x7fae1015b8a0 0x7fae100d0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae0f7fe640 1 -- 172.21.15.55:0/3479024114 >> v1:172.21.15.138:6789/0 conn(0x7fae100ce1a0 legacy=0x7fae100b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.751+0000 7fae0f7fe640 1 -- 172.21.15.55:0/3479024114 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae100d0bb0 con 0x7fae100b4040 2023-07-06T21:42:26.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.755+0000 7fae0f7fe640 1 --2- 172.21.15.55:0/3479024114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100b4040 0x7fae100b5490 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fae1008af80 tx=0x7fae0801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0d43d6b18db20f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:26.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.755+0000 7fae0e7fc640 1 -- 172.21.15.55:0/3479024114 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae080a56f0 con 0x7fae100b4040 2023-07-06T21:42:26.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.755+0000 7fae0e7fc640 1 -- 172.21.15.55:0/3479024114 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae080a5850 con 0x7fae100b4040 2023-07-06T21:42:26.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.755+0000 7fae0e7fc640 1 -- 172.21.15.55:0/3479024114 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae080a5be0 con 0x7fae100b4040 2023-07-06T21:42:26.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.755+0000 7fae15a19640 1 -- 172.21.15.55:0/3479024114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100b4040 msgr2=0x7fae100b5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.755+0000 7fae15a19640 1 --2- 172.21.15.55:0/3479024114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100b4040 0x7fae100b5490 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fae1008af80 tx=0x7fae0801c940 comp rx=0 tx=0).stop 2023-07-06T21:42:26.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.755+0000 7fae15a19640 1 -- 172.21.15.55:0/3479024114 shutdown_connections 2023-07-06T21:42:26.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.755+0000 7fae15a19640 1 --2- 172.21.15.55:0/3479024114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100b4040 0x7fae100b5490 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.755+0000 7fae15a19640 1 --2- 172.21.15.55:0/3479024114 >> v2:172.21.15.138:3300/0 conn(0x7fae1015b8a0 0x7fae100d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.755+0000 7fae15a19640 1 -- 172.21.15.55:0/3479024114 >> 172.21.15.55:0/3479024114 conn(0x7fae1006b620 msgr2=0x7fae1006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:26.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.755+0000 7fae15a19640 1 -- 172.21.15.55:0/3479024114 shutdown_connections 2023-07-06T21:42:26.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.755+0000 7fae15a19640 1 -- 172.21.15.55:0/3479024114 wait complete. 2023-07-06T21:42:26.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae15a19640 1 Processor -- start 2023-07-06T21:42:26.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae15a19640 1 -- start start 2023-07-06T21:42:26.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae15a19640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae100b4040 0x7fae1015d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae15a19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ce1a0 0x7fae10154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae15a19640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1015b8a0 0x7fae1014d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae15a19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae100c5ae0 con 0x7fae100ce1a0 2023-07-06T21:42:26.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae15a19640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae100c5cf0 con 0x7fae100b4040 2023-07-06T21:42:26.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae15a19640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae100c5fd0 con 0x7fae1015b8a0 2023-07-06T21:42:26.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae07fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ce1a0 0x7fae10154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae07fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ce1a0 0x7fae10154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59806/0 (socket says 172.21.15.55:59806) 2023-07-06T21:42:26.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae07fff640 1 -- 172.21.15.55:0/2827042062 learned_addr learned my addr 172.21.15.55:0/2827042062 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:26.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae0effd640 1 --2- 172.21.15.55:0/2827042062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae100b4040 0x7fae1015d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae0f7fe640 1 --2- 172.21.15.55:0/2827042062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1015b8a0 0x7fae1014d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae07fff640 1 -- 172.21.15.55:0/2827042062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1015b8a0 msgr2=0x7fae1014d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae07fff640 1 --2- 172.21.15.55:0/2827042062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1015b8a0 0x7fae1014d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae07fff640 1 -- 172.21.15.55:0/2827042062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae100b4040 msgr2=0x7fae1015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae07fff640 1 --2- 172.21.15.55:0/2827042062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae100b4040 0x7fae1015d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae07fff640 1 -- 172.21.15.55:0/2827042062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae08009b30 con 0x7fae100ce1a0 2023-07-06T21:42:26.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae07fff640 1 --2- 172.21.15.55:0/2827042062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ce1a0 0x7fae10154c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fadf800c500 tx=0x7fadf800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:26.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae0cff9640 1 -- 172.21.15.55:0/2827042062 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8005220 con 0x7fae100ce1a0 2023-07-06T21:42:26.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae0cff9640 1 -- 172.21.15.55:0/2827042062 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8005380 con 0x7fae100ce1a0 2023-07-06T21:42:26.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae0cff9640 1 -- 172.21.15.55:0/2827042062 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8007270 con 0x7fae100ce1a0 2023-07-06T21:42:26.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae15a19640 1 -- 172.21.15.55:0/2827042062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae100c62b0 con 0x7fae100ce1a0 2023-07-06T21:42:26.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.759+0000 7fae15a19640 1 -- 172.21.15.55:0/2827042062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae100c6ab0 con 0x7fae100ce1a0 2023-07-06T21:42:26.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.763+0000 7fae15a19640 1 -- 172.21.15.55:0/2827042062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae100c67d0 con 0x7fae100ce1a0 2023-07-06T21:42:26.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.763+0000 7fae0cff9640 1 -- 172.21.15.55:0/2827042062 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fadf80073d0 con 0x7fae100ce1a0 2023-07-06T21:42:26.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.763+0000 7fae0cff9640 1 --2- 172.21.15.55:0/2827042062 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fadf0066280 0x7fadf0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:26.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.763+0000 7fae0cff9640 1 -- 172.21.15.55:0/2827042062 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fadf8083850 con 0x7fae100ce1a0 2023-07-06T21:42:26.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.763+0000 7fae0effd640 1 --2- 172.21.15.55:0/2827042062 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fadf0066280 0x7fadf0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:26.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.763+0000 7fae0effd640 1 --2- 172.21.15.55:0/2827042062 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fadf0066280 0x7fadf0068730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fae000079c0 tx=0x7fae00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:26.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.767+0000 7fae0cff9640 1 -- 172.21.15.55:0/2827042062 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fae100c67d0 con 0x7fae100ce1a0 2023-07-06T21:42:26.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.939+0000 7fae15a19640 1 -- 172.21.15.55:0/2827042062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fae100c67d0 con 0x7fae100ce1a0 2023-07-06T21:42:26.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.939+0000 7fae0cff9640 1 -- 172.21.15.55:0/2827042062 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fae100c67d0 con 0x7fae100ce1a0 2023-07-06T21:42:26.945 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2023-07-06T21:42:26.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.939+0000 7fae15a19640 1 -- 172.21.15.55:0/2827042062 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fadf0066280 msgr2=0x7fadf0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.939+0000 7fae15a19640 1 --2- 172.21.15.55:0/2827042062 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fadf0066280 0x7fadf0068730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fae000079c0 tx=0x7fae00008040 comp rx=0 tx=0).stop 2023-07-06T21:42:26.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.939+0000 7fae15a19640 1 -- 172.21.15.55:0/2827042062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ce1a0 msgr2=0x7fae10154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:26.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.939+0000 7fae15a19640 1 --2- 172.21.15.55:0/2827042062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ce1a0 0x7fae10154c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fadf800c500 tx=0x7fadf800c9c0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.943+0000 7fae15a19640 1 -- 172.21.15.55:0/2827042062 shutdown_connections 2023-07-06T21:42:26.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.943+0000 7fae15a19640 1 --2- 172.21.15.55:0/2827042062 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fadf0066280 0x7fadf0068730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.943+0000 7fae15a19640 1 --2- 172.21.15.55:0/2827042062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1015b8a0 0x7fae1014d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.943+0000 7fae15a19640 1 --2- 172.21.15.55:0/2827042062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ce1a0 0x7fae10154c10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.943+0000 7fae15a19640 1 --2- 172.21.15.55:0/2827042062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae100b4040 0x7fae1015d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:26.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.943+0000 7fae15a19640 1 -- 172.21.15.55:0/2827042062 >> 172.21.15.55:0/2827042062 conn(0x7fae1006b620 msgr2=0x7fae1015f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:26.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.943+0000 7fae15a19640 1 -- 172.21.15.55:0/2827042062 shutdown_connections 2023-07-06T21:42:26.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:26.943+0000 7fae15a19640 1 -- 172.21.15.55:0/2827042062 wait complete. 2023-07-06T21:42:26.965 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2023-07-06T21:42:26.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:26.966 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-07-06T21:42:26.995 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi055.stderr:ceph-fuse[44068]: fuse finished with error 0 and tester_r 0 2023-07-06T21:42:26.997 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:42:27.099 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T21:42:27.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:27.099 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-07-06T21:42:27.118 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:27.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f698ad74640 1 Processor -- start 2023-07-06T21:42:27.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f698ad74640 1 -- start start 2023-07-06T21:42:27.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f698ad74640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f69840b7cd0 0x7f69840ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f698ad74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840ccab0 0x7f69840b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f698ad74640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f69840ccf00 0x7f69840b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f698ad74640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69840d2310 con 0x7f69840b7cd0 2023-07-06T21:42:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f698ad74640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69840b80a0 con 0x7f69840ccf00 2023-07-06T21:42:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f698ad74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69840d1100 con 0x7f69840ccab0 2023-07-06T21:42:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f6988b10640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f69840b7cd0 0x7f69840ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f6988b10640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f69840b7cd0 0x7f69840ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59816/0 (socket says 172.21.15.55:59816) 2023-07-06T21:42:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f6988b10640 1 -- 172.21.15.55:0/296436097 learned_addr learned my addr 172.21.15.55:0/296436097 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f6988b10640 1 -- 172.21.15.55:0/296436097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840ccab0 msgr2=0x7f69840b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f6988b10640 1 --2- 172.21.15.55:0/296436097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840ccab0 0x7f69840b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f6988b10640 1 -- 172.21.15.55:0/296436097 >> v2:172.21.15.138:3300/0 conn(0x7f69840ccf00 msgr2=0x7f69840b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:27.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f6989311640 1 --2- 172.21.15.55:0/296436097 >> v2:172.21.15.138:3300/0 conn(0x7f69840ccf00 0x7f69840b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f6988b10640 1 --2- 172.21.15.55:0/296436097 >> v2:172.21.15.138:3300/0 conn(0x7f69840ccf00 0x7f69840b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f6988b10640 1 -- 172.21.15.55:0/296436097 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69840cecf0 con 0x7f69840b7cd0 2023-07-06T21:42:27.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.299+0000 7f6989311640 1 --2- 172.21.15.55:0/296436097 >> v2:172.21.15.138:3300/0 conn(0x7f69840ccf00 0x7f69840b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:27.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.303+0000 7f6988b10640 1 --2- 172.21.15.55:0/296436097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7cd0 0x7f69840ce610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f69840cd800 tx=0x7f697801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10555276e1dd0dce server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.303+0000 7f69837fe640 1 -- 172.21.15.55:0/296436097 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69780ab600 con 0x7f69840b7cd0 2023-07-06T21:42:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.303+0000 7f69837fe640 1 -- 172.21.15.55:0/296436097 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69780a7050 con 0x7f69840b7cd0 2023-07-06T21:42:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.303+0000 7f69837fe640 1 -- 172.21.15.55:0/296436097 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69780ab980 con 0x7f69840b7cd0 2023-07-06T21:42:27.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.303+0000 7f698ad74640 1 -- 172.21.15.55:0/296436097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7cd0 msgr2=0x7f69840ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:27.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.303+0000 7f698ad74640 1 --2- 172.21.15.55:0/296436097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7cd0 0x7f69840ce610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f69840cd800 tx=0x7f697801c470 comp rx=0 tx=0).stop 2023-07-06T21:42:27.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.303+0000 7f698ad74640 1 -- 172.21.15.55:0/296436097 shutdown_connections 2023-07-06T21:42:27.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.303+0000 7f698ad74640 1 --2- 172.21.15.55:0/296436097 >> v2:172.21.15.138:3300/0 conn(0x7f69840ccf00 0x7f69840b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.303+0000 7f698ad74640 1 --2- 172.21.15.55:0/296436097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840ccab0 0x7f69840b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.303+0000 7f698ad74640 1 --2- 172.21.15.55:0/296436097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7cd0 0x7f69840ce610 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.303+0000 7f698ad74640 1 -- 172.21.15.55:0/296436097 >> 172.21.15.55:0/296436097 conn(0x7f69840ceee0 msgr2=0x7f69840cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:27.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.303+0000 7f698ad74640 1 -- 172.21.15.55:0/296436097 shutdown_connections 2023-07-06T21:42:27.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.303+0000 7f698ad74640 1 -- 172.21.15.55:0/296436097 wait complete. 2023-07-06T21:42:27.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f698ad74640 1 Processor -- start 2023-07-06T21:42:27.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f698ad74640 1 -- start start 2023-07-06T21:42:27.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f698ad74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7cd0 0x7f698414d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f698ad74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840ccab0 0x7f69840b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f698ad74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840ccf00 0x7f69840b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f698ad74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698415c480 con 0x7f69840b7cd0 2023-07-06T21:42:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f698ad74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6984159d20 con 0x7f69840ccab0 2023-07-06T21:42:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f698ad74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698415b400 con 0x7f69840ccf00 2023-07-06T21:42:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f6988b10640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7cd0 0x7f698414d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f6988b10640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7cd0 0x7f698414d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59820/0 (socket says 172.21.15.55:59820) 2023-07-06T21:42:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f6988b10640 1 -- 172.21.15.55:0/536534381 learned_addr learned my addr 172.21.15.55:0/536534381 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f6989311640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840ccf00 0x7f69840b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f6983fff640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840ccab0 0x7f69840b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f6988b10640 1 -- 172.21.15.55:0/536534381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840ccf00 msgr2=0x7f69840b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f6988b10640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840ccf00 0x7f69840b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f6988b10640 1 -- 172.21.15.55:0/536534381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840ccab0 msgr2=0x7f69840b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f6988b10640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840ccab0 0x7f69840b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f6988b10640 1 -- 172.21.15.55:0/536534381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69780094d0 con 0x7f69840b7cd0 2023-07-06T21:42:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f6989311640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840ccf00 0x7f69840b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f6988b10640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7cd0 0x7f698414d930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f69780ae040 tx=0x7f697801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f69817fa640 1 -- 172.21.15.55:0/536534381 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69780b6620 con 0x7f69840b7cd0 2023-07-06T21:42:27.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f69817fa640 1 -- 172.21.15.55:0/536534381 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69780b67a0 con 0x7f69840b7cd0 2023-07-06T21:42:27.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f69817fa640 1 -- 172.21.15.55:0/536534381 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69780b6b50 con 0x7f69840b7cd0 2023-07-06T21:42:27.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f698ad74640 1 -- 172.21.15.55:0/536534381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6984159f70 con 0x7f69840b7cd0 2023-07-06T21:42:27.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.307+0000 7f698ad74640 1 -- 172.21.15.55:0/536534381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698415a530 con 0x7f69840b7cd0 2023-07-06T21:42:27.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.311+0000 7f698ad74640 1 -- 172.21.15.55:0/536534381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6984066d60 con 0x7f69840b7cd0 2023-07-06T21:42:27.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.311+0000 7f69817fa640 1 -- 172.21.15.55:0/536534381 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f69780b2040 con 0x7f69840b7cd0 2023-07-06T21:42:27.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.311+0000 7f69817fa640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6968066280 0x7f6968068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.311+0000 7f69817fa640 1 -- 172.21.15.55:0/536534381 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f697811e680 con 0x7f69840b7cd0 2023-07-06T21:42:27.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.311+0000 7f6983fff640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6968066280 0x7f6968068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.311+0000 7f6983fff640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6968066280 0x7f6968068730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6970006fd0 tx=0x7f6970008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:27.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.315+0000 7f69817fa640 1 -- 172.21.15.55:0/536534381 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69780eb770 con 0x7f69840b7cd0 2023-07-06T21:42:27.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.475+0000 7f698ad74640 1 -- 172.21.15.55:0/536534381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6984071aa0 con 0x7f69840b7cd0 2023-07-06T21:42:27.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.475+0000 7f69817fa640 1 -- 172.21.15.55:0/536534381 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f69780eed90 con 0x7f69840b7cd0 2023-07-06T21:42:27.480 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:27.481 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:15.295464+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:27.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.475+0000 7f698ad74640 1 -- 172.21.15.55:0/536534381 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6968066280 msgr2=0x7f6968068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:27.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.475+0000 7f698ad74640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6968066280 0x7f6968068730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6970006fd0 tx=0x7f6970008040 comp rx=0 tx=0).stop 2023-07-06T21:42:27.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.475+0000 7f698ad74640 1 -- 172.21.15.55:0/536534381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7cd0 msgr2=0x7f698414d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:27.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.475+0000 7f698ad74640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7cd0 0x7f698414d930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f69780ae040 tx=0x7f697801acb0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.475+0000 7f698ad74640 1 -- 172.21.15.55:0/536534381 shutdown_connections 2023-07-06T21:42:27.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.475+0000 7f698ad74640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6968066280 0x7f6968068730 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.475+0000 7f698ad74640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840ccf00 0x7f69840b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.475+0000 7f698ad74640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840ccab0 0x7f69840b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.475+0000 7f698ad74640 1 --2- 172.21.15.55:0/536534381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7cd0 0x7f698414d930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.475+0000 7f698ad74640 1 -- 172.21.15.55:0/536534381 >> 172.21.15.55:0/536534381 conn(0x7f69840ceee0 msgr2=0x7f69841581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:27.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.475+0000 7f698ad74640 1 -- 172.21.15.55:0/536534381 shutdown_connections 2023-07-06T21:42:27.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.475+0000 7f698ad74640 1 -- 172.21.15.55:0/536534381 wait complete. 2023-07-06T21:42:27.501 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc41849c640 1 Processor -- start 2023-07-06T21:42:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc41849c640 1 -- start start 2023-07-06T21:42:27.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc41849c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc4100b7cd0 0x7fc4100ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc41849c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc4100ccab0 0x7fc4100b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc41849c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4100ccf00 0x7fc4100b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc41849c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4100d2310 con 0x7fc4100b7cd0 2023-07-06T21:42:27.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc41849c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4100b80a0 con 0x7fc4100ccab0 2023-07-06T21:42:27.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc41849c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4100d1100 con 0x7fc4100ccf00 2023-07-06T21:42:27.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc416238640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc4100b7cd0 0x7fc4100ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc416238640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc4100b7cd0 0x7fc4100ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59836/0 (socket says 172.21.15.55:59836) 2023-07-06T21:42:27.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc416238640 1 -- 172.21.15.55:0/3194646382 learned_addr learned my addr 172.21.15.55:0/3194646382 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc415a37640 1 --2- 172.21.15.55:0/3194646382 >> v2:172.21.15.138:3300/0 conn(0x7fc4100ccab0 0x7fc4100b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc416a39640 1 --2- 172.21.15.55:0/3194646382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4100ccf00 0x7fc4100b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc416238640 1 -- 172.21.15.55:0/3194646382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4100ccf00 msgr2=0x7fc4100b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc416238640 1 --2- 172.21.15.55:0/3194646382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4100ccf00 0x7fc4100b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc416238640 1 -- 172.21.15.55:0/3194646382 >> v2:172.21.15.138:3300/0 conn(0x7fc4100ccab0 msgr2=0x7fc4100b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc416238640 1 --2- 172.21.15.55:0/3194646382 >> v2:172.21.15.138:3300/0 conn(0x7fc4100ccab0 0x7fc4100b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.639+0000 7fc416238640 1 -- 172.21.15.55:0/3194646382 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4100cecf0 con 0x7fc4100b7cd0 2023-07-06T21:42:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.643+0000 7fc416238640 1 --2- 172.21.15.55:0/3194646382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100b7cd0 0x7fc4100ce610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc410065af0 tx=0x7fc40c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e40b5b1dbb8fc7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.643+0000 7fc415236640 1 -- 172.21.15.55:0/3194646382 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c0ab600 con 0x7fc4100b7cd0 2023-07-06T21:42:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.643+0000 7fc415236640 1 -- 172.21.15.55:0/3194646382 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40c0a7050 con 0x7fc4100b7cd0 2023-07-06T21:42:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.643+0000 7fc415236640 1 -- 172.21.15.55:0/3194646382 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c0ab980 con 0x7fc4100b7cd0 2023-07-06T21:42:27.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.643+0000 7fc41849c640 1 -- 172.21.15.55:0/3194646382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100b7cd0 msgr2=0x7fc4100ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:27.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.643+0000 7fc41849c640 1 --2- 172.21.15.55:0/3194646382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100b7cd0 0x7fc4100ce610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc410065af0 tx=0x7fc40c01c470 comp rx=0 tx=0).stop 2023-07-06T21:42:27.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.643+0000 7fc41849c640 1 -- 172.21.15.55:0/3194646382 shutdown_connections 2023-07-06T21:42:27.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.643+0000 7fc41849c640 1 --2- 172.21.15.55:0/3194646382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4100ccf00 0x7fc4100b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.643+0000 7fc41849c640 1 --2- 172.21.15.55:0/3194646382 >> v2:172.21.15.138:3300/0 conn(0x7fc4100ccab0 0x7fc4100b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.643+0000 7fc41849c640 1 --2- 172.21.15.55:0/3194646382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100b7cd0 0x7fc4100ce610 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.643+0000 7fc41849c640 1 -- 172.21.15.55:0/3194646382 >> 172.21.15.55:0/3194646382 conn(0x7fc4100ceee0 msgr2=0x7fc4100cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:27.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.643+0000 7fc41849c640 1 -- 172.21.15.55:0/3194646382 shutdown_connections 2023-07-06T21:42:27.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.643+0000 7fc41849c640 1 -- 172.21.15.55:0/3194646382 wait complete. 2023-07-06T21:42:27.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc41849c640 1 Processor -- start 2023-07-06T21:42:27.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc41849c640 1 -- start start 2023-07-06T21:42:27.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc41849c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4100b7cd0 0x7fc41014e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc41849c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4100ccab0 0x7fc41014df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc41849c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100ccf00 0x7fc41015d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc41849c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41015d9e0 con 0x7fc4100ccf00 2023-07-06T21:42:27.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc41849c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41014d1d0 con 0x7fc4100ccab0 2023-07-06T21:42:27.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc41849c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41014d4b0 con 0x7fc4100b7cd0 2023-07-06T21:42:27.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc416a39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100ccf00 0x7fc41015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc416a39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100ccf00 0x7fc41015d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59840/0 (socket says 172.21.15.55:59840) 2023-07-06T21:42:27.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc416a39640 1 -- 172.21.15.55:0/1033089848 learned_addr learned my addr 172.21.15.55:0/1033089848 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:27.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc416238640 1 --2- 172.21.15.55:0/1033089848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4100b7cd0 0x7fc41014e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc415a37640 1 --2- 172.21.15.55:0/1033089848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4100ccab0 0x7fc41014df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc416a39640 1 -- 172.21.15.55:0/1033089848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4100b7cd0 msgr2=0x7fc41014e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:27.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc416a39640 1 --2- 172.21.15.55:0/1033089848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4100b7cd0 0x7fc41014e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc416a39640 1 -- 172.21.15.55:0/1033089848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4100ccab0 msgr2=0x7fc41014df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:27.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc416a39640 1 --2- 172.21.15.55:0/1033089848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4100ccab0 0x7fc41014df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc416a39640 1 -- 172.21.15.55:0/1033089848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c0094d0 con 0x7fc4100ccf00 2023-07-06T21:42:27.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc416a39640 1 --2- 172.21.15.55:0/1033089848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100ccf00 0x7fc41015d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc408009fd0 tx=0x7fc40800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:27.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc406ffd640 1 -- 172.21.15.55:0/1033089848 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc408014420 con 0x7fc4100ccf00 2023-07-06T21:42:27.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc406ffd640 1 -- 172.21.15.55:0/1033089848 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc408014580 con 0x7fc4100ccf00 2023-07-06T21:42:27.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc406ffd640 1 -- 172.21.15.55:0/1033089848 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc408014930 con 0x7fc4100ccf00 2023-07-06T21:42:27.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc41849c640 1 -- 172.21.15.55:0/1033089848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41014d790 con 0x7fc4100ccf00 2023-07-06T21:42:27.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.647+0000 7fc41849c640 1 -- 172.21.15.55:0/1033089848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41015d6d0 con 0x7fc4100ccf00 2023-07-06T21:42:27.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.651+0000 7fc41849c640 1 -- 172.21.15.55:0/1033089848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc410066d60 con 0x7fc4100ccf00 2023-07-06T21:42:27.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.651+0000 7fc406ffd640 1 -- 172.21.15.55:0/1033089848 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc408014a90 con 0x7fc4100ccf00 2023-07-06T21:42:27.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.651+0000 7fc406ffd640 1 --2- 172.21.15.55:0/1033089848 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc3f4066280 0x7fc3f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.651+0000 7fc406ffd640 1 -- 172.21.15.55:0/1033089848 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc408084880 con 0x7fc4100ccf00 2023-07-06T21:42:27.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.651+0000 7fc416238640 1 --2- 172.21.15.55:0/1033089848 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc3f4066280 0x7fc3f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.651+0000 7fc416238640 1 --2- 172.21.15.55:0/1033089848 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc3f4066280 0x7fc3f4068730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0ad000 tx=0x7fc40c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:27.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.655+0000 7fc406ffd640 1 -- 172.21.15.55:0/1033089848 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc4080554b0 con 0x7fc4100ccf00 2023-07-06T21:42:27.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.815+0000 7fc41849c640 1 -- 172.21.15.55:0/1033089848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc41014dc40 con 0x7fc4100ccf00 2023-07-06T21:42:27.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.815+0000 7fc406ffd640 1 -- 172.21.15.55:0/1033089848 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fc408055040 con 0x7fc4100ccf00 2023-07-06T21:42:27.821 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:27.822 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:15.295464+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:27.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.819+0000 7fc41849c640 1 -- 172.21.15.55:0/1033089848 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc3f4066280 msgr2=0x7fc3f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:27.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.819+0000 7fc41849c640 1 --2- 172.21.15.55:0/1033089848 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc3f4066280 0x7fc3f4068730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0ad000 tx=0x7fc40c0a6000 comp rx=0 tx=0).stop 2023-07-06T21:42:27.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.819+0000 7fc41849c640 1 -- 172.21.15.55:0/1033089848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100ccf00 msgr2=0x7fc41015d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:27.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.819+0000 7fc41849c640 1 --2- 172.21.15.55:0/1033089848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100ccf00 0x7fc41015d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc408009fd0 tx=0x7fc40800e4b0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.819+0000 7fc41849c640 1 -- 172.21.15.55:0/1033089848 shutdown_connections 2023-07-06T21:42:27.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.819+0000 7fc41849c640 1 --2- 172.21.15.55:0/1033089848 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc3f4066280 0x7fc3f4068730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.819+0000 7fc41849c640 1 --2- 172.21.15.55:0/1033089848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100ccf00 0x7fc41015d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.819+0000 7fc41849c640 1 --2- 172.21.15.55:0/1033089848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4100ccab0 0x7fc41014df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.819+0000 7fc41849c640 1 --2- 172.21.15.55:0/1033089848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4100b7cd0 0x7fc41014e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.819+0000 7fc41849c640 1 -- 172.21.15.55:0/1033089848 >> 172.21.15.55:0/1033089848 conn(0x7fc4100ceee0 msgr2=0x7fc4101581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:27.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.819+0000 7fc41849c640 1 -- 172.21.15.55:0/1033089848 shutdown_connections 2023-07-06T21:42:27.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.819+0000 7fc41849c640 1 -- 172.21.15.55:0/1033089848 wait complete. 2023-07-06T21:42:27.842 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T21:42:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.983+0000 7fea9b59e640 1 Processor -- start 2023-07-06T21:42:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.983+0000 7fea9b59e640 1 -- start start 2023-07-06T21:42:27.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.983+0000 7fea9b59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea9c1646a0 0x7fea9c166a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.983+0000 7fea9b59e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c0cc740 con 0x7fea9c0b1250 2023-07-06T21:42:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.983+0000 7fea9b59e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c1601a0 con 0x7fea9c0d0630 2023-07-06T21:42:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.983+0000 7fea9b59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0ccc90 con 0x7fea9c1646a0 2023-07-06T21:42:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.983+0000 7fea9a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fea9c0b1250 0x7fea9c15f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57478/0 (socket says 172.21.15.55:57478) 2023-07-06T21:42:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.983+0000 7fea9a59c640 1 -- 172.21.15.55:0/233871051 learned_addr learned my addr 172.21.15.55:0/233871051 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea9ad9d640 1 --2- 172.21.15.55:0/233871051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea9c1646a0 0x7fea9c166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 -- 172.21.15.55:0/233871051 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189758252 0 0) 0x7fea9c0cc740 con 0x7fea9c0b1250 2023-07-06T21:42:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 -- 172.21.15.55:0/233871051 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea88003530 con 0x7fea9c0b1250 2023-07-06T21:42:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 -- 172.21.15.55:0/233871051 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2881416075 0 0) 0x7fea88003530 con 0x7fea9c0b1250 2023-07-06T21:42:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 -- 172.21.15.55:0/233871051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea9c1646a0 msgr2=0x7fea9c166a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 --2- 172.21.15.55:0/233871051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea9c1646a0 0x7fea9c166a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 -- 172.21.15.55:0/233871051 >> v1:172.21.15.138:6789/0 conn(0x7fea9c0d0630 legacy=0x7fea9c15fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 -- 172.21.15.55:0/233871051 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c0b29c0 con 0x7fea9c0b1250 2023-07-06T21:42:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 -- 172.21.15.55:0/233871051 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fea8c001680 con 0x7fea9c0b1250 2023-07-06T21:42:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 -- 172.21.15.55:0/233871051 >> v1:172.21.15.55:6789/0 conn(0x7fea9c0b1250 legacy=0x7fea9c15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 --2- 172.21.15.55:0/233871051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea9c1646a0 0x7fea880039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 --2- 172.21.15.55:0/233871051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea88003f30 0x7fea880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 --2- 172.21.15.55:0/233871051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea88004d10 0x7fea88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 -- 172.21.15.55:0/233871051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0ccc90 con 0x7fea88004d10 2023-07-06T21:42:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 -- 172.21.15.55:0/233871051 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8800ba70 con 0x7fea88003f30 2023-07-06T21:42:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea99d9b640 1 -- 172.21.15.55:0/233871051 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8800bc30 con 0x7fea9c1646a0 2023-07-06T21:42:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea9ad9d640 1 --2- 172.21.15.55:0/233871051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea88004d10 0x7fea88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea9a59c640 1 --2- 172.21.15.55:0/233871051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea9c1646a0 0x7fea880039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea93fff640 1 --2- 172.21.15.55:0/233871051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea88003f30 0x7fea880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea9ad9d640 1 -- 172.21.15.55:0/233871051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea9c1646a0 msgr2=0x7fea880039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea9ad9d640 1 --2- 172.21.15.55:0/233871051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea9c1646a0 0x7fea880039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea9ad9d640 1 -- 172.21.15.55:0/233871051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea88003f30 msgr2=0x7fea880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea9ad9d640 1 --2- 172.21.15.55:0/233871051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea88003f30 0x7fea880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.987+0000 7fea9ad9d640 1 -- 172.21.15.55:0/233871051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea88003530 con 0x7fea88004d10 2023-07-06T21:42:27.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.991+0000 7fea9ad9d640 1 --2- 172.21.15.55:0/233871051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea88004d10 0x7fea88005180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0cdc90 tx=0x7fea9401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37257ffc217e333 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:27.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.991+0000 7fea99d9b640 1 -- 172.21.15.55:0/233871051 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea940a5c10 con 0x7fea88004d10 2023-07-06T21:42:27.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.991+0000 7fea99d9b640 1 -- 172.21.15.55:0/233871051 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9400f040 con 0x7fea88004d10 2023-07-06T21:42:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.991+0000 7fea99d9b640 1 -- 172.21.15.55:0/233871051 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea940ad440 con 0x7fea88004d10 2023-07-06T21:42:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.991+0000 7fea9b59e640 1 -- 172.21.15.55:0/233871051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea88004d10 msgr2=0x7fea88005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.991+0000 7fea9b59e640 1 --2- 172.21.15.55:0/233871051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea88004d10 0x7fea88005180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0cdc90 tx=0x7fea9401cc00 comp rx=0 tx=0).stop 2023-07-06T21:42:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.991+0000 7fea9ad9d640 1 -- 172.21.15.55:0/233871051 reap_dead start 2023-07-06T21:42:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.991+0000 7fea9b59e640 1 -- 172.21.15.55:0/233871051 shutdown_connections 2023-07-06T21:42:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.991+0000 7fea9b59e640 1 -- 172.21.15.55:0/233871051 >> 172.21.15.55:0/233871051 conn(0x7fea9c0b3b60 msgr2=0x7fea9c0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.991+0000 7fea9b59e640 1 -- 172.21.15.55:0/233871051 shutdown_connections 2023-07-06T21:42:27.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.991+0000 7fea9b59e640 1 -- 172.21.15.55:0/233871051 wait complete. 2023-07-06T21:42:28.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.991+0000 7fea9b59e640 1 Processor -- start 2023-07-06T21:42:28.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.991+0000 7fea9b59e640 1 -- start start 2023-07-06T21:42:28.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea9b59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea88004d10 0x7fea9c15b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:28.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea9b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c0c8610 0x7fea9c1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:28.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea9b59e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea9c157f00 0x7fea9c0c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:28.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea9b59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c14f4a0 con 0x7fea9c0c8610 2023-07-06T21:42:28.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea9b59e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c158380 con 0x7fea9c157f00 2023-07-06T21:42:28.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea9b59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0c8a80 con 0x7fea88004d10 2023-07-06T21:42:28.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea93fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c0c8610 0x7fea9c1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:28.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea93fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c0c8610 0x7fea9c1579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59850/0 (socket says 172.21.15.55:59850) 2023-07-06T21:42:28.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea93fff640 1 -- 172.21.15.55:0/664247004 learned_addr learned my addr 172.21.15.55:0/664247004 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:28.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea9a59c640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea88004d10 0x7fea9c15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:28.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea9ad9d640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea9c157f00 0x7fea9c0c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:28.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea93fff640 1 -- 172.21.15.55:0/664247004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea88004d10 msgr2=0x7fea9c15b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea93fff640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea88004d10 0x7fea9c15b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea93fff640 1 -- 172.21.15.55:0/664247004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea9c157f00 msgr2=0x7fea9c0c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea93fff640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea9c157f00 0x7fea9c0c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea93fff640 1 -- 172.21.15.55:0/664247004 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c14eee0 con 0x7fea9c0c8610 2023-07-06T21:42:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea9ad9d640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea9c157f00 0x7fea9c0c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea93fff640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c0c8610 0x7fea9c1579c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fea8400f7f0 tx=0x7fea8400fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea92ffd640 1 -- 172.21.15.55:0/664247004 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea840050d0 con 0x7fea9c0c8610 2023-07-06T21:42:28.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea92ffd640 1 -- 172.21.15.55:0/664247004 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea84005230 con 0x7fea9c0c8610 2023-07-06T21:42:28.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea92ffd640 1 -- 172.21.15.55:0/664247004 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8400d730 con 0x7fea9c0c8610 2023-07-06T21:42:28.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea9b59e640 1 -- 172.21.15.55:0/664247004 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c14f1c0 con 0x7fea9c0c8610 2023-07-06T21:42:28.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea9b59e640 1 -- 172.21.15.55:0/664247004 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c15d350 con 0x7fea9c0c8610 2023-07-06T21:42:28.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea9b59e640 1 -- 172.21.15.55:0/664247004 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c15d510 con 0x7fea9c0c8610 2023-07-06T21:42:28.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.995+0000 7fea92ffd640 1 -- 172.21.15.55:0/664247004 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea8400d890 con 0x7fea9c0c8610 2023-07-06T21:42:28.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.999+0000 7fea92ffd640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fea7c0662b0 0x7fea7c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:28.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.999+0000 7fea92ffd640 1 -- 172.21.15.55:0/664247004 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fea84083f10 con 0x7fea9c0c8610 2023-07-06T21:42:28.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.999+0000 7fea9a59c640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fea7c0662b0 0x7fea7c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:28.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:27.999+0000 7fea9a59c640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fea7c0662b0 0x7fea7c068760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0017b0 tx=0x7fea8c001600 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:28.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.003+0000 7fea92ffd640 1 -- 172.21.15.55:0/664247004 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea84051090 con 0x7fea9c0c8610 2023-07-06T21:42:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.191+0000 7fea9b59e640 1 -- 172.21.15.55:0/664247004 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fea9c15ced0 con 0x7fea9c0c8610 2023-07-06T21:42:28.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.371+0000 7fea92ffd640 1 -- 172.21.15.55:0/664247004 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fea9c15ced0 con 0x7fea9c0c8610 2023-07-06T21:42:28.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.371+0000 7fea9b59e640 1 -- 172.21.15.55:0/664247004 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fea7c0662b0 msgr2=0x7fea7c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.371+0000 7fea9b59e640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fea7c0662b0 0x7fea7c068760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0017b0 tx=0x7fea8c001600 comp rx=0 tx=0).stop 2023-07-06T21:42:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.371+0000 7fea9b59e640 1 -- 172.21.15.55:0/664247004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c0c8610 msgr2=0x7fea9c1579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.371+0000 7fea9b59e640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c0c8610 0x7fea9c1579c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fea8400f7f0 tx=0x7fea8400fbf0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.371+0000 7fea9b59e640 1 -- 172.21.15.55:0/664247004 shutdown_connections 2023-07-06T21:42:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.371+0000 7fea9b59e640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fea7c0662b0 0x7fea7c068760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.371+0000 7fea9b59e640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea9c157f00 0x7fea9c0c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.371+0000 7fea9b59e640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c0c8610 0x7fea9c1579c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.371+0000 7fea9b59e640 1 --2- 172.21.15.55:0/664247004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea88004d10 0x7fea9c15b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.371+0000 7fea9b59e640 1 -- 172.21.15.55:0/664247004 >> 172.21.15.55:0/664247004 conn(0x7fea9c0b3b60 msgr2=0x7fea9c0cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.371+0000 7fea9b59e640 1 -- 172.21.15.55:0/664247004 shutdown_connections 2023-07-06T21:42:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.371+0000 7fea9b59e640 1 -- 172.21.15.55:0/664247004 wait complete. 2023-07-06T21:42:28.397 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-07-06T21:42:28.397 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T21:42:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.535+0000 7f73c4407640 1 Processor -- start 2023-07-06T21:42:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.535+0000 7f73c4407640 1 -- start start 2023-07-06T21:42:28.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c4407640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f73bc158850 0x7f73bc0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c4407640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73bc0ca130 0x7f73bc0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c4407640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73bc0703e0 0x7f73bc070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c4407640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73bc070dc0 con 0x7f73bc0ca130 2023-07-06T21:42:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c4407640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73bc158c20 con 0x7f73bc158850 2023-07-06T21:42:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c4407640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc0c8db0 con 0x7f73bc0703e0 2023-07-06T21:42:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c19a2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73bc0ca130 0x7f73bc0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c19a2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73bc0ca130 0x7f73bc0ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59860/0 (socket says 172.21.15.55:59860) 2023-07-06T21:42:28.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c19a2640 1 -- 172.21.15.55:0/754049157 learned_addr learned my addr 172.21.15.55:0/754049157 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:28.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c21a3640 1 --2- 172.21.15.55:0/754049157 >> v2:172.21.15.138:3300/0 conn(0x7f73bc158850 0x7f73bc0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:28.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c29a4640 1 --2- 172.21.15.55:0/754049157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73bc0703e0 0x7f73bc070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:28.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c19a2640 1 -- 172.21.15.55:0/754049157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73bc0703e0 msgr2=0x7f73bc070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:28.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c19a2640 1 --2- 172.21.15.55:0/754049157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73bc0703e0 0x7f73bc070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c19a2640 1 -- 172.21.15.55:0/754049157 >> v2:172.21.15.138:3300/0 conn(0x7f73bc158850 msgr2=0x7f73bc0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:28.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c19a2640 1 --2- 172.21.15.55:0/754049157 >> v2:172.21.15.138:3300/0 conn(0x7f73bc158850 0x7f73bc0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c19a2640 1 -- 172.21.15.55:0/754049157 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc0c9090 con 0x7f73bc0ca130 2023-07-06T21:42:28.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.539+0000 7f73c29a4640 1 --2- 172.21.15.55:0/754049157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73bc0703e0 0x7f73bc070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:28.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c19a2640 1 --2- 172.21.15.55:0/754049157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc0ca130 0x7f73bc0ccf70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f73bc06eaf0 tx=0x7f73ac01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9eb70f07906707 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:28.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c11a1640 1 -- 172.21.15.55:0/754049157 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac0a89b0 con 0x7f73bc0ca130 2023-07-06T21:42:28.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c11a1640 1 -- 172.21.15.55:0/754049157 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ac0a8b10 con 0x7f73bc0ca130 2023-07-06T21:42:28.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c11a1640 1 -- 172.21.15.55:0/754049157 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac0a8ea0 con 0x7f73bc0ca130 2023-07-06T21:42:28.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c4407640 1 -- 172.21.15.55:0/754049157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc0ca130 msgr2=0x7f73bc0ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:28.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c4407640 1 --2- 172.21.15.55:0/754049157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc0ca130 0x7f73bc0ccf70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f73bc06eaf0 tx=0x7f73ac01ecf0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c4407640 1 -- 172.21.15.55:0/754049157 shutdown_connections 2023-07-06T21:42:28.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c4407640 1 --2- 172.21.15.55:0/754049157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73bc0703e0 0x7f73bc070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c4407640 1 --2- 172.21.15.55:0/754049157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc0ca130 0x7f73bc0ccf70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c4407640 1 --2- 172.21.15.55:0/754049157 >> v2:172.21.15.138:3300/0 conn(0x7f73bc158850 0x7f73bc0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c4407640 1 -- 172.21.15.55:0/754049157 >> 172.21.15.55:0/754049157 conn(0x7f73bc0cea70 msgr2=0x7f73bc0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:28.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c4407640 1 -- 172.21.15.55:0/754049157 shutdown_connections 2023-07-06T21:42:28.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c4407640 1 -- 172.21.15.55:0/754049157 wait complete. 2023-07-06T21:42:28.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c4407640 1 Processor -- start 2023-07-06T21:42:28.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.543+0000 7f73c4407640 1 -- start start 2023-07-06T21:42:28.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c4407640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc0703e0 0x7f73bc0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:28.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c4407640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73bc0ca130 0x7f73bc06c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:28.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c4407640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73bc158850 0x7f73bc0c3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:28.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c4407640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc069960 con 0x7f73bc0703e0 2023-07-06T21:42:28.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c4407640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc069c40 con 0x7f73bc0ca130 2023-07-06T21:42:28.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c4407640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc069f20 con 0x7f73bc158850 2023-07-06T21:42:28.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c21a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc0703e0 0x7f73bc0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:28.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c21a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc0703e0 0x7f73bc0c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59872/0 (socket says 172.21.15.55:59872) 2023-07-06T21:42:28.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c21a3640 1 -- 172.21.15.55:0/865455265 learned_addr learned my addr 172.21.15.55:0/865455265 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:28.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c29a4640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73bc158850 0x7f73bc0c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:28.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c19a2640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73bc0ca130 0x7f73bc06c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:28.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c21a3640 1 -- 172.21.15.55:0/865455265 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73bc158850 msgr2=0x7f73bc0c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:28.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c21a3640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73bc158850 0x7f73bc0c3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c21a3640 1 -- 172.21.15.55:0/865455265 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73bc0ca130 msgr2=0x7f73bc06c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:28.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c21a3640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73bc0ca130 0x7f73bc06c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:28.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c21a3640 1 -- 172.21.15.55:0/865455265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ac0094d0 con 0x7f73bc0703e0 2023-07-06T21:42:28.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c19a2640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73bc0ca130 0x7f73bc06c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:28.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c29a4640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73bc158850 0x7f73bc0c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:28.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c21a3640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc0703e0 0x7f73bc0c7250 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f73b800d5f0 tx=0x7f73b800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73b2ffd640 1 -- 172.21.15.55:0/865455265 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b80125f0 con 0x7f73bc0703e0 2023-07-06T21:42:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73b2ffd640 1 -- 172.21.15.55:0/865455265 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b8012750 con 0x7f73bc0703e0 2023-07-06T21:42:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73b2ffd640 1 -- 172.21.15.55:0/865455265 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b8012ae0 con 0x7f73bc0703e0 2023-07-06T21:42:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c4407640 1 -- 172.21.15.55:0/865455265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73bc06a200 con 0x7f73bc0703e0 2023-07-06T21:42:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c4407640 1 -- 172.21.15.55:0/865455265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73bc1571b0 con 0x7f73bc0703e0 2023-07-06T21:42:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73c4407640 1 -- 172.21.15.55:0/865455265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73bc1573a0 con 0x7f73bc0703e0 2023-07-06T21:42:28.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.547+0000 7f73b2ffd640 1 -- 172.21.15.55:0/865455265 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f73b8012c40 con 0x7f73bc0703e0 2023-07-06T21:42:28.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.551+0000 7f73b2ffd640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f73a0066280 0x7f73a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:28.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.551+0000 7f73b2ffd640 1 -- 172.21.15.55:0/865455265 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f73b8084510 con 0x7f73bc0703e0 2023-07-06T21:42:28.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.551+0000 7f73c19a2640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f73a0066280 0x7f73a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:28.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.551+0000 7f73c19a2640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f73a0066280 0x7f73a0068730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0b2000 tx=0x7f73ac0aa070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:28.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.555+0000 7f73b2ffd640 1 -- 172.21.15.55:0/865455265 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73bc1573a0 con 0x7f73bc0703e0 2023-07-06T21:42:28.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:28.739+0000 7f73c4407640 1 -- 172.21.15.55:0/865455265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f73bc1573a0 con 0x7f73bc0703e0 2023-07-06T21:42:29.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.379+0000 7f73b2ffd640 1 -- 172.21.15.55:0/865455265 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f73bc1573a0 con 0x7f73bc0703e0 2023-07-06T21:42:29.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.379+0000 7f73c4407640 1 -- 172.21.15.55:0/865455265 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f73a0066280 msgr2=0x7f73a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:29.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.379+0000 7f73c4407640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f73a0066280 0x7f73a0068730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0b2000 tx=0x7f73ac0aa070 comp rx=0 tx=0).stop 2023-07-06T21:42:29.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.379+0000 7f73c4407640 1 -- 172.21.15.55:0/865455265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc0703e0 msgr2=0x7f73bc0c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:29.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.379+0000 7f73c4407640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc0703e0 0x7f73bc0c7250 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f73b800d5f0 tx=0x7f73b800dab0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.379+0000 7f73c4407640 1 -- 172.21.15.55:0/865455265 shutdown_connections 2023-07-06T21:42:29.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.379+0000 7f73c4407640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f73a0066280 0x7f73a0068730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.379+0000 7f73c4407640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73bc158850 0x7f73bc0c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.379+0000 7f73c4407640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73bc0ca130 0x7f73bc06c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.383+0000 7f73c4407640 1 --2- 172.21.15.55:0/865455265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc0703e0 0x7f73bc0c7250 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.383+0000 7f73c4407640 1 -- 172.21.15.55:0/865455265 >> 172.21.15.55:0/865455265 conn(0x7f73bc0cea70 msgr2=0x7f73bc0ada50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:29.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.383+0000 7f73c4407640 1 -- 172.21.15.55:0/865455265 shutdown_connections 2023-07-06T21:42:29.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.383+0000 7f73c4407640 1 -- 172.21.15.55:0/865455265 wait complete. 2023-07-06T21:42:29.409 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T21:42:29.410 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:42:29.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.551+0000 7f0e7d6d8640 1 Processor -- start 2023-07-06T21:42:29.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.551+0000 7f0e7d6d8640 1 -- start start 2023-07-06T21:42:29.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e7d6d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0e780b14a0 0x7f0e7806f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:29.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e7d6d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0e780c4c50 0x7f0e7806f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:29.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e7d6d8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e780c7880 con 0x7f0e781598c0 2023-07-06T21:42:29.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e7d6d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e780cbf40 con 0x7f0e780b14a0 2023-07-06T21:42:29.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e7d6d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e780c75a0 con 0x7f0e780c4c50 2023-07-06T21:42:29.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e6ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0e780b14a0 0x7f0e7806f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:29.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e6ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0e780b14a0 0x7f0e7806f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59886/0 (socket says 172.21.15.55:59886) 2023-07-06T21:42:29.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e6ffff640 1 -- 172.21.15.55:0/1740275294 learned_addr learned my addr 172.21.15.55:0/1740275294 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:29.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e777fe640 1 --2- 172.21.15.55:0/1740275294 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0e780c4c50 0x7f0e7806f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:29.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e6ffff640 1 -- 172.21.15.55:0/1740275294 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0e780c4c50 msgr2=0x7f0e7806f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:29.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e6ffff640 1 --2- 172.21.15.55:0/1740275294 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0e780c4c50 0x7f0e7806f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e6ffff640 1 -- 172.21.15.55:0/1740275294 >> v1:172.21.15.138:6789/0 conn(0x7f0e781598c0 legacy=0x7f0e780b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:29.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e6ffff640 1 -- 172.21.15.55:0/1740275294 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e780cb880 con 0x7f0e780b14a0 2023-07-06T21:42:29.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e777fe640 1 --2- 172.21.15.55:0/1740275294 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0e780c4c50 0x7f0e7806f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:29.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e6ffff640 1 --2- 172.21.15.55:0/1740275294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e780b14a0 0x7f0e7806f480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009870 tx=0x7f0e6001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db08910432b2a9f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e767fc640 1 -- 172.21.15.55:0/1740275294 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600ab620 con 0x7f0e780b14a0 2023-07-06T21:42:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e767fc640 1 -- 172.21.15.55:0/1740275294 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e600ab780 con 0x7f0e780b14a0 2023-07-06T21:42:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.555+0000 7f0e767fc640 1 -- 172.21.15.55:0/1740275294 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600abb10 con 0x7f0e780b14a0 2023-07-06T21:42:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1740275294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e780b14a0 msgr2=0x7f0e7806f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:29.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 --2- 172.21.15.55:0/1740275294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e780b14a0 0x7f0e7806f480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009870 tx=0x7f0e6001c440 comp rx=0 tx=0).stop 2023-07-06T21:42:29.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1740275294 shutdown_connections 2023-07-06T21:42:29.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 --2- 172.21.15.55:0/1740275294 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0e780c4c50 0x7f0e7806f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 --2- 172.21.15.55:0/1740275294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e780b14a0 0x7f0e7806f480 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1740275294 >> 172.21.15.55:0/1740275294 conn(0x7f0e780ca690 msgr2=0x7f0e780caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:29.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1740275294 shutdown_connections 2023-07-06T21:42:29.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1740275294 wait complete. 2023-07-06T21:42:29.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 Processor -- start 2023-07-06T21:42:29.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 -- start start 2023-07-06T21:42:29.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e780b14a0 0x7f0e7815a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:29.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0e780c4c50 0x7f0e781f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:29.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e781598c0 0x7f0e7815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:29.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e78158920 con 0x7f0e780b14a0 2023-07-06T21:42:29.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e78154b70 con 0x7f0e781598c0 2023-07-06T21:42:29.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e7d6d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e78153f60 con 0x7f0e780c4c50 2023-07-06T21:42:29.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e76ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e780b14a0 0x7f0e7815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:29.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e76ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e780b14a0 0x7f0e7815a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59890/0 (socket says 172.21.15.55:59890) 2023-07-06T21:42:29.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e76ffd640 1 -- 172.21.15.55:0/1974112218 learned_addr learned my addr 172.21.15.55:0/1974112218 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:29.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.559+0000 7f0e777fe640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e781598c0 0x7f0e7815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:29.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e6ffff640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0e780c4c50 0x7f0e781f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:29.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e76ffd640 1 -- 172.21.15.55:0/1974112218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0e780c4c50 msgr2=0x7f0e781f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:29.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e76ffd640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0e780c4c50 0x7f0e781f8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e76ffd640 1 -- 172.21.15.55:0/1974112218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e781598c0 msgr2=0x7f0e7815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:29.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e76ffd640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e781598c0 0x7f0e7815c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e76ffd640 1 -- 172.21.15.55:0/1974112218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e600094d0 con 0x7f0e780b14a0 2023-07-06T21:42:29.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e777fe640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e781598c0 0x7f0e7815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:29.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e6ffff640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0e780c4c50 0x7f0e781f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:29.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e76ffd640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e780b14a0 0x7f0e7815a980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0e6800b440 tx=0x7f0e6800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:29.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e6f7fe640 1 -- 172.21.15.55:0/1974112218 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68011890 con 0x7f0e780b14a0 2023-07-06T21:42:29.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e6f7fe640 1 -- 172.21.15.55:0/1974112218 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e680119f0 con 0x7f0e780b14a0 2023-07-06T21:42:29.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e6f7fe640 1 -- 172.21.15.55:0/1974112218 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68011da0 con 0x7f0e780b14a0 2023-07-06T21:42:29.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1974112218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e78154240 con 0x7f0e780b14a0 2023-07-06T21:42:29.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1974112218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e78154800 con 0x7f0e780b14a0 2023-07-06T21:42:29.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1974112218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7804d790 con 0x7f0e780b14a0 2023-07-06T21:42:29.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e6f7fe640 1 -- 172.21.15.55:0/1974112218 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e6801a400 con 0x7f0e780b14a0 2023-07-06T21:42:29.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e6f7fe640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0e58066280 0x7f0e58068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:29.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e6f7fe640 1 -- 172.21.15.55:0/1974112218 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0e680840c0 con 0x7f0e780b14a0 2023-07-06T21:42:29.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.563+0000 7f0e6ffff640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0e58066280 0x7f0e58068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:29.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.567+0000 7f0e6ffff640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0e58066280 0x7f0e58068730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e600af000 tx=0x7f0e600a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:29.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.567+0000 7f0e6f7fe640 1 -- 172.21.15.55:0/1974112218 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0e68051240 con 0x7f0e780b14a0 2023-07-06T21:42:29.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.759+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1974112218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e780ac110 con 0x7f0e780b14a0 2023-07-06T21:42:29.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.759+0000 7f0e6f7fe640 1 -- 172.21.15.55:0/1974112218 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4667 (secure 0 0 0) 0x7f0e68054860 con 0x7f0e780b14a0 2023-07-06T21:42:29.766 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:29.766 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/720785920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":720785920},{"type":"v1","addr":"172.21.15.138:6834","nonce":720785920}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3780018439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3780018439},{"type":"v1","addr":"172.21.15.138:6835","nonce":3780018439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/690984517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":690984517},{"type":"v1","addr":"172.21.15.55:6837","nonce":690984517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:42:10.854280+0000","modified":"2023-07-06T21:42:29.371982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/1421414378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1421414378},{"type":"v1","addr":"172.21.15.55:6836","nonce":1421414378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T21:42:29.768 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-07-06T21:42:29.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.759+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1974112218 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0e58066280 msgr2=0x7f0e58068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:29.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.759+0000 7f0e7d6d8640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0e58066280 0x7f0e58068730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e600af000 tx=0x7f0e600a7000 comp rx=0 tx=0).stop 2023-07-06T21:42:29.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.759+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1974112218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e780b14a0 msgr2=0x7f0e7815a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:29.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.759+0000 7f0e7d6d8640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e780b14a0 0x7f0e7815a980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0e6800b440 tx=0x7f0e6800b900 comp rx=0 tx=0).stop 2023-07-06T21:42:29.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.763+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1974112218 shutdown_connections 2023-07-06T21:42:29.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.763+0000 7f0e7d6d8640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0e58066280 0x7f0e58068730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.763+0000 7f0e7d6d8640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e781598c0 0x7f0e7815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.763+0000 7f0e7d6d8640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0e780c4c50 0x7f0e781f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.763+0000 7f0e7d6d8640 1 --2- 172.21.15.55:0/1974112218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e780b14a0 0x7f0e7815a980 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.763+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1974112218 >> 172.21.15.55:0/1974112218 conn(0x7f0e780ca690 msgr2=0x7f0e781519b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:29.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.763+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1974112218 shutdown_connections 2023-07-06T21:42:29.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.763+0000 7f0e7d6d8640 1 -- 172.21.15.55:0/1974112218 wait complete. 2023-07-06T21:42:29.786 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:29.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.923+0000 7f6484582640 1 Processor -- start 2023-07-06T21:42:29.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.923+0000 7f6484582640 1 -- start start 2023-07-06T21:42:29.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.923+0000 7f6484582640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f647c0cb4a0 0x7f647c15cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:29.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.923+0000 7f6484582640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f647c15f740 0x7f647c0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:29.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.923+0000 7f6484582640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c0b5b50 con 0x7f647c0cbc70 2023-07-06T21:42:29.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.923+0000 7f6484582640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c15d130 con 0x7f647c15f740 2023-07-06T21:42:29.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.923+0000 7f6484582640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c0cc8e0 con 0x7f647c0cb4a0 2023-07-06T21:42:29.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.927+0000 7f6481b1d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f647c15f740 0x7f647c0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:29.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.927+0000 7f6481b1d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f647c15f740 0x7f647c0ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59898/0 (socket says 172.21.15.55:59898) 2023-07-06T21:42:29.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.927+0000 7f6481b1d640 1 -- 172.21.15.55:0/2638123718 learned_addr learned my addr 172.21.15.55:0/2638123718 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:29.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.927+0000 7f648231e640 1 --2- 172.21.15.55:0/2638123718 >> v2:172.21.15.138:3300/0 conn(0x7f647c0cb4a0 0x7f647c15cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:29.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.927+0000 7f6481b1d640 1 -- 172.21.15.55:0/2638123718 >> v2:172.21.15.138:3300/0 conn(0x7f647c0cb4a0 msgr2=0x7f647c15cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:29.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.927+0000 7f6481b1d640 1 --2- 172.21.15.55:0/2638123718 >> v2:172.21.15.138:3300/0 conn(0x7f647c0cb4a0 0x7f647c15cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.927+0000 7f6481b1d640 1 -- 172.21.15.55:0/2638123718 >> v1:172.21.15.138:6789/0 conn(0x7f647c0cbc70 legacy=0x7f647c0ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:29.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.927+0000 7f6481b1d640 1 -- 172.21.15.55:0/2638123718 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c15fc00 con 0x7f647c15f740 2023-07-06T21:42:29.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.927+0000 7f6481b1d640 1 --2- 172.21.15.55:0/2638123718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f647c15f740 0x7f647c0ca720 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f647c0cdb90 tx=0x7f646c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfd545ded672fa5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:29.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.927+0000 7f648131c640 1 -- 172.21.15.55:0/2638123718 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0ab5f0 con 0x7f647c15f740 2023-07-06T21:42:29.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.927+0000 7f648131c640 1 -- 172.21.15.55:0/2638123718 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c0ab750 con 0x7f647c15f740 2023-07-06T21:42:29.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.927+0000 7f648131c640 1 -- 172.21.15.55:0/2638123718 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0abae0 con 0x7f647c15f740 2023-07-06T21:42:29.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 -- 172.21.15.55:0/2638123718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f647c15f740 msgr2=0x7f647c0ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:29.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 --2- 172.21.15.55:0/2638123718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f647c15f740 0x7f647c0ca720 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f647c0cdb90 tx=0x7f646c01c500 comp rx=0 tx=0).stop 2023-07-06T21:42:29.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 -- 172.21.15.55:0/2638123718 shutdown_connections 2023-07-06T21:42:29.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 --2- 172.21.15.55:0/2638123718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f647c15f740 0x7f647c0ca720 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 --2- 172.21.15.55:0/2638123718 >> v2:172.21.15.138:3300/0 conn(0x7f647c0cb4a0 0x7f647c15cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 -- 172.21.15.55:0/2638123718 >> 172.21.15.55:0/2638123718 conn(0x7f647c06ee80 msgr2=0x7f647c06f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:29.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 -- 172.21.15.55:0/2638123718 shutdown_connections 2023-07-06T21:42:29.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 -- 172.21.15.55:0/2638123718 wait complete. 2023-07-06T21:42:29.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 Processor -- start 2023-07-06T21:42:29.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 -- start start 2023-07-06T21:42:29.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f647c0cb4a0 0x7f647c156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:29.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f647c0cbc70 0x7f647c0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:29.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f647c15f740 0x7f647c0c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:29.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0c7330 con 0x7f647c15f740 2023-07-06T21:42:29.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0c7eb0 con 0x7f647c0cbc70 2023-07-06T21:42:29.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6484582640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0c7510 con 0x7f647c0cb4a0 2023-07-06T21:42:29.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6482b1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f647c15f740 0x7f647c0c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:29.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6482b1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f647c15f740 0x7f647c0c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59908/0 (socket says 172.21.15.55:59908) 2023-07-06T21:42:29.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6482b1f640 1 -- 172.21.15.55:0/754356189 learned_addr learned my addr 172.21.15.55:0/754356189 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:29.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6481b1d640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f647c0cbc70 0x7f647c0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:29.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f648231e640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f647c0cb4a0 0x7f647c156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:29.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6482b1f640 1 -- 172.21.15.55:0/754356189 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f647c0cb4a0 msgr2=0x7f647c156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:29.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6482b1f640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f647c0cb4a0 0x7f647c156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6482b1f640 1 -- 172.21.15.55:0/754356189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f647c0cbc70 msgr2=0x7f647c0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6482b1f640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f647c0cbc70 0x7f647c0c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6482b1f640 1 -- 172.21.15.55:0/754356189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c0094d0 con 0x7f647c15f740 2023-07-06T21:42:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.931+0000 7f6481b1d640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f647c0cbc70 0x7f647c0c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.935+0000 7f6482b1f640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f647c15f740 0x7f647c0c82d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f647400c770 tx=0x7f647400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.935+0000 7f6472ffd640 1 -- 172.21.15.55:0/754356189 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474003b80 con 0x7f647c15f740 2023-07-06T21:42:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.935+0000 7f6472ffd640 1 -- 172.21.15.55:0/754356189 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6474003ce0 con 0x7f647c15f740 2023-07-06T21:42:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.935+0000 7f6472ffd640 1 -- 172.21.15.55:0/754356189 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647400aa90 con 0x7f647c15f740 2023-07-06T21:42:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.935+0000 7f6484582640 1 -- 172.21.15.55:0/754356189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c0c77f0 con 0x7f647c15f740 2023-07-06T21:42:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.935+0000 7f6484582640 1 -- 172.21.15.55:0/754356189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c156d90 con 0x7f647c15f740 2023-07-06T21:42:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.935+0000 7f6484582640 1 -- 172.21.15.55:0/754356189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647c1601a0 con 0x7f647c15f740 2023-07-06T21:42:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.935+0000 7f6472ffd640 1 -- 172.21.15.55:0/754356189 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f647400abf0 con 0x7f647c15f740 2023-07-06T21:42:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.935+0000 7f6472ffd640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6460066280 0x7f6460068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.935+0000 7f6472ffd640 1 -- 172.21.15.55:0/754356189 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6474083ef0 con 0x7f647c15f740 2023-07-06T21:42:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.935+0000 7f648231e640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6460066280 0x7f6460068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.939+0000 7f648231e640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6460066280 0x7f6460068730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f647c0c72c0 tx=0x7f6478008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:29.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:29.939+0000 7f6472ffd640 1 -- 172.21.15.55:0/754356189 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f647c1601a0 con 0x7f647c15f740 2023-07-06T21:42:30.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.099+0000 7f6484582640 1 -- 172.21.15.55:0/754356189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f647c1601a0 con 0x7f647c15f740 2023-07-06T21:42:30.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.099+0000 7f6472ffd640 1 -- 172.21.15.55:0/754356189 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f647c1601a0 con 0x7f647c15f740 2023-07-06T21:42:30.105 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:30.105 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:15.295464+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.103+0000 7f6484582640 1 -- 172.21.15.55:0/754356189 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6460066280 msgr2=0x7f6460068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.103+0000 7f6484582640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6460066280 0x7f6460068730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f647c0c72c0 tx=0x7f6478008040 comp rx=0 tx=0).stop 2023-07-06T21:42:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.103+0000 7f6484582640 1 -- 172.21.15.55:0/754356189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f647c15f740 msgr2=0x7f647c0c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.103+0000 7f6484582640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f647c15f740 0x7f647c0c82d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f647400c770 tx=0x7f647400cc30 comp rx=0 tx=0).stop 2023-07-06T21:42:30.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.103+0000 7f6484582640 1 -- 172.21.15.55:0/754356189 shutdown_connections 2023-07-06T21:42:30.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.103+0000 7f6484582640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6460066280 0x7f6460068730 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.103+0000 7f6484582640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f647c15f740 0x7f647c0c82d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.103+0000 7f6484582640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f647c0cbc70 0x7f647c0c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.103+0000 7f6484582640 1 --2- 172.21.15.55:0/754356189 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f647c0cb4a0 0x7f647c156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.103+0000 7f6484582640 1 -- 172.21.15.55:0/754356189 >> 172.21.15.55:0/754356189 conn(0x7f647c06ee80 msgr2=0x7f647c0b4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:30.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.103+0000 7f6484582640 1 -- 172.21.15.55:0/754356189 shutdown_connections 2023-07-06T21:42:30.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.103+0000 7f6484582640 1 -- 172.21.15.55:0/754356189 wait complete. 2023-07-06T21:42:30.126 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T21:42:30.127 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:42:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.263+0000 7fe7fce7b640 1 Processor -- start 2023-07-06T21:42:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.263+0000 7fe7fce7b640 1 -- start start 2023-07-06T21:42:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.263+0000 7fe7fce7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7f80ca450 0x7fe7f806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.263+0000 7fe7fce7b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe7f80b3730 0x7fe7f815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.263+0000 7fe7fce7b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f8159cd0 con 0x7fe7f80712f0 2023-07-06T21:42:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.263+0000 7fe7fce7b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f80693f0 con 0x7fe7f80b3730 2023-07-06T21:42:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.263+0000 7fe7fce7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f806aca0 con 0x7fe7f80ca450 2023-07-06T21:42:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.263+0000 7fe7f6d9d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe7f80b3730 0x7fe7f815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.263+0000 7fe7f6d9d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe7f80b3730 0x7fe7f815d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:55778/0 (socket says 172.21.15.55:55778) 2023-07-06T21:42:30.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.263+0000 7fe7f6d9d640 1 -- 172.21.15.55:0/1445453511 learned_addr learned my addr 172.21.15.55:0/1445453511 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:30.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.263+0000 7fe7f659c640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fe7f80712f0 0x7fe7f80c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:47502/0 (socket says 172.21.15.55:47502) 2023-07-06T21:42:30.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.263+0000 7fe7effff640 1 --2- 172.21.15.55:0/1445453511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7f80ca450 0x7fe7f806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:30.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.267+0000 7fe7f5d9b640 1 -- 172.21.15.55:0/1445453511 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883476575 0 0) 0x7fe7f8159cd0 con 0x7fe7f80712f0 2023-07-06T21:42:30.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.267+0000 7fe7f5d9b640 1 -- 172.21.15.55:0/1445453511 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e4003530 con 0x7fe7f80712f0 2023-07-06T21:42:30.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.267+0000 7fe7effff640 1 -- 172.21.15.55:0/1445453511 >> v2:172.21.15.138:3300/0 conn(0x7fe7f80b3730 msgr2=0x7fe7f815d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:30.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.267+0000 7fe7effff640 1 --2- 172.21.15.55:0/1445453511 >> v2:172.21.15.138:3300/0 conn(0x7fe7f80b3730 0x7fe7f815d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.267+0000 7fe7effff640 1 -- 172.21.15.55:0/1445453511 >> v1:172.21.15.138:6789/0 conn(0x7fe7f80712f0 legacy=0x7fe7f80c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:30.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.267+0000 7fe7effff640 1 -- 172.21.15.55:0/1445453511 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f80696b0 con 0x7fe7f80ca450 2023-07-06T21:42:30.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.267+0000 7fe7effff640 1 --2- 172.21.15.55:0/1445453511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7f80ca450 0x7fe7f806a610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00097c0 tx=0x7fe7e001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fc5e8f2156ae6d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:30.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.267+0000 7fe7f5d9b640 1 -- 172.21.15.55:0/1445453511 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e00ab650 con 0x7fe7f80ca450 2023-07-06T21:42:30.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.267+0000 7fe7f5d9b640 1 -- 172.21.15.55:0/1445453511 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e00ab7b0 con 0x7fe7f80ca450 2023-07-06T21:42:30.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.267+0000 7fe7f5d9b640 1 -- 172.21.15.55:0/1445453511 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e00abb20 con 0x7fe7f80ca450 2023-07-06T21:42:30.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 -- 172.21.15.55:0/1445453511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7f80ca450 msgr2=0x7fe7f806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:30.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 --2- 172.21.15.55:0/1445453511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7f80ca450 0x7fe7f806a610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00097c0 tx=0x7fe7e001c450 comp rx=0 tx=0).stop 2023-07-06T21:42:30.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 -- 172.21.15.55:0/1445453511 shutdown_connections 2023-07-06T21:42:30.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 --2- 172.21.15.55:0/1445453511 >> v2:172.21.15.138:3300/0 conn(0x7fe7f80b3730 0x7fe7f815d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 --2- 172.21.15.55:0/1445453511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7f80ca450 0x7fe7f806a610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 -- 172.21.15.55:0/1445453511 >> 172.21.15.55:0/1445453511 conn(0x7fe7f80cded0 msgr2=0x7fe7f80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:30.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 -- 172.21.15.55:0/1445453511 shutdown_connections 2023-07-06T21:42:30.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 -- 172.21.15.55:0/1445453511 wait complete. 2023-07-06T21:42:30.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 Processor -- start 2023-07-06T21:42:30.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 -- start start 2023-07-06T21:42:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7f80712f0 0x7fe7f81595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f80b3730 0x7fe7f81f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7f80ca450 0x7fe7f81f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f80cb630 con 0x7fe7f80b3730 2023-07-06T21:42:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f80cb880 con 0x7fe7f80712f0 2023-07-06T21:42:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7fce7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f80cbb60 con 0x7fe7f80ca450 2023-07-06T21:42:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7effff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f80b3730 0x7fe7f81f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7effff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f80b3730 0x7fe7f81f7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59924/0 (socket says 172.21.15.55:59924) 2023-07-06T21:42:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7effff640 1 -- 172.21.15.55:0/828684651 learned_addr learned my addr 172.21.15.55:0/828684651 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7f659c640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7f80712f0 0x7fe7f81595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.271+0000 7fe7f6d9d640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7f80ca450 0x7fe7f81f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7effff640 1 -- 172.21.15.55:0/828684651 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7f80ca450 msgr2=0x7fe7f81f8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7effff640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7f80ca450 0x7fe7f81f8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7effff640 1 -- 172.21.15.55:0/828684651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7f80712f0 msgr2=0x7fe7f81595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7effff640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7f80712f0 0x7fe7f81595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7effff640 1 -- 172.21.15.55:0/828684651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e0009420 con 0x7fe7f80b3730 2023-07-06T21:42:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7f6d9d640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7f80ca450 0x7fe7f81f8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7effff640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f80b3730 0x7fe7f81f7b40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe7e001ccf0 tx=0x7fe7e001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7eeffd640 1 -- 172.21.15.55:0/828684651 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e00bf610 con 0x7fe7f80b3730 2023-07-06T21:42:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7eeffd640 1 -- 172.21.15.55:0/828684651 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e00bf770 con 0x7fe7f80b3730 2023-07-06T21:42:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7eeffd640 1 -- 172.21.15.55:0/828684651 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e00bfae0 con 0x7fe7f80b3730 2023-07-06T21:42:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7fce7b640 1 -- 172.21.15.55:0/828684651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f80cbe40 con 0x7fe7f80b3730 2023-07-06T21:42:30.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7fce7b640 1 -- 172.21.15.55:0/828684651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f80cc400 con 0x7fe7f80b3730 2023-07-06T21:42:30.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7fce7b640 1 -- 172.21.15.55:0/828684651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f8066d60 con 0x7fe7f80b3730 2023-07-06T21:42:30.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7eeffd640 1 -- 172.21.15.55:0/828684651 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe7e00bfc40 con 0x7fe7f80b3730 2023-07-06T21:42:30.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7eeffd640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe7d8066280 0x7fe7d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:30.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7eeffd640 1 -- 172.21.15.55:0/828684651 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe7e011ea50 con 0x7fe7f80b3730 2023-07-06T21:42:30.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.275+0000 7fe7f659c640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe7d8066280 0x7fe7d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:30.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.279+0000 7fe7f659c640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe7d8066280 0x7fe7d8068730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8000f70 tx=0x7fe7e8007d00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:30.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.279+0000 7fe7eeffd640 1 -- 172.21.15.55:0/828684651 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe7e00ebda0 con 0x7fe7f80b3730 2023-07-06T21:42:30.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.431+0000 7fe7fce7b640 1 -- 172.21.15.55:0/828684651 --> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7f8070530 con 0x7fe7d8066280 2023-07-06T21:42:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.443+0000 7fe7eeffd640 1 -- 172.21.15.55:0/828684651 <== mgr.4101 v2:172.21.15.55:6832/1575998409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367444 (secure 0 0 0) 0x7fe7e80072e0 con 0x7fe7d8066280 2023-07-06T21:42:30.453 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:42:30.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.451+0000 7fe7fce7b640 1 -- 172.21.15.55:0/828684651 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe7d8066280 msgr2=0x7fe7d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:30.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.451+0000 7fe7fce7b640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe7d8066280 0x7fe7d8068730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8000f70 tx=0x7fe7e8007d00 comp rx=0 tx=0).stop 2023-07-06T21:42:30.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.451+0000 7fe7fce7b640 1 -- 172.21.15.55:0/828684651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f80b3730 msgr2=0x7fe7f81f7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.451+0000 7fe7fce7b640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f80b3730 0x7fe7f81f7b40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe7e001ccf0 tx=0x7fe7e001ac90 comp rx=0 tx=0).stop 2023-07-06T21:42:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.451+0000 7fe7fce7b640 1 -- 172.21.15.55:0/828684651 shutdown_connections 2023-07-06T21:42:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.451+0000 7fe7fce7b640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe7d8066280 0x7fe7d8068730 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.451+0000 7fe7fce7b640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7f80ca450 0x7fe7f81f8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.451+0000 7fe7fce7b640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f80b3730 0x7fe7f81f7b40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.451+0000 7fe7fce7b640 1 --2- 172.21.15.55:0/828684651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7f80712f0 0x7fe7f81595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.451+0000 7fe7fce7b640 1 -- 172.21.15.55:0/828684651 >> 172.21.15.55:0/828684651 conn(0x7fe7f80cded0 msgr2=0x7fe7f815c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.451+0000 7fe7fce7b640 1 -- 172.21.15.55:0/828684651 shutdown_connections 2023-07-06T21:42:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.451+0000 7fe7fce7b640 1 -- 172.21.15.55:0/828684651 wait complete. 2023-07-06T21:42:30.474 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-07-06T21:42:29.646875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235488,"kb_used_data":3488,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739232,"statfs":{"total":773094113280,"available":772852973568,"internally_reserved":0,"allocated":3571712,"data_stored":2146947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002466"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559395+0000","last_change":"2023-07-06T21:42:14.922760+0000","last_active":"2023-07-06T21:42:15.559395+0000","last_peered":"2023-07-06T21:42:15.559395+0000","last_clean":"2023-07-06T21:42:15.559395+0000","last_became_active":"2023-07-06T21:42:14.922077+0000","last_became_peered":"2023-07-06T21:42:14.922077+0000","last_unstale":"2023-07-06T21:42:15.559395+0000","last_undegraded":"2023-07-06T21:42:15.559395+0000","last_fullsized":"2023-07-06T21:42:15.559395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:06:48.524116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555170+0000","last_change":"2023-07-06T21:42:10.476753+0000","last_active":"2023-07-06T21:42:15.555170+0000","last_peered":"2023-07-06T21:42:15.555170+0000","last_clean":"2023-07-06T21:42:15.555170+0000","last_became_active":"2023-07-06T21:42:10.476407+0000","last_became_peered":"2023-07-06T21:42:10.476407+0000","last_unstale":"2023-07-06T21:42:15.555170+0000","last_undegraded":"2023-07-06T21:42:15.555170+0000","last_fullsized":"2023-07-06T21:42:15.555170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:48.294217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302669+0000","last_change":"2023-07-06T21:42:10.894302+0000","last_active":"2023-07-06T21:42:15.302669+0000","last_peered":"2023-07-06T21:42:15.302669+0000","last_clean":"2023-07-06T21:42:15.302669+0000","last_became_active":"2023-07-06T21:42:10.894059+0000","last_became_peered":"2023-07-06T21:42:10.894059+0000","last_unstale":"2023-07-06T21:42:15.302669+0000","last_undegraded":"2023-07-06T21:42:15.302669+0000","last_fullsized":"2023-07-06T21:42:15.302669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:10:18.902553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302860+0000","last_change":"2023-07-06T21:42:14.912729+0000","last_active":"2023-07-06T21:42:15.302860+0000","last_peered":"2023-07-06T21:42:15.302860+0000","last_clean":"2023-07-06T21:42:15.302860+0000","last_became_active":"2023-07-06T21:42:14.912302+0000","last_became_peered":"2023-07-06T21:42:14.912302+0000","last_unstale":"2023-07-06T21:42:15.302860+0000","last_undegraded":"2023-07-06T21:42:15.302860+0000","last_fullsized":"2023-07-06T21:42:15.302860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:34:24.860047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814495+0000","last_change":"2023-07-06T21:42:10.468782+0000","last_active":"2023-07-06T21:42:15.814495+0000","last_peered":"2023-07-06T21:42:15.814495+0000","last_clean":"2023-07-06T21:42:15.814495+0000","last_became_active":"2023-07-06T21:42:10.468411+0000","last_became_peered":"2023-07-06T21:42:10.468411+0000","last_unstale":"2023-07-06T21:42:15.814495+0000","last_undegraded":"2023-07-06T21:42:15.814495+0000","last_fullsized":"2023-07-06T21:42:15.814495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:15:16.029351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814107+0000","last_change":"2023-07-06T21:42:10.877047+0000","last_active":"2023-07-06T21:42:15.814107+0000","last_peered":"2023-07-06T21:42:15.814107+0000","last_clean":"2023-07-06T21:42:15.814107+0000","last_became_active":"2023-07-06T21:42:10.876806+0000","last_became_peered":"2023-07-06T21:42:10.876806+0000","last_unstale":"2023-07-06T21:42:15.814107+0000","last_undegraded":"2023-07-06T21:42:15.814107+0000","last_fullsized":"2023-07-06T21:42:15.814107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:35.611286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749539+0000","last_change":"2023-07-06T21:42:14.921605+0000","last_active":"2023-07-06T21:42:15.749539+0000","last_peered":"2023-07-06T21:42:15.749539+0000","last_clean":"2023-07-06T21:42:15.749539+0000","last_became_active":"2023-07-06T21:42:14.921171+0000","last_became_peered":"2023-07-06T21:42:14.921171+0000","last_unstale":"2023-07-06T21:42:15.749539+0000","last_undegraded":"2023-07-06T21:42:15.749539+0000","last_fullsized":"2023-07-06T21:42:15.749539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:53.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750023+0000","last_change":"2023-07-06T21:42:10.482575+0000","last_active":"2023-07-06T21:42:15.750023+0000","last_peered":"2023-07-06T21:42:15.750023+0000","last_clean":"2023-07-06T21:42:15.750023+0000","last_became_active":"2023-07-06T21:42:10.482316+0000","last_became_peered":"2023-07-06T21:42:10.482316+0000","last_unstale":"2023-07-06T21:42:15.750023+0000","last_undegraded":"2023-07-06T21:42:15.750023+0000","last_fullsized":"2023-07-06T21:42:15.750023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:18:13.828606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303215+0000","last_change":"2023-07-06T21:42:10.883364+0000","last_active":"2023-07-06T21:42:15.303215+0000","last_peered":"2023-07-06T21:42:15.303215+0000","last_clean":"2023-07-06T21:42:15.303215+0000","last_became_active":"2023-07-06T21:42:10.882034+0000","last_became_peered":"2023-07-06T21:42:10.882034+0000","last_unstale":"2023-07-06T21:42:15.303215+0000","last_undegraded":"2023-07-06T21:42:15.303215+0000","last_fullsized":"2023-07-06T21:42:15.303215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:15:09.620712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303343+0000","last_change":"2023-07-06T21:42:14.910108+0000","last_active":"2023-07-06T21:42:15.303343+0000","last_peered":"2023-07-06T21:42:15.303343+0000","last_clean":"2023-07-06T21:42:15.303343+0000","last_became_active":"2023-07-06T21:42:14.909696+0000","last_became_peered":"2023-07-06T21:42:14.909696+0000","last_unstale":"2023-07-06T21:42:15.303343+0000","last_undegraded":"2023-07-06T21:42:15.303343+0000","last_fullsized":"2023-07-06T21:42:15.303343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:24.738875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749578+0000","last_change":"2023-07-06T21:42:10.474754+0000","last_active":"2023-07-06T21:42:15.749578+0000","last_peered":"2023-07-06T21:42:15.749578+0000","last_clean":"2023-07-06T21:42:15.749578+0000","last_became_active":"2023-07-06T21:42:10.474461+0000","last_became_peered":"2023-07-06T21:42:10.474461+0000","last_unstale":"2023-07-06T21:42:15.749578+0000","last_undegraded":"2023-07-06T21:42:15.749578+0000","last_fullsized":"2023-07-06T21:42:15.749578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:02.030132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303640+0000","last_change":"2023-07-06T21:42:10.882870+0000","last_active":"2023-07-06T21:42:15.303640+0000","last_peered":"2023-07-06T21:42:15.303640+0000","last_clean":"2023-07-06T21:42:15.303640+0000","last_became_active":"2023-07-06T21:42:10.882523+0000","last_became_peered":"2023-07-06T21:42:10.882523+0000","last_unstale":"2023-07-06T21:42:15.303640+0000","last_undegraded":"2023-07-06T21:42:15.303640+0000","last_fullsized":"2023-07-06T21:42:15.303640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:29:36.364419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560105+0000","last_change":"2023-07-06T21:42:14.904246+0000","last_active":"2023-07-06T21:42:15.560105+0000","last_peered":"2023-07-06T21:42:15.560105+0000","last_clean":"2023-07-06T21:42:15.560105+0000","last_became_active":"2023-07-06T21:42:14.903763+0000","last_became_peered":"2023-07-06T21:42:14.903763+0000","last_unstale":"2023-07-06T21:42:15.560105+0000","last_undegraded":"2023-07-06T21:42:15.560105+0000","last_fullsized":"2023-07-06T21:42:15.560105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555200+0000","last_change":"2023-07-06T21:42:10.483593+0000","last_active":"2023-07-06T21:42:15.555200+0000","last_peered":"2023-07-06T21:42:15.555200+0000","last_clean":"2023-07-06T21:42:15.555200+0000","last_became_active":"2023-07-06T21:42:10.483284+0000","last_became_peered":"2023-07-06T21:42:10.483284+0000","last_unstale":"2023-07-06T21:42:15.555200+0000","last_undegraded":"2023-07-06T21:42:15.555200+0000","last_fullsized":"2023-07-06T21:42:15.555200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:37.773277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300337+0000","last_change":"2023-07-06T21:42:10.901884+0000","last_active":"2023-07-06T21:42:15.300337+0000","last_peered":"2023-07-06T21:42:15.300337+0000","last_clean":"2023-07-06T21:42:15.300337+0000","last_became_active":"2023-07-06T21:42:10.901580+0000","last_became_peered":"2023-07-06T21:42:10.901580+0000","last_unstale":"2023-07-06T21:42:15.300337+0000","last_undegraded":"2023-07-06T21:42:15.300337+0000","last_fullsized":"2023-07-06T21:42:15.300337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:22:55.494418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303514+0000","last_change":"2023-07-06T21:42:14.912585+0000","last_active":"2023-07-06T21:42:15.303514+0000","last_peered":"2023-07-06T21:42:15.303514+0000","last_clean":"2023-07-06T21:42:15.303514+0000","last_became_active":"2023-07-06T21:42:14.912161+0000","last_became_peered":"2023-07-06T21:42:14.912161+0000","last_unstale":"2023-07-06T21:42:15.303514+0000","last_undegraded":"2023-07-06T21:42:15.303514+0000","last_fullsized":"2023-07-06T21:42:15.303514+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:00:05.811592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303358+0000","last_change":"2023-07-06T21:42:10.475123+0000","last_active":"2023-07-06T21:42:15.303358+0000","last_peered":"2023-07-06T21:42:15.303358+0000","last_clean":"2023-07-06T21:42:15.303358+0000","last_became_active":"2023-07-06T21:42:10.474779+0000","last_became_peered":"2023-07-06T21:42:10.474779+0000","last_unstale":"2023-07-06T21:42:15.303358+0000","last_undegraded":"2023-07-06T21:42:15.303358+0000","last_fullsized":"2023-07-06T21:42:15.303358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:57:21.124055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814299+0000","last_change":"2023-07-06T21:42:10.896524+0000","last_active":"2023-07-06T21:42:15.814299+0000","last_peered":"2023-07-06T21:42:15.814299+0000","last_clean":"2023-07-06T21:42:15.814299+0000","last_became_active":"2023-07-06T21:42:10.896258+0000","last_became_peered":"2023-07-06T21:42:10.896258+0000","last_unstale":"2023-07-06T21:42:15.814299+0000","last_undegraded":"2023-07-06T21:42:15.814299+0000","last_fullsized":"2023-07-06T21:42:15.814299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:01.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816070+0000","last_change":"2023-07-06T21:42:14.906299+0000","last_active":"2023-07-06T21:42:15.816070+0000","last_peered":"2023-07-06T21:42:15.816070+0000","last_clean":"2023-07-06T21:42:15.816070+0000","last_became_active":"2023-07-06T21:42:14.905903+0000","last_became_peered":"2023-07-06T21:42:14.905903+0000","last_unstale":"2023-07-06T21:42:15.816070+0000","last_undegraded":"2023-07-06T21:42:15.816070+0000","last_fullsized":"2023-07-06T21:42:15.816070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:15.781649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559557+0000","last_change":"2023-07-06T21:42:10.473362+0000","last_active":"2023-07-06T21:42:15.559557+0000","last_peered":"2023-07-06T21:42:15.559557+0000","last_clean":"2023-07-06T21:42:15.559557+0000","last_became_active":"2023-07-06T21:42:10.473023+0000","last_became_peered":"2023-07-06T21:42:10.473023+0000","last_unstale":"2023-07-06T21:42:15.559557+0000","last_undegraded":"2023-07-06T21:42:15.559557+0000","last_fullsized":"2023-07-06T21:42:15.559557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:44:16.691368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555110+0000","last_change":"2023-07-06T21:42:10.894953+0000","last_active":"2023-07-06T21:42:15.555110+0000","last_peered":"2023-07-06T21:42:15.555110+0000","last_clean":"2023-07-06T21:42:15.555110+0000","last_became_active":"2023-07-06T21:42:10.894746+0000","last_became_peered":"2023-07-06T21:42:10.894746+0000","last_unstale":"2023-07-06T21:42:15.555110+0000","last_undegraded":"2023-07-06T21:42:15.555110+0000","last_fullsized":"2023-07-06T21:42:15.555110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:03.040492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555021+0000","last_change":"2023-07-06T21:42:14.909036+0000","last_active":"2023-07-06T21:42:15.555021+0000","last_peered":"2023-07-06T21:42:15.555021+0000","last_clean":"2023-07-06T21:42:15.555021+0000","last_became_active":"2023-07-06T21:42:14.908620+0000","last_became_peered":"2023-07-06T21:42:14.908620+0000","last_unstale":"2023-07-06T21:42:15.555021+0000","last_undegraded":"2023-07-06T21:42:15.555021+0000","last_fullsized":"2023-07-06T21:42:15.555021+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813952+0000","last_change":"2023-07-06T21:42:10.478777+0000","last_active":"2023-07-06T21:42:15.813952+0000","last_peered":"2023-07-06T21:42:15.813952+0000","last_clean":"2023-07-06T21:42:15.813952+0000","last_became_active":"2023-07-06T21:42:10.478487+0000","last_became_peered":"2023-07-06T21:42:10.478487+0000","last_unstale":"2023-07-06T21:42:15.813952+0000","last_undegraded":"2023-07-06T21:42:15.813952+0000","last_fullsized":"2023-07-06T21:42:15.813952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:02.030132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816172+0000","last_change":"2023-07-06T21:42:10.891356+0000","last_active":"2023-07-06T21:42:15.816172+0000","last_peered":"2023-07-06T21:42:15.816172+0000","last_clean":"2023-07-06T21:42:15.816172+0000","last_became_active":"2023-07-06T21:42:10.890691+0000","last_became_peered":"2023-07-06T21:42:10.890691+0000","last_unstale":"2023-07-06T21:42:15.816172+0000","last_undegraded":"2023-07-06T21:42:15.816172+0000","last_fullsized":"2023-07-06T21:42:15.816172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:49:21.474970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813824+0000","last_change":"2023-07-06T21:42:10.903834+0000","last_active":"2023-07-06T21:42:15.813824+0000","last_peered":"2023-07-06T21:42:15.813824+0000","last_clean":"2023-07-06T21:42:15.813824+0000","last_became_active":"2023-07-06T21:42:10.903529+0000","last_became_peered":"2023-07-06T21:42:10.903529+0000","last_unstale":"2023-07-06T21:42:15.813824+0000","last_undegraded":"2023-07-06T21:42:15.813824+0000","last_fullsized":"2023-07-06T21:42:15.813824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:49.957566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555297+0000","last_change":"2023-07-06T21:42:10.476662+0000","last_active":"2023-07-06T21:42:15.555297+0000","last_peered":"2023-07-06T21:42:15.555297+0000","last_clean":"2023-07-06T21:42:15.555297+0000","last_became_active":"2023-07-06T21:42:10.476371+0000","last_became_peered":"2023-07-06T21:42:10.476371+0000","last_unstale":"2023-07-06T21:42:15.555297+0000","last_undegraded":"2023-07-06T21:42:15.555297+0000","last_fullsized":"2023-07-06T21:42:15.555297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:34.600926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815594+0000","last_change":"2023-07-06T21:42:14.905161+0000","last_active":"2023-07-06T21:42:15.815594+0000","last_peered":"2023-07-06T21:42:15.815594+0000","last_clean":"2023-07-06T21:42:15.815594+0000","last_became_active":"2023-07-06T21:42:14.904772+0000","last_became_peered":"2023-07-06T21:42:14.904772+0000","last_unstale":"2023-07-06T21:42:15.815594+0000","last_undegraded":"2023-07-06T21:42:15.815594+0000","last_fullsized":"2023-07-06T21:42:15.815594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:16:29.182580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813950+0000","last_change":"2023-07-06T21:42:10.886798+0000","last_active":"2023-07-06T21:42:15.813950+0000","last_peered":"2023-07-06T21:42:15.813950+0000","last_clean":"2023-07-06T21:42:15.813950+0000","last_became_active":"2023-07-06T21:42:10.886419+0000","last_became_peered":"2023-07-06T21:42:10.886419+0000","last_unstale":"2023-07-06T21:42:15.813950+0000","last_undegraded":"2023-07-06T21:42:15.813950+0000","last_fullsized":"2023-07-06T21:42:15.813950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:49.304577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750157+0000","last_change":"2023-07-06T21:42:10.470631+0000","last_active":"2023-07-06T21:42:15.750157+0000","last_peered":"2023-07-06T21:42:15.750157+0000","last_clean":"2023-07-06T21:42:15.750157+0000","last_became_active":"2023-07-06T21:42:10.470331+0000","last_became_peered":"2023-07-06T21:42:10.470331+0000","last_unstale":"2023-07-06T21:42:15.750157+0000","last_undegraded":"2023-07-06T21:42:15.750157+0000","last_fullsized":"2023-07-06T21:42:15.750157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:06.172940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302528+0000","last_change":"2023-07-06T21:42:14.905006+0000","last_active":"2023-07-06T21:42:15.302528+0000","last_peered":"2023-07-06T21:42:15.302528+0000","last_clean":"2023-07-06T21:42:15.302528+0000","last_became_active":"2023-07-06T21:42:14.904580+0000","last_became_peered":"2023-07-06T21:42:14.904580+0000","last_unstale":"2023-07-06T21:42:15.302528+0000","last_undegraded":"2023-07-06T21:42:15.302528+0000","last_fullsized":"2023-07-06T21:42:15.302528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304381+0000","last_change":"2023-07-06T21:42:10.472955+0000","last_active":"2023-07-06T21:42:15.304381+0000","last_peered":"2023-07-06T21:42:15.304381+0000","last_clean":"2023-07-06T21:42:15.304381+0000","last_became_active":"2023-07-06T21:42:10.472650+0000","last_became_peered":"2023-07-06T21:42:10.472650+0000","last_unstale":"2023-07-06T21:42:15.304381+0000","last_undegraded":"2023-07-06T21:42:15.304381+0000","last_fullsized":"2023-07-06T21:42:15.304381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:00.320476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559636+0000","last_change":"2023-07-06T21:42:10.895148+0000","last_active":"2023-07-06T21:42:15.559636+0000","last_peered":"2023-07-06T21:42:15.559636+0000","last_clean":"2023-07-06T21:42:15.559636+0000","last_became_active":"2023-07-06T21:42:10.893279+0000","last_became_peered":"2023-07-06T21:42:10.893279+0000","last_unstale":"2023-07-06T21:42:15.559636+0000","last_undegraded":"2023-07-06T21:42:15.559636+0000","last_fullsized":"2023-07-06T21:42:15.559636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:17.881222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814136+0000","last_change":"2023-07-06T21:42:14.923933+0000","last_active":"2023-07-06T21:42:15.814136+0000","last_peered":"2023-07-06T21:42:15.814136+0000","last_clean":"2023-07-06T21:42:15.814136+0000","last_became_active":"2023-07-06T21:42:14.923462+0000","last_became_peered":"2023-07-06T21:42:14.923462+0000","last_unstale":"2023-07-06T21:42:15.814136+0000","last_undegraded":"2023-07-06T21:42:15.814136+0000","last_fullsized":"2023-07-06T21:42:15.814136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:17.532639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:26.997905+0000","last_change":"2023-07-06T21:42:10.477982+0000","last_active":"2023-07-06T21:42:26.997905+0000","last_peered":"2023-07-06T21:42:26.997905+0000","last_clean":"2023-07-06T21:42:26.997905+0000","last_became_active":"2023-07-06T21:42:10.477682+0000","last_became_peered":"2023-07-06T21:42:10.477682+0000","last_unstale":"2023-07-06T21:42:26.997905+0000","last_undegraded":"2023-07-06T21:42:26.997905+0000","last_fullsized":"2023-07-06T21:42:26.997905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:36:40.587024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303762+0000","last_change":"2023-07-06T21:42:10.889884+0000","last_active":"2023-07-06T21:42:15.303762+0000","last_peered":"2023-07-06T21:42:15.303762+0000","last_clean":"2023-07-06T21:42:15.303762+0000","last_became_active":"2023-07-06T21:42:10.889573+0000","last_became_peered":"2023-07-06T21:42:10.889573+0000","last_unstale":"2023-07-06T21:42:15.303762+0000","last_undegraded":"2023-07-06T21:42:15.303762+0000","last_fullsized":"2023-07-06T21:42:15.303762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:19:13.251122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559445+0000","last_change":"2023-07-06T21:42:14.923296+0000","last_active":"2023-07-06T21:42:15.559445+0000","last_peered":"2023-07-06T21:42:15.559445+0000","last_clean":"2023-07-06T21:42:15.559445+0000","last_became_active":"2023-07-06T21:42:14.922887+0000","last_became_peered":"2023-07-06T21:42:14.922887+0000","last_unstale":"2023-07-06T21:42:15.559445+0000","last_undegraded":"2023-07-06T21:42:15.559445+0000","last_fullsized":"2023-07-06T21:42:15.559445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:04:10.970825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302823+0000","last_change":"2023-07-06T21:42:10.885592+0000","last_active":"2023-07-06T21:42:15.302823+0000","last_peered":"2023-07-06T21:42:15.302823+0000","last_clean":"2023-07-06T21:42:15.302823+0000","last_became_active":"2023-07-06T21:42:10.885320+0000","last_became_peered":"2023-07-06T21:42:10.885320+0000","last_unstale":"2023-07-06T21:42:15.302823+0000","last_undegraded":"2023-07-06T21:42:15.302823+0000","last_fullsized":"2023-07-06T21:42:15.302823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:37:33.460049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816166+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:42:15.816166+0000","last_peered":"2023-07-06T21:42:15.816166+0000","last_clean":"2023-07-06T21:42:15.816166+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:42:15.816166+0000","last_undegraded":"2023-07-06T21:42:15.816166+0000","last_fullsized":"2023-07-06T21:42:15.816166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:13:17.470539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555317+0000","last_change":"2023-07-06T21:42:10.483753+0000","last_active":"2023-07-06T21:42:15.555317+0000","last_peered":"2023-07-06T21:42:15.555317+0000","last_clean":"2023-07-06T21:42:15.555317+0000","last_became_active":"2023-07-06T21:42:10.483357+0000","last_became_peered":"2023-07-06T21:42:10.483357+0000","last_unstale":"2023-07-06T21:42:15.555317+0000","last_undegraded":"2023-07-06T21:42:15.555317+0000","last_fullsized":"2023-07-06T21:42:15.555317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:13.091304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813831+0000","last_change":"2023-07-06T21:42:14.904514+0000","last_active":"2023-07-06T21:42:15.813831+0000","last_peered":"2023-07-06T21:42:15.813831+0000","last_clean":"2023-07-06T21:42:15.813831+0000","last_became_active":"2023-07-06T21:42:14.904110+0000","last_became_peered":"2023-07-06T21:42:14.904110+0000","last_unstale":"2023-07-06T21:42:15.813831+0000","last_undegraded":"2023-07-06T21:42:15.813831+0000","last_fullsized":"2023-07-06T21:42:15.813831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813926+0000","last_change":"2023-07-06T21:42:10.886690+0000","last_active":"2023-07-06T21:42:15.813926+0000","last_peered":"2023-07-06T21:42:15.813926+0000","last_clean":"2023-07-06T21:42:15.813926+0000","last_became_active":"2023-07-06T21:42:10.886408+0000","last_became_peered":"2023-07-06T21:42:10.886408+0000","last_unstale":"2023-07-06T21:42:15.813926+0000","last_undegraded":"2023-07-06T21:42:15.813926+0000","last_fullsized":"2023-07-06T21:42:15.813926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:21.307899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560489+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:42:15.560489+0000","last_peered":"2023-07-06T21:42:15.560489+0000","last_clean":"2023-07-06T21:42:15.560489+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:42:15.560489+0000","last_undegraded":"2023-07-06T21:42:15.560489+0000","last_fullsized":"2023-07-06T21:42:15.560489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:32.217200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814738+0000","last_change":"2023-07-06T21:42:10.477099+0000","last_active":"2023-07-06T21:42:15.814738+0000","last_peered":"2023-07-06T21:42:15.814738+0000","last_clean":"2023-07-06T21:42:15.814738+0000","last_became_active":"2023-07-06T21:42:10.470849+0000","last_became_peered":"2023-07-06T21:42:10.470849+0000","last_unstale":"2023-07-06T21:42:15.814738+0000","last_undegraded":"2023-07-06T21:42:15.814738+0000","last_fullsized":"2023-07-06T21:42:15.814738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:01:27.903386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302507+0000","last_change":"2023-07-06T21:42:14.912597+0000","last_active":"2023-07-06T21:42:15.302507+0000","last_peered":"2023-07-06T21:42:15.302507+0000","last_clean":"2023-07-06T21:42:15.302507+0000","last_became_active":"2023-07-06T21:42:14.912117+0000","last_became_peered":"2023-07-06T21:42:14.912117+0000","last_unstale":"2023-07-06T21:42:15.302507+0000","last_undegraded":"2023-07-06T21:42:15.302507+0000","last_fullsized":"2023-07-06T21:42:15.302507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:04:25.768388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554791+0000","last_change":"2023-07-06T21:42:10.887381+0000","last_active":"2023-07-06T21:42:15.554791+0000","last_peered":"2023-07-06T21:42:15.554791+0000","last_clean":"2023-07-06T21:42:15.554791+0000","last_became_active":"2023-07-06T21:42:10.887098+0000","last_became_peered":"2023-07-06T21:42:10.887098+0000","last_unstale":"2023-07-06T21:42:15.554791+0000","last_undegraded":"2023-07-06T21:42:15.554791+0000","last_fullsized":"2023-07-06T21:42:15.554791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:22:58.629015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304566+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:42:15.304566+0000","last_peered":"2023-07-06T21:42:15.304566+0000","last_clean":"2023-07-06T21:42:15.304566+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:42:15.304566+0000","last_undegraded":"2023-07-06T21:42:15.304566+0000","last_fullsized":"2023-07-06T21:42:15.304566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:18:08.789205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560028+0000","last_change":"2023-07-06T21:42:10.470119+0000","last_active":"2023-07-06T21:42:15.560028+0000","last_peered":"2023-07-06T21:42:15.560028+0000","last_clean":"2023-07-06T21:42:15.560028+0000","last_became_active":"2023-07-06T21:42:10.469842+0000","last_became_peered":"2023-07-06T21:42:10.469842+0000","last_unstale":"2023-07-06T21:42:15.560028+0000","last_undegraded":"2023-07-06T21:42:15.560028+0000","last_fullsized":"2023-07-06T21:42:15.560028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:22:57.618655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815713+0000","last_change":"2023-07-06T21:42:14.922150+0000","last_active":"2023-07-06T21:42:15.815713+0000","last_peered":"2023-07-06T21:42:15.815713+0000","last_clean":"2023-07-06T21:42:15.815713+0000","last_became_active":"2023-07-06T21:42:14.921680+0000","last_became_peered":"2023-07-06T21:42:14.921680+0000","last_unstale":"2023-07-06T21:42:15.815713+0000","last_undegraded":"2023-07-06T21:42:15.815713+0000","last_fullsized":"2023-07-06T21:42:15.815713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:25:46.342686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559647+0000","last_change":"2023-07-06T21:42:10.895224+0000","last_active":"2023-07-06T21:42:15.559647+0000","last_peered":"2023-07-06T21:42:15.559647+0000","last_clean":"2023-07-06T21:42:15.559647+0000","last_became_active":"2023-07-06T21:42:10.893294+0000","last_became_peered":"2023-07-06T21:42:10.893294+0000","last_unstale":"2023-07-06T21:42:15.559647+0000","last_undegraded":"2023-07-06T21:42:15.559647+0000","last_fullsized":"2023-07-06T21:42:15.559647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:06:12.963913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560146+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:42:15.560146+0000","last_peered":"2023-07-06T21:42:15.560146+0000","last_clean":"2023-07-06T21:42:15.560146+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:42:15.560146+0000","last_undegraded":"2023-07-06T21:42:15.560146+0000","last_fullsized":"2023-07-06T21:42:15.560146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:26:57.147498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750089+0000","last_change":"2023-07-06T21:42:10.479311+0000","last_active":"2023-07-06T21:42:15.750089+0000","last_peered":"2023-07-06T21:42:15.750089+0000","last_clean":"2023-07-06T21:42:15.750089+0000","last_became_active":"2023-07-06T21:42:10.478999+0000","last_became_peered":"2023-07-06T21:42:10.478999+0000","last_unstale":"2023-07-06T21:42:15.750089+0000","last_undegraded":"2023-07-06T21:42:15.750089+0000","last_fullsized":"2023-07-06T21:42:15.750089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:15:16.029351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554783+0000","last_change":"2023-07-06T21:42:14.924362+0000","last_active":"2023-07-06T21:42:15.554783+0000","last_peered":"2023-07-06T21:42:15.554783+0000","last_clean":"2023-07-06T21:42:15.554783+0000","last_became_active":"2023-07-06T21:42:14.924003+0000","last_became_peered":"2023-07-06T21:42:14.924003+0000","last_unstale":"2023-07-06T21:42:15.554783+0000","last_undegraded":"2023-07-06T21:42:15.554783+0000","last_fullsized":"2023-07-06T21:42:15.554783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:30:36.626428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559964+0000","last_change":"2023-07-06T21:42:10.901083+0000","last_active":"2023-07-06T21:42:15.559964+0000","last_peered":"2023-07-06T21:42:15.559964+0000","last_clean":"2023-07-06T21:42:15.559964+0000","last_became_active":"2023-07-06T21:42:10.900454+0000","last_became_peered":"2023-07-06T21:42:10.900454+0000","last_unstale":"2023-07-06T21:42:15.559964+0000","last_undegraded":"2023-07-06T21:42:15.559964+0000","last_fullsized":"2023-07-06T21:42:15.559964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:30:33.195452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303877+0000","last_change":"2023-07-06T21:42:10.487423+0000","last_active":"2023-07-06T21:42:15.303877+0000","last_peered":"2023-07-06T21:42:15.303877+0000","last_clean":"2023-07-06T21:42:15.303877+0000","last_became_active":"2023-07-06T21:42:10.487178+0000","last_became_peered":"2023-07-06T21:42:10.487178+0000","last_unstale":"2023-07-06T21:42:15.303877+0000","last_undegraded":"2023-07-06T21:42:15.303877+0000","last_fullsized":"2023-07-06T21:42:15.303877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:27:27.820824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749519+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:42:15.749519+0000","last_peered":"2023-07-06T21:42:15.749519+0000","last_clean":"2023-07-06T21:42:15.749519+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:42:15.749519+0000","last_undegraded":"2023-07-06T21:42:15.749519+0000","last_fullsized":"2023-07-06T21:42:15.749519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:32.217200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555060+0000","last_change":"2023-07-06T21:42:14.916163+0000","last_active":"2023-07-06T21:42:15.555060+0000","last_peered":"2023-07-06T21:42:15.555060+0000","last_clean":"2023-07-06T21:42:15.555060+0000","last_became_active":"2023-07-06T21:42:14.915664+0000","last_became_peered":"2023-07-06T21:42:14.915664+0000","last_unstale":"2023-07-06T21:42:15.555060+0000","last_undegraded":"2023-07-06T21:42:15.555060+0000","last_fullsized":"2023-07-06T21:42:15.555060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:53.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.561394+0000","last_change":"2023-07-06T21:42:10.892520+0000","last_active":"2023-07-06T21:42:15.561394+0000","last_peered":"2023-07-06T21:42:15.561394+0000","last_clean":"2023-07-06T21:42:15.561394+0000","last_became_active":"2023-07-06T21:42:10.892199+0000","last_became_peered":"2023-07-06T21:42:10.892199+0000","last_unstale":"2023-07-06T21:42:15.561394+0000","last_undegraded":"2023-07-06T21:42:15.561394+0000","last_fullsized":"2023-07-06T21:42:15.561394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:03.040492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559437+0000","last_change":"2023-07-06T21:42:10.469013+0000","last_active":"2023-07-06T21:42:15.559437+0000","last_peered":"2023-07-06T21:42:15.559437+0000","last_clean":"2023-07-06T21:42:15.559437+0000","last_became_active":"2023-07-06T21:42:10.468725+0000","last_became_peered":"2023-07-06T21:42:10.468725+0000","last_unstale":"2023-07-06T21:42:15.559437+0000","last_undegraded":"2023-07-06T21:42:15.559437+0000","last_fullsized":"2023-07-06T21:42:15.559437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:20:16.016382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300174+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:42:15.300174+0000","last_peered":"2023-07-06T21:42:15.300174+0000","last_clean":"2023-07-06T21:42:15.300174+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:42:15.300174+0000","last_undegraded":"2023-07-06T21:42:15.300174+0000","last_fullsized":"2023-07-06T21:42:15.300174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:47:26.819677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300599+0000","last_change":"2023-07-06T21:42:14.924328+0000","last_active":"2023-07-06T21:42:15.300599+0000","last_peered":"2023-07-06T21:42:15.300599+0000","last_clean":"2023-07-06T21:42:15.300599+0000","last_became_active":"2023-07-06T21:42:14.923899+0000","last_became_peered":"2023-07-06T21:42:14.923899+0000","last_unstale":"2023-07-06T21:42:15.300599+0000","last_undegraded":"2023-07-06T21:42:15.300599+0000","last_fullsized":"2023-07-06T21:42:15.300599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:54:26.653941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555110+0000","last_change":"2023-07-06T21:42:10.903093+0000","last_active":"2023-07-06T21:42:15.555110+0000","last_peered":"2023-07-06T21:42:15.555110+0000","last_clean":"2023-07-06T21:42:15.555110+0000","last_became_active":"2023-07-06T21:42:10.902859+0000","last_became_peered":"2023-07-06T21:42:10.902859+0000","last_unstale":"2023-07-06T21:42:15.555110+0000","last_undegraded":"2023-07-06T21:42:15.555110+0000","last_fullsized":"2023-07-06T21:42:15.555110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:21.307899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554542+0000","last_change":"2023-07-06T21:42:10.483697+0000","last_active":"2023-07-06T21:42:15.554542+0000","last_peered":"2023-07-06T21:42:15.554542+0000","last_clean":"2023-07-06T21:42:15.554542+0000","last_became_active":"2023-07-06T21:42:10.483326+0000","last_became_peered":"2023-07-06T21:42:10.483326+0000","last_unstale":"2023-07-06T21:42:15.554542+0000","last_undegraded":"2023-07-06T21:42:15.554542+0000","last_fullsized":"2023-07-06T21:42:15.554542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:06:11.953553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302786+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:42:15.302786+0000","last_peered":"2023-07-06T21:42:15.302786+0000","last_clean":"2023-07-06T21:42:15.302786+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:42:15.302786+0000","last_undegraded":"2023-07-06T21:42:15.302786+0000","last_fullsized":"2023-07-06T21:42:15.302786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:43.907805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749963+0000","last_change":"2023-07-06T21:42:14.922451+0000","last_active":"2023-07-06T21:42:15.749963+0000","last_peered":"2023-07-06T21:42:15.749963+0000","last_clean":"2023-07-06T21:42:15.749963+0000","last_became_active":"2023-07-06T21:42:14.922047+0000","last_became_peered":"2023-07-06T21:42:14.922047+0000","last_unstale":"2023-07-06T21:42:15.749963+0000","last_undegraded":"2023-07-06T21:42:15.749963+0000","last_fullsized":"2023-07-06T21:42:15.749963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:04.761811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816094+0000","last_change":"2023-07-06T21:42:10.892446+0000","last_active":"2023-07-06T21:42:15.816094+0000","last_peered":"2023-07-06T21:42:15.816094+0000","last_clean":"2023-07-06T21:42:15.816094+0000","last_became_active":"2023-07-06T21:42:10.892161+0000","last_became_peered":"2023-07-06T21:42:10.892161+0000","last_unstale":"2023-07-06T21:42:15.816094+0000","last_undegraded":"2023-07-06T21:42:15.816094+0000","last_fullsized":"2023-07-06T21:42:15.816094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:16:28.548015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814063+0000","last_change":"2023-07-06T21:42:10.477978+0000","last_active":"2023-07-06T21:42:15.814063+0000","last_peered":"2023-07-06T21:42:15.814063+0000","last_clean":"2023-07-06T21:42:15.814063+0000","last_became_active":"2023-07-06T21:42:10.477741+0000","last_became_peered":"2023-07-06T21:42:10.477741+0000","last_unstale":"2023-07-06T21:42:15.814063+0000","last_undegraded":"2023-07-06T21:42:15.814063+0000","last_fullsized":"2023-07-06T21:42:15.814063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:53.942428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749582+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:42:15.749582+0000","last_peered":"2023-07-06T21:42:15.749582+0000","last_clean":"2023-07-06T21:42:15.749582+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:42:15.749582+0000","last_undegraded":"2023-07-06T21:42:15.749582+0000","last_fullsized":"2023-07-06T21:42:15.749582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:15.258138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302930+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:42:15.302930+0000","last_peered":"2023-07-06T21:42:15.302930+0000","last_clean":"2023-07-06T21:42:15.302930+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:42:15.302930+0000","last_undegraded":"2023-07-06T21:42:15.302930+0000","last_fullsized":"2023-07-06T21:42:15.302930+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:25.978867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304188+0000","last_change":"2023-07-06T21:42:14.922337+0000","last_active":"2023-07-06T21:42:15.304188+0000","last_peered":"2023-07-06T21:42:15.304188+0000","last_clean":"2023-07-06T21:42:15.304188+0000","last_became_active":"2023-07-06T21:42:14.921707+0000","last_became_peered":"2023-07-06T21:42:14.921707+0000","last_unstale":"2023-07-06T21:42:15.304188+0000","last_undegraded":"2023-07-06T21:42:15.304188+0000","last_fullsized":"2023-07-06T21:42:15.304188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:10.982651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.561390+0000","last_change":"2023-07-06T21:42:10.895068+0000","last_active":"2023-07-06T21:42:15.561390+0000","last_peered":"2023-07-06T21:42:15.561390+0000","last_clean":"2023-07-06T21:42:15.561390+0000","last_became_active":"2023-07-06T21:42:10.893118+0000","last_became_peered":"2023-07-06T21:42:10.893118+0000","last_unstale":"2023-07-06T21:42:15.561390+0000","last_undegraded":"2023-07-06T21:42:15.561390+0000","last_fullsized":"2023-07-06T21:42:15.561390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:49.304577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814064+0000","last_change":"2023-07-06T21:42:10.477723+0000","last_active":"2023-07-06T21:42:15.814064+0000","last_peered":"2023-07-06T21:42:15.814064+0000","last_clean":"2023-07-06T21:42:15.814064+0000","last_became_active":"2023-07-06T21:42:10.477458+0000","last_became_peered":"2023-07-06T21:42:10.477458+0000","last_unstale":"2023-07-06T21:42:15.814064+0000","last_undegraded":"2023-07-06T21:42:15.814064+0000","last_fullsized":"2023-07-06T21:42:15.814064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:37.773277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304476+0000","last_change":"2023-07-06T21:42:14.916934+0000","last_active":"2023-07-06T21:42:15.304476+0000","last_peered":"2023-07-06T21:42:15.304476+0000","last_clean":"2023-07-06T21:42:15.304476+0000","last_became_active":"2023-07-06T21:42:14.916426+0000","last_became_peered":"2023-07-06T21:42:14.916426+0000","last_unstale":"2023-07-06T21:42:15.304476+0000","last_undegraded":"2023-07-06T21:42:15.304476+0000","last_fullsized":"2023-07-06T21:42:15.304476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:59:26.819910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304570+0000","last_change":"2023-07-06T21:42:10.883910+0000","last_active":"2023-07-06T21:42:15.304570+0000","last_peered":"2023-07-06T21:42:15.304570+0000","last_clean":"2023-07-06T21:42:15.304570+0000","last_became_active":"2023-07-06T21:42:10.881813+0000","last_became_peered":"2023-07-06T21:42:10.881813+0000","last_unstale":"2023-07-06T21:42:15.304570+0000","last_undegraded":"2023-07-06T21:42:15.304570+0000","last_fullsized":"2023-07-06T21:42:15.304570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:35:26.163278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302957+0000","last_change":"2023-07-06T21:42:10.476748+0000","last_active":"2023-07-06T21:42:15.302957+0000","last_peered":"2023-07-06T21:42:15.302957+0000","last_clean":"2023-07-06T21:42:15.302957+0000","last_became_active":"2023-07-06T21:42:10.476481+0000","last_became_peered":"2023-07-06T21:42:10.476481+0000","last_unstale":"2023-07-06T21:42:15.302957+0000","last_undegraded":"2023-07-06T21:42:15.302957+0000","last_fullsized":"2023-07-06T21:42:15.302957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:44:25.975479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749892+0000","last_change":"2023-07-06T21:42:14.921688+0000","last_active":"2023-07-06T21:42:15.749892+0000","last_peered":"2023-07-06T21:42:15.749892+0000","last_clean":"2023-07-06T21:42:15.749892+0000","last_became_active":"2023-07-06T21:42:14.921265+0000","last_became_peered":"2023-07-06T21:42:14.921265+0000","last_unstale":"2023-07-06T21:42:15.749892+0000","last_undegraded":"2023-07-06T21:42:15.749892+0000","last_fullsized":"2023-07-06T21:42:15.749892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:39.042261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304373+0000","last_change":"2023-07-06T21:42:10.878847+0000","last_active":"2023-07-06T21:42:15.304373+0000","last_peered":"2023-07-06T21:42:15.304373+0000","last_clean":"2023-07-06T21:42:15.304373+0000","last_became_active":"2023-07-06T21:42:10.878527+0000","last_became_peered":"2023-07-06T21:42:10.878527+0000","last_unstale":"2023-07-06T21:42:15.304373+0000","last_undegraded":"2023-07-06T21:42:15.304373+0000","last_fullsized":"2023-07-06T21:42:15.304373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:16:10.597271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815959+0000","last_change":"2023-07-06T21:42:10.477879+0000","last_active":"2023-07-06T21:42:15.815959+0000","last_peered":"2023-07-06T21:42:15.815959+0000","last_clean":"2023-07-06T21:42:15.815959+0000","last_became_active":"2023-07-06T21:42:10.477581+0000","last_became_peered":"2023-07-06T21:42:10.477581+0000","last_unstale":"2023-07-06T21:42:15.815959+0000","last_undegraded":"2023-07-06T21:42:15.815959+0000","last_fullsized":"2023-07-06T21:42:15.815959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:44:19.088837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559764+0000","last_change":"2023-07-06T21:42:14.911992+0000","last_active":"2023-07-06T21:42:15.559764+0000","last_peered":"2023-07-06T21:42:15.559764+0000","last_clean":"2023-07-06T21:42:15.559764+0000","last_became_active":"2023-07-06T21:42:14.911568+0000","last_became_peered":"2023-07-06T21:42:14.911568+0000","last_unstale":"2023-07-06T21:42:15.559764+0000","last_undegraded":"2023-07-06T21:42:15.559764+0000","last_fullsized":"2023-07-06T21:42:15.559764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:20:11.252422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303859+0000","last_change":"2023-07-06T21:42:10.883052+0000","last_active":"2023-07-06T21:42:15.303859+0000","last_peered":"2023-07-06T21:42:15.303859+0000","last_clean":"2023-07-06T21:42:15.303859+0000","last_became_active":"2023-07-06T21:42:10.882252+0000","last_became_peered":"2023-07-06T21:42:10.882252+0000","last_unstale":"2023-07-06T21:42:15.303859+0000","last_undegraded":"2023-07-06T21:42:15.303859+0000","last_fullsized":"2023-07-06T21:42:15.303859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:24:28.967556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814372+0000","last_change":"2023-07-06T21:42:10.483767+0000","last_active":"2023-07-06T21:42:15.814372+0000","last_peered":"2023-07-06T21:42:15.814372+0000","last_clean":"2023-07-06T21:42:15.814372+0000","last_became_active":"2023-07-06T21:42:10.483507+0000","last_became_peered":"2023-07-06T21:42:10.483507+0000","last_unstale":"2023-07-06T21:42:15.814372+0000","last_undegraded":"2023-07-06T21:42:15.814372+0000","last_fullsized":"2023-07-06T21:42:15.814372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:18:13.828606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300565+0000","last_change":"2023-07-06T21:42:14.923194+0000","last_active":"2023-07-06T21:42:15.300565+0000","last_peered":"2023-07-06T21:42:15.300565+0000","last_clean":"2023-07-06T21:42:15.300565+0000","last_became_active":"2023-07-06T21:42:14.922520+0000","last_became_peered":"2023-07-06T21:42:14.922520+0000","last_unstale":"2023-07-06T21:42:15.300565+0000","last_undegraded":"2023-07-06T21:42:15.300565+0000","last_fullsized":"2023-07-06T21:42:15.300565+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:03:38.532050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554692+0000","last_change":"2023-07-06T21:42:10.896528+0000","last_active":"2023-07-06T21:42:15.554692+0000","last_peered":"2023-07-06T21:42:15.554692+0000","last_clean":"2023-07-06T21:42:15.554692+0000","last_became_active":"2023-07-06T21:42:10.896260+0000","last_became_peered":"2023-07-06T21:42:10.896260+0000","last_unstale":"2023-07-06T21:42:15.554692+0000","last_undegraded":"2023-07-06T21:42:15.554692+0000","last_fullsized":"2023-07-06T21:42:15.554692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:20:07.821447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749689+0000","last_change":"2023-07-06T21:42:10.467430+0000","last_active":"2023-07-06T21:42:15.749689+0000","last_peered":"2023-07-06T21:42:15.749689+0000","last_clean":"2023-07-06T21:42:15.749689+0000","last_became_active":"2023-07-06T21:42:10.467147+0000","last_became_peered":"2023-07-06T21:42:10.467147+0000","last_unstale":"2023-07-06T21:42:15.749689+0000","last_undegraded":"2023-07-06T21:42:15.749689+0000","last_fullsized":"2023-07-06T21:42:15.749689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:48.294217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300352+0000","last_change":"2023-07-06T21:42:14.911007+0000","last_active":"2023-07-06T21:42:15.300352+0000","last_peered":"2023-07-06T21:42:15.300352+0000","last_clean":"2023-07-06T21:42:15.300352+0000","last_became_active":"2023-07-06T21:42:14.910352+0000","last_became_peered":"2023-07-06T21:42:14.910352+0000","last_unstale":"2023-07-06T21:42:15.300352+0000","last_undegraded":"2023-07-06T21:42:15.300352+0000","last_fullsized":"2023-07-06T21:42:15.300352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:32:51.766704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815617+0000","last_change":"2023-07-06T21:42:10.903614+0000","last_active":"2023-07-06T21:42:15.815617+0000","last_peered":"2023-07-06T21:42:15.815617+0000","last_clean":"2023-07-06T21:42:15.815617+0000","last_became_active":"2023-07-06T21:42:10.903258+0000","last_became_peered":"2023-07-06T21:42:10.903258+0000","last_unstale":"2023-07-06T21:42:15.815617+0000","last_undegraded":"2023-07-06T21:42:15.815617+0000","last_fullsized":"2023-07-06T21:42:15.815617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:58:56.102496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304481+0000","last_change":"2023-07-06T21:42:10.472497+0000","last_active":"2023-07-06T21:42:15.304481+0000","last_peered":"2023-07-06T21:42:15.304481+0000","last_clean":"2023-07-06T21:42:15.304481+0000","last_became_active":"2023-07-06T21:42:10.470849+0000","last_became_peered":"2023-07-06T21:42:10.470849+0000","last_unstale":"2023-07-06T21:42:15.304481+0000","last_undegraded":"2023-07-06T21:42:15.304481+0000","last_fullsized":"2023-07-06T21:42:15.304481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:28.818997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300483+0000","last_change":"2023-07-06T21:42:14.927494+0000","last_active":"2023-07-06T21:42:15.300483+0000","last_peered":"2023-07-06T21:42:15.300483+0000","last_clean":"2023-07-06T21:42:15.300483+0000","last_became_active":"2023-07-06T21:42:14.927091+0000","last_became_peered":"2023-07-06T21:42:14.927091+0000","last_unstale":"2023-07-06T21:42:15.300483+0000","last_undegraded":"2023-07-06T21:42:15.300483+0000","last_fullsized":"2023-07-06T21:42:15.300483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:28:09.964167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302682+0000","last_change":"2023-07-06T21:42:10.900898+0000","last_active":"2023-07-06T21:42:15.302682+0000","last_peered":"2023-07-06T21:42:15.302682+0000","last_clean":"2023-07-06T21:42:15.302682+0000","last_became_active":"2023-07-06T21:42:10.900581+0000","last_became_peered":"2023-07-06T21:42:10.900581+0000","last_unstale":"2023-07-06T21:42:15.302682+0000","last_undegraded":"2023-07-06T21:42:15.302682+0000","last_fullsized":"2023-07-06T21:42:15.302682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:06:29.601787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304774+0000","last_change":"2023-07-06T21:42:10.481348+0000","last_active":"2023-07-06T21:42:15.304774+0000","last_peered":"2023-07-06T21:42:15.304774+0000","last_clean":"2023-07-06T21:42:15.304774+0000","last_became_active":"2023-07-06T21:42:10.480900+0000","last_became_peered":"2023-07-06T21:42:10.480900+0000","last_unstale":"2023-07-06T21:42:15.304774+0000","last_undegraded":"2023-07-06T21:42:15.304774+0000","last_fullsized":"2023-07-06T21:42:15.304774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:25.448002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300082+0000","last_change":"2023-07-06T21:42:14.910719+0000","last_active":"2023-07-06T21:42:15.300082+0000","last_peered":"2023-07-06T21:42:15.300082+0000","last_clean":"2023-07-06T21:42:15.300082+0000","last_became_active":"2023-07-06T21:42:14.910213+0000","last_became_peered":"2023-07-06T21:42:14.910213+0000","last_unstale":"2023-07-06T21:42:15.300082+0000","last_undegraded":"2023-07-06T21:42:15.300082+0000","last_fullsized":"2023-07-06T21:42:15.300082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:11:34.554961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749271+0000","last_change":"2023-07-06T21:42:10.899721+0000","last_active":"2023-07-06T21:42:15.749271+0000","last_peered":"2023-07-06T21:42:15.749271+0000","last_clean":"2023-07-06T21:42:15.749271+0000","last_became_active":"2023-07-06T21:42:10.896792+0000","last_became_peered":"2023-07-06T21:42:10.896792+0000","last_unstale":"2023-07-06T21:42:15.749271+0000","last_undegraded":"2023-07-06T21:42:15.749271+0000","last_fullsized":"2023-07-06T21:42:15.749271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:36.353661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304883+0000","last_change":"2023-07-06T21:42:10.479043+0000","last_active":"2023-07-06T21:42:15.304883+0000","last_peered":"2023-07-06T21:42:15.304883+0000","last_clean":"2023-07-06T21:42:15.304883+0000","last_became_active":"2023-07-06T21:42:10.478756+0000","last_became_peered":"2023-07-06T21:42:10.478756+0000","last_unstale":"2023-07-06T21:42:15.304883+0000","last_undegraded":"2023-07-06T21:42:15.304883+0000","last_fullsized":"2023-07-06T21:42:15.304883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:15:16.029351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303391+0000","last_change":"2023-07-06T21:42:14.903165+0000","last_active":"2023-07-06T21:42:15.303391+0000","last_peered":"2023-07-06T21:42:15.303391+0000","last_clean":"2023-07-06T21:42:15.303391+0000","last_became_active":"2023-07-06T21:42:14.902418+0000","last_became_peered":"2023-07-06T21:42:14.902418+0000","last_unstale":"2023-07-06T21:42:15.303391+0000","last_undegraded":"2023-07-06T21:42:15.303391+0000","last_fullsized":"2023-07-06T21:42:15.303391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:06.471467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749820+0000","last_change":"2023-07-06T21:42:14.923545+0000","last_active":"2023-07-06T21:42:15.749820+0000","last_peered":"2023-07-06T21:42:15.749820+0000","last_clean":"2023-07-06T21:42:15.749820+0000","last_became_active":"2023-07-06T21:42:14.922278+0000","last_became_peered":"2023-07-06T21:42:14.922278+0000","last_unstale":"2023-07-06T21:42:15.749820+0000","last_undegraded":"2023-07-06T21:42:15.749820+0000","last_fullsized":"2023-07-06T21:42:15.749820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:58.383763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815663+0000","last_change":"2023-07-06T21:42:10.477503+0000","last_active":"2023-07-06T21:42:15.815663+0000","last_peered":"2023-07-06T21:42:15.815663+0000","last_clean":"2023-07-06T21:42:15.815663+0000","last_became_active":"2023-07-06T21:42:10.477166+0000","last_became_peered":"2023-07-06T21:42:10.477166+0000","last_unstale":"2023-07-06T21:42:15.815663+0000","last_undegraded":"2023-07-06T21:42:15.815663+0000","last_fullsized":"2023-07-06T21:42:15.815663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:25:12.585223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814704+0000","last_change":"2023-07-06T21:42:10.897513+0000","last_active":"2023-07-06T21:42:15.814704+0000","last_peered":"2023-07-06T21:42:15.814704+0000","last_clean":"2023-07-06T21:42:15.814704+0000","last_became_active":"2023-07-06T21:42:10.897114+0000","last_became_peered":"2023-07-06T21:42:10.897114+0000","last_unstale":"2023-07-06T21:42:15.814704+0000","last_undegraded":"2023-07-06T21:42:15.814704+0000","last_fullsized":"2023-07-06T21:42:15.814704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:39:47.681666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814620+0000","last_change":"2023-07-06T21:42:14.904372+0000","last_active":"2023-07-06T21:42:15.814620+0000","last_peered":"2023-07-06T21:42:15.814620+0000","last_clean":"2023-07-06T21:42:15.814620+0000","last_became_active":"2023-07-06T21:42:14.904023+0000","last_became_peered":"2023-07-06T21:42:14.904023+0000","last_unstale":"2023-07-06T21:42:15.814620+0000","last_undegraded":"2023-07-06T21:42:15.814620+0000","last_fullsized":"2023-07-06T21:42:15.814620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:10.614275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303576+0000","last_change":"2023-07-06T21:42:10.478297+0000","last_active":"2023-07-06T21:42:15.303576+0000","last_peered":"2023-07-06T21:42:15.303576+0000","last_clean":"2023-07-06T21:42:15.303576+0000","last_became_active":"2023-07-06T21:42:10.478050+0000","last_became_peered":"2023-07-06T21:42:10.478050+0000","last_unstale":"2023-07-06T21:42:15.303576+0000","last_undegraded":"2023-07-06T21:42:15.303576+0000","last_fullsized":"2023-07-06T21:42:15.303576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:53.942428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555359+0000","last_change":"2023-07-06T21:42:10.883887+0000","last_active":"2023-07-06T21:42:15.555359+0000","last_peered":"2023-07-06T21:42:15.555359+0000","last_clean":"2023-07-06T21:42:15.555359+0000","last_became_active":"2023-07-06T21:42:10.883644+0000","last_became_peered":"2023-07-06T21:42:10.883644+0000","last_unstale":"2023-07-06T21:42:15.555359+0000","last_undegraded":"2023-07-06T21:42:15.555359+0000","last_fullsized":"2023-07-06T21:42:15.555359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:07.551676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554791+0000","last_change":"2023-07-06T21:42:10.476173+0000","last_active":"2023-07-06T21:42:15.554791+0000","last_peered":"2023-07-06T21:42:15.554791+0000","last_clean":"2023-07-06T21:42:15.554791+0000","last_became_active":"2023-07-06T21:42:10.475802+0000","last_became_peered":"2023-07-06T21:42:10.475802+0000","last_unstale":"2023-07-06T21:42:15.554791+0000","last_undegraded":"2023-07-06T21:42:15.554791+0000","last_fullsized":"2023-07-06T21:42:15.554791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:39.285403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749898+0000","last_change":"2023-07-06T21:42:10.905138+0000","last_active":"2023-07-06T21:42:15.749898+0000","last_peered":"2023-07-06T21:42:15.749898+0000","last_clean":"2023-07-06T21:42:15.749898+0000","last_became_active":"2023-07-06T21:42:10.904460+0000","last_became_peered":"2023-07-06T21:42:10.904460+0000","last_unstale":"2023-07-06T21:42:15.749898+0000","last_undegraded":"2023-07-06T21:42:15.749898+0000","last_fullsized":"2023-07-06T21:42:15.749898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:07.551676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814399+0000","last_change":"2023-07-06T21:42:14.906570+0000","last_active":"2023-07-06T21:42:15.814399+0000","last_peered":"2023-07-06T21:42:15.814399+0000","last_clean":"2023-07-06T21:42:15.814399+0000","last_became_active":"2023-07-06T21:42:14.906136+0000","last_became_peered":"2023-07-06T21:42:14.906136+0000","last_unstale":"2023-07-06T21:42:15.814399+0000","last_undegraded":"2023-07-06T21:42:15.814399+0000","last_fullsized":"2023-07-06T21:42:15.814399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:33.260332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304098+0000","last_change":"2023-07-06T21:42:10.478474+0000","last_active":"2023-07-06T21:42:15.304098+0000","last_peered":"2023-07-06T21:42:15.304098+0000","last_clean":"2023-07-06T21:42:15.304098+0000","last_became_active":"2023-07-06T21:42:10.478162+0000","last_became_peered":"2023-07-06T21:42:10.478162+0000","last_unstale":"2023-07-06T21:42:15.304098+0000","last_undegraded":"2023-07-06T21:42:15.304098+0000","last_fullsized":"2023-07-06T21:42:15.304098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:34.600926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814456+0000","last_change":"2023-07-06T21:42:10.903800+0000","last_active":"2023-07-06T21:42:15.814456+0000","last_peered":"2023-07-06T21:42:15.814456+0000","last_clean":"2023-07-06T21:42:15.814456+0000","last_became_active":"2023-07-06T21:42:10.903469+0000","last_became_peered":"2023-07-06T21:42:10.903469+0000","last_unstale":"2023-07-06T21:42:15.814456+0000","last_undegraded":"2023-07-06T21:42:15.814456+0000","last_fullsized":"2023-07-06T21:42:15.814456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:26.458362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749752+0000","last_change":"2023-07-06T21:42:14.916210+0000","last_active":"2023-07-06T21:42:15.749752+0000","last_peered":"2023-07-06T21:42:15.749752+0000","last_clean":"2023-07-06T21:42:15.749752+0000","last_became_active":"2023-07-06T21:42:14.915845+0000","last_became_peered":"2023-07-06T21:42:14.915845+0000","last_unstale":"2023-07-06T21:42:15.749752+0000","last_undegraded":"2023-07-06T21:42:15.749752+0000","last_fullsized":"2023-07-06T21:42:15.749752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:42.214612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815466+0000","last_change":"2023-07-06T21:42:10.887152+0000","last_active":"2023-07-06T21:42:15.815466+0000","last_peered":"2023-07-06T21:42:15.815466+0000","last_clean":"2023-07-06T21:42:15.815466+0000","last_became_active":"2023-07-06T21:42:10.881872+0000","last_became_peered":"2023-07-06T21:42:10.881872+0000","last_unstale":"2023-07-06T21:42:15.815466+0000","last_undegraded":"2023-07-06T21:42:15.815466+0000","last_fullsized":"2023-07-06T21:42:15.815466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:18:00.557093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813877+0000","last_change":"2023-07-06T21:42:10.899839+0000","last_active":"2023-07-06T21:42:15.813877+0000","last_peered":"2023-07-06T21:42:15.813877+0000","last_clean":"2023-07-06T21:42:15.813877+0000","last_became_active":"2023-07-06T21:42:10.899525+0000","last_became_peered":"2023-07-06T21:42:10.899525+0000","last_unstale":"2023-07-06T21:42:15.813877+0000","last_undegraded":"2023-07-06T21:42:15.813877+0000","last_fullsized":"2023-07-06T21:42:15.813877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:38.266961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303319+0000","last_change":"2023-07-06T21:42:10.893778+0000","last_active":"2023-07-06T21:42:15.303319+0000","last_peered":"2023-07-06T21:42:15.303319+0000","last_clean":"2023-07-06T21:42:15.303319+0000","last_became_active":"2023-07-06T21:42:10.893495+0000","last_became_peered":"2023-07-06T21:42:10.893495+0000","last_unstale":"2023-07-06T21:42:15.303319+0000","last_undegraded":"2023-07-06T21:42:15.303319+0000","last_fullsized":"2023-07-06T21:42:15.303319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:05:56.844228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814245+0000","last_change":"2023-07-06T21:42:10.898297+0000","last_active":"2023-07-06T21:42:15.814245+0000","last_peered":"2023-07-06T21:42:15.814245+0000","last_clean":"2023-07-06T21:42:15.814245+0000","last_became_active":"2023-07-06T21:42:10.897968+0000","last_became_peered":"2023-07-06T21:42:10.897968+0000","last_unstale":"2023-07-06T21:42:15.814245+0000","last_undegraded":"2023-07-06T21:42:15.814245+0000","last_fullsized":"2023-07-06T21:42:15.814245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:07.551676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560074+0000","last_change":"2023-07-06T21:42:10.900842+0000","last_active":"2023-07-06T21:42:15.560074+0000","last_peered":"2023-07-06T21:42:15.560074+0000","last_clean":"2023-07-06T21:42:15.560074+0000","last_became_active":"2023-07-06T21:42:10.900437+0000","last_became_peered":"2023-07-06T21:42:10.900437+0000","last_unstale":"2023-07-06T21:42:15.560074+0000","last_undegraded":"2023-07-06T21:42:15.560074+0000","last_fullsized":"2023-07-06T21:42:15.560074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:40.295763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749841+0000","last_change":"2023-07-06T21:42:10.905321+0000","last_active":"2023-07-06T21:42:15.749841+0000","last_peered":"2023-07-06T21:42:15.749841+0000","last_clean":"2023-07-06T21:42:15.749841+0000","last_became_active":"2023-07-06T21:42:10.904814+0000","last_became_peered":"2023-07-06T21:42:10.904814+0000","last_unstale":"2023-07-06T21:42:15.749841+0000","last_undegraded":"2023-07-06T21:42:15.749841+0000","last_fullsized":"2023-07-06T21:42:15.749841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:14.101664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560324+0000","last_change":"2023-07-06T21:42:10.902809+0000","last_active":"2023-07-06T21:42:15.560324+0000","last_peered":"2023-07-06T21:42:15.560324+0000","last_clean":"2023-07-06T21:42:15.560324+0000","last_became_active":"2023-07-06T21:42:10.902527+0000","last_became_peered":"2023-07-06T21:42:10.902527+0000","last_unstale":"2023-07-06T21:42:15.560324+0000","last_undegraded":"2023-07-06T21:42:15.560324+0000","last_fullsized":"2023-07-06T21:42:15.560324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:49.957566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.561334+0000","last_change":"2023-07-06T21:42:10.896398+0000","last_active":"2023-07-06T21:42:15.561334+0000","last_peered":"2023-07-06T21:42:15.561334+0000","last_clean":"2023-07-06T21:42:15.561334+0000","last_became_active":"2023-07-06T21:42:10.896054+0000","last_became_peered":"2023-07-06T21:42:10.896054+0000","last_unstale":"2023-07-06T21:42:15.561334+0000","last_undegraded":"2023-07-06T21:42:15.561334+0000","last_fullsized":"2023-07-06T21:42:15.561334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:21.307899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302771+0000","last_change":"2023-07-06T21:42:10.893870+0000","last_active":"2023-07-06T21:42:15.302771+0000","last_peered":"2023-07-06T21:42:15.302771+0000","last_clean":"2023-07-06T21:42:15.302771+0000","last_became_active":"2023-07-06T21:42:10.888026+0000","last_became_peered":"2023-07-06T21:42:10.888026+0000","last_unstale":"2023-07-06T21:42:15.302771+0000","last_undegraded":"2023-07-06T21:42:15.302771+0000","last_fullsized":"2023-07-06T21:42:15.302771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813817+0000","last_change":"2023-07-06T21:42:10.885134+0000","last_active":"2023-07-06T21:42:15.813817+0000","last_peered":"2023-07-06T21:42:15.813817+0000","last_clean":"2023-07-06T21:42:15.813817+0000","last_became_active":"2023-07-06T21:42:10.884849+0000","last_became_peered":"2023-07-06T21:42:10.884849+0000","last_unstale":"2023-07-06T21:42:15.813817+0000","last_undegraded":"2023-07-06T21:42:15.813817+0000","last_fullsized":"2023-07-06T21:42:15.813817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554548+0000","last_change":"2023-07-06T21:42:10.902317+0000","last_active":"2023-07-06T21:42:15.554548+0000","last_peered":"2023-07-06T21:42:15.554548+0000","last_clean":"2023-07-06T21:42:15.554548+0000","last_became_active":"2023-07-06T21:42:10.902008+0000","last_became_peered":"2023-07-06T21:42:10.902008+0000","last_unstale":"2023-07-06T21:42:15.554548+0000","last_undegraded":"2023-07-06T21:42:15.554548+0000","last_fullsized":"2023-07-06T21:42:15.554548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:17.881222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304038+0000","last_change":"2023-07-06T21:42:10.894288+0000","last_active":"2023-07-06T21:42:15.304038+0000","last_peered":"2023-07-06T21:42:15.304038+0000","last_clean":"2023-07-06T21:42:15.304038+0000","last_became_active":"2023-07-06T21:42:10.880077+0000","last_became_peered":"2023-07-06T21:42:10.880077+0000","last_unstale":"2023-07-06T21:42:15.304038+0000","last_undegraded":"2023-07-06T21:42:15.304038+0000","last_fullsized":"2023-07-06T21:42:15.304038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:14.101664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303738+0000","last_change":"2023-07-06T21:42:10.894314+0000","last_active":"2023-07-06T21:42:15.303738+0000","last_peered":"2023-07-06T21:42:15.303738+0000","last_clean":"2023-07-06T21:42:15.303738+0000","last_became_active":"2023-07-06T21:42:10.894014+0000","last_became_peered":"2023-07-06T21:42:10.894014+0000","last_unstale":"2023-07-06T21:42:15.303738+0000","last_undegraded":"2023-07-06T21:42:15.303738+0000","last_fullsized":"2023-07-06T21:42:15.303738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:38:49.964001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300620+0000","last_change":"2023-07-06T21:42:10.887468+0000","last_active":"2023-07-06T21:42:15.300620+0000","last_peered":"2023-07-06T21:42:15.300620+0000","last_clean":"2023-07-06T21:42:15.300620+0000","last_became_active":"2023-07-06T21:42:10.887178+0000","last_became_peered":"2023-07-06T21:42:10.887178+0000","last_unstale":"2023-07-06T21:42:15.300620+0000","last_undegraded":"2023-07-06T21:42:15.300620+0000","last_fullsized":"2023-07-06T21:42:15.300620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:48:23.869797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304224+0000","last_change":"2023-07-06T21:42:10.879664+0000","last_active":"2023-07-06T21:42:15.304224+0000","last_peered":"2023-07-06T21:42:15.304224+0000","last_clean":"2023-07-06T21:42:15.304224+0000","last_became_active":"2023-07-06T21:42:10.879395+0000","last_became_peered":"2023-07-06T21:42:10.879395+0000","last_unstale":"2023-07-06T21:42:15.304224+0000","last_undegraded":"2023-07-06T21:42:15.304224+0000","last_fullsized":"2023-07-06T21:42:15.304224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:52:32.495454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555257+0000","last_change":"2023-07-06T21:42:10.882880+0000","last_active":"2023-07-06T21:42:15.555257+0000","last_peered":"2023-07-06T21:42:15.555257+0000","last_clean":"2023-07-06T21:42:15.555257+0000","last_became_active":"2023-07-06T21:42:10.882651+0000","last_became_peered":"2023-07-06T21:42:10.882651+0000","last_unstale":"2023-07-06T21:42:15.555257+0000","last_undegraded":"2023-07-06T21:42:15.555257+0000","last_fullsized":"2023-07-06T21:42:15.555257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:54.952788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302546+0000","last_change":"2023-07-06T21:42:10.878440+0000","last_active":"2023-07-06T21:42:15.302546+0000","last_peered":"2023-07-06T21:42:15.302546+0000","last_clean":"2023-07-06T21:42:15.302546+0000","last_became_active":"2023-07-06T21:42:10.878108+0000","last_became_peered":"2023-07-06T21:42:10.878108+0000","last_unstale":"2023-07-06T21:42:15.302546+0000","last_undegraded":"2023-07-06T21:42:15.302546+0000","last_fullsized":"2023-07-06T21:42:15.302546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:23:26.016221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303514+0000","last_change":"2023-07-06T21:42:10.902391+0000","last_active":"2023-07-06T21:42:15.303514+0000","last_peered":"2023-07-06T21:42:15.303514+0000","last_clean":"2023-07-06T21:42:15.303514+0000","last_became_active":"2023-07-06T21:42:10.902167+0000","last_became_peered":"2023-07-06T21:42:10.902167+0000","last_unstale":"2023-07-06T21:42:15.303514+0000","last_undegraded":"2023-07-06T21:42:15.303514+0000","last_fullsized":"2023-07-06T21:42:15.303514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:38.783636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749382+0000","last_change":"2023-07-06T21:42:10.891440+0000","last_active":"2023-07-06T21:42:15.749382+0000","last_peered":"2023-07-06T21:42:15.749382+0000","last_clean":"2023-07-06T21:42:15.749382+0000","last_became_active":"2023-07-06T21:42:10.891154+0000","last_became_peered":"2023-07-06T21:42:10.891154+0000","last_unstale":"2023-07-06T21:42:15.749382+0000","last_undegraded":"2023-07-06T21:42:15.749382+0000","last_fullsized":"2023-07-06T21:42:15.749382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300255+0000","last_change":"2023-07-06T21:42:10.875691+0000","last_active":"2023-07-06T21:42:15.300255+0000","last_peered":"2023-07-06T21:42:15.300255+0000","last_clean":"2023-07-06T21:42:15.300255+0000","last_became_active":"2023-07-06T21:42:10.875349+0000","last_became_peered":"2023-07-06T21:42:10.875349+0000","last_unstale":"2023-07-06T21:42:15.300255+0000","last_undegraded":"2023-07-06T21:42:15.300255+0000","last_fullsized":"2023-07-06T21:42:15.300255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:27:07.827816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300278+0000","last_change":"2023-07-06T21:42:10.881532+0000","last_active":"2023-07-06T21:42:15.300278+0000","last_peered":"2023-07-06T21:42:15.300278+0000","last_clean":"2023-07-06T21:42:15.300278+0000","last_became_active":"2023-07-06T21:42:10.880941+0000","last_became_peered":"2023-07-06T21:42:10.880941+0000","last_unstale":"2023-07-06T21:42:15.300278+0000","last_undegraded":"2023-07-06T21:42:15.300278+0000","last_fullsized":"2023-07-06T21:42:15.300278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:52:05.125777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304252+0000","last_change":"2023-07-06T21:42:10.894986+0000","last_active":"2023-07-06T21:42:15.304252+0000","last_peered":"2023-07-06T21:42:15.304252+0000","last_clean":"2023-07-06T21:42:15.304252+0000","last_became_active":"2023-07-06T21:42:10.894738+0000","last_became_peered":"2023-07-06T21:42:10.894738+0000","last_unstale":"2023-07-06T21:42:15.304252+0000","last_undegraded":"2023-07-06T21:42:15.304252+0000","last_fullsized":"2023-07-06T21:42:15.304252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:27:06.771295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750069+0000","last_change":"2023-07-06T21:42:10.895916+0000","last_active":"2023-07-06T21:42:15.750069+0000","last_peered":"2023-07-06T21:42:15.750069+0000","last_clean":"2023-07-06T21:42:15.750069+0000","last_became_active":"2023-07-06T21:42:10.895651+0000","last_became_peered":"2023-07-06T21:42:10.895651+0000","last_unstale":"2023-07-06T21:42:15.750069+0000","last_undegraded":"2023-07-06T21:42:15.750069+0000","last_fullsized":"2023-07-06T21:42:15.750069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:26.458362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555014+0000","last_change":"2023-07-06T21:42:10.885988+0000","last_active":"2023-07-06T21:42:15.555014+0000","last_peered":"2023-07-06T21:42:15.555014+0000","last_clean":"2023-07-06T21:42:15.555014+0000","last_became_active":"2023-07-06T21:42:10.885729+0000","last_became_peered":"2023-07-06T21:42:10.885729+0000","last_unstale":"2023-07-06T21:42:15.555014+0000","last_undegraded":"2023-07-06T21:42:15.555014+0000","last_fullsized":"2023-07-06T21:42:15.555014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749183+0000","last_change":"2023-07-06T21:42:10.891993+0000","last_active":"2023-07-06T21:42:15.749183+0000","last_peered":"2023-07-06T21:42:15.749183+0000","last_clean":"2023-07-06T21:42:15.749183+0000","last_became_active":"2023-07-06T21:42:10.891739+0000","last_became_peered":"2023-07-06T21:42:10.891739+0000","last_unstale":"2023-07-06T21:42:15.749183+0000","last_undegraded":"2023-07-06T21:42:15.749183+0000","last_fullsized":"2023-07-06T21:42:15.749183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:40.295763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303451+0000","last_change":"2023-07-06T21:42:10.902805+0000","last_active":"2023-07-06T21:42:15.303451+0000","last_peered":"2023-07-06T21:42:15.303451+0000","last_clean":"2023-07-06T21:42:15.303451+0000","last_became_active":"2023-07-06T21:42:10.902567+0000","last_became_peered":"2023-07-06T21:42:10.902567+0000","last_unstale":"2023-07-06T21:42:15.303451+0000","last_undegraded":"2023-07-06T21:42:15.303451+0000","last_fullsized":"2023-07-06T21:42:15.303451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:49.304577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303055+0000","last_change":"2023-07-06T21:42:10.881630+0000","last_active":"2023-07-06T21:42:15.303055+0000","last_peered":"2023-07-06T21:42:15.303055+0000","last_clean":"2023-07-06T21:42:15.303055+0000","last_became_active":"2023-07-06T21:42:10.881320+0000","last_became_peered":"2023-07-06T21:42:10.881320+0000","last_unstale":"2023-07-06T21:42:15.303055+0000","last_undegraded":"2023-07-06T21:42:15.303055+0000","last_fullsized":"2023-07-06T21:42:15.303055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:25:56.218127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555077+0000","last_change":"2023-07-06T21:42:10.898965+0000","last_active":"2023-07-06T21:42:15.555077+0000","last_peered":"2023-07-06T21:42:15.555077+0000","last_clean":"2023-07-06T21:42:15.555077+0000","last_became_active":"2023-07-06T21:42:10.898708+0000","last_became_peered":"2023-07-06T21:42:10.898708+0000","last_unstale":"2023-07-06T21:42:15.555077+0000","last_undegraded":"2023-07-06T21:42:15.555077+0000","last_fullsized":"2023-07-06T21:42:15.555077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:38.266961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815879+0000","last_change":"2023-07-06T21:42:10.886444+0000","last_active":"2023-07-06T21:42:15.815879+0000","last_peered":"2023-07-06T21:42:15.815879+0000","last_clean":"2023-07-06T21:42:15.815879+0000","last_became_active":"2023-07-06T21:42:10.885666+0000","last_became_peered":"2023-07-06T21:42:10.885666+0000","last_unstale":"2023-07-06T21:42:15.815879+0000","last_undegraded":"2023-07-06T21:42:15.815879+0000","last_fullsized":"2023-07-06T21:42:15.815879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:46:15.005638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304225+0000","last_change":"2023-07-06T21:42:10.882573+0000","last_active":"2023-07-06T21:42:15.304225+0000","last_peered":"2023-07-06T21:42:15.304225+0000","last_clean":"2023-07-06T21:42:15.304225+0000","last_became_active":"2023-07-06T21:42:10.882180+0000","last_became_peered":"2023-07-06T21:42:10.882180+0000","last_unstale":"2023-07-06T21:42:15.304225+0000","last_undegraded":"2023-07-06T21:42:15.304225+0000","last_fullsized":"2023-07-06T21:42:15.304225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:30:13.482950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749979+0000","last_change":"2023-07-06T21:42:10.904712+0000","last_active":"2023-07-06T21:42:15.749979+0000","last_peered":"2023-07-06T21:42:15.749979+0000","last_clean":"2023-07-06T21:42:15.749979+0000","last_became_active":"2023-07-06T21:42:10.904256+0000","last_became_peered":"2023-07-06T21:42:10.904256+0000","last_unstale":"2023-07-06T21:42:15.749979+0000","last_undegraded":"2023-07-06T21:42:15.749979+0000","last_fullsized":"2023-07-06T21:42:15.749979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:29.829357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300331+0000","last_change":"2023-07-06T21:42:10.887637+0000","last_active":"2023-07-06T21:42:15.300331+0000","last_peered":"2023-07-06T21:42:15.300331+0000","last_clean":"2023-07-06T21:42:15.300331+0000","last_became_active":"2023-07-06T21:42:10.887372+0000","last_became_peered":"2023-07-06T21:42:10.887372+0000","last_unstale":"2023-07-06T21:42:15.300331+0000","last_undegraded":"2023-07-06T21:42:15.300331+0000","last_fullsized":"2023-07-06T21:42:15.300331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:03.429658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":913408,"data_stored":714278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":123609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":884736,"data_stored":709832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:42:30.483 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:42:30.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9ee511640 1 Processor -- start 2023-07-06T21:42:30.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9ee511640 1 -- start start 2023-07-06T21:42:30.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9ee511640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb9e80712f0 0x7fb9e806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:30.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9ee511640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9e80ca450 0x7fb9e815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:30.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9ee511640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e8159cd0 con 0x7fb9e80b3730 2023-07-06T21:42:30.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9ee511640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e80693f0 con 0x7fb9e80712f0 2023-07-06T21:42:30.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9ee511640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e806aca0 con 0x7fb9e80ca450 2023-07-06T21:42:30.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9e7fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb9e80712f0 0x7fb9e806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:30.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9ecaae640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9e80ca450 0x7fb9e815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:30.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9e77fe640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fb9e80b3730 0x7fb9e80c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:47514/0 (socket says 172.21.15.55:47514) 2023-07-06T21:42:30.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9e77fe640 1 -- 172.21.15.55:0/1287624286 learned_addr learned my addr 172.21.15.55:0/1287624286 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:30.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9ecaae640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9e80ca450 0x7fb9e815d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44478/0 (socket says 172.21.15.55:44478) 2023-07-06T21:42:30.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9e7fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb9e80712f0 0x7fb9e806a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:55802/0 (socket says 172.21.15.55:55802) 2023-07-06T21:42:30.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9e6ffd640 1 -- 172.21.15.55:0/1287624286 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090258134 0 0) 0x7fb9e8159cd0 con 0x7fb9e80b3730 2023-07-06T21:42:30.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9e6ffd640 1 -- 172.21.15.55:0/1287624286 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d0003530 con 0x7fb9e80b3730 2023-07-06T21:42:30.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9ecaae640 1 -- 172.21.15.55:0/1287624286 >> v2:172.21.15.138:3300/0 conn(0x7fb9e80712f0 msgr2=0x7fb9e806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:30.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9ecaae640 1 --2- 172.21.15.55:0/1287624286 >> v2:172.21.15.138:3300/0 conn(0x7fb9e80712f0 0x7fb9e806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9ecaae640 1 -- 172.21.15.55:0/1287624286 >> v1:172.21.15.138:6789/0 conn(0x7fb9e80b3730 legacy=0x7fb9e80c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:30.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9ecaae640 1 -- 172.21.15.55:0/1287624286 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e80696b0 con 0x7fb9e80ca450 2023-07-06T21:42:30.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.655+0000 7fb9e7fff640 1 --2- 172.21.15.55:0/1287624286 >> v2:172.21.15.138:3300/0 conn(0x7fb9e80712f0 0x7fb9e806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:30.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.659+0000 7fb9ecaae640 1 --2- 172.21.15.55:0/1287624286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9e80ca450 0x7fb9e815d3e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009d90 tx=0x7fb9e001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53d91cffd69abe9b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:30.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.659+0000 7fb9e6ffd640 1 -- 172.21.15.55:0/1287624286 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00a58f0 con 0x7fb9e80ca450 2023-07-06T21:42:30.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.659+0000 7fb9e6ffd640 1 -- 172.21.15.55:0/1287624286 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e00a5a50 con 0x7fb9e80ca450 2023-07-06T21:42:30.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.659+0000 7fb9e6ffd640 1 -- 172.21.15.55:0/1287624286 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00a5de0 con 0x7fb9e80ca450 2023-07-06T21:42:30.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.659+0000 7fb9ee511640 1 -- 172.21.15.55:0/1287624286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9e80ca450 msgr2=0x7fb9e815d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:30.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.659+0000 7fb9ee511640 1 --2- 172.21.15.55:0/1287624286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9e80ca450 0x7fb9e815d3e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009d90 tx=0x7fb9e001c920 comp rx=0 tx=0).stop 2023-07-06T21:42:30.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.659+0000 7fb9ee511640 1 -- 172.21.15.55:0/1287624286 shutdown_connections 2023-07-06T21:42:30.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.659+0000 7fb9ee511640 1 --2- 172.21.15.55:0/1287624286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9e80ca450 0x7fb9e815d3e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.659+0000 7fb9ee511640 1 --2- 172.21.15.55:0/1287624286 >> v2:172.21.15.138:3300/0 conn(0x7fb9e80712f0 0x7fb9e806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.659+0000 7fb9ee511640 1 -- 172.21.15.55:0/1287624286 >> 172.21.15.55:0/1287624286 conn(0x7fb9e80cded0 msgr2=0x7fb9e80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:30.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.659+0000 7fb9ee511640 1 -- 172.21.15.55:0/1287624286 shutdown_connections 2023-07-06T21:42:30.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.659+0000 7fb9ee511640 1 -- 172.21.15.55:0/1287624286 wait complete. 2023-07-06T21:42:30.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9ee511640 1 Processor -- start 2023-07-06T21:42:30.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9ee511640 1 -- start start 2023-07-06T21:42:30.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9ee511640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9e80712f0 0x7fb9e8155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:30.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9ee511640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9e80b3730 0x7fb9e80b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:30.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9ee511640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9e80ca450 0x7fb9e81581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:30.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9ee511640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80c2a90 con 0x7fb9e80b3730 2023-07-06T21:42:30.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9ee511640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80c6770 con 0x7fb9e80712f0 2023-07-06T21:42:30.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9ee511640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80c5ed0 con 0x7fb9e80ca450 2023-07-06T21:42:30.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9e77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9e80b3730 0x7fb9e80b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:30.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9e77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9e80b3730 0x7fb9e80b2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59938/0 (socket says 172.21.15.55:59938) 2023-07-06T21:42:30.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9e77fe640 1 -- 172.21.15.55:0/468786140 learned_addr learned my addr 172.21.15.55:0/468786140 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:30.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9e7fff640 1 --2- 172.21.15.55:0/468786140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9e80712f0 0x7fb9e8155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:30.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9ecaae640 1 --2- 172.21.15.55:0/468786140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9e80ca450 0x7fb9e81581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:30.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9e77fe640 1 -- 172.21.15.55:0/468786140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9e80ca450 msgr2=0x7fb9e81581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:30.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9e77fe640 1 --2- 172.21.15.55:0/468786140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9e80ca450 0x7fb9e81581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9e77fe640 1 -- 172.21.15.55:0/468786140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9e80712f0 msgr2=0x7fb9e8155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:30.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9e77fe640 1 --2- 172.21.15.55:0/468786140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9e80712f0 0x7fb9e8155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9e77fe640 1 -- 172.21.15.55:0/468786140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d8009420 con 0x7fb9e80b3730 2023-07-06T21:42:30.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9e77fe640 1 --2- 172.21.15.55:0/468786140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9e80b3730 0x7fb9e80b2250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00c420 tx=0x7fb9dc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:30.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9e4ff9640 1 -- 172.21.15.55:0/468786140 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc005cf0 con 0x7fb9e80b3730 2023-07-06T21:42:30.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9e4ff9640 1 -- 172.21.15.55:0/468786140 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc005e50 con 0x7fb9e80b3730 2023-07-06T21:42:30.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9e4ff9640 1 -- 172.21.15.55:0/468786140 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0072d0 con 0x7fb9e80b3730 2023-07-06T21:42:30.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.663+0000 7fb9ee511640 1 -- 172.21.15.55:0/468786140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e0009a70 con 0x7fb9e80b3730 2023-07-06T21:42:30.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.667+0000 7fb9ee511640 1 -- 172.21.15.55:0/468786140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e80c6490 con 0x7fb9e80b3730 2023-07-06T21:42:30.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.667+0000 7fb9ee511640 1 -- 172.21.15.55:0/468786140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e80c28f0 con 0x7fb9e80b3730 2023-07-06T21:42:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.667+0000 7fb9e4ff9640 1 -- 172.21.15.55:0/468786140 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb9dc007450 con 0x7fb9e80b3730 2023-07-06T21:42:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.667+0000 7fb9e4ff9640 1 --2- 172.21.15.55:0/468786140 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb9d4066280 0x7fb9d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.667+0000 7fb9e4ff9640 1 -- 172.21.15.55:0/468786140 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb9dc083230 con 0x7fb9e80b3730 2023-07-06T21:42:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.667+0000 7fb9e7fff640 1 --2- 172.21.15.55:0/468786140 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb9d4066280 0x7fb9d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:30.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.667+0000 7fb9e7fff640 1 --2- 172.21.15.55:0/468786140 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb9d4066280 0x7fb9d4068730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009be0 tx=0x7fb9d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:30.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.671+0000 7fb9e4ff9640 1 -- 172.21.15.55:0/468786140 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9e80c28f0 con 0x7fb9e80b3730 2023-07-06T21:42:30.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.823+0000 7fb9ee511640 1 -- 172.21.15.55:0/468786140 --> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9e8070530 con 0x7fb9d4066280 2023-07-06T21:42:30.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.831+0000 7fb9e4ff9640 1 -- 172.21.15.55:0/468786140 <== mgr.4101 v2:172.21.15.55:6832/1575998409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367444 (secure 0 0 0) 0x7fb9d8011ac0 con 0x7fb9d4066280 2023-07-06T21:42:30.843 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:30.845 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:42:30.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.835+0000 7fb9ee511640 1 -- 172.21.15.55:0/468786140 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb9d4066280 msgr2=0x7fb9d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:30.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.835+0000 7fb9ee511640 1 --2- 172.21.15.55:0/468786140 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb9d4066280 0x7fb9d4068730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009be0 tx=0x7fb9d8008040 comp rx=0 tx=0).stop 2023-07-06T21:42:30.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.835+0000 7fb9ee511640 1 -- 172.21.15.55:0/468786140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9e80b3730 msgr2=0x7fb9e80b2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:30.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.835+0000 7fb9ee511640 1 --2- 172.21.15.55:0/468786140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9e80b3730 0x7fb9e80b2250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00c420 tx=0x7fb9dc00c8e0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.835+0000 7fb9ee511640 1 -- 172.21.15.55:0/468786140 shutdown_connections 2023-07-06T21:42:30.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.835+0000 7fb9ee511640 1 --2- 172.21.15.55:0/468786140 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb9d4066280 0x7fb9d4068730 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.835+0000 7fb9ee511640 1 --2- 172.21.15.55:0/468786140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9e80ca450 0x7fb9e81581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.835+0000 7fb9ee511640 1 --2- 172.21.15.55:0/468786140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9e80b3730 0x7fb9e80b2250 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.835+0000 7fb9ee511640 1 --2- 172.21.15.55:0/468786140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9e80712f0 0x7fb9e8155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:30.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.835+0000 7fb9ee511640 1 -- 172.21.15.55:0/468786140 >> 172.21.15.55:0/468786140 conn(0x7fb9e80cded0 msgr2=0x7fb9e815be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:30.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.835+0000 7fb9ee511640 1 -- 172.21.15.55:0/468786140 shutdown_connections 2023-07-06T21:42:30.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:30.835+0000 7fb9ee511640 1 -- 172.21.15.55:0/468786140 wait complete. 2023-07-06T21:42:30.861 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-07-06T21:42:29.646875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235488,"kb_used_data":3488,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739232,"statfs":{"total":773094113280,"available":772852973568,"internally_reserved":0,"allocated":3571712,"data_stored":2146947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002466"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559395+0000","last_change":"2023-07-06T21:42:14.922760+0000","last_active":"2023-07-06T21:42:15.559395+0000","last_peered":"2023-07-06T21:42:15.559395+0000","last_clean":"2023-07-06T21:42:15.559395+0000","last_became_active":"2023-07-06T21:42:14.922077+0000","last_became_peered":"2023-07-06T21:42:14.922077+0000","last_unstale":"2023-07-06T21:42:15.559395+0000","last_undegraded":"2023-07-06T21:42:15.559395+0000","last_fullsized":"2023-07-06T21:42:15.559395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:06:48.524116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555170+0000","last_change":"2023-07-06T21:42:10.476753+0000","last_active":"2023-07-06T21:42:15.555170+0000","last_peered":"2023-07-06T21:42:15.555170+0000","last_clean":"2023-07-06T21:42:15.555170+0000","last_became_active":"2023-07-06T21:42:10.476407+0000","last_became_peered":"2023-07-06T21:42:10.476407+0000","last_unstale":"2023-07-06T21:42:15.555170+0000","last_undegraded":"2023-07-06T21:42:15.555170+0000","last_fullsized":"2023-07-06T21:42:15.555170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:48.294217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302669+0000","last_change":"2023-07-06T21:42:10.894302+0000","last_active":"2023-07-06T21:42:15.302669+0000","last_peered":"2023-07-06T21:42:15.302669+0000","last_clean":"2023-07-06T21:42:15.302669+0000","last_became_active":"2023-07-06T21:42:10.894059+0000","last_became_peered":"2023-07-06T21:42:10.894059+0000","last_unstale":"2023-07-06T21:42:15.302669+0000","last_undegraded":"2023-07-06T21:42:15.302669+0000","last_fullsized":"2023-07-06T21:42:15.302669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:10:18.902553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302860+0000","last_change":"2023-07-06T21:42:14.912729+0000","last_active":"2023-07-06T21:42:15.302860+0000","last_peered":"2023-07-06T21:42:15.302860+0000","last_clean":"2023-07-06T21:42:15.302860+0000","last_became_active":"2023-07-06T21:42:14.912302+0000","last_became_peered":"2023-07-06T21:42:14.912302+0000","last_unstale":"2023-07-06T21:42:15.302860+0000","last_undegraded":"2023-07-06T21:42:15.302860+0000","last_fullsized":"2023-07-06T21:42:15.302860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:34:24.860047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814495+0000","last_change":"2023-07-06T21:42:10.468782+0000","last_active":"2023-07-06T21:42:15.814495+0000","last_peered":"2023-07-06T21:42:15.814495+0000","last_clean":"2023-07-06T21:42:15.814495+0000","last_became_active":"2023-07-06T21:42:10.468411+0000","last_became_peered":"2023-07-06T21:42:10.468411+0000","last_unstale":"2023-07-06T21:42:15.814495+0000","last_undegraded":"2023-07-06T21:42:15.814495+0000","last_fullsized":"2023-07-06T21:42:15.814495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:15:16.029351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814107+0000","last_change":"2023-07-06T21:42:10.877047+0000","last_active":"2023-07-06T21:42:15.814107+0000","last_peered":"2023-07-06T21:42:15.814107+0000","last_clean":"2023-07-06T21:42:15.814107+0000","last_became_active":"2023-07-06T21:42:10.876806+0000","last_became_peered":"2023-07-06T21:42:10.876806+0000","last_unstale":"2023-07-06T21:42:15.814107+0000","last_undegraded":"2023-07-06T21:42:15.814107+0000","last_fullsized":"2023-07-06T21:42:15.814107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:35.611286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749539+0000","last_change":"2023-07-06T21:42:14.921605+0000","last_active":"2023-07-06T21:42:15.749539+0000","last_peered":"2023-07-06T21:42:15.749539+0000","last_clean":"2023-07-06T21:42:15.749539+0000","last_became_active":"2023-07-06T21:42:14.921171+0000","last_became_peered":"2023-07-06T21:42:14.921171+0000","last_unstale":"2023-07-06T21:42:15.749539+0000","last_undegraded":"2023-07-06T21:42:15.749539+0000","last_fullsized":"2023-07-06T21:42:15.749539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:53.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750023+0000","last_change":"2023-07-06T21:42:10.482575+0000","last_active":"2023-07-06T21:42:15.750023+0000","last_peered":"2023-07-06T21:42:15.750023+0000","last_clean":"2023-07-06T21:42:15.750023+0000","last_became_active":"2023-07-06T21:42:10.482316+0000","last_became_peered":"2023-07-06T21:42:10.482316+0000","last_unstale":"2023-07-06T21:42:15.750023+0000","last_undegraded":"2023-07-06T21:42:15.750023+0000","last_fullsized":"2023-07-06T21:42:15.750023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:18:13.828606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303215+0000","last_change":"2023-07-06T21:42:10.883364+0000","last_active":"2023-07-06T21:42:15.303215+0000","last_peered":"2023-07-06T21:42:15.303215+0000","last_clean":"2023-07-06T21:42:15.303215+0000","last_became_active":"2023-07-06T21:42:10.882034+0000","last_became_peered":"2023-07-06T21:42:10.882034+0000","last_unstale":"2023-07-06T21:42:15.303215+0000","last_undegraded":"2023-07-06T21:42:15.303215+0000","last_fullsized":"2023-07-06T21:42:15.303215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:15:09.620712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303343+0000","last_change":"2023-07-06T21:42:14.910108+0000","last_active":"2023-07-06T21:42:15.303343+0000","last_peered":"2023-07-06T21:42:15.303343+0000","last_clean":"2023-07-06T21:42:15.303343+0000","last_became_active":"2023-07-06T21:42:14.909696+0000","last_became_peered":"2023-07-06T21:42:14.909696+0000","last_unstale":"2023-07-06T21:42:15.303343+0000","last_undegraded":"2023-07-06T21:42:15.303343+0000","last_fullsized":"2023-07-06T21:42:15.303343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:24.738875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749578+0000","last_change":"2023-07-06T21:42:10.474754+0000","last_active":"2023-07-06T21:42:15.749578+0000","last_peered":"2023-07-06T21:42:15.749578+0000","last_clean":"2023-07-06T21:42:15.749578+0000","last_became_active":"2023-07-06T21:42:10.474461+0000","last_became_peered":"2023-07-06T21:42:10.474461+0000","last_unstale":"2023-07-06T21:42:15.749578+0000","last_undegraded":"2023-07-06T21:42:15.749578+0000","last_fullsized":"2023-07-06T21:42:15.749578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:02.030132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303640+0000","last_change":"2023-07-06T21:42:10.882870+0000","last_active":"2023-07-06T21:42:15.303640+0000","last_peered":"2023-07-06T21:42:15.303640+0000","last_clean":"2023-07-06T21:42:15.303640+0000","last_became_active":"2023-07-06T21:42:10.882523+0000","last_became_peered":"2023-07-06T21:42:10.882523+0000","last_unstale":"2023-07-06T21:42:15.303640+0000","last_undegraded":"2023-07-06T21:42:15.303640+0000","last_fullsized":"2023-07-06T21:42:15.303640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:29:36.364419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560105+0000","last_change":"2023-07-06T21:42:14.904246+0000","last_active":"2023-07-06T21:42:15.560105+0000","last_peered":"2023-07-06T21:42:15.560105+0000","last_clean":"2023-07-06T21:42:15.560105+0000","last_became_active":"2023-07-06T21:42:14.903763+0000","last_became_peered":"2023-07-06T21:42:14.903763+0000","last_unstale":"2023-07-06T21:42:15.560105+0000","last_undegraded":"2023-07-06T21:42:15.560105+0000","last_fullsized":"2023-07-06T21:42:15.560105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555200+0000","last_change":"2023-07-06T21:42:10.483593+0000","last_active":"2023-07-06T21:42:15.555200+0000","last_peered":"2023-07-06T21:42:15.555200+0000","last_clean":"2023-07-06T21:42:15.555200+0000","last_became_active":"2023-07-06T21:42:10.483284+0000","last_became_peered":"2023-07-06T21:42:10.483284+0000","last_unstale":"2023-07-06T21:42:15.555200+0000","last_undegraded":"2023-07-06T21:42:15.555200+0000","last_fullsized":"2023-07-06T21:42:15.555200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:37.773277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300337+0000","last_change":"2023-07-06T21:42:10.901884+0000","last_active":"2023-07-06T21:42:15.300337+0000","last_peered":"2023-07-06T21:42:15.300337+0000","last_clean":"2023-07-06T21:42:15.300337+0000","last_became_active":"2023-07-06T21:42:10.901580+0000","last_became_peered":"2023-07-06T21:42:10.901580+0000","last_unstale":"2023-07-06T21:42:15.300337+0000","last_undegraded":"2023-07-06T21:42:15.300337+0000","last_fullsized":"2023-07-06T21:42:15.300337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:22:55.494418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303514+0000","last_change":"2023-07-06T21:42:14.912585+0000","last_active":"2023-07-06T21:42:15.303514+0000","last_peered":"2023-07-06T21:42:15.303514+0000","last_clean":"2023-07-06T21:42:15.303514+0000","last_became_active":"2023-07-06T21:42:14.912161+0000","last_became_peered":"2023-07-06T21:42:14.912161+0000","last_unstale":"2023-07-06T21:42:15.303514+0000","last_undegraded":"2023-07-06T21:42:15.303514+0000","last_fullsized":"2023-07-06T21:42:15.303514+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:00:05.811592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303358+0000","last_change":"2023-07-06T21:42:10.475123+0000","last_active":"2023-07-06T21:42:15.303358+0000","last_peered":"2023-07-06T21:42:15.303358+0000","last_clean":"2023-07-06T21:42:15.303358+0000","last_became_active":"2023-07-06T21:42:10.474779+0000","last_became_peered":"2023-07-06T21:42:10.474779+0000","last_unstale":"2023-07-06T21:42:15.303358+0000","last_undegraded":"2023-07-06T21:42:15.303358+0000","last_fullsized":"2023-07-06T21:42:15.303358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:57:21.124055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814299+0000","last_change":"2023-07-06T21:42:10.896524+0000","last_active":"2023-07-06T21:42:15.814299+0000","last_peered":"2023-07-06T21:42:15.814299+0000","last_clean":"2023-07-06T21:42:15.814299+0000","last_became_active":"2023-07-06T21:42:10.896258+0000","last_became_peered":"2023-07-06T21:42:10.896258+0000","last_unstale":"2023-07-06T21:42:15.814299+0000","last_undegraded":"2023-07-06T21:42:15.814299+0000","last_fullsized":"2023-07-06T21:42:15.814299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:01.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816070+0000","last_change":"2023-07-06T21:42:14.906299+0000","last_active":"2023-07-06T21:42:15.816070+0000","last_peered":"2023-07-06T21:42:15.816070+0000","last_clean":"2023-07-06T21:42:15.816070+0000","last_became_active":"2023-07-06T21:42:14.905903+0000","last_became_peered":"2023-07-06T21:42:14.905903+0000","last_unstale":"2023-07-06T21:42:15.816070+0000","last_undegraded":"2023-07-06T21:42:15.816070+0000","last_fullsized":"2023-07-06T21:42:15.816070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:15.781649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559557+0000","last_change":"2023-07-06T21:42:10.473362+0000","last_active":"2023-07-06T21:42:15.559557+0000","last_peered":"2023-07-06T21:42:15.559557+0000","last_clean":"2023-07-06T21:42:15.559557+0000","last_became_active":"2023-07-06T21:42:10.473023+0000","last_became_peered":"2023-07-06T21:42:10.473023+0000","last_unstale":"2023-07-06T21:42:15.559557+0000","last_undegraded":"2023-07-06T21:42:15.559557+0000","last_fullsized":"2023-07-06T21:42:15.559557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:44:16.691368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555110+0000","last_change":"2023-07-06T21:42:10.894953+0000","last_active":"2023-07-06T21:42:15.555110+0000","last_peered":"2023-07-06T21:42:15.555110+0000","last_clean":"2023-07-06T21:42:15.555110+0000","last_became_active":"2023-07-06T21:42:10.894746+0000","last_became_peered":"2023-07-06T21:42:10.894746+0000","last_unstale":"2023-07-06T21:42:15.555110+0000","last_undegraded":"2023-07-06T21:42:15.555110+0000","last_fullsized":"2023-07-06T21:42:15.555110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:03.040492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555021+0000","last_change":"2023-07-06T21:42:14.909036+0000","last_active":"2023-07-06T21:42:15.555021+0000","last_peered":"2023-07-06T21:42:15.555021+0000","last_clean":"2023-07-06T21:42:15.555021+0000","last_became_active":"2023-07-06T21:42:14.908620+0000","last_became_peered":"2023-07-06T21:42:14.908620+0000","last_unstale":"2023-07-06T21:42:15.555021+0000","last_undegraded":"2023-07-06T21:42:15.555021+0000","last_fullsized":"2023-07-06T21:42:15.555021+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813952+0000","last_change":"2023-07-06T21:42:10.478777+0000","last_active":"2023-07-06T21:42:15.813952+0000","last_peered":"2023-07-06T21:42:15.813952+0000","last_clean":"2023-07-06T21:42:15.813952+0000","last_became_active":"2023-07-06T21:42:10.478487+0000","last_became_peered":"2023-07-06T21:42:10.478487+0000","last_unstale":"2023-07-06T21:42:15.813952+0000","last_undegraded":"2023-07-06T21:42:15.813952+0000","last_fullsized":"2023-07-06T21:42:15.813952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:02.030132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816172+0000","last_change":"2023-07-06T21:42:10.891356+0000","last_active":"2023-07-06T21:42:15.816172+0000","last_peered":"2023-07-06T21:42:15.816172+0000","last_clean":"2023-07-06T21:42:15.816172+0000","last_became_active":"2023-07-06T21:42:10.890691+0000","last_became_peered":"2023-07-06T21:42:10.890691+0000","last_unstale":"2023-07-06T21:42:15.816172+0000","last_undegraded":"2023-07-06T21:42:15.816172+0000","last_fullsized":"2023-07-06T21:42:15.816172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:49:21.474970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813824+0000","last_change":"2023-07-06T21:42:10.903834+0000","last_active":"2023-07-06T21:42:15.813824+0000","last_peered":"2023-07-06T21:42:15.813824+0000","last_clean":"2023-07-06T21:42:15.813824+0000","last_became_active":"2023-07-06T21:42:10.903529+0000","last_became_peered":"2023-07-06T21:42:10.903529+0000","last_unstale":"2023-07-06T21:42:15.813824+0000","last_undegraded":"2023-07-06T21:42:15.813824+0000","last_fullsized":"2023-07-06T21:42:15.813824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:49.957566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555297+0000","last_change":"2023-07-06T21:42:10.476662+0000","last_active":"2023-07-06T21:42:15.555297+0000","last_peered":"2023-07-06T21:42:15.555297+0000","last_clean":"2023-07-06T21:42:15.555297+0000","last_became_active":"2023-07-06T21:42:10.476371+0000","last_became_peered":"2023-07-06T21:42:10.476371+0000","last_unstale":"2023-07-06T21:42:15.555297+0000","last_undegraded":"2023-07-06T21:42:15.555297+0000","last_fullsized":"2023-07-06T21:42:15.555297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:34.600926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815594+0000","last_change":"2023-07-06T21:42:14.905161+0000","last_active":"2023-07-06T21:42:15.815594+0000","last_peered":"2023-07-06T21:42:15.815594+0000","last_clean":"2023-07-06T21:42:15.815594+0000","last_became_active":"2023-07-06T21:42:14.904772+0000","last_became_peered":"2023-07-06T21:42:14.904772+0000","last_unstale":"2023-07-06T21:42:15.815594+0000","last_undegraded":"2023-07-06T21:42:15.815594+0000","last_fullsized":"2023-07-06T21:42:15.815594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:16:29.182580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813950+0000","last_change":"2023-07-06T21:42:10.886798+0000","last_active":"2023-07-06T21:42:15.813950+0000","last_peered":"2023-07-06T21:42:15.813950+0000","last_clean":"2023-07-06T21:42:15.813950+0000","last_became_active":"2023-07-06T21:42:10.886419+0000","last_became_peered":"2023-07-06T21:42:10.886419+0000","last_unstale":"2023-07-06T21:42:15.813950+0000","last_undegraded":"2023-07-06T21:42:15.813950+0000","last_fullsized":"2023-07-06T21:42:15.813950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:49.304577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750157+0000","last_change":"2023-07-06T21:42:10.470631+0000","last_active":"2023-07-06T21:42:15.750157+0000","last_peered":"2023-07-06T21:42:15.750157+0000","last_clean":"2023-07-06T21:42:15.750157+0000","last_became_active":"2023-07-06T21:42:10.470331+0000","last_became_peered":"2023-07-06T21:42:10.470331+0000","last_unstale":"2023-07-06T21:42:15.750157+0000","last_undegraded":"2023-07-06T21:42:15.750157+0000","last_fullsized":"2023-07-06T21:42:15.750157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:06.172940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302528+0000","last_change":"2023-07-06T21:42:14.905006+0000","last_active":"2023-07-06T21:42:15.302528+0000","last_peered":"2023-07-06T21:42:15.302528+0000","last_clean":"2023-07-06T21:42:15.302528+0000","last_became_active":"2023-07-06T21:42:14.904580+0000","last_became_peered":"2023-07-06T21:42:14.904580+0000","last_unstale":"2023-07-06T21:42:15.302528+0000","last_undegraded":"2023-07-06T21:42:15.302528+0000","last_fullsized":"2023-07-06T21:42:15.302528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304381+0000","last_change":"2023-07-06T21:42:10.472955+0000","last_active":"2023-07-06T21:42:15.304381+0000","last_peered":"2023-07-06T21:42:15.304381+0000","last_clean":"2023-07-06T21:42:15.304381+0000","last_became_active":"2023-07-06T21:42:10.472650+0000","last_became_peered":"2023-07-06T21:42:10.472650+0000","last_unstale":"2023-07-06T21:42:15.304381+0000","last_undegraded":"2023-07-06T21:42:15.304381+0000","last_fullsized":"2023-07-06T21:42:15.304381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:00.320476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559636+0000","last_change":"2023-07-06T21:42:10.895148+0000","last_active":"2023-07-06T21:42:15.559636+0000","last_peered":"2023-07-06T21:42:15.559636+0000","last_clean":"2023-07-06T21:42:15.559636+0000","last_became_active":"2023-07-06T21:42:10.893279+0000","last_became_peered":"2023-07-06T21:42:10.893279+0000","last_unstale":"2023-07-06T21:42:15.559636+0000","last_undegraded":"2023-07-06T21:42:15.559636+0000","last_fullsized":"2023-07-06T21:42:15.559636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:17.881222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814136+0000","last_change":"2023-07-06T21:42:14.923933+0000","last_active":"2023-07-06T21:42:15.814136+0000","last_peered":"2023-07-06T21:42:15.814136+0000","last_clean":"2023-07-06T21:42:15.814136+0000","last_became_active":"2023-07-06T21:42:14.923462+0000","last_became_peered":"2023-07-06T21:42:14.923462+0000","last_unstale":"2023-07-06T21:42:15.814136+0000","last_undegraded":"2023-07-06T21:42:15.814136+0000","last_fullsized":"2023-07-06T21:42:15.814136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:17.532639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:26.997905+0000","last_change":"2023-07-06T21:42:10.477982+0000","last_active":"2023-07-06T21:42:26.997905+0000","last_peered":"2023-07-06T21:42:26.997905+0000","last_clean":"2023-07-06T21:42:26.997905+0000","last_became_active":"2023-07-06T21:42:10.477682+0000","last_became_peered":"2023-07-06T21:42:10.477682+0000","last_unstale":"2023-07-06T21:42:26.997905+0000","last_undegraded":"2023-07-06T21:42:26.997905+0000","last_fullsized":"2023-07-06T21:42:26.997905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:36:40.587024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303762+0000","last_change":"2023-07-06T21:42:10.889884+0000","last_active":"2023-07-06T21:42:15.303762+0000","last_peered":"2023-07-06T21:42:15.303762+0000","last_clean":"2023-07-06T21:42:15.303762+0000","last_became_active":"2023-07-06T21:42:10.889573+0000","last_became_peered":"2023-07-06T21:42:10.889573+0000","last_unstale":"2023-07-06T21:42:15.303762+0000","last_undegraded":"2023-07-06T21:42:15.303762+0000","last_fullsized":"2023-07-06T21:42:15.303762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:19:13.251122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559445+0000","last_change":"2023-07-06T21:42:14.923296+0000","last_active":"2023-07-06T21:42:15.559445+0000","last_peered":"2023-07-06T21:42:15.559445+0000","last_clean":"2023-07-06T21:42:15.559445+0000","last_became_active":"2023-07-06T21:42:14.922887+0000","last_became_peered":"2023-07-06T21:42:14.922887+0000","last_unstale":"2023-07-06T21:42:15.559445+0000","last_undegraded":"2023-07-06T21:42:15.559445+0000","last_fullsized":"2023-07-06T21:42:15.559445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:04:10.970825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302823+0000","last_change":"2023-07-06T21:42:10.885592+0000","last_active":"2023-07-06T21:42:15.302823+0000","last_peered":"2023-07-06T21:42:15.302823+0000","last_clean":"2023-07-06T21:42:15.302823+0000","last_became_active":"2023-07-06T21:42:10.885320+0000","last_became_peered":"2023-07-06T21:42:10.885320+0000","last_unstale":"2023-07-06T21:42:15.302823+0000","last_undegraded":"2023-07-06T21:42:15.302823+0000","last_fullsized":"2023-07-06T21:42:15.302823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:37:33.460049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816166+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:42:15.816166+0000","last_peered":"2023-07-06T21:42:15.816166+0000","last_clean":"2023-07-06T21:42:15.816166+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:42:15.816166+0000","last_undegraded":"2023-07-06T21:42:15.816166+0000","last_fullsized":"2023-07-06T21:42:15.816166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:13:17.470539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555317+0000","last_change":"2023-07-06T21:42:10.483753+0000","last_active":"2023-07-06T21:42:15.555317+0000","last_peered":"2023-07-06T21:42:15.555317+0000","last_clean":"2023-07-06T21:42:15.555317+0000","last_became_active":"2023-07-06T21:42:10.483357+0000","last_became_peered":"2023-07-06T21:42:10.483357+0000","last_unstale":"2023-07-06T21:42:15.555317+0000","last_undegraded":"2023-07-06T21:42:15.555317+0000","last_fullsized":"2023-07-06T21:42:15.555317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:13.091304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813831+0000","last_change":"2023-07-06T21:42:14.904514+0000","last_active":"2023-07-06T21:42:15.813831+0000","last_peered":"2023-07-06T21:42:15.813831+0000","last_clean":"2023-07-06T21:42:15.813831+0000","last_became_active":"2023-07-06T21:42:14.904110+0000","last_became_peered":"2023-07-06T21:42:14.904110+0000","last_unstale":"2023-07-06T21:42:15.813831+0000","last_undegraded":"2023-07-06T21:42:15.813831+0000","last_fullsized":"2023-07-06T21:42:15.813831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813926+0000","last_change":"2023-07-06T21:42:10.886690+0000","last_active":"2023-07-06T21:42:15.813926+0000","last_peered":"2023-07-06T21:42:15.813926+0000","last_clean":"2023-07-06T21:42:15.813926+0000","last_became_active":"2023-07-06T21:42:10.886408+0000","last_became_peered":"2023-07-06T21:42:10.886408+0000","last_unstale":"2023-07-06T21:42:15.813926+0000","last_undegraded":"2023-07-06T21:42:15.813926+0000","last_fullsized":"2023-07-06T21:42:15.813926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:21.307899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560489+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:42:15.560489+0000","last_peered":"2023-07-06T21:42:15.560489+0000","last_clean":"2023-07-06T21:42:15.560489+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:42:15.560489+0000","last_undegraded":"2023-07-06T21:42:15.560489+0000","last_fullsized":"2023-07-06T21:42:15.560489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:32.217200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814738+0000","last_change":"2023-07-06T21:42:10.477099+0000","last_active":"2023-07-06T21:42:15.814738+0000","last_peered":"2023-07-06T21:42:15.814738+0000","last_clean":"2023-07-06T21:42:15.814738+0000","last_became_active":"2023-07-06T21:42:10.470849+0000","last_became_peered":"2023-07-06T21:42:10.470849+0000","last_unstale":"2023-07-06T21:42:15.814738+0000","last_undegraded":"2023-07-06T21:42:15.814738+0000","last_fullsized":"2023-07-06T21:42:15.814738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:01:27.903386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302507+0000","last_change":"2023-07-06T21:42:14.912597+0000","last_active":"2023-07-06T21:42:15.302507+0000","last_peered":"2023-07-06T21:42:15.302507+0000","last_clean":"2023-07-06T21:42:15.302507+0000","last_became_active":"2023-07-06T21:42:14.912117+0000","last_became_peered":"2023-07-06T21:42:14.912117+0000","last_unstale":"2023-07-06T21:42:15.302507+0000","last_undegraded":"2023-07-06T21:42:15.302507+0000","last_fullsized":"2023-07-06T21:42:15.302507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:04:25.768388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554791+0000","last_change":"2023-07-06T21:42:10.887381+0000","last_active":"2023-07-06T21:42:15.554791+0000","last_peered":"2023-07-06T21:42:15.554791+0000","last_clean":"2023-07-06T21:42:15.554791+0000","last_became_active":"2023-07-06T21:42:10.887098+0000","last_became_peered":"2023-07-06T21:42:10.887098+0000","last_unstale":"2023-07-06T21:42:15.554791+0000","last_undegraded":"2023-07-06T21:42:15.554791+0000","last_fullsized":"2023-07-06T21:42:15.554791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:22:58.629015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304566+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:42:15.304566+0000","last_peered":"2023-07-06T21:42:15.304566+0000","last_clean":"2023-07-06T21:42:15.304566+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:42:15.304566+0000","last_undegraded":"2023-07-06T21:42:15.304566+0000","last_fullsized":"2023-07-06T21:42:15.304566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:18:08.789205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560028+0000","last_change":"2023-07-06T21:42:10.470119+0000","last_active":"2023-07-06T21:42:15.560028+0000","last_peered":"2023-07-06T21:42:15.560028+0000","last_clean":"2023-07-06T21:42:15.560028+0000","last_became_active":"2023-07-06T21:42:10.469842+0000","last_became_peered":"2023-07-06T21:42:10.469842+0000","last_unstale":"2023-07-06T21:42:15.560028+0000","last_undegraded":"2023-07-06T21:42:15.560028+0000","last_fullsized":"2023-07-06T21:42:15.560028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:22:57.618655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815713+0000","last_change":"2023-07-06T21:42:14.922150+0000","last_active":"2023-07-06T21:42:15.815713+0000","last_peered":"2023-07-06T21:42:15.815713+0000","last_clean":"2023-07-06T21:42:15.815713+0000","last_became_active":"2023-07-06T21:42:14.921680+0000","last_became_peered":"2023-07-06T21:42:14.921680+0000","last_unstale":"2023-07-06T21:42:15.815713+0000","last_undegraded":"2023-07-06T21:42:15.815713+0000","last_fullsized":"2023-07-06T21:42:15.815713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:25:46.342686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559647+0000","last_change":"2023-07-06T21:42:10.895224+0000","last_active":"2023-07-06T21:42:15.559647+0000","last_peered":"2023-07-06T21:42:15.559647+0000","last_clean":"2023-07-06T21:42:15.559647+0000","last_became_active":"2023-07-06T21:42:10.893294+0000","last_became_peered":"2023-07-06T21:42:10.893294+0000","last_unstale":"2023-07-06T21:42:15.559647+0000","last_undegraded":"2023-07-06T21:42:15.559647+0000","last_fullsized":"2023-07-06T21:42:15.559647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:06:12.963913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560146+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:42:15.560146+0000","last_peered":"2023-07-06T21:42:15.560146+0000","last_clean":"2023-07-06T21:42:15.560146+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:42:15.560146+0000","last_undegraded":"2023-07-06T21:42:15.560146+0000","last_fullsized":"2023-07-06T21:42:15.560146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:26:57.147498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750089+0000","last_change":"2023-07-06T21:42:10.479311+0000","last_active":"2023-07-06T21:42:15.750089+0000","last_peered":"2023-07-06T21:42:15.750089+0000","last_clean":"2023-07-06T21:42:15.750089+0000","last_became_active":"2023-07-06T21:42:10.478999+0000","last_became_peered":"2023-07-06T21:42:10.478999+0000","last_unstale":"2023-07-06T21:42:15.750089+0000","last_undegraded":"2023-07-06T21:42:15.750089+0000","last_fullsized":"2023-07-06T21:42:15.750089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:15:16.029351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554783+0000","last_change":"2023-07-06T21:42:14.924362+0000","last_active":"2023-07-06T21:42:15.554783+0000","last_peered":"2023-07-06T21:42:15.554783+0000","last_clean":"2023-07-06T21:42:15.554783+0000","last_became_active":"2023-07-06T21:42:14.924003+0000","last_became_peered":"2023-07-06T21:42:14.924003+0000","last_unstale":"2023-07-06T21:42:15.554783+0000","last_undegraded":"2023-07-06T21:42:15.554783+0000","last_fullsized":"2023-07-06T21:42:15.554783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:30:36.626428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559964+0000","last_change":"2023-07-06T21:42:10.901083+0000","last_active":"2023-07-06T21:42:15.559964+0000","last_peered":"2023-07-06T21:42:15.559964+0000","last_clean":"2023-07-06T21:42:15.559964+0000","last_became_active":"2023-07-06T21:42:10.900454+0000","last_became_peered":"2023-07-06T21:42:10.900454+0000","last_unstale":"2023-07-06T21:42:15.559964+0000","last_undegraded":"2023-07-06T21:42:15.559964+0000","last_fullsized":"2023-07-06T21:42:15.559964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:30:33.195452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303877+0000","last_change":"2023-07-06T21:42:10.487423+0000","last_active":"2023-07-06T21:42:15.303877+0000","last_peered":"2023-07-06T21:42:15.303877+0000","last_clean":"2023-07-06T21:42:15.303877+0000","last_became_active":"2023-07-06T21:42:10.487178+0000","last_became_peered":"2023-07-06T21:42:10.487178+0000","last_unstale":"2023-07-06T21:42:15.303877+0000","last_undegraded":"2023-07-06T21:42:15.303877+0000","last_fullsized":"2023-07-06T21:42:15.303877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:27:27.820824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749519+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:42:15.749519+0000","last_peered":"2023-07-06T21:42:15.749519+0000","last_clean":"2023-07-06T21:42:15.749519+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:42:15.749519+0000","last_undegraded":"2023-07-06T21:42:15.749519+0000","last_fullsized":"2023-07-06T21:42:15.749519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:32.217200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555060+0000","last_change":"2023-07-06T21:42:14.916163+0000","last_active":"2023-07-06T21:42:15.555060+0000","last_peered":"2023-07-06T21:42:15.555060+0000","last_clean":"2023-07-06T21:42:15.555060+0000","last_became_active":"2023-07-06T21:42:14.915664+0000","last_became_peered":"2023-07-06T21:42:14.915664+0000","last_unstale":"2023-07-06T21:42:15.555060+0000","last_undegraded":"2023-07-06T21:42:15.555060+0000","last_fullsized":"2023-07-06T21:42:15.555060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:53.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.561394+0000","last_change":"2023-07-06T21:42:10.892520+0000","last_active":"2023-07-06T21:42:15.561394+0000","last_peered":"2023-07-06T21:42:15.561394+0000","last_clean":"2023-07-06T21:42:15.561394+0000","last_became_active":"2023-07-06T21:42:10.892199+0000","last_became_peered":"2023-07-06T21:42:10.892199+0000","last_unstale":"2023-07-06T21:42:15.561394+0000","last_undegraded":"2023-07-06T21:42:15.561394+0000","last_fullsized":"2023-07-06T21:42:15.561394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:03.040492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559437+0000","last_change":"2023-07-06T21:42:10.469013+0000","last_active":"2023-07-06T21:42:15.559437+0000","last_peered":"2023-07-06T21:42:15.559437+0000","last_clean":"2023-07-06T21:42:15.559437+0000","last_became_active":"2023-07-06T21:42:10.468725+0000","last_became_peered":"2023-07-06T21:42:10.468725+0000","last_unstale":"2023-07-06T21:42:15.559437+0000","last_undegraded":"2023-07-06T21:42:15.559437+0000","last_fullsized":"2023-07-06T21:42:15.559437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:20:16.016382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300174+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:42:15.300174+0000","last_peered":"2023-07-06T21:42:15.300174+0000","last_clean":"2023-07-06T21:42:15.300174+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:42:15.300174+0000","last_undegraded":"2023-07-06T21:42:15.300174+0000","last_fullsized":"2023-07-06T21:42:15.300174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:47:26.819677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300599+0000","last_change":"2023-07-06T21:42:14.924328+0000","last_active":"2023-07-06T21:42:15.300599+0000","last_peered":"2023-07-06T21:42:15.300599+0000","last_clean":"2023-07-06T21:42:15.300599+0000","last_became_active":"2023-07-06T21:42:14.923899+0000","last_became_peered":"2023-07-06T21:42:14.923899+0000","last_unstale":"2023-07-06T21:42:15.300599+0000","last_undegraded":"2023-07-06T21:42:15.300599+0000","last_fullsized":"2023-07-06T21:42:15.300599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:54:26.653941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555110+0000","last_change":"2023-07-06T21:42:10.903093+0000","last_active":"2023-07-06T21:42:15.555110+0000","last_peered":"2023-07-06T21:42:15.555110+0000","last_clean":"2023-07-06T21:42:15.555110+0000","last_became_active":"2023-07-06T21:42:10.902859+0000","last_became_peered":"2023-07-06T21:42:10.902859+0000","last_unstale":"2023-07-06T21:42:15.555110+0000","last_undegraded":"2023-07-06T21:42:15.555110+0000","last_fullsized":"2023-07-06T21:42:15.555110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:21.307899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554542+0000","last_change":"2023-07-06T21:42:10.483697+0000","last_active":"2023-07-06T21:42:15.554542+0000","last_peered":"2023-07-06T21:42:15.554542+0000","last_clean":"2023-07-06T21:42:15.554542+0000","last_became_active":"2023-07-06T21:42:10.483326+0000","last_became_peered":"2023-07-06T21:42:10.483326+0000","last_unstale":"2023-07-06T21:42:15.554542+0000","last_undegraded":"2023-07-06T21:42:15.554542+0000","last_fullsized":"2023-07-06T21:42:15.554542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:06:11.953553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302786+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:42:15.302786+0000","last_peered":"2023-07-06T21:42:15.302786+0000","last_clean":"2023-07-06T21:42:15.302786+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:42:15.302786+0000","last_undegraded":"2023-07-06T21:42:15.302786+0000","last_fullsized":"2023-07-06T21:42:15.302786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:43.907805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749963+0000","last_change":"2023-07-06T21:42:14.922451+0000","last_active":"2023-07-06T21:42:15.749963+0000","last_peered":"2023-07-06T21:42:15.749963+0000","last_clean":"2023-07-06T21:42:15.749963+0000","last_became_active":"2023-07-06T21:42:14.922047+0000","last_became_peered":"2023-07-06T21:42:14.922047+0000","last_unstale":"2023-07-06T21:42:15.749963+0000","last_undegraded":"2023-07-06T21:42:15.749963+0000","last_fullsized":"2023-07-06T21:42:15.749963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:04.761811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816094+0000","last_change":"2023-07-06T21:42:10.892446+0000","last_active":"2023-07-06T21:42:15.816094+0000","last_peered":"2023-07-06T21:42:15.816094+0000","last_clean":"2023-07-06T21:42:15.816094+0000","last_became_active":"2023-07-06T21:42:10.892161+0000","last_became_peered":"2023-07-06T21:42:10.892161+0000","last_unstale":"2023-07-06T21:42:15.816094+0000","last_undegraded":"2023-07-06T21:42:15.816094+0000","last_fullsized":"2023-07-06T21:42:15.816094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:16:28.548015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814063+0000","last_change":"2023-07-06T21:42:10.477978+0000","last_active":"2023-07-06T21:42:15.814063+0000","last_peered":"2023-07-06T21:42:15.814063+0000","last_clean":"2023-07-06T21:42:15.814063+0000","last_became_active":"2023-07-06T21:42:10.477741+0000","last_became_peered":"2023-07-06T21:42:10.477741+0000","last_unstale":"2023-07-06T21:42:15.814063+0000","last_undegraded":"2023-07-06T21:42:15.814063+0000","last_fullsized":"2023-07-06T21:42:15.814063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:53.942428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749582+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:42:15.749582+0000","last_peered":"2023-07-06T21:42:15.749582+0000","last_clean":"2023-07-06T21:42:15.749582+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:42:15.749582+0000","last_undegraded":"2023-07-06T21:42:15.749582+0000","last_fullsized":"2023-07-06T21:42:15.749582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:15.258138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302930+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:42:15.302930+0000","last_peered":"2023-07-06T21:42:15.302930+0000","last_clean":"2023-07-06T21:42:15.302930+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:42:15.302930+0000","last_undegraded":"2023-07-06T21:42:15.302930+0000","last_fullsized":"2023-07-06T21:42:15.302930+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:25.978867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304188+0000","last_change":"2023-07-06T21:42:14.922337+0000","last_active":"2023-07-06T21:42:15.304188+0000","last_peered":"2023-07-06T21:42:15.304188+0000","last_clean":"2023-07-06T21:42:15.304188+0000","last_became_active":"2023-07-06T21:42:14.921707+0000","last_became_peered":"2023-07-06T21:42:14.921707+0000","last_unstale":"2023-07-06T21:42:15.304188+0000","last_undegraded":"2023-07-06T21:42:15.304188+0000","last_fullsized":"2023-07-06T21:42:15.304188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:10.982651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.561390+0000","last_change":"2023-07-06T21:42:10.895068+0000","last_active":"2023-07-06T21:42:15.561390+0000","last_peered":"2023-07-06T21:42:15.561390+0000","last_clean":"2023-07-06T21:42:15.561390+0000","last_became_active":"2023-07-06T21:42:10.893118+0000","last_became_peered":"2023-07-06T21:42:10.893118+0000","last_unstale":"2023-07-06T21:42:15.561390+0000","last_undegraded":"2023-07-06T21:42:15.561390+0000","last_fullsized":"2023-07-06T21:42:15.561390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:49.304577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814064+0000","last_change":"2023-07-06T21:42:10.477723+0000","last_active":"2023-07-06T21:42:15.814064+0000","last_peered":"2023-07-06T21:42:15.814064+0000","last_clean":"2023-07-06T21:42:15.814064+0000","last_became_active":"2023-07-06T21:42:10.477458+0000","last_became_peered":"2023-07-06T21:42:10.477458+0000","last_unstale":"2023-07-06T21:42:15.814064+0000","last_undegraded":"2023-07-06T21:42:15.814064+0000","last_fullsized":"2023-07-06T21:42:15.814064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:37.773277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304476+0000","last_change":"2023-07-06T21:42:14.916934+0000","last_active":"2023-07-06T21:42:15.304476+0000","last_peered":"2023-07-06T21:42:15.304476+0000","last_clean":"2023-07-06T21:42:15.304476+0000","last_became_active":"2023-07-06T21:42:14.916426+0000","last_became_peered":"2023-07-06T21:42:14.916426+0000","last_unstale":"2023-07-06T21:42:15.304476+0000","last_undegraded":"2023-07-06T21:42:15.304476+0000","last_fullsized":"2023-07-06T21:42:15.304476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:59:26.819910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304570+0000","last_change":"2023-07-06T21:42:10.883910+0000","last_active":"2023-07-06T21:42:15.304570+0000","last_peered":"2023-07-06T21:42:15.304570+0000","last_clean":"2023-07-06T21:42:15.304570+0000","last_became_active":"2023-07-06T21:42:10.881813+0000","last_became_peered":"2023-07-06T21:42:10.881813+0000","last_unstale":"2023-07-06T21:42:15.304570+0000","last_undegraded":"2023-07-06T21:42:15.304570+0000","last_fullsized":"2023-07-06T21:42:15.304570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:35:26.163278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302957+0000","last_change":"2023-07-06T21:42:10.476748+0000","last_active":"2023-07-06T21:42:15.302957+0000","last_peered":"2023-07-06T21:42:15.302957+0000","last_clean":"2023-07-06T21:42:15.302957+0000","last_became_active":"2023-07-06T21:42:10.476481+0000","last_became_peered":"2023-07-06T21:42:10.476481+0000","last_unstale":"2023-07-06T21:42:15.302957+0000","last_undegraded":"2023-07-06T21:42:15.302957+0000","last_fullsized":"2023-07-06T21:42:15.302957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:44:25.975479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749892+0000","last_change":"2023-07-06T21:42:14.921688+0000","last_active":"2023-07-06T21:42:15.749892+0000","last_peered":"2023-07-06T21:42:15.749892+0000","last_clean":"2023-07-06T21:42:15.749892+0000","last_became_active":"2023-07-06T21:42:14.921265+0000","last_became_peered":"2023-07-06T21:42:14.921265+0000","last_unstale":"2023-07-06T21:42:15.749892+0000","last_undegraded":"2023-07-06T21:42:15.749892+0000","last_fullsized":"2023-07-06T21:42:15.749892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:39.042261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304373+0000","last_change":"2023-07-06T21:42:10.878847+0000","last_active":"2023-07-06T21:42:15.304373+0000","last_peered":"2023-07-06T21:42:15.304373+0000","last_clean":"2023-07-06T21:42:15.304373+0000","last_became_active":"2023-07-06T21:42:10.878527+0000","last_became_peered":"2023-07-06T21:42:10.878527+0000","last_unstale":"2023-07-06T21:42:15.304373+0000","last_undegraded":"2023-07-06T21:42:15.304373+0000","last_fullsized":"2023-07-06T21:42:15.304373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:16:10.597271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815959+0000","last_change":"2023-07-06T21:42:10.477879+0000","last_active":"2023-07-06T21:42:15.815959+0000","last_peered":"2023-07-06T21:42:15.815959+0000","last_clean":"2023-07-06T21:42:15.815959+0000","last_became_active":"2023-07-06T21:42:10.477581+0000","last_became_peered":"2023-07-06T21:42:10.477581+0000","last_unstale":"2023-07-06T21:42:15.815959+0000","last_undegraded":"2023-07-06T21:42:15.815959+0000","last_fullsized":"2023-07-06T21:42:15.815959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:44:19.088837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559764+0000","last_change":"2023-07-06T21:42:14.911992+0000","last_active":"2023-07-06T21:42:15.559764+0000","last_peered":"2023-07-06T21:42:15.559764+0000","last_clean":"2023-07-06T21:42:15.559764+0000","last_became_active":"2023-07-06T21:42:14.911568+0000","last_became_peered":"2023-07-06T21:42:14.911568+0000","last_unstale":"2023-07-06T21:42:15.559764+0000","last_undegraded":"2023-07-06T21:42:15.559764+0000","last_fullsized":"2023-07-06T21:42:15.559764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:20:11.252422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303859+0000","last_change":"2023-07-06T21:42:10.883052+0000","last_active":"2023-07-06T21:42:15.303859+0000","last_peered":"2023-07-06T21:42:15.303859+0000","last_clean":"2023-07-06T21:42:15.303859+0000","last_became_active":"2023-07-06T21:42:10.882252+0000","last_became_peered":"2023-07-06T21:42:10.882252+0000","last_unstale":"2023-07-06T21:42:15.303859+0000","last_undegraded":"2023-07-06T21:42:15.303859+0000","last_fullsized":"2023-07-06T21:42:15.303859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:24:28.967556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814372+0000","last_change":"2023-07-06T21:42:10.483767+0000","last_active":"2023-07-06T21:42:15.814372+0000","last_peered":"2023-07-06T21:42:15.814372+0000","last_clean":"2023-07-06T21:42:15.814372+0000","last_became_active":"2023-07-06T21:42:10.483507+0000","last_became_peered":"2023-07-06T21:42:10.483507+0000","last_unstale":"2023-07-06T21:42:15.814372+0000","last_undegraded":"2023-07-06T21:42:15.814372+0000","last_fullsized":"2023-07-06T21:42:15.814372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:18:13.828606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300565+0000","last_change":"2023-07-06T21:42:14.923194+0000","last_active":"2023-07-06T21:42:15.300565+0000","last_peered":"2023-07-06T21:42:15.300565+0000","last_clean":"2023-07-06T21:42:15.300565+0000","last_became_active":"2023-07-06T21:42:14.922520+0000","last_became_peered":"2023-07-06T21:42:14.922520+0000","last_unstale":"2023-07-06T21:42:15.300565+0000","last_undegraded":"2023-07-06T21:42:15.300565+0000","last_fullsized":"2023-07-06T21:42:15.300565+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:03:38.532050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554692+0000","last_change":"2023-07-06T21:42:10.896528+0000","last_active":"2023-07-06T21:42:15.554692+0000","last_peered":"2023-07-06T21:42:15.554692+0000","last_clean":"2023-07-06T21:42:15.554692+0000","last_became_active":"2023-07-06T21:42:10.896260+0000","last_became_peered":"2023-07-06T21:42:10.896260+0000","last_unstale":"2023-07-06T21:42:15.554692+0000","last_undegraded":"2023-07-06T21:42:15.554692+0000","last_fullsized":"2023-07-06T21:42:15.554692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:20:07.821447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749689+0000","last_change":"2023-07-06T21:42:10.467430+0000","last_active":"2023-07-06T21:42:15.749689+0000","last_peered":"2023-07-06T21:42:15.749689+0000","last_clean":"2023-07-06T21:42:15.749689+0000","last_became_active":"2023-07-06T21:42:10.467147+0000","last_became_peered":"2023-07-06T21:42:10.467147+0000","last_unstale":"2023-07-06T21:42:15.749689+0000","last_undegraded":"2023-07-06T21:42:15.749689+0000","last_fullsized":"2023-07-06T21:42:15.749689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:48.294217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300352+0000","last_change":"2023-07-06T21:42:14.911007+0000","last_active":"2023-07-06T21:42:15.300352+0000","last_peered":"2023-07-06T21:42:15.300352+0000","last_clean":"2023-07-06T21:42:15.300352+0000","last_became_active":"2023-07-06T21:42:14.910352+0000","last_became_peered":"2023-07-06T21:42:14.910352+0000","last_unstale":"2023-07-06T21:42:15.300352+0000","last_undegraded":"2023-07-06T21:42:15.300352+0000","last_fullsized":"2023-07-06T21:42:15.300352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:32:51.766704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815617+0000","last_change":"2023-07-06T21:42:10.903614+0000","last_active":"2023-07-06T21:42:15.815617+0000","last_peered":"2023-07-06T21:42:15.815617+0000","last_clean":"2023-07-06T21:42:15.815617+0000","last_became_active":"2023-07-06T21:42:10.903258+0000","last_became_peered":"2023-07-06T21:42:10.903258+0000","last_unstale":"2023-07-06T21:42:15.815617+0000","last_undegraded":"2023-07-06T21:42:15.815617+0000","last_fullsized":"2023-07-06T21:42:15.815617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:58:56.102496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304481+0000","last_change":"2023-07-06T21:42:10.472497+0000","last_active":"2023-07-06T21:42:15.304481+0000","last_peered":"2023-07-06T21:42:15.304481+0000","last_clean":"2023-07-06T21:42:15.304481+0000","last_became_active":"2023-07-06T21:42:10.470849+0000","last_became_peered":"2023-07-06T21:42:10.470849+0000","last_unstale":"2023-07-06T21:42:15.304481+0000","last_undegraded":"2023-07-06T21:42:15.304481+0000","last_fullsized":"2023-07-06T21:42:15.304481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:28.818997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300483+0000","last_change":"2023-07-06T21:42:14.927494+0000","last_active":"2023-07-06T21:42:15.300483+0000","last_peered":"2023-07-06T21:42:15.300483+0000","last_clean":"2023-07-06T21:42:15.300483+0000","last_became_active":"2023-07-06T21:42:14.927091+0000","last_became_peered":"2023-07-06T21:42:14.927091+0000","last_unstale":"2023-07-06T21:42:15.300483+0000","last_undegraded":"2023-07-06T21:42:15.300483+0000","last_fullsized":"2023-07-06T21:42:15.300483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:28:09.964167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302682+0000","last_change":"2023-07-06T21:42:10.900898+0000","last_active":"2023-07-06T21:42:15.302682+0000","last_peered":"2023-07-06T21:42:15.302682+0000","last_clean":"2023-07-06T21:42:15.302682+0000","last_became_active":"2023-07-06T21:42:10.900581+0000","last_became_peered":"2023-07-06T21:42:10.900581+0000","last_unstale":"2023-07-06T21:42:15.302682+0000","last_undegraded":"2023-07-06T21:42:15.302682+0000","last_fullsized":"2023-07-06T21:42:15.302682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:06:29.601787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304774+0000","last_change":"2023-07-06T21:42:10.481348+0000","last_active":"2023-07-06T21:42:15.304774+0000","last_peered":"2023-07-06T21:42:15.304774+0000","last_clean":"2023-07-06T21:42:15.304774+0000","last_became_active":"2023-07-06T21:42:10.480900+0000","last_became_peered":"2023-07-06T21:42:10.480900+0000","last_unstale":"2023-07-06T21:42:15.304774+0000","last_undegraded":"2023-07-06T21:42:15.304774+0000","last_fullsized":"2023-07-06T21:42:15.304774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:25.448002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300082+0000","last_change":"2023-07-06T21:42:14.910719+0000","last_active":"2023-07-06T21:42:15.300082+0000","last_peered":"2023-07-06T21:42:15.300082+0000","last_clean":"2023-07-06T21:42:15.300082+0000","last_became_active":"2023-07-06T21:42:14.910213+0000","last_became_peered":"2023-07-06T21:42:14.910213+0000","last_unstale":"2023-07-06T21:42:15.300082+0000","last_undegraded":"2023-07-06T21:42:15.300082+0000","last_fullsized":"2023-07-06T21:42:15.300082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:11:34.554961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749271+0000","last_change":"2023-07-06T21:42:10.899721+0000","last_active":"2023-07-06T21:42:15.749271+0000","last_peered":"2023-07-06T21:42:15.749271+0000","last_clean":"2023-07-06T21:42:15.749271+0000","last_became_active":"2023-07-06T21:42:10.896792+0000","last_became_peered":"2023-07-06T21:42:10.896792+0000","last_unstale":"2023-07-06T21:42:15.749271+0000","last_undegraded":"2023-07-06T21:42:15.749271+0000","last_fullsized":"2023-07-06T21:42:15.749271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:36.353661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304883+0000","last_change":"2023-07-06T21:42:10.479043+0000","last_active":"2023-07-06T21:42:15.304883+0000","last_peered":"2023-07-06T21:42:15.304883+0000","last_clean":"2023-07-06T21:42:15.304883+0000","last_became_active":"2023-07-06T21:42:10.478756+0000","last_became_peered":"2023-07-06T21:42:10.478756+0000","last_unstale":"2023-07-06T21:42:15.304883+0000","last_undegraded":"2023-07-06T21:42:15.304883+0000","last_fullsized":"2023-07-06T21:42:15.304883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:15:16.029351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303391+0000","last_change":"2023-07-06T21:42:14.903165+0000","last_active":"2023-07-06T21:42:15.303391+0000","last_peered":"2023-07-06T21:42:15.303391+0000","last_clean":"2023-07-06T21:42:15.303391+0000","last_became_active":"2023-07-06T21:42:14.902418+0000","last_became_peered":"2023-07-06T21:42:14.902418+0000","last_unstale":"2023-07-06T21:42:15.303391+0000","last_undegraded":"2023-07-06T21:42:15.303391+0000","last_fullsized":"2023-07-06T21:42:15.303391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:06.471467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749820+0000","last_change":"2023-07-06T21:42:14.923545+0000","last_active":"2023-07-06T21:42:15.749820+0000","last_peered":"2023-07-06T21:42:15.749820+0000","last_clean":"2023-07-06T21:42:15.749820+0000","last_became_active":"2023-07-06T21:42:14.922278+0000","last_became_peered":"2023-07-06T21:42:14.922278+0000","last_unstale":"2023-07-06T21:42:15.749820+0000","last_undegraded":"2023-07-06T21:42:15.749820+0000","last_fullsized":"2023-07-06T21:42:15.749820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:58.383763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815663+0000","last_change":"2023-07-06T21:42:10.477503+0000","last_active":"2023-07-06T21:42:15.815663+0000","last_peered":"2023-07-06T21:42:15.815663+0000","last_clean":"2023-07-06T21:42:15.815663+0000","last_became_active":"2023-07-06T21:42:10.477166+0000","last_became_peered":"2023-07-06T21:42:10.477166+0000","last_unstale":"2023-07-06T21:42:15.815663+0000","last_undegraded":"2023-07-06T21:42:15.815663+0000","last_fullsized":"2023-07-06T21:42:15.815663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:25:12.585223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814704+0000","last_change":"2023-07-06T21:42:10.897513+0000","last_active":"2023-07-06T21:42:15.814704+0000","last_peered":"2023-07-06T21:42:15.814704+0000","last_clean":"2023-07-06T21:42:15.814704+0000","last_became_active":"2023-07-06T21:42:10.897114+0000","last_became_peered":"2023-07-06T21:42:10.897114+0000","last_unstale":"2023-07-06T21:42:15.814704+0000","last_undegraded":"2023-07-06T21:42:15.814704+0000","last_fullsized":"2023-07-06T21:42:15.814704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:39:47.681666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814620+0000","last_change":"2023-07-06T21:42:14.904372+0000","last_active":"2023-07-06T21:42:15.814620+0000","last_peered":"2023-07-06T21:42:15.814620+0000","last_clean":"2023-07-06T21:42:15.814620+0000","last_became_active":"2023-07-06T21:42:14.904023+0000","last_became_peered":"2023-07-06T21:42:14.904023+0000","last_unstale":"2023-07-06T21:42:15.814620+0000","last_undegraded":"2023-07-06T21:42:15.814620+0000","last_fullsized":"2023-07-06T21:42:15.814620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:10.614275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303576+0000","last_change":"2023-07-06T21:42:10.478297+0000","last_active":"2023-07-06T21:42:15.303576+0000","last_peered":"2023-07-06T21:42:15.303576+0000","last_clean":"2023-07-06T21:42:15.303576+0000","last_became_active":"2023-07-06T21:42:10.478050+0000","last_became_peered":"2023-07-06T21:42:10.478050+0000","last_unstale":"2023-07-06T21:42:15.303576+0000","last_undegraded":"2023-07-06T21:42:15.303576+0000","last_fullsized":"2023-07-06T21:42:15.303576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:53.942428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555359+0000","last_change":"2023-07-06T21:42:10.883887+0000","last_active":"2023-07-06T21:42:15.555359+0000","last_peered":"2023-07-06T21:42:15.555359+0000","last_clean":"2023-07-06T21:42:15.555359+0000","last_became_active":"2023-07-06T21:42:10.883644+0000","last_became_peered":"2023-07-06T21:42:10.883644+0000","last_unstale":"2023-07-06T21:42:15.555359+0000","last_undegraded":"2023-07-06T21:42:15.555359+0000","last_fullsized":"2023-07-06T21:42:15.555359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:07.551676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554791+0000","last_change":"2023-07-06T21:42:10.476173+0000","last_active":"2023-07-06T21:42:15.554791+0000","last_peered":"2023-07-06T21:42:15.554791+0000","last_clean":"2023-07-06T21:42:15.554791+0000","last_became_active":"2023-07-06T21:42:10.475802+0000","last_became_peered":"2023-07-06T21:42:10.475802+0000","last_unstale":"2023-07-06T21:42:15.554791+0000","last_undegraded":"2023-07-06T21:42:15.554791+0000","last_fullsized":"2023-07-06T21:42:15.554791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:39.285403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749898+0000","last_change":"2023-07-06T21:42:10.905138+0000","last_active":"2023-07-06T21:42:15.749898+0000","last_peered":"2023-07-06T21:42:15.749898+0000","last_clean":"2023-07-06T21:42:15.749898+0000","last_became_active":"2023-07-06T21:42:10.904460+0000","last_became_peered":"2023-07-06T21:42:10.904460+0000","last_unstale":"2023-07-06T21:42:15.749898+0000","last_undegraded":"2023-07-06T21:42:15.749898+0000","last_fullsized":"2023-07-06T21:42:15.749898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:07.551676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814399+0000","last_change":"2023-07-06T21:42:14.906570+0000","last_active":"2023-07-06T21:42:15.814399+0000","last_peered":"2023-07-06T21:42:15.814399+0000","last_clean":"2023-07-06T21:42:15.814399+0000","last_became_active":"2023-07-06T21:42:14.906136+0000","last_became_peered":"2023-07-06T21:42:14.906136+0000","last_unstale":"2023-07-06T21:42:15.814399+0000","last_undegraded":"2023-07-06T21:42:15.814399+0000","last_fullsized":"2023-07-06T21:42:15.814399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:33.260332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304098+0000","last_change":"2023-07-06T21:42:10.478474+0000","last_active":"2023-07-06T21:42:15.304098+0000","last_peered":"2023-07-06T21:42:15.304098+0000","last_clean":"2023-07-06T21:42:15.304098+0000","last_became_active":"2023-07-06T21:42:10.478162+0000","last_became_peered":"2023-07-06T21:42:10.478162+0000","last_unstale":"2023-07-06T21:42:15.304098+0000","last_undegraded":"2023-07-06T21:42:15.304098+0000","last_fullsized":"2023-07-06T21:42:15.304098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:34.600926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814456+0000","last_change":"2023-07-06T21:42:10.903800+0000","last_active":"2023-07-06T21:42:15.814456+0000","last_peered":"2023-07-06T21:42:15.814456+0000","last_clean":"2023-07-06T21:42:15.814456+0000","last_became_active":"2023-07-06T21:42:10.903469+0000","last_became_peered":"2023-07-06T21:42:10.903469+0000","last_unstale":"2023-07-06T21:42:15.814456+0000","last_undegraded":"2023-07-06T21:42:15.814456+0000","last_fullsized":"2023-07-06T21:42:15.814456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:26.458362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749752+0000","last_change":"2023-07-06T21:42:14.916210+0000","last_active":"2023-07-06T21:42:15.749752+0000","last_peered":"2023-07-06T21:42:15.749752+0000","last_clean":"2023-07-06T21:42:15.749752+0000","last_became_active":"2023-07-06T21:42:14.915845+0000","last_became_peered":"2023-07-06T21:42:14.915845+0000","last_unstale":"2023-07-06T21:42:15.749752+0000","last_undegraded":"2023-07-06T21:42:15.749752+0000","last_fullsized":"2023-07-06T21:42:15.749752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:42.214612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815466+0000","last_change":"2023-07-06T21:42:10.887152+0000","last_active":"2023-07-06T21:42:15.815466+0000","last_peered":"2023-07-06T21:42:15.815466+0000","last_clean":"2023-07-06T21:42:15.815466+0000","last_became_active":"2023-07-06T21:42:10.881872+0000","last_became_peered":"2023-07-06T21:42:10.881872+0000","last_unstale":"2023-07-06T21:42:15.815466+0000","last_undegraded":"2023-07-06T21:42:15.815466+0000","last_fullsized":"2023-07-06T21:42:15.815466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:18:00.557093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813877+0000","last_change":"2023-07-06T21:42:10.899839+0000","last_active":"2023-07-06T21:42:15.813877+0000","last_peered":"2023-07-06T21:42:15.813877+0000","last_clean":"2023-07-06T21:42:15.813877+0000","last_became_active":"2023-07-06T21:42:10.899525+0000","last_became_peered":"2023-07-06T21:42:10.899525+0000","last_unstale":"2023-07-06T21:42:15.813877+0000","last_undegraded":"2023-07-06T21:42:15.813877+0000","last_fullsized":"2023-07-06T21:42:15.813877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:38.266961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303319+0000","last_change":"2023-07-06T21:42:10.893778+0000","last_active":"2023-07-06T21:42:15.303319+0000","last_peered":"2023-07-06T21:42:15.303319+0000","last_clean":"2023-07-06T21:42:15.303319+0000","last_became_active":"2023-07-06T21:42:10.893495+0000","last_became_peered":"2023-07-06T21:42:10.893495+0000","last_unstale":"2023-07-06T21:42:15.303319+0000","last_undegraded":"2023-07-06T21:42:15.303319+0000","last_fullsized":"2023-07-06T21:42:15.303319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:05:56.844228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814245+0000","last_change":"2023-07-06T21:42:10.898297+0000","last_active":"2023-07-06T21:42:15.814245+0000","last_peered":"2023-07-06T21:42:15.814245+0000","last_clean":"2023-07-06T21:42:15.814245+0000","last_became_active":"2023-07-06T21:42:10.897968+0000","last_became_peered":"2023-07-06T21:42:10.897968+0000","last_unstale":"2023-07-06T21:42:15.814245+0000","last_undegraded":"2023-07-06T21:42:15.814245+0000","last_fullsized":"2023-07-06T21:42:15.814245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:07.551676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560074+0000","last_change":"2023-07-06T21:42:10.900842+0000","last_active":"2023-07-06T21:42:15.560074+0000","last_peered":"2023-07-06T21:42:15.560074+0000","last_clean":"2023-07-06T21:42:15.560074+0000","last_became_active":"2023-07-06T21:42:10.900437+0000","last_became_peered":"2023-07-06T21:42:10.900437+0000","last_unstale":"2023-07-06T21:42:15.560074+0000","last_undegraded":"2023-07-06T21:42:15.560074+0000","last_fullsized":"2023-07-06T21:42:15.560074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:40.295763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749841+0000","last_change":"2023-07-06T21:42:10.905321+0000","last_active":"2023-07-06T21:42:15.749841+0000","last_peered":"2023-07-06T21:42:15.749841+0000","last_clean":"2023-07-06T21:42:15.749841+0000","last_became_active":"2023-07-06T21:42:10.904814+0000","last_became_peered":"2023-07-06T21:42:10.904814+0000","last_unstale":"2023-07-06T21:42:15.749841+0000","last_undegraded":"2023-07-06T21:42:15.749841+0000","last_fullsized":"2023-07-06T21:42:15.749841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:14.101664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560324+0000","last_change":"2023-07-06T21:42:10.902809+0000","last_active":"2023-07-06T21:42:15.560324+0000","last_peered":"2023-07-06T21:42:15.560324+0000","last_clean":"2023-07-06T21:42:15.560324+0000","last_became_active":"2023-07-06T21:42:10.902527+0000","last_became_peered":"2023-07-06T21:42:10.902527+0000","last_unstale":"2023-07-06T21:42:15.560324+0000","last_undegraded":"2023-07-06T21:42:15.560324+0000","last_fullsized":"2023-07-06T21:42:15.560324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:49.957566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.561334+0000","last_change":"2023-07-06T21:42:10.896398+0000","last_active":"2023-07-06T21:42:15.561334+0000","last_peered":"2023-07-06T21:42:15.561334+0000","last_clean":"2023-07-06T21:42:15.561334+0000","last_became_active":"2023-07-06T21:42:10.896054+0000","last_became_peered":"2023-07-06T21:42:10.896054+0000","last_unstale":"2023-07-06T21:42:15.561334+0000","last_undegraded":"2023-07-06T21:42:15.561334+0000","last_fullsized":"2023-07-06T21:42:15.561334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:21.307899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302771+0000","last_change":"2023-07-06T21:42:10.893870+0000","last_active":"2023-07-06T21:42:15.302771+0000","last_peered":"2023-07-06T21:42:15.302771+0000","last_clean":"2023-07-06T21:42:15.302771+0000","last_became_active":"2023-07-06T21:42:10.888026+0000","last_became_peered":"2023-07-06T21:42:10.888026+0000","last_unstale":"2023-07-06T21:42:15.302771+0000","last_undegraded":"2023-07-06T21:42:15.302771+0000","last_fullsized":"2023-07-06T21:42:15.302771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813817+0000","last_change":"2023-07-06T21:42:10.885134+0000","last_active":"2023-07-06T21:42:15.813817+0000","last_peered":"2023-07-06T21:42:15.813817+0000","last_clean":"2023-07-06T21:42:15.813817+0000","last_became_active":"2023-07-06T21:42:10.884849+0000","last_became_peered":"2023-07-06T21:42:10.884849+0000","last_unstale":"2023-07-06T21:42:15.813817+0000","last_undegraded":"2023-07-06T21:42:15.813817+0000","last_fullsized":"2023-07-06T21:42:15.813817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554548+0000","last_change":"2023-07-06T21:42:10.902317+0000","last_active":"2023-07-06T21:42:15.554548+0000","last_peered":"2023-07-06T21:42:15.554548+0000","last_clean":"2023-07-06T21:42:15.554548+0000","last_became_active":"2023-07-06T21:42:10.902008+0000","last_became_peered":"2023-07-06T21:42:10.902008+0000","last_unstale":"2023-07-06T21:42:15.554548+0000","last_undegraded":"2023-07-06T21:42:15.554548+0000","last_fullsized":"2023-07-06T21:42:15.554548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:17.881222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304038+0000","last_change":"2023-07-06T21:42:10.894288+0000","last_active":"2023-07-06T21:42:15.304038+0000","last_peered":"2023-07-06T21:42:15.304038+0000","last_clean":"2023-07-06T21:42:15.304038+0000","last_became_active":"2023-07-06T21:42:10.880077+0000","last_became_peered":"2023-07-06T21:42:10.880077+0000","last_unstale":"2023-07-06T21:42:15.304038+0000","last_undegraded":"2023-07-06T21:42:15.304038+0000","last_fullsized":"2023-07-06T21:42:15.304038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:14.101664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303738+0000","last_change":"2023-07-06T21:42:10.894314+0000","last_active":"2023-07-06T21:42:15.303738+0000","last_peered":"2023-07-06T21:42:15.303738+0000","last_clean":"2023-07-06T21:42:15.303738+0000","last_became_active":"2023-07-06T21:42:10.894014+0000","last_became_peered":"2023-07-06T21:42:10.894014+0000","last_unstale":"2023-07-06T21:42:15.303738+0000","last_undegraded":"2023-07-06T21:42:15.303738+0000","last_fullsized":"2023-07-06T21:42:15.303738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:38:49.964001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300620+0000","last_change":"2023-07-06T21:42:10.887468+0000","last_active":"2023-07-06T21:42:15.300620+0000","last_peered":"2023-07-06T21:42:15.300620+0000","last_clean":"2023-07-06T21:42:15.300620+0000","last_became_active":"2023-07-06T21:42:10.887178+0000","last_became_peered":"2023-07-06T21:42:10.887178+0000","last_unstale":"2023-07-06T21:42:15.300620+0000","last_undegraded":"2023-07-06T21:42:15.300620+0000","last_fullsized":"2023-07-06T21:42:15.300620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:48:23.869797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304224+0000","last_change":"2023-07-06T21:42:10.879664+0000","last_active":"2023-07-06T21:42:15.304224+0000","last_peered":"2023-07-06T21:42:15.304224+0000","last_clean":"2023-07-06T21:42:15.304224+0000","last_became_active":"2023-07-06T21:42:10.879395+0000","last_became_peered":"2023-07-06T21:42:10.879395+0000","last_unstale":"2023-07-06T21:42:15.304224+0000","last_undegraded":"2023-07-06T21:42:15.304224+0000","last_fullsized":"2023-07-06T21:42:15.304224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:52:32.495454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555257+0000","last_change":"2023-07-06T21:42:10.882880+0000","last_active":"2023-07-06T21:42:15.555257+0000","last_peered":"2023-07-06T21:42:15.555257+0000","last_clean":"2023-07-06T21:42:15.555257+0000","last_became_active":"2023-07-06T21:42:10.882651+0000","last_became_peered":"2023-07-06T21:42:10.882651+0000","last_unstale":"2023-07-06T21:42:15.555257+0000","last_undegraded":"2023-07-06T21:42:15.555257+0000","last_fullsized":"2023-07-06T21:42:15.555257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:54.952788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302546+0000","last_change":"2023-07-06T21:42:10.878440+0000","last_active":"2023-07-06T21:42:15.302546+0000","last_peered":"2023-07-06T21:42:15.302546+0000","last_clean":"2023-07-06T21:42:15.302546+0000","last_became_active":"2023-07-06T21:42:10.878108+0000","last_became_peered":"2023-07-06T21:42:10.878108+0000","last_unstale":"2023-07-06T21:42:15.302546+0000","last_undegraded":"2023-07-06T21:42:15.302546+0000","last_fullsized":"2023-07-06T21:42:15.302546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:23:26.016221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303514+0000","last_change":"2023-07-06T21:42:10.902391+0000","last_active":"2023-07-06T21:42:15.303514+0000","last_peered":"2023-07-06T21:42:15.303514+0000","last_clean":"2023-07-06T21:42:15.303514+0000","last_became_active":"2023-07-06T21:42:10.902167+0000","last_became_peered":"2023-07-06T21:42:10.902167+0000","last_unstale":"2023-07-06T21:42:15.303514+0000","last_undegraded":"2023-07-06T21:42:15.303514+0000","last_fullsized":"2023-07-06T21:42:15.303514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:38.783636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749382+0000","last_change":"2023-07-06T21:42:10.891440+0000","last_active":"2023-07-06T21:42:15.749382+0000","last_peered":"2023-07-06T21:42:15.749382+0000","last_clean":"2023-07-06T21:42:15.749382+0000","last_became_active":"2023-07-06T21:42:10.891154+0000","last_became_peered":"2023-07-06T21:42:10.891154+0000","last_unstale":"2023-07-06T21:42:15.749382+0000","last_undegraded":"2023-07-06T21:42:15.749382+0000","last_fullsized":"2023-07-06T21:42:15.749382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300255+0000","last_change":"2023-07-06T21:42:10.875691+0000","last_active":"2023-07-06T21:42:15.300255+0000","last_peered":"2023-07-06T21:42:15.300255+0000","last_clean":"2023-07-06T21:42:15.300255+0000","last_became_active":"2023-07-06T21:42:10.875349+0000","last_became_peered":"2023-07-06T21:42:10.875349+0000","last_unstale":"2023-07-06T21:42:15.300255+0000","last_undegraded":"2023-07-06T21:42:15.300255+0000","last_fullsized":"2023-07-06T21:42:15.300255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:27:07.827816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300278+0000","last_change":"2023-07-06T21:42:10.881532+0000","last_active":"2023-07-06T21:42:15.300278+0000","last_peered":"2023-07-06T21:42:15.300278+0000","last_clean":"2023-07-06T21:42:15.300278+0000","last_became_active":"2023-07-06T21:42:10.880941+0000","last_became_peered":"2023-07-06T21:42:10.880941+0000","last_unstale":"2023-07-06T21:42:15.300278+0000","last_undegraded":"2023-07-06T21:42:15.300278+0000","last_fullsized":"2023-07-06T21:42:15.300278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:52:05.125777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304252+0000","last_change":"2023-07-06T21:42:10.894986+0000","last_active":"2023-07-06T21:42:15.304252+0000","last_peered":"2023-07-06T21:42:15.304252+0000","last_clean":"2023-07-06T21:42:15.304252+0000","last_became_active":"2023-07-06T21:42:10.894738+0000","last_became_peered":"2023-07-06T21:42:10.894738+0000","last_unstale":"2023-07-06T21:42:15.304252+0000","last_undegraded":"2023-07-06T21:42:15.304252+0000","last_fullsized":"2023-07-06T21:42:15.304252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:27:06.771295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750069+0000","last_change":"2023-07-06T21:42:10.895916+0000","last_active":"2023-07-06T21:42:15.750069+0000","last_peered":"2023-07-06T21:42:15.750069+0000","last_clean":"2023-07-06T21:42:15.750069+0000","last_became_active":"2023-07-06T21:42:10.895651+0000","last_became_peered":"2023-07-06T21:42:10.895651+0000","last_unstale":"2023-07-06T21:42:15.750069+0000","last_undegraded":"2023-07-06T21:42:15.750069+0000","last_fullsized":"2023-07-06T21:42:15.750069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:26.458362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555014+0000","last_change":"2023-07-06T21:42:10.885988+0000","last_active":"2023-07-06T21:42:15.555014+0000","last_peered":"2023-07-06T21:42:15.555014+0000","last_clean":"2023-07-06T21:42:15.555014+0000","last_became_active":"2023-07-06T21:42:10.885729+0000","last_became_peered":"2023-07-06T21:42:10.885729+0000","last_unstale":"2023-07-06T21:42:15.555014+0000","last_undegraded":"2023-07-06T21:42:15.555014+0000","last_fullsized":"2023-07-06T21:42:15.555014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749183+0000","last_change":"2023-07-06T21:42:10.891993+0000","last_active":"2023-07-06T21:42:15.749183+0000","last_peered":"2023-07-06T21:42:15.749183+0000","last_clean":"2023-07-06T21:42:15.749183+0000","last_became_active":"2023-07-06T21:42:10.891739+0000","last_became_peered":"2023-07-06T21:42:10.891739+0000","last_unstale":"2023-07-06T21:42:15.749183+0000","last_undegraded":"2023-07-06T21:42:15.749183+0000","last_fullsized":"2023-07-06T21:42:15.749183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:40.295763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303451+0000","last_change":"2023-07-06T21:42:10.902805+0000","last_active":"2023-07-06T21:42:15.303451+0000","last_peered":"2023-07-06T21:42:15.303451+0000","last_clean":"2023-07-06T21:42:15.303451+0000","last_became_active":"2023-07-06T21:42:10.902567+0000","last_became_peered":"2023-07-06T21:42:10.902567+0000","last_unstale":"2023-07-06T21:42:15.303451+0000","last_undegraded":"2023-07-06T21:42:15.303451+0000","last_fullsized":"2023-07-06T21:42:15.303451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:49.304577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303055+0000","last_change":"2023-07-06T21:42:10.881630+0000","last_active":"2023-07-06T21:42:15.303055+0000","last_peered":"2023-07-06T21:42:15.303055+0000","last_clean":"2023-07-06T21:42:15.303055+0000","last_became_active":"2023-07-06T21:42:10.881320+0000","last_became_peered":"2023-07-06T21:42:10.881320+0000","last_unstale":"2023-07-06T21:42:15.303055+0000","last_undegraded":"2023-07-06T21:42:15.303055+0000","last_fullsized":"2023-07-06T21:42:15.303055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:25:56.218127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555077+0000","last_change":"2023-07-06T21:42:10.898965+0000","last_active":"2023-07-06T21:42:15.555077+0000","last_peered":"2023-07-06T21:42:15.555077+0000","last_clean":"2023-07-06T21:42:15.555077+0000","last_became_active":"2023-07-06T21:42:10.898708+0000","last_became_peered":"2023-07-06T21:42:10.898708+0000","last_unstale":"2023-07-06T21:42:15.555077+0000","last_undegraded":"2023-07-06T21:42:15.555077+0000","last_fullsized":"2023-07-06T21:42:15.555077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:38.266961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815879+0000","last_change":"2023-07-06T21:42:10.886444+0000","last_active":"2023-07-06T21:42:15.815879+0000","last_peered":"2023-07-06T21:42:15.815879+0000","last_clean":"2023-07-06T21:42:15.815879+0000","last_became_active":"2023-07-06T21:42:10.885666+0000","last_became_peered":"2023-07-06T21:42:10.885666+0000","last_unstale":"2023-07-06T21:42:15.815879+0000","last_undegraded":"2023-07-06T21:42:15.815879+0000","last_fullsized":"2023-07-06T21:42:15.815879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:46:15.005638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304225+0000","last_change":"2023-07-06T21:42:10.882573+0000","last_active":"2023-07-06T21:42:15.304225+0000","last_peered":"2023-07-06T21:42:15.304225+0000","last_clean":"2023-07-06T21:42:15.304225+0000","last_became_active":"2023-07-06T21:42:10.882180+0000","last_became_peered":"2023-07-06T21:42:10.882180+0000","last_unstale":"2023-07-06T21:42:15.304225+0000","last_undegraded":"2023-07-06T21:42:15.304225+0000","last_fullsized":"2023-07-06T21:42:15.304225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:30:13.482950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749979+0000","last_change":"2023-07-06T21:42:10.904712+0000","last_active":"2023-07-06T21:42:15.749979+0000","last_peered":"2023-07-06T21:42:15.749979+0000","last_clean":"2023-07-06T21:42:15.749979+0000","last_became_active":"2023-07-06T21:42:10.904256+0000","last_became_peered":"2023-07-06T21:42:10.904256+0000","last_unstale":"2023-07-06T21:42:15.749979+0000","last_undegraded":"2023-07-06T21:42:15.749979+0000","last_fullsized":"2023-07-06T21:42:15.749979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:29.829357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300331+0000","last_change":"2023-07-06T21:42:10.887637+0000","last_active":"2023-07-06T21:42:15.300331+0000","last_peered":"2023-07-06T21:42:15.300331+0000","last_clean":"2023-07-06T21:42:15.300331+0000","last_became_active":"2023-07-06T21:42:10.887372+0000","last_became_peered":"2023-07-06T21:42:10.887372+0000","last_unstale":"2023-07-06T21:42:15.300331+0000","last_undegraded":"2023-07-06T21:42:15.300331+0000","last_fullsized":"2023-07-06T21:42:15.300331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:03.429658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":913408,"data_stored":714278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":123609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":884736,"data_stored":709832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:42:30.870 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T21:42:30.870 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-06T21:42:30.871 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-06T21:42:30.871 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-06T21:42:30.871 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-06T21:42:31.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.043+0000 7f05c99d2640 1 Processor -- start 2023-07-06T21:42:31.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.043+0000 7f05c99d2640 1 -- start start 2023-07-06T21:42:31.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05c99d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c415bc30 0x7f05c406ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05c99d2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f05c406f110 0x7f05c40cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05c99d2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c40cfe40 con 0x7f05c40cf9c0 2023-07-06T21:42:31.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05c99d2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c40cc800 con 0x7f05c406f110 2023-07-06T21:42:31.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05c99d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c406f580 con 0x7f05c415bc30 2023-07-06T21:42:31.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05bbfff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f05c406f110 0x7f05c40cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05c2ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c415bc30 0x7f05c406ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05c37fe640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f05c40cf9c0 0x7f05c40ca6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:47516/0 (socket says 172.21.15.55:47516) 2023-07-06T21:42:31.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05c37fe640 1 -- 172.21.15.55:0/3133262336 learned_addr learned my addr 172.21.15.55:0/3133262336 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:31.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05bbfff640 1 -- 172.21.15.55:0/3133262336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c415bc30 msgr2=0x7f05c406ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:31.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05bbfff640 1 --2- 172.21.15.55:0/3133262336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c415bc30 0x7f05c406ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05bbfff640 1 -- 172.21.15.55:0/3133262336 >> v1:172.21.15.138:6789/0 conn(0x7f05c40cf9c0 legacy=0x7f05c40ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05bbfff640 1 -- 172.21.15.55:0/3133262336 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c415f750 con 0x7f05c406f110 2023-07-06T21:42:31.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05c27fc640 1 -- 172.21.15.55:0/3133262336 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895680441 0 0) 0x7f05c40cfe40 con 0x7f05c40cf9c0 2023-07-06T21:42:31.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.047+0000 7f05c2ffd640 1 --2- 172.21.15.55:0/3133262336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c415bc30 0x7f05c406ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:31.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.051+0000 7f05bbfff640 1 --2- 172.21.15.55:0/3133262336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c406f110 0x7f05c40cf480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0097f0 tx=0x7f05ac01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93e5803530f4d337 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:31.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.051+0000 7f05c27fc640 1 -- 172.21.15.55:0/3133262336 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac0ab600 con 0x7f05c406f110 2023-07-06T21:42:31.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.051+0000 7f05c27fc640 1 -- 172.21.15.55:0/3133262336 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac0a7050 con 0x7f05c406f110 2023-07-06T21:42:31.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.051+0000 7f05c27fc640 1 -- 172.21.15.55:0/3133262336 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac0ab980 con 0x7f05c406f110 2023-07-06T21:42:31.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.051+0000 7f05c99d2640 1 -- 172.21.15.55:0/3133262336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c406f110 msgr2=0x7f05c40cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.051+0000 7f05c99d2640 1 --2- 172.21.15.55:0/3133262336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c406f110 0x7f05c40cf480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0097f0 tx=0x7f05ac01c450 comp rx=0 tx=0).stop 2023-07-06T21:42:31.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.051+0000 7f05c99d2640 1 -- 172.21.15.55:0/3133262336 shutdown_connections 2023-07-06T21:42:31.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.051+0000 7f05c99d2640 1 --2- 172.21.15.55:0/3133262336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c406f110 0x7f05c40cf480 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.051+0000 7f05c99d2640 1 --2- 172.21.15.55:0/3133262336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c415bc30 0x7f05c406ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.051+0000 7f05c99d2640 1 -- 172.21.15.55:0/3133262336 >> 172.21.15.55:0/3133262336 conn(0x7f05c40b2840 msgr2=0x7f05c40d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:31.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.051+0000 7f05c99d2640 1 -- 172.21.15.55:0/3133262336 shutdown_connections 2023-07-06T21:42:31.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.051+0000 7f05c99d2640 1 -- 172.21.15.55:0/3133262336 wait complete. 2023-07-06T21:42:31.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.051+0000 7f05c99d2640 1 Processor -- start 2023-07-06T21:42:31.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.051+0000 7f05c99d2640 1 -- start start 2023-07-06T21:42:31.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c99d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c406f110 0x7f05c41494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c99d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c40cf9c0 0x7f05c4148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c99d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c415bc30 0x7f05c40ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c99d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4149380 con 0x7f05c406f110 2023-07-06T21:42:31.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c99d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40c5740 con 0x7f05c415bc30 2023-07-06T21:42:31.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c99d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40c4e10 con 0x7f05c40cf9c0 2023-07-06T21:42:31.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c406f110 0x7f05c41494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c406f110 0x7f05c41494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59944/0 (socket says 172.21.15.55:59944) 2023-07-06T21:42:31.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c2ffd640 1 -- 172.21.15.55:0/866792731 learned_addr learned my addr 172.21.15.55:0/866792731 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:31.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05bbfff640 1 --2- 172.21.15.55:0/866792731 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c40cf9c0 0x7f05c4148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c37fe640 1 --2- 172.21.15.55:0/866792731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c415bc30 0x7f05c40ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c2ffd640 1 -- 172.21.15.55:0/866792731 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c40cf9c0 msgr2=0x7f05c4148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c2ffd640 1 --2- 172.21.15.55:0/866792731 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c40cf9c0 0x7f05c4148e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c2ffd640 1 -- 172.21.15.55:0/866792731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c415bc30 msgr2=0x7f05c40ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c2ffd640 1 --2- 172.21.15.55:0/866792731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c415bc30 0x7f05c40ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c2ffd640 1 -- 172.21.15.55:0/866792731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b4009420 con 0x7f05c406f110 2023-07-06T21:42:31.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c2ffd640 1 --2- 172.21.15.55:0/866792731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c406f110 0x7f05c41494f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f05b400e9b0 tx=0x7f05b400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c0ff9640 1 -- 172.21.15.55:0/866792731 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b400ca00 con 0x7f05c406f110 2023-07-06T21:42:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c0ff9640 1 -- 172.21.15.55:0/866792731 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b400cb60 con 0x7f05c406f110 2023-07-06T21:42:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c99d2640 1 -- 172.21.15.55:0/866792731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ac009420 con 0x7f05c406f110 2023-07-06T21:42:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c0ff9640 1 -- 172.21.15.55:0/866792731 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4013470 con 0x7f05c406f110 2023-07-06T21:42:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c99d2640 1 -- 172.21.15.55:0/866792731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c40c53d0 con 0x7f05c406f110 2023-07-06T21:42:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.055+0000 7f05c99d2640 1 -- 172.21.15.55:0/866792731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c4066d60 con 0x7f05c406f110 2023-07-06T21:42:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.059+0000 7f05c0ff9640 1 -- 172.21.15.55:0/866792731 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05b40135d0 con 0x7f05c406f110 2023-07-06T21:42:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.059+0000 7f05c0ff9640 1 --2- 172.21.15.55:0/866792731 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f05a4066280 0x7f05a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.059+0000 7f05c0ff9640 1 -- 172.21.15.55:0/866792731 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f05b40841b0 con 0x7f05c406f110 2023-07-06T21:42:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.059+0000 7f05bbfff640 1 --2- 172.21.15.55:0/866792731 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f05a4066280 0x7f05a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.059+0000 7f05bbfff640 1 --2- 172.21.15.55:0/866792731 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f05a4066280 0x7f05a4068730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0ad000 tx=0x7f05ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:31.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.063+0000 7f05c0ff9640 1 -- 172.21.15.55:0/866792731 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05b40513e0 con 0x7f05c406f110 2023-07-06T21:42:31.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.251+0000 7f05c99d2640 1 -- 172.21.15.55:0/866792731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f05c4166740 con 0x7f05c406f110 2023-07-06T21:42:31.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.255+0000 7f05c0ff9640 1 -- 172.21.15.55:0/866792731 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164242 (secure 0 0 0) 0x7f05b4054a00 con 0x7f05c406f110 2023-07-06T21:42:31.263 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:31.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.259+0000 7f05c99d2640 1 -- 172.21.15.55:0/866792731 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f05a4066280 msgr2=0x7f05a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.259+0000 7f05c99d2640 1 --2- 172.21.15.55:0/866792731 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f05a4066280 0x7f05a4068730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0ad000 tx=0x7f05ac008040 comp rx=0 tx=0).stop 2023-07-06T21:42:31.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.259+0000 7f05c99d2640 1 -- 172.21.15.55:0/866792731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c406f110 msgr2=0x7f05c41494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.259+0000 7f05c99d2640 1 --2- 172.21.15.55:0/866792731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c406f110 0x7f05c41494f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f05b400e9b0 tx=0x7f05b400ee70 comp rx=0 tx=0).stop 2023-07-06T21:42:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.259+0000 7f05c99d2640 1 -- 172.21.15.55:0/866792731 shutdown_connections 2023-07-06T21:42:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.259+0000 7f05c99d2640 1 --2- 172.21.15.55:0/866792731 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f05a4066280 0x7f05a4068730 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.259+0000 7f05c99d2640 1 --2- 172.21.15.55:0/866792731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c415bc30 0x7f05c40ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.259+0000 7f05c99d2640 1 --2- 172.21.15.55:0/866792731 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c40cf9c0 0x7f05c4148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.259+0000 7f05c99d2640 1 --2- 172.21.15.55:0/866792731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c406f110 0x7f05c41494f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.259+0000 7f05c99d2640 1 -- 172.21.15.55:0/866792731 >> 172.21.15.55:0/866792731 conn(0x7f05c40b2840 msgr2=0x7f05c40cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.259+0000 7f05c99d2640 1 -- 172.21.15.55:0/866792731 shutdown_connections 2023-07-06T21:42:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.259+0000 7f05c99d2640 1 -- 172.21.15.55:0/866792731 wait complete. 2023-07-06T21:42:31.284 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1575998409},{"type":"v1","addr":"172.21.15.55:6833","nonce":1575998409}]},"active_addr":"172.21.15.55:6833/1575998409","active_change":"2023-07-06T21:41:49.630136+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":2066223848}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":2297905762}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":1005520698}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":2605447220}]}]} 2023-07-06T21:42:31.293 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-06T21:42:31.294 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-06T21:42:31.294 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:31.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.431+0000 7f011def9640 1 Processor -- start 2023-07-06T21:42:31.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.431+0000 7f011def9640 1 -- start start 2023-07-06T21:42:31.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f011def9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f01180ca450 0x7f011806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f011def9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01180b3730 0x7f011815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f011def9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0118159cd0 con 0x7f01180712f0 2023-07-06T21:42:31.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f011def9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01180693f0 con 0x7f01180b3730 2023-07-06T21:42:31.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f011def9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f011806aca0 con 0x7f01180ca450 2023-07-06T21:42:31.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f0117fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01180b3730 0x7f011815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f0117fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01180b3730 0x7f011815d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59946/0 (socket says 172.21.15.55:59946) 2023-07-06T21:42:31.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f0117fff640 1 -- 172.21.15.55:0/2775967223 learned_addr learned my addr 172.21.15.55:0/2775967223 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:31.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f0116ffd640 1 --2- 172.21.15.55:0/2775967223 >> v2:172.21.15.138:3300/0 conn(0x7f01180ca450 0x7f011806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f0117fff640 1 -- 172.21.15.55:0/2775967223 >> v2:172.21.15.138:3300/0 conn(0x7f01180ca450 msgr2=0x7f011806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:31.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f0117fff640 1 --2- 172.21.15.55:0/2775967223 >> v2:172.21.15.138:3300/0 conn(0x7f01180ca450 0x7f011806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f0117fff640 1 -- 172.21.15.55:0/2775967223 >> v1:172.21.15.138:6789/0 conn(0x7f01180712f0 legacy=0x7f01180c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f0117fff640 1 -- 172.21.15.55:0/2775967223 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01180696b0 con 0x7f01180b3730 2023-07-06T21:42:31.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f0116ffd640 1 --2- 172.21.15.55:0/2775967223 >> v2:172.21.15.138:3300/0 conn(0x7f01180ca450 0x7f011806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:31.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f0117fff640 1 --2- 172.21.15.55:0/2775967223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180b3730 0x7f011815d3e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0118071a70 tx=0x7f011001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12aa2c5679e1694d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:31.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.435+0000 7f01167fc640 1 -- 172.21.15.55:0/2775967223 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01100a5860 con 0x7f01180b3730 2023-07-06T21:42:31.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f01167fc640 1 -- 172.21.15.55:0/2775967223 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01100a59c0 con 0x7f01180b3730 2023-07-06T21:42:31.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f01167fc640 1 -- 172.21.15.55:0/2775967223 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01100a5d50 con 0x7f01180b3730 2023-07-06T21:42:31.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 -- 172.21.15.55:0/2775967223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180b3730 msgr2=0x7f011815d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 --2- 172.21.15.55:0/2775967223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180b3730 0x7f011815d3e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0118071a70 tx=0x7f011001c9a0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 -- 172.21.15.55:0/2775967223 shutdown_connections 2023-07-06T21:42:31.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 --2- 172.21.15.55:0/2775967223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180b3730 0x7f011815d3e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 --2- 172.21.15.55:0/2775967223 >> v2:172.21.15.138:3300/0 conn(0x7f01180ca450 0x7f011806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 -- 172.21.15.55:0/2775967223 >> 172.21.15.55:0/2775967223 conn(0x7f01180cded0 msgr2=0x7f01180ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:31.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 -- 172.21.15.55:0/2775967223 shutdown_connections 2023-07-06T21:42:31.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 -- 172.21.15.55:0/2775967223 wait complete. 2023-07-06T21:42:31.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 Processor -- start 2023-07-06T21:42:31.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 -- start start 2023-07-06T21:42:31.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180712f0 0x7f01180c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01180b3730 0x7f01180c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01180ca450 0x7f01180cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180ccc00 con 0x7f01180712f0 2023-07-06T21:42:31.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180cbff0 con 0x7f01180ca450 2023-07-06T21:42:31.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f011def9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01180cc2d0 con 0x7f01180b3730 2023-07-06T21:42:31.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f01177fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180712f0 0x7f01180c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f01177fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180712f0 0x7f01180c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59956/0 (socket says 172.21.15.55:59956) 2023-07-06T21:42:31.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f01177fe640 1 -- 172.21.15.55:0/3492040580 learned_addr learned my addr 172.21.15.55:0/3492040580 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:31.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f0117fff640 1 --2- 172.21.15.55:0/3492040580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01180ca450 0x7f01180cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.439+0000 7f0116ffd640 1 --2- 172.21.15.55:0/3492040580 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01180b3730 0x7f01180c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f01177fe640 1 -- 172.21.15.55:0/3492040580 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01180b3730 msgr2=0x7f01180c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f01177fe640 1 --2- 172.21.15.55:0/3492040580 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01180b3730 0x7f01180c18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f01177fe640 1 -- 172.21.15.55:0/3492040580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01180ca450 msgr2=0x7f01180cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f01177fe640 1 --2- 172.21.15.55:0/3492040580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01180ca450 0x7f01180cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f01177fe640 1 -- 172.21.15.55:0/3492040580 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0110009b30 con 0x7f01180712f0 2023-07-06T21:42:31.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f01177fe640 1 --2- 172.21.15.55:0/3492040580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180712f0 0x7f01180c9610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f010800c370 tx=0x7f010800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f00fffff640 1 -- 172.21.15.55:0/3492040580 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01080052d0 con 0x7f01180712f0 2023-07-06T21:42:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f00fffff640 1 -- 172.21.15.55:0/3492040580 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0108005430 con 0x7f01180712f0 2023-07-06T21:42:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f00fffff640 1 -- 172.21.15.55:0/3492040580 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108007260 con 0x7f01180712f0 2023-07-06T21:42:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f011def9640 1 -- 172.21.15.55:0/3492040580 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01180cc5b0 con 0x7f01180712f0 2023-07-06T21:42:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f011def9640 1 -- 172.21.15.55:0/3492040580 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01180c4660 con 0x7f01180712f0 2023-07-06T21:42:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f011def9640 1 -- 172.21.15.55:0/3492040580 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0118066d60 con 0x7f01180712f0 2023-07-06T21:42:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f00fffff640 1 -- 172.21.15.55:0/3492040580 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01080073c0 con 0x7f01180712f0 2023-07-06T21:42:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f00fffff640 1 --2- 172.21.15.55:0/3492040580 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0104066280 0x7f0104068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.443+0000 7f00fffff640 1 -- 172.21.15.55:0/3492040580 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0108083330 con 0x7f01180712f0 2023-07-06T21:42:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.447+0000 7f0116ffd640 1 --2- 172.21.15.55:0/3492040580 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0104066280 0x7f0104068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.447+0000 7f0116ffd640 1 --2- 172.21.15.55:0/3492040580 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0104066280 0x7f0104068730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0118159ad0 tx=0x7f010c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:31.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.447+0000 7f00fffff640 1 -- 172.21.15.55:0/3492040580 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0108050570 con 0x7f01180712f0 2023-07-06T21:42:31.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.607+0000 7f011def9640 1 -- 172.21.15.55:0/3492040580 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f011806c380 con 0x7f01180712f0 2023-07-06T21:42:31.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.607+0000 7f00fffff640 1 -- 172.21.15.55:0/3492040580 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f0108053b90 con 0x7f01180712f0 2023-07-06T21:42:31.613 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:31.613 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:15.295464+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:31.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.607+0000 7f011def9640 1 -- 172.21.15.55:0/3492040580 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0104066280 msgr2=0x7f0104068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.607+0000 7f011def9640 1 --2- 172.21.15.55:0/3492040580 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0104066280 0x7f0104068730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0118159ad0 tx=0x7f010c008040 comp rx=0 tx=0).stop 2023-07-06T21:42:31.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.607+0000 7f011def9640 1 -- 172.21.15.55:0/3492040580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180712f0 msgr2=0x7f01180c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.607+0000 7f011def9640 1 --2- 172.21.15.55:0/3492040580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180712f0 0x7f01180c9610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f010800c370 tx=0x7f010800c830 comp rx=0 tx=0).stop 2023-07-06T21:42:31.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.607+0000 7f011def9640 1 -- 172.21.15.55:0/3492040580 shutdown_connections 2023-07-06T21:42:31.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.607+0000 7f011def9640 1 --2- 172.21.15.55:0/3492040580 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0104066280 0x7f0104068730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.607+0000 7f011def9640 1 --2- 172.21.15.55:0/3492040580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01180ca450 0x7f01180cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.607+0000 7f011def9640 1 --2- 172.21.15.55:0/3492040580 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01180b3730 0x7f01180c18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.607+0000 7f011def9640 1 --2- 172.21.15.55:0/3492040580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01180712f0 0x7f01180c9610 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.607+0000 7f011def9640 1 -- 172.21.15.55:0/3492040580 >> 172.21.15.55:0/3492040580 conn(0x7f01180cded0 msgr2=0x7f01180b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:31.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.611+0000 7f011def9640 1 -- 172.21.15.55:0/3492040580 shutdown_connections 2023-07-06T21:42:31.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.611+0000 7f011def9640 1 -- 172.21.15.55:0/3492040580 wait complete. 2023-07-06T21:42:31.634 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-06T21:42:31.635 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:31.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.771+0000 7f04143c5640 1 Processor -- start 2023-07-06T21:42:31.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.771+0000 7f04143c5640 1 -- start start 2023-07-06T21:42:31.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f04143c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f040c15c7d0 0x7f040c0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f04143c5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040c0b0b50 con 0x7f040c0c8350 2023-07-06T21:42:31.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f04143c5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040c0b0da0 con 0x7f040c158450 2023-07-06T21:42:31.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f04143c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040c0b2850 con 0x7f040c15c7d0 2023-07-06T21:42:31.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f0411960640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f040c0c8350 0x7f040c15c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57480/0 (socket says 172.21.15.55:57480) 2023-07-06T21:42:31.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f0411960640 1 -- 172.21.15.55:0/1500589378 learned_addr learned my addr 172.21.15.55:0/1500589378 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:31.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f0412962640 1 --2- 172.21.15.55:0/1500589378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f040c15c7d0 0x7f040c0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f041115f640 1 -- 172.21.15.55:0/1500589378 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989487439 0 0) 0x7f040c0b0b50 con 0x7f040c0c8350 2023-07-06T21:42:31.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f041115f640 1 -- 172.21.15.55:0/1500589378 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03f8003530 con 0x7f040c0c8350 2023-07-06T21:42:31.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f041115f640 1 -- 172.21.15.55:0/1500589378 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003539747 0 0) 0x7f040c0b0da0 con 0x7f040c158450 2023-07-06T21:42:31.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f041115f640 1 -- 172.21.15.55:0/1500589378 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f040c0b0b50 con 0x7f040c158450 2023-07-06T21:42:31.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f0412962640 1 -- 172.21.15.55:0/1500589378 >> v1:172.21.15.138:6789/0 conn(0x7f040c158450 legacy=0x7f040c0cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f0412962640 1 -- 172.21.15.55:0/1500589378 >> v1:172.21.15.55:6789/0 conn(0x7f040c0c8350 legacy=0x7f040c15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f0412962640 1 -- 172.21.15.55:0/1500589378 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c0b1080 con 0x7f040c15c7d0 2023-07-06T21:42:31.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.775+0000 7f0412962640 1 --2- 172.21.15.55:0/1500589378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f040c15c7d0 0x7f040c0b3240 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0404009dc0 tx=0x7f040401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=537256aa21676755 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:31.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f041115f640 1 -- 172.21.15.55:0/1500589378 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04040a5a20 con 0x7f040c15c7d0 2023-07-06T21:42:31.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f041115f640 1 -- 172.21.15.55:0/1500589378 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04040a5b80 con 0x7f040c15c7d0 2023-07-06T21:42:31.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f041115f640 1 -- 172.21.15.55:0/1500589378 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04040ad440 con 0x7f040c15c7d0 2023-07-06T21:42:31.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 -- 172.21.15.55:0/1500589378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f040c15c7d0 msgr2=0x7f040c0b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 --2- 172.21.15.55:0/1500589378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f040c15c7d0 0x7f040c0b3240 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0404009dc0 tx=0x7f040401c940 comp rx=0 tx=0).stop 2023-07-06T21:42:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 -- 172.21.15.55:0/1500589378 shutdown_connections 2023-07-06T21:42:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 --2- 172.21.15.55:0/1500589378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f040c15c7d0 0x7f040c0b3240 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 -- 172.21.15.55:0/1500589378 >> 172.21.15.55:0/1500589378 conn(0x7f040c0cdd00 msgr2=0x7f040c0ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 -- 172.21.15.55:0/1500589378 shutdown_connections 2023-07-06T21:42:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 -- 172.21.15.55:0/1500589378 wait complete. 2023-07-06T21:42:31.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 Processor -- start 2023-07-06T21:42:31.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 -- start start 2023-07-06T21:42:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f040c0c8350 0x7f040c0c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f040c158450 0x7f040c151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f040c15c7d0 0x7f040c14afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c0c5fa0 con 0x7f040c15c7d0 2023-07-06T21:42:31.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c151d50 con 0x7f040c0c8350 2023-07-06T21:42:31.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f04143c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040c0c5390 con 0x7f040c158450 2023-07-06T21:42:31.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f0412962640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f040c15c7d0 0x7f040c14afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f0412962640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f040c15c7d0 0x7f040c14afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59962/0 (socket says 172.21.15.55:59962) 2023-07-06T21:42:31.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.779+0000 7f0412962640 1 -- 172.21.15.55:0/2436268577 learned_addr learned my addr 172.21.15.55:0/2436268577 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:31.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f0411960640 1 --2- 172.21.15.55:0/2436268577 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f040c158450 0x7f040c151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f0412161640 1 --2- 172.21.15.55:0/2436268577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f040c0c8350 0x7f040c0c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f0412962640 1 -- 172.21.15.55:0/2436268577 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f040c158450 msgr2=0x7f040c151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f0412962640 1 --2- 172.21.15.55:0/2436268577 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f040c158450 0x7f040c151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f0412962640 1 -- 172.21.15.55:0/2436268577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f040c0c8350 msgr2=0x7f040c0c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f0412962640 1 --2- 172.21.15.55:0/2436268577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f040c0c8350 0x7f040c0c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f0412962640 1 -- 172.21.15.55:0/2436268577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0404009a70 con 0x7f040c15c7d0 2023-07-06T21:42:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f0412962640 1 --2- 172.21.15.55:0/2436268577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f040c15c7d0 0x7f040c14afc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f040401ce20 tx=0x7f04040196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f0402ffd640 1 -- 172.21.15.55:0/2436268577 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04040adc80 con 0x7f040c15c7d0 2023-07-06T21:42:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f0402ffd640 1 -- 172.21.15.55:0/2436268577 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04040ade00 con 0x7f040c15c7d0 2023-07-06T21:42:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f04143c5640 1 -- 172.21.15.55:0/2436268577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040c0c5670 con 0x7f040c15c7d0 2023-07-06T21:42:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f0402ffd640 1 -- 172.21.15.55:0/2436268577 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04040b9690 con 0x7f040c15c7d0 2023-07-06T21:42:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f04143c5640 1 -- 172.21.15.55:0/2436268577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040c0c5c30 con 0x7f040c15c7d0 2023-07-06T21:42:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f04143c5640 1 -- 172.21.15.55:0/2436268577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040c0c6150 con 0x7f040c15c7d0 2023-07-06T21:42:31.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f0402ffd640 1 -- 172.21.15.55:0/2436268577 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f04040b97f0 con 0x7f040c15c7d0 2023-07-06T21:42:31.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.783+0000 7f0402ffd640 1 --2- 172.21.15.55:0/2436268577 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f03f0066280 0x7f03f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:31.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.787+0000 7f0402ffd640 1 -- 172.21.15.55:0/2436268577 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f040411f600 con 0x7f040c15c7d0 2023-07-06T21:42:31.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.787+0000 7f0412161640 1 --2- 172.21.15.55:0/2436268577 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f03f0066280 0x7f03f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:31.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.787+0000 7f0412161640 1 --2- 172.21.15.55:0/2436268577 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f03f0066280 0x7f03f0068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04080011f0 tx=0x7f0408009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:31.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.787+0000 7f0402ffd640 1 -- 172.21.15.55:0/2436268577 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f040c0c6150 con 0x7f040c15c7d0 2023-07-06T21:42:31.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.943+0000 7f04143c5640 1 -- 172.21.15.55:0/2436268577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f040c0c6150 con 0x7f040c15c7d0 2023-07-06T21:42:31.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.947+0000 7f0402ffd640 1 -- 172.21.15.55:0/2436268577 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f040c0c6150 con 0x7f040c15c7d0 2023-07-06T21:42:31.952 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:31.952 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:15.295464+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:31.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.947+0000 7f04143c5640 1 -- 172.21.15.55:0/2436268577 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f03f0066280 msgr2=0x7f03f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.947+0000 7f04143c5640 1 --2- 172.21.15.55:0/2436268577 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f03f0066280 0x7f03f0068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04080011f0 tx=0x7f0408009040 comp rx=0 tx=0).stop 2023-07-06T21:42:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.947+0000 7f04143c5640 1 -- 172.21.15.55:0/2436268577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f040c15c7d0 msgr2=0x7f040c14afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.947+0000 7f04143c5640 1 --2- 172.21.15.55:0/2436268577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f040c15c7d0 0x7f040c14afc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f040401ce20 tx=0x7f04040196e0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.947+0000 7f04143c5640 1 -- 172.21.15.55:0/2436268577 shutdown_connections 2023-07-06T21:42:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.947+0000 7f04143c5640 1 --2- 172.21.15.55:0/2436268577 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f03f0066280 0x7f03f0068730 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.947+0000 7f04143c5640 1 --2- 172.21.15.55:0/2436268577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f040c15c7d0 0x7f040c14afc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.947+0000 7f04143c5640 1 --2- 172.21.15.55:0/2436268577 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f040c158450 0x7f040c151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.947+0000 7f04143c5640 1 --2- 172.21.15.55:0/2436268577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f040c0c8350 0x7f040c0c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.947+0000 7f04143c5640 1 -- 172.21.15.55:0/2436268577 >> 172.21.15.55:0/2436268577 conn(0x7f040c0cdd00 msgr2=0x7f040c0c8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.947+0000 7f04143c5640 1 -- 172.21.15.55:0/2436268577 shutdown_connections 2023-07-06T21:42:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:31.947+0000 7f04143c5640 1 -- 172.21.15.55:0/2436268577 wait complete. 2023-07-06T21:42:31.973 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-06T21:42:31.974 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-06T21:42:31.974 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-06T21:42:31.975 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-06T21:42:31.975 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-06T21:42:31.976 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-06T21:42:31.977 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-06T21:42:31.977 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-06T21:42:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.211+0000 7f384f848640 1 Processor -- start 2023-07-06T21:42:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.211+0000 7f384f848640 1 -- start start 2023-07-06T21:42:32.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7f384f848640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3848070450 0x7f3848070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7f384f848640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38480c9a10 0x7f38480cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7f384f848640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38480b3ba0 con 0x7f38480cd0f0 2023-07-06T21:42:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7f384f848640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38480b2880 con 0x7f3848070450 2023-07-06T21:42:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7f384f848640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38480c8270 con 0x7f38480c9a10 2023-07-06T21:42:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7f384d5e4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3848070450 0x7f3848070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7f384d5e4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3848070450 0x7f3848070820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59966/0 (socket says 172.21.15.55:59966) 2023-07-06T21:42:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7f384d5e4640 1 -- 172.21.15.55:0/766823734 learned_addr learned my addr 172.21.15.55:0/766823734 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7f384dde5640 1 --2- 172.21.15.55:0/766823734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38480c9a10 0x7f38480cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7f384d5e4640 1 -- 172.21.15.55:0/766823734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38480c9a10 msgr2=0x7f38480cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7f384d5e4640 1 --2- 172.21.15.55:0/766823734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38480c9a10 0x7f38480cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7f384d5e4640 1 -- 172.21.15.55:0/766823734 >> v1:172.21.15.138:6789/0 conn(0x7f38480cd0f0 legacy=0x7f384806ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7f384d5e4640 1 -- 172.21.15.55:0/766823734 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3848070d60 con 0x7f3848070450 2023-07-06T21:42:32.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7f384dde5640 1 --2- 172.21.15.55:0/766823734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38480c9a10 0x7f38480cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:32.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.215+0000 7fbe9e900640 1 Processor -- start 2023-07-06T21:42:32.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.219+0000 7fbe9e900640 1 -- start start 2023-07-06T21:42:32.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.219+0000 7fbe9e900640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe980ca100 0x7fbe980693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.219+0000 7fbe9e900640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe98069930 0x7fbe9806ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.219+0000 7fbe9e900640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe980cb7f0 con 0x7fbe98157ac0 2023-07-06T21:42:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.219+0000 7fbe9e900640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe980cc470 con 0x7fbe980ca100 2023-07-06T21:42:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.219+0000 7fbe9e900640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe98157e90 con 0x7fbe98069930 2023-07-06T21:42:32.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.219+0000 7fbe9ce9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe98069930 0x7fbe9806ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.219+0000 7fbe9ce9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe98069930 0x7fbe9806ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44554/0 (socket says 172.21.15.55:44554) 2023-07-06T21:42:32.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.219+0000 7fbe9ce9d640 1 -- 172.21.15.55:0/3862343602 learned_addr learned my addr 172.21.15.55:0/3862343602 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.219+0000 7fbe8f7fe640 1 --2- 172.21.15.55:0/3862343602 >> v2:172.21.15.55:3300/0 conn(0x7fbe980ca100 0x7fbe980693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.219+0000 7f384d5e4640 1 --2- 172.21.15.55:0/766823734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3848070450 0x7f3848070820 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f383800bb10 tx=0x7f383801ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a89239bd91085 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.219+0000 7fbe9ce9d640 1 -- 172.21.15.55:0/3862343602 >> v2:172.21.15.55:3300/0 conn(0x7fbe980ca100 msgr2=0x7fbe980693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.219+0000 7fbe9ce9d640 1 --2- 172.21.15.55:0/3862343602 >> v2:172.21.15.55:3300/0 conn(0x7fbe980ca100 0x7fbe980693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.219+0000 7fbe9ce9d640 1 -- 172.21.15.55:0/3862343602 >> v1:172.21.15.55:6789/0 conn(0x7fbe98157ac0 legacy=0x7fbe980c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.223+0000 7fbe9ce9d640 1 -- 172.21.15.55:0/3862343602 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe980cbad0 con 0x7fbe98069930 2023-07-06T21:42:32.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.223+0000 7f383ffff640 1 -- 172.21.15.55:0/766823734 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38380a7bd0 con 0x7f3848070450 2023-07-06T21:42:32.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.223+0000 7f383ffff640 1 -- 172.21.15.55:0/766823734 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38380a7d30 con 0x7f3848070450 2023-07-06T21:42:32.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.223+0000 7f383ffff640 1 -- 172.21.15.55:0/766823734 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38380a7ea0 con 0x7f3848070450 2023-07-06T21:42:32.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.223+0000 7f384f848640 1 -- 172.21.15.55:0/766823734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3848070450 msgr2=0x7f3848070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.223+0000 7f384f848640 1 --2- 172.21.15.55:0/766823734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3848070450 0x7f3848070820 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f383800bb10 tx=0x7f383801ebe0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.223+0000 7f384f848640 1 -- 172.21.15.55:0/766823734 shutdown_connections 2023-07-06T21:42:32.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.223+0000 7f384f848640 1 --2- 172.21.15.55:0/766823734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38480c9a10 0x7f38480cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.223+0000 7f384f848640 1 --2- 172.21.15.55:0/766823734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3848070450 0x7f3848070820 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.223+0000 7f384f848640 1 -- 172.21.15.55:0/766823734 >> 172.21.15.55:0/766823734 conn(0x7f38480ca690 msgr2=0x7f38480caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.223+0000 7f384f848640 1 -- 172.21.15.55:0/766823734 shutdown_connections 2023-07-06T21:42:32.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.223+0000 7f384f848640 1 -- 172.21.15.55:0/766823734 wait complete. 2023-07-06T21:42:32.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7f8721d82640 1 Processor -- start 2023-07-06T21:42:32.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7f8721d82640 1 -- start start 2023-07-06T21:42:32.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7f384f848640 1 Processor -- start 2023-07-06T21:42:32.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7f384f848640 1 -- start start 2023-07-06T21:42:32.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7fbe9ce9d640 1 --2- 172.21.15.55:0/3862343602 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe98069930 0x7fbe9806ed00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000d370 tx=0x7fbe9001ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33340dc27017398b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7f384f848640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3848070450 0x7f38481527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7fdef1ef9640 1 Processor -- start 2023-07-06T21:42:32.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7fdef1ef9640 1 -- start start 2023-07-06T21:42:32.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7f384f848640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38480c9a10 0x7f38480c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7f8721d82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f871c1630a0 0x7f871c0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7f8721d82640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f871c0c0930 0x7f871c0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7f8721d82640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871c06f570 con 0x7f871c163470 2023-07-06T21:42:32.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7f8721d82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871c0c1230 con 0x7f871c1630a0 2023-07-06T21:42:32.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7f8721d82640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871c0c0d00 con 0x7f871c0c0930 2023-07-06T21:42:32.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384d5e4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3848070450 0x7f38481527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384d5e4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3848070450 0x7f38481527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:55874/0 (socket says 172.21.15.55:55874) 2023-07-06T21:42:32.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384d5e4640 1 -- 172.21.15.55:0/2232986221 learned_addr learned my addr 172.21.15.55:0/2232986221 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384f848640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38480cd0f0 0x7f38480c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384f848640 1 -- 172.21.15.55:0/2232986221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384806ac90 con 0x7f38480c9a10 2023-07-06T21:42:32.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384f848640 1 -- 172.21.15.55:0/2232986221 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38480693f0 con 0x7f3848070450 2023-07-06T21:42:32.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384f848640 1 -- 172.21.15.55:0/2232986221 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38480c16b0 con 0x7f38480cd0f0 2023-07-06T21:42:32.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.227+0000 7fbe977fe640 1 -- 172.21.15.55:0/3862343602 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900a7c80 con 0x7fbe98069930 2023-07-06T21:42:32.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fbe977fe640 1 -- 172.21.15.55:0/3862343602 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe900ab070 con 0x7fbe98069930 2023-07-06T21:42:32.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fbe977fe640 1 -- 172.21.15.55:0/3862343602 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900b1400 con 0x7fbe98069930 2023-07-06T21:42:32.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f871b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f871c1630a0 0x7f871c0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f871b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f871c1630a0 0x7f871c0c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59986/0 (socket says 172.21.15.55:59986) 2023-07-06T21:42:32.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f871b7fe640 1 -- 172.21.15.55:0/2747923020 learned_addr learned my addr 172.21.15.55:0/2747923020 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384dde5640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38480cd0f0 0x7f38480c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384cde3640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38480c9a10 0x7f38480c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fbe9e900640 1 -- 172.21.15.55:0/3862343602 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe98069930 msgr2=0x7fbe9806ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fbe9e900640 1 --2- 172.21.15.55:0/3862343602 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe98069930 0x7fbe9806ed00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000d370 tx=0x7fbe9001ece0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384d5e4640 1 -- 172.21.15.55:0/2232986221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38480cd0f0 msgr2=0x7f38480c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384d5e4640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38480cd0f0 0x7f38480c5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384d5e4640 1 -- 172.21.15.55:0/2232986221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38480c9a10 msgr2=0x7f38480c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384d5e4640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38480c9a10 0x7f38480c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384d5e4640 1 -- 172.21.15.55:0/2232986221 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383800b770 con 0x7f3848070450 2023-07-06T21:42:32.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fbe9e900640 1 -- 172.21.15.55:0/3862343602 shutdown_connections 2023-07-06T21:42:32.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fbe9e900640 1 --2- 172.21.15.55:0/3862343602 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe98069930 0x7fbe9806ed00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fbe9e900640 1 --2- 172.21.15.55:0/3862343602 >> v2:172.21.15.55:3300/0 conn(0x7fbe980ca100 0x7fbe980693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fbe9e900640 1 -- 172.21.15.55:0/3862343602 >> 172.21.15.55:0/3862343602 conn(0x7fbe980ce8a0 msgr2=0x7fbe980ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fdef1ef9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdeec15ba30 0x7fdeec0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fdef1ef9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeec09d510 0x7fdeec0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fdef1ef9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeec0ccbb0 con 0x7fdeec0ad0c0 2023-07-06T21:42:32.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fdef1ef9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeec0c83a0 con 0x7fdeec15ba30 2023-07-06T21:42:32.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fdef1ef9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec0cce90 con 0x7fdeec09d510 2023-07-06T21:42:32.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fbe9e900640 1 -- 172.21.15.55:0/3862343602 shutdown_connections 2023-07-06T21:42:32.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f871bfff640 1 --2- 172.21.15.55:0/2747923020 >> v2:172.21.15.138:3300/0 conn(0x7f871c0c0930 0x7f871c0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f871b7fe640 1 -- 172.21.15.55:0/2747923020 >> v2:172.21.15.138:3300/0 conn(0x7f871c0c0930 msgr2=0x7f871c0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f871b7fe640 1 --2- 172.21.15.55:0/2747923020 >> v2:172.21.15.138:3300/0 conn(0x7f871c0c0930 0x7f871c0cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f871b7fe640 1 -- 172.21.15.55:0/2747923020 >> v1:172.21.15.55:6789/0 conn(0x7f871c163470 legacy=0x7f871c0c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f871b7fe640 1 -- 172.21.15.55:0/2747923020 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c06f850 con 0x7f871c1630a0 2023-07-06T21:42:32.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384d5e4640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3848070450 0x7f38481527c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f383800b2c0 tx=0x7f383801d420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fdeeb7fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdeec15ba30 0x7fdeec0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fdeeb7fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdeec15ba30 0x7fdeec0cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:55876/0 (socket says 172.21.15.55:55876) 2023-07-06T21:42:32.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fdeeb7fe640 1 -- 172.21.15.55:0/1164613564 learned_addr learned my addr 172.21.15.55:0/1164613564 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f383dffb640 1 -- 172.21.15.55:0/2232986221 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38380a7ea0 con 0x7f3848070450 2023-07-06T21:42:32.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f383dffb640 1 -- 172.21.15.55:0/2232986221 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38380ba480 con 0x7f3848070450 2023-07-06T21:42:32.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f383dffb640 1 -- 172.21.15.55:0/2232986221 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38380ba830 con 0x7f3848070450 2023-07-06T21:42:32.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fdeeb7fe640 1 -- 172.21.15.55:0/1164613564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeec09d510 msgr2=0x7fdeec0c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fdeebfff640 1 --2- 172.21.15.55:0/1164613564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeec09d510 0x7fdeec0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fdeeb7fe640 1 --2- 172.21.15.55:0/1164613564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeec09d510 0x7fdeec0c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fdeeb7fe640 1 -- 172.21.15.55:0/1164613564 >> v1:172.21.15.55:6789/0 conn(0x7fdeec0ad0c0 legacy=0x7fdeec09ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fdeeb7fe640 1 -- 172.21.15.55:0/1164613564 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec0cd170 con 0x7fdeec15ba30 2023-07-06T21:42:32.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7f384f848640 1 -- 172.21.15.55:0/2232986221 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384806a310 con 0x7f3848070450 2023-07-06T21:42:32.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.235+0000 7f384f848640 1 -- 172.21.15.55:0/2232986221 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384806a5d0 con 0x7f3848070450 2023-07-06T21:42:32.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.235+0000 7f332c374640 1 Processor -- start 2023-07-06T21:42:32.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.231+0000 7fbe9e900640 1 -- 172.21.15.55:0/3862343602 wait complete. 2023-07-06T21:42:32.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.235+0000 7fbe9e900640 1 Processor -- start 2023-07-06T21:42:32.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.235+0000 7fbe9e900640 1 -- start start 2023-07-06T21:42:32.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.235+0000 7f871b7fe640 1 --2- 172.21.15.55:0/2747923020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f871c1630a0 0x7f871c0c9830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f871c0ad690 tx=0x7f870c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f124f54b9e58a39 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.235+0000 7f332c374640 1 -- start start 2023-07-06T21:42:32.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.235+0000 7f871a7fc640 1 -- 172.21.15.55:0/2747923020 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c0ab600 con 0x7f871c1630a0 2023-07-06T21:42:32.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.235+0000 7f332c374640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3324157ac0 0x7f33240c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.235+0000 7f332c374640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33240ca100 0x7f33240693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.235+0000 7fdeeb7fe640 1 --2- 172.21.15.55:0/1164613564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeec15ba30 0x7fdeec0cd800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009870 tx=0x7fdedc01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9a168ff2166987e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f871a7fc640 1 -- 172.21.15.55:0/2747923020 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c0ab760 con 0x7f871c1630a0 2023-07-06T21:42:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f871a7fc640 1 -- 172.21.15.55:0/2747923020 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c0ab600 con 0x7f871c1630a0 2023-07-06T21:42:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f332c374640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33240c9630 con 0x7f3324069930 2023-07-06T21:42:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f332c374640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33240cc470 con 0x7f33240ca100 2023-07-06T21:42:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f332c374640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3324157e90 con 0x7f3324157ac0 2023-07-06T21:42:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fdeea7fc640 1 -- 172.21.15.55:0/1164613564 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0a95f0 con 0x7fdeec15ba30 2023-07-06T21:42:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fdeea7fc640 1 -- 172.21.15.55:0/1164613564 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc0a9750 con 0x7fdeec15ba30 2023-07-06T21:42:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fdeea7fc640 1 -- 172.21.15.55:0/1164613564 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0a9ae0 con 0x7fdeec15ba30 2023-07-06T21:42:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fbe9e900640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe98069930 0x7fbe980c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f8721d82640 1 -- 172.21.15.55:0/2747923020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f871c1630a0 msgr2=0x7f871c0c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f8721d82640 1 --2- 172.21.15.55:0/2747923020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f871c1630a0 0x7f871c0c9830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f871c0ad690 tx=0x7f870c01c400 comp rx=0 tx=0).stop 2023-07-06T21:42:32.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f332a110640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3324157ac0 0x7f33240c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f332a110640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3324157ac0 0x7f33240c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:55888/0 (socket says 172.21.15.55:55888) 2023-07-06T21:42:32.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f332a110640 1 -- 172.21.15.55:0/2729162155 learned_addr learned my addr 172.21.15.55:0/2729162155 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f332990f640 1 --2- 172.21.15.55:0/2729162155 >> v2:172.21.15.55:3300/0 conn(0x7f33240ca100 0x7f33240693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f332910e640 1 -- 172.21.15.55:0/2729162155 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073552021 0 0) 0x7f33240c9630 con 0x7f3324069930 2023-07-06T21:42:32.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f332a110640 1 -- 172.21.15.55:0/2729162155 >> v2:172.21.15.55:3300/0 conn(0x7f33240ca100 msgr2=0x7f33240693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f332a110640 1 --2- 172.21.15.55:0/2729162155 >> v2:172.21.15.55:3300/0 conn(0x7f33240ca100 0x7f33240693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f332a110640 1 -- 172.21.15.55:0/2729162155 >> v1:172.21.15.138:6789/0 conn(0x7f3324069930 legacy=0x7f332406ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f332a110640 1 -- 172.21.15.55:0/2729162155 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33240cb7f0 con 0x7f3324157ac0 2023-07-06T21:42:32.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1164613564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeec15ba30 msgr2=0x7fdeec0cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fdef1ef9640 1 --2- 172.21.15.55:0/1164613564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeec15ba30 0x7fdeec0cd800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009870 tx=0x7fdedc01c510 comp rx=0 tx=0).stop 2023-07-06T21:42:32.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fbe9e900640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe980ca100 0x7fbe980c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1164613564 shutdown_connections 2023-07-06T21:42:32.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fdef1ef9640 1 --2- 172.21.15.55:0/1164613564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeec09d510 0x7fdeec0c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fdef1ef9640 1 --2- 172.21.15.55:0/1164613564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeec15ba30 0x7fdeec0cd800 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1164613564 >> 172.21.15.55:0/1164613564 conn(0x7fdeec0cea70 msgr2=0x7fdeec0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1164613564 shutdown_connections 2023-07-06T21:42:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fbe97fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe98069930 0x7fbe980c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fbe97fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe98069930 0x7fbe980c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:55900/0 (socket says 172.21.15.55:55900) 2023-07-06T21:42:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.235+0000 7f382b7fe640 1 -- 172.21.15.55:0/2232986221 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38480c84e0 con 0x7f3848070450 2023-07-06T21:42:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f383dffb640 1 -- 172.21.15.55:0/2232986221 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38380ba990 con 0x7f3848070450 2023-07-06T21:42:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f383dffb640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f382c066380 0x7f382c068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f383dffb640 1 -- 172.21.15.55:0/2232986221 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f383811f500 con 0x7f3848070450 2023-07-06T21:42:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f383dffb640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.55:6800/3314779935,v1:172.21.15.55:6801/3314779935] conn(0x7f382c06ffd0 0x7f382c072400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f383dffb640 1 -- 172.21.15.55:0/2232986221 --> [v2:172.21.15.55:6800/3314779935,v1:172.21.15.55:6801/3314779935] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f382c072ad0 con 0x7f382c06ffd0 2023-07-06T21:42:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fbe8f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe980ca100 0x7fbe980c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fbe8f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe980ca100 0x7fbe980c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60024/0 (socket says 172.21.15.55:60024) 2023-07-06T21:42:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f8721d82640 1 -- 172.21.15.55:0/2747923020 shutdown_connections 2023-07-06T21:42:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f8721d82640 1 --2- 172.21.15.55:0/2747923020 >> v2:172.21.15.138:3300/0 conn(0x7f871c0c0930 0x7f871c0cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f8721d82640 1 --2- 172.21.15.55:0/2747923020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f871c1630a0 0x7f871c0c9830 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f8721d82640 1 -- 172.21.15.55:0/2747923020 >> 172.21.15.55:0/2747923020 conn(0x7f871c0ca690 msgr2=0x7f871c0caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f384cde3640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f382c066380 0x7f382c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fbe97fff640 1 -- 172.21.15.55:0/3633224698 learned_addr learned my addr 172.21.15.55:0/3633224698 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1164613564 wait complete. 2023-07-06T21:42:32.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fbe9e900640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe98157ac0 0x7fbe980c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f384dde5640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.55:6800/3314779935,v1:172.21.15.55:6801/3314779935] conn(0x7f382c06ffd0 0x7f382c072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fbe9e900640 1 -- 172.21.15.55:0/3633224698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980c7080 con 0x7fbe980ca100 2023-07-06T21:42:32.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fbe9e900640 1 -- 172.21.15.55:0/3633224698 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980c6270 con 0x7fbe98069930 2023-07-06T21:42:32.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f383dffb640 1 -- 172.21.15.55:0/2232986221 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38380ec670 con 0x7f3848070450 2023-07-06T21:42:32.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fbe9e900640 1 -- 172.21.15.55:0/3633224698 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980c5660 con 0x7fbe98157ac0 2023-07-06T21:42:32.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fbe9ce9d640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe98157ac0 0x7fbe980c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7f8721d82640 1 -- 172.21.15.55:0/2747923020 shutdown_connections 2023-07-06T21:42:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.239+0000 7fbe9ce9d640 1 -- 172.21.15.55:0/3633224698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe98069930 msgr2=0x7fbe980c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fbe9ce9d640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe98069930 0x7fbe980c4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fbe9ce9d640 1 -- 172.21.15.55:0/3633224698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe980ca100 msgr2=0x7fbe980c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fbe9ce9d640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe980ca100 0x7fbe980c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fbe9ce9d640 1 -- 172.21.15.55:0/3633224698 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9000d050 con 0x7fbe98157ac0 2023-07-06T21:42:32.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f384cde3640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f382c066380 0x7f382c068830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f38480cbce0 tx=0x7f3844009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fbe97fff640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe98069930 0x7fbe980c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:32.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f8721d82640 1 -- 172.21.15.55:0/2747923020 wait complete. 2023-07-06T21:42:32.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f384dde5640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.55:6800/3314779935,v1:172.21.15.55:6801/3314779935] conn(0x7f382c06ffd0 0x7f382c072400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f9e93fff640 1 Processor -- start 2023-07-06T21:42:32.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f9e93fff640 1 -- start start 2023-07-06T21:42:32.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fdef1ef9640 1 Processor -- start 2023-07-06T21:42:32.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fbe9ce9d640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe98157ac0 0x7fbe980c6b40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbe900af000 tx=0x7fbe9001ba80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fdef1ef9640 1 -- start start 2023-07-06T21:42:32.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fbe957fa640 1 -- 172.21.15.55:0/3633224698 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900a7e90 con 0x7fbe98157ac0 2023-07-06T21:42:32.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fbe957fa640 1 -- 172.21.15.55:0/3633224698 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe90007e10 con 0x7fbe98157ac0 2023-07-06T21:42:32.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fbe957fa640 1 -- 172.21.15.55:0/3633224698 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90008280 con 0x7fbe98157ac0 2023-07-06T21:42:32.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fbe9e900640 1 -- 172.21.15.55:0/3633224698 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe980c5940 con 0x7fbe98157ac0 2023-07-06T21:42:32.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fbe9e900640 1 -- 172.21.15.55:0/3633224698 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe980c5f00 con 0x7fbe98157ac0 2023-07-06T21:42:32.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f332a110640 1 --2- 172.21.15.55:0/2729162155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3324157ac0 0x7f33240c90f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f33240cd420 tx=0x7f331401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e10334eeaf071162 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f383dffb640 1 -- 172.21.15.55:0/2232986221 <== osd.0 v2:172.21.15.55:6800/3314779935 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f382c072ad0 con 0x7f382c06ffd0 2023-07-06T21:42:32.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f332910e640 1 -- 172.21.15.55:0/2729162155 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33140ab600 con 0x7f3324157ac0 2023-07-06T21:42:32.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f332910e640 1 -- 172.21.15.55:0/2729162155 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33140a7050 con 0x7f3324157ac0 2023-07-06T21:42:32.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f332910e640 1 -- 172.21.15.55:0/2729162155 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33140ab980 con 0x7f3324157ac0 2023-07-06T21:42:32.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fbe9e900640 1 -- 172.21.15.55:0/3633224698 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe9806f650 con 0x7fbe98157ac0 2023-07-06T21:42:32.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fdef1ef9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeec09d510 0x7fdeec15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f8721d82640 1 Processor -- start 2023-07-06T21:42:32.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fdef1ef9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeec0ad0c0 0x7fdeec0c0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f9e93fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e9406f4b0 0x7f9e941581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f9e93fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9e940c9e00 0x7f9e940c8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f9e93fff640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e940cb8f0 con 0x7f9e940cbd80 2023-07-06T21:42:32.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f9e93fff640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e94155be0 con 0x7f9e9406f4b0 2023-07-06T21:42:32.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7f9e93fff640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e941587f0 con 0x7f9e940c9e00 2023-07-06T21:42:32.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fdeeb7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeec09d510 0x7fdeec15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.243+0000 7fdeeb7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeec09d510 0x7fdeec15c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44610/0 (socket says 172.21.15.55:44610) 2023-07-06T21:42:32.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f9e92ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e9406f4b0 0x7f9e941581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f332c374640 1 -- 172.21.15.55:0/2729162155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3324157ac0 msgr2=0x7f33240c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f332c374640 1 --2- 172.21.15.55:0/2729162155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3324157ac0 0x7f33240c90f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f33240cd420 tx=0x7f331401c470 comp rx=0 tx=0).stop 2023-07-06T21:42:32.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f9e92ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e9406f4b0 0x7f9e941581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60026/0 (socket says 172.21.15.55:60026) 2023-07-06T21:42:32.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f9e92ffd640 1 -- 172.21.15.55:0/2358129535 learned_addr learned my addr 172.21.15.55:0/2358129535 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f8721d82640 1 -- start start 2023-07-06T21:42:32.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdeeaffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeec0ad0c0 0x7fdeec0c0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdeeaffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeec0ad0c0 0x7fdeec0c0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:55910/0 (socket says 172.21.15.55:55910) 2023-07-06T21:42:32.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdeeaffd640 1 -- 172.21.15.55:0/1372401176 learned_addr learned my addr 172.21.15.55:0/1372401176 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdef1ef9640 1 --2- 172.21.15.55:0/1372401176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeec15ba30 0x7fdeec14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1372401176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec15ca20 con 0x7fdeec15ba30 2023-07-06T21:42:32.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1372401176 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec0b2c20 con 0x7fdeec0ad0c0 2023-07-06T21:42:32.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1372401176 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec14f6f0 con 0x7fdeec09d510 2023-07-06T21:42:32.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f332c374640 1 -- 172.21.15.55:0/2729162155 shutdown_connections 2023-07-06T21:42:32.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f332c374640 1 --2- 172.21.15.55:0/2729162155 >> v2:172.21.15.55:3300/0 conn(0x7f33240ca100 0x7f33240693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f332c374640 1 --2- 172.21.15.55:0/2729162155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3324157ac0 0x7f33240c90f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f332c374640 1 -- 172.21.15.55:0/2729162155 >> 172.21.15.55:0/2729162155 conn(0x7f33240ce8a0 msgr2=0x7f33240ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f332c374640 1 -- 172.21.15.55:0/2729162155 shutdown_connections 2023-07-06T21:42:32.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f332c374640 1 -- 172.21.15.55:0/2729162155 wait complete. 2023-07-06T21:42:32.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f9e92ffd640 1 -- 172.21.15.55:0/2358129535 >> v2:172.21.15.138:3300/0 conn(0x7f9e940c9e00 msgr2=0x7f9e940c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f9e927fc640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9e940c9e00 0x7f9e940c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdeebfff640 1 --2- 172.21.15.55:0/1372401176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeec15ba30 0x7fdeec14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdeeaffd640 1 -- 172.21.15.55:0/1372401176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeec09d510 msgr2=0x7fdeec15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdeeaffd640 1 --2- 172.21.15.55:0/1372401176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeec09d510 0x7fdeec15c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdeeaffd640 1 -- 172.21.15.55:0/1372401176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeec15ba30 msgr2=0x7fdeec14fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdeeaffd640 1 --2- 172.21.15.55:0/1372401176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeec15ba30 0x7fdeec14fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdeeaffd640 1 -- 172.21.15.55:0/1372401176 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc0094d0 con 0x7fdeec0ad0c0 2023-07-06T21:42:32.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f9e92ffd640 1 --2- 172.21.15.55:0/2358129535 >> v2:172.21.15.138:3300/0 conn(0x7f9e940c9e00 0x7f9e940c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f9e92ffd640 1 -- 172.21.15.55:0/2358129535 >> v1:172.21.15.138:6789/0 conn(0x7f9e940cbd80 legacy=0x7f9e940cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f9e92ffd640 1 -- 172.21.15.55:0/2358129535 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e94158ad0 con 0x7f9e9406f4b0 2023-07-06T21:42:32.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f8721d82640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f871c0c0930 0x7f871c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f8721d82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f871c163470 0x7f871c14e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdeeaffd640 1 --2- 172.21.15.55:0/1372401176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeec0ad0c0 0x7fdeec0c0c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdee400c7f0 tx=0x7fdee400ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f8721d82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f871c0b1d90 0x7f871c0b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f9e927fc640 1 --2- 172.21.15.55:0/2358129535 >> v2:172.21.15.138:3300/0 conn(0x7f9e940c9e00 0x7f9e940c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:32.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f8721d82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c06a1f0 con 0x7f871c163470 2023-07-06T21:42:32.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f8721d82640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0b2770 con 0x7f871c0c0930 2023-07-06T21:42:32.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f8721d82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c069570 con 0x7f871c0b1d90 2023-07-06T21:42:32.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fded3fff640 1 -- 172.21.15.55:0/1372401176 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee4003b80 con 0x7fdeec0ad0c0 2023-07-06T21:42:32.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fded3fff640 1 -- 172.21.15.55:0/1372401176 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee4003ce0 con 0x7fdeec0ad0c0 2023-07-06T21:42:32.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1372401176 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeec14eae0 con 0x7fdeec0ad0c0 2023-07-06T21:42:32.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7f332c374640 1 Processor -- start 2023-07-06T21:42:32.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fded3fff640 1 -- 172.21.15.55:0/1372401176 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee400aa90 con 0x7fdeec0ad0c0 2023-07-06T21:42:32.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.247+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1372401176 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeec14f0a0 con 0x7fdeec0ad0c0 2023-07-06T21:42:32.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1372401176 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdeec0c9540 con 0x7fdeec0ad0c0 2023-07-06T21:42:32.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fbe957fa640 1 -- 172.21.15.55:0/3633224698 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbe900083e0 con 0x7fbe98157ac0 2023-07-06T21:42:32.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65fe96640 1 Processor -- start 2023-07-06T21:42:32.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65fe96640 1 -- start start 2023-07-06T21:42:32.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f871b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f871c0c0930 0x7f871c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f871b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f871c0c0930 0x7f871c06a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:55926/0 (socket says 172.21.15.55:55926) 2023-07-06T21:42:32.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f871b7fe640 1 -- 172.21.15.55:0/2921902338 learned_addr learned my addr 172.21.15.55:0/2921902338 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f871bfff640 1 --2- 172.21.15.55:0/2921902338 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f871c0b1d90 0x7f871c0b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332c374640 1 -- start start 2023-07-06T21:42:32.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332c374640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3324069930 0x7f33240c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fbe957fa640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbe78066350 0x7fbe78068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fbe957fa640 1 -- 172.21.15.55:0/3633224698 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbe9011e100 con 0x7fbe98157ac0 2023-07-06T21:42:32.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fbe957fa640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.55:6816/110907122,v1:172.21.15.55:6818/110907122] conn(0x7fbe7806feb0 0x7fbe780722e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fbe957fa640 1 -- 172.21.15.55:0/3633224698 --> [v2:172.21.15.55:6816/110907122,v1:172.21.15.55:6818/110907122] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe780729b0 con 0x7fbe7806feb0 2023-07-06T21:42:32.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fbe957fa640 1 -- 172.21.15.55:0/3633224698 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe9011e4b0 con 0x7fbe98157ac0 2023-07-06T21:42:32.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fbe8f7fe640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.55:6816/110907122,v1:172.21.15.55:6818/110907122] conn(0x7fbe7806feb0 0x7fbe780722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7fbe97fff640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbe78066350 0x7fbe78068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f871affd640 1 --2- 172.21.15.55:0/2921902338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f871c163470 0x7f871c14e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f871b7fe640 1 -- 172.21.15.55:0/2921902338 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f871c0b1d90 msgr2=0x7f871c0b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f871b7fe640 1 --2- 172.21.15.55:0/2921902338 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f871c0b1d90 0x7f871c0b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f871b7fe640 1 -- 172.21.15.55:0/2921902338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f871c163470 msgr2=0x7f871c14e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f871b7fe640 1 --2- 172.21.15.55:0/2921902338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f871c163470 0x7f871c14e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f871b7fe640 1 -- 172.21.15.55:0/2921902338 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c0094d0 con 0x7f871c0c0930 2023-07-06T21:42:32.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fded3fff640 1 -- 172.21.15.55:0/1372401176 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdee400abf0 con 0x7fdeec0ad0c0 2023-07-06T21:42:32.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f9e92ffd640 1 --2- 172.21.15.55:0/2358129535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e9406f4b0 0x7f9e941581c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009870 tx=0x7f9e8401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1de3ef6a47a20fc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65fe96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb65806ae50 0x7fb6580693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65fe96640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb65816a9e0 0x7fb65806b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65fe96640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb658069930 con 0x7fb658070bf0 2023-07-06T21:42:32.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65fe96640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6580cc290 con 0x7fb65816a9e0 2023-07-06T21:42:32.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65fe96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65806ba20 con 0x7fb65806ae50 2023-07-06T21:42:32.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65dc32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb65806ae50 0x7fb6580693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65dc32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb65806ae50 0x7fb6580693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44640/0 (socket says 172.21.15.55:44640) 2023-07-06T21:42:32.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65dc32640 1 -- 172.21.15.55:0/1383520221 learned_addr learned my addr 172.21.15.55:0/1383520221 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65d431640 1 --2- 172.21.15.55:0/1383520221 >> v2:172.21.15.138:3300/0 conn(0x7fb65816a9e0 0x7fb65806b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65dc32640 1 -- 172.21.15.55:0/1383520221 >> v2:172.21.15.138:3300/0 conn(0x7fb65816a9e0 msgr2=0x7fb65806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65dc32640 1 --2- 172.21.15.55:0/1383520221 >> v2:172.21.15.138:3300/0 conn(0x7fb65816a9e0 0x7fb65806b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65dc32640 1 -- 172.21.15.55:0/1383520221 >> v1:172.21.15.138:6789/0 conn(0x7fb658070bf0 legacy=0x7fb658087030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7fb65dc32640 1 -- 172.21.15.55:0/1383520221 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65806b760 con 0x7fb65806ae50 2023-07-06T21:42:32.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332a110640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3324069930 0x7f33240c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332c374640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33240ca100 0x7f3324153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332a110640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3324069930 0x7f33240c40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44624/0 (socket says 172.21.15.55:44624) 2023-07-06T21:42:32.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332a110640 1 -- 172.21.15.55:0/2399139497 learned_addr learned my addr 172.21.15.55:0/2399139497 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332c374640 1 --2- 172.21.15.55:0/2399139497 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3324157ac0 0x7f33240ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332c374640 1 -- 172.21.15.55:0/2399139497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3324154060 con 0x7f33240ca100 2023-07-06T21:42:32.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332c374640 1 -- 172.21.15.55:0/2399139497 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3324154ba0 con 0x7f3324157ac0 2023-07-06T21:42:32.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332c374640 1 -- 172.21.15.55:0/2399139497 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3324154300 con 0x7f3324069930 2023-07-06T21:42:32.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332a911640 1 --2- 172.21.15.55:0/2399139497 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3324157ac0 0x7f33240ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332a110640 1 -- 172.21.15.55:0/2399139497 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3324157ac0 msgr2=0x7f33240ac7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332a110640 1 --2- 172.21.15.55:0/2399139497 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3324157ac0 0x7f33240ac7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332a110640 1 -- 172.21.15.55:0/2399139497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33240ca100 msgr2=0x7f3324153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f332a110640 1 --2- 172.21.15.55:0/2399139497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33240ca100 0x7f3324153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f332a110640 1 -- 172.21.15.55:0/2399139497 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140094d0 con 0x7f3324069930 2023-07-06T21:42:32.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f332a110640 1 --2- 172.21.15.55:0/2399139497 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3324069930 0x7f33240c40d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f331401a0a0 tx=0x7f3314019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f331affd640 1 -- 172.21.15.55:0/2399139497 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33140b5400 con 0x7f3324069930 2023-07-06T21:42:32.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f331affd640 1 -- 172.21.15.55:0/2399139497 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33140b5560 con 0x7f3324069930 2023-07-06T21:42:32.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f331affd640 1 -- 172.21.15.55:0/2399139497 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33140b58d0 con 0x7f3324069930 2023-07-06T21:42:32.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f332c374640 1 -- 172.21.15.55:0/2399139497 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33241545e0 con 0x7f3324069930 2023-07-06T21:42:32.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f4b64e96640 1 Processor -- start 2023-07-06T21:42:32.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7fbe97fff640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbe78066350 0x7fbe78068800 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009da0 tx=0x7fbe80009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f332c374640 1 -- 172.21.15.55:0/2399139497 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3324150640 con 0x7f3324069930 2023-07-06T21:42:32.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.251+0000 7f4b64e96640 1 -- start start 2023-07-06T21:42:32.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b64e96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4b60151ed0 0x7f4b6006ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b64e96640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4b60070510 0x7f4b600c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b64e96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b601522a0 0x7f4b600c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b64e96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6015b720 con 0x7f4b601522a0 2023-07-06T21:42:32.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b64e96640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6015b9c0 con 0x7f4b60070510 2023-07-06T21:42:32.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b64e96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6015bca0 con 0x7f4b60151ed0 2023-07-06T21:42:32.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b5e59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4b60151ed0 0x7f4b6006ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b5e59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4b60151ed0 0x7f4b6006ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44650/0 (socket says 172.21.15.55:44650) 2023-07-06T21:42:32.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b5e59c640 1 -- 172.21.15.55:0/135625018 learned_addr learned my addr 172.21.15.55:0/135625018 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b5dd9b640 1 --2- 172.21.15.55:0/135625018 >> v2:172.21.15.138:3300/0 conn(0x7f4b60070510 0x7f4b600c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b5ed9d640 1 --2- 172.21.15.55:0/135625018 >> v2:172.21.15.55:3300/0 conn(0x7f4b601522a0 0x7f4b600c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7fded3fff640 1 --2- 172.21.15.55:0/1372401176 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fded8066350 0x7fded8068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7fded3fff640 1 -- 172.21.15.55:0/1372401176 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdee4038030 con 0x7fdeec0ad0c0 2023-07-06T21:42:32.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7fded3fff640 1 --2- 172.21.15.55:0/1372401176 >> [v2:172.21.15.55:6808/2677129803,v1:172.21.15.55:6809/2677129803] conn(0x7fded8070020 0x7fded8072450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7fded3fff640 1 -- 172.21.15.55:0/1372401176 --> [v2:172.21.15.55:6808/2677129803,v1:172.21.15.55:6809/2677129803] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fded8072b20 con 0x7fded8070020 2023-07-06T21:42:32.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7fded3fff640 1 -- 172.21.15.55:0/1372401176 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdee4084990 con 0x7fdeec0ad0c0 2023-07-06T21:42:32.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b5e59c640 1 -- 172.21.15.55:0/135625018 >> v2:172.21.15.138:3300/0 conn(0x7f4b60070510 msgr2=0x7f4b600c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b5e59c640 1 --2- 172.21.15.55:0/135625018 >> v2:172.21.15.138:3300/0 conn(0x7f4b60070510 0x7f4b600c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b5e59c640 1 -- 172.21.15.55:0/135625018 >> v2:172.21.15.55:3300/0 conn(0x7f4b601522a0 msgr2=0x7f4b600c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b5e59c640 1 --2- 172.21.15.55:0/135625018 >> v2:172.21.15.55:3300/0 conn(0x7f4b601522a0 0x7f4b600c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f4b5e59c640 1 -- 172.21.15.55:0/135625018 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6015bf80 con 0x7f4b60151ed0 2023-07-06T21:42:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7fbe8f7fe640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.55:6816/110907122,v1:172.21.15.55:6818/110907122] conn(0x7fbe7806feb0 0x7fbe780722e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7fdeeb7fe640 1 --2- 172.21.15.55:0/1372401176 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fded8066350 0x7fded8068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7fdeebfff640 1 --2- 172.21.15.55:0/1372401176 >> [v2:172.21.15.55:6808/2677129803,v1:172.21.15.55:6809/2677129803] conn(0x7fded8070020 0x7fded8072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f9e91ffb640 1 -- 172.21.15.55:0/2358129535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e840ab600 con 0x7f9e9406f4b0 2023-07-06T21:42:32.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f9e91ffb640 1 -- 172.21.15.55:0/2358129535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e840a7050 con 0x7f9e9406f4b0 2023-07-06T21:42:32.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f9e91ffb640 1 -- 172.21.15.55:0/2358129535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e840ab980 con 0x7f9e9406f4b0 2023-07-06T21:42:32.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f3318ff9640 1 -- 172.21.15.55:0/2399139497 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33240cc090 con 0x7f3324069930 2023-07-06T21:42:32.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7fdeebfff640 1 --2- 172.21.15.55:0/1372401176 >> [v2:172.21.15.55:6808/2677129803,v1:172.21.15.55:6809/2677129803] conn(0x7fded8070020 0x7fded8072450 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7fdeeb7fe640 1 --2- 172.21.15.55:0/1372401176 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fded8066350 0x7fded8068800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0ae000 tx=0x7fdedc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.255+0000 7f871b7fe640 1 --2- 172.21.15.55:0/2921902338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f871c0c0930 0x7f871c06a610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f870c0ad040 tx=0x7f870c0191a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f8703fff640 1 -- 172.21.15.55:0/2921902338 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c0abce0 con 0x7f871c0c0930 2023-07-06T21:42:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f8703fff640 1 -- 172.21.15.55:0/2921902338 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c0abe60 con 0x7f871c0c0930 2023-07-06T21:42:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f8703fff640 1 -- 172.21.15.55:0/2921902338 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c003860 con 0x7f871c0c0930 2023-07-06T21:42:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f9e93fff640 1 -- 172.21.15.55:0/2358129535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e9406f4b0 msgr2=0x7f9e941581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f9e93fff640 1 --2- 172.21.15.55:0/2358129535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e9406f4b0 0x7f9e941581c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009870 tx=0x7f9e8401c4f0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f8721d82640 1 -- 172.21.15.55:0/2921902338 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871c069850 con 0x7f871c0c0930 2023-07-06T21:42:32.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7fbe957fa640 1 -- 172.21.15.55:0/3633224698 <== osd.1 v2:172.21.15.55:6816/110907122 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbe780729b0 con 0x7fbe7806feb0 2023-07-06T21:42:32.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7fded3fff640 1 -- 172.21.15.55:0/1372401176 <== osd.3 v2:172.21.15.55:6808/2677129803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fded8072b20 con 0x7fded8070020 2023-07-06T21:42:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f9e93fff640 1 -- 172.21.15.55:0/2358129535 shutdown_connections 2023-07-06T21:42:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f9e93fff640 1 --2- 172.21.15.55:0/2358129535 >> v2:172.21.15.138:3300/0 conn(0x7f9e940c9e00 0x7f9e940c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f9e93fff640 1 --2- 172.21.15.55:0/2358129535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e9406f4b0 0x7f9e941581c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f9e93fff640 1 -- 172.21.15.55:0/2358129535 >> 172.21.15.55:0/2358129535 conn(0x7f9e940cdbf0 msgr2=0x7f9e940cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7fb65dc32640 1 --2- 172.21.15.55:0/1383520221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb65806ae50 0x7fb6580693f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb654009870 tx=0x7fb65401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6400e654de2180bf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7fb65cc30640 1 -- 172.21.15.55:0/1383520221 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540ac620 con 0x7fb65806ae50 2023-07-06T21:42:32.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f9e93fff640 1 -- 172.21.15.55:0/2358129535 shutdown_connections 2023-07-06T21:42:32.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f8721d82640 1 -- 172.21.15.55:0/2921902338 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c069e10 con 0x7f871c0c0930 2023-07-06T21:42:32.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7fb65cc30640 1 -- 172.21.15.55:0/1383520221 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6540ac780 con 0x7fb65806ae50 2023-07-06T21:42:32.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7fb65fe96640 1 -- 172.21.15.55:0/1383520221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb65806ae50 msgr2=0x7fb6580693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7fb65fe96640 1 --2- 172.21.15.55:0/1383520221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb65806ae50 0x7fb6580693f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb654009870 tx=0x7fb65401c4b0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f8701ffb640 1 -- 172.21.15.55:0/2921902338 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f871c06fe10 con 0x7f871c0c0930 2023-07-06T21:42:32.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7fb65fe96640 1 -- 172.21.15.55:0/1383520221 shutdown_connections 2023-07-06T21:42:32.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7fb65fe96640 1 --2- 172.21.15.55:0/1383520221 >> v2:172.21.15.138:3300/0 conn(0x7fb65816a9e0 0x7fb65806b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7fb65fe96640 1 --2- 172.21.15.55:0/1383520221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb65806ae50 0x7fb6580693f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7fb65fe96640 1 -- 172.21.15.55:0/1383520221 >> 172.21.15.55:0/1383520221 conn(0x7fb6580ce8a0 msgr2=0x7fb6580ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f4b5e59c640 1 --2- 172.21.15.55:0/135625018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4b60151ed0 0x7f4b6006ffd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b600b0940 tx=0x7f4b4801c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b55fb5b767aa34c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7fb65fe96640 1 -- 172.21.15.55:0/1383520221 shutdown_connections 2023-07-06T21:42:32.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f4b5d59a640 1 -- 172.21.15.55:0/135625018 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b480a5810 con 0x7f4b60151ed0 2023-07-06T21:42:32.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f4b5d59a640 1 -- 172.21.15.55:0/135625018 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b480a9070 con 0x7f4b60151ed0 2023-07-06T21:42:32.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f4b5d59a640 1 -- 172.21.15.55:0/135625018 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b480a5b90 con 0x7f4b60151ed0 2023-07-06T21:42:32.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f331affd640 1 -- 172.21.15.55:0/2399139497 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f33140b5a30 con 0x7f3324069930 2023-07-06T21:42:32.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f331affd640 1 --2- 172.21.15.55:0/2399139497 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3308066350 0x7f3308068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f331affd640 1 -- 172.21.15.55:0/2399139497 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f331411e440 con 0x7f3324069930 2023-07-06T21:42:32.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f331affd640 1 --2- 172.21.15.55:0/2399139497 >> [v2:172.21.15.138:6802/1391058734,v1:172.21.15.138:6804/1391058734] conn(0x7f3308070020 0x7f3308072450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f331affd640 1 -- 172.21.15.55:0/2399139497 --> [v2:172.21.15.138:6802/1391058734,v1:172.21.15.138:6804/1391058734] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3308072b20 con 0x7f3308070020 2023-07-06T21:42:32.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f331affd640 1 -- 172.21.15.55:0/2399139497 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f331411e7f0 con 0x7f3324069930 2023-07-06T21:42:32.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f332a911640 1 --2- 172.21.15.55:0/2399139497 >> [v2:172.21.15.138:6802/1391058734,v1:172.21.15.138:6804/1391058734] conn(0x7f3308070020 0x7f3308072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7f9e93fff640 1 -- 172.21.15.55:0/2358129535 wait complete. 2023-07-06T21:42:32.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f9e93fff640 1 Processor -- start 2023-07-06T21:42:32.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f4b64e96640 1 -- 172.21.15.55:0/135625018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4b60151ed0 msgr2=0x7f4b6006ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f4b64e96640 1 --2- 172.21.15.55:0/135625018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4b60151ed0 0x7f4b6006ffd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b600b0940 tx=0x7f4b4801c880 comp rx=0 tx=0).stop 2023-07-06T21:42:32.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f332990f640 1 --2- 172.21.15.55:0/2399139497 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3308066350 0x7f3308068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f9e93fff640 1 -- start start 2023-07-06T21:42:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.259+0000 7fb65fe96640 1 -- 172.21.15.55:0/1383520221 wait complete. 2023-07-06T21:42:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7fb65fe96640 1 Processor -- start 2023-07-06T21:42:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7fb65fe96640 1 -- start start 2023-07-06T21:42:32.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f332a911640 1 --2- 172.21.15.55:0/2399139497 >> [v2:172.21.15.138:6802/1391058734,v1:172.21.15.138:6804/1391058734] conn(0x7f3308070020 0x7f3308072450 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f332990f640 1 --2- 172.21.15.55:0/2399139497 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3308066350 0x7f3308068800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3324155f40 tx=0x7f331c009830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f4b64e96640 1 -- 172.21.15.55:0/135625018 shutdown_connections 2023-07-06T21:42:32.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f4b64e96640 1 --2- 172.21.15.55:0/135625018 >> v2:172.21.15.55:3300/0 conn(0x7f4b601522a0 0x7f4b600c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f4b64e96640 1 --2- 172.21.15.55:0/135625018 >> v2:172.21.15.138:3300/0 conn(0x7f4b60070510 0x7f4b600c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f4b64e96640 1 --2- 172.21.15.55:0/135625018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4b60151ed0 0x7f4b6006ffd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f4b64e96640 1 -- 172.21.15.55:0/135625018 >> 172.21.15.55:0/135625018 conn(0x7f4b600cea70 msgr2=0x7f4b600ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f8703fff640 1 -- 172.21.15.55:0/2921902338 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f870c0039c0 con 0x7f871c0c0930 2023-07-06T21:42:32.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f8703fff640 1 --2- 172.21.15.55:0/2921902338 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8708066350 0x7f8708068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f8703fff640 1 -- 172.21.15.55:0/2921902338 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f870c11e860 con 0x7f871c0c0930 2023-07-06T21:42:32.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f8703fff640 1 --2- 172.21.15.55:0/2921902338 >> [v2:172.21.15.55:6817/4070957199,v1:172.21.15.55:6819/4070957199] conn(0x7f870806ffa0 0x7f87080723d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f8703fff640 1 -- 172.21.15.55:0/2921902338 --> [v2:172.21.15.55:6817/4070957199,v1:172.21.15.55:6819/4070957199] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8708072aa0 con 0x7f870806ffa0 2023-07-06T21:42:32.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f8703fff640 1 -- 172.21.15.55:0/2921902338 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f870c0ebb10 con 0x7f871c0c0930 2023-07-06T21:42:32.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f4b64e96640 1 -- 172.21.15.55:0/135625018 shutdown_connections 2023-07-06T21:42:32.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f9e93fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e9406f4b0 0x7f9e94156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f871affd640 1 --2- 172.21.15.55:0/2921902338 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8708066350 0x7f8708068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f9e93fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e940c9e00 0x7f9e9414f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f331affd640 1 -- 172.21.15.55:0/2399139497 <== osd.6 v2:172.21.15.138:6802/1391058734 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3308072b20 con 0x7f3308070020 2023-07-06T21:42:32.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f871bfff640 1 --2- 172.21.15.55:0/2921902338 >> [v2:172.21.15.55:6817/4070957199,v1:172.21.15.55:6819/4070957199] conn(0x7f870806ffa0 0x7f87080723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7fb65fe96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb65806ae50 0x7fb6580b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7fb65fe96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb658070bf0 0x7fb6581727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e93fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e940cbd80 0x7f9e9406c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65fe96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6580c3860 0x7fb6580c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e92ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e9406f4b0 0x7f9e94156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e92ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e9406f4b0 0x7f9e94156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60052/0 (socket says 172.21.15.55:60052) 2023-07-06T21:42:32.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e927fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e940c9e00 0x7f9e9414f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e927fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e940c9e00 0x7f9e9414f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:55942/0 (socket says 172.21.15.55:55942) 2023-07-06T21:42:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65dc32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb65806ae50 0x7fb6580b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65dc32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb65806ae50 0x7fb6580b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44664/0 (socket says 172.21.15.55:44664) 2023-07-06T21:42:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65dc32640 1 -- 172.21.15.55:0/1280852143 learned_addr learned my addr 172.21.15.55:0/1280852143 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65fe96640 1 -- 172.21.15.55:0/1280852143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6580c4240 con 0x7fb6580c3860 2023-07-06T21:42:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65fe96640 1 -- 172.21.15.55:0/1280852143 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6580b2810 con 0x7fb658070bf0 2023-07-06T21:42:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65fe96640 1 -- 172.21.15.55:0/1280852143 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6580b1b90 con 0x7fb65806ae50 2023-07-06T21:42:32.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e92ffd640 1 -- 172.21.15.55:0/3490497985 learned_addr learned my addr 172.21.15.55:0/3490497985 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e93fff640 1 -- 172.21.15.55:0/3490497985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9414fe10 con 0x7f9e9406f4b0 2023-07-06T21:42:32.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65e433640 1 --2- 172.21.15.55:0/1280852143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6580c3860 0x7fb6580c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e937fe640 1 --2- 172.21.15.55:0/3490497985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e940cbd80 0x7f9e9406c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e93fff640 1 -- 172.21.15.55:0/3490497985 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e94156dd0 con 0x7f9e940c9e00 2023-07-06T21:42:32.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e93fff640 1 -- 172.21.15.55:0/3490497985 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e941570b0 con 0x7f9e940cbd80 2023-07-06T21:42:32.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65dc32640 1 -- 172.21.15.55:0/1280852143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb658070bf0 msgr2=0x7fb6581727b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T21:42:32.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65dc32640 1 --2- 172.21.15.55:0/1280852143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb658070bf0 0x7fb6581727b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65dc32640 1 -- 172.21.15.55:0/1280852143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6580c3860 msgr2=0x7fb6580c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65dc32640 1 --2- 172.21.15.55:0/1280852143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6580c3860 0x7fb6580c3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65dc32640 1 -- 172.21.15.55:0/1280852143 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6540094d0 con 0x7fb65806ae50 2023-07-06T21:42:32.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65dc32640 1 --2- 172.21.15.55:0/1280852143 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb65806ae50 0x7fb6580b1490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb65401a0e0 tx=0x7fb654019250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.263+0000 7f4b64e96640 1 -- 172.21.15.55:0/135625018 wait complete. 2023-07-06T21:42:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f4b64e96640 1 Processor -- start 2023-07-06T21:42:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb64e7fc640 1 -- 172.21.15.55:0/1280852143 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540bc070 con 0x7fb65806ae50 2023-07-06T21:42:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65fe96640 1 -- 172.21.15.55:0/1280852143 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6580b1e70 con 0x7fb65806ae50 2023-07-06T21:42:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7fb65fe96640 1 -- 172.21.15.55:0/1280852143 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6580b2430 con 0x7fb65806ae50 2023-07-06T21:42:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f871bfff640 1 --2- 172.21.15.55:0/2921902338 >> [v2:172.21.15.55:6817/4070957199,v1:172.21.15.55:6819/4070957199] conn(0x7f870806ffa0 0x7f87080723d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e92ffd640 1 -- 172.21.15.55:0/3490497985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e940cbd80 msgr2=0x7f9e9406c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e92ffd640 1 --2- 172.21.15.55:0/3490497985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e940cbd80 0x7f9e9406c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e92ffd640 1 -- 172.21.15.55:0/3490497985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e940c9e00 msgr2=0x7f9e9414f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e92ffd640 1 --2- 172.21.15.55:0/3490497985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e940c9e00 0x7f9e9414f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e92ffd640 1 -- 172.21.15.55:0/3490497985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e840094d0 con 0x7f9e9406f4b0 2023-07-06T21:42:32.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e937fe640 1 --2- 172.21.15.55:0/3490497985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e940cbd80 0x7f9e9406c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:32.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f9e92ffd640 1 --2- 172.21.15.55:0/3490497985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e9406f4b0 0x7f9e94156760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9e840ae040 tx=0x7f9e84019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f871affd640 1 --2- 172.21.15.55:0/2921902338 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8708066350 0x7f8708068800 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f871c14f1a0 tx=0x7f8710008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.267+0000 7f4b64e96640 1 -- start start 2023-07-06T21:42:32.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b64e96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b60070510 0x7f4b6006c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f9e7b7fe640 1 -- 172.21.15.55:0/3490497985 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e840b4640 con 0x7f9e9406f4b0 2023-07-06T21:42:32.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7fb64e7fc640 1 -- 172.21.15.55:0/1280852143 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6540ab540 con 0x7fb65806ae50 2023-07-06T21:42:32.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7fb64e7fc640 1 -- 172.21.15.55:0/1280852143 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540ab8d0 con 0x7fb65806ae50 2023-07-06T21:42:32.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b64e96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4b60151ed0 0x7f4b60148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b64e96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4b601522a0 0x7f4b600c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f9e7b7fe640 1 -- 172.21.15.55:0/3490497985 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e840b47a0 con 0x7f9e9406f4b0 2023-07-06T21:42:32.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b5e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b60070510 0x7f4b6006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b64e96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b600c4c00 con 0x7f4b60070510 2023-07-06T21:42:32.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b64e96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b600c7ba0 con 0x7f4b601522a0 2023-07-06T21:42:32.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b64e96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b600c7270 con 0x7f4b60151ed0 2023-07-06T21:42:32.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b5e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b60070510 0x7f4b6006c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60078/0 (socket says 172.21.15.55:60078) 2023-07-06T21:42:32.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b5e59c640 1 -- 172.21.15.55:0/3485686542 learned_addr learned my addr 172.21.15.55:0/3485686542 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f9e93fff640 1 -- 172.21.15.55:0/3490497985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e94157390 con 0x7f9e9406f4b0 2023-07-06T21:42:32.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b5ed9d640 1 --2- 172.21.15.55:0/3485686542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4b601522a0 0x7f4b600c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b5e59c640 1 -- 172.21.15.55:0/3485686542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4b60151ed0 msgr2=0x7f4b60148ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T21:42:32.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b5e59c640 1 --2- 172.21.15.55:0/3485686542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4b60151ed0 0x7f4b60148ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b5e59c640 1 -- 172.21.15.55:0/3485686542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4b601522a0 msgr2=0x7f4b600c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b5e59c640 1 --2- 172.21.15.55:0/3485686542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4b601522a0 0x7f4b600c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b5e59c640 1 -- 172.21.15.55:0/3485686542 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4800a570 con 0x7f4b60070510 2023-07-06T21:42:32.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b5e59c640 1 --2- 172.21.15.55:0/3485686542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b60070510 0x7f4b6006c060 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4b4801af30 tx=0x7f4b48019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7fb65fe96640 1 -- 172.21.15.55:0/1280852143 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb640000fd0 con 0x7fb65806ae50 2023-07-06T21:42:32.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b56ffd640 1 -- 172.21.15.55:0/3485686542 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b480b7820 con 0x7f4b60070510 2023-07-06T21:42:32.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b64e96640 1 -- 172.21.15.55:0/3485686542 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b600c7550 con 0x7f4b60070510 2023-07-06T21:42:32.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b64e96640 1 -- 172.21.15.55:0/3485686542 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b600c6f60 con 0x7f4b60070510 2023-07-06T21:42:32.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f4b56ffd640 1 -- 172.21.15.55:0/3485686542 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b480b7980 con 0x7f4b60070510 2023-07-06T21:42:32.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.275+0000 7f4b56ffd640 1 -- 172.21.15.55:0/3485686542 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b480b7cf0 con 0x7f4b60070510 2023-07-06T21:42:32.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7fb64e7fc640 1 -- 172.21.15.55:0/1280852143 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb6540b3040 con 0x7fb65806ae50 2023-07-06T21:42:32.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.275+0000 7fb64e7fc640 1 --2- 172.21.15.55:0/1280852143 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb63c066380 0x7fb63c068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.275+0000 7fb64e7fc640 1 -- 172.21.15.55:0/1280852143 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb65411d620 con 0x7fb65806ae50 2023-07-06T21:42:32.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.275+0000 7fb64e7fc640 1 --2- 172.21.15.55:0/1280852143 >> [v2:172.21.15.138:6800/1249635244,v1:172.21.15.138:6801/1249635244] conn(0x7fb63c06ffd0 0x7fb63c072400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.275+0000 7fb64e7fc640 1 -- 172.21.15.55:0/1280852143 --> [v2:172.21.15.138:6800/1249635244,v1:172.21.15.138:6801/1249635244] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb63c072ad0 con 0x7fb63c06ffd0 2023-07-06T21:42:32.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.275+0000 7fb64e7fc640 1 -- 172.21.15.55:0/1280852143 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6540ea790 con 0x7fb65806ae50 2023-07-06T21:42:32.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.271+0000 7f8703fff640 1 -- 172.21.15.55:0/2921902338 <== osd.2 v2:172.21.15.55:6817/4070957199 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8708072aa0 con 0x7f870806ffa0 2023-07-06T21:42:32.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.275+0000 7fb65e433640 1 --2- 172.21.15.55:0/1280852143 >> [v2:172.21.15.138:6800/1249635244,v1:172.21.15.138:6801/1249635244] conn(0x7fb63c06ffd0 0x7fb63c072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.275+0000 7fb65e433640 1 --2- 172.21.15.55:0/1280852143 >> [v2:172.21.15.138:6800/1249635244,v1:172.21.15.138:6801/1249635244] conn(0x7fb63c06ffd0 0x7fb63c072400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.275+0000 7f4b64e96640 1 -- 172.21.15.55:0/3485686542 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b44000fd0 con 0x7f4b60070510 2023-07-06T21:42:32.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.275+0000 7fb65d431640 1 --2- 172.21.15.55:0/1280852143 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb63c066380 0x7fb63c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7fb64e7fc640 1 -- 172.21.15.55:0/1280852143 <== osd.5 v2:172.21.15.138:6800/1249635244 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb63c072ad0 con 0x7fb63c06ffd0 2023-07-06T21:42:32.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f382b7fe640 1 -- 172.21.15.55:0/2232986221 --> [v2:172.21.15.55:6800/3314779935,v1:172.21.15.55:6801/3314779935] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f38481588b0 con 0x7f382c06ffd0 2023-07-06T21:42:32.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7fb65d431640 1 --2- 172.21.15.55:0/1280852143 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb63c066380 0x7fb63c068830 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb65816ddc0 tx=0x7fb648008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f383dffb640 1 -- 172.21.15.55:0/2232986221 <== osd.0 v2:172.21.15.55:6800/3314779935 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3840007ce0 con 0x7f382c06ffd0 2023-07-06T21:42:32.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f382b7fe640 1 -- 172.21.15.55:0/2232986221 >> [v2:172.21.15.55:6800/3314779935,v1:172.21.15.55:6801/3314779935] conn(0x7f382c06ffd0 msgr2=0x7f382c072400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f382b7fe640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.55:6800/3314779935,v1:172.21.15.55:6801/3314779935] conn(0x7f382c06ffd0 0x7f382c072400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f9e93fff640 1 -- 172.21.15.55:0/3490497985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e940ada80 con 0x7f9e9406f4b0 2023-07-06T21:42:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f9e7b7fe640 1 -- 172.21.15.55:0/3490497985 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e840b4b50 con 0x7f9e9406f4b0 2023-07-06T21:42:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f9e7b7fe640 1 -- 172.21.15.55:0/3490497985 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e840b2070 con 0x7f9e9406f4b0 2023-07-06T21:42:32.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f4b56ffd640 1 -- 172.21.15.55:0/3485686542 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b480af400 con 0x7f4b60070510 2023-07-06T21:42:32.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f4b56ffd640 1 --2- 172.21.15.55:0/3485686542 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4b40066350 0x7f4b40068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f4b56ffd640 1 -- 172.21.15.55:0/3485686542 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b4811e8f0 con 0x7f4b60070510 2023-07-06T21:42:32.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f4b56ffd640 1 --2- 172.21.15.55:0/3485686542 >> [v2:172.21.15.138:6816/3688560884,v1:172.21.15.138:6817/3688560884] conn(0x7f4b4006fe30 0x7f4b40072260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f4b56ffd640 1 -- 172.21.15.55:0/3485686542 --> [v2:172.21.15.138:6816/3688560884,v1:172.21.15.138:6817/3688560884] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4b40072930 con 0x7f4b4006fe30 2023-07-06T21:42:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f4b5dd9b640 1 --2- 172.21.15.55:0/3485686542 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4b40066350 0x7f4b40068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f4b56ffd640 1 -- 172.21.15.55:0/3485686542 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b480ebcc0 con 0x7f4b60070510 2023-07-06T21:42:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f9e7b7fe640 1 --2- 172.21.15.55:0/3490497985 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9e80066350 0x7f9e80068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.279+0000 7f4b5ed9d640 1 --2- 172.21.15.55:0/3485686542 >> [v2:172.21.15.138:6816/3688560884,v1:172.21.15.138:6817/3688560884] conn(0x7f4b4006fe30 0x7f4b40072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f382b7fe640 1 -- 172.21.15.55:0/2232986221 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f382c066380 msgr2=0x7f382c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f382b7fe640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f382c066380 0x7f382c068830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f38480cbce0 tx=0x7f3844009040 comp rx=0 tx=0).stop 2023-07-06T21:42:32.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f382b7fe640 1 -- 172.21.15.55:0/2232986221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3848070450 msgr2=0x7f38481527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f382b7fe640 1 --2- 172.21.15.55:0/2232986221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3848070450 0x7f38481527c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f383800b2c0 tx=0x7f383801d420 comp rx=0 tx=0).stop 2023-07-06T21:42:32.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f384dde5640 1 -- 172.21.15.55:0/2232986221 reap_dead start 2023-07-06T21:42:32.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f382b7fe640 1 -- 172.21.15.55:0/2232986221 shutdown_connections 2023-07-06T21:42:32.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f382b7fe640 1 -- 172.21.15.55:0/2232986221 >> 172.21.15.55:0/2232986221 conn(0x7f38480ca690 msgr2=0x7f38480ac3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f382b7fe640 1 -- 172.21.15.55:0/2232986221 shutdown_connections 2023-07-06T21:42:32.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f382b7fe640 1 -- 172.21.15.55:0/2232986221 wait complete. 2023-07-06T21:42:32.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f4b5ed9d640 1 --2- 172.21.15.55:0/3485686542 >> [v2:172.21.15.138:6816/3688560884,v1:172.21.15.138:6817/3688560884] conn(0x7f4b4006fe30 0x7f4b40072260 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1372401176 --> [v2:172.21.15.55:6808/2677129803,v1:172.21.15.55:6809/2677129803] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdeec066d60 con 0x7fded8070020 2023-07-06T21:42:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f4b56ffd640 1 -- 172.21.15.55:0/3485686542 <== osd.7 v2:172.21.15.138:6816/3688560884 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4b40072930 con 0x7f4b4006fe30 2023-07-06T21:42:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f9e927fc640 1 --2- 172.21.15.55:0/3490497985 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9e80066350 0x7f9e80068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f9e797fa640 1 -- 172.21.15.55:0/3490497985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e940ca2a0 con 0x7f9e9406f4b0 2023-07-06T21:42:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f9e7b7fe640 1 -- 172.21.15.55:0/3490497985 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9e840ead60 con 0x7f9e9406f4b0 2023-07-06T21:42:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f9e7b7fe640 1 --2- 172.21.15.55:0/3490497985 >> [v2:172.21.15.138:6824/851191383,v1:172.21.15.138:6825/851191383] conn(0x7f9e8006fe30 0x7f9e80072260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f9e7b7fe640 1 -- 172.21.15.55:0/3490497985 --> [v2:172.21.15.138:6824/851191383,v1:172.21.15.138:6825/851191383] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e80072930 con 0x7f9e8006fe30 2023-07-06T21:42:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f9e927fc640 1 --2- 172.21.15.55:0/3490497985 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9e80066350 0x7f9e80068800 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9e9406a9c0 tx=0x7f9e88008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f9e7b7fe640 1 -- 172.21.15.55:0/3490497985 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e840ea8d0 con 0x7f9e9406f4b0 2023-07-06T21:42:32.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f9e937fe640 1 --2- 172.21.15.55:0/3490497985 >> [v2:172.21.15.138:6824/851191383,v1:172.21.15.138:6825/851191383] conn(0x7f9e8006fe30 0x7f9e80072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7fded3fff640 1 -- 172.21.15.55:0/1372401176 <== osd.3 v2:172.21.15.55:6808/2677129803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdeec066d60 con 0x7fded8070020 2023-07-06T21:42:32.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1372401176 >> [v2:172.21.15.55:6808/2677129803,v1:172.21.15.55:6809/2677129803] conn(0x7fded8070020 msgr2=0x7fded8072450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7fdef1ef9640 1 --2- 172.21.15.55:0/1372401176 >> [v2:172.21.15.55:6808/2677129803,v1:172.21.15.55:6809/2677129803] conn(0x7fded8070020 0x7fded8072450 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1372401176 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fded8066350 msgr2=0x7fded8068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7fdef1ef9640 1 --2- 172.21.15.55:0/1372401176 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fded8066350 0x7fded8068800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0ae000 tx=0x7fdedc0a7000 comp rx=0 tx=0).stop 2023-07-06T21:42:32.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f9e937fe640 1 --2- 172.21.15.55:0/3490497985 >> [v2:172.21.15.138:6824/851191383,v1:172.21.15.138:6825/851191383] conn(0x7f9e8006fe30 0x7f9e80072260 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.283+0000 7f4b5dd9b640 1 --2- 172.21.15.55:0/3485686542 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4b40066350 0x7f4b40068800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4b600b24b0 tx=0x7f4b5800f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.287+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1372401176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeec0ad0c0 msgr2=0x7fdeec0c0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.287+0000 7fdef1ef9640 1 --2- 172.21.15.55:0/1372401176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeec0ad0c0 0x7fdeec0c0c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdee400c7f0 tx=0x7fdee400ccb0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.287+0000 7fdeebfff640 1 -- 172.21.15.55:0/1372401176 reap_dead start 2023-07-06T21:42:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.287+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1372401176 shutdown_connections 2023-07-06T21:42:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.287+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1372401176 >> 172.21.15.55:0/1372401176 conn(0x7fdeec0cea70 msgr2=0x7fdeec070110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.287+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1372401176 shutdown_connections 2023-07-06T21:42:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.287+0000 7f9e7b7fe640 1 -- 172.21.15.55:0/3490497985 <== osd.4 v2:172.21.15.138:6824/851191383 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9e80072930 con 0x7f9e8006fe30 2023-07-06T21:42:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.287+0000 7fdef1ef9640 1 -- 172.21.15.55:0/1372401176 wait complete. 2023-07-06T21:42:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.287+0000 7fbe9e900640 1 -- 172.21.15.55:0/3633224698 --> [v2:172.21.15.55:6816/110907122,v1:172.21.15.55:6818/110907122] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe9806f650 con 0x7fbe7806feb0 2023-07-06T21:42:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.287+0000 7fbe957fa640 1 -- 172.21.15.55:0/3633224698 <== osd.1 v2:172.21.15.55:6816/110907122 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe880096a0 con 0x7fbe7806feb0 2023-07-06T21:42:32.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.295+0000 7fb65fe96640 1 -- 172.21.15.55:0/1280852143 --> [v2:172.21.15.138:6800/1249635244,v1:172.21.15.138:6801/1249635244] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb640002cc0 con 0x7fb63c06ffd0 2023-07-06T21:42:32.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.295+0000 7fb64e7fc640 1 -- 172.21.15.55:0/1280852143 <== osd.5 v2:172.21.15.138:6800/1249635244 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb640002cc0 con 0x7fb63c06ffd0 2023-07-06T21:42:32.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fbe9e900640 1 -- 172.21.15.55:0/3633224698 >> [v2:172.21.15.55:6816/110907122,v1:172.21.15.55:6818/110907122] conn(0x7fbe7806feb0 msgr2=0x7fbe780722e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fbe9e900640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.55:6816/110907122,v1:172.21.15.55:6818/110907122] conn(0x7fbe7806feb0 0x7fbe780722e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fb65fe96640 1 -- 172.21.15.55:0/1280852143 >> [v2:172.21.15.138:6800/1249635244,v1:172.21.15.138:6801/1249635244] conn(0x7fb63c06ffd0 msgr2=0x7fb63c072400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fb65fe96640 1 --2- 172.21.15.55:0/1280852143 >> [v2:172.21.15.138:6800/1249635244,v1:172.21.15.138:6801/1249635244] conn(0x7fb63c06ffd0 0x7fb63c072400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fb65fe96640 1 -- 172.21.15.55:0/1280852143 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb63c066380 msgr2=0x7fb63c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fb65fe96640 1 --2- 172.21.15.55:0/1280852143 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb63c066380 0x7fb63c068830 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb65816ddc0 tx=0x7fb648008040 comp rx=0 tx=0).stop 2023-07-06T21:42:32.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fb65fe96640 1 -- 172.21.15.55:0/1280852143 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb65806ae50 msgr2=0x7fb6580b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fb65fe96640 1 --2- 172.21.15.55:0/1280852143 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb65806ae50 0x7fb6580b1490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb65401a0e0 tx=0x7fb654019250 comp rx=0 tx=0).stop 2023-07-06T21:42:32.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fb65e433640 1 -- 172.21.15.55:0/1280852143 reap_dead start 2023-07-06T21:42:32.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fb65fe96640 1 -- 172.21.15.55:0/1280852143 shutdown_connections 2023-07-06T21:42:32.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fb65fe96640 1 -- 172.21.15.55:0/1280852143 >> 172.21.15.55:0/1280852143 conn(0x7fb6580ce8a0 msgr2=0x7fb6581735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fbe9e900640 1 -- 172.21.15.55:0/3633224698 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbe78066350 msgr2=0x7fbe78068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fb65fe96640 1 -- 172.21.15.55:0/1280852143 shutdown_connections 2023-07-06T21:42:32.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fb65fe96640 1 -- 172.21.15.55:0/1280852143 wait complete. 2023-07-06T21:42:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fbe9e900640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbe78066350 0x7fbe78068800 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009da0 tx=0x7fbe80009110 comp rx=0 tx=0).stop 2023-07-06T21:42:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fbe9e900640 1 -- 172.21.15.55:0/3633224698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe98157ac0 msgr2=0x7fbe980c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fbe9e900640 1 --2- 172.21.15.55:0/3633224698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe98157ac0 0x7fbe980c6b40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbe900af000 tx=0x7fbe9001ba80 comp rx=0 tx=0).stop 2023-07-06T21:42:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fbe9ce9d640 1 -- 172.21.15.55:0/3633224698 reap_dead start 2023-07-06T21:42:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fbe9e900640 1 -- 172.21.15.55:0/3633224698 shutdown_connections 2023-07-06T21:42:32.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fbe9e900640 1 -- 172.21.15.55:0/3633224698 >> 172.21.15.55:0/3633224698 conn(0x7fbe980ce8a0 msgr2=0x7fbe98069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fbe9e900640 1 -- 172.21.15.55:0/3633224698 shutdown_connections 2023-07-06T21:42:32.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7fbe9e900640 1 -- 172.21.15.55:0/3633224698 wait complete. 2023-07-06T21:42:32.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.299+0000 7f3318ff9640 1 -- 172.21.15.55:0/2399139497 --> [v2:172.21.15.138:6802/1391058734,v1:172.21.15.138:6804/1391058734] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f332404d790 con 0x7f3308070020 2023-07-06T21:42:32.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.303+0000 7f331affd640 1 -- 172.21.15.55:0/2399139497 <== osd.6 v2:172.21.15.138:6802/1391058734 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f332404d790 con 0x7f3308070020 2023-07-06T21:42:32.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.303+0000 7f3318ff9640 1 -- 172.21.15.55:0/2399139497 >> [v2:172.21.15.138:6802/1391058734,v1:172.21.15.138:6804/1391058734] conn(0x7f3308070020 msgr2=0x7f3308072450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.303+0000 7f8701ffb640 1 -- 172.21.15.55:0/2921902338 --> [v2:172.21.15.55:6817/4070957199,v1:172.21.15.55:6819/4070957199] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f871c06a460 con 0x7f870806ffa0 2023-07-06T21:42:32.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.303+0000 7f3318ff9640 1 --2- 172.21.15.55:0/2399139497 >> [v2:172.21.15.138:6802/1391058734,v1:172.21.15.138:6804/1391058734] conn(0x7f3308070020 0x7f3308072450 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.303+0000 7f3318ff9640 1 -- 172.21.15.55:0/2399139497 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3308066350 msgr2=0x7f3308068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.303+0000 7f3318ff9640 1 --2- 172.21.15.55:0/2399139497 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3308066350 0x7f3308068800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3324155f40 tx=0x7f331c009830 comp rx=0 tx=0).stop 2023-07-06T21:42:32.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.303+0000 7f8703fff640 1 -- 172.21.15.55:0/2921902338 <== osd.2 v2:172.21.15.55:6817/4070957199 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f871c06a460 con 0x7f870806ffa0 2023-07-06T21:42:32.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.303+0000 7f3318ff9640 1 -- 172.21.15.55:0/2399139497 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3324069930 msgr2=0x7f33240c40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.303+0000 7f3318ff9640 1 --2- 172.21.15.55:0/2399139497 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3324069930 0x7f33240c40d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f331401a0a0 tx=0x7f3314019210 comp rx=0 tx=0).stop 2023-07-06T21:42:32.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.303+0000 7f332a911640 1 -- 172.21.15.55:0/2399139497 reap_dead start 2023-07-06T21:42:32.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.303+0000 7f3318ff9640 1 -- 172.21.15.55:0/2399139497 shutdown_connections 2023-07-06T21:42:32.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.303+0000 7f3318ff9640 1 -- 172.21.15.55:0/2399139497 >> 172.21.15.55:0/2399139497 conn(0x7f33240ce8a0 msgr2=0x7f3324156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.303+0000 7f8721d82640 1 -- 172.21.15.55:0/2921902338 >> [v2:172.21.15.55:6817/4070957199,v1:172.21.15.55:6819/4070957199] conn(0x7f870806ffa0 msgr2=0x7f87080723d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.303+0000 7f8721d82640 1 --2- 172.21.15.55:0/2921902338 >> [v2:172.21.15.55:6817/4070957199,v1:172.21.15.55:6819/4070957199] conn(0x7f870806ffa0 0x7f87080723d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.307+0000 7f3318ff9640 1 -- 172.21.15.55:0/2399139497 shutdown_connections 2023-07-06T21:42:32.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.307+0000 7f3318ff9640 1 -- 172.21.15.55:0/2399139497 wait complete. 2023-07-06T21:42:32.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.307+0000 7f8721d82640 1 -- 172.21.15.55:0/2921902338 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8708066350 msgr2=0x7f8708068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.307+0000 7f8721d82640 1 --2- 172.21.15.55:0/2921902338 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8708066350 0x7f8708068800 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f871c14f1a0 tx=0x7f8710008040 comp rx=0 tx=0).stop 2023-07-06T21:42:32.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.307+0000 7f8721d82640 1 -- 172.21.15.55:0/2921902338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f871c0c0930 msgr2=0x7f871c06a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.307+0000 7f8721d82640 1 --2- 172.21.15.55:0/2921902338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f871c0c0930 0x7f871c06a610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f870c0ad040 tx=0x7f870c0191a0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.307+0000 7f871bfff640 1 -- 172.21.15.55:0/2921902338 reap_dead start 2023-07-06T21:42:32.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.307+0000 7f8721d82640 1 -- 172.21.15.55:0/2921902338 shutdown_connections 2023-07-06T21:42:32.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.307+0000 7f8721d82640 1 -- 172.21.15.55:0/2921902338 >> 172.21.15.55:0/2921902338 conn(0x7f871c0ca690 msgr2=0x7f871c161bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.307+0000 7f8721d82640 1 -- 172.21.15.55:0/2921902338 shutdown_connections 2023-07-06T21:42:32.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.307+0000 7f8721d82640 1 -- 172.21.15.55:0/2921902338 wait complete. 2023-07-06T21:42:32.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.311+0000 7f4b64e96640 1 -- 172.21.15.55:0/3485686542 --> [v2:172.21.15.138:6816/3688560884,v1:172.21.15.138:6817/3688560884] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4b44002cc0 con 0x7f4b4006fe30 2023-07-06T21:42:32.381 INFO:teuthology.orchestra.run.smithi055.stdout:55834574857 2023-07-06T21:42:32.382 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-06T21:42:32.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.315+0000 7f4b56ffd640 1 -- 172.21.15.55:0/3485686542 <== osd.7 v2:172.21.15.138:6816/3688560884 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4b44002cc0 con 0x7f4b4006fe30 2023-07-06T21:42:32.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.315+0000 7f4b64e96640 1 -- 172.21.15.55:0/3485686542 >> [v2:172.21.15.138:6816/3688560884,v1:172.21.15.138:6817/3688560884] conn(0x7f4b4006fe30 msgr2=0x7f4b40072260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.315+0000 7f4b64e96640 1 --2- 172.21.15.55:0/3485686542 >> [v2:172.21.15.138:6816/3688560884,v1:172.21.15.138:6817/3688560884] conn(0x7f4b4006fe30 0x7f4b40072260 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.315+0000 7f4b64e96640 1 -- 172.21.15.55:0/3485686542 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4b40066350 msgr2=0x7f4b40068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.315+0000 7f4b64e96640 1 --2- 172.21.15.55:0/3485686542 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4b40066350 0x7f4b40068800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4b600b24b0 tx=0x7f4b5800f040 comp rx=0 tx=0).stop 2023-07-06T21:42:32.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.315+0000 7f9e797fa640 1 -- 172.21.15.55:0/3490497985 --> [v2:172.21.15.138:6824/851191383,v1:172.21.15.138:6825/851191383] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9e9404d790 con 0x7f9e8006fe30 2023-07-06T21:42:32.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f4b64e96640 1 -- 172.21.15.55:0/3485686542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b60070510 msgr2=0x7f4b6006c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f4b64e96640 1 --2- 172.21.15.55:0/3485686542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b60070510 0x7f4b6006c060 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4b4801af30 tx=0x7f4b48019620 comp rx=0 tx=0).stop 2023-07-06T21:42:32.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f4b5ed9d640 1 -- 172.21.15.55:0/3485686542 reap_dead start 2023-07-06T21:42:32.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f4b64e96640 1 -- 172.21.15.55:0/3485686542 shutdown_connections 2023-07-06T21:42:32.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f4b64e96640 1 -- 172.21.15.55:0/3485686542 >> 172.21.15.55:0/3485686542 conn(0x7f4b600cea70 msgr2=0x7f4b6014a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f4b64e96640 1 -- 172.21.15.55:0/3485686542 shutdown_connections 2023-07-06T21:42:32.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f4b64e96640 1 -- 172.21.15.55:0/3485686542 wait complete. 2023-07-06T21:42:32.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f9e7b7fe640 1 -- 172.21.15.55:0/3490497985 <== osd.4 v2:172.21.15.138:6824/851191383 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9e9404d790 con 0x7f9e8006fe30 2023-07-06T21:42:32.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f9e797fa640 1 -- 172.21.15.55:0/3490497985 >> [v2:172.21.15.138:6824/851191383,v1:172.21.15.138:6825/851191383] conn(0x7f9e8006fe30 msgr2=0x7f9e80072260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f9e797fa640 1 --2- 172.21.15.55:0/3490497985 >> [v2:172.21.15.138:6824/851191383,v1:172.21.15.138:6825/851191383] conn(0x7f9e8006fe30 0x7f9e80072260 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f9e797fa640 1 -- 172.21.15.55:0/3490497985 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9e80066350 msgr2=0x7f9e80068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f9e797fa640 1 --2- 172.21.15.55:0/3490497985 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9e80066350 0x7f9e80068800 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9e9406a9c0 tx=0x7f9e88008040 comp rx=0 tx=0).stop 2023-07-06T21:42:32.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f9e797fa640 1 -- 172.21.15.55:0/3490497985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e9406f4b0 msgr2=0x7f9e94156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f9e797fa640 1 --2- 172.21.15.55:0/3490497985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e9406f4b0 0x7f9e94156760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9e840ae040 tx=0x7f9e84019290 comp rx=0 tx=0).stop 2023-07-06T21:42:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f9e937fe640 1 -- 172.21.15.55:0/3490497985 reap_dead start 2023-07-06T21:42:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f9e797fa640 1 -- 172.21.15.55:0/3490497985 shutdown_connections 2023-07-06T21:42:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f9e797fa640 1 -- 172.21.15.55:0/3490497985 >> 172.21.15.55:0/3490497985 conn(0x7f9e940cdbf0 msgr2=0x7f9e940cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f9e797fa640 1 -- 172.21.15.55:0/3490497985 shutdown_connections 2023-07-06T21:42:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.319+0000 7f9e797fa640 1 -- 172.21.15.55:0/3490497985 wait complete. 2023-07-06T21:42:32.389 INFO:teuthology.orchestra.run.smithi055.stdout:55834574857 2023-07-06T21:42:32.389 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-06T21:42:32.390 INFO:teuthology.orchestra.run.smithi055.stdout:55834574857 2023-07-06T21:42:32.391 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-06T21:42:32.391 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-07-06T21:42:32.392 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-06T21:42:32.393 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-07-06T21:42:32.393 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-06T21:42:32.394 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2023-07-06T21:42:32.394 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-06T21:42:32.395 INFO:teuthology.orchestra.run.smithi055.stdout:55834574857 2023-07-06T21:42:32.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-06T21:42:32.396 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-07-06T21:42:32.397 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-06T21:42:32.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.675+0000 7f8b65f03640 1 Processor -- start 2023-07-06T21:42:32.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.675+0000 7f8b65f03640 1 -- start start 2023-07-06T21:42:32.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.675+0000 7f8b65f03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b6006bc30 0x7f8b600c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.675+0000 7f8b65f03640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b600cc070 0x7f8b6006ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.679+0000 7f8b65f03640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b600aca40 con 0x7f8b6006b860 2023-07-06T21:42:32.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.679+0000 7f8b65f03640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b600c9a20 con 0x7f8b6006bc30 2023-07-06T21:42:32.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.679+0000 7f8b65f03640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600abe30 con 0x7f8b600cc070 2023-07-06T21:42:32.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.679+0000 7f8b5effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b6006bc30 0x7f8b600c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.679+0000 7f8b5effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b6006bc30 0x7f8b600c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60086/0 (socket says 172.21.15.55:60086) 2023-07-06T21:42:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.679+0000 7f8b5effd640 1 -- 172.21.15.55:0/1180523473 learned_addr learned my addr 172.21.15.55:0/1180523473 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.679+0000 7f8b5ffff640 1 --2- 172.21.15.55:0/1180523473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b600cc070 0x7f8b6006ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.679+0000 7f8b5effd640 1 -- 172.21.15.55:0/1180523473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b600cc070 msgr2=0x7f8b6006ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.679+0000 7f8b5effd640 1 --2- 172.21.15.55:0/1180523473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b600cc070 0x7f8b6006ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.679+0000 7f8b5effd640 1 -- 172.21.15.55:0/1180523473 >> v1:172.21.15.138:6789/0 conn(0x7f8b6006b860 legacy=0x7f8b600cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.679+0000 7f8b5effd640 1 -- 172.21.15.55:0/1180523473 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b600ac110 con 0x7f8b6006bc30 2023-07-06T21:42:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.683+0000 7f8b5effd640 1 --2- 172.21.15.55:0/1180523473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b6006bc30 0x7f8b600c94e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009e50 tx=0x7f8b5801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3861a48043a3cbe server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.683+0000 7f8b5e7fc640 1 -- 172.21.15.55:0/1180523473 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580a5820 con 0x7f8b6006bc30 2023-07-06T21:42:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.687+0000 7f8b5e7fc640 1 -- 172.21.15.55:0/1180523473 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b580a5980 con 0x7f8b6006bc30 2023-07-06T21:42:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.687+0000 7f8b5e7fc640 1 -- 172.21.15.55:0/1180523473 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580a5d10 con 0x7f8b6006bc30 2023-07-06T21:42:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.687+0000 7f8b65f03640 1 -- 172.21.15.55:0/1180523473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b6006bc30 msgr2=0x7f8b600c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.687+0000 7f8b65f03640 1 --2- 172.21.15.55:0/1180523473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b6006bc30 0x7f8b600c94e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009e50 tx=0x7f8b5801c9a0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.687+0000 7f8b65f03640 1 -- 172.21.15.55:0/1180523473 shutdown_connections 2023-07-06T21:42:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.687+0000 7f8b65f03640 1 --2- 172.21.15.55:0/1180523473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b600cc070 0x7f8b6006ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.687+0000 7f8b65f03640 1 --2- 172.21.15.55:0/1180523473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b6006bc30 0x7f8b600c94e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.687+0000 7f8b65f03640 1 -- 172.21.15.55:0/1180523473 >> 172.21.15.55:0/1180523473 conn(0x7f8b600ce8a0 msgr2=0x7f8b600ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.687+0000 7f8b65f03640 1 -- 172.21.15.55:0/1180523473 shutdown_connections 2023-07-06T21:42:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.687+0000 7f8b65f03640 1 -- 172.21.15.55:0/1180523473 wait complete. 2023-07-06T21:42:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b65f03640 1 Processor -- start 2023-07-06T21:42:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b65f03640 1 -- start start 2023-07-06T21:42:32.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b65f03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b6006b860 0x7f8b60153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b65f03640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b6006bc30 0x7f8b6015b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b65f03640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b600cc070 0x7f8b60164680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b65f03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b601541f0 con 0x7f8b6006b860 2023-07-06T21:42:32.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b65f03640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6015a180 con 0x7f8b6006bc30 2023-07-06T21:42:32.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b65f03640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60159570 con 0x7f8b600cc070 2023-07-06T21:42:32.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b5effd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b6006bc30 0x7f8b6015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b5f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b6006b860 0x7f8b60153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b5ffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b600cc070 0x7f8b60164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b5effd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b6006bc30 0x7f8b6015b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:55972/0 (socket says 172.21.15.55:55972) 2023-07-06T21:42:32.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b5effd640 1 -- 172.21.15.55:0/4001419306 learned_addr learned my addr 172.21.15.55:0/4001419306 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b5ffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b600cc070 0x7f8b60164680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44700/0 (socket says 172.21.15.55:44700) 2023-07-06T21:42:32.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7fc0b166d640 1 Processor -- start 2023-07-06T21:42:32.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b5effd640 1 -- 172.21.15.55:0/4001419306 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b600cc070 msgr2=0x7f8b60164680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b5effd640 1 --2- 172.21.15.55:0/4001419306 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b600cc070 0x7f8b60164680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b5effd640 1 -- 172.21.15.55:0/4001419306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b6006b860 msgr2=0x7f8b60153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b5effd640 1 --2- 172.21.15.55:0/4001419306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b6006b860 0x7f8b60153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b5effd640 1 -- 172.21.15.55:0/4001419306 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b58009b30 con 0x7f8b6006bc30 2023-07-06T21:42:32.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7f8b5ffff640 1 --2- 172.21.15.55:0/4001419306 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b600cc070 0x7f8b60164680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:32.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7f8b5effd640 1 --2- 172.21.15.55:0/4001419306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b6006bc30 0x7f8b6015b090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b5801d240 tx=0x7f8b58019740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7f8b4ffff640 1 -- 172.21.15.55:0/4001419306 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580b8880 con 0x7f8b6006bc30 2023-07-06T21:42:32.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7f8b4ffff640 1 -- 172.21.15.55:0/4001419306 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b580b8a20 con 0x7f8b6006bc30 2023-07-06T21:42:32.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7f8b65f03640 1 -- 172.21.15.55:0/4001419306 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b60159850 con 0x7f8b6006bc30 2023-07-06T21:42:32.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7f8b65f03640 1 -- 172.21.15.55:0/4001419306 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b60159e10 con 0x7f8b6006bc30 2023-07-06T21:42:32.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7f8b4ffff640 1 -- 172.21.15.55:0/4001419306 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580b8dd0 con 0x7f8b6006bc30 2023-07-06T21:42:32.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7f8b65f03640 1 -- 172.21.15.55:0/4001419306 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c005260 con 0x7f8b6006bc30 2023-07-06T21:42:32.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.691+0000 7fc0b166d640 1 -- start start 2023-07-06T21:42:32.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7fc0b166d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0ac0ca100 0x7fc0ac0693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7fc0b166d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ac0cb7f0 con 0x7fc0ac069930 2023-07-06T21:42:32.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7fc0b166d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ac0cbad0 con 0x7fc0ac157ac0 2023-07-06T21:42:32.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7fc0b166d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac0cc470 con 0x7fc0ac0ca100 2023-07-06T21:42:32.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7fc0aa7fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0ac0ca100 0x7fc0ac0693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7fc0aaffd640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fc0ac157ac0 0x7fc0ac0c90f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:47610/0 (socket says 172.21.15.55:47610) 2023-07-06T21:42:32.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7fc0aaffd640 1 -- 172.21.15.55:0/44909421 learned_addr learned my addr 172.21.15.55:0/44909421 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:32.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f8b4ffff640 1 -- 172.21.15.55:0/4001419306 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8b580b6440 con 0x7f8b6006bc30 2023-07-06T21:42:32.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.695+0000 7f02e94af640 1 Processor -- start 2023-07-06T21:42:32.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f02e94af640 1 -- start start 2023-07-06T21:42:32.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f7be6a34640 1 Processor -- start 2023-07-06T21:42:32.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7fc0aa7fc640 1 -- 172.21.15.55:0/44909421 >> v1:172.21.15.138:6789/0 conn(0x7fc0ac157ac0 legacy=0x7fc0ac0c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7fc0aa7fc640 1 -- 172.21.15.55:0/44909421 >> v1:172.21.15.55:6789/0 conn(0x7fc0ac069930 legacy=0x7fc0ac06ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7fc0aa7fc640 1 -- 172.21.15.55:0/44909421 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac0cbdb0 con 0x7fc0ac0ca100 2023-07-06T21:42:32.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f02e94af640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f02e40b1250 0x7f02e415f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f7be6a34640 1 -- start start 2023-07-06T21:42:32.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f02e94af640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02e40d0630 0x7f02e415f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f02e3fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f02e40b1250 0x7f02e415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f02e3fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f02e40b1250 0x7f02e415f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:55986/0 (socket says 172.21.15.55:55986) 2023-07-06T21:42:32.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f02e94af640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e40cc740 con 0x7f02e415fe00 2023-07-06T21:42:32.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f02e94af640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e4160240 con 0x7f02e40d0630 2023-07-06T21:42:32.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f02e94af640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e40ccc90 con 0x7f02e40b1250 2023-07-06T21:42:32.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f02e3fff640 1 -- 172.21.15.55:0/555124857 learned_addr learned my addr 172.21.15.55:0/555124857 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f8b4ffff640 1 --2- 172.21.15.55:0/4001419306 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8b44066320 0x7f8b440687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f3ab3305640 1 Processor -- start 2023-07-06T21:42:32.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f3ab3305640 1 -- start start 2023-07-06T21:42:32.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f02e3fff640 1 -- 172.21.15.55:0/555124857 >> v2:172.21.15.55:3300/0 conn(0x7f02e40d0630 msgr2=0x7f02e415f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f02e3fff640 1 --2- 172.21.15.55:0/555124857 >> v2:172.21.15.55:3300/0 conn(0x7f02e40d0630 0x7f02e415f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f02e3fff640 1 -- 172.21.15.55:0/555124857 >> v1:172.21.15.138:6789/0 conn(0x7f02e415fe00 legacy=0x7f02e40b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f02e3fff640 1 -- 172.21.15.55:0/555124857 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e40d1d10 con 0x7f02e40b1250 2023-07-06T21:42:32.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.699+0000 7f8b4ffff640 1 -- 172.21.15.55:0/4001419306 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8b5811f500 con 0x7f8b6006bc30 2023-07-06T21:42:32.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f7be6a34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7be00ca160 0x7f7be0152110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f7be6a34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be00cc930 con 0x7f7be0151c70 2023-07-06T21:42:32.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f7be6a34640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be01590a0 con 0x7f7be00caf70 2023-07-06T21:42:32.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f7be6a34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be015b9c0 con 0x7f7be00ca160 2023-07-06T21:42:32.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f7bdffff640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f7be00caf70 0x7f7be006ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:47636/0 (socket says 172.21.15.55:47636) 2023-07-06T21:42:32.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f7bdffff640 1 -- 172.21.15.55:0/325819291 learned_addr learned my addr 172.21.15.55:0/325819291 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:32.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f8b5f7fe640 1 --2- 172.21.15.55:0/4001419306 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8b44066320 0x7f8b440687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f7be4fd1640 1 --2- 172.21.15.55:0/325819291 >> v2:172.21.15.55:3300/0 conn(0x7f7be00ca160 0x7f7be0152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f3ab3305640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3aac15fd50 0x7f3aac0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f7bdeffd640 1 -- 172.21.15.55:0/325819291 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812513685 0 0) 0x7f7be01590a0 con 0x7f7be00caf70 2023-07-06T21:42:32.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f3ab3305640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3aac0c0d20 0x7f3aac0cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f7bdeffd640 1 -- 172.21.15.55:0/325819291 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc8003530 con 0x7f7be00caf70 2023-07-06T21:42:32.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f7bdeffd640 1 -- 172.21.15.55:0/325819291 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300882741 0 0) 0x7f7be00cc930 con 0x7f7be0151c70 2023-07-06T21:42:32.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f3ab3305640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aac0710d0 con 0x7f3aac0c9e30 2023-07-06T21:42:32.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f3ab3305640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aac0cc9c0 con 0x7f3aac0c0d20 2023-07-06T21:42:32.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f3ab3305640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aac070550 con 0x7f3aac15fd50 2023-07-06T21:42:32.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f3ab2303640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3aac15fd50 0x7f3aac0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f3ab2303640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3aac15fd50 0x7f3aac0cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:56000/0 (socket says 172.21.15.55:56000) 2023-07-06T21:42:32.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f3ab2303640 1 -- 172.21.15.55:0/723947024 learned_addr learned my addr 172.21.15.55:0/723947024 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f3ab2303640 1 -- 172.21.15.55:0/723947024 >> v2:172.21.15.55:3300/0 conn(0x7f3aac0c0d20 msgr2=0x7f3aac0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f8b4ffff640 1 -- 172.21.15.55:0/4001419306 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8b580ec7b0 con 0x7f8b6006bc30 2023-07-06T21:42:32.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f8b5f7fe640 1 --2- 172.21.15.55:0/4001419306 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8b44066320 0x7f8b440687d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8b540098e0 tx=0x7f8b54009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f3ab1b02640 1 --2- 172.21.15.55:0/723947024 >> v2:172.21.15.55:3300/0 conn(0x7f3aac0c0d20 0x7f3aac0cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f3ab2303640 1 --2- 172.21.15.55:0/723947024 >> v2:172.21.15.55:3300/0 conn(0x7f3aac0c0d20 0x7f3aac0cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f3ab2303640 1 -- 172.21.15.55:0/723947024 >> v1:172.21.15.55:6789/0 conn(0x7f3aac0c9e30 legacy=0x7f3aac163a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f3ab2303640 1 -- 172.21.15.55:0/723947024 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac070830 con 0x7f3aac15fd50 2023-07-06T21:42:32.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f3ab1b02640 1 --2- 172.21.15.55:0/723947024 >> v2:172.21.15.55:3300/0 conn(0x7f3aac0c0d20 0x7f3aac0cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:32.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fba25648640 1 Processor -- start 2023-07-06T21:42:32.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fba25648640 1 -- start start 2023-07-06T21:42:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7f02e3fff640 1 --2- 172.21.15.55:0/555124857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02e40b1250 0x7f02e415f380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02e408a100 tx=0x7f02d401c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3959e9d796a79ceb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f7be4fd1640 1 -- 172.21.15.55:0/325819291 >> v1:172.21.15.138:6789/0 conn(0x7f7be00caf70 legacy=0x7f7be006ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f7be4fd1640 1 -- 172.21.15.55:0/325819291 >> v1:172.21.15.55:6789/0 conn(0x7f7be0151c70 legacy=0x7f7be00c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.703+0000 7f7be4fd1640 1 -- 172.21.15.55:0/325819291 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be015bca0 con 0x7f7be00ca160 2023-07-06T21:42:32.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fd610c76640 1 Processor -- start 2023-07-06T21:42:32.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fc0aa7fc640 1 --2- 172.21.15.55:0/44909421 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0ac0ca100 0x7fc0ac0693f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0090e0 tx=0x7fc09c01d680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbc8ad5b98bb5078 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7f02e37fe640 1 -- 172.21.15.55:0/555124857 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d40ac410 con 0x7f02e40b1250 2023-07-06T21:42:32.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7f02e37fe640 1 -- 172.21.15.55:0/555124857 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d40ac570 con 0x7f02e40b1250 2023-07-06T21:42:32.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7f02e37fe640 1 -- 172.21.15.55:0/555124857 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d40ac900 con 0x7f02e40b1250 2023-07-06T21:42:32.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7f02e94af640 1 -- 172.21.15.55:0/555124857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02e40b1250 msgr2=0x7f02e415f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7f02e94af640 1 --2- 172.21.15.55:0/555124857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02e40b1250 0x7f02e415f380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02e408a100 tx=0x7f02d401c4c0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fd610c76640 1 -- start start 2023-07-06T21:42:32.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fba25648640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fba200caf70 0x7fba2006ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fba25648640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba20152380 0x7fba200c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fba25648640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2015b9c0 con 0x7fba20070510 2023-07-06T21:42:32.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fba25648640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba200cc930 con 0x7fba20152380 2023-07-06T21:42:32.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fba25648640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2015bca0 con 0x7fba200caf70 2023-07-06T21:42:32.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7f02e94af640 1 -- 172.21.15.55:0/555124857 shutdown_connections 2023-07-06T21:42:32.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7f02e94af640 1 --2- 172.21.15.55:0/555124857 >> v2:172.21.15.55:3300/0 conn(0x7f02e40d0630 0x7f02e415f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7f02e94af640 1 --2- 172.21.15.55:0/555124857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02e40b1250 0x7f02e415f380 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7f02e94af640 1 -- 172.21.15.55:0/555124857 >> 172.21.15.55:0/555124857 conn(0x7f02e40b3b60 msgr2=0x7f02e40b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fc0a9ffb640 1 -- 172.21.15.55:0/44909421 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0aa640 con 0x7fc0ac0ca100 2023-07-06T21:42:32.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fc0a9ffb640 1 -- 172.21.15.55:0/44909421 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c0aa7a0 con 0x7fc0ac0ca100 2023-07-06T21:42:32.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fc0a9ffb640 1 -- 172.21.15.55:0/44909421 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0aab30 con 0x7fc0ac0ca100 2023-07-06T21:42:32.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fba1e7fc640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fba20070510 0x7fba20151c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:47638/0 (socket says 172.21.15.55:47638) 2023-07-06T21:42:32.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.707+0000 7fba1e7fc640 1 -- 172.21.15.55:0/3024520552 learned_addr learned my addr 172.21.15.55:0/3024520552 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:32.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1effd640 1 --2- 172.21.15.55:0/3024520552 >> v2:172.21.15.138:3300/0 conn(0x7fba200caf70 0x7fba2006ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7f7be4fd1640 1 --2- 172.21.15.55:0/325819291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be00ca160 0x7f7be0152110 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00097c0 tx=0x7f7bd001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488d26ceb3aa3435 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7f02e94af640 1 -- 172.21.15.55:0/555124857 shutdown_connections 2023-07-06T21:42:32.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fc0b166d640 1 -- 172.21.15.55:0/44909421 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0ac0ca100 msgr2=0x7fc0ac0693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fc0b166d640 1 --2- 172.21.15.55:0/44909421 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0ac0ca100 0x7fc0ac0693f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0090e0 tx=0x7fc09c01d680 comp rx=0 tx=0).stop 2023-07-06T21:42:32.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fd610c76640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd60c0cd640 0x7fd60c0c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fd610c76640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd60c15bcd0 0x7fd60c069e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1f7fe640 1 --2- 172.21.15.55:0/3024520552 >> v2:172.21.15.55:3300/0 conn(0x7fba20152380 0x7fba200c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7f3ab2303640 1 --2- 172.21.15.55:0/723947024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3aac15fd50 0x7f3aac0cb7c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0ce900 tx=0x7f3aa801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c90cf8d04115bad7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fc0b166d640 1 -- 172.21.15.55:0/44909421 shutdown_connections 2023-07-06T21:42:32.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fc0b166d640 1 --2- 172.21.15.55:0/44909421 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0ac0ca100 0x7fc0ac0693f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fc0b166d640 1 -- 172.21.15.55:0/44909421 >> 172.21.15.55:0/44909421 conn(0x7fc0ac0ce8a0 msgr2=0x7fc0ac0ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 -- 172.21.15.55:0/3024520552 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349876375 0 0) 0x7fba2015b9c0 con 0x7fba20070510 2023-07-06T21:42:32.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 -- 172.21.15.55:0/3024520552 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba08003530 con 0x7fba20070510 2023-07-06T21:42:32.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fd610c76640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c0693f0 con 0x7fd60c157780 2023-07-06T21:42:32.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fd610c76640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c0699b0 con 0x7fd60c0cd640 2023-07-06T21:42:32.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fd610c76640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c157b50 con 0x7fd60c15bcd0 2023-07-06T21:42:32.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fd60affd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd60c0cd640 0x7fd60c0c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fc0b166d640 1 -- 172.21.15.55:0/44909421 shutdown_connections 2023-07-06T21:42:32.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fd60affd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd60c0cd640 0x7fd60c0c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:56030/0 (socket says 172.21.15.55:56030) 2023-07-06T21:42:32.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fd60affd640 1 -- 172.21.15.55:0/1621577755 learned_addr learned my addr 172.21.15.55:0/1621577755 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fd60bfff640 1 --2- 172.21.15.55:0/1621577755 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd60c15bcd0 0x7fd60c069e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fd60affd640 1 -- 172.21.15.55:0/1621577755 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd60c15bcd0 msgr2=0x7fd60c069e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fd60affd640 1 --2- 172.21.15.55:0/1621577755 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd60c15bcd0 0x7fd60c069e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fd60affd640 1 -- 172.21.15.55:0/1621577755 >> v1:172.21.15.55:6789/0 conn(0x7fd60c157780 legacy=0x7fd60c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fd60affd640 1 -- 172.21.15.55:0/1621577755 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0c9f70 con 0x7fd60c0cd640 2023-07-06T21:42:32.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7f3ab1301640 1 -- 172.21.15.55:0/723947024 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa80ab600 con 0x7f3aac15fd50 2023-07-06T21:42:32.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7f3ab1301640 1 -- 172.21.15.55:0/723947024 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa80a7050 con 0x7f3aac15fd50 2023-07-06T21:42:32.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7f3ab1301640 1 -- 172.21.15.55:0/723947024 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa80ab980 con 0x7f3aac15fd50 2023-07-06T21:42:32.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7f3ab3305640 1 -- 172.21.15.55:0/723947024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3aac15fd50 msgr2=0x7f3aac0cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7f3ab3305640 1 --2- 172.21.15.55:0/723947024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3aac15fd50 0x7f3aac0cb7c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0ce900 tx=0x7f3aa801c390 comp rx=0 tx=0).stop 2023-07-06T21:42:32.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fc0b166d640 1 -- 172.21.15.55:0/44909421 wait complete. 2023-07-06T21:42:32.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fc0b166d640 1 Processor -- start 2023-07-06T21:42:32.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fc0b166d640 1 -- start start 2023-07-06T21:42:32.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fc0b166d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0ac069930 0x7fc0ac0c1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fc0b166d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0ac0ca100 0x7fc0ac1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7f02e94af640 1 -- 172.21.15.55:0/555124857 wait complete. 2023-07-06T21:42:32.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7f02e94af640 1 Processor -- start 2023-07-06T21:42:32.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7f02e94af640 1 -- start start 2023-07-06T21:42:32.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 -- 172.21.15.55:0/3024520552 <== mon.1 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2615344441 0 0) 0x7fba08003530 con 0x7fba20070510 2023-07-06T21:42:32.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 -- 172.21.15.55:0/3024520552 >> v2:172.21.15.138:3300/0 conn(0x7fba200caf70 msgr2=0x7fba2006ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 --2- 172.21.15.55:0/3024520552 >> v2:172.21.15.138:3300/0 conn(0x7fba200caf70 0x7fba2006ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 -- 172.21.15.55:0/3024520552 >> v2:172.21.15.55:3300/0 conn(0x7fba20152380 msgr2=0x7fba200c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 --2- 172.21.15.55:0/3024520552 >> v2:172.21.15.55:3300/0 conn(0x7fba20152380 0x7fba200c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 -- 172.21.15.55:0/3024520552 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2015bf80 con 0x7fba20070510 2023-07-06T21:42:32.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 -- 172.21.15.55:0/3024520552 <== mon.1 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fba18001a00 con 0x7fba20070510 2023-07-06T21:42:32.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 -- 172.21.15.55:0/3024520552 >> v1:172.21.15.138:6789/0 conn(0x7fba20070510 legacy=0x7fba20151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 --2- 172.21.15.55:0/3024520552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba08003980 0x7fba08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 --2- 172.21.15.55:0/3024520552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba080047d0 0x7fba08004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 --2- 172.21.15.55:0/3024520552 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba08005180 0x7fba0800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 -- 172.21.15.55:0/3024520552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba200cc930 con 0x7fba080047d0 2023-07-06T21:42:32.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 -- 172.21.15.55:0/3024520552 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2015bca0 con 0x7fba08003980 2023-07-06T21:42:32.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1dffb640 1 -- 172.21.15.55:0/3024520552 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0800bf80 con 0x7fba08005180 2023-07-06T21:42:32.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1f7fe640 1 --2- 172.21.15.55:0/3024520552 >> v2:172.21.15.55:3300/0 conn(0x7fba20152380 0x7fba200c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:32.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1f7fe640 1 --2- 172.21.15.55:0/3024520552 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba08005180 0x7fba0800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1e7fc640 1 --2- 172.21.15.55:0/3024520552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba080047d0 0x7fba08004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1f7fe640 1 -- 172.21.15.55:0/3024520552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba08003980 msgr2=0x7fba08003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1f7fe640 1 --2- 172.21.15.55:0/3024520552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba08003980 0x7fba08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1f7fe640 1 -- 172.21.15.55:0/3024520552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba080047d0 msgr2=0x7fba08004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1f7fe640 1 --2- 172.21.15.55:0/3024520552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba080047d0 0x7fba08004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.711+0000 7fba1f7fe640 1 -- 172.21.15.55:0/3024520552 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2015bf80 con 0x7fba08005180 2023-07-06T21:42:32.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7f3ab3305640 1 -- 172.21.15.55:0/723947024 shutdown_connections 2023-07-06T21:42:32.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7f3ab3305640 1 --2- 172.21.15.55:0/723947024 >> v2:172.21.15.55:3300/0 conn(0x7f3aac0c0d20 0x7f3aac0cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7f3ab3305640 1 --2- 172.21.15.55:0/723947024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3aac15fd50 0x7f3aac0cb7c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7f3ab3305640 1 -- 172.21.15.55:0/723947024 >> 172.21.15.55:0/723947024 conn(0x7f3aac0cdbf0 msgr2=0x7f3aac0cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7f3ab3305640 1 -- 172.21.15.55:0/723947024 shutdown_connections 2023-07-06T21:42:32.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7f02e94af640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02e40b1250 0x7f02e4157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fc0b166d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0ac157ac0 0x7fc0ac0c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7f02e94af640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e40d0630 0x7f02e4156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fc0aa7fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0ac0ca100 0x7fc0ac1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fc0aaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0ac069930 0x7fc0ac0c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fc0aa7fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0ac0ca100 0x7fc0ac1555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44724/0 (socket says 172.21.15.55:44724) 2023-07-06T21:42:32.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fc0aaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0ac069930 0x7fc0ac0c1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60144/0 (socket says 172.21.15.55:60144) 2023-07-06T21:42:32.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fc0aa7fc640 1 -- 172.21.15.55:0/2031139183 learned_addr learned my addr 172.21.15.55:0/2031139183 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7f02e3fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02e40b1250 0x7f02e4157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7f02e3fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02e40b1250 0x7f02e4157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44736/0 (socket says 172.21.15.55:44736) 2023-07-06T21:42:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fc0ab7fe640 1 --2- 172.21.15.55:0/2031139183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0ac157ac0 0x7fc0ac0c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fc0b166d640 1 -- 172.21.15.55:0/2031139183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac0c5b40 con 0x7fc0ac069930 2023-07-06T21:42:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fc0b166d640 1 -- 172.21.15.55:0/2031139183 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac0c4c50 con 0x7fc0ac157ac0 2023-07-06T21:42:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fc0b166d640 1 -- 172.21.15.55:0/2031139183 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac0c4f30 con 0x7fc0ac0ca100 2023-07-06T21:42:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7f02db7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e40d0630 0x7f02e4156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7f02db7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e40d0630 0x7f02e4156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60154/0 (socket says 172.21.15.55:60154) 2023-07-06T21:42:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fd60affd640 1 --2- 172.21.15.55:0/1621577755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd60c0cd640 0x7fd60c0c9890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd604009e50 tx=0x7fd60401c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d2543a4fe65696e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fd60a7fc640 1 -- 172.21.15.55:0/1621577755 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040a5680 con 0x7fd60c0cd640 2023-07-06T21:42:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fd60a7fc640 1 -- 172.21.15.55:0/1621577755 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6040a57e0 con 0x7fd60c0cd640 2023-07-06T21:42:32.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7fd60a7fc640 1 -- 172.21.15.55:0/1621577755 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040a5b70 con 0x7fd60c0cd640 2023-07-06T21:42:32.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7f3ab3305640 1 -- 172.21.15.55:0/723947024 wait complete. 2023-07-06T21:42:32.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.715+0000 7f3ab3305640 1 Processor -- start 2023-07-06T21:42:32.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fc0aa7fc640 1 -- 172.21.15.55:0/2031139183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0ac157ac0 msgr2=0x7fc0ac0c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fc0aa7fc640 1 --2- 172.21.15.55:0/2031139183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0ac157ac0 0x7fc0ac0c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fc0aa7fc640 1 -- 172.21.15.55:0/2031139183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0ac069930 msgr2=0x7fc0ac0c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fc0aa7fc640 1 --2- 172.21.15.55:0/2031139183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0ac069930 0x7fc0ac0c1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fc0aa7fc640 1 -- 172.21.15.55:0/2031139183 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c009cb0 con 0x7fc0ac0ca100 2023-07-06T21:42:32.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f02e3fff640 1 -- 172.21.15.55:0/4124770848 learned_addr learned my addr 172.21.15.55:0/4124770848 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f02e94af640 1 --2- 172.21.15.55:0/4124770848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02e415fe00 0x7f02e40c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fba1f7fe640 1 -- 172.21.15.55:0/3024520552 reap_dead start 2023-07-06T21:42:32.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fc0aa7fc640 1 --2- 172.21.15.55:0/2031139183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0ac0ca100 0x7fc0ac1555f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc09c01a290 tx=0x7fc09c01a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fd610c76640 1 -- 172.21.15.55:0/1621577755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd60c0cd640 msgr2=0x7fd60c0c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fba1f7fe640 1 --2- 172.21.15.55:0/3024520552 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba08005180 0x7fba0800b990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba100098a0 tx=0x7fba1001c610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a408348b9d4bb18 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fd610c76640 1 --2- 172.21.15.55:0/1621577755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd60c0cd640 0x7fd60c0c9890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd604009e50 tx=0x7fd60401c910 comp rx=0 tx=0).stop 2023-07-06T21:42:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f7bdeffd640 1 -- 172.21.15.55:0/325819291 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00a8970 con 0x7f7be00ca160 2023-07-06T21:42:32.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f02e8cae640 1 --2- 172.21.15.55:0/4124770848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02e415fe00 0x7f02e40c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fd610c76640 1 -- 172.21.15.55:0/1621577755 shutdown_connections 2023-07-06T21:42:32.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fd610c76640 1 --2- 172.21.15.55:0/1621577755 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd60c15bcd0 0x7fd60c069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fd610c76640 1 --2- 172.21.15.55:0/1621577755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd60c0cd640 0x7fd60c0c9890 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fd610c76640 1 -- 172.21.15.55:0/1621577755 >> 172.21.15.55:0/1621577755 conn(0x7fd60c0b0410 msgr2=0x7fd60c0cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fba1dffb640 1 -- 172.21.15.55:0/3024520552 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba100ad070 con 0x7fba08005180 2023-07-06T21:42:32.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fba1dffb640 1 -- 172.21.15.55:0/3024520552 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba10006e60 con 0x7fba08005180 2023-07-06T21:42:32.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fba1dffb640 1 -- 172.21.15.55:0/3024520552 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba100a8680 con 0x7fba08005180 2023-07-06T21:42:32.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f3ab3305640 1 -- start start 2023-07-06T21:42:32.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fd610c76640 1 -- 172.21.15.55:0/1621577755 shutdown_connections 2023-07-06T21:42:32.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f02e94af640 1 -- 172.21.15.55:0/4124770848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e4157040 con 0x7f02e40d0630 2023-07-06T21:42:32.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f02e94af640 1 -- 172.21.15.55:0/4124770848 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e4157ab0 con 0x7f02e415fe00 2023-07-06T21:42:32.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f02e94af640 1 -- 172.21.15.55:0/4124770848 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e415dca0 con 0x7f02e40b1250 2023-07-06T21:42:32.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f7bdeffd640 1 -- 172.21.15.55:0/325819291 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd00a8ad0 con 0x7f7be00ca160 2023-07-06T21:42:32.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f7be6a34640 1 -- 172.21.15.55:0/325819291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be00ca160 msgr2=0x7f7be0152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fc0937fe640 1 -- 172.21.15.55:0/2031139183 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0b2940 con 0x7fc0ac0ca100 2023-07-06T21:42:32.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fc0937fe640 1 -- 172.21.15.55:0/2031139183 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c0b2aa0 con 0x7fc0ac0ca100 2023-07-06T21:42:32.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f7bdeffd640 1 -- 172.21.15.55:0/325819291 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00a8970 con 0x7f7be00ca160 2023-07-06T21:42:32.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fc0937fe640 1 -- 172.21.15.55:0/2031139183 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0b2e50 con 0x7fc0ac0ca100 2023-07-06T21:42:32.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fc0b166d640 1 -- 172.21.15.55:0/2031139183 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ac0c5210 con 0x7fc0ac0ca100 2023-07-06T21:42:32.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f02e3fff640 1 -- 172.21.15.55:0/4124770848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02e415fe00 msgr2=0x7f02e40c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f02e3fff640 1 --2- 172.21.15.55:0/4124770848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02e415fe00 0x7f02e40c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f02e3fff640 1 -- 172.21.15.55:0/4124770848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e40d0630 msgr2=0x7f02e4156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f02e3fff640 1 --2- 172.21.15.55:0/4124770848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e40d0630 0x7f02e4156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f02e3fff640 1 -- 172.21.15.55:0/4124770848 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d40094d0 con 0x7f02e40b1250 2023-07-06T21:42:32.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7f02e3fff640 1 --2- 172.21.15.55:0/4124770848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02e40b1250 0x7f02e4157210 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f02d40af040 tx=0x7f02d4019260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f7be6a34640 1 --2- 172.21.15.55:0/325819291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be00ca160 0x7f7be0152110 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00097c0 tx=0x7f7bd001ec90 comp rx=0 tx=0).stop 2023-07-06T21:42:32.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f7be6a34640 1 -- 172.21.15.55:0/325819291 shutdown_connections 2023-07-06T21:42:32.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f7be6a34640 1 --2- 172.21.15.55:0/325819291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be00ca160 0x7f7be0152110 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f7be6a34640 1 -- 172.21.15.55:0/325819291 >> 172.21.15.55:0/325819291 conn(0x7f7be00cea70 msgr2=0x7f7be00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f7be6a34640 1 -- 172.21.15.55:0/325819291 shutdown_connections 2023-07-06T21:42:32.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fd610c76640 1 -- 172.21.15.55:0/1621577755 wait complete. 2023-07-06T21:42:32.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fd610c76640 1 Processor -- start 2023-07-06T21:42:32.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fba25648640 1 -- 172.21.15.55:0/3024520552 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba08005180 msgr2=0x7fba0800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fba25648640 1 --2- 172.21.15.55:0/3024520552 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba08005180 0x7fba0800b990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba100098a0 tx=0x7fba1001c610 comp rx=0 tx=0).stop 2023-07-06T21:42:32.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fba25648640 1 -- 172.21.15.55:0/3024520552 shutdown_connections 2023-07-06T21:42:32.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fba25648640 1 --2- 172.21.15.55:0/3024520552 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba08005180 0x7fba0800b990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fba25648640 1 -- 172.21.15.55:0/3024520552 >> 172.21.15.55:0/3024520552 conn(0x7fba200cea70 msgr2=0x7fba200ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fba25648640 1 -- 172.21.15.55:0/3024520552 shutdown_connections 2023-07-06T21:42:32.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fba25648640 1 -- 172.21.15.55:0/3024520552 wait complete. 2023-07-06T21:42:32.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7f02e17fa640 1 -- 172.21.15.55:0/4124770848 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d40ac410 con 0x7f02e40b1250 2023-07-06T21:42:32.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7f7be6a34640 1 -- 172.21.15.55:0/325819291 wait complete. 2023-07-06T21:42:32.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7f02e94af640 1 -- 172.21.15.55:0/4124770848 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e415df80 con 0x7f02e40b1250 2023-07-06T21:42:32.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.719+0000 7fc0b166d640 1 -- 172.21.15.55:0/2031139183 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ac0c57d0 con 0x7fc0ac0ca100 2023-07-06T21:42:32.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fc0917fa640 1 -- 172.21.15.55:0/2031139183 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc084005260 con 0x7fc0ac0ca100 2023-07-06T21:42:32.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7f02e94af640 1 -- 172.21.15.55:0/4124770848 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e40c9400 con 0x7f02e40b1250 2023-07-06T21:42:32.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7f02da7fc640 1 -- 172.21.15.55:0/4124770848 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c8005260 con 0x7f02e40b1250 2023-07-06T21:42:32.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7f7be6a34640 1 Processor -- start 2023-07-06T21:42:32.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7f7be6a34640 1 -- start start 2023-07-06T21:42:32.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7f7be6a34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be00ca160 0x7f7be01f0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7f7be6a34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be00caf70 0x7f7be013d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7be6a34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7be0151c70 0x7f7be013d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7be6a34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be006c400 con 0x7f7be00ca160 2023-07-06T21:42:32.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7be6a34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00c7e10 con 0x7f7be00caf70 2023-07-06T21:42:32.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7be6a34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00c7200 con 0x7f7be0151c70 2023-07-06T21:42:32.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7bdffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be00ca160 0x7f7be01f0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7bdffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be00ca160 0x7f7be01f0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60164/0 (socket says 172.21.15.55:60164) 2023-07-06T21:42:32.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7bdffff640 1 -- 172.21.15.55:0/3334965644 learned_addr learned my addr 172.21.15.55:0/3334965644 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7bdf7fe640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be00caf70 0x7f7be013d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7be4fd1640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7be0151c70 0x7f7be013d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7bdffff640 1 -- 172.21.15.55:0/3334965644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7be0151c70 msgr2=0x7f7be013d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7bdffff640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7be0151c70 0x7f7be013d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7bdffff640 1 -- 172.21.15.55:0/3334965644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be00caf70 msgr2=0x7f7be013d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7bdffff640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be00caf70 0x7f7be013d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7bdffff640 1 -- 172.21.15.55:0/3334965644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd0009420 con 0x7f7be00ca160 2023-07-06T21:42:32.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7bdf7fe640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be00caf70 0x7f7be013d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:32.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7be4fd1640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7be0151c70 0x7f7be013d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:32.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7bdffff640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be00ca160 0x7f7be01f0860 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800cbc0 tx=0x7f7bd800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fd610c76640 1 -- start start 2023-07-06T21:42:32.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fd610c76640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0cd640 0x7fd60c15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fd610c76640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd60c157780 0x7fd60c150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fd610c76640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd60c15bcd0 0x7fd60c150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fd60affd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd60c157780 0x7fd60c150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fd60affd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd60c157780 0x7fd60c150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:56076/0 (socket says 172.21.15.55:56076) 2023-07-06T21:42:32.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fd60affd640 1 -- 172.21.15.55:0/1020098618 learned_addr learned my addr 172.21.15.55:0/1020098618 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fd610c76640 1 -- 172.21.15.55:0/1020098618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c151400 con 0x7fd60c0cd640 2023-07-06T21:42:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fd60bfff640 1 --2- 172.21.15.55:0/1020098618 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd60c15bcd0 0x7fd60c150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fd610c76640 1 -- 172.21.15.55:0/1020098618 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c152a50 con 0x7fd60c157780 2023-07-06T21:42:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fd610c76640 1 -- 172.21.15.55:0/1020098618 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0cc600 con 0x7fd60c15bcd0 2023-07-06T21:42:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fd60b7fe640 1 --2- 172.21.15.55:0/1020098618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0cd640 0x7fd60c15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7fd60affd640 1 -- 172.21.15.55:0/1020098618 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd60c15bcd0 msgr2=0x7fd60c150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7fd60affd640 1 --2- 172.21.15.55:0/1020098618 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd60c15bcd0 0x7fd60c150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7fd60affd640 1 -- 172.21.15.55:0/1020098618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0cd640 msgr2=0x7fd60c15a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7fd60affd640 1 --2- 172.21.15.55:0/1020098618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0cd640 0x7fd60c15a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7fd60affd640 1 -- 172.21.15.55:0/1020098618 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd604009b30 con 0x7fd60c157780 2023-07-06T21:42:32.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7fd60affd640 1 --2- 172.21.15.55:0/1020098618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd60c157780 0x7fd60c150520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd6040af040 tx=0x7fd6040196b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7fd5f3fff640 1 -- 172.21.15.55:0/1020098618 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040a5680 con 0x7fd60c157780 2023-07-06T21:42:32.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fba25648640 1 Processor -- start 2023-07-06T21:42:32.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f3ab3305640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3aac0c0d20 0x7f3aac160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f3ab3305640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3aac0c9e30 0x7f3aac0c2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f02e17fa640 1 -- 172.21.15.55:0/4124770848 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d40b5630 con 0x7f02e40b1250 2023-07-06T21:42:32.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f3ab2303640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3aac0c0d20 0x7f3aac160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f3ab2303640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3aac0c0d20 0x7f3aac160bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:56088/0 (socket says 172.21.15.55:56088) 2023-07-06T21:42:32.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f3ab2303640 1 -- 172.21.15.55:0/1740416974 learned_addr learned my addr 172.21.15.55:0/1740416974 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f3ab1b02640 1 --2- 172.21.15.55:0/1740416974 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3aac0c9e30 0x7f3aac0c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f3ab3305640 1 --2- 172.21.15.55:0/1740416974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aac15fd50 0x7f3aac0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7fd610c76640 1 -- 172.21.15.55:0/1020098618 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c0cc8e0 con 0x7fd60c157780 2023-07-06T21:42:32.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7fd610c76640 1 -- 172.21.15.55:0/1020098618 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c0ccea0 con 0x7fd60c157780 2023-07-06T21:42:32.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f3ab3305640 1 -- 172.21.15.55:0/1740416974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac0c25d0 con 0x7f3aac15fd50 2023-07-06T21:42:32.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f3ab3305640 1 -- 172.21.15.55:0/1740416974 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac1f6400 con 0x7f3aac0c0d20 2023-07-06T21:42:32.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7fc0937fe640 1 -- 172.21.15.55:0/2031139183 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc09c0a8070 con 0x7fc0ac0ca100 2023-07-06T21:42:32.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7fc0937fe640 1 --2- 172.21.15.55:0/2031139183 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc098066380 0x7fc098068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f3ab3305640 1 -- 172.21.15.55:0/1740416974 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac161270 con 0x7f3aac0c9e30 2023-07-06T21:42:32.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7fc0937fe640 1 -- 172.21.15.55:0/2031139183 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc09c11ef30 con 0x7fc0ac0ca100 2023-07-06T21:42:32.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7fd5f3fff640 1 -- 172.21.15.55:0/1020098618 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6040b8880 con 0x7fd60c157780 2023-07-06T21:42:32.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f02e17fa640 1 -- 172.21.15.55:0/4124770848 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d40acea0 con 0x7f02e40b1250 2023-07-06T21:42:32.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f02e17fa640 1 -- 172.21.15.55:0/4124770848 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f02d40b3070 con 0x7f02e40b1250 2023-07-06T21:42:32.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7bdcff9640 1 -- 172.21.15.55:0/3334965644 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800ad40 con 0x7f7be00ca160 2023-07-06T21:42:32.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7bdcff9640 1 -- 172.21.15.55:0/3334965644 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd8012400 con 0x7f7be00ca160 2023-07-06T21:42:32.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7bdcff9640 1 -- 172.21.15.55:0/3334965644 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800aea0 con 0x7f7be00ca160 2023-07-06T21:42:32.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7be6a34640 1 -- 172.21.15.55:0/3334965644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be00c74e0 con 0x7f7be00ca160 2023-07-06T21:42:32.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7f7be6a34640 1 -- 172.21.15.55:0/3334965644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be00c7aa0 con 0x7f7be00ca160 2023-07-06T21:42:32.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.727+0000 7fd5f3fff640 1 -- 172.21.15.55:0/1020098618 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040b8c30 con 0x7fd60c157780 2023-07-06T21:42:32.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fc0aaffd640 1 --2- 172.21.15.55:0/2031139183 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc098066380 0x7fc098068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f3ab2303640 1 -- 172.21.15.55:0/1740416974 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3aac0c9e30 msgr2=0x7f3aac0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f3ab2303640 1 --2- 172.21.15.55:0/1740416974 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3aac0c9e30 0x7f3aac0c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f3ab2303640 1 -- 172.21.15.55:0/1740416974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aac15fd50 msgr2=0x7f3aac0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f3ab2303640 1 --2- 172.21.15.55:0/1740416974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aac15fd50 0x7f3aac0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f3ab2303640 1 -- 172.21.15.55:0/1740416974 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa80094d0 con 0x7f3aac0c0d20 2023-07-06T21:42:32.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f3ab2303640 1 --2- 172.21.15.55:0/1740416974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3aac0c0d20 0x7f3aac160bd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3aa801aa40 tx=0x7f3aa8019130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fc0aaffd640 1 --2- 172.21.15.55:0/2031139183 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc098066380 0x7fc098068830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0005890 tx=0x7fc0a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7fc0937fe640 1 -- 172.21.15.55:0/2031139183 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc09c0ec270 con 0x7fc0ac0ca100 2023-07-06T21:42:32.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f02e17fa640 1 --2- 172.21.15.55:0/4124770848 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f02c40663d0 0x7f02c4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f02e17fa640 1 -- 172.21.15.55:0/4124770848 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f02d411e610 con 0x7f02e40b1250 2023-07-06T21:42:32.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f02db7fe640 1 --2- 172.21.15.55:0/4124770848 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f02c40663d0 0x7f02c4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7f02db7fe640 1 --2- 172.21.15.55:0/4124770848 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f02c40663d0 0x7f02c4068880 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f02e415ed10 tx=0x7f02cc009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f7be6a34640 1 -- 172.21.15.55:0/3334965644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc0005260 con 0x7f7be00ca160 2023-07-06T21:42:32.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7f7bdcff9640 1 -- 172.21.15.55:0/3334965644 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7bd8007070 con 0x7f7be00ca160 2023-07-06T21:42:32.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7f7bdcff9640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7bcc066350 0x7f7bcc068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7f7bdcff9640 1 -- 172.21.15.55:0/3334965644 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7bd8084510 con 0x7f7be00ca160 2023-07-06T21:42:32.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7f42f28d8640 1 Processor -- start 2023-07-06T21:42:32.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fd5f3fff640 1 -- 172.21.15.55:0/1020098618 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6040b6440 con 0x7fd60c157780 2023-07-06T21:42:32.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fd610c76640 1 -- 172.21.15.55:0/1020098618 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ec005260 con 0x7fd60c157780 2023-07-06T21:42:32.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7fd5f3fff640 1 --2- 172.21.15.55:0/1020098618 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd5f80662d0 0x7fd5f8068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7fd5f3fff640 1 -- 172.21.15.55:0/1020098618 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd60411f670 con 0x7fd60c157780 2023-07-06T21:42:32.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7fd60b7fe640 1 --2- 172.21.15.55:0/1020098618 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd5f80662d0 0x7fd5f8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7fd60b7fe640 1 --2- 172.21.15.55:0/1020098618 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd5f80662d0 0x7fd5f8068780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0cd490 tx=0x7fd5fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.723+0000 7fba25648640 1 -- start start 2023-07-06T21:42:32.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba25648640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba08005180 0x7fba20145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba25648640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba200c3ce0 0x7fba20149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba25648640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba200c4150 0x7fba2006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba25648640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba200c3850 con 0x7fba200c4150 2023-07-06T21:42:32.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba25648640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba201462e0 con 0x7fba200c3ce0 2023-07-06T21:42:32.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba25648640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba200c2c80 con 0x7fba08005180 2023-07-06T21:42:32.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba1e7fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba200c3ce0 0x7fba20149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba1e7fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba200c3ce0 0x7fba20149610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:56094/0 (socket says 172.21.15.55:56094) 2023-07-06T21:42:32.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba1e7fc640 1 -- 172.21.15.55:0/3582537685 learned_addr learned my addr 172.21.15.55:0/3582537685 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba1effd640 1 --2- 172.21.15.55:0/3582537685 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba08005180 0x7fba20145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba1f7fe640 1 --2- 172.21.15.55:0/3582537685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba200c4150 0x7fba2006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba1e7fc640 1 -- 172.21.15.55:0/3582537685 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba08005180 msgr2=0x7fba20145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba1e7fc640 1 --2- 172.21.15.55:0/3582537685 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba08005180 0x7fba20145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba1e7fc640 1 -- 172.21.15.55:0/3582537685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba200c4150 msgr2=0x7fba2006f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba1e7fc640 1 --2- 172.21.15.55:0/3582537685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba200c4150 0x7fba2006f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7fba1e7fc640 1 -- 172.21.15.55:0/3582537685 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba200c2f20 con 0x7fba200c3ce0 2023-07-06T21:42:32.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7fba1e7fc640 1 --2- 172.21.15.55:0/3582537685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba200c3ce0 0x7fba20149610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fba18007a20 tx=0x7fba1800a750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f3aa2ffd640 1 -- 172.21.15.55:0/1740416974 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa80b4870 con 0x7f3aac0c0d20 2023-07-06T21:42:32.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f3aa2ffd640 1 -- 172.21.15.55:0/1740416974 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa80b49d0 con 0x7f3aac0c0d20 2023-07-06T21:42:32.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f3aa2ffd640 1 -- 172.21.15.55:0/1740416974 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa80b4d80 con 0x7f3aac0c0d20 2023-07-06T21:42:32.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f3ab3305640 1 -- 172.21.15.55:0/1740416974 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aac161550 con 0x7f3aac0c0d20 2023-07-06T21:42:32.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.731+0000 7f3ab3305640 1 -- 172.21.15.55:0/1740416974 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aac0c2de0 con 0x7f3aac0c0d20 2023-07-06T21:42:32.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7f3aa2ffd640 1 -- 172.21.15.55:0/1740416974 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3aa80b5440 con 0x7f3aac0c0d20 2023-07-06T21:42:32.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7f02e17fa640 1 -- 172.21.15.55:0/4124770848 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02d40eb830 con 0x7f02e40b1250 2023-07-06T21:42:32.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7f7bdf7fe640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7bcc066350 0x7f7bcc068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7f42f28d8640 1 -- start start 2023-07-06T21:42:32.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7f3ab3305640 1 -- 172.21.15.55:0/1740416974 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a94005260 con 0x7f3aac0c0d20 2023-07-06T21:42:32.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7f7bdf7fe640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7bcc066350 0x7f7bcc068800 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7be01f45c0 tx=0x7f7bd4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7fba077fe640 1 -- 172.21.15.55:0/3582537685 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1800ae60 con 0x7fba200c3ce0 2023-07-06T21:42:32.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7fba25648640 1 -- 172.21.15.55:0/3582537685 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba200c3200 con 0x7fba200c3ce0 2023-07-06T21:42:32.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.735+0000 7f3aa2ffd640 1 --2- 172.21.15.55:0/1740416974 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3a900662d0 0x7f3a90068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f42f28d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42ec1630a0 0x7f42ec0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f42ebfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42ec1630a0 0x7f42ec0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f42ebfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42ec1630a0 0x7f42ec0c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44782/0 (socket says 172.21.15.55:44782) 2023-07-06T21:42:32.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7fd5f3fff640 1 -- 172.21.15.55:0/1020098618 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6040eca50 con 0x7fd60c157780 2023-07-06T21:42:32.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7fba25648640 1 -- 172.21.15.55:0/3582537685 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba201466b0 con 0x7fba200c3ce0 2023-07-06T21:42:32.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f3aa2ffd640 1 -- 172.21.15.55:0/1740416974 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3aa811e550 con 0x7f3aac0c0d20 2023-07-06T21:42:32.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f3ab1b02640 1 --2- 172.21.15.55:0/1740416974 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3a900662d0 0x7f3a90068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f3ab1b02640 1 --2- 172.21.15.55:0/1740416974 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3a900662d0 0x7f3a90068780 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3aac1f2e50 tx=0x7f3a9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7fba25648640 1 -- 172.21.15.55:0/3582537685 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba20066d60 con 0x7fba200c3ce0 2023-07-06T21:42:32.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f42f28d8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f42ec0c0930 0x7f42ec0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f42eb7fe640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f42ec163470 0x7f42ec0c81d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:47650/0 (socket says 172.21.15.55:47650) 2023-07-06T21:42:32.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.743+0000 7f7bdcff9640 1 -- 172.21.15.55:0/3334965644 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7bd8051730 con 0x7f7be00ca160 2023-07-06T21:42:32.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f42eb7fe640 1 -- 172.21.15.55:0/3569874640 learned_addr learned my addr 172.21.15.55:0/3569874640 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:32.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f42f0e75640 1 --2- 172.21.15.55:0/3569874640 >> v2:172.21.15.138:3300/0 conn(0x7f42ec0c0930 0x7f42ec0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f42f28d8640 1 -- 172.21.15.55:0/3569874640 --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ec06f570 con 0x7f42ec163470 2023-07-06T21:42:32.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f42f28d8640 1 -- 172.21.15.55:0/3569874640 --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ec0c1230 con 0x7f42ec0c0930 2023-07-06T21:42:32.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f42f28d8640 1 -- 172.21.15.55:0/3569874640 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec06f850 con 0x7f42ec1630a0 2023-07-06T21:42:32.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f42ebfff640 1 -- 172.21.15.55:0/3569874640 >> v2:172.21.15.138:3300/0 conn(0x7f42ec0c0930 msgr2=0x7f42ec0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:32.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f42ebfff640 1 --2- 172.21.15.55:0/3569874640 >> v2:172.21.15.138:3300/0 conn(0x7f42ec0c0930 0x7f42ec0cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f42ebfff640 1 -- 172.21.15.55:0/3569874640 >> v1:172.21.15.138:6789/0 conn(0x7f42ec163470 legacy=0x7f42ec0c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.739+0000 7f42ebfff640 1 -- 172.21.15.55:0/3569874640 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec06fb30 con 0x7f42ec1630a0 2023-07-06T21:42:32.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.743+0000 7f42ebfff640 1 --2- 172.21.15.55:0/3569874640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42ec1630a0 0x7f42ec0c9830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009d90 tx=0x7f42e401c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed3c957214004e6f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7f42eaffd640 1 -- 172.21.15.55:0/3569874640 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e40a5a00 con 0x7f42ec1630a0 2023-07-06T21:42:32.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.743+0000 7fba077fe640 1 -- 172.21.15.55:0/3582537685 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba180019e0 con 0x7fba200c3ce0 2023-07-06T21:42:32.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.743+0000 7fba077fe640 1 -- 172.21.15.55:0/3582537685 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18013840 con 0x7fba200c3ce0 2023-07-06T21:42:32.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.743+0000 7fba077fe640 1 -- 172.21.15.55:0/3582537685 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fba180139a0 con 0x7fba200c3ce0 2023-07-06T21:42:32.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.743+0000 7f3aa2ffd640 1 -- 172.21.15.55:0/1740416974 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3aa80eb6c0 con 0x7f3aac0c0d20 2023-07-06T21:42:32.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7f42eaffd640 1 -- 172.21.15.55:0/3569874640 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e40a5b60 con 0x7f42ec1630a0 2023-07-06T21:42:32.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7f42f28d8640 1 -- 172.21.15.55:0/3569874640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42ec1630a0 msgr2=0x7f42ec0c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7f42f28d8640 1 --2- 172.21.15.55:0/3569874640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42ec1630a0 0x7f42ec0c9830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009d90 tx=0x7f42e401c960 comp rx=0 tx=0).stop 2023-07-06T21:42:32.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7f42f28d8640 1 -- 172.21.15.55:0/3569874640 shutdown_connections 2023-07-06T21:42:32.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7f42f28d8640 1 --2- 172.21.15.55:0/3569874640 >> v2:172.21.15.138:3300/0 conn(0x7f42ec0c0930 0x7f42ec0cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7f42f28d8640 1 --2- 172.21.15.55:0/3569874640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42ec1630a0 0x7f42ec0c9830 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7f42f28d8640 1 -- 172.21.15.55:0/3569874640 >> 172.21.15.55:0/3569874640 conn(0x7f42ec0ca690 msgr2=0x7f42ec0caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:32.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7fba077fe640 1 --2- 172.21.15.55:0/3582537685 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fba0c0662b0 0x7fba0c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7fba077fe640 1 -- 172.21.15.55:0/3582537685 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fba18085280 con 0x7fba200c3ce0 2023-07-06T21:42:32.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7fba1effd640 1 --2- 172.21.15.55:0/3582537685 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fba0c0662b0 0x7fba0c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7fba077fe640 1 -- 172.21.15.55:0/3582537685 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fba18052380 con 0x7fba200c3ce0 2023-07-06T21:42:32.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7fba1effd640 1 --2- 172.21.15.55:0/3582537685 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fba0c0662b0 0x7fba0c068760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fba140047c0 tx=0x7fba14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7f42f28d8640 1 -- 172.21.15.55:0/3569874640 shutdown_connections 2023-07-06T21:42:32.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.747+0000 7f42f28d8640 1 -- 172.21.15.55:0/3569874640 wait complete. 2023-07-06T21:42:32.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.751+0000 7f42f28d8640 1 Processor -- start 2023-07-06T21:42:32.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.751+0000 7f42f28d8640 1 -- start start 2023-07-06T21:42:32.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.751+0000 7f42f28d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42ec0c0930 0x7f42ec0c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.751+0000 7f42f28d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42ec1630a0 0x7f42ec0c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.751+0000 7f42ebfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42ec0c0930 0x7f42ec0c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.751+0000 7f42ebfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42ec0c0930 0x7f42ec0c4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44794/0 (socket says 172.21.15.55:44794) 2023-07-06T21:42:32.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.751+0000 7f42ebfff640 1 -- 172.21.15.55:0/281731538 learned_addr learned my addr 172.21.15.55:0/281731538 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:32.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.751+0000 7f42eb7fe640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42ec1630a0 0x7f42ec0c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.751+0000 7f42f28d8640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42ec163470 0x7f42ec0b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42f0e75640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42ec163470 0x7f42ec0b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42f28d8640 1 -- 172.21.15.55:0/281731538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0c78c0 con 0x7f42ec163470 2023-07-06T21:42:32.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42f28d8640 1 -- 172.21.15.55:0/281731538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0c6f20 con 0x7f42ec1630a0 2023-07-06T21:42:32.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42f28d8640 1 -- 172.21.15.55:0/281731538 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0c7200 con 0x7f42ec0c0930 2023-07-06T21:42:32.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42eb7fe640 1 -- 172.21.15.55:0/281731538 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42ec0c0930 msgr2=0x7f42ec0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42eb7fe640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42ec0c0930 0x7f42ec0c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42eb7fe640 1 -- 172.21.15.55:0/281731538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42ec163470 msgr2=0x7f42ec0b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:32.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42eb7fe640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42ec163470 0x7f42ec0b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:32.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42eb7fe640 1 -- 172.21.15.55:0/281731538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e4009a70 con 0x7f42ec1630a0 2023-07-06T21:42:32.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42ebfff640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42ec0c0930 0x7f42ec0c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:32.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42eb7fe640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42ec1630a0 0x7f42ec0c5190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f42e000c390 tx=0x7f42e000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42e8ff9640 1 -- 172.21.15.55:0/281731538 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0005cf0 con 0x7f42ec1630a0 2023-07-06T21:42:32.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42e8ff9640 1 -- 172.21.15.55:0/281731538 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e0005e50 con 0x7f42ec1630a0 2023-07-06T21:42:32.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42e8ff9640 1 -- 172.21.15.55:0/281731538 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00049f0 con 0x7f42ec1630a0 2023-07-06T21:42:32.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42f28d8640 1 -- 172.21.15.55:0/281731538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ec0c74e0 con 0x7f42ec1630a0 2023-07-06T21:42:32.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.755+0000 7f42f28d8640 1 -- 172.21.15.55:0/281731538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ec14dc50 con 0x7f42ec1630a0 2023-07-06T21:42:32.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.759+0000 7f42e8ff9640 1 -- 172.21.15.55:0/281731538 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f42e0004b50 con 0x7f42ec1630a0 2023-07-06T21:42:32.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.763+0000 7f42e8ff9640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f42d4066500 0x7f42d40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:32.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.763+0000 7f42e8ff9640 1 -- 172.21.15.55:0/281731538 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f42e00837d0 con 0x7f42ec1630a0 2023-07-06T21:42:32.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.763+0000 7f42ebfff640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f42d4066500 0x7f42d40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:32.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.763+0000 7f42ebfff640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f42d4066500 0x7f42d40689b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42e4019570 tx=0x7f42e40a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:32.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.767+0000 7f42d27fc640 1 -- 172.21.15.55:0/281731538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ec0c7a00 con 0x7f42ec1630a0 2023-07-06T21:42:32.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:32.771+0000 7f42e8ff9640 1 -- 172.21.15.55:0/281731538 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42ec0c7a00 con 0x7f42ec1630a0 2023-07-06T21:42:33.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.039+0000 7f8b65f03640 1 -- 172.21.15.55:0/4001419306 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8b3c005510 con 0x7f8b6006bc30 2023-07-06T21:42:33.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.039+0000 7f8b4ffff640 1 -- 172.21.15.55:0/4001419306 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b580efdd0 con 0x7f8b6006bc30 2023-07-06T21:42:33.048 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2023-07-06T21:42:33.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.043+0000 7f8b4dffb640 1 -- 172.21.15.55:0/4001419306 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8b44066320 msgr2=0x7f8b440687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.043+0000 7f8b4dffb640 1 --2- 172.21.15.55:0/4001419306 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8b44066320 0x7f8b440687d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8b540098e0 tx=0x7f8b54009060 comp rx=0 tx=0).stop 2023-07-06T21:42:33.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.043+0000 7f8b4dffb640 1 -- 172.21.15.55:0/4001419306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b6006bc30 msgr2=0x7f8b6015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.043+0000 7f8b4dffb640 1 --2- 172.21.15.55:0/4001419306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b6006bc30 0x7f8b6015b090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b5801d240 tx=0x7f8b58019740 comp rx=0 tx=0).stop 2023-07-06T21:42:33.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.043+0000 7f8b4dffb640 1 -- 172.21.15.55:0/4001419306 shutdown_connections 2023-07-06T21:42:33.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.043+0000 7f8b4dffb640 1 --2- 172.21.15.55:0/4001419306 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8b44066320 0x7f8b440687d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.043+0000 7f8b4dffb640 1 --2- 172.21.15.55:0/4001419306 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b600cc070 0x7f8b60164680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.043+0000 7f8b4dffb640 1 --2- 172.21.15.55:0/4001419306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b6006bc30 0x7f8b6015b090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.043+0000 7f8b4dffb640 1 --2- 172.21.15.55:0/4001419306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b6006b860 0x7f8b60153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.047+0000 7f8b4dffb640 1 -- 172.21.15.55:0/4001419306 >> 172.21.15.55:0/4001419306 conn(0x7f8b600ce8a0 msgr2=0x7f8b60157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:33.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.047+0000 7f8b4dffb640 1 -- 172.21.15.55:0/4001419306 shutdown_connections 2023-07-06T21:42:33.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.047+0000 7f8b4dffb640 1 -- 172.21.15.55:0/4001419306 wait complete. 2023-07-06T21:42:33.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.067+0000 7fd610c76640 1 -- 172.21.15.55:0/1020098618 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd5ec005510 con 0x7fd60c157780 2023-07-06T21:42:33.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.067+0000 7fc0917fa640 1 -- 172.21.15.55:0/2031139183 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc0840057e0 con 0x7fc0ac0ca100 2023-07-06T21:42:33.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.067+0000 7fd5f3fff640 1 -- 172.21.15.55:0/1020098618 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd6040f0070 con 0x7fd60c157780 2023-07-06T21:42:33.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.067+0000 7fc0937fe640 1 -- 172.21.15.55:0/2031139183 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc09c0ef890 con 0x7fc0ac0ca100 2023-07-06T21:42:33.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.067+0000 7f02da7fc640 1 -- 172.21.15.55:0/4124770848 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f02c8005510 con 0x7f02e40b1250 2023-07-06T21:42:33.075 INFO:teuthology.orchestra.run.smithi055.stdout:55834574855 2023-07-06T21:42:33.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.071+0000 7f02e17fa640 1 -- 172.21.15.55:0/4124770848 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f02d40eee50 con 0x7f02e40b1250 2023-07-06T21:42:33.076 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2023-07-06T21:42:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.071+0000 7f7be6a34640 1 -- 172.21.15.55:0/3334965644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7bc00057e0 con 0x7f7be00ca160 2023-07-06T21:42:33.077 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2023-07-06T21:42:33.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.071+0000 7f7bdcff9640 1 -- 172.21.15.55:0/3334965644 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7bd8054d50 con 0x7f7be00ca160 2023-07-06T21:42:33.078 INFO:teuthology.orchestra.run.smithi055.stdout:55834574857 2023-07-06T21:42:33.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.071+0000 7fd610c76640 1 -- 172.21.15.55:0/1020098618 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd5f80662d0 msgr2=0x7fd5f8068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.071+0000 7fd610c76640 1 --2- 172.21.15.55:0/1020098618 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd5f80662d0 0x7fd5f8068780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0cd490 tx=0x7fd5fc008040 comp rx=0 tx=0).stop 2023-07-06T21:42:33.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.071+0000 7fd610c76640 1 -- 172.21.15.55:0/1020098618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd60c157780 msgr2=0x7fd60c150520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.071+0000 7fd610c76640 1 --2- 172.21.15.55:0/1020098618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd60c157780 0x7fd60c150520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd6040af040 tx=0x7fd6040196b0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.071+0000 7fd610c76640 1 -- 172.21.15.55:0/1020098618 shutdown_connections 2023-07-06T21:42:33.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.071+0000 7fd610c76640 1 --2- 172.21.15.55:0/1020098618 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd5f80662d0 0x7fd5f8068780 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.071+0000 7fd610c76640 1 --2- 172.21.15.55:0/1020098618 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd60c15bcd0 0x7fd60c150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.071+0000 7fd610c76640 1 --2- 172.21.15.55:0/1020098618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd60c157780 0x7fd60c150520 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.071+0000 7fd610c76640 1 --2- 172.21.15.55:0/1020098618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0cd640 0x7fd60c15a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.071+0000 7fd610c76640 1 -- 172.21.15.55:0/1020098618 >> 172.21.15.55:0/1020098618 conn(0x7fd60c0b0410 msgr2=0x7fd60c070a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:33.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.071+0000 7fd610c76640 1 -- 172.21.15.55:0/1020098618 shutdown_connections 2023-07-06T21:42:33.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7fd610c76640 1 -- 172.21.15.55:0/1020098618 wait complete. 2023-07-06T21:42:33.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f02da7fc640 1 -- 172.21.15.55:0/4124770848 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f02c40663d0 msgr2=0x7f02c4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f02da7fc640 1 --2- 172.21.15.55:0/4124770848 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f02c40663d0 0x7f02c4068880 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f02e415ed10 tx=0x7f02cc009110 comp rx=0 tx=0).stop 2023-07-06T21:42:33.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f02da7fc640 1 -- 172.21.15.55:0/4124770848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02e40b1250 msgr2=0x7f02e4157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f02da7fc640 1 --2- 172.21.15.55:0/4124770848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02e40b1250 0x7f02e4157210 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f02d40af040 tx=0x7f02d4019260 comp rx=0 tx=0).stop 2023-07-06T21:42:33.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7fc0917fa640 1 -- 172.21.15.55:0/2031139183 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc098066380 msgr2=0x7fc098068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7fc0917fa640 1 --2- 172.21.15.55:0/2031139183 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc098066380 0x7fc098068830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0005890 tx=0x7fc0a0009040 comp rx=0 tx=0).stop 2023-07-06T21:42:33.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f7be6a34640 1 -- 172.21.15.55:0/3334965644 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7bcc066350 msgr2=0x7f7bcc068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f02da7fc640 1 -- 172.21.15.55:0/4124770848 shutdown_connections 2023-07-06T21:42:33.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f02da7fc640 1 --2- 172.21.15.55:0/4124770848 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f02c40663d0 0x7f02c4068880 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f7be6a34640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7bcc066350 0x7f7bcc068800 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7be01f45c0 tx=0x7f7bd4009040 comp rx=0 tx=0).stop 2023-07-06T21:42:33.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f02da7fc640 1 --2- 172.21.15.55:0/4124770848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02e415fe00 0x7f02e40c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f02da7fc640 1 --2- 172.21.15.55:0/4124770848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e40d0630 0x7f02e4156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f02da7fc640 1 --2- 172.21.15.55:0/4124770848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02e40b1250 0x7f02e4157210 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f02da7fc640 1 -- 172.21.15.55:0/4124770848 >> 172.21.15.55:0/4124770848 conn(0x7f02e40b3b60 msgr2=0x7f02e40ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:33.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7fc0917fa640 1 -- 172.21.15.55:0/2031139183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0ac0ca100 msgr2=0x7fc0ac1555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7fc0917fa640 1 --2- 172.21.15.55:0/2031139183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0ac0ca100 0x7fc0ac1555f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc09c01a290 tx=0x7fc09c01a420 comp rx=0 tx=0).stop 2023-07-06T21:42:33.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f7be6a34640 1 -- 172.21.15.55:0/3334965644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be00ca160 msgr2=0x7f7be01f0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f7be6a34640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be00ca160 0x7f7be01f0860 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800cbc0 tx=0x7f7bd800a430 comp rx=0 tx=0).stop 2023-07-06T21:42:33.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f7be6a34640 1 -- 172.21.15.55:0/3334965644 shutdown_connections 2023-07-06T21:42:33.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f7be6a34640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7bcc066350 0x7f7bcc068800 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f7be6a34640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7be0151c70 0x7f7be013d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f7be6a34640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be00caf70 0x7f7be013d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f7be6a34640 1 --2- 172.21.15.55:0/3334965644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be00ca160 0x7f7be01f0860 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f7be6a34640 1 -- 172.21.15.55:0/3334965644 >> 172.21.15.55:0/3334965644 conn(0x7f7be00cea70 msgr2=0x7f7be00c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:33.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f02da7fc640 1 -- 172.21.15.55:0/4124770848 shutdown_connections 2023-07-06T21:42:33.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7fc0917fa640 1 -- 172.21.15.55:0/2031139183 shutdown_connections 2023-07-06T21:42:33.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f02da7fc640 1 -- 172.21.15.55:0/4124770848 wait complete. 2023-07-06T21:42:33.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7fc0917fa640 1 --2- 172.21.15.55:0/2031139183 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc098066380 0x7fc098068830 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7fc0917fa640 1 --2- 172.21.15.55:0/2031139183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0ac157ac0 0x7fc0ac0c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7fc0917fa640 1 --2- 172.21.15.55:0/2031139183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0ac0ca100 0x7fc0ac1555f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f7be6a34640 1 -- 172.21.15.55:0/3334965644 shutdown_connections 2023-07-06T21:42:33.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7fc0917fa640 1 --2- 172.21.15.55:0/2031139183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0ac069930 0x7fc0ac0c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7fc0917fa640 1 -- 172.21.15.55:0/2031139183 >> 172.21.15.55:0/2031139183 conn(0x7fc0ac0ce8a0 msgr2=0x7fc0ac156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:33.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7f7be6a34640 1 -- 172.21.15.55:0/3334965644 wait complete. 2023-07-06T21:42:33.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7fc0917fa640 1 -- 172.21.15.55:0/2031139183 shutdown_connections 2023-07-06T21:42:33.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.075+0000 7fc0917fa640 1 -- 172.21.15.55:0/2031139183 wait complete. 2023-07-06T21:42:33.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2023-07-06T21:42:33.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.079+0000 7fba25648640 1 -- 172.21.15.55:0/3582537685 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fba2015b050 con 0x7fba200c3ce0 2023-07-06T21:42:33.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.079+0000 7fba077fe640 1 -- 172.21.15.55:0/3582537685 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba18017090 con 0x7fba200c3ce0 2023-07-06T21:42:33.099 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2023-07-06T21:42:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.079+0000 7f3ab3305640 1 -- 172.21.15.55:0/1740416974 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3a94005510 con 0x7f3aac0c0d20 2023-07-06T21:42:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.083+0000 7f3aa2ffd640 1 -- 172.21.15.55:0/1740416974 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3aa80eece0 con 0x7f3aac0c0d20 2023-07-06T21:42:33.101 INFO:teuthology.orchestra.run.smithi055.stdout:55834574857 2023-07-06T21:42:33.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.083+0000 7fba25648640 1 -- 172.21.15.55:0/3582537685 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fba0c0662b0 msgr2=0x7fba0c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.083+0000 7fba25648640 1 --2- 172.21.15.55:0/3582537685 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fba0c0662b0 0x7fba0c068760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fba140047c0 tx=0x7fba14008040 comp rx=0 tx=0).stop 2023-07-06T21:42:33.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.083+0000 7fba25648640 1 -- 172.21.15.55:0/3582537685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba200c3ce0 msgr2=0x7fba20149610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.083+0000 7fba25648640 1 --2- 172.21.15.55:0/3582537685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba200c3ce0 0x7fba20149610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fba18007a20 tx=0x7fba1800a750 comp rx=0 tx=0).stop 2023-07-06T21:42:33.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.083+0000 7fba25648640 1 -- 172.21.15.55:0/3582537685 shutdown_connections 2023-07-06T21:42:33.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.083+0000 7fba25648640 1 --2- 172.21.15.55:0/3582537685 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fba0c0662b0 0x7fba0c068760 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.083+0000 7fba25648640 1 --2- 172.21.15.55:0/3582537685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba200c4150 0x7fba2006f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.083+0000 7fba25648640 1 --2- 172.21.15.55:0/3582537685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba200c3ce0 0x7fba20149610 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.083+0000 7fba25648640 1 --2- 172.21.15.55:0/3582537685 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba08005180 0x7fba20145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.083+0000 7fba25648640 1 -- 172.21.15.55:0/3582537685 >> 172.21.15.55:0/3582537685 conn(0x7fba200cea70 msgr2=0x7fba200aef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:33.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.083+0000 7fba25648640 1 -- 172.21.15.55:0/3582537685 shutdown_connections 2023-07-06T21:42:33.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.083+0000 7fba25648640 1 -- 172.21.15.55:0/3582537685 wait complete. 2023-07-06T21:42:33.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.087+0000 7f3ab3305640 1 -- 172.21.15.55:0/1740416974 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3a900662d0 msgr2=0x7f3a90068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.087+0000 7f3ab3305640 1 --2- 172.21.15.55:0/1740416974 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3a900662d0 0x7f3a90068780 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3aac1f2e50 tx=0x7f3a9c008040 comp rx=0 tx=0).stop 2023-07-06T21:42:33.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.087+0000 7f3ab3305640 1 -- 172.21.15.55:0/1740416974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3aac0c0d20 msgr2=0x7f3aac160bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.087+0000 7f3ab3305640 1 --2- 172.21.15.55:0/1740416974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3aac0c0d20 0x7f3aac160bd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3aa801aa40 tx=0x7f3aa8019130 comp rx=0 tx=0).stop 2023-07-06T21:42:33.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.087+0000 7f3ab3305640 1 -- 172.21.15.55:0/1740416974 shutdown_connections 2023-07-06T21:42:33.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.087+0000 7f3ab3305640 1 --2- 172.21.15.55:0/1740416974 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3a900662d0 0x7f3a90068780 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.087+0000 7f3ab3305640 1 --2- 172.21.15.55:0/1740416974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aac15fd50 0x7f3aac0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.087+0000 7f3ab3305640 1 --2- 172.21.15.55:0/1740416974 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3aac0c9e30 0x7f3aac0c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.087+0000 7f3ab3305640 1 --2- 172.21.15.55:0/1740416974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3aac0c0d20 0x7f3aac160bd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.087+0000 7f3ab3305640 1 -- 172.21.15.55:0/1740416974 >> 172.21.15.55:0/1740416974 conn(0x7f3aac0cdbf0 msgr2=0x7f3aac0cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:33.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.087+0000 7f3ab3305640 1 -- 172.21.15.55:0/1740416974 shutdown_connections 2023-07-06T21:42:33.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.087+0000 7f3ab3305640 1 -- 172.21.15.55:0/1740416974 wait complete. 2023-07-06T21:42:33.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.103+0000 7f42d27fc640 1 -- 172.21.15.55:0/281731538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f42ec0c7a00 con 0x7f42ec1630a0 2023-07-06T21:42:33.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.103+0000 7f42e8ff9640 1 -- 172.21.15.55:0/281731538 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42ec0c7a00 con 0x7f42ec1630a0 2023-07-06T21:42:33.111 INFO:teuthology.orchestra.run.smithi055.stdout:55834574857 2023-07-06T21:42:33.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-07-06T21:42:33.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.107+0000 7f42d27fc640 1 -- 172.21.15.55:0/281731538 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f42d4066500 msgr2=0x7f42d40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.107+0000 7f42d27fc640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f42d4066500 0x7f42d40689b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42e4019570 tx=0x7f42e40a7070 comp rx=0 tx=0).stop 2023-07-06T21:42:33.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.107+0000 7f42d27fc640 1 -- 172.21.15.55:0/281731538 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42ec1630a0 msgr2=0x7f42ec0c5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:33.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.107+0000 7f42d27fc640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42ec1630a0 0x7f42ec0c5190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f42e000c390 tx=0x7f42e000c850 comp rx=0 tx=0).stop 2023-07-06T21:42:33.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.107+0000 7f42d27fc640 1 -- 172.21.15.55:0/281731538 shutdown_connections 2023-07-06T21:42:33.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.107+0000 7f42d27fc640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f42d4066500 0x7f42d40689b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.107+0000 7f42d27fc640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42ec163470 0x7f42ec0b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.107+0000 7f42d27fc640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42ec1630a0 0x7f42ec0c5190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.107+0000 7f42d27fc640 1 --2- 172.21.15.55:0/281731538 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42ec0c0930 0x7f42ec0c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:33.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.107+0000 7f42d27fc640 1 -- 172.21.15.55:0/281731538 >> 172.21.15.55:0/281731538 conn(0x7f42ec0ca690 msgr2=0x7f42ec1611f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:33.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.111+0000 7f42d27fc640 1 -- 172.21.15.55:0/281731538 shutdown_connections 2023-07-06T21:42:33.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:33.111+0000 7f42d27fc640 1 -- 172.21.15.55:0/281731538 wait complete. 2023-07-06T21:42:33.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2023-07-06T21:42:33.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2023-07-06T21:42:33.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-07-06T21:42:33.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-07-06T21:42:33.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2023-07-06T21:42:33.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-07-06T21:42:34.099 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-06T21:42:34.116 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-06T21:42:34.124 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-06T21:42:34.128 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-06T21:42:34.132 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-06T21:42:34.133 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-06T21:42:34.133 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-06T21:42:34.139 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-06T21:42:34.312 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:42:34.317 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:42:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.347+0000 7ff6ac46d640 1 Processor -- start 2023-07-06T21:42:34.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.347+0000 7ff6ac46d640 1 -- start start 2023-07-06T21:42:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.347+0000 7ff6ac46d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a406b860 0x7ff6a40c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.347+0000 7ff6ac46d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a40aca40 con 0x7ff6a40cc070 2023-07-06T21:42:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.347+0000 7ff6ac46d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a40c9a20 con 0x7ff6a406bc30 2023-07-06T21:42:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.347+0000 7ff6ac46d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40abe30 con 0x7ff6a406b860 2023-07-06T21:42:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.347+0000 7ff6a9a08640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff6a406bc30 0x7ff6a40cb960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:54570/0 (socket says 172.21.15.55:54570) 2023-07-06T21:42:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.347+0000 7ff6a9a08640 1 -- 172.21.15.55:0/2247914648 learned_addr learned my addr 172.21.15.55:0/2247914648 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684546725 0 0) 0x7ff6a40aca40 con 0x7ff6a40cc070 2023-07-06T21:42:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff690003530 con 0x7ff6a40cc070 2023-07-06T21:42:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428565239 0 0) 0x7ff6a40c9a20 con 0x7ff6a406bc30 2023-07-06T21:42:34.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a40aca40 con 0x7ff6a406bc30 2023-07-06T21:42:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 <== mon.1 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3032645621 0 0) 0x7ff6a40aca40 con 0x7ff6a406bc30 2023-07-06T21:42:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a406b860 msgr2=0x7ff6a40c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6aa209640 1 --2- 172.21.15.55:0/2247914648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a406b860 0x7ff6a40c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 --2- 172.21.15.55:0/2247914648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a406b860 0x7ff6a40c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 >> v1:172.21.15.55:6789/0 conn(0x7ff6a40cc070 legacy=0x7ff6a406ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a40ac110 con 0x7ff6a406bc30 2023-07-06T21:42:34.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 <== mon.1 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7ff694001660 con 0x7ff6a406bc30 2023-07-06T21:42:34.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 >> v1:172.21.15.138:6789/0 conn(0x7ff6a406bc30 legacy=0x7ff6a40cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 --2- 172.21.15.55:0/2247914648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff690003b40 0x7ff690003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 --2- 172.21.15.55:0/2247914648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6900047d0 0x7ff690004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 --2- 172.21.15.55:0/2247914648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff690005180 0x7ff69000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0001240 con 0x7ff690005180 2023-07-06T21:42:34.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40abe30 con 0x7ff690003b40 2023-07-06T21:42:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69000c090 con 0x7ff6900047d0 2023-07-06T21:42:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6aaa0a640 1 --2- 172.21.15.55:0/2247914648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff690005180 0x7ff69000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6aa209640 1 --2- 172.21.15.55:0/2247914648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a406b860 0x7ff6a40c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6a9a08640 1 --2- 172.21.15.55:0/2247914648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6900047d0 0x7ff690004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6aaa0a640 1 -- 172.21.15.55:0/2247914648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6900047d0 msgr2=0x7ff690004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6aaa0a640 1 --2- 172.21.15.55:0/2247914648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6900047d0 0x7ff690004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6aaa0a640 1 -- 172.21.15.55:0/2247914648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff690003b40 msgr2=0x7ff690003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6aa209640 1 --2- 172.21.15.55:0/2247914648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff690003b40 0x7ff690003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6aaa0a640 1 --2- 172.21.15.55:0/2247914648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff690003b40 0x7ff690003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.351+0000 7ff6aaa0a640 1 -- 172.21.15.55:0/2247914648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a40ac110 con 0x7ff690005180 2023-07-06T21:42:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.355+0000 7ff6aa209640 1 --2- 172.21.15.55:0/2247914648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff690003b40 0x7ff690003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.359+0000 7ff6aaa0a640 1 --2- 172.21.15.55:0/2247914648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff690005180 0x7ff69000b990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0007f40 tx=0x7ff6a001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349985d143db9c50 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.359+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0005310 con 0x7ff690005180 2023-07-06T21:42:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.359+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0005470 con 0x7ff690005180 2023-07-06T21:42:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.359+0000 7ff6a9207640 1 -- 172.21.15.55:0/2247914648 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a00a5990 con 0x7ff690005180 2023-07-06T21:42:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.359+0000 7ff6ac46d640 1 -- 172.21.15.55:0/2247914648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff690005180 msgr2=0x7ff69000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.359+0000 7ff6ac46d640 1 --2- 172.21.15.55:0/2247914648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff690005180 0x7ff69000b990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0007f40 tx=0x7ff6a001ca60 comp rx=0 tx=0).stop 2023-07-06T21:42:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.359+0000 7ff6aaa0a640 1 -- 172.21.15.55:0/2247914648 reap_dead start 2023-07-06T21:42:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.359+0000 7ff6ac46d640 1 -- 172.21.15.55:0/2247914648 shutdown_connections 2023-07-06T21:42:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.359+0000 7ff6ac46d640 1 -- 172.21.15.55:0/2247914648 >> 172.21.15.55:0/2247914648 conn(0x7ff6a40ce8a0 msgr2=0x7ff6a40ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.359+0000 7ff6ac46d640 1 -- 172.21.15.55:0/2247914648 shutdown_connections 2023-07-06T21:42:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.359+0000 7ff6ac46d640 1 -- 172.21.15.55:0/2247914648 wait complete. 2023-07-06T21:42:34.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.363+0000 7ff6ac46d640 1 Processor -- start 2023-07-06T21:42:34.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.363+0000 7ff6ac46d640 1 -- start start 2023-07-06T21:42:34.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.363+0000 7ff6ac46d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff690005180 0x7ff6a4145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.363+0000 7ff6ac46d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a40c4d00 0x7ff6a41f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.363+0000 7ff6ac46d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6a41f1e50 0x7ff6a40b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.363+0000 7ff6ac46d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a41f19c0 con 0x7ff6a40c4d00 2023-07-06T21:42:34.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.363+0000 7ff6ac46d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40c54a0 con 0x7ff6a41f1e50 2023-07-06T21:42:34.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.363+0000 7ff6ac46d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a41e3290 con 0x7ff690005180 2023-07-06T21:42:34.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.363+0000 7ff6aa209640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff690005180 0x7ff6a4145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.363+0000 7ff6a9a08640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a40c4d00 0x7ff6a41f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.363+0000 7ff6aa209640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff690005180 0x7ff6a4145160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:46272/0 (socket says 172.21.15.55:46272) 2023-07-06T21:42:34.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.363+0000 7ff6aa209640 1 -- 172.21.15.55:0/2771328069 learned_addr learned my addr 172.21.15.55:0/2771328069 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:34.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.367+0000 7ff6aaa0a640 1 --2- 172.21.15.55:0/2771328069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6a41f1e50 0x7ff6a40b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.367+0000 7ff6aa209640 1 -- 172.21.15.55:0/2771328069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6a41f1e50 msgr2=0x7ff6a40b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.367+0000 7ff6aa209640 1 --2- 172.21.15.55:0/2771328069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6a41f1e50 0x7ff6a40b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.367+0000 7ff6aa209640 1 -- 172.21.15.55:0/2771328069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a40c4d00 msgr2=0x7ff6a41f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.367+0000 7ff6aa209640 1 --2- 172.21.15.55:0/2771328069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a40c4d00 0x7ff6a41f0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.367+0000 7ff6aa209640 1 -- 172.21.15.55:0/2771328069 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a41456a0 con 0x7ff690005180 2023-07-06T21:42:34.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.367+0000 7ff6a9a08640 1 --2- 172.21.15.55:0/2771328069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a40c4d00 0x7ff6a41f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:34.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.367+0000 7ff6aa209640 1 --2- 172.21.15.55:0/2771328069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff690005180 0x7ff6a4145160 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00df10 tx=0x7ff69c00b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.367+0000 7ff69affd640 1 -- 172.21.15.55:0/2771328069 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c00bdf0 con 0x7ff690005180 2023-07-06T21:42:34.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.367+0000 7ff6ac46d640 1 -- 172.21.15.55:0/2771328069 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a40c51c0 con 0x7ff690005180 2023-07-06T21:42:34.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.367+0000 7ff6ac46d640 1 -- 172.21.15.55:0/2771328069 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a41f1650 con 0x7ff690005180 2023-07-06T21:42:34.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.367+0000 7ff69affd640 1 -- 172.21.15.55:0/2771328069 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c0039a0 con 0x7ff690005180 2023-07-06T21:42:34.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.367+0000 7ff69affd640 1 -- 172.21.15.55:0/2771328069 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c003d30 con 0x7ff690005180 2023-07-06T21:42:34.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.371+0000 7ff69affd640 1 -- 172.21.15.55:0/2771328069 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff69c004030 con 0x7ff690005180 2023-07-06T21:42:34.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.371+0000 7ff69affd640 1 --2- 172.21.15.55:0/2771328069 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff688066350 0x7ff688068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.371+0000 7ff6a9a08640 1 --2- 172.21.15.55:0/2771328069 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff688066350 0x7ff688068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.371+0000 7ff69affd640 1 -- 172.21.15.55:0/2771328069 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff69c084210 con 0x7ff690005180 2023-07-06T21:42:34.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.375+0000 7ff6a9a08640 1 --2- 172.21.15.55:0/2771328069 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff688066350 0x7ff688068800 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40c50f0 tx=0x7ff694009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.375+0000 7ff6ac46d640 1 -- 172.21.15.55:0/2771328069 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff68c005260 con 0x7ff690005180 2023-07-06T21:42:34.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.379+0000 7ff69affd640 1 -- 172.21.15.55:0/2771328069 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff69c01a080 con 0x7ff690005180 2023-07-06T21:42:34.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.391+0000 7f5dc963a640 1 Processor -- start 2023-07-06T21:42:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.391+0000 7f5dc963a640 1 -- start start 2023-07-06T21:42:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.391+0000 7f5dc963a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dc4070ab0 0x7f5dc40c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.391+0000 7f5dc963a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5dc4070e80 0x7f5dc40ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.391+0000 7f5dc963a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5dc416bfe0 0x7f5dc40c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.391+0000 7f5dc963a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc4069520 con 0x7f5dc416bfe0 2023-07-06T21:42:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.391+0000 7f5dc963a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc41688d0 con 0x7f5dc4070e80 2023-07-06T21:42:34.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.391+0000 7f5dc963a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc416c560 con 0x7f5dc4070ab0 2023-07-06T21:42:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.391+0000 7f5dc8e39640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5dc416bfe0 0x7f5dc40c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.391+0000 7f5dc37fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5dc4070e80 0x7f5dc40ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.391+0000 7f5dc8e39640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5dc416bfe0 0x7f5dc40c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55088/0 (socket says 172.21.15.55:55088) 2023-07-06T21:42:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.391+0000 7f5dc8e39640 1 -- 172.21.15.55:0/2150760193 learned_addr learned my addr 172.21.15.55:0/2150760193 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.395+0000 7f5dc8e39640 1 -- 172.21.15.55:0/2150760193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dc4070ab0 msgr2=0x7f5dc40c9af0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T21:42:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.395+0000 7f5dc8e39640 1 --2- 172.21.15.55:0/2150760193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dc4070ab0 0x7f5dc40c9af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.395+0000 7f5dc8e39640 1 -- 172.21.15.55:0/2150760193 >> v2:172.21.15.138:3300/0 conn(0x7f5dc4070e80 msgr2=0x7f5dc40ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.395+0000 7f5dc8e39640 1 --2- 172.21.15.55:0/2150760193 >> v2:172.21.15.138:3300/0 conn(0x7f5dc4070e80 0x7f5dc40ca030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.395+0000 7f5dc8e39640 1 -- 172.21.15.55:0/2150760193 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc416c840 con 0x7f5dc416bfe0 2023-07-06T21:42:34.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.399+0000 7f5dc8e39640 1 --2- 172.21.15.55:0/2150760193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc416bfe0 0x7f5dc40c8240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40cebb0 tx=0x7f5db8020c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2afa9e06ab76ed0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.399+0000 7f5dc2ffd640 1 -- 172.21.15.55:0/2150760193 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db80a9c90 con 0x7f5dc416bfe0 2023-07-06T21:42:34.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.403+0000 7f5dc2ffd640 1 -- 172.21.15.55:0/2150760193 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db80ad070 con 0x7f5dc416bfe0 2023-07-06T21:42:34.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.403+0000 7f5dc2ffd640 1 -- 172.21.15.55:0/2150760193 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db80b3650 con 0x7f5dc416bfe0 2023-07-06T21:42:34.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.403+0000 7f5dc963a640 1 -- 172.21.15.55:0/2150760193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc416bfe0 msgr2=0x7f5dc40c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.403+0000 7f5dc963a640 1 --2- 172.21.15.55:0/2150760193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc416bfe0 0x7f5dc40c8240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40cebb0 tx=0x7f5db8020c20 comp rx=0 tx=0).stop 2023-07-06T21:42:34.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.403+0000 7f5dc963a640 1 -- 172.21.15.55:0/2150760193 shutdown_connections 2023-07-06T21:42:34.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.403+0000 7f5dc963a640 1 --2- 172.21.15.55:0/2150760193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc416bfe0 0x7f5dc40c8240 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.403+0000 7f5dc963a640 1 --2- 172.21.15.55:0/2150760193 >> v2:172.21.15.138:3300/0 conn(0x7f5dc4070e80 0x7f5dc40ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.403+0000 7f5dc963a640 1 --2- 172.21.15.55:0/2150760193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dc4070ab0 0x7f5dc40c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.403+0000 7f5dc963a640 1 -- 172.21.15.55:0/2150760193 >> 172.21.15.55:0/2150760193 conn(0x7f5dc40cdbf0 msgr2=0x7f5dc40cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.403+0000 7f5dc963a640 1 -- 172.21.15.55:0/2150760193 shutdown_connections 2023-07-06T21:42:34.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.403+0000 7f5dc963a640 1 -- 172.21.15.55:0/2150760193 wait complete. 2023-07-06T21:42:34.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.407+0000 7f5dc963a640 1 Processor -- start 2023-07-06T21:42:34.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.407+0000 7f5dc963a640 1 -- start start 2023-07-06T21:42:34.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.407+0000 7fb61d796640 1 Processor -- start 2023-07-06T21:42:34.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.407+0000 7f5dc963a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dc4070ab0 0x7f5dc416b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.407+0000 7f5dc963a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dc4070e80 0x7f5dc40884f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.407+0000 7f5dc963a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc416bfe0 0x7f5dc4205e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7f5dc3fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dc4070ab0 0x7f5dc416b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7f5dc3fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dc4070ab0 0x7f5dc416b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:34526/0 (socket says 172.21.15.55:34526) 2023-07-06T21:42:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7f5dc3fff640 1 -- 172.21.15.55:0/37671894 learned_addr learned my addr 172.21.15.55:0/37671894 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7f5dc37fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dc4070e80 0x7f5dc40884f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7f5dc8e39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc416bfe0 0x7f5dc4205e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7f5dc963a640 1 -- 172.21.15.55:0/37671894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc4168f30 con 0x7f5dc416bfe0 2023-07-06T21:42:34.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7f5dc963a640 1 -- 172.21.15.55:0/37671894 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc4169210 con 0x7f5dc4070ab0 2023-07-06T21:42:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.407+0000 7fb61d796640 1 -- start start 2023-07-06T21:42:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7fb61d796640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb61815f520 0x7fb6180ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7fb61d796640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6180cfc20 0x7fb6180b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7fb61d796640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6180ce850 con 0x7fb6180b3f40 2023-07-06T21:42:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7fb61d796640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6180b1ab0 con 0x7fb6180cfc20 2023-07-06T21:42:34.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7fb61d796640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6180b4420 con 0x7fb61815f520 2023-07-06T21:42:34.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7fb616ffd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb61815f520 0x7fb6180ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7fb616ffd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb61815f520 0x7fb6180ce310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:34536/0 (socket says 172.21.15.55:34536) 2023-07-06T21:42:34.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7fb616ffd640 1 -- 172.21.15.55:0/741776059 learned_addr learned my addr 172.21.15.55:0/741776059 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:34.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7f5dc963a640 1 -- 172.21.15.55:0/37671894 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc41694f0 con 0x7f5dc4070e80 2023-07-06T21:42:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7f5dc8e39640 1 -- 172.21.15.55:0/37671894 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dc4070e80 msgr2=0x7f5dc40884f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7f5dc8e39640 1 --2- 172.21.15.55:0/37671894 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dc4070e80 0x7f5dc40884f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7f5dc8e39640 1 -- 172.21.15.55:0/37671894 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dc4070ab0 msgr2=0x7f5dc416b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7f5dc8e39640 1 --2- 172.21.15.55:0/37671894 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dc4070ab0 0x7f5dc416b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7f5dc8e39640 1 -- 172.21.15.55:0/37671894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db800b700 con 0x7f5dc416bfe0 2023-07-06T21:42:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7fd6309a3640 1 Processor -- start 2023-07-06T21:42:34.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7fd6309a3640 1 -- start start 2023-07-06T21:42:34.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7fb616ffd640 1 -- 172.21.15.55:0/741776059 >> v2:172.21.15.55:3300/0 conn(0x7fb6180cfc20 msgr2=0x7fb6180b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:34.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7fb616ffd640 1 --2- 172.21.15.55:0/741776059 >> v2:172.21.15.55:3300/0 conn(0x7fb6180cfc20 0x7fb6180b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7fb616ffd640 1 -- 172.21.15.55:0/741776059 >> v1:172.21.15.55:6789/0 conn(0x7fb6180b3f40 legacy=0x7fb61815f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:34.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7fb616ffd640 1 -- 172.21.15.55:0/741776059 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6180cc740 con 0x7fb61815f520 2023-07-06T21:42:34.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.411+0000 7f5dc8e39640 1 --2- 172.21.15.55:0/37671894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc416bfe0 0x7f5dc4205e90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5db80b1000 tx=0x7f5db801d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7f5dc0ff9640 1 -- 172.21.15.55:0/37671894 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db80aae70 con 0x7f5dc416bfe0 2023-07-06T21:42:34.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7f5dc0ff9640 1 -- 172.21.15.55:0/37671894 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db8004030 con 0x7f5dc416bfe0 2023-07-06T21:42:34.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7f5dc963a640 1 -- 172.21.15.55:0/37671894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc41697d0 con 0x7f5dc416bfe0 2023-07-06T21:42:34.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7f5dc963a640 1 -- 172.21.15.55:0/37671894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc4088c00 con 0x7f5dc416bfe0 2023-07-06T21:42:34.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7fd6309a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd62c0cd540 0x7fd62c0c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7fd6309a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62c0b3ba0 con 0x7fd62c070450 2023-07-06T21:42:34.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7fd6309a3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62c0b2880 con 0x7fd62c0cd0f0 2023-07-06T21:42:34.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7fd6309a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c0cd9a0 con 0x7fd62c0cd540 2023-07-06T21:42:34.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7fd629d9b640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fd62c0cd0f0 0x7fd62c0c8a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:54580/0 (socket says 172.21.15.55:54580) 2023-07-06T21:42:34.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7fd629d9b640 1 -- 172.21.15.55:0/982101157 learned_addr learned my addr 172.21.15.55:0/982101157 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:34.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7fd62ad9d640 1 --2- 172.21.15.55:0/982101157 >> v2:172.21.15.55:3300/0 conn(0x7fd62c0cd540 0x7fd62c0c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7fb616ffd640 1 --2- 172.21.15.55:0/741776059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb61815f520 0x7fb6180ce310 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb6180cfbd0 tx=0x7fb60c01c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3bdb66a0932c4cb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7f5dc0ff9640 1 -- 172.21.15.55:0/37671894 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db80043e0 con 0x7f5dc416bfe0 2023-07-06T21:42:34.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7fd62ad9d640 1 -- 172.21.15.55:0/982101157 >> v1:172.21.15.138:6789/0 conn(0x7fd62c0cd0f0 legacy=0x7fd62c0c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:34.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7fd62ad9d640 1 -- 172.21.15.55:0/982101157 >> v1:172.21.15.55:6789/0 conn(0x7fd62c070450 legacy=0x7fd62c070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:34.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7fd62ad9d640 1 -- 172.21.15.55:0/982101157 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c0c8270 con 0x7fd62c0cd540 2023-07-06T21:42:34.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7f35bc3ad640 1 Processor -- start 2023-07-06T21:42:34.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7f35bc3ad640 1 -- start start 2023-07-06T21:42:34.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7fb615ffb640 1 -- 172.21.15.55:0/741776059 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0ab600 con 0x7fb61815f520 2023-07-06T21:42:34.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7fb615ffb640 1 -- 172.21.15.55:0/741776059 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c0ab760 con 0x7fb61815f520 2023-07-06T21:42:34.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.415+0000 7fb615ffb640 1 -- 172.21.15.55:0/741776059 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0abaf0 con 0x7fb61815f520 2023-07-06T21:42:34.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f95b2f20640 1 Processor -- start 2023-07-06T21:42:34.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f95b2f20640 1 -- start start 2023-07-06T21:42:34.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35bc3ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b40c9670 0x7f35b406b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35bc3ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35b40709e0 0x7f35b406b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35bc3ad640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f35b40c9a40 0x7f35b40c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35bc3ad640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b406ed00 con 0x7f35b40709e0 2023-07-06T21:42:34.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35bc3ad640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b41600e0 con 0x7f35b40c9a40 2023-07-06T21:42:34.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35bc3ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b4070f30 con 0x7f35b40c9670 2023-07-06T21:42:34.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7fb61d796640 1 -- 172.21.15.55:0/741776059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb61815f520 msgr2=0x7fb6180ce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7fb61d796640 1 --2- 172.21.15.55:0/741776059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb61815f520 0x7fb6180ce310 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb6180cfbd0 tx=0x7fb60c01c400 comp rx=0 tx=0).stop 2023-07-06T21:42:34.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35ba94a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f35b40c9a40 0x7f35b40c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35ba149640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b40c9670 0x7f35b406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35ba149640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b40c9670 0x7f35b406b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:46296/0 (socket says 172.21.15.55:46296) 2023-07-06T21:42:34.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35ba149640 1 -- 172.21.15.55:0/214041012 learned_addr learned my addr 172.21.15.55:0/214041012 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:34.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35b9948640 1 --2- 172.21.15.55:0/214041012 >> v2:172.21.15.55:3300/0 conn(0x7f35b40709e0 0x7f35b406b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f95b2f20640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f95a40366a0 0x7f95a40e4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f95b2f20640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95a4050fe0 0x7f95a4036a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f95b2f20640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a40e5080 con 0x7f95a404fc10 2023-07-06T21:42:34.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f95b2f20640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a40381d0 con 0x7f95a4050fe0 2023-07-06T21:42:34.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f95b2f20640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a404f780 con 0x7f95a40366a0 2023-07-06T21:42:34.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35ba149640 1 -- 172.21.15.55:0/214041012 >> v2:172.21.15.138:3300/0 conn(0x7f35b40c9a40 msgr2=0x7f35b40c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:34.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35ba149640 1 --2- 172.21.15.55:0/214041012 >> v2:172.21.15.138:3300/0 conn(0x7f35b40c9a40 0x7f35b40c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35ba149640 1 -- 172.21.15.55:0/214041012 >> v2:172.21.15.55:3300/0 conn(0x7f35b40709e0 msgr2=0x7f35b406b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:34.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35ba149640 1 --2- 172.21.15.55:0/214041012 >> v2:172.21.15.55:3300/0 conn(0x7f35b40709e0 0x7f35b406b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f35ba149640 1 -- 172.21.15.55:0/214041012 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b406ef10 con 0x7f35b40c9670 2023-07-06T21:42:34.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7fb61d796640 1 -- 172.21.15.55:0/741776059 shutdown_connections 2023-07-06T21:42:34.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7fb61d796640 1 --2- 172.21.15.55:0/741776059 >> v2:172.21.15.55:3300/0 conn(0x7fb6180cfc20 0x7fb6180b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7fb61d796640 1 --2- 172.21.15.55:0/741776059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb61815f520 0x7fb6180ce310 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7fb61d796640 1 -- 172.21.15.55:0/741776059 >> 172.21.15.55:0/741776059 conn(0x7fb6180cead0 msgr2=0x7fb6180ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f95b271f640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f95a404fc10 0x7f95a4039660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:54586/0 (socket says 172.21.15.55:54586) 2023-07-06T21:42:34.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f95b271f640 1 -- 172.21.15.55:0/120269712 learned_addr learned my addr 172.21.15.55:0/120269712 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:34.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7fb61d796640 1 -- 172.21.15.55:0/741776059 shutdown_connections 2023-07-06T21:42:34.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7fd62ad9d640 1 --2- 172.21.15.55:0/982101157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd62c0cd540 0x7fd62c0c9110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd624009d90 tx=0x7fd624020cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c2497737c37311 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f95b171d640 1 --2- 172.21.15.55:0/120269712 >> v2:172.21.15.55:3300/0 conn(0x7f95a4050fe0 0x7f95a4036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f95b1f1e640 1 --2- 172.21.15.55:0/120269712 >> v2:172.21.15.138:3300/0 conn(0x7f95a40366a0 0x7f95a40e4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f95b0f1c640 1 -- 172.21.15.55:0/120269712 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102000106 0 0) 0x7f95a8001120 con 0x7f95a404fc10 2023-07-06T21:42:34.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f95b0f1c640 1 -- 172.21.15.55:0/120269712 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9598003530 con 0x7f95a404fc10 2023-07-06T21:42:34.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f95b171d640 1 -- 172.21.15.55:0/120269712 >> v2:172.21.15.138:3300/0 conn(0x7f95a40366a0 msgr2=0x7f95a40e4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:34.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f95b171d640 1 --2- 172.21.15.55:0/120269712 >> v2:172.21.15.138:3300/0 conn(0x7f95a40366a0 0x7f95a40e4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f95b171d640 1 -- 172.21.15.55:0/120269712 >> v1:172.21.15.138:6789/0 conn(0x7f95a404fc10 legacy=0x7f95a4039660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f95b171d640 1 -- 172.21.15.55:0/120269712 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a40e0a20 con 0x7f95a4050fe0 2023-07-06T21:42:34.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f35b9948640 1 --2- 172.21.15.55:0/214041012 >> v2:172.21.15.55:3300/0 conn(0x7f35b40709e0 0x7f35b406b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:34.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7efe53570640 1 Processor -- start 2023-07-06T21:42:34.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7fb61d796640 1 -- 172.21.15.55:0/741776059 wait complete. 2023-07-06T21:42:34.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f5dc0ff9640 1 -- 172.21.15.55:0/37671894 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5db80b9020 con 0x7f5dc416bfe0 2023-07-06T21:42:34.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f5dc0ff9640 1 --2- 172.21.15.55:0/37671894 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5db0066350 0x7f5db0068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7efe53570640 1 -- start start 2023-07-06T21:42:34.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.419+0000 7f5dc0ff9640 1 -- 172.21.15.55:0/37671894 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5db811df90 con 0x7f5dc416bfe0 2023-07-06T21:42:34.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f5dc3fff640 1 --2- 172.21.15.55:0/37671894 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5db0066350 0x7f5db0068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f5dc3fff640 1 --2- 172.21.15.55:0/37671894 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5db0066350 0x7f5db0068800 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009a50 tx=0x7f5db4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f2d2bfff640 1 Processor -- start 2023-07-06T21:42:34.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f2d2bfff640 1 -- start start 2023-07-06T21:42:34.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7fd62959a640 1 -- 172.21.15.55:0/982101157 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6240a9da0 con 0x7fd62c0cd540 2023-07-06T21:42:34.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7fd62959a640 1 -- 172.21.15.55:0/982101157 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6240b1440 con 0x7fd62c0cd540 2023-07-06T21:42:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7fd62959a640 1 -- 172.21.15.55:0/982101157 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6240b17d0 con 0x7fd62c0cd540 2023-07-06T21:42:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7f5dc963a640 1 -- 172.21.15.55:0/37671894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da4005260 con 0x7f5dc416bfe0 2023-07-06T21:42:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7fd6309a3640 1 -- 172.21.15.55:0/982101157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd62c0cd540 msgr2=0x7fd62c0c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.423+0000 7fd6309a3640 1 --2- 172.21.15.55:0/982101157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd62c0cd540 0x7fd62c0c9110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd624009d90 tx=0x7fd624020cb0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb61d796640 1 Processor -- start 2023-07-06T21:42:34.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fd6309a3640 1 -- 172.21.15.55:0/982101157 shutdown_connections 2023-07-06T21:42:34.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fd6309a3640 1 --2- 172.21.15.55:0/982101157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd62c0cd540 0x7fd62c0c9110 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fd6309a3640 1 -- 172.21.15.55:0/982101157 >> 172.21.15.55:0/982101157 conn(0x7fd62c0ca690 msgr2=0x7fd62c0caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fd6309a3640 1 -- 172.21.15.55:0/982101157 shutdown_connections 2023-07-06T21:42:34.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fd6309a3640 1 -- 172.21.15.55:0/982101157 wait complete. 2023-07-06T21:42:34.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb61d796640 1 -- start start 2023-07-06T21:42:34.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f35ba149640 1 --2- 172.21.15.55:0/214041012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b40c9670 0x7f35b406b410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f35b406e8d0 tx=0x7f35ac01c1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9243068d13bc6d54 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2d2c06ea40 0x7f2d2c06b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2bfff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2d2c06bc70 0x7f2d2c0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2bfff640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2c06c070 con 0x7f2d2c15b920 2023-07-06T21:42:34.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2bfff640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c15cd70 con 0x7f2d2c06ea40 2023-07-06T21:42:34.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2bfff640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c15c0f0 con 0x7f2d2c06bc70 2023-07-06T21:42:34.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2d2c06ea40 0x7f2d2c06b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2b7fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2d2c06bc70 0x7f2d2c0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2b7fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2d2c06bc70 0x7f2d2c0cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:34564/0 (socket says 172.21.15.55:34564) 2023-07-06T21:42:34.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2b7fe640 1 -- 172.21.15.55:0/1142013193 learned_addr learned my addr 172.21.15.55:0/1142013193 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:34.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2affd640 1 --1- 172.21.15.55:0/1142013193 >> v1:172.21.15.138:6789/0 conn(0x7f2d2c15b920 0x7f2d2c06efe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:54602/0 (socket says 172.21.15.55:54602) 2023-07-06T21:42:34.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe53570640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efe4c163220 0x7efe4c0693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe53570640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe4c0c9bd0 0x7efe4c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe53570640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4c06f380 con 0x7efe4c0704f0 2023-07-06T21:42:34.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe53570640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4c1635f0 con 0x7efe4c0c9bd0 2023-07-06T21:42:34.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe53570640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4c06c6e0 con 0x7efe4c163220 2023-07-06T21:42:34.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe51d6d640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7efe4c0704f0 0x7efe4c0c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:54610/0 (socket says 172.21.15.55:54610) 2023-07-06T21:42:34.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d29ffb640 1 -- 172.21.15.55:0/1142013193 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973109835 0 0) 0x7f2d2c06c070 con 0x7f2d2c15b920 2023-07-06T21:42:34.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d29ffb640 1 -- 172.21.15.55:0/1142013193 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d14003530 con 0x7f2d2c15b920 2023-07-06T21:42:34.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2b7fe640 1 -- 172.21.15.55:0/1142013193 >> v2:172.21.15.55:3300/0 conn(0x7f2d2c06ea40 msgr2=0x7f2d2c06b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:34.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe51d6d640 1 -- 172.21.15.55:0/2663819309 learned_addr learned my addr 172.21.15.55:0/2663819309 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:34.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2b7fe640 1 --2- 172.21.15.55:0/1142013193 >> v2:172.21.15.55:3300/0 conn(0x7f2d2c06ea40 0x7f2d2c06b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2b7fe640 1 -- 172.21.15.55:0/1142013193 >> v1:172.21.15.138:6789/0 conn(0x7f2d2c15b920 legacy=0x7f2d2c06efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2b7fe640 1 -- 172.21.15.55:0/1142013193 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c15c3d0 con 0x7f2d2c06bc70 2023-07-06T21:42:34.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb61d796640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6180b3f40 0x7fb61806db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb61d796640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6180cfc20 0x7fb618069ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb61d796640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb61815f520 0x7fb6180c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb61d796640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6180c9c70 con 0x7fb6180cfc20 2023-07-06T21:42:34.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb61d796640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6180c9f50 con 0x7fb61815f520 2023-07-06T21:42:34.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb61d796640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6180ca230 con 0x7fb6180b3f40 2023-07-06T21:42:34.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f2d2a7fc640 1 --2- 172.21.15.55:0/1142013193 >> v2:172.21.15.55:3300/0 conn(0x7f2d2c06ea40 0x7f2d2c06b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:34.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f35b9147640 1 -- 172.21.15.55:0/214041012 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac0ab600 con 0x7f35b40c9670 2023-07-06T21:42:34.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f35b9147640 1 -- 172.21.15.55:0/214041012 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac0a7050 con 0x7f35b40c9670 2023-07-06T21:42:34.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f35b9147640 1 -- 172.21.15.55:0/214041012 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac0ab980 con 0x7f35b40c9670 2023-07-06T21:42:34.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe5256e640 1 --2- 172.21.15.55:0/2663819309 >> v2:172.21.15.138:3300/0 conn(0x7efe4c163220 0x7efe4c0693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe52d6f640 1 --2- 172.21.15.55:0/2663819309 >> v2:172.21.15.55:3300/0 conn(0x7efe4c0c9bd0 0x7efe4c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe5156c640 1 -- 172.21.15.55:0/2663819309 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262522423 0 0) 0x7efe4c06f380 con 0x7efe4c0704f0 2023-07-06T21:42:34.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe5156c640 1 -- 172.21.15.55:0/2663819309 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe38003530 con 0x7efe4c0704f0 2023-07-06T21:42:34.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb616ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6180b3f40 0x7fb61806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb616ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6180b3f40 0x7fb61806db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:46306/0 (socket says 172.21.15.55:46306) 2023-07-06T21:42:34.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb616ffd640 1 -- 172.21.15.55:0/586638677 learned_addr learned my addr 172.21.15.55:0/586638677 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:34.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb6177fe640 1 --2- 172.21.15.55:0/586638677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb61815f520 0x7fb6180c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe52d6f640 1 -- 172.21.15.55:0/2663819309 >> v2:172.21.15.138:3300/0 conn(0x7efe4c163220 msgr2=0x7efe4c0693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:34.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe52d6f640 1 --2- 172.21.15.55:0/2663819309 >> v2:172.21.15.138:3300/0 conn(0x7efe4c163220 0x7efe4c0693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe52d6f640 1 -- 172.21.15.55:0/2663819309 >> v1:172.21.15.138:6789/0 conn(0x7efe4c0704f0 legacy=0x7efe4c0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7efe52d6f640 1 -- 172.21.15.55:0/2663819309 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c06c980 con 0x7efe4c0c9bd0 2023-07-06T21:42:34.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb616ffd640 1 -- 172.21.15.55:0/586638677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb61815f520 msgr2=0x7fb6180c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb616ffd640 1 --2- 172.21.15.55:0/586638677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb61815f520 0x7fb6180c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb616ffd640 1 -- 172.21.15.55:0/586638677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6180cfc20 msgr2=0x7fb618069ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb616ffd640 1 --2- 172.21.15.55:0/586638677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6180cfc20 0x7fb618069ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fb616ffd640 1 -- 172.21.15.55:0/586638677 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c0094d0 con 0x7fb6180b3f40 2023-07-06T21:42:34.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7fd6309a3640 1 Processor -- start 2023-07-06T21:42:34.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.427+0000 7f95b171d640 1 --2- 172.21.15.55:0/120269712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95a4050fe0 0x7f95a4036a70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f95a400d930 tx=0x7f959c0207e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1afc4482e66705 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fb616ffd640 1 --2- 172.21.15.55:0/586638677 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6180b3f40 0x7fb61806db30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb60c01aab0 tx=0x7fb60c01ac40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7f35bc3ad640 1 -- 172.21.15.55:0/214041012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b40c9670 msgr2=0x7f35b406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7f35bc3ad640 1 --2- 172.21.15.55:0/214041012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b40c9670 0x7f35b406b410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f35b406e8d0 tx=0x7f35ac01c1a0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fb5ff7fe640 1 -- 172.21.15.55:0/586638677 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0b4800 con 0x7fb6180b3f40 2023-07-06T21:42:34.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fb5ff7fe640 1 -- 172.21.15.55:0/586638677 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c0b4960 con 0x7fb6180b3f40 2023-07-06T21:42:34.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fb5ff7fe640 1 -- 172.21.15.55:0/586638677 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0b4d10 con 0x7fb6180b3f40 2023-07-06T21:42:34.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fb61d796640 1 -- 172.21.15.55:0/586638677 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6180ca510 con 0x7fb6180b3f40 2023-07-06T21:42:34.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fb61d796640 1 -- 172.21.15.55:0/586638677 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb618157c00 con 0x7fb6180b3f40 2023-07-06T21:42:34.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fd6309a3640 1 -- start start 2023-07-06T21:42:34.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7f35bc3ad640 1 -- 172.21.15.55:0/214041012 shutdown_connections 2023-07-06T21:42:34.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7f35bc3ad640 1 --2- 172.21.15.55:0/214041012 >> v2:172.21.15.138:3300/0 conn(0x7f35b40c9a40 0x7f35b40c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7f35bc3ad640 1 --2- 172.21.15.55:0/214041012 >> v2:172.21.15.55:3300/0 conn(0x7f35b40709e0 0x7f35b406b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7f35bc3ad640 1 --2- 172.21.15.55:0/214041012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b40c9670 0x7f35b406b410 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7f35bc3ad640 1 -- 172.21.15.55:0/214041012 >> 172.21.15.55:0/214041012 conn(0x7f35b40ce8a0 msgr2=0x7f35b40ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7f35bc3ad640 1 -- 172.21.15.55:0/214041012 shutdown_connections 2023-07-06T21:42:34.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fd6309a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd62c070450 0x7fd62c0c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fd6309a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd62c0cd0f0 0x7fd62c144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fd6309a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd62c0cd540 0x7fd62c0c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fd6309a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0c1b50 con 0x7fd62c0cd0f0 2023-07-06T21:42:34.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fd6309a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0c7de0 con 0x7fd62c0cd540 2023-07-06T21:42:34.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fd6309a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0c7860 con 0x7fd62c070450 2023-07-06T21:42:34.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7f35bc3ad640 1 -- 172.21.15.55:0/214041012 wait complete. 2023-07-06T21:42:34.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fd629d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd62c0cd0f0 0x7fd62c144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fd629d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd62c0cd0f0 0x7fd62c144090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55180/0 (socket says 172.21.15.55:55180) 2023-07-06T21:42:34.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fd629d9b640 1 -- 172.21.15.55:0/3927790725 learned_addr learned my addr 172.21.15.55:0/3927790725 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:34.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.431+0000 7fd62ad9d640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd62c0cd540 0x7fd62c0c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fd62a59c640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd62c070450 0x7fd62c0c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35bc3ad640 1 Processor -- start 2023-07-06T21:42:34.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f2d2b7fe640 1 --2- 172.21.15.55:0/1142013193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d2c06bc70 0x7f2d2c0cecc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c15f360 tx=0x7f2d1c01c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10bcab90e2551dbc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fd629d9b640 1 -- 172.21.15.55:0/3927790725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd62c070450 msgr2=0x7fd62c0c10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fd629d9b640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd62c070450 0x7fd62c0c10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fd629d9b640 1 -- 172.21.15.55:0/3927790725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd62c0cd540 msgr2=0x7fd62c0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fd629d9b640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd62c0cd540 0x7fd62c0c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fd629d9b640 1 -- 172.21.15.55:0/3927790725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd624009a70 con 0x7fd62c0cd0f0 2023-07-06T21:42:34.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fd62a59c640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd62c070450 0x7fd62c0c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:34.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fd62ad9d640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd62c0cd540 0x7fd62c0c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:34.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f2d29ffb640 1 -- 172.21.15.55:0/1142013193 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0a57d0 con 0x7f2d2c06bc70 2023-07-06T21:42:34.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f2d29ffb640 1 -- 172.21.15.55:0/1142013193 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c0a5930 con 0x7f2d2c06bc70 2023-07-06T21:42:34.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f2d29ffb640 1 -- 172.21.15.55:0/1142013193 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0a5cc0 con 0x7f2d2c06bc70 2023-07-06T21:42:34.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fd629d9b640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd62c0cd0f0 0x7fd62c144090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd62000c470 tx=0x7fd62000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7efe52d6f640 1 --2- 172.21.15.55:0/2663819309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe4c0c9bd0 0x7efe4c06f810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0cb770 tx=0x7efe4401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83aafda60f3b9696 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fb61d796640 1 -- 172.21.15.55:0/586638677 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61804d790 con 0x7fb6180b3f40 2023-07-06T21:42:34.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fb5ff7fe640 1 -- 172.21.15.55:0/586638677 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb60c0b3380 con 0x7fb6180b3f40 2023-07-06T21:42:34.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fb5ff7fe640 1 --2- 172.21.15.55:0/586638677 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb604066280 0x7fb604068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fb5ff7fe640 1 -- 172.21.15.55:0/586638677 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb60c11e6e0 con 0x7fb6180b3f40 2023-07-06T21:42:34.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fd61affd640 1 -- 172.21.15.55:0/3927790725 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620005cf0 con 0x7fd62c0cd0f0 2023-07-06T21:42:34.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fd6309a3640 1 -- 172.21.15.55:0/3927790725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62c0c7b00 con 0x7fd62c0cd0f0 2023-07-06T21:42:34.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fd6309a3640 1 -- 172.21.15.55:0/3927790725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c153600 con 0x7fd62c0cd0f0 2023-07-06T21:42:34.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fd61affd640 1 -- 172.21.15.55:0/3927790725 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd620005e50 con 0x7fd62c0cd0f0 2023-07-06T21:42:34.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7fd61affd640 1 -- 172.21.15.55:0/3927790725 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620007270 con 0x7fd62c0cd0f0 2023-07-06T21:42:34.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35bc3ad640 1 -- start start 2023-07-06T21:42:34.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35bc3ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35b40709e0 0x7f35b4147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35bc3ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b40c9670 0x7f35b40c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35bc3ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b40c9a40 0x7f35b40c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35bc3ad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40c75c0 con 0x7f35b40c9670 2023-07-06T21:42:34.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35ba149640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35b40709e0 0x7f35b4147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35b9948640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b40c9670 0x7f35b40c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35b9948640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b40c9670 0x7f35b40c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55186/0 (socket says 172.21.15.55:55186) 2023-07-06T21:42:34.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35b9948640 1 -- 172.21.15.55:0/2318435483 learned_addr learned my addr 172.21.15.55:0/2318435483 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:34.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35ba94a640 1 --2- 172.21.15.55:0/2318435483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b40c9a40 0x7f35b40c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35bc3ad640 1 -- 172.21.15.55:0/2318435483 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40c78a0 con 0x7f35b40709e0 2023-07-06T21:42:34.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35bc3ad640 1 -- 172.21.15.55:0/2318435483 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40c7b80 con 0x7f35b40c9a40 2023-07-06T21:42:34.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f2d2bfff640 1 -- 172.21.15.55:0/1142013193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d2c06bc70 msgr2=0x7f2d2c0cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f2d2bfff640 1 --2- 172.21.15.55:0/1142013193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d2c06bc70 0x7f2d2c0cecc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c15f360 tx=0x7f2d1c01c910 comp rx=0 tx=0).stop 2023-07-06T21:42:34.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f2d2bfff640 1 -- 172.21.15.55:0/1142013193 shutdown_connections 2023-07-06T21:42:34.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f2d2bfff640 1 --2- 172.21.15.55:0/1142013193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d2c06bc70 0x7f2d2c0cecc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f2d2bfff640 1 --2- 172.21.15.55:0/1142013193 >> v2:172.21.15.55:3300/0 conn(0x7f2d2c06ea40 0x7f2d2c06b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f2d2bfff640 1 -- 172.21.15.55:0/1142013193 >> 172.21.15.55:0/1142013193 conn(0x7f2d2c0cd510 msgr2=0x7f2d2c0cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f2d2bfff640 1 -- 172.21.15.55:0/1142013193 shutdown_connections 2023-07-06T21:42:34.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7efe5156c640 1 -- 172.21.15.55:0/2663819309 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe440a58e0 con 0x7efe4c0c9bd0 2023-07-06T21:42:34.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7efe5156c640 1 -- 172.21.15.55:0/2663819309 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe440a5a40 con 0x7efe4c0c9bd0 2023-07-06T21:42:34.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7efe5156c640 1 -- 172.21.15.55:0/2663819309 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe440a58e0 con 0x7efe4c0c9bd0 2023-07-06T21:42:34.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f2d2bfff640 1 -- 172.21.15.55:0/1142013193 wait complete. 2023-07-06T21:42:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7efe53570640 1 -- 172.21.15.55:0/2663819309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe4c0c9bd0 msgr2=0x7efe4c06f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7efe53570640 1 --2- 172.21.15.55:0/2663819309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe4c0c9bd0 0x7efe4c06f810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0cb770 tx=0x7efe4401c910 comp rx=0 tx=0).stop 2023-07-06T21:42:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35b9948640 1 -- 172.21.15.55:0/2318435483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b40c9a40 msgr2=0x7f35b40c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35b9948640 1 --2- 172.21.15.55:0/2318435483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b40c9a40 0x7f35b40c6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35b9948640 1 -- 172.21.15.55:0/2318435483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35b40709e0 msgr2=0x7f35b4147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35b9948640 1 --2- 172.21.15.55:0/2318435483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35b40709e0 0x7f35b4147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f35b9948640 1 -- 172.21.15.55:0/2318435483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b0009420 con 0x7f35b40c9670 2023-07-06T21:42:34.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7efe53570640 1 -- 172.21.15.55:0/2663819309 shutdown_connections 2023-07-06T21:42:34.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2bfff640 1 Processor -- start 2023-07-06T21:42:34.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7efe53570640 1 --2- 172.21.15.55:0/2663819309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe4c0c9bd0 0x7efe4c06f810 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f35b9948640 1 --2- 172.21.15.55:0/2318435483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b40c9670 0x7f35b40c6aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35b000e9b0 tx=0x7f35b000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7efe53570640 1 --2- 172.21.15.55:0/2663819309 >> v2:172.21.15.138:3300/0 conn(0x7efe4c163220 0x7efe4c0693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7efe53570640 1 -- 172.21.15.55:0/2663819309 >> 172.21.15.55:0/2663819309 conn(0x7efe4c0b0410 msgr2=0x7efe4c0cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.435+0000 7f5dc0ff9640 1 -- 172.21.15.55:0/37671894 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5db80c1080 con 0x7f5dc416bfe0 2023-07-06T21:42:34.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2bfff640 1 -- start start 2023-07-06T21:42:34.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f95b0f1c640 1 -- 172.21.15.55:0/120269712 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c0a95c0 con 0x7f95a4050fe0 2023-07-06T21:42:34.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f95b0f1c640 1 -- 172.21.15.55:0/120269712 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c0a9720 con 0x7f95a4050fe0 2023-07-06T21:42:34.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f95b0f1c640 1 -- 172.21.15.55:0/120269712 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c0a9ab0 con 0x7f95a4050fe0 2023-07-06T21:42:34.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7fd6309a3640 1 -- 172.21.15.55:0/3927790725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd610005260 con 0x7fd62c0cd0f0 2023-07-06T21:42:34.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7efe53570640 1 -- 172.21.15.55:0/2663819309 shutdown_connections 2023-07-06T21:42:34.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f95b2f20640 1 -- 172.21.15.55:0/120269712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95a4050fe0 msgr2=0x7f95a4036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f95b2f20640 1 --2- 172.21.15.55:0/120269712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95a4050fe0 0x7f95a4036a70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f95a400d930 tx=0x7f959c0207e0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f95b2f20640 1 -- 172.21.15.55:0/120269712 shutdown_connections 2023-07-06T21:42:34.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f95b2f20640 1 --2- 172.21.15.55:0/120269712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95a4050fe0 0x7f95a4036a70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f95b2f20640 1 --2- 172.21.15.55:0/120269712 >> v2:172.21.15.138:3300/0 conn(0x7f95a40366a0 0x7f95a40e4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f95b2f20640 1 -- 172.21.15.55:0/120269712 >> 172.21.15.55:0/120269712 conn(0x7f95a40516a0 msgr2=0x7f95a4051aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7fb5ff7fe640 1 -- 172.21.15.55:0/586638677 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb60c0eba00 con 0x7fb6180b3f40 2023-07-06T21:42:34.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7efe53570640 1 -- 172.21.15.55:0/2663819309 wait complete. 2023-07-06T21:42:34.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c06bc70 0x7f2d2c156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2bfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c15b920 0x7f2d2c15ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d2c0b4480 0x7f2d2c0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7fd61affd640 1 -- 172.21.15.55:0/3927790725 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6200073d0 con 0x7fd62c0cd0f0 2023-07-06T21:42:34.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2bfff640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c153680 con 0x7f2d2c06bc70 2023-07-06T21:42:34.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2bfff640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0b2f80 con 0x7f2d2c0b4480 2023-07-06T21:42:34.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2bfff640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c156740 con 0x7f2d2c15b920 2023-07-06T21:42:34.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2a7fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c15b920 0x7f2d2c15ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d2c0b4480 0x7f2d2c0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2a7fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c15b920 0x7f2d2c15ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:46342/0 (socket says 172.21.15.55:46342) 2023-07-06T21:42:34.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2a7fc640 1 -- 172.21.15.55:0/293202430 learned_addr learned my addr 172.21.15.55:0/293202430 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:34.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2affd640 1 --2- 172.21.15.55:0/293202430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c06bc70 0x7f2d2c156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2affd640 1 -- 172.21.15.55:0/293202430 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c15b920 msgr2=0x7f2d2c15ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2affd640 1 --2- 172.21.15.55:0/293202430 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c15b920 0x7f2d2c15ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2affd640 1 -- 172.21.15.55:0/293202430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d2c0b4480 msgr2=0x7f2d2c0b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2affd640 1 --2- 172.21.15.55:0/293202430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d2c0b4480 0x7f2d2c0b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.439+0000 7f2d2affd640 1 -- 172.21.15.55:0/293202430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d24009420 con 0x7f2d2c06bc70 2023-07-06T21:42:34.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7fd61affd640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd60c0662b0 0x7fd60c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7f2d2affd640 1 --2- 172.21.15.55:0/293202430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c06bc70 0x7f2d2c156200 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2d20001ec0 tx=0x7f2d2000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7fd61affd640 1 -- 172.21.15.55:0/3927790725 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd620083a70 con 0x7fd62c0cd0f0 2023-07-06T21:42:34.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7f35aaffd640 1 -- 172.21.15.55:0/2318435483 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b000ca00 con 0x7f35b40c9670 2023-07-06T21:42:34.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7f35aaffd640 1 -- 172.21.15.55:0/2318435483 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b000cb60 con 0x7f35b40c9670 2023-07-06T21:42:34.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7f35aaffd640 1 -- 172.21.15.55:0/2318435483 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b000ced0 con 0x7f35b40c9670 2023-07-06T21:42:34.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7f35bc3ad640 1 -- 172.21.15.55:0/2318435483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ac0094d0 con 0x7f35b40c9670 2023-07-06T21:42:34.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7fb6167fc640 1 --2- 172.21.15.55:0/586638677 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb604066280 0x7fb604068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7fd62a59c640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd60c0662b0 0x7fd60c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7f35bc3ad640 1 -- 172.21.15.55:0/2318435483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b41484a0 con 0x7f35b40c9670 2023-07-06T21:42:34.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7efe53570640 1 Processor -- start 2023-07-06T21:42:34.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7efe53570640 1 -- start start 2023-07-06T21:42:34.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7fb6167fc640 1 --2- 172.21.15.55:0/586638677 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb604066280 0x7fb604068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb61815fc30 tx=0x7fb608006bd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7fd62a59c640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd60c0662b0 0x7fd60c068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd61c003ec0 tx=0x7fd61c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7f95b2f20640 1 -- 172.21.15.55:0/120269712 shutdown_connections 2023-07-06T21:42:34.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7f95b2f20640 1 -- 172.21.15.55:0/120269712 wait complete. 2023-07-06T21:42:34.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7efe53570640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe4c0704f0 0x7efe4c1546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7efe53570640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe4c0c9bd0 0x7efe4c0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7efe53570640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe4c163220 0x7efe4c0c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7efe53570640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c154c10 con 0x7efe4c163220 2023-07-06T21:42:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7efe53570640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0b1200 con 0x7efe4c0704f0 2023-07-06T21:42:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7efe53570640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0c7c30 con 0x7efe4c0c9bd0 2023-07-06T21:42:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7efe5256e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe4c0704f0 0x7efe4c1546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7efe5256e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe4c0704f0 0x7efe4c1546d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:34610/0 (socket says 172.21.15.55:34610) 2023-07-06T21:42:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.443+0000 7efe5256e640 1 -- 172.21.15.55:0/1530433960 learned_addr learned my addr 172.21.15.55:0/1530433960 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:34.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe51d6d640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe4c0c9bd0 0x7efe4c0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe52d6f640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe4c163220 0x7efe4c0c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe5256e640 1 -- 172.21.15.55:0/1530433960 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe4c0c9bd0 msgr2=0x7efe4c0c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe5256e640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe4c0c9bd0 0x7efe4c0c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe5256e640 1 -- 172.21.15.55:0/1530433960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe4c163220 msgr2=0x7efe4c0c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe5256e640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe4c163220 0x7efe4c0c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe5256e640 1 -- 172.21.15.55:0/1530433960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe44009a70 con 0x7efe4c0704f0 2023-07-06T21:42:34.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe51d6d640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe4c0c9bd0 0x7efe4c0c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:34.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe5256e640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe4c0704f0 0x7efe4c1546d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efe4800e870 tx=0x7efe4800ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7f35bc3ad640 1 -- 172.21.15.55:0/2318435483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b404d790 con 0x7f35b40c9670 2023-07-06T21:42:34.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe42ffd640 1 -- 172.21.15.55:0/1530433960 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48009510 con 0x7efe4c0704f0 2023-07-06T21:42:34.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe42ffd640 1 -- 172.21.15.55:0/1530433960 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4800eec0 con 0x7efe4c0704f0 2023-07-06T21:42:34.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe42ffd640 1 -- 172.21.15.55:0/1530433960 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4800cb40 con 0x7efe4c0704f0 2023-07-06T21:42:34.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe53570640 1 -- 172.21.15.55:0/1530433960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4c0c7950 con 0x7efe4c0704f0 2023-07-06T21:42:34.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7f95b2f20640 1 Processor -- start 2023-07-06T21:42:34.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe53570640 1 -- 172.21.15.55:0/1530433960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4c0b0e90 con 0x7efe4c0704f0 2023-07-06T21:42:34.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7f95b2f20640 1 -- start start 2023-07-06T21:42:34.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7efe53570640 1 -- 172.21.15.55:0/1530433960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4c04d790 con 0x7efe4c0704f0 2023-07-06T21:42:34.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.447+0000 7fd61affd640 1 -- 172.21.15.55:0/3927790725 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd620050c30 con 0x7fd62c0cd0f0 2023-07-06T21:42:34.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b2f20640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95a40366a0 0x7f95a40d74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b2f20640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95a404fc10 0x7f95a404d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b1f1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95a40366a0 0x7f95a40d74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b1f1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95a40366a0 0x7f95a40d74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55218/0 (socket says 172.21.15.55:55218) 2023-07-06T21:42:34.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b2f20640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95a4050fe0 0x7f95a40db1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b171d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95a404fc10 0x7f95a404d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b171d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95a404fc10 0x7f95a404d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:46360/0 (socket says 172.21.15.55:46360) 2023-07-06T21:42:34.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b1f1e640 1 -- 172.21.15.55:0/4144666278 learned_addr learned my addr 172.21.15.55:0/4144666278 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:34.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b2f20640 1 -- 172.21.15.55:0/4144666278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40e0e60 con 0x7f95a40366a0 2023-07-06T21:42:34.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b2f20640 1 -- 172.21.15.55:0/4144666278 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40d7a30 con 0x7f95a4050fe0 2023-07-06T21:42:34.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b271f640 1 --2- 172.21.15.55:0/4144666278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95a4050fe0 0x7f95a40db1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f2d13fff640 1 -- 172.21.15.55:0/293202430 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200074e0 con 0x7f2d2c06bc70 2023-07-06T21:42:34.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f2d2bfff640 1 -- 172.21.15.55:0/293202430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1c009b30 con 0x7f2d2c06bc70 2023-07-06T21:42:34.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f2d2bfff640 1 -- 172.21.15.55:0/293202430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c155120 con 0x7f2d2c06bc70 2023-07-06T21:42:34.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b2f20640 1 -- 172.21.15.55:0/4144666278 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a404e910 con 0x7f95a404fc10 2023-07-06T21:42:34.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f35aaffd640 1 -- 172.21.15.55:0/2318435483 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35b0013470 con 0x7f35b40c9670 2023-07-06T21:42:34.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b171d640 1 -- 172.21.15.55:0/4144666278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95a4050fe0 msgr2=0x7f95a40db1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b171d640 1 --2- 172.21.15.55:0/4144666278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95a4050fe0 0x7f95a40db1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b171d640 1 -- 172.21.15.55:0/4144666278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95a40366a0 msgr2=0x7f95a40d74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b171d640 1 --2- 172.21.15.55:0/4144666278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95a40366a0 0x7f95a40d74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b171d640 1 -- 172.21.15.55:0/4144666278 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c009420 con 0x7f95a404fc10 2023-07-06T21:42:34.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b171d640 1 --2- 172.21.15.55:0/4144666278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95a404fc10 0x7f95a404d840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f95a4007be0 tx=0x7f959c01d580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7efe42ffd640 1 -- 172.21.15.55:0/1530433960 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efe4800cca0 con 0x7efe4c0704f0 2023-07-06T21:42:34.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7efe42ffd640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efe30066350 0x7efe30068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f2d2bfff640 1 -- 172.21.15.55:0/293202430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2c04d790 con 0x7f2d2c06bc70 2023-07-06T21:42:34.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f2d13fff640 1 -- 172.21.15.55:0/293202430 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d20007640 con 0x7f2d2c06bc70 2023-07-06T21:42:34.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f2d13fff640 1 -- 172.21.15.55:0/293202430 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200049f0 con 0x7f2d2c06bc70 2023-07-06T21:42:34.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95a27fc640 1 -- 172.21.15.55:0/4144666278 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c0b2c10 con 0x7f95a404fc10 2023-07-06T21:42:34.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95a27fc640 1 -- 172.21.15.55:0/4144666278 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c0b2db0 con 0x7f95a404fc10 2023-07-06T21:42:34.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95a27fc640 1 -- 172.21.15.55:0/4144666278 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c0ba670 con 0x7f95a404fc10 2023-07-06T21:42:34.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f35aaffd640 1 --2- 172.21.15.55:0/2318435483 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f35a0066300 0x7f35a00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7efe42ffd640 1 -- 172.21.15.55:0/1530433960 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efe48084530 con 0x7efe4c0704f0 2023-07-06T21:42:34.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.455+0000 7f35aaffd640 1 -- 172.21.15.55:0/2318435483 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f35b00597e0 con 0x7f35b40c9670 2023-07-06T21:42:34.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b2f20640 1 -- 172.21.15.55:0/4144666278 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a404e070 con 0x7f95a404fc10 2023-07-06T21:42:34.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.451+0000 7f95b2f20640 1 -- 172.21.15.55:0/4144666278 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a404e630 con 0x7f95a404fc10 2023-07-06T21:42:34.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.455+0000 7efe42ffd640 1 -- 172.21.15.55:0/1530433960 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe48051730 con 0x7efe4c0704f0 2023-07-06T21:42:34.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.455+0000 7f95b2f20640 1 -- 172.21.15.55:0/4144666278 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a40e0fa0 con 0x7f95a404fc10 2023-07-06T21:42:34.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.455+0000 7f95a27fc640 1 -- 172.21.15.55:0/4144666278 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f959c0b8040 con 0x7f95a404fc10 2023-07-06T21:42:34.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.459+0000 7f95a27fc640 1 --2- 172.21.15.55:0/4144666278 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95900662d0 0x7f9590068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.459+0000 7f95a27fc640 1 -- 172.21.15.55:0/4144666278 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f959c122780 con 0x7f95a404fc10 2023-07-06T21:42:34.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.459+0000 7f35ba149640 1 --2- 172.21.15.55:0/2318435483 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f35a0066300 0x7f35a00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.459+0000 7efe51d6d640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efe30066350 0x7efe30068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.459+0000 7f2d13fff640 1 -- 172.21.15.55:0/293202430 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d20004b50 con 0x7f2d2c06bc70 2023-07-06T21:42:34.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.459+0000 7f2d13fff640 1 --2- 172.21.15.55:0/293202430 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d180662b0 0x7f2d18068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.459+0000 7f95b1f1e640 1 --2- 172.21.15.55:0/4144666278 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95900662d0 0x7f9590068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.459+0000 7f2d2a7fc640 1 --2- 172.21.15.55:0/293202430 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d180662b0 0x7f2d18068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:34.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.459+0000 7f95a27fc640 1 -- 172.21.15.55:0/4144666278 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95a40e0fa0 con 0x7f95a404fc10 2023-07-06T21:42:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.463+0000 7f35ba149640 1 --2- 172.21.15.55:0/2318435483 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f35a0066300 0x7f35a00687b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0ad000 tx=0x7f35ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.463+0000 7f2d2a7fc640 1 --2- 172.21.15.55:0/293202430 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d180662b0 0x7f2d18068760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0b0c30 tx=0x7f2d24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.463+0000 7efe51d6d640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efe30066350 0x7efe30068800 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0cb450 tx=0x7efe3c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.463+0000 7f95b1f1e640 1 --2- 172.21.15.55:0/4144666278 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95900662d0 0x7f9590068780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f95ac078790 tx=0x7f95ac08af90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.471+0000 7f35aaffd640 1 -- 172.21.15.55:0/2318435483 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35b0051c10 con 0x7f35b40c9670 2023-07-06T21:42:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.471+0000 7f2d13fff640 1 -- 172.21.15.55:0/293202430 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2d20054fa0 con 0x7f2d2c06bc70 2023-07-06T21:42:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.479+0000 7f2d13fff640 1 -- 172.21.15.55:0/293202430 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d200512e0 con 0x7f2d2c06bc70 2023-07-06T21:42:34.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.727+0000 7ff6ac46d640 1 -- 172.21.15.55:0/2771328069 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff68c0050d0 con 0x7ff690005180 2023-07-06T21:42:34.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.727+0000 7ff69affd640 1 -- 172.21.15.55:0/2771328069 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff69c054ec0 con 0x7ff690005180 2023-07-06T21:42:34.734 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-07-06T21:42:34.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.731+0000 7ff698ff9640 1 -- 172.21.15.55:0/2771328069 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff688066350 msgr2=0x7ff688068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.731+0000 7ff698ff9640 1 --2- 172.21.15.55:0/2771328069 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff688066350 0x7ff688068800 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40c50f0 tx=0x7ff694009040 comp rx=0 tx=0).stop 2023-07-06T21:42:34.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.731+0000 7ff698ff9640 1 -- 172.21.15.55:0/2771328069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff690005180 msgr2=0x7ff6a4145160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.731+0000 7ff698ff9640 1 --2- 172.21.15.55:0/2771328069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff690005180 0x7ff6a4145160 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00df10 tx=0x7ff69c00b3b0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.731+0000 7ff698ff9640 1 -- 172.21.15.55:0/2771328069 shutdown_connections 2023-07-06T21:42:34.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.731+0000 7ff698ff9640 1 --2- 172.21.15.55:0/2771328069 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff688066350 0x7ff688068800 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.731+0000 7ff698ff9640 1 --2- 172.21.15.55:0/2771328069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6a41f1e50 0x7ff6a40b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.731+0000 7ff698ff9640 1 --2- 172.21.15.55:0/2771328069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a40c4d00 0x7ff6a41f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.731+0000 7ff698ff9640 1 --2- 172.21.15.55:0/2771328069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff690005180 0x7ff6a4145160 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.731+0000 7ff698ff9640 1 -- 172.21.15.55:0/2771328069 >> 172.21.15.55:0/2771328069 conn(0x7ff6a40ce8a0 msgr2=0x7ff6a41e0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.731+0000 7ff698ff9640 1 -- 172.21.15.55:0/2771328069 shutdown_connections 2023-07-06T21:42:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.731+0000 7ff698ff9640 1 -- 172.21.15.55:0/2771328069 wait complete. 2023-07-06T21:42:34.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.3 2023-07-06T21:42:34.767 DEBUG:teuthology.parallel:result is None 2023-07-06T21:42:34.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.771+0000 7fd6309a3640 1 -- 172.21.15.55:0/3927790725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd610005510 con 0x7fd62c0cd0f0 2023-07-06T21:42:34.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.771+0000 7f5dc963a640 1 -- 172.21.15.55:0/37671894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5da4005510 con 0x7f5dc416bfe0 2023-07-06T21:42:34.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.771+0000 7f5dc0ff9640 1 -- 172.21.15.55:0/37671894 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5db80af020 con 0x7f5dc416bfe0 2023-07-06T21:42:34.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.771+0000 7fd61affd640 1 -- 172.21.15.55:0/3927790725 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd620054250 con 0x7fd62c0cd0f0 2023-07-06T21:42:34.778 INFO:teuthology.orchestra.run.smithi055.stdout:55834574859 2023-07-06T21:42:34.778 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-07-06T21:42:34.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7fd6309a3640 1 -- 172.21.15.55:0/3927790725 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd60c0662b0 msgr2=0x7fd60c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7fd6309a3640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd60c0662b0 0x7fd60c068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd61c003ec0 tx=0x7fd61c009040 comp rx=0 tx=0).stop 2023-07-06T21:42:34.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7fd6309a3640 1 -- 172.21.15.55:0/3927790725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd62c0cd0f0 msgr2=0x7fd62c144090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7fd6309a3640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd62c0cd0f0 0x7fd62c144090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd62000c470 tx=0x7fd62000c930 comp rx=0 tx=0).stop 2023-07-06T21:42:34.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7fd6309a3640 1 -- 172.21.15.55:0/3927790725 shutdown_connections 2023-07-06T21:42:34.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7fd6309a3640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd60c0662b0 0x7fd60c068760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7fd6309a3640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd62c0cd540 0x7fd62c0c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7fd6309a3640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd62c0cd0f0 0x7fd62c144090 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7fd6309a3640 1 --2- 172.21.15.55:0/3927790725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd62c070450 0x7fd62c0c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7fd6309a3640 1 -- 172.21.15.55:0/3927790725 >> 172.21.15.55:0/3927790725 conn(0x7fd62c0ca690 msgr2=0x7fd62c0cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7fd6309a3640 1 -- 172.21.15.55:0/3927790725 shutdown_connections 2023-07-06T21:42:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7fd6309a3640 1 -- 172.21.15.55:0/3927790725 wait complete. 2023-07-06T21:42:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7f5dc963a640 1 -- 172.21.15.55:0/37671894 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5db0066350 msgr2=0x7f5db0068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7f5dc963a640 1 --2- 172.21.15.55:0/37671894 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5db0066350 0x7f5db0068800 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009a50 tx=0x7f5db4009190 comp rx=0 tx=0).stop 2023-07-06T21:42:34.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7f5dc963a640 1 -- 172.21.15.55:0/37671894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc416bfe0 msgr2=0x7f5dc4205e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7f5dc963a640 1 --2- 172.21.15.55:0/37671894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc416bfe0 0x7f5dc4205e90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5db80b1000 tx=0x7f5db801d9c0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7f5dc963a640 1 -- 172.21.15.55:0/37671894 shutdown_connections 2023-07-06T21:42:34.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7f5dc963a640 1 --2- 172.21.15.55:0/37671894 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5db0066350 0x7f5db0068800 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7f5dc963a640 1 --2- 172.21.15.55:0/37671894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc416bfe0 0x7f5dc4205e90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7f5dc963a640 1 --2- 172.21.15.55:0/37671894 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dc4070e80 0x7f5dc40884f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7f5dc963a640 1 --2- 172.21.15.55:0/37671894 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dc4070ab0 0x7f5dc416b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7f5dc963a640 1 -- 172.21.15.55:0/37671894 >> 172.21.15.55:0/37671894 conn(0x7f5dc40cdbf0 msgr2=0x7f5dc40b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7f5dc963a640 1 -- 172.21.15.55:0/37671894 shutdown_connections 2023-07-06T21:42:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7f5dc963a640 1 -- 172.21.15.55:0/37671894 wait complete. 2023-07-06T21:42:34.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.775+0000 7fb61d796640 1 -- 172.21.15.55:0/586638677 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb6180735d0 con 0x7fb6180b3f40 2023-07-06T21:42:34.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.779+0000 7fb5ff7fe640 1 -- 172.21.15.55:0/586638677 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb60c0ef020 con 0x7fb6180b3f40 2023-07-06T21:42:34.790 INFO:teuthology.orchestra.run.smithi055.stdout:55834574857 2023-07-06T21:42:34.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.783+0000 7fb61d796640 1 -- 172.21.15.55:0/586638677 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb604066280 msgr2=0x7fb604068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.783+0000 7fb61d796640 1 --2- 172.21.15.55:0/586638677 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb604066280 0x7fb604068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb61815fc30 tx=0x7fb608006bd0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.783+0000 7fb61d796640 1 -- 172.21.15.55:0/586638677 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6180b3f40 msgr2=0x7fb61806db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.783+0000 7fb61d796640 1 --2- 172.21.15.55:0/586638677 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6180b3f40 0x7fb61806db30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb60c01aab0 tx=0x7fb60c01ac40 comp rx=0 tx=0).stop 2023-07-06T21:42:34.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.783+0000 7fb61d796640 1 -- 172.21.15.55:0/586638677 shutdown_connections 2023-07-06T21:42:34.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.783+0000 7fb61d796640 1 --2- 172.21.15.55:0/586638677 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb604066280 0x7fb604068730 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb61815fc30 tx=0x7fb608006bd0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.783+0000 7fb61d796640 1 --2- 172.21.15.55:0/586638677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb61815f520 0x7fb6180c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.783+0000 7fb61d796640 1 --2- 172.21.15.55:0/586638677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6180cfc20 0x7fb618069ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.783+0000 7fb61d796640 1 --2- 172.21.15.55:0/586638677 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6180b3f40 0x7fb61806db30 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb60c01aab0 tx=0x7fb60c01ac40 comp rx=0 tx=0).stop 2023-07-06T21:42:34.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.783+0000 7fb61d796640 1 -- 172.21.15.55:0/586638677 >> 172.21.15.55:0/586638677 conn(0x7fb6180cead0 msgr2=0x7fb61806a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.787+0000 7fb61d796640 1 -- 172.21.15.55:0/586638677 shutdown_connections 2023-07-06T21:42:34.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.787+0000 7fb61d796640 1 -- 172.21.15.55:0/586638677 wait complete. 2023-07-06T21:42:34.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.791+0000 7efe53570640 1 -- 172.21.15.55:0/1530433960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7efe4c06c320 con 0x7efe4c0704f0 2023-07-06T21:42:34.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.791+0000 7efe42ffd640 1 -- 172.21.15.55:0/1530433960 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe48054d50 con 0x7efe4c0704f0 2023-07-06T21:42:34.798 INFO:teuthology.orchestra.run.smithi055.stdout:55834574859 2023-07-06T21:42:34.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.795+0000 7efe53570640 1 -- 172.21.15.55:0/1530433960 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efe30066350 msgr2=0x7efe30068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.795+0000 7efe53570640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efe30066350 0x7efe30068800 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0cb450 tx=0x7efe3c009040 comp rx=0 tx=0).stop 2023-07-06T21:42:34.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.795+0000 7efe53570640 1 -- 172.21.15.55:0/1530433960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe4c0704f0 msgr2=0x7efe4c1546d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.795+0000 7efe53570640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe4c0704f0 0x7efe4c1546d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efe4800e870 tx=0x7efe4800ec70 comp rx=0 tx=0).stop 2023-07-06T21:42:34.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.795+0000 7efe53570640 1 -- 172.21.15.55:0/1530433960 shutdown_connections 2023-07-06T21:42:34.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.795+0000 7efe53570640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efe30066350 0x7efe30068800 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.795+0000 7efe53570640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe4c163220 0x7efe4c0c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.795+0000 7efe53570640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe4c0c9bd0 0x7efe4c0c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.795+0000 7efe53570640 1 --2- 172.21.15.55:0/1530433960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe4c0704f0 0x7efe4c1546d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.795+0000 7efe53570640 1 -- 172.21.15.55:0/1530433960 >> 172.21.15.55:0/1530433960 conn(0x7efe4c0b0410 msgr2=0x7efe4c157f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.795+0000 7efe53570640 1 -- 172.21.15.55:0/1530433960 shutdown_connections 2023-07-06T21:42:34.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.795+0000 7efe53570640 1 -- 172.21.15.55:0/1530433960 wait complete. 2023-07-06T21:42:34.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.799+0000 7f95b2f20640 1 -- 172.21.15.55:0/4144666278 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f95a40e0fa0 con 0x7f95a404fc10 2023-07-06T21:42:34.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.799+0000 7f95a27fc640 1 -- 172.21.15.55:0/4144666278 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95a40e0fa0 con 0x7f95a404fc10 2023-07-06T21:42:34.805 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-07-06T21:42:34.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f2d2bfff640 1 -- 172.21.15.55:0/293202430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2d2c0b0980 con 0x7f2d2c06bc70 2023-07-06T21:42:34.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.1 2023-07-06T21:42:34.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f35bc3ad640 1 -- 172.21.15.55:0/2318435483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f35b40cafc0 con 0x7f35b40c9670 2023-07-06T21:42:34.809 DEBUG:teuthology.parallel:result is None 2023-07-06T21:42:34.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f95b2f20640 1 -- 172.21.15.55:0/4144666278 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95900662d0 msgr2=0x7f9590068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f95b2f20640 1 --2- 172.21.15.55:0/4144666278 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95900662d0 0x7f9590068780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f95ac078790 tx=0x7f95ac08af90 comp rx=0 tx=0).stop 2023-07-06T21:42:34.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f95b2f20640 1 -- 172.21.15.55:0/4144666278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95a404fc10 msgr2=0x7f95a404d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f95b2f20640 1 --2- 172.21.15.55:0/4144666278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95a404fc10 0x7f95a404d840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f95a4007be0 tx=0x7f959c01d580 comp rx=0 tx=0).stop 2023-07-06T21:42:34.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f95b2f20640 1 -- 172.21.15.55:0/4144666278 shutdown_connections 2023-07-06T21:42:34.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f95b2f20640 1 --2- 172.21.15.55:0/4144666278 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95900662d0 0x7f9590068780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f95b2f20640 1 --2- 172.21.15.55:0/4144666278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95a4050fe0 0x7f95a40db1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f95b2f20640 1 --2- 172.21.15.55:0/4144666278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95a404fc10 0x7f95a404d840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f95b2f20640 1 --2- 172.21.15.55:0/4144666278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95a40366a0 0x7f95a40d74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f95b2f20640 1 -- 172.21.15.55:0/4144666278 >> 172.21.15.55:0/4144666278 conn(0x7f95a40516a0 msgr2=0x7f95a4004d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f2d13fff640 1 -- 172.21.15.55:0/293202430 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d20054900 con 0x7f2d2c06bc70 2023-07-06T21:42:34.811 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-07-06T21:42:34.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f35aaffd640 1 -- 172.21.15.55:0/2318435483 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f35b0021090 con 0x7f35b40c9670 2023-07-06T21:42:34.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f95b2f20640 1 -- 172.21.15.55:0/4144666278 shutdown_connections 2023-07-06T21:42:34.812 INFO:teuthology.orchestra.run.smithi055.stdout:55834574859 2023-07-06T21:42:34.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f95b2f20640 1 -- 172.21.15.55:0/4144666278 wait complete. 2023-07-06T21:42:34.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f2d2bfff640 1 -- 172.21.15.55:0/293202430 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d180662b0 msgr2=0x7f2d18068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f2d2bfff640 1 --2- 172.21.15.55:0/293202430 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d180662b0 0x7f2d18068760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0b0c30 tx=0x7f2d24008040 comp rx=0 tx=0).stop 2023-07-06T21:42:34.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f2d2bfff640 1 -- 172.21.15.55:0/293202430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c06bc70 msgr2=0x7f2d2c156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.803+0000 7f2d2bfff640 1 --2- 172.21.15.55:0/293202430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c06bc70 0x7f2d2c156200 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2d20001ec0 tx=0x7f2d2000c820 comp rx=0 tx=0).stop 2023-07-06T21:42:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f2d2bfff640 1 -- 172.21.15.55:0/293202430 shutdown_connections 2023-07-06T21:42:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f2d2bfff640 1 --2- 172.21.15.55:0/293202430 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d180662b0 0x7f2d18068760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f2d2bfff640 1 --2- 172.21.15.55:0/293202430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d2c0b4480 0x7f2d2c0b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f2d2bfff640 1 --2- 172.21.15.55:0/293202430 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c15b920 0x7f2d2c15ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f2d2bfff640 1 --2- 172.21.15.55:0/293202430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c06bc70 0x7f2d2c156200 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f2d2bfff640 1 -- 172.21.15.55:0/293202430 >> 172.21.15.55:0/293202430 conn(0x7f2d2c0cd510 msgr2=0x7f2d2c15fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f2d2bfff640 1 -- 172.21.15.55:0/293202430 shutdown_connections 2023-07-06T21:42:34.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f2d2bfff640 1 -- 172.21.15.55:0/293202430 wait complete. 2023-07-06T21:42:34.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f35bc3ad640 1 -- 172.21.15.55:0/2318435483 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f35a0066300 msgr2=0x7f35a00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f35bc3ad640 1 --2- 172.21.15.55:0/2318435483 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f35a0066300 0x7f35a00687b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0ad000 tx=0x7f35ac008040 comp rx=0 tx=0).stop 2023-07-06T21:42:34.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f35bc3ad640 1 -- 172.21.15.55:0/2318435483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b40c9670 msgr2=0x7f35b40c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:34.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f35bc3ad640 1 --2- 172.21.15.55:0/2318435483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b40c9670 0x7f35b40c6aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35b000e9b0 tx=0x7f35b000ee70 comp rx=0 tx=0).stop 2023-07-06T21:42:34.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f35bc3ad640 1 -- 172.21.15.55:0/2318435483 shutdown_connections 2023-07-06T21:42:34.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f35bc3ad640 1 --2- 172.21.15.55:0/2318435483 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f35a0066300 0x7f35a00687b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f35bc3ad640 1 --2- 172.21.15.55:0/2318435483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b40c9a40 0x7f35b40c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f35bc3ad640 1 --2- 172.21.15.55:0/2318435483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b40c9670 0x7f35b40c6aa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f35bc3ad640 1 --2- 172.21.15.55:0/2318435483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35b40709e0 0x7f35b4147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:34.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f35bc3ad640 1 -- 172.21.15.55:0/2318435483 >> 172.21.15.55:0/2318435483 conn(0x7f35b40ce8a0 msgr2=0x7f35b40cc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:34.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f35bc3ad640 1 -- 172.21.15.55:0/2318435483 shutdown_connections 2023-07-06T21:42:34.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:34.807+0000 7f35bc3ad640 1 -- 172.21.15.55:0/2318435483 wait complete. 2023-07-06T21:42:34.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.5 2023-07-06T21:42:34.818 DEBUG:teuthology.parallel:result is None 2023-07-06T21:42:34.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.4 2023-07-06T21:42:34.826 DEBUG:teuthology.parallel:result is None 2023-07-06T21:42:34.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.6 2023-07-06T21:42:34.835 DEBUG:teuthology.parallel:result is None 2023-07-06T21:42:34.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.7 2023-07-06T21:42:34.840 DEBUG:teuthology.parallel:result is None 2023-07-06T21:42:34.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.0 2023-07-06T21:42:34.849 DEBUG:teuthology.parallel:result is None 2023-07-06T21:42:34.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.2 2023-07-06T21:42:34.850 DEBUG:teuthology.parallel:result is None 2023-07-06T21:42:34.850 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-06T21:42:34.851 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:42:35.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.027+0000 7f95c47fa640 1 Processor -- start 2023-07-06T21:42:35.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.027+0000 7f95c47fa640 1 -- start start 2023-07-06T21:42:35.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.027+0000 7f95c47fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95bc15f740 0x7f95bc15cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c47fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95bc0cbc70 0x7f95bc0cc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c47fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc0b5b50 con 0x7f95bc0cb4a0 2023-07-06T21:42:35.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c47fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc15d130 con 0x7f95bc0cbc70 2023-07-06T21:42:35.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c47fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0cc5b0 con 0x7f95bc15f740 2023-07-06T21:42:35.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c2596640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f95bc0cb4a0 0x7f95bc0ca720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38400/0 (socket says 172.21.15.55:38400) 2023-07-06T21:42:35.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c2596640 1 -- 172.21.15.55:0/1677614053 learned_addr learned my addr 172.21.15.55:0/1677614053 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:35.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c2d97640 1 --2- 172.21.15.55:0/1677614053 >> v2:172.21.15.55:3300/0 conn(0x7f95bc0cbc70 0x7f95bc0cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c1d95640 1 --2- 172.21.15.55:0/1677614053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95bc15f740 0x7f95bc15cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c1594640 1 -- 172.21.15.55:0/1677614053 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936935428 0 0) 0x7f95bc0b5b50 con 0x7f95bc0cb4a0 2023-07-06T21:42:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c2d97640 1 -- 172.21.15.55:0/1677614053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95bc15f740 msgr2=0x7f95bc15cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c2d97640 1 --2- 172.21.15.55:0/1677614053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95bc15f740 0x7f95bc15cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c2d97640 1 -- 172.21.15.55:0/1677614053 >> v1:172.21.15.55:6789/0 conn(0x7f95bc0cb4a0 legacy=0x7f95bc0ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c2d97640 1 -- 172.21.15.55:0/1677614053 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc0cc8e0 con 0x7f95bc0cbc70 2023-07-06T21:42:35.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c2d97640 1 --2- 172.21.15.55:0/1677614053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95bc0cbc70 0x7f95bc0cc070 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009d90 tx=0x7f95b401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950fbae3a330d4b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:35.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c1594640 1 -- 172.21.15.55:0/1677614053 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40a5900 con 0x7f95bc0cbc70 2023-07-06T21:42:35.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c1594640 1 -- 172.21.15.55:0/1677614053 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b40a5a60 con 0x7f95bc0cbc70 2023-07-06T21:42:35.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.031+0000 7f95c1594640 1 -- 172.21.15.55:0/1677614053 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40a5df0 con 0x7f95bc0cbc70 2023-07-06T21:42:35.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 -- 172.21.15.55:0/1677614053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95bc0cbc70 msgr2=0x7f95bc0cc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 --2- 172.21.15.55:0/1677614053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95bc0cbc70 0x7f95bc0cc070 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009d90 tx=0x7f95b401c950 comp rx=0 tx=0).stop 2023-07-06T21:42:35.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 -- 172.21.15.55:0/1677614053 shutdown_connections 2023-07-06T21:42:35.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 --2- 172.21.15.55:0/1677614053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95bc15f740 0x7f95bc15cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 --2- 172.21.15.55:0/1677614053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95bc0cbc70 0x7f95bc0cc070 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 -- 172.21.15.55:0/1677614053 >> 172.21.15.55:0/1677614053 conn(0x7f95bc06ee80 msgr2=0x7f95bc06f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:35.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 -- 172.21.15.55:0/1677614053 shutdown_connections 2023-07-06T21:42:35.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 -- 172.21.15.55:0/1677614053 wait complete. 2023-07-06T21:42:35.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 Processor -- start 2023-07-06T21:42:35.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 -- start start 2023-07-06T21:42:35.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95bc0cb4a0 0x7f95bc0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95bc0cbc70 0x7f95bc0c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95bc15f740 0x7f95bc147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0c74d0 con 0x7f95bc15f740 2023-07-06T21:42:35.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc1479a0 con 0x7f95bc0cbc70 2023-07-06T21:42:35.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c47fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0c6410 con 0x7f95bc0cb4a0 2023-07-06T21:42:35.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c2d97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95bc15f740 0x7f95bc147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c2d97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95bc15f740 0x7f95bc147460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55240/0 (socket says 172.21.15.55:55240) 2023-07-06T21:42:35.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c2d97640 1 -- 172.21.15.55:0/3999346269 learned_addr learned my addr 172.21.15.55:0/3999346269 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:35.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c1d95640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95bc0cbc70 0x7f95bc0c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c2596640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95bc0cb4a0 0x7f95bc0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c2d97640 1 -- 172.21.15.55:0/3999346269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95bc0cb4a0 msgr2=0x7f95bc0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.035+0000 7f95c2d97640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95bc0cb4a0 0x7f95bc0c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95c2d97640 1 -- 172.21.15.55:0/3999346269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95bc0cbc70 msgr2=0x7f95bc0c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95c2d97640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95bc0cbc70 0x7f95bc0c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95c2d97640 1 -- 172.21.15.55:0/3999346269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b4009a70 con 0x7f95bc15f740 2023-07-06T21:42:35.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95c1d95640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95bc0cbc70 0x7f95bc0c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:35.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95c2596640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95bc0cb4a0 0x7f95bc0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:35.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95c2d97640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95bc15f740 0x7f95bc147460 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f95b401a580 tx=0x7f95b40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:35.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95b2ffd640 1 -- 172.21.15.55:0/3999346269 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40bd070 con 0x7f95bc15f740 2023-07-06T21:42:35.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95b2ffd640 1 -- 172.21.15.55:0/3999346269 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b40a58f0 con 0x7f95bc15f740 2023-07-06T21:42:35.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95c47fa640 1 -- 172.21.15.55:0/3999346269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc0c5800 con 0x7f95bc15f740 2023-07-06T21:42:35.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95b2ffd640 1 -- 172.21.15.55:0/3999346269 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40ad850 con 0x7f95bc15f740 2023-07-06T21:42:35.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95c47fa640 1 -- 172.21.15.55:0/3999346269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc0c5dc0 con 0x7f95bc15f740 2023-07-06T21:42:35.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95c47fa640 1 -- 172.21.15.55:0/3999346269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95bc0c65a0 con 0x7f95bc15f740 2023-07-06T21:42:35.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95b2ffd640 1 -- 172.21.15.55:0/3999346269 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95b40b4070 con 0x7f95bc15f740 2023-07-06T21:42:35.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95b2ffd640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95a0066280 0x7f95a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95b2ffd640 1 -- 172.21.15.55:0/3999346269 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f95b411e790 con 0x7f95bc15f740 2023-07-06T21:42:35.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.039+0000 7f95c2596640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95a0066280 0x7f95a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.043+0000 7f95c2596640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95a0066280 0x7f95a0068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f95b8000f70 tx=0x7f95b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.043+0000 7f95b2ffd640 1 -- 172.21.15.55:0/3999346269 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95b40eb9a0 con 0x7f95bc15f740 2023-07-06T21:42:35.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.199+0000 7f95c47fa640 1 -- 172.21.15.55:0/3999346269 --> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95bc1604a0 con 0x7f95a0066280 2023-07-06T21:42:35.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.207+0000 7f95b2ffd640 1 -- 172.21.15.55:0/3999346269 <== mgr.4101 v2:172.21.15.55:6832/1575998409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367351 (secure 0 0 0) 0x7f95b8001d60 con 0x7f95a0066280 2023-07-06T21:42:35.217 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:35.218 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:42:35.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.211+0000 7f95c47fa640 1 -- 172.21.15.55:0/3999346269 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95a0066280 msgr2=0x7f95a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.211+0000 7f95c47fa640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95a0066280 0x7f95a0068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f95b8000f70 tx=0x7f95b8009040 comp rx=0 tx=0).stop 2023-07-06T21:42:35.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.211+0000 7f95c47fa640 1 -- 172.21.15.55:0/3999346269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95bc15f740 msgr2=0x7f95bc147460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.211+0000 7f95c47fa640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95bc15f740 0x7f95bc147460 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f95b401a580 tx=0x7f95b40196f0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.211+0000 7f95c47fa640 1 -- 172.21.15.55:0/3999346269 shutdown_connections 2023-07-06T21:42:35.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.211+0000 7f95c47fa640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95a0066280 0x7f95a0068730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.211+0000 7f95c47fa640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95bc15f740 0x7f95bc147460 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.211+0000 7f95c47fa640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95bc0cbc70 0x7f95bc0c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.211+0000 7f95c47fa640 1 --2- 172.21.15.55:0/3999346269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95bc0cb4a0 0x7f95bc0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.211+0000 7f95c47fa640 1 -- 172.21.15.55:0/3999346269 >> 172.21.15.55:0/3999346269 conn(0x7f95bc06ee80 msgr2=0x7f95bc15b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:35.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.211+0000 7f95c47fa640 1 -- 172.21.15.55:0/3999346269 shutdown_connections 2023-07-06T21:42:35.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.211+0000 7f95c47fa640 1 -- 172.21.15.55:0/3999346269 wait complete. 2023-07-06T21:42:35.238 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-07-06T21:42:33.647778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235488,"kb_used_data":3488,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739232,"statfs":{"total":773094113280,"available":772852973568,"internally_reserved":0,"allocated":3571712,"data_stored":2147088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002452"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559395+0000","last_change":"2023-07-06T21:42:14.922760+0000","last_active":"2023-07-06T21:42:15.559395+0000","last_peered":"2023-07-06T21:42:15.559395+0000","last_clean":"2023-07-06T21:42:15.559395+0000","last_became_active":"2023-07-06T21:42:14.922077+0000","last_became_peered":"2023-07-06T21:42:14.922077+0000","last_unstale":"2023-07-06T21:42:15.559395+0000","last_undegraded":"2023-07-06T21:42:15.559395+0000","last_fullsized":"2023-07-06T21:42:15.559395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:06:48.524116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555170+0000","last_change":"2023-07-06T21:42:10.476753+0000","last_active":"2023-07-06T21:42:15.555170+0000","last_peered":"2023-07-06T21:42:15.555170+0000","last_clean":"2023-07-06T21:42:15.555170+0000","last_became_active":"2023-07-06T21:42:10.476407+0000","last_became_peered":"2023-07-06T21:42:10.476407+0000","last_unstale":"2023-07-06T21:42:15.555170+0000","last_undegraded":"2023-07-06T21:42:15.555170+0000","last_fullsized":"2023-07-06T21:42:15.555170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:48.294217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302669+0000","last_change":"2023-07-06T21:42:10.894302+0000","last_active":"2023-07-06T21:42:15.302669+0000","last_peered":"2023-07-06T21:42:15.302669+0000","last_clean":"2023-07-06T21:42:15.302669+0000","last_became_active":"2023-07-06T21:42:10.894059+0000","last_became_peered":"2023-07-06T21:42:10.894059+0000","last_unstale":"2023-07-06T21:42:15.302669+0000","last_undegraded":"2023-07-06T21:42:15.302669+0000","last_fullsized":"2023-07-06T21:42:15.302669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:10:18.902553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302860+0000","last_change":"2023-07-06T21:42:14.912729+0000","last_active":"2023-07-06T21:42:15.302860+0000","last_peered":"2023-07-06T21:42:15.302860+0000","last_clean":"2023-07-06T21:42:15.302860+0000","last_became_active":"2023-07-06T21:42:14.912302+0000","last_became_peered":"2023-07-06T21:42:14.912302+0000","last_unstale":"2023-07-06T21:42:15.302860+0000","last_undegraded":"2023-07-06T21:42:15.302860+0000","last_fullsized":"2023-07-06T21:42:15.302860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:34:24.860047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814495+0000","last_change":"2023-07-06T21:42:10.468782+0000","last_active":"2023-07-06T21:42:15.814495+0000","last_peered":"2023-07-06T21:42:15.814495+0000","last_clean":"2023-07-06T21:42:15.814495+0000","last_became_active":"2023-07-06T21:42:10.468411+0000","last_became_peered":"2023-07-06T21:42:10.468411+0000","last_unstale":"2023-07-06T21:42:15.814495+0000","last_undegraded":"2023-07-06T21:42:15.814495+0000","last_fullsized":"2023-07-06T21:42:15.814495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:15:16.029351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814107+0000","last_change":"2023-07-06T21:42:10.877047+0000","last_active":"2023-07-06T21:42:15.814107+0000","last_peered":"2023-07-06T21:42:15.814107+0000","last_clean":"2023-07-06T21:42:15.814107+0000","last_became_active":"2023-07-06T21:42:10.876806+0000","last_became_peered":"2023-07-06T21:42:10.876806+0000","last_unstale":"2023-07-06T21:42:15.814107+0000","last_undegraded":"2023-07-06T21:42:15.814107+0000","last_fullsized":"2023-07-06T21:42:15.814107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:35.611286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749539+0000","last_change":"2023-07-06T21:42:14.921605+0000","last_active":"2023-07-06T21:42:15.749539+0000","last_peered":"2023-07-06T21:42:15.749539+0000","last_clean":"2023-07-06T21:42:15.749539+0000","last_became_active":"2023-07-06T21:42:14.921171+0000","last_became_peered":"2023-07-06T21:42:14.921171+0000","last_unstale":"2023-07-06T21:42:15.749539+0000","last_undegraded":"2023-07-06T21:42:15.749539+0000","last_fullsized":"2023-07-06T21:42:15.749539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:53.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750023+0000","last_change":"2023-07-06T21:42:10.482575+0000","last_active":"2023-07-06T21:42:15.750023+0000","last_peered":"2023-07-06T21:42:15.750023+0000","last_clean":"2023-07-06T21:42:15.750023+0000","last_became_active":"2023-07-06T21:42:10.482316+0000","last_became_peered":"2023-07-06T21:42:10.482316+0000","last_unstale":"2023-07-06T21:42:15.750023+0000","last_undegraded":"2023-07-06T21:42:15.750023+0000","last_fullsized":"2023-07-06T21:42:15.750023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:18:13.828606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303215+0000","last_change":"2023-07-06T21:42:10.883364+0000","last_active":"2023-07-06T21:42:15.303215+0000","last_peered":"2023-07-06T21:42:15.303215+0000","last_clean":"2023-07-06T21:42:15.303215+0000","last_became_active":"2023-07-06T21:42:10.882034+0000","last_became_peered":"2023-07-06T21:42:10.882034+0000","last_unstale":"2023-07-06T21:42:15.303215+0000","last_undegraded":"2023-07-06T21:42:15.303215+0000","last_fullsized":"2023-07-06T21:42:15.303215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:15:09.620712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303343+0000","last_change":"2023-07-06T21:42:14.910108+0000","last_active":"2023-07-06T21:42:15.303343+0000","last_peered":"2023-07-06T21:42:15.303343+0000","last_clean":"2023-07-06T21:42:15.303343+0000","last_became_active":"2023-07-06T21:42:14.909696+0000","last_became_peered":"2023-07-06T21:42:14.909696+0000","last_unstale":"2023-07-06T21:42:15.303343+0000","last_undegraded":"2023-07-06T21:42:15.303343+0000","last_fullsized":"2023-07-06T21:42:15.303343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:24.738875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749578+0000","last_change":"2023-07-06T21:42:10.474754+0000","last_active":"2023-07-06T21:42:15.749578+0000","last_peered":"2023-07-06T21:42:15.749578+0000","last_clean":"2023-07-06T21:42:15.749578+0000","last_became_active":"2023-07-06T21:42:10.474461+0000","last_became_peered":"2023-07-06T21:42:10.474461+0000","last_unstale":"2023-07-06T21:42:15.749578+0000","last_undegraded":"2023-07-06T21:42:15.749578+0000","last_fullsized":"2023-07-06T21:42:15.749578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:02.030132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303640+0000","last_change":"2023-07-06T21:42:10.882870+0000","last_active":"2023-07-06T21:42:15.303640+0000","last_peered":"2023-07-06T21:42:15.303640+0000","last_clean":"2023-07-06T21:42:15.303640+0000","last_became_active":"2023-07-06T21:42:10.882523+0000","last_became_peered":"2023-07-06T21:42:10.882523+0000","last_unstale":"2023-07-06T21:42:15.303640+0000","last_undegraded":"2023-07-06T21:42:15.303640+0000","last_fullsized":"2023-07-06T21:42:15.303640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:29:36.364419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560105+0000","last_change":"2023-07-06T21:42:14.904246+0000","last_active":"2023-07-06T21:42:15.560105+0000","last_peered":"2023-07-06T21:42:15.560105+0000","last_clean":"2023-07-06T21:42:15.560105+0000","last_became_active":"2023-07-06T21:42:14.903763+0000","last_became_peered":"2023-07-06T21:42:14.903763+0000","last_unstale":"2023-07-06T21:42:15.560105+0000","last_undegraded":"2023-07-06T21:42:15.560105+0000","last_fullsized":"2023-07-06T21:42:15.560105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555200+0000","last_change":"2023-07-06T21:42:10.483593+0000","last_active":"2023-07-06T21:42:15.555200+0000","last_peered":"2023-07-06T21:42:15.555200+0000","last_clean":"2023-07-06T21:42:15.555200+0000","last_became_active":"2023-07-06T21:42:10.483284+0000","last_became_peered":"2023-07-06T21:42:10.483284+0000","last_unstale":"2023-07-06T21:42:15.555200+0000","last_undegraded":"2023-07-06T21:42:15.555200+0000","last_fullsized":"2023-07-06T21:42:15.555200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:37.773277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300337+0000","last_change":"2023-07-06T21:42:10.901884+0000","last_active":"2023-07-06T21:42:15.300337+0000","last_peered":"2023-07-06T21:42:15.300337+0000","last_clean":"2023-07-06T21:42:15.300337+0000","last_became_active":"2023-07-06T21:42:10.901580+0000","last_became_peered":"2023-07-06T21:42:10.901580+0000","last_unstale":"2023-07-06T21:42:15.300337+0000","last_undegraded":"2023-07-06T21:42:15.300337+0000","last_fullsized":"2023-07-06T21:42:15.300337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:22:55.494418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303514+0000","last_change":"2023-07-06T21:42:14.912585+0000","last_active":"2023-07-06T21:42:15.303514+0000","last_peered":"2023-07-06T21:42:15.303514+0000","last_clean":"2023-07-06T21:42:15.303514+0000","last_became_active":"2023-07-06T21:42:14.912161+0000","last_became_peered":"2023-07-06T21:42:14.912161+0000","last_unstale":"2023-07-06T21:42:15.303514+0000","last_undegraded":"2023-07-06T21:42:15.303514+0000","last_fullsized":"2023-07-06T21:42:15.303514+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:00:05.811592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303358+0000","last_change":"2023-07-06T21:42:10.475123+0000","last_active":"2023-07-06T21:42:15.303358+0000","last_peered":"2023-07-06T21:42:15.303358+0000","last_clean":"2023-07-06T21:42:15.303358+0000","last_became_active":"2023-07-06T21:42:10.474779+0000","last_became_peered":"2023-07-06T21:42:10.474779+0000","last_unstale":"2023-07-06T21:42:15.303358+0000","last_undegraded":"2023-07-06T21:42:15.303358+0000","last_fullsized":"2023-07-06T21:42:15.303358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:57:21.124055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814299+0000","last_change":"2023-07-06T21:42:10.896524+0000","last_active":"2023-07-06T21:42:15.814299+0000","last_peered":"2023-07-06T21:42:15.814299+0000","last_clean":"2023-07-06T21:42:15.814299+0000","last_became_active":"2023-07-06T21:42:10.896258+0000","last_became_peered":"2023-07-06T21:42:10.896258+0000","last_unstale":"2023-07-06T21:42:15.814299+0000","last_undegraded":"2023-07-06T21:42:15.814299+0000","last_fullsized":"2023-07-06T21:42:15.814299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:01.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816070+0000","last_change":"2023-07-06T21:42:14.906299+0000","last_active":"2023-07-06T21:42:15.816070+0000","last_peered":"2023-07-06T21:42:15.816070+0000","last_clean":"2023-07-06T21:42:15.816070+0000","last_became_active":"2023-07-06T21:42:14.905903+0000","last_became_peered":"2023-07-06T21:42:14.905903+0000","last_unstale":"2023-07-06T21:42:15.816070+0000","last_undegraded":"2023-07-06T21:42:15.816070+0000","last_fullsized":"2023-07-06T21:42:15.816070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:15.781649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559557+0000","last_change":"2023-07-06T21:42:10.473362+0000","last_active":"2023-07-06T21:42:15.559557+0000","last_peered":"2023-07-06T21:42:15.559557+0000","last_clean":"2023-07-06T21:42:15.559557+0000","last_became_active":"2023-07-06T21:42:10.473023+0000","last_became_peered":"2023-07-06T21:42:10.473023+0000","last_unstale":"2023-07-06T21:42:15.559557+0000","last_undegraded":"2023-07-06T21:42:15.559557+0000","last_fullsized":"2023-07-06T21:42:15.559557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:44:16.691368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555110+0000","last_change":"2023-07-06T21:42:10.894953+0000","last_active":"2023-07-06T21:42:15.555110+0000","last_peered":"2023-07-06T21:42:15.555110+0000","last_clean":"2023-07-06T21:42:15.555110+0000","last_became_active":"2023-07-06T21:42:10.894746+0000","last_became_peered":"2023-07-06T21:42:10.894746+0000","last_unstale":"2023-07-06T21:42:15.555110+0000","last_undegraded":"2023-07-06T21:42:15.555110+0000","last_fullsized":"2023-07-06T21:42:15.555110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:03.040492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555021+0000","last_change":"2023-07-06T21:42:14.909036+0000","last_active":"2023-07-06T21:42:15.555021+0000","last_peered":"2023-07-06T21:42:15.555021+0000","last_clean":"2023-07-06T21:42:15.555021+0000","last_became_active":"2023-07-06T21:42:14.908620+0000","last_became_peered":"2023-07-06T21:42:14.908620+0000","last_unstale":"2023-07-06T21:42:15.555021+0000","last_undegraded":"2023-07-06T21:42:15.555021+0000","last_fullsized":"2023-07-06T21:42:15.555021+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813952+0000","last_change":"2023-07-06T21:42:10.478777+0000","last_active":"2023-07-06T21:42:15.813952+0000","last_peered":"2023-07-06T21:42:15.813952+0000","last_clean":"2023-07-06T21:42:15.813952+0000","last_became_active":"2023-07-06T21:42:10.478487+0000","last_became_peered":"2023-07-06T21:42:10.478487+0000","last_unstale":"2023-07-06T21:42:15.813952+0000","last_undegraded":"2023-07-06T21:42:15.813952+0000","last_fullsized":"2023-07-06T21:42:15.813952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:02.030132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816172+0000","last_change":"2023-07-06T21:42:10.891356+0000","last_active":"2023-07-06T21:42:15.816172+0000","last_peered":"2023-07-06T21:42:15.816172+0000","last_clean":"2023-07-06T21:42:15.816172+0000","last_became_active":"2023-07-06T21:42:10.890691+0000","last_became_peered":"2023-07-06T21:42:10.890691+0000","last_unstale":"2023-07-06T21:42:15.816172+0000","last_undegraded":"2023-07-06T21:42:15.816172+0000","last_fullsized":"2023-07-06T21:42:15.816172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:49:21.474970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813824+0000","last_change":"2023-07-06T21:42:10.903834+0000","last_active":"2023-07-06T21:42:15.813824+0000","last_peered":"2023-07-06T21:42:15.813824+0000","last_clean":"2023-07-06T21:42:15.813824+0000","last_became_active":"2023-07-06T21:42:10.903529+0000","last_became_peered":"2023-07-06T21:42:10.903529+0000","last_unstale":"2023-07-06T21:42:15.813824+0000","last_undegraded":"2023-07-06T21:42:15.813824+0000","last_fullsized":"2023-07-06T21:42:15.813824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:49.957566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555297+0000","last_change":"2023-07-06T21:42:10.476662+0000","last_active":"2023-07-06T21:42:15.555297+0000","last_peered":"2023-07-06T21:42:15.555297+0000","last_clean":"2023-07-06T21:42:15.555297+0000","last_became_active":"2023-07-06T21:42:10.476371+0000","last_became_peered":"2023-07-06T21:42:10.476371+0000","last_unstale":"2023-07-06T21:42:15.555297+0000","last_undegraded":"2023-07-06T21:42:15.555297+0000","last_fullsized":"2023-07-06T21:42:15.555297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:34.600926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815594+0000","last_change":"2023-07-06T21:42:14.905161+0000","last_active":"2023-07-06T21:42:15.815594+0000","last_peered":"2023-07-06T21:42:15.815594+0000","last_clean":"2023-07-06T21:42:15.815594+0000","last_became_active":"2023-07-06T21:42:14.904772+0000","last_became_peered":"2023-07-06T21:42:14.904772+0000","last_unstale":"2023-07-06T21:42:15.815594+0000","last_undegraded":"2023-07-06T21:42:15.815594+0000","last_fullsized":"2023-07-06T21:42:15.815594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:16:29.182580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813950+0000","last_change":"2023-07-06T21:42:10.886798+0000","last_active":"2023-07-06T21:42:15.813950+0000","last_peered":"2023-07-06T21:42:15.813950+0000","last_clean":"2023-07-06T21:42:15.813950+0000","last_became_active":"2023-07-06T21:42:10.886419+0000","last_became_peered":"2023-07-06T21:42:10.886419+0000","last_unstale":"2023-07-06T21:42:15.813950+0000","last_undegraded":"2023-07-06T21:42:15.813950+0000","last_fullsized":"2023-07-06T21:42:15.813950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:49.304577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750157+0000","last_change":"2023-07-06T21:42:10.470631+0000","last_active":"2023-07-06T21:42:15.750157+0000","last_peered":"2023-07-06T21:42:15.750157+0000","last_clean":"2023-07-06T21:42:15.750157+0000","last_became_active":"2023-07-06T21:42:10.470331+0000","last_became_peered":"2023-07-06T21:42:10.470331+0000","last_unstale":"2023-07-06T21:42:15.750157+0000","last_undegraded":"2023-07-06T21:42:15.750157+0000","last_fullsized":"2023-07-06T21:42:15.750157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:06.172940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302528+0000","last_change":"2023-07-06T21:42:14.905006+0000","last_active":"2023-07-06T21:42:15.302528+0000","last_peered":"2023-07-06T21:42:15.302528+0000","last_clean":"2023-07-06T21:42:15.302528+0000","last_became_active":"2023-07-06T21:42:14.904580+0000","last_became_peered":"2023-07-06T21:42:14.904580+0000","last_unstale":"2023-07-06T21:42:15.302528+0000","last_undegraded":"2023-07-06T21:42:15.302528+0000","last_fullsized":"2023-07-06T21:42:15.302528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304381+0000","last_change":"2023-07-06T21:42:10.472955+0000","last_active":"2023-07-06T21:42:15.304381+0000","last_peered":"2023-07-06T21:42:15.304381+0000","last_clean":"2023-07-06T21:42:15.304381+0000","last_became_active":"2023-07-06T21:42:10.472650+0000","last_became_peered":"2023-07-06T21:42:10.472650+0000","last_unstale":"2023-07-06T21:42:15.304381+0000","last_undegraded":"2023-07-06T21:42:15.304381+0000","last_fullsized":"2023-07-06T21:42:15.304381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:00.320476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559636+0000","last_change":"2023-07-06T21:42:10.895148+0000","last_active":"2023-07-06T21:42:15.559636+0000","last_peered":"2023-07-06T21:42:15.559636+0000","last_clean":"2023-07-06T21:42:15.559636+0000","last_became_active":"2023-07-06T21:42:10.893279+0000","last_became_peered":"2023-07-06T21:42:10.893279+0000","last_unstale":"2023-07-06T21:42:15.559636+0000","last_undegraded":"2023-07-06T21:42:15.559636+0000","last_fullsized":"2023-07-06T21:42:15.559636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:17.881222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814136+0000","last_change":"2023-07-06T21:42:14.923933+0000","last_active":"2023-07-06T21:42:15.814136+0000","last_peered":"2023-07-06T21:42:15.814136+0000","last_clean":"2023-07-06T21:42:15.814136+0000","last_became_active":"2023-07-06T21:42:14.923462+0000","last_became_peered":"2023-07-06T21:42:14.923462+0000","last_unstale":"2023-07-06T21:42:15.814136+0000","last_undegraded":"2023-07-06T21:42:15.814136+0000","last_fullsized":"2023-07-06T21:42:15.814136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:17.532639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:26.997905+0000","last_change":"2023-07-06T21:42:10.477982+0000","last_active":"2023-07-06T21:42:26.997905+0000","last_peered":"2023-07-06T21:42:26.997905+0000","last_clean":"2023-07-06T21:42:26.997905+0000","last_became_active":"2023-07-06T21:42:10.477682+0000","last_became_peered":"2023-07-06T21:42:10.477682+0000","last_unstale":"2023-07-06T21:42:26.997905+0000","last_undegraded":"2023-07-06T21:42:26.997905+0000","last_fullsized":"2023-07-06T21:42:26.997905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:36:40.587024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303762+0000","last_change":"2023-07-06T21:42:10.889884+0000","last_active":"2023-07-06T21:42:15.303762+0000","last_peered":"2023-07-06T21:42:15.303762+0000","last_clean":"2023-07-06T21:42:15.303762+0000","last_became_active":"2023-07-06T21:42:10.889573+0000","last_became_peered":"2023-07-06T21:42:10.889573+0000","last_unstale":"2023-07-06T21:42:15.303762+0000","last_undegraded":"2023-07-06T21:42:15.303762+0000","last_fullsized":"2023-07-06T21:42:15.303762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:19:13.251122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559445+0000","last_change":"2023-07-06T21:42:14.923296+0000","last_active":"2023-07-06T21:42:15.559445+0000","last_peered":"2023-07-06T21:42:15.559445+0000","last_clean":"2023-07-06T21:42:15.559445+0000","last_became_active":"2023-07-06T21:42:14.922887+0000","last_became_peered":"2023-07-06T21:42:14.922887+0000","last_unstale":"2023-07-06T21:42:15.559445+0000","last_undegraded":"2023-07-06T21:42:15.559445+0000","last_fullsized":"2023-07-06T21:42:15.559445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:04:10.970825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302823+0000","last_change":"2023-07-06T21:42:10.885592+0000","last_active":"2023-07-06T21:42:15.302823+0000","last_peered":"2023-07-06T21:42:15.302823+0000","last_clean":"2023-07-06T21:42:15.302823+0000","last_became_active":"2023-07-06T21:42:10.885320+0000","last_became_peered":"2023-07-06T21:42:10.885320+0000","last_unstale":"2023-07-06T21:42:15.302823+0000","last_undegraded":"2023-07-06T21:42:15.302823+0000","last_fullsized":"2023-07-06T21:42:15.302823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:37:33.460049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816166+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:42:15.816166+0000","last_peered":"2023-07-06T21:42:15.816166+0000","last_clean":"2023-07-06T21:42:15.816166+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:42:15.816166+0000","last_undegraded":"2023-07-06T21:42:15.816166+0000","last_fullsized":"2023-07-06T21:42:15.816166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:13:17.470539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555317+0000","last_change":"2023-07-06T21:42:10.483753+0000","last_active":"2023-07-06T21:42:15.555317+0000","last_peered":"2023-07-06T21:42:15.555317+0000","last_clean":"2023-07-06T21:42:15.555317+0000","last_became_active":"2023-07-06T21:42:10.483357+0000","last_became_peered":"2023-07-06T21:42:10.483357+0000","last_unstale":"2023-07-06T21:42:15.555317+0000","last_undegraded":"2023-07-06T21:42:15.555317+0000","last_fullsized":"2023-07-06T21:42:15.555317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:13.091304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813831+0000","last_change":"2023-07-06T21:42:14.904514+0000","last_active":"2023-07-06T21:42:15.813831+0000","last_peered":"2023-07-06T21:42:15.813831+0000","last_clean":"2023-07-06T21:42:15.813831+0000","last_became_active":"2023-07-06T21:42:14.904110+0000","last_became_peered":"2023-07-06T21:42:14.904110+0000","last_unstale":"2023-07-06T21:42:15.813831+0000","last_undegraded":"2023-07-06T21:42:15.813831+0000","last_fullsized":"2023-07-06T21:42:15.813831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813926+0000","last_change":"2023-07-06T21:42:10.886690+0000","last_active":"2023-07-06T21:42:15.813926+0000","last_peered":"2023-07-06T21:42:15.813926+0000","last_clean":"2023-07-06T21:42:15.813926+0000","last_became_active":"2023-07-06T21:42:10.886408+0000","last_became_peered":"2023-07-06T21:42:10.886408+0000","last_unstale":"2023-07-06T21:42:15.813926+0000","last_undegraded":"2023-07-06T21:42:15.813926+0000","last_fullsized":"2023-07-06T21:42:15.813926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:21.307899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560489+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:42:15.560489+0000","last_peered":"2023-07-06T21:42:15.560489+0000","last_clean":"2023-07-06T21:42:15.560489+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:42:15.560489+0000","last_undegraded":"2023-07-06T21:42:15.560489+0000","last_fullsized":"2023-07-06T21:42:15.560489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:32.217200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814738+0000","last_change":"2023-07-06T21:42:10.477099+0000","last_active":"2023-07-06T21:42:15.814738+0000","last_peered":"2023-07-06T21:42:15.814738+0000","last_clean":"2023-07-06T21:42:15.814738+0000","last_became_active":"2023-07-06T21:42:10.470849+0000","last_became_peered":"2023-07-06T21:42:10.470849+0000","last_unstale":"2023-07-06T21:42:15.814738+0000","last_undegraded":"2023-07-06T21:42:15.814738+0000","last_fullsized":"2023-07-06T21:42:15.814738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:01:27.903386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302507+0000","last_change":"2023-07-06T21:42:14.912597+0000","last_active":"2023-07-06T21:42:15.302507+0000","last_peered":"2023-07-06T21:42:15.302507+0000","last_clean":"2023-07-06T21:42:15.302507+0000","last_became_active":"2023-07-06T21:42:14.912117+0000","last_became_peered":"2023-07-06T21:42:14.912117+0000","last_unstale":"2023-07-06T21:42:15.302507+0000","last_undegraded":"2023-07-06T21:42:15.302507+0000","last_fullsized":"2023-07-06T21:42:15.302507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:04:25.768388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554791+0000","last_change":"2023-07-06T21:42:10.887381+0000","last_active":"2023-07-06T21:42:15.554791+0000","last_peered":"2023-07-06T21:42:15.554791+0000","last_clean":"2023-07-06T21:42:15.554791+0000","last_became_active":"2023-07-06T21:42:10.887098+0000","last_became_peered":"2023-07-06T21:42:10.887098+0000","last_unstale":"2023-07-06T21:42:15.554791+0000","last_undegraded":"2023-07-06T21:42:15.554791+0000","last_fullsized":"2023-07-06T21:42:15.554791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:22:58.629015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304566+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:42:15.304566+0000","last_peered":"2023-07-06T21:42:15.304566+0000","last_clean":"2023-07-06T21:42:15.304566+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:42:15.304566+0000","last_undegraded":"2023-07-06T21:42:15.304566+0000","last_fullsized":"2023-07-06T21:42:15.304566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:18:08.789205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560028+0000","last_change":"2023-07-06T21:42:10.470119+0000","last_active":"2023-07-06T21:42:15.560028+0000","last_peered":"2023-07-06T21:42:15.560028+0000","last_clean":"2023-07-06T21:42:15.560028+0000","last_became_active":"2023-07-06T21:42:10.469842+0000","last_became_peered":"2023-07-06T21:42:10.469842+0000","last_unstale":"2023-07-06T21:42:15.560028+0000","last_undegraded":"2023-07-06T21:42:15.560028+0000","last_fullsized":"2023-07-06T21:42:15.560028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:22:57.618655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815713+0000","last_change":"2023-07-06T21:42:14.922150+0000","last_active":"2023-07-06T21:42:15.815713+0000","last_peered":"2023-07-06T21:42:15.815713+0000","last_clean":"2023-07-06T21:42:15.815713+0000","last_became_active":"2023-07-06T21:42:14.921680+0000","last_became_peered":"2023-07-06T21:42:14.921680+0000","last_unstale":"2023-07-06T21:42:15.815713+0000","last_undegraded":"2023-07-06T21:42:15.815713+0000","last_fullsized":"2023-07-06T21:42:15.815713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:25:46.342686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559647+0000","last_change":"2023-07-06T21:42:10.895224+0000","last_active":"2023-07-06T21:42:15.559647+0000","last_peered":"2023-07-06T21:42:15.559647+0000","last_clean":"2023-07-06T21:42:15.559647+0000","last_became_active":"2023-07-06T21:42:10.893294+0000","last_became_peered":"2023-07-06T21:42:10.893294+0000","last_unstale":"2023-07-06T21:42:15.559647+0000","last_undegraded":"2023-07-06T21:42:15.559647+0000","last_fullsized":"2023-07-06T21:42:15.559647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:06:12.963913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560146+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:42:15.560146+0000","last_peered":"2023-07-06T21:42:15.560146+0000","last_clean":"2023-07-06T21:42:15.560146+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:42:15.560146+0000","last_undegraded":"2023-07-06T21:42:15.560146+0000","last_fullsized":"2023-07-06T21:42:15.560146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:26:57.147498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750089+0000","last_change":"2023-07-06T21:42:10.479311+0000","last_active":"2023-07-06T21:42:15.750089+0000","last_peered":"2023-07-06T21:42:15.750089+0000","last_clean":"2023-07-06T21:42:15.750089+0000","last_became_active":"2023-07-06T21:42:10.478999+0000","last_became_peered":"2023-07-06T21:42:10.478999+0000","last_unstale":"2023-07-06T21:42:15.750089+0000","last_undegraded":"2023-07-06T21:42:15.750089+0000","last_fullsized":"2023-07-06T21:42:15.750089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:15:16.029351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554783+0000","last_change":"2023-07-06T21:42:14.924362+0000","last_active":"2023-07-06T21:42:15.554783+0000","last_peered":"2023-07-06T21:42:15.554783+0000","last_clean":"2023-07-06T21:42:15.554783+0000","last_became_active":"2023-07-06T21:42:14.924003+0000","last_became_peered":"2023-07-06T21:42:14.924003+0000","last_unstale":"2023-07-06T21:42:15.554783+0000","last_undegraded":"2023-07-06T21:42:15.554783+0000","last_fullsized":"2023-07-06T21:42:15.554783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:30:36.626428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559964+0000","last_change":"2023-07-06T21:42:10.901083+0000","last_active":"2023-07-06T21:42:15.559964+0000","last_peered":"2023-07-06T21:42:15.559964+0000","last_clean":"2023-07-06T21:42:15.559964+0000","last_became_active":"2023-07-06T21:42:10.900454+0000","last_became_peered":"2023-07-06T21:42:10.900454+0000","last_unstale":"2023-07-06T21:42:15.559964+0000","last_undegraded":"2023-07-06T21:42:15.559964+0000","last_fullsized":"2023-07-06T21:42:15.559964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:30:33.195452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303877+0000","last_change":"2023-07-06T21:42:10.487423+0000","last_active":"2023-07-06T21:42:15.303877+0000","last_peered":"2023-07-06T21:42:15.303877+0000","last_clean":"2023-07-06T21:42:15.303877+0000","last_became_active":"2023-07-06T21:42:10.487178+0000","last_became_peered":"2023-07-06T21:42:10.487178+0000","last_unstale":"2023-07-06T21:42:15.303877+0000","last_undegraded":"2023-07-06T21:42:15.303877+0000","last_fullsized":"2023-07-06T21:42:15.303877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:27:27.820824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749519+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:42:15.749519+0000","last_peered":"2023-07-06T21:42:15.749519+0000","last_clean":"2023-07-06T21:42:15.749519+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:42:15.749519+0000","last_undegraded":"2023-07-06T21:42:15.749519+0000","last_fullsized":"2023-07-06T21:42:15.749519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:32.217200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555060+0000","last_change":"2023-07-06T21:42:14.916163+0000","last_active":"2023-07-06T21:42:15.555060+0000","last_peered":"2023-07-06T21:42:15.555060+0000","last_clean":"2023-07-06T21:42:15.555060+0000","last_became_active":"2023-07-06T21:42:14.915664+0000","last_became_peered":"2023-07-06T21:42:14.915664+0000","last_unstale":"2023-07-06T21:42:15.555060+0000","last_undegraded":"2023-07-06T21:42:15.555060+0000","last_fullsized":"2023-07-06T21:42:15.555060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:53.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.561394+0000","last_change":"2023-07-06T21:42:10.892520+0000","last_active":"2023-07-06T21:42:15.561394+0000","last_peered":"2023-07-06T21:42:15.561394+0000","last_clean":"2023-07-06T21:42:15.561394+0000","last_became_active":"2023-07-06T21:42:10.892199+0000","last_became_peered":"2023-07-06T21:42:10.892199+0000","last_unstale":"2023-07-06T21:42:15.561394+0000","last_undegraded":"2023-07-06T21:42:15.561394+0000","last_fullsized":"2023-07-06T21:42:15.561394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:03.040492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559437+0000","last_change":"2023-07-06T21:42:10.469013+0000","last_active":"2023-07-06T21:42:15.559437+0000","last_peered":"2023-07-06T21:42:15.559437+0000","last_clean":"2023-07-06T21:42:15.559437+0000","last_became_active":"2023-07-06T21:42:10.468725+0000","last_became_peered":"2023-07-06T21:42:10.468725+0000","last_unstale":"2023-07-06T21:42:15.559437+0000","last_undegraded":"2023-07-06T21:42:15.559437+0000","last_fullsized":"2023-07-06T21:42:15.559437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:20:16.016382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300174+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:42:15.300174+0000","last_peered":"2023-07-06T21:42:15.300174+0000","last_clean":"2023-07-06T21:42:15.300174+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:42:15.300174+0000","last_undegraded":"2023-07-06T21:42:15.300174+0000","last_fullsized":"2023-07-06T21:42:15.300174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:47:26.819677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300599+0000","last_change":"2023-07-06T21:42:14.924328+0000","last_active":"2023-07-06T21:42:15.300599+0000","last_peered":"2023-07-06T21:42:15.300599+0000","last_clean":"2023-07-06T21:42:15.300599+0000","last_became_active":"2023-07-06T21:42:14.923899+0000","last_became_peered":"2023-07-06T21:42:14.923899+0000","last_unstale":"2023-07-06T21:42:15.300599+0000","last_undegraded":"2023-07-06T21:42:15.300599+0000","last_fullsized":"2023-07-06T21:42:15.300599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:54:26.653941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555110+0000","last_change":"2023-07-06T21:42:10.903093+0000","last_active":"2023-07-06T21:42:15.555110+0000","last_peered":"2023-07-06T21:42:15.555110+0000","last_clean":"2023-07-06T21:42:15.555110+0000","last_became_active":"2023-07-06T21:42:10.902859+0000","last_became_peered":"2023-07-06T21:42:10.902859+0000","last_unstale":"2023-07-06T21:42:15.555110+0000","last_undegraded":"2023-07-06T21:42:15.555110+0000","last_fullsized":"2023-07-06T21:42:15.555110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:21.307899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554542+0000","last_change":"2023-07-06T21:42:10.483697+0000","last_active":"2023-07-06T21:42:15.554542+0000","last_peered":"2023-07-06T21:42:15.554542+0000","last_clean":"2023-07-06T21:42:15.554542+0000","last_became_active":"2023-07-06T21:42:10.483326+0000","last_became_peered":"2023-07-06T21:42:10.483326+0000","last_unstale":"2023-07-06T21:42:15.554542+0000","last_undegraded":"2023-07-06T21:42:15.554542+0000","last_fullsized":"2023-07-06T21:42:15.554542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:06:11.953553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302786+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:42:15.302786+0000","last_peered":"2023-07-06T21:42:15.302786+0000","last_clean":"2023-07-06T21:42:15.302786+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:42:15.302786+0000","last_undegraded":"2023-07-06T21:42:15.302786+0000","last_fullsized":"2023-07-06T21:42:15.302786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:43.907805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749963+0000","last_change":"2023-07-06T21:42:14.922451+0000","last_active":"2023-07-06T21:42:15.749963+0000","last_peered":"2023-07-06T21:42:15.749963+0000","last_clean":"2023-07-06T21:42:15.749963+0000","last_became_active":"2023-07-06T21:42:14.922047+0000","last_became_peered":"2023-07-06T21:42:14.922047+0000","last_unstale":"2023-07-06T21:42:15.749963+0000","last_undegraded":"2023-07-06T21:42:15.749963+0000","last_fullsized":"2023-07-06T21:42:15.749963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:04.761811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816094+0000","last_change":"2023-07-06T21:42:10.892446+0000","last_active":"2023-07-06T21:42:15.816094+0000","last_peered":"2023-07-06T21:42:15.816094+0000","last_clean":"2023-07-06T21:42:15.816094+0000","last_became_active":"2023-07-06T21:42:10.892161+0000","last_became_peered":"2023-07-06T21:42:10.892161+0000","last_unstale":"2023-07-06T21:42:15.816094+0000","last_undegraded":"2023-07-06T21:42:15.816094+0000","last_fullsized":"2023-07-06T21:42:15.816094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:16:28.548015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814063+0000","last_change":"2023-07-06T21:42:10.477978+0000","last_active":"2023-07-06T21:42:15.814063+0000","last_peered":"2023-07-06T21:42:15.814063+0000","last_clean":"2023-07-06T21:42:15.814063+0000","last_became_active":"2023-07-06T21:42:10.477741+0000","last_became_peered":"2023-07-06T21:42:10.477741+0000","last_unstale":"2023-07-06T21:42:15.814063+0000","last_undegraded":"2023-07-06T21:42:15.814063+0000","last_fullsized":"2023-07-06T21:42:15.814063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:53.942428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749582+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:42:15.749582+0000","last_peered":"2023-07-06T21:42:15.749582+0000","last_clean":"2023-07-06T21:42:15.749582+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:42:15.749582+0000","last_undegraded":"2023-07-06T21:42:15.749582+0000","last_fullsized":"2023-07-06T21:42:15.749582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:15.258138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302930+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:42:15.302930+0000","last_peered":"2023-07-06T21:42:15.302930+0000","last_clean":"2023-07-06T21:42:15.302930+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:42:15.302930+0000","last_undegraded":"2023-07-06T21:42:15.302930+0000","last_fullsized":"2023-07-06T21:42:15.302930+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:25.978867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304188+0000","last_change":"2023-07-06T21:42:14.922337+0000","last_active":"2023-07-06T21:42:15.304188+0000","last_peered":"2023-07-06T21:42:15.304188+0000","last_clean":"2023-07-06T21:42:15.304188+0000","last_became_active":"2023-07-06T21:42:14.921707+0000","last_became_peered":"2023-07-06T21:42:14.921707+0000","last_unstale":"2023-07-06T21:42:15.304188+0000","last_undegraded":"2023-07-06T21:42:15.304188+0000","last_fullsized":"2023-07-06T21:42:15.304188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:10.982651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.561390+0000","last_change":"2023-07-06T21:42:10.895068+0000","last_active":"2023-07-06T21:42:15.561390+0000","last_peered":"2023-07-06T21:42:15.561390+0000","last_clean":"2023-07-06T21:42:15.561390+0000","last_became_active":"2023-07-06T21:42:10.893118+0000","last_became_peered":"2023-07-06T21:42:10.893118+0000","last_unstale":"2023-07-06T21:42:15.561390+0000","last_undegraded":"2023-07-06T21:42:15.561390+0000","last_fullsized":"2023-07-06T21:42:15.561390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:49.304577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814064+0000","last_change":"2023-07-06T21:42:10.477723+0000","last_active":"2023-07-06T21:42:15.814064+0000","last_peered":"2023-07-06T21:42:15.814064+0000","last_clean":"2023-07-06T21:42:15.814064+0000","last_became_active":"2023-07-06T21:42:10.477458+0000","last_became_peered":"2023-07-06T21:42:10.477458+0000","last_unstale":"2023-07-06T21:42:15.814064+0000","last_undegraded":"2023-07-06T21:42:15.814064+0000","last_fullsized":"2023-07-06T21:42:15.814064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:37.773277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304476+0000","last_change":"2023-07-06T21:42:14.916934+0000","last_active":"2023-07-06T21:42:15.304476+0000","last_peered":"2023-07-06T21:42:15.304476+0000","last_clean":"2023-07-06T21:42:15.304476+0000","last_became_active":"2023-07-06T21:42:14.916426+0000","last_became_peered":"2023-07-06T21:42:14.916426+0000","last_unstale":"2023-07-06T21:42:15.304476+0000","last_undegraded":"2023-07-06T21:42:15.304476+0000","last_fullsized":"2023-07-06T21:42:15.304476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:59:26.819910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304570+0000","last_change":"2023-07-06T21:42:10.883910+0000","last_active":"2023-07-06T21:42:15.304570+0000","last_peered":"2023-07-06T21:42:15.304570+0000","last_clean":"2023-07-06T21:42:15.304570+0000","last_became_active":"2023-07-06T21:42:10.881813+0000","last_became_peered":"2023-07-06T21:42:10.881813+0000","last_unstale":"2023-07-06T21:42:15.304570+0000","last_undegraded":"2023-07-06T21:42:15.304570+0000","last_fullsized":"2023-07-06T21:42:15.304570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:35:26.163278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302957+0000","last_change":"2023-07-06T21:42:10.476748+0000","last_active":"2023-07-06T21:42:15.302957+0000","last_peered":"2023-07-06T21:42:15.302957+0000","last_clean":"2023-07-06T21:42:15.302957+0000","last_became_active":"2023-07-06T21:42:10.476481+0000","last_became_peered":"2023-07-06T21:42:10.476481+0000","last_unstale":"2023-07-06T21:42:15.302957+0000","last_undegraded":"2023-07-06T21:42:15.302957+0000","last_fullsized":"2023-07-06T21:42:15.302957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:44:25.975479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749892+0000","last_change":"2023-07-06T21:42:14.921688+0000","last_active":"2023-07-06T21:42:15.749892+0000","last_peered":"2023-07-06T21:42:15.749892+0000","last_clean":"2023-07-06T21:42:15.749892+0000","last_became_active":"2023-07-06T21:42:14.921265+0000","last_became_peered":"2023-07-06T21:42:14.921265+0000","last_unstale":"2023-07-06T21:42:15.749892+0000","last_undegraded":"2023-07-06T21:42:15.749892+0000","last_fullsized":"2023-07-06T21:42:15.749892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:39.042261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304373+0000","last_change":"2023-07-06T21:42:10.878847+0000","last_active":"2023-07-06T21:42:15.304373+0000","last_peered":"2023-07-06T21:42:15.304373+0000","last_clean":"2023-07-06T21:42:15.304373+0000","last_became_active":"2023-07-06T21:42:10.878527+0000","last_became_peered":"2023-07-06T21:42:10.878527+0000","last_unstale":"2023-07-06T21:42:15.304373+0000","last_undegraded":"2023-07-06T21:42:15.304373+0000","last_fullsized":"2023-07-06T21:42:15.304373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:16:10.597271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815959+0000","last_change":"2023-07-06T21:42:10.477879+0000","last_active":"2023-07-06T21:42:15.815959+0000","last_peered":"2023-07-06T21:42:15.815959+0000","last_clean":"2023-07-06T21:42:15.815959+0000","last_became_active":"2023-07-06T21:42:10.477581+0000","last_became_peered":"2023-07-06T21:42:10.477581+0000","last_unstale":"2023-07-06T21:42:15.815959+0000","last_undegraded":"2023-07-06T21:42:15.815959+0000","last_fullsized":"2023-07-06T21:42:15.815959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:44:19.088837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559764+0000","last_change":"2023-07-06T21:42:14.911992+0000","last_active":"2023-07-06T21:42:15.559764+0000","last_peered":"2023-07-06T21:42:15.559764+0000","last_clean":"2023-07-06T21:42:15.559764+0000","last_became_active":"2023-07-06T21:42:14.911568+0000","last_became_peered":"2023-07-06T21:42:14.911568+0000","last_unstale":"2023-07-06T21:42:15.559764+0000","last_undegraded":"2023-07-06T21:42:15.559764+0000","last_fullsized":"2023-07-06T21:42:15.559764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:20:11.252422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303859+0000","last_change":"2023-07-06T21:42:10.883052+0000","last_active":"2023-07-06T21:42:15.303859+0000","last_peered":"2023-07-06T21:42:15.303859+0000","last_clean":"2023-07-06T21:42:15.303859+0000","last_became_active":"2023-07-06T21:42:10.882252+0000","last_became_peered":"2023-07-06T21:42:10.882252+0000","last_unstale":"2023-07-06T21:42:15.303859+0000","last_undegraded":"2023-07-06T21:42:15.303859+0000","last_fullsized":"2023-07-06T21:42:15.303859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:24:28.967556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814372+0000","last_change":"2023-07-06T21:42:10.483767+0000","last_active":"2023-07-06T21:42:15.814372+0000","last_peered":"2023-07-06T21:42:15.814372+0000","last_clean":"2023-07-06T21:42:15.814372+0000","last_became_active":"2023-07-06T21:42:10.483507+0000","last_became_peered":"2023-07-06T21:42:10.483507+0000","last_unstale":"2023-07-06T21:42:15.814372+0000","last_undegraded":"2023-07-06T21:42:15.814372+0000","last_fullsized":"2023-07-06T21:42:15.814372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:18:13.828606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300565+0000","last_change":"2023-07-06T21:42:14.923194+0000","last_active":"2023-07-06T21:42:15.300565+0000","last_peered":"2023-07-06T21:42:15.300565+0000","last_clean":"2023-07-06T21:42:15.300565+0000","last_became_active":"2023-07-06T21:42:14.922520+0000","last_became_peered":"2023-07-06T21:42:14.922520+0000","last_unstale":"2023-07-06T21:42:15.300565+0000","last_undegraded":"2023-07-06T21:42:15.300565+0000","last_fullsized":"2023-07-06T21:42:15.300565+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:03:38.532050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554692+0000","last_change":"2023-07-06T21:42:10.896528+0000","last_active":"2023-07-06T21:42:15.554692+0000","last_peered":"2023-07-06T21:42:15.554692+0000","last_clean":"2023-07-06T21:42:15.554692+0000","last_became_active":"2023-07-06T21:42:10.896260+0000","last_became_peered":"2023-07-06T21:42:10.896260+0000","last_unstale":"2023-07-06T21:42:15.554692+0000","last_undegraded":"2023-07-06T21:42:15.554692+0000","last_fullsized":"2023-07-06T21:42:15.554692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:20:07.821447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749689+0000","last_change":"2023-07-06T21:42:10.467430+0000","last_active":"2023-07-06T21:42:15.749689+0000","last_peered":"2023-07-06T21:42:15.749689+0000","last_clean":"2023-07-06T21:42:15.749689+0000","last_became_active":"2023-07-06T21:42:10.467147+0000","last_became_peered":"2023-07-06T21:42:10.467147+0000","last_unstale":"2023-07-06T21:42:15.749689+0000","last_undegraded":"2023-07-06T21:42:15.749689+0000","last_fullsized":"2023-07-06T21:42:15.749689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:48.294217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300352+0000","last_change":"2023-07-06T21:42:14.911007+0000","last_active":"2023-07-06T21:42:15.300352+0000","last_peered":"2023-07-06T21:42:15.300352+0000","last_clean":"2023-07-06T21:42:15.300352+0000","last_became_active":"2023-07-06T21:42:14.910352+0000","last_became_peered":"2023-07-06T21:42:14.910352+0000","last_unstale":"2023-07-06T21:42:15.300352+0000","last_undegraded":"2023-07-06T21:42:15.300352+0000","last_fullsized":"2023-07-06T21:42:15.300352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:32:51.766704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815617+0000","last_change":"2023-07-06T21:42:10.903614+0000","last_active":"2023-07-06T21:42:15.815617+0000","last_peered":"2023-07-06T21:42:15.815617+0000","last_clean":"2023-07-06T21:42:15.815617+0000","last_became_active":"2023-07-06T21:42:10.903258+0000","last_became_peered":"2023-07-06T21:42:10.903258+0000","last_unstale":"2023-07-06T21:42:15.815617+0000","last_undegraded":"2023-07-06T21:42:15.815617+0000","last_fullsized":"2023-07-06T21:42:15.815617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:58:56.102496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304481+0000","last_change":"2023-07-06T21:42:10.472497+0000","last_active":"2023-07-06T21:42:15.304481+0000","last_peered":"2023-07-06T21:42:15.304481+0000","last_clean":"2023-07-06T21:42:15.304481+0000","last_became_active":"2023-07-06T21:42:10.470849+0000","last_became_peered":"2023-07-06T21:42:10.470849+0000","last_unstale":"2023-07-06T21:42:15.304481+0000","last_undegraded":"2023-07-06T21:42:15.304481+0000","last_fullsized":"2023-07-06T21:42:15.304481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:28.818997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300483+0000","last_change":"2023-07-06T21:42:14.927494+0000","last_active":"2023-07-06T21:42:15.300483+0000","last_peered":"2023-07-06T21:42:15.300483+0000","last_clean":"2023-07-06T21:42:15.300483+0000","last_became_active":"2023-07-06T21:42:14.927091+0000","last_became_peered":"2023-07-06T21:42:14.927091+0000","last_unstale":"2023-07-06T21:42:15.300483+0000","last_undegraded":"2023-07-06T21:42:15.300483+0000","last_fullsized":"2023-07-06T21:42:15.300483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:28:09.964167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302682+0000","last_change":"2023-07-06T21:42:10.900898+0000","last_active":"2023-07-06T21:42:15.302682+0000","last_peered":"2023-07-06T21:42:15.302682+0000","last_clean":"2023-07-06T21:42:15.302682+0000","last_became_active":"2023-07-06T21:42:10.900581+0000","last_became_peered":"2023-07-06T21:42:10.900581+0000","last_unstale":"2023-07-06T21:42:15.302682+0000","last_undegraded":"2023-07-06T21:42:15.302682+0000","last_fullsized":"2023-07-06T21:42:15.302682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:06:29.601787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304774+0000","last_change":"2023-07-06T21:42:10.481348+0000","last_active":"2023-07-06T21:42:15.304774+0000","last_peered":"2023-07-06T21:42:15.304774+0000","last_clean":"2023-07-06T21:42:15.304774+0000","last_became_active":"2023-07-06T21:42:10.480900+0000","last_became_peered":"2023-07-06T21:42:10.480900+0000","last_unstale":"2023-07-06T21:42:15.304774+0000","last_undegraded":"2023-07-06T21:42:15.304774+0000","last_fullsized":"2023-07-06T21:42:15.304774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:25.448002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300082+0000","last_change":"2023-07-06T21:42:14.910719+0000","last_active":"2023-07-06T21:42:15.300082+0000","last_peered":"2023-07-06T21:42:15.300082+0000","last_clean":"2023-07-06T21:42:15.300082+0000","last_became_active":"2023-07-06T21:42:14.910213+0000","last_became_peered":"2023-07-06T21:42:14.910213+0000","last_unstale":"2023-07-06T21:42:15.300082+0000","last_undegraded":"2023-07-06T21:42:15.300082+0000","last_fullsized":"2023-07-06T21:42:15.300082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:11:34.554961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749271+0000","last_change":"2023-07-06T21:42:10.899721+0000","last_active":"2023-07-06T21:42:15.749271+0000","last_peered":"2023-07-06T21:42:15.749271+0000","last_clean":"2023-07-06T21:42:15.749271+0000","last_became_active":"2023-07-06T21:42:10.896792+0000","last_became_peered":"2023-07-06T21:42:10.896792+0000","last_unstale":"2023-07-06T21:42:15.749271+0000","last_undegraded":"2023-07-06T21:42:15.749271+0000","last_fullsized":"2023-07-06T21:42:15.749271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:36.353661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304883+0000","last_change":"2023-07-06T21:42:10.479043+0000","last_active":"2023-07-06T21:42:15.304883+0000","last_peered":"2023-07-06T21:42:15.304883+0000","last_clean":"2023-07-06T21:42:15.304883+0000","last_became_active":"2023-07-06T21:42:10.478756+0000","last_became_peered":"2023-07-06T21:42:10.478756+0000","last_unstale":"2023-07-06T21:42:15.304883+0000","last_undegraded":"2023-07-06T21:42:15.304883+0000","last_fullsized":"2023-07-06T21:42:15.304883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:15:16.029351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303391+0000","last_change":"2023-07-06T21:42:14.903165+0000","last_active":"2023-07-06T21:42:15.303391+0000","last_peered":"2023-07-06T21:42:15.303391+0000","last_clean":"2023-07-06T21:42:15.303391+0000","last_became_active":"2023-07-06T21:42:14.902418+0000","last_became_peered":"2023-07-06T21:42:14.902418+0000","last_unstale":"2023-07-06T21:42:15.303391+0000","last_undegraded":"2023-07-06T21:42:15.303391+0000","last_fullsized":"2023-07-06T21:42:15.303391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:06.471467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749820+0000","last_change":"2023-07-06T21:42:14.923545+0000","last_active":"2023-07-06T21:42:15.749820+0000","last_peered":"2023-07-06T21:42:15.749820+0000","last_clean":"2023-07-06T21:42:15.749820+0000","last_became_active":"2023-07-06T21:42:14.922278+0000","last_became_peered":"2023-07-06T21:42:14.922278+0000","last_unstale":"2023-07-06T21:42:15.749820+0000","last_undegraded":"2023-07-06T21:42:15.749820+0000","last_fullsized":"2023-07-06T21:42:15.749820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:58.383763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815663+0000","last_change":"2023-07-06T21:42:10.477503+0000","last_active":"2023-07-06T21:42:15.815663+0000","last_peered":"2023-07-06T21:42:15.815663+0000","last_clean":"2023-07-06T21:42:15.815663+0000","last_became_active":"2023-07-06T21:42:10.477166+0000","last_became_peered":"2023-07-06T21:42:10.477166+0000","last_unstale":"2023-07-06T21:42:15.815663+0000","last_undegraded":"2023-07-06T21:42:15.815663+0000","last_fullsized":"2023-07-06T21:42:15.815663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:25:12.585223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814704+0000","last_change":"2023-07-06T21:42:10.897513+0000","last_active":"2023-07-06T21:42:15.814704+0000","last_peered":"2023-07-06T21:42:15.814704+0000","last_clean":"2023-07-06T21:42:15.814704+0000","last_became_active":"2023-07-06T21:42:10.897114+0000","last_became_peered":"2023-07-06T21:42:10.897114+0000","last_unstale":"2023-07-06T21:42:15.814704+0000","last_undegraded":"2023-07-06T21:42:15.814704+0000","last_fullsized":"2023-07-06T21:42:15.814704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:39:47.681666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814620+0000","last_change":"2023-07-06T21:42:14.904372+0000","last_active":"2023-07-06T21:42:15.814620+0000","last_peered":"2023-07-06T21:42:15.814620+0000","last_clean":"2023-07-06T21:42:15.814620+0000","last_became_active":"2023-07-06T21:42:14.904023+0000","last_became_peered":"2023-07-06T21:42:14.904023+0000","last_unstale":"2023-07-06T21:42:15.814620+0000","last_undegraded":"2023-07-06T21:42:15.814620+0000","last_fullsized":"2023-07-06T21:42:15.814620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:10.614275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303576+0000","last_change":"2023-07-06T21:42:10.478297+0000","last_active":"2023-07-06T21:42:15.303576+0000","last_peered":"2023-07-06T21:42:15.303576+0000","last_clean":"2023-07-06T21:42:15.303576+0000","last_became_active":"2023-07-06T21:42:10.478050+0000","last_became_peered":"2023-07-06T21:42:10.478050+0000","last_unstale":"2023-07-06T21:42:15.303576+0000","last_undegraded":"2023-07-06T21:42:15.303576+0000","last_fullsized":"2023-07-06T21:42:15.303576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:53.942428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555359+0000","last_change":"2023-07-06T21:42:10.883887+0000","last_active":"2023-07-06T21:42:15.555359+0000","last_peered":"2023-07-06T21:42:15.555359+0000","last_clean":"2023-07-06T21:42:15.555359+0000","last_became_active":"2023-07-06T21:42:10.883644+0000","last_became_peered":"2023-07-06T21:42:10.883644+0000","last_unstale":"2023-07-06T21:42:15.555359+0000","last_undegraded":"2023-07-06T21:42:15.555359+0000","last_fullsized":"2023-07-06T21:42:15.555359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:07.551676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554791+0000","last_change":"2023-07-06T21:42:10.476173+0000","last_active":"2023-07-06T21:42:15.554791+0000","last_peered":"2023-07-06T21:42:15.554791+0000","last_clean":"2023-07-06T21:42:15.554791+0000","last_became_active":"2023-07-06T21:42:10.475802+0000","last_became_peered":"2023-07-06T21:42:10.475802+0000","last_unstale":"2023-07-06T21:42:15.554791+0000","last_undegraded":"2023-07-06T21:42:15.554791+0000","last_fullsized":"2023-07-06T21:42:15.554791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:39.285403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749898+0000","last_change":"2023-07-06T21:42:10.905138+0000","last_active":"2023-07-06T21:42:15.749898+0000","last_peered":"2023-07-06T21:42:15.749898+0000","last_clean":"2023-07-06T21:42:15.749898+0000","last_became_active":"2023-07-06T21:42:10.904460+0000","last_became_peered":"2023-07-06T21:42:10.904460+0000","last_unstale":"2023-07-06T21:42:15.749898+0000","last_undegraded":"2023-07-06T21:42:15.749898+0000","last_fullsized":"2023-07-06T21:42:15.749898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:07.551676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814399+0000","last_change":"2023-07-06T21:42:14.906570+0000","last_active":"2023-07-06T21:42:15.814399+0000","last_peered":"2023-07-06T21:42:15.814399+0000","last_clean":"2023-07-06T21:42:15.814399+0000","last_became_active":"2023-07-06T21:42:14.906136+0000","last_became_peered":"2023-07-06T21:42:14.906136+0000","last_unstale":"2023-07-06T21:42:15.814399+0000","last_undegraded":"2023-07-06T21:42:15.814399+0000","last_fullsized":"2023-07-06T21:42:15.814399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:33.260332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304098+0000","last_change":"2023-07-06T21:42:10.478474+0000","last_active":"2023-07-06T21:42:15.304098+0000","last_peered":"2023-07-06T21:42:15.304098+0000","last_clean":"2023-07-06T21:42:15.304098+0000","last_became_active":"2023-07-06T21:42:10.478162+0000","last_became_peered":"2023-07-06T21:42:10.478162+0000","last_unstale":"2023-07-06T21:42:15.304098+0000","last_undegraded":"2023-07-06T21:42:15.304098+0000","last_fullsized":"2023-07-06T21:42:15.304098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:34.600926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814456+0000","last_change":"2023-07-06T21:42:10.903800+0000","last_active":"2023-07-06T21:42:15.814456+0000","last_peered":"2023-07-06T21:42:15.814456+0000","last_clean":"2023-07-06T21:42:15.814456+0000","last_became_active":"2023-07-06T21:42:10.903469+0000","last_became_peered":"2023-07-06T21:42:10.903469+0000","last_unstale":"2023-07-06T21:42:15.814456+0000","last_undegraded":"2023-07-06T21:42:15.814456+0000","last_fullsized":"2023-07-06T21:42:15.814456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:26.458362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749752+0000","last_change":"2023-07-06T21:42:14.916210+0000","last_active":"2023-07-06T21:42:15.749752+0000","last_peered":"2023-07-06T21:42:15.749752+0000","last_clean":"2023-07-06T21:42:15.749752+0000","last_became_active":"2023-07-06T21:42:14.915845+0000","last_became_peered":"2023-07-06T21:42:14.915845+0000","last_unstale":"2023-07-06T21:42:15.749752+0000","last_undegraded":"2023-07-06T21:42:15.749752+0000","last_fullsized":"2023-07-06T21:42:15.749752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:42.214612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815466+0000","last_change":"2023-07-06T21:42:10.887152+0000","last_active":"2023-07-06T21:42:15.815466+0000","last_peered":"2023-07-06T21:42:15.815466+0000","last_clean":"2023-07-06T21:42:15.815466+0000","last_became_active":"2023-07-06T21:42:10.881872+0000","last_became_peered":"2023-07-06T21:42:10.881872+0000","last_unstale":"2023-07-06T21:42:15.815466+0000","last_undegraded":"2023-07-06T21:42:15.815466+0000","last_fullsized":"2023-07-06T21:42:15.815466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:18:00.557093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813877+0000","last_change":"2023-07-06T21:42:10.899839+0000","last_active":"2023-07-06T21:42:15.813877+0000","last_peered":"2023-07-06T21:42:15.813877+0000","last_clean":"2023-07-06T21:42:15.813877+0000","last_became_active":"2023-07-06T21:42:10.899525+0000","last_became_peered":"2023-07-06T21:42:10.899525+0000","last_unstale":"2023-07-06T21:42:15.813877+0000","last_undegraded":"2023-07-06T21:42:15.813877+0000","last_fullsized":"2023-07-06T21:42:15.813877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:38.266961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303319+0000","last_change":"2023-07-06T21:42:10.893778+0000","last_active":"2023-07-06T21:42:15.303319+0000","last_peered":"2023-07-06T21:42:15.303319+0000","last_clean":"2023-07-06T21:42:15.303319+0000","last_became_active":"2023-07-06T21:42:10.893495+0000","last_became_peered":"2023-07-06T21:42:10.893495+0000","last_unstale":"2023-07-06T21:42:15.303319+0000","last_undegraded":"2023-07-06T21:42:15.303319+0000","last_fullsized":"2023-07-06T21:42:15.303319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:05:56.844228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814245+0000","last_change":"2023-07-06T21:42:10.898297+0000","last_active":"2023-07-06T21:42:15.814245+0000","last_peered":"2023-07-06T21:42:15.814245+0000","last_clean":"2023-07-06T21:42:15.814245+0000","last_became_active":"2023-07-06T21:42:10.897968+0000","last_became_peered":"2023-07-06T21:42:10.897968+0000","last_unstale":"2023-07-06T21:42:15.814245+0000","last_undegraded":"2023-07-06T21:42:15.814245+0000","last_fullsized":"2023-07-06T21:42:15.814245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:07.551676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560074+0000","last_change":"2023-07-06T21:42:10.900842+0000","last_active":"2023-07-06T21:42:15.560074+0000","last_peered":"2023-07-06T21:42:15.560074+0000","last_clean":"2023-07-06T21:42:15.560074+0000","last_became_active":"2023-07-06T21:42:10.900437+0000","last_became_peered":"2023-07-06T21:42:10.900437+0000","last_unstale":"2023-07-06T21:42:15.560074+0000","last_undegraded":"2023-07-06T21:42:15.560074+0000","last_fullsized":"2023-07-06T21:42:15.560074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:40.295763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749841+0000","last_change":"2023-07-06T21:42:10.905321+0000","last_active":"2023-07-06T21:42:15.749841+0000","last_peered":"2023-07-06T21:42:15.749841+0000","last_clean":"2023-07-06T21:42:15.749841+0000","last_became_active":"2023-07-06T21:42:10.904814+0000","last_became_peered":"2023-07-06T21:42:10.904814+0000","last_unstale":"2023-07-06T21:42:15.749841+0000","last_undegraded":"2023-07-06T21:42:15.749841+0000","last_fullsized":"2023-07-06T21:42:15.749841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:14.101664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560324+0000","last_change":"2023-07-06T21:42:10.902809+0000","last_active":"2023-07-06T21:42:15.560324+0000","last_peered":"2023-07-06T21:42:15.560324+0000","last_clean":"2023-07-06T21:42:15.560324+0000","last_became_active":"2023-07-06T21:42:10.902527+0000","last_became_peered":"2023-07-06T21:42:10.902527+0000","last_unstale":"2023-07-06T21:42:15.560324+0000","last_undegraded":"2023-07-06T21:42:15.560324+0000","last_fullsized":"2023-07-06T21:42:15.560324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:49.957566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.561334+0000","last_change":"2023-07-06T21:42:10.896398+0000","last_active":"2023-07-06T21:42:15.561334+0000","last_peered":"2023-07-06T21:42:15.561334+0000","last_clean":"2023-07-06T21:42:15.561334+0000","last_became_active":"2023-07-06T21:42:10.896054+0000","last_became_peered":"2023-07-06T21:42:10.896054+0000","last_unstale":"2023-07-06T21:42:15.561334+0000","last_undegraded":"2023-07-06T21:42:15.561334+0000","last_fullsized":"2023-07-06T21:42:15.561334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:21.307899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302771+0000","last_change":"2023-07-06T21:42:10.893870+0000","last_active":"2023-07-06T21:42:15.302771+0000","last_peered":"2023-07-06T21:42:15.302771+0000","last_clean":"2023-07-06T21:42:15.302771+0000","last_became_active":"2023-07-06T21:42:10.888026+0000","last_became_peered":"2023-07-06T21:42:10.888026+0000","last_unstale":"2023-07-06T21:42:15.302771+0000","last_undegraded":"2023-07-06T21:42:15.302771+0000","last_fullsized":"2023-07-06T21:42:15.302771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813817+0000","last_change":"2023-07-06T21:42:10.885134+0000","last_active":"2023-07-06T21:42:15.813817+0000","last_peered":"2023-07-06T21:42:15.813817+0000","last_clean":"2023-07-06T21:42:15.813817+0000","last_became_active":"2023-07-06T21:42:10.884849+0000","last_became_peered":"2023-07-06T21:42:10.884849+0000","last_unstale":"2023-07-06T21:42:15.813817+0000","last_undegraded":"2023-07-06T21:42:15.813817+0000","last_fullsized":"2023-07-06T21:42:15.813817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554548+0000","last_change":"2023-07-06T21:42:10.902317+0000","last_active":"2023-07-06T21:42:15.554548+0000","last_peered":"2023-07-06T21:42:15.554548+0000","last_clean":"2023-07-06T21:42:15.554548+0000","last_became_active":"2023-07-06T21:42:10.902008+0000","last_became_peered":"2023-07-06T21:42:10.902008+0000","last_unstale":"2023-07-06T21:42:15.554548+0000","last_undegraded":"2023-07-06T21:42:15.554548+0000","last_fullsized":"2023-07-06T21:42:15.554548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:17.881222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304038+0000","last_change":"2023-07-06T21:42:10.894288+0000","last_active":"2023-07-06T21:42:15.304038+0000","last_peered":"2023-07-06T21:42:15.304038+0000","last_clean":"2023-07-06T21:42:15.304038+0000","last_became_active":"2023-07-06T21:42:10.880077+0000","last_became_peered":"2023-07-06T21:42:10.880077+0000","last_unstale":"2023-07-06T21:42:15.304038+0000","last_undegraded":"2023-07-06T21:42:15.304038+0000","last_fullsized":"2023-07-06T21:42:15.304038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:14.101664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303738+0000","last_change":"2023-07-06T21:42:10.894314+0000","last_active":"2023-07-06T21:42:15.303738+0000","last_peered":"2023-07-06T21:42:15.303738+0000","last_clean":"2023-07-06T21:42:15.303738+0000","last_became_active":"2023-07-06T21:42:10.894014+0000","last_became_peered":"2023-07-06T21:42:10.894014+0000","last_unstale":"2023-07-06T21:42:15.303738+0000","last_undegraded":"2023-07-06T21:42:15.303738+0000","last_fullsized":"2023-07-06T21:42:15.303738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:38:49.964001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300620+0000","last_change":"2023-07-06T21:42:10.887468+0000","last_active":"2023-07-06T21:42:15.300620+0000","last_peered":"2023-07-06T21:42:15.300620+0000","last_clean":"2023-07-06T21:42:15.300620+0000","last_became_active":"2023-07-06T21:42:10.887178+0000","last_became_peered":"2023-07-06T21:42:10.887178+0000","last_unstale":"2023-07-06T21:42:15.300620+0000","last_undegraded":"2023-07-06T21:42:15.300620+0000","last_fullsized":"2023-07-06T21:42:15.300620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:48:23.869797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304224+0000","last_change":"2023-07-06T21:42:10.879664+0000","last_active":"2023-07-06T21:42:15.304224+0000","last_peered":"2023-07-06T21:42:15.304224+0000","last_clean":"2023-07-06T21:42:15.304224+0000","last_became_active":"2023-07-06T21:42:10.879395+0000","last_became_peered":"2023-07-06T21:42:10.879395+0000","last_unstale":"2023-07-06T21:42:15.304224+0000","last_undegraded":"2023-07-06T21:42:15.304224+0000","last_fullsized":"2023-07-06T21:42:15.304224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:52:32.495454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555257+0000","last_change":"2023-07-06T21:42:10.882880+0000","last_active":"2023-07-06T21:42:15.555257+0000","last_peered":"2023-07-06T21:42:15.555257+0000","last_clean":"2023-07-06T21:42:15.555257+0000","last_became_active":"2023-07-06T21:42:10.882651+0000","last_became_peered":"2023-07-06T21:42:10.882651+0000","last_unstale":"2023-07-06T21:42:15.555257+0000","last_undegraded":"2023-07-06T21:42:15.555257+0000","last_fullsized":"2023-07-06T21:42:15.555257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:54.952788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302546+0000","last_change":"2023-07-06T21:42:10.878440+0000","last_active":"2023-07-06T21:42:15.302546+0000","last_peered":"2023-07-06T21:42:15.302546+0000","last_clean":"2023-07-06T21:42:15.302546+0000","last_became_active":"2023-07-06T21:42:10.878108+0000","last_became_peered":"2023-07-06T21:42:10.878108+0000","last_unstale":"2023-07-06T21:42:15.302546+0000","last_undegraded":"2023-07-06T21:42:15.302546+0000","last_fullsized":"2023-07-06T21:42:15.302546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:23:26.016221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303514+0000","last_change":"2023-07-06T21:42:10.902391+0000","last_active":"2023-07-06T21:42:15.303514+0000","last_peered":"2023-07-06T21:42:15.303514+0000","last_clean":"2023-07-06T21:42:15.303514+0000","last_became_active":"2023-07-06T21:42:10.902167+0000","last_became_peered":"2023-07-06T21:42:10.902167+0000","last_unstale":"2023-07-06T21:42:15.303514+0000","last_undegraded":"2023-07-06T21:42:15.303514+0000","last_fullsized":"2023-07-06T21:42:15.303514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:38.783636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749382+0000","last_change":"2023-07-06T21:42:10.891440+0000","last_active":"2023-07-06T21:42:15.749382+0000","last_peered":"2023-07-06T21:42:15.749382+0000","last_clean":"2023-07-06T21:42:15.749382+0000","last_became_active":"2023-07-06T21:42:10.891154+0000","last_became_peered":"2023-07-06T21:42:10.891154+0000","last_unstale":"2023-07-06T21:42:15.749382+0000","last_undegraded":"2023-07-06T21:42:15.749382+0000","last_fullsized":"2023-07-06T21:42:15.749382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300255+0000","last_change":"2023-07-06T21:42:10.875691+0000","last_active":"2023-07-06T21:42:15.300255+0000","last_peered":"2023-07-06T21:42:15.300255+0000","last_clean":"2023-07-06T21:42:15.300255+0000","last_became_active":"2023-07-06T21:42:10.875349+0000","last_became_peered":"2023-07-06T21:42:10.875349+0000","last_unstale":"2023-07-06T21:42:15.300255+0000","last_undegraded":"2023-07-06T21:42:15.300255+0000","last_fullsized":"2023-07-06T21:42:15.300255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:27:07.827816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300278+0000","last_change":"2023-07-06T21:42:10.881532+0000","last_active":"2023-07-06T21:42:15.300278+0000","last_peered":"2023-07-06T21:42:15.300278+0000","last_clean":"2023-07-06T21:42:15.300278+0000","last_became_active":"2023-07-06T21:42:10.880941+0000","last_became_peered":"2023-07-06T21:42:10.880941+0000","last_unstale":"2023-07-06T21:42:15.300278+0000","last_undegraded":"2023-07-06T21:42:15.300278+0000","last_fullsized":"2023-07-06T21:42:15.300278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:52:05.125777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304252+0000","last_change":"2023-07-06T21:42:10.894986+0000","last_active":"2023-07-06T21:42:15.304252+0000","last_peered":"2023-07-06T21:42:15.304252+0000","last_clean":"2023-07-06T21:42:15.304252+0000","last_became_active":"2023-07-06T21:42:10.894738+0000","last_became_peered":"2023-07-06T21:42:10.894738+0000","last_unstale":"2023-07-06T21:42:15.304252+0000","last_undegraded":"2023-07-06T21:42:15.304252+0000","last_fullsized":"2023-07-06T21:42:15.304252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:27:06.771295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750069+0000","last_change":"2023-07-06T21:42:10.895916+0000","last_active":"2023-07-06T21:42:15.750069+0000","last_peered":"2023-07-06T21:42:15.750069+0000","last_clean":"2023-07-06T21:42:15.750069+0000","last_became_active":"2023-07-06T21:42:10.895651+0000","last_became_peered":"2023-07-06T21:42:10.895651+0000","last_unstale":"2023-07-06T21:42:15.750069+0000","last_undegraded":"2023-07-06T21:42:15.750069+0000","last_fullsized":"2023-07-06T21:42:15.750069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:26.458362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555014+0000","last_change":"2023-07-06T21:42:10.885988+0000","last_active":"2023-07-06T21:42:15.555014+0000","last_peered":"2023-07-06T21:42:15.555014+0000","last_clean":"2023-07-06T21:42:15.555014+0000","last_became_active":"2023-07-06T21:42:10.885729+0000","last_became_peered":"2023-07-06T21:42:10.885729+0000","last_unstale":"2023-07-06T21:42:15.555014+0000","last_undegraded":"2023-07-06T21:42:15.555014+0000","last_fullsized":"2023-07-06T21:42:15.555014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749183+0000","last_change":"2023-07-06T21:42:10.891993+0000","last_active":"2023-07-06T21:42:15.749183+0000","last_peered":"2023-07-06T21:42:15.749183+0000","last_clean":"2023-07-06T21:42:15.749183+0000","last_became_active":"2023-07-06T21:42:10.891739+0000","last_became_peered":"2023-07-06T21:42:10.891739+0000","last_unstale":"2023-07-06T21:42:15.749183+0000","last_undegraded":"2023-07-06T21:42:15.749183+0000","last_fullsized":"2023-07-06T21:42:15.749183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:40.295763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303451+0000","last_change":"2023-07-06T21:42:10.902805+0000","last_active":"2023-07-06T21:42:15.303451+0000","last_peered":"2023-07-06T21:42:15.303451+0000","last_clean":"2023-07-06T21:42:15.303451+0000","last_became_active":"2023-07-06T21:42:10.902567+0000","last_became_peered":"2023-07-06T21:42:10.902567+0000","last_unstale":"2023-07-06T21:42:15.303451+0000","last_undegraded":"2023-07-06T21:42:15.303451+0000","last_fullsized":"2023-07-06T21:42:15.303451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:49.304577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303055+0000","last_change":"2023-07-06T21:42:10.881630+0000","last_active":"2023-07-06T21:42:15.303055+0000","last_peered":"2023-07-06T21:42:15.303055+0000","last_clean":"2023-07-06T21:42:15.303055+0000","last_became_active":"2023-07-06T21:42:10.881320+0000","last_became_peered":"2023-07-06T21:42:10.881320+0000","last_unstale":"2023-07-06T21:42:15.303055+0000","last_undegraded":"2023-07-06T21:42:15.303055+0000","last_fullsized":"2023-07-06T21:42:15.303055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:25:56.218127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555077+0000","last_change":"2023-07-06T21:42:10.898965+0000","last_active":"2023-07-06T21:42:15.555077+0000","last_peered":"2023-07-06T21:42:15.555077+0000","last_clean":"2023-07-06T21:42:15.555077+0000","last_became_active":"2023-07-06T21:42:10.898708+0000","last_became_peered":"2023-07-06T21:42:10.898708+0000","last_unstale":"2023-07-06T21:42:15.555077+0000","last_undegraded":"2023-07-06T21:42:15.555077+0000","last_fullsized":"2023-07-06T21:42:15.555077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:38.266961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815879+0000","last_change":"2023-07-06T21:42:10.886444+0000","last_active":"2023-07-06T21:42:15.815879+0000","last_peered":"2023-07-06T21:42:15.815879+0000","last_clean":"2023-07-06T21:42:15.815879+0000","last_became_active":"2023-07-06T21:42:10.885666+0000","last_became_peered":"2023-07-06T21:42:10.885666+0000","last_unstale":"2023-07-06T21:42:15.815879+0000","last_undegraded":"2023-07-06T21:42:15.815879+0000","last_fullsized":"2023-07-06T21:42:15.815879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:46:15.005638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304225+0000","last_change":"2023-07-06T21:42:10.882573+0000","last_active":"2023-07-06T21:42:15.304225+0000","last_peered":"2023-07-06T21:42:15.304225+0000","last_clean":"2023-07-06T21:42:15.304225+0000","last_became_active":"2023-07-06T21:42:10.882180+0000","last_became_peered":"2023-07-06T21:42:10.882180+0000","last_unstale":"2023-07-06T21:42:15.304225+0000","last_undegraded":"2023-07-06T21:42:15.304225+0000","last_fullsized":"2023-07-06T21:42:15.304225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:30:13.482950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749979+0000","last_change":"2023-07-06T21:42:10.904712+0000","last_active":"2023-07-06T21:42:15.749979+0000","last_peered":"2023-07-06T21:42:15.749979+0000","last_clean":"2023-07-06T21:42:15.749979+0000","last_became_active":"2023-07-06T21:42:10.904256+0000","last_became_peered":"2023-07-06T21:42:10.904256+0000","last_unstale":"2023-07-06T21:42:15.749979+0000","last_undegraded":"2023-07-06T21:42:15.749979+0000","last_fullsized":"2023-07-06T21:42:15.749979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:29.829357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300331+0000","last_change":"2023-07-06T21:42:10.887637+0000","last_active":"2023-07-06T21:42:15.300331+0000","last_peered":"2023-07-06T21:42:15.300331+0000","last_clean":"2023-07-06T21:42:15.300331+0000","last_became_active":"2023-07-06T21:42:10.887372+0000","last_became_peered":"2023-07-06T21:42:10.887372+0000","last_unstale":"2023-07-06T21:42:15.300331+0000","last_undegraded":"2023-07-06T21:42:15.300331+0000","last_fullsized":"2023-07-06T21:42:15.300331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:03.429658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":913408,"data_stored":714278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":123750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":884736,"data_stored":709832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:42:35.246 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:42:35.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.415+0000 7f27f4b1e640 1 Processor -- start 2023-07-06T21:42:35.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.415+0000 7f27f4b1e640 1 -- start start 2023-07-06T21:42:35.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.415+0000 7f27f4b1e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f27f00b4420 0x7f27f015c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.415+0000 7f27f4b1e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f006a160 con 0x7f27f015b9d0 2023-07-06T21:42:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.415+0000 7f27f4b1e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f015bda0 con 0x7f27f015f4e0 2023-07-06T21:42:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.415+0000 7f27f4b1e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f0069590 con 0x7f27f00b4420 2023-07-06T21:42:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.415+0000 7f27ee59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f27f015b9d0 0x7f27f00ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38412/0 (socket says 172.21.15.55:38412) 2023-07-06T21:42:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.415+0000 7f27ee59c640 1 -- 172.21.15.55:0/4288033329 learned_addr learned my addr 172.21.15.55:0/4288033329 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.415+0000 7f27eed9d640 1 --2- 172.21.15.55:0/4288033329 >> v2:172.21.15.55:3300/0 conn(0x7f27f00b4420 0x7f27f015c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.415+0000 7f27edd9b640 1 -- 172.21.15.55:0/4288033329 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401752896 0 0) 0x7f27f006a160 con 0x7f27f015b9d0 2023-07-06T21:42:35.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.415+0000 7f27edd9b640 1 -- 172.21.15.55:0/4288033329 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27dc003530 con 0x7f27f015b9d0 2023-07-06T21:42:35.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.415+0000 7f27eed9d640 1 -- 172.21.15.55:0/4288033329 >> v1:172.21.15.138:6789/0 conn(0x7f27f015f4e0 legacy=0x7f27f00b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:35.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.415+0000 7f27eed9d640 1 -- 172.21.15.55:0/4288033329 >> v1:172.21.15.55:6789/0 conn(0x7f27f015b9d0 legacy=0x7f27f00ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.415+0000 7f27eed9d640 1 -- 172.21.15.55:0/4288033329 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0069830 con 0x7f27f00b4420 2023-07-06T21:42:35.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.419+0000 7f27eed9d640 1 --2- 172.21.15.55:0/4288033329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27f00b4420 0x7f27f015c110 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009d90 tx=0x7f27e801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0a3802e1a0757a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:35.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.419+0000 7f27edd9b640 1 -- 172.21.15.55:0/4288033329 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80a57d0 con 0x7f27f00b4420 2023-07-06T21:42:35.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.419+0000 7f27edd9b640 1 -- 172.21.15.55:0/4288033329 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e80a5930 con 0x7f27f00b4420 2023-07-06T21:42:35.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.419+0000 7f27edd9b640 1 -- 172.21.15.55:0/4288033329 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80a5cc0 con 0x7f27f00b4420 2023-07-06T21:42:35.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.419+0000 7f27f4b1e640 1 -- 172.21.15.55:0/4288033329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27f00b4420 msgr2=0x7f27f015c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.419+0000 7f27f4b1e640 1 --2- 172.21.15.55:0/4288033329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27f00b4420 0x7f27f015c110 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009d90 tx=0x7f27e801c910 comp rx=0 tx=0).stop 2023-07-06T21:42:35.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.419+0000 7f27f4b1e640 1 -- 172.21.15.55:0/4288033329 shutdown_connections 2023-07-06T21:42:35.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.419+0000 7f27f4b1e640 1 --2- 172.21.15.55:0/4288033329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27f00b4420 0x7f27f015c110 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.419+0000 7f27f4b1e640 1 -- 172.21.15.55:0/4288033329 >> 172.21.15.55:0/4288033329 conn(0x7f27f00ced10 msgr2=0x7f27f00cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:35.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.419+0000 7f27f4b1e640 1 -- 172.21.15.55:0/4288033329 shutdown_connections 2023-07-06T21:42:35.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.419+0000 7f27f4b1e640 1 -- 172.21.15.55:0/4288033329 wait complete. 2023-07-06T21:42:35.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27f4b1e640 1 Processor -- start 2023-07-06T21:42:35.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27f4b1e640 1 -- start start 2023-07-06T21:42:35.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27f4b1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27f00b4420 0x7f27f0153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27f4b1e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27f015b9d0 0x7f27f00c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27f4b1e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27f015f4e0 0x7f27f00c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27f4b1e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f014f9c0 con 0x7f27f00b4420 2023-07-06T21:42:35.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27f4b1e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00b73a0 con 0x7f27f015f4e0 2023-07-06T21:42:35.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27f4b1e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00b7680 con 0x7f27f015b9d0 2023-07-06T21:42:35.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27ee59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27f00b4420 0x7f27f0153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27ee59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27f00b4420 0x7f27f0153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55256/0 (socket says 172.21.15.55:55256) 2023-07-06T21:42:35.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27ee59c640 1 -- 172.21.15.55:0/1783329204 learned_addr learned my addr 172.21.15.55:0/1783329204 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:35.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27eed9d640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27f015f4e0 0x7f27f00c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27e7fff640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27f015b9d0 0x7f27f00c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27ee59c640 1 -- 172.21.15.55:0/1783329204 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27f015b9d0 msgr2=0x7f27f00c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27ee59c640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27f015b9d0 0x7f27f00c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27ee59c640 1 -- 172.21.15.55:0/1783329204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27f015f4e0 msgr2=0x7f27f00c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27ee59c640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27f015f4e0 0x7f27f00c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27ee59c640 1 -- 172.21.15.55:0/1783329204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e8009a70 con 0x7f27f00b4420 2023-07-06T21:42:35.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27eed9d640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27f015f4e0 0x7f27f00c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27ee59c640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27f00b4420 0x7f27f0153400 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c4d0 tx=0x7f27e000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27e6ffd640 1 -- 172.21.15.55:0/1783329204 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0005cf0 con 0x7f27f00b4420 2023-07-06T21:42:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27e6ffd640 1 -- 172.21.15.55:0/1783329204 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e0005e50 con 0x7f27f00b4420 2023-07-06T21:42:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27f4b1e640 1 -- 172.21.15.55:0/1783329204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f00b7960 con 0x7f27f00b4420 2023-07-06T21:42:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27e6ffd640 1 -- 172.21.15.55:0/1783329204 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0007270 con 0x7f27f00b4420 2023-07-06T21:42:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.423+0000 7f27f4b1e640 1 -- 172.21.15.55:0/1783329204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f0152160 con 0x7f27f00b4420 2023-07-06T21:42:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.427+0000 7f27f4b1e640 1 -- 172.21.15.55:0/1783329204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f00cf8d0 con 0x7f27f00b4420 2023-07-06T21:42:35.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.427+0000 7f27e6ffd640 1 -- 172.21.15.55:0/1783329204 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27e00073d0 con 0x7f27f00b4420 2023-07-06T21:42:35.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.427+0000 7f27e6ffd640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f27d0066280 0x7f27d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.427+0000 7f27e6ffd640 1 -- 172.21.15.55:0/1783329204 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f27e0083550 con 0x7f27f00b4420 2023-07-06T21:42:35.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.427+0000 7f27e7fff640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f27d0066280 0x7f27d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.427+0000 7f27e7fff640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f27d0066280 0x7f27d0068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f27f00cf7a0 tx=0x7f27d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.431+0000 7f27e6ffd640 1 -- 172.21.15.55:0/1783329204 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27e0050780 con 0x7f27f00b4420 2023-07-06T21:42:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.583+0000 7f27f4b1e640 1 -- 172.21.15.55:0/1783329204 --> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27f00cea50 con 0x7f27d0066280 2023-07-06T21:42:35.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.595+0000 7f27e6ffd640 1 -- 172.21.15.55:0/1783329204 <== mgr.4101 v2:172.21.15.55:6832/1575998409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367351 (secure 0 0 0) 0x7f27d800bdc0 con 0x7f27d0066280 2023-07-06T21:42:35.602 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:42:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.599+0000 7f27f4b1e640 1 -- 172.21.15.55:0/1783329204 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f27d0066280 msgr2=0x7f27d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.599+0000 7f27f4b1e640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f27d0066280 0x7f27d0068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f27f00cf7a0 tx=0x7f27d8008040 comp rx=0 tx=0).stop 2023-07-06T21:42:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.599+0000 7f27f4b1e640 1 -- 172.21.15.55:0/1783329204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27f00b4420 msgr2=0x7f27f0153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.599+0000 7f27f4b1e640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27f00b4420 0x7f27f0153400 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c4d0 tx=0x7f27e000c990 comp rx=0 tx=0).stop 2023-07-06T21:42:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.599+0000 7f27f4b1e640 1 -- 172.21.15.55:0/1783329204 shutdown_connections 2023-07-06T21:42:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.599+0000 7f27f4b1e640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f27d0066280 0x7f27d0068730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.599+0000 7f27f4b1e640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27f015f4e0 0x7f27f00c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.599+0000 7f27f4b1e640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27f015b9d0 0x7f27f00c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.599+0000 7f27f4b1e640 1 --2- 172.21.15.55:0/1783329204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27f00b4420 0x7f27f0153400 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.599+0000 7f27f4b1e640 1 -- 172.21.15.55:0/1783329204 >> 172.21.15.55:0/1783329204 conn(0x7f27f00ced10 msgr2=0x7f27f015fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:35.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.599+0000 7f27f4b1e640 1 -- 172.21.15.55:0/1783329204 shutdown_connections 2023-07-06T21:42:35.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.599+0000 7f27f4b1e640 1 -- 172.21.15.55:0/1783329204 wait complete. 2023-07-06T21:42:35.623 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-07-06T21:42:33.647778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235488,"kb_used_data":3488,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739232,"statfs":{"total":773094113280,"available":772852973568,"internally_reserved":0,"allocated":3571712,"data_stored":2147088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002452"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559395+0000","last_change":"2023-07-06T21:42:14.922760+0000","last_active":"2023-07-06T21:42:15.559395+0000","last_peered":"2023-07-06T21:42:15.559395+0000","last_clean":"2023-07-06T21:42:15.559395+0000","last_became_active":"2023-07-06T21:42:14.922077+0000","last_became_peered":"2023-07-06T21:42:14.922077+0000","last_unstale":"2023-07-06T21:42:15.559395+0000","last_undegraded":"2023-07-06T21:42:15.559395+0000","last_fullsized":"2023-07-06T21:42:15.559395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:06:48.524116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555170+0000","last_change":"2023-07-06T21:42:10.476753+0000","last_active":"2023-07-06T21:42:15.555170+0000","last_peered":"2023-07-06T21:42:15.555170+0000","last_clean":"2023-07-06T21:42:15.555170+0000","last_became_active":"2023-07-06T21:42:10.476407+0000","last_became_peered":"2023-07-06T21:42:10.476407+0000","last_unstale":"2023-07-06T21:42:15.555170+0000","last_undegraded":"2023-07-06T21:42:15.555170+0000","last_fullsized":"2023-07-06T21:42:15.555170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:48.294217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302669+0000","last_change":"2023-07-06T21:42:10.894302+0000","last_active":"2023-07-06T21:42:15.302669+0000","last_peered":"2023-07-06T21:42:15.302669+0000","last_clean":"2023-07-06T21:42:15.302669+0000","last_became_active":"2023-07-06T21:42:10.894059+0000","last_became_peered":"2023-07-06T21:42:10.894059+0000","last_unstale":"2023-07-06T21:42:15.302669+0000","last_undegraded":"2023-07-06T21:42:15.302669+0000","last_fullsized":"2023-07-06T21:42:15.302669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:10:18.902553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302860+0000","last_change":"2023-07-06T21:42:14.912729+0000","last_active":"2023-07-06T21:42:15.302860+0000","last_peered":"2023-07-06T21:42:15.302860+0000","last_clean":"2023-07-06T21:42:15.302860+0000","last_became_active":"2023-07-06T21:42:14.912302+0000","last_became_peered":"2023-07-06T21:42:14.912302+0000","last_unstale":"2023-07-06T21:42:15.302860+0000","last_undegraded":"2023-07-06T21:42:15.302860+0000","last_fullsized":"2023-07-06T21:42:15.302860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:34:24.860047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814495+0000","last_change":"2023-07-06T21:42:10.468782+0000","last_active":"2023-07-06T21:42:15.814495+0000","last_peered":"2023-07-06T21:42:15.814495+0000","last_clean":"2023-07-06T21:42:15.814495+0000","last_became_active":"2023-07-06T21:42:10.468411+0000","last_became_peered":"2023-07-06T21:42:10.468411+0000","last_unstale":"2023-07-06T21:42:15.814495+0000","last_undegraded":"2023-07-06T21:42:15.814495+0000","last_fullsized":"2023-07-06T21:42:15.814495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:15:16.029351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814107+0000","last_change":"2023-07-06T21:42:10.877047+0000","last_active":"2023-07-06T21:42:15.814107+0000","last_peered":"2023-07-06T21:42:15.814107+0000","last_clean":"2023-07-06T21:42:15.814107+0000","last_became_active":"2023-07-06T21:42:10.876806+0000","last_became_peered":"2023-07-06T21:42:10.876806+0000","last_unstale":"2023-07-06T21:42:15.814107+0000","last_undegraded":"2023-07-06T21:42:15.814107+0000","last_fullsized":"2023-07-06T21:42:15.814107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:35.611286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749539+0000","last_change":"2023-07-06T21:42:14.921605+0000","last_active":"2023-07-06T21:42:15.749539+0000","last_peered":"2023-07-06T21:42:15.749539+0000","last_clean":"2023-07-06T21:42:15.749539+0000","last_became_active":"2023-07-06T21:42:14.921171+0000","last_became_peered":"2023-07-06T21:42:14.921171+0000","last_unstale":"2023-07-06T21:42:15.749539+0000","last_undegraded":"2023-07-06T21:42:15.749539+0000","last_fullsized":"2023-07-06T21:42:15.749539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:53.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750023+0000","last_change":"2023-07-06T21:42:10.482575+0000","last_active":"2023-07-06T21:42:15.750023+0000","last_peered":"2023-07-06T21:42:15.750023+0000","last_clean":"2023-07-06T21:42:15.750023+0000","last_became_active":"2023-07-06T21:42:10.482316+0000","last_became_peered":"2023-07-06T21:42:10.482316+0000","last_unstale":"2023-07-06T21:42:15.750023+0000","last_undegraded":"2023-07-06T21:42:15.750023+0000","last_fullsized":"2023-07-06T21:42:15.750023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:18:13.828606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303215+0000","last_change":"2023-07-06T21:42:10.883364+0000","last_active":"2023-07-06T21:42:15.303215+0000","last_peered":"2023-07-06T21:42:15.303215+0000","last_clean":"2023-07-06T21:42:15.303215+0000","last_became_active":"2023-07-06T21:42:10.882034+0000","last_became_peered":"2023-07-06T21:42:10.882034+0000","last_unstale":"2023-07-06T21:42:15.303215+0000","last_undegraded":"2023-07-06T21:42:15.303215+0000","last_fullsized":"2023-07-06T21:42:15.303215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:15:09.620712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303343+0000","last_change":"2023-07-06T21:42:14.910108+0000","last_active":"2023-07-06T21:42:15.303343+0000","last_peered":"2023-07-06T21:42:15.303343+0000","last_clean":"2023-07-06T21:42:15.303343+0000","last_became_active":"2023-07-06T21:42:14.909696+0000","last_became_peered":"2023-07-06T21:42:14.909696+0000","last_unstale":"2023-07-06T21:42:15.303343+0000","last_undegraded":"2023-07-06T21:42:15.303343+0000","last_fullsized":"2023-07-06T21:42:15.303343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:24.738875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749578+0000","last_change":"2023-07-06T21:42:10.474754+0000","last_active":"2023-07-06T21:42:15.749578+0000","last_peered":"2023-07-06T21:42:15.749578+0000","last_clean":"2023-07-06T21:42:15.749578+0000","last_became_active":"2023-07-06T21:42:10.474461+0000","last_became_peered":"2023-07-06T21:42:10.474461+0000","last_unstale":"2023-07-06T21:42:15.749578+0000","last_undegraded":"2023-07-06T21:42:15.749578+0000","last_fullsized":"2023-07-06T21:42:15.749578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:02.030132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303640+0000","last_change":"2023-07-06T21:42:10.882870+0000","last_active":"2023-07-06T21:42:15.303640+0000","last_peered":"2023-07-06T21:42:15.303640+0000","last_clean":"2023-07-06T21:42:15.303640+0000","last_became_active":"2023-07-06T21:42:10.882523+0000","last_became_peered":"2023-07-06T21:42:10.882523+0000","last_unstale":"2023-07-06T21:42:15.303640+0000","last_undegraded":"2023-07-06T21:42:15.303640+0000","last_fullsized":"2023-07-06T21:42:15.303640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:29:36.364419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560105+0000","last_change":"2023-07-06T21:42:14.904246+0000","last_active":"2023-07-06T21:42:15.560105+0000","last_peered":"2023-07-06T21:42:15.560105+0000","last_clean":"2023-07-06T21:42:15.560105+0000","last_became_active":"2023-07-06T21:42:14.903763+0000","last_became_peered":"2023-07-06T21:42:14.903763+0000","last_unstale":"2023-07-06T21:42:15.560105+0000","last_undegraded":"2023-07-06T21:42:15.560105+0000","last_fullsized":"2023-07-06T21:42:15.560105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555200+0000","last_change":"2023-07-06T21:42:10.483593+0000","last_active":"2023-07-06T21:42:15.555200+0000","last_peered":"2023-07-06T21:42:15.555200+0000","last_clean":"2023-07-06T21:42:15.555200+0000","last_became_active":"2023-07-06T21:42:10.483284+0000","last_became_peered":"2023-07-06T21:42:10.483284+0000","last_unstale":"2023-07-06T21:42:15.555200+0000","last_undegraded":"2023-07-06T21:42:15.555200+0000","last_fullsized":"2023-07-06T21:42:15.555200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:37.773277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300337+0000","last_change":"2023-07-06T21:42:10.901884+0000","last_active":"2023-07-06T21:42:15.300337+0000","last_peered":"2023-07-06T21:42:15.300337+0000","last_clean":"2023-07-06T21:42:15.300337+0000","last_became_active":"2023-07-06T21:42:10.901580+0000","last_became_peered":"2023-07-06T21:42:10.901580+0000","last_unstale":"2023-07-06T21:42:15.300337+0000","last_undegraded":"2023-07-06T21:42:15.300337+0000","last_fullsized":"2023-07-06T21:42:15.300337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:22:55.494418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303514+0000","last_change":"2023-07-06T21:42:14.912585+0000","last_active":"2023-07-06T21:42:15.303514+0000","last_peered":"2023-07-06T21:42:15.303514+0000","last_clean":"2023-07-06T21:42:15.303514+0000","last_became_active":"2023-07-06T21:42:14.912161+0000","last_became_peered":"2023-07-06T21:42:14.912161+0000","last_unstale":"2023-07-06T21:42:15.303514+0000","last_undegraded":"2023-07-06T21:42:15.303514+0000","last_fullsized":"2023-07-06T21:42:15.303514+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:00:05.811592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303358+0000","last_change":"2023-07-06T21:42:10.475123+0000","last_active":"2023-07-06T21:42:15.303358+0000","last_peered":"2023-07-06T21:42:15.303358+0000","last_clean":"2023-07-06T21:42:15.303358+0000","last_became_active":"2023-07-06T21:42:10.474779+0000","last_became_peered":"2023-07-06T21:42:10.474779+0000","last_unstale":"2023-07-06T21:42:15.303358+0000","last_undegraded":"2023-07-06T21:42:15.303358+0000","last_fullsized":"2023-07-06T21:42:15.303358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:57:21.124055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814299+0000","last_change":"2023-07-06T21:42:10.896524+0000","last_active":"2023-07-06T21:42:15.814299+0000","last_peered":"2023-07-06T21:42:15.814299+0000","last_clean":"2023-07-06T21:42:15.814299+0000","last_became_active":"2023-07-06T21:42:10.896258+0000","last_became_peered":"2023-07-06T21:42:10.896258+0000","last_unstale":"2023-07-06T21:42:15.814299+0000","last_undegraded":"2023-07-06T21:42:15.814299+0000","last_fullsized":"2023-07-06T21:42:15.814299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:01.330836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816070+0000","last_change":"2023-07-06T21:42:14.906299+0000","last_active":"2023-07-06T21:42:15.816070+0000","last_peered":"2023-07-06T21:42:15.816070+0000","last_clean":"2023-07-06T21:42:15.816070+0000","last_became_active":"2023-07-06T21:42:14.905903+0000","last_became_peered":"2023-07-06T21:42:14.905903+0000","last_unstale":"2023-07-06T21:42:15.816070+0000","last_undegraded":"2023-07-06T21:42:15.816070+0000","last_fullsized":"2023-07-06T21:42:15.816070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:15.781649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559557+0000","last_change":"2023-07-06T21:42:10.473362+0000","last_active":"2023-07-06T21:42:15.559557+0000","last_peered":"2023-07-06T21:42:15.559557+0000","last_clean":"2023-07-06T21:42:15.559557+0000","last_became_active":"2023-07-06T21:42:10.473023+0000","last_became_peered":"2023-07-06T21:42:10.473023+0000","last_unstale":"2023-07-06T21:42:15.559557+0000","last_undegraded":"2023-07-06T21:42:15.559557+0000","last_fullsized":"2023-07-06T21:42:15.559557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:44:16.691368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555110+0000","last_change":"2023-07-06T21:42:10.894953+0000","last_active":"2023-07-06T21:42:15.555110+0000","last_peered":"2023-07-06T21:42:15.555110+0000","last_clean":"2023-07-06T21:42:15.555110+0000","last_became_active":"2023-07-06T21:42:10.894746+0000","last_became_peered":"2023-07-06T21:42:10.894746+0000","last_unstale":"2023-07-06T21:42:15.555110+0000","last_undegraded":"2023-07-06T21:42:15.555110+0000","last_fullsized":"2023-07-06T21:42:15.555110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:03.040492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555021+0000","last_change":"2023-07-06T21:42:14.909036+0000","last_active":"2023-07-06T21:42:15.555021+0000","last_peered":"2023-07-06T21:42:15.555021+0000","last_clean":"2023-07-06T21:42:15.555021+0000","last_became_active":"2023-07-06T21:42:14.908620+0000","last_became_peered":"2023-07-06T21:42:14.908620+0000","last_unstale":"2023-07-06T21:42:15.555021+0000","last_undegraded":"2023-07-06T21:42:15.555021+0000","last_fullsized":"2023-07-06T21:42:15.555021+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813952+0000","last_change":"2023-07-06T21:42:10.478777+0000","last_active":"2023-07-06T21:42:15.813952+0000","last_peered":"2023-07-06T21:42:15.813952+0000","last_clean":"2023-07-06T21:42:15.813952+0000","last_became_active":"2023-07-06T21:42:10.478487+0000","last_became_peered":"2023-07-06T21:42:10.478487+0000","last_unstale":"2023-07-06T21:42:15.813952+0000","last_undegraded":"2023-07-06T21:42:15.813952+0000","last_fullsized":"2023-07-06T21:42:15.813952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:02.030132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816172+0000","last_change":"2023-07-06T21:42:10.891356+0000","last_active":"2023-07-06T21:42:15.816172+0000","last_peered":"2023-07-06T21:42:15.816172+0000","last_clean":"2023-07-06T21:42:15.816172+0000","last_became_active":"2023-07-06T21:42:10.890691+0000","last_became_peered":"2023-07-06T21:42:10.890691+0000","last_unstale":"2023-07-06T21:42:15.816172+0000","last_undegraded":"2023-07-06T21:42:15.816172+0000","last_fullsized":"2023-07-06T21:42:15.816172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:49:21.474970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813824+0000","last_change":"2023-07-06T21:42:10.903834+0000","last_active":"2023-07-06T21:42:15.813824+0000","last_peered":"2023-07-06T21:42:15.813824+0000","last_clean":"2023-07-06T21:42:15.813824+0000","last_became_active":"2023-07-06T21:42:10.903529+0000","last_became_peered":"2023-07-06T21:42:10.903529+0000","last_unstale":"2023-07-06T21:42:15.813824+0000","last_undegraded":"2023-07-06T21:42:15.813824+0000","last_fullsized":"2023-07-06T21:42:15.813824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:49.957566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555297+0000","last_change":"2023-07-06T21:42:10.476662+0000","last_active":"2023-07-06T21:42:15.555297+0000","last_peered":"2023-07-06T21:42:15.555297+0000","last_clean":"2023-07-06T21:42:15.555297+0000","last_became_active":"2023-07-06T21:42:10.476371+0000","last_became_peered":"2023-07-06T21:42:10.476371+0000","last_unstale":"2023-07-06T21:42:15.555297+0000","last_undegraded":"2023-07-06T21:42:15.555297+0000","last_fullsized":"2023-07-06T21:42:15.555297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:34.600926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815594+0000","last_change":"2023-07-06T21:42:14.905161+0000","last_active":"2023-07-06T21:42:15.815594+0000","last_peered":"2023-07-06T21:42:15.815594+0000","last_clean":"2023-07-06T21:42:15.815594+0000","last_became_active":"2023-07-06T21:42:14.904772+0000","last_became_peered":"2023-07-06T21:42:14.904772+0000","last_unstale":"2023-07-06T21:42:15.815594+0000","last_undegraded":"2023-07-06T21:42:15.815594+0000","last_fullsized":"2023-07-06T21:42:15.815594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:16:29.182580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813950+0000","last_change":"2023-07-06T21:42:10.886798+0000","last_active":"2023-07-06T21:42:15.813950+0000","last_peered":"2023-07-06T21:42:15.813950+0000","last_clean":"2023-07-06T21:42:15.813950+0000","last_became_active":"2023-07-06T21:42:10.886419+0000","last_became_peered":"2023-07-06T21:42:10.886419+0000","last_unstale":"2023-07-06T21:42:15.813950+0000","last_undegraded":"2023-07-06T21:42:15.813950+0000","last_fullsized":"2023-07-06T21:42:15.813950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:49.304577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750157+0000","last_change":"2023-07-06T21:42:10.470631+0000","last_active":"2023-07-06T21:42:15.750157+0000","last_peered":"2023-07-06T21:42:15.750157+0000","last_clean":"2023-07-06T21:42:15.750157+0000","last_became_active":"2023-07-06T21:42:10.470331+0000","last_became_peered":"2023-07-06T21:42:10.470331+0000","last_unstale":"2023-07-06T21:42:15.750157+0000","last_undegraded":"2023-07-06T21:42:15.750157+0000","last_fullsized":"2023-07-06T21:42:15.750157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:06.172940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302528+0000","last_change":"2023-07-06T21:42:14.905006+0000","last_active":"2023-07-06T21:42:15.302528+0000","last_peered":"2023-07-06T21:42:15.302528+0000","last_clean":"2023-07-06T21:42:15.302528+0000","last_became_active":"2023-07-06T21:42:14.904580+0000","last_became_peered":"2023-07-06T21:42:14.904580+0000","last_unstale":"2023-07-06T21:42:15.302528+0000","last_undegraded":"2023-07-06T21:42:15.302528+0000","last_fullsized":"2023-07-06T21:42:15.302528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304381+0000","last_change":"2023-07-06T21:42:10.472955+0000","last_active":"2023-07-06T21:42:15.304381+0000","last_peered":"2023-07-06T21:42:15.304381+0000","last_clean":"2023-07-06T21:42:15.304381+0000","last_became_active":"2023-07-06T21:42:10.472650+0000","last_became_peered":"2023-07-06T21:42:10.472650+0000","last_unstale":"2023-07-06T21:42:15.304381+0000","last_undegraded":"2023-07-06T21:42:15.304381+0000","last_fullsized":"2023-07-06T21:42:15.304381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:00.320476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559636+0000","last_change":"2023-07-06T21:42:10.895148+0000","last_active":"2023-07-06T21:42:15.559636+0000","last_peered":"2023-07-06T21:42:15.559636+0000","last_clean":"2023-07-06T21:42:15.559636+0000","last_became_active":"2023-07-06T21:42:10.893279+0000","last_became_peered":"2023-07-06T21:42:10.893279+0000","last_unstale":"2023-07-06T21:42:15.559636+0000","last_undegraded":"2023-07-06T21:42:15.559636+0000","last_fullsized":"2023-07-06T21:42:15.559636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:17.881222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814136+0000","last_change":"2023-07-06T21:42:14.923933+0000","last_active":"2023-07-06T21:42:15.814136+0000","last_peered":"2023-07-06T21:42:15.814136+0000","last_clean":"2023-07-06T21:42:15.814136+0000","last_became_active":"2023-07-06T21:42:14.923462+0000","last_became_peered":"2023-07-06T21:42:14.923462+0000","last_unstale":"2023-07-06T21:42:15.814136+0000","last_undegraded":"2023-07-06T21:42:15.814136+0000","last_fullsized":"2023-07-06T21:42:15.814136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:17.532639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:26.997905+0000","last_change":"2023-07-06T21:42:10.477982+0000","last_active":"2023-07-06T21:42:26.997905+0000","last_peered":"2023-07-06T21:42:26.997905+0000","last_clean":"2023-07-06T21:42:26.997905+0000","last_became_active":"2023-07-06T21:42:10.477682+0000","last_became_peered":"2023-07-06T21:42:10.477682+0000","last_unstale":"2023-07-06T21:42:26.997905+0000","last_undegraded":"2023-07-06T21:42:26.997905+0000","last_fullsized":"2023-07-06T21:42:26.997905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:36:40.587024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303762+0000","last_change":"2023-07-06T21:42:10.889884+0000","last_active":"2023-07-06T21:42:15.303762+0000","last_peered":"2023-07-06T21:42:15.303762+0000","last_clean":"2023-07-06T21:42:15.303762+0000","last_became_active":"2023-07-06T21:42:10.889573+0000","last_became_peered":"2023-07-06T21:42:10.889573+0000","last_unstale":"2023-07-06T21:42:15.303762+0000","last_undegraded":"2023-07-06T21:42:15.303762+0000","last_fullsized":"2023-07-06T21:42:15.303762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:19:13.251122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559445+0000","last_change":"2023-07-06T21:42:14.923296+0000","last_active":"2023-07-06T21:42:15.559445+0000","last_peered":"2023-07-06T21:42:15.559445+0000","last_clean":"2023-07-06T21:42:15.559445+0000","last_became_active":"2023-07-06T21:42:14.922887+0000","last_became_peered":"2023-07-06T21:42:14.922887+0000","last_unstale":"2023-07-06T21:42:15.559445+0000","last_undegraded":"2023-07-06T21:42:15.559445+0000","last_fullsized":"2023-07-06T21:42:15.559445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:04:10.970825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302823+0000","last_change":"2023-07-06T21:42:10.885592+0000","last_active":"2023-07-06T21:42:15.302823+0000","last_peered":"2023-07-06T21:42:15.302823+0000","last_clean":"2023-07-06T21:42:15.302823+0000","last_became_active":"2023-07-06T21:42:10.885320+0000","last_became_peered":"2023-07-06T21:42:10.885320+0000","last_unstale":"2023-07-06T21:42:15.302823+0000","last_undegraded":"2023-07-06T21:42:15.302823+0000","last_fullsized":"2023-07-06T21:42:15.302823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:37:33.460049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816166+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:42:15.816166+0000","last_peered":"2023-07-06T21:42:15.816166+0000","last_clean":"2023-07-06T21:42:15.816166+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:42:15.816166+0000","last_undegraded":"2023-07-06T21:42:15.816166+0000","last_fullsized":"2023-07-06T21:42:15.816166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:13:17.470539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555317+0000","last_change":"2023-07-06T21:42:10.483753+0000","last_active":"2023-07-06T21:42:15.555317+0000","last_peered":"2023-07-06T21:42:15.555317+0000","last_clean":"2023-07-06T21:42:15.555317+0000","last_became_active":"2023-07-06T21:42:10.483357+0000","last_became_peered":"2023-07-06T21:42:10.483357+0000","last_unstale":"2023-07-06T21:42:15.555317+0000","last_undegraded":"2023-07-06T21:42:15.555317+0000","last_fullsized":"2023-07-06T21:42:15.555317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:13.091304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813831+0000","last_change":"2023-07-06T21:42:14.904514+0000","last_active":"2023-07-06T21:42:15.813831+0000","last_peered":"2023-07-06T21:42:15.813831+0000","last_clean":"2023-07-06T21:42:15.813831+0000","last_became_active":"2023-07-06T21:42:14.904110+0000","last_became_peered":"2023-07-06T21:42:14.904110+0000","last_unstale":"2023-07-06T21:42:15.813831+0000","last_undegraded":"2023-07-06T21:42:15.813831+0000","last_fullsized":"2023-07-06T21:42:15.813831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:39.784637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813926+0000","last_change":"2023-07-06T21:42:10.886690+0000","last_active":"2023-07-06T21:42:15.813926+0000","last_peered":"2023-07-06T21:42:15.813926+0000","last_clean":"2023-07-06T21:42:15.813926+0000","last_became_active":"2023-07-06T21:42:10.886408+0000","last_became_peered":"2023-07-06T21:42:10.886408+0000","last_unstale":"2023-07-06T21:42:15.813926+0000","last_undegraded":"2023-07-06T21:42:15.813926+0000","last_fullsized":"2023-07-06T21:42:15.813926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:21.307899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560489+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:42:15.560489+0000","last_peered":"2023-07-06T21:42:15.560489+0000","last_clean":"2023-07-06T21:42:15.560489+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:42:15.560489+0000","last_undegraded":"2023-07-06T21:42:15.560489+0000","last_fullsized":"2023-07-06T21:42:15.560489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:32.217200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814738+0000","last_change":"2023-07-06T21:42:10.477099+0000","last_active":"2023-07-06T21:42:15.814738+0000","last_peered":"2023-07-06T21:42:15.814738+0000","last_clean":"2023-07-06T21:42:15.814738+0000","last_became_active":"2023-07-06T21:42:10.470849+0000","last_became_peered":"2023-07-06T21:42:10.470849+0000","last_unstale":"2023-07-06T21:42:15.814738+0000","last_undegraded":"2023-07-06T21:42:15.814738+0000","last_fullsized":"2023-07-06T21:42:15.814738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:01:27.903386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302507+0000","last_change":"2023-07-06T21:42:14.912597+0000","last_active":"2023-07-06T21:42:15.302507+0000","last_peered":"2023-07-06T21:42:15.302507+0000","last_clean":"2023-07-06T21:42:15.302507+0000","last_became_active":"2023-07-06T21:42:14.912117+0000","last_became_peered":"2023-07-06T21:42:14.912117+0000","last_unstale":"2023-07-06T21:42:15.302507+0000","last_undegraded":"2023-07-06T21:42:15.302507+0000","last_fullsized":"2023-07-06T21:42:15.302507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:04:25.768388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554791+0000","last_change":"2023-07-06T21:42:10.887381+0000","last_active":"2023-07-06T21:42:15.554791+0000","last_peered":"2023-07-06T21:42:15.554791+0000","last_clean":"2023-07-06T21:42:15.554791+0000","last_became_active":"2023-07-06T21:42:10.887098+0000","last_became_peered":"2023-07-06T21:42:10.887098+0000","last_unstale":"2023-07-06T21:42:15.554791+0000","last_undegraded":"2023-07-06T21:42:15.554791+0000","last_fullsized":"2023-07-06T21:42:15.554791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:22:58.629015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304566+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:42:15.304566+0000","last_peered":"2023-07-06T21:42:15.304566+0000","last_clean":"2023-07-06T21:42:15.304566+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:42:15.304566+0000","last_undegraded":"2023-07-06T21:42:15.304566+0000","last_fullsized":"2023-07-06T21:42:15.304566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:18:08.789205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560028+0000","last_change":"2023-07-06T21:42:10.470119+0000","last_active":"2023-07-06T21:42:15.560028+0000","last_peered":"2023-07-06T21:42:15.560028+0000","last_clean":"2023-07-06T21:42:15.560028+0000","last_became_active":"2023-07-06T21:42:10.469842+0000","last_became_peered":"2023-07-06T21:42:10.469842+0000","last_unstale":"2023-07-06T21:42:15.560028+0000","last_undegraded":"2023-07-06T21:42:15.560028+0000","last_fullsized":"2023-07-06T21:42:15.560028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:22:57.618655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815713+0000","last_change":"2023-07-06T21:42:14.922150+0000","last_active":"2023-07-06T21:42:15.815713+0000","last_peered":"2023-07-06T21:42:15.815713+0000","last_clean":"2023-07-06T21:42:15.815713+0000","last_became_active":"2023-07-06T21:42:14.921680+0000","last_became_peered":"2023-07-06T21:42:14.921680+0000","last_unstale":"2023-07-06T21:42:15.815713+0000","last_undegraded":"2023-07-06T21:42:15.815713+0000","last_fullsized":"2023-07-06T21:42:15.815713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:25:46.342686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559647+0000","last_change":"2023-07-06T21:42:10.895224+0000","last_active":"2023-07-06T21:42:15.559647+0000","last_peered":"2023-07-06T21:42:15.559647+0000","last_clean":"2023-07-06T21:42:15.559647+0000","last_became_active":"2023-07-06T21:42:10.893294+0000","last_became_peered":"2023-07-06T21:42:10.893294+0000","last_unstale":"2023-07-06T21:42:15.559647+0000","last_undegraded":"2023-07-06T21:42:15.559647+0000","last_fullsized":"2023-07-06T21:42:15.559647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:06:12.963913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560146+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:42:15.560146+0000","last_peered":"2023-07-06T21:42:15.560146+0000","last_clean":"2023-07-06T21:42:15.560146+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:42:15.560146+0000","last_undegraded":"2023-07-06T21:42:15.560146+0000","last_fullsized":"2023-07-06T21:42:15.560146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:26:57.147498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750089+0000","last_change":"2023-07-06T21:42:10.479311+0000","last_active":"2023-07-06T21:42:15.750089+0000","last_peered":"2023-07-06T21:42:15.750089+0000","last_clean":"2023-07-06T21:42:15.750089+0000","last_became_active":"2023-07-06T21:42:10.478999+0000","last_became_peered":"2023-07-06T21:42:10.478999+0000","last_unstale":"2023-07-06T21:42:15.750089+0000","last_undegraded":"2023-07-06T21:42:15.750089+0000","last_fullsized":"2023-07-06T21:42:15.750089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:15:16.029351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554783+0000","last_change":"2023-07-06T21:42:14.924362+0000","last_active":"2023-07-06T21:42:15.554783+0000","last_peered":"2023-07-06T21:42:15.554783+0000","last_clean":"2023-07-06T21:42:15.554783+0000","last_became_active":"2023-07-06T21:42:14.924003+0000","last_became_peered":"2023-07-06T21:42:14.924003+0000","last_unstale":"2023-07-06T21:42:15.554783+0000","last_undegraded":"2023-07-06T21:42:15.554783+0000","last_fullsized":"2023-07-06T21:42:15.554783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:30:36.626428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559964+0000","last_change":"2023-07-06T21:42:10.901083+0000","last_active":"2023-07-06T21:42:15.559964+0000","last_peered":"2023-07-06T21:42:15.559964+0000","last_clean":"2023-07-06T21:42:15.559964+0000","last_became_active":"2023-07-06T21:42:10.900454+0000","last_became_peered":"2023-07-06T21:42:10.900454+0000","last_unstale":"2023-07-06T21:42:15.559964+0000","last_undegraded":"2023-07-06T21:42:15.559964+0000","last_fullsized":"2023-07-06T21:42:15.559964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:30:33.195452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303877+0000","last_change":"2023-07-06T21:42:10.487423+0000","last_active":"2023-07-06T21:42:15.303877+0000","last_peered":"2023-07-06T21:42:15.303877+0000","last_clean":"2023-07-06T21:42:15.303877+0000","last_became_active":"2023-07-06T21:42:10.487178+0000","last_became_peered":"2023-07-06T21:42:10.487178+0000","last_unstale":"2023-07-06T21:42:15.303877+0000","last_undegraded":"2023-07-06T21:42:15.303877+0000","last_fullsized":"2023-07-06T21:42:15.303877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:27:27.820824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749519+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:42:15.749519+0000","last_peered":"2023-07-06T21:42:15.749519+0000","last_clean":"2023-07-06T21:42:15.749519+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:42:15.749519+0000","last_undegraded":"2023-07-06T21:42:15.749519+0000","last_fullsized":"2023-07-06T21:42:15.749519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:32.217200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555060+0000","last_change":"2023-07-06T21:42:14.916163+0000","last_active":"2023-07-06T21:42:15.555060+0000","last_peered":"2023-07-06T21:42:15.555060+0000","last_clean":"2023-07-06T21:42:15.555060+0000","last_became_active":"2023-07-06T21:42:14.915664+0000","last_became_peered":"2023-07-06T21:42:14.915664+0000","last_unstale":"2023-07-06T21:42:15.555060+0000","last_undegraded":"2023-07-06T21:42:15.555060+0000","last_fullsized":"2023-07-06T21:42:15.555060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:53.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.561394+0000","last_change":"2023-07-06T21:42:10.892520+0000","last_active":"2023-07-06T21:42:15.561394+0000","last_peered":"2023-07-06T21:42:15.561394+0000","last_clean":"2023-07-06T21:42:15.561394+0000","last_became_active":"2023-07-06T21:42:10.892199+0000","last_became_peered":"2023-07-06T21:42:10.892199+0000","last_unstale":"2023-07-06T21:42:15.561394+0000","last_undegraded":"2023-07-06T21:42:15.561394+0000","last_fullsized":"2023-07-06T21:42:15.561394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:03.040492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559437+0000","last_change":"2023-07-06T21:42:10.469013+0000","last_active":"2023-07-06T21:42:15.559437+0000","last_peered":"2023-07-06T21:42:15.559437+0000","last_clean":"2023-07-06T21:42:15.559437+0000","last_became_active":"2023-07-06T21:42:10.468725+0000","last_became_peered":"2023-07-06T21:42:10.468725+0000","last_unstale":"2023-07-06T21:42:15.559437+0000","last_undegraded":"2023-07-06T21:42:15.559437+0000","last_fullsized":"2023-07-06T21:42:15.559437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:20:16.016382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300174+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:42:15.300174+0000","last_peered":"2023-07-06T21:42:15.300174+0000","last_clean":"2023-07-06T21:42:15.300174+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:42:15.300174+0000","last_undegraded":"2023-07-06T21:42:15.300174+0000","last_fullsized":"2023-07-06T21:42:15.300174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:47:26.819677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300599+0000","last_change":"2023-07-06T21:42:14.924328+0000","last_active":"2023-07-06T21:42:15.300599+0000","last_peered":"2023-07-06T21:42:15.300599+0000","last_clean":"2023-07-06T21:42:15.300599+0000","last_became_active":"2023-07-06T21:42:14.923899+0000","last_became_peered":"2023-07-06T21:42:14.923899+0000","last_unstale":"2023-07-06T21:42:15.300599+0000","last_undegraded":"2023-07-06T21:42:15.300599+0000","last_fullsized":"2023-07-06T21:42:15.300599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:54:26.653941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555110+0000","last_change":"2023-07-06T21:42:10.903093+0000","last_active":"2023-07-06T21:42:15.555110+0000","last_peered":"2023-07-06T21:42:15.555110+0000","last_clean":"2023-07-06T21:42:15.555110+0000","last_became_active":"2023-07-06T21:42:10.902859+0000","last_became_peered":"2023-07-06T21:42:10.902859+0000","last_unstale":"2023-07-06T21:42:15.555110+0000","last_undegraded":"2023-07-06T21:42:15.555110+0000","last_fullsized":"2023-07-06T21:42:15.555110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:21.307899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554542+0000","last_change":"2023-07-06T21:42:10.483697+0000","last_active":"2023-07-06T21:42:15.554542+0000","last_peered":"2023-07-06T21:42:15.554542+0000","last_clean":"2023-07-06T21:42:15.554542+0000","last_became_active":"2023-07-06T21:42:10.483326+0000","last_became_peered":"2023-07-06T21:42:10.483326+0000","last_unstale":"2023-07-06T21:42:15.554542+0000","last_undegraded":"2023-07-06T21:42:15.554542+0000","last_fullsized":"2023-07-06T21:42:15.554542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:06:11.953553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302786+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:42:15.302786+0000","last_peered":"2023-07-06T21:42:15.302786+0000","last_clean":"2023-07-06T21:42:15.302786+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:42:15.302786+0000","last_undegraded":"2023-07-06T21:42:15.302786+0000","last_fullsized":"2023-07-06T21:42:15.302786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:43.907805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749963+0000","last_change":"2023-07-06T21:42:14.922451+0000","last_active":"2023-07-06T21:42:15.749963+0000","last_peered":"2023-07-06T21:42:15.749963+0000","last_clean":"2023-07-06T21:42:15.749963+0000","last_became_active":"2023-07-06T21:42:14.922047+0000","last_became_peered":"2023-07-06T21:42:14.922047+0000","last_unstale":"2023-07-06T21:42:15.749963+0000","last_undegraded":"2023-07-06T21:42:15.749963+0000","last_fullsized":"2023-07-06T21:42:15.749963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:04.761811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.816094+0000","last_change":"2023-07-06T21:42:10.892446+0000","last_active":"2023-07-06T21:42:15.816094+0000","last_peered":"2023-07-06T21:42:15.816094+0000","last_clean":"2023-07-06T21:42:15.816094+0000","last_became_active":"2023-07-06T21:42:10.892161+0000","last_became_peered":"2023-07-06T21:42:10.892161+0000","last_unstale":"2023-07-06T21:42:15.816094+0000","last_undegraded":"2023-07-06T21:42:15.816094+0000","last_fullsized":"2023-07-06T21:42:15.816094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:16:28.548015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814063+0000","last_change":"2023-07-06T21:42:10.477978+0000","last_active":"2023-07-06T21:42:15.814063+0000","last_peered":"2023-07-06T21:42:15.814063+0000","last_clean":"2023-07-06T21:42:15.814063+0000","last_became_active":"2023-07-06T21:42:10.477741+0000","last_became_peered":"2023-07-06T21:42:10.477741+0000","last_unstale":"2023-07-06T21:42:15.814063+0000","last_undegraded":"2023-07-06T21:42:15.814063+0000","last_fullsized":"2023-07-06T21:42:15.814063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:53.942428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749582+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:42:15.749582+0000","last_peered":"2023-07-06T21:42:15.749582+0000","last_clean":"2023-07-06T21:42:15.749582+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:42:15.749582+0000","last_undegraded":"2023-07-06T21:42:15.749582+0000","last_fullsized":"2023-07-06T21:42:15.749582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:15.258138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302930+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:42:15.302930+0000","last_peered":"2023-07-06T21:42:15.302930+0000","last_clean":"2023-07-06T21:42:15.302930+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:42:15.302930+0000","last_undegraded":"2023-07-06T21:42:15.302930+0000","last_fullsized":"2023-07-06T21:42:15.302930+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:25.978867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304188+0000","last_change":"2023-07-06T21:42:14.922337+0000","last_active":"2023-07-06T21:42:15.304188+0000","last_peered":"2023-07-06T21:42:15.304188+0000","last_clean":"2023-07-06T21:42:15.304188+0000","last_became_active":"2023-07-06T21:42:14.921707+0000","last_became_peered":"2023-07-06T21:42:14.921707+0000","last_unstale":"2023-07-06T21:42:15.304188+0000","last_undegraded":"2023-07-06T21:42:15.304188+0000","last_fullsized":"2023-07-06T21:42:15.304188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:10.982651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.561390+0000","last_change":"2023-07-06T21:42:10.895068+0000","last_active":"2023-07-06T21:42:15.561390+0000","last_peered":"2023-07-06T21:42:15.561390+0000","last_clean":"2023-07-06T21:42:15.561390+0000","last_became_active":"2023-07-06T21:42:10.893118+0000","last_became_peered":"2023-07-06T21:42:10.893118+0000","last_unstale":"2023-07-06T21:42:15.561390+0000","last_undegraded":"2023-07-06T21:42:15.561390+0000","last_fullsized":"2023-07-06T21:42:15.561390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:49.304577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814064+0000","last_change":"2023-07-06T21:42:10.477723+0000","last_active":"2023-07-06T21:42:15.814064+0000","last_peered":"2023-07-06T21:42:15.814064+0000","last_clean":"2023-07-06T21:42:15.814064+0000","last_became_active":"2023-07-06T21:42:10.477458+0000","last_became_peered":"2023-07-06T21:42:10.477458+0000","last_unstale":"2023-07-06T21:42:15.814064+0000","last_undegraded":"2023-07-06T21:42:15.814064+0000","last_fullsized":"2023-07-06T21:42:15.814064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:37.773277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304476+0000","last_change":"2023-07-06T21:42:14.916934+0000","last_active":"2023-07-06T21:42:15.304476+0000","last_peered":"2023-07-06T21:42:15.304476+0000","last_clean":"2023-07-06T21:42:15.304476+0000","last_became_active":"2023-07-06T21:42:14.916426+0000","last_became_peered":"2023-07-06T21:42:14.916426+0000","last_unstale":"2023-07-06T21:42:15.304476+0000","last_undegraded":"2023-07-06T21:42:15.304476+0000","last_fullsized":"2023-07-06T21:42:15.304476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:59:26.819910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304570+0000","last_change":"2023-07-06T21:42:10.883910+0000","last_active":"2023-07-06T21:42:15.304570+0000","last_peered":"2023-07-06T21:42:15.304570+0000","last_clean":"2023-07-06T21:42:15.304570+0000","last_became_active":"2023-07-06T21:42:10.881813+0000","last_became_peered":"2023-07-06T21:42:10.881813+0000","last_unstale":"2023-07-06T21:42:15.304570+0000","last_undegraded":"2023-07-06T21:42:15.304570+0000","last_fullsized":"2023-07-06T21:42:15.304570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:35:26.163278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302957+0000","last_change":"2023-07-06T21:42:10.476748+0000","last_active":"2023-07-06T21:42:15.302957+0000","last_peered":"2023-07-06T21:42:15.302957+0000","last_clean":"2023-07-06T21:42:15.302957+0000","last_became_active":"2023-07-06T21:42:10.476481+0000","last_became_peered":"2023-07-06T21:42:10.476481+0000","last_unstale":"2023-07-06T21:42:15.302957+0000","last_undegraded":"2023-07-06T21:42:15.302957+0000","last_fullsized":"2023-07-06T21:42:15.302957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:44:25.975479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749892+0000","last_change":"2023-07-06T21:42:14.921688+0000","last_active":"2023-07-06T21:42:15.749892+0000","last_peered":"2023-07-06T21:42:15.749892+0000","last_clean":"2023-07-06T21:42:15.749892+0000","last_became_active":"2023-07-06T21:42:14.921265+0000","last_became_peered":"2023-07-06T21:42:14.921265+0000","last_unstale":"2023-07-06T21:42:15.749892+0000","last_undegraded":"2023-07-06T21:42:15.749892+0000","last_fullsized":"2023-07-06T21:42:15.749892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:39.042261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304373+0000","last_change":"2023-07-06T21:42:10.878847+0000","last_active":"2023-07-06T21:42:15.304373+0000","last_peered":"2023-07-06T21:42:15.304373+0000","last_clean":"2023-07-06T21:42:15.304373+0000","last_became_active":"2023-07-06T21:42:10.878527+0000","last_became_peered":"2023-07-06T21:42:10.878527+0000","last_unstale":"2023-07-06T21:42:15.304373+0000","last_undegraded":"2023-07-06T21:42:15.304373+0000","last_fullsized":"2023-07-06T21:42:15.304373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:16:10.597271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815959+0000","last_change":"2023-07-06T21:42:10.477879+0000","last_active":"2023-07-06T21:42:15.815959+0000","last_peered":"2023-07-06T21:42:15.815959+0000","last_clean":"2023-07-06T21:42:15.815959+0000","last_became_active":"2023-07-06T21:42:10.477581+0000","last_became_peered":"2023-07-06T21:42:10.477581+0000","last_unstale":"2023-07-06T21:42:15.815959+0000","last_undegraded":"2023-07-06T21:42:15.815959+0000","last_fullsized":"2023-07-06T21:42:15.815959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:44:19.088837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.559764+0000","last_change":"2023-07-06T21:42:14.911992+0000","last_active":"2023-07-06T21:42:15.559764+0000","last_peered":"2023-07-06T21:42:15.559764+0000","last_clean":"2023-07-06T21:42:15.559764+0000","last_became_active":"2023-07-06T21:42:14.911568+0000","last_became_peered":"2023-07-06T21:42:14.911568+0000","last_unstale":"2023-07-06T21:42:15.559764+0000","last_undegraded":"2023-07-06T21:42:15.559764+0000","last_fullsized":"2023-07-06T21:42:15.559764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:20:11.252422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303859+0000","last_change":"2023-07-06T21:42:10.883052+0000","last_active":"2023-07-06T21:42:15.303859+0000","last_peered":"2023-07-06T21:42:15.303859+0000","last_clean":"2023-07-06T21:42:15.303859+0000","last_became_active":"2023-07-06T21:42:10.882252+0000","last_became_peered":"2023-07-06T21:42:10.882252+0000","last_unstale":"2023-07-06T21:42:15.303859+0000","last_undegraded":"2023-07-06T21:42:15.303859+0000","last_fullsized":"2023-07-06T21:42:15.303859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:24:28.967556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814372+0000","last_change":"2023-07-06T21:42:10.483767+0000","last_active":"2023-07-06T21:42:15.814372+0000","last_peered":"2023-07-06T21:42:15.814372+0000","last_clean":"2023-07-06T21:42:15.814372+0000","last_became_active":"2023-07-06T21:42:10.483507+0000","last_became_peered":"2023-07-06T21:42:10.483507+0000","last_unstale":"2023-07-06T21:42:15.814372+0000","last_undegraded":"2023-07-06T21:42:15.814372+0000","last_fullsized":"2023-07-06T21:42:15.814372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:18:13.828606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300565+0000","last_change":"2023-07-06T21:42:14.923194+0000","last_active":"2023-07-06T21:42:15.300565+0000","last_peered":"2023-07-06T21:42:15.300565+0000","last_clean":"2023-07-06T21:42:15.300565+0000","last_became_active":"2023-07-06T21:42:14.922520+0000","last_became_peered":"2023-07-06T21:42:14.922520+0000","last_unstale":"2023-07-06T21:42:15.300565+0000","last_undegraded":"2023-07-06T21:42:15.300565+0000","last_fullsized":"2023-07-06T21:42:15.300565+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:03:38.532050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554692+0000","last_change":"2023-07-06T21:42:10.896528+0000","last_active":"2023-07-06T21:42:15.554692+0000","last_peered":"2023-07-06T21:42:15.554692+0000","last_clean":"2023-07-06T21:42:15.554692+0000","last_became_active":"2023-07-06T21:42:10.896260+0000","last_became_peered":"2023-07-06T21:42:10.896260+0000","last_unstale":"2023-07-06T21:42:15.554692+0000","last_undegraded":"2023-07-06T21:42:15.554692+0000","last_fullsized":"2023-07-06T21:42:15.554692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:20:07.821447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749689+0000","last_change":"2023-07-06T21:42:10.467430+0000","last_active":"2023-07-06T21:42:15.749689+0000","last_peered":"2023-07-06T21:42:15.749689+0000","last_clean":"2023-07-06T21:42:15.749689+0000","last_became_active":"2023-07-06T21:42:10.467147+0000","last_became_peered":"2023-07-06T21:42:10.467147+0000","last_unstale":"2023-07-06T21:42:15.749689+0000","last_undegraded":"2023-07-06T21:42:15.749689+0000","last_fullsized":"2023-07-06T21:42:15.749689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:48.294217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300352+0000","last_change":"2023-07-06T21:42:14.911007+0000","last_active":"2023-07-06T21:42:15.300352+0000","last_peered":"2023-07-06T21:42:15.300352+0000","last_clean":"2023-07-06T21:42:15.300352+0000","last_became_active":"2023-07-06T21:42:14.910352+0000","last_became_peered":"2023-07-06T21:42:14.910352+0000","last_unstale":"2023-07-06T21:42:15.300352+0000","last_undegraded":"2023-07-06T21:42:15.300352+0000","last_fullsized":"2023-07-06T21:42:15.300352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:32:51.766704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815617+0000","last_change":"2023-07-06T21:42:10.903614+0000","last_active":"2023-07-06T21:42:15.815617+0000","last_peered":"2023-07-06T21:42:15.815617+0000","last_clean":"2023-07-06T21:42:15.815617+0000","last_became_active":"2023-07-06T21:42:10.903258+0000","last_became_peered":"2023-07-06T21:42:10.903258+0000","last_unstale":"2023-07-06T21:42:15.815617+0000","last_undegraded":"2023-07-06T21:42:15.815617+0000","last_fullsized":"2023-07-06T21:42:15.815617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:58:56.102496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304481+0000","last_change":"2023-07-06T21:42:10.472497+0000","last_active":"2023-07-06T21:42:15.304481+0000","last_peered":"2023-07-06T21:42:15.304481+0000","last_clean":"2023-07-06T21:42:15.304481+0000","last_became_active":"2023-07-06T21:42:10.470849+0000","last_became_peered":"2023-07-06T21:42:10.470849+0000","last_unstale":"2023-07-06T21:42:15.304481+0000","last_undegraded":"2023-07-06T21:42:15.304481+0000","last_fullsized":"2023-07-06T21:42:15.304481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:28.818997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300483+0000","last_change":"2023-07-06T21:42:14.927494+0000","last_active":"2023-07-06T21:42:15.300483+0000","last_peered":"2023-07-06T21:42:15.300483+0000","last_clean":"2023-07-06T21:42:15.300483+0000","last_became_active":"2023-07-06T21:42:14.927091+0000","last_became_peered":"2023-07-06T21:42:14.927091+0000","last_unstale":"2023-07-06T21:42:15.300483+0000","last_undegraded":"2023-07-06T21:42:15.300483+0000","last_fullsized":"2023-07-06T21:42:15.300483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:28:09.964167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302682+0000","last_change":"2023-07-06T21:42:10.900898+0000","last_active":"2023-07-06T21:42:15.302682+0000","last_peered":"2023-07-06T21:42:15.302682+0000","last_clean":"2023-07-06T21:42:15.302682+0000","last_became_active":"2023-07-06T21:42:10.900581+0000","last_became_peered":"2023-07-06T21:42:10.900581+0000","last_unstale":"2023-07-06T21:42:15.302682+0000","last_undegraded":"2023-07-06T21:42:15.302682+0000","last_fullsized":"2023-07-06T21:42:15.302682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:06:29.601787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304774+0000","last_change":"2023-07-06T21:42:10.481348+0000","last_active":"2023-07-06T21:42:15.304774+0000","last_peered":"2023-07-06T21:42:15.304774+0000","last_clean":"2023-07-06T21:42:15.304774+0000","last_became_active":"2023-07-06T21:42:10.480900+0000","last_became_peered":"2023-07-06T21:42:10.480900+0000","last_unstale":"2023-07-06T21:42:15.304774+0000","last_undegraded":"2023-07-06T21:42:15.304774+0000","last_fullsized":"2023-07-06T21:42:15.304774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:25.448002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300082+0000","last_change":"2023-07-06T21:42:14.910719+0000","last_active":"2023-07-06T21:42:15.300082+0000","last_peered":"2023-07-06T21:42:15.300082+0000","last_clean":"2023-07-06T21:42:15.300082+0000","last_became_active":"2023-07-06T21:42:14.910213+0000","last_became_peered":"2023-07-06T21:42:14.910213+0000","last_unstale":"2023-07-06T21:42:15.300082+0000","last_undegraded":"2023-07-06T21:42:15.300082+0000","last_fullsized":"2023-07-06T21:42:15.300082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:11:34.554961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749271+0000","last_change":"2023-07-06T21:42:10.899721+0000","last_active":"2023-07-06T21:42:15.749271+0000","last_peered":"2023-07-06T21:42:15.749271+0000","last_clean":"2023-07-06T21:42:15.749271+0000","last_became_active":"2023-07-06T21:42:10.896792+0000","last_became_peered":"2023-07-06T21:42:10.896792+0000","last_unstale":"2023-07-06T21:42:15.749271+0000","last_undegraded":"2023-07-06T21:42:15.749271+0000","last_fullsized":"2023-07-06T21:42:15.749271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:13:36.353661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304883+0000","last_change":"2023-07-06T21:42:10.479043+0000","last_active":"2023-07-06T21:42:15.304883+0000","last_peered":"2023-07-06T21:42:15.304883+0000","last_clean":"2023-07-06T21:42:15.304883+0000","last_became_active":"2023-07-06T21:42:10.478756+0000","last_became_peered":"2023-07-06T21:42:10.478756+0000","last_unstale":"2023-07-06T21:42:15.304883+0000","last_undegraded":"2023-07-06T21:42:15.304883+0000","last_fullsized":"2023-07-06T21:42:15.304883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:15:16.029351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303391+0000","last_change":"2023-07-06T21:42:14.903165+0000","last_active":"2023-07-06T21:42:15.303391+0000","last_peered":"2023-07-06T21:42:15.303391+0000","last_clean":"2023-07-06T21:42:15.303391+0000","last_became_active":"2023-07-06T21:42:14.902418+0000","last_became_peered":"2023-07-06T21:42:14.902418+0000","last_unstale":"2023-07-06T21:42:15.303391+0000","last_undegraded":"2023-07-06T21:42:15.303391+0000","last_fullsized":"2023-07-06T21:42:15.303391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:06.471467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749820+0000","last_change":"2023-07-06T21:42:14.923545+0000","last_active":"2023-07-06T21:42:15.749820+0000","last_peered":"2023-07-06T21:42:15.749820+0000","last_clean":"2023-07-06T21:42:15.749820+0000","last_became_active":"2023-07-06T21:42:14.922278+0000","last_became_peered":"2023-07-06T21:42:14.922278+0000","last_unstale":"2023-07-06T21:42:15.749820+0000","last_undegraded":"2023-07-06T21:42:15.749820+0000","last_fullsized":"2023-07-06T21:42:15.749820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:58.383763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815663+0000","last_change":"2023-07-06T21:42:10.477503+0000","last_active":"2023-07-06T21:42:15.815663+0000","last_peered":"2023-07-06T21:42:15.815663+0000","last_clean":"2023-07-06T21:42:15.815663+0000","last_became_active":"2023-07-06T21:42:10.477166+0000","last_became_peered":"2023-07-06T21:42:10.477166+0000","last_unstale":"2023-07-06T21:42:15.815663+0000","last_undegraded":"2023-07-06T21:42:15.815663+0000","last_fullsized":"2023-07-06T21:42:15.815663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:25:12.585223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814704+0000","last_change":"2023-07-06T21:42:10.897513+0000","last_active":"2023-07-06T21:42:15.814704+0000","last_peered":"2023-07-06T21:42:15.814704+0000","last_clean":"2023-07-06T21:42:15.814704+0000","last_became_active":"2023-07-06T21:42:10.897114+0000","last_became_peered":"2023-07-06T21:42:10.897114+0000","last_unstale":"2023-07-06T21:42:15.814704+0000","last_undegraded":"2023-07-06T21:42:15.814704+0000","last_fullsized":"2023-07-06T21:42:15.814704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:39:47.681666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814620+0000","last_change":"2023-07-06T21:42:14.904372+0000","last_active":"2023-07-06T21:42:15.814620+0000","last_peered":"2023-07-06T21:42:15.814620+0000","last_clean":"2023-07-06T21:42:15.814620+0000","last_became_active":"2023-07-06T21:42:14.904023+0000","last_became_peered":"2023-07-06T21:42:14.904023+0000","last_unstale":"2023-07-06T21:42:15.814620+0000","last_undegraded":"2023-07-06T21:42:15.814620+0000","last_fullsized":"2023-07-06T21:42:15.814620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:10.614275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303576+0000","last_change":"2023-07-06T21:42:10.478297+0000","last_active":"2023-07-06T21:42:15.303576+0000","last_peered":"2023-07-06T21:42:15.303576+0000","last_clean":"2023-07-06T21:42:15.303576+0000","last_became_active":"2023-07-06T21:42:10.478050+0000","last_became_peered":"2023-07-06T21:42:10.478050+0000","last_unstale":"2023-07-06T21:42:15.303576+0000","last_undegraded":"2023-07-06T21:42:15.303576+0000","last_fullsized":"2023-07-06T21:42:15.303576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:53.942428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555359+0000","last_change":"2023-07-06T21:42:10.883887+0000","last_active":"2023-07-06T21:42:15.555359+0000","last_peered":"2023-07-06T21:42:15.555359+0000","last_clean":"2023-07-06T21:42:15.555359+0000","last_became_active":"2023-07-06T21:42:10.883644+0000","last_became_peered":"2023-07-06T21:42:10.883644+0000","last_unstale":"2023-07-06T21:42:15.555359+0000","last_undegraded":"2023-07-06T21:42:15.555359+0000","last_fullsized":"2023-07-06T21:42:15.555359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:07.551676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554791+0000","last_change":"2023-07-06T21:42:10.476173+0000","last_active":"2023-07-06T21:42:15.554791+0000","last_peered":"2023-07-06T21:42:15.554791+0000","last_clean":"2023-07-06T21:42:15.554791+0000","last_became_active":"2023-07-06T21:42:10.475802+0000","last_became_peered":"2023-07-06T21:42:10.475802+0000","last_unstale":"2023-07-06T21:42:15.554791+0000","last_undegraded":"2023-07-06T21:42:15.554791+0000","last_fullsized":"2023-07-06T21:42:15.554791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:39.285403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749898+0000","last_change":"2023-07-06T21:42:10.905138+0000","last_active":"2023-07-06T21:42:15.749898+0000","last_peered":"2023-07-06T21:42:15.749898+0000","last_clean":"2023-07-06T21:42:15.749898+0000","last_became_active":"2023-07-06T21:42:10.904460+0000","last_became_peered":"2023-07-06T21:42:10.904460+0000","last_unstale":"2023-07-06T21:42:15.749898+0000","last_undegraded":"2023-07-06T21:42:15.749898+0000","last_fullsized":"2023-07-06T21:42:15.749898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:07.551676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814399+0000","last_change":"2023-07-06T21:42:14.906570+0000","last_active":"2023-07-06T21:42:15.814399+0000","last_peered":"2023-07-06T21:42:15.814399+0000","last_clean":"2023-07-06T21:42:15.814399+0000","last_became_active":"2023-07-06T21:42:14.906136+0000","last_became_peered":"2023-07-06T21:42:14.906136+0000","last_unstale":"2023-07-06T21:42:15.814399+0000","last_undegraded":"2023-07-06T21:42:15.814399+0000","last_fullsized":"2023-07-06T21:42:15.814399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:33.260332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304098+0000","last_change":"2023-07-06T21:42:10.478474+0000","last_active":"2023-07-06T21:42:15.304098+0000","last_peered":"2023-07-06T21:42:15.304098+0000","last_clean":"2023-07-06T21:42:15.304098+0000","last_became_active":"2023-07-06T21:42:10.478162+0000","last_became_peered":"2023-07-06T21:42:10.478162+0000","last_unstale":"2023-07-06T21:42:15.304098+0000","last_undegraded":"2023-07-06T21:42:15.304098+0000","last_fullsized":"2023-07-06T21:42:15.304098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:09.427015+0000","last_clean_scrub_stamp":"2023-07-06T21:42:09.427015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:34.600926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814456+0000","last_change":"2023-07-06T21:42:10.903800+0000","last_active":"2023-07-06T21:42:15.814456+0000","last_peered":"2023-07-06T21:42:15.814456+0000","last_clean":"2023-07-06T21:42:15.814456+0000","last_became_active":"2023-07-06T21:42:10.903469+0000","last_became_peered":"2023-07-06T21:42:10.903469+0000","last_unstale":"2023-07-06T21:42:15.814456+0000","last_undegraded":"2023-07-06T21:42:15.814456+0000","last_fullsized":"2023-07-06T21:42:15.814456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:26.458362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749752+0000","last_change":"2023-07-06T21:42:14.916210+0000","last_active":"2023-07-06T21:42:15.749752+0000","last_peered":"2023-07-06T21:42:15.749752+0000","last_clean":"2023-07-06T21:42:15.749752+0000","last_became_active":"2023-07-06T21:42:14.915845+0000","last_became_peered":"2023-07-06T21:42:14.915845+0000","last_unstale":"2023-07-06T21:42:15.749752+0000","last_undegraded":"2023-07-06T21:42:15.749752+0000","last_fullsized":"2023-07-06T21:42:15.749752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:13.868350+0000","last_clean_scrub_stamp":"2023-07-06T21:42:13.868350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:42.214612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815466+0000","last_change":"2023-07-06T21:42:10.887152+0000","last_active":"2023-07-06T21:42:15.815466+0000","last_peered":"2023-07-06T21:42:15.815466+0000","last_clean":"2023-07-06T21:42:15.815466+0000","last_became_active":"2023-07-06T21:42:10.881872+0000","last_became_peered":"2023-07-06T21:42:10.881872+0000","last_unstale":"2023-07-06T21:42:15.815466+0000","last_undegraded":"2023-07-06T21:42:15.815466+0000","last_fullsized":"2023-07-06T21:42:15.815466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:18:00.557093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813877+0000","last_change":"2023-07-06T21:42:10.899839+0000","last_active":"2023-07-06T21:42:15.813877+0000","last_peered":"2023-07-06T21:42:15.813877+0000","last_clean":"2023-07-06T21:42:15.813877+0000","last_became_active":"2023-07-06T21:42:10.899525+0000","last_became_peered":"2023-07-06T21:42:10.899525+0000","last_unstale":"2023-07-06T21:42:15.813877+0000","last_undegraded":"2023-07-06T21:42:15.813877+0000","last_fullsized":"2023-07-06T21:42:15.813877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:38.266961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303319+0000","last_change":"2023-07-06T21:42:10.893778+0000","last_active":"2023-07-06T21:42:15.303319+0000","last_peered":"2023-07-06T21:42:15.303319+0000","last_clean":"2023-07-06T21:42:15.303319+0000","last_became_active":"2023-07-06T21:42:10.893495+0000","last_became_peered":"2023-07-06T21:42:10.893495+0000","last_unstale":"2023-07-06T21:42:15.303319+0000","last_undegraded":"2023-07-06T21:42:15.303319+0000","last_fullsized":"2023-07-06T21:42:15.303319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:05:56.844228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.814245+0000","last_change":"2023-07-06T21:42:10.898297+0000","last_active":"2023-07-06T21:42:15.814245+0000","last_peered":"2023-07-06T21:42:15.814245+0000","last_clean":"2023-07-06T21:42:15.814245+0000","last_became_active":"2023-07-06T21:42:10.897968+0000","last_became_peered":"2023-07-06T21:42:10.897968+0000","last_unstale":"2023-07-06T21:42:15.814245+0000","last_undegraded":"2023-07-06T21:42:15.814245+0000","last_fullsized":"2023-07-06T21:42:15.814245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:07.551676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560074+0000","last_change":"2023-07-06T21:42:10.900842+0000","last_active":"2023-07-06T21:42:15.560074+0000","last_peered":"2023-07-06T21:42:15.560074+0000","last_clean":"2023-07-06T21:42:15.560074+0000","last_became_active":"2023-07-06T21:42:10.900437+0000","last_became_peered":"2023-07-06T21:42:10.900437+0000","last_unstale":"2023-07-06T21:42:15.560074+0000","last_undegraded":"2023-07-06T21:42:15.560074+0000","last_fullsized":"2023-07-06T21:42:15.560074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:40.295763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749841+0000","last_change":"2023-07-06T21:42:10.905321+0000","last_active":"2023-07-06T21:42:15.749841+0000","last_peered":"2023-07-06T21:42:15.749841+0000","last_clean":"2023-07-06T21:42:15.749841+0000","last_became_active":"2023-07-06T21:42:10.904814+0000","last_became_peered":"2023-07-06T21:42:10.904814+0000","last_unstale":"2023-07-06T21:42:15.749841+0000","last_undegraded":"2023-07-06T21:42:15.749841+0000","last_fullsized":"2023-07-06T21:42:15.749841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:14.101664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.560324+0000","last_change":"2023-07-06T21:42:10.902809+0000","last_active":"2023-07-06T21:42:15.560324+0000","last_peered":"2023-07-06T21:42:15.560324+0000","last_clean":"2023-07-06T21:42:15.560324+0000","last_became_active":"2023-07-06T21:42:10.902527+0000","last_became_peered":"2023-07-06T21:42:10.902527+0000","last_unstale":"2023-07-06T21:42:15.560324+0000","last_undegraded":"2023-07-06T21:42:15.560324+0000","last_fullsized":"2023-07-06T21:42:15.560324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:49.957566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.561334+0000","last_change":"2023-07-06T21:42:10.896398+0000","last_active":"2023-07-06T21:42:15.561334+0000","last_peered":"2023-07-06T21:42:15.561334+0000","last_clean":"2023-07-06T21:42:15.561334+0000","last_became_active":"2023-07-06T21:42:10.896054+0000","last_became_peered":"2023-07-06T21:42:10.896054+0000","last_unstale":"2023-07-06T21:42:15.561334+0000","last_undegraded":"2023-07-06T21:42:15.561334+0000","last_fullsized":"2023-07-06T21:42:15.561334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:21.307899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302771+0000","last_change":"2023-07-06T21:42:10.893870+0000","last_active":"2023-07-06T21:42:15.302771+0000","last_peered":"2023-07-06T21:42:15.302771+0000","last_clean":"2023-07-06T21:42:15.302771+0000","last_became_active":"2023-07-06T21:42:10.888026+0000","last_became_peered":"2023-07-06T21:42:10.888026+0000","last_unstale":"2023-07-06T21:42:15.302771+0000","last_undegraded":"2023-07-06T21:42:15.302771+0000","last_fullsized":"2023-07-06T21:42:15.302771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.813817+0000","last_change":"2023-07-06T21:42:10.885134+0000","last_active":"2023-07-06T21:42:15.813817+0000","last_peered":"2023-07-06T21:42:15.813817+0000","last_clean":"2023-07-06T21:42:15.813817+0000","last_became_active":"2023-07-06T21:42:10.884849+0000","last_became_peered":"2023-07-06T21:42:10.884849+0000","last_unstale":"2023-07-06T21:42:15.813817+0000","last_undegraded":"2023-07-06T21:42:15.813817+0000","last_fullsized":"2023-07-06T21:42:15.813817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.554548+0000","last_change":"2023-07-06T21:42:10.902317+0000","last_active":"2023-07-06T21:42:15.554548+0000","last_peered":"2023-07-06T21:42:15.554548+0000","last_clean":"2023-07-06T21:42:15.554548+0000","last_became_active":"2023-07-06T21:42:10.902008+0000","last_became_peered":"2023-07-06T21:42:10.902008+0000","last_unstale":"2023-07-06T21:42:15.554548+0000","last_undegraded":"2023-07-06T21:42:15.554548+0000","last_fullsized":"2023-07-06T21:42:15.554548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:17.881222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304038+0000","last_change":"2023-07-06T21:42:10.894288+0000","last_active":"2023-07-06T21:42:15.304038+0000","last_peered":"2023-07-06T21:42:15.304038+0000","last_clean":"2023-07-06T21:42:15.304038+0000","last_became_active":"2023-07-06T21:42:10.880077+0000","last_became_peered":"2023-07-06T21:42:10.880077+0000","last_unstale":"2023-07-06T21:42:15.304038+0000","last_undegraded":"2023-07-06T21:42:15.304038+0000","last_fullsized":"2023-07-06T21:42:15.304038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:14.101664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303738+0000","last_change":"2023-07-06T21:42:10.894314+0000","last_active":"2023-07-06T21:42:15.303738+0000","last_peered":"2023-07-06T21:42:15.303738+0000","last_clean":"2023-07-06T21:42:15.303738+0000","last_became_active":"2023-07-06T21:42:10.894014+0000","last_became_peered":"2023-07-06T21:42:10.894014+0000","last_unstale":"2023-07-06T21:42:15.303738+0000","last_undegraded":"2023-07-06T21:42:15.303738+0000","last_fullsized":"2023-07-06T21:42:15.303738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:38:49.964001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300620+0000","last_change":"2023-07-06T21:42:10.887468+0000","last_active":"2023-07-06T21:42:15.300620+0000","last_peered":"2023-07-06T21:42:15.300620+0000","last_clean":"2023-07-06T21:42:15.300620+0000","last_became_active":"2023-07-06T21:42:10.887178+0000","last_became_peered":"2023-07-06T21:42:10.887178+0000","last_unstale":"2023-07-06T21:42:15.300620+0000","last_undegraded":"2023-07-06T21:42:15.300620+0000","last_fullsized":"2023-07-06T21:42:15.300620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:48:23.869797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304224+0000","last_change":"2023-07-06T21:42:10.879664+0000","last_active":"2023-07-06T21:42:15.304224+0000","last_peered":"2023-07-06T21:42:15.304224+0000","last_clean":"2023-07-06T21:42:15.304224+0000","last_became_active":"2023-07-06T21:42:10.879395+0000","last_became_peered":"2023-07-06T21:42:10.879395+0000","last_unstale":"2023-07-06T21:42:15.304224+0000","last_undegraded":"2023-07-06T21:42:15.304224+0000","last_fullsized":"2023-07-06T21:42:15.304224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:52:32.495454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555257+0000","last_change":"2023-07-06T21:42:10.882880+0000","last_active":"2023-07-06T21:42:15.555257+0000","last_peered":"2023-07-06T21:42:15.555257+0000","last_clean":"2023-07-06T21:42:15.555257+0000","last_became_active":"2023-07-06T21:42:10.882651+0000","last_became_peered":"2023-07-06T21:42:10.882651+0000","last_unstale":"2023-07-06T21:42:15.555257+0000","last_undegraded":"2023-07-06T21:42:15.555257+0000","last_fullsized":"2023-07-06T21:42:15.555257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:54.952788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.302546+0000","last_change":"2023-07-06T21:42:10.878440+0000","last_active":"2023-07-06T21:42:15.302546+0000","last_peered":"2023-07-06T21:42:15.302546+0000","last_clean":"2023-07-06T21:42:15.302546+0000","last_became_active":"2023-07-06T21:42:10.878108+0000","last_became_peered":"2023-07-06T21:42:10.878108+0000","last_unstale":"2023-07-06T21:42:15.302546+0000","last_undegraded":"2023-07-06T21:42:15.302546+0000","last_fullsized":"2023-07-06T21:42:15.302546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:23:26.016221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303514+0000","last_change":"2023-07-06T21:42:10.902391+0000","last_active":"2023-07-06T21:42:15.303514+0000","last_peered":"2023-07-06T21:42:15.303514+0000","last_clean":"2023-07-06T21:42:15.303514+0000","last_became_active":"2023-07-06T21:42:10.902167+0000","last_became_peered":"2023-07-06T21:42:10.902167+0000","last_unstale":"2023-07-06T21:42:15.303514+0000","last_undegraded":"2023-07-06T21:42:15.303514+0000","last_fullsized":"2023-07-06T21:42:15.303514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:59:38.783636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749382+0000","last_change":"2023-07-06T21:42:10.891440+0000","last_active":"2023-07-06T21:42:15.749382+0000","last_peered":"2023-07-06T21:42:15.749382+0000","last_clean":"2023-07-06T21:42:15.749382+0000","last_became_active":"2023-07-06T21:42:10.891154+0000","last_became_peered":"2023-07-06T21:42:10.891154+0000","last_unstale":"2023-07-06T21:42:15.749382+0000","last_undegraded":"2023-07-06T21:42:15.749382+0000","last_fullsized":"2023-07-06T21:42:15.749382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300255+0000","last_change":"2023-07-06T21:42:10.875691+0000","last_active":"2023-07-06T21:42:15.300255+0000","last_peered":"2023-07-06T21:42:15.300255+0000","last_clean":"2023-07-06T21:42:15.300255+0000","last_became_active":"2023-07-06T21:42:10.875349+0000","last_became_peered":"2023-07-06T21:42:10.875349+0000","last_unstale":"2023-07-06T21:42:15.300255+0000","last_undegraded":"2023-07-06T21:42:15.300255+0000","last_fullsized":"2023-07-06T21:42:15.300255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:27:07.827816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300278+0000","last_change":"2023-07-06T21:42:10.881532+0000","last_active":"2023-07-06T21:42:15.300278+0000","last_peered":"2023-07-06T21:42:15.300278+0000","last_clean":"2023-07-06T21:42:15.300278+0000","last_became_active":"2023-07-06T21:42:10.880941+0000","last_became_peered":"2023-07-06T21:42:10.880941+0000","last_unstale":"2023-07-06T21:42:15.300278+0000","last_undegraded":"2023-07-06T21:42:15.300278+0000","last_fullsized":"2023-07-06T21:42:15.300278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:52:05.125777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304252+0000","last_change":"2023-07-06T21:42:10.894986+0000","last_active":"2023-07-06T21:42:15.304252+0000","last_peered":"2023-07-06T21:42:15.304252+0000","last_clean":"2023-07-06T21:42:15.304252+0000","last_became_active":"2023-07-06T21:42:10.894738+0000","last_became_peered":"2023-07-06T21:42:10.894738+0000","last_unstale":"2023-07-06T21:42:15.304252+0000","last_undegraded":"2023-07-06T21:42:15.304252+0000","last_fullsized":"2023-07-06T21:42:15.304252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:27:06.771295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.750069+0000","last_change":"2023-07-06T21:42:10.895916+0000","last_active":"2023-07-06T21:42:15.750069+0000","last_peered":"2023-07-06T21:42:15.750069+0000","last_clean":"2023-07-06T21:42:15.750069+0000","last_became_active":"2023-07-06T21:42:10.895651+0000","last_became_peered":"2023-07-06T21:42:10.895651+0000","last_unstale":"2023-07-06T21:42:15.750069+0000","last_undegraded":"2023-07-06T21:42:15.750069+0000","last_fullsized":"2023-07-06T21:42:15.750069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:26.458362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555014+0000","last_change":"2023-07-06T21:42:10.885988+0000","last_active":"2023-07-06T21:42:15.555014+0000","last_peered":"2023-07-06T21:42:15.555014+0000","last_clean":"2023-07-06T21:42:15.555014+0000","last_became_active":"2023-07-06T21:42:10.885729+0000","last_became_peered":"2023-07-06T21:42:10.885729+0000","last_unstale":"2023-07-06T21:42:15.555014+0000","last_undegraded":"2023-07-06T21:42:15.555014+0000","last_fullsized":"2023-07-06T21:42:15.555014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:03.197259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749183+0000","last_change":"2023-07-06T21:42:10.891993+0000","last_active":"2023-07-06T21:42:15.749183+0000","last_peered":"2023-07-06T21:42:15.749183+0000","last_clean":"2023-07-06T21:42:15.749183+0000","last_became_active":"2023-07-06T21:42:10.891739+0000","last_became_peered":"2023-07-06T21:42:10.891739+0000","last_unstale":"2023-07-06T21:42:15.749183+0000","last_undegraded":"2023-07-06T21:42:15.749183+0000","last_fullsized":"2023-07-06T21:42:15.749183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:40.295763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303451+0000","last_change":"2023-07-06T21:42:10.902805+0000","last_active":"2023-07-06T21:42:15.303451+0000","last_peered":"2023-07-06T21:42:15.303451+0000","last_clean":"2023-07-06T21:42:15.303451+0000","last_became_active":"2023-07-06T21:42:10.902567+0000","last_became_peered":"2023-07-06T21:42:10.902567+0000","last_unstale":"2023-07-06T21:42:15.303451+0000","last_undegraded":"2023-07-06T21:42:15.303451+0000","last_fullsized":"2023-07-06T21:42:15.303451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:49.304577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.303055+0000","last_change":"2023-07-06T21:42:10.881630+0000","last_active":"2023-07-06T21:42:15.303055+0000","last_peered":"2023-07-06T21:42:15.303055+0000","last_clean":"2023-07-06T21:42:15.303055+0000","last_became_active":"2023-07-06T21:42:10.881320+0000","last_became_peered":"2023-07-06T21:42:10.881320+0000","last_unstale":"2023-07-06T21:42:15.303055+0000","last_undegraded":"2023-07-06T21:42:15.303055+0000","last_fullsized":"2023-07-06T21:42:15.303055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:25:56.218127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.555077+0000","last_change":"2023-07-06T21:42:10.898965+0000","last_active":"2023-07-06T21:42:15.555077+0000","last_peered":"2023-07-06T21:42:15.555077+0000","last_clean":"2023-07-06T21:42:15.555077+0000","last_became_active":"2023-07-06T21:42:10.898708+0000","last_became_peered":"2023-07-06T21:42:10.898708+0000","last_unstale":"2023-07-06T21:42:15.555077+0000","last_undegraded":"2023-07-06T21:42:15.555077+0000","last_fullsized":"2023-07-06T21:42:15.555077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:38.266961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.815879+0000","last_change":"2023-07-06T21:42:10.886444+0000","last_active":"2023-07-06T21:42:15.815879+0000","last_peered":"2023-07-06T21:42:15.815879+0000","last_clean":"2023-07-06T21:42:15.815879+0000","last_became_active":"2023-07-06T21:42:10.885666+0000","last_became_peered":"2023-07-06T21:42:10.885666+0000","last_unstale":"2023-07-06T21:42:15.815879+0000","last_undegraded":"2023-07-06T21:42:15.815879+0000","last_fullsized":"2023-07-06T21:42:15.815879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:46:15.005638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.304225+0000","last_change":"2023-07-06T21:42:10.882573+0000","last_active":"2023-07-06T21:42:15.304225+0000","last_peered":"2023-07-06T21:42:15.304225+0000","last_clean":"2023-07-06T21:42:15.304225+0000","last_became_active":"2023-07-06T21:42:10.882180+0000","last_became_peered":"2023-07-06T21:42:10.882180+0000","last_unstale":"2023-07-06T21:42:15.304225+0000","last_undegraded":"2023-07-06T21:42:15.304225+0000","last_fullsized":"2023-07-06T21:42:15.304225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:30:13.482950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.749979+0000","last_change":"2023-07-06T21:42:10.904712+0000","last_active":"2023-07-06T21:42:15.749979+0000","last_peered":"2023-07-06T21:42:15.749979+0000","last_clean":"2023-07-06T21:42:15.749979+0000","last_became_active":"2023-07-06T21:42:10.904256+0000","last_became_peered":"2023-07-06T21:42:10.904256+0000","last_unstale":"2023-07-06T21:42:15.749979+0000","last_undegraded":"2023-07-06T21:42:15.749979+0000","last_fullsized":"2023-07-06T21:42:15.749979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:29.829357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T21:42:15.300331+0000","last_change":"2023-07-06T21:42:10.887637+0000","last_active":"2023-07-06T21:42:15.300331+0000","last_peered":"2023-07-06T21:42:15.300331+0000","last_clean":"2023-07-06T21:42:15.300331+0000","last_became_active":"2023-07-06T21:42:10.887372+0000","last_became_peered":"2023-07-06T21:42:10.887372+0000","last_unstale":"2023-07-06T21:42:15.300331+0000","last_undegraded":"2023-07-06T21:42:15.300331+0000","last_fullsized":"2023-07-06T21:42:15.300331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:10.437374+0000","last_clean_scrub_stamp":"2023-07-06T21:42:10.437374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:03.429658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":913408,"data_stored":714278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":123750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":884736,"data_stored":709832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:42:35.631 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-06T21:42:35.632 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-06T21:42:35.632 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-06T21:42:35.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-06T21:42:35.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.803+0000 7efce4607640 1 Processor -- start 2023-07-06T21:42:35.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.807+0000 7efce4607640 1 -- start start 2023-07-06T21:42:35.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.807+0000 7efce4607640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efcdc0cf080 0x7efcdc0cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.807+0000 7efce4607640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0cd990 con 0x7efcdc15ba30 2023-07-06T21:42:35.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.807+0000 7efce4607640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0cd3f0 con 0x7efcdc0b5990 2023-07-06T21:42:35.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.807+0000 7efce4607640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc0b41a0 con 0x7efcdc0cf080 2023-07-06T21:42:35.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.807+0000 7efce23a3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efcdc15ba30 0x7efcdc0ca720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38422/0 (socket says 172.21.15.55:38422) 2023-07-06T21:42:35.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.807+0000 7efce23a3640 1 -- 172.21.15.55:0/2367317947 learned_addr learned my addr 172.21.15.55:0/2367317947 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:35.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.807+0000 7efce2ba4640 1 --2- 172.21.15.55:0/2367317947 >> v2:172.21.15.138:3300/0 conn(0x7efcdc0cf080 0x7efcdc0cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.807+0000 7efce13a1640 1 -- 172.21.15.55:0/2367317947 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792858203 0 0) 0x7efcdc0cd990 con 0x7efcdc15ba30 2023-07-06T21:42:35.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.807+0000 7efce13a1640 1 -- 172.21.15.55:0/2367317947 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc8003530 con 0x7efcdc15ba30 2023-07-06T21:42:35.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.807+0000 7efce13a1640 1 -- 172.21.15.55:0/2367317947 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3334030486 0 0) 0x7efcc8003530 con 0x7efcdc15ba30 2023-07-06T21:42:35.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.807+0000 7efce2ba4640 1 -- 172.21.15.55:0/2367317947 >> v1:172.21.15.138:6789/0 conn(0x7efcdc0b5990 legacy=0x7efcdc0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.807+0000 7efce2ba4640 1 -- 172.21.15.55:0/2367317947 >> v1:172.21.15.55:6789/0 conn(0x7efcdc15ba30 legacy=0x7efcdc0ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.807+0000 7efce2ba4640 1 -- 172.21.15.55:0/2367317947 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0cd6b0 con 0x7efcdc0cf080 2023-07-06T21:42:35.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.811+0000 7efce2ba4640 1 --2- 172.21.15.55:0/2367317947 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcdc0cf080 0x7efcdc0cffe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009d90 tx=0x7efcd401c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72f6e8ec1491d663 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:35.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.811+0000 7efce13a1640 1 -- 172.21.15.55:0/2367317947 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8001680 con 0x7efcdc0cf080 2023-07-06T21:42:35.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.811+0000 7efce13a1640 1 -- 172.21.15.55:0/2367317947 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd40a55f0 con 0x7efcdc0cf080 2023-07-06T21:42:35.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.811+0000 7efce13a1640 1 -- 172.21.15.55:0/2367317947 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd40a5980 con 0x7efcdc0cf080 2023-07-06T21:42:35.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.811+0000 7efce4607640 1 -- 172.21.15.55:0/2367317947 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcdc0cf080 msgr2=0x7efcdc0cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.811+0000 7efce4607640 1 --2- 172.21.15.55:0/2367317947 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcdc0cf080 0x7efcdc0cffe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009d90 tx=0x7efcd401c7b0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.811+0000 7efce4607640 1 -- 172.21.15.55:0/2367317947 shutdown_connections 2023-07-06T21:42:35.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.811+0000 7efce4607640 1 --2- 172.21.15.55:0/2367317947 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcdc0cf080 0x7efcdc0cffe0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.811+0000 7efce4607640 1 -- 172.21.15.55:0/2367317947 >> 172.21.15.55:0/2367317947 conn(0x7efcdc06ee80 msgr2=0x7efcdc06f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:35.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.811+0000 7efce4607640 1 -- 172.21.15.55:0/2367317947 shutdown_connections 2023-07-06T21:42:35.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.811+0000 7efce4607640 1 -- 172.21.15.55:0/2367317947 wait complete. 2023-07-06T21:42:35.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.811+0000 7efce4607640 1 Processor -- start 2023-07-06T21:42:35.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce4607640 1 -- start start 2023-07-06T21:42:35.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce4607640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcdc0b5990 0x7efcdc14b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce4607640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcdc0cf080 0x7efcdc152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce4607640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcdc15ba30 0x7efcdc153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce4607640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc1542a0 con 0x7efcdc15ba30 2023-07-06T21:42:35.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce4607640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc150560 con 0x7efcdc0b5990 2023-07-06T21:42:35.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce4607640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc153690 con 0x7efcdc0cf080 2023-07-06T21:42:35.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce2ba4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcdc15ba30 0x7efcdc153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce2ba4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcdc15ba30 0x7efcdc153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55268/0 (socket says 172.21.15.55:55268) 2023-07-06T21:42:35.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce2ba4640 1 -- 172.21.15.55:0/1079207352 learned_addr learned my addr 172.21.15.55:0/1079207352 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:35.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce23a3640 1 --2- 172.21.15.55:0/1079207352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcdc0b5990 0x7efcdc14b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce1ba2640 1 --2- 172.21.15.55:0/1079207352 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcdc0cf080 0x7efcdc152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce2ba4640 1 -- 172.21.15.55:0/1079207352 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcdc0cf080 msgr2=0x7efcdc152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce2ba4640 1 --2- 172.21.15.55:0/1079207352 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcdc0cf080 0x7efcdc152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce2ba4640 1 -- 172.21.15.55:0/1079207352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcdc0b5990 msgr2=0x7efcdc14b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:35.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce2ba4640 1 --2- 172.21.15.55:0/1079207352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcdc0b5990 0x7efcdc14b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:35.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce2ba4640 1 -- 172.21.15.55:0/1079207352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd4009a70 con 0x7efcdc15ba30 2023-07-06T21:42:35.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce2ba4640 1 --2- 172.21.15.55:0/1079207352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcdc15ba30 0x7efcdc153010 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efcd40193c0 tx=0x7efcd4019550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:35.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efcd2ffd640 1 -- 172.21.15.55:0/1079207352 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd40a5e10 con 0x7efcdc15ba30 2023-07-06T21:42:35.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efcd2ffd640 1 -- 172.21.15.55:0/1079207352 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd40ad650 con 0x7efcdc15ba30 2023-07-06T21:42:35.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efcd2ffd640 1 -- 172.21.15.55:0/1079207352 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd40ada00 con 0x7efcdc15ba30 2023-07-06T21:42:35.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce4607640 1 -- 172.21.15.55:0/1079207352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc153970 con 0x7efcdc15ba30 2023-07-06T21:42:35.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce4607640 1 -- 172.21.15.55:0/1079207352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc153f30 con 0x7efcdc15ba30 2023-07-06T21:42:35.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.815+0000 7efce4607640 1 -- 172.21.15.55:0/1079207352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc154450 con 0x7efcdc15ba30 2023-07-06T21:42:35.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.819+0000 7efcd2ffd640 1 -- 172.21.15.55:0/1079207352 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efcd40adb60 con 0x7efcdc15ba30 2023-07-06T21:42:35.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.819+0000 7efcd2ffd640 1 --2- 172.21.15.55:0/1079207352 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efcc00662b0 0x7efcc0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:35.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.819+0000 7efcd2ffd640 1 -- 172.21.15.55:0/1079207352 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efcd411eef0 con 0x7efcdc15ba30 2023-07-06T21:42:35.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.819+0000 7efce23a3640 1 --2- 172.21.15.55:0/1079207352 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efcc00662b0 0x7efcc0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:35.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.819+0000 7efce23a3640 1 --2- 172.21.15.55:0/1079207352 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efcc00662b0 0x7efcc0068760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efcd8006ae0 tx=0x7efcd8001d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:35.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:35.823+0000 7efcd2ffd640 1 -- 172.21.15.55:0/1079207352 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efcdc154450 con 0x7efcdc15ba30 2023-07-06T21:42:36.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.011+0000 7efce4607640 1 -- 172.21.15.55:0/1079207352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efcdc154450 con 0x7efcdc15ba30 2023-07-06T21:42:36.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.011+0000 7efcd2ffd640 1 -- 172.21.15.55:0/1079207352 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7efcdc154450 con 0x7efcdc15ba30 2023-07-06T21:42:36.017 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:36.017 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-06T21:42:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.011+0000 7efce4607640 1 -- 172.21.15.55:0/1079207352 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efcc00662b0 msgr2=0x7efcc0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.011+0000 7efce4607640 1 --2- 172.21.15.55:0/1079207352 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efcc00662b0 0x7efcc0068760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efcd8006ae0 tx=0x7efcd8001d30 comp rx=0 tx=0).stop 2023-07-06T21:42:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.011+0000 7efce4607640 1 -- 172.21.15.55:0/1079207352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcdc15ba30 msgr2=0x7efcdc153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.011+0000 7efce4607640 1 --2- 172.21.15.55:0/1079207352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcdc15ba30 0x7efcdc153010 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efcd40193c0 tx=0x7efcd4019550 comp rx=0 tx=0).stop 2023-07-06T21:42:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.011+0000 7efce4607640 1 -- 172.21.15.55:0/1079207352 shutdown_connections 2023-07-06T21:42:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.011+0000 7efce4607640 1 --2- 172.21.15.55:0/1079207352 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efcc00662b0 0x7efcc0068760 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.011+0000 7efce4607640 1 --2- 172.21.15.55:0/1079207352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcdc15ba30 0x7efcdc153010 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.011+0000 7efce4607640 1 --2- 172.21.15.55:0/1079207352 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcdc0cf080 0x7efcdc152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.011+0000 7efce4607640 1 --2- 172.21.15.55:0/1079207352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcdc0b5990 0x7efcdc14b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.011+0000 7efce4607640 1 -- 172.21.15.55:0/1079207352 >> 172.21.15.55:0/1079207352 conn(0x7efcdc06ee80 msgr2=0x7efcdc06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.011+0000 7efce4607640 1 -- 172.21.15.55:0/1079207352 shutdown_connections 2023-07-06T21:42:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.015+0000 7efce4607640 1 -- 172.21.15.55:0/1079207352 wait complete. 2023-07-06T21:42:36.037 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-06T21:42:36.038 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:36.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f1592b11640 1 Processor -- start 2023-07-06T21:42:36.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f1592b11640 1 -- start start 2023-07-06T21:42:36.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f1592b11640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f158c15f4e0 0x7f158c0b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f1592b11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f158c0b4250 0x7f158c15c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f1592b11640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158c06a160 con 0x7f158c15b9d0 2023-07-06T21:42:36.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f1592b11640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158c15bda0 con 0x7f158c15f4e0 2023-07-06T21:42:36.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f1592b11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c0b46b0 con 0x7f158c0b4250 2023-07-06T21:42:36.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f15908ad640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f158c15b9d0 0x7f158c0ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38428/0 (socket says 172.21.15.55:38428) 2023-07-06T21:42:36.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f15908ad640 1 -- 172.21.15.55:0/3905273833 learned_addr learned my addr 172.21.15.55:0/3905273833 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:36.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f158bfff640 1 --2- 172.21.15.55:0/3905273833 >> v2:172.21.15.138:3300/0 conn(0x7f158c15f4e0 0x7f158c0b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f15910ae640 1 --2- 172.21.15.55:0/3905273833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f158c0b4250 0x7f158c15c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f158b7fe640 1 -- 172.21.15.55:0/3905273833 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158309276 0 0) 0x7f158c06a160 con 0x7f158c15b9d0 2023-07-06T21:42:36.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f158b7fe640 1 -- 172.21.15.55:0/3905273833 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f157c003530 con 0x7f158c15b9d0 2023-07-06T21:42:36.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f158bfff640 1 -- 172.21.15.55:0/3905273833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f158c0b4250 msgr2=0x7f158c15c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:36.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f158bfff640 1 --2- 172.21.15.55:0/3905273833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f158c0b4250 0x7f158c15c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f158bfff640 1 -- 172.21.15.55:0/3905273833 >> v1:172.21.15.55:6789/0 conn(0x7f158c15b9d0 legacy=0x7f158c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.175+0000 7f158bfff640 1 -- 172.21.15.55:0/3905273833 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c069590 con 0x7f158c15f4e0 2023-07-06T21:42:36.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.179+0000 7f158bfff640 1 --2- 172.21.15.55:0/3905273833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f158c15f4e0 0x7f158c0b3d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f15780097c0 tx=0x7f157801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31ddea13f8ee9c3b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:36.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.179+0000 7f158b7fe640 1 -- 172.21.15.55:0/3905273833 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15780ab480 con 0x7f158c15f4e0 2023-07-06T21:42:36.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.179+0000 7f158b7fe640 1 -- 172.21.15.55:0/3905273833 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15780ab5e0 con 0x7f158c15f4e0 2023-07-06T21:42:36.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.179+0000 7f158b7fe640 1 -- 172.21.15.55:0/3905273833 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15780ab970 con 0x7f158c15f4e0 2023-07-06T21:42:36.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.179+0000 7f1592b11640 1 -- 172.21.15.55:0/3905273833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f158c15f4e0 msgr2=0x7f158c0b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.179+0000 7f1592b11640 1 --2- 172.21.15.55:0/3905273833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f158c15f4e0 0x7f158c0b3d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f15780097c0 tx=0x7f157801c480 comp rx=0 tx=0).stop 2023-07-06T21:42:36.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f1592b11640 1 -- 172.21.15.55:0/3905273833 shutdown_connections 2023-07-06T21:42:36.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f1592b11640 1 --2- 172.21.15.55:0/3905273833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f158c0b4250 0x7f158c15c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f1592b11640 1 --2- 172.21.15.55:0/3905273833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f158c15f4e0 0x7f158c0b3d10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f1592b11640 1 -- 172.21.15.55:0/3905273833 >> 172.21.15.55:0/3905273833 conn(0x7f158c0ced10 msgr2=0x7f158c0cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:36.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f1592b11640 1 -- 172.21.15.55:0/3905273833 shutdown_connections 2023-07-06T21:42:36.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f1592b11640 1 -- 172.21.15.55:0/3905273833 wait complete. 2023-07-06T21:42:36.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f1592b11640 1 Processor -- start 2023-07-06T21:42:36.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f1592b11640 1 -- start start 2023-07-06T21:42:36.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f1592b11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f158c0b4250 0x7f158c0c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f1592b11640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f158c15b9d0 0x7f158c15fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f1592b11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f158c15f4e0 0x7f158c15ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f1592b11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c0cae10 con 0x7f158c0b4250 2023-07-06T21:42:36.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f1592b11640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c0ca200 con 0x7f158c15b9d0 2023-07-06T21:42:36.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f1592b11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c0ca4e0 con 0x7f158c15f4e0 2023-07-06T21:42:36.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f15908ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f158c0b4250 0x7f158c0c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f15908ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f158c0b4250 0x7f158c0c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55280/0 (socket says 172.21.15.55:55280) 2023-07-06T21:42:36.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f15908ad640 1 -- 172.21.15.55:0/3242093762 learned_addr learned my addr 172.21.15.55:0/3242093762 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:36.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f15908ad640 1 -- 172.21.15.55:0/3242093762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f158c15f4e0 msgr2=0x7f158c15ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f15910ae640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f158c15f4e0 0x7f158c15ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f158bfff640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f158c15b9d0 0x7f158c15fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f15908ad640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f158c15f4e0 0x7f158c15ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f15908ad640 1 -- 172.21.15.55:0/3242093762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f158c15b9d0 msgr2=0x7f158c15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f15908ad640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f158c15b9d0 0x7f158c15fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f15908ad640 1 -- 172.21.15.55:0/3242093762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1578009420 con 0x7f158c0b4250 2023-07-06T21:42:36.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f158bfff640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f158c15b9d0 0x7f158c15fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:36.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.183+0000 7f15908ad640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f158c0b4250 0x7f158c0c8010 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f158000c420 tx=0x7f158000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:36.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.187+0000 7f15897fa640 1 -- 172.21.15.55:0/3242093762 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580005cf0 con 0x7f158c0b4250 2023-07-06T21:42:36.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.187+0000 7f15897fa640 1 -- 172.21.15.55:0/3242093762 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1580005e50 con 0x7f158c0b4250 2023-07-06T21:42:36.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.187+0000 7f15897fa640 1 -- 172.21.15.55:0/3242093762 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15800072d0 con 0x7f158c0b4250 2023-07-06T21:42:36.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.187+0000 7f1592b11640 1 -- 172.21.15.55:0/3242093762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158c0ca7c0 con 0x7f158c0b4250 2023-07-06T21:42:36.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.187+0000 7f1592b11640 1 -- 172.21.15.55:0/3242093762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c0cb2a0 con 0x7f158c0b4250 2023-07-06T21:42:36.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.187+0000 7f1592b11640 1 -- 172.21.15.55:0/3242093762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158c066d60 con 0x7f158c0b4250 2023-07-06T21:42:36.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.187+0000 7f15897fa640 1 -- 172.21.15.55:0/3242093762 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1580007430 con 0x7f158c0b4250 2023-07-06T21:42:36.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.187+0000 7f15897fa640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1570066280 0x7f1570068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.187+0000 7f15897fa640 1 -- 172.21.15.55:0/3242093762 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1580083600 con 0x7f158c0b4250 2023-07-06T21:42:36.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.187+0000 7f158bfff640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1570066280 0x7f1570068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.187+0000 7f158bfff640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1570066280 0x7f1570068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f15780af000 tx=0x7f1578008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:36.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.191+0000 7f15897fa640 1 -- 172.21.15.55:0/3242093762 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f15800507a0 con 0x7f158c0b4250 2023-07-06T21:42:36.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.347+0000 7f1592b11640 1 -- 172.21.15.55:0/3242093762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f158c06ac10 con 0x7f158c0b4250 2023-07-06T21:42:36.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.347+0000 7f15897fa640 1 -- 172.21.15.55:0/3242093762 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f1580053dc0 con 0x7f158c0b4250 2023-07-06T21:42:36.354 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:36.355 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:15.295464+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.351+0000 7f1592b11640 1 -- 172.21.15.55:0/3242093762 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1570066280 msgr2=0x7f1570068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.351+0000 7f1592b11640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1570066280 0x7f1570068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f15780af000 tx=0x7f1578008040 comp rx=0 tx=0).stop 2023-07-06T21:42:36.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.351+0000 7f1592b11640 1 -- 172.21.15.55:0/3242093762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f158c0b4250 msgr2=0x7f158c0c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.351+0000 7f1592b11640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f158c0b4250 0x7f158c0c8010 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f158000c420 tx=0x7f158000c8e0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.351+0000 7f1592b11640 1 -- 172.21.15.55:0/3242093762 shutdown_connections 2023-07-06T21:42:36.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.351+0000 7f1592b11640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1570066280 0x7f1570068730 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.351+0000 7f1592b11640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f158c15f4e0 0x7f158c15ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.351+0000 7f1592b11640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f158c15b9d0 0x7f158c15fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.351+0000 7f1592b11640 1 --2- 172.21.15.55:0/3242093762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f158c0b4250 0x7f158c0c8010 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.351+0000 7f1592b11640 1 -- 172.21.15.55:0/3242093762 >> 172.21.15.55:0/3242093762 conn(0x7f158c0ced10 msgr2=0x7f158c15ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:36.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.351+0000 7f1592b11640 1 -- 172.21.15.55:0/3242093762 shutdown_connections 2023-07-06T21:42:36.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.351+0000 7f1592b11640 1 -- 172.21.15.55:0/3242093762 wait complete. 2023-07-06T21:42:36.375 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:42:08.597013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:42:09.843890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T21:42:12.918111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T21:42:36.377 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:42:36.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd7a2cf9640 1 Processor -- start 2023-07-06T21:42:36.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd7a2cf9640 1 -- start start 2023-07-06T21:42:36.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd7a2cf9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd79c0709a0 0x7fd79c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd7a2cf9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79c0cc300 con 0x7fd79c0b1340 2023-07-06T21:42:36.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd7a2cf9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79c0cc5e0 con 0x7fd79c0cbe60 2023-07-06T21:42:36.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd7a2cf9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79c0cc8c0 con 0x7fd79c0709a0 2023-07-06T21:42:36.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd7a1296640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd79c0b1340 0x7fd79c06eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38434/0 (socket says 172.21.15.55:38434) 2023-07-06T21:42:36.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd7a1296640 1 -- 172.21.15.55:0/2591864363 learned_addr learned my addr 172.21.15.55:0/2591864363 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:36.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd7a0a95640 1 --2- 172.21.15.55:0/2591864363 >> v2:172.21.15.138:3300/0 conn(0x7fd79c0709a0 0x7fd79c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd79b7fe640 1 -- 172.21.15.55:0/2591864363 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795836464 0 0) 0x7fd79c0cc300 con 0x7fd79c0b1340 2023-07-06T21:42:36.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd79b7fe640 1 -- 172.21.15.55:0/2591864363 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd78c003530 con 0x7fd79c0b1340 2023-07-06T21:42:36.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd7a0a95640 1 -- 172.21.15.55:0/2591864363 >> v1:172.21.15.138:6789/0 conn(0x7fd79c0cbe60 legacy=0x7fd79c0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd7a0a95640 1 -- 172.21.15.55:0/2591864363 >> v1:172.21.15.55:6789/0 conn(0x7fd79c0b1340 legacy=0x7fd79c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd79b7fe640 1 -- 172.21.15.55:0/2591864363 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2977031662 0 0) 0x7fd78c003530 con 0x7fd79c0b1340 2023-07-06T21:42:36.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.519+0000 7fd7a0a95640 1 -- 172.21.15.55:0/2591864363 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c0ccba0 con 0x7fd79c0709a0 2023-07-06T21:42:36.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.523+0000 7fd7a0a95640 1 --2- 172.21.15.55:0/2591864363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd79c0709a0 0x7fd79c0cb920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd7900097c0 tx=0x7fd79001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=964d52aa83a98a80 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:36.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.523+0000 7fd79b7fe640 1 -- 172.21.15.55:0/2591864363 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd794001a00 con 0x7fd79c0709a0 2023-07-06T21:42:36.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.523+0000 7fd79b7fe640 1 -- 172.21.15.55:0/2591864363 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7900a7050 con 0x7fd79c0709a0 2023-07-06T21:42:36.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.523+0000 7fd79b7fe640 1 -- 172.21.15.55:0/2591864363 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7900ab620 con 0x7fd79c0709a0 2023-07-06T21:42:36.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.523+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/2591864363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd79c0709a0 msgr2=0x7fd79c0cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.523+0000 7fd7a2cf9640 1 --2- 172.21.15.55:0/2591864363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd79c0709a0 0x7fd79c0cb920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd7900097c0 tx=0x7fd79001c3a0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.523+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/2591864363 shutdown_connections 2023-07-06T21:42:36.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.523+0000 7fd7a2cf9640 1 --2- 172.21.15.55:0/2591864363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd79c0709a0 0x7fd79c0cb920 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.523+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/2591864363 >> 172.21.15.55:0/2591864363 conn(0x7fd79c0cea70 msgr2=0x7fd79c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:36.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.523+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/2591864363 shutdown_connections 2023-07-06T21:42:36.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.523+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/2591864363 wait complete. 2023-07-06T21:42:36.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.523+0000 7fd7a2cf9640 1 Processor -- start 2023-07-06T21:42:36.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a2cf9640 1 -- start start 2023-07-06T21:42:36.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a2cf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd79c0709a0 0x7fd79c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a2cf9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd79c0b1340 0x7fd79c161790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a2cf9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd79c0cbe60 0x7fd79c161cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a2cf9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c15c740 con 0x7fd79c0709a0 2023-07-06T21:42:36.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a2cf9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c06aa10 con 0x7fd79c0b1340 2023-07-06T21:42:36.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a2cf9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c06b7c0 con 0x7fd79c0cbe60 2023-07-06T21:42:36.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a0a95640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd79c0709a0 0x7fd79c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a0a95640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd79c0709a0 0x7fd79c15c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55284/0 (socket says 172.21.15.55:55284) 2023-07-06T21:42:36.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a0a95640 1 -- 172.21.15.55:0/3391368276 learned_addr learned my addr 172.21.15.55:0/3391368276 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:36.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd79bfff640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd79c0b1340 0x7fd79c161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a1296640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd79c0cbe60 0x7fd79c161cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a0a95640 1 -- 172.21.15.55:0/3391368276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd79c0cbe60 msgr2=0x7fd79c161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a0a95640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd79c0cbe60 0x7fd79c161cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a0a95640 1 -- 172.21.15.55:0/3391368276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd79c0b1340 msgr2=0x7fd79c161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a0a95640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd79c0b1340 0x7fd79c161790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a0a95640 1 -- 172.21.15.55:0/3391368276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd790009420 con 0x7fd79c0709a0 2023-07-06T21:42:36.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd79bfff640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd79c0b1340 0x7fd79c161790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:36.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a0a95640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd79c0709a0 0x7fd79c15c200 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd7900097c0 tx=0x7fd79001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:36.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7997fa640 1 -- 172.21.15.55:0/3391368276 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7900abda0 con 0x7fd79c0709a0 2023-07-06T21:42:36.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7997fa640 1 -- 172.21.15.55:0/3391368276 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd790004020 con 0x7fd79c0709a0 2023-07-06T21:42:36.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7997fa640 1 -- 172.21.15.55:0/3391368276 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790004390 con 0x7fd79c0709a0 2023-07-06T21:42:36.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/3391368276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79c06ac40 con 0x7fd79c0709a0 2023-07-06T21:42:36.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/3391368276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79c06b200 con 0x7fd79c0709a0 2023-07-06T21:42:36.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.527+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/3391368276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79c15c970 con 0x7fd79c0709a0 2023-07-06T21:42:36.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.531+0000 7fd7997fa640 1 -- 172.21.15.55:0/3391368276 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd790003620 con 0x7fd79c0709a0 2023-07-06T21:42:36.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.531+0000 7fd7997fa640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd7800662b0 0x7fd780068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.531+0000 7fd7997fa640 1 -- 172.21.15.55:0/3391368276 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd79011e2d0 con 0x7fd79c0709a0 2023-07-06T21:42:36.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.531+0000 7fd79bfff640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd7800662b0 0x7fd780068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.531+0000 7fd79bfff640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd7800662b0 0x7fd780068760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd79c0c4100 tx=0x7fd788009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:36.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.535+0000 7fd7997fa640 1 -- 172.21.15.55:0/3391368276 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd79c15c970 con 0x7fd79c0709a0 2023-07-06T21:42:36.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.691+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/3391368276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd79c066d60 con 0x7fd79c0709a0 2023-07-06T21:42:36.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.691+0000 7fd7997fa640 1 -- 172.21.15.55:0/3391368276 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7900eb570 con 0x7fd79c0709a0 2023-07-06T21:42:36.696 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:42:36.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.691+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/3391368276 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd7800662b0 msgr2=0x7fd780068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.691+0000 7fd7a2cf9640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd7800662b0 0x7fd780068760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd79c0c4100 tx=0x7fd788009040 comp rx=0 tx=0).stop 2023-07-06T21:42:36.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.691+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/3391368276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd79c0709a0 msgr2=0x7fd79c15c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.691+0000 7fd7a2cf9640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd79c0709a0 0x7fd79c15c200 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd7900097c0 tx=0x7fd79001abe0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.691+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/3391368276 shutdown_connections 2023-07-06T21:42:36.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.691+0000 7fd7a2cf9640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd7800662b0 0x7fd780068760 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.691+0000 7fd7a2cf9640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd79c0cbe60 0x7fd79c161cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.691+0000 7fd7a2cf9640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd79c0b1340 0x7fd79c161790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.691+0000 7fd7a2cf9640 1 --2- 172.21.15.55:0/3391368276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd79c0709a0 0x7fd79c15c200 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.691+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/3391368276 >> 172.21.15.55:0/3391368276 conn(0x7fd79c0cea70 msgr2=0x7fd79c0ad050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:36.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.691+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/3391368276 shutdown_connections 2023-07-06T21:42:36.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.691+0000 7fd7a2cf9640 1 -- 172.21.15.55:0/3391368276 wait complete. 2023-07-06T21:42:36.717 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:42:36.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.855+0000 7fcedd940640 1 Processor -- start 2023-07-06T21:42:36.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.855+0000 7fcedd940640 1 -- start start 2023-07-06T21:42:36.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.859+0000 7fcedd940640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fced80ca610 0x7fced80cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.859+0000 7fcedd940640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced815f5d0 con 0x7fced8156180 2023-07-06T21:42:36.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.859+0000 7fcedd940640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced815f8b0 con 0x7fced806f0e0 2023-07-06T21:42:36.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.859+0000 7fcedd940640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced8160250 con 0x7fced80ca610 2023-07-06T21:42:36.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.859+0000 7fced6ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fced8156180 0x7fced806e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38448/0 (socket says 172.21.15.55:38448) 2023-07-06T21:42:36.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.859+0000 7fced6ffd640 1 -- 172.21.15.55:0/3850427297 learned_addr learned my addr 172.21.15.55:0/3850427297 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:36.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.859+0000 7fced77fe640 1 --2- 172.21.15.55:0/3850427297 >> v2:172.21.15.55:3300/0 conn(0x7fced80ca610 0x7fced80cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.859+0000 7fced5ffb640 1 -- 172.21.15.55:0/3850427297 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876421931 0 0) 0x7fced815f5d0 con 0x7fced8156180 2023-07-06T21:42:36.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.859+0000 7fced5ffb640 1 -- 172.21.15.55:0/3850427297 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec0003530 con 0x7fced8156180 2023-07-06T21:42:36.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.859+0000 7fced77fe640 1 -- 172.21.15.55:0/3850427297 >> v1:172.21.15.138:6789/0 conn(0x7fced806f0e0 legacy=0x7fced80cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.859+0000 7fced77fe640 1 -- 172.21.15.55:0/3850427297 >> v1:172.21.15.55:6789/0 conn(0x7fced8156180 legacy=0x7fced806e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.859+0000 7fced77fe640 1 -- 172.21.15.55:0/3850427297 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced815fb90 con 0x7fced80ca610 2023-07-06T21:42:36.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.863+0000 7fced77fe640 1 --2- 172.21.15.55:0/3850427297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80ca610 0x7fced80cbeb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fced0009d90 tx=0x7fced001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad9851d720069c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:36.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.863+0000 7fced5ffb640 1 -- 172.21.15.55:0/3850427297 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced00a5890 con 0x7fced80ca610 2023-07-06T21:42:36.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.863+0000 7fced5ffb640 1 -- 172.21.15.55:0/3850427297 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced00a59f0 con 0x7fced80ca610 2023-07-06T21:42:36.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.863+0000 7fced5ffb640 1 -- 172.21.15.55:0/3850427297 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced00a5d80 con 0x7fced80ca610 2023-07-06T21:42:36.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.863+0000 7fcedd940640 1 -- 172.21.15.55:0/3850427297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80ca610 msgr2=0x7fced80cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.863+0000 7fcedd940640 1 --2- 172.21.15.55:0/3850427297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80ca610 0x7fced80cbeb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fced0009d90 tx=0x7fced001c8c0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.863+0000 7fcedd940640 1 -- 172.21.15.55:0/3850427297 shutdown_connections 2023-07-06T21:42:36.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.863+0000 7fcedd940640 1 --2- 172.21.15.55:0/3850427297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80ca610 0x7fced80cbeb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.863+0000 7fcedd940640 1 -- 172.21.15.55:0/3850427297 >> 172.21.15.55:0/3850427297 conn(0x7fced80d0c50 msgr2=0x7fced80cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:36.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.863+0000 7fcedd940640 1 -- 172.21.15.55:0/3850427297 shutdown_connections 2023-07-06T21:42:36.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.863+0000 7fcedd940640 1 -- 172.21.15.55:0/3850427297 wait complete. 2023-07-06T21:42:36.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.863+0000 7fcedd940640 1 Processor -- start 2023-07-06T21:42:36.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.863+0000 7fcedd940640 1 -- start start 2023-07-06T21:42:36.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fcedd940640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fced806f0e0 0x7fced8159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fcedd940640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80ca610 0x7fced814f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fcedd940640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fced8156180 0x7fced81576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fcedd940640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced8158070 con 0x7fced80ca610 2023-07-06T21:42:36.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fcedd940640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced8158350 con 0x7fced8156180 2023-07-06T21:42:36.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fcedd940640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced8158630 con 0x7fced806f0e0 2023-07-06T21:42:36.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fced67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80ca610 0x7fced814f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fced67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80ca610 0x7fced814f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55302/0 (socket says 172.21.15.55:55302) 2023-07-06T21:42:36.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fced67fc640 1 -- 172.21.15.55:0/3827208164 learned_addr learned my addr 172.21.15.55:0/3827208164 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:36.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fced6ffd640 1 --2- 172.21.15.55:0/3827208164 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fced806f0e0 0x7fced8159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fced77fe640 1 --2- 172.21.15.55:0/3827208164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fced8156180 0x7fced81576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fced67fc640 1 -- 172.21.15.55:0/3827208164 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fced806f0e0 msgr2=0x7fced8159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fced67fc640 1 --2- 172.21.15.55:0/3827208164 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fced806f0e0 0x7fced8159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fced67fc640 1 -- 172.21.15.55:0/3827208164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fced8156180 msgr2=0x7fced81576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:36.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fced67fc640 1 --2- 172.21.15.55:0/3827208164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fced8156180 0x7fced81576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:36.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fced67fc640 1 -- 172.21.15.55:0/3827208164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced0009a70 con 0x7fced80ca610 2023-07-06T21:42:36.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fced67fc640 1 --2- 172.21.15.55:0/3827208164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80ca610 0x7fced814f540 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00c500 tx=0x7fcecc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:36.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fcebffff640 1 -- 172.21.15.55:0/3827208164 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0052d0 con 0x7fced80ca610 2023-07-06T21:42:36.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fcebffff640 1 -- 172.21.15.55:0/3827208164 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc005430 con 0x7fced80ca610 2023-07-06T21:42:36.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fcebffff640 1 -- 172.21.15.55:0/3827208164 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc012870 con 0x7fced80ca610 2023-07-06T21:42:36.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fcedd940640 1 -- 172.21.15.55:0/3827208164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced8158910 con 0x7fced80ca610 2023-07-06T21:42:36.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fcedd940640 1 -- 172.21.15.55:0/3827208164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced814fa80 con 0x7fced80ca610 2023-07-06T21:42:36.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fcedd940640 1 -- 172.21.15.55:0/3827208164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced8066d60 con 0x7fced80ca610 2023-07-06T21:42:36.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.867+0000 7fcebffff640 1 -- 172.21.15.55:0/3827208164 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcecc0129d0 con 0x7fced80ca610 2023-07-06T21:42:36.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.871+0000 7fcebffff640 1 --2- 172.21.15.55:0/3827208164 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcec40662b0 0x7fcec4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:36.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.871+0000 7fcebffff640 1 -- 172.21.15.55:0/3827208164 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcecc083ac0 con 0x7fced80ca610 2023-07-06T21:42:36.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.871+0000 7fced6ffd640 1 --2- 172.21.15.55:0/3827208164 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcec40662b0 0x7fcec4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:36.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.871+0000 7fced6ffd640 1 --2- 172.21.15.55:0/3827208164 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcec40662b0 0x7fcec4068760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcec80011f0 tx=0x7fcec8007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:36.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:36.875+0000 7fcebffff640 1 -- 172.21.15.55:0/3827208164 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcecc050c70 con 0x7fced80ca610 2023-07-06T21:42:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.027+0000 7fcedd940640 1 -- 172.21.15.55:0/3827208164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fced8158dc0 con 0x7fced80ca610 2023-07-06T21:42:37.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.031+0000 7fcebffff640 1 -- 172.21.15.55:0/3827208164 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcecc054290 con 0x7fced80ca610 2023-07-06T21:42:37.035 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:42:37.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.031+0000 7fcedd940640 1 -- 172.21.15.55:0/3827208164 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcec40662b0 msgr2=0x7fcec4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.031+0000 7fcedd940640 1 --2- 172.21.15.55:0/3827208164 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcec40662b0 0x7fcec4068760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcec80011f0 tx=0x7fcec8007d40 comp rx=0 tx=0).stop 2023-07-06T21:42:37.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.031+0000 7fcedd940640 1 -- 172.21.15.55:0/3827208164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80ca610 msgr2=0x7fced814f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.031+0000 7fcedd940640 1 --2- 172.21.15.55:0/3827208164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80ca610 0x7fced814f540 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00c500 tx=0x7fcecc00c9c0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.031+0000 7fcedd940640 1 -- 172.21.15.55:0/3827208164 shutdown_connections 2023-07-06T21:42:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.031+0000 7fcedd940640 1 --2- 172.21.15.55:0/3827208164 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcec40662b0 0x7fcec4068760 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.031+0000 7fcedd940640 1 --2- 172.21.15.55:0/3827208164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fced8156180 0x7fced81576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.031+0000 7fcedd940640 1 --2- 172.21.15.55:0/3827208164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80ca610 0x7fced814f540 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.031+0000 7fcedd940640 1 --2- 172.21.15.55:0/3827208164 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fced806f0e0 0x7fced8159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.031+0000 7fcedd940640 1 -- 172.21.15.55:0/3827208164 >> 172.21.15.55:0/3827208164 conn(0x7fced80d0c50 msgr2=0x7fced815b370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.031+0000 7fcedd940640 1 -- 172.21.15.55:0/3827208164 shutdown_connections 2023-07-06T21:42:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.031+0000 7fcedd940640 1 -- 172.21.15.55:0/3827208164 wait complete. 2023-07-06T21:42:37.056 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:42:37.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.195+0000 7f7531d37640 1 Processor -- start 2023-07-06T21:42:37.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.195+0000 7f7531d37640 1 -- start start 2023-07-06T21:42:37.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.195+0000 7f7531d37640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f752c0709a0 0x7f752c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.195+0000 7f7531d37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f752c0b1340 0x7f752c06eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f7531d37640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752c0cc300 con 0x7f752c0cbe60 2023-07-06T21:42:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f7531d37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752c0cc5e0 con 0x7f752c0b1340 2023-07-06T21:42:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f7531d37640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752c0cc8c0 con 0x7f752c0709a0 2023-07-06T21:42:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f752bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f752c0b1340 0x7f752c06eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f752bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f752c0b1340 0x7f752c06eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55304/0 (socket says 172.21.15.55:55304) 2023-07-06T21:42:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f752bfff640 1 -- 172.21.15.55:0/3208466835 learned_addr learned my addr 172.21.15.55:0/3208466835 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f752b7fe640 1 --2- 172.21.15.55:0/3208466835 >> v2:172.21.15.138:3300/0 conn(0x7f752c0709a0 0x7f752c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f752bfff640 1 -- 172.21.15.55:0/3208466835 >> v2:172.21.15.138:3300/0 conn(0x7f752c0709a0 msgr2=0x7f752c0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:37.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f752bfff640 1 --2- 172.21.15.55:0/3208466835 >> v2:172.21.15.138:3300/0 conn(0x7f752c0709a0 0x7f752c0cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f752bfff640 1 -- 172.21.15.55:0/3208466835 >> v1:172.21.15.138:6789/0 conn(0x7f752c0cbe60 legacy=0x7f752c0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f752bfff640 1 -- 172.21.15.55:0/3208466835 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c0ccba0 con 0x7f752c0b1340 2023-07-06T21:42:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f752bfff640 1 --2- 172.21.15.55:0/3208466835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f752c0b1340 0x7f752c06eee0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f752c06ec60 tx=0x7f752401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdd7fdaae74790e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f752affd640 1 -- 172.21.15.55:0/3208466835 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240a57a0 con 0x7f752c0b1340 2023-07-06T21:42:37.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f752affd640 1 -- 172.21.15.55:0/3208466835 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75240a5900 con 0x7f752c0b1340 2023-07-06T21:42:37.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.199+0000 7f752affd640 1 -- 172.21.15.55:0/3208466835 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240a5c90 con 0x7f752c0b1340 2023-07-06T21:42:37.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 -- 172.21.15.55:0/3208466835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f752c0b1340 msgr2=0x7f752c06eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 --2- 172.21.15.55:0/3208466835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f752c0b1340 0x7f752c06eee0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f752c06ec60 tx=0x7f752401c9d0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 -- 172.21.15.55:0/3208466835 shutdown_connections 2023-07-06T21:42:37.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 --2- 172.21.15.55:0/3208466835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f752c0b1340 0x7f752c06eee0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 --2- 172.21.15.55:0/3208466835 >> v2:172.21.15.138:3300/0 conn(0x7f752c0709a0 0x7f752c0cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 -- 172.21.15.55:0/3208466835 >> 172.21.15.55:0/3208466835 conn(0x7f752c0cea70 msgr2=0x7f752c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:37.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 -- 172.21.15.55:0/3208466835 shutdown_connections 2023-07-06T21:42:37.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 -- 172.21.15.55:0/3208466835 wait complete. 2023-07-06T21:42:37.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 Processor -- start 2023-07-06T21:42:37.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 -- start start 2023-07-06T21:42:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f752c0709a0 0x7f752c09e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f752c0b1340 0x7f752c09d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f752c0cbe60 0x7f752c153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c09d960 con 0x7f752c0b1340 2023-07-06T21:42:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c09cea0 con 0x7f752c0709a0 2023-07-06T21:42:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7531d37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c09d140 con 0x7f752c0cbe60 2023-07-06T21:42:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7523fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f752c0b1340 0x7f752c09d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7523fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f752c0b1340 0x7f752c09d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55314/0 (socket says 172.21.15.55:55314) 2023-07-06T21:42:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7523fff640 1 -- 172.21.15.55:0/597373430 learned_addr learned my addr 172.21.15.55:0/597373430 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f752b7fe640 1 --2- 172.21.15.55:0/597373430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f752c0709a0 0x7f752c09e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f752bfff640 1 --2- 172.21.15.55:0/597373430 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f752c0cbe60 0x7f752c153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7523fff640 1 -- 172.21.15.55:0/597373430 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f752c0cbe60 msgr2=0x7f752c153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7523fff640 1 --2- 172.21.15.55:0/597373430 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f752c0cbe60 0x7f752c153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7523fff640 1 -- 172.21.15.55:0/597373430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f752c0709a0 msgr2=0x7f752c09e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7523fff640 1 --2- 172.21.15.55:0/597373430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f752c0709a0 0x7f752c09e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.203+0000 7f7523fff640 1 -- 172.21.15.55:0/597373430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7524009b30 con 0x7f752c0b1340 2023-07-06T21:42:37.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.207+0000 7f7523fff640 1 --2- 172.21.15.55:0/597373430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f752c0b1340 0x7f752c09d420 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f751400c3c0 tx=0x7f751400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:37.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.207+0000 7f7528ff9640 1 -- 172.21.15.55:0/597373430 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75140052d0 con 0x7f752c0b1340 2023-07-06T21:42:37.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.207+0000 7f7528ff9640 1 -- 172.21.15.55:0/597373430 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7514005430 con 0x7f752c0b1340 2023-07-06T21:42:37.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.207+0000 7f7528ff9640 1 -- 172.21.15.55:0/597373430 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514003840 con 0x7f752c0b1340 2023-07-06T21:42:37.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.207+0000 7f7531d37640 1 -- 172.21.15.55:0/597373430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c0c94c0 con 0x7f752c0b1340 2023-07-06T21:42:37.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.207+0000 7f7531d37640 1 -- 172.21.15.55:0/597373430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c154320 con 0x7f752c0b1340 2023-07-06T21:42:37.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.207+0000 7f7531d37640 1 -- 172.21.15.55:0/597373430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752c0c99e0 con 0x7f752c0b1340 2023-07-06T21:42:37.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.207+0000 7f7528ff9640 1 -- 172.21.15.55:0/597373430 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75140039a0 con 0x7f752c0b1340 2023-07-06T21:42:37.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.207+0000 7f7528ff9640 1 --2- 172.21.15.55:0/597373430 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f750c066280 0x7f750c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.207+0000 7f7528ff9640 1 -- 172.21.15.55:0/597373430 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7514083490 con 0x7f752c0b1340 2023-07-06T21:42:37.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.207+0000 7f752b7fe640 1 --2- 172.21.15.55:0/597373430 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f750c066280 0x7f750c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.211+0000 7f752b7fe640 1 --2- 172.21.15.55:0/597373430 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f750c066280 0x7f750c068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f752c06edb0 tx=0x7f751c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:37.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.211+0000 7f7528ff9640 1 -- 172.21.15.55:0/597373430 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f752c0c99e0 con 0x7f752c0b1340 2023-07-06T21:42:37.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.367+0000 7f7531d37640 1 -- 172.21.15.55:0/597373430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f752c0c99e0 con 0x7f752c0b1340 2023-07-06T21:42:37.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.367+0000 7f7528ff9640 1 -- 172.21.15.55:0/597373430 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f752c0c99e0 con 0x7f752c0b1340 2023-07-06T21:42:37.374 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:37.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.371+0000 7f7531d37640 1 -- 172.21.15.55:0/597373430 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f750c066280 msgr2=0x7f750c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.371+0000 7f7531d37640 1 --2- 172.21.15.55:0/597373430 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f750c066280 0x7f750c068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f752c06edb0 tx=0x7f751c008040 comp rx=0 tx=0).stop 2023-07-06T21:42:37.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.371+0000 7f7531d37640 1 -- 172.21.15.55:0/597373430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f752c0b1340 msgr2=0x7f752c09d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.371+0000 7f7531d37640 1 --2- 172.21.15.55:0/597373430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f752c0b1340 0x7f752c09d420 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f751400c3c0 tx=0x7f751400c880 comp rx=0 tx=0).stop 2023-07-06T21:42:37.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.371+0000 7f7531d37640 1 -- 172.21.15.55:0/597373430 shutdown_connections 2023-07-06T21:42:37.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.371+0000 7f7531d37640 1 --2- 172.21.15.55:0/597373430 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f750c066280 0x7f750c068730 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.371+0000 7f7531d37640 1 --2- 172.21.15.55:0/597373430 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f752c0cbe60 0x7f752c153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.371+0000 7f7531d37640 1 --2- 172.21.15.55:0/597373430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f752c0b1340 0x7f752c09d420 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.371+0000 7f7531d37640 1 --2- 172.21.15.55:0/597373430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f752c0709a0 0x7f752c09e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.371+0000 7f7531d37640 1 -- 172.21.15.55:0/597373430 >> 172.21.15.55:0/597373430 conn(0x7f752c0cea70 msgr2=0x7f752c0c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:37.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.371+0000 7f7531d37640 1 -- 172.21.15.55:0/597373430 shutdown_connections 2023-07-06T21:42:37.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.371+0000 7f7531d37640 1 -- 172.21.15.55:0/597373430 wait complete. 2023-07-06T21:42:37.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:42:37.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.535+0000 7fcb04c96640 1 Processor -- start 2023-07-06T21:42:37.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.535+0000 7fcb04c96640 1 -- start start 2023-07-06T21:42:37.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.535+0000 7fcb04c96640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcb00157290 0x7fcb0015a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.535+0000 7fcb04c96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb0015d2d0 0x7fcb0006e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.535+0000 7fcb04c96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb0015d710 0x7fcb0006ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.535+0000 7fcb04c96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb00159ce0 con 0x7fcb0015d710 2023-07-06T21:42:37.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.535+0000 7fcb04c96640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0015ac10 con 0x7fcb00157290 2023-07-06T21:42:37.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.535+0000 7fcb04c96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb00157660 con 0x7fcb0015d2d0 2023-07-06T21:42:37.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.535+0000 7fcafed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb0015d710 0x7fcb0006ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.535+0000 7fcafed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb0015d710 0x7fcb0006ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55322/0 (socket says 172.21.15.55:55322) 2023-07-06T21:42:37.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.535+0000 7fcafed9d640 1 -- 172.21.15.55:0/4183751888 learned_addr learned my addr 172.21.15.55:0/4183751888 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:37.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.539+0000 7fcaf7fff640 1 --2- 172.21.15.55:0/4183751888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb0015d2d0 0x7fcb0006e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.539+0000 7fcafe59c640 1 --2- 172.21.15.55:0/4183751888 >> v2:172.21.15.138:3300/0 conn(0x7fcb00157290 0x7fcb0015a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.539+0000 7fcafed9d640 1 -- 172.21.15.55:0/4183751888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb0015d2d0 msgr2=0x7fcb0006e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:37.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.539+0000 7fcafed9d640 1 --2- 172.21.15.55:0/4183751888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb0015d2d0 0x7fcb0006e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.539+0000 7fcafed9d640 1 -- 172.21.15.55:0/4183751888 >> v2:172.21.15.138:3300/0 conn(0x7fcb00157290 msgr2=0x7fcb0015a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:37.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.539+0000 7fcafed9d640 1 --2- 172.21.15.55:0/4183751888 >> v2:172.21.15.138:3300/0 conn(0x7fcb00157290 0x7fcb0015a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.539+0000 7fcafed9d640 1 -- 172.21.15.55:0/4183751888 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0015dc90 con 0x7fcb0015d710 2023-07-06T21:42:37.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.539+0000 7fcaf7fff640 1 --2- 172.21.15.55:0/4183751888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb0015d2d0 0x7fcb0006e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:37.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.539+0000 7fcafe59c640 1 --2- 172.21.15.55:0/4183751888 >> v2:172.21.15.138:3300/0 conn(0x7fcb00157290 0x7fcb0015a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:37.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.539+0000 7fcafed9d640 1 --2- 172.21.15.55:0/4183751888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb0015d710 0x7fcb0006ef10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcb0006fd20 tx=0x7fcaf801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35dc5edb5677a82 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:37.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.539+0000 7fcafdd9b640 1 -- 172.21.15.55:0/4183751888 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80a5850 con 0x7fcb0015d710 2023-07-06T21:42:37.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.539+0000 7fcafdd9b640 1 -- 172.21.15.55:0/4183751888 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf80a59b0 con 0x7fcb0015d710 2023-07-06T21:42:37.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.539+0000 7fcafdd9b640 1 -- 172.21.15.55:0/4183751888 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80a5d40 con 0x7fcb0015d710 2023-07-06T21:42:37.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 -- 172.21.15.55:0/4183751888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb0015d710 msgr2=0x7fcb0006ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 --2- 172.21.15.55:0/4183751888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb0015d710 0x7fcb0006ef10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcb0006fd20 tx=0x7fcaf801c9d0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 -- 172.21.15.55:0/4183751888 shutdown_connections 2023-07-06T21:42:37.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 --2- 172.21.15.55:0/4183751888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb0015d710 0x7fcb0006ef10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 --2- 172.21.15.55:0/4183751888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb0015d2d0 0x7fcb0006e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 --2- 172.21.15.55:0/4183751888 >> v2:172.21.15.138:3300/0 conn(0x7fcb00157290 0x7fcb0015a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 -- 172.21.15.55:0/4183751888 >> 172.21.15.55:0/4183751888 conn(0x7fcb000d0c50 msgr2=0x7fcb000cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:37.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 -- 172.21.15.55:0/4183751888 shutdown_connections 2023-07-06T21:42:37.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 -- 172.21.15.55:0/4183751888 wait complete. 2023-07-06T21:42:37.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 Processor -- start 2023-07-06T21:42:37.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 -- start start 2023-07-06T21:42:37.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb00157290 0x7fcb0014a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb0015d2d0 0x7fcb0006a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb0015d710 0x7fcb001522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb00151690 con 0x7fcb00157290 2023-07-06T21:42:37.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0014af10 con 0x7fcb0015d2d0 2023-07-06T21:42:37.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcb04c96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb001513b0 con 0x7fcb0015d710 2023-07-06T21:42:37.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcafe59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb00157290 0x7fcb0014a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcafe59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb00157290 0x7fcb0014a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55336/0 (socket says 172.21.15.55:55336) 2023-07-06T21:42:37.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcafe59c640 1 -- 172.21.15.55:0/2205640330 learned_addr learned my addr 172.21.15.55:0/2205640330 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:37.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcafed9d640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb0015d710 0x7fcb001522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcaf7fff640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb0015d2d0 0x7fcb0006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcafe59c640 1 -- 172.21.15.55:0/2205640330 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb0015d710 msgr2=0x7fcb001522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcafe59c640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb0015d710 0x7fcb001522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcafe59c640 1 -- 172.21.15.55:0/2205640330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb0015d2d0 msgr2=0x7fcb0006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcafe59c640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb0015d2d0 0x7fcb0006a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcafe59c640 1 -- 172.21.15.55:0/2205640330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf8009b30 con 0x7fcb00157290 2023-07-06T21:42:37.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.543+0000 7fcafed9d640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb0015d710 0x7fcb001522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:37.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.547+0000 7fcafe59c640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb00157290 0x7fcb0014a9d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000d800 tx=0x7fcaf000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:37.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.547+0000 7fcaf6ffd640 1 -- 172.21.15.55:0/2205640330 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0004030 con 0x7fcb00157290 2023-07-06T21:42:37.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.547+0000 7fcaf6ffd640 1 -- 172.21.15.55:0/2205640330 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf0004190 con 0x7fcb00157290 2023-07-06T21:42:37.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.547+0000 7fcaf6ffd640 1 -- 172.21.15.55:0/2205640330 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0004520 con 0x7fcb00157290 2023-07-06T21:42:37.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.547+0000 7fcb04c96640 1 -- 172.21.15.55:0/2205640330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0014bff0 con 0x7fcb00157290 2023-07-06T21:42:37.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.547+0000 7fcb04c96640 1 -- 172.21.15.55:0/2205640330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0014c5b0 con 0x7fcb00157290 2023-07-06T21:42:37.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.547+0000 7fcb04c96640 1 -- 172.21.15.55:0/2205640330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0014be50 con 0x7fcb00157290 2023-07-06T21:42:37.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.547+0000 7fcaf6ffd640 1 -- 172.21.15.55:0/2205640330 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcaf0009640 con 0x7fcb00157290 2023-07-06T21:42:37.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.547+0000 7fcaf6ffd640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcae0066280 0x7fcae0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.547+0000 7fcaf6ffd640 1 -- 172.21.15.55:0/2205640330 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcaf00842b0 con 0x7fcb00157290 2023-07-06T21:42:37.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.551+0000 7fcaf7fff640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcae0066280 0x7fcae0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.551+0000 7fcaf7fff640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcae0066280 0x7fcae0068730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcb001f79e0 tx=0x7fcae8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:37.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.551+0000 7fcaf6ffd640 1 -- 172.21.15.55:0/2205640330 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb0014be50 con 0x7fcb00157290 2023-07-06T21:42:37.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.707+0000 7fcb04c96640 1 -- 172.21.15.55:0/2205640330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb0014be50 con 0x7fcb00157290 2023-07-06T21:42:37.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.711+0000 7fcaf6ffd640 1 -- 172.21.15.55:0/2205640330 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb0014be50 con 0x7fcb00157290 2023-07-06T21:42:37.715 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:42:37.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.711+0000 7fcb04c96640 1 -- 172.21.15.55:0/2205640330 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcae0066280 msgr2=0x7fcae0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.711+0000 7fcb04c96640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcae0066280 0x7fcae0068730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcb001f79e0 tx=0x7fcae8008040 comp rx=0 tx=0).stop 2023-07-06T21:42:37.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.711+0000 7fcb04c96640 1 -- 172.21.15.55:0/2205640330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb00157290 msgr2=0x7fcb0014a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.711+0000 7fcb04c96640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb00157290 0x7fcb0014a9d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000d800 tx=0x7fcaf000dcc0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.711+0000 7fcb04c96640 1 -- 172.21.15.55:0/2205640330 shutdown_connections 2023-07-06T21:42:37.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.711+0000 7fcb04c96640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcae0066280 0x7fcae0068730 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.711+0000 7fcb04c96640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb0015d710 0x7fcb001522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.711+0000 7fcb04c96640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb0015d2d0 0x7fcb0006a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.711+0000 7fcb04c96640 1 --2- 172.21.15.55:0/2205640330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb00157290 0x7fcb0014a9d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.711+0000 7fcb04c96640 1 -- 172.21.15.55:0/2205640330 >> 172.21.15.55:0/2205640330 conn(0x7fcb000d0c50 msgr2=0x7fcb001552a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:37.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.711+0000 7fcb04c96640 1 -- 172.21.15.55:0/2205640330 shutdown_connections 2023-07-06T21:42:37.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.711+0000 7fcb04c96640 1 -- 172.21.15.55:0/2205640330 wait complete. 2023-07-06T21:42:37.736 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T21:42:37.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.875+0000 7f3c801c5640 1 Processor -- start 2023-07-06T21:42:37.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.875+0000 7f3c801c5640 1 -- start start 2023-07-06T21:42:37.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.875+0000 7f3c801c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c78158850 0x7f3c780cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.875+0000 7f3c801c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c78070af0 0x7f3c780ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.875+0000 7f3c801c5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c78158c20 con 0x7f3c780ca130 2023-07-06T21:42:37.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.875+0000 7f3c801c5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c780b2aa0 con 0x7f3c78070af0 2023-07-06T21:42:37.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.875+0000 7f3c801c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780c8db0 con 0x7f3c78158850 2023-07-06T21:42:37.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.875+0000 7f3c7e762640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c78070af0 0x7f3c780ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.875+0000 7f3c7e762640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c78070af0 0x7f3c780ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55350/0 (socket says 172.21.15.55:55350) 2023-07-06T21:42:37.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.875+0000 7f3c7e762640 1 -- 172.21.15.55:0/3919212128 learned_addr learned my addr 172.21.15.55:0/3919212128 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:37.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.875+0000 7f3c7df61640 1 --2- 172.21.15.55:0/3919212128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c78158850 0x7f3c780cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c7e762640 1 -- 172.21.15.55:0/3919212128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c78158850 msgr2=0x7f3c780cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:37.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c7e762640 1 --2- 172.21.15.55:0/3919212128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c78158850 0x7f3c780cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c7e762640 1 -- 172.21.15.55:0/3919212128 >> v1:172.21.15.138:6789/0 conn(0x7f3c780ca130 legacy=0x7f3c780703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:37.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c7e762640 1 -- 172.21.15.55:0/3919212128 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c780c9090 con 0x7f3c78070af0 2023-07-06T21:42:37.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c7df61640 1 --2- 172.21.15.55:0/3919212128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c78158850 0x7f3c780cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:37.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c7e762640 1 --2- 172.21.15.55:0/3919212128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c78070af0 0x7f3c780ccf70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009e50 tx=0x7f3c7001f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc92bd063930d02 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:37.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c7cf5f640 1 -- 172.21.15.55:0/3919212128 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c700af400 con 0x7f3c78070af0 2023-07-06T21:42:37.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c7cf5f640 1 -- 172.21.15.55:0/3919212128 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c700ab050 con 0x7f3c78070af0 2023-07-06T21:42:37.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c7cf5f640 1 -- 172.21.15.55:0/3919212128 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c700af780 con 0x7f3c78070af0 2023-07-06T21:42:37.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c801c5640 1 -- 172.21.15.55:0/3919212128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c78070af0 msgr2=0x7f3c780ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c801c5640 1 --2- 172.21.15.55:0/3919212128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c78070af0 0x7f3c780ccf70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009e50 tx=0x7f3c7001f1f0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c801c5640 1 -- 172.21.15.55:0/3919212128 shutdown_connections 2023-07-06T21:42:37.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c801c5640 1 --2- 172.21.15.55:0/3919212128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c78070af0 0x7f3c780ccf70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c801c5640 1 --2- 172.21.15.55:0/3919212128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c78158850 0x7f3c780cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.879+0000 7f3c801c5640 1 -- 172.21.15.55:0/3919212128 >> 172.21.15.55:0/3919212128 conn(0x7f3c780cea70 msgr2=0x7f3c780ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:37.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c801c5640 1 -- 172.21.15.55:0/3919212128 shutdown_connections 2023-07-06T21:42:37.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c801c5640 1 -- 172.21.15.55:0/3919212128 wait complete. 2023-07-06T21:42:37.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c801c5640 1 Processor -- start 2023-07-06T21:42:37.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c801c5640 1 -- start start 2023-07-06T21:42:37.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c801c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c78070af0 0x7f3c780b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c801c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c780ca130 0x7f3c780b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c801c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c78158850 0x7f3c780b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c801c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780b4190 con 0x7f3c780ca130 2023-07-06T21:42:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c801c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7814f560 con 0x7f3c78070af0 2023-07-06T21:42:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c801c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780b7aa0 con 0x7f3c78158850 2023-07-06T21:42:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c7d760640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c780ca130 0x7f3c780b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c7df61640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c78070af0 0x7f3c780b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c7d760640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c780ca130 0x7f3c780b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55358/0 (socket says 172.21.15.55:55358) 2023-07-06T21:42:37.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c7d760640 1 -- 172.21.15.55:0/2993682345 learned_addr learned my addr 172.21.15.55:0/2993682345 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:37.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c7e762640 1 --2- 172.21.15.55:0/2993682345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c78158850 0x7f3c780b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c7d760640 1 -- 172.21.15.55:0/2993682345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c78158850 msgr2=0x7f3c780b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c7d760640 1 --2- 172.21.15.55:0/2993682345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c78158850 0x7f3c780b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c7d760640 1 -- 172.21.15.55:0/2993682345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c78070af0 msgr2=0x7f3c780b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:37.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c7d760640 1 --2- 172.21.15.55:0/2993682345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c78070af0 0x7f3c780b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:37.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c7d760640 1 -- 172.21.15.55:0/2993682345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c70009b30 con 0x7f3c780ca130 2023-07-06T21:42:37.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c7df61640 1 --2- 172.21.15.55:0/2993682345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c78070af0 0x7f3c780b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:37.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.883+0000 7f3c7d760640 1 --2- 172.21.15.55:0/2993682345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c780ca130 0x7f3c780b54d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800c500 tx=0x7f3c6800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:37.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.887+0000 7f3c6e7fc640 1 -- 172.21.15.55:0/2993682345 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c68005220 con 0x7f3c780ca130 2023-07-06T21:42:37.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.887+0000 7f3c6e7fc640 1 -- 172.21.15.55:0/2993682345 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c68005380 con 0x7f3c780ca130 2023-07-06T21:42:37.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.887+0000 7f3c6e7fc640 1 -- 172.21.15.55:0/2993682345 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c68007270 con 0x7f3c780ca130 2023-07-06T21:42:37.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.887+0000 7f3c801c5640 1 -- 172.21.15.55:0/2993682345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c780b7d40 con 0x7f3c780ca130 2023-07-06T21:42:37.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.887+0000 7f3c801c5640 1 -- 172.21.15.55:0/2993682345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c780b8300 con 0x7f3c780ca130 2023-07-06T21:42:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.887+0000 7f3c801c5640 1 -- 172.21.15.55:0/2993682345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c780b84f0 con 0x7f3c780ca130 2023-07-06T21:42:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.887+0000 7f3c6e7fc640 1 -- 172.21.15.55:0/2993682345 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3c680073d0 con 0x7f3c780ca130 2023-07-06T21:42:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.887+0000 7f3c6e7fc640 1 --2- 172.21.15.55:0/2993682345 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3c5c066280 0x7f3c5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:37.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.887+0000 7f3c6e7fc640 1 -- 172.21.15.55:0/2993682345 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3c68083850 con 0x7f3c780ca130 2023-07-06T21:42:37.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.887+0000 7f3c7df61640 1 --2- 172.21.15.55:0/2993682345 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3c5c066280 0x7f3c5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:37.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.887+0000 7f3c7df61640 1 --2- 172.21.15.55:0/2993682345 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3c5c066280 0x7f3c5c068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3c74006fd0 tx=0x7f3c74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:37.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:37.891+0000 7f3c6e7fc640 1 -- 172.21.15.55:0/2993682345 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3c68050aa0 con 0x7f3c780ca130 2023-07-06T21:42:38.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.047+0000 7f3c801c5640 1 -- 172.21.15.55:0/2993682345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3c78066d60 con 0x7f3c780ca130 2023-07-06T21:42:38.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.047+0000 7f3c6e7fc640 1 -- 172.21.15.55:0/2993682345 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3c680540c0 con 0x7f3c780ca130 2023-07-06T21:42:38.052 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:38.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.047+0000 7f3c801c5640 1 -- 172.21.15.55:0/2993682345 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3c5c066280 msgr2=0x7f3c5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.047+0000 7f3c801c5640 1 --2- 172.21.15.55:0/2993682345 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3c5c066280 0x7f3c5c068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3c74006fd0 tx=0x7f3c74008040 comp rx=0 tx=0).stop 2023-07-06T21:42:38.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.047+0000 7f3c801c5640 1 -- 172.21.15.55:0/2993682345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c780ca130 msgr2=0x7f3c780b54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.047+0000 7f3c801c5640 1 --2- 172.21.15.55:0/2993682345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c780ca130 0x7f3c780b54d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800c500 tx=0x7f3c6800c9c0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.047+0000 7f3c801c5640 1 -- 172.21.15.55:0/2993682345 shutdown_connections 2023-07-06T21:42:38.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.047+0000 7f3c801c5640 1 --2- 172.21.15.55:0/2993682345 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3c5c066280 0x7f3c5c068730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.047+0000 7f3c801c5640 1 --2- 172.21.15.55:0/2993682345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c78158850 0x7f3c780b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.047+0000 7f3c801c5640 1 --2- 172.21.15.55:0/2993682345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c780ca130 0x7f3c780b54d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.047+0000 7f3c801c5640 1 --2- 172.21.15.55:0/2993682345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c78070af0 0x7f3c780b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.047+0000 7f3c801c5640 1 -- 172.21.15.55:0/2993682345 >> 172.21.15.55:0/2993682345 conn(0x7f3c780cea70 msgr2=0x7f3c781533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:38.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.047+0000 7f3c801c5640 1 -- 172.21.15.55:0/2993682345 shutdown_connections 2023-07-06T21:42:38.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.047+0000 7f3c801c5640 1 -- 172.21.15.55:0/2993682345 wait complete. 2023-07-06T21:42:38.072 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:42:38.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.207+0000 7f9a2632c640 1 Processor -- start 2023-07-06T21:42:38.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.207+0000 7f9a2632c640 1 -- start start 2023-07-06T21:42:38.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.211+0000 7f9a2632c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a2015f740 0x7f9a2015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.211+0000 7f9a2632c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a200b5b50 con 0x7f9a200cb4a0 2023-07-06T21:42:38.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.211+0000 7f9a2632c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2015d130 con 0x7f9a200cbc70 2023-07-06T21:42:38.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.211+0000 7f9a2632c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a200cc8e0 con 0x7f9a2015f740 2023-07-06T21:42:38.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.211+0000 7f9a1ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9a200cb4a0 0x7f9a200ca720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38454/0 (socket says 172.21.15.55:38454) 2023-07-06T21:42:38.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.211+0000 7f9a1ffff640 1 -- 172.21.15.55:0/689610108 learned_addr learned my addr 172.21.15.55:0/689610108 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:38.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.211+0000 7f9a1f7fe640 1 --2- 172.21.15.55:0/689610108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a2015f740 0x7f9a2015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.211+0000 7f9a1effd640 1 -- 172.21.15.55:0/689610108 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760489444 0 0) 0x7f9a200b5b50 con 0x7f9a200cb4a0 2023-07-06T21:42:38.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.211+0000 7f9a1effd640 1 -- 172.21.15.55:0/689610108 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a08003530 con 0x7f9a200cb4a0 2023-07-06T21:42:38.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.211+0000 7f9a1effd640 1 -- 172.21.15.55:0/689610108 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166895638 0 0) 0x7f9a2015d130 con 0x7f9a200cbc70 2023-07-06T21:42:38.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.211+0000 7f9a1effd640 1 -- 172.21.15.55:0/689610108 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a200b5b50 con 0x7f9a200cbc70 2023-07-06T21:42:38.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.211+0000 7f9a1f7fe640 1 -- 172.21.15.55:0/689610108 >> v1:172.21.15.138:6789/0 conn(0x7f9a200cbc70 legacy=0x7f9a200cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.211+0000 7f9a1f7fe640 1 -- 172.21.15.55:0/689610108 >> v1:172.21.15.55:6789/0 conn(0x7f9a200cb4a0 legacy=0x7f9a200ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.211+0000 7f9a1f7fe640 1 -- 172.21.15.55:0/689610108 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2015fc00 con 0x7f9a2015f740 2023-07-06T21:42:38.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.215+0000 7f9a1f7fe640 1 --2- 172.21.15.55:0/689610108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a2015f740 0x7f9a2015cbf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a140097f0 tx=0x7f9a1401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3052cf1257e707b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:38.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.215+0000 7f9a1effd640 1 -- 172.21.15.55:0/689610108 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a140ac410 con 0x7f9a2015f740 2023-07-06T21:42:38.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.215+0000 7f9a1effd640 1 -- 172.21.15.55:0/689610108 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a140ac570 con 0x7f9a2015f740 2023-07-06T21:42:38.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.215+0000 7f9a1effd640 1 -- 172.21.15.55:0/689610108 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a140ac900 con 0x7f9a2015f740 2023-07-06T21:42:38.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.215+0000 7f9a2632c640 1 -- 172.21.15.55:0/689610108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a2015f740 msgr2=0x7f9a2015cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.215+0000 7f9a2632c640 1 --2- 172.21.15.55:0/689610108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a2015f740 0x7f9a2015cbf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a140097f0 tx=0x7f9a1401c4c0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.215+0000 7f9a2632c640 1 -- 172.21.15.55:0/689610108 shutdown_connections 2023-07-06T21:42:38.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.215+0000 7f9a2632c640 1 --2- 172.21.15.55:0/689610108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a2015f740 0x7f9a2015cbf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.215+0000 7f9a2632c640 1 -- 172.21.15.55:0/689610108 >> 172.21.15.55:0/689610108 conn(0x7f9a2006ee80 msgr2=0x7f9a2006f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:38.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.215+0000 7f9a2632c640 1 -- 172.21.15.55:0/689610108 shutdown_connections 2023-07-06T21:42:38.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.215+0000 7f9a2632c640 1 -- 172.21.15.55:0/689610108 wait complete. 2023-07-06T21:42:38.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.215+0000 7f9a2632c640 1 Processor -- start 2023-07-06T21:42:38.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.215+0000 7f9a2632c640 1 -- start start 2023-07-06T21:42:38.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a2632c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a200cb4a0 0x7f9a201538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a2632c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a200cbc70 0x7f9a20153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a2632c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a2015f740 0x7f9a200ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a2632c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a200c7c50 con 0x7f9a200cb4a0 2023-07-06T21:42:38.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a2632c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a200c7320 con 0x7f9a200cbc70 2023-07-06T21:42:38.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a2632c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a200c7600 con 0x7f9a2015f740 2023-07-06T21:42:38.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a1ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a200cb4a0 0x7f9a201538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a1ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a200cb4a0 0x7f9a201538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55372/0 (socket says 172.21.15.55:55372) 2023-07-06T21:42:38.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a1ffff640 1 -- 172.21.15.55:0/667136695 learned_addr learned my addr 172.21.15.55:0/667136695 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:38.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a1ffff640 1 -- 172.21.15.55:0/667136695 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a2015f740 msgr2=0x7f9a200ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a1ffff640 1 --2- 172.21.15.55:0/667136695 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a2015f740 0x7f9a200ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a1ffff640 1 -- 172.21.15.55:0/667136695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a200cbc70 msgr2=0x7f9a20153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a1ffff640 1 --2- 172.21.15.55:0/667136695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a200cbc70 0x7f9a20153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a1ffff640 1 -- 172.21.15.55:0/667136695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a14009420 con 0x7f9a200cb4a0 2023-07-06T21:42:38.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a1ffff640 1 --2- 172.21.15.55:0/667136695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a200cb4a0 0x7f9a201538b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000c4d0 tx=0x7f9a1000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:38.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a1cff9640 1 -- 172.21.15.55:0/667136695 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10005cf0 con 0x7f9a200cb4a0 2023-07-06T21:42:38.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a1cff9640 1 -- 172.21.15.55:0/667136695 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a10005e50 con 0x7f9a200cb4a0 2023-07-06T21:42:38.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a1cff9640 1 -- 172.21.15.55:0/667136695 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10007270 con 0x7f9a200cb4a0 2023-07-06T21:42:38.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a2632c640 1 -- 172.21.15.55:0/667136695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a200c78e0 con 0x7f9a200cb4a0 2023-07-06T21:42:38.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a2632c640 1 -- 172.21.15.55:0/667136695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2015acb0 con 0x7f9a200cb4a0 2023-07-06T21:42:38.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a2632c640 1 -- 172.21.15.55:0/667136695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a200cac80 con 0x7f9a200cb4a0 2023-07-06T21:42:38.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.219+0000 7f9a1cff9640 1 -- 172.21.15.55:0/667136695 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a100073d0 con 0x7f9a200cb4a0 2023-07-06T21:42:38.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.223+0000 7f9a1cff9640 1 --2- 172.21.15.55:0/667136695 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9a0c066280 0x7f9a0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.223+0000 7f9a1cff9640 1 -- 172.21.15.55:0/667136695 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9a10083530 con 0x7f9a200cb4a0 2023-07-06T21:42:38.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.223+0000 7f9a1f7fe640 1 --2- 172.21.15.55:0/667136695 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9a0c066280 0x7f9a0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.223+0000 7f9a1f7fe640 1 --2- 172.21.15.55:0/667136695 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9a0c066280 0x7f9a0c068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a140ae000 tx=0x7f9a14004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:38.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.227+0000 7f9a1cff9640 1 -- 172.21.15.55:0/667136695 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a100541f0 con 0x7f9a200cb4a0 2023-07-06T21:42:38.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.411+0000 7f9a2632c640 1 -- 172.21.15.55:0/667136695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a20066d60 con 0x7f9a200cb4a0 2023-07-06T21:42:38.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.415+0000 7f9a1cff9640 1 -- 172.21.15.55:0/667136695 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4667 (secure 0 0 0) 0x7f9a10053d80 con 0x7f9a200cb4a0 2023-07-06T21:42:38.420 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:38.420 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/720785920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":720785920},{"type":"v1","addr":"172.21.15.138:6834","nonce":720785920}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3780018439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3780018439},{"type":"v1","addr":"172.21.15.138:6835","nonce":3780018439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/690984517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":690984517},{"type":"v1","addr":"172.21.15.55:6837","nonce":690984517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:42:10.854280+0000","modified":"2023-07-06T21:42:29.371982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/1421414378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1421414378},{"type":"v1","addr":"172.21.15.55:6836","nonce":1421414378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T21:42:38.420 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-07-06T21:42:38.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.415+0000 7f9a2632c640 1 -- 172.21.15.55:0/667136695 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9a0c066280 msgr2=0x7f9a0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.415+0000 7f9a2632c640 1 --2- 172.21.15.55:0/667136695 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9a0c066280 0x7f9a0c068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a140ae000 tx=0x7f9a14004740 comp rx=0 tx=0).stop 2023-07-06T21:42:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.415+0000 7f9a2632c640 1 -- 172.21.15.55:0/667136695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a200cb4a0 msgr2=0x7f9a201538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.415+0000 7f9a2632c640 1 --2- 172.21.15.55:0/667136695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a200cb4a0 0x7f9a201538b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000c4d0 tx=0x7f9a1000c990 comp rx=0 tx=0).stop 2023-07-06T21:42:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.415+0000 7f9a2632c640 1 -- 172.21.15.55:0/667136695 shutdown_connections 2023-07-06T21:42:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.415+0000 7f9a2632c640 1 --2- 172.21.15.55:0/667136695 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9a0c066280 0x7f9a0c068730 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.415+0000 7f9a2632c640 1 --2- 172.21.15.55:0/667136695 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a2015f740 0x7f9a200ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.415+0000 7f9a2632c640 1 --2- 172.21.15.55:0/667136695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a200cbc70 0x7f9a20153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.415+0000 7f9a2632c640 1 --2- 172.21.15.55:0/667136695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a200cb4a0 0x7f9a201538b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.415+0000 7f9a2632c640 1 -- 172.21.15.55:0/667136695 >> 172.21.15.55:0/667136695 conn(0x7f9a2006ee80 msgr2=0x7f9a20157660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.415+0000 7f9a2632c640 1 -- 172.21.15.55:0/667136695 shutdown_connections 2023-07-06T21:42:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.415+0000 7f9a2632c640 1 -- 172.21.15.55:0/667136695 wait complete. 2023-07-06T21:42:38.442 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:38.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.579+0000 7f2df6740640 1 Processor -- start 2023-07-06T21:42:38.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.579+0000 7f2df6740640 1 -- start start 2023-07-06T21:42:38.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.579+0000 7f2df6740640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2df00712f0 0x7f2df006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.579+0000 7f2df6740640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2df00ca450 0x7f2df015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.579+0000 7f2df6740640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df0159cd0 con 0x7f2df00b3730 2023-07-06T21:42:38.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.579+0000 7f2df6740640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df00693f0 con 0x7f2df00ca450 2023-07-06T21:42:38.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.579+0000 7f2df6740640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df006aca0 con 0x7f2df00712f0 2023-07-06T21:42:38.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.579+0000 7f2df4cdd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2df00ca450 0x7f2df015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.579+0000 7f2def7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2df00b3730 0x7f2df00c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38464/0 (socket says 172.21.15.55:38464) 2023-07-06T21:42:38.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.579+0000 7f2def7fe640 1 -- 172.21.15.55:0/3702138622 learned_addr learned my addr 172.21.15.55:0/3702138622 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:38.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.583+0000 7f2deffff640 1 --2- 172.21.15.55:0/3702138622 >> v2:172.21.15.138:3300/0 conn(0x7f2df00712f0 0x7f2df006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.583+0000 7f2df4cdd640 1 -- 172.21.15.55:0/3702138622 >> v2:172.21.15.138:3300/0 conn(0x7f2df00712f0 msgr2=0x7f2df006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:38.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.583+0000 7f2df4cdd640 1 --2- 172.21.15.55:0/3702138622 >> v2:172.21.15.138:3300/0 conn(0x7f2df00712f0 0x7f2df006a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.583+0000 7f2df4cdd640 1 -- 172.21.15.55:0/3702138622 >> v1:172.21.15.55:6789/0 conn(0x7f2df00b3730 legacy=0x7f2df00c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.583+0000 7f2df4cdd640 1 -- 172.21.15.55:0/3702138622 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df00696b0 con 0x7f2df00ca450 2023-07-06T21:42:38.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.583+0000 7f2deeffd640 1 -- 172.21.15.55:0/3702138622 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320345770 0 0) 0x7f2df0159cd0 con 0x7f2df00b3730 2023-07-06T21:42:38.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.583+0000 7f2df4cdd640 1 --2- 172.21.15.55:0/3702138622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df00ca450 0x7f2df015d3e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2df0071950 tx=0x7f2de801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234ab8bdf02306c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:38.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.583+0000 7f2deeffd640 1 -- 172.21.15.55:0/3702138622 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de80a59a0 con 0x7f2df00ca450 2023-07-06T21:42:38.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.583+0000 7f2deeffd640 1 -- 172.21.15.55:0/3702138622 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de80a5b00 con 0x7f2df00ca450 2023-07-06T21:42:38.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.583+0000 7f2deeffd640 1 -- 172.21.15.55:0/3702138622 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de80a5e90 con 0x7f2df00ca450 2023-07-06T21:42:38.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 -- 172.21.15.55:0/3702138622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df00ca450 msgr2=0x7f2df015d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 --2- 172.21.15.55:0/3702138622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df00ca450 0x7f2df015d3e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2df0071950 tx=0x7f2de801c8e0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 -- 172.21.15.55:0/3702138622 shutdown_connections 2023-07-06T21:42:38.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 --2- 172.21.15.55:0/3702138622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df00ca450 0x7f2df015d3e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 --2- 172.21.15.55:0/3702138622 >> v2:172.21.15.138:3300/0 conn(0x7f2df00712f0 0x7f2df006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 -- 172.21.15.55:0/3702138622 >> 172.21.15.55:0/3702138622 conn(0x7f2df00cded0 msgr2=0x7f2df00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:38.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 -- 172.21.15.55:0/3702138622 shutdown_connections 2023-07-06T21:42:38.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 -- 172.21.15.55:0/3702138622 wait complete. 2023-07-06T21:42:38.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 Processor -- start 2023-07-06T21:42:38.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 -- start start 2023-07-06T21:42:38.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df00712f0 0x7f2df00cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2df00b3730 0x7f2df01fbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2df00ca450 0x7f2df00cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df00cc8e0 con 0x7f2df00712f0 2023-07-06T21:42:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df00ccbc0 con 0x7f2df00b3730 2023-07-06T21:42:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df6740640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df01fb6b0 con 0x7f2df00ca450 2023-07-06T21:42:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2deffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df00712f0 0x7f2df00cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2deffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df00712f0 0x7f2df00cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55390/0 (socket says 172.21.15.55:55390) 2023-07-06T21:42:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2deffff640 1 -- 172.21.15.55:0/2619334040 learned_addr learned my addr 172.21.15.55:0/2619334040 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2df4cdd640 1 --2- 172.21.15.55:0/2619334040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2df00ca450 0x7f2df00cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2def7fe640 1 --2- 172.21.15.55:0/2619334040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2df00b3730 0x7f2df01fbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2deffff640 1 -- 172.21.15.55:0/2619334040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2df00ca450 msgr2=0x7f2df00cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2deffff640 1 --2- 172.21.15.55:0/2619334040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2df00ca450 0x7f2df00cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2deffff640 1 -- 172.21.15.55:0/2619334040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2df00b3730 msgr2=0x7f2df01fbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2deffff640 1 --2- 172.21.15.55:0/2619334040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2df00b3730 0x7f2df01fbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2deffff640 1 -- 172.21.15.55:0/2619334040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de8009a70 con 0x7f2df00712f0 2023-07-06T21:42:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.587+0000 7f2deffff640 1 --2- 172.21.15.55:0/2619334040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df00712f0 0x7f2df00cd660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2de000e870 tx=0x7f2de000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:38.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.591+0000 7f2decff9640 1 -- 172.21.15.55:0/2619334040 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0009510 con 0x7f2df00712f0 2023-07-06T21:42:38.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.591+0000 7f2decff9640 1 -- 172.21.15.55:0/2619334040 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de000eec0 con 0x7f2df00712f0 2023-07-06T21:42:38.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.591+0000 7f2decff9640 1 -- 172.21.15.55:0/2619334040 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de000cb40 con 0x7f2df00712f0 2023-07-06T21:42:38.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.591+0000 7f2df6740640 1 -- 172.21.15.55:0/2619334040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df01fb990 con 0x7f2df00712f0 2023-07-06T21:42:38.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.591+0000 7f2df6740640 1 -- 172.21.15.55:0/2619334040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df00cc4b0 con 0x7f2df00712f0 2023-07-06T21:42:38.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.591+0000 7f2df6740640 1 -- 172.21.15.55:0/2619334040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df00ccde0 con 0x7f2df00712f0 2023-07-06T21:42:38.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.591+0000 7f2decff9640 1 -- 172.21.15.55:0/2619334040 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2de000cca0 con 0x7f2df00712f0 2023-07-06T21:42:38.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.591+0000 7f2decff9640 1 --2- 172.21.15.55:0/2619334040 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2ddc066280 0x7f2ddc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.591+0000 7f2decff9640 1 -- 172.21.15.55:0/2619334040 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2de0084140 con 0x7f2df00712f0 2023-07-06T21:42:38.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.591+0000 7f2def7fe640 1 --2- 172.21.15.55:0/2619334040 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2ddc066280 0x7f2ddc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.591+0000 7f2def7fe640 1 --2- 172.21.15.55:0/2619334040 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2ddc066280 0x7f2ddc068730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2df00c4ea0 tx=0x7f2de4007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:38.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.595+0000 7f2decff9640 1 -- 172.21.15.55:0/2619334040 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2de00512c0 con 0x7f2df00712f0 2023-07-06T21:42:38.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.751+0000 7f2df6740640 1 -- 172.21.15.55:0/2619334040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2df0066d60 con 0x7f2df00712f0 2023-07-06T21:42:38.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.755+0000 7f2decff9640 1 -- 172.21.15.55:0/2619334040 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f2de00548e0 con 0x7f2df00712f0 2023-07-06T21:42:38.760 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:38.760 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:15.295464+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.755+0000 7f2df6740640 1 -- 172.21.15.55:0/2619334040 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2ddc066280 msgr2=0x7f2ddc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.755+0000 7f2df6740640 1 --2- 172.21.15.55:0/2619334040 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2ddc066280 0x7f2ddc068730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2df00c4ea0 tx=0x7f2de4007b60 comp rx=0 tx=0).stop 2023-07-06T21:42:38.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.755+0000 7f2df6740640 1 -- 172.21.15.55:0/2619334040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df00712f0 msgr2=0x7f2df00cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.755+0000 7f2df6740640 1 --2- 172.21.15.55:0/2619334040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df00712f0 0x7f2df00cd660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2de000e870 tx=0x7f2de000ec70 comp rx=0 tx=0).stop 2023-07-06T21:42:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.755+0000 7f2df6740640 1 -- 172.21.15.55:0/2619334040 shutdown_connections 2023-07-06T21:42:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.755+0000 7f2df6740640 1 --2- 172.21.15.55:0/2619334040 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2ddc066280 0x7f2ddc068730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.755+0000 7f2df6740640 1 --2- 172.21.15.55:0/2619334040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2df00ca450 0x7f2df00cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.755+0000 7f2df6740640 1 --2- 172.21.15.55:0/2619334040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2df00b3730 0x7f2df01fbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.755+0000 7f2df6740640 1 --2- 172.21.15.55:0/2619334040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df00712f0 0x7f2df00cd660 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.755+0000 7f2df6740640 1 -- 172.21.15.55:0/2619334040 >> 172.21.15.55:0/2619334040 conn(0x7f2df00cded0 msgr2=0x7f2df00b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.755+0000 7f2df6740640 1 -- 172.21.15.55:0/2619334040 shutdown_connections 2023-07-06T21:42:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.755+0000 7f2df6740640 1 -- 172.21.15.55:0/2619334040 wait complete. 2023-07-06T21:42:38.781 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:42:08.597013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:42:09.843890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T21:42:12.918111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T21:42:38.782 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:42:38.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.923+0000 7fdd9aa9e640 1 Processor -- start 2023-07-06T21:42:38.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.923+0000 7fdd9aa9e640 1 -- start start 2023-07-06T21:42:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd9aa9e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd940d0630 0x7fdd9415fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd9aa9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd940ce200 0x7fdd940ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd9aa9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd940cc740 con 0x7fdd940b1250 2023-07-06T21:42:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd9aa9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd940ccc90 con 0x7fdd940ce200 2023-07-06T21:42:38.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd9aa9e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940b29c0 con 0x7fdd940d0630 2023-07-06T21:42:38.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd99a9c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdd940b1250 0x7fdd9415f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38478/0 (socket says 172.21.15.55:38478) 2023-07-06T21:42:38.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd99a9c640 1 -- 172.21.15.55:0/1181518150 learned_addr learned my addr 172.21.15.55:0/1181518150 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:38.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd9a29d640 1 --2- 172.21.15.55:0/1181518150 >> v2:172.21.15.55:3300/0 conn(0x7fdd940ce200 0x7fdd940ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd9929b640 1 --2- 172.21.15.55:0/1181518150 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd940d0630 0x7fdd9415fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd9a29d640 1 -- 172.21.15.55:0/1181518150 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd940d0630 msgr2=0x7fdd9415fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:38.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd9a29d640 1 --2- 172.21.15.55:0/1181518150 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd940d0630 0x7fdd9415fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd9a29d640 1 -- 172.21.15.55:0/1181518150 >> v1:172.21.15.55:6789/0 conn(0x7fdd940b1250 legacy=0x7fdd9415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd9a29d640 1 -- 172.21.15.55:0/1181518150 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd940d1d10 con 0x7fdd940ce200 2023-07-06T21:42:38.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd98a9a640 1 -- 172.21.15.55:0/1181518150 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248253570 0 0) 0x7fdd940cc740 con 0x7fdd940b1250 2023-07-06T21:42:38.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.927+0000 7fdd9929b640 1 --2- 172.21.15.55:0/1181518150 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd940d0630 0x7fdd9415fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:38.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.931+0000 7fdd9a29d640 1 --2- 172.21.15.55:0/1181518150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd940ce200 0x7fdd940ce680 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009d90 tx=0x7fdd8c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84347953116fbea server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:38.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.931+0000 7fdd98a9a640 1 -- 172.21.15.55:0/1181518150 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0a5870 con 0x7fdd940ce200 2023-07-06T21:42:38.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.931+0000 7fdd98a9a640 1 -- 172.21.15.55:0/1181518150 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c0a59d0 con 0x7fdd940ce200 2023-07-06T21:42:38.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.931+0000 7fdd98a9a640 1 -- 172.21.15.55:0/1181518150 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0a5d60 con 0x7fdd940ce200 2023-07-06T21:42:38.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.931+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1181518150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd940ce200 msgr2=0x7fdd940ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.931+0000 7fdd9aa9e640 1 --2- 172.21.15.55:0/1181518150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd940ce200 0x7fdd940ce680 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009d90 tx=0x7fdd8c01c8c0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.931+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1181518150 shutdown_connections 2023-07-06T21:42:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.931+0000 7fdd9aa9e640 1 --2- 172.21.15.55:0/1181518150 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd940d0630 0x7fdd9415fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.931+0000 7fdd9aa9e640 1 --2- 172.21.15.55:0/1181518150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd940ce200 0x7fdd940ce680 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.931+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1181518150 >> 172.21.15.55:0/1181518150 conn(0x7fdd940b3b60 msgr2=0x7fdd940b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.931+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1181518150 shutdown_connections 2023-07-06T21:42:38.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.931+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1181518150 wait complete. 2023-07-06T21:42:38.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.931+0000 7fdd9aa9e640 1 Processor -- start 2023-07-06T21:42:38.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.931+0000 7fdd9aa9e640 1 -- start start 2023-07-06T21:42:38.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9aa9e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd940b1250 0x7fdd9406a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9aa9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd940ce200 0x7fdd94151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9aa9e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd940d0630 0x7fdd9414f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9aa9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9415d5b0 con 0x7fdd940ce200 2023-07-06T21:42:38.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9aa9e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940c69d0 con 0x7fdd940b1250 2023-07-06T21:42:38.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9aa9e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9415cf60 con 0x7fdd940d0630 2023-07-06T21:42:38.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9929b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd940ce200 0x7fdd94151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9929b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd940ce200 0x7fdd94151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55416/0 (socket says 172.21.15.55:55416) 2023-07-06T21:42:38.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9929b640 1 -- 172.21.15.55:0/1309066734 learned_addr learned my addr 172.21.15.55:0/1309066734 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:38.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd99a9c640 1 --2- 172.21.15.55:0/1309066734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd940b1250 0x7fdd9406a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9a29d640 1 --2- 172.21.15.55:0/1309066734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd940d0630 0x7fdd9414f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9929b640 1 -- 172.21.15.55:0/1309066734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd940d0630 msgr2=0x7fdd9414f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9929b640 1 --2- 172.21.15.55:0/1309066734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd940d0630 0x7fdd9414f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9929b640 1 -- 172.21.15.55:0/1309066734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd940b1250 msgr2=0x7fdd9406a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9929b640 1 --2- 172.21.15.55:0/1309066734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd940b1250 0x7fdd9406a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9929b640 1 -- 172.21.15.55:0/1309066734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c009a70 con 0x7fdd940ce200 2023-07-06T21:42:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9929b640 1 --2- 172.21.15.55:0/1309066734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd940ce200 0x7fdd94151190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400e810 tx=0x7fdd8400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd8a7fc640 1 -- 172.21.15.55:0/1309066734 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400c8d0 con 0x7fdd940ce200 2023-07-06T21:42:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd8a7fc640 1 -- 172.21.15.55:0/1309066734 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8400ca30 con 0x7fdd940ce200 2023-07-06T21:42:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1309066734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9415d240 con 0x7fdd940ce200 2023-07-06T21:42:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd8a7fc640 1 -- 172.21.15.55:0/1309066734 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400cdc0 con 0x7fdd940ce200 2023-07-06T21:42:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1309066734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9415da40 con 0x7fdd940ce200 2023-07-06T21:42:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1309066734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9415d720 con 0x7fdd940ce200 2023-07-06T21:42:38.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.935+0000 7fdd8a7fc640 1 -- 172.21.15.55:0/1309066734 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdd84013410 con 0x7fdd940ce200 2023-07-06T21:42:38.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.939+0000 7fdd8a7fc640 1 --2- 172.21.15.55:0/1309066734 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fdd78066280 0x7fdd78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:38.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.939+0000 7fdd8a7fc640 1 -- 172.21.15.55:0/1309066734 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdd84083e20 con 0x7fdd940ce200 2023-07-06T21:42:38.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.939+0000 7fdd99a9c640 1 --2- 172.21.15.55:0/1309066734 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fdd78066280 0x7fdd78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:38.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.939+0000 7fdd99a9c640 1 --2- 172.21.15.55:0/1309066734 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fdd78066280 0x7fdd78068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdd90000f70 tx=0x7fdd90007c10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:38.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:38.943+0000 7fdd8a7fc640 1 -- 172.21.15.55:0/1309066734 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd84050fa0 con 0x7fdd940ce200 2023-07-06T21:42:39.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.095+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1309066734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd9404d790 con 0x7fdd940ce200 2023-07-06T21:42:39.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.095+0000 7fdd8a7fc640 1 -- 172.21.15.55:0/1309066734 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd840545c0 con 0x7fdd940ce200 2023-07-06T21:42:39.102 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:42:39.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.099+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1309066734 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fdd78066280 msgr2=0x7fdd78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.099+0000 7fdd9aa9e640 1 --2- 172.21.15.55:0/1309066734 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fdd78066280 0x7fdd78068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdd90000f70 tx=0x7fdd90007c10 comp rx=0 tx=0).stop 2023-07-06T21:42:39.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.099+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1309066734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd940ce200 msgr2=0x7fdd94151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.099+0000 7fdd9aa9e640 1 --2- 172.21.15.55:0/1309066734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd940ce200 0x7fdd94151190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400e810 tx=0x7fdd8400ecd0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.099+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1309066734 shutdown_connections 2023-07-06T21:42:39.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.099+0000 7fdd9aa9e640 1 --2- 172.21.15.55:0/1309066734 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fdd78066280 0x7fdd78068730 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.099+0000 7fdd9aa9e640 1 --2- 172.21.15.55:0/1309066734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd940d0630 0x7fdd9414f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.099+0000 7fdd9aa9e640 1 --2- 172.21.15.55:0/1309066734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd940ce200 0x7fdd94151190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.099+0000 7fdd9aa9e640 1 --2- 172.21.15.55:0/1309066734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd940b1250 0x7fdd9406a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.099+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1309066734 >> 172.21.15.55:0/1309066734 conn(0x7fdd940b3b60 msgr2=0x7fdd940b4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:39.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.099+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1309066734 shutdown_connections 2023-07-06T21:42:39.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.099+0000 7fdd9aa9e640 1 -- 172.21.15.55:0/1309066734 wait complete. 2023-07-06T21:42:39.124 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:42:39.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.263+0000 7f978380b640 1 Processor -- start 2023-07-06T21:42:39.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.263+0000 7f978380b640 1 -- start start 2023-07-06T21:42:39.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f978380b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f977c0b7b90 0x7f977c0d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f978380b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f977c0cc870 0x7f977c0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f978380b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f977c0b4130 0x7f977c0d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f978380b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0b45b0 con 0x7f977c0b4130 2023-07-06T21:42:39.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f978380b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0b5070 con 0x7f977c0b7b90 2023-07-06T21:42:39.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f978380b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c160020 con 0x7f977c0cc870 2023-07-06T21:42:39.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f9781da8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f977c0b4130 0x7f977c0d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f9781da8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f977c0b4130 0x7f977c0d0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55420/0 (socket says 172.21.15.55:55420) 2023-07-06T21:42:39.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f9781da8640 1 -- 172.21.15.55:0/810128847 learned_addr learned my addr 172.21.15.55:0/810128847 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:39.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f9780da6640 1 --2- 172.21.15.55:0/810128847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f977c0cc870 0x7f977c0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f9781da8640 1 -- 172.21.15.55:0/810128847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f977c0cc870 msgr2=0x7f977c0b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:39.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f97815a7640 1 --2- 172.21.15.55:0/810128847 >> v2:172.21.15.138:3300/0 conn(0x7f977c0b7b90 0x7f977c0d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f9781da8640 1 --2- 172.21.15.55:0/810128847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f977c0cc870 0x7f977c0b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f9781da8640 1 -- 172.21.15.55:0/810128847 >> v2:172.21.15.138:3300/0 conn(0x7f977c0b7b90 msgr2=0x7f977c0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:39.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f9781da8640 1 --2- 172.21.15.55:0/810128847 >> v2:172.21.15.138:3300/0 conn(0x7f977c0b7b90 0x7f977c0d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f9781da8640 1 -- 172.21.15.55:0/810128847 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c1604b0 con 0x7f977c0b4130 2023-07-06T21:42:39.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f9780da6640 1 --2- 172.21.15.55:0/810128847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f977c0cc870 0x7f977c0b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:39.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f97815a7640 1 --2- 172.21.15.55:0/810128847 >> v2:172.21.15.138:3300/0 conn(0x7f977c0b7b90 0x7f977c0d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:39.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f9781da8640 1 --2- 172.21.15.55:0/810128847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0b4130 0x7f977c0d0120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f977c0b2e80 tx=0x7f977401c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0503bc3e5c902a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:39.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f9773fff640 1 -- 172.21.15.55:0/810128847 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740a5570 con 0x7f977c0b4130 2023-07-06T21:42:39.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f9773fff640 1 -- 172.21.15.55:0/810128847 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97740a56d0 con 0x7f977c0b4130 2023-07-06T21:42:39.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.267+0000 7f9773fff640 1 -- 172.21.15.55:0/810128847 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740a5a60 con 0x7f977c0b4130 2023-07-06T21:42:39.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 -- 172.21.15.55:0/810128847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0b4130 msgr2=0x7f977c0d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 --2- 172.21.15.55:0/810128847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0b4130 0x7f977c0d0120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f977c0b2e80 tx=0x7f977401c6f0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 -- 172.21.15.55:0/810128847 shutdown_connections 2023-07-06T21:42:39.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 --2- 172.21.15.55:0/810128847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0b4130 0x7f977c0d0120 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 --2- 172.21.15.55:0/810128847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f977c0cc870 0x7f977c0b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 --2- 172.21.15.55:0/810128847 >> v2:172.21.15.138:3300/0 conn(0x7f977c0b7b90 0x7f977c0d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 -- 172.21.15.55:0/810128847 >> 172.21.15.55:0/810128847 conn(0x7f977c0ceca0 msgr2=0x7f977c0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:39.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 -- 172.21.15.55:0/810128847 shutdown_connections 2023-07-06T21:42:39.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 -- 172.21.15.55:0/810128847 wait complete. 2023-07-06T21:42:39.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 Processor -- start 2023-07-06T21:42:39.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 -- start start 2023-07-06T21:42:39.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f977c0b4130 0x7f977c153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f977c0b7b90 0x7f977c0d1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cc870 0x7f977c0d1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1537b0 con 0x7f977c0cc870 2023-07-06T21:42:39.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1593d0 con 0x7f977c0b4130 2023-07-06T21:42:39.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f978380b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c157e90 con 0x7f977c0b7b90 2023-07-06T21:42:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f9781da8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cc870 0x7f977c0d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f9781da8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cc870 0x7f977c0d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55430/0 (socket says 172.21.15.55:55430) 2023-07-06T21:42:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f9781da8640 1 -- 172.21.15.55:0/3653557860 learned_addr learned my addr 172.21.15.55:0/3653557860 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f9780da6640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f977c0b7b90 0x7f977c0d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f9781da8640 1 -- 172.21.15.55:0/3653557860 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f977c0b7b90 msgr2=0x7f977c0d1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f97815a7640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f977c0b4130 0x7f977c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f9781da8640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f977c0b7b90 0x7f977c0d1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.271+0000 7f9781da8640 1 -- 172.21.15.55:0/3653557860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f977c0b4130 msgr2=0x7f977c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f9781da8640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f977c0b4130 0x7f977c153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f9781da8640 1 -- 172.21.15.55:0/3653557860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774009b30 con 0x7f977c0cc870 2023-07-06T21:42:39.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f9780da6640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f977c0b7b90 0x7f977c0d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:39.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f97815a7640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f977c0b4130 0x7f977c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:39.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f9781da8640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cc870 0x7f977c0d1670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f977401ada0 tx=0x7f9774019490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:39.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f9771ffb640 1 -- 172.21.15.55:0/3653557860 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740bd070 con 0x7f977c0cc870 2023-07-06T21:42:39.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f9771ffb640 1 -- 172.21.15.55:0/3653557860 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9774009510 con 0x7f977c0cc870 2023-07-06T21:42:39.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f9771ffb640 1 -- 172.21.15.55:0/3653557860 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740b86b0 con 0x7f977c0cc870 2023-07-06T21:42:39.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f978380b640 1 -- 172.21.15.55:0/3653557860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c157560 con 0x7f977c0cc870 2023-07-06T21:42:39.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f978380b640 1 -- 172.21.15.55:0/3653557860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c157b20 con 0x7f977c0cc870 2023-07-06T21:42:39.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f978380b640 1 -- 172.21.15.55:0/3653557860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c066d60 con 0x7f977c0cc870 2023-07-06T21:42:39.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f9771ffb640 1 -- 172.21.15.55:0/3653557860 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f97740039a0 con 0x7f977c0cc870 2023-07-06T21:42:39.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f9771ffb640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f97600662b0 0x7f9760068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f9771ffb640 1 -- 172.21.15.55:0/3653557860 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f977411ee50 con 0x7f977c0cc870 2023-07-06T21:42:39.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.275+0000 7f97815a7640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f97600662b0 0x7f9760068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.279+0000 7f97815a7640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f97600662b0 0x7f9760068760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9778008930 tx=0x7f9778008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:39.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.279+0000 7f9771ffb640 1 -- 172.21.15.55:0/3653557860 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f97740ec190 con 0x7f977c0cc870 2023-07-06T21:42:39.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.435+0000 7f978380b640 1 -- 172.21.15.55:0/3653557860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f977c15fc80 con 0x7f977c0cc870 2023-07-06T21:42:39.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.435+0000 7f9771ffb640 1 -- 172.21.15.55:0/3653557860 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f97740ef7b0 con 0x7f977c0cc870 2023-07-06T21:42:39.442 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:42:39.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.439+0000 7f978380b640 1 -- 172.21.15.55:0/3653557860 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f97600662b0 msgr2=0x7f9760068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.439+0000 7f978380b640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f97600662b0 0x7f9760068760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9778008930 tx=0x7f9778008040 comp rx=0 tx=0).stop 2023-07-06T21:42:39.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.439+0000 7f978380b640 1 -- 172.21.15.55:0/3653557860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cc870 msgr2=0x7f977c0d1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.439+0000 7f978380b640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cc870 0x7f977c0d1670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f977401ada0 tx=0x7f9774019490 comp rx=0 tx=0).stop 2023-07-06T21:42:39.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.439+0000 7f978380b640 1 -- 172.21.15.55:0/3653557860 shutdown_connections 2023-07-06T21:42:39.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.439+0000 7f978380b640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f97600662b0 0x7f9760068760 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.439+0000 7f978380b640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cc870 0x7f977c0d1670 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.439+0000 7f978380b640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f977c0b7b90 0x7f977c0d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.439+0000 7f978380b640 1 --2- 172.21.15.55:0/3653557860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f977c0b4130 0x7f977c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.439+0000 7f978380b640 1 -- 172.21.15.55:0/3653557860 >> 172.21.15.55:0/3653557860 conn(0x7f977c0ceca0 msgr2=0x7f977c0b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:39.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.439+0000 7f978380b640 1 -- 172.21.15.55:0/3653557860 shutdown_connections 2023-07-06T21:42:39.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.439+0000 7f978380b640 1 -- 172.21.15.55:0/3653557860 wait complete. 2023-07-06T21:42:39.462 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:42:39.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.599+0000 7f878f634640 1 Processor -- start 2023-07-06T21:42:39.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878f634640 1 -- start start 2023-07-06T21:42:39.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878f634640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f878815b850 0x7f87880cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878f634640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f87880ccd30 0x7f87880b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878f634640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87880b4210 con 0x7f87880b3db0 2023-07-06T21:42:39.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878f634640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87880b2b80 con 0x7f87880ccd30 2023-07-06T21:42:39.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878f634640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87880cff30 con 0x7f878815b850 2023-07-06T21:42:39.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878d3d0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f878815b850 0x7f87880cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878cbcf640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f87880ccd30 0x7f87880b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878d3d0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f878815b850 0x7f87880cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:46516/0 (socket says 172.21.15.55:46516) 2023-07-06T21:42:39.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878d3d0640 1 -- 172.21.15.55:0/2411737971 learned_addr learned my addr 172.21.15.55:0/2411737971 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:39.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878d3d0640 1 -- 172.21.15.55:0/2411737971 >> v2:172.21.15.138:3300/0 conn(0x7f87880ccd30 msgr2=0x7f87880b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:39.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878d3d0640 1 --2- 172.21.15.55:0/2411737971 >> v2:172.21.15.138:3300/0 conn(0x7f87880ccd30 0x7f87880b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878d3d0640 1 -- 172.21.15.55:0/2411737971 >> v1:172.21.15.138:6789/0 conn(0x7f87880b3db0 legacy=0x7f878815f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878d3d0640 1 -- 172.21.15.55:0/2411737971 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87880b22e0 con 0x7f878815b850 2023-07-06T21:42:39.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.603+0000 7f878cbcf640 1 --2- 172.21.15.55:0/2411737971 >> v2:172.21.15.138:3300/0 conn(0x7f87880ccd30 0x7f87880b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:39.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.607+0000 7f878d3d0640 1 --2- 172.21.15.55:0/2411737971 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f878815b850 0x7f87880cc7f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8784009870 tx=0x7f878401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ed514f1f3514bd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:39.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.607+0000 7f877ffff640 1 -- 172.21.15.55:0/2411737971 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840ab5f0 con 0x7f878815b850 2023-07-06T21:42:39.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.607+0000 7f877ffff640 1 -- 172.21.15.55:0/2411737971 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87840ab750 con 0x7f878815b850 2023-07-06T21:42:39.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.607+0000 7f877ffff640 1 -- 172.21.15.55:0/2411737971 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840abae0 con 0x7f878815b850 2023-07-06T21:42:39.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.607+0000 7f878f634640 1 -- 172.21.15.55:0/2411737971 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f878815b850 msgr2=0x7f87880cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.607+0000 7f878f634640 1 --2- 172.21.15.55:0/2411737971 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f878815b850 0x7f87880cc7f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8784009870 tx=0x7f878401c3f0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.607+0000 7f878f634640 1 -- 172.21.15.55:0/2411737971 shutdown_connections 2023-07-06T21:42:39.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.607+0000 7f878f634640 1 --2- 172.21.15.55:0/2411737971 >> v2:172.21.15.138:3300/0 conn(0x7f87880ccd30 0x7f87880b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.607+0000 7f878f634640 1 --2- 172.21.15.55:0/2411737971 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f878815b850 0x7f87880cc7f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.607+0000 7f878f634640 1 -- 172.21.15.55:0/2411737971 >> 172.21.15.55:0/2411737971 conn(0x7f87880cec20 msgr2=0x7f87880cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:39.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.607+0000 7f878f634640 1 -- 172.21.15.55:0/2411737971 shutdown_connections 2023-07-06T21:42:39.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.607+0000 7f878f634640 1 -- 172.21.15.55:0/2411737971 wait complete. 2023-07-06T21:42:39.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.607+0000 7f878f634640 1 Processor -- start 2023-07-06T21:42:39.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878f634640 1 -- start start 2023-07-06T21:42:39.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878f634640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87880b3db0 0x7f87881513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878f634640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87880ccd30 0x7f87881569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878f634640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f878815b850 0x7f878814f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878f634640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87881571c0 con 0x7f87880b3db0 2023-07-06T21:42:39.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878f634640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8788156f20 con 0x7f878815b850 2023-07-06T21:42:39.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878f634640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8788150b00 con 0x7f87880ccd30 2023-07-06T21:42:39.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878d3d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87880b3db0 0x7f87881513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878d3d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87880b3db0 0x7f87881513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55446/0 (socket says 172.21.15.55:55446) 2023-07-06T21:42:39.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878d3d0640 1 -- 172.21.15.55:0/386958794 learned_addr learned my addr 172.21.15.55:0/386958794 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:39.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878cbcf640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87880ccd30 0x7f87881569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878dbd1640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f878815b850 0x7f878814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878d3d0640 1 -- 172.21.15.55:0/386958794 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87880ccd30 msgr2=0x7f87881569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878d3d0640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87880ccd30 0x7f87881569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878d3d0640 1 -- 172.21.15.55:0/386958794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f878815b850 msgr2=0x7f878814f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878d3d0640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f878815b850 0x7f878814f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878d3d0640 1 -- 172.21.15.55:0/386958794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778009420 con 0x7f87880b3db0 2023-07-06T21:42:39.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878cbcf640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87880ccd30 0x7f87881569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:39.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878dbd1640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f878815b850 0x7f878814f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:39.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878d3d0640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87880b3db0 0x7f87881513a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f87840ad040 tx=0x7f8784019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:39.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f877dffb640 1 -- 172.21.15.55:0/386958794 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840c0680 con 0x7f87880b3db0 2023-07-06T21:42:39.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f877dffb640 1 -- 172.21.15.55:0/386958794 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87840b9070 con 0x7f87880b3db0 2023-07-06T21:42:39.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f877dffb640 1 -- 172.21.15.55:0/386958794 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840c0a20 con 0x7f87880b3db0 2023-07-06T21:42:39.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878f634640 1 -- 172.21.15.55:0/386958794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87840094d0 con 0x7f87880b3db0 2023-07-06T21:42:39.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878f634640 1 -- 172.21.15.55:0/386958794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878815bda0 con 0x7f87880b3db0 2023-07-06T21:42:39.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.611+0000 7f878f634640 1 -- 172.21.15.55:0/386958794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8788066d60 con 0x7f87880b3db0 2023-07-06T21:42:39.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.615+0000 7f877dffb640 1 -- 172.21.15.55:0/386958794 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87840c0b80 con 0x7f87880b3db0 2023-07-06T21:42:39.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.615+0000 7f877dffb640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f876c066280 0x7f876c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.615+0000 7f877dffb640 1 -- 172.21.15.55:0/386958794 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87840bb070 con 0x7f87880b3db0 2023-07-06T21:42:39.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.615+0000 7f878cbcf640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f876c066280 0x7f876c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.615+0000 7f878cbcf640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f876c066280 0x7f876c068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87880d2be0 tx=0x7f8778008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:39.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.619+0000 7f877dffb640 1 -- 172.21.15.55:0/386958794 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f87840ebf70 con 0x7f87880b3db0 2023-07-06T21:42:39.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.771+0000 7f878f634640 1 -- 172.21.15.55:0/386958794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87880b3420 con 0x7f87880b3db0 2023-07-06T21:42:39.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.771+0000 7f877dffb640 1 -- 172.21.15.55:0/386958794 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87840c50a0 con 0x7f87880b3db0 2023-07-06T21:42:39.778 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:39.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.775+0000 7f878f634640 1 -- 172.21.15.55:0/386958794 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f876c066280 msgr2=0x7f876c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.775+0000 7f878f634640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f876c066280 0x7f876c068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87880d2be0 tx=0x7f8778008040 comp rx=0 tx=0).stop 2023-07-06T21:42:39.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.775+0000 7f878f634640 1 -- 172.21.15.55:0/386958794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87880b3db0 msgr2=0x7f87881513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.775+0000 7f878f634640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87880b3db0 0x7f87881513a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f87840ad040 tx=0x7f8784019190 comp rx=0 tx=0).stop 2023-07-06T21:42:39.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.775+0000 7f878f634640 1 -- 172.21.15.55:0/386958794 shutdown_connections 2023-07-06T21:42:39.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.775+0000 7f878f634640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f876c066280 0x7f876c068730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.775+0000 7f878f634640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f878815b850 0x7f878814f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.775+0000 7f878f634640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87880ccd30 0x7f87881569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.775+0000 7f878f634640 1 --2- 172.21.15.55:0/386958794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87880b3db0 0x7f87881513a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.775+0000 7f878f634640 1 -- 172.21.15.55:0/386958794 >> 172.21.15.55:0/386958794 conn(0x7f87880cec20 msgr2=0x7f87880b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:39.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.775+0000 7f878f634640 1 -- 172.21.15.55:0/386958794 shutdown_connections 2023-07-06T21:42:39.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.775+0000 7f878f634640 1 -- 172.21.15.55:0/386958794 wait complete. 2023-07-06T21:42:39.799 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:42:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d7dbe9640 1 Processor -- start 2023-07-06T21:42:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d7dbe9640 1 -- start start 2023-07-06T21:42:39.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d7dbe9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d78070d70 0x7f2d780b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d7dbe9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2d780b1170 0x7f2d7806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d7dbe9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d780cc030 con 0x7f2d780709a0 2023-07-06T21:42:39.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d7dbe9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d780b15f0 con 0x7f2d780b1170 2023-07-06T21:42:39.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d7dbe9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d780cc300 con 0x7f2d78070d70 2023-07-06T21:42:39.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d76ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d78070d70 0x7f2d780b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d77fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2d780b1170 0x7f2d7806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d777fe640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f2d780709a0 0x7f2d780cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:54702/0 (socket says 172.21.15.55:54702) 2023-07-06T21:42:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d777fe640 1 -- 172.21.15.55:0/2809023489 learned_addr learned my addr 172.21.15.55:0/2809023489 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d767fc640 1 -- 172.21.15.55:0/2809023489 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834496633 0 0) 0x7f2d780cc030 con 0x7f2d780709a0 2023-07-06T21:42:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d767fc640 1 -- 172.21.15.55:0/2809023489 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d60003530 con 0x7f2d780709a0 2023-07-06T21:42:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d77fff640 1 -- 172.21.15.55:0/2809023489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d78070d70 msgr2=0x7f2d780b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d77fff640 1 --2- 172.21.15.55:0/2809023489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d78070d70 0x7f2d780b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d77fff640 1 -- 172.21.15.55:0/2809023489 >> v1:172.21.15.138:6789/0 conn(0x7f2d780709a0 legacy=0x7f2d780cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d77fff640 1 -- 172.21.15.55:0/2809023489 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d780cc5e0 con 0x7f2d780b1170 2023-07-06T21:42:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.943+0000 7f2d76ffd640 1 --2- 172.21.15.55:0/2809023489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d78070d70 0x7f2d780b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.947+0000 7f2d77fff640 1 --2- 172.21.15.55:0/2809023489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d780b1170 0x7f2d7806eee0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2d70009dc0 tx=0x7f2d7001c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc2cd4eef5ef3c02 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.947+0000 7f2d767fc640 1 -- 172.21.15.55:0/2809023489 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d700a5850 con 0x7f2d780b1170 2023-07-06T21:42:39.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.947+0000 7f2d767fc640 1 -- 172.21.15.55:0/2809023489 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d700a59b0 con 0x7f2d780b1170 2023-07-06T21:42:39.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.947+0000 7f2d767fc640 1 -- 172.21.15.55:0/2809023489 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d700a5d40 con 0x7f2d780b1170 2023-07-06T21:42:39.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.947+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/2809023489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d780b1170 msgr2=0x7f2d7806eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.947+0000 7f2d7dbe9640 1 --2- 172.21.15.55:0/2809023489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d780b1170 0x7f2d7806eee0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2d70009dc0 tx=0x7f2d7001c8a0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.947+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/2809023489 shutdown_connections 2023-07-06T21:42:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.947+0000 7f2d7dbe9640 1 --2- 172.21.15.55:0/2809023489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d780b1170 0x7f2d7806eee0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.947+0000 7f2d7dbe9640 1 --2- 172.21.15.55:0/2809023489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d78070d70 0x7f2d780b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.947+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/2809023489 >> 172.21.15.55:0/2809023489 conn(0x7f2d780cea70 msgr2=0x7f2d780ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.947+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/2809023489 shutdown_connections 2023-07-06T21:42:39.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.947+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/2809023489 wait complete. 2023-07-06T21:42:39.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d7dbe9640 1 Processor -- start 2023-07-06T21:42:39.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d7dbe9640 1 -- start start 2023-07-06T21:42:39.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d7dbe9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d780709a0 0x7f2d78163040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d7dbe9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d78070d70 0x7f2d78163580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d7dbe9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d780b1170 0x7f2d780c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d7dbe9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d781f91e0 con 0x7f2d780709a0 2023-07-06T21:42:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d7dbe9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d780c9260 con 0x7f2d780b1170 2023-07-06T21:42:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d7dbe9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d781f8420 con 0x7f2d78070d70 2023-07-06T21:42:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d780709a0 0x7f2d78163040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d780709a0 0x7f2d78163040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55452/0 (socket says 172.21.15.55:55452) 2023-07-06T21:42:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d777fe640 1 -- 172.21.15.55:0/3139881377 learned_addr learned my addr 172.21.15.55:0/3139881377 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d77fff640 1 --2- 172.21.15.55:0/3139881377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d780b1170 0x7f2d780c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d76ffd640 1 --2- 172.21.15.55:0/3139881377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d78070d70 0x7f2d78163580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d777fe640 1 -- 172.21.15.55:0/3139881377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d78070d70 msgr2=0x7f2d78163580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d777fe640 1 --2- 172.21.15.55:0/3139881377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d78070d70 0x7f2d78163580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d777fe640 1 -- 172.21.15.55:0/3139881377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d780b1170 msgr2=0x7f2d780c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d777fe640 1 --2- 172.21.15.55:0/3139881377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d780b1170 0x7f2d780c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d777fe640 1 -- 172.21.15.55:0/3139881377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c009420 con 0x7f2d780709a0 2023-07-06T21:42:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d777fe640 1 --2- 172.21.15.55:0/3139881377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d780709a0 0x7f2d78163040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c420 tx=0x7f2d6800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d5ffff640 1 -- 172.21.15.55:0/3139881377 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68005cf0 con 0x7f2d780709a0 2023-07-06T21:42:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d5ffff640 1 -- 172.21.15.55:0/3139881377 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d68005e50 con 0x7f2d780709a0 2023-07-06T21:42:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/3139881377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d70009a70 con 0x7f2d780709a0 2023-07-06T21:42:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d5ffff640 1 -- 172.21.15.55:0/3139881377 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d680072d0 con 0x7f2d780709a0 2023-07-06T21:42:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/3139881377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d781f89e0 con 0x7f2d780709a0 2023-07-06T21:42:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.951+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/3139881377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d78066d60 con 0x7f2d780709a0 2023-07-06T21:42:39.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.955+0000 7f2d5ffff640 1 -- 172.21.15.55:0/3139881377 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d68007430 con 0x7f2d780709a0 2023-07-06T21:42:39.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.955+0000 7f2d5ffff640 1 --2- 172.21.15.55:0/3139881377 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d64066280 0x7f2d64068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:39.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.955+0000 7f2d5ffff640 1 -- 172.21.15.55:0/3139881377 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2d68083590 con 0x7f2d780709a0 2023-07-06T21:42:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.955+0000 7f2d76ffd640 1 --2- 172.21.15.55:0/3139881377 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d64066280 0x7f2d64068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.955+0000 7f2d76ffd640 1 --2- 172.21.15.55:0/3139881377 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d64066280 0x7f2d64068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2d7809c080 tx=0x7f2d6c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:39.959+0000 7f2d5ffff640 1 -- 172.21.15.55:0/3139881377 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d68050730 con 0x7f2d780709a0 2023-07-06T21:42:40.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.111+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/3139881377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d780c7e50 con 0x7f2d780709a0 2023-07-06T21:42:40.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.111+0000 7f2d5ffff640 1 -- 172.21.15.55:0/3139881377 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d68053d50 con 0x7f2d780709a0 2023-07-06T21:42:40.119 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:42:40.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.115+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/3139881377 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d64066280 msgr2=0x7f2d64068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:40.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.115+0000 7f2d7dbe9640 1 --2- 172.21.15.55:0/3139881377 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d64066280 0x7f2d64068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2d7809c080 tx=0x7f2d6c009190 comp rx=0 tx=0).stop 2023-07-06T21:42:40.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.115+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/3139881377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d780709a0 msgr2=0x7f2d78163040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.115+0000 7f2d7dbe9640 1 --2- 172.21.15.55:0/3139881377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d780709a0 0x7f2d78163040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c420 tx=0x7f2d6800c8e0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.115+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/3139881377 shutdown_connections 2023-07-06T21:42:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.115+0000 7f2d7dbe9640 1 --2- 172.21.15.55:0/3139881377 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d64066280 0x7f2d64068730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.115+0000 7f2d7dbe9640 1 --2- 172.21.15.55:0/3139881377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d780b1170 0x7f2d780c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.115+0000 7f2d7dbe9640 1 --2- 172.21.15.55:0/3139881377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d78070d70 0x7f2d78163580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.115+0000 7f2d7dbe9640 1 --2- 172.21.15.55:0/3139881377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d780709a0 0x7f2d78163040 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.115+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/3139881377 >> 172.21.15.55:0/3139881377 conn(0x7f2d780cea70 msgr2=0x7f2d780c4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:40.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.115+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/3139881377 shutdown_connections 2023-07-06T21:42:40.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.115+0000 7f2d7dbe9640 1 -- 172.21.15.55:0/3139881377 wait complete. 2023-07-06T21:42:40.139 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T21:42:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfb0f37640 1 Processor -- start 2023-07-06T21:42:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfb0f37640 1 -- start start 2023-07-06T21:42:40.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfb0f37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcfac15b850 0x7fcfac0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfb0f37640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcfac0ccd30 0x7fcfac0b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfb0f37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfac0b3db0 0x7fcfac15f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfb0f37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfac0b4210 con 0x7fcfac15b850 2023-07-06T21:42:40.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfb0f37640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfac0b2b80 con 0x7fcfac0ccd30 2023-07-06T21:42:40.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfb0f37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac0cff30 con 0x7fcfac0b3db0 2023-07-06T21:42:40.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfaa59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcfac15b850 0x7fcfac0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfaa59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcfac15b850 0x7fcfac0cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55468/0 (socket says 172.21.15.55:55468) 2023-07-06T21:42:40.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfaa59c640 1 -- 172.21.15.55:0/3978863807 learned_addr learned my addr 172.21.15.55:0/3978863807 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:40.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfaad9d640 1 --2- 172.21.15.55:0/3978863807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfac0b3db0 0x7fcfac15f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfa3fff640 1 --2- 172.21.15.55:0/3978863807 >> v2:172.21.15.138:3300/0 conn(0x7fcfac0ccd30 0x7fcfac0b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfaa59c640 1 -- 172.21.15.55:0/3978863807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfac0b3db0 msgr2=0x7fcfac15f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:40.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfaa59c640 1 --2- 172.21.15.55:0/3978863807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfac0b3db0 0x7fcfac15f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfaa59c640 1 -- 172.21.15.55:0/3978863807 >> v2:172.21.15.138:3300/0 conn(0x7fcfac0ccd30 msgr2=0x7fcfac0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.279+0000 7fcfaa59c640 1 --2- 172.21.15.55:0/3978863807 >> v2:172.21.15.138:3300/0 conn(0x7fcfac0ccd30 0x7fcfac0b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.283+0000 7fcfaa59c640 1 -- 172.21.15.55:0/3978863807 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac0b22e0 con 0x7fcfac15b850 2023-07-06T21:42:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.283+0000 7fcfa3fff640 1 --2- 172.21.15.55:0/3978863807 >> v2:172.21.15.138:3300/0 conn(0x7fcfac0ccd30 0x7fcfac0b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.283+0000 7fcfaa59c640 1 --2- 172.21.15.55:0/3978863807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfac15b850 0x7fcfac0cc7f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0cebd0 tx=0x7fcf9c01c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafa0e9741c32f66 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.283+0000 7fcfa9d9b640 1 -- 172.21.15.55:0/3978863807 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c0ab600 con 0x7fcfac15b850 2023-07-06T21:42:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.283+0000 7fcfa9d9b640 1 -- 172.21.15.55:0/3978863807 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c0a7050 con 0x7fcfac15b850 2023-07-06T21:42:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.283+0000 7fcfa9d9b640 1 -- 172.21.15.55:0/3978863807 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c0ab980 con 0x7fcfac15b850 2023-07-06T21:42:40.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.283+0000 7fcfb0f37640 1 -- 172.21.15.55:0/3978863807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfac15b850 msgr2=0x7fcfac0cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:40.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.283+0000 7fcfb0f37640 1 --2- 172.21.15.55:0/3978863807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfac15b850 0x7fcfac0cc7f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0cebd0 tx=0x7fcf9c01c0f0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 -- 172.21.15.55:0/3978863807 shutdown_connections 2023-07-06T21:42:40.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 --2- 172.21.15.55:0/3978863807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfac0b3db0 0x7fcfac15f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 --2- 172.21.15.55:0/3978863807 >> v2:172.21.15.138:3300/0 conn(0x7fcfac0ccd30 0x7fcfac0b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 --2- 172.21.15.55:0/3978863807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfac15b850 0x7fcfac0cc7f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 -- 172.21.15.55:0/3978863807 >> 172.21.15.55:0/3978863807 conn(0x7fcfac0cec20 msgr2=0x7fcfac0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:40.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 -- 172.21.15.55:0/3978863807 shutdown_connections 2023-07-06T21:42:40.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 -- 172.21.15.55:0/3978863807 wait complete. 2023-07-06T21:42:40.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 Processor -- start 2023-07-06T21:42:40.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 -- start start 2023-07-06T21:42:40.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfac0b3db0 0x7fcfac1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfac0ccd30 0x7fcfac157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfac15b850 0x7fcfac157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac0cae70 con 0x7fcfac15b850 2023-07-06T21:42:40.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac153bf0 con 0x7fcfac0b3db0 2023-07-06T21:42:40.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfb0f37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac0ca260 con 0x7fcfac0ccd30 2023-07-06T21:42:40.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfaad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfac15b850 0x7fcfac157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfaad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfac15b850 0x7fcfac157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55476/0 (socket says 172.21.15.55:55476) 2023-07-06T21:42:40.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfaad9d640 1 -- 172.21.15.55:0/1650784321 learned_addr learned my addr 172.21.15.55:0/1650784321 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:40.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfa3fff640 1 --2- 172.21.15.55:0/1650784321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfac0ccd30 0x7fcfac157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfaa59c640 1 --2- 172.21.15.55:0/1650784321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfac0b3db0 0x7fcfac1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfaad9d640 1 -- 172.21.15.55:0/1650784321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfac0ccd30 msgr2=0x7fcfac157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:40.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfaad9d640 1 --2- 172.21.15.55:0/1650784321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfac0ccd30 0x7fcfac157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfaad9d640 1 -- 172.21.15.55:0/1650784321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfac0b3db0 msgr2=0x7fcfac1536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:40.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfaad9d640 1 --2- 172.21.15.55:0/1650784321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfac0b3db0 0x7fcfac1536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.287+0000 7fcfaad9d640 1 -- 172.21.15.55:0/1650784321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c0094d0 con 0x7fcfac15b850 2023-07-06T21:42:40.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.291+0000 7fcfaad9d640 1 --2- 172.21.15.55:0/1650784321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfac15b850 0x7fcfac157b60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4007e60 tx=0x7fcfa400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:40.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.291+0000 7fcfa2ffd640 1 -- 172.21.15.55:0/1650784321 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4014620 con 0x7fcfac15b850 2023-07-06T21:42:40.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.291+0000 7fcfa2ffd640 1 -- 172.21.15.55:0/1650784321 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa400ee90 con 0x7fcfac15b850 2023-07-06T21:42:40.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.291+0000 7fcfa2ffd640 1 -- 172.21.15.55:0/1650784321 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa40149e0 con 0x7fcfac15b850 2023-07-06T21:42:40.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.291+0000 7fcfb0f37640 1 -- 172.21.15.55:0/1650784321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfac15bda0 con 0x7fcfac15b850 2023-07-06T21:42:40.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.291+0000 7fcfb0f37640 1 -- 172.21.15.55:0/1650784321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfac0ca820 con 0x7fcfac15b850 2023-07-06T21:42:40.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.291+0000 7fcfb0f37640 1 -- 172.21.15.55:0/1650784321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfac0cb020 con 0x7fcfac15b850 2023-07-06T21:42:40.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.291+0000 7fcfa2ffd640 1 -- 172.21.15.55:0/1650784321 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcfa4014b40 con 0x7fcfac15b850 2023-07-06T21:42:40.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.291+0000 7fcfa2ffd640 1 --2- 172.21.15.55:0/1650784321 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcf8c0662b0 0x7fcf8c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.291+0000 7fcfa2ffd640 1 -- 172.21.15.55:0/1650784321 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcfa40847d0 con 0x7fcfac15b850 2023-07-06T21:42:40.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.291+0000 7fcfaa59c640 1 --2- 172.21.15.55:0/1650784321 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcf8c0662b0 0x7fcf8c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.295+0000 7fcfaa59c640 1 --2- 172.21.15.55:0/1650784321 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcf8c0662b0 0x7fcf8c068760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0ad000 tx=0x7fcf9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:40.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.295+0000 7fcfa2ffd640 1 -- 172.21.15.55:0/1650784321 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcfac0cb020 con 0x7fcfac15b850 2023-07-06T21:42:40.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.455+0000 7fcfb0f37640 1 -- 172.21.15.55:0/1650784321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcfac066d60 con 0x7fcfac15b850 2023-07-06T21:42:40.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.455+0000 7fcfa2ffd640 1 -- 172.21.15.55:0/1650784321 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcfa4051970 con 0x7fcfac15b850 2023-07-06T21:42:40.460 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:40.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.455+0000 7fcfb0f37640 1 -- 172.21.15.55:0/1650784321 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcf8c0662b0 msgr2=0x7fcf8c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:40.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.455+0000 7fcfb0f37640 1 --2- 172.21.15.55:0/1650784321 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcf8c0662b0 0x7fcf8c068760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0ad000 tx=0x7fcf9c008040 comp rx=0 tx=0).stop 2023-07-06T21:42:40.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.455+0000 7fcfb0f37640 1 -- 172.21.15.55:0/1650784321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfac15b850 msgr2=0x7fcfac157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:40.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.455+0000 7fcfb0f37640 1 --2- 172.21.15.55:0/1650784321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfac15b850 0x7fcfac157b60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4007e60 tx=0x7fcfa400e4b0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.455+0000 7fcfb0f37640 1 -- 172.21.15.55:0/1650784321 shutdown_connections 2023-07-06T21:42:40.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.455+0000 7fcfb0f37640 1 --2- 172.21.15.55:0/1650784321 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcf8c0662b0 0x7fcf8c068760 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.455+0000 7fcfb0f37640 1 --2- 172.21.15.55:0/1650784321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfac15b850 0x7fcfac157b60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.455+0000 7fcfb0f37640 1 --2- 172.21.15.55:0/1650784321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfac0ccd30 0x7fcfac157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.455+0000 7fcfb0f37640 1 --2- 172.21.15.55:0/1650784321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfac0b3db0 0x7fcfac1536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.455+0000 7fcfb0f37640 1 -- 172.21.15.55:0/1650784321 >> 172.21.15.55:0/1650784321 conn(0x7fcfac0cec20 msgr2=0x7fcfac0d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:40.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.455+0000 7fcfb0f37640 1 -- 172.21.15.55:0/1650784321 shutdown_connections 2023-07-06T21:42:40.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.455+0000 7fcfb0f37640 1 -- 172.21.15.55:0/1650784321 wait complete. 2023-07-06T21:42:40.482 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:42:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.619+0000 7f65e8e48640 1 Processor -- start 2023-07-06T21:42:40.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.619+0000 7f65e8e48640 1 -- start start 2023-07-06T21:42:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.619+0000 7f65e8e48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65e415fd40 0x7f65e406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.619+0000 7f65e8e48640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f65e406caf0 0x7f65e40ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.619+0000 7f65e8e48640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e40ca880 con 0x7f65e4160110 2023-07-06T21:42:40.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.619+0000 7f65e8e48640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e415cd90 con 0x7f65e406caf0 2023-07-06T21:42:40.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.619+0000 7f65e8e48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40c9c90 con 0x7f65e415fd40 2023-07-06T21:42:40.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.619+0000 7f65dbfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f65e4160110 0x7f65e406c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38480/0 (socket says 172.21.15.55:38480) 2023-07-06T21:42:40.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.619+0000 7f65dbfff640 1 -- 172.21.15.55:0/2444199590 learned_addr learned my addr 172.21.15.55:0/2444199590 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:40.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.619+0000 7f65e2d9d640 1 --2- 172.21.15.55:0/2444199590 >> v2:172.21.15.138:3300/0 conn(0x7f65e406caf0 0x7f65e40ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 -- 172.21.15.55:0/2444199590 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854524307 0 0) 0x7f65e40ca880 con 0x7f65e4160110 2023-07-06T21:42:40.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 -- 172.21.15.55:0/2444199590 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65d0003530 con 0x7f65e4160110 2023-07-06T21:42:40.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e259c640 1 --2- 172.21.15.55:0/2444199590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65e415fd40 0x7f65e406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 -- 172.21.15.55:0/2444199590 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2616528942 0 0) 0x7f65d0003530 con 0x7f65e4160110 2023-07-06T21:42:40.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 -- 172.21.15.55:0/2444199590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65e415fd40 msgr2=0x7f65e406e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:40.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 --2- 172.21.15.55:0/2444199590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65e415fd40 0x7f65e406e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 -- 172.21.15.55:0/2444199590 >> v2:172.21.15.138:3300/0 conn(0x7f65e406caf0 msgr2=0x7f65e40ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:40.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 --2- 172.21.15.55:0/2444199590 >> v2:172.21.15.138:3300/0 conn(0x7f65e406caf0 0x7f65e40ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 -- 172.21.15.55:0/2444199590 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40c9f50 con 0x7f65e4160110 2023-07-06T21:42:40.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 -- 172.21.15.55:0/2444199590 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f65cc001680 con 0x7f65e4160110 2023-07-06T21:42:40.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 -- 172.21.15.55:0/2444199590 >> v1:172.21.15.55:6789/0 conn(0x7f65e4160110 legacy=0x7f65e406c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:40.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 --2- 172.21.15.55:0/2444199590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65e415fd40 0x7f65d0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 --2- 172.21.15.55:0/2444199590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65d0003f00 0x7f65d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 --2- 172.21.15.55:0/2444199590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65d0004d10 0x7f65d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 -- 172.21.15.55:0/2444199590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e415cd90 con 0x7f65d0004d10 2023-07-06T21:42:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 -- 172.21.15.55:0/2444199590 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40c9c90 con 0x7f65d0003f00 2023-07-06T21:42:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e1d9b640 1 -- 172.21.15.55:0/2444199590 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d000b9c0 con 0x7f65e415fd40 2023-07-06T21:42:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e259c640 1 --2- 172.21.15.55:0/2444199590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65e415fd40 0x7f65d0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e2d9d640 1 --2- 172.21.15.55:0/2444199590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65d0004d10 0x7f65d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65dbfff640 1 --2- 172.21.15.55:0/2444199590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65d0003f00 0x7f65d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e259c640 1 -- 172.21.15.55:0/2444199590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65d0003f00 msgr2=0x7f65d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e259c640 1 --2- 172.21.15.55:0/2444199590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65d0003f00 0x7f65d00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e259c640 1 -- 172.21.15.55:0/2444199590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65d0004d10 msgr2=0x7f65d0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:40.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e259c640 1 --2- 172.21.15.55:0/2444199590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65d0004d10 0x7f65d0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e259c640 1 -- 172.21.15.55:0/2444199590 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d0003530 con 0x7f65e415fd40 2023-07-06T21:42:40.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.623+0000 7f65e2d9d640 1 --2- 172.21.15.55:0/2444199590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65d0004d10 0x7f65d0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:40.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.627+0000 7f65e259c640 1 --2- 172.21.15.55:0/2444199590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65e415fd40 0x7f65d0003980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f65d400ba30 tx=0x7f65d401c6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2afe040ce9808228 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:40.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.627+0000 7f65e1d9b640 1 -- 172.21.15.55:0/2444199590 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d40aa630 con 0x7f65e415fd40 2023-07-06T21:42:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.627+0000 7f65e1d9b640 1 -- 172.21.15.55:0/2444199590 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d40aa790 con 0x7f65e415fd40 2023-07-06T21:42:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.627+0000 7f65e1d9b640 1 -- 172.21.15.55:0/2444199590 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d40aab40 con 0x7f65e415fd40 2023-07-06T21:42:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.627+0000 7f65e8e48640 1 -- 172.21.15.55:0/2444199590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65e415fd40 msgr2=0x7f65d0003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.627+0000 7f65e8e48640 1 --2- 172.21.15.55:0/2444199590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65e415fd40 0x7f65d0003980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f65d400ba30 tx=0x7f65d401c6c0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.627+0000 7f65e2d9d640 1 -- 172.21.15.55:0/2444199590 reap_dead start 2023-07-06T21:42:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.627+0000 7f65e8e48640 1 -- 172.21.15.55:0/2444199590 shutdown_connections 2023-07-06T21:42:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.627+0000 7f65e8e48640 1 -- 172.21.15.55:0/2444199590 >> 172.21.15.55:0/2444199590 conn(0x7f65e40b1730 msgr2=0x7f65e40cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.627+0000 7f65e8e48640 1 -- 172.21.15.55:0/2444199590 shutdown_connections 2023-07-06T21:42:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.627+0000 7f65e8e48640 1 -- 172.21.15.55:0/2444199590 wait complete. 2023-07-06T21:42:40.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.627+0000 7f65e8e48640 1 Processor -- start 2023-07-06T21:42:40.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.627+0000 7f65e8e48640 1 -- start start 2023-07-06T21:42:40.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65e8e48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65e415fd40 0x7f65e41525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65e8e48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65e40c51a0 0x7f65e406b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65e8e48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65e40693f0 0x7f65e40c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65e8e48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40b3a60 con 0x7f65e40c51a0 2023-07-06T21:42:40.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65e8e48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e4152b00 con 0x7f65e40693f0 2023-07-06T21:42:40.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65e8e48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40c5710 con 0x7f65e415fd40 2023-07-06T21:42:40.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65e40c51a0 0x7f65e406b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65e40c51a0 0x7f65e406b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55504/0 (socket says 172.21.15.55:55504) 2023-07-06T21:42:40.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65dbfff640 1 -- 172.21.15.55:0/2480053485 learned_addr learned my addr 172.21.15.55:0/2480053485 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:40.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65e259c640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65e415fd40 0x7f65e41525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65e2d9d640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65e40693f0 0x7f65e40c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65dbfff640 1 -- 172.21.15.55:0/2480053485 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65e415fd40 msgr2=0x7f65e41525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:40.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65dbfff640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65e415fd40 0x7f65e41525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65dbfff640 1 -- 172.21.15.55:0/2480053485 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65e40693f0 msgr2=0x7f65e40c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:40.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65dbfff640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65e40693f0 0x7f65e40c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65dbfff640 1 -- 172.21.15.55:0/2480053485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40b3130 con 0x7f65e40c51a0 2023-07-06T21:42:40.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65e2d9d640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65e40693f0 0x7f65e40c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:40.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65dbfff640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65e40c51a0 0x7f65e406b590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f65cc007370 tx=0x7f65cc007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:40.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65daffd640 1 -- 172.21.15.55:0/2480053485 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc00f960 con 0x7f65e40c51a0 2023-07-06T21:42:40.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65daffd640 1 -- 172.21.15.55:0/2480053485 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc00fac0 con 0x7f65e40c51a0 2023-07-06T21:42:40.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65daffd640 1 -- 172.21.15.55:0/2480053485 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc00fe50 con 0x7f65e40c51a0 2023-07-06T21:42:40.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65e8e48640 1 -- 172.21.15.55:0/2480053485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e40b3410 con 0x7f65e40c51a0 2023-07-06T21:42:40.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65e8e48640 1 -- 172.21.15.55:0/2480053485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e406bad0 con 0x7f65e40c51a0 2023-07-06T21:42:40.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.631+0000 7f65e8e48640 1 -- 172.21.15.55:0/2480053485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e40b3c10 con 0x7f65e40c51a0 2023-07-06T21:42:40.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.635+0000 7f65daffd640 1 -- 172.21.15.55:0/2480053485 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f65cc01d360 con 0x7f65e40c51a0 2023-07-06T21:42:40.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.635+0000 7f65daffd640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f65c40662b0 0x7f65c4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.635+0000 7f65daffd640 1 -- 172.21.15.55:0/2480053485 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f65cc083850 con 0x7f65e40c51a0 2023-07-06T21:42:40.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.635+0000 7f65e259c640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f65c40662b0 0x7f65c4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:40.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.635+0000 7f65e259c640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f65c40662b0 0x7f65c4068760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65d40af000 tx=0x7f65d40b4040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:40.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.639+0000 7f65daffd640 1 -- 172.21.15.55:0/2480053485 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65e40b3c10 con 0x7f65e40c51a0 2023-07-06T21:42:40.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.823+0000 7f65e8e48640 1 -- 172.21.15.55:0/2480053485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65e40b3c10 con 0x7f65e40c51a0 2023-07-06T21:42:40.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.823+0000 7f65daffd640 1 -- 172.21.15.55:0/2480053485 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4667 (secure 0 0 0) 0x7f65e40b3c10 con 0x7f65e40c51a0 2023-07-06T21:42:40.831 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:40.831 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/720785920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":720785920},{"type":"v1","addr":"172.21.15.138:6834","nonce":720785920}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3780018439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3780018439},{"type":"v1","addr":"172.21.15.138:6835","nonce":3780018439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/690984517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":690984517},{"type":"v1","addr":"172.21.15.55:6837","nonce":690984517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:42:10.854280+0000","modified":"2023-07-06T21:42:29.371982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/1421414378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1421414378},{"type":"v1","addr":"172.21.15.55:6836","nonce":1421414378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T21:42:40.831 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-07-06T21:42:40.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.827+0000 7f65e8e48640 1 -- 172.21.15.55:0/2480053485 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f65c40662b0 msgr2=0x7f65c4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:40.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.827+0000 7f65e8e48640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f65c40662b0 0x7f65c4068760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65d40af000 tx=0x7f65d40b4040 comp rx=0 tx=0).stop 2023-07-06T21:42:40.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.827+0000 7f65e8e48640 1 -- 172.21.15.55:0/2480053485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65e40c51a0 msgr2=0x7f65e406b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:40.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.827+0000 7f65e8e48640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65e40c51a0 0x7f65e406b590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f65cc007370 tx=0x7f65cc007830 comp rx=0 tx=0).stop 2023-07-06T21:42:40.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.827+0000 7f65e8e48640 1 -- 172.21.15.55:0/2480053485 shutdown_connections 2023-07-06T21:42:40.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.827+0000 7f65e8e48640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f65c40662b0 0x7f65c4068760 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.827+0000 7f65e8e48640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65e40693f0 0x7f65e40c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.827+0000 7f65e8e48640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65e40c51a0 0x7f65e406b590 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.827+0000 7f65e8e48640 1 --2- 172.21.15.55:0/2480053485 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65e415fd40 0x7f65e41525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:40.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.827+0000 7f65e8e48640 1 -- 172.21.15.55:0/2480053485 >> 172.21.15.55:0/2480053485 conn(0x7f65e40b1730 msgr2=0x7f65e4153820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:40.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.827+0000 7f65e8e48640 1 -- 172.21.15.55:0/2480053485 shutdown_connections 2023-07-06T21:42:40.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.827+0000 7f65e8e48640 1 -- 172.21.15.55:0/2480053485 wait complete. 2023-07-06T21:42:40.852 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f8562093640 1 Processor -- start 2023-07-06T21:42:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f8562093640 1 -- start start 2023-07-06T21:42:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f8562093640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f855c0ce610 0x7f855c0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f8562093640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f855c0b1e10 0x7f855c15f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f8562093640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855c0b2290 con 0x7f855c0b7cd0 2023-07-06T21:42:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f8562093640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855c0d2310 con 0x7f855c0b1e10 2023-07-06T21:42:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f8562093640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c0b80a0 con 0x7f855c0ce610 2023-07-06T21:42:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f855b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f855c0b7cd0 0x7f855c0ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38486/0 (socket says 172.21.15.55:38486) 2023-07-06T21:42:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f855b7fe640 1 -- 172.21.15.55:0/3440774687 learned_addr learned my addr 172.21.15.55:0/3440774687 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f855bfff640 1 --2- 172.21.15.55:0/3440774687 >> v2:172.21.15.55:3300/0 conn(0x7f855c0b1e10 0x7f855c15f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f855affd640 1 --2- 172.21.15.55:0/3440774687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f855c0ce610 0x7f855c0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f855bfff640 1 -- 172.21.15.55:0/3440774687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f855c0ce610 msgr2=0x7f855c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:41.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f855bfff640 1 --2- 172.21.15.55:0/3440774687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f855c0ce610 0x7f855c0b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f855bfff640 1 -- 172.21.15.55:0/3440774687 >> v1:172.21.15.55:6789/0 conn(0x7f855c0b7cd0 legacy=0x7f855c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:41.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f855bfff640 1 -- 172.21.15.55:0/3440774687 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c0cd1c0 con 0x7f855c0b1e10 2023-07-06T21:42:41.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.991+0000 7f855a7fc640 1 -- 172.21.15.55:0/3440774687 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134839488 0 0) 0x7f855c0b2290 con 0x7f855c0b7cd0 2023-07-06T21:42:41.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.995+0000 7f855bfff640 1 --2- 172.21.15.55:0/3440774687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f855c0b1e10 0x7f855c15f870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8554009d90 tx=0x7f855401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5957606409966b25 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:41.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.995+0000 7f855a7fc640 1 -- 172.21.15.55:0/3440774687 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85540a5780 con 0x7f855c0b1e10 2023-07-06T21:42:41.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.995+0000 7f855a7fc640 1 -- 172.21.15.55:0/3440774687 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85540a58e0 con 0x7f855c0b1e10 2023-07-06T21:42:41.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.995+0000 7f855a7fc640 1 -- 172.21.15.55:0/3440774687 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85540a5c70 con 0x7f855c0b1e10 2023-07-06T21:42:41.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.995+0000 7f8562093640 1 -- 172.21.15.55:0/3440774687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f855c0b1e10 msgr2=0x7f855c15f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:41.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.995+0000 7f8562093640 1 --2- 172.21.15.55:0/3440774687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f855c0b1e10 0x7f855c15f870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8554009d90 tx=0x7f855401c8c0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.995+0000 7f8562093640 1 -- 172.21.15.55:0/3440774687 shutdown_connections 2023-07-06T21:42:41.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.995+0000 7f8562093640 1 --2- 172.21.15.55:0/3440774687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f855c0ce610 0x7f855c0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.995+0000 7f8562093640 1 --2- 172.21.15.55:0/3440774687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f855c0b1e10 0x7f855c15f870 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.995+0000 7f8562093640 1 -- 172.21.15.55:0/3440774687 >> 172.21.15.55:0/3440774687 conn(0x7f855c0ceee0 msgr2=0x7f855c0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:41.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.995+0000 7f8562093640 1 -- 172.21.15.55:0/3440774687 shutdown_connections 2023-07-06T21:42:41.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.995+0000 7f8562093640 1 -- 172.21.15.55:0/3440774687 wait complete. 2023-07-06T21:42:41.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.995+0000 7f8562093640 1 Processor -- start 2023-07-06T21:42:41.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.995+0000 7f8562093640 1 -- start start 2023-07-06T21:42:41.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f8562093640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f855c0b1e10 0x7f855c1491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:41.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f8562093640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f855c0b7cd0 0x7f855c159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:41.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f8562093640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f855c0ce610 0x7f855c15b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:41.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f8562093640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c15a6b0 con 0x7f855c0ce610 2023-07-06T21:42:41.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f8562093640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c15bf00 con 0x7f855c0b7cd0 2023-07-06T21:42:41.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f8562093640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c159aa0 con 0x7f855c0b1e10 2023-07-06T21:42:41.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f855bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f855c0ce610 0x7f855c15b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:41.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f855bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f855c0ce610 0x7f855c15b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55516/0 (socket says 172.21.15.55:55516) 2023-07-06T21:42:41.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f855bfff640 1 -- 172.21.15.55:0/1763815467 learned_addr learned my addr 172.21.15.55:0/1763815467 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:41.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f855b7fe640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f855c0b1e10 0x7f855c1491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:41.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f855affd640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f855c0b7cd0 0x7f855c159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:41.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f855bfff640 1 -- 172.21.15.55:0/1763815467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f855c0b1e10 msgr2=0x7f855c1491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:41.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f855bfff640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f855c0b1e10 0x7f855c1491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f855bfff640 1 -- 172.21.15.55:0/1763815467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f855c0b7cd0 msgr2=0x7f855c159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:41.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f855bfff640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f855c0b7cd0 0x7f855c159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f855bfff640 1 -- 172.21.15.55:0/1763815467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8554009a70 con 0x7f855c0ce610 2023-07-06T21:42:41.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f855b7fe640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f855c0b1e10 0x7f855c1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:41.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f855affd640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f855c0b7cd0 0x7f855c159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:41.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f855bfff640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f855c0ce610 0x7f855c15b9c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f85540b0040 tx=0x7f8554019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:41.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f8543fff640 1 -- 172.21.15.55:0/1763815467 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85540b9650 con 0x7f855c0ce610 2023-07-06T21:42:41.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f8543fff640 1 -- 172.21.15.55:0/1763815467 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85540b97b0 con 0x7f855c0ce610 2023-07-06T21:42:41.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f8543fff640 1 -- 172.21.15.55:0/1763815467 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85540b9b20 con 0x7f855c0ce610 2023-07-06T21:42:41.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f8562093640 1 -- 172.21.15.55:0/1763815467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c159d80 con 0x7f855c0ce610 2023-07-06T21:42:41.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f8562093640 1 -- 172.21.15.55:0/1763815467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c15a340 con 0x7f855c0ce610 2023-07-06T21:42:41.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:40.999+0000 7f8562093640 1 -- 172.21.15.55:0/1763815467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c15db50 con 0x7f855c0ce610 2023-07-06T21:42:41.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.003+0000 7f8543fff640 1 -- 172.21.15.55:0/1763815467 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85540b9c80 con 0x7f855c0ce610 2023-07-06T21:42:41.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.003+0000 7f8543fff640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8548066280 0x7f8548068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:41.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.003+0000 7f8543fff640 1 -- 172.21.15.55:0/1763815467 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f855411f220 con 0x7f855c0ce610 2023-07-06T21:42:41.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.003+0000 7f855b7fe640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8548066280 0x7f8548068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:41.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.003+0000 7f855b7fe640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8548066280 0x7f8548068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f854c000f70 tx=0x7f854c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:41.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.007+0000 7f8543fff640 1 -- 172.21.15.55:0/1763815467 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85540ec3a0 con 0x7f855c0ce610 2023-07-06T21:42:41.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.163+0000 7f8562093640 1 -- 172.21.15.55:0/1763815467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f855c066d60 con 0x7f855c0ce610 2023-07-06T21:42:41.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.163+0000 7f8543fff640 1 -- 172.21.15.55:0/1763815467 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f85540ef9c0 con 0x7f855c0ce610 2023-07-06T21:42:41.169 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:41.170 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:15.295464+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:41.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.167+0000 7f8562093640 1 -- 172.21.15.55:0/1763815467 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8548066280 msgr2=0x7f8548068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:41.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.167+0000 7f8562093640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8548066280 0x7f8548068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f854c000f70 tx=0x7f854c009040 comp rx=0 tx=0).stop 2023-07-06T21:42:41.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.167+0000 7f8562093640 1 -- 172.21.15.55:0/1763815467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f855c0ce610 msgr2=0x7f855c15b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:41.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.167+0000 7f8562093640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f855c0ce610 0x7f855c15b9c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f85540b0040 tx=0x7f8554019660 comp rx=0 tx=0).stop 2023-07-06T21:42:41.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.167+0000 7f8562093640 1 -- 172.21.15.55:0/1763815467 shutdown_connections 2023-07-06T21:42:41.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.167+0000 7f8562093640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8548066280 0x7f8548068730 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.167+0000 7f8562093640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f855c0ce610 0x7f855c15b9c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.167+0000 7f8562093640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f855c0b7cd0 0x7f855c159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.167+0000 7f8562093640 1 --2- 172.21.15.55:0/1763815467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f855c0b1e10 0x7f855c1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.167+0000 7f8562093640 1 -- 172.21.15.55:0/1763815467 >> 172.21.15.55:0/1763815467 conn(0x7f855c0ceee0 msgr2=0x7f855c06a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.167+0000 7f8562093640 1 -- 172.21.15.55:0/1763815467 shutdown_connections 2023-07-06T21:42:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.167+0000 7f8562093640 1 -- 172.21.15.55:0/1763815467 wait complete. 2023-07-06T21:42:41.191 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:42:41.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.327+0000 7ff10f5c5640 1 Processor -- start 2023-07-06T21:42:41.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.327+0000 7ff10f5c5640 1 -- start start 2023-07-06T21:42:41.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.331+0000 7ff10f5c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1080cde40 0x7ff10815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:41.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.331+0000 7ff10f5c5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1080ce290 con 0x7ff10806f8e0 2023-07-06T21:42:41.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.331+0000 7ff10f5c5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff108158210 con 0x7ff108157e40 2023-07-06T21:42:41.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.331+0000 7ff10f5c5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10815bd10 con 0x7ff1080cde40 2023-07-06T21:42:41.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.331+0000 7ff10cb60640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1080cde40 0x7ff10815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:41.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.331+0000 7ff10db62640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff10806f8e0 0x7ff1080c8cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38496/0 (socket says 172.21.15.55:38496) 2023-07-06T21:42:41.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.331+0000 7ff10db62640 1 -- 172.21.15.55:0/3556560888 learned_addr learned my addr 172.21.15.55:0/3556560888 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:41.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.331+0000 7ff10cb60640 1 -- 172.21.15.55:0/3556560888 >> v1:172.21.15.138:6789/0 conn(0x7ff108157e40 legacy=0x7ff108158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:41.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.331+0000 7ff0fffff640 1 -- 172.21.15.55:0/3556560888 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439483978 0 0) 0x7ff1080ce290 con 0x7ff10806f8e0 2023-07-06T21:42:41.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.331+0000 7ff10cb60640 1 -- 172.21.15.55:0/3556560888 >> v1:172.21.15.55:6789/0 conn(0x7ff10806f8e0 legacy=0x7ff1080c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:41.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.331+0000 7ff10cb60640 1 -- 172.21.15.55:0/3556560888 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10815b9e0 con 0x7ff1080cde40 2023-07-06T21:42:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.331+0000 7ff10cb60640 1 --2- 172.21.15.55:0/3556560888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1080cde40 0x7ff10815c1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80097c0 tx=0x7ff0f801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54078bab26a83d38 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.331+0000 7ff0fffff640 1 -- 172.21.15.55:0/3556560888 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f80ab600 con 0x7ff1080cde40 2023-07-06T21:42:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff0fffff640 1 -- 172.21.15.55:0/3556560888 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f80a7050 con 0x7ff1080cde40 2023-07-06T21:42:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff0fffff640 1 -- 172.21.15.55:0/3556560888 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f80ab980 con 0x7ff1080cde40 2023-07-06T21:42:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 -- 172.21.15.55:0/3556560888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1080cde40 msgr2=0x7ff10815c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 --2- 172.21.15.55:0/3556560888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1080cde40 0x7ff10815c1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80097c0 tx=0x7ff0f801c480 comp rx=0 tx=0).stop 2023-07-06T21:42:41.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 -- 172.21.15.55:0/3556560888 shutdown_connections 2023-07-06T21:42:41.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 --2- 172.21.15.55:0/3556560888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1080cde40 0x7ff10815c1a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 -- 172.21.15.55:0/3556560888 >> 172.21.15.55:0/3556560888 conn(0x7ff1080cbd80 msgr2=0x7ff1080ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:41.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 -- 172.21.15.55:0/3556560888 shutdown_connections 2023-07-06T21:42:41.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 -- 172.21.15.55:0/3556560888 wait complete. 2023-07-06T21:42:41.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 Processor -- start 2023-07-06T21:42:41.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 -- start start 2023-07-06T21:42:41.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff10806f8e0 0x7ff10814aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:41.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1080cde40 0x7ff10814e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:41.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff108157e40 0x7ff10814d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:41.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10814cda0 con 0x7ff1080cde40 2023-07-06T21:42:41.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080b2ba0 con 0x7ff108157e40 2023-07-06T21:42:41.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10f5c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080b2e80 con 0x7ff10806f8e0 2023-07-06T21:42:41.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10cb60640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1080cde40 0x7ff10814e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:41.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10cb60640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1080cde40 0x7ff10814e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55538/0 (socket says 172.21.15.55:55538) 2023-07-06T21:42:41.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10cb60640 1 -- 172.21.15.55:0/798509461 learned_addr learned my addr 172.21.15.55:0/798509461 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:41.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10d361640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff10806f8e0 0x7ff10814aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:41.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.335+0000 7ff10db62640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff108157e40 0x7ff10814d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:41.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff10cb60640 1 -- 172.21.15.55:0/798509461 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff10806f8e0 msgr2=0x7ff10814aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:41.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff10cb60640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff10806f8e0 0x7ff10814aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff10cb60640 1 -- 172.21.15.55:0/798509461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff108157e40 msgr2=0x7ff10814d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:41.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff10cb60640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff108157e40 0x7ff10814d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff10cb60640 1 -- 172.21.15.55:0/798509461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f8009420 con 0x7ff1080cde40 2023-07-06T21:42:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff10d361640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff10806f8e0 0x7ff10814aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff10db62640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff108157e40 0x7ff10814d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff10cb60640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1080cde40 0x7ff10814e190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8019090 tx=0x7ff0f8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff0fdffb640 1 -- 172.21.15.55:0/798509461 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f80b4610 con 0x7ff1080cde40 2023-07-06T21:42:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff0fdffb640 1 -- 172.21.15.55:0/798509461 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f80abe90 con 0x7ff1080cde40 2023-07-06T21:42:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff10f5c5640 1 -- 172.21.15.55:0/798509461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10814c9c0 con 0x7ff1080cde40 2023-07-06T21:42:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff0fdffb640 1 -- 172.21.15.55:0/798509461 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f80b49d0 con 0x7ff1080cde40 2023-07-06T21:42:41.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff10f5c5640 1 -- 172.21.15.55:0/798509461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10814e6d0 con 0x7ff1080cde40 2023-07-06T21:42:41.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff10f5c5640 1 -- 172.21.15.55:0/798509461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff108066d60 con 0x7ff1080cde40 2023-07-06T21:42:41.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff0fdffb640 1 -- 172.21.15.55:0/798509461 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff0f80b2040 con 0x7ff1080cde40 2023-07-06T21:42:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff0fdffb640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff0ec066280 0x7ff0ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff0fdffb640 1 -- 172.21.15.55:0/798509461 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff0f811e0d0 con 0x7ff1080cde40 2023-07-06T21:42:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.339+0000 7ff10d361640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff0ec066280 0x7ff0ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.343+0000 7ff10d361640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff0ec066280 0x7ff0ec068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff10815ae60 tx=0x7ff104009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:41.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.343+0000 7ff0fdffb640 1 -- 172.21.15.55:0/798509461 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff0f80eb1c0 con 0x7ff1080cde40 2023-07-06T21:42:41.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.531+0000 7ff10f5c5640 1 -- 172.21.15.55:0/798509461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff10806a6f0 con 0x7ff1080cde40 2023-07-06T21:42:41.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.531+0000 7ff0fdffb640 1 -- 172.21.15.55:0/798509461 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4667 (secure 0 0 0) 0x7ff0f80b0020 con 0x7ff1080cde40 2023-07-06T21:42:41.538 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:41.539 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/720785920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":720785920},{"type":"v1","addr":"172.21.15.138:6834","nonce":720785920}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3780018439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3780018439},{"type":"v1","addr":"172.21.15.138:6835","nonce":3780018439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/690984517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":690984517},{"type":"v1","addr":"172.21.15.55:6837","nonce":690984517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:42:10.854280+0000","modified":"2023-07-06T21:42:29.371982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/1421414378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1421414378},{"type":"v1","addr":"172.21.15.55:6836","nonce":1421414378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T21:42:41.540 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-07-06T21:42:41.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.535+0000 7ff10f5c5640 1 -- 172.21.15.55:0/798509461 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff0ec066280 msgr2=0x7ff0ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:41.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.535+0000 7ff10f5c5640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff0ec066280 0x7ff0ec068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff10815ae60 tx=0x7ff104009040 comp rx=0 tx=0).stop 2023-07-06T21:42:41.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.535+0000 7ff10f5c5640 1 -- 172.21.15.55:0/798509461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1080cde40 msgr2=0x7ff10814e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:41.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.535+0000 7ff10f5c5640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1080cde40 0x7ff10814e190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8019090 tx=0x7ff0f8019220 comp rx=0 tx=0).stop 2023-07-06T21:42:41.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.535+0000 7ff10f5c5640 1 -- 172.21.15.55:0/798509461 shutdown_connections 2023-07-06T21:42:41.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.535+0000 7ff10f5c5640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff0ec066280 0x7ff0ec068730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.535+0000 7ff10f5c5640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff108157e40 0x7ff10814d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.535+0000 7ff10f5c5640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1080cde40 0x7ff10814e190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.535+0000 7ff10f5c5640 1 --2- 172.21.15.55:0/798509461 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff10806f8e0 0x7ff10814aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:41.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.535+0000 7ff10f5c5640 1 -- 172.21.15.55:0/798509461 >> 172.21.15.55:0/798509461 conn(0x7ff1080cbd80 msgr2=0x7ff1081633c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:41.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.535+0000 7ff10f5c5640 1 -- 172.21.15.55:0/798509461 shutdown_connections 2023-07-06T21:42:41.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:41.535+0000 7ff10f5c5640 1 -- 172.21.15.55:0/798509461 wait complete. 2023-07-06T21:42:41.961 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T21:42:10.854280+0000', 'modified': '2023-07-06T21:42:29.371982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6836/1421414378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 1421414378}, {'type': 'v1', 'addr': '172.21.15.55:6836', 'nonce': 1421414378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T21:42:41.961 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T21:42:41.961 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-06T21:42:42.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.103+0000 7fa97e9a3640 1 Processor -- start 2023-07-06T21:42:42.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.103+0000 7fa97e9a3640 1 -- start start 2023-07-06T21:42:42.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.103+0000 7fa97e9a3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa9780ca130 0x7fa9780703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.103+0000 7fa97e9a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9780cd140 0x7fa978070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.103+0000 7fa97e9a3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa978158c20 con 0x7fa978158850 2023-07-06T21:42:42.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.103+0000 7fa97e9a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9780b2aa0 con 0x7fa9780cd140 2023-07-06T21:42:42.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.103+0000 7fa97e9a3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9780c8db0 con 0x7fa9780ca130 2023-07-06T21:42:42.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.103+0000 7fa97cf40640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9780cd140 0x7fa978070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.103+0000 7fa97cf40640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9780cd140 0x7fa978070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55554/0 (socket says 172.21.15.55:55554) 2023-07-06T21:42:42.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.103+0000 7fa97cf40640 1 -- 172.21.15.55:0/292266771 learned_addr learned my addr 172.21.15.55:0/292266771 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:42.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.103+0000 7fa9777fe640 1 --2- 172.21.15.55:0/292266771 >> v2:172.21.15.138:3300/0 conn(0x7fa9780ca130 0x7fa9780703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.103+0000 7fa97cf40640 1 -- 172.21.15.55:0/292266771 >> v2:172.21.15.138:3300/0 conn(0x7fa9780ca130 msgr2=0x7fa9780703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:42.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa97cf40640 1 --2- 172.21.15.55:0/292266771 >> v2:172.21.15.138:3300/0 conn(0x7fa9780ca130 0x7fa9780703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa97cf40640 1 -- 172.21.15.55:0/292266771 >> v1:172.21.15.138:6789/0 conn(0x7fa978158850 legacy=0x7fa9780cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa97cf40640 1 -- 172.21.15.55:0/292266771 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780c9090 con 0x7fa9780cd140 2023-07-06T21:42:42.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa9777fe640 1 --2- 172.21.15.55:0/292266771 >> v2:172.21.15.138:3300/0 conn(0x7fa9780ca130 0x7fa9780703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:42.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa97cf40640 1 --2- 172.21.15.55:0/292266771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780cd140 0x7fa978070920 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa978071490 tx=0x7fa97001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879cbcd367f12649 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:42.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa976ffd640 1 -- 172.21.15.55:0/292266771 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000b2d0 con 0x7fa9780cd140 2023-07-06T21:42:42.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa976ffd640 1 -- 172.21.15.55:0/292266771 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000b430 con 0x7fa9780cd140 2023-07-06T21:42:42.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa976ffd640 1 -- 172.21.15.55:0/292266771 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9700a7c90 con 0x7fa9780cd140 2023-07-06T21:42:42.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa97e9a3640 1 -- 172.21.15.55:0/292266771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780cd140 msgr2=0x7fa978070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa97e9a3640 1 --2- 172.21.15.55:0/292266771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780cd140 0x7fa978070920 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa978071490 tx=0x7fa97001eba0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa97e9a3640 1 -- 172.21.15.55:0/292266771 shutdown_connections 2023-07-06T21:42:42.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa97e9a3640 1 --2- 172.21.15.55:0/292266771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780cd140 0x7fa978070920 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa97e9a3640 1 --2- 172.21.15.55:0/292266771 >> v2:172.21.15.138:3300/0 conn(0x7fa9780ca130 0x7fa9780703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa97e9a3640 1 -- 172.21.15.55:0/292266771 >> 172.21.15.55:0/292266771 conn(0x7fa9780cea70 msgr2=0x7fa9780ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa97e9a3640 1 -- 172.21.15.55:0/292266771 shutdown_connections 2023-07-06T21:42:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.107+0000 7fa97e9a3640 1 -- 172.21.15.55:0/292266771 wait complete. 2023-07-06T21:42:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97e9a3640 1 Processor -- start 2023-07-06T21:42:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97e9a3640 1 -- start start 2023-07-06T21:42:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97e9a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9780ca130 0x7fa9780c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97e9a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9780cd140 0x7fa97806b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97e9a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa978158850 0x7fa97806bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97e9a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780c67b0 con 0x7fa978158850 2023-07-06T21:42:42.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97e9a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780c7d00 con 0x7fa9780cd140 2023-07-06T21:42:42.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97e9a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780c5ba0 con 0x7fa9780ca130 2023-07-06T21:42:42.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97cf40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa978158850 0x7fa97806bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa977fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9780ca130 0x7fa9780c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97cf40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa978158850 0x7fa97806bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55562/0 (socket says 172.21.15.55:55562) 2023-07-06T21:42:42.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97cf40640 1 -- 172.21.15.55:0/547434214 learned_addr learned my addr 172.21.15.55:0/547434214 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:42.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa9777fe640 1 --2- 172.21.15.55:0/547434214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9780cd140 0x7fa97806b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97cf40640 1 -- 172.21.15.55:0/547434214 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9780ca130 msgr2=0x7fa9780c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97cf40640 1 --2- 172.21.15.55:0/547434214 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9780ca130 0x7fa9780c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97cf40640 1 -- 172.21.15.55:0/547434214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9780cd140 msgr2=0x7fa97806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97cf40640 1 --2- 172.21.15.55:0/547434214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9780cd140 0x7fa97806b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97cf40640 1 -- 172.21.15.55:0/547434214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97000bd40 con 0x7fa978158850 2023-07-06T21:42:42.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.111+0000 7fa97cf40640 1 --2- 172.21.15.55:0/547434214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa978158850 0x7fa97806bb30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa97001b7b0 tx=0x7fa97001b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:42.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.115+0000 7fa974ff9640 1 -- 172.21.15.55:0/547434214 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970009800 con 0x7fa978158850 2023-07-06T21:42:42.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.115+0000 7fa974ff9640 1 -- 172.21.15.55:0/547434214 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9700099a0 con 0x7fa978158850 2023-07-06T21:42:42.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.115+0000 7fa974ff9640 1 -- 172.21.15.55:0/547434214 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970009d50 con 0x7fa978158850 2023-07-06T21:42:42.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.115+0000 7fa97e9a3640 1 -- 172.21.15.55:0/547434214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9780c5e80 con 0x7fa978158850 2023-07-06T21:42:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.115+0000 7fa97e9a3640 1 -- 172.21.15.55:0/547434214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9780c6440 con 0x7fa978158850 2023-07-06T21:42:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.115+0000 7fa974ff9640 1 -- 172.21.15.55:0/547434214 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa9700c3460 con 0x7fa978158850 2023-07-06T21:42:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.115+0000 7fa974ff9640 1 --2- 172.21.15.55:0/547434214 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa9640662b0 0x7fa964068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.115+0000 7fa974ff9640 1 -- 172.21.15.55:0/547434214 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa97011f6f0 con 0x7fa978158850 2023-07-06T21:42:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.115+0000 7fa977fff640 1 --2- 172.21.15.55:0/547434214 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa9640662b0 0x7fa964068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.115+0000 7fa981ce6000 1 Processor -- start 2023-07-06T21:42:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.115+0000 7fa981ce6000 1 -- start start 2023-07-06T21:42:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa977fff640 1 --2- 172.21.15.55:0/547434214 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa9640662b0 0x7fa964068760 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa968007fd0 tx=0x7fa968009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:42.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792726740 0x562792726b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792727050 0x5627926dc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 0x5627926dd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627925a4ac0 con 0x562792726740 2023-07-06T21:42:42.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627924de840 con 0x5627926dcd80 2023-07-06T21:42:42.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627925322e0 con 0x562792727050 2023-07-06T21:42:42.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa977fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792726740 0x562792726b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa977fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792726740 0x562792726b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55568/0 (socket says 172.21.15.55:55568) 2023-07-06T21:42:42.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa977fff640 1 -- 172.21.15.55:0/3494067308 learned_addr learned my addr 172.21.15.55:0/3494067308 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:42.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa9777fe640 1 --2- 172.21.15.55:0/3494067308 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792727050 0x5627926dc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa97cf40640 1 --2- 172.21.15.55:0/3494067308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 0x5627926dd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa977fff640 1 -- 172.21.15.55:0/3494067308 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792727050 msgr2=0x5627926dc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:42.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa977fff640 1 --2- 172.21.15.55:0/3494067308 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792727050 0x5627926dc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa977fff640 1 -- 172.21.15.55:0/3494067308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 msgr2=0x5627926dd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:42.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa977fff640 1 --2- 172.21.15.55:0/3494067308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 0x5627926dd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa977fff640 1 -- 172.21.15.55:0/3494067308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562792227890 con 0x562792726740 2023-07-06T21:42:42.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa9777fe640 1 --2- 172.21.15.55:0/3494067308 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792727050 0x5627926dc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:42.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa97cf40640 1 --2- 172.21.15.55:0/3494067308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 0x5627926dd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:42.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa977fff640 1 --2- 172.21.15.55:0/3494067308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792726740 0x562792726b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa9680015e0 tx=0x7fa968012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161cc8611edbe75f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:42.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa95dffb640 1 -- 172.21.15.55:0/3494067308 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680149d0 con 0x562792726740 2023-07-06T21:42:42.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa95dffb640 1 -- 172.21.15.55:0/3494067308 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa968014b30 con 0x562792726740 2023-07-06T21:42:42.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa95dffb640 1 -- 172.21.15.55:0/3494067308 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968014ea0 con 0x562792726740 2023-07-06T21:42:42.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 -- 172.21.15.55:0/3494067308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792726740 msgr2=0x562792726b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 --2- 172.21.15.55:0/3494067308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792726740 0x562792726b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa9680015e0 tx=0x7fa968012000 comp rx=0 tx=0).stop 2023-07-06T21:42:42.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 -- 172.21.15.55:0/3494067308 shutdown_connections 2023-07-06T21:42:42.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 --2- 172.21.15.55:0/3494067308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 0x5627926dd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 --2- 172.21.15.55:0/3494067308 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792727050 0x5627926dc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 --2- 172.21.15.55:0/3494067308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792726740 0x562792726b10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 -- 172.21.15.55:0/3494067308 >> 172.21.15.55:0/3494067308 conn(0x5627926d4800 msgr2=0x5627926e3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:42.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 -- 172.21.15.55:0/3494067308 shutdown_connections 2023-07-06T21:42:42.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 -- 172.21.15.55:0/3494067308 wait complete. 2023-07-06T21:42:42.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 -- start start 2023-07-06T21:42:42.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.119+0000 7fa981ce6000 1 Processor -- start 2023-07-06T21:42:42.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627926dcd80 0x5627926e2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792726740 0x5627926e80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562792727050 0x5627926e8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56279252b380 con 0x5627926dcd80 2023-07-06T21:42:42.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627924e7ae0 con 0x562792727050 2023-07-06T21:42:42.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627924e7780 con 0x562792726740 2023-07-06T21:42:42.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 10 client.0 _ll_register_callbacks cb 0x5627926c8e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T21:42:42.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa977fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627926dcd80 0x5627926e2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa977fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627926dcd80 0x5627926e2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55574/0 (socket says 172.21.15.55:55574) 2023-07-06T21:42:42.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa977fff640 1 -- 172.21.15.55:0/1596085324 learned_addr learned my addr 172.21.15.55:0/1596085324 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa97cf40640 1 --2- 172.21.15.55:0/1596085324 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562792727050 0x5627926e8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa977fff640 1 -- 172.21.15.55:0/1596085324 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792726740 msgr2=0x5627926e80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa977fff640 1 --2- 172.21.15.55:0/1596085324 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792726740 0x5627926e80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa977fff640 1 -- 172.21.15.55:0/1596085324 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562792727050 msgr2=0x5627926e8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa977fff640 1 --2- 172.21.15.55:0/1596085324 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562792727050 0x5627926e8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa977fff640 1 -- 172.21.15.55:0/1596085324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa978158c20 con 0x5627926dcd80 2023-07-06T21:42:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa97cf40640 1 --2- 172.21.15.55:0/1596085324 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562792727050 0x5627926e8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:42.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa977fff640 1 --2- 172.21.15.55:0/1596085324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627926dcd80 0x5627926e2910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa968023040 tx=0x7fa968001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa400e20fdc1b45d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:42.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa956ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T21:42:42.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa956ffd640 1 -- 172.21.15.55:0/1596085324 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968020a20 con 0x5627926dcd80 2023-07-06T21:42:42.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa956ffd640 1 -- 172.21.15.55:0/1596085324 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa96801c040 con 0x5627926dcd80 2023-07-06T21:42:42.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 1 -- 172.21.15.55:0/1596085324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627924f2a20 con 0x5627926dcd80 2023-07-06T21:42:42.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa956ffd640 1 -- 172.21.15.55:0/1596085324 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa968020b80 con 0x5627926dcd80 2023-07-06T21:42:42.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 10 client.4866 fetch_fsmap learned FSMap version 9 2023-07-06T21:42:42.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 1 -- 172.21.15.55:0/1596085324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5627924efd10 con 0x5627926dcd80 2023-07-06T21:42:42.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa956ffd640 1 -- 172.21.15.55:0/1596085324 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5627924f2a20 con 0x5627926dcd80 2023-07-06T21:42:42.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa956ffd640 1 -- 172.21.15.55:0/1596085324 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fa968012070 con 0x5627926dcd80 2023-07-06T21:42:42.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 10 client.4866 fetch_fsmap finished waiting for FSMap version 9 2023-07-06T21:42:42.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 10 client.4866 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-06T21:42:42.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 20 client.4866 populate_metadata read hostname 'smithi055' 2023-07-06T21:42:42.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 1 --2- 172.21.15.55:0/1596085324 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x562792735c80 0x562792738060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 4 client.4866 mds_command: new command op to 4297 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T21:42:42.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa981ce6000 1 -- 172.21.15.55:0/1596085324 --> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56279255a710 con 0x562792735c80 2023-07-06T21:42:42.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa9777fe640 1 --2- 172.21.15.55:0/1596085324 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x562792735c80 0x562792738060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa9777fe640 1 --2- 172.21.15.55:0/1596085324 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x562792735c80 0x562792738060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce44561917d3124b server_cookie=db1f5cf8e3a7bc3b in_seq=0 out_seq=0 2023-07-06T21:42:42.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.123+0000 7fa956ffd640 10 client.4866 ms_handle_connect on v2:172.21.15.55:6834/1421414378 2023-07-06T21:42:42.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa956ffd640 1 -- 172.21.15.55:0/1596085324 <== mds.0 v2:172.21.15.55:6834/1421414378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56279255a710 con 0x562792735c80 2023-07-06T21:42:42.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa956ffd640 10 client.4866 handle_command_reply: tid=0 2023-07-06T21:42:42.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa981ce6000 1 client.4866 shutdown 2023-07-06T21:42:42.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa981ce6000 1 -- 172.21.15.55:0/1596085324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627926dcd80 msgr2=0x5627926e2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa981ce6000 1 --2- 172.21.15.55:0/1596085324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627926dcd80 0x5627926e2910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa968023040 tx=0x7fa968001090 comp rx=0 tx=0).stop 2023-07-06T21:42:42.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa981ce6000 1 -- 172.21.15.55:0/1596085324 shutdown_connections 2023-07-06T21:42:42.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa981ce6000 1 --2- 172.21.15.55:0/1596085324 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562792727050 0x5627926e8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa981ce6000 1 --2- 172.21.15.55:0/1596085324 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792726740 0x5627926e80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa981ce6000 1 --2- 172.21.15.55:0/1596085324 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x562792735c80 0x562792738060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa981ce6000 1 --2- 172.21.15.55:0/1596085324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627926dcd80 0x5627926e2910 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa981ce6000 1 -- 172.21.15.55:0/1596085324 >> 172.21.15.55:0/1596085324 conn(0x5627926d4800 msgr2=0x5627926db830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:42.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa956ffd640 0 client.4866 ms_handle_reset on v2:172.21.15.55:6834/1421414378 2023-07-06T21:42:42.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa981ce6000 1 -- 172.21.15.55:0/1596085324 shutdown_connections 2023-07-06T21:42:42.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa981ce6000 1 -- 172.21.15.55:0/1596085324 wait complete. 2023-07-06T21:42:42.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.127+0000 7fa981ce6000 20 client.4866 trim_cache size 0 max 16384 2023-07-06T21:42:42.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 Processor -- start 2023-07-06T21:42:42.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 -- start start 2023-07-06T21:42:42.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 0x5627927257e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792726740 0x562792725d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792727050 0x562792736050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627921e8940 con 0x562792727050 2023-07-06T21:42:42.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x562792533570 con 0x5627926dcd80 2023-07-06T21:42:42.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627924ca930 con 0x562792726740 2023-07-06T21:42:42.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa97cf40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792727050 0x562792736050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa97cf40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792727050 0x562792736050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55576/0 (socket says 172.21.15.55:55576) 2023-07-06T21:42:42.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa97cf40640 1 -- 172.21.15.55:0/2582449478 learned_addr learned my addr 172.21.15.55:0/2582449478 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:42.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa977fff640 1 --2- 172.21.15.55:0/2582449478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 0x5627927257e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa9777fe640 1 --2- 172.21.15.55:0/2582449478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792726740 0x562792725d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa97cf40640 1 -- 172.21.15.55:0/2582449478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792726740 msgr2=0x562792725d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:42.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa97cf40640 1 --2- 172.21.15.55:0/2582449478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792726740 0x562792725d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa97cf40640 1 -- 172.21.15.55:0/2582449478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 msgr2=0x5627927257e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:42.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa97cf40640 1 --2- 172.21.15.55:0/2582449478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 0x5627927257e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa97cf40640 1 -- 172.21.15.55:0/2582449478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627926df450 con 0x562792727050 2023-07-06T21:42:42.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa97cf40640 1 --2- 172.21.15.55:0/2582449478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792727050 0x562792736050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa9700f0430 tx=0x7fa9700f0630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae4d9c46197e422 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:42.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa95e7fc640 1 -- 172.21.15.55:0/2582449478 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97011d900 con 0x562792727050 2023-07-06T21:42:42.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa95e7fc640 1 -- 172.21.15.55:0/2582449478 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9700eead0 con 0x562792727050 2023-07-06T21:42:42.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa95e7fc640 1 -- 172.21.15.55:0/2582449478 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9700efc20 con 0x562792727050 2023-07-06T21:42:42.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 -- 172.21.15.55:0/2582449478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792727050 msgr2=0x562792736050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 --2- 172.21.15.55:0/2582449478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792727050 0x562792736050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa9700f0430 tx=0x7fa9700f0630 comp rx=0 tx=0).stop 2023-07-06T21:42:42.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 -- 172.21.15.55:0/2582449478 shutdown_connections 2023-07-06T21:42:42.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 --2- 172.21.15.55:0/2582449478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792727050 0x562792736050 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 --2- 172.21.15.55:0/2582449478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792726740 0x562792725d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 --2- 172.21.15.55:0/2582449478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 0x5627927257e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 -- 172.21.15.55:0/2582449478 >> 172.21.15.55:0/2582449478 conn(0x5627926d4800 msgr2=0x5627927250d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:42.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 -- 172.21.15.55:0/2582449478 shutdown_connections 2023-07-06T21:42:42.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 -- 172.21.15.55:0/2582449478 wait complete. 2023-07-06T21:42:42.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.143+0000 7fa981ce6000 1 -- start start 2023-07-06T21:42:42.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 1 Processor -- start 2023-07-06T21:42:42.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 0x562792784760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792726740 0x562792784ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792727050 0x5627927388b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627924f2630 con 0x562792727050 2023-07-06T21:42:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x562792526cf0 con 0x5627926dcd80 2023-07-06T21:42:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627926e68a0 con 0x562792726740 2023-07-06T21:42:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 10 client.0 _ll_register_callbacks cb 0x5627924ef7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T21:42:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa97cf40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792727050 0x5627927388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa97cf40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792727050 0x5627927388b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55592/0 (socket says 172.21.15.55:55592) 2023-07-06T21:42:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa97cf40640 1 -- 172.21.15.55:0/688337564 learned_addr learned my addr 172.21.15.55:0/688337564 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa977fff640 1 --2- 172.21.15.55:0/688337564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 0x562792784760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa9777fe640 1 --2- 172.21.15.55:0/688337564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792726740 0x562792784ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa97cf40640 1 -- 172.21.15.55:0/688337564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792726740 msgr2=0x562792784ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa97cf40640 1 --2- 172.21.15.55:0/688337564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792726740 0x562792784ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa97cf40640 1 -- 172.21.15.55:0/688337564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 msgr2=0x562792784760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa97cf40640 1 --2- 172.21.15.55:0/688337564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 0x562792784760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa97cf40640 1 -- 172.21.15.55:0/688337564 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9780c6440 con 0x562792727050 2023-07-06T21:42:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa977fff640 1 --2- 172.21.15.55:0/688337564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 0x562792784760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:42.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa97cf40640 1 --2- 172.21.15.55:0/688337564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792727050 0x5627927388b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa970025190 tx=0x7fa97011d600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48cb19caf8e9a6f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:42.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa956ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T21:42:42.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa956ffd640 1 -- 172.21.15.55:0/688337564 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9700f8740 con 0x562792727050 2023-07-06T21:42:42.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa956ffd640 1 -- 172.21.15.55:0/688337564 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa9700fe030 con 0x562792727050 2023-07-06T21:42:42.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 1 -- 172.21.15.55:0/688337564 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627926e06e0 con 0x562792727050 2023-07-06T21:42:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa956ffd640 1 -- 172.21.15.55:0/688337564 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa97011d490 con 0x562792727050 2023-07-06T21:42:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 10 client.4872 fetch_fsmap learned FSMap version 9 2023-07-06T21:42:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 1 -- 172.21.15.55:0/688337564 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5627924d5fa0 con 0x562792727050 2023-07-06T21:42:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa956ffd640 1 -- 172.21.15.55:0/688337564 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5627926e06e0 con 0x562792727050 2023-07-06T21:42:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa956ffd640 1 -- 172.21.15.55:0/688337564 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fa970005d20 con 0x562792727050 2023-07-06T21:42:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 10 client.4872 fetch_fsmap finished waiting for FSMap version 9 2023-07-06T21:42:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 10 client.4872 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-06T21:42:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 20 client.4872 populate_metadata read hostname 'smithi055' 2023-07-06T21:42:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 1 --2- 172.21.15.55:0/688337564 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x5627927391b0 0x562792739580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 4 client.4872 mds_command: new command op to 4297 tid=0[{"prefix": "status"}] 2023-07-06T21:42:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa981ce6000 1 -- 172.21.15.55:0/688337564 --> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562792529cd0 con 0x5627927391b0 2023-07-06T21:42:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa977fff640 1 --2- 172.21.15.55:0/688337564 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x5627927391b0 0x562792739580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa977fff640 1 --2- 172.21.15.55:0/688337564 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x5627927391b0 0x562792739580 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16e43173e34500aa server_cookie=af346fc4fa5cdeda in_seq=0 out_seq=0 2023-07-06T21:42:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.147+0000 7fa956ffd640 10 client.4872 ms_handle_connect on v2:172.21.15.55:6834/1421414378 2023-07-06T21:42:42.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa956ffd640 1 -- 172.21.15.55:0/688337564 <== mds.0 v2:172.21.15.55:6834/1421414378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x562792529cd0 con 0x5627927391b0 2023-07-06T21:42:42.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa956ffd640 10 client.4872 handle_command_reply: tid=0 2023-07-06T21:42:42.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa981ce6000 1 client.4872 shutdown 2023-07-06T21:42:42.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa981ce6000 1 -- 172.21.15.55:0/688337564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792727050 msgr2=0x5627927388b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa981ce6000 1 --2- 172.21.15.55:0/688337564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792727050 0x5627927388b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa970025190 tx=0x7fa97011d600 comp rx=0 tx=0).stop 2023-07-06T21:42:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa981ce6000 1 -- 172.21.15.55:0/688337564 shutdown_connections 2023-07-06T21:42:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa981ce6000 1 --2- 172.21.15.55:0/688337564 >> [v2:172.21.15.55:6834/1421414378,v1:172.21.15.55:6836/1421414378] conn(0x5627927391b0 0x562792739580 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa981ce6000 1 --2- 172.21.15.55:0/688337564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562792727050 0x5627927388b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa981ce6000 1 --2- 172.21.15.55:0/688337564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x562792726740 0x562792784ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa981ce6000 1 --2- 172.21.15.55:0/688337564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5627926dcd80 0x562792784760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa981ce6000 1 -- 172.21.15.55:0/688337564 >> 172.21.15.55:0/688337564 conn(0x5627926d4800 msgr2=0x5627927250d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:42.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa956ffd640 0 client.4872 ms_handle_reset on v2:172.21.15.55:6834/1421414378 2023-07-06T21:42:42.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa981ce6000 1 -- 172.21.15.55:0/688337564 shutdown_connections 2023-07-06T21:42:42.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa981ce6000 1 -- 172.21.15.55:0/688337564 wait complete. 2023-07-06T21:42:42.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa981ce6000 20 client.4872 trim_cache size 0 max 16384 2023-07-06T21:42:42.170 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T21:42:42.170 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c64f3ef1-e769-47b3-ae15-a714e4e7c4f7", 2023-07-06T21:42:42.170 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-07-06T21:42:42.170 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 4297, 2023-07-06T21:42:42.171 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-07-06T21:42:42.171 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-07-06T21:42:42.171 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-07-06T21:42:42.171 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 31.294757516000001, 2023-07-06T21:42:42.171 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 9, 2023-07-06T21:42:42.172 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 27, 2023-07-06T21:42:42.172 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 27, 2023-07-06T21:42:42.172 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 36.604833675000002 2023-07-06T21:42:42.172 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T21:42:42.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa97e9a3640 1 -- 172.21.15.55:0/547434214 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa9640662b0 msgr2=0x7fa964068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa97e9a3640 1 --2- 172.21.15.55:0/547434214 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa9640662b0 0x7fa964068760 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa968007fd0 tx=0x7fa968009040 comp rx=0 tx=0).stop 2023-07-06T21:42:42.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa97e9a3640 1 -- 172.21.15.55:0/547434214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa978158850 msgr2=0x7fa97806bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa97e9a3640 1 --2- 172.21.15.55:0/547434214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa978158850 0x7fa97806bb30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa97001b7b0 tx=0x7fa97001b940 comp rx=0 tx=0).stop 2023-07-06T21:42:42.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa97e9a3640 1 -- 172.21.15.55:0/547434214 shutdown_connections 2023-07-06T21:42:42.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa97e9a3640 1 --2- 172.21.15.55:0/547434214 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa9640662b0 0x7fa964068760 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa97e9a3640 1 --2- 172.21.15.55:0/547434214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa978158850 0x7fa97806bb30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa97e9a3640 1 --2- 172.21.15.55:0/547434214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9780cd140 0x7fa97806b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa97e9a3640 1 --2- 172.21.15.55:0/547434214 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9780ca130 0x7fa9780c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa97e9a3640 1 -- 172.21.15.55:0/547434214 >> 172.21.15.55:0/547434214 conn(0x7fa9780cea70 msgr2=0x7fa9780cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:42.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa97e9a3640 1 -- 172.21.15.55:0/547434214 shutdown_connections 2023-07-06T21:42:42.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.151+0000 7fa97e9a3640 1 -- 172.21.15.55:0/547434214 wait complete. 2023-07-06T21:42:42.176 INFO:teuthology.run_tasks:Running task kclient... 2023-07-06T21:42:42.193 INFO:tasks.kclient:Mounting kernel clients... 2023-07-06T21:42:42.194 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-06T21:42:42.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:42.194 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T21:42:42.204 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-07-06T21:42:42.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:42.205 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-06T21:42:42.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:42.269 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2023-07-06T21:42:42.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:42.521 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T21:42:42.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:42.533 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2023-07-06T21:42:42.598 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2023-07-06T21:42:42.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T21:42:42.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:42.601 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-07-06T21:42:42.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:42.612 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2023-07-06T21:42:42.679 INFO:teuthology.orchestra.run.smithi138.stderr:Cannot find device "ceph-brx" 2023-07-06T21:42:42.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T21:42:42.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:42.682 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-07-06T21:42:42.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:42.736 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2023-07-06T21:42:42.803 INFO:teuthology.orchestra.run.smithi138.stderr:Cannot find device "ceph-brx" 2023-07-06T21:42:42.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T21:42:42.809 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-07-06T21:42:42.810 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-06T21:42:42.810 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T21:42:42.811 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T21:42:42.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.951+0000 7f1826848640 1 Processor -- start 2023-07-06T21:42:42.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.951+0000 7f1826848640 1 -- start start 2023-07-06T21:42:42.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.951+0000 7f1826848640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1820158400 0x7f18200c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.951+0000 7f1826848640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182006fae0 con 0x7f18201587d0 2023-07-06T21:42:42.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.951+0000 7f1826848640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182006fdc0 con 0x7f18200c9680 2023-07-06T21:42:42.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.951+0000 7f1826848640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18200700a0 con 0x7f1820158400 2023-07-06T21:42:42.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.955+0000 7f1824de5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f18201587d0 0x7f18200cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38504/0 (socket says 172.21.15.55:38504) 2023-07-06T21:42:42.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.955+0000 7f1824de5640 1 -- 172.21.15.55:0/961971001 learned_addr learned my addr 172.21.15.55:0/961971001 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:42.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.955+0000 7f181ffff640 1 --2- 172.21.15.55:0/961971001 >> v2:172.21.15.138:3300/0 conn(0x7f1820158400 0x7f18200c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.955+0000 7f181effd640 1 -- 172.21.15.55:0/961971001 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623320695 0 0) 0x7f182006fae0 con 0x7f18201587d0 2023-07-06T21:42:42.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.955+0000 7f181effd640 1 -- 172.21.15.55:0/961971001 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1808003530 con 0x7f18201587d0 2023-07-06T21:42:42.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.955+0000 7f181ffff640 1 -- 172.21.15.55:0/961971001 >> v1:172.21.15.138:6789/0 conn(0x7f18200c9680 legacy=0x7f1820070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.955+0000 7f181ffff640 1 -- 172.21.15.55:0/961971001 >> v1:172.21.15.55:6789/0 conn(0x7f18201587d0 legacy=0x7f18200cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.955+0000 7f181ffff640 1 -- 172.21.15.55:0/961971001 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1820070380 con 0x7f1820158400 2023-07-06T21:42:42.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.955+0000 7f181ffff640 1 --2- 172.21.15.55:0/961971001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1820158400 0x7f18200c9140 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f18100097c0 tx=0x7f181001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8316f7f1a5869251 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:42.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.955+0000 7f181effd640 1 -- 172.21.15.55:0/961971001 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18100ab600 con 0x7f1820158400 2023-07-06T21:42:42.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.955+0000 7f181effd640 1 -- 172.21.15.55:0/961971001 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18100a7050 con 0x7f1820158400 2023-07-06T21:42:42.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f181effd640 1 -- 172.21.15.55:0/961971001 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18100ab980 con 0x7f1820158400 2023-07-06T21:42:42.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 -- 172.21.15.55:0/961971001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1820158400 msgr2=0x7f18200c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 --2- 172.21.15.55:0/961971001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1820158400 0x7f18200c9140 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f18100097c0 tx=0x7f181001c3c0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 -- 172.21.15.55:0/961971001 shutdown_connections 2023-07-06T21:42:42.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 --2- 172.21.15.55:0/961971001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1820158400 0x7f18200c9140 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 -- 172.21.15.55:0/961971001 >> 172.21.15.55:0/961971001 conn(0x7f18200cded0 msgr2=0x7f18200ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:42.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 -- 172.21.15.55:0/961971001 shutdown_connections 2023-07-06T21:42:42.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 -- 172.21.15.55:0/961971001 wait complete. 2023-07-06T21:42:42.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 Processor -- start 2023-07-06T21:42:42.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 -- start start 2023-07-06T21:42:42.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18200c9680 0x7f182015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1820158400 0x7f1820154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18201587d0 0x7f18200aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182015bd30 con 0x7f18200c9680 2023-07-06T21:42:42.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182015c010 con 0x7f18201587d0 2023-07-06T21:42:42.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f1826848640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182015c2f0 con 0x7f1820158400 2023-07-06T21:42:42.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f181ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18200c9680 0x7f182015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f181ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18200c9680 0x7f182015b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55596/0 (socket says 172.21.15.55:55596) 2023-07-06T21:42:42.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.959+0000 7f181ffff640 1 -- 172.21.15.55:0/1305357823 learned_addr learned my addr 172.21.15.55:0/1305357823 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:42.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f1824de5640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18201587d0 0x7f18200aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f181f7fe640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1820158400 0x7f1820154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f181ffff640 1 -- 172.21.15.55:0/1305357823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1820158400 msgr2=0x7f1820154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f181ffff640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1820158400 0x7f1820154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f181ffff640 1 -- 172.21.15.55:0/1305357823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18201587d0 msgr2=0x7f18200aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:42.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f181ffff640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18201587d0 0x7f18200aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f181ffff640 1 -- 172.21.15.55:0/1305357823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1810009420 con 0x7f18200c9680 2023-07-06T21:42:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f181f7fe640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1820158400 0x7f1820154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f181ffff640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18200c9680 0x7f182015b4a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1810018fd0 tx=0x7f181001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f181cff9640 1 -- 172.21.15.55:0/1305357823 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18100b7450 con 0x7f18200c9680 2023-07-06T21:42:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f181cff9640 1 -- 172.21.15.55:0/1305357823 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18100b75b0 con 0x7f18200c9680 2023-07-06T21:42:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f181cff9640 1 -- 172.21.15.55:0/1305357823 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18100b7960 con 0x7f18200c9680 2023-07-06T21:42:42.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f1826848640 1 -- 172.21.15.55:0/1305357823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182015c5d0 con 0x7f18200c9680 2023-07-06T21:42:42.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f1826848640 1 -- 172.21.15.55:0/1305357823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182015b9e0 con 0x7f18200c9680 2023-07-06T21:42:42.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f1826848640 1 -- 172.21.15.55:0/1305357823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182006c580 con 0x7f18200c9680 2023-07-06T21:42:42.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.963+0000 7f181cff9640 1 -- 172.21.15.55:0/1305357823 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18100b7ac0 con 0x7f18200c9680 2023-07-06T21:42:42.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.967+0000 7f181cff9640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f180c066280 0x7f180c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:42.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.967+0000 7f181cff9640 1 -- 172.21.15.55:0/1305357823 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f181011e7a0 con 0x7f18200c9680 2023-07-06T21:42:42.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.967+0000 7f181f7fe640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f180c066280 0x7f180c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:42.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.967+0000 7f181f7fe640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f180c066280 0x7f180c068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f18200c8fe0 tx=0x7f1814009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:42.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:42.971+0000 7f181cff9640 1 -- 172.21.15.55:0/1305357823 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18100eb930 con 0x7f18200c9680 2023-07-06T21:42:43.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:43.159+0000 7f1826848640 1 -- 172.21.15.55:0/1305357823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1820066d60 con 0x7f18200c9680 2023-07-06T21:42:43.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:43.159+0000 7f181cff9640 1 -- 172.21.15.55:0/1305357823 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f18100eef50 con 0x7f18200c9680 2023-07-06T21:42:43.166 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-06T21:42:43.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:43.163+0000 7f1826848640 1 -- 172.21.15.55:0/1305357823 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f180c066280 msgr2=0x7f180c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:43.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:43.163+0000 7f1826848640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f180c066280 0x7f180c068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f18200c8fe0 tx=0x7f1814009040 comp rx=0 tx=0).stop 2023-07-06T21:42:43.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:43.163+0000 7f1826848640 1 -- 172.21.15.55:0/1305357823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18200c9680 msgr2=0x7f182015b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:43.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:43.163+0000 7f1826848640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18200c9680 0x7f182015b4a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1810018fd0 tx=0x7f181001ac00 comp rx=0 tx=0).stop 2023-07-06T21:42:43.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:43.163+0000 7f1826848640 1 -- 172.21.15.55:0/1305357823 shutdown_connections 2023-07-06T21:42:43.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:43.163+0000 7f1826848640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f180c066280 0x7f180c068730 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:43.163+0000 7f1826848640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18201587d0 0x7f18200aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:43.163+0000 7f1826848640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1820158400 0x7f1820154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:43.163+0000 7f1826848640 1 --2- 172.21.15.55:0/1305357823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18200c9680 0x7f182015b4a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:43.163+0000 7f1826848640 1 -- 172.21.15.55:0/1305357823 >> 172.21.15.55:0/1305357823 conn(0x7f18200cded0 msgr2=0x7f18200ad990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:43.163+0000 7f1826848640 1 -- 172.21.15.55:0/1305357823 shutdown_connections 2023-07-06T21:42:43.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:43.163+0000 7f1826848640 1 -- 172.21.15.55:0/1305357823 wait complete. 2023-07-06T21:42:43.186 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-06T21:42:43.187 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T21:42:43.187 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-07-06T21:42:43.187 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T21:42:43.187 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T21:42:43.187 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-06T21:42:43.188 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-06T21:42:43.188 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T21:42:43.188 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:42:43.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:43.189 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-07-06T21:42:43.198 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T21:42:43.198 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T21:42:43.198 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T21:42:43.198 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:43.198 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T21:42:43.199 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:43.199 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:43.199 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:43.199 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-07-06T21:42:43.199 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:43.199 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:43.199 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-07-06T21:42:43.199 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T21:42:43.200 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:43.200 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-07-06T21:42:43.200 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-06T21:42:43.200 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42393sec preferred_lft 42393sec 2023-07-06T21:42:43.200 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-07-06T21:42:43.200 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:43.200 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:43.201 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:43.201 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-07-06T21:42:43.201 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T21:42:43.201 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:84:fe:b8:21 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:43.201 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T21:42:43.201 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:43.202 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-06T21:42:43.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:43.203 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:42:43.203 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:42:43.203 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add name ceph-brx type bridge 2023-07-06T21:42:43.203 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr flush dev ceph-brx 2023-07-06T21:42:43.204 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set ceph-brx up 2023-07-06T21:42:43.204 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-06T21:42:43.204 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:42:43.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:43.320 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T21:42:43.340 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-07-06T21:42:43.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:43.342 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-07-06T21:42:43.392 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-07-06T21:42:43.392 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T21:42:43.393 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-06T21:42:43.393 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T21:42:43.393 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-06T21:42:43.394 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T21:42:43.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:43.395 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:42:43.395 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:42:43.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T21:42:43.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T21:42:43.397 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T21:42:43.397 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:42:43.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:43.492 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T21:42:43.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:43.503 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2023-07-06T21:42:43.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:43.556 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:42:43.556 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:42:43.556 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T21:42:43.556 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-06T21:42:43.556 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:42:43.638 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-06T21:42:43.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:43.639 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:42:43.639 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:42:43.640 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-06T21:42:43.640 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-06T21:42:43.640 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-06T21:42:43.641 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-06T21:42:43.641 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-06T21:42:43.641 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:42:43.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:43.784 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:42:43.784 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:42:43.784 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-07-06T21:42:43.784 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.0 master ceph-brx 2023-07-06T21:42:43.785 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:42:43.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:42:43.829 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T21:42:43.883 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:42:43.883 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:42:43.883 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T21:42:43.934 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-06T21:42:43.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:43.934 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:42:44.025 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:42:44.026 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:42:44.224 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:42:44.224 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:42:44.225 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-07-06T21:42:44.225 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.cephfs=/ 2023-07-06T21:42:44.225 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-07-06T21:42:44.228 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T21:42:44.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:44.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T21:42:44.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:44.250 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:42:44.301 INFO:teuthology.orchestra.run.smithi055.stdout:client4881 2023-07-06T21:42:44.302 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:42:44.302 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:42:44.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:44.351 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:42:44.406 INFO:teuthology.orchestra.run.smithi055.stdout:client4881 2023-07-06T21:42:44.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:44.407 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:42:44.457 INFO:teuthology.orchestra.run.smithi055.stdout:client4881 2023-07-06T21:42:44.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:44.458 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.client4881/status') 2023-07-06T21:42:44.519 INFO:teuthology.orchestra.run.smithi055.stdout:instance: client.4881 (3)192.168.0.1:0/209469917 2023-07-06T21:42:44.519 INFO:teuthology.orchestra.run.smithi055.stdout:blocklisted: false 2023-07-06T21:42:44.520 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records in 2023-07-06T21:42:44.520 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records out 2023-07-06T21:42:44.520 INFO:teuthology.orchestra.run.smithi055.stderr:68 bytes copied, 5.1646e-05 s, 1.3 MB/s 2023-07-06T21:42:44.521 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-07-06T21:42:44.521 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-06T21:42:44.522 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-06T21:42:44.522 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T21:42:44.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f6859374640 1 Processor -- start 2023-07-06T21:42:44.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f6859374640 1 -- start start 2023-07-06T21:42:44.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f6859374640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68540ce610 0x7f68540b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:44.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f6859374640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68540b2290 con 0x7f68540b7cd0 2023-07-06T21:42:44.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f6859374640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68540cd1c0 con 0x7f68540b1e10 2023-07-06T21:42:44.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f6859374640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68540d2310 con 0x7f68540ce610 2023-07-06T21:42:44.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f6852ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f68540b7cd0 0x7f68540ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58286/0 (socket says 172.21.15.55:58286) 2023-07-06T21:42:44.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f6852ffd640 1 -- 172.21.15.55:0/1084122990 learned_addr learned my addr 172.21.15.55:0/1084122990 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:44.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f684a7fc640 1 --2- 172.21.15.55:0/1084122990 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68540ce610 0x7f68540b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:44.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 -- 172.21.15.55:0/1084122990 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229994332 0 0) 0x7f68540b2290 con 0x7f68540b7cd0 2023-07-06T21:42:44.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 -- 172.21.15.55:0/1084122990 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6840003530 con 0x7f68540b7cd0 2023-07-06T21:42:44.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 -- 172.21.15.55:0/1084122990 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1564063763 0 0) 0x7f6840003530 con 0x7f68540b7cd0 2023-07-06T21:42:44.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 -- 172.21.15.55:0/1084122990 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68540ce610 msgr2=0x7f68540b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:44.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 --2- 172.21.15.55:0/1084122990 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68540ce610 0x7f68540b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:44.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 -- 172.21.15.55:0/1084122990 >> v1:172.21.15.138:6789/0 conn(0x7f68540b1e10 legacy=0x7f685415f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:44.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 -- 172.21.15.55:0/1084122990 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68540cecf0 con 0x7f68540b7cd0 2023-07-06T21:42:44.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 -- 172.21.15.55:0/1084122990 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f6844001680 con 0x7f68540b7cd0 2023-07-06T21:42:44.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 -- 172.21.15.55:0/1084122990 >> v1:172.21.15.55:6789/0 conn(0x7f68540b7cd0 legacy=0x7f68540ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:44.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 --2- 172.21.15.55:0/1084122990 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68540ce610 0x7f68400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 --2- 172.21.15.55:0/1084122990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6840003ef0 0x7f68400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 --2- 172.21.15.55:0/1084122990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6840004d10 0x7f6840005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 -- 172.21.15.55:0/1084122990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684000ba40 con 0x7f6840003ef0 2023-07-06T21:42:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 -- 172.21.15.55:0/1084122990 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684000bbb0 con 0x7f6840004d10 2023-07-06T21:42:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.699+0000 7f68527fc640 1 -- 172.21.15.55:0/1084122990 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684000bd70 con 0x7f68540ce610 2023-07-06T21:42:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.703+0000 7f684a7fc640 1 --2- 172.21.15.55:0/1084122990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6840003ef0 0x7f68400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.703+0000 7f6852ffd640 1 --2- 172.21.15.55:0/1084122990 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68540ce610 0x7f68400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:44.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.703+0000 7f68537fe640 1 --2- 172.21.15.55:0/1084122990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6840004d10 0x7f6840005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:44.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.703+0000 7f684a7fc640 1 -- 172.21.15.55:0/1084122990 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68540ce610 msgr2=0x7f68400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:44.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.703+0000 7f684a7fc640 1 --2- 172.21.15.55:0/1084122990 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68540ce610 0x7f68400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:44.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.703+0000 7f684a7fc640 1 -- 172.21.15.55:0/1084122990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6840004d10 msgr2=0x7f6840005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:44.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.703+0000 7f684a7fc640 1 --2- 172.21.15.55:0/1084122990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6840004d10 0x7f6840005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:44.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.703+0000 7f684a7fc640 1 -- 172.21.15.55:0/1084122990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6840003530 con 0x7f6840003ef0 2023-07-06T21:42:44.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.703+0000 7f684a7fc640 1 --2- 172.21.15.55:0/1084122990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6840003ef0 0x7f68400047d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f683c009ab0 tx=0x7f683c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967a10fdf5fd4951 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:44.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.703+0000 7f68527fc640 1 -- 172.21.15.55:0/1084122990 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0a5620 con 0x7f6840003ef0 2023-07-06T21:42:44.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.703+0000 7f68527fc640 1 -- 172.21.15.55:0/1084122990 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c0a5780 con 0x7f6840003ef0 2023-07-06T21:42:44.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.703+0000 7f68527fc640 1 -- 172.21.15.55:0/1084122990 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0a5b30 con 0x7f6840003ef0 2023-07-06T21:42:44.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f6859374640 1 -- 172.21.15.55:0/1084122990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6840003ef0 msgr2=0x7f68400047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:44.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f6859374640 1 --2- 172.21.15.55:0/1084122990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6840003ef0 0x7f68400047d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f683c009ab0 tx=0x7f683c01ca30 comp rx=0 tx=0).stop 2023-07-06T21:42:44.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f68537fe640 1 -- 172.21.15.55:0/1084122990 reap_dead start 2023-07-06T21:42:44.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f6859374640 1 -- 172.21.15.55:0/1084122990 shutdown_connections 2023-07-06T21:42:44.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f6859374640 1 -- 172.21.15.55:0/1084122990 >> 172.21.15.55:0/1084122990 conn(0x7f68540ceee0 msgr2=0x7f68540cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:44.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f6859374640 1 -- 172.21.15.55:0/1084122990 shutdown_connections 2023-07-06T21:42:44.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f6859374640 1 -- 172.21.15.55:0/1084122990 wait complete. 2023-07-06T21:42:44.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f6859374640 1 Processor -- start 2023-07-06T21:42:44.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f6859374640 1 -- start start 2023-07-06T21:42:44.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f6859374640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6840003ef0 0x7f6854146830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:44.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f6859374640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68540c5f90 0x7f68540c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:44.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f6859374640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6854152930 0x7f68540c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:44.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f6859374640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68540b6c90 con 0x7f68540c5f90 2023-07-06T21:42:44.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f6859374640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68540b6080 con 0x7f6840003ef0 2023-07-06T21:42:44.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f6859374640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68540b6360 con 0x7f6854152930 2023-07-06T21:42:44.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f684a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68540c5f90 0x7f68540c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:44.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f684a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68540c5f90 0x7f68540c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32924/0 (socket says 172.21.15.55:32924) 2023-07-06T21:42:44.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f684a7fc640 1 -- 172.21.15.55:0/2859989270 learned_addr learned my addr 172.21.15.55:0/2859989270 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:44.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f684a7fc640 1 -- 172.21.15.55:0/2859989270 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6854152930 msgr2=0x7f68540c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:44.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f684a7fc640 1 --2- 172.21.15.55:0/2859989270 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6854152930 0x7f68540c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:44.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f684a7fc640 1 -- 172.21.15.55:0/2859989270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6840003ef0 msgr2=0x7f6854146830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:44.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f684a7fc640 1 --2- 172.21.15.55:0/2859989270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6840003ef0 0x7f6854146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:44.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.707+0000 7f684a7fc640 1 -- 172.21.15.55:0/2859989270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68540b6640 con 0x7f68540c5f90 2023-07-06T21:42:44.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.711+0000 7f684a7fc640 1 --2- 172.21.15.55:0/2859989270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68540c5f90 0x7f68540c69c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f683c009ab0 tx=0x7f6840005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:44.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.711+0000 7f684bfff640 1 -- 172.21.15.55:0/2859989270 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c004220 con 0x7f68540c5f90 2023-07-06T21:42:44.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.711+0000 7f684bfff640 1 -- 172.21.15.55:0/2859989270 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c004380 con 0x7f68540c5f90 2023-07-06T21:42:44.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.711+0000 7f684bfff640 1 -- 172.21.15.55:0/2859989270 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0ad850 con 0x7f68540c5f90 2023-07-06T21:42:44.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.711+0000 7f6859374640 1 -- 172.21.15.55:0/2859989270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68540b6920 con 0x7f68540c5f90 2023-07-06T21:42:44.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.711+0000 7f6859374640 1 -- 172.21.15.55:0/2859989270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68540b5e20 con 0x7f68540c5f90 2023-07-06T21:42:44.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.711+0000 7f6859374640 1 -- 172.21.15.55:0/2859989270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68540b6c90 con 0x7f68540c5f90 2023-07-06T21:42:44.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.711+0000 7f684bfff640 1 -- 172.21.15.55:0/2859989270 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f683c0b4040 con 0x7f68540c5f90 2023-07-06T21:42:44.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.711+0000 7f684bfff640 1 --2- 172.21.15.55:0/2859989270 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f68340662b0 0x7f6834068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:44.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.711+0000 7f684bfff640 1 -- 172.21.15.55:0/2859989270 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f683c11e5c0 con 0x7f68540c5f90 2023-07-06T21:42:44.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.711+0000 7f6852ffd640 1 --2- 172.21.15.55:0/2859989270 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f68340662b0 0x7f6834068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:44.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.715+0000 7f6852ffd640 1 --2- 172.21.15.55:0/2859989270 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f68340662b0 0x7f6834068760 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6844007c30 tx=0x7f6844001b40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:44.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.715+0000 7f684bfff640 1 -- 172.21.15.55:0/2859989270 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f68540b6c90 con 0x7f68540c5f90 2023-07-06T21:42:44.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.903+0000 7f6859374640 1 -- 172.21.15.55:0/2859989270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f68540b6c90 con 0x7f68540c5f90 2023-07-06T21:42:44.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.907+0000 7f684bfff640 1 -- 172.21.15.55:0/2859989270 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f68540b6c90 con 0x7f68540c5f90 2023-07-06T21:42:44.911 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-06T21:42:44.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.907+0000 7f6859374640 1 -- 172.21.15.55:0/2859989270 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f68340662b0 msgr2=0x7f6834068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.907+0000 7f6859374640 1 --2- 172.21.15.55:0/2859989270 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f68340662b0 0x7f6834068760 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6844007c30 tx=0x7f6844001b40 comp rx=0 tx=0).stop 2023-07-06T21:42:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.907+0000 7f6859374640 1 -- 172.21.15.55:0/2859989270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68540c5f90 msgr2=0x7f68540c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.907+0000 7f6859374640 1 --2- 172.21.15.55:0/2859989270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68540c5f90 0x7f68540c69c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f683c009ab0 tx=0x7f6840005800 comp rx=0 tx=0).stop 2023-07-06T21:42:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.907+0000 7f6859374640 1 -- 172.21.15.55:0/2859989270 shutdown_connections 2023-07-06T21:42:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.907+0000 7f6859374640 1 --2- 172.21.15.55:0/2859989270 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f68340662b0 0x7f6834068760 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.907+0000 7f6859374640 1 --2- 172.21.15.55:0/2859989270 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6854152930 0x7f68540c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.907+0000 7f6859374640 1 --2- 172.21.15.55:0/2859989270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68540c5f90 0x7f68540c69c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:44.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.907+0000 7f6859374640 1 --2- 172.21.15.55:0/2859989270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6840003ef0 0x7f6854146830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:44.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.907+0000 7f6859374640 1 -- 172.21.15.55:0/2859989270 >> 172.21.15.55:0/2859989270 conn(0x7f68540ceee0 msgr2=0x7f68540cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:44.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.907+0000 7f6859374640 1 -- 172.21.15.55:0/2859989270 shutdown_connections 2023-07-06T21:42:44.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:44.907+0000 7f6859374640 1 -- 172.21.15.55:0/2859989270 wait complete. 2023-07-06T21:42:44.932 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-06T21:42:44.933 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T21:42:44.933 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-07-06T21:42:44.933 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-06T21:42:44.933 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-06T21:42:44.933 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-06T21:42:44.934 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-06T21:42:44.934 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T21:42:44.934 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-06T21:42:44.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:44.935 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-07-06T21:42:44.944 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T21:42:44.944 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T21:42:44.944 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T21:42:44.945 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:44.945 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T21:42:44.945 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:44.946 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:44.946 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:44.946 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-07-06T21:42:44.946 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:44.947 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:44.947 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-07-06T21:42:44.947 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T21:42:44.948 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:44.948 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-07-06T21:42:44.948 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-06T21:42:44.949 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42392sec preferred_lft 42392sec 2023-07-06T21:42:44.949 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-07-06T21:42:44.949 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:44.950 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:44.950 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:44.950 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-07-06T21:42:44.951 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T21:42:44.951 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:84:fe:b8:21 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:44.951 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T21:42:44.951 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:44.952 INFO:teuthology.orchestra.run.smithi055.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T21:42:44.952 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:44.952 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T21:42:44.953 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:44.953 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-07-06T21:42:44.953 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:44.953 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T21:42:44.953 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T21:42:44.954 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-07-06T21:42:44.954 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:44.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:44.956 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T21:42:45.022 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-07-06T21:42:45.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:45.024 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-07-06T21:42:45.080 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-07-06T21:42:45.080 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T21:42:45.080 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-06T21:42:45.081 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T21:42:45.081 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-06T21:42:45.081 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T21:42:45.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:45.082 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:42:45.082 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:42:45.082 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T21:42:45.082 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T21:42:45.082 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T21:42:45.083 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:42:45.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:45.175 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T21:42:45.184 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T21:42:45.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:45.186 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2023-07-06T21:42:45.238 INFO:teuthology.orchestra.run.smithi055.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-06T21:42:45.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:45.240 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:42:45.240 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:42:45.240 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T21:42:45.240 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-06T21:42:45.240 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:42:45.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:45.323 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-06T21:42:45.388 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T21:42:45.388 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T21:42:45.388 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T21:42:45.389 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:45.389 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T21:42:45.389 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:45.389 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T21:42:45.389 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 26:74:1c:1e:7a:5c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-06T21:42:45.389 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-06T21:42:45.389 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:45.390 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::2474:1cff:fe1e:7a5c/64 scope link 2023-07-06T21:42:45.390 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:45.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:45.391 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-06T21:42:45.456 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T21:42:45.457 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T21:42:45.457 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T21:42:45.457 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:45.457 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T21:42:45.457 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:45.457 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T21:42:45.457 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 26:74:1c:1e:7a:5c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-06T21:42:45.458 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-06T21:42:45.458 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:45.458 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::2474:1cff:fe1e:7a5c/64 scope link 2023-07-06T21:42:45.458 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:45.459 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-06T21:42:45.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:45.460 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:42:45.460 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:42:45.460 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-06T21:42:45.461 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-06T21:42:45.461 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-06T21:42:45.461 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-06T21:42:45.461 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-06T21:42:45.462 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:42:45.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:45.603 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:42:45.603 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:42:45.604 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.1 up 2023-07-06T21:42:45.604 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.1 master ceph-brx 2023-07-06T21:42:45.605 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:42:45.646 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:42:45.646 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-06T21:42:45.699 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-06T21:42:45.699 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:42:45.700 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-06T21:42:45.750 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-07-06T21:42:45.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:45.752 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:42:45.846 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:42:45.847 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:42:45.860 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:42:45.861 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:42:45.861 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-07-06T21:42:45.861 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 2@c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.cephfs=/ 2023-07-06T21:42:45.861 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.55:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-07-06T21:42:45.864 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T21:42:45.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:45.865 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-06T21:42:45.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:45.888 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:42:45.945 INFO:teuthology.orchestra.run.smithi055.stdout:client4658 2023-07-06T21:42:45.946 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:42:45.946 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:42:45.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:45.999 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:42:46.057 INFO:teuthology.orchestra.run.smithi055.stdout:client4658 2023-07-06T21:42:46.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:46.058 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:42:46.113 INFO:teuthology.orchestra.run.smithi055.stdout:client4658 2023-07-06T21:42:46.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:46.114 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.client4658/status') 2023-07-06T21:42:46.179 INFO:teuthology.orchestra.run.smithi055.stdout:instance: client.4658 (3)172.21.15.55:0/293130456 2023-07-06T21:42:46.179 INFO:teuthology.orchestra.run.smithi055.stdout:blocklisted: false 2023-07-06T21:42:46.180 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records in 2023-07-06T21:42:46.180 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records out 2023-07-06T21:42:46.180 INFO:teuthology.orchestra.run.smithi055.stderr:69 bytes copied, 5.3724e-05 s, 1.3 MB/s 2023-07-06T21:42:46.181 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-07-06T21:42:46.181 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-06T21:42:46.181 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-06T21:42:46.182 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T21:42:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.359+0000 7fc9191d2640 1 Processor -- start 2023-07-06T21:42:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.359+0000 7fc9191d2640 1 -- start start 2023-07-06T21:42:46.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.363+0000 7fc9191d2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc9141587d0 0x7fc914070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:46.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.363+0000 7fc9191d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91406fae0 con 0x7fc914158400 2023-07-06T21:42:46.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.363+0000 7fc9191d2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91406fdc0 con 0x7fc9140710c0 2023-07-06T21:42:46.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.363+0000 7fc9191d2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9140700a0 con 0x7fc9141587d0 2023-07-06T21:42:46.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.363+0000 7fc912d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc914158400 0x7fc9140c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58298/0 (socket says 172.21.15.55:58298) 2023-07-06T21:42:46.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.363+0000 7fc912d9d640 1 -- 172.21.15.55:0/3392000456 learned_addr learned my addr 172.21.15.55:0/3392000456 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:46.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.363+0000 7fc91259c640 1 --2- 172.21.15.55:0/3392000456 >> v2:172.21.15.138:3300/0 conn(0x7fc9141587d0 0x7fc914070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:46.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.363+0000 7fc911d9b640 1 -- 172.21.15.55:0/3392000456 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039438858 0 0) 0x7fc91406fae0 con 0x7fc914158400 2023-07-06T21:42:46.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.363+0000 7fc911d9b640 1 -- 172.21.15.55:0/3392000456 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8fc003530 con 0x7fc914158400 2023-07-06T21:42:46.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.363+0000 7fc911d9b640 1 -- 172.21.15.55:0/3392000456 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 529400359 0 0) 0x7fc8fc003530 con 0x7fc914158400 2023-07-06T21:42:46.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.363+0000 7fc91259c640 1 -- 172.21.15.55:0/3392000456 >> v1:172.21.15.138:6789/0 conn(0x7fc9140710c0 legacy=0x7fc9140cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:46.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.363+0000 7fc91259c640 1 -- 172.21.15.55:0/3392000456 >> v1:172.21.15.55:6789/0 conn(0x7fc914158400 legacy=0x7fc9140c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:46.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.363+0000 7fc91259c640 1 -- 172.21.15.55:0/3392000456 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc914070380 con 0x7fc9141587d0 2023-07-06T21:42:46.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.367+0000 7fc91259c640 1 --2- 172.21.15.55:0/3392000456 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9141587d0 0x7fc914070b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc9080097c0 tx=0x7fc90801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25d09d222eb67bea server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:46.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.367+0000 7fc911d9b640 1 -- 172.21.15.55:0/3392000456 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904001680 con 0x7fc9141587d0 2023-07-06T21:42:46.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.367+0000 7fc911d9b640 1 -- 172.21.15.55:0/3392000456 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9080a7050 con 0x7fc9141587d0 2023-07-06T21:42:46.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.367+0000 7fc911d9b640 1 -- 172.21.15.55:0/3392000456 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9080ab620 con 0x7fc9141587d0 2023-07-06T21:42:46.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.367+0000 7fc9191d2640 1 -- 172.21.15.55:0/3392000456 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9141587d0 msgr2=0x7fc914070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:46.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.367+0000 7fc9191d2640 1 --2- 172.21.15.55:0/3392000456 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9141587d0 0x7fc914070b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc9080097c0 tx=0x7fc90801c370 comp rx=0 tx=0).stop 2023-07-06T21:42:46.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.367+0000 7fc9191d2640 1 -- 172.21.15.55:0/3392000456 shutdown_connections 2023-07-06T21:42:46.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.367+0000 7fc9191d2640 1 --2- 172.21.15.55:0/3392000456 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9141587d0 0x7fc914070b80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:46.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.367+0000 7fc9191d2640 1 -- 172.21.15.55:0/3392000456 >> 172.21.15.55:0/3392000456 conn(0x7fc9140cded0 msgr2=0x7fc9140ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:46.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.367+0000 7fc9191d2640 1 -- 172.21.15.55:0/3392000456 shutdown_connections 2023-07-06T21:42:46.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.367+0000 7fc9191d2640 1 -- 172.21.15.55:0/3392000456 wait complete. 2023-07-06T21:42:46.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.367+0000 7fc9191d2640 1 Processor -- start 2023-07-06T21:42:46.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.367+0000 7fc9191d2640 1 -- start start 2023-07-06T21:42:46.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc9191d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9140710c0 0x7fc914156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:46.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc9191d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc914158400 0x7fc9140c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:46.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc9191d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9141587d0 0x7fc9140c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:46.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc9191d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9140c74d0 con 0x7fc9140710c0 2023-07-06T21:42:46.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc9191d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9140c7730 con 0x7fc9141587d0 2023-07-06T21:42:46.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc9191d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9140c7a10 con 0x7fc914158400 2023-07-06T21:42:46.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc912d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9140710c0 0x7fc914156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:46.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc912d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9140710c0 0x7fc914156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32934/0 (socket says 172.21.15.55:32934) 2023-07-06T21:42:46.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc912d9d640 1 -- 172.21.15.55:0/755687632 learned_addr learned my addr 172.21.15.55:0/755687632 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:46.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc91259c640 1 --2- 172.21.15.55:0/755687632 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc914158400 0x7fc9140c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:46.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc91359e640 1 --2- 172.21.15.55:0/755687632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9141587d0 0x7fc9140c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:46.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc912d9d640 1 -- 172.21.15.55:0/755687632 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc914158400 msgr2=0x7fc9140c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:46.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc912d9d640 1 --2- 172.21.15.55:0/755687632 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc914158400 0x7fc9140c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:46.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc912d9d640 1 -- 172.21.15.55:0/755687632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9141587d0 msgr2=0x7fc9140c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:46.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc912d9d640 1 --2- 172.21.15.55:0/755687632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9141587d0 0x7fc9140c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:46.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc912d9d640 1 -- 172.21.15.55:0/755687632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc908009420 con 0x7fc9140710c0 2023-07-06T21:42:46.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc912d9d640 1 --2- 172.21.15.55:0/755687632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9140710c0 0x7fc914156510 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc90400c760 tx=0x7fc90400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:46.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc8fb7fe640 1 -- 172.21.15.55:0/755687632 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904005ae0 con 0x7fc9140710c0 2023-07-06T21:42:46.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc8fb7fe640 1 -- 172.21.15.55:0/755687632 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc904005c40 con 0x7fc9140710c0 2023-07-06T21:42:46.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc9191d2640 1 -- 172.21.15.55:0/755687632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9140c7cf0 con 0x7fc9140710c0 2023-07-06T21:42:46.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc8fb7fe640 1 -- 172.21.15.55:0/755687632 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904007070 con 0x7fc9140710c0 2023-07-06T21:42:46.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc9191d2640 1 -- 172.21.15.55:0/755687632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9140c3b10 con 0x7fc9140710c0 2023-07-06T21:42:46.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc9191d2640 1 -- 172.21.15.55:0/755687632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91406c580 con 0x7fc9140710c0 2023-07-06T21:42:46.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.371+0000 7fc8fb7fe640 1 -- 172.21.15.55:0/755687632 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc9040071d0 con 0x7fc9140710c0 2023-07-06T21:42:46.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.375+0000 7fc8fb7fe640 1 --2- 172.21.15.55:0/755687632 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc900066280 0x7fc900068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:46.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.375+0000 7fc8fb7fe640 1 -- 172.21.15.55:0/755687632 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc904083de0 con 0x7fc9140710c0 2023-07-06T21:42:46.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.375+0000 7fc91259c640 1 --2- 172.21.15.55:0/755687632 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc900066280 0x7fc900068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:46.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.375+0000 7fc91259c640 1 --2- 172.21.15.55:0/755687632 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc900066280 0x7fc900068730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc9080ad000 tx=0x7fc9080a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:46.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.379+0000 7fc8fb7fe640 1 -- 172.21.15.55:0/755687632 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc904054a10 con 0x7fc9140710c0 2023-07-06T21:42:46.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.571+0000 7fc9191d2640 1 -- 172.21.15.55:0/755687632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc9141f8100 con 0x7fc9140710c0 2023-07-06T21:42:46.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.571+0000 7fc8fb7fe640 1 -- 172.21.15.55:0/755687632 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc9040545a0 con 0x7fc9140710c0 2023-07-06T21:42:46.577 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-06T21:42:46.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.571+0000 7fc9191d2640 1 -- 172.21.15.55:0/755687632 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc900066280 msgr2=0x7fc900068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:46.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.571+0000 7fc9191d2640 1 --2- 172.21.15.55:0/755687632 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc900066280 0x7fc900068730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc9080ad000 tx=0x7fc9080a6000 comp rx=0 tx=0).stop 2023-07-06T21:42:46.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.571+0000 7fc9191d2640 1 -- 172.21.15.55:0/755687632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9140710c0 msgr2=0x7fc914156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:46.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.571+0000 7fc9191d2640 1 --2- 172.21.15.55:0/755687632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9140710c0 0x7fc914156510 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc90400c760 tx=0x7fc90400cc20 comp rx=0 tx=0).stop 2023-07-06T21:42:46.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.571+0000 7fc9191d2640 1 -- 172.21.15.55:0/755687632 shutdown_connections 2023-07-06T21:42:46.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.571+0000 7fc9191d2640 1 --2- 172.21.15.55:0/755687632 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc900066280 0x7fc900068730 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:46.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.571+0000 7fc9191d2640 1 --2- 172.21.15.55:0/755687632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9141587d0 0x7fc9140c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:46.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.571+0000 7fc9191d2640 1 --2- 172.21.15.55:0/755687632 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc914158400 0x7fc9140c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:46.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.571+0000 7fc9191d2640 1 --2- 172.21.15.55:0/755687632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9140710c0 0x7fc914156510 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:46.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.571+0000 7fc9191d2640 1 -- 172.21.15.55:0/755687632 >> 172.21.15.55:0/755687632 conn(0x7fc9140cded0 msgr2=0x7fc914156bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:46.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.571+0000 7fc9191d2640 1 -- 172.21.15.55:0/755687632 shutdown_connections 2023-07-06T21:42:46.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:46.571+0000 7fc9191d2640 1 -- 172.21.15.55:0/755687632 wait complete. 2023-07-06T21:42:46.597 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-06T21:42:46.598 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T21:42:46.598 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2023-07-06T21:42:46.598 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-06T21:42:46.598 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-06T21:42:46.598 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-06T21:42:46.599 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-06T21:42:46.599 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T21:42:46.599 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-06T21:42:46.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:46.599 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2023-07-06T21:42:46.609 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T21:42:46.610 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T21:42:46.610 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T21:42:46.610 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:46.610 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2023-07-06T21:42:46.611 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:46.611 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:46.611 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:46.611 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2023-07-06T21:42:46.611 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:46.611 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:46.611 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2023-07-06T21:42:46.611 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:46.612 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:46.612 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T21:42:46.612 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:46.612 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-06T21:42:46.612 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42398sec preferred_lft 42398sec 2023-07-06T21:42:46.612 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2023-07-06T21:42:46.612 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:46.613 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T21:42:46.613 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:54:5c:95:68 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:46.613 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T21:42:46.613 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:46.614 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-06T21:42:46.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:46.614 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-07-06T21:42:46.615 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-07-06T21:42:46.615 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add name ceph-brx type bridge 2023-07-06T21:42:46.615 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr flush dev ceph-brx 2023-07-06T21:42:46.615 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set ceph-brx up 2023-07-06T21:42:46.616 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-06T21:42:46.616 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-07-06T21:42:46.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:46.734 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T21:42:46.753 INFO:teuthology.orchestra.run.smithi138.stdout:1 2023-07-06T21:42:46.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:46.756 DEBUG:teuthology.orchestra.run.smithi138:> route 2023-07-06T21:42:46.839 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2023-07-06T21:42:46.839 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T21:42:46.839 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-06T21:42:46.840 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-06T21:42:46.840 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T21:42:46.840 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-06T21:42:46.840 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-06T21:42:46.840 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-06T21:42:46.840 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-06T21:42:46.841 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T21:42:46.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:46.841 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-07-06T21:42:46.841 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-07-06T21:42:46.842 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-06T21:42:46.842 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-06T21:42:46.842 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-06T21:42:46.842 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-07-06T21:42:46.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:46.941 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-07-06T21:42:46.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:46.950 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list-id 2023-07-06T21:42:47.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:47.002 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-07-06T21:42:47.002 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-07-06T21:42:47.003 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-06T21:42:47.003 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-06T21:42:47.003 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-07-06T21:42:47.085 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-06T21:42:47.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:47.086 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-07-06T21:42:47.086 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-07-06T21:42:47.087 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-06T21:42:47.087 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-06T21:42:47.087 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-06T21:42:47.087 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-06T21:42:47.088 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-06T21:42:47.088 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-07-06T21:42:47.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:47.253 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-07-06T21:42:47.254 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-07-06T21:42:47.254 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2023-07-06T21:42:47.254 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set dev brx.0 master ceph-brx 2023-07-06T21:42:47.255 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-07-06T21:42:47.297 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:42:47.297 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-06T21:42:47.349 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-06T21:42:47.350 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:42:47.350 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-06T21:42:47.404 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-06T21:42:47.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:47.405 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:42:47.500 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:42:47.500 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:42:47.611 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:42:47.611 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:42:47.611 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-07-06T21:42:47.611 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: 1@c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.cephfs=/ 2023-07-06T21:42:47.612 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-07-06T21:42:47.615 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T21:42:47.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:47.616 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-06T21:42:47.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:47.637 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:42:47.705 INFO:teuthology.orchestra.run.smithi138.stdout:client4896 2023-07-06T21:42:47.706 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:42:47.706 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:42:47.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:47.761 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:42:47.812 INFO:teuthology.orchestra.run.smithi138.stdout:client4896 2023-07-06T21:42:47.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:47.813 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:42:47.868 INFO:teuthology.orchestra.run.smithi138.stdout:client4896 2023-07-06T21:42:47.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:47.869 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.client4896/status') 2023-07-06T21:42:47.933 INFO:teuthology.orchestra.run.smithi138.stdout:instance: client.4896 (3)172.21.15.138:0/408222820 2023-07-06T21:42:47.934 INFO:teuthology.orchestra.run.smithi138.stdout:blocklisted: false 2023-07-06T21:42:47.934 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records in 2023-07-06T21:42:47.934 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records out 2023-07-06T21:42:47.934 INFO:teuthology.orchestra.run.smithi138.stderr:70 bytes copied, 5.0763e-05 s, 1.4 MB/s 2023-07-06T21:42:47.935 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-07-06T21:42:47.936 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-06T21:42:47.936 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-06T21:42:47.936 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T21:42:48.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.083+0000 7f189920b640 1 Processor -- start 2023-07-06T21:42:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.083+0000 7f189920b640 1 -- start start 2023-07-06T21:42:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.087+0000 7f189920b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f18940712f0 0x7f189406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:48.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.087+0000 7f189920b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18940b3730 0x7f18940c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:48.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.087+0000 7f189920b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1894159cd0 con 0x7f18940ca280 2023-07-06T21:42:48.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.087+0000 7f189920b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18940ca700 con 0x7f18940712f0 2023-07-06T21:42:48.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.087+0000 7f189920b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18940693f0 con 0x7f18940b3730 2023-07-06T21:42:48.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.087+0000 7f1892d9d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f18940712f0 0x7f189406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:48.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.087+0000 7f188bfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18940b3730 0x7f18940c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:48.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.087+0000 7f1892d9d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f18940712f0 0x7f189406a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:49406/0 (socket says 172.21.15.55:49406) 2023-07-06T21:42:48.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.087+0000 7f189359e640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f18940ca280 0x7f18940c8520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:40392/0 (socket says 172.21.15.55:40392) 2023-07-06T21:42:48.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.087+0000 7f1892d9d640 1 -- 172.21.15.55:0/1142570648 learned_addr learned my addr 172.21.15.55:0/1142570648 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:48.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.087+0000 7f1892d9d640 1 -- 172.21.15.55:0/1142570648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18940b3730 msgr2=0x7f18940c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:48.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.087+0000 7f1892d9d640 1 --2- 172.21.15.55:0/1142570648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18940b3730 0x7f18940c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:48.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.087+0000 7f1892d9d640 1 -- 172.21.15.55:0/1142570648 >> v1:172.21.15.138:6789/0 conn(0x7f18940ca280 legacy=0x7f18940c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:48.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.087+0000 7f1892d9d640 1 -- 172.21.15.55:0/1142570648 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189406aca0 con 0x7f18940712f0 2023-07-06T21:42:48.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.091+0000 7f1892d9d640 1 --2- 172.21.15.55:0/1142570648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18940712f0 0x7f189406a610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1884009870 tx=0x7f188401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13d93ffe688c1114 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:48.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.091+0000 7f189259c640 1 -- 172.21.15.55:0/1142570648 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18840ab600 con 0x7f18940712f0 2023-07-06T21:42:48.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.091+0000 7f189259c640 1 -- 172.21.15.55:0/1142570648 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18840a7050 con 0x7f18940712f0 2023-07-06T21:42:48.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.091+0000 7f189259c640 1 -- 172.21.15.55:0/1142570648 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18840ab980 con 0x7f18940712f0 2023-07-06T21:42:48.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.091+0000 7f189920b640 1 -- 172.21.15.55:0/1142570648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18940712f0 msgr2=0x7f189406a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:48.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.091+0000 7f189920b640 1 --2- 172.21.15.55:0/1142570648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18940712f0 0x7f189406a610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1884009870 tx=0x7f188401c510 comp rx=0 tx=0).stop 2023-07-06T21:42:48.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.091+0000 7f189920b640 1 -- 172.21.15.55:0/1142570648 shutdown_connections 2023-07-06T21:42:48.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.091+0000 7f189920b640 1 --2- 172.21.15.55:0/1142570648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18940b3730 0x7f18940c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:48.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.091+0000 7f189920b640 1 --2- 172.21.15.55:0/1142570648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18940712f0 0x7f189406a610 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:48.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.091+0000 7f189920b640 1 -- 172.21.15.55:0/1142570648 >> 172.21.15.55:0/1142570648 conn(0x7f18940cded0 msgr2=0x7f18940ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:48.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.091+0000 7f189920b640 1 -- 172.21.15.55:0/1142570648 shutdown_connections 2023-07-06T21:42:48.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.091+0000 7f189920b640 1 -- 172.21.15.55:0/1142570648 wait complete. 2023-07-06T21:42:48.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.091+0000 7f189920b640 1 Processor -- start 2023-07-06T21:42:48.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.091+0000 7f189920b640 1 -- start start 2023-07-06T21:42:48.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f189920b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18940712f0 0x7f189414dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:48.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f189920b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18940b3730 0x7f1894159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:48.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f189920b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18940ca280 0x7f18940c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:48.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f189920b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189415a400 con 0x7f18940712f0 2023-07-06T21:42:48.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f189920b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18940c7f30 con 0x7f18940b3730 2023-07-06T21:42:48.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f189920b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189414e2d0 con 0x7f18940ca280 2023-07-06T21:42:48.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f1892d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18940712f0 0x7f189414dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:48.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f1892d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18940712f0 0x7f189414dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32944/0 (socket says 172.21.15.55:32944) 2023-07-06T21:42:48.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f1892d9d640 1 -- 172.21.15.55:0/2317126194 learned_addr learned my addr 172.21.15.55:0/2317126194 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:48.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f188bfff640 1 --2- 172.21.15.55:0/2317126194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18940b3730 0x7f1894159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:48.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f189359e640 1 --2- 172.21.15.55:0/2317126194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18940ca280 0x7f18940c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:48.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f1892d9d640 1 -- 172.21.15.55:0/2317126194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18940ca280 msgr2=0x7f18940c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:48.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f1892d9d640 1 --2- 172.21.15.55:0/2317126194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18940ca280 0x7f18940c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:48.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f1892d9d640 1 -- 172.21.15.55:0/2317126194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18940b3730 msgr2=0x7f1894159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f1892d9d640 1 --2- 172.21.15.55:0/2317126194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18940b3730 0x7f1894159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f1892d9d640 1 -- 172.21.15.55:0/2317126194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18840094d0 con 0x7f18940712f0 2023-07-06T21:42:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f1892d9d640 1 --2- 172.21.15.55:0/2317126194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18940712f0 0x7f189414dc10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f188401abc0 tx=0x7f18840192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f188b7fe640 1 -- 172.21.15.55:0/2317126194 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18840b6440 con 0x7f18940712f0 2023-07-06T21:42:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f188b7fe640 1 -- 172.21.15.55:0/2317126194 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18840b65c0 con 0x7f18940712f0 2023-07-06T21:42:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f188b7fe640 1 -- 172.21.15.55:0/2317126194 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18840b6970 con 0x7f18940712f0 2023-07-06T21:42:48.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f189920b640 1 -- 172.21.15.55:0/2317126194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189414e5b0 con 0x7f18940712f0 2023-07-06T21:42:48.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f189920b640 1 -- 172.21.15.55:0/2317126194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189414eb70 con 0x7f18940712f0 2023-07-06T21:42:48.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f189920b640 1 -- 172.21.15.55:0/2317126194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18940b3df0 con 0x7f18940712f0 2023-07-06T21:42:48.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.095+0000 7f188b7fe640 1 -- 172.21.15.55:0/2317126194 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18840b2040 con 0x7f18940712f0 2023-07-06T21:42:48.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.099+0000 7f188b7fe640 1 --2- 172.21.15.55:0/2317126194 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1874066280 0x7f1874068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:48.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.099+0000 7f188b7fe640 1 -- 172.21.15.55:0/2317126194 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f188411dc10 con 0x7f18940712f0 2023-07-06T21:42:48.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.099+0000 7f188bfff640 1 --2- 172.21.15.55:0/2317126194 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1874066280 0x7f1874068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:48.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.099+0000 7f188bfff640 1 --2- 172.21.15.55:0/2317126194 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1874066280 0x7f1874068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f18940b3450 tx=0x7f187c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:48.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.103+0000 7f188b7fe640 1 -- 172.21.15.55:0/2317126194 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18840eae40 con 0x7f18940712f0 2023-07-06T21:42:48.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.291+0000 7f189920b640 1 -- 172.21.15.55:0/2317126194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1894066d60 con 0x7f18940712f0 2023-07-06T21:42:48.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.291+0000 7f188b7fe640 1 -- 172.21.15.55:0/2317126194 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f18840ee460 con 0x7f18940712f0 2023-07-06T21:42:48.299 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-06T21:42:48.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.295+0000 7f189920b640 1 -- 172.21.15.55:0/2317126194 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1874066280 msgr2=0x7f1874068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:48.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.295+0000 7f189920b640 1 --2- 172.21.15.55:0/2317126194 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1874066280 0x7f1874068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f18940b3450 tx=0x7f187c009190 comp rx=0 tx=0).stop 2023-07-06T21:42:48.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.295+0000 7f189920b640 1 -- 172.21.15.55:0/2317126194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18940712f0 msgr2=0x7f189414dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:48.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.295+0000 7f189920b640 1 --2- 172.21.15.55:0/2317126194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18940712f0 0x7f189414dc10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f188401abc0 tx=0x7f18840192b0 comp rx=0 tx=0).stop 2023-07-06T21:42:48.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.295+0000 7f189920b640 1 -- 172.21.15.55:0/2317126194 shutdown_connections 2023-07-06T21:42:48.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.295+0000 7f189920b640 1 --2- 172.21.15.55:0/2317126194 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1874066280 0x7f1874068730 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:48.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.295+0000 7f189920b640 1 --2- 172.21.15.55:0/2317126194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f18940ca280 0x7f18940c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:48.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.295+0000 7f189920b640 1 --2- 172.21.15.55:0/2317126194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18940b3730 0x7f1894159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:48.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.295+0000 7f189920b640 1 --2- 172.21.15.55:0/2317126194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18940712f0 0x7f189414dc10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:48.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.295+0000 7f189920b640 1 -- 172.21.15.55:0/2317126194 >> 172.21.15.55:0/2317126194 conn(0x7f18940cded0 msgr2=0x7f1894070910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:48.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.295+0000 7f189920b640 1 -- 172.21.15.55:0/2317126194 shutdown_connections 2023-07-06T21:42:48.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:48.295+0000 7f189920b640 1 -- 172.21.15.55:0/2317126194 wait complete. 2023-07-06T21:42:48.319 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-06T21:42:48.319 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T21:42:48.319 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2023-07-06T21:42:48.320 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-06T21:42:48.320 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-06T21:42:48.320 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-06T21:42:48.320 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-06T21:42:48.321 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T21:42:48.321 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-06T21:42:48.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:48.321 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2023-07-06T21:42:48.331 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T21:42:48.331 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T21:42:48.331 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T21:42:48.332 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.332 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2023-07-06T21:42:48.332 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.332 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:48.332 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:48.332 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2023-07-06T21:42:48.332 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:48.333 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:48.333 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2023-07-06T21:42:48.333 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:42:48.333 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:48.333 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T21:42:48.333 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:48.333 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-06T21:42:48.333 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42397sec preferred_lft 42397sec 2023-07-06T21:42:48.334 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2023-07-06T21:42:48.334 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.334 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T21:42:48.334 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:54:5c:95:68 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:48.334 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T21:42:48.334 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.334 INFO:teuthology.orchestra.run.smithi138.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T21:42:48.335 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-06T21:42:48.335 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T21:42:48.335 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.335 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-07-06T21:42:48.335 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.335 INFO:teuthology.orchestra.run.smithi138.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T21:42:48.335 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-06T21:42:48.335 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-07-06T21:42:48.336 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:48.338 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T21:42:48.392 INFO:teuthology.orchestra.run.smithi138.stdout:1 2023-07-06T21:42:48.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:48.394 DEBUG:teuthology.orchestra.run.smithi138:> route 2023-07-06T21:42:48.448 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2023-07-06T21:42:48.448 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T21:42:48.448 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-06T21:42:48.448 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-06T21:42:48.449 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T21:42:48.449 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-06T21:42:48.449 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-06T21:42:48.449 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-06T21:42:48.449 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-06T21:42:48.449 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T21:42:48.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:48.450 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-07-06T21:42:48.450 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-07-06T21:42:48.451 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-06T21:42:48.451 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-06T21:42:48.451 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-06T21:42:48.451 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-07-06T21:42:48.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:48.545 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-07-06T21:42:48.554 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-06T21:42:48.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:48.555 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list-id 2023-07-06T21:42:48.610 INFO:teuthology.orchestra.run.smithi138.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-06T21:42:48.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:48.610 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-07-06T21:42:48.611 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-07-06T21:42:48.612 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-06T21:42:48.612 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-06T21:42:48.612 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-07-06T21:42:48.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:48.699 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-06T21:42:48.763 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T21:42:48.763 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T21:42:48.764 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T21:42:48.764 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.764 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2023-07-06T21:42:48.764 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.764 INFO:teuthology.orchestra.run.smithi138.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T21:42:48.765 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether a2:96:d4:ff:00:92 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-06T21:42:48.765 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-06T21:42:48.765 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.765 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::a096:d4ff:feff:92/64 scope link tentative 2023-07-06T21:42:48.765 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:48.767 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-06T21:42:48.834 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T21:42:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T21:42:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T21:42:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2023-07-06T21:42:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.836 INFO:teuthology.orchestra.run.smithi138.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T21:42:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether a2:96:d4:ff:00:92 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-06T21:42:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-06T21:42:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::a096:d4ff:feff:92/64 scope link tentative 2023-07-06T21:42:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:42:48.837 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-06T21:42:48.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:48.838 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-07-06T21:42:48.838 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-07-06T21:42:48.839 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-06T21:42:48.839 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-06T21:42:48.839 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-06T21:42:48.839 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-06T21:42:48.839 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-06T21:42:48.840 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-07-06T21:42:48.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:48.980 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-07-06T21:42:48.980 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-07-06T21:42:48.981 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.1 up 2023-07-06T21:42:48.981 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set dev brx.1 master ceph-brx 2023-07-06T21:42:48.981 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-07-06T21:42:49.022 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:42:49.022 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-06T21:42:49.074 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-06T21:42:49.074 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:42:49.075 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-06T21:42:49.129 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-07-06T21:42:49.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:49.130 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:42:49.223 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:42:49.223 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:42:49.236 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:42:49.236 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:42:49.236 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-07-06T21:42:49.237 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: 3@c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.cephfs=/ 2023-07-06T21:42:49.237 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.55:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-07-06T21:42:49.239 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T21:42:49.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:49.240 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-06T21:42:49.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:49.260 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:42:49.313 INFO:teuthology.orchestra.run.smithi138.stdout:client4670 2023-07-06T21:42:49.314 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:42:49.314 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:42:49.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:49.372 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:42:49.424 INFO:teuthology.orchestra.run.smithi138.stdout:client4670 2023-07-06T21:42:49.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:49.425 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:42:49.481 INFO:teuthology.orchestra.run.smithi138.stdout:client4670 2023-07-06T21:42:49.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:42:49.482 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.client4670/status') 2023-07-06T21:42:49.546 INFO:teuthology.orchestra.run.smithi138.stdout:instance: client.4670 (3)192.168.0.2:0/3551623245 2023-07-06T21:42:49.546 INFO:teuthology.orchestra.run.smithi138.stdout:blocklisted: false 2023-07-06T21:42:49.546 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records in 2023-07-06T21:42:49.547 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records out 2023-07-06T21:42:49.547 INFO:teuthology.orchestra.run.smithi138.stderr:69 bytes copied, 5.3316e-05 s, 1.3 MB/s 2023-07-06T21:42:49.548 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-06T21:42:49.566 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:49.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.714+0000 7f451e47b640 1 Processor -- start 2023-07-06T21:42:49.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.714+0000 7f451e47b640 1 -- start start 2023-07-06T21:42:49.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.714+0000 7f451e47b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45180712f0 0x7f451806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:49.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.714+0000 7f451e47b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45180b3730 0x7f45180c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:49.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.714+0000 7f451e47b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4518159cd0 con 0x7f45180ca280 2023-07-06T21:42:49.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.714+0000 7f451e47b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45180ca700 con 0x7f45180b3730 2023-07-06T21:42:49.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.714+0000 7f451e47b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45180693f0 con 0x7f45180712f0 2023-07-06T21:42:49.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.718+0000 7f45177fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45180b3730 0x7f45180c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:49.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.718+0000 7f45177fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45180b3730 0x7f45180c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32954/0 (socket says 172.21.15.55:32954) 2023-07-06T21:42:49.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.718+0000 7f45177fe640 1 -- 172.21.15.55:0/596072644 learned_addr learned my addr 172.21.15.55:0/596072644 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:49.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.718+0000 7f4517fff640 1 --2- 172.21.15.55:0/596072644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45180712f0 0x7f451806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:49.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.718+0000 7f45177fe640 1 -- 172.21.15.55:0/596072644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45180712f0 msgr2=0x7f451806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:49.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.718+0000 7f45177fe640 1 --2- 172.21.15.55:0/596072644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45180712f0 0x7f451806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:49.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.718+0000 7f45177fe640 1 -- 172.21.15.55:0/596072644 >> v1:172.21.15.138:6789/0 conn(0x7f45180ca280 legacy=0x7f45180c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:49.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.718+0000 7f45177fe640 1 -- 172.21.15.55:0/596072644 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451806aca0 con 0x7f45180b3730 2023-07-06T21:42:49.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.718+0000 7f4517fff640 1 --2- 172.21.15.55:0/596072644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45180712f0 0x7f451806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:49.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.718+0000 7f45177fe640 1 --2- 172.21.15.55:0/596072644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45180b3730 0x7f45180c9d40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f450c009870 tx=0x7f450c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884e66cf0547fc32 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:49.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.718+0000 7f4516ffd640 1 -- 172.21.15.55:0/596072644 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c0a7070 con 0x7f45180b3730 2023-07-06T21:42:49.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.718+0000 7f4516ffd640 1 -- 172.21.15.55:0/596072644 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c0ab430 con 0x7f45180b3730 2023-07-06T21:42:49.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.718+0000 7f4516ffd640 1 -- 172.21.15.55:0/596072644 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c0ab7c0 con 0x7f45180b3730 2023-07-06T21:42:49.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 -- 172.21.15.55:0/596072644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45180b3730 msgr2=0x7f45180c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 --2- 172.21.15.55:0/596072644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45180b3730 0x7f45180c9d40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f450c009870 tx=0x7f450c01c510 comp rx=0 tx=0).stop 2023-07-06T21:42:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 -- 172.21.15.55:0/596072644 shutdown_connections 2023-07-06T21:42:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 --2- 172.21.15.55:0/596072644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45180b3730 0x7f45180c9d40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 --2- 172.21.15.55:0/596072644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45180712f0 0x7f451806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 -- 172.21.15.55:0/596072644 >> 172.21.15.55:0/596072644 conn(0x7f45180cded0 msgr2=0x7f45180ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 -- 172.21.15.55:0/596072644 shutdown_connections 2023-07-06T21:42:49.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 -- 172.21.15.55:0/596072644 wait complete. 2023-07-06T21:42:49.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 Processor -- start 2023-07-06T21:42:49.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 -- start start 2023-07-06T21:42:49.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45180712f0 0x7f4518155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:49.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45180b3730 0x7f45180b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:49.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45180ca280 0x7f45180c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:49.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45180c1c40 con 0x7f45180ca280 2023-07-06T21:42:49.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45180c3e50 con 0x7f45180712f0 2023-07-06T21:42:49.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451e47b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45180c4130 con 0x7f45180b3730 2023-07-06T21:42:49.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451ca18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45180ca280 0x7f45180c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:49.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451ca18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45180ca280 0x7f45180c3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32958/0 (socket says 172.21.15.55:32958) 2023-07-06T21:42:49.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f451ca18640 1 -- 172.21.15.55:0/3812455541 learned_addr learned my addr 172.21.15.55:0/3812455541 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:49.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f45177fe640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45180b3730 0x7f45180b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:49.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.722+0000 7f4517fff640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45180712f0 0x7f4518155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:49.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f451ca18640 1 -- 172.21.15.55:0/3812455541 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45180b3730 msgr2=0x7f45180b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:49.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f451ca18640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45180b3730 0x7f45180b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:49.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f451ca18640 1 -- 172.21.15.55:0/3812455541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45180712f0 msgr2=0x7f4518155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:49.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f451ca18640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45180712f0 0x7f4518155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:49.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f451ca18640 1 -- 172.21.15.55:0/3812455541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c0094d0 con 0x7f45180ca280 2023-07-06T21:42:49.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f45177fe640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45180b3730 0x7f45180b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:49.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f451ca18640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45180ca280 0x7f45180c3010 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f451000c730 tx=0x7f451000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:49.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f4514ff9640 1 -- 172.21.15.55:0/3812455541 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4510003b80 con 0x7f45180ca280 2023-07-06T21:42:49.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f4514ff9640 1 -- 172.21.15.55:0/3812455541 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4510003ce0 con 0x7f45180ca280 2023-07-06T21:42:49.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f4514ff9640 1 -- 172.21.15.55:0/3812455541 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451000aa30 con 0x7f45180ca280 2023-07-06T21:42:49.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f451e47b640 1 -- 172.21.15.55:0/3812455541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45180c4410 con 0x7f45180ca280 2023-07-06T21:42:49.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f451e47b640 1 -- 172.21.15.55:0/3812455541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4518155e80 con 0x7f45180ca280 2023-07-06T21:42:49.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f451e47b640 1 -- 172.21.15.55:0/3812455541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4518066d60 con 0x7f45180ca280 2023-07-06T21:42:49.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f4514ff9640 1 -- 172.21.15.55:0/3812455541 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f451000ab90 con 0x7f45180ca280 2023-07-06T21:42:49.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f4514ff9640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4504066280 0x7f4504068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:49.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f4514ff9640 1 -- 172.21.15.55:0/3812455541 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4510083cf0 con 0x7f45180ca280 2023-07-06T21:42:49.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.726+0000 7f4517fff640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4504066280 0x7f4504068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:49.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.730+0000 7f4517fff640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4504066280 0x7f4504068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f45080045f0 tx=0x7f4508008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:49.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.730+0000 7f4514ff9640 1 -- 172.21.15.55:0/3812455541 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4510050f10 con 0x7f45180ca280 2023-07-06T21:42:49.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.890+0000 7f451e47b640 1 -- 172.21.15.55:0/3812455541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f451806c380 con 0x7f45180ca280 2023-07-06T21:42:49.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.890+0000 7f4514ff9640 1 -- 172.21.15.55:0/3812455541 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f4510054530 con 0x7f45180ca280 2023-07-06T21:42:49.897 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:49.897 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:15.295464+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:49.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.890+0000 7f451e47b640 1 -- 172.21.15.55:0/3812455541 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4504066280 msgr2=0x7f4504068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:49.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.890+0000 7f451e47b640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4504066280 0x7f4504068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f45080045f0 tx=0x7f4508008040 comp rx=0 tx=0).stop 2023-07-06T21:42:49.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.890+0000 7f451e47b640 1 -- 172.21.15.55:0/3812455541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45180ca280 msgr2=0x7f45180c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:49.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.890+0000 7f451e47b640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45180ca280 0x7f45180c3010 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f451000c730 tx=0x7f451000cbf0 comp rx=0 tx=0).stop 2023-07-06T21:42:49.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.890+0000 7f451e47b640 1 -- 172.21.15.55:0/3812455541 shutdown_connections 2023-07-06T21:42:49.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.890+0000 7f451e47b640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4504066280 0x7f4504068730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:49.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.890+0000 7f451e47b640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45180ca280 0x7f45180c3010 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:49.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.890+0000 7f451e47b640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45180b3730 0x7f45180b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:49.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.890+0000 7f451e47b640 1 --2- 172.21.15.55:0/3812455541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45180712f0 0x7f4518155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:49.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.890+0000 7f451e47b640 1 -- 172.21.15.55:0/3812455541 >> 172.21.15.55:0/3812455541 conn(0x7f45180cded0 msgr2=0x7f45180c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:49.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.890+0000 7f451e47b640 1 -- 172.21.15.55:0/3812455541 shutdown_connections 2023-07-06T21:42:49.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:49.890+0000 7f451e47b640 1 -- 172.21.15.55:0/3812455541 wait complete. 2023-07-06T21:42:49.918 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:42:08.597013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:42:09.843890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T21:42:12.918111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T21:42:49.919 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:42:50.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.062+0000 7f033d4f9640 1 Processor -- start 2023-07-06T21:42:50.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.062+0000 7f033d4f9640 1 -- start start 2023-07-06T21:42:50.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.062+0000 7f033d4f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f033806ea60 0x7f03380cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.062+0000 7f033d4f9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f033806eeb0 0x7f03380cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.062+0000 7f033d4f9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03380b3d60 con 0x7f033815b810 2023-07-06T21:42:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.062+0000 7f033d4f9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033806f720 con 0x7f033806eeb0 2023-07-06T21:42:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.062+0000 7f033d4f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03380b45e0 con 0x7f033806ea60 2023-07-06T21:42:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.062+0000 7f032ffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f033806ea60 0x7f03380cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.062+0000 7f03377fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f033806eeb0 0x7f03380cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.062+0000 7f032ffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f033806ea60 0x7f03380cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:56702/0 (socket says 172.21.15.55:56702) 2023-07-06T21:42:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.062+0000 7f032ffff640 1 -- 172.21.15.55:0/1049638175 learned_addr learned my addr 172.21.15.55:0/1049638175 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.062+0000 7f0336ffd640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f033815b810 0x7f03380b4a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:40402/0 (socket says 172.21.15.55:40402) 2023-07-06T21:42:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.066+0000 7f032ffff640 1 -- 172.21.15.55:0/1049638175 >> v2:172.21.15.138:3300/0 conn(0x7f033806eeb0 msgr2=0x7f03380cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.066+0000 7f032ffff640 1 --2- 172.21.15.55:0/1049638175 >> v2:172.21.15.138:3300/0 conn(0x7f033806eeb0 0x7f03380cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.066+0000 7f032ffff640 1 -- 172.21.15.55:0/1049638175 >> v1:172.21.15.138:6789/0 conn(0x7f033815b810 legacy=0x7f03380b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.066+0000 7f032ffff640 1 -- 172.21.15.55:0/1049638175 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03380b5180 con 0x7f033806ea60 2023-07-06T21:42:50.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.066+0000 7f032ffff640 1 --2- 172.21.15.55:0/1049638175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f033806ea60 0x7f03380cb790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03380b5370 tx=0x7f032001c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55e7fc0e8b44d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:50.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.066+0000 7f03367fc640 1 -- 172.21.15.55:0/1049638175 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03200aa650 con 0x7f033806ea60 2023-07-06T21:42:50.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.066+0000 7f03367fc640 1 -- 172.21.15.55:0/1049638175 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03200aa7b0 con 0x7f033806ea60 2023-07-06T21:42:50.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.066+0000 7f03367fc640 1 -- 172.21.15.55:0/1049638175 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03200aab40 con 0x7f033806ea60 2023-07-06T21:42:50.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 -- 172.21.15.55:0/1049638175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f033806ea60 msgr2=0x7f03380cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 --2- 172.21.15.55:0/1049638175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f033806ea60 0x7f03380cb790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03380b5370 tx=0x7f032001c4f0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 -- 172.21.15.55:0/1049638175 shutdown_connections 2023-07-06T21:42:50.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 --2- 172.21.15.55:0/1049638175 >> v2:172.21.15.138:3300/0 conn(0x7f033806eeb0 0x7f03380cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 --2- 172.21.15.55:0/1049638175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f033806ea60 0x7f03380cb790 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 -- 172.21.15.55:0/1049638175 >> 172.21.15.55:0/1049638175 conn(0x7f03380d0020 msgr2=0x7f03380d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:50.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 -- 172.21.15.55:0/1049638175 shutdown_connections 2023-07-06T21:42:50.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 -- 172.21.15.55:0/1049638175 wait complete. 2023-07-06T21:42:50.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 Processor -- start 2023-07-06T21:42:50.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 -- start start 2023-07-06T21:42:50.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f033806ea60 0x7f033814dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f033806eeb0 0x7f033814e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f033815b810 0x7f03381531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03380c3b50 con 0x7f033806eeb0 2023-07-06T21:42:50.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033814ed70 con 0x7f033815b810 2023-07-06T21:42:50.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f033d4f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033814f050 con 0x7f033806ea60 2023-07-06T21:42:50.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f032ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f033806eeb0 0x7f033814e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f0336ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f033806ea60 0x7f033814dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f032ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f033806eeb0 0x7f033814e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32972/0 (socket says 172.21.15.55:32972) 2023-07-06T21:42:50.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f03377fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f033815b810 0x7f03381531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f032ffff640 1 -- 172.21.15.55:0/1880013997 learned_addr learned my addr 172.21.15.55:0/1880013997 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:50.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f032ffff640 1 -- 172.21.15.55:0/1880013997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f033806ea60 msgr2=0x7f033814dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f032ffff640 1 --2- 172.21.15.55:0/1880013997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f033806ea60 0x7f033814dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f032ffff640 1 -- 172.21.15.55:0/1880013997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f033815b810 msgr2=0x7f03381531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f032ffff640 1 --2- 172.21.15.55:0/1880013997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f033815b810 0x7f03381531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f032ffff640 1 -- 172.21.15.55:0/1880013997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03200094d0 con 0x7f033806eeb0 2023-07-06T21:42:50.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f03377fe640 1 --2- 172.21.15.55:0/1880013997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f033815b810 0x7f03381531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:50.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.070+0000 7f0336ffd640 1 --2- 172.21.15.55:0/1880013997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f033806ea60 0x7f033814dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:50.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.074+0000 7f032ffff640 1 --2- 172.21.15.55:0/1880013997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f033806eeb0 0x7f033814e420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f03200ac040 tx=0x7f032001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:50.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.074+0000 7f032f7fe640 1 -- 172.21.15.55:0/1880013997 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03200b3800 con 0x7f033806eeb0 2023-07-06T21:42:50.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.074+0000 7f032f7fe640 1 -- 172.21.15.55:0/1880013997 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03200b3960 con 0x7f033806eeb0 2023-07-06T21:42:50.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.074+0000 7f032f7fe640 1 -- 172.21.15.55:0/1880013997 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03200b3cd0 con 0x7f033806eeb0 2023-07-06T21:42:50.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.074+0000 7f033d4f9640 1 -- 172.21.15.55:0/1880013997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033814f330 con 0x7f033806eeb0 2023-07-06T21:42:50.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.074+0000 7f033d4f9640 1 -- 172.21.15.55:0/1880013997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033814e0f0 con 0x7f033806eeb0 2023-07-06T21:42:50.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.074+0000 7f033d4f9640 1 -- 172.21.15.55:0/1880013997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033815bbe0 con 0x7f033806eeb0 2023-07-06T21:42:50.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.074+0000 7f032f7fe640 1 -- 172.21.15.55:0/1880013997 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f03200b2380 con 0x7f033806eeb0 2023-07-06T21:42:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.074+0000 7f032f7fe640 1 --2- 172.21.15.55:0/1880013997 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f03180662b0 0x7f0318068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.074+0000 7f032f7fe640 1 -- 172.21.15.55:0/1880013997 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f032011e8a0 con 0x7f033806eeb0 2023-07-06T21:42:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.074+0000 7f0336ffd640 1 --2- 172.21.15.55:0/1880013997 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f03180662b0 0x7f0318068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.078+0000 7f0336ffd640 1 --2- 172.21.15.55:0/1880013997 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f03180662b0 0x7f0318068760 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0328000f70 tx=0x7f0328007e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:50.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.078+0000 7f032f7fe640 1 -- 172.21.15.55:0/1880013997 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f03200ebad0 con 0x7f033806eeb0 2023-07-06T21:42:50.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.234+0000 7f033d4f9640 1 -- 172.21.15.55:0/1880013997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0338160130 con 0x7f033806eeb0 2023-07-06T21:42:50.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.234+0000 7f032f7fe640 1 -- 172.21.15.55:0/1880013997 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03200ef0f0 con 0x7f033806eeb0 2023-07-06T21:42:50.242 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:42:50.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.238+0000 7f033d4f9640 1 -- 172.21.15.55:0/1880013997 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f03180662b0 msgr2=0x7f0318068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.238+0000 7f033d4f9640 1 --2- 172.21.15.55:0/1880013997 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f03180662b0 0x7f0318068760 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0328000f70 tx=0x7f0328007e50 comp rx=0 tx=0).stop 2023-07-06T21:42:50.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.238+0000 7f033d4f9640 1 -- 172.21.15.55:0/1880013997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f033806eeb0 msgr2=0x7f033814e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.238+0000 7f033d4f9640 1 --2- 172.21.15.55:0/1880013997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f033806eeb0 0x7f033814e420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f03200ac040 tx=0x7f032001ad30 comp rx=0 tx=0).stop 2023-07-06T21:42:50.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.238+0000 7f033d4f9640 1 -- 172.21.15.55:0/1880013997 shutdown_connections 2023-07-06T21:42:50.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.238+0000 7f033d4f9640 1 --2- 172.21.15.55:0/1880013997 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f03180662b0 0x7f0318068760 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.238+0000 7f033d4f9640 1 --2- 172.21.15.55:0/1880013997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f033815b810 0x7f03381531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.238+0000 7f033d4f9640 1 --2- 172.21.15.55:0/1880013997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f033806eeb0 0x7f033814e420 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.238+0000 7f033d4f9640 1 --2- 172.21.15.55:0/1880013997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f033806ea60 0x7f033814dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.238+0000 7f033d4f9640 1 -- 172.21.15.55:0/1880013997 >> 172.21.15.55:0/1880013997 conn(0x7f03380d0020 msgr2=0x7f0338154490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:50.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.238+0000 7f033d4f9640 1 -- 172.21.15.55:0/1880013997 shutdown_connections 2023-07-06T21:42:50.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.238+0000 7f033d4f9640 1 -- 172.21.15.55:0/1880013997 wait complete. 2023-07-06T21:42:50.263 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:42:50.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.402+0000 7f6020967640 1 Processor -- start 2023-07-06T21:42:50.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.402+0000 7f6020967640 1 -- start start 2023-07-06T21:42:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.402+0000 7f6020967640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f601c0b3cd0 0x7f601c0d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.402+0000 7f6020967640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601c0b2b80 con 0x7f601c15b850 2023-07-06T21:42:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.402+0000 7f6020967640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601c0cff30 con 0x7f601c0b3870 2023-07-06T21:42:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.402+0000 7f6020967640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601c0b22e0 con 0x7f601c0b3cd0 2023-07-06T21:42:50.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.402+0000 7f601a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f601c15b850 0x7f601c0cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58300/0 (socket says 172.21.15.55:58300) 2023-07-06T21:42:50.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.402+0000 7f601a59c640 1 -- 172.21.15.55:0/391737489 learned_addr learned my addr 172.21.15.55:0/391737489 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.402+0000 7f601ad9d640 1 --2- 172.21.15.55:0/391737489 >> v2:172.21.15.138:3300/0 conn(0x7f601c0b3cd0 0x7f601c0d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.406+0000 7f6019d9b640 1 -- 172.21.15.55:0/391737489 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617398161 0 0) 0x7f601c0b2b80 con 0x7f601c15b850 2023-07-06T21:42:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.406+0000 7f6019d9b640 1 -- 172.21.15.55:0/391737489 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6008003530 con 0x7f601c15b850 2023-07-06T21:42:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.406+0000 7f6019d9b640 1 -- 172.21.15.55:0/391737489 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150579690 0 0) 0x7f601c0cff30 con 0x7f601c0b3870 2023-07-06T21:42:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.406+0000 7f6019d9b640 1 -- 172.21.15.55:0/391737489 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f601c0b2b80 con 0x7f601c0b3870 2023-07-06T21:42:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.406+0000 7f601ad9d640 1 -- 172.21.15.55:0/391737489 >> v1:172.21.15.138:6789/0 conn(0x7f601c0b3870 legacy=0x7f601c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.406+0000 7f601ad9d640 1 -- 172.21.15.55:0/391737489 >> v1:172.21.15.55:6789/0 conn(0x7f601c15b850 legacy=0x7f601c0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.406+0000 7f601ad9d640 1 -- 172.21.15.55:0/391737489 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c0b25c0 con 0x7f601c0b3cd0 2023-07-06T21:42:50.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.406+0000 7f601ad9d640 1 --2- 172.21.15.55:0/391737489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c0b3cd0 0x7f601c0d0ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6014009d90 tx=0x7f601401c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9546f3c0f5409d74 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:50.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.406+0000 7f6019d9b640 1 -- 172.21.15.55:0/391737489 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60140a5880 con 0x7f601c0b3cd0 2023-07-06T21:42:50.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.406+0000 7f6019d9b640 1 -- 172.21.15.55:0/391737489 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60140a59e0 con 0x7f601c0b3cd0 2023-07-06T21:42:50.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.406+0000 7f6019d9b640 1 -- 172.21.15.55:0/391737489 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60140a5d70 con 0x7f601c0b3cd0 2023-07-06T21:42:50.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 -- 172.21.15.55:0/391737489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c0b3cd0 msgr2=0x7f601c0d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 --2- 172.21.15.55:0/391737489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c0b3cd0 0x7f601c0d0ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6014009d90 tx=0x7f601401c800 comp rx=0 tx=0).stop 2023-07-06T21:42:50.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 -- 172.21.15.55:0/391737489 shutdown_connections 2023-07-06T21:42:50.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 --2- 172.21.15.55:0/391737489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c0b3cd0 0x7f601c0d0ad0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 -- 172.21.15.55:0/391737489 >> 172.21.15.55:0/391737489 conn(0x7f601c0cec20 msgr2=0x7f601c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:50.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 -- 172.21.15.55:0/391737489 shutdown_connections 2023-07-06T21:42:50.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 -- 172.21.15.55:0/391737489 wait complete. 2023-07-06T21:42:50.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 Processor -- start 2023-07-06T21:42:50.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 -- start start 2023-07-06T21:42:50.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f601c0b3870 0x7f601c0c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f601c0b3cd0 0x7f601c14fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c15b850 0x7f601c15e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c0c82b0 con 0x7f601c0b3cd0 2023-07-06T21:42:50.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c156930 con 0x7f601c15b850 2023-07-06T21:42:50.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6020967640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601c1503b0 con 0x7f601c0b3870 2023-07-06T21:42:50.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6013fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f601c0b3cd0 0x7f601c14fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6013fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f601c0b3cd0 0x7f601c14fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32982/0 (socket says 172.21.15.55:32982) 2023-07-06T21:42:50.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6013fff640 1 -- 172.21.15.55:0/1699240218 learned_addr learned my addr 172.21.15.55:0/1699240218 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:50.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f601a59c640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f601c0b3870 0x7f601c0c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f601ad9d640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c15b850 0x7f601c15e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6013fff640 1 -- 172.21.15.55:0/1699240218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f601c0b3870 msgr2=0x7f601c0c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6013fff640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f601c0b3870 0x7f601c0c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6013fff640 1 -- 172.21.15.55:0/1699240218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c15b850 msgr2=0x7f601c15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6013fff640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c15b850 0x7f601c15e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f6013fff640 1 -- 172.21.15.55:0/1699240218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6014009a70 con 0x7f601c0b3cd0 2023-07-06T21:42:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.410+0000 7f601ad9d640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c15b850 0x7f601c15e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.414+0000 7f6013fff640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f601c0b3cd0 0x7f601c14fe70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f600400c490 tx=0x7f600400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.414+0000 7f6012ffd640 1 -- 172.21.15.55:0/1699240218 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60040052d0 con 0x7f601c0b3cd0 2023-07-06T21:42:50.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.414+0000 7f6012ffd640 1 -- 172.21.15.55:0/1699240218 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6004005450 con 0x7f601c0b3cd0 2023-07-06T21:42:50.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.414+0000 7f6012ffd640 1 -- 172.21.15.55:0/1699240218 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004012870 con 0x7f601c0b3cd0 2023-07-06T21:42:50.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.414+0000 7f6020967640 1 -- 172.21.15.55:0/1699240218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601c157140 con 0x7f601c0b3cd0 2023-07-06T21:42:50.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.414+0000 7f6020967640 1 -- 172.21.15.55:0/1699240218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601c156b80 con 0x7f601c0b3cd0 2023-07-06T21:42:50.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.414+0000 7f6020967640 1 -- 172.21.15.55:0/1699240218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601c066d60 con 0x7f601c0b3cd0 2023-07-06T21:42:50.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.414+0000 7f6012ffd640 1 -- 172.21.15.55:0/1699240218 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f60040129d0 con 0x7f601c0b3cd0 2023-07-06T21:42:50.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.414+0000 7f6012ffd640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5ffc066280 0x7f5ffc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.414+0000 7f6012ffd640 1 -- 172.21.15.55:0/1699240218 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f60040839b0 con 0x7f601c0b3cd0 2023-07-06T21:42:50.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.418+0000 7f601a59c640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5ffc066280 0x7f5ffc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.418+0000 7f601a59c640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5ffc066280 0x7f5ffc068730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f600c0011f0 tx=0x7f600c007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:50.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.418+0000 7f6012ffd640 1 -- 172.21.15.55:0/1699240218 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6004050c80 con 0x7f601c0b3cd0 2023-07-06T21:42:50.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.586+0000 7f6020967640 1 -- 172.21.15.55:0/1699240218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f601c0ccce0 con 0x7f601c0b3cd0 2023-07-06T21:42:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.586+0000 7f6012ffd640 1 -- 172.21.15.55:0/1699240218 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f60040542a0 con 0x7f601c0b3cd0 2023-07-06T21:42:50.593 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:42:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.586+0000 7f6020967640 1 -- 172.21.15.55:0/1699240218 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5ffc066280 msgr2=0x7f5ffc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.586+0000 7f6020967640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5ffc066280 0x7f5ffc068730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f600c0011f0 tx=0x7f600c007d40 comp rx=0 tx=0).stop 2023-07-06T21:42:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.590+0000 7f6020967640 1 -- 172.21.15.55:0/1699240218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f601c0b3cd0 msgr2=0x7f601c14fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.590+0000 7f6020967640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f601c0b3cd0 0x7f601c14fe70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f600400c490 tx=0x7f600400c950 comp rx=0 tx=0).stop 2023-07-06T21:42:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.590+0000 7f6020967640 1 -- 172.21.15.55:0/1699240218 shutdown_connections 2023-07-06T21:42:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.590+0000 7f6020967640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5ffc066280 0x7f5ffc068730 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.590+0000 7f6020967640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f601c15b850 0x7f601c15e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.590+0000 7f6020967640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f601c0b3cd0 0x7f601c14fe70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.590+0000 7f6020967640 1 --2- 172.21.15.55:0/1699240218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f601c0b3870 0x7f601c0c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.590+0000 7f6020967640 1 -- 172.21.15.55:0/1699240218 >> 172.21.15.55:0/1699240218 conn(0x7f601c0cec20 msgr2=0x7f601c06aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.590+0000 7f6020967640 1 -- 172.21.15.55:0/1699240218 shutdown_connections 2023-07-06T21:42:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.590+0000 7f6020967640 1 -- 172.21.15.55:0/1699240218 wait complete. 2023-07-06T21:42:50.615 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:42:50.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.754+0000 7f6376d00640 1 Processor -- start 2023-07-06T21:42:50.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.754+0000 7f6376d00640 1 -- start start 2023-07-06T21:42:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.754+0000 7f6376d00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f63700d1c40 0x7f63700b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.754+0000 7f6376d00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63700b5070 con 0x7f63700b4130 2023-07-06T21:42:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.754+0000 7f6376d00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6370160020 con 0x7f63700b7b90 2023-07-06T21:42:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.754+0000 7f6376d00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63700d20c0 con 0x7f63700d1c40 2023-07-06T21:42:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.754+0000 7f637529d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f63700b4130 0x7f63700b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58308/0 (socket says 172.21.15.55:58308) 2023-07-06T21:42:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.754+0000 7f637529d640 1 -- 172.21.15.55:0/3667041428 learned_addr learned my addr 172.21.15.55:0/3667041428 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.754+0000 7f636ffff640 1 --2- 172.21.15.55:0/3667041428 >> v2:172.21.15.138:3300/0 conn(0x7f63700d1c40 0x7f63700b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.754+0000 7f636f7fe640 1 -- 172.21.15.55:0/3667041428 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974850581 0 0) 0x7f63700b5070 con 0x7f63700b4130 2023-07-06T21:42:50.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.754+0000 7f636f7fe640 1 -- 172.21.15.55:0/3667041428 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6360003530 con 0x7f63700b4130 2023-07-06T21:42:50.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.754+0000 7f636ffff640 1 -- 172.21.15.55:0/3667041428 >> v1:172.21.15.138:6789/0 conn(0x7f63700b7b90 legacy=0x7f63700cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.754+0000 7f636ffff640 1 -- 172.21.15.55:0/3667041428 >> v1:172.21.15.55:6789/0 conn(0x7f63700b4130 legacy=0x7f63700b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.754+0000 7f636ffff640 1 -- 172.21.15.55:0/3667041428 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700b4570 con 0x7f63700d1c40 2023-07-06T21:42:50.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.758+0000 7f636ffff640 1 --2- 172.21.15.55:0/3667041428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63700d1c40 0x7f63700b3bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f635c0097c0 tx=0x7f635c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ef8fb7e1cab31f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:50.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.758+0000 7f636f7fe640 1 -- 172.21.15.55:0/3667041428 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c0ab600 con 0x7f63700d1c40 2023-07-06T21:42:50.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.758+0000 7f636f7fe640 1 -- 172.21.15.55:0/3667041428 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c0a7050 con 0x7f63700d1c40 2023-07-06T21:42:50.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.758+0000 7f636f7fe640 1 -- 172.21.15.55:0/3667041428 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c0ab980 con 0x7f63700d1c40 2023-07-06T21:42:50.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.758+0000 7f6376d00640 1 -- 172.21.15.55:0/3667041428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63700d1c40 msgr2=0x7f63700b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.758+0000 7f6376d00640 1 --2- 172.21.15.55:0/3667041428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63700d1c40 0x7f63700b3bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f635c0097c0 tx=0x7f635c01c480 comp rx=0 tx=0).stop 2023-07-06T21:42:50.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.758+0000 7f6376d00640 1 -- 172.21.15.55:0/3667041428 shutdown_connections 2023-07-06T21:42:50.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.758+0000 7f6376d00640 1 --2- 172.21.15.55:0/3667041428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63700d1c40 0x7f63700b3bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.758+0000 7f6376d00640 1 -- 172.21.15.55:0/3667041428 >> 172.21.15.55:0/3667041428 conn(0x7f63700ceca0 msgr2=0x7f63700cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:50.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.758+0000 7f6376d00640 1 -- 172.21.15.55:0/3667041428 shutdown_connections 2023-07-06T21:42:50.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.758+0000 7f6376d00640 1 -- 172.21.15.55:0/3667041428 wait complete. 2023-07-06T21:42:50.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f6376d00640 1 Processor -- start 2023-07-06T21:42:50.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f6376d00640 1 -- start start 2023-07-06T21:42:50.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f6376d00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f63700b4130 0x7f6370069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f6376d00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63700b7b90 0x7f63700cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f6376d00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63700d1c40 0x7f63700cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f6376d00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63700cbcb0 con 0x7f63700b7b90 2023-07-06T21:42:50.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f6376d00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637015ce90 con 0x7f63700d1c40 2023-07-06T21:42:50.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f6376d00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637015d170 con 0x7f63700b4130 2023-07-06T21:42:50.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f636ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63700b7b90 0x7f63700cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f636ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63700b7b90 0x7f63700cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32990/0 (socket says 172.21.15.55:32990) 2023-07-06T21:42:50.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f636ffff640 1 -- 172.21.15.55:0/419326461 learned_addr learned my addr 172.21.15.55:0/419326461 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:50.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f637529d640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63700d1c40 0x7f63700cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f6374a9c640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f63700b4130 0x7f6370069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f636ffff640 1 -- 172.21.15.55:0/419326461 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f63700b4130 msgr2=0x7f6370069650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f636ffff640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f63700b4130 0x7f6370069650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f636ffff640 1 -- 172.21.15.55:0/419326461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63700d1c40 msgr2=0x7f63700cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f636ffff640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63700d1c40 0x7f63700cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f636ffff640 1 -- 172.21.15.55:0/419326461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c009420 con 0x7f63700b7b90 2023-07-06T21:42:50.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f637529d640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63700d1c40 0x7f63700cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:50.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.762+0000 7f636ffff640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63700b7b90 0x7f63700cb230 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f635c01a0b0 tx=0x7f635c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:50.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.766+0000 7f636d7fa640 1 -- 172.21.15.55:0/419326461 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c0b4400 con 0x7f63700b7b90 2023-07-06T21:42:50.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.766+0000 7f636d7fa640 1 -- 172.21.15.55:0/419326461 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c0b4560 con 0x7f63700b7b90 2023-07-06T21:42:50.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.766+0000 7f6376d00640 1 -- 172.21.15.55:0/419326461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637015d450 con 0x7f63700b7b90 2023-07-06T21:42:50.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.766+0000 7f636d7fa640 1 -- 172.21.15.55:0/419326461 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c0b4910 con 0x7f63700b7b90 2023-07-06T21:42:50.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.766+0000 7f6376d00640 1 -- 172.21.15.55:0/419326461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637015da10 con 0x7f63700b7b90 2023-07-06T21:42:50.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.766+0000 7f6376d00640 1 -- 172.21.15.55:0/419326461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6370066d60 con 0x7f63700b7b90 2023-07-06T21:42:50.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.766+0000 7f636d7fa640 1 -- 172.21.15.55:0/419326461 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f635c0b2040 con 0x7f63700b7b90 2023-07-06T21:42:50.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.766+0000 7f636d7fa640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6354066280 0x7f6354068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:50.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.766+0000 7f636d7fa640 1 -- 172.21.15.55:0/419326461 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f635c11dd90 con 0x7f63700b7b90 2023-07-06T21:42:50.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.766+0000 7f6374a9c640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6354066280 0x7f6354068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:50.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.766+0000 7f6374a9c640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6354066280 0x7f6354068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6364007fd0 tx=0x7f6364009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:50.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.770+0000 7f636d7fa640 1 -- 172.21.15.55:0/419326461 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f635c0eaef0 con 0x7f63700b7b90 2023-07-06T21:42:50.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.930+0000 7f6376d00640 1 -- 172.21.15.55:0/419326461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6370072de0 con 0x7f63700b7b90 2023-07-06T21:42:50.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.930+0000 7f636d7fa640 1 -- 172.21.15.55:0/419326461 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f635c0b00a0 con 0x7f63700b7b90 2023-07-06T21:42:50.937 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:50.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.930+0000 7f6376d00640 1 -- 172.21.15.55:0/419326461 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6354066280 msgr2=0x7f6354068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.930+0000 7f6376d00640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6354066280 0x7f6354068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6364007fd0 tx=0x7f6364009040 comp rx=0 tx=0).stop 2023-07-06T21:42:50.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.930+0000 7f6376d00640 1 -- 172.21.15.55:0/419326461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63700b7b90 msgr2=0x7f63700cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:50.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.930+0000 7f6376d00640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63700b7b90 0x7f63700cb230 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f635c01a0b0 tx=0x7f635c019220 comp rx=0 tx=0).stop 2023-07-06T21:42:50.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.930+0000 7f6376d00640 1 -- 172.21.15.55:0/419326461 shutdown_connections 2023-07-06T21:42:50.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.934+0000 7f6376d00640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6354066280 0x7f6354068730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.934+0000 7f6376d00640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63700d1c40 0x7f63700cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.934+0000 7f6376d00640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63700b7b90 0x7f63700cb230 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.934+0000 7f6376d00640 1 --2- 172.21.15.55:0/419326461 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f63700b4130 0x7f6370069650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:50.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.934+0000 7f6376d00640 1 -- 172.21.15.55:0/419326461 >> 172.21.15.55:0/419326461 conn(0x7f63700ceca0 msgr2=0x7f637015b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:50.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.934+0000 7f6376d00640 1 -- 172.21.15.55:0/419326461 shutdown_connections 2023-07-06T21:42:50.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:50.934+0000 7f6376d00640 1 -- 172.21.15.55:0/419326461 wait complete. 2023-07-06T21:42:50.959 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:42:51.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae20a0b640 1 Processor -- start 2023-07-06T21:42:51.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae20a0b640 1 -- start start 2023-07-06T21:42:51.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae20a0b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae1c15bb90 0x7fae1c0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae20a0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1c070020 0x7fae1c0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae20a0b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c15fe80 con 0x7fae1c0cef40 2023-07-06T21:42:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae20a0b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1c15f620 con 0x7fae1c15bb90 2023-07-06T21:42:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae20a0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c15bf60 con 0x7fae1c070020 2023-07-06T21:42:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae1a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae1c15bb90 0x7fae1c0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae1a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae1c15bb90 0x7fae1c0ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32996/0 (socket says 172.21.15.55:32996) 2023-07-06T21:42:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae1a59c640 1 -- 172.21.15.55:0/2492931997 learned_addr learned my addr 172.21.15.55:0/2492931997 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae13fff640 1 --1- 172.21.15.55:0/2492931997 >> v1:172.21.15.55:6789/0 conn(0x7fae1c0cef40 0x7fae1c06f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58312/0 (socket says 172.21.15.55:58312) 2023-07-06T21:42:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae1ad9d640 1 --2- 172.21.15.55:0/2492931997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1c070020 0x7fae1c0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae1a59c640 1 -- 172.21.15.55:0/2492931997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1c070020 msgr2=0x7fae1c0c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae1a59c640 1 --2- 172.21.15.55:0/2492931997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1c070020 0x7fae1c0c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae1a59c640 1 -- 172.21.15.55:0/2492931997 >> v1:172.21.15.55:6789/0 conn(0x7fae1c0cef40 legacy=0x7fae1c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae19d9b640 1 -- 172.21.15.55:0/2492931997 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586050761 0 0) 0x7fae1c15fe80 con 0x7fae1c0cef40 2023-07-06T21:42:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.098+0000 7fae1a59c640 1 -- 172.21.15.55:0/2492931997 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c0cf440 con 0x7fae1c15bb90 2023-07-06T21:42:51.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.102+0000 7fae1a59c640 1 --2- 172.21.15.55:0/2492931997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae1c15bb90 0x7fae1c0ce030 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009870 tx=0x7fae0c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc46b8a49d2c9ec server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:51.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.102+0000 7fae19d9b640 1 -- 172.21.15.55:0/2492931997 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0ab600 con 0x7fae1c15bb90 2023-07-06T21:42:51.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.102+0000 7fae19d9b640 1 -- 172.21.15.55:0/2492931997 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c0a7050 con 0x7fae1c15bb90 2023-07-06T21:42:51.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.102+0000 7fae19d9b640 1 -- 172.21.15.55:0/2492931997 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0ab980 con 0x7fae1c15bb90 2023-07-06T21:42:51.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.102+0000 7fae20a0b640 1 -- 172.21.15.55:0/2492931997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae1c15bb90 msgr2=0x7fae1c0ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.102+0000 7fae20a0b640 1 --2- 172.21.15.55:0/2492931997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae1c15bb90 0x7fae1c0ce030 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009870 tx=0x7fae0c01c540 comp rx=0 tx=0).stop 2023-07-06T21:42:51.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.102+0000 7fae20a0b640 1 -- 172.21.15.55:0/2492931997 shutdown_connections 2023-07-06T21:42:51.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.102+0000 7fae20a0b640 1 --2- 172.21.15.55:0/2492931997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1c070020 0x7fae1c0c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.102+0000 7fae20a0b640 1 --2- 172.21.15.55:0/2492931997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae1c15bb90 0x7fae1c0ce030 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.102+0000 7fae20a0b640 1 -- 172.21.15.55:0/2492931997 >> 172.21.15.55:0/2492931997 conn(0x7fae1c0cbd70 msgr2=0x7fae1c0ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:51.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.102+0000 7fae20a0b640 1 -- 172.21.15.55:0/2492931997 shutdown_connections 2023-07-06T21:42:51.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.102+0000 7fae20a0b640 1 -- 172.21.15.55:0/2492931997 wait complete. 2023-07-06T21:42:51.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae20a0b640 1 Processor -- start 2023-07-06T21:42:51.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae20a0b640 1 -- start start 2023-07-06T21:42:51.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae20a0b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1c070020 0x7fae1c149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae20a0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1c0cef40 0x7fae1c149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae20a0b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae1c15bb90 0x7fae1c06c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae20a0b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c15ae30 con 0x7fae1c15bb90 2023-07-06T21:42:51.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae20a0b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0b1600 con 0x7fae1c070020 2023-07-06T21:42:51.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae20a0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c1499a0 con 0x7fae1c0cef40 2023-07-06T21:42:51.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae1ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae1c15bb90 0x7fae1c06c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae1ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae1c15bb90 0x7fae1c06c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32998/0 (socket says 172.21.15.55:32998) 2023-07-06T21:42:51.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae1ad9d640 1 -- 172.21.15.55:0/1056205616 learned_addr learned my addr 172.21.15.55:0/1056205616 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:51.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae13fff640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1c0cef40 0x7fae1c149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae1a59c640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1c070020 0x7fae1c149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae1ad9d640 1 -- 172.21.15.55:0/1056205616 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1c0cef40 msgr2=0x7fae1c149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae1ad9d640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1c0cef40 0x7fae1c149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae1ad9d640 1 -- 172.21.15.55:0/1056205616 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1c070020 msgr2=0x7fae1c149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae1ad9d640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1c070020 0x7fae1c149460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae1ad9d640 1 -- 172.21.15.55:0/1056205616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c0094d0 con 0x7fae1c15bb90 2023-07-06T21:42:51.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae13fff640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1c0cef40 0x7fae1c149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:51.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae1ad9d640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae1c15bb90 0x7fae1c06c810 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fae14007e70 tx=0x7fae1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:51.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae12ffd640 1 -- 172.21.15.55:0/1056205616 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14014620 con 0x7fae1c15bb90 2023-07-06T21:42:51.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae12ffd640 1 -- 172.21.15.55:0/1056205616 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae140147a0 con 0x7fae1c15bb90 2023-07-06T21:42:51.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae12ffd640 1 -- 172.21.15.55:0/1056205616 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14014b50 con 0x7fae1c15bb90 2023-07-06T21:42:51.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae20a0b640 1 -- 172.21.15.55:0/1056205616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1c14ae90 con 0x7fae1c15bb90 2023-07-06T21:42:51.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.106+0000 7fae20a0b640 1 -- 172.21.15.55:0/1056205616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c14a8d0 con 0x7fae1c15bb90 2023-07-06T21:42:51.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.110+0000 7fae20a0b640 1 -- 172.21.15.55:0/1056205616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1c066d60 con 0x7fae1c15bb90 2023-07-06T21:42:51.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.110+0000 7fae12ffd640 1 -- 172.21.15.55:0/1056205616 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fae14014cb0 con 0x7fae1c15bb90 2023-07-06T21:42:51.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.110+0000 7fae12ffd640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fadfc066280 0x7fadfc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.110+0000 7fae12ffd640 1 -- 172.21.15.55:0/1056205616 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fae14084a40 con 0x7fae1c15bb90 2023-07-06T21:42:51.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.110+0000 7fae1a59c640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fadfc066280 0x7fadfc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.110+0000 7fae1a59c640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fadfc066280 0x7fadfc068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0ad000 tx=0x7fae0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:51.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.114+0000 7fae12ffd640 1 -- 172.21.15.55:0/1056205616 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fae14055580 con 0x7fae1c15bb90 2023-07-06T21:42:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.270+0000 7fae20a0b640 1 -- 172.21.15.55:0/1056205616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fae1c0b1740 con 0x7fae1c15bb90 2023-07-06T21:42:51.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.270+0000 7fae12ffd640 1 -- 172.21.15.55:0/1056205616 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fae14082e60 con 0x7fae1c15bb90 2023-07-06T21:42:51.277 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:42:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.274+0000 7fae20a0b640 1 -- 172.21.15.55:0/1056205616 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fadfc066280 msgr2=0x7fadfc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.274+0000 7fae20a0b640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fadfc066280 0x7fadfc068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0ad000 tx=0x7fae0c008040 comp rx=0 tx=0).stop 2023-07-06T21:42:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.274+0000 7fae20a0b640 1 -- 172.21.15.55:0/1056205616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae1c15bb90 msgr2=0x7fae1c06c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.274+0000 7fae20a0b640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae1c15bb90 0x7fae1c06c810 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fae14007e70 tx=0x7fae1400e4b0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.274+0000 7fae20a0b640 1 -- 172.21.15.55:0/1056205616 shutdown_connections 2023-07-06T21:42:51.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.274+0000 7fae20a0b640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fadfc066280 0x7fadfc068730 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.274+0000 7fae20a0b640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae1c15bb90 0x7fae1c06c810 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.274+0000 7fae20a0b640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae1c0cef40 0x7fae1c149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.274+0000 7fae20a0b640 1 --2- 172.21.15.55:0/1056205616 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae1c070020 0x7fae1c149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.274+0000 7fae20a0b640 1 -- 172.21.15.55:0/1056205616 >> 172.21.15.55:0/1056205616 conn(0x7fae1c0cbd70 msgr2=0x7fae1c154ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:51.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.274+0000 7fae20a0b640 1 -- 172.21.15.55:0/1056205616 shutdown_connections 2023-07-06T21:42:51.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.274+0000 7fae20a0b640 1 -- 172.21.15.55:0/1056205616 wait complete. 2023-07-06T21:42:51.298 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T21:42:51.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f864b3a3640 1 Processor -- start 2023-07-06T21:42:51.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f864b3a3640 1 -- start start 2023-07-06T21:42:51.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f864b3a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f864406eee0 0x7f864406f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f864b3a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86440ccd70 con 0x7f864406f890 2023-07-06T21:42:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f864b3a3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864406fca0 con 0x7f86440c11a0 2023-07-06T21:42:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f864b3a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86441605f0 con 0x7f864406eee0 2023-07-06T21:42:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f8649940640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f864406f890 0x7f86440c84a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58328/0 (socket says 172.21.15.55:58328) 2023-07-06T21:42:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f8649940640 1 -- 172.21.15.55:0/4289658902 learned_addr learned my addr 172.21.15.55:0/4289658902 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f864893e640 1 --2- 172.21.15.55:0/4289658902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f864406eee0 0x7f864406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f863bfff640 1 -- 172.21.15.55:0/4289658902 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066275100 0 0) 0x7f86440ccd70 con 0x7f864406f890 2023-07-06T21:42:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f863bfff640 1 -- 172.21.15.55:0/4289658902 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8630003530 con 0x7f864406f890 2023-07-06T21:42:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f863bfff640 1 -- 172.21.15.55:0/4289658902 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659225206 0 0) 0x7f864406fca0 con 0x7f86440c11a0 2023-07-06T21:42:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f863bfff640 1 -- 172.21.15.55:0/4289658902 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86440ccd70 con 0x7f86440c11a0 2023-07-06T21:42:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f864893e640 1 -- 172.21.15.55:0/4289658902 >> v1:172.21.15.138:6789/0 conn(0x7f86440c11a0 legacy=0x7f86440cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f864893e640 1 -- 172.21.15.55:0/4289658902 >> v1:172.21.15.55:6789/0 conn(0x7f864406f890 legacy=0x7f86440c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.438+0000 7f864893e640 1 -- 172.21.15.55:0/4289658902 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864406cb20 con 0x7f864406eee0 2023-07-06T21:42:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.442+0000 7f864893e640 1 --2- 172.21.15.55:0/4289658902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f864406eee0 0x7f864406f350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f86340097f0 tx=0x7f863401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96d28686d3b45e46 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.442+0000 7f863bfff640 1 -- 172.21.15.55:0/4289658902 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86340ab600 con 0x7f864406eee0 2023-07-06T21:42:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.442+0000 7f863bfff640 1 -- 172.21.15.55:0/4289658902 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86340a7050 con 0x7f864406eee0 2023-07-06T21:42:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.442+0000 7f863bfff640 1 -- 172.21.15.55:0/4289658902 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86340ab980 con 0x7f864406eee0 2023-07-06T21:42:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.442+0000 7f864b3a3640 1 -- 172.21.15.55:0/4289658902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f864406eee0 msgr2=0x7f864406f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.442+0000 7f864b3a3640 1 --2- 172.21.15.55:0/4289658902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f864406eee0 0x7f864406f350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f86340097f0 tx=0x7f863401c430 comp rx=0 tx=0).stop 2023-07-06T21:42:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.442+0000 7f864b3a3640 1 -- 172.21.15.55:0/4289658902 shutdown_connections 2023-07-06T21:42:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.442+0000 7f864b3a3640 1 --2- 172.21.15.55:0/4289658902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f864406eee0 0x7f864406f350 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.442+0000 7f864b3a3640 1 -- 172.21.15.55:0/4289658902 >> 172.21.15.55:0/4289658902 conn(0x7f86440cea70 msgr2=0x7f86440ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.442+0000 7f864b3a3640 1 -- 172.21.15.55:0/4289658902 shutdown_connections 2023-07-06T21:42:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.442+0000 7f864b3a3640 1 -- 172.21.15.55:0/4289658902 wait complete. 2023-07-06T21:42:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f864b3a3640 1 Processor -- start 2023-07-06T21:42:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f864b3a3640 1 -- start start 2023-07-06T21:42:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f864b3a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f864406eee0 0x7f8644154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f864b3a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f864406f890 0x7f8644162f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f864b3a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86440c11a0 0x7f864415aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f864b3a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8644158520 con 0x7f86440c11a0 2023-07-06T21:42:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f864b3a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441611a0 con 0x7f864406eee0 2023-07-06T21:42:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f864b3a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8644161480 con 0x7f864406f890 2023-07-06T21:42:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f8649940640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86440c11a0 0x7f864415aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f8649940640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86440c11a0 0x7f864415aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33004/0 (socket says 172.21.15.55:33004) 2023-07-06T21:42:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f8649940640 1 -- 172.21.15.55:0/946705117 learned_addr learned my addr 172.21.15.55:0/946705117 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:51.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f864893e640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f864406f890 0x7f8644162f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f864913f640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f864406eee0 0x7f8644154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f8649940640 1 -- 172.21.15.55:0/946705117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f864406f890 msgr2=0x7f8644162f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f8649940640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f864406f890 0x7f8644162f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f8649940640 1 -- 172.21.15.55:0/946705117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f864406eee0 msgr2=0x7f8644154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f8649940640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f864406eee0 0x7f8644154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f8649940640 1 -- 172.21.15.55:0/946705117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8634009420 con 0x7f86440c11a0 2023-07-06T21:42:51.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f864913f640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f864406eee0 0x7f8644154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:51.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f8649940640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86440c11a0 0x7f864415aa00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f863c00cbc0 tx=0x7f863c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:51.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f8639ffb640 1 -- 172.21.15.55:0/946705117 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c00ace0 con 0x7f86440c11a0 2023-07-06T21:42:51.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f8639ffb640 1 -- 172.21.15.55:0/946705117 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c00ae40 con 0x7f86440c11a0 2023-07-06T21:42:51.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f864b3a3640 1 -- 172.21.15.55:0/946705117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86440c16f0 con 0x7f86440c11a0 2023-07-06T21:42:51.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f8639ffb640 1 -- 172.21.15.55:0/946705117 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c012600 con 0x7f86440c11a0 2023-07-06T21:42:51.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f864b3a3640 1 -- 172.21.15.55:0/946705117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864406a530 con 0x7f86440c11a0 2023-07-06T21:42:51.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.446+0000 7f864b3a3640 1 -- 172.21.15.55:0/946705117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864406a720 con 0x7f86440c11a0 2023-07-06T21:42:51.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.450+0000 7f8639ffb640 1 -- 172.21.15.55:0/946705117 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f863c012820 con 0x7f86440c11a0 2023-07-06T21:42:51.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.450+0000 7f8639ffb640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8628066280 0x7f8628068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.450+0000 7f8639ffb640 1 -- 172.21.15.55:0/946705117 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f863c083fe0 con 0x7f86440c11a0 2023-07-06T21:42:51.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.450+0000 7f864913f640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8628066280 0x7f8628068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.450+0000 7f864913f640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8628066280 0x7f8628068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f86400011f0 tx=0x7f8640009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:51.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.454+0000 7f8639ffb640 1 -- 172.21.15.55:0/946705117 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f863c051140 con 0x7f86440c11a0 2023-07-06T21:42:51.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.610+0000 7f864b3a3640 1 -- 172.21.15.55:0/946705117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8644066d60 con 0x7f86440c11a0 2023-07-06T21:42:51.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.610+0000 7f8639ffb640 1 -- 172.21.15.55:0/946705117 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f863c054760 con 0x7f86440c11a0 2023-07-06T21:42:51.619 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:51.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.614+0000 7f864b3a3640 1 -- 172.21.15.55:0/946705117 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8628066280 msgr2=0x7f8628068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.614+0000 7f864b3a3640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8628066280 0x7f8628068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f86400011f0 tx=0x7f8640009040 comp rx=0 tx=0).stop 2023-07-06T21:42:51.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.614+0000 7f864b3a3640 1 -- 172.21.15.55:0/946705117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86440c11a0 msgr2=0x7f864415aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.614+0000 7f864b3a3640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86440c11a0 0x7f864415aa00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f863c00cbc0 tx=0x7f863c00a430 comp rx=0 tx=0).stop 2023-07-06T21:42:51.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.614+0000 7f864b3a3640 1 -- 172.21.15.55:0/946705117 shutdown_connections 2023-07-06T21:42:51.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.614+0000 7f864b3a3640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8628066280 0x7f8628068730 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.614+0000 7f864b3a3640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86440c11a0 0x7f864415aa00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.614+0000 7f864b3a3640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f864406f890 0x7f8644162f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.614+0000 7f864b3a3640 1 --2- 172.21.15.55:0/946705117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f864406eee0 0x7f8644154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.614+0000 7f864b3a3640 1 -- 172.21.15.55:0/946705117 >> 172.21.15.55:0/946705117 conn(0x7f86440cea70 msgr2=0x7f86440c3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:51.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.614+0000 7f864b3a3640 1 -- 172.21.15.55:0/946705117 shutdown_connections 2023-07-06T21:42:51.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.614+0000 7f864b3a3640 1 -- 172.21.15.55:0/946705117 wait complete. 2023-07-06T21:42:51.640 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.778+0000 7f95f667b640 1 Processor -- start 2023-07-06T21:42:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95f667b640 1 -- start start 2023-07-06T21:42:51.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95f667b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95f00c8d80 0x7f95f00cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95f667b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95f006bb60 0x7f95f006c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95f667b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f015c8a0 con 0x7f95f00c89b0 2023-07-06T21:42:51.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95f667b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f00cce70 con 0x7f95f00c8d80 2023-07-06T21:42:51.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95f667b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f006c540 con 0x7f95f006bb60 2023-07-06T21:42:51.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95ef7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95f00c8d80 0x7f95f00cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95ef7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95f00c8d80 0x7f95f00cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33006/0 (socket says 172.21.15.55:33006) 2023-07-06T21:42:51.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95ef7fe640 1 -- 172.21.15.55:0/2298050781 learned_addr learned my addr 172.21.15.55:0/2298050781 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:51.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95f4c18640 1 --2- 172.21.15.55:0/2298050781 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95f006bb60 0x7f95f006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95ef7fe640 1 -- 172.21.15.55:0/2298050781 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95f006bb60 msgr2=0x7f95f006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:51.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95ef7fe640 1 --2- 172.21.15.55:0/2298050781 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95f006bb60 0x7f95f006c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95ef7fe640 1 -- 172.21.15.55:0/2298050781 >> v1:172.21.15.138:6789/0 conn(0x7f95f00c89b0 legacy=0x7f95f00cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:51.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95ef7fe640 1 -- 172.21.15.55:0/2298050781 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f00cdb70 con 0x7f95f00c8d80 2023-07-06T21:42:51.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.782+0000 7f95f4c18640 1 --2- 172.21.15.55:0/2298050781 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95f006bb60 0x7f95f006c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.786+0000 7f95ef7fe640 1 --2- 172.21.15.55:0/2298050781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f00c8d80 0x7f95f00cbe50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009870 tx=0x7f95e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27d1cbf3de36432 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.786+0000 7f95eeffd640 1 -- 172.21.15.55:0/2298050781 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40ab610 con 0x7f95f00c8d80 2023-07-06T21:42:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.786+0000 7f95eeffd640 1 -- 172.21.15.55:0/2298050781 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e40ab770 con 0x7f95f00c8d80 2023-07-06T21:42:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.786+0000 7f95eeffd640 1 -- 172.21.15.55:0/2298050781 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40abb00 con 0x7f95f00c8d80 2023-07-06T21:42:51.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.786+0000 7f95f667b640 1 -- 172.21.15.55:0/2298050781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f00c8d80 msgr2=0x7f95f00cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.786+0000 7f95f667b640 1 --2- 172.21.15.55:0/2298050781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f00c8d80 0x7f95f00cbe50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009870 tx=0x7f95e401c4d0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.786+0000 7f95f667b640 1 -- 172.21.15.55:0/2298050781 shutdown_connections 2023-07-06T21:42:51.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.786+0000 7f95f667b640 1 --2- 172.21.15.55:0/2298050781 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95f006bb60 0x7f95f006c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.786+0000 7f95f667b640 1 --2- 172.21.15.55:0/2298050781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f00c8d80 0x7f95f00cbe50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.786+0000 7f95f667b640 1 -- 172.21.15.55:0/2298050781 >> 172.21.15.55:0/2298050781 conn(0x7f95f00cded0 msgr2=0x7f95f00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:51.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.786+0000 7f95f667b640 1 -- 172.21.15.55:0/2298050781 shutdown_connections 2023-07-06T21:42:51.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.786+0000 7f95f667b640 1 -- 172.21.15.55:0/2298050781 wait complete. 2023-07-06T21:42:51.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.786+0000 7f95f667b640 1 Processor -- start 2023-07-06T21:42:51.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.786+0000 7f95f667b640 1 -- start start 2023-07-06T21:42:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f667b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95f006bb60 0x7f95f01432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f667b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95f00c89b0 0x7f95f014f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f667b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f00c8d80 0x7f95f014f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f667b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00c4fa0 con 0x7f95f00c8d80 2023-07-06T21:42:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f667b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f015b5e0 con 0x7f95f00c89b0 2023-07-06T21:42:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f667b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f006fa50 con 0x7f95f006bb60 2023-07-06T21:42:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f4c18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f00c8d80 0x7f95f014f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f4c18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f00c8d80 0x7f95f014f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33008/0 (socket says 172.21.15.55:33008) 2023-07-06T21:42:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f4c18640 1 -- 172.21.15.55:0/2715323017 learned_addr learned my addr 172.21.15.55:0/2715323017 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95effff640 1 --2- 172.21.15.55:0/2715323017 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95f006bb60 0x7f95f01432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95ef7fe640 1 --2- 172.21.15.55:0/2715323017 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95f00c89b0 0x7f95f014f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f4c18640 1 -- 172.21.15.55:0/2715323017 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95f006bb60 msgr2=0x7f95f01432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f4c18640 1 --2- 172.21.15.55:0/2715323017 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95f006bb60 0x7f95f01432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f4c18640 1 -- 172.21.15.55:0/2715323017 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95f00c89b0 msgr2=0x7f95f014f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f4c18640 1 --2- 172.21.15.55:0/2715323017 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95f00c89b0 0x7f95f014f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f4c18640 1 -- 172.21.15.55:0/2715323017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e40094d0 con 0x7f95f00c8d80 2023-07-06T21:42:51.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f4c18640 1 --2- 172.21.15.55:0/2715323017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f00c8d80 0x7f95f014f660 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f95e800cd80 tx=0x7f95e800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:51.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95ecff9640 1 -- 172.21.15.55:0/2715323017 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800f680 con 0x7f95f00c8d80 2023-07-06T21:42:51.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95ecff9640 1 -- 172.21.15.55:0/2715323017 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e800f800 con 0x7f95f00c8d80 2023-07-06T21:42:51.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95ecff9640 1 -- 172.21.15.55:0/2715323017 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800fbb0 con 0x7f95f00c8d80 2023-07-06T21:42:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f667b640 1 -- 172.21.15.55:0/2715323017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f0158850 con 0x7f95f00c8d80 2023-07-06T21:42:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f667b640 1 -- 172.21.15.55:0/2715323017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f006fca0 con 0x7f95f00c8d80 2023-07-06T21:42:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.790+0000 7f95f667b640 1 -- 172.21.15.55:0/2715323017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f0158d70 con 0x7f95f00c8d80 2023-07-06T21:42:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.794+0000 7f95ecff9640 1 -- 172.21.15.55:0/2715323017 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95e800b040 con 0x7f95f00c8d80 2023-07-06T21:42:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.794+0000 7f95ecff9640 1 --2- 172.21.15.55:0/2715323017 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95dc066280 0x7f95dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.794+0000 7f95ecff9640 1 -- 172.21.15.55:0/2715323017 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f95e80848f0 con 0x7f95f00c8d80 2023-07-06T21:42:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.794+0000 7f95effff640 1 --2- 172.21.15.55:0/2715323017 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95dc066280 0x7f95dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.794+0000 7f95effff640 1 --2- 172.21.15.55:0/2715323017 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95dc066280 0x7f95dc068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f95e0007fd0 tx=0x7f95e0007e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.798+0000 7f95ecff9640 1 -- 172.21.15.55:0/2715323017 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95e8051ae0 con 0x7f95f00c8d80 2023-07-06T21:42:51.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.954+0000 7f95f667b640 1 -- 172.21.15.55:0/2715323017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95f006fe90 con 0x7f95f00c8d80 2023-07-06T21:42:51.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.954+0000 7f95ecff9640 1 -- 172.21.15.55:0/2715323017 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f95e8055100 con 0x7f95f00c8d80 2023-07-06T21:42:51.961 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:51.961 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":29,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:51.480379+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:51.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.954+0000 7f95f667b640 1 -- 172.21.15.55:0/2715323017 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95dc066280 msgr2=0x7f95dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.954+0000 7f95f667b640 1 --2- 172.21.15.55:0/2715323017 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95dc066280 0x7f95dc068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f95e0007fd0 tx=0x7f95e0007e40 comp rx=0 tx=0).stop 2023-07-06T21:42:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.954+0000 7f95f667b640 1 -- 172.21.15.55:0/2715323017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f00c8d80 msgr2=0x7f95f014f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.954+0000 7f95f667b640 1 --2- 172.21.15.55:0/2715323017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f00c8d80 0x7f95f014f660 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f95e800cd80 tx=0x7f95e800a650 comp rx=0 tx=0).stop 2023-07-06T21:42:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.954+0000 7f95f667b640 1 -- 172.21.15.55:0/2715323017 shutdown_connections 2023-07-06T21:42:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.954+0000 7f95f667b640 1 --2- 172.21.15.55:0/2715323017 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f95dc066280 0x7f95dc068730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.954+0000 7f95f667b640 1 --2- 172.21.15.55:0/2715323017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f00c8d80 0x7f95f014f660 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.954+0000 7f95f667b640 1 --2- 172.21.15.55:0/2715323017 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95f00c89b0 0x7f95f014f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.954+0000 7f95f667b640 1 --2- 172.21.15.55:0/2715323017 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95f006bb60 0x7f95f01432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:51.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.954+0000 7f95f667b640 1 -- 172.21.15.55:0/2715323017 >> 172.21.15.55:0/2715323017 conn(0x7f95f00cded0 msgr2=0x7f95f00ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:51.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.954+0000 7f95f667b640 1 -- 172.21.15.55:0/2715323017 shutdown_connections 2023-07-06T21:42:51.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:51.954+0000 7f95f667b640 1 -- 172.21.15.55:0/2715323017 wait complete. 2023-07-06T21:42:51.983 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:42:08.597013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:42:09.843890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T21:42:12.918111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T21:42:51.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:42:52.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca4b219640 1 Processor -- start 2023-07-06T21:42:52.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca4b219640 1 -- start start 2023-07-06T21:42:52.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca4b219640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca4415b850 0x7fca440cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca4b219640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca440ccd30 0x7fca440b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca4b219640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440b4210 con 0x7fca440b3db0 2023-07-06T21:42:52.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca4b219640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca440b2b80 con 0x7fca4415b850 2023-07-06T21:42:52.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca4b219640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440cff30 con 0x7fca440ccd30 2023-07-06T21:42:52.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca48fb5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca4415b850 0x7fca440cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca48fb5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca4415b850 0x7fca440cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33018/0 (socket says 172.21.15.55:33018) 2023-07-06T21:42:52.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca48fb5640 1 -- 172.21.15.55:0/219137068 learned_addr learned my addr 172.21.15.55:0/219137068 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:52.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca43fff640 1 --2- 172.21.15.55:0/219137068 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca440ccd30 0x7fca440b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca48fb5640 1 -- 172.21.15.55:0/219137068 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca440ccd30 msgr2=0x7fca440b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:52.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca48fb5640 1 --2- 172.21.15.55:0/219137068 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca440ccd30 0x7fca440b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca48fb5640 1 -- 172.21.15.55:0/219137068 >> v1:172.21.15.138:6789/0 conn(0x7fca440b3db0 legacy=0x7fca4415f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.122+0000 7fca48fb5640 1 -- 172.21.15.55:0/219137068 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440b22e0 con 0x7fca4415b850 2023-07-06T21:42:52.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.126+0000 7fca48fb5640 1 --2- 172.21.15.55:0/219137068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca4415b850 0x7fca440cc7f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fca38009870 tx=0x7fca3801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fff84d5c0d6acce server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:52.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.126+0000 7fca437fe640 1 -- 172.21.15.55:0/219137068 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca380ab5f0 con 0x7fca4415b850 2023-07-06T21:42:52.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.126+0000 7fca437fe640 1 -- 172.21.15.55:0/219137068 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca380ab750 con 0x7fca4415b850 2023-07-06T21:42:52.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.126+0000 7fca437fe640 1 -- 172.21.15.55:0/219137068 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca380abae0 con 0x7fca4415b850 2023-07-06T21:42:52.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.126+0000 7fca4b219640 1 -- 172.21.15.55:0/219137068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca4415b850 msgr2=0x7fca440cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.126+0000 7fca4b219640 1 --2- 172.21.15.55:0/219137068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca4415b850 0x7fca440cc7f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fca38009870 tx=0x7fca3801c3f0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.126+0000 7fca4b219640 1 -- 172.21.15.55:0/219137068 shutdown_connections 2023-07-06T21:42:52.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.126+0000 7fca4b219640 1 --2- 172.21.15.55:0/219137068 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca440ccd30 0x7fca440b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.126+0000 7fca4b219640 1 --2- 172.21.15.55:0/219137068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca4415b850 0x7fca440cc7f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.126+0000 7fca4b219640 1 -- 172.21.15.55:0/219137068 >> 172.21.15.55:0/219137068 conn(0x7fca440cec20 msgr2=0x7fca440cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:52.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.126+0000 7fca4b219640 1 -- 172.21.15.55:0/219137068 shutdown_connections 2023-07-06T21:42:52.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.126+0000 7fca4b219640 1 -- 172.21.15.55:0/219137068 wait complete. 2023-07-06T21:42:52.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca4b219640 1 Processor -- start 2023-07-06T21:42:52.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca4b219640 1 -- start start 2023-07-06T21:42:52.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca4b219640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca440b3db0 0x7fca4415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca4b219640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca440ccd30 0x7fca44156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca4b219640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca4415b850 0x7fca44151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca4b219640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca44152f50 con 0x7fca440ccd30 2023-07-06T21:42:52.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca4b219640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4415a1f0 con 0x7fca4415b850 2023-07-06T21:42:52.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca4b219640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca44152900 con 0x7fca440b3db0 2023-07-06T21:42:52.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca43fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca440ccd30 0x7fca44156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca43fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca440ccd30 0x7fca44156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33032/0 (socket says 172.21.15.55:33032) 2023-07-06T21:42:52.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca43fff640 1 -- 172.21.15.55:0/1718406618 learned_addr learned my addr 172.21.15.55:0/1718406618 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:52.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca497b6640 1 --2- 172.21.15.55:0/1718406618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca4415b850 0x7fca44151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca48fb5640 1 --2- 172.21.15.55:0/1718406618 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca440b3db0 0x7fca4415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca43fff640 1 -- 172.21.15.55:0/1718406618 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca440b3db0 msgr2=0x7fca4415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca43fff640 1 --2- 172.21.15.55:0/1718406618 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca440b3db0 0x7fca4415aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca43fff640 1 -- 172.21.15.55:0/1718406618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca4415b850 msgr2=0x7fca44151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca43fff640 1 --2- 172.21.15.55:0/1718406618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca4415b850 0x7fca44151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca43fff640 1 -- 172.21.15.55:0/1718406618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca380094d0 con 0x7fca440ccd30 2023-07-06T21:42:52.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca43fff640 1 --2- 172.21.15.55:0/1718406618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca440ccd30 0x7fca44156b20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca3000e900 tx=0x7fca3000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:52.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca417fa640 1 -- 172.21.15.55:0/1718406618 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca30009690 con 0x7fca440ccd30 2023-07-06T21:42:52.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca417fa640 1 -- 172.21.15.55:0/1718406618 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3000ca00 con 0x7fca440ccd30 2023-07-06T21:42:52.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca417fa640 1 -- 172.21.15.55:0/1718406618 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3000cdb0 con 0x7fca440ccd30 2023-07-06T21:42:52.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca4b219640 1 -- 172.21.15.55:0/1718406618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4415bda0 con 0x7fca440ccd30 2023-07-06T21:42:52.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.130+0000 7fca4b219640 1 -- 172.21.15.55:0/1718406618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4415a4d0 con 0x7fca440ccd30 2023-07-06T21:42:52.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.134+0000 7fca4b219640 1 -- 172.21.15.55:0/1718406618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca44066d60 con 0x7fca440ccd30 2023-07-06T21:42:52.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.134+0000 7fca417fa640 1 -- 172.21.15.55:0/1718406618 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca30013470 con 0x7fca440ccd30 2023-07-06T21:42:52.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.134+0000 7fca417fa640 1 --2- 172.21.15.55:0/1718406618 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fca280662b0 0x7fca28068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.134+0000 7fca417fa640 1 -- 172.21.15.55:0/1718406618 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fca30084230 con 0x7fca440ccd30 2023-07-06T21:42:52.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.134+0000 7fca48fb5640 1 --2- 172.21.15.55:0/1718406618 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fca280662b0 0x7fca28068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.134+0000 7fca48fb5640 1 --2- 172.21.15.55:0/1718406618 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fca280662b0 0x7fca28068760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fca380af000 tx=0x7fca380b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:52.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.138+0000 7fca417fa640 1 -- 172.21.15.55:0/1718406618 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fca30051390 con 0x7fca440ccd30 2023-07-06T21:42:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.294+0000 7fca4b219640 1 -- 172.21.15.55:0/1718406618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca440b3420 con 0x7fca440ccd30 2023-07-06T21:42:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.294+0000 7fca417fa640 1 -- 172.21.15.55:0/1718406618 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca300549b0 con 0x7fca440ccd30 2023-07-06T21:42:52.302 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:42:52.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.298+0000 7fca4b219640 1 -- 172.21.15.55:0/1718406618 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fca280662b0 msgr2=0x7fca28068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.298+0000 7fca4b219640 1 --2- 172.21.15.55:0/1718406618 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fca280662b0 0x7fca28068760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fca380af000 tx=0x7fca380b6040 comp rx=0 tx=0).stop 2023-07-06T21:42:52.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.298+0000 7fca4b219640 1 -- 172.21.15.55:0/1718406618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca440ccd30 msgr2=0x7fca44156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.298+0000 7fca4b219640 1 --2- 172.21.15.55:0/1718406618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca440ccd30 0x7fca44156b20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca3000e900 tx=0x7fca3000edc0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.298+0000 7fca4b219640 1 -- 172.21.15.55:0/1718406618 shutdown_connections 2023-07-06T21:42:52.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.298+0000 7fca4b219640 1 --2- 172.21.15.55:0/1718406618 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fca280662b0 0x7fca28068760 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.298+0000 7fca4b219640 1 --2- 172.21.15.55:0/1718406618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca4415b850 0x7fca44151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.298+0000 7fca4b219640 1 --2- 172.21.15.55:0/1718406618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca440ccd30 0x7fca44156b20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.298+0000 7fca4b219640 1 --2- 172.21.15.55:0/1718406618 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca440b3db0 0x7fca4415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.298+0000 7fca4b219640 1 -- 172.21.15.55:0/1718406618 >> 172.21.15.55:0/1718406618 conn(0x7fca440cec20 msgr2=0x7fca441541a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.298+0000 7fca4b219640 1 -- 172.21.15.55:0/1718406618 shutdown_connections 2023-07-06T21:42:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.298+0000 7fca4b219640 1 -- 172.21.15.55:0/1718406618 wait complete. 2023-07-06T21:42:52.323 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:42:52.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.462+0000 7f1a54ba9640 1 Processor -- start 2023-07-06T21:42:52.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.462+0000 7f1a54ba9640 1 -- start start 2023-07-06T21:42:52.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.466+0000 7f1a54ba9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a500b1250 0x7f1a5015f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.466+0000 7f1a54ba9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1a500ce200 0x7f1a500ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.466+0000 7f1a54ba9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a500cc740 con 0x7f1a500d0630 2023-07-06T21:42:52.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.466+0000 7f1a54ba9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a500ccc90 con 0x7f1a500b1250 2023-07-06T21:42:52.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.466+0000 7f1a54ba9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a500b29c0 con 0x7f1a500ce200 2023-07-06T21:42:52.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.466+0000 7f1a4f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a500b1250 0x7f1a5015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.466+0000 7f1a4f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a500b1250 0x7f1a5015f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33042/0 (socket says 172.21.15.55:33042) 2023-07-06T21:42:52.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.466+0000 7f1a4f7fe640 1 -- 172.21.15.55:0/1010112313 learned_addr learned my addr 172.21.15.55:0/1010112313 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:52.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.466+0000 7f1a4ffff640 1 --2- 172.21.15.55:0/1010112313 >> v2:172.21.15.138:3300/0 conn(0x7f1a500ce200 0x7f1a500ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.466+0000 7f1a4f7fe640 1 -- 172.21.15.55:0/1010112313 >> v2:172.21.15.138:3300/0 conn(0x7f1a500ce200 msgr2=0x7f1a500ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:52.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.466+0000 7f1a4f7fe640 1 --2- 172.21.15.55:0/1010112313 >> v2:172.21.15.138:3300/0 conn(0x7f1a500ce200 0x7f1a500ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.466+0000 7f1a4f7fe640 1 -- 172.21.15.55:0/1010112313 >> v1:172.21.15.138:6789/0 conn(0x7f1a500d0630 legacy=0x7f1a5015f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:52.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.466+0000 7f1a4f7fe640 1 -- 172.21.15.55:0/1010112313 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a500d1d10 con 0x7f1a500b1250 2023-07-06T21:42:52.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.466+0000 7f1a4ffff640 1 --2- 172.21.15.55:0/1010112313 >> v2:172.21.15.138:3300/0 conn(0x7f1a500ce200 0x7f1a500ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:52.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.470+0000 7f1a4f7fe640 1 --2- 172.21.15.55:0/1010112313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a500b1250 0x7f1a5015f380 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1a500cdc70 tx=0x7f1a4001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7357a6c931e561a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:52.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.470+0000 7f1a4e7fc640 1 -- 172.21.15.55:0/1010112313 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a400ac410 con 0x7f1a500b1250 2023-07-06T21:42:52.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.470+0000 7f1a4e7fc640 1 -- 172.21.15.55:0/1010112313 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a400ac570 con 0x7f1a500b1250 2023-07-06T21:42:52.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.470+0000 7f1a4e7fc640 1 -- 172.21.15.55:0/1010112313 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a400ac700 con 0x7f1a500b1250 2023-07-06T21:42:52.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.470+0000 7f1a54ba9640 1 -- 172.21.15.55:0/1010112313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a500b1250 msgr2=0x7f1a5015f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.470+0000 7f1a54ba9640 1 --2- 172.21.15.55:0/1010112313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a500b1250 0x7f1a5015f380 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1a500cdc70 tx=0x7f1a4001c4c0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.470+0000 7f1a54ba9640 1 -- 172.21.15.55:0/1010112313 shutdown_connections 2023-07-06T21:42:52.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.470+0000 7f1a54ba9640 1 --2- 172.21.15.55:0/1010112313 >> v2:172.21.15.138:3300/0 conn(0x7f1a500ce200 0x7f1a500ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.470+0000 7f1a54ba9640 1 --2- 172.21.15.55:0/1010112313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a500b1250 0x7f1a5015f380 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.470+0000 7f1a54ba9640 1 -- 172.21.15.55:0/1010112313 >> 172.21.15.55:0/1010112313 conn(0x7f1a500b3b60 msgr2=0x7f1a500b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:52.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.470+0000 7f1a54ba9640 1 -- 172.21.15.55:0/1010112313 shutdown_connections 2023-07-06T21:42:52.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.470+0000 7f1a54ba9640 1 -- 172.21.15.55:0/1010112313 wait complete. 2023-07-06T21:42:52.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.470+0000 7f1a54ba9640 1 Processor -- start 2023-07-06T21:42:52.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.470+0000 7f1a54ba9640 1 -- start start 2023-07-06T21:42:52.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a54ba9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a500b1250 0x7f1a5014ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a54ba9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a500ce200 0x7f1a501f70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a54ba9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a500d0630 0x7f1a500ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a54ba9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a501f79f0 con 0x7f1a500b1250 2023-07-06T21:42:52.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a54ba9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a501f7cd0 con 0x7f1a500ce200 2023-07-06T21:42:52.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a54ba9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a501f7fb0 con 0x7f1a500d0630 2023-07-06T21:42:52.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a4f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a500b1250 0x7f1a5014ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a4f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a500b1250 0x7f1a5014ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33050/0 (socket says 172.21.15.55:33050) 2023-07-06T21:42:52.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a4f7fe640 1 -- 172.21.15.55:0/2446114322 learned_addr learned my addr 172.21.15.55:0/2446114322 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:52.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a4effd640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a500ce200 0x7f1a501f70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a4ffff640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a500d0630 0x7f1a500ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a4f7fe640 1 -- 172.21.15.55:0/2446114322 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a500d0630 msgr2=0x7f1a500ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a4f7fe640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a500d0630 0x7f1a500ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a4f7fe640 1 -- 172.21.15.55:0/2446114322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a500ce200 msgr2=0x7f1a501f70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a4f7fe640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a500ce200 0x7f1a501f70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a4f7fe640 1 -- 172.21.15.55:0/2446114322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a400094d0 con 0x7f1a500b1250 2023-07-06T21:42:52.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a4effd640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a500ce200 0x7f1a501f70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:52.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a4ffff640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a500d0630 0x7f1a500ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:52.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a4f7fe640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a500b1250 0x7f1a5014ffe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1a400af040 tx=0x7f1a40019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:52.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a37fff640 1 -- 172.21.15.55:0/2446114322 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a400ace20 con 0x7f1a500b1250 2023-07-06T21:42:52.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a37fff640 1 -- 172.21.15.55:0/2446114322 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a400b5630 con 0x7f1a500b1250 2023-07-06T21:42:52.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a37fff640 1 -- 172.21.15.55:0/2446114322 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a400b59e0 con 0x7f1a500b1250 2023-07-06T21:42:52.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a54ba9640 1 -- 172.21.15.55:0/2446114322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5015d450 con 0x7f1a500b1250 2023-07-06T21:42:52.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a54ba9640 1 -- 172.21.15.55:0/2446114322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a50150520 con 0x7f1a500b1250 2023-07-06T21:42:52.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a54ba9640 1 -- 172.21.15.55:0/2446114322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5015d970 con 0x7f1a500b1250 2023-07-06T21:42:52.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.474+0000 7f1a37fff640 1 -- 172.21.15.55:0/2446114322 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a400b3070 con 0x7f1a500b1250 2023-07-06T21:42:52.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.478+0000 7f1a37fff640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1a3c066280 0x7f1a3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.478+0000 7f1a37fff640 1 -- 172.21.15.55:0/2446114322 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1a4011e6c0 con 0x7f1a500b1250 2023-07-06T21:42:52.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.478+0000 7f1a4effd640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1a3c066280 0x7f1a3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.478+0000 7f1a4effd640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1a3c066280 0x7f1a3c068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1a5015ecf0 tx=0x7f1a44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:52.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.482+0000 7f1a37fff640 1 -- 172.21.15.55:0/2446114322 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a400eb800 con 0x7f1a500b1250 2023-07-06T21:42:52.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.634+0000 7f1a54ba9640 1 -- 172.21.15.55:0/2446114322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1a5004d790 con 0x7f1a500b1250 2023-07-06T21:42:52.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.634+0000 7f1a37fff640 1 -- 172.21.15.55:0/2446114322 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1a400eee20 con 0x7f1a500b1250 2023-07-06T21:42:52.643 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:42:52.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.638+0000 7f1a54ba9640 1 -- 172.21.15.55:0/2446114322 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1a3c066280 msgr2=0x7f1a3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.638+0000 7f1a54ba9640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1a3c066280 0x7f1a3c068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1a5015ecf0 tx=0x7f1a44009040 comp rx=0 tx=0).stop 2023-07-06T21:42:52.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.638+0000 7f1a54ba9640 1 -- 172.21.15.55:0/2446114322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a500b1250 msgr2=0x7f1a5014ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.638+0000 7f1a54ba9640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a500b1250 0x7f1a5014ffe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1a400af040 tx=0x7f1a40019260 comp rx=0 tx=0).stop 2023-07-06T21:42:52.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.638+0000 7f1a54ba9640 1 -- 172.21.15.55:0/2446114322 shutdown_connections 2023-07-06T21:42:52.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.638+0000 7f1a54ba9640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1a3c066280 0x7f1a3c068730 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.638+0000 7f1a54ba9640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a500d0630 0x7f1a500ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.638+0000 7f1a54ba9640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a500ce200 0x7f1a501f70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.638+0000 7f1a54ba9640 1 --2- 172.21.15.55:0/2446114322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a500b1250 0x7f1a5014ffe0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.638+0000 7f1a54ba9640 1 -- 172.21.15.55:0/2446114322 >> 172.21.15.55:0/2446114322 conn(0x7f1a500b3b60 msgr2=0x7f1a500b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:52.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.638+0000 7f1a54ba9640 1 -- 172.21.15.55:0/2446114322 shutdown_connections 2023-07-06T21:42:52.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.638+0000 7f1a54ba9640 1 -- 172.21.15.55:0/2446114322 wait complete. 2023-07-06T21:42:52.663 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:42:52.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.802+0000 7fc54ec6d640 1 Processor -- start 2023-07-06T21:42:52.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.802+0000 7fc54ec6d640 1 -- start start 2023-07-06T21:42:52.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.806+0000 7fc54ec6d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc548156180 0x7fc5480ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.806+0000 7fc54ec6d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc54806e9d0 0x7fc54806ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.806+0000 7fc54ec6d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54815f5d0 con 0x7fc5480cb7a0 2023-07-06T21:42:52.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.806+0000 7fc54ec6d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc548160250 con 0x7fc548156180 2023-07-06T21:42:52.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.806+0000 7fc54ec6d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54806f390 con 0x7fc54806e9d0 2023-07-06T21:42:52.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.806+0000 7fc54ca09640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc548156180 0x7fc5480ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.806+0000 7fc54ca09640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc548156180 0x7fc5480ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33054/0 (socket says 172.21.15.55:33054) 2023-07-06T21:42:52.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.806+0000 7fc54ca09640 1 -- 172.21.15.55:0/2013744094 learned_addr learned my addr 172.21.15.55:0/2013744094 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:52.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.806+0000 7fc547fff640 1 --2- 172.21.15.55:0/2013744094 >> v2:172.21.15.138:3300/0 conn(0x7fc54806e9d0 0x7fc54806ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.806+0000 7fc54ca09640 1 -- 172.21.15.55:0/2013744094 >> v2:172.21.15.138:3300/0 conn(0x7fc54806e9d0 msgr2=0x7fc54806ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:52.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.806+0000 7fc54ca09640 1 --2- 172.21.15.55:0/2013744094 >> v2:172.21.15.138:3300/0 conn(0x7fc54806e9d0 0x7fc54806ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.806+0000 7fc54ca09640 1 -- 172.21.15.55:0/2013744094 >> v1:172.21.15.55:6789/0 conn(0x7fc5480cb7a0 legacy=0x7fc5480cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.806+0000 7fc54ca09640 1 -- 172.21.15.55:0/2013744094 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54815f8b0 con 0x7fc548156180 2023-07-06T21:42:52.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ca09640 1 --2- 172.21.15.55:0/2013744094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc548156180 0x7fc5480ca610 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc5480cef40 tx=0x7fc53c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3dec0df9b216ba server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:52.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc5477fe640 1 -- 172.21.15.55:0/2013744094 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c0ab640 con 0x7fc548156180 2023-07-06T21:42:52.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc5477fe640 1 -- 172.21.15.55:0/2013744094 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c0a7070 con 0x7fc548156180 2023-07-06T21:42:52.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc5477fe640 1 -- 172.21.15.55:0/2013744094 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c0ab9c0 con 0x7fc548156180 2023-07-06T21:42:52.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 -- 172.21.15.55:0/2013744094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc548156180 msgr2=0x7fc5480ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 --2- 172.21.15.55:0/2013744094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc548156180 0x7fc5480ca610 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc5480cef40 tx=0x7fc53c01c440 comp rx=0 tx=0).stop 2023-07-06T21:42:52.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 -- 172.21.15.55:0/2013744094 shutdown_connections 2023-07-06T21:42:52.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 --2- 172.21.15.55:0/2013744094 >> v2:172.21.15.138:3300/0 conn(0x7fc54806e9d0 0x7fc54806ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 --2- 172.21.15.55:0/2013744094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc548156180 0x7fc5480ca610 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 -- 172.21.15.55:0/2013744094 >> 172.21.15.55:0/2013744094 conn(0x7fc5480d0c50 msgr2=0x7fc5480cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:52.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 -- 172.21.15.55:0/2013744094 shutdown_connections 2023-07-06T21:42:52.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 -- 172.21.15.55:0/2013744094 wait complete. 2023-07-06T21:42:52.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 Processor -- start 2023-07-06T21:42:52.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 -- start start 2023-07-06T21:42:52.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc54806e9d0 0x7fc54814d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5480cb7a0 0x7fc5480c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc548156180 0x7fc5480c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480c3af0 con 0x7fc548156180 2023-07-06T21:42:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480afec0 con 0x7fc54806e9d0 2023-07-06T21:42:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.810+0000 7fc54ec6d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480ca090 con 0x7fc5480cb7a0 2023-07-06T21:42:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc54d20a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc548156180 0x7fc5480c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc54ca09640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc54806e9d0 0x7fc54814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc54d20a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc548156180 0x7fc5480c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33058/0 (socket says 172.21.15.55:33058) 2023-07-06T21:42:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc54d20a640 1 -- 172.21.15.55:0/3476450021 learned_addr learned my addr 172.21.15.55:0/3476450021 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc547fff640 1 --2- 172.21.15.55:0/3476450021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5480cb7a0 0x7fc5480c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc54d20a640 1 -- 172.21.15.55:0/3476450021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5480cb7a0 msgr2=0x7fc5480c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc54d20a640 1 --2- 172.21.15.55:0/3476450021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5480cb7a0 0x7fc5480c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc54d20a640 1 -- 172.21.15.55:0/3476450021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc54806e9d0 msgr2=0x7fc54814d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc54d20a640 1 --2- 172.21.15.55:0/3476450021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc54806e9d0 0x7fc54814d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc54d20a640 1 -- 172.21.15.55:0/3476450021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c0094d0 con 0x7fc548156180 2023-07-06T21:42:52.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc54d20a640 1 --2- 172.21.15.55:0/3476450021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc548156180 0x7fc5480c84e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc54000c770 tx=0x7fc54000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:52.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc5457fa640 1 -- 172.21.15.55:0/3476450021 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc540003b80 con 0x7fc548156180 2023-07-06T21:42:52.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc5457fa640 1 -- 172.21.15.55:0/3476450021 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc540003ce0 con 0x7fc548156180 2023-07-06T21:42:52.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc5457fa640 1 -- 172.21.15.55:0/3476450021 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54000aa90 con 0x7fc548156180 2023-07-06T21:42:52.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc54ec6d640 1 -- 172.21.15.55:0/3476450021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5480c9ad0 con 0x7fc548156180 2023-07-06T21:42:52.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc54ec6d640 1 -- 172.21.15.55:0/3476450021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5480afb50 con 0x7fc548156180 2023-07-06T21:42:52.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc54ec6d640 1 -- 172.21.15.55:0/3476450021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5480b0070 con 0x7fc548156180 2023-07-06T21:42:52.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc5457fa640 1 -- 172.21.15.55:0/3476450021 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc54000abf0 con 0x7fc548156180 2023-07-06T21:42:52.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.814+0000 7fc5457fa640 1 --2- 172.21.15.55:0/3476450021 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc52c066280 0x7fc52c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:52.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.818+0000 7fc5457fa640 1 -- 172.21.15.55:0/3476450021 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc540083d60 con 0x7fc548156180 2023-07-06T21:42:52.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.818+0000 7fc54ca09640 1 --2- 172.21.15.55:0/3476450021 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc52c066280 0x7fc52c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:52.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.818+0000 7fc54ca09640 1 --2- 172.21.15.55:0/3476450021 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc52c066280 0x7fc52c068730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0af000 tx=0x7fc53c0b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:52.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.818+0000 7fc5457fa640 1 -- 172.21.15.55:0/3476450021 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc5480b0070 con 0x7fc548156180 2023-07-06T21:42:52.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.974+0000 7fc54ec6d640 1 -- 172.21.15.55:0/3476450021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc5480b0030 con 0x7fc548156180 2023-07-06T21:42:52.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.978+0000 7fc5457fa640 1 -- 172.21.15.55:0/3476450021 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc540050f50 con 0x7fc548156180 2023-07-06T21:42:52.985 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:52.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.978+0000 7fc54ec6d640 1 -- 172.21.15.55:0/3476450021 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc52c066280 msgr2=0x7fc52c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.978+0000 7fc54ec6d640 1 --2- 172.21.15.55:0/3476450021 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc52c066280 0x7fc52c068730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0af000 tx=0x7fc53c0b6040 comp rx=0 tx=0).stop 2023-07-06T21:42:52.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.978+0000 7fc54ec6d640 1 -- 172.21.15.55:0/3476450021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc548156180 msgr2=0x7fc5480c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:52.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.978+0000 7fc54ec6d640 1 --2- 172.21.15.55:0/3476450021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc548156180 0x7fc5480c84e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc54000c770 tx=0x7fc54000cc30 comp rx=0 tx=0).stop 2023-07-06T21:42:52.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.978+0000 7fc54ec6d640 1 -- 172.21.15.55:0/3476450021 shutdown_connections 2023-07-06T21:42:52.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.978+0000 7fc54ec6d640 1 --2- 172.21.15.55:0/3476450021 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc52c066280 0x7fc52c068730 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.978+0000 7fc54ec6d640 1 --2- 172.21.15.55:0/3476450021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc548156180 0x7fc5480c84e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.978+0000 7fc54ec6d640 1 --2- 172.21.15.55:0/3476450021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5480cb7a0 0x7fc5480c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.978+0000 7fc54ec6d640 1 --2- 172.21.15.55:0/3476450021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc54806e9d0 0x7fc54814d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:52.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.978+0000 7fc54ec6d640 1 -- 172.21.15.55:0/3476450021 >> 172.21.15.55:0/3476450021 conn(0x7fc5480d0c50 msgr2=0x7fc54815d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:52.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.978+0000 7fc54ec6d640 1 -- 172.21.15.55:0/3476450021 shutdown_connections 2023-07-06T21:42:52.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:52.978+0000 7fc54ec6d640 1 -- 172.21.15.55:0/3476450021 wait complete. 2023-07-06T21:42:53.004 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:42:53.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.142+0000 7f0b60996640 1 Processor -- start 2023-07-06T21:42:53.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.142+0000 7f0b60996640 1 -- start start 2023-07-06T21:42:53.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.142+0000 7f0b60996640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b5c06f470 0x7f0b5c0c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.142+0000 7f0b60996640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5c070350 con 0x7f0b5c0c9360 2023-07-06T21:42:53.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.142+0000 7f0b60996640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5c158550 con 0x7f0b5c06ff50 2023-07-06T21:42:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.142+0000 7f0b60996640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c9800 con 0x7f0b5c06f470 2023-07-06T21:42:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.142+0000 7f0b53fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0b5c0c9360 0x7f0b5c06f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58346/0 (socket says 172.21.15.55:58346) 2023-07-06T21:42:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.142+0000 7f0b53fff640 1 -- 172.21.15.55:0/682719004 learned_addr learned my addr 172.21.15.55:0/682719004 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:53.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.142+0000 7f0b5a59c640 1 --2- 172.21.15.55:0/682719004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b5c06f470 0x7f0b5c0c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.146+0000 7f0b59d9b640 1 -- 172.21.15.55:0/682719004 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112609524 0 0) 0x7f0b5c070350 con 0x7f0b5c0c9360 2023-07-06T21:42:53.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.146+0000 7f0b59d9b640 1 -- 172.21.15.55:0/682719004 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b48005740 con 0x7f0b5c0c9360 2023-07-06T21:42:53.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.146+0000 7f0b5a59c640 1 -- 172.21.15.55:0/682719004 >> v1:172.21.15.138:6789/0 conn(0x7f0b5c06ff50 legacy=0x7f0b5c0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.146+0000 7f0b5a59c640 1 -- 172.21.15.55:0/682719004 >> v1:172.21.15.55:6789/0 conn(0x7f0b5c0c9360 legacy=0x7f0b5c06f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.146+0000 7f0b59d9b640 1 -- 172.21.15.55:0/682719004 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2678062413 0 0) 0x7f0b48005740 con 0x7f0b5c0c9360 2023-07-06T21:42:53.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.146+0000 7f0b5a59c640 1 -- 172.21.15.55:0/682719004 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c0c9ae0 con 0x7f0b5c06f470 2023-07-06T21:42:53.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.146+0000 7f0b5a59c640 1 --2- 172.21.15.55:0/682719004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b5c06f470 0x7f0b5c0c8e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0097f0 tx=0x7f0b4c01c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab5c6ba853d1152c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:53.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.146+0000 7f0b59d9b640 1 -- 172.21.15.55:0/682719004 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44001680 con 0x7f0b5c06f470 2023-07-06T21:42:53.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.146+0000 7f0b59d9b640 1 -- 172.21.15.55:0/682719004 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c0a7050 con 0x7f0b5c06f470 2023-07-06T21:42:53.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.146+0000 7f0b59d9b640 1 -- 172.21.15.55:0/682719004 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0ab620 con 0x7f0b5c06f470 2023-07-06T21:42:53.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 -- 172.21.15.55:0/682719004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b5c06f470 msgr2=0x7f0b5c0c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 --2- 172.21.15.55:0/682719004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b5c06f470 0x7f0b5c0c8e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0097f0 tx=0x7f0b4c01c3b0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 -- 172.21.15.55:0/682719004 shutdown_connections 2023-07-06T21:42:53.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 --2- 172.21.15.55:0/682719004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b5c06f470 0x7f0b5c0c8e20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 -- 172.21.15.55:0/682719004 >> 172.21.15.55:0/682719004 conn(0x7f0b5c0cea70 msgr2=0x7f0b5c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:53.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 -- 172.21.15.55:0/682719004 shutdown_connections 2023-07-06T21:42:53.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 -- 172.21.15.55:0/682719004 wait complete. 2023-07-06T21:42:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 Processor -- start 2023-07-06T21:42:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 -- start start 2023-07-06T21:42:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b5c06f470 0x7f0b5c0c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b5c06ff50 0x7f0b5c1f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b5c0c9360 0x7f0b5c0ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c1f8700 con 0x7f0b5c0c9360 2023-07-06T21:42:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c7400 con 0x7f0b5c06ff50 2023-07-06T21:42:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b60996640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c6810 con 0x7f0b5c06f470 2023-07-06T21:42:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b5ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b5c0c9360 0x7f0b5c0ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b5ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b5c0c9360 0x7f0b5c0ac7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33068/0 (socket says 172.21.15.55:33068) 2023-07-06T21:42:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b5ad9d640 1 -- 172.21.15.55:0/1640449074 learned_addr learned my addr 172.21.15.55:0/1640449074 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b5a59c640 1 --2- 172.21.15.55:0/1640449074 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b5c06f470 0x7f0b5c0c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b53fff640 1 --2- 172.21.15.55:0/1640449074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b5c06ff50 0x7f0b5c1f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b5ad9d640 1 -- 172.21.15.55:0/1640449074 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b5c06f470 msgr2=0x7f0b5c0c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b5ad9d640 1 --2- 172.21.15.55:0/1640449074 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b5c06f470 0x7f0b5c0c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b5ad9d640 1 -- 172.21.15.55:0/1640449074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b5c06ff50 msgr2=0x7f0b5c1f81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b5ad9d640 1 --2- 172.21.15.55:0/1640449074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b5c06ff50 0x7f0b5c1f81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.150+0000 7f0b5ad9d640 1 -- 172.21.15.55:0/1640449074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c009420 con 0x7f0b5c0c9360 2023-07-06T21:42:53.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.154+0000 7f0b5ad9d640 1 --2- 172.21.15.55:0/1640449074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b5c0c9360 0x7f0b5c0ac7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400c770 tx=0x7f0b5400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:53.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.154+0000 7f0b52ffd640 1 -- 172.21.15.55:0/1640449074 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54003b80 con 0x7f0b5c0c9360 2023-07-06T21:42:53.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.154+0000 7f0b52ffd640 1 -- 172.21.15.55:0/1640449074 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b54003ce0 con 0x7f0b5c0c9360 2023-07-06T21:42:53.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.154+0000 7f0b52ffd640 1 -- 172.21.15.55:0/1640449074 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5400aa90 con 0x7f0b5c0c9360 2023-07-06T21:42:53.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.154+0000 7f0b60996640 1 -- 172.21.15.55:0/1640449074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c0c6ad0 con 0x7f0b5c0c9360 2023-07-06T21:42:53.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.154+0000 7f0b60996640 1 -- 172.21.15.55:0/1640449074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c0c7090 con 0x7f0b5c0c9360 2023-07-06T21:42:53.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.154+0000 7f0b60996640 1 -- 172.21.15.55:0/1640449074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c066d60 con 0x7f0b5c0c9360 2023-07-06T21:42:53.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.154+0000 7f0b52ffd640 1 -- 172.21.15.55:0/1640449074 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b5400abf0 con 0x7f0b5c0c9360 2023-07-06T21:42:53.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.154+0000 7f0b52ffd640 1 --2- 172.21.15.55:0/1640449074 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b3c066280 0x7f0b3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.154+0000 7f0b52ffd640 1 -- 172.21.15.55:0/1640449074 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0b54083cf0 con 0x7f0b5c0c9360 2023-07-06T21:42:53.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.154+0000 7f0b5a59c640 1 --2- 172.21.15.55:0/1640449074 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b3c066280 0x7f0b3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.158+0000 7f0b5a59c640 1 --2- 172.21.15.55:0/1640449074 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b3c066280 0x7f0b3c068730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0ad000 tx=0x7f0b4c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.158+0000 7f0b52ffd640 1 -- 172.21.15.55:0/1640449074 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b54050f60 con 0x7f0b5c0c9360 2023-07-06T21:42:53.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.314+0000 7f0b60996640 1 -- 172.21.15.55:0/1640449074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b5c0c7540 con 0x7f0b5c0c9360 2023-07-06T21:42:53.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.314+0000 7f0b52ffd640 1 -- 172.21.15.55:0/1640449074 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b54054580 con 0x7f0b5c0c9360 2023-07-06T21:42:53.323 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:42:53.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.318+0000 7f0b60996640 1 -- 172.21.15.55:0/1640449074 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b3c066280 msgr2=0x7f0b3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.318+0000 7f0b60996640 1 --2- 172.21.15.55:0/1640449074 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b3c066280 0x7f0b3c068730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0ad000 tx=0x7f0b4c0a6000 comp rx=0 tx=0).stop 2023-07-06T21:42:53.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.318+0000 7f0b60996640 1 -- 172.21.15.55:0/1640449074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b5c0c9360 msgr2=0x7f0b5c0ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.318+0000 7f0b60996640 1 --2- 172.21.15.55:0/1640449074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b5c0c9360 0x7f0b5c0ac7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400c770 tx=0x7f0b5400cc30 comp rx=0 tx=0).stop 2023-07-06T21:42:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.318+0000 7f0b60996640 1 -- 172.21.15.55:0/1640449074 shutdown_connections 2023-07-06T21:42:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.318+0000 7f0b60996640 1 --2- 172.21.15.55:0/1640449074 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b3c066280 0x7f0b3c068730 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.318+0000 7f0b60996640 1 --2- 172.21.15.55:0/1640449074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b5c0c9360 0x7f0b5c0ac7a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.318+0000 7f0b60996640 1 --2- 172.21.15.55:0/1640449074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b5c06ff50 0x7f0b5c1f81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.318+0000 7f0b60996640 1 --2- 172.21.15.55:0/1640449074 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b5c06f470 0x7f0b5c0c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.318+0000 7f0b60996640 1 -- 172.21.15.55:0/1640449074 >> 172.21.15.55:0/1640449074 conn(0x7f0b5c0cea70 msgr2=0x7f0b5c0ae0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.318+0000 7f0b60996640 1 -- 172.21.15.55:0/1640449074 shutdown_connections 2023-07-06T21:42:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.318+0000 7f0b60996640 1 -- 172.21.15.55:0/1640449074 wait complete. 2023-07-06T21:42:53.343 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T21:42:53.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.482+0000 7f7a02c9c640 1 Processor -- start 2023-07-06T21:42:53.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.482+0000 7f7a02c9c640 1 -- start start 2023-07-06T21:42:53.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.482+0000 7f7a02c9c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f79fc158850 0x7f79fc0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.486+0000 7f7a02c9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79fc070af0 0x7f79fc0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.486+0000 7f7a02c9c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79fc158c20 con 0x7f79fc0ca130 2023-07-06T21:42:53.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.486+0000 7f7a02c9c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79fc0b2aa0 con 0x7f79fc158850 2023-07-06T21:42:53.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.486+0000 7f7a02c9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0c8db0 con 0x7f79fc070af0 2023-07-06T21:42:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.486+0000 7f79fbfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f79fc0ca130 0x7f79fc0703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32974/0 (socket says 172.21.15.55:32974) 2023-07-06T21:42:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.486+0000 7f79fbfff640 1 -- 172.21.15.55:0/800190252 learned_addr learned my addr 172.21.15.55:0/800190252 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.486+0000 7f7a01239640 1 --2- 172.21.15.55:0/800190252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79fc070af0 0x7f79fc0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.486+0000 7f7a00a38640 1 --2- 172.21.15.55:0/800190252 >> v2:172.21.15.138:3300/0 conn(0x7f79fc158850 0x7f79fc0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.486+0000 7f7a01239640 1 -- 172.21.15.55:0/800190252 >> v2:172.21.15.138:3300/0 conn(0x7f79fc158850 msgr2=0x7f79fc0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.486+0000 7f7a01239640 1 --2- 172.21.15.55:0/800190252 >> v2:172.21.15.138:3300/0 conn(0x7f79fc158850 0x7f79fc0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.486+0000 7f79fb7fe640 1 -- 172.21.15.55:0/800190252 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752659031 0 0) 0x7f79fc158c20 con 0x7f79fc0ca130 2023-07-06T21:42:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.486+0000 7f7a01239640 1 -- 172.21.15.55:0/800190252 >> v1:172.21.15.55:6789/0 conn(0x7f79fc0ca130 legacy=0x7f79fc0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.486+0000 7f7a01239640 1 -- 172.21.15.55:0/800190252 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc0c9090 con 0x7f79fc070af0 2023-07-06T21:42:53.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.486+0000 7f7a01239640 1 --2- 172.21.15.55:0/800190252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79fc070af0 0x7f79fc0ccf70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009d90 tx=0x7f79f401f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f69b6b1cd0d9ffb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f79fb7fe640 1 -- 172.21.15.55:0/800190252 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40af600 con 0x7f79fc070af0 2023-07-06T21:42:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f79fb7fe640 1 -- 172.21.15.55:0/800190252 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f40ab050 con 0x7f79fc070af0 2023-07-06T21:42:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f79fb7fe640 1 -- 172.21.15.55:0/800190252 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40af980 con 0x7f79fc070af0 2023-07-06T21:42:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 -- 172.21.15.55:0/800190252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79fc070af0 msgr2=0x7f79fc0ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 --2- 172.21.15.55:0/800190252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79fc070af0 0x7f79fc0ccf70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009d90 tx=0x7f79f401f130 comp rx=0 tx=0).stop 2023-07-06T21:42:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 -- 172.21.15.55:0/800190252 shutdown_connections 2023-07-06T21:42:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 --2- 172.21.15.55:0/800190252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79fc070af0 0x7f79fc0ccf70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 --2- 172.21.15.55:0/800190252 >> v2:172.21.15.138:3300/0 conn(0x7f79fc158850 0x7f79fc0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 -- 172.21.15.55:0/800190252 >> 172.21.15.55:0/800190252 conn(0x7f79fc0cea70 msgr2=0x7f79fc0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:53.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 -- 172.21.15.55:0/800190252 shutdown_connections 2023-07-06T21:42:53.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 -- 172.21.15.55:0/800190252 wait complete. 2023-07-06T21:42:53.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 Processor -- start 2023-07-06T21:42:53.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 -- start start 2023-07-06T21:42:53.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79fc070af0 0x7f79fc1e3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79fc0ca130 0x7f79fc155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79fc158850 0x7f79fc1f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc156720 con 0x7f79fc158850 2023-07-06T21:42:53.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc06ace0 con 0x7f79fc0ca130 2023-07-06T21:42:53.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.490+0000 7f7a02c9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc1dee70 con 0x7f79fc070af0 2023-07-06T21:42:53.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f7a01239640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79fc158850 0x7f79fc1f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f7a00a38640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79fc070af0 0x7f79fc1e3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f79fbfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79fc0ca130 0x7f79fc155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f7a01239640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79fc158850 0x7f79fc1f1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41410/0 (socket says 172.21.15.55:41410) 2023-07-06T21:42:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f7a01239640 1 -- 172.21.15.55:0/1435752136 learned_addr learned my addr 172.21.15.55:0/1435752136 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f7a01239640 1 -- 172.21.15.55:0/1435752136 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79fc070af0 msgr2=0x7f79fc1e3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f7a01239640 1 --2- 172.21.15.55:0/1435752136 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79fc070af0 0x7f79fc1e3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f7a01239640 1 -- 172.21.15.55:0/1435752136 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79fc0ca130 msgr2=0x7f79fc155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f7a01239640 1 --2- 172.21.15.55:0/1435752136 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79fc0ca130 0x7f79fc155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f7a01239640 1 -- 172.21.15.55:0/1435752136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f4009a70 con 0x7f79fc158850 2023-07-06T21:42:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f7a01239640 1 --2- 172.21.15.55:0/1435752136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79fc158850 0x7f79fc1f1fb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f79f40b2040 tx=0x7f79f401bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:53.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f79f97fa640 1 -- 172.21.15.55:0/1435752136 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4009450 con 0x7f79fc158850 2023-07-06T21:42:53.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f79f97fa640 1 -- 172.21.15.55:0/1435752136 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f40b9410 con 0x7f79fc158850 2023-07-06T21:42:53.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f7a02c9c640 1 -- 172.21.15.55:0/1435752136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79fc069f30 con 0x7f79fc158850 2023-07-06T21:42:53.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f79f97fa640 1 -- 172.21.15.55:0/1435752136 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40b97c0 con 0x7f79fc158850 2023-07-06T21:42:53.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f7a02c9c640 1 -- 172.21.15.55:0/1435752136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79fc06a4f0 con 0x7f79fc158850 2023-07-06T21:42:53.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.494+0000 7f7a02c9c640 1 -- 172.21.15.55:0/1435752136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79fc06aea0 con 0x7f79fc158850 2023-07-06T21:42:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.498+0000 7f79f97fa640 1 -- 172.21.15.55:0/1435752136 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f79f40b6050 con 0x7f79fc158850 2023-07-06T21:42:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.498+0000 7f79f97fa640 1 --2- 172.21.15.55:0/1435752136 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f79e0066280 0x7f79e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.498+0000 7f79f97fa640 1 -- 172.21.15.55:0/1435752136 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f79f4122440 con 0x7f79fc158850 2023-07-06T21:42:53.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.498+0000 7f7a00a38640 1 --2- 172.21.15.55:0/1435752136 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f79e0066280 0x7f79e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.498+0000 7f7a00a38640 1 --2- 172.21.15.55:0/1435752136 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f79e0066280 0x7f79e0068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f79fc06ff10 tx=0x7f79f0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.502+0000 7f79f97fa640 1 -- 172.21.15.55:0/1435752136 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79f40ef750 con 0x7f79fc158850 2023-07-06T21:42:53.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.654+0000 7f7a02c9c640 1 -- 172.21.15.55:0/1435752136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f79fc066d60 con 0x7f79fc158850 2023-07-06T21:42:53.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.654+0000 7f79f97fa640 1 -- 172.21.15.55:0/1435752136 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f79f40f2d70 con 0x7f79fc158850 2023-07-06T21:42:53.663 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:53.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.658+0000 7f7a02c9c640 1 -- 172.21.15.55:0/1435752136 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f79e0066280 msgr2=0x7f79e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.658+0000 7f7a02c9c640 1 --2- 172.21.15.55:0/1435752136 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f79e0066280 0x7f79e0068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f79fc06ff10 tx=0x7f79f0009190 comp rx=0 tx=0).stop 2023-07-06T21:42:53.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.658+0000 7f7a02c9c640 1 -- 172.21.15.55:0/1435752136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79fc158850 msgr2=0x7f79fc1f1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.658+0000 7f7a02c9c640 1 --2- 172.21.15.55:0/1435752136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79fc158850 0x7f79fc1f1fb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f79f40b2040 tx=0x7f79f401bed0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.658+0000 7f7a02c9c640 1 -- 172.21.15.55:0/1435752136 shutdown_connections 2023-07-06T21:42:53.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.658+0000 7f7a02c9c640 1 --2- 172.21.15.55:0/1435752136 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f79e0066280 0x7f79e0068730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.658+0000 7f7a02c9c640 1 --2- 172.21.15.55:0/1435752136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79fc158850 0x7f79fc1f1fb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.658+0000 7f7a02c9c640 1 --2- 172.21.15.55:0/1435752136 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79fc0ca130 0x7f79fc155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.658+0000 7f7a02c9c640 1 --2- 172.21.15.55:0/1435752136 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79fc070af0 0x7f79fc1e3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.658+0000 7f7a02c9c640 1 -- 172.21.15.55:0/1435752136 >> 172.21.15.55:0/1435752136 conn(0x7f79fc0cea70 msgr2=0x7f79fc0b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:53.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.658+0000 7f7a02c9c640 1 -- 172.21.15.55:0/1435752136 shutdown_connections 2023-07-06T21:42:53.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.658+0000 7f7a02c9c640 1 -- 172.21.15.55:0/1435752136 wait complete. 2023-07-06T21:42:53.685 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:53.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f2161e9c640 1 Processor -- start 2023-07-06T21:42:53.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f2161e9c640 1 -- start start 2023-07-06T21:42:53.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f2161e9c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f215c158400 0x7f215c0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f2161e9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f215c1587d0 0x7f215c0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f2161e9c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f215c06fae0 con 0x7f215c0c9680 2023-07-06T21:42:53.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f2161e9c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215c06fdc0 con 0x7f215c158400 2023-07-06T21:42:53.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f2161e9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c0700a0 con 0x7f215c1587d0 2023-07-06T21:42:53.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f215b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f215c158400 0x7f215c0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f215b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f215c158400 0x7f215c0c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41418/0 (socket says 172.21.15.55:41418) 2023-07-06T21:42:53.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f215b7fe640 1 -- 172.21.15.55:0/2262631032 learned_addr learned my addr 172.21.15.55:0/2262631032 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:53.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f215bfff640 1 --2- 172.21.15.55:0/2262631032 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f215c1587d0 0x7f215c0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f215b7fe640 1 -- 172.21.15.55:0/2262631032 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f215c1587d0 msgr2=0x7f215c0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:53.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f215b7fe640 1 --2- 172.21.15.55:0/2262631032 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f215c1587d0 0x7f215c0cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f215b7fe640 1 -- 172.21.15.55:0/2262631032 >> v1:172.21.15.138:6789/0 conn(0x7f215c0c9680 legacy=0x7f215c070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.822+0000 7f215b7fe640 1 -- 172.21.15.55:0/2262631032 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c070380 con 0x7f215c158400 2023-07-06T21:42:53.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.826+0000 7f215b7fe640 1 --2- 172.21.15.55:0/2262631032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c158400 0x7f215c0c9140 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f214c009870 tx=0x7f214c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f90d4537c84df23 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:53.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.826+0000 7f215a7fc640 1 -- 172.21.15.55:0/2262631032 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c0ab620 con 0x7f215c158400 2023-07-06T21:42:53.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.826+0000 7f215a7fc640 1 -- 172.21.15.55:0/2262631032 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c0ab780 con 0x7f215c158400 2023-07-06T21:42:53.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.826+0000 7f215a7fc640 1 -- 172.21.15.55:0/2262631032 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c0abb10 con 0x7f215c158400 2023-07-06T21:42:53.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.826+0000 7f2161e9c640 1 -- 172.21.15.55:0/2262631032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c158400 msgr2=0x7f215c0c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.826+0000 7f2161e9c640 1 --2- 172.21.15.55:0/2262631032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c158400 0x7f215c0c9140 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f214c009870 tx=0x7f214c01c510 comp rx=0 tx=0).stop 2023-07-06T21:42:53.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.826+0000 7f2161e9c640 1 -- 172.21.15.55:0/2262631032 shutdown_connections 2023-07-06T21:42:53.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.826+0000 7f2161e9c640 1 --2- 172.21.15.55:0/2262631032 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f215c1587d0 0x7f215c0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.826+0000 7f2161e9c640 1 --2- 172.21.15.55:0/2262631032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c158400 0x7f215c0c9140 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.826+0000 7f2161e9c640 1 -- 172.21.15.55:0/2262631032 >> 172.21.15.55:0/2262631032 conn(0x7f215c0cded0 msgr2=0x7f215c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:53.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.826+0000 7f2161e9c640 1 -- 172.21.15.55:0/2262631032 shutdown_connections 2023-07-06T21:42:53.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.826+0000 7f2161e9c640 1 -- 172.21.15.55:0/2262631032 wait complete. 2023-07-06T21:42:53.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f2161e9c640 1 Processor -- start 2023-07-06T21:42:53.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f2161e9c640 1 -- start start 2023-07-06T21:42:53.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f2161e9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f215c0c9680 0x7f215c156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f2161e9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f215c158400 0x7f215c1f8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f2161e9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c1587d0 0x7f215c0b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f2161e9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c1559c0 con 0x7f215c1587d0 2023-07-06T21:42:53.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f2161e9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c155ca0 con 0x7f215c0c9680 2023-07-06T21:42:53.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f2161e9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c155f80 con 0x7f215c158400 2023-07-06T21:42:53.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f215bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c1587d0 0x7f215c0b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f215b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f215c0c9680 0x7f215c156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f215bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c1587d0 0x7f215c0b2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41426/0 (socket says 172.21.15.55:41426) 2023-07-06T21:42:53.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f215bfff640 1 -- 172.21.15.55:0/3551086020 learned_addr learned my addr 172.21.15.55:0/3551086020 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:53.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f215affd640 1 --2- 172.21.15.55:0/3551086020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f215c158400 0x7f215c1f8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f215bfff640 1 -- 172.21.15.55:0/3551086020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f215c158400 msgr2=0x7f215c1f8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f215bfff640 1 --2- 172.21.15.55:0/3551086020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f215c158400 0x7f215c1f8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f215bfff640 1 -- 172.21.15.55:0/3551086020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f215c0c9680 msgr2=0x7f215c156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:53.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f215bfff640 1 --2- 172.21.15.55:0/3551086020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f215c0c9680 0x7f215c156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:53.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f215bfff640 1 -- 172.21.15.55:0/3551086020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0094d0 con 0x7f215c1587d0 2023-07-06T21:42:53.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f215bfff640 1 --2- 172.21.15.55:0/3551086020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c1587d0 0x7f215c0b2ae0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f215400efc0 tx=0x7f215400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:53.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f2143fff640 1 -- 172.21.15.55:0/3551086020 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154009ba0 con 0x7f215c1587d0 2023-07-06T21:42:53.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f2143fff640 1 -- 172.21.15.55:0/3551086020 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215400f040 con 0x7f215c1587d0 2023-07-06T21:42:53.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f2143fff640 1 -- 172.21.15.55:0/3551086020 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21540146c0 con 0x7f215c1587d0 2023-07-06T21:42:53.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.830+0000 7f2161e9c640 1 -- 172.21.15.55:0/3551086020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215c156260 con 0x7f215c1587d0 2023-07-06T21:42:53.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.834+0000 7f2161e9c640 1 -- 172.21.15.55:0/3551086020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215c1f90a0 con 0x7f215c1587d0 2023-07-06T21:42:53.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.834+0000 7f2161e9c640 1 -- 172.21.15.55:0/3551086020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215c06c580 con 0x7f215c1587d0 2023-07-06T21:42:53.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.834+0000 7f2143fff640 1 -- 172.21.15.55:0/3551086020 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2154014820 con 0x7f215c1587d0 2023-07-06T21:42:53.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.834+0000 7f2143fff640 1 --2- 172.21.15.55:0/3551086020 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f21480662b0 0x7f2148068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:53.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.834+0000 7f2143fff640 1 -- 172.21.15.55:0/3551086020 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2154084de0 con 0x7f215c1587d0 2023-07-06T21:42:53.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.834+0000 7f215b7fe640 1 --2- 172.21.15.55:0/3551086020 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f21480662b0 0x7f2148068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:53.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.834+0000 7f215b7fe640 1 --2- 172.21.15.55:0/3551086020 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f21480662b0 0x7f2148068760 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f214c0af000 tx=0x7f214c0b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:53.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.838+0000 7f2143fff640 1 -- 172.21.15.55:0/3551086020 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2154051f40 con 0x7f215c1587d0 2023-07-06T21:42:54.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.994+0000 7f2161e9c640 1 -- 172.21.15.55:0/3551086020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f215c066d60 con 0x7f215c1587d0 2023-07-06T21:42:54.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.994+0000 7f2143fff640 1 -- 172.21.15.55:0/3551086020 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f2154018090 con 0x7f215c1587d0 2023-07-06T21:42:54.003 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:54.003 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":29,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:51.480379+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:54.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.998+0000 7f2161e9c640 1 -- 172.21.15.55:0/3551086020 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f21480662b0 msgr2=0x7f2148068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.998+0000 7f2161e9c640 1 --2- 172.21.15.55:0/3551086020 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f21480662b0 0x7f2148068760 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f214c0af000 tx=0x7f214c0b6040 comp rx=0 tx=0).stop 2023-07-06T21:42:54.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.998+0000 7f2161e9c640 1 -- 172.21.15.55:0/3551086020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c1587d0 msgr2=0x7f215c0b2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.998+0000 7f2161e9c640 1 --2- 172.21.15.55:0/3551086020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c1587d0 0x7f215c0b2ae0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f215400efc0 tx=0x7f215400c490 comp rx=0 tx=0).stop 2023-07-06T21:42:54.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.998+0000 7f2161e9c640 1 -- 172.21.15.55:0/3551086020 shutdown_connections 2023-07-06T21:42:54.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.998+0000 7f2161e9c640 1 --2- 172.21.15.55:0/3551086020 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f21480662b0 0x7f2148068760 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.998+0000 7f2161e9c640 1 --2- 172.21.15.55:0/3551086020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c1587d0 0x7f215c0b2ae0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.998+0000 7f2161e9c640 1 --2- 172.21.15.55:0/3551086020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f215c158400 0x7f215c1f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.998+0000 7f2161e9c640 1 --2- 172.21.15.55:0/3551086020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f215c0c9680 0x7f215c156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.998+0000 7f2161e9c640 1 -- 172.21.15.55:0/3551086020 >> 172.21.15.55:0/3551086020 conn(0x7f215c0cded0 msgr2=0x7f215c0cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:54.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.998+0000 7f2161e9c640 1 -- 172.21.15.55:0/3551086020 shutdown_connections 2023-07-06T21:42:54.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:53.998+0000 7f2161e9c640 1 -- 172.21.15.55:0/3551086020 wait complete. 2023-07-06T21:42:54.024 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:42:08.597013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:42:09.843890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T21:42:12.918111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T21:42:54.025 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:42:54.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.162+0000 7f81f5982640 1 Processor -- start 2023-07-06T21:42:54.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.162+0000 7f81f5982640 1 -- start start 2023-07-06T21:42:54.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81f5982640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f81f015b8a0 0x7f81f00d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81f5982640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81f00ce1a0 0x7f81f00b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81f5982640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f00b42d0 con 0x7f81f00b3e70 2023-07-06T21:42:54.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81f5982640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f00ccca0 con 0x7f81f00ce1a0 2023-07-06T21:42:54.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81f5982640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f00b5000 con 0x7f81f015b8a0 2023-07-06T21:42:54.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81e7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81f00ce1a0 0x7f81f00b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81ef7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f81f00b3e70 0x7f81f015f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32988/0 (socket says 172.21.15.55:32988) 2023-07-06T21:42:54.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81e7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81f00ce1a0 0x7f81f00b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41438/0 (socket says 172.21.15.55:41438) 2023-07-06T21:42:54.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81ef7fe640 1 -- 172.21.15.55:0/2997077643 learned_addr learned my addr 172.21.15.55:0/2997077643 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:54.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81eeffd640 1 --2- 172.21.15.55:0/2997077643 >> v2:172.21.15.138:3300/0 conn(0x7f81f015b8a0 0x7f81f00d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81e7fff640 1 -- 172.21.15.55:0/2997077643 >> v2:172.21.15.138:3300/0 conn(0x7f81f015b8a0 msgr2=0x7f81f00d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:54.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81e7fff640 1 --2- 172.21.15.55:0/2997077643 >> v2:172.21.15.138:3300/0 conn(0x7f81f015b8a0 0x7f81f00d0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81e7fff640 1 -- 172.21.15.55:0/2997077643 >> v1:172.21.15.55:6789/0 conn(0x7f81f00b3e70 legacy=0x7f81f015f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81e7fff640 1 -- 172.21.15.55:0/2997077643 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f015bc70 con 0x7f81f00ce1a0 2023-07-06T21:42:54.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81eeffd640 1 --2- 172.21.15.55:0/2997077643 >> v2:172.21.15.138:3300/0 conn(0x7f81f015b8a0 0x7f81f00d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:54.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.166+0000 7f81ee7fc640 1 -- 172.21.15.55:0/2997077643 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206056766 0 0) 0x7f81f00b42d0 con 0x7f81f00b3e70 2023-07-06T21:42:54.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.170+0000 7f81e7fff640 1 --2- 172.21.15.55:0/2997077643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f00ce1a0 0x7f81f00b3930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f81f008af80 tx=0x7f81d801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a267aee6807b35e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:54.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.170+0000 7f81ee7fc640 1 -- 172.21.15.55:0/2997077643 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d80ab600 con 0x7f81f00ce1a0 2023-07-06T21:42:54.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.170+0000 7f81ee7fc640 1 -- 172.21.15.55:0/2997077643 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d80a7050 con 0x7f81f00ce1a0 2023-07-06T21:42:54.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.170+0000 7f81ee7fc640 1 -- 172.21.15.55:0/2997077643 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d80ab980 con 0x7f81f00ce1a0 2023-07-06T21:42:54.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.170+0000 7f81f5982640 1 -- 172.21.15.55:0/2997077643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f00ce1a0 msgr2=0x7f81f00b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.170+0000 7f81f5982640 1 --2- 172.21.15.55:0/2997077643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f00ce1a0 0x7f81f00b3930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f81f008af80 tx=0x7f81d801c3d0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.170+0000 7f81f5982640 1 -- 172.21.15.55:0/2997077643 shutdown_connections 2023-07-06T21:42:54.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.170+0000 7f81f5982640 1 --2- 172.21.15.55:0/2997077643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f00ce1a0 0x7f81f00b3930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.170+0000 7f81f5982640 1 --2- 172.21.15.55:0/2997077643 >> v2:172.21.15.138:3300/0 conn(0x7f81f015b8a0 0x7f81f00d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.170+0000 7f81f5982640 1 -- 172.21.15.55:0/2997077643 >> 172.21.15.55:0/2997077643 conn(0x7f81f006b620 msgr2=0x7f81f006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:54.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.170+0000 7f81f5982640 1 -- 172.21.15.55:0/2997077643 shutdown_connections 2023-07-06T21:42:54.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.170+0000 7f81f5982640 1 -- 172.21.15.55:0/2997077643 wait complete. 2023-07-06T21:42:54.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.170+0000 7f81f5982640 1 Processor -- start 2023-07-06T21:42:54.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.170+0000 7f81f5982640 1 -- start start 2023-07-06T21:42:54.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81f5982640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81f00b3e70 0x7f81f00cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81f5982640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81f00ce1a0 0x7f81f015da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81f5982640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f015b8a0 0x7f81f014f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81f5982640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00c80d0 con 0x7f81f015b8a0 2023-07-06T21:42:54.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81f5982640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f015df60 con 0x7f81f00ce1a0 2023-07-06T21:42:54.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81f5982640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00c7490 con 0x7f81f00b3e70 2023-07-06T21:42:54.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81ef7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f015b8a0 0x7f81f014f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81ef7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f015b8a0 0x7f81f014f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41440/0 (socket says 172.21.15.55:41440) 2023-07-06T21:42:54.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81ef7fe640 1 -- 172.21.15.55:0/80967000 learned_addr learned my addr 172.21.15.55:0/80967000 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:54.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81e7fff640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81f00ce1a0 0x7f81f015da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81eeffd640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81f00b3e70 0x7f81f00cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81ef7fe640 1 -- 172.21.15.55:0/80967000 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81f00b3e70 msgr2=0x7f81f00cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81ef7fe640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81f00b3e70 0x7f81f00cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81ef7fe640 1 -- 172.21.15.55:0/80967000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81f00ce1a0 msgr2=0x7f81f015da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81ef7fe640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81f00ce1a0 0x7f81f015da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81ef7fe640 1 -- 172.21.15.55:0/80967000 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d8009420 con 0x7f81f015b8a0 2023-07-06T21:42:54.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81e7fff640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81f00ce1a0 0x7f81f015da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:54.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81ef7fe640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f015b8a0 0x7f81f014f6e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f81e800cb30 tx=0x7f81e800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:54.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81ecff9640 1 -- 172.21.15.55:0/80967000 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e800aca0 con 0x7f81f015b8a0 2023-07-06T21:42:54.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81ecff9640 1 -- 172.21.15.55:0/80967000 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e800ae20 con 0x7f81f015b8a0 2023-07-06T21:42:54.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81f5982640 1 -- 172.21.15.55:0/80967000 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f00c7730 con 0x7f81f015b8a0 2023-07-06T21:42:54.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81ecff9640 1 -- 172.21.15.55:0/80967000 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e8012640 con 0x7f81f015b8a0 2023-07-06T21:42:54.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81f5982640 1 -- 172.21.15.55:0/80967000 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f00c7cf0 con 0x7f81f015b8a0 2023-07-06T21:42:54.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81f5982640 1 -- 172.21.15.55:0/80967000 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f00c8210 con 0x7f81f015b8a0 2023-07-06T21:42:54.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.174+0000 7f81ecff9640 1 -- 172.21.15.55:0/80967000 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f81e8007070 con 0x7f81f015b8a0 2023-07-06T21:42:54.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.178+0000 7f81ecff9640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f81d0066280 0x7f81d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.178+0000 7f81ecff9640 1 -- 172.21.15.55:0/80967000 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f81e8084090 con 0x7f81f015b8a0 2023-07-06T21:42:54.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.178+0000 7f81eeffd640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f81d0066280 0x7f81d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.178+0000 7f81eeffd640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f81d0066280 0x7f81d0068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f81e0006fd0 tx=0x7f81e0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:54.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.182+0000 7f81ecff9640 1 -- 172.21.15.55:0/80967000 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81f00c8210 con 0x7f81f015b8a0 2023-07-06T21:42:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.334+0000 7f81f5982640 1 -- 172.21.15.55:0/80967000 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81f00c8210 con 0x7f81f015b8a0 2023-07-06T21:42:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.334+0000 7f81ecff9640 1 -- 172.21.15.55:0/80967000 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81f00c8210 con 0x7f81f015b8a0 2023-07-06T21:42:54.341 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:42:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.338+0000 7f81f5982640 1 -- 172.21.15.55:0/80967000 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f81d0066280 msgr2=0x7f81d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.338+0000 7f81f5982640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f81d0066280 0x7f81d0068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f81e0006fd0 tx=0x7f81e0008040 comp rx=0 tx=0).stop 2023-07-06T21:42:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.338+0000 7f81f5982640 1 -- 172.21.15.55:0/80967000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f015b8a0 msgr2=0x7f81f014f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.338+0000 7f81f5982640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f015b8a0 0x7f81f014f6e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f81e800cb30 tx=0x7f81e800a060 comp rx=0 tx=0).stop 2023-07-06T21:42:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.338+0000 7f81f5982640 1 -- 172.21.15.55:0/80967000 shutdown_connections 2023-07-06T21:42:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.338+0000 7f81f5982640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f81d0066280 0x7f81d0068730 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.338+0000 7f81f5982640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f015b8a0 0x7f81f014f6e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.338+0000 7f81f5982640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81f00ce1a0 0x7f81f015da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.338+0000 7f81f5982640 1 --2- 172.21.15.55:0/80967000 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81f00b3e70 0x7f81f00cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.338+0000 7f81f5982640 1 -- 172.21.15.55:0/80967000 >> 172.21.15.55:0/80967000 conn(0x7f81f006b620 msgr2=0x7f81f00b72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:54.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.338+0000 7f81f5982640 1 -- 172.21.15.55:0/80967000 shutdown_connections 2023-07-06T21:42:54.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.338+0000 7f81f5982640 1 -- 172.21.15.55:0/80967000 wait complete. 2023-07-06T21:42:54.364 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:42:54.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.502+0000 7f1d6faf9640 1 Processor -- start 2023-07-06T21:42:54.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.502+0000 7f1d6faf9640 1 -- start start 2023-07-06T21:42:54.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.506+0000 7f1d6faf9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d68070020 0x7f1d680ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.506+0000 7f1d6faf9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d680cef40 0x7f1d680c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.506+0000 7f1d6faf9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6815fe80 con 0x7f1d6815bb90 2023-07-06T21:42:54.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.506+0000 7f1d6faf9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6815f620 con 0x7f1d680cef40 2023-07-06T21:42:54.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.506+0000 7f1d6faf9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6815bf60 con 0x7f1d68070020 2023-07-06T21:42:54.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.506+0000 7f1d6e096640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d680cef40 0x7f1d680c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.506+0000 7f1d6e096640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d680cef40 0x7f1d680c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41444/0 (socket says 172.21.15.55:41444) 2023-07-06T21:42:54.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.506+0000 7f1d6e096640 1 -- 172.21.15.55:0/532765177 learned_addr learned my addr 172.21.15.55:0/532765177 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:54.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.506+0000 7f1d6d094640 1 --2- 172.21.15.55:0/532765177 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d68070020 0x7f1d680ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.506+0000 7f1d6e096640 1 -- 172.21.15.55:0/532765177 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d68070020 msgr2=0x7f1d680ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:54.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.506+0000 7f1d6e096640 1 --2- 172.21.15.55:0/532765177 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d68070020 0x7f1d680ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.506+0000 7f1d6e096640 1 -- 172.21.15.55:0/532765177 >> v1:172.21.15.138:6789/0 conn(0x7f1d6815bb90 legacy=0x7f1d6806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.506+0000 7f1d6e096640 1 -- 172.21.15.55:0/532765177 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d680cf440 con 0x7f1d680cef40 2023-07-06T21:42:54.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.510+0000 7f1d6e096640 1 --2- 172.21.15.55:0/532765177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d680cef40 0x7f1d680c8cf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009e50 tx=0x7f1d6001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23e1c22ce5dd5bc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:54.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.510+0000 7f1d6c893640 1 -- 172.21.15.55:0/532765177 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d600a6410 con 0x7f1d680cef40 2023-07-06T21:42:54.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.510+0000 7f1d6c893640 1 -- 172.21.15.55:0/532765177 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d600a6570 con 0x7f1d680cef40 2023-07-06T21:42:54.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.510+0000 7f1d6c893640 1 -- 172.21.15.55:0/532765177 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d600a6900 con 0x7f1d680cef40 2023-07-06T21:42:54.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.510+0000 7f1d6faf9640 1 -- 172.21.15.55:0/532765177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d680cef40 msgr2=0x7f1d680c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.510+0000 7f1d6faf9640 1 --2- 172.21.15.55:0/532765177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d680cef40 0x7f1d680c8cf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009e50 tx=0x7f1d6001ca10 comp rx=0 tx=0).stop 2023-07-06T21:42:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.510+0000 7f1d6faf9640 1 -- 172.21.15.55:0/532765177 shutdown_connections 2023-07-06T21:42:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.510+0000 7f1d6faf9640 1 --2- 172.21.15.55:0/532765177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d680cef40 0x7f1d680c8cf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.510+0000 7f1d6faf9640 1 --2- 172.21.15.55:0/532765177 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d68070020 0x7f1d680ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.510+0000 7f1d6faf9640 1 -- 172.21.15.55:0/532765177 >> 172.21.15.55:0/532765177 conn(0x7f1d680cbd70 msgr2=0x7f1d680ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.510+0000 7f1d6faf9640 1 -- 172.21.15.55:0/532765177 shutdown_connections 2023-07-06T21:42:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.510+0000 7f1d6faf9640 1 -- 172.21.15.55:0/532765177 wait complete. 2023-07-06T21:42:54.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.510+0000 7f1d6faf9640 1 Processor -- start 2023-07-06T21:42:54.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.510+0000 7f1d6faf9640 1 -- start start 2023-07-06T21:42:54.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6faf9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d68070020 0x7f1d68153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6faf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d680cef40 0x7f1d680ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6faf9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d6815bb90 0x7f1d6814aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6faf9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680c5810 con 0x7f1d680cef40 2023-07-06T21:42:54.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6faf9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680c5af0 con 0x7f1d68070020 2023-07-06T21:42:54.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6faf9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680c5dd0 con 0x7f1d6815bb90 2023-07-06T21:42:54.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6d094640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d680cef40 0x7f1d680ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6d094640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d680cef40 0x7f1d680ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41458/0 (socket says 172.21.15.55:41458) 2023-07-06T21:42:54.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6d094640 1 -- 172.21.15.55:0/3624409027 learned_addr learned my addr 172.21.15.55:0/3624409027 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:54.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6e096640 1 --2- 172.21.15.55:0/3624409027 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d6815bb90 0x7f1d6814aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6d895640 1 --2- 172.21.15.55:0/3624409027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d68070020 0x7f1d68153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6d094640 1 -- 172.21.15.55:0/3624409027 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d6815bb90 msgr2=0x7f1d6814aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6d094640 1 --2- 172.21.15.55:0/3624409027 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d6815bb90 0x7f1d6814aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6d094640 1 -- 172.21.15.55:0/3624409027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d68070020 msgr2=0x7f1d68153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6d094640 1 --2- 172.21.15.55:0/3624409027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d68070020 0x7f1d68153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6d094640 1 -- 172.21.15.55:0/3624409027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d60009b30 con 0x7f1d680cef40 2023-07-06T21:42:54.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6d094640 1 --2- 172.21.15.55:0/3624409027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d680cef40 0x7f1d680ae050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800e900 tx=0x7f1d5800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:54.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d5e7fc640 1 -- 172.21.15.55:0/3624409027 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58009690 con 0x7f1d680cef40 2023-07-06T21:42:54.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d5e7fc640 1 -- 172.21.15.55:0/3624409027 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5800ca00 con 0x7f1d680cef40 2023-07-06T21:42:54.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d5e7fc640 1 -- 172.21.15.55:0/3624409027 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5800cdb0 con 0x7f1d680cef40 2023-07-06T21:42:54.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6faf9640 1 -- 172.21.15.55:0/3624409027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d680c60b0 con 0x7f1d680cef40 2023-07-06T21:42:54.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6faf9640 1 -- 172.21.15.55:0/3624409027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d68153960 con 0x7f1d680cef40 2023-07-06T21:42:54.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d6faf9640 1 -- 172.21.15.55:0/3624409027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d68066d60 con 0x7f1d680cef40 2023-07-06T21:42:54.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.514+0000 7f1d5e7fc640 1 -- 172.21.15.55:0/3624409027 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1d58013470 con 0x7f1d680cef40 2023-07-06T21:42:54.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.518+0000 7f1d5e7fc640 1 --2- 172.21.15.55:0/3624409027 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1d4c0662b0 0x7f1d4c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.518+0000 7f1d5e7fc640 1 -- 172.21.15.55:0/3624409027 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1d58084370 con 0x7f1d680cef40 2023-07-06T21:42:54.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.518+0000 7f1d6d895640 1 --2- 172.21.15.55:0/3624409027 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1d4c0662b0 0x7f1d4c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.518+0000 7f1d6d895640 1 --2- 172.21.15.55:0/3624409027 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1d4c0662b0 0x7f1d4c068760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d64000f70 tx=0x7f1d64009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:54.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.522+0000 7f1d5e7fc640 1 -- 172.21.15.55:0/3624409027 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d58051390 con 0x7f1d680cef40 2023-07-06T21:42:54.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.678+0000 7f1d6faf9640 1 -- 172.21.15.55:0/3624409027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1d680b4620 con 0x7f1d680cef40 2023-07-06T21:42:54.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.678+0000 7f1d5e7fc640 1 -- 172.21.15.55:0/3624409027 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1d580549b0 con 0x7f1d680cef40 2023-07-06T21:42:54.684 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:42:54.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.678+0000 7f1d6faf9640 1 -- 172.21.15.55:0/3624409027 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1d4c0662b0 msgr2=0x7f1d4c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.678+0000 7f1d6faf9640 1 --2- 172.21.15.55:0/3624409027 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1d4c0662b0 0x7f1d4c068760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d64000f70 tx=0x7f1d64009040 comp rx=0 tx=0).stop 2023-07-06T21:42:54.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.678+0000 7f1d6faf9640 1 -- 172.21.15.55:0/3624409027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d680cef40 msgr2=0x7f1d680ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.678+0000 7f1d6faf9640 1 --2- 172.21.15.55:0/3624409027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d680cef40 0x7f1d680ae050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800e900 tx=0x7f1d5800edc0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.678+0000 7f1d6faf9640 1 -- 172.21.15.55:0/3624409027 shutdown_connections 2023-07-06T21:42:54.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.678+0000 7f1d6faf9640 1 --2- 172.21.15.55:0/3624409027 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1d4c0662b0 0x7f1d4c068760 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.678+0000 7f1d6faf9640 1 --2- 172.21.15.55:0/3624409027 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d6815bb90 0x7f1d6814aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.678+0000 7f1d6faf9640 1 --2- 172.21.15.55:0/3624409027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d680cef40 0x7f1d680ae050 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.678+0000 7f1d6faf9640 1 --2- 172.21.15.55:0/3624409027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d68070020 0x7f1d68153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.678+0000 7f1d6faf9640 1 -- 172.21.15.55:0/3624409027 >> 172.21.15.55:0/3624409027 conn(0x7f1d680cbd70 msgr2=0x7f1d680ab870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:54.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.678+0000 7f1d6faf9640 1 -- 172.21.15.55:0/3624409027 shutdown_connections 2023-07-06T21:42:54.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.678+0000 7f1d6faf9640 1 -- 172.21.15.55:0/3624409027 wait complete. 2023-07-06T21:42:54.705 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:42:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.842+0000 7fee60e93640 1 Processor -- start 2023-07-06T21:42:54.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.842+0000 7fee60e93640 1 -- start start 2023-07-06T21:42:54.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.842+0000 7fee60e93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fee5c070020 0x7fee5c06b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee60e93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee5c0ce220 0x7fee5c06bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee60e93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c0cdd60 con 0x7fee5c157ee0 2023-07-06T21:42:54.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee60e93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5c0cc5a0 con 0x7fee5c070020 2023-07-06T21:42:54.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee60e93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c069f30 con 0x7fee5c0ce220 2023-07-06T21:42:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee53fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fee5c070020 0x7fee5c06b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee53fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fee5c070020 0x7fee5c06b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41468/0 (socket says 172.21.15.55:41468) 2023-07-06T21:42:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee53fff640 1 -- 172.21.15.55:0/103700039 learned_addr learned my addr 172.21.15.55:0/103700039 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee5a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fee5c157ee0 0x7fee5c06f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33000/0 (socket says 172.21.15.55:33000) 2023-07-06T21:42:54.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee5ad9d640 1 --2- 172.21.15.55:0/103700039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee5c0ce220 0x7fee5c06bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee53fff640 1 -- 172.21.15.55:0/103700039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee5c0ce220 msgr2=0x7fee5c06bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:54.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee53fff640 1 --2- 172.21.15.55:0/103700039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee5c0ce220 0x7fee5c06bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee53fff640 1 -- 172.21.15.55:0/103700039 >> v1:172.21.15.55:6789/0 conn(0x7fee5c157ee0 legacy=0x7fee5c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee53fff640 1 -- 172.21.15.55:0/103700039 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c06a210 con 0x7fee5c070020 2023-07-06T21:42:54.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee59d9b640 1 -- 172.21.15.55:0/103700039 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166747146 0 0) 0x7fee5c0cdd60 con 0x7fee5c157ee0 2023-07-06T21:42:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee5ad9d640 1 --2- 172.21.15.55:0/103700039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee5c0ce220 0x7fee5c06bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.846+0000 7fee53fff640 1 --2- 172.21.15.55:0/103700039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee5c070020 0x7fee5c06b690 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee44009870 tx=0x7fee4401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7767861dfd8fe165 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee59d9b640 1 -- 172.21.15.55:0/103700039 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee440ab600 con 0x7fee5c070020 2023-07-06T21:42:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee59d9b640 1 -- 172.21.15.55:0/103700039 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee440a7050 con 0x7fee5c070020 2023-07-06T21:42:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee59d9b640 1 -- 172.21.15.55:0/103700039 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee440ab980 con 0x7fee5c070020 2023-07-06T21:42:54.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 -- 172.21.15.55:0/103700039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee5c070020 msgr2=0x7fee5c06b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 --2- 172.21.15.55:0/103700039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee5c070020 0x7fee5c06b690 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee44009870 tx=0x7fee4401c420 comp rx=0 tx=0).stop 2023-07-06T21:42:54.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 -- 172.21.15.55:0/103700039 shutdown_connections 2023-07-06T21:42:54.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 --2- 172.21.15.55:0/103700039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee5c0ce220 0x7fee5c06bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 --2- 172.21.15.55:0/103700039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee5c070020 0x7fee5c06b690 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 -- 172.21.15.55:0/103700039 >> 172.21.15.55:0/103700039 conn(0x7fee5c0cbd70 msgr2=0x7fee5c0ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:54.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 -- 172.21.15.55:0/103700039 shutdown_connections 2023-07-06T21:42:54.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 -- 172.21.15.55:0/103700039 wait complete. 2023-07-06T21:42:54.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 Processor -- start 2023-07-06T21:42:54.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 -- start start 2023-07-06T21:42:54.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee5c070020 0x7fee5c150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee5c0ce220 0x7fee5c155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee5c157ee0 0x7fee5c155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c162940 con 0x7fee5c157ee0 2023-07-06T21:42:54.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c161cc0 con 0x7fee5c070020 2023-07-06T21:42:54.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee60e93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c161fa0 con 0x7fee5c0ce220 2023-07-06T21:42:54.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee5ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee5c157ee0 0x7fee5c155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee5ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee5c157ee0 0x7fee5c155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41476/0 (socket says 172.21.15.55:41476) 2023-07-06T21:42:54.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.850+0000 7fee5ad9d640 1 -- 172.21.15.55:0/3344412283 learned_addr learned my addr 172.21.15.55:0/3344412283 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:54.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee5a59c640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee5c070020 0x7fee5c150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee53fff640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee5c0ce220 0x7fee5c155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee5ad9d640 1 -- 172.21.15.55:0/3344412283 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee5c0ce220 msgr2=0x7fee5c155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee5ad9d640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee5c0ce220 0x7fee5c155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee5ad9d640 1 -- 172.21.15.55:0/3344412283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee5c070020 msgr2=0x7fee5c150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:54.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee5ad9d640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee5c070020 0x7fee5c150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:54.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee5ad9d640 1 -- 172.21.15.55:0/3344412283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee440094d0 con 0x7fee5c157ee0 2023-07-06T21:42:54.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee53fff640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee5c0ce220 0x7fee5c155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:54.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee5a59c640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee5c070020 0x7fee5c150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:54.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee5ad9d640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee5c157ee0 0x7fee5c155fc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee54007df0 tx=0x7fee5400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:54.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee52ffd640 1 -- 172.21.15.55:0/3344412283 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540039a0 con 0x7fee5c157ee0 2023-07-06T21:42:54.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee52ffd640 1 -- 172.21.15.55:0/3344412283 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5400f040 con 0x7fee5c157ee0 2023-07-06T21:42:54.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee52ffd640 1 -- 172.21.15.55:0/3344412283 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54003d40 con 0x7fee5c157ee0 2023-07-06T21:42:54.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee60e93640 1 -- 172.21.15.55:0/3344412283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c162280 con 0x7fee5c157ee0 2023-07-06T21:42:54.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee60e93640 1 -- 172.21.15.55:0/3344412283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c151090 con 0x7fee5c157ee0 2023-07-06T21:42:54.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee60e93640 1 -- 172.21.15.55:0/3344412283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c162a80 con 0x7fee5c157ee0 2023-07-06T21:42:54.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee52ffd640 1 -- 172.21.15.55:0/3344412283 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee54004030 con 0x7fee5c157ee0 2023-07-06T21:42:54.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee52ffd640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fee3c066280 0x7fee3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:54.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee52ffd640 1 -- 172.21.15.55:0/3344412283 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fee540843b0 con 0x7fee5c157ee0 2023-07-06T21:42:54.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.854+0000 7fee5a59c640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fee3c066280 0x7fee3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:54.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.858+0000 7fee5a59c640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fee3c066280 0x7fee3c068730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fee4c000f70 tx=0x7fee4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:54.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:54.858+0000 7fee52ffd640 1 -- 172.21.15.55:0/3344412283 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee540514f0 con 0x7fee5c157ee0 2023-07-06T21:42:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.018+0000 7fee60e93640 1 -- 172.21.15.55:0/3344412283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fee5c066d60 con 0x7fee5c157ee0 2023-07-06T21:42:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.018+0000 7fee52ffd640 1 -- 172.21.15.55:0/3344412283 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fee54054b10 con 0x7fee5c157ee0 2023-07-06T21:42:55.026 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:55.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.022+0000 7fee60e93640 1 -- 172.21.15.55:0/3344412283 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fee3c066280 msgr2=0x7fee3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.022+0000 7fee60e93640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fee3c066280 0x7fee3c068730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fee4c000f70 tx=0x7fee4c009040 comp rx=0 tx=0).stop 2023-07-06T21:42:55.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.022+0000 7fee60e93640 1 -- 172.21.15.55:0/3344412283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee5c157ee0 msgr2=0x7fee5c155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.022+0000 7fee60e93640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee5c157ee0 0x7fee5c155fc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee54007df0 tx=0x7fee5400d4a0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.022+0000 7fee60e93640 1 -- 172.21.15.55:0/3344412283 shutdown_connections 2023-07-06T21:42:55.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.022+0000 7fee60e93640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fee3c066280 0x7fee3c068730 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.022+0000 7fee60e93640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee5c157ee0 0x7fee5c155fc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.022+0000 7fee60e93640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee5c0ce220 0x7fee5c155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.022+0000 7fee60e93640 1 --2- 172.21.15.55:0/3344412283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee5c070020 0x7fee5c150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.022+0000 7fee60e93640 1 -- 172.21.15.55:0/3344412283 >> 172.21.15.55:0/3344412283 conn(0x7fee5c0cbd70 msgr2=0x7fee5c1530e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:55.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.022+0000 7fee60e93640 1 -- 172.21.15.55:0/3344412283 shutdown_connections 2023-07-06T21:42:55.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.022+0000 7fee60e93640 1 -- 172.21.15.55:0/3344412283 wait complete. 2023-07-06T21:42:55.047 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:42:55.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb232967640 1 Processor -- start 2023-07-06T21:42:55.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb232967640 1 -- start start 2023-07-06T21:42:55.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb232967640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb22c15b850 0x7fb22c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb232967640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22c0b2b80 con 0x7fb22c0ccd30 2023-07-06T21:42:55.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb232967640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22c0cff30 con 0x7fb22c0b3f80 2023-07-06T21:42:55.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb232967640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22c0b22e0 con 0x7fb22c15b850 2023-07-06T21:42:55.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb22c0ccd30 0x7fb22c0b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33008/0 (socket says 172.21.15.55:33008) 2023-07-06T21:42:55.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22b7fe640 1 -- 172.21.15.55:0/3170242288 learned_addr learned my addr 172.21.15.55:0/3170242288 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22bfff640 1 --2- 172.21.15.55:0/3170242288 >> v2:172.21.15.138:3300/0 conn(0x7fb22c15b850 0x7fb22c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22affd640 1 -- 172.21.15.55:0/3170242288 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861350263 0 0) 0x7fb22c0b2b80 con 0x7fb22c0ccd30 2023-07-06T21:42:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22affd640 1 -- 172.21.15.55:0/3170242288 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb214003530 con 0x7fb22c0ccd30 2023-07-06T21:42:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22affd640 1 -- 172.21.15.55:0/3170242288 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2427215924 0 0) 0x7fb214003530 con 0x7fb22c0ccd30 2023-07-06T21:42:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22affd640 1 -- 172.21.15.55:0/3170242288 >> v2:172.21.15.138:3300/0 conn(0x7fb22c15b850 msgr2=0x7fb22c0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22affd640 1 --2- 172.21.15.55:0/3170242288 >> v2:172.21.15.138:3300/0 conn(0x7fb22c15b850 0x7fb22c0cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22affd640 1 -- 172.21.15.55:0/3170242288 >> v1:172.21.15.138:6789/0 conn(0x7fb22c0b3f80 legacy=0x7fb22c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22affd640 1 -- 172.21.15.55:0/3170242288 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c0b25c0 con 0x7fb22c0ccd30 2023-07-06T21:42:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22affd640 1 -- 172.21.15.55:0/3170242288 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fb220001680 con 0x7fb22c0ccd30 2023-07-06T21:42:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22affd640 1 -- 172.21.15.55:0/3170242288 >> v1:172.21.15.55:6789/0 conn(0x7fb22c0ccd30 legacy=0x7fb22c0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22affd640 1 --2- 172.21.15.55:0/3170242288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb214003980 0x7fb214003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22affd640 1 --2- 172.21.15.55:0/3170242288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2140047d0 0x7fb214004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.186+0000 7fb22affd640 1 --2- 172.21.15.55:0/3170242288 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb214005180 0x7fb21400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb22affd640 1 -- 172.21.15.55:0/3170242288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c0b22e0 con 0x7fb2140047d0 2023-07-06T21:42:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb22affd640 1 -- 172.21.15.55:0/3170242288 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21400c110 con 0x7fb214003980 2023-07-06T21:42:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb22affd640 1 -- 172.21.15.55:0/3170242288 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21400c2d0 con 0x7fb214005180 2023-07-06T21:42:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb22b7fe640 1 --2- 172.21.15.55:0/3170242288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2140047d0 0x7fb214004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb22bfff640 1 --2- 172.21.15.55:0/3170242288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb214003980 0x7fb214003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb230f04640 1 --2- 172.21.15.55:0/3170242288 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb214005180 0x7fb21400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb22b7fe640 1 -- 172.21.15.55:0/3170242288 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb214005180 msgr2=0x7fb21400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb22b7fe640 1 --2- 172.21.15.55:0/3170242288 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb214005180 0x7fb21400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb22b7fe640 1 -- 172.21.15.55:0/3170242288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb214003980 msgr2=0x7fb214003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:55.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb22b7fe640 1 --2- 172.21.15.55:0/3170242288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb214003980 0x7fb214003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb22b7fe640 1 -- 172.21.15.55:0/3170242288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb214003530 con 0x7fb2140047d0 2023-07-06T21:42:55.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb230f04640 1 -- 172.21.15.55:0/3170242288 reap_dead start 2023-07-06T21:42:55.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb22b7fe640 1 --2- 172.21.15.55:0/3170242288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2140047d0 0x7fb214004c40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb220001ec0 tx=0x7fb22001cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a38800e7ddccc3d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:55.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb22affd640 1 -- 172.21.15.55:0/3170242288 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220005ae0 con 0x7fb2140047d0 2023-07-06T21:42:55.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb22affd640 1 -- 172.21.15.55:0/3170242288 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb220005c60 con 0x7fb2140047d0 2023-07-06T21:42:55.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb22affd640 1 -- 172.21.15.55:0/3170242288 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2200072b0 con 0x7fb2140047d0 2023-07-06T21:42:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.190+0000 7fb232967640 1 -- 172.21.15.55:0/3170242288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2140047d0 msgr2=0x7fb214004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb232967640 1 --2- 172.21.15.55:0/3170242288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2140047d0 0x7fb214004c40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb220001ec0 tx=0x7fb22001cbb0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb232967640 1 -- 172.21.15.55:0/3170242288 shutdown_connections 2023-07-06T21:42:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb232967640 1 --2- 172.21.15.55:0/3170242288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2140047d0 0x7fb214004c40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb232967640 1 -- 172.21.15.55:0/3170242288 >> 172.21.15.55:0/3170242288 conn(0x7fb22c0cec20 msgr2=0x7fb22c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb232967640 1 -- 172.21.15.55:0/3170242288 shutdown_connections 2023-07-06T21:42:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb232967640 1 -- 172.21.15.55:0/3170242288 wait complete. 2023-07-06T21:42:55.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb232967640 1 Processor -- start 2023-07-06T21:42:55.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb232967640 1 -- start start 2023-07-06T21:42:55.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb232967640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2140047d0 0x7fb22c0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb232967640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb22c1588d0 0x7fb22c14f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb232967640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb22c0cbf30 0x7fb22c0b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb232967640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c0cbb10 con 0x7fb2140047d0 2023-07-06T21:42:55.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb232967640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c159150 con 0x7fb22c0cbf30 2023-07-06T21:42:55.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb232967640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c14fbb0 con 0x7fb22c1588d0 2023-07-06T21:42:55.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb22bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2140047d0 0x7fb22c0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb22bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2140047d0 0x7fb22c0ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41490/0 (socket says 172.21.15.55:41490) 2023-07-06T21:42:55.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb22bfff640 1 -- 172.21.15.55:0/229121128 learned_addr learned my addr 172.21.15.55:0/229121128 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:55.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb22b7fe640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb22c1588d0 0x7fb22c14f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb230f04640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb22c0cbf30 0x7fb22c0b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb22bfff640 1 -- 172.21.15.55:0/229121128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb22c1588d0 msgr2=0x7fb22c14f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb22bfff640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb22c1588d0 0x7fb22c14f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb22bfff640 1 -- 172.21.15.55:0/229121128 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb22c0cbf30 msgr2=0x7fb22c0b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb22bfff640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb22c0cbf30 0x7fb22c0b5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb22bfff640 1 -- 172.21.15.55:0/229121128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c0cae90 con 0x7fb2140047d0 2023-07-06T21:42:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.194+0000 7fb230f04640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb22c0cbf30 0x7fb22c0b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.198+0000 7fb22bfff640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2140047d0 0x7fb22c0ca790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb21c011900 tx=0x7fb21c0119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:55.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.198+0000 7fb228ff9640 1 -- 172.21.15.55:0/229121128 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c004240 con 0x7fb2140047d0 2023-07-06T21:42:55.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.198+0000 7fb228ff9640 1 -- 172.21.15.55:0/229121128 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c0043a0 con 0x7fb2140047d0 2023-07-06T21:42:55.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.198+0000 7fb228ff9640 1 -- 172.21.15.55:0/229121128 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c003860 con 0x7fb2140047d0 2023-07-06T21:42:55.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.198+0000 7fb232967640 1 -- 172.21.15.55:0/229121128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22c0cb170 con 0x7fb2140047d0 2023-07-06T21:42:55.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.198+0000 7fb232967640 1 -- 172.21.15.55:0/229121128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22c0cb730 con 0x7fb2140047d0 2023-07-06T21:42:55.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.198+0000 7fb232967640 1 -- 172.21.15.55:0/229121128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22c066d60 con 0x7fb2140047d0 2023-07-06T21:42:55.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.198+0000 7fb228ff9640 1 -- 172.21.15.55:0/229121128 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb21c0039c0 con 0x7fb2140047d0 2023-07-06T21:42:55.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.198+0000 7fb228ff9640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2180662b0 0x7fb218068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.198+0000 7fb228ff9640 1 -- 172.21.15.55:0/229121128 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb21c0842d0 con 0x7fb2140047d0 2023-07-06T21:42:55.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.198+0000 7fb22b7fe640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2180662b0 0x7fb218068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.202+0000 7fb22b7fe640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2180662b0 0x7fb218068760 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb2200ab000 tx=0x7fb2200a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:55.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.202+0000 7fb228ff9640 1 -- 172.21.15.55:0/229121128 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb21c051430 con 0x7fb2140047d0 2023-07-06T21:42:55.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.358+0000 7fb232967640 1 -- 172.21.15.55:0/229121128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb22c0b3420 con 0x7fb2140047d0 2023-07-06T21:42:55.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.358+0000 7fb228ff9640 1 -- 172.21.15.55:0/229121128 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb21c054a50 con 0x7fb2140047d0 2023-07-06T21:42:55.365 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:42:55.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.358+0000 7fb232967640 1 -- 172.21.15.55:0/229121128 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2180662b0 msgr2=0x7fb218068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.358+0000 7fb232967640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2180662b0 0x7fb218068760 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb2200ab000 tx=0x7fb2200a7070 comp rx=0 tx=0).stop 2023-07-06T21:42:55.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.358+0000 7fb232967640 1 -- 172.21.15.55:0/229121128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2140047d0 msgr2=0x7fb22c0ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.358+0000 7fb232967640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2140047d0 0x7fb22c0ca790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb21c011900 tx=0x7fb21c0119f0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.358+0000 7fb232967640 1 -- 172.21.15.55:0/229121128 shutdown_connections 2023-07-06T21:42:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.358+0000 7fb232967640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2180662b0 0x7fb218068760 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.358+0000 7fb232967640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb22c0cbf30 0x7fb22c0b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.358+0000 7fb232967640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb22c1588d0 0x7fb22c14f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.358+0000 7fb232967640 1 --2- 172.21.15.55:0/229121128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2140047d0 0x7fb22c0ca790 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.358+0000 7fb232967640 1 -- 172.21.15.55:0/229121128 >> 172.21.15.55:0/229121128 conn(0x7fb22c0cec20 msgr2=0x7fb22c0d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.358+0000 7fb232967640 1 -- 172.21.15.55:0/229121128 shutdown_connections 2023-07-06T21:42:55.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.358+0000 7fb232967640 1 -- 172.21.15.55:0/229121128 wait complete. 2023-07-06T21:42:55.386 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T21:42:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.522+0000 7f0ce4c7b640 1 Processor -- start 2023-07-06T21:42:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0ce4c7b640 1 -- start start 2023-07-06T21:42:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0ce4c7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ce0158850 0x7f0ce00cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0ce4c7b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0ce00ca130 0x7f0ce00ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0ce4c7b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ce00703e0 0x7f0ce0070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0ce4c7b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce0070dc0 con 0x7f0ce00703e0 2023-07-06T21:42:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0ce4c7b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce0158c20 con 0x7f0ce00ca130 2023-07-06T21:42:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0ce4c7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00c8db0 con 0x7f0ce0158850 2023-07-06T21:42:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0cded9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ce00703e0 0x7f0ce0070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0cded9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ce00703e0 0x7f0ce0070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41494/0 (socket says 172.21.15.55:41494) 2023-07-06T21:42:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0cded9d640 1 -- 172.21.15.55:0/3251724181 learned_addr learned my addr 172.21.15.55:0/3251724181 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0cded9d640 1 -- 172.21.15.55:0/3251724181 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ce0158850 msgr2=0x7f0ce00cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0cded9d640 1 --2- 172.21.15.55:0/3251724181 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ce0158850 0x7f0ce00cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0cded9d640 1 -- 172.21.15.55:0/3251724181 >> v2:172.21.15.138:3300/0 conn(0x7f0ce00ca130 msgr2=0x7f0ce00ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0cded9d640 1 --2- 172.21.15.55:0/3251724181 >> v2:172.21.15.138:3300/0 conn(0x7f0ce00ca130 0x7f0ce00ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.526+0000 7f0cded9d640 1 -- 172.21.15.55:0/3251724181 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00c9090 con 0x7f0ce00703e0 2023-07-06T21:42:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0cded9d640 1 --2- 172.21.15.55:0/3251724181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce00703e0 0x7f0ce0070880 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ce006eb70 tx=0x7f0cd80213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de1cb676e5b8531 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0cddd9b640 1 -- 172.21.15.55:0/3251724181 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800b2d0 con 0x7f0ce00703e0 2023-07-06T21:42:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0cddd9b640 1 -- 172.21.15.55:0/3251724181 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd80ad050 con 0x7f0ce00703e0 2023-07-06T21:42:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0cddd9b640 1 -- 172.21.15.55:0/3251724181 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8009820 con 0x7f0ce00703e0 2023-07-06T21:42:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3251724181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce00703e0 msgr2=0x7f0ce0070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0ce4c7b640 1 --2- 172.21.15.55:0/3251724181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce00703e0 0x7f0ce0070880 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ce006eb70 tx=0x7f0cd80213c0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3251724181 shutdown_connections 2023-07-06T21:42:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0ce4c7b640 1 --2- 172.21.15.55:0/3251724181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce00703e0 0x7f0ce0070880 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0ce4c7b640 1 --2- 172.21.15.55:0/3251724181 >> v2:172.21.15.138:3300/0 conn(0x7f0ce00ca130 0x7f0ce00ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0ce4c7b640 1 --2- 172.21.15.55:0/3251724181 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ce0158850 0x7f0ce00cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3251724181 >> 172.21.15.55:0/3251724181 conn(0x7f0ce00cea70 msgr2=0x7f0ce00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:55.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3251724181 shutdown_connections 2023-07-06T21:42:55.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3251724181 wait complete. 2023-07-06T21:42:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0ce4c7b640 1 Processor -- start 2023-07-06T21:42:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.530+0000 7f0ce4c7b640 1 -- start start 2023-07-06T21:42:55.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0ce4c7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce00703e0 0x7f0ce00c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0ce4c7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ce00ca130 0x7f0ce006a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0ce4c7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ce0158850 0x7f0ce006c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0ce4c7b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce006ac70 con 0x7f0ce00703e0 2023-07-06T21:42:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0ce4c7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce006af50 con 0x7f0ce0158850 2023-07-06T21:42:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0ce4c7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce006b230 con 0x7f0ce00ca130 2023-07-06T21:42:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cde59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce00703e0 0x7f0ce00c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cde59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce00703e0 0x7f0ce00c34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41508/0 (socket says 172.21.15.55:41508) 2023-07-06T21:42:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cde59c640 1 -- 172.21.15.55:0/3463930733 learned_addr learned my addr 172.21.15.55:0/3463930733 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cd7fff640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ce00ca130 0x7f0ce006a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cded9d640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ce0158850 0x7f0ce006c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cde59c640 1 -- 172.21.15.55:0/3463930733 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ce00ca130 msgr2=0x7f0ce006a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cde59c640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ce00ca130 0x7f0ce006a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cde59c640 1 -- 172.21.15.55:0/3463930733 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ce0158850 msgr2=0x7f0ce006c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cde59c640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ce0158850 0x7f0ce006c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cde59c640 1 -- 172.21.15.55:0/3463930733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd800bd40 con 0x7f0ce00703e0 2023-07-06T21:42:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cded9d640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ce0158850 0x7f0ce006c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cde59c640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce00703e0 0x7f0ce00c34e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000b410 tx=0x7f0cd000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cd6ffd640 1 -- 172.21.15.55:0/3463930733 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0011830 con 0x7f0ce00703e0 2023-07-06T21:42:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cd6ffd640 1 -- 172.21.15.55:0/3463930733 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd0011990 con 0x7f0ce00703e0 2023-07-06T21:42:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cd6ffd640 1 -- 172.21.15.55:0/3463930733 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0011d40 con 0x7f0ce00703e0 2023-07-06T21:42:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3463930733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce006b510 con 0x7f0ce00703e0 2023-07-06T21:42:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3463930733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce006bd10 con 0x7f0ce00703e0 2023-07-06T21:42:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3463930733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce0066d60 con 0x7f0ce00703e0 2023-07-06T21:42:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.534+0000 7f0cd6ffd640 1 -- 172.21.15.55:0/3463930733 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0cd001a400 con 0x7f0ce00703e0 2023-07-06T21:42:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.538+0000 7f0cd6ffd640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0cc0066280 0x7f0cc0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.538+0000 7f0cd6ffd640 1 -- 172.21.15.55:0/3463930733 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0cd00841f0 con 0x7f0ce00703e0 2023-07-06T21:42:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.538+0000 7f0cd7fff640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0cc0066280 0x7f0cc0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.538+0000 7f0cd7fff640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0cc0066280 0x7f0cc0068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00c8000 tx=0x7f0cc8009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:55.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.542+0000 7f0cd6ffd640 1 -- 172.21.15.55:0/3463930733 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0cd00512a0 con 0x7f0ce00703e0 2023-07-06T21:42:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.694+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3463930733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0ce006cd30 con 0x7f0ce00703e0 2023-07-06T21:42:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.694+0000 7f0cd6ffd640 1 -- 172.21.15.55:0/3463930733 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0cd00548c0 con 0x7f0ce00703e0 2023-07-06T21:42:55.702 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.698+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3463930733 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0cc0066280 msgr2=0x7f0cc0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.698+0000 7f0ce4c7b640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0cc0066280 0x7f0cc0068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00c8000 tx=0x7f0cc8009110 comp rx=0 tx=0).stop 2023-07-06T21:42:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.698+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3463930733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce00703e0 msgr2=0x7f0ce00c34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.698+0000 7f0ce4c7b640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce00703e0 0x7f0ce00c34e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000b410 tx=0x7f0cd000b8d0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.698+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3463930733 shutdown_connections 2023-07-06T21:42:55.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.698+0000 7f0ce4c7b640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0cc0066280 0x7f0cc0068730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.698+0000 7f0ce4c7b640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ce0158850 0x7f0ce006c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.698+0000 7f0ce4c7b640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ce00ca130 0x7f0ce006a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.698+0000 7f0ce4c7b640 1 --2- 172.21.15.55:0/3463930733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce00703e0 0x7f0ce00c34e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.698+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3463930733 >> 172.21.15.55:0/3463930733 conn(0x7f0ce00cea70 msgr2=0x7f0ce00afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:55.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.698+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3463930733 shutdown_connections 2023-07-06T21:42:55.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.698+0000 7f0ce4c7b640 1 -- 172.21.15.55:0/3463930733 wait complete. 2023-07-06T21:42:55.723 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:55.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb6280f9640 1 Processor -- start 2023-07-06T21:42:55.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb6280f9640 1 -- start start 2023-07-06T21:42:55.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb6280f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6200cf940 0x7fb6200cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb6280f9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb62006d670 0x7fb6200d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb6280f9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6200ce9e0 con 0x7fb6200d0790 2023-07-06T21:42:55.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb6280f9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb620159eb0 con 0x7fb62006d670 2023-07-06T21:42:55.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb6280f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6200cddd0 con 0x7fb6200cf940 2023-07-06T21:42:55.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb626696640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb6200d0790 0x7fb62015d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33018/0 (socket says 172.21.15.55:33018) 2023-07-06T21:42:55.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb626696640 1 -- 172.21.15.55:0/1491127570 learned_addr learned my addr 172.21.15.55:0/1491127570 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:55.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb625694640 1 --2- 172.21.15.55:0/1491127570 >> v2:172.21.15.138:3300/0 conn(0x7fb62006d670 0x7fb6200d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb625e95640 1 --2- 172.21.15.55:0/1491127570 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6200cf940 0x7fb6200cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb624e93640 1 -- 172.21.15.55:0/1491127570 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892364502 0 0) 0x7fb6200ce9e0 con 0x7fb6200d0790 2023-07-06T21:42:55.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb624e93640 1 -- 172.21.15.55:0/1491127570 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb60c003530 con 0x7fb6200d0790 2023-07-06T21:42:55.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb624e93640 1 -- 172.21.15.55:0/1491127570 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1209270149 0 0) 0x7fb60c003530 con 0x7fb6200d0790 2023-07-06T21:42:55.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb625e95640 1 -- 172.21.15.55:0/1491127570 >> v2:172.21.15.138:3300/0 conn(0x7fb62006d670 msgr2=0x7fb6200d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:55.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb625e95640 1 --2- 172.21.15.55:0/1491127570 >> v2:172.21.15.138:3300/0 conn(0x7fb62006d670 0x7fb6200d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb625e95640 1 -- 172.21.15.55:0/1491127570 >> v1:172.21.15.55:6789/0 conn(0x7fb6200d0790 legacy=0x7fb62015d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb625e95640 1 -- 172.21.15.55:0/1491127570 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6200ce0b0 con 0x7fb6200cf940 2023-07-06T21:42:55.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.862+0000 7fb625694640 1 --2- 172.21.15.55:0/1491127570 >> v2:172.21.15.138:3300/0 conn(0x7fb62006d670 0x7fb6200d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:42:55.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.866+0000 7fb625e95640 1 --2- 172.21.15.55:0/1491127570 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6200cf940 0x7fb6200cfd10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0097f0 tx=0x7fb61c01c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50a23e44d4c4a841 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:55.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.866+0000 7fb624e93640 1 -- 172.21.15.55:0/1491127570 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb618001a00 con 0x7fb6200cf940 2023-07-06T21:42:55.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.866+0000 7fb624e93640 1 -- 172.21.15.55:0/1491127570 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c0a7050 con 0x7fb6200cf940 2023-07-06T21:42:55.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.866+0000 7fb624e93640 1 -- 172.21.15.55:0/1491127570 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0ab620 con 0x7fb6200cf940 2023-07-06T21:42:55.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.866+0000 7fb6280f9640 1 -- 172.21.15.55:0/1491127570 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6200cf940 msgr2=0x7fb6200cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.866+0000 7fb6280f9640 1 --2- 172.21.15.55:0/1491127570 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6200cf940 0x7fb6200cfd10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0097f0 tx=0x7fb61c01c2e0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.866+0000 7fb6280f9640 1 -- 172.21.15.55:0/1491127570 shutdown_connections 2023-07-06T21:42:55.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.866+0000 7fb6280f9640 1 --2- 172.21.15.55:0/1491127570 >> v2:172.21.15.138:3300/0 conn(0x7fb62006d670 0x7fb6200d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.866+0000 7fb6280f9640 1 --2- 172.21.15.55:0/1491127570 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6200cf940 0x7fb6200cfd10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.866+0000 7fb6280f9640 1 -- 172.21.15.55:0/1491127570 >> 172.21.15.55:0/1491127570 conn(0x7fb62006ee80 msgr2=0x7fb62006f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:55.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.866+0000 7fb6280f9640 1 -- 172.21.15.55:0/1491127570 shutdown_connections 2023-07-06T21:42:55.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.866+0000 7fb6280f9640 1 -- 172.21.15.55:0/1491127570 wait complete. 2023-07-06T21:42:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb6280f9640 1 Processor -- start 2023-07-06T21:42:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb6280f9640 1 -- start start 2023-07-06T21:42:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb6280f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62006d670 0x7fb620153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb6280f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6200cf940 0x7fb620154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb6280f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6200d0790 0x7fb6201577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb6280f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb620154c60 con 0x7fb62006d670 2023-07-06T21:42:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb6280f9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb620154f00 con 0x7fb6200d0790 2023-07-06T21:42:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb6280f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6201551e0 con 0x7fb6200cf940 2023-07-06T21:42:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb625e95640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62006d670 0x7fb620153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb625e95640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62006d670 0x7fb620153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41524/0 (socket says 172.21.15.55:41524) 2023-07-06T21:42:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb625e95640 1 -- 172.21.15.55:0/1352199873 learned_addr learned my addr 172.21.15.55:0/1352199873 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb625694640 1 --2- 172.21.15.55:0/1352199873 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6200cf940 0x7fb620154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb626696640 1 --2- 172.21.15.55:0/1352199873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6200d0790 0x7fb6201577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb625e95640 1 -- 172.21.15.55:0/1352199873 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6200cf940 msgr2=0x7fb620154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb625e95640 1 --2- 172.21.15.55:0/1352199873 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6200cf940 0x7fb620154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb625e95640 1 -- 172.21.15.55:0/1352199873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6200d0790 msgr2=0x7fb6201577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:55.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb625e95640 1 --2- 172.21.15.55:0/1352199873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6200d0790 0x7fb6201577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:55.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb625e95640 1 -- 172.21.15.55:0/1352199873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610009420 con 0x7fb62006d670 2023-07-06T21:42:55.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb625e95640 1 --2- 172.21.15.55:0/1352199873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62006d670 0x7fb620153f50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0ae040 tx=0x7fb61c01ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb6167fc640 1 -- 172.21.15.55:0/1352199873 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0b7450 con 0x7fb62006d670 2023-07-06T21:42:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb6167fc640 1 -- 172.21.15.55:0/1352199873 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c0b75d0 con 0x7fb62006d670 2023-07-06T21:42:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb6167fc640 1 -- 172.21.15.55:0/1352199873 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0b7980 con 0x7fb62006d670 2023-07-06T21:42:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb6280f9640 1 -- 172.21.15.55:0/1352199873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61c009420 con 0x7fb62006d670 2023-07-06T21:42:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.870+0000 7fb6280f9640 1 -- 172.21.15.55:0/1352199873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb620151750 con 0x7fb62006d670 2023-07-06T21:42:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.874+0000 7fb6280f9640 1 -- 172.21.15.55:0/1352199873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6200cc650 con 0x7fb62006d670 2023-07-06T21:42:55.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.874+0000 7fb6167fc640 1 -- 172.21.15.55:0/1352199873 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb61c0b7ae0 con 0x7fb62006d670 2023-07-06T21:42:55.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.874+0000 7fb6167fc640 1 --2- 172.21.15.55:0/1352199873 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb604066280 0x7fb604068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:55.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.874+0000 7fb6167fc640 1 -- 172.21.15.55:0/1352199873 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb61c11e8b0 con 0x7fb62006d670 2023-07-06T21:42:55.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.874+0000 7fb625694640 1 --2- 172.21.15.55:0/1352199873 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb604066280 0x7fb604068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:55.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.874+0000 7fb625694640 1 --2- 172.21.15.55:0/1352199873 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb604066280 0x7fb604068730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb620152f30 tx=0x7fb610009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:55.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:55.878+0000 7fb6167fc640 1 -- 172.21.15.55:0/1352199873 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb61c0ebbc0 con 0x7fb62006d670 2023-07-06T21:42:56.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.034+0000 7fb6280f9640 1 -- 172.21.15.55:0/1352199873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb620155690 con 0x7fb62006d670 2023-07-06T21:42:56.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.034+0000 7fb6167fc640 1 -- 172.21.15.55:0/1352199873 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fb61c0ef1e0 con 0x7fb62006d670 2023-07-06T21:42:56.043 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:56.043 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":29,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:51.480379+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:56.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.038+0000 7fb6280f9640 1 -- 172.21.15.55:0/1352199873 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb604066280 msgr2=0x7fb604068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.038+0000 7fb6280f9640 1 --2- 172.21.15.55:0/1352199873 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb604066280 0x7fb604068730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb620152f30 tx=0x7fb610009190 comp rx=0 tx=0).stop 2023-07-06T21:42:56.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.038+0000 7fb6280f9640 1 -- 172.21.15.55:0/1352199873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62006d670 msgr2=0x7fb620153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.038+0000 7fb6280f9640 1 --2- 172.21.15.55:0/1352199873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62006d670 0x7fb620153f50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0ae040 tx=0x7fb61c01ab20 comp rx=0 tx=0).stop 2023-07-06T21:42:56.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.038+0000 7fb6280f9640 1 -- 172.21.15.55:0/1352199873 shutdown_connections 2023-07-06T21:42:56.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.038+0000 7fb6280f9640 1 --2- 172.21.15.55:0/1352199873 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb604066280 0x7fb604068730 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.038+0000 7fb6280f9640 1 --2- 172.21.15.55:0/1352199873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6200d0790 0x7fb6201577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.038+0000 7fb6280f9640 1 --2- 172.21.15.55:0/1352199873 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6200cf940 0x7fb620154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.038+0000 7fb6280f9640 1 --2- 172.21.15.55:0/1352199873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62006d670 0x7fb620153f50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.038+0000 7fb6280f9640 1 -- 172.21.15.55:0/1352199873 >> 172.21.15.55:0/1352199873 conn(0x7fb62006ee80 msgr2=0x7fb62006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:56.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.038+0000 7fb6280f9640 1 -- 172.21.15.55:0/1352199873 shutdown_connections 2023-07-06T21:42:56.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.038+0000 7fb6280f9640 1 -- 172.21.15.55:0/1352199873 wait complete. 2023-07-06T21:42:56.064 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:42:08.597013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:42:09.843890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T21:42:12.918111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T21:42:56.065 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:42:56.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.202+0000 7fbcbf60b640 1 Processor -- start 2023-07-06T21:42:56.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcbf60b640 1 -- start start 2023-07-06T21:42:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcbf60b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbcb8158850 0x7fbcb80cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcbf60b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbcb8070af0 0x7fbcb80ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcbf60b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb8158c20 con 0x7fbcb80ca130 2023-07-06T21:42:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcbf60b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb80b2aa0 con 0x7fbcb8070af0 2023-07-06T21:42:56.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcbf60b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb80c8db0 con 0x7fbcb8158850 2023-07-06T21:42:56.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcbdba8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbcb8070af0 0x7fbcb80ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcbcba6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbcb80ca130 0x7fbcb80703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33034/0 (socket says 172.21.15.55:33034) 2023-07-06T21:42:56.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcbcba6640 1 -- 172.21.15.55:0/1428450674 learned_addr learned my addr 172.21.15.55:0/1428450674 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcbd3a7640 1 --2- 172.21.15.55:0/1428450674 >> v2:172.21.15.138:3300/0 conn(0x7fbcb8158850 0x7fbcb80cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcbdba8640 1 -- 172.21.15.55:0/1428450674 >> v2:172.21.15.138:3300/0 conn(0x7fbcb8158850 msgr2=0x7fbcb80cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcbdba8640 1 --2- 172.21.15.55:0/1428450674 >> v2:172.21.15.138:3300/0 conn(0x7fbcb8158850 0x7fbcb80cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcbdba8640 1 -- 172.21.15.55:0/1428450674 >> v1:172.21.15.55:6789/0 conn(0x7fbcb80ca130 legacy=0x7fbcb80703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcaffff640 1 -- 172.21.15.55:0/1428450674 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694678431 0 0) 0x7fbcb8158c20 con 0x7fbcb80ca130 2023-07-06T21:42:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.206+0000 7fbcbdba8640 1 -- 172.21.15.55:0/1428450674 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb80c9090 con 0x7fbcb8070af0 2023-07-06T21:42:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.210+0000 7fbcbdba8640 1 --2- 172.21.15.55:0/1428450674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb8070af0 0x7fbcb80ccf70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbcb806eaf0 tx=0x7fbcb001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d79e2828437ab9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.210+0000 7fbcaffff640 1 -- 172.21.15.55:0/1428450674 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00a59a0 con 0x7fbcb8070af0 2023-07-06T21:42:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.210+0000 7fbcaffff640 1 -- 172.21.15.55:0/1428450674 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb00a5b00 con 0x7fbcb8070af0 2023-07-06T21:42:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.210+0000 7fbcaffff640 1 -- 172.21.15.55:0/1428450674 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00a5e90 con 0x7fbcb8070af0 2023-07-06T21:42:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.210+0000 7fbcbf60b640 1 -- 172.21.15.55:0/1428450674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb8070af0 msgr2=0x7fbcb80ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.210+0000 7fbcbf60b640 1 --2- 172.21.15.55:0/1428450674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb8070af0 0x7fbcb80ccf70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbcb806eaf0 tx=0x7fbcb001c8e0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.210+0000 7fbcbf60b640 1 -- 172.21.15.55:0/1428450674 shutdown_connections 2023-07-06T21:42:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.210+0000 7fbcbf60b640 1 --2- 172.21.15.55:0/1428450674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb8070af0 0x7fbcb80ccf70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.210+0000 7fbcbf60b640 1 --2- 172.21.15.55:0/1428450674 >> v2:172.21.15.138:3300/0 conn(0x7fbcb8158850 0x7fbcb80cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.210+0000 7fbcbf60b640 1 -- 172.21.15.55:0/1428450674 >> 172.21.15.55:0/1428450674 conn(0x7fbcb80cea70 msgr2=0x7fbcb80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.210+0000 7fbcbf60b640 1 -- 172.21.15.55:0/1428450674 shutdown_connections 2023-07-06T21:42:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.210+0000 7fbcbf60b640 1 -- 172.21.15.55:0/1428450674 wait complete. 2023-07-06T21:42:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.210+0000 7fbcbf60b640 1 Processor -- start 2023-07-06T21:42:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.210+0000 7fbcbf60b640 1 -- start start 2023-07-06T21:42:56.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbf60b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbcb8070af0 0x7fbcb806bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbf60b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb80ca130 0x7fbcb80c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbf60b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbcb8158850 0x7fbcb80c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbf60b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80c6b20 con 0x7fbcb80ca130 2023-07-06T21:42:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbf60b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb8152c50 con 0x7fbcb8070af0 2023-07-06T21:42:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbf60b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb8152690 con 0x7fbcb8158850 2023-07-06T21:42:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbcba6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb80ca130 0x7fbcb80c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbcba6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb80ca130 0x7fbcb80c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41538/0 (socket says 172.21.15.55:41538) 2023-07-06T21:42:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbcba6640 1 -- 172.21.15.55:0/930724868 learned_addr learned my addr 172.21.15.55:0/930724868 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:56.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbd3a7640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbcb8070af0 0x7fbcb806bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbdba8640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbcb8158850 0x7fbcb80c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbcba6640 1 -- 172.21.15.55:0/930724868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbcb8158850 msgr2=0x7fbcb80c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbcba6640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbcb8158850 0x7fbcb80c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbcba6640 1 -- 172.21.15.55:0/930724868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbcb8070af0 msgr2=0x7fbcb806bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbcba6640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbcb8070af0 0x7fbcb806bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbcba6640 1 -- 172.21.15.55:0/930724868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb0009a70 con 0x7fbcb80ca130 2023-07-06T21:42:56.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbdba8640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbcb8158850 0x7fbcb80c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:56.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbcba6640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb80ca130 0x7fbcb80c60a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbca80011f0 tx=0x7fbca800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:56.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcadffb640 1 -- 172.21.15.55:0/930724868 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca80074e0 con 0x7fbcb80ca130 2023-07-06T21:42:56.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcadffb640 1 -- 172.21.15.55:0/930724868 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca8007640 con 0x7fbcb80ca130 2023-07-06T21:42:56.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcadffb640 1 -- 172.21.15.55:0/930724868 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8004a10 con 0x7fbcb80ca130 2023-07-06T21:42:56.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbf60b640 1 -- 172.21.15.55:0/930724868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb8152970 con 0x7fbcb80ca130 2023-07-06T21:42:56.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbf60b640 1 -- 172.21.15.55:0/930724868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb80697e0 con 0x7fbcb80ca130 2023-07-06T21:42:56.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcbf60b640 1 -- 172.21.15.55:0/930724868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb8066d60 con 0x7fbcb80ca130 2023-07-06T21:42:56.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.214+0000 7fbcadffb640 1 -- 172.21.15.55:0/930724868 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbca8004b70 con 0x7fbcb80ca130 2023-07-06T21:42:56.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.218+0000 7fbcadffb640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbc9c066280 0x7fbc9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.218+0000 7fbcadffb640 1 -- 172.21.15.55:0/930724868 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbca80832c0 con 0x7fbcb80ca130 2023-07-06T21:42:56.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.218+0000 7fbcbd3a7640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbc9c066280 0x7fbc9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.218+0000 7fbcbd3a7640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbc9c066280 0x7fbc9c068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400b930 tx=0x7fbcb4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:56.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.222+0000 7fbcadffb640 1 -- 172.21.15.55:0/930724868 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbca8050370 con 0x7fbcb80ca130 2023-07-06T21:42:56.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.374+0000 7fbcbf60b640 1 -- 172.21.15.55:0/930724868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbcb806cd30 con 0x7fbcb80ca130 2023-07-06T21:42:56.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.374+0000 7fbcadffb640 1 -- 172.21.15.55:0/930724868 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbca8053990 con 0x7fbcb80ca130 2023-07-06T21:42:56.382 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:42:56.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.378+0000 7fbcbf60b640 1 -- 172.21.15.55:0/930724868 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbc9c066280 msgr2=0x7fbc9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.378+0000 7fbcbf60b640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbc9c066280 0x7fbc9c068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400b930 tx=0x7fbcb4008040 comp rx=0 tx=0).stop 2023-07-06T21:42:56.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.378+0000 7fbcbf60b640 1 -- 172.21.15.55:0/930724868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb80ca130 msgr2=0x7fbcb80c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.378+0000 7fbcbf60b640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb80ca130 0x7fbcb80c60a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbca80011f0 tx=0x7fbca800c9b0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.378+0000 7fbcbf60b640 1 -- 172.21.15.55:0/930724868 shutdown_connections 2023-07-06T21:42:56.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.378+0000 7fbcbf60b640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbc9c066280 0x7fbc9c068730 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.378+0000 7fbcbf60b640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbcb8158850 0x7fbcb80c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.378+0000 7fbcbf60b640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb80ca130 0x7fbcb80c60a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.378+0000 7fbcbf60b640 1 --2- 172.21.15.55:0/930724868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbcb8070af0 0x7fbcb806bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.378+0000 7fbcbf60b640 1 -- 172.21.15.55:0/930724868 >> 172.21.15.55:0/930724868 conn(0x7fbcb80cea70 msgr2=0x7fbcb8150090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:56.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.378+0000 7fbcbf60b640 1 -- 172.21.15.55:0/930724868 shutdown_connections 2023-07-06T21:42:56.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.378+0000 7fbcbf60b640 1 -- 172.21.15.55:0/930724868 wait complete. 2023-07-06T21:42:56.403 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:42:56.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff2076d8640 1 Processor -- start 2023-07-06T21:42:56.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff2076d8640 1 -- start start 2023-07-06T21:42:56.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff2076d8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff2000709a0 0x7ff2000cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff2076d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2000cbe60 0x7ff2000b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff2076d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff200070d70 0x7ff2000b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff2076d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2000cc300 con 0x7ff2000cbe60 2023-07-06T21:42:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff2076d8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2000cc5e0 con 0x7ff2000709a0 2023-07-06T21:42:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff2076d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2000cc8c0 con 0x7ff200070d70 2023-07-06T21:42:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff204c73640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2000cbe60 0x7ff2000b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff204c73640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2000cbe60 0x7ff2000b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41542/0 (socket says 172.21.15.55:41542) 2023-07-06T21:42:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff204c73640 1 -- 172.21.15.55:0/368510632 learned_addr learned my addr 172.21.15.55:0/368510632 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:56.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff205474640 1 --2- 172.21.15.55:0/368510632 >> v2:172.21.15.138:3300/0 conn(0x7ff2000709a0 0x7ff2000cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff205c75640 1 --2- 172.21.15.55:0/368510632 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff200070d70 0x7ff2000b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff204c73640 1 -- 172.21.15.55:0/368510632 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff200070d70 msgr2=0x7ff2000b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:56.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff204c73640 1 --2- 172.21.15.55:0/368510632 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff200070d70 0x7ff2000b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff204c73640 1 -- 172.21.15.55:0/368510632 >> v2:172.21.15.138:3300/0 conn(0x7ff2000709a0 msgr2=0x7ff2000cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:56.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff204c73640 1 --2- 172.21.15.55:0/368510632 >> v2:172.21.15.138:3300/0 conn(0x7ff2000709a0 0x7ff2000cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff204c73640 1 -- 172.21.15.55:0/368510632 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2000ccba0 con 0x7ff2000cbe60 2023-07-06T21:42:56.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.542+0000 7ff205c75640 1 --2- 172.21.15.55:0/368510632 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff200070d70 0x7ff2000b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:56.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.546+0000 7ff204c73640 1 --2- 172.21.15.55:0/368510632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000cbe60 0x7ff2000b0c30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff20006ec60 tx=0x7ff1f001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2a6ef7390d1baa server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:56.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.546+0000 7ff1f7fff640 1 -- 172.21.15.55:0/368510632 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f00ac630 con 0x7ff2000cbe60 2023-07-06T21:42:56.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.546+0000 7ff1f7fff640 1 -- 172.21.15.55:0/368510632 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f00ac790 con 0x7ff2000cbe60 2023-07-06T21:42:56.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.546+0000 7ff1f7fff640 1 -- 172.21.15.55:0/368510632 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f00acb20 con 0x7ff2000cbe60 2023-07-06T21:42:56.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.546+0000 7ff2076d8640 1 -- 172.21.15.55:0/368510632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000cbe60 msgr2=0x7ff2000b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.546+0000 7ff2076d8640 1 --2- 172.21.15.55:0/368510632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000cbe60 0x7ff2000b0c30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff20006ec60 tx=0x7ff1f001c500 comp rx=0 tx=0).stop 2023-07-06T21:42:56.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.546+0000 7ff2076d8640 1 -- 172.21.15.55:0/368510632 shutdown_connections 2023-07-06T21:42:56.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.546+0000 7ff2076d8640 1 --2- 172.21.15.55:0/368510632 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff200070d70 0x7ff2000b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.546+0000 7ff2076d8640 1 --2- 172.21.15.55:0/368510632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000cbe60 0x7ff2000b0c30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.546+0000 7ff2076d8640 1 --2- 172.21.15.55:0/368510632 >> v2:172.21.15.138:3300/0 conn(0x7ff2000709a0 0x7ff2000cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.546+0000 7ff2076d8640 1 -- 172.21.15.55:0/368510632 >> 172.21.15.55:0/368510632 conn(0x7ff2000cea70 msgr2=0x7ff2000ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:56.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.546+0000 7ff2076d8640 1 -- 172.21.15.55:0/368510632 shutdown_connections 2023-07-06T21:42:56.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.546+0000 7ff2076d8640 1 -- 172.21.15.55:0/368510632 wait complete. 2023-07-06T21:42:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff2076d8640 1 Processor -- start 2023-07-06T21:42:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff2076d8640 1 -- start start 2023-07-06T21:42:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff2076d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000709a0 0x7ff200154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff2076d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff200070d70 0x7ff200162c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff2076d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2000cbe60 0x7ff2000c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff2076d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff200155ea0 con 0x7ff2000709a0 2023-07-06T21:42:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff2076d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2001555b0 con 0x7ff200070d70 2023-07-06T21:42:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff2076d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff200155850 con 0x7ff2000cbe60 2023-07-06T21:42:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff205474640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000709a0 0x7ff200154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff205474640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000709a0 0x7ff200154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41556/0 (socket says 172.21.15.55:41556) 2023-07-06T21:42:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff205474640 1 -- 172.21.15.55:0/148283747 learned_addr learned my addr 172.21.15.55:0/148283747 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff205c75640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2000cbe60 0x7ff2000c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff204c73640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff200070d70 0x7ff200162c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff205474640 1 -- 172.21.15.55:0/148283747 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2000cbe60 msgr2=0x7ff2000c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff205474640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2000cbe60 0x7ff2000c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff205474640 1 -- 172.21.15.55:0/148283747 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff200070d70 msgr2=0x7ff200162c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff205474640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff200070d70 0x7ff200162c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff205474640 1 -- 172.21.15.55:0/148283747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f00094d0 con 0x7ff2000709a0 2023-07-06T21:42:56.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff205c75640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2000cbe60 0x7ff2000c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:56.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff205474640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000709a0 0x7ff200154c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00e8b0 tx=0x7ff1fc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:56.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff1f5ffb640 1 -- 172.21.15.55:0/148283747 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc00c940 con 0x7ff2000709a0 2023-07-06T21:42:56.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff1f5ffb640 1 -- 172.21.15.55:0/148283747 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc00caa0 con 0x7ff2000709a0 2023-07-06T21:42:56.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff2076d8640 1 -- 172.21.15.55:0/148283747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff200155b30 con 0x7ff2000709a0 2023-07-06T21:42:56.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.550+0000 7ff1f5ffb640 1 -- 172.21.15.55:0/148283747 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc00ce30 con 0x7ff2000709a0 2023-07-06T21:42:56.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.554+0000 7ff2076d8640 1 -- 172.21.15.55:0/148283747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff200155190 con 0x7ff2000709a0 2023-07-06T21:42:56.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.554+0000 7ff2076d8640 1 -- 172.21.15.55:0/148283747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff200066d60 con 0x7ff2000709a0 2023-07-06T21:42:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.554+0000 7ff1f5ffb640 1 -- 172.21.15.55:0/148283747 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1fc013470 con 0x7ff2000709a0 2023-07-06T21:42:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.554+0000 7ff1f5ffb640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff1e40662b0 0x7ff1e4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.554+0000 7ff1f5ffb640 1 -- 172.21.15.55:0/148283747 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff1fc0841b0 con 0x7ff2000709a0 2023-07-06T21:42:56.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.554+0000 7ff204c73640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff1e40662b0 0x7ff1e4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.554+0000 7ff204c73640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff1e40662b0 0x7ff1e4068760 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00ae000 tx=0x7ff1f00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:56.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.558+0000 7ff1f5ffb640 1 -- 172.21.15.55:0/148283747 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1fc051300 con 0x7ff2000709a0 2023-07-06T21:42:56.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.714+0000 7ff2076d8640 1 -- 172.21.15.55:0/148283747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff2000c7e50 con 0x7ff2000709a0 2023-07-06T21:42:56.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.714+0000 7ff1f5ffb640 1 -- 172.21.15.55:0/148283747 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff1fc054920 con 0x7ff2000709a0 2023-07-06T21:42:56.722 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:42:56.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.718+0000 7ff2076d8640 1 -- 172.21.15.55:0/148283747 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff1e40662b0 msgr2=0x7ff1e4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.718+0000 7ff2076d8640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff1e40662b0 0x7ff1e4068760 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00ae000 tx=0x7ff1f00a7000 comp rx=0 tx=0).stop 2023-07-06T21:42:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.718+0000 7ff2076d8640 1 -- 172.21.15.55:0/148283747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000709a0 msgr2=0x7ff200154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.718+0000 7ff2076d8640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000709a0 0x7ff200154c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00e8b0 tx=0x7ff1fc00ed70 comp rx=0 tx=0).stop 2023-07-06T21:42:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.718+0000 7ff2076d8640 1 -- 172.21.15.55:0/148283747 shutdown_connections 2023-07-06T21:42:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.718+0000 7ff2076d8640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff1e40662b0 0x7ff1e4068760 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.718+0000 7ff2076d8640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2000cbe60 0x7ff2000c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.718+0000 7ff2076d8640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff200070d70 0x7ff200162c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.718+0000 7ff2076d8640 1 --2- 172.21.15.55:0/148283747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000709a0 0x7ff200154c50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.718+0000 7ff2076d8640 1 -- 172.21.15.55:0/148283747 >> 172.21.15.55:0/148283747 conn(0x7ff2000cea70 msgr2=0x7ff2000ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.718+0000 7ff2076d8640 1 -- 172.21.15.55:0/148283747 shutdown_connections 2023-07-06T21:42:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.718+0000 7ff2076d8640 1 -- 172.21.15.55:0/148283747 wait complete. 2023-07-06T21:42:56.742 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:42:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.878+0000 7fc40a7a3640 1 Processor -- start 2023-07-06T21:42:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc40a7a3640 1 -- start start 2023-07-06T21:42:56.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc40a7a3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc40406f0e0 0x7fc4040ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc40a7a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc4040cb7a0 0x7fc4040cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc40a7a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40415f5d0 con 0x7fc404156180 2023-07-06T21:42:56.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc40a7a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc404160250 con 0x7fc4040cb7a0 2023-07-06T21:42:56.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc40a7a3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40415f8b0 con 0x7fc40406f0e0 2023-07-06T21:42:56.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc403fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc404156180 0x7fc40406e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33038/0 (socket says 172.21.15.55:33038) 2023-07-06T21:42:56.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc403fff640 1 -- 172.21.15.55:0/2651965432 learned_addr learned my addr 172.21.15.55:0/2651965432 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:42:56.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc408d40640 1 --2- 172.21.15.55:0/2651965432 >> v2:172.21.15.55:3300/0 conn(0x7fc4040cb7a0 0x7fc4040cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc4037fe640 1 --2- 172.21.15.55:0/2651965432 >> v2:172.21.15.138:3300/0 conn(0x7fc40406f0e0 0x7fc4040ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc402ffd640 1 -- 172.21.15.55:0/2651965432 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468302390 0 0) 0x7fc40415f5d0 con 0x7fc404156180 2023-07-06T21:42:56.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc402ffd640 1 -- 172.21.15.55:0/2651965432 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3ec003530 con 0x7fc404156180 2023-07-06T21:42:56.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc408d40640 1 -- 172.21.15.55:0/2651965432 >> v2:172.21.15.138:3300/0 conn(0x7fc40406f0e0 msgr2=0x7fc4040ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:56.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc408d40640 1 --2- 172.21.15.55:0/2651965432 >> v2:172.21.15.138:3300/0 conn(0x7fc40406f0e0 0x7fc4040ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc408d40640 1 -- 172.21.15.55:0/2651965432 >> v1:172.21.15.55:6789/0 conn(0x7fc404156180 legacy=0x7fc40406e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc408d40640 1 -- 172.21.15.55:0/2651965432 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40415fb90 con 0x7fc4040cb7a0 2023-07-06T21:42:56.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.882+0000 7fc4037fe640 1 --2- 172.21.15.55:0/2651965432 >> v2:172.21.15.138:3300/0 conn(0x7fc40406f0e0 0x7fc4040ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:56.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.886+0000 7fc408d40640 1 --2- 172.21.15.55:0/2651965432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4040cb7a0 0x7fc4040cbba0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc4040cef40 tx=0x7fc3fc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4875f0554c3bc66 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:56.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.886+0000 7fc402ffd640 1 -- 172.21.15.55:0/2651965432 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0a5930 con 0x7fc4040cb7a0 2023-07-06T21:42:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.886+0000 7fc402ffd640 1 -- 172.21.15.55:0/2651965432 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc0a5a90 con 0x7fc4040cb7a0 2023-07-06T21:42:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.886+0000 7fc402ffd640 1 -- 172.21.15.55:0/2651965432 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0a5e20 con 0x7fc4040cb7a0 2023-07-06T21:42:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.886+0000 7fc40a7a3640 1 -- 172.21.15.55:0/2651965432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4040cb7a0 msgr2=0x7fc4040cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.886+0000 7fc40a7a3640 1 --2- 172.21.15.55:0/2651965432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4040cb7a0 0x7fc4040cbba0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc4040cef40 tx=0x7fc3fc01c850 comp rx=0 tx=0).stop 2023-07-06T21:42:56.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.886+0000 7fc40a7a3640 1 -- 172.21.15.55:0/2651965432 shutdown_connections 2023-07-06T21:42:56.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.886+0000 7fc40a7a3640 1 --2- 172.21.15.55:0/2651965432 >> v2:172.21.15.138:3300/0 conn(0x7fc40406f0e0 0x7fc4040ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.886+0000 7fc40a7a3640 1 --2- 172.21.15.55:0/2651965432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4040cb7a0 0x7fc4040cbba0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.886+0000 7fc40a7a3640 1 -- 172.21.15.55:0/2651965432 >> 172.21.15.55:0/2651965432 conn(0x7fc4040d0c50 msgr2=0x7fc4040cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:56.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.886+0000 7fc40a7a3640 1 -- 172.21.15.55:0/2651965432 shutdown_connections 2023-07-06T21:42:56.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.886+0000 7fc40a7a3640 1 -- 172.21.15.55:0/2651965432 wait complete. 2023-07-06T21:42:56.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.886+0000 7fc40a7a3640 1 Processor -- start 2023-07-06T21:42:56.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.886+0000 7fc40a7a3640 1 -- start start 2023-07-06T21:42:56.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc40a7a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc40406f0e0 0x7fc40414ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc40a7a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4040cb7a0 0x7fc40414e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc40a7a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc404156180 0x7fc4040c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc40a7a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4040c6ab0 con 0x7fc404156180 2023-07-06T21:42:56.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc40a7a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4040c3c90 con 0x7fc4040cb7a0 2023-07-06T21:42:56.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc40a7a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4040c3f70 con 0x7fc40406f0e0 2023-07-06T21:42:56.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc408d40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc404156180 0x7fc4040c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc408d40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc404156180 0x7fc4040c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41580/0 (socket says 172.21.15.55:41580) 2023-07-06T21:42:56.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc408d40640 1 -- 172.21.15.55:0/349650170 learned_addr learned my addr 172.21.15.55:0/349650170 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:56.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc408d40640 1 -- 172.21.15.55:0/349650170 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc40406f0e0 msgr2=0x7fc40414ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc408d40640 1 --2- 172.21.15.55:0/349650170 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc40406f0e0 0x7fc40414ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc408d40640 1 -- 172.21.15.55:0/349650170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4040cb7a0 msgr2=0x7fc40414e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:56.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc408d40640 1 --2- 172.21.15.55:0/349650170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4040cb7a0 0x7fc40414e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:56.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc408d40640 1 -- 172.21.15.55:0/349650170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc009a70 con 0x7fc404156180 2023-07-06T21:42:56.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc408d40640 1 --2- 172.21.15.55:0/349650170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc404156180 0x7fc4040c7090 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc019460 tx=0x7fc3fc0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:56.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc400ff9640 1 -- 172.21.15.55:0/349650170 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0a5930 con 0x7fc404156180 2023-07-06T21:42:56.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc400ff9640 1 -- 172.21.15.55:0/349650170 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc009450 con 0x7fc404156180 2023-07-06T21:42:56.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc400ff9640 1 -- 172.21.15.55:0/349650170 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0b9690 con 0x7fc404156180 2023-07-06T21:42:56.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc40a7a3640 1 -- 172.21.15.55:0/349650170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4040c4250 con 0x7fc404156180 2023-07-06T21:42:56.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc40a7a3640 1 -- 172.21.15.55:0/349650170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4040c6230 con 0x7fc404156180 2023-07-06T21:42:56.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc40a7a3640 1 -- 172.21.15.55:0/349650170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc404066d60 con 0x7fc404156180 2023-07-06T21:42:56.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.890+0000 7fc400ff9640 1 -- 172.21.15.55:0/349650170 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc3fc0b97f0 con 0x7fc404156180 2023-07-06T21:42:56.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.894+0000 7fc400ff9640 1 --2- 172.21.15.55:0/349650170 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc3f0066280 0x7fc3f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:56.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.894+0000 7fc400ff9640 1 -- 172.21.15.55:0/349650170 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc3fc11fb60 con 0x7fc404156180 2023-07-06T21:42:56.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.894+0000 7fc403fff640 1 --2- 172.21.15.55:0/349650170 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc3f0066280 0x7fc3f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:56.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.894+0000 7fc403fff640 1 --2- 172.21.15.55:0/349650170 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc3f0066280 0x7fc3f0068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4007fd0 tx=0x7fc3f4007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:56.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:56.898+0000 7fc400ff9640 1 -- 172.21.15.55:0/349650170 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc3fc0ecd30 con 0x7fc404156180 2023-07-06T21:42:57.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.050+0000 7fc40a7a3640 1 -- 172.21.15.55:0/349650170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4040c4700 con 0x7fc404156180 2023-07-06T21:42:57.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.054+0000 7fc400ff9640 1 -- 172.21.15.55:0/349650170 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3fc0f0350 con 0x7fc404156180 2023-07-06T21:42:57.060 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:57.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.054+0000 7fc40a7a3640 1 -- 172.21.15.55:0/349650170 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc3f0066280 msgr2=0x7fc3f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.054+0000 7fc40a7a3640 1 --2- 172.21.15.55:0/349650170 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc3f0066280 0x7fc3f0068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4007fd0 tx=0x7fc3f4007940 comp rx=0 tx=0).stop 2023-07-06T21:42:57.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.054+0000 7fc40a7a3640 1 -- 172.21.15.55:0/349650170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc404156180 msgr2=0x7fc4040c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.054+0000 7fc40a7a3640 1 --2- 172.21.15.55:0/349650170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc404156180 0x7fc4040c7090 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc019460 tx=0x7fc3fc0195f0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.054+0000 7fc40a7a3640 1 -- 172.21.15.55:0/349650170 shutdown_connections 2023-07-06T21:42:57.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.054+0000 7fc40a7a3640 1 --2- 172.21.15.55:0/349650170 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc3f0066280 0x7fc3f0068730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.054+0000 7fc40a7a3640 1 --2- 172.21.15.55:0/349650170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc404156180 0x7fc4040c7090 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.054+0000 7fc40a7a3640 1 --2- 172.21.15.55:0/349650170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4040cb7a0 0x7fc40414e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.054+0000 7fc40a7a3640 1 --2- 172.21.15.55:0/349650170 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc40406f0e0 0x7fc40414ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.054+0000 7fc40a7a3640 1 -- 172.21.15.55:0/349650170 >> 172.21.15.55:0/349650170 conn(0x7fc4040d0c50 msgr2=0x7fc4040ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:57.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.054+0000 7fc40a7a3640 1 -- 172.21.15.55:0/349650170 shutdown_connections 2023-07-06T21:42:57.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.054+0000 7fc40a7a3640 1 -- 172.21.15.55:0/349650170 wait complete. 2023-07-06T21:42:57.080 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:42:57.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.218+0000 7fd0a2d37640 1 Processor -- start 2023-07-06T21:42:57.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.218+0000 7fd0a2d37640 1 -- start start 2023-07-06T21:42:57.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.222+0000 7fd0a2d37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd09c0709a0 0x7fd09c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.222+0000 7fd0a2d37640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd09c0b1340 0x7fd09c06eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.222+0000 7fd0a2d37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09c0cc300 con 0x7fd09c0cbe60 2023-07-06T21:42:57.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.222+0000 7fd0a2d37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c0cc5e0 con 0x7fd09c0709a0 2023-07-06T21:42:57.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.222+0000 7fd0a2d37640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c0cc8c0 con 0x7fd09c0b1340 2023-07-06T21:42:57.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.222+0000 7fd0a0ad3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd09c0709a0 0x7fd09c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.222+0000 7fd0a0ad3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd09c0709a0 0x7fd09c0cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41584/0 (socket says 172.21.15.55:41584) 2023-07-06T21:42:57.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.222+0000 7fd0a0ad3640 1 -- 172.21.15.55:0/1732460336 learned_addr learned my addr 172.21.15.55:0/1732460336 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:57.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.222+0000 7fd09bfff640 1 --1- 172.21.15.55:0/1732460336 >> v1:172.21.15.55:6789/0 conn(0x7fd09c0cbe60 0x7fd09c0b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33050/0 (socket says 172.21.15.55:33050) 2023-07-06T21:42:57.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.222+0000 7fd0a12d4640 1 --2- 172.21.15.55:0/1732460336 >> v2:172.21.15.138:3300/0 conn(0x7fd09c0b1340 0x7fd09c06eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.222+0000 7fd0a0ad3640 1 -- 172.21.15.55:0/1732460336 >> v2:172.21.15.138:3300/0 conn(0x7fd09c0b1340 msgr2=0x7fd09c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:57.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.222+0000 7fd0a0ad3640 1 --2- 172.21.15.55:0/1732460336 >> v2:172.21.15.138:3300/0 conn(0x7fd09c0b1340 0x7fd09c06eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.222+0000 7fd0a0ad3640 1 -- 172.21.15.55:0/1732460336 >> v1:172.21.15.55:6789/0 conn(0x7fd09c0cbe60 legacy=0x7fd09c0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.222+0000 7fd0a0ad3640 1 -- 172.21.15.55:0/1732460336 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c0ccba0 con 0x7fd09c0709a0 2023-07-06T21:42:57.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.226+0000 7fd0a0ad3640 1 --2- 172.21.15.55:0/1732460336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09c0709a0 0x7fd09c0cb920 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0b18b0 tx=0x7fd09001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16b7413e578df06 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:57.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.226+0000 7fd09b7fe640 1 -- 172.21.15.55:0/1732460336 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0900ab610 con 0x7fd09c0709a0 2023-07-06T21:42:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.226+0000 7fd09b7fe640 1 -- 172.21.15.55:0/1732460336 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0900ab770 con 0x7fd09c0709a0 2023-07-06T21:42:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.226+0000 7fd09b7fe640 1 -- 172.21.15.55:0/1732460336 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0900abb00 con 0x7fd09c0709a0 2023-07-06T21:42:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.226+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1732460336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09c0709a0 msgr2=0x7fd09c0cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.226+0000 7fd0a2d37640 1 --2- 172.21.15.55:0/1732460336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09c0709a0 0x7fd09c0cb920 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0b18b0 tx=0x7fd09001c500 comp rx=0 tx=0).stop 2023-07-06T21:42:57.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.226+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1732460336 shutdown_connections 2023-07-06T21:42:57.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.226+0000 7fd0a2d37640 1 --2- 172.21.15.55:0/1732460336 >> v2:172.21.15.138:3300/0 conn(0x7fd09c0b1340 0x7fd09c06eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.226+0000 7fd0a2d37640 1 --2- 172.21.15.55:0/1732460336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09c0709a0 0x7fd09c0cb920 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.226+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1732460336 >> 172.21.15.55:0/1732460336 conn(0x7fd09c0cea70 msgr2=0x7fd09c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:57.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.226+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1732460336 shutdown_connections 2023-07-06T21:42:57.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.226+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1732460336 wait complete. 2023-07-06T21:42:57.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.226+0000 7fd0a2d37640 1 Processor -- start 2023-07-06T21:42:57.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.226+0000 7fd0a2d37640 1 -- start start 2023-07-06T21:42:57.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a2d37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09c0709a0 0x7fd09c1f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a2d37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09c0b1340 0x7fd09c1f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a2d37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09c0cbe60 0x7fd09c09d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a2d37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0c83a0 con 0x7fd09c0709a0 2023-07-06T21:42:57.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a2d37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c1f74b0 con 0x7fd09c0cbe60 2023-07-06T21:42:57.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a2d37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0c85f0 con 0x7fd09c0b1340 2023-07-06T21:42:57.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a0ad3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09c0709a0 0x7fd09c1f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a0ad3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09c0709a0 0x7fd09c1f4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41590/0 (socket says 172.21.15.55:41590) 2023-07-06T21:42:57.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a0ad3640 1 -- 172.21.15.55:0/1755229234 learned_addr learned my addr 172.21.15.55:0/1755229234 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:57.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a0ad3640 1 -- 172.21.15.55:0/1755229234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09c0b1340 msgr2=0x7fd09c1f6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd09bfff640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09c0b1340 0x7fd09c1f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a12d4640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09c0cbe60 0x7fd09c09d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a0ad3640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09c0b1340 0x7fd09c1f6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a0ad3640 1 -- 172.21.15.55:0/1755229234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09c0cbe60 msgr2=0x7fd09c09d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a0ad3640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09c0cbe60 0x7fd09c09d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a0ad3640 1 -- 172.21.15.55:0/1755229234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900094d0 con 0x7fd09c0709a0 2023-07-06T21:42:57.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd09bfff640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09c0b1340 0x7fd09c1f6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:57.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a0ad3640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09c0709a0 0x7fd09c1f4170 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd090019110 tx=0x7fd09001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:57.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0997fa640 1 -- 172.21.15.55:0/1755229234 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0900ab610 con 0x7fd09c0709a0 2023-07-06T21:42:57.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0997fa640 1 -- 172.21.15.55:0/1755229234 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0900b4800 con 0x7fd09c0709a0 2023-07-06T21:42:57.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1755229234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09c0c88d0 con 0x7fd09c0709a0 2023-07-06T21:42:57.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0997fa640 1 -- 172.21.15.55:0/1755229234 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0900b4b90 con 0x7fd09c0709a0 2023-07-06T21:42:57.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1755229234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c0c8e90 con 0x7fd09c0709a0 2023-07-06T21:42:57.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1755229234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c066d60 con 0x7fd09c0709a0 2023-07-06T21:42:57.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.230+0000 7fd0997fa640 1 -- 172.21.15.55:0/1755229234 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0900b4cf0 con 0x7fd09c0709a0 2023-07-06T21:42:57.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.234+0000 7fd0997fa640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd080066280 0x7fd080068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.234+0000 7fd0997fa640 1 -- 172.21.15.55:0/1755229234 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd09011ebf0 con 0x7fd09c0709a0 2023-07-06T21:42:57.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.234+0000 7fd09bfff640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd080066280 0x7fd080068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.234+0000 7fd09bfff640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd080066280 0x7fd080068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd09c1647f0 tx=0x7fd088009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:57.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.238+0000 7fd0997fa640 1 -- 172.21.15.55:0/1755229234 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0900ebd30 con 0x7fd09c0709a0 2023-07-06T21:42:57.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.390+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1755229234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd09c0c7e50 con 0x7fd09c0709a0 2023-07-06T21:42:57.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.390+0000 7fd0997fa640 1 -- 172.21.15.55:0/1755229234 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0900ef350 con 0x7fd09c0709a0 2023-07-06T21:42:57.399 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:42:57.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.394+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1755229234 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd080066280 msgr2=0x7fd080068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.394+0000 7fd0a2d37640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd080066280 0x7fd080068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd09c1647f0 tx=0x7fd088009040 comp rx=0 tx=0).stop 2023-07-06T21:42:57.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.394+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1755229234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09c0709a0 msgr2=0x7fd09c1f4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.394+0000 7fd0a2d37640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09c0709a0 0x7fd09c1f4170 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd090019110 tx=0x7fd09001ad40 comp rx=0 tx=0).stop 2023-07-06T21:42:57.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.394+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1755229234 shutdown_connections 2023-07-06T21:42:57.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.394+0000 7fd0a2d37640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd080066280 0x7fd080068730 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.394+0000 7fd0a2d37640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09c0cbe60 0x7fd09c09d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.394+0000 7fd0a2d37640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09c0b1340 0x7fd09c1f6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.394+0000 7fd0a2d37640 1 --2- 172.21.15.55:0/1755229234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09c0709a0 0x7fd09c1f4170 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.394+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1755229234 >> 172.21.15.55:0/1755229234 conn(0x7fd09c0cea70 msgr2=0x7fd09c06c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:57.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.394+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1755229234 shutdown_connections 2023-07-06T21:42:57.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.394+0000 7fd0a2d37640 1 -- 172.21.15.55:0/1755229234 wait complete. 2023-07-06T21:42:57.419 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T21:42:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.558+0000 7f818d2af640 1 Processor -- start 2023-07-06T21:42:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.558+0000 7f818d2af640 1 -- start start 2023-07-06T21:42:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.562+0000 7f818d2af640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81880d0630 0x7f818815fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.562+0000 7f818d2af640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81880ce200 0x7f81880ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.562+0000 7f818d2af640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81880cc740 con 0x7f81880b1250 2023-07-06T21:42:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.562+0000 7f818d2af640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81880ccc90 con 0x7f81880ce200 2023-07-06T21:42:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.562+0000 7f818d2af640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81880b29c0 con 0x7f81880d0630 2023-07-06T21:42:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.562+0000 7f818caae640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81880ce200 0x7f81880ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.562+0000 7f818caae640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81880ce200 0x7f81880ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41602/0 (socket says 172.21.15.55:41602) 2023-07-06T21:42:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.562+0000 7f818caae640 1 -- 172.21.15.55:0/3825635609 learned_addr learned my addr 172.21.15.55:0/3825635609 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.562+0000 7f8187fff640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f81880b1250 0x7f818815f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:48558/0 (socket says 172.21.15.55:48558) 2023-07-06T21:42:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.562+0000 7f81877fe640 1 --2- 172.21.15.55:0/3825635609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81880d0630 0x7f818815fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.562+0000 7f818caae640 1 -- 172.21.15.55:0/3825635609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81880d0630 msgr2=0x7f818815fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.562+0000 7f818caae640 1 --2- 172.21.15.55:0/3825635609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81880d0630 0x7f818815fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.562+0000 7f818caae640 1 -- 172.21.15.55:0/3825635609 >> v1:172.21.15.138:6789/0 conn(0x7f81880b1250 legacy=0x7f818815f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.562+0000 7f818caae640 1 -- 172.21.15.55:0/3825635609 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81880d1d10 con 0x7f81880ce200 2023-07-06T21:42:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818caae640 1 --2- 172.21.15.55:0/3825635609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81880ce200 0x7f81880ce680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8180009e50 tx=0x7f818001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3241492cef51e4db server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f8186ffd640 1 -- 172.21.15.55:0/3825635609 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81800a5730 con 0x7f81880ce200 2023-07-06T21:42:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f8186ffd640 1 -- 172.21.15.55:0/3825635609 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81800a5890 con 0x7f81880ce200 2023-07-06T21:42:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f8186ffd640 1 -- 172.21.15.55:0/3825635609 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81800a5c20 con 0x7f81880ce200 2023-07-06T21:42:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 -- 172.21.15.55:0/3825635609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81880ce200 msgr2=0x7f81880ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 --2- 172.21.15.55:0/3825635609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81880ce200 0x7f81880ce680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8180009e50 tx=0x7f818001c980 comp rx=0 tx=0).stop 2023-07-06T21:42:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 -- 172.21.15.55:0/3825635609 shutdown_connections 2023-07-06T21:42:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 --2- 172.21.15.55:0/3825635609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81880ce200 0x7f81880ce680 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 --2- 172.21.15.55:0/3825635609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81880d0630 0x7f818815fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 -- 172.21.15.55:0/3825635609 >> 172.21.15.55:0/3825635609 conn(0x7f81880b3b60 msgr2=0x7f81880b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:57.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 -- 172.21.15.55:0/3825635609 shutdown_connections 2023-07-06T21:42:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 -- 172.21.15.55:0/3825635609 wait complete. 2023-07-06T21:42:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 Processor -- start 2023-07-06T21:42:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 -- start start 2023-07-06T21:42:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81880b1250 0x7f818815d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81880ce200 0x7f8188155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81880d0630 0x7f8188157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818815eb80 con 0x7f81880d0630 2023-07-06T21:42:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8188155a80 con 0x7f81880b1250 2023-07-06T21:42:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.566+0000 7f818d2af640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818815c270 con 0x7f81880ce200 2023-07-06T21:42:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f818caae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81880d0630 0x7f8188157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f818caae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81880d0630 0x7f8188157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41608/0 (socket says 172.21.15.55:41608) 2023-07-06T21:42:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f818caae640 1 -- 172.21.15.55:0/919179950 learned_addr learned my addr 172.21.15.55:0/919179950 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f8187fff640 1 --2- 172.21.15.55:0/919179950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81880b1250 0x7f818815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f81877fe640 1 --2- 172.21.15.55:0/919179950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81880ce200 0x7f8188155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f818caae640 1 -- 172.21.15.55:0/919179950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81880ce200 msgr2=0x7f8188155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f818caae640 1 --2- 172.21.15.55:0/919179950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81880ce200 0x7f8188155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f818caae640 1 -- 172.21.15.55:0/919179950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81880b1250 msgr2=0x7f818815d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f818caae640 1 --2- 172.21.15.55:0/919179950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81880b1250 0x7f818815d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f818caae640 1 -- 172.21.15.55:0/919179950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8180009b30 con 0x7f81880d0630 2023-07-06T21:42:57.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f818caae640 1 --2- 172.21.15.55:0/919179950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81880d0630 0x7f8188157b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f818001a5b0 tx=0x7f8180019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:57.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f8184ff9640 1 -- 172.21.15.55:0/919179950 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81800b8670 con 0x7f81880d0630 2023-07-06T21:42:57.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f8184ff9640 1 -- 172.21.15.55:0/919179950 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81800b87d0 con 0x7f81880d0630 2023-07-06T21:42:57.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f8184ff9640 1 -- 172.21.15.55:0/919179950 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81800b8b60 con 0x7f81880d0630 2023-07-06T21:42:57.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f818d2af640 1 -- 172.21.15.55:0/919179950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818815c550 con 0x7f81880d0630 2023-07-06T21:42:57.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f818d2af640 1 -- 172.21.15.55:0/919179950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818815cb10 con 0x7f81880d0630 2023-07-06T21:42:57.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f818d2af640 1 -- 172.21.15.55:0/919179950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81880b6f60 con 0x7f81880d0630 2023-07-06T21:42:57.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.570+0000 7f8184ff9640 1 -- 172.21.15.55:0/919179950 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f81800b8cc0 con 0x7f81880d0630 2023-07-06T21:42:57.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.574+0000 7f8184ff9640 1 --2- 172.21.15.55:0/919179950 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8174066280 0x7f8174068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.574+0000 7f8184ff9640 1 -- 172.21.15.55:0/919179950 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f81880cf3d0 con 0x7f81880d0630 2023-07-06T21:42:57.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.574+0000 7f8187fff640 1 --2- 172.21.15.55:0/919179950 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8174066280 0x7f8174068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.574+0000 7f8187fff640 1 --2- 172.21.15.55:0/919179950 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8174066280 0x7f8174068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8178000f70 tx=0x7f8178007e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:57.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.578+0000 7f8184ff9640 1 -- 172.21.15.55:0/919179950 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81800ec560 con 0x7f81880d0630 2023-07-06T21:42:57.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.730+0000 7f818d2af640 1 -- 172.21.15.55:0/919179950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f81880b6b80 con 0x7f81880d0630 2023-07-06T21:42:57.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.730+0000 7f8184ff9640 1 -- 172.21.15.55:0/919179950 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8180009510 con 0x7f81880d0630 2023-07-06T21:42:57.738 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:57.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.734+0000 7f818d2af640 1 -- 172.21.15.55:0/919179950 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8174066280 msgr2=0x7f8174068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.734+0000 7f818d2af640 1 --2- 172.21.15.55:0/919179950 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8174066280 0x7f8174068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8178000f70 tx=0x7f8178007e50 comp rx=0 tx=0).stop 2023-07-06T21:42:57.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.734+0000 7f818d2af640 1 -- 172.21.15.55:0/919179950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81880d0630 msgr2=0x7f8188157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.734+0000 7f818d2af640 1 --2- 172.21.15.55:0/919179950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81880d0630 0x7f8188157b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f818001a5b0 tx=0x7f8180019720 comp rx=0 tx=0).stop 2023-07-06T21:42:57.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.734+0000 7f818d2af640 1 -- 172.21.15.55:0/919179950 shutdown_connections 2023-07-06T21:42:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.734+0000 7f818d2af640 1 --2- 172.21.15.55:0/919179950 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8174066280 0x7f8174068730 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.734+0000 7f818d2af640 1 --2- 172.21.15.55:0/919179950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81880d0630 0x7f8188157b10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.734+0000 7f818d2af640 1 --2- 172.21.15.55:0/919179950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81880ce200 0x7f8188155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.734+0000 7f818d2af640 1 --2- 172.21.15.55:0/919179950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81880b1250 0x7f818815d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.734+0000 7f818d2af640 1 -- 172.21.15.55:0/919179950 >> 172.21.15.55:0/919179950 conn(0x7f81880b3b60 msgr2=0x7f818806a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.734+0000 7f818d2af640 1 -- 172.21.15.55:0/919179950 shutdown_connections 2023-07-06T21:42:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.734+0000 7f818d2af640 1 -- 172.21.15.55:0/919179950 wait complete. 2023-07-06T21:42:57.773 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-07-06T21:42:57.774 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-06T21:42:57.774 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-07-06T21:42:57.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.910+0000 7f0b6d3e9640 1 Processor -- start 2023-07-06T21:42:57.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.910+0000 7f0b6d3e9640 1 -- start start 2023-07-06T21:42:57.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b6d3e9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b68158400 0x7f0b680c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b6d3e9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0b680c9680 0x7f0b68070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b6d3e9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b680710c0 0x7f0b680cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b6d3e9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6806fae0 con 0x7f0b68158400 2023-07-06T21:42:57.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b6d3e9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6806fdc0 con 0x7f0b680c9680 2023-07-06T21:42:57.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b6d3e9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680700a0 con 0x7f0b680710c0 2023-07-06T21:42:57.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b66ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b68158400 0x7f0b680c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b66ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b68158400 0x7f0b680c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41622/0 (socket says 172.21.15.55:41622) 2023-07-06T21:42:57.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b66ffd640 1 -- 172.21.15.55:0/4016848001 learned_addr learned my addr 172.21.15.55:0/4016848001 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:57.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b5ffff640 1 --2- 172.21.15.55:0/4016848001 >> v2:172.21.15.138:3300/0 conn(0x7f0b680c9680 0x7f0b68070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b677fe640 1 --2- 172.21.15.55:0/4016848001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b680710c0 0x7f0b680cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b66ffd640 1 -- 172.21.15.55:0/4016848001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b680710c0 msgr2=0x7f0b680cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:57.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b66ffd640 1 --2- 172.21.15.55:0/4016848001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b680710c0 0x7f0b680cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b66ffd640 1 -- 172.21.15.55:0/4016848001 >> v2:172.21.15.138:3300/0 conn(0x7f0b680c9680 msgr2=0x7f0b68070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:57.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b66ffd640 1 --2- 172.21.15.55:0/4016848001 >> v2:172.21.15.138:3300/0 conn(0x7f0b680c9680 0x7f0b68070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b66ffd640 1 -- 172.21.15.55:0/4016848001 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b68070380 con 0x7f0b68158400 2023-07-06T21:42:57.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.914+0000 7f0b677fe640 1 --2- 172.21.15.55:0/4016848001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b680710c0 0x7f0b680cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:57.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b66ffd640 1 --2- 172.21.15.55:0/4016848001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b68158400 0x7f0b680c9140 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0b6806f060 tx=0x7f0b5801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2136ab76968e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:57.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b667fc640 1 -- 172.21.15.55:0/4016848001 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580a7c50 con 0x7f0b68158400 2023-07-06T21:42:57.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b667fc640 1 -- 172.21.15.55:0/4016848001 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b580a7db0 con 0x7f0b68158400 2023-07-06T21:42:57.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b667fc640 1 -- 172.21.15.55:0/4016848001 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580af660 con 0x7f0b68158400 2023-07-06T21:42:57.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/4016848001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b68158400 msgr2=0x7f0b680c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b6d3e9640 1 --2- 172.21.15.55:0/4016848001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b68158400 0x7f0b680c9140 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0b6806f060 tx=0x7f0b5801eba0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/4016848001 shutdown_connections 2023-07-06T21:42:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b6d3e9640 1 --2- 172.21.15.55:0/4016848001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b680710c0 0x7f0b680cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b6d3e9640 1 --2- 172.21.15.55:0/4016848001 >> v2:172.21.15.138:3300/0 conn(0x7f0b680c9680 0x7f0b68070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b6d3e9640 1 --2- 172.21.15.55:0/4016848001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b68158400 0x7f0b680c9140 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/4016848001 >> 172.21.15.55:0/4016848001 conn(0x7f0b680cded0 msgr2=0x7f0b680ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:57.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/4016848001 shutdown_connections 2023-07-06T21:42:57.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/4016848001 wait complete. 2023-07-06T21:42:57.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b6d3e9640 1 Processor -- start 2023-07-06T21:42:57.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b6d3e9640 1 -- start start 2023-07-06T21:42:57.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b6d3e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680710c0 0x7f0b68161770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.918+0000 7f0b6d3e9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b680c9680 0x7f0b680c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b6d3e9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68158400 0x7f0b6814faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b6d3e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6815bbb0 con 0x7f0b680710c0 2023-07-06T21:42:57.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b6d3e9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b68161cb0 con 0x7f0b680c9680 2023-07-06T21:42:57.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b6d3e9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b68161f30 con 0x7f0b68158400 2023-07-06T21:42:57.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b66ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680710c0 0x7f0b68161770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b66ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680710c0 0x7f0b68161770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41632/0 (socket says 172.21.15.55:41632) 2023-07-06T21:42:57.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b66ffd640 1 -- 172.21.15.55:0/3682597082 learned_addr learned my addr 172.21.15.55:0/3682597082 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:57.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b5ffff640 1 --2- 172.21.15.55:0/3682597082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b680c9680 0x7f0b680c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b677fe640 1 --2- 172.21.15.55:0/3682597082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68158400 0x7f0b6814faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b66ffd640 1 -- 172.21.15.55:0/3682597082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68158400 msgr2=0x7f0b6814faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b66ffd640 1 --2- 172.21.15.55:0/3682597082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68158400 0x7f0b6814faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b66ffd640 1 -- 172.21.15.55:0/3682597082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b680c9680 msgr2=0x7f0b680c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:57.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b66ffd640 1 --2- 172.21.15.55:0/3682597082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b680c9680 0x7f0b680c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:57.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b66ffd640 1 -- 172.21.15.55:0/3682597082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5800b770 con 0x7f0b680710c0 2023-07-06T21:42:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b66ffd640 1 --2- 172.21.15.55:0/3682597082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680710c0 0x7f0b68161770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800b2c0 tx=0x7f0b5801b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b5f7fe640 1 -- 172.21.15.55:0/3682597082 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580afcf0 con 0x7f0b680710c0 2023-07-06T21:42:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b5f7fe640 1 -- 172.21.15.55:0/3682597082 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b580afe50 con 0x7f0b680710c0 2023-07-06T21:42:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b5f7fe640 1 -- 172.21.15.55:0/3682597082 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580ba690 con 0x7f0b680710c0 2023-07-06T21:42:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/3682597082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b68162210 con 0x7f0b680710c0 2023-07-06T21:42:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/3682597082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b681627d0 con 0x7f0b680710c0 2023-07-06T21:42:57.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/3682597082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6806c580 con 0x7f0b680710c0 2023-07-06T21:42:57.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.922+0000 7f0b5f7fe640 1 -- 172.21.15.55:0/3682597082 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b580b6070 con 0x7f0b680710c0 2023-07-06T21:42:57.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.926+0000 7f0b5f7fe640 1 --2- 172.21.15.55:0/3682597082 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b48066280 0x7f0b48068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:57.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.926+0000 7f0b5f7fe640 1 -- 172.21.15.55:0/3682597082 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0b5811f3c0 con 0x7f0b680710c0 2023-07-06T21:42:57.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.926+0000 7f0b5ffff640 1 --2- 172.21.15.55:0/3682597082 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b48066280 0x7f0b48068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:57.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.926+0000 7f0b5ffff640 1 --2- 172.21.15.55:0/3682597082 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b48066280 0x7f0b48068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b68157640 tx=0x7f0b50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:57.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:57.930+0000 7f0b5f7fe640 1 -- 172.21.15.55:0/3682597082 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b580ec500 con 0x7f0b680710c0 2023-07-06T21:42:58.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.138+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/3682597082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f0b68066d60 con 0x7f0b680710c0 2023-07-06T21:42:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.518+0000 7f0b5f7fe640 1 -- 172.21.15.55:0/3682597082 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v68) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0b580efb20 con 0x7f0b680710c0 2023-07-06T21:42:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.518+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/3682597082 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b48066280 msgr2=0x7f0b48068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.518+0000 7f0b6d3e9640 1 --2- 172.21.15.55:0/3682597082 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b48066280 0x7f0b48068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b68157640 tx=0x7f0b50008040 comp rx=0 tx=0).stop 2023-07-06T21:42:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.518+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/3682597082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680710c0 msgr2=0x7f0b68161770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.518+0000 7f0b6d3e9640 1 --2- 172.21.15.55:0/3682597082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680710c0 0x7f0b68161770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800b2c0 tx=0x7f0b5801b940 comp rx=0 tx=0).stop 2023-07-06T21:42:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.518+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/3682597082 shutdown_connections 2023-07-06T21:42:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.518+0000 7f0b6d3e9640 1 --2- 172.21.15.55:0/3682597082 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b48066280 0x7f0b48068730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.518+0000 7f0b6d3e9640 1 --2- 172.21.15.55:0/3682597082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68158400 0x7f0b6814faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.518+0000 7f0b6d3e9640 1 --2- 172.21.15.55:0/3682597082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b680c9680 0x7f0b680c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.518+0000 7f0b6d3e9640 1 --2- 172.21.15.55:0/3682597082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680710c0 0x7f0b68161770 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.518+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/3682597082 >> 172.21.15.55:0/3682597082 conn(0x7f0b680cded0 msgr2=0x7f0b680ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.518+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/3682597082 shutdown_connections 2023-07-06T21:42:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.518+0000 7f0b6d3e9640 1 -- 172.21.15.55:0/3682597082 wait complete. 2023-07-06T21:42:58.548 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:42:58.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0cad626640 1 Processor -- start 2023-07-06T21:42:58.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0cad626640 1 -- start start 2023-07-06T21:42:58.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0cad626640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ca8158400 0x7f0ca80c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:58.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0cad626640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ca80c9680 0x7f0ca8070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:58.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0cad626640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0ca80710c0 0x7f0ca80cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:58.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0cad626640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca806fae0 con 0x7f0ca80c9680 2023-07-06T21:42:58.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0cad626640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca806fdc0 con 0x7f0ca80710c0 2023-07-06T21:42:58.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0cad626640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80700a0 con 0x7f0ca8158400 2023-07-06T21:42:58.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0c9ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ca80c9680 0x7f0ca8070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:58.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0c9ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ca80c9680 0x7f0ca8070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41640/0 (socket says 172.21.15.55:41640) 2023-07-06T21:42:58.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0c9ffff640 1 -- 172.21.15.55:0/783124134 learned_addr learned my addr 172.21.15.55:0/783124134 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:58.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0ca77fe640 1 --2- 172.21.15.55:0/783124134 >> v2:172.21.15.138:3300/0 conn(0x7f0ca80710c0 0x7f0ca80cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:58.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0ca6ffd640 1 --2- 172.21.15.55:0/783124134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ca8158400 0x7f0ca80c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0c9ffff640 1 -- 172.21.15.55:0/783124134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ca8158400 msgr2=0x7f0ca80c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0c9ffff640 1 --2- 172.21.15.55:0/783124134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ca8158400 0x7f0ca80c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0c9ffff640 1 -- 172.21.15.55:0/783124134 >> v2:172.21.15.138:3300/0 conn(0x7f0ca80710c0 msgr2=0x7f0ca80cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0c9ffff640 1 --2- 172.21.15.55:0/783124134 >> v2:172.21.15.138:3300/0 conn(0x7f0ca80710c0 0x7f0ca80cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0c9ffff640 1 -- 172.21.15.55:0/783124134 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8070380 con 0x7f0ca80c9680 2023-07-06T21:42:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.686+0000 7f0ca77fe640 1 --2- 172.21.15.55:0/783124134 >> v2:172.21.15.138:3300/0 conn(0x7f0ca80710c0 0x7f0ca80cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:42:58.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.690+0000 7f0c9ffff640 1 --2- 172.21.15.55:0/783124134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca80c9680 0x7f0ca8070b80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80ad960 tx=0x7f0c9001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fe1e7bd9109af server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:58.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.690+0000 7f0ca67fc640 1 -- 172.21.15.55:0/783124134 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900a7c50 con 0x7f0ca80c9680 2023-07-06T21:42:58.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.690+0000 7f0ca67fc640 1 -- 172.21.15.55:0/783124134 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c900a7db0 con 0x7f0ca80c9680 2023-07-06T21:42:58.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.690+0000 7f0ca67fc640 1 -- 172.21.15.55:0/783124134 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900af660 con 0x7f0ca80c9680 2023-07-06T21:42:58.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.690+0000 7f0cad626640 1 -- 172.21.15.55:0/783124134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca80c9680 msgr2=0x7f0ca8070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:58.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.690+0000 7f0cad626640 1 --2- 172.21.15.55:0/783124134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca80c9680 0x7f0ca8070b80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80ad960 tx=0x7f0c9001eba0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.690+0000 7f0cad626640 1 -- 172.21.15.55:0/783124134 shutdown_connections 2023-07-06T21:42:58.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.690+0000 7f0cad626640 1 --2- 172.21.15.55:0/783124134 >> v2:172.21.15.138:3300/0 conn(0x7f0ca80710c0 0x7f0ca80cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.690+0000 7f0cad626640 1 --2- 172.21.15.55:0/783124134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca80c9680 0x7f0ca8070b80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.690+0000 7f0cad626640 1 --2- 172.21.15.55:0/783124134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ca8158400 0x7f0ca80c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.690+0000 7f0cad626640 1 -- 172.21.15.55:0/783124134 >> 172.21.15.55:0/783124134 conn(0x7f0ca80cded0 msgr2=0x7f0ca80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:58.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.690+0000 7f0cad626640 1 -- 172.21.15.55:0/783124134 shutdown_connections 2023-07-06T21:42:58.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.690+0000 7f0cad626640 1 -- 172.21.15.55:0/783124134 wait complete. 2023-07-06T21:42:58.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0cad626640 1 Processor -- start 2023-07-06T21:42:58.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0cad626640 1 -- start start 2023-07-06T21:42:58.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0cad626640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ca80710c0 0x7f0ca8154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:58.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0cad626640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca80c9680 0x7f0ca815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:58.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0cad626640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ca8158400 0x7f0ca815ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:58.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0cad626640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80c5c50 con 0x7f0ca80c9680 2023-07-06T21:42:58.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0cad626640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8154bb0 con 0x7f0ca80710c0 2023-07-06T21:42:58.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0cad626640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80c5040 con 0x7f0ca8158400 2023-07-06T21:42:58.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0c9ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca80c9680 0x7f0ca815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:58.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0c9ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca80c9680 0x7f0ca815a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41648/0 (socket says 172.21.15.55:41648) 2023-07-06T21:42:58.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0c9ffff640 1 -- 172.21.15.55:0/645402847 learned_addr learned my addr 172.21.15.55:0/645402847 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:58.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0ca6ffd640 1 --2- 172.21.15.55:0/645402847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ca80710c0 0x7f0ca8154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:58.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0ca77fe640 1 --2- 172.21.15.55:0/645402847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ca8158400 0x7f0ca815ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:58.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0c9ffff640 1 -- 172.21.15.55:0/645402847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ca8158400 msgr2=0x7f0ca815ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:58.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0c9ffff640 1 --2- 172.21.15.55:0/645402847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ca8158400 0x7f0ca815ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0c9ffff640 1 -- 172.21.15.55:0/645402847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ca80710c0 msgr2=0x7f0ca8154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:58.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0c9ffff640 1 --2- 172.21.15.55:0/645402847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ca80710c0 0x7f0ca8154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0c9ffff640 1 -- 172.21.15.55:0/645402847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9000b770 con 0x7f0ca80c9680 2023-07-06T21:42:58.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0c9ffff640 1 --2- 172.21.15.55:0/645402847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca80c9680 0x7f0ca815a6d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0c9001d250 tx=0x7f0c9001b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:58.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0c9f7fe640 1 -- 172.21.15.55:0/645402847 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900ba660 con 0x7f0ca80c9680 2023-07-06T21:42:58.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0c9f7fe640 1 -- 172.21.15.55:0/645402847 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c900ba7c0 con 0x7f0ca80c9680 2023-07-06T21:42:58.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0c9f7fe640 1 -- 172.21.15.55:0/645402847 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900bab70 con 0x7f0ca80c9680 2023-07-06T21:42:58.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0cad626640 1 -- 172.21.15.55:0/645402847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca80c5320 con 0x7f0ca80c9680 2023-07-06T21:42:58.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.694+0000 7f0cad626640 1 -- 172.21.15.55:0/645402847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca80c58e0 con 0x7f0ca80c9680 2023-07-06T21:42:58.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.698+0000 7f0cad626640 1 -- 172.21.15.55:0/645402847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca806c580 con 0x7f0ca80c9680 2023-07-06T21:42:58.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.698+0000 7f0c9f7fe640 1 -- 172.21.15.55:0/645402847 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c900c2360 con 0x7f0ca80c9680 2023-07-06T21:42:58.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.698+0000 7f0c9f7fe640 1 --2- 172.21.15.55:0/645402847 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0c88066280 0x7f0c88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:58.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.698+0000 7f0c9f7fe640 1 -- 172.21.15.55:0/645402847 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0c9011efe0 con 0x7f0ca80c9680 2023-07-06T21:42:58.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.698+0000 7f0ca6ffd640 1 --2- 172.21.15.55:0/645402847 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0c88066280 0x7f0c88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:58.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.698+0000 7f0ca6ffd640 1 --2- 172.21.15.55:0/645402847 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0c88066280 0x7f0c88068730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800b930 tx=0x7f0c98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:58.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.702+0000 7f0c9f7fe640 1 -- 172.21.15.55:0/645402847 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c900ec160 con 0x7f0ca80c9680 2023-07-06T21:42:58.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.858+0000 7f0cad626640 1 -- 172.21.15.55:0/645402847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ca8066d60 con 0x7f0ca80c9680 2023-07-06T21:42:58.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.858+0000 7f0c9f7fe640 1 -- 172.21.15.55:0/645402847 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f0c900bf020 con 0x7f0ca80c9680 2023-07-06T21:42:58.865 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:42:58.865 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":29,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:51.480379+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:42:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.858+0000 7f0cad626640 1 -- 172.21.15.55:0/645402847 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0c88066280 msgr2=0x7f0c88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.858+0000 7f0cad626640 1 --2- 172.21.15.55:0/645402847 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0c88066280 0x7f0c88068730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800b930 tx=0x7f0c98008040 comp rx=0 tx=0).stop 2023-07-06T21:42:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.858+0000 7f0cad626640 1 -- 172.21.15.55:0/645402847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca80c9680 msgr2=0x7f0ca815a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.858+0000 7f0cad626640 1 --2- 172.21.15.55:0/645402847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca80c9680 0x7f0ca815a6d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0c9001d250 tx=0x7f0c9001b940 comp rx=0 tx=0).stop 2023-07-06T21:42:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.858+0000 7f0cad626640 1 -- 172.21.15.55:0/645402847 shutdown_connections 2023-07-06T21:42:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.858+0000 7f0cad626640 1 --2- 172.21.15.55:0/645402847 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0c88066280 0x7f0c88068730 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.858+0000 7f0cad626640 1 --2- 172.21.15.55:0/645402847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ca8158400 0x7f0ca815ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.858+0000 7f0cad626640 1 --2- 172.21.15.55:0/645402847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca80c9680 0x7f0ca815a6d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.858+0000 7f0cad626640 1 --2- 172.21.15.55:0/645402847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ca80710c0 0x7f0ca8154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.858+0000 7f0cad626640 1 -- 172.21.15.55:0/645402847 >> 172.21.15.55:0/645402847 conn(0x7f0ca80cded0 msgr2=0x7f0ca81566c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.862+0000 7f0cad626640 1 -- 172.21.15.55:0/645402847 shutdown_connections 2023-07-06T21:42:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:58.862+0000 7f0cad626640 1 -- 172.21.15.55:0/645402847 wait complete. 2023-07-06T21:42:58.887 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:42:08.597013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:42:09.843890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T21:42:12.918111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T21:42:58.888 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:42:59.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.026+0000 7f3af9b82640 1 Processor -- start 2023-07-06T21:42:59.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.026+0000 7f3af9b82640 1 -- start start 2023-07-06T21:42:59.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.030+0000 7f3af9b82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3af4158850 0x7f3af40cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.030+0000 7f3af9b82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3af4070af0 0x7f3af40ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.030+0000 7f3af9b82640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af4158c20 con 0x7f3af40ca130 2023-07-06T21:42:59.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.030+0000 7f3af9b82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af40b2aa0 con 0x7f3af4070af0 2023-07-06T21:42:59.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.030+0000 7f3af9b82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af40c8db0 con 0x7f3af4158850 2023-07-06T21:42:59.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.030+0000 7f3af3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3af4070af0 0x7f3af40ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.030+0000 7f3af3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3af4070af0 0x7f3af40ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41650/0 (socket says 172.21.15.55:41650) 2023-07-06T21:42:59.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.030+0000 7f3af3fff640 1 -- 172.21.15.55:0/2751602226 learned_addr learned my addr 172.21.15.55:0/2751602226 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:59.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.030+0000 7f3af37fe640 1 --2- 172.21.15.55:0/2751602226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3af4158850 0x7f3af40cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.030+0000 7f3af3fff640 1 -- 172.21.15.55:0/2751602226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3af4158850 msgr2=0x7f3af40cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:59.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.030+0000 7f3af3fff640 1 --2- 172.21.15.55:0/2751602226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3af4158850 0x7f3af40cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.030+0000 7f3af3fff640 1 -- 172.21.15.55:0/2751602226 >> v1:172.21.15.138:6789/0 conn(0x7f3af40ca130 legacy=0x7f3af40703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:59.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.030+0000 7f3af3fff640 1 -- 172.21.15.55:0/2751602226 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af40c9090 con 0x7f3af4070af0 2023-07-06T21:42:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.034+0000 7f3af3fff640 1 --2- 172.21.15.55:0/2751602226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af4070af0 0x7f3af40ccf70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009e50 tx=0x7f3aec0213d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8385f68411e1209c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:59.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.034+0000 7f3af27fc640 1 -- 172.21.15.55:0/2751602226 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec0b1400 con 0x7f3af4070af0 2023-07-06T21:42:59.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.034+0000 7f3af27fc640 1 -- 172.21.15.55:0/2751602226 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec0ad050 con 0x7f3af4070af0 2023-07-06T21:42:59.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.034+0000 7f3af27fc640 1 -- 172.21.15.55:0/2751602226 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec0b1780 con 0x7f3af4070af0 2023-07-06T21:42:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.034+0000 7f3af9b82640 1 -- 172.21.15.55:0/2751602226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af4070af0 msgr2=0x7f3af40ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.034+0000 7f3af9b82640 1 --2- 172.21.15.55:0/2751602226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af4070af0 0x7f3af40ccf70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009e50 tx=0x7f3aec0213d0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.034+0000 7f3af9b82640 1 -- 172.21.15.55:0/2751602226 shutdown_connections 2023-07-06T21:42:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.034+0000 7f3af9b82640 1 --2- 172.21.15.55:0/2751602226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af4070af0 0x7f3af40ccf70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.034+0000 7f3af9b82640 1 --2- 172.21.15.55:0/2751602226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3af4158850 0x7f3af40cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.034+0000 7f3af9b82640 1 -- 172.21.15.55:0/2751602226 >> 172.21.15.55:0/2751602226 conn(0x7f3af40cea70 msgr2=0x7f3af40ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.034+0000 7f3af9b82640 1 -- 172.21.15.55:0/2751602226 shutdown_connections 2023-07-06T21:42:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.034+0000 7f3af9b82640 1 -- 172.21.15.55:0/2751602226 wait complete. 2023-07-06T21:42:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.034+0000 7f3af9b82640 1 Processor -- start 2023-07-06T21:42:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.034+0000 7f3af9b82640 1 -- start start 2023-07-06T21:42:59.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af9b82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af4070af0 0x7f3af406bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af9b82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3af40ca130 0x7f3af40b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af9b82640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3af4158850 0x7f3af40693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af9b82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af406bb00 con 0x7f3af4070af0 2023-07-06T21:42:59.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af9b82640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af406ae80 con 0x7f3af4158850 2023-07-06T21:42:59.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af9b82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af406b160 con 0x7f3af40ca130 2023-07-06T21:42:59.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af4070af0 0x7f3af406bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af4070af0 0x7f3af406bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41658/0 (socket says 172.21.15.55:41658) 2023-07-06T21:42:59.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af37fe640 1 -- 172.21.15.55:0/467382835 learned_addr learned my addr 172.21.15.55:0/467382835 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:59.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af3fff640 1 --2- 172.21.15.55:0/467382835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3af4158850 0x7f3af40693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af2ffd640 1 --2- 172.21.15.55:0/467382835 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3af40ca130 0x7f3af40b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af37fe640 1 -- 172.21.15.55:0/467382835 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3af40ca130 msgr2=0x7f3af40b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af37fe640 1 --2- 172.21.15.55:0/467382835 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3af40ca130 0x7f3af40b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af37fe640 1 -- 172.21.15.55:0/467382835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3af4158850 msgr2=0x7f3af40693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af37fe640 1 --2- 172.21.15.55:0/467382835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3af4158850 0x7f3af40693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af37fe640 1 -- 172.21.15.55:0/467382835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec009b30 con 0x7f3af4070af0 2023-07-06T21:42:59.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af37fe640 1 --2- 172.21.15.55:0/467382835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af4070af0 0x7f3af406bf20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400c7f0 tx=0x7f3ae400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:59.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3adbfff640 1 -- 172.21.15.55:0/467382835 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4007820 con 0x7f3af4070af0 2023-07-06T21:42:59.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3adbfff640 1 -- 172.21.15.55:0/467382835 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae4007980 con 0x7f3af4070af0 2023-07-06T21:42:59.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3adbfff640 1 -- 172.21.15.55:0/467382835 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4007d30 con 0x7f3af4070af0 2023-07-06T21:42:59.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af9b82640 1 -- 172.21.15.55:0/467382835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af406b440 con 0x7f3af4070af0 2023-07-06T21:42:59.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af9b82640 1 -- 172.21.15.55:0/467382835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af4152830 con 0x7f3af4070af0 2023-07-06T21:42:59.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.038+0000 7f3af9b82640 1 -- 172.21.15.55:0/467382835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af4066d60 con 0x7f3af4070af0 2023-07-06T21:42:59.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.042+0000 7f3adbfff640 1 -- 172.21.15.55:0/467382835 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3ae40113f0 con 0x7f3af4070af0 2023-07-06T21:42:59.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.042+0000 7f3adbfff640 1 --2- 172.21.15.55:0/467382835 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3ae0066280 0x7f3ae0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.042+0000 7f3adbfff640 1 -- 172.21.15.55:0/467382835 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3ae40842b0 con 0x7f3af4070af0 2023-07-06T21:42:59.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.042+0000 7f3af2ffd640 1 --2- 172.21.15.55:0/467382835 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3ae0066280 0x7f3ae0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.042+0000 7f3af2ffd640 1 --2- 172.21.15.55:0/467382835 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3ae0066280 0x7f3ae0068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3af41f4500 tx=0x7f3ae8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:59.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.046+0000 7f3adbfff640 1 -- 172.21.15.55:0/467382835 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3ae40514b0 con 0x7f3af4070af0 2023-07-06T21:42:59.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.198+0000 7f3af9b82640 1 -- 172.21.15.55:0/467382835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3af406cd30 con 0x7f3af4070af0 2023-07-06T21:42:59.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.202+0000 7f3adbfff640 1 -- 172.21.15.55:0/467382835 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ae4054ad0 con 0x7f3af4070af0 2023-07-06T21:42:59.208 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:42:59.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.202+0000 7f3af9b82640 1 -- 172.21.15.55:0/467382835 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3ae0066280 msgr2=0x7f3ae0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.202+0000 7f3af9b82640 1 --2- 172.21.15.55:0/467382835 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3ae0066280 0x7f3ae0068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3af41f4500 tx=0x7f3ae8009040 comp rx=0 tx=0).stop 2023-07-06T21:42:59.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.202+0000 7f3af9b82640 1 -- 172.21.15.55:0/467382835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af4070af0 msgr2=0x7f3af406bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.202+0000 7f3af9b82640 1 --2- 172.21.15.55:0/467382835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af4070af0 0x7f3af406bf20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400c7f0 tx=0x7f3ae400ccb0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.202+0000 7f3af9b82640 1 -- 172.21.15.55:0/467382835 shutdown_connections 2023-07-06T21:42:59.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.202+0000 7f3af9b82640 1 --2- 172.21.15.55:0/467382835 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3ae0066280 0x7f3ae0068730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.202+0000 7f3af9b82640 1 --2- 172.21.15.55:0/467382835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3af4158850 0x7f3af40693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.202+0000 7f3af9b82640 1 --2- 172.21.15.55:0/467382835 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3af40ca130 0x7f3af40b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.202+0000 7f3af9b82640 1 --2- 172.21.15.55:0/467382835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af4070af0 0x7f3af406bf20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.202+0000 7f3af9b82640 1 -- 172.21.15.55:0/467382835 >> 172.21.15.55:0/467382835 conn(0x7f3af40cea70 msgr2=0x7f3af40b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.202+0000 7f3af9b82640 1 -- 172.21.15.55:0/467382835 shutdown_connections 2023-07-06T21:42:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.202+0000 7f3af9b82640 1 -- 172.21.15.55:0/467382835 wait complete. 2023-07-06T21:42:59.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:42:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea95303640 1 Processor -- start 2023-07-06T21:42:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea95303640 1 -- start start 2023-07-06T21:42:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea95303640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fea900b7b90 0x7fea900d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea95303640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fea900b4300 0x7fea900b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea95303640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea900b5070 con 0x7fea900cc870 2023-07-06T21:42:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea95303640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea90160020 con 0x7fea900b7b90 2023-07-06T21:42:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea95303640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea901604b0 con 0x7fea900b4300 2023-07-06T21:42:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea8effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fea900b7b90 0x7fea900d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea8effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fea900b7b90 0x7fea900d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41674/0 (socket says 172.21.15.55:41674) 2023-07-06T21:42:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea8effd640 1 -- 172.21.15.55:0/2638561178 learned_addr learned my addr 172.21.15.55:0/2638561178 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea8f7fe640 1 --2- 172.21.15.55:0/2638561178 >> v2:172.21.15.138:3300/0 conn(0x7fea900b4300 0x7fea900b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea8effd640 1 -- 172.21.15.55:0/2638561178 >> v2:172.21.15.138:3300/0 conn(0x7fea900b4300 msgr2=0x7fea900b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea8effd640 1 --2- 172.21.15.55:0/2638561178 >> v2:172.21.15.138:3300/0 conn(0x7fea900b4300 0x7fea900b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea8effd640 1 -- 172.21.15.55:0/2638561178 >> v1:172.21.15.55:6789/0 conn(0x7fea900cc870 legacy=0x7fea900b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea8effd640 1 -- 172.21.15.55:0/2638561178 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea900cd030 con 0x7fea900b7b90 2023-07-06T21:42:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.370+0000 7fea8f7fe640 1 --2- 172.21.15.55:0/2638561178 >> v2:172.21.15.138:3300/0 conn(0x7fea900b4300 0x7fea900b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.374+0000 7fea8effd640 1 --2- 172.21.15.55:0/2638561178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea900b7b90 0x7fea900d1c40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fea9006c6a0 tx=0x7fea8001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbd416c3d318819 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.374+0000 7fea8dffb640 1 -- 172.21.15.55:0/2638561178 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea800aa430 con 0x7fea900b7b90 2023-07-06T21:42:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.374+0000 7fea8dffb640 1 -- 172.21.15.55:0/2638561178 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea800aa590 con 0x7fea900b7b90 2023-07-06T21:42:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.374+0000 7fea8dffb640 1 -- 172.21.15.55:0/2638561178 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea800aa920 con 0x7fea900b7b90 2023-07-06T21:42:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.374+0000 7fea95303640 1 -- 172.21.15.55:0/2638561178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea900b7b90 msgr2=0x7fea900d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.374+0000 7fea95303640 1 --2- 172.21.15.55:0/2638561178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea900b7b90 0x7fea900d1c40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fea9006c6a0 tx=0x7fea8001c4d0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.374+0000 7fea95303640 1 -- 172.21.15.55:0/2638561178 shutdown_connections 2023-07-06T21:42:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.374+0000 7fea95303640 1 --2- 172.21.15.55:0/2638561178 >> v2:172.21.15.138:3300/0 conn(0x7fea900b4300 0x7fea900b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.374+0000 7fea95303640 1 --2- 172.21.15.55:0/2638561178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea900b7b90 0x7fea900d1c40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.374+0000 7fea95303640 1 -- 172.21.15.55:0/2638561178 >> 172.21.15.55:0/2638561178 conn(0x7fea900ceca0 msgr2=0x7fea900cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.374+0000 7fea95303640 1 -- 172.21.15.55:0/2638561178 shutdown_connections 2023-07-06T21:42:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.374+0000 7fea95303640 1 -- 172.21.15.55:0/2638561178 wait complete. 2023-07-06T21:42:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea95303640 1 Processor -- start 2023-07-06T21:42:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea95303640 1 -- start start 2023-07-06T21:42:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea95303640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea900b4300 0x7fea900cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea95303640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea900b7b90 0x7fea90153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea95303640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea900cc870 0x7fea90153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea95303640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea900b5dc0 con 0x7fea900b4300 2023-07-06T21:42:59.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea95303640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea900c9e70 con 0x7fea900cc870 2023-07-06T21:42:59.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea95303640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea900b67e0 con 0x7fea900b7b90 2023-07-06T21:42:59.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea8effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea900b4300 0x7fea900cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea8effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea900b4300 0x7fea900cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41680/0 (socket says 172.21.15.55:41680) 2023-07-06T21:42:59.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea8effd640 1 -- 172.21.15.55:0/1647507475 learned_addr learned my addr 172.21.15.55:0/1647507475 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea8f7fe640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea900cc870 0x7fea90153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea8e7fc640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea900b7b90 0x7fea90153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea8effd640 1 -- 172.21.15.55:0/1647507475 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea900b7b90 msgr2=0x7fea90153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea8effd640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea900b7b90 0x7fea90153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea8effd640 1 -- 172.21.15.55:0/1647507475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea900cc870 msgr2=0x7fea90153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea8effd640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea900cc870 0x7fea90153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea8effd640 1 -- 172.21.15.55:0/1647507475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea800094d0 con 0x7fea900b4300 2023-07-06T21:42:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea8f7fe640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea900cc870 0x7fea90153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea8e7fc640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea900b7b90 0x7fea90153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:42:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea8effd640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea900b4300 0x7fea900cbb10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fea800ac040 tx=0x7fea8001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea777fe640 1 -- 172.21.15.55:0/1647507475 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea800b38c0 con 0x7fea900b4300 2023-07-06T21:42:59.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea777fe640 1 -- 172.21.15.55:0/1647507475 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea800b3a20 con 0x7fea900b4300 2023-07-06T21:42:59.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea95303640 1 -- 172.21.15.55:0/1647507475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea900b6ac0 con 0x7fea900b4300 2023-07-06T21:42:59.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea777fe640 1 -- 172.21.15.55:0/1647507475 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea800b3dd0 con 0x7fea900b4300 2023-07-06T21:42:59.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea95303640 1 -- 172.21.15.55:0/1647507475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea900b7080 con 0x7fea900b4300 2023-07-06T21:42:59.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.378+0000 7fea95303640 1 -- 172.21.15.55:0/1647507475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea90066d60 con 0x7fea900b4300 2023-07-06T21:42:59.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.382+0000 7fea777fe640 1 -- 172.21.15.55:0/1647507475 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea800c6390 con 0x7fea900b4300 2023-07-06T21:42:59.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.382+0000 7fea777fe640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fea7c066280 0x7fea7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.382+0000 7fea777fe640 1 -- 172.21.15.55:0/1647507475 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fea8011eb70 con 0x7fea900b4300 2023-07-06T21:42:59.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.382+0000 7fea8e7fc640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fea7c066280 0x7fea7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.382+0000 7fea8e7fc640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fea7c066280 0x7fea7c068730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fea90158fd0 tx=0x7fea84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:59.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.386+0000 7fea777fe640 1 -- 172.21.15.55:0/1647507475 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea800ebcb0 con 0x7fea900b4300 2023-07-06T21:42:59.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.542+0000 7fea95303640 1 -- 172.21.15.55:0/1647507475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fea900cd7e0 con 0x7fea900b4300 2023-07-06T21:42:59.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.542+0000 7fea777fe640 1 -- 172.21.15.55:0/1647507475 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fea800ef2d0 con 0x7fea900b4300 2023-07-06T21:42:59.549 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:42:59.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.542+0000 7fea95303640 1 -- 172.21.15.55:0/1647507475 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fea7c066280 msgr2=0x7fea7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.542+0000 7fea95303640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fea7c066280 0x7fea7c068730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fea90158fd0 tx=0x7fea84009040 comp rx=0 tx=0).stop 2023-07-06T21:42:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.542+0000 7fea95303640 1 -- 172.21.15.55:0/1647507475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea900b4300 msgr2=0x7fea900cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.542+0000 7fea95303640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea900b4300 0x7fea900cbb10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fea800ac040 tx=0x7fea8001ad10 comp rx=0 tx=0).stop 2023-07-06T21:42:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.542+0000 7fea95303640 1 -- 172.21.15.55:0/1647507475 shutdown_connections 2023-07-06T21:42:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.542+0000 7fea95303640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fea7c066280 0x7fea7c068730 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.542+0000 7fea95303640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea900cc870 0x7fea90153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.542+0000 7fea95303640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea900b7b90 0x7fea90153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.542+0000 7fea95303640 1 --2- 172.21.15.55:0/1647507475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea900b4300 0x7fea900cbb10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.542+0000 7fea95303640 1 -- 172.21.15.55:0/1647507475 >> 172.21.15.55:0/1647507475 conn(0x7fea900ceca0 msgr2=0x7fea900b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.542+0000 7fea95303640 1 -- 172.21.15.55:0/1647507475 shutdown_connections 2023-07-06T21:42:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.542+0000 7fea95303640 1 -- 172.21.15.55:0/1647507475 wait complete. 2023-07-06T21:42:59.570 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:42:59.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f1909574640 1 Processor -- start 2023-07-06T21:42:59.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f1909574640 1 -- start start 2023-07-06T21:42:59.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f1909574640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1904156180 0x7f19040ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f1909574640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f190406e9d0 0x7f190406ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f1909574640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f19040cb7a0 0x7f19040cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f1909574640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1904160250 con 0x7f190406e9d0 2023-07-06T21:42:59.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f1909574640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190406f360 con 0x7f19040cb7a0 2023-07-06T21:42:59.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f1909574640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f190415f5d0 con 0x7f1904156180 2023-07-06T21:42:59.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f19027fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f190406e9d0 0x7f190406ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f19027fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f190406e9d0 0x7f190406ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41690/0 (socket says 172.21.15.55:41690) 2023-07-06T21:42:59.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f19027fc640 1 -- 172.21.15.55:0/2630814089 learned_addr learned my addr 172.21.15.55:0/2630814089 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:59.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f19037fe640 1 --2- 172.21.15.55:0/2630814089 >> v2:172.21.15.138:3300/0 conn(0x7f19040cb7a0 0x7f19040cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f1902ffd640 1 --2- 172.21.15.55:0/2630814089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1904156180 0x7f19040ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f19027fc640 1 -- 172.21.15.55:0/2630814089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1904156180 msgr2=0x7f19040ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:59.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f19027fc640 1 --2- 172.21.15.55:0/2630814089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1904156180 0x7f19040ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f19027fc640 1 -- 172.21.15.55:0/2630814089 >> v2:172.21.15.138:3300/0 conn(0x7f19040cb7a0 msgr2=0x7f19040cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:42:59.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f19027fc640 1 --2- 172.21.15.55:0/2630814089 >> v2:172.21.15.138:3300/0 conn(0x7f19040cb7a0 0x7f19040cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.710+0000 7f19027fc640 1 -- 172.21.15.55:0/2630814089 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190415f8b0 con 0x7f190406e9d0 2023-07-06T21:42:59.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.714+0000 7f19027fc640 1 --2- 172.21.15.55:0/2630814089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f190406e9d0 0x7f190406ee20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1904072220 tx=0x7f18f801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41185b41c7be2ecd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.714+0000 7f1901ffb640 1 -- 172.21.15.55:0/2630814089 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f80ab600 con 0x7f190406e9d0 2023-07-06T21:42:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.714+0000 7f1901ffb640 1 -- 172.21.15.55:0/2630814089 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f80ab760 con 0x7f190406e9d0 2023-07-06T21:42:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.714+0000 7f1901ffb640 1 -- 172.21.15.55:0/2630814089 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f80abaf0 con 0x7f190406e9d0 2023-07-06T21:42:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.714+0000 7f1909574640 1 -- 172.21.15.55:0/2630814089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f190406e9d0 msgr2=0x7f190406ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.714+0000 7f1909574640 1 --2- 172.21.15.55:0/2630814089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f190406e9d0 0x7f190406ee20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1904072220 tx=0x7f18f801c440 comp rx=0 tx=0).stop 2023-07-06T21:42:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.714+0000 7f1909574640 1 -- 172.21.15.55:0/2630814089 shutdown_connections 2023-07-06T21:42:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.714+0000 7f1909574640 1 --2- 172.21.15.55:0/2630814089 >> v2:172.21.15.138:3300/0 conn(0x7f19040cb7a0 0x7f19040cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.714+0000 7f1909574640 1 --2- 172.21.15.55:0/2630814089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f190406e9d0 0x7f190406ee20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.714+0000 7f1909574640 1 --2- 172.21.15.55:0/2630814089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1904156180 0x7f19040ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.714+0000 7f1909574640 1 -- 172.21.15.55:0/2630814089 >> 172.21.15.55:0/2630814089 conn(0x7f19040d0c50 msgr2=0x7f19040cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:59.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.714+0000 7f1909574640 1 -- 172.21.15.55:0/2630814089 shutdown_connections 2023-07-06T21:42:59.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.714+0000 7f1909574640 1 -- 172.21.15.55:0/2630814089 wait complete. 2023-07-06T21:42:59.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f1909574640 1 Processor -- start 2023-07-06T21:42:59.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f1909574640 1 -- start start 2023-07-06T21:42:59.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f1909574640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f190406e9d0 0x7f19040c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f1909574640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19040cb7a0 0x7f19040cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f1909574640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1904156180 0x7f19040c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f1909574640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19040c3d90 con 0x7f1904156180 2023-07-06T21:42:59.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f1909574640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19040c5c60 con 0x7f19040cb7a0 2023-07-06T21:42:59.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f1909574640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19040c5f40 con 0x7f190406e9d0 2023-07-06T21:42:59.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f19037fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1904156180 0x7f19040c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f19027fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19040cb7a0 0x7f19040cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f1902ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f190406e9d0 0x7f19040c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f19037fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1904156180 0x7f19040c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41694/0 (socket says 172.21.15.55:41694) 2023-07-06T21:42:59.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f19037fe640 1 -- 172.21.15.55:0/2286727709 learned_addr learned my addr 172.21.15.55:0/2286727709 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:42:59.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f19037fe640 1 -- 172.21.15.55:0/2286727709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f190406e9d0 msgr2=0x7f19040c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f19037fe640 1 --2- 172.21.15.55:0/2286727709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f190406e9d0 0x7f19040c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f19037fe640 1 -- 172.21.15.55:0/2286727709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19040cb7a0 msgr2=0x7f19040cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f19037fe640 1 --2- 172.21.15.55:0/2286727709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19040cb7a0 0x7f19040cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f19037fe640 1 -- 172.21.15.55:0/2286727709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f80094d0 con 0x7f1904156180 2023-07-06T21:42:59.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f19037fe640 1 --2- 172.21.15.55:0/2286727709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1904156180 0x7f19040c7df0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f18fc007e60 tx=0x7f18fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:59.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f18eb7fe640 1 -- 172.21.15.55:0/2286727709 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc014620 con 0x7f1904156180 2023-07-06T21:42:59.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f18eb7fe640 1 -- 172.21.15.55:0/2286727709 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18fc00ee90 con 0x7f1904156180 2023-07-06T21:42:59.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f18eb7fe640 1 -- 172.21.15.55:0/2286727709 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0149e0 con 0x7f1904156180 2023-07-06T21:42:59.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f1909574640 1 -- 172.21.15.55:0/2286727709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19040c6220 con 0x7f1904156180 2023-07-06T21:42:59.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.718+0000 7f1909574640 1 -- 172.21.15.55:0/2286727709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19040ce330 con 0x7f1904156180 2023-07-06T21:42:59.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.722+0000 7f1909574640 1 -- 172.21.15.55:0/2286727709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19040c3af0 con 0x7f1904156180 2023-07-06T21:42:59.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.722+0000 7f18eb7fe640 1 -- 172.21.15.55:0/2286727709 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18fc014b40 con 0x7f1904156180 2023-07-06T21:42:59.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.722+0000 7f18eb7fe640 1 --2- 172.21.15.55:0/2286727709 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f18f0066280 0x7f18f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:42:59.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.722+0000 7f18eb7fe640 1 -- 172.21.15.55:0/2286727709 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f18fc084850 con 0x7f1904156180 2023-07-06T21:42:59.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.722+0000 7f1902ffd640 1 --2- 172.21.15.55:0/2286727709 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f18f0066280 0x7f18f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:42:59.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.722+0000 7f1902ffd640 1 --2- 172.21.15.55:0/2286727709 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f18f0066280 0x7f18f0068730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f18f40079c0 tx=0x7f18f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:42:59.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.726+0000 7f18eb7fe640 1 -- 172.21.15.55:0/2286727709 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19040c3af0 con 0x7f1904156180 2023-07-06T21:42:59.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.878+0000 7f1909574640 1 -- 172.21.15.55:0/2286727709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f19040c3ed0 con 0x7f1904156180 2023-07-06T21:42:59.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.878+0000 7f18eb7fe640 1 -- 172.21.15.55:0/2286727709 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f19040c3ed0 con 0x7f1904156180 2023-07-06T21:42:59.886 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:42:59.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.878+0000 7f1909574640 1 -- 172.21.15.55:0/2286727709 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f18f0066280 msgr2=0x7f18f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.878+0000 7f1909574640 1 --2- 172.21.15.55:0/2286727709 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f18f0066280 0x7f18f0068730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f18f40079c0 tx=0x7f18f4008040 comp rx=0 tx=0).stop 2023-07-06T21:42:59.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.878+0000 7f1909574640 1 -- 172.21.15.55:0/2286727709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1904156180 msgr2=0x7f19040c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:42:59.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.878+0000 7f1909574640 1 --2- 172.21.15.55:0/2286727709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1904156180 0x7f19040c7df0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f18fc007e60 tx=0x7f18fc00e4b0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.882+0000 7f1909574640 1 -- 172.21.15.55:0/2286727709 shutdown_connections 2023-07-06T21:42:59.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.882+0000 7f1909574640 1 --2- 172.21.15.55:0/2286727709 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f18f0066280 0x7f18f0068730 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.882+0000 7f1909574640 1 --2- 172.21.15.55:0/2286727709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1904156180 0x7f19040c7df0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.882+0000 7f1909574640 1 --2- 172.21.15.55:0/2286727709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19040cb7a0 0x7f19040cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.882+0000 7f1909574640 1 --2- 172.21.15.55:0/2286727709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f190406e9d0 0x7f19040c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:42:59.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.882+0000 7f1909574640 1 -- 172.21.15.55:0/2286727709 >> 172.21.15.55:0/2286727709 conn(0x7f19040d0c50 msgr2=0x7f19040b4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:42:59.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.882+0000 7f1909574640 1 -- 172.21.15.55:0/2286727709 shutdown_connections 2023-07-06T21:42:59.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:42:59.882+0000 7f1909574640 1 -- 172.21.15.55:0/2286727709 wait complete. 2023-07-06T21:42:59.907 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:43:00.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f464e007640 1 Processor -- start 2023-07-06T21:43:00.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f464e007640 1 -- start start 2023-07-06T21:43:00.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f464e007640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46480cd510 0x7f46480cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f464e007640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46480cbd50 0x7f464815fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f464e007640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464806c9e0 con 0x7f4648069db0 2023-07-06T21:43:00.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f464e007640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464806d080 con 0x7f46480cd510 2023-07-06T21:43:00.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f464e007640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46480adc60 con 0x7f46480cbd50 2023-07-06T21:43:00.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f46477fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46480cd510 0x7f46480cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f46477fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46480cd510 0x7f46480cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41696/0 (socket says 172.21.15.55:41696) 2023-07-06T21:43:00.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f46477fe640 1 -- 172.21.15.55:0/4145640227 learned_addr learned my addr 172.21.15.55:0/4145640227 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:00.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f4647fff640 1 --2- 172.21.15.55:0/4145640227 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46480cbd50 0x7f464815fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f46477fe640 1 -- 172.21.15.55:0/4145640227 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46480cbd50 msgr2=0x7f464815fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:00.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f46477fe640 1 --2- 172.21.15.55:0/4145640227 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46480cbd50 0x7f464815fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f46477fe640 1 -- 172.21.15.55:0/4145640227 >> v1:172.21.15.138:6789/0 conn(0x7f4648069db0 legacy=0x7f464815f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:00.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f46477fe640 1 -- 172.21.15.55:0/4145640227 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46480cde20 con 0x7f46480cd510 2023-07-06T21:43:00.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.046+0000 7f4647fff640 1 --2- 172.21.15.55:0/4145640227 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46480cbd50 0x7f464815fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:00.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.050+0000 7f46477fe640 1 --2- 172.21.15.55:0/4145640227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46480cd510 0x7f46480cd8e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4638009870 tx=0x7f463801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c654678085832a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:00.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.050+0000 7f46467fc640 1 -- 172.21.15.55:0/4145640227 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46380a7070 con 0x7f46480cd510 2023-07-06T21:43:00.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.050+0000 7f46467fc640 1 -- 172.21.15.55:0/4145640227 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46380ab430 con 0x7f46480cd510 2023-07-06T21:43:00.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.050+0000 7f46467fc640 1 -- 172.21.15.55:0/4145640227 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46380ab7c0 con 0x7f46480cd510 2023-07-06T21:43:00.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.050+0000 7f464e007640 1 -- 172.21.15.55:0/4145640227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46480cd510 msgr2=0x7f46480cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.050+0000 7f464e007640 1 --2- 172.21.15.55:0/4145640227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46480cd510 0x7f46480cd8e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4638009870 tx=0x7f463801c470 comp rx=0 tx=0).stop 2023-07-06T21:43:00.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.050+0000 7f464e007640 1 -- 172.21.15.55:0/4145640227 shutdown_connections 2023-07-06T21:43:00.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.050+0000 7f464e007640 1 --2- 172.21.15.55:0/4145640227 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46480cbd50 0x7f464815fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.050+0000 7f464e007640 1 --2- 172.21.15.55:0/4145640227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46480cd510 0x7f46480cd8e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.050+0000 7f464e007640 1 -- 172.21.15.55:0/4145640227 >> 172.21.15.55:0/4145640227 conn(0x7f46480afe60 msgr2=0x7f46480b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:00.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.050+0000 7f464e007640 1 -- 172.21.15.55:0/4145640227 shutdown_connections 2023-07-06T21:43:00.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.050+0000 7f464e007640 1 -- 172.21.15.55:0/4145640227 wait complete. 2023-07-06T21:43:00.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f464e007640 1 Processor -- start 2023-07-06T21:43:00.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f464e007640 1 -- start start 2023-07-06T21:43:00.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f464e007640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4648069db0 0x7f4648151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f464e007640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46480cbd50 0x7f4648158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f464e007640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46480cd510 0x7f4648158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f464e007640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464815ebe0 con 0x7f46480cbd50 2023-07-06T21:43:00.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f464e007640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464815dfd0 con 0x7f46480cd510 2023-07-06T21:43:00.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f464e007640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464815e2b0 con 0x7f4648069db0 2023-07-06T21:43:00.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f4646ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46480cbd50 0x7f4648158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f4646ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46480cbd50 0x7f4648158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41708/0 (socket says 172.21.15.55:41708) 2023-07-06T21:43:00.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f4646ffd640 1 -- 172.21.15.55:0/4134033514 learned_addr learned my addr 172.21.15.55:0/4134033514 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:00.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f4647fff640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46480cd510 0x7f4648158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f4646ffd640 1 -- 172.21.15.55:0/4134033514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4648069db0 msgr2=0x7f4648151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f46477fe640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4648069db0 0x7f4648151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f4646ffd640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4648069db0 0x7f4648151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f4646ffd640 1 -- 172.21.15.55:0/4134033514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46480cd510 msgr2=0x7f4648158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f4646ffd640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46480cd510 0x7f4648158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f4646ffd640 1 -- 172.21.15.55:0/4134033514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46380094d0 con 0x7f46480cbd50 2023-07-06T21:43:00.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f46477fe640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4648069db0 0x7f4648151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:00.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f4647fff640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46480cd510 0x7f4648158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:00.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f4646ffd640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46480cbd50 0x7f4648158580 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f463c00b3e0 tx=0x7f463c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:00.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f462ffff640 1 -- 172.21.15.55:0/4134033514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c011830 con 0x7f46480cbd50 2023-07-06T21:43:00.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f462ffff640 1 -- 172.21.15.55:0/4134033514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c011990 con 0x7f46480cbd50 2023-07-06T21:43:00.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f464e007640 1 -- 172.21.15.55:0/4134033514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464815e590 con 0x7f46480cbd50 2023-07-06T21:43:00.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f462ffff640 1 -- 172.21.15.55:0/4134033514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c011d80 con 0x7f46480cbd50 2023-07-06T21:43:00.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.054+0000 7f464e007640 1 -- 172.21.15.55:0/4134033514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464815d230 con 0x7f46480cbd50 2023-07-06T21:43:00.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.058+0000 7f464e007640 1 -- 172.21.15.55:0/4134033514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464806d480 con 0x7f46480cbd50 2023-07-06T21:43:00.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.058+0000 7f462ffff640 1 -- 172.21.15.55:0/4134033514 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f463c01a400 con 0x7f46480cbd50 2023-07-06T21:43:00.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.058+0000 7f462ffff640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4634066280 0x7f4634068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.058+0000 7f462ffff640 1 -- 172.21.15.55:0/4134033514 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f463c083f70 con 0x7f46480cbd50 2023-07-06T21:43:00.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.058+0000 7f46477fe640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4634066280 0x7f4634068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.058+0000 7f46477fe640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4634066280 0x7f4634068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f46380af000 tx=0x7f4638008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:00.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.062+0000 7f462ffff640 1 -- 172.21.15.55:0/4134033514 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f464806d480 con 0x7f46480cbd50 2023-07-06T21:43:00.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.214+0000 7f464e007640 1 -- 172.21.15.55:0/4134033514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46480c30d0 con 0x7f46480cbd50 2023-07-06T21:43:00.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.214+0000 7f462ffff640 1 -- 172.21.15.55:0/4134033514 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f46480c30d0 con 0x7f46480cbd50 2023-07-06T21:43:00.223 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:43:00.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.218+0000 7f464e007640 1 -- 172.21.15.55:0/4134033514 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4634066280 msgr2=0x7f4634068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.218+0000 7f464e007640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4634066280 0x7f4634068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f46380af000 tx=0x7f4638008040 comp rx=0 tx=0).stop 2023-07-06T21:43:00.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.218+0000 7f464e007640 1 -- 172.21.15.55:0/4134033514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46480cbd50 msgr2=0x7f4648158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.218+0000 7f464e007640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46480cbd50 0x7f4648158580 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f463c00b3e0 tx=0x7f463c00b8a0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.218+0000 7f464e007640 1 -- 172.21.15.55:0/4134033514 shutdown_connections 2023-07-06T21:43:00.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.218+0000 7f464e007640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4634066280 0x7f4634068730 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.218+0000 7f464e007640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46480cd510 0x7f4648158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.218+0000 7f464e007640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46480cbd50 0x7f4648158580 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.218+0000 7f464e007640 1 --2- 172.21.15.55:0/4134033514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4648069db0 0x7f4648151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.218+0000 7f464e007640 1 -- 172.21.15.55:0/4134033514 >> 172.21.15.55:0/4134033514 conn(0x7f46480afe60 msgr2=0x7f464815f440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.218+0000 7f464e007640 1 -- 172.21.15.55:0/4134033514 shutdown_connections 2023-07-06T21:43:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.218+0000 7f464e007640 1 -- 172.21.15.55:0/4134033514 wait complete. 2023-07-06T21:43:00.243 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T21:43:00.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.382+0000 7fca93693640 1 Processor -- start 2023-07-06T21:43:00.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.382+0000 7fca93693640 1 -- start start 2023-07-06T21:43:00.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.382+0000 7fca93693640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca8c06eee0 0x7fca8c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.382+0000 7fca93693640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca8c06f890 0x7fca8c0c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.382+0000 7fca93693640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8c0ccd70 con 0x7fca8c0c11a0 2023-07-06T21:43:00.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.382+0000 7fca93693640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8c1605f0 con 0x7fca8c06f890 2023-07-06T21:43:00.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.382+0000 7fca93693640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c06ce00 con 0x7fca8c06eee0 2023-07-06T21:43:00.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.382+0000 7fca9142f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fca8c0c11a0 0x7fca8c0cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33056/0 (socket says 172.21.15.55:33056) 2023-07-06T21:43:00.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.382+0000 7fca91c30640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca8c06f890 0x7fca8c0c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.382+0000 7fca9142f640 1 -- 172.21.15.55:0/3379309784 learned_addr learned my addr 172.21.15.55:0/3379309784 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:00.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.386+0000 7fca90c2e640 1 --2- 172.21.15.55:0/3379309784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca8c06eee0 0x7fca8c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.386+0000 7fca91c30640 1 -- 172.21.15.55:0/3379309784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca8c06eee0 msgr2=0x7fca8c06f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:00.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.386+0000 7fca91c30640 1 --2- 172.21.15.55:0/3379309784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca8c06eee0 0x7fca8c06f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.386+0000 7fca91c30640 1 -- 172.21.15.55:0/3379309784 >> v1:172.21.15.55:6789/0 conn(0x7fca8c0c11a0 legacy=0x7fca8c0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.386+0000 7fca91c30640 1 -- 172.21.15.55:0/3379309784 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c06fca0 con 0x7fca8c06f890 2023-07-06T21:43:00.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.386+0000 7fca83fff640 1 -- 172.21.15.55:0/3379309784 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393072980 0 0) 0x7fca8c0ccd70 con 0x7fca8c0c11a0 2023-07-06T21:43:00.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.386+0000 7fca91c30640 1 --2- 172.21.15.55:0/3379309784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca8c06f890 0x7fca8c0c84a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fca84009dc0 tx=0x7fca8401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9b21d07d272e64 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:00.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.386+0000 7fca83fff640 1 -- 172.21.15.55:0/3379309784 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca840a5850 con 0x7fca8c06f890 2023-07-06T21:43:00.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.386+0000 7fca83fff640 1 -- 172.21.15.55:0/3379309784 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca840a59b0 con 0x7fca8c06f890 2023-07-06T21:43:00.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.386+0000 7fca83fff640 1 -- 172.21.15.55:0/3379309784 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca840a5d40 con 0x7fca8c06f890 2023-07-06T21:43:00.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 -- 172.21.15.55:0/3379309784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca8c06f890 msgr2=0x7fca8c0c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 --2- 172.21.15.55:0/3379309784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca8c06f890 0x7fca8c0c84a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fca84009dc0 tx=0x7fca8401c8a0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 -- 172.21.15.55:0/3379309784 shutdown_connections 2023-07-06T21:43:00.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 --2- 172.21.15.55:0/3379309784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca8c06eee0 0x7fca8c06f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 --2- 172.21.15.55:0/3379309784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca8c06f890 0x7fca8c0c84a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 -- 172.21.15.55:0/3379309784 >> 172.21.15.55:0/3379309784 conn(0x7fca8c0cea70 msgr2=0x7fca8c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:00.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 -- 172.21.15.55:0/3379309784 shutdown_connections 2023-07-06T21:43:00.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 -- 172.21.15.55:0/3379309784 wait complete. 2023-07-06T21:43:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 Processor -- start 2023-07-06T21:43:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 -- start start 2023-07-06T21:43:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca8c06eee0 0x7fca8c1fb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca8c06f890 0x7fca8c15e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca8c0c11a0 0x7fca8c162e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c1fc2e0 con 0x7fca8c06f890 2023-07-06T21:43:00.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c1fc5c0 con 0x7fca8c0c11a0 2023-07-06T21:43:00.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca93693640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c1fc8a0 con 0x7fca8c06eee0 2023-07-06T21:43:00.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca90c2e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca8c06f890 0x7fca8c15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca90c2e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca8c06f890 0x7fca8c15e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41724/0 (socket says 172.21.15.55:41724) 2023-07-06T21:43:00.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca90c2e640 1 -- 172.21.15.55:0/1245744353 learned_addr learned my addr 172.21.15.55:0/1245744353 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:00.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca9142f640 1 --2- 172.21.15.55:0/1245744353 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca8c06eee0 0x7fca8c1fb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca91c30640 1 --2- 172.21.15.55:0/1245744353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca8c0c11a0 0x7fca8c162e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca90c2e640 1 -- 172.21.15.55:0/1245744353 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca8c06eee0 msgr2=0x7fca8c1fb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca90c2e640 1 --2- 172.21.15.55:0/1245744353 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca8c06eee0 0x7fca8c1fb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca90c2e640 1 -- 172.21.15.55:0/1245744353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca8c0c11a0 msgr2=0x7fca8c162e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca90c2e640 1 --2- 172.21.15.55:0/1245744353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca8c0c11a0 0x7fca8c162e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.390+0000 7fca90c2e640 1 -- 172.21.15.55:0/1245744353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca84009a70 con 0x7fca8c06f890 2023-07-06T21:43:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.394+0000 7fca90c2e640 1 --2- 172.21.15.55:0/1245744353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca8c06f890 0x7fca8c15e040 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00d800 tx=0x7fca7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.394+0000 7fca81ffb640 1 -- 172.21.15.55:0/1245744353 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c00b6c0 con 0x7fca8c06f890 2023-07-06T21:43:00.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.394+0000 7fca81ffb640 1 -- 172.21.15.55:0/1245744353 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c00b820 con 0x7fca8c06f890 2023-07-06T21:43:00.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.394+0000 7fca81ffb640 1 -- 172.21.15.55:0/1245744353 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c00bb90 con 0x7fca8c06f890 2023-07-06T21:43:00.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.394+0000 7fca93693640 1 -- 172.21.15.55:0/1245744353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8c0c16f0 con 0x7fca8c06f890 2023-07-06T21:43:00.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.394+0000 7fca93693640 1 -- 172.21.15.55:0/1245744353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8c1628f0 con 0x7fca8c06f890 2023-07-06T21:43:00.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.394+0000 7fca93693640 1 -- 172.21.15.55:0/1245744353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8c162ab0 con 0x7fca8c06f890 2023-07-06T21:43:00.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.394+0000 7fca81ffb640 1 -- 172.21.15.55:0/1245744353 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca7c00bcf0 con 0x7fca8c06f890 2023-07-06T21:43:00.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.394+0000 7fca81ffb640 1 --2- 172.21.15.55:0/1245744353 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fca70066280 0x7fca70068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.394+0000 7fca81ffb640 1 -- 172.21.15.55:0/1245744353 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fca7c084530 con 0x7fca8c06f890 2023-07-06T21:43:00.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.394+0000 7fca9142f640 1 --2- 172.21.15.55:0/1245744353 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fca70066280 0x7fca70068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.398+0000 7fca9142f640 1 --2- 172.21.15.55:0/1245744353 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fca70066280 0x7fca70068730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fca88000f70 tx=0x7fca88007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.398+0000 7fca81ffb640 1 -- 172.21.15.55:0/1245744353 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fca7c055120 con 0x7fca8c06f890 2023-07-06T21:43:00.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.554+0000 7fca93693640 1 -- 172.21.15.55:0/1245744353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fca8c066d60 con 0x7fca8c06f890 2023-07-06T21:43:00.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.554+0000 7fca81ffb640 1 -- 172.21.15.55:0/1245744353 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fca7c054cb0 con 0x7fca8c06f890 2023-07-06T21:43:00.561 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:43:00.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.554+0000 7fca93693640 1 -- 172.21.15.55:0/1245744353 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fca70066280 msgr2=0x7fca70068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.554+0000 7fca93693640 1 --2- 172.21.15.55:0/1245744353 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fca70066280 0x7fca70068730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fca88000f70 tx=0x7fca88007df0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.554+0000 7fca93693640 1 -- 172.21.15.55:0/1245744353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca8c06f890 msgr2=0x7fca8c15e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.554+0000 7fca93693640 1 --2- 172.21.15.55:0/1245744353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca8c06f890 0x7fca8c15e040 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00d800 tx=0x7fca7c00dcc0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.554+0000 7fca93693640 1 -- 172.21.15.55:0/1245744353 shutdown_connections 2023-07-06T21:43:00.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.554+0000 7fca93693640 1 --2- 172.21.15.55:0/1245744353 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fca70066280 0x7fca70068730 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.554+0000 7fca93693640 1 --2- 172.21.15.55:0/1245744353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca8c0c11a0 0x7fca8c162e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.554+0000 7fca93693640 1 --2- 172.21.15.55:0/1245744353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca8c06f890 0x7fca8c15e040 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.554+0000 7fca93693640 1 --2- 172.21.15.55:0/1245744353 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca8c06eee0 0x7fca8c1fb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.554+0000 7fca93693640 1 -- 172.21.15.55:0/1245744353 >> 172.21.15.55:0/1245744353 conn(0x7fca8c0cea70 msgr2=0x7fca8c0b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:00.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.554+0000 7fca93693640 1 -- 172.21.15.55:0/1245744353 shutdown_connections 2023-07-06T21:43:00.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.554+0000 7fca93693640 1 -- 172.21.15.55:0/1245744353 wait complete. 2023-07-06T21:43:00.582 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-06T21:43:00.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5739cd8640 1 Processor -- start 2023-07-06T21:43:00.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5739cd8640 1 -- start start 2023-07-06T21:43:00.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5739cd8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f573406f0e0 0x7f57340ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5739cd8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f57340cb7a0 0x7f57340cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5739cd8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573415f5d0 con 0x7f5734156180 2023-07-06T21:43:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5739cd8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5734160250 con 0x7f573406f0e0 2023-07-06T21:43:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5739cd8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573415f8b0 con 0x7f57340cb7a0 2023-07-06T21:43:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5732ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f573406f0e0 0x7f57340ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5732ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f573406f0e0 0x7f57340ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41726/0 (socket says 172.21.15.55:41726) 2023-07-06T21:43:00.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5732ffd640 1 -- 172.21.15.55:0/501656831 learned_addr learned my addr 172.21.15.55:0/501656831 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5733fff640 1 --2- 172.21.15.55:0/501656831 >> v2:172.21.15.138:3300/0 conn(0x7f57340cb7a0 0x7f57340cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5732ffd640 1 -- 172.21.15.55:0/501656831 >> v2:172.21.15.138:3300/0 conn(0x7f57340cb7a0 msgr2=0x7f57340cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5732ffd640 1 --2- 172.21.15.55:0/501656831 >> v2:172.21.15.138:3300/0 conn(0x7f57340cb7a0 0x7f57340cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5732ffd640 1 -- 172.21.15.55:0/501656831 >> v1:172.21.15.138:6789/0 conn(0x7f5734156180 legacy=0x7f573406e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.722+0000 7f5732ffd640 1 -- 172.21.15.55:0/501656831 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573415fb90 con 0x7f573406f0e0 2023-07-06T21:43:00.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.726+0000 7f5732ffd640 1 --2- 172.21.15.55:0/501656831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573406f0e0 0x7f57340ca610 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f57340af9d0 tx=0x7f572801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce8029cf4686dde server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:00.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.726+0000 7f57327fc640 1 -- 172.21.15.55:0/501656831 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57280ab620 con 0x7f573406f0e0 2023-07-06T21:43:00.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.726+0000 7f57327fc640 1 -- 172.21.15.55:0/501656831 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57280ab780 con 0x7f573406f0e0 2023-07-06T21:43:00.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.726+0000 7f57327fc640 1 -- 172.21.15.55:0/501656831 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57280abb10 con 0x7f573406f0e0 2023-07-06T21:43:00.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.726+0000 7f5739cd8640 1 -- 172.21.15.55:0/501656831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573406f0e0 msgr2=0x7f57340ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.726+0000 7f5739cd8640 1 --2- 172.21.15.55:0/501656831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573406f0e0 0x7f57340ca610 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f57340af9d0 tx=0x7f572801c400 comp rx=0 tx=0).stop 2023-07-06T21:43:00.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.726+0000 7f5739cd8640 1 -- 172.21.15.55:0/501656831 shutdown_connections 2023-07-06T21:43:00.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.726+0000 7f5739cd8640 1 --2- 172.21.15.55:0/501656831 >> v2:172.21.15.138:3300/0 conn(0x7f57340cb7a0 0x7f57340cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.726+0000 7f5739cd8640 1 --2- 172.21.15.55:0/501656831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573406f0e0 0x7f57340ca610 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.726+0000 7f5739cd8640 1 -- 172.21.15.55:0/501656831 >> 172.21.15.55:0/501656831 conn(0x7f57340d0c50 msgr2=0x7f57340cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:00.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.726+0000 7f5739cd8640 1 -- 172.21.15.55:0/501656831 shutdown_connections 2023-07-06T21:43:00.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.726+0000 7f5739cd8640 1 -- 172.21.15.55:0/501656831 wait complete. 2023-07-06T21:43:00.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f5739cd8640 1 Processor -- start 2023-07-06T21:43:00.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f5739cd8640 1 -- start start 2023-07-06T21:43:00.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f5739cd8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573406f0e0 0x7f5734154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f5739cd8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57340cb7a0 0x7f5734150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f5739cd8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5734156180 0x7f5734150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f5739cd8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57341539f0 con 0x7f573406f0e0 2023-07-06T21:43:00.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f5739cd8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5734150d30 con 0x7f5734156180 2023-07-06T21:43:00.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f5739cd8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5734151010 con 0x7f57340cb7a0 2023-07-06T21:43:00.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f57337fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573406f0e0 0x7f5734154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f57337fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573406f0e0 0x7f5734154300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41730/0 (socket says 172.21.15.55:41730) 2023-07-06T21:43:00.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f57337fe640 1 -- 172.21.15.55:0/3831561861 learned_addr learned my addr 172.21.15.55:0/3831561861 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:00.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f5733fff640 1 --2- 172.21.15.55:0/3831561861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5734156180 0x7f5734150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f5732ffd640 1 --2- 172.21.15.55:0/3831561861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57340cb7a0 0x7f5734150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f57337fe640 1 -- 172.21.15.55:0/3831561861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57340cb7a0 msgr2=0x7f5734150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f57337fe640 1 --2- 172.21.15.55:0/3831561861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57340cb7a0 0x7f5734150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f57337fe640 1 -- 172.21.15.55:0/3831561861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5734156180 msgr2=0x7f5734150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f57337fe640 1 --2- 172.21.15.55:0/3831561861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5734156180 0x7f5734150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f57337fe640 1 -- 172.21.15.55:0/3831561861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57280094d0 con 0x7f573406f0e0 2023-07-06T21:43:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f57337fe640 1 --2- 172.21.15.55:0/3831561861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573406f0e0 0x7f5734154300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f572400b410 tx=0x7f572400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:00.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f571bfff640 1 -- 172.21.15.55:0/3831561861 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724004020 con 0x7f573406f0e0 2023-07-06T21:43:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f571bfff640 1 -- 172.21.15.55:0/3831561861 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5724004180 con 0x7f573406f0e0 2023-07-06T21:43:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f5739cd8640 1 -- 172.21.15.55:0/3831561861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57341512f0 con 0x7f573406f0e0 2023-07-06T21:43:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f571bfff640 1 -- 172.21.15.55:0/3831561861 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724011630 con 0x7f573406f0e0 2023-07-06T21:43:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f5739cd8640 1 -- 172.21.15.55:0/3831561861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57341518b0 con 0x7f573406f0e0 2023-07-06T21:43:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.730+0000 7f5739cd8640 1 -- 172.21.15.55:0/3831561861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5734066d60 con 0x7f573406f0e0 2023-07-06T21:43:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.734+0000 7f571bfff640 1 -- 172.21.15.55:0/3831561861 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5724011790 con 0x7f573406f0e0 2023-07-06T21:43:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.734+0000 7f571bfff640 1 --2- 172.21.15.55:0/3831561861 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5720066280 0x7f5720068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:00.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.734+0000 7f571bfff640 1 -- 172.21.15.55:0/3831561861 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5724083cf0 con 0x7f573406f0e0 2023-07-06T21:43:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.734+0000 7f5732ffd640 1 --2- 172.21.15.55:0/3831561861 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5720066280 0x7f5720068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.734+0000 7f5732ffd640 1 --2- 172.21.15.55:0/3831561861 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5720066280 0x7f5720068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f57280af000 tx=0x7f57280b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.738+0000 7f571bfff640 1 -- 172.21.15.55:0/3831561861 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5724050e50 con 0x7f573406f0e0 2023-07-06T21:43:00.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.894+0000 7f5739cd8640 1 -- 172.21.15.55:0/3831561861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f57340cd930 con 0x7f573406f0e0 2023-07-06T21:43:00.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.902+0000 7f571bfff640 1 -- 172.21.15.55:0/3831561861 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5724054470 con 0x7f573406f0e0 2023-07-06T21:43:00.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.902+0000 7f5739cd8640 1 -- 172.21.15.55:0/3831561861 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5720066280 msgr2=0x7f5720068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.902+0000 7f5739cd8640 1 --2- 172.21.15.55:0/3831561861 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5720066280 0x7f5720068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f57280af000 tx=0x7f57280b6040 comp rx=0 tx=0).stop 2023-07-06T21:43:00.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.902+0000 7f5739cd8640 1 -- 172.21.15.55:0/3831561861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573406f0e0 msgr2=0x7f5734154300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:00.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.902+0000 7f5739cd8640 1 --2- 172.21.15.55:0/3831561861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573406f0e0 0x7f5734154300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f572400b410 tx=0x7f572400b8d0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.902+0000 7f5739cd8640 1 -- 172.21.15.55:0/3831561861 shutdown_connections 2023-07-06T21:43:00.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.902+0000 7f5739cd8640 1 --2- 172.21.15.55:0/3831561861 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5720066280 0x7f5720068730 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.902+0000 7f5739cd8640 1 --2- 172.21.15.55:0/3831561861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5734156180 0x7f5734150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.902+0000 7f5739cd8640 1 --2- 172.21.15.55:0/3831561861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57340cb7a0 0x7f5734150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.902+0000 7f5739cd8640 1 --2- 172.21.15.55:0/3831561861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f573406f0e0 0x7f5734154300 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:00.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.902+0000 7f5739cd8640 1 -- 172.21.15.55:0/3831561861 >> 172.21.15.55:0/3831561861 conn(0x7f57340d0c50 msgr2=0x7f573406e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:00.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.902+0000 7f5739cd8640 1 -- 172.21.15.55:0/3831561861 shutdown_connections 2023-07-06T21:43:00.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:00.902+0000 7f5739cd8640 1 -- 172.21.15.55:0/3831561861 wait complete. 2023-07-06T21:43:00.929 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T21:43:00.930 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:43:00.990 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:43:01.050 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T21:43:01.050 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:43:01.051 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:43:01.061 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:43:01.062 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:43:01.112 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:43:01.113 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:43:01.163 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:43:01.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.342+0000 7fe3fe39f640 1 Processor -- start 2023-07-06T21:43:01.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.342+0000 7fe3fe39f640 1 -- start start 2023-07-06T21:43:01.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.342+0000 7fe3fe39f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3f8158400 0x7fe3f80c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:01.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.342+0000 7fe3fe39f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe3f80c9680 0x7fe3f8070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:01.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.342+0000 7fe3fe39f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f806fae0 con 0x7fe3f80710c0 2023-07-06T21:43:01.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.342+0000 7fe3fe39f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f806fdc0 con 0x7fe3f80c9680 2023-07-06T21:43:01.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.342+0000 7fe3fe39f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80700a0 con 0x7fe3f8158400 2023-07-06T21:43:01.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.342+0000 7fe3fc93c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe3f80710c0 0x7fe3f80cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33072/0 (socket says 172.21.15.55:33072) 2023-07-06T21:43:01.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.342+0000 7fe3fc93c640 1 -- 172.21.15.55:0/3223207677 learned_addr learned my addr 172.21.15.55:0/3223207677 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f77fe640 1 --2- 172.21.15.55:0/3223207677 >> v2:172.21.15.138:3300/0 conn(0x7fe3f80c9680 0x7fe3f8070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f7fff640 1 --2- 172.21.15.55:0/3223207677 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3f8158400 0x7fe3f80c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 -- 172.21.15.55:0/3223207677 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304999919 0 0) 0x7fe3f806fae0 con 0x7fe3f80710c0 2023-07-06T21:43:01.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 -- 172.21.15.55:0/3223207677 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e0003530 con 0x7fe3f80710c0 2023-07-06T21:43:01.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 -- 172.21.15.55:0/3223207677 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 570057645 0 0) 0x7fe3e0003530 con 0x7fe3f80710c0 2023-07-06T21:43:01.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 -- 172.21.15.55:0/3223207677 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3f8158400 msgr2=0x7fe3f80c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:01.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 --2- 172.21.15.55:0/3223207677 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3f8158400 0x7fe3f80c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 -- 172.21.15.55:0/3223207677 >> v2:172.21.15.138:3300/0 conn(0x7fe3f80c9680 msgr2=0x7fe3f8070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:01.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 --2- 172.21.15.55:0/3223207677 >> v2:172.21.15.138:3300/0 conn(0x7fe3f80c9680 0x7fe3f8070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 -- 172.21.15.55:0/3223207677 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f8070380 con 0x7fe3f80710c0 2023-07-06T21:43:01.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 -- 172.21.15.55:0/3223207677 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fe3f0001a00 con 0x7fe3f80710c0 2023-07-06T21:43:01.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 -- 172.21.15.55:0/3223207677 >> v1:172.21.15.55:6789/0 conn(0x7fe3f80710c0 legacy=0x7fe3f80cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:01.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 --2- 172.21.15.55:0/3223207677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3e0003980 0x7fe3e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:01.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 --2- 172.21.15.55:0/3223207677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e00043b0 0x7fe3e0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:01.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 --2- 172.21.15.55:0/3223207677 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3f8158400 0x7fe3e0004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:01.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 -- 172.21.15.55:0/3223207677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f806fdc0 con 0x7fe3e00043b0 2023-07-06T21:43:01.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 -- 172.21.15.55:0/3223207677 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80700a0 con 0x7fe3e0003980 2023-07-06T21:43:01.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f6ffd640 1 -- 172.21.15.55:0/3223207677 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e000dba0 con 0x7fe3f8158400 2023-07-06T21:43:01.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f77fe640 1 --2- 172.21.15.55:0/3223207677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e00043b0 0x7fe3e0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:01.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f7fff640 1 --2- 172.21.15.55:0/3223207677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3e0003980 0x7fe3e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:01.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3fc93c640 1 --2- 172.21.15.55:0/3223207677 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3f8158400 0x7fe3e0004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:01.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f77fe640 1 -- 172.21.15.55:0/3223207677 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3f8158400 msgr2=0x7fe3e0004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:01.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f77fe640 1 --2- 172.21.15.55:0/3223207677 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3f8158400 0x7fe3e0004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f77fe640 1 -- 172.21.15.55:0/3223207677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3e0003980 msgr2=0x7fe3e0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:01.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f77fe640 1 --2- 172.21.15.55:0/3223207677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3e0003980 0x7fe3e0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.346+0000 7fe3f77fe640 1 -- 172.21.15.55:0/3223207677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e0003530 con 0x7fe3e00043b0 2023-07-06T21:43:01.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3f77fe640 1 --2- 172.21.15.55:0/3223207677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e00043b0 0x7fe3e0004870 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009ae0 tx=0x7fe3ec01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3753dbf4e7ccafdf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:01.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3f6ffd640 1 -- 172.21.15.55:0/3223207677 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec0a5570 con 0x7fe3e00043b0 2023-07-06T21:43:01.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3f6ffd640 1 -- 172.21.15.55:0/3223207677 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec0a56d0 con 0x7fe3e00043b0 2023-07-06T21:43:01.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3f6ffd640 1 -- 172.21.15.55:0/3223207677 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec0a5a80 con 0x7fe3e00043b0 2023-07-06T21:43:01.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fe39f640 1 -- 172.21.15.55:0/3223207677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e00043b0 msgr2=0x7fe3e0004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:01.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fe39f640 1 --2- 172.21.15.55:0/3223207677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e00043b0 0x7fe3e0004870 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009ae0 tx=0x7fe3ec01ca90 comp rx=0 tx=0).stop 2023-07-06T21:43:01.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fc93c640 1 -- 172.21.15.55:0/3223207677 reap_dead start 2023-07-06T21:43:01.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fe39f640 1 -- 172.21.15.55:0/3223207677 shutdown_connections 2023-07-06T21:43:01.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fe39f640 1 -- 172.21.15.55:0/3223207677 >> 172.21.15.55:0/3223207677 conn(0x7fe3f80cded0 msgr2=0x7fe3f80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:01.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fe39f640 1 -- 172.21.15.55:0/3223207677 shutdown_connections 2023-07-06T21:43:01.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fe39f640 1 -- 172.21.15.55:0/3223207677 wait complete. 2023-07-06T21:43:01.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fe39f640 1 Processor -- start 2023-07-06T21:43:01.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fe39f640 1 -- start start 2023-07-06T21:43:01.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fe39f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3e00043b0 0x7fe3f8154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:01.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fe39f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3f80c6a00 0x7fe3f81561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:01.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fe39f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3f8152f90 0x7fe3f8153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:01.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fe39f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80c7af0 con 0x7fe3f8152f90 2023-07-06T21:43:01.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fe39f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8153970 con 0x7fe3f80c6a00 2023-07-06T21:43:01.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.350+0000 7fe3fe39f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80c6f70 con 0x7fe3e00043b0 2023-07-06T21:43:01.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3fc93c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3f8152f90 0x7fe3f8153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:01.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3f77fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3f80c6a00 0x7fe3f81561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:01.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3e00043b0 0x7fe3f8154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:01.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3fc93c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3f8152f90 0x7fe3f8153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41752/0 (socket says 172.21.15.55:41752) 2023-07-06T21:43:01.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3f77fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3f80c6a00 0x7fe3f81561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:41250/0 (socket says 172.21.15.55:41250) 2023-07-06T21:43:01.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3fc93c640 1 -- 172.21.15.55:0/507336596 learned_addr learned my addr 172.21.15.55:0/507336596 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:01.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3fc93c640 1 -- 172.21.15.55:0/507336596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3e00043b0 msgr2=0x7fe3f8154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:01.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3fc93c640 1 --2- 172.21.15.55:0/507336596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3e00043b0 0x7fe3f8154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3fc93c640 1 -- 172.21.15.55:0/507336596 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3f80c6a00 msgr2=0x7fe3f81561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:01.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3fc93c640 1 --2- 172.21.15.55:0/507336596 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3f80c6a00 0x7fe3f81561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3fc93c640 1 -- 172.21.15.55:0/507336596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f80c7250 con 0x7fe3f8152f90 2023-07-06T21:43:01.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3fc93c640 1 --2- 172.21.15.55:0/507336596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3f8152f90 0x7fe3f8153430 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe3f806ed50 tx=0x7fe3f0011790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:01.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3f4ff9640 1 -- 172.21.15.55:0/507336596 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0014370 con 0x7fe3f8152f90 2023-07-06T21:43:01.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3f4ff9640 1 -- 172.21.15.55:0/507336596 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f00144f0 con 0x7fe3f8152f90 2023-07-06T21:43:01.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3f4ff9640 1 -- 172.21.15.55:0/507336596 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f00148a0 con 0x7fe3f8152f90 2023-07-06T21:43:01.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3fe39f640 1 -- 172.21.15.55:0/507336596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f80c7530 con 0x7fe3f8152f90 2023-07-06T21:43:01.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3fe39f640 1 -- 172.21.15.55:0/507336596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f8155390 con 0x7fe3f8152f90 2023-07-06T21:43:01.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3fe39f640 1 -- 172.21.15.55:0/507336596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f806c580 con 0x7fe3f8152f90 2023-07-06T21:43:01.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.354+0000 7fe3f4ff9640 1 -- 172.21.15.55:0/507336596 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3f0014a00 con 0x7fe3f8152f90 2023-07-06T21:43:01.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.358+0000 7fe3f4ff9640 1 --2- 172.21.15.55:0/507336596 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe3e40662b0 0x7fe3e4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:01.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.358+0000 7fe3f4ff9640 1 -- 172.21.15.55:0/507336596 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe3f00860e0 con 0x7fe3f8152f90 2023-07-06T21:43:01.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.358+0000 7fe3f7fff640 1 --2- 172.21.15.55:0/507336596 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe3e40662b0 0x7fe3e4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:01.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.358+0000 7fe3f7fff640 1 --2- 172.21.15.55:0/507336596 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe3e40662b0 0x7fe3e4068760 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009b00 tx=0x7fe3e8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:01.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.362+0000 7fe3f4ff9640 1 -- 172.21.15.55:0/507336596 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3f0053370 con 0x7fe3f8152f90 2023-07-06T21:43:01.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.518+0000 7fe3fe39f640 1 -- 172.21.15.55:0/507336596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3f8066d60 con 0x7fe3f8152f90 2023-07-06T21:43:01.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.518+0000 7fe3f4ff9640 1 -- 172.21.15.55:0/507336596 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fe3f001c090 con 0x7fe3f8152f90 2023-07-06T21:43:01.526 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:01.526 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":29,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:51.480379+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:43:01.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.522+0000 7fe3fe39f640 1 -- 172.21.15.55:0/507336596 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe3e40662b0 msgr2=0x7fe3e4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:01.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.522+0000 7fe3fe39f640 1 --2- 172.21.15.55:0/507336596 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe3e40662b0 0x7fe3e4068760 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009b00 tx=0x7fe3e8009190 comp rx=0 tx=0).stop 2023-07-06T21:43:01.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.522+0000 7fe3fe39f640 1 -- 172.21.15.55:0/507336596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3f8152f90 msgr2=0x7fe3f8153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:01.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.522+0000 7fe3fe39f640 1 --2- 172.21.15.55:0/507336596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3f8152f90 0x7fe3f8153430 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe3f806ed50 tx=0x7fe3f0011790 comp rx=0 tx=0).stop 2023-07-06T21:43:01.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.522+0000 7fe3fe39f640 1 -- 172.21.15.55:0/507336596 shutdown_connections 2023-07-06T21:43:01.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.522+0000 7fe3fe39f640 1 --2- 172.21.15.55:0/507336596 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe3e40662b0 0x7fe3e4068760 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.522+0000 7fe3fe39f640 1 --2- 172.21.15.55:0/507336596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3f8152f90 0x7fe3f8153430 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.522+0000 7fe3fe39f640 1 --2- 172.21.15.55:0/507336596 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3f80c6a00 0x7fe3f81561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.522+0000 7fe3fe39f640 1 --2- 172.21.15.55:0/507336596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3e00043b0 0x7fe3f8154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.522+0000 7fe3fe39f640 1 -- 172.21.15.55:0/507336596 >> 172.21.15.55:0/507336596 conn(0x7fe3f80cded0 msgr2=0x7fe3f80693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:01.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.522+0000 7fe3fe39f640 1 -- 172.21.15.55:0/507336596 shutdown_connections 2023-07-06T21:43:01.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.522+0000 7fe3fe39f640 1 -- 172.21.15.55:0/507336596 wait complete. 2023-07-06T21:43:01.550 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:42:08.597013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:42:09.843890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T21:42:12.918111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T21:43:01.551 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:43:01.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.690+0000 7fc72add3640 1 Processor -- start 2023-07-06T21:43:01.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.690+0000 7fc72add3640 1 -- start start 2023-07-06T21:43:01.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.690+0000 7fc72add3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc72415bb90 0x7fc7240ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:01.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.690+0000 7fc72add3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72415fe80 con 0x7fc724070020 2023-07-06T21:43:01.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.690+0000 7fc72add3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72415bf60 con 0x7fc7240cef40 2023-07-06T21:43:01.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.690+0000 7fc72add3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72415f620 con 0x7fc72415bb90 2023-07-06T21:43:01.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.694+0000 7fc728b6f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc72415bb90 0x7fc7240ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:01.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.694+0000 7fc729370640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc724070020 0x7fc7240c8cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33084/0 (socket says 172.21.15.55:33084) 2023-07-06T21:43:01.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.694+0000 7fc729370640 1 -- 172.21.15.55:0/1477789932 learned_addr learned my addr 172.21.15.55:0/1477789932 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:01.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.694+0000 7fc728b6f640 1 -- 172.21.15.55:0/1477789932 >> v1:172.21.15.138:6789/0 conn(0x7fc7240cef40 legacy=0x7fc72406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:01.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.694+0000 7fc7237fe640 1 -- 172.21.15.55:0/1477789932 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523395490 0 0) 0x7fc72415fe80 con 0x7fc724070020 2023-07-06T21:43:01.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.694+0000 7fc728b6f640 1 -- 172.21.15.55:0/1477789932 >> v1:172.21.15.55:6789/0 conn(0x7fc724070020 legacy=0x7fc7240c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:01.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.694+0000 7fc728b6f640 1 -- 172.21.15.55:0/1477789932 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7240cf440 con 0x7fc72415bb90 2023-07-06T21:43:01.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.694+0000 7fc728b6f640 1 --2- 172.21.15.55:0/1477789932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc72415bb90 0x7fc7240ce030 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc7180097c0 tx=0x7fc71801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e909152d031590 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:01.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.694+0000 7fc7237fe640 1 -- 172.21.15.55:0/1477789932 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7180ab400 con 0x7fc72415bb90 2023-07-06T21:43:01.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.694+0000 7fc7237fe640 1 -- 172.21.15.55:0/1477789932 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7180a7050 con 0x7fc72415bb90 2023-07-06T21:43:01.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.694+0000 7fc7237fe640 1 -- 172.21.15.55:0/1477789932 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7180ab780 con 0x7fc72415bb90 2023-07-06T21:43:01.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 -- 172.21.15.55:0/1477789932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc72415bb90 msgr2=0x7fc7240ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:01.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 --2- 172.21.15.55:0/1477789932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc72415bb90 0x7fc7240ce030 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc7180097c0 tx=0x7fc71801c480 comp rx=0 tx=0).stop 2023-07-06T21:43:01.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 -- 172.21.15.55:0/1477789932 shutdown_connections 2023-07-06T21:43:01.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 --2- 172.21.15.55:0/1477789932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc72415bb90 0x7fc7240ce030 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 -- 172.21.15.55:0/1477789932 >> 172.21.15.55:0/1477789932 conn(0x7fc7240cbd70 msgr2=0x7fc7240ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:01.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 -- 172.21.15.55:0/1477789932 shutdown_connections 2023-07-06T21:43:01.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 -- 172.21.15.55:0/1477789932 wait complete. 2023-07-06T21:43:01.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 Processor -- start 2023-07-06T21:43:01.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 -- start start 2023-07-06T21:43:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc724070020 0x7fc72414cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7240cef40 0x7fc7240b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72415bb90 0x7fc7241550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72415c120 con 0x7fc7240cef40 2023-07-06T21:43:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72415c400 con 0x7fc72415bb90 2023-07-06T21:43:01.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc72add3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7240c8fc0 con 0x7fc724070020 2023-07-06T21:43:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc723fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7240cef40 0x7fc7240b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc723fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7240cef40 0x7fc7240b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41772/0 (socket says 172.21.15.55:41772) 2023-07-06T21:43:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.698+0000 7fc723fff640 1 -- 172.21.15.55:0/417096303 learned_addr learned my addr 172.21.15.55:0/417096303 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc728b6f640 1 --2- 172.21.15.55:0/417096303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc724070020 0x7fc72414cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc729370640 1 --2- 172.21.15.55:0/417096303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72415bb90 0x7fc7241550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc723fff640 1 -- 172.21.15.55:0/417096303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc724070020 msgr2=0x7fc72414cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc723fff640 1 --2- 172.21.15.55:0/417096303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc724070020 0x7fc72414cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc723fff640 1 -- 172.21.15.55:0/417096303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72415bb90 msgr2=0x7fc7241550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:01.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc723fff640 1 --2- 172.21.15.55:0/417096303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72415bb90 0x7fc7241550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc723fff640 1 -- 172.21.15.55:0/417096303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc718009420 con 0x7fc7240cef40 2023-07-06T21:43:01.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc723fff640 1 --2- 172.21.15.55:0/417096303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7240cef40 0x7fc7240b0900 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc71000c490 tx=0x7fc71000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:01.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc7217fa640 1 -- 172.21.15.55:0/417096303 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7100052d0 con 0x7fc7240cef40 2023-07-06T21:43:01.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc7217fa640 1 -- 172.21.15.55:0/417096303 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc710005430 con 0x7fc7240cef40 2023-07-06T21:43:01.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc7217fa640 1 -- 172.21.15.55:0/417096303 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710007260 con 0x7fc7240cef40 2023-07-06T21:43:01.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc72add3640 1 -- 172.21.15.55:0/417096303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7240b38e0 con 0x7fc7240cef40 2023-07-06T21:43:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc72add3640 1 -- 172.21.15.55:0/417096303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7240b3ea0 con 0x7fc7240cef40 2023-07-06T21:43:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc72add3640 1 -- 172.21.15.55:0/417096303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc724066d60 con 0x7fc7240cef40 2023-07-06T21:43:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc7217fa640 1 -- 172.21.15.55:0/417096303 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7100073c0 con 0x7fc7240cef40 2023-07-06T21:43:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.702+0000 7fc7217fa640 1 --2- 172.21.15.55:0/417096303 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc708066280 0x7fc708068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.706+0000 7fc7217fa640 1 -- 172.21.15.55:0/417096303 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc7100836e0 con 0x7fc7240cef40 2023-07-06T21:43:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.706+0000 7fc728b6f640 1 --2- 172.21.15.55:0/417096303 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc708066280 0x7fc708068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.706+0000 7fc728b6f640 1 --2- 172.21.15.55:0/417096303 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc708066280 0x7fc708068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc7180ad000 tx=0x7fc7180a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:01.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.706+0000 7fc7217fa640 1 -- 172.21.15.55:0/417096303 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc710050970 con 0x7fc7240cef40 2023-07-06T21:43:01.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.862+0000 7fc72add3640 1 -- 172.21.15.55:0/417096303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc72415c540 con 0x7fc7240cef40 2023-07-06T21:43:01.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.862+0000 7fc7217fa640 1 -- 172.21.15.55:0/417096303 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc710053f90 con 0x7fc7240cef40 2023-07-06T21:43:01.869 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:43:01.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.862+0000 7fc72add3640 1 -- 172.21.15.55:0/417096303 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc708066280 msgr2=0x7fc708068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.862+0000 7fc72add3640 1 --2- 172.21.15.55:0/417096303 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc708066280 0x7fc708068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc7180ad000 tx=0x7fc7180a6000 comp rx=0 tx=0).stop 2023-07-06T21:43:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.862+0000 7fc72add3640 1 -- 172.21.15.55:0/417096303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7240cef40 msgr2=0x7fc7240b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.862+0000 7fc72add3640 1 --2- 172.21.15.55:0/417096303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7240cef40 0x7fc7240b0900 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc71000c490 tx=0x7fc71000c950 comp rx=0 tx=0).stop 2023-07-06T21:43:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.862+0000 7fc72add3640 1 -- 172.21.15.55:0/417096303 shutdown_connections 2023-07-06T21:43:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.862+0000 7fc72add3640 1 --2- 172.21.15.55:0/417096303 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc708066280 0x7fc708068730 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.862+0000 7fc72add3640 1 --2- 172.21.15.55:0/417096303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72415bb90 0x7fc7241550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.862+0000 7fc72add3640 1 --2- 172.21.15.55:0/417096303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7240cef40 0x7fc7240b0900 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.862+0000 7fc72add3640 1 --2- 172.21.15.55:0/417096303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc724070020 0x7fc72414cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.862+0000 7fc72add3640 1 -- 172.21.15.55:0/417096303 >> 172.21.15.55:0/417096303 conn(0x7fc7240cbd70 msgr2=0x7fc72406cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.862+0000 7fc72add3640 1 -- 172.21.15.55:0/417096303 shutdown_connections 2023-07-06T21:43:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:01.862+0000 7fc72add3640 1 -- 172.21.15.55:0/417096303 wait complete. 2023-07-06T21:43:01.890 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:43:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.030+0000 7effab4d8640 1 Processor -- start 2023-07-06T21:43:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.030+0000 7effab4d8640 1 -- start start 2023-07-06T21:43:02.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.030+0000 7effab4d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7effa415b850 0x7effa40cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.030+0000 7effab4d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa40b2b80 con 0x7effa40ccd30 2023-07-06T21:43:02.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.030+0000 7effab4d8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa40cff30 con 0x7effa40b3f80 2023-07-06T21:43:02.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.030+0000 7effab4d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa40b22e0 con 0x7effa415b850 2023-07-06T21:43:02.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.030+0000 7effa9274640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7effa415b850 0x7effa40cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.030+0000 7effa8a73640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7effa40ccd30 0x7effa40b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33092/0 (socket says 172.21.15.55:33092) 2023-07-06T21:43:02.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.030+0000 7effa8a73640 1 -- 172.21.15.55:0/162599650 learned_addr learned my addr 172.21.15.55:0/162599650 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:02.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.030+0000 7effa9274640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7effa415b850 0x7effa40cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41780/0 (socket says 172.21.15.55:41780) 2023-07-06T21:43:02.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.030+0000 7effa9274640 1 -- 172.21.15.55:0/162599650 >> v1:172.21.15.138:6789/0 conn(0x7effa40b3f80 legacy=0x7effa40d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:02.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.030+0000 7effa9274640 1 -- 172.21.15.55:0/162599650 >> v1:172.21.15.55:6789/0 conn(0x7effa40ccd30 legacy=0x7effa40b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.030+0000 7eff9bfff640 1 -- 172.21.15.55:0/162599650 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677781679 0 0) 0x7effa40b2b80 con 0x7effa40ccd30 2023-07-06T21:43:02.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.030+0000 7effa9274640 1 -- 172.21.15.55:0/162599650 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa40b25c0 con 0x7effa415b850 2023-07-06T21:43:02.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.034+0000 7effa9274640 1 --2- 172.21.15.55:0/162599650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa415b850 0x7effa40cc7f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7effa00097c0 tx=0x7effa001c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6687cfa7a2866e55 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:02.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.034+0000 7eff9bfff640 1 -- 172.21.15.55:0/162599650 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa00ab600 con 0x7effa415b850 2023-07-06T21:43:02.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.034+0000 7eff9bfff640 1 -- 172.21.15.55:0/162599650 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa00a7050 con 0x7effa415b850 2023-07-06T21:43:02.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.034+0000 7eff9bfff640 1 -- 172.21.15.55:0/162599650 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa00ab980 con 0x7effa415b850 2023-07-06T21:43:02.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.034+0000 7effab4d8640 1 -- 172.21.15.55:0/162599650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa415b850 msgr2=0x7effa40cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.034+0000 7effab4d8640 1 --2- 172.21.15.55:0/162599650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa415b850 0x7effa40cc7f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7effa00097c0 tx=0x7effa001c2f0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.034+0000 7effab4d8640 1 -- 172.21.15.55:0/162599650 shutdown_connections 2023-07-06T21:43:02.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.034+0000 7effab4d8640 1 --2- 172.21.15.55:0/162599650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa415b850 0x7effa40cc7f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.034+0000 7effab4d8640 1 -- 172.21.15.55:0/162599650 >> 172.21.15.55:0/162599650 conn(0x7effa40cec20 msgr2=0x7effa40cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:02.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.034+0000 7effab4d8640 1 -- 172.21.15.55:0/162599650 shutdown_connections 2023-07-06T21:43:02.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.034+0000 7effab4d8640 1 -- 172.21.15.55:0/162599650 wait complete. 2023-07-06T21:43:02.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effab4d8640 1 Processor -- start 2023-07-06T21:43:02.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effab4d8640 1 -- start start 2023-07-06T21:43:02.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effab4d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effa40b3f80 0x7effa40b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effab4d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa40ccd30 0x7effa4152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effab4d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effa415b850 0x7effa4158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effab4d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa415a6d0 con 0x7effa40ccd30 2023-07-06T21:43:02.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effab4d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa4159ac0 con 0x7effa40b3f80 2023-07-06T21:43:02.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effab4d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa4159da0 con 0x7effa415b850 2023-07-06T21:43:02.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effa8a73640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa40ccd30 0x7effa4152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effa8a73640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa40ccd30 0x7effa4152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41794/0 (socket says 172.21.15.55:41794) 2023-07-06T21:43:02.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effa8a73640 1 -- 172.21.15.55:0/3040491093 learned_addr learned my addr 172.21.15.55:0/3040491093 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:02.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effa9a75640 1 --2- 172.21.15.55:0/3040491093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effa415b850 0x7effa4158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effa9274640 1 --2- 172.21.15.55:0/3040491093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effa40b3f80 0x7effa40b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effa8a73640 1 -- 172.21.15.55:0/3040491093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effa415b850 msgr2=0x7effa4158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effa8a73640 1 --2- 172.21.15.55:0/3040491093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effa415b850 0x7effa4158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effa8a73640 1 -- 172.21.15.55:0/3040491093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effa40b3f80 msgr2=0x7effa40b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effa8a73640 1 --2- 172.21.15.55:0/3040491093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effa40b3f80 0x7effa40b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effa8a73640 1 -- 172.21.15.55:0/3040491093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0009420 con 0x7effa40ccd30 2023-07-06T21:43:02.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effa8a73640 1 --2- 172.21.15.55:0/3040491093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa40ccd30 0x7effa4152180 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7eff940011f0 tx=0x7eff9400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:02.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7eff99ffb640 1 -- 172.21.15.55:0/3040491093 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff940074e0 con 0x7effa40ccd30 2023-07-06T21:43:02.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7eff99ffb640 1 -- 172.21.15.55:0/3040491093 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff94007640 con 0x7effa40ccd30 2023-07-06T21:43:02.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7eff99ffb640 1 -- 172.21.15.55:0/3040491093 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94004a10 con 0x7effa40ccd30 2023-07-06T21:43:02.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effab4d8640 1 -- 172.21.15.55:0/3040491093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa415bda0 con 0x7effa40ccd30 2023-07-06T21:43:02.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effab4d8640 1 -- 172.21.15.55:0/3040491093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa415a360 con 0x7effa40ccd30 2023-07-06T21:43:02.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.038+0000 7effab4d8640 1 -- 172.21.15.55:0/3040491093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa40c9250 con 0x7effa40ccd30 2023-07-06T21:43:02.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.042+0000 7eff99ffb640 1 -- 172.21.15.55:0/3040491093 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7eff94004b70 con 0x7effa40ccd30 2023-07-06T21:43:02.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.042+0000 7eff99ffb640 1 --2- 172.21.15.55:0/3040491093 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7eff88066280 0x7eff88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.042+0000 7eff99ffb640 1 -- 172.21.15.55:0/3040491093 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7eff940833b0 con 0x7effa40ccd30 2023-07-06T21:43:02.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.042+0000 7effa9274640 1 --2- 172.21.15.55:0/3040491093 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7eff88066280 0x7eff88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.042+0000 7effa9274640 1 --2- 172.21.15.55:0/3040491093 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7eff88066280 0x7eff88068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7effa00ad000 tx=0x7effa00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:02.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.046+0000 7eff99ffb640 1 -- 172.21.15.55:0/3040491093 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff94050460 con 0x7effa40ccd30 2023-07-06T21:43:02.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.198+0000 7effab4d8640 1 -- 172.21.15.55:0/3040491093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7effa4066d60 con 0x7effa40ccd30 2023-07-06T21:43:02.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.202+0000 7eff99ffb640 1 -- 172.21.15.55:0/3040491093 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7eff940180a0 con 0x7effa40ccd30 2023-07-06T21:43:02.208 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:43:02.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.202+0000 7effab4d8640 1 -- 172.21.15.55:0/3040491093 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7eff88066280 msgr2=0x7eff88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.202+0000 7effab4d8640 1 --2- 172.21.15.55:0/3040491093 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7eff88066280 0x7eff88068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7effa00ad000 tx=0x7effa00a6000 comp rx=0 tx=0).stop 2023-07-06T21:43:02.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.202+0000 7effab4d8640 1 -- 172.21.15.55:0/3040491093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa40ccd30 msgr2=0x7effa4152180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.202+0000 7effab4d8640 1 --2- 172.21.15.55:0/3040491093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa40ccd30 0x7effa4152180 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7eff940011f0 tx=0x7eff9400c9b0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.202+0000 7effab4d8640 1 -- 172.21.15.55:0/3040491093 shutdown_connections 2023-07-06T21:43:02.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.202+0000 7effab4d8640 1 --2- 172.21.15.55:0/3040491093 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7eff88066280 0x7eff88068730 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.202+0000 7effab4d8640 1 --2- 172.21.15.55:0/3040491093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effa415b850 0x7effa4158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.202+0000 7effab4d8640 1 --2- 172.21.15.55:0/3040491093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa40ccd30 0x7effa4152180 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.202+0000 7effab4d8640 1 --2- 172.21.15.55:0/3040491093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effa40b3f80 0x7effa40b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.202+0000 7effab4d8640 1 -- 172.21.15.55:0/3040491093 >> 172.21.15.55:0/3040491093 conn(0x7effa40cec20 msgr2=0x7effa40b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:02.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.202+0000 7effab4d8640 1 -- 172.21.15.55:0/3040491093 shutdown_connections 2023-07-06T21:43:02.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.202+0000 7effab4d8640 1 -- 172.21.15.55:0/3040491093 wait complete. 2023-07-06T21:43:02.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:43:02.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa366f11640 1 Processor -- start 2023-07-06T21:43:02.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa366f11640 1 -- start start 2023-07-06T21:43:02.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa366f11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa36015b850 0x7fa3600cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa366f11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3600ccd30 0x7fa3600b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa366f11640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3600b4210 con 0x7fa3600b3db0 2023-07-06T21:43:02.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa366f11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3600b2b80 con 0x7fa36015b850 2023-07-06T21:43:02.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa366f11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3600cff30 con 0x7fa3600ccd30 2023-07-06T21:43:02.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa364cad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa36015b850 0x7fa3600cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa364cad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa36015b850 0x7fa3600cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41808/0 (socket says 172.21.15.55:41808) 2023-07-06T21:43:02.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa364cad640 1 -- 172.21.15.55:0/3855906650 learned_addr learned my addr 172.21.15.55:0/3855906650 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:02.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa35ffff640 1 --2- 172.21.15.55:0/3855906650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3600ccd30 0x7fa3600b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa364cad640 1 -- 172.21.15.55:0/3855906650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3600ccd30 msgr2=0x7fa3600b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:02.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa364cad640 1 --2- 172.21.15.55:0/3855906650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3600ccd30 0x7fa3600b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa364cad640 1 -- 172.21.15.55:0/3855906650 >> v1:172.21.15.138:6789/0 conn(0x7fa3600b3db0 legacy=0x7fa36015f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.370+0000 7fa364cad640 1 -- 172.21.15.55:0/3855906650 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3600b22e0 con 0x7fa36015b850 2023-07-06T21:43:02.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.374+0000 7fa364cad640 1 --2- 172.21.15.55:0/3855906650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa36015b850 0x7fa3600cc7f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa354009870 tx=0x7fa35401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401f86e82b26ff6f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:02.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.374+0000 7fa35f7fe640 1 -- 172.21.15.55:0/3855906650 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3540ab5f0 con 0x7fa36015b850 2023-07-06T21:43:02.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.374+0000 7fa35f7fe640 1 -- 172.21.15.55:0/3855906650 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3540ab750 con 0x7fa36015b850 2023-07-06T21:43:02.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.374+0000 7fa35f7fe640 1 -- 172.21.15.55:0/3855906650 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3540abae0 con 0x7fa36015b850 2023-07-06T21:43:02.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.374+0000 7fa366f11640 1 -- 172.21.15.55:0/3855906650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa36015b850 msgr2=0x7fa3600cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.374+0000 7fa366f11640 1 --2- 172.21.15.55:0/3855906650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa36015b850 0x7fa3600cc7f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa354009870 tx=0x7fa35401c3f0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.374+0000 7fa366f11640 1 -- 172.21.15.55:0/3855906650 shutdown_connections 2023-07-06T21:43:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.374+0000 7fa366f11640 1 --2- 172.21.15.55:0/3855906650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3600ccd30 0x7fa3600b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.374+0000 7fa366f11640 1 --2- 172.21.15.55:0/3855906650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa36015b850 0x7fa3600cc7f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.374+0000 7fa366f11640 1 -- 172.21.15.55:0/3855906650 >> 172.21.15.55:0/3855906650 conn(0x7fa3600cec20 msgr2=0x7fa3600cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.374+0000 7fa366f11640 1 -- 172.21.15.55:0/3855906650 shutdown_connections 2023-07-06T21:43:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.374+0000 7fa366f11640 1 -- 172.21.15.55:0/3855906650 wait complete. 2023-07-06T21:43:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa366f11640 1 Processor -- start 2023-07-06T21:43:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa366f11640 1 -- start start 2023-07-06T21:43:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa366f11640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3600b3db0 0x7fa36015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa366f11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3600ccd30 0x7fa360156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa366f11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36015b850 0x7fa360151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa366f11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa360152f50 con 0x7fa3600ccd30 2023-07-06T21:43:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa366f11640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36015a1f0 con 0x7fa3600b3db0 2023-07-06T21:43:02.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa366f11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa360152900 con 0x7fa36015b850 2023-07-06T21:43:02.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa35ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3600ccd30 0x7fa360156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa35ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3600ccd30 0x7fa360156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41820/0 (socket says 172.21.15.55:41820) 2023-07-06T21:43:02.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa35ffff640 1 -- 172.21.15.55:0/2348465115 learned_addr learned my addr 172.21.15.55:0/2348465115 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:02.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa364cad640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3600b3db0 0x7fa36015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa3654ae640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36015b850 0x7fa360151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa35ffff640 1 -- 172.21.15.55:0/2348465115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36015b850 msgr2=0x7fa360151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa35ffff640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36015b850 0x7fa360151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa35ffff640 1 -- 172.21.15.55:0/2348465115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3600b3db0 msgr2=0x7fa36015aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa35ffff640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3600b3db0 0x7fa36015aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa35ffff640 1 -- 172.21.15.55:0/2348465115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3540094d0 con 0x7fa3600ccd30 2023-07-06T21:43:02.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa3654ae640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36015b850 0x7fa360151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:02.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa35ffff640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3600ccd30 0x7fa360156b20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00e900 tx=0x7fa34c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:02.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa35d7fa640 1 -- 172.21.15.55:0/2348465115 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c009690 con 0x7fa3600ccd30 2023-07-06T21:43:02.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa35d7fa640 1 -- 172.21.15.55:0/2348465115 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c00ca00 con 0x7fa3600ccd30 2023-07-06T21:43:02.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa35d7fa640 1 -- 172.21.15.55:0/2348465115 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c00cdb0 con 0x7fa3600ccd30 2023-07-06T21:43:02.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa366f11640 1 -- 172.21.15.55:0/2348465115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36015bda0 con 0x7fa3600ccd30 2023-07-06T21:43:02.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.378+0000 7fa366f11640 1 -- 172.21.15.55:0/2348465115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36015a4d0 con 0x7fa3600ccd30 2023-07-06T21:43:02.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.382+0000 7fa366f11640 1 -- 172.21.15.55:0/2348465115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa360066d60 con 0x7fa3600ccd30 2023-07-06T21:43:02.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.382+0000 7fa35d7fa640 1 -- 172.21.15.55:0/2348465115 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa34c013470 con 0x7fa3600ccd30 2023-07-06T21:43:02.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.382+0000 7fa35d7fa640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa3440662b0 0x7fa344068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.382+0000 7fa35d7fa640 1 -- 172.21.15.55:0/2348465115 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa34c084230 con 0x7fa3600ccd30 2023-07-06T21:43:02.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.382+0000 7fa364cad640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa3440662b0 0x7fa344068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.382+0000 7fa364cad640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa3440662b0 0x7fa344068760 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa3540af000 tx=0x7fa3540b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:02.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.386+0000 7fa35d7fa640 1 -- 172.21.15.55:0/2348465115 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa34c051390 con 0x7fa3600ccd30 2023-07-06T21:43:02.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.542+0000 7fa366f11640 1 -- 172.21.15.55:0/2348465115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3600b3420 con 0x7fa3600ccd30 2023-07-06T21:43:02.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.542+0000 7fa35d7fa640 1 -- 172.21.15.55:0/2348465115 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa34c0549b0 con 0x7fa3600ccd30 2023-07-06T21:43:02.549 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:43:02.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.542+0000 7fa366f11640 1 -- 172.21.15.55:0/2348465115 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa3440662b0 msgr2=0x7fa344068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.542+0000 7fa366f11640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa3440662b0 0x7fa344068760 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa3540af000 tx=0x7fa3540b6040 comp rx=0 tx=0).stop 2023-07-06T21:43:02.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.542+0000 7fa366f11640 1 -- 172.21.15.55:0/2348465115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3600ccd30 msgr2=0x7fa360156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.542+0000 7fa366f11640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3600ccd30 0x7fa360156b20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00e900 tx=0x7fa34c00edc0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.542+0000 7fa366f11640 1 -- 172.21.15.55:0/2348465115 shutdown_connections 2023-07-06T21:43:02.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.542+0000 7fa366f11640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa3440662b0 0x7fa344068760 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.542+0000 7fa366f11640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36015b850 0x7fa360151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.542+0000 7fa366f11640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3600ccd30 0x7fa360156b20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.542+0000 7fa366f11640 1 --2- 172.21.15.55:0/2348465115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3600b3db0 0x7fa36015aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.542+0000 7fa366f11640 1 -- 172.21.15.55:0/2348465115 >> 172.21.15.55:0/2348465115 conn(0x7fa3600cec20 msgr2=0x7fa3601541a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:02.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.546+0000 7fa366f11640 1 -- 172.21.15.55:0/2348465115 shutdown_connections 2023-07-06T21:43:02.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.546+0000 7fa366f11640 1 -- 172.21.15.55:0/2348465115 wait complete. 2023-07-06T21:43:02.570 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:43:02.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.710+0000 7f341a80b640 1 Processor -- start 2023-07-06T21:43:02.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.710+0000 7f341a80b640 1 -- start start 2023-07-06T21:43:02.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.710+0000 7f341a80b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3414156180 0x7f34140ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.710+0000 7f341a80b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34140cbeb0 0x7f341406ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.710+0000 7f341a80b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34140cc310 con 0x7f341406e9d0 2023-07-06T21:43:02.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.710+0000 7f341a80b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3414160250 con 0x7f3414156180 2023-07-06T21:43:02.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.710+0000 7f341a80b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341406f390 con 0x7f34140cbeb0 2023-07-06T21:43:02.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.710+0000 7f3413fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3414156180 0x7f34140ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.710+0000 7f3418da8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34140cbeb0 0x7f341406ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.710+0000 7f3413fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3414156180 0x7f34140ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:41296/0 (socket says 172.21.15.55:41296) 2023-07-06T21:43:02.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.710+0000 7f3413fff640 1 -- 172.21.15.55:0/1013712144 learned_addr learned my addr 172.21.15.55:0/1013712144 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:02.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.714+0000 7f3413fff640 1 -- 172.21.15.55:0/1013712144 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34140cbeb0 msgr2=0x7f341406ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:02.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.714+0000 7f3413fff640 1 --2- 172.21.15.55:0/1013712144 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34140cbeb0 0x7f341406ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.714+0000 7f3413fff640 1 -- 172.21.15.55:0/1013712144 >> v1:172.21.15.138:6789/0 conn(0x7f341406e9d0 legacy=0x7f34140cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.714+0000 7f3413fff640 1 -- 172.21.15.55:0/1013712144 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341415f5d0 con 0x7f3414156180 2023-07-06T21:43:02.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.714+0000 7f3418da8640 1 --2- 172.21.15.55:0/1013712144 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34140cbeb0 0x7f341406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:02.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.714+0000 7f3413fff640 1 --2- 172.21.15.55:0/1013712144 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3414156180 0x7f34140ca610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3404009870 tx=0x7f340401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4d1296dacabb867 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:02.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.714+0000 7f3412ffd640 1 -- 172.21.15.55:0/1013712144 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34040ab680 con 0x7f3414156180 2023-07-06T21:43:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.714+0000 7f3412ffd640 1 -- 172.21.15.55:0/1013712144 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34040ab7e0 con 0x7f3414156180 2023-07-06T21:43:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.714+0000 7f3412ffd640 1 -- 172.21.15.55:0/1013712144 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34040abb70 con 0x7f3414156180 2023-07-06T21:43:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 -- 172.21.15.55:0/1013712144 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3414156180 msgr2=0x7f34140ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 --2- 172.21.15.55:0/1013712144 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3414156180 0x7f34140ca610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3404009870 tx=0x7f340401c480 comp rx=0 tx=0).stop 2023-07-06T21:43:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 -- 172.21.15.55:0/1013712144 shutdown_connections 2023-07-06T21:43:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 --2- 172.21.15.55:0/1013712144 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34140cbeb0 0x7f341406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 --2- 172.21.15.55:0/1013712144 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3414156180 0x7f34140ca610 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 -- 172.21.15.55:0/1013712144 >> 172.21.15.55:0/1013712144 conn(0x7f34140d0c50 msgr2=0x7f34140cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:02.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 -- 172.21.15.55:0/1013712144 shutdown_connections 2023-07-06T21:43:02.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 -- 172.21.15.55:0/1013712144 wait complete. 2023-07-06T21:43:02.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 Processor -- start 2023-07-06T21:43:02.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 -- start start 2023-07-06T21:43:02.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f341406e9d0 0x7f341414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34140cbeb0 0x7f3414152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3414156180 0x7f34141531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34140c4d60 con 0x7f34140cbeb0 2023-07-06T21:43:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3414154d80 con 0x7f341406e9d0 2023-07-06T21:43:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f341a80b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34140c4fb0 con 0x7f3414156180 2023-07-06T21:43:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f34137fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34140cbeb0 0x7f3414152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f34137fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34140cbeb0 0x7f3414152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41828/0 (socket says 172.21.15.55:41828) 2023-07-06T21:43:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f34137fe640 1 -- 172.21.15.55:0/1865045269 learned_addr learned my addr 172.21.15.55:0/1865045269 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f3413fff640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f341406e9d0 0x7f341414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.718+0000 7f3418da8640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3414156180 0x7f34141531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f34137fe640 1 -- 172.21.15.55:0/1865045269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3414156180 msgr2=0x7f34141531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f34137fe640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3414156180 0x7f34141531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f34137fe640 1 -- 172.21.15.55:0/1865045269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f341406e9d0 msgr2=0x7f341414d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f34137fe640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f341406e9d0 0x7f341414d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f34137fe640 1 -- 172.21.15.55:0/1865045269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c009a70 con 0x7f34140cbeb0 2023-07-06T21:43:02.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f3418da8640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3414156180 0x7f34141531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:02.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f34137fe640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34140cbeb0 0x7f3414152c70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f340800c530 tx=0x7f340800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:02.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f3410ff9640 1 -- 172.21.15.55:0/1865045269 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408005220 con 0x7f34140cbeb0 2023-07-06T21:43:02.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f3410ff9640 1 -- 172.21.15.55:0/1865045269 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3408005380 con 0x7f34140cbeb0 2023-07-06T21:43:02.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f3410ff9640 1 -- 172.21.15.55:0/1865045269 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408007270 con 0x7f34140cbeb0 2023-07-06T21:43:02.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f341a80b640 1 -- 172.21.15.55:0/1865045269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34040094d0 con 0x7f34140cbeb0 2023-07-06T21:43:02.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f341a80b640 1 -- 172.21.15.55:0/1865045269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34140c5570 con 0x7f34140cbeb0 2023-07-06T21:43:02.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f341a80b640 1 -- 172.21.15.55:0/1865045269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3414066d60 con 0x7f34140cbeb0 2023-07-06T21:43:02.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f3410ff9640 1 -- 172.21.15.55:0/1865045269 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f34080073d0 con 0x7f34140cbeb0 2023-07-06T21:43:02.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f3410ff9640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f34000662b0 0x7f3400068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:02.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f3410ff9640 1 -- 172.21.15.55:0/1865045269 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f34080837e0 con 0x7f34140cbeb0 2023-07-06T21:43:02.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.722+0000 7f3413fff640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f34000662b0 0x7f3400068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:02.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.726+0000 7f3413fff640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f34000662b0 0x7f3400068760 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f34040af000 tx=0x7f34040b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:02.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.726+0000 7f3410ff9640 1 -- 172.21.15.55:0/1865045269 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f34080509c0 con 0x7f34140cbeb0 2023-07-06T21:43:02.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.882+0000 7f341a80b640 1 -- 172.21.15.55:0/1865045269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f34140cd930 con 0x7f34140cbeb0 2023-07-06T21:43:02.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.882+0000 7f3410ff9640 1 -- 172.21.15.55:0/1865045269 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3408053fe0 con 0x7f34140cbeb0 2023-07-06T21:43:02.891 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:43:02.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.886+0000 7f341a80b640 1 -- 172.21.15.55:0/1865045269 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f34000662b0 msgr2=0x7f3400068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.886+0000 7f341a80b640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f34000662b0 0x7f3400068760 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f34040af000 tx=0x7f34040b6040 comp rx=0 tx=0).stop 2023-07-06T21:43:02.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.886+0000 7f341a80b640 1 -- 172.21.15.55:0/1865045269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34140cbeb0 msgr2=0x7f3414152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:02.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.886+0000 7f341a80b640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34140cbeb0 0x7f3414152c70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f340800c530 tx=0x7f340800c9f0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.886+0000 7f341a80b640 1 -- 172.21.15.55:0/1865045269 shutdown_connections 2023-07-06T21:43:02.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.886+0000 7f341a80b640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f34000662b0 0x7f3400068760 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.886+0000 7f341a80b640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3414156180 0x7f34141531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.886+0000 7f341a80b640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34140cbeb0 0x7f3414152c70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.886+0000 7f341a80b640 1 --2- 172.21.15.55:0/1865045269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f341406e9d0 0x7f341414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:02.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.886+0000 7f341a80b640 1 -- 172.21.15.55:0/1865045269 >> 172.21.15.55:0/1865045269 conn(0x7f34140d0c50 msgr2=0x7f34140cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:02.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.886+0000 7f341a80b640 1 -- 172.21.15.55:0/1865045269 shutdown_connections 2023-07-06T21:43:02.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:02.886+0000 7f341a80b640 1 -- 172.21.15.55:0/1865045269 wait complete. 2023-07-06T21:43:02.912 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T21:43:03.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3db626d640 1 Processor -- start 2023-07-06T21:43:03.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3db626d640 1 -- start start 2023-07-06T21:43:03.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3db626d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3db00ca130 0x7f3db00703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3db626d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3db00cd140 0x7f3db0070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3db626d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db0158c20 con 0x7f3db0158850 2023-07-06T21:43:03.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3db626d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db00b2aa0 con 0x7f3db00cd140 2023-07-06T21:43:03.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3db626d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db00c8db0 con 0x7f3db00ca130 2023-07-06T21:43:03.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3db480a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3db00cd140 0x7f3db0070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3db480a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3db00cd140 0x7f3db0070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41832/0 (socket says 172.21.15.55:41832) 2023-07-06T21:43:03.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3db480a640 1 -- 172.21.15.55:0/1601143845 learned_addr learned my addr 172.21.15.55:0/1601143845 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:03.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3daf7fe640 1 --2- 172.21.15.55:0/1601143845 >> v2:172.21.15.138:3300/0 conn(0x7f3db00ca130 0x7f3db00703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3db480a640 1 -- 172.21.15.55:0/1601143845 >> v2:172.21.15.138:3300/0 conn(0x7f3db00ca130 msgr2=0x7f3db00703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:03.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3db480a640 1 --2- 172.21.15.55:0/1601143845 >> v2:172.21.15.138:3300/0 conn(0x7f3db00ca130 0x7f3db00703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3db480a640 1 -- 172.21.15.55:0/1601143845 >> v1:172.21.15.138:6789/0 conn(0x7f3db0158850 legacy=0x7f3db00cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.054+0000 7f3db480a640 1 -- 172.21.15.55:0/1601143845 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db00c9090 con 0x7f3db00cd140 2023-07-06T21:43:03.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.058+0000 7f3db480a640 1 --2- 172.21.15.55:0/1601143845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3db00cd140 0x7f3db0070920 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3db0071490 tx=0x7f3da801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2756749c1caa34be server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:03.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.058+0000 7f3daeffd640 1 -- 172.21.15.55:0/1601143845 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da80a5860 con 0x7f3db00cd140 2023-07-06T21:43:03.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.058+0000 7f3daeffd640 1 -- 172.21.15.55:0/1601143845 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da80a59c0 con 0x7f3db00cd140 2023-07-06T21:43:03.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.058+0000 7f3daeffd640 1 -- 172.21.15.55:0/1601143845 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da80a5d50 con 0x7f3db00cd140 2023-07-06T21:43:03.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.058+0000 7f3db626d640 1 -- 172.21.15.55:0/1601143845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3db00cd140 msgr2=0x7f3db0070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.058+0000 7f3db626d640 1 --2- 172.21.15.55:0/1601143845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3db00cd140 0x7f3db0070920 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3db0071490 tx=0x7f3da801c9a0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.058+0000 7f3db626d640 1 -- 172.21.15.55:0/1601143845 shutdown_connections 2023-07-06T21:43:03.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.058+0000 7f3db626d640 1 --2- 172.21.15.55:0/1601143845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3db00cd140 0x7f3db0070920 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.058+0000 7f3db626d640 1 --2- 172.21.15.55:0/1601143845 >> v2:172.21.15.138:3300/0 conn(0x7f3db00ca130 0x7f3db00703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.058+0000 7f3db626d640 1 -- 172.21.15.55:0/1601143845 >> 172.21.15.55:0/1601143845 conn(0x7f3db00cea70 msgr2=0x7f3db00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:03.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.058+0000 7f3db626d640 1 -- 172.21.15.55:0/1601143845 shutdown_connections 2023-07-06T21:43:03.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.058+0000 7f3db626d640 1 -- 172.21.15.55:0/1601143845 wait complete. 2023-07-06T21:43:03.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.058+0000 7f3db626d640 1 Processor -- start 2023-07-06T21:43:03.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3db626d640 1 -- start start 2023-07-06T21:43:03.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3db626d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3db00ca130 0x7f3db006bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3db626d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3db00cd140 0x7f3db00c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3db626d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3db0158850 0x7f3db01510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3db626d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db01540d0 con 0x7f3db00cd140 2023-07-06T21:43:03.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3db626d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db0154370 con 0x7f3db00ca130 2023-07-06T21:43:03.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3db626d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db0154650 con 0x7f3db0158850 2023-07-06T21:43:03.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3daf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3db00cd140 0x7f3db00c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3daffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3db00ca130 0x7f3db006bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3daf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3db00cd140 0x7f3db00c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41842/0 (socket says 172.21.15.55:41842) 2023-07-06T21:43:03.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3daf7fe640 1 -- 172.21.15.55:0/3371894649 learned_addr learned my addr 172.21.15.55:0/3371894649 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:03.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3db480a640 1 --2- 172.21.15.55:0/3371894649 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3db0158850 0x7f3db01510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3daf7fe640 1 -- 172.21.15.55:0/3371894649 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3db0158850 msgr2=0x7f3db01510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3daf7fe640 1 --2- 172.21.15.55:0/3371894649 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3db0158850 0x7f3db01510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3daf7fe640 1 -- 172.21.15.55:0/3371894649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3db00ca130 msgr2=0x7f3db006bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3daf7fe640 1 --2- 172.21.15.55:0/3371894649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3db00ca130 0x7f3db006bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3daf7fe640 1 -- 172.21.15.55:0/3371894649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da8009b30 con 0x7f3db00cd140 2023-07-06T21:43:03.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3daffff640 1 --2- 172.21.15.55:0/3371894649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3db00ca130 0x7f3db006bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:03.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3daf7fe640 1 --2- 172.21.15.55:0/3371894649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3db00cd140 0x7f3db00c34c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3da400e930 tx=0x7f3da400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:03.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3dacff9640 1 -- 172.21.15.55:0/3371894649 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4009690 con 0x7f3db00cd140 2023-07-06T21:43:03.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3dacff9640 1 -- 172.21.15.55:0/3371894649 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da400ca00 con 0x7f3db00cd140 2023-07-06T21:43:03.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3db626d640 1 -- 172.21.15.55:0/3371894649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db0154930 con 0x7f3db00cd140 2023-07-06T21:43:03.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3dacff9640 1 -- 172.21.15.55:0/3371894649 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da400cd70 con 0x7f3db00cd140 2023-07-06T21:43:03.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3db626d640 1 -- 172.21.15.55:0/3371894649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db0151e20 con 0x7f3db00cd140 2023-07-06T21:43:03.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.062+0000 7f3db626d640 1 -- 172.21.15.55:0/3371894649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db0066d60 con 0x7f3db00cd140 2023-07-06T21:43:03.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.066+0000 7f3dacff9640 1 -- 172.21.15.55:0/3371894649 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3da4013470 con 0x7f3db00cd140 2023-07-06T21:43:03.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.066+0000 7f3dacff9640 1 --2- 172.21.15.55:0/3371894649 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3d9c066280 0x7f3d9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.066+0000 7f3dacff9640 1 -- 172.21.15.55:0/3371894649 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3da4084280 con 0x7f3db00cd140 2023-07-06T21:43:03.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.066+0000 7f3daffff640 1 --2- 172.21.15.55:0/3371894649 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3d9c066280 0x7f3d9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.066+0000 7f3daffff640 1 --2- 172.21.15.55:0/3371894649 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3d9c066280 0x7f3d9c068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3db00c5b50 tx=0x7f3da0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:03.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.070+0000 7f3dacff9640 1 -- 172.21.15.55:0/3371894649 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3da4051530 con 0x7f3db00cd140 2023-07-06T21:43:03.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.226+0000 7f3db626d640 1 -- 172.21.15.55:0/3371894649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3db006cd30 con 0x7f3db00cd140 2023-07-06T21:43:03.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.226+0000 7f3dacff9640 1 -- 172.21.15.55:0/3371894649 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3da4054b50 con 0x7f3db00cd140 2023-07-06T21:43:03.232 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:43:03.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.226+0000 7f3db626d640 1 -- 172.21.15.55:0/3371894649 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3d9c066280 msgr2=0x7f3d9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.226+0000 7f3db626d640 1 --2- 172.21.15.55:0/3371894649 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3d9c066280 0x7f3d9c068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3db00c5b50 tx=0x7f3da0009040 comp rx=0 tx=0).stop 2023-07-06T21:43:03.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.226+0000 7f3db626d640 1 -- 172.21.15.55:0/3371894649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3db00cd140 msgr2=0x7f3db00c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.226+0000 7f3db626d640 1 --2- 172.21.15.55:0/3371894649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3db00cd140 0x7f3db00c34c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3da400e930 tx=0x7f3da400edf0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.226+0000 7f3db626d640 1 -- 172.21.15.55:0/3371894649 shutdown_connections 2023-07-06T21:43:03.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.226+0000 7f3db626d640 1 --2- 172.21.15.55:0/3371894649 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3d9c066280 0x7f3d9c068730 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.226+0000 7f3db626d640 1 --2- 172.21.15.55:0/3371894649 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3db0158850 0x7f3db01510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.226+0000 7f3db626d640 1 --2- 172.21.15.55:0/3371894649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3db00cd140 0x7f3db00c34c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.226+0000 7f3db626d640 1 --2- 172.21.15.55:0/3371894649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3db00ca130 0x7f3db006bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.226+0000 7f3db626d640 1 -- 172.21.15.55:0/3371894649 >> 172.21.15.55:0/3371894649 conn(0x7f3db00cea70 msgr2=0x7f3db00ca500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:03.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.226+0000 7f3db626d640 1 -- 172.21.15.55:0/3371894649 shutdown_connections 2023-07-06T21:43:03.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.226+0000 7f3db626d640 1 -- 172.21.15.55:0/3371894649 wait complete. 2023-07-06T21:43:03.254 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T21:43:03.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.390+0000 7f49f6d03640 1 Processor -- start 2023-07-06T21:43:03.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.390+0000 7f49f6d03640 1 -- start start 2023-07-06T21:43:03.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.390+0000 7f49f6d03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f49f006fff0 0x7f49f0070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.390+0000 7f49f6d03640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00b2ca0 0x7f49f00b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.390+0000 7f49f6d03640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f00cd490 con 0x7f49f01597d0 2023-07-06T21:43:03.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.390+0000 7f49f6d03640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f0070960 con 0x7f49f006fff0 2023-07-06T21:43:03.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.390+0000 7f49f6d03640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f015cf60 con 0x7f49f00b2ca0 2023-07-06T21:43:03.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.390+0000 7f49effff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f49f006fff0 0x7f49f0070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.390+0000 7f49effff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f49f006fff0 0x7f49f0070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35738/0 (socket says 172.21.15.55:35738) 2023-07-06T21:43:03.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.390+0000 7f49f52a0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00b2ca0 0x7f49f00b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.390+0000 7f49effff640 1 -- 172.21.15.55:0/285763372 learned_addr learned my addr 172.21.15.55:0/285763372 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49effff640 1 -- 172.21.15.55:0/285763372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00b2ca0 msgr2=0x7f49f00b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49effff640 1 --2- 172.21.15.55:0/285763372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00b2ca0 0x7f49f00b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49effff640 1 -- 172.21.15.55:0/285763372 >> v1:172.21.15.138:6789/0 conn(0x7f49f01597d0 legacy=0x7f49f00ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49effff640 1 -- 172.21.15.55:0/285763372 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00ccb60 con 0x7f49f006fff0 2023-07-06T21:43:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49ef7fe640 1 -- 172.21.15.55:0/285763372 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093917618 0 0) 0x7f49f00cd490 con 0x7f49f01597d0 2023-07-06T21:43:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49effff640 1 --2- 172.21.15.55:0/285763372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49f006fff0 0x7f49f0070420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009870 tx=0x7f49dc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28e4aa14d54a978 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:03.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49ef7fe640 1 -- 172.21.15.55:0/285763372 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f00b3e70 con 0x7f49f006fff0 2023-07-06T21:43:03.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49ef7fe640 1 -- 172.21.15.55:0/285763372 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc0ab680 con 0x7f49f006fff0 2023-07-06T21:43:03.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49ef7fe640 1 -- 172.21.15.55:0/285763372 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0aba10 con 0x7f49f006fff0 2023-07-06T21:43:03.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49f6d03640 1 -- 172.21.15.55:0/285763372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49f006fff0 msgr2=0x7f49f0070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49f6d03640 1 --2- 172.21.15.55:0/285763372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49f006fff0 0x7f49f0070420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009870 tx=0x7f49dc01c480 comp rx=0 tx=0).stop 2023-07-06T21:43:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49f6d03640 1 -- 172.21.15.55:0/285763372 shutdown_connections 2023-07-06T21:43:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49f6d03640 1 --2- 172.21.15.55:0/285763372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00b2ca0 0x7f49f00b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49f6d03640 1 --2- 172.21.15.55:0/285763372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49f006fff0 0x7f49f0070420 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49f6d03640 1 -- 172.21.15.55:0/285763372 >> 172.21.15.55:0/285763372 conn(0x7f49f00cb970 msgr2=0x7f49f00cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49f6d03640 1 -- 172.21.15.55:0/285763372 shutdown_connections 2023-07-06T21:43:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.394+0000 7f49f6d03640 1 -- 172.21.15.55:0/285763372 wait complete. 2023-07-06T21:43:03.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f6d03640 1 Processor -- start 2023-07-06T21:43:03.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f6d03640 1 -- start start 2023-07-06T21:43:03.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f6d03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49f006fff0 0x7f49f014f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f6d03640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49f00b2ca0 0x7f49f01518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f6d03640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00c8880 0x7f49f0151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f6d03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f0143e40 con 0x7f49f006fff0 2023-07-06T21:43:03.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f6d03640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00c77e0 con 0x7f49f00b2ca0 2023-07-06T21:43:03.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f6d03640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00c7ac0 con 0x7f49f00c8880 2023-07-06T21:43:03.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f4a9f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49f006fff0 0x7f49f014f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f4a9f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49f006fff0 0x7f49f014f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35746/0 (socket says 172.21.15.55:35746) 2023-07-06T21:43:03.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f4a9f640 1 -- 172.21.15.55:0/559180042 learned_addr learned my addr 172.21.15.55:0/559180042 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:03.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49effff640 1 --2- 172.21.15.55:0/559180042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49f00b2ca0 0x7f49f01518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f52a0640 1 --2- 172.21.15.55:0/559180042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00c8880 0x7f49f0151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f4a9f640 1 -- 172.21.15.55:0/559180042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00c8880 msgr2=0x7f49f0151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f4a9f640 1 --2- 172.21.15.55:0/559180042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00c8880 0x7f49f0151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f4a9f640 1 -- 172.21.15.55:0/559180042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49f00b2ca0 msgr2=0x7f49f01518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f4a9f640 1 --2- 172.21.15.55:0/559180042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49f00b2ca0 0x7f49f01518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f4a9f640 1 -- 172.21.15.55:0/559180042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc0094d0 con 0x7f49f006fff0 2023-07-06T21:43:03.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.398+0000 7f49f4a9f640 1 --2- 172.21.15.55:0/559180042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49f006fff0 0x7f49f014f020 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f49e4001ec0 tx=0x7f49e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:03.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.402+0000 7f49ed7fa640 1 -- 172.21.15.55:0/559180042 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e40054e0 con 0x7f49f006fff0 2023-07-06T21:43:03.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.402+0000 7f49ed7fa640 1 -- 172.21.15.55:0/559180042 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4003600 con 0x7f49f006fff0 2023-07-06T21:43:03.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.402+0000 7f49ed7fa640 1 -- 172.21.15.55:0/559180042 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e40039b0 con 0x7f49f006fff0 2023-07-06T21:43:03.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.402+0000 7f49f6d03640 1 -- 172.21.15.55:0/559180042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f00c7da0 con 0x7f49f006fff0 2023-07-06T21:43:03.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.402+0000 7f49f6d03640 1 -- 172.21.15.55:0/559180042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f00c8360 con 0x7f49f006fff0 2023-07-06T21:43:03.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.402+0000 7f49f6d03640 1 -- 172.21.15.55:0/559180042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f0070420 con 0x7f49f006fff0 2023-07-06T21:43:03.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.402+0000 7f49ed7fa640 1 -- 172.21.15.55:0/559180042 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f49e4003b10 con 0x7f49f006fff0 2023-07-06T21:43:03.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.402+0000 7f49ed7fa640 1 --2- 172.21.15.55:0/559180042 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f49d4066280 0x7f49d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.402+0000 7f49ed7fa640 1 -- 172.21.15.55:0/559180042 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f49e4083650 con 0x7f49f006fff0 2023-07-06T21:43:03.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.402+0000 7f49effff640 1 --2- 172.21.15.55:0/559180042 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f49d4066280 0x7f49d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.406+0000 7f49effff640 1 --2- 172.21.15.55:0/559180042 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f49d4066280 0x7f49d4068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0af000 tx=0x7f49dc0b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:03.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.406+0000 7f49ed7fa640 1 -- 172.21.15.55:0/559180042 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f49e40507c0 con 0x7f49f006fff0 2023-07-06T21:43:03.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.574+0000 7f49f6d03640 1 -- 172.21.15.55:0/559180042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f49f0066d60 con 0x7f49f006fff0 2023-07-06T21:43:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.574+0000 7f49ed7fa640 1 -- 172.21.15.55:0/559180042 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f49e4017020 con 0x7f49f006fff0 2023-07-06T21:43:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2023-07-06T21:43:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.578+0000 7f49f6d03640 1 -- 172.21.15.55:0/559180042 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f49d4066280 msgr2=0x7f49d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.578+0000 7f49f6d03640 1 --2- 172.21.15.55:0/559180042 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f49d4066280 0x7f49d4068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0af000 tx=0x7f49dc0b6040 comp rx=0 tx=0).stop 2023-07-06T21:43:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.578+0000 7f49f6d03640 1 -- 172.21.15.55:0/559180042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49f006fff0 msgr2=0x7f49f014f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.578+0000 7f49f6d03640 1 --2- 172.21.15.55:0/559180042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49f006fff0 0x7f49f014f020 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f49e4001ec0 tx=0x7f49e400c8e0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.578+0000 7f49f6d03640 1 -- 172.21.15.55:0/559180042 shutdown_connections 2023-07-06T21:43:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.578+0000 7f49f6d03640 1 --2- 172.21.15.55:0/559180042 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f49d4066280 0x7f49d4068730 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.578+0000 7f49f6d03640 1 --2- 172.21.15.55:0/559180042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00c8880 0x7f49f0151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.578+0000 7f49f6d03640 1 --2- 172.21.15.55:0/559180042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49f00b2ca0 0x7f49f01518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.578+0000 7f49f6d03640 1 --2- 172.21.15.55:0/559180042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49f006fff0 0x7f49f014f020 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.578+0000 7f49f6d03640 1 -- 172.21.15.55:0/559180042 >> 172.21.15.55:0/559180042 conn(0x7f49f00cb970 msgr2=0x7f49f0152bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.578+0000 7f49f6d03640 1 -- 172.21.15.55:0/559180042 shutdown_connections 2023-07-06T21:43:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.578+0000 7f49f6d03640 1 -- 172.21.15.55:0/559180042 wait complete. 2023-07-06T21:43:03.604 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T21:43:03.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:03.605 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-06T21:43:03.683 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T21:43:03.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:03.684 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T21:43:03.694 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:43:03.695 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:43:03.705 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:43:03.705 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:43:03.755 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:43:03.756 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:43:03.807 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:43:03.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.942+0000 7f0ab15fa640 1 Processor -- start 2023-07-06T21:43:03.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.942+0000 7f0ab15fa640 1 -- start start 2023-07-06T21:43:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0ab15fa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0aac15b9d0 0x7f0aac15f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0ab15fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0aac0ce340 0x7f0aac0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0ab15fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aac0b3d10 0x7f0aac0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0ab15fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aac0b46f0 con 0x7f0aac0ce340 2023-07-06T21:43:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0ab15fa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aac06a160 con 0x7f0aac15b9d0 2023-07-06T21:43:03.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0ab15fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac15bda0 con 0x7f0aac0b3d10 2023-07-06T21:43:03.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0aa3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0aac0ce340 0x7f0aac0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0aa3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0aac0ce340 0x7f0aac0ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35756/0 (socket says 172.21.15.55:35756) 2023-07-06T21:43:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0aa3fff640 1 -- 172.21.15.55:0/1789791965 learned_addr learned my addr 172.21.15.55:0/1789791965 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0aab7fe640 1 --2- 172.21.15.55:0/1789791965 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aac0b3d10 0x7f0aac0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0aaaffd640 1 --2- 172.21.15.55:0/1789791965 >> v2:172.21.15.138:3300/0 conn(0x7f0aac15b9d0 0x7f0aac15f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0aa3fff640 1 -- 172.21.15.55:0/1789791965 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aac0b3d10 msgr2=0x7f0aac0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0aa3fff640 1 --2- 172.21.15.55:0/1789791965 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aac0b3d10 0x7f0aac0b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0aa3fff640 1 -- 172.21.15.55:0/1789791965 >> v2:172.21.15.138:3300/0 conn(0x7f0aac15b9d0 msgr2=0x7f0aac15f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0aa3fff640 1 --2- 172.21.15.55:0/1789791965 >> v2:172.21.15.138:3300/0 conn(0x7f0aac15b9d0 0x7f0aac15f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.946+0000 7f0aa3fff640 1 -- 172.21.15.55:0/1789791965 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac069590 con 0x7f0aac0ce340 2023-07-06T21:43:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0aa3fff640 1 --2- 172.21.15.55:0/1789791965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aac0ce340 0x7f0aac0ce7a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0aac0b49c0 tx=0x7f0a9401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7be9ed8e8666384 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0aaa7fc640 1 -- 172.21.15.55:0/1789791965 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a940aa5f0 con 0x7f0aac0ce340 2023-07-06T21:43:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0aaa7fc640 1 -- 172.21.15.55:0/1789791965 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a940aa750 con 0x7f0aac0ce340 2023-07-06T21:43:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0aaa7fc640 1 -- 172.21.15.55:0/1789791965 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a940aaae0 con 0x7f0aac0ce340 2023-07-06T21:43:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0ab15fa640 1 -- 172.21.15.55:0/1789791965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aac0ce340 msgr2=0x7f0aac0ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0ab15fa640 1 --2- 172.21.15.55:0/1789791965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aac0ce340 0x7f0aac0ce7a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0aac0b49c0 tx=0x7f0a9401c4d0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0ab15fa640 1 -- 172.21.15.55:0/1789791965 shutdown_connections 2023-07-06T21:43:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0ab15fa640 1 --2- 172.21.15.55:0/1789791965 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aac0b3d10 0x7f0aac0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0ab15fa640 1 --2- 172.21.15.55:0/1789791965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aac0ce340 0x7f0aac0ce7a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0ab15fa640 1 --2- 172.21.15.55:0/1789791965 >> v2:172.21.15.138:3300/0 conn(0x7f0aac15b9d0 0x7f0aac15f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0ab15fa640 1 -- 172.21.15.55:0/1789791965 >> 172.21.15.55:0/1789791965 conn(0x7f0aac0ced10 msgr2=0x7f0aac0cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0ab15fa640 1 -- 172.21.15.55:0/1789791965 shutdown_connections 2023-07-06T21:43:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0ab15fa640 1 -- 172.21.15.55:0/1789791965 wait complete. 2023-07-06T21:43:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0ab15fa640 1 Processor -- start 2023-07-06T21:43:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.950+0000 7f0ab15fa640 1 -- start start 2023-07-06T21:43:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0ab15fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aac0b3d10 0x7f0aac0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0ab15fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aac0ce340 0x7f0aac0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0ab15fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aac15b9d0 0x7f0aac14b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0ab15fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac0c5fd0 con 0x7f0aac15b9d0 2023-07-06T21:43:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0ab15fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac14eef0 con 0x7f0aac0ce340 2023-07-06T21:43:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0ab15fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac14e600 con 0x7f0aac0b3d10 2023-07-06T21:43:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aab7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aac15b9d0 0x7f0aac14b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aab7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aac15b9d0 0x7f0aac14b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35758/0 (socket says 172.21.15.55:35758) 2023-07-06T21:43:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aab7fe640 1 -- 172.21.15.55:0/2333604728 learned_addr learned my addr 172.21.15.55:0/2333604728 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aa3fff640 1 --2- 172.21.15.55:0/2333604728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aac0ce340 0x7f0aac0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aaaffd640 1 --2- 172.21.15.55:0/2333604728 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aac0b3d10 0x7f0aac0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aab7fe640 1 -- 172.21.15.55:0/2333604728 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aac0b3d10 msgr2=0x7f0aac0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aab7fe640 1 --2- 172.21.15.55:0/2333604728 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aac0b3d10 0x7f0aac0b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aab7fe640 1 -- 172.21.15.55:0/2333604728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aac0ce340 msgr2=0x7f0aac0b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aab7fe640 1 --2- 172.21.15.55:0/2333604728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aac0ce340 0x7f0aac0b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aab7fe640 1 -- 172.21.15.55:0/2333604728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a940094d0 con 0x7f0aac15b9d0 2023-07-06T21:43:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aab7fe640 1 --2- 172.21.15.55:0/2333604728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aac15b9d0 0x7f0aac14b060 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4007d20 tx=0x7f0aa400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:03.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aa37fe640 1 -- 172.21.15.55:0/2333604728 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4014420 con 0x7f0aac15b9d0 2023-07-06T21:43:03.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aa37fe640 1 -- 172.21.15.55:0/2333604728 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa40145a0 con 0x7f0aac15b9d0 2023-07-06T21:43:03.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aa37fe640 1 -- 172.21.15.55:0/2333604728 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4014950 con 0x7f0aac15b9d0 2023-07-06T21:43:03.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0ab15fa640 1 -- 172.21.15.55:0/2333604728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aac0b6c50 con 0x7f0aac15b9d0 2023-07-06T21:43:03.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0ab15fa640 1 -- 172.21.15.55:0/2333604728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aac14eb80 con 0x7f0aac15b9d0 2023-07-06T21:43:03.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0ab15fa640 1 -- 172.21.15.55:0/2333604728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aac14f080 con 0x7f0aac15b9d0 2023-07-06T21:43:03.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.954+0000 7f0aa37fe640 1 -- 172.21.15.55:0/2333604728 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0aa4014ab0 con 0x7f0aac15b9d0 2023-07-06T21:43:03.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.958+0000 7f0aa37fe640 1 --2- 172.21.15.55:0/2333604728 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a8c066280 0x7f0a8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:03.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.958+0000 7f0aa37fe640 1 -- 172.21.15.55:0/2333604728 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0aa4084850 con 0x7f0aac15b9d0 2023-07-06T21:43:03.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.958+0000 7f0aaaffd640 1 --2- 172.21.15.55:0/2333604728 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a8c066280 0x7f0a8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:03.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.958+0000 7f0aaaffd640 1 --2- 172.21.15.55:0/2333604728 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a8c066280 0x7f0a8c068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c007a60 tx=0x7f0a9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:03.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:03.962+0000 7f0aa37fe640 1 -- 172.21.15.55:0/2333604728 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0aa40519b0 con 0x7f0aac15b9d0 2023-07-06T21:43:04.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.118+0000 7f0ab15fa640 1 -- 172.21.15.55:0/2333604728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0aac066d60 con 0x7f0aac15b9d0 2023-07-06T21:43:04.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.122+0000 7f0aa37fe640 1 -- 172.21.15.55:0/2333604728 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f0aa4054fd0 con 0x7f0aac15b9d0 2023-07-06T21:43:04.128 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:04.128 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":29,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:51.480379+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:43:04.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.122+0000 7f0ab15fa640 1 -- 172.21.15.55:0/2333604728 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a8c066280 msgr2=0x7f0a8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:04.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.122+0000 7f0ab15fa640 1 --2- 172.21.15.55:0/2333604728 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a8c066280 0x7f0a8c068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c007a60 tx=0x7f0a9c008040 comp rx=0 tx=0).stop 2023-07-06T21:43:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.122+0000 7f0ab15fa640 1 -- 172.21.15.55:0/2333604728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aac15b9d0 msgr2=0x7f0aac14b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.122+0000 7f0ab15fa640 1 --2- 172.21.15.55:0/2333604728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aac15b9d0 0x7f0aac14b060 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4007d20 tx=0x7f0aa400e4b0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.122+0000 7f0ab15fa640 1 -- 172.21.15.55:0/2333604728 shutdown_connections 2023-07-06T21:43:04.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.122+0000 7f0ab15fa640 1 --2- 172.21.15.55:0/2333604728 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0a8c066280 0x7f0a8c068730 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.122+0000 7f0ab15fa640 1 --2- 172.21.15.55:0/2333604728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aac15b9d0 0x7f0aac14b060 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.122+0000 7f0ab15fa640 1 --2- 172.21.15.55:0/2333604728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aac0ce340 0x7f0aac0b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.122+0000 7f0ab15fa640 1 --2- 172.21.15.55:0/2333604728 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aac0b3d10 0x7f0aac0b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.122+0000 7f0ab15fa640 1 -- 172.21.15.55:0/2333604728 >> 172.21.15.55:0/2333604728 conn(0x7f0aac0ced10 msgr2=0x7f0aac15fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:04.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.122+0000 7f0ab15fa640 1 -- 172.21.15.55:0/2333604728 shutdown_connections 2023-07-06T21:43:04.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.122+0000 7f0ab15fa640 1 -- 172.21.15.55:0/2333604728 wait complete. 2023-07-06T21:43:04.150 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:42:08.597013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:42:09.843890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T21:42:12.918111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T21:43:04.151 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:43:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.290+0000 7f2392e93640 1 Processor -- start 2023-07-06T21:43:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.290+0000 7f2392e93640 1 -- start start 2023-07-06T21:43:04.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.290+0000 7f2392e93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238c158e70 0x7f238c159240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:04.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.290+0000 7f2392e93640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f238c159780 0x7f238c06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:04.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.290+0000 7f2392e93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238c15d0c0 con 0x7f238c070530 2023-07-06T21:43:04.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.290+0000 7f2392e93640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238c0709b0 con 0x7f238c159780 2023-07-06T21:43:04.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.290+0000 7f2392e93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c159bf0 con 0x7f238c158e70 2023-07-06T21:43:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.290+0000 7f2391430640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f238c070530 0x7f238c0ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52692/0 (socket says 172.21.15.55:52692) 2023-07-06T21:43:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.290+0000 7f2391430640 1 -- 172.21.15.55:0/3313023622 learned_addr learned my addr 172.21.15.55:0/3313023622 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.290+0000 7f2390c2f640 1 --2- 172.21.15.55:0/3313023622 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238c158e70 0x7f238c159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.290+0000 7f238bfff640 1 --2- 172.21.15.55:0/3313023622 >> v2:172.21.15.138:3300/0 conn(0x7f238c159780 0x7f238c06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.294+0000 7f238b7fe640 1 -- 172.21.15.55:0/3313023622 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774293620 0 0) 0x7f238c15d0c0 con 0x7f238c070530 2023-07-06T21:43:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.294+0000 7f238b7fe640 1 -- 172.21.15.55:0/3313023622 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f237c005740 con 0x7f238c070530 2023-07-06T21:43:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.294+0000 7f2390c2f640 1 -- 172.21.15.55:0/3313023622 >> v2:172.21.15.138:3300/0 conn(0x7f238c159780 msgr2=0x7f238c06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.294+0000 7f2390c2f640 1 --2- 172.21.15.55:0/3313023622 >> v2:172.21.15.138:3300/0 conn(0x7f238c159780 0x7f238c06fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.294+0000 7f2390c2f640 1 -- 172.21.15.55:0/3313023622 >> v1:172.21.15.55:6789/0 conn(0x7f238c070530 legacy=0x7f238c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.294+0000 7f2390c2f640 1 -- 172.21.15.55:0/3313023622 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c0cb770 con 0x7f238c158e70 2023-07-06T21:43:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.294+0000 7f238bfff640 1 --2- 172.21.15.55:0/3313023622 >> v2:172.21.15.138:3300/0 conn(0x7f238c159780 0x7f238c06fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.294+0000 7f2390c2f640 1 --2- 172.21.15.55:0/3313023622 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238c158e70 0x7f238c159240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23800097c0 tx=0x7f238001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4be1e8360922160b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.294+0000 7f238b7fe640 1 -- 172.21.15.55:0/3313023622 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23800ab650 con 0x7f238c158e70 2023-07-06T21:43:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.294+0000 7f238b7fe640 1 -- 172.21.15.55:0/3313023622 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23800ab7b0 con 0x7f238c158e70 2023-07-06T21:43:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.294+0000 7f238b7fe640 1 -- 172.21.15.55:0/3313023622 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23800abb20 con 0x7f238c158e70 2023-07-06T21:43:04.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 -- 172.21.15.55:0/3313023622 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238c158e70 msgr2=0x7f238c159240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:04.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 --2- 172.21.15.55:0/3313023622 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238c158e70 0x7f238c159240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23800097c0 tx=0x7f238001c450 comp rx=0 tx=0).stop 2023-07-06T21:43:04.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 -- 172.21.15.55:0/3313023622 shutdown_connections 2023-07-06T21:43:04.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 --2- 172.21.15.55:0/3313023622 >> v2:172.21.15.138:3300/0 conn(0x7f238c159780 0x7f238c06fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 --2- 172.21.15.55:0/3313023622 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238c158e70 0x7f238c159240 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 -- 172.21.15.55:0/3313023622 >> 172.21.15.55:0/3313023622 conn(0x7f238c0cb970 msgr2=0x7f238c0cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:04.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 -- 172.21.15.55:0/3313023622 shutdown_connections 2023-07-06T21:43:04.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 -- 172.21.15.55:0/3313023622 wait complete. 2023-07-06T21:43:04.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 Processor -- start 2023-07-06T21:43:04.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 -- start start 2023-07-06T21:43:04.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f238c070530 0x7f238c0b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:04.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f238c158e70 0x7f238c0c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:04.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238c159780 0x7f238c148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:04.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c150fe0 con 0x7f238c158e70 2023-07-06T21:43:04.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c147d70 con 0x7f238c070530 2023-07-06T21:43:04.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2392e93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c1496b0 con 0x7f238c159780 2023-07-06T21:43:04.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f238bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f238c158e70 0x7f238c0c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:04.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f238bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f238c158e70 0x7f238c0c67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35772/0 (socket says 172.21.15.55:35772) 2023-07-06T21:43:04.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f238bfff640 1 -- 172.21.15.55:0/4243206649 learned_addr learned my addr 172.21.15.55:0/4243206649 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:04.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.298+0000 7f2390c2f640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f238c070530 0x7f238c0b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:04.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f2391430640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238c159780 0x7f238c148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:04.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f238bfff640 1 -- 172.21.15.55:0/4243206649 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238c159780 msgr2=0x7f238c148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:04.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f238bfff640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238c159780 0x7f238c148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f238bfff640 1 -- 172.21.15.55:0/4243206649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f238c070530 msgr2=0x7f238c0b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f238bfff640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f238c070530 0x7f238c0b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f238bfff640 1 -- 172.21.15.55:0/4243206649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2378009420 con 0x7f238c158e70 2023-07-06T21:43:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f2390c2f640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f238c070530 0x7f238c0b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f238bfff640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f238c158e70 0x7f238c0c67d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f237800ebe0 tx=0x7f237800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f23897fa640 1 -- 172.21.15.55:0/4243206649 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237800eee0 con 0x7f238c158e70 2023-07-06T21:43:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f23897fa640 1 -- 172.21.15.55:0/4243206649 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237800cc30 con 0x7f238c158e70 2023-07-06T21:43:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f2392e93640 1 -- 172.21.15.55:0/4243206649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2380009420 con 0x7f238c158e70 2023-07-06T21:43:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f23897fa640 1 -- 172.21.15.55:0/4243206649 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378013470 con 0x7f238c158e70 2023-07-06T21:43:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f2392e93640 1 -- 172.21.15.55:0/4243206649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c150990 con 0x7f238c158e70 2023-07-06T21:43:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f2392e93640 1 -- 172.21.15.55:0/4243206649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c151190 con 0x7f238c158e70 2023-07-06T21:43:04.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f23897fa640 1 -- 172.21.15.55:0/4243206649 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f23780135d0 con 0x7f238c158e70 2023-07-06T21:43:04.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f23897fa640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f23700662b0 0x7f2370068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:04.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f23897fa640 1 -- 172.21.15.55:0/4243206649 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f23780843c0 con 0x7f238c158e70 2023-07-06T21:43:04.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.302+0000 7f2390c2f640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f23700662b0 0x7f2370068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:04.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.306+0000 7f2390c2f640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f23700662b0 0x7f2370068760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f23800af000 tx=0x7f23800a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:04.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.306+0000 7f23897fa640 1 -- 172.21.15.55:0/4243206649 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f238c151190 con 0x7f238c158e70 2023-07-06T21:43:04.407 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:43:04.410 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:43:04.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.466+0000 7f2392e93640 1 -- 172.21.15.55:0/4243206649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f238c066d60 con 0x7f238c158e70 2023-07-06T21:43:04.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.466+0000 7f23897fa640 1 -- 172.21.15.55:0/4243206649 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2378054f00 con 0x7f238c158e70 2023-07-06T21:43:04.472 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:43:04.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.466+0000 7f2392e93640 1 -- 172.21.15.55:0/4243206649 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f23700662b0 msgr2=0x7f2370068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:04.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.466+0000 7f2392e93640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f23700662b0 0x7f2370068760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f23800af000 tx=0x7f23800a7000 comp rx=0 tx=0).stop 2023-07-06T21:43:04.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.466+0000 7f2392e93640 1 -- 172.21.15.55:0/4243206649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f238c158e70 msgr2=0x7f238c0c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:04.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.466+0000 7f2392e93640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f238c158e70 0x7f238c0c67d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f237800ebe0 tx=0x7f237800c520 comp rx=0 tx=0).stop 2023-07-06T21:43:04.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.466+0000 7f2392e93640 1 -- 172.21.15.55:0/4243206649 shutdown_connections 2023-07-06T21:43:04.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.466+0000 7f2392e93640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f23700662b0 0x7f2370068760 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.466+0000 7f2392e93640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238c159780 0x7f238c148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.466+0000 7f2392e93640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f238c158e70 0x7f238c0c67d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.466+0000 7f2392e93640 1 --2- 172.21.15.55:0/4243206649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f238c070530 0x7f238c0b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.466+0000 7f2392e93640 1 -- 172.21.15.55:0/4243206649 >> 172.21.15.55:0/4243206649 conn(0x7f238c0cb970 msgr2=0x7f238c0b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:04.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.466+0000 7f2392e93640 1 -- 172.21.15.55:0/4243206649 shutdown_connections 2023-07-06T21:43:04.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.466+0000 7f2392e93640 1 -- 172.21.15.55:0/4243206649 wait complete. 2023-07-06T21:43:04.493 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:43:04.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b58f00640 1 Processor -- start 2023-07-06T21:43:04.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b58f00640 1 -- start start 2023-07-06T21:43:04.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b58f00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b54156180 0x7f8b540ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:04.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b58f00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8b540cbeb0 0x7f8b5406ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:04.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b58f00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5415f5d0 con 0x7f8b5406e9d0 2023-07-06T21:43:04.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b58f00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b54160250 con 0x7f8b54156180 2023-07-06T21:43:04.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b58f00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5406f390 con 0x7f8b540cbeb0 2023-07-06T21:43:04.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b5259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b54156180 0x7f8b540ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:04.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b5259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b54156180 0x7f8b540ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35778/0 (socket says 172.21.15.55:35778) 2023-07-06T21:43:04.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b5259c640 1 -- 172.21.15.55:0/3608096907 learned_addr learned my addr 172.21.15.55:0/3608096907 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:04.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b52d9d640 1 --2- 172.21.15.55:0/3608096907 >> v2:172.21.15.138:3300/0 conn(0x7f8b540cbeb0 0x7f8b5406ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:04.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b5259c640 1 -- 172.21.15.55:0/3608096907 >> v2:172.21.15.138:3300/0 conn(0x7f8b540cbeb0 msgr2=0x7f8b5406ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:04.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b5259c640 1 --2- 172.21.15.55:0/3608096907 >> v2:172.21.15.138:3300/0 conn(0x7f8b540cbeb0 0x7f8b5406ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b5259c640 1 -- 172.21.15.55:0/3608096907 >> v1:172.21.15.138:6789/0 conn(0x7f8b5406e9d0 legacy=0x7f8b540cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:04.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.678+0000 7f8b5259c640 1 -- 172.21.15.55:0/3608096907 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5415f8b0 con 0x7f8b54156180 2023-07-06T21:43:04.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.682+0000 7f8b5259c640 1 --2- 172.21.15.55:0/3608096907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b54156180 0x7f8b540ca610 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8b54071170 tx=0x7f8b4401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8062a21996beec server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:04.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.682+0000 7f8b51d9b640 1 -- 172.21.15.55:0/3608096907 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440ab600 con 0x7f8b54156180 2023-07-06T21:43:04.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.682+0000 7f8b51d9b640 1 -- 172.21.15.55:0/3608096907 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b440ab760 con 0x7f8b54156180 2023-07-06T21:43:04.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.682+0000 7f8b51d9b640 1 -- 172.21.15.55:0/3608096907 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440abaf0 con 0x7f8b54156180 2023-07-06T21:43:04.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.682+0000 7f8b58f00640 1 -- 172.21.15.55:0/3608096907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b54156180 msgr2=0x7f8b540ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:04.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.682+0000 7f8b58f00640 1 --2- 172.21.15.55:0/3608096907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b54156180 0x7f8b540ca610 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8b54071170 tx=0x7f8b4401c400 comp rx=0 tx=0).stop 2023-07-06T21:43:04.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.682+0000 7f8b58f00640 1 -- 172.21.15.55:0/3608096907 shutdown_connections 2023-07-06T21:43:04.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.682+0000 7f8b58f00640 1 --2- 172.21.15.55:0/3608096907 >> v2:172.21.15.138:3300/0 conn(0x7f8b540cbeb0 0x7f8b5406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.682+0000 7f8b58f00640 1 --2- 172.21.15.55:0/3608096907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b54156180 0x7f8b540ca610 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.682+0000 7f8b58f00640 1 -- 172.21.15.55:0/3608096907 >> 172.21.15.55:0/3608096907 conn(0x7f8b540d0c50 msgr2=0x7f8b540cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:04.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.682+0000 7f8b58f00640 1 -- 172.21.15.55:0/3608096907 shutdown_connections 2023-07-06T21:43:04.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.682+0000 7f8b58f00640 1 -- 172.21.15.55:0/3608096907 wait complete. 2023-07-06T21:43:04.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b58f00640 1 Processor -- start 2023-07-06T21:43:04.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b58f00640 1 -- start start 2023-07-06T21:43:04.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b58f00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b5406e9d0 0x7f8b5414e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:04.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b58f00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b540cbeb0 0x7f8b54157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:04.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b58f00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b54156180 0x7f8b54149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:04.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b58f00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b541583c0 con 0x7f8b5406e9d0 2023-07-06T21:43:04.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b58f00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b541586a0 con 0x7f8b540cbeb0 2023-07-06T21:43:04.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b58f00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b54158980 con 0x7f8b54156180 2023-07-06T21:43:04.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b5259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b5406e9d0 0x7f8b5414e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:04.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b5259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b5406e9d0 0x7f8b5414e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35786/0 (socket says 172.21.15.55:35786) 2023-07-06T21:43:04.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b5259c640 1 -- 172.21.15.55:0/2849095555 learned_addr learned my addr 172.21.15.55:0/2849095555 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:04.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b4bfff640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b540cbeb0 0x7f8b54157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:04.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b52d9d640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b54156180 0x7f8b54149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:04.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b5259c640 1 -- 172.21.15.55:0/2849095555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b54156180 msgr2=0x7f8b54149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:04.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b5259c640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b54156180 0x7f8b54149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b5259c640 1 -- 172.21.15.55:0/2849095555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b540cbeb0 msgr2=0x7f8b54157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:04.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b5259c640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b540cbeb0 0x7f8b54157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b5259c640 1 -- 172.21.15.55:0/2849095555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b440094d0 con 0x7f8b5406e9d0 2023-07-06T21:43:04.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b52d9d640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b54156180 0x7f8b54149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:04.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b5259c640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b5406e9d0 0x7f8b5414e750 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8b4401a030 tx=0x7f8b4401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:04.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b4affd640 1 -- 172.21.15.55:0/2849095555 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440b4800 con 0x7f8b5406e9d0 2023-07-06T21:43:04.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b4affd640 1 -- 172.21.15.55:0/2849095555 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b440b4980 con 0x7f8b5406e9d0 2023-07-06T21:43:04.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b4affd640 1 -- 172.21.15.55:0/2849095555 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440b4d30 con 0x7f8b5406e9d0 2023-07-06T21:43:04.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b58f00640 1 -- 172.21.15.55:0/2849095555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b54158c60 con 0x7f8b5406e9d0 2023-07-06T21:43:04.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.686+0000 7f8b58f00640 1 -- 172.21.15.55:0/2849095555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5414ec90 con 0x7f8b5406e9d0 2023-07-06T21:43:04.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.690+0000 7f8b58f00640 1 -- 172.21.15.55:0/2849095555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5414ee80 con 0x7f8b5406e9d0 2023-07-06T21:43:04.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.690+0000 7f8b4affd640 1 -- 172.21.15.55:0/2849095555 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8b440b3380 con 0x7f8b5406e9d0 2023-07-06T21:43:04.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.690+0000 7f8b4affd640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8b34066280 0x7f8b34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:04.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.690+0000 7f8b4affd640 1 -- 172.21.15.55:0/2849095555 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8b4411e600 con 0x7f8b5406e9d0 2023-07-06T21:43:04.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.690+0000 7f8b4bfff640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8b34066280 0x7f8b34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:04.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.690+0000 7f8b4bfff640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8b34066280 0x7f8b34068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8b5414aee0 tx=0x7f8b3c007e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:04.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.694+0000 7f8b4affd640 1 -- 172.21.15.55:0/2849095555 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8b5414ee80 con 0x7f8b5406e9d0 2023-07-06T21:43:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.850+0000 7f8b58f00640 1 -- 172.21.15.55:0/2849095555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8b5414ee80 con 0x7f8b5406e9d0 2023-07-06T21:43:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.850+0000 7f8b4affd640 1 -- 172.21.15.55:0/2849095555 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8b5414ee80 con 0x7f8b5406e9d0 2023-07-06T21:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:43:04.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.850+0000 7f8b58f00640 1 -- 172.21.15.55:0/2849095555 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8b34066280 msgr2=0x7f8b34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:04.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.850+0000 7f8b58f00640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8b34066280 0x7f8b34068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8b5414aee0 tx=0x7f8b3c007e40 comp rx=0 tx=0).stop 2023-07-06T21:43:04.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.850+0000 7f8b58f00640 1 -- 172.21.15.55:0/2849095555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b5406e9d0 msgr2=0x7f8b5414e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:04.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.850+0000 7f8b58f00640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b5406e9d0 0x7f8b5414e750 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8b4401a030 tx=0x7f8b4401ac40 comp rx=0 tx=0).stop 2023-07-06T21:43:04.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.850+0000 7f8b58f00640 1 -- 172.21.15.55:0/2849095555 shutdown_connections 2023-07-06T21:43:04.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.850+0000 7f8b58f00640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8b34066280 0x7f8b34068730 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.850+0000 7f8b58f00640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b54156180 0x7f8b54149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.850+0000 7f8b58f00640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b540cbeb0 0x7f8b54157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.850+0000 7f8b58f00640 1 --2- 172.21.15.55:0/2849095555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b5406e9d0 0x7f8b5414e750 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:04.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.850+0000 7f8b58f00640 1 -- 172.21.15.55:0/2849095555 >> 172.21.15.55:0/2849095555 conn(0x7f8b540d0c50 msgr2=0x7f8b540cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:04.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.850+0000 7f8b58f00640 1 -- 172.21.15.55:0/2849095555 shutdown_connections 2023-07-06T21:43:04.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:04.850+0000 7f8b58f00640 1 -- 172.21.15.55:0/2849095555 wait complete. 2023-07-06T21:43:04.877 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:43:05.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.014+0000 7f84417fa640 1 Processor -- start 2023-07-06T21:43:05.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.014+0000 7f84417fa640 1 -- start start 2023-07-06T21:43:05.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f84417fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f843c15bac0 0x7f843c0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f84417fa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f843c070970 0x7f843c0c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f84417fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f843c06b370 0x7f843c06b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f84417fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c15be90 con 0x7f843c06b370 2023-07-06T21:43:05.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f84417fa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c06f910 con 0x7f843c070970 2023-07-06T21:43:05.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f84417fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c06fb60 con 0x7f843c15bac0 2023-07-06T21:43:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f8440ff9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f843c06b370 0x7f843c06b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f8440ff9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f843c06b370 0x7f843c06b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35792/0 (socket says 172.21.15.55:35792) 2023-07-06T21:43:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f8440ff9640 1 -- 172.21.15.55:0/4191526012 learned_addr learned my addr 172.21.15.55:0/4191526012 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:05.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f843b7fe640 1 --2- 172.21.15.55:0/4191526012 >> v2:172.21.15.138:3300/0 conn(0x7f843c070970 0x7f843c0c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f843bfff640 1 --2- 172.21.15.55:0/4191526012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f843c15bac0 0x7f843c0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f8440ff9640 1 -- 172.21.15.55:0/4191526012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f843c15bac0 msgr2=0x7f843c0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:05.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f8440ff9640 1 --2- 172.21.15.55:0/4191526012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f843c15bac0 0x7f843c0c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f8440ff9640 1 -- 172.21.15.55:0/4191526012 >> v2:172.21.15.138:3300/0 conn(0x7f843c070970 msgr2=0x7f843c0c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:05.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f8440ff9640 1 --2- 172.21.15.55:0/4191526012 >> v2:172.21.15.138:3300/0 conn(0x7f843c070970 0x7f843c0c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.018+0000 7f8440ff9640 1 -- 172.21.15.55:0/4191526012 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c06fe40 con 0x7f843c06b370 2023-07-06T21:43:05.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f8440ff9640 1 --2- 172.21.15.55:0/4191526012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c06b370 0x7f843c06b7d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f843c06ae10 tx=0x7f843401eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ebd7f487afd56b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:05.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f843affd640 1 -- 172.21.15.55:0/4191526012 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843400b2d0 con 0x7f843c06b370 2023-07-06T21:43:05.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f843affd640 1 -- 172.21.15.55:0/4191526012 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843400b430 con 0x7f843c06b370 2023-07-06T21:43:05.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f843affd640 1 -- 172.21.15.55:0/4191526012 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84340a7960 con 0x7f843c06b370 2023-07-06T21:43:05.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f84417fa640 1 -- 172.21.15.55:0/4191526012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c06b370 msgr2=0x7f843c06b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f84417fa640 1 --2- 172.21.15.55:0/4191526012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c06b370 0x7f843c06b7d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f843c06ae10 tx=0x7f843401eab0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f84417fa640 1 -- 172.21.15.55:0/4191526012 shutdown_connections 2023-07-06T21:43:05.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f84417fa640 1 --2- 172.21.15.55:0/4191526012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c06b370 0x7f843c06b7d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f84417fa640 1 --2- 172.21.15.55:0/4191526012 >> v2:172.21.15.138:3300/0 conn(0x7f843c070970 0x7f843c0c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f84417fa640 1 --2- 172.21.15.55:0/4191526012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f843c15bac0 0x7f843c0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f84417fa640 1 -- 172.21.15.55:0/4191526012 >> 172.21.15.55:0/4191526012 conn(0x7f843c0b0410 msgr2=0x7f843c0cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:05.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f84417fa640 1 -- 172.21.15.55:0/4191526012 shutdown_connections 2023-07-06T21:43:05.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f84417fa640 1 -- 172.21.15.55:0/4191526012 wait complete. 2023-07-06T21:43:05.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f84417fa640 1 Processor -- start 2023-07-06T21:43:05.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.022+0000 7f84417fa640 1 -- start start 2023-07-06T21:43:05.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f84417fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f843c06b370 0x7f843c144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f84417fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c070970 0x7f843c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f84417fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f843c15bac0 0x7f843c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f84417fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c14c800 con 0x7f843c070970 2023-07-06T21:43:05.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f84417fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c145390 con 0x7f843c15bac0 2023-07-06T21:43:05.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f84417fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0b2bd0 con 0x7f843c06b370 2023-07-06T21:43:05.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f843b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c070970 0x7f843c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f843b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c070970 0x7f843c0b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35802/0 (socket says 172.21.15.55:35802) 2023-07-06T21:43:05.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f843b7fe640 1 -- 172.21.15.55:0/2912385416 learned_addr learned my addr 172.21.15.55:0/2912385416 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:05.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f843bfff640 1 --2- 172.21.15.55:0/2912385416 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f843c06b370 0x7f843c144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f8440ff9640 1 --2- 172.21.15.55:0/2912385416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f843c15bac0 0x7f843c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f843b7fe640 1 -- 172.21.15.55:0/2912385416 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f843c06b370 msgr2=0x7f843c144400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f843b7fe640 1 --2- 172.21.15.55:0/2912385416 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f843c06b370 0x7f843c144400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f843b7fe640 1 -- 172.21.15.55:0/2912385416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f843c15bac0 msgr2=0x7f843c0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f843b7fe640 1 --2- 172.21.15.55:0/2912385416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f843c15bac0 0x7f843c0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f843b7fe640 1 -- 172.21.15.55:0/2912385416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843400bd40 con 0x7f843c070970 2023-07-06T21:43:05.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f843b7fe640 1 --2- 172.21.15.55:0/2912385416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c070970 0x7f843c0b2060 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f843000d800 tx=0x7f843000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:05.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f8438ff9640 1 -- 172.21.15.55:0/2912385416 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300096a0 con 0x7f843c070970 2023-07-06T21:43:05.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f8438ff9640 1 -- 172.21.15.55:0/2912385416 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8430009800 con 0x7f843c070970 2023-07-06T21:43:05.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f8438ff9640 1 -- 172.21.15.55:0/2912385416 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430009b70 con 0x7f843c070970 2023-07-06T21:43:05.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f84417fa640 1 -- 172.21.15.55:0/2912385416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843c14ca50 con 0x7f843c070970 2023-07-06T21:43:05.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f84417fa640 1 -- 172.21.15.55:0/2912385416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843c14d010 con 0x7f843c070970 2023-07-06T21:43:05.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f84417fa640 1 -- 172.21.15.55:0/2912385416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843c04d790 con 0x7f843c070970 2023-07-06T21:43:05.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.026+0000 7f8438ff9640 1 -- 172.21.15.55:0/2912385416 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8430009cd0 con 0x7f843c070970 2023-07-06T21:43:05.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.030+0000 7f8438ff9640 1 --2- 172.21.15.55:0/2912385416 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8428066280 0x7f8428068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.030+0000 7f8438ff9640 1 -- 172.21.15.55:0/2912385416 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f84300846e0 con 0x7f843c070970 2023-07-06T21:43:05.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.030+0000 7f843bfff640 1 --2- 172.21.15.55:0/2912385416 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8428066280 0x7f8428068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.030+0000 7f843bfff640 1 --2- 172.21.15.55:0/2912385416 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8428066280 0x7f8428068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f843c0c47d0 tx=0x7f842c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:05.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.034+0000 7f8438ff9640 1 -- 172.21.15.55:0/2912385416 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84300518d0 con 0x7f843c070970 2023-07-06T21:43:05.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.186+0000 7f84417fa640 1 -- 172.21.15.55:0/2912385416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f843c144940 con 0x7f843c070970 2023-07-06T21:43:05.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.186+0000 7f8438ff9640 1 -- 172.21.15.55:0/2912385416 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8430054ef0 con 0x7f843c070970 2023-07-06T21:43:05.194 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:43:05.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.186+0000 7f84417fa640 1 -- 172.21.15.55:0/2912385416 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8428066280 msgr2=0x7f8428068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.186+0000 7f84417fa640 1 --2- 172.21.15.55:0/2912385416 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8428066280 0x7f8428068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f843c0c47d0 tx=0x7f842c008040 comp rx=0 tx=0).stop 2023-07-06T21:43:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.186+0000 7f84417fa640 1 -- 172.21.15.55:0/2912385416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c070970 msgr2=0x7f843c0b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.186+0000 7f84417fa640 1 --2- 172.21.15.55:0/2912385416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c070970 0x7f843c0b2060 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f843000d800 tx=0x7f843000dcc0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.190+0000 7f84417fa640 1 -- 172.21.15.55:0/2912385416 shutdown_connections 2023-07-06T21:43:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.190+0000 7f84417fa640 1 --2- 172.21.15.55:0/2912385416 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f8428066280 0x7f8428068730 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.190+0000 7f84417fa640 1 --2- 172.21.15.55:0/2912385416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f843c15bac0 0x7f843c0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.190+0000 7f84417fa640 1 --2- 172.21.15.55:0/2912385416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c070970 0x7f843c0b2060 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.190+0000 7f84417fa640 1 --2- 172.21.15.55:0/2912385416 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f843c06b370 0x7f843c144400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.190+0000 7f84417fa640 1 -- 172.21.15.55:0/2912385416 >> 172.21.15.55:0/2912385416 conn(0x7f843c0b0410 msgr2=0x7f843c0cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.190+0000 7f84417fa640 1 -- 172.21.15.55:0/2912385416 shutdown_connections 2023-07-06T21:43:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.190+0000 7f84417fa640 1 -- 172.21.15.55:0/2912385416 wait complete. 2023-07-06T21:43:05.214 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:43:05.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a85019640 1 Processor -- start 2023-07-06T21:43:05.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a85019640 1 -- start start 2023-07-06T21:43:05.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a85019640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9a80158850 0x7f9a800cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a85019640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a800ca130 0x7f9a800ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a85019640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a800b2aa0 con 0x7f9a800703e0 2023-07-06T21:43:05.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a85019640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a80158c20 con 0x7f9a80158850 2023-07-06T21:43:05.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a85019640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a800c8db0 con 0x7f9a800ca130 2023-07-06T21:43:05.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a7ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9a80158850 0x7f9a800cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a7ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9a80158850 0x7f9a800cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35808/0 (socket says 172.21.15.55:35808) 2023-07-06T21:43:05.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a7ed9d640 1 -- 172.21.15.55:0/1932119084 learned_addr learned my addr 172.21.15.55:0/1932119084 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:05.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a77fff640 1 --2- 172.21.15.55:0/1932119084 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a800ca130 0x7f9a800ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a7ed9d640 1 -- 172.21.15.55:0/1932119084 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a800ca130 msgr2=0x7f9a800ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:05.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a7ed9d640 1 --2- 172.21.15.55:0/1932119084 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a800ca130 0x7f9a800ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a7ed9d640 1 -- 172.21.15.55:0/1932119084 >> v1:172.21.15.138:6789/0 conn(0x7f9a800703e0 legacy=0x7f9a8006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.354+0000 7f9a7ed9d640 1 -- 172.21.15.55:0/1932119084 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800c9090 con 0x7f9a80158850 2023-07-06T21:43:05.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.358+0000 7f9a7ed9d640 1 --2- 172.21.15.55:0/1932119084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a80158850 0x7f9a800cca30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9a70009870 tx=0x7f9a7001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9e5b0bcc5fb39 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:05.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.358+0000 7f9a7e59c640 1 -- 172.21.15.55:0/1932119084 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a700a8a30 con 0x7f9a80158850 2023-07-06T21:43:05.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.358+0000 7f9a7e59c640 1 -- 172.21.15.55:0/1932119084 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a700a8b90 con 0x7f9a80158850 2023-07-06T21:43:05.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.358+0000 7f9a7e59c640 1 -- 172.21.15.55:0/1932119084 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a700b0440 con 0x7f9a80158850 2023-07-06T21:43:05.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.358+0000 7f9a85019640 1 -- 172.21.15.55:0/1932119084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a80158850 msgr2=0x7f9a800cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.358+0000 7f9a85019640 1 --2- 172.21.15.55:0/1932119084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a80158850 0x7f9a800cca30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9a70009870 tx=0x7f9a7001ed30 comp rx=0 tx=0).stop 2023-07-06T21:43:05.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.358+0000 7f9a85019640 1 -- 172.21.15.55:0/1932119084 shutdown_connections 2023-07-06T21:43:05.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.358+0000 7f9a85019640 1 --2- 172.21.15.55:0/1932119084 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a800ca130 0x7f9a800ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.358+0000 7f9a85019640 1 --2- 172.21.15.55:0/1932119084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a80158850 0x7f9a800cca30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.358+0000 7f9a85019640 1 -- 172.21.15.55:0/1932119084 >> 172.21.15.55:0/1932119084 conn(0x7f9a800cea70 msgr2=0x7f9a800ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:05.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.358+0000 7f9a85019640 1 -- 172.21.15.55:0/1932119084 shutdown_connections 2023-07-06T21:43:05.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.358+0000 7f9a85019640 1 -- 172.21.15.55:0/1932119084 wait complete. 2023-07-06T21:43:05.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a85019640 1 Processor -- start 2023-07-06T21:43:05.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a85019640 1 -- start start 2023-07-06T21:43:05.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a85019640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a800703e0 0x7f9a801f3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a85019640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a800ca130 0x7f9a800989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a85019640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a80158850 0x7f9a801f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a85019640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a80154590 con 0x7f9a80158850 2023-07-06T21:43:05.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a85019640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a80156730 con 0x7f9a800ca130 2023-07-06T21:43:05.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a85019640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a80156a10 con 0x7f9a800703e0 2023-07-06T21:43:05.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a7f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a80158850 0x7f9a801f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a7f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a80158850 0x7f9a801f2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35816/0 (socket says 172.21.15.55:35816) 2023-07-06T21:43:05.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a7f59e640 1 -- 172.21.15.55:0/3689755956 learned_addr learned my addr 172.21.15.55:0/3689755956 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:05.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a77fff640 1 --2- 172.21.15.55:0/3689755956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a800ca130 0x7f9a800989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a7ed9d640 1 --2- 172.21.15.55:0/3689755956 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a800703e0 0x7f9a801f3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a7f59e640 1 -- 172.21.15.55:0/3689755956 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a800703e0 msgr2=0x7f9a801f3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a7f59e640 1 --2- 172.21.15.55:0/3689755956 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a800703e0 0x7f9a801f3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a7f59e640 1 -- 172.21.15.55:0/3689755956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a800ca130 msgr2=0x7f9a800989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a7f59e640 1 --2- 172.21.15.55:0/3689755956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a800ca130 0x7f9a800989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a7f59e640 1 -- 172.21.15.55:0/3689755956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a700094d0 con 0x7f9a80158850 2023-07-06T21:43:05.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a7f59e640 1 --2- 172.21.15.55:0/3689755956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a80158850 0x7f9a801f2b00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800c770 tx=0x7f9a7800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:05.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a777fe640 1 -- 172.21.15.55:0/3689755956 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78003b80 con 0x7f9a80158850 2023-07-06T21:43:05.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a777fe640 1 -- 172.21.15.55:0/3689755956 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a78003ce0 con 0x7f9a80158850 2023-07-06T21:43:05.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a85019640 1 -- 172.21.15.55:0/3689755956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a80156cf0 con 0x7f9a80158850 2023-07-06T21:43:05.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a777fe640 1 -- 172.21.15.55:0/3689755956 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7800aa90 con 0x7f9a80158850 2023-07-06T21:43:05.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a85019640 1 -- 172.21.15.55:0/3689755956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a801541b0 con 0x7f9a80158850 2023-07-06T21:43:05.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.362+0000 7f9a85019640 1 -- 172.21.15.55:0/3689755956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a801546d0 con 0x7f9a80158850 2023-07-06T21:43:05.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.366+0000 7f9a777fe640 1 -- 172.21.15.55:0/3689755956 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a7800abf0 con 0x7f9a80158850 2023-07-06T21:43:05.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.366+0000 7f9a777fe640 1 --2- 172.21.15.55:0/3689755956 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9a60066280 0x7f9a60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.366+0000 7f9a777fe640 1 -- 172.21.15.55:0/3689755956 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9a78083e20 con 0x7f9a80158850 2023-07-06T21:43:05.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.366+0000 7f9a7ed9d640 1 --2- 172.21.15.55:0/3689755956 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9a60066280 0x7f9a60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.366+0000 7f9a7ed9d640 1 --2- 172.21.15.55:0/3689755956 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9a60066280 0x7f9a60068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9a700b2000 tx=0x7f9a700aa070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.370+0000 7f9a777fe640 1 -- 172.21.15.55:0/3689755956 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a801546d0 con 0x7f9a80158850 2023-07-06T21:43:05.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.522+0000 7f9a85019640 1 -- 172.21.15.55:0/3689755956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a801546d0 con 0x7f9a80158850 2023-07-06T21:43:05.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.522+0000 7f9a777fe640 1 -- 172.21.15.55:0/3689755956 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a801546d0 con 0x7f9a80158850 2023-07-06T21:43:05.531 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:43:05.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.526+0000 7f9a85019640 1 -- 172.21.15.55:0/3689755956 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9a60066280 msgr2=0x7f9a60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.526+0000 7f9a85019640 1 --2- 172.21.15.55:0/3689755956 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9a60066280 0x7f9a60068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9a700b2000 tx=0x7f9a700aa070 comp rx=0 tx=0).stop 2023-07-06T21:43:05.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.526+0000 7f9a85019640 1 -- 172.21.15.55:0/3689755956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a80158850 msgr2=0x7f9a801f2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.526+0000 7f9a85019640 1 --2- 172.21.15.55:0/3689755956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a80158850 0x7f9a801f2b00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800c770 tx=0x7f9a7800cc30 comp rx=0 tx=0).stop 2023-07-06T21:43:05.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.526+0000 7f9a85019640 1 -- 172.21.15.55:0/3689755956 shutdown_connections 2023-07-06T21:43:05.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.526+0000 7f9a85019640 1 --2- 172.21.15.55:0/3689755956 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9a60066280 0x7f9a60068730 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.526+0000 7f9a85019640 1 --2- 172.21.15.55:0/3689755956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a80158850 0x7f9a801f2b00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.526+0000 7f9a85019640 1 --2- 172.21.15.55:0/3689755956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a800ca130 0x7f9a800989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.526+0000 7f9a85019640 1 --2- 172.21.15.55:0/3689755956 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a800703e0 0x7f9a801f3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.526+0000 7f9a85019640 1 -- 172.21.15.55:0/3689755956 >> 172.21.15.55:0/3689755956 conn(0x7f9a800cea70 msgr2=0x7f9a800afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:05.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.526+0000 7f9a85019640 1 -- 172.21.15.55:0/3689755956 shutdown_connections 2023-07-06T21:43:05.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.526+0000 7f9a85019640 1 -- 172.21.15.55:0/3689755956 wait complete. 2023-07-06T21:43:05.552 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T21:43:05.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.694+0000 7f1a20b05640 1 Processor -- start 2023-07-06T21:43:05.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.694+0000 7f1a20b05640 1 -- start start 2023-07-06T21:43:05.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a20b05640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1a1c0b1250 0x7f1a1c15f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a20b05640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1c0d0630 0x7f1a1c15f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a20b05640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1c0cc740 con 0x7f1a1c15fe00 2023-07-06T21:43:05.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a20b05640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1c0ccc90 con 0x7f1a1c0b1250 2023-07-06T21:43:05.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a20b05640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0d1d10 con 0x7f1a1c0d0630 2023-07-06T21:43:05.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a1b7fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1a1c0b1250 0x7f1a1c15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a1affd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1c0d0630 0x7f1a1c15f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a1bfff640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f1a1c15fe00 0x7f1a1c0b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:35540/0 (socket says 172.21.15.55:35540) 2023-07-06T21:43:05.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a1b7fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1a1c0b1250 0x7f1a1c15f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:45684/0 (socket says 172.21.15.55:45684) 2023-07-06T21:43:05.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a1bfff640 1 -- 172.21.15.55:0/2476057235 learned_addr learned my addr 172.21.15.55:0/2476057235 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:05.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a1affd640 1 -- 172.21.15.55:0/2476057235 >> v2:172.21.15.138:3300/0 conn(0x7f1a1c0b1250 msgr2=0x7f1a1c15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:05.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a1affd640 1 --2- 172.21.15.55:0/2476057235 >> v2:172.21.15.138:3300/0 conn(0x7f1a1c0b1250 0x7f1a1c15f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a1affd640 1 -- 172.21.15.55:0/2476057235 >> v1:172.21.15.138:6789/0 conn(0x7f1a1c15fe00 legacy=0x7f1a1c0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a1affd640 1 -- 172.21.15.55:0/2476057235 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c0cc9b0 con 0x7f1a1c0d0630 2023-07-06T21:43:05.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.698+0000 7f1a1a7fc640 1 -- 172.21.15.55:0/2476057235 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79666991 0 0) 0x7f1a1c0cc740 con 0x7f1a1c15fe00 2023-07-06T21:43:05.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a1affd640 1 --2- 172.21.15.55:0/2476057235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1c0d0630 0x7f1a1c15f8c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1a100097c0 tx=0x7f1a1001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9854c31f688fba7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:05.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a1a7fc640 1 -- 172.21.15.55:0/2476057235 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100ab600 con 0x7f1a1c0d0630 2023-07-06T21:43:05.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a1a7fc640 1 -- 172.21.15.55:0/2476057235 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a100a7050 con 0x7f1a1c0d0630 2023-07-06T21:43:05.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a1a7fc640 1 -- 172.21.15.55:0/2476057235 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100ab980 con 0x7f1a1c0d0630 2023-07-06T21:43:05.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 -- 172.21.15.55:0/2476057235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1c0d0630 msgr2=0x7f1a1c15f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 --2- 172.21.15.55:0/2476057235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1c0d0630 0x7f1a1c15f8c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1a100097c0 tx=0x7f1a1001c3f0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 -- 172.21.15.55:0/2476057235 shutdown_connections 2023-07-06T21:43:05.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 --2- 172.21.15.55:0/2476057235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1c0d0630 0x7f1a1c15f8c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 --2- 172.21.15.55:0/2476057235 >> v2:172.21.15.138:3300/0 conn(0x7f1a1c0b1250 0x7f1a1c15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 -- 172.21.15.55:0/2476057235 >> 172.21.15.55:0/2476057235 conn(0x7f1a1c0b3b60 msgr2=0x7f1a1c0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:05.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 -- 172.21.15.55:0/2476057235 shutdown_connections 2023-07-06T21:43:05.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 -- 172.21.15.55:0/2476057235 wait complete. 2023-07-06T21:43:05.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 Processor -- start 2023-07-06T21:43:05.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 -- start start 2023-07-06T21:43:05.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a1c0b1250 0x7f1a1c157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a1c0d0630 0x7f1a1c14c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1c15fe00 0x7f1a1c0b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c1557f0 con 0x7f1a1c0d0630 2023-07-06T21:43:05.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c157980 con 0x7f1a1c0b1250 2023-07-06T21:43:05.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.702+0000 7f1a20b05640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c155a40 con 0x7f1a1c15fe00 2023-07-06T21:43:05.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a1affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a1c0d0630 0x7f1a1c14c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a1affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a1c0d0630 0x7f1a1c14c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35826/0 (socket says 172.21.15.55:35826) 2023-07-06T21:43:05.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a1affd640 1 -- 172.21.15.55:0/1151654362 learned_addr learned my addr 172.21.15.55:0/1151654362 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:05.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a1b7fe640 1 --2- 172.21.15.55:0/1151654362 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a1c0b1250 0x7f1a1c157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a1bfff640 1 --2- 172.21.15.55:0/1151654362 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1c15fe00 0x7f1a1c0b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a1affd640 1 -- 172.21.15.55:0/1151654362 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1c15fe00 msgr2=0x7f1a1c0b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a1affd640 1 --2- 172.21.15.55:0/1151654362 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1c15fe00 0x7f1a1c0b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a1affd640 1 -- 172.21.15.55:0/1151654362 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a1c0b1250 msgr2=0x7f1a1c157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a1affd640 1 --2- 172.21.15.55:0/1151654362 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a1c0b1250 0x7f1a1c157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a1affd640 1 -- 172.21.15.55:0/1151654362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a10009420 con 0x7f1a1c0d0630 2023-07-06T21:43:05.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a1affd640 1 --2- 172.21.15.55:0/1151654362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a1c0d0630 0x7f1a1c14c580 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1a100097c0 tx=0x7f1a10019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:05.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a03fff640 1 -- 172.21.15.55:0/1151654362 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100b4430 con 0x7f1a1c0d0630 2023-07-06T21:43:05.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a03fff640 1 -- 172.21.15.55:0/1151654362 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a100b4590 con 0x7f1a1c0d0630 2023-07-06T21:43:05.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a03fff640 1 -- 172.21.15.55:0/1151654362 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100b4940 con 0x7f1a1c0d0630 2023-07-06T21:43:05.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a20b05640 1 -- 172.21.15.55:0/1151654362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1c155d20 con 0x7f1a1c0d0630 2023-07-06T21:43:05.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a20b05640 1 -- 172.21.15.55:0/1151654362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1c1562e0 con 0x7f1a1c0d0630 2023-07-06T21:43:05.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a20b05640 1 -- 172.21.15.55:0/1151654362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1c04d790 con 0x7f1a1c0d0630 2023-07-06T21:43:05.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.706+0000 7f1a03fff640 1 -- 172.21.15.55:0/1151654362 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a100b2040 con 0x7f1a1c0d0630 2023-07-06T21:43:05.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.710+0000 7f1a03fff640 1 --2- 172.21.15.55:0/1151654362 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1a08066280 0x7f1a08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:05.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.710+0000 7f1a03fff640 1 -- 172.21.15.55:0/1151654362 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1a1011dfd0 con 0x7f1a1c0d0630 2023-07-06T21:43:05.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.710+0000 7f1a1b7fe640 1 --2- 172.21.15.55:0/1151654362 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1a08066280 0x7f1a08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:05.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.710+0000 7f1a1b7fe640 1 --2- 172.21.15.55:0/1151654362 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1a08066280 0x7f1a08068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009ac0 tx=0x7f1a0c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:05.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.714+0000 7f1a03fff640 1 -- 172.21.15.55:0/1151654362 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a100eb110 con 0x7f1a1c0d0630 2023-07-06T21:43:05.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.866+0000 7f1a20b05640 1 -- 172.21.15.55:0/1151654362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1a1c0b3940 con 0x7f1a1c0d0630 2023-07-06T21:43:05.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.866+0000 7f1a03fff640 1 -- 172.21.15.55:0/1151654362 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1a100b0020 con 0x7f1a1c0d0630 2023-07-06T21:43:05.875 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:43:05.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.870+0000 7f1a20b05640 1 -- 172.21.15.55:0/1151654362 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1a08066280 msgr2=0x7f1a08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.870+0000 7f1a20b05640 1 --2- 172.21.15.55:0/1151654362 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1a08066280 0x7f1a08068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009ac0 tx=0x7f1a0c009190 comp rx=0 tx=0).stop 2023-07-06T21:43:05.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.870+0000 7f1a20b05640 1 -- 172.21.15.55:0/1151654362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a1c0d0630 msgr2=0x7f1a1c14c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:05.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.870+0000 7f1a20b05640 1 --2- 172.21.15.55:0/1151654362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a1c0d0630 0x7f1a1c14c580 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1a100097c0 tx=0x7f1a10019190 comp rx=0 tx=0).stop 2023-07-06T21:43:05.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.870+0000 7f1a20b05640 1 -- 172.21.15.55:0/1151654362 shutdown_connections 2023-07-06T21:43:05.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.870+0000 7f1a20b05640 1 --2- 172.21.15.55:0/1151654362 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1a08066280 0x7f1a08068730 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.870+0000 7f1a20b05640 1 --2- 172.21.15.55:0/1151654362 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a1c15fe00 0x7f1a1c0b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.870+0000 7f1a20b05640 1 --2- 172.21.15.55:0/1151654362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a1c0d0630 0x7f1a1c14c580 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.870+0000 7f1a20b05640 1 --2- 172.21.15.55:0/1151654362 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a1c0b1250 0x7f1a1c157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:05.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.870+0000 7f1a20b05640 1 -- 172.21.15.55:0/1151654362 >> 172.21.15.55:0/1151654362 conn(0x7f1a1c0b3b60 msgr2=0x7f1a1c0cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:05.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.870+0000 7f1a20b05640 1 -- 172.21.15.55:0/1151654362 shutdown_connections 2023-07-06T21:43:05.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:05.870+0000 7f1a20b05640 1 -- 172.21.15.55:0/1151654362 wait complete. 2023-07-06T21:43:05.896 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T21:43:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f6231640 1 Processor -- start 2023-07-06T21:43:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f6231640 1 -- start start 2023-07-06T21:43:06.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f6231640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f00b1250 0x7fb2f015f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f6231640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2f00ce200 0x7fb2f00ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f6231640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f00cc740 con 0x7fb2f00d0630 2023-07-06T21:43:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f6231640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f00ccc90 con 0x7fb2f00ce200 2023-07-06T21:43:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f6231640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00b29c0 con 0x7fb2f00b1250 2023-07-06T21:43:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f5a30640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2f00ce200 0x7fb2f00ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:06.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f5a30640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2f00ce200 0x7fb2f00ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35828/0 (socket says 172.21.15.55:35828) 2023-07-06T21:43:06.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f5a30640 1 -- 172.21.15.55:0/3975038581 learned_addr learned my addr 172.21.15.55:0/3975038581 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:06.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f522f640 1 --2- 172.21.15.55:0/3975038581 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f00b1250 0x7fb2f015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:06.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f5a30640 1 -- 172.21.15.55:0/3975038581 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f00b1250 msgr2=0x7fb2f015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:06.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f5a30640 1 --2- 172.21.15.55:0/3975038581 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f00b1250 0x7fb2f015f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f5a30640 1 -- 172.21.15.55:0/3975038581 >> v1:172.21.15.55:6789/0 conn(0x7fb2f00d0630 legacy=0x7fb2f015f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:06.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.034+0000 7fb2f5a30640 1 -- 172.21.15.55:0/3975038581 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f00d1d10 con 0x7fb2f00ce200 2023-07-06T21:43:06.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.038+0000 7fb2f5a30640 1 --2- 172.21.15.55:0/3975038581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2f00ce200 0x7fb2f00ce680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8009e50 tx=0x7fb2e801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ead3f86a5a1a8d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:06.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.038+0000 7fb2e7fff640 1 -- 172.21.15.55:0/3975038581 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80a5730 con 0x7fb2f00ce200 2023-07-06T21:43:06.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.038+0000 7fb2e7fff640 1 -- 172.21.15.55:0/3975038581 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e80a5890 con 0x7fb2f00ce200 2023-07-06T21:43:06.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.038+0000 7fb2e7fff640 1 -- 172.21.15.55:0/3975038581 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80a5c20 con 0x7fb2f00ce200 2023-07-06T21:43:06.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.038+0000 7fb2f6231640 1 -- 172.21.15.55:0/3975038581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2f00ce200 msgr2=0x7fb2f00ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:06.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.038+0000 7fb2f6231640 1 --2- 172.21.15.55:0/3975038581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2f00ce200 0x7fb2f00ce680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8009e50 tx=0x7fb2e801c980 comp rx=0 tx=0).stop 2023-07-06T21:43:06.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.038+0000 7fb2f6231640 1 -- 172.21.15.55:0/3975038581 shutdown_connections 2023-07-06T21:43:06.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.038+0000 7fb2f6231640 1 --2- 172.21.15.55:0/3975038581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2f00ce200 0x7fb2f00ce680 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.038+0000 7fb2f6231640 1 --2- 172.21.15.55:0/3975038581 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f00b1250 0x7fb2f015f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.038+0000 7fb2f6231640 1 -- 172.21.15.55:0/3975038581 >> 172.21.15.55:0/3975038581 conn(0x7fb2f00b3b60 msgr2=0x7fb2f00b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:06.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.038+0000 7fb2f6231640 1 -- 172.21.15.55:0/3975038581 shutdown_connections 2023-07-06T21:43:06.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.038+0000 7fb2f6231640 1 -- 172.21.15.55:0/3975038581 wait complete. 2023-07-06T21:43:06.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f6231640 1 Processor -- start 2023-07-06T21:43:06.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f6231640 1 -- start start 2023-07-06T21:43:06.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f6231640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f00b1250 0x7fb2f01515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:06.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f6231640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f00ce200 0x7fb2f00c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:06.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f6231640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2f00d0630 0x7fb2f014f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:06.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f6231640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f014fed0 con 0x7fb2f00d0630 2023-07-06T21:43:06.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f6231640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f015cf50 con 0x7fb2f00b1250 2023-07-06T21:43:06.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f6231640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f015d230 con 0x7fb2f00ce200 2023-07-06T21:43:06.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f5a30640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2f00d0630 0x7fb2f014f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:06.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f5a30640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2f00d0630 0x7fb2f014f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35830/0 (socket says 172.21.15.55:35830) 2023-07-06T21:43:06.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f5a30640 1 -- 172.21.15.55:0/3006719464 learned_addr learned my addr 172.21.15.55:0/3006719464 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:06.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f5a30640 1 -- 172.21.15.55:0/3006719464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f00ce200 msgr2=0x7fb2f00c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:06.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f5a30640 1 --2- 172.21.15.55:0/3006719464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f00ce200 0x7fb2f00c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f5a30640 1 -- 172.21.15.55:0/3006719464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f00b1250 msgr2=0x7fb2f01515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:06.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f5a30640 1 --2- 172.21.15.55:0/3006719464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f00b1250 0x7fb2f01515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f5a30640 1 -- 172.21.15.55:0/3006719464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e8009b30 con 0x7fb2f00d0630 2023-07-06T21:43:06.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f5a30640 1 --2- 172.21.15.55:0/3006719464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2f00d0630 0x7fb2f014f990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb2e801a5b0 tx=0x7fb2e8019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:06.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2e5ffb640 1 -- 172.21.15.55:0/3006719464 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80b8670 con 0x7fb2f00d0630 2023-07-06T21:43:06.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2e5ffb640 1 -- 172.21.15.55:0/3006719464 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e80b87d0 con 0x7fb2f00d0630 2023-07-06T21:43:06.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2e5ffb640 1 -- 172.21.15.55:0/3006719464 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80b8b60 con 0x7fb2f00d0630 2023-07-06T21:43:06.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f6231640 1 -- 172.21.15.55:0/3006719464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f0150ba0 con 0x7fb2f00d0630 2023-07-06T21:43:06.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.042+0000 7fb2f6231640 1 -- 172.21.15.55:0/3006719464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f015d510 con 0x7fb2f00d0630 2023-07-06T21:43:06.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.046+0000 7fb2f6231640 1 -- 172.21.15.55:0/3006719464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f004d790 con 0x7fb2f00d0630 2023-07-06T21:43:06.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.046+0000 7fb2e5ffb640 1 -- 172.21.15.55:0/3006719464 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb2e80b8cc0 con 0x7fb2f00d0630 2023-07-06T21:43:06.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.046+0000 7fb2e5ffb640 1 --2- 172.21.15.55:0/3006719464 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2d4066280 0x7fb2d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.046+0000 7fb2e5ffb640 1 -- 172.21.15.55:0/3006719464 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb2f00cf3d0 con 0x7fb2f00d0630 2023-07-06T21:43:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.046+0000 7fb2f522f640 1 --2- 172.21.15.55:0/3006719464 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2d4066280 0x7fb2d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.046+0000 7fb2f522f640 1 --2- 172.21.15.55:0/3006719464 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2d4066280 0x7fb2d4068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0150ad0 tx=0x7fb2ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.050+0000 7fb2e5ffb640 1 -- 172.21.15.55:0/3006719464 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2e80ec920 con 0x7fb2f00d0630 2023-07-06T21:43:06.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.218+0000 7fb2f6231640 1 -- 172.21.15.55:0/3006719464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb2f01513a0 con 0x7fb2f00d0630 2023-07-06T21:43:06.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.218+0000 7fb2e5ffb640 1 -- 172.21.15.55:0/3006719464 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb2f01513a0 con 0x7fb2f00d0630 2023-07-06T21:43:06.225 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2023-07-06T21:43:06.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.218+0000 7fb2f6231640 1 -- 172.21.15.55:0/3006719464 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2d4066280 msgr2=0x7fb2d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.218+0000 7fb2f6231640 1 --2- 172.21.15.55:0/3006719464 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2d4066280 0x7fb2d4068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0150ad0 tx=0x7fb2ec008040 comp rx=0 tx=0).stop 2023-07-06T21:43:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.218+0000 7fb2f6231640 1 -- 172.21.15.55:0/3006719464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2f00d0630 msgr2=0x7fb2f014f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.218+0000 7fb2f6231640 1 --2- 172.21.15.55:0/3006719464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2f00d0630 0x7fb2f014f990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb2e801a5b0 tx=0x7fb2e8019720 comp rx=0 tx=0).stop 2023-07-06T21:43:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.218+0000 7fb2f6231640 1 -- 172.21.15.55:0/3006719464 shutdown_connections 2023-07-06T21:43:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.218+0000 7fb2f6231640 1 --2- 172.21.15.55:0/3006719464 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2d4066280 0x7fb2d4068730 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.218+0000 7fb2f6231640 1 --2- 172.21.15.55:0/3006719464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2f00d0630 0x7fb2f014f990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.218+0000 7fb2f6231640 1 --2- 172.21.15.55:0/3006719464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f00ce200 0x7fb2f00c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.218+0000 7fb2f6231640 1 --2- 172.21.15.55:0/3006719464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f00b1250 0x7fb2f01515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.218+0000 7fb2f6231640 1 -- 172.21.15.55:0/3006719464 >> 172.21.15.55:0/3006719464 conn(0x7fb2f00b3b60 msgr2=0x7fb2f00693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.218+0000 7fb2f6231640 1 -- 172.21.15.55:0/3006719464 shutdown_connections 2023-07-06T21:43:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.218+0000 7fb2f6231640 1 -- 172.21.15.55:0/3006719464 wait complete. 2023-07-06T21:43:06.246 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-06T21:43:06.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:06.247 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-06T21:43:06.327 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2023-07-06T21:43:06.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:06.328 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-06T21:43:06.346 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:43:06.347 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:43:06.356 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:43:06.356 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:43:06.411 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:43:06.411 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:43:06.467 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:43:06.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6f8b11640 1 Processor -- start 2023-07-06T21:43:06.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6f8b11640 1 -- start start 2023-07-06T21:43:06.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6f8b11640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe6f40b7cd0 0x7fe6f40ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:06.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6f8b11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6f40ccab0 0x7fe6f40b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:06.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6f8b11640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f40cecf0 con 0x7fe6f40ccf00 2023-07-06T21:43:06.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6f8b11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f40d2310 con 0x7fe6f40ccab0 2023-07-06T21:43:06.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6f8b11640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f40b80a0 con 0x7fe6f40b7cd0 2023-07-06T21:43:06.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6ebfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6f40ccab0 0x7fe6f40b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:06.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6ebfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6f40ccab0 0x7fe6f40b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35834/0 (socket says 172.21.15.55:35834) 2023-07-06T21:43:06.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6ebfff640 1 -- 172.21.15.55:0/2082952824 learned_addr learned my addr 172.21.15.55:0/2082952824 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:06.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6f259c640 1 --2- 172.21.15.55:0/2082952824 >> v2:172.21.15.138:3300/0 conn(0x7fe6f40b7cd0 0x7fe6f40ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:06.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6ebfff640 1 -- 172.21.15.55:0/2082952824 >> v2:172.21.15.138:3300/0 conn(0x7fe6f40b7cd0 msgr2=0x7fe6f40ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:06.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6ebfff640 1 --2- 172.21.15.55:0/2082952824 >> v2:172.21.15.138:3300/0 conn(0x7fe6f40b7cd0 0x7fe6f40ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6ebfff640 1 -- 172.21.15.55:0/2082952824 >> v1:172.21.15.138:6789/0 conn(0x7fe6f40ccf00 legacy=0x7fe6f40b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:06.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.662+0000 7fe6ebfff640 1 -- 172.21.15.55:0/2082952824 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f40d1d90 con 0x7fe6f40ccab0 2023-07-06T21:43:06.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.666+0000 7fe6ebfff640 1 --2- 172.21.15.55:0/2082952824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40ccab0 0x7fe6f40b18d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe6f408b5d0 tx=0x7fe6dc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b80d34a3f5d456f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:06.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.666+0000 7fe6f1d9b640 1 -- 172.21.15.55:0/2082952824 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0ab600 con 0x7fe6f40ccab0 2023-07-06T21:43:06.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.666+0000 7fe6f1d9b640 1 -- 172.21.15.55:0/2082952824 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0a7050 con 0x7fe6f40ccab0 2023-07-06T21:43:06.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.666+0000 7fe6f1d9b640 1 -- 172.21.15.55:0/2082952824 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0ab980 con 0x7fe6f40ccab0 2023-07-06T21:43:06.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.666+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2082952824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40ccab0 msgr2=0x7fe6f40b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:06.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.666+0000 7fe6f8b11640 1 --2- 172.21.15.55:0/2082952824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40ccab0 0x7fe6f40b18d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe6f408b5d0 tx=0x7fe6dc01c470 comp rx=0 tx=0).stop 2023-07-06T21:43:06.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.666+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2082952824 shutdown_connections 2023-07-06T21:43:06.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.666+0000 7fe6f8b11640 1 --2- 172.21.15.55:0/2082952824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40ccab0 0x7fe6f40b18d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.666+0000 7fe6f8b11640 1 --2- 172.21.15.55:0/2082952824 >> v2:172.21.15.138:3300/0 conn(0x7fe6f40b7cd0 0x7fe6f40ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.666+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2082952824 >> 172.21.15.55:0/2082952824 conn(0x7fe6f40ceee0 msgr2=0x7fe6f40cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:06.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.666+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2082952824 shutdown_connections 2023-07-06T21:43:06.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.666+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2082952824 wait complete. 2023-07-06T21:43:06.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6f8b11640 1 Processor -- start 2023-07-06T21:43:06.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6f8b11640 1 -- start start 2023-07-06T21:43:06.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6f8b11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6f40b7cd0 0x7fe6f414cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:06.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6f8b11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40ccab0 0x7fe6f415c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:06.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6f8b11640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6f40ccf00 0x7fe6f40b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:06.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6f8b11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f406a0d0 con 0x7fe6f40ccab0 2023-07-06T21:43:06.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6f8b11640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f406a3b0 con 0x7fe6f40ccf00 2023-07-06T21:43:06.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6f8b11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f41f8a60 con 0x7fe6f40b7cd0 2023-07-06T21:43:06.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6ebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40ccab0 0x7fe6f415c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:06.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6ebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40ccab0 0x7fe6f415c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35838/0 (socket says 172.21.15.55:35838) 2023-07-06T21:43:06.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6ebfff640 1 -- 172.21.15.55:0/2543401674 learned_addr learned my addr 172.21.15.55:0/2543401674 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:06.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6f259c640 1 --2- 172.21.15.55:0/2543401674 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6f40b7cd0 0x7fe6f414cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:06.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6f2d9d640 1 --2- 172.21.15.55:0/2543401674 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6f40ccf00 0x7fe6f40b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:06.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6ebfff640 1 -- 172.21.15.55:0/2543401674 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6f40b7cd0 msgr2=0x7fe6f414cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:06.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6ebfff640 1 --2- 172.21.15.55:0/2543401674 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6f40b7cd0 0x7fe6f414cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6ebfff640 1 -- 172.21.15.55:0/2543401674 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6f40ccf00 msgr2=0x7fe6f40b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:06.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6ebfff640 1 --2- 172.21.15.55:0/2543401674 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6f40ccf00 0x7fe6f40b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6ebfff640 1 -- 172.21.15.55:0/2543401674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc0094d0 con 0x7fe6f40ccab0 2023-07-06T21:43:06.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6ebfff640 1 --2- 172.21.15.55:0/2543401674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40ccab0 0x7fe6f415c370 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0ae040 tx=0x7fe6dc019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:06.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6eaffd640 1 -- 172.21.15.55:0/2543401674 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0b37d0 con 0x7fe6f40ccab0 2023-07-06T21:43:06.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6eaffd640 1 -- 172.21.15.55:0/2543401674 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0b3930 con 0x7fe6f40ccab0 2023-07-06T21:43:06.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6eaffd640 1 -- 172.21.15.55:0/2543401674 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0b3ca0 con 0x7fe6f40ccab0 2023-07-06T21:43:06.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2543401674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f414d3c0 con 0x7fe6f40ccab0 2023-07-06T21:43:06.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2543401674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f4158360 con 0x7fe6f40ccab0 2023-07-06T21:43:06.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.670+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2543401674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f4158550 con 0x7fe6f40ccab0 2023-07-06T21:43:06.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.674+0000 7fe6eaffd640 1 -- 172.21.15.55:0/2543401674 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe6dc0b2070 con 0x7fe6f40ccab0 2023-07-06T21:43:06.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.674+0000 7fe6eaffd640 1 --2- 172.21.15.55:0/2543401674 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe6d4066280 0x7fe6d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:06.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.674+0000 7fe6eaffd640 1 -- 172.21.15.55:0/2543401674 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe6dc11e460 con 0x7fe6f40ccab0 2023-07-06T21:43:06.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.674+0000 7fe6f259c640 1 --2- 172.21.15.55:0/2543401674 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe6d4066280 0x7fe6d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:06.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.674+0000 7fe6f259c640 1 --2- 172.21.15.55:0/2543401674 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe6d4066280 0x7fe6d4068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400b930 tx=0x7fe6e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:06.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.678+0000 7fe6eaffd640 1 -- 172.21.15.55:0/2543401674 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe6dc0eb5a0 con 0x7fe6f40ccab0 2023-07-06T21:43:06.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.834+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2543401674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6f4066d60 con 0x7fe6f40ccab0 2023-07-06T21:43:06.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.834+0000 7fe6eaffd640 1 -- 172.21.15.55:0/2543401674 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fe6dc0eebc0 con 0x7fe6f40ccab0 2023-07-06T21:43:06.841 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:06.842 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":29,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:51.480379+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:43:06.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.838+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2543401674 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe6d4066280 msgr2=0x7fe6d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:06.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.838+0000 7fe6f8b11640 1 --2- 172.21.15.55:0/2543401674 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe6d4066280 0x7fe6d4068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400b930 tx=0x7fe6e4008040 comp rx=0 tx=0).stop 2023-07-06T21:43:06.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.838+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2543401674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40ccab0 msgr2=0x7fe6f415c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:06.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.838+0000 7fe6f8b11640 1 --2- 172.21.15.55:0/2543401674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40ccab0 0x7fe6f415c370 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0ae040 tx=0x7fe6dc019210 comp rx=0 tx=0).stop 2023-07-06T21:43:06.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.838+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2543401674 shutdown_connections 2023-07-06T21:43:06.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.838+0000 7fe6f8b11640 1 --2- 172.21.15.55:0/2543401674 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe6d4066280 0x7fe6d4068730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.838+0000 7fe6f8b11640 1 --2- 172.21.15.55:0/2543401674 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6f40ccf00 0x7fe6f40b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.838+0000 7fe6f8b11640 1 --2- 172.21.15.55:0/2543401674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f40ccab0 0x7fe6f415c370 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.838+0000 7fe6f8b11640 1 --2- 172.21.15.55:0/2543401674 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6f40b7cd0 0x7fe6f414cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:06.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.838+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2543401674 >> 172.21.15.55:0/2543401674 conn(0x7fe6f40ceee0 msgr2=0x7fe6f40b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:06.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.838+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2543401674 shutdown_connections 2023-07-06T21:43:06.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:06.838+0000 7fe6f8b11640 1 -- 172.21.15.55:0/2543401674 wait complete. 2023-07-06T21:43:06.865 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:42:08.597013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:42:09.843890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T21:42:12.918111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T21:43:06.867 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:43:07.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadc206d640 1 Processor -- start 2023-07-06T21:43:07.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadc206d640 1 -- start start 2023-07-06T21:43:07.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadc206d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fadbc070020 0x7fadbc0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadc206d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fadbc0cef40 0x7fadbc0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadc206d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadbc15fe80 con 0x7fadbc15bb90 2023-07-06T21:43:07.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadc206d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadbc15f620 con 0x7fadbc070020 2023-07-06T21:43:07.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadc206d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadbc15bf60 con 0x7fadbc0cef40 2023-07-06T21:43:07.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadbaffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fadbc070020 0x7fadbc0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadbaffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fadbc070020 0x7fadbc0ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35852/0 (socket says 172.21.15.55:35852) 2023-07-06T21:43:07.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadbaffd640 1 -- 172.21.15.55:0/2899943728 learned_addr learned my addr 172.21.15.55:0/2899943728 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:07.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadbbfff640 1 --2- 172.21.15.55:0/2899943728 >> v2:172.21.15.138:3300/0 conn(0x7fadbc0cef40 0x7fadbc0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadbaffd640 1 -- 172.21.15.55:0/2899943728 >> v2:172.21.15.138:3300/0 conn(0x7fadbc0cef40 msgr2=0x7fadbc0c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:07.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadbaffd640 1 --2- 172.21.15.55:0/2899943728 >> v2:172.21.15.138:3300/0 conn(0x7fadbc0cef40 0x7fadbc0c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadbaffd640 1 -- 172.21.15.55:0/2899943728 >> v1:172.21.15.138:6789/0 conn(0x7fadbc15bb90 legacy=0x7fadbc06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.010+0000 7fadbaffd640 1 -- 172.21.15.55:0/2899943728 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc0cf440 con 0x7fadbc070020 2023-07-06T21:43:07.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.014+0000 7fadbaffd640 1 --2- 172.21.15.55:0/2899943728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadbc070020 0x7fadbc0ce030 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fadbc06aaf0 tx=0x7fadb001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b8d5c6fad46499 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:07.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.014+0000 7fadba7fc640 1 -- 172.21.15.55:0/2899943728 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb00ab600 con 0x7fadbc070020 2023-07-06T21:43:07.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.014+0000 7fadba7fc640 1 -- 172.21.15.55:0/2899943728 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb00a7050 con 0x7fadbc070020 2023-07-06T21:43:07.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.014+0000 7fadba7fc640 1 -- 172.21.15.55:0/2899943728 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb00ab980 con 0x7fadbc070020 2023-07-06T21:43:07.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.014+0000 7fadc206d640 1 -- 172.21.15.55:0/2899943728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadbc070020 msgr2=0x7fadbc0ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.014+0000 7fadc206d640 1 --2- 172.21.15.55:0/2899943728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadbc070020 0x7fadbc0ce030 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fadbc06aaf0 tx=0x7fadb001c500 comp rx=0 tx=0).stop 2023-07-06T21:43:07.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.014+0000 7fadc206d640 1 -- 172.21.15.55:0/2899943728 shutdown_connections 2023-07-06T21:43:07.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.014+0000 7fadc206d640 1 --2- 172.21.15.55:0/2899943728 >> v2:172.21.15.138:3300/0 conn(0x7fadbc0cef40 0x7fadbc0c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.014+0000 7fadc206d640 1 --2- 172.21.15.55:0/2899943728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadbc070020 0x7fadbc0ce030 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.014+0000 7fadc206d640 1 -- 172.21.15.55:0/2899943728 >> 172.21.15.55:0/2899943728 conn(0x7fadbc0cbd70 msgr2=0x7fadbc0ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:07.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.014+0000 7fadc206d640 1 -- 172.21.15.55:0/2899943728 shutdown_connections 2023-07-06T21:43:07.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.014+0000 7fadc206d640 1 -- 172.21.15.55:0/2899943728 wait complete. 2023-07-06T21:43:07.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadc206d640 1 Processor -- start 2023-07-06T21:43:07.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadc206d640 1 -- start start 2023-07-06T21:43:07.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadc206d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadbc070020 0x7fadbc0c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadc206d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadbc0cef40 0x7fadbc14a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadc206d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadbc15bb90 0x7fadbc0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadc206d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc14a790 con 0x7fadbc15bb90 2023-07-06T21:43:07.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadc206d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0ae810 con 0x7fadbc070020 2023-07-06T21:43:07.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadc206d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0aeaf0 con 0x7fadbc0cef40 2023-07-06T21:43:07.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadbbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadbc15bb90 0x7fadbc0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadbbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadbc15bb90 0x7fadbc0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35868/0 (socket says 172.21.15.55:35868) 2023-07-06T21:43:07.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadbbfff640 1 -- 172.21.15.55:0/782610240 learned_addr learned my addr 172.21.15.55:0/782610240 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:07.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadbaffd640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadbc0cef40 0x7fadbc14a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadbb7fe640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadbc070020 0x7fadbc0c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadbbfff640 1 -- 172.21.15.55:0/782610240 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadbc0cef40 msgr2=0x7fadbc14a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadbbfff640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadbc0cef40 0x7fadbc14a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadbbfff640 1 -- 172.21.15.55:0/782610240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadbc070020 msgr2=0x7fadbc0c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadbbfff640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadbc070020 0x7fadbc0c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadbbfff640 1 -- 172.21.15.55:0/782610240 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb00094d0 con 0x7fadbc15bb90 2023-07-06T21:43:07.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadbb7fe640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadbc070020 0x7fadbc0c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:07.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadbbfff640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadbc15bb90 0x7fadbc0adf10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fadb4007e40 tx=0x7fadb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fada3fff640 1 -- 172.21.15.55:0/782610240 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4014620 con 0x7fadbc15bb90 2023-07-06T21:43:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fada3fff640 1 -- 172.21.15.55:0/782610240 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb400ee90 con 0x7fadbc15bb90 2023-07-06T21:43:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fada3fff640 1 -- 172.21.15.55:0/782610240 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb40149e0 con 0x7fadbc15bb90 2023-07-06T21:43:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadc206d640 1 -- 172.21.15.55:0/782610240 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadbc0aedd0 con 0x7fadbc15bb90 2023-07-06T21:43:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadc206d640 1 -- 172.21.15.55:0/782610240 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadbc15a0a0 con 0x7fadbc15bb90 2023-07-06T21:43:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.018+0000 7fadc206d640 1 -- 172.21.15.55:0/782610240 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadbc066d60 con 0x7fadbc15bb90 2023-07-06T21:43:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.022+0000 7fada3fff640 1 -- 172.21.15.55:0/782610240 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fadb4014b40 con 0x7fadbc15bb90 2023-07-06T21:43:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.022+0000 7fada3fff640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fada8066280 0x7fada8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.022+0000 7fada3fff640 1 -- 172.21.15.55:0/782610240 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fadb4084980 con 0x7fadbc15bb90 2023-07-06T21:43:07.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.022+0000 7fadbb7fe640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fada8066280 0x7fada8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.022+0000 7fadbb7fe640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fada8066280 0x7fada8068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fadbc06cb30 tx=0x7fadac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:07.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.026+0000 7fada3fff640 1 -- 172.21.15.55:0/782610240 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fadb4051a30 con 0x7fadbc15bb90 2023-07-06T21:43:07.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.182+0000 7fadc206d640 1 -- 172.21.15.55:0/782610240 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fadbc0b4620 con 0x7fadbc15bb90 2023-07-06T21:43:07.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.182+0000 7fada3fff640 1 -- 172.21.15.55:0/782610240 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fadb4055050 con 0x7fadbc15bb90 2023-07-06T21:43:07.191 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:43:07.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.186+0000 7fadc206d640 1 -- 172.21.15.55:0/782610240 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fada8066280 msgr2=0x7fada8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.186+0000 7fadc206d640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fada8066280 0x7fada8068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fadbc06cb30 tx=0x7fadac009040 comp rx=0 tx=0).stop 2023-07-06T21:43:07.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.186+0000 7fadc206d640 1 -- 172.21.15.55:0/782610240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadbc15bb90 msgr2=0x7fadbc0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.186+0000 7fadc206d640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadbc15bb90 0x7fadbc0adf10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fadb4007e40 tx=0x7fadb400e4b0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.186+0000 7fadc206d640 1 -- 172.21.15.55:0/782610240 shutdown_connections 2023-07-06T21:43:07.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.186+0000 7fadc206d640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fada8066280 0x7fada8068730 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.186+0000 7fadc206d640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadbc15bb90 0x7fadbc0adf10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.186+0000 7fadc206d640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadbc0cef40 0x7fadbc14a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.186+0000 7fadc206d640 1 --2- 172.21.15.55:0/782610240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadbc070020 0x7fadbc0c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.186+0000 7fadc206d640 1 -- 172.21.15.55:0/782610240 >> 172.21.15.55:0/782610240 conn(0x7fadbc0cbd70 msgr2=0x7fadbc0c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:07.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.186+0000 7fadc206d640 1 -- 172.21.15.55:0/782610240 shutdown_connections 2023-07-06T21:43:07.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.186+0000 7fadc206d640 1 -- 172.21.15.55:0/782610240 wait complete. 2023-07-06T21:43:07.212 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:43:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.350+0000 7f5731f12640 1 Processor -- start 2023-07-06T21:43:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.350+0000 7f5731f12640 1 -- start start 2023-07-06T21:43:07.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f5731f12640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f572c0d0630 0x7f572c15fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f5731f12640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f572c0ce200 0x7f572c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f5731f12640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572c0cc740 con 0x7f572c0b1250 2023-07-06T21:43:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f5731f12640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c0ccc90 con 0x7f572c0d0630 2023-07-06T21:43:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f5731f12640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0b29c0 con 0x7f572c0ce200 2023-07-06T21:43:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f572bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f572c0d0630 0x7f572c15fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f572bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f572c0d0630 0x7f572c15fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35874/0 (socket says 172.21.15.55:35874) 2023-07-06T21:43:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f572bfff640 1 -- 172.21.15.55:0/3071240852 learned_addr learned my addr 172.21.15.55:0/3071240852 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:07.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f572bfff640 1 -- 172.21.15.55:0/3071240852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f572c0ce200 msgr2=0x7f572c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:07.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f5731711640 1 --2- 172.21.15.55:0/3071240852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f572c0ce200 0x7f572c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f572bfff640 1 --2- 172.21.15.55:0/3071240852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f572c0ce200 0x7f572c0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f572bfff640 1 -- 172.21.15.55:0/3071240852 >> v1:172.21.15.138:6789/0 conn(0x7f572c0b1250 legacy=0x7f572c15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f572bfff640 1 -- 172.21.15.55:0/3071240852 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c0d1d10 con 0x7f572c0d0630 2023-07-06T21:43:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f5731711640 1 --2- 172.21.15.55:0/3071240852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f572c0ce200 0x7f572c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.354+0000 7f572bfff640 1 --2- 172.21.15.55:0/3071240852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572c0d0630 0x7f572c15fa90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5718009870 tx=0x7f571801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5123841620dcca2f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f572b7fe640 1 -- 172.21.15.55:0/3071240852 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57180ac410 con 0x7f572c0d0630 2023-07-06T21:43:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f572b7fe640 1 -- 172.21.15.55:0/3071240852 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57180ac570 con 0x7f572c0d0630 2023-07-06T21:43:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f572b7fe640 1 -- 172.21.15.55:0/3071240852 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57180ac900 con 0x7f572c0d0630 2023-07-06T21:43:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 -- 172.21.15.55:0/3071240852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572c0d0630 msgr2=0x7f572c15fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 --2- 172.21.15.55:0/3071240852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572c0d0630 0x7f572c15fa90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5718009870 tx=0x7f571801c500 comp rx=0 tx=0).stop 2023-07-06T21:43:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 -- 172.21.15.55:0/3071240852 shutdown_connections 2023-07-06T21:43:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 --2- 172.21.15.55:0/3071240852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f572c0ce200 0x7f572c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 --2- 172.21.15.55:0/3071240852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572c0d0630 0x7f572c15fa90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 -- 172.21.15.55:0/3071240852 >> 172.21.15.55:0/3071240852 conn(0x7f572c0b3b60 msgr2=0x7f572c0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:07.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 -- 172.21.15.55:0/3071240852 shutdown_connections 2023-07-06T21:43:07.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 -- 172.21.15.55:0/3071240852 wait complete. 2023-07-06T21:43:07.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 Processor -- start 2023-07-06T21:43:07.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 -- start start 2023-07-06T21:43:07.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572c0b1250 0x7f572c14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f572c0ce200 0x7f572c156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f572c0d0630 0x7f572c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c14d180 con 0x7f572c0b1250 2023-07-06T21:43:07.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0c8820 con 0x7f572c0d0630 2023-07-06T21:43:07.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5731f12640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c14cb30 con 0x7f572c0ce200 2023-07-06T21:43:07.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5730f10640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572c0b1250 0x7f572c14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5730f10640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572c0b1250 0x7f572c14c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35886/0 (socket says 172.21.15.55:35886) 2023-07-06T21:43:07.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.358+0000 7f5730f10640 1 -- 172.21.15.55:0/3106860142 learned_addr learned my addr 172.21.15.55:0/3106860142 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:07.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f572bfff640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f572c0ce200 0x7f572c156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f5731711640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f572c0d0630 0x7f572c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f5730f10640 1 -- 172.21.15.55:0/3106860142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f572c0ce200 msgr2=0x7f572c156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f5730f10640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f572c0ce200 0x7f572c156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f5730f10640 1 -- 172.21.15.55:0/3106860142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f572c0d0630 msgr2=0x7f572c156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f5730f10640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f572c0d0630 0x7f572c156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f5730f10640 1 -- 172.21.15.55:0/3106860142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57180094d0 con 0x7f572c0b1250 2023-07-06T21:43:07.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f5731711640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f572c0d0630 0x7f572c156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:07.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f5730f10640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572c0b1250 0x7f572c14c1c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f572000b410 tx=0x7f572000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:07.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f57297fa640 1 -- 172.21.15.55:0/3106860142 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720004020 con 0x7f572c0b1250 2023-07-06T21:43:07.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f57297fa640 1 -- 172.21.15.55:0/3106860142 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5720004180 con 0x7f572c0b1250 2023-07-06T21:43:07.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f57297fa640 1 -- 172.21.15.55:0/3106860142 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720011630 con 0x7f572c0b1250 2023-07-06T21:43:07.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f5731f12640 1 -- 172.21.15.55:0/3106860142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572c14ce10 con 0x7f572c0b1250 2023-07-06T21:43:07.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f5731f12640 1 -- 172.21.15.55:0/3106860142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c0c84d0 con 0x7f572c0b1250 2023-07-06T21:43:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f5731f12640 1 -- 172.21.15.55:0/3106860142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572c14c990 con 0x7f572c0b1250 2023-07-06T21:43:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.362+0000 7f57297fa640 1 -- 172.21.15.55:0/3106860142 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5720011790 con 0x7f572c0b1250 2023-07-06T21:43:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.366+0000 7f57297fa640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5710066280 0x7f5710068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.366+0000 7f57297fa640 1 -- 172.21.15.55:0/3106860142 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5720083d80 con 0x7f572c0b1250 2023-07-06T21:43:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.366+0000 7f572bfff640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5710066280 0x7f5710068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.366+0000 7f572bfff640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5710066280 0x7f5710068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f57180ae000 tx=0x7f57180a6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:07.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.370+0000 7f57297fa640 1 -- 172.21.15.55:0/3106860142 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f572c14c990 con 0x7f572c0b1250 2023-07-06T21:43:07.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.522+0000 7f5731f12640 1 -- 172.21.15.55:0/3106860142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f572c14c990 con 0x7f572c0b1250 2023-07-06T21:43:07.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.522+0000 7f57297fa640 1 -- 172.21.15.55:0/3106860142 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f572c14c990 con 0x7f572c0b1250 2023-07-06T21:43:07.530 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:43:07.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.526+0000 7f5731f12640 1 -- 172.21.15.55:0/3106860142 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5710066280 msgr2=0x7f5710068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.526+0000 7f5731f12640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5710066280 0x7f5710068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f57180ae000 tx=0x7f57180a6040 comp rx=0 tx=0).stop 2023-07-06T21:43:07.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.526+0000 7f5731f12640 1 -- 172.21.15.55:0/3106860142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572c0b1250 msgr2=0x7f572c14c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.526+0000 7f5731f12640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572c0b1250 0x7f572c14c1c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f572000b410 tx=0x7f572000b8d0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.526+0000 7f5731f12640 1 -- 172.21.15.55:0/3106860142 shutdown_connections 2023-07-06T21:43:07.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.526+0000 7f5731f12640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5710066280 0x7f5710068730 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.526+0000 7f5731f12640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f572c0d0630 0x7f572c156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.526+0000 7f5731f12640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f572c0ce200 0x7f572c156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.526+0000 7f5731f12640 1 --2- 172.21.15.55:0/3106860142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572c0b1250 0x7f572c14c1c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.526+0000 7f5731f12640 1 -- 172.21.15.55:0/3106860142 >> 172.21.15.55:0/3106860142 conn(0x7f572c0b3b60 msgr2=0x7f572c0cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.526+0000 7f5731f12640 1 -- 172.21.15.55:0/3106860142 shutdown_connections 2023-07-06T21:43:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.526+0000 7f5731f12640 1 -- 172.21.15.55:0/3106860142 wait complete. 2023-07-06T21:43:07.551 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:43:07.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bbcb74640 1 Processor -- start 2023-07-06T21:43:07.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bbcb74640 1 -- start start 2023-07-06T21:43:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bbcb74640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6bb80ca130 0x7f6bb80703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bbcb74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bb80cd140 0x7f6bb8070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bbcb74640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb8158c20 con 0x7f6bb8158850 2023-07-06T21:43:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bbcb74640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb80b2aa0 con 0x7f6bb80ca130 2023-07-06T21:43:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bbcb74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80c8db0 con 0x7f6bb80cd140 2023-07-06T21:43:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6bb8158850 0x7f6bb80cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52714/0 (socket says 172.21.15.55:52714) 2023-07-06T21:43:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb659c640 1 -- 172.21.15.55:0/3568241940 learned_addr learned my addr 172.21.15.55:0/3568241940 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:07.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3568241940 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333278305 0 0) 0x7f6bb8158c20 con 0x7f6bb8158850 2023-07-06T21:43:07.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3568241940 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba4003530 con 0x7f6bb8158850 2023-07-06T21:43:07.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6baffff640 1 --2- 172.21.15.55:0/3568241940 >> v2:172.21.15.138:3300/0 conn(0x7f6bb80ca130 0x7f6bb80703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb6d9d640 1 --2- 172.21.15.55:0/3568241940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bb80cd140 0x7f6bb8070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3568241940 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1649475474 0 0) 0x7f6ba4003530 con 0x7f6bb8158850 2023-07-06T21:43:07.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3568241940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bb80cd140 msgr2=0x7f6bb8070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:07.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 --2- 172.21.15.55:0/3568241940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bb80cd140 0x7f6bb8070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3568241940 >> v2:172.21.15.138:3300/0 conn(0x7f6bb80ca130 msgr2=0x7f6bb80703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:07.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 --2- 172.21.15.55:0/3568241940 >> v2:172.21.15.138:3300/0 conn(0x7f6bb80ca130 0x7f6bb80703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3568241940 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb80c9090 con 0x7f6bb8158850 2023-07-06T21:43:07.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3568241940 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f6ba8001680 con 0x7f6bb8158850 2023-07-06T21:43:07.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6baffff640 1 --2- 172.21.15.55:0/3568241940 >> v2:172.21.15.138:3300/0 conn(0x7f6bb80ca130 0x7f6bb80703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:07.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3568241940 >> v1:172.21.15.55:6789/0 conn(0x7f6bb8158850 legacy=0x7f6bb80cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 --2- 172.21.15.55:0/3568241940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ba4003980 0x7f6ba4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 --2- 172.21.15.55:0/3568241940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bb80cd140 0x7f6ba40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 --2- 172.21.15.55:0/3568241940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba4004d10 0x7f6ba4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3568241940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80b2aa0 con 0x7f6ba4004d10 2023-07-06T21:43:07.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3568241940 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80c8db0 con 0x7f6ba4003980 2023-07-06T21:43:07.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3568241940 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba400bac0 con 0x7f6bb80cd140 2023-07-06T21:43:07.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb6d9d640 1 --2- 172.21.15.55:0/3568241940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba4004d10 0x7f6ba4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6baffff640 1 --2- 172.21.15.55:0/3568241940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bb80cd140 0x7f6ba40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb659c640 1 --2- 172.21.15.55:0/3568241940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ba4003980 0x7f6ba4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb6d9d640 1 -- 172.21.15.55:0/3568241940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bb80cd140 msgr2=0x7f6ba40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:07.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb6d9d640 1 --2- 172.21.15.55:0/3568241940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bb80cd140 0x7f6ba40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb6d9d640 1 -- 172.21.15.55:0/3568241940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ba4003980 msgr2=0x7f6ba4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:07.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb6d9d640 1 --2- 172.21.15.55:0/3568241940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ba4003980 0x7f6ba4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.694+0000 7f6bb6d9d640 1 -- 172.21.15.55:0/3568241940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba4003530 con 0x7f6ba4004d10 2023-07-06T21:43:07.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.698+0000 7f6bb6d9d640 1 --2- 172.21.15.55:0/3568241940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba4004d10 0x7f6ba4005180 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0007330 tx=0x7f6bb001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85333856b6a4e0ad server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:07.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.698+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3568241940 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00a5d90 con 0x7f6ba4004d10 2023-07-06T21:43:07.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.698+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3568241940 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb00ad440 con 0x7f6ba4004d10 2023-07-06T21:43:07.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.698+0000 7f6bb5d9b640 1 -- 172.21.15.55:0/3568241940 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00ad7d0 con 0x7f6ba4004d10 2023-07-06T21:43:07.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.698+0000 7f6bbcb74640 1 -- 172.21.15.55:0/3568241940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba4004d10 msgr2=0x7f6ba4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.698+0000 7f6bbcb74640 1 --2- 172.21.15.55:0/3568241940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba4004d10 0x7f6ba4005180 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0007330 tx=0x7f6bb001ce90 comp rx=0 tx=0).stop 2023-07-06T21:43:07.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.698+0000 7f6bb6d9d640 1 -- 172.21.15.55:0/3568241940 reap_dead start 2023-07-06T21:43:07.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.698+0000 7f6bbcb74640 1 -- 172.21.15.55:0/3568241940 shutdown_connections 2023-07-06T21:43:07.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.698+0000 7f6bbcb74640 1 -- 172.21.15.55:0/3568241940 >> 172.21.15.55:0/3568241940 conn(0x7f6bb80cea70 msgr2=0x7f6bb80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:07.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.698+0000 7f6bbcb74640 1 -- 172.21.15.55:0/3568241940 shutdown_connections 2023-07-06T21:43:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.698+0000 7f6bbcb74640 1 -- 172.21.15.55:0/3568241940 wait complete. 2023-07-06T21:43:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bbcb74640 1 Processor -- start 2023-07-06T21:43:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bbcb74640 1 -- start start 2023-07-06T21:43:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bbcb74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6ba4004d10 0x7f6bb81ed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bbcb74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6bb8155e10 0x7f6bb81555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bbcb74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb8098bb0 0x7f6bb8099020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bbcb74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb81ed9e0 con 0x7f6bb8098bb0 2023-07-06T21:43:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bbcb74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb8099560 con 0x7f6bb8155e10 2023-07-06T21:43:07.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bbcb74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb81ec850 con 0x7f6ba4004d10 2023-07-06T21:43:07.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bb6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb8098bb0 0x7f6bb8099020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bb6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb8098bb0 0x7f6bb8099020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35906/0 (socket says 172.21.15.55:35906) 2023-07-06T21:43:07.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bb6d9d640 1 -- 172.21.15.55:0/450753583 learned_addr learned my addr 172.21.15.55:0/450753583 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:07.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bb659c640 1 --2- 172.21.15.55:0/450753583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6ba4004d10 0x7f6bb81ed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6baffff640 1 --2- 172.21.15.55:0/450753583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6bb8155e10 0x7f6bb81555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bb6d9d640 1 -- 172.21.15.55:0/450753583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6ba4004d10 msgr2=0x7f6bb81ed3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bb6d9d640 1 --2- 172.21.15.55:0/450753583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6ba4004d10 0x7f6bb81ed3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bb6d9d640 1 -- 172.21.15.55:0/450753583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6bb8155e10 msgr2=0x7f6bb81555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bb6d9d640 1 --2- 172.21.15.55:0/450753583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6bb8155e10 0x7f6bb81555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bb6d9d640 1 -- 172.21.15.55:0/450753583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb80ae4a0 con 0x7f6bb8098bb0 2023-07-06T21:43:07.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bb6d9d640 1 --2- 172.21.15.55:0/450753583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb8098bb0 0x7f6bb8099020 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00b0040 tx=0x7f6ba4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:07.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6baeffd640 1 -- 172.21.15.55:0/450753583 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00ad7c0 con 0x7f6bb8098bb0 2023-07-06T21:43:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6baeffd640 1 -- 172.21.15.55:0/450753583 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb00ad920 con 0x7f6bb8098bb0 2023-07-06T21:43:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bbcb74640 1 -- 172.21.15.55:0/450753583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb80ae780 con 0x7f6bb8098bb0 2023-07-06T21:43:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6baeffd640 1 -- 172.21.15.55:0/450753583 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00adcd0 con 0x7f6bb8098bb0 2023-07-06T21:43:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.702+0000 7f6bbcb74640 1 -- 172.21.15.55:0/450753583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb80aea60 con 0x7f6bb8098bb0 2023-07-06T21:43:07.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.706+0000 7f6bbcb74640 1 -- 172.21.15.55:0/450753583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb8066d60 con 0x7f6bb8098bb0 2023-07-06T21:43:07.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.706+0000 7f6baeffd640 1 -- 172.21.15.55:0/450753583 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6bb00b4070 con 0x7f6bb8098bb0 2023-07-06T21:43:07.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.706+0000 7f6baeffd640 1 --2- 172.21.15.55:0/450753583 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b98066280 0x7f6b98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:07.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.706+0000 7f6baeffd640 1 -- 172.21.15.55:0/450753583 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6bb011e110 con 0x7f6bb8098bb0 2023-07-06T21:43:07.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.706+0000 7f6bb659c640 1 --2- 172.21.15.55:0/450753583 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b98066280 0x7f6b98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:07.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.706+0000 7f6bb659c640 1 --2- 172.21.15.55:0/450753583 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b98066280 0x7f6b98068730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8000c10 tx=0x7f6ba8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:07.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.710+0000 7f6baeffd640 1 -- 172.21.15.55:0/450753583 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6bb00eb270 con 0x7f6bb8098bb0 2023-07-06T21:43:07.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.862+0000 7f6bbcb74640 1 -- 172.21.15.55:0/450753583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6bb81eddd0 con 0x7f6bb8098bb0 2023-07-06T21:43:07.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.862+0000 7f6baeffd640 1 -- 172.21.15.55:0/450753583 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6bb00ee890 con 0x7f6bb8098bb0 2023-07-06T21:43:07.871 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:43:07.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.866+0000 7f6bbcb74640 1 -- 172.21.15.55:0/450753583 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b98066280 msgr2=0x7f6b98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.866+0000 7f6bbcb74640 1 --2- 172.21.15.55:0/450753583 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b98066280 0x7f6b98068730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8000c10 tx=0x7f6ba8009040 comp rx=0 tx=0).stop 2023-07-06T21:43:07.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.866+0000 7f6bbcb74640 1 -- 172.21.15.55:0/450753583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb8098bb0 msgr2=0x7f6bb8099020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.866+0000 7f6bbcb74640 1 --2- 172.21.15.55:0/450753583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb8098bb0 0x7f6bb8099020 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00b0040 tx=0x7f6ba4005800 comp rx=0 tx=0).stop 2023-07-06T21:43:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.866+0000 7f6bbcb74640 1 -- 172.21.15.55:0/450753583 shutdown_connections 2023-07-06T21:43:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.866+0000 7f6bbcb74640 1 --2- 172.21.15.55:0/450753583 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b98066280 0x7f6b98068730 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.866+0000 7f6bbcb74640 1 --2- 172.21.15.55:0/450753583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb8098bb0 0x7f6bb8099020 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.866+0000 7f6bbcb74640 1 --2- 172.21.15.55:0/450753583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6bb8155e10 0x7f6bb81555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.866+0000 7f6bbcb74640 1 --2- 172.21.15.55:0/450753583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6ba4004d10 0x7f6bb81ed3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.866+0000 7f6bbcb74640 1 -- 172.21.15.55:0/450753583 >> 172.21.15.55:0/450753583 conn(0x7f6bb80cea70 msgr2=0x7f6bb8157ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:07.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.866+0000 7f6bbcb74640 1 -- 172.21.15.55:0/450753583 shutdown_connections 2023-07-06T21:43:07.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:07.866+0000 7f6bbcb74640 1 -- 172.21.15.55:0/450753583 wait complete. 2023-07-06T21:43:07.893 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:43:08.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.030+0000 7ffaddc48640 1 Processor -- start 2023-07-06T21:43:08.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.030+0000 7ffaddc48640 1 -- start start 2023-07-06T21:43:08.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.034+0000 7ffaddc48640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffad8156180 0x7ffad80ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.034+0000 7ffaddc48640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ffad806e9d0 0x7ffad806ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.034+0000 7ffaddc48640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad815f5d0 con 0x7ffad80cb7a0 2023-07-06T21:43:08.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.034+0000 7ffaddc48640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad8160250 con 0x7ffad8156180 2023-07-06T21:43:08.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.034+0000 7ffaddc48640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad806f390 con 0x7ffad806e9d0 2023-07-06T21:43:08.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.034+0000 7ffad77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffad8156180 0x7ffad80ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.034+0000 7ffad77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffad8156180 0x7ffad80ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35910/0 (socket says 172.21.15.55:35910) 2023-07-06T21:43:08.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.034+0000 7ffad77fe640 1 -- 172.21.15.55:0/1976503230 learned_addr learned my addr 172.21.15.55:0/1976503230 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:08.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.034+0000 7ffad6ffd640 1 --2- 172.21.15.55:0/1976503230 >> v2:172.21.15.138:3300/0 conn(0x7ffad806e9d0 0x7ffad806ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.034+0000 7ffad77fe640 1 -- 172.21.15.55:0/1976503230 >> v2:172.21.15.138:3300/0 conn(0x7ffad806e9d0 msgr2=0x7ffad806ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:08.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.034+0000 7ffad77fe640 1 --2- 172.21.15.55:0/1976503230 >> v2:172.21.15.138:3300/0 conn(0x7ffad806e9d0 0x7ffad806ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.034+0000 7ffad77fe640 1 -- 172.21.15.55:0/1976503230 >> v1:172.21.15.138:6789/0 conn(0x7ffad80cb7a0 legacy=0x7ffad80cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:08.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.034+0000 7ffad77fe640 1 -- 172.21.15.55:0/1976503230 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad815f8b0 con 0x7ffad8156180 2023-07-06T21:43:08.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.038+0000 7ffad77fe640 1 --2- 172.21.15.55:0/1976503230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad8156180 0x7ffad80ca610 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffad80cef40 tx=0x7ffac801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2709f96a638401fb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:08.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.038+0000 7ffad67fc640 1 -- 172.21.15.55:0/1976503230 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac80ab640 con 0x7ffad8156180 2023-07-06T21:43:08.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.038+0000 7ffad67fc640 1 -- 172.21.15.55:0/1976503230 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac80a7070 con 0x7ffad8156180 2023-07-06T21:43:08.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.038+0000 7ffad67fc640 1 -- 172.21.15.55:0/1976503230 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac80ab9c0 con 0x7ffad8156180 2023-07-06T21:43:08.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.038+0000 7ffaddc48640 1 -- 172.21.15.55:0/1976503230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad8156180 msgr2=0x7ffad80ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.038+0000 7ffaddc48640 1 --2- 172.21.15.55:0/1976503230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad8156180 0x7ffad80ca610 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffad80cef40 tx=0x7ffac801c440 comp rx=0 tx=0).stop 2023-07-06T21:43:08.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.038+0000 7ffaddc48640 1 -- 172.21.15.55:0/1976503230 shutdown_connections 2023-07-06T21:43:08.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.038+0000 7ffaddc48640 1 --2- 172.21.15.55:0/1976503230 >> v2:172.21.15.138:3300/0 conn(0x7ffad806e9d0 0x7ffad806ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.038+0000 7ffaddc48640 1 --2- 172.21.15.55:0/1976503230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad8156180 0x7ffad80ca610 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.038+0000 7ffaddc48640 1 -- 172.21.15.55:0/1976503230 >> 172.21.15.55:0/1976503230 conn(0x7ffad80d0c50 msgr2=0x7ffad80cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:08.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.038+0000 7ffaddc48640 1 -- 172.21.15.55:0/1976503230 shutdown_connections 2023-07-06T21:43:08.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.038+0000 7ffaddc48640 1 -- 172.21.15.55:0/1976503230 wait complete. 2023-07-06T21:43:08.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.038+0000 7ffaddc48640 1 Processor -- start 2023-07-06T21:43:08.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.038+0000 7ffaddc48640 1 -- start start 2023-07-06T21:43:08.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffaddc48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffad806e9d0 0x7ffad814d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffaddc48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad80cb7a0 0x7ffad80c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffaddc48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffad8156180 0x7ffad80c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffaddc48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80c3af0 con 0x7ffad80cb7a0 2023-07-06T21:43:08.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffaddc48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80afec0 con 0x7ffad806e9d0 2023-07-06T21:43:08.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffaddc48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80ca090 con 0x7ffad8156180 2023-07-06T21:43:08.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffad6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad80cb7a0 0x7ffad80c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffad6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad80cb7a0 0x7ffad80c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35924/0 (socket says 172.21.15.55:35924) 2023-07-06T21:43:08.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffad6ffd640 1 -- 172.21.15.55:0/3558075241 learned_addr learned my addr 172.21.15.55:0/3558075241 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:08.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffad77fe640 1 --2- 172.21.15.55:0/3558075241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffad806e9d0 0x7ffad814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffad7fff640 1 --2- 172.21.15.55:0/3558075241 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffad8156180 0x7ffad80c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffad6ffd640 1 -- 172.21.15.55:0/3558075241 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffad8156180 msgr2=0x7ffad80c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffad6ffd640 1 --2- 172.21.15.55:0/3558075241 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffad8156180 0x7ffad80c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffad6ffd640 1 -- 172.21.15.55:0/3558075241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffad806e9d0 msgr2=0x7ffad814d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffad6ffd640 1 --2- 172.21.15.55:0/3558075241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffad806e9d0 0x7ffad814d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffad6ffd640 1 -- 172.21.15.55:0/3558075241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac80094d0 con 0x7ffad80cb7a0 2023-07-06T21:43:08.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffad6ffd640 1 --2- 172.21.15.55:0/3558075241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad80cb7a0 0x7ffad80c7fa0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00d800 tx=0x7ffacc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:08.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffabffff640 1 -- 172.21.15.55:0/3558075241 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc00b6c0 con 0x7ffad80cb7a0 2023-07-06T21:43:08.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffabffff640 1 -- 172.21.15.55:0/3558075241 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc00b820 con 0x7ffad80cb7a0 2023-07-06T21:43:08.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffabffff640 1 -- 172.21.15.55:0/3558075241 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc00bb90 con 0x7ffad80cb7a0 2023-07-06T21:43:08.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffaddc48640 1 -- 172.21.15.55:0/3558075241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad80c9ad0 con 0x7ffad80cb7a0 2023-07-06T21:43:08.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffaddc48640 1 -- 172.21.15.55:0/3558075241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad80afb50 con 0x7ffad80cb7a0 2023-07-06T21:43:08.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffaddc48640 1 -- 172.21.15.55:0/3558075241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad8066d60 con 0x7ffad80cb7a0 2023-07-06T21:43:08.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.042+0000 7ffabffff640 1 -- 172.21.15.55:0/3558075241 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffacc00bcf0 con 0x7ffad80cb7a0 2023-07-06T21:43:08.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.046+0000 7ffabffff640 1 --2- 172.21.15.55:0/3558075241 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffac4066280 0x7ffac4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.046+0000 7ffabffff640 1 -- 172.21.15.55:0/3558075241 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffacc0844a0 con 0x7ffad80cb7a0 2023-07-06T21:43:08.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.046+0000 7ffad77fe640 1 --2- 172.21.15.55:0/3558075241 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffac4066280 0x7ffac4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.046+0000 7ffad77fe640 1 --2- 172.21.15.55:0/3558075241 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffac4066280 0x7ffac4068730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffac80af000 tx=0x7ffac80b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.050+0000 7ffabffff640 1 -- 172.21.15.55:0/3558075241 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffacc055120 con 0x7ffad80cb7a0 2023-07-06T21:43:08.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.202+0000 7ffaddc48640 1 -- 172.21.15.55:0/3558075241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffad81676b0 con 0x7ffad80cb7a0 2023-07-06T21:43:08.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.202+0000 7ffabffff640 1 -- 172.21.15.55:0/3558075241 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffacc054cb0 con 0x7ffad80cb7a0 2023-07-06T21:43:08.211 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:43:08.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.206+0000 7ffaddc48640 1 -- 172.21.15.55:0/3558075241 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffac4066280 msgr2=0x7ffac4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.206+0000 7ffaddc48640 1 --2- 172.21.15.55:0/3558075241 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffac4066280 0x7ffac4068730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffac80af000 tx=0x7ffac80b6040 comp rx=0 tx=0).stop 2023-07-06T21:43:08.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.206+0000 7ffaddc48640 1 -- 172.21.15.55:0/3558075241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad80cb7a0 msgr2=0x7ffad80c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.206+0000 7ffaddc48640 1 --2- 172.21.15.55:0/3558075241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad80cb7a0 0x7ffad80c7fa0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00d800 tx=0x7ffacc00dcc0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.206+0000 7ffaddc48640 1 -- 172.21.15.55:0/3558075241 shutdown_connections 2023-07-06T21:43:08.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.206+0000 7ffaddc48640 1 --2- 172.21.15.55:0/3558075241 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffac4066280 0x7ffac4068730 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.206+0000 7ffaddc48640 1 --2- 172.21.15.55:0/3558075241 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffad8156180 0x7ffad80c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.206+0000 7ffaddc48640 1 --2- 172.21.15.55:0/3558075241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad80cb7a0 0x7ffad80c7fa0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.206+0000 7ffaddc48640 1 --2- 172.21.15.55:0/3558075241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffad806e9d0 0x7ffad814d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.206+0000 7ffaddc48640 1 -- 172.21.15.55:0/3558075241 >> 172.21.15.55:0/3558075241 conn(0x7ffad80d0c50 msgr2=0x7ffad815d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:08.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.206+0000 7ffaddc48640 1 -- 172.21.15.55:0/3558075241 shutdown_connections 2023-07-06T21:43:08.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.206+0000 7ffaddc48640 1 -- 172.21.15.55:0/3558075241 wait complete. 2023-07-06T21:43:08.232 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T21:43:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.370+0000 7faf5266d640 1 Processor -- start 2023-07-06T21:43:08.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.370+0000 7faf5266d640 1 -- start start 2023-07-06T21:43:08.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.370+0000 7faf5266d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf4c0ca130 0x7faf4c0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.370+0000 7faf5266d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4c158cb0 con 0x7faf4c0cd140 2023-07-06T21:43:08.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.370+0000 7faf5266d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4c0c8db0 con 0x7faf4c158850 2023-07-06T21:43:08.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.370+0000 7faf5266d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0c9090 con 0x7faf4c0ca130 2023-07-06T21:43:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.370+0000 7faf50c0a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faf4c0cd140 0x7faf4c0b1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52730/0 (socket says 172.21.15.55:52730) 2023-07-06T21:43:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.370+0000 7faf50c0a640 1 -- 172.21.15.55:0/3784962001 learned_addr learned my addr 172.21.15.55:0/3784962001 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.374+0000 7faf4b7fe640 1 --2- 172.21.15.55:0/3784962001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf4c0ca130 0x7faf4c0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.374+0000 7faf4affd640 1 -- 172.21.15.55:0/3784962001 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206780795 0 0) 0x7faf4c158cb0 con 0x7faf4c0cd140 2023-07-06T21:43:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.374+0000 7faf4affd640 1 -- 172.21.15.55:0/3784962001 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf34003530 con 0x7faf4c0cd140 2023-07-06T21:43:08.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.374+0000 7faf4affd640 1 -- 172.21.15.55:0/3784962001 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149453275 0 0) 0x7faf4c0c8db0 con 0x7faf4c158850 2023-07-06T21:43:08.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.374+0000 7faf4affd640 1 -- 172.21.15.55:0/3784962001 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf4c158cb0 con 0x7faf4c158850 2023-07-06T21:43:08.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.374+0000 7faf4b7fe640 1 -- 172.21.15.55:0/3784962001 >> v1:172.21.15.138:6789/0 conn(0x7faf4c158850 legacy=0x7faf4c0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.374+0000 7faf4b7fe640 1 -- 172.21.15.55:0/3784962001 >> v1:172.21.15.55:6789/0 conn(0x7faf4c0cd140 legacy=0x7faf4c0b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.374+0000 7faf4affd640 1 -- 172.21.15.55:0/3784962001 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3108907506 0 0) 0x7faf34003530 con 0x7faf4c0cd140 2023-07-06T21:43:08.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.374+0000 7faf4b7fe640 1 -- 172.21.15.55:0/3784962001 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c0c9370 con 0x7faf4c0ca130 2023-07-06T21:43:08.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.374+0000 7faf4b7fe640 1 --2- 172.21.15.55:0/3784962001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf4c0ca130 0x7faf4c0703e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faf400097f0 tx=0x7faf4001e5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ba10726e3377174 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:08.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf4affd640 1 -- 172.21.15.55:0/3784962001 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf44001a00 con 0x7faf4c0ca130 2023-07-06T21:43:08.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf4affd640 1 -- 172.21.15.55:0/3784962001 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf400ab410 con 0x7faf4c0ca130 2023-07-06T21:43:08.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf4affd640 1 -- 172.21.15.55:0/3784962001 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf400ab7a0 con 0x7faf4c0ca130 2023-07-06T21:43:08.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 -- 172.21.15.55:0/3784962001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf4c0ca130 msgr2=0x7faf4c0703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 --2- 172.21.15.55:0/3784962001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf4c0ca130 0x7faf4c0703e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faf400097f0 tx=0x7faf4001e5c0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 -- 172.21.15.55:0/3784962001 shutdown_connections 2023-07-06T21:43:08.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 --2- 172.21.15.55:0/3784962001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf4c0ca130 0x7faf4c0703e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 -- 172.21.15.55:0/3784962001 >> 172.21.15.55:0/3784962001 conn(0x7faf4c0cea70 msgr2=0x7faf4c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:08.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 -- 172.21.15.55:0/3784962001 shutdown_connections 2023-07-06T21:43:08.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 -- 172.21.15.55:0/3784962001 wait complete. 2023-07-06T21:43:08.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 Processor -- start 2023-07-06T21:43:08.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 -- start start 2023-07-06T21:43:08.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf4c0ca130 0x7faf4c153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf4c0cd140 0x7faf4c0c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf4c158850 0x7faf4c157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c156980 con 0x7faf4c158850 2023-07-06T21:43:08.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c156c60 con 0x7faf4c0cd140 2023-07-06T21:43:08.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf5266d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c156f40 con 0x7faf4c0ca130 2023-07-06T21:43:08.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf50c0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf4c158850 0x7faf4c157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf50c0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf4c158850 0x7faf4c157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35930/0 (socket says 172.21.15.55:35930) 2023-07-06T21:43:08.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf50c0a640 1 -- 172.21.15.55:0/2039903591 learned_addr learned my addr 172.21.15.55:0/2039903591 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:08.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf4b7fe640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf4c0cd140 0x7faf4c0c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.378+0000 7faf4bfff640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf4c0ca130 0x7faf4c153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf50c0a640 1 -- 172.21.15.55:0/2039903591 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf4c0ca130 msgr2=0x7faf4c153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf50c0a640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf4c0ca130 0x7faf4c153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf50c0a640 1 -- 172.21.15.55:0/2039903591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf4c0cd140 msgr2=0x7faf4c0c14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf50c0a640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf4c0cd140 0x7faf4c0c14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf50c0a640 1 -- 172.21.15.55:0/2039903591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf40009420 con 0x7faf4c158850 2023-07-06T21:43:08.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf4b7fe640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf4c0cd140 0x7faf4c0c14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:08.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf50c0a640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf4c158850 0x7faf4c157a20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faf44001fb0 tx=0x7faf4400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:08.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf48ff9640 1 -- 172.21.15.55:0/2039903591 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf44012400 con 0x7faf4c158850 2023-07-06T21:43:08.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf48ff9640 1 -- 172.21.15.55:0/2039903591 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf44012560 con 0x7faf4c158850 2023-07-06T21:43:08.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf48ff9640 1 -- 172.21.15.55:0/2039903591 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf44012910 con 0x7faf4c158850 2023-07-06T21:43:08.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf5266d640 1 -- 172.21.15.55:0/2039903591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4c157220 con 0x7faf4c158850 2023-07-06T21:43:08.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf5266d640 1 -- 172.21.15.55:0/2039903591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4c0c1a20 con 0x7faf4c158850 2023-07-06T21:43:08.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf5266d640 1 -- 172.21.15.55:0/2039903591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4c0c1c10 con 0x7faf4c158850 2023-07-06T21:43:08.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf48ff9640 1 -- 172.21.15.55:0/2039903591 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf44012a70 con 0x7faf4c158850 2023-07-06T21:43:08.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf48ff9640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7faf38066280 0x7faf38068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf48ff9640 1 -- 172.21.15.55:0/2039903591 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faf44084850 con 0x7faf4c158850 2023-07-06T21:43:08.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.382+0000 7faf4bfff640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7faf38066280 0x7faf38068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.386+0000 7faf4bfff640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7faf38066280 0x7faf38068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0011f0 tx=0x7faf3c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:08.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.386+0000 7faf48ff9640 1 -- 172.21.15.55:0/2039903591 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf44051a50 con 0x7faf4c158850 2023-07-06T21:43:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.542+0000 7faf5266d640 1 -- 172.21.15.55:0/2039903591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faf4c066d60 con 0x7faf4c158850 2023-07-06T21:43:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.542+0000 7faf48ff9640 1 -- 172.21.15.55:0/2039903591 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7faf44055070 con 0x7faf4c158850 2023-07-06T21:43:08.548 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:43:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.542+0000 7faf5266d640 1 -- 172.21.15.55:0/2039903591 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7faf38066280 msgr2=0x7faf38068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.542+0000 7faf5266d640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7faf38066280 0x7faf38068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0011f0 tx=0x7faf3c009040 comp rx=0 tx=0).stop 2023-07-06T21:43:08.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.542+0000 7faf5266d640 1 -- 172.21.15.55:0/2039903591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf4c158850 msgr2=0x7faf4c157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.542+0000 7faf5266d640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf4c158850 0x7faf4c157a20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faf44001fb0 tx=0x7faf4400a430 comp rx=0 tx=0).stop 2023-07-06T21:43:08.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.542+0000 7faf5266d640 1 -- 172.21.15.55:0/2039903591 shutdown_connections 2023-07-06T21:43:08.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.542+0000 7faf5266d640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7faf38066280 0x7faf38068730 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.542+0000 7faf5266d640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf4c158850 0x7faf4c157a20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.542+0000 7faf5266d640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf4c0cd140 0x7faf4c0c14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.542+0000 7faf5266d640 1 --2- 172.21.15.55:0/2039903591 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf4c0ca130 0x7faf4c153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.542+0000 7faf5266d640 1 -- 172.21.15.55:0/2039903591 >> 172.21.15.55:0/2039903591 conn(0x7faf4c0cea70 msgr2=0x7faf4c0ae010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.542+0000 7faf5266d640 1 -- 172.21.15.55:0/2039903591 shutdown_connections 2023-07-06T21:43:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.542+0000 7faf5266d640 1 -- 172.21.15.55:0/2039903591 wait complete. 2023-07-06T21:43:08.570 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T21:43:08.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.706+0000 7f6641b37640 1 Processor -- start 2023-07-06T21:43:08.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.706+0000 7f6641b37640 1 -- start start 2023-07-06T21:43:08.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.710+0000 7f6641b37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f663c06f0e0 0x7f663c0ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.710+0000 7f6641b37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cb7a0 0x7f663c0cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.710+0000 7f6641b37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c15f5d0 con 0x7f663c156180 2023-07-06T21:43:08.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.710+0000 7f6641b37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c160250 con 0x7f663c06f0e0 2023-07-06T21:43:08.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.710+0000 7f6641b37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c15f8b0 con 0x7f663c0cb7a0 2023-07-06T21:43:08.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.710+0000 7f6633fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f663c06f0e0 0x7f663c0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.710+0000 7f6633fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f663c06f0e0 0x7f663c0ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35942/0 (socket says 172.21.15.55:35942) 2023-07-06T21:43:08.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.710+0000 7f6633fff640 1 -- 172.21.15.55:0/2145443191 learned_addr learned my addr 172.21.15.55:0/2145443191 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:08.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.710+0000 7f663bfff640 1 --2- 172.21.15.55:0/2145443191 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cb7a0 0x7f663c0cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.710+0000 7f6633fff640 1 -- 172.21.15.55:0/2145443191 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cb7a0 msgr2=0x7f663c0cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:08.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.710+0000 7f6633fff640 1 --2- 172.21.15.55:0/2145443191 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cb7a0 0x7f663c0cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.710+0000 7f6633fff640 1 -- 172.21.15.55:0/2145443191 >> v1:172.21.15.55:6789/0 conn(0x7f663c156180 legacy=0x7f663c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.710+0000 7f6633fff640 1 -- 172.21.15.55:0/2145443191 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c15fb90 con 0x7f663c06f0e0 2023-07-06T21:43:08.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.710+0000 7f663bfff640 1 --2- 172.21.15.55:0/2145443191 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cb7a0 0x7f663c0cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:08.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6633fff640 1 --2- 172.21.15.55:0/2145443191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c06f0e0 0x7f663c0ca610 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6624009870 tx=0x7f662401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0d9a6c6ff6978e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:08.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f663affd640 1 -- 172.21.15.55:0/2145443191 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240a6040 con 0x7f663c06f0e0 2023-07-06T21:43:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f663affd640 1 -- 172.21.15.55:0/2145443191 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66240aa600 con 0x7f663c06f0e0 2023-07-06T21:43:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f663affd640 1 -- 172.21.15.55:0/2145443191 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240aa990 con 0x7f663c06f0e0 2023-07-06T21:43:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 -- 172.21.15.55:0/2145443191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c06f0e0 msgr2=0x7f663c0ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 --2- 172.21.15.55:0/2145443191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c06f0e0 0x7f663c0ca610 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6624009870 tx=0x7f662401c480 comp rx=0 tx=0).stop 2023-07-06T21:43:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 -- 172.21.15.55:0/2145443191 shutdown_connections 2023-07-06T21:43:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 --2- 172.21.15.55:0/2145443191 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cb7a0 0x7f663c0cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 --2- 172.21.15.55:0/2145443191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c06f0e0 0x7f663c0ca610 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 -- 172.21.15.55:0/2145443191 >> 172.21.15.55:0/2145443191 conn(0x7f663c0d0c50 msgr2=0x7f663c0cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 -- 172.21.15.55:0/2145443191 shutdown_connections 2023-07-06T21:43:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 -- 172.21.15.55:0/2145443191 wait complete. 2023-07-06T21:43:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 Processor -- start 2023-07-06T21:43:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 -- start start 2023-07-06T21:43:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f663c06f0e0 0x7f663c0b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cb7a0 0x7f663c1f7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c156180 0x7f663c1f7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c150400 con 0x7f663c156180 2023-07-06T21:43:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0b24a0 con 0x7f663c06f0e0 2023-07-06T21:43:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.714+0000 7f6641b37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c151190 con 0x7f663c0cb7a0 2023-07-06T21:43:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f663bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c156180 0x7f663c1f7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f663bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c156180 0x7f663c1f7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35946/0 (socket says 172.21.15.55:35946) 2023-07-06T21:43:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f663bfff640 1 -- 172.21.15.55:0/836323776 learned_addr learned my addr 172.21.15.55:0/836323776 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f663b7fe640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f663c06f0e0 0x7f663c0b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f6633fff640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cb7a0 0x7f663c1f7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f663bfff640 1 -- 172.21.15.55:0/836323776 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cb7a0 msgr2=0x7f663c1f7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f663bfff640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cb7a0 0x7f663c1f7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f663bfff640 1 -- 172.21.15.55:0/836323776 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f663c06f0e0 msgr2=0x7f663c0b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f663bfff640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f663c06f0e0 0x7f663c0b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f663bfff640 1 -- 172.21.15.55:0/836323776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66240094d0 con 0x7f663c156180 2023-07-06T21:43:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f663b7fe640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f663c06f0e0 0x7f663c0b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f663bfff640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c156180 0x7f663c1f7840 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f663400cf20 tx=0x7f663400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f6638ff9640 1 -- 172.21.15.55:0/836323776 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663400d840 con 0x7f663c156180 2023-07-06T21:43:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f6638ff9640 1 -- 172.21.15.55:0/836323776 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663400d9a0 con 0x7f663c156180 2023-07-06T21:43:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f6638ff9640 1 -- 172.21.15.55:0/836323776 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663400dd50 con 0x7f663c156180 2023-07-06T21:43:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f6641b37640 1 -- 172.21.15.55:0/836323776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c14fad0 con 0x7f663c156180 2023-07-06T21:43:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f6641b37640 1 -- 172.21.15.55:0/836323776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c150090 con 0x7f663c156180 2023-07-06T21:43:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f6641b37640 1 -- 172.21.15.55:0/836323776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c1505b0 con 0x7f663c156180 2023-07-06T21:43:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f6638ff9640 1 -- 172.21.15.55:0/836323776 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f663401d360 con 0x7f663c156180 2023-07-06T21:43:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f6638ff9640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f661c066280 0x7f661c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.718+0000 7f6638ff9640 1 -- 172.21.15.55:0/836323776 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6634084ad0 con 0x7f663c156180 2023-07-06T21:43:08.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.722+0000 7f663b7fe640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f661c066280 0x7f661c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:08.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.722+0000 7f663b7fe640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f661c066280 0x7f661c068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f663c06e740 tx=0x7f662c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:08.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.722+0000 7f6638ff9640 1 -- 172.21.15.55:0/836323776 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f663c1505b0 con 0x7f663c156180 2023-07-06T21:43:08.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.894+0000 7f6641b37640 1 -- 172.21.15.55:0/836323776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f663c1505b0 con 0x7f663c156180 2023-07-06T21:43:08.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.894+0000 7f6638ff9640 1 -- 172.21.15.55:0/836323776 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f663c1505b0 con 0x7f663c156180 2023-07-06T21:43:08.900 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2023-07-06T21:43:08.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.894+0000 7f6641b37640 1 -- 172.21.15.55:0/836323776 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f661c066280 msgr2=0x7f661c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.894+0000 7f6641b37640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f661c066280 0x7f661c068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f663c06e740 tx=0x7f662c009040 comp rx=0 tx=0).stop 2023-07-06T21:43:08.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.894+0000 7f6641b37640 1 -- 172.21.15.55:0/836323776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c156180 msgr2=0x7f663c1f7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:08.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.894+0000 7f6641b37640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c156180 0x7f663c1f7840 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f663400cf20 tx=0x7f663400a7d0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.894+0000 7f6641b37640 1 -- 172.21.15.55:0/836323776 shutdown_connections 2023-07-06T21:43:08.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.894+0000 7f6641b37640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f661c066280 0x7f661c068730 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.894+0000 7f6641b37640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c156180 0x7f663c1f7840 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.894+0000 7f6641b37640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cb7a0 0x7f663c1f7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.894+0000 7f6641b37640 1 --2- 172.21.15.55:0/836323776 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f663c06f0e0 0x7f663c0b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:08.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.894+0000 7f6641b37640 1 -- 172.21.15.55:0/836323776 >> 172.21.15.55:0/836323776 conn(0x7f663c0d0c50 msgr2=0x7f663c151470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:08.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.894+0000 7f6641b37640 1 -- 172.21.15.55:0/836323776 shutdown_connections 2023-07-06T21:43:08.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:08.894+0000 7f6641b37640 1 -- 172.21.15.55:0/836323776 wait complete. 2023-07-06T21:43:08.921 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-06T21:43:08.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:08.922 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-06T21:43:08.987 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T21:43:08.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:08.988 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-06T21:43:08.997 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:43:08.998 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:43:09.007 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:43:09.008 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:43:09.058 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:43:09.059 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:43:09.115 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:43:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.250+0000 7f3061893640 1 Processor -- start 2023-07-06T21:43:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.250+0000 7f3061893640 1 -- start start 2023-07-06T21:43:09.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.250+0000 7f3061893640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f305c0ce610 0x7f305c0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.250+0000 7f3061893640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305c0cd1c0 con 0x7f305c0b7cd0 2023-07-06T21:43:09.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.250+0000 7f3061893640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305c0b2270 con 0x7f305c0b1e10 2023-07-06T21:43:09.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.250+0000 7f3061893640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305c0d2310 con 0x7f305c0ce610 2023-07-06T21:43:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.250+0000 7f305affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f305c0b7cd0 0x7f305c0ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52748/0 (socket says 172.21.15.55:52748) 2023-07-06T21:43:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.250+0000 7f305affd640 1 -- 172.21.15.55:0/882064729 learned_addr learned my addr 172.21.15.55:0/882064729 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.250+0000 7f3053fff640 1 --2- 172.21.15.55:0/882064729 >> v2:172.21.15.55:3300/0 conn(0x7f305c0ce610 0x7f305c0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.250+0000 7f3053fff640 1 -- 172.21.15.55:0/882064729 >> v1:172.21.15.138:6789/0 conn(0x7f305c0b1e10 legacy=0x7f305c15f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:09.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.250+0000 7f3053fff640 1 -- 172.21.15.55:0/882064729 >> v1:172.21.15.55:6789/0 conn(0x7f305c0b7cd0 legacy=0x7f305c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.250+0000 7f305a7fc640 1 -- 172.21.15.55:0/882064729 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325669930 0 0) 0x7f305c0cd1c0 con 0x7f305c0b7cd0 2023-07-06T21:43:09.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.250+0000 7f3053fff640 1 -- 172.21.15.55:0/882064729 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c0cecf0 con 0x7f305c0ce610 2023-07-06T21:43:09.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.254+0000 7f3053fff640 1 --2- 172.21.15.55:0/882064729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305c0ce610 0x7f305c0b18d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f30440097c0 tx=0x7f304401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7f84cbc7d33411 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.254+0000 7f305a7fc640 1 -- 172.21.15.55:0/882064729 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440ab600 con 0x7f305c0ce610 2023-07-06T21:43:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.254+0000 7f305a7fc640 1 -- 172.21.15.55:0/882064729 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30440a7050 con 0x7f305c0ce610 2023-07-06T21:43:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.254+0000 7f305a7fc640 1 -- 172.21.15.55:0/882064729 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440ab980 con 0x7f305c0ce610 2023-07-06T21:43:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.254+0000 7f3061893640 1 -- 172.21.15.55:0/882064729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305c0ce610 msgr2=0x7f305c0b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.254+0000 7f3061893640 1 --2- 172.21.15.55:0/882064729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305c0ce610 0x7f305c0b18d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f30440097c0 tx=0x7f304401c3b0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.254+0000 7f3061893640 1 -- 172.21.15.55:0/882064729 shutdown_connections 2023-07-06T21:43:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.254+0000 7f3061893640 1 --2- 172.21.15.55:0/882064729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305c0ce610 0x7f305c0b18d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.254+0000 7f3061893640 1 -- 172.21.15.55:0/882064729 >> 172.21.15.55:0/882064729 conn(0x7f305c0ceee0 msgr2=0x7f305c0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.254+0000 7f3061893640 1 -- 172.21.15.55:0/882064729 shutdown_connections 2023-07-06T21:43:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.254+0000 7f3061893640 1 -- 172.21.15.55:0/882064729 wait complete. 2023-07-06T21:43:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3061893640 1 Processor -- start 2023-07-06T21:43:09.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3061893640 1 -- start start 2023-07-06T21:43:09.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3061893640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f305c0b1e10 0x7f305c147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3061893640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305c0b7cd0 0x7f305c149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3061893640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f305c0ce610 0x7f305c0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3061893640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c155dc0 con 0x7f305c0b7cd0 2023-07-06T21:43:09.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3061893640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c14c1b0 con 0x7f305c0ce610 2023-07-06T21:43:09.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3061893640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305c14c490 con 0x7f305c0b1e10 2023-07-06T21:43:09.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3053fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305c0b7cd0 0x7f305c149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3053fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305c0b7cd0 0x7f305c149960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35960/0 (socket says 172.21.15.55:35960) 2023-07-06T21:43:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3053fff640 1 -- 172.21.15.55:0/2666549826 learned_addr learned my addr 172.21.15.55:0/2666549826 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f305affd640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f305c0b1e10 0x7f305c147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3053fff640 1 -- 172.21.15.55:0/2666549826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f305c0b1e10 msgr2=0x7f305c147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f305b7fe640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f305c0ce610 0x7f305c0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3053fff640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f305c0b1e10 0x7f305c147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3053fff640 1 -- 172.21.15.55:0/2666549826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f305c0ce610 msgr2=0x7f305c0b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3053fff640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f305c0ce610 0x7f305c0b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3053fff640 1 -- 172.21.15.55:0/2666549826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3044009420 con 0x7f305c0b7cd0 2023-07-06T21:43:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f305affd640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f305c0b1e10 0x7f305c147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f305b7fe640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f305c0ce610 0x7f305c0b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3053fff640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305c0b7cd0 0x7f305c149960 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3044018fc0 tx=0x7f304401abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3058ff9640 1 -- 172.21.15.55:0/2666549826 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440b7650 con 0x7f305c0b7cd0 2023-07-06T21:43:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3058ff9640 1 -- 172.21.15.55:0/2666549826 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30440abe90 con 0x7f305c0b7cd0 2023-07-06T21:43:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3058ff9640 1 -- 172.21.15.55:0/2666549826 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440b7a10 con 0x7f305c0b7cd0 2023-07-06T21:43:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3061893640 1 -- 172.21.15.55:0/2666549826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305c155520 con 0x7f305c0b7cd0 2023-07-06T21:43:09.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.258+0000 7f3061893640 1 -- 172.21.15.55:0/2666549826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305c155ae0 con 0x7f305c0b7cd0 2023-07-06T21:43:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.262+0000 7f3061893640 1 -- 172.21.15.55:0/2666549826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305c066d60 con 0x7f305c0b7cd0 2023-07-06T21:43:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.262+0000 7f3058ff9640 1 -- 172.21.15.55:0/2666549826 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f30440b7b70 con 0x7f305c0b7cd0 2023-07-06T21:43:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.262+0000 7f3058ff9640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f303c066280 0x7f303c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.262+0000 7f3058ff9640 1 -- 172.21.15.55:0/2666549826 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f30440a4e40 con 0x7f305c0b7cd0 2023-07-06T21:43:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.262+0000 7f305affd640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f303c066280 0x7f303c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.262+0000 7f305affd640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f303c066280 0x7f303c068730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f304c000f70 tx=0x7f304c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:09.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.266+0000 7f3058ff9640 1 -- 172.21.15.55:0/2666549826 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30440eb9d0 con 0x7f305c0b7cd0 2023-07-06T21:43:09.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.422+0000 7f3061893640 1 -- 172.21.15.55:0/2666549826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f305c160790 con 0x7f305c0b7cd0 2023-07-06T21:43:09.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.426+0000 7f3058ff9640 1 -- 172.21.15.55:0/2666549826 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f305c160790 con 0x7f305c0b7cd0 2023-07-06T21:43:09.432 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:09.432 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":29,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:51.480379+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:43:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.426+0000 7f3061893640 1 -- 172.21.15.55:0/2666549826 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f303c066280 msgr2=0x7f303c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.426+0000 7f3061893640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f303c066280 0x7f303c068730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f304c000f70 tx=0x7f304c009040 comp rx=0 tx=0).stop 2023-07-06T21:43:09.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.426+0000 7f3061893640 1 -- 172.21.15.55:0/2666549826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305c0b7cd0 msgr2=0x7f305c149960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.426+0000 7f3061893640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305c0b7cd0 0x7f305c149960 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3044018fc0 tx=0x7f304401abf0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.426+0000 7f3061893640 1 -- 172.21.15.55:0/2666549826 shutdown_connections 2023-07-06T21:43:09.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.426+0000 7f3061893640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f303c066280 0x7f303c068730 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.426+0000 7f3061893640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f305c0ce610 0x7f305c0b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.426+0000 7f3061893640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305c0b7cd0 0x7f305c149960 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.426+0000 7f3061893640 1 --2- 172.21.15.55:0/2666549826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f305c0b1e10 0x7f305c147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.426+0000 7f3061893640 1 -- 172.21.15.55:0/2666549826 >> 172.21.15.55:0/2666549826 conn(0x7f305c0ceee0 msgr2=0x7f305c06a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:09.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.426+0000 7f3061893640 1 -- 172.21.15.55:0/2666549826 shutdown_connections 2023-07-06T21:43:09.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.426+0000 7f3061893640 1 -- 172.21.15.55:0/2666549826 wait complete. 2023-07-06T21:43:09.453 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:42:08.597013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:42:09.843890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T21:42:12.918111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T21:43:09.454 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:43:09.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.594+0000 7f5ddb9fa640 1 Processor -- start 2023-07-06T21:43:09.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.594+0000 7f5ddb9fa640 1 -- start start 2023-07-06T21:43:09.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.594+0000 7f5ddb9fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5dd4069db0 0x7f5dd40c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.594+0000 7f5ddb9fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd406c9e0 con 0x7f5dd40cbd50 2023-07-06T21:43:09.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.594+0000 7f5ddb9fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd406a290 con 0x7f5dd40cd510 2023-07-06T21:43:09.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.594+0000 7f5ddb9fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd406d080 con 0x7f5dd4069db0 2023-07-06T21:43:09.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.594+0000 7f5dd8f95640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5dd4069db0 0x7f5dd40c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.594+0000 7f5dd9f97640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5dd40cbd50 0x7f5dd40c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52758/0 (socket says 172.21.15.55:52758) 2023-07-06T21:43:09.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.594+0000 7f5dd9f97640 1 -- 172.21.15.55:0/2302501672 learned_addr learned my addr 172.21.15.55:0/2302501672 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:09.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.598+0000 7f5dd8f95640 1 -- 172.21.15.55:0/2302501672 >> v1:172.21.15.138:6789/0 conn(0x7f5dd40cd510 legacy=0x7f5dd40cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.598+0000 7f5dd8f95640 1 -- 172.21.15.55:0/2302501672 >> v1:172.21.15.55:6789/0 conn(0x7f5dd40cbd50 legacy=0x7f5dd40c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.598+0000 7f5dd8f95640 1 -- 172.21.15.55:0/2302501672 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd406a570 con 0x7f5dd4069db0 2023-07-06T21:43:09.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.598+0000 7f5dd8f95640 1 --2- 172.21.15.55:0/2302501672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dd4069db0 0x7f5dd40c87d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40097c0 tx=0x7f5dc401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705196ca37c0afd8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:09.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.598+0000 7f5dcbfff640 1 -- 172.21.15.55:0/2302501672 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40ab600 con 0x7f5dd4069db0 2023-07-06T21:43:09.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.598+0000 7f5dcbfff640 1 -- 172.21.15.55:0/2302501672 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc40a7050 con 0x7f5dd4069db0 2023-07-06T21:43:09.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.598+0000 7f5dcbfff640 1 -- 172.21.15.55:0/2302501672 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40ab980 con 0x7f5dd4069db0 2023-07-06T21:43:09.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.598+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/2302501672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dd4069db0 msgr2=0x7f5dd40c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.598+0000 7f5ddb9fa640 1 --2- 172.21.15.55:0/2302501672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dd4069db0 0x7f5dd40c87d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40097c0 tx=0x7f5dc401c3f0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.598+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/2302501672 shutdown_connections 2023-07-06T21:43:09.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.598+0000 7f5ddb9fa640 1 --2- 172.21.15.55:0/2302501672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dd4069db0 0x7f5dd40c87d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.598+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/2302501672 >> 172.21.15.55:0/2302501672 conn(0x7f5dd40afe60 msgr2=0x7f5dd40b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:09.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/2302501672 shutdown_connections 2023-07-06T21:43:09.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/2302501672 wait complete. 2023-07-06T21:43:09.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5ddb9fa640 1 Processor -- start 2023-07-06T21:43:09.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5ddb9fa640 1 -- start start 2023-07-06T21:43:09.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5ddb9fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dd4069db0 0x7f5dd4150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5ddb9fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dd40cbd50 0x7f5dd40c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5ddb9fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dd40cd510 0x7f5dd40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5ddb9fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40c6de0 con 0x7f5dd40cd510 2023-07-06T21:43:09.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5ddb9fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40ad300 con 0x7f5dd40cbd50 2023-07-06T21:43:09.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5ddb9fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40ad5e0 con 0x7f5dd4069db0 2023-07-06T21:43:09.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5dd9f97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dd40cd510 0x7f5dd40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5dd9f97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dd40cd510 0x7f5dd40ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35978/0 (socket says 172.21.15.55:35978) 2023-07-06T21:43:09.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5dd9f97640 1 -- 172.21.15.55:0/986439642 learned_addr learned my addr 172.21.15.55:0/986439642 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:09.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5dd8f95640 1 --2- 172.21.15.55:0/986439642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dd40cbd50 0x7f5dd40c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5dd9796640 1 --2- 172.21.15.55:0/986439642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dd4069db0 0x7f5dd4150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5dd9f97640 1 -- 172.21.15.55:0/986439642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dd4069db0 msgr2=0x7f5dd4150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5dd9f97640 1 --2- 172.21.15.55:0/986439642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dd4069db0 0x7f5dd4150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5dd9f97640 1 -- 172.21.15.55:0/986439642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dd40cbd50 msgr2=0x7f5dd40c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5dd9f97640 1 --2- 172.21.15.55:0/986439642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dd40cbd50 0x7f5dd40c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5dd9f97640 1 -- 172.21.15.55:0/986439642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc4009420 con 0x7f5dd40cd510 2023-07-06T21:43:09.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.602+0000 7f5dd9f97640 1 --2- 172.21.15.55:0/986439642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dd40cd510 0x7f5dd40ac8b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00cbc0 tx=0x7f5dcc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:09.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.606+0000 7f5dc9ffb640 1 -- 172.21.15.55:0/986439642 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00ad40 con 0x7f5dd40cd510 2023-07-06T21:43:09.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.606+0000 7f5dc9ffb640 1 -- 172.21.15.55:0/986439642 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc012400 con 0x7f5dd40cd510 2023-07-06T21:43:09.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.606+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/986439642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd415bda0 con 0x7f5dd40cd510 2023-07-06T21:43:09.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.606+0000 7f5dc9ffb640 1 -- 172.21.15.55:0/986439642 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00aea0 con 0x7f5dd40cd510 2023-07-06T21:43:09.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.606+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/986439642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd40c6a70 con 0x7f5dd40cd510 2023-07-06T21:43:09.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.606+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/986439642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd40c6f50 con 0x7f5dd40cd510 2023-07-06T21:43:09.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.606+0000 7f5dc9ffb640 1 -- 172.21.15.55:0/986439642 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5dcc007070 con 0x7f5dd40cd510 2023-07-06T21:43:09.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.606+0000 7f5dc9ffb640 1 --2- 172.21.15.55:0/986439642 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5db8066280 0x7f5db8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.606+0000 7f5dc9ffb640 1 -- 172.21.15.55:0/986439642 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5dcc083ff0 con 0x7f5dd40cd510 2023-07-06T21:43:09.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.606+0000 7f5dd9796640 1 --2- 172.21.15.55:0/986439642 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5db8066280 0x7f5db8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.610+0000 7f5dd9796640 1 --2- 172.21.15.55:0/986439642 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5db8066280 0x7f5db8068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0000f70 tx=0x7f5dd0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:09.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.610+0000 7f5dc9ffb640 1 -- 172.21.15.55:0/986439642 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5dcc051150 con 0x7f5dd40cd510 2023-07-06T21:43:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.766+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/986439642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5dd4066d60 con 0x7f5dd40cd510 2023-07-06T21:43:09.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.766+0000 7f5dc9ffb640 1 -- 172.21.15.55:0/986439642 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5dcc0170a0 con 0x7f5dd40cd510 2023-07-06T21:43:09.772 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:43:09.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.766+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/986439642 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5db8066280 msgr2=0x7f5db8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.766+0000 7f5ddb9fa640 1 --2- 172.21.15.55:0/986439642 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5db8066280 0x7f5db8068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0000f70 tx=0x7f5dd0009040 comp rx=0 tx=0).stop 2023-07-06T21:43:09.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.766+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/986439642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dd40cd510 msgr2=0x7f5dd40ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.766+0000 7f5ddb9fa640 1 --2- 172.21.15.55:0/986439642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dd40cd510 0x7f5dd40ac8b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00cbc0 tx=0x7f5dcc00a430 comp rx=0 tx=0).stop 2023-07-06T21:43:09.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.766+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/986439642 shutdown_connections 2023-07-06T21:43:09.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.766+0000 7f5ddb9fa640 1 --2- 172.21.15.55:0/986439642 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f5db8066280 0x7f5db8068730 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.766+0000 7f5ddb9fa640 1 --2- 172.21.15.55:0/986439642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dd40cd510 0x7f5dd40ac8b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.766+0000 7f5ddb9fa640 1 --2- 172.21.15.55:0/986439642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dd40cbd50 0x7f5dd40c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.766+0000 7f5ddb9fa640 1 --2- 172.21.15.55:0/986439642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dd4069db0 0x7f5dd4150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.766+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/986439642 >> 172.21.15.55:0/986439642 conn(0x7f5dd40afe60 msgr2=0x7f5dd406f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:09.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.766+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/986439642 shutdown_connections 2023-07-06T21:43:09.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.766+0000 7f5ddb9fa640 1 -- 172.21.15.55:0/986439642 wait complete. 2023-07-06T21:43:09.793 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:43:09.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.930+0000 7fd86df40640 1 Processor -- start 2023-07-06T21:43:09.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd86df40640 1 -- start start 2023-07-06T21:43:09.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd86df40640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8680ca610 0x7fd8680cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd86df40640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86815f5d0 con 0x7fd868156180 2023-07-06T21:43:09.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd86df40640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86815f8b0 con 0x7fd86806f0e0 2023-07-06T21:43:09.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd86df40640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd868160250 con 0x7fd8680ca610 2023-07-06T21:43:09.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8677fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd868156180 0x7fd86806e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52774/0 (socket says 172.21.15.55:52774) 2023-07-06T21:43:09.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8677fe640 1 -- 172.21.15.55:0/303307208 learned_addr learned my addr 172.21.15.55:0/303307208 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 -- 172.21.15.55:0/303307208 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166363590 0 0) 0x7fd86815f5d0 con 0x7fd868156180 2023-07-06T21:43:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd867fff640 1 --2- 172.21.15.55:0/303307208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8680ca610 0x7fd8680cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 -- 172.21.15.55:0/303307208 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd850003530 con 0x7fd868156180 2023-07-06T21:43:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 -- 172.21.15.55:0/303307208 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 245828518 0 0) 0x7fd850003530 con 0x7fd868156180 2023-07-06T21:43:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 -- 172.21.15.55:0/303307208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8680ca610 msgr2=0x7fd8680cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:09.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 --2- 172.21.15.55:0/303307208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8680ca610 0x7fd8680cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 -- 172.21.15.55:0/303307208 >> v1:172.21.15.138:6789/0 conn(0x7fd86806f0e0 legacy=0x7fd8680cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 -- 172.21.15.55:0/303307208 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86815fb90 con 0x7fd868156180 2023-07-06T21:43:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 -- 172.21.15.55:0/303307208 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fd858001680 con 0x7fd868156180 2023-07-06T21:43:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 -- 172.21.15.55:0/303307208 >> v1:172.21.15.55:6789/0 conn(0x7fd868156180 legacy=0x7fd86806e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 --2- 172.21.15.55:0/303307208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8500039b0 0x7fd850003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 --2- 172.21.15.55:0/303307208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8500047d0 0x7fd850004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 --2- 172.21.15.55:0/303307208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8680ca610 0x7fd8500051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 -- 172.21.15.55:0/303307208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd868160250 con 0x7fd8500039b0 2023-07-06T21:43:09.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 -- 172.21.15.55:0/303307208 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85000ba90 con 0x7fd8500047d0 2023-07-06T21:43:09.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8667fc640 1 -- 172.21.15.55:0/303307208 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85000bc50 con 0x7fd8680ca610 2023-07-06T21:43:09.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8677fe640 1 --2- 172.21.15.55:0/303307208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8500039b0 0x7fd850003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd866ffd640 1 --2- 172.21.15.55:0/303307208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8500047d0 0x7fd850004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd867fff640 1 --2- 172.21.15.55:0/303307208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8680ca610 0x7fd8500051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8677fe640 1 -- 172.21.15.55:0/303307208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8680ca610 msgr2=0x7fd8500051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:09.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8677fe640 1 --2- 172.21.15.55:0/303307208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8680ca610 0x7fd8500051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8677fe640 1 -- 172.21.15.55:0/303307208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8500047d0 msgr2=0x7fd850004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:09.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8677fe640 1 --2- 172.21.15.55:0/303307208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8500047d0 0x7fd850004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.934+0000 7fd8677fe640 1 -- 172.21.15.55:0/303307208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd850003530 con 0x7fd8500039b0 2023-07-06T21:43:09.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.938+0000 7fd8677fe640 1 --2- 172.21.15.55:0/303307208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8500039b0 0x7fd850003dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd85800c240 tx=0x7fd85801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c964c830c9a7c06 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:09.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.938+0000 7fd8667fc640 1 -- 172.21.15.55:0/303307208 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8580a5b00 con 0x7fd8500039b0 2023-07-06T21:43:09.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.938+0000 7fd8667fc640 1 -- 172.21.15.55:0/303307208 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8580a5c60 con 0x7fd8500039b0 2023-07-06T21:43:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.938+0000 7fd8667fc640 1 -- 172.21.15.55:0/303307208 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858005b20 con 0x7fd8500039b0 2023-07-06T21:43:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.938+0000 7fd86df40640 1 -- 172.21.15.55:0/303307208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8500039b0 msgr2=0x7fd850003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.938+0000 7fd86df40640 1 --2- 172.21.15.55:0/303307208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8500039b0 0x7fd850003dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd85800c240 tx=0x7fd85801cc40 comp rx=0 tx=0).stop 2023-07-06T21:43:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.938+0000 7fd867fff640 1 -- 172.21.15.55:0/303307208 reap_dead start 2023-07-06T21:43:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.938+0000 7fd86df40640 1 -- 172.21.15.55:0/303307208 shutdown_connections 2023-07-06T21:43:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.938+0000 7fd86df40640 1 -- 172.21.15.55:0/303307208 >> 172.21.15.55:0/303307208 conn(0x7fd8680d0c50 msgr2=0x7fd8680cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:09.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.938+0000 7fd86df40640 1 -- 172.21.15.55:0/303307208 shutdown_connections 2023-07-06T21:43:09.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.938+0000 7fd86df40640 1 -- 172.21.15.55:0/303307208 wait complete. 2023-07-06T21:43:09.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd86df40640 1 Processor -- start 2023-07-06T21:43:09.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd86df40640 1 -- start start 2023-07-06T21:43:09.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd86df40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8500039b0 0x7fd868150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd86df40640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd86815cf50 0x7fd86815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd86df40640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd868158790 0x7fd868158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd86df40640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86815d900 con 0x7fd8500039b0 2023-07-06T21:43:09.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd86df40640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8681f8ff0 con 0x7fd868158790 2023-07-06T21:43:09.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd86df40640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd868150c90 con 0x7fd86815cf50 2023-07-06T21:43:09.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd8677fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8500039b0 0x7fd868150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd8677fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8500039b0 0x7fd868150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35994/0 (socket says 172.21.15.55:35994) 2023-07-06T21:43:09.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd8677fe640 1 -- 172.21.15.55:0/147881616 learned_addr learned my addr 172.21.15.55:0/147881616 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:09.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd867fff640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd868158790 0x7fd868158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd866ffd640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd86815cf50 0x7fd86815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd8677fe640 1 -- 172.21.15.55:0/147881616 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd86815cf50 msgr2=0x7fd86815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd8677fe640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd86815cf50 0x7fd86815d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd8677fe640 1 -- 172.21.15.55:0/147881616 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd868158790 msgr2=0x7fd868158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:09.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd8677fe640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd868158790 0x7fd868158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:09.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd8677fe640 1 -- 172.21.15.55:0/147881616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8681f8400 con 0x7fd8500039b0 2023-07-06T21:43:09.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd866ffd640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd86815cf50 0x7fd86815d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:09.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd867fff640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd868158790 0x7fd868158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:09.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd8677fe640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8500039b0 0x7fd868150750 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd85800c240 tx=0x7fd850005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:09.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd84ffff640 1 -- 172.21.15.55:0/147881616 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8580b4070 con 0x7fd8500039b0 2023-07-06T21:43:09.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd84ffff640 1 -- 172.21.15.55:0/147881616 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8580a59c0 con 0x7fd8500039b0 2023-07-06T21:43:09.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd84ffff640 1 -- 172.21.15.55:0/147881616 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858001640 con 0x7fd8500039b0 2023-07-06T21:43:09.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd86df40640 1 -- 172.21.15.55:0/147881616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8681f86c0 con 0x7fd8500039b0 2023-07-06T21:43:09.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.942+0000 7fd86df40640 1 -- 172.21.15.55:0/147881616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8681f8c80 con 0x7fd8500039b0 2023-07-06T21:43:09.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.946+0000 7fd86df40640 1 -- 172.21.15.55:0/147881616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd868066d60 con 0x7fd8500039b0 2023-07-06T21:43:09.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.946+0000 7fd84ffff640 1 -- 172.21.15.55:0/147881616 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd8580047f0 con 0x7fd8500039b0 2023-07-06T21:43:09.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.946+0000 7fd84ffff640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd854066280 0x7fd854068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:09.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.946+0000 7fd84ffff640 1 -- 172.21.15.55:0/147881616 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd85811dc70 con 0x7fd8500039b0 2023-07-06T21:43:09.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.946+0000 7fd866ffd640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd854066280 0x7fd854068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:09.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.946+0000 7fd866ffd640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd854066280 0x7fd854068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd85c007fd0 tx=0x7fd85c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:09.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:09.950+0000 7fd84ffff640 1 -- 172.21.15.55:0/147881616 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd8580eadb0 con 0x7fd8500039b0 2023-07-06T21:43:10.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.102+0000 7fd86df40640 1 -- 172.21.15.55:0/147881616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd8680cacb0 con 0x7fd8500039b0 2023-07-06T21:43:10.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.106+0000 7fd84ffff640 1 -- 172.21.15.55:0/147881616 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd8580ee3d0 con 0x7fd8500039b0 2023-07-06T21:43:10.112 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:43:10.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.106+0000 7fd86df40640 1 -- 172.21.15.55:0/147881616 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd854066280 msgr2=0x7fd854068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.106+0000 7fd86df40640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd854066280 0x7fd854068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd85c007fd0 tx=0x7fd85c009040 comp rx=0 tx=0).stop 2023-07-06T21:43:10.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.106+0000 7fd86df40640 1 -- 172.21.15.55:0/147881616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8500039b0 msgr2=0x7fd868150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.106+0000 7fd86df40640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8500039b0 0x7fd868150750 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd85800c240 tx=0x7fd850005800 comp rx=0 tx=0).stop 2023-07-06T21:43:10.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.106+0000 7fd86df40640 1 -- 172.21.15.55:0/147881616 shutdown_connections 2023-07-06T21:43:10.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.106+0000 7fd86df40640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd854066280 0x7fd854068730 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.106+0000 7fd86df40640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd868158790 0x7fd868158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.106+0000 7fd86df40640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd86815cf50 0x7fd86815d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.106+0000 7fd86df40640 1 --2- 172.21.15.55:0/147881616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8500039b0 0x7fd868150750 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.106+0000 7fd86df40640 1 -- 172.21.15.55:0/147881616 >> 172.21.15.55:0/147881616 conn(0x7fd8680d0c50 msgr2=0x7fd8680b2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:10.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.106+0000 7fd86df40640 1 -- 172.21.15.55:0/147881616 shutdown_connections 2023-07-06T21:43:10.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.106+0000 7fd86df40640 1 -- 172.21.15.55:0/147881616 wait complete. 2023-07-06T21:43:10.133 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:43:10.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.270+0000 7ff6a7737640 1 Processor -- start 2023-07-06T21:43:10.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.270+0000 7ff6a7737640 1 -- start start 2023-07-06T21:43:10.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a7737640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6a01597d0 0x7ff6a00ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a7737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a0070700 0x7ff6a00b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a7737640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a00cd490 con 0x7ff6a00cac10 2023-07-06T21:43:10.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a7737640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a00cb040 con 0x7ff6a01597d0 2023-07-06T21:43:10.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a7737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a015cf60 con 0x7ff6a0070700 2023-07-06T21:43:10.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a54d3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6a01597d0 0x7ff6a00ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a54d3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6a01597d0 0x7ff6a00ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35996/0 (socket says 172.21.15.55:35996) 2023-07-06T21:43:10.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a54d3640 1 -- 172.21.15.55:0/806798902 learned_addr learned my addr 172.21.15.55:0/806798902 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:10.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a4cd2640 1 --1- 172.21.15.55:0/806798902 >> v1:172.21.15.55:6789/0 conn(0x7ff6a00cac10 0x7ff6a006fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52784/0 (socket says 172.21.15.55:52784) 2023-07-06T21:43:10.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a54d3640 1 -- 172.21.15.55:0/806798902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a0070700 msgr2=0x7ff6a00b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:10.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a5cd4640 1 --2- 172.21.15.55:0/806798902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a0070700 0x7ff6a00b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a54d3640 1 --2- 172.21.15.55:0/806798902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a0070700 0x7ff6a00b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff697fff640 1 -- 172.21.15.55:0/806798902 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54824150 0 0) 0x7ff6a00cd490 con 0x7ff6a00cac10 2023-07-06T21:43:10.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a54d3640 1 -- 172.21.15.55:0/806798902 >> v1:172.21.15.55:6789/0 conn(0x7ff6a00cac10 legacy=0x7ff6a006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a54d3640 1 -- 172.21.15.55:0/806798902 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a00ccb60 con 0x7ff6a01597d0 2023-07-06T21:43:10.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.274+0000 7ff6a5cd4640 1 --2- 172.21.15.55:0/806798902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a0070700 0x7ff6a00b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:10.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.278+0000 7ff6a54d3640 1 --2- 172.21.15.55:0/806798902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a01597d0 0x7ff6a00ca6d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009870 tx=0x7ff69c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336ddb3b14f1481b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:10.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.278+0000 7ff697fff640 1 -- 172.21.15.55:0/806798902 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c0ab680 con 0x7ff6a01597d0 2023-07-06T21:43:10.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.278+0000 7ff697fff640 1 -- 172.21.15.55:0/806798902 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c0ab7e0 con 0x7ff6a01597d0 2023-07-06T21:43:10.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.278+0000 7ff697fff640 1 -- 172.21.15.55:0/806798902 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c0abb70 con 0x7ff6a01597d0 2023-07-06T21:43:10.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.278+0000 7ff6a7737640 1 -- 172.21.15.55:0/806798902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a01597d0 msgr2=0x7ff6a00ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.278+0000 7ff6a7737640 1 --2- 172.21.15.55:0/806798902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a01597d0 0x7ff6a00ca6d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009870 tx=0x7ff69c01c480 comp rx=0 tx=0).stop 2023-07-06T21:43:10.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.278+0000 7ff6a7737640 1 -- 172.21.15.55:0/806798902 shutdown_connections 2023-07-06T21:43:10.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.278+0000 7ff6a7737640 1 --2- 172.21.15.55:0/806798902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a0070700 0x7ff6a00b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.278+0000 7ff6a7737640 1 --2- 172.21.15.55:0/806798902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a01597d0 0x7ff6a00ca6d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.278+0000 7ff6a7737640 1 -- 172.21.15.55:0/806798902 >> 172.21.15.55:0/806798902 conn(0x7ff6a00cb970 msgr2=0x7ff6a00cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:10.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.278+0000 7ff6a7737640 1 -- 172.21.15.55:0/806798902 shutdown_connections 2023-07-06T21:43:10.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.278+0000 7ff6a7737640 1 -- 172.21.15.55:0/806798902 wait complete. 2023-07-06T21:43:10.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.278+0000 7ff6a7737640 1 Processor -- start 2023-07-06T21:43:10.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.278+0000 7ff6a7737640 1 -- start start 2023-07-06T21:43:10.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a7737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a0070700 0x7ff6a014cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a7737640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a00cac10 0x7ff6a01f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a7737640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6a0151350 0x7ff6a00c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a7737640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0151ab0 con 0x7ff6a00cac10 2023-07-06T21:43:10.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a7737640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a015a170 con 0x7ff6a0151350 2023-07-06T21:43:10.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a7737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a015a450 con 0x7ff6a0070700 2023-07-06T21:43:10.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a4cd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a00cac10 0x7ff6a01f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a4cd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a00cac10 0x7ff6a01f3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36006/0 (socket says 172.21.15.55:36006) 2023-07-06T21:43:10.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a4cd2640 1 -- 172.21.15.55:0/3203747401 learned_addr learned my addr 172.21.15.55:0/3203747401 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:10.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a5cd4640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6a0151350 0x7ff6a00c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a54d3640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a0070700 0x7ff6a014cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a4cd2640 1 -- 172.21.15.55:0/3203747401 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a0070700 msgr2=0x7ff6a014cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a4cd2640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a0070700 0x7ff6a014cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a4cd2640 1 -- 172.21.15.55:0/3203747401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6a0151350 msgr2=0x7ff6a00c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a4cd2640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6a0151350 0x7ff6a00c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a4cd2640 1 -- 172.21.15.55:0/3203747401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c0094d0 con 0x7ff6a00cac10 2023-07-06T21:43:10.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a5cd4640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6a0151350 0x7ff6a00c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:10.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a54d3640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a0070700 0x7ff6a014cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:10.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a4cd2640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a00cac10 0x7ff6a01f3570 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff6900011f0 tx=0x7ff69000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:10.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff695ffb640 1 -- 172.21.15.55:0/3203747401 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6900074e0 con 0x7ff6a00cac10 2023-07-06T21:43:10.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff695ffb640 1 -- 172.21.15.55:0/3203747401 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff690007640 con 0x7ff6a00cac10 2023-07-06T21:43:10.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff695ffb640 1 -- 172.21.15.55:0/3203747401 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff690004a10 con 0x7ff6a00cac10 2023-07-06T21:43:10.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a7737640 1 -- 172.21.15.55:0/3203747401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a015a730 con 0x7ff6a00cac10 2023-07-06T21:43:10.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a7737640 1 -- 172.21.15.55:0/3203747401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a014d4c0 con 0x7ff6a00cac10 2023-07-06T21:43:10.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff6a7737640 1 -- 172.21.15.55:0/3203747401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a00cd900 con 0x7ff6a00cac10 2023-07-06T21:43:10.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.282+0000 7ff695ffb640 1 -- 172.21.15.55:0/3203747401 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff690004b70 con 0x7ff6a00cac10 2023-07-06T21:43:10.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.286+0000 7ff695ffb640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff6840662b0 0x7ff684068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.286+0000 7ff695ffb640 1 -- 172.21.15.55:0/3203747401 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff690083210 con 0x7ff6a00cac10 2023-07-06T21:43:10.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.286+0000 7ff6a54d3640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff6840662b0 0x7ff684068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.286+0000 7ff6a54d3640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff6840662b0 0x7ff684068760 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0af000 tx=0x7ff69c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:10.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.290+0000 7ff695ffb640 1 -- 172.21.15.55:0/3203747401 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff6a00cd900 con 0x7ff6a00cac10 2023-07-06T21:43:10.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.446+0000 7ff6a7737640 1 -- 172.21.15.55:0/3203747401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6a00cd900 con 0x7ff6a00cac10 2023-07-06T21:43:10.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.446+0000 7ff695ffb640 1 -- 172.21.15.55:0/3203747401 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff6a00cd900 con 0x7ff6a00cac10 2023-07-06T21:43:10.452 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:43:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.446+0000 7ff6a7737640 1 -- 172.21.15.55:0/3203747401 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff6840662b0 msgr2=0x7ff684068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.446+0000 7ff6a7737640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff6840662b0 0x7ff684068760 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0af000 tx=0x7ff69c008040 comp rx=0 tx=0).stop 2023-07-06T21:43:10.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.446+0000 7ff6a7737640 1 -- 172.21.15.55:0/3203747401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a00cac10 msgr2=0x7ff6a01f3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.446+0000 7ff6a7737640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a00cac10 0x7ff6a01f3570 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff6900011f0 tx=0x7ff69000c9b0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.446+0000 7ff6a7737640 1 -- 172.21.15.55:0/3203747401 shutdown_connections 2023-07-06T21:43:10.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.446+0000 7ff6a7737640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff6840662b0 0x7ff684068760 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.446+0000 7ff6a7737640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6a0151350 0x7ff6a00c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.446+0000 7ff6a7737640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a00cac10 0x7ff6a01f3570 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.446+0000 7ff6a7737640 1 --2- 172.21.15.55:0/3203747401 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6a0070700 0x7ff6a014cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.446+0000 7ff6a7737640 1 -- 172.21.15.55:0/3203747401 >> 172.21.15.55:0/3203747401 conn(0x7ff6a00cb970 msgr2=0x7ff6a00cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:10.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.446+0000 7ff6a7737640 1 -- 172.21.15.55:0/3203747401 shutdown_connections 2023-07-06T21:43:10.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.446+0000 7ff6a7737640 1 -- 172.21.15.55:0/3203747401 wait complete. 2023-07-06T21:43:10.473 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:43:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f377e911640 1 Processor -- start 2023-07-06T21:43:10.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f377e911640 1 -- start start 2023-07-06T21:43:10.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f377e911640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f37780ad0c0 0x7f37780cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f377e911640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37780ccbb0 con 0x7f377809d510 2023-07-06T21:43:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f377e911640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37780cce90 con 0x7f377815ba30 2023-07-06T21:43:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f377e911640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37780c83a0 con 0x7f37780ad0c0 2023-07-06T21:43:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f37777fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f377809d510 0x7f37780c87f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52800/0 (socket says 172.21.15.55:52800) 2023-07-06T21:43:10.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f37777fe640 1 -- 172.21.15.55:0/487810563 learned_addr learned my addr 172.21.15.55:0/487810563 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:10.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f377ceae640 1 --2- 172.21.15.55:0/487810563 >> v2:172.21.15.138:3300/0 conn(0x7f37780ad0c0 0x7f37780cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490154749 0 0) 0x7f37780ccbb0 con 0x7f377809d510 2023-07-06T21:43:10.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3760003530 con 0x7f377809d510 2023-07-06T21:43:10.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662970638 0 0) 0x7f37780cce90 con 0x7f377815ba30 2023-07-06T21:43:10.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37780ccbb0 con 0x7f377815ba30 2023-07-06T21:43:10.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2305959932 0 0) 0x7f3760003530 con 0x7f377809d510 2023-07-06T21:43:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 >> v2:172.21.15.138:3300/0 conn(0x7f37780ad0c0 msgr2=0x7f37780cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 --2- 172.21.15.55:0/487810563 >> v2:172.21.15.138:3300/0 conn(0x7f37780ad0c0 0x7f37780cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 >> v1:172.21.15.138:6789/0 conn(0x7f377815ba30 legacy=0x7f377809ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37780cd170 con 0x7f377809d510 2023-07-06T21:43:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f376c001680 con 0x7f377809d510 2023-07-06T21:43:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 >> v1:172.21.15.55:6789/0 conn(0x7f377809d510 legacy=0x7f37780c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 --2- 172.21.15.55:0/487810563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3760003b10 0x7f3760003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 --2- 172.21.15.55:0/487810563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37600047d0 0x7f3760004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 --2- 172.21.15.55:0/487810563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3760005180 0x7f376000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37780c83a0 con 0x7f37600047d0 2023-07-06T21:43:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376000bfe0 con 0x7f3760003b10 2023-07-06T21:43:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376000c1a0 con 0x7f3760005180 2023-07-06T21:43:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f37777fe640 1 --2- 172.21.15.55:0/487810563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37600047d0 0x7f3760004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f3777fff640 1 --2- 172.21.15.55:0/487810563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3760003b10 0x7f3760003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.614+0000 7f377ceae640 1 --2- 172.21.15.55:0/487810563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3760005180 0x7f376000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f37777fe640 1 -- 172.21.15.55:0/487810563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3760005180 msgr2=0x7f376000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:10.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f37777fe640 1 --2- 172.21.15.55:0/487810563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3760005180 0x7f376000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f37777fe640 1 -- 172.21.15.55:0/487810563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3760003b10 msgr2=0x7f3760003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:10.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f37777fe640 1 --2- 172.21.15.55:0/487810563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3760003b10 0x7f3760003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f37777fe640 1 -- 172.21.15.55:0/487810563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760003530 con 0x7f37600047d0 2023-07-06T21:43:10.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f3777fff640 1 --2- 172.21.15.55:0/487810563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3760003b10 0x7f3760003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:10.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f377ceae640 1 -- 172.21.15.55:0/487810563 reap_dead start 2023-07-06T21:43:10.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f37777fe640 1 --2- 172.21.15.55:0/487810563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37600047d0 0x7f3760004c40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f377809d900 tx=0x7f376c01cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7409b3330182a503 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:10.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0058e0 con 0x7f37600047d0 2023-07-06T21:43:10.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c005a60 con 0x7f37600047d0 2023-07-06T21:43:10.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f3776ffd640 1 -- 172.21.15.55:0/487810563 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c005e50 con 0x7f37600047d0 2023-07-06T21:43:10.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f377e911640 1 -- 172.21.15.55:0/487810563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37600047d0 msgr2=0x7f3760004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f377e911640 1 --2- 172.21.15.55:0/487810563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37600047d0 0x7f3760004c40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f377809d900 tx=0x7f376c01cb40 comp rx=0 tx=0).stop 2023-07-06T21:43:10.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f377e911640 1 -- 172.21.15.55:0/487810563 shutdown_connections 2023-07-06T21:43:10.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f377e911640 1 --2- 172.21.15.55:0/487810563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37600047d0 0x7f3760004c40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f377e911640 1 -- 172.21.15.55:0/487810563 >> 172.21.15.55:0/487810563 conn(0x7f37780cea70 msgr2=0x7f37780ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:10.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f377e911640 1 -- 172.21.15.55:0/487810563 shutdown_connections 2023-07-06T21:43:10.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.618+0000 7f377e911640 1 -- 172.21.15.55:0/487810563 wait complete. 2023-07-06T21:43:10.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f377e911640 1 Processor -- start 2023-07-06T21:43:10.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f377e911640 1 -- start start 2023-07-06T21:43:10.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f377e911640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37600047d0 0x7f37780c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f377e911640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f377815c220 0x7f37781f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f377e911640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37781f5020 0x7f37780c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f377e911640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377815c6b0 con 0x7f37600047d0 2023-07-06T21:43:10.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f377e911640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377815c990 con 0x7f37781f5020 2023-07-06T21:43:10.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f377e911640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377815cc70 con 0x7f377815c220 2023-07-06T21:43:10.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f3777fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37600047d0 0x7f37780c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f3777fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37600047d0 0x7f37780c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36030/0 (socket says 172.21.15.55:36030) 2023-07-06T21:43:10.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f3777fff640 1 -- 172.21.15.55:0/3919818345 learned_addr learned my addr 172.21.15.55:0/3919818345 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:10.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f3777fff640 1 -- 172.21.15.55:0/3919818345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f377815c220 msgr2=0x7f37781f4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f3777fff640 1 --2- 172.21.15.55:0/3919818345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f377815c220 0x7f37781f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f3777fff640 1 -- 172.21.15.55:0/3919818345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37781f5020 msgr2=0x7f37780c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f3777fff640 1 --2- 172.21.15.55:0/3919818345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37781f5020 0x7f37780c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f3777fff640 1 -- 172.21.15.55:0/3919818345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377815cf50 con 0x7f37600047d0 2023-07-06T21:43:10.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f3777fff640 1 --2- 172.21.15.55:0/3919818345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37600047d0 0x7f37780c3710 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3768007860 tx=0x7f3768011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:10.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f3774ff9640 1 -- 172.21.15.55:0/3919818345 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376800fae0 con 0x7f37600047d0 2023-07-06T21:43:10.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f3774ff9640 1 -- 172.21.15.55:0/3919818345 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376800fc40 con 0x7f37600047d0 2023-07-06T21:43:10.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f3774ff9640 1 -- 172.21.15.55:0/3919818345 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768015410 con 0x7f37600047d0 2023-07-06T21:43:10.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.622+0000 7f377e911640 1 -- 172.21.15.55:0/3919818345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377815d230 con 0x7f37600047d0 2023-07-06T21:43:10.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.626+0000 7f377e911640 1 -- 172.21.15.55:0/3919818345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37780c3e20 con 0x7f37600047d0 2023-07-06T21:43:10.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.626+0000 7f377e911640 1 -- 172.21.15.55:0/3919818345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377815d420 con 0x7f37600047d0 2023-07-06T21:43:10.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.626+0000 7f3774ff9640 1 -- 172.21.15.55:0/3919818345 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3768015570 con 0x7f37600047d0 2023-07-06T21:43:10.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.626+0000 7f3774ff9640 1 --2- 172.21.15.55:0/3919818345 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3764066280 0x7f3764068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.626+0000 7f3774ff9640 1 -- 172.21.15.55:0/3919818345 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3768087430 con 0x7f37600047d0 2023-07-06T21:43:10.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.626+0000 7f37777fe640 1 --2- 172.21.15.55:0/3919818345 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3764066280 0x7f3764068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.626+0000 7f37777fe640 1 --2- 172.21.15.55:0/3919818345 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3764066280 0x7f3764068730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f376c0aa000 tx=0x7f376c001990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:10.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.630+0000 7f3774ff9640 1 -- 172.21.15.55:0/3919818345 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3768054570 con 0x7f37600047d0 2023-07-06T21:43:10.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.782+0000 7f377e911640 1 -- 172.21.15.55:0/3919818345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3778066d60 con 0x7f37600047d0 2023-07-06T21:43:10.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.782+0000 7f3774ff9640 1 -- 172.21.15.55:0/3919818345 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3768057b90 con 0x7f37600047d0 2023-07-06T21:43:10.791 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:43:10.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.786+0000 7f377e911640 1 -- 172.21.15.55:0/3919818345 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3764066280 msgr2=0x7f3764068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.786+0000 7f377e911640 1 --2- 172.21.15.55:0/3919818345 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3764066280 0x7f3764068730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f376c0aa000 tx=0x7f376c001990 comp rx=0 tx=0).stop 2023-07-06T21:43:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.786+0000 7f377e911640 1 -- 172.21.15.55:0/3919818345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37600047d0 msgr2=0x7f37780c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.786+0000 7f377e911640 1 --2- 172.21.15.55:0/3919818345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37600047d0 0x7f37780c3710 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3768007860 tx=0x7f3768011d60 comp rx=0 tx=0).stop 2023-07-06T21:43:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.786+0000 7f377e911640 1 -- 172.21.15.55:0/3919818345 shutdown_connections 2023-07-06T21:43:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.786+0000 7f377e911640 1 --2- 172.21.15.55:0/3919818345 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f3764066280 0x7f3764068730 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.786+0000 7f377e911640 1 --2- 172.21.15.55:0/3919818345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37781f5020 0x7f37780c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.786+0000 7f377e911640 1 --2- 172.21.15.55:0/3919818345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f377815c220 0x7f37781f4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.786+0000 7f377e911640 1 --2- 172.21.15.55:0/3919818345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37600047d0 0x7f37780c3710 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.786+0000 7f377e911640 1 -- 172.21.15.55:0/3919818345 >> 172.21.15.55:0/3919818345 conn(0x7f37780cea70 msgr2=0x7f3778070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:10.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.786+0000 7f377e911640 1 -- 172.21.15.55:0/3919818345 shutdown_connections 2023-07-06T21:43:10.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.786+0000 7f377e911640 1 -- 172.21.15.55:0/3919818345 wait complete. 2023-07-06T21:43:10.812 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T21:43:10.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.954+0000 7fd5bc0d8640 1 Processor -- start 2023-07-06T21:43:10.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.954+0000 7fd5bc0d8640 1 -- start start 2023-07-06T21:43:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.954+0000 7fd5bc0d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5b406f840 0x7fd5b406fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.954+0000 7fd5bc0d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b40cb9b0 0x7fd5b40cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.954+0000 7fd5bc0d8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b4158550 con 0x7fd5b406f470 2023-07-06T21:43:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.954+0000 7fd5bc0d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b40c9530 con 0x7fd5b406f840 2023-07-06T21:43:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.954+0000 7fd5bc0d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b40c9800 con 0x7fd5b40cb9b0 2023-07-06T21:43:10.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.958+0000 7fd5b9673640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5b406f840 0x7fd5b406fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.958+0000 7fd5b9673640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5b406f840 0x7fd5b406fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36044/0 (socket says 172.21.15.55:36044) 2023-07-06T21:43:10.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.958+0000 7fd5b9673640 1 -- 172.21.15.55:0/1807631644 learned_addr learned my addr 172.21.15.55:0/1807631644 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:10.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.958+0000 7fd5ba675640 1 --2- 172.21.15.55:0/1807631644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b40cb9b0 0x7fd5b40cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.958+0000 7fd5b9673640 1 -- 172.21.15.55:0/1807631644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b40cb9b0 msgr2=0x7fd5b40cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:10.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.958+0000 7fd5b9673640 1 --2- 172.21.15.55:0/1807631644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b40cb9b0 0x7fd5b40cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.958+0000 7fd5b9673640 1 -- 172.21.15.55:0/1807631644 >> v1:172.21.15.138:6789/0 conn(0x7fd5b406f470 legacy=0x7fd5b40c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:10.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.958+0000 7fd5b9673640 1 -- 172.21.15.55:0/1807631644 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b40c9ae0 con 0x7fd5b406f840 2023-07-06T21:43:10.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.958+0000 7fd5b9673640 1 --2- 172.21.15.55:0/1807631644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5b406f840 0x7fd5b406fce0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4006fd0 tx=0x7fd5a401e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cae3d8dd41462e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:10.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.958+0000 7fd5b8e72640 1 -- 172.21.15.55:0/1807631644 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4004230 con 0x7fd5b406f840 2023-07-06T21:43:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.958+0000 7fd5b8e72640 1 -- 172.21.15.55:0/1807631644 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a40ab070 con 0x7fd5b406f840 2023-07-06T21:43:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.958+0000 7fd5b8e72640 1 -- 172.21.15.55:0/1807631644 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40a7770 con 0x7fd5b406f840 2023-07-06T21:43:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1807631644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5b406f840 msgr2=0x7fd5b406fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 --2- 172.21.15.55:0/1807631644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5b406f840 0x7fd5b406fce0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4006fd0 tx=0x7fd5a401e960 comp rx=0 tx=0).stop 2023-07-06T21:43:10.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1807631644 shutdown_connections 2023-07-06T21:43:10.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 --2- 172.21.15.55:0/1807631644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b40cb9b0 0x7fd5b40cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 --2- 172.21.15.55:0/1807631644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5b406f840 0x7fd5b406fce0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1807631644 >> 172.21.15.55:0/1807631644 conn(0x7fd5b40cea70 msgr2=0x7fd5b40ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:10.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1807631644 shutdown_connections 2023-07-06T21:43:10.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1807631644 wait complete. 2023-07-06T21:43:10.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 Processor -- start 2023-07-06T21:43:10.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 -- start start 2023-07-06T21:43:10.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5b406f470 0x7fd5b41547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b406f840 0x7fd5b41540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b40cb9b0 0x7fd5b40c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4154630 con 0x7fd5b406f470 2023-07-06T21:43:10.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4155270 con 0x7fd5b406f840 2023-07-06T21:43:10.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5bc0d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b40adf50 con 0x7fd5b40cb9b0 2023-07-06T21:43:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5b9e74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5b406f470 0x7fd5b41547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5b9e74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5b406f470 0x7fd5b41547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36046/0 (socket says 172.21.15.55:36046) 2023-07-06T21:43:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5b9e74640 1 -- 172.21.15.55:0/1090366871 learned_addr learned my addr 172.21.15.55:0/1090366871 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5b9673640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b406f840 0x7fd5b41540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5ba675640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b40cb9b0 0x7fd5b40c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5b9e74640 1 -- 172.21.15.55:0/1090366871 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b40cb9b0 msgr2=0x7fd5b40c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5b9e74640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b40cb9b0 0x7fd5b40c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5b9e74640 1 -- 172.21.15.55:0/1090366871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b406f840 msgr2=0x7fd5b41540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.962+0000 7fd5b9e74640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b406f840 0x7fd5b41540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.966+0000 7fd5b9e74640 1 -- 172.21.15.55:0/1090366871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a400b780 con 0x7fd5b406f470 2023-07-06T21:43:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.966+0000 7fd5b9673640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b406f840 0x7fd5b41540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.966+0000 7fd5b9e74640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5b406f470 0x7fd5b41547d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000b440 tx=0x7fd5b000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.966+0000 7fd5aa7fc640 1 -- 172.21.15.55:0/1090366871 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0011890 con 0x7fd5b406f470 2023-07-06T21:43:10.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.966+0000 7fd5aa7fc640 1 -- 172.21.15.55:0/1090366871 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b00119f0 con 0x7fd5b406f470 2023-07-06T21:43:10.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.966+0000 7fd5aa7fc640 1 -- 172.21.15.55:0/1090366871 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0011da0 con 0x7fd5b406f470 2023-07-06T21:43:10.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.966+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1090366871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b40ae210 con 0x7fd5b406f470 2023-07-06T21:43:10.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.966+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1090366871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b41554c0 con 0x7fd5b406f470 2023-07-06T21:43:10.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.966+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1090366871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b4066d60 con 0x7fd5b406f470 2023-07-06T21:43:10.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.966+0000 7fd5aa7fc640 1 -- 172.21.15.55:0/1090366871 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5b001a400 con 0x7fd5b406f470 2023-07-06T21:43:10.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.966+0000 7fd5aa7fc640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd598066280 0x7fd598068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:10.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.966+0000 7fd5aa7fc640 1 -- 172.21.15.55:0/1090366871 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd5b0083f10 con 0x7fd5b406f470 2023-07-06T21:43:10.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.966+0000 7fd5b9673640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd598066280 0x7fd598068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:10.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.970+0000 7fd5b9673640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd598066280 0x7fd598068730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40b1000 tx=0x7fd5a40a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:10.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:10.970+0000 7fd5aa7fc640 1 -- 172.21.15.55:0/1090366871 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5b0051100 con 0x7fd5b406f470 2023-07-06T21:43:11.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.126+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1090366871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd5b40cd240 con 0x7fd5b406f470 2023-07-06T21:43:11.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.126+0000 7fd5aa7fc640 1 -- 172.21.15.55:0/1090366871 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd5b0054720 con 0x7fd5b406f470 2023-07-06T21:43:11.133 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:43:11.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.126+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1090366871 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd598066280 msgr2=0x7fd598068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:11.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.126+0000 7fd5bc0d8640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd598066280 0x7fd598068730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40b1000 tx=0x7fd5a40a9070 comp rx=0 tx=0).stop 2023-07-06T21:43:11.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.126+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1090366871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5b406f470 msgr2=0x7fd5b41547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:11.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.126+0000 7fd5bc0d8640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5b406f470 0x7fd5b41547d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000b440 tx=0x7fd5b000b900 comp rx=0 tx=0).stop 2023-07-06T21:43:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.126+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1090366871 shutdown_connections 2023-07-06T21:43:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.126+0000 7fd5bc0d8640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd598066280 0x7fd598068730 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.126+0000 7fd5bc0d8640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b40cb9b0 0x7fd5b40c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.126+0000 7fd5bc0d8640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b406f840 0x7fd5b41540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.126+0000 7fd5bc0d8640 1 --2- 172.21.15.55:0/1090366871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5b406f470 0x7fd5b41547d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.126+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1090366871 >> 172.21.15.55:0/1090366871 conn(0x7fd5b40cea70 msgr2=0x7fd5b4157640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:11.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.130+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1090366871 shutdown_connections 2023-07-06T21:43:11.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.130+0000 7fd5bc0d8640 1 -- 172.21.15.55:0/1090366871 wait complete. 2023-07-06T21:43:11.154 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T21:43:11.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.294+0000 7f34c0940640 1 Processor -- start 2023-07-06T21:43:11.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.294+0000 7f34c0940640 1 -- start start 2023-07-06T21:43:11.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34c0940640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34bc158850 0x7f34bc0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:11.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34c0940640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34bc070af0 0x7f34bc0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:11.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34c0940640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34bc158c20 con 0x7f34bc0ca130 2023-07-06T21:43:11.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34c0940640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34bc0b2aa0 con 0x7f34bc070af0 2023-07-06T21:43:11.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34c0940640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0c8db0 con 0x7f34bc158850 2023-07-06T21:43:11.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34bad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34bc070af0 0x7f34bc0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:11.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34bad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34bc070af0 0x7f34bc0ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36062/0 (socket says 172.21.15.55:36062) 2023-07-06T21:43:11.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34bad9d640 1 -- 172.21.15.55:0/965495431 learned_addr learned my addr 172.21.15.55:0/965495431 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:11.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34b9d9b640 1 --1- 172.21.15.55:0/965495431 >> v1:172.21.15.55:6789/0 conn(0x7f34bc0ca130 0x7f34bc0703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52812/0 (socket says 172.21.15.55:52812) 2023-07-06T21:43:11.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34ba59c640 1 --2- 172.21.15.55:0/965495431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34bc158850 0x7f34bc0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:11.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34bad9d640 1 -- 172.21.15.55:0/965495431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34bc158850 msgr2=0x7f34bc0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:11.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34bad9d640 1 --2- 172.21.15.55:0/965495431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34bc158850 0x7f34bc0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34bad9d640 1 -- 172.21.15.55:0/965495431 >> v1:172.21.15.55:6789/0 conn(0x7f34bc0ca130 legacy=0x7f34bc0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:11.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34bad9d640 1 -- 172.21.15.55:0/965495431 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0c9090 con 0x7f34bc070af0 2023-07-06T21:43:11.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.298+0000 7f34b959a640 1 -- 172.21.15.55:0/965495431 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150058071 0 0) 0x7f34bc158c20 con 0x7f34bc0ca130 2023-07-06T21:43:11.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.302+0000 7f34bad9d640 1 --2- 172.21.15.55:0/965495431 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34bc070af0 0x7f34bc0ccf70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f34b400d150 tx=0x7f34b4021400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274413faafe7a17c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:11.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.302+0000 7f34b959a640 1 -- 172.21.15.55:0/965495431 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b400b2d0 con 0x7f34bc070af0 2023-07-06T21:43:11.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.302+0000 7f34b959a640 1 -- 172.21.15.55:0/965495431 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b40ad050 con 0x7f34bc070af0 2023-07-06T21:43:11.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.302+0000 7f34b959a640 1 -- 172.21.15.55:0/965495431 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4009820 con 0x7f34bc070af0 2023-07-06T21:43:11.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.302+0000 7f34c0940640 1 -- 172.21.15.55:0/965495431 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34bc070af0 msgr2=0x7f34bc0ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:11.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.302+0000 7f34c0940640 1 --2- 172.21.15.55:0/965495431 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34bc070af0 0x7f34bc0ccf70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f34b400d150 tx=0x7f34b4021400 comp rx=0 tx=0).stop 2023-07-06T21:43:11.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.302+0000 7f34c0940640 1 -- 172.21.15.55:0/965495431 shutdown_connections 2023-07-06T21:43:11.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.302+0000 7f34c0940640 1 --2- 172.21.15.55:0/965495431 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34bc070af0 0x7f34bc0ccf70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.302+0000 7f34c0940640 1 --2- 172.21.15.55:0/965495431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34bc158850 0x7f34bc0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.302+0000 7f34c0940640 1 -- 172.21.15.55:0/965495431 >> 172.21.15.55:0/965495431 conn(0x7f34bc0cea70 msgr2=0x7f34bc0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:11.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.302+0000 7f34c0940640 1 -- 172.21.15.55:0/965495431 shutdown_connections 2023-07-06T21:43:11.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.302+0000 7f34c0940640 1 -- 172.21.15.55:0/965495431 wait complete. 2023-07-06T21:43:11.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.302+0000 7f34c0940640 1 Processor -- start 2023-07-06T21:43:11.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.302+0000 7f34c0940640 1 -- start start 2023-07-06T21:43:11.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34c0940640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34bc070af0 0x7f34bc0c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:11.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34c0940640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34bc0ca130 0x7f34bc0693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:11.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34c0940640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34bc158850 0x7f34bc156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:11.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34c0940640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc069930 con 0x7f34bc0ca130 2023-07-06T21:43:11.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34c0940640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc069c00 con 0x7f34bc070af0 2023-07-06T21:43:11.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34c0940640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc069ee0 con 0x7f34bc158850 2023-07-06T21:43:11.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34b9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34bc0ca130 0x7f34bc0693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:11.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34b9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34bc0ca130 0x7f34bc0693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36074/0 (socket says 172.21.15.55:36074) 2023-07-06T21:43:11.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34b9d9b640 1 -- 172.21.15.55:0/1779110969 learned_addr learned my addr 172.21.15.55:0/1779110969 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:11.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34bad9d640 1 --2- 172.21.15.55:0/1779110969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34bc158850 0x7f34bc156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:11.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34ba59c640 1 --2- 172.21.15.55:0/1779110969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34bc070af0 0x7f34bc0c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:11.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34b9d9b640 1 -- 172.21.15.55:0/1779110969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34bc158850 msgr2=0x7f34bc156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:11.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34b9d9b640 1 --2- 172.21.15.55:0/1779110969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34bc158850 0x7f34bc156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34b9d9b640 1 -- 172.21.15.55:0/1779110969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34bc070af0 msgr2=0x7f34bc0c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:11.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34b9d9b640 1 --2- 172.21.15.55:0/1779110969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34bc070af0 0x7f34bc0c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34b9d9b640 1 -- 172.21.15.55:0/1779110969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b400bd40 con 0x7f34bc0ca130 2023-07-06T21:43:11.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34b9d9b640 1 --2- 172.21.15.55:0/1779110969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34bc0ca130 0x7f34bc0693f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f34b00011f0 tx=0x7f34b000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:11.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34aaffd640 1 -- 172.21.15.55:0/1779110969 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b00074e0 con 0x7f34bc0ca130 2023-07-06T21:43:11.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34aaffd640 1 -- 172.21.15.55:0/1779110969 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b0007640 con 0x7f34bc0ca130 2023-07-06T21:43:11.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34aaffd640 1 -- 172.21.15.55:0/1779110969 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0004a10 con 0x7f34bc0ca130 2023-07-06T21:43:11.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34c0940640 1 -- 172.21.15.55:0/1779110969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34bc06a1c0 con 0x7f34bc0ca130 2023-07-06T21:43:11.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34c0940640 1 -- 172.21.15.55:0/1779110969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34bc06a780 con 0x7f34bc0ca130 2023-07-06T21:43:11.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34c0940640 1 -- 172.21.15.55:0/1779110969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34bc06a9a0 con 0x7f34bc0ca130 2023-07-06T21:43:11.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.306+0000 7f34aaffd640 1 -- 172.21.15.55:0/1779110969 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f34b0004b70 con 0x7f34bc0ca130 2023-07-06T21:43:11.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.310+0000 7f34aaffd640 1 --2- 172.21.15.55:0/1779110969 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f349c066280 0x7f349c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:11.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.310+0000 7f34aaffd640 1 -- 172.21.15.55:0/1779110969 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f34b0083270 con 0x7f34bc0ca130 2023-07-06T21:43:11.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.310+0000 7f34ba59c640 1 --2- 172.21.15.55:0/1779110969 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f349c066280 0x7f349c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:11.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.310+0000 7f34ba59c640 1 --2- 172.21.15.55:0/1779110969 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f349c066280 0x7f349c068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00b930 tx=0x7f34ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:11.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.314+0000 7f34aaffd640 1 -- 172.21.15.55:0/1779110969 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f34b0050460 con 0x7f34bc0ca130 2023-07-06T21:43:11.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.478+0000 7f34c0940640 1 -- 172.21.15.55:0/1779110969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f34bc066d60 con 0x7f34bc0ca130 2023-07-06T21:43:11.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.478+0000 7f34aaffd640 1 -- 172.21.15.55:0/1779110969 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f34b0018080 con 0x7f34bc0ca130 2023-07-06T21:43:11.487 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2023-07-06T21:43:11.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.482+0000 7f34c0940640 1 -- 172.21.15.55:0/1779110969 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f349c066280 msgr2=0x7f349c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:11.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.482+0000 7f34c0940640 1 --2- 172.21.15.55:0/1779110969 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f349c066280 0x7f349c068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00b930 tx=0x7f34ac008040 comp rx=0 tx=0).stop 2023-07-06T21:43:11.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.482+0000 7f34c0940640 1 -- 172.21.15.55:0/1779110969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34bc0ca130 msgr2=0x7f34bc0693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:11.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.482+0000 7f34c0940640 1 --2- 172.21.15.55:0/1779110969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34bc0ca130 0x7f34bc0693f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f34b00011f0 tx=0x7f34b000c9b0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.482+0000 7f34c0940640 1 -- 172.21.15.55:0/1779110969 shutdown_connections 2023-07-06T21:43:11.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.482+0000 7f34c0940640 1 --2- 172.21.15.55:0/1779110969 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f349c066280 0x7f349c068730 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.482+0000 7f34c0940640 1 --2- 172.21.15.55:0/1779110969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34bc158850 0x7f34bc156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.482+0000 7f34c0940640 1 --2- 172.21.15.55:0/1779110969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34bc0ca130 0x7f34bc0693f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.482+0000 7f34c0940640 1 --2- 172.21.15.55:0/1779110969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34bc070af0 0x7f34bc0c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.482+0000 7f34c0940640 1 -- 172.21.15.55:0/1779110969 >> 172.21.15.55:0/1779110969 conn(0x7f34bc0cea70 msgr2=0x7f34bc157c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:11.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.482+0000 7f34c0940640 1 -- 172.21.15.55:0/1779110969 shutdown_connections 2023-07-06T21:43:11.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.482+0000 7f34c0940640 1 -- 172.21.15.55:0/1779110969 wait complete. 2023-07-06T21:43:11.508 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-06T21:43:11.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:11.509 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-06T21:43:11.571 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2023-07-06T21:43:11.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:11.572 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-06T21:43:11.582 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-06T21:43:11.583 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:43:11.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.718+0000 7ff8ad974640 1 Processor -- start 2023-07-06T21:43:11.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.718+0000 7ff8ad974640 1 -- start start 2023-07-06T21:43:11.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8ad974640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff8a80712f0 0x7ff8a806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:11.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8ad974640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8a80ca450 0x7ff8a815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:11.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8ad974640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a8159cd0 con 0x7ff8a80b3730 2023-07-06T21:43:11.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8ad974640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a80693f0 con 0x7ff8a80712f0 2023-07-06T21:43:11.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8ad974640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a806aca0 con 0x7ff8a80ca450 2023-07-06T21:43:11.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff89ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff8a80b3730 0x7ff8a80c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52822/0 (socket says 172.21.15.55:52822) 2023-07-06T21:43:11.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff89ffff640 1 -- 172.21.15.55:0/3023517893 learned_addr learned my addr 172.21.15.55:0/3023517893 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:11.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8a6ffd640 1 --2- 172.21.15.55:0/3023517893 >> v2:172.21.15.138:3300/0 conn(0x7ff8a80712f0 0x7ff8a806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:11.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8a77fe640 1 --2- 172.21.15.55:0/3023517893 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8a80ca450 0x7ff8a815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:11.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8a67fc640 1 -- 172.21.15.55:0/3023517893 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454380605 0 0) 0x7ff8a8159cd0 con 0x7ff8a80b3730 2023-07-06T21:43:11.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8a67fc640 1 -- 172.21.15.55:0/3023517893 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff894003530 con 0x7ff8a80b3730 2023-07-06T21:43:11.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8a77fe640 1 -- 172.21.15.55:0/3023517893 >> v2:172.21.15.138:3300/0 conn(0x7ff8a80712f0 msgr2=0x7ff8a806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:11.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8a77fe640 1 --2- 172.21.15.55:0/3023517893 >> v2:172.21.15.138:3300/0 conn(0x7ff8a80712f0 0x7ff8a806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8a67fc640 1 -- 172.21.15.55:0/3023517893 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 171169344 0 0) 0x7ff894003530 con 0x7ff8a80b3730 2023-07-06T21:43:11.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8a77fe640 1 -- 172.21.15.55:0/3023517893 >> v1:172.21.15.55:6789/0 conn(0x7ff8a80b3730 legacy=0x7ff8a80c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:11.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8a77fe640 1 -- 172.21.15.55:0/3023517893 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a80696b0 con 0x7ff8a80ca450 2023-07-06T21:43:11.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.722+0000 7ff8a6ffd640 1 --2- 172.21.15.55:0/3023517893 >> v2:172.21.15.138:3300/0 conn(0x7ff8a80712f0 0x7ff8a806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:11.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.726+0000 7ff8a77fe640 1 --2- 172.21.15.55:0/3023517893 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8a80ca450 0x7ff8a815d3e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009d90 tx=0x7ff8a001c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34dab4bd31b5f0cb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:11.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.726+0000 7ff8a67fc640 1 -- 172.21.15.55:0/3023517893 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8900016a0 con 0x7ff8a80ca450 2023-07-06T21:43:11.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.726+0000 7ff8a67fc640 1 -- 172.21.15.55:0/3023517893 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a00a5640 con 0x7ff8a80ca450 2023-07-06T21:43:11.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.726+0000 7ff8a67fc640 1 -- 172.21.15.55:0/3023517893 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00a59d0 con 0x7ff8a80ca450 2023-07-06T21:43:11.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.726+0000 7ff8ad974640 1 -- 172.21.15.55:0/3023517893 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8a80ca450 msgr2=0x7ff8a815d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:11.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.726+0000 7ff8ad974640 1 --2- 172.21.15.55:0/3023517893 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8a80ca450 0x7ff8a815d3e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009d90 tx=0x7ff8a001c840 comp rx=0 tx=0).stop 2023-07-06T21:43:11.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.726+0000 7ff8ad974640 1 -- 172.21.15.55:0/3023517893 shutdown_connections 2023-07-06T21:43:11.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.726+0000 7ff8ad974640 1 --2- 172.21.15.55:0/3023517893 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8a80ca450 0x7ff8a815d3e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.726+0000 7ff8ad974640 1 --2- 172.21.15.55:0/3023517893 >> v2:172.21.15.138:3300/0 conn(0x7ff8a80712f0 0x7ff8a806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.726+0000 7ff8ad974640 1 -- 172.21.15.55:0/3023517893 >> 172.21.15.55:0/3023517893 conn(0x7ff8a80cded0 msgr2=0x7ff8a80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:11.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.726+0000 7ff8ad974640 1 -- 172.21.15.55:0/3023517893 shutdown_connections 2023-07-06T21:43:11.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.726+0000 7ff8ad974640 1 -- 172.21.15.55:0/3023517893 wait complete. 2023-07-06T21:43:11.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.726+0000 7ff8ad974640 1 Processor -- start 2023-07-06T21:43:11.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.726+0000 7ff8ad974640 1 -- start start 2023-07-06T21:43:11.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff8ad974640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8a80712f0 0x7ff8a814b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:11.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff8ad974640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8a80b3730 0x7ff8a815a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:11.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff8ad974640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8a80ca450 0x7ff8a815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:11.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff8ad974640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a80b12e0 con 0x7ff8a80b3730 2023-07-06T21:43:11.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff8ad974640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a815aba0 con 0x7ff8a80ca450 2023-07-06T21:43:11.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff8ad974640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a815cd70 con 0x7ff8a80712f0 2023-07-06T21:43:11.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8a80b3730 0x7ff8a815a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:11.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8a80b3730 0x7ff8a815a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36080/0 (socket says 172.21.15.55:36080) 2023-07-06T21:43:11.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff89ffff640 1 -- 172.21.15.55:0/791633700 learned_addr learned my addr 172.21.15.55:0/791633700 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:11.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff8a77fe640 1 --2- 172.21.15.55:0/791633700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8a80ca450 0x7ff8a815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:11.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff8a6ffd640 1 --2- 172.21.15.55:0/791633700 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8a80712f0 0x7ff8a814b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:11.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff89ffff640 1 -- 172.21.15.55:0/791633700 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8a80712f0 msgr2=0x7ff8a814b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:11.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff89ffff640 1 --2- 172.21.15.55:0/791633700 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8a80712f0 0x7ff8a814b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff89ffff640 1 -- 172.21.15.55:0/791633700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8a80ca450 msgr2=0x7ff8a815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:11.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff89ffff640 1 --2- 172.21.15.55:0/791633700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8a80ca450 0x7ff8a815bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff89ffff640 1 -- 172.21.15.55:0/791633700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff898009420 con 0x7ff8a80b3730 2023-07-06T21:43:11.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff89ffff640 1 --2- 172.21.15.55:0/791633700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8a80b3730 0x7ff8a815a660 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff89000c760 tx=0x7ff89000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:11.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff8a4ff9640 1 -- 172.21.15.55:0/791633700 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8900074e0 con 0x7ff8a80b3730 2023-07-06T21:43:11.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff8a4ff9640 1 -- 172.21.15.55:0/791633700 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff890007660 con 0x7ff8a80b3730 2023-07-06T21:43:11.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff8a4ff9640 1 -- 172.21.15.55:0/791633700 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890004a30 con 0x7ff8a80b3730 2023-07-06T21:43:11.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff8ad974640 1 -- 172.21.15.55:0/791633700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a0009a70 con 0x7ff8a80b3730 2023-07-06T21:43:11.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff8ad974640 1 -- 172.21.15.55:0/791633700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a815c7b0 con 0x7ff8a80b3730 2023-07-06T21:43:11.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.730+0000 7ff8ad974640 1 -- 172.21.15.55:0/791633700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a80b1420 con 0x7ff8a80b3730 2023-07-06T21:43:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.734+0000 7ff8a4ff9640 1 -- 172.21.15.55:0/791633700 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff890004b90 con 0x7ff8a80b3730 2023-07-06T21:43:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.734+0000 7ff8a4ff9640 1 --2- 172.21.15.55:0/791633700 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff888066280 0x7ff888068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.734+0000 7ff8a4ff9640 1 -- 172.21.15.55:0/791633700 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff890083500 con 0x7ff8a80b3730 2023-07-06T21:43:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.734+0000 7ff8a6ffd640 1 --2- 172.21.15.55:0/791633700 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff888066280 0x7ff888068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:11.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.734+0000 7ff8a6ffd640 1 --2- 172.21.15.55:0/791633700 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff888066280 0x7ff888068730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff898009be0 tx=0x7ff898008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:11.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.738+0000 7ff8a4ff9640 1 -- 172.21.15.55:0/791633700 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8a80b1420 con 0x7ff8a80b3730 2023-07-06T21:43:11.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.926+0000 7ff8ad974640 1 -- 172.21.15.55:0/791633700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8a80b1420 con 0x7ff8a80b3730 2023-07-06T21:43:11.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.926+0000 7ff8a4ff9640 1 -- 172.21.15.55:0/791633700 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4667 (secure 0 0 0) 0x7ff8a80b1420 con 0x7ff8a80b3730 2023-07-06T21:43:11.933 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:11.933 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/720785920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":720785920},{"type":"v1","addr":"172.21.15.138:6834","nonce":720785920}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3780018439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3780018439},{"type":"v1","addr":"172.21.15.138:6835","nonce":3780018439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/690984517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":690984517},{"type":"v1","addr":"172.21.15.55:6837","nonce":690984517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:42:10.854280+0000","modified":"2023-07-06T21:42:29.371982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/1421414378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1421414378},{"type":"v1","addr":"172.21.15.55:6836","nonce":1421414378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T21:43:11.934 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-07-06T21:43:11.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.926+0000 7ff8ad974640 1 -- 172.21.15.55:0/791633700 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff888066280 msgr2=0x7ff888068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:11.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.926+0000 7ff8ad974640 1 --2- 172.21.15.55:0/791633700 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff888066280 0x7ff888068730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff898009be0 tx=0x7ff898008040 comp rx=0 tx=0).stop 2023-07-06T21:43:11.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.926+0000 7ff8ad974640 1 -- 172.21.15.55:0/791633700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8a80b3730 msgr2=0x7ff8a815a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:11.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.926+0000 7ff8ad974640 1 --2- 172.21.15.55:0/791633700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8a80b3730 0x7ff8a815a660 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff89000c760 tx=0x7ff89000cc20 comp rx=0 tx=0).stop 2023-07-06T21:43:11.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.930+0000 7ff8ad974640 1 -- 172.21.15.55:0/791633700 shutdown_connections 2023-07-06T21:43:11.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.930+0000 7ff8ad974640 1 --2- 172.21.15.55:0/791633700 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff888066280 0x7ff888068730 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.930+0000 7ff8ad974640 1 --2- 172.21.15.55:0/791633700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8a80ca450 0x7ff8a815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.930+0000 7ff8ad974640 1 --2- 172.21.15.55:0/791633700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8a80b3730 0x7ff8a815a660 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.930+0000 7ff8ad974640 1 --2- 172.21.15.55:0/791633700 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8a80712f0 0x7ff8a814b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:11.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.930+0000 7ff8ad974640 1 -- 172.21.15.55:0/791633700 >> 172.21.15.55:0/791633700 conn(0x7ff8a80cded0 msgr2=0x7ff8a80cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:11.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.930+0000 7ff8ad974640 1 -- 172.21.15.55:0/791633700 shutdown_connections 2023-07-06T21:43:11.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:11.930+0000 7ff8ad974640 1 -- 172.21.15.55:0/791633700 wait complete. 2023-07-06T21:43:11.954 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:43:12.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a52e93640 1 Processor -- start 2023-07-06T21:43:12.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a52e93640 1 -- start start 2023-07-06T21:43:12.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a52e93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a4c0712f0 0x7f2a4c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a52e93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a4c0b3730 0x7f2a4c0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a52e93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c159cd0 con 0x7f2a4c0ca280 2023-07-06T21:43:12.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a52e93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c0ca700 con 0x7f2a4c0b3730 2023-07-06T21:43:12.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a52e93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0693f0 con 0x7f2a4c0712f0 2023-07-06T21:43:12.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a4bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a4c0b3730 0x7f2a4c0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a4bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a4c0b3730 0x7f2a4c0c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36096/0 (socket says 172.21.15.55:36096) 2023-07-06T21:43:12.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a4bfff640 1 -- 172.21.15.55:0/3004459914 learned_addr learned my addr 172.21.15.55:0/3004459914 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:12.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a51430640 1 --1- 172.21.15.55:0/3004459914 >> v1:172.21.15.55:6789/0 conn(0x7f2a4c0ca280 0x7f2a4c0c8520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52824/0 (socket says 172.21.15.55:52824) 2023-07-06T21:43:12.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a50c2f640 1 --2- 172.21.15.55:0/3004459914 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a4c0712f0 0x7f2a4c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a4bfff640 1 -- 172.21.15.55:0/3004459914 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a4c0712f0 msgr2=0x7f2a4c06a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:12.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a4bfff640 1 --2- 172.21.15.55:0/3004459914 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a4c0712f0 0x7f2a4c06a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a4bfff640 1 -- 172.21.15.55:0/3004459914 >> v1:172.21.15.55:6789/0 conn(0x7f2a4c0ca280 legacy=0x7f2a4c0c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a4bfff640 1 -- 172.21.15.55:0/3004459914 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c06aca0 con 0x7f2a4c0b3730 2023-07-06T21:43:12.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.090+0000 7f2a4b7fe640 1 -- 172.21.15.55:0/3004459914 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679588031 0 0) 0x7f2a4c159cd0 con 0x7f2a4c0ca280 2023-07-06T21:43:12.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.094+0000 7f2a4bfff640 1 --2- 172.21.15.55:0/3004459914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0b3730 0x7f2a4c0c9d40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009870 tx=0x7f2a3801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ba4987d17d4402 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:12.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.094+0000 7f2a4b7fe640 1 -- 172.21.15.55:0/3004459914 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a380a7070 con 0x7f2a4c0b3730 2023-07-06T21:43:12.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.094+0000 7f2a4b7fe640 1 -- 172.21.15.55:0/3004459914 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a380ab430 con 0x7f2a4c0b3730 2023-07-06T21:43:12.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.094+0000 7f2a4b7fe640 1 -- 172.21.15.55:0/3004459914 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a380ab7c0 con 0x7f2a4c0b3730 2023-07-06T21:43:12.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.094+0000 7f2a52e93640 1 -- 172.21.15.55:0/3004459914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0b3730 msgr2=0x7f2a4c0c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.094+0000 7f2a52e93640 1 --2- 172.21.15.55:0/3004459914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0b3730 0x7f2a4c0c9d40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009870 tx=0x7f2a3801c510 comp rx=0 tx=0).stop 2023-07-06T21:43:12.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.094+0000 7f2a52e93640 1 -- 172.21.15.55:0/3004459914 shutdown_connections 2023-07-06T21:43:12.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.094+0000 7f2a52e93640 1 --2- 172.21.15.55:0/3004459914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0b3730 0x7f2a4c0c9d40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.094+0000 7f2a52e93640 1 --2- 172.21.15.55:0/3004459914 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a4c0712f0 0x7f2a4c06a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.094+0000 7f2a52e93640 1 -- 172.21.15.55:0/3004459914 >> 172.21.15.55:0/3004459914 conn(0x7f2a4c0cded0 msgr2=0x7f2a4c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:12.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.094+0000 7f2a52e93640 1 -- 172.21.15.55:0/3004459914 shutdown_connections 2023-07-06T21:43:12.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.094+0000 7f2a52e93640 1 -- 172.21.15.55:0/3004459914 wait complete. 2023-07-06T21:43:12.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a52e93640 1 Processor -- start 2023-07-06T21:43:12.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a52e93640 1 -- start start 2023-07-06T21:43:12.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a52e93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a4c0712f0 0x7f2a4c145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a52e93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a4c0b3730 0x7f2a4c0c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a52e93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0ca280 0x7f2a4c0c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a52e93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c1458a0 con 0x7f2a4c0ca280 2023-07-06T21:43:12.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a52e93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0c5270 con 0x7f2a4c0712f0 2023-07-06T21:43:12.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a52e93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0c7ad0 con 0x7f2a4c0b3730 2023-07-06T21:43:12.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a51430640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0ca280 0x7f2a4c0c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a51430640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0ca280 0x7f2a4c0c34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36100/0 (socket says 172.21.15.55:36100) 2023-07-06T21:43:12.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a51430640 1 -- 172.21.15.55:0/2114409143 learned_addr learned my addr 172.21.15.55:0/2114409143 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:12.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a4bfff640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a4c0b3730 0x7f2a4c0c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a51430640 1 -- 172.21.15.55:0/2114409143 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a4c0b3730 msgr2=0x7f2a4c0c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a50c2f640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a4c0712f0 0x7f2a4c145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a51430640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a4c0b3730 0x7f2a4c0c18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a51430640 1 -- 172.21.15.55:0/2114409143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a4c0712f0 msgr2=0x7f2a4c145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a51430640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a4c0712f0 0x7f2a4c145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a51430640 1 -- 172.21.15.55:0/2114409143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a380094d0 con 0x7f2a4c0ca280 2023-07-06T21:43:12.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a4bfff640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a4c0b3730 0x7f2a4c0c18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:12.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a50c2f640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a4c0712f0 0x7f2a4c145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:12.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a51430640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0ca280 0x7f2a4c0c34a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400c780 tx=0x7f2a4400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:12.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a497fa640 1 -- 172.21.15.55:0/2114409143 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400ce90 con 0x7f2a4c0ca280 2023-07-06T21:43:12.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a497fa640 1 -- 172.21.15.55:0/2114409143 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4400a640 con 0x7f2a4c0ca280 2023-07-06T21:43:12.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a497fa640 1 -- 172.21.15.55:0/2114409143 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400a9d0 con 0x7f2a4c0ca280 2023-07-06T21:43:12.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a52e93640 1 -- 172.21.15.55:0/2114409143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c0c43b0 con 0x7f2a4c0ca280 2023-07-06T21:43:12.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.098+0000 7f2a52e93640 1 -- 172.21.15.55:0/2114409143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c0c4970 con 0x7f2a4c0ca280 2023-07-06T21:43:12.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.102+0000 7f2a52e93640 1 -- 172.21.15.55:0/2114409143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c066d60 con 0x7f2a4c0ca280 2023-07-06T21:43:12.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.102+0000 7f2a497fa640 1 -- 172.21.15.55:0/2114409143 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2a4400ab30 con 0x7f2a4c0ca280 2023-07-06T21:43:12.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.102+0000 7f2a497fa640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2a30066280 0x7f2a30068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.102+0000 7f2a497fa640 1 -- 172.21.15.55:0/2114409143 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2a44083670 con 0x7f2a4c0ca280 2023-07-06T21:43:12.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.102+0000 7f2a50c2f640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2a30066280 0x7f2a30068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.102+0000 7f2a50c2f640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2a30066280 0x7f2a30068730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009a40 tx=0x7f2a40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:12.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.106+0000 7f2a497fa640 1 -- 172.21.15.55:0/2114409143 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2a44050720 con 0x7f2a4c0ca280 2023-07-06T21:43:12.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.262+0000 7f2a52e93640 1 -- 172.21.15.55:0/2114409143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a4c0c53b0 con 0x7f2a4c0ca280 2023-07-06T21:43:12.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.262+0000 7f2a497fa640 1 -- 172.21.15.55:0/2114409143 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f2a44053d40 con 0x7f2a4c0ca280 2023-07-06T21:43:12.270 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:12.271 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":29,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:51.480379+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:43:12.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.266+0000 7f2a52e93640 1 -- 172.21.15.55:0/2114409143 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2a30066280 msgr2=0x7f2a30068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.266+0000 7f2a52e93640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2a30066280 0x7f2a30068730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009a40 tx=0x7f2a40008040 comp rx=0 tx=0).stop 2023-07-06T21:43:12.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.266+0000 7f2a52e93640 1 -- 172.21.15.55:0/2114409143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0ca280 msgr2=0x7f2a4c0c34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.266+0000 7f2a52e93640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0ca280 0x7f2a4c0c34a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400c780 tx=0x7f2a4400cc40 comp rx=0 tx=0).stop 2023-07-06T21:43:12.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.266+0000 7f2a52e93640 1 -- 172.21.15.55:0/2114409143 shutdown_connections 2023-07-06T21:43:12.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.266+0000 7f2a52e93640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2a30066280 0x7f2a30068730 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.266+0000 7f2a52e93640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0ca280 0x7f2a4c0c34a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.266+0000 7f2a52e93640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a4c0b3730 0x7f2a4c0c18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.266+0000 7f2a52e93640 1 --2- 172.21.15.55:0/2114409143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a4c0712f0 0x7f2a4c145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.266+0000 7f2a52e93640 1 -- 172.21.15.55:0/2114409143 >> 172.21.15.55:0/2114409143 conn(0x7f2a4c0cded0 msgr2=0x7f2a4c0b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:12.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.266+0000 7f2a52e93640 1 -- 172.21.15.55:0/2114409143 shutdown_connections 2023-07-06T21:43:12.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.266+0000 7f2a52e93640 1 -- 172.21.15.55:0/2114409143 wait complete. 2023-07-06T21:43:12.292 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:42:08.597013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:42:09.843890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T21:42:12.918111+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T21:43:12.294 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:43:12.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa84807640 1 Processor -- start 2023-07-06T21:43:12.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa84807640 1 -- start start 2023-07-06T21:43:12.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa84807640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa8015ba30 0x7ffa800cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa84807640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ffa800ad0c0 0x7ffa8009ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa84807640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa800ccbb0 con 0x7ffa8009d340 2023-07-06T21:43:12.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa84807640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa800c83a0 con 0x7ffa800ad0c0 2023-07-06T21:43:12.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa84807640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8009d7c0 con 0x7ffa8015ba30 2023-07-06T21:43:12.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa7dd9b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ffa800ad0c0 0x7ffa8009ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa7e59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa8015ba30 0x7ffa800cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa7ed9d640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ffa8009d340 0x7ffa8015f6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:35632/0 (socket says 172.21.15.55:35632) 2023-07-06T21:43:12.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa7e59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa8015ba30 0x7ffa800cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:42578/0 (socket says 172.21.15.55:42578) 2023-07-06T21:43:12.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa7dd9b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ffa800ad0c0 0x7ffa8009ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:45956/0 (socket says 172.21.15.55:45956) 2023-07-06T21:43:12.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa7ed9d640 1 -- 172.21.15.55:0/1860839705 learned_addr learned my addr 172.21.15.55:0/1860839705 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:12.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa7e59c640 1 -- 172.21.15.55:0/1860839705 >> v2:172.21.15.138:3300/0 conn(0x7ffa800ad0c0 msgr2=0x7ffa8009ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:12.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa7e59c640 1 --2- 172.21.15.55:0/1860839705 >> v2:172.21.15.138:3300/0 conn(0x7ffa800ad0c0 0x7ffa8009ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa7e59c640 1 -- 172.21.15.55:0/1860839705 >> v1:172.21.15.138:6789/0 conn(0x7ffa8009d340 legacy=0x7ffa8015f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa7e59c640 1 -- 172.21.15.55:0/1860839705 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa800cce90 con 0x7ffa8015ba30 2023-07-06T21:43:12.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa7d59a640 1 -- 172.21.15.55:0/1860839705 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83934040 0 0) 0x7ffa800ccbb0 con 0x7ffa8009d340 2023-07-06T21:43:12.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.434+0000 7ffa7dd9b640 1 --2- 172.21.15.55:0/1860839705 >> v2:172.21.15.138:3300/0 conn(0x7ffa800ad0c0 0x7ffa8009ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:12.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.438+0000 7ffa7e59c640 1 --2- 172.21.15.55:0/1860839705 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa8015ba30 0x7ffa800cd800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa700097c0 tx=0x7ffa7001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16b023b8b1325767 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:12.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.438+0000 7ffa7d59a640 1 -- 172.21.15.55:0/1860839705 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa700ab650 con 0x7ffa8015ba30 2023-07-06T21:43:12.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.438+0000 7ffa7d59a640 1 -- 172.21.15.55:0/1860839705 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa700ab7b0 con 0x7ffa8015ba30 2023-07-06T21:43:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.438+0000 7ffa7d59a640 1 -- 172.21.15.55:0/1860839705 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa700abb40 con 0x7ffa8015ba30 2023-07-06T21:43:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.438+0000 7ffa84807640 1 -- 172.21.15.55:0/1860839705 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa8015ba30 msgr2=0x7ffa800cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.438+0000 7ffa84807640 1 --2- 172.21.15.55:0/1860839705 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa8015ba30 0x7ffa800cd800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa700097c0 tx=0x7ffa7001c450 comp rx=0 tx=0).stop 2023-07-06T21:43:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.438+0000 7ffa84807640 1 -- 172.21.15.55:0/1860839705 shutdown_connections 2023-07-06T21:43:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.438+0000 7ffa84807640 1 --2- 172.21.15.55:0/1860839705 >> v2:172.21.15.138:3300/0 conn(0x7ffa800ad0c0 0x7ffa8009ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.438+0000 7ffa84807640 1 --2- 172.21.15.55:0/1860839705 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa8015ba30 0x7ffa800cd800 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.438+0000 7ffa84807640 1 -- 172.21.15.55:0/1860839705 >> 172.21.15.55:0/1860839705 conn(0x7ffa800cea70 msgr2=0x7ffa800ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.438+0000 7ffa84807640 1 -- 172.21.15.55:0/1860839705 shutdown_connections 2023-07-06T21:43:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.438+0000 7ffa84807640 1 -- 172.21.15.55:0/1860839705 wait complete. 2023-07-06T21:43:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa84807640 1 Processor -- start 2023-07-06T21:43:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa84807640 1 -- start start 2023-07-06T21:43:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa84807640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa8009d340 0x7ffa800c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa84807640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa800ad0c0 0x7ffa8006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa84807640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa8015ba30 0x7ffa8006f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa84807640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800c3ec0 con 0x7ffa8015ba30 2023-07-06T21:43:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa84807640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa801517a0 con 0x7ffa800ad0c0 2023-07-06T21:43:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa84807640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800c3240 con 0x7ffa8009d340 2023-07-06T21:43:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa7ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa8015ba30 0x7ffa8006f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa7ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa8015ba30 0x7ffa8006f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36112/0 (socket says 172.21.15.55:36112) 2023-07-06T21:43:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa7ed9d640 1 -- 172.21.15.55:0/106059252 learned_addr learned my addr 172.21.15.55:0/106059252 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa7e59c640 1 --2- 172.21.15.55:0/106059252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa8009d340 0x7ffa800c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa7dd9b640 1 --2- 172.21.15.55:0/106059252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa800ad0c0 0x7ffa8006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa7ed9d640 1 -- 172.21.15.55:0/106059252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa8009d340 msgr2=0x7ffa800c2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa7ed9d640 1 --2- 172.21.15.55:0/106059252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa8009d340 0x7ffa800c2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa7ed9d640 1 -- 172.21.15.55:0/106059252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa800ad0c0 msgr2=0x7ffa8006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa7ed9d640 1 --2- 172.21.15.55:0/106059252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa800ad0c0 0x7ffa8006eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa7ed9d640 1 -- 172.21.15.55:0/106059252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa74009420 con 0x7ffa8015ba30 2023-07-06T21:43:12.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa7ed9d640 1 --2- 172.21.15.55:0/106059252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa8015ba30 0x7ffa8006f420 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ffa78001570 tx=0x7ffa7800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:12.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa6effd640 1 -- 172.21.15.55:0/106059252 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800a640 con 0x7ffa8015ba30 2023-07-06T21:43:12.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa6effd640 1 -- 172.21.15.55:0/106059252 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7800a7c0 con 0x7ffa8015ba30 2023-07-06T21:43:12.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa6effd640 1 -- 172.21.15.55:0/106059252 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800ab70 con 0x7ffa8015ba30 2023-07-06T21:43:12.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa84807640 1 -- 172.21.15.55:0/106059252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa70009420 con 0x7ffa8015ba30 2023-07-06T21:43:12.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.442+0000 7ffa84807640 1 -- 172.21.15.55:0/106059252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa800c3800 con 0x7ffa8015ba30 2023-07-06T21:43:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.446+0000 7ffa84807640 1 -- 172.21.15.55:0/106059252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa80066d60 con 0x7ffa8015ba30 2023-07-06T21:43:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.446+0000 7ffa6effd640 1 -- 172.21.15.55:0/106059252 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa7800acd0 con 0x7ffa8015ba30 2023-07-06T21:43:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.446+0000 7ffa6effd640 1 --2- 172.21.15.55:0/106059252 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffa600662b0 0x7ffa60068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.446+0000 7ffa6effd640 1 -- 172.21.15.55:0/106059252 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffa78083530 con 0x7ffa8015ba30 2023-07-06T21:43:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.446+0000 7ffa7e59c640 1 --2- 172.21.15.55:0/106059252 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffa600662b0 0x7ffa60068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.446+0000 7ffa7e59c640 1 --2- 172.21.15.55:0/106059252 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffa600662b0 0x7ffa60068760 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffa700af000 tx=0x7ffa700a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:12.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.450+0000 7ffa6effd640 1 -- 172.21.15.55:0/106059252 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa78050690 con 0x7ffa8015ba30 2023-07-06T21:43:12.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.602+0000 7ffa84807640 1 -- 172.21.15.55:0/106059252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa800cb6c0 con 0x7ffa8015ba30 2023-07-06T21:43:12.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.606+0000 7ffa6effd640 1 -- 172.21.15.55:0/106059252 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa78053cb0 con 0x7ffa8015ba30 2023-07-06T21:43:12.611 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:43:12.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.606+0000 7ffa84807640 1 -- 172.21.15.55:0/106059252 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffa600662b0 msgr2=0x7ffa60068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.606+0000 7ffa84807640 1 --2- 172.21.15.55:0/106059252 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffa600662b0 0x7ffa60068760 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffa700af000 tx=0x7ffa700a7000 comp rx=0 tx=0).stop 2023-07-06T21:43:12.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.606+0000 7ffa84807640 1 -- 172.21.15.55:0/106059252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa8015ba30 msgr2=0x7ffa8006f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.606+0000 7ffa84807640 1 --2- 172.21.15.55:0/106059252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa8015ba30 0x7ffa8006f420 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ffa78001570 tx=0x7ffa7800cca0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.606+0000 7ffa84807640 1 -- 172.21.15.55:0/106059252 shutdown_connections 2023-07-06T21:43:12.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.606+0000 7ffa84807640 1 --2- 172.21.15.55:0/106059252 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffa600662b0 0x7ffa60068760 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.606+0000 7ffa84807640 1 --2- 172.21.15.55:0/106059252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa8015ba30 0x7ffa8006f420 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.606+0000 7ffa84807640 1 --2- 172.21.15.55:0/106059252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa800ad0c0 0x7ffa8006eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.606+0000 7ffa84807640 1 --2- 172.21.15.55:0/106059252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa8009d340 0x7ffa800c2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.606+0000 7ffa84807640 1 -- 172.21.15.55:0/106059252 >> 172.21.15.55:0/106059252 conn(0x7ffa800cea70 msgr2=0x7ffa80070260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:12.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.606+0000 7ffa84807640 1 -- 172.21.15.55:0/106059252 shutdown_connections 2023-07-06T21:43:12.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.606+0000 7ffa84807640 1 -- 172.21.15.55:0/106059252 wait complete. 2023-07-06T21:43:12.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:43:12.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc12848640 1 Processor -- start 2023-07-06T21:43:12.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc12848640 1 -- start start 2023-07-06T21:43:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc12848640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc0c070d70 0x7fcc0c0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc12848640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcc0c0b1170 0x7fcc0c06eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc12848640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0c0b15a0 con 0x7fcc0c0709a0 2023-07-06T21:43:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc12848640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0c0cc030 con 0x7fcc0c070d70 2023-07-06T21:43:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc12848640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0c0cc300 con 0x7fcc0c0b1170 2023-07-06T21:43:12.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc0b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc0c070d70 0x7fcc0c0b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc0b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc0c070d70 0x7fcc0c0b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36122/0 (socket says 172.21.15.55:36122) 2023-07-06T21:43:12.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc0b7fe640 1 -- 172.21.15.55:0/1395434897 learned_addr learned my addr 172.21.15.55:0/1395434897 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:12.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc10de5640 1 --2- 172.21.15.55:0/1395434897 >> v2:172.21.15.138:3300/0 conn(0x7fcc0c0b1170 0x7fcc0c06eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc0b7fe640 1 -- 172.21.15.55:0/1395434897 >> v2:172.21.15.138:3300/0 conn(0x7fcc0c0b1170 msgr2=0x7fcc0c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:12.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc0b7fe640 1 --2- 172.21.15.55:0/1395434897 >> v2:172.21.15.138:3300/0 conn(0x7fcc0c0b1170 0x7fcc0c06eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc0b7fe640 1 -- 172.21.15.55:0/1395434897 >> v1:172.21.15.138:6789/0 conn(0x7fcc0c0709a0 legacy=0x7fcc0c0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:12.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc0b7fe640 1 -- 172.21.15.55:0/1395434897 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c0cc5e0 con 0x7fcc0c070d70 2023-07-06T21:43:12.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.774+0000 7fcc10de5640 1 --2- 172.21.15.55:0/1395434897 >> v2:172.21.15.138:3300/0 conn(0x7fcc0c0b1170 0x7fcc0c06eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:12.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.778+0000 7fcc0b7fe640 1 --2- 172.21.15.55:0/1395434897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c070d70 0x7fcc0c0b0c30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0711d0 tx=0x7fcc0001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f6cd464c62c62a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:12.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.778+0000 7fcc0affd640 1 -- 172.21.15.55:0/1395434897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc000ac410 con 0x7fcc0c070d70 2023-07-06T21:43:12.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.778+0000 7fcc0affd640 1 -- 172.21.15.55:0/1395434897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc000ac570 con 0x7fcc0c070d70 2023-07-06T21:43:12.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.778+0000 7fcc0affd640 1 -- 172.21.15.55:0/1395434897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc000ac900 con 0x7fcc0c070d70 2023-07-06T21:43:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.778+0000 7fcc12848640 1 -- 172.21.15.55:0/1395434897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c070d70 msgr2=0x7fcc0c0b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.778+0000 7fcc12848640 1 --2- 172.21.15.55:0/1395434897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c070d70 0x7fcc0c0b0c30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0711d0 tx=0x7fcc0001c4c0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.778+0000 7fcc12848640 1 -- 172.21.15.55:0/1395434897 shutdown_connections 2023-07-06T21:43:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.778+0000 7fcc12848640 1 --2- 172.21.15.55:0/1395434897 >> v2:172.21.15.138:3300/0 conn(0x7fcc0c0b1170 0x7fcc0c06eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.778+0000 7fcc12848640 1 --2- 172.21.15.55:0/1395434897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c070d70 0x7fcc0c0b0c30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.778+0000 7fcc12848640 1 -- 172.21.15.55:0/1395434897 >> 172.21.15.55:0/1395434897 conn(0x7fcc0c0cea70 msgr2=0x7fcc0c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.778+0000 7fcc12848640 1 -- 172.21.15.55:0/1395434897 shutdown_connections 2023-07-06T21:43:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.778+0000 7fcc12848640 1 -- 172.21.15.55:0/1395434897 wait complete. 2023-07-06T21:43:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.778+0000 7fcc12848640 1 Processor -- start 2023-07-06T21:43:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc12848640 1 -- start start 2023-07-06T21:43:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc12848640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcc0c0709a0 0x7fcc0c0693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc12848640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c070d70 0x7fcc0c158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc12848640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc0c0b1170 0x7fcc0c163160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc12848640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c06a750 con 0x7fcc0c070d70 2023-07-06T21:43:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc12848640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c06c090 con 0x7fcc0c0b1170 2023-07-06T21:43:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc12848640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c069ad0 con 0x7fcc0c0709a0 2023-07-06T21:43:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc0b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c070d70 0x7fcc0c158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc0b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c070d70 0x7fcc0c158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36130/0 (socket says 172.21.15.55:36130) 2023-07-06T21:43:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc0b7fe640 1 -- 172.21.15.55:0/3041365295 learned_addr learned my addr 172.21.15.55:0/3041365295 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc10de5640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc0c0b1170 0x7fcc0c163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc0bfff640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcc0c0709a0 0x7fcc0c0693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc0b7fe640 1 -- 172.21.15.55:0/3041365295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcc0c0709a0 msgr2=0x7fcc0c0693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc0b7fe640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcc0c0709a0 0x7fcc0c0693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc0b7fe640 1 -- 172.21.15.55:0/3041365295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc0c0b1170 msgr2=0x7fcc0c163160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc0b7fe640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc0c0b1170 0x7fcc0c163160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc0b7fe640 1 -- 172.21.15.55:0/3041365295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000094d0 con 0x7fcc0c070d70 2023-07-06T21:43:12.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc10de5640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc0c0b1170 0x7fcc0c163160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:12.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc0b7fe640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c070d70 0x7fcc0c158b70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcc000af040 tx=0x7fcc00019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:12.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc08ff9640 1 -- 172.21.15.55:0/3041365295 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc000acea0 con 0x7fcc0c070d70 2023-07-06T21:43:12.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc08ff9640 1 -- 172.21.15.55:0/3041365295 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc000b5630 con 0x7fcc0c070d70 2023-07-06T21:43:12.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc08ff9640 1 -- 172.21.15.55:0/3041365295 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc000ac410 con 0x7fcc0c070d70 2023-07-06T21:43:12.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc12848640 1 -- 172.21.15.55:0/3041365295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0c069db0 con 0x7fcc0c070d70 2023-07-06T21:43:12.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc12848640 1 -- 172.21.15.55:0/3041365295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0c06a370 con 0x7fcc0c070d70 2023-07-06T21:43:12.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.782+0000 7fcc12848640 1 -- 172.21.15.55:0/3041365295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0c066d60 con 0x7fcc0c070d70 2023-07-06T21:43:12.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.786+0000 7fcc08ff9640 1 -- 172.21.15.55:0/3041365295 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc000b3070 con 0x7fcc0c070d70 2023-07-06T21:43:12.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.786+0000 7fcc08ff9640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcbf8066280 0x7fcbf8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.786+0000 7fcc08ff9640 1 -- 172.21.15.55:0/3041365295 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcc0011e7e0 con 0x7fcc0c070d70 2023-07-06T21:43:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.786+0000 7fcc0bfff640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcbf8066280 0x7fcbf8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.786+0000 7fcc0bfff640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcbf8066280 0x7fcbf8068730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc004e30 tx=0x7fcbfc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.790+0000 7fcc08ff9640 1 -- 172.21.15.55:0/3041365295 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc000eb930 con 0x7fcc0c070d70 2023-07-06T21:43:12.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.946+0000 7fcc12848640 1 -- 172.21.15.55:0/3041365295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcc0c0c7e50 con 0x7fcc0c070d70 2023-07-06T21:43:12.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.946+0000 7fcc08ff9640 1 -- 172.21.15.55:0/3041365295 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcc000eef50 con 0x7fcc0c070d70 2023-07-06T21:43:12.954 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:43:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.950+0000 7fcc12848640 1 -- 172.21.15.55:0/3041365295 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcbf8066280 msgr2=0x7fcbf8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.950+0000 7fcc12848640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcbf8066280 0x7fcbf8068730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc004e30 tx=0x7fcbfc009040 comp rx=0 tx=0).stop 2023-07-06T21:43:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.950+0000 7fcc12848640 1 -- 172.21.15.55:0/3041365295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c070d70 msgr2=0x7fcc0c158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.950+0000 7fcc12848640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c070d70 0x7fcc0c158b70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcc000af040 tx=0x7fcc00019260 comp rx=0 tx=0).stop 2023-07-06T21:43:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.950+0000 7fcc12848640 1 -- 172.21.15.55:0/3041365295 shutdown_connections 2023-07-06T21:43:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.950+0000 7fcc12848640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fcbf8066280 0x7fcbf8068730 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.950+0000 7fcc12848640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc0c0b1170 0x7fcc0c163160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.950+0000 7fcc12848640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c070d70 0x7fcc0c158b70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.950+0000 7fcc12848640 1 --2- 172.21.15.55:0/3041365295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcc0c0709a0 0x7fcc0c0693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.950+0000 7fcc12848640 1 -- 172.21.15.55:0/3041365295 >> 172.21.15.55:0/3041365295 conn(0x7fcc0c0cea70 msgr2=0x7fcc0c159820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.950+0000 7fcc12848640 1 -- 172.21.15.55:0/3041365295 shutdown_connections 2023-07-06T21:43:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:12.950+0000 7fcc12848640 1 -- 172.21.15.55:0/3041365295 wait complete. 2023-07-06T21:43:12.975 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:43:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b6127b640 1 Processor -- start 2023-07-06T21:43:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b6127b640 1 -- start start 2023-07-06T21:43:13.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b6127b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b5c070d70 0x7f6b5c0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b6127b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5c0cc030 con 0x7f6b5c0b1170 2023-07-06T21:43:13.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b6127b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5c0cc300 con 0x7f6b5c0709a0 2023-07-06T21:43:13.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b6127b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c0b15f0 con 0x7f6b5c070d70 2023-07-06T21:43:13.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b5b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6b5c0b1170 0x7f6b5c06eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52840/0 (socket says 172.21.15.55:52840) 2023-07-06T21:43:13.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b5b7fe640 1 -- 172.21.15.55:0/260176522 learned_addr learned my addr 172.21.15.55:0/260176522 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:13.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b53fff640 1 --2- 172.21.15.55:0/260176522 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b5c070d70 0x7f6b5c0b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b5a7fc640 1 -- 172.21.15.55:0/260176522 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540320319 0 0) 0x7f6b5c0cc030 con 0x7f6b5c0b1170 2023-07-06T21:43:13.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b5a7fc640 1 -- 172.21.15.55:0/260176522 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b48003530 con 0x7f6b5c0b1170 2023-07-06T21:43:13.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b5a7fc640 1 -- 172.21.15.55:0/260176522 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275050327 0 0) 0x7f6b5c0cc300 con 0x7f6b5c0709a0 2023-07-06T21:43:13.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b5a7fc640 1 -- 172.21.15.55:0/260176522 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b5c0cc030 con 0x7f6b5c0709a0 2023-07-06T21:43:13.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b53fff640 1 -- 172.21.15.55:0/260176522 >> v1:172.21.15.138:6789/0 conn(0x7f6b5c0709a0 legacy=0x7f6b5c0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b5a7fc640 1 -- 172.21.15.55:0/260176522 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1872003530 0 0) 0x7f6b48003530 con 0x7f6b5c0b1170 2023-07-06T21:43:13.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b53fff640 1 -- 172.21.15.55:0/260176522 >> v1:172.21.15.55:6789/0 conn(0x7f6b5c0b1170 legacy=0x7f6b5c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.114+0000 7f6b53fff640 1 -- 172.21.15.55:0/260176522 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c0cc5e0 con 0x7f6b5c070d70 2023-07-06T21:43:13.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.118+0000 7f6b53fff640 1 --2- 172.21.15.55:0/260176522 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b5c070d70 0x7f6b5c0b0c30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0b1730 tx=0x7f6b4401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d78e78b636fb0b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.118+0000 7f6b5a7fc640 1 -- 172.21.15.55:0/260176522 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54001a00 con 0x7f6b5c070d70 2023-07-06T21:43:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.118+0000 7f6b5a7fc640 1 -- 172.21.15.55:0/260176522 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b440a7050 con 0x7f6b5c070d70 2023-07-06T21:43:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.118+0000 7f6b5a7fc640 1 -- 172.21.15.55:0/260176522 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b440ab620 con 0x7f6b5c070d70 2023-07-06T21:43:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.118+0000 7f6b6127b640 1 -- 172.21.15.55:0/260176522 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b5c070d70 msgr2=0x7f6b5c0b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.118+0000 7f6b6127b640 1 --2- 172.21.15.55:0/260176522 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b5c070d70 0x7f6b5c0b0c30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0b1730 tx=0x7f6b4401c330 comp rx=0 tx=0).stop 2023-07-06T21:43:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.118+0000 7f6b6127b640 1 -- 172.21.15.55:0/260176522 shutdown_connections 2023-07-06T21:43:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.118+0000 7f6b6127b640 1 --2- 172.21.15.55:0/260176522 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b5c070d70 0x7f6b5c0b0c30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.118+0000 7f6b6127b640 1 -- 172.21.15.55:0/260176522 >> 172.21.15.55:0/260176522 conn(0x7f6b5c0cea70 msgr2=0x7f6b5c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.118+0000 7f6b6127b640 1 -- 172.21.15.55:0/260176522 shutdown_connections 2023-07-06T21:43:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.118+0000 7f6b6127b640 1 -- 172.21.15.55:0/260176522 wait complete. 2023-07-06T21:43:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b6127b640 1 Processor -- start 2023-07-06T21:43:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b6127b640 1 -- start start 2023-07-06T21:43:13.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b6127b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b5c0709a0 0x7f6b5c06bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b6127b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b5c070d70 0x7f6b5c158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b6127b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b5c0b1170 0x7f6b5c0c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b6127b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c06bb40 con 0x7f6b5c0709a0 2023-07-06T21:43:13.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b6127b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c06a7d0 con 0x7f6b5c070d70 2023-07-06T21:43:13.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b6127b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c06af30 con 0x7f6b5c0b1170 2023-07-06T21:43:13.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b5affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b5c0709a0 0x7f6b5c06bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b5affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b5c0709a0 0x7f6b5c06bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36146/0 (socket says 172.21.15.55:36146) 2023-07-06T21:43:13.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b5affd640 1 -- 172.21.15.55:0/4039820970 learned_addr learned my addr 172.21.15.55:0/4039820970 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:13.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b53fff640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b5c070d70 0x7f6b5c158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b5b7fe640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b5c0b1170 0x7f6b5c0c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b5affd640 1 -- 172.21.15.55:0/4039820970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b5c0b1170 msgr2=0x7f6b5c0c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b5affd640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b5c0b1170 0x7f6b5c0c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b5affd640 1 -- 172.21.15.55:0/4039820970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b5c070d70 msgr2=0x7f6b5c158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b5affd640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b5c070d70 0x7f6b5c158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b5affd640 1 -- 172.21.15.55:0/4039820970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b44009420 con 0x7f6b5c0709a0 2023-07-06T21:43:13.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b5b7fe640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b5c0b1170 0x7f6b5c0c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:13.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b5affd640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b5c0709a0 0x7f6b5c06bfd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00c490 tx=0x7f6b4c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:13.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b537fe640 1 -- 172.21.15.55:0/4039820970 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0052d0 con 0x7f6b5c0709a0 2023-07-06T21:43:13.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b537fe640 1 -- 172.21.15.55:0/4039820970 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4c005430 con 0x7f6b5c0709a0 2023-07-06T21:43:13.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b537fe640 1 -- 172.21.15.55:0/4039820970 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c012870 con 0x7f6b5c0709a0 2023-07-06T21:43:13.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b6127b640 1 -- 172.21.15.55:0/4039820970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5c06b210 con 0x7f6b5c0709a0 2023-07-06T21:43:13.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.122+0000 7f6b6127b640 1 -- 172.21.15.55:0/4039820970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5c06b7d0 con 0x7f6b5c0709a0 2023-07-06T21:43:13.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.126+0000 7f6b6127b640 1 -- 172.21.15.55:0/4039820970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5c066d60 con 0x7f6b5c0709a0 2023-07-06T21:43:13.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.126+0000 7f6b537fe640 1 -- 172.21.15.55:0/4039820970 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b4c0129d0 con 0x7f6b5c0709a0 2023-07-06T21:43:13.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.126+0000 7f6b537fe640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b3c066280 0x7f6b3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.126+0000 7f6b537fe640 1 -- 172.21.15.55:0/4039820970 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6b4c083ca0 con 0x7f6b5c0709a0 2023-07-06T21:43:13.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.126+0000 7f6b53fff640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b3c066280 0x7f6b3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.126+0000 7f6b53fff640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b3c066280 0x7f6b3c068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6b440ad000 tx=0x7f6b44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:13.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.130+0000 7f6b537fe640 1 -- 172.21.15.55:0/4039820970 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b4c050cc0 con 0x7f6b5c0709a0 2023-07-06T21:43:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.282+0000 7f6b6127b640 1 -- 172.21.15.55:0/4039820970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b5c0c7e50 con 0x7f6b5c0709a0 2023-07-06T21:43:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.282+0000 7f6b537fe640 1 -- 172.21.15.55:0/4039820970 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b4c0542e0 con 0x7f6b5c0709a0 2023-07-06T21:43:13.291 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:43:13.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.286+0000 7f6b6127b640 1 -- 172.21.15.55:0/4039820970 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b3c066280 msgr2=0x7f6b3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.286+0000 7f6b6127b640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b3c066280 0x7f6b3c068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6b440ad000 tx=0x7f6b44008040 comp rx=0 tx=0).stop 2023-07-06T21:43:13.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.286+0000 7f6b6127b640 1 -- 172.21.15.55:0/4039820970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b5c0709a0 msgr2=0x7f6b5c06bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.286+0000 7f6b6127b640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b5c0709a0 0x7f6b5c06bfd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00c490 tx=0x7f6b4c00c950 comp rx=0 tx=0).stop 2023-07-06T21:43:13.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.286+0000 7f6b6127b640 1 -- 172.21.15.55:0/4039820970 shutdown_connections 2023-07-06T21:43:13.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.286+0000 7f6b6127b640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6b3c066280 0x7f6b3c068730 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.286+0000 7f6b6127b640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b5c0b1170 0x7f6b5c0c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.286+0000 7f6b6127b640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b5c070d70 0x7f6b5c158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.286+0000 7f6b6127b640 1 --2- 172.21.15.55:0/4039820970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b5c0709a0 0x7f6b5c06bfd0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.286+0000 7f6b6127b640 1 -- 172.21.15.55:0/4039820970 >> 172.21.15.55:0/4039820970 conn(0x7f6b5c0cea70 msgr2=0x7f6b5c158f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:13.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.286+0000 7f6b6127b640 1 -- 172.21.15.55:0/4039820970 shutdown_connections 2023-07-06T21:43:13.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.286+0000 7f6b6127b640 1 -- 172.21.15.55:0/4039820970 wait complete. 2023-07-06T21:43:13.312 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:43:13.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.450+0000 7f4c53034640 1 Processor -- start 2023-07-06T21:43:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.450+0000 7f4c53034640 1 -- start start 2023-07-06T21:43:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.450+0000 7f4c53034640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c4c069db0 0x7f4c4c0c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.450+0000 7f4c53034640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4c4c0cbd50 0x7f4c4c0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.450+0000 7f4c53034640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4c06c9e0 con 0x7f4c4c0cd510 2023-07-06T21:43:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.450+0000 7f4c53034640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4c06d080 con 0x7f4c4c069db0 2023-07-06T21:43:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.450+0000 7f4c53034640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4c0adc60 con 0x7f4c4c0cbd50 2023-07-06T21:43:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.454+0000 7f4c4bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c4c069db0 0x7f4c4c0c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.454+0000 7f4c4bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c4c069db0 0x7f4c4c0c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60392/0 (socket says 172.21.15.55:60392) 2023-07-06T21:43:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.454+0000 7f4c4bfff640 1 -- 172.21.15.55:0/1376563832 learned_addr learned my addr 172.21.15.55:0/1376563832 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:13.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.454+0000 7f4c515d1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4c4c0cbd50 0x7f4c4c0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.454+0000 7f4c4bfff640 1 -- 172.21.15.55:0/1376563832 >> v2:172.21.15.138:3300/0 conn(0x7f4c4c0cbd50 msgr2=0x7f4c4c0c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:13.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.454+0000 7f4c4bfff640 1 --2- 172.21.15.55:0/1376563832 >> v2:172.21.15.138:3300/0 conn(0x7f4c4c0cbd50 0x7f4c4c0c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.454+0000 7f4c4bfff640 1 -- 172.21.15.55:0/1376563832 >> v1:172.21.15.138:6789/0 conn(0x7f4c4c0cd510 legacy=0x7f4c4c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.454+0000 7f4c4bfff640 1 -- 172.21.15.55:0/1376563832 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c06a290 con 0x7f4c4c069db0 2023-07-06T21:43:13.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.454+0000 7f4c4b7fe640 1 -- 172.21.15.55:0/1376563832 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666334918 0 0) 0x7f4c4c06c9e0 con 0x7f4c4c0cd510 2023-07-06T21:43:13.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.454+0000 7f4c4bfff640 1 --2- 172.21.15.55:0/1376563832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c4c069db0 0x7f4c4c0c87d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c06f020 tx=0x7f4c3801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b66c2c9a1621a90 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:13.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.454+0000 7f4c4b7fe640 1 -- 172.21.15.55:0/1376563832 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c380ab640 con 0x7f4c4c069db0 2023-07-06T21:43:13.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.454+0000 7f4c4b7fe640 1 -- 172.21.15.55:0/1376563832 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c380a7070 con 0x7f4c4c069db0 2023-07-06T21:43:13.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.454+0000 7f4c4b7fe640 1 -- 172.21.15.55:0/1376563832 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c380ab9c0 con 0x7f4c4c069db0 2023-07-06T21:43:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 -- 172.21.15.55:0/1376563832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c4c069db0 msgr2=0x7f4c4c0c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 --2- 172.21.15.55:0/1376563832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c4c069db0 0x7f4c4c0c87d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c06f020 tx=0x7f4c3801c440 comp rx=0 tx=0).stop 2023-07-06T21:43:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 -- 172.21.15.55:0/1376563832 shutdown_connections 2023-07-06T21:43:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 --2- 172.21.15.55:0/1376563832 >> v2:172.21.15.138:3300/0 conn(0x7f4c4c0cbd50 0x7f4c4c0c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 --2- 172.21.15.55:0/1376563832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c4c069db0 0x7f4c4c0c87d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 -- 172.21.15.55:0/1376563832 >> 172.21.15.55:0/1376563832 conn(0x7f4c4c0afe60 msgr2=0x7f4c4c0b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 -- 172.21.15.55:0/1376563832 shutdown_connections 2023-07-06T21:43:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 -- 172.21.15.55:0/1376563832 wait complete. 2023-07-06T21:43:13.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 Processor -- start 2023-07-06T21:43:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 -- start start 2023-07-06T21:43:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c4c069db0 0x7f4c4c154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c4c0cbd50 0x7f4c4c159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c4c0cd510 0x7f4c4c0ae040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c159530 con 0x7f4c4c069db0 2023-07-06T21:43:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c1586a0 con 0x7f4c4c0cd510 2023-07-06T21:43:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c53034640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c1548a0 con 0x7f4c4c0cbd50 2023-07-06T21:43:13.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c50dd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c4c069db0 0x7f4c4c154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c50dd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c4c069db0 0x7f4c4c154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60408/0 (socket says 172.21.15.55:60408) 2023-07-06T21:43:13.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c50dd0640 1 -- 172.21.15.55:0/2720341364 learned_addr learned my addr 172.21.15.55:0/2720341364 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:13.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c515d1640 1 --2- 172.21.15.55:0/2720341364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c4c0cd510 0x7f4c4c0ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c4bfff640 1 --2- 172.21.15.55:0/2720341364 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c4c0cbd50 0x7f4c4c159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c50dd0640 1 -- 172.21.15.55:0/2720341364 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c4c0cbd50 msgr2=0x7f4c4c159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.458+0000 7f4c50dd0640 1 --2- 172.21.15.55:0/2720341364 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c4c0cbd50 0x7f4c4c159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.462+0000 7f4c50dd0640 1 -- 172.21.15.55:0/2720341364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c4c0cd510 msgr2=0x7f4c4c0ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.462+0000 7f4c50dd0640 1 --2- 172.21.15.55:0/2720341364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c4c0cd510 0x7f4c4c0ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.462+0000 7f4c50dd0640 1 -- 172.21.15.55:0/2720341364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c380094d0 con 0x7f4c4c069db0 2023-07-06T21:43:13.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.462+0000 7f4c50dd0640 1 --2- 172.21.15.55:0/2720341364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c4c069db0 0x7f4c4c154360 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000c4d0 tx=0x7f4c4000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:13.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.462+0000 7f4c497fa640 1 -- 172.21.15.55:0/2720341364 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40005480 con 0x7f4c4c069db0 2023-07-06T21:43:13.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.462+0000 7f4c497fa640 1 -- 172.21.15.55:0/2720341364 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c40003600 con 0x7f4c4c069db0 2023-07-06T21:43:13.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.462+0000 7f4c497fa640 1 -- 172.21.15.55:0/2720341364 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400039b0 con 0x7f4c4c069db0 2023-07-06T21:43:13.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.462+0000 7f4c53034640 1 -- 172.21.15.55:0/2720341364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4c15bda0 con 0x7f4c4c069db0 2023-07-06T21:43:13.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.462+0000 7f4c53034640 1 -- 172.21.15.55:0/2720341364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4c158b90 con 0x7f4c4c069db0 2023-07-06T21:43:13.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.462+0000 7f4c53034640 1 -- 172.21.15.55:0/2720341364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4c066d60 con 0x7f4c4c069db0 2023-07-06T21:43:13.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.462+0000 7f4c497fa640 1 -- 172.21.15.55:0/2720341364 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4c40003b10 con 0x7f4c4c069db0 2023-07-06T21:43:13.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.462+0000 7f4c497fa640 1 --2- 172.21.15.55:0/2720341364 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4c30066280 0x7f4c30068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.462+0000 7f4c497fa640 1 -- 172.21.15.55:0/2720341364 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4c400836d0 con 0x7f4c4c069db0 2023-07-06T21:43:13.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.466+0000 7f4c4bfff640 1 --2- 172.21.15.55:0/2720341364 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4c30066280 0x7f4c30068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.466+0000 7f4c4bfff640 1 --2- 172.21.15.55:0/2720341364 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4c30066280 0x7f4c30068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4c380af000 tx=0x7f4c380b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:13.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.466+0000 7f4c497fa640 1 -- 172.21.15.55:0/2720341364 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c400508f0 con 0x7f4c4c069db0 2023-07-06T21:43:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.622+0000 7f4c53034640 1 -- 172.21.15.55:0/2720341364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4c4c0c8910 con 0x7f4c4c069db0 2023-07-06T21:43:13.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.622+0000 7f4c497fa640 1 -- 172.21.15.55:0/2720341364 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4c40053f10 con 0x7f4c4c069db0 2023-07-06T21:43:13.631 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:43:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.626+0000 7f4c53034640 1 -- 172.21.15.55:0/2720341364 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4c30066280 msgr2=0x7f4c30068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.626+0000 7f4c53034640 1 --2- 172.21.15.55:0/2720341364 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4c30066280 0x7f4c30068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4c380af000 tx=0x7f4c380b6040 comp rx=0 tx=0).stop 2023-07-06T21:43:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.626+0000 7f4c53034640 1 -- 172.21.15.55:0/2720341364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c4c069db0 msgr2=0x7f4c4c154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.626+0000 7f4c53034640 1 --2- 172.21.15.55:0/2720341364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c4c069db0 0x7f4c4c154360 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000c4d0 tx=0x7f4c4000c990 comp rx=0 tx=0).stop 2023-07-06T21:43:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.626+0000 7f4c53034640 1 -- 172.21.15.55:0/2720341364 shutdown_connections 2023-07-06T21:43:13.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.626+0000 7f4c53034640 1 --2- 172.21.15.55:0/2720341364 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4c30066280 0x7f4c30068730 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.626+0000 7f4c53034640 1 --2- 172.21.15.55:0/2720341364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c4c0cd510 0x7f4c4c0ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.626+0000 7f4c53034640 1 --2- 172.21.15.55:0/2720341364 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c4c0cbd50 0x7f4c4c159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.626+0000 7f4c53034640 1 --2- 172.21.15.55:0/2720341364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c4c069db0 0x7f4c4c154360 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.626+0000 7f4c53034640 1 -- 172.21.15.55:0/2720341364 >> 172.21.15.55:0/2720341364 conn(0x7f4c4c0afe60 msgr2=0x7f4c4c0af480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:13.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.626+0000 7f4c53034640 1 -- 172.21.15.55:0/2720341364 shutdown_connections 2023-07-06T21:43:13.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.626+0000 7f4c53034640 1 -- 172.21.15.55:0/2720341364 wait complete. 2023-07-06T21:43:13.652 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T21:43:13.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.790+0000 7fc327fa3640 1 Processor -- start 2023-07-06T21:43:13.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.790+0000 7fc327fa3640 1 -- start start 2023-07-06T21:43:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.790+0000 7fc327fa3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc3200ca130 0x7fc3200703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.790+0000 7fc327fa3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3200c8db0 con 0x7fc3200cd140 2023-07-06T21:43:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.790+0000 7fc327fa3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3200c9090 con 0x7fc320158850 2023-07-06T21:43:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.790+0000 7fc327fa3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc320158ce0 con 0x7fc3200ca130 2023-07-06T21:43:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.790+0000 7fc32553e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc3200ca130 0x7fc3200703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.790+0000 7fc326540640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc3200cd140 0x7fc3200b1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40890/0 (socket says 172.21.15.55:40890) 2023-07-06T21:43:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.790+0000 7fc32553e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc3200ca130 0x7fc3200703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60410/0 (socket says 172.21.15.55:60410) 2023-07-06T21:43:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.790+0000 7fc326540640 1 -- 172.21.15.55:0/796538143 learned_addr learned my addr 172.21.15.55:0/796538143 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.794+0000 7fc32553e640 1 -- 172.21.15.55:0/796538143 >> v1:172.21.15.138:6789/0 conn(0x7fc320158850 legacy=0x7fc3200cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.794+0000 7fc32553e640 1 -- 172.21.15.55:0/796538143 >> v1:172.21.15.55:6789/0 conn(0x7fc3200cd140 legacy=0x7fc3200b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.794+0000 7fc32553e640 1 -- 172.21.15.55:0/796538143 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3200c9370 con 0x7fc3200ca130 2023-07-06T21:43:13.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.794+0000 7fc324d3d640 1 -- 172.21.15.55:0/796538143 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267006364 0 0) 0x7fc3200c8db0 con 0x7fc3200cd140 2023-07-06T21:43:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.794+0000 7fc32553e640 1 --2- 172.21.15.55:0/796538143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3200ca130 0x7fc3200703e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc3100097c0 tx=0x7fc31001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586485b97d7df563 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.794+0000 7fc324d3d640 1 -- 172.21.15.55:0/796538143 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100ab650 con 0x7fc3200ca130 2023-07-06T21:43:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.794+0000 7fc324d3d640 1 -- 172.21.15.55:0/796538143 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3100ab7b0 con 0x7fc3200ca130 2023-07-06T21:43:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.794+0000 7fc324d3d640 1 -- 172.21.15.55:0/796538143 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100abb40 con 0x7fc3200ca130 2023-07-06T21:43:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.794+0000 7fc327fa3640 1 -- 172.21.15.55:0/796538143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3200ca130 msgr2=0x7fc3200703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.794+0000 7fc327fa3640 1 --2- 172.21.15.55:0/796538143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3200ca130 0x7fc3200703e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc3100097c0 tx=0x7fc31001c450 comp rx=0 tx=0).stop 2023-07-06T21:43:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc327fa3640 1 -- 172.21.15.55:0/796538143 shutdown_connections 2023-07-06T21:43:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc327fa3640 1 --2- 172.21.15.55:0/796538143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3200ca130 0x7fc3200703e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc327fa3640 1 -- 172.21.15.55:0/796538143 >> 172.21.15.55:0/796538143 conn(0x7fc3200cea70 msgr2=0x7fc3200ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc327fa3640 1 -- 172.21.15.55:0/796538143 shutdown_connections 2023-07-06T21:43:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc327fa3640 1 -- 172.21.15.55:0/796538143 wait complete. 2023-07-06T21:43:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc327fa3640 1 Processor -- start 2023-07-06T21:43:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc327fa3640 1 -- start start 2023-07-06T21:43:13.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc327fa3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3200ca130 0x7fc3200acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc327fa3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3200cd140 0x7fc3200693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc327fa3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc320158850 0x7fc3200c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc327fa3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc320069930 con 0x7fc3200ca130 2023-07-06T21:43:13.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc327fa3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc320069bb0 con 0x7fc3200cd140 2023-07-06T21:43:13.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc327fa3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc320069e90 con 0x7fc320158850 2023-07-06T21:43:13.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc325d3f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3200ca130 0x7fc3200acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc325d3f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3200ca130 0x7fc3200acc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60424/0 (socket says 172.21.15.55:60424) 2023-07-06T21:43:13.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc325d3f640 1 -- 172.21.15.55:0/867845043 learned_addr learned my addr 172.21.15.55:0/867845043 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:13.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc32553e640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3200cd140 0x7fc3200693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc326540640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc320158850 0x7fc3200c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc325d3f640 1 -- 172.21.15.55:0/867845043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc320158850 msgr2=0x7fc3200c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc325d3f640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc320158850 0x7fc3200c2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc325d3f640 1 -- 172.21.15.55:0/867845043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3200cd140 msgr2=0x7fc3200693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc325d3f640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3200cd140 0x7fc3200693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc325d3f640 1 -- 172.21.15.55:0/867845043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310009420 con 0x7fc3200ca130 2023-07-06T21:43:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc32553e640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3200cd140 0x7fc3200693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:13.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc325d3f640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3200ca130 0x7fc3200acc00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c3c0 tx=0x7fc31c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:13.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.798+0000 7fc3167fc640 1 -- 172.21.15.55:0/867845043 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0052d0 con 0x7fc3200ca130 2023-07-06T21:43:13.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.802+0000 7fc3167fc640 1 -- 172.21.15.55:0/867845043 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c005430 con 0x7fc3200ca130 2023-07-06T21:43:13.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.802+0000 7fc3167fc640 1 -- 172.21.15.55:0/867845043 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c003840 con 0x7fc3200ca130 2023-07-06T21:43:13.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.802+0000 7fc327fa3640 1 -- 172.21.15.55:0/867845043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32006a170 con 0x7fc3200ca130 2023-07-06T21:43:13.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.802+0000 7fc327fa3640 1 -- 172.21.15.55:0/867845043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32006a730 con 0x7fc3200ca130 2023-07-06T21:43:13.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.802+0000 7fc327fa3640 1 -- 172.21.15.55:0/867845043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3200ae7c0 con 0x7fc3200ca130 2023-07-06T21:43:13.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.802+0000 7fc3167fc640 1 -- 172.21.15.55:0/867845043 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc31c0039a0 con 0x7fc3200ca130 2023-07-06T21:43:13.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.802+0000 7fc3167fc640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc304066280 0x7fc304068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:13.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.802+0000 7fc3167fc640 1 -- 172.21.15.55:0/867845043 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc31c0835a0 con 0x7fc3200ca130 2023-07-06T21:43:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.802+0000 7fc32553e640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc304066280 0x7fc304068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.806+0000 7fc32553e640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc304066280 0x7fc304068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc3100af000 tx=0x7fc3100a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:13.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.806+0000 7fc3167fc640 1 -- 172.21.15.55:0/867845043 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc3200ae7c0 con 0x7fc3200ca130 2023-07-06T21:43:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.958+0000 7fc327fa3640 1 -- 172.21.15.55:0/867845043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc3200ae7c0 con 0x7fc3200ca130 2023-07-06T21:43:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.958+0000 7fc3167fc640 1 -- 172.21.15.55:0/867845043 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc3200ae7c0 con 0x7fc3200ca130 2023-07-06T21:43:13.968 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:43:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.962+0000 7fc327fa3640 1 -- 172.21.15.55:0/867845043 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc304066280 msgr2=0x7fc304068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.962+0000 7fc327fa3640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc304066280 0x7fc304068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc3100af000 tx=0x7fc3100a7000 comp rx=0 tx=0).stop 2023-07-06T21:43:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.962+0000 7fc327fa3640 1 -- 172.21.15.55:0/867845043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3200ca130 msgr2=0x7fc3200acc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:13.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.962+0000 7fc327fa3640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3200ca130 0x7fc3200acc00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c3c0 tx=0x7fc31c00c880 comp rx=0 tx=0).stop 2023-07-06T21:43:13.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.962+0000 7fc327fa3640 1 -- 172.21.15.55:0/867845043 shutdown_connections 2023-07-06T21:43:13.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.962+0000 7fc327fa3640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc304066280 0x7fc304068730 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.962+0000 7fc327fa3640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc320158850 0x7fc3200c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.962+0000 7fc327fa3640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3200cd140 0x7fc3200693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.962+0000 7fc327fa3640 1 --2- 172.21.15.55:0/867845043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3200ca130 0x7fc3200acc00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:13.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.962+0000 7fc327fa3640 1 -- 172.21.15.55:0/867845043 >> 172.21.15.55:0/867845043 conn(0x7fc3200cea70 msgr2=0x7fc3200c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:13.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.962+0000 7fc327fa3640 1 -- 172.21.15.55:0/867845043 shutdown_connections 2023-07-06T21:43:13.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:13.962+0000 7fc327fa3640 1 -- 172.21.15.55:0/867845043 wait complete. 2023-07-06T21:43:13.989 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:43:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.122+0000 7f0ba0111640 1 Processor -- start 2023-07-06T21:43:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0ba0111640 1 -- start start 2023-07-06T21:43:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0ba0111640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b980ca450 0x7f0b9806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0ba0111640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b980b3730 0x7f0b9815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0ba0111640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b98159cd0 con 0x7f0b980712f0 2023-07-06T21:43:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0ba0111640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b980693f0 con 0x7f0b980b3730 2023-07-06T21:43:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0ba0111640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9806aca0 con 0x7f0b980ca450 2023-07-06T21:43:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0b9dead640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0b980712f0 0x7f0b980c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40904/0 (socket says 172.21.15.55:40904) 2023-07-06T21:43:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0b9dead640 1 -- 172.21.15.55:0/327780814 learned_addr learned my addr 172.21.15.55:0/327780814 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0b9e6ae640 1 --2- 172.21.15.55:0/327780814 >> v2:172.21.15.55:3300/0 conn(0x7f0b980b3730 0x7f0b9815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0b9d6ac640 1 --2- 172.21.15.55:0/327780814 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b980ca450 0x7f0b9806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0b9e6ae640 1 -- 172.21.15.55:0/327780814 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b980ca450 msgr2=0x7f0b9806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:14.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0b9e6ae640 1 --2- 172.21.15.55:0/327780814 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b980ca450 0x7f0b9806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0b9e6ae640 1 -- 172.21.15.55:0/327780814 >> v1:172.21.15.55:6789/0 conn(0x7f0b980712f0 legacy=0x7f0b980c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0b9e6ae640 1 -- 172.21.15.55:0/327780814 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b980696b0 con 0x7f0b980b3730 2023-07-06T21:43:14.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0b9d6ac640 1 --2- 172.21.15.55:0/327780814 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b980ca450 0x7f0b9806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:14.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.126+0000 7f0b9ceab640 1 -- 172.21.15.55:0/327780814 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652174654 0 0) 0x7f0b98159cd0 con 0x7f0b980712f0 2023-07-06T21:43:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.130+0000 7f0b9e6ae640 1 --2- 172.21.15.55:0/327780814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b980b3730 0x7f0b9815d3e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009d90 tx=0x7f0b9001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdde59582a01f3a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.130+0000 7f0b9ceab640 1 -- 172.21.15.55:0/327780814 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900a59e0 con 0x7f0b980b3730 2023-07-06T21:43:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.130+0000 7f0b9ceab640 1 -- 172.21.15.55:0/327780814 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b900a5b40 con 0x7f0b980b3730 2023-07-06T21:43:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.130+0000 7f0b9ceab640 1 -- 172.21.15.55:0/327780814 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900ad440 con 0x7f0b980b3730 2023-07-06T21:43:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.130+0000 7f0ba0111640 1 -- 172.21.15.55:0/327780814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b980b3730 msgr2=0x7f0b9815d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.130+0000 7f0ba0111640 1 --2- 172.21.15.55:0/327780814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b980b3730 0x7f0b9815d3e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009d90 tx=0x7f0b9001c920 comp rx=0 tx=0).stop 2023-07-06T21:43:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.130+0000 7f0ba0111640 1 -- 172.21.15.55:0/327780814 shutdown_connections 2023-07-06T21:43:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.130+0000 7f0ba0111640 1 --2- 172.21.15.55:0/327780814 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b980ca450 0x7f0b9806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.130+0000 7f0ba0111640 1 --2- 172.21.15.55:0/327780814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b980b3730 0x7f0b9815d3e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.130+0000 7f0ba0111640 1 -- 172.21.15.55:0/327780814 >> 172.21.15.55:0/327780814 conn(0x7f0b980cded0 msgr2=0x7f0b980ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.130+0000 7f0ba0111640 1 -- 172.21.15.55:0/327780814 shutdown_connections 2023-07-06T21:43:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.130+0000 7f0ba0111640 1 -- 172.21.15.55:0/327780814 wait complete. 2023-07-06T21:43:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.130+0000 7f0ba0111640 1 Processor -- start 2023-07-06T21:43:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.130+0000 7f0ba0111640 1 -- start start 2023-07-06T21:43:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0ba0111640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b980712f0 0x7f0b9815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0ba0111640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b980b3730 0x7f0b981545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0ba0111640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b980ca450 0x7f0b980ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0ba0111640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b980c39b0 con 0x7f0b980b3730 2023-07-06T21:43:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0ba0111640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b980c2b20 con 0x7f0b980712f0 2023-07-06T21:43:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0ba0111640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b980c2da0 con 0x7f0b980ca450 2023-07-06T21:43:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0b9d6ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b980b3730 0x7f0b981545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0b9d6ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b980b3730 0x7f0b981545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60444/0 (socket says 172.21.15.55:60444) 2023-07-06T21:43:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0b9d6ac640 1 -- 172.21.15.55:0/3803993175 learned_addr learned my addr 172.21.15.55:0/3803993175 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:14.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0b9dead640 1 --2- 172.21.15.55:0/3803993175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b980712f0 0x7f0b9815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0b9e6ae640 1 --2- 172.21.15.55:0/3803993175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b980ca450 0x7f0b980ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0b9d6ac640 1 -- 172.21.15.55:0/3803993175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b980ca450 msgr2=0x7f0b980ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0b9d6ac640 1 --2- 172.21.15.55:0/3803993175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b980ca450 0x7f0b980ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0b9d6ac640 1 -- 172.21.15.55:0/3803993175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b980712f0 msgr2=0x7f0b9815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0b9d6ac640 1 --2- 172.21.15.55:0/3803993175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b980712f0 0x7f0b9815a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0b9d6ac640 1 -- 172.21.15.55:0/3803993175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b90009a70 con 0x7f0b980b3730 2023-07-06T21:43:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0b9d6ac640 1 --2- 172.21.15.55:0/3803993175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b980b3730 0x7f0b981545c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800d830 tx=0x7f0b8800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0b8e7fc640 1 -- 172.21.15.55:0/3803993175 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b880096a0 con 0x7f0b980b3730 2023-07-06T21:43:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0b8e7fc640 1 -- 172.21.15.55:0/3803993175 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88009800 con 0x7f0b980b3730 2023-07-06T21:43:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0b8e7fc640 1 -- 172.21.15.55:0/3803993175 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88009bb0 con 0x7f0b980b3730 2023-07-06T21:43:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0ba0111640 1 -- 172.21.15.55:0/3803993175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b980c3080 con 0x7f0b980b3730 2023-07-06T21:43:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0ba0111640 1 -- 172.21.15.55:0/3803993175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b980c3640 con 0x7f0b980b3730 2023-07-06T21:43:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.134+0000 7f0ba0111640 1 -- 172.21.15.55:0/3803993175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b980c3b20 con 0x7f0b980b3730 2023-07-06T21:43:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.138+0000 7f0b8e7fc640 1 -- 172.21.15.55:0/3803993175 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b8801e460 con 0x7f0b980b3730 2023-07-06T21:43:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.138+0000 7f0b8e7fc640 1 --2- 172.21.15.55:0/3803993175 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b7c066280 0x7f0b7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.138+0000 7f0b8e7fc640 1 -- 172.21.15.55:0/3803993175 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0b88084840 con 0x7f0b980b3730 2023-07-06T21:43:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.138+0000 7f0b9dead640 1 --2- 172.21.15.55:0/3803993175 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b7c066280 0x7f0b7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.138+0000 7f0b9dead640 1 --2- 172.21.15.55:0/3803993175 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b7c066280 0x7f0b7c068730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0b94000f70 tx=0x7f0b94007c10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:14.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.142+0000 7f0b8e7fc640 1 -- 172.21.15.55:0/3803993175 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b880518f0 con 0x7f0b980b3730 2023-07-06T21:43:14.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.326+0000 7f0ba0111640 1 -- 172.21.15.55:0/3803993175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b98066d60 con 0x7f0b980b3730 2023-07-06T21:43:14.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.326+0000 7f0b8e7fc640 1 -- 172.21.15.55:0/3803993175 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4667 (secure 0 0 0) 0x7f0b88054f10 con 0x7f0b980b3730 2023-07-06T21:43:14.336 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:14.337 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/720785920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":720785920},{"type":"v1","addr":"172.21.15.138:6834","nonce":720785920}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3780018439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3780018439},{"type":"v1","addr":"172.21.15.138:6835","nonce":3780018439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/690984517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":690984517},{"type":"v1","addr":"172.21.15.55:6837","nonce":690984517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:42:10.854280+0000","modified":"2023-07-06T21:42:29.371982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/1421414378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1421414378},{"type":"v1","addr":"172.21.15.55:6836","nonce":1421414378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T21:43:14.338 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-07-06T21:43:14.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.330+0000 7f0ba0111640 1 -- 172.21.15.55:0/3803993175 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b7c066280 msgr2=0x7f0b7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.330+0000 7f0ba0111640 1 --2- 172.21.15.55:0/3803993175 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b7c066280 0x7f0b7c068730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0b94000f70 tx=0x7f0b94007c10 comp rx=0 tx=0).stop 2023-07-06T21:43:14.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.330+0000 7f0ba0111640 1 -- 172.21.15.55:0/3803993175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b980b3730 msgr2=0x7f0b981545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.330+0000 7f0ba0111640 1 --2- 172.21.15.55:0/3803993175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b980b3730 0x7f0b981545c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800d830 tx=0x7f0b8800dcf0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.330+0000 7f0ba0111640 1 -- 172.21.15.55:0/3803993175 shutdown_connections 2023-07-06T21:43:14.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.330+0000 7f0ba0111640 1 --2- 172.21.15.55:0/3803993175 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0b7c066280 0x7f0b7c068730 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.330+0000 7f0ba0111640 1 --2- 172.21.15.55:0/3803993175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b980ca450 0x7f0b980ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.330+0000 7f0ba0111640 1 --2- 172.21.15.55:0/3803993175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b980b3730 0x7f0b981545c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.330+0000 7f0ba0111640 1 --2- 172.21.15.55:0/3803993175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b980712f0 0x7f0b9815a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.330+0000 7f0ba0111640 1 -- 172.21.15.55:0/3803993175 >> 172.21.15.55:0/3803993175 conn(0x7f0b980cded0 msgr2=0x7f0b980c9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:14.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.330+0000 7f0ba0111640 1 -- 172.21.15.55:0/3803993175 shutdown_connections 2023-07-06T21:43:14.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.330+0000 7f0ba0111640 1 -- 172.21.15.55:0/3803993175 wait complete. 2023-07-06T21:43:14.358 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:43:14.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.494+0000 7f9423d11640 1 Processor -- start 2023-07-06T21:43:14.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.494+0000 7f9423d11640 1 -- start start 2023-07-06T21:43:14.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.494+0000 7f9423d11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f941c0ca450 0x7f941c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.494+0000 7f9423d11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f941c0b3730 0x7f941c15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.494+0000 7f9423d11640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c159cd0 con 0x7f941c0712f0 2023-07-06T21:43:14.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.494+0000 7f9423d11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c0693f0 con 0x7f941c0b3730 2023-07-06T21:43:14.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.494+0000 7f9423d11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c06aca0 con 0x7f941c0ca450 2023-07-06T21:43:14.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.494+0000 7f9421aad640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f941c0712f0 0x7f941c0c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40916/0 (socket says 172.21.15.55:40916) 2023-07-06T21:43:14.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.494+0000 7f9421aad640 1 -- 172.21.15.55:0/4062993772 learned_addr learned my addr 172.21.15.55:0/4062993772 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:14.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.494+0000 7f94222ae640 1 --2- 172.21.15.55:0/4062993772 >> v2:172.21.15.55:3300/0 conn(0x7f941c0b3730 0x7f941c15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.494+0000 7f94212ac640 1 --2- 172.21.15.55:0/4062993772 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f941c0ca450 0x7f941c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.498+0000 7f94222ae640 1 -- 172.21.15.55:0/4062993772 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f941c0ca450 msgr2=0x7f941c06a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:14.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.498+0000 7f94222ae640 1 --2- 172.21.15.55:0/4062993772 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f941c0ca450 0x7f941c06a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.498+0000 7f94222ae640 1 -- 172.21.15.55:0/4062993772 >> v1:172.21.15.55:6789/0 conn(0x7f941c0712f0 legacy=0x7f941c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.498+0000 7f9420aab640 1 -- 172.21.15.55:0/4062993772 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338235353 0 0) 0x7f941c159cd0 con 0x7f941c0712f0 2023-07-06T21:43:14.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.498+0000 7f94222ae640 1 -- 172.21.15.55:0/4062993772 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0696b0 con 0x7f941c0b3730 2023-07-06T21:43:14.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.498+0000 7f94222ae640 1 --2- 172.21.15.55:0/4062993772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941c0b3730 0x7f941c15d3e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9414009d90 tx=0x7f941401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6fc6602ad37ab0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:14.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.498+0000 7f9420aab640 1 -- 172.21.15.55:0/4062993772 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94140a59e0 con 0x7f941c0b3730 2023-07-06T21:43:14.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.498+0000 7f9420aab640 1 -- 172.21.15.55:0/4062993772 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94140a5b40 con 0x7f941c0b3730 2023-07-06T21:43:14.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.498+0000 7f9420aab640 1 -- 172.21.15.55:0/4062993772 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94140ad440 con 0x7f941c0b3730 2023-07-06T21:43:14.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.498+0000 7f9423d11640 1 -- 172.21.15.55:0/4062993772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941c0b3730 msgr2=0x7f941c15d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.498+0000 7f9423d11640 1 --2- 172.21.15.55:0/4062993772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941c0b3730 0x7f941c15d3e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9414009d90 tx=0x7f941401c920 comp rx=0 tx=0).stop 2023-07-06T21:43:14.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9423d11640 1 -- 172.21.15.55:0/4062993772 shutdown_connections 2023-07-06T21:43:14.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9423d11640 1 --2- 172.21.15.55:0/4062993772 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f941c0ca450 0x7f941c06a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9423d11640 1 --2- 172.21.15.55:0/4062993772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941c0b3730 0x7f941c15d3e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9423d11640 1 -- 172.21.15.55:0/4062993772 >> 172.21.15.55:0/4062993772 conn(0x7f941c0cded0 msgr2=0x7f941c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:14.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9423d11640 1 -- 172.21.15.55:0/4062993772 shutdown_connections 2023-07-06T21:43:14.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9423d11640 1 -- 172.21.15.55:0/4062993772 wait complete. 2023-07-06T21:43:14.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9423d11640 1 Processor -- start 2023-07-06T21:43:14.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9423d11640 1 -- start start 2023-07-06T21:43:14.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9423d11640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f941c0712f0 0x7f941c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9423d11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941c0b3730 0x7f941c0c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9423d11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f941c0ca450 0x7f941c155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9423d11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c81d0 con 0x7f941c0b3730 2023-07-06T21:43:14.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9423d11640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c7550 con 0x7f941c0712f0 2023-07-06T21:43:14.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9423d11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c7830 con 0x7f941c0ca450 2023-07-06T21:43:14.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f94212ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941c0b3730 0x7f941c0c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f94212ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941c0b3730 0x7f941c0c5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60468/0 (socket says 172.21.15.55:60468) 2023-07-06T21:43:14.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f94212ac640 1 -- 172.21.15.55:0/2364829412 learned_addr learned my addr 172.21.15.55:0/2364829412 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:14.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9421aad640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f941c0712f0 0x7f941c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f94222ae640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f941c0ca450 0x7f941c155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f94212ac640 1 -- 172.21.15.55:0/2364829412 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f941c0ca450 msgr2=0x7f941c155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f94212ac640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f941c0ca450 0x7f941c155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f94212ac640 1 -- 172.21.15.55:0/2364829412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f941c0712f0 msgr2=0x7f941c0c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f94212ac640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f941c0712f0 0x7f941c0c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f94212ac640 1 -- 172.21.15.55:0/2364829412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414009a70 con 0x7f941c0b3730 2023-07-06T21:43:14.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f9421aad640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f941c0712f0 0x7f941c0c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:14.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.502+0000 7f94212ac640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941c0b3730 0x7f941c0c5200 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f940c00e840 tx=0x7f940c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:14.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.506+0000 7f94127fc640 1 -- 172.21.15.55:0/2364829412 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c009510 con 0x7f941c0b3730 2023-07-06T21:43:14.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.506+0000 7f94127fc640 1 -- 172.21.15.55:0/2364829412 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c00ee90 con 0x7f941c0b3730 2023-07-06T21:43:14.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.506+0000 7f9423d11640 1 -- 172.21.15.55:0/2364829412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c0c7b10 con 0x7f941c0b3730 2023-07-06T21:43:14.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.506+0000 7f94127fc640 1 -- 172.21.15.55:0/2364829412 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c00cb80 con 0x7f941c0b3730 2023-07-06T21:43:14.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.506+0000 7f9423d11640 1 -- 172.21.15.55:0/2364829412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c0c5740 con 0x7f941c0b3730 2023-07-06T21:43:14.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.506+0000 7f9423d11640 1 -- 172.21.15.55:0/2364829412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c066d60 con 0x7f941c0b3730 2023-07-06T21:43:14.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.506+0000 7f94127fc640 1 -- 172.21.15.55:0/2364829412 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f940c00cce0 con 0x7f941c0b3730 2023-07-06T21:43:14.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.506+0000 7f94127fc640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9400066280 0x7f9400068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.506+0000 7f94127fc640 1 -- 172.21.15.55:0/2364829412 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f940c0840e0 con 0x7f941c0b3730 2023-07-06T21:43:14.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.506+0000 7f9421aad640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9400066280 0x7f9400068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.506+0000 7f9421aad640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9400066280 0x7f9400068730 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9418000f70 tx=0x7f9418007cb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:14.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.510+0000 7f94127fc640 1 -- 172.21.15.55:0/2364829412 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f940c054d60 con 0x7f941c0b3730 2023-07-06T21:43:14.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.670+0000 7f9423d11640 1 -- 172.21.15.55:0/2364829412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f941c15cb20 con 0x7f941c0b3730 2023-07-06T21:43:14.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.674+0000 7f94127fc640 1 -- 172.21.15.55:0/2364829412 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f940c0548f0 con 0x7f941c0b3730 2023-07-06T21:43:14.680 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:14.680 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":29,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:51.480379+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:43:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.674+0000 7f9423d11640 1 -- 172.21.15.55:0/2364829412 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9400066280 msgr2=0x7f9400068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.674+0000 7f9423d11640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9400066280 0x7f9400068730 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9418000f70 tx=0x7f9418007cb0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.674+0000 7f9423d11640 1 -- 172.21.15.55:0/2364829412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941c0b3730 msgr2=0x7f941c0c5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.674+0000 7f9423d11640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941c0b3730 0x7f941c0c5200 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f940c00e840 tx=0x7f940c00ec40 comp rx=0 tx=0).stop 2023-07-06T21:43:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.674+0000 7f9423d11640 1 -- 172.21.15.55:0/2364829412 shutdown_connections 2023-07-06T21:43:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.674+0000 7f9423d11640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f9400066280 0x7f9400068730 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.674+0000 7f9423d11640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f941c0ca450 0x7f941c155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.674+0000 7f9423d11640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f941c0b3730 0x7f941c0c5200 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.674+0000 7f9423d11640 1 --2- 172.21.15.55:0/2364829412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f941c0712f0 0x7f941c0c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.674+0000 7f9423d11640 1 -- 172.21.15.55:0/2364829412 >> 172.21.15.55:0/2364829412 conn(0x7f941c0cded0 msgr2=0x7f941c0c9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:14.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.674+0000 7f9423d11640 1 -- 172.21.15.55:0/2364829412 shutdown_connections 2023-07-06T21:43:14.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.674+0000 7f9423d11640 1 -- 172.21.15.55:0/2364829412 wait complete. 2023-07-06T21:43:14.701 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T21:43:14.701 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:43:14.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda49596640 1 Processor -- start 2023-07-06T21:43:14.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda49596640 1 -- start start 2023-07-06T21:43:14.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda49596640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda441587d0 0x7fda44070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda49596640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fda440710c0 0x7fda440cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda49596640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4406fae0 con 0x7fda44158400 2023-07-06T21:43:14.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda49596640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda4406fdc0 con 0x7fda440710c0 2023-07-06T21:43:14.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda49596640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda440700a0 con 0x7fda441587d0 2023-07-06T21:43:14.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda437fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fda440710c0 0x7fda440cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda42ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fda44158400 0x7fda440c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40918/0 (socket says 172.21.15.55:40918) 2023-07-06T21:43:14.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda42ffd640 1 -- 172.21.15.55:0/3435716185 learned_addr learned my addr 172.21.15.55:0/3435716185 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:14.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda427fc640 1 --2- 172.21.15.55:0/3435716185 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda441587d0 0x7fda44070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda437fe640 1 -- 172.21.15.55:0/3435716185 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda441587d0 msgr2=0x7fda44070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:14.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda437fe640 1 --2- 172.21.15.55:0/3435716185 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda441587d0 0x7fda44070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda437fe640 1 -- 172.21.15.55:0/3435716185 >> v1:172.21.15.55:6789/0 conn(0x7fda44158400 legacy=0x7fda440c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.838+0000 7fda437fe640 1 -- 172.21.15.55:0/3435716185 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda44070380 con 0x7fda440710c0 2023-07-06T21:43:14.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.842+0000 7fda437fe640 1 --2- 172.21.15.55:0/3435716185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda440710c0 0x7fda440cbaa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009d90 tx=0x7fda3c01eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af79ad2ffce1de6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:14.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.842+0000 7fda41ffb640 1 -- 172.21.15.55:0/3435716185 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c0a7b10 con 0x7fda440710c0 2023-07-06T21:43:14.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.842+0000 7fda41ffb640 1 -- 172.21.15.55:0/3435716185 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c0a7c70 con 0x7fda440710c0 2023-07-06T21:43:14.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.842+0000 7fda41ffb640 1 -- 172.21.15.55:0/3435716185 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c0af440 con 0x7fda440710c0 2023-07-06T21:43:14.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.842+0000 7fda49596640 1 -- 172.21.15.55:0/3435716185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda440710c0 msgr2=0x7fda440cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.842+0000 7fda49596640 1 --2- 172.21.15.55:0/3435716185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda440710c0 0x7fda440cbaa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009d90 tx=0x7fda3c01eb30 comp rx=0 tx=0).stop 2023-07-06T21:43:14.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.842+0000 7fda49596640 1 -- 172.21.15.55:0/3435716185 shutdown_connections 2023-07-06T21:43:14.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.842+0000 7fda49596640 1 --2- 172.21.15.55:0/3435716185 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda441587d0 0x7fda44070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.842+0000 7fda49596640 1 --2- 172.21.15.55:0/3435716185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda440710c0 0x7fda440cbaa0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.842+0000 7fda49596640 1 -- 172.21.15.55:0/3435716185 >> 172.21.15.55:0/3435716185 conn(0x7fda440cded0 msgr2=0x7fda440ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:14.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.842+0000 7fda49596640 1 -- 172.21.15.55:0/3435716185 shutdown_connections 2023-07-06T21:43:14.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.842+0000 7fda49596640 1 -- 172.21.15.55:0/3435716185 wait complete. 2023-07-06T21:43:14.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda49596640 1 Processor -- start 2023-07-06T21:43:14.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda49596640 1 -- start start 2023-07-06T21:43:14.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda49596640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda440710c0 0x7fda441507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda49596640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda44158400 0x7fda440c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda49596640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda441587d0 0x7fda440c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda49596640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44151320 con 0x7fda44158400 2023-07-06T21:43:14.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda49596640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda441557a0 con 0x7fda441587d0 2023-07-06T21:43:14.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda49596640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda44155a80 con 0x7fda440710c0 2023-07-06T21:43:14.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda427fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda44158400 0x7fda440c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda427fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda44158400 0x7fda440c7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60482/0 (socket says 172.21.15.55:60482) 2023-07-06T21:43:14.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda427fc640 1 -- 172.21.15.55:0/3968399954 learned_addr learned my addr 172.21.15.55:0/3968399954 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:14.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda42ffd640 1 --2- 172.21.15.55:0/3968399954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda440710c0 0x7fda441507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda437fe640 1 --2- 172.21.15.55:0/3968399954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda441587d0 0x7fda440c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda427fc640 1 -- 172.21.15.55:0/3968399954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda440710c0 msgr2=0x7fda441507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda427fc640 1 --2- 172.21.15.55:0/3968399954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda440710c0 0x7fda441507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda427fc640 1 -- 172.21.15.55:0/3968399954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda441587d0 msgr2=0x7fda440c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:14.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda427fc640 1 --2- 172.21.15.55:0/3968399954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda441587d0 0x7fda440c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:14.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda427fc640 1 -- 172.21.15.55:0/3968399954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c009a70 con 0x7fda44158400 2023-07-06T21:43:14.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda427fc640 1 --2- 172.21.15.55:0/3968399954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda44158400 0x7fda440c7170 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fda3800d5f0 tx=0x7fda3800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:14.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda2b7fe640 1 -- 172.21.15.55:0/3968399954 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda380125f0 con 0x7fda44158400 2023-07-06T21:43:14.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda2b7fe640 1 -- 172.21.15.55:0/3968399954 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda38012750 con 0x7fda44158400 2023-07-06T21:43:14.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda2b7fe640 1 -- 172.21.15.55:0/3968399954 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda38012ae0 con 0x7fda44158400 2023-07-06T21:43:14.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda49596640 1 -- 172.21.15.55:0/3968399954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda44155d60 con 0x7fda44158400 2023-07-06T21:43:14.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.846+0000 7fda49596640 1 -- 172.21.15.55:0/3968399954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda44156320 con 0x7fda44158400 2023-07-06T21:43:14.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.850+0000 7fda49596640 1 -- 172.21.15.55:0/3968399954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4406c580 con 0x7fda44158400 2023-07-06T21:43:14.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.850+0000 7fda2b7fe640 1 -- 172.21.15.55:0/3968399954 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fda38012c40 con 0x7fda44158400 2023-07-06T21:43:14.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.850+0000 7fda2b7fe640 1 --2- 172.21.15.55:0/3968399954 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fda30066280 0x7fda30068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:14.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.850+0000 7fda2b7fe640 1 -- 172.21.15.55:0/3968399954 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fda38084630 con 0x7fda44158400 2023-07-06T21:43:14.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.850+0000 7fda42ffd640 1 --2- 172.21.15.55:0/3968399954 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fda30066280 0x7fda30068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:14.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.850+0000 7fda42ffd640 1 --2- 172.21.15.55:0/3968399954 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fda30066280 0x7fda30068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fda34005890 tx=0x7fda34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:14.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:14.854+0000 7fda2b7fe640 1 -- 172.21.15.55:0/3968399954 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda380516e0 con 0x7fda44158400 2023-07-06T21:43:15.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.046+0000 7fda49596640 1 -- 172.21.15.55:0/3968399954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda44066d60 con 0x7fda44158400 2023-07-06T21:43:15.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.046+0000 7fda2b7fe640 1 -- 172.21.15.55:0/3968399954 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4667 (secure 0 0 0) 0x7fda38054d00 con 0x7fda44158400 2023-07-06T21:43:15.056 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:15.056 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/720785920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":720785920},{"type":"v1","addr":"172.21.15.138:6834","nonce":720785920}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3780018439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3780018439},{"type":"v1","addr":"172.21.15.138:6835","nonce":3780018439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/690984517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":690984517},{"type":"v1","addr":"172.21.15.55:6837","nonce":690984517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:42:10.854280+0000","modified":"2023-07-06T21:42:29.371982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/1421414378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1421414378},{"type":"v1","addr":"172.21.15.55:6836","nonce":1421414378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T21:43:15.057 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-07-06T21:43:15.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.050+0000 7fda49596640 1 -- 172.21.15.55:0/3968399954 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fda30066280 msgr2=0x7fda30068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.050+0000 7fda49596640 1 --2- 172.21.15.55:0/3968399954 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fda30066280 0x7fda30068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fda34005890 tx=0x7fda34009040 comp rx=0 tx=0).stop 2023-07-06T21:43:15.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.050+0000 7fda49596640 1 -- 172.21.15.55:0/3968399954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda44158400 msgr2=0x7fda440c7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.050+0000 7fda49596640 1 --2- 172.21.15.55:0/3968399954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda44158400 0x7fda440c7170 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fda3800d5f0 tx=0x7fda3800dab0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.050+0000 7fda49596640 1 -- 172.21.15.55:0/3968399954 shutdown_connections 2023-07-06T21:43:15.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.050+0000 7fda49596640 1 --2- 172.21.15.55:0/3968399954 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fda30066280 0x7fda30068730 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.050+0000 7fda49596640 1 --2- 172.21.15.55:0/3968399954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda441587d0 0x7fda440c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.050+0000 7fda49596640 1 --2- 172.21.15.55:0/3968399954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda44158400 0x7fda440c7170 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.050+0000 7fda49596640 1 --2- 172.21.15.55:0/3968399954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda440710c0 0x7fda441507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.050+0000 7fda49596640 1 -- 172.21.15.55:0/3968399954 >> 172.21.15.55:0/3968399954 conn(0x7fda440cded0 msgr2=0x7fda440ad990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:15.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.050+0000 7fda49596640 1 -- 172.21.15.55:0/3968399954 shutdown_connections 2023-07-06T21:43:15.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.050+0000 7fda49596640 1 -- 172.21.15.55:0/3968399954 wait complete. 2023-07-06T21:43:15.076 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:43:15.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.210+0000 7f76ac767640 1 Processor -- start 2023-07-06T21:43:15.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.210+0000 7f76ac767640 1 -- start start 2023-07-06T21:43:15.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76ac767640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f76a4158400 0x7f76a40c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76ac767640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f76a40c9680 0x7f76a4070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76ac767640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76a40710c0 0x7f76a40cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76ac767640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a406fae0 con 0x7f76a4158400 2023-07-06T21:43:15.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76ac767640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a406fdc0 con 0x7f76a40c9680 2023-07-06T21:43:15.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76ac767640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40700a0 con 0x7f76a40710c0 2023-07-06T21:43:15.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76aa503640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f76a4158400 0x7f76a40c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76aa503640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f76a4158400 0x7f76a40c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60494/0 (socket says 172.21.15.55:60494) 2023-07-06T21:43:15.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76aa503640 1 -- 172.21.15.55:0/3846478968 learned_addr learned my addr 172.21.15.55:0/3846478968 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:15.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76aad04640 1 --2- 172.21.15.55:0/3846478968 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76a40710c0 0x7f76a40cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76a9d02640 1 --2- 172.21.15.55:0/3846478968 >> v2:172.21.15.138:3300/0 conn(0x7f76a40c9680 0x7f76a4070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76aa503640 1 -- 172.21.15.55:0/3846478968 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76a40710c0 msgr2=0x7f76a40cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:15.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76aa503640 1 --2- 172.21.15.55:0/3846478968 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76a40710c0 0x7f76a40cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76aa503640 1 -- 172.21.15.55:0/3846478968 >> v2:172.21.15.138:3300/0 conn(0x7f76a40c9680 msgr2=0x7f76a4070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:15.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76aa503640 1 --2- 172.21.15.55:0/3846478968 >> v2:172.21.15.138:3300/0 conn(0x7f76a40c9680 0x7f76a4070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76aa503640 1 -- 172.21.15.55:0/3846478968 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4070380 con 0x7f76a4158400 2023-07-06T21:43:15.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.214+0000 7f76a9d02640 1 --2- 172.21.15.55:0/3846478968 >> v2:172.21.15.138:3300/0 conn(0x7f76a40c9680 0x7f76a4070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:15.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76aa503640 1 --2- 172.21.15.55:0/3846478968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76a4158400 0x7f76a40c9140 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f76a406f060 tx=0x7f76a001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab490815e24c973 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:15.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76a9501640 1 -- 172.21.15.55:0/3846478968 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a00aa610 con 0x7f76a4158400 2023-07-06T21:43:15.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76a9501640 1 -- 172.21.15.55:0/3846478968 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a00a6040 con 0x7f76a4158400 2023-07-06T21:43:15.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76a9501640 1 -- 172.21.15.55:0/3846478968 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a00aa990 con 0x7f76a4158400 2023-07-06T21:43:15.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76ac767640 1 -- 172.21.15.55:0/3846478968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76a4158400 msgr2=0x7f76a40c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76ac767640 1 --2- 172.21.15.55:0/3846478968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76a4158400 0x7f76a40c9140 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f76a406f060 tx=0x7f76a001c4d0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76ac767640 1 -- 172.21.15.55:0/3846478968 shutdown_connections 2023-07-06T21:43:15.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76ac767640 1 --2- 172.21.15.55:0/3846478968 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76a40710c0 0x7f76a40cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76ac767640 1 --2- 172.21.15.55:0/3846478968 >> v2:172.21.15.138:3300/0 conn(0x7f76a40c9680 0x7f76a4070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76ac767640 1 --2- 172.21.15.55:0/3846478968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76a4158400 0x7f76a40c9140 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76ac767640 1 -- 172.21.15.55:0/3846478968 >> 172.21.15.55:0/3846478968 conn(0x7f76a40cded0 msgr2=0x7f76a40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:15.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76ac767640 1 -- 172.21.15.55:0/3846478968 shutdown_connections 2023-07-06T21:43:15.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76ac767640 1 -- 172.21.15.55:0/3846478968 wait complete. 2023-07-06T21:43:15.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76ac767640 1 Processor -- start 2023-07-06T21:43:15.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.218+0000 7f76ac767640 1 -- start start 2023-07-06T21:43:15.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76ac767640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76a40710c0 0x7f76a40c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76ac767640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76a40c9680 0x7f76a40b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76ac767640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76a4158400 0x7f76a4153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76ac767640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a4153ba0 con 0x7f76a40c9680 2023-07-06T21:43:15.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76ac767640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40c56a0 con 0x7f76a40710c0 2023-07-06T21:43:15.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76ac767640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40c5980 con 0x7f76a4158400 2023-07-06T21:43:15.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76a9d02640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76a40c9680 0x7f76a40b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76a9d02640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76a40c9680 0x7f76a40b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60502/0 (socket says 172.21.15.55:60502) 2023-07-06T21:43:15.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76a9d02640 1 -- 172.21.15.55:0/4100915557 learned_addr learned my addr 172.21.15.55:0/4100915557 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:15.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76aad04640 1 --2- 172.21.15.55:0/4100915557 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76a4158400 0x7f76a4153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76aa503640 1 --2- 172.21.15.55:0/4100915557 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76a40710c0 0x7f76a40c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76a9d02640 1 -- 172.21.15.55:0/4100915557 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76a4158400 msgr2=0x7f76a4153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76a9d02640 1 --2- 172.21.15.55:0/4100915557 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76a4158400 0x7f76a4153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76a9d02640 1 -- 172.21.15.55:0/4100915557 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76a40710c0 msgr2=0x7f76a40c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76a9d02640 1 --2- 172.21.15.55:0/4100915557 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76a40710c0 0x7f76a40c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76a9d02640 1 -- 172.21.15.55:0/4100915557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a00094d0 con 0x7f76a40c9680 2023-07-06T21:43:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76a9d02640 1 --2- 172.21.15.55:0/4100915557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76a40c9680 0x7f76a40b36b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f769400c7f0 tx=0x7f769400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f769affd640 1 -- 172.21.15.55:0/4100915557 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769400cea0 con 0x7f76a40c9680 2023-07-06T21:43:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f769affd640 1 -- 172.21.15.55:0/4100915557 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7694007a30 con 0x7f76a40c9680 2023-07-06T21:43:15.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f769affd640 1 -- 172.21.15.55:0/4100915557 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694007dc0 con 0x7f76a40c9680 2023-07-06T21:43:15.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76ac767640 1 -- 172.21.15.55:0/4100915557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a40c5c60 con 0x7f76a40c9680 2023-07-06T21:43:15.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76ac767640 1 -- 172.21.15.55:0/4100915557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a40c6220 con 0x7f76a40c9680 2023-07-06T21:43:15.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f76ac767640 1 -- 172.21.15.55:0/4100915557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a406c580 con 0x7f76a40c9680 2023-07-06T21:43:15.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.222+0000 7f769affd640 1 -- 172.21.15.55:0/4100915557 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76940113f0 con 0x7f76a40c9680 2023-07-06T21:43:15.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.226+0000 7f769affd640 1 --2- 172.21.15.55:0/4100915557 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7688066280 0x7f7688068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.226+0000 7f769affd640 1 -- 172.21.15.55:0/4100915557 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f76940842e0 con 0x7f76a40c9680 2023-07-06T21:43:15.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.226+0000 7f76aa503640 1 --2- 172.21.15.55:0/4100915557 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7688066280 0x7f7688068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.226+0000 7f76aa503640 1 --2- 172.21.15.55:0/4100915557 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7688066280 0x7f7688068730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f76a00ae000 tx=0x7f76a00b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:15.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.230+0000 7f769affd640 1 -- 172.21.15.55:0/4100915557 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76940513b0 con 0x7f76a40c9680 2023-07-06T21:43:15.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.418+0000 7f76ac767640 1 -- 172.21.15.55:0/4100915557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76a40c6440 con 0x7f76a40c9680 2023-07-06T21:43:15.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.418+0000 7f769affd640 1 -- 172.21.15.55:0/4100915557 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4667 (secure 0 0 0) 0x7f76940549d0 con 0x7f76a40c9680 2023-07-06T21:43:15.425 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:15.425 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/720785920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":720785920},{"type":"v1","addr":"172.21.15.138:6834","nonce":720785920}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3780018439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3780018439},{"type":"v1","addr":"172.21.15.138:6835","nonce":3780018439}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/690984517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":690984517},{"type":"v1","addr":"172.21.15.55:6837","nonce":690984517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:42:10.854280+0000","modified":"2023-07-06T21:42:29.371982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/1421414378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1421414378},{"type":"v1","addr":"172.21.15.55:6836","nonce":1421414378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T21:43:15.426 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-07-06T21:43:15.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.418+0000 7f76ac767640 1 -- 172.21.15.55:0/4100915557 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7688066280 msgr2=0x7f7688068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.418+0000 7f76ac767640 1 --2- 172.21.15.55:0/4100915557 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7688066280 0x7f7688068730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f76a00ae000 tx=0x7f76a00b5040 comp rx=0 tx=0).stop 2023-07-06T21:43:15.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.418+0000 7f76ac767640 1 -- 172.21.15.55:0/4100915557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76a40c9680 msgr2=0x7f76a40b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.418+0000 7f76ac767640 1 --2- 172.21.15.55:0/4100915557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76a40c9680 0x7f76a40b36b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f769400c7f0 tx=0x7f769400ccb0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.418+0000 7f76ac767640 1 -- 172.21.15.55:0/4100915557 shutdown_connections 2023-07-06T21:43:15.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.418+0000 7f76ac767640 1 --2- 172.21.15.55:0/4100915557 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f7688066280 0x7f7688068730 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.418+0000 7f76ac767640 1 --2- 172.21.15.55:0/4100915557 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76a4158400 0x7f76a4153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.418+0000 7f76ac767640 1 --2- 172.21.15.55:0/4100915557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76a40c9680 0x7f76a40b36b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.418+0000 7f76ac767640 1 --2- 172.21.15.55:0/4100915557 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76a40710c0 0x7f76a40c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.418+0000 7f76ac767640 1 -- 172.21.15.55:0/4100915557 >> 172.21.15.55:0/4100915557 conn(0x7f76a40cded0 msgr2=0x7f76a4154150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:15.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.418+0000 7f76ac767640 1 -- 172.21.15.55:0/4100915557 shutdown_connections 2023-07-06T21:43:15.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.418+0000 7f76ac767640 1 -- 172.21.15.55:0/4100915557 wait complete. 2023-07-06T21:43:15.445 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:43:15.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd9103ad640 1 Processor -- start 2023-07-06T21:43:15.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd9103ad640 1 -- start start 2023-07-06T21:43:15.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd9103ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd90806b0a0 0x7fd9080d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd9103ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9080b43d0 0x7fd9080ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd9103ad640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9080ccfe0 con 0x7fd90806acd0 2023-07-06T21:43:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd9103ad640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9080ccbe0 con 0x7fd9080b43d0 2023-07-06T21:43:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd9103ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90815c120 con 0x7fd90806b0a0 2023-07-06T21:43:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd90e94a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9080b43d0 0x7fd9080ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd90e94a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9080b43d0 0x7fd9080ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60516/0 (socket says 172.21.15.55:60516) 2023-07-06T21:43:15.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd90d948640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd90806b0a0 0x7fd9080d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd90e94a640 1 -- 172.21.15.55:0/4260443976 learned_addr learned my addr 172.21.15.55:0/4260443976 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd90e94a640 1 -- 172.21.15.55:0/4260443976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd90806b0a0 msgr2=0x7fd9080d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd90e94a640 1 --2- 172.21.15.55:0/4260443976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd90806b0a0 0x7fd9080d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd90e94a640 1 -- 172.21.15.55:0/4260443976 >> v1:172.21.15.138:6789/0 conn(0x7fd90806acd0 legacy=0x7fd9080b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.582+0000 7fd90e94a640 1 -- 172.21.15.55:0/4260443976 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9080d1010 con 0x7fd9080b43d0 2023-07-06T21:43:15.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.586+0000 7fd90e94a640 1 --2- 172.21.15.55:0/4260443976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9080b43d0 0x7fd9080ce500 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd900009e50 tx=0x7fd90001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f42f1316aebae0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:15.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.586+0000 7fd90d147640 1 -- 172.21.15.55:0/4260443976 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9000a55b0 con 0x7fd9080b43d0 2023-07-06T21:43:15.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.586+0000 7fd90d147640 1 -- 172.21.15.55:0/4260443976 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9000a5710 con 0x7fd9080b43d0 2023-07-06T21:43:15.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.586+0000 7fd90d147640 1 -- 172.21.15.55:0/4260443976 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9000a5aa0 con 0x7fd9080b43d0 2023-07-06T21:43:15.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.586+0000 7fd9103ad640 1 -- 172.21.15.55:0/4260443976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9080b43d0 msgr2=0x7fd9080ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.586+0000 7fd9103ad640 1 --2- 172.21.15.55:0/4260443976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9080b43d0 0x7fd9080ce500 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd900009e50 tx=0x7fd90001c8f0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.586+0000 7fd9103ad640 1 -- 172.21.15.55:0/4260443976 shutdown_connections 2023-07-06T21:43:15.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.586+0000 7fd9103ad640 1 --2- 172.21.15.55:0/4260443976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9080b43d0 0x7fd9080ce500 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.586+0000 7fd9103ad640 1 --2- 172.21.15.55:0/4260443976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd90806b0a0 0x7fd9080d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.586+0000 7fd9103ad640 1 -- 172.21.15.55:0/4260443976 >> 172.21.15.55:0/4260443976 conn(0x7fd90806bb30 msgr2=0x7fd90806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:15.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.586+0000 7fd9103ad640 1 -- 172.21.15.55:0/4260443976 shutdown_connections 2023-07-06T21:43:15.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.586+0000 7fd9103ad640 1 -- 172.21.15.55:0/4260443976 wait complete. 2023-07-06T21:43:15.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd9103ad640 1 Processor -- start 2023-07-06T21:43:15.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd9103ad640 1 -- start start 2023-07-06T21:43:15.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd9103ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd90806acd0 0x7fd908167540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd9103ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd90806b0a0 0x7fd908153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd9103ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9080b43d0 0x7fd9080c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd9103ad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080c82e0 con 0x7fd9080b43d0 2023-07-06T21:43:15.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd9103ad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9081536d0 con 0x7fd90806acd0 2023-07-06T21:43:15.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd9103ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080c7630 con 0x7fd90806b0a0 2023-07-06T21:43:15.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd90e94a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9080b43d0 0x7fd9080c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd90e94a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9080b43d0 0x7fd9080c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60526/0 (socket says 172.21.15.55:60526) 2023-07-06T21:43:15.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd90e94a640 1 -- 172.21.15.55:0/240742687 learned_addr learned my addr 172.21.15.55:0/240742687 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:15.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd90d948640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd90806b0a0 0x7fd908153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd90e149640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd90806acd0 0x7fd908167540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd90e94a640 1 -- 172.21.15.55:0/240742687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd90806b0a0 msgr2=0x7fd908153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd90e94a640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd90806b0a0 0x7fd908153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd90e94a640 1 -- 172.21.15.55:0/240742687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd90806acd0 msgr2=0x7fd908167540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd90e94a640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd90806acd0 0x7fd908167540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd90e94a640 1 -- 172.21.15.55:0/240742687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd900009b30 con 0x7fd9080b43d0 2023-07-06T21:43:15.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd90e149640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd90806acd0 0x7fd908167540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:15.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd90e94a640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9080b43d0 0x7fd9080c6280 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd900009e50 tx=0x7fd900019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:15.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd8feffd640 1 -- 172.21.15.55:0/240742687 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9000a55b0 con 0x7fd9080b43d0 2023-07-06T21:43:15.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd8feffd640 1 -- 172.21.15.55:0/240742687 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9000b8670 con 0x7fd9080b43d0 2023-07-06T21:43:15.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd9103ad640 1 -- 172.21.15.55:0/240742687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9080c9ec0 con 0x7fd9080b43d0 2023-07-06T21:43:15.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd8feffd640 1 -- 172.21.15.55:0/240742687 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9000b8a00 con 0x7fd9080b43d0 2023-07-06T21:43:15.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd9103ad640 1 -- 172.21.15.55:0/240742687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9080ca480 con 0x7fd9080b43d0 2023-07-06T21:43:15.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.590+0000 7fd9103ad640 1 -- 172.21.15.55:0/240742687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd908066d60 con 0x7fd9080b43d0 2023-07-06T21:43:15.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.594+0000 7fd8feffd640 1 -- 172.21.15.55:0/240742687 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd9000b8b60 con 0x7fd9080b43d0 2023-07-06T21:43:15.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.594+0000 7fd8feffd640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd8ec066280 0x7fd8ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.594+0000 7fd8feffd640 1 -- 172.21.15.55:0/240742687 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd90011f460 con 0x7fd9080b43d0 2023-07-06T21:43:15.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.594+0000 7fd90e149640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd8ec066280 0x7fd8ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.594+0000 7fd90e149640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd8ec066280 0x7fd8ec068730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd9080c8e00 tx=0x7fd904009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:15.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.598+0000 7fd8feffd640 1 -- 172.21.15.55:0/240742687 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9000ec6c0 con 0x7fd9080b43d0 2023-07-06T21:43:15.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.766+0000 7fd9103ad640 1 -- 172.21.15.55:0/240742687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9080d1010 con 0x7fd9080b43d0 2023-07-06T21:43:15.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.766+0000 7fd8feffd640 1 -- 172.21.15.55:0/240742687 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fd9080d1010 con 0x7fd9080b43d0 2023-07-06T21:43:15.773 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:15.773 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":29,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:42:51.480379+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:42:08.597013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T21:42:09.843890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T21:42:12.918111+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:43:15.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.766+0000 7fd9103ad640 1 -- 172.21.15.55:0/240742687 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd8ec066280 msgr2=0x7fd8ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.766+0000 7fd9103ad640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd8ec066280 0x7fd8ec068730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd9080c8e00 tx=0x7fd904009040 comp rx=0 tx=0).stop 2023-07-06T21:43:15.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.766+0000 7fd9103ad640 1 -- 172.21.15.55:0/240742687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9080b43d0 msgr2=0x7fd9080c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.766+0000 7fd9103ad640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9080b43d0 0x7fd9080c6280 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd900009e50 tx=0x7fd900019690 comp rx=0 tx=0).stop 2023-07-06T21:43:15.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.766+0000 7fd9103ad640 1 -- 172.21.15.55:0/240742687 shutdown_connections 2023-07-06T21:43:15.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.766+0000 7fd9103ad640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd8ec066280 0x7fd8ec068730 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.766+0000 7fd9103ad640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9080b43d0 0x7fd9080c6280 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.766+0000 7fd9103ad640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd90806b0a0 0x7fd908153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.766+0000 7fd9103ad640 1 --2- 172.21.15.55:0/240742687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd90806acd0 0x7fd908167540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.766+0000 7fd9103ad640 1 -- 172.21.15.55:0/240742687 >> 172.21.15.55:0/240742687 conn(0x7fd90806bb30 msgr2=0x7fd9081569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:15.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.766+0000 7fd9103ad640 1 -- 172.21.15.55:0/240742687 shutdown_connections 2023-07-06T21:43:15.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.766+0000 7fd9103ad640 1 -- 172.21.15.55:0/240742687 wait complete. 2023-07-06T21:43:15.795 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T21:43:15.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.930+0000 7fdcff007640 1 Processor -- start 2023-07-06T21:43:15.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.930+0000 7fdcff007640 1 -- start start 2023-07-06T21:43:15.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcff007640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcf8156180 0x7fdcf80ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcff007640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdcf806e9d0 0x7fdcf806ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcff007640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdcf80cb7a0 0x7fdcf80cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcff007640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf8160250 con 0x7fdcf806e9d0 2023-07-06T21:43:15.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcff007640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf806f360 con 0x7fdcf80cb7a0 2023-07-06T21:43:15.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcff007640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf815f5d0 con 0x7fdcf8156180 2023-07-06T21:43:15.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcf7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdcf806e9d0 0x7fdcf806ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcf7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdcf806e9d0 0x7fdcf806ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60542/0 (socket says 172.21.15.55:60542) 2023-07-06T21:43:15.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcf7fff640 1 -- 172.21.15.55:0/2723201124 learned_addr learned my addr 172.21.15.55:0/2723201124 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:15.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcfcda3640 1 --2- 172.21.15.55:0/2723201124 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcf8156180 0x7fdcf80ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcfd5a4640 1 --2- 172.21.15.55:0/2723201124 >> v2:172.21.15.138:3300/0 conn(0x7fdcf80cb7a0 0x7fdcf80cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcf7fff640 1 -- 172.21.15.55:0/2723201124 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcf8156180 msgr2=0x7fdcf80ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:15.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcf7fff640 1 --2- 172.21.15.55:0/2723201124 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcf8156180 0x7fdcf80ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcf7fff640 1 -- 172.21.15.55:0/2723201124 >> v2:172.21.15.138:3300/0 conn(0x7fdcf80cb7a0 msgr2=0x7fdcf80cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:15.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcf7fff640 1 --2- 172.21.15.55:0/2723201124 >> v2:172.21.15.138:3300/0 conn(0x7fdcf80cb7a0 0x7fdcf80cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcf7fff640 1 -- 172.21.15.55:0/2723201124 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf815f8b0 con 0x7fdcf806e9d0 2023-07-06T21:43:15.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcfd5a4640 1 --2- 172.21.15.55:0/2723201124 >> v2:172.21.15.138:3300/0 conn(0x7fdcf80cb7a0 0x7fdcf80cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:15.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcfcda3640 1 --2- 172.21.15.55:0/2723201124 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcf8156180 0x7fdcf80ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:15.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcf7fff640 1 --2- 172.21.15.55:0/2723201124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcf806e9d0 0x7fdcf806ee20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8072220 tx=0x7fdce401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb3c0e087aa6a8d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:15.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcf77fe640 1 -- 172.21.15.55:0/2723201124 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40ab600 con 0x7fdcf806e9d0 2023-07-06T21:43:15.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcf77fe640 1 -- 172.21.15.55:0/2723201124 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce40ab760 con 0x7fdcf806e9d0 2023-07-06T21:43:15.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.934+0000 7fdcf77fe640 1 -- 172.21.15.55:0/2723201124 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40abaf0 con 0x7fdcf806e9d0 2023-07-06T21:43:15.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 -- 172.21.15.55:0/2723201124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcf806e9d0 msgr2=0x7fdcf806ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 --2- 172.21.15.55:0/2723201124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcf806e9d0 0x7fdcf806ee20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8072220 tx=0x7fdce401c440 comp rx=0 tx=0).stop 2023-07-06T21:43:15.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 -- 172.21.15.55:0/2723201124 shutdown_connections 2023-07-06T21:43:15.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 --2- 172.21.15.55:0/2723201124 >> v2:172.21.15.138:3300/0 conn(0x7fdcf80cb7a0 0x7fdcf80cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 --2- 172.21.15.55:0/2723201124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcf806e9d0 0x7fdcf806ee20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 --2- 172.21.15.55:0/2723201124 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcf8156180 0x7fdcf80ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 -- 172.21.15.55:0/2723201124 >> 172.21.15.55:0/2723201124 conn(0x7fdcf80d0c50 msgr2=0x7fdcf80cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:15.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 -- 172.21.15.55:0/2723201124 shutdown_connections 2023-07-06T21:43:15.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 -- 172.21.15.55:0/2723201124 wait complete. 2023-07-06T21:43:15.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 Processor -- start 2023-07-06T21:43:15.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 -- start start 2023-07-06T21:43:15.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcf806e9d0 0x7fdcf80c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80cb7a0 0x7fdcf80c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcf8156180 0x7fdcf8150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80c57c0 con 0x7fdcf806e9d0 2023-07-06T21:43:15.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80c71c0 con 0x7fdcf80cb7a0 2023-07-06T21:43:15.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcff007640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80c74a0 con 0x7fdcf8156180 2023-07-06T21:43:15.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcfcda3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcf806e9d0 0x7fdcf80c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcfcda3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcf806e9d0 0x7fdcf80c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60546/0 (socket says 172.21.15.55:60546) 2023-07-06T21:43:15.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcfcda3640 1 -- 172.21.15.55:0/265046991 learned_addr learned my addr 172.21.15.55:0/265046991 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:15.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcf7fff640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80cb7a0 0x7fdcf80c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.938+0000 7fdcfd5a4640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcf8156180 0x7fdcf8150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcfcda3640 1 -- 172.21.15.55:0/265046991 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcf8156180 msgr2=0x7fdcf8150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcfcda3640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcf8156180 0x7fdcf8150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcfcda3640 1 -- 172.21.15.55:0/265046991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80cb7a0 msgr2=0x7fdcf80c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:15.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcfcda3640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80cb7a0 0x7fdcf80c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:15.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcfcda3640 1 -- 172.21.15.55:0/265046991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce40094d0 con 0x7fdcf806e9d0 2023-07-06T21:43:15.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcfd5a4640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcf8156180 0x7fdcf8150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:15.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcfcda3640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcf806e9d0 0x7fdcf80c7cd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00c7f0 tx=0x7fdcec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:15.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcf57fa640 1 -- 172.21.15.55:0/265046991 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec007820 con 0x7fdcf806e9d0 2023-07-06T21:43:15.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcf57fa640 1 -- 172.21.15.55:0/265046991 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec007980 con 0x7fdcf806e9d0 2023-07-06T21:43:15.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcff007640 1 -- 172.21.15.55:0/265046991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf80c53e0 con 0x7fdcf806e9d0 2023-07-06T21:43:15.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcf57fa640 1 -- 172.21.15.55:0/265046991 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec007d30 con 0x7fdcf806e9d0 2023-07-06T21:43:15.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcff007640 1 -- 172.21.15.55:0/265046991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf80c7780 con 0x7fdcf806e9d0 2023-07-06T21:43:15.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcff007640 1 -- 172.21.15.55:0/265046991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf8066d60 con 0x7fdcf806e9d0 2023-07-06T21:43:15.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcf57fa640 1 -- 172.21.15.55:0/265046991 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdcec0113f0 con 0x7fdcf806e9d0 2023-07-06T21:43:15.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcf57fa640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fdcdc066280 0x7fdcdc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:15.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcf57fa640 1 -- 172.21.15.55:0/265046991 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdcec084300 con 0x7fdcf806e9d0 2023-07-06T21:43:15.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.942+0000 7fdcf7fff640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fdcdc066280 0x7fdcdc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:15.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.946+0000 7fdcf7fff640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fdcdc066280 0x7fdcdc068730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdce40af000 tx=0x7fdce40b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:15.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:15.946+0000 7fdcf57fa640 1 -- 172.21.15.55:0/265046991 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdcec0514f0 con 0x7fdcf806e9d0 2023-07-06T21:43:16.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.138+0000 7fdcff007640 1 -- 172.21.15.55:0/265046991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdcf80cd930 con 0x7fdcf806e9d0 2023-07-06T21:43:16.618 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-07-06T21:43:16.610+0000 7f5b6d80c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T21:43:16.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.622+0000 7fdcf57fa640 1 -- 172.21.15.55:0/265046991 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdcec054b10 con 0x7fdcf806e9d0 2023-07-06T21:43:16.629 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T21:43:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.622+0000 7fdcff007640 1 -- 172.21.15.55:0/265046991 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fdcdc066280 msgr2=0x7fdcdc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.622+0000 7fdcff007640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fdcdc066280 0x7fdcdc068730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdce40af000 tx=0x7fdce40b6040 comp rx=0 tx=0).stop 2023-07-06T21:43:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.622+0000 7fdcff007640 1 -- 172.21.15.55:0/265046991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcf806e9d0 msgr2=0x7fdcf80c7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.622+0000 7fdcff007640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcf806e9d0 0x7fdcf80c7cd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00c7f0 tx=0x7fdcec00ccb0 comp rx=0 tx=0).stop 2023-07-06T21:43:16.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.622+0000 7fdcff007640 1 -- 172.21.15.55:0/265046991 shutdown_connections 2023-07-06T21:43:16.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.622+0000 7fdcff007640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fdcdc066280 0x7fdcdc068730 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:16.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.622+0000 7fdcff007640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcf8156180 0x7fdcf8150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:16.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.622+0000 7fdcff007640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80cb7a0 0x7fdcf80c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:16.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.622+0000 7fdcff007640 1 --2- 172.21.15.55:0/265046991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcf806e9d0 0x7fdcf80c7cd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:16.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.622+0000 7fdcff007640 1 -- 172.21.15.55:0/265046991 >> 172.21.15.55:0/265046991 conn(0x7fdcf80d0c50 msgr2=0x7fdcf81554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.622+0000 7fdcff007640 1 -- 172.21.15.55:0/265046991 shutdown_connections 2023-07-06T21:43:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.622+0000 7fdcff007640 1 -- 172.21.15.55:0/265046991 wait complete. 2023-07-06T21:43:16.637 INFO:tasks.ceph.mds.a.smithi055.stderr: -4941> 2023-07-06T21:42:16.564+0000 7ff7c2b71640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T21:43:16.654 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T21:43:16.689 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-07-06T21:43:16.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.794+0000 7fd28a1d2640 1 Processor -- start 2023-07-06T21:43:16.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.794+0000 7fd28a1d2640 1 -- start start 2023-07-06T21:43:16.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.794+0000 7fd28a1d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd284070d70 0x7fd2840b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:16.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.798+0000 7fd28a1d2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd2840b1170 0x7fd28406eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:16.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.798+0000 7fd28a1d2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2840cc030 con 0x7fd2840709a0 2023-07-06T21:43:16.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.798+0000 7fd28a1d2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2840b15f0 con 0x7fd2840b1170 2023-07-06T21:43:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.798+0000 7fd28a1d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2840cc300 con 0x7fd284070d70 2023-07-06T21:43:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.798+0000 7fd282ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd284070d70 0x7fd2840b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.798+0000 7fd283fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd2840b1170 0x7fd28406eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.798+0000 7fd282ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd284070d70 0x7fd2840b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:40206/0 (socket says 172.21.15.55:40206) 2023-07-06T21:43:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.798+0000 7fd282ffd640 1 -- 172.21.15.55:0/778174037 learned_addr learned my addr 172.21.15.55:0/778174037 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.798+0000 7fd283fff640 1 -- 172.21.15.55:0/778174037 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd284070d70 msgr2=0x7fd2840b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.798+0000 7fd283fff640 1 --2- 172.21.15.55:0/778174037 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd284070d70 0x7fd2840b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:16.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.798+0000 7fd283fff640 1 -- 172.21.15.55:0/778174037 >> v1:172.21.15.138:6789/0 conn(0x7fd2840709a0 legacy=0x7fd2840cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:16.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.798+0000 7fd283fff640 1 -- 172.21.15.55:0/778174037 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2840cc5e0 con 0x7fd2840b1170 2023-07-06T21:43:16.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.798+0000 7fd283fff640 1 --2- 172.21.15.55:0/778174037 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2840b1170 0x7fd28406eee0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd27c009dc0 tx=0x7fd27c01c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd53db26e365c1ca server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:16.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd2827fc640 1 -- 172.21.15.55:0/778174037 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c0a5850 con 0x7fd2840b1170 2023-07-06T21:43:16.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd2827fc640 1 -- 172.21.15.55:0/778174037 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c0a59b0 con 0x7fd2840b1170 2023-07-06T21:43:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd2827fc640 1 -- 172.21.15.55:0/778174037 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c0a5d40 con 0x7fd2840b1170 2023-07-06T21:43:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 -- 172.21.15.55:0/778174037 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2840b1170 msgr2=0x7fd28406eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 --2- 172.21.15.55:0/778174037 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2840b1170 0x7fd28406eee0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd27c009dc0 tx=0x7fd27c01c8a0 comp rx=0 tx=0).stop 2023-07-06T21:43:16.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 -- 172.21.15.55:0/778174037 shutdown_connections 2023-07-06T21:43:16.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 --2- 172.21.15.55:0/778174037 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2840b1170 0x7fd28406eee0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:16.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 --2- 172.21.15.55:0/778174037 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd284070d70 0x7fd2840b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:16.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 -- 172.21.15.55:0/778174037 >> 172.21.15.55:0/778174037 conn(0x7fd2840cea70 msgr2=0x7fd2840ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:16.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 -- 172.21.15.55:0/778174037 shutdown_connections 2023-07-06T21:43:16.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 -- 172.21.15.55:0/778174037 wait complete. 2023-07-06T21:43:16.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 Processor -- start 2023-07-06T21:43:16.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 -- start start 2023-07-06T21:43:16.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2840709a0 0x7fd2840af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:16.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd284070d70 0x7fd284160d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:16.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2840b1170 0x7fd2841f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:16.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd284162120 con 0x7fd2840b1170 2023-07-06T21:43:16.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd284161290 con 0x7fd2840709a0 2023-07-06T21:43:16.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.802+0000 7fd28a1d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2841f4bc0 con 0x7fd284070d70 2023-07-06T21:43:16.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd283fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2840b1170 0x7fd2841f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:16.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd283fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2840b1170 0x7fd2841f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60574/0 (socket says 172.21.15.55:60574) 2023-07-06T21:43:16.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd283fff640 1 -- 172.21.15.55:0/944858596 learned_addr learned my addr 172.21.15.55:0/944858596 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:16.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd2837fe640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2840709a0 0x7fd2840af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:16.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd282ffd640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd284070d70 0x7fd284160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:16.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd283fff640 1 -- 172.21.15.55:0/944858596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd284070d70 msgr2=0x7fd284160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:16.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd283fff640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd284070d70 0x7fd284160d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:16.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd283fff640 1 -- 172.21.15.55:0/944858596 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2840709a0 msgr2=0x7fd2840af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:16.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd283fff640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2840709a0 0x7fd2840af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:16.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd283fff640 1 -- 172.21.15.55:0/944858596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c009a70 con 0x7fd2840b1170 2023-07-06T21:43:16.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd282ffd640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd284070d70 0x7fd284160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:16.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd2837fe640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2840709a0 0x7fd2840af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:16.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd283fff640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2840b1170 0x7fd2841f4680 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd27c01af50 tx=0x7fd27c019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:16.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd26bfff640 1 -- 172.21.15.55:0/944858596 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c0b9860 con 0x7fd2840b1170 2023-07-06T21:43:16.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd26bfff640 1 -- 172.21.15.55:0/944858596 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c0b99c0 con 0x7fd2840b1170 2023-07-06T21:43:16.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd28a1d2640 1 -- 172.21.15.55:0/944858596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd284161510 con 0x7fd2840b1170 2023-07-06T21:43:16.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd26bfff640 1 -- 172.21.15.55:0/944858596 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c0b9d70 con 0x7fd2840b1170 2023-07-06T21:43:16.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd28a1d2640 1 -- 172.21.15.55:0/944858596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd284161ad0 con 0x7fd2840b1170 2023-07-06T21:43:16.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd28a1d2640 1 -- 172.21.15.55:0/944858596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2841622d0 con 0x7fd2840b1170 2023-07-06T21:43:16.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.806+0000 7fd26bfff640 1 -- 172.21.15.55:0/944858596 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd27c0ad440 con 0x7fd2840b1170 2023-07-06T21:43:16.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.810+0000 7fd26bfff640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd270066280 0x7fd270068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:16.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.810+0000 7fd26bfff640 1 -- 172.21.15.55:0/944858596 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fd27c11f420 con 0x7fd2840b1170 2023-07-06T21:43:16.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.810+0000 7fd2837fe640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd270066280 0x7fd270068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:16.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.810+0000 7fd2837fe640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd270066280 0x7fd270068730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd274000f70 tx=0x7fd274009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:16.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:16.810+0000 7fd26bfff640 1 -- 172.21.15.55:0/944858596 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2841622d0 con 0x7fd2840b1170 2023-07-06T21:43:17.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.002+0000 7fd28a1d2640 1 -- 172.21.15.55:0/944858596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd28409eae0 con 0x7fd2840b1170 2023-07-06T21:43:17.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.630+0000 7fd26bfff640 1 -- 172.21.15.55:0/944858596 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd27c0f0030 con 0x7fd2840b1170 2023-07-06T21:43:17.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.630+0000 7fd28a1d2640 1 -- 172.21.15.55:0/944858596 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd270066280 msgr2=0x7fd270068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:17.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.630+0000 7fd28a1d2640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd270066280 0x7fd270068730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd274000f70 tx=0x7fd274009040 comp rx=0 tx=0).stop 2023-07-06T21:43:17.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.630+0000 7fd28a1d2640 1 -- 172.21.15.55:0/944858596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2840b1170 msgr2=0x7fd2841f4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:17.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.630+0000 7fd28a1d2640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2840b1170 0x7fd2841f4680 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd27c01af50 tx=0x7fd27c019640 comp rx=0 tx=0).stop 2023-07-06T21:43:17.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.630+0000 7fd28a1d2640 1 -- 172.21.15.55:0/944858596 shutdown_connections 2023-07-06T21:43:17.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.630+0000 7fd28a1d2640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd270066280 0x7fd270068730 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:17.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.630+0000 7fd28a1d2640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2840b1170 0x7fd2841f4680 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:17.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.630+0000 7fd28a1d2640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd284070d70 0x7fd284160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:17.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.630+0000 7fd28a1d2640 1 --2- 172.21.15.55:0/944858596 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2840709a0 0x7fd2840af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:17.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.630+0000 7fd28a1d2640 1 -- 172.21.15.55:0/944858596 >> 172.21.15.55:0/944858596 conn(0x7fd2840cea70 msgr2=0x7fd28406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:17.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.634+0000 7fd28a1d2640 1 -- 172.21.15.55:0/944858596 shutdown_connections 2023-07-06T21:43:17.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.634+0000 7fd28a1d2640 1 -- 172.21.15.55:0/944858596 wait complete. 2023-07-06T21:43:17.662 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T21:43:17.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.850+0000 7fd55cc9c640 1 Processor -- start 2023-07-06T21:43:17.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.850+0000 7fd55cc9c640 1 -- start start 2023-07-06T21:43:17.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.850+0000 7fd55cc9c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd55815dd50 0x7fd558069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:17.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.850+0000 7fd55cc9c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5580b3e70 con 0x7fd5580c9b90 2023-07-06T21:43:17.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.850+0000 7fd55cc9c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd558159c30 con 0x7fd5580ccb70 2023-07-06T21:43:17.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.850+0000 7fd55cc9c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5580c9070 con 0x7fd55815dd50 2023-07-06T21:43:17.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.850+0000 7fd55659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd5580c9b90 0x7fd5580c9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40942/0 (socket says 172.21.15.55:40942) 2023-07-06T21:43:17.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.850+0000 7fd55659c640 1 -- 172.21.15.55:0/3919991148 learned_addr learned my addr 172.21.15.55:0/3919991148 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:17.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.854+0000 7fd556d9d640 1 --2- 172.21.15.55:0/3919991148 >> v2:172.21.15.138:3300/0 conn(0x7fd55815dd50 0x7fd558069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:17.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.854+0000 7fd555d9b640 1 -- 172.21.15.55:0/3919991148 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924279043 0 0) 0x7fd548001120 con 0x7fd5580c9b90 2023-07-06T21:43:17.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.854+0000 7fd555d9b640 1 -- 172.21.15.55:0/3919991148 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd544003530 con 0x7fd5580c9b90 2023-07-06T21:43:17.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.854+0000 7fd556d9d640 1 -- 172.21.15.55:0/3919991148 >> v1:172.21.15.138:6789/0 conn(0x7fd5580ccb70 legacy=0x7fd5580693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:17.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.854+0000 7fd555d9b640 1 -- 172.21.15.55:0/3919991148 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2223614471 0 0) 0x7fd544003530 con 0x7fd5580c9b90 2023-07-06T21:43:17.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.854+0000 7fd556d9d640 1 -- 172.21.15.55:0/3919991148 >> v1:172.21.15.55:6789/0 conn(0x7fd5580c9b90 legacy=0x7fd5580c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:17.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.854+0000 7fd556d9d640 1 -- 172.21.15.55:0/3919991148 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5580c8480 con 0x7fd55815dd50 2023-07-06T21:43:17.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.854+0000 7fd556d9d640 1 --2- 172.21.15.55:0/3919991148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd55815dd50 0x7fd558069b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd550009d90 tx=0x7fd55001c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97169a053d5bbc9d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:17.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.854+0000 7fd555d9b640 1 -- 172.21.15.55:0/3919991148 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548001810 con 0x7fd55815dd50 2023-07-06T21:43:17.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.854+0000 7fd555d9b640 1 -- 172.21.15.55:0/3919991148 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5500a6490 con 0x7fd55815dd50 2023-07-06T21:43:17.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.854+0000 7fd555d9b640 1 -- 172.21.15.55:0/3919991148 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5500a6820 con 0x7fd55815dd50 2023-07-06T21:43:17.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 -- 172.21.15.55:0/3919991148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd55815dd50 msgr2=0x7fd558069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:17.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 --2- 172.21.15.55:0/3919991148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd55815dd50 0x7fd558069b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd550009d90 tx=0x7fd55001c6f0 comp rx=0 tx=0).stop 2023-07-06T21:43:17.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 -- 172.21.15.55:0/3919991148 shutdown_connections 2023-07-06T21:43:17.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 --2- 172.21.15.55:0/3919991148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd55815dd50 0x7fd558069b00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:17.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 -- 172.21.15.55:0/3919991148 >> 172.21.15.55:0/3919991148 conn(0x7fd5580cde30 msgr2=0x7fd5580ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:17.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 -- 172.21.15.55:0/3919991148 shutdown_connections 2023-07-06T21:43:17.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 -- 172.21.15.55:0/3919991148 wait complete. 2023-07-06T21:43:17.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 Processor -- start 2023-07-06T21:43:17.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 -- start start 2023-07-06T21:43:17.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5580c9b90 0x7fd55815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:17.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5580ccb70 0x7fd558151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:17.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd55815dd50 0x7fd558159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:17.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55815a320 con 0x7fd5580c9b90 2023-07-06T21:43:17.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55815bb00 con 0x7fd5580ccb70 2023-07-06T21:43:17.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55cc9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55815bde0 con 0x7fd55815dd50 2023-07-06T21:43:17.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5580c9b90 0x7fd55815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:17.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5580c9b90 0x7fd55815c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60590/0 (socket says 172.21.15.55:60590) 2023-07-06T21:43:17.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55659c640 1 -- 172.21.15.55:0/2259449897 learned_addr learned my addr 172.21.15.55:0/2259449897 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:17.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd54ffff640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5580ccb70 0x7fd558151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:17.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd556d9d640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd55815dd50 0x7fd558159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:17.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.858+0000 7fd55659c640 1 -- 172.21.15.55:0/2259449897 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd55815dd50 msgr2=0x7fd558159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:17.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd55659c640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd55815dd50 0x7fd558159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:17.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd55659c640 1 -- 172.21.15.55:0/2259449897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5580ccb70 msgr2=0x7fd558151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:17.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd55659c640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5580ccb70 0x7fd558151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:17.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd55659c640 1 -- 172.21.15.55:0/2259449897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd550009a70 con 0x7fd5580c9b90 2023-07-06T21:43:17.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd54ffff640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5580ccb70 0x7fd558151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:17.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd55659c640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5580c9b90 0x7fd55815c8c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd548001520 tx=0x7fd54800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:17.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd54effd640 1 -- 172.21.15.55:0/2259449897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480072d0 con 0x7fd5580c9b90 2023-07-06T21:43:17.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd54effd640 1 -- 172.21.15.55:0/2259449897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd548007450 con 0x7fd5580c9b90 2023-07-06T21:43:17.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd55cc9c640 1 -- 172.21.15.55:0/2259449897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55815c0c0 con 0x7fd5580c9b90 2023-07-06T21:43:17.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd54effd640 1 -- 172.21.15.55:0/2259449897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480047f0 con 0x7fd5580c9b90 2023-07-06T21:43:17.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd55cc9c640 1 -- 172.21.15.55:0/2259449897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55815b740 con 0x7fd5580c9b90 2023-07-06T21:43:17.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd55cc9c640 1 -- 172.21.15.55:0/2259449897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5580c94e0 con 0x7fd5580c9b90 2023-07-06T21:43:17.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd54effd640 1 -- 172.21.15.55:0/2259449897 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd548004950 con 0x7fd5580c9b90 2023-07-06T21:43:17.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd54effd640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd538066280 0x7fd538068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:17.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd54effd640 1 -- 172.21.15.55:0/2259449897 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fd548083600 con 0x7fd5580c9b90 2023-07-06T21:43:17.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.862+0000 7fd54ffff640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd538066280 0x7fd538068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:17.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.866+0000 7fd54ffff640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd538066280 0x7fd538068730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd5580b18c0 tx=0x7fd540009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:17.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:17.866+0000 7fd54effd640 1 -- 172.21.15.55:0/2259449897 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5580c94e0 con 0x7fd5580c9b90 2023-07-06T21:43:18.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.026+0000 7fd55cc9c640 1 -- 172.21.15.55:0/2259449897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd55815bc40 con 0x7fd5580c9b90 2023-07-06T21:43:18.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.646+0000 7fd54effd640 1 -- 172.21.15.55:0/2259449897 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd55815bc40 con 0x7fd5580c9b90 2023-07-06T21:43:18.652 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-07-06T21:43:18.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.650+0000 7fd55cc9c640 1 -- 172.21.15.55:0/2259449897 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd538066280 msgr2=0x7fd538068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:18.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.650+0000 7fd55cc9c640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd538066280 0x7fd538068730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd5580b18c0 tx=0x7fd540009040 comp rx=0 tx=0).stop 2023-07-06T21:43:18.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.650+0000 7fd55cc9c640 1 -- 172.21.15.55:0/2259449897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5580c9b90 msgr2=0x7fd55815c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:18.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.650+0000 7fd55cc9c640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5580c9b90 0x7fd55815c8c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd548001520 tx=0x7fd54800cbe0 comp rx=0 tx=0).stop 2023-07-06T21:43:18.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.650+0000 7fd55cc9c640 1 -- 172.21.15.55:0/2259449897 shutdown_connections 2023-07-06T21:43:18.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.650+0000 7fd55cc9c640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd538066280 0x7fd538068730 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:18.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.650+0000 7fd55cc9c640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd55815dd50 0x7fd558159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:18.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.650+0000 7fd55cc9c640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5580ccb70 0x7fd558151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:18.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.650+0000 7fd55cc9c640 1 --2- 172.21.15.55:0/2259449897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5580c9b90 0x7fd55815c8c0 secure :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd548001520 tx=0x7fd54800cbe0 comp rx=0 tx=0).stop 2023-07-06T21:43:18.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.650+0000 7fd55cc9c640 1 -- 172.21.15.55:0/2259449897 >> 172.21.15.55:0/2259449897 conn(0x7fd5580cde30 msgr2=0x7fd5580c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:18.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.650+0000 7fd55cc9c640 1 -- 172.21.15.55:0/2259449897 shutdown_connections 2023-07-06T21:43:18.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.650+0000 7fd55cc9c640 1 -- 172.21.15.55:0/2259449897 wait complete. 2023-07-06T21:43:18.683 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T21:43:18.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.826+0000 7fc5ce0cb640 1 Processor -- start 2023-07-06T21:43:18.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.826+0000 7fc5ce0cb640 1 -- start start 2023-07-06T21:43:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5ce0cb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc5c806a460 0x7fc5c80caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:18.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5ce0cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c80cc650 con 0x7fc5c806f960 2023-07-06T21:43:18.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5ce0cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c806d130 con 0x7fc5c806cb40 2023-07-06T21:43:18.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5ce0cb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c806bac0 con 0x7fc5c806a460 2023-07-06T21:43:18.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc5c806f960 0x7fc5c806fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40946/0 (socket says 172.21.15.55:40946) 2023-07-06T21:43:18.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c7fff640 1 -- 172.21.15.55:0/783956848 learned_addr learned my addr 172.21.15.55:0/783956848 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:18.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c77fe640 1 --2- 172.21.15.55:0/783956848 >> v2:172.21.15.138:3300/0 conn(0x7fc5c806a460 0x7fc5c80caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:18.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 -- 172.21.15.55:0/783956848 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679106730 0 0) 0x7fc5c80cc650 con 0x7fc5c806f960 2023-07-06T21:43:18.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 -- 172.21.15.55:0/783956848 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5b0003530 con 0x7fc5c806f960 2023-07-06T21:43:18.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 -- 172.21.15.55:0/783956848 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1159275478 0 0) 0x7fc5b0003530 con 0x7fc5c806f960 2023-07-06T21:43:18.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 -- 172.21.15.55:0/783956848 >> v2:172.21.15.138:3300/0 conn(0x7fc5c806a460 msgr2=0x7fc5c80caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:18.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 --2- 172.21.15.55:0/783956848 >> v2:172.21.15.138:3300/0 conn(0x7fc5c806a460 0x7fc5c80caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 -- 172.21.15.55:0/783956848 >> v1:172.21.15.138:6789/0 conn(0x7fc5c806cb40 legacy=0x7fc5c80693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 -- 172.21.15.55:0/783956848 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c806d3d0 con 0x7fc5c806f960 2023-07-06T21:43:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 -- 172.21.15.55:0/783956848 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fc5c0001a00 con 0x7fc5c806f960 2023-07-06T21:43:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 -- 172.21.15.55:0/783956848 >> v1:172.21.15.55:6789/0 conn(0x7fc5c806f960 legacy=0x7fc5c806fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 --2- 172.21.15.55:0/783956848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5b0003980 0x7fc5b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:18.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 --2- 172.21.15.55:0/783956848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b00047d0 0x7fc5b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:18.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 --2- 172.21.15.55:0/783956848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5b0005180 0x7fc5b000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:18.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 -- 172.21.15.55:0/783956848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c806bac0 con 0x7fc5b00047d0 2023-07-06T21:43:18.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 -- 172.21.15.55:0/783956848 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b000c090 con 0x7fc5b0005180 2023-07-06T21:43:18.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c67fc640 1 -- 172.21.15.55:0/783956848 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b000c250 con 0x7fc5b0003980 2023-07-06T21:43:18.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c6ffd640 1 --2- 172.21.15.55:0/783956848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b00047d0 0x7fc5b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c77fe640 1 --2- 172.21.15.55:0/783956848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5b0003980 0x7fc5b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c7fff640 1 --2- 172.21.15.55:0/783956848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5b0005180 0x7fc5b000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c6ffd640 1 -- 172.21.15.55:0/783956848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5b0003980 msgr2=0x7fc5b0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c6ffd640 1 --2- 172.21.15.55:0/783956848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5b0003980 0x7fc5b0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c6ffd640 1 -- 172.21.15.55:0/783956848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5b0005180 msgr2=0x7fc5b000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c6ffd640 1 --2- 172.21.15.55:0/783956848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5b0005180 0x7fc5b000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c6ffd640 1 -- 172.21.15.55:0/783956848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b0003530 con 0x7fc5b00047d0 2023-07-06T21:43:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c7fff640 1 --2- 172.21.15.55:0/783956848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5b0005180 0x7fc5b000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.830+0000 7fc5c7fff640 1 -- 172.21.15.55:0/783956848 reap_dead start 2023-07-06T21:43:18.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.834+0000 7fc5c6ffd640 1 --2- 172.21.15.55:0/783956848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b00047d0 0x7fc5b0004c40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc001780 tx=0x7fc5bc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27399a19508201c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:18.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.834+0000 7fc5c67fc640 1 -- 172.21.15.55:0/783956848 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0052d0 con 0x7fc5b00047d0 2023-07-06T21:43:18.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.834+0000 7fc5c67fc640 1 -- 172.21.15.55:0/783956848 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc0a7050 con 0x7fc5b00047d0 2023-07-06T21:43:18.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.834+0000 7fc5c67fc640 1 -- 172.21.15.55:0/783956848 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc003600 con 0x7fc5b00047d0 2023-07-06T21:43:18.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.834+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/783956848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b00047d0 msgr2=0x7fc5b0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:18.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.834+0000 7fc5ce0cb640 1 --2- 172.21.15.55:0/783956848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b00047d0 0x7fc5b0004c40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc001780 tx=0x7fc5bc01c3b0 comp rx=0 tx=0).stop 2023-07-06T21:43:18.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.834+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/783956848 shutdown_connections 2023-07-06T21:43:18.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.834+0000 7fc5ce0cb640 1 --2- 172.21.15.55:0/783956848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b00047d0 0x7fc5b0004c40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.834+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/783956848 >> 172.21.15.55:0/783956848 conn(0x7fc5c80ce7f0 msgr2=0x7fc5c80cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.834+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/783956848 shutdown_connections 2023-07-06T21:43:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.834+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/783956848 wait complete. 2023-07-06T21:43:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.834+0000 7fc5ce0cb640 1 Processor -- start 2023-07-06T21:43:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.834+0000 7fc5ce0cb640 1 -- start start 2023-07-06T21:43:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5ce0cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5b00047d0 0x7fc5c8151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5ce0cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5c80c2320 0x7fc5c80c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5ce0cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c80c7b30 0x7fc5c80c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5ce0cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80c76a0 con 0x7fc5c80c7b30 2023-07-06T21:43:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5ce0cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80c6a90 con 0x7fc5b00047d0 2023-07-06T21:43:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5ce0cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80c6d70 con 0x7fc5c80c2320 2023-07-06T21:43:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c80c7b30 0x7fc5c80c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c80c7b30 0x7fc5c80c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60604/0 (socket says 172.21.15.55:60604) 2023-07-06T21:43:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5c7fff640 1 -- 172.21.15.55:0/304015356 learned_addr learned my addr 172.21.15.55:0/304015356 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5c6ffd640 1 --2- 172.21.15.55:0/304015356 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5c80c2320 0x7fc5c80c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:18.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5c77fe640 1 --2- 172.21.15.55:0/304015356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5b00047d0 0x7fc5c8151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:18.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5c7fff640 1 -- 172.21.15.55:0/304015356 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5c80c2320 msgr2=0x7fc5c80c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:18.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5c7fff640 1 --2- 172.21.15.55:0/304015356 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5c80c2320 0x7fc5c80c2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:18.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5c7fff640 1 -- 172.21.15.55:0/304015356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5b00047d0 msgr2=0x7fc5c8151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:18.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5c7fff640 1 --2- 172.21.15.55:0/304015356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5b00047d0 0x7fc5c8151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:18.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5c7fff640 1 -- 172.21.15.55:0/304015356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c80c7050 con 0x7fc5c80c7b30 2023-07-06T21:43:18.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5c7fff640 1 --2- 172.21.15.55:0/304015356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c80c7b30 0x7fc5c80c7fa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80cf350 tx=0x7fc5c0007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:18.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5affff640 1 -- 172.21.15.55:0/304015356 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00114f0 con 0x7fc5c80c7b30 2023-07-06T21:43:18.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5affff640 1 -- 172.21.15.55:0/304015356 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c0011670 con 0x7fc5c80c7b30 2023-07-06T21:43:18.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5affff640 1 -- 172.21.15.55:0/304015356 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0011a20 con 0x7fc5c80c7b30 2023-07-06T21:43:18.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/304015356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c80c7330 con 0x7fc5c80c7b30 2023-07-06T21:43:18.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/304015356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c80b3410 con 0x7fc5c80c7b30 2023-07-06T21:43:18.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.838+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/304015356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c8066d60 con 0x7fc5c80c7b30 2023-07-06T21:43:18.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.842+0000 7fc5affff640 1 -- 172.21.15.55:0/304015356 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc5c0011b80 con 0x7fc5c80c7b30 2023-07-06T21:43:18.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.842+0000 7fc5affff640 1 --2- 172.21.15.55:0/304015356 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc5b4066280 0x7fc5b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:18.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.842+0000 7fc5affff640 1 -- 172.21.15.55:0/304015356 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6519+0+0 (secure 0 0 0) 0x7fc5c0083900 con 0x7fc5c80c7b30 2023-07-06T21:43:18.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.842+0000 7fc5c77fe640 1 --2- 172.21.15.55:0/304015356 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc5b4066280 0x7fc5b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:18.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.842+0000 7fc5c77fe640 1 --2- 172.21.15.55:0/304015356 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc5b4066280 0x7fc5b4068730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc5c804eaa0 tx=0x7fc5b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:18.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:18.846+0000 7fc5affff640 1 -- 172.21.15.55:0/304015356 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc5c0050b10 con 0x7fc5c80c7b30 2023-07-06T21:43:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.006+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/304015356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc5c80b4770 con 0x7fc5c80c7b30 2023-07-06T21:43:19.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.646+0000 7fc5affff640 1 -- 172.21.15.55:0/304015356 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc5c00190d0 con 0x7fc5c80c7b30 2023-07-06T21:43:19.654 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-07-06T21:43:19.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.650+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/304015356 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc5b4066280 msgr2=0x7fc5b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:19.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.650+0000 7fc5ce0cb640 1 --2- 172.21.15.55:0/304015356 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc5b4066280 0x7fc5b4068730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc5c804eaa0 tx=0x7fc5b8008040 comp rx=0 tx=0).stop 2023-07-06T21:43:19.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.650+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/304015356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c80c7b30 msgr2=0x7fc5c80c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:19.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.650+0000 7fc5ce0cb640 1 --2- 172.21.15.55:0/304015356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c80c7b30 0x7fc5c80c7fa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80cf350 tx=0x7fc5c0007a20 comp rx=0 tx=0).stop 2023-07-06T21:43:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.650+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/304015356 shutdown_connections 2023-07-06T21:43:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.650+0000 7fc5ce0cb640 1 --2- 172.21.15.55:0/304015356 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc5b4066280 0x7fc5b4068730 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.650+0000 7fc5ce0cb640 1 --2- 172.21.15.55:0/304015356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c80c7b30 0x7fc5c80c7fa0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.650+0000 7fc5ce0cb640 1 --2- 172.21.15.55:0/304015356 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5c80c2320 0x7fc5c80c2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.650+0000 7fc5ce0cb640 1 --2- 172.21.15.55:0/304015356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5b00047d0 0x7fc5c8151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.650+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/304015356 >> 172.21.15.55:0/304015356 conn(0x7fc5c80ce7f0 msgr2=0x7fc5c8065070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.650+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/304015356 shutdown_connections 2023-07-06T21:43:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.650+0000 7fc5ce0cb640 1 -- 172.21.15.55:0/304015356 wait complete. 2023-07-06T21:43:19.686 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-07-06T21:43:19.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e2346d640 1 Processor -- start 2023-07-06T21:43:19.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e2346d640 1 -- start start 2023-07-06T21:43:19.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e2346d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1e1c0b7bf0 0x7f1e1c0ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:19.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e2346d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1e1c069e00 0x7f1e1c0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:19.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e2346d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c0cc8d0 con 0x7f1e1c0b4240 2023-07-06T21:43:19.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e2346d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c0cfe50 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e2346d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c0b46c0 con 0x7f1e1c069e00 2023-07-06T21:43:19.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e21209640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1e1c0b7bf0 0x7f1e1c0ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:19.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e21209640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1e1c0b7bf0 0x7f1e1c0ce540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60612/0 (socket says 172.21.15.55:60612) 2023-07-06T21:43:19.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e21209640 1 -- 172.21.15.55:0/3726536258 learned_addr learned my addr 172.21.15.55:0/3726536258 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:19.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e20a08640 1 --2- 172.21.15.55:0/3726536258 >> v2:172.21.15.138:3300/0 conn(0x7f1e1c069e00 0x7f1e1c0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:19.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e21209640 1 -- 172.21.15.55:0/3726536258 >> v2:172.21.15.138:3300/0 conn(0x7f1e1c069e00 msgr2=0x7f1e1c0b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:19.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e21209640 1 --2- 172.21.15.55:0/3726536258 >> v2:172.21.15.138:3300/0 conn(0x7f1e1c069e00 0x7f1e1c0b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e21209640 1 -- 172.21.15.55:0/3726536258 >> v1:172.21.15.138:6789/0 conn(0x7f1e1c0b4240 legacy=0x7f1e1c15f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.834+0000 7f1e21209640 1 -- 172.21.15.55:0/3726536258 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c06a290 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.838+0000 7f1e21209640 1 --2- 172.21.15.55:0/3726536258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c0b7bf0 0x7f1e1c0ce540 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0d1d80 tx=0x7f1e1801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93beaf7148e82e67 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:19.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.838+0000 7f1e13fff640 1 -- 172.21.15.55:0/3726536258 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180aa430 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.838+0000 7f1e13fff640 1 -- 172.21.15.55:0/3726536258 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e180aa590 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.838+0000 7f1e13fff640 1 -- 172.21.15.55:0/3726536258 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180aa920 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.842+0000 7f1e2346d640 1 -- 172.21.15.55:0/3726536258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c0b7bf0 msgr2=0x7f1e1c0ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:19.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.842+0000 7f1e2346d640 1 --2- 172.21.15.55:0/3726536258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c0b7bf0 0x7f1e1c0ce540 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0d1d80 tx=0x7f1e1801c4d0 comp rx=0 tx=0).stop 2023-07-06T21:43:19.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.842+0000 7f1e2346d640 1 -- 172.21.15.55:0/3726536258 shutdown_connections 2023-07-06T21:43:19.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.842+0000 7f1e2346d640 1 --2- 172.21.15.55:0/3726536258 >> v2:172.21.15.138:3300/0 conn(0x7f1e1c069e00 0x7f1e1c0b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:19.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.842+0000 7f1e2346d640 1 --2- 172.21.15.55:0/3726536258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c0b7bf0 0x7f1e1c0ce540 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:19.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.842+0000 7f1e2346d640 1 -- 172.21.15.55:0/3726536258 >> 172.21.15.55:0/3726536258 conn(0x7f1e1c070cf0 msgr2=0x7f1e1c0ced00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:19.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.842+0000 7f1e2346d640 1 -- 172.21.15.55:0/3726536258 shutdown_connections 2023-07-06T21:43:19.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.842+0000 7f1e2346d640 1 -- 172.21.15.55:0/3726536258 wait complete. 2023-07-06T21:43:19.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.842+0000 7f1e2346d640 1 Processor -- start 2023-07-06T21:43:19.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.842+0000 7f1e2346d640 1 -- start start 2023-07-06T21:43:19.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e2346d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e1c069e00 0x7f1e1c14dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:19.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e2346d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1e1c0b4240 0x7f1e1c151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:19.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e2346d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c0b7bf0 0x7f1e1c152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:19.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e2346d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c151100 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e2346d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c14fc00 con 0x7f1e1c069e00 2023-07-06T21:43:19.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e2346d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c150480 con 0x7f1e1c0b4240 2023-07-06T21:43:19.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e21a0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c0b7bf0 0x7f1e1c152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:19.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e21a0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c0b7bf0 0x7f1e1c152b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60624/0 (socket says 172.21.15.55:60624) 2023-07-06T21:43:19.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e21a0a640 1 -- 172.21.15.55:0/1487435182 learned_addr learned my addr 172.21.15.55:0/1487435182 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:19.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e21209640 1 --2- 172.21.15.55:0/1487435182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e1c069e00 0x7f1e1c14dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:19.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e20a08640 1 --2- 172.21.15.55:0/1487435182 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1e1c0b4240 0x7f1e1c151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:19.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e21a0a640 1 -- 172.21.15.55:0/1487435182 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1e1c0b4240 msgr2=0x7f1e1c151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:19.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e21a0a640 1 --2- 172.21.15.55:0/1487435182 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1e1c0b4240 0x7f1e1c151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:19.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e21a0a640 1 -- 172.21.15.55:0/1487435182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e1c069e00 msgr2=0x7f1e1c14dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:19.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e21a0a640 1 --2- 172.21.15.55:0/1487435182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e1c069e00 0x7f1e1c14dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:19.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e21a0a640 1 -- 172.21.15.55:0/1487435182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180094d0 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e21a0a640 1 --2- 172.21.15.55:0/1487435182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c0b7bf0 0x7f1e1c152b20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400c770 tx=0x7f1e1400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:19.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e11ffb640 1 -- 172.21.15.55:0/1487435182 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14003b80 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e11ffb640 1 -- 172.21.15.55:0/1487435182 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e14003ce0 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e11ffb640 1 -- 172.21.15.55:0/1487435182 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400aa90 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e2346d640 1 -- 172.21.15.55:0/1487435182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c150760 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e2346d640 1 -- 172.21.15.55:0/1487435182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c150d20 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.846+0000 7f1e2346d640 1 -- 172.21.15.55:0/1487435182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c066d60 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.850+0000 7f1e11ffb640 1 -- 172.21.15.55:0/1487435182 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1e1400abf0 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.850+0000 7f1e11ffb640 1 --2- 172.21.15.55:0/1487435182 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1e000662b0 0x7f1e00068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:19.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.850+0000 7f1e11ffb640 1 -- 172.21.15.55:0/1487435182 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f1e14083a70 con 0x7f1e1c0b7bf0 2023-07-06T21:43:19.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.850+0000 7f1e21209640 1 --2- 172.21.15.55:0/1487435182 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1e000662b0 0x7f1e00068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:19.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.850+0000 7f1e21209640 1 --2- 172.21.15.55:0/1487435182 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1e000662b0 0x7f1e00068760 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1e180ae000 tx=0x7f1e180b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:19.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:19.854+0000 7f1e11ffb640 1 -- 172.21.15.55:0/1487435182 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e14050ef0 con 0x7f1e1c0b7bf0 2023-07-06T21:43:20.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.010+0000 7f1e2346d640 1 -- 172.21.15.55:0/1487435182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1e1c15f420 con 0x7f1e1c0b7bf0 2023-07-06T21:43:20.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.658+0000 7f1e11ffb640 1 -- 172.21.15.55:0/1487435182 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f1e14054510 con 0x7f1e1c0b7bf0 2023-07-06T21:43:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data_ec' removed 2023-07-06T21:43:20.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.662+0000 7f1e2346d640 1 -- 172.21.15.55:0/1487435182 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1e000662b0 msgr2=0x7f1e00068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:20.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.662+0000 7f1e2346d640 1 --2- 172.21.15.55:0/1487435182 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1e000662b0 0x7f1e00068760 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1e180ae000 tx=0x7f1e180b5040 comp rx=0 tx=0).stop 2023-07-06T21:43:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.666+0000 7f1e2346d640 1 -- 172.21.15.55:0/1487435182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c0b7bf0 msgr2=0x7f1e1c152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.666+0000 7f1e2346d640 1 --2- 172.21.15.55:0/1487435182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c0b7bf0 0x7f1e1c152b20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400c770 tx=0x7f1e1400cc30 comp rx=0 tx=0).stop 2023-07-06T21:43:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.666+0000 7f1e2346d640 1 -- 172.21.15.55:0/1487435182 shutdown_connections 2023-07-06T21:43:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.666+0000 7f1e2346d640 1 --2- 172.21.15.55:0/1487435182 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f1e000662b0 0x7f1e00068760 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:20.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.666+0000 7f1e2346d640 1 --2- 172.21.15.55:0/1487435182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c0b7bf0 0x7f1e1c152b20 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:20.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.666+0000 7f1e2346d640 1 --2- 172.21.15.55:0/1487435182 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1e1c0b4240 0x7f1e1c151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:20.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.666+0000 7f1e2346d640 1 --2- 172.21.15.55:0/1487435182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e1c069e00 0x7f1e1c14dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:20.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.666+0000 7f1e2346d640 1 -- 172.21.15.55:0/1487435182 >> 172.21.15.55:0/1487435182 conn(0x7f1e1c070cf0 msgr2=0x7f1e1c0d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:20.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.666+0000 7f1e2346d640 1 -- 172.21.15.55:0/1487435182 shutdown_connections 2023-07-06T21:43:20.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.666+0000 7f1e2346d640 1 -- 172.21.15.55:0/1487435182 wait complete. 2023-07-06T21:43:20.697 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T21:43:20.697 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-06T21:43:20.698 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T21:43:20.698 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:43:20.698 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T21:43:20.698 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-06T21:43:20.698 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T21:43:20.699 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:43:20.699 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T21:43:20.699 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-06T21:43:20.699 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T21:43:20.700 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:43:20.700 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T21:43:20.700 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-06T21:43:20.700 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T21:43:20.700 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:43:20.711 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T21:43:20.712 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T21:43:20.713 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T21:43:20.713 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T21:43:20.714 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T21:43:20.714 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T21:43:20.715 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T21:43:20.715 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T21:43:20.762 INFO:tasks.ceph.mds.c:Started 2023-07-06T21:43:20.763 DEBUG:teuthology.parallel:result is None 2023-07-06T21:43:20.764 INFO:tasks.ceph.mds.a:Started 2023-07-06T21:43:20.764 DEBUG:teuthology.parallel:result is None 2023-07-06T21:43:20.765 INFO:tasks.ceph.mds.b:Started 2023-07-06T21:43:20.765 DEBUG:teuthology.parallel:result is None 2023-07-06T21:43:20.767 INFO:tasks.ceph.mds.d:Started 2023-07-06T21:43:20.768 DEBUG:teuthology.parallel:result is None 2023-07-06T21:43:20.768 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-06T21:43:20.852 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-07-06T21:43:20.852 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T21:43:20.853 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-07-06T21:43:20.854 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-07-06T21:43:20.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f0732448640 1 Processor -- start 2023-07-06T21:43:20.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f0732448640 1 -- start start 2023-07-06T21:43:20.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f0732448640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f072c0709a0 0x7f072c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:20.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f0732448640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f072c0cbe60 0x7f072c0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:20.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f0732448640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072c0cc300 con 0x7f072c070d70 2023-07-06T21:43:20.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f0732448640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072c0cc5e0 con 0x7f072c0cbe60 2023-07-06T21:43:20.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f0732448640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0cc8c0 con 0x7f072c0709a0 2023-07-06T21:43:20.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f072b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f072c0cbe60 0x7f072c0b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:20.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f072b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f072c0cbe60 0x7f072c0b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60674/0 (socket says 172.21.15.55:60674) 2023-07-06T21:43:20.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f072b7fe640 1 -- 172.21.15.55:0/799569942 learned_addr learned my addr 172.21.15.55:0/799569942 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:20.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f072bfff640 1 --2- 172.21.15.55:0/799569942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f072c0709a0 0x7f072c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:20.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f072b7fe640 1 -- 172.21.15.55:0/799569942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f072c0709a0 msgr2=0x7f072c0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:20.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f072b7fe640 1 --2- 172.21.15.55:0/799569942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f072c0709a0 0x7f072c0cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:20.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f072b7fe640 1 -- 172.21.15.55:0/799569942 >> v1:172.21.15.55:6789/0 conn(0x7f072c070d70 legacy=0x7f072c15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:20.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f072b7fe640 1 -- 172.21.15.55:0/799569942 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c0ccba0 con 0x7f072c0cbe60 2023-07-06T21:43:20.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.918+0000 7f072bfff640 1 --2- 172.21.15.55:0/799569942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f072c0709a0 0x7f072c0cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:20.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.922+0000 7f072b7fe640 1 --2- 172.21.15.55:0/799569942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f072c0cbe60 0x7f072c0b0c30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f071c009870 tx=0x7f071c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1e408691c540e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:20.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.922+0000 7f072affd640 1 -- 172.21.15.55:0/799569942 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0ab600 con 0x7f072c0cbe60 2023-07-06T21:43:20.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.922+0000 7f072affd640 1 -- 172.21.15.55:0/799569942 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c0a7050 con 0x7f072c0cbe60 2023-07-06T21:43:20.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.922+0000 7f072affd640 1 -- 172.21.15.55:0/799569942 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0ab980 con 0x7f072c0cbe60 2023-07-06T21:43:20.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.926+0000 7f0732448640 1 -- 172.21.15.55:0/799569942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f072c0cbe60 msgr2=0x7f072c0b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:20.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.926+0000 7f0732448640 1 --2- 172.21.15.55:0/799569942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f072c0cbe60 0x7f072c0b0c30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f071c009870 tx=0x7f071c01c560 comp rx=0 tx=0).stop 2023-07-06T21:43:20.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.926+0000 7f0732448640 1 -- 172.21.15.55:0/799569942 shutdown_connections 2023-07-06T21:43:20.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.926+0000 7f0732448640 1 --2- 172.21.15.55:0/799569942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f072c0cbe60 0x7f072c0b0c30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:20.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.926+0000 7f0732448640 1 --2- 172.21.15.55:0/799569942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f072c0709a0 0x7f072c0cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:20.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.926+0000 7f0732448640 1 -- 172.21.15.55:0/799569942 >> 172.21.15.55:0/799569942 conn(0x7f072c0cea70 msgr2=0x7f072c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:20.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.926+0000 7f0732448640 1 -- 172.21.15.55:0/799569942 shutdown_connections 2023-07-06T21:43:20.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.926+0000 7f0732448640 1 -- 172.21.15.55:0/799569942 wait complete. 2023-07-06T21:43:20.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.926+0000 7f0732448640 1 Processor -- start 2023-07-06T21:43:20.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.926+0000 7f0732448640 1 -- start start 2023-07-06T21:43:20.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f0732448640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f072c0709a0 0x7f072c06c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:20.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f0732448640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f072c070d70 0x7f072c1f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:20.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f0732448640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f072c0cbe60 0x7f072c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:20.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f0732448640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0aff80 con 0x7f072c0cbe60 2023-07-06T21:43:20.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f0732448640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c069e00 con 0x7f072c0709a0 2023-07-06T21:43:20.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f0732448640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c06c990 con 0x7f072c070d70 2023-07-06T21:43:20.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f07309e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f072c0cbe60 0x7f072c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:20.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f07309e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f072c0cbe60 0x7f072c0ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60684/0 (socket says 172.21.15.55:60684) 2023-07-06T21:43:20.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f07309e5640 1 -- 172.21.15.55:0/2332856173 learned_addr learned my addr 172.21.15.55:0/2332856173 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:20.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f072bfff640 1 --2- 172.21.15.55:0/2332856173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f072c0709a0 0x7f072c06c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:20.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f072b7fe640 1 --2- 172.21.15.55:0/2332856173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f072c070d70 0x7f072c1f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f07309e5640 1 -- 172.21.15.55:0/2332856173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f072c070d70 msgr2=0x7f072c1f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f07309e5640 1 --2- 172.21.15.55:0/2332856173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f072c070d70 0x7f072c1f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f07309e5640 1 -- 172.21.15.55:0/2332856173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f072c0709a0 msgr2=0x7f072c06c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f07309e5640 1 --2- 172.21.15.55:0/2332856173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f072c0709a0 0x7f072c06c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f07309e5640 1 -- 172.21.15.55:0/2332856173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0720009420 con 0x7f072c0cbe60 2023-07-06T21:43:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f07309e5640 1 --2- 172.21.15.55:0/2332856173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f072c0cbe60 0x7f072c0ad840 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f072400c7a0 tx=0x7f072400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:20.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f0728ff9640 1 -- 172.21.15.55:0/2332856173 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724003b80 con 0x7f072c0cbe60 2023-07-06T21:43:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f0728ff9640 1 -- 172.21.15.55:0/2332856173 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0724003ce0 con 0x7f072c0cbe60 2023-07-06T21:43:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f0728ff9640 1 -- 172.21.15.55:0/2332856173 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072400aa90 con 0x7f072c0cbe60 2023-07-06T21:43:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f0732448640 1 -- 172.21.15.55:0/2332856173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071c0094d0 con 0x7f072c0cbe60 2023-07-06T21:43:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f0732448640 1 -- 172.21.15.55:0/2332856173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072c0b01d0 con 0x7f072c0cbe60 2023-07-06T21:43:20.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.930+0000 7f0732448640 1 -- 172.21.15.55:0/2332856173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072c066d60 con 0x7f072c0cbe60 2023-07-06T21:43:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.934+0000 7f0728ff9640 1 -- 172.21.15.55:0/2332856173 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f072400abf0 con 0x7f072c0cbe60 2023-07-06T21:43:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.934+0000 7f0728ff9640 1 --2- 172.21.15.55:0/2332856173 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0718066280 0x7f0718068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.934+0000 7f0728ff9640 1 -- 172.21.15.55:0/2332856173 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0724083910 con 0x7f072c0cbe60 2023-07-06T21:43:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.934+0000 7f072bfff640 1 --2- 172.21.15.55:0/2332856173 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0718066280 0x7f0718068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:20.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.934+0000 7f072bfff640 1 --2- 172.21.15.55:0/2332856173 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0718066280 0x7f0718068730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0720009c80 tx=0x7f0720008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:20.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:20.938+0000 7f0728ff9640 1 -- 172.21.15.55:0/2332856173 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0724050f60 con 0x7f072c0cbe60 2023-07-06T21:43:21.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:21.106+0000 7f0732448640 1 -- 172.21.15.55:0/2332856173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f072c0ad5f0 con 0x7f072c0cbe60 2023-07-06T21:43:21.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:21.893+0000 7f0728ff9640 1 -- 172.21.15.55:0/2332856173 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v38) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0724054580 con 0x7f072c0cbe60 2023-07-06T21:43:21.902 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-07-06T21:43:21.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:21.897+0000 7f0732448640 1 -- 172.21.15.55:0/2332856173 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0718066280 msgr2=0x7f0718068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:21.897+0000 7f0732448640 1 --2- 172.21.15.55:0/2332856173 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0718066280 0x7f0718068730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0720009c80 tx=0x7f0720008040 comp rx=0 tx=0).stop 2023-07-06T21:43:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:21.897+0000 7f0732448640 1 -- 172.21.15.55:0/2332856173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f072c0cbe60 msgr2=0x7f072c0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:21.897+0000 7f0732448640 1 --2- 172.21.15.55:0/2332856173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f072c0cbe60 0x7f072c0ad840 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f072400c7a0 tx=0x7f072400cc60 comp rx=0 tx=0).stop 2023-07-06T21:43:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:21.897+0000 7f0732448640 1 -- 172.21.15.55:0/2332856173 shutdown_connections 2023-07-06T21:43:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:21.897+0000 7f0732448640 1 --2- 172.21.15.55:0/2332856173 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0718066280 0x7f0718068730 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:21.897+0000 7f0732448640 1 --2- 172.21.15.55:0/2332856173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f072c0cbe60 0x7f072c0ad840 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:21.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:21.897+0000 7f0732448640 1 --2- 172.21.15.55:0/2332856173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f072c070d70 0x7f072c1f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:21.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:21.897+0000 7f0732448640 1 --2- 172.21.15.55:0/2332856173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f072c0709a0 0x7f072c06c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:21.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:21.897+0000 7f0732448640 1 -- 172.21.15.55:0/2332856173 >> 172.21.15.55:0/2332856173 conn(0x7f072c0cea70 msgr2=0x7f072c065070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:21.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:21.897+0000 7f0732448640 1 -- 172.21.15.55:0/2332856173 shutdown_connections 2023-07-06T21:43:21.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:21.897+0000 7f0732448640 1 -- 172.21.15.55:0/2332856173 wait complete. 2023-07-06T21:43:21.928 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-06T21:43:22.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a6434640 1 Processor -- start 2023-07-06T21:43:22.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a6434640 1 -- start start 2023-07-06T21:43:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a6434640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1a015b9d0 0x7fb1a00b2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a6434640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb1a00ce5e0 0x7fb1a00b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a6434640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1a00b40e0 0x7fb1a015f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a6434640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a00b4560 con 0x7fb1a015b9d0 2023-07-06T21:43:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a6434640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a00cc770 con 0x7fb1a00ce5e0 2023-07-06T21:43:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a6434640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a00cc9c0 con 0x7fb1a00b40e0 2023-07-06T21:43:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a5432640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1a015b9d0 0x7fb1a00b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a5432640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1a015b9d0 0x7fb1a00b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60694/0 (socket says 172.21.15.55:60694) 2023-07-06T21:43:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a5432640 1 -- 172.21.15.55:0/2935486735 learned_addr learned my addr 172.21.15.55:0/2935486735 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a4c31640 1 --2- 172.21.15.55:0/2935486735 >> v2:172.21.15.138:3300/0 conn(0x7fb1a00ce5e0 0x7fb1a00b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a5c33640 1 --2- 172.21.15.55:0/2935486735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1a00b40e0 0x7fb1a015f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a5432640 1 -- 172.21.15.55:0/2935486735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1a00b40e0 msgr2=0x7fb1a015f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a5432640 1 --2- 172.21.15.55:0/2935486735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1a00b40e0 0x7fb1a015f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a5432640 1 -- 172.21.15.55:0/2935486735 >> v2:172.21.15.138:3300/0 conn(0x7fb1a00ce5e0 msgr2=0x7fb1a00b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a5432640 1 --2- 172.21.15.55:0/2935486735 >> v2:172.21.15.138:3300/0 conn(0x7fb1a00ce5e0 0x7fb1a00b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.069+0000 7fb1a5432640 1 -- 172.21.15.55:0/2935486735 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a00ccca0 con 0x7fb1a015b9d0 2023-07-06T21:43:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.073+0000 7fb1a5432640 1 --2- 172.21.15.55:0/2935486735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a015b9d0 0x7fb1a00b2440 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00d31f0 tx=0x7fb19c01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c93a7d27190f1f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.073+0000 7fb197fff640 1 -- 172.21.15.55:0/2935486735 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c0ab600 con 0x7fb1a015b9d0 2023-07-06T21:43:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.073+0000 7fb197fff640 1 -- 172.21.15.55:0/2935486735 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c0a7050 con 0x7fb1a015b9d0 2023-07-06T21:43:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.073+0000 7fb197fff640 1 -- 172.21.15.55:0/2935486735 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c0ab980 con 0x7fb1a015b9d0 2023-07-06T21:43:22.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.073+0000 7fb1a6434640 1 -- 172.21.15.55:0/2935486735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a015b9d0 msgr2=0x7fb1a00b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:22.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.073+0000 7fb1a6434640 1 --2- 172.21.15.55:0/2935486735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a015b9d0 0x7fb1a00b2440 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00d31f0 tx=0x7fb19c01c240 comp rx=0 tx=0).stop 2023-07-06T21:43:22.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.073+0000 7fb1a6434640 1 -- 172.21.15.55:0/2935486735 shutdown_connections 2023-07-06T21:43:22.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.073+0000 7fb1a6434640 1 --2- 172.21.15.55:0/2935486735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1a00b40e0 0x7fb1a015f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.073+0000 7fb1a6434640 1 --2- 172.21.15.55:0/2935486735 >> v2:172.21.15.138:3300/0 conn(0x7fb1a00ce5e0 0x7fb1a00b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.073+0000 7fb1a6434640 1 --2- 172.21.15.55:0/2935486735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a015b9d0 0x7fb1a00b2440 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.073+0000 7fb1a6434640 1 -- 172.21.15.55:0/2935486735 >> 172.21.15.55:0/2935486735 conn(0x7fb1a006c2b0 msgr2=0x7fb1a00ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:22.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.073+0000 7fb1a6434640 1 -- 172.21.15.55:0/2935486735 shutdown_connections 2023-07-06T21:43:22.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.073+0000 7fb1a6434640 1 -- 172.21.15.55:0/2935486735 wait complete. 2023-07-06T21:43:22.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.073+0000 7fb1a6434640 1 Processor -- start 2023-07-06T21:43:22.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a6434640 1 -- start start 2023-07-06T21:43:22.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a6434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a00b40e0 0x7fb1a01f8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a6434640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1a00ce5e0 0x7fb1a015e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a6434640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1a015b9d0 0x7fb1a014b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a6434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a015ed40 con 0x7fb1a00b40e0 2023-07-06T21:43:22.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a6434640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a015d5d0 con 0x7fb1a00ce5e0 2023-07-06T21:43:22.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a6434640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a014bb10 con 0x7fb1a015b9d0 2023-07-06T21:43:22.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a5432640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a00b40e0 0x7fb1a01f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a5432640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a00b40e0 0x7fb1a01f8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60700/0 (socket says 172.21.15.55:60700) 2023-07-06T21:43:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a5432640 1 -- 172.21.15.55:0/1953531236 learned_addr learned my addr 172.21.15.55:0/1953531236 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a5c33640 1 --2- 172.21.15.55:0/1953531236 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1a015b9d0 0x7fb1a014b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a4c31640 1 --2- 172.21.15.55:0/1953531236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1a00ce5e0 0x7fb1a015e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a5432640 1 -- 172.21.15.55:0/1953531236 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1a015b9d0 msgr2=0x7fb1a014b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a5432640 1 --2- 172.21.15.55:0/1953531236 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1a015b9d0 0x7fb1a014b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a5432640 1 -- 172.21.15.55:0/1953531236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1a00ce5e0 msgr2=0x7fb1a015e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a5432640 1 --2- 172.21.15.55:0/1953531236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1a00ce5e0 0x7fb1a015e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a5432640 1 -- 172.21.15.55:0/1953531236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c0094d0 con 0x7fb1a00b40e0 2023-07-06T21:43:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a5432640 1 --2- 172.21.15.55:0/1953531236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a00b40e0 0x7fb1a01f8120 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0ae040 tx=0x7fb19c01aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb195ffb640 1 -- 172.21.15.55:0/1953531236 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c0b6620 con 0x7fb1a00b40e0 2023-07-06T21:43:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb195ffb640 1 -- 172.21.15.55:0/1953531236 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c0b67a0 con 0x7fb1a00b40e0 2023-07-06T21:43:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb195ffb640 1 -- 172.21.15.55:0/1953531236 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c0b6b50 con 0x7fb1a00b40e0 2023-07-06T21:43:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a6434640 1 -- 172.21.15.55:0/1953531236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a015cce0 con 0x7fb1a00b40e0 2023-07-06T21:43:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a6434640 1 -- 172.21.15.55:0/1953531236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a015d260 con 0x7fb1a00b40e0 2023-07-06T21:43:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.077+0000 7fb1a6434640 1 -- 172.21.15.55:0/1953531236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a00ccf60 con 0x7fb1a00b40e0 2023-07-06T21:43:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.081+0000 7fb195ffb640 1 -- 172.21.15.55:0/1953531236 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb19c0b2040 con 0x7fb1a00b40e0 2023-07-06T21:43:22.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.081+0000 7fb195ffb640 1 --2- 172.21.15.55:0/1953531236 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb184066280 0x7fb184068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.081+0000 7fb195ffb640 1 -- 172.21.15.55:0/1953531236 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb19c11ddd0 con 0x7fb1a00b40e0 2023-07-06T21:43:22.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.081+0000 7fb1a4c31640 1 --2- 172.21.15.55:0/1953531236 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb184066280 0x7fb184068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.081+0000 7fb1a4c31640 1 --2- 172.21.15.55:0/1953531236 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb184066280 0x7fb184068730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00c5e70 tx=0x7fb190008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:22.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.085+0000 7fb195ffb640 1 -- 172.21.15.55:0/1953531236 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1a00ccf60 con 0x7fb1a00b40e0 2023-07-06T21:43:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.293+0000 7fb1a6434640 1 -- 172.21.15.55:0/1953531236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb1a00ccf60 con 0x7fb1a00b40e0 2023-07-06T21:43:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.293+0000 7fb195ffb640 1 -- 172.21.15.55:0/1953531236 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fb1a00ccf60 con 0x7fb1a00b40e0 2023-07-06T21:43:22.303 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:22.303 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T21:43:22.303 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-07-06T21:43:22.303 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.303 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-07-06T21:43:22.303 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkWjb1JxAAMmLy+dPO5qyorBnuzazx6A==", 2023-07-06T21:43:22.304 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.304 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:43:22.304 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:43:22.304 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:43:22.304 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.304 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.304 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.305 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.305 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-07-06T21:43:22.305 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkpLLENBAAxMASh3qbELQMJ3XbPEX0Zw==", 2023-07-06T21:43:22.305 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.305 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:43:22.305 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:43:22.305 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:43:22.306 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.306 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.306 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.306 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.306 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-07-06T21:43:22.306 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkvOSfLxAAMEoqAPg1pb47e5a1G1QtAw==", 2023-07-06T21:43:22.306 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.306 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:43:22.307 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:43:22.307 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:43:22.307 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.307 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.307 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.307 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.307 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-07-06T21:43:22.308 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkeQIBARAApXT5zWLUqqMSdwYygZeatw==", 2023-07-06T21:43:22.308 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.308 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:43:22.308 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:43:22.308 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:43:22.308 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.308 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.308 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.309 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.309 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-07-06T21:43:22.309 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD5NKdkSIfzJxAAlXiG8PWFXQqIeugbdp7Eiw==", 2023-07-06T21:43:22.309 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.309 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:43:22.309 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:43:22.309 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.310 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.310 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.310 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.310 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-07-06T21:43:22.310 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD8NKdkv2iwLxAAxjFucMwaaH66wPQpoYSTGw==", 2023-07-06T21:43:22.310 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.310 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:43:22.310 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:43:22.311 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.311 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.311 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.311 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.311 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-07-06T21:43:22.311 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD/NKdk5w7XOBAAuiup4mcC02ZMCPHCU1Cl3A==", 2023-07-06T21:43:22.311 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.311 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:43:22.312 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:43:22.312 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.312 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.312 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.312 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.312 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-07-06T21:43:22.312 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQADNadksvRLBBAAE1YX9VgA8pWARIEZL8tbsQ==", 2023-07-06T21:43:22.313 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.313 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:43:22.313 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:43:22.313 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.313 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.313 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.313 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.313 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-07-06T21:43:22.314 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAJNadkn2HsChAAgwb7B9lHOMq2h0BNuhB/AQ==", 2023-07-06T21:43:22.314 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.314 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:43:22.314 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:43:22.314 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.314 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.314 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.314 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.315 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-07-06T21:43:22.315 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMNadkbonPERAA2PLg4NMr+4eW+FDAfPig1A==", 2023-07-06T21:43:22.315 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.315 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:43:22.315 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:43:22.315 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.315 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.316 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.316 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.316 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-07-06T21:43:22.316 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAPNadkQw76GBAAY9SIgsTUHqvThwjdpjuwpw==", 2023-07-06T21:43:22.316 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.316 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:43:22.316 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:43:22.317 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.317 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.317 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.317 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.317 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-07-06T21:43:22.317 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQASNadkr3gRHxAALbPUtIgImIK1UUoe6vcyjg==", 2023-07-06T21:43:22.317 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.317 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:43:22.318 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:43:22.318 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.318 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.318 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.318 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.318 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-07-06T21:43:22.318 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkaZgiBRAAvyBUd+qHLh/wwhgoE1MsVA==", 2023-07-06T21:43:22.318 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.319 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:43:22.319 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:43:22.319 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:43:22.319 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:43:22.319 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.319 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.319 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.319 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-07-06T21:43:22.320 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkOBqoDBAASIhzvCqkSAFLX2oc99MYqw==", 2023-07-06T21:43:22.320 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.320 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:43:22.320 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:43:22.320 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:43:22.320 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:43:22.320 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.321 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.321 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.321 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-07-06T21:43:22.321 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkgt/fCBAAlQY94DrR/nFTIVwSFCEToQ==", 2023-07-06T21:43:22.321 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.321 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:43:22.321 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:43:22.321 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:43:22.322 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:43:22.322 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.322 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.322 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.322 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-07-06T21:43:22.322 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkd5zAEhAAU0Qo6NROIKRSlOncFUoTxQ==", 2023-07-06T21:43:22.322 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.322 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:43:22.323 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:43:22.323 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:43:22.323 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:43:22.323 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.323 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.323 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.323 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-07-06T21:43:22.324 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkjvG8ChAA5rpuV6+YETQS9UjMRUynxA==", 2023-07-06T21:43:22.324 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.324 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:43:22.324 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:43:22.324 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:43:22.324 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.324 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.324 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.325 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.325 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-mds", 2023-07-06T21:43:22.325 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAYNadk3pcOIhAAlIQb0Noem6sfyFkp/sLcNQ==", 2023-07-06T21:43:22.325 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.325 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-mds" 2023-07-06T21:43:22.325 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.325 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.325 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.326 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-mgr", 2023-07-06T21:43:22.326 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAYNadke6IOIhAA7Wxu0k7oyK9q4YNkWGMsAw==", 2023-07-06T21:43:22.326 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.326 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-06T21:43:22.326 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.326 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.326 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.327 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-osd", 2023-07-06T21:43:22.327 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAYNadkDasOIhAAJiGIidelV63HF9OODLVuDw==", 2023-07-06T21:43:22.327 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.327 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-osd" 2023-07-06T21:43:22.327 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.327 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.327 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.327 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rbd", 2023-07-06T21:43:22.328 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAYNadkrLMOIhAAPh8J+sjGgsjuCyuQzQRcCg==", 2023-07-06T21:43:22.328 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.328 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-06T21:43:22.328 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.328 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.328 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.328 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-06T21:43:22.328 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAYNadkTrwOIhAAEwP3jRV7YSZ/gwGXyQDq/Q==", 2023-07-06T21:43:22.329 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.329 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-06T21:43:22.329 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.329 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.329 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.329 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rgw", 2023-07-06T21:43:22.329 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAYNadkDsUOIhAALOJH5y30uSn70AeqFxJHKw==", 2023-07-06T21:43:22.330 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.330 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-06T21:43:22.330 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.330 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.330 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.330 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-07-06T21:43:22.330 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdk+RUVIxAAyQpmGAeL8K+Cy+fgK5BmCQ==", 2023-07-06T21:43:22.330 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.331 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:43:22.331 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T21:43:22.331 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.331 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.331 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:22.331 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:22.331 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-07-06T21:43:22.331 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkLH8aHxAAzzX5YxumCYWYqo0rQfFA9g==", 2023-07-06T21:43:22.332 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:43:22.332 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:43:22.332 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T21:43:22.332 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:43:22.332 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.332 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:22.332 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-07-06T21:43:22.333 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T21:43:22.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.297+0000 7fb1a6434640 1 -- 172.21.15.55:0/1953531236 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb184066280 msgr2=0x7fb184068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:22.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.297+0000 7fb1a6434640 1 --2- 172.21.15.55:0/1953531236 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb184066280 0x7fb184068730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00c5e70 tx=0x7fb190008040 comp rx=0 tx=0).stop 2023-07-06T21:43:22.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.297+0000 7fb1a6434640 1 -- 172.21.15.55:0/1953531236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a00b40e0 msgr2=0x7fb1a01f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:22.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.297+0000 7fb1a6434640 1 --2- 172.21.15.55:0/1953531236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a00b40e0 0x7fb1a01f8120 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0ae040 tx=0x7fb19c01aa80 comp rx=0 tx=0).stop 2023-07-06T21:43:22.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.297+0000 7fb1a6434640 1 -- 172.21.15.55:0/1953531236 shutdown_connections 2023-07-06T21:43:22.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.297+0000 7fb1a6434640 1 --2- 172.21.15.55:0/1953531236 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb184066280 0x7fb184068730 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.297+0000 7fb1a6434640 1 --2- 172.21.15.55:0/1953531236 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1a015b9d0 0x7fb1a014b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.297+0000 7fb1a6434640 1 --2- 172.21.15.55:0/1953531236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1a00ce5e0 0x7fb1a015e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.297+0000 7fb1a6434640 1 --2- 172.21.15.55:0/1953531236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1a00b40e0 0x7fb1a01f8120 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.297+0000 7fb1a6434640 1 -- 172.21.15.55:0/1953531236 >> 172.21.15.55:0/1953531236 conn(0x7fb1a006c2b0 msgr2=0x7fb1a015c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:22.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.297+0000 7fb1a6434640 1 -- 172.21.15.55:0/1953531236 shutdown_connections 2023-07-06T21:43:22.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.297+0000 7fb1a6434640 1 -- 172.21.15.55:0/1953531236 wait complete. 2023-07-06T21:43:22.336 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-06T21:43:22.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8aaf11640 1 Processor -- start 2023-07-06T21:43:22.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8aaf11640 1 -- start start 2023-07-06T21:43:22.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8aaf11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8a40b7b90 0x7fd8a40d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8aaf11640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd8a40cc870 0x7fd8a40b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8aaf11640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a40b5070 con 0x7fd8a40b4130 2023-07-06T21:43:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8aaf11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a4160020 con 0x7fd8a40b7b90 2023-07-06T21:43:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8aaf11640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a40b4570 con 0x7fd8a40cc870 2023-07-06T21:43:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8a8cad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8a40b7b90 0x7fd8a40d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8a8cad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8a40b7b90 0x7fd8a40d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60708/0 (socket says 172.21.15.55:60708) 2023-07-06T21:43:22.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8a8cad640 1 -- 172.21.15.55:0/601342322 learned_addr learned my addr 172.21.15.55:0/601342322 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:22.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8a3fff640 1 --2- 172.21.15.55:0/601342322 >> v2:172.21.15.138:3300/0 conn(0x7fd8a40cc870 0x7fd8a40b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8a8cad640 1 -- 172.21.15.55:0/601342322 >> v2:172.21.15.138:3300/0 conn(0x7fd8a40cc870 msgr2=0x7fd8a40b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:22.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8a8cad640 1 --2- 172.21.15.55:0/601342322 >> v2:172.21.15.138:3300/0 conn(0x7fd8a40cc870 0x7fd8a40b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8a8cad640 1 -- 172.21.15.55:0/601342322 >> v1:172.21.15.138:6789/0 conn(0x7fd8a40b4130 legacy=0x7fd8a40d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:22.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.473+0000 7fd8a8cad640 1 -- 172.21.15.55:0/601342322 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a41604b0 con 0x7fd8a40b7b90 2023-07-06T21:43:22.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.477+0000 7fd8a8cad640 1 --2- 172.21.15.55:0/601342322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40b7b90 0x7fd8a40d1c40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd8a408b540 tx=0x7fd89801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602dd3794077b6e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:22.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.477+0000 7fd8a37fe640 1 -- 172.21.15.55:0/601342322 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8980ab600 con 0x7fd8a40b7b90 2023-07-06T21:43:22.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.477+0000 7fd8a37fe640 1 -- 172.21.15.55:0/601342322 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8980ab760 con 0x7fd8a40b7b90 2023-07-06T21:43:22.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.477+0000 7fd8a37fe640 1 -- 172.21.15.55:0/601342322 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8980abaf0 con 0x7fd8a40b7b90 2023-07-06T21:43:22.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.477+0000 7fd8aaf11640 1 -- 172.21.15.55:0/601342322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40b7b90 msgr2=0x7fd8a40d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:22.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.477+0000 7fd8aaf11640 1 --2- 172.21.15.55:0/601342322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40b7b90 0x7fd8a40d1c40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd8a408b540 tx=0x7fd89801c4e0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.477+0000 7fd8aaf11640 1 -- 172.21.15.55:0/601342322 shutdown_connections 2023-07-06T21:43:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.477+0000 7fd8aaf11640 1 --2- 172.21.15.55:0/601342322 >> v2:172.21.15.138:3300/0 conn(0x7fd8a40cc870 0x7fd8a40b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.477+0000 7fd8aaf11640 1 --2- 172.21.15.55:0/601342322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40b7b90 0x7fd8a40d1c40 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.477+0000 7fd8aaf11640 1 -- 172.21.15.55:0/601342322 >> 172.21.15.55:0/601342322 conn(0x7fd8a40ceca0 msgr2=0x7fd8a40cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.477+0000 7fd8aaf11640 1 -- 172.21.15.55:0/601342322 shutdown_connections 2023-07-06T21:43:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.477+0000 7fd8aaf11640 1 -- 172.21.15.55:0/601342322 wait complete. 2023-07-06T21:43:22.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8aaf11640 1 Processor -- start 2023-07-06T21:43:22.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8aaf11640 1 -- start start 2023-07-06T21:43:22.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8aaf11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b4130 0x7fd8a40c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8aaf11640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8a40b7b90 0x7fd8a4154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8aaf11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40cc870 0x7fd8a414f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8aaf11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40ca5e0 con 0x7fd8a40cc870 2023-07-06T21:43:22.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8aaf11640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a41547c0 con 0x7fd8a40b7b90 2023-07-06T21:43:22.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8aaf11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40c99d0 con 0x7fd8a40b4130 2023-07-06T21:43:22.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8a94ae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40cc870 0x7fd8a414f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8a94ae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40cc870 0x7fd8a414f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60712/0 (socket says 172.21.15.55:60712) 2023-07-06T21:43:22.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8a94ae640 1 -- 172.21.15.55:0/448210110 learned_addr learned my addr 172.21.15.55:0/448210110 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8a8cad640 1 --2- 172.21.15.55:0/448210110 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b4130 0x7fd8a40c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8a3fff640 1 --2- 172.21.15.55:0/448210110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8a40b7b90 0x7fd8a4154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8a94ae640 1 -- 172.21.15.55:0/448210110 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b4130 msgr2=0x7fd8a40c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8a94ae640 1 --2- 172.21.15.55:0/448210110 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b4130 0x7fd8a40c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8a94ae640 1 -- 172.21.15.55:0/448210110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8a40b7b90 msgr2=0x7fd8a4154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:22.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8a94ae640 1 --2- 172.21.15.55:0/448210110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8a40b7b90 0x7fd8a4154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8a94ae640 1 -- 172.21.15.55:0/448210110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8980094d0 con 0x7fd8a40cc870 2023-07-06T21:43:22.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8a94ae640 1 --2- 172.21.15.55:0/448210110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40cc870 0x7fd8a414f450 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00c7a0 tx=0x7fd89c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:22.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8a17fa640 1 -- 172.21.15.55:0/448210110 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c003b80 con 0x7fd8a40cc870 2023-07-06T21:43:22.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8a17fa640 1 -- 172.21.15.55:0/448210110 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c003ce0 con 0x7fd8a40cc870 2023-07-06T21:43:22.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8a17fa640 1 -- 172.21.15.55:0/448210110 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c00aa90 con 0x7fd8a40cc870 2023-07-06T21:43:22.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8aaf11640 1 -- 172.21.15.55:0/448210110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a40c9cb0 con 0x7fd8a40cc870 2023-07-06T21:43:22.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.481+0000 7fd8aaf11640 1 -- 172.21.15.55:0/448210110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a40ca270 con 0x7fd8a40cc870 2023-07-06T21:43:22.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.485+0000 7fd8aaf11640 1 -- 172.21.15.55:0/448210110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a40ca430 con 0x7fd8a40cc870 2023-07-06T21:43:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.485+0000 7fd8a17fa640 1 -- 172.21.15.55:0/448210110 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd89c00abf0 con 0x7fd8a40cc870 2023-07-06T21:43:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.485+0000 7fd8a17fa640 1 --2- 172.21.15.55:0/448210110 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd8880662b0 0x7fd888068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.485+0000 7fd8a17fa640 1 -- 172.21.15.55:0/448210110 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd89c083960 con 0x7fd8a40cc870 2023-07-06T21:43:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.485+0000 7fd8a8cad640 1 --2- 172.21.15.55:0/448210110 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd8880662b0 0x7fd888068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.485+0000 7fd8a8cad640 1 --2- 172.21.15.55:0/448210110 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd8880662b0 0x7fd888068760 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd8980af000 tx=0x7fd8980b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:22.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.489+0000 7fd8a17fa640 1 -- 172.21.15.55:0/448210110 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd89c050f70 con 0x7fd8a40cc870 2023-07-06T21:43:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.701+0000 7fd8aaf11640 1 -- 172.21.15.55:0/448210110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd8a40ca790 con 0x7fd8a40cc870 2023-07-06T21:43:22.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.705+0000 7fd8a17fa640 1 -- 172.21.15.55:0/448210110 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd8a40ca790 con 0x7fd8a40cc870 2023-07-06T21:43:22.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.709+0000 7fd8aaf11640 1 -- 172.21.15.55:0/448210110 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd8880662b0 msgr2=0x7fd888068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:22.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.709+0000 7fd8aaf11640 1 --2- 172.21.15.55:0/448210110 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd8880662b0 0x7fd888068760 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd8980af000 tx=0x7fd8980b6040 comp rx=0 tx=0).stop 2023-07-06T21:43:22.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.709+0000 7fd8aaf11640 1 -- 172.21.15.55:0/448210110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40cc870 msgr2=0x7fd8a414f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:22.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.709+0000 7fd8aaf11640 1 --2- 172.21.15.55:0/448210110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40cc870 0x7fd8a414f450 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00c7a0 tx=0x7fd89c00cc60 comp rx=0 tx=0).stop 2023-07-06T21:43:22.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.709+0000 7fd8aaf11640 1 -- 172.21.15.55:0/448210110 shutdown_connections 2023-07-06T21:43:22.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.709+0000 7fd8aaf11640 1 --2- 172.21.15.55:0/448210110 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd8880662b0 0x7fd888068760 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.709+0000 7fd8aaf11640 1 --2- 172.21.15.55:0/448210110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40cc870 0x7fd8a414f450 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.709+0000 7fd8aaf11640 1 --2- 172.21.15.55:0/448210110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8a40b7b90 0x7fd8a4154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.709+0000 7fd8aaf11640 1 --2- 172.21.15.55:0/448210110 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b4130 0x7fd8a40c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.709+0000 7fd8aaf11640 1 -- 172.21.15.55:0/448210110 >> 172.21.15.55:0/448210110 conn(0x7fd8a40ceca0 msgr2=0x7fd8a4157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:22.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.709+0000 7fd8aaf11640 1 -- 172.21.15.55:0/448210110 shutdown_connections 2023-07-06T21:43:22.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.709+0000 7fd8aaf11640 1 -- 172.21.15.55:0/448210110 wait complete. 2023-07-06T21:43:22.736 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-06T21:43:22.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.869+0000 7fe2ee103640 1 Processor -- start 2023-07-06T21:43:22.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.869+0000 7fe2ee103640 1 -- start start 2023-07-06T21:43:22.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2ee103640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2e80ccf40 0x7fe2e815bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2ee103640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe2e80cf090 0x7fe2e80cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2ee103640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2e80cb7e0 0x7fe2e80cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2ee103640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e80ce950 con 0x7fe2e80ccf40 2023-07-06T21:43:22.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2ee103640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e80cc180 con 0x7fe2e80cf090 2023-07-06T21:43:22.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2ee103640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e80cdcd0 con 0x7fe2e80cb7e0 2023-07-06T21:43:22.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2e77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2e80ccf40 0x7fe2e815bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2e77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2e80ccf40 0x7fe2e815bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60728/0 (socket says 172.21.15.55:60728) 2023-07-06T21:43:22.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2e77fe640 1 -- 172.21.15.55:0/4135112040 learned_addr learned my addr 172.21.15.55:0/4135112040 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:22.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2e7fff640 1 --2- 172.21.15.55:0/4135112040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2e80cb7e0 0x7fe2e80cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2e6ffd640 1 --2- 172.21.15.55:0/4135112040 >> v2:172.21.15.138:3300/0 conn(0x7fe2e80cf090 0x7fe2e80cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2e77fe640 1 -- 172.21.15.55:0/4135112040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2e80cb7e0 msgr2=0x7fe2e80cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:22.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2e77fe640 1 --2- 172.21.15.55:0/4135112040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2e80cb7e0 0x7fe2e80cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2e77fe640 1 -- 172.21.15.55:0/4135112040 >> v2:172.21.15.138:3300/0 conn(0x7fe2e80cf090 msgr2=0x7fe2e80cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:22.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2e77fe640 1 --2- 172.21.15.55:0/4135112040 >> v2:172.21.15.138:3300/0 conn(0x7fe2e80cf090 0x7fe2e80cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.873+0000 7fe2e77fe640 1 -- 172.21.15.55:0/4135112040 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e80cdfb0 con 0x7fe2e80ccf40 2023-07-06T21:43:22.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2e77fe640 1 --2- 172.21.15.55:0/4135112040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2e80ccf40 0x7fe2e815bf40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe2e80660e0 tx=0x7fe2d801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c4e99d0c778b80 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:22.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2e67fc640 1 -- 172.21.15.55:0/4135112040 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80aa5f0 con 0x7fe2e80ccf40 2023-07-06T21:43:22.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2e67fc640 1 -- 172.21.15.55:0/4135112040 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d80aa750 con 0x7fe2e80ccf40 2023-07-06T21:43:22.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2e67fc640 1 -- 172.21.15.55:0/4135112040 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80aaae0 con 0x7fe2e80ccf40 2023-07-06T21:43:22.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2ee103640 1 -- 172.21.15.55:0/4135112040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2e80ccf40 msgr2=0x7fe2e815bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:22.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2ee103640 1 --2- 172.21.15.55:0/4135112040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2e80ccf40 0x7fe2e815bf40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe2e80660e0 tx=0x7fe2d801c4d0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2ee103640 1 -- 172.21.15.55:0/4135112040 shutdown_connections 2023-07-06T21:43:22.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2ee103640 1 --2- 172.21.15.55:0/4135112040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2e80cb7e0 0x7fe2e80cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2ee103640 1 --2- 172.21.15.55:0/4135112040 >> v2:172.21.15.138:3300/0 conn(0x7fe2e80cf090 0x7fe2e80cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2ee103640 1 --2- 172.21.15.55:0/4135112040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2e80ccf40 0x7fe2e815bf40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2ee103640 1 -- 172.21.15.55:0/4135112040 >> 172.21.15.55:0/4135112040 conn(0x7fe2e80cff60 msgr2=0x7fe2e80d0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:22.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2ee103640 1 -- 172.21.15.55:0/4135112040 shutdown_connections 2023-07-06T21:43:22.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2ee103640 1 -- 172.21.15.55:0/4135112040 wait complete. 2023-07-06T21:43:22.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2ee103640 1 Processor -- start 2023-07-06T21:43:22.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.877+0000 7fe2ee103640 1 -- start start 2023-07-06T21:43:22.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2ee103640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2e80cb7e0 0x7fe2e814f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2ee103640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2e80ccf40 0x7fe2e8156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2ee103640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2e80cf090 0x7fe2e8156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2ee103640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e80b46d0 con 0x7fe2e80cb7e0 2023-07-06T21:43:22.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2ee103640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e8154ce0 con 0x7fe2e80ccf40 2023-07-06T21:43:22.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2ee103640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e8155210 con 0x7fe2e80cf090 2023-07-06T21:43:22.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2e77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2e80cb7e0 0x7fe2e814f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2e77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2e80cb7e0 0x7fe2e814f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60732/0 (socket says 172.21.15.55:60732) 2023-07-06T21:43:22.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2e77fe640 1 -- 172.21.15.55:0/4214825985 learned_addr learned my addr 172.21.15.55:0/4214825985 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:22.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2e77fe640 1 -- 172.21.15.55:0/4214825985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2e80cf090 msgr2=0x7fe2e8156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:22.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2e77fe640 1 --2- 172.21.15.55:0/4214825985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2e80cf090 0x7fe2e8156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2e77fe640 1 -- 172.21.15.55:0/4214825985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2e80ccf40 msgr2=0x7fe2e8156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:22.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2e77fe640 1 --2- 172.21.15.55:0/4214825985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2e80ccf40 0x7fe2e8156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:22.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2e77fe640 1 -- 172.21.15.55:0/4214825985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80094d0 con 0x7fe2e80cb7e0 2023-07-06T21:43:22.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2e77fe640 1 --2- 172.21.15.55:0/4214825985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2e80cb7e0 0x7fe2e814f2e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe2d801c9b0 tx=0x7fe2d801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:22.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2cffff640 1 -- 172.21.15.55:0/4214825985 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80aa5f0 con 0x7fe2e80cb7e0 2023-07-06T21:43:22.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2cffff640 1 -- 172.21.15.55:0/4214825985 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d80b3820 con 0x7fe2e80cb7e0 2023-07-06T21:43:22.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2ee103640 1 -- 172.21.15.55:0/4214825985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e8154f30 con 0x7fe2e80cb7e0 2023-07-06T21:43:22.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2cffff640 1 -- 172.21.15.55:0/4214825985 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80b3bd0 con 0x7fe2e80cb7e0 2023-07-06T21:43:22.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2ee103640 1 -- 172.21.15.55:0/4214825985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e8153d90 con 0x7fe2e80cb7e0 2023-07-06T21:43:22.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2ee103640 1 -- 172.21.15.55:0/4214825985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e804d790 con 0x7fe2e80cb7e0 2023-07-06T21:43:22.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.881+0000 7fe2cffff640 1 -- 172.21.15.55:0/4214825985 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe2d80b3d30 con 0x7fe2e80cb7e0 2023-07-06T21:43:22.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.885+0000 7fe2cffff640 1 --2- 172.21.15.55:0/4214825985 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe2d4066280 0x7fe2d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:22.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.885+0000 7fe2cffff640 1 -- 172.21.15.55:0/4214825985 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe2d80a7070 con 0x7fe2e80cb7e0 2023-07-06T21:43:22.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.885+0000 7fe2e6ffd640 1 --2- 172.21.15.55:0/4214825985 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe2d4066280 0x7fe2d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:22.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.885+0000 7fe2e6ffd640 1 --2- 172.21.15.55:0/4214825985 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe2d4066280 0x7fe2d4068730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe2e81571a0 tx=0x7fe2dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:22.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:22.889+0000 7fe2cffff640 1 -- 172.21.15.55:0/4214825985 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2d80eb0d0 con 0x7fe2e80cb7e0 2023-07-06T21:43:23.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.093+0000 7fe2ee103640 1 -- 172.21.15.55:0/4214825985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe2e80cb5c0 con 0x7fe2e80cb7e0 2023-07-06T21:43:23.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.101+0000 7fe2cffff640 1 -- 172.21.15.55:0/4214825985 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe2d80ee6f0 con 0x7fe2e80cb7e0 2023-07-06T21:43:23.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.101+0000 7fe2ee103640 1 -- 172.21.15.55:0/4214825985 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe2d4066280 msgr2=0x7fe2d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:23.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.101+0000 7fe2ee103640 1 --2- 172.21.15.55:0/4214825985 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe2d4066280 0x7fe2d4068730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe2e81571a0 tx=0x7fe2dc008040 comp rx=0 tx=0).stop 2023-07-06T21:43:23.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.101+0000 7fe2ee103640 1 -- 172.21.15.55:0/4214825985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2e80cb7e0 msgr2=0x7fe2e814f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:23.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.101+0000 7fe2ee103640 1 --2- 172.21.15.55:0/4214825985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2e80cb7e0 0x7fe2e814f2e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe2d801c9b0 tx=0x7fe2d801ad10 comp rx=0 tx=0).stop 2023-07-06T21:43:23.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.101+0000 7fe2ee103640 1 -- 172.21.15.55:0/4214825985 shutdown_connections 2023-07-06T21:43:23.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.101+0000 7fe2ee103640 1 --2- 172.21.15.55:0/4214825985 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe2d4066280 0x7fe2d4068730 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.101+0000 7fe2ee103640 1 --2- 172.21.15.55:0/4214825985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2e80cf090 0x7fe2e8156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.101+0000 7fe2ee103640 1 --2- 172.21.15.55:0/4214825985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2e80ccf40 0x7fe2e8156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.101+0000 7fe2ee103640 1 --2- 172.21.15.55:0/4214825985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2e80cb7e0 0x7fe2e814f2e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.101+0000 7fe2ee103640 1 -- 172.21.15.55:0/4214825985 >> 172.21.15.55:0/4214825985 conn(0x7fe2e80cff60 msgr2=0x7fe2e80b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:23.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.101+0000 7fe2ee103640 1 -- 172.21.15.55:0/4214825985 shutdown_connections 2023-07-06T21:43:23.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.101+0000 7fe2ee103640 1 -- 172.21.15.55:0/4214825985 wait complete. 2023-07-06T21:43:23.129 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-06T21:43:23.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6ce0ec640 1 Processor -- start 2023-07-06T21:43:23.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6ce0ec640 1 -- start start 2023-07-06T21:43:23.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6ce0ec640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6c80709a0 0x7fa6c80cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:23.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6ce0ec640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa6c80cbe60 0x7fa6c80b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:23.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6ce0ec640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c80cc300 con 0x7fa6c8070d70 2023-07-06T21:43:23.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6ce0ec640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c80cc5e0 con 0x7fa6c80709a0 2023-07-06T21:43:23.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6ce0ec640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c80cc8c0 con 0x7fa6c80cbe60 2023-07-06T21:43:23.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6c77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6c80709a0 0x7fa6c80cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:23.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6c77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6c80709a0 0x7fa6c80cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50624/0 (socket says 172.21.15.55:50624) 2023-07-06T21:43:23.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6c77fe640 1 -- 172.21.15.55:0/1838381885 learned_addr learned my addr 172.21.15.55:0/1838381885 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:23.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6c6ffd640 1 --2- 172.21.15.55:0/1838381885 >> v2:172.21.15.138:3300/0 conn(0x7fa6c80cbe60 0x7fa6c80b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:23.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6c77fe640 1 -- 172.21.15.55:0/1838381885 >> v2:172.21.15.138:3300/0 conn(0x7fa6c80cbe60 msgr2=0x7fa6c80b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:23.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6c77fe640 1 --2- 172.21.15.55:0/1838381885 >> v2:172.21.15.138:3300/0 conn(0x7fa6c80cbe60 0x7fa6c80b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6c77fe640 1 -- 172.21.15.55:0/1838381885 >> v1:172.21.15.138:6789/0 conn(0x7fa6c8070d70 legacy=0x7fa6c815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:23.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6c77fe640 1 -- 172.21.15.55:0/1838381885 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80ccba0 con 0x7fa6c80709a0 2023-07-06T21:43:23.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.265+0000 7fa6c6ffd640 1 --2- 172.21.15.55:0/1838381885 >> v2:172.21.15.138:3300/0 conn(0x7fa6c80cbe60 0x7fa6c80b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:23.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.269+0000 7fa6c77fe640 1 --2- 172.21.15.55:0/1838381885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6c80709a0 0x7fa6c80cb920 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80ca7c0 tx=0x7fa6b801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972f9ffe92a5e1b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:23.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.269+0000 7fa6c67fc640 1 -- 172.21.15.55:0/1838381885 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b80ab600 con 0x7fa6c80709a0 2023-07-06T21:43:23.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.269+0000 7fa6c67fc640 1 -- 172.21.15.55:0/1838381885 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b80a7050 con 0x7fa6c80709a0 2023-07-06T21:43:23.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.269+0000 7fa6c67fc640 1 -- 172.21.15.55:0/1838381885 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b80ab980 con 0x7fa6c80709a0 2023-07-06T21:43:23.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.269+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/1838381885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6c80709a0 msgr2=0x7fa6c80cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:23.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.269+0000 7fa6ce0ec640 1 --2- 172.21.15.55:0/1838381885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6c80709a0 0x7fa6c80cb920 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80ca7c0 tx=0x7fa6b801c500 comp rx=0 tx=0).stop 2023-07-06T21:43:23.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.269+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/1838381885 shutdown_connections 2023-07-06T21:43:23.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.269+0000 7fa6ce0ec640 1 --2- 172.21.15.55:0/1838381885 >> v2:172.21.15.138:3300/0 conn(0x7fa6c80cbe60 0x7fa6c80b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.269+0000 7fa6ce0ec640 1 --2- 172.21.15.55:0/1838381885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6c80709a0 0x7fa6c80cb920 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.269+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/1838381885 >> 172.21.15.55:0/1838381885 conn(0x7fa6c80cea70 msgr2=0x7fa6c80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:23.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.269+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/1838381885 shutdown_connections 2023-07-06T21:43:23.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.269+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/1838381885 wait complete. 2023-07-06T21:43:23.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6ce0ec640 1 Processor -- start 2023-07-06T21:43:23.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6ce0ec640 1 -- start start 2023-07-06T21:43:23.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6ce0ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6c80709a0 0x7fa6c81fbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:23.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6ce0ec640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6c8070d70 0x7fa6c8156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:23.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6ce0ec640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6c80cbe60 0x7fa6c815c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:23.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6ce0ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c81fc010 con 0x7fa6c80709a0 2023-07-06T21:43:23.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6ce0ec640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c8157720 con 0x7fa6c8070d70 2023-07-06T21:43:23.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6ce0ec640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c80c43e0 con 0x7fa6c80cbe60 2023-07-06T21:43:23.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6c77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6c80709a0 0x7fa6c81fbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:23.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6c77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6c80709a0 0x7fa6c81fbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50632/0 (socket says 172.21.15.55:50632) 2023-07-06T21:43:23.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6c77fe640 1 -- 172.21.15.55:0/2145992417 learned_addr learned my addr 172.21.15.55:0/2145992417 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:23.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6c6ffd640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6c8070d70 0x7fa6c8156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:23.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6c7fff640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6c80cbe60 0x7fa6c815c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:23.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6c77fe640 1 -- 172.21.15.55:0/2145992417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6c80cbe60 msgr2=0x7fa6c815c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:23.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6c77fe640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6c80cbe60 0x7fa6c815c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6c77fe640 1 -- 172.21.15.55:0/2145992417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6c8070d70 msgr2=0x7fa6c8156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:23.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6c77fe640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6c8070d70 0x7fa6c8156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6c77fe640 1 -- 172.21.15.55:0/2145992417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b80094d0 con 0x7fa6c80709a0 2023-07-06T21:43:23.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6c6ffd640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6c8070d70 0x7fa6c8156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:23.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6c77fe640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6c80709a0 0x7fa6c81fbad0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80ae040 tx=0x7fa6b80192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:23.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6affff640 1 -- 172.21.15.55:0/2145992417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b80b4440 con 0x7fa6c80709a0 2023-07-06T21:43:23.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6affff640 1 -- 172.21.15.55:0/2145992417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b80b45a0 con 0x7fa6c80709a0 2023-07-06T21:43:23.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/2145992417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c80c9410 con 0x7fa6c80709a0 2023-07-06T21:43:23.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6affff640 1 -- 172.21.15.55:0/2145992417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b80b4930 con 0x7fa6c80709a0 2023-07-06T21:43:23.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/2145992417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c80c99d0 con 0x7fa6c80709a0 2023-07-06T21:43:23.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.273+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/2145992417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c8066d60 con 0x7fa6c80709a0 2023-07-06T21:43:23.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.277+0000 7fa6affff640 1 -- 172.21.15.55:0/2145992417 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6b80b2070 con 0x7fa6c80709a0 2023-07-06T21:43:23.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.277+0000 7fa6affff640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa6b4066280 0x7fa6b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:23.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.277+0000 7fa6affff640 1 -- 172.21.15.55:0/2145992417 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa6b811db40 con 0x7fa6c80709a0 2023-07-06T21:43:23.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.277+0000 7fa6c6ffd640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa6b4066280 0x7fa6b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:23.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.277+0000 7fa6c6ffd640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa6b4066280 0x7fa6b4068730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8069cc0 tx=0x7fa6bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:23.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.281+0000 7fa6affff640 1 -- 172.21.15.55:0/2145992417 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6b80eb130 con 0x7fa6c80709a0 2023-07-06T21:43:23.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.489+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/2145992417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fa6c80b3440 con 0x7fa6c80709a0 2023-07-06T21:43:23.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.493+0000 7fa6affff640 1 -- 172.21.15.55:0/2145992417 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa6b80b0020 con 0x7fa6c80709a0 2023-07-06T21:43:23.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.493+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/2145992417 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa6b4066280 msgr2=0x7fa6b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:23.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.493+0000 7fa6ce0ec640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa6b4066280 0x7fa6b4068730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8069cc0 tx=0x7fa6bc008040 comp rx=0 tx=0).stop 2023-07-06T21:43:23.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.493+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/2145992417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6c80709a0 msgr2=0x7fa6c81fbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:23.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.493+0000 7fa6ce0ec640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6c80709a0 0x7fa6c81fbad0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80ae040 tx=0x7fa6b80192a0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.493+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/2145992417 shutdown_connections 2023-07-06T21:43:23.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.493+0000 7fa6ce0ec640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fa6b4066280 0x7fa6b4068730 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.493+0000 7fa6ce0ec640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6c80cbe60 0x7fa6c815c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.493+0000 7fa6ce0ec640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6c8070d70 0x7fa6c8156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.493+0000 7fa6ce0ec640 1 --2- 172.21.15.55:0/2145992417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6c80709a0 0x7fa6c81fbad0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.493+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/2145992417 >> 172.21.15.55:0/2145992417 conn(0x7fa6c80cea70 msgr2=0x7fa6c80c6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:23.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.493+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/2145992417 shutdown_connections 2023-07-06T21:43:23.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.493+0000 7fa6ce0ec640 1 -- 172.21.15.55:0/2145992417 wait complete. 2023-07-06T21:43:23.522 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-06T21:43:23.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.657+0000 7f0fed46a640 1 Processor -- start 2023-07-06T21:43:23.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.657+0000 7f0fed46a640 1 -- start start 2023-07-06T21:43:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.661+0000 7f0fed46a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fe80b7b90 0x7f0fe80d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.661+0000 7f0fed46a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0fe80b4300 0x7f0fe80b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.661+0000 7f0fed46a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe80b5070 con 0x7f0fe80cc870 2023-07-06T21:43:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.661+0000 7f0fed46a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe8160020 con 0x7f0fe80b4300 2023-07-06T21:43:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.661+0000 7f0fed46a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe81604b0 con 0x7f0fe80b7b90 2023-07-06T21:43:23.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.661+0000 7f0fe77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0fe80b4300 0x7f0fe80b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:23.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.661+0000 7f0fe77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0fe80b4300 0x7f0fe80b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50640/0 (socket says 172.21.15.55:50640) 2023-07-06T21:43:23.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.661+0000 7f0fe77fe640 1 -- 172.21.15.55:0/4222747393 learned_addr learned my addr 172.21.15.55:0/4222747393 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:23.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.661+0000 7f0fe6ffd640 1 --2- 172.21.15.55:0/4222747393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fe80b7b90 0x7f0fe80d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.661+0000 7f0fe77fe640 1 -- 172.21.15.55:0/4222747393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fe80b7b90 msgr2=0x7f0fe80d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.661+0000 7f0fe77fe640 1 --2- 172.21.15.55:0/4222747393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fe80b7b90 0x7f0fe80d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.661+0000 7f0fe77fe640 1 -- 172.21.15.55:0/4222747393 >> v1:172.21.15.138:6789/0 conn(0x7f0fe80cc870 legacy=0x7f0fe80b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.661+0000 7f0fe77fe640 1 -- 172.21.15.55:0/4222747393 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe80cd030 con 0x7f0fe80b4300 2023-07-06T21:43:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.661+0000 7f0fe6ffd640 1 --2- 172.21.15.55:0/4222747393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fe80b7b90 0x7f0fe80d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fe77fe640 1 --2- 172.21.15.55:0/4222747393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fe80b4300 0x7f0fe80b1af0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009e50 tx=0x7f0fe001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efae8c459a53e53 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:23.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fe67fc640 1 -- 172.21.15.55:0/4222747393 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe00a58a0 con 0x7f0fe80b4300 2023-07-06T21:43:23.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fe67fc640 1 -- 172.21.15.55:0/4222747393 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe00a5a00 con 0x7f0fe80b4300 2023-07-06T21:43:23.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fe67fc640 1 -- 172.21.15.55:0/4222747393 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe00a5d90 con 0x7f0fe80b4300 2023-07-06T21:43:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 -- 172.21.15.55:0/4222747393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fe80b4300 msgr2=0x7f0fe80b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 --2- 172.21.15.55:0/4222747393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fe80b4300 0x7f0fe80b1af0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009e50 tx=0x7f0fe001c9e0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 -- 172.21.15.55:0/4222747393 shutdown_connections 2023-07-06T21:43:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 --2- 172.21.15.55:0/4222747393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fe80b4300 0x7f0fe80b1af0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 --2- 172.21.15.55:0/4222747393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fe80b7b90 0x7f0fe80d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 -- 172.21.15.55:0/4222747393 >> 172.21.15.55:0/4222747393 conn(0x7f0fe80ceca0 msgr2=0x7f0fe80cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 -- 172.21.15.55:0/4222747393 shutdown_connections 2023-07-06T21:43:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 -- 172.21.15.55:0/4222747393 wait complete. 2023-07-06T21:43:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 Processor -- start 2023-07-06T21:43:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 -- start start 2023-07-06T21:43:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fe80b4300 0x7f0fe80cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fe80b7b90 0x7f0fe80ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80cc870 0x7f0fe8155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe80cc240 con 0x7f0fe80b4300 2023-07-06T21:43:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe80cb1a0 con 0x7f0fe80cc870 2023-07-06T21:43:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.665+0000 7f0fed46a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe80cb480 con 0x7f0fe80b7b90 2023-07-06T21:43:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fe6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fe80b4300 0x7f0fe80cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fe6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fe80b4300 0x7f0fe80cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50654/0 (socket says 172.21.15.55:50654) 2023-07-06T21:43:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fe6ffd640 1 -- 172.21.15.55:0/3584723967 learned_addr learned my addr 172.21.15.55:0/3584723967 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fe77fe640 1 --2- 172.21.15.55:0/3584723967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80cc870 0x7f0fe8155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fdffff640 1 --2- 172.21.15.55:0/3584723967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fe80b7b90 0x7f0fe80ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fe6ffd640 1 -- 172.21.15.55:0/3584723967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fe80b7b90 msgr2=0x7f0fe80ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fe6ffd640 1 --2- 172.21.15.55:0/3584723967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fe80b7b90 0x7f0fe80ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fe6ffd640 1 -- 172.21.15.55:0/3584723967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80cc870 msgr2=0x7f0fe8155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fe6ffd640 1 --2- 172.21.15.55:0/3584723967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80cc870 0x7f0fe8155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fe6ffd640 1 -- 172.21.15.55:0/3584723967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe0009b30 con 0x7f0fe80b4300 2023-07-06T21:43:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fe6ffd640 1 --2- 172.21.15.55:0/3584723967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fe80b4300 0x7f0fe80cabc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800e810 tx=0x7f0fd800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fdf7fe640 1 -- 172.21.15.55:0/3584723967 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd800c8d0 con 0x7f0fe80b4300 2023-07-06T21:43:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fdf7fe640 1 -- 172.21.15.55:0/3584723967 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd800ca30 con 0x7f0fe80b4300 2023-07-06T21:43:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fed46a640 1 -- 172.21.15.55:0/3584723967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe80cb760 con 0x7f0fe80b4300 2023-07-06T21:43:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fdf7fe640 1 -- 172.21.15.55:0/3584723967 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd800cde0 con 0x7f0fe80b4300 2023-07-06T21:43:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fed46a640 1 -- 172.21.15.55:0/3584723967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe80cbd20 con 0x7f0fe80b4300 2023-07-06T21:43:23.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fed46a640 1 -- 172.21.15.55:0/3584723967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe8066d60 con 0x7f0fe80b4300 2023-07-06T21:43:23.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.669+0000 7f0fdf7fe640 1 -- 172.21.15.55:0/3584723967 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0fd8013410 con 0x7f0fe80b4300 2023-07-06T21:43:23.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.673+0000 7f0fdf7fe640 1 --2- 172.21.15.55:0/3584723967 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0fc8066280 0x7f0fc8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:23.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.673+0000 7f0fdf7fe640 1 -- 172.21.15.55:0/3584723967 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0fd8083890 con 0x7f0fe80b4300 2023-07-06T21:43:23.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.673+0000 7f0fdffff640 1 --2- 172.21.15.55:0/3584723967 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0fc8066280 0x7f0fc8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.673+0000 7f0fdffff640 1 --2- 172.21.15.55:0/3584723967 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0fc8066280 0x7f0fc8068730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80c88d0 tx=0x7f0fd0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:23.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.677+0000 7f0fdf7fe640 1 -- 172.21.15.55:0/3584723967 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0fd8050fc0 con 0x7f0fe80b4300 2023-07-06T21:43:23.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.885+0000 7f0fed46a640 1 -- 172.21.15.55:0/3584723967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f0fe815f2c0 con 0x7f0fe80b4300 2023-07-06T21:43:23.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.889+0000 7f0fdf7fe640 1 -- 172.21.15.55:0/3584723967 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0fd80545e0 con 0x7f0fe80b4300 2023-07-06T21:43:23.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.893+0000 7f0fed46a640 1 -- 172.21.15.55:0/3584723967 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0fc8066280 msgr2=0x7f0fc8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:23.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.893+0000 7f0fed46a640 1 --2- 172.21.15.55:0/3584723967 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0fc8066280 0x7f0fc8068730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80c88d0 tx=0x7f0fd0009040 comp rx=0 tx=0).stop 2023-07-06T21:43:23.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.893+0000 7f0fed46a640 1 -- 172.21.15.55:0/3584723967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fe80b4300 msgr2=0x7f0fe80cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:23.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.893+0000 7f0fed46a640 1 --2- 172.21.15.55:0/3584723967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fe80b4300 0x7f0fe80cabc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800e810 tx=0x7f0fd800ecd0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.893+0000 7f0fed46a640 1 -- 172.21.15.55:0/3584723967 shutdown_connections 2023-07-06T21:43:23.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.893+0000 7f0fed46a640 1 --2- 172.21.15.55:0/3584723967 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f0fc8066280 0x7f0fc8068730 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.893+0000 7f0fed46a640 1 --2- 172.21.15.55:0/3584723967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fe80cc870 0x7f0fe8155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.893+0000 7f0fed46a640 1 --2- 172.21.15.55:0/3584723967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fe80b7b90 0x7f0fe80ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.893+0000 7f0fed46a640 1 --2- 172.21.15.55:0/3584723967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fe80b4300 0x7f0fe80cabc0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:23.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.893+0000 7f0fed46a640 1 -- 172.21.15.55:0/3584723967 >> 172.21.15.55:0/3584723967 conn(0x7f0fe80ceca0 msgr2=0x7f0fe80d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:23.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.893+0000 7f0fed46a640 1 -- 172.21.15.55:0/3584723967 shutdown_connections 2023-07-06T21:43:23.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:23.893+0000 7f0fed46a640 1 -- 172.21.15.55:0/3584723967 wait complete. 2023-07-06T21:43:23.920 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-06T21:43:24.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.057+0000 7fec7ecd8640 1 Processor -- start 2023-07-06T21:43:24.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.057+0000 7fec7ecd8640 1 -- start start 2023-07-06T21:43:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.057+0000 7fec7ecd8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec780cbd50 0x7fec780c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.057+0000 7fec7ecd8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7806c9e0 con 0x7fec78069db0 2023-07-06T21:43:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.057+0000 7fec7ecd8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7806a290 con 0x7fec780cd510 2023-07-06T21:43:24.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.057+0000 7fec7ecd8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7806d080 con 0x7fec780cbd50 2023-07-06T21:43:24.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.057+0000 7fec7d275640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec780cbd50 0x7fec780c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.057+0000 7fec7d275640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec780cbd50 0x7fec780c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50658/0 (socket says 172.21.15.55:50658) 2023-07-06T21:43:24.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.057+0000 7fec77fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fec78069db0 0x7fec780c87d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45000/0 (socket says 172.21.15.55:45000) 2023-07-06T21:43:24.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.057+0000 7fec7d275640 1 -- 172.21.15.55:0/3750845848 learned_addr learned my addr 172.21.15.55:0/3750845848 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.057+0000 7fec7d275640 1 -- 172.21.15.55:0/3750845848 >> v1:172.21.15.138:6789/0 conn(0x7fec780cd510 legacy=0x7fec780cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.057+0000 7fec7d275640 1 -- 172.21.15.55:0/3750845848 >> v1:172.21.15.55:6789/0 conn(0x7fec78069db0 legacy=0x7fec780c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.057+0000 7fec7d275640 1 -- 172.21.15.55:0/3750845848 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7806a570 con 0x7fec780cbd50 2023-07-06T21:43:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.057+0000 7fec777fe640 1 -- 172.21.15.55:0/3750845848 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622256342 0 0) 0x7fec7806c9e0 con 0x7fec78069db0 2023-07-06T21:43:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.061+0000 7fec7d275640 1 --2- 172.21.15.55:0/3750845848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec780cbd50 0x7fec780c8ee0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fec70009e50 tx=0x7fec7001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904bbe497846fd4d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:24.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.061+0000 7fec777fe640 1 -- 172.21.15.55:0/3750845848 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700a5750 con 0x7fec780cbd50 2023-07-06T21:43:24.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.061+0000 7fec777fe640 1 -- 172.21.15.55:0/3750845848 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec700a58b0 con 0x7fec780cbd50 2023-07-06T21:43:24.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.061+0000 7fec777fe640 1 -- 172.21.15.55:0/3750845848 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700a5c40 con 0x7fec780cbd50 2023-07-06T21:43:24.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.061+0000 7fec7ecd8640 1 -- 172.21.15.55:0/3750845848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec780cbd50 msgr2=0x7fec780c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.061+0000 7fec7ecd8640 1 --2- 172.21.15.55:0/3750845848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec780cbd50 0x7fec780c8ee0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fec70009e50 tx=0x7fec7001c980 comp rx=0 tx=0).stop 2023-07-06T21:43:24.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.061+0000 7fec7ecd8640 1 -- 172.21.15.55:0/3750845848 shutdown_connections 2023-07-06T21:43:24.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.061+0000 7fec7ecd8640 1 --2- 172.21.15.55:0/3750845848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec780cbd50 0x7fec780c8ee0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.061+0000 7fec7ecd8640 1 -- 172.21.15.55:0/3750845848 >> 172.21.15.55:0/3750845848 conn(0x7fec780afe60 msgr2=0x7fec780b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:24.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.061+0000 7fec7ecd8640 1 -- 172.21.15.55:0/3750845848 shutdown_connections 2023-07-06T21:43:24.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.061+0000 7fec7ecd8640 1 -- 172.21.15.55:0/3750845848 wait complete. 2023-07-06T21:43:24.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ecd8640 1 Processor -- start 2023-07-06T21:43:24.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ecd8640 1 -- start start 2023-07-06T21:43:24.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ecd8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec78069db0 0x7fec780c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ecd8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec780cbd50 0x7fec780c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ecd8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec780cd510 0x7fec78157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ecd8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec780c3f60 con 0x7fec78069db0 2023-07-06T21:43:24.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ecd8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec780c30d0 con 0x7fec780cd510 2023-07-06T21:43:24.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ecd8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec780b2220 con 0x7fec780cbd50 2023-07-06T21:43:24.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ca74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec78069db0 0x7fec780c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ca74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec78069db0 0x7fec780c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50660/0 (socket says 172.21.15.55:50660) 2023-07-06T21:43:24.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ca74640 1 -- 172.21.15.55:0/317532941 learned_addr learned my addr 172.21.15.55:0/317532941 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:24.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7d275640 1 --2- 172.21.15.55:0/317532941 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec780cd510 0x7fec78157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec77fff640 1 --2- 172.21.15.55:0/317532941 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec780cbd50 0x7fec780c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ca74640 1 -- 172.21.15.55:0/317532941 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec780cbd50 msgr2=0x7fec780c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ca74640 1 --2- 172.21.15.55:0/317532941 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec780cbd50 0x7fec780c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ca74640 1 -- 172.21.15.55:0/317532941 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec780cd510 msgr2=0x7fec78157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ca74640 1 --2- 172.21.15.55:0/317532941 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec780cd510 0x7fec78157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ca74640 1 -- 172.21.15.55:0/317532941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec70009b30 con 0x7fec78069db0 2023-07-06T21:43:24.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ca74640 1 --2- 172.21.15.55:0/317532941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec78069db0 0x7fec780c4380 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00c500 tx=0x7fec6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:24.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec757fa640 1 -- 172.21.15.55:0/317532941 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c005220 con 0x7fec78069db0 2023-07-06T21:43:24.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec757fa640 1 -- 172.21.15.55:0/317532941 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c005380 con 0x7fec78069db0 2023-07-06T21:43:24.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec757fa640 1 -- 172.21.15.55:0/317532941 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c007270 con 0x7fec78069db0 2023-07-06T21:43:24.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ecd8640 1 -- 172.21.15.55:0/317532941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7815bda0 con 0x7fec78069db0 2023-07-06T21:43:24.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ecd8640 1 -- 172.21.15.55:0/317532941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec780c38a0 con 0x7fec78069db0 2023-07-06T21:43:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.065+0000 7fec7ecd8640 1 -- 172.21.15.55:0/317532941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec780c40a0 con 0x7fec78069db0 2023-07-06T21:43:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.069+0000 7fec757fa640 1 -- 172.21.15.55:0/317532941 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec6c0073d0 con 0x7fec78069db0 2023-07-06T21:43:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.069+0000 7fec757fa640 1 --2- 172.21.15.55:0/317532941 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fec5c066280 0x7fec5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.069+0000 7fec757fa640 1 -- 172.21.15.55:0/317532941 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fec6c083350 con 0x7fec78069db0 2023-07-06T21:43:24.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.069+0000 7fec77fff640 1 --2- 172.21.15.55:0/317532941 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fec5c066280 0x7fec5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.069+0000 7fec77fff640 1 --2- 172.21.15.55:0/317532941 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fec5c066280 0x7fec5c068730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fec780b1e80 tx=0x7fec64007240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:24.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.073+0000 7fec757fa640 1 -- 172.21.15.55:0/317532941 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec780c40a0 con 0x7fec78069db0 2023-07-06T21:43:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.281+0000 7fec7ecd8640 1 -- 172.21.15.55:0/317532941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fec780c40a0 con 0x7fec78069db0 2023-07-06T21:43:24.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.285+0000 7fec757fa640 1 -- 172.21.15.55:0/317532941 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fec780c40a0 con 0x7fec78069db0 2023-07-06T21:43:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.289+0000 7fec7ecd8640 1 -- 172.21.15.55:0/317532941 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fec5c066280 msgr2=0x7fec5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.289+0000 7fec7ecd8640 1 --2- 172.21.15.55:0/317532941 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fec5c066280 0x7fec5c068730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fec780b1e80 tx=0x7fec64007240 comp rx=0 tx=0).stop 2023-07-06T21:43:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.289+0000 7fec7ecd8640 1 -- 172.21.15.55:0/317532941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec78069db0 msgr2=0x7fec780c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.289+0000 7fec7ecd8640 1 --2- 172.21.15.55:0/317532941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec78069db0 0x7fec780c4380 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00c500 tx=0x7fec6c00c9c0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.289+0000 7fec7ecd8640 1 -- 172.21.15.55:0/317532941 shutdown_connections 2023-07-06T21:43:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.289+0000 7fec7ecd8640 1 --2- 172.21.15.55:0/317532941 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fec5c066280 0x7fec5c068730 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.289+0000 7fec7ecd8640 1 --2- 172.21.15.55:0/317532941 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec780cd510 0x7fec78157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.289+0000 7fec7ecd8640 1 --2- 172.21.15.55:0/317532941 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec780cbd50 0x7fec780c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.289+0000 7fec7ecd8640 1 --2- 172.21.15.55:0/317532941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec78069db0 0x7fec780c4380 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.289+0000 7fec7ecd8640 1 -- 172.21.15.55:0/317532941 >> 172.21.15.55:0/317532941 conn(0x7fec780afe60 msgr2=0x7fec780c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.289+0000 7fec7ecd8640 1 -- 172.21.15.55:0/317532941 shutdown_connections 2023-07-06T21:43:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.289+0000 7fec7ecd8640 1 -- 172.21.15.55:0/317532941 wait complete. 2023-07-06T21:43:24.315 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-06T21:43:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.449+0000 7efe89dd2640 1 Processor -- start 2023-07-06T21:43:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.449+0000 7efe89dd2640 1 -- start start 2023-07-06T21:43:24.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe89dd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe84156180 0x7efe840ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe89dd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe840cbeb0 0x7efe8406ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe89dd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe840cc310 con 0x7efe8406e9d0 2023-07-06T21:43:24.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe89dd2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe84160250 con 0x7efe84156180 2023-07-06T21:43:24.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe89dd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8406f390 con 0x7efe840cbeb0 2023-07-06T21:43:24.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe837fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe84156180 0x7efe840ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe837fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe84156180 0x7efe840ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50666/0 (socket says 172.21.15.55:50666) 2023-07-06T21:43:24.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe837fe640 1 -- 172.21.15.55:0/2740998933 learned_addr learned my addr 172.21.15.55:0/2740998933 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:24.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe83fff640 1 --2- 172.21.15.55:0/2740998933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe840cbeb0 0x7efe8406ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe837fe640 1 -- 172.21.15.55:0/2740998933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe840cbeb0 msgr2=0x7efe8406ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:24.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe837fe640 1 --2- 172.21.15.55:0/2740998933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe840cbeb0 0x7efe8406ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe837fe640 1 -- 172.21.15.55:0/2740998933 >> v1:172.21.15.55:6789/0 conn(0x7efe8406e9d0 legacy=0x7efe840cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe837fe640 1 -- 172.21.15.55:0/2740998933 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8415f5d0 con 0x7efe84156180 2023-07-06T21:43:24.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe83fff640 1 --2- 172.21.15.55:0/2740998933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe840cbeb0 0x7efe8406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:24.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.453+0000 7efe827fc640 1 -- 172.21.15.55:0/2740998933 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037786722 0 0) 0x7efe840cc310 con 0x7efe8406e9d0 2023-07-06T21:43:24.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe837fe640 1 --2- 172.21.15.55:0/2740998933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe84156180 0x7efe840ca610 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efe74009870 tx=0x7efe7401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411e3c584b9fc2d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:24.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe827fc640 1 -- 172.21.15.55:0/2740998933 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe740ab680 con 0x7efe84156180 2023-07-06T21:43:24.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe827fc640 1 -- 172.21.15.55:0/2740998933 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe740ab7e0 con 0x7efe84156180 2023-07-06T21:43:24.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe827fc640 1 -- 172.21.15.55:0/2740998933 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe740abb70 con 0x7efe84156180 2023-07-06T21:43:24.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 -- 172.21.15.55:0/2740998933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe84156180 msgr2=0x7efe840ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 --2- 172.21.15.55:0/2740998933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe84156180 0x7efe840ca610 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efe74009870 tx=0x7efe7401c480 comp rx=0 tx=0).stop 2023-07-06T21:43:24.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 -- 172.21.15.55:0/2740998933 shutdown_connections 2023-07-06T21:43:24.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 --2- 172.21.15.55:0/2740998933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe840cbeb0 0x7efe8406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 --2- 172.21.15.55:0/2740998933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe84156180 0x7efe840ca610 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 -- 172.21.15.55:0/2740998933 >> 172.21.15.55:0/2740998933 conn(0x7efe840d0c50 msgr2=0x7efe840cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:24.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 -- 172.21.15.55:0/2740998933 shutdown_connections 2023-07-06T21:43:24.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 -- 172.21.15.55:0/2740998933 wait complete. 2023-07-06T21:43:24.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 Processor -- start 2023-07-06T21:43:24.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 -- start start 2023-07-06T21:43:24.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe8406e9d0 0x7efe8414d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe840cbeb0 0x7efe84152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe84156180 0x7efe840c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe840b24a0 con 0x7efe84156180 2023-07-06T21:43:24.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.457+0000 7efe89dd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe840c3af0 con 0x7efe840cbeb0 2023-07-06T21:43:24.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe89dd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe840c3d40 con 0x7efe8406e9d0 2023-07-06T21:43:24.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe83fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe84156180 0x7efe840c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe83fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe84156180 0x7efe840c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50680/0 (socket says 172.21.15.55:50680) 2023-07-06T21:43:24.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe83fff640 1 -- 172.21.15.55:0/3919956942 learned_addr learned my addr 172.21.15.55:0/3919956942 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:24.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe837fe640 1 --2- 172.21.15.55:0/3919956942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe8406e9d0 0x7efe8414d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe82ffd640 1 --2- 172.21.15.55:0/3919956942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe840cbeb0 0x7efe84152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe83fff640 1 -- 172.21.15.55:0/3919956942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe8406e9d0 msgr2=0x7efe8414d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe83fff640 1 --2- 172.21.15.55:0/3919956942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe8406e9d0 0x7efe8414d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe83fff640 1 -- 172.21.15.55:0/3919956942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe840cbeb0 msgr2=0x7efe84152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe83fff640 1 --2- 172.21.15.55:0/3919956942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe840cbeb0 0x7efe84152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe83fff640 1 -- 172.21.15.55:0/3919956942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe740094d0 con 0x7efe84156180 2023-07-06T21:43:24.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe83fff640 1 --2- 172.21.15.55:0/3919956942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe84156180 0x7efe840c5f70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efe7c007ef0 tx=0x7efe7c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:24.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe6bfff640 1 -- 172.21.15.55:0/3919956942 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c003ba0 con 0x7efe84156180 2023-07-06T21:43:24.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe6bfff640 1 -- 172.21.15.55:0/3919956942 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c00f040 con 0x7efe84156180 2023-07-06T21:43:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe6bfff640 1 -- 172.21.15.55:0/3919956942 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c00de80 con 0x7efe84156180 2023-07-06T21:43:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe89dd2640 1 -- 172.21.15.55:0/3919956942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe840c4020 con 0x7efe84156180 2023-07-06T21:43:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe89dd2640 1 -- 172.21.15.55:0/3919956942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe840c45e0 con 0x7efe84156180 2023-07-06T21:43:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe89dd2640 1 -- 172.21.15.55:0/3919956942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe84072550 con 0x7efe84156180 2023-07-06T21:43:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.461+0000 7efe6bfff640 1 -- 172.21.15.55:0/3919956942 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efe7c004030 con 0x7efe84156180 2023-07-06T21:43:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.465+0000 7efe6bfff640 1 --2- 172.21.15.55:0/3919956942 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efe700662b0 0x7efe70068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.465+0000 7efe6bfff640 1 -- 172.21.15.55:0/3919956942 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efe7c083df0 con 0x7efe84156180 2023-07-06T21:43:24.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.465+0000 7efe837fe640 1 --2- 172.21.15.55:0/3919956942 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efe700662b0 0x7efe70068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.465+0000 7efe837fe640 1 --2- 172.21.15.55:0/3919956942 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efe700662b0 0x7efe70068760 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efe740af000 tx=0x7efe740b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:24.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.469+0000 7efe6bfff640 1 -- 172.21.15.55:0/3919956942 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe7c051530 con 0x7efe84156180 2023-07-06T21:43:24.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.677+0000 7efe89dd2640 1 -- 172.21.15.55:0/3919956942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7efe840b36b0 con 0x7efe84156180 2023-07-06T21:43:24.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.681+0000 7efe6bfff640 1 -- 172.21.15.55:0/3919956942 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7efe7c01a0a0 con 0x7efe84156180 2023-07-06T21:43:24.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.685+0000 7efe89dd2640 1 -- 172.21.15.55:0/3919956942 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efe700662b0 msgr2=0x7efe70068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.685+0000 7efe89dd2640 1 --2- 172.21.15.55:0/3919956942 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efe700662b0 0x7efe70068760 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efe740af000 tx=0x7efe740b6040 comp rx=0 tx=0).stop 2023-07-06T21:43:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.685+0000 7efe89dd2640 1 -- 172.21.15.55:0/3919956942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe84156180 msgr2=0x7efe840c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.685+0000 7efe89dd2640 1 --2- 172.21.15.55:0/3919956942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe84156180 0x7efe840c5f70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efe7c007ef0 tx=0x7efe7c00d4a0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.685+0000 7efe89dd2640 1 -- 172.21.15.55:0/3919956942 shutdown_connections 2023-07-06T21:43:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.685+0000 7efe89dd2640 1 --2- 172.21.15.55:0/3919956942 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7efe700662b0 0x7efe70068760 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.685+0000 7efe89dd2640 1 --2- 172.21.15.55:0/3919956942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe84156180 0x7efe840c5f70 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.685+0000 7efe89dd2640 1 --2- 172.21.15.55:0/3919956942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe840cbeb0 0x7efe84152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.685+0000 7efe89dd2640 1 --2- 172.21.15.55:0/3919956942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe8406e9d0 0x7efe8414d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.685+0000 7efe89dd2640 1 -- 172.21.15.55:0/3919956942 >> 172.21.15.55:0/3919956942 conn(0x7efe840d0c50 msgr2=0x7efe84155410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:24.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.685+0000 7efe89dd2640 1 -- 172.21.15.55:0/3919956942 shutdown_connections 2023-07-06T21:43:24.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.685+0000 7efe89dd2640 1 -- 172.21.15.55:0/3919956942 wait complete. 2023-07-06T21:43:24.711 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:43:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.845+0000 7f2b35c26640 1 Processor -- start 2023-07-06T21:43:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.845+0000 7f2b35c26640 1 -- start start 2023-07-06T21:43:24.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.849+0000 7f2b35c26640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2b30158400 0x7f2b300c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.849+0000 7f2b35c26640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b300c9680 0x7f2b30070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.849+0000 7f2b35c26640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3006fae0 con 0x7f2b300710c0 2023-07-06T21:43:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.849+0000 7f2b35c26640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3006fdc0 con 0x7f2b300c9680 2023-07-06T21:43:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.849+0000 7f2b35c26640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b300700a0 con 0x7f2b30158400 2023-07-06T21:43:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.849+0000 7f2b2effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b300c9680 0x7f2b30070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.849+0000 7f2b2effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b300c9680 0x7f2b30070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50686/0 (socket says 172.21.15.55:50686) 2023-07-06T21:43:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.849+0000 7f2b2effd640 1 -- 172.21.15.55:0/3390270269 learned_addr learned my addr 172.21.15.55:0/3390270269 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.849+0000 7f2b2f7fe640 1 --2- 172.21.15.55:0/3390270269 >> v2:172.21.15.138:3300/0 conn(0x7f2b30158400 0x7f2b300c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.849+0000 7f2b2effd640 1 -- 172.21.15.55:0/3390270269 >> v2:172.21.15.138:3300/0 conn(0x7f2b30158400 msgr2=0x7f2b300c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.849+0000 7f2b2effd640 1 --2- 172.21.15.55:0/3390270269 >> v2:172.21.15.138:3300/0 conn(0x7f2b30158400 0x7f2b300c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.849+0000 7f2b2effd640 1 -- 172.21.15.55:0/3390270269 >> v1:172.21.15.138:6789/0 conn(0x7f2b300710c0 legacy=0x7f2b300cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.849+0000 7f2b2effd640 1 -- 172.21.15.55:0/3390270269 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b30070380 con 0x7f2b300c9680 2023-07-06T21:43:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.853+0000 7f2b2effd640 1 --2- 172.21.15.55:0/3390270269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b300c9680 0x7f2b30070b80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2b3006ed50 tx=0x7f2b2401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abdadaa0ab26115d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.853+0000 7f2b2e7fc640 1 -- 172.21.15.55:0/3390270269 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b240ab620 con 0x7f2b300c9680 2023-07-06T21:43:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.853+0000 7f2b2e7fc640 1 -- 172.21.15.55:0/3390270269 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b240ab780 con 0x7f2b300c9680 2023-07-06T21:43:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.853+0000 7f2b2e7fc640 1 -- 172.21.15.55:0/3390270269 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b240abb10 con 0x7f2b300c9680 2023-07-06T21:43:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.853+0000 7f2b35c26640 1 -- 172.21.15.55:0/3390270269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b300c9680 msgr2=0x7f2b30070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.853+0000 7f2b35c26640 1 --2- 172.21.15.55:0/3390270269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b300c9680 0x7f2b30070b80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2b3006ed50 tx=0x7f2b2401c400 comp rx=0 tx=0).stop 2023-07-06T21:43:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.853+0000 7f2b35c26640 1 -- 172.21.15.55:0/3390270269 shutdown_connections 2023-07-06T21:43:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.853+0000 7f2b35c26640 1 --2- 172.21.15.55:0/3390270269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b300c9680 0x7f2b30070b80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.853+0000 7f2b35c26640 1 --2- 172.21.15.55:0/3390270269 >> v2:172.21.15.138:3300/0 conn(0x7f2b30158400 0x7f2b300c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.853+0000 7f2b35c26640 1 -- 172.21.15.55:0/3390270269 >> 172.21.15.55:0/3390270269 conn(0x7f2b300cded0 msgr2=0x7f2b300ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.853+0000 7f2b35c26640 1 -- 172.21.15.55:0/3390270269 shutdown_connections 2023-07-06T21:43:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.853+0000 7f2b35c26640 1 -- 172.21.15.55:0/3390270269 wait complete. 2023-07-06T21:43:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.853+0000 7f2b35c26640 1 Processor -- start 2023-07-06T21:43:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.853+0000 7f2b35c26640 1 -- start start 2023-07-06T21:43:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b35c26640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b300710c0 0x7f2b3014df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b35c26640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2b300c9680 0x7f2b300cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b35c26640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b30158400 0x7f2b300cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b35c26640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300c5e70 con 0x7f2b300710c0 2023-07-06T21:43:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b35c26640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300c4fa0 con 0x7f2b30158400 2023-07-06T21:43:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b35c26640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3014e4c0 con 0x7f2b300c9680 2023-07-06T21:43:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b300710c0 0x7f2b3014df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b300710c0 0x7f2b3014df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50702/0 (socket says 172.21.15.55:50702) 2023-07-06T21:43:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b2f7fe640 1 -- 172.21.15.55:0/912200226 learned_addr learned my addr 172.21.15.55:0/912200226 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b2effd640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2b300c9680 0x7f2b300cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b2ffff640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b30158400 0x7f2b300cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b2f7fe640 1 -- 172.21.15.55:0/912200226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2b300c9680 msgr2=0x7f2b300cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b2f7fe640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2b300c9680 0x7f2b300cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b2f7fe640 1 -- 172.21.15.55:0/912200226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b30158400 msgr2=0x7f2b300cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:24.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b2f7fe640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b30158400 0x7f2b300cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:24.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b2f7fe640 1 -- 172.21.15.55:0/912200226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b240094d0 con 0x7f2b300710c0 2023-07-06T21:43:24.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b2ffff640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b30158400 0x7f2b300cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:24.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b2effd640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2b300c9680 0x7f2b300cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:24.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b2f7fe640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b300710c0 0x7f2b3014df80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000d5f0 tx=0x7f2b2000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b17fff640 1 -- 172.21.15.55:0/912200226 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b200125f0 con 0x7f2b300710c0 2023-07-06T21:43:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b17fff640 1 -- 172.21.15.55:0/912200226 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b20012750 con 0x7f2b300710c0 2023-07-06T21:43:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b17fff640 1 -- 172.21.15.55:0/912200226 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b20012ae0 con 0x7f2b300710c0 2023-07-06T21:43:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b35c26640 1 -- 172.21.15.55:0/912200226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b300c51f0 con 0x7f2b300710c0 2023-07-06T21:43:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b35c26640 1 -- 172.21.15.55:0/912200226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b300c57b0 con 0x7f2b300710c0 2023-07-06T21:43:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b35c26640 1 -- 172.21.15.55:0/912200226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b300c60e0 con 0x7f2b300710c0 2023-07-06T21:43:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.857+0000 7f2b17fff640 1 -- 172.21.15.55:0/912200226 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2b20012c40 con 0x7f2b300710c0 2023-07-06T21:43:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.861+0000 7f2b17fff640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2b1c066280 0x7f2b1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.861+0000 7f2b17fff640 1 -- 172.21.15.55:0/912200226 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2b20083ff0 con 0x7f2b300710c0 2023-07-06T21:43:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.861+0000 7f2b2effd640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2b1c066280 0x7f2b1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.861+0000 7f2b2effd640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2b1c066280 0x7f2b1c068730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2b240af000 tx=0x7f2b240a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:24.865+0000 7f2b17fff640 1 -- 172.21.15.55:0/912200226 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2b200516d0 con 0x7f2b300710c0 2023-07-06T21:43:25.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.021+0000 7f2b35c26640 1 -- 172.21.15.55:0/912200226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b3006c580 con 0x7f2b300710c0 2023-07-06T21:43:25.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.021+0000 7f2b17fff640 1 -- 172.21.15.55:0/912200226 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+14832 (secure 0 0 0) 0x7f2b20007380 con 0x7f2b300710c0 2023-07-06T21:43:25.031 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:25.031 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":38,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:43:21.891512+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:43:25.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.025+0000 7f2b35c26640 1 -- 172.21.15.55:0/912200226 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2b1c066280 msgr2=0x7f2b1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.025+0000 7f2b35c26640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2b1c066280 0x7f2b1c068730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2b240af000 tx=0x7f2b240a7000 comp rx=0 tx=0).stop 2023-07-06T21:43:25.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.025+0000 7f2b35c26640 1 -- 172.21.15.55:0/912200226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b300710c0 msgr2=0x7f2b3014df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.025+0000 7f2b35c26640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b300710c0 0x7f2b3014df80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000d5f0 tx=0x7f2b2000dab0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.025+0000 7f2b35c26640 1 -- 172.21.15.55:0/912200226 shutdown_connections 2023-07-06T21:43:25.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.025+0000 7f2b35c26640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2b1c066280 0x7f2b1c068730 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.025+0000 7f2b35c26640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b30158400 0x7f2b300cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.025+0000 7f2b35c26640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2b300c9680 0x7f2b300cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.025+0000 7f2b35c26640 1 --2- 172.21.15.55:0/912200226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b300710c0 0x7f2b3014df80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.025+0000 7f2b35c26640 1 -- 172.21.15.55:0/912200226 >> 172.21.15.55:0/912200226 conn(0x7f2b300cded0 msgr2=0x7f2b300b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:25.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.025+0000 7f2b35c26640 1 -- 172.21.15.55:0/912200226 shutdown_connections 2023-07-06T21:43:25.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.025+0000 7f2b35c26640 1 -- 172.21.15.55:0/912200226 wait complete. 2023-07-06T21:43:25.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:43:25.053 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:43:25.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.189+0000 7f2d2b300640 1 Processor -- start 2023-07-06T21:43:25.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.189+0000 7f2d2b300640 1 -- start start 2023-07-06T21:43:25.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2b300640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d240c11a0 0x7f2d240cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2b300640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2d2406eee0 0x7f2d2406f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2b300640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2d2406f890 0x7f2d24163c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2b300640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d241605f0 con 0x7f2d2406f890 2023-07-06T21:43:25.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2b300640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2406ce00 con 0x7f2d2406eee0 2023-07-06T21:43:25.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2b300640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d240c4ca0 con 0x7f2d240c11a0 2023-07-06T21:43:25.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2989d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2d2406f890 0x7f2d24163c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2989d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2d2406f890 0x7f2d24163c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50704/0 (socket says 172.21.15.55:50704) 2023-07-06T21:43:25.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2989d640 1 -- 172.21.15.55:0/2552397926 learned_addr learned my addr 172.21.15.55:0/2552397926 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:25.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2909c640 1 --2- 172.21.15.55:0/2552397926 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d240c11a0 0x7f2d240cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2889b640 1 --2- 172.21.15.55:0/2552397926 >> v2:172.21.15.138:3300/0 conn(0x7f2d2406eee0 0x7f2d2406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2989d640 1 -- 172.21.15.55:0/2552397926 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d240c11a0 msgr2=0x7f2d240cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:25.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2989d640 1 --2- 172.21.15.55:0/2552397926 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d240c11a0 0x7f2d240cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2989d640 1 -- 172.21.15.55:0/2552397926 >> v2:172.21.15.138:3300/0 conn(0x7f2d2406eee0 msgr2=0x7f2d2406f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:25.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2989d640 1 --2- 172.21.15.55:0/2552397926 >> v2:172.21.15.138:3300/0 conn(0x7f2d2406eee0 0x7f2d2406f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2989d640 1 -- 172.21.15.55:0/2552397926 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d240ccd70 con 0x7f2d2406f890 2023-07-06T21:43:25.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2889b640 1 --2- 172.21.15.55:0/2552397926 >> v2:172.21.15.138:3300/0 conn(0x7f2d2406eee0 0x7f2d2406f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:25.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.193+0000 7f2d2909c640 1 --2- 172.21.15.55:0/2552397926 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d240c11a0 0x7f2d240cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:25.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d2989d640 1 --2- 172.21.15.55:0/2552397926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2406f890 0x7f2d24163c30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2d2406eb70 tx=0x7f2d1c01c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8c14f29b372699 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:25.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d1bfff640 1 -- 172.21.15.55:0/2552397926 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0a8460 con 0x7f2d2406f890 2023-07-06T21:43:25.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d1bfff640 1 -- 172.21.15.55:0/2552397926 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c0a85c0 con 0x7f2d2406f890 2023-07-06T21:43:25.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d1bfff640 1 -- 172.21.15.55:0/2552397926 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0a8950 con 0x7f2d2406f890 2023-07-06T21:43:25.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d2b300640 1 -- 172.21.15.55:0/2552397926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2406f890 msgr2=0x7f2d24163c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d2b300640 1 --2- 172.21.15.55:0/2552397926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2406f890 0x7f2d24163c30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2d2406eb70 tx=0x7f2d1c01c680 comp rx=0 tx=0).stop 2023-07-06T21:43:25.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d2b300640 1 -- 172.21.15.55:0/2552397926 shutdown_connections 2023-07-06T21:43:25.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d2b300640 1 --2- 172.21.15.55:0/2552397926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2406f890 0x7f2d24163c30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d2b300640 1 --2- 172.21.15.55:0/2552397926 >> v2:172.21.15.138:3300/0 conn(0x7f2d2406eee0 0x7f2d2406f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d2b300640 1 --2- 172.21.15.55:0/2552397926 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d240c11a0 0x7f2d240cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d2b300640 1 -- 172.21.15.55:0/2552397926 >> 172.21.15.55:0/2552397926 conn(0x7f2d240cea70 msgr2=0x7f2d240ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:25.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d2b300640 1 -- 172.21.15.55:0/2552397926 shutdown_connections 2023-07-06T21:43:25.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d2b300640 1 -- 172.21.15.55:0/2552397926 wait complete. 2023-07-06T21:43:25.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d2b300640 1 Processor -- start 2023-07-06T21:43:25.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.197+0000 7f2d2b300640 1 -- start start 2023-07-06T21:43:25.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2b300640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2406eee0 0x7f2d24159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2b300640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2406f890 0x7f2d24160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2b300640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d240c11a0 0x7f2d24160d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2b300640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d24159ac0 con 0x7f2d2406eee0 2023-07-06T21:43:25.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2b300640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d241fb850 con 0x7f2d240c11a0 2023-07-06T21:43:25.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2b300640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d241fbac0 con 0x7f2d2406f890 2023-07-06T21:43:25.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2909c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2406eee0 0x7f2d24159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2909c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2406eee0 0x7f2d24159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50710/0 (socket says 172.21.15.55:50710) 2023-07-06T21:43:25.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2909c640 1 -- 172.21.15.55:0/1576154073 learned_addr learned my addr 172.21.15.55:0/1576154073 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:25.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2889b640 1 --2- 172.21.15.55:0/1576154073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2406f890 0x7f2d24160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2989d640 1 --2- 172.21.15.55:0/1576154073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d240c11a0 0x7f2d24160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2909c640 1 -- 172.21.15.55:0/1576154073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2406f890 msgr2=0x7f2d24160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2909c640 1 --2- 172.21.15.55:0/1576154073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2406f890 0x7f2d24160850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2909c640 1 -- 172.21.15.55:0/1576154073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d240c11a0 msgr2=0x7f2d24160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2909c640 1 --2- 172.21.15.55:0/1576154073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d240c11a0 0x7f2d24160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2909c640 1 -- 172.21.15.55:0/1576154073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c009b30 con 0x7f2d2406eee0 2023-07-06T21:43:25.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2909c640 1 --2- 172.21.15.55:0/1576154073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2406eee0 0x7f2d24159580 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000d830 tx=0x7f2d2000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:25.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d19ffb640 1 -- 172.21.15.55:0/1576154073 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200096c0 con 0x7f2d2406eee0 2023-07-06T21:43:25.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d19ffb640 1 -- 172.21.15.55:0/1576154073 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d20009820 con 0x7f2d2406eee0 2023-07-06T21:43:25.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d19ffb640 1 -- 172.21.15.55:0/1576154073 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d20009bd0 con 0x7f2d2406eee0 2023-07-06T21:43:25.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2b300640 1 -- 172.21.15.55:0/1576154073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d241fbda0 con 0x7f2d2406eee0 2023-07-06T21:43:25.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2b300640 1 -- 172.21.15.55:0/1576154073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d241fc360 con 0x7f2d2406eee0 2023-07-06T21:43:25.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.201+0000 7f2d2b300640 1 -- 172.21.15.55:0/1576154073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d24066d60 con 0x7f2d2406eee0 2023-07-06T21:43:25.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.205+0000 7f2d19ffb640 1 -- 172.21.15.55:0/1576154073 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d20014410 con 0x7f2d2406eee0 2023-07-06T21:43:25.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.205+0000 7f2d19ffb640 1 --2- 172.21.15.55:0/1576154073 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d08066280 0x7f2d08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.205+0000 7f2d19ffb640 1 -- 172.21.15.55:0/1576154073 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2d20084320 con 0x7f2d2406eee0 2023-07-06T21:43:25.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.205+0000 7f2d2889b640 1 --2- 172.21.15.55:0/1576154073 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d08066280 0x7f2d08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.205+0000 7f2d2889b640 1 --2- 172.21.15.55:0/1576154073 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d08066280 0x7f2d08068730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2d240c43f0 tx=0x7f2d14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:25.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.209+0000 7f2d19ffb640 1 -- 172.21.15.55:0/1576154073 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d20051a60 con 0x7f2d2406eee0 2023-07-06T21:43:25.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.369+0000 7f2d2b300640 1 -- 172.21.15.55:0/1576154073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d240c7f60 con 0x7f2d2406eee0 2023-07-06T21:43:25.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.369+0000 7f2d19ffb640 1 -- 172.21.15.55:0/1576154073 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d20055080 con 0x7f2d2406eee0 2023-07-06T21:43:25.376 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:43:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.369+0000 7f2d2b300640 1 -- 172.21.15.55:0/1576154073 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d08066280 msgr2=0x7f2d08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.369+0000 7f2d2b300640 1 --2- 172.21.15.55:0/1576154073 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d08066280 0x7f2d08068730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2d240c43f0 tx=0x7f2d14008040 comp rx=0 tx=0).stop 2023-07-06T21:43:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.369+0000 7f2d2b300640 1 -- 172.21.15.55:0/1576154073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2406eee0 msgr2=0x7f2d24159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.369+0000 7f2d2b300640 1 --2- 172.21.15.55:0/1576154073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2406eee0 0x7f2d24159580 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000d830 tx=0x7f2d2000dcf0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.369+0000 7f2d2b300640 1 -- 172.21.15.55:0/1576154073 shutdown_connections 2023-07-06T21:43:25.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.369+0000 7f2d2b300640 1 --2- 172.21.15.55:0/1576154073 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d08066280 0x7f2d08068730 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.369+0000 7f2d2b300640 1 --2- 172.21.15.55:0/1576154073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d240c11a0 0x7f2d24160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.369+0000 7f2d2b300640 1 --2- 172.21.15.55:0/1576154073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2406f890 0x7f2d24160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.369+0000 7f2d2b300640 1 --2- 172.21.15.55:0/1576154073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2406eee0 0x7f2d24159580 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.369+0000 7f2d2b300640 1 -- 172.21.15.55:0/1576154073 >> 172.21.15.55:0/1576154073 conn(0x7f2d240cea70 msgr2=0x7f2d2415fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:25.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.369+0000 7f2d2b300640 1 -- 172.21.15.55:0/1576154073 shutdown_connections 2023-07-06T21:43:25.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.369+0000 7f2d2b300640 1 -- 172.21.15.55:0/1576154073 wait complete. 2023-07-06T21:43:25.397 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:43:25.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.533+0000 7fd84825c640 1 Processor -- start 2023-07-06T21:43:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.533+0000 7fd84825c640 1 -- start start 2023-07-06T21:43:25.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd84825c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd840156180 0x7fd8400ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd84825c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd84006e9d0 0x7fd84006ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd84825c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd8400cb7a0 0x7fd8400cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd84825c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd840160250 con 0x7fd84006e9d0 2023-07-06T21:43:25.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd84825c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84006f360 con 0x7fd8400cb7a0 2023-07-06T21:43:25.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd84825c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84015f5d0 con 0x7fd840156180 2023-07-06T21:43:25.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd8457f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd84006e9d0 0x7fd84006ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd8457f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd84006e9d0 0x7fd84006ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50726/0 (socket says 172.21.15.55:50726) 2023-07-06T21:43:25.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd8457f7640 1 -- 172.21.15.55:0/341808302 learned_addr learned my addr 172.21.15.55:0/341808302 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd8467f9640 1 --2- 172.21.15.55:0/341808302 >> v2:172.21.15.138:3300/0 conn(0x7fd8400cb7a0 0x7fd8400cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd845ff8640 1 --2- 172.21.15.55:0/341808302 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd840156180 0x7fd8400ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd8457f7640 1 -- 172.21.15.55:0/341808302 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd840156180 msgr2=0x7fd8400ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd8457f7640 1 --2- 172.21.15.55:0/341808302 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd840156180 0x7fd8400ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd8457f7640 1 -- 172.21.15.55:0/341808302 >> v2:172.21.15.138:3300/0 conn(0x7fd8400cb7a0 msgr2=0x7fd8400cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd8457f7640 1 --2- 172.21.15.55:0/341808302 >> v2:172.21.15.138:3300/0 conn(0x7fd8400cb7a0 0x7fd8400cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd8457f7640 1 -- 172.21.15.55:0/341808302 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84015f8b0 con 0x7fd84006e9d0 2023-07-06T21:43:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.537+0000 7fd8467f9640 1 --2- 172.21.15.55:0/341808302 >> v2:172.21.15.138:3300/0 conn(0x7fd8400cb7a0 0x7fd8400cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd8457f7640 1 --2- 172.21.15.55:0/341808302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84006e9d0 0x7fd84006ee20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd840072220 tx=0x7fd83001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8055bb86facdf8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:25.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd844ff6640 1 -- 172.21.15.55:0/341808302 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8300ab600 con 0x7fd84006e9d0 2023-07-06T21:43:25.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd844ff6640 1 -- 172.21.15.55:0/341808302 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8300ab760 con 0x7fd84006e9d0 2023-07-06T21:43:25.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd844ff6640 1 -- 172.21.15.55:0/341808302 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8300abaf0 con 0x7fd84006e9d0 2023-07-06T21:43:25.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd84825c640 1 -- 172.21.15.55:0/341808302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84006e9d0 msgr2=0x7fd84006ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd84825c640 1 --2- 172.21.15.55:0/341808302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84006e9d0 0x7fd84006ee20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd840072220 tx=0x7fd83001c440 comp rx=0 tx=0).stop 2023-07-06T21:43:25.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd84825c640 1 -- 172.21.15.55:0/341808302 shutdown_connections 2023-07-06T21:43:25.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd84825c640 1 --2- 172.21.15.55:0/341808302 >> v2:172.21.15.138:3300/0 conn(0x7fd8400cb7a0 0x7fd8400cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd84825c640 1 --2- 172.21.15.55:0/341808302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84006e9d0 0x7fd84006ee20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd84825c640 1 --2- 172.21.15.55:0/341808302 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd840156180 0x7fd8400ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd84825c640 1 -- 172.21.15.55:0/341808302 >> 172.21.15.55:0/341808302 conn(0x7fd8400d0c50 msgr2=0x7fd8400cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd84825c640 1 -- 172.21.15.55:0/341808302 shutdown_connections 2023-07-06T21:43:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd84825c640 1 -- 172.21.15.55:0/341808302 wait complete. 2023-07-06T21:43:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd84825c640 1 Processor -- start 2023-07-06T21:43:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.541+0000 7fd84825c640 1 -- start start 2023-07-06T21:43:25.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd84825c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84006e9d0 0x7fd840155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd84825c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8400cb7a0 0x7fd8400afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd84825c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd840156180 0x7fd8400c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd84825c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd840149ef0 con 0x7fd84006e9d0 2023-07-06T21:43:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd84825c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd840155ad0 con 0x7fd8400cb7a0 2023-07-06T21:43:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd84825c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84014ebe0 con 0x7fd840156180 2023-07-06T21:43:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd845ff8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84006e9d0 0x7fd840155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd845ff8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84006e9d0 0x7fd840155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50732/0 (socket says 172.21.15.55:50732) 2023-07-06T21:43:25.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd845ff8640 1 -- 172.21.15.55:0/2399272358 learned_addr learned my addr 172.21.15.55:0/2399272358 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:25.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd8457f7640 1 --2- 172.21.15.55:0/2399272358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8400cb7a0 0x7fd8400afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd8467f9640 1 --2- 172.21.15.55:0/2399272358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd840156180 0x7fd8400c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd845ff8640 1 -- 172.21.15.55:0/2399272358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd840156180 msgr2=0x7fd8400c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd845ff8640 1 --2- 172.21.15.55:0/2399272358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd840156180 0x7fd8400c5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd845ff8640 1 -- 172.21.15.55:0/2399272358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8400cb7a0 msgr2=0x7fd8400afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd845ff8640 1 --2- 172.21.15.55:0/2399272358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8400cb7a0 0x7fd8400afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd845ff8640 1 -- 172.21.15.55:0/2399272358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8300094d0 con 0x7fd84006e9d0 2023-07-06T21:43:25.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd845ff8640 1 --2- 172.21.15.55:0/2399272358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84006e9d0 0x7fd840155590 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00d5f0 tx=0x7fd83c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:25.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd8367fc640 1 -- 172.21.15.55:0/2399272358 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c0125f0 con 0x7fd84006e9d0 2023-07-06T21:43:25.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd8367fc640 1 -- 172.21.15.55:0/2399272358 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c012750 con 0x7fd84006e9d0 2023-07-06T21:43:25.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd8367fc640 1 -- 172.21.15.55:0/2399272358 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c012ae0 con 0x7fd84006e9d0 2023-07-06T21:43:25.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd84825c640 1 -- 172.21.15.55:0/2399272358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84014eec0 con 0x7fd84006e9d0 2023-07-06T21:43:25.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd84825c640 1 -- 172.21.15.55:0/2399272358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84014f480 con 0x7fd84006e9d0 2023-07-06T21:43:25.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd84825c640 1 -- 172.21.15.55:0/2399272358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd840066d60 con 0x7fd84006e9d0 2023-07-06T21:43:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.545+0000 7fd8367fc640 1 -- 172.21.15.55:0/2399272358 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd83c012c40 con 0x7fd84006e9d0 2023-07-06T21:43:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.549+0000 7fd8367fc640 1 --2- 172.21.15.55:0/2399272358 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd824066280 0x7fd824068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.549+0000 7fd8367fc640 1 -- 172.21.15.55:0/2399272358 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd83c083f40 con 0x7fd84006e9d0 2023-07-06T21:43:25.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.549+0000 7fd8457f7640 1 --2- 172.21.15.55:0/2399272358 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd824066280 0x7fd824068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.549+0000 7fd8457f7640 1 --2- 172.21.15.55:0/2399272358 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd824066280 0x7fd824068730 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd8300af000 tx=0x7fd8300b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:25.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.553+0000 7fd8367fc640 1 -- 172.21.15.55:0/2399272358 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd83c0515f0 con 0x7fd84006e9d0 2023-07-06T21:43:25.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.709+0000 7fd84825c640 1 -- 172.21.15.55:0/2399272358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd8400cd930 con 0x7fd84006e9d0 2023-07-06T21:43:25.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.709+0000 7fd8367fc640 1 -- 172.21.15.55:0/2399272358 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd83c007380 con 0x7fd84006e9d0 2023-07-06T21:43:25.718 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:43:25.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.713+0000 7fd84825c640 1 -- 172.21.15.55:0/2399272358 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd824066280 msgr2=0x7fd824068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.713+0000 7fd84825c640 1 --2- 172.21.15.55:0/2399272358 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd824066280 0x7fd824068730 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd8300af000 tx=0x7fd8300b6040 comp rx=0 tx=0).stop 2023-07-06T21:43:25.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.713+0000 7fd84825c640 1 -- 172.21.15.55:0/2399272358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84006e9d0 msgr2=0x7fd840155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.713+0000 7fd84825c640 1 --2- 172.21.15.55:0/2399272358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84006e9d0 0x7fd840155590 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00d5f0 tx=0x7fd83c00dab0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.713+0000 7fd84825c640 1 -- 172.21.15.55:0/2399272358 shutdown_connections 2023-07-06T21:43:25.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.713+0000 7fd84825c640 1 --2- 172.21.15.55:0/2399272358 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fd824066280 0x7fd824068730 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.713+0000 7fd84825c640 1 --2- 172.21.15.55:0/2399272358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd840156180 0x7fd8400c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.713+0000 7fd84825c640 1 --2- 172.21.15.55:0/2399272358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8400cb7a0 0x7fd8400afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.713+0000 7fd84825c640 1 --2- 172.21.15.55:0/2399272358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd84006e9d0 0x7fd840155590 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.713+0000 7fd84825c640 1 -- 172.21.15.55:0/2399272358 >> 172.21.15.55:0/2399272358 conn(0x7fd8400d0c50 msgr2=0x7fd84015e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:25.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.713+0000 7fd84825c640 1 -- 172.21.15.55:0/2399272358 shutdown_connections 2023-07-06T21:43:25.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.713+0000 7fd84825c640 1 -- 172.21.15.55:0/2399272358 wait complete. 2023-07-06T21:43:25.739 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T21:43:25.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.873+0000 7fc9f6893640 1 Processor -- start 2023-07-06T21:43:25.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.873+0000 7fc9f6893640 1 -- start start 2023-07-06T21:43:25.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9f6893640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc9f01587d0 0x7fc9f0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9f6893640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9f00710c0 0x7fc9f00cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9f6893640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f006fae0 con 0x7fc9f0158400 2023-07-06T21:43:25.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9f6893640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f006fdc0 con 0x7fc9f01587d0 2023-07-06T21:43:25.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9f6893640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00700a0 con 0x7fc9f00710c0 2023-07-06T21:43:25.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9effff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc9f0158400 0x7fc9f00c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45006/0 (socket says 172.21.15.55:45006) 2023-07-06T21:43:25.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9effff640 1 -- 172.21.15.55:0/1485542138 learned_addr learned my addr 172.21.15.55:0/1485542138 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:25.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9ef7fe640 1 --2- 172.21.15.55:0/1485542138 >> v2:172.21.15.138:3300/0 conn(0x7fc9f01587d0 0x7fc9f0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9f4e30640 1 --2- 172.21.15.55:0/1485542138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9f00710c0 0x7fc9f00cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 -- 172.21.15.55:0/1485542138 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810540213 0 0) 0x7fc9f006fae0 con 0x7fc9f0158400 2023-07-06T21:43:25.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 -- 172.21.15.55:0/1485542138 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9d8003530 con 0x7fc9f0158400 2023-07-06T21:43:25.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 -- 172.21.15.55:0/1485542138 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2735876871 0 0) 0x7fc9d8003530 con 0x7fc9f0158400 2023-07-06T21:43:25.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 -- 172.21.15.55:0/1485542138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9f00710c0 msgr2=0x7fc9f00cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:25.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 --2- 172.21.15.55:0/1485542138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9f00710c0 0x7fc9f00cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 -- 172.21.15.55:0/1485542138 >> v2:172.21.15.138:3300/0 conn(0x7fc9f01587d0 msgr2=0x7fc9f0070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:25.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 --2- 172.21.15.55:0/1485542138 >> v2:172.21.15.138:3300/0 conn(0x7fc9f01587d0 0x7fc9f0070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 -- 172.21.15.55:0/1485542138 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f0070380 con 0x7fc9f0158400 2023-07-06T21:43:25.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 -- 172.21.15.55:0/1485542138 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fc9e0001680 con 0x7fc9f0158400 2023-07-06T21:43:25.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 -- 172.21.15.55:0/1485542138 >> v1:172.21.15.55:6789/0 conn(0x7fc9f0158400 legacy=0x7fc9f00c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 --2- 172.21.15.55:0/1485542138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9d8003980 0x7fc9d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 --2- 172.21.15.55:0/1485542138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9d8004360 0x7fc9d8004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 --2- 172.21.15.55:0/1485542138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d8004ea0 0x7fc9d800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 -- 172.21.15.55:0/1485542138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f006fdc0 con 0x7fc9d8004ea0 2023-07-06T21:43:25.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 -- 172.21.15.55:0/1485542138 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00700a0 con 0x7fc9d8004360 2023-07-06T21:43:25.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9eeffd640 1 -- 172.21.15.55:0/1485542138 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d800bed0 con 0x7fc9d8003980 2023-07-06T21:43:25.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9effff640 1 --2- 172.21.15.55:0/1485542138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9d8003980 0x7fc9d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9f4e30640 1 --2- 172.21.15.55:0/1485542138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d8004ea0 0x7fc9d800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9ef7fe640 1 --2- 172.21.15.55:0/1485542138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9d8004360 0x7fc9d8004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9f4e30640 1 -- 172.21.15.55:0/1485542138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9d8003980 msgr2=0x7fc9d8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:25.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9f4e30640 1 --2- 172.21.15.55:0/1485542138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9d8003980 0x7fc9d8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9f4e30640 1 -- 172.21.15.55:0/1485542138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9d8004360 msgr2=0x7fc9d8004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:25.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9f4e30640 1 --2- 172.21.15.55:0/1485542138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9d8004360 0x7fc9d8004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.877+0000 7fc9f4e30640 1 -- 172.21.15.55:0/1485542138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d8003530 con 0x7fc9d8004ea0 2023-07-06T21:43:25.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.881+0000 7fc9f4e30640 1 --2- 172.21.15.55:0/1485542138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d8004ea0 0x7fc9d800b990 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0158c80 tx=0x7fc9e801cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a77ca7e138c5f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:25.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.881+0000 7fc9eeffd640 1 -- 172.21.15.55:0/1485542138 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e80a5800 con 0x7fc9d8004ea0 2023-07-06T21:43:25.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.881+0000 7fc9eeffd640 1 -- 172.21.15.55:0/1485542138 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e800f040 con 0x7fc9d8004ea0 2023-07-06T21:43:25.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.881+0000 7fc9eeffd640 1 -- 172.21.15.55:0/1485542138 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e80a5b80 con 0x7fc9d8004ea0 2023-07-06T21:43:25.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.881+0000 7fc9f6893640 1 -- 172.21.15.55:0/1485542138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d8004ea0 msgr2=0x7fc9d800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.881+0000 7fc9f6893640 1 --2- 172.21.15.55:0/1485542138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d8004ea0 0x7fc9d800b990 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0158c80 tx=0x7fc9e801cba0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.881+0000 7fc9f4e30640 1 -- 172.21.15.55:0/1485542138 reap_dead start 2023-07-06T21:43:25.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.881+0000 7fc9f6893640 1 -- 172.21.15.55:0/1485542138 shutdown_connections 2023-07-06T21:43:25.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.881+0000 7fc9f6893640 1 -- 172.21.15.55:0/1485542138 >> 172.21.15.55:0/1485542138 conn(0x7fc9f00cded0 msgr2=0x7fc9f00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:25.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.881+0000 7fc9f6893640 1 -- 172.21.15.55:0/1485542138 shutdown_connections 2023-07-06T21:43:25.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.881+0000 7fc9f6893640 1 -- 172.21.15.55:0/1485542138 wait complete. 2023-07-06T21:43:25.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.881+0000 7fc9f6893640 1 Processor -- start 2023-07-06T21:43:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9f6893640 1 -- start start 2023-07-06T21:43:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9f6893640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d8004ea0 0x7fc9f00c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9f6893640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9f01484e0 0x7fc9f0147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9f6893640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9f01eca50 0x7fc9f0069880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9f6893640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f01ed420 con 0x7fc9d8004ea0 2023-07-06T21:43:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9f6893640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f01ed700 con 0x7fc9f01484e0 2023-07-06T21:43:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9f6893640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f01ed9e0 con 0x7fc9f01eca50 2023-07-06T21:43:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9effff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d8004ea0 0x7fc9f00c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9effff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d8004ea0 0x7fc9f00c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50746/0 (socket says 172.21.15.55:50746) 2023-07-06T21:43:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9effff640 1 -- 172.21.15.55:0/3141524043 learned_addr learned my addr 172.21.15.55:0/3141524043 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9ef7fe640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9f01484e0 0x7fc9f0147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9effff640 1 -- 172.21.15.55:0/3141524043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9f01eca50 msgr2=0x7fc9f0069880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9f4e30640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9f01eca50 0x7fc9f0069880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9effff640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9f01eca50 0x7fc9f0069880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9effff640 1 -- 172.21.15.55:0/3141524043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9f01484e0 msgr2=0x7fc9f0147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9effff640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9f01484e0 0x7fc9f0147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9effff640 1 -- 172.21.15.55:0/3141524043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f01edcc0 con 0x7fc9d8004ea0 2023-07-06T21:43:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9ef7fe640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9f01484e0 0x7fc9f0147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9effff640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d8004ea0 0x7fc9f00c5470 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00072f0 tx=0x7fc9e00077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9ecff9640 1 -- 172.21.15.55:0/3141524043 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e000fd50 con 0x7fc9d8004ea0 2023-07-06T21:43:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9ecff9640 1 -- 172.21.15.55:0/3141524043 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e000feb0 con 0x7fc9d8004ea0 2023-07-06T21:43:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9ecff9640 1 -- 172.21.15.55:0/3141524043 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0011640 con 0x7fc9d8004ea0 2023-07-06T21:43:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9f6893640 1 -- 172.21.15.55:0/3141524043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f01ecef0 con 0x7fc9d8004ea0 2023-07-06T21:43:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9f6893640 1 -- 172.21.15.55:0/3141524043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f0069f90 con 0x7fc9d8004ea0 2023-07-06T21:43:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.885+0000 7fc9f6893640 1 -- 172.21.15.55:0/3141524043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f006c580 con 0x7fc9d8004ea0 2023-07-06T21:43:25.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.889+0000 7fc9ecff9640 1 -- 172.21.15.55:0/3141524043 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc9e00117a0 con 0x7fc9d8004ea0 2023-07-06T21:43:25.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.889+0000 7fc9ecff9640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc9dc066290 0x7fc9dc068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:25.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.889+0000 7fc9ecff9640 1 -- 172.21.15.55:0/3141524043 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc9e00847a0 con 0x7fc9d8004ea0 2023-07-06T21:43:25.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.889+0000 7fc9ef7fe640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc9dc066290 0x7fc9dc068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:25.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.889+0000 7fc9ef7fe640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc9dc066290 0x7fc9dc068740 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0148a70 tx=0x7fc9e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:25.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:25.893+0000 7fc9ecff9640 1 -- 172.21.15.55:0/3141524043 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9e0051e10 con 0x7fc9d8004ea0 2023-07-06T21:43:26.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.049+0000 7fc9f6893640 1 -- 172.21.15.55:0/3141524043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc9f00c9820 con 0x7fc9d8004ea0 2023-07-06T21:43:26.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.049+0000 7fc9ecff9640 1 -- 172.21.15.55:0/3141524043 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v38) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc9e001f090 con 0x7fc9d8004ea0 2023-07-06T21:43:26.058 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:26.058 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T21:43:26.058 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:26.058 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-07-06T21:43:26.058 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-07-06T21:43:26.059 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:43:26.059 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:26.059 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-07-06T21:43:26.059 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-07-06T21:43:26.059 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:26.059 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T21:43:26.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.053+0000 7fc9f6893640 1 -- 172.21.15.55:0/3141524043 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc9dc066290 msgr2=0x7fc9dc068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:26.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.053+0000 7fc9f6893640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc9dc066290 0x7fc9dc068740 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0148a70 tx=0x7fc9e4008040 comp rx=0 tx=0).stop 2023-07-06T21:43:26.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.053+0000 7fc9f6893640 1 -- 172.21.15.55:0/3141524043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d8004ea0 msgr2=0x7fc9f00c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:26.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.053+0000 7fc9f6893640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d8004ea0 0x7fc9f00c5470 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00072f0 tx=0x7fc9e00077b0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.053+0000 7fc9f6893640 1 -- 172.21.15.55:0/3141524043 shutdown_connections 2023-07-06T21:43:26.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.053+0000 7fc9f6893640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc9dc066290 0x7fc9dc068740 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.053+0000 7fc9f6893640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc9f01eca50 0x7fc9f0069880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.053+0000 7fc9f6893640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9f01484e0 0x7fc9f0147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.053+0000 7fc9f6893640 1 --2- 172.21.15.55:0/3141524043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d8004ea0 0x7fc9f00c5470 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.053+0000 7fc9f6893640 1 -- 172.21.15.55:0/3141524043 >> 172.21.15.55:0/3141524043 conn(0x7fc9f00cded0 msgr2=0x7fc9f0157310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:26.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.053+0000 7fc9f6893640 1 -- 172.21.15.55:0/3141524043 shutdown_connections 2023-07-06T21:43:26.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.053+0000 7fc9f6893640 1 -- 172.21.15.55:0/3141524043 wait complete. 2023-07-06T21:43:26.079 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T21:43:26.080 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T21:43:26.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54fa093640 1 Processor -- start 2023-07-06T21:43:26.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54fa093640 1 -- start start 2023-07-06T21:43:26.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54fa093640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f54f415b930 0x7f54f40cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:26.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54fa093640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54f40cc2e0 0x7f54f40ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:26.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54fa093640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54f40ce790 0x7f54f40ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:26.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54fa093640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f40b5b60 con 0x7f54f40cc2e0 2023-07-06T21:43:26.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54fa093640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f40b5880 con 0x7f54f415b930 2023-07-06T21:43:26.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54fa093640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f40cdcb0 con 0x7f54f40ce790 2023-07-06T21:43:26.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54f2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54f40cc2e0 0x7f54f40ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:26.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54f2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54f40cc2e0 0x7f54f40ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50760/0 (socket says 172.21.15.55:50760) 2023-07-06T21:43:26.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54f2ffd640 1 -- 172.21.15.55:0/1907046701 learned_addr learned my addr 172.21.15.55:0/1907046701 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:26.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54f37fe640 1 --2- 172.21.15.55:0/1907046701 >> v2:172.21.15.138:3300/0 conn(0x7f54f415b930 0x7f54f40cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:26.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54f3fff640 1 --2- 172.21.15.55:0/1907046701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54f40ce790 0x7f54f40ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:26.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54f2ffd640 1 -- 172.21.15.55:0/1907046701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54f40ce790 msgr2=0x7f54f40ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:26.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54f2ffd640 1 --2- 172.21.15.55:0/1907046701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54f40ce790 0x7f54f40ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54f2ffd640 1 -- 172.21.15.55:0/1907046701 >> v2:172.21.15.138:3300/0 conn(0x7f54f415b930 msgr2=0x7f54f40cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:26.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54f2ffd640 1 --2- 172.21.15.55:0/1907046701 >> v2:172.21.15.138:3300/0 conn(0x7f54f415b930 0x7f54f40cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.221+0000 7f54f2ffd640 1 -- 172.21.15.55:0/1907046701 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f40cdf90 con 0x7f54f40cc2e0 2023-07-06T21:43:26.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.225+0000 7f54f2ffd640 1 --2- 172.21.15.55:0/1907046701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40cc2e0 0x7f54f40ccf20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f54f40cc9b0 tx=0x7f54e801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa9fdee1217912b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:26.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.225+0000 7f54f27fc640 1 -- 172.21.15.55:0/1907046701 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e80aa610 con 0x7f54f40cc2e0 2023-07-06T21:43:26.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.225+0000 7f54f27fc640 1 -- 172.21.15.55:0/1907046701 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e80a6040 con 0x7f54f40cc2e0 2023-07-06T21:43:26.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.225+0000 7f54f27fc640 1 -- 172.21.15.55:0/1907046701 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e80aa990 con 0x7f54f40cc2e0 2023-07-06T21:43:26.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.225+0000 7f54fa093640 1 -- 172.21.15.55:0/1907046701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40cc2e0 msgr2=0x7f54f40ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:26.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.225+0000 7f54fa093640 1 --2- 172.21.15.55:0/1907046701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40cc2e0 0x7f54f40ccf20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f54f40cc9b0 tx=0x7f54e801c4d0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.225+0000 7f54fa093640 1 -- 172.21.15.55:0/1907046701 shutdown_connections 2023-07-06T21:43:26.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.225+0000 7f54fa093640 1 --2- 172.21.15.55:0/1907046701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54f40ce790 0x7f54f40ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.225+0000 7f54fa093640 1 --2- 172.21.15.55:0/1907046701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40cc2e0 0x7f54f40ccf20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.225+0000 7f54fa093640 1 --2- 172.21.15.55:0/1907046701 >> v2:172.21.15.138:3300/0 conn(0x7f54f415b930 0x7f54f40cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.225+0000 7f54fa093640 1 -- 172.21.15.55:0/1907046701 >> 172.21.15.55:0/1907046701 conn(0x7f54f40d0c60 msgr2=0x7f54f40b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:26.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.225+0000 7f54fa093640 1 -- 172.21.15.55:0/1907046701 shutdown_connections 2023-07-06T21:43:26.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.225+0000 7f54fa093640 1 -- 172.21.15.55:0/1907046701 wait complete. 2023-07-06T21:43:26.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54fa093640 1 Processor -- start 2023-07-06T21:43:26.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54fa093640 1 -- start start 2023-07-06T21:43:26.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54fa093640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54f40ce790 0x7f54f414e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:26.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54fa093640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54f415b930 0x7f54f40c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:26.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54fa093640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40c7ff0 0x7f54f4153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:26.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54fa093640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f414ee20 con 0x7f54f40c7ff0 2023-07-06T21:43:26.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54fa093640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f40c8570 con 0x7f54f415b930 2023-07-06T21:43:26.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54fa093640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f40c8850 con 0x7f54f40ce790 2023-07-06T21:43:26.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54f3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40c7ff0 0x7f54f4153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:26.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54f3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40c7ff0 0x7f54f4153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50770/0 (socket says 172.21.15.55:50770) 2023-07-06T21:43:26.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54f3fff640 1 -- 172.21.15.55:0/3614782414 learned_addr learned my addr 172.21.15.55:0/3614782414 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:26.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54f2ffd640 1 --2- 172.21.15.55:0/3614782414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54f415b930 0x7f54f40c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:26.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54f37fe640 1 --2- 172.21.15.55:0/3614782414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54f40ce790 0x7f54f414e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:26.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54f3fff640 1 -- 172.21.15.55:0/3614782414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54f40ce790 msgr2=0x7f54f414e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:26.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54f3fff640 1 --2- 172.21.15.55:0/3614782414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54f40ce790 0x7f54f414e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54f3fff640 1 -- 172.21.15.55:0/3614782414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54f415b930 msgr2=0x7f54f40c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:26.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54f3fff640 1 --2- 172.21.15.55:0/3614782414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54f415b930 0x7f54f40c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54f3fff640 1 -- 172.21.15.55:0/3614782414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e80094d0 con 0x7f54f40c7ff0 2023-07-06T21:43:26.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54f3fff640 1 --2- 172.21.15.55:0/3614782414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40c7ff0 0x7f54f4153520 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00eed0 tx=0x7f54ec00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:26.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54dbfff640 1 -- 172.21.15.55:0/3614782414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec010040 con 0x7f54f40c7ff0 2023-07-06T21:43:26.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54dbfff640 1 -- 172.21.15.55:0/3614782414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec014400 con 0x7f54f40c7ff0 2023-07-06T21:43:26.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54dbfff640 1 -- 172.21.15.55:0/3614782414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec009ea0 con 0x7f54f40c7ff0 2023-07-06T21:43:26.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54fa093640 1 -- 172.21.15.55:0/3614782414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f40c8b30 con 0x7f54f40c7ff0 2023-07-06T21:43:26.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.229+0000 7f54fa093640 1 -- 172.21.15.55:0/3614782414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f415dfb0 con 0x7f54f40c7ff0 2023-07-06T21:43:26.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.233+0000 7f54fa093640 1 -- 172.21.15.55:0/3614782414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f4066d60 con 0x7f54f40c7ff0 2023-07-06T21:43:26.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.233+0000 7f54dbfff640 1 -- 172.21.15.55:0/3614782414 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f54ec0147b0 con 0x7f54f40c7ff0 2023-07-06T21:43:26.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.233+0000 7f54dbfff640 1 --2- 172.21.15.55:0/3614782414 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f54e0066280 0x7f54e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:26.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.233+0000 7f54dbfff640 1 -- 172.21.15.55:0/3614782414 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f54ec084220 con 0x7f54f40c7ff0 2023-07-06T21:43:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.233+0000 7f54f37fe640 1 --2- 172.21.15.55:0/3614782414 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f54e0066280 0x7f54e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.233+0000 7f54f37fe640 1 --2- 172.21.15.55:0/3614782414 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f54e0066280 0x7f54e0068730 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009ac0 tx=0x7f54e4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:26.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.237+0000 7f54dbfff640 1 -- 172.21.15.55:0/3614782414 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54ec051830 con 0x7f54f40c7ff0 2023-07-06T21:43:26.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.393+0000 7f54fa093640 1 -- 172.21.15.55:0/3614782414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f54f40cc790 con 0x7f54f40c7ff0 2023-07-06T21:43:26.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.693+0000 7f54dbfff640 1 -- 172.21.15.55:0/3614782414 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7f54ec0180b0 con 0x7f54f40c7ff0 2023-07-06T21:43:26.700 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-07-06T21:43:26.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.697+0000 7f54fa093640 1 -- 172.21.15.55:0/3614782414 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f54e0066280 msgr2=0x7f54e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:26.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.697+0000 7f54fa093640 1 --2- 172.21.15.55:0/3614782414 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f54e0066280 0x7f54e0068730 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009ac0 tx=0x7f54e4009190 comp rx=0 tx=0).stop 2023-07-06T21:43:26.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.697+0000 7f54fa093640 1 -- 172.21.15.55:0/3614782414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40c7ff0 msgr2=0x7f54f4153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:26.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.697+0000 7f54fa093640 1 --2- 172.21.15.55:0/3614782414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40c7ff0 0x7f54f4153520 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00eed0 tx=0x7f54ec00b480 comp rx=0 tx=0).stop 2023-07-06T21:43:26.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.697+0000 7f54fa093640 1 -- 172.21.15.55:0/3614782414 shutdown_connections 2023-07-06T21:43:26.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.697+0000 7f54fa093640 1 --2- 172.21.15.55:0/3614782414 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f54e0066280 0x7f54e0068730 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.697+0000 7f54fa093640 1 --2- 172.21.15.55:0/3614782414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40c7ff0 0x7f54f4153520 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.697+0000 7f54fa093640 1 --2- 172.21.15.55:0/3614782414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54f415b930 0x7f54f40c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.697+0000 7f54fa093640 1 --2- 172.21.15.55:0/3614782414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54f40ce790 0x7f54f414e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.697+0000 7f54fa093640 1 -- 172.21.15.55:0/3614782414 >> 172.21.15.55:0/3614782414 conn(0x7f54f40d0c60 msgr2=0x7f54f4159b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:26.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.697+0000 7f54fa093640 1 -- 172.21.15.55:0/3614782414 shutdown_connections 2023-07-06T21:43:26.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.697+0000 7f54fa093640 1 -- 172.21.15.55:0/3614782414 wait complete. 2023-07-06T21:43:26.727 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T21:43:26.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fea9c640 1 Processor -- start 2023-07-06T21:43:26.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fea9c640 1 -- start start 2023-07-06T21:43:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fea9c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66f80c8cb0 0x7f66f80cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fea9c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f66f815c310 0x7f66f8158480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fea9c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f815be80 con 0x7f66f806bb80 2023-07-06T21:43:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fea9c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f80c9080 con 0x7f66f80c8cb0 2023-07-06T21:43:26.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fea9c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f8158d40 con 0x7f66f815c310 2023-07-06T21:43:26.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fc838640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66f80c8cb0 0x7f66f80cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:26.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fc838640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66f80c8cb0 0x7f66f80cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50774/0 (socket says 172.21.15.55:50774) 2023-07-06T21:43:26.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fd039640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f66f806bb80 0x7f66f80cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45016/0 (socket says 172.21.15.55:45016) 2023-07-06T21:43:26.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fc838640 1 -- 172.21.15.55:0/14285648 learned_addr learned my addr 172.21.15.55:0/14285648 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:26.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66f7fff640 1 --2- 172.21.15.55:0/14285648 >> v2:172.21.15.138:3300/0 conn(0x7f66f815c310 0x7f66f8158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:26.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fc838640 1 -- 172.21.15.55:0/14285648 >> v2:172.21.15.138:3300/0 conn(0x7f66f815c310 msgr2=0x7f66f8158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:26.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fc838640 1 --2- 172.21.15.55:0/14285648 >> v2:172.21.15.138:3300/0 conn(0x7f66f815c310 0x7f66f8158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fc838640 1 -- 172.21.15.55:0/14285648 >> v1:172.21.15.55:6789/0 conn(0x7f66f806bb80 legacy=0x7f66f80cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:26.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66fc838640 1 -- 172.21.15.55:0/14285648 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f8159020 con 0x7f66f80c8cb0 2023-07-06T21:43:26.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.869+0000 7f66f77fe640 1 -- 172.21.15.55:0/14285648 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553288257 0 0) 0x7f66f815be80 con 0x7f66f806bb80 2023-07-06T21:43:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.873+0000 7f66fc838640 1 --2- 172.21.15.55:0/14285648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66f80c8cb0 0x7f66f80cd890 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f66f806ac30 tx=0x7f66ec01d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fe637daa745d19 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.873+0000 7f66f77fe640 1 -- 172.21.15.55:0/14285648 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0a6990 con 0x7f66f80c8cb0 2023-07-06T21:43:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.873+0000 7f66f77fe640 1 -- 172.21.15.55:0/14285648 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec0a6af0 con 0x7f66f80c8cb0 2023-07-06T21:43:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.873+0000 7f66f77fe640 1 -- 172.21.15.55:0/14285648 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0a6e80 con 0x7f66f80c8cb0 2023-07-06T21:43:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.873+0000 7f66fea9c640 1 -- 172.21.15.55:0/14285648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66f80c8cb0 msgr2=0x7f66f80cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.873+0000 7f66fea9c640 1 --2- 172.21.15.55:0/14285648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66f80c8cb0 0x7f66f80cd890 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f66f806ac30 tx=0x7f66ec01d8a0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.873+0000 7f66fea9c640 1 -- 172.21.15.55:0/14285648 shutdown_connections 2023-07-06T21:43:26.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.873+0000 7f66fea9c640 1 --2- 172.21.15.55:0/14285648 >> v2:172.21.15.138:3300/0 conn(0x7f66f815c310 0x7f66f8158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.873+0000 7f66fea9c640 1 --2- 172.21.15.55:0/14285648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66f80c8cb0 0x7f66f80cd890 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.873+0000 7f66fea9c640 1 -- 172.21.15.55:0/14285648 >> 172.21.15.55:0/14285648 conn(0x7f66f80cdf40 msgr2=0x7f66f80ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:26.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.873+0000 7f66fea9c640 1 -- 172.21.15.55:0/14285648 shutdown_connections 2023-07-06T21:43:26.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.873+0000 7f66fea9c640 1 -- 172.21.15.55:0/14285648 wait complete. 2023-07-06T21:43:26.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fea9c640 1 Processor -- start 2023-07-06T21:43:26.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fea9c640 1 -- start start 2023-07-06T21:43:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fea9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66f806bb80 0x7f66f80acea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fea9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66f80c8cb0 0x7f66f81484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fea9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f815c310 0x7f66f8153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fea9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f81489e0 con 0x7f66f806bb80 2023-07-06T21:43:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fea9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80c53f0 con 0x7f66f815c310 2023-07-06T21:43:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fea9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80c56d0 con 0x7f66f80c8cb0 2023-07-06T21:43:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fc838640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66f806bb80 0x7f66f80acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:26.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fc838640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66f806bb80 0x7f66f80acea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50778/0 (socket says 172.21.15.55:50778) 2023-07-06T21:43:26.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fc838640 1 -- 172.21.15.55:0/1893604321 learned_addr learned my addr 172.21.15.55:0/1893604321 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:26.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66f7fff640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66f80c8cb0 0x7f66f81484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:26.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fd039640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f815c310 0x7f66f8153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:26.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fc838640 1 -- 172.21.15.55:0/1893604321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66f80c8cb0 msgr2=0x7f66f81484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:26.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fc838640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66f80c8cb0 0x7f66f81484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fc838640 1 -- 172.21.15.55:0/1893604321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f815c310 msgr2=0x7f66f8153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:26.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fc838640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f815c310 0x7f66f8153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:26.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fc838640 1 -- 172.21.15.55:0/1893604321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec00a670 con 0x7f66f806bb80 2023-07-06T21:43:26.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fd039640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f815c310 0x7f66f8153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:26.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fc838640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66f806bb80 0x7f66f80acea0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f66ec01a4b0 tx=0x7f66ec01c0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:26.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66f57fa640 1 -- 172.21.15.55:0/1893604321 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0aeea0 con 0x7f66f806bb80 2023-07-06T21:43:26.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66f57fa640 1 -- 172.21.15.55:0/1893604321 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec004020 con 0x7f66f806bb80 2023-07-06T21:43:26.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66fea9c640 1 -- 172.21.15.55:0/1893604321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f80c59b0 con 0x7f66f806bb80 2023-07-06T21:43:26.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.877+0000 7f66f57fa640 1 -- 172.21.15.55:0/1893604321 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec004390 con 0x7f66f806bb80 2023-07-06T21:43:26.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.881+0000 7f66fea9c640 1 -- 172.21.15.55:0/1893604321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f80c5c90 con 0x7f66f806bb80 2023-07-06T21:43:26.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.881+0000 7f66fea9c640 1 -- 172.21.15.55:0/1893604321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f8066d60 con 0x7f66f806bb80 2023-07-06T21:43:26.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.881+0000 7f66f57fa640 1 -- 172.21.15.55:0/1893604321 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f66ec003620 con 0x7f66f806bb80 2023-07-06T21:43:26.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.881+0000 7f66f57fa640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f66dc066280 0x7f66dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:26.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.881+0000 7f66f57fa640 1 -- 172.21.15.55:0/1893604321 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f66ec11e490 con 0x7f66f806bb80 2023-07-06T21:43:26.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.881+0000 7f66f7fff640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f66dc066280 0x7f66dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:26.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.885+0000 7f66f7fff640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f66dc066280 0x7f66dc068730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f66e40079c0 tx=0x7f66e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:26.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:26.885+0000 7f66f57fa640 1 -- 172.21.15.55:0/1893604321 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f66ec0eba40 con 0x7f66f806bb80 2023-07-06T21:43:27.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.041+0000 7f66fea9c640 1 -- 172.21.15.55:0/1893604321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f66f806ac60 con 0x7f66f806bb80 2023-07-06T21:43:27.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.701+0000 7f66f57fa640 1 -- 172.21.15.55:0/1893604321 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v40) v1 ==== 170+0+0 (secure 0 0 0) 0x7f66ec0044f0 con 0x7f66f806bb80 2023-07-06T21:43:27.711 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-07-06T21:43:27.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.709+0000 7f66fea9c640 1 -- 172.21.15.55:0/1893604321 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f66dc066280 msgr2=0x7f66dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:27.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.709+0000 7f66fea9c640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f66dc066280 0x7f66dc068730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f66e40079c0 tx=0x7f66e4008040 comp rx=0 tx=0).stop 2023-07-06T21:43:27.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.709+0000 7f66fea9c640 1 -- 172.21.15.55:0/1893604321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66f806bb80 msgr2=0x7f66f80acea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:27.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.709+0000 7f66fea9c640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66f806bb80 0x7f66f80acea0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f66ec01a4b0 tx=0x7f66ec01c0e0 comp rx=0 tx=0).stop 2023-07-06T21:43:27.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.709+0000 7f66fea9c640 1 -- 172.21.15.55:0/1893604321 shutdown_connections 2023-07-06T21:43:27.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.709+0000 7f66fea9c640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f66dc066280 0x7f66dc068730 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:27.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.709+0000 7f66fea9c640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f815c310 0x7f66f8153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:27.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.709+0000 7f66fea9c640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66f80c8cb0 0x7f66f81484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:27.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.709+0000 7f66fea9c640 1 --2- 172.21.15.55:0/1893604321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66f806bb80 0x7f66f80acea0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:27.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.709+0000 7f66fea9c640 1 -- 172.21.15.55:0/1893604321 >> 172.21.15.55:0/1893604321 conn(0x7f66f80cdf40 msgr2=0x7f66f81551b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:27.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.709+0000 7f66fea9c640 1 -- 172.21.15.55:0/1893604321 shutdown_connections 2023-07-06T21:43:27.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.709+0000 7f66fea9c640 1 -- 172.21.15.55:0/1893604321 wait complete. 2023-07-06T21:43:27.752 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T21:43:27.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f094adf6640 1 Processor -- start 2023-07-06T21:43:27.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f094adf6640 1 -- start start 2023-07-06T21:43:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f094adf6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f094406fef0 0x7f0944164820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f094adf6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09440cc030 con 0x7f0944070d70 2023-07-06T21:43:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f094adf6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09440cc300 con 0x7f09440709a0 2023-07-06T21:43:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f094adf6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09440cc5e0 con 0x7f094406fef0 2023-07-06T21:43:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f0943fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0944070d70 0x7f09440b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45024/0 (socket says 172.21.15.55:45024) 2023-07-06T21:43:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f0943fff640 1 -- 172.21.15.55:0/38303585 learned_addr learned my addr 172.21.15.55:0/38303585 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f0949393640 1 --2- 172.21.15.55:0/38303585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f094406fef0 0x7f0944164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 -- 172.21.15.55:0/38303585 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093464109 0 0) 0x7f09440cc030 con 0x7f0944070d70 2023-07-06T21:43:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 -- 172.21.15.55:0/38303585 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0934003530 con 0x7f0944070d70 2023-07-06T21:43:27.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 -- 172.21.15.55:0/38303585 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 515668037 0 0) 0x7f0934003530 con 0x7f0944070d70 2023-07-06T21:43:27.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 -- 172.21.15.55:0/38303585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f094406fef0 msgr2=0x7f0944164820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:27.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 --2- 172.21.15.55:0/38303585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f094406fef0 0x7f0944164820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:27.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 -- 172.21.15.55:0/38303585 >> v1:172.21.15.138:6789/0 conn(0x7f09440709a0 legacy=0x7f09440cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:27.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 -- 172.21.15.55:0/38303585 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09440cc8c0 con 0x7f0944070d70 2023-07-06T21:43:27.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 -- 172.21.15.55:0/38303585 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f0930001680 con 0x7f0944070d70 2023-07-06T21:43:27.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 -- 172.21.15.55:0/38303585 >> v1:172.21.15.55:6789/0 conn(0x7f0944070d70 legacy=0x7f09440b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:27.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 --2- 172.21.15.55:0/38303585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f094406fef0 0x7f09340039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:27.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 --2- 172.21.15.55:0/38303585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0934003ef0 0x7f09340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:27.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 --2- 172.21.15.55:0/38303585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0934004d10 0x7f0934005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:27.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 -- 172.21.15.55:0/38303585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09440cc5e0 con 0x7f0934004d10 2023-07-06T21:43:27.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 -- 172.21.15.55:0/38303585 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093400b9c0 con 0x7f0934003ef0 2023-07-06T21:43:27.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f09437fe640 1 -- 172.21.15.55:0/38303585 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093400bb80 con 0x7f094406fef0 2023-07-06T21:43:27.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f0949393640 1 --2- 172.21.15.55:0/38303585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0934004d10 0x7f0934005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:27.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f0943fff640 1 --2- 172.21.15.55:0/38303585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0934003ef0 0x7f09340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:27.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.893+0000 7f0948b92640 1 --2- 172.21.15.55:0/38303585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f094406fef0 0x7f09340039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:27.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f0949393640 1 -- 172.21.15.55:0/38303585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f094406fef0 msgr2=0x7f09340039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:27.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f0949393640 1 --2- 172.21.15.55:0/38303585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f094406fef0 0x7f09340039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:27.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f0949393640 1 -- 172.21.15.55:0/38303585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0934003ef0 msgr2=0x7f09340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:27.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f0949393640 1 --2- 172.21.15.55:0/38303585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0934003ef0 0x7f09340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:27.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f0949393640 1 -- 172.21.15.55:0/38303585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0934003530 con 0x7f0934004d10 2023-07-06T21:43:27.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f0949393640 1 --2- 172.21.15.55:0/38303585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0934004d10 0x7f0934005180 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f093c009f90 tx=0x7f093c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ffd865fbb47f98 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:27.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f09437fe640 1 -- 172.21.15.55:0/38303585 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0930007ea0 con 0x7f0934004d10 2023-07-06T21:43:27.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f09437fe640 1 -- 172.21.15.55:0/38303585 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c00f040 con 0x7f0934004d10 2023-07-06T21:43:27.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f09437fe640 1 -- 172.21.15.55:0/38303585 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c0a5e70 con 0x7f0934004d10 2023-07-06T21:43:27.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f094adf6640 1 -- 172.21.15.55:0/38303585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0934004d10 msgr2=0x7f0934005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:27.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f094adf6640 1 --2- 172.21.15.55:0/38303585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0934004d10 0x7f0934005180 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f093c009f90 tx=0x7f093c01cc20 comp rx=0 tx=0).stop 2023-07-06T21:43:27.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f0949393640 1 -- 172.21.15.55:0/38303585 reap_dead start 2023-07-06T21:43:27.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f094adf6640 1 -- 172.21.15.55:0/38303585 shutdown_connections 2023-07-06T21:43:27.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f094adf6640 1 -- 172.21.15.55:0/38303585 >> 172.21.15.55:0/38303585 conn(0x7f09440cea70 msgr2=0x7f09440ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:27.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f094adf6640 1 -- 172.21.15.55:0/38303585 shutdown_connections 2023-07-06T21:43:27.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.897+0000 7f094adf6640 1 -- 172.21.15.55:0/38303585 wait complete. 2023-07-06T21:43:27.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f094adf6640 1 Processor -- start 2023-07-06T21:43:27.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f094adf6640 1 -- start start 2023-07-06T21:43:27.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f094adf6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0934004d10 0x7f094415ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:27.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f094adf6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09441547d0 0x7f09441f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:27.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f094adf6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09441f4800 0x7f09441f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:27.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f094adf6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094415bf60 con 0x7f0934004d10 2023-07-06T21:43:27.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f094adf6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0944156470 con 0x7f09441547d0 2023-07-06T21:43:27.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f094adf6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0944156750 con 0x7f09441f4800 2023-07-06T21:43:27.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f0948b92640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0934004d10 0x7f094415ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:27.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f0948b92640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0934004d10 0x7f094415ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50800/0 (socket says 172.21.15.55:50800) 2023-07-06T21:43:27.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f0948b92640 1 -- 172.21.15.55:0/4095515962 learned_addr learned my addr 172.21.15.55:0/4095515962 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:27.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f0943fff640 1 --2- 172.21.15.55:0/4095515962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09441547d0 0x7f09441f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:27.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f0949393640 1 --2- 172.21.15.55:0/4095515962 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09441f4800 0x7f09441f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:27.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f0948b92640 1 -- 172.21.15.55:0/4095515962 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09441f4800 msgr2=0x7f09441f4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:27.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f0948b92640 1 --2- 172.21.15.55:0/4095515962 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09441f4800 0x7f09441f4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:27.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f0948b92640 1 -- 172.21.15.55:0/4095515962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09441547d0 msgr2=0x7f09441f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:27.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f0948b92640 1 --2- 172.21.15.55:0/4095515962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09441547d0 0x7f09441f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:27.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f0948b92640 1 -- 172.21.15.55:0/4095515962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0944156a30 con 0x7f0934004d10 2023-07-06T21:43:27.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.901+0000 7f0948b92640 1 --2- 172.21.15.55:0/4095515962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0934004d10 0x7f094415ba20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f093800f780 tx=0x7f093800fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:27.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.905+0000 7f09417fa640 1 -- 172.21.15.55:0/4095515962 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800fe90 con 0x7f0934004d10 2023-07-06T21:43:27.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.905+0000 7f09417fa640 1 -- 172.21.15.55:0/4095515962 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09380052e0 con 0x7f0934004d10 2023-07-06T21:43:27.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.905+0000 7f09417fa640 1 -- 172.21.15.55:0/4095515962 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800d970 con 0x7f0934004d10 2023-07-06T21:43:27.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.905+0000 7f094adf6640 1 -- 172.21.15.55:0/4095515962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0944156d10 con 0x7f0934004d10 2023-07-06T21:43:27.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.905+0000 7f094adf6640 1 -- 172.21.15.55:0/4095515962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0944154fb0 con 0x7f0934004d10 2023-07-06T21:43:27.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.905+0000 7f094adf6640 1 -- 172.21.15.55:0/4095515962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0944066d60 con 0x7f0934004d10 2023-07-06T21:43:27.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.905+0000 7f09417fa640 1 -- 172.21.15.55:0/4095515962 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f093800dad0 con 0x7f0934004d10 2023-07-06T21:43:27.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.905+0000 7f09417fa640 1 --2- 172.21.15.55:0/4095515962 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f09280662b0 0x7f0928068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:27.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.905+0000 7f09417fa640 1 -- 172.21.15.55:0/4095515962 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f09380849a0 con 0x7f0934004d10 2023-07-06T21:43:27.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.905+0000 7f0943fff640 1 --2- 172.21.15.55:0/4095515962 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f09280662b0 0x7f0928068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:27.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.905+0000 7f0943fff640 1 --2- 172.21.15.55:0/4095515962 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f09280662b0 0x7f0928068760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f09440c4590 tx=0x7f0930009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:27.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:27.909+0000 7f09417fa640 1 -- 172.21.15.55:0/4095515962 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0938051d20 con 0x7f0934004d10 2023-07-06T21:43:28.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.101+0000 7f094adf6640 1 -- 172.21.15.55:0/4095515962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f09441571c0 con 0x7f0934004d10 2023-07-06T21:43:28.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.109+0000 7f09417fa640 1 -- 172.21.15.55:0/4095515962 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0938055340 con 0x7f0934004d10 2023-07-06T21:43:28.120 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 6 and data pool 7 2023-07-06T21:43:28.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.117+0000 7f094adf6640 1 -- 172.21.15.55:0/4095515962 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f09280662b0 msgr2=0x7f0928068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:28.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.117+0000 7f094adf6640 1 --2- 172.21.15.55:0/4095515962 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f09280662b0 0x7f0928068760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f09440c4590 tx=0x7f0930009040 comp rx=0 tx=0).stop 2023-07-06T21:43:28.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.117+0000 7f094adf6640 1 -- 172.21.15.55:0/4095515962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0934004d10 msgr2=0x7f094415ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:28.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.117+0000 7f094adf6640 1 --2- 172.21.15.55:0/4095515962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0934004d10 0x7f094415ba20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f093800f780 tx=0x7f093800fc40 comp rx=0 tx=0).stop 2023-07-06T21:43:28.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.117+0000 7f094adf6640 1 -- 172.21.15.55:0/4095515962 shutdown_connections 2023-07-06T21:43:28.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.117+0000 7f094adf6640 1 --2- 172.21.15.55:0/4095515962 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f09280662b0 0x7f0928068760 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.121+0000 7f094adf6640 1 --2- 172.21.15.55:0/4095515962 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09441f4800 0x7f09441f4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.121+0000 7f094adf6640 1 --2- 172.21.15.55:0/4095515962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09441547d0 0x7f09441f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.121+0000 7f094adf6640 1 --2- 172.21.15.55:0/4095515962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0934004d10 0x7f094415ba20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.121+0000 7f094adf6640 1 -- 172.21.15.55:0/4095515962 >> 172.21.15.55:0/4095515962 conn(0x7f09440cea70 msgr2=0x7f094415cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:28.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.133+0000 7f094adf6640 1 -- 172.21.15.55:0/4095515962 shutdown_connections 2023-07-06T21:43:28.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.133+0000 7f094adf6640 1 -- 172.21.15.55:0/4095515962 wait complete. 2023-07-06T21:43:28.174 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:43:28.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5cb8cb640 1 Processor -- start 2023-07-06T21:43:28.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5cb8cb640 1 -- start start 2023-07-06T21:43:28.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5cb8cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5c40cd330 0x7fe5c40cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:28.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5cb8cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe5c40cbce0 0x7fe5c40cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:28.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5cb8cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c406bd00 con 0x7fe5c4160030 2023-07-06T21:43:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5cb8cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c4160400 con 0x7fe5c40cbce0 2023-07-06T21:43:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5cb8cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40cdce0 con 0x7fe5c40cd330 2023-07-06T21:43:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5c9e68640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe5c40cbce0 0x7fe5c40cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5c9667640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe5c4160030 0x7fe5c4070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45038/0 (socket says 172.21.15.55:45038) 2023-07-06T21:43:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5c9667640 1 -- 172.21.15.55:0/4245870652 learned_addr learned my addr 172.21.15.55:0/4245870652 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5c8e66640 1 --2- 172.21.15.55:0/4245870652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5c40cd330 0x7fe5c40cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:28.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5c9e68640 1 -- 172.21.15.55:0/4245870652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5c40cd330 msgr2=0x7fe5c40cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:28.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5c9e68640 1 --2- 172.21.15.55:0/4245870652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5c40cd330 0x7fe5c40cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5c9e68640 1 -- 172.21.15.55:0/4245870652 >> v1:172.21.15.55:6789/0 conn(0x7fe5c4160030 legacy=0x7fe5c4070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:28.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.309+0000 7fe5bbfff640 1 -- 172.21.15.55:0/4245870652 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379918713 0 0) 0x7fe5c406bd00 con 0x7fe5c4160030 2023-07-06T21:43:28.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.313+0000 7fe5c9e68640 1 -- 172.21.15.55:0/4245870652 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c40c9ba0 con 0x7fe5c40cbce0 2023-07-06T21:43:28.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.313+0000 7fe5c8e66640 1 --2- 172.21.15.55:0/4245870652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5c40cd330 0x7fe5c40cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:28.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.313+0000 7fe5c9e68640 1 --2- 172.21.15.55:0/4245870652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40cbce0 0x7fe5c40cc160 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009dc0 tx=0x7fe5bc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4131e8e362d3b21 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:28.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.313+0000 7fe5bbfff640 1 -- 172.21.15.55:0/4245870652 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0a57f0 con 0x7fe5c40cbce0 2023-07-06T21:43:28.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.313+0000 7fe5bbfff640 1 -- 172.21.15.55:0/4245870652 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc0a5950 con 0x7fe5c40cbce0 2023-07-06T21:43:28.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.313+0000 7fe5bbfff640 1 -- 172.21.15.55:0/4245870652 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0a5ce0 con 0x7fe5c40cbce0 2023-07-06T21:43:28.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.313+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4245870652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40cbce0 msgr2=0x7fe5c40cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:28.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.313+0000 7fe5cb8cb640 1 --2- 172.21.15.55:0/4245870652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40cbce0 0x7fe5c40cc160 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009dc0 tx=0x7fe5bc01c930 comp rx=0 tx=0).stop 2023-07-06T21:43:28.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.313+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4245870652 shutdown_connections 2023-07-06T21:43:28.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.313+0000 7fe5cb8cb640 1 --2- 172.21.15.55:0/4245870652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5c40cd330 0x7fe5c40cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.313+0000 7fe5cb8cb640 1 --2- 172.21.15.55:0/4245870652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40cbce0 0x7fe5c40cc160 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.313+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4245870652 >> 172.21.15.55:0/4245870652 conn(0x7fe5c40cded0 msgr2=0x7fe5c40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:28.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.313+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4245870652 shutdown_connections 2023-07-06T21:43:28.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.313+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4245870652 wait complete. 2023-07-06T21:43:28.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5cb8cb640 1 Processor -- start 2023-07-06T21:43:28.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5cb8cb640 1 -- start start 2023-07-06T21:43:28.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5cb8cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40cbce0 0x7fe5c40c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:28.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5cb8cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5c40cd330 0x7fe5c40c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:28.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5cb8cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5c4160030 0x7fe5c415f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:28.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5cb8cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40c7dc0 con 0x7fe5c40cbce0 2023-07-06T21:43:28.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5cb8cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41fb630 con 0x7fe5c40cd330 2023-07-06T21:43:28.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5cb8cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41fb910 con 0x7fe5c4160030 2023-07-06T21:43:28.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5c9667640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40cbce0 0x7fe5c40c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:28.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5c9667640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40cbce0 0x7fe5c40c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50818/0 (socket says 172.21.15.55:50818) 2023-07-06T21:43:28.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5c9667640 1 -- 172.21.15.55:0/4156737930 learned_addr learned my addr 172.21.15.55:0/4156737930 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:28.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5c9e68640 1 --2- 172.21.15.55:0/4156737930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5c4160030 0x7fe5c415f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:28.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5c8e66640 1 --2- 172.21.15.55:0/4156737930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5c40cd330 0x7fe5c40c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:28.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5c9667640 1 -- 172.21.15.55:0/4156737930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5c4160030 msgr2=0x7fe5c415f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:28.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5c9667640 1 --2- 172.21.15.55:0/4156737930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5c4160030 0x7fe5c415f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5c9667640 1 -- 172.21.15.55:0/4156737930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5c40cd330 msgr2=0x7fe5c40c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:28.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5c9667640 1 --2- 172.21.15.55:0/4156737930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5c40cd330 0x7fe5c40c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5c9667640 1 -- 172.21.15.55:0/4156737930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc009a70 con 0x7fe5c40cbce0 2023-07-06T21:43:28.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5c9667640 1 --2- 172.21.15.55:0/4156737930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40cbce0 0x7fe5c40c7880 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00011f0 tx=0x7fe5c000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:28.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5b9ffb640 1 -- 172.21.15.55:0/4156737930 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00074e0 con 0x7fe5c40cbce0 2023-07-06T21:43:28.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5b9ffb640 1 -- 172.21.15.55:0/4156737930 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c0007640 con 0x7fe5c40cbce0 2023-07-06T21:43:28.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5b9ffb640 1 -- 172.21.15.55:0/4156737930 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0004a10 con 0x7fe5c40cbce0 2023-07-06T21:43:28.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.317+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4156737930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c41fbbf0 con 0x7fe5c40cbce0 2023-07-06T21:43:28.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.321+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4156737930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c40c4570 con 0x7fe5c40cbce0 2023-07-06T21:43:28.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.321+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4156737930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c40c48a0 con 0x7fe5c40cbce0 2023-07-06T21:43:28.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.321+0000 7fe5b9ffb640 1 -- 172.21.15.55:0/4156737930 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe5c0004b70 con 0x7fe5c40cbce0 2023-07-06T21:43:28.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.321+0000 7fe5b9ffb640 1 --2- 172.21.15.55:0/4156737930 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe5a80662b0 0x7fe5a8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:28.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.321+0000 7fe5b9ffb640 1 -- 172.21.15.55:0/4156737930 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe5c0083070 con 0x7fe5c40cbce0 2023-07-06T21:43:28.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.321+0000 7fe5c8e66640 1 --2- 172.21.15.55:0/4156737930 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe5a80662b0 0x7fe5a8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:28.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.321+0000 7fe5c8e66640 1 --2- 172.21.15.55:0/4156737930 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe5a80662b0 0x7fe5a8068760 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe5c406f850 tx=0x7fe5b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:28.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.325+0000 7fe5b9ffb640 1 -- 172.21.15.55:0/4156737930 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe5c00b3700 con 0x7fe5c40cbce0 2023-07-06T21:43:28.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.481+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4156737930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5c4156e10 con 0x7fe5c40cbce0 2023-07-06T21:43:28.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.485+0000 7fe5b9ffb640 1 -- 172.21.15.55:0/4156737930 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18501 (secure 0 0 0) 0x7fe5c0018020 con 0x7fe5c40cbce0 2023-07-06T21:43:28.492 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:28.492 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":41,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:43:28.108093+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:43:26.444989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-06T21:43:27.092120+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:43:28.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.485+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4156737930 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe5a80662b0 msgr2=0x7fe5a8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:28.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.485+0000 7fe5cb8cb640 1 --2- 172.21.15.55:0/4156737930 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe5a80662b0 0x7fe5a8068760 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe5c406f850 tx=0x7fe5b4008040 comp rx=0 tx=0).stop 2023-07-06T21:43:28.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.485+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4156737930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40cbce0 msgr2=0x7fe5c40c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:28.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.485+0000 7fe5cb8cb640 1 --2- 172.21.15.55:0/4156737930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40cbce0 0x7fe5c40c7880 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00011f0 tx=0x7fe5c000c9b0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.485+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4156737930 shutdown_connections 2023-07-06T21:43:28.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.485+0000 7fe5cb8cb640 1 --2- 172.21.15.55:0/4156737930 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe5a80662b0 0x7fe5a8068760 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.485+0000 7fe5cb8cb640 1 --2- 172.21.15.55:0/4156737930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5c4160030 0x7fe5c415f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.485+0000 7fe5cb8cb640 1 --2- 172.21.15.55:0/4156737930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5c40cd330 0x7fe5c40c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.485+0000 7fe5cb8cb640 1 --2- 172.21.15.55:0/4156737930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40cbce0 0x7fe5c40c7880 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.485+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4156737930 >> 172.21.15.55:0/4156737930 conn(0x7fe5c40cded0 msgr2=0x7fe5c40ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:28.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.485+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4156737930 shutdown_connections 2023-07-06T21:43:28.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.485+0000 7fe5cb8cb640 1 -- 172.21.15.55:0/4156737930 wait complete. 2023-07-06T21:43:28.516 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:43:28.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.649+0000 7fe1657d2640 1 Processor -- start 2023-07-06T21:43:28.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.649+0000 7fe1657d2640 1 -- start start 2023-07-06T21:43:28.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe1657d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe16015b7e0 0x7fe1600cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:28.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe1657d2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe160160300 0x7fe1600c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:28.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe1657d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1600cdc80 con 0x7fe1600c8a60 2023-07-06T21:43:28.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe1657d2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1600cd6c0 con 0x7fe160160300 2023-07-06T21:43:28.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe1657d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600cd9a0 con 0x7fe16015b7e0 2023-07-06T21:43:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe15f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe1600c8a60 0x7fe16006b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45052/0 (socket says 172.21.15.55:45052) 2023-07-06T21:43:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe15f7fe640 1 -- 172.21.15.55:0/3548235044 learned_addr learned my addr 172.21.15.55:0/3548235044 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe15effd640 1 --2- 172.21.15.55:0/3548235044 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe16015b7e0 0x7fe1600cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe157fff640 1 --2- 172.21.15.55:0/3548235044 >> v2:172.21.15.138:3300/0 conn(0x7fe160160300 0x7fe1600c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe15e7fc640 1 -- 172.21.15.55:0/3548235044 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821152125 0 0) 0x7fe1600cdc80 con 0x7fe1600c8a60 2023-07-06T21:43:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe15e7fc640 1 -- 172.21.15.55:0/3548235044 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe14c003530 con 0x7fe1600c8a60 2023-07-06T21:43:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe157fff640 1 -- 172.21.15.55:0/3548235044 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe16015b7e0 msgr2=0x7fe1600cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe157fff640 1 --2- 172.21.15.55:0/3548235044 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe16015b7e0 0x7fe1600cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe157fff640 1 -- 172.21.15.55:0/3548235044 >> v1:172.21.15.55:6789/0 conn(0x7fe1600c8a60 legacy=0x7fe16006b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.653+0000 7fe157fff640 1 -- 172.21.15.55:0/3548235044 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160069490 con 0x7fe160160300 2023-07-06T21:43:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.657+0000 7fe157fff640 1 --2- 172.21.15.55:0/3548235044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe160160300 0x7fe1600c8520 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe1480097c0 tx=0x7fe14801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bf64c59be45955b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.657+0000 7fe15e7fc640 1 -- 172.21.15.55:0/3548235044 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1480ab670 con 0x7fe160160300 2023-07-06T21:43:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.657+0000 7fe15e7fc640 1 -- 172.21.15.55:0/3548235044 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1480ab7d0 con 0x7fe160160300 2023-07-06T21:43:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.657+0000 7fe15e7fc640 1 -- 172.21.15.55:0/3548235044 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1480abb60 con 0x7fe160160300 2023-07-06T21:43:28.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.657+0000 7fe1657d2640 1 -- 172.21.15.55:0/3548235044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe160160300 msgr2=0x7fe1600c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:28.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.657+0000 7fe1657d2640 1 --2- 172.21.15.55:0/3548235044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe160160300 0x7fe1600c8520 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe1480097c0 tx=0x7fe14801c450 comp rx=0 tx=0).stop 2023-07-06T21:43:28.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.657+0000 7fe1657d2640 1 -- 172.21.15.55:0/3548235044 shutdown_connections 2023-07-06T21:43:28.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.657+0000 7fe1657d2640 1 --2- 172.21.15.55:0/3548235044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe160160300 0x7fe1600c8520 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.657+0000 7fe1657d2640 1 --2- 172.21.15.55:0/3548235044 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe16015b7e0 0x7fe1600cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.657+0000 7fe1657d2640 1 -- 172.21.15.55:0/3548235044 >> 172.21.15.55:0/3548235044 conn(0x7fe1600cded0 msgr2=0x7fe1600ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.657+0000 7fe1657d2640 1 -- 172.21.15.55:0/3548235044 shutdown_connections 2023-07-06T21:43:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.657+0000 7fe1657d2640 1 -- 172.21.15.55:0/3548235044 wait complete. 2023-07-06T21:43:28.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe1657d2640 1 Processor -- start 2023-07-06T21:43:28.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe1657d2640 1 -- start start 2023-07-06T21:43:28.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe1657d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1600c8a60 0x7fe16015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:28.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe1657d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe16015b7e0 0x7fe160155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:28.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe1657d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe160160300 0x7fe160153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:28.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe1657d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16015c0f0 con 0x7fe16015b7e0 2023-07-06T21:43:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe1657d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe160159b70 con 0x7fe160160300 2023-07-06T21:43:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe1657d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe160158f60 con 0x7fe1600c8a60 2023-07-06T21:43:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe157fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe16015b7e0 0x7fe160155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe157fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe16015b7e0 0x7fe160155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50830/0 (socket says 172.21.15.55:50830) 2023-07-06T21:43:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe157fff640 1 -- 172.21.15.55:0/2960331841 learned_addr learned my addr 172.21.15.55:0/2960331841 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe15effd640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1600c8a60 0x7fe16015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:28.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe15f7fe640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe160160300 0x7fe160153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:28.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe157fff640 1 -- 172.21.15.55:0/2960331841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1600c8a60 msgr2=0x7fe16015bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:28.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe157fff640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1600c8a60 0x7fe16015bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe157fff640 1 -- 172.21.15.55:0/2960331841 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe160160300 msgr2=0x7fe160153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:28.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe157fff640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe160160300 0x7fe160153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe157fff640 1 -- 172.21.15.55:0/2960331841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe148009420 con 0x7fe16015b7e0 2023-07-06T21:43:28.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe15effd640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1600c8a60 0x7fe16015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:28.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe157fff640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe16015b7e0 0x7fe160155a90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe1480ad040 tx=0x7fe14801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:28.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe1577fe640 1 -- 172.21.15.55:0/2960331841 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1480bf610 con 0x7fe16015b7e0 2023-07-06T21:43:28.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe1577fe640 1 -- 172.21.15.55:0/2960331841 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1480bf7b0 con 0x7fe16015b7e0 2023-07-06T21:43:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe1657d2640 1 -- 172.21.15.55:0/2960331841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe160159240 con 0x7fe16015b7e0 2023-07-06T21:43:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe1577fe640 1 -- 172.21.15.55:0/2960331841 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1480bfb60 con 0x7fe16015b7e0 2023-07-06T21:43:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe1657d2640 1 -- 172.21.15.55:0/2960331841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe160159800 con 0x7fe16015b7e0 2023-07-06T21:43:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.661+0000 7fe1657d2640 1 -- 172.21.15.55:0/2960331841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe160066d60 con 0x7fe16015b7e0 2023-07-06T21:43:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.665+0000 7fe1577fe640 1 -- 172.21.15.55:0/2960331841 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1480b5400 con 0x7fe16015b7e0 2023-07-06T21:43:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.665+0000 7fe1577fe640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe140066280 0x7fe140068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.665+0000 7fe1577fe640 1 -- 172.21.15.55:0/2960331841 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe14811e730 con 0x7fe16015b7e0 2023-07-06T21:43:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.665+0000 7fe15effd640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe140066280 0x7fe140068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.665+0000 7fe15effd640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe140066280 0x7fe140068730 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe150009bb0 tx=0x7fe150008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.669+0000 7fe1577fe640 1 -- 172.21.15.55:0/2960331841 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1480eb940 con 0x7fe16015b7e0 2023-07-06T21:43:28.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.829+0000 7fe1657d2640 1 -- 172.21.15.55:0/2960331841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe16006c4f0 con 0x7fe16015b7e0 2023-07-06T21:43:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.829+0000 7fe1577fe640 1 -- 172.21.15.55:0/2960331841 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18501 (secure 0 0 0) 0x7fe1480eef60 con 0x7fe16015b7e0 2023-07-06T21:43:28.837 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:28.837 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":41,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:43:28.108093+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:43:26.444989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-06T21:43:27.092120+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:43:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.829+0000 7fe1657d2640 1 -- 172.21.15.55:0/2960331841 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe140066280 msgr2=0x7fe140068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.829+0000 7fe1657d2640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe140066280 0x7fe140068730 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe150009bb0 tx=0x7fe150008040 comp rx=0 tx=0).stop 2023-07-06T21:43:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.829+0000 7fe1657d2640 1 -- 172.21.15.55:0/2960331841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe16015b7e0 msgr2=0x7fe160155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.829+0000 7fe1657d2640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe16015b7e0 0x7fe160155a90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe1480ad040 tx=0x7fe14801ac90 comp rx=0 tx=0).stop 2023-07-06T21:43:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.829+0000 7fe1657d2640 1 -- 172.21.15.55:0/2960331841 shutdown_connections 2023-07-06T21:43:28.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.829+0000 7fe1657d2640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fe140066280 0x7fe140068730 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.829+0000 7fe1657d2640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe160160300 0x7fe160153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.829+0000 7fe1657d2640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe16015b7e0 0x7fe160155a90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.829+0000 7fe1657d2640 1 --2- 172.21.15.55:0/2960331841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1600c8a60 0x7fe16015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:28.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.829+0000 7fe1657d2640 1 -- 172.21.15.55:0/2960331841 >> 172.21.15.55:0/2960331841 conn(0x7fe1600cded0 msgr2=0x7fe1600accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:28.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.829+0000 7fe1657d2640 1 -- 172.21.15.55:0/2960331841 shutdown_connections 2023-07-06T21:43:28.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.829+0000 7fe1657d2640 1 -- 172.21.15.55:0/2960331841 wait complete. 2023-07-06T21:43:28.858 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T21:43:29.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4aba048640 1 Processor -- start 2023-07-06T21:43:29.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4aba048640 1 -- start start 2023-07-06T21:43:29.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4aba048640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4ab40ca130 0x7f4ab40703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:29.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4aba048640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4ab40cd140 0x7f4ab4070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:29.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4aba048640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab4158c20 con 0x7f4ab4158850 2023-07-06T21:43:29.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4aba048640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab40b2aa0 con 0x7f4ab40cd140 2023-07-06T21:43:29.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4aba048640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab40c8db0 con 0x7f4ab40ca130 2023-07-06T21:43:29.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4ab3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4ab40cd140 0x7f4ab4070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:29.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4ab3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4ab40cd140 0x7f4ab4070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50832/0 (socket says 172.21.15.55:50832) 2023-07-06T21:43:29.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4ab3fff640 1 -- 172.21.15.55:0/2660382485 learned_addr learned my addr 172.21.15.55:0/2660382485 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:29.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4ab2ffd640 1 --2- 172.21.15.55:0/2660382485 >> v2:172.21.15.138:3300/0 conn(0x7f4ab40ca130 0x7f4ab40703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:29.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4ab3fff640 1 -- 172.21.15.55:0/2660382485 >> v2:172.21.15.138:3300/0 conn(0x7f4ab40ca130 msgr2=0x7f4ab40703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:29.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4ab3fff640 1 --2- 172.21.15.55:0/2660382485 >> v2:172.21.15.138:3300/0 conn(0x7f4ab40ca130 0x7f4ab40703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:29.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4ab3fff640 1 -- 172.21.15.55:0/2660382485 >> v1:172.21.15.138:6789/0 conn(0x7f4ab4158850 legacy=0x7f4ab40cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:29.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4ab3fff640 1 -- 172.21.15.55:0/2660382485 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab40c9090 con 0x7f4ab40cd140 2023-07-06T21:43:29.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:28.997+0000 7f4ab2ffd640 1 --2- 172.21.15.55:0/2660382485 >> v2:172.21.15.138:3300/0 conn(0x7f4ab40ca130 0x7f4ab40703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:29.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.001+0000 7f4ab3fff640 1 --2- 172.21.15.55:0/2660382485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ab40cd140 0x7f4ab4070920 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4071490 tx=0x7f4aac01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a55fabe5c2bbc4c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.001+0000 7f4ab27fc640 1 -- 172.21.15.55:0/2660382485 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac0a5820 con 0x7f4ab40cd140 2023-07-06T21:43:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.001+0000 7f4ab27fc640 1 -- 172.21.15.55:0/2660382485 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac0a5980 con 0x7f4ab40cd140 2023-07-06T21:43:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.001+0000 7f4ab27fc640 1 -- 172.21.15.55:0/2660382485 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac0a5d10 con 0x7f4ab40cd140 2023-07-06T21:43:29.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.001+0000 7f4aba048640 1 -- 172.21.15.55:0/2660382485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ab40cd140 msgr2=0x7f4ab4070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:29.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.001+0000 7f4aba048640 1 --2- 172.21.15.55:0/2660382485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ab40cd140 0x7f4ab4070920 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4071490 tx=0x7f4aac01c960 comp rx=0 tx=0).stop 2023-07-06T21:43:29.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.001+0000 7f4aba048640 1 -- 172.21.15.55:0/2660382485 shutdown_connections 2023-07-06T21:43:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.001+0000 7f4aba048640 1 --2- 172.21.15.55:0/2660382485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ab40cd140 0x7f4ab4070920 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.001+0000 7f4aba048640 1 --2- 172.21.15.55:0/2660382485 >> v2:172.21.15.138:3300/0 conn(0x7f4ab40ca130 0x7f4ab40703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.001+0000 7f4aba048640 1 -- 172.21.15.55:0/2660382485 >> 172.21.15.55:0/2660382485 conn(0x7f4ab40cea70 msgr2=0x7f4ab40ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.001+0000 7f4aba048640 1 -- 172.21.15.55:0/2660382485 shutdown_connections 2023-07-06T21:43:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.001+0000 7f4aba048640 1 -- 172.21.15.55:0/2660382485 wait complete. 2023-07-06T21:43:29.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4aba048640 1 Processor -- start 2023-07-06T21:43:29.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4aba048640 1 -- start start 2023-07-06T21:43:29.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4aba048640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ab40ca130 0x7f4ab41f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:29.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4aba048640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ab40cd140 0x7f4ab40c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:29.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4aba048640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ab4158850 0x7f4ab40c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:29.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4aba048640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab40693f0 con 0x7f4ab40cd140 2023-07-06T21:43:29.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4aba048640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab4069600 con 0x7f4ab4158850 2023-07-06T21:43:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4aba048640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab40698e0 con 0x7f4ab40ca130 2023-07-06T21:43:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4ab2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ab40cd140 0x7f4ab40c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4ab2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ab40cd140 0x7f4ab40c6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50842/0 (socket says 172.21.15.55:50842) 2023-07-06T21:43:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4ab2ffd640 1 -- 172.21.15.55:0/1541950952 learned_addr learned my addr 172.21.15.55:0/1541950952 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4ab3fff640 1 --2- 172.21.15.55:0/1541950952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ab4158850 0x7f4ab40c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4ab37fe640 1 --2- 172.21.15.55:0/1541950952 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ab40ca130 0x7f4ab41f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4ab2ffd640 1 -- 172.21.15.55:0/1541950952 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ab40ca130 msgr2=0x7f4ab41f5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:29.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4ab2ffd640 1 --2- 172.21.15.55:0/1541950952 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ab40ca130 0x7f4ab41f5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:29.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4ab2ffd640 1 -- 172.21.15.55:0/1541950952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ab4158850 msgr2=0x7f4ab40c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:29.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4ab2ffd640 1 --2- 172.21.15.55:0/1541950952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ab4158850 0x7f4ab40c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:29.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4ab2ffd640 1 -- 172.21.15.55:0/1541950952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac009b30 con 0x7f4ab40cd140 2023-07-06T21:43:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4ab2ffd640 1 --2- 172.21.15.55:0/1541950952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ab40cd140 0x7f4ab40c6ce0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800e810 tx=0x7f4aa800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4a9bfff640 1 -- 172.21.15.55:0/1541950952 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800c8d0 con 0x7f4ab40cd140 2023-07-06T21:43:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4a9bfff640 1 -- 172.21.15.55:0/1541950952 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa800ca30 con 0x7f4ab40cd140 2023-07-06T21:43:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4a9bfff640 1 -- 172.21.15.55:0/1541950952 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800cda0 con 0x7f4ab40cd140 2023-07-06T21:43:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4aba048640 1 -- 172.21.15.55:0/1541950952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab4069bc0 con 0x7f4ab40cd140 2023-07-06T21:43:29.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.005+0000 7f4aba048640 1 -- 172.21.15.55:0/1541950952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab406a180 con 0x7f4ab40cd140 2023-07-06T21:43:29.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.009+0000 7f4aba048640 1 -- 172.21.15.55:0/1541950952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab4066d60 con 0x7f4ab40cd140 2023-07-06T21:43:29.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.009+0000 7f4a9bfff640 1 -- 172.21.15.55:0/1541950952 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4aa8013410 con 0x7f4ab40cd140 2023-07-06T21:43:29.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.009+0000 7f4a9bfff640 1 --2- 172.21.15.55:0/1541950952 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4aa0066280 0x7f4aa0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.009+0000 7f4a9bfff640 1 -- 172.21.15.55:0/1541950952 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4aa8083c60 con 0x7f4ab40cd140 2023-07-06T21:43:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.009+0000 7f4ab37fe640 1 --2- 172.21.15.55:0/1541950952 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4aa0066280 0x7f4aa0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.009+0000 7f4ab37fe640 1 --2- 172.21.15.55:0/1541950952 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4aa0066280 0x7f4aa0068730 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40098e0 tx=0x7f4aa4009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.013+0000 7f4a9bfff640 1 -- 172.21.15.55:0/1541950952 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4aa8050fb0 con 0x7f4ab40cd140 2023-07-06T21:43:29.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:29.201+0000 7f4aba048640 1 -- 172.21.15.55:0/1541950952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4ab40b07a0 con 0x7f4ab40cd140 2023-07-06T21:43:30.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.121+0000 7f4a9bfff640 1 -- 172.21.15.55:0/1541950952 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4aa80545d0 con 0x7f4ab40cd140 2023-07-06T21:43:30.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.121+0000 7f4aba048640 1 -- 172.21.15.55:0/1541950952 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4aa0066280 msgr2=0x7f4aa0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:30.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.121+0000 7f4aba048640 1 --2- 172.21.15.55:0/1541950952 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4aa0066280 0x7f4aa0068730 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40098e0 tx=0x7f4aa4009060 comp rx=0 tx=0).stop 2023-07-06T21:43:30.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.121+0000 7f4aba048640 1 -- 172.21.15.55:0/1541950952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ab40cd140 msgr2=0x7f4ab40c6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:30.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.121+0000 7f4aba048640 1 --2- 172.21.15.55:0/1541950952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ab40cd140 0x7f4ab40c6ce0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800e810 tx=0x7f4aa800ecd0 comp rx=0 tx=0).stop 2023-07-06T21:43:30.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.121+0000 7f4aba048640 1 -- 172.21.15.55:0/1541950952 shutdown_connections 2023-07-06T21:43:30.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.121+0000 7f4aba048640 1 --2- 172.21.15.55:0/1541950952 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4aa0066280 0x7f4aa0068730 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:30.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.121+0000 7f4aba048640 1 --2- 172.21.15.55:0/1541950952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ab4158850 0x7f4ab40c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:30.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.121+0000 7f4aba048640 1 --2- 172.21.15.55:0/1541950952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ab40cd140 0x7f4ab40c6ce0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:30.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.121+0000 7f4aba048640 1 --2- 172.21.15.55:0/1541950952 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ab40ca130 0x7f4ab41f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:30.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.121+0000 7f4aba048640 1 -- 172.21.15.55:0/1541950952 >> 172.21.15.55:0/1541950952 conn(0x7f4ab40cea70 msgr2=0x7f4ab40cc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:30.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.125+0000 7f4aba048640 1 -- 172.21.15.55:0/1541950952 shutdown_connections 2023-07-06T21:43:30.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.125+0000 7f4aba048640 1 -- 172.21.15.55:0/1541950952 wait complete. 2023-07-06T21:43:30.154 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-06T21:43:30.154 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T21:43:30.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd81c5640 1 Processor -- start 2023-07-06T21:43:30.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd81c5640 1 -- start start 2023-07-06T21:43:30.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd81c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfd00709a0 0x7fbfd00cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:30.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd81c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfd00cbe60 0x7fbfd00b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:30.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd81c5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd00cc300 con 0x7fbfd0070d70 2023-07-06T21:43:30.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd81c5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd00cc5e0 con 0x7fbfd00cbe60 2023-07-06T21:43:30.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd81c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00cc8c0 con 0x7fbfd00709a0 2023-07-06T21:43:30.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd5760640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfd00cbe60 0x7fbfd00b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:30.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd5760640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfd00cbe60 0x7fbfd00b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50844/0 (socket says 172.21.15.55:50844) 2023-07-06T21:43:30.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd5760640 1 -- 172.21.15.55:0/2093134797 learned_addr learned my addr 172.21.15.55:0/2093134797 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:30.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd5f61640 1 --2- 172.21.15.55:0/2093134797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfd00709a0 0x7fbfd00cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:30.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd5760640 1 -- 172.21.15.55:0/2093134797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfd00709a0 msgr2=0x7fbfd00cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:30.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd5760640 1 --2- 172.21.15.55:0/2093134797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfd00709a0 0x7fbfd00cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:30.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd5760640 1 -- 172.21.15.55:0/2093134797 >> v1:172.21.15.138:6789/0 conn(0x7fbfd0070d70 legacy=0x7fbfd015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:30.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.297+0000 7fbfd5760640 1 -- 172.21.15.55:0/2093134797 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd00ccba0 con 0x7fbfd00cbe60 2023-07-06T21:43:30.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.301+0000 7fbfd5760640 1 --2- 172.21.15.55:0/2093134797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd00cbe60 0x7fbfd00b0c30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0009870 tx=0x7fbfc001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada6c241879e6abf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:30.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.301+0000 7fbfd4f5f640 1 -- 172.21.15.55:0/2093134797 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc00ab600 con 0x7fbfd00cbe60 2023-07-06T21:43:30.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.301+0000 7fbfd4f5f640 1 -- 172.21.15.55:0/2093134797 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc00a7050 con 0x7fbfd00cbe60 2023-07-06T21:43:30.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.301+0000 7fbfd4f5f640 1 -- 172.21.15.55:0/2093134797 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc00ab980 con 0x7fbfd00cbe60 2023-07-06T21:43:30.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.301+0000 7fbfd81c5640 1 -- 172.21.15.55:0/2093134797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd00cbe60 msgr2=0x7fbfd00b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:30.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.301+0000 7fbfd81c5640 1 --2- 172.21.15.55:0/2093134797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd00cbe60 0x7fbfd00b0c30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0009870 tx=0x7fbfc001c540 comp rx=0 tx=0).stop 2023-07-06T21:43:30.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.301+0000 7fbfd81c5640 1 -- 172.21.15.55:0/2093134797 shutdown_connections 2023-07-06T21:43:30.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.301+0000 7fbfd81c5640 1 --2- 172.21.15.55:0/2093134797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd00cbe60 0x7fbfd00b0c30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:30.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.301+0000 7fbfd81c5640 1 --2- 172.21.15.55:0/2093134797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfd00709a0 0x7fbfd00cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:30.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.301+0000 7fbfd81c5640 1 -- 172.21.15.55:0/2093134797 >> 172.21.15.55:0/2093134797 conn(0x7fbfd00cea70 msgr2=0x7fbfd00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:30.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.301+0000 7fbfd81c5640 1 -- 172.21.15.55:0/2093134797 shutdown_connections 2023-07-06T21:43:30.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.301+0000 7fbfd81c5640 1 -- 172.21.15.55:0/2093134797 wait complete. 2023-07-06T21:43:30.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd81c5640 1 Processor -- start 2023-07-06T21:43:30.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd81c5640 1 -- start start 2023-07-06T21:43:30.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd81c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfd00709a0 0x7fbfd00afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:30.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd81c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd0070d70 0x7fbfd0157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:30.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd81c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfd00cbe60 0x7fbfd0157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:30.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd81c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00adde0 con 0x7fbfd0070d70 2023-07-06T21:43:30.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd81c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00693f0 con 0x7fbfd00709a0 2023-07-06T21:43:30.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd81c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00ae080 con 0x7fbfd00cbe60 2023-07-06T21:43:30.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd5760640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd0070d70 0x7fbfd0157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:30.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd5760640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd0070d70 0x7fbfd0157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50850/0 (socket says 172.21.15.55:50850) 2023-07-06T21:43:30.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd5760640 1 -- 172.21.15.55:0/1287633277 learned_addr learned my addr 172.21.15.55:0/1287633277 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:30.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd5f61640 1 --2- 172.21.15.55:0/1287633277 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfd00709a0 0x7fbfd00afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:30.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd6762640 1 --2- 172.21.15.55:0/1287633277 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfd00cbe60 0x7fbfd0157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:30.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd5760640 1 -- 172.21.15.55:0/1287633277 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfd00cbe60 msgr2=0x7fbfd0157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:30.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd5760640 1 --2- 172.21.15.55:0/1287633277 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfd00cbe60 0x7fbfd0157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:30.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd5760640 1 -- 172.21.15.55:0/1287633277 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfd00709a0 msgr2=0x7fbfd00afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:30.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd5760640 1 --2- 172.21.15.55:0/1287633277 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfd00709a0 0x7fbfd00afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:30.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd5760640 1 -- 172.21.15.55:0/1287633277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc00094d0 con 0x7fbfd0070d70 2023-07-06T21:43:30.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd5760640 1 --2- 172.21.15.55:0/1287633277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd0070d70 0x7fbfd0157a90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbfc001abf0 tx=0x7fbfc00192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:30.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfc67fc640 1 -- 172.21.15.55:0/1287633277 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc00b37d0 con 0x7fbfd0070d70 2023-07-06T21:43:30.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfc67fc640 1 -- 172.21.15.55:0/1287633277 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc00b3930 con 0x7fbfd0070d70 2023-07-06T21:43:30.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfc67fc640 1 -- 172.21.15.55:0/1287633277 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc00b3ce0 con 0x7fbfd0070d70 2023-07-06T21:43:30.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd81c5640 1 -- 172.21.15.55:0/1287633277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd00ae360 con 0x7fbfd0070d70 2023-07-06T21:43:30.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd81c5640 1 -- 172.21.15.55:0/1287633277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd0069970 con 0x7fbfd0070d70 2023-07-06T21:43:30.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.305+0000 7fbfd81c5640 1 -- 172.21.15.55:0/1287633277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd0066d60 con 0x7fbfd0070d70 2023-07-06T21:43:30.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.309+0000 7fbfc67fc640 1 -- 172.21.15.55:0/1287633277 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbfc00b2070 con 0x7fbfd0070d70 2023-07-06T21:43:30.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.309+0000 7fbfc67fc640 1 --2- 172.21.15.55:0/1287633277 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbfb4066280 0x7fbfb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:30.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.309+0000 7fbfc67fc640 1 -- 172.21.15.55:0/1287633277 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbfc011e150 con 0x7fbfd0070d70 2023-07-06T21:43:30.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.309+0000 7fbfd5f61640 1 --2- 172.21.15.55:0/1287633277 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbfb4066280 0x7fbfb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:30.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.309+0000 7fbfd5f61640 1 --2- 172.21.15.55:0/1287633277 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbfb4066280 0x7fbfb4068730 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00aeb50 tx=0x7fbfcc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:30.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.313+0000 7fbfc67fc640 1 -- 172.21.15.55:0/1287633277 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbfc00eb3f0 con 0x7fbfd0070d70 2023-07-06T21:43:30.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:30.501+0000 7fbfd81c5640 1 -- 172.21.15.55:0/1287633277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbfd00cb9c0 con 0x7fbfd0070d70 2023-07-06T21:43:31.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.361+0000 7fbfc67fc640 1 -- 172.21.15.55:0/1287633277 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbfc00eea10 con 0x7fbfd0070d70 2023-07-06T21:43:31.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.361+0000 7fbfd81c5640 1 -- 172.21.15.55:0/1287633277 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbfb4066280 msgr2=0x7fbfb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:31.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.361+0000 7fbfd81c5640 1 --2- 172.21.15.55:0/1287633277 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbfb4066280 0x7fbfb4068730 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00aeb50 tx=0x7fbfcc008040 comp rx=0 tx=0).stop 2023-07-06T21:43:31.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.361+0000 7fbfd81c5640 1 -- 172.21.15.55:0/1287633277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd0070d70 msgr2=0x7fbfd0157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:31.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.361+0000 7fbfd81c5640 1 --2- 172.21.15.55:0/1287633277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd0070d70 0x7fbfd0157a90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbfc001abf0 tx=0x7fbfc00192e0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.361+0000 7fbfd81c5640 1 -- 172.21.15.55:0/1287633277 shutdown_connections 2023-07-06T21:43:31.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.361+0000 7fbfd81c5640 1 --2- 172.21.15.55:0/1287633277 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbfb4066280 0x7fbfb4068730 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.361+0000 7fbfd81c5640 1 --2- 172.21.15.55:0/1287633277 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbfd00cbe60 0x7fbfd0157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.361+0000 7fbfd81c5640 1 --2- 172.21.15.55:0/1287633277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd0070d70 0x7fbfd0157a90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.361+0000 7fbfd81c5640 1 --2- 172.21.15.55:0/1287633277 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfd00709a0 0x7fbfd00afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.361+0000 7fbfd81c5640 1 -- 172.21.15.55:0/1287633277 >> 172.21.15.55:0/1287633277 conn(0x7fbfd00cea70 msgr2=0x7fbfd00c4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:31.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.365+0000 7fbfd81c5640 1 -- 172.21.15.55:0/1287633277 shutdown_connections 2023-07-06T21:43:31.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.365+0000 7fbfd81c5640 1 -- 172.21.15.55:0/1287633277 wait complete. 2023-07-06T21:43:31.394 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T21:43:31.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:43:31.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.533+0000 7ff9d680b640 1 Processor -- start 2023-07-06T21:43:31.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.533+0000 7ff9d680b640 1 -- start start 2023-07-06T21:43:31.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.533+0000 7ff9d680b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9d00712f0 0x7ff9d006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:31.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.533+0000 7ff9d680b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d0159cd0 con 0x7ff9d00b3730 2023-07-06T21:43:31.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.533+0000 7ff9d680b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d00693f0 con 0x7ff9d00ca450 2023-07-06T21:43:31.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.533+0000 7ff9d680b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d006aca0 con 0x7ff9d00712f0 2023-07-06T21:43:31.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9cf7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff9d00b3730 0x7ff9d00c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45064/0 (socket says 172.21.15.55:45064) 2023-07-06T21:43:31.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9cf7fe640 1 -- 172.21.15.55:0/2281450647 learned_addr learned my addr 172.21.15.55:0/2281450647 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:31.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9cffff640 1 --2- 172.21.15.55:0/2281450647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9d00712f0 0x7ff9d006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722140951 0 0) 0x7ff9d0159cd0 con 0x7ff9d00b3730 2023-07-06T21:43:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b8003530 con 0x7ff9d00b3730 2023-07-06T21:43:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888914793 0 0) 0x7ff9d00693f0 con 0x7ff9d00ca450 2023-07-06T21:43:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9d0159cd0 con 0x7ff9d00ca450 2023-07-06T21:43:31.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4092069131 0 0) 0x7ff9b8003530 con 0x7ff9d00b3730 2023-07-06T21:43:31.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9d00712f0 msgr2=0x7ff9d006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:31.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 --2- 172.21.15.55:0/2281450647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9d00712f0 0x7ff9d006a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 >> v1:172.21.15.138:6789/0 conn(0x7ff9d00ca450 legacy=0x7ff9d015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:31.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d00696b0 con 0x7ff9d00b3730 2023-07-06T21:43:31.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7ff9c4001680 con 0x7ff9d00b3730 2023-07-06T21:43:31.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 >> v1:172.21.15.55:6789/0 conn(0x7ff9d00b3730 legacy=0x7ff9d00c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:31.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 --2- 172.21.15.55:0/2281450647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9d00712f0 0x7ff9b8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:31.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 --2- 172.21.15.55:0/2281450647 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9b80040a0 0x7ff9b80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:31.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 --2- 172.21.15.55:0/2281450647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b8004d10 0x7ff9b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:31.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d006aca0 con 0x7ff9b8004d10 2023-07-06T21:43:31.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b800ba40 con 0x7ff9b80040a0 2023-07-06T21:43:31.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b800bc00 con 0x7ff9d00712f0 2023-07-06T21:43:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9cffff640 1 --2- 172.21.15.55:0/2281450647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9d00712f0 0x7ff9b8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9cf7fe640 1 --2- 172.21.15.55:0/2281450647 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9b80040a0 0x7ff9b80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9d4da8640 1 --2- 172.21.15.55:0/2281450647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b8004d10 0x7ff9b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9cffff640 1 -- 172.21.15.55:0/2281450647 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9b80040a0 msgr2=0x7ff9b80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9cffff640 1 --2- 172.21.15.55:0/2281450647 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9b80040a0 0x7ff9b80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9cffff640 1 -- 172.21.15.55:0/2281450647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b8004d10 msgr2=0x7ff9b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9cffff640 1 --2- 172.21.15.55:0/2281450647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b8004d10 0x7ff9b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.537+0000 7ff9cffff640 1 -- 172.21.15.55:0/2281450647 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b8003530 con 0x7ff9d00712f0 2023-07-06T21:43:31.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.541+0000 7ff9cffff640 1 --2- 172.21.15.55:0/2281450647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9d00712f0 0x7ff9b8003b40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009ab0 tx=0x7ff9c001ca70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac91e1088856efc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:31.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.541+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4007ea0 con 0x7ff9d00712f0 2023-07-06T21:43:31.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.541+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c00a5550 con 0x7ff9d00712f0 2023-07-06T21:43:31.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.541+0000 7ff9ceffd640 1 -- 172.21.15.55:0/2281450647 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c00a5940 con 0x7ff9d00712f0 2023-07-06T21:43:31.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.541+0000 7ff9d680b640 1 -- 172.21.15.55:0/2281450647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9d00712f0 msgr2=0x7ff9b8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:31.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.541+0000 7ff9d680b640 1 --2- 172.21.15.55:0/2281450647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9d00712f0 0x7ff9b8003b40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009ab0 tx=0x7ff9c001ca70 comp rx=0 tx=0).stop 2023-07-06T21:43:31.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.541+0000 7ff9d4da8640 1 -- 172.21.15.55:0/2281450647 reap_dead start 2023-07-06T21:43:31.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.541+0000 7ff9d680b640 1 -- 172.21.15.55:0/2281450647 shutdown_connections 2023-07-06T21:43:31.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.541+0000 7ff9d680b640 1 -- 172.21.15.55:0/2281450647 >> 172.21.15.55:0/2281450647 conn(0x7ff9d00cded0 msgr2=0x7ff9d00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:31.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.541+0000 7ff9d680b640 1 -- 172.21.15.55:0/2281450647 shutdown_connections 2023-07-06T21:43:31.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.541+0000 7ff9d680b640 1 -- 172.21.15.55:0/2281450647 wait complete. 2023-07-06T21:43:31.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.541+0000 7ff9d680b640 1 Processor -- start 2023-07-06T21:43:31.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.541+0000 7ff9d680b640 1 -- start start 2023-07-06T21:43:31.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9d680b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9d00712f0 0x7ff9d01f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:31.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9d680b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9d00acf60 0x7ff9d015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:31.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9d680b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9d0159ee0 0x7ff9d0157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:31.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9d680b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d0155ec0 con 0x7ff9d00712f0 2023-07-06T21:43:31.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9d680b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00c1930 con 0x7ff9d00acf60 2023-07-06T21:43:31.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9d680b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00ad3d0 con 0x7ff9d0159ee0 2023-07-06T21:43:31.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9cffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9d00712f0 0x7ff9d01f0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:31.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9cffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9d00712f0 0x7ff9d01f0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50872/0 (socket says 172.21.15.55:50872) 2023-07-06T21:43:31.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9cffff640 1 -- 172.21.15.55:0/1904481856 learned_addr learned my addr 172.21.15.55:0/1904481856 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:31.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9d4da8640 1 --2- 172.21.15.55:0/1904481856 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9d0159ee0 0x7ff9d0157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9cf7fe640 1 --2- 172.21.15.55:0/1904481856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9d00acf60 0x7ff9d015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9cffff640 1 -- 172.21.15.55:0/1904481856 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9d0159ee0 msgr2=0x7ff9d0157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9cffff640 1 --2- 172.21.15.55:0/1904481856 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9d0159ee0 0x7ff9d0157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9cffff640 1 -- 172.21.15.55:0/1904481856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9d00acf60 msgr2=0x7ff9d015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9cffff640 1 --2- 172.21.15.55:0/1904481856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9d00acf60 0x7ff9d015bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9cffff640 1 -- 172.21.15.55:0/1904481856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d015c2d0 con 0x7ff9d00712f0 2023-07-06T21:43:31.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9cffff640 1 --2- 172.21.15.55:0/1904481856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9d00712f0 0x7ff9d01f0eb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff9c001c8a0 tx=0x7ff9b8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:31.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9ccff9640 1 -- 172.21.15.55:0/1904481856 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0004220 con 0x7ff9d00712f0 2023-07-06T21:43:31.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9ccff9640 1 -- 172.21.15.55:0/1904481856 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c0004380 con 0x7ff9d00712f0 2023-07-06T21:43:31.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9ccff9640 1 -- 172.21.15.55:0/1904481856 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0003860 con 0x7ff9d00712f0 2023-07-06T21:43:31.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9d680b640 1 -- 172.21.15.55:0/1904481856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d01f14a0 con 0x7ff9d00712f0 2023-07-06T21:43:31.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9d680b640 1 -- 172.21.15.55:0/1904481856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d01f1a60 con 0x7ff9d00712f0 2023-07-06T21:43:31.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.545+0000 7ff9d680b640 1 -- 172.21.15.55:0/1904481856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d0066d60 con 0x7ff9d00712f0 2023-07-06T21:43:31.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.549+0000 7ff9ccff9640 1 -- 172.21.15.55:0/1904481856 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff9c00b4040 con 0x7ff9d00712f0 2023-07-06T21:43:31.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.549+0000 7ff9ccff9640 1 --2- 172.21.15.55:0/1904481856 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff9bc066280 0x7ff9bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:31.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.549+0000 7ff9ccff9640 1 -- 172.21.15.55:0/1904481856 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff9c011e230 con 0x7ff9d00712f0 2023-07-06T21:43:31.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.549+0000 7ff9cf7fe640 1 --2- 172.21.15.55:0/1904481856 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff9bc066280 0x7ff9bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:31.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.549+0000 7ff9cf7fe640 1 --2- 172.21.15.55:0/1904481856 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff9bc066280 0x7ff9bc068730 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4001060 tx=0x7ff9c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.553+0000 7ff9ccff9640 1 -- 172.21.15.55:0/1904481856 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff9c00eb580 con 0x7ff9d00712f0 2023-07-06T21:43:31.683 INFO:tasks.ceph.mds.a.smithi055.stderr:2023-07-06T21:43:31.673+0000 7f1defd41640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T21:43:31.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.737+0000 7ff9d680b640 1 -- 172.21.15.55:0/1904481856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9d006c380 con 0x7ff9d00712f0 2023-07-06T21:43:31.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.737+0000 7ff9ccff9640 1 -- 172.21.15.55:0/1904481856 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4677 (secure 0 0 0) 0x7ff9c00044f0 con 0x7ff9d00712f0 2023-07-06T21:43:31.746 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:31.746 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2166228749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2166228749},{"type":"v1","addr":"172.21.15.138:6834","nonce":2166228749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3702805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3702805788},{"type":"v1","addr":"172.21.15.138:6835","nonce":3702805788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2574870623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2574870623},{"type":"v1","addr":"172.21.15.55:6836","nonce":2574870623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:43:28.108537+0000","modified":"2023-07-06T21:43:31.358407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1792917100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1792917100},{"type":"v1","addr":"172.21.15.55:6837","nonce":1792917100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T21:43:31.747 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2023-07-06T21:43:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.741+0000 7ff9d680b640 1 -- 172.21.15.55:0/1904481856 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff9bc066280 msgr2=0x7ff9bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.741+0000 7ff9d680b640 1 --2- 172.21.15.55:0/1904481856 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff9bc066280 0x7ff9bc068730 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4001060 tx=0x7ff9c4009040 comp rx=0 tx=0).stop 2023-07-06T21:43:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.741+0000 7ff9d680b640 1 -- 172.21.15.55:0/1904481856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9d00712f0 msgr2=0x7ff9d01f0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.741+0000 7ff9d680b640 1 --2- 172.21.15.55:0/1904481856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9d00712f0 0x7ff9d01f0eb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff9c001c8a0 tx=0x7ff9b8005800 comp rx=0 tx=0).stop 2023-07-06T21:43:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.741+0000 7ff9d680b640 1 -- 172.21.15.55:0/1904481856 shutdown_connections 2023-07-06T21:43:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.741+0000 7ff9d680b640 1 --2- 172.21.15.55:0/1904481856 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff9bc066280 0x7ff9bc068730 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.741+0000 7ff9d680b640 1 --2- 172.21.15.55:0/1904481856 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9d0159ee0 0x7ff9d0157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.741+0000 7ff9d680b640 1 --2- 172.21.15.55:0/1904481856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9d00acf60 0x7ff9d015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.741+0000 7ff9d680b640 1 --2- 172.21.15.55:0/1904481856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9d00712f0 0x7ff9d01f0eb0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.741+0000 7ff9d680b640 1 -- 172.21.15.55:0/1904481856 >> 172.21.15.55:0/1904481856 conn(0x7ff9d00cded0 msgr2=0x7ff9d00c95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.741+0000 7ff9d680b640 1 -- 172.21.15.55:0/1904481856 shutdown_connections 2023-07-06T21:43:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.741+0000 7ff9d680b640 1 -- 172.21.15.55:0/1904481856 wait complete. 2023-07-06T21:43:31.767 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:43:31.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4db0dd2640 1 Processor -- start 2023-07-06T21:43:31.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4db0dd2640 1 -- start start 2023-07-06T21:43:31.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4db0dd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4dac0ce610 0x7f4dac0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:31.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4db0dd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dac0b1e10 0x7f4dac15f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:31.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4db0dd2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dac0b2290 con 0x7f4dac0b7cd0 2023-07-06T21:43:31.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4db0dd2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac0d2310 con 0x7f4dac0ce610 2023-07-06T21:43:31.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4db0dd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac0b80a0 con 0x7f4dac0b1e10 2023-07-06T21:43:31.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4da3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4dac0ce610 0x7f4dac0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:31.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4da3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4dac0ce610 0x7f4dac0b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50882/0 (socket says 172.21.15.55:50882) 2023-07-06T21:43:31.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4da3fff640 1 -- 172.21.15.55:0/2926512399 learned_addr learned my addr 172.21.15.55:0/2926512399 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:31.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4daad9d640 1 --2- 172.21.15.55:0/2926512399 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dac0b1e10 0x7f4dac15f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:31.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4da3fff640 1 -- 172.21.15.55:0/2926512399 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dac0b1e10 msgr2=0x7f4dac15f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:31.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4da3fff640 1 --2- 172.21.15.55:0/2926512399 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dac0b1e10 0x7f4dac15f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4da3fff640 1 -- 172.21.15.55:0/2926512399 >> v1:172.21.15.138:6789/0 conn(0x7f4dac0b7cd0 legacy=0x7f4dac0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:31.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4da3fff640 1 -- 172.21.15.55:0/2926512399 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac0cd1c0 con 0x7f4dac0ce610 2023-07-06T21:43:31.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.901+0000 7f4da9d9b640 1 -- 172.21.15.55:0/2926512399 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224138014 0 0) 0x7f4dac0b2290 con 0x7f4dac0b7cd0 2023-07-06T21:43:31.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.905+0000 7f4da3fff640 1 --2- 172.21.15.55:0/2926512399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dac0ce610 0x7f4dac0b18d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009870 tx=0x7f4d9401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf62148022dad236 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:31.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.905+0000 7f4da9d9b640 1 -- 172.21.15.55:0/2926512399 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940ab600 con 0x7f4dac0ce610 2023-07-06T21:43:31.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.905+0000 7f4da9d9b640 1 -- 172.21.15.55:0/2926512399 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d940a7050 con 0x7f4dac0ce610 2023-07-06T21:43:31.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.905+0000 7f4da9d9b640 1 -- 172.21.15.55:0/2926512399 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940ab980 con 0x7f4dac0ce610 2023-07-06T21:43:31.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.905+0000 7f4db0dd2640 1 -- 172.21.15.55:0/2926512399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dac0ce610 msgr2=0x7f4dac0b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:31.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.905+0000 7f4db0dd2640 1 --2- 172.21.15.55:0/2926512399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dac0ce610 0x7f4dac0b18d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009870 tx=0x7f4d9401c4b0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.905+0000 7f4db0dd2640 1 -- 172.21.15.55:0/2926512399 shutdown_connections 2023-07-06T21:43:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.905+0000 7f4db0dd2640 1 --2- 172.21.15.55:0/2926512399 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dac0b1e10 0x7f4dac15f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.905+0000 7f4db0dd2640 1 --2- 172.21.15.55:0/2926512399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dac0ce610 0x7f4dac0b18d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.905+0000 7f4db0dd2640 1 -- 172.21.15.55:0/2926512399 >> 172.21.15.55:0/2926512399 conn(0x7f4dac0ceee0 msgr2=0x7f4dac0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.905+0000 7f4db0dd2640 1 -- 172.21.15.55:0/2926512399 shutdown_connections 2023-07-06T21:43:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.905+0000 7f4db0dd2640 1 -- 172.21.15.55:0/2926512399 wait complete. 2023-07-06T21:43:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4db0dd2640 1 Processor -- start 2023-07-06T21:43:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4db0dd2640 1 -- start start 2023-07-06T21:43:31.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4db0dd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dac0b1e10 0x7f4dac15c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:31.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4db0dd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dac0b7cd0 0x7f4dac0c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:31.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4db0dd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dac0ce610 0x7f4dac158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:31.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4db0dd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac150fa0 con 0x7f4dac0b7cd0 2023-07-06T21:43:31.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4db0dd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac151280 con 0x7f4dac0b1e10 2023-07-06T21:43:31.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4db0dd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac151560 con 0x7f4dac0ce610 2023-07-06T21:43:31.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4da3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dac0b7cd0 0x7f4dac0c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:31.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4da3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dac0b7cd0 0x7f4dac0c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50890/0 (socket says 172.21.15.55:50890) 2023-07-06T21:43:31.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4da3fff640 1 -- 172.21.15.55:0/3736659187 learned_addr learned my addr 172.21.15.55:0/3736659187 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:31.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4daa59c640 1 --2- 172.21.15.55:0/3736659187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dac0b1e10 0x7f4dac15c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:31.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4daad9d640 1 --2- 172.21.15.55:0/3736659187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dac0ce610 0x7f4dac158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:31.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4da3fff640 1 -- 172.21.15.55:0/3736659187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dac0ce610 msgr2=0x7f4dac158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:31.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4da3fff640 1 --2- 172.21.15.55:0/3736659187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dac0ce610 0x7f4dac158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4da3fff640 1 -- 172.21.15.55:0/3736659187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dac0b1e10 msgr2=0x7f4dac15c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:31.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4da3fff640 1 --2- 172.21.15.55:0/3736659187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dac0b1e10 0x7f4dac15c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:31.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4da3fff640 1 -- 172.21.15.55:0/3736659187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d940094d0 con 0x7f4dac0b7cd0 2023-07-06T21:43:31.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4da3fff640 1 --2- 172.21.15.55:0/3736659187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dac0b7cd0 0x7f4dac0c5f90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4d940ae040 tx=0x7f4d94019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:31.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4da2ffd640 1 -- 172.21.15.55:0/3736659187 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940b4440 con 0x7f4dac0b7cd0 2023-07-06T21:43:31.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4da2ffd640 1 -- 172.21.15.55:0/3736659187 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d940b45a0 con 0x7f4dac0b7cd0 2023-07-06T21:43:31.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4da2ffd640 1 -- 172.21.15.55:0/3736659187 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940b4950 con 0x7f4dac0b7cd0 2023-07-06T21:43:31.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4db0dd2640 1 -- 172.21.15.55:0/3736659187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dac0c7bb0 con 0x7f4dac0b7cd0 2023-07-06T21:43:31.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.909+0000 7f4db0dd2640 1 -- 172.21.15.55:0/3736659187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac15ce30 con 0x7f4dac0b7cd0 2023-07-06T21:43:31.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.913+0000 7f4db0dd2640 1 -- 172.21.15.55:0/3736659187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dac0c7a10 con 0x7f4dac0b7cd0 2023-07-06T21:43:31.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.913+0000 7f4da2ffd640 1 -- 172.21.15.55:0/3736659187 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4d940b2070 con 0x7f4dac0b7cd0 2023-07-06T21:43:31.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.913+0000 7f4da2ffd640 1 --2- 172.21.15.55:0/3736659187 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4d8c066280 0x7f4d8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:31.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.913+0000 7f4da2ffd640 1 -- 172.21.15.55:0/3736659187 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4d9411dc00 con 0x7f4dac0b7cd0 2023-07-06T21:43:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.913+0000 7f4daa59c640 1 --2- 172.21.15.55:0/3736659187 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4d8c066280 0x7f4d8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.917+0000 7f4daa59c640 1 --2- 172.21.15.55:0/3736659187 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4d8c066280 0x7f4d8c068730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c007fd0 tx=0x7f4d9c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:31.917+0000 7f4da2ffd640 1 -- 172.21.15.55:0/3736659187 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4dac0c7a10 con 0x7f4dac0b7cd0 2023-07-06T21:43:32.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.073+0000 7f4db0dd2640 1 -- 172.21.15.55:0/3736659187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dac0c7a10 con 0x7f4dac0b7cd0 2023-07-06T21:43:32.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.077+0000 7f4da2ffd640 1 -- 172.21.15.55:0/3736659187 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18488 (secure 0 0 0) 0x7f4dac0c7a10 con 0x7f4dac0b7cd0 2023-07-06T21:43:32.085 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:32.086 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":42,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:43:29.111834+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:43:26.444989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-06T21:43:27.092120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:43:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.077+0000 7f4db0dd2640 1 -- 172.21.15.55:0/3736659187 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4d8c066280 msgr2=0x7f4d8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.077+0000 7f4db0dd2640 1 --2- 172.21.15.55:0/3736659187 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4d8c066280 0x7f4d8c068730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c007fd0 tx=0x7f4d9c009040 comp rx=0 tx=0).stop 2023-07-06T21:43:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.077+0000 7f4db0dd2640 1 -- 172.21.15.55:0/3736659187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dac0b7cd0 msgr2=0x7f4dac0c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.077+0000 7f4db0dd2640 1 --2- 172.21.15.55:0/3736659187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dac0b7cd0 0x7f4dac0c5f90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4d940ae040 tx=0x7f4d94019250 comp rx=0 tx=0).stop 2023-07-06T21:43:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.077+0000 7f4db0dd2640 1 -- 172.21.15.55:0/3736659187 shutdown_connections 2023-07-06T21:43:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.077+0000 7f4db0dd2640 1 --2- 172.21.15.55:0/3736659187 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f4d8c066280 0x7f4d8c068730 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.077+0000 7f4db0dd2640 1 --2- 172.21.15.55:0/3736659187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dac0ce610 0x7f4dac158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.077+0000 7f4db0dd2640 1 --2- 172.21.15.55:0/3736659187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dac0b7cd0 0x7f4dac0c5f90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.077+0000 7f4db0dd2640 1 --2- 172.21.15.55:0/3736659187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dac0b1e10 0x7f4dac15c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.077+0000 7f4db0dd2640 1 -- 172.21.15.55:0/3736659187 >> 172.21.15.55:0/3736659187 conn(0x7f4dac0ceee0 msgr2=0x7f4dac06a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.077+0000 7f4db0dd2640 1 -- 172.21.15.55:0/3736659187 shutdown_connections 2023-07-06T21:43:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.077+0000 7f4db0dd2640 1 -- 172.21.15.55:0/3736659187 wait complete. 2023-07-06T21:43:32.105 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T21:43:32.106 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:43:32.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5fb9a3640 1 Processor -- start 2023-07-06T21:43:32.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5fb9a3640 1 -- start start 2023-07-06T21:43:32.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5fb9a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5f406f520 0x7fb5f40cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:32.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5fb9a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f406fae0 con 0x7fb5f41587d0 2023-07-06T21:43:32.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5fb9a3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f406fdc0 con 0x7fb5f4158400 2023-07-06T21:43:32.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5fb9a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f40700a0 con 0x7fb5f406f520 2023-07-06T21:43:32.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5f8f3e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb5f41587d0 0x7fb5f4070b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45074/0 (socket says 172.21.15.55:45074) 2023-07-06T21:43:32.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5f8f3e640 1 -- 172.21.15.55:0/2643112932 learned_addr learned my addr 172.21.15.55:0/2643112932 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:32.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5f9f40640 1 --2- 172.21.15.55:0/2643112932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5f406f520 0x7fb5f40cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:32.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5ebfff640 1 -- 172.21.15.55:0/2643112932 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182089845 0 0) 0x7fb5f406fae0 con 0x7fb5f41587d0 2023-07-06T21:43:32.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5ebfff640 1 -- 172.21.15.55:0/2643112932 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5e0005740 con 0x7fb5f41587d0 2023-07-06T21:43:32.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5ebfff640 1 -- 172.21.15.55:0/2643112932 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258419229 0 0) 0x7fb5f406fdc0 con 0x7fb5f4158400 2023-07-06T21:43:32.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5ebfff640 1 -- 172.21.15.55:0/2643112932 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5f406fae0 con 0x7fb5f4158400 2023-07-06T21:43:32.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5f9f40640 1 -- 172.21.15.55:0/2643112932 >> v1:172.21.15.138:6789/0 conn(0x7fb5f4158400 legacy=0x7fb5f40c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5ebfff640 1 -- 172.21.15.55:0/2643112932 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1056074405 0 0) 0x7fb5e0005740 con 0x7fb5f41587d0 2023-07-06T21:43:32.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5f9f40640 1 -- 172.21.15.55:0/2643112932 >> v1:172.21.15.55:6789/0 conn(0x7fb5f41587d0 legacy=0x7fb5f4070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.241+0000 7fb5f9f40640 1 -- 172.21.15.55:0/2643112932 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f4070380 con 0x7fb5f406f520 2023-07-06T21:43:32.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.245+0000 7fb5f9f40640 1 --2- 172.21.15.55:0/2643112932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5f406f520 0x7fb5f40cbaa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec009dc0 tx=0x7fb5ec01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a0a7550e110c5f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.245+0000 7fb5ebfff640 1 -- 172.21.15.55:0/2643112932 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4001680 con 0x7fb5f406f520 2023-07-06T21:43:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.245+0000 7fb5ebfff640 1 -- 172.21.15.55:0/2643112932 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec0a64e0 con 0x7fb5f406f520 2023-07-06T21:43:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.245+0000 7fb5ebfff640 1 -- 172.21.15.55:0/2643112932 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0a6870 con 0x7fb5f406f520 2023-07-06T21:43:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.245+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/2643112932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5f406f520 msgr2=0x7fb5f40cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.245+0000 7fb5fb9a3640 1 --2- 172.21.15.55:0/2643112932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5f406f520 0x7fb5f40cbaa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec009dc0 tx=0x7fb5ec01c890 comp rx=0 tx=0).stop 2023-07-06T21:43:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.245+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/2643112932 shutdown_connections 2023-07-06T21:43:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.245+0000 7fb5fb9a3640 1 --2- 172.21.15.55:0/2643112932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5f406f520 0x7fb5f40cbaa0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.245+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/2643112932 >> 172.21.15.55:0/2643112932 conn(0x7fb5f40cded0 msgr2=0x7fb5f40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:32.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.245+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/2643112932 shutdown_connections 2023-07-06T21:43:32.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.245+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/2643112932 wait complete. 2023-07-06T21:43:32.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5fb9a3640 1 Processor -- start 2023-07-06T21:43:32.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5fb9a3640 1 -- start start 2023-07-06T21:43:32.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5fb9a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5f406f520 0x7fb5f414d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:32.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5fb9a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f4158400 0x7fb5f4150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:32.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5fb9a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5f41587d0 0x7fb5f41549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:32.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5fb9a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f414dfe0 con 0x7fb5f4158400 2023-07-06T21:43:32.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5fb9a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f40b2df0 con 0x7fb5f406f520 2023-07-06T21:43:32.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5fb9a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f414d5b0 con 0x7fb5f41587d0 2023-07-06T21:43:32.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5f8f3e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f4158400 0x7fb5f4150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:32.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5f8f3e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f4158400 0x7fb5f4150bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50898/0 (socket says 172.21.15.55:50898) 2023-07-06T21:43:32.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5f8f3e640 1 -- 172.21.15.55:0/103266089 learned_addr learned my addr 172.21.15.55:0/103266089 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:32.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5f973f640 1 --2- 172.21.15.55:0/103266089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5f406f520 0x7fb5f414d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:32.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5f9f40640 1 --2- 172.21.15.55:0/103266089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5f41587d0 0x7fb5f41549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5f8f3e640 1 -- 172.21.15.55:0/103266089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5f41587d0 msgr2=0x7fb5f41549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5f8f3e640 1 --2- 172.21.15.55:0/103266089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5f41587d0 0x7fb5f41549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5f8f3e640 1 -- 172.21.15.55:0/103266089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5f406f520 msgr2=0x7fb5f414d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5f8f3e640 1 --2- 172.21.15.55:0/103266089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5f406f520 0x7fb5f414d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5f8f3e640 1 -- 172.21.15.55:0/103266089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec009a70 con 0x7fb5f4158400 2023-07-06T21:43:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5f8f3e640 1 --2- 172.21.15.55:0/103266089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f4158400 0x7fb5f4150bf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4001ec0 tx=0x7fb5e400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5e9ffb640 1 -- 172.21.15.55:0/103266089 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4005ae0 con 0x7fb5f4158400 2023-07-06T21:43:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5e9ffb640 1 -- 172.21.15.55:0/103266089 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e4005c40 con 0x7fb5f4158400 2023-07-06T21:43:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/103266089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f40b1f00 con 0x7fb5f4158400 2023-07-06T21:43:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.249+0000 7fb5e9ffb640 1 -- 172.21.15.55:0/103266089 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4007070 con 0x7fb5f4158400 2023-07-06T21:43:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.253+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/103266089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f40b24c0 con 0x7fb5f4158400 2023-07-06T21:43:32.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.253+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/103266089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f406c580 con 0x7fb5f4158400 2023-07-06T21:43:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.253+0000 7fb5e9ffb640 1 -- 172.21.15.55:0/103266089 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb5e40071d0 con 0x7fb5f4158400 2023-07-06T21:43:32.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.253+0000 7fb5e9ffb640 1 --2- 172.21.15.55:0/103266089 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb5d80662b0 0x7fb5d8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.253+0000 7fb5e9ffb640 1 -- 172.21.15.55:0/103266089 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb5e4083a90 con 0x7fb5f4158400 2023-07-06T21:43:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.253+0000 7fb5f973f640 1 --2- 172.21.15.55:0/103266089 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb5d80662b0 0x7fb5d8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:32.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.253+0000 7fb5f973f640 1 --2- 172.21.15.55:0/103266089 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb5d80662b0 0x7fb5d8068760 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00011f0 tx=0x7fb5f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:32.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.257+0000 7fb5e9ffb640 1 -- 172.21.15.55:0/103266089 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb5e4050df0 con 0x7fb5f4158400 2023-07-06T21:43:32.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.409+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/103266089 --> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5f4066d60 con 0x7fb5d80662b0 2023-07-06T21:43:32.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.417+0000 7fb5e9ffb640 1 -- 172.21.15.55:0/103266089 <== mgr.4101 v2:172.21.15.55:6832/1575998409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298952 (secure 0 0 0) 0x7fb5f4066d60 con 0x7fb5d80662b0 2023-07-06T21:43:32.430 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:32.432 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:43:32.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.421+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/103266089 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb5d80662b0 msgr2=0x7fb5d8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.421+0000 7fb5fb9a3640 1 --2- 172.21.15.55:0/103266089 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb5d80662b0 0x7fb5d8068760 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00011f0 tx=0x7fb5f0009040 comp rx=0 tx=0).stop 2023-07-06T21:43:32.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.421+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/103266089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f4158400 msgr2=0x7fb5f4150bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.421+0000 7fb5fb9a3640 1 --2- 172.21.15.55:0/103266089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f4158400 0x7fb5f4150bf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4001ec0 tx=0x7fb5e400cbe0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.421+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/103266089 shutdown_connections 2023-07-06T21:43:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.421+0000 7fb5fb9a3640 1 --2- 172.21.15.55:0/103266089 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb5d80662b0 0x7fb5d8068760 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.421+0000 7fb5fb9a3640 1 --2- 172.21.15.55:0/103266089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5f41587d0 0x7fb5f41549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.421+0000 7fb5fb9a3640 1 --2- 172.21.15.55:0/103266089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f4158400 0x7fb5f4150bf0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.421+0000 7fb5fb9a3640 1 --2- 172.21.15.55:0/103266089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5f406f520 0x7fb5f414d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.421+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/103266089 >> 172.21.15.55:0/103266089 conn(0x7fb5f40cded0 msgr2=0x7fb5f40ae770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:32.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.421+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/103266089 shutdown_connections 2023-07-06T21:43:32.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.421+0000 7fb5fb9a3640 1 -- 172.21.15.55:0/103266089 wait complete. 2023-07-06T21:43:32.449 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-07-06T21:43:31.660353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236672,"kb_used_data":4672,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738048,"statfs":{"total":773094113280,"available":772851761152,"internally_reserved":0,"allocated":4784128,"data_stored":2758018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.963760"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.699848+0000","last_change":"2023-07-06T21:43:26.699848+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.699848+0000","last_undegraded":"2023-07-06T21:43:26.699848+0000","last_fullsized":"2023-07-06T21:43:26.699848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702735+0000","last_change":"2023-07-06T21:43:26.702735+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702735+0000","last_undegraded":"2023-07-06T21:43:26.702735+0000","last_fullsized":"2023-07-06T21:43:26.702735+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.705671+0000","last_change":"2023-07-06T21:43:26.705671+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.705671+0000","last_undegraded":"2023-07-06T21:43:26.705671+0000","last_fullsized":"2023-07-06T21:43:26.705671+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700832+0000","last_change":"2023-07-06T21:43:26.700832+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700832+0000","last_undegraded":"2023-07-06T21:43:26.700832+0000","last_fullsized":"2023-07-06T21:43:26.700832+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.699836+0000","last_change":"2023-07-06T21:43:26.699836+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.699836+0000","last_undegraded":"2023-07-06T21:43:26.699836+0000","last_fullsized":"2023-07-06T21:43:26.699836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702665+0000","last_change":"2023-07-06T21:43:26.702665+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702665+0000","last_undegraded":"2023-07-06T21:43:26.702665+0000","last_fullsized":"2023-07-06T21:43:26.702665+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704385+0000","last_change":"2023-07-06T21:43:26.704385+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704385+0000","last_undegraded":"2023-07-06T21:43:26.704385+0000","last_fullsized":"2023-07-06T21:43:26.704385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702285+0000","last_change":"2023-07-06T21:43:26.702285+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702285+0000","last_undegraded":"2023-07-06T21:43:26.702285+0000","last_fullsized":"2023-07-06T21:43:26.702285+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702225+0000","last_change":"2023-07-06T21:43:26.702225+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702225+0000","last_undegraded":"2023-07-06T21:43:26.702225+0000","last_fullsized":"2023-07-06T21:43:26.702225+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701377+0000","last_change":"2023-07-06T21:43:26.701377+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701377+0000","last_undegraded":"2023-07-06T21:43:26.701377+0000","last_fullsized":"2023-07-06T21:43:26.701377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701422+0000","last_change":"2023-07-06T21:43:26.701422+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701422+0000","last_undegraded":"2023-07-06T21:43:26.701422+0000","last_fullsized":"2023-07-06T21:43:26.701422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704143+0000","last_change":"2023-07-06T21:43:26.704143+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704143+0000","last_undegraded":"2023-07-06T21:43:26.704143+0000","last_fullsized":"2023-07-06T21:43:26.704143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.699386+0000","last_change":"2023-07-06T21:43:26.699386+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.699386+0000","last_undegraded":"2023-07-06T21:43:26.699386+0000","last_fullsized":"2023-07-06T21:43:26.699386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700793+0000","last_change":"2023-07-06T21:43:26.700793+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700793+0000","last_undegraded":"2023-07-06T21:43:26.700793+0000","last_fullsized":"2023-07-06T21:43:26.700793+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.698875+0000","last_change":"2023-07-06T21:43:26.698875+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.698875+0000","last_undegraded":"2023-07-06T21:43:26.698875+0000","last_fullsized":"2023-07-06T21:43:26.698875+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701863+0000","last_change":"2023-07-06T21:43:26.701863+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701863+0000","last_undegraded":"2023-07-06T21:43:26.701863+0000","last_fullsized":"2023-07-06T21:43:26.701863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.703902+0000","last_change":"2023-07-06T21:43:26.703902+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.703902+0000","last_undegraded":"2023-07-06T21:43:26.703902+0000","last_fullsized":"2023-07-06T21:43:26.703902+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702212+0000","last_change":"2023-07-06T21:43:26.702212+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702212+0000","last_undegraded":"2023-07-06T21:43:26.702212+0000","last_fullsized":"2023-07-06T21:43:26.702212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704332+0000","last_change":"2023-07-06T21:43:26.704332+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704332+0000","last_undegraded":"2023-07-06T21:43:26.704332+0000","last_fullsized":"2023-07-06T21:43:26.704332+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.698854+0000","last_change":"2023-07-06T21:43:26.698854+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.698854+0000","last_undegraded":"2023-07-06T21:43:26.698854+0000","last_fullsized":"2023-07-06T21:43:26.698854+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.698833+0000","last_change":"2023-07-06T21:43:26.698833+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.698833+0000","last_undegraded":"2023-07-06T21:43:26.698833+0000","last_fullsized":"2023-07-06T21:43:26.698833+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704652+0000","last_change":"2023-07-06T21:43:26.704652+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704652+0000","last_undegraded":"2023-07-06T21:43:26.704652+0000","last_fullsized":"2023-07-06T21:43:26.704652+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701346+0000","last_change":"2023-07-06T21:43:26.701346+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701346+0000","last_undegraded":"2023-07-06T21:43:26.701346+0000","last_fullsized":"2023-07-06T21:43:26.701346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700758+0000","last_change":"2023-07-06T21:43:26.700758+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700758+0000","last_undegraded":"2023-07-06T21:43:26.700758+0000","last_fullsized":"2023-07-06T21:43:26.700758+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700883+0000","last_change":"2023-07-06T21:43:26.700883+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700883+0000","last_undegraded":"2023-07-06T21:43:26.700883+0000","last_fullsized":"2023-07-06T21:43:26.700883+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.699719+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:43:26.699719+0000","last_peered":"2023-07-06T21:43:26.699719+0000","last_clean":"2023-07-06T21:43:26.699719+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:43:26.699719+0000","last_undegraded":"2023-07-06T21:43:26.699719+0000","last_fullsized":"2023-07-06T21:43:26.699719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:09:46.423161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702066+0000","last_change":"2023-07-06T21:43:26.702066+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702066+0000","last_undegraded":"2023-07-06T21:43:26.702066+0000","last_fullsized":"2023-07-06T21:43:26.702066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.706503+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:43:26.706503+0000","last_peered":"2023-07-06T21:43:26.706503+0000","last_clean":"2023-07-06T21:43:26.706503+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:43:26.706503+0000","last_undegraded":"2023-07-06T21:43:26.706503+0000","last_fullsized":"2023-07-06T21:43:26.706503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:18:38.165250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.705591+0000","last_change":"2023-07-06T21:43:26.705591+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.705591+0000","last_undegraded":"2023-07-06T21:43:26.705591+0000","last_fullsized":"2023-07-06T21:43:26.705591+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.703294+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:43:26.703294+0000","last_peered":"2023-07-06T21:43:26.703294+0000","last_clean":"2023-07-06T21:43:26.703294+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:43:26.703294+0000","last_undegraded":"2023-07-06T21:43:26.703294+0000","last_fullsized":"2023-07-06T21:43:26.703294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:59:59.983232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701331+0000","last_change":"2023-07-06T21:43:26.701331+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701331+0000","last_undegraded":"2023-07-06T21:43:26.701331+0000","last_fullsized":"2023-07-06T21:43:26.701331+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.706435+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:43:26.706435+0000","last_peered":"2023-07-06T21:43:26.706435+0000","last_clean":"2023-07-06T21:43:26.706435+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:43:26.706435+0000","last_undegraded":"2023-07-06T21:43:26.706435+0000","last_fullsized":"2023-07-06T21:43:26.706435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:10:49.833853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.698885+0000","last_change":"2023-07-06T21:43:26.698885+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.698885+0000","last_undegraded":"2023-07-06T21:43:26.698885+0000","last_fullsized":"2023-07-06T21:43:26.698885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.705504+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:43:26.705504+0000","last_peered":"2023-07-06T21:43:26.705504+0000","last_clean":"2023-07-06T21:43:26.705504+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:43:26.705504+0000","last_undegraded":"2023-07-06T21:43:26.705504+0000","last_fullsized":"2023-07-06T21:43:26.705504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:54:03.674314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700868+0000","last_change":"2023-07-06T21:43:26.700868+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700868+0000","last_undegraded":"2023-07-06T21:43:26.700868+0000","last_fullsized":"2023-07-06T21:43:26.700868+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.703722+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:43:26.703722+0000","last_peered":"2023-07-06T21:43:26.703722+0000","last_clean":"2023-07-06T21:43:26.703722+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:43:26.703722+0000","last_undegraded":"2023-07-06T21:43:26.703722+0000","last_fullsized":"2023-07-06T21:43:26.703722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:17:31.580212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.705834+0000","last_change":"2023-07-06T21:43:26.705834+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.705834+0000","last_undegraded":"2023-07-06T21:43:26.705834+0000","last_fullsized":"2023-07-06T21:43:26.705834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.702300+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:43:26.702300+0000","last_peered":"2023-07-06T21:43:26.702300+0000","last_clean":"2023-07-06T21:43:26.702300+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:43:26.702300+0000","last_undegraded":"2023-07-06T21:43:26.702300+0000","last_fullsized":"2023-07-06T21:43:26.702300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:28:54.724929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704386+0000","last_change":"2023-07-06T21:43:26.704386+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704386+0000","last_undegraded":"2023-07-06T21:43:26.704386+0000","last_fullsized":"2023-07-06T21:43:26.704386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.705478+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:43:26.705478+0000","last_peered":"2023-07-06T21:43:26.705478+0000","last_clean":"2023-07-06T21:43:26.705478+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:43:26.705478+0000","last_undegraded":"2023-07-06T21:43:26.705478+0000","last_fullsized":"2023-07-06T21:43:26.705478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:11:25.152837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.702441+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:43:26.702441+0000","last_peered":"2023-07-06T21:43:26.702441+0000","last_clean":"2023-07-06T21:43:26.702441+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:43:26.702441+0000","last_undegraded":"2023-07-06T21:43:26.702441+0000","last_fullsized":"2023-07-06T21:43:26.702441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:06:07.766504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":1044480,"data_stored":787783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78500000000000003}]},{"osd":2,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.747},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.629},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.65500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":196396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.753}]},{"osd":2,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.63},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.59899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.71799999999999997}]},{"osd":1,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.73199999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.62}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.623}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.73899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.754}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.054}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.371},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.496}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":1040384,"data_stored":786764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.31},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.623},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:43:32.458 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:43:32.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2e2a5c640 1 Processor -- start 2023-07-06T21:43:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2e2a5c640 1 -- start start 2023-07-06T21:43:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2e2a5c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb2dc0b7cd0 0x7fb2dc0ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2e2a5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2dc0ccab0 0x7fb2dc0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2e2a5c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2dc0cecf0 con 0x7fb2dc0ccf00 2023-07-06T21:43:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2e2a5c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2dc0d2310 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2e2a5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc0b80a0 con 0x7fb2dc0ccab0 2023-07-06T21:43:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2dbfff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb2dc0b7cd0 0x7fb2dc0ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2db7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2dc0ccab0 0x7fb2dc0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2dbfff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb2dc0b7cd0 0x7fb2dc0ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:56848/0 (socket says 172.21.15.55:56848) 2023-07-06T21:43:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2dbfff640 1 -- 172.21.15.55:0/3023041488 learned_addr learned my addr 172.21.15.55:0/3023041488 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2dbfff640 1 -- 172.21.15.55:0/3023041488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2dc0ccab0 msgr2=0x7fb2dc0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2dbfff640 1 --2- 172.21.15.55:0/3023041488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2dc0ccab0 0x7fb2dc0b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2dbfff640 1 -- 172.21.15.55:0/3023041488 >> v1:172.21.15.138:6789/0 conn(0x7fb2dc0ccf00 legacy=0x7fb2dc0b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2dbfff640 1 -- 172.21.15.55:0/3023041488 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc0d1d90 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.625+0000 7fb2daffd640 1 -- 172.21.15.55:0/3023041488 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355072187 0 0) 0x7fb2dc0cecf0 con 0x7fb2dc0ccf00 2023-07-06T21:43:32.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.629+0000 7fb2dbfff640 1 --2- 172.21.15.55:0/3023041488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2dc0b7cd0 0x7fb2dc0ce610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009870 tx=0x7fb2cc01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921c98aede681101 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:32.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.629+0000 7fb2daffd640 1 -- 172.21.15.55:0/3023041488 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0ab600 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.629+0000 7fb2daffd640 1 -- 172.21.15.55:0/3023041488 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc0a7050 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.629+0000 7fb2daffd640 1 -- 172.21.15.55:0/3023041488 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0ab980 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.629+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/3023041488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2dc0b7cd0 msgr2=0x7fb2dc0ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.629+0000 7fb2e2a5c640 1 --2- 172.21.15.55:0/3023041488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2dc0b7cd0 0x7fb2dc0ce610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009870 tx=0x7fb2cc01c4b0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.629+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/3023041488 shutdown_connections 2023-07-06T21:43:32.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.629+0000 7fb2e2a5c640 1 --2- 172.21.15.55:0/3023041488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2dc0ccab0 0x7fb2dc0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.629+0000 7fb2e2a5c640 1 --2- 172.21.15.55:0/3023041488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2dc0b7cd0 0x7fb2dc0ce610 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.629+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/3023041488 >> 172.21.15.55:0/3023041488 conn(0x7fb2dc0ceee0 msgr2=0x7fb2dc0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:32.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.629+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/3023041488 shutdown_connections 2023-07-06T21:43:32.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.629+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/3023041488 wait complete. 2023-07-06T21:43:32.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2e2a5c640 1 Processor -- start 2023-07-06T21:43:32.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2e2a5c640 1 -- start start 2023-07-06T21:43:32.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2e2a5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2dc0b7cd0 0x7fb2dc14f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2e2a5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2dc0ccab0 0x7fb2dc14f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2e2a5c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2dc0ccf00 0x7fb2dc159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2e2a5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc1529b0 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2e2a5c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc153430 con 0x7fb2dc0ccf00 2023-07-06T21:43:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2e2a5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc150700 con 0x7fb2dc0ccab0 2023-07-06T21:43:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2dc0b7cd0 0x7fb2dc14f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2dc0b7cd0 0x7fb2dc14f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50900/0 (socket says 172.21.15.55:50900) 2023-07-06T21:43:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2dbfff640 1 -- 172.21.15.55:0/2705733663 learned_addr learned my addr 172.21.15.55:0/2705733663 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2e0ff9640 1 --2- 172.21.15.55:0/2705733663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2dc0ccf00 0x7fb2dc159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2db7fe640 1 --2- 172.21.15.55:0/2705733663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2dc0ccab0 0x7fb2dc14f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2dbfff640 1 -- 172.21.15.55:0/2705733663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2dc0ccab0 msgr2=0x7fb2dc14f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2dbfff640 1 --2- 172.21.15.55:0/2705733663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2dc0ccab0 0x7fb2dc14f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2dbfff640 1 -- 172.21.15.55:0/2705733663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2dc0ccf00 msgr2=0x7fb2dc159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2dbfff640 1 --2- 172.21.15.55:0/2705733663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2dc0ccf00 0x7fb2dc159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2dbfff640 1 -- 172.21.15.55:0/2705733663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc0094d0 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2dbfff640 1 --2- 172.21.15.55:0/2705733663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2dc0b7cd0 0x7fb2dc14f120 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0ae040 tx=0x7fb2cc019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:32.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2d8ff9640 1 -- 172.21.15.55:0/2705733663 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0b4420 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2d8ff9640 1 -- 172.21.15.55:0/2705733663 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc0b4580 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2d8ff9640 1 -- 172.21.15.55:0/2705733663 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0b4930 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/2705733663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2dc152b90 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.633+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/2705733663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2dc153150 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.637+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/2705733663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2dc1504d0 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.637+0000 7fb2d8ff9640 1 -- 172.21.15.55:0/2705733663 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb2cc0b2070 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.637+0000 7fb2d8ff9640 1 --2- 172.21.15.55:0/2705733663 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2c8066280 0x7fb2c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:32.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.637+0000 7fb2d8ff9640 1 -- 172.21.15.55:0/2705733663 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb2cc11cef0 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.637+0000 7fb2db7fe640 1 --2- 172.21.15.55:0/2705733663 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2c8066280 0x7fb2c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:32.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.637+0000 7fb2db7fe640 1 --2- 172.21.15.55:0/2705733663 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2c8066280 0x7fb2c8068730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc151e40 tx=0x7fb2d0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:32.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.641+0000 7fb2d8ff9640 1 -- 172.21.15.55:0/2705733663 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2dc1504d0 con 0x7fb2dc0b7cd0 2023-07-06T21:43:32.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.793+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/2705733663 --> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2dc0b1620 con 0x7fb2c8066280 2023-07-06T21:43:32.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.801+0000 7fb2d8ff9640 1 -- 172.21.15.55:0/2705733663 <== mgr.4101 v2:172.21.15.55:6832/1575998409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298952 (secure 0 0 0) 0x7fb2d0011a30 con 0x7fb2c8066280 2023-07-06T21:43:32.813 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:32.814 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:43:32.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.805+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/2705733663 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2c8066280 msgr2=0x7fb2c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.805+0000 7fb2e2a5c640 1 --2- 172.21.15.55:0/2705733663 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2c8066280 0x7fb2c8068730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc151e40 tx=0x7fb2d0009190 comp rx=0 tx=0).stop 2023-07-06T21:43:32.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.805+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/2705733663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2dc0b7cd0 msgr2=0x7fb2dc14f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:32.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.805+0000 7fb2e2a5c640 1 --2- 172.21.15.55:0/2705733663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2dc0b7cd0 0x7fb2dc14f120 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0ae040 tx=0x7fb2cc019250 comp rx=0 tx=0).stop 2023-07-06T21:43:32.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.805+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/2705733663 shutdown_connections 2023-07-06T21:43:32.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.805+0000 7fb2e2a5c640 1 --2- 172.21.15.55:0/2705733663 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fb2c8066280 0x7fb2c8068730 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.805+0000 7fb2e2a5c640 1 --2- 172.21.15.55:0/2705733663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2dc0ccf00 0x7fb2dc159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.805+0000 7fb2e2a5c640 1 --2- 172.21.15.55:0/2705733663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2dc0ccab0 0x7fb2dc14f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.805+0000 7fb2e2a5c640 1 --2- 172.21.15.55:0/2705733663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2dc0b7cd0 0x7fb2dc14f120 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:32.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.805+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/2705733663 >> 172.21.15.55:0/2705733663 conn(0x7fb2dc0ceee0 msgr2=0x7fb2dc0cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:32.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.805+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/2705733663 shutdown_connections 2023-07-06T21:43:32.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:32.805+0000 7fb2e2a5c640 1 -- 172.21.15.55:0/2705733663 wait complete. 2023-07-06T21:43:32.833 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-07-06T21:43:31.660353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236672,"kb_used_data":4672,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738048,"statfs":{"total":773094113280,"available":772851761152,"internally_reserved":0,"allocated":4784128,"data_stored":2758018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.963760"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.699848+0000","last_change":"2023-07-06T21:43:26.699848+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.699848+0000","last_undegraded":"2023-07-06T21:43:26.699848+0000","last_fullsized":"2023-07-06T21:43:26.699848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702735+0000","last_change":"2023-07-06T21:43:26.702735+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702735+0000","last_undegraded":"2023-07-06T21:43:26.702735+0000","last_fullsized":"2023-07-06T21:43:26.702735+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.705671+0000","last_change":"2023-07-06T21:43:26.705671+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.705671+0000","last_undegraded":"2023-07-06T21:43:26.705671+0000","last_fullsized":"2023-07-06T21:43:26.705671+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700832+0000","last_change":"2023-07-06T21:43:26.700832+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700832+0000","last_undegraded":"2023-07-06T21:43:26.700832+0000","last_fullsized":"2023-07-06T21:43:26.700832+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.699836+0000","last_change":"2023-07-06T21:43:26.699836+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.699836+0000","last_undegraded":"2023-07-06T21:43:26.699836+0000","last_fullsized":"2023-07-06T21:43:26.699836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702665+0000","last_change":"2023-07-06T21:43:26.702665+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702665+0000","last_undegraded":"2023-07-06T21:43:26.702665+0000","last_fullsized":"2023-07-06T21:43:26.702665+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704385+0000","last_change":"2023-07-06T21:43:26.704385+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704385+0000","last_undegraded":"2023-07-06T21:43:26.704385+0000","last_fullsized":"2023-07-06T21:43:26.704385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702285+0000","last_change":"2023-07-06T21:43:26.702285+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702285+0000","last_undegraded":"2023-07-06T21:43:26.702285+0000","last_fullsized":"2023-07-06T21:43:26.702285+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702225+0000","last_change":"2023-07-06T21:43:26.702225+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702225+0000","last_undegraded":"2023-07-06T21:43:26.702225+0000","last_fullsized":"2023-07-06T21:43:26.702225+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701377+0000","last_change":"2023-07-06T21:43:26.701377+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701377+0000","last_undegraded":"2023-07-06T21:43:26.701377+0000","last_fullsized":"2023-07-06T21:43:26.701377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701422+0000","last_change":"2023-07-06T21:43:26.701422+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701422+0000","last_undegraded":"2023-07-06T21:43:26.701422+0000","last_fullsized":"2023-07-06T21:43:26.701422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704143+0000","last_change":"2023-07-06T21:43:26.704143+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704143+0000","last_undegraded":"2023-07-06T21:43:26.704143+0000","last_fullsized":"2023-07-06T21:43:26.704143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.699386+0000","last_change":"2023-07-06T21:43:26.699386+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.699386+0000","last_undegraded":"2023-07-06T21:43:26.699386+0000","last_fullsized":"2023-07-06T21:43:26.699386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700793+0000","last_change":"2023-07-06T21:43:26.700793+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700793+0000","last_undegraded":"2023-07-06T21:43:26.700793+0000","last_fullsized":"2023-07-06T21:43:26.700793+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.698875+0000","last_change":"2023-07-06T21:43:26.698875+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.698875+0000","last_undegraded":"2023-07-06T21:43:26.698875+0000","last_fullsized":"2023-07-06T21:43:26.698875+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701863+0000","last_change":"2023-07-06T21:43:26.701863+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701863+0000","last_undegraded":"2023-07-06T21:43:26.701863+0000","last_fullsized":"2023-07-06T21:43:26.701863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.703902+0000","last_change":"2023-07-06T21:43:26.703902+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.703902+0000","last_undegraded":"2023-07-06T21:43:26.703902+0000","last_fullsized":"2023-07-06T21:43:26.703902+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702212+0000","last_change":"2023-07-06T21:43:26.702212+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702212+0000","last_undegraded":"2023-07-06T21:43:26.702212+0000","last_fullsized":"2023-07-06T21:43:26.702212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704332+0000","last_change":"2023-07-06T21:43:26.704332+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704332+0000","last_undegraded":"2023-07-06T21:43:26.704332+0000","last_fullsized":"2023-07-06T21:43:26.704332+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.698854+0000","last_change":"2023-07-06T21:43:26.698854+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.698854+0000","last_undegraded":"2023-07-06T21:43:26.698854+0000","last_fullsized":"2023-07-06T21:43:26.698854+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.698833+0000","last_change":"2023-07-06T21:43:26.698833+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.698833+0000","last_undegraded":"2023-07-06T21:43:26.698833+0000","last_fullsized":"2023-07-06T21:43:26.698833+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704652+0000","last_change":"2023-07-06T21:43:26.704652+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704652+0000","last_undegraded":"2023-07-06T21:43:26.704652+0000","last_fullsized":"2023-07-06T21:43:26.704652+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701346+0000","last_change":"2023-07-06T21:43:26.701346+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701346+0000","last_undegraded":"2023-07-06T21:43:26.701346+0000","last_fullsized":"2023-07-06T21:43:26.701346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700758+0000","last_change":"2023-07-06T21:43:26.700758+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700758+0000","last_undegraded":"2023-07-06T21:43:26.700758+0000","last_fullsized":"2023-07-06T21:43:26.700758+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700883+0000","last_change":"2023-07-06T21:43:26.700883+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700883+0000","last_undegraded":"2023-07-06T21:43:26.700883+0000","last_fullsized":"2023-07-06T21:43:26.700883+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.699719+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:43:26.699719+0000","last_peered":"2023-07-06T21:43:26.699719+0000","last_clean":"2023-07-06T21:43:26.699719+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:43:26.699719+0000","last_undegraded":"2023-07-06T21:43:26.699719+0000","last_fullsized":"2023-07-06T21:43:26.699719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:09:46.423161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702066+0000","last_change":"2023-07-06T21:43:26.702066+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702066+0000","last_undegraded":"2023-07-06T21:43:26.702066+0000","last_fullsized":"2023-07-06T21:43:26.702066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.706503+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:43:26.706503+0000","last_peered":"2023-07-06T21:43:26.706503+0000","last_clean":"2023-07-06T21:43:26.706503+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:43:26.706503+0000","last_undegraded":"2023-07-06T21:43:26.706503+0000","last_fullsized":"2023-07-06T21:43:26.706503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:18:38.165250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.705591+0000","last_change":"2023-07-06T21:43:26.705591+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.705591+0000","last_undegraded":"2023-07-06T21:43:26.705591+0000","last_fullsized":"2023-07-06T21:43:26.705591+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.703294+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:43:26.703294+0000","last_peered":"2023-07-06T21:43:26.703294+0000","last_clean":"2023-07-06T21:43:26.703294+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:43:26.703294+0000","last_undegraded":"2023-07-06T21:43:26.703294+0000","last_fullsized":"2023-07-06T21:43:26.703294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:59:59.983232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701331+0000","last_change":"2023-07-06T21:43:26.701331+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701331+0000","last_undegraded":"2023-07-06T21:43:26.701331+0000","last_fullsized":"2023-07-06T21:43:26.701331+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.706435+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:43:26.706435+0000","last_peered":"2023-07-06T21:43:26.706435+0000","last_clean":"2023-07-06T21:43:26.706435+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:43:26.706435+0000","last_undegraded":"2023-07-06T21:43:26.706435+0000","last_fullsized":"2023-07-06T21:43:26.706435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:10:49.833853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.698885+0000","last_change":"2023-07-06T21:43:26.698885+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.698885+0000","last_undegraded":"2023-07-06T21:43:26.698885+0000","last_fullsized":"2023-07-06T21:43:26.698885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.705504+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:43:26.705504+0000","last_peered":"2023-07-06T21:43:26.705504+0000","last_clean":"2023-07-06T21:43:26.705504+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:43:26.705504+0000","last_undegraded":"2023-07-06T21:43:26.705504+0000","last_fullsized":"2023-07-06T21:43:26.705504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:54:03.674314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700868+0000","last_change":"2023-07-06T21:43:26.700868+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700868+0000","last_undegraded":"2023-07-06T21:43:26.700868+0000","last_fullsized":"2023-07-06T21:43:26.700868+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.703722+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:43:26.703722+0000","last_peered":"2023-07-06T21:43:26.703722+0000","last_clean":"2023-07-06T21:43:26.703722+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:43:26.703722+0000","last_undegraded":"2023-07-06T21:43:26.703722+0000","last_fullsized":"2023-07-06T21:43:26.703722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:17:31.580212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.705834+0000","last_change":"2023-07-06T21:43:26.705834+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.705834+0000","last_undegraded":"2023-07-06T21:43:26.705834+0000","last_fullsized":"2023-07-06T21:43:26.705834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.702300+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:43:26.702300+0000","last_peered":"2023-07-06T21:43:26.702300+0000","last_clean":"2023-07-06T21:43:26.702300+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:43:26.702300+0000","last_undegraded":"2023-07-06T21:43:26.702300+0000","last_fullsized":"2023-07-06T21:43:26.702300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:28:54.724929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704386+0000","last_change":"2023-07-06T21:43:26.704386+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704386+0000","last_undegraded":"2023-07-06T21:43:26.704386+0000","last_fullsized":"2023-07-06T21:43:26.704386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.705478+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:43:26.705478+0000","last_peered":"2023-07-06T21:43:26.705478+0000","last_clean":"2023-07-06T21:43:26.705478+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:43:26.705478+0000","last_undegraded":"2023-07-06T21:43:26.705478+0000","last_fullsized":"2023-07-06T21:43:26.705478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:11:25.152837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.702441+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:43:26.702441+0000","last_peered":"2023-07-06T21:43:26.702441+0000","last_clean":"2023-07-06T21:43:26.702441+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:43:26.702441+0000","last_undegraded":"2023-07-06T21:43:26.702441+0000","last_fullsized":"2023-07-06T21:43:26.702441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:06:07.766504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":1044480,"data_stored":787783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78500000000000003}]},{"osd":2,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.747},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.629},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.65500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":196396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.753}]},{"osd":2,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.63},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.59899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.71799999999999997}]},{"osd":1,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.73199999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.62}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.623}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.73899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.754}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.054}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.371},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.496}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":1040384,"data_stored":786764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.31},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.623},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:43:32.840 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:43:33.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbfe96640 1 Processor -- start 2023-07-06T21:43:33.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbfe96640 1 -- start start 2023-07-06T21:43:33.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbfe96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fb80712f0 0x7f2fb806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbfe96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fb80b3730 0x7f2fb80c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbfe96640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2fb80ca280 0x7f2fb80c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbfe96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb80ca700 con 0x7f2fb80b3730 2023-07-06T21:43:33.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbfe96640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb8159cd0 con 0x7f2fb80ca280 2023-07-06T21:43:33.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbfe96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb80693f0 con 0x7f2fb80712f0 2023-07-06T21:43:33.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbd431640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fb80b3730 0x7f2fb80c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbd431640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fb80b3730 0x7f2fb80c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50912/0 (socket says 172.21.15.55:50912) 2023-07-06T21:43:33.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbd431640 1 -- 172.21.15.55:0/2672893436 learned_addr learned my addr 172.21.15.55:0/2672893436 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:33.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbe433640 1 --2- 172.21.15.55:0/2672893436 >> v2:172.21.15.138:3300/0 conn(0x7f2fb80ca280 0x7f2fb80c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbdc32640 1 --2- 172.21.15.55:0/2672893436 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fb80712f0 0x7f2fb806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbd431640 1 -- 172.21.15.55:0/2672893436 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fb80712f0 msgr2=0x7f2fb806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:33.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbd431640 1 --2- 172.21.15.55:0/2672893436 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fb80712f0 0x7f2fb806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbd431640 1 -- 172.21.15.55:0/2672893436 >> v2:172.21.15.138:3300/0 conn(0x7f2fb80ca280 msgr2=0x7f2fb80c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbd431640 1 --2- 172.21.15.55:0/2672893436 >> v2:172.21.15.138:3300/0 conn(0x7f2fb80ca280 0x7f2fb80c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbd431640 1 -- 172.21.15.55:0/2672893436 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb806aca0 con 0x7f2fb80b3730 2023-07-06T21:43:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbe433640 1 --2- 172.21.15.55:0/2672893436 >> v2:172.21.15.138:3300/0 conn(0x7f2fb80ca280 0x7f2fb80c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.009+0000 7f2fbdc32640 1 --2- 172.21.15.55:0/2672893436 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fb80712f0 0x7f2fb806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:33.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.013+0000 7f2fbd431640 1 --2- 172.21.15.55:0/2672893436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb80b3730 0x7f2fb80c9d40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2fb806ee30 tx=0x7f2fa801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e44752cc7d79cc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:33.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.013+0000 7f2fbcc30640 1 -- 172.21.15.55:0/2672893436 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80ab600 con 0x7f2fb80b3730 2023-07-06T21:43:33.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.013+0000 7f2fbcc30640 1 -- 172.21.15.55:0/2672893436 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa80a7050 con 0x7f2fb80b3730 2023-07-06T21:43:33.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.013+0000 7f2fbcc30640 1 -- 172.21.15.55:0/2672893436 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80ab980 con 0x7f2fb80b3730 2023-07-06T21:43:33.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.013+0000 7f2fbfe96640 1 -- 172.21.15.55:0/2672893436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb80b3730 msgr2=0x7f2fb80c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.013+0000 7f2fbfe96640 1 --2- 172.21.15.55:0/2672893436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb80b3730 0x7f2fb80c9d40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2fb806ee30 tx=0x7f2fa801c210 comp rx=0 tx=0).stop 2023-07-06T21:43:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.013+0000 7f2fbfe96640 1 -- 172.21.15.55:0/2672893436 shutdown_connections 2023-07-06T21:43:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.013+0000 7f2fbfe96640 1 --2- 172.21.15.55:0/2672893436 >> v2:172.21.15.138:3300/0 conn(0x7f2fb80ca280 0x7f2fb80c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.013+0000 7f2fbfe96640 1 --2- 172.21.15.55:0/2672893436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb80b3730 0x7f2fb80c9d40 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.013+0000 7f2fbfe96640 1 --2- 172.21.15.55:0/2672893436 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fb80712f0 0x7f2fb806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.013+0000 7f2fbfe96640 1 -- 172.21.15.55:0/2672893436 >> 172.21.15.55:0/2672893436 conn(0x7f2fb80cded0 msgr2=0x7f2fb80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.013+0000 7f2fbfe96640 1 -- 172.21.15.55:0/2672893436 shutdown_connections 2023-07-06T21:43:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.013+0000 7f2fbfe96640 1 -- 172.21.15.55:0/2672893436 wait complete. 2023-07-06T21:43:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbfe96640 1 Processor -- start 2023-07-06T21:43:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbfe96640 1 -- start start 2023-07-06T21:43:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbfe96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fb80712f0 0x7f2fb80c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbfe96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb80b3730 0x7f2fb81f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbfe96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fb80ca280 0x7f2fb8155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbfe96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb81f50d0 con 0x7f2fb80b3730 2023-07-06T21:43:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbfe96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb8155a50 con 0x7f2fb80712f0 2023-07-06T21:43:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbfe96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb80c61b0 con 0x7f2fb80ca280 2023-07-06T21:43:33.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbd431640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb80b3730 0x7f2fb81f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbd431640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb80b3730 0x7f2fb81f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50928/0 (socket says 172.21.15.55:50928) 2023-07-06T21:43:33.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbd431640 1 -- 172.21.15.55:0/1725142711 learned_addr learned my addr 172.21.15.55:0/1725142711 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:33.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbe433640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fb80ca280 0x7f2fb8155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbdc32640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fb80712f0 0x7f2fb80c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbd431640 1 -- 172.21.15.55:0/1725142711 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fb80ca280 msgr2=0x7f2fb8155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbd431640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fb80ca280 0x7f2fb8155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbd431640 1 -- 172.21.15.55:0/1725142711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fb80712f0 msgr2=0x7f2fb80c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbd431640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fb80712f0 0x7f2fb80c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbd431640 1 -- 172.21.15.55:0/1725142711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa80094d0 con 0x7f2fb80b3730 2023-07-06T21:43:33.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbdc32640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fb80712f0 0x7f2fb80c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:33.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbd431640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb80b3730 0x7f2fb81f4b90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2fa801a8c0 tx=0x7f2fa8018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:33.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fae7fc640 1 -- 172.21.15.55:0/1725142711 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80b4620 con 0x7f2fb80b3730 2023-07-06T21:43:33.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fae7fc640 1 -- 172.21.15.55:0/1725142711 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa80b4780 con 0x7f2fb80b3730 2023-07-06T21:43:33.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fae7fc640 1 -- 172.21.15.55:0/1725142711 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80b4b30 con 0x7f2fb80b3730 2023-07-06T21:43:33.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbfe96640 1 -- 172.21.15.55:0/1725142711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb80c5630 con 0x7f2fb80b3730 2023-07-06T21:43:33.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.017+0000 7f2fbfe96640 1 -- 172.21.15.55:0/1725142711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb80c5bf0 con 0x7f2fb80b3730 2023-07-06T21:43:33.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.021+0000 7f2fbfe96640 1 -- 172.21.15.55:0/1725142711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb8066d60 con 0x7f2fb80b3730 2023-07-06T21:43:33.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.021+0000 7f2fae7fc640 1 -- 172.21.15.55:0/1725142711 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2fa80b2070 con 0x7f2fb80b3730 2023-07-06T21:43:33.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.021+0000 7f2fae7fc640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2f9c066280 0x7f2f9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.021+0000 7f2fae7fc640 1 -- 172.21.15.55:0/1725142711 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2fa811ce70 con 0x7f2fb80b3730 2023-07-06T21:43:33.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.021+0000 7f2fbdc32640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2f9c066280 0x7f2f9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.021+0000 7f2fbdc32640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2f9c066280 0x7f2f9c068730 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400ba50 tx=0x7f2fb4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:33.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.025+0000 7f2fae7fc640 1 -- 172.21.15.55:0/1725142711 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2fa80ea2f0 con 0x7f2fb80b3730 2023-07-06T21:43:33.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.177+0000 7f2fbfe96640 1 -- 172.21.15.55:0/1725142711 --> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fb80b3e30 con 0x7f2f9c066280 2023-07-06T21:43:33.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.185+0000 7f2fae7fc640 1 -- 172.21.15.55:0/1725142711 <== mgr.4101 v2:172.21.15.55:6832/1575998409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298952 (secure 0 0 0) 0x7f2fb400b6f0 con 0x7f2f9c066280 2023-07-06T21:43:33.196 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:33.197 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:43:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.189+0000 7f2fbfe96640 1 -- 172.21.15.55:0/1725142711 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2f9c066280 msgr2=0x7f2f9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.189+0000 7f2fbfe96640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2f9c066280 0x7f2f9c068730 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400ba50 tx=0x7f2fb4008040 comp rx=0 tx=0).stop 2023-07-06T21:43:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.189+0000 7f2fbfe96640 1 -- 172.21.15.55:0/1725142711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb80b3730 msgr2=0x7f2fb81f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.189+0000 7f2fbfe96640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb80b3730 0x7f2fb81f4b90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2fa801a8c0 tx=0x7f2fa8018fb0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.189+0000 7f2fbfe96640 1 -- 172.21.15.55:0/1725142711 shutdown_connections 2023-07-06T21:43:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.189+0000 7f2fbfe96640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2f9c066280 0x7f2f9c068730 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.189+0000 7f2fbfe96640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fb80ca280 0x7f2fb8155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.189+0000 7f2fbfe96640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb80b3730 0x7f2fb81f4b90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.189+0000 7f2fbfe96640 1 --2- 172.21.15.55:0/1725142711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fb80712f0 0x7f2fb80c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.189+0000 7f2fbfe96640 1 -- 172.21.15.55:0/1725142711 >> 172.21.15.55:0/1725142711 conn(0x7f2fb80cded0 msgr2=0x7f2fb80b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.189+0000 7f2fbfe96640 1 -- 172.21.15.55:0/1725142711 shutdown_connections 2023-07-06T21:43:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.189+0000 7f2fbfe96640 1 -- 172.21.15.55:0/1725142711 wait complete. 2023-07-06T21:43:33.216 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-07-06T21:43:31.660353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236672,"kb_used_data":4672,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738048,"statfs":{"total":773094113280,"available":772851761152,"internally_reserved":0,"allocated":4784128,"data_stored":2758018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.963760"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.699848+0000","last_change":"2023-07-06T21:43:26.699848+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.699848+0000","last_undegraded":"2023-07-06T21:43:26.699848+0000","last_fullsized":"2023-07-06T21:43:26.699848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702735+0000","last_change":"2023-07-06T21:43:26.702735+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702735+0000","last_undegraded":"2023-07-06T21:43:26.702735+0000","last_fullsized":"2023-07-06T21:43:26.702735+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.705671+0000","last_change":"2023-07-06T21:43:26.705671+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.705671+0000","last_undegraded":"2023-07-06T21:43:26.705671+0000","last_fullsized":"2023-07-06T21:43:26.705671+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700832+0000","last_change":"2023-07-06T21:43:26.700832+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700832+0000","last_undegraded":"2023-07-06T21:43:26.700832+0000","last_fullsized":"2023-07-06T21:43:26.700832+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.699836+0000","last_change":"2023-07-06T21:43:26.699836+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.699836+0000","last_undegraded":"2023-07-06T21:43:26.699836+0000","last_fullsized":"2023-07-06T21:43:26.699836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702665+0000","last_change":"2023-07-06T21:43:26.702665+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702665+0000","last_undegraded":"2023-07-06T21:43:26.702665+0000","last_fullsized":"2023-07-06T21:43:26.702665+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704385+0000","last_change":"2023-07-06T21:43:26.704385+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704385+0000","last_undegraded":"2023-07-06T21:43:26.704385+0000","last_fullsized":"2023-07-06T21:43:26.704385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702285+0000","last_change":"2023-07-06T21:43:26.702285+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702285+0000","last_undegraded":"2023-07-06T21:43:26.702285+0000","last_fullsized":"2023-07-06T21:43:26.702285+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702225+0000","last_change":"2023-07-06T21:43:26.702225+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702225+0000","last_undegraded":"2023-07-06T21:43:26.702225+0000","last_fullsized":"2023-07-06T21:43:26.702225+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701377+0000","last_change":"2023-07-06T21:43:26.701377+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701377+0000","last_undegraded":"2023-07-06T21:43:26.701377+0000","last_fullsized":"2023-07-06T21:43:26.701377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701422+0000","last_change":"2023-07-06T21:43:26.701422+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701422+0000","last_undegraded":"2023-07-06T21:43:26.701422+0000","last_fullsized":"2023-07-06T21:43:26.701422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704143+0000","last_change":"2023-07-06T21:43:26.704143+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704143+0000","last_undegraded":"2023-07-06T21:43:26.704143+0000","last_fullsized":"2023-07-06T21:43:26.704143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.699386+0000","last_change":"2023-07-06T21:43:26.699386+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.699386+0000","last_undegraded":"2023-07-06T21:43:26.699386+0000","last_fullsized":"2023-07-06T21:43:26.699386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700793+0000","last_change":"2023-07-06T21:43:26.700793+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700793+0000","last_undegraded":"2023-07-06T21:43:26.700793+0000","last_fullsized":"2023-07-06T21:43:26.700793+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.698875+0000","last_change":"2023-07-06T21:43:26.698875+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.698875+0000","last_undegraded":"2023-07-06T21:43:26.698875+0000","last_fullsized":"2023-07-06T21:43:26.698875+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701863+0000","last_change":"2023-07-06T21:43:26.701863+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701863+0000","last_undegraded":"2023-07-06T21:43:26.701863+0000","last_fullsized":"2023-07-06T21:43:26.701863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.703902+0000","last_change":"2023-07-06T21:43:26.703902+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.703902+0000","last_undegraded":"2023-07-06T21:43:26.703902+0000","last_fullsized":"2023-07-06T21:43:26.703902+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702212+0000","last_change":"2023-07-06T21:43:26.702212+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702212+0000","last_undegraded":"2023-07-06T21:43:26.702212+0000","last_fullsized":"2023-07-06T21:43:26.702212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704332+0000","last_change":"2023-07-06T21:43:26.704332+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704332+0000","last_undegraded":"2023-07-06T21:43:26.704332+0000","last_fullsized":"2023-07-06T21:43:26.704332+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.698854+0000","last_change":"2023-07-06T21:43:26.698854+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.698854+0000","last_undegraded":"2023-07-06T21:43:26.698854+0000","last_fullsized":"2023-07-06T21:43:26.698854+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.698833+0000","last_change":"2023-07-06T21:43:26.698833+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.698833+0000","last_undegraded":"2023-07-06T21:43:26.698833+0000","last_fullsized":"2023-07-06T21:43:26.698833+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704652+0000","last_change":"2023-07-06T21:43:26.704652+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704652+0000","last_undegraded":"2023-07-06T21:43:26.704652+0000","last_fullsized":"2023-07-06T21:43:26.704652+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701346+0000","last_change":"2023-07-06T21:43:26.701346+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701346+0000","last_undegraded":"2023-07-06T21:43:26.701346+0000","last_fullsized":"2023-07-06T21:43:26.701346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700758+0000","last_change":"2023-07-06T21:43:26.700758+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700758+0000","last_undegraded":"2023-07-06T21:43:26.700758+0000","last_fullsized":"2023-07-06T21:43:26.700758+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700883+0000","last_change":"2023-07-06T21:43:26.700883+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700883+0000","last_undegraded":"2023-07-06T21:43:26.700883+0000","last_fullsized":"2023-07-06T21:43:26.700883+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.699719+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:43:26.699719+0000","last_peered":"2023-07-06T21:43:26.699719+0000","last_clean":"2023-07-06T21:43:26.699719+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:43:26.699719+0000","last_undegraded":"2023-07-06T21:43:26.699719+0000","last_fullsized":"2023-07-06T21:43:26.699719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:09:46.423161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.702066+0000","last_change":"2023-07-06T21:43:26.702066+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.702066+0000","last_undegraded":"2023-07-06T21:43:26.702066+0000","last_fullsized":"2023-07-06T21:43:26.702066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.706503+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:43:26.706503+0000","last_peered":"2023-07-06T21:43:26.706503+0000","last_clean":"2023-07-06T21:43:26.706503+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:43:26.706503+0000","last_undegraded":"2023-07-06T21:43:26.706503+0000","last_fullsized":"2023-07-06T21:43:26.706503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:18:38.165250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.705591+0000","last_change":"2023-07-06T21:43:26.705591+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.705591+0000","last_undegraded":"2023-07-06T21:43:26.705591+0000","last_fullsized":"2023-07-06T21:43:26.705591+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.703294+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:43:26.703294+0000","last_peered":"2023-07-06T21:43:26.703294+0000","last_clean":"2023-07-06T21:43:26.703294+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:43:26.703294+0000","last_undegraded":"2023-07-06T21:43:26.703294+0000","last_fullsized":"2023-07-06T21:43:26.703294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:59:59.983232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.701331+0000","last_change":"2023-07-06T21:43:26.701331+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.701331+0000","last_undegraded":"2023-07-06T21:43:26.701331+0000","last_fullsized":"2023-07-06T21:43:26.701331+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.706435+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:43:26.706435+0000","last_peered":"2023-07-06T21:43:26.706435+0000","last_clean":"2023-07-06T21:43:26.706435+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:43:26.706435+0000","last_undegraded":"2023-07-06T21:43:26.706435+0000","last_fullsized":"2023-07-06T21:43:26.706435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:10:49.833853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.698885+0000","last_change":"2023-07-06T21:43:26.698885+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.698885+0000","last_undegraded":"2023-07-06T21:43:26.698885+0000","last_fullsized":"2023-07-06T21:43:26.698885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.705504+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:43:26.705504+0000","last_peered":"2023-07-06T21:43:26.705504+0000","last_clean":"2023-07-06T21:43:26.705504+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:43:26.705504+0000","last_undegraded":"2023-07-06T21:43:26.705504+0000","last_fullsized":"2023-07-06T21:43:26.705504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:54:03.674314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.700868+0000","last_change":"2023-07-06T21:43:26.700868+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.700868+0000","last_undegraded":"2023-07-06T21:43:26.700868+0000","last_fullsized":"2023-07-06T21:43:26.700868+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.703722+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:43:26.703722+0000","last_peered":"2023-07-06T21:43:26.703722+0000","last_clean":"2023-07-06T21:43:26.703722+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:43:26.703722+0000","last_undegraded":"2023-07-06T21:43:26.703722+0000","last_fullsized":"2023-07-06T21:43:26.703722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:17:31.580212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.705834+0000","last_change":"2023-07-06T21:43:26.705834+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.705834+0000","last_undegraded":"2023-07-06T21:43:26.705834+0000","last_fullsized":"2023-07-06T21:43:26.705834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.702300+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:43:26.702300+0000","last_peered":"2023-07-06T21:43:26.702300+0000","last_clean":"2023-07-06T21:43:26.702300+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:43:26.702300+0000","last_undegraded":"2023-07-06T21:43:26.702300+0000","last_fullsized":"2023-07-06T21:43:26.702300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:28:54.724929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:43:27.696519+0000","last_change":"2023-07-06T21:43:27.696519+0000","last_active":"2023-07-06T21:43:27.696519+0000","last_peered":"2023-07-06T21:43:27.696519+0000","last_clean":"2023-07-06T21:43:27.696519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:27.696519+0000","last_undegraded":"2023-07-06T21:43:27.696519+0000","last_fullsized":"2023-07-06T21:43:27.696519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T21:43:26.704386+0000","last_change":"2023-07-06T21:43:26.704386+0000","last_active":"2023-07-06T21:43:26.689015+0000","last_peered":"2023-07-06T21:43:26.689015+0000","last_clean":"2023-07-06T21:43:26.689015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:43:26.704386+0000","last_undegraded":"2023-07-06T21:43:26.704386+0000","last_fullsized":"2023-07-06T21:43:26.704386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.705478+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:43:26.705478+0000","last_peered":"2023-07-06T21:43:26.705478+0000","last_clean":"2023-07-06T21:43:26.705478+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:43:26.705478+0000","last_undegraded":"2023-07-06T21:43:26.705478+0000","last_fullsized":"2023-07-06T21:43:26.705478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:11:25.152837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T21:43:26.702441+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:43:26.702441+0000","last_peered":"2023-07-06T21:43:26.702441+0000","last_clean":"2023-07-06T21:43:26.702441+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:43:26.702441+0000","last_undegraded":"2023-07-06T21:43:26.702441+0000","last_fullsized":"2023-07-06T21:43:26.702441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:06:07.766504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":1044480,"data_stored":787783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78500000000000003}]},{"osd":2,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.747},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.629},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.65500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":196396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.753}]},{"osd":2,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.63},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.59899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.71799999999999997}]},{"osd":1,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.73199999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.62}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.623}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.73899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.754}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.054}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.371},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":450560,"data_stored":197415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.496}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":1040384,"data_stored":786764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.31},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.623},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:43:33.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-07-06T21:43:33.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-07-06T21:43:33.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-07-06T21:43:33.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-07-06T21:43:33.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-07-06T21:43:33.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-07-06T21:43:33.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-07-06T21:43:33.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-07-06T21:43:33.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-07-06T21:43:33.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-07-06T21:43:33.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-07-06T21:43:33.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-07-06T21:43:33.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-07-06T21:43:33.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-07-06T21:43:33.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-07-06T21:43:33.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-07-06T21:43:33.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-07-06T21:43:33.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-07-06T21:43:33.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-07-06T21:43:33.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-07-06T21:43:33.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-07-06T21:43:33.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-07-06T21:43:33.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-07-06T21:43:33.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-07-06T21:43:33.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-07-06T21:43:33.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-07-06T21:43:33.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-07-06T21:43:33.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-07-06T21:43:33.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-07-06T21:43:33.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-07-06T21:43:33.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-07-06T21:43:33.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-07-06T21:43:33.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-07-06T21:43:33.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-07-06T21:43:33.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.699848+0000', 'last_change': '2023-07-06T21:43:26.699848+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.699848+0000', 'last_undegraded': '2023-07-06T21:43:26.699848+0000', 'last_fullsized': '2023-07-06T21:43:26.699848+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T21:43:33.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-07-06T21:43:33.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-07-06T21:43:33.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.702735+0000', 'last_change': '2023-07-06T21:43:26.702735+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.702735+0000', 'last_undegraded': '2023-07-06T21:43:26.702735+0000', 'last_fullsized': '2023-07-06T21:43:26.702735+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T21:43:33.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-07-06T21:43:33.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-07-06T21:43:33.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.705671+0000', 'last_change': '2023-07-06T21:43:26.705671+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.705671+0000', 'last_undegraded': '2023-07-06T21:43:26.705671+0000', 'last_fullsized': '2023-07-06T21:43:26.705671+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T21:43:33.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-07-06T21:43:33.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-07-06T21:43:33.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.700832+0000', 'last_change': '2023-07-06T21:43:26.700832+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.700832+0000', 'last_undegraded': '2023-07-06T21:43:26.700832+0000', 'last_fullsized': '2023-07-06T21:43:26.700832+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T21:43:33.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-07-06T21:43:33.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-07-06T21:43:33.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.699836+0000', 'last_change': '2023-07-06T21:43:26.699836+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.699836+0000', 'last_undegraded': '2023-07-06T21:43:26.699836+0000', 'last_fullsized': '2023-07-06T21:43:26.699836+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T21:43:33.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-07-06T21:43:33.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-07-06T21:43:33.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.702665+0000', 'last_change': '2023-07-06T21:43:26.702665+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.702665+0000', 'last_undegraded': '2023-07-06T21:43:26.702665+0000', 'last_fullsized': '2023-07-06T21:43:26.702665+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T21:43:33.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-07-06T21:43:33.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-07-06T21:43:33.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.704385+0000', 'last_change': '2023-07-06T21:43:26.704385+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.704385+0000', 'last_undegraded': '2023-07-06T21:43:26.704385+0000', 'last_fullsized': '2023-07-06T21:43:26.704385+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T21:43:33.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-07-06T21:43:33.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-07-06T21:43:33.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.702285+0000', 'last_change': '2023-07-06T21:43:26.702285+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.702285+0000', 'last_undegraded': '2023-07-06T21:43:26.702285+0000', 'last_fullsized': '2023-07-06T21:43:26.702285+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:43:33.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-07-06T21:43:33.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-07-06T21:43:33.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.702225+0000', 'last_change': '2023-07-06T21:43:26.702225+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.702225+0000', 'last_undegraded': '2023-07-06T21:43:26.702225+0000', 'last_fullsized': '2023-07-06T21:43:26.702225+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T21:43:33.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-07-06T21:43:33.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-07-06T21:43:33.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.701377+0000', 'last_change': '2023-07-06T21:43:26.701377+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.701377+0000', 'last_undegraded': '2023-07-06T21:43:26.701377+0000', 'last_fullsized': '2023-07-06T21:43:26.701377+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:43:33.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-07-06T21:43:33.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-07-06T21:43:33.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.701422+0000', 'last_change': '2023-07-06T21:43:26.701422+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.701422+0000', 'last_undegraded': '2023-07-06T21:43:26.701422+0000', 'last_fullsized': '2023-07-06T21:43:26.701422+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T21:43:33.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-07-06T21:43:33.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-07-06T21:43:33.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.704143+0000', 'last_change': '2023-07-06T21:43:26.704143+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.704143+0000', 'last_undegraded': '2023-07-06T21:43:26.704143+0000', 'last_fullsized': '2023-07-06T21:43:26.704143+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T21:43:33.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-07-06T21:43:33.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-07-06T21:43:33.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.699386+0000', 'last_change': '2023-07-06T21:43:26.699386+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.699386+0000', 'last_undegraded': '2023-07-06T21:43:26.699386+0000', 'last_fullsized': '2023-07-06T21:43:26.699386+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T21:43:33.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-07-06T21:43:33.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-07-06T21:43:33.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.700793+0000', 'last_change': '2023-07-06T21:43:26.700793+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.700793+0000', 'last_undegraded': '2023-07-06T21:43:26.700793+0000', 'last_fullsized': '2023-07-06T21:43:26.700793+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T21:43:33.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-07-06T21:43:33.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-07-06T21:43:33.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.698875+0000', 'last_change': '2023-07-06T21:43:26.698875+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.698875+0000', 'last_undegraded': '2023-07-06T21:43:26.698875+0000', 'last_fullsized': '2023-07-06T21:43:26.698875+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T21:43:33.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-07-06T21:43:33.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-07-06T21:43:33.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.701863+0000', 'last_change': '2023-07-06T21:43:26.701863+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.701863+0000', 'last_undegraded': '2023-07-06T21:43:26.701863+0000', 'last_fullsized': '2023-07-06T21:43:26.701863+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:43:33.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-07-06T21:43:33.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-07-06T21:43:33.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.703902+0000', 'last_change': '2023-07-06T21:43:26.703902+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.703902+0000', 'last_undegraded': '2023-07-06T21:43:26.703902+0000', 'last_fullsized': '2023-07-06T21:43:26.703902+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T21:43:33.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-07-06T21:43:33.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-07-06T21:43:33.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.702212+0000', 'last_change': '2023-07-06T21:43:26.702212+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.702212+0000', 'last_undegraded': '2023-07-06T21:43:26.702212+0000', 'last_fullsized': '2023-07-06T21:43:26.702212+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T21:43:33.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-07-06T21:43:33.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-07-06T21:43:33.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.704332+0000', 'last_change': '2023-07-06T21:43:26.704332+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.704332+0000', 'last_undegraded': '2023-07-06T21:43:26.704332+0000', 'last_fullsized': '2023-07-06T21:43:26.704332+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T21:43:33.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-07-06T21:43:33.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-07-06T21:43:33.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.698854+0000', 'last_change': '2023-07-06T21:43:26.698854+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.698854+0000', 'last_undegraded': '2023-07-06T21:43:26.698854+0000', 'last_fullsized': '2023-07-06T21:43:26.698854+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T21:43:33.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-07-06T21:43:33.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-07-06T21:43:33.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.698833+0000', 'last_change': '2023-07-06T21:43:26.698833+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.698833+0000', 'last_undegraded': '2023-07-06T21:43:26.698833+0000', 'last_fullsized': '2023-07-06T21:43:26.698833+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T21:43:33.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-07-06T21:43:33.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-07-06T21:43:33.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.704652+0000', 'last_change': '2023-07-06T21:43:26.704652+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.704652+0000', 'last_undegraded': '2023-07-06T21:43:26.704652+0000', 'last_fullsized': '2023-07-06T21:43:26.704652+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T21:43:33.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-07-06T21:43:33.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-07-06T21:43:33.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.701346+0000', 'last_change': '2023-07-06T21:43:26.701346+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.701346+0000', 'last_undegraded': '2023-07-06T21:43:26.701346+0000', 'last_fullsized': '2023-07-06T21:43:26.701346+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:43:33.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-07-06T21:43:33.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-07-06T21:43:33.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.700758+0000', 'last_change': '2023-07-06T21:43:26.700758+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.700758+0000', 'last_undegraded': '2023-07-06T21:43:26.700758+0000', 'last_fullsized': '2023-07-06T21:43:26.700758+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T21:43:33.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-07-06T21:43:33.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-07-06T21:43:33.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.700883+0000', 'last_change': '2023-07-06T21:43:26.700883+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.700883+0000', 'last_undegraded': '2023-07-06T21:43:26.700883+0000', 'last_fullsized': '2023-07-06T21:43:26.700883+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T21:43:33.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-07-06T21:43:33.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-07-06T21:43:33.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.702066+0000', 'last_change': '2023-07-06T21:43:26.702066+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.702066+0000', 'last_undegraded': '2023-07-06T21:43:26.702066+0000', 'last_fullsized': '2023-07-06T21:43:26.702066+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T21:43:33.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-07-06T21:43:33.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-07-06T21:43:33.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.705591+0000', 'last_change': '2023-07-06T21:43:26.705591+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.705591+0000', 'last_undegraded': '2023-07-06T21:43:26.705591+0000', 'last_fullsized': '2023-07-06T21:43:26.705591+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T21:43:33.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-07-06T21:43:33.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-07-06T21:43:33.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.701331+0000', 'last_change': '2023-07-06T21:43:26.701331+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.701331+0000', 'last_undegraded': '2023-07-06T21:43:26.701331+0000', 'last_fullsized': '2023-07-06T21:43:26.701331+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:43:33.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-07-06T21:43:33.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-07-06T21:43:33.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.698885+0000', 'last_change': '2023-07-06T21:43:26.698885+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.698885+0000', 'last_undegraded': '2023-07-06T21:43:26.698885+0000', 'last_fullsized': '2023-07-06T21:43:26.698885+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T21:43:33.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-07-06T21:43:33.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-07-06T21:43:33.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.700868+0000', 'last_change': '2023-07-06T21:43:26.700868+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.700868+0000', 'last_undegraded': '2023-07-06T21:43:26.700868+0000', 'last_fullsized': '2023-07-06T21:43:26.700868+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T21:43:33.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-07-06T21:43:33.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-07-06T21:43:33.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.705834+0000', 'last_change': '2023-07-06T21:43:26.705834+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.705834+0000', 'last_undegraded': '2023-07-06T21:43:26.705834+0000', 'last_fullsized': '2023-07-06T21:43:26.705834+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T21:43:33.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-07-06T21:43:33.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:43:27.696519+0000', 'last_change': '2023-07-06T21:43:27.696519+0000', 'last_active': '2023-07-06T21:43:27.696519+0000', 'last_peered': '2023-07-06T21:43:27.696519+0000', 'last_clean': '2023-07-06T21:43:27.696519+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:27.696519+0000', 'last_undegraded': '2023-07-06T21:43:27.696519+0000', 'last_fullsized': '2023-07-06T21:43:27.696519+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:27.696519+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:43:33.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-07-06T21:43:33.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:43:26.704386+0000', 'last_change': '2023-07-06T21:43:26.704386+0000', 'last_active': '2023-07-06T21:43:26.689015+0000', 'last_peered': '2023-07-06T21:43:26.689015+0000', 'last_clean': '2023-07-06T21:43:26.689015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:43:26.704386+0000', 'last_undegraded': '2023-07-06T21:43:26.704386+0000', 'last_fullsized': '2023-07-06T21:43:26.704386+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'last_clean_scrub_stamp': '2023-07-06T21:43:26.689015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T21:43:33.287 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-06T21:43:33.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7fecf48d8640 1 Processor -- start 2023-07-06T21:43:33.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7fecf48d8640 1 -- start start 2023-07-06T21:43:33.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7fecf48d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf01587d0 0x7fecf0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7fecf48d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fecf00710c0 0x7fecf00cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7fecf48d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf006fae0 con 0x7fecf0158400 2023-07-06T21:43:33.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7fecf48d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf006fdc0 con 0x7fecf00710c0 2023-07-06T21:43:33.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7fecf48d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf00700a0 con 0x7fecf01587d0 2023-07-06T21:43:33.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7fecee59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fecf0158400 0x7fecf00c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49324/0 (socket says 172.21.15.55:49324) 2023-07-06T21:43:33.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7fecee59c640 1 -- 172.21.15.55:0/2651587083 learned_addr learned my addr 172.21.15.55:0/2651587083 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:33.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7feceed9d640 1 --2- 172.21.15.55:0/2651587083 >> v2:172.21.15.55:3300/0 conn(0x7fecf00710c0 0x7fecf00cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7fece7fff640 1 --2- 172.21.15.55:0/2651587083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf01587d0 0x7fecf0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7fecedd9b640 1 -- 172.21.15.55:0/2651587083 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819240516 0 0) 0x7fecf006fae0 con 0x7fecf0158400 2023-07-06T21:43:33.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7fecedd9b640 1 -- 172.21.15.55:0/2651587083 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecdc003530 con 0x7fecf0158400 2023-07-06T21:43:33.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7feceed9d640 1 -- 172.21.15.55:0/2651587083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf01587d0 msgr2=0x7fecf0070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:33.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7feceed9d640 1 --2- 172.21.15.55:0/2651587083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf01587d0 0x7fecf0070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7feceed9d640 1 -- 172.21.15.55:0/2651587083 >> v1:172.21.15.55:6789/0 conn(0x7fecf0158400 legacy=0x7fecf00c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.421+0000 7feceed9d640 1 -- 172.21.15.55:0/2651587083 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf0070380 con 0x7fecf00710c0 2023-07-06T21:43:33.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.425+0000 7feceed9d640 1 --2- 172.21.15.55:0/2651587083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf00710c0 0x7fecf00cbaa0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fece8009d90 tx=0x7fece801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fd3deac5e5f0d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:33.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.425+0000 7fecedd9b640 1 -- 172.21.15.55:0/2651587083 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece80a58f0 con 0x7fecf00710c0 2023-07-06T21:43:33.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.425+0000 7fecedd9b640 1 -- 172.21.15.55:0/2651587083 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece80a5a50 con 0x7fecf00710c0 2023-07-06T21:43:33.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.425+0000 7fecedd9b640 1 -- 172.21.15.55:0/2651587083 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece80a5de0 con 0x7fecf00710c0 2023-07-06T21:43:33.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.425+0000 7fecf48d8640 1 -- 172.21.15.55:0/2651587083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf00710c0 msgr2=0x7fecf00cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.425+0000 7fecf48d8640 1 --2- 172.21.15.55:0/2651587083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf00710c0 0x7fecf00cbaa0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fece8009d90 tx=0x7fece801c920 comp rx=0 tx=0).stop 2023-07-06T21:43:33.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.425+0000 7fecf48d8640 1 -- 172.21.15.55:0/2651587083 shutdown_connections 2023-07-06T21:43:33.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.425+0000 7fecf48d8640 1 --2- 172.21.15.55:0/2651587083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf01587d0 0x7fecf0070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.425+0000 7fecf48d8640 1 --2- 172.21.15.55:0/2651587083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf00710c0 0x7fecf00cbaa0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.425+0000 7fecf48d8640 1 -- 172.21.15.55:0/2651587083 >> 172.21.15.55:0/2651587083 conn(0x7fecf00cded0 msgr2=0x7fecf00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:33.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.425+0000 7fecf48d8640 1 -- 172.21.15.55:0/2651587083 shutdown_connections 2023-07-06T21:43:33.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.425+0000 7fecf48d8640 1 -- 172.21.15.55:0/2651587083 wait complete. 2023-07-06T21:43:33.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7fecf48d8640 1 Processor -- start 2023-07-06T21:43:33.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7fecf48d8640 1 -- start start 2023-07-06T21:43:33.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7fecf48d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00710c0 0x7fecf00c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7fecf48d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecf0158400 0x7fecf0150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7fecf48d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf01587d0 0x7fecf00adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7fecf48d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf0152270 con 0x7fecf01587d0 2023-07-06T21:43:33.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7fecf48d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf00c6290 con 0x7fecf0158400 2023-07-06T21:43:33.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7fecf48d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf01f46c0 con 0x7fecf00710c0 2023-07-06T21:43:33.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7feceed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf01587d0 0x7fecf00adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7feceed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf01587d0 0x7fecf00adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35408/0 (socket says 172.21.15.55:35408) 2023-07-06T21:43:33.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7feceed9d640 1 -- 172.21.15.55:0/1957618920 learned_addr learned my addr 172.21.15.55:0/1957618920 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:33.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7fecee59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00710c0 0x7fecf00c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7fece7fff640 1 --2- 172.21.15.55:0/1957618920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecf0158400 0x7fecf0150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7feceed9d640 1 -- 172.21.15.55:0/1957618920 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00710c0 msgr2=0x7fecf00c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7feceed9d640 1 --2- 172.21.15.55:0/1957618920 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00710c0 0x7fecf00c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7feceed9d640 1 -- 172.21.15.55:0/1957618920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecf0158400 msgr2=0x7fecf0150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7feceed9d640 1 --2- 172.21.15.55:0/1957618920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecf0158400 0x7fecf0150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7feceed9d640 1 -- 172.21.15.55:0/1957618920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece8009a70 con 0x7fecf01587d0 2023-07-06T21:43:33.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7feceed9d640 1 --2- 172.21.15.55:0/1957618920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf01587d0 0x7fecf00adf50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fece80b0040 tx=0x7fece80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:33.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7fece6ffd640 1 -- 172.21.15.55:0/1957618920 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece80b9860 con 0x7fecf01587d0 2023-07-06T21:43:33.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7fece6ffd640 1 -- 172.21.15.55:0/1957618920 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece80b99c0 con 0x7fecf01587d0 2023-07-06T21:43:33.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7fece6ffd640 1 -- 172.21.15.55:0/1957618920 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece80b9d70 con 0x7fecf01587d0 2023-07-06T21:43:33.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.429+0000 7fecf48d8640 1 -- 172.21.15.55:0/1957618920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf0151980 con 0x7fecf01587d0 2023-07-06T21:43:33.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.433+0000 7fecf48d8640 1 -- 172.21.15.55:0/1957618920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf0151f00 con 0x7fecf01587d0 2023-07-06T21:43:33.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.433+0000 7fecf48d8640 1 -- 172.21.15.55:0/1957618920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf006c580 con 0x7fecf01587d0 2023-07-06T21:43:33.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.433+0000 7fece6ffd640 1 -- 172.21.15.55:0/1957618920 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fece80c4460 con 0x7fecf01587d0 2023-07-06T21:43:33.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.433+0000 7fece6ffd640 1 --2- 172.21.15.55:0/1957618920 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fecd0066280 0x7fecd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.433+0000 7fece6ffd640 1 -- 172.21.15.55:0/1957618920 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fece811f0d0 con 0x7fecf01587d0 2023-07-06T21:43:33.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.433+0000 7fecee59c640 1 --2- 172.21.15.55:0/1957618920 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fecd0066280 0x7fecd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.433+0000 7fecee59c640 1 --2- 172.21.15.55:0/1957618920 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fecd0066280 0x7fecd0068730 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fece00011f0 tx=0x7fece0007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:33.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.437+0000 7fece6ffd640 1 -- 172.21.15.55:0/1957618920 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fece80ec420 con 0x7fecf01587d0 2023-07-06T21:43:33.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.645+0000 7fecf48d8640 1 -- 172.21.15.55:0/1957618920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fecf0066d60 con 0x7fecf01587d0 2023-07-06T21:43:33.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.645+0000 7fece6ffd640 1 -- 172.21.15.55:0/1957618920 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1270 (secure 0 0 0) 0x7fece80efa40 con 0x7fecf01587d0 2023-07-06T21:43:33.653 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:33.653 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":109,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":42,"num_osds":8,"num_up_osds":8,"osd_up_since":1688679717,"num_in_osds":8,"osd_in_since":1688679707,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":242352128,"bytes_avail":772851761152,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5433}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-07-06T21:43:07.655933+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-06T21:43:33.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.645+0000 7fecf48d8640 1 -- 172.21.15.55:0/1957618920 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fecd0066280 msgr2=0x7fecd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.645+0000 7fecf48d8640 1 --2- 172.21.15.55:0/1957618920 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fecd0066280 0x7fecd0068730 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fece00011f0 tx=0x7fece0007d40 comp rx=0 tx=0).stop 2023-07-06T21:43:33.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.645+0000 7fecf48d8640 1 -- 172.21.15.55:0/1957618920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf01587d0 msgr2=0x7fecf00adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.645+0000 7fecf48d8640 1 --2- 172.21.15.55:0/1957618920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf01587d0 0x7fecf00adf50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fece80b0040 tx=0x7fece80196c0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.645+0000 7fecf48d8640 1 -- 172.21.15.55:0/1957618920 shutdown_connections 2023-07-06T21:43:33.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.645+0000 7fecf48d8640 1 --2- 172.21.15.55:0/1957618920 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fecd0066280 0x7fecd0068730 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.645+0000 7fecf48d8640 1 --2- 172.21.15.55:0/1957618920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf01587d0 0x7fecf00adf50 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.645+0000 7fecf48d8640 1 --2- 172.21.15.55:0/1957618920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecf0158400 0x7fecf0150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.645+0000 7fecf48d8640 1 --2- 172.21.15.55:0/1957618920 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00710c0 0x7fecf00c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.645+0000 7fecf48d8640 1 -- 172.21.15.55:0/1957618920 >> 172.21.15.55:0/1957618920 conn(0x7fecf00cded0 msgr2=0x7fecf00aef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.645+0000 7fecf48d8640 1 -- 172.21.15.55:0/1957618920 shutdown_connections 2023-07-06T21:43:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.645+0000 7fecf48d8640 1 -- 172.21.15.55:0/1957618920 wait complete. 2023-07-06T21:43:33.674 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-06T21:43:33.674 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:43:33.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20ff46d640 1 Processor -- start 2023-07-06T21:43:33.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20ff46d640 1 -- start start 2023-07-06T21:43:33.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20ff46d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20f815f4e0 0x7f20f80b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20ff46d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f20f80b4250 0x7f20f815c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20ff46d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f806a160 con 0x7f20f815b9d0 2023-07-06T21:43:33.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20ff46d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f815f910 con 0x7f20f80b4250 2023-07-06T21:43:33.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20ff46d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f815bda0 con 0x7f20f815f4e0 2023-07-06T21:43:33.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20fda0a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f20f80b4250 0x7f20f815c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20fca08640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20f815f4e0 0x7f20f80b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20fd209640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f20f815b9d0 0x7f20f80ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:34744/0 (socket says 172.21.15.55:34744) 2023-07-06T21:43:33.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20fd209640 1 -- 172.21.15.55:0/1617400559 learned_addr learned my addr 172.21.15.55:0/1617400559 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:33.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20fda0a640 1 -- 172.21.15.55:0/1617400559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20f815f4e0 msgr2=0x7f20f80b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:33.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20fda0a640 1 --2- 172.21.15.55:0/1617400559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20f815f4e0 0x7f20f80b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20fda0a640 1 -- 172.21.15.55:0/1617400559 >> v1:172.21.15.138:6789/0 conn(0x7f20f815b9d0 legacy=0x7f20f80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20fda0a640 1 -- 172.21.15.55:0/1617400559 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f80b46b0 con 0x7f20f80b4250 2023-07-06T21:43:33.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20effff640 1 -- 172.21.15.55:0/1617400559 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894765322 0 0) 0x7f20f806a160 con 0x7f20f815b9d0 2023-07-06T21:43:33.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.809+0000 7f20fca08640 1 --2- 172.21.15.55:0/1617400559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20f815f4e0 0x7f20f80b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:33.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.813+0000 7f20fda0a640 1 --2- 172.21.15.55:0/1617400559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f80b4250 0x7f20f815c110 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009d90 tx=0x7f20f001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a987d44902e77330 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:33.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.813+0000 7f20effff640 1 -- 172.21.15.55:0/1617400559 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f00a5700 con 0x7f20f80b4250 2023-07-06T21:43:33.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.813+0000 7f20effff640 1 -- 172.21.15.55:0/1617400559 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f00a5860 con 0x7f20f80b4250 2023-07-06T21:43:33.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.813+0000 7f20effff640 1 -- 172.21.15.55:0/1617400559 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f00a5bf0 con 0x7f20f80b4250 2023-07-06T21:43:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.813+0000 7f20ff46d640 1 -- 172.21.15.55:0/1617400559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f80b4250 msgr2=0x7f20f815c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.813+0000 7f20ff46d640 1 --2- 172.21.15.55:0/1617400559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f80b4250 0x7f20f815c110 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009d90 tx=0x7f20f001c950 comp rx=0 tx=0).stop 2023-07-06T21:43:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.813+0000 7f20ff46d640 1 -- 172.21.15.55:0/1617400559 shutdown_connections 2023-07-06T21:43:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.813+0000 7f20ff46d640 1 --2- 172.21.15.55:0/1617400559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f80b4250 0x7f20f815c110 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.813+0000 7f20ff46d640 1 --2- 172.21.15.55:0/1617400559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20f815f4e0 0x7f20f80b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.813+0000 7f20ff46d640 1 -- 172.21.15.55:0/1617400559 >> 172.21.15.55:0/1617400559 conn(0x7f20f80ced10 msgr2=0x7f20f80cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:33.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.813+0000 7f20ff46d640 1 -- 172.21.15.55:0/1617400559 shutdown_connections 2023-07-06T21:43:33.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.813+0000 7f20ff46d640 1 -- 172.21.15.55:0/1617400559 wait complete. 2023-07-06T21:43:33.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20ff46d640 1 Processor -- start 2023-07-06T21:43:33.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20ff46d640 1 -- start start 2023-07-06T21:43:33.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20ff46d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f80b4250 0x7f20f814d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20ff46d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20f815b9d0 0x7f20f80c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20ff46d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f815f4e0 0x7f20f81501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20ff46d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f8159920 con 0x7f20f80b4250 2023-07-06T21:43:33.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20ff46d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f8158d10 con 0x7f20f815f4e0 2023-07-06T21:43:33.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20ff46d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f8158ff0 con 0x7f20f815b9d0 2023-07-06T21:43:33.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20fd209640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f80b4250 0x7f20f814d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20fd209640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f80b4250 0x7f20f814d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35418/0 (socket says 172.21.15.55:35418) 2023-07-06T21:43:33.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20fd209640 1 -- 172.21.15.55:0/2126891876 learned_addr learned my addr 172.21.15.55:0/2126891876 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:33.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20fca08640 1 --2- 172.21.15.55:0/2126891876 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20f815b9d0 0x7f20f80c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20fda0a640 1 --2- 172.21.15.55:0/2126891876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f815f4e0 0x7f20f81501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20fd209640 1 -- 172.21.15.55:0/2126891876 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20f815b9d0 msgr2=0x7f20f80c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20fd209640 1 --2- 172.21.15.55:0/2126891876 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20f815b9d0 0x7f20f80c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20fd209640 1 -- 172.21.15.55:0/2126891876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f815f4e0 msgr2=0x7f20f81501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:33.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20fd209640 1 --2- 172.21.15.55:0/2126891876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f815f4e0 0x7f20f81501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:33.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20fd209640 1 -- 172.21.15.55:0/2126891876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e8009420 con 0x7f20f80b4250 2023-07-06T21:43:33.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20fd209640 1 --2- 172.21.15.55:0/2126891876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f80b4250 0x7f20f814d640 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f20f40011f0 tx=0x7f20f400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:33.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20edffb640 1 -- 172.21.15.55:0/2126891876 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f40074e0 con 0x7f20f80b4250 2023-07-06T21:43:33.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20edffb640 1 -- 172.21.15.55:0/2126891876 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f4007640 con 0x7f20f80b4250 2023-07-06T21:43:33.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20ff46d640 1 -- 172.21.15.55:0/2126891876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f0009a70 con 0x7f20f80b4250 2023-07-06T21:43:33.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.817+0000 7f20edffb640 1 -- 172.21.15.55:0/2126891876 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f4004a10 con 0x7f20f80b4250 2023-07-06T21:43:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.821+0000 7f20ff46d640 1 -- 172.21.15.55:0/2126891876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f81595b0 con 0x7f20f80b4250 2023-07-06T21:43:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.821+0000 7f20ff46d640 1 -- 172.21.15.55:0/2126891876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f8066d60 con 0x7f20f80b4250 2023-07-06T21:43:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.821+0000 7f20edffb640 1 -- 172.21.15.55:0/2126891876 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f20f4004b70 con 0x7f20f80b4250 2023-07-06T21:43:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.821+0000 7f20edffb640 1 --2- 172.21.15.55:0/2126891876 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f20dc0662b0 0x7f20dc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.821+0000 7f20edffb640 1 -- 172.21.15.55:0/2126891876 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f20f40832b0 con 0x7f20f80b4250 2023-07-06T21:43:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.821+0000 7f20fca08640 1 --2- 172.21.15.55:0/2126891876 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f20dc0662b0 0x7f20dc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.821+0000 7f20fca08640 1 --2- 172.21.15.55:0/2126891876 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f20dc0662b0 0x7f20dc068760 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f20f81f71a0 tx=0x7f20e8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.825+0000 7f20edffb640 1 -- 172.21.15.55:0/2126891876 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f20f4050680 con 0x7f20f80b4250 2023-07-06T21:43:33.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.977+0000 7f20ff46d640 1 -- 172.21.15.55:0/2126891876 --> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20f8159160 con 0x7f20dc0662b0 2023-07-06T21:43:33.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.985+0000 7f20edffb640 1 -- 172.21.15.55:0/2126891876 <== mgr.4101 v2:172.21.15.55:6832/1575998409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311080 (secure 0 0 0) 0x7f20f8159160 con 0x7f20dc0662b0 2023-07-06T21:43:33.997 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:43:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.989+0000 7f20ff46d640 1 -- 172.21.15.55:0/2126891876 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f20dc0662b0 msgr2=0x7f20dc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:34.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.989+0000 7f20ff46d640 1 --2- 172.21.15.55:0/2126891876 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f20dc0662b0 0x7f20dc068760 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f20f81f71a0 tx=0x7f20e8009190 comp rx=0 tx=0).stop 2023-07-06T21:43:34.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.989+0000 7f20ff46d640 1 -- 172.21.15.55:0/2126891876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f80b4250 msgr2=0x7f20f814d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:34.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.989+0000 7f20ff46d640 1 --2- 172.21.15.55:0/2126891876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f80b4250 0x7f20f814d640 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f20f40011f0 tx=0x7f20f400c9b0 comp rx=0 tx=0).stop 2023-07-06T21:43:34.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.989+0000 7f20ff46d640 1 -- 172.21.15.55:0/2126891876 shutdown_connections 2023-07-06T21:43:34.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.989+0000 7f20ff46d640 1 --2- 172.21.15.55:0/2126891876 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f20dc0662b0 0x7f20dc068760 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.989+0000 7f20ff46d640 1 --2- 172.21.15.55:0/2126891876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f815f4e0 0x7f20f81501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.989+0000 7f20ff46d640 1 --2- 172.21.15.55:0/2126891876 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20f815b9d0 0x7f20f80c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.989+0000 7f20ff46d640 1 --2- 172.21.15.55:0/2126891876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f80b4250 0x7f20f814d640 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.989+0000 7f20ff46d640 1 -- 172.21.15.55:0/2126891876 >> 172.21.15.55:0/2126891876 conn(0x7f20f80ced10 msgr2=0x7f20f80d15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.989+0000 7f20ff46d640 1 -- 172.21.15.55:0/2126891876 shutdown_connections 2023-07-06T21:43:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:33.989+0000 7f20ff46d640 1 -- 172.21.15.55:0/2126891876 wait complete. 2023-07-06T21:43:34.017 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2023-07-06T21:43:33.660725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237024,"kb_used_data":5024,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754737696,"statfs":{"total":773094113280,"available":772851400704,"internally_reserved":0,"allocated":5144576,"data_stored":2933630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001200"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659520+0000","last_change":"2023-07-06T21:43:28.127352+0000","last_active":"2023-07-06T21:43:29.659520+0000","last_peered":"2023-07-06T21:43:29.659520+0000","last_clean":"2023-07-06T21:43:29.659520+0000","last_became_active":"2023-07-06T21:43:28.127051+0000","last_became_peered":"2023-07-06T21:43:28.127051+0000","last_unstale":"2023-07-06T21:43:29.659520+0000","last_undegraded":"2023-07-06T21:43:29.659520+0000","last_fullsized":"2023-07-06T21:43:29.659520+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:21:43.990348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.126237+0000","last_change":"2023-07-06T21:43:28.130627+0000","last_active":"2023-07-06T21:43:29.126237+0000","last_peered":"2023-07-06T21:43:29.126237+0000","last_clean":"2023-07-06T21:43:29.126237+0000","last_became_active":"2023-07-06T21:43:28.130350+0000","last_became_peered":"2023-07-06T21:43:28.130350+0000","last_unstale":"2023-07-06T21:43:29.126237+0000","last_undegraded":"2023-07-06T21:43:29.126237+0000","last_fullsized":"2023-07-06T21:43:29.126237+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:21:43.990348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739044+0000","last_change":"2023-07-06T21:43:28.146808+0000","last_active":"2023-07-06T21:43:29.739044+0000","last_peered":"2023-07-06T21:43:29.739044+0000","last_clean":"2023-07-06T21:43:29.739044+0000","last_became_active":"2023-07-06T21:43:28.146548+0000","last_became_peered":"2023-07-06T21:43:28.146548+0000","last_unstale":"2023-07-06T21:43:29.739044+0000","last_undegraded":"2023-07-06T21:43:29.739044+0000","last_fullsized":"2023-07-06T21:43:29.739044+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:01:40.414000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162745+0000","last_change":"2023-07-06T21:43:28.148729+0000","last_active":"2023-07-06T21:43:30.162745+0000","last_peered":"2023-07-06T21:43:30.162745+0000","last_clean":"2023-07-06T21:43:30.162745+0000","last_became_active":"2023-07-06T21:43:28.148440+0000","last_became_peered":"2023-07-06T21:43:28.148440+0000","last_unstale":"2023-07-06T21:43:30.162745+0000","last_undegraded":"2023-07-06T21:43:30.162745+0000","last_fullsized":"2023-07-06T21:43:30.162745+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:17:01.128035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.125966+0000","last_change":"2023-07-06T21:43:28.134063+0000","last_active":"2023-07-06T21:43:29.125966+0000","last_peered":"2023-07-06T21:43:29.125966+0000","last_clean":"2023-07-06T21:43:29.125966+0000","last_became_active":"2023-07-06T21:43:28.133675+0000","last_became_peered":"2023-07-06T21:43:28.133675+0000","last_unstale":"2023-07-06T21:43:29.125966+0000","last_undegraded":"2023-07-06T21:43:29.125966+0000","last_fullsized":"2023-07-06T21:43:29.125966+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:35:43.943388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084600+0000","last_change":"2023-07-06T21:43:28.127048+0000","last_active":"2023-07-06T21:43:30.084600+0000","last_peered":"2023-07-06T21:43:30.084600+0000","last_clean":"2023-07-06T21:43:30.084600+0000","last_became_active":"2023-07-06T21:43:28.126799+0000","last_became_peered":"2023-07-06T21:43:28.126799+0000","last_unstale":"2023-07-06T21:43:30.084600+0000","last_undegraded":"2023-07-06T21:43:30.084600+0000","last_fullsized":"2023-07-06T21:43:30.084600+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:35:43.943388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659716+0000","last_change":"2023-07-06T21:43:28.144013+0000","last_active":"2023-07-06T21:43:29.659716+0000","last_peered":"2023-07-06T21:43:29.659716+0000","last_clean":"2023-07-06T21:43:29.659716+0000","last_became_active":"2023-07-06T21:43:28.143672+0000","last_became_peered":"2023-07-06T21:43:28.143672+0000","last_unstale":"2023-07-06T21:43:29.659716+0000","last_undegraded":"2023-07-06T21:43:29.659716+0000","last_fullsized":"2023-07-06T21:43:29.659716+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:29:00.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162308+0000","last_change":"2023-07-06T21:43:28.148219+0000","last_active":"2023-07-06T21:43:30.162308+0000","last_peered":"2023-07-06T21:43:30.162308+0000","last_clean":"2023-07-06T21:43:30.162308+0000","last_became_active":"2023-07-06T21:43:28.147958+0000","last_became_peered":"2023-07-06T21:43:28.147958+0000","last_unstale":"2023-07-06T21:43:30.162308+0000","last_undegraded":"2023-07-06T21:43:30.162308+0000","last_fullsized":"2023-07-06T21:43:30.162308+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:43:39.474333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162867+0000","last_change":"2023-07-06T21:43:28.145606+0000","last_active":"2023-07-06T21:43:30.162867+0000","last_peered":"2023-07-06T21:43:30.162867+0000","last_clean":"2023-07-06T21:43:30.162867+0000","last_became_active":"2023-07-06T21:43:28.145139+0000","last_became_peered":"2023-07-06T21:43:28.145139+0000","last_unstale":"2023-07-06T21:43:30.162867+0000","last_undegraded":"2023-07-06T21:43:30.162867+0000","last_fullsized":"2023-07-06T21:43:30.162867+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:34:55.955941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162829+0000","last_change":"2023-07-06T21:43:28.146439+0000","last_active":"2023-07-06T21:43:30.162829+0000","last_peered":"2023-07-06T21:43:30.162829+0000","last_clean":"2023-07-06T21:43:30.162829+0000","last_became_active":"2023-07-06T21:43:28.146034+0000","last_became_peered":"2023-07-06T21:43:28.146034+0000","last_unstale":"2023-07-06T21:43:30.162829+0000","last_undegraded":"2023-07-06T21:43:30.162829+0000","last_fullsized":"2023-07-06T21:43:30.162829+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:50:04.428389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162984+0000","last_change":"2023-07-06T21:43:28.134000+0000","last_active":"2023-07-06T21:43:30.162984+0000","last_peered":"2023-07-06T21:43:30.162984+0000","last_clean":"2023-07-06T21:43:30.162984+0000","last_became_active":"2023-07-06T21:43:28.133611+0000","last_became_peered":"2023-07-06T21:43:28.133611+0000","last_unstale":"2023-07-06T21:43:30.162984+0000","last_undegraded":"2023-07-06T21:43:30.162984+0000","last_fullsized":"2023-07-06T21:43:30.162984+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:08:19.012688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.126029+0000","last_change":"2023-07-06T21:43:28.137975+0000","last_active":"2023-07-06T21:43:29.126029+0000","last_peered":"2023-07-06T21:43:29.126029+0000","last_clean":"2023-07-06T21:43:29.126029+0000","last_became_active":"2023-07-06T21:43:28.136296+0000","last_became_peered":"2023-07-06T21:43:28.136296+0000","last_unstale":"2023-07-06T21:43:29.126029+0000","last_undegraded":"2023-07-06T21:43:29.126029+0000","last_fullsized":"2023-07-06T21:43:29.126029+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:20:21.050440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124351+0000","last_change":"2023-07-06T21:43:28.135159+0000","last_active":"2023-07-06T21:43:29.124351+0000","last_peered":"2023-07-06T21:43:29.124351+0000","last_clean":"2023-07-06T21:43:29.124351+0000","last_became_active":"2023-07-06T21:43:28.134839+0000","last_became_peered":"2023-07-06T21:43:28.134839+0000","last_unstale":"2023-07-06T21:43:29.124351+0000","last_undegraded":"2023-07-06T21:43:29.124351+0000","last_fullsized":"2023-07-06T21:43:29.124351+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:52:54.983957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162378+0000","last_change":"2023-07-06T21:43:28.145467+0000","last_active":"2023-07-06T21:43:30.162378+0000","last_peered":"2023-07-06T21:43:30.162378+0000","last_clean":"2023-07-06T21:43:30.162378+0000","last_became_active":"2023-07-06T21:43:28.145165+0000","last_became_peered":"2023-07-06T21:43:28.145165+0000","last_unstale":"2023-07-06T21:43:30.162378+0000","last_undegraded":"2023-07-06T21:43:30.162378+0000","last_fullsized":"2023-07-06T21:43:30.162378+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:33.701130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084563+0000","last_change":"2023-07-06T21:43:28.131975+0000","last_active":"2023-07-06T21:43:30.084563+0000","last_peered":"2023-07-06T21:43:30.084563+0000","last_clean":"2023-07-06T21:43:30.084563+0000","last_became_active":"2023-07-06T21:43:28.131704+0000","last_became_peered":"2023-07-06T21:43:28.131704+0000","last_unstale":"2023-07-06T21:43:30.084563+0000","last_undegraded":"2023-07-06T21:43:30.084563+0000","last_fullsized":"2023-07-06T21:43:30.084563+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:11.433217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.381641+0000","last_change":"2023-07-06T21:43:28.147392+0000","last_active":"2023-07-06T21:43:29.381641+0000","last_peered":"2023-07-06T21:43:29.381641+0000","last_clean":"2023-07-06T21:43:29.381641+0000","last_became_active":"2023-07-06T21:43:28.146936+0000","last_became_peered":"2023-07-06T21:43:28.146936+0000","last_unstale":"2023-07-06T21:43:29.381641+0000","last_undegraded":"2023-07-06T21:43:29.381641+0000","last_fullsized":"2023-07-06T21:43:29.381641+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:43:44.763141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739116+0000","last_change":"2023-07-06T21:43:28.131820+0000","last_active":"2023-07-06T21:43:29.739116+0000","last_peered":"2023-07-06T21:43:29.739116+0000","last_clean":"2023-07-06T21:43:29.739116+0000","last_became_active":"2023-07-06T21:43:28.131538+0000","last_became_peered":"2023-07-06T21:43:28.131538+0000","last_unstale":"2023-07-06T21:43:29.739116+0000","last_undegraded":"2023-07-06T21:43:29.739116+0000","last_fullsized":"2023-07-06T21:43:29.739116+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:51:33.945546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.738851+0000","last_change":"2023-07-06T21:43:28.136842+0000","last_active":"2023-07-06T21:43:29.738851+0000","last_peered":"2023-07-06T21:43:29.738851+0000","last_clean":"2023-07-06T21:43:29.738851+0000","last_became_active":"2023-07-06T21:43:28.136346+0000","last_became_peered":"2023-07-06T21:43:28.136346+0000","last_unstale":"2023-07-06T21:43:29.738851+0000","last_undegraded":"2023-07-06T21:43:29.738851+0000","last_fullsized":"2023-07-06T21:43:29.738851+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:25:16.938438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.382102+0000","last_change":"2023-07-06T21:43:28.147255+0000","last_active":"2023-07-06T21:43:29.382102+0000","last_peered":"2023-07-06T21:43:29.382102+0000","last_clean":"2023-07-06T21:43:29.382102+0000","last_became_active":"2023-07-06T21:43:28.146926+0000","last_became_peered":"2023-07-06T21:43:28.146926+0000","last_unstale":"2023-07-06T21:43:29.382102+0000","last_undegraded":"2023-07-06T21:43:29.382102+0000","last_fullsized":"2023-07-06T21:43:29.382102+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:33:39.880266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124581+0000","last_change":"2023-07-06T21:43:28.137042+0000","last_active":"2023-07-06T21:43:29.124581+0000","last_peered":"2023-07-06T21:43:29.124581+0000","last_clean":"2023-07-06T21:43:29.124581+0000","last_became_active":"2023-07-06T21:43:28.136771+0000","last_became_peered":"2023-07-06T21:43:28.136771+0000","last_unstale":"2023-07-06T21:43:29.124581+0000","last_undegraded":"2023-07-06T21:43:29.124581+0000","last_fullsized":"2023-07-06T21:43:29.124581+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:23:01.411836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084842+0000","last_change":"2023-07-06T21:43:28.142922+0000","last_active":"2023-07-06T21:43:30.084842+0000","last_peered":"2023-07-06T21:43:30.084842+0000","last_clean":"2023-07-06T21:43:30.084842+0000","last_became_active":"2023-07-06T21:43:28.142659+0000","last_became_peered":"2023-07-06T21:43:28.142659+0000","last_unstale":"2023-07-06T21:43:30.084842+0000","last_undegraded":"2023-07-06T21:43:30.084842+0000","last_fullsized":"2023-07-06T21:43:30.084842+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:02:11.572115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162930+0000","last_change":"2023-07-06T21:43:28.148976+0000","last_active":"2023-07-06T21:43:30.162930+0000","last_peered":"2023-07-06T21:43:30.162930+0000","last_clean":"2023-07-06T21:43:30.162930+0000","last_became_active":"2023-07-06T21:43:28.148667+0000","last_became_peered":"2023-07-06T21:43:28.148667+0000","last_unstale":"2023-07-06T21:43:30.162930+0000","last_undegraded":"2023-07-06T21:43:30.162930+0000","last_fullsized":"2023-07-06T21:43:30.162930+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:00:35.213542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.381857+0000","last_change":"2023-07-06T21:43:28.141122+0000","last_active":"2023-07-06T21:43:29.381857+0000","last_peered":"2023-07-06T21:43:29.381857+0000","last_clean":"2023-07-06T21:43:29.381857+0000","last_became_active":"2023-07-06T21:43:28.140807+0000","last_became_peered":"2023-07-06T21:43:28.140807+0000","last_unstale":"2023-07-06T21:43:29.381857+0000","last_undegraded":"2023-07-06T21:43:29.381857+0000","last_fullsized":"2023-07-06T21:43:29.381857+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:17:47.136531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.381853+0000","last_change":"2023-07-06T21:43:28.144653+0000","last_active":"2023-07-06T21:43:29.381853+0000","last_peered":"2023-07-06T21:43:29.381853+0000","last_clean":"2023-07-06T21:43:29.381853+0000","last_became_active":"2023-07-06T21:43:28.144334+0000","last_became_peered":"2023-07-06T21:43:28.144334+0000","last_unstale":"2023-07-06T21:43:29.381853+0000","last_undegraded":"2023-07-06T21:43:29.381853+0000","last_fullsized":"2023-07-06T21:43:29.381853+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:18:53.626479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.382171+0000","last_change":"2023-07-06T21:43:28.154302+0000","last_active":"2023-07-06T21:43:29.382171+0000","last_peered":"2023-07-06T21:43:29.382171+0000","last_clean":"2023-07-06T21:43:29.382171+0000","last_became_active":"2023-07-06T21:43:28.153962+0000","last_became_peered":"2023-07-06T21:43:28.153962+0000","last_unstale":"2023-07-06T21:43:29.382171+0000","last_undegraded":"2023-07-06T21:43:29.382171+0000","last_fullsized":"2023-07-06T21:43:29.382171+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:38.827234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124553+0000","last_change":"2023-07-06T21:43:28.132756+0000","last_active":"2023-07-06T21:43:29.124553+0000","last_peered":"2023-07-06T21:43:29.124553+0000","last_clean":"2023-07-06T21:43:29.124553+0000","last_became_active":"2023-07-06T21:43:28.132516+0000","last_became_peered":"2023-07-06T21:43:28.132516+0000","last_unstale":"2023-07-06T21:43:29.124553+0000","last_undegraded":"2023-07-06T21:43:29.124553+0000","last_fullsized":"2023-07-06T21:43:29.124553+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:31:46.134851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739146+0000","last_change":"2023-07-06T21:43:28.131053+0000","last_active":"2023-07-06T21:43:29.739146+0000","last_peered":"2023-07-06T21:43:29.739146+0000","last_clean":"2023-07-06T21:43:29.739146+0000","last_became_active":"2023-07-06T21:43:28.130746+0000","last_became_peered":"2023-07-06T21:43:28.130746+0000","last_unstale":"2023-07-06T21:43:29.739146+0000","last_undegraded":"2023-07-06T21:43:29.739146+0000","last_fullsized":"2023-07-06T21:43:29.739146+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:29:50.239395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.126171+0000","last_change":"2023-07-06T21:43:28.138190+0000","last_active":"2023-07-06T21:43:29.126171+0000","last_peered":"2023-07-06T21:43:29.126171+0000","last_clean":"2023-07-06T21:43:29.126171+0000","last_became_active":"2023-07-06T21:43:28.136654+0000","last_became_peered":"2023-07-06T21:43:28.136654+0000","last_unstale":"2023-07-06T21:43:29.126171+0000","last_undegraded":"2023-07-06T21:43:29.126171+0000","last_fullsized":"2023-07-06T21:43:29.126171+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:02:11.572115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.381890+0000","last_change":"2023-07-06T21:43:28.154190+0000","last_active":"2023-07-06T21:43:29.381890+0000","last_peered":"2023-07-06T21:43:29.381890+0000","last_clean":"2023-07-06T21:43:29.381890+0000","last_became_active":"2023-07-06T21:43:28.153857+0000","last_became_peered":"2023-07-06T21:43:28.153857+0000","last_unstale":"2023-07-06T21:43:29.381890+0000","last_undegraded":"2023-07-06T21:43:29.381890+0000","last_fullsized":"2023-07-06T21:43:29.381890+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:09:42.992597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.738852+0000","last_change":"2023-07-06T21:43:28.131768+0000","last_active":"2023-07-06T21:43:29.738852+0000","last_peered":"2023-07-06T21:43:29.738852+0000","last_clean":"2023-07-06T21:43:29.738852+0000","last_became_active":"2023-07-06T21:43:28.131433+0000","last_became_peered":"2023-07-06T21:43:28.131433+0000","last_unstale":"2023-07-06T21:43:29.738852+0000","last_undegraded":"2023-07-06T21:43:29.738852+0000","last_fullsized":"2023-07-06T21:43:29.738852+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:52:09.226832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084591+0000","last_change":"2023-07-06T21:43:28.124621+0000","last_active":"2023-07-06T21:43:30.084591+0000","last_peered":"2023-07-06T21:43:30.084591+0000","last_clean":"2023-07-06T21:43:30.084591+0000","last_became_active":"2023-07-06T21:43:28.124350+0000","last_became_peered":"2023-07-06T21:43:28.124350+0000","last_unstale":"2023-07-06T21:43:30.084591+0000","last_undegraded":"2023-07-06T21:43:30.084591+0000","last_fullsized":"2023-07-06T21:43:30.084591+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:35:03.288088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124266+0000","last_change":"2023-07-06T21:43:28.144210+0000","last_active":"2023-07-06T21:43:29.124266+0000","last_peered":"2023-07-06T21:43:29.124266+0000","last_clean":"2023-07-06T21:43:29.124266+0000","last_became_active":"2023-07-06T21:43:28.143937+0000","last_became_peered":"2023-07-06T21:43:28.143937+0000","last_unstale":"2023-07-06T21:43:29.124266+0000","last_undegraded":"2023-07-06T21:43:29.124266+0000","last_fullsized":"2023-07-06T21:43:29.124266+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:22:27.729197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.128955+0000","last_change":"2023-07-06T21:43:28.144632+0000","last_active":"2023-07-06T21:43:29.128955+0000","last_peered":"2023-07-06T21:43:29.128955+0000","last_clean":"2023-07-06T21:43:29.128955+0000","last_became_active":"2023-07-06T21:43:28.143765+0000","last_became_peered":"2023-07-06T21:43:28.143765+0000","last_unstale":"2023-07-06T21:43:29.128955+0000","last_undegraded":"2023-07-06T21:43:29.128955+0000","last_fullsized":"2023-07-06T21:43:29.128955+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:25:18.218214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.085216+0000","last_change":"2023-07-06T21:43:27.726313+0000","last_active":"2023-07-06T21:43:30.085216+0000","last_peered":"2023-07-06T21:43:30.085216+0000","last_clean":"2023-07-06T21:43:30.085216+0000","last_became_active":"2023-07-06T21:43:27.726054+0000","last_became_peered":"2023-07-06T21:43:27.726054+0000","last_unstale":"2023-07-06T21:43:30.085216+0000","last_undegraded":"2023-07-06T21:43:30.085216+0000","last_fullsized":"2023-07-06T21:43:30.085216+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:32:42.463739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.382233+0000","last_change":"2023-07-06T21:43:28.148103+0000","last_active":"2023-07-06T21:43:29.382233+0000","last_peered":"2023-07-06T21:43:29.382233+0000","last_clean":"2023-07-06T21:43:29.382233+0000","last_became_active":"2023-07-06T21:43:28.147823+0000","last_became_peered":"2023-07-06T21:43:28.147823+0000","last_unstale":"2023-07-06T21:43:29.382233+0000","last_undegraded":"2023-07-06T21:43:29.382233+0000","last_fullsized":"2023-07-06T21:43:29.382233+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:34:11.156063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739174+0000","last_change":"2023-07-06T21:43:27.727188+0000","last_active":"2023-07-06T21:43:29.739174+0000","last_peered":"2023-07-06T21:43:29.739174+0000","last_clean":"2023-07-06T21:43:29.739174+0000","last_became_active":"2023-07-06T21:43:27.726961+0000","last_became_peered":"2023-07-06T21:43:27.726961+0000","last_unstale":"2023-07-06T21:43:29.739174+0000","last_undegraded":"2023-07-06T21:43:29.739174+0000","last_fullsized":"2023-07-06T21:43:29.739174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:24:18.634902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.126214+0000","last_change":"2023-07-06T21:43:28.125780+0000","last_active":"2023-07-06T21:43:29.126214+0000","last_peered":"2023-07-06T21:43:29.126214+0000","last_clean":"2023-07-06T21:43:29.126214+0000","last_became_active":"2023-07-06T21:43:28.125455+0000","last_became_peered":"2023-07-06T21:43:28.125455+0000","last_unstale":"2023-07-06T21:43:29.126214+0000","last_undegraded":"2023-07-06T21:43:29.126214+0000","last_fullsized":"2023-07-06T21:43:29.126214+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:22:19.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.129128+0000","last_change":"2023-07-06T21:43:27.729704+0000","last_active":"2023-07-06T21:43:29.129128+0000","last_peered":"2023-07-06T21:43:29.129128+0000","last_clean":"2023-07-06T21:43:29.129128+0000","last_became_active":"2023-07-06T21:43:27.729223+0000","last_became_peered":"2023-07-06T21:43:27.729223+0000","last_unstale":"2023-07-06T21:43:29.129128+0000","last_undegraded":"2023-07-06T21:43:29.129128+0000","last_fullsized":"2023-07-06T21:43:29.129128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:43:38.466830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.129065+0000","last_change":"2023-07-06T21:43:28.152395+0000","last_active":"2023-07-06T21:43:29.129065+0000","last_peered":"2023-07-06T21:43:29.129065+0000","last_clean":"2023-07-06T21:43:29.129065+0000","last_became_active":"2023-07-06T21:43:28.147472+0000","last_became_peered":"2023-07-06T21:43:28.147472+0000","last_unstale":"2023-07-06T21:43:29.129065+0000","last_undegraded":"2023-07-06T21:43:29.129065+0000","last_fullsized":"2023-07-06T21:43:29.129065+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:43:16.189289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659349+0000","last_change":"2023-07-06T21:43:27.726889+0000","last_active":"2023-07-06T21:43:29.659349+0000","last_peered":"2023-07-06T21:43:29.659349+0000","last_clean":"2023-07-06T21:43:29.659349+0000","last_became_active":"2023-07-06T21:43:27.726598+0000","last_became_peered":"2023-07-06T21:43:27.726598+0000","last_unstale":"2023-07-06T21:43:29.659349+0000","last_undegraded":"2023-07-06T21:43:29.659349+0000","last_fullsized":"2023-07-06T21:43:29.659349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:57.876183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.738949+0000","last_change":"2023-07-06T21:43:28.146165+0000","last_active":"2023-07-06T21:43:29.738949+0000","last_peered":"2023-07-06T21:43:29.738949+0000","last_clean":"2023-07-06T21:43:29.738949+0000","last_became_active":"2023-07-06T21:43:28.145868+0000","last_became_peered":"2023-07-06T21:43:28.145868+0000","last_unstale":"2023-07-06T21:43:29.738949+0000","last_undegraded":"2023-07-06T21:43:29.738949+0000","last_fullsized":"2023-07-06T21:43:29.738949+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:49:35.873552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084958+0000","last_change":"2023-07-06T21:43:27.720422+0000","last_active":"2023-07-06T21:43:30.084958+0000","last_peered":"2023-07-06T21:43:30.084958+0000","last_clean":"2023-07-06T21:43:30.084958+0000","last_became_active":"2023-07-06T21:43:27.719826+0000","last_became_peered":"2023-07-06T21:43:27.719826+0000","last_unstale":"2023-07-06T21:43:30.084958+0000","last_undegraded":"2023-07-06T21:43:30.084958+0000","last_fullsized":"2023-07-06T21:43:30.084958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:21:42.982844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162545+0000","last_change":"2023-07-06T21:43:28.142537+0000","last_active":"2023-07-06T21:43:30.162545+0000","last_peered":"2023-07-06T21:43:30.162545+0000","last_clean":"2023-07-06T21:43:30.162545+0000","last_became_active":"2023-07-06T21:43:28.142283+0000","last_became_peered":"2023-07-06T21:43:28.142283+0000","last_unstale":"2023-07-06T21:43:30.162545+0000","last_undegraded":"2023-07-06T21:43:30.162545+0000","last_fullsized":"2023-07-06T21:43:30.162545+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:21:56.348051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739032+0000","last_change":"2023-07-06T21:43:27.727116+0000","last_active":"2023-07-06T21:43:29.739032+0000","last_peered":"2023-07-06T21:43:29.739032+0000","last_clean":"2023-07-06T21:43:29.739032+0000","last_became_active":"2023-07-06T21:43:27.726829+0000","last_became_peered":"2023-07-06T21:43:27.726829+0000","last_unstale":"2023-07-06T21:43:29.739032+0000","last_undegraded":"2023-07-06T21:43:29.739032+0000","last_fullsized":"2023-07-06T21:43:29.739032+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:40:31.358888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162359+0000","last_change":"2023-07-06T21:43:28.148127+0000","last_active":"2023-07-06T21:43:30.162359+0000","last_peered":"2023-07-06T21:43:30.162359+0000","last_clean":"2023-07-06T21:43:30.162359+0000","last_became_active":"2023-07-06T21:43:28.147674+0000","last_became_peered":"2023-07-06T21:43:28.147674+0000","last_unstale":"2023-07-06T21:43:30.162359+0000","last_undegraded":"2023-07-06T21:43:30.162359+0000","last_fullsized":"2023-07-06T21:43:30.162359+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:59:40.805720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.125706+0000","last_change":"2023-07-06T21:43:27.732107+0000","last_active":"2023-07-06T21:43:29.125706+0000","last_peered":"2023-07-06T21:43:29.125706+0000","last_clean":"2023-07-06T21:43:29.125706+0000","last_became_active":"2023-07-06T21:43:27.731536+0000","last_became_peered":"2023-07-06T21:43:27.731536+0000","last_unstale":"2023-07-06T21:43:29.125706+0000","last_undegraded":"2023-07-06T21:43:29.125706+0000","last_fullsized":"2023-07-06T21:43:29.125706+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:48:52.598589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.381654+0000","last_change":"2023-07-06T21:43:28.141796+0000","last_active":"2023-07-06T21:43:29.381654+0000","last_peered":"2023-07-06T21:43:29.381654+0000","last_clean":"2023-07-06T21:43:29.381654+0000","last_became_active":"2023-07-06T21:43:28.141425+0000","last_became_peered":"2023-07-06T21:43:28.141425+0000","last_unstale":"2023-07-06T21:43:29.381654+0000","last_undegraded":"2023-07-06T21:43:29.381654+0000","last_fullsized":"2023-07-06T21:43:29.381654+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:02:53.539483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162410+0000","last_change":"2023-07-06T21:43:27.726446+0000","last_active":"2023-07-06T21:43:30.162410+0000","last_peered":"2023-07-06T21:43:30.162410+0000","last_clean":"2023-07-06T21:43:30.162410+0000","last_became_active":"2023-07-06T21:43:27.726023+0000","last_became_peered":"2023-07-06T21:43:27.726023+0000","last_unstale":"2023-07-06T21:43:30.162410+0000","last_undegraded":"2023-07-06T21:43:30.162410+0000","last_fullsized":"2023-07-06T21:43:30.162410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:38:13.060729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739066+0000","last_change":"2023-07-06T21:43:28.136626+0000","last_active":"2023-07-06T21:43:29.739066+0000","last_peered":"2023-07-06T21:43:29.739066+0000","last_clean":"2023-07-06T21:43:29.739066+0000","last_became_active":"2023-07-06T21:43:28.135991+0000","last_became_peered":"2023-07-06T21:43:28.135991+0000","last_unstale":"2023-07-06T21:43:29.739066+0000","last_undegraded":"2023-07-06T21:43:29.739066+0000","last_fullsized":"2023-07-06T21:43:29.739066+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:08:19.749149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739159+0000","last_change":"2023-07-06T21:43:27.724043+0000","last_active":"2023-07-06T21:43:29.739159+0000","last_peered":"2023-07-06T21:43:29.739159+0000","last_clean":"2023-07-06T21:43:29.739159+0000","last_became_active":"2023-07-06T21:43:27.723762+0000","last_became_peered":"2023-07-06T21:43:27.723762+0000","last_unstale":"2023-07-06T21:43:29.739159+0000","last_undegraded":"2023-07-06T21:43:29.739159+0000","last_fullsized":"2023-07-06T21:43:29.739159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:19:35.089114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659717+0000","last_change":"2023-07-06T21:43:28.128894+0000","last_active":"2023-07-06T21:43:29.659717+0000","last_peered":"2023-07-06T21:43:29.659717+0000","last_clean":"2023-07-06T21:43:29.659717+0000","last_became_active":"2023-07-06T21:43:28.128615+0000","last_became_peered":"2023-07-06T21:43:28.128615+0000","last_unstale":"2023-07-06T21:43:29.659717+0000","last_undegraded":"2023-07-06T21:43:29.659717+0000","last_fullsized":"2023-07-06T21:43:29.659717+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:06.069496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162927+0000","last_change":"2023-07-06T21:43:27.732867+0000","last_active":"2023-07-06T21:43:30.162927+0000","last_peered":"2023-07-06T21:43:30.162927+0000","last_clean":"2023-07-06T21:43:30.162927+0000","last_became_active":"2023-07-06T21:43:27.732499+0000","last_became_peered":"2023-07-06T21:43:27.732499+0000","last_unstale":"2023-07-06T21:43:30.162927+0000","last_undegraded":"2023-07-06T21:43:30.162927+0000","last_fullsized":"2023-07-06T21:43:30.162927+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:21:06.867631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.085138+0000","last_change":"2023-07-06T21:43:28.136811+0000","last_active":"2023-07-06T21:43:30.085138+0000","last_peered":"2023-07-06T21:43:30.085138+0000","last_clean":"2023-07-06T21:43:30.085138+0000","last_became_active":"2023-07-06T21:43:28.136550+0000","last_became_peered":"2023-07-06T21:43:28.136550+0000","last_unstale":"2023-07-06T21:43:30.085138+0000","last_undegraded":"2023-07-06T21:43:30.085138+0000","last_fullsized":"2023-07-06T21:43:30.085138+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:37:57.099549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659724+0000","last_change":"2023-07-06T21:43:27.731402+0000","last_active":"2023-07-06T21:43:29.659724+0000","last_peered":"2023-07-06T21:43:29.659724+0000","last_clean":"2023-07-06T21:43:29.659724+0000","last_became_active":"2023-07-06T21:43:27.731122+0000","last_became_peered":"2023-07-06T21:43:27.731122+0000","last_unstale":"2023-07-06T21:43:29.659724+0000","last_undegraded":"2023-07-06T21:43:29.659724+0000","last_fullsized":"2023-07-06T21:43:29.659724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:32:42.463739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659464+0000","last_change":"2023-07-06T21:43:28.134688+0000","last_active":"2023-07-06T21:43:29.659464+0000","last_peered":"2023-07-06T21:43:29.659464+0000","last_clean":"2023-07-06T21:43:29.659464+0000","last_became_active":"2023-07-06T21:43:28.134347+0000","last_became_peered":"2023-07-06T21:43:28.134347+0000","last_unstale":"2023-07-06T21:43:29.659464+0000","last_undegraded":"2023-07-06T21:43:29.659464+0000","last_fullsized":"2023-07-06T21:43:29.659464+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:02:11.572115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124562+0000","last_change":"2023-07-06T21:43:27.721274+0000","last_active":"2023-07-06T21:43:29.124562+0000","last_peered":"2023-07-06T21:43:29.124562+0000","last_clean":"2023-07-06T21:43:29.124562+0000","last_became_active":"2023-07-06T21:43:27.720976+0000","last_became_peered":"2023-07-06T21:43:27.720976+0000","last_unstale":"2023-07-06T21:43:29.124562+0000","last_undegraded":"2023-07-06T21:43:29.124562+0000","last_fullsized":"2023-07-06T21:43:29.124562+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:47.600326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.381762+0000","last_change":"2023-07-06T21:43:28.148521+0000","last_active":"2023-07-06T21:43:29.381762+0000","last_peered":"2023-07-06T21:43:29.381762+0000","last_clean":"2023-07-06T21:43:29.381762+0000","last_became_active":"2023-07-06T21:43:28.145066+0000","last_became_peered":"2023-07-06T21:43:28.145066+0000","last_unstale":"2023-07-06T21:43:29.381762+0000","last_undegraded":"2023-07-06T21:43:29.381762+0000","last_fullsized":"2023-07-06T21:43:29.381762+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:34:47.237305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084968+0000","last_change":"2023-07-06T21:43:27.727005+0000","last_active":"2023-07-06T21:43:30.084968+0000","last_peered":"2023-07-06T21:43:30.084968+0000","last_clean":"2023-07-06T21:43:30.084968+0000","last_became_active":"2023-07-06T21:43:27.726537+0000","last_became_peered":"2023-07-06T21:43:27.726537+0000","last_unstale":"2023-07-06T21:43:30.084968+0000","last_undegraded":"2023-07-06T21:43:30.084968+0000","last_fullsized":"2023-07-06T21:43:30.084968+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:59.057362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162550+0000","last_change":"2023-07-06T21:43:28.135417+0000","last_active":"2023-07-06T21:43:30.162550+0000","last_peered":"2023-07-06T21:43:30.162550+0000","last_clean":"2023-07-06T21:43:30.162550+0000","last_became_active":"2023-07-06T21:43:28.135163+0000","last_became_peered":"2023-07-06T21:43:28.135163+0000","last_unstale":"2023-07-06T21:43:30.162550+0000","last_undegraded":"2023-07-06T21:43:30.162550+0000","last_fullsized":"2023-07-06T21:43:30.162550+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:06:59.514452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659516+0000","last_change":"2023-07-06T21:43:27.726879+0000","last_active":"2023-07-06T21:43:29.659516+0000","last_peered":"2023-07-06T21:43:29.659516+0000","last_clean":"2023-07-06T21:43:29.659516+0000","last_became_active":"2023-07-06T21:43:27.726579+0000","last_became_peered":"2023-07-06T21:43:27.726579+0000","last_unstale":"2023-07-06T21:43:29.659516+0000","last_undegraded":"2023-07-06T21:43:29.659516+0000","last_fullsized":"2023-07-06T21:43:29.659516+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:59.057362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084540+0000","last_change":"2023-07-06T21:43:28.137267+0000","last_active":"2023-07-06T21:43:30.084540+0000","last_peered":"2023-07-06T21:43:30.084540+0000","last_clean":"2023-07-06T21:43:30.084540+0000","last_became_active":"2023-07-06T21:43:28.137007+0000","last_became_peered":"2023-07-06T21:43:28.137007+0000","last_unstale":"2023-07-06T21:43:30.084540+0000","last_undegraded":"2023-07-06T21:43:30.084540+0000","last_fullsized":"2023-07-06T21:43:30.084540+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:48:53.606092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084665+0000","last_change":"2023-07-06T21:43:27.729150+0000","last_active":"2023-07-06T21:43:30.084665+0000","last_peered":"2023-07-06T21:43:30.084665+0000","last_clean":"2023-07-06T21:43:30.084665+0000","last_became_active":"2023-07-06T21:43:27.728872+0000","last_became_peered":"2023-07-06T21:43:27.728872+0000","last_unstale":"2023-07-06T21:43:30.084665+0000","last_undegraded":"2023-07-06T21:43:30.084665+0000","last_fullsized":"2023-07-06T21:43:30.084665+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:57.876183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659504+0000","last_change":"2023-07-06T21:43:28.146072+0000","last_active":"2023-07-06T21:43:29.659504+0000","last_peered":"2023-07-06T21:43:29.659504+0000","last_clean":"2023-07-06T21:43:29.659504+0000","last_became_active":"2023-07-06T21:43:28.145683+0000","last_became_peered":"2023-07-06T21:43:28.145683+0000","last_unstale":"2023-07-06T21:43:29.659504+0000","last_undegraded":"2023-07-06T21:43:29.659504+0000","last_fullsized":"2023-07-06T21:43:29.659504+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:22:19.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162886+0000","last_change":"2023-07-06T21:43:27.726035+0000","last_active":"2023-07-06T21:43:30.162886+0000","last_peered":"2023-07-06T21:43:30.162886+0000","last_clean":"2023-07-06T21:43:30.162886+0000","last_became_active":"2023-07-06T21:43:27.725748+0000","last_became_peered":"2023-07-06T21:43:27.725748+0000","last_unstale":"2023-07-06T21:43:30.162886+0000","last_undegraded":"2023-07-06T21:43:30.162886+0000","last_fullsized":"2023-07-06T21:43:30.162886+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:54:25.440375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124430+0000","last_change":"2023-07-06T21:43:28.132302+0000","last_active":"2023-07-06T21:43:29.124430+0000","last_peered":"2023-07-06T21:43:29.124430+0000","last_clean":"2023-07-06T21:43:29.124430+0000","last_became_active":"2023-07-06T21:43:28.132125+0000","last_became_peered":"2023-07-06T21:43:28.132125+0000","last_unstale":"2023-07-06T21:43:29.124430+0000","last_undegraded":"2023-07-06T21:43:29.124430+0000","last_fullsized":"2023-07-06T21:43:29.124430+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:20:08.347391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124443+0000","last_change":"2023-07-06T21:43:27.728499+0000","last_active":"2023-07-06T21:43:29.124443+0000","last_peered":"2023-07-06T21:43:29.124443+0000","last_clean":"2023-07-06T21:43:29.124443+0000","last_became_active":"2023-07-06T21:43:27.728249+0000","last_became_peered":"2023-07-06T21:43:27.728249+0000","last_unstale":"2023-07-06T21:43:29.124443+0000","last_undegraded":"2023-07-06T21:43:29.124443+0000","last_fullsized":"2023-07-06T21:43:29.124443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:40:18.729829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162815+0000","last_change":"2023-07-06T21:43:28.138349+0000","last_active":"2023-07-06T21:43:30.162815+0000","last_peered":"2023-07-06T21:43:30.162815+0000","last_clean":"2023-07-06T21:43:30.162815+0000","last_became_active":"2023-07-06T21:43:28.138065+0000","last_became_peered":"2023-07-06T21:43:28.138065+0000","last_unstale":"2023-07-06T21:43:30.162815+0000","last_undegraded":"2023-07-06T21:43:30.162815+0000","last_fullsized":"2023-07-06T21:43:30.162815+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:30:35.260810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739246+0000","last_change":"2023-07-06T21:43:27.723497+0000","last_active":"2023-07-06T21:43:29.739246+0000","last_peered":"2023-07-06T21:43:29.739246+0000","last_clean":"2023-07-06T21:43:29.739246+0000","last_became_active":"2023-07-06T21:43:27.723082+0000","last_became_peered":"2023-07-06T21:43:27.723082+0000","last_unstale":"2023-07-06T21:43:29.739246+0000","last_undegraded":"2023-07-06T21:43:29.739246+0000","last_fullsized":"2023-07-06T21:43:29.739246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:54:29.482970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.381886+0000","last_change":"2023-07-06T21:43:28.144909+0000","last_active":"2023-07-06T21:43:29.381886+0000","last_peered":"2023-07-06T21:43:29.381886+0000","last_clean":"2023-07-06T21:43:29.381886+0000","last_became_active":"2023-07-06T21:43:28.144584+0000","last_became_peered":"2023-07-06T21:43:28.144584+0000","last_unstale":"2023-07-06T21:43:29.381886+0000","last_undegraded":"2023-07-06T21:43:29.381886+0000","last_fullsized":"2023-07-06T21:43:29.381886+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:03:32.831579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.126214+0000","last_change":"2023-07-06T21:43:27.732889+0000","last_active":"2023-07-06T21:43:29.126214+0000","last_peered":"2023-07-06T21:43:29.126214+0000","last_clean":"2023-07-06T21:43:29.126214+0000","last_became_active":"2023-07-06T21:43:27.732416+0000","last_became_peered":"2023-07-06T21:43:27.732416+0000","last_unstale":"2023-07-06T21:43:29.126214+0000","last_undegraded":"2023-07-06T21:43:29.126214+0000","last_fullsized":"2023-07-06T21:43:29.126214+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:59.057362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.382036+0000","last_change":"2023-07-06T21:43:28.158348+0000","last_active":"2023-07-06T21:43:29.382036+0000","last_peered":"2023-07-06T21:43:29.382036+0000","last_clean":"2023-07-06T21:43:29.382036+0000","last_became_active":"2023-07-06T21:43:28.158007+0000","last_became_peered":"2023-07-06T21:43:28.158007+0000","last_unstale":"2023-07-06T21:43:29.382036+0000","last_undegraded":"2023-07-06T21:43:29.382036+0000","last_fullsized":"2023-07-06T21:43:29.382036+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:41:53.029968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.085013+0000","last_change":"2023-07-06T21:43:27.727567+0000","last_active":"2023-07-06T21:43:30.085013+0000","last_peered":"2023-07-06T21:43:30.085013+0000","last_clean":"2023-07-06T21:43:30.085013+0000","last_became_active":"2023-07-06T21:43:27.727303+0000","last_became_peered":"2023-07-06T21:43:27.727303+0000","last_unstale":"2023-07-06T21:43:30.085013+0000","last_undegraded":"2023-07-06T21:43:30.085013+0000","last_fullsized":"2023-07-06T21:43:30.085013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:22:30.419221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084683+0000","last_change":"2023-07-06T21:43:28.147498+0000","last_active":"2023-07-06T21:43:30.084683+0000","last_peered":"2023-07-06T21:43:30.084683+0000","last_clean":"2023-07-06T21:43:30.084683+0000","last_became_active":"2023-07-06T21:43:28.145842+0000","last_became_peered":"2023-07-06T21:43:28.145842+0000","last_unstale":"2023-07-06T21:43:30.084683+0000","last_undegraded":"2023-07-06T21:43:30.084683+0000","last_fullsized":"2023-07-06T21:43:30.084683+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:20:21.050440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.085171+0000","last_change":"2023-07-06T21:43:27.728015+0000","last_active":"2023-07-06T21:43:30.085171+0000","last_peered":"2023-07-06T21:43:30.085171+0000","last_clean":"2023-07-06T21:43:30.085171+0000","last_became_active":"2023-07-06T21:43:27.727749+0000","last_became_peered":"2023-07-06T21:43:27.727749+0000","last_unstale":"2023-07-06T21:43:30.085171+0000","last_undegraded":"2023-07-06T21:43:30.085171+0000","last_fullsized":"2023-07-06T21:43:30.085171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:28:59.139587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.128982+0000","last_change":"2023-07-06T21:43:28.152946+0000","last_active":"2023-07-06T21:43:29.128982+0000","last_peered":"2023-07-06T21:43:29.128982+0000","last_clean":"2023-07-06T21:43:29.128982+0000","last_became_active":"2023-07-06T21:43:28.152678+0000","last_became_peered":"2023-07-06T21:43:28.152678+0000","last_unstale":"2023-07-06T21:43:29.128982+0000","last_undegraded":"2023-07-06T21:43:29.128982+0000","last_fullsized":"2023-07-06T21:43:29.128982+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:12:48.461743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.125708+0000","last_change":"2023-07-06T21:43:27.730760+0000","last_active":"2023-07-06T21:43:29.125708+0000","last_peered":"2023-07-06T21:43:29.125708+0000","last_clean":"2023-07-06T21:43:29.125708+0000","last_became_active":"2023-07-06T21:43:27.730457+0000","last_became_peered":"2023-07-06T21:43:27.730457+0000","last_unstale":"2023-07-06T21:43:29.125708+0000","last_undegraded":"2023-07-06T21:43:29.125708+0000","last_fullsized":"2023-07-06T21:43:29.125708+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:10.425713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124624+0000","last_change":"2023-07-06T21:43:28.136757+0000","last_active":"2023-07-06T21:43:29.124624+0000","last_peered":"2023-07-06T21:43:29.124624+0000","last_clean":"2023-07-06T21:43:29.124624+0000","last_became_active":"2023-07-06T21:43:28.136502+0000","last_became_peered":"2023-07-06T21:43:28.136502+0000","last_unstale":"2023-07-06T21:43:29.124624+0000","last_undegraded":"2023-07-06T21:43:29.124624+0000","last_fullsized":"2023-07-06T21:43:29.124624+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:45:21.360064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162385+0000","last_change":"2023-07-06T21:43:27.732793+0000","last_active":"2023-07-06T21:43:30.162385+0000","last_peered":"2023-07-06T21:43:30.162385+0000","last_clean":"2023-07-06T21:43:30.162385+0000","last_became_active":"2023-07-06T21:43:27.732452+0000","last_became_peered":"2023-07-06T21:43:27.732452+0000","last_unstale":"2023-07-06T21:43:30.162385+0000","last_undegraded":"2023-07-06T21:43:30.162385+0000","last_fullsized":"2023-07-06T21:43:30.162385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:49:55.409381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162546+0000","last_change":"2023-07-06T21:43:28.153933+0000","last_active":"2023-07-06T21:43:30.162546+0000","last_peered":"2023-07-06T21:43:30.162546+0000","last_clean":"2023-07-06T21:43:30.162546+0000","last_became_active":"2023-07-06T21:43:28.153625+0000","last_became_peered":"2023-07-06T21:43:28.153625+0000","last_unstale":"2023-07-06T21:43:30.162546+0000","last_undegraded":"2023-07-06T21:43:30.162546+0000","last_fullsized":"2023-07-06T21:43:30.162546+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:54:38.692864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659214+0000","last_change":"2023-07-06T21:43:27.730917+0000","last_active":"2023-07-06T21:43:29.659214+0000","last_peered":"2023-07-06T21:43:29.659214+0000","last_clean":"2023-07-06T21:43:29.659214+0000","last_became_active":"2023-07-06T21:43:27.730646+0000","last_became_peered":"2023-07-06T21:43:27.730646+0000","last_unstale":"2023-07-06T21:43:29.659214+0000","last_undegraded":"2023-07-06T21:43:29.659214+0000","last_fullsized":"2023-07-06T21:43:29.659214+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:35:42.935884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084732+0000","last_change":"2023-07-06T21:43:28.133873+0000","last_active":"2023-07-06T21:43:30.084732+0000","last_peered":"2023-07-06T21:43:30.084732+0000","last_clean":"2023-07-06T21:43:30.084732+0000","last_became_active":"2023-07-06T21:43:28.133590+0000","last_became_peered":"2023-07-06T21:43:28.133590+0000","last_unstale":"2023-07-06T21:43:30.084732+0000","last_undegraded":"2023-07-06T21:43:30.084732+0000","last_fullsized":"2023-07-06T21:43:30.084732+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:09:44.703647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659509+0000","last_change":"2023-07-06T21:43:27.731790+0000","last_active":"2023-07-06T21:43:29.659509+0000","last_peered":"2023-07-06T21:43:29.659509+0000","last_clean":"2023-07-06T21:43:29.659509+0000","last_became_active":"2023-07-06T21:43:27.731151+0000","last_became_peered":"2023-07-06T21:43:27.731151+0000","last_unstale":"2023-07-06T21:43:29.659509+0000","last_undegraded":"2023-07-06T21:43:29.659509+0000","last_fullsized":"2023-07-06T21:43:29.659509+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:22:30.419221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.382318+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:43:29.382318+0000","last_peered":"2023-07-06T21:43:29.382318+0000","last_clean":"2023-07-06T21:43:29.382318+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:43:29.382318+0000","last_undegraded":"2023-07-06T21:43:29.382318+0000","last_fullsized":"2023-07-06T21:43:29.382318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:37:35.745100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084859+0000","last_change":"2023-07-06T21:43:28.137144+0000","last_active":"2023-07-06T21:43:30.084859+0000","last_peered":"2023-07-06T21:43:30.084859+0000","last_clean":"2023-07-06T21:43:30.084859+0000","last_became_active":"2023-07-06T21:43:28.136743+0000","last_became_peered":"2023-07-06T21:43:28.136743+0000","last_unstale":"2023-07-06T21:43:30.084859+0000","last_undegraded":"2023-07-06T21:43:30.084859+0000","last_fullsized":"2023-07-06T21:43:30.084859+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:22:19.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739145+0000","last_change":"2023-07-06T21:43:27.722147+0000","last_active":"2023-07-06T21:43:29.739145+0000","last_peered":"2023-07-06T21:43:29.739145+0000","last_clean":"2023-07-06T21:43:29.739145+0000","last_became_active":"2023-07-06T21:43:27.721839+0000","last_became_peered":"2023-07-06T21:43:27.721839+0000","last_unstale":"2023-07-06T21:43:29.739145+0000","last_undegraded":"2023-07-06T21:43:29.739145+0000","last_fullsized":"2023-07-06T21:43:29.739145+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:51.109992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.129021+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:43:29.129021+0000","last_peered":"2023-07-06T21:43:29.129021+0000","last_clean":"2023-07-06T21:43:29.129021+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:43:29.129021+0000","last_undegraded":"2023-07-06T21:43:29.129021+0000","last_fullsized":"2023-07-06T21:43:29.129021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:54:03.674314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.125829+0000","last_change":"2023-07-06T21:43:28.145768+0000","last_active":"2023-07-06T21:43:29.125829+0000","last_peered":"2023-07-06T21:43:29.125829+0000","last_clean":"2023-07-06T21:43:29.125829+0000","last_became_active":"2023-07-06T21:43:28.145444+0000","last_became_peered":"2023-07-06T21:43:28.145444+0000","last_unstale":"2023-07-06T21:43:29.125829+0000","last_undegraded":"2023-07-06T21:43:29.125829+0000","last_fullsized":"2023-07-06T21:43:29.125829+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:35:03.288088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.128805+0000","last_change":"2023-07-06T21:43:27.730977+0000","last_active":"2023-07-06T21:43:29.128805+0000","last_peered":"2023-07-06T21:43:29.128805+0000","last_clean":"2023-07-06T21:43:29.128805+0000","last_became_active":"2023-07-06T21:43:27.730680+0000","last_became_peered":"2023-07-06T21:43:27.730680+0000","last_unstale":"2023-07-06T21:43:29.128805+0000","last_undegraded":"2023-07-06T21:43:29.128805+0000","last_fullsized":"2023-07-06T21:43:29.128805+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:01:22.284634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659844+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:43:29.659844+0000","last_peered":"2023-07-06T21:43:29.659844+0000","last_clean":"2023-07-06T21:43:29.659844+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:43:29.659844+0000","last_undegraded":"2023-07-06T21:43:29.659844+0000","last_fullsized":"2023-07-06T21:43:29.659844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:38:47.834510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.738848+0000","last_change":"2023-07-06T21:43:28.135739+0000","last_active":"2023-07-06T21:43:29.738848+0000","last_peered":"2023-07-06T21:43:29.738848+0000","last_clean":"2023-07-06T21:43:29.738848+0000","last_became_active":"2023-07-06T21:43:28.135456+0000","last_became_peered":"2023-07-06T21:43:28.135456+0000","last_unstale":"2023-07-06T21:43:29.738848+0000","last_undegraded":"2023-07-06T21:43:29.738848+0000","last_fullsized":"2023-07-06T21:43:29.738848+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:12:42.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162549+0000","last_change":"2023-07-06T21:43:27.725326+0000","last_active":"2023-07-06T21:43:30.162549+0000","last_peered":"2023-07-06T21:43:30.162549+0000","last_clean":"2023-07-06T21:43:30.162549+0000","last_became_active":"2023-07-06T21:43:27.724891+0000","last_became_peered":"2023-07-06T21:43:27.724891+0000","last_unstale":"2023-07-06T21:43:30.162549+0000","last_undegraded":"2023-07-06T21:43:30.162549+0000","last_fullsized":"2023-07-06T21:43:30.162549+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:58:29.118184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.128847+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:43:29.128847+0000","last_peered":"2023-07-06T21:43:29.128847+0000","last_clean":"2023-07-06T21:43:29.128847+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:43:29.128847+0000","last_undegraded":"2023-07-06T21:43:29.128847+0000","last_fullsized":"2023-07-06T21:43:29.128847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:16:05.147872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.382254+0000","last_change":"2023-07-06T21:43:28.141560+0000","last_active":"2023-07-06T21:43:29.382254+0000","last_peered":"2023-07-06T21:43:29.382254+0000","last_clean":"2023-07-06T21:43:29.382254+0000","last_became_active":"2023-07-06T21:43:28.141233+0000","last_became_peered":"2023-07-06T21:43:28.141233+0000","last_unstale":"2023-07-06T21:43:29.382254+0000","last_undegraded":"2023-07-06T21:43:29.382254+0000","last_fullsized":"2023-07-06T21:43:29.382254+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:24:43.863862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"42'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.085230+0000","last_change":"2023-07-06T21:43:27.719133+0000","last_active":"2023-07-06T21:43:30.085230+0000","last_peered":"2023-07-06T21:43:30.085230+0000","last_clean":"2023-07-06T21:43:30.085230+0000","last_became_active":"2023-07-06T21:43:27.718849+0000","last_became_peered":"2023-07-06T21:43:27.718849+0000","last_unstale":"2023-07-06T21:43:30.085230+0000","last_undegraded":"2023-07-06T21:43:30.085230+0000","last_fullsized":"2023-07-06T21:43:30.085230+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:05.061993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.125959+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:43:29.125959+0000","last_peered":"2023-07-06T21:43:29.125959+0000","last_clean":"2023-07-06T21:43:29.125959+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:43:29.125959+0000","last_undegraded":"2023-07-06T21:43:29.125959+0000","last_fullsized":"2023-07-06T21:43:29.125959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:51:35.574781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162822+0000","last_change":"2023-07-06T21:43:28.134264+0000","last_active":"2023-07-06T21:43:30.162822+0000","last_peered":"2023-07-06T21:43:30.162822+0000","last_clean":"2023-07-06T21:43:30.162822+0000","last_became_active":"2023-07-06T21:43:28.132834+0000","last_became_peered":"2023-07-06T21:43:28.132834+0000","last_unstale":"2023-07-06T21:43:30.162822+0000","last_undegraded":"2023-07-06T21:43:30.162822+0000","last_fullsized":"2023-07-06T21:43:30.162822+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:03:55.659006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659779+0000","last_change":"2023-07-06T21:43:27.730964+0000","last_active":"2023-07-06T21:43:29.659779+0000","last_peered":"2023-07-06T21:43:29.659779+0000","last_clean":"2023-07-06T21:43:29.659779+0000","last_became_active":"2023-07-06T21:43:27.730688+0000","last_became_peered":"2023-07-06T21:43:27.730688+0000","last_unstale":"2023-07-06T21:43:29.659779+0000","last_undegraded":"2023-07-06T21:43:29.659779+0000","last_fullsized":"2023-07-06T21:43:29.659779+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:33.713525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124194+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:43:29.124194+0000","last_peered":"2023-07-06T21:43:29.124194+0000","last_clean":"2023-07-06T21:43:29.124194+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:43:29.124194+0000","last_undegraded":"2023-07-06T21:43:29.124194+0000","last_fullsized":"2023-07-06T21:43:29.124194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:40:19.713391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659690+0000","last_change":"2023-07-06T21:43:28.138655+0000","last_active":"2023-07-06T21:43:29.659690+0000","last_peered":"2023-07-06T21:43:29.659690+0000","last_clean":"2023-07-06T21:43:29.659690+0000","last_became_active":"2023-07-06T21:43:28.138388+0000","last_became_peered":"2023-07-06T21:43:28.138388+0000","last_unstale":"2023-07-06T21:43:29.659690+0000","last_undegraded":"2023-07-06T21:43:29.659690+0000","last_fullsized":"2023-07-06T21:43:29.659690+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:37:57.099549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.128787+0000","last_change":"2023-07-06T21:43:27.730119+0000","last_active":"2023-07-06T21:43:29.128787+0000","last_peered":"2023-07-06T21:43:29.128787+0000","last_clean":"2023-07-06T21:43:29.128787+0000","last_became_active":"2023-07-06T21:43:27.729850+0000","last_became_peered":"2023-07-06T21:43:27.729850+0000","last_unstale":"2023-07-06T21:43:29.128787+0000","last_undegraded":"2023-07-06T21:43:29.128787+0000","last_fullsized":"2023-07-06T21:43:29.128787+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:07:36.306239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659303+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:43:29.659303+0000","last_peered":"2023-07-06T21:43:29.659303+0000","last_clean":"2023-07-06T21:43:29.659303+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:43:29.659303+0000","last_undegraded":"2023-07-06T21:43:29.659303+0000","last_fullsized":"2023-07-06T21:43:29.659303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:18:57.741535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.163014+0000","last_change":"2023-07-06T21:43:28.131975+0000","last_active":"2023-07-06T21:43:30.163014+0000","last_peered":"2023-07-06T21:43:30.163014+0000","last_clean":"2023-07-06T21:43:30.163014+0000","last_became_active":"2023-07-06T21:43:28.131686+0000","last_became_peered":"2023-07-06T21:43:28.131686+0000","last_unstale":"2023-07-06T21:43:30.163014+0000","last_undegraded":"2023-07-06T21:43:30.163014+0000","last_fullsized":"2023-07-06T21:43:30.163014+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:19:03.124674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.126344+0000","last_change":"2023-07-06T21:43:27.726972+0000","last_active":"2023-07-06T21:43:29.126344+0000","last_peered":"2023-07-06T21:43:29.126344+0000","last_clean":"2023-07-06T21:43:29.126344+0000","last_became_active":"2023-07-06T21:43:27.726709+0000","last_became_peered":"2023-07-06T21:43:27.726709+0000","last_unstale":"2023-07-06T21:43:29.126344+0000","last_undegraded":"2023-07-06T21:43:29.126344+0000","last_fullsized":"2023-07-06T21:43:29.126344+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:22:30.419221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.125984+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:43:29.125984+0000","last_peered":"2023-07-06T21:43:29.125984+0000","last_clean":"2023-07-06T21:43:29.125984+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:43:29.125984+0000","last_undegraded":"2023-07-06T21:43:29.125984+0000","last_fullsized":"2023-07-06T21:43:29.125984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:08:21.394741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659379+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:43:29.659379+0000","last_peered":"2023-07-06T21:43:29.659379+0000","last_clean":"2023-07-06T21:43:29.659379+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:43:29.659379+0000","last_undegraded":"2023-07-06T21:43:29.659379+0000","last_fullsized":"2023-07-06T21:43:29.659379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:08:15.156408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1085440,"data_stored":809234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.88200000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.99199999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.84299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":491520,"data_stored":218429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.628}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":491520,"data_stored":218846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.84499999999999997}]},{"osd":4,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.74099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":499712,"data_stored":220340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.77500000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.97799999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.92300000000000004}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.629},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":499712,"data_stored":219414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.439},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.37},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.872},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.81599999999999995}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.752},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.79500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":503808,"data_stored":220362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.436}]},{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.752}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":491520,"data_stored":218846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.76500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":1081344,"data_stored":808159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":1.198},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":1.1499999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":1.3700000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.125},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.2989999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.3640000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":1.2589999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:43:34.474 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:43:34.479 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:43:37.026 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:43:37.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.173+0000 7f2d33ed8640 1 Processor -- start 2023-07-06T21:43:37.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.173+0000 7f2d33ed8640 1 -- start start 2023-07-06T21:43:37.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.173+0000 7f2d33ed8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c160030 0x7f2d2c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.173+0000 7f2d33ed8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2d2c071050 0x7f2d2c0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.173+0000 7f2d33ed8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2c06bd00 con 0x7f2d2c0cd870 2023-07-06T21:43:37.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.173+0000 7f2d33ed8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c160400 con 0x7f2d2c071050 2023-07-06T21:43:37.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.173+0000 7f2d33ed8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0cdd10 con 0x7f2d2c160030 2023-07-06T21:43:37.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.173+0000 7f2d31473640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2d2c071050 0x7f2d2c0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.177+0000 7f2d31c74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c160030 0x7f2d2c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.177+0000 7f2d32475640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f2d2c0cd870 0x7f2d2c163a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:34750/0 (socket says 172.21.15.55:34750) 2023-07-06T21:43:37.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.177+0000 7f2d32475640 1 -- 172.21.15.55:0/524496872 learned_addr learned my addr 172.21.15.55:0/524496872 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:37.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.177+0000 7f2d30c72640 1 -- 172.21.15.55:0/524496872 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008802912 0 0) 0x7f2d2c06bd00 con 0x7f2d2c0cd870 2023-07-06T21:43:37.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.177+0000 7f2d31c74640 1 -- 172.21.15.55:0/524496872 >> v2:172.21.15.138:3300/0 conn(0x7f2d2c071050 msgr2=0x7f2d2c0cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:37.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.177+0000 7f2d31c74640 1 --2- 172.21.15.55:0/524496872 >> v2:172.21.15.138:3300/0 conn(0x7f2d2c071050 0x7f2d2c0cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.177+0000 7f2d31c74640 1 -- 172.21.15.55:0/524496872 >> v1:172.21.15.138:6789/0 conn(0x7f2d2c0cd870 legacy=0x7f2d2c163a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.177+0000 7f2d31c74640 1 -- 172.21.15.55:0/524496872 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c0c9ba0 con 0x7f2d2c160030 2023-07-06T21:43:37.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.177+0000 7f2d31c74640 1 --2- 172.21.15.55:0/524496872 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c160030 0x7f2d2c070b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2d280097c0 tx=0x7f2d2801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=757210f851a9d20c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:37.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.177+0000 7f2d30c72640 1 -- 172.21.15.55:0/524496872 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280ab600 con 0x7f2d2c160030 2023-07-06T21:43:37.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d30c72640 1 -- 172.21.15.55:0/524496872 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d280a7050 con 0x7f2d2c160030 2023-07-06T21:43:37.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d30c72640 1 -- 172.21.15.55:0/524496872 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280ab980 con 0x7f2d2c160030 2023-07-06T21:43:37.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 -- 172.21.15.55:0/524496872 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c160030 msgr2=0x7f2d2c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 --2- 172.21.15.55:0/524496872 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c160030 0x7f2d2c070b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2d280097c0 tx=0x7f2d2801c480 comp rx=0 tx=0).stop 2023-07-06T21:43:37.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 -- 172.21.15.55:0/524496872 shutdown_connections 2023-07-06T21:43:37.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 --2- 172.21.15.55:0/524496872 >> v2:172.21.15.138:3300/0 conn(0x7f2d2c071050 0x7f2d2c0cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 --2- 172.21.15.55:0/524496872 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c160030 0x7f2d2c070b10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 -- 172.21.15.55:0/524496872 >> 172.21.15.55:0/524496872 conn(0x7f2d2c0cded0 msgr2=0x7f2d2c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:37.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 -- 172.21.15.55:0/524496872 shutdown_connections 2023-07-06T21:43:37.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 -- 172.21.15.55:0/524496872 wait complete. 2023-07-06T21:43:37.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 Processor -- start 2023-07-06T21:43:37.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 -- start start 2023-07-06T21:43:37.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c071050 0x7f2d2c1572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d2c0cd870 0x7f2d2c0ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c160030 0x7f2d2c0cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0c6ee0 con 0x7f2d2c071050 2023-07-06T21:43:37.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0b1970 con 0x7f2d2c0cd870 2023-07-06T21:43:37.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d33ed8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0b1c50 con 0x7f2d2c160030 2023-07-06T21:43:37.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d31c74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c071050 0x7f2d2c1572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.181+0000 7f2d31c74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c071050 0x7f2d2c1572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35428/0 (socket says 172.21.15.55:35428) 2023-07-06T21:43:37.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d31c74640 1 -- 172.21.15.55:0/814696450 learned_addr learned my addr 172.21.15.55:0/814696450 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:37.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d31473640 1 --2- 172.21.15.55:0/814696450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d2c0cd870 0x7f2d2c0ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d32475640 1 --2- 172.21.15.55:0/814696450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c160030 0x7f2d2c0cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d31c74640 1 -- 172.21.15.55:0/814696450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c160030 msgr2=0x7f2d2c0cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d31c74640 1 --2- 172.21.15.55:0/814696450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c160030 0x7f2d2c0cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d31c74640 1 -- 172.21.15.55:0/814696450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d2c0cd870 msgr2=0x7f2d2c0ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d31c74640 1 --2- 172.21.15.55:0/814696450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d2c0cd870 0x7f2d2c0ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d31c74640 1 -- 172.21.15.55:0/814696450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28009420 con 0x7f2d2c071050 2023-07-06T21:43:37.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d31c74640 1 --2- 172.21.15.55:0/814696450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c071050 0x7f2d2c1572c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2d28019090 tx=0x7f2d28019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:37.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d227fc640 1 -- 172.21.15.55:0/814696450 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280b4600 con 0x7f2d2c071050 2023-07-06T21:43:37.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d227fc640 1 -- 172.21.15.55:0/814696450 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d280b4760 con 0x7f2d2c071050 2023-07-06T21:43:37.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d227fc640 1 -- 172.21.15.55:0/814696450 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280b4b10 con 0x7f2d2c071050 2023-07-06T21:43:37.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d33ed8640 1 -- 172.21.15.55:0/814696450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c0b1f30 con 0x7f2d2c071050 2023-07-06T21:43:37.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d33ed8640 1 -- 172.21.15.55:0/814696450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c0b24f0 con 0x7f2d2c071050 2023-07-06T21:43:37.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d33ed8640 1 -- 172.21.15.55:0/814696450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2c066d60 con 0x7f2d2c071050 2023-07-06T21:43:37.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d227fc640 1 -- 172.21.15.55:0/814696450 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d280b2040 con 0x7f2d2c071050 2023-07-06T21:43:37.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.185+0000 7f2d227fc640 1 --2- 172.21.15.55:0/814696450 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d10066280 0x7f2d10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.189+0000 7f2d227fc640 1 -- 172.21.15.55:0/814696450 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2d2811dab0 con 0x7f2d2c071050 2023-07-06T21:43:37.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.189+0000 7f2d31473640 1 --2- 172.21.15.55:0/814696450 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d10066280 0x7f2d10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.189+0000 7f2d31473640 1 --2- 172.21.15.55:0/814696450 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d10066280 0x7f2d10068730 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0c6b40 tx=0x7f2d1c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:37.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.189+0000 7f2d227fc640 1 -- 172.21.15.55:0/814696450 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d280eae00 con 0x7f2d2c071050 2023-07-06T21:43:37.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.341+0000 7f2d33ed8640 1 -- 172.21.15.55:0/814696450 --> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d2c0ca390 con 0x7f2d10066280 2023-07-06T21:43:37.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.349+0000 7f2d227fc640 1 -- 172.21.15.55:0/814696450 <== mgr.4101 v2:172.21.15.55:6832/1575998409 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311080 (secure 0 0 0) 0x7f2d1c011a00 con 0x7f2d10066280 2023-07-06T21:43:37.361 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:37.362 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:43:37.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.353+0000 7f2d33ed8640 1 -- 172.21.15.55:0/814696450 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d10066280 msgr2=0x7f2d10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.353+0000 7f2d33ed8640 1 --2- 172.21.15.55:0/814696450 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d10066280 0x7f2d10068730 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0c6b40 tx=0x7f2d1c009190 comp rx=0 tx=0).stop 2023-07-06T21:43:37.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.353+0000 7f2d33ed8640 1 -- 172.21.15.55:0/814696450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c071050 msgr2=0x7f2d2c1572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.353+0000 7f2d33ed8640 1 --2- 172.21.15.55:0/814696450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c071050 0x7f2d2c1572c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2d28019090 tx=0x7f2d28019220 comp rx=0 tx=0).stop 2023-07-06T21:43:37.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.353+0000 7f2d33ed8640 1 -- 172.21.15.55:0/814696450 shutdown_connections 2023-07-06T21:43:37.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.353+0000 7f2d33ed8640 1 --2- 172.21.15.55:0/814696450 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f2d10066280 0x7f2d10068730 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.353+0000 7f2d33ed8640 1 --2- 172.21.15.55:0/814696450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d2c160030 0x7f2d2c0cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.353+0000 7f2d33ed8640 1 --2- 172.21.15.55:0/814696450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d2c0cd870 0x7f2d2c0ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.353+0000 7f2d33ed8640 1 --2- 172.21.15.55:0/814696450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c071050 0x7f2d2c1572c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.353+0000 7f2d33ed8640 1 -- 172.21.15.55:0/814696450 >> 172.21.15.55:0/814696450 conn(0x7f2d2c0cded0 msgr2=0x7f2d2c06b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:37.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.353+0000 7f2d33ed8640 1 -- 172.21.15.55:0/814696450 shutdown_connections 2023-07-06T21:43:37.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.353+0000 7f2d33ed8640 1 -- 172.21.15.55:0/814696450 wait complete. 2023-07-06T21:43:37.382 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-07-06T21:43:35.661219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237024,"kb_used_data":5024,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754737696,"statfs":{"total":773094113280,"available":772851400704,"internally_reserved":0,"allocated":5144576,"data_stored":2933630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.955827"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659520+0000","last_change":"2023-07-06T21:43:28.127352+0000","last_active":"2023-07-06T21:43:29.659520+0000","last_peered":"2023-07-06T21:43:29.659520+0000","last_clean":"2023-07-06T21:43:29.659520+0000","last_became_active":"2023-07-06T21:43:28.127051+0000","last_became_peered":"2023-07-06T21:43:28.127051+0000","last_unstale":"2023-07-06T21:43:29.659520+0000","last_undegraded":"2023-07-06T21:43:29.659520+0000","last_fullsized":"2023-07-06T21:43:29.659520+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:21:43.990348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.126237+0000","last_change":"2023-07-06T21:43:28.130627+0000","last_active":"2023-07-06T21:43:29.126237+0000","last_peered":"2023-07-06T21:43:29.126237+0000","last_clean":"2023-07-06T21:43:29.126237+0000","last_became_active":"2023-07-06T21:43:28.130350+0000","last_became_peered":"2023-07-06T21:43:28.130350+0000","last_unstale":"2023-07-06T21:43:29.126237+0000","last_undegraded":"2023-07-06T21:43:29.126237+0000","last_fullsized":"2023-07-06T21:43:29.126237+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:21:43.990348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739044+0000","last_change":"2023-07-06T21:43:28.146808+0000","last_active":"2023-07-06T21:43:29.739044+0000","last_peered":"2023-07-06T21:43:29.739044+0000","last_clean":"2023-07-06T21:43:29.739044+0000","last_became_active":"2023-07-06T21:43:28.146548+0000","last_became_peered":"2023-07-06T21:43:28.146548+0000","last_unstale":"2023-07-06T21:43:29.739044+0000","last_undegraded":"2023-07-06T21:43:29.739044+0000","last_fullsized":"2023-07-06T21:43:29.739044+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:01:40.414000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162745+0000","last_change":"2023-07-06T21:43:28.148729+0000","last_active":"2023-07-06T21:43:30.162745+0000","last_peered":"2023-07-06T21:43:30.162745+0000","last_clean":"2023-07-06T21:43:30.162745+0000","last_became_active":"2023-07-06T21:43:28.148440+0000","last_became_peered":"2023-07-06T21:43:28.148440+0000","last_unstale":"2023-07-06T21:43:30.162745+0000","last_undegraded":"2023-07-06T21:43:30.162745+0000","last_fullsized":"2023-07-06T21:43:30.162745+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:17:01.128035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.125966+0000","last_change":"2023-07-06T21:43:28.134063+0000","last_active":"2023-07-06T21:43:29.125966+0000","last_peered":"2023-07-06T21:43:29.125966+0000","last_clean":"2023-07-06T21:43:29.125966+0000","last_became_active":"2023-07-06T21:43:28.133675+0000","last_became_peered":"2023-07-06T21:43:28.133675+0000","last_unstale":"2023-07-06T21:43:29.125966+0000","last_undegraded":"2023-07-06T21:43:29.125966+0000","last_fullsized":"2023-07-06T21:43:29.125966+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:35:43.943388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084600+0000","last_change":"2023-07-06T21:43:28.127048+0000","last_active":"2023-07-06T21:43:30.084600+0000","last_peered":"2023-07-06T21:43:30.084600+0000","last_clean":"2023-07-06T21:43:30.084600+0000","last_became_active":"2023-07-06T21:43:28.126799+0000","last_became_peered":"2023-07-06T21:43:28.126799+0000","last_unstale":"2023-07-06T21:43:30.084600+0000","last_undegraded":"2023-07-06T21:43:30.084600+0000","last_fullsized":"2023-07-06T21:43:30.084600+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:35:43.943388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659716+0000","last_change":"2023-07-06T21:43:28.144013+0000","last_active":"2023-07-06T21:43:29.659716+0000","last_peered":"2023-07-06T21:43:29.659716+0000","last_clean":"2023-07-06T21:43:29.659716+0000","last_became_active":"2023-07-06T21:43:28.143672+0000","last_became_peered":"2023-07-06T21:43:28.143672+0000","last_unstale":"2023-07-06T21:43:29.659716+0000","last_undegraded":"2023-07-06T21:43:29.659716+0000","last_fullsized":"2023-07-06T21:43:29.659716+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:29:00.147090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162308+0000","last_change":"2023-07-06T21:43:28.148219+0000","last_active":"2023-07-06T21:43:30.162308+0000","last_peered":"2023-07-06T21:43:30.162308+0000","last_clean":"2023-07-06T21:43:30.162308+0000","last_became_active":"2023-07-06T21:43:28.147958+0000","last_became_peered":"2023-07-06T21:43:28.147958+0000","last_unstale":"2023-07-06T21:43:30.162308+0000","last_undegraded":"2023-07-06T21:43:30.162308+0000","last_fullsized":"2023-07-06T21:43:30.162308+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:43:39.474333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162867+0000","last_change":"2023-07-06T21:43:28.145606+0000","last_active":"2023-07-06T21:43:30.162867+0000","last_peered":"2023-07-06T21:43:30.162867+0000","last_clean":"2023-07-06T21:43:30.162867+0000","last_became_active":"2023-07-06T21:43:28.145139+0000","last_became_peered":"2023-07-06T21:43:28.145139+0000","last_unstale":"2023-07-06T21:43:30.162867+0000","last_undegraded":"2023-07-06T21:43:30.162867+0000","last_fullsized":"2023-07-06T21:43:30.162867+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:34:55.955941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162829+0000","last_change":"2023-07-06T21:43:28.146439+0000","last_active":"2023-07-06T21:43:30.162829+0000","last_peered":"2023-07-06T21:43:30.162829+0000","last_clean":"2023-07-06T21:43:30.162829+0000","last_became_active":"2023-07-06T21:43:28.146034+0000","last_became_peered":"2023-07-06T21:43:28.146034+0000","last_unstale":"2023-07-06T21:43:30.162829+0000","last_undegraded":"2023-07-06T21:43:30.162829+0000","last_fullsized":"2023-07-06T21:43:30.162829+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:50:04.428389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162984+0000","last_change":"2023-07-06T21:43:28.134000+0000","last_active":"2023-07-06T21:43:30.162984+0000","last_peered":"2023-07-06T21:43:30.162984+0000","last_clean":"2023-07-06T21:43:30.162984+0000","last_became_active":"2023-07-06T21:43:28.133611+0000","last_became_peered":"2023-07-06T21:43:28.133611+0000","last_unstale":"2023-07-06T21:43:30.162984+0000","last_undegraded":"2023-07-06T21:43:30.162984+0000","last_fullsized":"2023-07-06T21:43:30.162984+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:08:19.012688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.126029+0000","last_change":"2023-07-06T21:43:28.137975+0000","last_active":"2023-07-06T21:43:29.126029+0000","last_peered":"2023-07-06T21:43:29.126029+0000","last_clean":"2023-07-06T21:43:29.126029+0000","last_became_active":"2023-07-06T21:43:28.136296+0000","last_became_peered":"2023-07-06T21:43:28.136296+0000","last_unstale":"2023-07-06T21:43:29.126029+0000","last_undegraded":"2023-07-06T21:43:29.126029+0000","last_fullsized":"2023-07-06T21:43:29.126029+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:20:21.050440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124351+0000","last_change":"2023-07-06T21:43:28.135159+0000","last_active":"2023-07-06T21:43:29.124351+0000","last_peered":"2023-07-06T21:43:29.124351+0000","last_clean":"2023-07-06T21:43:29.124351+0000","last_became_active":"2023-07-06T21:43:28.134839+0000","last_became_peered":"2023-07-06T21:43:28.134839+0000","last_unstale":"2023-07-06T21:43:29.124351+0000","last_undegraded":"2023-07-06T21:43:29.124351+0000","last_fullsized":"2023-07-06T21:43:29.124351+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:52:54.983957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162378+0000","last_change":"2023-07-06T21:43:28.145467+0000","last_active":"2023-07-06T21:43:30.162378+0000","last_peered":"2023-07-06T21:43:30.162378+0000","last_clean":"2023-07-06T21:43:30.162378+0000","last_became_active":"2023-07-06T21:43:28.145165+0000","last_became_peered":"2023-07-06T21:43:28.145165+0000","last_unstale":"2023-07-06T21:43:30.162378+0000","last_undegraded":"2023-07-06T21:43:30.162378+0000","last_fullsized":"2023-07-06T21:43:30.162378+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:33.701130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084563+0000","last_change":"2023-07-06T21:43:28.131975+0000","last_active":"2023-07-06T21:43:30.084563+0000","last_peered":"2023-07-06T21:43:30.084563+0000","last_clean":"2023-07-06T21:43:30.084563+0000","last_became_active":"2023-07-06T21:43:28.131704+0000","last_became_peered":"2023-07-06T21:43:28.131704+0000","last_unstale":"2023-07-06T21:43:30.084563+0000","last_undegraded":"2023-07-06T21:43:30.084563+0000","last_fullsized":"2023-07-06T21:43:30.084563+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:11.433217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.381641+0000","last_change":"2023-07-06T21:43:28.147392+0000","last_active":"2023-07-06T21:43:29.381641+0000","last_peered":"2023-07-06T21:43:29.381641+0000","last_clean":"2023-07-06T21:43:29.381641+0000","last_became_active":"2023-07-06T21:43:28.146936+0000","last_became_peered":"2023-07-06T21:43:28.146936+0000","last_unstale":"2023-07-06T21:43:29.381641+0000","last_undegraded":"2023-07-06T21:43:29.381641+0000","last_fullsized":"2023-07-06T21:43:29.381641+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:43:44.763141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739116+0000","last_change":"2023-07-06T21:43:28.131820+0000","last_active":"2023-07-06T21:43:29.739116+0000","last_peered":"2023-07-06T21:43:29.739116+0000","last_clean":"2023-07-06T21:43:29.739116+0000","last_became_active":"2023-07-06T21:43:28.131538+0000","last_became_peered":"2023-07-06T21:43:28.131538+0000","last_unstale":"2023-07-06T21:43:29.739116+0000","last_undegraded":"2023-07-06T21:43:29.739116+0000","last_fullsized":"2023-07-06T21:43:29.739116+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:51:33.945546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.738851+0000","last_change":"2023-07-06T21:43:28.136842+0000","last_active":"2023-07-06T21:43:29.738851+0000","last_peered":"2023-07-06T21:43:29.738851+0000","last_clean":"2023-07-06T21:43:29.738851+0000","last_became_active":"2023-07-06T21:43:28.136346+0000","last_became_peered":"2023-07-06T21:43:28.136346+0000","last_unstale":"2023-07-06T21:43:29.738851+0000","last_undegraded":"2023-07-06T21:43:29.738851+0000","last_fullsized":"2023-07-06T21:43:29.738851+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:25:16.938438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.382102+0000","last_change":"2023-07-06T21:43:28.147255+0000","last_active":"2023-07-06T21:43:29.382102+0000","last_peered":"2023-07-06T21:43:29.382102+0000","last_clean":"2023-07-06T21:43:29.382102+0000","last_became_active":"2023-07-06T21:43:28.146926+0000","last_became_peered":"2023-07-06T21:43:28.146926+0000","last_unstale":"2023-07-06T21:43:29.382102+0000","last_undegraded":"2023-07-06T21:43:29.382102+0000","last_fullsized":"2023-07-06T21:43:29.382102+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:33:39.880266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124581+0000","last_change":"2023-07-06T21:43:28.137042+0000","last_active":"2023-07-06T21:43:29.124581+0000","last_peered":"2023-07-06T21:43:29.124581+0000","last_clean":"2023-07-06T21:43:29.124581+0000","last_became_active":"2023-07-06T21:43:28.136771+0000","last_became_peered":"2023-07-06T21:43:28.136771+0000","last_unstale":"2023-07-06T21:43:29.124581+0000","last_undegraded":"2023-07-06T21:43:29.124581+0000","last_fullsized":"2023-07-06T21:43:29.124581+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:23:01.411836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084842+0000","last_change":"2023-07-06T21:43:28.142922+0000","last_active":"2023-07-06T21:43:30.084842+0000","last_peered":"2023-07-06T21:43:30.084842+0000","last_clean":"2023-07-06T21:43:30.084842+0000","last_became_active":"2023-07-06T21:43:28.142659+0000","last_became_peered":"2023-07-06T21:43:28.142659+0000","last_unstale":"2023-07-06T21:43:30.084842+0000","last_undegraded":"2023-07-06T21:43:30.084842+0000","last_fullsized":"2023-07-06T21:43:30.084842+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:02:11.572115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162930+0000","last_change":"2023-07-06T21:43:28.148976+0000","last_active":"2023-07-06T21:43:30.162930+0000","last_peered":"2023-07-06T21:43:30.162930+0000","last_clean":"2023-07-06T21:43:30.162930+0000","last_became_active":"2023-07-06T21:43:28.148667+0000","last_became_peered":"2023-07-06T21:43:28.148667+0000","last_unstale":"2023-07-06T21:43:30.162930+0000","last_undegraded":"2023-07-06T21:43:30.162930+0000","last_fullsized":"2023-07-06T21:43:30.162930+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:00:35.213542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.381857+0000","last_change":"2023-07-06T21:43:28.141122+0000","last_active":"2023-07-06T21:43:29.381857+0000","last_peered":"2023-07-06T21:43:29.381857+0000","last_clean":"2023-07-06T21:43:29.381857+0000","last_became_active":"2023-07-06T21:43:28.140807+0000","last_became_peered":"2023-07-06T21:43:28.140807+0000","last_unstale":"2023-07-06T21:43:29.381857+0000","last_undegraded":"2023-07-06T21:43:29.381857+0000","last_fullsized":"2023-07-06T21:43:29.381857+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:17:47.136531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.381853+0000","last_change":"2023-07-06T21:43:28.144653+0000","last_active":"2023-07-06T21:43:29.381853+0000","last_peered":"2023-07-06T21:43:29.381853+0000","last_clean":"2023-07-06T21:43:29.381853+0000","last_became_active":"2023-07-06T21:43:28.144334+0000","last_became_peered":"2023-07-06T21:43:28.144334+0000","last_unstale":"2023-07-06T21:43:29.381853+0000","last_undegraded":"2023-07-06T21:43:29.381853+0000","last_fullsized":"2023-07-06T21:43:29.381853+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:18:53.626479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.382171+0000","last_change":"2023-07-06T21:43:28.154302+0000","last_active":"2023-07-06T21:43:29.382171+0000","last_peered":"2023-07-06T21:43:29.382171+0000","last_clean":"2023-07-06T21:43:29.382171+0000","last_became_active":"2023-07-06T21:43:28.153962+0000","last_became_peered":"2023-07-06T21:43:28.153962+0000","last_unstale":"2023-07-06T21:43:29.382171+0000","last_undegraded":"2023-07-06T21:43:29.382171+0000","last_fullsized":"2023-07-06T21:43:29.382171+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:38.827234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124553+0000","last_change":"2023-07-06T21:43:28.132756+0000","last_active":"2023-07-06T21:43:29.124553+0000","last_peered":"2023-07-06T21:43:29.124553+0000","last_clean":"2023-07-06T21:43:29.124553+0000","last_became_active":"2023-07-06T21:43:28.132516+0000","last_became_peered":"2023-07-06T21:43:28.132516+0000","last_unstale":"2023-07-06T21:43:29.124553+0000","last_undegraded":"2023-07-06T21:43:29.124553+0000","last_fullsized":"2023-07-06T21:43:29.124553+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:31:46.134851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739146+0000","last_change":"2023-07-06T21:43:28.131053+0000","last_active":"2023-07-06T21:43:29.739146+0000","last_peered":"2023-07-06T21:43:29.739146+0000","last_clean":"2023-07-06T21:43:29.739146+0000","last_became_active":"2023-07-06T21:43:28.130746+0000","last_became_peered":"2023-07-06T21:43:28.130746+0000","last_unstale":"2023-07-06T21:43:29.739146+0000","last_undegraded":"2023-07-06T21:43:29.739146+0000","last_fullsized":"2023-07-06T21:43:29.739146+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:29:50.239395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.126171+0000","last_change":"2023-07-06T21:43:28.138190+0000","last_active":"2023-07-06T21:43:29.126171+0000","last_peered":"2023-07-06T21:43:29.126171+0000","last_clean":"2023-07-06T21:43:29.126171+0000","last_became_active":"2023-07-06T21:43:28.136654+0000","last_became_peered":"2023-07-06T21:43:28.136654+0000","last_unstale":"2023-07-06T21:43:29.126171+0000","last_undegraded":"2023-07-06T21:43:29.126171+0000","last_fullsized":"2023-07-06T21:43:29.126171+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:02:11.572115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.381890+0000","last_change":"2023-07-06T21:43:28.154190+0000","last_active":"2023-07-06T21:43:29.381890+0000","last_peered":"2023-07-06T21:43:29.381890+0000","last_clean":"2023-07-06T21:43:29.381890+0000","last_became_active":"2023-07-06T21:43:28.153857+0000","last_became_peered":"2023-07-06T21:43:28.153857+0000","last_unstale":"2023-07-06T21:43:29.381890+0000","last_undegraded":"2023-07-06T21:43:29.381890+0000","last_fullsized":"2023-07-06T21:43:29.381890+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:09:42.992597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.738852+0000","last_change":"2023-07-06T21:43:28.131768+0000","last_active":"2023-07-06T21:43:29.738852+0000","last_peered":"2023-07-06T21:43:29.738852+0000","last_clean":"2023-07-06T21:43:29.738852+0000","last_became_active":"2023-07-06T21:43:28.131433+0000","last_became_peered":"2023-07-06T21:43:28.131433+0000","last_unstale":"2023-07-06T21:43:29.738852+0000","last_undegraded":"2023-07-06T21:43:29.738852+0000","last_fullsized":"2023-07-06T21:43:29.738852+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:52:09.226832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084591+0000","last_change":"2023-07-06T21:43:28.124621+0000","last_active":"2023-07-06T21:43:30.084591+0000","last_peered":"2023-07-06T21:43:30.084591+0000","last_clean":"2023-07-06T21:43:30.084591+0000","last_became_active":"2023-07-06T21:43:28.124350+0000","last_became_peered":"2023-07-06T21:43:28.124350+0000","last_unstale":"2023-07-06T21:43:30.084591+0000","last_undegraded":"2023-07-06T21:43:30.084591+0000","last_fullsized":"2023-07-06T21:43:30.084591+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:35:03.288088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124266+0000","last_change":"2023-07-06T21:43:28.144210+0000","last_active":"2023-07-06T21:43:29.124266+0000","last_peered":"2023-07-06T21:43:29.124266+0000","last_clean":"2023-07-06T21:43:29.124266+0000","last_became_active":"2023-07-06T21:43:28.143937+0000","last_became_peered":"2023-07-06T21:43:28.143937+0000","last_unstale":"2023-07-06T21:43:29.124266+0000","last_undegraded":"2023-07-06T21:43:29.124266+0000","last_fullsized":"2023-07-06T21:43:29.124266+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:22:27.729197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.128955+0000","last_change":"2023-07-06T21:43:28.144632+0000","last_active":"2023-07-06T21:43:29.128955+0000","last_peered":"2023-07-06T21:43:29.128955+0000","last_clean":"2023-07-06T21:43:29.128955+0000","last_became_active":"2023-07-06T21:43:28.143765+0000","last_became_peered":"2023-07-06T21:43:28.143765+0000","last_unstale":"2023-07-06T21:43:29.128955+0000","last_undegraded":"2023-07-06T21:43:29.128955+0000","last_fullsized":"2023-07-06T21:43:29.128955+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:25:18.218214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.085216+0000","last_change":"2023-07-06T21:43:27.726313+0000","last_active":"2023-07-06T21:43:30.085216+0000","last_peered":"2023-07-06T21:43:30.085216+0000","last_clean":"2023-07-06T21:43:30.085216+0000","last_became_active":"2023-07-06T21:43:27.726054+0000","last_became_peered":"2023-07-06T21:43:27.726054+0000","last_unstale":"2023-07-06T21:43:30.085216+0000","last_undegraded":"2023-07-06T21:43:30.085216+0000","last_fullsized":"2023-07-06T21:43:30.085216+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:32:42.463739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.382233+0000","last_change":"2023-07-06T21:43:28.148103+0000","last_active":"2023-07-06T21:43:29.382233+0000","last_peered":"2023-07-06T21:43:29.382233+0000","last_clean":"2023-07-06T21:43:29.382233+0000","last_became_active":"2023-07-06T21:43:28.147823+0000","last_became_peered":"2023-07-06T21:43:28.147823+0000","last_unstale":"2023-07-06T21:43:29.382233+0000","last_undegraded":"2023-07-06T21:43:29.382233+0000","last_fullsized":"2023-07-06T21:43:29.382233+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:34:11.156063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739174+0000","last_change":"2023-07-06T21:43:27.727188+0000","last_active":"2023-07-06T21:43:29.739174+0000","last_peered":"2023-07-06T21:43:29.739174+0000","last_clean":"2023-07-06T21:43:29.739174+0000","last_became_active":"2023-07-06T21:43:27.726961+0000","last_became_peered":"2023-07-06T21:43:27.726961+0000","last_unstale":"2023-07-06T21:43:29.739174+0000","last_undegraded":"2023-07-06T21:43:29.739174+0000","last_fullsized":"2023-07-06T21:43:29.739174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:24:18.634902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.126214+0000","last_change":"2023-07-06T21:43:28.125780+0000","last_active":"2023-07-06T21:43:29.126214+0000","last_peered":"2023-07-06T21:43:29.126214+0000","last_clean":"2023-07-06T21:43:29.126214+0000","last_became_active":"2023-07-06T21:43:28.125455+0000","last_became_peered":"2023-07-06T21:43:28.125455+0000","last_unstale":"2023-07-06T21:43:29.126214+0000","last_undegraded":"2023-07-06T21:43:29.126214+0000","last_fullsized":"2023-07-06T21:43:29.126214+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:22:19.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.129128+0000","last_change":"2023-07-06T21:43:27.729704+0000","last_active":"2023-07-06T21:43:29.129128+0000","last_peered":"2023-07-06T21:43:29.129128+0000","last_clean":"2023-07-06T21:43:29.129128+0000","last_became_active":"2023-07-06T21:43:27.729223+0000","last_became_peered":"2023-07-06T21:43:27.729223+0000","last_unstale":"2023-07-06T21:43:29.129128+0000","last_undegraded":"2023-07-06T21:43:29.129128+0000","last_fullsized":"2023-07-06T21:43:29.129128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:43:38.466830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.129065+0000","last_change":"2023-07-06T21:43:28.152395+0000","last_active":"2023-07-06T21:43:29.129065+0000","last_peered":"2023-07-06T21:43:29.129065+0000","last_clean":"2023-07-06T21:43:29.129065+0000","last_became_active":"2023-07-06T21:43:28.147472+0000","last_became_peered":"2023-07-06T21:43:28.147472+0000","last_unstale":"2023-07-06T21:43:29.129065+0000","last_undegraded":"2023-07-06T21:43:29.129065+0000","last_fullsized":"2023-07-06T21:43:29.129065+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:43:16.189289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659349+0000","last_change":"2023-07-06T21:43:27.726889+0000","last_active":"2023-07-06T21:43:29.659349+0000","last_peered":"2023-07-06T21:43:29.659349+0000","last_clean":"2023-07-06T21:43:29.659349+0000","last_became_active":"2023-07-06T21:43:27.726598+0000","last_became_peered":"2023-07-06T21:43:27.726598+0000","last_unstale":"2023-07-06T21:43:29.659349+0000","last_undegraded":"2023-07-06T21:43:29.659349+0000","last_fullsized":"2023-07-06T21:43:29.659349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:57.876183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.738949+0000","last_change":"2023-07-06T21:43:28.146165+0000","last_active":"2023-07-06T21:43:29.738949+0000","last_peered":"2023-07-06T21:43:29.738949+0000","last_clean":"2023-07-06T21:43:29.738949+0000","last_became_active":"2023-07-06T21:43:28.145868+0000","last_became_peered":"2023-07-06T21:43:28.145868+0000","last_unstale":"2023-07-06T21:43:29.738949+0000","last_undegraded":"2023-07-06T21:43:29.738949+0000","last_fullsized":"2023-07-06T21:43:29.738949+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:49:35.873552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084958+0000","last_change":"2023-07-06T21:43:27.720422+0000","last_active":"2023-07-06T21:43:30.084958+0000","last_peered":"2023-07-06T21:43:30.084958+0000","last_clean":"2023-07-06T21:43:30.084958+0000","last_became_active":"2023-07-06T21:43:27.719826+0000","last_became_peered":"2023-07-06T21:43:27.719826+0000","last_unstale":"2023-07-06T21:43:30.084958+0000","last_undegraded":"2023-07-06T21:43:30.084958+0000","last_fullsized":"2023-07-06T21:43:30.084958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:21:42.982844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162545+0000","last_change":"2023-07-06T21:43:28.142537+0000","last_active":"2023-07-06T21:43:30.162545+0000","last_peered":"2023-07-06T21:43:30.162545+0000","last_clean":"2023-07-06T21:43:30.162545+0000","last_became_active":"2023-07-06T21:43:28.142283+0000","last_became_peered":"2023-07-06T21:43:28.142283+0000","last_unstale":"2023-07-06T21:43:30.162545+0000","last_undegraded":"2023-07-06T21:43:30.162545+0000","last_fullsized":"2023-07-06T21:43:30.162545+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:21:56.348051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739032+0000","last_change":"2023-07-06T21:43:27.727116+0000","last_active":"2023-07-06T21:43:29.739032+0000","last_peered":"2023-07-06T21:43:29.739032+0000","last_clean":"2023-07-06T21:43:29.739032+0000","last_became_active":"2023-07-06T21:43:27.726829+0000","last_became_peered":"2023-07-06T21:43:27.726829+0000","last_unstale":"2023-07-06T21:43:29.739032+0000","last_undegraded":"2023-07-06T21:43:29.739032+0000","last_fullsized":"2023-07-06T21:43:29.739032+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:40:31.358888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162359+0000","last_change":"2023-07-06T21:43:28.148127+0000","last_active":"2023-07-06T21:43:30.162359+0000","last_peered":"2023-07-06T21:43:30.162359+0000","last_clean":"2023-07-06T21:43:30.162359+0000","last_became_active":"2023-07-06T21:43:28.147674+0000","last_became_peered":"2023-07-06T21:43:28.147674+0000","last_unstale":"2023-07-06T21:43:30.162359+0000","last_undegraded":"2023-07-06T21:43:30.162359+0000","last_fullsized":"2023-07-06T21:43:30.162359+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:59:40.805720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.125706+0000","last_change":"2023-07-06T21:43:27.732107+0000","last_active":"2023-07-06T21:43:29.125706+0000","last_peered":"2023-07-06T21:43:29.125706+0000","last_clean":"2023-07-06T21:43:29.125706+0000","last_became_active":"2023-07-06T21:43:27.731536+0000","last_became_peered":"2023-07-06T21:43:27.731536+0000","last_unstale":"2023-07-06T21:43:29.125706+0000","last_undegraded":"2023-07-06T21:43:29.125706+0000","last_fullsized":"2023-07-06T21:43:29.125706+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:48:52.598589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.381654+0000","last_change":"2023-07-06T21:43:28.141796+0000","last_active":"2023-07-06T21:43:29.381654+0000","last_peered":"2023-07-06T21:43:29.381654+0000","last_clean":"2023-07-06T21:43:29.381654+0000","last_became_active":"2023-07-06T21:43:28.141425+0000","last_became_peered":"2023-07-06T21:43:28.141425+0000","last_unstale":"2023-07-06T21:43:29.381654+0000","last_undegraded":"2023-07-06T21:43:29.381654+0000","last_fullsized":"2023-07-06T21:43:29.381654+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:02:53.539483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162410+0000","last_change":"2023-07-06T21:43:27.726446+0000","last_active":"2023-07-06T21:43:30.162410+0000","last_peered":"2023-07-06T21:43:30.162410+0000","last_clean":"2023-07-06T21:43:30.162410+0000","last_became_active":"2023-07-06T21:43:27.726023+0000","last_became_peered":"2023-07-06T21:43:27.726023+0000","last_unstale":"2023-07-06T21:43:30.162410+0000","last_undegraded":"2023-07-06T21:43:30.162410+0000","last_fullsized":"2023-07-06T21:43:30.162410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:38:13.060729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739066+0000","last_change":"2023-07-06T21:43:28.136626+0000","last_active":"2023-07-06T21:43:29.739066+0000","last_peered":"2023-07-06T21:43:29.739066+0000","last_clean":"2023-07-06T21:43:29.739066+0000","last_became_active":"2023-07-06T21:43:28.135991+0000","last_became_peered":"2023-07-06T21:43:28.135991+0000","last_unstale":"2023-07-06T21:43:29.739066+0000","last_undegraded":"2023-07-06T21:43:29.739066+0000","last_fullsized":"2023-07-06T21:43:29.739066+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:08:19.749149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739159+0000","last_change":"2023-07-06T21:43:27.724043+0000","last_active":"2023-07-06T21:43:29.739159+0000","last_peered":"2023-07-06T21:43:29.739159+0000","last_clean":"2023-07-06T21:43:29.739159+0000","last_became_active":"2023-07-06T21:43:27.723762+0000","last_became_peered":"2023-07-06T21:43:27.723762+0000","last_unstale":"2023-07-06T21:43:29.739159+0000","last_undegraded":"2023-07-06T21:43:29.739159+0000","last_fullsized":"2023-07-06T21:43:29.739159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:19:35.089114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659717+0000","last_change":"2023-07-06T21:43:28.128894+0000","last_active":"2023-07-06T21:43:29.659717+0000","last_peered":"2023-07-06T21:43:29.659717+0000","last_clean":"2023-07-06T21:43:29.659717+0000","last_became_active":"2023-07-06T21:43:28.128615+0000","last_became_peered":"2023-07-06T21:43:28.128615+0000","last_unstale":"2023-07-06T21:43:29.659717+0000","last_undegraded":"2023-07-06T21:43:29.659717+0000","last_fullsized":"2023-07-06T21:43:29.659717+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:06.069496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162927+0000","last_change":"2023-07-06T21:43:27.732867+0000","last_active":"2023-07-06T21:43:30.162927+0000","last_peered":"2023-07-06T21:43:30.162927+0000","last_clean":"2023-07-06T21:43:30.162927+0000","last_became_active":"2023-07-06T21:43:27.732499+0000","last_became_peered":"2023-07-06T21:43:27.732499+0000","last_unstale":"2023-07-06T21:43:30.162927+0000","last_undegraded":"2023-07-06T21:43:30.162927+0000","last_fullsized":"2023-07-06T21:43:30.162927+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:21:06.867631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.085138+0000","last_change":"2023-07-06T21:43:28.136811+0000","last_active":"2023-07-06T21:43:30.085138+0000","last_peered":"2023-07-06T21:43:30.085138+0000","last_clean":"2023-07-06T21:43:30.085138+0000","last_became_active":"2023-07-06T21:43:28.136550+0000","last_became_peered":"2023-07-06T21:43:28.136550+0000","last_unstale":"2023-07-06T21:43:30.085138+0000","last_undegraded":"2023-07-06T21:43:30.085138+0000","last_fullsized":"2023-07-06T21:43:30.085138+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:37:57.099549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659724+0000","last_change":"2023-07-06T21:43:27.731402+0000","last_active":"2023-07-06T21:43:29.659724+0000","last_peered":"2023-07-06T21:43:29.659724+0000","last_clean":"2023-07-06T21:43:29.659724+0000","last_became_active":"2023-07-06T21:43:27.731122+0000","last_became_peered":"2023-07-06T21:43:27.731122+0000","last_unstale":"2023-07-06T21:43:29.659724+0000","last_undegraded":"2023-07-06T21:43:29.659724+0000","last_fullsized":"2023-07-06T21:43:29.659724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:32:42.463739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659464+0000","last_change":"2023-07-06T21:43:28.134688+0000","last_active":"2023-07-06T21:43:29.659464+0000","last_peered":"2023-07-06T21:43:29.659464+0000","last_clean":"2023-07-06T21:43:29.659464+0000","last_became_active":"2023-07-06T21:43:28.134347+0000","last_became_peered":"2023-07-06T21:43:28.134347+0000","last_unstale":"2023-07-06T21:43:29.659464+0000","last_undegraded":"2023-07-06T21:43:29.659464+0000","last_fullsized":"2023-07-06T21:43:29.659464+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:02:11.572115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124562+0000","last_change":"2023-07-06T21:43:27.721274+0000","last_active":"2023-07-06T21:43:29.124562+0000","last_peered":"2023-07-06T21:43:29.124562+0000","last_clean":"2023-07-06T21:43:29.124562+0000","last_became_active":"2023-07-06T21:43:27.720976+0000","last_became_peered":"2023-07-06T21:43:27.720976+0000","last_unstale":"2023-07-06T21:43:29.124562+0000","last_undegraded":"2023-07-06T21:43:29.124562+0000","last_fullsized":"2023-07-06T21:43:29.124562+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:47.600326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.381762+0000","last_change":"2023-07-06T21:43:28.148521+0000","last_active":"2023-07-06T21:43:29.381762+0000","last_peered":"2023-07-06T21:43:29.381762+0000","last_clean":"2023-07-06T21:43:29.381762+0000","last_became_active":"2023-07-06T21:43:28.145066+0000","last_became_peered":"2023-07-06T21:43:28.145066+0000","last_unstale":"2023-07-06T21:43:29.381762+0000","last_undegraded":"2023-07-06T21:43:29.381762+0000","last_fullsized":"2023-07-06T21:43:29.381762+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:34:47.237305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084968+0000","last_change":"2023-07-06T21:43:27.727005+0000","last_active":"2023-07-06T21:43:30.084968+0000","last_peered":"2023-07-06T21:43:30.084968+0000","last_clean":"2023-07-06T21:43:30.084968+0000","last_became_active":"2023-07-06T21:43:27.726537+0000","last_became_peered":"2023-07-06T21:43:27.726537+0000","last_unstale":"2023-07-06T21:43:30.084968+0000","last_undegraded":"2023-07-06T21:43:30.084968+0000","last_fullsized":"2023-07-06T21:43:30.084968+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:59.057362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162550+0000","last_change":"2023-07-06T21:43:28.135417+0000","last_active":"2023-07-06T21:43:30.162550+0000","last_peered":"2023-07-06T21:43:30.162550+0000","last_clean":"2023-07-06T21:43:30.162550+0000","last_became_active":"2023-07-06T21:43:28.135163+0000","last_became_peered":"2023-07-06T21:43:28.135163+0000","last_unstale":"2023-07-06T21:43:30.162550+0000","last_undegraded":"2023-07-06T21:43:30.162550+0000","last_fullsized":"2023-07-06T21:43:30.162550+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:06:59.514452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659516+0000","last_change":"2023-07-06T21:43:27.726879+0000","last_active":"2023-07-06T21:43:29.659516+0000","last_peered":"2023-07-06T21:43:29.659516+0000","last_clean":"2023-07-06T21:43:29.659516+0000","last_became_active":"2023-07-06T21:43:27.726579+0000","last_became_peered":"2023-07-06T21:43:27.726579+0000","last_unstale":"2023-07-06T21:43:29.659516+0000","last_undegraded":"2023-07-06T21:43:29.659516+0000","last_fullsized":"2023-07-06T21:43:29.659516+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:59.057362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084540+0000","last_change":"2023-07-06T21:43:28.137267+0000","last_active":"2023-07-06T21:43:30.084540+0000","last_peered":"2023-07-06T21:43:30.084540+0000","last_clean":"2023-07-06T21:43:30.084540+0000","last_became_active":"2023-07-06T21:43:28.137007+0000","last_became_peered":"2023-07-06T21:43:28.137007+0000","last_unstale":"2023-07-06T21:43:30.084540+0000","last_undegraded":"2023-07-06T21:43:30.084540+0000","last_fullsized":"2023-07-06T21:43:30.084540+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:48:53.606092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084665+0000","last_change":"2023-07-06T21:43:27.729150+0000","last_active":"2023-07-06T21:43:30.084665+0000","last_peered":"2023-07-06T21:43:30.084665+0000","last_clean":"2023-07-06T21:43:30.084665+0000","last_became_active":"2023-07-06T21:43:27.728872+0000","last_became_peered":"2023-07-06T21:43:27.728872+0000","last_unstale":"2023-07-06T21:43:30.084665+0000","last_undegraded":"2023-07-06T21:43:30.084665+0000","last_fullsized":"2023-07-06T21:43:30.084665+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:57.876183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659504+0000","last_change":"2023-07-06T21:43:28.146072+0000","last_active":"2023-07-06T21:43:29.659504+0000","last_peered":"2023-07-06T21:43:29.659504+0000","last_clean":"2023-07-06T21:43:29.659504+0000","last_became_active":"2023-07-06T21:43:28.145683+0000","last_became_peered":"2023-07-06T21:43:28.145683+0000","last_unstale":"2023-07-06T21:43:29.659504+0000","last_undegraded":"2023-07-06T21:43:29.659504+0000","last_fullsized":"2023-07-06T21:43:29.659504+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:22:19.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162886+0000","last_change":"2023-07-06T21:43:27.726035+0000","last_active":"2023-07-06T21:43:30.162886+0000","last_peered":"2023-07-06T21:43:30.162886+0000","last_clean":"2023-07-06T21:43:30.162886+0000","last_became_active":"2023-07-06T21:43:27.725748+0000","last_became_peered":"2023-07-06T21:43:27.725748+0000","last_unstale":"2023-07-06T21:43:30.162886+0000","last_undegraded":"2023-07-06T21:43:30.162886+0000","last_fullsized":"2023-07-06T21:43:30.162886+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:54:25.440375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124430+0000","last_change":"2023-07-06T21:43:28.132302+0000","last_active":"2023-07-06T21:43:29.124430+0000","last_peered":"2023-07-06T21:43:29.124430+0000","last_clean":"2023-07-06T21:43:29.124430+0000","last_became_active":"2023-07-06T21:43:28.132125+0000","last_became_peered":"2023-07-06T21:43:28.132125+0000","last_unstale":"2023-07-06T21:43:29.124430+0000","last_undegraded":"2023-07-06T21:43:29.124430+0000","last_fullsized":"2023-07-06T21:43:29.124430+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:20:08.347391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124443+0000","last_change":"2023-07-06T21:43:27.728499+0000","last_active":"2023-07-06T21:43:29.124443+0000","last_peered":"2023-07-06T21:43:29.124443+0000","last_clean":"2023-07-06T21:43:29.124443+0000","last_became_active":"2023-07-06T21:43:27.728249+0000","last_became_peered":"2023-07-06T21:43:27.728249+0000","last_unstale":"2023-07-06T21:43:29.124443+0000","last_undegraded":"2023-07-06T21:43:29.124443+0000","last_fullsized":"2023-07-06T21:43:29.124443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:40:18.729829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162815+0000","last_change":"2023-07-06T21:43:28.138349+0000","last_active":"2023-07-06T21:43:30.162815+0000","last_peered":"2023-07-06T21:43:30.162815+0000","last_clean":"2023-07-06T21:43:30.162815+0000","last_became_active":"2023-07-06T21:43:28.138065+0000","last_became_peered":"2023-07-06T21:43:28.138065+0000","last_unstale":"2023-07-06T21:43:30.162815+0000","last_undegraded":"2023-07-06T21:43:30.162815+0000","last_fullsized":"2023-07-06T21:43:30.162815+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:30:35.260810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739246+0000","last_change":"2023-07-06T21:43:27.723497+0000","last_active":"2023-07-06T21:43:29.739246+0000","last_peered":"2023-07-06T21:43:29.739246+0000","last_clean":"2023-07-06T21:43:29.739246+0000","last_became_active":"2023-07-06T21:43:27.723082+0000","last_became_peered":"2023-07-06T21:43:27.723082+0000","last_unstale":"2023-07-06T21:43:29.739246+0000","last_undegraded":"2023-07-06T21:43:29.739246+0000","last_fullsized":"2023-07-06T21:43:29.739246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:54:29.482970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.381886+0000","last_change":"2023-07-06T21:43:28.144909+0000","last_active":"2023-07-06T21:43:29.381886+0000","last_peered":"2023-07-06T21:43:29.381886+0000","last_clean":"2023-07-06T21:43:29.381886+0000","last_became_active":"2023-07-06T21:43:28.144584+0000","last_became_peered":"2023-07-06T21:43:28.144584+0000","last_unstale":"2023-07-06T21:43:29.381886+0000","last_undegraded":"2023-07-06T21:43:29.381886+0000","last_fullsized":"2023-07-06T21:43:29.381886+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:03:32.831579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.126214+0000","last_change":"2023-07-06T21:43:27.732889+0000","last_active":"2023-07-06T21:43:29.126214+0000","last_peered":"2023-07-06T21:43:29.126214+0000","last_clean":"2023-07-06T21:43:29.126214+0000","last_became_active":"2023-07-06T21:43:27.732416+0000","last_became_peered":"2023-07-06T21:43:27.732416+0000","last_unstale":"2023-07-06T21:43:29.126214+0000","last_undegraded":"2023-07-06T21:43:29.126214+0000","last_fullsized":"2023-07-06T21:43:29.126214+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:59.057362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.382036+0000","last_change":"2023-07-06T21:43:28.158348+0000","last_active":"2023-07-06T21:43:29.382036+0000","last_peered":"2023-07-06T21:43:29.382036+0000","last_clean":"2023-07-06T21:43:29.382036+0000","last_became_active":"2023-07-06T21:43:28.158007+0000","last_became_peered":"2023-07-06T21:43:28.158007+0000","last_unstale":"2023-07-06T21:43:29.382036+0000","last_undegraded":"2023-07-06T21:43:29.382036+0000","last_fullsized":"2023-07-06T21:43:29.382036+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:41:53.029968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.085013+0000","last_change":"2023-07-06T21:43:27.727567+0000","last_active":"2023-07-06T21:43:30.085013+0000","last_peered":"2023-07-06T21:43:30.085013+0000","last_clean":"2023-07-06T21:43:30.085013+0000","last_became_active":"2023-07-06T21:43:27.727303+0000","last_became_peered":"2023-07-06T21:43:27.727303+0000","last_unstale":"2023-07-06T21:43:30.085013+0000","last_undegraded":"2023-07-06T21:43:30.085013+0000","last_fullsized":"2023-07-06T21:43:30.085013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:22:30.419221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084683+0000","last_change":"2023-07-06T21:43:28.147498+0000","last_active":"2023-07-06T21:43:30.084683+0000","last_peered":"2023-07-06T21:43:30.084683+0000","last_clean":"2023-07-06T21:43:30.084683+0000","last_became_active":"2023-07-06T21:43:28.145842+0000","last_became_peered":"2023-07-06T21:43:28.145842+0000","last_unstale":"2023-07-06T21:43:30.084683+0000","last_undegraded":"2023-07-06T21:43:30.084683+0000","last_fullsized":"2023-07-06T21:43:30.084683+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:20:21.050440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.085171+0000","last_change":"2023-07-06T21:43:27.728015+0000","last_active":"2023-07-06T21:43:30.085171+0000","last_peered":"2023-07-06T21:43:30.085171+0000","last_clean":"2023-07-06T21:43:30.085171+0000","last_became_active":"2023-07-06T21:43:27.727749+0000","last_became_peered":"2023-07-06T21:43:27.727749+0000","last_unstale":"2023-07-06T21:43:30.085171+0000","last_undegraded":"2023-07-06T21:43:30.085171+0000","last_fullsized":"2023-07-06T21:43:30.085171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:28:59.139587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.128982+0000","last_change":"2023-07-06T21:43:28.152946+0000","last_active":"2023-07-06T21:43:29.128982+0000","last_peered":"2023-07-06T21:43:29.128982+0000","last_clean":"2023-07-06T21:43:29.128982+0000","last_became_active":"2023-07-06T21:43:28.152678+0000","last_became_peered":"2023-07-06T21:43:28.152678+0000","last_unstale":"2023-07-06T21:43:29.128982+0000","last_undegraded":"2023-07-06T21:43:29.128982+0000","last_fullsized":"2023-07-06T21:43:29.128982+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:12:48.461743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.125708+0000","last_change":"2023-07-06T21:43:27.730760+0000","last_active":"2023-07-06T21:43:29.125708+0000","last_peered":"2023-07-06T21:43:29.125708+0000","last_clean":"2023-07-06T21:43:29.125708+0000","last_became_active":"2023-07-06T21:43:27.730457+0000","last_became_peered":"2023-07-06T21:43:27.730457+0000","last_unstale":"2023-07-06T21:43:29.125708+0000","last_undegraded":"2023-07-06T21:43:29.125708+0000","last_fullsized":"2023-07-06T21:43:29.125708+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:10.425713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124624+0000","last_change":"2023-07-06T21:43:28.136757+0000","last_active":"2023-07-06T21:43:29.124624+0000","last_peered":"2023-07-06T21:43:29.124624+0000","last_clean":"2023-07-06T21:43:29.124624+0000","last_became_active":"2023-07-06T21:43:28.136502+0000","last_became_peered":"2023-07-06T21:43:28.136502+0000","last_unstale":"2023-07-06T21:43:29.124624+0000","last_undegraded":"2023-07-06T21:43:29.124624+0000","last_fullsized":"2023-07-06T21:43:29.124624+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:45:21.360064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162385+0000","last_change":"2023-07-06T21:43:27.732793+0000","last_active":"2023-07-06T21:43:30.162385+0000","last_peered":"2023-07-06T21:43:30.162385+0000","last_clean":"2023-07-06T21:43:30.162385+0000","last_became_active":"2023-07-06T21:43:27.732452+0000","last_became_peered":"2023-07-06T21:43:27.732452+0000","last_unstale":"2023-07-06T21:43:30.162385+0000","last_undegraded":"2023-07-06T21:43:30.162385+0000","last_fullsized":"2023-07-06T21:43:30.162385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:49:55.409381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162546+0000","last_change":"2023-07-06T21:43:28.153933+0000","last_active":"2023-07-06T21:43:30.162546+0000","last_peered":"2023-07-06T21:43:30.162546+0000","last_clean":"2023-07-06T21:43:30.162546+0000","last_became_active":"2023-07-06T21:43:28.153625+0000","last_became_peered":"2023-07-06T21:43:28.153625+0000","last_unstale":"2023-07-06T21:43:30.162546+0000","last_undegraded":"2023-07-06T21:43:30.162546+0000","last_fullsized":"2023-07-06T21:43:30.162546+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:54:38.692864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659214+0000","last_change":"2023-07-06T21:43:27.730917+0000","last_active":"2023-07-06T21:43:29.659214+0000","last_peered":"2023-07-06T21:43:29.659214+0000","last_clean":"2023-07-06T21:43:29.659214+0000","last_became_active":"2023-07-06T21:43:27.730646+0000","last_became_peered":"2023-07-06T21:43:27.730646+0000","last_unstale":"2023-07-06T21:43:29.659214+0000","last_undegraded":"2023-07-06T21:43:29.659214+0000","last_fullsized":"2023-07-06T21:43:29.659214+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:35:42.935884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084732+0000","last_change":"2023-07-06T21:43:28.133873+0000","last_active":"2023-07-06T21:43:30.084732+0000","last_peered":"2023-07-06T21:43:30.084732+0000","last_clean":"2023-07-06T21:43:30.084732+0000","last_became_active":"2023-07-06T21:43:28.133590+0000","last_became_peered":"2023-07-06T21:43:28.133590+0000","last_unstale":"2023-07-06T21:43:30.084732+0000","last_undegraded":"2023-07-06T21:43:30.084732+0000","last_fullsized":"2023-07-06T21:43:30.084732+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:09:44.703647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659509+0000","last_change":"2023-07-06T21:43:27.731790+0000","last_active":"2023-07-06T21:43:29.659509+0000","last_peered":"2023-07-06T21:43:29.659509+0000","last_clean":"2023-07-06T21:43:29.659509+0000","last_became_active":"2023-07-06T21:43:27.731151+0000","last_became_peered":"2023-07-06T21:43:27.731151+0000","last_unstale":"2023-07-06T21:43:29.659509+0000","last_undegraded":"2023-07-06T21:43:29.659509+0000","last_fullsized":"2023-07-06T21:43:29.659509+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:22:30.419221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.382318+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:43:29.382318+0000","last_peered":"2023-07-06T21:43:29.382318+0000","last_clean":"2023-07-06T21:43:29.382318+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:43:29.382318+0000","last_undegraded":"2023-07-06T21:43:29.382318+0000","last_fullsized":"2023-07-06T21:43:29.382318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:37:35.745100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.084859+0000","last_change":"2023-07-06T21:43:28.137144+0000","last_active":"2023-07-06T21:43:30.084859+0000","last_peered":"2023-07-06T21:43:30.084859+0000","last_clean":"2023-07-06T21:43:30.084859+0000","last_became_active":"2023-07-06T21:43:28.136743+0000","last_became_peered":"2023-07-06T21:43:28.136743+0000","last_unstale":"2023-07-06T21:43:30.084859+0000","last_undegraded":"2023-07-06T21:43:30.084859+0000","last_fullsized":"2023-07-06T21:43:30.084859+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:22:19.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.739145+0000","last_change":"2023-07-06T21:43:27.722147+0000","last_active":"2023-07-06T21:43:29.739145+0000","last_peered":"2023-07-06T21:43:29.739145+0000","last_clean":"2023-07-06T21:43:29.739145+0000","last_became_active":"2023-07-06T21:43:27.721839+0000","last_became_peered":"2023-07-06T21:43:27.721839+0000","last_unstale":"2023-07-06T21:43:29.739145+0000","last_undegraded":"2023-07-06T21:43:29.739145+0000","last_fullsized":"2023-07-06T21:43:29.739145+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:51.109992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.129021+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:43:29.129021+0000","last_peered":"2023-07-06T21:43:29.129021+0000","last_clean":"2023-07-06T21:43:29.129021+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:43:29.129021+0000","last_undegraded":"2023-07-06T21:43:29.129021+0000","last_fullsized":"2023-07-06T21:43:29.129021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:54:03.674314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.125829+0000","last_change":"2023-07-06T21:43:28.145768+0000","last_active":"2023-07-06T21:43:29.125829+0000","last_peered":"2023-07-06T21:43:29.125829+0000","last_clean":"2023-07-06T21:43:29.125829+0000","last_became_active":"2023-07-06T21:43:28.145444+0000","last_became_peered":"2023-07-06T21:43:28.145444+0000","last_unstale":"2023-07-06T21:43:29.125829+0000","last_undegraded":"2023-07-06T21:43:29.125829+0000","last_fullsized":"2023-07-06T21:43:29.125829+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:35:03.288088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.128805+0000","last_change":"2023-07-06T21:43:27.730977+0000","last_active":"2023-07-06T21:43:29.128805+0000","last_peered":"2023-07-06T21:43:29.128805+0000","last_clean":"2023-07-06T21:43:29.128805+0000","last_became_active":"2023-07-06T21:43:27.730680+0000","last_became_peered":"2023-07-06T21:43:27.730680+0000","last_unstale":"2023-07-06T21:43:29.128805+0000","last_undegraded":"2023-07-06T21:43:29.128805+0000","last_fullsized":"2023-07-06T21:43:29.128805+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:01:22.284634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659844+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:43:29.659844+0000","last_peered":"2023-07-06T21:43:29.659844+0000","last_clean":"2023-07-06T21:43:29.659844+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:43:29.659844+0000","last_undegraded":"2023-07-06T21:43:29.659844+0000","last_fullsized":"2023-07-06T21:43:29.659844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:38:47.834510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.738848+0000","last_change":"2023-07-06T21:43:28.135739+0000","last_active":"2023-07-06T21:43:29.738848+0000","last_peered":"2023-07-06T21:43:29.738848+0000","last_clean":"2023-07-06T21:43:29.738848+0000","last_became_active":"2023-07-06T21:43:28.135456+0000","last_became_peered":"2023-07-06T21:43:28.135456+0000","last_unstale":"2023-07-06T21:43:29.738848+0000","last_undegraded":"2023-07-06T21:43:29.738848+0000","last_fullsized":"2023-07-06T21:43:29.738848+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:12:42.519630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162549+0000","last_change":"2023-07-06T21:43:27.725326+0000","last_active":"2023-07-06T21:43:30.162549+0000","last_peered":"2023-07-06T21:43:30.162549+0000","last_clean":"2023-07-06T21:43:30.162549+0000","last_became_active":"2023-07-06T21:43:27.724891+0000","last_became_peered":"2023-07-06T21:43:27.724891+0000","last_unstale":"2023-07-06T21:43:30.162549+0000","last_undegraded":"2023-07-06T21:43:30.162549+0000","last_fullsized":"2023-07-06T21:43:30.162549+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:58:29.118184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.128847+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:43:29.128847+0000","last_peered":"2023-07-06T21:43:29.128847+0000","last_clean":"2023-07-06T21:43:29.128847+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:43:29.128847+0000","last_undegraded":"2023-07-06T21:43:29.128847+0000","last_fullsized":"2023-07-06T21:43:29.128847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:16:05.147872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.382254+0000","last_change":"2023-07-06T21:43:28.141560+0000","last_active":"2023-07-06T21:43:29.382254+0000","last_peered":"2023-07-06T21:43:29.382254+0000","last_clean":"2023-07-06T21:43:29.382254+0000","last_became_active":"2023-07-06T21:43:28.141233+0000","last_became_peered":"2023-07-06T21:43:28.141233+0000","last_unstale":"2023-07-06T21:43:29.382254+0000","last_undegraded":"2023-07-06T21:43:29.382254+0000","last_fullsized":"2023-07-06T21:43:29.382254+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:24:43.863862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"42'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.085230+0000","last_change":"2023-07-06T21:43:27.719133+0000","last_active":"2023-07-06T21:43:30.085230+0000","last_peered":"2023-07-06T21:43:30.085230+0000","last_clean":"2023-07-06T21:43:30.085230+0000","last_became_active":"2023-07-06T21:43:27.718849+0000","last_became_peered":"2023-07-06T21:43:27.718849+0000","last_unstale":"2023-07-06T21:43:30.085230+0000","last_undegraded":"2023-07-06T21:43:30.085230+0000","last_fullsized":"2023-07-06T21:43:30.085230+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:05.061993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.125959+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:43:29.125959+0000","last_peered":"2023-07-06T21:43:29.125959+0000","last_clean":"2023-07-06T21:43:29.125959+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:43:29.125959+0000","last_undegraded":"2023-07-06T21:43:29.125959+0000","last_fullsized":"2023-07-06T21:43:29.125959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:51:35.574781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.162822+0000","last_change":"2023-07-06T21:43:28.134264+0000","last_active":"2023-07-06T21:43:30.162822+0000","last_peered":"2023-07-06T21:43:30.162822+0000","last_clean":"2023-07-06T21:43:30.162822+0000","last_became_active":"2023-07-06T21:43:28.132834+0000","last_became_peered":"2023-07-06T21:43:28.132834+0000","last_unstale":"2023-07-06T21:43:30.162822+0000","last_undegraded":"2023-07-06T21:43:30.162822+0000","last_fullsized":"2023-07-06T21:43:30.162822+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:03:55.659006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659779+0000","last_change":"2023-07-06T21:43:27.730964+0000","last_active":"2023-07-06T21:43:29.659779+0000","last_peered":"2023-07-06T21:43:29.659779+0000","last_clean":"2023-07-06T21:43:29.659779+0000","last_became_active":"2023-07-06T21:43:27.730688+0000","last_became_peered":"2023-07-06T21:43:27.730688+0000","last_unstale":"2023-07-06T21:43:29.659779+0000","last_undegraded":"2023-07-06T21:43:29.659779+0000","last_fullsized":"2023-07-06T21:43:29.659779+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:33.713525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.124194+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:43:29.124194+0000","last_peered":"2023-07-06T21:43:29.124194+0000","last_clean":"2023-07-06T21:43:29.124194+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:43:29.124194+0000","last_undegraded":"2023-07-06T21:43:29.124194+0000","last_fullsized":"2023-07-06T21:43:29.124194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:40:19.713391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659690+0000","last_change":"2023-07-06T21:43:28.138655+0000","last_active":"2023-07-06T21:43:29.659690+0000","last_peered":"2023-07-06T21:43:29.659690+0000","last_clean":"2023-07-06T21:43:29.659690+0000","last_became_active":"2023-07-06T21:43:28.138388+0000","last_became_peered":"2023-07-06T21:43:28.138388+0000","last_unstale":"2023-07-06T21:43:29.659690+0000","last_undegraded":"2023-07-06T21:43:29.659690+0000","last_fullsized":"2023-07-06T21:43:29.659690+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:37:57.099549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.128787+0000","last_change":"2023-07-06T21:43:27.730119+0000","last_active":"2023-07-06T21:43:29.128787+0000","last_peered":"2023-07-06T21:43:29.128787+0000","last_clean":"2023-07-06T21:43:29.128787+0000","last_became_active":"2023-07-06T21:43:27.729850+0000","last_became_peered":"2023-07-06T21:43:27.729850+0000","last_unstale":"2023-07-06T21:43:29.128787+0000","last_undegraded":"2023-07-06T21:43:29.128787+0000","last_fullsized":"2023-07-06T21:43:29.128787+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:07:36.306239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659303+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:43:29.659303+0000","last_peered":"2023-07-06T21:43:29.659303+0000","last_clean":"2023-07-06T21:43:29.659303+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:43:29.659303+0000","last_undegraded":"2023-07-06T21:43:29.659303+0000","last_fullsized":"2023-07-06T21:43:29.659303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:18:57.741535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:30.163014+0000","last_change":"2023-07-06T21:43:28.131975+0000","last_active":"2023-07-06T21:43:30.163014+0000","last_peered":"2023-07-06T21:43:30.163014+0000","last_clean":"2023-07-06T21:43:30.163014+0000","last_became_active":"2023-07-06T21:43:28.131686+0000","last_became_peered":"2023-07-06T21:43:28.131686+0000","last_unstale":"2023-07-06T21:43:30.163014+0000","last_undegraded":"2023-07-06T21:43:30.163014+0000","last_fullsized":"2023-07-06T21:43:30.163014+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:27.696519+0000","last_clean_scrub_stamp":"2023-07-06T21:43:27.696519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:19:03.124674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.126344+0000","last_change":"2023-07-06T21:43:27.726972+0000","last_active":"2023-07-06T21:43:29.126344+0000","last_peered":"2023-07-06T21:43:29.126344+0000","last_clean":"2023-07-06T21:43:29.126344+0000","last_became_active":"2023-07-06T21:43:27.726709+0000","last_became_peered":"2023-07-06T21:43:27.726709+0000","last_unstale":"2023-07-06T21:43:29.126344+0000","last_undegraded":"2023-07-06T21:43:29.126344+0000","last_fullsized":"2023-07-06T21:43:29.126344+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:43:26.689015+0000","last_clean_scrub_stamp":"2023-07-06T21:43:26.689015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:22:30.419221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.125984+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:43:29.125984+0000","last_peered":"2023-07-06T21:43:29.125984+0000","last_clean":"2023-07-06T21:43:29.125984+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:43:29.125984+0000","last_undegraded":"2023-07-06T21:43:29.125984+0000","last_fullsized":"2023-07-06T21:43:29.125984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:08:21.394741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-07-06T21:43:29.659379+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:43:29.659379+0000","last_peered":"2023-07-06T21:43:29.659379+0000","last_clean":"2023-07-06T21:43:29.659379+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:43:29.659379+0000","last_undegraded":"2023-07-06T21:43:29.659379+0000","last_fullsized":"2023-07-06T21:43:29.659379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:08:15.156408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1085440,"data_stored":809234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.88200000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.99199999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.84299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":491520,"data_stored":218429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.628}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":491520,"data_stored":218846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.84499999999999997}]},{"osd":4,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.74099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":499712,"data_stored":220340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.77500000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.97799999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.92300000000000004}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.629},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":499712,"data_stored":219414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.439},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.37},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.872},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.81599999999999995}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.752},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.79500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":503808,"data_stored":220362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.436}]},{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.752}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":491520,"data_stored":218846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jul 6 21:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.76500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":1081344,"data_stored":808159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":1.198},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":1.1499999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":1.3700000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.125},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.2989999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.3640000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":1.2589999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:43:37.394 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T21:43:37.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-06T21:43:37.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc152c34640 1 Processor -- start 2023-07-06T21:43:37.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc152c34640 1 -- start start 2023-07-06T21:43:37.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc152c34640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc14c15bd60 0x7fc14c15f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc152c34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc14c0cad50 0x7fc14c15fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc152c34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c06bb00 con 0x7fc14c15b990 2023-07-06T21:43:37.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc152c34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c0c9510 con 0x7fc14c0cad50 2023-07-06T21:43:37.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc152c34640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c0c8f50 con 0x7fc14c15bd60 2023-07-06T21:43:37.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc1511d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc14c0cad50 0x7fc14c15fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc1511d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc14c0cad50 0x7fc14c15fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35430/0 (socket says 172.21.15.55:35430) 2023-07-06T21:43:37.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc1509d0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc14c15b990 0x7fc14c06dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49340/0 (socket says 172.21.15.55:49340) 2023-07-06T21:43:37.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc1511d1640 1 -- 172.21.15.55:0/1659450267 learned_addr learned my addr 172.21.15.55:0/1659450267 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:37.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc14bfff640 1 --2- 172.21.15.55:0/1659450267 >> v2:172.21.15.138:3300/0 conn(0x7fc14c15bd60 0x7fc14c15f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc1511d1640 1 -- 172.21.15.55:0/1659450267 >> v2:172.21.15.138:3300/0 conn(0x7fc14c15bd60 msgr2=0x7fc14c15f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:37.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc1511d1640 1 --2- 172.21.15.55:0/1659450267 >> v2:172.21.15.138:3300/0 conn(0x7fc14c15bd60 0x7fc14c15f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc1511d1640 1 -- 172.21.15.55:0/1659450267 >> v1:172.21.15.55:6789/0 conn(0x7fc14c15b990 legacy=0x7fc14c06dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc1511d1640 1 -- 172.21.15.55:0/1659450267 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c0c9230 con 0x7fc14c0cad50 2023-07-06T21:43:37.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc14b7fe640 1 -- 172.21.15.55:0/1659450267 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879911776 0 0) 0x7fc14c06bb00 con 0x7fc14c15b990 2023-07-06T21:43:37.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.565+0000 7fc14bfff640 1 --2- 172.21.15.55:0/1659450267 >> v2:172.21.15.138:3300/0 conn(0x7fc14c15bd60 0x7fc14c15f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:37.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.569+0000 7fc1511d1640 1 --2- 172.21.15.55:0/1659450267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0cad50 0x7fc14c15fbb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc14c066160 tx=0x7fc14401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3481e021233c65b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:37.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.569+0000 7fc14b7fe640 1 -- 172.21.15.55:0/1659450267 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1440a57f0 con 0x7fc14c0cad50 2023-07-06T21:43:37.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.569+0000 7fc14b7fe640 1 -- 172.21.15.55:0/1659450267 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1440a5950 con 0x7fc14c0cad50 2023-07-06T21:43:37.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.569+0000 7fc14b7fe640 1 -- 172.21.15.55:0/1659450267 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1440a5ce0 con 0x7fc14c0cad50 2023-07-06T21:43:37.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.569+0000 7fc152c34640 1 -- 172.21.15.55:0/1659450267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0cad50 msgr2=0x7fc14c15fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.569+0000 7fc152c34640 1 --2- 172.21.15.55:0/1659450267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0cad50 0x7fc14c15fbb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc14c066160 tx=0x7fc14401c910 comp rx=0 tx=0).stop 2023-07-06T21:43:37.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.569+0000 7fc152c34640 1 -- 172.21.15.55:0/1659450267 shutdown_connections 2023-07-06T21:43:37.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.569+0000 7fc152c34640 1 --2- 172.21.15.55:0/1659450267 >> v2:172.21.15.138:3300/0 conn(0x7fc14c15bd60 0x7fc14c15f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.569+0000 7fc152c34640 1 --2- 172.21.15.55:0/1659450267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0cad50 0x7fc14c15fbb0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.569+0000 7fc152c34640 1 -- 172.21.15.55:0/1659450267 >> 172.21.15.55:0/1659450267 conn(0x7fc14c0cf3c0 msgr2=0x7fc14c0cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:37.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.569+0000 7fc152c34640 1 -- 172.21.15.55:0/1659450267 shutdown_connections 2023-07-06T21:43:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.569+0000 7fc152c34640 1 -- 172.21.15.55:0/1659450267 wait complete. 2023-07-06T21:43:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.569+0000 7fc152c34640 1 Processor -- start 2023-07-06T21:43:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.569+0000 7fc152c34640 1 -- start start 2023-07-06T21:43:37.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc152c34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0cad50 0x7fc14c0b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc152c34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc14c15b990 0x7fc14c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc152c34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc14c15bd60 0x7fc14c0c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc152c34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c159e50 con 0x7fc14c0cad50 2023-07-06T21:43:37.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc152c34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c0c4120 con 0x7fc14c15b990 2023-07-06T21:43:37.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc152c34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c1597d0 con 0x7fc14c15bd60 2023-07-06T21:43:37.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc1509d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0cad50 0x7fc14c0b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc1509d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0cad50 0x7fc14c0b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35446/0 (socket says 172.21.15.55:35446) 2023-07-06T21:43:37.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc1509d0640 1 -- 172.21.15.55:0/2950495785 learned_addr learned my addr 172.21.15.55:0/2950495785 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:37.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc14bfff640 1 --2- 172.21.15.55:0/2950495785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc14c15b990 0x7fc14c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc1511d1640 1 --2- 172.21.15.55:0/2950495785 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc14c15bd60 0x7fc14c0c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc1509d0640 1 -- 172.21.15.55:0/2950495785 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc14c15bd60 msgr2=0x7fc14c0c32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc1509d0640 1 --2- 172.21.15.55:0/2950495785 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc14c15bd60 0x7fc14c0c32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc1509d0640 1 -- 172.21.15.55:0/2950495785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc14c15b990 msgr2=0x7fc14c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc1509d0640 1 --2- 172.21.15.55:0/2950495785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc14c15b990 0x7fc14c157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc1509d0640 1 -- 172.21.15.55:0/2950495785 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc144009b30 con 0x7fc14c0cad50 2023-07-06T21:43:37.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc1509d0640 1 --2- 172.21.15.55:0/2950495785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0cad50 0x7fc14c0b1650 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c520 tx=0x7fc14000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc1497fa640 1 -- 172.21.15.55:0/2950495785 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1400074e0 con 0x7fc14c0cad50 2023-07-06T21:43:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc1497fa640 1 -- 172.21.15.55:0/2950495785 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc140007640 con 0x7fc14c0cad50 2023-07-06T21:43:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc152c34640 1 -- 172.21.15.55:0/2950495785 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14c0c3e40 con 0x7fc14c0cad50 2023-07-06T21:43:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc1497fa640 1 -- 172.21.15.55:0/2950495785 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1400049f0 con 0x7fc14c0cad50 2023-07-06T21:43:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc152c34640 1 -- 172.21.15.55:0/2950495785 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c0c4710 con 0x7fc14c0cad50 2023-07-06T21:43:37.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.573+0000 7fc152c34640 1 -- 172.21.15.55:0/2950495785 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14c159630 con 0x7fc14c0cad50 2023-07-06T21:43:37.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.577+0000 7fc1497fa640 1 -- 172.21.15.55:0/2950495785 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc140004b50 con 0x7fc14c0cad50 2023-07-06T21:43:37.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.577+0000 7fc1497fa640 1 --2- 172.21.15.55:0/2950495785 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc130066280 0x7fc130068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.577+0000 7fc1497fa640 1 -- 172.21.15.55:0/2950495785 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc140083490 con 0x7fc14c0cad50 2023-07-06T21:43:37.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.577+0000 7fc14bfff640 1 --2- 172.21.15.55:0/2950495785 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc130066280 0x7fc130068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.577+0000 7fc14bfff640 1 --2- 172.21.15.55:0/2950495785 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc130066280 0x7fc130068730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc14c15b370 tx=0x7fc138008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.581+0000 7fc1497fa640 1 -- 172.21.15.55:0/2950495785 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc14c159630 con 0x7fc14c0cad50 2023-07-06T21:43:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.789+0000 7fc152c34640 1 -- 172.21.15.55:0/2950495785 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc14c159630 con 0x7fc14c0cad50 2023-07-06T21:43:37.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.797+0000 7fc1497fa640 1 -- 172.21.15.55:0/2950495785 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc14c159630 con 0x7fc14c0cad50 2023-07-06T21:43:37.804 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-07-06T21:43:37.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.797+0000 7fc152c34640 1 -- 172.21.15.55:0/2950495785 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc130066280 msgr2=0x7fc130068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.797+0000 7fc152c34640 1 --2- 172.21.15.55:0/2950495785 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc130066280 0x7fc130068730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc14c15b370 tx=0x7fc138008040 comp rx=0 tx=0).stop 2023-07-06T21:43:37.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.797+0000 7fc152c34640 1 -- 172.21.15.55:0/2950495785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0cad50 msgr2=0x7fc14c0b1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.797+0000 7fc152c34640 1 --2- 172.21.15.55:0/2950495785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0cad50 0x7fc14c0b1650 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c520 tx=0x7fc14000c9e0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.797+0000 7fc152c34640 1 -- 172.21.15.55:0/2950495785 shutdown_connections 2023-07-06T21:43:37.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.797+0000 7fc152c34640 1 --2- 172.21.15.55:0/2950495785 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fc130066280 0x7fc130068730 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.797+0000 7fc152c34640 1 --2- 172.21.15.55:0/2950495785 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc14c15bd60 0x7fc14c0c32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.797+0000 7fc152c34640 1 --2- 172.21.15.55:0/2950495785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc14c15b990 0x7fc14c157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.797+0000 7fc152c34640 1 --2- 172.21.15.55:0/2950495785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0cad50 0x7fc14c0b1650 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.797+0000 7fc152c34640 1 -- 172.21.15.55:0/2950495785 >> 172.21.15.55:0/2950495785 conn(0x7fc14c0cf3c0 msgr2=0x7fc14c0afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:37.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.797+0000 7fc152c34640 1 -- 172.21.15.55:0/2950495785 shutdown_connections 2023-07-06T21:43:37.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.797+0000 7fc152c34640 1 -- 172.21.15.55:0/2950495785 wait complete. 2023-07-06T21:43:37.825 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:43:37.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.957+0000 7fbea3b11640 1 Processor -- start 2023-07-06T21:43:37.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea3b11640 1 -- start start 2023-07-06T21:43:37.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea3b11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe9c06f8e0 0x7fbe9c06fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea3b11640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbe9c15bc40 0x7fbe9c06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea3b11640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9c15c770 con 0x7fbe9c15cc00 2023-07-06T21:43:37.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea3b11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c06d4f0 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea3b11640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c0701f0 con 0x7fbe9c15bc40 2023-07-06T21:43:37.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea18ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe9c06f8e0 0x7fbe9c06fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea20ae640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbe9c15cc00 0x7fbe9c0693f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49342/0 (socket says 172.21.15.55:49342) 2023-07-06T21:43:37.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea20ae640 1 -- 172.21.15.55:0/1672105208 learned_addr learned my addr 172.21.15.55:0/1672105208 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:37.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea10ac640 1 --2- 172.21.15.55:0/1672105208 >> v2:172.21.15.138:3300/0 conn(0x7fbe9c15bc40 0x7fbe9c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea18ad640 1 -- 172.21.15.55:0/1672105208 >> v2:172.21.15.138:3300/0 conn(0x7fbe9c15bc40 msgr2=0x7fbe9c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:37.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea18ad640 1 --2- 172.21.15.55:0/1672105208 >> v2:172.21.15.138:3300/0 conn(0x7fbe9c15bc40 0x7fbe9c06c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea18ad640 1 -- 172.21.15.55:0/1672105208 >> v1:172.21.15.55:6789/0 conn(0x7fbe9c15cc00 legacy=0x7fbe9c0693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea18ad640 1 -- 172.21.15.55:0/1672105208 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c06d210 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea08ab640 1 -- 172.21.15.55:0/1672105208 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870323867 0 0) 0x7fbe9c15c770 con 0x7fbe9c15cc00 2023-07-06T21:43:37.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.961+0000 7fbea10ac640 1 --2- 172.21.15.55:0/1672105208 >> v2:172.21.15.138:3300/0 conn(0x7fbe9c15bc40 0x7fbe9c06c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:37.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.965+0000 7fbea18ad640 1 --2- 172.21.15.55:0/1672105208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c06f8e0 0x7fbe9c06fcb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbe980097c0 tx=0x7fbe9801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2d18b638b1fa97 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:37.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.965+0000 7fbea08ab640 1 -- 172.21.15.55:0/1672105208 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe980ab610 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.965+0000 7fbea08ab640 1 -- 172.21.15.55:0/1672105208 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe980ab770 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.965+0000 7fbea08ab640 1 -- 172.21.15.55:0/1672105208 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe980abb00 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.965+0000 7fbea3b11640 1 -- 172.21.15.55:0/1672105208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c06f8e0 msgr2=0x7fbe9c06fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.965+0000 7fbea3b11640 1 --2- 172.21.15.55:0/1672105208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c06f8e0 0x7fbe9c06fcb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbe980097c0 tx=0x7fbe9801c410 comp rx=0 tx=0).stop 2023-07-06T21:43:37.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.965+0000 7fbea3b11640 1 -- 172.21.15.55:0/1672105208 shutdown_connections 2023-07-06T21:43:37.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.965+0000 7fbea3b11640 1 --2- 172.21.15.55:0/1672105208 >> v2:172.21.15.138:3300/0 conn(0x7fbe9c15bc40 0x7fbe9c06c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.965+0000 7fbea3b11640 1 --2- 172.21.15.55:0/1672105208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c06f8e0 0x7fbe9c06fcb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.965+0000 7fbea3b11640 1 -- 172.21.15.55:0/1672105208 >> 172.21.15.55:0/1672105208 conn(0x7fbe9c0cbd80 msgr2=0x7fbe9c0ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:37.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.965+0000 7fbea3b11640 1 -- 172.21.15.55:0/1672105208 shutdown_connections 2023-07-06T21:43:37.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.965+0000 7fbea3b11640 1 -- 172.21.15.55:0/1672105208 wait complete. 2023-07-06T21:43:37.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.965+0000 7fbea3b11640 1 Processor -- start 2023-07-06T21:43:37.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.965+0000 7fbea3b11640 1 -- start start 2023-07-06T21:43:37.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea3b11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c06f8e0 0x7fbe9c0aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea3b11640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe9c15bc40 0x7fbe9c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea3b11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe9c15cc00 0x7fbe9c153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea3b11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0ae0d0 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea3b11640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0ad350 con 0x7fbe9c15bc40 2023-07-06T21:43:37.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea3b11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0ae320 con 0x7fbe9c15cc00 2023-07-06T21:43:37.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea18ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c06f8e0 0x7fbe9c0aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea18ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c06f8e0 0x7fbe9c0aee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35452/0 (socket says 172.21.15.55:35452) 2023-07-06T21:43:37.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea18ad640 1 -- 172.21.15.55:0/312664592 learned_addr learned my addr 172.21.15.55:0/312664592 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:37.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea10ac640 1 --2- 172.21.15.55:0/312664592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe9c15bc40 0x7fbe9c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea20ae640 1 --2- 172.21.15.55:0/312664592 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe9c15cc00 0x7fbe9c153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea18ad640 1 -- 172.21.15.55:0/312664592 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe9c15cc00 msgr2=0x7fbe9c153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea18ad640 1 --2- 172.21.15.55:0/312664592 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe9c15cc00 0x7fbe9c153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea18ad640 1 -- 172.21.15.55:0/312664592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe9c15bc40 msgr2=0x7fbe9c159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:37.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea18ad640 1 --2- 172.21.15.55:0/312664592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe9c15bc40 0x7fbe9c159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:37.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea18ad640 1 -- 172.21.15.55:0/312664592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009420 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea18ad640 1 --2- 172.21.15.55:0/312664592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c06f8e0 0x7fbe9c0aee00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbe980ad040 tx=0x7fbe9801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:37.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbe927fc640 1 -- 172.21.15.55:0/312664592 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe980b5810 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbe927fc640 1 -- 172.21.15.55:0/312664592 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe980b59b0 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbe927fc640 1 -- 172.21.15.55:0/312664592 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe980b5d60 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea3b11640 1 -- 172.21.15.55:0/312664592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c0ae600 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea3b11640 1 -- 172.21.15.55:0/312664592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9c0add30 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbea3b11640 1 -- 172.21.15.55:0/312664592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9c066d60 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.969+0000 7fbe927fc640 1 -- 172.21.15.55:0/312664592 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbe980b4390 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.973+0000 7fbe927fc640 1 --2- 172.21.15.55:0/312664592 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbe80066280 0x7fbe80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:37.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.973+0000 7fbe927fc640 1 -- 172.21.15.55:0/312664592 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbe9811e9b0 con 0x7fbe9c06f8e0 2023-07-06T21:43:37.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.973+0000 7fbea10ac640 1 --2- 172.21.15.55:0/312664592 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbe80066280 0x7fbe80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:37.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.973+0000 7fbea10ac640 1 --2- 172.21.15.55:0/312664592 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbe80066280 0x7fbe80068730 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0c2570 tx=0x7fbe8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:37.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:37.977+0000 7fbe927fc640 1 -- 172.21.15.55:0/312664592 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbe980ebcd0 con 0x7fbe9c06f8e0 2023-07-06T21:43:38.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.161+0000 7fbea3b11640 1 -- 172.21.15.55:0/312664592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe9c0cf1b0 con 0x7fbe9c06f8e0 2023-07-06T21:43:38.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.165+0000 7fbe927fc640 1 -- 172.21.15.55:0/312664592 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fbe980ef2f0 con 0x7fbe9c06f8e0 2023-07-06T21:43:38.172 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:43:38.172 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2166228749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2166228749},{"type":"v1","addr":"172.21.15.138:6834","nonce":2166228749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3702805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3702805788},{"type":"v1","addr":"172.21.15.138:6835","nonce":3702805788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2574870623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2574870623},{"type":"v1","addr":"172.21.15.55:6836","nonce":2574870623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:43:28.108537+0000","modified":"2023-07-06T21:43:31.358407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1792917100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1792917100},{"type":"v1","addr":"172.21.15.55:6837","nonce":1792917100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T21:43:38.173 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2023-07-06T21:43:38.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.165+0000 7fbea3b11640 1 -- 172.21.15.55:0/312664592 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbe80066280 msgr2=0x7fbe80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.165+0000 7fbea3b11640 1 --2- 172.21.15.55:0/312664592 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbe80066280 0x7fbe80068730 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0c2570 tx=0x7fbe8c008040 comp rx=0 tx=0).stop 2023-07-06T21:43:38.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.165+0000 7fbea3b11640 1 -- 172.21.15.55:0/312664592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c06f8e0 msgr2=0x7fbe9c0aee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.165+0000 7fbea3b11640 1 --2- 172.21.15.55:0/312664592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c06f8e0 0x7fbe9c0aee00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbe980ad040 tx=0x7fbe9801ac50 comp rx=0 tx=0).stop 2023-07-06T21:43:38.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.165+0000 7fbea3b11640 1 -- 172.21.15.55:0/312664592 shutdown_connections 2023-07-06T21:43:38.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.165+0000 7fbea3b11640 1 --2- 172.21.15.55:0/312664592 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7fbe80066280 0x7fbe80068730 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.165+0000 7fbea3b11640 1 --2- 172.21.15.55:0/312664592 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe9c15cc00 0x7fbe9c153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.165+0000 7fbea3b11640 1 --2- 172.21.15.55:0/312664592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe9c15bc40 0x7fbe9c159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.165+0000 7fbea3b11640 1 --2- 172.21.15.55:0/312664592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c06f8e0 0x7fbe9c0aee00 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.165+0000 7fbea3b11640 1 -- 172.21.15.55:0/312664592 >> 172.21.15.55:0/312664592 conn(0x7fbe9c0cbd80 msgr2=0x7fbe9c15e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:38.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.165+0000 7fbea3b11640 1 -- 172.21.15.55:0/312664592 shutdown_connections 2023-07-06T21:43:38.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.165+0000 7fbea3b11640 1 -- 172.21.15.55:0/312664592 wait complete. 2023-07-06T21:43:38.596 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T21:43:28.108537+0000', 'modified': '2023-07-06T21:43:31.358407+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5433': {'gid': 5433, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6837/1792917100', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 1792917100}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 1792917100}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T21:43:38.596 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T21:43:38.597 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-06T21:43:38.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb30cec640 1 Processor -- start 2023-07-06T21:43:38.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb30cec640 1 -- start start 2023-07-06T21:43:38.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb30cec640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb2c158850 0x7ffb2c0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb30cec640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb2c070af0 0x7ffb2c0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb30cec640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2c158c20 con 0x7ffb2c0ca130 2023-07-06T21:43:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb30cec640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2c0b2aa0 con 0x7ffb2c158850 2023-07-06T21:43:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb30cec640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c0c8db0 con 0x7ffb2c070af0 2023-07-06T21:43:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb2a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb2c158850 0x7ffb2c0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb2a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb2c158850 0x7ffb2c0cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35460/0 (socket says 172.21.15.55:35460) 2023-07-06T21:43:38.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2159185160 learned_addr learned my addr 172.21.15.55:0/2159185160 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:38.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb2ad9d640 1 --2- 172.21.15.55:0/2159185160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb2c070af0 0x7ffb2c0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2159185160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb2c070af0 msgr2=0x7ffb2c0ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:38.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/2159185160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb2c070af0 0x7ffb2c0ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2159185160 >> v1:172.21.15.138:6789/0 conn(0x7ffb2c0ca130 legacy=0x7ffb2c0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:38.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.733+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2159185160 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c0c9090 con 0x7ffb2c158850 2023-07-06T21:43:38.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.737+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/2159185160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c158850 0x7ffb2c0cca30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009870 tx=0x7ffb1c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd8431f00dca333 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:38.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.737+0000 7ffb2959a640 1 -- 172.21.15.55:0/2159185160 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0a8a30 con 0x7ffb2c158850 2023-07-06T21:43:38.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.737+0000 7ffb2959a640 1 -- 172.21.15.55:0/2159185160 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c0a8b90 con 0x7ffb2c158850 2023-07-06T21:43:38.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.737+0000 7ffb2959a640 1 -- 172.21.15.55:0/2159185160 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0b0440 con 0x7ffb2c158850 2023-07-06T21:43:38.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.737+0000 7ffb30cec640 1 -- 172.21.15.55:0/2159185160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c158850 msgr2=0x7ffb2c0cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.737+0000 7ffb30cec640 1 --2- 172.21.15.55:0/2159185160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c158850 0x7ffb2c0cca30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009870 tx=0x7ffb1c01ed30 comp rx=0 tx=0).stop 2023-07-06T21:43:38.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.737+0000 7ffb30cec640 1 -- 172.21.15.55:0/2159185160 shutdown_connections 2023-07-06T21:43:38.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.737+0000 7ffb30cec640 1 --2- 172.21.15.55:0/2159185160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb2c070af0 0x7ffb2c0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.737+0000 7ffb30cec640 1 --2- 172.21.15.55:0/2159185160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c158850 0x7ffb2c0cca30 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.737+0000 7ffb30cec640 1 -- 172.21.15.55:0/2159185160 >> 172.21.15.55:0/2159185160 conn(0x7ffb2c0cea70 msgr2=0x7ffb2c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:38.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.737+0000 7ffb30cec640 1 -- 172.21.15.55:0/2159185160 shutdown_connections 2023-07-06T21:43:38.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.737+0000 7ffb30cec640 1 -- 172.21.15.55:0/2159185160 wait complete. 2023-07-06T21:43:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb30cec640 1 Processor -- start 2023-07-06T21:43:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb30cec640 1 -- start start 2023-07-06T21:43:38.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb30cec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c070af0 0x7ffb2c0cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb30cec640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb2c0ca130 0x7ffb2c163260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb30cec640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb2c158850 0x7ffb2c164d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb30cec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c1519d0 con 0x7ffb2c070af0 2023-07-06T21:43:38.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb30cec640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c151cb0 con 0x7ffb2c0ca130 2023-07-06T21:43:38.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb30cec640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c151f90 con 0x7ffb2c158850 2023-07-06T21:43:38.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb2a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c070af0 0x7ffb2c0cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb2a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c070af0 0x7ffb2c0cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35466/0 (socket says 172.21.15.55:35466) 2023-07-06T21:43:38.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2201561424 learned_addr learned my addr 172.21.15.55:0/2201561424 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:38.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb2ad9d640 1 --2- 172.21.15.55:0/2201561424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb2c158850 0x7ffb2c164d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb29d9b640 1 --2- 172.21.15.55:0/2201561424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb2c0ca130 0x7ffb2c163260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2201561424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb2c158850 msgr2=0x7ffb2c164d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/2201561424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb2c158850 0x7ffb2c164d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2201561424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb2c0ca130 msgr2=0x7ffb2c163260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/2201561424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb2c0ca130 0x7ffb2c163260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2201561424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0094d0 con 0x7ffb2c070af0 2023-07-06T21:43:38.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/2201561424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c070af0 0x7ffb2c0cced0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0b3040 tx=0x7ffb1c01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:38.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb1affd640 1 -- 172.21.15.55:0/2201561424 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0be070 con 0x7ffb2c070af0 2023-07-06T21:43:38.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb1affd640 1 -- 172.21.15.55:0/2201561424 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c0ba400 con 0x7ffb2c070af0 2023-07-06T21:43:38.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb30cec640 1 -- 172.21.15.55:0/2201561424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2c09cea0 con 0x7ffb2c070af0 2023-07-06T21:43:38.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb1affd640 1 -- 172.21.15.55:0/2201561424 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0ba7d0 con 0x7ffb2c070af0 2023-07-06T21:43:38.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.741+0000 7ffb30cec640 1 -- 172.21.15.55:0/2201561424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c165260 con 0x7ffb2c070af0 2023-07-06T21:43:38.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.745+0000 7ffb1affd640 1 -- 172.21.15.55:0/2201561424 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb1c0c3410 con 0x7ffb2c070af0 2023-07-06T21:43:38.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.745+0000 7ffb1affd640 1 --2- 172.21.15.55:0/2201561424 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffb0c066280 0x7ffb0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.745+0000 7ffb1affd640 1 -- 172.21.15.55:0/2201561424 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ffb1c121a00 con 0x7ffb2c070af0 2023-07-06T21:43:38.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.745+0000 7ffb29d9b640 1 --2- 172.21.15.55:0/2201561424 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffb0c066280 0x7ffb0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 Processor -- start 2023-07-06T21:43:38.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb29d9b640 1 --2- 172.21.15.55:0/2201561424 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffb0c066280 0x7ffb0c068730 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0afcc0 tx=0x7ffb20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:38.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 -- start start 2023-07-06T21:43:38.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4ef740 0x5593fe4efb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4f0050 0x5593fe4a5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4a5d80 0x5593fe4a6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe36dac0 con 0x5593fe4ef740 2023-07-06T21:43:38.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe2a7840 con 0x5593fe4a5d80 2023-07-06T21:43:38.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593fe2fb2e0 con 0x5593fe4f0050 2023-07-06T21:43:38.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb2a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4ef740 0x5593fe4efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb2a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4ef740 0x5593fe4efb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35472/0 (socket says 172.21.15.55:35472) 2023-07-06T21:43:38.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb2a59c640 1 -- 172.21.15.55:0/1025512132 learned_addr learned my addr 172.21.15.55:0/1025512132 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:38.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb2ad9d640 1 --2- 172.21.15.55:0/1025512132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4a5d80 0x5593fe4a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb29d9b640 1 --2- 172.21.15.55:0/1025512132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4f0050 0x5593fe4a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb2a59c640 1 -- 172.21.15.55:0/1025512132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4f0050 msgr2=0x5593fe4a5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:38.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/1025512132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4f0050 0x5593fe4a5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb2a59c640 1 -- 172.21.15.55:0/1025512132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4a5d80 msgr2=0x5593fe4a6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:38.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/1025512132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4a5d80 0x5593fe4a6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb2a59c640 1 -- 172.21.15.55:0/1025512132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593fdff0890 con 0x5593fe4ef740 2023-07-06T21:43:38.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb29d9b640 1 --2- 172.21.15.55:0/1025512132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4f0050 0x5593fe4a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:38.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/1025512132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4ef740 0x5593fe4efb10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0f26f0 tx=0x7ffb1c0f2660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f876ff1eb709a8a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:38.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb0bfff640 1 -- 172.21.15.55:0/1025512132 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c10a1c0 con 0x5593fe4ef740 2023-07-06T21:43:38.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb0bfff640 1 -- 172.21.15.55:0/1025512132 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c0f0d90 con 0x5593fe4ef740 2023-07-06T21:43:38.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb0bfff640 1 -- 172.21.15.55:0/1025512132 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0fa8b0 con 0x5593fe4ef740 2023-07-06T21:43:38.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 -- 172.21.15.55:0/1025512132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4ef740 msgr2=0x5593fe4efb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 --2- 172.21.15.55:0/1025512132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4ef740 0x5593fe4efb10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0f26f0 tx=0x7ffb1c0f2660 comp rx=0 tx=0).stop 2023-07-06T21:43:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 -- 172.21.15.55:0/1025512132 shutdown_connections 2023-07-06T21:43:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 --2- 172.21.15.55:0/1025512132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4a5d80 0x5593fe4a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 --2- 172.21.15.55:0/1025512132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4f0050 0x5593fe4a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 --2- 172.21.15.55:0/1025512132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4ef740 0x5593fe4efb10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 -- 172.21.15.55:0/1025512132 >> 172.21.15.55:0/1025512132 conn(0x5593fe49d800 msgr2=0x5593fe4ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 -- 172.21.15.55:0/1025512132 shutdown_connections 2023-07-06T21:43:38.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 -- 172.21.15.55:0/1025512132 wait complete. 2023-07-06T21:43:38.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.749+0000 7ffb34046000 1 -- start start 2023-07-06T21:43:38.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 1 Processor -- start 2023-07-06T21:43:38.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4a5d80 0x5593fe4ab190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4ef740 0x5593fe4ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4f0050 0x5593fe4b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe2f4380 con 0x5593fe4a5d80 2023-07-06T21:43:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe2b0ae0 con 0x5593fe4f0050 2023-07-06T21:43:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593fe2b0780 con 0x5593fe4ef740 2023-07-06T21:43:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 10 client.0 _ll_register_callbacks cb 0x5593fe491e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T21:43:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb2a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4a5d80 0x5593fe4ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb2a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4a5d80 0x5593fe4ab190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35474/0 (socket says 172.21.15.55:35474) 2023-07-06T21:43:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2344850840 learned_addr learned my addr 172.21.15.55:0/2344850840 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:38.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb29d9b640 1 --2- 172.21.15.55:0/2344850840 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4ef740 0x5593fe4ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb2ad9d640 1 --2- 172.21.15.55:0/2344850840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4f0050 0x5593fe4b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2344850840 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4ef740 msgr2=0x5593fe4ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/2344850840 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4ef740 0x5593fe4ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2344850840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4f0050 msgr2=0x5593fe4b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/2344850840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4f0050 0x5593fe4b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2344850840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c165260 con 0x5593fe4a5d80 2023-07-06T21:43:38.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/2344850840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4a5d80 0x5593fe4ab190 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009960 tx=0x7ffb1c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc7fcbdde24a712 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:38.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb097fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T21:43:38.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb097fa640 1 -- 172.21.15.55:0/2344850840 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0f0e50 con 0x5593fe4a5d80 2023-07-06T21:43:38.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb097fa640 1 -- 172.21.15.55:0/2344850840 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ffb1c0c1bf0 con 0x5593fe4a5d80 2023-07-06T21:43:38.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 1 -- 172.21.15.55:0/2344850840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5593fe2bba20 con 0x5593fe4a5d80 2023-07-06T21:43:38.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb097fa640 1 -- 172.21.15.55:0/2344850840 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb1c0c1db0 con 0x5593fe4a5d80 2023-07-06T21:43:38.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 10 client.5637 fetch_fsmap learned FSMap version 17 2023-07-06T21:43:38.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 1 -- 172.21.15.55:0/2344850840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5593fe2b8d10 con 0x5593fe4a5d80 2023-07-06T21:43:38.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb097fa640 1 -- 172.21.15.55:0/2344850840 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c114020 con 0x5593fe4a5d80 2023-07-06T21:43:38.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb097fa640 1 -- 172.21.15.55:0/2344850840 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ffb1c0b7030 con 0x5593fe4a5d80 2023-07-06T21:43:38.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 10 client.5637 fetch_fsmap finished waiting for FSMap version 17 2023-07-06T21:43:38.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 10 client.5637 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-06T21:43:38.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 20 client.5637 populate_metadata read hostname 'smithi055' 2023-07-06T21:43:38.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 1 --2- 172.21.15.55:0/2344850840 >> [v2:172.21.15.55:6835/1792917100,v1:172.21.15.55:6837/1792917100] conn(0x5593fe4fe7b0 0x5593fe500b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 4 client.5637 mds_command: new command op to 5433 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T21:43:38.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb34046000 1 -- 172.21.15.55:0/2344850840 --> [v2:172.21.15.55:6835/1792917100,v1:172.21.15.55:6837/1792917100] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5593fe323710 con 0x5593fe4fe7b0 2023-07-06T21:43:38.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb29d9b640 1 --2- 172.21.15.55:0/2344850840 >> [v2:172.21.15.55:6835/1792917100,v1:172.21.15.55:6837/1792917100] conn(0x5593fe4fe7b0 0x5593fe500b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb29d9b640 1 --2- 172.21.15.55:0/2344850840 >> [v2:172.21.15.55:6835/1792917100,v1:172.21.15.55:6837/1792917100] conn(0x5593fe4fe7b0 0x5593fe500b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=328d4f6eec7f7a3d server_cookie=6f4c57d03d028c88 in_seq=0 out_seq=0 2023-07-06T21:43:38.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.753+0000 7ffb097fa640 10 client.5637 ms_handle_connect on v2:172.21.15.55:6835/1792917100 2023-07-06T21:43:38.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb097fa640 1 -- 172.21.15.55:0/2344850840 <== mds.0 v2:172.21.15.55:6835/1792917100 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5593fe323710 con 0x5593fe4fe7b0 2023-07-06T21:43:38.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb097fa640 10 client.5637 handle_command_reply: tid=0 2023-07-06T21:43:38.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb34046000 1 client.5637 shutdown 2023-07-06T21:43:38.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb34046000 1 -- 172.21.15.55:0/2344850840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4a5d80 msgr2=0x5593fe4ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb34046000 1 --2- 172.21.15.55:0/2344850840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4a5d80 0x5593fe4ab190 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009960 tx=0x7ffb1c000bd0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb34046000 1 -- 172.21.15.55:0/2344850840 shutdown_connections 2023-07-06T21:43:38.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb34046000 1 --2- 172.21.15.55:0/2344850840 >> [v2:172.21.15.55:6835/1792917100,v1:172.21.15.55:6837/1792917100] conn(0x5593fe4fe7b0 0x5593fe500b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb34046000 1 --2- 172.21.15.55:0/2344850840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4f0050 0x5593fe4b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb34046000 1 --2- 172.21.15.55:0/2344850840 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4ef740 0x5593fe4ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb34046000 1 --2- 172.21.15.55:0/2344850840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4a5d80 0x5593fe4ab190 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb34046000 1 -- 172.21.15.55:0/2344850840 >> 172.21.15.55:0/2344850840 conn(0x5593fe49d800 msgr2=0x5593fe4a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:38.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb097fa640 0 client.5637 ms_handle_reset on v2:172.21.15.55:6835/1792917100 2023-07-06T21:43:38.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb34046000 1 -- 172.21.15.55:0/2344850840 shutdown_connections 2023-07-06T21:43:38.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb34046000 1 -- 172.21.15.55:0/2344850840 wait complete. 2023-07-06T21:43:38.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.757+0000 7ffb34046000 20 client.5637 trim_cache size 0 max 16384 2023-07-06T21:43:38.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 Processor -- start 2023-07-06T21:43:38.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 -- start start 2023-07-06T21:43:38.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4a5d80 0x5593fe4ee740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4ef740 0x5593fe4eec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4f0050 0x5593fe4feb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fdfb1940 con 0x5593fe4a5d80 2023-07-06T21:43:38.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe5031f0 con 0x5593fe4f0050 2023-07-06T21:43:38.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593fe2b0780 con 0x5593fe4ef740 2023-07-06T21:43:38.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb2a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4a5d80 0x5593fe4ee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb2a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4a5d80 0x5593fe4ee740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35490/0 (socket says 172.21.15.55:35490) 2023-07-06T21:43:38.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2460663573 learned_addr learned my addr 172.21.15.55:0/2460663573 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:38.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb29d9b640 1 --2- 172.21.15.55:0/2460663573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4ef740 0x5593fe4eec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb2ad9d640 1 --2- 172.21.15.55:0/2460663573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4f0050 0x5593fe4feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2460663573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4ef740 msgr2=0x5593fe4eec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:38.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/2460663573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4ef740 0x5593fe4eec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2460663573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4f0050 msgr2=0x5593fe4feb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:38.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/2460663573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4f0050 0x5593fe4feb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb2a59c640 1 -- 172.21.15.55:0/2460663573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593fe4a8450 con 0x5593fe4a5d80 2023-07-06T21:43:38.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb29d9b640 1 --2- 172.21.15.55:0/2460663573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4ef740 0x5593fe4eec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:38.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb2ad9d640 1 --2- 172.21.15.55:0/2460663573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4f0050 0x5593fe4feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:38.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/2460663573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4a5d80 0x5593fe4ee740 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0f26f0 tx=0x7ffb1c0f8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a03e9f4e5dc58ef server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:38.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb18ff9640 1 -- 172.21.15.55:0/2460663573 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c10a1c0 con 0x5593fe4a5d80 2023-07-06T21:43:38.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb18ff9640 1 -- 172.21.15.55:0/2460663573 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c114020 con 0x5593fe4a5d80 2023-07-06T21:43:38.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb18ff9640 1 -- 172.21.15.55:0/2460663573 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0f0e50 con 0x5593fe4a5d80 2023-07-06T21:43:38.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 -- 172.21.15.55:0/2460663573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4a5d80 msgr2=0x5593fe4ee740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 --2- 172.21.15.55:0/2460663573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4a5d80 0x5593fe4ee740 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0f26f0 tx=0x7ffb1c0f8000 comp rx=0 tx=0).stop 2023-07-06T21:43:38.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 -- 172.21.15.55:0/2460663573 shutdown_connections 2023-07-06T21:43:38.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 --2- 172.21.15.55:0/2460663573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4f0050 0x5593fe4feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 --2- 172.21.15.55:0/2460663573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4ef740 0x5593fe4eec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 --2- 172.21.15.55:0/2460663573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4a5d80 0x5593fe4ee740 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 -- 172.21.15.55:0/2460663573 >> 172.21.15.55:0/2460663573 conn(0x5593fe49d800 msgr2=0x5593fe4ee030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:38.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 -- 172.21.15.55:0/2460663573 shutdown_connections 2023-07-06T21:43:38.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 -- 172.21.15.55:0/2460663573 wait complete. 2023-07-06T21:43:38.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 -- start start 2023-07-06T21:43:38.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.773+0000 7ffb34046000 1 Processor -- start 2023-07-06T21:43:38.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4a5d80 0x5593fe54cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4ef740 0x5593fe54d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4f0050 0x5593fe5013e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe2f1780 con 0x5593fe4ef740 2023-07-06T21:43:38.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fe2c3320 con 0x5593fe4a5d80 2023-07-06T21:43:38.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593fe2efcf0 con 0x5593fe4f0050 2023-07-06T21:43:38.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 10 client.0 _ll_register_callbacks cb 0x5593fe2b87f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T21:43:38.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb29d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4ef740 0x5593fe54d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb29d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4ef740 0x5593fe54d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35494/0 (socket says 172.21.15.55:35494) 2023-07-06T21:43:38.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb29d9b640 1 -- 172.21.15.55:0/3389992180 learned_addr learned my addr 172.21.15.55:0/3389992180 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:38.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/3389992180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4a5d80 0x5593fe54cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb2ad9d640 1 --2- 172.21.15.55:0/3389992180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4f0050 0x5593fe5013e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb29d9b640 1 -- 172.21.15.55:0/3389992180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4f0050 msgr2=0x5593fe5013e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:38.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb29d9b640 1 --2- 172.21.15.55:0/3389992180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4f0050 0x5593fe5013e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb29d9b640 1 -- 172.21.15.55:0/3389992180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4a5d80 msgr2=0x5593fe54cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:38.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb29d9b640 1 --2- 172.21.15.55:0/3389992180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4a5d80 0x5593fe54cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb29d9b640 1 -- 172.21.15.55:0/3389992180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c165260 con 0x5593fe4ef740 2023-07-06T21:43:38.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb29d9b640 1 --2- 172.21.15.55:0/3389992180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4ef740 0x5593fe54d160 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffb20001ec0 tx=0x7ffb20000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbecb48512e31c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:38.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb097fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T21:43:38.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb097fa640 1 -- 172.21.15.55:0/3389992180 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2000edb0 con 0x5593fe4ef740 2023-07-06T21:43:38.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb097fa640 1 -- 172.21.15.55:0/3389992180 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ffb20024a60 con 0x5593fe4ef740 2023-07-06T21:43:38.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 1 -- 172.21.15.55:0/3389992180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5593fe2f2cd0 con 0x5593fe4ef740 2023-07-06T21:43:38.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb097fa640 1 -- 172.21.15.55:0/3389992180 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb20024c20 con 0x5593fe4ef740 2023-07-06T21:43:38.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 10 client.5643 fetch_fsmap learned FSMap version 17 2023-07-06T21:43:38.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 1 -- 172.21.15.55:0/3389992180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5593fe29efa0 con 0x5593fe4ef740 2023-07-06T21:43:38.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb097fa640 1 -- 172.21.15.55:0/3389992180 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5593fe2f2cd0 con 0x5593fe4ef740 2023-07-06T21:43:38.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb097fa640 1 -- 172.21.15.55:0/3389992180 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ffb20020030 con 0x5593fe4ef740 2023-07-06T21:43:38.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 10 client.5643 fetch_fsmap finished waiting for FSMap version 17 2023-07-06T21:43:38.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 10 client.5643 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-06T21:43:38.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 20 client.5643 populate_metadata read hostname 'smithi055' 2023-07-06T21:43:38.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 1 --2- 172.21.15.55:0/3389992180 >> [v2:172.21.15.55:6835/1792917100,v1:172.21.15.55:6837/1792917100] conn(0x5593fe553a80 0x5593fe555e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 4 client.5643 mds_command: new command op to 5433 tid=0[{"prefix": "status"}] 2023-07-06T21:43:38.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 1 -- 172.21.15.55:0/3389992180 --> [v2:172.21.15.55:6835/1792917100,v1:172.21.15.55:6837/1792917100] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5593fe2ed360 con 0x5593fe553a80 2023-07-06T21:43:38.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/3389992180 >> [v2:172.21.15.55:6835/1792917100,v1:172.21.15.55:6837/1792917100] conn(0x5593fe553a80 0x5593fe555e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb097fa640 10 client.5643 ms_handle_connect on v2:172.21.15.55:6835/1792917100 2023-07-06T21:43:38.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb2a59c640 1 --2- 172.21.15.55:0/3389992180 >> [v2:172.21.15.55:6835/1792917100,v1:172.21.15.55:6837/1792917100] conn(0x5593fe553a80 0x5593fe555e60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3717f807b0da8620 server_cookie=4c225bd496ed9d9e in_seq=0 out_seq=0 2023-07-06T21:43:38.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb097fa640 1 -- 172.21.15.55:0/3389992180 <== mds.0 v2:172.21.15.55:6835/1792917100 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5593fe2ed360 con 0x5593fe553a80 2023-07-06T21:43:38.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb097fa640 10 client.5643 handle_command_reply: tid=0 2023-07-06T21:43:38.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.777+0000 7ffb34046000 1 client.5643 shutdown 2023-07-06T21:43:38.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb34046000 1 -- 172.21.15.55:0/3389992180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4ef740 msgr2=0x5593fe54d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb34046000 1 --2- 172.21.15.55:0/3389992180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4ef740 0x5593fe54d160 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffb20001ec0 tx=0x7ffb20000ee0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb34046000 1 -- 172.21.15.55:0/3389992180 shutdown_connections 2023-07-06T21:43:38.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb34046000 1 --2- 172.21.15.55:0/3389992180 >> [v2:172.21.15.55:6835/1792917100,v1:172.21.15.55:6837/1792917100] conn(0x5593fe553a80 0x5593fe555e60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb34046000 1 --2- 172.21.15.55:0/3389992180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x5593fe4f0050 0x5593fe5013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb34046000 1 --2- 172.21.15.55:0/3389992180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5593fe4ef740 0x5593fe54d160 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb34046000 1 --2- 172.21.15.55:0/3389992180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593fe4a5d80 0x5593fe54cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb34046000 1 -- 172.21.15.55:0/3389992180 >> 172.21.15.55:0/3389992180 conn(0x5593fe49d800 msgr2=0x5593fe4aa5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb097fa640 0 client.5643 ms_handle_reset on v2:172.21.15.55:6835/1792917100 2023-07-06T21:43:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb34046000 1 -- 172.21.15.55:0/3389992180 shutdown_connections 2023-07-06T21:43:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb34046000 1 -- 172.21.15.55:0/3389992180 wait complete. 2023-07-06T21:43:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb34046000 20 client.5643 trim_cache size 0 max 16384 2023-07-06T21:43:38.796 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T21:43:38.796 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c64f3ef1-e769-47b3-ae15-a714e4e7c4f7", 2023-07-06T21:43:38.796 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-07-06T21:43:38.796 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 5433, 2023-07-06T21:43:38.796 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-07-06T21:43:38.796 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-07-06T21:43:38.796 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-07-06T21:43:38.797 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.672821304999999, 2023-07-06T21:43:38.797 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 17, 2023-07-06T21:43:38.797 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 42, 2023-07-06T21:43:38.797 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 42, 2023-07-06T21:43:38.797 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 17.931269953000001 2023-07-06T21:43:38.797 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T21:43:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb30cec640 1 -- 172.21.15.55:0/2201561424 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffb0c066280 msgr2=0x7ffb0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb30cec640 1 --2- 172.21.15.55:0/2201561424 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffb0c066280 0x7ffb0c068730 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0afcc0 tx=0x7ffb20009040 comp rx=0 tx=0).stop 2023-07-06T21:43:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb30cec640 1 -- 172.21.15.55:0/2201561424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c070af0 msgr2=0x7ffb2c0cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb30cec640 1 --2- 172.21.15.55:0/2201561424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c070af0 0x7ffb2c0cced0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0b3040 tx=0x7ffb1c01bad0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb30cec640 1 -- 172.21.15.55:0/2201561424 shutdown_connections 2023-07-06T21:43:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb30cec640 1 --2- 172.21.15.55:0/2201561424 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ffb0c066280 0x7ffb0c068730 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb30cec640 1 --2- 172.21.15.55:0/2201561424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb2c158850 0x7ffb2c164d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb30cec640 1 --2- 172.21.15.55:0/2201561424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb2c0ca130 0x7ffb2c163260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb30cec640 1 --2- 172.21.15.55:0/2201561424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb2c070af0 0x7ffb2c0cced0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb30cec640 1 -- 172.21.15.55:0/2201561424 >> 172.21.15.55:0/2201561424 conn(0x7ffb2c0cea70 msgr2=0x7ffb2c0c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:38.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb30cec640 1 -- 172.21.15.55:0/2201561424 shutdown_connections 2023-07-06T21:43:38.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.781+0000 7ffb30cec640 1 -- 172.21.15.55:0/2201561424 wait complete. 2023-07-06T21:43:38.807 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T21:43:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.941+0000 7f87e6c34640 1 Processor -- start 2023-07-06T21:43:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.941+0000 7f87e6c34640 1 -- start start 2023-07-06T21:43:38.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.945+0000 7f87e6c34640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f87e006f520 0x7f87e00cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.945+0000 7f87e6c34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e006fae0 con 0x7f87e0158400 2023-07-06T21:43:38.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.945+0000 7f87e6c34640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e006fdc0 con 0x7f87e01587d0 2023-07-06T21:43:38.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.945+0000 7f87e6c34640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e00700a0 con 0x7f87e006f520 2023-07-06T21:43:38.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.945+0000 7f87e49d0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f87e0158400 0x7f87e00c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49350/0 (socket says 172.21.15.55:49350) 2023-07-06T21:43:38.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.945+0000 7f87e49d0640 1 -- 172.21.15.55:0/1874243413 learned_addr learned my addr 172.21.15.55:0/1874243413 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:38.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.945+0000 7f87e51d1640 1 --2- 172.21.15.55:0/1874243413 >> v2:172.21.15.138:3300/0 conn(0x7f87e006f520 0x7f87e00cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.945+0000 7f87df7fe640 1 -- 172.21.15.55:0/1874243413 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602090866 0 0) 0x7f87e006fae0 con 0x7f87e0158400 2023-07-06T21:43:38.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.945+0000 7f87df7fe640 1 -- 172.21.15.55:0/1874243413 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87d0005740 con 0x7f87e0158400 2023-07-06T21:43:38.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.945+0000 7f87e51d1640 1 -- 172.21.15.55:0/1874243413 >> v1:172.21.15.138:6789/0 conn(0x7f87e01587d0 legacy=0x7f87e0070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.945+0000 7f87e51d1640 1 -- 172.21.15.55:0/1874243413 >> v1:172.21.15.55:6789/0 conn(0x7f87e0158400 legacy=0x7f87e00c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.945+0000 7f87e51d1640 1 -- 172.21.15.55:0/1874243413 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e0070380 con 0x7f87e006f520 2023-07-06T21:43:38.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.949+0000 7f87e51d1640 1 --2- 172.21.15.55:0/1874243413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87e006f520 0x7f87e00cbaa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009d90 tx=0x7f87d801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8109c9f14f66323 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:38.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.949+0000 7f87df7fe640 1 -- 172.21.15.55:0/1874243413 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80a58f0 con 0x7f87e006f520 2023-07-06T21:43:38.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.949+0000 7f87df7fe640 1 -- 172.21.15.55:0/1874243413 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d80a5a50 con 0x7f87e006f520 2023-07-06T21:43:38.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.949+0000 7f87df7fe640 1 -- 172.21.15.55:0/1874243413 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80a5de0 con 0x7f87e006f520 2023-07-06T21:43:38.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.949+0000 7f87e6c34640 1 -- 172.21.15.55:0/1874243413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87e006f520 msgr2=0x7f87e00cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.949+0000 7f87e6c34640 1 --2- 172.21.15.55:0/1874243413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87e006f520 0x7f87e00cbaa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009d90 tx=0x7f87d801c920 comp rx=0 tx=0).stop 2023-07-06T21:43:38.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.949+0000 7f87e6c34640 1 -- 172.21.15.55:0/1874243413 shutdown_connections 2023-07-06T21:43:38.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.949+0000 7f87e6c34640 1 --2- 172.21.15.55:0/1874243413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87e006f520 0x7f87e00cbaa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.949+0000 7f87e6c34640 1 -- 172.21.15.55:0/1874243413 >> 172.21.15.55:0/1874243413 conn(0x7f87e00cded0 msgr2=0x7f87e00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:38.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.949+0000 7f87e6c34640 1 -- 172.21.15.55:0/1874243413 shutdown_connections 2023-07-06T21:43:38.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.949+0000 7f87e6c34640 1 -- 172.21.15.55:0/1874243413 wait complete. 2023-07-06T21:43:38.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.949+0000 7f87e6c34640 1 Processor -- start 2023-07-06T21:43:38.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.949+0000 7f87e6c34640 1 -- start start 2023-07-06T21:43:38.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e6c34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e006f520 0x7f87e01462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e6c34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87e0158400 0x7f87e00c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e6c34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87e01587d0 0x7f87e00caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e6c34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00c6400 con 0x7f87e006f520 2023-07-06T21:43:38.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e6c34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0146820 con 0x7f87e01587d0 2023-07-06T21:43:38.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e6c34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00c57f0 con 0x7f87e0158400 2023-07-06T21:43:38.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e49d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e006f520 0x7f87e01462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e49d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e006f520 0x7f87e01462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35498/0 (socket says 172.21.15.55:35498) 2023-07-06T21:43:38.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e49d0640 1 -- 172.21.15.55:0/849824804 learned_addr learned my addr 172.21.15.55:0/849824804 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:38.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e51d1640 1 --2- 172.21.15.55:0/849824804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87e01587d0 0x7f87e00caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87dffff640 1 --2- 172.21.15.55:0/849824804 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87e0158400 0x7f87e00c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e49d0640 1 -- 172.21.15.55:0/849824804 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87e0158400 msgr2=0x7f87e00c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e49d0640 1 --2- 172.21.15.55:0/849824804 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87e0158400 0x7f87e00c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e49d0640 1 -- 172.21.15.55:0/849824804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87e01587d0 msgr2=0x7f87e00caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:38.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e49d0640 1 --2- 172.21.15.55:0/849824804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87e01587d0 0x7f87e00caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:38.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e49d0640 1 -- 172.21.15.55:0/849824804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d8009a70 con 0x7f87e006f520 2023-07-06T21:43:38.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e49d0640 1 --2- 172.21.15.55:0/849824804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e006f520 0x7f87e01462e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f87d400c4d0 tx=0x7f87d400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:38.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87dd7fa640 1 -- 172.21.15.55:0/849824804 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4005cf0 con 0x7f87e006f520 2023-07-06T21:43:38.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87dd7fa640 1 -- 172.21.15.55:0/849824804 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d4005e50 con 0x7f87e006f520 2023-07-06T21:43:38.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e6c34640 1 -- 172.21.15.55:0/849824804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e00c5ad0 con 0x7f87e006f520 2023-07-06T21:43:38.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87dd7fa640 1 -- 172.21.15.55:0/849824804 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4007270 con 0x7f87e006f520 2023-07-06T21:43:38.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e6c34640 1 -- 172.21.15.55:0/849824804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e00c6090 con 0x7f87e006f520 2023-07-06T21:43:38.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87e6c34640 1 -- 172.21.15.55:0/849824804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e006c580 con 0x7f87e006f520 2023-07-06T21:43:38.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.953+0000 7f87dd7fa640 1 -- 172.21.15.55:0/849824804 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87d40073d0 con 0x7f87e006f520 2023-07-06T21:43:38.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.957+0000 7f87dd7fa640 1 --2- 172.21.15.55:0/849824804 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f87c4066280 0x7f87c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:38.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.957+0000 7f87dd7fa640 1 -- 172.21.15.55:0/849824804 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f87d4083370 con 0x7f87e006f520 2023-07-06T21:43:38.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.957+0000 7f87dffff640 1 --2- 172.21.15.55:0/849824804 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f87c4066280 0x7f87c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:38.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.957+0000 7f87dffff640 1 --2- 172.21.15.55:0/849824804 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f87c4066280 0x7f87c4068730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f87e00cba80 tx=0x7f87cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:38.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:38.961+0000 7f87dd7fa640 1 -- 172.21.15.55:0/849824804 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f87d4050750 con 0x7f87e006f520 2023-07-06T21:43:39.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:39.149+0000 7f87e6c34640 1 -- 172.21.15.55:0/849824804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f87e0066d60 con 0x7f87e006f520 2023-07-06T21:43:39.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:39.149+0000 7f87dd7fa640 1 -- 172.21.15.55:0/849824804 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f87d4053d70 con 0x7f87e006f520 2023-07-06T21:43:39.158 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T21:43:39.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:39.149+0000 7f87e6c34640 1 -- 172.21.15.55:0/849824804 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f87c4066280 msgr2=0x7f87c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:39.149+0000 7f87e6c34640 1 --2- 172.21.15.55:0/849824804 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f87c4066280 0x7f87c4068730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f87e00cba80 tx=0x7f87cc009040 comp rx=0 tx=0).stop 2023-07-06T21:43:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:39.149+0000 7f87e6c34640 1 -- 172.21.15.55:0/849824804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e006f520 msgr2=0x7f87e01462e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:39.149+0000 7f87e6c34640 1 --2- 172.21.15.55:0/849824804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e006f520 0x7f87e01462e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f87d400c4d0 tx=0x7f87d400c990 comp rx=0 tx=0).stop 2023-07-06T21:43:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:39.153+0000 7f87e6c34640 1 -- 172.21.15.55:0/849824804 shutdown_connections 2023-07-06T21:43:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:39.153+0000 7f87e6c34640 1 --2- 172.21.15.55:0/849824804 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f87c4066280 0x7f87c4068730 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:39.153+0000 7f87e6c34640 1 --2- 172.21.15.55:0/849824804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87e01587d0 0x7f87e00caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:39.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:39.153+0000 7f87e6c34640 1 --2- 172.21.15.55:0/849824804 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87e0158400 0x7f87e00c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:39.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:39.153+0000 7f87e6c34640 1 --2- 172.21.15.55:0/849824804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e006f520 0x7f87e01462e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:39.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:39.153+0000 7f87e6c34640 1 -- 172.21.15.55:0/849824804 >> 172.21.15.55:0/849824804 conn(0x7f87e00cded0 msgr2=0x7f87e0156350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:39.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:39.153+0000 7f87e6c34640 1 -- 172.21.15.55:0/849824804 shutdown_connections 2023-07-06T21:43:39.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:39.153+0000 7f87e6c34640 1 -- 172.21.15.55:0/849824804 wait complete. 2023-07-06T21:43:39.178 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T21:43:39.178 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T21:43:39.179 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-07-06T21:43:39.179 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T21:43:39.180 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T21:43:39.180 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T21:43:39.180 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-06T21:43:39.181 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T21:43:39.181 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:43:39.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:39.182 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-07-06T21:43:39.191 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T21:43:39.191 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T21:43:39.192 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T21:43:39.192 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:43:39.192 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T21:43:39.192 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:43:39.192 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:43:39.192 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:43:39.193 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-07-06T21:43:39.193 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:43:39.193 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:43:39.193 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-07-06T21:43:39.193 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T21:43:39.194 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:43:39.194 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-07-06T21:43:39.194 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-06T21:43:39.194 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42337sec preferred_lft 42337sec 2023-07-06T21:43:39.194 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-07-06T21:43:39.194 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:43:39.195 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:43:39.195 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:43:39.195 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-07-06T21:43:39.195 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T21:43:39.195 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:84:fe:b8:21 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:43:39.195 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T21:43:39.195 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:43:39.196 INFO:teuthology.orchestra.run.smithi055.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T21:43:39.196 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-06T21:43:39.196 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T21:43:39.196 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:43:39.196 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-06T21:43:39.196 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:43:39.196 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T21:43:39.196 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T21:43:39.197 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-06T21:43:39.197 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:43:39.197 INFO:teuthology.orchestra.run.smithi055.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T21:43:39.197 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T21:43:39.197 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-06T21:43:39.197 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:43:39.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:39.199 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T21:43:39.263 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-07-06T21:43:39.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:39.265 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-07-06T21:43:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-07-06T21:43:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T21:43:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-06T21:43:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T21:43:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-06T21:43:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T21:43:39.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:39.323 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:43:39.323 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:43:39.323 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T21:43:39.323 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T21:43:39.324 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T21:43:39.324 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:43:39.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:39.421 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T21:43:39.431 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T21:43:39.431 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T21:43:39.432 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:43:39.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:39.432 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-07-06T21:43:39.500 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:43:39.501 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T21:43:39.551 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:43:39.552 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:43:39.552 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T21:43:39.603 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-06T21:43:39.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:39.604 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:43:39.698 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:43:39.699 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:43:39.712 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:43:39.712 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:43:39.712 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-07-06T21:43:39.713 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.cephfs=/ 2023-07-06T21:43:39.714 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-07-06T21:43:39.716 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T21:43:39.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:39.717 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T21:43:39.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:39.740 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:43:39.801 INFO:teuthology.orchestra.run.smithi055.stdout:client5180 2023-07-06T21:43:39.801 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:43:39.802 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:43:39.851 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-06T21:43:40.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.033+0000 7ff6b1567640 1 Processor -- start 2023-07-06T21:43:40.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.033+0000 7ff6b1567640 1 -- start start 2023-07-06T21:43:40.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.033+0000 7ff6b1567640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6ac0709a0 0x7ff6ac0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:40.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.033+0000 7ff6b1567640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ac0cc300 con 0x7ff6ac0cbe60 2023-07-06T21:43:40.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.033+0000 7ff6b1567640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ac0cc5e0 con 0x7ff6ac0b1340 2023-07-06T21:43:40.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.033+0000 7ff6b1567640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ac0cc8c0 con 0x7ff6ac0709a0 2023-07-06T21:43:40.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.033+0000 7ff6aaffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6ac0709a0 0x7ff6ac0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:40.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.033+0000 7ff6aa7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff6ac0cbe60 0x7ff6ac0b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49362/0 (socket says 172.21.15.55:49362) 2023-07-06T21:43:40.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.033+0000 7ff6aa7fc640 1 -- 172.21.15.55:0/3718048674 learned_addr learned my addr 172.21.15.55:0/3718048674 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:40.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.033+0000 7ff6aaffd640 1 -- 172.21.15.55:0/3718048674 >> v1:172.21.15.138:6789/0 conn(0x7ff6ac0b1340 legacy=0x7ff6ac06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:40.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.033+0000 7ff6aaffd640 1 -- 172.21.15.55:0/3718048674 >> v1:172.21.15.55:6789/0 conn(0x7ff6ac0cbe60 legacy=0x7ff6ac0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:40.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.033+0000 7ff6aaffd640 1 -- 172.21.15.55:0/3718048674 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac0ccba0 con 0x7ff6ac0709a0 2023-07-06T21:43:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.037+0000 7ff6aaffd640 1 --2- 172.21.15.55:0/3718048674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6ac0709a0 0x7ff6ac0cb920 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0097c0 tx=0x7ff69c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc160374e22f930 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:40.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.037+0000 7ff6a9ffb640 1 -- 172.21.15.55:0/3718048674 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c0a8050 con 0x7ff6ac0709a0 2023-07-06T21:43:40.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.037+0000 7ff6a9ffb640 1 -- 172.21.15.55:0/3718048674 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c0ac5f0 con 0x7ff6ac0709a0 2023-07-06T21:43:40.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.037+0000 7ff6a9ffb640 1 -- 172.21.15.55:0/3718048674 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c0ac980 con 0x7ff6ac0709a0 2023-07-06T21:43:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.037+0000 7ff6b1567640 1 -- 172.21.15.55:0/3718048674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6ac0709a0 msgr2=0x7ff6ac0cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.037+0000 7ff6b1567640 1 --2- 172.21.15.55:0/3718048674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6ac0709a0 0x7ff6ac0cb920 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0097c0 tx=0x7ff69c01c480 comp rx=0 tx=0).stop 2023-07-06T21:43:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.037+0000 7ff6b1567640 1 -- 172.21.15.55:0/3718048674 shutdown_connections 2023-07-06T21:43:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.037+0000 7ff6b1567640 1 --2- 172.21.15.55:0/3718048674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6ac0709a0 0x7ff6ac0cb920 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.037+0000 7ff6b1567640 1 -- 172.21.15.55:0/3718048674 >> 172.21.15.55:0/3718048674 conn(0x7ff6ac0cea70 msgr2=0x7ff6ac0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.037+0000 7ff6b1567640 1 -- 172.21.15.55:0/3718048674 shutdown_connections 2023-07-06T21:43:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.037+0000 7ff6b1567640 1 -- 172.21.15.55:0/3718048674 wait complete. 2023-07-06T21:43:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6b1567640 1 Processor -- start 2023-07-06T21:43:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6b1567640 1 -- start start 2023-07-06T21:43:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6b1567640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6ac0709a0 0x7ff6ac06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6b1567640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6ac0b1340 0x7ff6ac06b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6b1567640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6ac0cbe60 0x7ff6ac1f8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6b1567640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac1549a0 con 0x7ff6ac0709a0 2023-07-06T21:43:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6b1567640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac164340 con 0x7ff6ac0cbe60 2023-07-06T21:43:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6b1567640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac15f690 con 0x7ff6ac0b1340 2023-07-06T21:43:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6aaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6ac0709a0 0x7ff6ac06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6aaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6ac0709a0 0x7ff6ac06b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35510/0 (socket says 172.21.15.55:35510) 2023-07-06T21:43:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6aaffd640 1 -- 172.21.15.55:0/1451938509 learned_addr learned my addr 172.21.15.55:0/1451938509 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6ab7fe640 1 --2- 172.21.15.55:0/1451938509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6ac0cbe60 0x7ff6ac1f8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6aa7fc640 1 --2- 172.21.15.55:0/1451938509 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6ac0b1340 0x7ff6ac06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6aaffd640 1 -- 172.21.15.55:0/1451938509 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6ac0b1340 msgr2=0x7ff6ac06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6aaffd640 1 --2- 172.21.15.55:0/1451938509 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6ac0b1340 0x7ff6ac06b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6aaffd640 1 -- 172.21.15.55:0/1451938509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6ac0cbe60 msgr2=0x7ff6ac1f8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6aaffd640 1 --2- 172.21.15.55:0/1451938509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6ac0cbe60 0x7ff6ac1f8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6aaffd640 1 -- 172.21.15.55:0/1451938509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c009420 con 0x7ff6ac0709a0 2023-07-06T21:43:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6aaffd640 1 --2- 172.21.15.55:0/1451938509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6ac0709a0 0x7ff6ac06b1e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff69c01a0b0 tx=0x7ff69c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6937fe640 1 -- 172.21.15.55:0/1451938509 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c0b8860 con 0x7ff6ac0709a0 2023-07-06T21:43:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6937fe640 1 -- 172.21.15.55:0/1451938509 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c0b89c0 con 0x7ff6ac0709a0 2023-07-06T21:43:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6937fe640 1 -- 172.21.15.55:0/1451938509 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c0b8d70 con 0x7ff6ac0709a0 2023-07-06T21:43:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6b1567640 1 -- 172.21.15.55:0/1451938509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ac15f970 con 0x7ff6ac0709a0 2023-07-06T21:43:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6b1567640 1 -- 172.21.15.55:0/1451938509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac15ff30 con 0x7ff6ac0709a0 2023-07-06T21:43:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.041+0000 7ff6b1567640 1 -- 172.21.15.55:0/1451938509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ac160120 con 0x7ff6ac0709a0 2023-07-06T21:43:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.045+0000 7ff6937fe640 1 -- 172.21.15.55:0/1451938509 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff69c0c1410 con 0x7ff6ac0709a0 2023-07-06T21:43:40.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.045+0000 7ff6937fe640 1 --2- 172.21.15.55:0/1451938509 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff698066280 0x7ff698068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:40.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.045+0000 7ff6937fe640 1 -- 172.21.15.55:0/1451938509 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff69c11e4a0 con 0x7ff6ac0709a0 2023-07-06T21:43:40.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.045+0000 7ff6aa7fc640 1 --2- 172.21.15.55:0/1451938509 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff698066280 0x7ff698068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:40.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.045+0000 7ff6aa7fc640 1 --2- 172.21.15.55:0/1451938509 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff698066280 0x7ff698068730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac1f8280 tx=0x7ff6a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:40.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.049+0000 7ff6937fe640 1 -- 172.21.15.55:0/1451938509 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff69c0eb8f0 con 0x7ff6ac0709a0 2023-07-06T21:43:40.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.225+0000 7ff6b1567640 1 -- 172.21.15.55:0/1451938509 --> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6ac066d60 con 0x7ff698066280 2023-07-06T21:43:40.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.225+0000 7ff6937fe640 1 -- 172.21.15.55:0/1451938509 <== mgr.4101 v2:172.21.15.55:6832/1575998409 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff6ac066d60 con 0x7ff698066280 2023-07-06T21:43:40.234 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T21:43:40.234 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:43:40.234 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-07-06T21:43:40.235 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:43:40.235 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T21:43:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.229+0000 7ff6b1567640 1 -- 172.21.15.55:0/1451938509 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff698066280 msgr2=0x7ff698068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.229+0000 7ff6b1567640 1 --2- 172.21.15.55:0/1451938509 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff698066280 0x7ff698068730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac1f8280 tx=0x7ff6a0009040 comp rx=0 tx=0).stop 2023-07-06T21:43:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.229+0000 7ff6b1567640 1 -- 172.21.15.55:0/1451938509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6ac0709a0 msgr2=0x7ff6ac06b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.229+0000 7ff6b1567640 1 --2- 172.21.15.55:0/1451938509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6ac0709a0 0x7ff6ac06b1e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff69c01a0b0 tx=0x7ff69c01acc0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.229+0000 7ff6b1567640 1 -- 172.21.15.55:0/1451938509 shutdown_connections 2023-07-06T21:43:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.229+0000 7ff6b1567640 1 --2- 172.21.15.55:0/1451938509 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7ff698066280 0x7ff698068730 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.229+0000 7ff6b1567640 1 --2- 172.21.15.55:0/1451938509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6ac0cbe60 0x7ff6ac1f8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.229+0000 7ff6b1567640 1 --2- 172.21.15.55:0/1451938509 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6ac0b1340 0x7ff6ac06b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.229+0000 7ff6b1567640 1 --2- 172.21.15.55:0/1451938509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6ac0709a0 0x7ff6ac06b1e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.229+0000 7ff6b1567640 1 -- 172.21.15.55:0/1451938509 >> 172.21.15.55:0/1451938509 conn(0x7ff6ac0cea70 msgr2=0x7ff6ac164cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.229+0000 7ff6b1567640 1 -- 172.21.15.55:0/1451938509 shutdown_connections 2023-07-06T21:43:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.229+0000 7ff6b1567640 1 -- 172.21.15.55:0/1451938509 wait complete. 2023-07-06T21:43:40.255 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-06T21:43:40.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.393+0000 7f6d37182640 1 Processor -- start 2023-07-06T21:43:40.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.393+0000 7f6d37182640 1 -- start start 2023-07-06T21:43:40.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.393+0000 7f6d37182640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6d3015b850 0x7f6d300cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:40.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.393+0000 7f6d37182640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d300b2b80 con 0x7f6d300b3f80 2023-07-06T21:43:40.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.393+0000 7f6d37182640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d300cff30 con 0x7f6d300ccd30 2023-07-06T21:43:40.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.393+0000 7f6d37182640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d300b22e0 con 0x7f6d3015b850 2023-07-06T21:43:40.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.393+0000 7f6d3571f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6d300b3f80 0x7f6d300d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49364/0 (socket says 172.21.15.55:49364) 2023-07-06T21:43:40.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.393+0000 7f6d3571f640 1 -- 172.21.15.55:0/391137936 learned_addr learned my addr 172.21.15.55:0/391137936 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:40.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.393+0000 7f6d34f1e640 1 --2- 172.21.15.55:0/391137936 >> v2:172.21.15.138:3300/0 conn(0x7f6d3015b850 0x7f6d300cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:40.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.393+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929785618 0 0) 0x7f6d300b2b80 con 0x7f6d300b3f80 2023-07-06T21:43:40.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.393+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d18003530 con 0x7f6d300b3f80 2023-07-06T21:43:40.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324384659 0 0) 0x7f6d300cff30 con 0x7f6d300ccd30 2023-07-06T21:43:40.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d300b2b80 con 0x7f6d300ccd30 2023-07-06T21:43:40.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641062806 0 0) 0x7f6d18003530 con 0x7f6d300b3f80 2023-07-06T21:43:40.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 >> v2:172.21.15.138:3300/0 conn(0x7f6d3015b850 msgr2=0x7f6d300cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:40.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 --2- 172.21.15.55:0/391137936 >> v2:172.21.15.138:3300/0 conn(0x7f6d3015b850 0x7f6d300cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 >> v1:172.21.15.138:6789/0 conn(0x7f6d300ccd30 legacy=0x7f6d300b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:40.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d300b25c0 con 0x7f6d300b3f80 2023-07-06T21:43:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f6d28001a50 con 0x7f6d300b3f80 2023-07-06T21:43:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d34f1e640 1 --2- 172.21.15.55:0/391137936 >> v2:172.21.15.138:3300/0 conn(0x7f6d3015b850 0x7f6d300cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 >> v1:172.21.15.55:6789/0 conn(0x7f6d300b3f80 legacy=0x7f6d300d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 --2- 172.21.15.55:0/391137936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d18003b10 0x7f6d18003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 --2- 172.21.15.55:0/391137936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d180047d0 0x7f6d18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 --2- 172.21.15.55:0/391137936 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d180051f0 0x7f6d1800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d300b22e0 con 0x7f6d18003b10 2023-07-06T21:43:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1800c130 con 0x7f6d180047d0 2023-07-06T21:43:40.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1800c2f0 con 0x7f6d180051f0 2023-07-06T21:43:40.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d34f1e640 1 --2- 172.21.15.55:0/391137936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d18003b10 0x7f6d18003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:40.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d3571f640 1 --2- 172.21.15.55:0/391137936 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d180051f0 0x7f6d1800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:40.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d27fff640 1 --2- 172.21.15.55:0/391137936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d180047d0 0x7f6d18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:40.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d34f1e640 1 -- 172.21.15.55:0/391137936 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d180051f0 msgr2=0x7f6d1800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:40.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d34f1e640 1 --2- 172.21.15.55:0/391137936 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d180051f0 0x7f6d1800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d34f1e640 1 -- 172.21.15.55:0/391137936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d180047d0 msgr2=0x7f6d18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:40.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d34f1e640 1 --2- 172.21.15.55:0/391137936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d180047d0 0x7f6d18004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d34f1e640 1 -- 172.21.15.55:0/391137936 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d18003530 con 0x7f6d18003b10 2023-07-06T21:43:40.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d3571f640 1 -- 172.21.15.55:0/391137936 reap_dead start 2023-07-06T21:43:40.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d34f1e640 1 --2- 172.21.15.55:0/391137936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d18003b10 0x7f6d18003f00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009cb0 tx=0x7f6d2c01cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca29e115de4cb238 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:40.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c0a5760 con 0x7f6d18003b10 2023-07-06T21:43:40.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c0a58c0 con 0x7f6d18003b10 2023-07-06T21:43:40.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.397+0000 7f6d277fe640 1 -- 172.21.15.55:0/391137936 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c0a5cb0 con 0x7f6d18003b10 2023-07-06T21:43:40.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 -- 172.21.15.55:0/391137936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d18003b10 msgr2=0x7f6d18003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:40.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 --2- 172.21.15.55:0/391137936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d18003b10 0x7f6d18003f00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009cb0 tx=0x7f6d2c01cbe0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 -- 172.21.15.55:0/391137936 shutdown_connections 2023-07-06T21:43:40.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 --2- 172.21.15.55:0/391137936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d18003b10 0x7f6d18003f00 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 -- 172.21.15.55:0/391137936 >> 172.21.15.55:0/391137936 conn(0x7f6d300cec20 msgr2=0x7f6d300cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:40.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 -- 172.21.15.55:0/391137936 shutdown_connections 2023-07-06T21:43:40.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 -- 172.21.15.55:0/391137936 wait complete. 2023-07-06T21:43:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 Processor -- start 2023-07-06T21:43:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 -- start start 2023-07-06T21:43:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d18003b10 0x7f6d300c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d3015d0f0 0x7f6d301557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d30069fe0 0x7f6d301589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3015de10 con 0x7f6d3015d0f0 2023-07-06T21:43:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3006a9c0 con 0x7f6d30069fe0 2023-07-06T21:43:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d37182640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3015d750 con 0x7f6d18003b10 2023-07-06T21:43:40.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d27fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d3015d0f0 0x7f6d301557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:40.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d27fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d3015d0f0 0x7f6d301557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35522/0 (socket says 172.21.15.55:35522) 2023-07-06T21:43:40.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.401+0000 7f6d27fff640 1 -- 172.21.15.55:0/711055669 learned_addr learned my addr 172.21.15.55:0/711055669 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:40.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d34f1e640 1 --2- 172.21.15.55:0/711055669 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d18003b10 0x7f6d300c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:40.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d3571f640 1 --2- 172.21.15.55:0/711055669 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d30069fe0 0x7f6d301589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:40.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d27fff640 1 -- 172.21.15.55:0/711055669 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d18003b10 msgr2=0x7f6d300c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:40.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d27fff640 1 --2- 172.21.15.55:0/711055669 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d18003b10 0x7f6d300c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d27fff640 1 -- 172.21.15.55:0/711055669 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d30069fe0 msgr2=0x7f6d301589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:40.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d27fff640 1 --2- 172.21.15.55:0/711055669 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d30069fe0 0x7f6d301589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:40.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d27fff640 1 -- 172.21.15.55:0/711055669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3015da30 con 0x7f6d3015d0f0 2023-07-06T21:43:40.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d27fff640 1 --2- 172.21.15.55:0/711055669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d3015d0f0 0x7f6d301557d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6d20007860 tx=0x7f6d2000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:40.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d257fa640 1 -- 172.21.15.55:0/711055669 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200050d0 con 0x7f6d3015d0f0 2023-07-06T21:43:40.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d257fa640 1 -- 172.21.15.55:0/711055669 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d20005250 con 0x7f6d3015d0f0 2023-07-06T21:43:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d257fa640 1 -- 172.21.15.55:0/711055669 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2000c6c0 con 0x7f6d3015d0f0 2023-07-06T21:43:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d37182640 1 -- 172.21.15.55:0/711055669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d300c60d0 con 0x7f6d3015d0f0 2023-07-06T21:43:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d37182640 1 -- 172.21.15.55:0/711055669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3006a480 con 0x7f6d3015d0f0 2023-07-06T21:43:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d37182640 1 -- 172.21.15.55:0/711055669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d3015d5b0 con 0x7f6d3015d0f0 2023-07-06T21:43:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d257fa640 1 -- 172.21.15.55:0/711055669 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6d2000c820 con 0x7f6d3015d0f0 2023-07-06T21:43:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.405+0000 7f6d257fa640 1 --2- 172.21.15.55:0/711055669 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6d1c066280 0x7f6d1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.409+0000 7f6d257fa640 1 -- 172.21.15.55:0/711055669 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6d20083b20 con 0x7f6d3015d0f0 2023-07-06T21:43:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.409+0000 7f6d34f1e640 1 --2- 172.21.15.55:0/711055669 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6d1c066280 0x7f6d1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.409+0000 7f6d34f1e640 1 --2- 172.21.15.55:0/711055669 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6d1c066280 0x7f6d1c068730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0af000 tx=0x7f6d2c0046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:40.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.413+0000 7f6d257fa640 1 -- 172.21.15.55:0/711055669 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6d3015d5b0 con 0x7f6d3015d0f0 2023-07-06T21:43:40.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:40.601+0000 7f6d37182640 1 -- 172.21.15.55:0/711055669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f6d3015df50 con 0x7f6d3015d0f0 2023-07-06T21:43:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.437+0000 7f6d257fa640 1 -- 172.21.15.55:0/711055669 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7f6d20051370 con 0x7f6d3015d0f0 2023-07-06T21:43:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.441+0000 7f6d257fa640 1 -- 172.21.15.55:0/711055669 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) v1 ==== 92+0+0 (secure 0 0 0) 0x7f6d2006e880 con 0x7f6d3015d0f0 2023-07-06T21:43:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.441+0000 7f6d37182640 1 -- 172.21.15.55:0/711055669 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6d1c066280 msgr2=0x7f6d1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.441+0000 7f6d37182640 1 --2- 172.21.15.55:0/711055669 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6d1c066280 0x7f6d1c068730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0af000 tx=0x7f6d2c0046d0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.441+0000 7f6d37182640 1 -- 172.21.15.55:0/711055669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d3015d0f0 msgr2=0x7f6d301557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.441+0000 7f6d37182640 1 --2- 172.21.15.55:0/711055669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d3015d0f0 0x7f6d301557d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6d20007860 tx=0x7f6d2000ec10 comp rx=0 tx=0).stop 2023-07-06T21:43:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.441+0000 7f6d37182640 1 -- 172.21.15.55:0/711055669 shutdown_connections 2023-07-06T21:43:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.441+0000 7f6d37182640 1 --2- 172.21.15.55:0/711055669 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f6d1c066280 0x7f6d1c068730 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.441+0000 7f6d37182640 1 --2- 172.21.15.55:0/711055669 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d30069fe0 0x7f6d301589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.441+0000 7f6d37182640 1 --2- 172.21.15.55:0/711055669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d3015d0f0 0x7f6d301557d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.441+0000 7f6d37182640 1 --2- 172.21.15.55:0/711055669 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d18003b10 0x7f6d300c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.441+0000 7f6d37182640 1 -- 172.21.15.55:0/711055669 >> 172.21.15.55:0/711055669 conn(0x7f6d300cec20 msgr2=0x7f6d300b5060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.441+0000 7f6d37182640 1 -- 172.21.15.55:0/711055669 shutdown_connections 2023-07-06T21:43:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.441+0000 7f6d37182640 1 -- 172.21.15.55:0/711055669 wait complete. 2023-07-06T21:43:41.474 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-06T21:43:41.612 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:41.605+0000 7f25d4a55180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:43:41.641 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:41.633+0000 7f232413d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:43:41.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.633+0000 7f07053e9640 1 Processor -- start 2023-07-06T21:43:41.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.633+0000 7f07053e9640 1 -- start start 2023-07-06T21:43:41.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.633+0000 7f07053e9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07000b3870 0x7f07000b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:41.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.633+0000 7f07053e9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07000b2b80 con 0x7f070015b850 2023-07-06T21:43:41.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.633+0000 7f07053e9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07000cff30 con 0x7f07000d03c0 2023-07-06T21:43:41.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.633+0000 7f07053e9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07000b41e0 con 0x7f07000b3870 2023-07-06T21:43:41.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.637+0000 7f06feffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f070015b850 0x7f07000cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49370/0 (socket says 172.21.15.55:49370) 2023-07-06T21:43:41.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.637+0000 7f06feffd640 1 -- 172.21.15.55:0/3367977357 learned_addr learned my addr 172.21.15.55:0/3367977357 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:41.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.637+0000 7f06fe7fc640 1 --2- 172.21.15.55:0/3367977357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07000b3870 0x7f07000b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:41.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.637+0000 7f06fdffb640 1 -- 172.21.15.55:0/3367977357 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267640977 0 0) 0x7f07000b2b80 con 0x7f070015b850 2023-07-06T21:43:41.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.637+0000 7f06fdffb640 1 -- 172.21.15.55:0/3367977357 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06e8003530 con 0x7f070015b850 2023-07-06T21:43:41.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.637+0000 7f06fdffb640 1 -- 172.21.15.55:0/3367977357 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2981219356 0 0) 0x7f07000cff30 con 0x7f07000d03c0 2023-07-06T21:43:41.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.637+0000 7f06fe7fc640 1 -- 172.21.15.55:0/3367977357 >> v1:172.21.15.138:6789/0 conn(0x7f07000d03c0 legacy=0x7f07000d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:41.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.637+0000 7f06fe7fc640 1 -- 172.21.15.55:0/3367977357 >> v1:172.21.15.55:6789/0 conn(0x7f070015b850 legacy=0x7f07000cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:41.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.637+0000 7f06fe7fc640 1 -- 172.21.15.55:0/3367977357 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07000b22e0 con 0x7f07000b3870 2023-07-06T21:43:41.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.637+0000 7f06fe7fc640 1 --2- 172.21.15.55:0/3367977357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07000b3870 0x7f07000b3ca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f06f40097f0 tx=0x7f06f401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f66e2dc99d4bab0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:41.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.637+0000 7f06fdffb640 1 -- 172.21.15.55:0/3367977357 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40ab600 con 0x7f07000b3870 2023-07-06T21:43:41.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.637+0000 7f06fdffb640 1 -- 172.21.15.55:0/3367977357 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f40a7050 con 0x7f07000b3870 2023-07-06T21:43:41.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.637+0000 7f06fdffb640 1 -- 172.21.15.55:0/3367977357 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40ab980 con 0x7f07000b3870 2023-07-06T21:43:41.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 -- 172.21.15.55:0/3367977357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07000b3870 msgr2=0x7f07000b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:41.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 --2- 172.21.15.55:0/3367977357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07000b3870 0x7f07000b3ca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f06f40097f0 tx=0x7f06f401c370 comp rx=0 tx=0).stop 2023-07-06T21:43:41.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 -- 172.21.15.55:0/3367977357 shutdown_connections 2023-07-06T21:43:41.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 --2- 172.21.15.55:0/3367977357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07000b3870 0x7f07000b3ca0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 -- 172.21.15.55:0/3367977357 >> 172.21.15.55:0/3367977357 conn(0x7f07000cec20 msgr2=0x7f07000cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:41.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 -- 172.21.15.55:0/3367977357 shutdown_connections 2023-07-06T21:43:41.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 -- 172.21.15.55:0/3367977357 wait complete. 2023-07-06T21:43:41.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 Processor -- start 2023-07-06T21:43:41.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 -- start start 2023-07-06T21:43:41.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07000b3870 0x7f07001523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:41.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07000d03c0 0x7f070015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:41.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f070015b850 0x7f070015f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:41.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070015ef80 con 0x7f070015b850 2023-07-06T21:43:41.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07000c95e0 con 0x7f07000d03c0 2023-07-06T21:43:41.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f07053e9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07000c98c0 con 0x7f07000b3870 2023-07-06T21:43:41.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f06ff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f070015b850 0x7f070015f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f06ff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f070015b850 0x7f070015f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35562/0 (socket says 172.21.15.55:35562) 2023-07-06T21:43:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f06ff7fe640 1 -- 172.21.15.55:0/352446418 learned_addr learned my addr 172.21.15.55:0/352446418 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f06feffd640 1 --2- 172.21.15.55:0/352446418 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07000b3870 0x7f07001523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.641+0000 7f06fe7fc640 1 --2- 172.21.15.55:0/352446418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07000d03c0 0x7f070015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.645+0000 7f06ff7fe640 1 -- 172.21.15.55:0/352446418 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07000b3870 msgr2=0x7f07001523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.645+0000 7f06ff7fe640 1 --2- 172.21.15.55:0/352446418 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07000b3870 0x7f07001523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.645+0000 7f06ff7fe640 1 -- 172.21.15.55:0/352446418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07000d03c0 msgr2=0x7f070015bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.645+0000 7f06ff7fe640 1 --2- 172.21.15.55:0/352446418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07000d03c0 0x7f070015bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.645+0000 7f06ff7fe640 1 -- 172.21.15.55:0/352446418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f4009420 con 0x7f070015b850 2023-07-06T21:43:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.645+0000 7f06ff7fe640 1 --2- 172.21.15.55:0/352446418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f070015b850 0x7f070015f3b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f06f800c780 tx=0x7f06f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.645+0000 7f06e77fe640 1 -- 172.21.15.55:0/352446418 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8003e00 con 0x7f070015b850 2023-07-06T21:43:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.645+0000 7f06e77fe640 1 -- 172.21.15.55:0/352446418 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f800ce90 con 0x7f070015b850 2023-07-06T21:43:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.645+0000 7f07053e9640 1 -- 172.21.15.55:0/352446418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07000c9ba0 con 0x7f070015b850 2023-07-06T21:43:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.645+0000 7f06e77fe640 1 -- 172.21.15.55:0/352446418 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8005290 con 0x7f070015b850 2023-07-06T21:43:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.645+0000 7f07053e9640 1 -- 172.21.15.55:0/352446418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07000ca160 con 0x7f070015b850 2023-07-06T21:43:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.645+0000 7f07053e9640 1 -- 172.21.15.55:0/352446418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0700066d60 con 0x7f070015b850 2023-07-06T21:43:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.645+0000 7f06e77fe640 1 -- 172.21.15.55:0/352446418 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7f06f80053f0 con 0x7f070015b850 2023-07-06T21:43:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.645+0000 7f06e77fe640 1 --2- 172.21.15.55:0/352446418 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f06ec0662d0 0x7f06ec068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.649+0000 7f06e77fe640 1 -- 172.21.15.55:0/352446418 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f06f8083710 con 0x7f070015b850 2023-07-06T21:43:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.649+0000 7f06feffd640 1 -- 172.21.15.55:0/352446418 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f06ec0662d0 msgr2=0x7f06ec068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1575998409 2023-07-06T21:43:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.649+0000 7f06feffd640 1 --2- 172.21.15.55:0/352446418 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f06ec0662d0 0x7f06ec068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:43:41.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.653+0000 7f06e77fe640 1 -- 172.21.15.55:0/352446418 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06f8050a60 con 0x7f070015b850 2023-07-06T21:43:41.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.809+0000 7f07053e9640 1 -- 172.21.15.55:0/352446418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f070006a650 con 0x7f070015b850 2023-07-06T21:43:41.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.813+0000 7f06e77fe640 1 -- 172.21.15.55:0/352446418 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7f06f8054080 con 0x7f070015b850 2023-07-06T21:43:41.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.817+0000 7f07053e9640 1 -- 172.21.15.55:0/352446418 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f06ec0662d0 msgr2=0x7f06ec068780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:43:41.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.817+0000 7f07053e9640 1 --2- 172.21.15.55:0/352446418 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f06ec0662d0 0x7f06ec068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.817+0000 7f07053e9640 1 -- 172.21.15.55:0/352446418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f070015b850 msgr2=0x7f070015f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:41.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.817+0000 7f07053e9640 1 --2- 172.21.15.55:0/352446418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f070015b850 0x7f070015f3b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f06f800c780 tx=0x7f06f800cc40 comp rx=0 tx=0).stop 2023-07-06T21:43:41.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.817+0000 7f07053e9640 1 -- 172.21.15.55:0/352446418 shutdown_connections 2023-07-06T21:43:41.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.817+0000 7f07053e9640 1 --2- 172.21.15.55:0/352446418 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f06ec0662d0 0x7f06ec068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.817+0000 7f07053e9640 1 --2- 172.21.15.55:0/352446418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f070015b850 0x7f070015f3b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.817+0000 7f07053e9640 1 --2- 172.21.15.55:0/352446418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07000d03c0 0x7f070015bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.817+0000 7f07053e9640 1 --2- 172.21.15.55:0/352446418 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07000b3870 0x7f07001523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.817+0000 7f07053e9640 1 -- 172.21.15.55:0/352446418 >> 172.21.15.55:0/352446418 conn(0x7f07000cec20 msgr2=0x7f07000cc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:41.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.817+0000 7f07053e9640 1 -- 172.21.15.55:0/352446418 shutdown_connections 2023-07-06T21:43:41.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.817+0000 7f07053e9640 1 -- 172.21.15.55:0/352446418 wait complete. 2023-07-06T21:43:41.844 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-06T21:43:41.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f19708cb640 1 Processor -- start 2023-07-06T21:43:41.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f19708cb640 1 -- start start 2023-07-06T21:43:41.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f19708cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f196c0b7b90 0x7f196c0d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:41.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f19708cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f196c0cc870 0x7f196c0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:41.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f19708cb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f196c0b4130 0x7f196c0d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:41.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f19708cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c0b45b0 con 0x7f196c0b7b90 2023-07-06T21:43:41.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f19708cb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c0b5070 con 0x7f196c0b4130 2023-07-06T21:43:41.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f19708cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c160020 con 0x7f196c0cc870 2023-07-06T21:43:41.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f196a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f196c0b7b90 0x7f196c0d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:41.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f196a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f196c0b7b90 0x7f196c0d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35568/0 (socket says 172.21.15.55:35568) 2023-07-06T21:43:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f196a59c640 1 -- 172.21.15.55:0/1429974316 learned_addr learned my addr 172.21.15.55:0/1429974316 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f196ad9d640 1 --2- 172.21.15.55:0/1429974316 >> v2:172.21.15.138:3300/0 conn(0x7f196c0b4130 0x7f196c0d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f1963fff640 1 --2- 172.21.15.55:0/1429974316 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f196c0cc870 0x7f196c0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f196a59c640 1 -- 172.21.15.55:0/1429974316 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f196c0cc870 msgr2=0x7f196c0b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f196a59c640 1 --2- 172.21.15.55:0/1429974316 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f196c0cc870 0x7f196c0b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f196a59c640 1 -- 172.21.15.55:0/1429974316 >> v2:172.21.15.138:3300/0 conn(0x7f196c0b4130 msgr2=0x7f196c0d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:41.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f196a59c640 1 --2- 172.21.15.55:0/1429974316 >> v2:172.21.15.138:3300/0 conn(0x7f196c0b4130 0x7f196c0d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:41.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.985+0000 7f196a59c640 1 -- 172.21.15.55:0/1429974316 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c1604b0 con 0x7f196c0b7b90 2023-07-06T21:43:41.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.989+0000 7f196a59c640 1 --2- 172.21.15.55:0/1429974316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f196c0b7b90 0x7f196c0d1c40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f196c0c9280 tx=0x7f195c01c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61136c00ffe3671c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:41.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.989+0000 7f1969d9b640 1 -- 172.21.15.55:0/1429974316 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c0ab600 con 0x7f196c0b7b90 2023-07-06T21:43:41.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.989+0000 7f1969d9b640 1 -- 172.21.15.55:0/1429974316 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c0a7050 con 0x7f196c0b7b90 2023-07-06T21:43:41.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.989+0000 7f1969d9b640 1 -- 172.21.15.55:0/1429974316 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c0ab980 con 0x7f196c0b7b90 2023-07-06T21:43:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.989+0000 7f19708cb640 1 -- 172.21.15.55:0/1429974316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f196c0b7b90 msgr2=0x7f196c0d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.989+0000 7f19708cb640 1 --2- 172.21.15.55:0/1429974316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f196c0b7b90 0x7f196c0d1c40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f196c0c9280 tx=0x7f195c01c220 comp rx=0 tx=0).stop 2023-07-06T21:43:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.989+0000 7f19708cb640 1 -- 172.21.15.55:0/1429974316 shutdown_connections 2023-07-06T21:43:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.989+0000 7f19708cb640 1 --2- 172.21.15.55:0/1429974316 >> v2:172.21.15.138:3300/0 conn(0x7f196c0b4130 0x7f196c0d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:42.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.989+0000 7f19708cb640 1 --2- 172.21.15.55:0/1429974316 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f196c0cc870 0x7f196c0b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:42.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.989+0000 7f19708cb640 1 --2- 172.21.15.55:0/1429974316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f196c0b7b90 0x7f196c0d1c40 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:42.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.989+0000 7f19708cb640 1 -- 172.21.15.55:0/1429974316 >> 172.21.15.55:0/1429974316 conn(0x7f196c0ceca0 msgr2=0x7f196c0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:42.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f19708cb640 1 -- 172.21.15.55:0/1429974316 shutdown_connections 2023-07-06T21:43:42.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f19708cb640 1 -- 172.21.15.55:0/1429974316 wait complete. 2023-07-06T21:43:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f19708cb640 1 Processor -- start 2023-07-06T21:43:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f19708cb640 1 -- start start 2023-07-06T21:43:42.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f19708cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f196c0b4130 0x7f196c156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:42.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f19708cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f196c0b7b90 0x7f196c159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:42.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f19708cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f196c0cc870 0x7f196c157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:42.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f19708cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0cbbf0 con 0x7f196c0b4130 2023-07-06T21:43:42.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f19708cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c1588f0 con 0x7f196c0cc870 2023-07-06T21:43:42.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f19708cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c158bd0 con 0x7f196c0b7b90 2023-07-06T21:43:42.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f196a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f196c0b4130 0x7f196c156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:42.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f1963fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f196c0b7b90 0x7f196c159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:42.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f196ad9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f196c0cc870 0x7f196c157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:42.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f196a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f196c0b4130 0x7f196c156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35582/0 (socket says 172.21.15.55:35582) 2023-07-06T21:43:42.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f196a59c640 1 -- 172.21.15.55:0/2562651833 learned_addr learned my addr 172.21.15.55:0/2562651833 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f1963fff640 1 -- 172.21.15.55:0/2562651833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f196c0cc870 msgr2=0x7f196c157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f1963fff640 1 --2- 172.21.15.55:0/2562651833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f196c0cc870 0x7f196c157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f1963fff640 1 -- 172.21.15.55:0/2562651833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f196c0b4130 msgr2=0x7f196c156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f1963fff640 1 --2- 172.21.15.55:0/2562651833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f196c0b4130 0x7f196c156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:42.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f1963fff640 1 -- 172.21.15.55:0/2562651833 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c0094d0 con 0x7f196c0b7b90 2023-07-06T21:43:42.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f196a59c640 1 --2- 172.21.15.55:0/2562651833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f196c0b4130 0x7f196c156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:42.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.993+0000 7f1963fff640 1 --2- 172.21.15.55:0/2562651833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f196c0b7b90 0x7f196c159990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f195400e870 tx=0x7f195400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:42.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.997+0000 7f1962ffd640 1 -- 172.21.15.55:0/2562651833 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195400ee60 con 0x7f196c0b7b90 2023-07-06T21:43:42.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.997+0000 7f1962ffd640 1 -- 172.21.15.55:0/2562651833 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195400c940 con 0x7f196c0b7b90 2023-07-06T21:43:42.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.997+0000 7f19708cb640 1 -- 172.21.15.55:0/2562651833 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c158eb0 con 0x7f196c0b7b90 2023-07-06T21:43:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.997+0000 7f1962ffd640 1 -- 172.21.15.55:0/2562651833 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195400ccd0 con 0x7f196c0b7b90 2023-07-06T21:43:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.997+0000 7f19708cb640 1 -- 172.21.15.55:0/2562651833 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c159470 con 0x7f196c0b7b90 2023-07-06T21:43:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.997+0000 7f19708cb640 1 -- 172.21.15.55:0/2562651833 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c066d60 con 0x7f196c0b7b90 2023-07-06T21:43:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.997+0000 7f1962ffd640 1 -- 172.21.15.55:0/2562651833 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7f1954013470 con 0x7f196c0b7b90 2023-07-06T21:43:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.997+0000 7f1962ffd640 1 --2- 172.21.15.55:0/2562651833 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f194c066300 0x7f194c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.997+0000 7f1962ffd640 1 -- 172.21.15.55:0/2562651833 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1954083cc0 con 0x7f196c0b7b90 2023-07-06T21:43:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.997+0000 7f196a59c640 1 -- 172.21.15.55:0/2562651833 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f194c066300 msgr2=0x7f194c0687b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1575998409 2023-07-06T21:43:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:41.997+0000 7f196a59c640 1 --2- 172.21.15.55:0/2562651833 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f194c066300 0x7f194c0687b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:43:42.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.001+0000 7f1962ffd640 1 -- 172.21.15.55:0/2562651833 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1954051140 con 0x7f196c0b7b90 2023-07-06T21:43:42.031 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:42.025+0000 7f25d4a55180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:43:42.089 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:42.081+0000 7f232413d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:43:42.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.161+0000 7f19708cb640 1 -- 172.21.15.55:0/2562651833 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f196c0b6fd0 con 0x7f196c0b7b90 2023-07-06T21:43:42.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.173+0000 7f1962ffd640 1 -- 172.21.15.55:0/2562651833 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1954054760 con 0x7f196c0b7b90 2023-07-06T21:43:42.181 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:42.173+0000 7f25d4a55180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:43:42.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.173+0000 7f19708cb640 1 -- 172.21.15.55:0/2562651833 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f194c066300 msgr2=0x7f194c0687b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:43:42.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.173+0000 7f19708cb640 1 --2- 172.21.15.55:0/2562651833 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f194c066300 0x7f194c0687b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:42.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.173+0000 7f19708cb640 1 -- 172.21.15.55:0/2562651833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f196c0b7b90 msgr2=0x7f196c159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:42.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.173+0000 7f19708cb640 1 --2- 172.21.15.55:0/2562651833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f196c0b7b90 0x7f196c159990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f195400e870 tx=0x7f195400ed30 comp rx=0 tx=0).stop 2023-07-06T21:43:42.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.173+0000 7f19708cb640 1 -- 172.21.15.55:0/2562651833 shutdown_connections 2023-07-06T21:43:42.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.173+0000 7f19708cb640 1 --2- 172.21.15.55:0/2562651833 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f194c066300 0x7f194c0687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:42.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.173+0000 7f19708cb640 1 --2- 172.21.15.55:0/2562651833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f196c0cc870 0x7f196c157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:42.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.173+0000 7f19708cb640 1 --2- 172.21.15.55:0/2562651833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f196c0b7b90 0x7f196c159990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:42.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.173+0000 7f19708cb640 1 --2- 172.21.15.55:0/2562651833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f196c0b4130 0x7f196c156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:42.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.173+0000 7f19708cb640 1 -- 172.21.15.55:0/2562651833 >> 172.21.15.55:0/2562651833 conn(0x7f196c0ceca0 msgr2=0x7f196c0d1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:42.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.173+0000 7f19708cb640 1 -- 172.21.15.55:0/2562651833 shutdown_connections 2023-07-06T21:43:42.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.173+0000 7f19708cb640 1 -- 172.21.15.55:0/2562651833 wait complete. 2023-07-06T21:43:42.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:42.201 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-06T21:43:42.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:42.220 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-07-06T21:43:42.252 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:42.245+0000 7f232413d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:43:42.264 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-07-06T21:43:42.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.449+0000 7f10cb60b640 1 Processor -- start 2023-07-06T21:43:42.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.449+0000 7f10cb60b640 1 -- start start 2023-07-06T21:43:42.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.449+0000 7f10cb60b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f10c40b3c90 0x7f10c40ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:42.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.449+0000 7f10cb60b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c40ccd50 con 0x7f10c40b18a0 2023-07-06T21:43:42.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.449+0000 7f10cb60b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c4069ea0 con 0x7f10c40d1d30 2023-07-06T21:43:42.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.449+0000 7f10cb60b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c40cd0a0 con 0x7f10c40b3c90 2023-07-06T21:43:42.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.449+0000 7f10c93a7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f10c40b3c90 0x7f10c40ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:42.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.449+0000 7f10c93a7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f10c40b3c90 0x7f10c40ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35586/0 (socket says 172.21.15.55:35586) 2023-07-06T21:43:42.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.449+0000 7f10c93a7640 1 -- 172.21.15.55:0/122408626 learned_addr learned my addr 172.21.15.55:0/122408626 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:42.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.449+0000 7f10c93a7640 1 -- 172.21.15.55:0/122408626 >> v1:172.21.15.138:6789/0 conn(0x7f10c40d1d30 legacy=0x7f10c40cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:42.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.449+0000 7f10c93a7640 1 -- 172.21.15.55:0/122408626 >> v1:172.21.15.55:6789/0 conn(0x7f10c40b18a0 legacy=0x7f10c40b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:42.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.449+0000 7f10c93a7640 1 -- 172.21.15.55:0/122408626 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c406a140 con 0x7f10c40b3c90 2023-07-06T21:43:42.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.453+0000 7f10c93a7640 1 --2- 172.21.15.55:0/122408626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10c40b3c90 0x7f10c40ce460 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009870 tx=0x7f10c001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6477a3cc43686c44 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:42.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.453+0000 7f10bbfff640 1 -- 172.21.15.55:0/122408626 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00a95f0 con 0x7f10c40b3c90 2023-07-06T21:43:42.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.453+0000 7f10bbfff640 1 -- 172.21.15.55:0/122408626 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c00a9750 con 0x7f10c40b3c90 2023-07-06T21:43:42.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.453+0000 7f10bbfff640 1 -- 172.21.15.55:0/122408626 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00a9ae0 con 0x7f10c40b3c90 2023-07-06T21:43:42.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.453+0000 7f10cb60b640 1 -- 172.21.15.55:0/122408626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10c40b3c90 msgr2=0x7f10c40ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:42.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.453+0000 7f10cb60b640 1 --2- 172.21.15.55:0/122408626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10c40b3c90 0x7f10c40ce460 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009870 tx=0x7f10c001c510 comp rx=0 tx=0).stop 2023-07-06T21:43:42.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.453+0000 7f10cb60b640 1 -- 172.21.15.55:0/122408626 shutdown_connections 2023-07-06T21:43:42.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.453+0000 7f10cb60b640 1 --2- 172.21.15.55:0/122408626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10c40b3c90 0x7f10c40ce460 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:42.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.453+0000 7f10cb60b640 1 -- 172.21.15.55:0/122408626 >> 172.21.15.55:0/122408626 conn(0x7f10c406bf40 msgr2=0x7f10c40cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.453+0000 7f10cb60b640 1 -- 172.21.15.55:0/122408626 shutdown_connections 2023-07-06T21:43:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.453+0000 7f10cb60b640 1 -- 172.21.15.55:0/122408626 wait complete. 2023-07-06T21:43:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10cb60b640 1 Processor -- start 2023-07-06T21:43:42.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10cb60b640 1 -- start start 2023-07-06T21:43:42.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10cb60b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10c40b18a0 0x7f10c40c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:42.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10cb60b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10c40b3c90 0x7f10c40b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:42.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10cb60b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10c40d1d30 0x7f10c40b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:42.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10cb60b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c41f4e60 con 0x7f10c40b3c90 2023-07-06T21:43:42.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10cb60b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c41f7f80 con 0x7f10c40b18a0 2023-07-06T21:43:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10cb60b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c41f8410 con 0x7f10c40d1d30 2023-07-06T21:43:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10c8ba6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10c40b3c90 0x7f10c40b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10c8ba6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10c40b3c90 0x7f10c40b2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35598/0 (socket says 172.21.15.55:35598) 2023-07-06T21:43:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10c8ba6640 1 -- 172.21.15.55:0/3671567419 learned_addr learned my addr 172.21.15.55:0/3671567419 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10c9ba8640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10c40d1d30 0x7f10c40b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:42.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10c93a7640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10c40b18a0 0x7f10c40c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:42.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10c8ba6640 1 -- 172.21.15.55:0/3671567419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10c40d1d30 msgr2=0x7f10c40b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:42.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10c8ba6640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10c40d1d30 0x7f10c40b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:42.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10c8ba6640 1 -- 172.21.15.55:0/3671567419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10c40b18a0 msgr2=0x7f10c40c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:42.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10c8ba6640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10c40b18a0 0x7f10c40c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:42.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10c8ba6640 1 -- 172.21.15.55:0/3671567419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c00094d0 con 0x7f10c40b3c90 2023-07-06T21:43:42.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10c8ba6640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10c40b3c90 0x7f10c40b2df0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f10b400c4d0 tx=0x7f10b400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:42.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10b9ffb640 1 -- 172.21.15.55:0/3671567419 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b40052d0 con 0x7f10c40b3c90 2023-07-06T21:43:42.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10b9ffb640 1 -- 172.21.15.55:0/3671567419 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b4005430 con 0x7f10c40b3c90 2023-07-06T21:43:42.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10cb60b640 1 -- 172.21.15.55:0/3671567419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c40c8d00 con 0x7f10c40b3c90 2023-07-06T21:43:42.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10b9ffb640 1 -- 172.21.15.55:0/3671567419 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4012830 con 0x7f10c40b3c90 2023-07-06T21:43:42.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.457+0000 7f10cb60b640 1 -- 172.21.15.55:0/3671567419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c41f7930 con 0x7f10c40b3c90 2023-07-06T21:43:42.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.461+0000 7f10cb60b640 1 -- 172.21.15.55:0/3671567419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c4066d60 con 0x7f10c40b3c90 2023-07-06T21:43:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.461+0000 7f10b9ffb640 1 -- 172.21.15.55:0/3671567419 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7f10b4012990 con 0x7f10c40b3c90 2023-07-06T21:43:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.461+0000 7f10b9ffb640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f10a80662d0 0x7f10a8068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:42.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.461+0000 7f10b9ffb640 1 -- 172.21.15.55:0/3671567419 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f10b40838b0 con 0x7f10c40b3c90 2023-07-06T21:43:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.461+0000 7f10c93a7640 1 -- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f10a80662d0 msgr2=0x7f10a8068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1575998409 2023-07-06T21:43:42.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.461+0000 7f10c93a7640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f10a80662d0 0x7f10a8068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:43:42.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.469+0000 7f10b9ffb640 1 -- 172.21.15.55:0/3671567419 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f10b4050c90 con 0x7f10c40b3c90 2023-07-06T21:43:42.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.641+0000 7f10cb60b640 1 -- 172.21.15.55:0/3671567419 --> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f10c406ac30 con 0x7f10a80662d0 2023-07-06T21:43:42.661 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:42.653+0000 7f25d4a55180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:43:42.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.665+0000 7f10c93a7640 1 -- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f10a80662d0 msgr2=0x7f10a8068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1575998409 2023-07-06T21:43:42.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:42.665+0000 7f10c93a7640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f10a80662d0 0x7f10a8068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-06T21:43:42.719 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:42.713+0000 7f25d4a55180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:43:42.764 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:42.757+0000 7f232413d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:43:42.774 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:42.765+0000 7f25d4a55180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:43:42.825 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:42.817+0000 7f232413d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:43:42.860 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:42.853+0000 7f25d4a55180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:43:42.883 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:42.873+0000 7f232413d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:43:42.918 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:42.909+0000 7f25d4a55180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:43:42.973 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:42.965+0000 7f232413d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:43:43.001 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:42.993+0000 7f25d4a55180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:43:43.032 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:43.025+0000 7f232413d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:43:43.057 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:43.049+0000 7f25d4a55180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:43:43.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:43.069+0000 7f10c93a7640 1 -- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f10a80662d0 msgr2=0x7f10a8068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1575998409 2023-07-06T21:43:43.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:43.069+0000 7f10c93a7640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f10a80662d0 0x7f10a8068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-06T21:43:43.121 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:43.113+0000 7f232413d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:43:43.179 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:43.173+0000 7f232413d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:43:43.198 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:43.189+0000 7f25d4a55180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:43:43.256 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:43.249+0000 7f25d4a55180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:43:43.328 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:43.321+0000 7f232413d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:43:43.389 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:43.381+0000 7f232413d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:43:43.496 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:43:43.496 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:43:43.496 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:43:43.503 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:43.497+0000 7f25d4a55180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:43:43.636 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:43.629+0000 7f25d4a55180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:43:43.637 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:43:43.638 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:43:43.638 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:43:43.646 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:43.637+0000 7f232413d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:43:43.763 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:43.757+0000 7f25d4a55180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:43:43.788 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:43.777+0000 7f232413d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:43:43.833 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:43.825+0000 7f25d4a55180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:43:43.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:43.873+0000 7f10c93a7640 1 -- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f10a80662d0 msgr2=0x7f10a8068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1575998409 2023-07-06T21:43:43.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:43.873+0000 7f10c93a7640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f10a80662d0 0x7f10a8068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-06T21:43:43.918 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:43.909+0000 7f232413d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:43:43.967 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:43.961+0000 7f25d4a55180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:43:43.991 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:43.981+0000 7f232413d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:43:44.131 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:44.121+0000 7f232413d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:43:44.505 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:44.497+0000 7f25d4a55180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:43:44.591 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:44.585+0000 7f25d4a55180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:43:44.700 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:44.693+0000 7f232413d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:43:44.738 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:44.729+0000 7f25d4a55180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:43:44.787 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:44.781+0000 7f232413d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:43:44.821 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:44.813+0000 7f25d4a55180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:43:44.941 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:44.933+0000 7f232413d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:43:45.028 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:45.021+0000 7f232413d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:43:45.089 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:45.081+0000 7f25d4a55180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:43:45.149 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:43:45.141+0000 7f25d4a55180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:43:45.312 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:45.305+0000 7f232413d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:43:45.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:45.361+0000 7f10b9ffb640 1 -- 172.21.15.55:0/3671567419 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 7) v1 ==== 85675+0+0 (secure 0 0 0) 0x7f10b4051060 con 0x7f10c40b3c90 2023-07-06T21:43:45.377 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:45.369+0000 7f232413d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:43:45.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:45.381+0000 7f10b9ffb640 1 -- 172.21.15.55:0/3671567419 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 8) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f10b4012c40 con 0x7f10c40b3c90 2023-07-06T21:43:45.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:45.381+0000 7f10b9ffb640 1 -- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f10a80662d0 msgr2=0x7f10a8068780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:43:45.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:45.381+0000 7f10b9ffb640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1575998409,v1:172.21.15.55:6833/1575998409] conn(0x7f10a80662d0 0x7f10a8068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:45.511 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:45.501+0000 7f22a31a2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:43:45.511 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:45.501+0000 7f22a31a2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:43:45.512 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:45.501+0000 7f22a31a2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:43:45.512 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:45.501+0000 7f22a31a2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:43:45.512 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:45.501+0000 7f22a31a2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:43:45.512 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:45.505+0000 7f22a59a7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:43:45.512 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:45.505+0000 7f22a59a7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:43:45.512 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:45.505+0000 7f22a59a7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:43:45.513 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:45.505+0000 7f22a59a7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:43:45.513 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:43:45.505+0000 7f22a59a7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:43:46.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.385+0000 7f10b9ffb640 1 -- 172.21.15.55:0/3671567419 <== mon.0 v2:172.21.15.55:3300/0 9 ==== mgrmap(e 9) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f10b404cf30 con 0x7f10c40b3c90 2023-07-06T21:43:46.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.385+0000 7f10b9ffb640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f10a8033f70 0x7f10a8070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:46.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.385+0000 7f10b9ffb640 1 -- 172.21.15.55:0/3671567419 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f10c406ac30 con 0x7f10a8033f70 2023-07-06T21:43:46.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.389+0000 7f10c93a7640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f10a8033f70 0x7f10a8070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:46.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.389+0000 7f10c93a7640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f10a8033f70 0x7f10a8070d30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f10c00ae000 tx=0x7f10c00b3040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:46.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.465+0000 7f10b9ffb640 1 -- 172.21.15.55:0/3671567419 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f10c406ac30 con 0x7f10a8033f70 2023-07-06T21:43:46.473 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir0 2023-07-06T21:43:46.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.465+0000 7f10cb60b640 1 -- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f10a8033f70 msgr2=0x7f10a8070d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:46.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.465+0000 7f10cb60b640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f10a8033f70 0x7f10a8070d30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f10c00ae000 tx=0x7f10c00b3040 comp rx=0 tx=0).stop 2023-07-06T21:43:46.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.465+0000 7f10cb60b640 1 -- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10c40b3c90 msgr2=0x7f10c40b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:46.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.465+0000 7f10cb60b640 1 --2- 172.21.15.55:0/3671567419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10c40b3c90 0x7f10c40b2df0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f10b400c4d0 tx=0x7f10b400c990 comp rx=0 tx=0).stop 2023-07-06T21:43:46.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.465+0000 7f10c9ba8640 1 -- 172.21.15.55:0/3671567419 reap_dead start 2023-07-06T21:43:46.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.465+0000 7f10cb60b640 1 -- 172.21.15.55:0/3671567419 shutdown_connections 2023-07-06T21:43:46.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.465+0000 7f10cb60b640 1 -- 172.21.15.55:0/3671567419 >> 172.21.15.55:0/3671567419 conn(0x7f10c406bf40 msgr2=0x7f10c4157120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:46.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.465+0000 7f10cb60b640 1 -- 172.21.15.55:0/3671567419 shutdown_connections 2023-07-06T21:43:46.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.465+0000 7f10cb60b640 1 -- 172.21.15.55:0/3671567419 wait complete. 2023-07-06T21:43:46.495 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-07-06T21:43:46.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:46.496 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-07-06T21:43:46.508 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-07-06T21:43:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.689+0000 7fcf77ecb640 1 Processor -- start 2023-07-06T21:43:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.693+0000 7fcf77ecb640 1 -- start start 2023-07-06T21:43:46.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.693+0000 7fcf77ecb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf700c9b90 0x7fcf7015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:46.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.693+0000 7fcf77ecb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf700b3e70 con 0x7fcf700693f0 2023-07-06T21:43:46.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.693+0000 7fcf77ecb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf70159c30 con 0x7fcf700ccb70 2023-07-06T21:43:46.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.693+0000 7fcf77ecb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf700c9070 con 0x7fcf700c9b90 2023-07-06T21:43:46.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.693+0000 7fcf75c67640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf700c9b90 0x7fcf7015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:46.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.693+0000 7fcf75c67640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf700c9b90 0x7fcf7015dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40940/0 (socket says 172.21.15.55:40940) 2023-07-06T21:43:46.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.693+0000 7fcf75c67640 1 -- 172.21.15.55:0/440870165 learned_addr learned my addr 172.21.15.55:0/440870165 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.693+0000 7fcf75c67640 1 -- 172.21.15.55:0/440870165 >> v1:172.21.15.138:6789/0 conn(0x7fcf700ccb70 legacy=0x7fcf700c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.693+0000 7fcf75c67640 1 -- 172.21.15.55:0/440870165 >> v1:172.21.15.55:6789/0 conn(0x7fcf700693f0 legacy=0x7fcf70069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.693+0000 7fcf75c67640 1 -- 172.21.15.55:0/440870165 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf700c8480 con 0x7fcf700c9b90 2023-07-06T21:43:46.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.697+0000 7fcf75c67640 1 --2- 172.21.15.55:0/440870165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf700c9b90 0x7fcf7015dd50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009870 tx=0x7fcf6c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa6780235890ee0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:46.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.697+0000 7fcf74c65640 1 -- 172.21.15.55:0/440870165 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0aa660 con 0x7fcf700c9b90 2023-07-06T21:43:46.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.697+0000 7fcf74c65640 1 -- 172.21.15.55:0/440870165 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c0aa7c0 con 0x7fcf700c9b90 2023-07-06T21:43:46.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.697+0000 7fcf74c65640 1 -- 172.21.15.55:0/440870165 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0aab50 con 0x7fcf700c9b90 2023-07-06T21:43:46.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.697+0000 7fcf77ecb640 1 -- 172.21.15.55:0/440870165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf700c9b90 msgr2=0x7fcf7015dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:46.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.697+0000 7fcf77ecb640 1 --2- 172.21.15.55:0/440870165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf700c9b90 0x7fcf7015dd50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009870 tx=0x7fcf6c01c500 comp rx=0 tx=0).stop 2023-07-06T21:43:46.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.697+0000 7fcf77ecb640 1 -- 172.21.15.55:0/440870165 shutdown_connections 2023-07-06T21:43:46.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.697+0000 7fcf77ecb640 1 --2- 172.21.15.55:0/440870165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf700c9b90 0x7fcf7015dd50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:46.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.697+0000 7fcf77ecb640 1 -- 172.21.15.55:0/440870165 >> 172.21.15.55:0/440870165 conn(0x7fcf700cde30 msgr2=0x7fcf700ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:46.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.697+0000 7fcf77ecb640 1 -- 172.21.15.55:0/440870165 shutdown_connections 2023-07-06T21:43:46.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.697+0000 7fcf77ecb640 1 -- 172.21.15.55:0/440870165 wait complete. 2023-07-06T21:43:46.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.697+0000 7fcf77ecb640 1 Processor -- start 2023-07-06T21:43:46.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.697+0000 7fcf77ecb640 1 -- start start 2023-07-06T21:43:46.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf77ecb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf700693f0 0x7fcf7006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:46.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf77ecb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf700c9b90 0x7fcf70159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:46.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf77ecb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf700ccb70 0x7fcf701f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:46.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf77ecb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf70162880 con 0x7fcf700ccb70 2023-07-06T21:43:46.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf77ecb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7006b830 con 0x7fcf700693f0 2023-07-06T21:43:46.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf77ecb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7015a530 con 0x7fcf700c9b90 2023-07-06T21:43:46.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf76468640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf700ccb70 0x7fcf701f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:46.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf76468640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf700ccb70 0x7fcf701f82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40956/0 (socket says 172.21.15.55:40956) 2023-07-06T21:43:46.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf76468640 1 -- 172.21.15.55:0/3205179372 learned_addr learned my addr 172.21.15.55:0/3205179372 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:46.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf75c67640 1 --2- 172.21.15.55:0/3205179372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf700693f0 0x7fcf7006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:46.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf75466640 1 --2- 172.21.15.55:0/3205179372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf700c9b90 0x7fcf70159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:46.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf76468640 1 -- 172.21.15.55:0/3205179372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf700c9b90 msgr2=0x7fcf70159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:46.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf76468640 1 --2- 172.21.15.55:0/3205179372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf700c9b90 0x7fcf70159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:46.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf76468640 1 -- 172.21.15.55:0/3205179372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf700693f0 msgr2=0x7fcf7006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf76468640 1 --2- 172.21.15.55:0/3205179372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf700693f0 0x7fcf7006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf76468640 1 -- 172.21.15.55:0/3205179372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c0094d0 con 0x7fcf700ccb70 2023-07-06T21:43:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf76468640 1 --2- 172.21.15.55:0/3205179372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf700ccb70 0x7fcf701f82a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800c730 tx=0x7fcf6800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf667fc640 1 -- 172.21.15.55:0/3205179372 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68003b80 con 0x7fcf700ccb70 2023-07-06T21:43:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf667fc640 1 -- 172.21.15.55:0/3205179372 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf68003ce0 con 0x7fcf700ccb70 2023-07-06T21:43:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf667fc640 1 -- 172.21.15.55:0/3205179372 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6800aa30 con 0x7fcf700ccb70 2023-07-06T21:43:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf77ecb640 1 -- 172.21.15.55:0/3205179372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf70162af0 con 0x7fcf700ccb70 2023-07-06T21:43:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf77ecb640 1 -- 172.21.15.55:0/3205179372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7015aa00 con 0x7fcf700ccb70 2023-07-06T21:43:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.701+0000 7fcf77ecb640 1 -- 172.21.15.55:0/3205179372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf700c94e0 con 0x7fcf700ccb70 2023-07-06T21:43:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.705+0000 7fcf667fc640 1 -- 172.21.15.55:0/3205179372 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 9) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fcf6800ab90 con 0x7fcf700ccb70 2023-07-06T21:43:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.705+0000 7fcf667fc640 1 --2- 172.21.15.55:0/3205179372 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fcf54066120 0x7fcf540685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.705+0000 7fcf667fc640 1 -- 172.21.15.55:0/3205179372 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7fcf68083700 con 0x7fcf700ccb70 2023-07-06T21:43:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.705+0000 7fcf75c67640 1 --2- 172.21.15.55:0/3205179372 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fcf54066120 0x7fcf540685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:46.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.705+0000 7fcf75c67640 1 --2- 172.21.15.55:0/3205179372 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fcf54066120 0x7fcf540685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0ae000 tx=0x7fcf6c0b5040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:46.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.709+0000 7fcf667fc640 1 -- 172.21.15.55:0/3205179372 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf700c94e0 con 0x7fcf700ccb70 2023-07-06T21:43:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.881+0000 7fcf77ecb640 1 -- 172.21.15.55:0/3205179372 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf700c8d00 con 0x7fcf54066120 2023-07-06T21:43:46.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.953+0000 7fcf667fc640 1 -- 172.21.15.55:0/3205179372 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fcf6c0aa930 con 0x7fcf54066120 2023-07-06T21:43:46.963 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir1 2023-07-06T21:43:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.957+0000 7fcf77ecb640 1 -- 172.21.15.55:0/3205179372 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fcf54066120 msgr2=0x7fcf540685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.957+0000 7fcf77ecb640 1 --2- 172.21.15.55:0/3205179372 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fcf54066120 0x7fcf540685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0ae000 tx=0x7fcf6c0b5040 comp rx=0 tx=0).stop 2023-07-06T21:43:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.957+0000 7fcf77ecb640 1 -- 172.21.15.55:0/3205179372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf700ccb70 msgr2=0x7fcf701f82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.957+0000 7fcf77ecb640 1 --2- 172.21.15.55:0/3205179372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf700ccb70 0x7fcf701f82a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800c730 tx=0x7fcf6800cbf0 comp rx=0 tx=0).stop 2023-07-06T21:43:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.957+0000 7fcf77ecb640 1 -- 172.21.15.55:0/3205179372 shutdown_connections 2023-07-06T21:43:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.957+0000 7fcf77ecb640 1 --2- 172.21.15.55:0/3205179372 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fcf54066120 0x7fcf540685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.957+0000 7fcf77ecb640 1 --2- 172.21.15.55:0/3205179372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf700ccb70 0x7fcf701f82a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.957+0000 7fcf77ecb640 1 --2- 172.21.15.55:0/3205179372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcf700c9b90 0x7fcf70159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.957+0000 7fcf77ecb640 1 --2- 172.21.15.55:0/3205179372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf700693f0 0x7fcf7006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.957+0000 7fcf77ecb640 1 -- 172.21.15.55:0/3205179372 >> 172.21.15.55:0/3205179372 conn(0x7fcf700cde30 msgr2=0x7fcf7015d520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.957+0000 7fcf77ecb640 1 -- 172.21.15.55:0/3205179372 shutdown_connections 2023-07-06T21:43:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:46.957+0000 7fcf77ecb640 1 -- 172.21.15.55:0/3205179372 wait complete. 2023-07-06T21:43:46.983 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-07-06T21:43:46.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:46.984 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-07-06T21:43:46.995 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-07-06T21:43:47.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.177+0000 7f5fa849c640 1 Processor -- start 2023-07-06T21:43:47.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.177+0000 7f5fa849c640 1 -- start start 2023-07-06T21:43:47.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.181+0000 7f5fa849c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5fa00ccb70 0x7f5fa015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:47.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.181+0000 7f5fa849c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5fa00693f0 0x7f5fa0069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:47.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.181+0000 7f5fa849c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa00b3e70 con 0x7f5fa00c9b90 2023-07-06T21:43:47.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.181+0000 7f5fa849c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa0159c30 con 0x7f5fa00693f0 2023-07-06T21:43:47.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.181+0000 7f5fa849c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa00c9070 con 0x7f5fa00ccb70 2023-07-06T21:43:47.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.181+0000 7f5fa6238640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5fa00c9b90 0x7f5fa00c9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34900/0 (socket says 172.21.15.55:34900) 2023-07-06T21:43:47.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.181+0000 7f5fa6238640 1 -- 172.21.15.55:0/654105840 learned_addr learned my addr 172.21.15.55:0/654105840 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:47.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.181+0000 7f5fa6a39640 1 --2- 172.21.15.55:0/654105840 >> v2:172.21.15.55:3300/0 conn(0x7f5fa00693f0 0x7f5fa0069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:47.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.181+0000 7f5fa5a37640 1 --2- 172.21.15.55:0/654105840 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5fa00ccb70 0x7f5fa015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:47.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.181+0000 7f5fa6a39640 1 -- 172.21.15.55:0/654105840 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5fa00ccb70 msgr2=0x7f5fa015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:47.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.181+0000 7f5fa6a39640 1 --2- 172.21.15.55:0/654105840 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5fa00ccb70 0x7f5fa015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.181+0000 7f5fa6a39640 1 -- 172.21.15.55:0/654105840 >> v1:172.21.15.55:6789/0 conn(0x7f5fa00c9b90 legacy=0x7f5fa00c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:47.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.181+0000 7f5fa6a39640 1 -- 172.21.15.55:0/654105840 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa00c8480 con 0x7f5fa00693f0 2023-07-06T21:43:47.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.181+0000 7f5fa6a39640 1 --2- 172.21.15.55:0/654105840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa00693f0 0x7f5fa0069870 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009d90 tx=0x7f5f9801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b74311f84bb0812 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:47.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa5236640 1 -- 172.21.15.55:0/654105840 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f980a5900 con 0x7f5fa00693f0 2023-07-06T21:43:47.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa5236640 1 -- 172.21.15.55:0/654105840 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f980a5a60 con 0x7f5fa00693f0 2023-07-06T21:43:47.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa5236640 1 -- 172.21.15.55:0/654105840 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f980a5df0 con 0x7f5fa00693f0 2023-07-06T21:43:47.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 -- 172.21.15.55:0/654105840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa00693f0 msgr2=0x7f5fa0069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:47.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 --2- 172.21.15.55:0/654105840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa00693f0 0x7f5fa0069870 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009d90 tx=0x7f5f9801c930 comp rx=0 tx=0).stop 2023-07-06T21:43:47.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 -- 172.21.15.55:0/654105840 shutdown_connections 2023-07-06T21:43:47.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 --2- 172.21.15.55:0/654105840 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5fa00ccb70 0x7f5fa015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 --2- 172.21.15.55:0/654105840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa00693f0 0x7f5fa0069870 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 -- 172.21.15.55:0/654105840 >> 172.21.15.55:0/654105840 conn(0x7f5fa00cde30 msgr2=0x7f5fa00ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:47.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 -- 172.21.15.55:0/654105840 shutdown_connections 2023-07-06T21:43:47.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 -- 172.21.15.55:0/654105840 wait complete. 2023-07-06T21:43:47.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 Processor -- start 2023-07-06T21:43:47.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 -- start start 2023-07-06T21:43:47.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa00693f0 0x7f5fa015c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:47.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5fa00c9b90 0x7f5fa015ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:47.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fa00ccb70 0x7f5fa0154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:47.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa014fce0 con 0x7f5fa00693f0 2023-07-06T21:43:47.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa014ffa0 con 0x7f5fa00ccb70 2023-07-06T21:43:47.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa849c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa0150280 con 0x7f5fa00c9b90 2023-07-06T21:43:47.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa6238640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa00693f0 0x7f5fa015c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:47.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.185+0000 7f5fa6238640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa00693f0 0x7f5fa015c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40976/0 (socket says 172.21.15.55:40976) 2023-07-06T21:43:47.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5fa6238640 1 -- 172.21.15.55:0/3685161166 learned_addr learned my addr 172.21.15.55:0/3685161166 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:47.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5fa5a37640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5fa00c9b90 0x7f5fa015ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:47.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5fa6a39640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fa00ccb70 0x7f5fa0154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:47.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5fa6238640 1 -- 172.21.15.55:0/3685161166 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5fa00c9b90 msgr2=0x7f5fa015ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:47.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5fa6238640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5fa00c9b90 0x7f5fa015ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5fa6238640 1 -- 172.21.15.55:0/3685161166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fa00ccb70 msgr2=0x7f5fa0154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:47.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5fa6238640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fa00ccb70 0x7f5fa0154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5fa6238640 1 -- 172.21.15.55:0/3685161166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f98009a70 con 0x7f5fa00693f0 2023-07-06T21:43:47.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5fa5a37640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5fa00c9b90 0x7f5fa015ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:47.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5fa6238640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa00693f0 0x7f5fa015c770 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00c500 tx=0x7f5f9c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:47.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5f96ffd640 1 -- 172.21.15.55:0/3685161166 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c005cf0 con 0x7f5fa00693f0 2023-07-06T21:43:47.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5f96ffd640 1 -- 172.21.15.55:0/3685161166 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9c005e50 con 0x7f5fa00693f0 2023-07-06T21:43:47.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5f96ffd640 1 -- 172.21.15.55:0/3685161166 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c0072f0 con 0x7f5fa00693f0 2023-07-06T21:43:47.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5fa849c640 1 -- 172.21.15.55:0/3685161166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa0150560 con 0x7f5fa00693f0 2023-07-06T21:43:47.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5fa849c640 1 -- 172.21.15.55:0/3685161166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa0154960 con 0x7f5fa00693f0 2023-07-06T21:43:47.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5fa849c640 1 -- 172.21.15.55:0/3685161166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa0066d60 con 0x7f5fa00693f0 2023-07-06T21:43:47.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.189+0000 7f5f96ffd640 1 -- 172.21.15.55:0/3685161166 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 9) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f5f9c007450 con 0x7f5fa00693f0 2023-07-06T21:43:47.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.193+0000 7f5f96ffd640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5f84066150 0x7f5f84068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:47.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.193+0000 7f5f96ffd640 1 -- 172.21.15.55:0/3685161166 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7f5f9c082f60 con 0x7f5fa00693f0 2023-07-06T21:43:47.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.193+0000 7f5fa5a37640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5f84066150 0x7f5f84068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:47.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.193+0000 7f5fa5a37640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5f84066150 0x7f5f84068600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0157710 tx=0x7f5f90008040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:47.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.193+0000 7f5f96ffd640 1 -- 172.21.15.55:0/3685161166 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f9c0504e0 con 0x7f5fa00693f0 2023-07-06T21:43:47.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.369+0000 7f5fa849c640 1 -- 172.21.15.55:0/3685161166 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fa0150110 con 0x7f5f84066150 2023-07-06T21:43:47.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.397+0000 7f5f96ffd640 1 -- 172.21.15.55:0/3685161166 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f5f9c0508b0 con 0x7f5fa00693f0 2023-07-06T21:43:47.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.437+0000 7f5f96ffd640 1 -- 172.21.15.55:0/3685161166 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f5fa0150110 con 0x7f5f84066150 2023-07-06T21:43:47.446 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir2 2023-07-06T21:43:47.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.441+0000 7f5fa849c640 1 -- 172.21.15.55:0/3685161166 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5f84066150 msgr2=0x7f5f84068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:47.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.441+0000 7f5fa849c640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5f84066150 0x7f5f84068600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0157710 tx=0x7f5f90008040 comp rx=0 tx=0).stop 2023-07-06T21:43:47.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.441+0000 7f5fa849c640 1 -- 172.21.15.55:0/3685161166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa00693f0 msgr2=0x7f5fa015c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:47.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.441+0000 7f5fa849c640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa00693f0 0x7f5fa015c770 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00c500 tx=0x7f5f9c00c9c0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.441+0000 7f5fa849c640 1 -- 172.21.15.55:0/3685161166 shutdown_connections 2023-07-06T21:43:47.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.441+0000 7f5fa849c640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5f84066150 0x7f5f84068600 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.441+0000 7f5fa849c640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fa00ccb70 0x7f5fa0154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.441+0000 7f5fa849c640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5fa00c9b90 0x7f5fa015ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.441+0000 7f5fa849c640 1 --2- 172.21.15.55:0/3685161166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa00693f0 0x7f5fa015c770 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.441+0000 7f5fa849c640 1 -- 172.21.15.55:0/3685161166 >> 172.21.15.55:0/3685161166 conn(0x7f5fa00cde30 msgr2=0x7f5fa00ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:47.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.441+0000 7f5fa849c640 1 -- 172.21.15.55:0/3685161166 shutdown_connections 2023-07-06T21:43:47.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.441+0000 7f5fa849c640 1 -- 172.21.15.55:0/3685161166 wait complete. 2023-07-06T21:43:47.468 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-07-06T21:43:47.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:47.469 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-07-06T21:43:47.480 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-07-06T21:43:47.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.665+0000 7f1bb54d8640 1 Processor -- start 2023-07-06T21:43:47.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.665+0000 7f1bb54d8640 1 -- start start 2023-07-06T21:43:47.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.665+0000 7f1bb54d8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1bb00b7840 0x7f1bb00ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:47.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bb54d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb00ccd00 con 0x7f1bb015ff00 2023-07-06T21:43:47.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bb54d8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb00b7c10 con 0x7f1bb015c4a0 2023-07-06T21:43:47.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bb54d8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb00d18b0 con 0x7f1bb00b7840 2023-07-06T21:43:47.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1ba7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1bb015ff00 0x7f1bb015bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34908/0 (socket says 172.21.15.55:34908) 2023-07-06T21:43:47.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1ba7fff640 1 -- 172.21.15.55:0/2766188795 learned_addr learned my addr 172.21.15.55:0/2766188795 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:47.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 -- 172.21.15.55:0/2766188795 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625569398 0 0) 0x7f1bb00ccd00 con 0x7f1bb015ff00 2023-07-06T21:43:47.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1baeffd640 1 --2- 172.21.15.55:0/2766188795 >> v2:172.21.15.138:3300/0 conn(0x7f1bb00b7840 0x7f1bb00ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 -- 172.21.15.55:0/2766188795 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b9c003530 con 0x7f1bb015ff00 2023-07-06T21:43:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 -- 172.21.15.55:0/2766188795 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3167521701 0 0) 0x7f1b9c003530 con 0x7f1bb015ff00 2023-07-06T21:43:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 -- 172.21.15.55:0/2766188795 >> v2:172.21.15.138:3300/0 conn(0x7f1bb00b7840 msgr2=0x7f1bb00ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 --2- 172.21.15.55:0/2766188795 >> v2:172.21.15.138:3300/0 conn(0x7f1bb00b7840 0x7f1bb00ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 -- 172.21.15.55:0/2766188795 >> v1:172.21.15.138:6789/0 conn(0x7f1bb015c4a0 legacy=0x7f1bb00b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 -- 172.21.15.55:0/2766188795 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb00d1a90 con 0x7f1bb015ff00 2023-07-06T21:43:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 -- 172.21.15.55:0/2766188795 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f1b98001680 con 0x7f1bb015ff00 2023-07-06T21:43:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 -- 172.21.15.55:0/2766188795 >> v1:172.21.15.55:6789/0 conn(0x7f1bb015ff00 legacy=0x7f1bb015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 --2- 172.21.15.55:0/2766188795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b9c003980 0x7f1b9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 --2- 172.21.15.55:0/2766188795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b9c0047d0 0x7f1b9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 --2- 172.21.15.55:0/2766188795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b9c005180 0x7f1b9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 -- 172.21.15.55:0/2766188795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb00d18b0 con 0x7f1b9c0047d0 2023-07-06T21:43:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 -- 172.21.15.55:0/2766188795 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c00c000 con 0x7f1b9c005180 2023-07-06T21:43:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1bae7fc640 1 -- 172.21.15.55:0/2766188795 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c00c1c0 con 0x7f1b9c003980 2023-07-06T21:43:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1ba7fff640 1 --2- 172.21.15.55:0/2766188795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b9c0047d0 0x7f1b9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1baf7fe640 1 --2- 172.21.15.55:0/2766188795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b9c005180 0x7f1b9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1baeffd640 1 --2- 172.21.15.55:0/2766188795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b9c003980 0x7f1b9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1ba7fff640 1 -- 172.21.15.55:0/2766188795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b9c003980 msgr2=0x7f1b9c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1ba7fff640 1 --2- 172.21.15.55:0/2766188795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b9c003980 0x7f1b9c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1ba7fff640 1 -- 172.21.15.55:0/2766188795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b9c005180 msgr2=0x7f1b9c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:47.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1ba7fff640 1 --2- 172.21.15.55:0/2766188795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b9c005180 0x7f1b9c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1ba7fff640 1 -- 172.21.15.55:0/2766188795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c003530 con 0x7f1b9c0047d0 2023-07-06T21:43:47.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.669+0000 7f1baf7fe640 1 -- 172.21.15.55:0/2766188795 reap_dead start 2023-07-06T21:43:47.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.673+0000 7f1ba7fff640 1 --2- 172.21.15.55:0/2766188795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b9c0047d0 0x7f1b9c004c40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800c190 tx=0x7f1b9801f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368a0b6667bd7a5f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:47.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.673+0000 7f1bae7fc640 1 -- 172.21.15.55:0/2766188795 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b980a8e70 con 0x7f1b9c0047d0 2023-07-06T21:43:47.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.673+0000 7f1bae7fc640 1 -- 172.21.15.55:0/2766188795 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b980058e0 con 0x7f1b9c0047d0 2023-07-06T21:43:47.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.673+0000 7f1bae7fc640 1 -- 172.21.15.55:0/2766188795 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b98005d10 con 0x7f1b9c0047d0 2023-07-06T21:43:47.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.673+0000 7f1bb54d8640 1 -- 172.21.15.55:0/2766188795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b9c0047d0 msgr2=0x7f1b9c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.673+0000 7f1bb54d8640 1 --2- 172.21.15.55:0/2766188795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b9c0047d0 0x7f1b9c004c40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800c190 tx=0x7f1b9801f350 comp rx=0 tx=0).stop 2023-07-06T21:43:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.673+0000 7f1bb54d8640 1 -- 172.21.15.55:0/2766188795 shutdown_connections 2023-07-06T21:43:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.673+0000 7f1bb54d8640 1 --2- 172.21.15.55:0/2766188795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b9c0047d0 0x7f1b9c004c40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.673+0000 7f1bb54d8640 1 -- 172.21.15.55:0/2766188795 >> 172.21.15.55:0/2766188795 conn(0x7f1bb00ceae0 msgr2=0x7f1bb00ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.673+0000 7f1bb54d8640 1 -- 172.21.15.55:0/2766188795 shutdown_connections 2023-07-06T21:43:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.673+0000 7f1bb54d8640 1 -- 172.21.15.55:0/2766188795 wait complete. 2023-07-06T21:43:47.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.673+0000 7f1bb54d8640 1 Processor -- start 2023-07-06T21:43:47.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.673+0000 7f1bb54d8640 1 -- start start 2023-07-06T21:43:47.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1bb54d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b9c0047d0 0x7f1bb014bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:47.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1bb54d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bb00c5040 0x7f1bb0146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:47.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1bb54d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb00c7f20 0x7f1bb00c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:47.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1bb54d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb00c6e80 con 0x7f1bb00c7f20 2023-07-06T21:43:47.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1bb54d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb00c7160 con 0x7f1b9c0047d0 2023-07-06T21:43:47.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1bb54d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb00c7440 con 0x7f1bb00c5040 2023-07-06T21:43:47.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1baeffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b9c0047d0 0x7f1bb014bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:47.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1baeffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b9c0047d0 0x7f1bb014bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:34412/0 (socket says 172.21.15.55:34412) 2023-07-06T21:43:47.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1baeffd640 1 -- 172.21.15.55:0/311331285 learned_addr learned my addr 172.21.15.55:0/311331285 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1baf7fe640 1 --2- 172.21.15.55:0/311331285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb00c7f20 0x7f1bb00c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1ba7fff640 1 --2- 172.21.15.55:0/311331285 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bb00c5040 0x7f1bb0146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:47.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1baeffd640 1 -- 172.21.15.55:0/311331285 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bb00c5040 msgr2=0x7f1bb0146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:47.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1baeffd640 1 --2- 172.21.15.55:0/311331285 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bb00c5040 0x7f1bb0146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1baeffd640 1 -- 172.21.15.55:0/311331285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb00c7f20 msgr2=0x7f1bb00c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:47.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1baeffd640 1 --2- 172.21.15.55:0/311331285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb00c7f20 0x7f1bb00c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1baeffd640 1 -- 172.21.15.55:0/311331285 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb00c7720 con 0x7f1b9c0047d0 2023-07-06T21:43:47.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1baeffd640 1 --2- 172.21.15.55:0/311331285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b9c0047d0 0x7f1bb014bb30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0011900 tx=0x7f1ba00119f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:47.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1ba77fe640 1 -- 172.21.15.55:0/311331285 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0004240 con 0x7f1b9c0047d0 2023-07-06T21:43:47.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1ba77fe640 1 -- 172.21.15.55:0/311331285 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba00043a0 con 0x7f1b9c0047d0 2023-07-06T21:43:47.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1ba77fe640 1 -- 172.21.15.55:0/311331285 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0003860 con 0x7f1b9c0047d0 2023-07-06T21:43:47.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1bb54d8640 1 -- 172.21.15.55:0/311331285 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb00c7a00 con 0x7f1b9c0047d0 2023-07-06T21:43:47.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1bb54d8640 1 -- 172.21.15.55:0/311331285 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb00c88d0 con 0x7f1b9c0047d0 2023-07-06T21:43:47.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.677+0000 7f1bb54d8640 1 -- 172.21.15.55:0/311331285 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb00b3390 con 0x7f1b9c0047d0 2023-07-06T21:43:47.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.681+0000 7f1ba77fe640 1 -- 172.21.15.55:0/311331285 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f1ba00039c0 con 0x7f1b9c0047d0 2023-07-06T21:43:47.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.681+0000 7f1ba77fe640 1 --2- 172.21.15.55:0/311331285 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f1b90066480 0x7f1b90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:47.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.681+0000 7f1ba77fe640 1 -- 172.21.15.55:0/311331285 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7f1ba0084ba0 con 0x7f1b9c0047d0 2023-07-06T21:43:47.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.681+0000 7f1ba7fff640 1 --2- 172.21.15.55:0/311331285 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f1b90066480 0x7f1b90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:47.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.681+0000 7f1ba7fff640 1 --2- 172.21.15.55:0/311331285 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f1b90066480 0x7f1b90068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b980ae000 tx=0x7f1b980aa070 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:47.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.685+0000 7f1ba77fe640 1 -- 172.21.15.55:0/311331285 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1ba0051d90 con 0x7f1b9c0047d0 2023-07-06T21:43:47.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.857+0000 7f1bb54d8640 1 -- 172.21.15.55:0/311331285 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bb00cc6b0 con 0x7f1b90066480 2023-07-06T21:43:47.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.933+0000 7f1ba77fe640 1 -- 172.21.15.55:0/311331285 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f1b980b8040 con 0x7f1b90066480 2023-07-06T21:43:47.942 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir3 2023-07-06T21:43:47.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.937+0000 7f1bb54d8640 1 -- 172.21.15.55:0/311331285 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f1b90066480 msgr2=0x7f1b90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:47.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.937+0000 7f1bb54d8640 1 --2- 172.21.15.55:0/311331285 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f1b90066480 0x7f1b90068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b980ae000 tx=0x7f1b980aa070 comp rx=0 tx=0).stop 2023-07-06T21:43:47.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.937+0000 7f1bb54d8640 1 -- 172.21.15.55:0/311331285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b9c0047d0 msgr2=0x7f1bb014bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:47.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.937+0000 7f1bb54d8640 1 --2- 172.21.15.55:0/311331285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b9c0047d0 0x7f1bb014bb30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0011900 tx=0x7f1ba00119f0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.937+0000 7f1bb54d8640 1 -- 172.21.15.55:0/311331285 shutdown_connections 2023-07-06T21:43:47.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.937+0000 7f1bb54d8640 1 --2- 172.21.15.55:0/311331285 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f1b90066480 0x7f1b90068930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.937+0000 7f1bb54d8640 1 --2- 172.21.15.55:0/311331285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb00c7f20 0x7f1bb00c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.937+0000 7f1bb54d8640 1 --2- 172.21.15.55:0/311331285 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bb00c5040 0x7f1bb0146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.937+0000 7f1bb54d8640 1 --2- 172.21.15.55:0/311331285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b9c0047d0 0x7f1bb014bb30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:47.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.937+0000 7f1bb54d8640 1 -- 172.21.15.55:0/311331285 >> 172.21.15.55:0/311331285 conn(0x7f1bb00ceae0 msgr2=0x7f1bb0069600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:47.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.937+0000 7f1bb54d8640 1 -- 172.21.15.55:0/311331285 shutdown_connections 2023-07-06T21:43:47.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:47.937+0000 7f1bb54d8640 1 -- 172.21.15.55:0/311331285 wait complete. 2023-07-06T21:43:47.962 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-07-06T21:43:47.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:47.963 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-07-06T21:43:47.974 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-07-06T21:43:48.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.153+0000 7fbc9d4bd640 1 Processor -- start 2023-07-06T21:43:48.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.153+0000 7fbc9d4bd640 1 -- start start 2023-07-06T21:43:48.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.153+0000 7fbc9d4bd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbc980ccb70 0x7fbc9815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:48.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.153+0000 7fbc9d4bd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbc980693f0 0x7fbc98069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:48.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.153+0000 7fbc9d4bd640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc980b3e70 con 0x7fbc980c9b90 2023-07-06T21:43:48.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.153+0000 7fbc9d4bd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc98159c30 con 0x7fbc980693f0 2023-07-06T21:43:48.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.153+0000 7fbc9d4bd640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc980c9070 con 0x7fbc980ccb70 2023-07-06T21:43:48.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.153+0000 7fbc977fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbc980693f0 0x7fbc98069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:48.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.157+0000 7fbc977fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbc980693f0 0x7fbc98069810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41008/0 (socket says 172.21.15.55:41008) 2023-07-06T21:43:48.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.157+0000 7fbc977fe640 1 -- 172.21.15.55:0/2501430477 learned_addr learned my addr 172.21.15.55:0/2501430477 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:48.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.157+0000 7fbc8ffff640 1 --2- 172.21.15.55:0/2501430477 >> v2:172.21.15.138:3300/0 conn(0x7fbc980ccb70 0x7fbc9815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:48.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.157+0000 7fbc977fe640 1 -- 172.21.15.55:0/2501430477 >> v2:172.21.15.138:3300/0 conn(0x7fbc980ccb70 msgr2=0x7fbc9815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:48.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.157+0000 7fbc977fe640 1 --2- 172.21.15.55:0/2501430477 >> v2:172.21.15.138:3300/0 conn(0x7fbc980ccb70 0x7fbc9815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.157+0000 7fbc977fe640 1 -- 172.21.15.55:0/2501430477 >> v1:172.21.15.138:6789/0 conn(0x7fbc980c9b90 legacy=0x7fbc980c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:48.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.157+0000 7fbc977fe640 1 -- 172.21.15.55:0/2501430477 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc980c8480 con 0x7fbc980693f0 2023-07-06T21:43:48.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.157+0000 7fbc8ffff640 1 --2- 172.21.15.55:0/2501430477 >> v2:172.21.15.138:3300/0 conn(0x7fbc980ccb70 0x7fbc9815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:48.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.157+0000 7fbc977fe640 1 --2- 172.21.15.55:0/2501430477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc980693f0 0x7fbc98069810 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbc980ccb00 tx=0x7fbc9001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52591ea96874f490 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:48.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.157+0000 7fbc967fc640 1 -- 172.21.15.55:0/2501430477 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc900a5720 con 0x7fbc980693f0 2023-07-06T21:43:48.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.157+0000 7fbc967fc640 1 -- 172.21.15.55:0/2501430477 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc900a5880 con 0x7fbc980693f0 2023-07-06T21:43:48.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.157+0000 7fbc967fc640 1 -- 172.21.15.55:0/2501430477 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc900a5c10 con 0x7fbc980693f0 2023-07-06T21:43:48.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2501430477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc980693f0 msgr2=0x7fbc98069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:48.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 --2- 172.21.15.55:0/2501430477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc980693f0 0x7fbc98069810 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbc980ccb00 tx=0x7fbc9001c9d0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2501430477 shutdown_connections 2023-07-06T21:43:48.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 --2- 172.21.15.55:0/2501430477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc980693f0 0x7fbc98069810 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 --2- 172.21.15.55:0/2501430477 >> v2:172.21.15.138:3300/0 conn(0x7fbc980ccb70 0x7fbc9815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2501430477 >> 172.21.15.55:0/2501430477 conn(0x7fbc980cde30 msgr2=0x7fbc980ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:48.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2501430477 shutdown_connections 2023-07-06T21:43:48.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2501430477 wait complete. 2023-07-06T21:43:48.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 Processor -- start 2023-07-06T21:43:48.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 -- start start 2023-07-06T21:43:48.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc980693f0 0x7fbc98152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:48.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc980c9b90 0x7fbc98163900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:48.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc980ccb70 0x7fbc98152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:48.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9806c7b0 con 0x7fbc980ccb70 2023-07-06T21:43:48.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9806bf10 con 0x7fbc980693f0 2023-07-06T21:43:48.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc9d4bd640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9806c1f0 con 0x7fbc980c9b90 2023-07-06T21:43:48.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc977fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc980ccb70 0x7fbc98152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:48.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc977fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc980ccb70 0x7fbc98152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41024/0 (socket says 172.21.15.55:41024) 2023-07-06T21:43:48.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc977fe640 1 -- 172.21.15.55:0/2695617442 learned_addr learned my addr 172.21.15.55:0/2695617442 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:48.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc96ffd640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc980693f0 0x7fbc98152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:48.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc8ffff640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc980c9b90 0x7fbc98163900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:48.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc977fe640 1 -- 172.21.15.55:0/2695617442 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc980c9b90 msgr2=0x7fbc98163900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:48.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc977fe640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc980c9b90 0x7fbc98163900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc977fe640 1 -- 172.21.15.55:0/2695617442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc980693f0 msgr2=0x7fbc98152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:48.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc977fe640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc980693f0 0x7fbc98152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc977fe640 1 -- 172.21.15.55:0/2695617442 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc90009b30 con 0x7fbc980ccb70 2023-07-06T21:43:48.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.161+0000 7fbc96ffd640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc980693f0 0x7fbc98152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:48.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.165+0000 7fbc977fe640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc980ccb70 0x7fbc98152da0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbc900195e0 tx=0x7fbc90019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:48.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.165+0000 7fbc8f7fe640 1 -- 172.21.15.55:0/2695617442 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc900b8670 con 0x7fbc980ccb70 2023-07-06T21:43:48.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.165+0000 7fbc8f7fe640 1 -- 172.21.15.55:0/2695617442 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc900b8810 con 0x7fbc980ccb70 2023-07-06T21:43:48.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.165+0000 7fbc8f7fe640 1 -- 172.21.15.55:0/2695617442 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc900b8bc0 con 0x7fbc980ccb70 2023-07-06T21:43:48.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.165+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2695617442 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9806c4d0 con 0x7fbc980ccb70 2023-07-06T21:43:48.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.165+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2695617442 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc98152840 con 0x7fbc980ccb70 2023-07-06T21:43:48.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.165+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2695617442 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9815a5f0 con 0x7fbc980ccb70 2023-07-06T21:43:48.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.165+0000 7fbc8f7fe640 1 -- 172.21.15.55:0/2695617442 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fbc900b8d20 con 0x7fbc980ccb70 2023-07-06T21:43:48.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.165+0000 7fbc8f7fe640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbc78066480 0x7fbc78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:48.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.165+0000 7fbc8f7fe640 1 -- 172.21.15.55:0/2695617442 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7fbc9011f6f0 con 0x7fbc980ccb70 2023-07-06T21:43:48.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.165+0000 7fbc96ffd640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbc78066480 0x7fbc78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:48.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.169+0000 7fbc96ffd640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbc78066480 0x7fbc78068930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbc88000f70 tx=0x7fbc88009040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:48.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.169+0000 7fbc8f7fe640 1 -- 172.21.15.55:0/2695617442 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc900ec630 con 0x7fbc980ccb70 2023-07-06T21:43:48.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.345+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2695617442 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc980ca740 con 0x7fbc78066480 2023-07-06T21:43:48.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.409+0000 7fbc8f7fe640 1 -- 172.21.15.55:0/2695617442 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fbc980ca740 con 0x7fbc78066480 2023-07-06T21:43:48.418 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir4 2023-07-06T21:43:48.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.413+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2695617442 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbc78066480 msgr2=0x7fbc78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:48.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.413+0000 7fbc9d4bd640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbc78066480 0x7fbc78068930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbc88000f70 tx=0x7fbc88009040 comp rx=0 tx=0).stop 2023-07-06T21:43:48.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.413+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2695617442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc980ccb70 msgr2=0x7fbc98152da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:48.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.413+0000 7fbc9d4bd640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc980ccb70 0x7fbc98152da0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbc900195e0 tx=0x7fbc90019770 comp rx=0 tx=0).stop 2023-07-06T21:43:48.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.413+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2695617442 shutdown_connections 2023-07-06T21:43:48.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.413+0000 7fbc9d4bd640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbc78066480 0x7fbc78068930 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.413+0000 7fbc9d4bd640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc980ccb70 0x7fbc98152da0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.413+0000 7fbc9d4bd640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc980c9b90 0x7fbc98163900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.413+0000 7fbc9d4bd640 1 --2- 172.21.15.55:0/2695617442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc980693f0 0x7fbc98152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.413+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2695617442 >> 172.21.15.55:0/2695617442 conn(0x7fbc980cde30 msgr2=0x7fbc9815d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:48.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.413+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2695617442 shutdown_connections 2023-07-06T21:43:48.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.413+0000 7fbc9d4bd640 1 -- 172.21.15.55:0/2695617442 wait complete. 2023-07-06T21:43:48.438 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-07-06T21:43:48.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:48.439 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-07-06T21:43:48.450 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-07-06T21:43:48.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.629+0000 7f50561c5640 1 Processor -- start 2023-07-06T21:43:48.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.629+0000 7f50561c5640 1 -- start start 2023-07-06T21:43:48.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f50561c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500b3c90 0x7f50500ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:48.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f50561c5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f50500b18a0 0x7f50500b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:48.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f50561c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f50500d1d30 0x7f505015f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:48.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f50561c5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50500cd0a0 con 0x7f50500d1d30 2023-07-06T21:43:48.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f50561c5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50500ccd50 con 0x7f50500b18a0 2023-07-06T21:43:48.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f50561c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5050069ea0 con 0x7f50500b3c90 2023-07-06T21:43:48.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f504ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f50500d1d30 0x7f505015f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:48.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f504ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f50500d1d30 0x7f505015f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41028/0 (socket says 172.21.15.55:41028) 2023-07-06T21:43:48.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f504ffff640 1 -- 172.21.15.55:0/3223930672 learned_addr learned my addr 172.21.15.55:0/3223930672 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:48.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f504effd640 1 --2- 172.21.15.55:0/3223930672 >> v2:172.21.15.138:3300/0 conn(0x7f50500b18a0 0x7f50500b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:48.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f504f7fe640 1 --2- 172.21.15.55:0/3223930672 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500b3c90 0x7f50500ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:48.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f504ffff640 1 -- 172.21.15.55:0/3223930672 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500b3c90 msgr2=0x7f50500ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:48.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f504ffff640 1 --2- 172.21.15.55:0/3223930672 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500b3c90 0x7f50500ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f504ffff640 1 -- 172.21.15.55:0/3223930672 >> v2:172.21.15.138:3300/0 conn(0x7f50500b18a0 msgr2=0x7f50500b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:48.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f504ffff640 1 --2- 172.21.15.55:0/3223930672 >> v2:172.21.15.138:3300/0 conn(0x7f50500b18a0 0x7f50500b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f504ffff640 1 -- 172.21.15.55:0/3223930672 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50500b45a0 con 0x7f50500d1d30 2023-07-06T21:43:48.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.633+0000 7f504effd640 1 --2- 172.21.15.55:0/3223930672 >> v2:172.21.15.138:3300/0 conn(0x7f50500b18a0 0x7f50500b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:48.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f504ffff640 1 --2- 172.21.15.55:0/3223930672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500d1d30 0x7f505015f540 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f505008b330 tx=0x7f504801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44814bc9f7299342 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:48.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f504e7fc640 1 -- 172.21.15.55:0/3223930672 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480a5560 con 0x7f50500d1d30 2023-07-06T21:43:48.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f504e7fc640 1 -- 172.21.15.55:0/3223930672 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50480a56c0 con 0x7f50500d1d30 2023-07-06T21:43:48.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f504e7fc640 1 -- 172.21.15.55:0/3223930672 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480a5a50 con 0x7f50500d1d30 2023-07-06T21:43:48.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f50561c5640 1 -- 172.21.15.55:0/3223930672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500d1d30 msgr2=0x7f505015f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:48.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f50561c5640 1 --2- 172.21.15.55:0/3223930672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500d1d30 0x7f505015f540 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f505008b330 tx=0x7f504801c6e0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f50561c5640 1 -- 172.21.15.55:0/3223930672 shutdown_connections 2023-07-06T21:43:48.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f50561c5640 1 --2- 172.21.15.55:0/3223930672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500d1d30 0x7f505015f540 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f50561c5640 1 --2- 172.21.15.55:0/3223930672 >> v2:172.21.15.138:3300/0 conn(0x7f50500b18a0 0x7f50500b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f50561c5640 1 --2- 172.21.15.55:0/3223930672 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500b3c90 0x7f50500ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f50561c5640 1 -- 172.21.15.55:0/3223930672 >> 172.21.15.55:0/3223930672 conn(0x7f505006bf40 msgr2=0x7f50500cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:48.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f50561c5640 1 -- 172.21.15.55:0/3223930672 shutdown_connections 2023-07-06T21:43:48.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f50561c5640 1 -- 172.21.15.55:0/3223930672 wait complete. 2023-07-06T21:43:48.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f50561c5640 1 Processor -- start 2023-07-06T21:43:48.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.637+0000 7f50561c5640 1 -- start start 2023-07-06T21:43:48.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f50561c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500b18a0 0x7f50500c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f50561c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50500b3c90 0x7f50500b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f50561c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500d1d30 0x7f50500b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f50561c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50501f42a0 con 0x7f50500d1d30 2023-07-06T21:43:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f50561c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50501f4580 con 0x7f50500b3c90 2023-07-06T21:43:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f50561c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50501f4860 con 0x7f50500b18a0 2023-07-06T21:43:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f504ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500d1d30 0x7f50500b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:48.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f504ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500d1d30 0x7f50500b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41032/0 (socket says 172.21.15.55:41032) 2023-07-06T21:43:48.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f504ffff640 1 -- 172.21.15.55:0/3011042419 learned_addr learned my addr 172.21.15.55:0/3011042419 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:48.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f504f7fe640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500b18a0 0x7f50500c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:48.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f504effd640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50500b3c90 0x7f50500b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:48.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f504ffff640 1 -- 172.21.15.55:0/3011042419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500b18a0 msgr2=0x7f50500c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:48.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f504ffff640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500b18a0 0x7f50500c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f504ffff640 1 -- 172.21.15.55:0/3011042419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50500b3c90 msgr2=0x7f50500b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:48.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f504ffff640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50500b3c90 0x7f50500b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f504ffff640 1 -- 172.21.15.55:0/3011042419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5048009b30 con 0x7f50500d1d30 2023-07-06T21:43:48.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f504effd640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50500b3c90 0x7f50500b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:48.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f504ffff640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500d1d30 0x7f50500b2a00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f504801ad90 tx=0x7f5048019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f5037fff640 1 -- 172.21.15.55:0/3011042419 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480a5560 con 0x7f50500d1d30 2023-07-06T21:43:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f5037fff640 1 -- 172.21.15.55:0/3011042419 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50480b8690 con 0x7f50500d1d30 2023-07-06T21:43:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f50561c5640 1 -- 172.21.15.55:0/3011042419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50501f4b40 con 0x7f50500d1d30 2023-07-06T21:43:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f5037fff640 1 -- 172.21.15.55:0/3011042419 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480b8a40 con 0x7f50500d1d30 2023-07-06T21:43:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f50561c5640 1 -- 172.21.15.55:0/3011042419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50501f5110 con 0x7f50500d1d30 2023-07-06T21:43:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f50561c5640 1 -- 172.21.15.55:0/3011042419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5050066d60 con 0x7f50500d1d30 2023-07-06T21:43:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.641+0000 7f5037fff640 1 -- 172.21.15.55:0/3011042419 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f50480b8ba0 con 0x7f50500d1d30 2023-07-06T21:43:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.645+0000 7f5037fff640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f503c066480 0x7f503c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.645+0000 7f5037fff640 1 -- 172.21.15.55:0/3011042419 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7f504811f700 con 0x7f50500d1d30 2023-07-06T21:43:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.645+0000 7f504f7fe640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f503c066480 0x7f503c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.645+0000 7f504f7fe640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f503c066480 0x7f503c068930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f505015d050 tx=0x7f5040008040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.649+0000 7f5037fff640 1 -- 172.21.15.55:0/3011042419 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50480ec7f0 con 0x7f50500d1d30 2023-07-06T21:43:48.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.821+0000 7f50561c5640 1 -- 172.21.15.55:0/3011042419 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f50500cfec0 con 0x7f503c066480 2023-07-06T21:43:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.893+0000 7f5037fff640 1 -- 172.21.15.55:0/3011042419 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f5040010a80 con 0x7f503c066480 2023-07-06T21:43:48.903 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir5 2023-07-06T21:43:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.897+0000 7f50561c5640 1 -- 172.21.15.55:0/3011042419 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f503c066480 msgr2=0x7f503c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.897+0000 7f50561c5640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f503c066480 0x7f503c068930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f505015d050 tx=0x7f5040008040 comp rx=0 tx=0).stop 2023-07-06T21:43:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.897+0000 7f50561c5640 1 -- 172.21.15.55:0/3011042419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500d1d30 msgr2=0x7f50500b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.897+0000 7f50561c5640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500d1d30 0x7f50500b2a00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f504801ad90 tx=0x7f5048019480 comp rx=0 tx=0).stop 2023-07-06T21:43:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.897+0000 7f50561c5640 1 -- 172.21.15.55:0/3011042419 shutdown_connections 2023-07-06T21:43:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.897+0000 7f50561c5640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f503c066480 0x7f503c068930 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.897+0000 7f50561c5640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500d1d30 0x7f50500b2a00 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.897+0000 7f50561c5640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50500b3c90 0x7f50500b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.897+0000 7f50561c5640 1 --2- 172.21.15.55:0/3011042419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500b18a0 0x7f50500c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.897+0000 7f50561c5640 1 -- 172.21.15.55:0/3011042419 >> 172.21.15.55:0/3011042419 conn(0x7f505006bf40 msgr2=0x7f50500cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.897+0000 7f50561c5640 1 -- 172.21.15.55:0/3011042419 shutdown_connections 2023-07-06T21:43:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:48.897+0000 7f50561c5640 1 -- 172.21.15.55:0/3011042419 wait complete. 2023-07-06T21:43:48.924 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-07-06T21:43:48.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:48.925 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-07-06T21:43:48.936 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-07-06T21:43:49.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.121+0000 7fbecafad640 1 Processor -- start 2023-07-06T21:43:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.121+0000 7fbecafad640 1 -- start start 2023-07-06T21:43:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.121+0000 7fbecafad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbec40cd3e0 0x7fbec40c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.121+0000 7fbecafad640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbec41587b0 0x7fbec406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.121+0000 7fbecafad640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec4159350 con 0x7fbec4158360 2023-07-06T21:43:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.121+0000 7fbecafad640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec40ccf50 con 0x7fbec41587b0 2023-07-06T21:43:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.121+0000 7fbecafad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40c8e50 con 0x7fbec40cd3e0 2023-07-06T21:43:49.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.121+0000 7fbec8d49640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbec40cd3e0 0x7fbec40c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:49.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.121+0000 7fbec954a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbec41587b0 0x7fbec406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:49.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.125+0000 7fbec8d49640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbec40cd3e0 0x7fbec40c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:49344/0 (socket says 172.21.15.55:49344) 2023-07-06T21:43:49.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.125+0000 7fbec8d49640 1 -- 172.21.15.55:0/3105548757 learned_addr learned my addr 172.21.15.55:0/3105548757 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:49.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.125+0000 7fbec954a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbec41587b0 0x7fbec406bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:34464/0 (socket says 172.21.15.55:34464) 2023-07-06T21:43:49.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.125+0000 7fbec3fff640 1 --1- 172.21.15.55:0/3105548757 >> v1:172.21.15.138:6789/0 conn(0x7fbec4158360 0x7fbec40cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:43590/0 (socket says 172.21.15.55:43590) 2023-07-06T21:43:49.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.125+0000 7fbec954a640 1 -- 172.21.15.55:0/3105548757 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbec40cd3e0 msgr2=0x7fbec40c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:49.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.125+0000 7fbec954a640 1 --2- 172.21.15.55:0/3105548757 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbec40cd3e0 0x7fbec40c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.125+0000 7fbec954a640 1 -- 172.21.15.55:0/3105548757 >> v1:172.21.15.138:6789/0 conn(0x7fbec4158360 legacy=0x7fbec40cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:49.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.125+0000 7fbec954a640 1 -- 172.21.15.55:0/3105548757 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec4158d90 con 0x7fbec41587b0 2023-07-06T21:43:49.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.125+0000 7fbec8d49640 1 --2- 172.21.15.55:0/3105548757 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbec40cd3e0 0x7fbec40c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:49.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.125+0000 7fbec37fe640 1 -- 172.21.15.55:0/3105548757 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601333828 0 0) 0x7fbec4159350 con 0x7fbec4158360 2023-07-06T21:43:49.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.125+0000 7fbec954a640 1 --2- 172.21.15.55:0/3105548757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbec41587b0 0x7fbec406bc00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009d90 tx=0x7fbebc01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa7ecf10aca00858 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:49.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.125+0000 7fbec37fe640 1 -- 172.21.15.55:0/3105548757 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0a5860 con 0x7fbec41587b0 2023-07-06T21:43:49.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.125+0000 7fbec37fe640 1 -- 172.21.15.55:0/3105548757 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc0a59c0 con 0x7fbec41587b0 2023-07-06T21:43:49.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.125+0000 7fbec37fe640 1 -- 172.21.15.55:0/3105548757 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0a5d50 con 0x7fbec41587b0 2023-07-06T21:43:49.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 -- 172.21.15.55:0/3105548757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbec41587b0 msgr2=0x7fbec406bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:49.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 --2- 172.21.15.55:0/3105548757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbec41587b0 0x7fbec406bc00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009d90 tx=0x7fbebc01c890 comp rx=0 tx=0).stop 2023-07-06T21:43:49.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 -- 172.21.15.55:0/3105548757 shutdown_connections 2023-07-06T21:43:49.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 --2- 172.21.15.55:0/3105548757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbec41587b0 0x7fbec406bc00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 --2- 172.21.15.55:0/3105548757 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbec40cd3e0 0x7fbec40c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 -- 172.21.15.55:0/3105548757 >> 172.21.15.55:0/3105548757 conn(0x7fbec40cde30 msgr2=0x7fbec40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:49.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 -- 172.21.15.55:0/3105548757 shutdown_connections 2023-07-06T21:43:49.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 -- 172.21.15.55:0/3105548757 wait complete. 2023-07-06T21:43:49.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 Processor -- start 2023-07-06T21:43:49.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 -- start start 2023-07-06T21:43:49.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbec4158360 0x7fbec40c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:49.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbec41587b0 0x7fbec4069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:49.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbec40708c0 0x7fbec406a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:49.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40b3cf0 con 0x7fbec41587b0 2023-07-06T21:43:49.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40c4f00 con 0x7fbec4158360 2023-07-06T21:43:49.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbecafad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40c5150 con 0x7fbec40708c0 2023-07-06T21:43:49.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbec3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbec41587b0 0x7fbec4069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:49.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbec3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbec41587b0 0x7fbec4069bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41036/0 (socket says 172.21.15.55:41036) 2023-07-06T21:43:49.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbec3fff640 1 -- 172.21.15.55:0/3943064942 learned_addr learned my addr 172.21.15.55:0/3943064942 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:49.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbec8d49640 1 --2- 172.21.15.55:0/3943064942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbec4158360 0x7fbec40c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:49.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.129+0000 7fbec954a640 1 --2- 172.21.15.55:0/3943064942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbec40708c0 0x7fbec406a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:49.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbec3fff640 1 -- 172.21.15.55:0/3943064942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbec40708c0 msgr2=0x7fbec406a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:49.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbec3fff640 1 --2- 172.21.15.55:0/3943064942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbec40708c0 0x7fbec406a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbec3fff640 1 -- 172.21.15.55:0/3943064942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbec4158360 msgr2=0x7fbec40c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:49.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbec3fff640 1 --2- 172.21.15.55:0/3943064942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbec4158360 0x7fbec40c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbec3fff640 1 -- 172.21.15.55:0/3943064942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb800b770 con 0x7fbec41587b0 2023-07-06T21:43:49.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbec3fff640 1 --2- 172.21.15.55:0/3943064942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbec41587b0 0x7fbec4069bb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000c520 tx=0x7fbeb000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:49.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbec17fa640 1 -- 172.21.15.55:0/3943064942 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb00074e0 con 0x7fbec41587b0 2023-07-06T21:43:49.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbec17fa640 1 -- 172.21.15.55:0/3943064942 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb0007640 con 0x7fbec41587b0 2023-07-06T21:43:49.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbec17fa640 1 -- 172.21.15.55:0/3943064942 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb00049f0 con 0x7fbec41587b0 2023-07-06T21:43:49.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbecafad640 1 -- 172.21.15.55:0/3943064942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc009a70 con 0x7fbec41587b0 2023-07-06T21:43:49.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbecafad640 1 -- 172.21.15.55:0/3943064942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec40b1860 con 0x7fbec41587b0 2023-07-06T21:43:49.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbecafad640 1 -- 172.21.15.55:0/3943064942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec40b1a80 con 0x7fbec41587b0 2023-07-06T21:43:49.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbec17fa640 1 -- 172.21.15.55:0/3943064942 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fbeb0004b50 con 0x7fbec41587b0 2023-07-06T21:43:49.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbec17fa640 1 --2- 172.21.15.55:0/3943064942 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbea8066480 0x7fbea8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:49.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.133+0000 7fbec17fa640 1 -- 172.21.15.55:0/3943064942 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7fbeb0083530 con 0x7fbec41587b0 2023-07-06T21:43:49.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.137+0000 7fbec8d49640 1 --2- 172.21.15.55:0/3943064942 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbea8066480 0x7fbea8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:49.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.137+0000 7fbec8d49640 1 --2- 172.21.15.55:0/3943064942 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbea8066480 0x7fbea8068930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800b240 tx=0x7fbeb800b450 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:49.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.137+0000 7fbec17fa640 1 -- 172.21.15.55:0/3943064942 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbeb00505e0 con 0x7fbec41587b0 2023-07-06T21:43:49.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.309+0000 7fbecafad640 1 -- 172.21.15.55:0/3943064942 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbec406b700 con 0x7fbea8066480 2023-07-06T21:43:49.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.377+0000 7fbec17fa640 1 -- 172.21.15.55:0/3943064942 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fbeb801c4a0 con 0x7fbea8066480 2023-07-06T21:43:49.385 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir6 2023-07-06T21:43:49.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.377+0000 7fbecafad640 1 -- 172.21.15.55:0/3943064942 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbea8066480 msgr2=0x7fbea8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:49.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.377+0000 7fbecafad640 1 --2- 172.21.15.55:0/3943064942 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbea8066480 0x7fbea8068930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800b240 tx=0x7fbeb800b450 comp rx=0 tx=0).stop 2023-07-06T21:43:49.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.377+0000 7fbecafad640 1 -- 172.21.15.55:0/3943064942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbec41587b0 msgr2=0x7fbec4069bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:49.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.377+0000 7fbecafad640 1 --2- 172.21.15.55:0/3943064942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbec41587b0 0x7fbec4069bb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000c520 tx=0x7fbeb000c9e0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.377+0000 7fbecafad640 1 -- 172.21.15.55:0/3943064942 shutdown_connections 2023-07-06T21:43:49.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.377+0000 7fbecafad640 1 --2- 172.21.15.55:0/3943064942 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbea8066480 0x7fbea8068930 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.377+0000 7fbecafad640 1 --2- 172.21.15.55:0/3943064942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbec40708c0 0x7fbec406a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.377+0000 7fbecafad640 1 --2- 172.21.15.55:0/3943064942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbec41587b0 0x7fbec4069bb0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.377+0000 7fbecafad640 1 --2- 172.21.15.55:0/3943064942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbec4158360 0x7fbec40c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.377+0000 7fbecafad640 1 -- 172.21.15.55:0/3943064942 >> 172.21.15.55:0/3943064942 conn(0x7fbec40cde30 msgr2=0x7fbec4151160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:49.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.377+0000 7fbecafad640 1 -- 172.21.15.55:0/3943064942 shutdown_connections 2023-07-06T21:43:49.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.377+0000 7fbecafad640 1 -- 172.21.15.55:0/3943064942 wait complete. 2023-07-06T21:43:49.407 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-07-06T21:43:49.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:49.408 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-07-06T21:43:49.418 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-07-06T21:43:49.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.597+0000 7f4f7cbc5640 1 Processor -- start 2023-07-06T21:43:49.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.597+0000 7f4f7cbc5640 1 -- start start 2023-07-06T21:43:49.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.597+0000 7f4f7cbc5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4f780c9b90 0x7f4f7815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:49.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.597+0000 7f4f7cbc5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4f780ccb70 0x7f4f780c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:49.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7cbc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f78070410 0x7f4f78070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:49.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7cbc5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f780b3e70 con 0x7f4f780c9b90 2023-07-06T21:43:49.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7cbc5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f78159c30 con 0x7f4f780ccb70 2023-07-06T21:43:49.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7cbc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f780c9070 con 0x7f4f78070410 2023-07-06T21:43:49.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4f780c9b90 0x7f4f7815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:49.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4f780c9b90 0x7f4f7815dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41044/0 (socket says 172.21.15.55:41044) 2023-07-06T21:43:49.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7659c640 1 -- 172.21.15.55:0/2801727528 learned_addr learned my addr 172.21.15.55:0/2801727528 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:49.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f75d9b640 1 --2- 172.21.15.55:0/2801727528 >> v2:172.21.15.138:3300/0 conn(0x7f4f780ccb70 0x7f4f780c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:49.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f76d9d640 1 --2- 172.21.15.55:0/2801727528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f78070410 0x7f4f78070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:49.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7659c640 1 -- 172.21.15.55:0/2801727528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f78070410 msgr2=0x7f4f78070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:49.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7659c640 1 --2- 172.21.15.55:0/2801727528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f78070410 0x7f4f78070870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7659c640 1 -- 172.21.15.55:0/2801727528 >> v2:172.21.15.138:3300/0 conn(0x7f4f780ccb70 msgr2=0x7f4f780c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:49.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7659c640 1 --2- 172.21.15.55:0/2801727528 >> v2:172.21.15.138:3300/0 conn(0x7f4f780ccb70 0x7f4f780c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7659c640 1 -- 172.21.15.55:0/2801727528 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f780c8480 con 0x7f4f780c9b90 2023-07-06T21:43:49.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7659c640 1 --2- 172.21.15.55:0/2801727528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f780c9b90 0x7f4f7815dd50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4f780ccb00 tx=0x7f4f6801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a09a0b8543c401 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:49.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7559a640 1 -- 172.21.15.55:0/2801727528 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f680ab600 con 0x7f4f780c9b90 2023-07-06T21:43:49.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7559a640 1 -- 172.21.15.55:0/2801727528 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f680a7050 con 0x7f4f780c9b90 2023-07-06T21:43:49.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.601+0000 7f4f7559a640 1 -- 172.21.15.55:0/2801727528 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f680ab980 con 0x7f4f780c9b90 2023-07-06T21:43:49.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/2801727528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f780c9b90 msgr2=0x7f4f7815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:49.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 --2- 172.21.15.55:0/2801727528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f780c9b90 0x7f4f7815dd50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4f780ccb00 tx=0x7f4f6801c320 comp rx=0 tx=0).stop 2023-07-06T21:43:49.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/2801727528 shutdown_connections 2023-07-06T21:43:49.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 --2- 172.21.15.55:0/2801727528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f78070410 0x7f4f78070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 --2- 172.21.15.55:0/2801727528 >> v2:172.21.15.138:3300/0 conn(0x7f4f780ccb70 0x7f4f780c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 --2- 172.21.15.55:0/2801727528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f780c9b90 0x7f4f7815dd50 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/2801727528 >> 172.21.15.55:0/2801727528 conn(0x7f4f780cde30 msgr2=0x7f4f780ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:49.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/2801727528 shutdown_connections 2023-07-06T21:43:49.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/2801727528 wait complete. 2023-07-06T21:43:49.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 Processor -- start 2023-07-06T21:43:49.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 -- start start 2023-07-06T21:43:49.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f78070410 0x7f4f78157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:49.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f780c9b90 0x7f4f7814c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:49.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f780ccb70 0x7f4f7806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:49.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f781584b0 con 0x7f4f780ccb70 2023-07-06T21:43:49.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7814c8e0 con 0x7f4f78070410 2023-07-06T21:43:49.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f7cbc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7806be80 con 0x7f4f780c9b90 2023-07-06T21:43:49.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f76d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f780ccb70 0x7f4f7806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:49.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f76d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f780ccb70 0x7f4f7806b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41048/0 (socket says 172.21.15.55:41048) 2023-07-06T21:43:49.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.605+0000 7f4f76d9d640 1 -- 172.21.15.55:0/923139049 learned_addr learned my addr 172.21.15.55:0/923139049 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:49.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f75d9b640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f780c9b90 0x7f4f7814c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:49.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f7659c640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f78070410 0x7f4f78157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:49.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f76d9d640 1 -- 172.21.15.55:0/923139049 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f780c9b90 msgr2=0x7f4f7814c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:49.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f76d9d640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f780c9b90 0x7f4f7814c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f76d9d640 1 -- 172.21.15.55:0/923139049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f78070410 msgr2=0x7f4f78157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:49.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f76d9d640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f78070410 0x7f4f78157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f76d9d640 1 -- 172.21.15.55:0/923139049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f680094d0 con 0x7f4f780ccb70 2023-07-06T21:43:49.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f7659c640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f78070410 0x7f4f78157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:49.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f76d9d640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f780ccb70 0x7f4f7806b2f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000eed0 tx=0x7f4f7000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:49.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f66ffd640 1 -- 172.21.15.55:0/923139049 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70010040 con 0x7f4f780ccb70 2023-07-06T21:43:49.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f66ffd640 1 -- 172.21.15.55:0/923139049 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7000bd20 con 0x7f4f780ccb70 2023-07-06T21:43:49.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f66ffd640 1 -- 172.21.15.55:0/923139049 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70014640 con 0x7f4f780ccb70 2023-07-06T21:43:49.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/923139049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7806c160 con 0x7f4f780ccb70 2023-07-06T21:43:49.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/923139049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7806b830 con 0x7f4f780ccb70 2023-07-06T21:43:49.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/923139049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f780c94e0 con 0x7f4f780ccb70 2023-07-06T21:43:49.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f66ffd640 1 -- 172.21.15.55:0/923139049 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f4f700147a0 con 0x7f4f780ccb70 2023-07-06T21:43:49.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f66ffd640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f4f58066480 0x7f4f58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:49.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.609+0000 7f4f66ffd640 1 -- 172.21.15.55:0/923139049 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7f4f70084dc0 con 0x7f4f780ccb70 2023-07-06T21:43:49.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.613+0000 7f4f7659c640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f4f58066480 0x7f4f58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.613+0000 7f4f7659c640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f4f58066480 0x7f4f58068930 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4f680ad000 tx=0x7f4f680a6000 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:49.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.617+0000 7f4f66ffd640 1 -- 172.21.15.55:0/923139049 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4f780c94e0 con 0x7f4f780ccb70 2023-07-06T21:43:49.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.789+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/923139049 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f780c8a20 con 0x7f4f58066480 2023-07-06T21:43:49.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.849+0000 7f4f66ffd640 1 -- 172.21.15.55:0/923139049 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f4f680bb0d0 con 0x7f4f58066480 2023-07-06T21:43:49.859 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir7 2023-07-06T21:43:49.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.853+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/923139049 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f4f58066480 msgr2=0x7f4f58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:49.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.853+0000 7f4f7cbc5640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f4f58066480 0x7f4f58068930 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4f680ad000 tx=0x7f4f680a6000 comp rx=0 tx=0).stop 2023-07-06T21:43:49.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.853+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/923139049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f780ccb70 msgr2=0x7f4f7806b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:49.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.853+0000 7f4f7cbc5640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f780ccb70 0x7f4f7806b2f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000eed0 tx=0x7f4f7000b480 comp rx=0 tx=0).stop 2023-07-06T21:43:49.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.853+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/923139049 shutdown_connections 2023-07-06T21:43:49.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.853+0000 7f4f7cbc5640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f4f58066480 0x7f4f58068930 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.853+0000 7f4f7cbc5640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f780ccb70 0x7f4f7806b2f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.853+0000 7f4f7cbc5640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4f780c9b90 0x7f4f7814c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.853+0000 7f4f7cbc5640 1 --2- 172.21.15.55:0/923139049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f78070410 0x7f4f78157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:49.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.853+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/923139049 >> 172.21.15.55:0/923139049 conn(0x7f4f780cde30 msgr2=0x7f4f780af180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:49.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.853+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/923139049 shutdown_connections 2023-07-06T21:43:49.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:49.853+0000 7f4f7cbc5640 1 -- 172.21.15.55:0/923139049 wait complete. 2023-07-06T21:43:49.879 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-07-06T21:43:49.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:49.880 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-07-06T21:43:49.891 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-07-06T21:43:50.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.093+0000 7fd991174640 1 Processor -- start 2023-07-06T21:43:50.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.093+0000 7fd991174640 1 -- start start 2023-07-06T21:43:50.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.093+0000 7fd991174640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd98c0b3c90 0x7fd98c0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:50.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.093+0000 7fd991174640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd98c0b18a0 0x7fd98c0b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:50.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.093+0000 7fd991174640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98c0ccd50 con 0x7fd98c0d1d30 2023-07-06T21:43:50.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.093+0000 7fd991174640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98c0cd0a0 con 0x7fd98c0b3c90 2023-07-06T21:43:50.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.093+0000 7fd991174640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c069ea0 con 0x7fd98c0b18a0 2023-07-06T21:43:50.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.093+0000 7fd98ad9d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd98c0b3c90 0x7fd98c0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:50.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.093+0000 7fd983fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd98c0b18a0 0x7fd98c0b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:50.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.093+0000 7fd98b59e640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fd98c0d1d30 0x7fd98c15f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:43592/0 (socket says 172.21.15.55:43592) 2023-07-06T21:43:50.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.093+0000 7fd98b59e640 1 -- 172.21.15.55:0/2949969854 learned_addr learned my addr 172.21.15.55:0/2949969854 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:50.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.097+0000 7fd98ad9d640 1 -- 172.21.15.55:0/2949969854 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd98c0b18a0 msgr2=0x7fd98c0b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:50.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.097+0000 7fd98ad9d640 1 --2- 172.21.15.55:0/2949969854 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd98c0b18a0 0x7fd98c0b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.097+0000 7fd98ad9d640 1 -- 172.21.15.55:0/2949969854 >> v1:172.21.15.138:6789/0 conn(0x7fd98c0d1d30 legacy=0x7fd98c15f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:50.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.097+0000 7fd98ad9d640 1 -- 172.21.15.55:0/2949969854 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c0b45a0 con 0x7fd98c0b3c90 2023-07-06T21:43:50.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.097+0000 7fd98ad9d640 1 --2- 172.21.15.55:0/2949969854 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd98c0b3c90 0x7fd98c0ce460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0097c0 tx=0x7fd97c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74ee501e3fe48481 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:50.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.097+0000 7fd98a59c640 1 -- 172.21.15.55:0/2949969854 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0ab650 con 0x7fd98c0b3c90 2023-07-06T21:43:50.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.097+0000 7fd98a59c640 1 -- 172.21.15.55:0/2949969854 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c0ab7b0 con 0x7fd98c0b3c90 2023-07-06T21:43:50.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.097+0000 7fd98a59c640 1 -- 172.21.15.55:0/2949969854 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0abb40 con 0x7fd98c0b3c90 2023-07-06T21:43:50.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 -- 172.21.15.55:0/2949969854 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd98c0b3c90 msgr2=0x7fd98c0ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:50.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 --2- 172.21.15.55:0/2949969854 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd98c0b3c90 0x7fd98c0ce460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0097c0 tx=0x7fd97c01c450 comp rx=0 tx=0).stop 2023-07-06T21:43:50.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 -- 172.21.15.55:0/2949969854 shutdown_connections 2023-07-06T21:43:50.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 --2- 172.21.15.55:0/2949969854 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd98c0b18a0 0x7fd98c0b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 --2- 172.21.15.55:0/2949969854 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd98c0b3c90 0x7fd98c0ce460 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 -- 172.21.15.55:0/2949969854 >> 172.21.15.55:0/2949969854 conn(0x7fd98c06bf40 msgr2=0x7fd98c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:50.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 -- 172.21.15.55:0/2949969854 shutdown_connections 2023-07-06T21:43:50.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 -- 172.21.15.55:0/2949969854 wait complete. 2023-07-06T21:43:50.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 Processor -- start 2023-07-06T21:43:50.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 -- start start 2023-07-06T21:43:50.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd98c0b18a0 0x7fd98c0cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:50.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd98c0b3c90 0x7fd98c0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:50.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd98c0d1d30 0x7fd98c0c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:50.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c1540e0 con 0x7fd98c0b3c90 2023-07-06T21:43:50.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0b2be0 con 0x7fd98c0d1d30 2023-07-06T21:43:50.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd991174640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c154330 con 0x7fd98c0b18a0 2023-07-06T21:43:50.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd98ad9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd98c0b18a0 0x7fd98c0cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:50.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd983fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd98c0b3c90 0x7fd98c0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:50.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd98ad9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd98c0b18a0 0x7fd98c0cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:49400/0 (socket says 172.21.15.55:49400) 2023-07-06T21:43:50.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd98ad9d640 1 -- 172.21.15.55:0/1997248404 learned_addr learned my addr 172.21.15.55:0/1997248404 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:50.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.101+0000 7fd98b59e640 1 --2- 172.21.15.55:0/1997248404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd98c0d1d30 0x7fd98c0c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:50.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.105+0000 7fd98ad9d640 1 -- 172.21.15.55:0/1997248404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd98c0d1d30 msgr2=0x7fd98c0c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:50.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.105+0000 7fd98ad9d640 1 --2- 172.21.15.55:0/1997248404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd98c0d1d30 0x7fd98c0c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.105+0000 7fd98ad9d640 1 -- 172.21.15.55:0/1997248404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd98c0b3c90 msgr2=0x7fd98c0c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:50.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.105+0000 7fd98ad9d640 1 --2- 172.21.15.55:0/1997248404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd98c0b3c90 0x7fd98c0c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.105+0000 7fd98ad9d640 1 -- 172.21.15.55:0/1997248404 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c009420 con 0x7fd98c0b18a0 2023-07-06T21:43:50.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.105+0000 7fd98ad9d640 1 --2- 172.21.15.55:0/1997248404 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd98c0b18a0 0x7fd98c0cb6b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0ad040 tx=0x7fd97c01ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:50.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.105+0000 7fd9837fe640 1 -- 172.21.15.55:0/1997248404 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0b5810 con 0x7fd98c0b18a0 2023-07-06T21:43:50.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.105+0000 7fd9837fe640 1 -- 172.21.15.55:0/1997248404 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c0b5990 con 0x7fd98c0b18a0 2023-07-06T21:43:50.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.105+0000 7fd9837fe640 1 -- 172.21.15.55:0/1997248404 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0b5d40 con 0x7fd98c0b18a0 2023-07-06T21:43:50.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.105+0000 7fd991174640 1 -- 172.21.15.55:0/1997248404 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c154610 con 0x7fd98c0b18a0 2023-07-06T21:43:50.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.105+0000 7fd991174640 1 -- 172.21.15.55:0/1997248404 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c0cbdc0 con 0x7fd98c0b18a0 2023-07-06T21:43:50.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.105+0000 7fd991174640 1 -- 172.21.15.55:0/1997248404 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c066d60 con 0x7fd98c0b18a0 2023-07-06T21:43:50.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.109+0000 7fd9837fe640 1 -- 172.21.15.55:0/1997248404 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fd97c0b4390 con 0x7fd98c0b18a0 2023-07-06T21:43:50.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.109+0000 7fd9837fe640 1 --2- 172.21.15.55:0/1997248404 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd96c066480 0x7fd96c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:50.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.109+0000 7fd9837fe640 1 -- 172.21.15.55:0/1997248404 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7fd97c11edb0 con 0x7fd98c0b18a0 2023-07-06T21:43:50.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.109+0000 7fd983fff640 1 --2- 172.21.15.55:0/1997248404 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd96c066480 0x7fd96c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:50.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.109+0000 7fd983fff640 1 --2- 172.21.15.55:0/1997248404 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd96c066480 0x7fd96c068930 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0b7870 tx=0x7fd974009190 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:50.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.117+0000 7fd9837fe640 1 -- 172.21.15.55:0/1997248404 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd97c123070 con 0x7fd98c0b18a0 2023-07-06T21:43:50.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.293+0000 7fd991174640 1 -- 172.21.15.55:0/1997248404 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd98c168880 con 0x7fd96c066480 2023-07-06T21:43:50.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.361+0000 7fd9837fe640 1 -- 172.21.15.55:0/1997248404 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd974011a30 con 0x7fd96c066480 2023-07-06T21:43:50.371 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir8 2023-07-06T21:43:50.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.365+0000 7fd991174640 1 -- 172.21.15.55:0/1997248404 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd96c066480 msgr2=0x7fd96c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:50.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.365+0000 7fd991174640 1 --2- 172.21.15.55:0/1997248404 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd96c066480 0x7fd96c068930 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0b7870 tx=0x7fd974009190 comp rx=0 tx=0).stop 2023-07-06T21:43:50.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.365+0000 7fd991174640 1 -- 172.21.15.55:0/1997248404 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd98c0b18a0 msgr2=0x7fd98c0cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:50.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.365+0000 7fd991174640 1 --2- 172.21.15.55:0/1997248404 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd98c0b18a0 0x7fd98c0cb6b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0ad040 tx=0x7fd97c01ac90 comp rx=0 tx=0).stop 2023-07-06T21:43:50.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.365+0000 7fd991174640 1 -- 172.21.15.55:0/1997248404 shutdown_connections 2023-07-06T21:43:50.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.365+0000 7fd991174640 1 --2- 172.21.15.55:0/1997248404 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd96c066480 0x7fd96c068930 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.365+0000 7fd991174640 1 --2- 172.21.15.55:0/1997248404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd98c0d1d30 0x7fd98c0c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.365+0000 7fd991174640 1 --2- 172.21.15.55:0/1997248404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd98c0b3c90 0x7fd98c0c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.365+0000 7fd991174640 1 --2- 172.21.15.55:0/1997248404 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd98c0b18a0 0x7fd98c0cb6b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.365+0000 7fd991174640 1 -- 172.21.15.55:0/1997248404 >> 172.21.15.55:0/1997248404 conn(0x7fd98c06bf40 msgr2=0x7fd98c0d2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:50.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.365+0000 7fd991174640 1 -- 172.21.15.55:0/1997248404 shutdown_connections 2023-07-06T21:43:50.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.365+0000 7fd991174640 1 -- 172.21.15.55:0/1997248404 wait complete. 2023-07-06T21:43:50.392 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-07-06T21:43:50.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:43:50.393 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-07-06T21:43:50.404 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-07-06T21:43:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f3866703640 1 Processor -- start 2023-07-06T21:43:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f3866703640 1 -- start start 2023-07-06T21:43:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f3866703640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38600c9b90 0x7f386015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f3866703640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f38600ccb70 0x7f38600c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f3866703640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38600b3e70 con 0x7f3860070410 2023-07-06T21:43:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f3866703640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3860159c30 con 0x7f38600c9b90 2023-07-06T21:43:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f3866703640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38600c9070 con 0x7f38600ccb70 2023-07-06T21:43:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f385ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38600c9b90 0x7f386015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:50.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f385ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38600c9b90 0x7f386015dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41066/0 (socket says 172.21.15.55:41066) 2023-07-06T21:43:50.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f385ffff640 1 -- 172.21.15.55:0/4232382999 learned_addr learned my addr 172.21.15.55:0/4232382999 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:50.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f385f7fe640 1 --2- 172.21.15.55:0/4232382999 >> v2:172.21.15.138:3300/0 conn(0x7f38600ccb70 0x7f38600c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:50.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f385f7fe640 1 -- 172.21.15.55:0/4232382999 >> v2:172.21.15.55:3300/0 conn(0x7f38600c9b90 msgr2=0x7f386015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:50.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f385f7fe640 1 --2- 172.21.15.55:0/4232382999 >> v2:172.21.15.55:3300/0 conn(0x7f38600c9b90 0x7f386015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f385f7fe640 1 -- 172.21.15.55:0/4232382999 >> v1:172.21.15.55:6789/0 conn(0x7f3860070410 legacy=0x7f3860070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:50.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f385f7fe640 1 -- 172.21.15.55:0/4232382999 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386006a400 con 0x7f38600ccb70 2023-07-06T21:43:50.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.589+0000 7f385ffff640 1 --2- 172.21.15.55:0/4232382999 >> v2:172.21.15.55:3300/0 conn(0x7f38600c9b90 0x7f386015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:50.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.593+0000 7f385f7fe640 1 --2- 172.21.15.55:0/4232382999 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38600ccb70 0x7f38600c9f60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38600ccb00 tx=0x7f385401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2425aa71391bc00a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.593+0000 7f385effd640 1 -- 172.21.15.55:0/4232382999 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38540ab600 con 0x7f38600ccb70 2023-07-06T21:43:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.593+0000 7f385effd640 1 -- 172.21.15.55:0/4232382999 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38540a7050 con 0x7f38600ccb70 2023-07-06T21:43:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.593+0000 7f385effd640 1 -- 172.21.15.55:0/4232382999 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38540ab980 con 0x7f38600ccb70 2023-07-06T21:43:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.593+0000 7f3866703640 1 -- 172.21.15.55:0/4232382999 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38600ccb70 msgr2=0x7f38600c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.593+0000 7f3866703640 1 --2- 172.21.15.55:0/4232382999 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38600ccb70 0x7f38600c9f60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38600ccb00 tx=0x7f385401c460 comp rx=0 tx=0).stop 2023-07-06T21:43:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.593+0000 7f3866703640 1 -- 172.21.15.55:0/4232382999 shutdown_connections 2023-07-06T21:43:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.593+0000 7f3866703640 1 --2- 172.21.15.55:0/4232382999 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38600ccb70 0x7f38600c9f60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.593+0000 7f3866703640 1 --2- 172.21.15.55:0/4232382999 >> v2:172.21.15.55:3300/0 conn(0x7f38600c9b90 0x7f386015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.593+0000 7f3866703640 1 -- 172.21.15.55:0/4232382999 >> 172.21.15.55:0/4232382999 conn(0x7f38600cde30 msgr2=0x7f38600ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.593+0000 7f3866703640 1 -- 172.21.15.55:0/4232382999 shutdown_connections 2023-07-06T21:43:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.593+0000 7f3866703640 1 -- 172.21.15.55:0/4232382999 wait complete. 2023-07-06T21:43:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f3866703640 1 Processor -- start 2023-07-06T21:43:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f3866703640 1 -- start start 2023-07-06T21:43:50.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f3866703640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3860070410 0x7f386014f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f3866703640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38600c9b90 0x7f386014e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f3866703640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38600ccb70 0x7f3860153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f3866703640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386006d0a0 con 0x7f38600c9b90 2023-07-06T21:43:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f3866703640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386006c490 con 0x7f38600ccb70 2023-07-06T21:43:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f3866703640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386006c770 con 0x7f3860070410 2023-07-06T21:43:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f385f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38600c9b90 0x7f386014e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f385f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38600c9b90 0x7f386014e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41068/0 (socket says 172.21.15.55:41068) 2023-07-06T21:43:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f385f7fe640 1 -- 172.21.15.55:0/120158599 learned_addr learned my addr 172.21.15.55:0/120158599 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f385ffff640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3860070410 0x7f386014f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f3864ca0640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38600ccb70 0x7f3860153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f385f7fe640 1 -- 172.21.15.55:0/120158599 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3860070410 msgr2=0x7f386014f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f385f7fe640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3860070410 0x7f386014f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f385f7fe640 1 -- 172.21.15.55:0/120158599 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38600ccb70 msgr2=0x7f3860153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f385f7fe640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38600ccb70 0x7f3860153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f385f7fe640 1 -- 172.21.15.55:0/120158599 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38500094d0 con 0x7f38600c9b90 2023-07-06T21:43:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f385ffff640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3860070410 0x7f386014f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f3864ca0640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38600ccb70 0x7f3860153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f385f7fe640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38600c9b90 0x7f386014e530 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f38540ae040 tx=0x7f3854019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f385cff9640 1 -- 172.21.15.55:0/120158599 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38540b4840 con 0x7f38600c9b90 2023-07-06T21:43:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f385cff9640 1 -- 172.21.15.55:0/120158599 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38540b49c0 con 0x7f38600c9b90 2023-07-06T21:43:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f385cff9640 1 -- 172.21.15.55:0/120158599 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38540b4d70 con 0x7f38600c9b90 2023-07-06T21:43:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f3866703640 1 -- 172.21.15.55:0/120158599 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3854009420 con 0x7f38600c9b90 2023-07-06T21:43:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f3866703640 1 -- 172.21.15.55:0/120158599 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386006cd30 con 0x7f38600c9b90 2023-07-06T21:43:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.597+0000 7f3866703640 1 -- 172.21.15.55:0/120158599 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386006d210 con 0x7f38600c9b90 2023-07-06T21:43:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.601+0000 7f385cff9640 1 -- 172.21.15.55:0/120158599 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f38540b2040 con 0x7f38600c9b90 2023-07-06T21:43:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.601+0000 7f385cff9640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f384c0664b0 0x7f384c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.601+0000 7f385cff9640 1 -- 172.21.15.55:0/120158599 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7f385411e5e0 con 0x7f38600c9b90 2023-07-06T21:43:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.601+0000 7f385ffff640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f384c0664b0 0x7f384c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.601+0000 7f385ffff640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f384c0664b0 0x7f384c068960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f386006b4c0 tx=0x7f3850009240 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:50.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.605+0000 7f385cff9640 1 -- 172.21.15.55:0/120158599 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38540eb550 con 0x7f38600c9b90 2023-07-06T21:43:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.781+0000 7f3866703640 1 -- 172.21.15.55:0/120158599 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3860150730 con 0x7f384c0664b0 2023-07-06T21:43:50.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.849+0000 7f385cff9640 1 -- 172.21.15.55:0/120158599 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f3860150730 con 0x7f384c0664b0 2023-07-06T21:43:50.857 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir9 2023-07-06T21:43:50.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.849+0000 7f3866703640 1 -- 172.21.15.55:0/120158599 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f384c0664b0 msgr2=0x7f384c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:50.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.849+0000 7f3866703640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f384c0664b0 0x7f384c068960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f386006b4c0 tx=0x7f3850009240 comp rx=0 tx=0).stop 2023-07-06T21:43:50.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.849+0000 7f3866703640 1 -- 172.21.15.55:0/120158599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38600c9b90 msgr2=0x7f386014e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:50.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.849+0000 7f3866703640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38600c9b90 0x7f386014e530 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f38540ae040 tx=0x7f3854019200 comp rx=0 tx=0).stop 2023-07-06T21:43:50.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.849+0000 7f3866703640 1 -- 172.21.15.55:0/120158599 shutdown_connections 2023-07-06T21:43:50.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.849+0000 7f3866703640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f384c0664b0 0x7f384c068960 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.849+0000 7f3866703640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38600ccb70 0x7f3860153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.849+0000 7f3866703640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38600c9b90 0x7f386014e530 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.849+0000 7f3866703640 1 --2- 172.21.15.55:0/120158599 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3860070410 0x7f386014f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:50.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.849+0000 7f3866703640 1 -- 172.21.15.55:0/120158599 >> 172.21.15.55:0/120158599 conn(0x7f38600cde30 msgr2=0x7f38601635e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:50.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.849+0000 7f3866703640 1 -- 172.21.15.55:0/120158599 shutdown_connections 2023-07-06T21:43:50.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:50.849+0000 7f3866703640 1 -- 172.21.15.55:0/120158599 wait complete. 2023-07-06T21:43:50.879 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-07-06T21:43:50.880 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-07-06T21:43:51.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e92e26640 1 Processor -- start 2023-07-06T21:43:51.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e92e26640 1 -- start start 2023-07-06T21:43:51.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e92e26640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6e8c15b930 0x7f6e8c0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e92e26640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c0ce790 0x7f6e8c0ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e92e26640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c0b5880 con 0x7f6e8c0cc2e0 2023-07-06T21:43:51.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e92e26640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c0b5b60 con 0x7f6e8c15b930 2023-07-06T21:43:51.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e92e26640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0cdcb0 con 0x7f6e8c0ce790 2023-07-06T21:43:51.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6e8c0cc2e0 0x7f6e8c0ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34936/0 (socket says 172.21.15.55:34936) 2023-07-06T21:43:51.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8bfff640 1 -- 172.21.15.55:0/2775322118 learned_addr learned my addr 172.21.15.55:0/2775322118 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:51.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e913c3640 1 --2- 172.21.15.55:0/2775322118 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c0ce790 0x7f6e8c0ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e90bc2640 1 --2- 172.21.15.55:0/2775322118 >> v2:172.21.15.138:3300/0 conn(0x7f6e8c15b930 0x7f6e8c0cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 -- 172.21.15.55:0/2775322118 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320392161 0 0) 0x7f6e8c0b5880 con 0x7f6e8c0cc2e0 2023-07-06T21:43:51.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 -- 172.21.15.55:0/2775322118 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e7c003530 con 0x7f6e8c0cc2e0 2023-07-06T21:43:51.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 -- 172.21.15.55:0/2775322118 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2351814258 0 0) 0x7f6e7c003530 con 0x7f6e8c0cc2e0 2023-07-06T21:43:51.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 -- 172.21.15.55:0/2775322118 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c0ce790 msgr2=0x7f6e8c0ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:51.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 --2- 172.21.15.55:0/2775322118 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c0ce790 0x7f6e8c0ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 -- 172.21.15.55:0/2775322118 >> v2:172.21.15.138:3300/0 conn(0x7f6e8c15b930 msgr2=0x7f6e8c0cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 --2- 172.21.15.55:0/2775322118 >> v2:172.21.15.138:3300/0 conn(0x7f6e8c15b930 0x7f6e8c0cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 -- 172.21.15.55:0/2775322118 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c0cdf90 con 0x7f6e8c0cc2e0 2023-07-06T21:43:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 -- 172.21.15.55:0/2775322118 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f6e78001680 con 0x7f6e8c0cc2e0 2023-07-06T21:43:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 -- 172.21.15.55:0/2775322118 >> v1:172.21.15.55:6789/0 conn(0x7f6e8c0cc2e0 legacy=0x7f6e8c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 --2- 172.21.15.55:0/2775322118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c003980 0x7f6e7c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 --2- 172.21.15.55:0/2775322118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e7c0043b0 0x7f6e7c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 --2- 172.21.15.55:0/2775322118 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c0ce790 0x7f6e7c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 -- 172.21.15.55:0/2775322118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0b5b60 con 0x7f6e7c003980 2023-07-06T21:43:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 -- 172.21.15.55:0/2775322118 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0cdcb0 con 0x7f6e7c0043b0 2023-07-06T21:43:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8b7fe640 1 -- 172.21.15.55:0/2775322118 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c00b990 con 0x7f6e8c0ce790 2023-07-06T21:43:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e90bc2640 1 --2- 172.21.15.55:0/2775322118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c003980 0x7f6e7c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e913c3640 1 --2- 172.21.15.55:0/2775322118 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c0ce790 0x7f6e7c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.021+0000 7f6e8bfff640 1 --2- 172.21.15.55:0/2775322118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e7c0043b0 0x7f6e7c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e90bc2640 1 -- 172.21.15.55:0/2775322118 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c0ce790 msgr2=0x7f6e7c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e90bc2640 1 --2- 172.21.15.55:0/2775322118 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c0ce790 0x7f6e7c004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e90bc2640 1 -- 172.21.15.55:0/2775322118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e7c0043b0 msgr2=0x7f6e7c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e90bc2640 1 --2- 172.21.15.55:0/2775322118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e7c0043b0 0x7f6e7c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e90bc2640 1 -- 172.21.15.55:0/2775322118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c003530 con 0x7f6e7c003980 2023-07-06T21:43:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e8bfff640 1 --2- 172.21.15.55:0/2775322118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e7c0043b0 0x7f6e7c004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:51.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e90bc2640 1 --2- 172.21.15.55:0/2775322118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c003980 0x7f6e7c003d90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009ae0 tx=0x7f6e8001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba11aff8d644300 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:51.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e8b7fe640 1 -- 172.21.15.55:0/2775322118 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800a5650 con 0x7f6e7c003980 2023-07-06T21:43:51.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e8b7fe640 1 -- 172.21.15.55:0/2775322118 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e800a57b0 con 0x7f6e7c003980 2023-07-06T21:43:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e8b7fe640 1 -- 172.21.15.55:0/2775322118 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800a5b60 con 0x7f6e7c003980 2023-07-06T21:43:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e92e26640 1 -- 172.21.15.55:0/2775322118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c003980 msgr2=0x7f6e7c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e92e26640 1 --2- 172.21.15.55:0/2775322118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c003980 0x7f6e7c003d90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009ae0 tx=0x7f6e8001ca60 comp rx=0 tx=0).stop 2023-07-06T21:43:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e913c3640 1 -- 172.21.15.55:0/2775322118 reap_dead start 2023-07-06T21:43:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e92e26640 1 -- 172.21.15.55:0/2775322118 shutdown_connections 2023-07-06T21:43:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e92e26640 1 -- 172.21.15.55:0/2775322118 >> 172.21.15.55:0/2775322118 conn(0x7f6e8c0d0c60 msgr2=0x7f6e8c0b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e92e26640 1 -- 172.21.15.55:0/2775322118 shutdown_connections 2023-07-06T21:43:51.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.025+0000 7f6e92e26640 1 -- 172.21.15.55:0/2775322118 wait complete. 2023-07-06T21:43:51.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e92e26640 1 Processor -- start 2023-07-06T21:43:51.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e92e26640 1 -- start start 2023-07-06T21:43:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e92e26640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e7c003980 0x7f6e8c0c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e92e26640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c1527e0 0x7f6e8c15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e92e26640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c13d360 0x7f6e8c13d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e92e26640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0ca0b0 con 0x7f6e8c1527e0 2023-07-06T21:43:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e92e26640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0c94a0 con 0x7f6e8c13d360 2023-07-06T21:43:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e92e26640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0c9780 con 0x7f6e7c003980 2023-07-06T21:43:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e8bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c1527e0 0x7f6e8c15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e90bc2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e7c003980 0x7f6e8c0c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e90bc2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e7c003980 0x7f6e8c0c8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:49432/0 (socket says 172.21.15.55:49432) 2023-07-06T21:43:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e90bc2640 1 -- 172.21.15.55:0/1439277583 learned_addr learned my addr 172.21.15.55:0/1439277583 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e913c3640 1 --2- 172.21.15.55:0/1439277583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c13d360 0x7f6e8c13d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e90bc2640 1 -- 172.21.15.55:0/1439277583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c13d360 msgr2=0x7f6e8c13d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e90bc2640 1 --2- 172.21.15.55:0/1439277583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c13d360 0x7f6e8c13d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e90bc2640 1 -- 172.21.15.55:0/1439277583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c1527e0 msgr2=0x7f6e8c15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e90bc2640 1 --2- 172.21.15.55:0/1439277583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c1527e0 0x7f6e8c15d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e90bc2640 1 -- 172.21.15.55:0/1439277583 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c0c9a60 con 0x7f6e7c003980 2023-07-06T21:43:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.029+0000 7f6e90bc2640 1 --2- 172.21.15.55:0/1439277583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e7c003980 0x7f6e8c0c8e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009ae0 tx=0x7f6e7c005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.033+0000 7f6e897fa640 1 -- 172.21.15.55:0/1439277583 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80004020 con 0x7f6e7c003980 2023-07-06T21:43:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.033+0000 7f6e897fa640 1 -- 172.21.15.55:0/1439277583 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e80004180 con 0x7f6e7c003980 2023-07-06T21:43:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.033+0000 7f6e897fa640 1 -- 172.21.15.55:0/1439277583 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800044f0 con 0x7f6e7c003980 2023-07-06T21:43:51.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.033+0000 7f6e92e26640 1 -- 172.21.15.55:0/1439277583 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c0c9d40 con 0x7f6e7c003980 2023-07-06T21:43:51.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.033+0000 7f6e92e26640 1 -- 172.21.15.55:0/1439277583 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c15de10 con 0x7f6e7c003980 2023-07-06T21:43:51.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.033+0000 7f6e92e26640 1 -- 172.21.15.55:0/1439277583 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c15e000 con 0x7f6e7c003980 2023-07-06T21:43:51.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.033+0000 7f6e897fa640 1 -- 172.21.15.55:0/1439277583 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f6e800b4040 con 0x7f6e7c003980 2023-07-06T21:43:51.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.033+0000 7f6e897fa640 1 --2- 172.21.15.55:0/1439277583 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f6e700664b0 0x7f6e70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.033+0000 7f6e897fa640 1 -- 172.21.15.55:0/1439277583 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7f6e8011e970 con 0x7f6e7c003980 2023-07-06T21:43:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.033+0000 7f6e8bfff640 1 --2- 172.21.15.55:0/1439277583 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f6e700664b0 0x7f6e70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.033+0000 7f6e8bfff640 1 --2- 172.21.15.55:0/1439277583 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f6e700664b0 0x7f6e70068960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c1f7ea0 tx=0x7f6e78007040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.037+0000 7f6e897fa640 1 -- 172.21.15.55:0/1439277583 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6e800ebb20 con 0x7f6e7c003980 2023-07-06T21:43:51.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.213+0000 7f6e92e26640 1 -- 172.21.15.55:0/1439277583 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e8c152e20 con 0x7f6e700664b0 2023-07-06T21:43:51.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.269+0000 7f6e897fa640 1 -- 172.21.15.55:0/1439277583 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6e78011a20 con 0x7f6e700664b0 2023-07-06T21:43:51.276 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-07-06T21:43:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.269+0000 7f6e92e26640 1 -- 172.21.15.55:0/1439277583 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f6e700664b0 msgr2=0x7f6e70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.269+0000 7f6e92e26640 1 --2- 172.21.15.55:0/1439277583 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f6e700664b0 0x7f6e70068960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c1f7ea0 tx=0x7f6e78007040 comp rx=0 tx=0).stop 2023-07-06T21:43:51.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.269+0000 7f6e92e26640 1 -- 172.21.15.55:0/1439277583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e7c003980 msgr2=0x7f6e8c0c8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.269+0000 7f6e92e26640 1 --2- 172.21.15.55:0/1439277583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e7c003980 0x7f6e8c0c8e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009ae0 tx=0x7f6e7c005800 comp rx=0 tx=0).stop 2023-07-06T21:43:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.269+0000 7f6e92e26640 1 -- 172.21.15.55:0/1439277583 shutdown_connections 2023-07-06T21:43:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.269+0000 7f6e92e26640 1 --2- 172.21.15.55:0/1439277583 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f6e700664b0 0x7f6e70068960 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.269+0000 7f6e92e26640 1 --2- 172.21.15.55:0/1439277583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c13d360 0x7f6e8c13d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.269+0000 7f6e92e26640 1 --2- 172.21.15.55:0/1439277583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c1527e0 0x7f6e8c15d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.269+0000 7f6e92e26640 1 --2- 172.21.15.55:0/1439277583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e7c003980 0x7f6e8c0c8e30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.269+0000 7f6e92e26640 1 -- 172.21.15.55:0/1439277583 >> 172.21.15.55:0/1439277583 conn(0x7f6e8c0d0c60 msgr2=0x7f6e8c156f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:51.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.269+0000 7f6e92e26640 1 -- 172.21.15.55:0/1439277583 shutdown_connections 2023-07-06T21:43:51.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.269+0000 7f6e92e26640 1 -- 172.21.15.55:0/1439277583 wait complete. 2023-07-06T21:43:51.297 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-07-06T21:43:51.298 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-07-06T21:43:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.437+0000 7fd25af40640 1 Processor -- start 2023-07-06T21:43:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.437+0000 7fd25af40640 1 -- start start 2023-07-06T21:43:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd25af40640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2540c9b90 0x7fd25415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd25af40640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd2540693f0 0x7fd254069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd25af40640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2540b3e70 con 0x7fd2540ccb70 2023-07-06T21:43:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd25af40640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd254159c30 con 0x7fd2540693f0 2023-07-06T21:43:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd25af40640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2540c9070 con 0x7fd2540c9b90 2023-07-06T21:43:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd253fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd2540ccb70 0x7fd2540c9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34944/0 (socket says 172.21.15.55:34944) 2023-07-06T21:43:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd253fff640 1 -- 172.21.15.55:0/4195366784 learned_addr learned my addr 172.21.15.55:0/4195366784 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd258cdc640 1 --2- 172.21.15.55:0/4195366784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2540c9b90 0x7fd25415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd2594dd640 1 --2- 172.21.15.55:0/4195366784 >> v2:172.21.15.138:3300/0 conn(0x7fd2540693f0 0x7fd254069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd2537fe640 1 -- 172.21.15.55:0/4195366784 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606577798 0 0) 0x7fd240001120 con 0x7fd2540ccb70 2023-07-06T21:43:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd2537fe640 1 -- 172.21.15.55:0/4195366784 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd244003530 con 0x7fd2540ccb70 2023-07-06T21:43:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd258cdc640 1 -- 172.21.15.55:0/4195366784 >> v2:172.21.15.138:3300/0 conn(0x7fd2540693f0 msgr2=0x7fd254069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd258cdc640 1 --2- 172.21.15.55:0/4195366784 >> v2:172.21.15.138:3300/0 conn(0x7fd2540693f0 0x7fd254069870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd258cdc640 1 -- 172.21.15.55:0/4195366784 >> v1:172.21.15.55:6789/0 conn(0x7fd2540ccb70 legacy=0x7fd2540c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd258cdc640 1 -- 172.21.15.55:0/4195366784 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2540c8480 con 0x7fd2540c9b90 2023-07-06T21:43:51.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.441+0000 7fd2594dd640 1 --2- 172.21.15.55:0/4195366784 >> v2:172.21.15.138:3300/0 conn(0x7fd2540693f0 0x7fd254069870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:51.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.445+0000 7fd258cdc640 1 --2- 172.21.15.55:0/4195366784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2540c9b90 0x7fd25415dd50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd2480097c0 tx=0x7fd24801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1761df305780af28 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:51.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.445+0000 7fd2537fe640 1 -- 172.21.15.55:0/4195366784 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2480ab600 con 0x7fd2540c9b90 2023-07-06T21:43:51.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.445+0000 7fd2537fe640 1 -- 172.21.15.55:0/4195366784 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2480a7050 con 0x7fd2540c9b90 2023-07-06T21:43:51.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.445+0000 7fd2537fe640 1 -- 172.21.15.55:0/4195366784 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2480ab980 con 0x7fd2540c9b90 2023-07-06T21:43:51.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.445+0000 7fd25af40640 1 -- 172.21.15.55:0/4195366784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2540c9b90 msgr2=0x7fd25415dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.445+0000 7fd25af40640 1 --2- 172.21.15.55:0/4195366784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2540c9b90 0x7fd25415dd50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd2480097c0 tx=0x7fd24801c460 comp rx=0 tx=0).stop 2023-07-06T21:43:51.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.445+0000 7fd25af40640 1 -- 172.21.15.55:0/4195366784 shutdown_connections 2023-07-06T21:43:51.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.445+0000 7fd25af40640 1 --2- 172.21.15.55:0/4195366784 >> v2:172.21.15.138:3300/0 conn(0x7fd2540693f0 0x7fd254069870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.445+0000 7fd25af40640 1 --2- 172.21.15.55:0/4195366784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2540c9b90 0x7fd25415dd50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.445+0000 7fd25af40640 1 -- 172.21.15.55:0/4195366784 >> 172.21.15.55:0/4195366784 conn(0x7fd2540cde30 msgr2=0x7fd2540ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:51.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.445+0000 7fd25af40640 1 -- 172.21.15.55:0/4195366784 shutdown_connections 2023-07-06T21:43:51.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.445+0000 7fd25af40640 1 -- 172.21.15.55:0/4195366784 wait complete. 2023-07-06T21:43:51.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.445+0000 7fd25af40640 1 Processor -- start 2023-07-06T21:43:51.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.445+0000 7fd25af40640 1 -- start start 2023-07-06T21:43:51.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd25af40640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2540693f0 0x7fd25406b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd25af40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2540c9b90 0x7fd2540c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd25af40640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2540ccb70 0x7fd25406cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd25af40640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2540c7dc0 con 0x7fd2540c9b90 2023-07-06T21:43:51.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd25af40640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25406c790 con 0x7fd2540ccb70 2023-07-06T21:43:51.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd25af40640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25406bb80 con 0x7fd2540693f0 2023-07-06T21:43:51.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd253fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2540c9b90 0x7fd2540c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd258cdc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2540693f0 0x7fd25406b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd253fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2540c9b90 0x7fd2540c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41086/0 (socket says 172.21.15.55:41086) 2023-07-06T21:43:51.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd253fff640 1 -- 172.21.15.55:0/4283386247 learned_addr learned my addr 172.21.15.55:0/4283386247 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:51.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd2594dd640 1 --2- 172.21.15.55:0/4283386247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2540ccb70 0x7fd25406cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd253fff640 1 -- 172.21.15.55:0/4283386247 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2540693f0 msgr2=0x7fd25406b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd253fff640 1 --2- 172.21.15.55:0/4283386247 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2540693f0 0x7fd25406b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd253fff640 1 -- 172.21.15.55:0/4283386247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2540ccb70 msgr2=0x7fd25406cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd253fff640 1 --2- 172.21.15.55:0/4283386247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2540ccb70 0x7fd25406cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd253fff640 1 -- 172.21.15.55:0/4283386247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c009a70 con 0x7fd2540c9b90 2023-07-06T21:43:51.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd253fff640 1 --2- 172.21.15.55:0/4283386247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2540c9b90 0x7fd2540c7880 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd24000c4d0 tx=0x7fd24000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:51.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd2517fa640 1 -- 172.21.15.55:0/4283386247 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240005cf0 con 0x7fd2540c9b90 2023-07-06T21:43:51.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd2517fa640 1 -- 172.21.15.55:0/4283386247 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240005e50 con 0x7fd2540c9b90 2023-07-06T21:43:51.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd2517fa640 1 -- 172.21.15.55:0/4283386247 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400072d0 con 0x7fd2540c9b90 2023-07-06T21:43:51.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd25af40640 1 -- 172.21.15.55:0/4283386247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd248009420 con 0x7fd2540c9b90 2023-07-06T21:43:51.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd25af40640 1 -- 172.21.15.55:0/4283386247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25406c140 con 0x7fd2540c9b90 2023-07-06T21:43:51.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.449+0000 7fd25af40640 1 -- 172.21.15.55:0/4283386247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2540c94e0 con 0x7fd2540c9b90 2023-07-06T21:43:51.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.453+0000 7fd2517fa640 1 -- 172.21.15.55:0/4283386247 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fd240007430 con 0x7fd2540c9b90 2023-07-06T21:43:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.453+0000 7fd2517fa640 1 --2- 172.21.15.55:0/4283386247 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd238066480 0x7fd238068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.453+0000 7fd2517fa640 1 -- 172.21.15.55:0/4283386247 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7fd2400836a0 con 0x7fd2540c9b90 2023-07-06T21:43:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.453+0000 7fd258cdc640 1 --2- 172.21.15.55:0/4283386247 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd238066480 0x7fd238068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.453+0000 7fd258cdc640 1 --2- 172.21.15.55:0/4283386247 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd238066480 0x7fd238068930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd2480ad000 tx=0x7fd2480a6000 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.457+0000 7fd2517fa640 1 -- 172.21.15.55:0/4283386247 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2540c94e0 con 0x7fd2540c9b90 2023-07-06T21:43:51.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.629+0000 7fd25af40640 1 -- 172.21.15.55:0/4283386247 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2540c8d00 con 0x7fd238066480 2023-07-06T21:43:51.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.677+0000 7fd2517fa640 1 -- 172.21.15.55:0/4283386247 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd2480ab500 con 0x7fd238066480 2023-07-06T21:43:51.684 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-07-06T21:43:51.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.677+0000 7fd25af40640 1 -- 172.21.15.55:0/4283386247 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd238066480 msgr2=0x7fd238068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.677+0000 7fd25af40640 1 --2- 172.21.15.55:0/4283386247 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd238066480 0x7fd238068930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd2480ad000 tx=0x7fd2480a6000 comp rx=0 tx=0).stop 2023-07-06T21:43:51.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.677+0000 7fd25af40640 1 -- 172.21.15.55:0/4283386247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2540c9b90 msgr2=0x7fd2540c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.677+0000 7fd25af40640 1 --2- 172.21.15.55:0/4283386247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2540c9b90 0x7fd2540c7880 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd24000c4d0 tx=0x7fd24000c8d0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.677+0000 7fd25af40640 1 -- 172.21.15.55:0/4283386247 shutdown_connections 2023-07-06T21:43:51.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.677+0000 7fd25af40640 1 --2- 172.21.15.55:0/4283386247 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd238066480 0x7fd238068930 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.677+0000 7fd25af40640 1 --2- 172.21.15.55:0/4283386247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2540ccb70 0x7fd25406cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.677+0000 7fd25af40640 1 --2- 172.21.15.55:0/4283386247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2540c9b90 0x7fd2540c7880 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.677+0000 7fd25af40640 1 --2- 172.21.15.55:0/4283386247 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2540693f0 0x7fd25406b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.677+0000 7fd25af40640 1 -- 172.21.15.55:0/4283386247 >> 172.21.15.55:0/4283386247 conn(0x7fd2540cde30 msgr2=0x7fd2540b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:51.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.677+0000 7fd25af40640 1 -- 172.21.15.55:0/4283386247 shutdown_connections 2023-07-06T21:43:51.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.677+0000 7fd25af40640 1 -- 172.21.15.55:0/4283386247 wait complete. 2023-07-06T21:43:51.705 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-07-06T21:43:51.706 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-07-06T21:43:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa6559c5640 1 Processor -- start 2023-07-06T21:43:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa6559c5640 1 -- start start 2023-07-06T21:43:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa6559c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6500c8910 0x7fa650158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa6559c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6500cd3e0 0x7fa6500cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa6559c5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa650159350 con 0x7fa6501588a0 2023-07-06T21:43:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa6559c5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6500ccf50 con 0x7fa6500cd3e0 2023-07-06T21:43:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa6559c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa650158d90 con 0x7fa6500c8910 2023-07-06T21:43:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa647fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6500cd3e0 0x7fa6500cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa647fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6500cd3e0 0x7fa6500cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41092/0 (socket says 172.21.15.55:41092) 2023-07-06T21:43:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa647fff640 1 -- 172.21.15.55:0/1122520250 learned_addr learned my addr 172.21.15.55:0/1122520250 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa64effd640 1 --2- 172.21.15.55:0/1122520250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6500c8910 0x7fa650158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa647fff640 1 -- 172.21.15.55:0/1122520250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6500c8910 msgr2=0x7fa650158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa647fff640 1 --2- 172.21.15.55:0/1122520250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6500c8910 0x7fa650158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa647fff640 1 -- 172.21.15.55:0/1122520250 >> v1:172.21.15.55:6789/0 conn(0x7fa6501588a0 legacy=0x7fa65006bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.849+0000 7fa647fff640 1 -- 172.21.15.55:0/1122520250 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa650159070 con 0x7fa6500cd3e0 2023-07-06T21:43:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.853+0000 7fa647fff640 1 --2- 172.21.15.55:0/1122520250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6500cd3e0 0x7fa6500cbc10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa638006fd0 tx=0x7fa63801e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2ab208bd75e666 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.853+0000 7fa64e7fc640 1 -- 172.21.15.55:0/1122520250 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638004230 con 0x7fa6500cd3e0 2023-07-06T21:43:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.853+0000 7fa64e7fc640 1 -- 172.21.15.55:0/1122520250 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6380ab070 con 0x7fa6500cd3e0 2023-07-06T21:43:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.853+0000 7fa64e7fc640 1 -- 172.21.15.55:0/1122520250 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6380a7800 con 0x7fa6500cd3e0 2023-07-06T21:43:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.853+0000 7fa6559c5640 1 -- 172.21.15.55:0/1122520250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6500cd3e0 msgr2=0x7fa6500cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.853+0000 7fa6559c5640 1 --2- 172.21.15.55:0/1122520250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6500cd3e0 0x7fa6500cbc10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa638006fd0 tx=0x7fa63801e910 comp rx=0 tx=0).stop 2023-07-06T21:43:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.853+0000 7fa6559c5640 1 -- 172.21.15.55:0/1122520250 shutdown_connections 2023-07-06T21:43:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.853+0000 7fa6559c5640 1 --2- 172.21.15.55:0/1122520250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6500cd3e0 0x7fa6500cbc10 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.853+0000 7fa6559c5640 1 --2- 172.21.15.55:0/1122520250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6500c8910 0x7fa650158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.853+0000 7fa6559c5640 1 -- 172.21.15.55:0/1122520250 >> 172.21.15.55:0/1122520250 conn(0x7fa6500cde30 msgr2=0x7fa6500ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.853+0000 7fa6559c5640 1 -- 172.21.15.55:0/1122520250 shutdown_connections 2023-07-06T21:43:51.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.853+0000 7fa6559c5640 1 -- 172.21.15.55:0/1122520250 wait complete. 2023-07-06T21:43:51.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.853+0000 7fa6559c5640 1 Processor -- start 2023-07-06T21:43:51.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.853+0000 7fa6559c5640 1 -- start start 2023-07-06T21:43:51.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa6559c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6500c8910 0x7fa6500b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa6559c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6501588a0 0x7fa6500b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa6559c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa650151390 0x7fa6500c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa6559c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500b32f0 con 0x7fa6500c8910 2023-07-06T21:43:51.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa6559c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500b2920 con 0x7fa6501588a0 2023-07-06T21:43:51.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa6559c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa650151830 con 0x7fa650151390 2023-07-06T21:43:51.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa64effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6500c8910 0x7fa6500b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa64effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6500c8910 0x7fa6500b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41100/0 (socket says 172.21.15.55:41100) 2023-07-06T21:43:51.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa64effd640 1 -- 172.21.15.55:0/3469573434 learned_addr learned my addr 172.21.15.55:0/3469573434 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:51.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa64f7fe640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa650151390 0x7fa6500c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa647fff640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6501588a0 0x7fa6500b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa64effd640 1 -- 172.21.15.55:0/3469573434 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa650151390 msgr2=0x7fa6500c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa64effd640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa650151390 0x7fa6500c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa64effd640 1 -- 172.21.15.55:0/3469573434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6501588a0 msgr2=0x7fa6500b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:51.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa64effd640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6501588a0 0x7fa6500b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:51.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa64effd640 1 -- 172.21.15.55:0/3469573434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63800b780 con 0x7fa6500c8910 2023-07-06T21:43:51.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa64f7fe640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa650151390 0x7fa6500c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:51.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa64effd640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6500c8910 0x7fa6500b1730 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa64000d620 tx=0x7fa64000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:51.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa64cff9640 1 -- 172.21.15.55:0/3469573434 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64000b620 con 0x7fa6500c8910 2023-07-06T21:43:51.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa64cff9640 1 -- 172.21.15.55:0/3469573434 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64000b780 con 0x7fa6500c8910 2023-07-06T21:43:51.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa64cff9640 1 -- 172.21.15.55:0/3469573434 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64000bb10 con 0x7fa6500c8910 2023-07-06T21:43:51.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa6559c5640 1 -- 172.21.15.55:0/3469573434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6500b1d10 con 0x7fa6500c8910 2023-07-06T21:43:51.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa6559c5640 1 -- 172.21.15.55:0/3469573434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6500b22d0 con 0x7fa6500c8910 2023-07-06T21:43:51.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.857+0000 7fa6559c5640 1 -- 172.21.15.55:0/3469573434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa650066d60 con 0x7fa6500c8910 2023-07-06T21:43:51.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.861+0000 7fa64cff9640 1 -- 172.21.15.55:0/3469573434 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fa64000bc70 con 0x7fa6500c8910 2023-07-06T21:43:51.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.861+0000 7fa64cff9640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa630066480 0x7fa630068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:51.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.861+0000 7fa64cff9640 1 -- 172.21.15.55:0/3469573434 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7fa640084790 con 0x7fa6500c8910 2023-07-06T21:43:51.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.861+0000 7fa647fff640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa630066480 0x7fa630068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:51.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.861+0000 7fa647fff640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa630066480 0x7fa630068930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa6380b1000 tx=0x7fa6380a9070 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:51.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:51.865+0000 7fa64cff9640 1 -- 172.21.15.55:0/3469573434 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6400517e0 con 0x7fa6500c8910 2023-07-06T21:43:52.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.041+0000 7fa6559c5640 1 -- 172.21.15.55:0/3469573434 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6500c8ce0 con 0x7fa630066480 2023-07-06T21:43:52.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.089+0000 7fa64cff9640 1 -- 172.21.15.55:0/3469573434 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa638004130 con 0x7fa630066480 2023-07-06T21:43:52.096 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-07-06T21:43:52.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.089+0000 7fa6559c5640 1 -- 172.21.15.55:0/3469573434 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa630066480 msgr2=0x7fa630068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:52.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.089+0000 7fa6559c5640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa630066480 0x7fa630068930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa6380b1000 tx=0x7fa6380a9070 comp rx=0 tx=0).stop 2023-07-06T21:43:52.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.089+0000 7fa6559c5640 1 -- 172.21.15.55:0/3469573434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6500c8910 msgr2=0x7fa6500b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:52.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.089+0000 7fa6559c5640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6500c8910 0x7fa6500b1730 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa64000d620 tx=0x7fa64000dae0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.089+0000 7fa6559c5640 1 -- 172.21.15.55:0/3469573434 shutdown_connections 2023-07-06T21:43:52.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.089+0000 7fa6559c5640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa630066480 0x7fa630068930 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.089+0000 7fa6559c5640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa650151390 0x7fa6500c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.089+0000 7fa6559c5640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6501588a0 0x7fa6500b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.089+0000 7fa6559c5640 1 --2- 172.21.15.55:0/3469573434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6500c8910 0x7fa6500b1730 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.089+0000 7fa6559c5640 1 -- 172.21.15.55:0/3469573434 >> 172.21.15.55:0/3469573434 conn(0x7fa6500cde30 msgr2=0x7fa65006f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:52.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.089+0000 7fa6559c5640 1 -- 172.21.15.55:0/3469573434 shutdown_connections 2023-07-06T21:43:52.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.089+0000 7fa6559c5640 1 -- 172.21.15.55:0/3469573434 wait complete. 2023-07-06T21:43:52.117 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-07-06T21:43:52.118 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-07-06T21:43:52.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.261+0000 7fce5fbd2640 1 Processor -- start 2023-07-06T21:43:52.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.261+0000 7fce5fbd2640 1 -- start start 2023-07-06T21:43:52.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.261+0000 7fce5fbd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce5815dd50 0x7fce58069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:52.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.261+0000 7fce5fbd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce580b3e70 con 0x7fce580c9b90 2023-07-06T21:43:52.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.261+0000 7fce5fbd2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce58159c30 con 0x7fce580ccb70 2023-07-06T21:43:52.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.261+0000 7fce5fbd2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce580c9070 con 0x7fce5815dd50 2023-07-06T21:43:52.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.265+0000 7fce5e16f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce5815dd50 0x7fce58069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:52.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.265+0000 7fce5e16f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce5815dd50 0x7fce58069b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41114/0 (socket says 172.21.15.55:41114) 2023-07-06T21:43:52.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.265+0000 7fce5e16f640 1 -- 172.21.15.55:0/1810575537 learned_addr learned my addr 172.21.15.55:0/1810575537 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:52.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.265+0000 7fce5e16f640 1 -- 172.21.15.55:0/1810575537 >> v1:172.21.15.138:6789/0 conn(0x7fce580ccb70 legacy=0x7fce580693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:52.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.265+0000 7fce5e16f640 1 -- 172.21.15.55:0/1810575537 >> v1:172.21.15.55:6789/0 conn(0x7fce580c9b90 legacy=0x7fce580c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:52.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.265+0000 7fce5e16f640 1 -- 172.21.15.55:0/1810575537 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce580c8480 con 0x7fce5815dd50 2023-07-06T21:43:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.265+0000 7fce5e16f640 1 --2- 172.21.15.55:0/1810575537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5815dd50 0x7fce58069b00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fce50009e50 tx=0x7fce5001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb181cebec04b40 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.265+0000 7fce5c96c640 1 -- 172.21.15.55:0/1810575537 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce500a57c0 con 0x7fce5815dd50 2023-07-06T21:43:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.265+0000 7fce5c96c640 1 -- 172.21.15.55:0/1810575537 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce500a5920 con 0x7fce5815dd50 2023-07-06T21:43:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.265+0000 7fce5c96c640 1 -- 172.21.15.55:0/1810575537 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce500a5cb0 con 0x7fce5815dd50 2023-07-06T21:43:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1810575537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5815dd50 msgr2=0x7fce58069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 --2- 172.21.15.55:0/1810575537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5815dd50 0x7fce58069b00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fce50009e50 tx=0x7fce5001c9e0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1810575537 shutdown_connections 2023-07-06T21:43:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 --2- 172.21.15.55:0/1810575537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5815dd50 0x7fce58069b00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1810575537 >> 172.21.15.55:0/1810575537 conn(0x7fce580cde30 msgr2=0x7fce580ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:52.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1810575537 shutdown_connections 2023-07-06T21:43:52.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1810575537 wait complete. 2023-07-06T21:43:52.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 Processor -- start 2023-07-06T21:43:52.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 -- start start 2023-07-06T21:43:52.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce580c9b90 0x7fce58158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:52.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce580ccb70 0x7fce581586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:52.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce5815dd50 0x7fce58163710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:52.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce58159de0 con 0x7fce580ccb70 2023-07-06T21:43:52.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce580c76f0 con 0x7fce580c9b90 2023-07-06T21:43:52.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5fbd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce580c79d0 con 0x7fce5815dd50 2023-07-06T21:43:52.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5d16d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce580ccb70 0x7fce581586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:52.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5d16d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce580ccb70 0x7fce581586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41116/0 (socket says 172.21.15.55:41116) 2023-07-06T21:43:52.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5d16d640 1 -- 172.21.15.55:0/1560177673 learned_addr learned my addr 172.21.15.55:0/1560177673 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:52.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5d96e640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce580c9b90 0x7fce58158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5e16f640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce5815dd50 0x7fce58163710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5d16d640 1 -- 172.21.15.55:0/1560177673 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce5815dd50 msgr2=0x7fce58163710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5d16d640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce5815dd50 0x7fce58163710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5d16d640 1 -- 172.21.15.55:0/1560177673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce580c9b90 msgr2=0x7fce58158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5d16d640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce580c9b90 0x7fce58158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5d16d640 1 -- 172.21.15.55:0/1560177673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce50009b30 con 0x7fce580ccb70 2023-07-06T21:43:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.269+0000 7fce5d96e640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce580c9b90 0x7fce58158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.273+0000 7fce5d16d640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce580ccb70 0x7fce581586d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fce4800c500 tx=0x7fce4800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.273+0000 7fce4e7fc640 1 -- 172.21.15.55:0/1560177673 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48005220 con 0x7fce580ccb70 2023-07-06T21:43:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.273+0000 7fce4e7fc640 1 -- 172.21.15.55:0/1560177673 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce48005380 con 0x7fce580ccb70 2023-07-06T21:43:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.273+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1560177673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5806a450 con 0x7fce580ccb70 2023-07-06T21:43:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.273+0000 7fce4e7fc640 1 -- 172.21.15.55:0/1560177673 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48007270 con 0x7fce580ccb70 2023-07-06T21:43:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.273+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1560177673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5815a030 con 0x7fce580ccb70 2023-07-06T21:43:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.273+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1560177673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5815a250 con 0x7fce580ccb70 2023-07-06T21:43:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.273+0000 7fce4e7fc640 1 -- 172.21.15.55:0/1560177673 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fce480073d0 con 0x7fce580ccb70 2023-07-06T21:43:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.273+0000 7fce4e7fc640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fce3c066480 0x7fce3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.273+0000 7fce4e7fc640 1 -- 172.21.15.55:0/1560177673 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7fce48083c50 con 0x7fce580ccb70 2023-07-06T21:43:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.273+0000 7fce5d96e640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fce3c066480 0x7fce3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.277+0000 7fce5d96e640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fce3c066480 0x7fce3c068930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce5815d9a0 tx=0x7fce54009040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:52.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.277+0000 7fce4e7fc640 1 -- 172.21.15.55:0/1560177673 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce48089020 con 0x7fce580ccb70 2023-07-06T21:43:52.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.453+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1560177673 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fce580c7b40 con 0x7fce3c066480 2023-07-06T21:43:52.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.501+0000 7fce4e7fc640 1 -- 172.21.15.55:0/1560177673 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fce580c7b40 con 0x7fce3c066480 2023-07-06T21:43:52.511 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-07-06T21:43:52.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.505+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1560177673 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fce3c066480 msgr2=0x7fce3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:52.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.505+0000 7fce5fbd2640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fce3c066480 0x7fce3c068930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce5815d9a0 tx=0x7fce54009040 comp rx=0 tx=0).stop 2023-07-06T21:43:52.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.505+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1560177673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce580ccb70 msgr2=0x7fce581586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:52.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.505+0000 7fce5fbd2640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce580ccb70 0x7fce581586d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fce4800c500 tx=0x7fce4800c9c0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.505+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1560177673 shutdown_connections 2023-07-06T21:43:52.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.505+0000 7fce5fbd2640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fce3c066480 0x7fce3c068930 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.505+0000 7fce5fbd2640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce5815dd50 0x7fce58163710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.505+0000 7fce5fbd2640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce580ccb70 0x7fce581586d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.505+0000 7fce5fbd2640 1 --2- 172.21.15.55:0/1560177673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce580c9b90 0x7fce58158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.505+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1560177673 >> 172.21.15.55:0/1560177673 conn(0x7fce580cde30 msgr2=0x7fce5815d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:52.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.505+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1560177673 shutdown_connections 2023-07-06T21:43:52.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.505+0000 7fce5fbd2640 1 -- 172.21.15.55:0/1560177673 wait complete. 2023-07-06T21:43:52.532 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-07-06T21:43:52.532 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-07-06T21:43:52.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55bd337640 1 Processor -- start 2023-07-06T21:43:52.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55bd337640 1 -- start start 2023-07-06T21:43:52.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55bd337640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55b8159600 0x7f55b80cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:52.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55bd337640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55b815cc70 0x7f55b80ca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:52.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55bd337640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b81599d0 con 0x7f55b806ed10 2023-07-06T21:43:52.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55bd337640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b80cae80 con 0x7f55b8159600 2023-07-06T21:43:52.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55bd337640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80cb160 con 0x7f55b815cc70 2023-07-06T21:43:52.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55b6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55b8159600 0x7f55b80cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:52.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55b6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55b8159600 0x7f55b80cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41130/0 (socket says 172.21.15.55:41130) 2023-07-06T21:43:52.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55b77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f55b806ed10 0x7f55b80cdbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34970/0 (socket says 172.21.15.55:34970) 2023-07-06T21:43:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55b6ffd640 1 -- 172.21.15.55:0/649628020 learned_addr learned my addr 172.21.15.55:0/649628020 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55affff640 1 --2- 172.21.15.55:0/649628020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55b815cc70 0x7f55b80ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55b6ffd640 1 -- 172.21.15.55:0/649628020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55b815cc70 msgr2=0x7f55b80ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55b6ffd640 1 --2- 172.21.15.55:0/649628020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55b815cc70 0x7f55b80ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.673+0000 7f55b6ffd640 1 -- 172.21.15.55:0/649628020 >> v1:172.21.15.55:6789/0 conn(0x7f55b806ed10 legacy=0x7f55b80cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:52.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.677+0000 7f55b6ffd640 1 -- 172.21.15.55:0/649628020 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b80cb440 con 0x7f55b8159600 2023-07-06T21:43:52.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.677+0000 7f55b6ffd640 1 --2- 172.21.15.55:0/649628020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55b8159600 0x7f55b80cbf20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009870 tx=0x7f55a801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989b9c6ebe0a6d2b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:52.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.677+0000 7f55b67fc640 1 -- 172.21.15.55:0/649628020 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80aa670 con 0x7f55b8159600 2023-07-06T21:43:52.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.677+0000 7f55b67fc640 1 -- 172.21.15.55:0/649628020 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a80aa7d0 con 0x7f55b8159600 2023-07-06T21:43:52.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.677+0000 7f55b67fc640 1 -- 172.21.15.55:0/649628020 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80aab60 con 0x7f55b8159600 2023-07-06T21:43:52.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.677+0000 7f55bd337640 1 -- 172.21.15.55:0/649628020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55b8159600 msgr2=0x7f55b80cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:52.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.677+0000 7f55bd337640 1 --2- 172.21.15.55:0/649628020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55b8159600 0x7f55b80cbf20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009870 tx=0x7f55a801c510 comp rx=0 tx=0).stop 2023-07-06T21:43:52.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.677+0000 7f55bd337640 1 -- 172.21.15.55:0/649628020 shutdown_connections 2023-07-06T21:43:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.677+0000 7f55bd337640 1 --2- 172.21.15.55:0/649628020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55b815cc70 0x7f55b80ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.677+0000 7f55bd337640 1 --2- 172.21.15.55:0/649628020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55b8159600 0x7f55b80cbf20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.677+0000 7f55bd337640 1 -- 172.21.15.55:0/649628020 >> 172.21.15.55:0/649628020 conn(0x7f55b80d0c20 msgr2=0x7f55b80cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.677+0000 7f55bd337640 1 -- 172.21.15.55:0/649628020 shutdown_connections 2023-07-06T21:43:52.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55bd337640 1 -- 172.21.15.55:0/649628020 wait complete. 2023-07-06T21:43:52.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55bd337640 1 Processor -- start 2023-07-06T21:43:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55bd337640 1 -- start start 2023-07-06T21:43:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55bd337640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55b806ed10 0x7f55b814e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55bd337640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55b8159600 0x7f55b80c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55bd337640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55b815cc70 0x7f55b814feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55bd337640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b81503f0 con 0x7f55b806ed10 2023-07-06T21:43:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55bd337640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b814de50 con 0x7f55b815cc70 2023-07-06T21:43:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55bd337640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b8156a50 con 0x7f55b8159600 2023-07-06T21:43:52.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55b6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55b806ed10 0x7f55b814e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:52.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55b6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55b806ed10 0x7f55b814e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41142/0 (socket says 172.21.15.55:41142) 2023-07-06T21:43:52.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55b6ffd640 1 -- 172.21.15.55:0/3694257678 learned_addr learned my addr 172.21.15.55:0/3694257678 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:52.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55b77fe640 1 --2- 172.21.15.55:0/3694257678 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55b815cc70 0x7f55b814feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:52.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55affff640 1 --2- 172.21.15.55:0/3694257678 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55b8159600 0x7f55b80c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:52.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55b6ffd640 1 -- 172.21.15.55:0/3694257678 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55b8159600 msgr2=0x7f55b80c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:52.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55b6ffd640 1 --2- 172.21.15.55:0/3694257678 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55b8159600 0x7f55b80c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55b6ffd640 1 -- 172.21.15.55:0/3694257678 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55b815cc70 msgr2=0x7f55b814feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:52.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55b6ffd640 1 --2- 172.21.15.55:0/3694257678 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55b815cc70 0x7f55b814feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55b6ffd640 1 -- 172.21.15.55:0/3694257678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a80094d0 con 0x7f55b806ed10 2023-07-06T21:43:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55b6ffd640 1 --2- 172.21.15.55:0/3694257678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55b806ed10 0x7f55b814e080 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f55a80ac040 tx=0x7f55a801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55af7fe640 1 -- 172.21.15.55:0/3694257678 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80b3800 con 0x7f55b806ed10 2023-07-06T21:43:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55af7fe640 1 -- 172.21.15.55:0/3694257678 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a80b3980 con 0x7f55b806ed10 2023-07-06T21:43:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55bd337640 1 -- 172.21.15.55:0/3694257678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b8158b10 con 0x7f55b806ed10 2023-07-06T21:43:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.681+0000 7f55af7fe640 1 -- 172.21.15.55:0/3694257678 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80b3d30 con 0x7f55b806ed10 2023-07-06T21:43:52.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.685+0000 7f55bd337640 1 -- 172.21.15.55:0/3694257678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b8156fd0 con 0x7f55b806ed10 2023-07-06T21:43:52.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.685+0000 7f55bd337640 1 -- 172.21.15.55:0/3694257678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b8066d60 con 0x7f55b806ed10 2023-07-06T21:43:52.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.685+0000 7f55af7fe640 1 -- 172.21.15.55:0/3694257678 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f55a80c6390 con 0x7f55b806ed10 2023-07-06T21:43:52.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.685+0000 7f55af7fe640 1 --2- 172.21.15.55:0/3694257678 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5598066480 0x7f5598068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:52.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.685+0000 7f55af7fe640 1 -- 172.21.15.55:0/3694257678 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7f55a811ef90 con 0x7f55b806ed10 2023-07-06T21:43:52.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.685+0000 7f55affff640 1 --2- 172.21.15.55:0/3694257678 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5598066480 0x7f5598068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:52.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.685+0000 7f55affff640 1 --2- 172.21.15.55:0/3694257678 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5598066480 0x7f5598068930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f55b80c9ea0 tx=0x7f55a0008040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:52.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.689+0000 7f55af7fe640 1 -- 172.21.15.55:0/3694257678 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55a80ebdc0 con 0x7f55b806ed10 2023-07-06T21:43:52.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.865+0000 7f55bd337640 1 -- 172.21.15.55:0/3694257678 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f55b80cab70 con 0x7f5598066480 2023-07-06T21:43:52.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.929+0000 7f55af7fe640 1 -- 172.21.15.55:0/3694257678 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f55a0011950 con 0x7f5598066480 2023-07-06T21:43:52.937 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-07-06T21:43:52.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.929+0000 7f55bd337640 1 -- 172.21.15.55:0/3694257678 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5598066480 msgr2=0x7f5598068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:52.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.929+0000 7f55bd337640 1 --2- 172.21.15.55:0/3694257678 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5598066480 0x7f5598068930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f55b80c9ea0 tx=0x7f55a0008040 comp rx=0 tx=0).stop 2023-07-06T21:43:52.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.929+0000 7f55bd337640 1 -- 172.21.15.55:0/3694257678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55b806ed10 msgr2=0x7f55b814e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:52.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.929+0000 7f55bd337640 1 --2- 172.21.15.55:0/3694257678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55b806ed10 0x7f55b814e080 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f55a80ac040 tx=0x7f55a801ad50 comp rx=0 tx=0).stop 2023-07-06T21:43:52.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.929+0000 7f55bd337640 1 -- 172.21.15.55:0/3694257678 shutdown_connections 2023-07-06T21:43:52.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.929+0000 7f55bd337640 1 --2- 172.21.15.55:0/3694257678 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5598066480 0x7f5598068930 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.929+0000 7f55bd337640 1 --2- 172.21.15.55:0/3694257678 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55b815cc70 0x7f55b814feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.929+0000 7f55bd337640 1 --2- 172.21.15.55:0/3694257678 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55b8159600 0x7f55b80c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.929+0000 7f55bd337640 1 --2- 172.21.15.55:0/3694257678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55b806ed10 0x7f55b814e080 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:52.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.929+0000 7f55bd337640 1 -- 172.21.15.55:0/3694257678 >> 172.21.15.55:0/3694257678 conn(0x7f55b80d0c20 msgr2=0x7f55b815ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:52.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.929+0000 7f55bd337640 1 -- 172.21.15.55:0/3694257678 shutdown_connections 2023-07-06T21:43:52.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:52.929+0000 7f55bd337640 1 -- 172.21.15.55:0/3694257678 wait complete. 2023-07-06T21:43:52.957 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-07-06T21:43:52.957 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-07-06T21:43:53.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.097+0000 7f85d8796640 1 Processor -- start 2023-07-06T21:43:53.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.097+0000 7f85d8796640 1 -- start start 2023-07-06T21:43:53.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.097+0000 7f85d8796640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85d00c9b90 0x7f85d015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.097+0000 7f85d8796640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f85d00693f0 0x7f85d0069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.097+0000 7f85d8796640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d00b3e70 con 0x7f85d00ccb70 2023-07-06T21:43:53.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.097+0000 7f85d8796640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d0159c30 con 0x7f85d00693f0 2023-07-06T21:43:53.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.097+0000 7f85d8796640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00c9070 con 0x7f85d00c9b90 2023-07-06T21:43:53.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.097+0000 7f85d6d33640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f85d00693f0 0x7f85d0069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.101+0000 7f85d6532640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85d00c9b90 0x7f85d015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.101+0000 7f85d6d33640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f85d00693f0 0x7f85d0069870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:34608/0 (socket says 172.21.15.55:34608) 2023-07-06T21:43:53.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.101+0000 7f85d6d33640 1 -- 172.21.15.55:0/1067219051 learned_addr learned my addr 172.21.15.55:0/1067219051 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:53.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.101+0000 7f85d6d33640 1 -- 172.21.15.55:0/1067219051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85d00c9b90 msgr2=0x7f85d015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:53.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.101+0000 7f85d6d33640 1 --2- 172.21.15.55:0/1067219051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85d00c9b90 0x7f85d015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.101+0000 7f85d6d33640 1 -- 172.21.15.55:0/1067219051 >> v1:172.21.15.138:6789/0 conn(0x7f85d00ccb70 legacy=0x7f85d00c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.101+0000 7f85d6d33640 1 -- 172.21.15.55:0/1067219051 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d00c8480 con 0x7f85d00693f0 2023-07-06T21:43:53.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.101+0000 7f85d6532640 1 --2- 172.21.15.55:0/1067219051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85d00c9b90 0x7f85d015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:53.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.101+0000 7f85d5530640 1 -- 172.21.15.55:0/1067219051 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378643978 0 0) 0x7f85c0001120 con 0x7f85d00ccb70 2023-07-06T21:43:53.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.101+0000 7f85d6d33640 1 --2- 172.21.15.55:0/1067219051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d00693f0 0x7f85d0069870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009e50 tx=0x7f85c801c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a371d65a7f9bbf8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:53.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.101+0000 7f85d5530640 1 -- 172.21.15.55:0/1067219051 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c80a58b0 con 0x7f85d00693f0 2023-07-06T21:43:53.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.101+0000 7f85d5530640 1 -- 172.21.15.55:0/1067219051 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c80a5a10 con 0x7f85d00693f0 2023-07-06T21:43:53.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.101+0000 7f85d5530640 1 -- 172.21.15.55:0/1067219051 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c80a5da0 con 0x7f85d00693f0 2023-07-06T21:43:53.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 -- 172.21.15.55:0/1067219051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d00693f0 msgr2=0x7f85d0069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 --2- 172.21.15.55:0/1067219051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d00693f0 0x7f85d0069870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009e50 tx=0x7f85c801c9f0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 -- 172.21.15.55:0/1067219051 shutdown_connections 2023-07-06T21:43:53.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 --2- 172.21.15.55:0/1067219051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d00693f0 0x7f85d0069870 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 --2- 172.21.15.55:0/1067219051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85d00c9b90 0x7f85d015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 -- 172.21.15.55:0/1067219051 >> 172.21.15.55:0/1067219051 conn(0x7f85d00cde30 msgr2=0x7f85d00ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:53.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 -- 172.21.15.55:0/1067219051 shutdown_connections 2023-07-06T21:43:53.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 -- 172.21.15.55:0/1067219051 wait complete. 2023-07-06T21:43:53.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 Processor -- start 2023-07-06T21:43:53.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 -- start start 2023-07-06T21:43:53.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85d00693f0 0x7f85d01f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85d00c9b90 0x7f85d01f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d00ccb70 0x7f85d0155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00c7cd0 con 0x7f85d00693f0 2023-07-06T21:43:53.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d0150dd0 con 0x7f85d00ccb70 2023-07-06T21:43:53.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d8796640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d01f82f0 con 0x7f85d00c9b90 2023-07-06T21:43:53.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d6532640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85d00693f0 0x7f85d01f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d6532640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85d00693f0 0x7f85d01f3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41146/0 (socket says 172.21.15.55:41146) 2023-07-06T21:43:53.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d6532640 1 -- 172.21.15.55:0/2277757329 learned_addr learned my addr 172.21.15.55:0/2277757329 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:53.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d6d33640 1 --2- 172.21.15.55:0/2277757329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d00ccb70 0x7f85d0155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d5d31640 1 --2- 172.21.15.55:0/2277757329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85d00c9b90 0x7f85d01f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d6532640 1 -- 172.21.15.55:0/2277757329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85d00c9b90 msgr2=0x7f85d01f7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d6532640 1 --2- 172.21.15.55:0/2277757329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85d00c9b90 0x7f85d01f7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d6532640 1 -- 172.21.15.55:0/2277757329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d00ccb70 msgr2=0x7f85d0155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d6532640 1 --2- 172.21.15.55:0/2277757329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d00ccb70 0x7f85d0155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.105+0000 7f85d6532640 1 -- 172.21.15.55:0/2277757329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc009420 con 0x7f85d00693f0 2023-07-06T21:43:53.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.109+0000 7f85d6532640 1 --2- 172.21.15.55:0/2277757329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85d00693f0 0x7f85d01f3880 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00ec10 tx=0x7f85cc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:53.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.109+0000 7f85c6ffd640 1 -- 172.21.15.55:0/2277757329 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00cc30 con 0x7f85d00693f0 2023-07-06T21:43:53.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.109+0000 7f85c6ffd640 1 -- 172.21.15.55:0/2277757329 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc00cd90 con 0x7f85d00693f0 2023-07-06T21:43:53.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.109+0000 7f85c6ffd640 1 -- 172.21.15.55:0/2277757329 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc013690 con 0x7f85d00693f0 2023-07-06T21:43:53.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.109+0000 7f85d8796640 1 -- 172.21.15.55:0/2277757329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c8009b30 con 0x7f85d00693f0 2023-07-06T21:43:53.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.109+0000 7f85d8796640 1 -- 172.21.15.55:0/2277757329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d00c7610 con 0x7f85d00693f0 2023-07-06T21:43:53.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.109+0000 7f85d8796640 1 -- 172.21.15.55:0/2277757329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d0066d60 con 0x7f85d00693f0 2023-07-06T21:43:53.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.109+0000 7f85c6ffd640 1 -- 172.21.15.55:0/2277757329 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f85cc0137f0 con 0x7f85d00693f0 2023-07-06T21:43:53.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.109+0000 7f85c6ffd640 1 --2- 172.21.15.55:0/2277757329 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f85b4066480 0x7f85b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.109+0000 7f85c6ffd640 1 -- 172.21.15.55:0/2277757329 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7f85cc084490 con 0x7f85d00693f0 2023-07-06T21:43:53.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.109+0000 7f85d5d31640 1 --2- 172.21.15.55:0/2277757329 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f85b4066480 0x7f85b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.113+0000 7f85d5d31640 1 --2- 172.21.15.55:0/2277757329 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f85b4066480 0x7f85b4068930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f85d00ce270 tx=0x7f85c0009040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:53.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.113+0000 7f85c6ffd640 1 -- 172.21.15.55:0/2277757329 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85cc0515b0 con 0x7f85d00693f0 2023-07-06T21:43:53.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.289+0000 7f85d8796640 1 -- 172.21.15.55:0/2277757329 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f85d00c8d00 con 0x7f85b4066480 2023-07-06T21:43:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.349+0000 7f85c6ffd640 1 -- 172.21.15.55:0/2277757329 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f85c000f820 con 0x7f85b4066480 2023-07-06T21:43:53.357 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-07-06T21:43:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.349+0000 7f85d8796640 1 -- 172.21.15.55:0/2277757329 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f85b4066480 msgr2=0x7f85b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.349+0000 7f85d8796640 1 --2- 172.21.15.55:0/2277757329 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f85b4066480 0x7f85b4068930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f85d00ce270 tx=0x7f85c0009040 comp rx=0 tx=0).stop 2023-07-06T21:43:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.349+0000 7f85d8796640 1 -- 172.21.15.55:0/2277757329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85d00693f0 msgr2=0x7f85d01f3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.349+0000 7f85d8796640 1 --2- 172.21.15.55:0/2277757329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85d00693f0 0x7f85d01f3880 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00ec10 tx=0x7f85cc00c520 comp rx=0 tx=0).stop 2023-07-06T21:43:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.353+0000 7f85d8796640 1 -- 172.21.15.55:0/2277757329 shutdown_connections 2023-07-06T21:43:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.353+0000 7f85d8796640 1 --2- 172.21.15.55:0/2277757329 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f85b4066480 0x7f85b4068930 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.353+0000 7f85d8796640 1 --2- 172.21.15.55:0/2277757329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d00ccb70 0x7f85d0155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.353+0000 7f85d8796640 1 --2- 172.21.15.55:0/2277757329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85d00c9b90 0x7f85d01f7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.353+0000 7f85d8796640 1 --2- 172.21.15.55:0/2277757329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85d00693f0 0x7f85d01f3880 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.353+0000 7f85d8796640 1 -- 172.21.15.55:0/2277757329 >> 172.21.15.55:0/2277757329 conn(0x7f85d00cde30 msgr2=0x7f85d0158140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.353+0000 7f85d8796640 1 -- 172.21.15.55:0/2277757329 shutdown_connections 2023-07-06T21:43:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.353+0000 7f85d8796640 1 -- 172.21.15.55:0/2277757329 wait complete. 2023-07-06T21:43:53.378 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-07-06T21:43:53.379 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-07-06T21:43:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.521+0000 7ffac86d8640 1 Processor -- start 2023-07-06T21:43:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.521+0000 7ffac86d8640 1 -- start start 2023-07-06T21:43:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac86d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffac006a460 0x7ffac00caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac86d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffac006f960 0x7ffac006fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac86d8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac0070300 con 0x7ffac006cb40 2023-07-06T21:43:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac86d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac006bac0 con 0x7ffac006a460 2023-07-06T21:43:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac86d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac0069b00 con 0x7ffac006f960 2023-07-06T21:43:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac6474640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffac006a460 0x7ffac00caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac6474640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffac006a460 0x7ffac00caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59168/0 (socket says 172.21.15.55:59168) 2023-07-06T21:43:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac6474640 1 -- 172.21.15.55:0/2149889993 learned_addr learned my addr 172.21.15.55:0/2149889993 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac6c75640 1 --2- 172.21.15.55:0/2149889993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffac006f960 0x7ffac006fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac6474640 1 -- 172.21.15.55:0/2149889993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffac006f960 msgr2=0x7ffac006fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac6474640 1 --2- 172.21.15.55:0/2149889993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffac006f960 0x7ffac006fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac6474640 1 -- 172.21.15.55:0/2149889993 >> v1:172.21.15.138:6789/0 conn(0x7ffac006cb40 legacy=0x7ffac00693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:53.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac6474640 1 -- 172.21.15.55:0/2149889993 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac00cc650 con 0x7ffac006a460 2023-07-06T21:43:53.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac6c75640 1 --2- 172.21.15.55:0/2149889993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffac006f960 0x7ffac006fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:43:53.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac6474640 1 --2- 172.21.15.55:0/2149889993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffac006a460 0x7ffac00caa80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ffabc006fd0 tx=0x7ffabc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72e4ba4241adabc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:53.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.525+0000 7ffac5472640 1 -- 172.21.15.55:0/2149889993 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0ab600 con 0x7ffac006a460 2023-07-06T21:43:53.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac5472640 1 -- 172.21.15.55:0/2149889993 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc0a7050 con 0x7ffac006a460 2023-07-06T21:43:53.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac5472640 1 -- 172.21.15.55:0/2149889993 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0ab980 con 0x7ffac006a460 2023-07-06T21:43:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 -- 172.21.15.55:0/2149889993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffac006a460 msgr2=0x7ffac00caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 --2- 172.21.15.55:0/2149889993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffac006a460 0x7ffac00caa80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ffabc006fd0 tx=0x7ffabc01c450 comp rx=0 tx=0).stop 2023-07-06T21:43:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 -- 172.21.15.55:0/2149889993 shutdown_connections 2023-07-06T21:43:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 --2- 172.21.15.55:0/2149889993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffac006f960 0x7ffac006fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 --2- 172.21.15.55:0/2149889993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffac006a460 0x7ffac00caa80 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 -- 172.21.15.55:0/2149889993 >> 172.21.15.55:0/2149889993 conn(0x7ffac00ce7f0 msgr2=0x7ffac00cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 -- 172.21.15.55:0/2149889993 shutdown_connections 2023-07-06T21:43:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 -- 172.21.15.55:0/2149889993 wait complete. 2023-07-06T21:43:53.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 Processor -- start 2023-07-06T21:43:53.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 -- start start 2023-07-06T21:43:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffac006a460 0x7ffac00b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffac006cb40 0x7ffac01572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffac006f960 0x7ffac01577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac00b4580 con 0x7ffac006cb40 2023-07-06T21:43:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac0150610 con 0x7ffac006f960 2023-07-06T21:43:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac86d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac013d390 con 0x7ffac006a460 2023-07-06T21:43:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac5c73640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffac006cb40 0x7ffac01572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac5c73640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffac006cb40 0x7ffac01572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59174/0 (socket says 172.21.15.55:59174) 2023-07-06T21:43:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac5c73640 1 -- 172.21.15.55:0/3340207823 learned_addr learned my addr 172.21.15.55:0/3340207823 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac6474640 1 --2- 172.21.15.55:0/3340207823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffac006a460 0x7ffac00b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.529+0000 7ffac6c75640 1 --2- 172.21.15.55:0/3340207823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffac006f960 0x7ffac01577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.533+0000 7ffac5c73640 1 -- 172.21.15.55:0/3340207823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffac006a460 msgr2=0x7ffac00b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.533+0000 7ffac5c73640 1 --2- 172.21.15.55:0/3340207823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffac006a460 0x7ffac00b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.533+0000 7ffac5c73640 1 -- 172.21.15.55:0/3340207823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffac006f960 msgr2=0x7ffac01577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.533+0000 7ffac5c73640 1 --2- 172.21.15.55:0/3340207823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffac006f960 0x7ffac01577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.533+0000 7ffac5c73640 1 -- 172.21.15.55:0/3340207823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc009480 con 0x7ffac006cb40 2023-07-06T21:43:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.533+0000 7ffac5c73640 1 --2- 172.21.15.55:0/3340207823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffac006cb40 0x7ffac01572a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ffab000c450 tx=0x7ffab000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.533+0000 7ffab6ffd640 1 -- 172.21.15.55:0/3340207823 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab0012830 con 0x7ffac006cb40 2023-07-06T21:43:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.533+0000 7ffab6ffd640 1 -- 172.21.15.55:0/3340207823 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab00129b0 con 0x7ffac006cb40 2023-07-06T21:43:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.533+0000 7ffac86d8640 1 -- 172.21.15.55:0/3340207823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac00b42a0 con 0x7ffac006cb40 2023-07-06T21:43:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.533+0000 7ffab6ffd640 1 -- 172.21.15.55:0/3340207823 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab0012d60 con 0x7ffac006cb40 2023-07-06T21:43:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.533+0000 7ffac86d8640 1 -- 172.21.15.55:0/3340207823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac0150b90 con 0x7ffac006cb40 2023-07-06T21:43:53.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.533+0000 7ffac86d8640 1 -- 172.21.15.55:0/3340207823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac0150db0 con 0x7ffac006cb40 2023-07-06T21:43:53.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.533+0000 7ffab6ffd640 1 -- 172.21.15.55:0/3340207823 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7ffab001c460 con 0x7ffac006cb40 2023-07-06T21:43:53.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.533+0000 7ffab6ffd640 1 --2- 172.21.15.55:0/3340207823 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ffaa4066480 0x7ffaa4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.537+0000 7ffab6ffd640 1 -- 172.21.15.55:0/3340207823 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7ffab0084040 con 0x7ffac006cb40 2023-07-06T21:43:53.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.537+0000 7ffac6474640 1 --2- 172.21.15.55:0/3340207823 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ffaa4066480 0x7ffaa4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.537+0000 7ffac6474640 1 --2- 172.21.15.55:0/3340207823 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ffaa4066480 0x7ffaa4068930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0ad000 tx=0x7ffabc0a4f90 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:53.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.537+0000 7ffab6ffd640 1 -- 172.21.15.55:0/3340207823 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffab00b4700 con 0x7ffac006cb40 2023-07-06T21:43:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.713+0000 7ffac86d8640 1 -- 172.21.15.55:0/3340207823 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ffac006a830 con 0x7ffaa4066480 2023-07-06T21:43:53.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.765+0000 7ffab6ffd640 1 -- 172.21.15.55:0/3340207823 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ffabc004420 con 0x7ffaa4066480 2023-07-06T21:43:53.774 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-07-06T21:43:53.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.769+0000 7ffac86d8640 1 -- 172.21.15.55:0/3340207823 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ffaa4066480 msgr2=0x7ffaa4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.769+0000 7ffac86d8640 1 --2- 172.21.15.55:0/3340207823 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ffaa4066480 0x7ffaa4068930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0ad000 tx=0x7ffabc0a4f90 comp rx=0 tx=0).stop 2023-07-06T21:43:53.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.769+0000 7ffac86d8640 1 -- 172.21.15.55:0/3340207823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffac006cb40 msgr2=0x7ffac01572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.769+0000 7ffac86d8640 1 --2- 172.21.15.55:0/3340207823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffac006cb40 0x7ffac01572a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ffab000c450 tx=0x7ffab000c910 comp rx=0 tx=0).stop 2023-07-06T21:43:53.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.769+0000 7ffac86d8640 1 -- 172.21.15.55:0/3340207823 shutdown_connections 2023-07-06T21:43:53.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.769+0000 7ffac86d8640 1 --2- 172.21.15.55:0/3340207823 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ffaa4066480 0x7ffaa4068930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.769+0000 7ffac86d8640 1 --2- 172.21.15.55:0/3340207823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffac006f960 0x7ffac01577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.769+0000 7ffac86d8640 1 --2- 172.21.15.55:0/3340207823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffac006cb40 0x7ffac01572a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.769+0000 7ffac86d8640 1 --2- 172.21.15.55:0/3340207823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffac006a460 0x7ffac00b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.769+0000 7ffac86d8640 1 -- 172.21.15.55:0/3340207823 >> 172.21.15.55:0/3340207823 conn(0x7ffac00ce7f0 msgr2=0x7ffac0158870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:53.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.769+0000 7ffac86d8640 1 -- 172.21.15.55:0/3340207823 shutdown_connections 2023-07-06T21:43:53.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.769+0000 7ffac86d8640 1 -- 172.21.15.55:0/3340207823 wait complete. 2023-07-06T21:43:53.795 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-07-06T21:43:53.795 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-07-06T21:43:53.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6d5893640 1 Processor -- start 2023-07-06T21:43:53.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6d5893640 1 -- start start 2023-07-06T21:43:53.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6d5893640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff6d0159600 0x7ff6d00cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6d5893640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d01599d0 con 0x7ff6d015cc70 2023-07-06T21:43:53.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6d5893640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d00cae80 con 0x7ff6d006ed10 2023-07-06T21:43:53.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6d5893640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d00cb160 con 0x7ff6d0159600 2023-07-06T21:43:53.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6c7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff6d015cc70 0x7ff6d00ca630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40070/0 (socket says 172.21.15.55:40070) 2023-07-06T21:43:53.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6c7fff640 1 -- 172.21.15.55:0/3720015615 learned_addr learned my addr 172.21.15.55:0/3720015615 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:53.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6ceffd640 1 --2- 172.21.15.55:0/3720015615 >> v2:172.21.15.138:3300/0 conn(0x7ff6d0159600 0x7ff6d00cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6ce7fc640 1 -- 172.21.15.55:0/3720015615 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101721685 0 0) 0x7ff6d01599d0 con 0x7ff6d015cc70 2023-07-06T21:43:53.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6ce7fc640 1 -- 172.21.15.55:0/3720015615 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6bc003530 con 0x7ff6d015cc70 2023-07-06T21:43:53.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6ceffd640 1 -- 172.21.15.55:0/3720015615 >> v1:172.21.15.138:6789/0 conn(0x7ff6d006ed10 legacy=0x7ff6d006f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6ceffd640 1 -- 172.21.15.55:0/3720015615 >> v1:172.21.15.55:6789/0 conn(0x7ff6d015cc70 legacy=0x7ff6d00ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6ce7fc640 1 -- 172.21.15.55:0/3720015615 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3902541925 0 0) 0x7ff6bc003530 con 0x7ff6d015cc70 2023-07-06T21:43:53.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.937+0000 7ff6ceffd640 1 -- 172.21.15.55:0/3720015615 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d00cb440 con 0x7ff6d0159600 2023-07-06T21:43:53.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.941+0000 7ff6ceffd640 1 --2- 172.21.15.55:0/3720015615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d0159600 0x7ff6d00cbf20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00097c0 tx=0x7ff6c001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac4094bd56cab528 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:53.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.941+0000 7ff6ce7fc640 1 -- 172.21.15.55:0/3720015615 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8001680 con 0x7ff6d0159600 2023-07-06T21:43:53.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.941+0000 7ff6ce7fc640 1 -- 172.21.15.55:0/3720015615 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c00a7050 con 0x7ff6d0159600 2023-07-06T21:43:53.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.941+0000 7ff6ce7fc640 1 -- 172.21.15.55:0/3720015615 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c00ab620 con 0x7ff6d0159600 2023-07-06T21:43:53.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.941+0000 7ff6d5893640 1 -- 172.21.15.55:0/3720015615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d0159600 msgr2=0x7ff6d00cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.941+0000 7ff6d5893640 1 --2- 172.21.15.55:0/3720015615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d0159600 0x7ff6d00cbf20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00097c0 tx=0x7ff6c001c370 comp rx=0 tx=0).stop 2023-07-06T21:43:53.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.941+0000 7ff6d5893640 1 -- 172.21.15.55:0/3720015615 shutdown_connections 2023-07-06T21:43:53.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.941+0000 7ff6d5893640 1 --2- 172.21.15.55:0/3720015615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d0159600 0x7ff6d00cbf20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.941+0000 7ff6d5893640 1 -- 172.21.15.55:0/3720015615 >> 172.21.15.55:0/3720015615 conn(0x7ff6d00d0c20 msgr2=0x7ff6d00cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:53.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.941+0000 7ff6d5893640 1 -- 172.21.15.55:0/3720015615 shutdown_connections 2023-07-06T21:43:53.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.941+0000 7ff6d5893640 1 -- 172.21.15.55:0/3720015615 wait complete. 2023-07-06T21:43:53.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6d5893640 1 Processor -- start 2023-07-06T21:43:53.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6d5893640 1 -- start start 2023-07-06T21:43:53.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6d5893640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d006ed10 0x7ff6d014e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6d5893640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d0159600 0x7ff6d00c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6d5893640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6d015cc70 0x7ff6d0157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6d5893640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d00ca400 con 0x7ff6d0159600 2023-07-06T21:43:53.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6d5893640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d00c9e80 con 0x7ff6d006ed10 2023-07-06T21:43:53.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6d5893640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d00ca120 con 0x7ff6d015cc70 2023-07-06T21:43:53.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6c7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d0159600 0x7ff6d00c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6c7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d0159600 0x7ff6d00c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59180/0 (socket says 172.21.15.55:59180) 2023-07-06T21:43:53.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6c7fff640 1 -- 172.21.15.55:0/435107555 learned_addr learned my addr 172.21.15.55:0/435107555 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:53.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6ceffd640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d006ed10 0x7ff6d014e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6cf7fe640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6d015cc70 0x7ff6d0157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6c7fff640 1 -- 172.21.15.55:0/435107555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6d015cc70 msgr2=0x7ff6d0157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6c7fff640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6d015cc70 0x7ff6d0157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6c7fff640 1 -- 172.21.15.55:0/435107555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d006ed10 msgr2=0x7ff6d014e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:53.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6c7fff640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d006ed10 0x7ff6d014e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:53.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6c7fff640 1 -- 172.21.15.55:0/435107555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0009420 con 0x7ff6d0159600 2023-07-06T21:43:53.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6cf7fe640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6d015cc70 0x7ff6d0157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:43:53.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6c7fff640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d0159600 0x7ff6d00c8190 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800c750 tx=0x7ff6b800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:53.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6ccff9640 1 -- 172.21.15.55:0/435107555 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8005ae0 con 0x7ff6d0159600 2023-07-06T21:43:53.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6ccff9640 1 -- 172.21.15.55:0/435107555 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8005c40 con 0x7ff6d0159600 2023-07-06T21:43:53.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6ccff9640 1 -- 172.21.15.55:0/435107555 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8007290 con 0x7ff6d0159600 2023-07-06T21:43:53.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6d5893640 1 -- 172.21.15.55:0/435107555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d00c4fd0 con 0x7ff6d0159600 2023-07-06T21:43:53.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6d5893640 1 -- 172.21.15.55:0/435107555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d014eec0 con 0x7ff6d0159600 2023-07-06T21:43:53.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.945+0000 7ff6d5893640 1 -- 172.21.15.55:0/435107555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d0066d60 con 0x7ff6d0159600 2023-07-06T21:43:53.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.949+0000 7ff6ccff9640 1 -- 172.21.15.55:0/435107555 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7ff6b80073f0 con 0x7ff6d0159600 2023-07-06T21:43:53.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.949+0000 7ff6ccff9640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff6b00664b0 0x7ff6b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:53.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.949+0000 7ff6ccff9640 1 -- 172.21.15.55:0/435107555 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7ff6b80838f0 con 0x7ff6d0159600 2023-07-06T21:43:53.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.949+0000 7ff6ceffd640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff6b00664b0 0x7ff6b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:53.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.949+0000 7ff6ceffd640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff6b00664b0 0x7ff6b0068960 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00ad000 tx=0x7ff6c0008040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:53.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:53.953+0000 7ff6ccff9640 1 -- 172.21.15.55:0/435107555 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff6b8050a20 con 0x7ff6d0159600 2023-07-06T21:43:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.125+0000 7ff6d5893640 1 -- 172.21.15.55:0/435107555 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6d00c5480 con 0x7ff6b00664b0 2023-07-06T21:43:54.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.177+0000 7ff6ccff9640 1 -- 172.21.15.55:0/435107555 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ff6d00c5480 con 0x7ff6b00664b0 2023-07-06T21:43:54.187 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-07-06T21:43:54.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.181+0000 7ff6d5893640 1 -- 172.21.15.55:0/435107555 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff6b00664b0 msgr2=0x7ff6b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:54.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.181+0000 7ff6d5893640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff6b00664b0 0x7ff6b0068960 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00ad000 tx=0x7ff6c0008040 comp rx=0 tx=0).stop 2023-07-06T21:43:54.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.181+0000 7ff6d5893640 1 -- 172.21.15.55:0/435107555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d0159600 msgr2=0x7ff6d00c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.181+0000 7ff6d5893640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d0159600 0x7ff6d00c8190 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800c750 tx=0x7ff6b800cc10 comp rx=0 tx=0).stop 2023-07-06T21:43:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.181+0000 7ff6d5893640 1 -- 172.21.15.55:0/435107555 shutdown_connections 2023-07-06T21:43:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.181+0000 7ff6d5893640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff6b00664b0 0x7ff6b0068960 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.181+0000 7ff6d5893640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6d015cc70 0x7ff6d0157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.181+0000 7ff6d5893640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d0159600 0x7ff6d00c8190 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.181+0000 7ff6d5893640 1 --2- 172.21.15.55:0/435107555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6d006ed10 0x7ff6d014e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.181+0000 7ff6d5893640 1 -- 172.21.15.55:0/435107555 >> 172.21.15.55:0/435107555 conn(0x7ff6d00d0c20 msgr2=0x7ff6d00b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:54.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.181+0000 7ff6d5893640 1 -- 172.21.15.55:0/435107555 shutdown_connections 2023-07-06T21:43:54.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.181+0000 7ff6d5893640 1 -- 172.21.15.55:0/435107555 wait complete. 2023-07-06T21:43:54.207 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-07-06T21:43:54.207 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-07-06T21:43:54.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.349+0000 7f3b23311640 1 Processor -- start 2023-07-06T21:43:54.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.349+0000 7f3b23311640 1 -- start start 2023-07-06T21:43:54.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.349+0000 7f3b23311640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b1c0cc730 0x7f3b1c0c1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:54.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.349+0000 7f3b23311640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1c0ca720 con 0x7f3b1c15ff90 2023-07-06T21:43:54.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.349+0000 7f3b23311640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1c0cba00 con 0x7f3b1c0cd910 2023-07-06T21:43:54.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.349+0000 7f3b23311640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1c160360 con 0x7f3b1c0cc730 2023-07-06T21:43:54.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.349+0000 7f3b210ad640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3b1c15ff90 0x7f3b1c0cd200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40074/0 (socket says 172.21.15.55:40074) 2023-07-06T21:43:54.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.349+0000 7f3b210ad640 1 -- 172.21.15.55:0/2503907080 learned_addr learned my addr 172.21.15.55:0/2503907080 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:54.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.349+0000 7f3b218ae640 1 --2- 172.21.15.55:0/2503907080 >> v2:172.21.15.55:3300/0 conn(0x7f3b1c0cc730 0x7f3b1c0c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:54.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.349+0000 7f3b218ae640 1 -- 172.21.15.55:0/2503907080 >> v1:172.21.15.138:6789/0 conn(0x7f3b1c0cd910 legacy=0x7f3b1c0c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:43:54.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.349+0000 7f3b218ae640 1 -- 172.21.15.55:0/2503907080 >> v1:172.21.15.55:6789/0 conn(0x7f3b1c15ff90 legacy=0x7f3b1c0cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:54.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.349+0000 7f3b218ae640 1 -- 172.21.15.55:0/2503907080 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c06d160 con 0x7f3b1c0cc730 2023-07-06T21:43:54.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.349+0000 7f3b13fff640 1 -- 172.21.15.55:0/2503907080 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965501250 0 0) 0x7f3b1c0ca720 con 0x7f3b1c15ff90 2023-07-06T21:43:54.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.353+0000 7f3b218ae640 1 --2- 172.21.15.55:0/2503907080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c0cc730 0x7f3b1c0c1180 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009d90 tx=0x7f3b1401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9152757eb3f812ac server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:54.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.353+0000 7f3b13fff640 1 -- 172.21.15.55:0/2503907080 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b140a5910 con 0x7f3b1c0cc730 2023-07-06T21:43:54.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.353+0000 7f3b13fff640 1 -- 172.21.15.55:0/2503907080 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b140a5a70 con 0x7f3b1c0cc730 2023-07-06T21:43:54.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.353+0000 7f3b13fff640 1 -- 172.21.15.55:0/2503907080 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b140a5e00 con 0x7f3b1c0cc730 2023-07-06T21:43:54.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.353+0000 7f3b23311640 1 -- 172.21.15.55:0/2503907080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c0cc730 msgr2=0x7f3b1c0c1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:54.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.353+0000 7f3b23311640 1 --2- 172.21.15.55:0/2503907080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c0cc730 0x7f3b1c0c1180 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009d90 tx=0x7f3b1401c850 comp rx=0 tx=0).stop 2023-07-06T21:43:54.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.353+0000 7f3b23311640 1 -- 172.21.15.55:0/2503907080 shutdown_connections 2023-07-06T21:43:54.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.353+0000 7f3b23311640 1 --2- 172.21.15.55:0/2503907080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c0cc730 0x7f3b1c0c1180 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.353+0000 7f3b23311640 1 -- 172.21.15.55:0/2503907080 >> 172.21.15.55:0/2503907080 conn(0x7f3b1c0cde30 msgr2=0x7f3b1c0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:54.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.353+0000 7f3b23311640 1 -- 172.21.15.55:0/2503907080 shutdown_connections 2023-07-06T21:43:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.353+0000 7f3b23311640 1 -- 172.21.15.55:0/2503907080 wait complete. 2023-07-06T21:43:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b23311640 1 Processor -- start 2023-07-06T21:43:54.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b23311640 1 -- start start 2023-07-06T21:43:54.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b23311640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b1c0cc730 0x7f3b1c14f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:54.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b23311640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c0cd910 0x7f3b1c15db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:54.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b23311640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b1c15ff90 0x7f3b1c0b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:54.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b23311640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c0c6fe0 con 0x7f3b1c0cd910 2023-07-06T21:43:54.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b23311640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c0c63d0 con 0x7f3b1c0cc730 2023-07-06T21:43:54.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b23311640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c0c66b0 con 0x7f3b1c15ff90 2023-07-06T21:43:54.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b208ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c0cd910 0x7f3b1c15db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:54.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b210ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b1c0cc730 0x7f3b1c14f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:54.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b208ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c0cd910 0x7f3b1c15db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59192/0 (socket says 172.21.15.55:59192) 2023-07-06T21:43:54.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b208ac640 1 -- 172.21.15.55:0/1279352659 learned_addr learned my addr 172.21.15.55:0/1279352659 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:54.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b218ae640 1 --2- 172.21.15.55:0/1279352659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b1c15ff90 0x7f3b1c0b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b210ad640 1 -- 172.21.15.55:0/1279352659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b1c15ff90 msgr2=0x7f3b1c0b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b210ad640 1 --2- 172.21.15.55:0/1279352659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b1c15ff90 0x7f3b1c0b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b210ad640 1 -- 172.21.15.55:0/1279352659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c0cd910 msgr2=0x7f3b1c15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b210ad640 1 --2- 172.21.15.55:0/1279352659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c0cd910 0x7f3b1c15db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b210ad640 1 -- 172.21.15.55:0/1279352659 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b14009a70 con 0x7f3b1c0cc730 2023-07-06T21:43:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b208ac640 1 --2- 172.21.15.55:0/1279352659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c0cd910 0x7f3b1c15db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:43:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.357+0000 7f3b210ad640 1 --2- 172.21.15.55:0/1279352659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b1c0cc730 0x7f3b1c14f130 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800c460 tx=0x7f3b1800c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.361+0000 7f3b11ffb640 1 -- 172.21.15.55:0/1279352659 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b180074e0 con 0x7f3b1c0cc730 2023-07-06T21:43:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.361+0000 7f3b11ffb640 1 -- 172.21.15.55:0/1279352659 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b18007660 con 0x7f3b1c0cc730 2023-07-06T21:43:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.361+0000 7f3b11ffb640 1 -- 172.21.15.55:0/1279352659 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18004a30 con 0x7f3b1c0cc730 2023-07-06T21:43:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.361+0000 7f3b23311640 1 -- 172.21.15.55:0/1279352659 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1c0c6990 con 0x7f3b1c0cc730 2023-07-06T21:43:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.361+0000 7f3b23311640 1 -- 172.21.15.55:0/1279352659 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1c0c5f60 con 0x7f3b1c0cc730 2023-07-06T21:43:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.361+0000 7f3b23311640 1 -- 172.21.15.55:0/1279352659 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1c0c6e40 con 0x7f3b1c0cc730 2023-07-06T21:43:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.361+0000 7f3b11ffb640 1 -- 172.21.15.55:0/1279352659 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f3b18004b90 con 0x7f3b1c0cc730 2023-07-06T21:43:54.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.361+0000 7f3b11ffb640 1 --2- 172.21.15.55:0/1279352659 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3b00066480 0x7f3b00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:54.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.361+0000 7f3b11ffb640 1 -- 172.21.15.55:0/1279352659 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7f3b18083460 con 0x7f3b1c0cc730 2023-07-06T21:43:54.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.361+0000 7f3b208ac640 1 --2- 172.21.15.55:0/1279352659 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3b00066480 0x7f3b00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:54.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.365+0000 7f3b208ac640 1 --2- 172.21.15.55:0/1279352659 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3b00066480 0x7f3b00068930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c1587f0 tx=0x7f3b0c007ed0 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:54.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.369+0000 7f3b11ffb640 1 -- 172.21.15.55:0/1279352659 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b1c0c6e40 con 0x7f3b1c0cc730 2023-07-06T21:43:54.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.541+0000 7f3b23311640 1 -- 172.21.15.55:0/1279352659 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b1c0cc210 con 0x7f3b00066480 2023-07-06T21:43:54.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.605+0000 7f3b11ffb640 1 -- 172.21.15.55:0/1279352659 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f3b0c004020 con 0x7f3b00066480 2023-07-06T21:43:54.612 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-07-06T21:43:54.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.605+0000 7f3b23311640 1 -- 172.21.15.55:0/1279352659 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3b00066480 msgr2=0x7f3b00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:54.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.605+0000 7f3b23311640 1 --2- 172.21.15.55:0/1279352659 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3b00066480 0x7f3b00068930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c1587f0 tx=0x7f3b0c007ed0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.605+0000 7f3b23311640 1 -- 172.21.15.55:0/1279352659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b1c0cc730 msgr2=0x7f3b1c14f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:54.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.605+0000 7f3b23311640 1 --2- 172.21.15.55:0/1279352659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b1c0cc730 0x7f3b1c14f130 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800c460 tx=0x7f3b1800c920 comp rx=0 tx=0).stop 2023-07-06T21:43:54.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.605+0000 7f3b23311640 1 -- 172.21.15.55:0/1279352659 shutdown_connections 2023-07-06T21:43:54.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.605+0000 7f3b23311640 1 --2- 172.21.15.55:0/1279352659 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3b00066480 0x7f3b00068930 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.605+0000 7f3b23311640 1 --2- 172.21.15.55:0/1279352659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b1c15ff90 0x7f3b1c0b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.605+0000 7f3b23311640 1 --2- 172.21.15.55:0/1279352659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c0cd910 0x7f3b1c15db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.605+0000 7f3b23311640 1 --2- 172.21.15.55:0/1279352659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b1c0cc730 0x7f3b1c14f130 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.605+0000 7f3b23311640 1 -- 172.21.15.55:0/1279352659 >> 172.21.15.55:0/1279352659 conn(0x7f3b1c0cde30 msgr2=0x7f3b1c0ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:54.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.605+0000 7f3b23311640 1 -- 172.21.15.55:0/1279352659 shutdown_connections 2023-07-06T21:43:54.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.605+0000 7f3b23311640 1 -- 172.21.15.55:0/1279352659 wait complete. 2023-07-06T21:43:54.633 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-07-06T21:43:54.633 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-07-06T21:43:54.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.773+0000 7fd09bd96640 1 Processor -- start 2023-07-06T21:43:54.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.773+0000 7fd09bd96640 1 -- start start 2023-07-06T21:43:54.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.773+0000 7fd09bd96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd0940c89b0 0x7fd0940c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:54.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.773+0000 7fd09bd96640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd094158b50 con 0x7fd094158780 2023-07-06T21:43:54.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.773+0000 7fd09bd96640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0940c9350 con 0x7fd0940cbfa0 2023-07-06T21:43:54.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.773+0000 7fd09bd96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09406fb00 con 0x7fd0940c89b0 2023-07-06T21:43:54.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.773+0000 7fd099b32640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd094158780 0x7fd0940cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40090/0 (socket says 172.21.15.55:40090) 2023-07-06T21:43:54.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.773+0000 7fd099b32640 1 -- 172.21.15.55:0/3396751776 learned_addr learned my addr 172.21.15.55:0/3396751776 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:43:54.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.773+0000 7fd09a333640 1 --2- 172.21.15.55:0/3396751776 >> v2:172.21.15.55:3300/0 conn(0x7fd0940c89b0 0x7fd0940c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:54.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.777+0000 7fd09a333640 1 -- 172.21.15.55:0/3396751776 >> v1:172.21.15.138:6789/0 conn(0x7fd0940cbfa0 legacy=0x7fd09406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:54.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.777+0000 7fd09a333640 1 -- 172.21.15.55:0/3396751776 >> v1:172.21.15.55:6789/0 conn(0x7fd094158780 legacy=0x7fd0940cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:54.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.777+0000 7fd09a333640 1 -- 172.21.15.55:0/3396751776 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09406b390 con 0x7fd0940c89b0 2023-07-06T21:43:54.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.777+0000 7fd09a333640 1 --2- 172.21.15.55:0/3396751776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0940c89b0 0x7fd0940c8e10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009d90 tx=0x7fd08c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccdfa5e1aa9ce8d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:54.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.777+0000 7fd098b30640 1 -- 172.21.15.55:0/3396751776 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c0a5870 con 0x7fd0940c89b0 2023-07-06T21:43:54.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.777+0000 7fd098b30640 1 -- 172.21.15.55:0/3396751776 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c0a59d0 con 0x7fd0940c89b0 2023-07-06T21:43:54.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.777+0000 7fd098b30640 1 -- 172.21.15.55:0/3396751776 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c0a5d60 con 0x7fd0940c89b0 2023-07-06T21:43:54.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 -- 172.21.15.55:0/3396751776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0940c89b0 msgr2=0x7fd0940c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 --2- 172.21.15.55:0/3396751776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0940c89b0 0x7fd0940c8e10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009d90 tx=0x7fd08c01c8c0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 -- 172.21.15.55:0/3396751776 shutdown_connections 2023-07-06T21:43:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 --2- 172.21.15.55:0/3396751776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0940c89b0 0x7fd0940c8e10 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 -- 172.21.15.55:0/3396751776 >> 172.21.15.55:0/3396751776 conn(0x7fd0940cde30 msgr2=0x7fd0940ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 -- 172.21.15.55:0/3396751776 shutdown_connections 2023-07-06T21:43:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 -- 172.21.15.55:0/3396751776 wait complete. 2023-07-06T21:43:54.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 Processor -- start 2023-07-06T21:43:54.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 -- start start 2023-07-06T21:43:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0940c89b0 0x7fd09414f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0940cbfa0 0x7fd0940ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd094158780 0x7fd094153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0941599e0 con 0x7fd0940cbfa0 2023-07-06T21:43:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd094158e60 con 0x7fd0940c89b0 2023-07-06T21:43:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09bd96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd094159140 con 0x7fd094158780 2023-07-06T21:43:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd099331640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0940cbfa0 0x7fd0940ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd099331640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0940cbfa0 0x7fd0940ac820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59204/0 (socket says 172.21.15.55:59204) 2023-07-06T21:43:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd099331640 1 -- 172.21.15.55:0/3981897188 learned_addr learned my addr 172.21.15.55:0/3981897188 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:43:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd099b32640 1 --2- 172.21.15.55:0/3981897188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0940c89b0 0x7fd09414f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd09a333640 1 --2- 172.21.15.55:0/3981897188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd094158780 0x7fd094153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd099331640 1 -- 172.21.15.55:0/3981897188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd094158780 msgr2=0x7fd094153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd099331640 1 --2- 172.21.15.55:0/3981897188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd094158780 0x7fd094153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd099331640 1 -- 172.21.15.55:0/3981897188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0940c89b0 msgr2=0x7fd09414f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd099331640 1 --2- 172.21.15.55:0/3981897188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0940c89b0 0x7fd09414f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.781+0000 7fd099331640 1 -- 172.21.15.55:0/3981897188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c009a70 con 0x7fd0940cbfa0 2023-07-06T21:43:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.785+0000 7fd099331640 1 --2- 172.21.15.55:0/3981897188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0940cbfa0 0x7fd0940ac820 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd08400c500 tx=0x7fd08400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.785+0000 7fd08a7fc640 1 -- 172.21.15.55:0/3981897188 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084005220 con 0x7fd0940cbfa0 2023-07-06T21:43:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.785+0000 7fd08a7fc640 1 -- 172.21.15.55:0/3981897188 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd084005380 con 0x7fd0940cbfa0 2023-07-06T21:43:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.785+0000 7fd08a7fc640 1 -- 172.21.15.55:0/3981897188 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084007270 con 0x7fd0940cbfa0 2023-07-06T21:43:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.785+0000 7fd09bd96640 1 -- 172.21.15.55:0/3981897188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd094159420 con 0x7fd0940cbfa0 2023-07-06T21:43:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.785+0000 7fd09bd96640 1 -- 172.21.15.55:0/3981897188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0940acd60 con 0x7fd0940cbfa0 2023-07-06T21:43:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.785+0000 7fd09bd96640 1 -- 172.21.15.55:0/3981897188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd094066d60 con 0x7fd0940cbfa0 2023-07-06T21:43:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.785+0000 7fd08a7fc640 1 -- 172.21.15.55:0/3981897188 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fd0840073d0 con 0x7fd0940cbfa0 2023-07-06T21:43:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.785+0000 7fd08a7fc640 1 --2- 172.21.15.55:0/3981897188 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd0780664b0 0x7fd078068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:43:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.785+0000 7fd08a7fc640 1 -- 172.21.15.55:0/3981897188 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6640+0+0 (secure 0 0 0) 0x7fd0840834c0 con 0x7fd0940cbfa0 2023-07-06T21:43:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.785+0000 7fd099b32640 1 --2- 172.21.15.55:0/3981897188 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd0780664b0 0x7fd078068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:43:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.789+0000 7fd099b32640 1 --2- 172.21.15.55:0/3981897188 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd0780664b0 0x7fd078068960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd090005890 tx=0x7fd090009040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:43:54.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.789+0000 7fd08a7fc640 1 -- 172.21.15.55:0/3981897188 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0840505f0 con 0x7fd0940cbfa0 2023-07-06T21:43:54.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:54.969+0000 7fd09bd96640 1 -- 172.21.15.55:0/3981897188 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0940cd6a0 con 0x7fd0780664b0 2023-07-06T21:43:55.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:55.029+0000 7fd08a7fc640 1 -- 172.21.15.55:0/3981897188 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd090001470 con 0x7fd0780664b0 2023-07-06T21:43:55.039 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-07-06T21:43:55.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:55.033+0000 7fd09bd96640 1 -- 172.21.15.55:0/3981897188 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd0780664b0 msgr2=0x7fd078068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:55.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:55.033+0000 7fd09bd96640 1 --2- 172.21.15.55:0/3981897188 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd0780664b0 0x7fd078068960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd090005890 tx=0x7fd090009040 comp rx=0 tx=0).stop 2023-07-06T21:43:55.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:55.033+0000 7fd09bd96640 1 -- 172.21.15.55:0/3981897188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0940cbfa0 msgr2=0x7fd0940ac820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:43:55.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:55.033+0000 7fd09bd96640 1 --2- 172.21.15.55:0/3981897188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0940cbfa0 0x7fd0940ac820 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd08400c500 tx=0x7fd08400c9c0 comp rx=0 tx=0).stop 2023-07-06T21:43:55.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:55.033+0000 7fd09bd96640 1 -- 172.21.15.55:0/3981897188 shutdown_connections 2023-07-06T21:43:55.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:55.033+0000 7fd09bd96640 1 --2- 172.21.15.55:0/3981897188 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd0780664b0 0x7fd078068960 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:55.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:55.033+0000 7fd09bd96640 1 --2- 172.21.15.55:0/3981897188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd094158780 0x7fd094153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:55.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:55.033+0000 7fd09bd96640 1 --2- 172.21.15.55:0/3981897188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0940cbfa0 0x7fd0940ac820 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:55.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:55.033+0000 7fd09bd96640 1 --2- 172.21.15.55:0/3981897188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0940c89b0 0x7fd09414f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:43:55.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:55.033+0000 7fd09bd96640 1 -- 172.21.15.55:0/3981897188 >> 172.21.15.55:0/3981897188 conn(0x7fd0940cde30 msgr2=0x7fd0940ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:43:55.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:55.033+0000 7fd09bd96640 1 -- 172.21.15.55:0/3981897188 shutdown_connections 2023-07-06T21:43:55.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:43:55.033+0000 7fd09bd96640 1 -- 172.21.15.55:0/3981897188 wait complete. 2023-07-06T21:43:55.060 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-07-06T21:44:00.056 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:44:00.045+0000 7f229197f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:44:00.056 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:44:00.045+0000 7f229197f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:44:00.056 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:44:00.045+0000 7f229197f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:44:00.057 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:44:00.045+0000 7f229197f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:44:00.057 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:44:00.045+0000 7f229197f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:44:04.540 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:44:04.545 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:44:34.601 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:44:34.605 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:45:04.683 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:45:04.687 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:45:34.747 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:45:34.751 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:46:04.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:46:04.815 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:46:34.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:46:34.878 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:47:04.947 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:47:04.952 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:47:35.010 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:47:35.014 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:48:00.607 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:48:00.603+0000 7f229197f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:48:00.607 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:48:00.603+0000 7f229197f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:48:00.607 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:48:00.603+0000 7f229197f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:48:00.608 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:48:00.603+0000 7f229197f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:48:00.608 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:48:00.603+0000 7f229197f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:48:05.065 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:48:05.069 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:48:35.130 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:48:35.134 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:49:05.426 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:49:05.431 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:49:35.565 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:49:35.570 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:50:05.630 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:50:05.635 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:50:35.692 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:50:35.696 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:51:05.989 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:51:05.995 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:51:36.228 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:51:36.232 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:52:06.274 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:52:06.278 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:52:36.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:52:36.342 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:53:06.402 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:53:06.405 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:53:36.466 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:53:36.470 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:54:06.520 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:54:06.524 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:54:20.061 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-07-06T21:54:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.219+0000 7f7b2e46d640 1 Processor -- start 2023-07-06T21:54:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.219+0000 7f7b2e46d640 1 -- start start 2023-07-06T21:54:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.223+0000 7f7b2e46d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7b280ccb70 0x7f7b2815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.223+0000 7f7b2e46d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7b280693f0 0x7f7b28069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.223+0000 7f7b2e46d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b280b3e70 con 0x7f7b280c9b90 2023-07-06T21:54:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.223+0000 7f7b2e46d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b28159c30 con 0x7f7b280ccb70 2023-07-06T21:54:20.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.223+0000 7f7b2e46d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b280c9070 con 0x7f7b280693f0 2023-07-06T21:54:20.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.223+0000 7f7b1ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7b280ccb70 0x7f7b2815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:20.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.223+0000 7f7b27fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7b280c9b90 0x7f7b280c9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56432/0 (socket says 172.21.15.55:56432) 2023-07-06T21:54:20.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.223+0000 7f7b27fff640 1 -- 172.21.15.55:0/3268877246 learned_addr learned my addr 172.21.15.55:0/3268877246 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.223+0000 7f7b2ca0a640 1 --2- 172.21.15.55:0/3268877246 >> v2:172.21.15.138:3300/0 conn(0x7f7b280693f0 0x7f7b28069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.223+0000 7f7b1ffff640 1 -- 172.21.15.55:0/3268877246 >> v2:172.21.15.138:3300/0 conn(0x7f7b280693f0 msgr2=0x7f7b28069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.223+0000 7f7b1ffff640 1 --2- 172.21.15.55:0/3268877246 >> v2:172.21.15.138:3300/0 conn(0x7f7b280693f0 0x7f7b28069810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.223+0000 7f7b1ffff640 1 -- 172.21.15.55:0/3268877246 >> v1:172.21.15.55:6789/0 conn(0x7f7b280c9b90 legacy=0x7f7b280c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.223+0000 7f7b1ffff640 1 -- 172.21.15.55:0/3268877246 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b280c8480 con 0x7f7b280ccb70 2023-07-06T21:54:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.223+0000 7f7b277fe640 1 -- 172.21.15.55:0/3268877246 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313185852 0 0) 0x7f7b18001120 con 0x7f7b280c9b90 2023-07-06T21:54:20.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.227+0000 7f7b1ffff640 1 --2- 172.21.15.55:0/3268877246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b280ccb70 0x7f7b2815dd50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7b280cee10 tx=0x7f7b1001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e971db76be547a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:20.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.227+0000 7f7b277fe640 1 -- 172.21.15.55:0/3268877246 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b100ac640 con 0x7f7b280ccb70 2023-07-06T21:54:20.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.227+0000 7f7b277fe640 1 -- 172.21.15.55:0/3268877246 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b100ac7a0 con 0x7f7b280ccb70 2023-07-06T21:54:20.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.227+0000 7f7b277fe640 1 -- 172.21.15.55:0/3268877246 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b100acb30 con 0x7f7b280ccb70 2023-07-06T21:54:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.227+0000 7f7b2e46d640 1 -- 172.21.15.55:0/3268877246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b280ccb70 msgr2=0x7f7b2815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.227+0000 7f7b2e46d640 1 --2- 172.21.15.55:0/3268877246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b280ccb70 0x7f7b2815dd50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7b280cee10 tx=0x7f7b1001c460 comp rx=0 tx=0).stop 2023-07-06T21:54:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.227+0000 7f7b2e46d640 1 -- 172.21.15.55:0/3268877246 shutdown_connections 2023-07-06T21:54:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.227+0000 7f7b2e46d640 1 --2- 172.21.15.55:0/3268877246 >> v2:172.21.15.138:3300/0 conn(0x7f7b280693f0 0x7f7b28069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.227+0000 7f7b2e46d640 1 --2- 172.21.15.55:0/3268877246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b280ccb70 0x7f7b2815dd50 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.227+0000 7f7b2e46d640 1 -- 172.21.15.55:0/3268877246 >> 172.21.15.55:0/3268877246 conn(0x7f7b280cde30 msgr2=0x7f7b280ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.227+0000 7f7b2e46d640 1 -- 172.21.15.55:0/3268877246 shutdown_connections 2023-07-06T21:54:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.227+0000 7f7b2e46d640 1 -- 172.21.15.55:0/3268877246 wait complete. 2023-07-06T21:54:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.227+0000 7f7b2e46d640 1 Processor -- start 2023-07-06T21:54:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.227+0000 7f7b2e46d640 1 -- start start 2023-07-06T21:54:20.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2e46d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b280693f0 0x7f7b281525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:20.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2e46d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b280c9b90 0x7f7b28154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:20.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2e46d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b280ccb70 0x7f7b281553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:20.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2e46d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28158410 con 0x7f7b280ccb70 2023-07-06T21:54:20.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2e46d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28158c20 con 0x7f7b280c9b90 2023-07-06T21:54:20.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2e46d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28158660 con 0x7f7b280693f0 2023-07-06T21:54:20.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2ca0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b280ccb70 0x7f7b281553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:20.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2ca0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b280ccb70 0x7f7b281553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59720/0 (socket says 172.21.15.55:59720) 2023-07-06T21:54:20.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2ca0a640 1 -- 172.21.15.55:0/2461469289 learned_addr learned my addr 172.21.15.55:0/2461469289 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:20.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b1ffff640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b280c9b90 0x7f7b28154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:20.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b27fff640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b280693f0 0x7f7b281525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:20.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2ca0a640 1 -- 172.21.15.55:0/2461469289 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b280693f0 msgr2=0x7f7b281525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:20.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2ca0a640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b280693f0 0x7f7b281525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2ca0a640 1 -- 172.21.15.55:0/2461469289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b280c9b90 msgr2=0x7f7b28154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:20.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2ca0a640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b280c9b90 0x7f7b28154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2ca0a640 1 -- 172.21.15.55:0/2461469289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b10009420 con 0x7f7b280ccb70 2023-07-06T21:54:20.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b27fff640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b280693f0 0x7f7b281525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:20.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2ca0a640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b280ccb70 0x7f7b281553c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7b20007e60 tx=0x7f7b2000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:20.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b257fa640 1 -- 172.21.15.55:0/2461469289 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20014420 con 0x7f7b280ccb70 2023-07-06T21:54:20.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b257fa640 1 -- 172.21.15.55:0/2461469289 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b200145a0 con 0x7f7b280ccb70 2023-07-06T21:54:20.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b257fa640 1 -- 172.21.15.55:0/2461469289 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20014950 con 0x7f7b280ccb70 2023-07-06T21:54:20.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2e46d640 1 -- 172.21.15.55:0/2461469289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b28158940 con 0x7f7b280ccb70 2023-07-06T21:54:20.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2e46d640 1 -- 172.21.15.55:0/2461469289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b28154170 con 0x7f7b280ccb70 2023-07-06T21:54:20.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b2e46d640 1 -- 172.21.15.55:0/2461469289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b280c94e0 con 0x7f7b280ccb70 2023-07-06T21:54:20.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.231+0000 7f7b257fa640 1 -- 172.21.15.55:0/2461469289 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f7b20014ab0 con 0x7f7b280ccb70 2023-07-06T21:54:20.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.235+0000 7f7b257fa640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7b08066450 0x7f7b08068900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:20.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.235+0000 7f7b257fa640 1 -- 172.21.15.55:0/2461469289 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f7b20084bd0 con 0x7f7b280ccb70 2023-07-06T21:54:20.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.235+0000 7f7b27fff640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7b08066450 0x7f7b08068900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:20.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.235+0000 7f7b27fff640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7b08066450 0x7f7b08068900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b18000f70 tx=0x7f7b18007a60 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:20.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.239+0000 7f7b257fa640 1 -- 172.21.15.55:0/2461469289 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7b280c94e0 con 0x7f7b280ccb70 2023-07-06T21:54:20.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.415+0000 7f7b2e46d640 1 -- 172.21.15.55:0/2461469289 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b280c8d00 con 0x7f7b08066450 2023-07-06T21:54:20.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.491+0000 7f7b257fa640 1 -- 172.21.15.55:0/2461469289 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7b18007c50 con 0x7f7b08066450 2023-07-06T21:54:20.491 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-07-06T21:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.491+0000 7f7b2e46d640 1 -- 172.21.15.55:0/2461469289 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7b08066450 msgr2=0x7f7b08068900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.491+0000 7f7b2e46d640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7b08066450 0x7f7b08068900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b18000f70 tx=0x7f7b18007a60 comp rx=0 tx=0).stop 2023-07-06T21:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.491+0000 7f7b2e46d640 1 -- 172.21.15.55:0/2461469289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b280ccb70 msgr2=0x7f7b281553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.491+0000 7f7b2e46d640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b280ccb70 0x7f7b281553c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7b20007e60 tx=0x7f7b2000e4b0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.491+0000 7f7b2e46d640 1 -- 172.21.15.55:0/2461469289 shutdown_connections 2023-07-06T21:54:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.491+0000 7f7b2e46d640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7b08066450 0x7f7b08068900 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.491+0000 7f7b2e46d640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b280ccb70 0x7f7b281553c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.491+0000 7f7b2e46d640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b280c9b90 0x7f7b28154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.491+0000 7f7b2e46d640 1 --2- 172.21.15.55:0/2461469289 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b280693f0 0x7f7b281525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.491+0000 7f7b2e46d640 1 -- 172.21.15.55:0/2461469289 >> 172.21.15.55:0/2461469289 conn(0x7f7b280cde30 msgr2=0x7f7b2806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.491+0000 7f7b2e46d640 1 -- 172.21.15.55:0/2461469289 shutdown_connections 2023-07-06T21:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.491+0000 7f7b2e46d640 1 -- 172.21.15.55:0/2461469289 wait complete. 2023-07-06T21:54:20.512 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-07-06T21:54:20.512 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-07-06T21:54:20.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.659+0000 7fe51c79f640 1 Processor -- start 2023-07-06T21:54:20.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.659+0000 7fe51c79f640 1 -- start start 2023-07-06T21:54:20.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.663+0000 7fe51c79f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe514158780 0x7fe5140cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:20.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.663+0000 7fe51c79f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe5140c89b0 0x7fe5140c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:20.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.663+0000 7fe51c79f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe514158b50 con 0x7fe5140cbfa0 2023-07-06T21:54:20.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.663+0000 7fe51c79f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe51406fb00 con 0x7fe514158780 2023-07-06T21:54:20.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.663+0000 7fe51c79f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe51406b390 con 0x7fe5140c89b0 2023-07-06T21:54:20.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.663+0000 7fe51a53b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe514158780 0x7fe5140cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:20.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.663+0000 7fe519d3a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe5140cbfa0 0x7fe51406f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56442/0 (socket says 172.21.15.55:56442) 2023-07-06T21:54:20.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.663+0000 7fe519d3a640 1 -- 172.21.15.55:0/2074661122 learned_addr learned my addr 172.21.15.55:0/2074661122 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:20.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.663+0000 7fe51a53b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe514158780 0x7fe5140cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59728/0 (socket says 172.21.15.55:59728) 2023-07-06T21:54:20.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.663+0000 7fe51a53b640 1 -- 172.21.15.55:0/2074661122 >> v2:172.21.15.138:3300/0 conn(0x7fe5140c89b0 msgr2=0x7fe5140c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:20.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.663+0000 7fe51a53b640 1 --2- 172.21.15.55:0/2074661122 >> v2:172.21.15.138:3300/0 conn(0x7fe5140c89b0 0x7fe5140c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.663+0000 7fe51a53b640 1 -- 172.21.15.55:0/2074661122 >> v1:172.21.15.55:6789/0 conn(0x7fe5140cbfa0 legacy=0x7fe51406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:20.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.663+0000 7fe51a53b640 1 -- 172.21.15.55:0/2074661122 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5140c9350 con 0x7fe514158780 2023-07-06T21:54:20.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.663+0000 7fe519539640 1 -- 172.21.15.55:0/2074661122 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980521282 0 0) 0x7fe514158b50 con 0x7fe5140cbfa0 2023-07-06T21:54:20.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51a53b640 1 --2- 172.21.15.55:0/2074661122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe514158780 0x7fe5140cce90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe51415d280 tx=0x7fe51001e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5b82791a394b02 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe519539640 1 -- 172.21.15.55:0/2074661122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5100ac640 con 0x7fe514158780 2023-07-06T21:54:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe519539640 1 -- 172.21.15.55:0/2074661122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5100ac7a0 con 0x7fe514158780 2023-07-06T21:54:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe519539640 1 -- 172.21.15.55:0/2074661122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5100acb30 con 0x7fe514158780 2023-07-06T21:54:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 -- 172.21.15.55:0/2074661122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe514158780 msgr2=0x7fe5140cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 --2- 172.21.15.55:0/2074661122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe514158780 0x7fe5140cce90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe51415d280 tx=0x7fe51001e5e0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 -- 172.21.15.55:0/2074661122 shutdown_connections 2023-07-06T21:54:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 --2- 172.21.15.55:0/2074661122 >> v2:172.21.15.138:3300/0 conn(0x7fe5140c89b0 0x7fe5140c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 --2- 172.21.15.55:0/2074661122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe514158780 0x7fe5140cce90 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 -- 172.21.15.55:0/2074661122 >> 172.21.15.55:0/2074661122 conn(0x7fe5140cde30 msgr2=0x7fe5140ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 -- 172.21.15.55:0/2074661122 shutdown_connections 2023-07-06T21:54:20.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 -- 172.21.15.55:0/2074661122 wait complete. 2023-07-06T21:54:20.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 Processor -- start 2023-07-06T21:54:20.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 -- start start 2023-07-06T21:54:20.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5140c89b0 0x7fe5140b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:20.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5140cbfa0 0x7fe514070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:20.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe514158780 0x7fe5141460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:20.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe514159550 con 0x7fe514158780 2023-07-06T21:54:20.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe514158bf0 con 0x7fe5140cbfa0 2023-07-06T21:54:20.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.667+0000 7fe51c79f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5140b1260 con 0x7fe5140c89b0 2023-07-06T21:54:20.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe51ad3c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe514158780 0x7fe5141460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:20.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe51a53b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5140c89b0 0x7fe5140b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:20.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe519d3a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5140cbfa0 0x7fe514070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:20.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe51ad3c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe514158780 0x7fe5141460e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59744/0 (socket says 172.21.15.55:59744) 2023-07-06T21:54:20.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe51ad3c640 1 -- 172.21.15.55:0/49625113 learned_addr learned my addr 172.21.15.55:0/49625113 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe51a53b640 1 -- 172.21.15.55:0/49625113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5140cbfa0 msgr2=0x7fe514070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe51a53b640 1 --2- 172.21.15.55:0/49625113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5140cbfa0 0x7fe514070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe51a53b640 1 -- 172.21.15.55:0/49625113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe514158780 msgr2=0x7fe5141460e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe51a53b640 1 --2- 172.21.15.55:0/49625113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe514158780 0x7fe5141460e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe51a53b640 1 -- 172.21.15.55:0/49625113 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe510009420 con 0x7fe5140c89b0 2023-07-06T21:54:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe51ad3c640 1 --2- 172.21.15.55:0/49625113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe514158780 0x7fe5141460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe51a53b640 1 --2- 172.21.15.55:0/49625113 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5140c89b0 0x7fe5140b0d20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe5100ad000 tx=0x7fe51001ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe50affd640 1 -- 172.21.15.55:0/49625113 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5100b5420 con 0x7fe5140c89b0 2023-07-06T21:54:20.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe51c79f640 1 -- 172.21.15.55:0/49625113 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe514158e90 con 0x7fe5140c89b0 2023-07-06T21:54:20.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe50affd640 1 -- 172.21.15.55:0/49625113 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5100b55a0 con 0x7fe5140c89b0 2023-07-06T21:54:20.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe50affd640 1 -- 172.21.15.55:0/49625113 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5100b5950 con 0x7fe5140c89b0 2023-07-06T21:54:20.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe51c79f640 1 -- 172.21.15.55:0/49625113 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51415b920 con 0x7fe5140c89b0 2023-07-06T21:54:20.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe51c79f640 1 -- 172.21.15.55:0/49625113 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe514066d60 con 0x7fe5140c89b0 2023-07-06T21:54:20.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.671+0000 7fe50affd640 1 -- 172.21.15.55:0/49625113 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fe5100aa050 con 0x7fe5140c89b0 2023-07-06T21:54:20.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.675+0000 7fe50affd640 1 --2- 172.21.15.55:0/49625113 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fe4f8066480 0x7fe4f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:20.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.675+0000 7fe50affd640 1 -- 172.21.15.55:0/49625113 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7fe51011f070 con 0x7fe5140c89b0 2023-07-06T21:54:20.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.675+0000 7fe519d3a640 1 --2- 172.21.15.55:0/49625113 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fe4f8066480 0x7fe4f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:20.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.675+0000 7fe519d3a640 1 --2- 172.21.15.55:0/49625113 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fe4f8066480 0x7fe4f8068930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe5140c9cd0 tx=0x7fe504007d60 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.679+0000 7fe50affd640 1 -- 172.21.15.55:0/49625113 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe5100ec030 con 0x7fe5140c89b0 2023-07-06T21:54:20.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.851+0000 7fe51c79f640 1 -- 172.21.15.55:0/49625113 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe51406bbf0 con 0x7fe4f8066480 2023-07-06T21:54:20.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.923+0000 7fe50affd640 1 -- 172.21.15.55:0/49625113 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fe504004c80 con 0x7fe4f8066480 2023-07-06T21:54:20.923 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-07-06T21:54:20.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.923+0000 7fe51c79f640 1 -- 172.21.15.55:0/49625113 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fe4f8066480 msgr2=0x7fe4f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:20.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.923+0000 7fe51c79f640 1 --2- 172.21.15.55:0/49625113 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fe4f8066480 0x7fe4f8068930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe5140c9cd0 tx=0x7fe504007d60 comp rx=0 tx=0).stop 2023-07-06T21:54:20.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.923+0000 7fe51c79f640 1 -- 172.21.15.55:0/49625113 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5140c89b0 msgr2=0x7fe5140b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:20.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.923+0000 7fe51c79f640 1 --2- 172.21.15.55:0/49625113 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5140c89b0 0x7fe5140b0d20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe5100ad000 tx=0x7fe51001ce20 comp rx=0 tx=0).stop 2023-07-06T21:54:20.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.923+0000 7fe51c79f640 1 -- 172.21.15.55:0/49625113 shutdown_connections 2023-07-06T21:54:20.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.923+0000 7fe51c79f640 1 --2- 172.21.15.55:0/49625113 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fe4f8066480 0x7fe4f8068930 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.923+0000 7fe51c79f640 1 --2- 172.21.15.55:0/49625113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe514158780 0x7fe5141460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.923+0000 7fe51c79f640 1 --2- 172.21.15.55:0/49625113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5140cbfa0 0x7fe514070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.923+0000 7fe51c79f640 1 --2- 172.21.15.55:0/49625113 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5140c89b0 0x7fe5140b0d20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:20.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.923+0000 7fe51c79f640 1 -- 172.21.15.55:0/49625113 >> 172.21.15.55:0/49625113 conn(0x7fe5140cde30 msgr2=0x7fe514069b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:20.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.923+0000 7fe51c79f640 1 -- 172.21.15.55:0/49625113 shutdown_connections 2023-07-06T21:54:20.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:20.923+0000 7fe51c79f640 1 -- 172.21.15.55:0/49625113 wait complete. 2023-07-06T21:54:20.943 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-07-06T21:54:20.943 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-07-06T21:54:21.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.091+0000 7fc06620b640 1 Processor -- start 2023-07-06T21:54:21.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.091+0000 7fc06620b640 1 -- start start 2023-07-06T21:54:21.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.091+0000 7fc06620b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc0600ccb70 0x7fc06015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.091+0000 7fc06620b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0600693f0 0x7fc060069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.091+0000 7fc06620b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0600b3e70 con 0x7fc0600c9b90 2023-07-06T21:54:21.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.091+0000 7fc06620b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc060159c30 con 0x7fc0600693f0 2023-07-06T21:54:21.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.091+0000 7fc06620b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0600c9070 con 0x7fc0600ccb70 2023-07-06T21:54:21.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.091+0000 7fc05ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0600693f0 0x7fc060069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.091+0000 7fc05ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0600693f0 0x7fc060069810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59756/0 (socket says 172.21.15.55:59756) 2023-07-06T21:54:21.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.091+0000 7fc05ffff640 1 -- 172.21.15.55:0/1961699325 learned_addr learned my addr 172.21.15.55:0/1961699325 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:21.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.091+0000 7fc05effd640 1 --2- 172.21.15.55:0/1961699325 >> v2:172.21.15.138:3300/0 conn(0x7fc0600ccb70 0x7fc06015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.095+0000 7fc05ffff640 1 -- 172.21.15.55:0/1961699325 >> v2:172.21.15.138:3300/0 conn(0x7fc0600ccb70 msgr2=0x7fc06015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:21.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.095+0000 7fc05ffff640 1 --2- 172.21.15.55:0/1961699325 >> v2:172.21.15.138:3300/0 conn(0x7fc0600ccb70 0x7fc06015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.095+0000 7fc05ffff640 1 -- 172.21.15.55:0/1961699325 >> v1:172.21.15.138:6789/0 conn(0x7fc0600c9b90 legacy=0x7fc0600c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.095+0000 7fc05ffff640 1 -- 172.21.15.55:0/1961699325 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0600c8480 con 0x7fc0600693f0 2023-07-06T21:54:21.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.095+0000 7fc05ffff640 1 --2- 172.21.15.55:0/1961699325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0600693f0 0x7fc060069810 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc0600ccb00 tx=0x7fc05801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70b891b7082111c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:21.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.095+0000 7fc05e7fc640 1 -- 172.21.15.55:0/1961699325 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0580a5720 con 0x7fc0600693f0 2023-07-06T21:54:21.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.095+0000 7fc05e7fc640 1 -- 172.21.15.55:0/1961699325 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0580a5880 con 0x7fc0600693f0 2023-07-06T21:54:21.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.095+0000 7fc05e7fc640 1 -- 172.21.15.55:0/1961699325 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0580a5c10 con 0x7fc0600693f0 2023-07-06T21:54:21.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.095+0000 7fc06620b640 1 -- 172.21.15.55:0/1961699325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0600693f0 msgr2=0x7fc060069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.095+0000 7fc06620b640 1 --2- 172.21.15.55:0/1961699325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0600693f0 0x7fc060069810 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc0600ccb00 tx=0x7fc05801c9d0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.095+0000 7fc06620b640 1 -- 172.21.15.55:0/1961699325 shutdown_connections 2023-07-06T21:54:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.095+0000 7fc06620b640 1 --2- 172.21.15.55:0/1961699325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0600693f0 0x7fc060069810 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.095+0000 7fc06620b640 1 --2- 172.21.15.55:0/1961699325 >> v2:172.21.15.138:3300/0 conn(0x7fc0600ccb70 0x7fc06015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.095+0000 7fc06620b640 1 -- 172.21.15.55:0/1961699325 >> 172.21.15.55:0/1961699325 conn(0x7fc0600cde30 msgr2=0x7fc0600ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc06620b640 1 -- 172.21.15.55:0/1961699325 shutdown_connections 2023-07-06T21:54:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc06620b640 1 -- 172.21.15.55:0/1961699325 wait complete. 2023-07-06T21:54:21.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc06620b640 1 Processor -- start 2023-07-06T21:54:21.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc06620b640 1 -- start start 2023-07-06T21:54:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc06620b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0600693f0 0x7fc0600b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc06620b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0600c9b90 0x7fc06015c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc06620b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0600ccb70 0x7fc060159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc06620b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0600b2330 con 0x7fc0600c9b90 2023-07-06T21:54:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc06620b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0600b30d0 con 0x7fc0600ccb70 2023-07-06T21:54:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc06620b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0600b1290 con 0x7fc0600693f0 2023-07-06T21:54:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc05effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0600c9b90 0x7fc06015c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc05effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0600c9b90 0x7fc06015c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59764/0 (socket says 172.21.15.55:59764) 2023-07-06T21:54:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc05effd640 1 -- 172.21.15.55:0/2110487387 learned_addr learned my addr 172.21.15.55:0/2110487387 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:21.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc05f7fe640 1 --2- 172.21.15.55:0/2110487387 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0600693f0 0x7fc0600b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc05ffff640 1 --2- 172.21.15.55:0/2110487387 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0600ccb70 0x7fc060159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc05effd640 1 -- 172.21.15.55:0/2110487387 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0600693f0 msgr2=0x7fc0600b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc05effd640 1 --2- 172.21.15.55:0/2110487387 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0600693f0 0x7fc0600b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc05effd640 1 -- 172.21.15.55:0/2110487387 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0600ccb70 msgr2=0x7fc060159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc05effd640 1 --2- 172.21.15.55:0/2110487387 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0600ccb70 0x7fc060159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc05effd640 1 -- 172.21.15.55:0/2110487387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc058009b30 con 0x7fc0600c9b90 2023-07-06T21:54:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.099+0000 7fc05effd640 1 --2- 172.21.15.55:0/2110487387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0600c9b90 0x7fc06015c280 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc05400e930 tx=0x7fc05400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.103+0000 7fc047fff640 1 -- 172.21.15.55:0/2110487387 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054009690 con 0x7fc0600c9b90 2023-07-06T21:54:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.103+0000 7fc06620b640 1 -- 172.21.15.55:0/2110487387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0600b1570 con 0x7fc0600c9b90 2023-07-06T21:54:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.103+0000 7fc047fff640 1 -- 172.21.15.55:0/2110487387 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05400ca00 con 0x7fc0600c9b90 2023-07-06T21:54:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.103+0000 7fc047fff640 1 -- 172.21.15.55:0/2110487387 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05400cd70 con 0x7fc0600c9b90 2023-07-06T21:54:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.103+0000 7fc06620b640 1 -- 172.21.15.55:0/2110487387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0600b1b30 con 0x7fc0600c9b90 2023-07-06T21:54:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.103+0000 7fc06620b640 1 -- 172.21.15.55:0/2110487387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc060066d60 con 0x7fc0600c9b90 2023-07-06T21:54:21.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.103+0000 7fc047fff640 1 -- 172.21.15.55:0/2110487387 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fc054013470 con 0x7fc0600c9b90 2023-07-06T21:54:21.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.103+0000 7fc047fff640 1 --2- 172.21.15.55:0/2110487387 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc04c066480 0x7fc04c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.103+0000 7fc047fff640 1 -- 172.21.15.55:0/2110487387 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7fc0540844d0 con 0x7fc0600c9b90 2023-07-06T21:54:21.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.103+0000 7fc05f7fe640 1 --2- 172.21.15.55:0/2110487387 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc04c066480 0x7fc04c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.103+0000 7fc05f7fe640 1 --2- 172.21.15.55:0/2110487387 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc04c066480 0x7fc04c068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc050007fd0 tx=0x7fc050009040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:21.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.107+0000 7fc047fff640 1 -- 172.21.15.55:0/2110487387 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc0540515d0 con 0x7fc0600c9b90 2023-07-06T21:54:21.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.283+0000 7fc06620b640 1 -- 172.21.15.55:0/2110487387 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0600c8d00 con 0x7fc04c066480 2023-07-06T21:54:21.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.359+0000 7fc047fff640 1 -- 172.21.15.55:0/2110487387 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc0500014f0 con 0x7fc04c066480 2023-07-06T21:54:21.358 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-07-06T21:54:21.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.359+0000 7fc06620b640 1 -- 172.21.15.55:0/2110487387 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc04c066480 msgr2=0x7fc04c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.359+0000 7fc06620b640 1 --2- 172.21.15.55:0/2110487387 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc04c066480 0x7fc04c068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc050007fd0 tx=0x7fc050009040 comp rx=0 tx=0).stop 2023-07-06T21:54:21.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.359+0000 7fc06620b640 1 -- 172.21.15.55:0/2110487387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0600c9b90 msgr2=0x7fc06015c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.359+0000 7fc06620b640 1 --2- 172.21.15.55:0/2110487387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0600c9b90 0x7fc06015c280 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc05400e930 tx=0x7fc05400edf0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.359+0000 7fc06620b640 1 -- 172.21.15.55:0/2110487387 shutdown_connections 2023-07-06T21:54:21.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.359+0000 7fc06620b640 1 --2- 172.21.15.55:0/2110487387 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc04c066480 0x7fc04c068930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.359+0000 7fc06620b640 1 --2- 172.21.15.55:0/2110487387 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0600ccb70 0x7fc060159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.359+0000 7fc06620b640 1 --2- 172.21.15.55:0/2110487387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0600c9b90 0x7fc06015c280 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.359+0000 7fc06620b640 1 --2- 172.21.15.55:0/2110487387 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0600693f0 0x7fc0600b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.359+0000 7fc06620b640 1 -- 172.21.15.55:0/2110487387 >> 172.21.15.55:0/2110487387 conn(0x7fc0600cde30 msgr2=0x7fc06015d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:21.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.359+0000 7fc06620b640 1 -- 172.21.15.55:0/2110487387 shutdown_connections 2023-07-06T21:54:21.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.359+0000 7fc06620b640 1 -- 172.21.15.55:0/2110487387 wait complete. 2023-07-06T21:54:21.378 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-07-06T21:54:21.379 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-07-06T21:54:21.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c8c1ad640 1 Processor -- start 2023-07-06T21:54:21.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c8c1ad640 1 -- start start 2023-07-06T21:54:21.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c8c1ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7c84158780 0x7f7c840cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c8c1ad640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7c840cbfa0 0x7f7c8406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c8c1ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c840c89b0 0x7f7c840c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c8c1ad640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c840c9370 con 0x7f7c84158780 2023-07-06T21:54:21.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c8c1ad640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c84158b50 con 0x7f7c840cbfa0 2023-07-06T21:54:21.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c8c1ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8406b390 con 0x7f7c840c89b0 2023-07-06T21:54:21.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c89f49640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7c84158780 0x7f7c840cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c89f49640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7c84158780 0x7f7c840cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59780/0 (socket says 172.21.15.55:59780) 2023-07-06T21:54:21.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c89f49640 1 -- 172.21.15.55:0/4258426962 learned_addr learned my addr 172.21.15.55:0/4258426962 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:21.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c89748640 1 --2- 172.21.15.55:0/4258426962 >> v2:172.21.15.138:3300/0 conn(0x7f7c840cbfa0 0x7f7c8406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c8a74a640 1 --2- 172.21.15.55:0/4258426962 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c840c89b0 0x7f7c840c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c89f49640 1 -- 172.21.15.55:0/4258426962 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c840c89b0 msgr2=0x7f7c840c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:21.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c89f49640 1 --2- 172.21.15.55:0/4258426962 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c840c89b0 0x7f7c840c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c89f49640 1 -- 172.21.15.55:0/4258426962 >> v2:172.21.15.138:3300/0 conn(0x7f7c840cbfa0 msgr2=0x7f7c8406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:21.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c89f49640 1 --2- 172.21.15.55:0/4258426962 >> v2:172.21.15.138:3300/0 conn(0x7f7c840cbfa0 0x7f7c8406f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.527+0000 7f7c89f49640 1 -- 172.21.15.55:0/4258426962 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c840cd3d0 con 0x7f7c84158780 2023-07-06T21:54:21.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.531+0000 7f7c89f49640 1 --2- 172.21.15.55:0/4258426962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c84158780 0x7f7c840cce90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7c8406ae20 tx=0x7f7c8001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace4f929a5b30108 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:21.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.531+0000 7f7c88f47640 1 -- 172.21.15.55:0/4258426962 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c800ab600 con 0x7f7c84158780 2023-07-06T21:54:21.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.531+0000 7f7c88f47640 1 -- 172.21.15.55:0/4258426962 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c800a7050 con 0x7f7c84158780 2023-07-06T21:54:21.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.531+0000 7f7c88f47640 1 -- 172.21.15.55:0/4258426962 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c800ab980 con 0x7f7c84158780 2023-07-06T21:54:21.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.531+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/4258426962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c84158780 msgr2=0x7f7c840cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.531+0000 7f7c8c1ad640 1 --2- 172.21.15.55:0/4258426962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c84158780 0x7f7c840cce90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7c8406ae20 tx=0x7f7c8001c470 comp rx=0 tx=0).stop 2023-07-06T21:54:21.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.531+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/4258426962 shutdown_connections 2023-07-06T21:54:21.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.531+0000 7f7c8c1ad640 1 --2- 172.21.15.55:0/4258426962 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c840c89b0 0x7f7c840c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.531+0000 7f7c8c1ad640 1 --2- 172.21.15.55:0/4258426962 >> v2:172.21.15.138:3300/0 conn(0x7f7c840cbfa0 0x7f7c8406f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.531+0000 7f7c8c1ad640 1 --2- 172.21.15.55:0/4258426962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c84158780 0x7f7c840cce90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.531+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/4258426962 >> 172.21.15.55:0/4258426962 conn(0x7f7c840cde30 msgr2=0x7f7c840ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.531+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/4258426962 shutdown_connections 2023-07-06T21:54:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.531+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/4258426962 wait complete. 2023-07-06T21:54:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c8c1ad640 1 Processor -- start 2023-07-06T21:54:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c8c1ad640 1 -- start start 2023-07-06T21:54:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c8c1ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c840c89b0 0x7f7c841502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c8c1ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c840cbfa0 0x7f7c8415c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c8c1ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c84158780 0x7f7c8415c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c8c1ad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c84157ea0 con 0x7f7c840c89b0 2023-07-06T21:54:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c8c1ad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c841f45b0 con 0x7f7c840cbfa0 2023-07-06T21:54:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c8c1ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c841f3c80 con 0x7f7c84158780 2023-07-06T21:54:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c89f49640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c840c89b0 0x7f7c841502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c89f49640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c840c89b0 0x7f7c841502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59790/0 (socket says 172.21.15.55:59790) 2023-07-06T21:54:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c89f49640 1 -- 172.21.15.55:0/290270151 learned_addr learned my addr 172.21.15.55:0/290270151 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c89748640 1 --2- 172.21.15.55:0/290270151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c840cbfa0 0x7f7c8415c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c8a74a640 1 --2- 172.21.15.55:0/290270151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c84158780 0x7f7c8415c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c89f49640 1 -- 172.21.15.55:0/290270151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c84158780 msgr2=0x7f7c8415c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c89f49640 1 --2- 172.21.15.55:0/290270151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c84158780 0x7f7c8415c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c89f49640 1 -- 172.21.15.55:0/290270151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c840cbfa0 msgr2=0x7f7c8415c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c89f49640 1 --2- 172.21.15.55:0/290270151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c840cbfa0 0x7f7c8415c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c89f49640 1 -- 172.21.15.55:0/290270151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c800094d0 con 0x7f7c840c89b0 2023-07-06T21:54:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c89f49640 1 --2- 172.21.15.55:0/290270151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c840c89b0 0x7f7c841502e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7c800ae040 tx=0x7f7c80019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c7a7fc640 1 -- 172.21.15.55:0/290270151 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c800ba070 con 0x7f7c840c89b0 2023-07-06T21:54:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c7a7fc640 1 -- 172.21.15.55:0/290270151 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c800abdd0 con 0x7f7c840c89b0 2023-07-06T21:54:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c7a7fc640 1 -- 172.21.15.55:0/290270151 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c800b66b0 con 0x7f7c840c89b0 2023-07-06T21:54:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/290270151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c841f3f60 con 0x7f7c840c89b0 2023-07-06T21:54:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.535+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/290270151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c840c61d0 con 0x7f7c840c89b0 2023-07-06T21:54:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.539+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/290270151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c84066d60 con 0x7f7c840c89b0 2023-07-06T21:54:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.539+0000 7f7c7a7fc640 1 -- 172.21.15.55:0/290270151 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f7c800b2070 con 0x7f7c840c89b0 2023-07-06T21:54:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.539+0000 7f7c7a7fc640 1 --2- 172.21.15.55:0/290270151 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7c68066480 0x7f7c68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.539+0000 7f7c7a7fc640 1 -- 172.21.15.55:0/290270151 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f7c8011df50 con 0x7f7c840c89b0 2023-07-06T21:54:21.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.539+0000 7f7c89748640 1 --2- 172.21.15.55:0/290270151 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7c68066480 0x7f7c68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.539+0000 7f7c89748640 1 --2- 172.21.15.55:0/290270151 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7c68066480 0x7f7c68068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7c840af090 tx=0x7f7c74008040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:21.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.543+0000 7f7c7a7fc640 1 -- 172.21.15.55:0/290270151 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7c800eaf00 con 0x7f7c840c89b0 2023-07-06T21:54:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.723+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/290270151 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c840cd6a0 con 0x7f7c68066480 2023-07-06T21:54:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.787+0000 7f7c7a7fc640 1 -- 172.21.15.55:0/290270151 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7c740108a0 con 0x7f7c68066480 2023-07-06T21:54:21.788 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-07-06T21:54:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.791+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/290270151 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7c68066480 msgr2=0x7f7c68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.791+0000 7f7c8c1ad640 1 --2- 172.21.15.55:0/290270151 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7c68066480 0x7f7c68068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7c840af090 tx=0x7f7c74008040 comp rx=0 tx=0).stop 2023-07-06T21:54:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.791+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/290270151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c840c89b0 msgr2=0x7f7c841502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.791+0000 7f7c8c1ad640 1 --2- 172.21.15.55:0/290270151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c840c89b0 0x7f7c841502e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7c800ae040 tx=0x7f7c80019210 comp rx=0 tx=0).stop 2023-07-06T21:54:21.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.791+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/290270151 shutdown_connections 2023-07-06T21:54:21.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.791+0000 7f7c8c1ad640 1 --2- 172.21.15.55:0/290270151 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7c68066480 0x7f7c68068930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.791+0000 7f7c8c1ad640 1 --2- 172.21.15.55:0/290270151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c84158780 0x7f7c8415c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.791+0000 7f7c8c1ad640 1 --2- 172.21.15.55:0/290270151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c840cbfa0 0x7f7c8415c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.791+0000 7f7c8c1ad640 1 --2- 172.21.15.55:0/290270151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c840c89b0 0x7f7c841502e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.791+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/290270151 >> 172.21.15.55:0/290270151 conn(0x7f7c840cde30 msgr2=0x7f7c840708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:21.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.791+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/290270151 shutdown_connections 2023-07-06T21:54:21.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.791+0000 7f7c8c1ad640 1 -- 172.21.15.55:0/290270151 wait complete. 2023-07-06T21:54:21.808 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-07-06T21:54:21.809 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-07-06T21:54:21.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.955+0000 7fb8d1140640 1 Processor -- start 2023-07-06T21:54:21.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.955+0000 7fb8d1140640 1 -- start start 2023-07-06T21:54:21.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.955+0000 7fb8d1140640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb8cc1560a0 0x7fb8cc06a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.955+0000 7fb8d1140640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8cc15f5a0 0x7fb8cc15f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.955+0000 7fb8d1140640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8cc069ea0 con 0x7fb8cc1601d0 2023-07-06T21:54:21.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.955+0000 7fb8d1140640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8cc15ff00 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.955+0000 7fb8d1140640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8cc156470 con 0x7fb8cc1560a0 2023-07-06T21:54:21.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.959+0000 7fb8cb59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8cc15f5a0 0x7fb8cc15f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.959+0000 7fb8c3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb8cc1601d0 0x7fb8cc0cba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56454/0 (socket says 172.21.15.55:56454) 2023-07-06T21:54:21.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.959+0000 7fb8cb59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8cc15f5a0 0x7fb8cc15f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59806/0 (socket says 172.21.15.55:59806) 2023-07-06T21:54:21.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.959+0000 7fb8c3fff640 1 -- 172.21.15.55:0/3047564391 learned_addr learned my addr 172.21.15.55:0/3047564391 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:21.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.959+0000 7fb8cad9d640 1 --2- 172.21.15.55:0/3047564391 >> v2:172.21.15.138:3300/0 conn(0x7fb8cc1560a0 0x7fb8cc06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.959+0000 7fb8cb59e640 1 -- 172.21.15.55:0/3047564391 >> v2:172.21.15.138:3300/0 conn(0x7fb8cc1560a0 msgr2=0x7fb8cc06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.959+0000 7fb8cb59e640 1 --2- 172.21.15.55:0/3047564391 >> v2:172.21.15.138:3300/0 conn(0x7fb8cc1560a0 0x7fb8cc06a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.959+0000 7fb8cb59e640 1 -- 172.21.15.55:0/3047564391 >> v1:172.21.15.55:6789/0 conn(0x7fb8cc1601d0 legacy=0x7fb8cc0cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.959+0000 7fb8cb59e640 1 -- 172.21.15.55:0/3047564391 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc0cd800 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.959+0000 7fb8ca59c640 1 -- 172.21.15.55:0/3047564391 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198113838 0 0) 0x7fb8cc069ea0 con 0x7fb8cc1601d0 2023-07-06T21:54:21.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.959+0000 7fb8cb59e640 1 --2- 172.21.15.55:0/3047564391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8cc15f5a0 0x7fb8cc15f9c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc06eac0 tx=0x7fb8c401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4046449c896d3344 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:21.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.959+0000 7fb8ca59c640 1 -- 172.21.15.55:0/3047564391 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40a59a0 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.959+0000 7fb8ca59c640 1 -- 172.21.15.55:0/3047564391 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c40a5b00 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.959+0000 7fb8ca59c640 1 -- 172.21.15.55:0/3047564391 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40a5e90 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 -- 172.21.15.55:0/3047564391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8cc15f5a0 msgr2=0x7fb8cc15f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 --2- 172.21.15.55:0/3047564391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8cc15f5a0 0x7fb8cc15f9c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc06eac0 tx=0x7fb8c401c8e0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 -- 172.21.15.55:0/3047564391 shutdown_connections 2023-07-06T21:54:21.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 --2- 172.21.15.55:0/3047564391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8cc15f5a0 0x7fb8cc15f9c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 --2- 172.21.15.55:0/3047564391 >> v2:172.21.15.138:3300/0 conn(0x7fb8cc1560a0 0x7fb8cc06a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 -- 172.21.15.55:0/3047564391 >> 172.21.15.55:0/3047564391 conn(0x7fb8cc0cde30 msgr2=0x7fb8cc0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:21.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 -- 172.21.15.55:0/3047564391 shutdown_connections 2023-07-06T21:54:21.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 -- 172.21.15.55:0/3047564391 wait complete. 2023-07-06T21:54:21.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 Processor -- start 2023-07-06T21:54:21.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 -- start start 2023-07-06T21:54:21.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8cc1560a0 0x7fb8cc06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8cc15f5a0 0x7fb8cc15e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8cc1504f0 0x7fb8cc14d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc1509f0 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc06d3d0 con 0x7fb8cc1560a0 2023-07-06T21:54:21.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8d1140640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc06c3e0 con 0x7fb8cc1504f0 2023-07-06T21:54:21.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8cc15f5a0 0x7fb8cc15e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8cc15f5a0 0x7fb8cc15e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59822/0 (socket says 172.21.15.55:59822) 2023-07-06T21:54:21.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8c3fff640 1 -- 172.21.15.55:0/2229159515 learned_addr learned my addr 172.21.15.55:0/2229159515 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8cad9d640 1 --2- 172.21.15.55:0/2229159515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8cc1560a0 0x7fb8cc06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8cb59e640 1 --2- 172.21.15.55:0/2229159515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8cc1504f0 0x7fb8cc14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8c3fff640 1 -- 172.21.15.55:0/2229159515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8cc1504f0 msgr2=0x7fb8cc14d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8c3fff640 1 --2- 172.21.15.55:0/2229159515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8cc1504f0 0x7fb8cc14d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8c3fff640 1 -- 172.21.15.55:0/2229159515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8cc1560a0 msgr2=0x7fb8cc06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8c3fff640 1 --2- 172.21.15.55:0/2229159515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8cc1560a0 0x7fb8cc06ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:21.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.963+0000 7fb8c3fff640 1 -- 172.21.15.55:0/2229159515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c4009a70 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.967+0000 7fb8c3fff640 1 --2- 172.21.15.55:0/2229159515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8cc15f5a0 0x7fb8cc15e530 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400c520 tx=0x7fb8b400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:21.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.967+0000 7fb8c37fe640 1 -- 172.21.15.55:0/2229159515 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40074e0 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.967+0000 7fb8c37fe640 1 -- 172.21.15.55:0/2229159515 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b4007640 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.967+0000 7fb8c37fe640 1 -- 172.21.15.55:0/2229159515 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40049f0 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.967+0000 7fb8d1140640 1 -- 172.21.15.55:0/2229159515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc06c100 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.967+0000 7fb8d1140640 1 -- 172.21.15.55:0/2229159515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc06f290 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.967+0000 7fb8d1140640 1 -- 172.21.15.55:0/2229159515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8cc06f4b0 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.967+0000 7fb8c37fe640 1 -- 172.21.15.55:0/2229159515 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fb8b4004b50 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.971+0000 7fb8c37fe640 1 --2- 172.21.15.55:0/2229159515 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fb8ac066480 0x7fb8ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:21.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.971+0000 7fb8c37fe640 1 -- 172.21.15.55:0/2229159515 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7fb8b4083500 con 0x7fb8cc15f5a0 2023-07-06T21:54:21.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.971+0000 7fb8cad9d640 1 --2- 172.21.15.55:0/2229159515 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fb8ac066480 0x7fb8ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:21.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.971+0000 7fb8cad9d640 1 --2- 172.21.15.55:0/2229159515 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fb8ac066480 0x7fb8ac068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009ac0 tx=0x7fb8bc009190 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:21.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:21.975+0000 7fb8c37fe640 1 -- 172.21.15.55:0/2229159515 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb8b4050540 con 0x7fb8cc15f5a0 2023-07-06T21:54:22.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.147+0000 7fb8d1140640 1 -- 172.21.15.55:0/2229159515 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8cc0cdae0 con 0x7fb8ac066480 2023-07-06T21:54:22.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.227+0000 7fb8c37fe640 1 -- 172.21.15.55:0/2229159515 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fb8bc0119e0 con 0x7fb8ac066480 2023-07-06T21:54:22.226 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-07-06T21:54:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.227+0000 7fb8d1140640 1 -- 172.21.15.55:0/2229159515 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fb8ac066480 msgr2=0x7fb8ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.227+0000 7fb8d1140640 1 --2- 172.21.15.55:0/2229159515 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fb8ac066480 0x7fb8ac068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009ac0 tx=0x7fb8bc009190 comp rx=0 tx=0).stop 2023-07-06T21:54:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.227+0000 7fb8d1140640 1 -- 172.21.15.55:0/2229159515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8cc15f5a0 msgr2=0x7fb8cc15e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.227+0000 7fb8d1140640 1 --2- 172.21.15.55:0/2229159515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8cc15f5a0 0x7fb8cc15e530 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400c520 tx=0x7fb8b400c9e0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.227+0000 7fb8d1140640 1 -- 172.21.15.55:0/2229159515 shutdown_connections 2023-07-06T21:54:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.227+0000 7fb8d1140640 1 --2- 172.21.15.55:0/2229159515 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fb8ac066480 0x7fb8ac068930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.227+0000 7fb8d1140640 1 --2- 172.21.15.55:0/2229159515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8cc1504f0 0x7fb8cc14d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.227+0000 7fb8d1140640 1 --2- 172.21.15.55:0/2229159515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8cc15f5a0 0x7fb8cc15e530 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.227+0000 7fb8d1140640 1 --2- 172.21.15.55:0/2229159515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8cc1560a0 0x7fb8cc06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.227+0000 7fb8d1140640 1 -- 172.21.15.55:0/2229159515 >> 172.21.15.55:0/2229159515 conn(0x7fb8cc0cde30 msgr2=0x7fb8cc15c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.227+0000 7fb8d1140640 1 -- 172.21.15.55:0/2229159515 shutdown_connections 2023-07-06T21:54:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.227+0000 7fb8d1140640 1 -- 172.21.15.55:0/2229159515 wait complete. 2023-07-06T21:54:22.247 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-07-06T21:54:22.247 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-07-06T21:54:22.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.395+0000 7f232dd1e640 1 Processor -- start 2023-07-06T21:54:22.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.395+0000 7f232dd1e640 1 -- start start 2023-07-06T21:54:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.395+0000 7f232dd1e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f23280cd3e0 0x7f23280cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.395+0000 7f232dd1e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23280cc150 0x7f232806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.395+0000 7f232dd1e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2328159350 con 0x7f23280c8910 2023-07-06T21:54:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.395+0000 7f232dd1e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23280ccf50 con 0x7f23280cc150 2023-07-06T21:54:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.395+0000 7f232dd1e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2328158d90 con 0x7f23280cd3e0 2023-07-06T21:54:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.395+0000 7f23277fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f23280c8910 0x7f2328158360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56466/0 (socket says 172.21.15.55:56466) 2023-07-06T21:54:22.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.395+0000 7f23277fe640 1 -- 172.21.15.55:0/4156971004 learned_addr learned my addr 172.21.15.55:0/4156971004 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:22.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.395+0000 7f2327fff640 1 --2- 172.21.15.55:0/4156971004 >> v2:172.21.15.55:3300/0 conn(0x7f23280cc150 0x7f232806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:22.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.395+0000 7f2326ffd640 1 --2- 172.21.15.55:0/4156971004 >> v2:172.21.15.138:3300/0 conn(0x7f23280cd3e0 0x7f23280cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:22.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f23267fc640 1 -- 172.21.15.55:0/4156971004 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789607024 0 0) 0x7f2328159350 con 0x7f23280c8910 2023-07-06T21:54:22.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f23267fc640 1 -- 172.21.15.55:0/4156971004 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2310003530 con 0x7f23280c8910 2023-07-06T21:54:22.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f2327fff640 1 -- 172.21.15.55:0/4156971004 >> v2:172.21.15.138:3300/0 conn(0x7f23280cd3e0 msgr2=0x7f23280cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:22.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f2327fff640 1 --2- 172.21.15.55:0/4156971004 >> v2:172.21.15.138:3300/0 conn(0x7f23280cd3e0 0x7f23280cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f2327fff640 1 -- 172.21.15.55:0/4156971004 >> v1:172.21.15.55:6789/0 conn(0x7f23280c8910 legacy=0x7f2328158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:22.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f2327fff640 1 -- 172.21.15.55:0/4156971004 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2328159070 con 0x7f23280cc150 2023-07-06T21:54:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f2327fff640 1 --2- 172.21.15.55:0/4156971004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23280cc150 0x7f232806bc00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f23280ca7e0 tx=0x7f232001d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bcd53a11b283c8b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f23267fc640 1 -- 172.21.15.55:0/4156971004 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232000a2d0 con 0x7f23280cc150 2023-07-06T21:54:22.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f23267fc640 1 -- 172.21.15.55:0/4156971004 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23200a6760 con 0x7f23280cc150 2023-07-06T21:54:22.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f23267fc640 1 -- 172.21.15.55:0/4156971004 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23200a6af0 con 0x7f23280cc150 2023-07-06T21:54:22.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f232dd1e640 1 -- 172.21.15.55:0/4156971004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23280cc150 msgr2=0x7f232806bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f232dd1e640 1 --2- 172.21.15.55:0/4156971004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23280cc150 0x7f232806bc00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f23280ca7e0 tx=0x7f232001d970 comp rx=0 tx=0).stop 2023-07-06T21:54:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f232dd1e640 1 -- 172.21.15.55:0/4156971004 shutdown_connections 2023-07-06T21:54:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f232dd1e640 1 --2- 172.21.15.55:0/4156971004 >> v2:172.21.15.138:3300/0 conn(0x7f23280cd3e0 0x7f23280cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f232dd1e640 1 --2- 172.21.15.55:0/4156971004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23280cc150 0x7f232806bc00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.399+0000 7f232dd1e640 1 -- 172.21.15.55:0/4156971004 >> 172.21.15.55:0/4156971004 conn(0x7f23280cde30 msgr2=0x7f23280ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f232dd1e640 1 -- 172.21.15.55:0/4156971004 shutdown_connections 2023-07-06T21:54:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f232dd1e640 1 -- 172.21.15.55:0/4156971004 wait complete. 2023-07-06T21:54:22.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f232dd1e640 1 Processor -- start 2023-07-06T21:54:22.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f232dd1e640 1 -- start start 2023-07-06T21:54:22.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f232dd1e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23280c8910 0x7f23280c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:22.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f232dd1e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23280cc150 0x7f23280c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:22.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f232dd1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23281f7620 0x7f232814eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:22.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f232dd1e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232814e580 con 0x7f23281f7620 2023-07-06T21:54:22.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f232dd1e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23281f7a90 con 0x7f23280c8910 2023-07-06T21:54:22.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f232dd1e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23281f7d70 con 0x7f23280cc150 2023-07-06T21:54:22.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f2327fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23281f7620 0x7f232814eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:22.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f2327fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23281f7620 0x7f232814eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59846/0 (socket says 172.21.15.55:59846) 2023-07-06T21:54:22.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f2327fff640 1 -- 172.21.15.55:0/1167358168 learned_addr learned my addr 172.21.15.55:0/1167358168 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:22.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f23277fe640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23280c8910 0x7f23280c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:22.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f2326ffd640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23280cc150 0x7f23280c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:22.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f2327fff640 1 -- 172.21.15.55:0/1167358168 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23280cc150 msgr2=0x7f23280c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:22.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f2327fff640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23280cc150 0x7f23280c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f2327fff640 1 -- 172.21.15.55:0/1167358168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23280c8910 msgr2=0x7f23280c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:22.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f2327fff640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23280c8910 0x7f23280c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f2327fff640 1 -- 172.21.15.55:0/1167358168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232000ab80 con 0x7f23281f7620 2023-07-06T21:54:22.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f2326ffd640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23280cc150 0x7f23280c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:22.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.403+0000 7f2327fff640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23281f7620 0x7f232814eb10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f23200b0040 tx=0x7f232001a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.407+0000 7f230ffff640 1 -- 172.21.15.55:0/1167358168 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23200b7680 con 0x7f23281f7620 2023-07-06T21:54:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.407+0000 7f230ffff640 1 -- 172.21.15.55:0/1167358168 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23200b77e0 con 0x7f23281f7620 2023-07-06T21:54:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.407+0000 7f232dd1e640 1 -- 172.21.15.55:0/1167358168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23281f8050 con 0x7f23281f7620 2023-07-06T21:54:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.407+0000 7f230ffff640 1 -- 172.21.15.55:0/1167358168 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23200b7b90 con 0x7f23281f7620 2023-07-06T21:54:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.407+0000 7f232dd1e640 1 -- 172.21.15.55:0/1167358168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23280c1420 con 0x7f23281f7620 2023-07-06T21:54:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.407+0000 7f232dd1e640 1 -- 172.21.15.55:0/1167358168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2328066d60 con 0x7f23281f7620 2023-07-06T21:54:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.407+0000 7f230ffff640 1 -- 172.21.15.55:0/1167358168 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f23200b7cf0 con 0x7f23281f7620 2023-07-06T21:54:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.407+0000 7f230ffff640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f2314066480 0x7f2314068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.407+0000 7f230ffff640 1 -- 172.21.15.55:0/1167358168 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f232011f500 con 0x7f23281f7620 2023-07-06T21:54:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.407+0000 7f23277fe640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f2314066480 0x7f2314068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:22.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.411+0000 7f23277fe640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f2314066480 0x7f2314068930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f23180011f0 tx=0x7f2318007d40 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:22.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.411+0000 7f230ffff640 1 -- 172.21.15.55:0/1167358168 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f23200ec530 con 0x7f23281f7620 2023-07-06T21:54:22.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.591+0000 7f232dd1e640 1 -- 172.21.15.55:0/1167358168 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2328158a70 con 0x7f2314066480 2023-07-06T21:54:22.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.663+0000 7f230ffff640 1 -- 172.21.15.55:0/1167358168 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f2318005860 con 0x7f2314066480 2023-07-06T21:54:22.666 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-07-06T21:54:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.667+0000 7f232dd1e640 1 -- 172.21.15.55:0/1167358168 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f2314066480 msgr2=0x7f2314068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:22.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.667+0000 7f232dd1e640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f2314066480 0x7f2314068930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f23180011f0 tx=0x7f2318007d40 comp rx=0 tx=0).stop 2023-07-06T21:54:22.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.667+0000 7f232dd1e640 1 -- 172.21.15.55:0/1167358168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23281f7620 msgr2=0x7f232814eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:22.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.667+0000 7f232dd1e640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23281f7620 0x7f232814eb10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f23200b0040 tx=0x7f232001a710 comp rx=0 tx=0).stop 2023-07-06T21:54:22.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.667+0000 7f232dd1e640 1 -- 172.21.15.55:0/1167358168 shutdown_connections 2023-07-06T21:54:22.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.667+0000 7f232dd1e640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f2314066480 0x7f2314068930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.667+0000 7f232dd1e640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23281f7620 0x7f232814eb10 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.667+0000 7f232dd1e640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23280cc150 0x7f23280c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.667+0000 7f232dd1e640 1 --2- 172.21.15.55:0/1167358168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23280c8910 0x7f23280c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.667+0000 7f232dd1e640 1 -- 172.21.15.55:0/1167358168 >> 172.21.15.55:0/1167358168 conn(0x7f23280cde30 msgr2=0x7f2328159720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:22.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.667+0000 7f232dd1e640 1 -- 172.21.15.55:0/1167358168 shutdown_connections 2023-07-06T21:54:22.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.667+0000 7f232dd1e640 1 -- 172.21.15.55:0/1167358168 wait complete. 2023-07-06T21:54:22.686 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-07-06T21:54:22.687 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-07-06T21:54:22.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee7e9c640 1 Processor -- start 2023-07-06T21:54:22.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee7e9c640 1 -- start start 2023-07-06T21:54:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee7e9c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7faee00b3c90 0x7faee00ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee7e9c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee00ccd50 con 0x7faee00d1d30 2023-07-06T21:54:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee7e9c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee0069ea0 con 0x7faee00b18a0 2023-07-06T21:54:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee7e9c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee00cd0a0 con 0x7faee00b3c90 2023-07-06T21:54:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee6439640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faee00d1d30 0x7faee00cfee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56480/0 (socket says 172.21.15.55:56480) 2023-07-06T21:54:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee6439640 1 -- 172.21.15.55:0/1841942769 learned_addr learned my addr 172.21.15.55:0/1841942769 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:22.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee5c38640 1 --2- 172.21.15.55:0/1841942769 >> v2:172.21.15.138:3300/0 conn(0x7faee00b3c90 0x7faee00ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee4c36640 1 -- 172.21.15.55:0/1841942769 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937501771 0 0) 0x7faee00ccd50 con 0x7faee00d1d30 2023-07-06T21:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee4c36640 1 -- 172.21.15.55:0/1841942769 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faecc003530 con 0x7faee00d1d30 2023-07-06T21:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee4c36640 1 -- 172.21.15.55:0/1841942769 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1203230906 0 0) 0x7faecc003530 con 0x7faee00d1d30 2023-07-06T21:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee4c36640 1 -- 172.21.15.55:0/1841942769 >> v2:172.21.15.138:3300/0 conn(0x7faee00b3c90 msgr2=0x7faee00ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee4c36640 1 --2- 172.21.15.55:0/1841942769 >> v2:172.21.15.138:3300/0 conn(0x7faee00b3c90 0x7faee00ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee4c36640 1 -- 172.21.15.55:0/1841942769 >> v1:172.21.15.138:6789/0 conn(0x7faee00b18a0 legacy=0x7faee00b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.835+0000 7faee4c36640 1 -- 172.21.15.55:0/1841942769 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee006a140 con 0x7faee00d1d30 2023-07-06T21:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee4c36640 1 -- 172.21.15.55:0/1841942769 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7faed8001a00 con 0x7faee00d1d30 2023-07-06T21:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee5c38640 1 --2- 172.21.15.55:0/1841942769 >> v2:172.21.15.138:3300/0 conn(0x7faee00b3c90 0x7faee00ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee4c36640 1 -- 172.21.15.55:0/1841942769 >> v1:172.21.15.55:6789/0 conn(0x7faee00d1d30 legacy=0x7faee00cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee4c36640 1 --2- 172.21.15.55:0/1841942769 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faecc003980 0x7faecc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee4c36640 1 --2- 172.21.15.55:0/1841942769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0047d0 0x7faecc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee4c36640 1 --2- 172.21.15.55:0/1841942769 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faecc005180 0x7faecc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:22.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee4c36640 1 -- 172.21.15.55:0/1841942769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00cd0a0 con 0x7faecc0047d0 2023-07-06T21:54:22.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee4c36640 1 -- 172.21.15.55:0/1841942769 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc00c000 con 0x7faecc005180 2023-07-06T21:54:22.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee4c36640 1 -- 172.21.15.55:0/1841942769 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc00c1c0 con 0x7faecc003980 2023-07-06T21:54:22.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee5437640 1 --2- 172.21.15.55:0/1841942769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0047d0 0x7faecc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:22.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee5c38640 1 --2- 172.21.15.55:0/1841942769 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faecc003980 0x7faecc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:22.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee6439640 1 --2- 172.21.15.55:0/1841942769 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faecc005180 0x7faecc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:22.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee5437640 1 -- 172.21.15.55:0/1841942769 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faecc003980 msgr2=0x7faecc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:22.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee5437640 1 --2- 172.21.15.55:0/1841942769 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faecc003980 0x7faecc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee5437640 1 -- 172.21.15.55:0/1841942769 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faecc005180 msgr2=0x7faecc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:22.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee5437640 1 --2- 172.21.15.55:0/1841942769 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faecc005180 0x7faecc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee5437640 1 -- 172.21.15.55:0/1841942769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc003530 con 0x7faecc0047d0 2023-07-06T21:54:22.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee6439640 1 -- 172.21.15.55:0/1841942769 reap_dead start 2023-07-06T21:54:22.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee5437640 1 --2- 172.21.15.55:0/1841942769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0047d0 0x7faecc004c40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7faed0001750 tx=0x7faed001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621902ff27c85d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:22.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee4c36640 1 -- 172.21.15.55:0/1841942769 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed00052d0 con 0x7faecc0047d0 2023-07-06T21:54:22.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee4c36640 1 -- 172.21.15.55:0/1841942769 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed00a7050 con 0x7faecc0047d0 2023-07-06T21:54:22.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.839+0000 7faee4c36640 1 -- 172.21.15.55:0/1841942769 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0003600 con 0x7faecc0047d0 2023-07-06T21:54:22.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 -- 172.21.15.55:0/1841942769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0047d0 msgr2=0x7faecc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 --2- 172.21.15.55:0/1841942769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0047d0 0x7faecc004c40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7faed0001750 tx=0x7faed001c3a0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 -- 172.21.15.55:0/1841942769 shutdown_connections 2023-07-06T21:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 --2- 172.21.15.55:0/1841942769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0047d0 0x7faecc004c40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 -- 172.21.15.55:0/1841942769 >> 172.21.15.55:0/1841942769 conn(0x7faee006bf40 msgr2=0x7faee00cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 -- 172.21.15.55:0/1841942769 shutdown_connections 2023-07-06T21:54:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 -- 172.21.15.55:0/1841942769 wait complete. 2023-07-06T21:54:22.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 Processor -- start 2023-07-06T21:54:22.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 -- start start 2023-07-06T21:54:22.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faecc0047d0 0x7faee01f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:22.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee00c8380 0x7faee00c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:22.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faee015b630 0x7faee015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:22.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00c6e30 con 0x7faee00c8380 2023-07-06T21:54:22.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00c75c0 con 0x7faee015b630 2023-07-06T21:54:22.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee7e9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee00c78a0 con 0x7faecc0047d0 2023-07-06T21:54:22.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee5437640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee00c8380 0x7faee00c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:22.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee5437640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee00c8380 0x7faee00c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59870/0 (socket says 172.21.15.55:59870) 2023-07-06T21:54:22.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee5437640 1 -- 172.21.15.55:0/4131427863 learned_addr learned my addr 172.21.15.55:0/4131427863 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:22.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee5c38640 1 --2- 172.21.15.55:0/4131427863 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faecc0047d0 0x7faee01f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:22.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.843+0000 7faee6439640 1 --2- 172.21.15.55:0/4131427863 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faee015b630 0x7faee015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:22.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.847+0000 7faee5437640 1 -- 172.21.15.55:0/4131427863 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faecc0047d0 msgr2=0x7faee01f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:22.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.847+0000 7faee5437640 1 --2- 172.21.15.55:0/4131427863 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faecc0047d0 0x7faee01f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.847+0000 7faee5437640 1 -- 172.21.15.55:0/4131427863 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faee015b630 msgr2=0x7faee015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:22.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.847+0000 7faee5437640 1 --2- 172.21.15.55:0/4131427863 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faee015b630 0x7faee015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:22.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.847+0000 7faee5437640 1 -- 172.21.15.55:0/4131427863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee00c7b80 con 0x7faee00c8380 2023-07-06T21:54:22.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.847+0000 7faee5437640 1 --2- 172.21.15.55:0/4131427863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee00c8380 0x7faee00c87f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7faed001c1d0 tx=0x7faecc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:22.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.847+0000 7faed67fc640 1 -- 172.21.15.55:0/4131427863 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0003e40 con 0x7faee00c8380 2023-07-06T21:54:22.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.847+0000 7faed67fc640 1 -- 172.21.15.55:0/4131427863 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed0007a40 con 0x7faee00c8380 2023-07-06T21:54:22.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.847+0000 7faed67fc640 1 -- 172.21.15.55:0/4131427863 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0007250 con 0x7faee00c8380 2023-07-06T21:54:22.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.847+0000 7faee7e9c640 1 -- 172.21.15.55:0/4131427863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee00c7e60 con 0x7faee00c8380 2023-07-06T21:54:22.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.847+0000 7faee7e9c640 1 -- 172.21.15.55:0/4131427863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee00d0ea0 con 0x7faee00c8380 2023-07-06T21:54:22.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.847+0000 7faee7e9c640 1 -- 172.21.15.55:0/4131427863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee00c7ff0 con 0x7faee00c8380 2023-07-06T21:54:22.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.847+0000 7faed67fc640 1 -- 172.21.15.55:0/4131427863 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7faed00073b0 con 0x7faee00c8380 2023-07-06T21:54:22.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.851+0000 7faed67fc640 1 --2- 172.21.15.55:0/4131427863 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7faec40664b0 0x7faec4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:22.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.851+0000 7faed67fc640 1 -- 172.21.15.55:0/4131427863 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7faed011e800 con 0x7faee00c8380 2023-07-06T21:54:22.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.851+0000 7faee5c38640 1 --2- 172.21.15.55:0/4131427863 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7faec40664b0 0x7faec4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:22.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.851+0000 7faee5c38640 1 --2- 172.21.15.55:0/4131427863 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7faec40664b0 0x7faec4068960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faedc0093f0 tx=0x7faedc009190 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:22.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:22.855+0000 7faed67fc640 1 -- 172.21.15.55:0/4131427863 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faed00eb540 con 0x7faee00c8380 2023-07-06T21:54:23.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.031+0000 7faee7e9c640 1 -- 172.21.15.55:0/4131427863 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7faee00cc9e0 con 0x7faec40664b0 2023-07-06T21:54:23.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.103+0000 7faed67fc640 1 -- 172.21.15.55:0/4131427863 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7faedc0099e0 con 0x7faec40664b0 2023-07-06T21:54:23.102 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-07-06T21:54:23.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.103+0000 7faee7e9c640 1 -- 172.21.15.55:0/4131427863 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7faec40664b0 msgr2=0x7faec4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.103+0000 7faee7e9c640 1 --2- 172.21.15.55:0/4131427863 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7faec40664b0 0x7faec4068960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faedc0093f0 tx=0x7faedc009190 comp rx=0 tx=0).stop 2023-07-06T21:54:23.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.103+0000 7faee7e9c640 1 -- 172.21.15.55:0/4131427863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee00c8380 msgr2=0x7faee00c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.103+0000 7faee7e9c640 1 --2- 172.21.15.55:0/4131427863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee00c8380 0x7faee00c87f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7faed001c1d0 tx=0x7faecc005800 comp rx=0 tx=0).stop 2023-07-06T21:54:23.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.103+0000 7faee7e9c640 1 -- 172.21.15.55:0/4131427863 shutdown_connections 2023-07-06T21:54:23.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.103+0000 7faee7e9c640 1 --2- 172.21.15.55:0/4131427863 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7faec40664b0 0x7faec4068960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.103+0000 7faee7e9c640 1 --2- 172.21.15.55:0/4131427863 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faee015b630 0x7faee015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.103+0000 7faee7e9c640 1 --2- 172.21.15.55:0/4131427863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee00c8380 0x7faee00c87f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.103+0000 7faee7e9c640 1 --2- 172.21.15.55:0/4131427863 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faecc0047d0 0x7faee01f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.103+0000 7faee7e9c640 1 -- 172.21.15.55:0/4131427863 >> 172.21.15.55:0/4131427863 conn(0x7faee006bf40 msgr2=0x7faee00b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:23.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.103+0000 7faee7e9c640 1 -- 172.21.15.55:0/4131427863 shutdown_connections 2023-07-06T21:54:23.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.103+0000 7faee7e9c640 1 -- 172.21.15.55:0/4131427863 wait complete. 2023-07-06T21:54:23.122 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-07-06T21:54:23.123 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-07-06T21:54:23.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24cf59e640 1 Processor -- start 2023-07-06T21:54:23.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24cf59e640 1 -- start start 2023-07-06T21:54:23.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24cf59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24d00ccdf0 0x7f24d00b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:23.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24cf59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24d015f570 0x7f24d015f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:23.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24cf59e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d00b2030 con 0x7f24d015b830 2023-07-06T21:54:23.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24cf59e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d00b1700 con 0x7f24d015f570 2023-07-06T21:54:23.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24cf59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00b19e0 con 0x7f24d00ccdf0 2023-07-06T21:54:23.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24ce59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f24d015b830 0x7f24d00cc6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42030/0 (socket says 172.21.15.55:42030) 2023-07-06T21:54:23.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24ce59c640 1 -- 172.21.15.55:0/1172552829 learned_addr learned my addr 172.21.15.55:0/1172552829 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:23.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24ced9d640 1 --2- 172.21.15.55:0/1172552829 >> v2:172.21.15.55:3300/0 conn(0x7f24d015f570 0x7f24d015f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:23.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24c7fff640 1 --2- 172.21.15.55:0/1172552829 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24d00ccdf0 0x7f24d00b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:23.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24ced9d640 1 -- 172.21.15.55:0/1172552829 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24d00ccdf0 msgr2=0x7f24d00b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:23.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24ced9d640 1 --2- 172.21.15.55:0/1172552829 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24d00ccdf0 0x7f24d00b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24ced9d640 1 -- 172.21.15.55:0/1172552829 >> v1:172.21.15.55:6789/0 conn(0x7f24d015b830 legacy=0x7f24d00cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24ced9d640 1 -- 172.21.15.55:0/1172552829 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d00b1cc0 con 0x7f24d015f570 2023-07-06T21:54:23.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24cdd9b640 1 -- 172.21.15.55:0/1172552829 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755852211 0 0) 0x7f24d00b2030 con 0x7f24d015b830 2023-07-06T21:54:23.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.271+0000 7f24c7fff640 1 --2- 172.21.15.55:0/1172552829 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24d00ccdf0 0x7f24d00b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:23.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.275+0000 7f24ced9d640 1 --2- 172.21.15.55:0/1172552829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24d015f570 0x7f24d015f9d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009d90 tx=0x7f24c801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffe899c60024294 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:23.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.275+0000 7f24cdd9b640 1 -- 172.21.15.55:0/1172552829 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80a5a30 con 0x7f24d015f570 2023-07-06T21:54:23.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.275+0000 7f24cdd9b640 1 -- 172.21.15.55:0/1172552829 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c80a5b90 con 0x7f24d015f570 2023-07-06T21:54:23.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.275+0000 7f24cdd9b640 1 -- 172.21.15.55:0/1172552829 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80ad440 con 0x7f24d015f570 2023-07-06T21:54:23.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.275+0000 7f24cf59e640 1 -- 172.21.15.55:0/1172552829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24d015f570 msgr2=0x7f24d015f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.275+0000 7f24cf59e640 1 --2- 172.21.15.55:0/1172552829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24d015f570 0x7f24d015f9d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009d90 tx=0x7f24c801c950 comp rx=0 tx=0).stop 2023-07-06T21:54:23.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.275+0000 7f24cf59e640 1 -- 172.21.15.55:0/1172552829 shutdown_connections 2023-07-06T21:54:23.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.275+0000 7f24cf59e640 1 --2- 172.21.15.55:0/1172552829 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24d00ccdf0 0x7f24d00b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.275+0000 7f24cf59e640 1 --2- 172.21.15.55:0/1172552829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24d015f570 0x7f24d015f9d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.275+0000 7f24cf59e640 1 -- 172.21.15.55:0/1172552829 >> 172.21.15.55:0/1172552829 conn(0x7f24d0070b20 msgr2=0x7f24d0070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:23.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.275+0000 7f24cf59e640 1 -- 172.21.15.55:0/1172552829 shutdown_connections 2023-07-06T21:54:23.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.275+0000 7f24cf59e640 1 -- 172.21.15.55:0/1172552829 wait complete. 2023-07-06T21:54:23.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24cf59e640 1 Processor -- start 2023-07-06T21:54:23.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24cf59e640 1 -- start start 2023-07-06T21:54:23.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24cf59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24d00ccdf0 0x7f24d00cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:23.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24cf59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24d015b830 0x7f24d00c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:23.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24cf59e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24d015f570 0x7f24d00c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:23.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24cf59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00b79a0 con 0x7f24d00ccdf0 2023-07-06T21:54:23.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24cf59e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00b6d20 con 0x7f24d015f570 2023-07-06T21:54:23.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24cf59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00b7000 con 0x7f24d015b830 2023-07-06T21:54:23.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24ce59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24d00ccdf0 0x7f24d00cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:23.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24ce59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24d00ccdf0 0x7f24d00cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51192/0 (socket says 172.21.15.55:51192) 2023-07-06T21:54:23.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24ce59c640 1 -- 172.21.15.55:0/3990036316 learned_addr learned my addr 172.21.15.55:0/3990036316 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:23.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24ced9d640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24d015f570 0x7f24d00c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:23.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24c7fff640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24d015b830 0x7f24d00c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:23.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24ce59c640 1 -- 172.21.15.55:0/3990036316 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24d015b830 msgr2=0x7f24d00c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24ce59c640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24d015b830 0x7f24d00c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24ce59c640 1 -- 172.21.15.55:0/3990036316 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24d015f570 msgr2=0x7f24d00c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24ce59c640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24d015f570 0x7f24d00c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24ce59c640 1 -- 172.21.15.55:0/3990036316 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c8009a70 con 0x7f24d00ccdf0 2023-07-06T21:54:23.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24ced9d640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24d015f570 0x7f24d00c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:23.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24ce59c640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24d00ccdf0 0x7f24d00cb7a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f24c00011f0 tx=0x7f24c000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:23.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24c6ffd640 1 -- 172.21.15.55:0/3990036316 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c00074e0 con 0x7f24d00ccdf0 2023-07-06T21:54:23.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24c6ffd640 1 -- 172.21.15.55:0/3990036316 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c0007640 con 0x7f24d00ccdf0 2023-07-06T21:54:23.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24cf59e640 1 -- 172.21.15.55:0/3990036316 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d00b72e0 con 0x7f24d00ccdf0 2023-07-06T21:54:23.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24c6ffd640 1 -- 172.21.15.55:0/3990036316 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0004a10 con 0x7f24d00ccdf0 2023-07-06T21:54:23.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.279+0000 7f24cf59e640 1 -- 172.21.15.55:0/3990036316 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d00b69b0 con 0x7f24d00ccdf0 2023-07-06T21:54:23.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.283+0000 7f24cf59e640 1 -- 172.21.15.55:0/3990036316 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d004d860 con 0x7f24d00ccdf0 2023-07-06T21:54:23.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.283+0000 7f24c6ffd640 1 -- 172.21.15.55:0/3990036316 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f24c0004b70 con 0x7f24d00ccdf0 2023-07-06T21:54:23.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.283+0000 7f24c6ffd640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f24b0066480 0x7f24b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:23.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.283+0000 7f24c6ffd640 1 -- 172.21.15.55:0/3990036316 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f24c00836c0 con 0x7f24d00ccdf0 2023-07-06T21:54:23.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.283+0000 7f24c7fff640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f24b0066480 0x7f24b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:23.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.283+0000 7f24c7fff640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f24b0066480 0x7f24b0068930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f24d00cadb0 tx=0x7f24b8008040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:23.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.287+0000 7f24c6ffd640 1 -- 172.21.15.55:0/3990036316 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f24c00505a0 con 0x7f24d00ccdf0 2023-07-06T21:54:23.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.459+0000 7f24cf59e640 1 -- 172.21.15.55:0/3990036316 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f24d00d0830 con 0x7f24b0066480 2023-07-06T21:54:23.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.547+0000 7f24c6ffd640 1 -- 172.21.15.55:0/3990036316 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f24b800c590 con 0x7f24b0066480 2023-07-06T21:54:23.550 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-07-06T21:54:23.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.551+0000 7f24cf59e640 1 -- 172.21.15.55:0/3990036316 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f24b0066480 msgr2=0x7f24b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.551+0000 7f24cf59e640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f24b0066480 0x7f24b0068930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f24d00cadb0 tx=0x7f24b8008040 comp rx=0 tx=0).stop 2023-07-06T21:54:23.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.551+0000 7f24cf59e640 1 -- 172.21.15.55:0/3990036316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24d00ccdf0 msgr2=0x7f24d00cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.551+0000 7f24cf59e640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24d00ccdf0 0x7f24d00cb7a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f24c00011f0 tx=0x7f24c000c9b0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.551+0000 7f24cf59e640 1 -- 172.21.15.55:0/3990036316 shutdown_connections 2023-07-06T21:54:23.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.551+0000 7f24cf59e640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f24b0066480 0x7f24b0068930 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.551+0000 7f24cf59e640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24d015f570 0x7f24d00c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.551+0000 7f24cf59e640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24d015b830 0x7f24d00c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.551+0000 7f24cf59e640 1 --2- 172.21.15.55:0/3990036316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24d00ccdf0 0x7f24d00cb7a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.551+0000 7f24cf59e640 1 -- 172.21.15.55:0/3990036316 >> 172.21.15.55:0/3990036316 conn(0x7f24d0070b20 msgr2=0x7f24d00d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:23.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.551+0000 7f24cf59e640 1 -- 172.21.15.55:0/3990036316 shutdown_connections 2023-07-06T21:54:23.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.551+0000 7f24cf59e640 1 -- 172.21.15.55:0/3990036316 wait complete. 2023-07-06T21:54:23.571 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-07-06T21:54:23.572 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-07-06T21:54:23.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.719+0000 7fa4b6967640 1 Processor -- start 2023-07-06T21:54:23.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.719+0000 7fa4b6967640 1 -- start start 2023-07-06T21:54:23.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.719+0000 7fa4b6967640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b00c9b90 0x7fa4b015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:23.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.723+0000 7fa4b6967640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b00b3e70 con 0x7fa4b00ccb70 2023-07-06T21:54:23.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.723+0000 7fa4b6967640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b0159c30 con 0x7fa4b00693f0 2023-07-06T21:54:23.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.723+0000 7fa4b6967640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b00c9070 con 0x7fa4b00c9b90 2023-07-06T21:54:23.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.723+0000 7fa4af7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa4b00ccb70 0x7fa4b00c9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42040/0 (socket says 172.21.15.55:42040) 2023-07-06T21:54:23.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.723+0000 7fa4af7fe640 1 -- 172.21.15.55:0/527571086 learned_addr learned my addr 172.21.15.55:0/527571086 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:23.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.723+0000 7fa4affff640 1 --2- 172.21.15.55:0/527571086 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b00c9b90 0x7fa4b015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:23.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.723+0000 7fa4aeffd640 1 -- 172.21.15.55:0/527571086 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809194219 0 0) 0x7fa4a4001120 con 0x7fa4b00ccb70 2023-07-06T21:54:23.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.723+0000 7fa4aeffd640 1 -- 172.21.15.55:0/527571086 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa498003530 con 0x7fa4b00ccb70 2023-07-06T21:54:23.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.723+0000 7fa4aeffd640 1 -- 172.21.15.55:0/527571086 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988322380 0 0) 0x7fa4b0159c30 con 0x7fa4b00693f0 2023-07-06T21:54:23.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.723+0000 7fa4aeffd640 1 -- 172.21.15.55:0/527571086 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a4001120 con 0x7fa4b00693f0 2023-07-06T21:54:23.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.723+0000 7fa4affff640 1 -- 172.21.15.55:0/527571086 >> v1:172.21.15.138:6789/0 conn(0x7fa4b00693f0 legacy=0x7fa4b0069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.723+0000 7fa4affff640 1 -- 172.21.15.55:0/527571086 >> v1:172.21.15.55:6789/0 conn(0x7fa4b00ccb70 legacy=0x7fa4b00c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.723+0000 7fa4affff640 1 -- 172.21.15.55:0/527571086 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b00c8480 con 0x7fa4b00c9b90 2023-07-06T21:54:23.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.723+0000 7fa4affff640 1 --2- 172.21.15.55:0/527571086 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b00c9b90 0x7fa4b015dd50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00097f0 tx=0x7fa4a001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f86c5ba54245bdf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4aeffd640 1 -- 172.21.15.55:0/527571086 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a00ac630 con 0x7fa4b00c9b90 2023-07-06T21:54:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4aeffd640 1 -- 172.21.15.55:0/527571086 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a00ac790 con 0x7fa4b00c9b90 2023-07-06T21:54:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4aeffd640 1 -- 172.21.15.55:0/527571086 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a00acb20 con 0x7fa4b00c9b90 2023-07-06T21:54:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 -- 172.21.15.55:0/527571086 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b00c9b90 msgr2=0x7fa4b015dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 --2- 172.21.15.55:0/527571086 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b00c9b90 0x7fa4b015dd50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00097f0 tx=0x7fa4a001c4c0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 -- 172.21.15.55:0/527571086 shutdown_connections 2023-07-06T21:54:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 --2- 172.21.15.55:0/527571086 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b00c9b90 0x7fa4b015dd50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 -- 172.21.15.55:0/527571086 >> 172.21.15.55:0/527571086 conn(0x7fa4b00cde30 msgr2=0x7fa4b00ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 -- 172.21.15.55:0/527571086 shutdown_connections 2023-07-06T21:54:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 -- 172.21.15.55:0/527571086 wait complete. 2023-07-06T21:54:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 Processor -- start 2023-07-06T21:54:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 -- start start 2023-07-06T21:54:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b00693f0 0x7fa4b00c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:23.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b00c9b90 0x7fa4b0157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:23.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b00ccb70 0x7fa4b00c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:23.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b015a950 con 0x7fa4b00ccb70 2023-07-06T21:54:23.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b0159cd0 con 0x7fa4b00693f0 2023-07-06T21:54:23.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b6967640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b0159fb0 con 0x7fa4b00c9b90 2023-07-06T21:54:23.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b4f04640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b00ccb70 0x7fa4b00c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:23.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4af7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b00c9b90 0x7fa4b0157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:23.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b4f04640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b00ccb70 0x7fa4b00c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51194/0 (socket says 172.21.15.55:51194) 2023-07-06T21:54:23.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4b4f04640 1 -- 172.21.15.55:0/1373932070 learned_addr learned my addr 172.21.15.55:0/1373932070 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:23.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4af7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b00c9b90 0x7fa4b0157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:57666/0 (socket says 172.21.15.55:57666) 2023-07-06T21:54:23.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.727+0000 7fa4affff640 1 --2- 172.21.15.55:0/1373932070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b00693f0 0x7fa4b00c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:23.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4b4f04640 1 -- 172.21.15.55:0/1373932070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b00c9b90 msgr2=0x7fa4b0157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4b4f04640 1 --2- 172.21.15.55:0/1373932070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b00c9b90 0x7fa4b0157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4b4f04640 1 -- 172.21.15.55:0/1373932070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b00693f0 msgr2=0x7fa4b00c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4b4f04640 1 --2- 172.21.15.55:0/1373932070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b00693f0 0x7fa4b00c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4b4f04640 1 -- 172.21.15.55:0/1373932070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a0009420 con 0x7fa4b00ccb70 2023-07-06T21:54:23.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4b4f04640 1 --2- 172.21.15.55:0/1373932070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b00ccb70 0x7fa4b00c4f70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800c730 tx=0x7fa4a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:23.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4acff9640 1 -- 172.21.15.55:0/1373932070 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8003b80 con 0x7fa4b00ccb70 2023-07-06T21:54:23.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4acff9640 1 -- 172.21.15.55:0/1373932070 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a8003ce0 con 0x7fa4b00ccb70 2023-07-06T21:54:23.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4acff9640 1 -- 172.21.15.55:0/1373932070 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a800aa90 con 0x7fa4b00ccb70 2023-07-06T21:54:23.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4b6967640 1 -- 172.21.15.55:0/1373932070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b015a290 con 0x7fa4b00ccb70 2023-07-06T21:54:23.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4b6967640 1 -- 172.21.15.55:0/1373932070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b0158340 con 0x7fa4b00ccb70 2023-07-06T21:54:23.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4b6967640 1 -- 172.21.15.55:0/1373932070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b00c94e0 con 0x7fa4b00ccb70 2023-07-06T21:54:23.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4acff9640 1 -- 172.21.15.55:0/1373932070 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fa4a800abf0 con 0x7fa4b00ccb70 2023-07-06T21:54:23.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4acff9640 1 --2- 172.21.15.55:0/1373932070 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa49c066480 0x7fa49c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:23.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.731+0000 7fa4acff9640 1 -- 172.21.15.55:0/1373932070 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7fa4a8083fe0 con 0x7fa4b00ccb70 2023-07-06T21:54:23.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.735+0000 7fa4affff640 1 --2- 172.21.15.55:0/1373932070 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa49c066480 0x7fa49c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:23.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.735+0000 7fa4affff640 1 --2- 172.21.15.55:0/1373932070 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa49c066480 0x7fa49c068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00ae000 tx=0x7fa4a0008040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:23.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.735+0000 7fa4acff9640 1 -- 172.21.15.55:0/1373932070 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa4b00c94e0 con 0x7fa4b00ccb70 2023-07-06T21:54:23.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.915+0000 7fa4b6967640 1 -- 172.21.15.55:0/1373932070 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4b006a390 con 0x7fa49c066480 2023-07-06T21:54:23.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.995+0000 7fa4acff9640 1 -- 172.21.15.55:0/1373932070 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa4a00ac900 con 0x7fa49c066480 2023-07-06T21:54:23.996 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-07-06T21:54:23.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.995+0000 7fa4b6967640 1 -- 172.21.15.55:0/1373932070 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa49c066480 msgr2=0x7fa49c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.995+0000 7fa4b6967640 1 --2- 172.21.15.55:0/1373932070 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa49c066480 0x7fa49c068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00ae000 tx=0x7fa4a0008040 comp rx=0 tx=0).stop 2023-07-06T21:54:23.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.995+0000 7fa4b6967640 1 -- 172.21.15.55:0/1373932070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b00ccb70 msgr2=0x7fa4b00c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:23.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.995+0000 7fa4b6967640 1 --2- 172.21.15.55:0/1373932070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b00ccb70 0x7fa4b00c4f70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800c730 tx=0x7fa4a800cbf0 comp rx=0 tx=0).stop 2023-07-06T21:54:23.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.999+0000 7fa4b6967640 1 -- 172.21.15.55:0/1373932070 shutdown_connections 2023-07-06T21:54:24.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.999+0000 7fa4b6967640 1 --2- 172.21.15.55:0/1373932070 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa49c066480 0x7fa49c068930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.999+0000 7fa4b6967640 1 --2- 172.21.15.55:0/1373932070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b00ccb70 0x7fa4b00c4f70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.999+0000 7fa4b6967640 1 --2- 172.21.15.55:0/1373932070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b00c9b90 0x7fa4b0157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.999+0000 7fa4b6967640 1 --2- 172.21.15.55:0/1373932070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b00693f0 0x7fa4b00c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.999+0000 7fa4b6967640 1 -- 172.21.15.55:0/1373932070 >> 172.21.15.55:0/1373932070 conn(0x7fa4b00cde30 msgr2=0x7fa4b0164890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:24.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.999+0000 7fa4b6967640 1 -- 172.21.15.55:0/1373932070 shutdown_connections 2023-07-06T21:54:24.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:23.999+0000 7fa4b6967640 1 -- 172.21.15.55:0/1373932070 wait complete. 2023-07-06T21:54:24.017 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-07-06T21:54:24.018 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-07-06T21:54:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.167+0000 7f9a6e008640 1 Processor -- start 2023-07-06T21:54:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.167+0000 7f9a6e008640 1 -- start start 2023-07-06T21:54:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.171+0000 7f9a6e008640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9a6815b830 0x7f9a680b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.171+0000 7f9a6e008640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9a6815fc80 0x7f9a680ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.171+0000 7f9a6e008640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a680cd070 con 0x7f9a680cc6e0 2023-07-06T21:54:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.171+0000 7f9a6e008640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a681600e0 con 0x7f9a6815b830 2023-07-06T21:54:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.171+0000 7f9a6e008640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a680b2030 con 0x7f9a6815fc80 2023-07-06T21:54:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.171+0000 7f9a6d006640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9a6815b830 0x7f9a680b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.171+0000 7f9a6c805640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9a680cc6e0 0x7f9a6815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42056/0 (socket says 172.21.15.55:42056) 2023-07-06T21:54:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.171+0000 7f9a6d006640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9a6815b830 0x7f9a680b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51204/0 (socket says 172.21.15.55:51204) 2023-07-06T21:54:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.171+0000 7f9a6c805640 1 -- 172.21.15.55:0/528087839 learned_addr learned my addr 172.21.15.55:0/528087839 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.171+0000 7f9a6d006640 1 -- 172.21.15.55:0/528087839 >> v2:172.21.15.138:3300/0 conn(0x7f9a6815fc80 msgr2=0x7f9a680ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.171+0000 7f9a6d006640 1 --2- 172.21.15.55:0/528087839 >> v2:172.21.15.138:3300/0 conn(0x7f9a6815fc80 0x7f9a680ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.171+0000 7f9a6d006640 1 -- 172.21.15.55:0/528087839 >> v1:172.21.15.55:6789/0 conn(0x7f9a680cc6e0 legacy=0x7f9a6815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.171+0000 7f9a6d006640 1 -- 172.21.15.55:0/528087839 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a680b1700 con 0x7f9a6815b830 2023-07-06T21:54:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.171+0000 7f9a5ffff640 1 -- 172.21.15.55:0/528087839 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185775134 0 0) 0x7f9a58001120 con 0x7f9a680cc6e0 2023-07-06T21:54:24.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.175+0000 7f9a6d006640 1 --2- 172.21.15.55:0/528087839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6815b830 0x7f9a680b24c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9a680b8290 tx=0x7f9a6401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d190ac719c1419c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:24.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.175+0000 7f9a5ffff640 1 -- 172.21.15.55:0/528087839 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a640a7070 con 0x7f9a6815b830 2023-07-06T21:54:24.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.175+0000 7f9a5ffff640 1 -- 172.21.15.55:0/528087839 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a640ab430 con 0x7f9a6815b830 2023-07-06T21:54:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.175+0000 7f9a5ffff640 1 -- 172.21.15.55:0/528087839 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a640ab7c0 con 0x7f9a6815b830 2023-07-06T21:54:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.175+0000 7f9a6e008640 1 -- 172.21.15.55:0/528087839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6815b830 msgr2=0x7f9a680b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.175+0000 7f9a6e008640 1 --2- 172.21.15.55:0/528087839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6815b830 0x7f9a680b24c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9a680b8290 tx=0x7f9a6401c430 comp rx=0 tx=0).stop 2023-07-06T21:54:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.175+0000 7f9a6e008640 1 -- 172.21.15.55:0/528087839 shutdown_connections 2023-07-06T21:54:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.175+0000 7f9a6e008640 1 --2- 172.21.15.55:0/528087839 >> v2:172.21.15.138:3300/0 conn(0x7f9a6815fc80 0x7f9a680ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.175+0000 7f9a6e008640 1 --2- 172.21.15.55:0/528087839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6815b830 0x7f9a680b24c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.175+0000 7f9a6e008640 1 -- 172.21.15.55:0/528087839 >> 172.21.15.55:0/528087839 conn(0x7f9a68070b20 msgr2=0x7f9a68070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.175+0000 7f9a6e008640 1 -- 172.21.15.55:0/528087839 shutdown_connections 2023-07-06T21:54:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.175+0000 7f9a6e008640 1 -- 172.21.15.55:0/528087839 wait complete. 2023-07-06T21:54:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.175+0000 7f9a6e008640 1 Processor -- start 2023-07-06T21:54:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.175+0000 7f9a6e008640 1 -- start start 2023-07-06T21:54:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6e008640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a680cc6e0 0x7f9a680cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6e008640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6815b830 0x7f9a681515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6e008640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6815fc80 0x7f9a680b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6e008640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a680cc0c0 con 0x7f9a6815fc80 2023-07-06T21:54:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6e008640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a68151ae0 con 0x7f9a680cc6e0 2023-07-06T21:54:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6e008640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a680b6ba0 con 0x7f9a6815b830 2023-07-06T21:54:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6d807640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6815fc80 0x7f9a680b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6d807640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6815fc80 0x7f9a680b6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51218/0 (socket says 172.21.15.55:51218) 2023-07-06T21:54:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6d807640 1 -- 172.21.15.55:0/3354852992 learned_addr learned my addr 172.21.15.55:0/3354852992 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:24.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6d807640 1 -- 172.21.15.55:0/3354852992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6815b830 msgr2=0x7f9a681515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:24.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6d807640 1 --2- 172.21.15.55:0/3354852992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6815b830 0x7f9a681515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6d807640 1 -- 172.21.15.55:0/3354852992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a680cc6e0 msgr2=0x7f9a680cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:24.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6d807640 1 --2- 172.21.15.55:0/3354852992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a680cc6e0 0x7f9a680cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6d807640 1 -- 172.21.15.55:0/3354852992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a64009420 con 0x7f9a6815fc80 2023-07-06T21:54:24.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6d807640 1 --2- 172.21.15.55:0/3354852992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6815fc80 0x7f9a680b6370 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000b970 tx=0x7f9a6000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:24.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a5dffb640 1 -- 172.21.15.55:0/3354852992 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000cb40 con 0x7f9a6815fc80 2023-07-06T21:54:24.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a5dffb640 1 -- 172.21.15.55:0/3354852992 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6000ccc0 con 0x7f9a6815fc80 2023-07-06T21:54:24.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6e008640 1 -- 172.21.15.55:0/3354852992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a680b6e80 con 0x7f9a6815fc80 2023-07-06T21:54:24.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a5dffb640 1 -- 172.21.15.55:0/3354852992 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60014680 con 0x7f9a6815fc80 2023-07-06T21:54:24.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6e008640 1 -- 172.21.15.55:0/3354852992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a680b7440 con 0x7f9a6815fc80 2023-07-06T21:54:24.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a6e008640 1 -- 172.21.15.55:0/3354852992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6804d860 con 0x7f9a6815fc80 2023-07-06T21:54:24.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.179+0000 7f9a5dffb640 1 -- 172.21.15.55:0/3354852992 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f9a6001d3b0 con 0x7f9a6815fc80 2023-07-06T21:54:24.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.183+0000 7f9a5dffb640 1 --2- 172.21.15.55:0/3354852992 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f9a4c0664b0 0x7f9a4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:24.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.183+0000 7f9a5dffb640 1 -- 172.21.15.55:0/3354852992 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f9a600842d0 con 0x7f9a6815fc80 2023-07-06T21:54:24.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.183+0000 7f9a6d006640 1 --2- 172.21.15.55:0/3354852992 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f9a4c0664b0 0x7f9a4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:24.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.183+0000 7f9a6d006640 1 --2- 172.21.15.55:0/3354852992 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f9a4c0664b0 0x7f9a4c068960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a640af000 tx=0x7f9a64008040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.187+0000 7f9a5dffb640 1 -- 172.21.15.55:0/3354852992 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a60051240 con 0x7f9a6815fc80 2023-07-06T21:54:24.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.363+0000 7f9a6e008640 1 -- 172.21.15.55:0/3354852992 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a681602e0 con 0x7f9a4c0664b0 2023-07-06T21:54:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.439+0000 7f9a5dffb640 1 -- 172.21.15.55:0/3354852992 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f9a640ab8a0 con 0x7f9a4c0664b0 2023-07-06T21:54:24.439 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-07-06T21:54:24.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.439+0000 7f9a6e008640 1 -- 172.21.15.55:0/3354852992 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f9a4c0664b0 msgr2=0x7f9a4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.439+0000 7f9a6e008640 1 --2- 172.21.15.55:0/3354852992 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f9a4c0664b0 0x7f9a4c068960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a640af000 tx=0x7f9a64008040 comp rx=0 tx=0).stop 2023-07-06T21:54:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.439+0000 7f9a6e008640 1 -- 172.21.15.55:0/3354852992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6815fc80 msgr2=0x7f9a680b6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.439+0000 7f9a6e008640 1 --2- 172.21.15.55:0/3354852992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6815fc80 0x7f9a680b6370 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000b970 tx=0x7f9a6000be30 comp rx=0 tx=0).stop 2023-07-06T21:54:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.439+0000 7f9a6e008640 1 -- 172.21.15.55:0/3354852992 shutdown_connections 2023-07-06T21:54:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.439+0000 7f9a6e008640 1 --2- 172.21.15.55:0/3354852992 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f9a4c0664b0 0x7f9a4c068960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.439+0000 7f9a6e008640 1 --2- 172.21.15.55:0/3354852992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6815fc80 0x7f9a680b6370 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.439+0000 7f9a6e008640 1 --2- 172.21.15.55:0/3354852992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6815b830 0x7f9a681515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.439+0000 7f9a6e008640 1 --2- 172.21.15.55:0/3354852992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a680cc6e0 0x7f9a680cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.439+0000 7f9a6e008640 1 -- 172.21.15.55:0/3354852992 >> 172.21.15.55:0/3354852992 conn(0x7f9a68070b20 msgr2=0x7f9a680694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:24.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.439+0000 7f9a6e008640 1 -- 172.21.15.55:0/3354852992 shutdown_connections 2023-07-06T21:54:24.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.439+0000 7f9a6e008640 1 -- 172.21.15.55:0/3354852992 wait complete. 2023-07-06T21:54:24.459 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-07-06T21:54:24.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:24.460 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-07-06T21:54:24.472 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:24.472 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:24.472 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:24.472 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:24.473 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:24.473 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:24.473 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:24.473 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:24.473 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:24.473 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:24.473 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:24.474 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-06-21_44_00_UTC', 'scheduled-2023-07-06-21_45_00_UTC', 'scheduled-2023-07-06-21_46_00_UTC', 'scheduled-2023-07-06-21_47_00_UTC', 'scheduled-2023-07-06-21_48_00_UTC', 'scheduled-2023-07-06-21_49_00_UTC', 'scheduled-2023-07-06-21_50_00_UTC', 'scheduled-2023-07-06-21_51_00_UTC', 'scheduled-2023-07-06-21_52_00_UTC', 'scheduled-2023-07-06-21_53_00_UTC', 'scheduled-2023-07-06-21_54_00_UTC'] 2023-07-06T21:54:24.475 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-07-06T21:54:24.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.663+0000 7fd3e739f640 1 Processor -- start 2023-07-06T21:54:24.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.663+0000 7fd3e739f640 1 -- start start 2023-07-06T21:54:24.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.663+0000 7fd3e739f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3e00b3c90 0x7fd3e00ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:24.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.663+0000 7fd3e739f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd3e00b18a0 0x7fd3e00b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:24.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.663+0000 7fd3e739f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e00ccd50 con 0x7fd3e00d1d30 2023-07-06T21:54:24.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.663+0000 7fd3e739f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e00cd0a0 con 0x7fd3e00b18a0 2023-07-06T21:54:24.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.663+0000 7fd3e739f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e0069ea0 con 0x7fd3e00b3c90 2023-07-06T21:54:24.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.663+0000 7fd3e593c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd3e00d1d30 0x7fd3e015f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42072/0 (socket says 172.21.15.55:42072) 2023-07-06T21:54:24.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.663+0000 7fd3e593c640 1 -- 172.21.15.55:0/129333980 learned_addr learned my addr 172.21.15.55:0/129333980 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:24.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.663+0000 7fd3e513b640 1 --2- 172.21.15.55:0/129333980 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3e00b3c90 0x7fd3e00ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:24.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.663+0000 7fd3e493a640 1 --2- 172.21.15.55:0/129333980 >> v2:172.21.15.138:3300/0 conn(0x7fd3e00b18a0 0x7fd3e00b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:24.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.663+0000 7fd3d7fff640 1 -- 172.21.15.55:0/129333980 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855801169 0 0) 0x7fd3e00ccd50 con 0x7fd3e00d1d30 2023-07-06T21:54:24.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.663+0000 7fd3d7fff640 1 -- 172.21.15.55:0/129333980 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3cc003530 con 0x7fd3e00d1d30 2023-07-06T21:54:24.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3e513b640 1 -- 172.21.15.55:0/129333980 >> v2:172.21.15.138:3300/0 conn(0x7fd3e00b18a0 msgr2=0x7fd3e00b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:24.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3e513b640 1 --2- 172.21.15.55:0/129333980 >> v2:172.21.15.138:3300/0 conn(0x7fd3e00b18a0 0x7fd3e00b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3e513b640 1 -- 172.21.15.55:0/129333980 >> v1:172.21.15.55:6789/0 conn(0x7fd3e00d1d30 legacy=0x7fd3e015f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:24.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3e513b640 1 -- 172.21.15.55:0/129333980 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e00b45a0 con 0x7fd3e00b3c90 2023-07-06T21:54:24.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3e493a640 1 --2- 172.21.15.55:0/129333980 >> v2:172.21.15.138:3300/0 conn(0x7fd3e00b18a0 0x7fd3e00b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:24.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3e513b640 1 --2- 172.21.15.55:0/129333980 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3e00b3c90 0x7fd3e00ce460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0097c0 tx=0x7fd3dc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=781331f1881cc7b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:24.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3d7fff640 1 -- 172.21.15.55:0/129333980 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0ab650 con 0x7fd3e00b3c90 2023-07-06T21:54:24.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3d7fff640 1 -- 172.21.15.55:0/129333980 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc0ab7b0 con 0x7fd3e00b3c90 2023-07-06T21:54:24.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3d7fff640 1 -- 172.21.15.55:0/129333980 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0abb40 con 0x7fd3e00b3c90 2023-07-06T21:54:24.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3e739f640 1 -- 172.21.15.55:0/129333980 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3e00b3c90 msgr2=0x7fd3e00ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3e739f640 1 --2- 172.21.15.55:0/129333980 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3e00b3c90 0x7fd3e00ce460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0097c0 tx=0x7fd3dc01c450 comp rx=0 tx=0).stop 2023-07-06T21:54:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3e739f640 1 -- 172.21.15.55:0/129333980 shutdown_connections 2023-07-06T21:54:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3e739f640 1 --2- 172.21.15.55:0/129333980 >> v2:172.21.15.138:3300/0 conn(0x7fd3e00b18a0 0x7fd3e00b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3e739f640 1 --2- 172.21.15.55:0/129333980 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3e00b3c90 0x7fd3e00ce460 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.667+0000 7fd3e739f640 1 -- 172.21.15.55:0/129333980 >> 172.21.15.55:0/129333980 conn(0x7fd3e006bf40 msgr2=0x7fd3e00cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e739f640 1 -- 172.21.15.55:0/129333980 shutdown_connections 2023-07-06T21:54:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e739f640 1 -- 172.21.15.55:0/129333980 wait complete. 2023-07-06T21:54:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e739f640 1 Processor -- start 2023-07-06T21:54:24.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e739f640 1 -- start start 2023-07-06T21:54:24.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e739f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3e00b18a0 0x7fd3e00cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:24.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e739f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3e00b3c90 0x7fd3e0160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:24.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e739f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3e00d1d30 0x7fd3e0160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:24.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e739f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e0162030 con 0x7fd3e00b18a0 2023-07-06T21:54:24.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e739f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e01613b0 con 0x7fd3e00b3c90 2023-07-06T21:54:24.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e739f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e0161690 con 0x7fd3e00d1d30 2023-07-06T21:54:24.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e513b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3e00b18a0 0x7fd3e00cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:24.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e513b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3e00b18a0 0x7fd3e00cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51220/0 (socket says 172.21.15.55:51220) 2023-07-06T21:54:24.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e513b640 1 -- 172.21.15.55:0/1730435450 learned_addr learned my addr 172.21.15.55:0/1730435450 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:24.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e593c640 1 --2- 172.21.15.55:0/1730435450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3e00d1d30 0x7fd3e0160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e493a640 1 --2- 172.21.15.55:0/1730435450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3e00b3c90 0x7fd3e0160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e513b640 1 -- 172.21.15.55:0/1730435450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3e00d1d30 msgr2=0x7fd3e0160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e513b640 1 --2- 172.21.15.55:0/1730435450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3e00d1d30 0x7fd3e0160dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e513b640 1 -- 172.21.15.55:0/1730435450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3e00b3c90 msgr2=0x7fd3e0160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e513b640 1 --2- 172.21.15.55:0/1730435450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3e00b3c90 0x7fd3e0160890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e513b640 1 -- 172.21.15.55:0/1730435450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d0009420 con 0x7fd3e00b18a0 2023-07-06T21:54:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.671+0000 7fd3e513b640 1 --2- 172.21.15.55:0/1730435450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3e00b18a0 0x7fd3e00cafb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0ad040 tx=0x7fd3dc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.675+0000 7fd3d5ffb640 1 -- 172.21.15.55:0/1730435450 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0bf610 con 0x7fd3e00b18a0 2023-07-06T21:54:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.675+0000 7fd3d5ffb640 1 -- 172.21.15.55:0/1730435450 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc0bf790 con 0x7fd3e00b18a0 2023-07-06T21:54:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.675+0000 7fd3d5ffb640 1 -- 172.21.15.55:0/1730435450 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0bfb40 con 0x7fd3e00b18a0 2023-07-06T21:54:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.675+0000 7fd3e739f640 1 -- 172.21.15.55:0/1730435450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3dc009420 con 0x7fd3e00b18a0 2023-07-06T21:54:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.675+0000 7fd3e739f640 1 -- 172.21.15.55:0/1730435450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e0161c50 con 0x7fd3e00b18a0 2023-07-06T21:54:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.675+0000 7fd3e739f640 1 -- 172.21.15.55:0/1730435450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e0066d60 con 0x7fd3e00b18a0 2023-07-06T21:54:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.675+0000 7fd3d5ffb640 1 -- 172.21.15.55:0/1730435450 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fd3dc0bfca0 con 0x7fd3e00b18a0 2023-07-06T21:54:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.675+0000 7fd3d5ffb640 1 --2- 172.21.15.55:0/1730435450 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd3c4066480 0x7fd3c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.675+0000 7fd3d5ffb640 1 -- 172.21.15.55:0/1730435450 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7fd3dc11ebd0 con 0x7fd3e00b18a0 2023-07-06T21:54:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.675+0000 7fd3e493a640 1 --2- 172.21.15.55:0/1730435450 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd3c4066480 0x7fd3c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.679+0000 7fd3e493a640 1 --2- 172.21.15.55:0/1730435450 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd3c4066480 0x7fd3c4068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0166730 tx=0x7fd3d0009190 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:24.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.679+0000 7fd3d5ffb640 1 -- 172.21.15.55:0/1730435450 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd3dc0ebcc0 con 0x7fd3e00b18a0 2023-07-06T21:54:24.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.855+0000 7fd3e739f640 1 -- 172.21.15.55:0/1730435450 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3e0168880 con 0x7fd3c4066480 2023-07-06T21:54:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.863+0000 7fd3d5ffb640 1 -- 172.21.15.55:0/1730435450 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fd3d0009940 con 0x7fd3c4066480 2023-07-06T21:54:24.863 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:24.863 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:46", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.863+0000 7fd3e739f640 1 -- 172.21.15.55:0/1730435450 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd3c4066480 msgr2=0x7fd3c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.863+0000 7fd3e739f640 1 --2- 172.21.15.55:0/1730435450 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd3c4066480 0x7fd3c4068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0166730 tx=0x7fd3d0009190 comp rx=0 tx=0).stop 2023-07-06T21:54:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.863+0000 7fd3e739f640 1 -- 172.21.15.55:0/1730435450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3e00b18a0 msgr2=0x7fd3e00cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.863+0000 7fd3e739f640 1 --2- 172.21.15.55:0/1730435450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3e00b18a0 0x7fd3e00cafb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0ad040 tx=0x7fd3dc01ac90 comp rx=0 tx=0).stop 2023-07-06T21:54:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.863+0000 7fd3e739f640 1 -- 172.21.15.55:0/1730435450 shutdown_connections 2023-07-06T21:54:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.863+0000 7fd3e739f640 1 --2- 172.21.15.55:0/1730435450 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fd3c4066480 0x7fd3c4068930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.863+0000 7fd3e739f640 1 --2- 172.21.15.55:0/1730435450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3e00d1d30 0x7fd3e0160dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.863+0000 7fd3e739f640 1 --2- 172.21.15.55:0/1730435450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3e00b3c90 0x7fd3e0160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.863+0000 7fd3e739f640 1 --2- 172.21.15.55:0/1730435450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3e00b18a0 0x7fd3e00cafb0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.863+0000 7fd3e739f640 1 -- 172.21.15.55:0/1730435450 >> 172.21.15.55:0/1730435450 conn(0x7fd3e006bf40 msgr2=0x7fd3e00b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.863+0000 7fd3e739f640 1 -- 172.21.15.55:0/1730435450 shutdown_connections 2023-07-06T21:54:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:24.863+0000 7fd3e739f640 1 -- 172.21.15.55:0/1730435450 wait complete. 2023-07-06T21:54:24.884 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:46", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:24.884 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-07-06T00:00:00', 'created': '2023-07-06T21:43:46', 'first': '2023-07-06T21:44:00', 'last': '2023-07-06T21:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-06T21:54:24.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:24.885 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-07-06T21:54:24.895 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:24.895 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:24.895 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:24.895 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:24.896 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:24.896 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_01_UTC 2023-07-06T21:54:24.896 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:24.896 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:24.896 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:24.896 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:24.896 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:24.897 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-06-21_44_00_UTC', 'scheduled-2023-07-06-21_45_00_UTC', 'scheduled-2023-07-06-21_46_00_UTC', 'scheduled-2023-07-06-21_47_00_UTC', 'scheduled-2023-07-06-21_48_00_UTC', 'scheduled-2023-07-06-21_49_01_UTC', 'scheduled-2023-07-06-21_50_00_UTC', 'scheduled-2023-07-06-21_51_00_UTC', 'scheduled-2023-07-06-21_52_00_UTC', 'scheduled-2023-07-06-21_53_00_UTC', 'scheduled-2023-07-06-21_54_00_UTC'] 2023-07-06T21:54:24.898 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-07-06T21:54:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.087+0000 7f42fc700640 1 Processor -- start 2023-07-06T21:54:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.087+0000 7f42fc700640 1 -- start start 2023-07-06T21:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.091+0000 7f42fc700640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f415b930 0x7f42f40cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.091+0000 7f42fc700640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42f40ce790 0x7f42f40ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.091+0000 7f42fc700640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f40b5880 con 0x7f42f40cc2e0 2023-07-06T21:54:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.091+0000 7f42fc700640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f40b5b60 con 0x7f42f40ce790 2023-07-06T21:54:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.091+0000 7f42fc700640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40cdcb0 con 0x7f42f415b930 2023-07-06T21:54:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.091+0000 7f42fac9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42f40ce790 0x7f42f40ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.091+0000 7f42fac9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42f40ce790 0x7f42f40ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51230/0 (socket says 172.21.15.55:51230) 2023-07-06T21:54:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.091+0000 7f42fac9d640 1 -- 172.21.15.55:0/23553288 learned_addr learned my addr 172.21.15.55:0/23553288 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:25.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.091+0000 7f42fa49c640 1 --2- 172.21.15.55:0/23553288 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f415b930 0x7f42f40cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.091+0000 7f42fac9d640 1 -- 172.21.15.55:0/23553288 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f415b930 msgr2=0x7f42f40cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:25.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.091+0000 7f42fac9d640 1 --2- 172.21.15.55:0/23553288 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f415b930 0x7f42f40cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.091+0000 7f42fac9d640 1 -- 172.21.15.55:0/23553288 >> v1:172.21.15.138:6789/0 conn(0x7f42f40cc2e0 legacy=0x7f42f40ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:25.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.091+0000 7f42fac9d640 1 -- 172.21.15.55:0/23553288 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f40cdf90 con 0x7f42f40ce790 2023-07-06T21:54:25.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.095+0000 7f42fac9d640 1 --2- 172.21.15.55:0/23553288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40ce790 0x7f42f40ccf20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009e50 tx=0x7f42ec01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2b06a6d2dac437 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.095+0000 7f42f949a640 1 -- 172.21.15.55:0/23553288 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec0a58d0 con 0x7f42f40ce790 2023-07-06T21:54:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.095+0000 7f42f949a640 1 -- 172.21.15.55:0/23553288 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec0a5a30 con 0x7f42f40ce790 2023-07-06T21:54:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.095+0000 7f42f949a640 1 -- 172.21.15.55:0/23553288 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec0a5dc0 con 0x7f42f40ce790 2023-07-06T21:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.095+0000 7f42fc700640 1 -- 172.21.15.55:0/23553288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40ce790 msgr2=0x7f42f40ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.095+0000 7f42fc700640 1 --2- 172.21.15.55:0/23553288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40ce790 0x7f42f40ccf20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009e50 tx=0x7f42ec01c9e0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.095+0000 7f42fc700640 1 -- 172.21.15.55:0/23553288 shutdown_connections 2023-07-06T21:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.095+0000 7f42fc700640 1 --2- 172.21.15.55:0/23553288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40ce790 0x7f42f40ccf20 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.095+0000 7f42fc700640 1 --2- 172.21.15.55:0/23553288 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f415b930 0x7f42f40cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.095+0000 7f42fc700640 1 -- 172.21.15.55:0/23553288 >> 172.21.15.55:0/23553288 conn(0x7f42f40d0c60 msgr2=0x7f42f40b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.095+0000 7f42fc700640 1 -- 172.21.15.55:0/23553288 shutdown_connections 2023-07-06T21:54:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.095+0000 7f42fc700640 1 -- 172.21.15.55:0/23553288 wait complete. 2023-07-06T21:54:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.095+0000 7f42fc700640 1 Processor -- start 2023-07-06T21:54:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.095+0000 7f42fc700640 1 -- start start 2023-07-06T21:54:25.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fc700640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40ce790 0x7f42f415e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fc700640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42f415b930 0x7f42f40c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fc700640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f40ca050 0x7f42f414d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fc700640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f4156890 con 0x7f42f40ce790 2023-07-06T21:54:25.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fc700640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40c7fa0 con 0x7f42f415b930 2023-07-06T21:54:25.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fc700640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40c8280 con 0x7f42f40ca050 2023-07-06T21:54:25.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fa49c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40ce790 0x7f42f415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fa49c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40ce790 0x7f42f415e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51244/0 (socket says 172.21.15.55:51244) 2023-07-06T21:54:25.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fa49c640 1 -- 172.21.15.55:0/2029636676 learned_addr learned my addr 172.21.15.55:0/2029636676 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:25.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42f9c9b640 1 --2- 172.21.15.55:0/2029636676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42f415b930 0x7f42f40c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fac9d640 1 --2- 172.21.15.55:0/2029636676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f40ca050 0x7f42f414d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fa49c640 1 -- 172.21.15.55:0/2029636676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f40ca050 msgr2=0x7f42f414d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fa49c640 1 --2- 172.21.15.55:0/2029636676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f40ca050 0x7f42f414d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fa49c640 1 -- 172.21.15.55:0/2029636676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42f415b930 msgr2=0x7f42f40c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fa49c640 1 --2- 172.21.15.55:0/2029636676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42f415b930 0x7f42f40c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fa49c640 1 -- 172.21.15.55:0/2029636676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec009b30 con 0x7f42f40ce790 2023-07-06T21:54:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fa49c640 1 --2- 172.21.15.55:0/2029636676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40ce790 0x7f42f415e500 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f42f000d5f0 tx=0x7f42f000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42eaffd640 1 -- 172.21.15.55:0/2029636676 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f00125f0 con 0x7f42f40ce790 2023-07-06T21:54:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42eaffd640 1 -- 172.21.15.55:0/2029636676 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f0012750 con 0x7f42f40ce790 2023-07-06T21:54:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42eaffd640 1 -- 172.21.15.55:0/2029636676 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0012ae0 con 0x7f42f40ce790 2023-07-06T21:54:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fc700640 1 -- 172.21.15.55:0/2029636676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f40c8560 con 0x7f42f40ce790 2023-07-06T21:54:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fc700640 1 -- 172.21.15.55:0/2029636676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f415ea40 con 0x7f42f40ce790 2023-07-06T21:54:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42fc700640 1 -- 172.21.15.55:0/2029636676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f4156b00 con 0x7f42f40ce790 2023-07-06T21:54:25.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.099+0000 7f42eaffd640 1 -- 172.21.15.55:0/2029636676 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f42f0012c40 con 0x7f42f40ce790 2023-07-06T21:54:25.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.103+0000 7f42eaffd640 1 --2- 172.21.15.55:0/2029636676 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f42d8066480 0x7f42d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.103+0000 7f42eaffd640 1 -- 172.21.15.55:0/2029636676 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f42f00846d0 con 0x7f42f40ce790 2023-07-06T21:54:25.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.103+0000 7f42f9c9b640 1 --2- 172.21.15.55:0/2029636676 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f42d8066480 0x7f42d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.103+0000 7f42f9c9b640 1 --2- 172.21.15.55:0/2029636676 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f42d8066480 0x7f42d8068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f42f415ef80 tx=0x7f42e4009040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:25.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.107+0000 7f42eaffd640 1 -- 172.21.15.55:0/2029636676 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42f0051700 con 0x7f42f40ce790 2023-07-06T21:54:25.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.295+0000 7f42fc700640 1 -- 172.21.15.55:0/2029636676 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42f415ec60 con 0x7f42d8066480 2023-07-06T21:54:25.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.303+0000 7f42eaffd640 1 -- 172.21.15.55:0/2029636676 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f42f415ec60 con 0x7f42d8066480 2023-07-06T21:54:25.302 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:25.302 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:46", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:25.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.303+0000 7f42fc700640 1 -- 172.21.15.55:0/2029636676 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f42d8066480 msgr2=0x7f42d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:25.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.303+0000 7f42fc700640 1 --2- 172.21.15.55:0/2029636676 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f42d8066480 0x7f42d8068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f42f415ef80 tx=0x7f42e4009040 comp rx=0 tx=0).stop 2023-07-06T21:54:25.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.303+0000 7f42fc700640 1 -- 172.21.15.55:0/2029636676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40ce790 msgr2=0x7f42f415e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:25.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.303+0000 7f42fc700640 1 --2- 172.21.15.55:0/2029636676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40ce790 0x7f42f415e500 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f42f000d5f0 tx=0x7f42f000dab0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.303+0000 7f42fc700640 1 -- 172.21.15.55:0/2029636676 shutdown_connections 2023-07-06T21:54:25.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.303+0000 7f42fc700640 1 --2- 172.21.15.55:0/2029636676 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f42d8066480 0x7f42d8068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.303+0000 7f42fc700640 1 --2- 172.21.15.55:0/2029636676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f40ca050 0x7f42f414d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.303+0000 7f42fc700640 1 --2- 172.21.15.55:0/2029636676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42f415b930 0x7f42f40c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.303+0000 7f42fc700640 1 --2- 172.21.15.55:0/2029636676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40ce790 0x7f42f415e500 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.303+0000 7f42fc700640 1 -- 172.21.15.55:0/2029636676 >> 172.21.15.55:0/2029636676 conn(0x7f42f40d0c60 msgr2=0x7f42f40b5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:25.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.303+0000 7f42fc700640 1 -- 172.21.15.55:0/2029636676 shutdown_connections 2023-07-06T21:54:25.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.303+0000 7f42fc700640 1 -- 172.21.15.55:0/2029636676 wait complete. 2023-07-06T21:54:25.322 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:46", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:25.322 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-07-06T00:00:00', 'created': '2023-07-06T21:43:46', 'first': '2023-07-06T21:44:00', 'last': '2023-07-06T21:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-06T21:54:25.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:25.323 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-07-06T21:54:25.333 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:25.334 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:25.334 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:25.334 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:25.334 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:25.334 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:25.334 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:25.335 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:25.335 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:25.335 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:25.335 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:25.336 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-06-21_44_00_UTC', 'scheduled-2023-07-06-21_45_00_UTC', 'scheduled-2023-07-06-21_46_00_UTC', 'scheduled-2023-07-06-21_47_00_UTC', 'scheduled-2023-07-06-21_48_00_UTC', 'scheduled-2023-07-06-21_49_00_UTC', 'scheduled-2023-07-06-21_50_00_UTC', 'scheduled-2023-07-06-21_51_00_UTC', 'scheduled-2023-07-06-21_52_00_UTC', 'scheduled-2023-07-06-21_53_00_UTC', 'scheduled-2023-07-06-21_54_00_UTC'] 2023-07-06T21:54:25.336 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-07-06T21:54:25.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e738d8640 1 Processor -- start 2023-07-06T21:54:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e738d8640 1 -- start start 2023-07-06T21:54:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e738d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e6c0caf70 0x7f7e6c0cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e738d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7e6c15c2b0 0x7f7e6c0c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e738d8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7e6c15c700 0x7f7e6c070020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e738d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6c0cb880 con 0x7f7e6c0caf70 2023-07-06T21:54:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e738d8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6c0c9910 con 0x7f7e6c15c700 2023-07-06T21:54:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e738d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c15cbb0 con 0x7f7e6c15c2b0 2023-07-06T21:54:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e71674640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e6c0caf70 0x7f7e6c0cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e71674640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e6c0caf70 0x7f7e6c0cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51252/0 (socket says 172.21.15.55:51252) 2023-07-06T21:54:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e71674640 1 -- 172.21.15.55:0/3880782012 learned_addr learned my addr 172.21.15.55:0/3880782012 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e71e75640 1 --2- 172.21.15.55:0/3880782012 >> v2:172.21.15.138:3300/0 conn(0x7f7e6c15c700 0x7f7e6c070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e70e73640 1 --2- 172.21.15.55:0/3880782012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7e6c15c2b0 0x7f7e6c0c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e71674640 1 -- 172.21.15.55:0/3880782012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7e6c15c2b0 msgr2=0x7f7e6c0c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e71674640 1 --2- 172.21.15.55:0/3880782012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7e6c15c2b0 0x7f7e6c0c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e71674640 1 -- 172.21.15.55:0/3880782012 >> v2:172.21.15.138:3300/0 conn(0x7f7e6c15c700 msgr2=0x7f7e6c070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e71674640 1 --2- 172.21.15.55:0/3880782012 >> v2:172.21.15.138:3300/0 conn(0x7f7e6c15c700 0x7f7e6c070020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e71674640 1 -- 172.21.15.55:0/3880782012 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c15ce90 con 0x7f7e6c0caf70 2023-07-06T21:54:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.523+0000 7f7e71e75640 1 --2- 172.21.15.55:0/3880782012 >> v2:172.21.15.138:3300/0 conn(0x7f7e6c15c700 0x7f7e6c070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.527+0000 7f7e71674640 1 --2- 172.21.15.55:0/3880782012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e6c0caf70 0x7f7e6c0cb340 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0b5080 tx=0x7f7e6801e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7408a347f64a06e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:25.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.527+0000 7f7e63fff640 1 -- 172.21.15.55:0/3880782012 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e680ab680 con 0x7f7e6c0caf70 2023-07-06T21:54:25.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.527+0000 7f7e63fff640 1 -- 172.21.15.55:0/3880782012 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e680ab7e0 con 0x7f7e6c0caf70 2023-07-06T21:54:25.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.527+0000 7f7e63fff640 1 -- 172.21.15.55:0/3880782012 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e680abb70 con 0x7f7e6c0caf70 2023-07-06T21:54:25.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.527+0000 7f7e738d8640 1 -- 172.21.15.55:0/3880782012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e6c0caf70 msgr2=0x7f7e6c0cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:25.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.527+0000 7f7e738d8640 1 --2- 172.21.15.55:0/3880782012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e6c0caf70 0x7f7e6c0cb340 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0b5080 tx=0x7f7e6801e6e0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.527+0000 7f7e738d8640 1 -- 172.21.15.55:0/3880782012 shutdown_connections 2023-07-06T21:54:25.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.527+0000 7f7e738d8640 1 --2- 172.21.15.55:0/3880782012 >> v2:172.21.15.138:3300/0 conn(0x7f7e6c15c700 0x7f7e6c070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.527+0000 7f7e738d8640 1 --2- 172.21.15.55:0/3880782012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7e6c15c2b0 0x7f7e6c0c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.527+0000 7f7e738d8640 1 --2- 172.21.15.55:0/3880782012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e6c0caf70 0x7f7e6c0cb340 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.527+0000 7f7e738d8640 1 -- 172.21.15.55:0/3880782012 >> 172.21.15.55:0/3880782012 conn(0x7f7e6c0cfb90 msgr2=0x7f7e6c0cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:25.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.527+0000 7f7e738d8640 1 -- 172.21.15.55:0/3880782012 shutdown_connections 2023-07-06T21:54:25.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.527+0000 7f7e738d8640 1 -- 172.21.15.55:0/3880782012 wait complete. 2023-07-06T21:54:25.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e738d8640 1 Processor -- start 2023-07-06T21:54:25.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e738d8640 1 -- start start 2023-07-06T21:54:25.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e738d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e6c0caf70 0x7f7e6c154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e738d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7e6c15c2b0 0x7f7e6c0b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e738d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e6c15c700 0x7f7e6c0c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e738d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c0b4570 con 0x7f7e6c15c700 2023-07-06T21:54:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e738d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c0b38f0 con 0x7f7e6c0caf70 2023-07-06T21:54:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e738d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c0b3bd0 con 0x7f7e6c15c2b0 2023-07-06T21:54:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e71e75640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e6c15c700 0x7f7e6c0c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e71e75640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e6c15c700 0x7f7e6c0c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51254/0 (socket says 172.21.15.55:51254) 2023-07-06T21:54:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e71e75640 1 -- 172.21.15.55:0/16758848 learned_addr learned my addr 172.21.15.55:0/16758848 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e70e73640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7e6c15c2b0 0x7f7e6c0b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e71674640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e6c0caf70 0x7f7e6c154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e71e75640 1 -- 172.21.15.55:0/16758848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7e6c15c2b0 msgr2=0x7f7e6c0b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:25.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e71e75640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7e6c15c2b0 0x7f7e6c0b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e71e75640 1 -- 172.21.15.55:0/16758848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e6c0caf70 msgr2=0x7f7e6c154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:25.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e71e75640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e6c0caf70 0x7f7e6c154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e71e75640 1 -- 172.21.15.55:0/16758848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68009470 con 0x7f7e6c15c700 2023-07-06T21:54:25.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e71674640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e6c0caf70 0x7f7e6c154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:25.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e71e75640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e6c15c700 0x7f7e6c0c72b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7e64007dc0 tx=0x7f7e6400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:25.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e61ffb640 1 -- 172.21.15.55:0/16758848 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640039a0 con 0x7f7e6c15c700 2023-07-06T21:54:25.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e61ffb640 1 -- 172.21.15.55:0/16758848 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6400f040 con 0x7f7e6c15c700 2023-07-06T21:54:25.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e61ffb640 1 -- 172.21.15.55:0/16758848 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64003d40 con 0x7f7e6c15c700 2023-07-06T21:54:25.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e738d8640 1 -- 172.21.15.55:0/16758848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6c0b3eb0 con 0x7f7e6c15c700 2023-07-06T21:54:25.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.531+0000 7f7e738d8640 1 -- 172.21.15.55:0/16758848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6c154a60 con 0x7f7e6c15c700 2023-07-06T21:54:25.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.535+0000 7f7e738d8640 1 -- 172.21.15.55:0/16758848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6c0b46b0 con 0x7f7e6c15c700 2023-07-06T21:54:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.535+0000 7f7e61ffb640 1 -- 172.21.15.55:0/16758848 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f7e64004030 con 0x7f7e6c15c700 2023-07-06T21:54:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.535+0000 7f7e61ffb640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7e50066480 0x7f7e50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.535+0000 7f7e61ffb640 1 -- 172.21.15.55:0/16758848 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f7e640846b0 con 0x7f7e6c15c700 2023-07-06T21:54:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.535+0000 7f7e71674640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7e50066480 0x7f7e50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.535+0000 7f7e71674640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7e50066480 0x7f7e50068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e680b0000 tx=0x7f7e680b5040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:25.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.539+0000 7f7e61ffb640 1 -- 172.21.15.55:0/16758848 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e640515e0 con 0x7f7e6c15c700 2023-07-06T21:54:25.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.715+0000 7f7e738d8640 1 -- 172.21.15.55:0/16758848 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e6c0b3d40 con 0x7f7e50066480 2023-07-06T21:54:25.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.723+0000 7f7e61ffb640 1 -- 172.21.15.55:0/16758848 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f7e6c0b3d40 con 0x7f7e50066480 2023-07-06T21:54:25.724 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:25.724 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:47", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:25.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.727+0000 7f7e738d8640 1 -- 172.21.15.55:0/16758848 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7e50066480 msgr2=0x7f7e50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:25.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.727+0000 7f7e738d8640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7e50066480 0x7f7e50068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e680b0000 tx=0x7f7e680b5040 comp rx=0 tx=0).stop 2023-07-06T21:54:25.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.727+0000 7f7e738d8640 1 -- 172.21.15.55:0/16758848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e6c15c700 msgr2=0x7f7e6c0c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:25.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.727+0000 7f7e738d8640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e6c15c700 0x7f7e6c0c72b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7e64007dc0 tx=0x7f7e6400d4a0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.727+0000 7f7e738d8640 1 -- 172.21.15.55:0/16758848 shutdown_connections 2023-07-06T21:54:25.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.727+0000 7f7e738d8640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f7e50066480 0x7f7e50068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.727+0000 7f7e738d8640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e6c15c700 0x7f7e6c0c72b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.727+0000 7f7e738d8640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7e6c15c2b0 0x7f7e6c0b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.727+0000 7f7e738d8640 1 --2- 172.21.15.55:0/16758848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e6c0caf70 0x7f7e6c154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.727+0000 7f7e738d8640 1 -- 172.21.15.55:0/16758848 >> 172.21.15.55:0/16758848 conn(0x7f7e6c0cfb90 msgr2=0x7f7e6c155680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:25.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.727+0000 7f7e738d8640 1 -- 172.21.15.55:0/16758848 shutdown_connections 2023-07-06T21:54:25.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.727+0000 7f7e738d8640 1 -- 172.21.15.55:0/16758848 wait complete. 2023-07-06T21:54:25.745 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:47", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:25.745 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-07-06T00:00:00', 'created': '2023-07-06T21:43:47', 'first': '2023-07-06T21:44:00', 'last': '2023-07-06T21:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-06T21:54:25.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:25.746 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-07-06T21:54:25.756 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:25.757 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:25.757 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:25.757 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:25.757 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:25.757 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:25.757 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:25.758 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:25.758 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:25.758 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:25.758 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:25.759 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-06-21_44_00_UTC', 'scheduled-2023-07-06-21_45_00_UTC', 'scheduled-2023-07-06-21_46_00_UTC', 'scheduled-2023-07-06-21_47_00_UTC', 'scheduled-2023-07-06-21_48_00_UTC', 'scheduled-2023-07-06-21_49_00_UTC', 'scheduled-2023-07-06-21_50_00_UTC', 'scheduled-2023-07-06-21_51_00_UTC', 'scheduled-2023-07-06-21_52_00_UTC', 'scheduled-2023-07-06-21_53_00_UTC', 'scheduled-2023-07-06-21_54_00_UTC'] 2023-07-06T21:54:25.759 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-07-06T21:54:25.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.947+0000 7f412f0cb640 1 Processor -- start 2023-07-06T21:54:25.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.947+0000 7f412f0cb640 1 -- start start 2023-07-06T21:54:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.947+0000 7f412f0cb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f412806cb40 0x7f41280caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.947+0000 7f412f0cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f412806f960 0x7f412806fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.947+0000 7f412f0cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4128070300 con 0x7f412806a460 2023-07-06T21:54:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.947+0000 7f412f0cb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412806bac0 con 0x7f412806cb40 2023-07-06T21:54:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.947+0000 7f412f0cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4128069b00 con 0x7f412806f960 2023-07-06T21:54:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.947+0000 7f412ce67640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f412806a460 0x7f41280693f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42076/0 (socket says 172.21.15.55:42076) 2023-07-06T21:54:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.947+0000 7f412ce67640 1 -- 172.21.15.55:0/2062310784 learned_addr learned my addr 172.21.15.55:0/2062310784 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.947+0000 7f4127fff640 1 --2- 172.21.15.55:0/2062310784 >> v2:172.21.15.138:3300/0 conn(0x7f412806cb40 0x7f41280caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.947+0000 7f412d668640 1 --2- 172.21.15.55:0/2062310784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f412806f960 0x7f412806fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.947+0000 7f41277fe640 1 -- 172.21.15.55:0/2062310784 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837595896 0 0) 0x7f4128070300 con 0x7f412806a460 2023-07-06T21:54:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.947+0000 7f41277fe640 1 -- 172.21.15.55:0/2062310784 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4118003530 con 0x7f412806a460 2023-07-06T21:54:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f41277fe640 1 -- 172.21.15.55:0/2062310784 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1545187457 0 0) 0x7f4118003530 con 0x7f412806a460 2023-07-06T21:54:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f41277fe640 1 -- 172.21.15.55:0/2062310784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f412806f960 msgr2=0x7f412806fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f41277fe640 1 --2- 172.21.15.55:0/2062310784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f412806f960 0x7f412806fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f41277fe640 1 -- 172.21.15.55:0/2062310784 >> v2:172.21.15.138:3300/0 conn(0x7f412806cb40 msgr2=0x7f41280caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f41277fe640 1 --2- 172.21.15.55:0/2062310784 >> v2:172.21.15.138:3300/0 conn(0x7f412806cb40 0x7f41280caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f41277fe640 1 -- 172.21.15.55:0/2062310784 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41280cc650 con 0x7f412806a460 2023-07-06T21:54:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f41277fe640 1 -- 172.21.15.55:0/2062310784 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f411c001800 con 0x7f412806a460 2023-07-06T21:54:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f41277fe640 1 -- 172.21.15.55:0/2062310784 >> v1:172.21.15.55:6789/0 conn(0x7f412806a460 legacy=0x7f41280693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f41277fe640 1 --2- 172.21.15.55:0/2062310784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4118003980 0x7f4118003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f41277fe640 1 --2- 172.21.15.55:0/2062310784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41180043b0 0x7f4118004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f41277fe640 1 --2- 172.21.15.55:0/2062310784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f412806f960 0x7f4118004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f41277fe640 1 -- 172.21.15.55:0/2062310784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412806bac0 con 0x7f41180043b0 2023-07-06T21:54:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f41277fe640 1 -- 172.21.15.55:0/2062310784 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4128069b00 con 0x7f4118003980 2023-07-06T21:54:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f41277fe640 1 -- 172.21.15.55:0/2062310784 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411800b990 con 0x7f412806f960 2023-07-06T21:54:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f4127fff640 1 --2- 172.21.15.55:0/2062310784 >> v2:172.21.15.138:3300/0 conn(0x7f412806cb40 0x7f41280caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f4127fff640 1 --2- 172.21.15.55:0/2062310784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41180043b0 0x7f4118004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f412ce67640 1 --2- 172.21.15.55:0/2062310784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4118003980 0x7f4118003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f412d668640 1 --2- 172.21.15.55:0/2062310784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f412806f960 0x7f4118004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f4127fff640 1 -- 172.21.15.55:0/2062310784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f412806f960 msgr2=0x7f4118004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:25.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f4127fff640 1 --2- 172.21.15.55:0/2062310784 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f412806f960 0x7f4118004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f4127fff640 1 -- 172.21.15.55:0/2062310784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4118003980 msgr2=0x7f4118003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:25.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f4127fff640 1 --2- 172.21.15.55:0/2062310784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4118003980 0x7f4118003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f4127fff640 1 -- 172.21.15.55:0/2062310784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4118003530 con 0x7f41180043b0 2023-07-06T21:54:25.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.951+0000 7f4127fff640 1 --2- 172.21.15.55:0/2062310784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41180043b0 0x7f4118004870 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4114009cc0 tx=0x7f411401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d96b15eaa534277 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:25.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f41277fe640 1 -- 172.21.15.55:0/2062310784 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114004020 con 0x7f41180043b0 2023-07-06T21:54:25.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f41277fe640 1 -- 172.21.15.55:0/2062310784 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4114004180 con 0x7f41180043b0 2023-07-06T21:54:25.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f41277fe640 1 -- 172.21.15.55:0/2062310784 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140a56d0 con 0x7f41180043b0 2023-07-06T21:54:25.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412f0cb640 1 -- 172.21.15.55:0/2062310784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41180043b0 msgr2=0x7f4118004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:25.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412f0cb640 1 --2- 172.21.15.55:0/2062310784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41180043b0 0x7f4118004870 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4114009cc0 tx=0x7f411401cc30 comp rx=0 tx=0).stop 2023-07-06T21:54:25.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412d668640 1 -- 172.21.15.55:0/2062310784 reap_dead start 2023-07-06T21:54:25.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412f0cb640 1 -- 172.21.15.55:0/2062310784 shutdown_connections 2023-07-06T21:54:25.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412f0cb640 1 -- 172.21.15.55:0/2062310784 >> 172.21.15.55:0/2062310784 conn(0x7f41280ce7f0 msgr2=0x7f41280cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:25.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412f0cb640 1 -- 172.21.15.55:0/2062310784 shutdown_connections 2023-07-06T21:54:25.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412f0cb640 1 -- 172.21.15.55:0/2062310784 wait complete. 2023-07-06T21:54:25.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412f0cb640 1 Processor -- start 2023-07-06T21:54:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412f0cb640 1 -- start start 2023-07-06T21:54:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412f0cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41180043b0 0x7f41280b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412f0cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41280c58c0 0x7f41281f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412f0cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41281f84c0 0x7f41281f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412f0cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41280b30c0 con 0x7f41281f84c0 2023-07-06T21:54:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412f0cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41280c5d80 con 0x7f41180043b0 2023-07-06T21:54:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.955+0000 7f412f0cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41280c6060 con 0x7f41280c58c0 2023-07-06T21:54:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f412d668640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41281f84c0 0x7f41281f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f412d668640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41281f84c0 0x7f41281f41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51262/0 (socket says 172.21.15.55:51262) 2023-07-06T21:54:25.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f412d668640 1 -- 172.21.15.55:0/1787000753 learned_addr learned my addr 172.21.15.55:0/1787000753 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:25.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f4127fff640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41280c58c0 0x7f41281f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f412ce67640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41180043b0 0x7f41280b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f412d668640 1 -- 172.21.15.55:0/1787000753 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41280c58c0 msgr2=0x7f41281f7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:25.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f412d668640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41280c58c0 0x7f41281f7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f412d668640 1 -- 172.21.15.55:0/1787000753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41180043b0 msgr2=0x7f41280b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f412d668640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41180043b0 0x7f41280b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f412d668640 1 -- 172.21.15.55:0/1787000753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4128070170 con 0x7f41281f84c0 2023-07-06T21:54:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f412ce67640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41180043b0 0x7f41280b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f4127fff640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41280c58c0 0x7f41281f7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f412d668640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41281f84c0 0x7f41281f41d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f41280cf350 tx=0x7f4120011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f41257fa640 1 -- 172.21.15.55:0/1787000753 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412000e040 con 0x7f41281f84c0 2023-07-06T21:54:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f41257fa640 1 -- 172.21.15.55:0/1787000753 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412000f040 con 0x7f41281f84c0 2023-07-06T21:54:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f41257fa640 1 -- 172.21.15.55:0/1787000753 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120015b60 con 0x7f41281f84c0 2023-07-06T21:54:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f412f0cb640 1 -- 172.21.15.55:0/1787000753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41280c6340 con 0x7f41281f84c0 2023-07-06T21:54:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f412f0cb640 1 -- 172.21.15.55:0/1787000753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41280b3830 con 0x7f41281f84c0 2023-07-06T21:54:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f412f0cb640 1 -- 172.21.15.55:0/1787000753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4128066d60 con 0x7f41281f84c0 2023-07-06T21:54:25.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f41257fa640 1 -- 172.21.15.55:0/1787000753 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f4120015cc0 con 0x7f41281f84c0 2023-07-06T21:54:25.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.959+0000 7f41257fa640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f410c0664b0 0x7f410c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:25.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.963+0000 7f41257fa640 1 -- 172.21.15.55:0/1787000753 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f4120084480 con 0x7f41281f84c0 2023-07-06T21:54:25.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.963+0000 7f412ce67640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f410c0664b0 0x7f410c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:25.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.963+0000 7f412ce67640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f410c0664b0 0x7f410c068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f411c000f00 tx=0x7f411c009040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:25.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:25.967+0000 7f41257fa640 1 -- 172.21.15.55:0/1787000753 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4120051250 con 0x7f41281f84c0 2023-07-06T21:54:26.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.135+0000 7f412f0cb640 1 -- 172.21.15.55:0/1787000753 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f412806b6e0 con 0x7f410c0664b0 2023-07-06T21:54:26.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.147+0000 7f41257fa640 1 -- 172.21.15.55:0/1787000753 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f411c000f80 con 0x7f410c0664b0 2023-07-06T21:54:26.147 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:26.147 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:47", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.147+0000 7f412f0cb640 1 -- 172.21.15.55:0/1787000753 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f410c0664b0 msgr2=0x7f410c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.147+0000 7f412f0cb640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f410c0664b0 0x7f410c068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f411c000f00 tx=0x7f411c009040 comp rx=0 tx=0).stop 2023-07-06T21:54:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.147+0000 7f412f0cb640 1 -- 172.21.15.55:0/1787000753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41281f84c0 msgr2=0x7f41281f41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.147+0000 7f412f0cb640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41281f84c0 0x7f41281f41d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f41280cf350 tx=0x7f4120011d40 comp rx=0 tx=0).stop 2023-07-06T21:54:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.147+0000 7f412f0cb640 1 -- 172.21.15.55:0/1787000753 shutdown_connections 2023-07-06T21:54:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.147+0000 7f412f0cb640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f410c0664b0 0x7f410c068960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.147+0000 7f412f0cb640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41281f84c0 0x7f41281f41d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.147+0000 7f412f0cb640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41280c58c0 0x7f41281f7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.147+0000 7f412f0cb640 1 --2- 172.21.15.55:0/1787000753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41180043b0 0x7f41280b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.147+0000 7f412f0cb640 1 -- 172.21.15.55:0/1787000753 >> 172.21.15.55:0/1787000753 conn(0x7f41280ce7f0 msgr2=0x7f412815fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.147+0000 7f412f0cb640 1 -- 172.21.15.55:0/1787000753 shutdown_connections 2023-07-06T21:54:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.147+0000 7f412f0cb640 1 -- 172.21.15.55:0/1787000753 wait complete. 2023-07-06T21:54:26.167 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:47", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:26.168 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-07-06T00:00:00', 'created': '2023-07-06T21:43:47', 'first': '2023-07-06T21:44:00', 'last': '2023-07-06T21:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-06T21:54:26.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:26.168 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-07-06T21:54:26.178 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:26.179 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:26.179 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:26.179 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:26.179 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:26.179 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:26.179 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:26.179 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:26.180 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:26.180 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:26.180 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:26.181 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-06-21_44_00_UTC', 'scheduled-2023-07-06-21_45_00_UTC', 'scheduled-2023-07-06-21_46_00_UTC', 'scheduled-2023-07-06-21_47_00_UTC', 'scheduled-2023-07-06-21_48_00_UTC', 'scheduled-2023-07-06-21_49_00_UTC', 'scheduled-2023-07-06-21_50_00_UTC', 'scheduled-2023-07-06-21_51_00_UTC', 'scheduled-2023-07-06-21_52_00_UTC', 'scheduled-2023-07-06-21_53_00_UTC', 'scheduled-2023-07-06-21_54_00_UTC'] 2023-07-06T21:54:26.181 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-07-06T21:54:26.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d9d82640 1 Processor -- start 2023-07-06T21:54:26.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d9d82640 1 -- start start 2023-07-06T21:54:26.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d9d82640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff3d40cbfa0 0x7ff3d406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:26.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d9d82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff3d40c89b0 0x7ff3d40c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:26.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d9d82640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d4158b50 con 0x7ff3d4158780 2023-07-06T21:54:26.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d9d82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d406b390 con 0x7ff3d40c89b0 2023-07-06T21:54:26.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d9d82640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d406b630 con 0x7ff3d40cbfa0 2023-07-06T21:54:26.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff3d40c89b0 0x7ff3d40c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:26.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff3d40c89b0 0x7ff3d40c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51276/0 (socket says 172.21.15.55:51276) 2023-07-06T21:54:26.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d3fff640 1 -- 172.21.15.55:0/3803506909 learned_addr learned my addr 172.21.15.55:0/3803506909 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:26.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d2ffd640 1 --2- 172.21.15.55:0/3803506909 >> v2:172.21.15.138:3300/0 conn(0x7ff3d40cbfa0 0x7ff3d406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d3fff640 1 -- 172.21.15.55:0/3803506909 >> v2:172.21.15.138:3300/0 conn(0x7ff3d40cbfa0 msgr2=0x7ff3d406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d3fff640 1 --2- 172.21.15.55:0/3803506909 >> v2:172.21.15.138:3300/0 conn(0x7ff3d40cbfa0 0x7ff3d406f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d3fff640 1 -- 172.21.15.55:0/3803506909 >> v1:172.21.15.138:6789/0 conn(0x7ff3d4158780 legacy=0x7ff3d40cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d3fff640 1 -- 172.21.15.55:0/3803506909 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d40c9350 con 0x7ff3d40c89b0 2023-07-06T21:54:26.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.371+0000 7ff3d2ffd640 1 --2- 172.21.15.55:0/3803506909 >> v2:172.21.15.138:3300/0 conn(0x7ff3d40cbfa0 0x7ff3d406f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:54:26.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.375+0000 7ff3d3fff640 1 --2- 172.21.15.55:0/3803506909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3d40c89b0 0x7ff3d40c8e10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff3d406ae20 tx=0x7ff3cc01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2a8dd1f4e34a86 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:26.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.375+0000 7ff3d27fc640 1 -- 172.21.15.55:0/3803506909 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0a56b0 con 0x7ff3d40c89b0 2023-07-06T21:54:26.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.375+0000 7ff3d27fc640 1 -- 172.21.15.55:0/3803506909 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc0a5810 con 0x7ff3d40c89b0 2023-07-06T21:54:26.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.375+0000 7ff3d27fc640 1 -- 172.21.15.55:0/3803506909 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0a5ba0 con 0x7ff3d40c89b0 2023-07-06T21:54:26.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.375+0000 7ff3d9d82640 1 -- 172.21.15.55:0/3803506909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3d40c89b0 msgr2=0x7ff3d40c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:26.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.375+0000 7ff3d9d82640 1 --2- 172.21.15.55:0/3803506909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3d40c89b0 0x7ff3d40c8e10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff3d406ae20 tx=0x7ff3cc01c900 comp rx=0 tx=0).stop 2023-07-06T21:54:26.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.375+0000 7ff3d9d82640 1 -- 172.21.15.55:0/3803506909 shutdown_connections 2023-07-06T21:54:26.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.375+0000 7ff3d9d82640 1 --2- 172.21.15.55:0/3803506909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3d40c89b0 0x7ff3d40c8e10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.375+0000 7ff3d9d82640 1 --2- 172.21.15.55:0/3803506909 >> v2:172.21.15.138:3300/0 conn(0x7ff3d40cbfa0 0x7ff3d406f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.375+0000 7ff3d9d82640 1 -- 172.21.15.55:0/3803506909 >> 172.21.15.55:0/3803506909 conn(0x7ff3d40cde30 msgr2=0x7ff3d40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:26.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.375+0000 7ff3d9d82640 1 -- 172.21.15.55:0/3803506909 shutdown_connections 2023-07-06T21:54:26.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.375+0000 7ff3d9d82640 1 -- 172.21.15.55:0/3803506909 wait complete. 2023-07-06T21:54:26.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d9d82640 1 Processor -- start 2023-07-06T21:54:26.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d9d82640 1 -- start start 2023-07-06T21:54:26.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d9d82640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3d40c89b0 0x7ff3d414f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:26.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d9d82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3d40cbfa0 0x7ff3d415b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:26.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d9d82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3d4158780 0x7ff3d40b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:26.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d9d82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d414f900 con 0x7ff3d40cbfa0 2023-07-06T21:54:26.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d9d82640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d414a2f0 con 0x7ff3d40c89b0 2023-07-06T21:54:26.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d9d82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d415afc0 con 0x7ff3d4158780 2023-07-06T21:54:26.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3d40cbfa0 0x7ff3d415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:26.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3d40cbfa0 0x7ff3d415b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51288/0 (socket says 172.21.15.55:51288) 2023-07-06T21:54:26.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d2ffd640 1 -- 172.21.15.55:0/2695005998 learned_addr learned my addr 172.21.15.55:0/2695005998 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:26.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d37fe640 1 --2- 172.21.15.55:0/2695005998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3d40c89b0 0x7ff3d414f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:26.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d3fff640 1 --2- 172.21.15.55:0/2695005998 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3d4158780 0x7ff3d40b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:26.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d2ffd640 1 -- 172.21.15.55:0/2695005998 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3d4158780 msgr2=0x7ff3d40b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:26.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d2ffd640 1 --2- 172.21.15.55:0/2695005998 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3d4158780 0x7ff3d40b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d2ffd640 1 -- 172.21.15.55:0/2695005998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3d40c89b0 msgr2=0x7ff3d414f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:26.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d2ffd640 1 --2- 172.21.15.55:0/2695005998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3d40c89b0 0x7ff3d414f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d2ffd640 1 -- 172.21.15.55:0/2695005998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc009b30 con 0x7ff3d40cbfa0 2023-07-06T21:54:26.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d2ffd640 1 --2- 172.21.15.55:0/2695005998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3d40cbfa0 0x7ff3d415b450 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800c7c0 tx=0x7ff3c800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:26.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3bbfff640 1 -- 172.21.15.55:0/2695005998 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8007a30 con 0x7ff3d40cbfa0 2023-07-06T21:54:26.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3bbfff640 1 -- 172.21.15.55:0/2695005998 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c8007b90 con 0x7ff3d40cbfa0 2023-07-06T21:54:26.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3bbfff640 1 -- 172.21.15.55:0/2695005998 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800ce70 con 0x7ff3d40cbfa0 2023-07-06T21:54:26.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d9d82640 1 -- 172.21.15.55:0/2695005998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d415a3b0 con 0x7ff3d40cbfa0 2023-07-06T21:54:26.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.379+0000 7ff3d9d82640 1 -- 172.21.15.55:0/2695005998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d415a970 con 0x7ff3d40cbfa0 2023-07-06T21:54:26.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.383+0000 7ff3d9d82640 1 -- 172.21.15.55:0/2695005998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d4066d60 con 0x7ff3d40cbfa0 2023-07-06T21:54:26.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.383+0000 7ff3bbfff640 1 -- 172.21.15.55:0/2695005998 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7ff3c80113f0 con 0x7ff3d40cbfa0 2023-07-06T21:54:26.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.383+0000 7ff3bbfff640 1 --2- 172.21.15.55:0/2695005998 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff3c0066480 0x7ff3c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:26.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.383+0000 7ff3bbfff640 1 -- 172.21.15.55:0/2695005998 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7ff3c80848c0 con 0x7ff3d40cbfa0 2023-07-06T21:54:26.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.383+0000 7ff3d37fe640 1 --2- 172.21.15.55:0/2695005998 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff3c0066480 0x7ff3c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:26.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.383+0000 7ff3d37fe640 1 --2- 172.21.15.55:0/2695005998 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff3c0066480 0x7ff3c0068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40098e0 tx=0x7ff3c4009060 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:26.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.387+0000 7ff3bbfff640 1 -- 172.21.15.55:0/2695005998 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3c80517d0 con 0x7ff3d40cbfa0 2023-07-06T21:54:26.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.563+0000 7ff3d9d82640 1 -- 172.21.15.55:0/2695005998 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3d40cd6a0 con 0x7ff3c0066480 2023-07-06T21:54:26.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.571+0000 7ff3bbfff640 1 -- 172.21.15.55:0/2695005998 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7ff3c4009530 con 0x7ff3c0066480 2023-07-06T21:54:26.571 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:26.572 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:48", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:26.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.575+0000 7ff3d9d82640 1 -- 172.21.15.55:0/2695005998 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff3c0066480 msgr2=0x7ff3c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:26.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.575+0000 7ff3d9d82640 1 --2- 172.21.15.55:0/2695005998 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff3c0066480 0x7ff3c0068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40098e0 tx=0x7ff3c4009060 comp rx=0 tx=0).stop 2023-07-06T21:54:26.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.575+0000 7ff3d9d82640 1 -- 172.21.15.55:0/2695005998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3d40cbfa0 msgr2=0x7ff3d415b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:26.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.575+0000 7ff3d9d82640 1 --2- 172.21.15.55:0/2695005998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3d40cbfa0 0x7ff3d415b450 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800c7c0 tx=0x7ff3c800cc80 comp rx=0 tx=0).stop 2023-07-06T21:54:26.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.575+0000 7ff3d9d82640 1 -- 172.21.15.55:0/2695005998 shutdown_connections 2023-07-06T21:54:26.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.575+0000 7ff3d9d82640 1 --2- 172.21.15.55:0/2695005998 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff3c0066480 0x7ff3c0068930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.575+0000 7ff3d9d82640 1 --2- 172.21.15.55:0/2695005998 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3d4158780 0x7ff3d40b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.575+0000 7ff3d9d82640 1 --2- 172.21.15.55:0/2695005998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3d40cbfa0 0x7ff3d415b450 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.575+0000 7ff3d9d82640 1 --2- 172.21.15.55:0/2695005998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3d40c89b0 0x7ff3d414f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.575+0000 7ff3d9d82640 1 -- 172.21.15.55:0/2695005998 >> 172.21.15.55:0/2695005998 conn(0x7ff3d40cde30 msgr2=0x7ff3d4070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:26.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.575+0000 7ff3d9d82640 1 -- 172.21.15.55:0/2695005998 shutdown_connections 2023-07-06T21:54:26.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.575+0000 7ff3d9d82640 1 -- 172.21.15.55:0/2695005998 wait complete. 2023-07-06T21:54:26.593 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:48", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:26.593 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-07-06T00:00:00', 'created': '2023-07-06T21:43:48', 'first': '2023-07-06T21:44:00', 'last': '2023-07-06T21:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-06T21:54:26.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:26.594 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-07-06T21:54:26.603 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:26.604 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:26.604 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:26.604 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:26.604 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:26.604 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:26.604 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:26.605 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:26.605 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:26.605 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:26.605 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:26.606 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-06-21_44_00_UTC', 'scheduled-2023-07-06-21_45_00_UTC', 'scheduled-2023-07-06-21_46_00_UTC', 'scheduled-2023-07-06-21_47_00_UTC', 'scheduled-2023-07-06-21_48_00_UTC', 'scheduled-2023-07-06-21_49_00_UTC', 'scheduled-2023-07-06-21_50_00_UTC', 'scheduled-2023-07-06-21_51_00_UTC', 'scheduled-2023-07-06-21_52_00_UTC', 'scheduled-2023-07-06-21_53_00_UTC', 'scheduled-2023-07-06-21_54_00_UTC'] 2023-07-06T21:54:26.606 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-07-06T21:54:26.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70d6537640 1 Processor -- start 2023-07-06T21:54:26.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70d6537640 1 -- start start 2023-07-06T21:54:26.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70d6537640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f70d00c9500 0x7f70d00ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:26.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70d6537640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d0152fc0 con 0x7f70d00ce710 2023-07-06T21:54:26.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70d6537640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d015c410 con 0x7f70d0070020 2023-07-06T21:54:26.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70d6537640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d015c6f0 con 0x7f70d00c9500 2023-07-06T21:54:26.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70d4ad4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f70d00ce710 0x7f70d015f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42080/0 (socket says 172.21.15.55:42080) 2023-07-06T21:54:26.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70d4ad4640 1 -- 172.21.15.55:0/4153901232 learned_addr learned my addr 172.21.15.55:0/4153901232 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:26.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70cf7fe640 1 --2- 172.21.15.55:0/4153901232 >> v2:172.21.15.138:3300/0 conn(0x7f70d00c9500 0x7f70d00ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:26.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 -- 172.21.15.55:0/4153901232 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455159935 0 0) 0x7f70d0152fc0 con 0x7f70d00ce710 2023-07-06T21:54:26.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 -- 172.21.15.55:0/4153901232 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b8003530 con 0x7f70d00ce710 2023-07-06T21:54:26.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 -- 172.21.15.55:0/4153901232 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 883239843 0 0) 0x7f70b8003530 con 0x7f70d00ce710 2023-07-06T21:54:26.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 -- 172.21.15.55:0/4153901232 >> v2:172.21.15.138:3300/0 conn(0x7f70d00c9500 msgr2=0x7f70d00ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:26.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 --2- 172.21.15.55:0/4153901232 >> v2:172.21.15.138:3300/0 conn(0x7f70d00c9500 0x7f70d00ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 -- 172.21.15.55:0/4153901232 >> v1:172.21.15.138:6789/0 conn(0x7f70d0070020 legacy=0x7f70d00703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:26.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 -- 172.21.15.55:0/4153901232 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d015c9d0 con 0x7f70d00ce710 2023-07-06T21:54:26.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 -- 172.21.15.55:0/4153901232 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f70c8001a00 con 0x7f70d00ce710 2023-07-06T21:54:26.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 -- 172.21.15.55:0/4153901232 >> v1:172.21.15.55:6789/0 conn(0x7f70d00ce710 legacy=0x7f70d015f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:26.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 --2- 172.21.15.55:0/4153901232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b8003980 0x7f70b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:26.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 --2- 172.21.15.55:0/4153901232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70b80047d0 0x7f70b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:26.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 --2- 172.21.15.55:0/4153901232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70b8005180 0x7f70b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:26.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 -- 172.21.15.55:0/4153901232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d015c6f0 con 0x7f70b80047d0 2023-07-06T21:54:26.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 -- 172.21.15.55:0/4153901232 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b800c000 con 0x7f70b8003980 2023-07-06T21:54:26.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70ceffd640 1 -- 172.21.15.55:0/4153901232 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b800c1c0 con 0x7f70b8005180 2023-07-06T21:54:26.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.795+0000 7f70cf7fe640 1 --2- 172.21.15.55:0/4153901232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70b80047d0 0x7f70b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:26.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70cffff640 1 --2- 172.21.15.55:0/4153901232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b8003980 0x7f70b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:26.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70d4ad4640 1 --2- 172.21.15.55:0/4153901232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70b8005180 0x7f70b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:26.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70cf7fe640 1 -- 172.21.15.55:0/4153901232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70b8005180 msgr2=0x7f70b800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:26.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70cf7fe640 1 --2- 172.21.15.55:0/4153901232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70b8005180 0x7f70b800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70cf7fe640 1 -- 172.21.15.55:0/4153901232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b8003980 msgr2=0x7f70b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:26.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70cf7fe640 1 --2- 172.21.15.55:0/4153901232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b8003980 0x7f70b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70cf7fe640 1 -- 172.21.15.55:0/4153901232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b8003530 con 0x7f70b80047d0 2023-07-06T21:54:26.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70cffff640 1 --2- 172.21.15.55:0/4153901232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b8003980 0x7f70b8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:26.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70d4ad4640 1 --2- 172.21.15.55:0/4153901232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70b8005180 0x7f70b800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:26.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70d4ad4640 1 -- 172.21.15.55:0/4153901232 reap_dead start 2023-07-06T21:54:26.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70cf7fe640 1 --2- 172.21.15.55:0/4153901232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70b80047d0 0x7f70b8004c40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009ae0 tx=0x7f70c401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8570f1635e55839 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:26.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70ceffd640 1 -- 172.21.15.55:0/4153901232 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c40a5560 con 0x7f70b80047d0 2023-07-06T21:54:26.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70ceffd640 1 -- 172.21.15.55:0/4153901232 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c40a56c0 con 0x7f70b80047d0 2023-07-06T21:54:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70ceffd640 1 -- 172.21.15.55:0/4153901232 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c40a5a70 con 0x7f70b80047d0 2023-07-06T21:54:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70d6537640 1 -- 172.21.15.55:0/4153901232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70b80047d0 msgr2=0x7f70b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70d6537640 1 --2- 172.21.15.55:0/4153901232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70b80047d0 0x7f70b8004c40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009ae0 tx=0x7f70c401ca50 comp rx=0 tx=0).stop 2023-07-06T21:54:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70d6537640 1 -- 172.21.15.55:0/4153901232 shutdown_connections 2023-07-06T21:54:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70d6537640 1 --2- 172.21.15.55:0/4153901232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70b80047d0 0x7f70b8004c40 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.799+0000 7f70d6537640 1 -- 172.21.15.55:0/4153901232 >> 172.21.15.55:0/4153901232 conn(0x7f70d00cfb90 msgr2=0x7f70d00cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:26.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70d6537640 1 -- 172.21.15.55:0/4153901232 shutdown_connections 2023-07-06T21:54:26.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70d6537640 1 -- 172.21.15.55:0/4153901232 wait complete. 2023-07-06T21:54:26.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70d6537640 1 Processor -- start 2023-07-06T21:54:26.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70d6537640 1 -- start start 2023-07-06T21:54:26.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70d6537640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70b80047d0 0x7f70d00c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70d6537640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70d015eb30 0x7f70d014f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70d6537640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70d00afbe0 0x7f70d00b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70d6537640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d014fdf0 con 0x7f70b80047d0 2023-07-06T21:54:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70d6537640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00b0590 con 0x7f70d00afbe0 2023-07-06T21:54:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70d6537640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00c53b0 con 0x7f70d015eb30 2023-07-06T21:54:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70cffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70b80047d0 0x7f70d00c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:26.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70cffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70b80047d0 0x7f70d00c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51312/0 (socket says 172.21.15.55:51312) 2023-07-06T21:54:26.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70cffff640 1 -- 172.21.15.55:0/3087277546 learned_addr learned my addr 172.21.15.55:0/3087277546 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:26.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70cf7fe640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70d015eb30 0x7f70d014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:26.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70d4ad4640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70d00afbe0 0x7f70d00b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:26.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70cffff640 1 -- 172.21.15.55:0/3087277546 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70d015eb30 msgr2=0x7f70d014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:26.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70cffff640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70d015eb30 0x7f70d014f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70cffff640 1 -- 172.21.15.55:0/3087277546 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70d00afbe0 msgr2=0x7f70d00b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:26.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70cffff640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70d00afbe0 0x7f70d00b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70cffff640 1 -- 172.21.15.55:0/3087277546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d015efa0 con 0x7f70b80047d0 2023-07-06T21:54:26.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70cf7fe640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70d015eb30 0x7f70d014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:26.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.803+0000 7f70cffff640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70b80047d0 0x7f70d00c4150 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f70c0001f10 tx=0x7f70c000e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:26.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.807+0000 7f70ccff9640 1 -- 172.21.15.55:0/3087277546 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c00052e0 con 0x7f70b80047d0 2023-07-06T21:54:26.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.807+0000 7f70ccff9640 1 -- 172.21.15.55:0/3087277546 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0005440 con 0x7f70b80047d0 2023-07-06T21:54:26.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.807+0000 7f70d6537640 1 -- 172.21.15.55:0/3087277546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d00c47a0 con 0x7f70b80047d0 2023-07-06T21:54:26.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.807+0000 7f70ccff9640 1 -- 172.21.15.55:0/3087277546 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0003890 con 0x7f70b80047d0 2023-07-06T21:54:26.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.807+0000 7f70d6537640 1 -- 172.21.15.55:0/3087277546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d00c4d60 con 0x7f70b80047d0 2023-07-06T21:54:26.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.807+0000 7f70d6537640 1 -- 172.21.15.55:0/3087277546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d00b2c80 con 0x7f70b80047d0 2023-07-06T21:54:26.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.807+0000 7f70ccff9640 1 -- 172.21.15.55:0/3087277546 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f70c00039f0 con 0x7f70b80047d0 2023-07-06T21:54:26.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.807+0000 7f70ccff9640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f70bc0664b0 0x7f70bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:26.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.807+0000 7f70ccff9640 1 -- 172.21.15.55:0/3087277546 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f70c00840b0 con 0x7f70b80047d0 2023-07-06T21:54:26.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.807+0000 7f70cf7fe640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f70bc0664b0 0x7f70bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:26.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.811+0000 7f70cf7fe640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f70bc0664b0 0x7f70bc068960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f70c40af000 tx=0x7f70c4008040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:26.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.811+0000 7f70ccff9640 1 -- 172.21.15.55:0/3087277546 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f70c0050f90 con 0x7f70b80047d0 2023-07-06T21:54:26.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.987+0000 7f70d6537640 1 -- 172.21.15.55:0/3087277546 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70d00ceb10 con 0x7f70bc0664b0 2023-07-06T21:54:26.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.995+0000 7f70ccff9640 1 -- 172.21.15.55:0/3087277546 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f70c40a5830 con 0x7f70bc0664b0 2023-07-06T21:54:26.996 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:26.996 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:48", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:26.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.999+0000 7f70d6537640 1 -- 172.21.15.55:0/3087277546 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f70bc0664b0 msgr2=0x7f70bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:26.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.999+0000 7f70d6537640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f70bc0664b0 0x7f70bc068960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f70c40af000 tx=0x7f70c4008040 comp rx=0 tx=0).stop 2023-07-06T21:54:26.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.999+0000 7f70d6537640 1 -- 172.21.15.55:0/3087277546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70b80047d0 msgr2=0x7f70d00c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:26.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.999+0000 7f70d6537640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70b80047d0 0x7f70d00c4150 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f70c0001f10 tx=0x7f70c000e9e0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.999+0000 7f70d6537640 1 -- 172.21.15.55:0/3087277546 shutdown_connections 2023-07-06T21:54:26.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.999+0000 7f70d6537640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f70bc0664b0 0x7f70bc068960 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.999+0000 7f70d6537640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70d00afbe0 0x7f70d00b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.999+0000 7f70d6537640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70d015eb30 0x7f70d014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.999+0000 7f70d6537640 1 --2- 172.21.15.55:0/3087277546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70b80047d0 0x7f70d00c4150 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:26.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.999+0000 7f70d6537640 1 -- 172.21.15.55:0/3087277546 >> 172.21.15.55:0/3087277546 conn(0x7f70d00cfb90 msgr2=0x7f70d00aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:26.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.999+0000 7f70d6537640 1 -- 172.21.15.55:0/3087277546 shutdown_connections 2023-07-06T21:54:26.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:26.999+0000 7f70d6537640 1 -- 172.21.15.55:0/3087277546 wait complete. 2023-07-06T21:54:27.017 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:48", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:27.017 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-07-06T00:00:00', 'created': '2023-07-06T21:43:48', 'first': '2023-07-06T21:44:00', 'last': '2023-07-06T21:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-06T21:54:27.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:27.018 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-07-06T21:54:27.028 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:27.028 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:27.029 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:27.029 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:27.029 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:27.029 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:27.029 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:27.029 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:27.029 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:27.030 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:27.030 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:27.030 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-06-21_44_00_UTC', 'scheduled-2023-07-06-21_45_00_UTC', 'scheduled-2023-07-06-21_46_00_UTC', 'scheduled-2023-07-06-21_47_00_UTC', 'scheduled-2023-07-06-21_48_00_UTC', 'scheduled-2023-07-06-21_49_00_UTC', 'scheduled-2023-07-06-21_50_00_UTC', 'scheduled-2023-07-06-21_51_00_UTC', 'scheduled-2023-07-06-21_52_00_UTC', 'scheduled-2023-07-06-21_53_00_UTC', 'scheduled-2023-07-06-21_54_00_UTC'] 2023-07-06T21:54:27.031 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-07-06T21:54:27.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f68293640 1 Processor -- start 2023-07-06T21:54:27.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f68293640 1 -- start start 2023-07-06T21:54:27.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f68293640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3f600c9500 0x7f3f600ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:27.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f68293640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f600ce710 0x7f3f6015f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:27.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f68293640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f60152fc0 con 0x7f3f60070020 2023-07-06T21:54:27.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f68293640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6015c410 con 0x7f3f600c9500 2023-07-06T21:54:27.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f68293640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6015c6f0 con 0x7f3f600ce710 2023-07-06T21:54:27.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f6582e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3f600c9500 0x7f3f600ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:27.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f66830640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f600ce710 0x7f3f6015f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:27.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f6602f640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f3f60070020 0x7f3f600703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:42680/0 (socket says 172.21.15.55:42680) 2023-07-06T21:54:27.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f6602f640 1 -- 172.21.15.55:0/3224009608 learned_addr learned my addr 172.21.15.55:0/3224009608 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:27.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f6502d640 1 -- 172.21.15.55:0/3224009608 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345629422 0 0) 0x7f3f60152fc0 con 0x7f3f60070020 2023-07-06T21:54:27.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f6502d640 1 -- 172.21.15.55:0/3224009608 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f4c003530 con 0x7f3f60070020 2023-07-06T21:54:27.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f6582e640 1 -- 172.21.15.55:0/3224009608 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f600ce710 msgr2=0x7f3f6015f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:27.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f6582e640 1 --2- 172.21.15.55:0/3224009608 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f600ce710 0x7f3f6015f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f6582e640 1 -- 172.21.15.55:0/3224009608 >> v1:172.21.15.138:6789/0 conn(0x7f3f60070020 legacy=0x7f3f600703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:27.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f6582e640 1 -- 172.21.15.55:0/3224009608 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6015c9d0 con 0x7f3f600c9500 2023-07-06T21:54:27.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.219+0000 7f3f66830640 1 --2- 172.21.15.55:0/3224009608 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f600ce710 0x7f3f6015f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:27.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.223+0000 7f3f6582e640 1 --2- 172.21.15.55:0/3224009608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f600c9500 0x7f3f600ce1d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3f500097c0 tx=0x7f3f5001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9bf0a9cd3a9e20b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:27.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.223+0000 7f3f6502d640 1 -- 172.21.15.55:0/3224009608 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f500ab600 con 0x7f3f600c9500 2023-07-06T21:54:27.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.223+0000 7f3f6502d640 1 -- 172.21.15.55:0/3224009608 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f500a7050 con 0x7f3f600c9500 2023-07-06T21:54:27.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.223+0000 7f3f6502d640 1 -- 172.21.15.55:0/3224009608 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f500ab960 con 0x7f3f600c9500 2023-07-06T21:54:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.223+0000 7f3f68293640 1 -- 172.21.15.55:0/3224009608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f600c9500 msgr2=0x7f3f600ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.223+0000 7f3f68293640 1 --2- 172.21.15.55:0/3224009608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f600c9500 0x7f3f600ce1d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3f500097c0 tx=0x7f3f5001c480 comp rx=0 tx=0).stop 2023-07-06T21:54:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.223+0000 7f3f68293640 1 -- 172.21.15.55:0/3224009608 shutdown_connections 2023-07-06T21:54:27.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.223+0000 7f3f68293640 1 --2- 172.21.15.55:0/3224009608 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f600ce710 0x7f3f6015f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.223+0000 7f3f68293640 1 --2- 172.21.15.55:0/3224009608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f600c9500 0x7f3f600ce1d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.223+0000 7f3f68293640 1 -- 172.21.15.55:0/3224009608 >> 172.21.15.55:0/3224009608 conn(0x7f3f600cfb90 msgr2=0x7f3f600cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:27.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.223+0000 7f3f68293640 1 -- 172.21.15.55:0/3224009608 shutdown_connections 2023-07-06T21:54:27.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.223+0000 7f3f68293640 1 -- 172.21.15.55:0/3224009608 wait complete. 2023-07-06T21:54:27.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f68293640 1 Processor -- start 2023-07-06T21:54:27.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f68293640 1 -- start start 2023-07-06T21:54:27.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f68293640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f60070020 0x7f3f6014bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:27.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f68293640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f600c9500 0x7f3f600c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:27.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f68293640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f600ce710 0x7f3f6014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:27.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f68293640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6014e830 con 0x7f3f600c9500 2023-07-06T21:54:27.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f68293640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6014f690 con 0x7f3f600ce710 2023-07-06T21:54:27.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f68293640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6014ea80 con 0x7f3f60070020 2023-07-06T21:54:27.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f6582e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f600c9500 0x7f3f600c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:27.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f6582e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f600c9500 0x7f3f600c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51316/0 (socket says 172.21.15.55:51316) 2023-07-06T21:54:27.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f6582e640 1 -- 172.21.15.55:0/646530517 learned_addr learned my addr 172.21.15.55:0/646530517 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f66830640 1 --2- 172.21.15.55:0/646530517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f600ce710 0x7f3f6014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f6602f640 1 --2- 172.21.15.55:0/646530517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f60070020 0x7f3f6014bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f6582e640 1 -- 172.21.15.55:0/646530517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f60070020 msgr2=0x7f3f6014bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f6582e640 1 --2- 172.21.15.55:0/646530517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f60070020 0x7f3f6014bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f6582e640 1 -- 172.21.15.55:0/646530517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f600ce710 msgr2=0x7f3f6014fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f6582e640 1 --2- 172.21.15.55:0/646530517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f600ce710 0x7f3f6014fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f6582e640 1 -- 172.21.15.55:0/646530517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f58009a70 con 0x7f3f600c9500 2023-07-06T21:54:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f6582e640 1 --2- 172.21.15.55:0/646530517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f600c9500 0x7f3f600c9b70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3f5001c960 tx=0x7f3f50019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f56ffd640 1 -- 172.21.15.55:0/646530517 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50006e20 con 0x7f3f600c9500 2023-07-06T21:54:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f56ffd640 1 -- 172.21.15.55:0/646530517 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f50004030 con 0x7f3f600c9500 2023-07-06T21:54:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f68293640 1 -- 172.21.15.55:0/646530517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f50009420 con 0x7f3f600c9500 2023-07-06T21:54:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f56ffd640 1 -- 172.21.15.55:0/646530517 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f500043a0 con 0x7f3f600c9500 2023-07-06T21:54:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.227+0000 7f3f68293640 1 -- 172.21.15.55:0/646530517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6014f040 con 0x7f3f600c9500 2023-07-06T21:54:27.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.231+0000 7f3f68293640 1 -- 172.21.15.55:0/646530517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f60066d60 con 0x7f3f600c9500 2023-07-06T21:54:27.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.231+0000 7f3f56ffd640 1 -- 172.21.15.55:0/646530517 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f3f500b2040 con 0x7f3f600c9500 2023-07-06T21:54:27.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.231+0000 7f3f56ffd640 1 --2- 172.21.15.55:0/646530517 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3f440664b0 0x7f3f44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.231+0000 7f3f56ffd640 1 -- 172.21.15.55:0/646530517 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f3f5011d800 con 0x7f3f600c9500 2023-07-06T21:54:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.231+0000 7f3f6602f640 1 --2- 172.21.15.55:0/646530517 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3f440664b0 0x7f3f44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.235+0000 7f3f6602f640 1 --2- 172.21.15.55:0/646530517 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3f440664b0 0x7f3f44068960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0058e0 tx=0x7f3f5c009040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:27.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.235+0000 7f3f56ffd640 1 -- 172.21.15.55:0/646530517 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f500ea680 con 0x7f3f600c9500 2023-07-06T21:54:27.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.411+0000 7f3f68293640 1 -- 172.21.15.55:0/646530517 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f6014f7d0 con 0x7f3f440664b0 2023-07-06T21:54:27.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.419+0000 7f3f56ffd640 1 -- 172.21.15.55:0/646530517 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f3f6014f7d0 con 0x7f3f440664b0 2023-07-06T21:54:27.419 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:27.419 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:49", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:27.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.419+0000 7f3f68293640 1 -- 172.21.15.55:0/646530517 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3f440664b0 msgr2=0x7f3f44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:27.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.419+0000 7f3f68293640 1 --2- 172.21.15.55:0/646530517 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3f440664b0 0x7f3f44068960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0058e0 tx=0x7f3f5c009040 comp rx=0 tx=0).stop 2023-07-06T21:54:27.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.419+0000 7f3f68293640 1 -- 172.21.15.55:0/646530517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f600c9500 msgr2=0x7f3f600c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:27.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.419+0000 7f3f68293640 1 --2- 172.21.15.55:0/646530517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f600c9500 0x7f3f600c9b70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3f5001c960 tx=0x7f3f50019220 comp rx=0 tx=0).stop 2023-07-06T21:54:27.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.419+0000 7f3f68293640 1 -- 172.21.15.55:0/646530517 shutdown_connections 2023-07-06T21:54:27.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.419+0000 7f3f68293640 1 --2- 172.21.15.55:0/646530517 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3f440664b0 0x7f3f44068960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.419+0000 7f3f68293640 1 --2- 172.21.15.55:0/646530517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f600ce710 0x7f3f6014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.419+0000 7f3f68293640 1 --2- 172.21.15.55:0/646530517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f600c9500 0x7f3f600c9b70 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.419+0000 7f3f68293640 1 --2- 172.21.15.55:0/646530517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f60070020 0x7f3f6014bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.419+0000 7f3f68293640 1 -- 172.21.15.55:0/646530517 >> 172.21.15.55:0/646530517 conn(0x7f3f600cfb90 msgr2=0x7f3f600703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:27.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.419+0000 7f3f68293640 1 -- 172.21.15.55:0/646530517 shutdown_connections 2023-07-06T21:54:27.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.419+0000 7f3f68293640 1 -- 172.21.15.55:0/646530517 wait complete. 2023-07-06T21:54:27.440 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:49", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:27.441 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-07-06T00:00:00', 'created': '2023-07-06T21:43:49', 'first': '2023-07-06T21:44:00', 'last': '2023-07-06T21:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-06T21:54:27.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:27.442 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-07-06T21:54:27.452 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:27.453 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:27.453 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:27.453 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:27.453 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:27.453 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:27.454 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:27.454 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:27.454 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:27.454 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:27.454 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:27.455 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-06-21_44_00_UTC', 'scheduled-2023-07-06-21_45_00_UTC', 'scheduled-2023-07-06-21_46_00_UTC', 'scheduled-2023-07-06-21_47_00_UTC', 'scheduled-2023-07-06-21_48_00_UTC', 'scheduled-2023-07-06-21_49_00_UTC', 'scheduled-2023-07-06-21_50_00_UTC', 'scheduled-2023-07-06-21_51_00_UTC', 'scheduled-2023-07-06-21_52_00_UTC', 'scheduled-2023-07-06-21_53_00_UTC', 'scheduled-2023-07-06-21_54_00_UTC'] 2023-07-06T21:54:27.455 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-07-06T21:54:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.643+0000 7fcb8b59e640 1 Processor -- start 2023-07-06T21:54:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.643+0000 7fcb8b59e640 1 -- start start 2023-07-06T21:54:27.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.643+0000 7fcb8b59e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcb8c06eef0 0x7fcb8c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:27.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.643+0000 7fcb8b59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb8c0700e0 0x7fcb8c06f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:27.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.643+0000 7fcb8b59e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8c0cdb50 con 0x7fcb8c06c9f0 2023-07-06T21:54:27.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.643+0000 7fcb8b59e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c071240 con 0x7fcb8c0700e0 2023-07-06T21:54:27.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.643+0000 7fcb8b59e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c06fcc0 con 0x7fcb8c06eef0 2023-07-06T21:54:27.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.647+0000 7fcb83fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb8c0700e0 0x7fcb8c06f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:27.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.647+0000 7fcb8ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcb8c06c9f0 0x7fcb8c0c83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42084/0 (socket says 172.21.15.55:42084) 2023-07-06T21:54:27.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.647+0000 7fcb8ad9d640 1 -- 172.21.15.55:0/2147409096 learned_addr learned my addr 172.21.15.55:0/2147409096 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.647+0000 7fcb8a59c640 1 --2- 172.21.15.55:0/2147409096 >> v2:172.21.15.138:3300/0 conn(0x7fcb8c06eef0 0x7fcb8c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.647+0000 7fcb83fff640 1 -- 172.21.15.55:0/2147409096 >> v2:172.21.15.138:3300/0 conn(0x7fcb8c06eef0 msgr2=0x7fcb8c0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.647+0000 7fcb83fff640 1 --2- 172.21.15.55:0/2147409096 >> v2:172.21.15.138:3300/0 conn(0x7fcb8c06eef0 0x7fcb8c0cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.647+0000 7fcb83fff640 1 -- 172.21.15.55:0/2147409096 >> v1:172.21.15.55:6789/0 conn(0x7fcb8c06c9f0 legacy=0x7fcb8c0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.647+0000 7fcb83fff640 1 -- 172.21.15.55:0/2147409096 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c070880 con 0x7fcb8c0700e0 2023-07-06T21:54:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.647+0000 7fcb89d9b640 1 -- 172.21.15.55:0/2147409096 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421499438 0 0) 0x7fcb840014a0 con 0x7fcb8c06c9f0 2023-07-06T21:54:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.647+0000 7fcb83fff640 1 --2- 172.21.15.55:0/2147409096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb8c0700e0 0x7fcb8c06f2c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0ca2c0 tx=0x7fcb7401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea62363502248ce0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.647+0000 7fcb89d9b640 1 -- 172.21.15.55:0/2147409096 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740a7070 con 0x7fcb8c0700e0 2023-07-06T21:54:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.647+0000 7fcb89d9b640 1 -- 172.21.15.55:0/2147409096 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb740ab430 con 0x7fcb8c0700e0 2023-07-06T21:54:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.647+0000 7fcb89d9b640 1 -- 172.21.15.55:0/2147409096 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740ab7c0 con 0x7fcb8c0700e0 2023-07-06T21:54:27.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2147409096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb8c0700e0 msgr2=0x7fcb8c06f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:27.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 --2- 172.21.15.55:0/2147409096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb8c0700e0 0x7fcb8c06f2c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0ca2c0 tx=0x7fcb7401c430 comp rx=0 tx=0).stop 2023-07-06T21:54:27.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2147409096 shutdown_connections 2023-07-06T21:54:27.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 --2- 172.21.15.55:0/2147409096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb8c0700e0 0x7fcb8c06f2c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 --2- 172.21.15.55:0/2147409096 >> v2:172.21.15.138:3300/0 conn(0x7fcb8c06eef0 0x7fcb8c0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2147409096 >> 172.21.15.55:0/2147409096 conn(0x7fcb8c0cdd90 msgr2=0x7fcb8c0ce190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:27.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2147409096 shutdown_connections 2023-07-06T21:54:27.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2147409096 wait complete. 2023-07-06T21:54:27.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 Processor -- start 2023-07-06T21:54:27.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 -- start start 2023-07-06T21:54:27.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb8c06c9f0 0x7fcb8c14d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:27.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb8c06eef0 0x7fcb8c14dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:27.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb8c0700e0 0x7fcb8c1527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:27.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c14e500 con 0x7fcb8c06c9f0 2023-07-06T21:54:27.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c154070 con 0x7fcb8c0700e0 2023-07-06T21:54:27.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8b59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c154b60 con 0x7fcb8c06eef0 2023-07-06T21:54:27.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb8c06c9f0 0x7fcb8c14d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:27.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb8c06c9f0 0x7fcb8c14d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51332/0 (socket says 172.21.15.55:51332) 2023-07-06T21:54:27.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8a59c640 1 -- 172.21.15.55:0/2300775269 learned_addr learned my addr 172.21.15.55:0/2300775269 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:27.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb8ad9d640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb8c0700e0 0x7fcb8c1527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:27.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.651+0000 7fcb83fff640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb8c06eef0 0x7fcb8c14dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:27.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb8a59c640 1 -- 172.21.15.55:0/2300775269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb8c06eef0 msgr2=0x7fcb8c14dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:27.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb8a59c640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb8c06eef0 0x7fcb8c14dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb8a59c640 1 -- 172.21.15.55:0/2300775269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb8c0700e0 msgr2=0x7fcb8c1527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:27.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb8a59c640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb8c0700e0 0x7fcb8c1527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb8a59c640 1 -- 172.21.15.55:0/2300775269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb74009420 con 0x7fcb8c06c9f0 2023-07-06T21:54:27.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb8ad9d640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb8c0700e0 0x7fcb8c1527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:27.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb8a59c640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb8c06c9f0 0x7fcb8c14d7f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00e930 tx=0x7fcb7c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:27.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb82ffd640 1 -- 172.21.15.55:0/2300775269 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c009690 con 0x7fcb8c06c9f0 2023-07-06T21:54:27.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb82ffd640 1 -- 172.21.15.55:0/2300775269 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c00ca00 con 0x7fcb8c06c9f0 2023-07-06T21:54:27.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb82ffd640 1 -- 172.21.15.55:0/2300775269 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c00cd70 con 0x7fcb8c06c9f0 2023-07-06T21:54:27.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2300775269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c0c15e0 con 0x7fcb8c06c9f0 2023-07-06T21:54:27.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2300775269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c1545a0 con 0x7fcb8c06c9f0 2023-07-06T21:54:27.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2300775269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8c0c1440 con 0x7fcb8c06c9f0 2023-07-06T21:54:27.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb82ffd640 1 -- 172.21.15.55:0/2300775269 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fcb7c013470 con 0x7fcb8c06c9f0 2023-07-06T21:54:27.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb82ffd640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fcb6c066480 0x7fcb6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:27.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb82ffd640 1 -- 172.21.15.55:0/2300775269 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7fcb7c084a40 con 0x7fcb8c06c9f0 2023-07-06T21:54:27.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.655+0000 7fcb83fff640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fcb6c066480 0x7fcb6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:27.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.659+0000 7fcb83fff640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fcb6c066480 0x7fcb6c068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcb740af000 tx=0x7fcb740b6040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:27.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.659+0000 7fcb82ffd640 1 -- 172.21.15.55:0/2300775269 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb8c0c1440 con 0x7fcb8c06c9f0 2023-07-06T21:54:27.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.835+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2300775269 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb8c158910 con 0x7fcb6c066480 2023-07-06T21:54:27.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.847+0000 7fcb82ffd640 1 -- 172.21.15.55:0/2300775269 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fcb740ab6a0 con 0x7fcb6c066480 2023-07-06T21:54:27.849 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:27.849 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:49", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.851+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2300775269 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fcb6c066480 msgr2=0x7fcb6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.851+0000 7fcb8b59e640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fcb6c066480 0x7fcb6c068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcb740af000 tx=0x7fcb740b6040 comp rx=0 tx=0).stop 2023-07-06T21:54:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.851+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2300775269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb8c06c9f0 msgr2=0x7fcb8c14d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.851+0000 7fcb8b59e640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb8c06c9f0 0x7fcb8c14d7f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00e930 tx=0x7fcb7c00edf0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.851+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2300775269 shutdown_connections 2023-07-06T21:54:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.851+0000 7fcb8b59e640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fcb6c066480 0x7fcb6c068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.851+0000 7fcb8b59e640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb8c0700e0 0x7fcb8c1527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.851+0000 7fcb8b59e640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb8c06eef0 0x7fcb8c14dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.851+0000 7fcb8b59e640 1 --2- 172.21.15.55:0/2300775269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb8c06c9f0 0x7fcb8c14d7f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.851+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2300775269 >> 172.21.15.55:0/2300775269 conn(0x7fcb8c0cdd90 msgr2=0x7fcb8c0afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.851+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2300775269 shutdown_connections 2023-07-06T21:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:27.851+0000 7fcb8b59e640 1 -- 172.21.15.55:0/2300775269 wait complete. 2023-07-06T21:54:27.870 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:49", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:27.870 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-07-06T00:00:00', 'created': '2023-07-06T21:43:49', 'first': '2023-07-06T21:44:00', 'last': '2023-07-06T21:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-06T21:54:27.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:27.871 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-07-06T21:54:27.881 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:27.881 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:27.882 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:27.882 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:27.882 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:27.882 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:27.882 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:27.882 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:27.883 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:27.883 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:27.883 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:27.884 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-06-21_44_00_UTC', 'scheduled-2023-07-06-21_45_00_UTC', 'scheduled-2023-07-06-21_46_00_UTC', 'scheduled-2023-07-06-21_47_00_UTC', 'scheduled-2023-07-06-21_48_00_UTC', 'scheduled-2023-07-06-21_49_00_UTC', 'scheduled-2023-07-06-21_50_00_UTC', 'scheduled-2023-07-06-21_51_00_UTC', 'scheduled-2023-07-06-21_52_00_UTC', 'scheduled-2023-07-06-21_53_00_UTC', 'scheduled-2023-07-06-21_54_00_UTC'] 2023-07-06T21:54:27.884 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-07-06T21:54:28.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc12b826640 1 Processor -- start 2023-07-06T21:54:28.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc12b826640 1 -- start start 2023-07-06T21:54:28.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc12b826640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc12406a460 0x7fc1240caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc12b826640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc12406cb40 0x7fc1240693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc12b826640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc12406f960 0x7fc12406fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc12b826640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12406bac0 con 0x7fc12406a460 2023-07-06T21:54:28.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc12b826640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc124070300 con 0x7fc12406cb40 2023-07-06T21:54:28.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc12b826640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240cc650 con 0x7fc12406f960 2023-07-06T21:54:28.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc1295c2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc12406a460 0x7fc1240caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc1295c2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc12406a460 0x7fc1240caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51338/0 (socket says 172.21.15.55:51338) 2023-07-06T21:54:28.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc1295c2640 1 -- 172.21.15.55:0/4212984496 learned_addr learned my addr 172.21.15.55:0/4212984496 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:28.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc129dc3640 1 --2- 172.21.15.55:0/4212984496 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc12406f960 0x7fc12406fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc128dc1640 1 --2- 172.21.15.55:0/4212984496 >> v2:172.21.15.138:3300/0 conn(0x7fc12406cb40 0x7fc1240693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc1295c2640 1 -- 172.21.15.55:0/4212984496 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc12406f960 msgr2=0x7fc12406fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc1295c2640 1 --2- 172.21.15.55:0/4212984496 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc12406f960 0x7fc12406fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc1295c2640 1 -- 172.21.15.55:0/4212984496 >> v2:172.21.15.138:3300/0 conn(0x7fc12406cb40 msgr2=0x7fc1240693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc1295c2640 1 --2- 172.21.15.55:0/4212984496 >> v2:172.21.15.138:3300/0 conn(0x7fc12406cb40 0x7fc1240693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.071+0000 7fc1295c2640 1 -- 172.21.15.55:0/4212984496 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12406d130 con 0x7fc12406a460 2023-07-06T21:54:28.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.075+0000 7fc1295c2640 1 --2- 172.21.15.55:0/4212984496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc12406a460 0x7fc1240caa80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc12406f730 tx=0x7fc12001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6032b5f1c1fe488 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:28.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.075+0000 7fc11bfff640 1 -- 172.21.15.55:0/4212984496 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1200ac640 con 0x7fc12406a460 2023-07-06T21:54:28.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.075+0000 7fc11bfff640 1 -- 172.21.15.55:0/4212984496 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1200ac7a0 con 0x7fc12406a460 2023-07-06T21:54:28.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.075+0000 7fc11bfff640 1 -- 172.21.15.55:0/4212984496 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1200acb30 con 0x7fc12406a460 2023-07-06T21:54:28.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.075+0000 7fc12b826640 1 -- 172.21.15.55:0/4212984496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc12406a460 msgr2=0x7fc1240caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:28.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.075+0000 7fc12b826640 1 --2- 172.21.15.55:0/4212984496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc12406a460 0x7fc1240caa80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc12406f730 tx=0x7fc12001c440 comp rx=0 tx=0).stop 2023-07-06T21:54:28.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.075+0000 7fc12b826640 1 -- 172.21.15.55:0/4212984496 shutdown_connections 2023-07-06T21:54:28.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.075+0000 7fc12b826640 1 --2- 172.21.15.55:0/4212984496 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc12406f960 0x7fc12406fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.075+0000 7fc12b826640 1 --2- 172.21.15.55:0/4212984496 >> v2:172.21.15.138:3300/0 conn(0x7fc12406cb40 0x7fc1240693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.075+0000 7fc12b826640 1 --2- 172.21.15.55:0/4212984496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc12406a460 0x7fc1240caa80 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.075+0000 7fc12b826640 1 -- 172.21.15.55:0/4212984496 >> 172.21.15.55:0/4212984496 conn(0x7fc1240ce7f0 msgr2=0x7fc1240cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:28.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.075+0000 7fc12b826640 1 -- 172.21.15.55:0/4212984496 shutdown_connections 2023-07-06T21:54:28.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.075+0000 7fc12b826640 1 -- 172.21.15.55:0/4212984496 wait complete. 2023-07-06T21:54:28.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc12b826640 1 Processor -- start 2023-07-06T21:54:28.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc12b826640 1 -- start start 2023-07-06T21:54:28.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc12b826640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc12406a460 0x7fc1240b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc12b826640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc12406cb40 0x7fc12415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc12b826640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc12406f960 0x7fc124152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc12b826640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12414c5a0 con 0x7fc12406a460 2023-07-06T21:54:28.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc12b826640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12415a6c0 con 0x7fc12406f960 2023-07-06T21:54:28.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc12b826640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240b2e70 con 0x7fc12406cb40 2023-07-06T21:54:28.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc1295c2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc12406a460 0x7fc1240b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc1295c2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc12406a460 0x7fc1240b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51340/0 (socket says 172.21.15.55:51340) 2023-07-06T21:54:28.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc1295c2640 1 -- 172.21.15.55:0/2582803351 learned_addr learned my addr 172.21.15.55:0/2582803351 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:28.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc1295c2640 1 -- 172.21.15.55:0/2582803351 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc12406cb40 msgr2=0x7fc12415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:28.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc1295c2640 1 --2- 172.21.15.55:0/2582803351 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc12406cb40 0x7fc12415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc1295c2640 1 -- 172.21.15.55:0/2582803351 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc12406f960 msgr2=0x7fc124152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:28.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc1295c2640 1 --2- 172.21.15.55:0/2582803351 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc12406f960 0x7fc124152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc1295c2640 1 -- 172.21.15.55:0/2582803351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc120009480 con 0x7fc12406a460 2023-07-06T21:54:28.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc1295c2640 1 --2- 172.21.15.55:0/2582803351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc12406a460 0x7fc1240b27d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc12001cce0 tx=0x7fc1200191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:28.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc119ffb640 1 -- 172.21.15.55:0/2582803351 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc120005ba0 con 0x7fc12406a460 2023-07-06T21:54:28.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc119ffb640 1 -- 172.21.15.55:0/2582803351 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc120005d00 con 0x7fc12406a460 2023-07-06T21:54:28.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc119ffb640 1 -- 172.21.15.55:0/2582803351 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1200acb10 con 0x7fc12406a460 2023-07-06T21:54:28.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc12b826640 1 -- 172.21.15.55:0/2582803351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1240b3150 con 0x7fc12406a460 2023-07-06T21:54:28.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.079+0000 7fc12b826640 1 -- 172.21.15.55:0/2582803351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1240b3710 con 0x7fc12406a460 2023-07-06T21:54:28.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.083+0000 7fc1077fe640 1 -- 172.21.15.55:0/2582803351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc100005260 con 0x7fc12406a460 2023-07-06T21:54:28.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.083+0000 7fc119ffb640 1 -- 172.21.15.55:0/2582803351 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fc1200b3070 con 0x7fc12406a460 2023-07-06T21:54:28.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.083+0000 7fc119ffb640 1 --2- 172.21.15.55:0/2582803351 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc108066480 0x7fc108068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.083+0000 7fc119ffb640 1 -- 172.21.15.55:0/2582803351 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7fc12011da80 con 0x7fc12406a460 2023-07-06T21:54:28.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.083+0000 7fc128dc1640 1 --2- 172.21.15.55:0/2582803351 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc108066480 0x7fc108068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.083+0000 7fc128dc1640 1 --2- 172.21.15.55:0/2582803351 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc108066480 0x7fc108068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc1240c91f0 tx=0x7fc114008040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:28.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.087+0000 7fc119ffb640 1 -- 172.21.15.55:0/2582803351 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc1200ea960 con 0x7fc12406a460 2023-07-06T21:54:28.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.259+0000 7fc1077fe640 1 -- 172.21.15.55:0/2582803351 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc100000bd0 con 0x7fc108066480 2023-07-06T21:54:28.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.267+0000 7fc119ffb640 1 -- 172.21.15.55:0/2582803351 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fc100000bd0 con 0x7fc108066480 2023-07-06T21:54:28.268 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:28.268 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:50", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:28.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.271+0000 7fc1077fe640 1 -- 172.21.15.55:0/2582803351 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc108066480 msgr2=0x7fc108068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:28.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.271+0000 7fc1077fe640 1 --2- 172.21.15.55:0/2582803351 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc108066480 0x7fc108068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc1240c91f0 tx=0x7fc114008040 comp rx=0 tx=0).stop 2023-07-06T21:54:28.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.271+0000 7fc1077fe640 1 -- 172.21.15.55:0/2582803351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc12406a460 msgr2=0x7fc1240b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:28.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.271+0000 7fc1077fe640 1 --2- 172.21.15.55:0/2582803351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc12406a460 0x7fc1240b27d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc12001cce0 tx=0x7fc1200191e0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.271+0000 7fc1077fe640 1 -- 172.21.15.55:0/2582803351 shutdown_connections 2023-07-06T21:54:28.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.271+0000 7fc1077fe640 1 --2- 172.21.15.55:0/2582803351 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc108066480 0x7fc108068930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.271+0000 7fc1077fe640 1 --2- 172.21.15.55:0/2582803351 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc12406f960 0x7fc124152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.271+0000 7fc1077fe640 1 --2- 172.21.15.55:0/2582803351 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc12406cb40 0x7fc12415a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.271+0000 7fc1077fe640 1 --2- 172.21.15.55:0/2582803351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc12406a460 0x7fc1240b27d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.271+0000 7fc1077fe640 1 -- 172.21.15.55:0/2582803351 >> 172.21.15.55:0/2582803351 conn(0x7fc1240ce7f0 msgr2=0x7fc1240ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:28.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.271+0000 7fc1077fe640 1 -- 172.21.15.55:0/2582803351 shutdown_connections 2023-07-06T21:54:28.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.271+0000 7fc1077fe640 1 -- 172.21.15.55:0/2582803351 wait complete. 2023-07-06T21:54:28.288 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:50", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:28.289 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-07-06T00:00:00', 'created': '2023-07-06T21:43:50', 'first': '2023-07-06T21:44:00', 'last': '2023-07-06T21:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-06T21:54:28.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:28.290 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-07-06T21:54:28.300 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:28.300 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:28.300 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:28.300 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:28.300 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:28.301 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:28.301 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:28.301 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:28.301 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:28.301 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:28.301 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:28.302 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-06-21_44_00_UTC', 'scheduled-2023-07-06-21_45_00_UTC', 'scheduled-2023-07-06-21_46_00_UTC', 'scheduled-2023-07-06-21_47_00_UTC', 'scheduled-2023-07-06-21_48_00_UTC', 'scheduled-2023-07-06-21_49_00_UTC', 'scheduled-2023-07-06-21_50_00_UTC', 'scheduled-2023-07-06-21_51_00_UTC', 'scheduled-2023-07-06-21_52_00_UTC', 'scheduled-2023-07-06-21_53_00_UTC', 'scheduled-2023-07-06-21_54_00_UTC'] 2023-07-06T21:54:28.302 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-07-06T21:54:28.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.495+0000 7f6db9607640 1 Processor -- start 2023-07-06T21:54:28.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.495+0000 7f6db9607640 1 -- start start 2023-07-06T21:54:28.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.495+0000 7f6db9607640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6db40cd3e0 0x7f6db40cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db9607640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6db40cc150 0x7f6db406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db9607640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db4159350 con 0x7f6db40c8910 2023-07-06T21:54:28.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db9607640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db40ccf50 con 0x7f6db40cc150 2023-07-06T21:54:28.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db9607640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4158d90 con 0x7f6db40cd3e0 2023-07-06T21:54:28.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db2ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6db40c8910 0x7f6db4158360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42098/0 (socket says 172.21.15.55:42098) 2023-07-06T21:54:28.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db2ffd640 1 -- 172.21.15.55:0/2840251473 learned_addr learned my addr 172.21.15.55:0/2840251473 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:28.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db37fe640 1 --2- 172.21.15.55:0/2840251473 >> v2:172.21.15.138:3300/0 conn(0x7f6db40cc150 0x7f6db406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6dabfff640 1 --2- 172.21.15.55:0/2840251473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6db40cd3e0 0x7f6db40cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 -- 172.21.15.55:0/2840251473 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124704721 0 0) 0x7f6db4159350 con 0x7f6db40c8910 2023-07-06T21:54:28.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 -- 172.21.15.55:0/2840251473 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da0003530 con 0x7f6db40c8910 2023-07-06T21:54:28.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 -- 172.21.15.55:0/2840251473 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1428363075 0 0) 0x7f6da0003530 con 0x7f6db40c8910 2023-07-06T21:54:28.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 -- 172.21.15.55:0/2840251473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6db40cd3e0 msgr2=0x7f6db40cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:28.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 --2- 172.21.15.55:0/2840251473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6db40cd3e0 0x7f6db40cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 -- 172.21.15.55:0/2840251473 >> v2:172.21.15.138:3300/0 conn(0x7f6db40cc150 msgr2=0x7f6db406bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:28.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 --2- 172.21.15.55:0/2840251473 >> v2:172.21.15.138:3300/0 conn(0x7f6db40cc150 0x7f6db406bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 -- 172.21.15.55:0/2840251473 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db4159070 con 0x7f6db40c8910 2023-07-06T21:54:28.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 -- 172.21.15.55:0/2840251473 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f6da4001680 con 0x7f6db40c8910 2023-07-06T21:54:28.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 -- 172.21.15.55:0/2840251473 >> v1:172.21.15.55:6789/0 conn(0x7f6db40c8910 legacy=0x7f6db4158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:28.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 --2- 172.21.15.55:0/2840251473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6da0003980 0x7f6da0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 --2- 172.21.15.55:0/2840251473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6da0004360 0x7f6da0004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 --2- 172.21.15.55:0/2840251473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6da0004f40 0x7f6da000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 -- 172.21.15.55:0/2840251473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db40ccf50 con 0x7f6da0004f40 2023-07-06T21:54:28.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 -- 172.21.15.55:0/2840251473 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4158d90 con 0x7f6da0004360 2023-07-06T21:54:28.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db27fc640 1 -- 172.21.15.55:0/2840251473 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da000e0e0 con 0x7f6da0003980 2023-07-06T21:54:28.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db37fe640 1 --2- 172.21.15.55:0/2840251473 >> v2:172.21.15.138:3300/0 conn(0x7f6db40cc150 0x7f6db406bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:28.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6dabfff640 1 --2- 172.21.15.55:0/2840251473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6db40cd3e0 0x7f6db40cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:28.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db2ffd640 1 --2- 172.21.15.55:0/2840251473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6da0003980 0x7f6da0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db37fe640 1 --2- 172.21.15.55:0/2840251473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6da0004f40 0x7f6da000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6dabfff640 1 --2- 172.21.15.55:0/2840251473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6da0004360 0x7f6da0004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db37fe640 1 -- 172.21.15.55:0/2840251473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6da0003980 msgr2=0x7f6da0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:28.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db37fe640 1 --2- 172.21.15.55:0/2840251473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6da0003980 0x7f6da0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db37fe640 1 -- 172.21.15.55:0/2840251473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6da0004360 msgr2=0x7f6da0004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:28.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db37fe640 1 --2- 172.21.15.55:0/2840251473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6da0004360 0x7f6da0004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6db37fe640 1 -- 172.21.15.55:0/2840251473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da0003530 con 0x7f6da0004f40 2023-07-06T21:54:28.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.499+0000 7f6dabfff640 1 --2- 172.21.15.55:0/2840251473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6da0004360 0x7f6da0004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:28.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.503+0000 7f6db37fe640 1 --2- 172.21.15.55:0/2840251473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6da0004f40 0x7f6da000b990 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00a420 tx=0x7f6dac01cff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972dd049a4d67a02 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:28.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.503+0000 7f6db27fc640 1 -- 172.21.15.55:0/2840251473 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0af400 con 0x7f6da0004f40 2023-07-06T21:54:28.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.503+0000 7f6db27fc640 1 -- 172.21.15.55:0/2840251473 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac0a9070 con 0x7f6da0004f40 2023-07-06T21:54:28.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.503+0000 7f6db27fc640 1 -- 172.21.15.55:0/2840251473 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0af780 con 0x7f6da0004f40 2023-07-06T21:54:28.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.503+0000 7f6db9607640 1 -- 172.21.15.55:0/2840251473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6da0004f40 msgr2=0x7f6da000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:28.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.503+0000 7f6db9607640 1 --2- 172.21.15.55:0/2840251473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6da0004f40 0x7f6da000b990 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00a420 tx=0x7f6dac01cff0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.503+0000 7f6db37fe640 1 -- 172.21.15.55:0/2840251473 reap_dead start 2023-07-06T21:54:28.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.503+0000 7f6db9607640 1 -- 172.21.15.55:0/2840251473 shutdown_connections 2023-07-06T21:54:28.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.503+0000 7f6db9607640 1 -- 172.21.15.55:0/2840251473 >> 172.21.15.55:0/2840251473 conn(0x7f6db40cde30 msgr2=0x7f6db40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:28.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.503+0000 7f6db9607640 1 -- 172.21.15.55:0/2840251473 shutdown_connections 2023-07-06T21:54:28.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.503+0000 7f6db9607640 1 -- 172.21.15.55:0/2840251473 wait complete. 2023-07-06T21:54:28.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.503+0000 7f6db9607640 1 Processor -- start 2023-07-06T21:54:28.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.503+0000 7f6db9607640 1 -- start start 2023-07-06T21:54:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db9607640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6da0004f40 0x7f6db40b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db9607640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6db40b0d20 0x7f6db40b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db9607640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6db40b2ce0 0x7f6db40b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db9607640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db41549d0 con 0x7f6da0004f40 2023-07-06T21:54:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db9607640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db40b3690 con 0x7f6db40b0d20 2023-07-06T21:54:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db9607640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4153d50 con 0x7f6db40b2ce0 2023-07-06T21:54:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6da0004f40 0x7f6db40b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6da0004f40 0x7f6db40b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51358/0 (socket says 172.21.15.55:51358) 2023-07-06T21:54:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db2ffd640 1 -- 172.21.15.55:0/3849596823 learned_addr learned my addr 172.21.15.55:0/3849596823 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db2ffd640 1 -- 172.21.15.55:0/3849596823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6db40b2ce0 msgr2=0x7f6db40b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db2ffd640 1 --2- 172.21.15.55:0/3849596823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6db40b2ce0 0x7f6db40b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6dabfff640 1 --2- 172.21.15.55:0/3849596823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6db40b0d20 0x7f6db40b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db2ffd640 1 -- 172.21.15.55:0/3849596823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6db40b0d20 msgr2=0x7f6db40b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db2ffd640 1 --2- 172.21.15.55:0/3849596823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6db40b0d20 0x7f6db40b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db2ffd640 1 -- 172.21.15.55:0/3849596823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db4154030 con 0x7f6da0004f40 2023-07-06T21:54:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6dabfff640 1 --2- 172.21.15.55:0/3849596823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6db40b0d20 0x7f6db40b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:54:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db2ffd640 1 --2- 172.21.15.55:0/3849596823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6da0004f40 0x7f6db40b3a00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6da4012490 tx=0x7f6da4012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:28.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6dab7fe640 1 -- 172.21.15.55:0/3849596823 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4014810 con 0x7f6da0004f40 2023-07-06T21:54:28.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6dab7fe640 1 -- 172.21.15.55:0/3849596823 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da4014970 con 0x7f6da0004f40 2023-07-06T21:54:28.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6dab7fe640 1 -- 172.21.15.55:0/3849596823 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4014d20 con 0x7f6da0004f40 2023-07-06T21:54:28.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db9607640 1 -- 172.21.15.55:0/3849596823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db4154310 con 0x7f6da0004f40 2023-07-06T21:54:28.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db9607640 1 -- 172.21.15.55:0/3849596823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db40b1190 con 0x7f6da0004f40 2023-07-06T21:54:28.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.507+0000 7f6db9607640 1 -- 172.21.15.55:0/3849596823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db4066d60 con 0x7f6da0004f40 2023-07-06T21:54:28.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.511+0000 7f6dab7fe640 1 -- 172.21.15.55:0/3849596823 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f6da40153e0 con 0x7f6da0004f40 2023-07-06T21:54:28.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.511+0000 7f6dab7fe640 1 --2- 172.21.15.55:0/3849596823 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f6d94066480 0x7f6d94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.511+0000 7f6dab7fe640 1 -- 172.21.15.55:0/3849596823 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f6da4086cc0 con 0x7f6da0004f40 2023-07-06T21:54:28.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.511+0000 7f6dabfff640 1 --2- 172.21.15.55:0/3849596823 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f6d94066480 0x7f6d94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.511+0000 7f6dabfff640 1 --2- 172.21.15.55:0/3849596823 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f6d94066480 0x7f6d94068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6db415a400 tx=0x7f6d9c008040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.515+0000 7f6dab7fe640 1 -- 172.21.15.55:0/3849596823 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6da408d080 con 0x7f6da0004f40 2023-07-06T21:54:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.687+0000 7f6db9607640 1 -- 172.21.15.55:0/3849596823 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6db41547c0 con 0x7f6d94066480 2023-07-06T21:54:28.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.703+0000 7f6dab7fe640 1 -- 172.21.15.55:0/3849596823 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f6d9c012b00 con 0x7f6d94066480 2023-07-06T21:54:28.702 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:28.702 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:50", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:28.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.703+0000 7f6db9607640 1 -- 172.21.15.55:0/3849596823 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f6d94066480 msgr2=0x7f6d94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:28.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.703+0000 7f6db9607640 1 --2- 172.21.15.55:0/3849596823 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f6d94066480 0x7f6d94068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6db415a400 tx=0x7f6d9c008040 comp rx=0 tx=0).stop 2023-07-06T21:54:28.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.703+0000 7f6db9607640 1 -- 172.21.15.55:0/3849596823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6da0004f40 msgr2=0x7f6db40b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:28.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.703+0000 7f6db9607640 1 --2- 172.21.15.55:0/3849596823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6da0004f40 0x7f6db40b3a00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6da4012490 tx=0x7f6da4012950 comp rx=0 tx=0).stop 2023-07-06T21:54:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.703+0000 7f6db9607640 1 -- 172.21.15.55:0/3849596823 shutdown_connections 2023-07-06T21:54:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.703+0000 7f6db9607640 1 --2- 172.21.15.55:0/3849596823 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f6d94066480 0x7f6d94068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.703+0000 7f6db9607640 1 --2- 172.21.15.55:0/3849596823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6db40b2ce0 0x7f6db40b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.703+0000 7f6db9607640 1 --2- 172.21.15.55:0/3849596823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6db40b0d20 0x7f6db40b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.703+0000 7f6db9607640 1 --2- 172.21.15.55:0/3849596823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6da0004f40 0x7f6db40b3a00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.703+0000 7f6db9607640 1 -- 172.21.15.55:0/3849596823 >> 172.21.15.55:0/3849596823 conn(0x7f6db40cde30 msgr2=0x7f6db415a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.703+0000 7f6db9607640 1 -- 172.21.15.55:0/3849596823 shutdown_connections 2023-07-06T21:54:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.703+0000 7f6db9607640 1 -- 172.21.15.55:0/3849596823 wait complete. 2023-07-06T21:54:28.723 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:43:50", "first": "2023-07-06T21:44:00", "last": "2023-07-06T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-06T21:54:28.723 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-07-06T00:00:00', 'created': '2023-07-06T21:43:50', 'first': '2023-07-06T21:44:00', 'last': '2023-07-06T21:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-06T21:54:28.724 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-07-06T21:54:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9fa5c640 1 Processor -- start 2023-07-06T21:54:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9fa5c640 1 -- start start 2023-07-06T21:54:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9fa5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb9806a460 0x7fbb980caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9fa5c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbb9806cb40 0x7fbb980693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9fa5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb9806f960 0x7fbb9806fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9fa5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9806bac0 con 0x7fbb9806a460 2023-07-06T21:54:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9fa5c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb98070300 con 0x7fbb9806cb40 2023-07-06T21:54:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9fa5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980cc650 con 0x7fbb9806f960 2023-07-06T21:54:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9d7f8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb9806a460 0x7fbb980caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9d7f8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb9806a460 0x7fbb980caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51370/0 (socket says 172.21.15.55:51370) 2023-07-06T21:54:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9d7f8640 1 -- 172.21.15.55:0/2038430406 learned_addr learned my addr 172.21.15.55:0/2038430406 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:28.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9dff9640 1 --2- 172.21.15.55:0/2038430406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb9806f960 0x7fbb9806fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9cff7640 1 --2- 172.21.15.55:0/2038430406 >> v2:172.21.15.138:3300/0 conn(0x7fbb9806cb40 0x7fbb980693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9d7f8640 1 -- 172.21.15.55:0/2038430406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb9806f960 msgr2=0x7fbb9806fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:28.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9d7f8640 1 --2- 172.21.15.55:0/2038430406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb9806f960 0x7fbb9806fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9d7f8640 1 -- 172.21.15.55:0/2038430406 >> v2:172.21.15.138:3300/0 conn(0x7fbb9806cb40 msgr2=0x7fbb980693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:28.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9d7f8640 1 --2- 172.21.15.55:0/2038430406 >> v2:172.21.15.138:3300/0 conn(0x7fbb9806cb40 0x7fbb980693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9d7f8640 1 -- 172.21.15.55:0/2038430406 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9806d130 con 0x7fbb9806a460 2023-07-06T21:54:28.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9dff9640 1 --2- 172.21.15.55:0/2038430406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb9806f960 0x7fbb9806fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:54:28.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.871+0000 7fbb9cff7640 1 --2- 172.21.15.55:0/2038430406 >> v2:172.21.15.138:3300/0 conn(0x7fbb9806cb40 0x7fbb980693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:54:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.875+0000 7fbb9d7f8640 1 --2- 172.21.15.55:0/2038430406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9806a460 0x7fbb980caa80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbb9806f730 tx=0x7fbb9401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f4bcd5df6177a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.875+0000 7fbb8ffff640 1 -- 172.21.15.55:0/2038430406 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb940ac640 con 0x7fbb9806a460 2023-07-06T21:54:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.875+0000 7fbb8ffff640 1 -- 172.21.15.55:0/2038430406 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb940ac7a0 con 0x7fbb9806a460 2023-07-06T21:54:28.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.875+0000 7fbb8ffff640 1 -- 172.21.15.55:0/2038430406 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb940acb30 con 0x7fbb9806a460 2023-07-06T21:54:28.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.875+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2038430406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9806a460 msgr2=0x7fbb980caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:28.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.875+0000 7fbb9fa5c640 1 --2- 172.21.15.55:0/2038430406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9806a460 0x7fbb980caa80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbb9806f730 tx=0x7fbb9401c440 comp rx=0 tx=0).stop 2023-07-06T21:54:28.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.875+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2038430406 shutdown_connections 2023-07-06T21:54:28.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.875+0000 7fbb9fa5c640 1 --2- 172.21.15.55:0/2038430406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb9806f960 0x7fbb9806fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.875+0000 7fbb9fa5c640 1 --2- 172.21.15.55:0/2038430406 >> v2:172.21.15.138:3300/0 conn(0x7fbb9806cb40 0x7fbb980693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.875+0000 7fbb9fa5c640 1 --2- 172.21.15.55:0/2038430406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9806a460 0x7fbb980caa80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.875+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2038430406 >> 172.21.15.55:0/2038430406 conn(0x7fbb980ce7f0 msgr2=0x7fbb980cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:28.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2038430406 shutdown_connections 2023-07-06T21:54:28.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2038430406 wait complete. 2023-07-06T21:54:28.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9fa5c640 1 Processor -- start 2023-07-06T21:54:28.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9fa5c640 1 -- start start 2023-07-06T21:54:28.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9fa5c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb9806a460 0x7fbb9815b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9fa5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9806cb40 0x7fbb9814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9fa5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb9806f960 0x7fbb9815bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9fa5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980c8550 con 0x7fbb9806cb40 2023-07-06T21:54:28.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9fa5c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9815a130 con 0x7fbb9806a460 2023-07-06T21:54:28.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9fa5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9814f8f0 con 0x7fbb9806f960 2023-07-06T21:54:28.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9cff7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9806cb40 0x7fbb9814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9cff7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9806cb40 0x7fbb9814f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51372/0 (socket says 172.21.15.55:51372) 2023-07-06T21:54:28.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9cff7640 1 -- 172.21.15.55:0/2451844729 learned_addr learned my addr 172.21.15.55:0/2451844729 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:28.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9d7f8640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb9806a460 0x7fbb9815b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9dff9640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb9806f960 0x7fbb9815bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9cff7640 1 -- 172.21.15.55:0/2451844729 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb9806f960 msgr2=0x7fbb9815bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:28.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9cff7640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb9806f960 0x7fbb9815bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9cff7640 1 -- 172.21.15.55:0/2451844729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb9806a460 msgr2=0x7fbb9815b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:28.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9cff7640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb9806a460 0x7fbb9815b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:28.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9cff7640 1 -- 172.21.15.55:0/2451844729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb94009480 con 0x7fbb9806cb40 2023-07-06T21:54:28.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9d7f8640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb9806a460 0x7fbb9815b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:28.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb9cff7640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9806cb40 0x7fbb9814f3b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800c7c0 tx=0x7fbb8800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:28.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.879+0000 7fbb8dffb640 1 -- 172.21.15.55:0/2451844729 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88007a30 con 0x7fbb9806cb40 2023-07-06T21:54:28.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.883+0000 7fbb8dffb640 1 -- 172.21.15.55:0/2451844729 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb88007b90 con 0x7fbb9806cb40 2023-07-06T21:54:28.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.883+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2451844729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9815a3d0 con 0x7fbb9806cb40 2023-07-06T21:54:28.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.883+0000 7fbb8dffb640 1 -- 172.21.15.55:0/2451844729 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8800ce70 con 0x7fbb9806cb40 2023-07-06T21:54:28.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.883+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2451844729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9815a990 con 0x7fbb9806cb40 2023-07-06T21:54:28.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.883+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2451844729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb98066d60 con 0x7fbb9806cb40 2023-07-06T21:54:28.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.883+0000 7fbb8dffb640 1 -- 172.21.15.55:0/2451844729 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fbb880113f0 con 0x7fbb9806cb40 2023-07-06T21:54:28.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.883+0000 7fbb8dffb640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbb7c066480 0x7fbb7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:28.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.883+0000 7fbb8dffb640 1 -- 172.21.15.55:0/2451844729 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7fbb88084620 con 0x7fbb9806cb40 2023-07-06T21:54:28.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.883+0000 7fbb9d7f8640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbb7c066480 0x7fbb7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:28.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.883+0000 7fbb9d7f8640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbb7c066480 0x7fbb7c068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb940ae000 tx=0x7fbb940a6070 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:28.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:28.887+0000 7fbb8dffb640 1 -- 172.21.15.55:0/2451844729 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb88051490 con 0x7fbb9806cb40 2023-07-06T21:54:29.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:29.059+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2451844729 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb9806a830 con 0x7fbb7c066480 2023-07-06T21:54:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:29.139+0000 7fbb8dffb640 1 -- 172.21.15.55:0/2451844729 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fbb94004140 con 0x7fbb7c066480 2023-07-06T21:54:29.138 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-07-06T21:54:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:29.139+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2451844729 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbb7c066480 msgr2=0x7fbb7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:29.139+0000 7fbb9fa5c640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbb7c066480 0x7fbb7c068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb940ae000 tx=0x7fbb940a6070 comp rx=0 tx=0).stop 2023-07-06T21:54:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:29.139+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2451844729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9806cb40 msgr2=0x7fbb9814f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:29.139+0000 7fbb9fa5c640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9806cb40 0x7fbb9814f3b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800c7c0 tx=0x7fbb8800cc80 comp rx=0 tx=0).stop 2023-07-06T21:54:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:29.139+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2451844729 shutdown_connections 2023-07-06T21:54:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:29.139+0000 7fbb9fa5c640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbb7c066480 0x7fbb7c068930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:29.139+0000 7fbb9fa5c640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb9806f960 0x7fbb9815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:29.139+0000 7fbb9fa5c640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9806cb40 0x7fbb9814f3b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:29.139+0000 7fbb9fa5c640 1 --2- 172.21.15.55:0/2451844729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb9806a460 0x7fbb9815b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:29.139+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2451844729 >> 172.21.15.55:0/2451844729 conn(0x7fbb980ce7f0 msgr2=0x7fbb980ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:29.139+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2451844729 shutdown_connections 2023-07-06T21:54:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:29.139+0000 7fbb9fa5c640 1 -- 172.21.15.55:0/2451844729 wait complete. 2023-07-06T21:54:29.159 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-07-06T21:54:29.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:29.160 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-07-06T21:54:29.170 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:29.170 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:29.170 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:29.170 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:29.170 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:29.171 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:29.171 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:29.171 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:29.171 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:29.171 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:29.171 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:29.172 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:29.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:29.173 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_44_00_UTC) 2023-07-06T21:54:29.233 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:29.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:29.234 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_45_00_UTC) 2023-07-06T21:54:29.292 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:29.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:29.293 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_46_00_UTC) 2023-07-06T21:54:29.347 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:29.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:29.348 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_47_00_UTC) 2023-07-06T21:54:29.403 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:29.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:29.404 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_48_00_UTC) 2023-07-06T21:54:29.459 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:29.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:29.460 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_49_00_UTC) 2023-07-06T21:54:29.515 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:29.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:29.516 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_50_00_UTC) 2023-07-06T21:54:29.572 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:29.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:29.572 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_51_00_UTC) 2023-07-06T21:54:29.628 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:29.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:29.629 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_52_00_UTC) 2023-07-06T21:54:29.683 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:29.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:29.683 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_53_00_UTC) 2023-07-06T21:54:29.739 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:29.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:29.740 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-06-21_54_00_UTC) 2023-07-06T21:54:29.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:29.796 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-07-06T21:54:29.849 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-07-06T21:54:30.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f33a51fa640 1 Processor -- start 2023-07-06T21:54:30.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f33a51fa640 1 -- start start 2023-07-06T21:54:30.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f33a51fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33a0158780 0x7f33a00cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:30.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f33a51fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33a00cbfa0 0x7f33a006f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:30.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f33a51fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a0158b50 con 0x7f33a00c89b0 2023-07-06T21:54:30.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f33a51fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a006b390 con 0x7f33a0158780 2023-07-06T21:54:30.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f33a51fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a00cd3d0 con 0x7f33a00cbfa0 2023-07-06T21:54:30.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f339ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33a0158780 0x7f33a00cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:30.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f339f59e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f33a00c89b0 0x7f33a006c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42102/0 (socket says 172.21.15.55:42102) 2023-07-06T21:54:30.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f339f59e640 1 -- 172.21.15.55:0/658977262 learned_addr learned my addr 172.21.15.55:0/658977262 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:30.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f3397fff640 1 --2- 172.21.15.55:0/658977262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33a00cbfa0 0x7f33a006f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:30.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f339e59c640 1 -- 172.21.15.55:0/658977262 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040232808 0 0) 0x7f33a0158b50 con 0x7f33a00c89b0 2023-07-06T21:54:30.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f339e59c640 1 -- 172.21.15.55:0/658977262 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f338c003530 con 0x7f33a00c89b0 2023-07-06T21:54:30.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f339ed9d640 1 -- 172.21.15.55:0/658977262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33a00cbfa0 msgr2=0x7f33a006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:30.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f339ed9d640 1 --2- 172.21.15.55:0/658977262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33a00cbfa0 0x7f33a006f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:30.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f339ed9d640 1 -- 172.21.15.55:0/658977262 >> v1:172.21.15.55:6789/0 conn(0x7f33a00c89b0 legacy=0x7f33a006c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:30.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.047+0000 7f339ed9d640 1 -- 172.21.15.55:0/658977262 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a006b630 con 0x7f33a0158780 2023-07-06T21:54:30.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.051+0000 7f339ed9d640 1 --2- 172.21.15.55:0/658977262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a0158780 0x7f33a00cce90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f33900097c0 tx=0x7f339001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b59a88dc942938 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:30.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.051+0000 7f339e59c640 1 -- 172.21.15.55:0/658977262 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33900ab600 con 0x7f33a0158780 2023-07-06T21:54:30.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.051+0000 7f339e59c640 1 -- 172.21.15.55:0/658977262 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33900a7050 con 0x7f33a0158780 2023-07-06T21:54:30.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.051+0000 7f339e59c640 1 -- 172.21.15.55:0/658977262 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33900ab960 con 0x7f33a0158780 2023-07-06T21:54:30.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.051+0000 7f33a51fa640 1 -- 172.21.15.55:0/658977262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a0158780 msgr2=0x7f33a00cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:30.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.051+0000 7f33a51fa640 1 --2- 172.21.15.55:0/658977262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a0158780 0x7f33a00cce90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f33900097c0 tx=0x7f339001c3f0 comp rx=0 tx=0).stop 2023-07-06T21:54:30.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.051+0000 7f33a51fa640 1 -- 172.21.15.55:0/658977262 shutdown_connections 2023-07-06T21:54:30.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.051+0000 7f33a51fa640 1 --2- 172.21.15.55:0/658977262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33a00cbfa0 0x7f33a006f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:30.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.051+0000 7f33a51fa640 1 --2- 172.21.15.55:0/658977262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a0158780 0x7f33a00cce90 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:30.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.051+0000 7f33a51fa640 1 -- 172.21.15.55:0/658977262 >> 172.21.15.55:0/658977262 conn(0x7f33a00cde30 msgr2=0x7f33a00ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:30.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.051+0000 7f33a51fa640 1 -- 172.21.15.55:0/658977262 shutdown_connections 2023-07-06T21:54:30.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.051+0000 7f33a51fa640 1 -- 172.21.15.55:0/658977262 wait complete. 2023-07-06T21:54:30.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f33a51fa640 1 Processor -- start 2023-07-06T21:54:30.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f33a51fa640 1 -- start start 2023-07-06T21:54:30.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f33a51fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33a00c89b0 0x7f33a00c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:30.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f33a51fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33a00cbfa0 0x7f33a0152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:30.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f33a51fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a0158780 0x7f33a0152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:30.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f33a51fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a0148a20 con 0x7f33a0158780 2023-07-06T21:54:30.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f33a51fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a014fa50 con 0x7f33a00cbfa0 2023-07-06T21:54:30.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f33a51fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a014fd10 con 0x7f33a00c89b0 2023-07-06T21:54:30.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f339f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a0158780 0x7f33a0152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:30.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f339f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a0158780 0x7f33a0152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51390/0 (socket says 172.21.15.55:51390) 2023-07-06T21:54:30.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f339f59e640 1 -- 172.21.15.55:0/3901242512 learned_addr learned my addr 172.21.15.55:0/3901242512 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:30.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f3397fff640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33a00cbfa0 0x7f33a0152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:30.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f339ed9d640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33a00c89b0 0x7f33a00c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:30.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f339f59e640 1 -- 172.21.15.55:0/3901242512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33a00c89b0 msgr2=0x7f33a00c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:30.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f339f59e640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33a00c89b0 0x7f33a00c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:30.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f339f59e640 1 -- 172.21.15.55:0/3901242512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33a00cbfa0 msgr2=0x7f33a0152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:30.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f339f59e640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33a00cbfa0 0x7f33a0152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:30.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f339f59e640 1 -- 172.21.15.55:0/3901242512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3390009420 con 0x7f33a0158780 2023-07-06T21:54:30.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f3397fff640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33a00cbfa0 0x7f33a0152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:30.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f339f59e640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a0158780 0x7f33a0152550 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f339800cb40 tx=0x7f339800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:30.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f33977fe640 1 -- 172.21.15.55:0/3901242512 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339800aca0 con 0x7f33a0158780 2023-07-06T21:54:30.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f33977fe640 1 -- 172.21.15.55:0/3901242512 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339800ae00 con 0x7f33a0158780 2023-07-06T21:54:30.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f33977fe640 1 -- 172.21.15.55:0/3901242512 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398012620 con 0x7f33a0158780 2023-07-06T21:54:30.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f33a51fa640 1 -- 172.21.15.55:0/3901242512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a014fff0 con 0x7f33a0158780 2023-07-06T21:54:30.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f33a51fa640 1 -- 172.21.15.55:0/3901242512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a01505b0 con 0x7f33a0158780 2023-07-06T21:54:30.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.055+0000 7f33a51fa640 1 -- 172.21.15.55:0/3901242512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a01507a0 con 0x7f33a0158780 2023-07-06T21:54:30.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.059+0000 7f33977fe640 1 -- 172.21.15.55:0/3901242512 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f3398007070 con 0x7f33a0158780 2023-07-06T21:54:30.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.059+0000 7f33977fe640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3380066480 0x7f3380068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:30.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.059+0000 7f33977fe640 1 -- 172.21.15.55:0/3901242512 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f3398084450 con 0x7f33a0158780 2023-07-06T21:54:30.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.059+0000 7f339ed9d640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3380066480 0x7f3380068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:30.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.059+0000 7f339ed9d640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3380066480 0x7f3380068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f33900ad000 tx=0x7f33900a6000 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.063+0000 7f33977fe640 1 -- 172.21.15.55:0/3901242512 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3398051330 con 0x7f33a0158780 2023-07-06T21:54:30.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.235+0000 7f33a51fa640 1 -- 172.21.15.55:0/3901242512 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f33a00cd6a0 con 0x7f3380066480 2023-07-06T21:54:30.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.319+0000 7f33977fe640 1 -- 172.21.15.55:0/3901242512 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f3390004300 con 0x7f3380066480 2023-07-06T21:54:30.318 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-07-06T21:54:30.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.319+0000 7f33a51fa640 1 -- 172.21.15.55:0/3901242512 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3380066480 msgr2=0x7f3380068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:30.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.319+0000 7f33a51fa640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3380066480 0x7f3380068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f33900ad000 tx=0x7f33900a6000 comp rx=0 tx=0).stop 2023-07-06T21:54:30.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.319+0000 7f33a51fa640 1 -- 172.21.15.55:0/3901242512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a0158780 msgr2=0x7f33a0152550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:30.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.319+0000 7f33a51fa640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a0158780 0x7f33a0152550 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f339800cb40 tx=0x7f339800a060 comp rx=0 tx=0).stop 2023-07-06T21:54:30.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.319+0000 7f33a51fa640 1 -- 172.21.15.55:0/3901242512 shutdown_connections 2023-07-06T21:54:30.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.319+0000 7f33a51fa640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3380066480 0x7f3380068930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:30.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.319+0000 7f33a51fa640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a0158780 0x7f33a0152550 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:30.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.319+0000 7f33a51fa640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33a00cbfa0 0x7f33a0152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:30.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.319+0000 7f33a51fa640 1 --2- 172.21.15.55:0/3901242512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33a00c89b0 0x7f33a00c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:30.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.319+0000 7f33a51fa640 1 -- 172.21.15.55:0/3901242512 >> 172.21.15.55:0/3901242512 conn(0x7f33a00cde30 msgr2=0x7f33a00ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:30.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.319+0000 7f33a51fa640 1 -- 172.21.15.55:0/3901242512 shutdown_connections 2023-07-06T21:54:30.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:30.319+0000 7f33a51fa640 1 -- 172.21.15.55:0/3901242512 wait complete. 2023-07-06T21:54:30.339 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-07-06T21:54:30.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:30.339 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-07-06T21:54:30.349 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:30.349 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:30.349 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:30.350 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:30.350 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:30.350 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_01_UTC 2023-07-06T21:54:30.350 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:30.351 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:30.351 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:30.351 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:30.351 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:30.352 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:30.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:30.353 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_44_00_UTC) 2023-07-06T21:54:30.412 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:30.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:30.523 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_45_00_UTC) 2023-07-06T21:54:30.542 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:30.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:30.542 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_46_00_UTC) 2023-07-06T21:54:30.600 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:30.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:30.601 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_47_00_UTC) 2023-07-06T21:54:30.656 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:30.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:30.657 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_48_00_UTC) 2023-07-06T21:54:30.712 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_49_01_UTC 2023-07-06T21:54:30.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:30.712 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_49_01_UTC) 2023-07-06T21:54:30.767 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:30.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:30.768 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_50_00_UTC) 2023-07-06T21:54:30.823 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:30.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:30.824 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_51_00_UTC) 2023-07-06T21:54:30.881 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:30.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:30.882 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_52_00_UTC) 2023-07-06T21:54:30.940 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:30.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:30.941 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_53_00_UTC) 2023-07-06T21:54:30.995 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:30.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:30.996 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-06-21_54_00_UTC) 2023-07-06T21:54:31.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:31.056 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-07-06T21:54:31.108 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-07-06T21:54:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.295+0000 7fc078048640 1 Processor -- start 2023-07-06T21:54:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.295+0000 7fc078048640 1 -- start start 2023-07-06T21:54:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc078048640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc07015b930 0x7fc0700cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc078048640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0700cc2e0 0x7fc0700ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc078048640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0700ce790 0x7fc0700ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc078048640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0700b5b60 con 0x7fc0700ce790 2023-07-06T21:54:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc078048640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0700b5880 con 0x7fc07015b930 2023-07-06T21:54:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc078048640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700cdcb0 con 0x7fc0700cc2e0 2023-07-06T21:54:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc0765e5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0700ce790 0x7fc0700ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc0765e5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0700ce790 0x7fc0700ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51396/0 (socket says 172.21.15.55:51396) 2023-07-06T21:54:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc0765e5640 1 -- 172.21.15.55:0/3732482394 learned_addr learned my addr 172.21.15.55:0/3732482394 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc075de4640 1 --2- 172.21.15.55:0/3732482394 >> v2:172.21.15.138:3300/0 conn(0x7fc07015b930 0x7fc0700cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:31.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc0755e3640 1 --2- 172.21.15.55:0/3732482394 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0700cc2e0 0x7fc0700ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:31.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc0765e5640 1 -- 172.21.15.55:0/3732482394 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0700cc2e0 msgr2=0x7fc0700ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:31.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc0765e5640 1 --2- 172.21.15.55:0/3732482394 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0700cc2e0 0x7fc0700ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:31.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc0765e5640 1 -- 172.21.15.55:0/3732482394 >> v2:172.21.15.138:3300/0 conn(0x7fc07015b930 msgr2=0x7fc0700cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:31.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc0765e5640 1 --2- 172.21.15.55:0/3732482394 >> v2:172.21.15.138:3300/0 conn(0x7fc07015b930 0x7fc0700cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:31.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc0765e5640 1 -- 172.21.15.55:0/3732482394 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0700cdf90 con 0x7fc0700ce790 2023-07-06T21:54:31.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc0755e3640 1 --2- 172.21.15.55:0/3732482394 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0700cc2e0 0x7fc0700ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:31.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.299+0000 7fc075de4640 1 --2- 172.21.15.55:0/3732482394 >> v2:172.21.15.138:3300/0 conn(0x7fc07015b930 0x7fc0700cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:31.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc0765e5640 1 --2- 172.21.15.55:0/3732482394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0700ce790 0x7fc0700ca620 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc0700cc9b0 tx=0x7fc06801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8208b012089e6c21 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:31.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc074de2640 1 -- 172.21.15.55:0/3732482394 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0680a5840 con 0x7fc0700ce790 2023-07-06T21:54:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc074de2640 1 -- 172.21.15.55:0/3732482394 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0680a59a0 con 0x7fc0700ce790 2023-07-06T21:54:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc074de2640 1 -- 172.21.15.55:0/3732482394 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0680a5d30 con 0x7fc0700ce790 2023-07-06T21:54:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 -- 172.21.15.55:0/3732482394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0700ce790 msgr2=0x7fc0700ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:31.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 --2- 172.21.15.55:0/3732482394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0700ce790 0x7fc0700ca620 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc0700cc9b0 tx=0x7fc06801c9a0 comp rx=0 tx=0).stop 2023-07-06T21:54:31.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 -- 172.21.15.55:0/3732482394 shutdown_connections 2023-07-06T21:54:31.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 --2- 172.21.15.55:0/3732482394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0700ce790 0x7fc0700ca620 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:31.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 --2- 172.21.15.55:0/3732482394 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0700cc2e0 0x7fc0700ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:31.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 --2- 172.21.15.55:0/3732482394 >> v2:172.21.15.138:3300/0 conn(0x7fc07015b930 0x7fc0700cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:31.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 -- 172.21.15.55:0/3732482394 >> 172.21.15.55:0/3732482394 conn(0x7fc0700d0c60 msgr2=0x7fc0700b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:31.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 -- 172.21.15.55:0/3732482394 shutdown_connections 2023-07-06T21:54:31.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 -- 172.21.15.55:0/3732482394 wait complete. 2023-07-06T21:54:31.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 Processor -- start 2023-07-06T21:54:31.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 -- start start 2023-07-06T21:54:31.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0700ce790 0x7fc07014ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:31.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07015b930 0x7fc070157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:31.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc07014b2a0 0x7fc070158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:31.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc070158b30 con 0x7fc07014b2a0 2023-07-06T21:54:31.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700c3960 con 0x7fc07015b930 2023-07-06T21:54:31.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.303+0000 7fc078048640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc070158850 con 0x7fc0700ce790 2023-07-06T21:54:31.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc0765e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc07014b2a0 0x7fc070158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:31.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc075de4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0700ce790 0x7fc07014ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:31.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc075de4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0700ce790 0x7fc07014ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:57916/0 (socket says 172.21.15.55:57916) 2023-07-06T21:54:31.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc0765e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc07014b2a0 0x7fc070158220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51408/0 (socket says 172.21.15.55:51408) 2023-07-06T21:54:31.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc075de4640 1 -- 172.21.15.55:0/2994554958 learned_addr learned my addr 172.21.15.55:0/2994554958 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:31.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc0755e3640 1 --2- 172.21.15.55:0/2994554958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07015b930 0x7fc070157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:31.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc075de4640 1 -- 172.21.15.55:0/2994554958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07015b930 msgr2=0x7fc070157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:31.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc075de4640 1 --2- 172.21.15.55:0/2994554958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07015b930 0x7fc070157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:31.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc075de4640 1 -- 172.21.15.55:0/2994554958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc07014b2a0 msgr2=0x7fc070158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:31.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc075de4640 1 --2- 172.21.15.55:0/2994554958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc07014b2a0 0x7fc070158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:31.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc075de4640 1 -- 172.21.15.55:0/2994554958 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc068009b30 con 0x7fc0700ce790 2023-07-06T21:54:31.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc0765e5640 1 --2- 172.21.15.55:0/2994554958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc07014b2a0 0x7fc070158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:31.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc075de4640 1 --2- 172.21.15.55:0/2994554958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0700ce790 0x7fc07014ad60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00d800 tx=0x7fc06c00dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:31.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc0667fc640 1 -- 172.21.15.55:0/2994554958 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0096c0 con 0x7fc0700ce790 2023-07-06T21:54:31.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc0667fc640 1 -- 172.21.15.55:0/2994554958 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c009820 con 0x7fc0700ce790 2023-07-06T21:54:31.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc078048640 1 -- 172.21.15.55:0/2994554958 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0700c3c00 con 0x7fc0700ce790 2023-07-06T21:54:31.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc0667fc640 1 -- 172.21.15.55:0/2994554958 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c009bd0 con 0x7fc0700ce790 2023-07-06T21:54:31.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc078048640 1 -- 172.21.15.55:0/2994554958 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07014ba00 con 0x7fc0700ce790 2023-07-06T21:54:31.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc078048640 1 -- 172.21.15.55:0/2994554958 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0700c4120 con 0x7fc0700ce790 2023-07-06T21:54:31.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.307+0000 7fc0667fc640 1 -- 172.21.15.55:0/2994554958 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fc06c009d30 con 0x7fc0700ce790 2023-07-06T21:54:31.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.311+0000 7fc0667fc640 1 --2- 172.21.15.55:0/2994554958 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc054066480 0x7fc054068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:31.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.311+0000 7fc0667fc640 1 -- 172.21.15.55:0/2994554958 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6698+0+0 (secure 0 0 0) 0x7fc06c084950 con 0x7fc0700ce790 2023-07-06T21:54:31.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.311+0000 7fc0755e3640 1 --2- 172.21.15.55:0/2994554958 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc054066480 0x7fc054068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:31.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.311+0000 7fc0755e3640 1 --2- 172.21.15.55:0/2994554958 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc054066480 0x7fc054068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc070154730 tx=0x7fc060008040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:31.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.315+0000 7fc0667fc640 1 -- 172.21.15.55:0/2994554958 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc06c051970 con 0x7fc0700ce790 2023-07-06T21:54:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.491+0000 7fc078048640 1 -- 172.21.15.55:0/2994554958 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc070066d60 con 0x7fc054066480 2023-07-06T21:54:31.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.571+0000 7fc0667fc640 1 -- 172.21.15.55:0/2994554958 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fc070066d60 con 0x7fc054066480 2023-07-06T21:54:31.573 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-07-06T21:54:31.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.575+0000 7fc078048640 1 -- 172.21.15.55:0/2994554958 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc054066480 msgr2=0x7fc054068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:31.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.575+0000 7fc078048640 1 --2- 172.21.15.55:0/2994554958 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc054066480 0x7fc054068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc070154730 tx=0x7fc060008040 comp rx=0 tx=0).stop 2023-07-06T21:54:31.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.575+0000 7fc078048640 1 -- 172.21.15.55:0/2994554958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0700ce790 msgr2=0x7fc07014ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:31.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.575+0000 7fc078048640 1 --2- 172.21.15.55:0/2994554958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0700ce790 0x7fc07014ad60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00d800 tx=0x7fc06c00dcc0 comp rx=0 tx=0).stop 2023-07-06T21:54:31.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.575+0000 7fc078048640 1 -- 172.21.15.55:0/2994554958 shutdown_connections 2023-07-06T21:54:31.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.575+0000 7fc078048640 1 --2- 172.21.15.55:0/2994554958 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fc054066480 0x7fc054068930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:31.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.575+0000 7fc078048640 1 --2- 172.21.15.55:0/2994554958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc07014b2a0 0x7fc070158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:31.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.575+0000 7fc078048640 1 --2- 172.21.15.55:0/2994554958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07015b930 0x7fc070157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:31.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.575+0000 7fc078048640 1 --2- 172.21.15.55:0/2994554958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0700ce790 0x7fc07014ad60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:31.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.575+0000 7fc078048640 1 -- 172.21.15.55:0/2994554958 >> 172.21.15.55:0/2994554958 conn(0x7fc0700d0c60 msgr2=0x7fc070165d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:31.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.575+0000 7fc078048640 1 -- 172.21.15.55:0/2994554958 shutdown_connections 2023-07-06T21:54:31.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:31.575+0000 7fc078048640 1 -- 172.21.15.55:0/2994554958 wait complete. 2023-07-06T21:54:31.594 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-07-06T21:54:31.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:31.594 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-07-06T21:54:31.605 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:31.605 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:31.605 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:31.605 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:31.605 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:31.605 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:31.606 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:31.606 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:31.606 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:31.606 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:31.606 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:31.607 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:31.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:31.608 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_44_00_UTC) 2023-07-06T21:54:31.711 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:31.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:31.712 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_45_00_UTC) 2023-07-06T21:54:31.738 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:31.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:31.739 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_46_00_UTC) 2023-07-06T21:54:31.804 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:31.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:31.805 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_47_00_UTC) 2023-07-06T21:54:31.859 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:31.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:31.860 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_48_00_UTC) 2023-07-06T21:54:31.928 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:31.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:31.929 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_49_00_UTC) 2023-07-06T21:54:31.989 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:31.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:31.990 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_50_00_UTC) 2023-07-06T21:54:32.057 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:32.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:32.058 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_51_00_UTC) 2023-07-06T21:54:32.122 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:32.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:32.123 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_52_00_UTC) 2023-07-06T21:54:32.179 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:32.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:32.180 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_53_00_UTC) 2023-07-06T21:54:32.241 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:32.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:32.242 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-06-21_54_00_UTC) 2023-07-06T21:54:32.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:32.300 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-07-06T21:54:32.352 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-07-06T21:54:32.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.539+0000 7f54997d2640 1 Processor -- start 2023-07-06T21:54:32.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.539+0000 7f54997d2640 1 -- start start 2023-07-06T21:54:32.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.539+0000 7f54997d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f549406a460 0x7f54940caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:32.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.539+0000 7f54997d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f549406f960 0x7f549406fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:32.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.539+0000 7f54997d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54940cc650 con 0x7f549406cb40 2023-07-06T21:54:32.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.539+0000 7f54997d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549406bac0 con 0x7f549406f960 2023-07-06T21:54:32.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.539+0000 7f54997d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5494070320 con 0x7f549406a460 2023-07-06T21:54:32.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.539+0000 7f54937fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f549406f960 0x7f549406fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:32.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.539+0000 7f548bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f549406cb40 0x7f54940693f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42114/0 (socket says 172.21.15.55:42114) 2023-07-06T21:54:32.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.539+0000 7f548bfff640 1 -- 172.21.15.55:0/910025155 learned_addr learned my addr 172.21.15.55:0/910025155 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:32.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.539+0000 7f54937fe640 1 --2- 172.21.15.55:0/910025155 >> v2:172.21.15.55:3300/0 conn(0x7f549406f960 0x7f549406fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51422/0 (socket says 172.21.15.55:51422) 2023-07-06T21:54:32.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.543+0000 7f5492ffd640 1 --2- 172.21.15.55:0/910025155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f549406a460 0x7f54940caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:32.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.543+0000 7f54937fe640 1 -- 172.21.15.55:0/910025155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f549406a460 msgr2=0x7f54940caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:32.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.543+0000 7f54937fe640 1 --2- 172.21.15.55:0/910025155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f549406a460 0x7f54940caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:32.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.543+0000 7f54937fe640 1 -- 172.21.15.55:0/910025155 >> v1:172.21.15.55:6789/0 conn(0x7f549406cb40 legacy=0x7f54940693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:32.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.543+0000 7f54937fe640 1 -- 172.21.15.55:0/910025155 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549406d130 con 0x7f549406f960 2023-07-06T21:54:32.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.543+0000 7f54927fc640 1 -- 172.21.15.55:0/910025155 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343121622 0 0) 0x7f54940cc650 con 0x7f549406cb40 2023-07-06T21:54:32.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.543+0000 7f54937fe640 1 --2- 172.21.15.55:0/910025155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549406f960 0x7f549406fde0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f548c009d90 tx=0x7f548c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f34319ddab82f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:32.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.543+0000 7f54927fc640 1 -- 172.21.15.55:0/910025155 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0a5890 con 0x7f549406f960 2023-07-06T21:54:32.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.543+0000 7f54927fc640 1 -- 172.21.15.55:0/910025155 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c0a59f0 con 0x7f549406f960 2023-07-06T21:54:32.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.543+0000 7f54927fc640 1 -- 172.21.15.55:0/910025155 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0a5d80 con 0x7f549406f960 2023-07-06T21:54:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.543+0000 7f54997d2640 1 -- 172.21.15.55:0/910025155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549406f960 msgr2=0x7f549406fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.543+0000 7f54997d2640 1 --2- 172.21.15.55:0/910025155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549406f960 0x7f549406fde0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f548c009d90 tx=0x7f548c01c8c0 comp rx=0 tx=0).stop 2023-07-06T21:54:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54997d2640 1 -- 172.21.15.55:0/910025155 shutdown_connections 2023-07-06T21:54:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54997d2640 1 --2- 172.21.15.55:0/910025155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549406f960 0x7f549406fde0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54997d2640 1 --2- 172.21.15.55:0/910025155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f549406a460 0x7f54940caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54997d2640 1 -- 172.21.15.55:0/910025155 >> 172.21.15.55:0/910025155 conn(0x7f54940ce7f0 msgr2=0x7f54940cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54997d2640 1 -- 172.21.15.55:0/910025155 shutdown_connections 2023-07-06T21:54:32.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54997d2640 1 -- 172.21.15.55:0/910025155 wait complete. 2023-07-06T21:54:32.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54997d2640 1 Processor -- start 2023-07-06T21:54:32.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54997d2640 1 -- start start 2023-07-06T21:54:32.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54997d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549406a460 0x7f5494152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:32.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54997d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f549406cb40 0x7f54941497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:32.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54997d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f549406f960 0x7f5494155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:32.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54997d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5494151000 con 0x7f549406a460 2023-07-06T21:54:32.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54997d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5494157670 con 0x7f549406cb40 2023-07-06T21:54:32.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54997d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5494157930 con 0x7f549406f960 2023-07-06T21:54:32.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f5492ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549406a460 0x7f5494152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:32.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f5492ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549406a460 0x7f5494152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51426/0 (socket says 172.21.15.55:51426) 2023-07-06T21:54:32.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f5492ffd640 1 -- 172.21.15.55:0/4065845470 learned_addr learned my addr 172.21.15.55:0/4065845470 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:32.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f54937fe640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f549406f960 0x7f5494155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:32.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f548bfff640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f549406cb40 0x7f54941497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:32.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f5492ffd640 1 -- 172.21.15.55:0/4065845470 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f549406f960 msgr2=0x7f5494155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:32.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f5492ffd640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f549406f960 0x7f5494155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:32.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f5492ffd640 1 -- 172.21.15.55:0/4065845470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f549406cb40 msgr2=0x7f54941497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:32.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f5492ffd640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f549406cb40 0x7f54941497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f5492ffd640 1 -- 172.21.15.55:0/4065845470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c009a70 con 0x7f549406a460 2023-07-06T21:54:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f548bfff640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f549406cb40 0x7f54941497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.547+0000 7f5492ffd640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549406a460 0x7f5494152ba0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f548400e9b0 tx=0x7f548400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.551+0000 7f548b7fe640 1 -- 172.21.15.55:0/4065845470 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484009670 con 0x7f549406a460 2023-07-06T21:54:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.551+0000 7f548b7fe640 1 -- 172.21.15.55:0/4065845470 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548400c9a0 con 0x7f549406a460 2023-07-06T21:54:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.551+0000 7f54997d2640 1 -- 172.21.15.55:0/4065845470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54941511e0 con 0x7f549406a460 2023-07-06T21:54:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.551+0000 7f548b7fe640 1 -- 172.21.15.55:0/4065845470 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400cd10 con 0x7f549406a460 2023-07-06T21:54:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.551+0000 7f54997d2640 1 -- 172.21.15.55:0/4065845470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54941517a0 con 0x7f549406a460 2023-07-06T21:54:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.551+0000 7f54997d2640 1 -- 172.21.15.55:0/4065845470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5494151960 con 0x7f549406a460 2023-07-06T21:54:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.551+0000 7f548b7fe640 1 -- 172.21.15.55:0/4065845470 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f5484013470 con 0x7f549406a460 2023-07-06T21:54:32.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.551+0000 7f548b7fe640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5474066480 0x7f5474068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:32.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.551+0000 7f548b7fe640 1 -- 172.21.15.55:0/4065845470 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7266+0+0 (secure 0 0 0) 0x7f5484084aa0 con 0x7f549406a460 2023-07-06T21:54:32.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.551+0000 7f548bfff640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5474066480 0x7f5474068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:32.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.551+0000 7f548bfff640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5474066480 0x7f5474068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f547c007fd0 tx=0x7f547c007c20 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:32.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.555+0000 7f548b7fe640 1 -- 172.21.15.55:0/4065845470 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5484051880 con 0x7f549406a460 2023-07-06T21:54:32.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.747+0000 7f54997d2640 1 -- 172.21.15.55:0/4065845470 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f549406a830 con 0x7f5474066480 2023-07-06T21:54:32.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.851+0000 7f548b7fe640 1 -- 172.21.15.55:0/4065845470 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f547c005c90 con 0x7f5474066480 2023-07-06T21:54:32.850 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-07-06T21:54:32.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.851+0000 7f54997d2640 1 -- 172.21.15.55:0/4065845470 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5474066480 msgr2=0x7f5474068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:32.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.851+0000 7f54997d2640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5474066480 0x7f5474068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f547c007fd0 tx=0x7f547c007c20 comp rx=0 tx=0).stop 2023-07-06T21:54:32.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.851+0000 7f54997d2640 1 -- 172.21.15.55:0/4065845470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549406a460 msgr2=0x7f5494152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:32.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.851+0000 7f54997d2640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549406a460 0x7f5494152ba0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f548400e9b0 tx=0x7f548400ee70 comp rx=0 tx=0).stop 2023-07-06T21:54:32.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.851+0000 7f54997d2640 1 -- 172.21.15.55:0/4065845470 shutdown_connections 2023-07-06T21:54:32.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.851+0000 7f54997d2640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f5474066480 0x7f5474068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:32.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.851+0000 7f54997d2640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f549406f960 0x7f5494155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:32.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.851+0000 7f54997d2640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f549406cb40 0x7f54941497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:32.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.851+0000 7f54997d2640 1 --2- 172.21.15.55:0/4065845470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549406a460 0x7f5494152ba0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:32.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.851+0000 7f54997d2640 1 -- 172.21.15.55:0/4065845470 >> 172.21.15.55:0/4065845470 conn(0x7f54940ce7f0 msgr2=0x7f54940ab870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:32.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.851+0000 7f54997d2640 1 -- 172.21.15.55:0/4065845470 shutdown_connections 2023-07-06T21:54:32.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:32.851+0000 7f54997d2640 1 -- 172.21.15.55:0/4065845470 wait complete. 2023-07-06T21:54:32.870 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-07-06T21:54:32.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:32.871 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-07-06T21:54:32.881 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:32.881 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:32.881 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:32.881 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:32.881 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:32.882 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:32.882 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:32.882 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:32.882 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:32.882 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:32.882 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:32.883 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:32.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:32.884 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_44_00_UTC) 2023-07-06T21:54:32.947 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:32.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:32.948 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_45_00_UTC) 2023-07-06T21:54:33.006 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:33.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:33.007 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_46_00_UTC) 2023-07-06T21:54:33.063 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:33.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:33.064 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_47_00_UTC) 2023-07-06T21:54:33.119 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:33.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:33.120 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_48_00_UTC) 2023-07-06T21:54:33.179 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:33.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:33.180 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_49_00_UTC) 2023-07-06T21:54:33.236 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:33.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:33.237 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_50_00_UTC) 2023-07-06T21:54:33.294 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:33.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:33.295 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_51_00_UTC) 2023-07-06T21:54:33.352 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:33.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:33.352 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_52_00_UTC) 2023-07-06T21:54:33.407 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:33.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:33.408 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_53_00_UTC) 2023-07-06T21:54:33.469 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:33.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:33.470 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-06-21_54_00_UTC) 2023-07-06T21:54:33.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:33.528 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-07-06T21:54:33.580 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-07-06T21:54:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.791+0000 7f28a753d640 1 Processor -- start 2023-07-06T21:54:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.791+0000 7f28a753d640 1 -- start start 2023-07-06T21:54:33.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.795+0000 7f28a753d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f28a015fef0 0x7f28a00b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:33.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.795+0000 7f28a753d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28a006fef0 0x7f28a00c9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:33.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.795+0000 7f28a753d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a00c8480 con 0x7f28a00c14c0 2023-07-06T21:54:33.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.795+0000 7f28a753d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a00c8720 con 0x7f28a015fef0 2023-07-06T21:54:33.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.795+0000 7f28a753d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00c8a00 con 0x7f28a006fef0 2023-07-06T21:54:33.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.795+0000 7f28a653b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f28a015fef0 0x7f28a00b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:33.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.795+0000 7f28a6d3c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28a006fef0 0x7f28a00c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:33.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.795+0000 7f28a6d3c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28a006fef0 0x7f28a00c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:32962/0 (socket says 172.21.15.55:32962) 2023-07-06T21:54:33.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.795+0000 7f28a6d3c640 1 -- 172.21.15.55:0/4061217277 learned_addr learned my addr 172.21.15.55:0/4061217277 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:33.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.795+0000 7f28a6d3c640 1 -- 172.21.15.55:0/4061217277 >> v2:172.21.15.138:3300/0 conn(0x7f28a015fef0 msgr2=0x7f28a00b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.795+0000 7f28a6d3c640 1 --2- 172.21.15.55:0/4061217277 >> v2:172.21.15.138:3300/0 conn(0x7f28a015fef0 0x7f28a00b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.795+0000 7f28a6d3c640 1 -- 172.21.15.55:0/4061217277 >> v1:172.21.15.138:6789/0 conn(0x7f28a00c14c0 legacy=0x7f28a006f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.795+0000 7f28a5539640 1 -- 172.21.15.55:0/4061217277 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014451094 0 0) 0x7f28a00c8480 con 0x7f28a00c14c0 2023-07-06T21:54:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.795+0000 7f28a6d3c640 1 -- 172.21.15.55:0/4061217277 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a00c8ce0 con 0x7f28a006fef0 2023-07-06T21:54:33.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.803+0000 7f28a6d3c640 1 --2- 172.21.15.55:0/4061217277 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28a006fef0 0x7f28a00c9200 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2898009870 tx=0x7f289801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a5c291147a936d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:33.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.803+0000 7f28a5539640 1 -- 172.21.15.55:0/4061217277 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a00b19f0 con 0x7f28a006fef0 2023-07-06T21:54:33.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.803+0000 7f28a5539640 1 -- 172.21.15.55:0/4061217277 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28980aa680 con 0x7f28a006fef0 2023-07-06T21:54:33.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.803+0000 7f28a5539640 1 -- 172.21.15.55:0/4061217277 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a00b19f0 con 0x7f28a006fef0 2023-07-06T21:54:33.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.803+0000 7f28a753d640 1 -- 172.21.15.55:0/4061217277 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28a006fef0 msgr2=0x7f28a00c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:33.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.803+0000 7f28a753d640 1 --2- 172.21.15.55:0/4061217277 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28a006fef0 0x7f28a00c9200 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2898009870 tx=0x7f289801c560 comp rx=0 tx=0).stop 2023-07-06T21:54:33.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.803+0000 7f28a753d640 1 -- 172.21.15.55:0/4061217277 shutdown_connections 2023-07-06T21:54:33.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.803+0000 7f28a753d640 1 --2- 172.21.15.55:0/4061217277 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28a006fef0 0x7f28a00c9200 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:33.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.803+0000 7f28a753d640 1 --2- 172.21.15.55:0/4061217277 >> v2:172.21.15.138:3300/0 conn(0x7f28a015fef0 0x7f28a00b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:33.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.803+0000 7f28a753d640 1 -- 172.21.15.55:0/4061217277 >> 172.21.15.55:0/4061217277 conn(0x7f28a00cdd90 msgr2=0x7f28a00ce190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:33.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.803+0000 7f28a753d640 1 -- 172.21.15.55:0/4061217277 shutdown_connections 2023-07-06T21:54:33.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.803+0000 7f28a753d640 1 -- 172.21.15.55:0/4061217277 wait complete. 2023-07-06T21:54:33.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.807+0000 7f28a753d640 1 Processor -- start 2023-07-06T21:54:33.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.807+0000 7f28a753d640 1 -- start start 2023-07-06T21:54:33.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a753d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28a006fef0 0x7f28a015d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:33.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a753d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28a015fef0 0x7f28a01567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:33.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a753d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28a0153300 0x7f28a00c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:33.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a753d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a015dbc0 con 0x7f28a006fef0 2023-07-06T21:54:33.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a753d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a0156d00 con 0x7f28a015fef0 2023-07-06T21:54:33.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a753d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a015dde0 con 0x7f28a0153300 2023-07-06T21:54:33.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a6d3c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28a0153300 0x7f28a00c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:33.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a653b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28a006fef0 0x7f28a015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:33.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a5d3a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28a015fef0 0x7f28a01567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:33.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a6d3c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28a0153300 0x7f28a00c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:32972/0 (socket says 172.21.15.55:32972) 2023-07-06T21:54:33.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a6d3c640 1 -- 172.21.15.55:0/3774289869 learned_addr learned my addr 172.21.15.55:0/3774289869 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:33.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a6d3c640 1 -- 172.21.15.55:0/3774289869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28a015fef0 msgr2=0x7f28a01567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:33.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a6d3c640 1 --2- 172.21.15.55:0/3774289869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28a015fef0 0x7f28a01567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:33.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a6d3c640 1 -- 172.21.15.55:0/3774289869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28a006fef0 msgr2=0x7f28a015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:33.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a6d3c640 1 --2- 172.21.15.55:0/3774289869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28a006fef0 0x7f28a015d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:33.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a6d3c640 1 -- 172.21.15.55:0/3774289869 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28980094d0 con 0x7f28a0153300 2023-07-06T21:54:33.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.811+0000 7f28a6d3c640 1 --2- 172.21.15.55:0/3774289869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28a0153300 0x7f28a00c71c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f289801ce00 tx=0x7f289801ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:33.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.815+0000 7f289effd640 1 -- 172.21.15.55:0/3774289869 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a00b19f0 con 0x7f28a0153300 2023-07-06T21:54:33.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.815+0000 7f289effd640 1 -- 172.21.15.55:0/3774289869 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28980b7070 con 0x7f28a0153300 2023-07-06T21:54:33.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.815+0000 7f289effd640 1 -- 172.21.15.55:0/3774289869 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898004270 con 0x7f28a0153300 2023-07-06T21:54:33.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.815+0000 7f28a753d640 1 -- 172.21.15.55:0/3774289869 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a015e0c0 con 0x7f28a0153300 2023-07-06T21:54:33.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.815+0000 7f28a753d640 1 -- 172.21.15.55:0/3774289869 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a015e680 con 0x7f28a0153300 2023-07-06T21:54:33.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.819+0000 7f289effd640 1 -- 172.21.15.55:0/3774289869 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f28980043d0 con 0x7f28a0153300 2023-07-06T21:54:33.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.819+0000 7f28a753d640 1 -- 172.21.15.55:0/3774289869 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a01516c0 con 0x7f28a0153300 2023-07-06T21:54:33.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.819+0000 7f289effd640 1 --2- 172.21.15.55:0/3774289869 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f28840664d0 0x7f2884068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:33.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.819+0000 7f289effd640 1 -- 172.21.15.55:0/3774289869 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7410+0+0 (secure 0 0 0) 0x7f289811eb20 con 0x7f28a0153300 2023-07-06T21:54:33.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.823+0000 7f28a653b640 1 --2- 172.21.15.55:0/3774289869 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f28840664d0 0x7f2884068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:33.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.823+0000 7f28a653b640 1 --2- 172.21.15.55:0/3774289869 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f28840664d0 0x7f2884068980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2894003fd0 tx=0x7f28940039a0 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:33.827+0000 7f289effd640 1 -- 172.21.15.55:0/3774289869 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28a01516c0 con 0x7f28a0153300 2023-07-06T21:54:34.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:34.051+0000 7f28a753d640 1 -- 172.21.15.55:0/3774289869 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f28a01516c0 con 0x7f28840664d0 2023-07-06T21:54:34.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:34.123+0000 7f289effd640 1 -- 172.21.15.55:0/3774289869 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f28a01516c0 con 0x7f28840664d0 2023-07-06T21:54:34.125 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-07-06T21:54:34.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:34.127+0000 7f28a753d640 1 -- 172.21.15.55:0/3774289869 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f28840664d0 msgr2=0x7f2884068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:34.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:34.127+0000 7f28a753d640 1 --2- 172.21.15.55:0/3774289869 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f28840664d0 0x7f2884068980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2894003fd0 tx=0x7f28940039a0 comp rx=0 tx=0).stop 2023-07-06T21:54:34.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:34.127+0000 7f28a753d640 1 -- 172.21.15.55:0/3774289869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28a0153300 msgr2=0x7f28a00c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:34.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:34.127+0000 7f28a753d640 1 --2- 172.21.15.55:0/3774289869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28a0153300 0x7f28a00c71c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f289801ce00 tx=0x7f289801ada0 comp rx=0 tx=0).stop 2023-07-06T21:54:34.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:34.127+0000 7f28a753d640 1 -- 172.21.15.55:0/3774289869 shutdown_connections 2023-07-06T21:54:34.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:34.127+0000 7f28a753d640 1 --2- 172.21.15.55:0/3774289869 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f28840664d0 0x7f2884068980 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:34.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:34.127+0000 7f28a753d640 1 --2- 172.21.15.55:0/3774289869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28a0153300 0x7f28a00c71c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:34.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:34.127+0000 7f28a753d640 1 --2- 172.21.15.55:0/3774289869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28a015fef0 0x7f28a01567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:34.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:34.127+0000 7f28a753d640 1 --2- 172.21.15.55:0/3774289869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28a006fef0 0x7f28a015d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:34.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:34.127+0000 7f28a753d640 1 -- 172.21.15.55:0/3774289869 >> 172.21.15.55:0/3774289869 conn(0x7f28a00cdd90 msgr2=0x7f28a00ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:34.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:34.127+0000 7f28a753d640 1 -- 172.21.15.55:0/3774289869 shutdown_connections 2023-07-06T21:54:34.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:34.127+0000 7f28a753d640 1 -- 172.21.15.55:0/3774289869 wait complete. 2023-07-06T21:54:34.146 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-07-06T21:54:34.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:34.147 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-07-06T21:54:34.157 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:34.157 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:34.157 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:34.158 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:34.158 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:34.158 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:34.158 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:34.158 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:34.158 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:34.158 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:34.159 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:34.159 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:34.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:34.160 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_44_00_UTC) 2023-07-06T21:54:34.248 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:34.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:34.249 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_45_00_UTC) 2023-07-06T21:54:34.304 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:34.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:34.305 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_46_00_UTC) 2023-07-06T21:54:34.360 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:34.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:34.360 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_47_00_UTC) 2023-07-06T21:54:34.416 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:34.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:34.416 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_48_00_UTC) 2023-07-06T21:54:34.471 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:34.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:34.472 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_49_00_UTC) 2023-07-06T21:54:34.533 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:34.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:34.533 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_50_00_UTC) 2023-07-06T21:54:34.592 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:34.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:34.593 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_51_00_UTC) 2023-07-06T21:54:34.656 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:34.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:34.657 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_52_00_UTC) 2023-07-06T21:54:34.751 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:34.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:34.752 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_53_00_UTC) 2023-07-06T21:54:34.773 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:34.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:34.773 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-06-21_54_00_UTC) 2023-07-06T21:54:34.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:34.839 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-07-06T21:54:34.903 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-07-06T21:54:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.091+0000 7f02d3af9640 1 Processor -- start 2023-07-06T21:54:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.091+0000 7f02d3af9640 1 -- start start 2023-07-06T21:54:35.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.091+0000 7f02d3af9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02cc0c89b0 0x7f02cc0c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:35.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.091+0000 7f02d3af9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02cc158b50 con 0x7f02cc158780 2023-07-06T21:54:35.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.091+0000 7f02d3af9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02cc0c9350 con 0x7f02cc0cbfa0 2023-07-06T21:54:35.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.091+0000 7f02d3af9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02cc06fb00 con 0x7f02cc0c89b0 2023-07-06T21:54:35.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.091+0000 7f02d1895640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f02cc158780 0x7f02cc0cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43940/0 (socket says 172.21.15.55:43940) 2023-07-06T21:54:35.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.091+0000 7f02d1895640 1 -- 172.21.15.55:0/1757520874 learned_addr learned my addr 172.21.15.55:0/1757520874 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:35.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.091+0000 7f02d2096640 1 --2- 172.21.15.55:0/1757520874 >> v2:172.21.15.55:3300/0 conn(0x7f02cc0c89b0 0x7f02cc0c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.091+0000 7f02d0893640 1 -- 172.21.15.55:0/1757520874 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473939014 0 0) 0x7f02cc158b50 con 0x7f02cc158780 2023-07-06T21:54:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.091+0000 7f02d0893640 1 -- 172.21.15.55:0/1757520874 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02b8003530 con 0x7f02cc158780 2023-07-06T21:54:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.095+0000 7f02d2096640 1 -- 172.21.15.55:0/1757520874 >> v1:172.21.15.138:6789/0 conn(0x7f02cc0cbfa0 legacy=0x7f02cc06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.095+0000 7f02d2096640 1 -- 172.21.15.55:0/1757520874 >> v1:172.21.15.55:6789/0 conn(0x7f02cc158780 legacy=0x7f02cc0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.095+0000 7f02d2096640 1 -- 172.21.15.55:0/1757520874 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc06b390 con 0x7f02cc0c89b0 2023-07-06T21:54:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.095+0000 7f02d2096640 1 --2- 172.21.15.55:0/1757520874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0c89b0 0x7f02cc0c8e10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009d90 tx=0x7f02c401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cc928b24222821 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.095+0000 7f02d0893640 1 -- 172.21.15.55:0/1757520874 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40a5870 con 0x7f02cc0c89b0 2023-07-06T21:54:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.095+0000 7f02d0893640 1 -- 172.21.15.55:0/1757520874 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c40a59d0 con 0x7f02cc0c89b0 2023-07-06T21:54:35.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.095+0000 7f02d0893640 1 -- 172.21.15.55:0/1757520874 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40a5d60 con 0x7f02cc0c89b0 2023-07-06T21:54:35.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.095+0000 7f02d3af9640 1 -- 172.21.15.55:0/1757520874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0c89b0 msgr2=0x7f02cc0c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:35.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.095+0000 7f02d3af9640 1 --2- 172.21.15.55:0/1757520874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0c89b0 0x7f02cc0c8e10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009d90 tx=0x7f02c401c8c0 comp rx=0 tx=0).stop 2023-07-06T21:54:35.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.095+0000 7f02d3af9640 1 -- 172.21.15.55:0/1757520874 shutdown_connections 2023-07-06T21:54:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.095+0000 7f02d3af9640 1 --2- 172.21.15.55:0/1757520874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0c89b0 0x7f02cc0c8e10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.095+0000 7f02d3af9640 1 -- 172.21.15.55:0/1757520874 >> 172.21.15.55:0/1757520874 conn(0x7f02cc0cde30 msgr2=0x7f02cc0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.095+0000 7f02d3af9640 1 -- 172.21.15.55:0/1757520874 shutdown_connections 2023-07-06T21:54:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.095+0000 7f02d3af9640 1 -- 172.21.15.55:0/1757520874 wait complete. 2023-07-06T21:54:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d3af9640 1 Processor -- start 2023-07-06T21:54:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d3af9640 1 -- start start 2023-07-06T21:54:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d3af9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0c89b0 0x7f02cc158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d3af9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02cc0cbfa0 0x7f02cc1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d3af9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02cc158780 0x7f02cc154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d3af9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc14f260 con 0x7f02cc0c89b0 2023-07-06T21:54:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d3af9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc157f00 con 0x7f02cc158780 2023-07-06T21:54:35.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d3af9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc14ea50 con 0x7f02cc0cbfa0 2023-07-06T21:54:35.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d1895640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0c89b0 0x7f02cc158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:35.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d1895640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0c89b0 0x7f02cc158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59060/0 (socket says 172.21.15.55:59060) 2023-07-06T21:54:35.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d1895640 1 -- 172.21.15.55:0/1566878080 learned_addr learned my addr 172.21.15.55:0/1566878080 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:35.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d1094640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02cc0cbfa0 0x7f02cc1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:35.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d2096640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02cc158780 0x7f02cc154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:35.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d1895640 1 -- 172.21.15.55:0/1566878080 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02cc0cbfa0 msgr2=0x7f02cc1579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:35.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d1895640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02cc0cbfa0 0x7f02cc1579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:35.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d1895640 1 -- 172.21.15.55:0/1566878080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02cc158780 msgr2=0x7f02cc154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d1895640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02cc158780 0x7f02cc154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d1895640 1 -- 172.21.15.55:0/1566878080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c4009a70 con 0x7f02cc0c89b0 2023-07-06T21:54:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d1094640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02cc0cbfa0 0x7f02cc1579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d1895640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0c89b0 0x7f02cc158ce0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f02c800c450 tx=0x7f02c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02c27fc640 1 -- 172.21.15.55:0/1566878080 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c8005cf0 con 0x7f02cc0c89b0 2023-07-06T21:54:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02c27fc640 1 -- 172.21.15.55:0/1566878080 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c8005e50 con 0x7f02cc0c89b0 2023-07-06T21:54:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02c27fc640 1 -- 172.21.15.55:0/1566878080 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c8007270 con 0x7f02cc0c89b0 2023-07-06T21:54:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.099+0000 7f02d3af9640 1 -- 172.21.15.55:0/1566878080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02cc14eca0 con 0x7f02cc0c89b0 2023-07-06T21:54:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.103+0000 7f02d3af9640 1 -- 172.21.15.55:0/1566878080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02cc15b2f0 con 0x7f02cc0c89b0 2023-07-06T21:54:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.103+0000 7f02d3af9640 1 -- 172.21.15.55:0/1566878080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02cc15b150 con 0x7f02cc0c89b0 2023-07-06T21:54:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.103+0000 7f02c27fc640 1 -- 172.21.15.55:0/1566878080 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f02c80073d0 con 0x7f02cc0c89b0 2023-07-06T21:54:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.103+0000 7f02c27fc640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f02b0066480 0x7f02b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.103+0000 7f02c27fc640 1 -- 172.21.15.55:0/1566878080 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7554+0+0 (secure 0 0 0) 0x7f02c8083ac0 con 0x7f02cc0c89b0 2023-07-06T21:54:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.103+0000 7f02d1094640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f02b0066480 0x7f02b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.103+0000 7f02d1094640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f02b0066480 0x7f02b0068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0ce4e0 tx=0x7f02bc009040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.107+0000 7f02c27fc640 1 -- 172.21.15.55:0/1566878080 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02cc15b150 con 0x7f02cc0c89b0 2023-07-06T21:54:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.283+0000 7f02d3af9640 1 -- 172.21.15.55:0/1566878080 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f02cc0cd6a0 con 0x7f02b0066480 2023-07-06T21:54:35.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.367+0000 7f02c27fc640 1 -- 172.21.15.55:0/1566878080 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f02bc0013f0 con 0x7f02b0066480 2023-07-06T21:54:35.368 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-07-06T21:54:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.371+0000 7f02d3af9640 1 -- 172.21.15.55:0/1566878080 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f02b0066480 msgr2=0x7f02b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.371+0000 7f02d3af9640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f02b0066480 0x7f02b0068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0ce4e0 tx=0x7f02bc009040 comp rx=0 tx=0).stop 2023-07-06T21:54:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.371+0000 7f02d3af9640 1 -- 172.21.15.55:0/1566878080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0c89b0 msgr2=0x7f02cc158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.371+0000 7f02d3af9640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0c89b0 0x7f02cc158ce0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f02c800c450 tx=0x7f02c800c910 comp rx=0 tx=0).stop 2023-07-06T21:54:35.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.371+0000 7f02d3af9640 1 -- 172.21.15.55:0/1566878080 shutdown_connections 2023-07-06T21:54:35.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.371+0000 7f02d3af9640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f02b0066480 0x7f02b0068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:35.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.371+0000 7f02d3af9640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02cc158780 0x7f02cc154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:35.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.371+0000 7f02d3af9640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02cc0cbfa0 0x7f02cc1579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:35.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.371+0000 7f02d3af9640 1 --2- 172.21.15.55:0/1566878080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0c89b0 0x7f02cc158ce0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:35.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.371+0000 7f02d3af9640 1 -- 172.21.15.55:0/1566878080 >> 172.21.15.55:0/1566878080 conn(0x7f02cc0cde30 msgr2=0x7f02cc0abec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:35.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.371+0000 7f02d3af9640 1 -- 172.21.15.55:0/1566878080 shutdown_connections 2023-07-06T21:54:35.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:35.371+0000 7f02d3af9640 1 -- 172.21.15.55:0/1566878080 wait complete. 2023-07-06T21:54:35.388 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-07-06T21:54:35.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:35.389 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-07-06T21:54:35.399 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:35.399 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:35.399 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:35.400 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:35.400 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:35.400 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:35.400 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:35.400 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:35.400 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:35.400 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:35.401 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:35.401 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:35.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:35.402 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_44_00_UTC) 2023-07-06T21:54:35.465 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:35.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:35.466 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_45_00_UTC) 2023-07-06T21:54:35.532 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:35.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:35.533 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_46_00_UTC) 2023-07-06T21:54:35.589 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:35.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:35.590 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_47_00_UTC) 2023-07-06T21:54:35.648 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:35.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:35.649 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_48_00_UTC) 2023-07-06T21:54:35.708 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:35.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:35.709 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_49_00_UTC) 2023-07-06T21:54:35.764 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:35.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:35.766 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_50_00_UTC) 2023-07-06T21:54:35.822 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:35.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:35.824 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_51_00_UTC) 2023-07-06T21:54:35.884 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:35.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:35.885 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_52_00_UTC) 2023-07-06T21:54:35.952 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:35.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:35.953 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_53_00_UTC) 2023-07-06T21:54:36.014 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:36.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:36.015 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-06-21_54_00_UTC) 2023-07-06T21:54:36.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:36.081 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-07-06T21:54:36.140 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-07-06T21:54:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.327+0000 7fa319c19640 1 Processor -- start 2023-07-06T21:54:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.327+0000 7fa319c19640 1 -- start start 2023-07-06T21:54:36.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa319c19640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa314158780 0x7fa3140cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:36.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa319c19640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3140cbfa0 0x7fa31406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:36.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa319c19640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa314158b50 con 0x7fa3140c89b0 2023-07-06T21:54:36.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa319c19640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa31406b390 con 0x7fa314158780 2023-07-06T21:54:36.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa319c19640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140cd3d0 con 0x7fa3140cbfa0 2023-07-06T21:54:36.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa3137fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa314158780 0x7fa3140cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:36.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa3137fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa314158780 0x7fa3140cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59062/0 (socket says 172.21.15.55:59062) 2023-07-06T21:54:36.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa3137fe640 1 -- 172.21.15.55:0/800067567 learned_addr learned my addr 172.21.15.55:0/800067567 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:36.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa312ffd640 1 --2- 172.21.15.55:0/800067567 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3140cbfa0 0x7fa31406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:36.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa3137fe640 1 -- 172.21.15.55:0/800067567 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3140cbfa0 msgr2=0x7fa31406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:36.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa3137fe640 1 --2- 172.21.15.55:0/800067567 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3140cbfa0 0x7fa31406f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:36.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa3137fe640 1 -- 172.21.15.55:0/800067567 >> v1:172.21.15.138:6789/0 conn(0x7fa3140c89b0 legacy=0x7fa31406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:36.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa3137fe640 1 -- 172.21.15.55:0/800067567 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31406b630 con 0x7fa314158780 2023-07-06T21:54:36.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa312ffd640 1 --2- 172.21.15.55:0/800067567 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3140cbfa0 0x7fa31406f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:54:36.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.331+0000 7fa3137fe640 1 --2- 172.21.15.55:0/800067567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa314158780 0x7fa3140cce90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa304009870 tx=0x7fa30401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd6bceb2ebfdf41 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:36.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa3127fc640 1 -- 172.21.15.55:0/800067567 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3040ab600 con 0x7fa314158780 2023-07-06T21:54:36.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa3127fc640 1 -- 172.21.15.55:0/800067567 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3040a7050 con 0x7fa314158780 2023-07-06T21:54:36.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa3127fc640 1 -- 172.21.15.55:0/800067567 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3040ab980 con 0x7fa314158780 2023-07-06T21:54:36.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 -- 172.21.15.55:0/800067567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa314158780 msgr2=0x7fa3140cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:36.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 --2- 172.21.15.55:0/800067567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa314158780 0x7fa3140cce90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa304009870 tx=0x7fa30401c470 comp rx=0 tx=0).stop 2023-07-06T21:54:36.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 -- 172.21.15.55:0/800067567 shutdown_connections 2023-07-06T21:54:36.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 --2- 172.21.15.55:0/800067567 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3140cbfa0 0x7fa31406f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:36.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 --2- 172.21.15.55:0/800067567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa314158780 0x7fa3140cce90 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:36.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 -- 172.21.15.55:0/800067567 >> 172.21.15.55:0/800067567 conn(0x7fa3140cde30 msgr2=0x7fa3140ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:36.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 -- 172.21.15.55:0/800067567 shutdown_connections 2023-07-06T21:54:36.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 -- 172.21.15.55:0/800067567 wait complete. 2023-07-06T21:54:36.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 Processor -- start 2023-07-06T21:54:36.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 -- start start 2023-07-06T21:54:36.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3140c89b0 0x7fa314147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:36.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3140cbfa0 0x7fa314153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:36.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa314158780 0x7fa314153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:36.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31414f9c0 con 0x7fa3140cbfa0 2023-07-06T21:54:36.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3141479b0 con 0x7fa314158780 2023-07-06T21:54:36.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.335+0000 7fa319c19640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140c62c0 con 0x7fa3140c89b0 2023-07-06T21:54:36.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa312ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3140cbfa0 0x7fa314153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:36.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa312ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3140cbfa0 0x7fa314153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59066/0 (socket says 172.21.15.55:59066) 2023-07-06T21:54:36.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa312ffd640 1 -- 172.21.15.55:0/1891714852 learned_addr learned my addr 172.21.15.55:0/1891714852 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:36.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa3137fe640 1 --2- 172.21.15.55:0/1891714852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3140c89b0 0x7fa314147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:36.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa313fff640 1 --2- 172.21.15.55:0/1891714852 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa314158780 0x7fa314153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:36.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa312ffd640 1 -- 172.21.15.55:0/1891714852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3140c89b0 msgr2=0x7fa314147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:36.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa312ffd640 1 --2- 172.21.15.55:0/1891714852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3140c89b0 0x7fa314147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:36.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa312ffd640 1 -- 172.21.15.55:0/1891714852 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa314158780 msgr2=0x7fa314153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:36.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa312ffd640 1 --2- 172.21.15.55:0/1891714852 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa314158780 0x7fa314153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:36.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa312ffd640 1 -- 172.21.15.55:0/1891714852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3040094d0 con 0x7fa3140cbfa0 2023-07-06T21:54:36.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa312ffd640 1 --2- 172.21.15.55:0/1891714852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3140cbfa0 0x7fa314153030 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa30800c7c0 tx=0x7fa30800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:36.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa2fbfff640 1 -- 172.21.15.55:0/1891714852 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308007a30 con 0x7fa3140cbfa0 2023-07-06T21:54:36.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa2fbfff640 1 -- 172.21.15.55:0/1891714852 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa308007b90 con 0x7fa3140cbfa0 2023-07-06T21:54:36.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa319c19640 1 -- 172.21.15.55:0/1891714852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3140c65a0 con 0x7fa3140cbfa0 2023-07-06T21:54:36.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa2fbfff640 1 -- 172.21.15.55:0/1891714852 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30800ce70 con 0x7fa3140cbfa0 2023-07-06T21:54:36.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa319c19640 1 -- 172.21.15.55:0/1891714852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3140c6b60 con 0x7fa3140cbfa0 2023-07-06T21:54:36.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa319c19640 1 -- 172.21.15.55:0/1891714852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3140c6d80 con 0x7fa3140cbfa0 2023-07-06T21:54:36.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.339+0000 7fa2fbfff640 1 -- 172.21.15.55:0/1891714852 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fa3080113f0 con 0x7fa3140cbfa0 2023-07-06T21:54:36.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.343+0000 7fa2fbfff640 1 --2- 172.21.15.55:0/1891714852 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa300066480 0x7fa300068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:36.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.343+0000 7fa2fbfff640 1 -- 172.21.15.55:0/1891714852 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7618+0+0 (secure 0 0 0) 0x7fa308084b60 con 0x7fa3140cbfa0 2023-07-06T21:54:36.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.343+0000 7fa3137fe640 1 --2- 172.21.15.55:0/1891714852 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa300066480 0x7fa300068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:36.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.343+0000 7fa3137fe640 1 --2- 172.21.15.55:0/1891714852 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa300066480 0x7fa300068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa3040ad000 tx=0x7fa3040a6000 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:36.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.347+0000 7fa2fbfff640 1 -- 172.21.15.55:0/1891714852 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa308051780 con 0x7fa3140cbfa0 2023-07-06T21:54:36.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.523+0000 7fa319c19640 1 -- 172.21.15.55:0/1891714852 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3140c9240 con 0x7fa300066480 2023-07-06T21:54:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.623+0000 7fa2fbfff640 1 -- 172.21.15.55:0/1891714852 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fa3040ab780 con 0x7fa300066480 2023-07-06T21:54:36.622 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-07-06T21:54:36.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.623+0000 7fa319c19640 1 -- 172.21.15.55:0/1891714852 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa300066480 msgr2=0x7fa300068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:36.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.623+0000 7fa319c19640 1 --2- 172.21.15.55:0/1891714852 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa300066480 0x7fa300068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa3040ad000 tx=0x7fa3040a6000 comp rx=0 tx=0).stop 2023-07-06T21:54:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.623+0000 7fa319c19640 1 -- 172.21.15.55:0/1891714852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3140cbfa0 msgr2=0x7fa314153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.623+0000 7fa319c19640 1 --2- 172.21.15.55:0/1891714852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3140cbfa0 0x7fa314153030 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa30800c7c0 tx=0x7fa30800cc80 comp rx=0 tx=0).stop 2023-07-06T21:54:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.623+0000 7fa319c19640 1 -- 172.21.15.55:0/1891714852 shutdown_connections 2023-07-06T21:54:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.623+0000 7fa319c19640 1 --2- 172.21.15.55:0/1891714852 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fa300066480 0x7fa300068930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.623+0000 7fa319c19640 1 --2- 172.21.15.55:0/1891714852 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa314158780 0x7fa314153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.623+0000 7fa319c19640 1 --2- 172.21.15.55:0/1891714852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3140cbfa0 0x7fa314153030 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.623+0000 7fa319c19640 1 --2- 172.21.15.55:0/1891714852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3140c89b0 0x7fa314147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.623+0000 7fa319c19640 1 -- 172.21.15.55:0/1891714852 >> 172.21.15.55:0/1891714852 conn(0x7fa3140cde30 msgr2=0x7fa31406fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:36.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.623+0000 7fa319c19640 1 -- 172.21.15.55:0/1891714852 shutdown_connections 2023-07-06T21:54:36.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:36.623+0000 7fa319c19640 1 -- 172.21.15.55:0/1891714852 wait complete. 2023-07-06T21:54:36.643 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-07-06T21:54:36.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:36.643 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-07-06T21:54:36.654 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:36.655 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:36.655 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:36.655 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:36.655 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:36.655 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:36.655 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:36.656 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:36.656 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:36.656 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:36.656 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:36.657 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:36.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:36.657 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_44_00_UTC) 2023-07-06T21:54:36.701 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:54:36.710 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:54:36.741 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:36.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:36.742 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_45_00_UTC) 2023-07-06T21:54:36.826 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:36.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:36.827 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_46_00_UTC) 2023-07-06T21:54:36.900 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:36.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:36.901 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_47_00_UTC) 2023-07-06T21:54:36.959 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:36.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:36.960 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_48_00_UTC) 2023-07-06T21:54:37.015 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:37.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:37.016 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_49_00_UTC) 2023-07-06T21:54:37.070 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:37.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:37.071 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_50_00_UTC) 2023-07-06T21:54:37.131 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:37.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:37.132 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_51_00_UTC) 2023-07-06T21:54:37.187 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:37.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:37.188 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_52_00_UTC) 2023-07-06T21:54:37.243 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:37.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:37.244 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_53_00_UTC) 2023-07-06T21:54:37.300 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:37.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:37.301 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-06-21_54_00_UTC) 2023-07-06T21:54:37.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:37.362 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-07-06T21:54:37.420 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-07-06T21:54:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.607+0000 7f092ab40640 1 Processor -- start 2023-07-06T21:54:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.607+0000 7f092ab40640 1 -- start start 2023-07-06T21:54:37.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.607+0000 7f092ab40640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f09240c9b90 0x7f092415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:37.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.607+0000 7f092ab40640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09240693f0 0x7f0924069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.607+0000 7f092ab40640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09240b3e70 con 0x7f09240ccb70 2023-07-06T21:54:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.607+0000 7f092ab40640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0924159c30 con 0x7f09240c9b90 2023-07-06T21:54:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.607+0000 7f092ab40640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09240c9070 con 0x7f09240693f0 2023-07-06T21:54:37.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.607+0000 7f0923fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f09240ccb70 0x7f09240c9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43942/0 (socket says 172.21.15.55:43942) 2023-07-06T21:54:37.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.611+0000 7f09290dd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09240693f0 0x7f0924069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:37.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.611+0000 7f0923fff640 1 -- 172.21.15.55:0/2411461040 learned_addr learned my addr 172.21.15.55:0/2411461040 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:37.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.611+0000 7f09288dc640 1 --2- 172.21.15.55:0/2411461040 >> v2:172.21.15.138:3300/0 conn(0x7f09240c9b90 0x7f092415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:37.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.611+0000 7f09237fe640 1 -- 172.21.15.55:0/2411461040 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078235298 0 0) 0x7f0910001120 con 0x7f09240ccb70 2023-07-06T21:54:37.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.611+0000 7f09237fe640 1 -- 172.21.15.55:0/2411461040 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0914003530 con 0x7f09240ccb70 2023-07-06T21:54:37.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.611+0000 7f09288dc640 1 -- 172.21.15.55:0/2411461040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09240693f0 msgr2=0x7f0924069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:37.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.611+0000 7f09288dc640 1 --2- 172.21.15.55:0/2411461040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09240693f0 0x7f0924069850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:37.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.611+0000 7f09288dc640 1 -- 172.21.15.55:0/2411461040 >> v1:172.21.15.55:6789/0 conn(0x7f09240ccb70 legacy=0x7f09240c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:37.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.611+0000 7f09288dc640 1 -- 172.21.15.55:0/2411461040 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09240c8480 con 0x7f09240c9b90 2023-07-06T21:54:37.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.611+0000 7f09288dc640 1 --2- 172.21.15.55:0/2411461040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09240c9b90 0x7f092415dd50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f09180097c0 tx=0x7f091801c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4aac2f8fb2583ab server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:37.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f09237fe640 1 -- 172.21.15.55:0/2411461040 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0918004230 con 0x7f09240c9b90 2023-07-06T21:54:37.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f09237fe640 1 -- 172.21.15.55:0/2411461040 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09180a7050 con 0x7f09240c9b90 2023-07-06T21:54:37.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f09237fe640 1 -- 172.21.15.55:0/2411461040 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0918003620 con 0x7f09240c9b90 2023-07-06T21:54:37.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 -- 172.21.15.55:0/2411461040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09240c9b90 msgr2=0x7f092415dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:37.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 --2- 172.21.15.55:0/2411461040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09240c9b90 0x7f092415dd50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f09180097c0 tx=0x7f091801c440 comp rx=0 tx=0).stop 2023-07-06T21:54:37.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 -- 172.21.15.55:0/2411461040 shutdown_connections 2023-07-06T21:54:37.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 --2- 172.21.15.55:0/2411461040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09240693f0 0x7f0924069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:37.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 --2- 172.21.15.55:0/2411461040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09240c9b90 0x7f092415dd50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:37.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 -- 172.21.15.55:0/2411461040 >> 172.21.15.55:0/2411461040 conn(0x7f09240cde30 msgr2=0x7f09240ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:37.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 -- 172.21.15.55:0/2411461040 shutdown_connections 2023-07-06T21:54:37.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 -- 172.21.15.55:0/2411461040 wait complete. 2023-07-06T21:54:37.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 Processor -- start 2023-07-06T21:54:37.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 -- start start 2023-07-06T21:54:37.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09240693f0 0x7f0924150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:37.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09240c9b90 0x7f092406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:37.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09240ccb70 0x7f092406c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:37.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09240c14a0 con 0x7f09240ccb70 2023-07-06T21:54:37.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0924151780 con 0x7f09240693f0 2023-07-06T21:54:37.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.615+0000 7f092ab40640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0924151a60 con 0x7f09240c9b90 2023-07-06T21:54:37.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09290dd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09240ccb70 0x7f092406c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:37.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09290dd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09240ccb70 0x7f092406c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59078/0 (socket says 172.21.15.55:59078) 2023-07-06T21:54:37.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09290dd640 1 -- 172.21.15.55:0/3294061016 learned_addr learned my addr 172.21.15.55:0/3294061016 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:37.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09288dc640 1 --2- 172.21.15.55:0/3294061016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09240693f0 0x7f0924150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:37.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09290dd640 1 -- 172.21.15.55:0/3294061016 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09240c9b90 msgr2=0x7f092406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:37.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09290dd640 1 --2- 172.21.15.55:0/3294061016 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09240c9b90 0x7f092406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:37.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09290dd640 1 -- 172.21.15.55:0/3294061016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09240693f0 msgr2=0x7f0924150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09290dd640 1 --2- 172.21.15.55:0/3294061016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09240693f0 0x7f0924150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09290dd640 1 -- 172.21.15.55:0/3294061016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0918009420 con 0x7f09240ccb70 2023-07-06T21:54:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09290dd640 1 --2- 172.21.15.55:0/3294061016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09240ccb70 0x7f092406c1b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f091c00efc0 tx=0x7f091c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09217fa640 1 -- 172.21.15.55:0/3294061016 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c009ba0 con 0x7f09240ccb70 2023-07-06T21:54:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09217fa640 1 -- 172.21.15.55:0/3294061016 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c00f040 con 0x7f09240ccb70 2023-07-06T21:54:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f092ab40640 1 -- 172.21.15.55:0/3294061016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0924151d40 con 0x7f09240ccb70 2023-07-06T21:54:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09217fa640 1 -- 172.21.15.55:0/3294061016 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0146c0 con 0x7f09240ccb70 2023-07-06T21:54:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f092ab40640 1 -- 172.21.15.55:0/3294061016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0924152300 con 0x7f09240ccb70 2023-07-06T21:54:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f092ab40640 1 -- 172.21.15.55:0/3294061016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0924152520 con 0x7f09240ccb70 2023-07-06T21:54:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09217fa640 1 -- 172.21.15.55:0/3294061016 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f091c014820 con 0x7f09240ccb70 2023-07-06T21:54:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.619+0000 7f09217fa640 1 --2- 172.21.15.55:0/3294061016 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f0908066480 0x7f0908068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.623+0000 7f09217fa640 1 -- 172.21.15.55:0/3294061016 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 7634+0+0 (secure 0 0 0) 0x7f091c0855a0 con 0x7f09240ccb70 2023-07-06T21:54:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.623+0000 7f09288dc640 1 --2- 172.21.15.55:0/3294061016 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f0908066480 0x7f0908068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.623+0000 7f09288dc640 1 --2- 172.21.15.55:0/3294061016 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f0908066480 0x7f0908068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f09180ad000 tx=0x7f09180a6000 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:37.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.623+0000 7f09217fa640 1 -- 172.21.15.55:0/3294061016 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f091c052050 con 0x7f09240ccb70 2023-07-06T21:54:37.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.823+0000 7f092ab40640 1 -- 172.21.15.55:0/3294061016 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0924151bd0 con 0x7f0908066480 2023-07-06T21:54:37.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.911+0000 7f09217fa640 1 -- 172.21.15.55:0/3294061016 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f0924151bd0 con 0x7f0908066480 2023-07-06T21:54:37.911 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-07-06T21:54:37.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.911+0000 7f092ab40640 1 -- 172.21.15.55:0/3294061016 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f0908066480 msgr2=0x7f0908068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:37.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.911+0000 7f092ab40640 1 --2- 172.21.15.55:0/3294061016 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f0908066480 0x7f0908068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f09180ad000 tx=0x7f09180a6000 comp rx=0 tx=0).stop 2023-07-06T21:54:37.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.911+0000 7f092ab40640 1 -- 172.21.15.55:0/3294061016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09240ccb70 msgr2=0x7f092406c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:37.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.911+0000 7f092ab40640 1 --2- 172.21.15.55:0/3294061016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09240ccb70 0x7f092406c1b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f091c00efc0 tx=0x7f091c00c490 comp rx=0 tx=0).stop 2023-07-06T21:54:37.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.915+0000 7f092ab40640 1 -- 172.21.15.55:0/3294061016 shutdown_connections 2023-07-06T21:54:37.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.915+0000 7f092ab40640 1 --2- 172.21.15.55:0/3294061016 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f0908066480 0x7f0908068930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:37.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.915+0000 7f092ab40640 1 --2- 172.21.15.55:0/3294061016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09240ccb70 0x7f092406c1b0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:37.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.915+0000 7f092ab40640 1 --2- 172.21.15.55:0/3294061016 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09240c9b90 0x7f092406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:37.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.915+0000 7f092ab40640 1 --2- 172.21.15.55:0/3294061016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09240693f0 0x7f0924150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:37.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.915+0000 7f092ab40640 1 -- 172.21.15.55:0/3294061016 >> 172.21.15.55:0/3294061016 conn(0x7f09240cde30 msgr2=0x7f09241531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:37.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.915+0000 7f092ab40640 1 -- 172.21.15.55:0/3294061016 shutdown_connections 2023-07-06T21:54:37.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:37.915+0000 7f092ab40640 1 -- 172.21.15.55:0/3294061016 wait complete. 2023-07-06T21:54:37.932 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-07-06T21:54:37.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:37.933 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-07-06T21:54:37.943 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:37.943 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:37.943 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:37.943 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:37.943 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:37.944 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:37.944 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:37.944 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:37.944 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:37.944 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:37.944 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:37.945 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:37.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:37.946 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_44_00_UTC) 2023-07-06T21:54:38.005 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:38.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:38.006 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_45_00_UTC) 2023-07-06T21:54:38.067 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:38.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:38.068 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_46_00_UTC) 2023-07-06T21:54:38.127 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:38.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:38.128 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_47_00_UTC) 2023-07-06T21:54:38.183 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:38.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:38.184 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_48_00_UTC) 2023-07-06T21:54:38.239 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:38.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:38.240 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_49_00_UTC) 2023-07-06T21:54:38.295 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:38.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:38.296 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_50_00_UTC) 2023-07-06T21:54:38.351 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:38.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:38.352 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_51_00_UTC) 2023-07-06T21:54:38.408 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:38.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:38.409 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_52_00_UTC) 2023-07-06T21:54:38.463 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:38.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:38.464 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_53_00_UTC) 2023-07-06T21:54:38.528 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:38.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:38.529 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-06-21_54_00_UTC) 2023-07-06T21:54:38.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:38.584 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-07-06T21:54:38.636 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-07-06T21:54:38.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.855+0000 7f22fd71e640 1 Processor -- start 2023-07-06T21:54:38.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.855+0000 7f22fd71e640 1 -- start start 2023-07-06T21:54:38.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.855+0000 7f22fd71e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f8158780 0x7f22f80cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:38.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.859+0000 7f22fd71e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f8158b50 con 0x7f22f80cbfa0 2023-07-06T21:54:38.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.859+0000 7f22fd71e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f806fb00 con 0x7f22f80c89b0 2023-07-06T21:54:38.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.859+0000 7f22fd71e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f806b390 con 0x7f22f8158780 2023-07-06T21:54:38.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.859+0000 7f22effff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f22f80cbfa0 0x7f22f806f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43958/0 (socket says 172.21.15.55:43958) 2023-07-06T21:54:38.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.859+0000 7f22effff640 1 -- 172.21.15.55:0/1839416023 learned_addr learned my addr 172.21.15.55:0/1839416023 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:38.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.859+0000 7f22f6ffd640 1 --2- 172.21.15.55:0/1839416023 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f8158780 0x7f22f80cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:38.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.859+0000 7f22f67fc640 1 -- 172.21.15.55:0/1839416023 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495216372 0 0) 0x7f22f8158b50 con 0x7f22f80cbfa0 2023-07-06T21:54:38.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.859+0000 7f22f67fc640 1 -- 172.21.15.55:0/1839416023 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e4003530 con 0x7f22f80cbfa0 2023-07-06T21:54:38.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.859+0000 7f22f67fc640 1 -- 172.21.15.55:0/1839416023 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288366036 0 0) 0x7f22f00014a0 con 0x7f22f80c89b0 2023-07-06T21:54:38.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.859+0000 7f22f67fc640 1 -- 172.21.15.55:0/1839416023 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22f8158b50 con 0x7f22f80c89b0 2023-07-06T21:54:38.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.859+0000 7f22f6ffd640 1 -- 172.21.15.55:0/1839416023 >> v1:172.21.15.138:6789/0 conn(0x7f22f80c89b0 legacy=0x7f22f806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:38.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.859+0000 7f22f6ffd640 1 -- 172.21.15.55:0/1839416023 >> v1:172.21.15.55:6789/0 conn(0x7f22f80cbfa0 legacy=0x7f22f806f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:38.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.859+0000 7f22f6ffd640 1 -- 172.21.15.55:0/1839416023 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f80cd3d0 con 0x7f22f8158780 2023-07-06T21:54:38.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.859+0000 7f22f6ffd640 1 --2- 172.21.15.55:0/1839416023 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f8158780 0x7f22f80cce90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f22e80097f0 tx=0x7f22e801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=438a2b3dba124427 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:38.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22f67fc640 1 -- 172.21.15.55:0/1839416023 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e80ab600 con 0x7f22f8158780 2023-07-06T21:54:38.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22f67fc640 1 -- 172.21.15.55:0/1839416023 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e80a7050 con 0x7f22f8158780 2023-07-06T21:54:38.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22f67fc640 1 -- 172.21.15.55:0/1839416023 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e80ab980 con 0x7f22f8158780 2023-07-06T21:54:38.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 -- 172.21.15.55:0/1839416023 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f8158780 msgr2=0x7f22f80cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:38.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 --2- 172.21.15.55:0/1839416023 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f8158780 0x7f22f80cce90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f22e80097f0 tx=0x7f22e801c430 comp rx=0 tx=0).stop 2023-07-06T21:54:38.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 -- 172.21.15.55:0/1839416023 shutdown_connections 2023-07-06T21:54:38.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 --2- 172.21.15.55:0/1839416023 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f8158780 0x7f22f80cce90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:38.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 -- 172.21.15.55:0/1839416023 >> 172.21.15.55:0/1839416023 conn(0x7f22f80cde30 msgr2=0x7f22f80ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:38.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 -- 172.21.15.55:0/1839416023 shutdown_connections 2023-07-06T21:54:38.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 -- 172.21.15.55:0/1839416023 wait complete. 2023-07-06T21:54:38.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 Processor -- start 2023-07-06T21:54:38.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 -- start start 2023-07-06T21:54:38.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f80c89b0 0x7f22f814eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:38.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22f80cbfa0 0x7f22f8146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:38.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22f8158780 0x7f22f8155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:38.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80b0d20 con 0x7f22f8158780 2023-07-06T21:54:38.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8147340 con 0x7f22f80cbfa0 2023-07-06T21:54:38.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22fd71e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f81477f0 con 0x7f22f80c89b0 2023-07-06T21:54:38.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22f77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22f8158780 0x7f22f8155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:38.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22effff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22f80cbfa0 0x7f22f8146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:38.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22effff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22f80cbfa0 0x7f22f8146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:52898/0 (socket says 172.21.15.55:52898) 2023-07-06T21:54:38.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22effff640 1 -- 172.21.15.55:0/635694806 learned_addr learned my addr 172.21.15.55:0/635694806 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:38.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.863+0000 7f22f77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22f8158780 0x7f22f8155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59082/0 (socket says 172.21.15.55:59082) 2023-07-06T21:54:38.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22f6ffd640 1 --2- 172.21.15.55:0/635694806 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f80c89b0 0x7f22f814eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:38.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22f77fe640 1 -- 172.21.15.55:0/635694806 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f80c89b0 msgr2=0x7f22f814eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:38.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22f77fe640 1 --2- 172.21.15.55:0/635694806 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f80c89b0 0x7f22f814eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:38.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22f77fe640 1 -- 172.21.15.55:0/635694806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22f80cbfa0 msgr2=0x7f22f8146e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:38.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22f77fe640 1 --2- 172.21.15.55:0/635694806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22f80cbfa0 0x7f22f8146e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:38.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22f77fe640 1 -- 172.21.15.55:0/635694806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e8009420 con 0x7f22f8158780 2023-07-06T21:54:38.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22f6ffd640 1 --2- 172.21.15.55:0/635694806 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f80c89b0 0x7f22f814eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:38.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22f77fe640 1 --2- 172.21.15.55:0/635694806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22f8158780 0x7f22f8155360 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f22f000c700 tx=0x7f22f000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:38.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22ef7fe640 1 -- 172.21.15.55:0/635694806 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0003b80 con 0x7f22f8158780 2023-07-06T21:54:38.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22ef7fe640 1 -- 172.21.15.55:0/635694806 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f0003d00 con 0x7f22f8158780 2023-07-06T21:54:38.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22ef7fe640 1 -- 172.21.15.55:0/635694806 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f000aa90 con 0x7f22f8158780 2023-07-06T21:54:38.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22fd71e640 1 -- 172.21.15.55:0/635694806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f80b14c0 con 0x7f22f8158780 2023-07-06T21:54:38.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22fd71e640 1 -- 172.21.15.55:0/635694806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f80b11e0 con 0x7f22f8158780 2023-07-06T21:54:38.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22fd71e640 1 -- 172.21.15.55:0/635694806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f8066d60 con 0x7f22f8158780 2023-07-06T21:54:38.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22ef7fe640 1 -- 172.21.15.55:0/635694806 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f22f000abf0 con 0x7f22f8158780 2023-07-06T21:54:38.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.867+0000 7f22ef7fe640 1 --2- 172.21.15.55:0/635694806 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f22d8066480 0x7f22d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:38.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.871+0000 7f22ef7fe640 1 -- 172.21.15.55:0/635694806 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7426+0+0 (secure 0 0 0) 0x7f22f0084310 con 0x7f22f8158780 2023-07-06T21:54:38.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.871+0000 7f22f6ffd640 1 --2- 172.21.15.55:0/635694806 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f22d8066480 0x7f22d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:38.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.871+0000 7f22f6ffd640 1 --2- 172.21.15.55:0/635694806 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f22d8066480 0x7f22d8068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22e80ad000 tx=0x7f22e80a6000 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:38.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:38.875+0000 7f22ef7fe640 1 -- 172.21.15.55:0/635694806 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22f0050e80 con 0x7f22f8158780 2023-07-06T21:54:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:39.075+0000 7f22fd71e640 1 -- 172.21.15.55:0/635694806 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f22f80cd6a0 con 0x7f22d8066480 2023-07-06T21:54:39.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:39.207+0000 7f22ef7fe640 1 -- 172.21.15.55:0/635694806 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f22e80bc0d0 con 0x7f22d8066480 2023-07-06T21:54:39.208 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-07-06T21:54:39.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:39.211+0000 7f22fd71e640 1 -- 172.21.15.55:0/635694806 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f22d8066480 msgr2=0x7f22d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:39.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:39.211+0000 7f22fd71e640 1 --2- 172.21.15.55:0/635694806 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f22d8066480 0x7f22d8068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22e80ad000 tx=0x7f22e80a6000 comp rx=0 tx=0).stop 2023-07-06T21:54:39.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:39.211+0000 7f22fd71e640 1 -- 172.21.15.55:0/635694806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22f8158780 msgr2=0x7f22f8155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:39.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:39.211+0000 7f22fd71e640 1 --2- 172.21.15.55:0/635694806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22f8158780 0x7f22f8155360 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f22f000c700 tx=0x7f22f000cbc0 comp rx=0 tx=0).stop 2023-07-06T21:54:39.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:39.211+0000 7f22fd71e640 1 -- 172.21.15.55:0/635694806 shutdown_connections 2023-07-06T21:54:39.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:39.211+0000 7f22fd71e640 1 --2- 172.21.15.55:0/635694806 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f22d8066480 0x7f22d8068930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:39.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:39.211+0000 7f22fd71e640 1 --2- 172.21.15.55:0/635694806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22f8158780 0x7f22f8155360 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:39.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:39.211+0000 7f22fd71e640 1 --2- 172.21.15.55:0/635694806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22f80cbfa0 0x7f22f8146e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:39.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:39.211+0000 7f22fd71e640 1 --2- 172.21.15.55:0/635694806 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f80c89b0 0x7f22f814eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:39.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:39.211+0000 7f22fd71e640 1 -- 172.21.15.55:0/635694806 >> 172.21.15.55:0/635694806 conn(0x7f22f80cde30 msgr2=0x7f22f806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:39.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:39.211+0000 7f22fd71e640 1 -- 172.21.15.55:0/635694806 shutdown_connections 2023-07-06T21:54:39.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:39.211+0000 7f22fd71e640 1 -- 172.21.15.55:0/635694806 wait complete. 2023-07-06T21:54:39.229 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-07-06T21:54:39.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:39.229 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-07-06T21:54:39.239 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:39.240 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:39.240 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:39.240 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:39.240 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:39.240 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:39.240 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:39.240 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:39.241 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:39.241 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:39.241 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:39.242 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:39.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:39.242 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_44_00_UTC) 2023-07-06T21:54:39.302 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:39.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:39.302 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_45_00_UTC) 2023-07-06T21:54:39.359 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:39.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:39.360 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_46_00_UTC) 2023-07-06T21:54:39.416 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:39.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:39.417 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_47_00_UTC) 2023-07-06T21:54:39.471 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:39.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:39.472 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_48_00_UTC) 2023-07-06T21:54:39.528 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:39.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:39.529 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_49_00_UTC) 2023-07-06T21:54:39.631 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:39.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:39.632 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_50_00_UTC) 2023-07-06T21:54:39.663 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:39.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:39.663 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_51_00_UTC) 2023-07-06T21:54:39.719 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:39.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:39.720 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_52_00_UTC) 2023-07-06T21:54:39.790 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:39.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:39.790 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_53_00_UTC) 2023-07-06T21:54:39.851 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:39.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:39.852 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-06-21_54_00_UTC) 2023-07-06T21:54:39.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:39.908 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-07-06T21:54:39.960 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-07-06T21:54:40.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e6d67b640 1 Processor -- start 2023-07-06T21:54:40.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e6d67b640 1 -- start start 2023-07-06T21:54:40.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e6d67b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e680c9b90 0x7f3e6815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:40.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e6d67b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3e680ccb70 0x7f3e680c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:40.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e6d67b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e680b3e70 con 0x7f3e68070410 2023-07-06T21:54:40.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e6d67b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e68159c30 con 0x7f3e680ccb70 2023-07-06T21:54:40.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e6d67b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e680c9070 con 0x7f3e680c9b90 2023-07-06T21:54:40.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e677fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3e68070410 0x7f3e68070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43964/0 (socket says 172.21.15.55:43964) 2023-07-06T21:54:40.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e677fe640 1 -- 172.21.15.55:0/4202179188 learned_addr learned my addr 172.21.15.55:0/4202179188 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:40.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e667fc640 1 --2- 172.21.15.55:0/4202179188 >> v2:172.21.15.138:3300/0 conn(0x7f3e680ccb70 0x7f3e680c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:40.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 -- 172.21.15.55:0/4202179188 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635538885 0 0) 0x7f3e600014a0 con 0x7f3e68070410 2023-07-06T21:54:40.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 -- 172.21.15.55:0/4202179188 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e50003530 con 0x7f3e68070410 2023-07-06T21:54:40.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e66ffd640 1 --2- 172.21.15.55:0/4202179188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e680c9b90 0x7f3e6815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:40.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 -- 172.21.15.55:0/4202179188 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1475903431 0 0) 0x7f3e50003530 con 0x7f3e68070410 2023-07-06T21:54:40.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 -- 172.21.15.55:0/4202179188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e680c9b90 msgr2=0x7f3e6815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:40.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 --2- 172.21.15.55:0/4202179188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e680c9b90 0x7f3e6815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:40.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 -- 172.21.15.55:0/4202179188 >> v2:172.21.15.138:3300/0 conn(0x7f3e680ccb70 msgr2=0x7f3e680c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:40.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 --2- 172.21.15.55:0/4202179188 >> v2:172.21.15.138:3300/0 conn(0x7f3e680ccb70 0x7f3e680c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:40.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 -- 172.21.15.55:0/4202179188 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6806a400 con 0x7f3e68070410 2023-07-06T21:54:40.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 -- 172.21.15.55:0/4202179188 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f3e60001b90 con 0x7f3e68070410 2023-07-06T21:54:40.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 -- 172.21.15.55:0/4202179188 >> v1:172.21.15.55:6789/0 conn(0x7f3e68070410 legacy=0x7f3e68070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:40.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 --2- 172.21.15.55:0/4202179188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e680c9b90 0x7f3e50003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:40.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 --2- 172.21.15.55:0/4202179188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e50003fb0 0x7f3e500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:40.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 --2- 172.21.15.55:0/4202179188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e50004d10 0x7f3e50005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:40.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 -- 172.21.15.55:0/4202179188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e68159c30 con 0x7f3e50003fb0 2023-07-06T21:54:40.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 -- 172.21.15.55:0/4202179188 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e680c9070 con 0x7f3e50004d10 2023-07-06T21:54:40.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e65ffb640 1 -- 172.21.15.55:0/4202179188 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5000ba90 con 0x7f3e680c9b90 2023-07-06T21:54:40.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e667fc640 1 --2- 172.21.15.55:0/4202179188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e50003fb0 0x7f3e500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:40.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e66ffd640 1 --2- 172.21.15.55:0/4202179188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e680c9b90 0x7f3e50003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:40.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e677fe640 1 --2- 172.21.15.55:0/4202179188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e50004d10 0x7f3e50005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:40.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e667fc640 1 -- 172.21.15.55:0/4202179188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e680c9b90 msgr2=0x7f3e50003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:40.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e667fc640 1 --2- 172.21.15.55:0/4202179188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e680c9b90 0x7f3e50003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:40.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e667fc640 1 -- 172.21.15.55:0/4202179188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e50004d10 msgr2=0x7f3e50005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:40.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e667fc640 1 --2- 172.21.15.55:0/4202179188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e50004d10 0x7f3e50005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:40.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.155+0000 7f3e667fc640 1 -- 172.21.15.55:0/4202179188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50003530 con 0x7f3e50003fb0 2023-07-06T21:54:40.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.159+0000 7f3e667fc640 1 --2- 172.21.15.55:0/4202179188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e50003fb0 0x7f3e500047d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00ba30 tx=0x7f3e5c01c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba18cc767be8f3a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:40.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.159+0000 7f3e65ffb640 1 -- 172.21.15.55:0/4202179188 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c0a9660 con 0x7f3e50003fb0 2023-07-06T21:54:40.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.159+0000 7f3e65ffb640 1 -- 172.21.15.55:0/4202179188 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c0a97c0 con 0x7f3e50003fb0 2023-07-06T21:54:40.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.159+0000 7f3e65ffb640 1 -- 172.21.15.55:0/4202179188 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c0a9b70 con 0x7f3e50003fb0 2023-07-06T21:54:40.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.159+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4202179188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e50003fb0 msgr2=0x7f3e500047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:40.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.159+0000 7f3e6d67b640 1 --2- 172.21.15.55:0/4202179188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e50003fb0 0x7f3e500047d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00ba30 tx=0x7f3e5c01c680 comp rx=0 tx=0).stop 2023-07-06T21:54:40.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e677fe640 1 -- 172.21.15.55:0/4202179188 reap_dead start 2023-07-06T21:54:40.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4202179188 shutdown_connections 2023-07-06T21:54:40.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4202179188 >> 172.21.15.55:0/4202179188 conn(0x7f3e680cde30 msgr2=0x7f3e680ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:40.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4202179188 shutdown_connections 2023-07-06T21:54:40.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4202179188 wait complete. 2023-07-06T21:54:40.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e6d67b640 1 Processor -- start 2023-07-06T21:54:40.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e6d67b640 1 -- start start 2023-07-06T21:54:40.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e6d67b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e50003fb0 0x7f3e68143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:40.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e6d67b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e681f0a10 0x7f3e6815a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:40.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e6d67b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e68141a20 0x7f3e680ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:40.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e6d67b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e681f10a0 con 0x7f3e50003fb0 2023-07-06T21:54:40.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e6d67b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6815c4e0 con 0x7f3e68141a20 2023-07-06T21:54:40.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e6d67b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e68144090 con 0x7f3e681f0a10 2023-07-06T21:54:40.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e66ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e50003fb0 0x7f3e68143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e66ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e50003fb0 0x7f3e68143ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59096/0 (socket says 172.21.15.55:59096) 2023-07-06T21:54:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e66ffd640 1 -- 172.21.15.55:0/4242960564 learned_addr learned my addr 172.21.15.55:0/4242960564 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e677fe640 1 --2- 172.21.15.55:0/4242960564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e68141a20 0x7f3e680ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.163+0000 7f3e667fc640 1 --2- 172.21.15.55:0/4242960564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e681f0a10 0x7f3e6815a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:40.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.167+0000 7f3e66ffd640 1 -- 172.21.15.55:0/4242960564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e681f0a10 msgr2=0x7f3e6815a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:40.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.167+0000 7f3e66ffd640 1 --2- 172.21.15.55:0/4242960564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e681f0a10 0x7f3e6815a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:40.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.167+0000 7f3e66ffd640 1 -- 172.21.15.55:0/4242960564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e68141a20 msgr2=0x7f3e680ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:40.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.167+0000 7f3e66ffd640 1 --2- 172.21.15.55:0/4242960564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e68141a20 0x7f3e680ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:40.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.167+0000 7f3e66ffd640 1 -- 172.21.15.55:0/4242960564 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e68144370 con 0x7f3e50003fb0 2023-07-06T21:54:40.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.167+0000 7f3e66ffd640 1 --2- 172.21.15.55:0/4242960564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e50003fb0 0x7f3e68143ab0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800b7f0 tx=0x7f3e5800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:40.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.167+0000 7f3e4f7fe640 1 -- 172.21.15.55:0/4242960564 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58004170 con 0x7f3e50003fb0 2023-07-06T21:54:40.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.167+0000 7f3e4f7fe640 1 -- 172.21.15.55:0/4242960564 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e58010830 con 0x7f3e50003fb0 2023-07-06T21:54:40.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.167+0000 7f3e4f7fe640 1 -- 172.21.15.55:0/4242960564 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58010be0 con 0x7f3e50003fb0 2023-07-06T21:54:40.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.167+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4242960564 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e68144650 con 0x7f3e50003fb0 2023-07-06T21:54:40.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.167+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4242960564 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e68141e90 con 0x7f3e50003fb0 2023-07-06T21:54:40.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.167+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4242960564 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e68142110 con 0x7f3e50003fb0 2023-07-06T21:54:40.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.167+0000 7f3e4f7fe640 1 -- 172.21.15.55:0/4242960564 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f3e58014430 con 0x7f3e50003fb0 2023-07-06T21:54:40.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.171+0000 7f3e4f7fe640 1 --2- 172.21.15.55:0/4242960564 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3e54066480 0x7f3e54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:40.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.171+0000 7f3e4f7fe640 1 -- 172.21.15.55:0/4242960564 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f3e58084f60 con 0x7f3e50003fb0 2023-07-06T21:54:40.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.171+0000 7f3e667fc640 1 --2- 172.21.15.55:0/4242960564 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3e54066480 0x7f3e54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:40.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.171+0000 7f3e667fc640 1 --2- 172.21.15.55:0/4242960564 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3e54066480 0x7f3e54068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0b0000 tx=0x7f3e5c0ac040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:40.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.175+0000 7f3e4f7fe640 1 -- 172.21.15.55:0/4242960564 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3e58051a00 con 0x7f3e50003fb0 2023-07-06T21:54:40.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.351+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4242960564 --> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e680ca4a0 con 0x7f3e54066480 2023-07-06T21:54:40.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.431+0000 7f3e4f7fe640 1 -- 172.21.15.55:0/4242960564 <== mgr.5192 v2:172.21.15.55:6832/1149809384 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f3e5c0a95e0 con 0x7f3e54066480 2023-07-06T21:54:40.433 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-07-06T21:54:40.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.435+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4242960564 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3e54066480 msgr2=0x7f3e54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:40.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.435+0000 7f3e6d67b640 1 --2- 172.21.15.55:0/4242960564 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3e54066480 0x7f3e54068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0b0000 tx=0x7f3e5c0ac040 comp rx=0 tx=0).stop 2023-07-06T21:54:40.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.435+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4242960564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e50003fb0 msgr2=0x7f3e68143ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:40.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.435+0000 7f3e6d67b640 1 --2- 172.21.15.55:0/4242960564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e50003fb0 0x7f3e68143ab0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800b7f0 tx=0x7f3e5800bcb0 comp rx=0 tx=0).stop 2023-07-06T21:54:40.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.435+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4242960564 shutdown_connections 2023-07-06T21:54:40.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.435+0000 7f3e6d67b640 1 --2- 172.21.15.55:0/4242960564 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f3e54066480 0x7f3e54068930 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.435+0000 7f3e6d67b640 1 --2- 172.21.15.55:0/4242960564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e68141a20 0x7f3e680ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.435+0000 7f3e6d67b640 1 --2- 172.21.15.55:0/4242960564 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e681f0a10 0x7f3e6815a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.435+0000 7f3e6d67b640 1 --2- 172.21.15.55:0/4242960564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e50003fb0 0x7f3e68143ab0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.435+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4242960564 >> 172.21.15.55:0/4242960564 conn(0x7f3e680cde30 msgr2=0x7f3e6806a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.435+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4242960564 shutdown_connections 2023-07-06T21:54:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:40.435+0000 7f3e6d67b640 1 -- 172.21.15.55:0/4242960564 wait complete. 2023-07-06T21:54:40.453 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-07-06T21:54:40.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:40.454 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-07-06T21:54:40.464 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:40.464 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:40.464 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:40.465 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:40.465 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:40.465 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:40.465 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:40.465 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:40.465 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:40.465 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:40.466 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:40.466 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_44_00_UTC 2023-07-06T21:54:40.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:40.467 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_44_00_UTC) 2023-07-06T21:54:40.533 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_45_00_UTC 2023-07-06T21:54:40.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:40.533 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_45_00_UTC) 2023-07-06T21:54:40.599 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_46_00_UTC 2023-07-06T21:54:40.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:40.600 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_46_00_UTC) 2023-07-06T21:54:40.667 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_47_00_UTC 2023-07-06T21:54:40.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:40.668 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_47_00_UTC) 2023-07-06T21:54:40.725 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_48_00_UTC 2023-07-06T21:54:40.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:40.726 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_48_00_UTC) 2023-07-06T21:54:40.784 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_49_00_UTC 2023-07-06T21:54:40.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:40.785 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_49_00_UTC) 2023-07-06T21:54:40.844 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_50_00_UTC 2023-07-06T21:54:40.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:40.844 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_50_00_UTC) 2023-07-06T21:54:40.909 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_51_00_UTC 2023-07-06T21:54:40.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:40.910 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_51_00_UTC) 2023-07-06T21:54:40.973 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_52_00_UTC 2023-07-06T21:54:40.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:40.974 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_52_00_UTC) 2023-07-06T21:54:41.032 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_53_00_UTC 2023-07-06T21:54:41.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:41.033 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_53_00_UTC) 2023-07-06T21:54:41.088 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_54_00_UTC 2023-07-06T21:54:41.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:41.088 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-06-21_54_00_UTC) 2023-07-06T21:54:41.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:41.144 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-07-06T21:54:41.196 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-06T21:54:41.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.383+0000 7fee8fa9c640 1 Processor -- start 2023-07-06T21:54:41.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8fa9c640 1 -- start start 2023-07-06T21:54:41.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8fa9c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fee8806fef0 0x7fee88164820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:41.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8fa9c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee880cc030 con 0x7fee88070d70 2023-07-06T21:54:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8fa9c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee880cc300 con 0x7fee880709a0 2023-07-06T21:54:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8fa9c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee880cc5e0 con 0x7fee8806fef0 2023-07-06T21:54:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8d037640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fee88070d70 0x7fee880b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43970/0 (socket says 172.21.15.55:43970) 2023-07-06T21:54:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8d037640 1 -- 172.21.15.55:0/850431848 learned_addr learned my addr 172.21.15.55:0/850431848 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8e039640 1 --2- 172.21.15.55:0/850431848 >> v2:172.21.15.138:3300/0 conn(0x7fee8806fef0 0x7fee88164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 -- 172.21.15.55:0/850431848 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3385791043 0 0) 0x7fee880cc030 con 0x7fee88070d70 2023-07-06T21:54:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 -- 172.21.15.55:0/850431848 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee74003530 con 0x7fee88070d70 2023-07-06T21:54:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 -- 172.21.15.55:0/850431848 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4212214500 0 0) 0x7fee74003530 con 0x7fee88070d70 2023-07-06T21:54:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 -- 172.21.15.55:0/850431848 >> v2:172.21.15.138:3300/0 conn(0x7fee8806fef0 msgr2=0x7fee88164820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 --2- 172.21.15.55:0/850431848 >> v2:172.21.15.138:3300/0 conn(0x7fee8806fef0 0x7fee88164820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 -- 172.21.15.55:0/850431848 >> v1:172.21.15.138:6789/0 conn(0x7fee880709a0 legacy=0x7fee880cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 -- 172.21.15.55:0/850431848 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee880cc8c0 con 0x7fee88070d70 2023-07-06T21:54:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 -- 172.21.15.55:0/850431848 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fee78001680 con 0x7fee88070d70 2023-07-06T21:54:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 -- 172.21.15.55:0/850431848 >> v1:172.21.15.55:6789/0 conn(0x7fee88070d70 legacy=0x7fee880b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 --2- 172.21.15.55:0/850431848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee74003980 0x7fee74003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 --2- 172.21.15.55:0/850431848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee74004370 0x7fee74004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 --2- 172.21.15.55:0/850431848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee74005030 0x7fee7400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 -- 172.21.15.55:0/850431848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee880cc5e0 con 0x7fee74004370 2023-07-06T21:54:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 -- 172.21.15.55:0/850431848 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7400bf80 con 0x7fee74005030 2023-07-06T21:54:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8c836640 1 -- 172.21.15.55:0/850431848 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7400c140 con 0x7fee74003980 2023-07-06T21:54:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8d037640 1 --2- 172.21.15.55:0/850431848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee74004370 0x7fee74004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8d838640 1 --2- 172.21.15.55:0/850431848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee74003980 0x7fee74003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8e039640 1 --2- 172.21.15.55:0/850431848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee74005030 0x7fee7400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8d037640 1 -- 172.21.15.55:0/850431848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee74003980 msgr2=0x7fee74003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8d037640 1 --2- 172.21.15.55:0/850431848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee74003980 0x7fee74003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8d037640 1 -- 172.21.15.55:0/850431848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee74005030 msgr2=0x7fee7400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8d037640 1 --2- 172.21.15.55:0/850431848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee74005030 0x7fee7400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8d037640 1 -- 172.21.15.55:0/850431848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee74003530 con 0x7fee74004370 2023-07-06T21:54:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.387+0000 7fee8e039640 1 -- 172.21.15.55:0/850431848 reap_dead start 2023-07-06T21:54:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.391+0000 7fee8d037640 1 --2- 172.21.15.55:0/850431848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee74004370 0x7fee74004830 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fee7800c210 tx=0x7fee7801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54383f40a0a1a721 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.391+0000 7fee8c836640 1 -- 172.21.15.55:0/850431848 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78005ae0 con 0x7fee74004370 2023-07-06T21:54:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.391+0000 7fee8c836640 1 -- 172.21.15.55:0/850431848 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee78005c60 con 0x7fee74004370 2023-07-06T21:54:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.391+0000 7fee8c836640 1 -- 172.21.15.55:0/850431848 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee780a5b00 con 0x7fee74004370 2023-07-06T21:54:41.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.391+0000 7fee8fa9c640 1 -- 172.21.15.55:0/850431848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee74004370 msgr2=0x7fee74004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:41.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.391+0000 7fee8fa9c640 1 --2- 172.21.15.55:0/850431848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee74004370 0x7fee74004830 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fee7800c210 tx=0x7fee7801cbc0 comp rx=0 tx=0).stop 2023-07-06T21:54:41.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.391+0000 7fee8fa9c640 1 -- 172.21.15.55:0/850431848 shutdown_connections 2023-07-06T21:54:41.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.391+0000 7fee8fa9c640 1 --2- 172.21.15.55:0/850431848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee74004370 0x7fee74004830 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:41.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.391+0000 7fee8fa9c640 1 -- 172.21.15.55:0/850431848 >> 172.21.15.55:0/850431848 conn(0x7fee880cea70 msgr2=0x7fee880ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:41.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.391+0000 7fee8fa9c640 1 -- 172.21.15.55:0/850431848 shutdown_connections 2023-07-06T21:54:41.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.391+0000 7fee8fa9c640 1 -- 172.21.15.55:0/850431848 wait complete. 2023-07-06T21:54:41.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8fa9c640 1 Processor -- start 2023-07-06T21:54:41.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8fa9c640 1 -- start start 2023-07-06T21:54:41.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8fa9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee74004370 0x7fee880693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:41.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8fa9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee8815cad0 0x7fee88155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:41.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8fa9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee8806bf30 0x7fee8806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:41.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8fa9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8806c8e0 con 0x7fee74004370 2023-07-06T21:54:41.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8fa9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee88069930 con 0x7fee8806bf30 2023-07-06T21:54:41.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8fa9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee88069bd0 con 0x7fee8815cad0 2023-07-06T21:54:41.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8d838640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee74004370 0x7fee880693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:41.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8d838640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee74004370 0x7fee880693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59114/0 (socket says 172.21.15.55:59114) 2023-07-06T21:54:41.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8d838640 1 -- 172.21.15.55:0/3881672224 learned_addr learned my addr 172.21.15.55:0/3881672224 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:41.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8d037640 1 --2- 172.21.15.55:0/3881672224 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee8815cad0 0x7fee88155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:41.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8e039640 1 --2- 172.21.15.55:0/3881672224 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee8806bf30 0x7fee8806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:41.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8d838640 1 -- 172.21.15.55:0/3881672224 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee8815cad0 msgr2=0x7fee88155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:41.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8d838640 1 --2- 172.21.15.55:0/3881672224 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee8815cad0 0x7fee88155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:41.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8d838640 1 -- 172.21.15.55:0/3881672224 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee8806bf30 msgr2=0x7fee8806c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:41.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8d838640 1 --2- 172.21.15.55:0/3881672224 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee8806bf30 0x7fee8806c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:41.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8d838640 1 -- 172.21.15.55:0/3881672224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee88069eb0 con 0x7fee74004370 2023-07-06T21:54:41.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8d838640 1 --2- 172.21.15.55:0/3881672224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee74004370 0x7fee880693f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fee84011470 tx=0x7fee84011560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:41.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee7e7fc640 1 -- 172.21.15.55:0/3881672224 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84015610 con 0x7fee74004370 2023-07-06T21:54:41.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee7e7fc640 1 -- 172.21.15.55:0/3881672224 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee84015770 con 0x7fee74004370 2023-07-06T21:54:41.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee7e7fc640 1 -- 172.21.15.55:0/3881672224 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84015b20 con 0x7fee74004370 2023-07-06T21:54:41.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8fa9c640 1 -- 172.21.15.55:0/3881672224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8806a190 con 0x7fee74004370 2023-07-06T21:54:41.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.395+0000 7fee8fa9c640 1 -- 172.21.15.55:0/3881672224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8806a750 con 0x7fee74004370 2023-07-06T21:54:41.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.399+0000 7fee8fa9c640 1 -- 172.21.15.55:0/3881672224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee88066d60 con 0x7fee74004370 2023-07-06T21:54:41.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.399+0000 7fee7e7fc640 1 -- 172.21.15.55:0/3881672224 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fee84015c80 con 0x7fee74004370 2023-07-06T21:54:41.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.399+0000 7fee7e7fc640 1 --2- 172.21.15.55:0/3881672224 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fee6c0664b0 0x7fee6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:41.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.399+0000 7fee7e7fc640 1 -- 172.21.15.55:0/3881672224 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7394+0+0 (secure 0 0 0) 0x7fee84087190 con 0x7fee74004370 2023-07-06T21:54:41.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.399+0000 7fee8d037640 1 --2- 172.21.15.55:0/3881672224 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fee6c0664b0 0x7fee6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:41.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.399+0000 7fee8d037640 1 --2- 172.21.15.55:0/3881672224 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fee6c0664b0 0x7fee6c068960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee780ab000 tx=0x7fee780b1040 comp rx=0 tx=0).ready entity=mgr.5192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:41.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.403+0000 7fee7e7fc640 1 -- 172.21.15.55:0/3881672224 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee84053e60 con 0x7fee74004370 2023-07-06T21:54:41.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:41.627+0000 7fee8fa9c640 1 -- 172.21.15.55:0/3881672224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fee8806a910 con 0x7fee74004370 2023-07-06T21:54:42.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:42.595+0000 7fee7e7fc640 1 -- 172.21.15.55:0/3881672224 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7fee84054230 con 0x7fee74004370 2023-07-06T21:54:42.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:42.595+0000 7fee7e7fc640 1 -- 172.21.15.55:0/3881672224 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v14) v1 ==== 93+0+0 (secure 0 0 0) 0x7fee840508a0 con 0x7fee74004370 2023-07-06T21:54:42.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:42.599+0000 7fee8fa9c640 1 -- 172.21.15.55:0/3881672224 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fee6c0664b0 msgr2=0x7fee6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:42.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:42.603+0000 7fee8fa9c640 1 --2- 172.21.15.55:0/3881672224 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fee6c0664b0 0x7fee6c068960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee780ab000 tx=0x7fee780b1040 comp rx=0 tx=0).stop 2023-07-06T21:54:42.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:42.603+0000 7fee8fa9c640 1 -- 172.21.15.55:0/3881672224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee74004370 msgr2=0x7fee880693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:42.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:42.603+0000 7fee8fa9c640 1 --2- 172.21.15.55:0/3881672224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee74004370 0x7fee880693f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fee84011470 tx=0x7fee84011560 comp rx=0 tx=0).stop 2023-07-06T21:54:42.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:42.603+0000 7fee8fa9c640 1 -- 172.21.15.55:0/3881672224 shutdown_connections 2023-07-06T21:54:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:42.603+0000 7fee8fa9c640 1 --2- 172.21.15.55:0/3881672224 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fee6c0664b0 0x7fee6c068960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:42.603+0000 7fee8fa9c640 1 --2- 172.21.15.55:0/3881672224 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee8806bf30 0x7fee8806c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:42.603+0000 7fee8fa9c640 1 --2- 172.21.15.55:0/3881672224 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee8815cad0 0x7fee88155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:42.603+0000 7fee8fa9c640 1 --2- 172.21.15.55:0/3881672224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee74004370 0x7fee880693f0 secure :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fee84011470 tx=0x7fee84011560 comp rx=0 tx=0).stop 2023-07-06T21:54:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:42.603+0000 7fee8fa9c640 1 -- 172.21.15.55:0/3881672224 >> 172.21.15.55:0/3881672224 conn(0x7fee880cea70 msgr2=0x7fee880c4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:42.603+0000 7fee8fa9c640 1 -- 172.21.15.55:0/3881672224 shutdown_connections 2023-07-06T21:54:42.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:42.607+0000 7fee8fa9c640 1 -- 172.21.15.55:0/3881672224 wait complete. 2023-07-06T21:54:42.632 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T21:54:42.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:54:42.700 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:54:42.776 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T21:54:42.776 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:54:42.777 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:54:42.778 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:42.777+0000 7f0b09a01180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:54:42.786 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:54:42.786 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:54:42.790 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:42.791+0000 7f213e047180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:54:42.798 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:54:43.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.027+0000 7f987f512640 1 Processor -- start 2023-07-06T21:54:43.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.027+0000 7f987f512640 1 -- start start 2023-07-06T21:54:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.027+0000 7f987f512640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9878150b10 0x7f98780693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.027+0000 7f987f512640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9878071240 con 0x7f98780c9b40 2023-07-06T21:54:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.027+0000 7f987f512640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987815a770 con 0x7f9878070490 2023-07-06T21:54:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.027+0000 7f987f512640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987815aa50 con 0x7f9878150b10 2023-07-06T21:54:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.027+0000 7f987e510640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9878150b10 0x7f98780693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.027+0000 7f987e510640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9878150b10 0x7f98780693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59152/0 (socket says 172.21.15.55:59152) 2023-07-06T21:54:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.027+0000 7f987e510640 1 -- 172.21.15.55:0/4244546403 learned_addr learned my addr 172.21.15.55:0/4244546403 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.027+0000 7f987e510640 1 -- 172.21.15.55:0/4244546403 >> v1:172.21.15.138:6789/0 conn(0x7f9878070490 legacy=0x7f9878159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.027+0000 7f987e510640 1 -- 172.21.15.55:0/4244546403 >> v1:172.21.15.55:6789/0 conn(0x7f98780c9b40 legacy=0x7f98780c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.027+0000 7f987e510640 1 -- 172.21.15.55:0/4244546403 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98780c83c0 con 0x7f9878150b10 2023-07-06T21:54:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.027+0000 7f987d50e640 1 -- 172.21.15.55:0/4244546403 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380264900 0 0) 0x7f9878071240 con 0x7f98780c9b40 2023-07-06T21:54:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.031+0000 7f987e510640 1 --2- 172.21.15.55:0/4244546403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878150b10 0x7f98780693f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9874009870 tx=0x7f987401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f796af01afe267 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.031+0000 7f987d50e640 1 -- 172.21.15.55:0/4244546403 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740ab650 con 0x7f9878150b10 2023-07-06T21:54:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.031+0000 7f987d50e640 1 -- 172.21.15.55:0/4244546403 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98740ab7b0 con 0x7f9878150b10 2023-07-06T21:54:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.031+0000 7f987d50e640 1 -- 172.21.15.55:0/4244546403 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740abb40 con 0x7f9878150b10 2023-07-06T21:54:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.031+0000 7f987f512640 1 -- 172.21.15.55:0/4244546403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878150b10 msgr2=0x7f98780693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.031+0000 7f987f512640 1 --2- 172.21.15.55:0/4244546403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878150b10 0x7f98780693f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9874009870 tx=0x7f987401c540 comp rx=0 tx=0).stop 2023-07-06T21:54:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.031+0000 7f987f512640 1 -- 172.21.15.55:0/4244546403 shutdown_connections 2023-07-06T21:54:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.031+0000 7f987f512640 1 --2- 172.21.15.55:0/4244546403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878150b10 0x7f98780693f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.031+0000 7f987f512640 1 -- 172.21.15.55:0/4244546403 >> 172.21.15.55:0/4244546403 conn(0x7f98780cdcd0 msgr2=0x7f98780ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.031+0000 7f987f512640 1 -- 172.21.15.55:0/4244546403 shutdown_connections 2023-07-06T21:54:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.031+0000 7f987f512640 1 -- 172.21.15.55:0/4244546403 wait complete. 2023-07-06T21:54:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987f512640 1 Processor -- start 2023-07-06T21:54:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987f512640 1 -- start start 2023-07-06T21:54:43.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987f512640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9878070490 0x7f987814bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987f512640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98780c9b40 0x7f9878152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987f512640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878150b10 0x7f987815d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987f512640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987814ca70 con 0x7f9878150b10 2023-07-06T21:54:43.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987f512640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987814cd50 con 0x7f98780c9b40 2023-07-06T21:54:43.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987f512640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987814d030 con 0x7f9878070490 2023-07-06T21:54:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987ed11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878150b10 0x7f987815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987ed11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878150b10 0x7f987815d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59162/0 (socket says 172.21.15.55:59162) 2023-07-06T21:54:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987ed11640 1 -- 172.21.15.55:0/3867323954 learned_addr learned my addr 172.21.15.55:0/3867323954 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987e510640 1 --2- 172.21.15.55:0/3867323954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9878070490 0x7f987814bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987dd0f640 1 --2- 172.21.15.55:0/3867323954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98780c9b40 0x7f9878152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987ed11640 1 -- 172.21.15.55:0/3867323954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9878070490 msgr2=0x7f987814bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987ed11640 1 --2- 172.21.15.55:0/3867323954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9878070490 0x7f987814bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987ed11640 1 -- 172.21.15.55:0/3867323954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98780c9b40 msgr2=0x7f9878152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987ed11640 1 --2- 172.21.15.55:0/3867323954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98780c9b40 0x7f9878152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987ed11640 1 -- 172.21.15.55:0/3867323954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98740094d0 con 0x7f9878150b10 2023-07-06T21:54:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987ed11640 1 --2- 172.21.15.55:0/3867323954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878150b10 0x7f987815d030 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9870001570 tx=0x7f987000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f986effd640 1 -- 172.21.15.55:0/3867323954 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870003db0 con 0x7f9878150b10 2023-07-06T21:54:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f986effd640 1 -- 172.21.15.55:0/3867323954 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9870005070 con 0x7f9878150b10 2023-07-06T21:54:43.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f986effd640 1 -- 172.21.15.55:0/3867323954 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870005420 con 0x7f9878150b10 2023-07-06T21:54:43.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987f512640 1 -- 172.21.15.55:0/3867323954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987814d310 con 0x7f9878150b10 2023-07-06T21:54:43.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987f512640 1 -- 172.21.15.55:0/3867323954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987814c230 con 0x7f9878150b10 2023-07-06T21:54:43.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.035+0000 7f987f512640 1 -- 172.21.15.55:0/3867323954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987804d790 con 0x7f9878150b10 2023-07-06T21:54:43.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.039+0000 7f986effd640 1 -- 172.21.15.55:0/3867323954 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f9870005580 con 0x7f9878150b10 2023-07-06T21:54:43.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.039+0000 7f986effd640 1 --2- 172.21.15.55:0/3867323954 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f985c066430 0x7f985c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.039+0000 7f986effd640 1 -- 172.21.15.55:0/3867323954 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 7602+0+0 (secure 0 0 0) 0x7f9870083eb0 con 0x7f9878150b10 2023-07-06T21:54:43.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.039+0000 7f987e510640 1 -- 172.21.15.55:0/3867323954 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f985c066430 msgr2=0x7f985c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1149809384 2023-07-06T21:54:43.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.039+0000 7f987e510640 1 --2- 172.21.15.55:0/3867323954 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f985c066430 0x7f985c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:54:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.043+0000 7f986effd640 1 -- 172.21.15.55:0/3867323954 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9870050b60 con 0x7f9878150b10 2023-07-06T21:54:43.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.199+0000 7f987f512640 1 -- 172.21.15.55:0/3867323954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f987814d7c0 con 0x7f9878150b10 2023-07-06T21:54:43.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.203+0000 7f986effd640 1 -- 172.21.15.55:0/3867323954 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+20348 (secure 0 0 0) 0x7f9870054180 con 0x7f9878150b10 2023-07-06T21:54:43.203 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:43.203 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":57,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:54:42.574883+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:43:26.444989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-06T21:43:27.092120+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":57,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/2066223848":"2023-07-07T21:43:45.377574+0000","172.21.15.55:6833/1575998409":"2023-07-07T21:43:45.377574+0000","172.21.15.55:6832/1575998409":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/2297905762":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/1005520698":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/2605447220":"2023-07-07T21:43:45.377574+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":13,"length":1},{"begin":15,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":1},{"begin":23,"length":1},{"begin":25,"length":1},{"begin":27,"length":1},{"begin":29,"length":1},{"begin":31,"length":1},{"begin":33,"length":1},{"begin":35,"length":1},{"begin":37,"length":1},{"begin":39,"length":1},{"begin":41,"length":2},{"begin":44,"length":1},{"begin":46,"length":1},{"begin":48,"length":1},{"begin":50,"length":1},{"begin":52,"length":1},{"begin":54,"length":1},{"begin":56,"length":1},{"begin":58,"length":1},{"begin":60,"length":1},{"begin":63,"length":1},{"begin":65,"length":1},{"begin":67,"length":1},{"begin":69,"length":1},{"begin":71,"length":2},{"begin":74,"length":3},{"begin":78,"length":1},{"begin":80,"length":1},{"begin":83,"length":1},{"begin":85,"length":3},{"begin":89,"length":1},{"begin":91,"length":1},{"begin":93,"length":1},{"begin":95,"length":3},{"begin":99,"length":1},{"begin":101,"length":2},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":1},{"begin":163,"length":58}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":54,"length":1},{"begin":65,"length":1},{"begin":76,"length":1},{"begin":87,"length":1},{"begin":97,"length":1},{"begin":216,"length":5}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:54:43.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.203+0000 7f987f512640 1 -- 172.21.15.55:0/3867323954 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f985c066430 msgr2=0x7f985c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:54:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.203+0000 7f987f512640 1 --2- 172.21.15.55:0/3867323954 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f985c066430 0x7f985c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.203+0000 7f987f512640 1 -- 172.21.15.55:0/3867323954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878150b10 msgr2=0x7f987815d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.203+0000 7f987f512640 1 --2- 172.21.15.55:0/3867323954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878150b10 0x7f987815d030 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9870001570 tx=0x7f987000cd20 comp rx=0 tx=0).stop 2023-07-06T21:54:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.203+0000 7f987f512640 1 -- 172.21.15.55:0/3867323954 shutdown_connections 2023-07-06T21:54:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.203+0000 7f987f512640 1 --2- 172.21.15.55:0/3867323954 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f985c066430 0x7f985c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.203+0000 7f987f512640 1 --2- 172.21.15.55:0/3867323954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9878150b10 0x7f987815d030 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.203+0000 7f987f512640 1 --2- 172.21.15.55:0/3867323954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98780c9b40 0x7f9878152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.203+0000 7f987f512640 1 --2- 172.21.15.55:0/3867323954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9878070490 0x7f987814bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.203+0000 7f987f512640 1 -- 172.21.15.55:0/3867323954 >> 172.21.15.55:0/3867323954 conn(0x7f98780cdcd0 msgr2=0x7f98780ae680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.203+0000 7f987f512640 1 -- 172.21.15.55:0/3867323954 shutdown_connections 2023-07-06T21:54:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.203+0000 7f987f512640 1 -- 172.21.15.55:0/3867323954 wait complete. 2023-07-06T21:54:43.210 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:43.209+0000 7f0b09a01180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:54:43.225 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:43:26.444989+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:43:27.092120+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 57, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:54:43.226 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:54:43.269 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:43.271+0000 7f213e047180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:54:43.359 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:43.357+0000 7f0b09a01180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:54:43.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f10405a3640 1 Processor -- start 2023-07-06T21:54:43.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f10405a3640 1 -- start start 2023-07-06T21:54:43.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f10405a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10380b3870 0x7f10380b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f10405a3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f10380d03c0 0x7f10380d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f10405a3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10380b2b80 con 0x7f103815b850 2023-07-06T21:54:43.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f10405a3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10380cff30 con 0x7f10380d03c0 2023-07-06T21:54:43.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f10405a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10380b41e0 con 0x7f10380b3870 2023-07-06T21:54:43.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f103db3e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10380b3870 0x7f10380b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:43.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f103eb40640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f10380d03c0 0x7f10380d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:43.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f103db3e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10380b3870 0x7f10380b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:43256/0 (socket says 172.21.15.55:43256) 2023-07-06T21:54:43.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f103eb40640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f10380d03c0 0x7f10380d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:36130/0 (socket says 172.21.15.55:36130) 2023-07-06T21:54:43.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f103db3e640 1 -- 172.21.15.55:0/3111333075 learned_addr learned my addr 172.21.15.55:0/3111333075 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:43.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f103e33f640 1 --1- 172.21.15.55:0/3111333075 >> v1:172.21.15.138:6789/0 conn(0x7f103815b850 0x7f10380cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:37276/0 (socket says 172.21.15.55:37276) 2023-07-06T21:54:43.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f103db3e640 1 -- 172.21.15.55:0/3111333075 >> v2:172.21.15.138:3300/0 conn(0x7f10380d03c0 msgr2=0x7f10380d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:43.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f103db3e640 1 --2- 172.21.15.55:0/3111333075 >> v2:172.21.15.138:3300/0 conn(0x7f10380d03c0 0x7f10380d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f103db3e640 1 -- 172.21.15.55:0/3111333075 >> v1:172.21.15.138:6789/0 conn(0x7f103815b850 legacy=0x7f10380cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f103db3e640 1 -- 172.21.15.55:0/3111333075 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10380b22e0 con 0x7f10380b3870 2023-07-06T21:54:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.375+0000 7f103eb40640 1 --2- 172.21.15.55:0/3111333075 >> v2:172.21.15.138:3300/0 conn(0x7f10380d03c0 0x7f10380d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.379+0000 7f103db3e640 1 --2- 172.21.15.55:0/3111333075 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10380b3870 0x7f10380b3ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1028009870 tx=0x7f102801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23fe3d6180e74ae7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.379+0000 7f103d33d640 1 -- 172.21.15.55:0/3111333075 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10280ab5f0 con 0x7f10380b3870 2023-07-06T21:54:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.379+0000 7f103d33d640 1 -- 172.21.15.55:0/3111333075 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10280ab750 con 0x7f10380b3870 2023-07-06T21:54:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.379+0000 7f103d33d640 1 -- 172.21.15.55:0/3111333075 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10280abae0 con 0x7f10380b3870 2023-07-06T21:54:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.379+0000 7f10405a3640 1 -- 172.21.15.55:0/3111333075 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10380b3870 msgr2=0x7f10380b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.379+0000 7f10405a3640 1 --2- 172.21.15.55:0/3111333075 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10380b3870 0x7f10380b3ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1028009870 tx=0x7f102801c3f0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.379+0000 7f10405a3640 1 -- 172.21.15.55:0/3111333075 shutdown_connections 2023-07-06T21:54:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.379+0000 7f10405a3640 1 --2- 172.21.15.55:0/3111333075 >> v2:172.21.15.138:3300/0 conn(0x7f10380d03c0 0x7f10380d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.379+0000 7f10405a3640 1 --2- 172.21.15.55:0/3111333075 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10380b3870 0x7f10380b3ca0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.379+0000 7f10405a3640 1 -- 172.21.15.55:0/3111333075 >> 172.21.15.55:0/3111333075 conn(0x7f10380cec20 msgr2=0x7f10380cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.379+0000 7f10405a3640 1 -- 172.21.15.55:0/3111333075 shutdown_connections 2023-07-06T21:54:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.379+0000 7f10405a3640 1 -- 172.21.15.55:0/3111333075 wait complete. 2023-07-06T21:54:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f10405a3640 1 Processor -- start 2023-07-06T21:54:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f10405a3640 1 -- start start 2023-07-06T21:54:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f10405a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10380b3870 0x7f10380c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f10405a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10380d03c0 0x7f103815ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f10405a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f103815b850 0x7f10380c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f10405a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10380c9be0 con 0x7f10380d03c0 2023-07-06T21:54:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f10405a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10380c9ec0 con 0x7f10380b3870 2023-07-06T21:54:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f10405a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10380ca1a0 con 0x7f103815b850 2023-07-06T21:54:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f103db3e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10380d03c0 0x7f103815ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f103db3e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10380d03c0 0x7f103815ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32838/0 (socket says 172.21.15.55:32838) 2023-07-06T21:54:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f103db3e640 1 -- 172.21.15.55:0/2319771619 learned_addr learned my addr 172.21.15.55:0/2319771619 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f103e33f640 1 --2- 172.21.15.55:0/2319771619 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10380b3870 0x7f10380c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f103eb40640 1 --2- 172.21.15.55:0/2319771619 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f103815b850 0x7f10380c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f103db3e640 1 -- 172.21.15.55:0/2319771619 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f103815b850 msgr2=0x7f10380c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f103db3e640 1 --2- 172.21.15.55:0/2319771619 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f103815b850 0x7f10380c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f103db3e640 1 -- 172.21.15.55:0/2319771619 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10380b3870 msgr2=0x7f10380c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f103db3e640 1 --2- 172.21.15.55:0/2319771619 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10380b3870 0x7f10380c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f103db3e640 1 -- 172.21.15.55:0/2319771619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1030009a70 con 0x7f10380d03c0 2023-07-06T21:54:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.383+0000 7f103db3e640 1 --2- 172.21.15.55:0/2319771619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10380d03c0 0x7f103815ea10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f10280ad040 tx=0x7f102801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.387+0000 7f102effd640 1 -- 172.21.15.55:0/2319771619 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10280be5f0 con 0x7f10380d03c0 2023-07-06T21:54:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.387+0000 7f102effd640 1 -- 172.21.15.55:0/2319771619 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10280be770 con 0x7f10380d03c0 2023-07-06T21:54:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.387+0000 7f102effd640 1 -- 172.21.15.55:0/2319771619 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10280beb20 con 0x7f10380d03c0 2023-07-06T21:54:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.387+0000 7f10405a3640 1 -- 172.21.15.55:0/2319771619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10280094d0 con 0x7f10380d03c0 2023-07-06T21:54:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.387+0000 7f10405a3640 1 -- 172.21.15.55:0/2319771619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10380c97b0 con 0x7f10380d03c0 2023-07-06T21:54:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.387+0000 7f10405a3640 1 -- 172.21.15.55:0/2319771619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10380c99a0 con 0x7f10380d03c0 2023-07-06T21:54:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.387+0000 7f102effd640 1 -- 172.21.15.55:0/2319771619 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f10280b43f0 con 0x7f10380d03c0 2023-07-06T21:54:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.387+0000 7f102effd640 1 --2- 172.21.15.55:0/2319771619 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f101c066430 0x7f101c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.387+0000 7f102effd640 1 -- 172.21.15.55:0/2319771619 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 7602+0+0 (secure 0 0 0) 0x7f10280a8050 con 0x7f10380d03c0 2023-07-06T21:54:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.387+0000 7f103e33f640 1 -- 172.21.15.55:0/2319771619 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f101c066430 msgr2=0x7f101c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1149809384 2023-07-06T21:54:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.387+0000 7f103e33f640 1 --2- 172.21.15.55:0/2319771619 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f101c066430 0x7f101c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:54:43.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.391+0000 7f102effd640 1 -- 172.21.15.55:0/2319771619 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f10380c99a0 con 0x7f10380d03c0 2023-07-06T21:54:43.429 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:43.427+0000 7f213e047180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:54:43.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.551+0000 7f10405a3640 1 -- 172.21.15.55:0/2319771619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10380c99a0 con 0x7f10380d03c0 2023-07-06T21:54:43.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.555+0000 7f102effd640 1 -- 172.21.15.55:0/2319771619 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10380c99a0 con 0x7f10380d03c0 2023-07-06T21:54:43.554 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:54:43.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.555+0000 7f10405a3640 1 -- 172.21.15.55:0/2319771619 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f101c066430 msgr2=0x7f101c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:54:43.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.555+0000 7f10405a3640 1 --2- 172.21.15.55:0/2319771619 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f101c066430 0x7f101c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.555+0000 7f10405a3640 1 -- 172.21.15.55:0/2319771619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10380d03c0 msgr2=0x7f103815ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.555+0000 7f10405a3640 1 --2- 172.21.15.55:0/2319771619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10380d03c0 0x7f103815ea10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f10280ad040 tx=0x7f102801ac30 comp rx=0 tx=0).stop 2023-07-06T21:54:43.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.555+0000 7f10405a3640 1 -- 172.21.15.55:0/2319771619 shutdown_connections 2023-07-06T21:54:43.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.555+0000 7f10405a3640 1 --2- 172.21.15.55:0/2319771619 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f101c066430 0x7f101c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.555+0000 7f10405a3640 1 --2- 172.21.15.55:0/2319771619 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f103815b850 0x7f10380c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.555+0000 7f10405a3640 1 --2- 172.21.15.55:0/2319771619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10380d03c0 0x7f103815ea10 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.555+0000 7f10405a3640 1 --2- 172.21.15.55:0/2319771619 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10380b3870 0x7f10380c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.555+0000 7f10405a3640 1 -- 172.21.15.55:0/2319771619 >> 172.21.15.55:0/2319771619 conn(0x7f10380cec20 msgr2=0x7f103815f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.555+0000 7f10405a3640 1 -- 172.21.15.55:0/2319771619 shutdown_connections 2023-07-06T21:54:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.555+0000 7f10405a3640 1 -- 172.21.15.55:0/2319771619 wait complete. 2023-07-06T21:54:43.575 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:54:43.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.763+0000 7ff2d740b640 1 Processor -- start 2023-07-06T21:54:43.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.763+0000 7ff2d740b640 1 -- start start 2023-07-06T21:54:43.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.763+0000 7ff2d740b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2d015b850 0x7ff2d00cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.763+0000 7ff2d740b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d00b2b80 con 0x7ff2d00ccd30 2023-07-06T21:54:43.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.763+0000 7ff2d740b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d00cff30 con 0x7ff2d00b3f80 2023-07-06T21:54:43.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.763+0000 7ff2d740b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d00b22e0 con 0x7ff2d015b850 2023-07-06T21:54:43.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.763+0000 7ff2d51a7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2d015b850 0x7ff2d00cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:43.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.763+0000 7ff2d51a7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2d015b850 0x7ff2d00cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32840/0 (socket says 172.21.15.55:32840) 2023-07-06T21:54:43.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.763+0000 7ff2d51a7640 1 -- 172.21.15.55:0/3224652914 learned_addr learned my addr 172.21.15.55:0/3224652914 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:43.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.763+0000 7ff2d49a6640 1 --1- 172.21.15.55:0/3224652914 >> v1:172.21.15.55:6789/0 conn(0x7ff2d00ccd30 0x7ff2d00b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44082/0 (socket says 172.21.15.55:44082) 2023-07-06T21:54:43.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.767+0000 7ff2d51a7640 1 -- 172.21.15.55:0/3224652914 >> v1:172.21.15.138:6789/0 conn(0x7ff2d00b3f80 legacy=0x7ff2d00d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.767+0000 7ff2d51a7640 1 -- 172.21.15.55:0/3224652914 >> v1:172.21.15.55:6789/0 conn(0x7ff2d00ccd30 legacy=0x7ff2d00b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.767+0000 7ff2d51a7640 1 -- 172.21.15.55:0/3224652914 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d00b25c0 con 0x7ff2d015b850 2023-07-06T21:54:43.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.767+0000 7ff2c7fff640 1 -- 172.21.15.55:0/3224652914 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468211827 0 0) 0x7ff2d00b2b80 con 0x7ff2d00ccd30 2023-07-06T21:54:43.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.767+0000 7ff2d51a7640 1 --2- 172.21.15.55:0/3224652914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d015b850 0x7ff2d00cc7f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009870 tx=0x7ff2cc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e690824898748118 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:43.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.767+0000 7ff2c7fff640 1 -- 172.21.15.55:0/3224652914 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc0ad680 con 0x7ff2d015b850 2023-07-06T21:54:43.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.767+0000 7ff2c7fff640 1 -- 172.21.15.55:0/3224652914 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc0ad7e0 con 0x7ff2d015b850 2023-07-06T21:54:43.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.767+0000 7ff2c7fff640 1 -- 172.21.15.55:0/3224652914 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc0adb70 con 0x7ff2d015b850 2023-07-06T21:54:43.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 -- 172.21.15.55:0/3224652914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d015b850 msgr2=0x7ff2d00cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 --2- 172.21.15.55:0/3224652914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d015b850 0x7ff2d00cc7f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009870 tx=0x7ff2cc01c3f0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 -- 172.21.15.55:0/3224652914 shutdown_connections 2023-07-06T21:54:43.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 --2- 172.21.15.55:0/3224652914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d015b850 0x7ff2d00cc7f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 -- 172.21.15.55:0/3224652914 >> 172.21.15.55:0/3224652914 conn(0x7ff2d00cec20 msgr2=0x7ff2d00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:43.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 -- 172.21.15.55:0/3224652914 shutdown_connections 2023-07-06T21:54:43.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 -- 172.21.15.55:0/3224652914 wait complete. 2023-07-06T21:54:43.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 Processor -- start 2023-07-06T21:54:43.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 -- start start 2023-07-06T21:54:43.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2d00b3f80 0x7ff2d014cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2d00ccd30 0x7ff2d00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d015b850 0x7ff2d0152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d01f7f10 con 0x7ff2d015b850 2023-07-06T21:54:43.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d014d240 con 0x7ff2d00ccd30 2023-07-06T21:54:43.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d740b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d01f39f0 con 0x7ff2d00b3f80 2023-07-06T21:54:43.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d59a8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d015b850 0x7ff2d0152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:43.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d59a8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d015b850 0x7ff2d0152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32844/0 (socket says 172.21.15.55:32844) 2023-07-06T21:54:43.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d59a8640 1 -- 172.21.15.55:0/11339134 learned_addr learned my addr 172.21.15.55:0/11339134 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:43.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d51a7640 1 --2- 172.21.15.55:0/11339134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2d00b3f80 0x7ff2d014cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:43.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.771+0000 7ff2d49a6640 1 --2- 172.21.15.55:0/11339134 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2d00ccd30 0x7ff2d00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:43.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2d59a8640 1 -- 172.21.15.55:0/11339134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2d00b3f80 msgr2=0x7ff2d014cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2d59a8640 1 --2- 172.21.15.55:0/11339134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2d00b3f80 0x7ff2d014cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2d59a8640 1 -- 172.21.15.55:0/11339134 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2d00ccd30 msgr2=0x7ff2d00c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2d59a8640 1 --2- 172.21.15.55:0/11339134 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2d00ccd30 0x7ff2d00c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2d59a8640 1 -- 172.21.15.55:0/11339134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc0094d0 con 0x7ff2d015b850 2023-07-06T21:54:43.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2d59a8640 1 --2- 172.21.15.55:0/11339134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d015b850 0x7ff2d0152820 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800c7d0 tx=0x7ff2c800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:43.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2c5ffb640 1 -- 172.21.15.55:0/11339134 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8003bd0 con 0x7ff2d015b850 2023-07-06T21:54:43.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2c5ffb640 1 -- 172.21.15.55:0/11339134 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c8003d50 con 0x7ff2d015b850 2023-07-06T21:54:43.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2d740b640 1 -- 172.21.15.55:0/11339134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d015bda0 con 0x7ff2d015b850 2023-07-06T21:54:43.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2c5ffb640 1 -- 172.21.15.55:0/11339134 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c800aa90 con 0x7ff2d015b850 2023-07-06T21:54:43.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2d740b640 1 -- 172.21.15.55:0/11339134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d01f7670 con 0x7ff2d015b850 2023-07-06T21:54:43.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2d740b640 1 -- 172.21.15.55:0/11339134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d01f3b90 con 0x7ff2d015b850 2023-07-06T21:54:43.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2c5ffb640 1 -- 172.21.15.55:0/11339134 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7ff2c800abf0 con 0x7ff2d015b850 2023-07-06T21:54:43.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2c5ffb640 1 --2- 172.21.15.55:0/11339134 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff2b4066430 0x7ff2b40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:43.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2d51a7640 1 -- 172.21.15.55:0/11339134 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff2b4066430 msgr2=0x7ff2b40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1149809384 2023-07-06T21:54:43.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2c5ffb640 1 -- 172.21.15.55:0/11339134 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 7602+0+0 (secure 0 0 0) 0x7ff2c80843a0 con 0x7ff2d015b850 2023-07-06T21:54:43.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.775+0000 7ff2d51a7640 1 --2- 172.21.15.55:0/11339134 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff2b4066430 0x7ff2b40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:54:43.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.779+0000 7ff2c5ffb640 1 -- 172.21.15.55:0/11339134 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff2d01f3b90 con 0x7ff2d015b850 2023-07-06T21:54:43.848 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:43.845+0000 7f0b09a01180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:54:43.906 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:43.905+0000 7f0b09a01180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:54:43.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.935+0000 7ff2d740b640 1 -- 172.21.15.55:0/11339134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff2d01f3b60 con 0x7ff2d015b850 2023-07-06T21:54:43.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.935+0000 7ff2c5ffb640 1 -- 172.21.15.55:0/11339134 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff2c8058e60 con 0x7ff2d015b850 2023-07-06T21:54:43.937 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:54:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.939+0000 7ff2d740b640 1 -- 172.21.15.55:0/11339134 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff2b4066430 msgr2=0x7ff2b40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:54:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.939+0000 7ff2d740b640 1 --2- 172.21.15.55:0/11339134 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff2b4066430 0x7ff2b40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.939+0000 7ff2d740b640 1 -- 172.21.15.55:0/11339134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d015b850 msgr2=0x7ff2d0152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.939+0000 7ff2d740b640 1 --2- 172.21.15.55:0/11339134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d015b850 0x7ff2d0152820 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800c7d0 tx=0x7ff2c800cc90 comp rx=0 tx=0).stop 2023-07-06T21:54:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.939+0000 7ff2d740b640 1 -- 172.21.15.55:0/11339134 shutdown_connections 2023-07-06T21:54:43.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.939+0000 7ff2d740b640 1 --2- 172.21.15.55:0/11339134 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7ff2b4066430 0x7ff2b40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.939+0000 7ff2d740b640 1 --2- 172.21.15.55:0/11339134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d015b850 0x7ff2d0152820 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.939+0000 7ff2d740b640 1 --2- 172.21.15.55:0/11339134 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2d00ccd30 0x7ff2d00c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.939+0000 7ff2d740b640 1 --2- 172.21.15.55:0/11339134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2d00b3f80 0x7ff2d014cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:43.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.939+0000 7ff2d740b640 1 -- 172.21.15.55:0/11339134 >> 172.21.15.55:0/11339134 conn(0x7ff2d00cec20 msgr2=0x7ff2d00b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:43.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.939+0000 7ff2d740b640 1 -- 172.21.15.55:0/11339134 shutdown_connections 2023-07-06T21:54:43.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:43.939+0000 7ff2d740b640 1 -- 172.21.15.55:0/11339134 wait complete. 2023-07-06T21:54:43.946 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:43.947+0000 7f213e047180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:54:43.958 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:54:43.962 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:43.961+0000 7f0b09a01180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:54:44.010 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:44.011+0000 7f213e047180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:54:44.046 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:44.045+0000 7f0b09a01180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:54:44.072 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:44.071+0000 7f213e047180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:54:44.104 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:44.101+0000 7f0b09a01180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:54:44.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80b6b59640 1 Processor -- start 2023-07-06T21:54:44.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80b6b59640 1 -- start start 2023-07-06T21:54:44.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80b6b59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80b015b850 0x7f80b00cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80b6b59640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f80b00ccd30 0x7f80b00b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80b6b59640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b00b2b80 con 0x7f80b00b3db0 2023-07-06T21:54:44.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80b6b59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b00cff30 con 0x7f80b015b850 2023-07-06T21:54:44.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80b6b59640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b00b41d0 con 0x7f80b00ccd30 2023-07-06T21:54:44.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80b48f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80b015b850 0x7f80b00cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80b48f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80b015b850 0x7f80b00cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32848/0 (socket says 172.21.15.55:32848) 2023-07-06T21:54:44.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80b48f5640 1 -- 172.21.15.55:0/3043746698 learned_addr learned my addr 172.21.15.55:0/3043746698 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:44.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80affff640 1 --2- 172.21.15.55:0/3043746698 >> v2:172.21.15.138:3300/0 conn(0x7f80b00ccd30 0x7f80b00b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80b48f5640 1 -- 172.21.15.55:0/3043746698 >> v2:172.21.15.138:3300/0 conn(0x7f80b00ccd30 msgr2=0x7f80b00b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:44.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80b48f5640 1 --2- 172.21.15.55:0/3043746698 >> v2:172.21.15.138:3300/0 conn(0x7f80b00ccd30 0x7f80b00b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80b48f5640 1 -- 172.21.15.55:0/3043746698 >> v1:172.21.15.138:6789/0 conn(0x7f80b00b3db0 legacy=0x7f80b015f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:44.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.107+0000 7f80b48f5640 1 -- 172.21.15.55:0/3043746698 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b00b22e0 con 0x7f80b015b850 2023-07-06T21:54:44.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.111+0000 7f80b48f5640 1 --2- 172.21.15.55:0/3043746698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80b015b850 0x7f80b00cc7f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f80b00cebd0 tx=0x7f80a401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500bced52e422146 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:44.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.111+0000 7f80af7fe640 1 -- 172.21.15.55:0/3043746698 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a40ac410 con 0x7f80b015b850 2023-07-06T21:54:44.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.111+0000 7f80af7fe640 1 -- 172.21.15.55:0/3043746698 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a40ac570 con 0x7f80b015b850 2023-07-06T21:54:44.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.111+0000 7f80af7fe640 1 -- 172.21.15.55:0/3043746698 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a40ac900 con 0x7f80b015b850 2023-07-06T21:54:44.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.111+0000 7f80b6b59640 1 -- 172.21.15.55:0/3043746698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80b015b850 msgr2=0x7f80b00cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:44.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.111+0000 7f80b6b59640 1 --2- 172.21.15.55:0/3043746698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80b015b850 0x7f80b00cc7f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f80b00cebd0 tx=0x7f80a401c3b0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.111+0000 7f80b6b59640 1 -- 172.21.15.55:0/3043746698 shutdown_connections 2023-07-06T21:54:44.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.111+0000 7f80b6b59640 1 --2- 172.21.15.55:0/3043746698 >> v2:172.21.15.138:3300/0 conn(0x7f80b00ccd30 0x7f80b00b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.111+0000 7f80b6b59640 1 --2- 172.21.15.55:0/3043746698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80b015b850 0x7f80b00cc7f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.111+0000 7f80b6b59640 1 -- 172.21.15.55:0/3043746698 >> 172.21.15.55:0/3043746698 conn(0x7f80b00cec20 msgr2=0x7f80b00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:44.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.111+0000 7f80b6b59640 1 -- 172.21.15.55:0/3043746698 shutdown_connections 2023-07-06T21:54:44.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.111+0000 7f80b6b59640 1 -- 172.21.15.55:0/3043746698 wait complete. 2023-07-06T21:54:44.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b6b59640 1 Processor -- start 2023-07-06T21:54:44.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b6b59640 1 -- start start 2023-07-06T21:54:44.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b6b59640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80b00b3db0 0x7f80b00b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b6b59640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80b00ccd30 0x7f80b0150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b6b59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80b015b850 0x7f80b01f7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b6b59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b015b100 con 0x7f80b015b850 2023-07-06T21:54:44.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b6b59640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b00b76b0 con 0x7f80b00b3db0 2023-07-06T21:54:44.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b6b59640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b00c9940 con 0x7f80b00ccd30 2023-07-06T21:54:44.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b50f6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80b015b850 0x7f80b01f7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b48f5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80b00b3db0 0x7f80b00b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80affff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80b00ccd30 0x7f80b0150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b50f6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80b015b850 0x7f80b01f7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32860/0 (socket says 172.21.15.55:32860) 2023-07-06T21:54:44.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b48f5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80b00b3db0 0x7f80b00b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:36170/0 (socket says 172.21.15.55:36170) 2023-07-06T21:54:44.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b50f6640 1 -- 172.21.15.55:0/2314064861 learned_addr learned my addr 172.21.15.55:0/2314064861 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:44.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b50f6640 1 -- 172.21.15.55:0/2314064861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80b00ccd30 msgr2=0x7f80b0150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:44.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b50f6640 1 --2- 172.21.15.55:0/2314064861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80b00ccd30 0x7f80b0150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b50f6640 1 -- 172.21.15.55:0/2314064861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80b00b3db0 msgr2=0x7f80b00b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b50f6640 1 --2- 172.21.15.55:0/2314064861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80b00b3db0 0x7f80b00b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b50f6640 1 -- 172.21.15.55:0/2314064861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a40094d0 con 0x7f80b015b850 2023-07-06T21:54:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b50f6640 1 --2- 172.21.15.55:0/2314064861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80b015b850 0x7f80b01f7a60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f80a800c7a0 tx=0x7f80a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80ad7fa640 1 -- 172.21.15.55:0/2314064861 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8003bd0 con 0x7f80b015b850 2023-07-06T21:54:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80ad7fa640 1 -- 172.21.15.55:0/2314064861 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a8003d50 con 0x7f80b015b850 2023-07-06T21:54:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b6b59640 1 -- 172.21.15.55:0/2314064861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b015bda0 con 0x7f80b015b850 2023-07-06T21:54:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80ad7fa640 1 -- 172.21.15.55:0/2314064861 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a800aa30 con 0x7f80b015b850 2023-07-06T21:54:44.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.115+0000 7f80b6b59640 1 -- 172.21.15.55:0/2314064861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b015a920 con 0x7f80b015b850 2023-07-06T21:54:44.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.119+0000 7f80b6b59640 1 -- 172.21.15.55:0/2314064861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b0066d60 con 0x7f80b015b850 2023-07-06T21:54:44.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.119+0000 7f80ad7fa640 1 -- 172.21.15.55:0/2314064861 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f80a800ab90 con 0x7f80b015b850 2023-07-06T21:54:44.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.119+0000 7f80ad7fa640 1 --2- 172.21.15.55:0/2314064861 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f8094066430 0x7f80940688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.119+0000 7f80ad7fa640 1 -- 172.21.15.55:0/2314064861 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 7602+0+0 (secure 0 0 0) 0x7f80a8084370 con 0x7f80b015b850 2023-07-06T21:54:44.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.119+0000 7f80b48f5640 1 -- 172.21.15.55:0/2314064861 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f8094066430 msgr2=0x7f80940688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1149809384 2023-07-06T21:54:44.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.119+0000 7f80b48f5640 1 --2- 172.21.15.55:0/2314064861 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f8094066430 0x7f80940688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:54:44.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.123+0000 7f80ad7fa640 1 -- 172.21.15.55:0/2314064861 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f80a8051010 con 0x7f80b015b850 2023-07-06T21:54:44.166 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:44.167+0000 7f213e047180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:54:44.188 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:44.185+0000 7f0b09a01180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:54:44.226 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:44.227+0000 7f213e047180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:54:44.243 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:44.241+0000 7f0b09a01180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:54:44.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.279+0000 7f80b6b59640 1 -- 172.21.15.55:0/2314064861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80b00b3420 con 0x7f80b015b850 2023-07-06T21:54:44.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.283+0000 7f80ad7fa640 1 -- 172.21.15.55:0/2314064861 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80a8054630 con 0x7f80b015b850 2023-07-06T21:54:44.282 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:54:44.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.283+0000 7f80b6b59640 1 -- 172.21.15.55:0/2314064861 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f8094066430 msgr2=0x7f80940688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:54:44.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.283+0000 7f80b6b59640 1 --2- 172.21.15.55:0/2314064861 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f8094066430 0x7f80940688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.283+0000 7f80b6b59640 1 -- 172.21.15.55:0/2314064861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80b015b850 msgr2=0x7f80b01f7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:44.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.283+0000 7f80b6b59640 1 --2- 172.21.15.55:0/2314064861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80b015b850 0x7f80b01f7a60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f80a800c7a0 tx=0x7f80a800cc60 comp rx=0 tx=0).stop 2023-07-06T21:54:44.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.283+0000 7f80b6b59640 1 -- 172.21.15.55:0/2314064861 shutdown_connections 2023-07-06T21:54:44.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.283+0000 7f80b6b59640 1 --2- 172.21.15.55:0/2314064861 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f8094066430 0x7f80940688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.283+0000 7f80b6b59640 1 --2- 172.21.15.55:0/2314064861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80b015b850 0x7f80b01f7a60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.283+0000 7f80b6b59640 1 --2- 172.21.15.55:0/2314064861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80b00ccd30 0x7f80b0150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.283+0000 7f80b6b59640 1 --2- 172.21.15.55:0/2314064861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80b00b3db0 0x7f80b00b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.283+0000 7f80b6b59640 1 -- 172.21.15.55:0/2314064861 >> 172.21.15.55:0/2314064861 conn(0x7f80b00cec20 msgr2=0x7f80b00d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:44.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.283+0000 7f80b6b59640 1 -- 172.21.15.55:0/2314064861 shutdown_connections 2023-07-06T21:54:44.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.283+0000 7f80b6b59640 1 -- 172.21.15.55:0/2314064861 wait complete. 2023-07-06T21:54:44.304 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:54:44.316 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:44.315+0000 7f213e047180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:54:44.376 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:44.375+0000 7f213e047180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:54:44.386 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:44.385+0000 7f0b09a01180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:54:44.443 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:44.441+0000 7f0b09a01180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:54:44.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.451+0000 7f261ebd3640 1 Processor -- start 2023-07-06T21:54:44.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.451+0000 7f261ebd3640 1 -- start start 2023-07-06T21:54:44.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.451+0000 7f261ebd3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f261815b850 0x7f26180cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.451+0000 7f261ebd3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f26180ccd30 0x7f26180b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.451+0000 7f261ebd3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f26180b3db0 0x7f261815f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.451+0000 7f261ebd3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26180b4210 con 0x7f261815b850 2023-07-06T21:54:44.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.451+0000 7f261ebd3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26180b2b80 con 0x7f26180b3db0 2023-07-06T21:54:44.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.451+0000 7f261ebd3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26180cff30 con 0x7f26180ccd30 2023-07-06T21:54:44.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.451+0000 7f261c96f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f261815b850 0x7f26180cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.451+0000 7f261c96f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f261815b850 0x7f26180cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32864/0 (socket says 172.21.15.55:32864) 2023-07-06T21:54:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.451+0000 7f261c96f640 1 -- 172.21.15.55:0/1181182873 learned_addr learned my addr 172.21.15.55:0/1181182873 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.451+0000 7f261d170640 1 --2- 172.21.15.55:0/1181182873 >> v2:172.21.15.138:3300/0 conn(0x7f26180b3db0 0x7f261815f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.451+0000 7f2617fff640 1 --2- 172.21.15.55:0/1181182873 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f26180ccd30 0x7f26180b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.455+0000 7f261c96f640 1 -- 172.21.15.55:0/1181182873 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f26180ccd30 msgr2=0x7f26180b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:44.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.455+0000 7f261c96f640 1 --2- 172.21.15.55:0/1181182873 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f26180ccd30 0x7f26180b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.455+0000 7f261c96f640 1 -- 172.21.15.55:0/1181182873 >> v2:172.21.15.138:3300/0 conn(0x7f26180b3db0 msgr2=0x7f261815f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:44.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.455+0000 7f261c96f640 1 --2- 172.21.15.55:0/1181182873 >> v2:172.21.15.138:3300/0 conn(0x7f26180b3db0 0x7f261815f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.455+0000 7f261c96f640 1 -- 172.21.15.55:0/1181182873 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26180b22e0 con 0x7f261815b850 2023-07-06T21:54:44.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.455+0000 7f2617fff640 1 --2- 172.21.15.55:0/1181182873 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f26180ccd30 0x7f26180b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:44.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.455+0000 7f261c96f640 1 --2- 172.21.15.55:0/1181182873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f261815b850 0x7f26180cc7f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2618160550 tx=0x7f260c01c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24a1175505ba512 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:44.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.455+0000 7f26177fe640 1 -- 172.21.15.55:0/1181182873 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0ab600 con 0x7f261815b850 2023-07-06T21:54:44.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.455+0000 7f26177fe640 1 -- 172.21.15.55:0/1181182873 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c0a7050 con 0x7f261815b850 2023-07-06T21:54:44.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.455+0000 7f26177fe640 1 -- 172.21.15.55:0/1181182873 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0ab980 con 0x7f261815b850 2023-07-06T21:54:44.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 -- 172.21.15.55:0/1181182873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f261815b850 msgr2=0x7f26180cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:44.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 --2- 172.21.15.55:0/1181182873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f261815b850 0x7f26180cc7f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2618160550 tx=0x7f260c01c0f0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 -- 172.21.15.55:0/1181182873 shutdown_connections 2023-07-06T21:54:44.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 --2- 172.21.15.55:0/1181182873 >> v2:172.21.15.138:3300/0 conn(0x7f26180b3db0 0x7f261815f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 --2- 172.21.15.55:0/1181182873 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f26180ccd30 0x7f26180b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 --2- 172.21.15.55:0/1181182873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f261815b850 0x7f26180cc7f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 -- 172.21.15.55:0/1181182873 >> 172.21.15.55:0/1181182873 conn(0x7f26180cec20 msgr2=0x7f26180cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:44.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 -- 172.21.15.55:0/1181182873 shutdown_connections 2023-07-06T21:54:44.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 -- 172.21.15.55:0/1181182873 wait complete. 2023-07-06T21:54:44.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 Processor -- start 2023-07-06T21:54:44.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 -- start start 2023-07-06T21:54:44.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26180b3db0 0x7f2618143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26180ccd30 0x7f261815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f261815b850 0x7f26180ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261815a680 con 0x7f26180b3db0 2023-07-06T21:54:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26180c86e0 con 0x7f26180ccd30 2023-07-06T21:54:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.459+0000 7f261ebd3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2618159a00 con 0x7f261815b850 2023-07-06T21:54:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f261c96f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26180b3db0 0x7f2618143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f261c96f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26180b3db0 0x7f2618143300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32870/0 (socket says 172.21.15.55:32870) 2023-07-06T21:54:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f261c96f640 1 -- 172.21.15.55:0/3369003903 learned_addr learned my addr 172.21.15.55:0/3369003903 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f2617fff640 1 --2- 172.21.15.55:0/3369003903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26180ccd30 0x7f261815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f261d170640 1 --2- 172.21.15.55:0/3369003903 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f261815b850 0x7f26180ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f261c96f640 1 -- 172.21.15.55:0/3369003903 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f261815b850 msgr2=0x7f26180ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:44.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f261c96f640 1 --2- 172.21.15.55:0/3369003903 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f261815b850 0x7f26180ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f261c96f640 1 -- 172.21.15.55:0/3369003903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26180ccd30 msgr2=0x7f261815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:44.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f261c96f640 1 --2- 172.21.15.55:0/3369003903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26180ccd30 0x7f261815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f261c96f640 1 -- 172.21.15.55:0/3369003903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0094d0 con 0x7f26180b3db0 2023-07-06T21:54:44.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f261c96f640 1 --2- 172.21.15.55:0/3369003903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26180b3db0 0x7f2618143300 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f260c0ae040 tx=0x7f260c018e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:44.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f26157fa640 1 -- 172.21.15.55:0/3369003903 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0b4440 con 0x7f26180b3db0 2023-07-06T21:54:44.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f26157fa640 1 -- 172.21.15.55:0/3369003903 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c0b45c0 con 0x7f26180b3db0 2023-07-06T21:54:44.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f26157fa640 1 -- 172.21.15.55:0/3369003903 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0b4970 con 0x7f26180b3db0 2023-07-06T21:54:44.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f261ebd3640 1 -- 172.21.15.55:0/3369003903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261815bda0 con 0x7f26180b3db0 2023-07-06T21:54:44.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f261ebd3640 1 -- 172.21.15.55:0/3369003903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2618159fc0 con 0x7f26180b3db0 2023-07-06T21:54:44.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f261ebd3640 1 -- 172.21.15.55:0/3369003903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2618066d60 con 0x7f26180b3db0 2023-07-06T21:54:44.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.463+0000 7f26157fa640 1 -- 172.21.15.55:0/3369003903 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f260c0b2070 con 0x7f26180b3db0 2023-07-06T21:54:44.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.467+0000 7f26157fa640 1 --2- 172.21.15.55:0/3369003903 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f25fc066430 0x7f25fc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.467+0000 7f26157fa640 1 -- 172.21.15.55:0/3369003903 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 7602+0+0 (secure 0 0 0) 0x7f260c11e4b0 con 0x7f26180b3db0 2023-07-06T21:54:44.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.467+0000 7f2617fff640 1 -- 172.21.15.55:0/3369003903 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f25fc066430 msgr2=0x7f25fc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1149809384 2023-07-06T21:54:44.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.467+0000 7f2617fff640 1 --2- 172.21.15.55:0/3369003903 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f25fc066430 0x7f25fc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:54:44.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.471+0000 7f26157fa640 1 -- 172.21.15.55:0/3369003903 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f260c0eb030 con 0x7f26180b3db0 2023-07-06T21:54:44.530 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:44.531+0000 7f213e047180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:54:44.596 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:44.595+0000 7f213e047180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:54:44.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.639+0000 7f261ebd3640 1 -- 172.21.15.55:0/3369003903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26180b3420 con 0x7f26180b3db0 2023-07-06T21:54:44.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.639+0000 7f26157fa640 1 -- 172.21.15.55:0/3369003903 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f260c0f2e60 con 0x7f26180b3db0 2023-07-06T21:54:44.638 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:54:44.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.639+0000 7f261ebd3640 1 -- 172.21.15.55:0/3369003903 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f25fc066430 msgr2=0x7f25fc0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:54:44.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.639+0000 7f261ebd3640 1 --2- 172.21.15.55:0/3369003903 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f25fc066430 0x7f25fc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.639+0000 7f261ebd3640 1 -- 172.21.15.55:0/3369003903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26180b3db0 msgr2=0x7f2618143300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:44.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.639+0000 7f261ebd3640 1 --2- 172.21.15.55:0/3369003903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26180b3db0 0x7f2618143300 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f260c0ae040 tx=0x7f260c018e90 comp rx=0 tx=0).stop 2023-07-06T21:54:44.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.639+0000 7f261ebd3640 1 -- 172.21.15.55:0/3369003903 shutdown_connections 2023-07-06T21:54:44.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.639+0000 7f261ebd3640 1 --2- 172.21.15.55:0/3369003903 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f25fc066430 0x7f25fc0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.639+0000 7f261ebd3640 1 --2- 172.21.15.55:0/3369003903 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f261815b850 0x7f26180ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.639+0000 7f261ebd3640 1 --2- 172.21.15.55:0/3369003903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26180ccd30 0x7f261815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.639+0000 7f261ebd3640 1 --2- 172.21.15.55:0/3369003903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26180b3db0 0x7f2618143300 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.639+0000 7f261ebd3640 1 -- 172.21.15.55:0/3369003903 >> 172.21.15.55:0/3369003903 conn(0x7f26180cec20 msgr2=0x7f2618157cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:44.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.639+0000 7f261ebd3640 1 -- 172.21.15.55:0/3369003903 shutdown_connections 2023-07-06T21:54:44.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.639+0000 7f261ebd3640 1 -- 172.21.15.55:0/3369003903 wait complete. 2023-07-06T21:54:44.660 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T21:54:44.686 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:54:44.686 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:54:44.686 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:54:44.694 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:44.693+0000 7f0b09a01180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:54:44.829 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:44.829+0000 7f0b09a01180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:54:44.855 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:54:44.855 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:54:44.855 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:54:44.863 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:44.863+0000 7f213e047180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:54:44.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.883+0000 7fb93fddb640 1 Processor -- start 2023-07-06T21:54:44.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.883+0000 7fb93fddb640 1 -- start start 2023-07-06T21:54:44.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.887+0000 7fb93fddb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb93806f140 0x7fb93815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.887+0000 7fb93fddb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9380ad0e0 con 0x7fb93806ca90 2023-07-06T21:54:44.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.887+0000 7fb93fddb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9380ad610 con 0x7fb9380c9e00 2023-07-06T21:54:44.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.887+0000 7fb93fddb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb938070070 con 0x7fb93806f140 2023-07-06T21:54:44.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.887+0000 7fb93d376640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb93806ca90 0x7fb9380cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44086/0 (socket says 172.21.15.55:44086) 2023-07-06T21:54:44.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.887+0000 7fb93d376640 1 -- 172.21.15.55:0/1643372148 learned_addr learned my addr 172.21.15.55:0/1643372148 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:44.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.887+0000 7fb93db77640 1 --2- 172.21.15.55:0/1643372148 >> v2:172.21.15.138:3300/0 conn(0x7fb93806f140 0x7fb93815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.887+0000 7fb93db77640 1 -- 172.21.15.55:0/1643372148 >> v1:172.21.15.138:6789/0 conn(0x7fb9380c9e00 legacy=0x7fb9380cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:44.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.887+0000 7fb93db77640 1 -- 172.21.15.55:0/1643372148 >> v1:172.21.15.55:6789/0 conn(0x7fb93806ca90 legacy=0x7fb9380cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:44.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.887+0000 7fb93cb75640 1 -- 172.21.15.55:0/1643372148 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224683276 0 0) 0x7fb9380ad0e0 con 0x7fb93806ca90 2023-07-06T21:54:44.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.891+0000 7fb93db77640 1 -- 172.21.15.55:0/1643372148 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9380cc740 con 0x7fb93806f140 2023-07-06T21:54:44.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.891+0000 7fb93db77640 1 --2- 172.21.15.55:0/1643372148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb93806f140 0x7fb93815aaf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009fd0 tx=0x7fb92c01fe60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba7a646a88c717c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:44.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.891+0000 7fb93cb75640 1 -- 172.21.15.55:0/1643372148 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c0a9c70 con 0x7fb93806f140 2023-07-06T21:54:44.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.891+0000 7fb93cb75640 1 -- 172.21.15.55:0/1643372148 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c0a9dd0 con 0x7fb93806f140 2023-07-06T21:54:44.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.891+0000 7fb93cb75640 1 -- 172.21.15.55:0/1643372148 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c0b1660 con 0x7fb93806f140 2023-07-06T21:54:44.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 -- 172.21.15.55:0/1643372148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb93806f140 msgr2=0x7fb93815aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:44.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 --2- 172.21.15.55:0/1643372148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb93806f140 0x7fb93815aaf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009fd0 tx=0x7fb92c01fe60 comp rx=0 tx=0).stop 2023-07-06T21:54:44.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 -- 172.21.15.55:0/1643372148 shutdown_connections 2023-07-06T21:54:44.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 --2- 172.21.15.55:0/1643372148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb93806f140 0x7fb93815aaf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 -- 172.21.15.55:0/1643372148 >> 172.21.15.55:0/1643372148 conn(0x7fb9380cea70 msgr2=0x7fb9380ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:44.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 -- 172.21.15.55:0/1643372148 shutdown_connections 2023-07-06T21:54:44.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 -- 172.21.15.55:0/1643372148 wait complete. 2023-07-06T21:54:44.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 Processor -- start 2023-07-06T21:54:44.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 -- start start 2023-07-06T21:54:44.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb93806ca90 0x7fb938154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb93806f140 0x7fb93809e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9380c9e00 0x7fb93809e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9380c3ab0 con 0x7fb9380c9e00 2023-07-06T21:54:44.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb938163cd0 con 0x7fb93806ca90 2023-07-06T21:54:44.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93fddb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb938154540 con 0x7fb93806f140 2023-07-06T21:54:44.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93db77640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb93806ca90 0x7fb938154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.895+0000 7fb93e378640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9380c9e00 0x7fb93809e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb93d376640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb93806f140 0x7fb93809e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:44.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb93db77640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb93806ca90 0x7fb938154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:36204/0 (socket says 172.21.15.55:36204) 2023-07-06T21:54:44.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb93e378640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9380c9e00 0x7fb93809e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32884/0 (socket says 172.21.15.55:32884) 2023-07-06T21:54:44.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb93db77640 1 -- 172.21.15.55:0/3479521613 learned_addr learned my addr 172.21.15.55:0/3479521613 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:44.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb93e378640 1 -- 172.21.15.55:0/3479521613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb93806f140 msgr2=0x7fb93809e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:44.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb93e378640 1 --2- 172.21.15.55:0/3479521613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb93806f140 0x7fb93809e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb93e378640 1 -- 172.21.15.55:0/3479521613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb93806ca90 msgr2=0x7fb938154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:44.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb93e378640 1 --2- 172.21.15.55:0/3479521613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb93806ca90 0x7fb938154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:44.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb93e378640 1 -- 172.21.15.55:0/3479521613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c009cb0 con 0x7fb9380c9e00 2023-07-06T21:54:44.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb93db77640 1 --2- 172.21.15.55:0/3479521613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb93806ca90 0x7fb938154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:44.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb93e378640 1 --2- 172.21.15.55:0/3479521613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9380c9e00 0x7fb93809e6b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb93000b3e0 tx=0x7fb93000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:44.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb9367fc640 1 -- 172.21.15.55:0/3479521613 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb930011830 con 0x7fb9380c9e00 2023-07-06T21:54:44.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb9367fc640 1 -- 172.21.15.55:0/3479521613 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb930011990 con 0x7fb9380c9e00 2023-07-06T21:54:44.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb93fddb640 1 -- 172.21.15.55:0/3479521613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9380c34f0 con 0x7fb9380c9e00 2023-07-06T21:54:44.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb9367fc640 1 -- 172.21.15.55:0/3479521613 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb930011d80 con 0x7fb9380c9e00 2023-07-06T21:54:44.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb93fddb640 1 -- 172.21.15.55:0/3479521613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb938163960 con 0x7fb9380c9e00 2023-07-06T21:54:44.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb93fddb640 1 -- 172.21.15.55:0/3479521613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9381637c0 con 0x7fb9380c9e00 2023-07-06T21:54:44.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.899+0000 7fb9367fc640 1 -- 172.21.15.55:0/3479521613 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7fb93001a400 con 0x7fb9380c9e00 2023-07-06T21:54:44.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.903+0000 7fb9367fc640 1 --2- 172.21.15.55:0/3479521613 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fb924066460 0x7fb924068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:44.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.903+0000 7fb93db77640 1 -- 172.21.15.55:0/3479521613 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fb924066460 msgr2=0x7fb924068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1149809384 2023-07-06T21:54:44.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.903+0000 7fb9367fc640 1 -- 172.21.15.55:0/3479521613 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 7570+0+0 (secure 0 0 0) 0x7fb9300842f0 con 0x7fb9380c9e00 2023-07-06T21:54:44.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.903+0000 7fb93db77640 1 --2- 172.21.15.55:0/3479521613 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fb924066460 0x7fb924068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:54:44.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:44.907+0000 7fb9367fc640 1 -- 172.21.15.55:0/3479521613 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9381637c0 con 0x7fb9380c9e00 2023-07-06T21:54:44.957 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:44.957+0000 7f0b09a01180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:54:45.012 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:45.011+0000 7f213e047180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:54:45.027 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:45.025+0000 7f0b09a01180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:54:45.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.075+0000 7fb93fddb640 1 -- 172.21.15.55:0/3479521613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb9381637c0 con 0x7fb9380c9e00 2023-07-06T21:54:45.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.075+0000 7fb9367fc640 1 -- 172.21.15.55:0/3479521613 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v58) v1 ==== 80+0+354 (secure 0 0 0) 0x7fb9381637c0 con 0x7fb9380c9e00 2023-07-06T21:54:45.076 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2066223848 2023-07-07T21:43:45.377574+0000 2023-07-06T21:54:45.077 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/1575998409 2023-07-07T21:43:45.377574+0000 2023-07-06T21:54:45.077 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/1575998409 2023-07-07T21:43:45.377574+0000 2023-07-06T21:54:45.077 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2297905762 2023-07-07T21:43:45.377574+0000 2023-07-06T21:54:45.077 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1005520698 2023-07-07T21:43:45.377574+0000 2023-07-06T21:54:45.077 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2605447220 2023-07-07T21:43:45.377574+0000 2023-07-06T21:54:45.078 INFO:teuthology.orchestra.run.smithi055.stderr:listed 6 entries 2023-07-06T21:54:45.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.079+0000 7fb93fddb640 1 -- 172.21.15.55:0/3479521613 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fb924066460 msgr2=0x7fb924068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:54:45.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.079+0000 7fb93fddb640 1 --2- 172.21.15.55:0/3479521613 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fb924066460 0x7fb924068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.079+0000 7fb93fddb640 1 -- 172.21.15.55:0/3479521613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9380c9e00 msgr2=0x7fb93809e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:45.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.079+0000 7fb93fddb640 1 --2- 172.21.15.55:0/3479521613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9380c9e00 0x7fb93809e6b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb93000b3e0 tx=0x7fb93000b8a0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.079+0000 7fb93fddb640 1 -- 172.21.15.55:0/3479521613 shutdown_connections 2023-07-06T21:54:45.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.079+0000 7fb93fddb640 1 --2- 172.21.15.55:0/3479521613 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fb924066460 0x7fb924068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.079+0000 7fb93fddb640 1 --2- 172.21.15.55:0/3479521613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9380c9e00 0x7fb93809e6b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.079+0000 7fb93fddb640 1 --2- 172.21.15.55:0/3479521613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb93806f140 0x7fb93809e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.079+0000 7fb93fddb640 1 --2- 172.21.15.55:0/3479521613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb93806ca90 0x7fb938154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.079+0000 7fb93fddb640 1 -- 172.21.15.55:0/3479521613 >> 172.21.15.55:0/3479521613 conn(0x7fb9380cea70 msgr2=0x7fb9380b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:45.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.079+0000 7fb93fddb640 1 -- 172.21.15.55:0/3479521613 shutdown_connections 2023-07-06T21:54:45.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.079+0000 7fb93fddb640 1 -- 172.21.15.55:0/3479521613 wait complete. 2023-07-06T21:54:45.097 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T21:54:45.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:45.098 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-06T21:54:45.147 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:45.147+0000 7f213e047180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:54:45.161 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:45.161+0000 7f0b09a01180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:54:45.165 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T21:54:45.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:54:45.166 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T21:54:45.175 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:54:45.175 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:54:45.184 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:54:45.185 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:54:45.185 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:54:45.222 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:45.223+0000 7f213e047180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:54:45.227 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T21:54:45.228 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:54:45.228 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:54:45.238 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:54:45.239 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:54:45.365 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:45.363+0000 7f213e047180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:54:45.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.411+0000 7f00ea9fa640 1 Processor -- start 2023-07-06T21:54:45.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.411+0000 7f00ea9fa640 1 -- start start 2023-07-06T21:54:45.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00ea9fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00e40712f0 0x7f00e406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:45.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00ea9fa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f00e40ca450 0x7f00e415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:45.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00ea9fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e4159cd0 con 0x7f00e40b3730 2023-07-06T21:54:45.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00ea9fa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e40693f0 con 0x7f00e40ca450 2023-07-06T21:54:45.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00ea9fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e406aca0 con 0x7f00e40712f0 2023-07-06T21:54:45.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00e37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f00e40b3730 0x7f00e40c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44096/0 (socket says 172.21.15.55:44096) 2023-07-06T21:54:45.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00e37fe640 1 -- 172.21.15.55:0/1954023385 learned_addr learned my addr 172.21.15.55:0/1954023385 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:45.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00e8f97640 1 --2- 172.21.15.55:0/1954023385 >> v2:172.21.15.138:3300/0 conn(0x7f00e40ca450 0x7f00e415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:45.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00e3fff640 1 --2- 172.21.15.55:0/1954023385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00e40712f0 0x7f00e406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:45.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00e2ffd640 1 -- 172.21.15.55:0/1954023385 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997998890 0 0) 0x7f00e4159cd0 con 0x7f00e40b3730 2023-07-06T21:54:45.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00e2ffd640 1 -- 172.21.15.55:0/1954023385 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00cc003530 con 0x7f00e40b3730 2023-07-06T21:54:45.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00e3fff640 1 -- 172.21.15.55:0/1954023385 >> v2:172.21.15.138:3300/0 conn(0x7f00e40ca450 msgr2=0x7f00e415d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:45.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00e3fff640 1 --2- 172.21.15.55:0/1954023385 >> v2:172.21.15.138:3300/0 conn(0x7f00e40ca450 0x7f00e415d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00e3fff640 1 -- 172.21.15.55:0/1954023385 >> v1:172.21.15.55:6789/0 conn(0x7f00e40b3730 legacy=0x7f00e40c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:45.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00e3fff640 1 -- 172.21.15.55:0/1954023385 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e40696b0 con 0x7f00e40712f0 2023-07-06T21:54:45.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.415+0000 7f00e8f97640 1 --2- 172.21.15.55:0/1954023385 >> v2:172.21.15.138:3300/0 conn(0x7f00e40ca450 0x7f00e415d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:45.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.419+0000 7f00e3fff640 1 --2- 172.21.15.55:0/1954023385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00e40712f0 0x7f00e406a610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f00d40097c0 tx=0x7f00d401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7520519f651df6fe server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:45.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.419+0000 7f00e2ffd640 1 -- 172.21.15.55:0/1954023385 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40ad660 con 0x7f00e40712f0 2023-07-06T21:54:45.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.419+0000 7f00e2ffd640 1 -- 172.21.15.55:0/1954023385 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d40ad7c0 con 0x7f00e40712f0 2023-07-06T21:54:45.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.419+0000 7f00e2ffd640 1 -- 172.21.15.55:0/1954023385 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40adb50 con 0x7f00e40712f0 2023-07-06T21:54:45.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.419+0000 7f00ea9fa640 1 -- 172.21.15.55:0/1954023385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00e40712f0 msgr2=0x7f00e406a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:45.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.419+0000 7f00ea9fa640 1 --2- 172.21.15.55:0/1954023385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00e40712f0 0x7f00e406a610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f00d40097c0 tx=0x7f00d401c450 comp rx=0 tx=0).stop 2023-07-06T21:54:45.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.419+0000 7f00ea9fa640 1 -- 172.21.15.55:0/1954023385 shutdown_connections 2023-07-06T21:54:45.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.419+0000 7f00ea9fa640 1 --2- 172.21.15.55:0/1954023385 >> v2:172.21.15.138:3300/0 conn(0x7f00e40ca450 0x7f00e415d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.419+0000 7f00ea9fa640 1 --2- 172.21.15.55:0/1954023385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00e40712f0 0x7f00e406a610 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.419+0000 7f00ea9fa640 1 -- 172.21.15.55:0/1954023385 >> 172.21.15.55:0/1954023385 conn(0x7f00e40cded0 msgr2=0x7f00e40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:45.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.419+0000 7f00ea9fa640 1 -- 172.21.15.55:0/1954023385 shutdown_connections 2023-07-06T21:54:45.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.419+0000 7f00ea9fa640 1 -- 172.21.15.55:0/1954023385 wait complete. 2023-07-06T21:54:45.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.419+0000 7f00ea9fa640 1 Processor -- start 2023-07-06T21:54:45.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00ea9fa640 1 -- start start 2023-07-06T21:54:45.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00ea9fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e40712f0 0x7f00e40cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:45.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00ea9fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00e40b3730 0x7f00e41520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:45.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00ea9fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00e40ca450 0x7f00e40ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:45.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00ea9fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40cc9c0 con 0x7f00e40712f0 2023-07-06T21:54:45.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00ea9fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40c2ae0 con 0x7f00e40ca450 2023-07-06T21:54:45.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00ea9fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40c2dc0 con 0x7f00e40b3730 2023-07-06T21:54:45.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00e3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e40712f0 0x7f00e40cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:45.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00e3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e40712f0 0x7f00e40cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32888/0 (socket says 172.21.15.55:32888) 2023-07-06T21:54:45.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00e3fff640 1 -- 172.21.15.55:0/3958888767 learned_addr learned my addr 172.21.15.55:0/3958888767 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:45.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00e8f97640 1 --2- 172.21.15.55:0/3958888767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00e40ca450 0x7f00e40ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:45.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00e37fe640 1 --2- 172.21.15.55:0/3958888767 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00e40b3730 0x7f00e41520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:45.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00e3fff640 1 -- 172.21.15.55:0/3958888767 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00e40b3730 msgr2=0x7f00e41520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:45.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00e3fff640 1 --2- 172.21.15.55:0/3958888767 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00e40b3730 0x7f00e41520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00e3fff640 1 -- 172.21.15.55:0/3958888767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00e40ca450 msgr2=0x7f00e40ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:45.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00e3fff640 1 --2- 172.21.15.55:0/3958888767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00e40ca450 0x7f00e40ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00e3fff640 1 -- 172.21.15.55:0/3958888767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc009a70 con 0x7f00e40712f0 2023-07-06T21:54:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00e3fff640 1 --2- 172.21.15.55:0/3958888767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e40712f0 0x7f00e40cc480 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f00d40b0040 tx=0x7f00d40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00e0ff9640 1 -- 172.21.15.55:0/3958888767 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40b6610 con 0x7f00e40712f0 2023-07-06T21:54:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00e0ff9640 1 -- 172.21.15.55:0/3958888767 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d40b6790 con 0x7f00e40712f0 2023-07-06T21:54:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00e0ff9640 1 -- 172.21.15.55:0/3958888767 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40b6b40 con 0x7f00e40712f0 2023-07-06T21:54:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00ea9fa640 1 -- 172.21.15.55:0/3958888767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d4009420 con 0x7f00e40712f0 2023-07-06T21:54:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00ea9fa640 1 -- 172.21.15.55:0/3958888767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e40c3380 con 0x7f00e40712f0 2023-07-06T21:54:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.423+0000 7f00ea9fa640 1 -- 172.21.15.55:0/3958888767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e4066d60 con 0x7f00e40712f0 2023-07-06T21:54:45.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.427+0000 7f00e0ff9640 1 -- 172.21.15.55:0/3958888767 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f00d40b4040 con 0x7f00e40712f0 2023-07-06T21:54:45.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.427+0000 7f00e0ff9640 1 --2- 172.21.15.55:0/3958888767 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f00d0066430 0x7f00d00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:45.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.427+0000 7f00e0ff9640 1 -- 172.21.15.55:0/3958888767 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 7570+0+0 (secure 0 0 0) 0x7f00d411e7b0 con 0x7f00e40712f0 2023-07-06T21:54:45.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.427+0000 7f00e37fe640 1 -- 172.21.15.55:0/3958888767 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f00d0066430 msgr2=0x7f00d00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1149809384 2023-07-06T21:54:45.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.427+0000 7f00e37fe640 1 --2- 172.21.15.55:0/3958888767 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f00d0066430 0x7f00d00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:54:45.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.431+0000 7f00e0ff9640 1 -- 172.21.15.55:0/3958888767 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00d40eb2c0 con 0x7f00e40712f0 2023-07-06T21:54:45.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.631+0000 7f00e37fe640 1 -- 172.21.15.55:0/3958888767 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f00d0066430 msgr2=0x7f00d00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1149809384 2023-07-06T21:54:45.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.631+0000 7f00e37fe640 1 --2- 172.21.15.55:0/3958888767 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f00d0066430 0x7f00d00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-06T21:54:45.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.651+0000 7f00ea9fa640 1 -- 172.21.15.55:0/3958888767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00e40c4ae0 con 0x7f00e40712f0 2023-07-06T21:54:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.651+0000 7f00e0ff9640 1 -- 172.21.15.55:0/3958888767 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f00d40ee8e0 con 0x7f00e40712f0 2023-07-06T21:54:45.653 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:45.654 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2166228749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2166228749},{"type":"v1","addr":"172.21.15.138:6834","nonce":2166228749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3702805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3702805788},{"type":"v1","addr":"172.21.15.138:6835","nonce":3702805788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2574870623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2574870623},{"type":"v1","addr":"172.21.15.55:6836","nonce":2574870623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:43:28.108537+0000","modified":"2023-07-06T21:43:31.358407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1792917100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1792917100},{"type":"v1","addr":"172.21.15.55:6837","nonce":1792917100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T21:54:45.654 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2023-07-06T21:54:45.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.655+0000 7f00ea9fa640 1 -- 172.21.15.55:0/3958888767 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f00d0066430 msgr2=0x7f00d00688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:54:45.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.655+0000 7f00ea9fa640 1 --2- 172.21.15.55:0/3958888767 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f00d0066430 0x7f00d00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.655+0000 7f00ea9fa640 1 -- 172.21.15.55:0/3958888767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e40712f0 msgr2=0x7f00e40cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:45.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.655+0000 7f00ea9fa640 1 --2- 172.21.15.55:0/3958888767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e40712f0 0x7f00e40cc480 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f00d40b0040 tx=0x7f00d40191f0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.655+0000 7f00ea9fa640 1 -- 172.21.15.55:0/3958888767 shutdown_connections 2023-07-06T21:54:45.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.655+0000 7f00ea9fa640 1 --2- 172.21.15.55:0/3958888767 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f00d0066430 0x7f00d00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.655+0000 7f00ea9fa640 1 --2- 172.21.15.55:0/3958888767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00e40ca450 0x7f00e40ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.655+0000 7f00ea9fa640 1 --2- 172.21.15.55:0/3958888767 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00e40b3730 0x7f00e41520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.655+0000 7f00ea9fa640 1 --2- 172.21.15.55:0/3958888767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e40712f0 0x7f00e40cc480 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.655+0000 7f00ea9fa640 1 -- 172.21.15.55:0/3958888767 >> 172.21.15.55:0/3958888767 conn(0x7f00e40cded0 msgr2=0x7f00e40b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:45.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.655+0000 7f00ea9fa640 1 -- 172.21.15.55:0/3958888767 shutdown_connections 2023-07-06T21:54:45.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.655+0000 7f00ea9fa640 1 -- 172.21.15.55:0/3958888767 wait complete. 2023-07-06T21:54:45.676 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:54:45.701 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:45.701+0000 7f0b09a01180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:54:45.785 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:45.785+0000 7f0b09a01180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:54:45.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.819+0000 7fbb66e6d640 1 Processor -- start 2023-07-06T21:54:45.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.819+0000 7fbb66e6d640 1 -- start start 2023-07-06T21:54:45.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb66e6d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb600b7cd0 0x7fbb600ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:45.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb66e6d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbb600ccab0 0x7fbb600b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:45.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb66e6d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb600ccf00 0x7fbb600b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:45.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb66e6d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb600d2310 con 0x7fbb600b7cd0 2023-07-06T21:54:45.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb66e6d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb600b80a0 con 0x7fbb600ccab0 2023-07-06T21:54:45.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb66e6d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600d1100 con 0x7fbb600ccf00 2023-07-06T21:54:45.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb64c09640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb600b7cd0 0x7fbb600ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:45.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb64c09640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb600b7cd0 0x7fbb600ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32900/0 (socket says 172.21.15.55:32900) 2023-07-06T21:54:45.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb64c09640 1 -- 172.21.15.55:0/3960370395 learned_addr learned my addr 172.21.15.55:0/3960370395 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:45.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb6540a640 1 --2- 172.21.15.55:0/3960370395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb600ccf00 0x7fbb600b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:45.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb5ffff640 1 --2- 172.21.15.55:0/3960370395 >> v2:172.21.15.138:3300/0 conn(0x7fbb600ccab0 0x7fbb600b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:45.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb64c09640 1 -- 172.21.15.55:0/3960370395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb600ccf00 msgr2=0x7fbb600b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:45.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb64c09640 1 --2- 172.21.15.55:0/3960370395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb600ccf00 0x7fbb600b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb64c09640 1 -- 172.21.15.55:0/3960370395 >> v2:172.21.15.138:3300/0 conn(0x7fbb600ccab0 msgr2=0x7fbb600b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:45.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb64c09640 1 --2- 172.21.15.55:0/3960370395 >> v2:172.21.15.138:3300/0 conn(0x7fbb600ccab0 0x7fbb600b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb64c09640 1 -- 172.21.15.55:0/3960370395 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb600cecf0 con 0x7fbb600b7cd0 2023-07-06T21:54:45.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.823+0000 7fbb6540a640 1 --2- 172.21.15.55:0/3960370395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb600ccf00 0x7fbb600b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:45.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb64c09640 1 --2- 172.21.15.55:0/3960370395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb600b7cd0 0x7fbb600ce610 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbb60065af0 tx=0x7fbb5401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a8e5ff3e87a0e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:45.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb5f7fe640 1 -- 172.21.15.55:0/3960370395 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb540ab600 con 0x7fbb600b7cd0 2023-07-06T21:54:45.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb5f7fe640 1 -- 172.21.15.55:0/3960370395 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb540a7050 con 0x7fbb600b7cd0 2023-07-06T21:54:45.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb5f7fe640 1 -- 172.21.15.55:0/3960370395 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb540ab980 con 0x7fbb600b7cd0 2023-07-06T21:54:45.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb66e6d640 1 -- 172.21.15.55:0/3960370395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb600b7cd0 msgr2=0x7fbb600ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:45.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb66e6d640 1 --2- 172.21.15.55:0/3960370395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb600b7cd0 0x7fbb600ce610 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbb60065af0 tx=0x7fbb5401c470 comp rx=0 tx=0).stop 2023-07-06T21:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb66e6d640 1 -- 172.21.15.55:0/3960370395 shutdown_connections 2023-07-06T21:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb66e6d640 1 --2- 172.21.15.55:0/3960370395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb600ccf00 0x7fbb600b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb66e6d640 1 --2- 172.21.15.55:0/3960370395 >> v2:172.21.15.138:3300/0 conn(0x7fbb600ccab0 0x7fbb600b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb66e6d640 1 --2- 172.21.15.55:0/3960370395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb600b7cd0 0x7fbb600ce610 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb66e6d640 1 -- 172.21.15.55:0/3960370395 >> 172.21.15.55:0/3960370395 conn(0x7fbb600ceee0 msgr2=0x7fbb600cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:45.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb66e6d640 1 -- 172.21.15.55:0/3960370395 shutdown_connections 2023-07-06T21:54:45.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb66e6d640 1 -- 172.21.15.55:0/3960370395 wait complete. 2023-07-06T21:54:45.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb66e6d640 1 Processor -- start 2023-07-06T21:54:45.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.827+0000 7fbb66e6d640 1 -- start start 2023-07-06T21:54:45.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb66e6d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb600b7cd0 0x7fbb6015ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:45.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb66e6d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb600ccab0 0x7fbb6015b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:45.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb66e6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb600ccf00 0x7fbb6015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:45.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb66e6d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6015abc0 con 0x7fbb600ccf00 2023-07-06T21:54:45.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb66e6d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6006a380 con 0x7fbb600b7cd0 2023-07-06T21:54:45.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb66e6d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6015a570 con 0x7fbb600ccab0 2023-07-06T21:54:45.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb6540a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb600ccf00 0x7fbb6015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:45.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb6540a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb600ccf00 0x7fbb6015cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32910/0 (socket says 172.21.15.55:32910) 2023-07-06T21:54:45.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb6540a640 1 -- 172.21.15.55:0/554871433 learned_addr learned my addr 172.21.15.55:0/554871433 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:45.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb64c09640 1 --2- 172.21.15.55:0/554871433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb600b7cd0 0x7fbb6015ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:45.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb5ffff640 1 --2- 172.21.15.55:0/554871433 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb600ccab0 0x7fbb6015b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:45.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb6540a640 1 -- 172.21.15.55:0/554871433 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb600ccab0 msgr2=0x7fbb6015b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:45.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb6540a640 1 --2- 172.21.15.55:0/554871433 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb600ccab0 0x7fbb6015b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb6540a640 1 -- 172.21.15.55:0/554871433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb600b7cd0 msgr2=0x7fbb6015ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:45.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb6540a640 1 --2- 172.21.15.55:0/554871433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb600b7cd0 0x7fbb6015ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:45.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb6540a640 1 -- 172.21.15.55:0/554871433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb540094d0 con 0x7fbb600ccf00 2023-07-06T21:54:45.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb6540a640 1 --2- 172.21.15.55:0/554871433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb600ccf00 0x7fbb6015cfc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbb58007dc0 tx=0x7fbb5800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:45.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb5d7fa640 1 -- 172.21.15.55:0/554871433 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb580039a0 con 0x7fbb600ccf00 2023-07-06T21:54:45.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb5d7fa640 1 -- 172.21.15.55:0/554871433 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5800f040 con 0x7fbb600ccf00 2023-07-06T21:54:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb5d7fa640 1 -- 172.21.15.55:0/554871433 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58003d40 con 0x7fbb600ccf00 2023-07-06T21:54:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb66e6d640 1 -- 172.21.15.55:0/554871433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6015a850 con 0x7fbb600ccf00 2023-07-06T21:54:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb66e6d640 1 -- 172.21.15.55:0/554871433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6015b760 con 0x7fbb600ccf00 2023-07-06T21:54:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.831+0000 7fbb66e6d640 1 -- 172.21.15.55:0/554871433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6015ad70 con 0x7fbb600ccf00 2023-07-06T21:54:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.835+0000 7fbb5d7fa640 1 -- 172.21.15.55:0/554871433 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7fbb58004030 con 0x7fbb600ccf00 2023-07-06T21:54:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.835+0000 7fbb5d7fa640 1 --2- 172.21.15.55:0/554871433 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbb44066460 0x7fbb44068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.835+0000 7fbb64c09640 1 -- 172.21.15.55:0/554871433 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbb44066460 msgr2=0x7fbb44068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1149809384 2023-07-06T21:54:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.835+0000 7fbb5d7fa640 1 -- 172.21.15.55:0/554871433 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 7570+0+0 (secure 0 0 0) 0x7fbb580848a0 con 0x7fbb600ccf00 2023-07-06T21:54:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.835+0000 7fbb64c09640 1 --2- 172.21.15.55:0/554871433 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbb44066460 0x7fbb44068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:54:45.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.839+0000 7fbb5d7fa640 1 -- 172.21.15.55:0/554871433 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb6015ad70 con 0x7fbb600ccf00 2023-07-06T21:54:45.933 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:45.933+0000 7f0b09a01180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:54:45.971 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:45.971+0000 7f213e047180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:54:45.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.999+0000 7fbb66e6d640 1 -- 172.21.15.55:0/554871433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb6015a9e0 con 0x7fbb600ccf00 2023-07-06T21:54:45.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:45.999+0000 7fbb5d7fa640 1 -- 172.21.15.55:0/554871433 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+20301 (secure 0 0 0) 0x7fbb580514f0 con 0x7fbb600ccf00 2023-07-06T21:54:46.000 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:46.000 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":58,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:54:44.568843+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:43:26.444989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-06T21:43:27.092120+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":57,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/2066223848":"2023-07-07T21:43:45.377574+0000","172.21.15.55:6833/1575998409":"2023-07-07T21:43:45.377574+0000","172.21.15.55:6832/1575998409":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/2297905762":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/1005520698":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/2605447220":"2023-07-07T21:43:45.377574+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":13,"length":1},{"begin":23,"length":1},{"begin":33,"length":1},{"begin":44,"length":1},{"begin":50,"length":1},{"begin":54,"length":1},{"begin":60,"length":1},{"begin":65,"length":1},{"begin":71,"length":2},{"begin":76,"length":1},{"begin":83,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":104,"length":1},{"begin":204,"length":17}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":4,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":15,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":27,"length":1},{"begin":29,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":37,"length":1},{"begin":39,"length":1},{"begin":41,"length":2},{"begin":46,"length":1},{"begin":48,"length":1},{"begin":52,"length":1},{"begin":56,"length":1},{"begin":58,"length":1},{"begin":63,"length":1},{"begin":67,"length":1},{"begin":69,"length":1},{"begin":74,"length":2},{"begin":78,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":89,"length":1},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":99,"length":1},{"begin":101,"length":2},{"begin":106,"length":2},{"begin":110,"length":1},{"begin":163,"length":41}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:54:46.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.003+0000 7fbb66e6d640 1 -- 172.21.15.55:0/554871433 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbb44066460 msgr2=0x7fbb44068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:54:46.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.003+0000 7fbb66e6d640 1 --2- 172.21.15.55:0/554871433 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbb44066460 0x7fbb44068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.003+0000 7fbb66e6d640 1 -- 172.21.15.55:0/554871433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb600ccf00 msgr2=0x7fbb6015cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.003+0000 7fbb66e6d640 1 --2- 172.21.15.55:0/554871433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb600ccf00 0x7fbb6015cfc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbb58007dc0 tx=0x7fbb5800d4a0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.003+0000 7fbb66e6d640 1 -- 172.21.15.55:0/554871433 shutdown_connections 2023-07-06T21:54:46.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.003+0000 7fbb66e6d640 1 --2- 172.21.15.55:0/554871433 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7fbb44066460 0x7fbb44068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.003+0000 7fbb66e6d640 1 --2- 172.21.15.55:0/554871433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb600ccf00 0x7fbb6015cfc0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.003+0000 7fbb66e6d640 1 --2- 172.21.15.55:0/554871433 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb600ccab0 0x7fbb6015b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.003+0000 7fbb66e6d640 1 --2- 172.21.15.55:0/554871433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb600b7cd0 0x7fbb6015ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.003+0000 7fbb66e6d640 1 -- 172.21.15.55:0/554871433 >> 172.21.15.55:0/554871433 conn(0x7fbb600ceee0 msgr2=0x7fbb600cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:46.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.003+0000 7fbb66e6d640 1 -- 172.21.15.55:0/554871433 shutdown_connections 2023-07-06T21:54:46.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.003+0000 7fbb66e6d640 1 -- 172.21.15.55:0/554871433 wait complete. 2023-07-06T21:54:46.016 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:46.013+0000 7f0b09a01180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:54:46.021 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:43:26.444989+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:43:27.092120+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 57, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:54:46.022 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:54:46.062 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.063+0000 7f213e047180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:54:46.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904c3c5640 1 Processor -- start 2023-07-06T21:54:46.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904c3c5640 1 -- start start 2023-07-06T21:54:46.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904c3c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90440b7b90 0x7f90440d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904c3c5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f90440b4300 0x7f90440b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904c3c5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90440b5070 con 0x7f90440cc870 2023-07-06T21:54:46.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904c3c5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9044160020 con 0x7f90440b7b90 2023-07-06T21:54:46.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904c3c5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90441604b0 con 0x7f90440b4300 2023-07-06T21:54:46.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904a161640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90440b7b90 0x7f90440d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:46.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904a161640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90440b7b90 0x7f90440d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32912/0 (socket says 172.21.15.55:32912) 2023-07-06T21:54:46.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904a161640 1 -- 172.21.15.55:0/3836095189 learned_addr learned my addr 172.21.15.55:0/3836095189 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:46.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904a962640 1 --2- 172.21.15.55:0/3836095189 >> v2:172.21.15.138:3300/0 conn(0x7f90440b4300 0x7f90440b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:46.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904a161640 1 -- 172.21.15.55:0/3836095189 >> v2:172.21.15.138:3300/0 conn(0x7f90440b4300 msgr2=0x7f90440b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:46.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904a161640 1 --2- 172.21.15.55:0/3836095189 >> v2:172.21.15.138:3300/0 conn(0x7f90440b4300 0x7f90440b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904a161640 1 -- 172.21.15.55:0/3836095189 >> v1:172.21.15.138:6789/0 conn(0x7f90440cc870 legacy=0x7f90440b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.171+0000 7f904a161640 1 -- 172.21.15.55:0/3836095189 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90440cd030 con 0x7f90440b7b90 2023-07-06T21:54:46.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.175+0000 7f904a161640 1 --2- 172.21.15.55:0/3836095189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90440b7b90 0x7f90440d1c40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f904406c6a0 tx=0x7f904001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1808aa33619bf4f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:46.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.175+0000 7f904915f640 1 -- 172.21.15.55:0/3836095189 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400aa430 con 0x7f90440b7b90 2023-07-06T21:54:46.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.175+0000 7f904915f640 1 -- 172.21.15.55:0/3836095189 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90400aa590 con 0x7f90440b7b90 2023-07-06T21:54:46.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.175+0000 7f904915f640 1 -- 172.21.15.55:0/3836095189 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400aa920 con 0x7f90440b7b90 2023-07-06T21:54:46.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.175+0000 7f904c3c5640 1 -- 172.21.15.55:0/3836095189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90440b7b90 msgr2=0x7f90440d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.175+0000 7f904c3c5640 1 --2- 172.21.15.55:0/3836095189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90440b7b90 0x7f90440d1c40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f904406c6a0 tx=0x7f904001c4d0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.175+0000 7f904c3c5640 1 -- 172.21.15.55:0/3836095189 shutdown_connections 2023-07-06T21:54:46.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.175+0000 7f904c3c5640 1 --2- 172.21.15.55:0/3836095189 >> v2:172.21.15.138:3300/0 conn(0x7f90440b4300 0x7f90440b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.175+0000 7f904c3c5640 1 --2- 172.21.15.55:0/3836095189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90440b7b90 0x7f90440d1c40 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.175+0000 7f904c3c5640 1 -- 172.21.15.55:0/3836095189 >> 172.21.15.55:0/3836095189 conn(0x7f90440ceca0 msgr2=0x7f90440cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:46.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.175+0000 7f904c3c5640 1 -- 172.21.15.55:0/3836095189 shutdown_connections 2023-07-06T21:54:46.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.175+0000 7f904c3c5640 1 -- 172.21.15.55:0/3836095189 wait complete. 2023-07-06T21:54:46.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904c3c5640 1 Processor -- start 2023-07-06T21:54:46.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904c3c5640 1 -- start start 2023-07-06T21:54:46.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904c3c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90440b4300 0x7f904414f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904c3c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90440b7b90 0x7f90441532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904c3c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90440cc870 0x7f9044153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904c3c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90440d15b0 con 0x7f90440b4300 2023-07-06T21:54:46.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904c3c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9044151f50 con 0x7f90440b7b90 2023-07-06T21:54:46.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904c3c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90440d1800 con 0x7f90440cc870 2023-07-06T21:54:46.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904a161640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90440b4300 0x7f904414f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:46.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904a161640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90440b4300 0x7f904414f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32916/0 (socket says 172.21.15.55:32916) 2023-07-06T21:54:46.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904a161640 1 -- 172.21.15.55:0/4269940354 learned_addr learned my addr 172.21.15.55:0/4269940354 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:46.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904a962640 1 --2- 172.21.15.55:0/4269940354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90440cc870 0x7f9044153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:46.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f9049960640 1 --2- 172.21.15.55:0/4269940354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90440b7b90 0x7f90441532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:46.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904a161640 1 -- 172.21.15.55:0/4269940354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90440cc870 msgr2=0x7f9044153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904a161640 1 --2- 172.21.15.55:0/4269940354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90440cc870 0x7f9044153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904a161640 1 -- 172.21.15.55:0/4269940354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90440b7b90 msgr2=0x7f90441532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904a161640 1 --2- 172.21.15.55:0/4269940354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90440b7b90 0x7f90441532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904a161640 1 -- 172.21.15.55:0/4269940354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90400094d0 con 0x7f90440b4300 2023-07-06T21:54:46.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904a161640 1 --2- 172.21.15.55:0/4269940354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90440b4300 0x7f904414f530 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f90400190e0 tx=0x7f904001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:46.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f903affd640 1 -- 172.21.15.55:0/4269940354 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400aa430 con 0x7f90440b4300 2023-07-06T21:54:46.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f903affd640 1 -- 172.21.15.55:0/4269940354 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90400b3800 con 0x7f90440b4300 2023-07-06T21:54:46.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904c3c5640 1 -- 172.21.15.55:0/4269940354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90440b6fa0 con 0x7f90440b4300 2023-07-06T21:54:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f903affd640 1 -- 172.21.15.55:0/4269940354 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400b3b90 con 0x7f90440b4300 2023-07-06T21:54:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.179+0000 7f904c3c5640 1 -- 172.21.15.55:0/4269940354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90441507a0 con 0x7f90440b4300 2023-07-06T21:54:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.183+0000 7f9038ff9640 1 -- 172.21.15.55:0/4269940354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9044150990 con 0x7f90440b4300 2023-07-06T21:54:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.183+0000 7f903affd640 1 -- 172.21.15.55:0/4269940354 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f90400b3cf0 con 0x7f90440b4300 2023-07-06T21:54:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.183+0000 7f903affd640 1 --2- 172.21.15.55:0/4269940354 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f9028066430 0x7f90280688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.183+0000 7f903affd640 1 -- 172.21.15.55:0/4269940354 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 7570+0+0 (secure 0 0 0) 0x7f904011eba0 con 0x7f90440b4300 2023-07-06T21:54:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.183+0000 7f9049960640 1 -- 172.21.15.55:0/4269940354 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f9028066430 msgr2=0x7f90280688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1149809384 2023-07-06T21:54:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.183+0000 7f9049960640 1 --2- 172.21.15.55:0/4269940354 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f9028066430 0x7f90280688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:54:46.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.187+0000 7f903affd640 1 -- 172.21.15.55:0/4269940354 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f90400eb760 con 0x7f90440b4300 2023-07-06T21:54:46.220 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.219+0000 7f213e047180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:54:46.286 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:46.285+0000 7f0b09a01180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:54:46.308 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.307+0000 7f213e047180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:54:46.345 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:54:46.345+0000 7f0b09a01180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:54:46.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.347+0000 7f9038ff9640 1 -- 172.21.15.55:0/4269940354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9044066d60 con 0x7f90440b4300 2023-07-06T21:54:46.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.347+0000 7f903affd640 1 -- 172.21.15.55:0/4269940354 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90400eed80 con 0x7f90440b4300 2023-07-06T21:54:46.347 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:54:46.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.351+0000 7f9038ff9640 1 -- 172.21.15.55:0/4269940354 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f9028066430 msgr2=0x7f90280688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:54:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.351+0000 7f9038ff9640 1 --2- 172.21.15.55:0/4269940354 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f9028066430 0x7f90280688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.351+0000 7f9038ff9640 1 -- 172.21.15.55:0/4269940354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90440b4300 msgr2=0x7f904414f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.351+0000 7f9038ff9640 1 --2- 172.21.15.55:0/4269940354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90440b4300 0x7f904414f530 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f90400190e0 tx=0x7f904001ad10 comp rx=0 tx=0).stop 2023-07-06T21:54:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.351+0000 7f9038ff9640 1 -- 172.21.15.55:0/4269940354 shutdown_connections 2023-07-06T21:54:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.351+0000 7f9038ff9640 1 --2- 172.21.15.55:0/4269940354 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f9028066430 0x7f90280688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.351+0000 7f9038ff9640 1 --2- 172.21.15.55:0/4269940354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90440cc870 0x7f9044153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.351+0000 7f9038ff9640 1 --2- 172.21.15.55:0/4269940354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90440b7b90 0x7f90441532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.351+0000 7f9038ff9640 1 --2- 172.21.15.55:0/4269940354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90440b4300 0x7f904414f530 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.351+0000 7f9038ff9640 1 -- 172.21.15.55:0/4269940354 >> 172.21.15.55:0/4269940354 conn(0x7f90440ceca0 msgr2=0x7f90440b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.351+0000 7f9038ff9640 1 -- 172.21.15.55:0/4269940354 shutdown_connections 2023-07-06T21:54:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.351+0000 7f9038ff9640 1 -- 172.21.15.55:0/4269940354 wait complete. 2023-07-06T21:54:46.369 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:54:46.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.563+0000 7f8771607640 1 Processor -- start 2023-07-06T21:54:46.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.563+0000 7f8771607640 1 -- start start 2023-07-06T21:54:46.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.563+0000 7f8771607640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f876c1597d0 0x7f876c0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.563+0000 7f8771607640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f876c0cac10 0x7f876c06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.563+0000 7f8771607640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876c0cd490 con 0x7f876c070530 2023-07-06T21:54:46.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.563+0000 7f8771607640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876c0cb040 con 0x7f876c0cac10 2023-07-06T21:54:46.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.563+0000 7f8771607640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0709b0 con 0x7f876c1597d0 2023-07-06T21:54:46.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.563+0000 7f876b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f876c070530 0x7f876c0c94b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44112/0 (socket says 172.21.15.55:44112) 2023-07-06T21:54:46.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.567+0000 7f876b7fe640 1 -- 172.21.15.55:0/204254059 learned_addr learned my addr 172.21.15.55:0/204254059 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:46.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.567+0000 7f8763fff640 1 --2- 172.21.15.55:0/204254059 >> v2:172.21.15.138:3300/0 conn(0x7f876c0cac10 0x7f876c06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:46.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.567+0000 7f876affd640 1 --2- 172.21.15.55:0/204254059 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f876c1597d0 0x7f876c0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:46.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.567+0000 7f876a7fc640 1 -- 172.21.15.55:0/204254059 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370103811 0 0) 0x7f876c0cd490 con 0x7f876c070530 2023-07-06T21:54:46.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.567+0000 7f876affd640 1 -- 172.21.15.55:0/204254059 >> v2:172.21.15.138:3300/0 conn(0x7f876c0cac10 msgr2=0x7f876c06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:46.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.567+0000 7f876affd640 1 --2- 172.21.15.55:0/204254059 >> v2:172.21.15.138:3300/0 conn(0x7f876c0cac10 0x7f876c06fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.567+0000 7f876affd640 1 -- 172.21.15.55:0/204254059 >> v1:172.21.15.55:6789/0 conn(0x7f876c070530 legacy=0x7f876c0c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.567+0000 7f876affd640 1 -- 172.21.15.55:0/204254059 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c15cf60 con 0x7f876c1597d0 2023-07-06T21:54:46.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.567+0000 7f876affd640 1 --2- 172.21.15.55:0/204254059 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f876c1597d0 0x7f876c0ca6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f875c0097c0 tx=0x7f875c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=833ad6c18ae96a96 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:46.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.567+0000 7f876a7fc640 1 -- 172.21.15.55:0/204254059 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0ab600 con 0x7f876c1597d0 2023-07-06T21:54:46.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.567+0000 7f876a7fc640 1 -- 172.21.15.55:0/204254059 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c0a7050 con 0x7f876c1597d0 2023-07-06T21:54:46.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.567+0000 7f876a7fc640 1 -- 172.21.15.55:0/204254059 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0ab980 con 0x7f876c1597d0 2023-07-06T21:54:46.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 -- 172.21.15.55:0/204254059 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f876c1597d0 msgr2=0x7f876c0ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 --2- 172.21.15.55:0/204254059 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f876c1597d0 0x7f876c0ca6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f875c0097c0 tx=0x7f875c01c3c0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 -- 172.21.15.55:0/204254059 shutdown_connections 2023-07-06T21:54:46.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 --2- 172.21.15.55:0/204254059 >> v2:172.21.15.138:3300/0 conn(0x7f876c0cac10 0x7f876c06fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 --2- 172.21.15.55:0/204254059 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f876c1597d0 0x7f876c0ca6d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 -- 172.21.15.55:0/204254059 >> 172.21.15.55:0/204254059 conn(0x7f876c0cb970 msgr2=0x7f876c0cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:46.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 -- 172.21.15.55:0/204254059 shutdown_connections 2023-07-06T21:54:46.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 -- 172.21.15.55:0/204254059 wait complete. 2023-07-06T21:54:46.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 Processor -- start 2023-07-06T21:54:46.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 -- start start 2023-07-06T21:54:46.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f876c070530 0x7f876c152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f876c0cac10 0x7f876c0c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c153e80 0x7f876c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0c7960 con 0x7f876c153e80 2023-07-06T21:54:46.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0c7c40 con 0x7f876c070530 2023-07-06T21:54:46.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8771607640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0c7f20 con 0x7f876c0cac10 2023-07-06T21:54:46.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f876b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c153e80 0x7f876c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:46.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f876affd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f876c070530 0x7f876c152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:46.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f876b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c153e80 0x7f876c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32930/0 (socket says 172.21.15.55:32930) 2023-07-06T21:54:46.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f8763fff640 1 --2- 172.21.15.55:0/2801892797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f876c0cac10 0x7f876c0c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:46.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.571+0000 7f876b7fe640 1 -- 172.21.15.55:0/2801892797 learned_addr learned my addr 172.21.15.55:0/2801892797 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:46.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.575+0000 7f876affd640 1 -- 172.21.15.55:0/2801892797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f876c0cac10 msgr2=0x7f876c0c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.575+0000 7f876affd640 1 --2- 172.21.15.55:0/2801892797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f876c0cac10 0x7f876c0c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.575+0000 7f876affd640 1 -- 172.21.15.55:0/2801892797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c153e80 msgr2=0x7f876c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.575+0000 7f876affd640 1 --2- 172.21.15.55:0/2801892797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c153e80 0x7f876c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.575+0000 7f876affd640 1 -- 172.21.15.55:0/2801892797 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c009420 con 0x7f876c070530 2023-07-06T21:54:46.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.575+0000 7f876affd640 1 --2- 172.21.15.55:0/2801892797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f876c070530 0x7f876c152320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f875c0ab000 tx=0x7f875c01ac00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:46.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.575+0000 7f87637fe640 1 -- 172.21.15.55:0/2801892797 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0b7450 con 0x7f876c070530 2023-07-06T21:54:46.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.575+0000 7f87637fe640 1 -- 172.21.15.55:0/2801892797 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c0b75f0 con 0x7f876c070530 2023-07-06T21:54:46.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.575+0000 7f87637fe640 1 -- 172.21.15.55:0/2801892797 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0b79a0 con 0x7f876c070530 2023-07-06T21:54:46.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.575+0000 7f8771607640 1 -- 172.21.15.55:0/2801892797 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876c0c8200 con 0x7f876c070530 2023-07-06T21:54:46.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.575+0000 7f8771607640 1 -- 172.21.15.55:0/2801892797 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c152860 con 0x7f876c070530 2023-07-06T21:54:46.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.575+0000 7f8771607640 1 -- 172.21.15.55:0/2801892797 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876c066d60 con 0x7f876c070530 2023-07-06T21:54:46.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.575+0000 7f87637fe640 1 -- 172.21.15.55:0/2801892797 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f875c0b7b00 con 0x7f876c070530 2023-07-06T21:54:46.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.579+0000 7f87637fe640 1 --2- 172.21.15.55:0/2801892797 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f874c066430 0x7f874c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.579+0000 7f87637fe640 1 -- 172.21.15.55:0/2801892797 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 7570+0+0 (secure 0 0 0) 0x7f875c11edd0 con 0x7f876c070530 2023-07-06T21:54:46.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.579+0000 7f8763fff640 1 -- 172.21.15.55:0/2801892797 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f874c066430 msgr2=0x7f874c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1149809384 2023-07-06T21:54:46.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.579+0000 7f8763fff640 1 --2- 172.21.15.55:0/2801892797 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f874c066430 0x7f874c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:54:46.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.583+0000 7f87637fe640 1 -- 172.21.15.55:0/2801892797 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f875c0eb850 con 0x7f876c070530 2023-07-06T21:54:46.599 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.599+0000 7f213e047180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:54:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.623+0000 7f87637fe640 1 -- 172.21.15.55:0/2801892797 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mgrmap(e 15) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f875c125080 con 0x7f876c070530 2023-07-06T21:54:46.680 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.679+0000 7f213e047180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:54:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.699+0000 7f87637fe640 1 -- 172.21.15.55:0/2801892797 <== mon.1 v2:172.21.15.138:3300/0 8 ==== mgrmap(e 16) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f875c0ebc20 con 0x7f876c070530 2023-07-06T21:54:46.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.699+0000 7f87637fe640 1 -- 172.21.15.55:0/2801892797 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f874c066430 msgr2=0x7f874c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:54:46.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.699+0000 7f87637fe640 1 --2- 172.21.15.55:0/2801892797 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f874c066430 0x7f874c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.762 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.763+0000 7f20ca3c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:54:46.762 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.763+0000 7f20ca3c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:54:46.762 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.763+0000 7f20ca3c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:54:46.763 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.763+0000 7f20ca3c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:54:46.763 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.763+0000 7f20ca3c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:54:46.763 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.763+0000 7f20c73bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:54:46.763 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.763+0000 7f20c73bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:54:46.763 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.763+0000 7f20c73bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:54:46.763 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.763+0000 7f20c73bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:54:46.763 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:54:46.763+0000 7f20c73bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:54:46.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.783+0000 7f8771607640 1 -- 172.21.15.55:0/2801892797 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f876c0c86b0 con 0x7f876c070530 2023-07-06T21:54:46.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.787+0000 7f87637fe640 1 -- 172.21.15.55:0/2801892797 <== mon.1 v2:172.21.15.138:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v60) v1 ==== 92+0+10 (secure 0 0 0) 0x7f875c0ec860 con 0x7f876c070530 2023-07-06T21:54:46.786 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:54:46.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.787+0000 7f8771607640 1 -- 172.21.15.55:0/2801892797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f876c070530 msgr2=0x7f876c152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.787+0000 7f8771607640 1 --2- 172.21.15.55:0/2801892797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f876c070530 0x7f876c152320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f875c0ab000 tx=0x7f875c01ac00 comp rx=0 tx=0).stop 2023-07-06T21:54:46.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.787+0000 7f8771607640 1 -- 172.21.15.55:0/2801892797 shutdown_connections 2023-07-06T21:54:46.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.787+0000 7f8771607640 1 --2- 172.21.15.55:0/2801892797 >> [v2:172.21.15.55:6832/1149809384,v1:172.21.15.55:6833/1149809384] conn(0x7f874c066430 0x7f874c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.787+0000 7f8771607640 1 --2- 172.21.15.55:0/2801892797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c153e80 0x7f876c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.787+0000 7f8771607640 1 --2- 172.21.15.55:0/2801892797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f876c0cac10 0x7f876c0c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.787+0000 7f8771607640 1 --2- 172.21.15.55:0/2801892797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f876c070530 0x7f876c152320 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.787+0000 7f8771607640 1 -- 172.21.15.55:0/2801892797 >> 172.21.15.55:0/2801892797 conn(0x7f876c0cb970 msgr2=0x7f876c159bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:46.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.787+0000 7f8771607640 1 -- 172.21.15.55:0/2801892797 shutdown_connections 2023-07-06T21:54:46.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.787+0000 7f8771607640 1 -- 172.21.15.55:0/2801892797 wait complete. 2023-07-06T21:54:46.807 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:54:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.951+0000 7faf3b8cb640 1 Processor -- start 2023-07-06T21:54:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf3b8cb640 1 -- start start 2023-07-06T21:54:46.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf3b8cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf3406fef0 0x7faf34164820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf3b8cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf340cc030 con 0x7faf34070d70 2023-07-06T21:54:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf3b8cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf340cc300 con 0x7faf340709a0 2023-07-06T21:54:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf3b8cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340cc5e0 con 0x7faf3406fef0 2023-07-06T21:54:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf38e66640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faf34070d70 0x7faf340b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44124/0 (socket says 172.21.15.55:44124) 2023-07-06T21:54:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf38e66640 1 -- 172.21.15.55:0/2931215188 learned_addr learned my addr 172.21.15.55:0/2931215188 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf39e68640 1 --2- 172.21.15.55:0/2931215188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf3406fef0 0x7faf34164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:46.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf2bfff640 1 -- 172.21.15.55:0/2931215188 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990214714 0 0) 0x7faf340cc030 con 0x7faf34070d70 2023-07-06T21:54:46.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf2bfff640 1 -- 172.21.15.55:0/2931215188 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf20003530 con 0x7faf34070d70 2023-07-06T21:54:46.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf2bfff640 1 -- 172.21.15.55:0/2931215188 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707538180 0 0) 0x7faf340cc300 con 0x7faf340709a0 2023-07-06T21:54:46.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf2bfff640 1 -- 172.21.15.55:0/2931215188 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf340cc030 con 0x7faf340709a0 2023-07-06T21:54:46.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf39e68640 1 -- 172.21.15.55:0/2931215188 >> v1:172.21.15.138:6789/0 conn(0x7faf340709a0 legacy=0x7faf340cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf39e68640 1 -- 172.21.15.55:0/2931215188 >> v1:172.21.15.55:6789/0 conn(0x7faf34070d70 legacy=0x7faf340b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.955+0000 7faf39e68640 1 -- 172.21.15.55:0/2931215188 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf340cc8c0 con 0x7faf3406fef0 2023-07-06T21:54:46.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.959+0000 7faf39e68640 1 --2- 172.21.15.55:0/2931215188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf3406fef0 0x7faf34164820 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009dc0 tx=0x7faf2c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dff1d9b3fe53803b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:46.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.959+0000 7faf2bfff640 1 -- 172.21.15.55:0/2931215188 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0a5920 con 0x7faf3406fef0 2023-07-06T21:54:46.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.959+0000 7faf2bfff640 1 -- 172.21.15.55:0/2931215188 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c0a5a80 con 0x7faf3406fef0 2023-07-06T21:54:46.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.959+0000 7faf2bfff640 1 -- 172.21.15.55:0/2931215188 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0a5e10 con 0x7faf3406fef0 2023-07-06T21:54:46.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.959+0000 7faf3b8cb640 1 -- 172.21.15.55:0/2931215188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf3406fef0 msgr2=0x7faf34164820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.959+0000 7faf3b8cb640 1 --2- 172.21.15.55:0/2931215188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf3406fef0 0x7faf34164820 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009dc0 tx=0x7faf2c01c970 comp rx=0 tx=0).stop 2023-07-06T21:54:46.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.959+0000 7faf3b8cb640 1 -- 172.21.15.55:0/2931215188 shutdown_connections 2023-07-06T21:54:46.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.959+0000 7faf3b8cb640 1 --2- 172.21.15.55:0/2931215188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf3406fef0 0x7faf34164820 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.959+0000 7faf3b8cb640 1 -- 172.21.15.55:0/2931215188 >> 172.21.15.55:0/2931215188 conn(0x7faf340cea70 msgr2=0x7faf340ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:46.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.959+0000 7faf3b8cb640 1 -- 172.21.15.55:0/2931215188 shutdown_connections 2023-07-06T21:54:46.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.959+0000 7faf3b8cb640 1 -- 172.21.15.55:0/2931215188 wait complete. 2023-07-06T21:54:46.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf3b8cb640 1 Processor -- start 2023-07-06T21:54:46.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf3b8cb640 1 -- start start 2023-07-06T21:54:46.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf3b8cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf3406fef0 0x7faf340c3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf3b8cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf340709a0 0x7faf34155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf3b8cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf34070d70 0x7faf340af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf3b8cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf34069600 con 0x7faf3406fef0 2023-07-06T21:54:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf3b8cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf341645a0 con 0x7faf340709a0 2023-07-06T21:54:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf3b8cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3406be80 con 0x7faf34070d70 2023-07-06T21:54:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf39667640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf3406fef0 0x7faf340c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf39667640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf3406fef0 0x7faf340c3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33032/0 (socket says 172.21.15.55:33032) 2023-07-06T21:54:46.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf39667640 1 -- 172.21.15.55:0/3284133020 learned_addr learned my addr 172.21.15.55:0/3284133020 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf39e68640 1 --2- 172.21.15.55:0/3284133020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf34070d70 0x7faf340af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf38e66640 1 --2- 172.21.15.55:0/3284133020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf340709a0 0x7faf34155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf39667640 1 -- 172.21.15.55:0/3284133020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf34070d70 msgr2=0x7faf340af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf39667640 1 --2- 172.21.15.55:0/3284133020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf34070d70 0x7faf340af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf39667640 1 -- 172.21.15.55:0/3284133020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf340709a0 msgr2=0x7faf34155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf39667640 1 --2- 172.21.15.55:0/3284133020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf340709a0 0x7faf34155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf39667640 1 -- 172.21.15.55:0/3284133020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c009a70 con 0x7faf3406fef0 2023-07-06T21:54:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf39667640 1 --2- 172.21.15.55:0/3284133020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf3406fef0 0x7faf340c3280 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7faf3000c500 tx=0x7faf3000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf29ffb640 1 -- 172.21.15.55:0/3284133020 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf300052d0 con 0x7faf3406fef0 2023-07-06T21:54:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf29ffb640 1 -- 172.21.15.55:0/3284133020 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30005450 con 0x7faf3406fef0 2023-07-06T21:54:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf3b8cb640 1 -- 172.21.15.55:0/3284133020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3406c120 con 0x7faf3406fef0 2023-07-06T21:54:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf29ffb640 1 -- 172.21.15.55:0/3284133020 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30012870 con 0x7faf3406fef0 2023-07-06T21:54:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf3b8cb640 1 -- 172.21.15.55:0/3284133020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf34164ad0 con 0x7faf3406fef0 2023-07-06T21:54:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.963+0000 7faf3b8cb640 1 -- 172.21.15.55:0/3284133020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf340af690 con 0x7faf3406fef0 2023-07-06T21:54:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.967+0000 7faf29ffb640 1 -- 172.21.15.55:0/3284133020 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 85369+0+0 (secure 0 0 0) 0x7faf300129d0 con 0x7faf3406fef0 2023-07-06T21:54:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.967+0000 7faf29ffb640 1 -- 172.21.15.55:0/3284133020 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7385+0+0 (secure 0 0 0) 0x7faf30083990 con 0x7faf3406fef0 2023-07-06T21:54:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:46.971+0000 7faf29ffb640 1 -- 172.21.15.55:0/3284133020 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf30050d90 con 0x7faf3406fef0 2023-07-06T21:54:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.123+0000 7faf3b8cb640 1 -- 172.21.15.55:0/3284133020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf34066d60 con 0x7faf3406fef0 2023-07-06T21:54:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.123+0000 7faf29ffb640 1 -- 172.21.15.55:0/3284133020 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf300543b0 con 0x7faf3406fef0 2023-07-06T21:54:47.125 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:54:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.127+0000 7faf3b8cb640 1 -- 172.21.15.55:0/3284133020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf3406fef0 msgr2=0x7faf340c3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:47.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.127+0000 7faf3b8cb640 1 --2- 172.21.15.55:0/3284133020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf3406fef0 0x7faf340c3280 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7faf3000c500 tx=0x7faf3000c9c0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.127+0000 7faf3b8cb640 1 -- 172.21.15.55:0/3284133020 shutdown_connections 2023-07-06T21:54:47.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.127+0000 7faf3b8cb640 1 --2- 172.21.15.55:0/3284133020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf34070d70 0x7faf340af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.127+0000 7faf3b8cb640 1 --2- 172.21.15.55:0/3284133020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf340709a0 0x7faf34155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.127+0000 7faf3b8cb640 1 --2- 172.21.15.55:0/3284133020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf3406fef0 0x7faf340c3280 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.127+0000 7faf3b8cb640 1 -- 172.21.15.55:0/3284133020 >> 172.21.15.55:0/3284133020 conn(0x7faf340cea70 msgr2=0x7faf3409e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:47.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.127+0000 7faf3b8cb640 1 -- 172.21.15.55:0/3284133020 shutdown_connections 2023-07-06T21:54:47.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.127+0000 7faf3b8cb640 1 -- 172.21.15.55:0/3284133020 wait complete. 2023-07-06T21:54:47.145 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:54:47.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.291+0000 7f2694619640 1 Processor -- start 2023-07-06T21:54:47.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.291+0000 7f2694619640 1 -- start start 2023-07-06T21:54:47.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.291+0000 7f2694619640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f268c06fef0 0x7f268c164820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:47.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.291+0000 7f2694619640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268c0cc030 con 0x7f268c070d70 2023-07-06T21:54:47.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.291+0000 7f2694619640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268c0cc300 con 0x7f268c0709a0 2023-07-06T21:54:47.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.291+0000 7f2694619640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c0cc5e0 con 0x7f268c06fef0 2023-07-06T21:54:47.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.291+0000 7f2691bb4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f268c070d70 0x7f268c0b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44134/0 (socket says 172.21.15.55:44134) 2023-07-06T21:54:47.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.291+0000 7f2691bb4640 1 -- 172.21.15.55:0/2451155241 learned_addr learned my addr 172.21.15.55:0/2451155241 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:47.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.291+0000 7f2692bb6640 1 --2- 172.21.15.55:0/2451155241 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f268c06fef0 0x7f268c164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:47.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.291+0000 7f26913b3640 1 -- 172.21.15.55:0/2451155241 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956158607 0 0) 0x7f268c0cc300 con 0x7f268c0709a0 2023-07-06T21:54:47.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.291+0000 7f2692bb6640 1 -- 172.21.15.55:0/2451155241 >> v1:172.21.15.138:6789/0 conn(0x7f268c0709a0 legacy=0x7f268c0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:47.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.291+0000 7f2692bb6640 1 -- 172.21.15.55:0/2451155241 >> v1:172.21.15.55:6789/0 conn(0x7f268c070d70 legacy=0x7f268c0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:47.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.291+0000 7f2692bb6640 1 -- 172.21.15.55:0/2451155241 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c0cc8c0 con 0x7f268c06fef0 2023-07-06T21:54:47.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.295+0000 7f2692bb6640 1 --2- 172.21.15.55:0/2451155241 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f268c06fef0 0x7f268c164820 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2684009dc0 tx=0x7f268401c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fef23351a26fd90 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:47.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.295+0000 7f26913b3640 1 -- 172.21.15.55:0/2451155241 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26840a5860 con 0x7f268c06fef0 2023-07-06T21:54:47.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.295+0000 7f26913b3640 1 -- 172.21.15.55:0/2451155241 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26840a59c0 con 0x7f268c06fef0 2023-07-06T21:54:47.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.295+0000 7f26913b3640 1 -- 172.21.15.55:0/2451155241 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26840a5d50 con 0x7f268c06fef0 2023-07-06T21:54:47.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.295+0000 7f2694619640 1 -- 172.21.15.55:0/2451155241 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f268c06fef0 msgr2=0x7f268c164820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:47.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.295+0000 7f2694619640 1 --2- 172.21.15.55:0/2451155241 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f268c06fef0 0x7f268c164820 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2684009dc0 tx=0x7f268401c800 comp rx=0 tx=0).stop 2023-07-06T21:54:47.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2694619640 1 -- 172.21.15.55:0/2451155241 shutdown_connections 2023-07-06T21:54:47.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2694619640 1 --2- 172.21.15.55:0/2451155241 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f268c06fef0 0x7f268c164820 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2694619640 1 -- 172.21.15.55:0/2451155241 >> 172.21.15.55:0/2451155241 conn(0x7f268c0cea70 msgr2=0x7f268c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:47.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2694619640 1 -- 172.21.15.55:0/2451155241 shutdown_connections 2023-07-06T21:54:47.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2694619640 1 -- 172.21.15.55:0/2451155241 wait complete. 2023-07-06T21:54:47.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2694619640 1 Processor -- start 2023-07-06T21:54:47.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2694619640 1 -- start start 2023-07-06T21:54:47.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2694619640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f268c06fef0 0x7f268c1f1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:47.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2694619640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f268c0709a0 0x7f268c0693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:47.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2694619640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f268c070d70 0x7f268c15b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:47.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2694619640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c15acd0 con 0x7f268c070d70 2023-07-06T21:54:47.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2694619640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c15a0c0 con 0x7f268c0709a0 2023-07-06T21:54:47.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2694619640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c15a3a0 con 0x7f268c06fef0 2023-07-06T21:54:47.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2692bb6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f268c070d70 0x7f268c15b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:47.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2692bb6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f268c070d70 0x7f268c15b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33038/0 (socket says 172.21.15.55:33038) 2023-07-06T21:54:47.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2692bb6640 1 -- 172.21.15.55:0/2345518982 learned_addr learned my addr 172.21.15.55:0/2345518982 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:47.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f26923b5640 1 --2- 172.21.15.55:0/2345518982 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f268c06fef0 0x7f268c1f1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:47.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2691bb4640 1 --2- 172.21.15.55:0/2345518982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f268c0709a0 0x7f268c0693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:47.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2692bb6640 1 -- 172.21.15.55:0/2345518982 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f268c06fef0 msgr2=0x7f268c1f1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:47.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2692bb6640 1 --2- 172.21.15.55:0/2345518982 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f268c06fef0 0x7f268c1f1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2692bb6640 1 -- 172.21.15.55:0/2345518982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f268c0709a0 msgr2=0x7f268c0693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:47.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2692bb6640 1 --2- 172.21.15.55:0/2345518982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f268c0709a0 0x7f268c0693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.299+0000 7f2692bb6640 1 -- 172.21.15.55:0/2345518982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2684009a70 con 0x7f268c070d70 2023-07-06T21:54:47.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.303+0000 7f2692bb6640 1 --2- 172.21.15.55:0/2345518982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f268c070d70 0x7f268c15b160 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f268401aeb0 tx=0x7f26840195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:47.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.303+0000 7f2682ffd640 1 -- 172.21.15.55:0/2345518982 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26840adcc0 con 0x7f268c070d70 2023-07-06T21:54:47.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.303+0000 7f2682ffd640 1 -- 172.21.15.55:0/2345518982 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26840ade20 con 0x7f268c070d70 2023-07-06T21:54:47.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.303+0000 7f2682ffd640 1 -- 172.21.15.55:0/2345518982 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26840b7650 con 0x7f268c070d70 2023-07-06T21:54:47.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.303+0000 7f2694619640 1 -- 172.21.15.55:0/2345518982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268c15a680 con 0x7f268c070d70 2023-07-06T21:54:47.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.303+0000 7f2694619640 1 -- 172.21.15.55:0/2345518982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268c1f1650 con 0x7f268c070d70 2023-07-06T21:54:47.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.303+0000 7f2694619640 1 -- 172.21.15.55:0/2345518982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268c15ae40 con 0x7f268c070d70 2023-07-06T21:54:47.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.303+0000 7f2682ffd640 1 -- 172.21.15.55:0/2345518982 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f26840b4050 con 0x7f268c070d70 2023-07-06T21:54:47.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.303+0000 7f2682ffd640 1 -- 172.21.15.55:0/2345518982 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7385+0+0 (secure 0 0 0) 0x7f268411e960 con 0x7f268c070d70 2023-07-06T21:54:47.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.307+0000 7f2682ffd640 1 -- 172.21.15.55:0/2345518982 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f26840ebc10 con 0x7f268c070d70 2023-07-06T21:54:47.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.463+0000 7f2694619640 1 -- 172.21.15.55:0/2345518982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f268c066d60 con 0x7f268c070d70 2023-07-06T21:54:47.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.463+0000 7f2682ffd640 1 -- 172.21.15.55:0/2345518982 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26840ef230 con 0x7f268c070d70 2023-07-06T21:54:47.465 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:54:47.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.467+0000 7f2694619640 1 -- 172.21.15.55:0/2345518982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f268c070d70 msgr2=0x7f268c15b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:47.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.467+0000 7f2694619640 1 --2- 172.21.15.55:0/2345518982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f268c070d70 0x7f268c15b160 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f268401aeb0 tx=0x7f26840195a0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.467+0000 7f2694619640 1 -- 172.21.15.55:0/2345518982 shutdown_connections 2023-07-06T21:54:47.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.467+0000 7f2694619640 1 --2- 172.21.15.55:0/2345518982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f268c070d70 0x7f268c15b160 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.467+0000 7f2694619640 1 --2- 172.21.15.55:0/2345518982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f268c0709a0 0x7f268c0693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.467+0000 7f2694619640 1 --2- 172.21.15.55:0/2345518982 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f268c06fef0 0x7f268c1f1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.467+0000 7f2694619640 1 -- 172.21.15.55:0/2345518982 >> 172.21.15.55:0/2345518982 conn(0x7f268c0cea70 msgr2=0x7f268c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:47.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.467+0000 7f2694619640 1 -- 172.21.15.55:0/2345518982 shutdown_connections 2023-07-06T21:54:47.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.467+0000 7f2694619640 1 -- 172.21.15.55:0/2345518982 wait complete. 2023-07-06T21:54:47.485 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:54:47.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.627+0000 7f0a7d5fa640 1 Processor -- start 2023-07-06T21:54:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.627+0000 7f0a7d5fa640 1 -- start start 2023-07-06T21:54:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.631+0000 7f0a7d5fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a780ca080 0x7f0a780c08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.631+0000 7f0a7d5fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a78071200 con 0x7f0a7815d980 2023-07-06T21:54:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.631+0000 7f0a7d5fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a78070f20 con 0x7f0a7815dd50 2023-07-06T21:54:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.631+0000 7f0a7d5fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a780c85b0 con 0x7f0a780ca080 2023-07-06T21:54:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.631+0000 7f0a77fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0a7815d980 0x7f0a78161050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44136/0 (socket says 172.21.15.55:44136) 2023-07-06T21:54:47.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.631+0000 7f0a77fff640 1 -- 172.21.15.55:0/2084515350 learned_addr learned my addr 172.21.15.55:0/2084515350 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:47.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.631+0000 7f0a7cdf9640 1 --2- 172.21.15.55:0/2084515350 >> v2:172.21.15.55:3300/0 conn(0x7f0a780ca080 0x7f0a780c08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:47.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.631+0000 7f0a76ffd640 1 -- 172.21.15.55:0/2084515350 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019280823 0 0) 0x7f0a78071200 con 0x7f0a7815d980 2023-07-06T21:54:47.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.631+0000 7f0a76ffd640 1 -- 172.21.15.55:0/2084515350 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a60003530 con 0x7f0a7815d980 2023-07-06T21:54:47.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.631+0000 7f0a7cdf9640 1 -- 172.21.15.55:0/2084515350 >> v1:172.21.15.138:6789/0 conn(0x7f0a7815dd50 legacy=0x7f0a780c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:47.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.631+0000 7f0a7cdf9640 1 -- 172.21.15.55:0/2084515350 >> v1:172.21.15.55:6789/0 conn(0x7f0a7815d980 legacy=0x7f0a78161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:47.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.631+0000 7f0a76ffd640 1 -- 172.21.15.55:0/2084515350 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1527240715 0 0) 0x7f0a60003530 con 0x7f0a7815d980 2023-07-06T21:54:47.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.631+0000 7f0a7cdf9640 1 -- 172.21.15.55:0/2084515350 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a780cd310 con 0x7f0a780ca080 2023-07-06T21:54:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.635+0000 7f0a7cdf9640 1 --2- 172.21.15.55:0/2084515350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a780ca080 0x7f0a780c08d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009d90 tx=0x7f0a7001c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2228abc4afa922f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:47.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.635+0000 7f0a76ffd640 1 -- 172.21.15.55:0/2084515350 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68001680 con 0x7f0a780ca080 2023-07-06T21:54:47.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.635+0000 7f0a76ffd640 1 -- 172.21.15.55:0/2084515350 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a700a6420 con 0x7f0a780ca080 2023-07-06T21:54:47.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.635+0000 7f0a76ffd640 1 -- 172.21.15.55:0/2084515350 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700a6790 con 0x7f0a780ca080 2023-07-06T21:54:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.635+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2084515350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a780ca080 msgr2=0x7f0a780c08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.635+0000 7f0a7d5fa640 1 --2- 172.21.15.55:0/2084515350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a780ca080 0x7f0a780c08d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009d90 tx=0x7f0a7001c5d0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.635+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2084515350 shutdown_connections 2023-07-06T21:54:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.635+0000 7f0a7d5fa640 1 --2- 172.21.15.55:0/2084515350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a780ca080 0x7f0a780c08d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.635+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2084515350 >> 172.21.15.55:0/2084515350 conn(0x7f0a780cdcd0 msgr2=0x7f0a780ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.635+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2084515350 shutdown_connections 2023-07-06T21:54:47.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.635+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2084515350 wait complete. 2023-07-06T21:54:47.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.635+0000 7f0a7d5fa640 1 Processor -- start 2023-07-06T21:54:47.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.635+0000 7f0a7d5fa640 1 -- start start 2023-07-06T21:54:47.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7d5fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a780ca080 0x7f0a780b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:47.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7d5fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a7815d980 0x7f0a78164000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:47.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7d5fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a7815dd50 0x7f0a78157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:47.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7d5fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a781fc720 con 0x7f0a7815dd50 2023-07-06T21:54:47.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7d5fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a780b10c0 con 0x7f0a780ca080 2023-07-06T21:54:47.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7d5fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a781fbaa0 con 0x7f0a7815d980 2023-07-06T21:54:47.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7cdf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a7815dd50 0x7f0a78157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:47.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7cdf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a7815dd50 0x7f0a78157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33058/0 (socket says 172.21.15.55:33058) 2023-07-06T21:54:47.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7cdf9640 1 -- 172.21.15.55:0/2841470111 learned_addr learned my addr 172.21.15.55:0/2841470111 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:47.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a77fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a780ca080 0x7f0a780b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:47.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a777fe640 1 --2- 172.21.15.55:0/2841470111 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a7815d980 0x7f0a78164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:47.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7cdf9640 1 -- 172.21.15.55:0/2841470111 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a7815d980 msgr2=0x7f0a78164000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:47.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7cdf9640 1 --2- 172.21.15.55:0/2841470111 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a7815d980 0x7f0a78164000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7cdf9640 1 -- 172.21.15.55:0/2841470111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a780ca080 msgr2=0x7f0a780b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:47.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7cdf9640 1 --2- 172.21.15.55:0/2841470111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a780ca080 0x7f0a780b0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7cdf9640 1 -- 172.21.15.55:0/2841470111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a70009a70 con 0x7f0a7815dd50 2023-07-06T21:54:47.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7cdf9640 1 --2- 172.21.15.55:0/2841470111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a7815dd50 0x7f0a78157d70 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0a7001a200 tx=0x7f0a70019370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:47.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a74ff9640 1 -- 172.21.15.55:0/2841470111 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700044d0 con 0x7f0a7815dd50 2023-07-06T21:54:47.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a74ff9640 1 -- 172.21.15.55:0/2841470111 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a700b5070 con 0x7f0a7815dd50 2023-07-06T21:54:47.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a74ff9640 1 -- 172.21.15.55:0/2841470111 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70004870 con 0x7f0a7815dd50 2023-07-06T21:54:47.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2841470111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a781fbd80 con 0x7f0a7815dd50 2023-07-06T21:54:47.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2841470111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a781fc340 con 0x7f0a7815dd50 2023-07-06T21:54:47.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.639+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2841470111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a781fc860 con 0x7f0a7815dd50 2023-07-06T21:54:47.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.643+0000 7f0a74ff9640 1 -- 172.21.15.55:0/2841470111 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f0a700a6590 con 0x7f0a7815dd50 2023-07-06T21:54:47.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.643+0000 7f0a74ff9640 1 -- 172.21.15.55:0/2841470111 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7385+0+0 (secure 0 0 0) 0x7f0a7011e9a0 con 0x7f0a7815dd50 2023-07-06T21:54:47.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.647+0000 7f0a74ff9640 1 -- 172.21.15.55:0/2841470111 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a781fc860 con 0x7f0a7815dd50 2023-07-06T21:54:47.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.695+0000 7f0a74ff9640 1 -- 172.21.15.55:0/2841470111 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 17) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f0a700eb7b0 con 0x7f0a7815dd50 2023-07-06T21:54:47.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.695+0000 7f0a74ff9640 1 --2- 172.21.15.55:0/2841470111 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f0a6406c9c0 0x7f0a6406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:47.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.699+0000 7f0a77fff640 1 --2- 172.21.15.55:0/2841470111 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f0a6406c9c0 0x7f0a6406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:47.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.699+0000 7f0a77fff640 1 --2- 172.21.15.55:0/2841470111 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f0a6406c9c0 0x7f0a6406eda0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0a68005890 tx=0x7f0a68001db0 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:47.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.843+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2841470111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a781fc860 con 0x7f0a7815dd50 2023-07-06T21:54:47.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.843+0000 7f0a74ff9640 1 -- 172.21.15.55:0/2841470111 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f0a700dbfc0 con 0x7f0a7815dd50 2023-07-06T21:54:47.845 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:47.845 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2166228749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2166228749},{"type":"v1","addr":"172.21.15.138:6834","nonce":2166228749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3702805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3702805788},{"type":"v1","addr":"172.21.15.138:6835","nonce":3702805788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2574870623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2574870623},{"type":"v1","addr":"172.21.15.55:6836","nonce":2574870623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:43:28.108537+0000","modified":"2023-07-06T21:43:31.358407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1792917100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1792917100},{"type":"v1","addr":"172.21.15.55:6837","nonce":1792917100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T21:54:47.845 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2023-07-06T21:54:47.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.847+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2841470111 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f0a6406c9c0 msgr2=0x7f0a6406eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:47.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.847+0000 7f0a7d5fa640 1 --2- 172.21.15.55:0/2841470111 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f0a6406c9c0 0x7f0a6406eda0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0a68005890 tx=0x7f0a68001db0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.847+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2841470111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a7815dd50 msgr2=0x7f0a78157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:47.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.847+0000 7f0a7d5fa640 1 --2- 172.21.15.55:0/2841470111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a7815dd50 0x7f0a78157d70 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0a7001a200 tx=0x7f0a70019370 comp rx=0 tx=0).stop 2023-07-06T21:54:47.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.847+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2841470111 shutdown_connections 2023-07-06T21:54:47.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.847+0000 7f0a7d5fa640 1 --2- 172.21.15.55:0/2841470111 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f0a6406c9c0 0x7f0a6406eda0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.847+0000 7f0a7d5fa640 1 --2- 172.21.15.55:0/2841470111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a7815dd50 0x7f0a78157d70 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.847+0000 7f0a7d5fa640 1 --2- 172.21.15.55:0/2841470111 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a7815d980 0x7f0a78164000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.847+0000 7f0a7d5fa640 1 --2- 172.21.15.55:0/2841470111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a780ca080 0x7f0a780b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:47.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.847+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2841470111 >> 172.21.15.55:0/2841470111 conn(0x7f0a780cdcd0 msgr2=0x7f0a78162ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:47.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.847+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2841470111 shutdown_connections 2023-07-06T21:54:47.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:47.847+0000 7f0a7d5fa640 1 -- 172.21.15.55:0/2841470111 wait complete. 2023-07-06T21:54:47.866 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:54:48.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.007+0000 7efe6d167640 1 Processor -- start 2023-07-06T21:54:48.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.007+0000 7efe6d167640 1 -- start start 2023-07-06T21:54:48.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe6d167640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe680cb4a0 0x7efe6815cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe6d167640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efe6815f740 0x7efe680ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe6d167640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe680b5b50 con 0x7efe680cbc70 2023-07-06T21:54:48.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe6d167640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6815d130 con 0x7efe6815f740 2023-07-06T21:54:48.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe6d167640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe680cc8e0 con 0x7efe680cb4a0 2023-07-06T21:54:48.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe5ffff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efe6815f740 0x7efe680ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe66d9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe680cb4a0 0x7efe6815cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe6759e640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7efe680cbc70 0x7efe680cc070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:37326/0 (socket says 172.21.15.55:37326) 2023-07-06T21:54:48.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe5ffff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efe6815f740 0x7efe680ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:36416/0 (socket says 172.21.15.55:36416) 2023-07-06T21:54:48.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe6759e640 1 -- 172.21.15.55:0/3571678703 learned_addr learned my addr 172.21.15.55:0/3571678703 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:48.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe6659c640 1 -- 172.21.15.55:0/3571678703 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312608599 0 0) 0x7efe680b5b50 con 0x7efe680cbc70 2023-07-06T21:54:48.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe6659c640 1 -- 172.21.15.55:0/3571678703 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe54003530 con 0x7efe680cbc70 2023-07-06T21:54:48.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe5ffff640 1 -- 172.21.15.55:0/3571678703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe680cb4a0 msgr2=0x7efe6815cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:48.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe5ffff640 1 --2- 172.21.15.55:0/3571678703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe680cb4a0 0x7efe6815cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe5ffff640 1 -- 172.21.15.55:0/3571678703 >> v1:172.21.15.138:6789/0 conn(0x7efe680cbc70 legacy=0x7efe680cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.011+0000 7efe5ffff640 1 -- 172.21.15.55:0/3571678703 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6815fc00 con 0x7efe6815f740 2023-07-06T21:54:48.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.015+0000 7efe5ffff640 1 --2- 172.21.15.55:0/3571678703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe6815f740 0x7efe680ca720 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efe500097c0 tx=0x7efe5001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=294b48d57609c0e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:48.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.015+0000 7efe6659c640 1 -- 172.21.15.55:0/3571678703 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500ab600 con 0x7efe6815f740 2023-07-06T21:54:48.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.015+0000 7efe6659c640 1 -- 172.21.15.55:0/3571678703 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe500a7050 con 0x7efe6815f740 2023-07-06T21:54:48.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.015+0000 7efe6659c640 1 -- 172.21.15.55:0/3571678703 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500ab980 con 0x7efe6815f740 2023-07-06T21:54:48.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.015+0000 7efe6d167640 1 -- 172.21.15.55:0/3571678703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe6815f740 msgr2=0x7efe680ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.015+0000 7efe6d167640 1 --2- 172.21.15.55:0/3571678703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe6815f740 0x7efe680ca720 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efe500097c0 tx=0x7efe5001c480 comp rx=0 tx=0).stop 2023-07-06T21:54:48.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.015+0000 7efe6d167640 1 -- 172.21.15.55:0/3571678703 shutdown_connections 2023-07-06T21:54:48.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.015+0000 7efe6d167640 1 --2- 172.21.15.55:0/3571678703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe6815f740 0x7efe680ca720 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.015+0000 7efe6d167640 1 --2- 172.21.15.55:0/3571678703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe680cb4a0 0x7efe6815cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.015+0000 7efe6d167640 1 -- 172.21.15.55:0/3571678703 >> 172.21.15.55:0/3571678703 conn(0x7efe6806ee80 msgr2=0x7efe6806f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:48.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.015+0000 7efe6d167640 1 -- 172.21.15.55:0/3571678703 shutdown_connections 2023-07-06T21:54:48.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.015+0000 7efe6d167640 1 -- 172.21.15.55:0/3571678703 wait complete. 2023-07-06T21:54:48.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.015+0000 7efe6d167640 1 Processor -- start 2023-07-06T21:54:48.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe6d167640 1 -- start start 2023-07-06T21:54:48.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe6d167640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe680cb4a0 0x7efe6806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe6d167640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe680cbc70 0x7efe680c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe6d167640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe6815f740 0x7efe6815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe6d167640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe680c9530 con 0x7efe680cbc70 2023-07-06T21:54:48.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe6d167640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe680c3d80 con 0x7efe680cb4a0 2023-07-06T21:54:48.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe6d167640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6806e730 con 0x7efe6815f740 2023-07-06T21:54:48.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe680cbc70 0x7efe680c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe680cbc70 0x7efe680c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33072/0 (socket says 172.21.15.55:33072) 2023-07-06T21:54:48.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe5ffff640 1 -- 172.21.15.55:0/2293014833 learned_addr learned my addr 172.21.15.55:0/2293014833 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:48.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe6759e640 1 --2- 172.21.15.55:0/2293014833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe6815f740 0x7efe6815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe66d9d640 1 --2- 172.21.15.55:0/2293014833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe680cb4a0 0x7efe6806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe5ffff640 1 -- 172.21.15.55:0/2293014833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe6815f740 msgr2=0x7efe6815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe5ffff640 1 --2- 172.21.15.55:0/2293014833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe6815f740 0x7efe6815c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe5ffff640 1 -- 172.21.15.55:0/2293014833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe680cb4a0 msgr2=0x7efe6806e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe5ffff640 1 --2- 172.21.15.55:0/2293014833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe680cb4a0 0x7efe6806e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe5ffff640 1 -- 172.21.15.55:0/2293014833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe50009420 con 0x7efe680cbc70 2023-07-06T21:54:48.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe5ffff640 1 --2- 172.21.15.55:0/2293014833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe680cbc70 0x7efe680c81f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7efe500ae040 tx=0x7efe50019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:48.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe5f7fe640 1 -- 172.21.15.55:0/2293014833 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500b4430 con 0x7efe680cbc70 2023-07-06T21:54:48.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe5f7fe640 1 -- 172.21.15.55:0/2293014833 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe500b45b0 con 0x7efe680cbc70 2023-07-06T21:54:48.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe6d167640 1 -- 172.21.15.55:0/2293014833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe680c8c90 con 0x7efe680cbc70 2023-07-06T21:54:48.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe5f7fe640 1 -- 172.21.15.55:0/2293014833 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500b4960 con 0x7efe680cbc70 2023-07-06T21:54:48.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe6d167640 1 -- 172.21.15.55:0/2293014833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe680c9250 con 0x7efe680cbc70 2023-07-06T21:54:48.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.019+0000 7efe6d167640 1 -- 172.21.15.55:0/2293014833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe680c3be0 con 0x7efe680cbc70 2023-07-06T21:54:48.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.023+0000 7efe5f7fe640 1 -- 172.21.15.55:0/2293014833 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 85496+0+0 (secure 0 0 0) 0x7efe500b2040 con 0x7efe680cbc70 2023-07-06T21:54:48.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.023+0000 7efe5f7fe640 1 --2- 172.21.15.55:0/2293014833 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7efe480660d0 0x7efe48068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.023+0000 7efe5f7fe640 1 -- 172.21.15.55:0/2293014833 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7385+0+0 (secure 0 0 0) 0x7efe5011dc20 con 0x7efe680cbc70 2023-07-06T21:54:48.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.023+0000 7efe66d9d640 1 --2- 172.21.15.55:0/2293014833 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7efe480660d0 0x7efe48068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.023+0000 7efe66d9d640 1 --2- 172.21.15.55:0/2293014833 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7efe480660d0 0x7efe48068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efe58009ac0 tx=0x7efe58009190 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:48.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.027+0000 7efe5f7fe640 1 -- 172.21.15.55:0/2293014833 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe680c3be0 con 0x7efe680cbc70 2023-07-06T21:54:48.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.183+0000 7efe6d167640 1 -- 172.21.15.55:0/2293014833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe680c3be0 con 0x7efe680cbc70 2023-07-06T21:54:48.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.187+0000 7efe5f7fe640 1 -- 172.21.15.55:0/2293014833 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+20003 (secure 0 0 0) 0x7efe680c3be0 con 0x7efe680cbc70 2023-07-06T21:54:48.186 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:48.187 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":60,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:54:46.685710+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:43:26.444989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-06T21:43:27.092120+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":59,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/901057021":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/4077940983":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/2605447220":"2023-07-07T21:43:45.377574+0000","172.21.15.55:6832/1575998409":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/2297905762":"2023-07-07T21:43:45.377574+0000","172.21.15.55:6833/1575998409":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/4216478759":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/3760089478":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/2066223848":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/1485483431":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/1005520698":"2023-07-07T21:43:45.377574+0000","172.21.15.55:6833/1149809384":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/2744432881":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/3786956974":"2023-07-07T21:54:46.685675+0000","172.21.15.55:6832/1149809384":"2023-07-07T21:54:46.685675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":13,"length":1},{"begin":23,"length":1},{"begin":33,"length":1},{"begin":44,"length":1},{"begin":50,"length":1},{"begin":54,"length":1},{"begin":60,"length":1},{"begin":65,"length":1},{"begin":71,"length":2},{"begin":76,"length":1},{"begin":83,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":104,"length":1},{"begin":108,"length":1},{"begin":204,"length":18}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:54:48.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.187+0000 7efe6d167640 1 -- 172.21.15.55:0/2293014833 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7efe480660d0 msgr2=0x7efe48068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.187+0000 7efe6d167640 1 --2- 172.21.15.55:0/2293014833 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7efe480660d0 0x7efe48068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efe58009ac0 tx=0x7efe58009190 comp rx=0 tx=0).stop 2023-07-06T21:54:48.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.187+0000 7efe6d167640 1 -- 172.21.15.55:0/2293014833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe680cbc70 msgr2=0x7efe680c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.187+0000 7efe6d167640 1 --2- 172.21.15.55:0/2293014833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe680cbc70 0x7efe680c81f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7efe500ae040 tx=0x7efe50019220 comp rx=0 tx=0).stop 2023-07-06T21:54:48.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.187+0000 7efe6d167640 1 -- 172.21.15.55:0/2293014833 shutdown_connections 2023-07-06T21:54:48.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.187+0000 7efe6d167640 1 --2- 172.21.15.55:0/2293014833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efe6815f740 0x7efe6815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.187+0000 7efe6d167640 1 --2- 172.21.15.55:0/2293014833 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7efe480660d0 0x7efe48068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.187+0000 7efe6d167640 1 --2- 172.21.15.55:0/2293014833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe680cbc70 0x7efe680c81f0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.187+0000 7efe6d167640 1 --2- 172.21.15.55:0/2293014833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe680cb4a0 0x7efe6806e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.187+0000 7efe6d167640 1 -- 172.21.15.55:0/2293014833 >> 172.21.15.55:0/2293014833 conn(0x7efe6806ee80 msgr2=0x7efe6815b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:48.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.187+0000 7efe6d167640 1 -- 172.21.15.55:0/2293014833 shutdown_connections 2023-07-06T21:54:48.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.187+0000 7efe6d167640 1 -- 172.21.15.55:0/2293014833 wait complete. 2023-07-06T21:54:48.208 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T21:54:48.208 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:54:48.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.351+0000 7fa057d82640 1 Processor -- start 2023-07-06T21:54:48.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.351+0000 7fa057d82640 1 -- start start 2023-07-06T21:54:48.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.351+0000 7fa057d82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa05015bc40 0x7fa05006c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.351+0000 7fa057d82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa05015cc00 0x7fa05015f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.351+0000 7fa057d82640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05015c770 con 0x7fa05006f8e0 2023-07-06T21:54:48.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.351+0000 7fa057d82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05006d4f0 con 0x7fa05015cc00 2023-07-06T21:54:48.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.351+0000 7fa057d82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05006d210 con 0x7fa05015bc40 2023-07-06T21:54:48.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.355+0000 7fa05631f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa05015cc00 0x7fa05015f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.355+0000 7fa05631f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa05015cc00 0x7fa05015f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33088/0 (socket says 172.21.15.55:33088) 2023-07-06T21:54:48.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.355+0000 7fa05631f640 1 -- 172.21.15.55:0/2417381049 learned_addr learned my addr 172.21.15.55:0/2417381049 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:48.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.355+0000 7fa05531d640 1 --2- 172.21.15.55:0/2417381049 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa05015bc40 0x7fa05006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.355+0000 7fa05631f640 1 -- 172.21.15.55:0/2417381049 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa05015bc40 msgr2=0x7fa05006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:48.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.355+0000 7fa05631f640 1 --2- 172.21.15.55:0/2417381049 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa05015bc40 0x7fa05006c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.355+0000 7fa05631f640 1 -- 172.21.15.55:0/2417381049 >> v1:172.21.15.138:6789/0 conn(0x7fa05006f8e0 legacy=0x7fa05006fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.355+0000 7fa05631f640 1 -- 172.21.15.55:0/2417381049 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05015c120 con 0x7fa05015cc00 2023-07-06T21:54:48.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.355+0000 7fa05531d640 1 --2- 172.21.15.55:0/2417381049 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa05015bc40 0x7fa05006c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:48.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.355+0000 7fa05631f640 1 --2- 172.21.15.55:0/2417381049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa05015cc00 0x7fa05015f4c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa048009e50 tx=0x7fa04801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12636a66308a52 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:48.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.355+0000 7fa054b1c640 1 -- 172.21.15.55:0/2417381049 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0480a57e0 con 0x7fa05015cc00 2023-07-06T21:54:48.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.355+0000 7fa054b1c640 1 -- 172.21.15.55:0/2417381049 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0480a5940 con 0x7fa05015cc00 2023-07-06T21:54:48.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.355+0000 7fa054b1c640 1 -- 172.21.15.55:0/2417381049 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0480a5cd0 con 0x7fa05015cc00 2023-07-06T21:54:48.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 -- 172.21.15.55:0/2417381049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa05015cc00 msgr2=0x7fa05015f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 --2- 172.21.15.55:0/2417381049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa05015cc00 0x7fa05015f4c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa048009e50 tx=0x7fa04801c9e0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 -- 172.21.15.55:0/2417381049 shutdown_connections 2023-07-06T21:54:48.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 --2- 172.21.15.55:0/2417381049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa05015cc00 0x7fa05015f4c0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 --2- 172.21.15.55:0/2417381049 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa05015bc40 0x7fa05006c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 -- 172.21.15.55:0/2417381049 >> 172.21.15.55:0/2417381049 conn(0x7fa0500cbd80 msgr2=0x7fa0500ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:48.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 -- 172.21.15.55:0/2417381049 shutdown_connections 2023-07-06T21:54:48.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 -- 172.21.15.55:0/2417381049 wait complete. 2023-07-06T21:54:48.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 Processor -- start 2023-07-06T21:54:48.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 -- start start 2023-07-06T21:54:48.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa05006f8e0 0x7fa0500c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa05015bc40 0x7fa0500ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa05015cc00 0x7fa0501469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa050148560 con 0x7fa05006f8e0 2023-07-06T21:54:48.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0500c9ea0 con 0x7fa05015bc40 2023-07-06T21:54:48.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa057d82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa050147f10 con 0x7fa05015cc00 2023-07-06T21:54:48.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa055b1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa05006f8e0 0x7fa0500c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa055b1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa05006f8e0 0x7fa0500c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33102/0 (socket says 172.21.15.55:33102) 2023-07-06T21:54:48.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa055b1e640 1 -- 172.21.15.55:0/3906998393 learned_addr learned my addr 172.21.15.55:0/3906998393 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:48.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa05531d640 1 --2- 172.21.15.55:0/3906998393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa05015bc40 0x7fa0500ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa05631f640 1 --2- 172.21.15.55:0/3906998393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa05015cc00 0x7fa0501469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa055b1e640 1 -- 172.21.15.55:0/3906998393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa05015cc00 msgr2=0x7fa0501469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa055b1e640 1 --2- 172.21.15.55:0/3906998393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa05015cc00 0x7fa0501469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa055b1e640 1 -- 172.21.15.55:0/3906998393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa05015bc40 msgr2=0x7fa0500ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa055b1e640 1 --2- 172.21.15.55:0/3906998393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa05015bc40 0x7fa0500ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.359+0000 7fa055b1e640 1 -- 172.21.15.55:0/3906998393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa048009b30 con 0x7fa05006f8e0 2023-07-06T21:54:48.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.363+0000 7fa055b1e640 1 --2- 172.21.15.55:0/3906998393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa05006f8e0 0x7fa0500c97e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00c500 tx=0x7fa04c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:48.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.363+0000 7fa0467fc640 1 -- 172.21.15.55:0/3906998393 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c005220 con 0x7fa05006f8e0 2023-07-06T21:54:48.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.363+0000 7fa0467fc640 1 -- 172.21.15.55:0/3906998393 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04c005380 con 0x7fa05006f8e0 2023-07-06T21:54:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.363+0000 7fa0467fc640 1 -- 172.21.15.55:0/3906998393 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c007270 con 0x7fa05006f8e0 2023-07-06T21:54:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.363+0000 7fa057d82640 1 -- 172.21.15.55:0/3906998393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0501481f0 con 0x7fa05006f8e0 2023-07-06T21:54:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.363+0000 7fa057d82640 1 -- 172.21.15.55:0/3906998393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa050146f30 con 0x7fa05006f8e0 2023-07-06T21:54:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.363+0000 7fa057d82640 1 -- 172.21.15.55:0/3906998393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa050159d70 con 0x7fa05006f8e0 2023-07-06T21:54:48.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.363+0000 7fa0467fc640 1 -- 172.21.15.55:0/3906998393 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fa04c0073d0 con 0x7fa05006f8e0 2023-07-06T21:54:48.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.363+0000 7fa0467fc640 1 --2- 172.21.15.55:0/3906998393 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fa0340660d0 0x7fa034068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.363+0000 7fa0467fc640 1 -- 172.21.15.55:0/3906998393 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7385+0+0 (secure 0 0 0) 0x7fa04c083770 con 0x7fa05006f8e0 2023-07-06T21:54:48.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.363+0000 7fa05531d640 1 --2- 172.21.15.55:0/3906998393 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fa0340660d0 0x7fa034068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.367+0000 7fa05531d640 1 --2- 172.21.15.55:0/3906998393 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fa0340660d0 0x7fa034068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa050152230 tx=0x7fa040008040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.367+0000 7fa0467fc640 1 -- 172.21.15.55:0/3906998393 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa04c050960 con 0x7fa05006f8e0 2023-07-06T21:54:48.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.555+0000 7fa057d82640 1 -- 172.21.15.55:0/3906998393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa050066d60 con 0x7fa05006f8e0 2023-07-06T21:54:48.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.555+0000 7fa0467fc640 1 -- 172.21.15.55:0/3906998393 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fa04c053f80 con 0x7fa05006f8e0 2023-07-06T21:54:48.556 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:48.556 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2166228749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2166228749},{"type":"v1","addr":"172.21.15.138:6834","nonce":2166228749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3702805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3702805788},{"type":"v1","addr":"172.21.15.138:6835","nonce":3702805788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2574870623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2574870623},{"type":"v1","addr":"172.21.15.55:6836","nonce":2574870623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:43:28.108537+0000","modified":"2023-07-06T21:43:31.358407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1792917100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1792917100},{"type":"v1","addr":"172.21.15.55:6837","nonce":1792917100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T21:54:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2023-07-06T21:54:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.559+0000 7fa057d82640 1 -- 172.21.15.55:0/3906998393 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fa0340660d0 msgr2=0x7fa034068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.559+0000 7fa057d82640 1 --2- 172.21.15.55:0/3906998393 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fa0340660d0 0x7fa034068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa050152230 tx=0x7fa040008040 comp rx=0 tx=0).stop 2023-07-06T21:54:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.559+0000 7fa057d82640 1 -- 172.21.15.55:0/3906998393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa05006f8e0 msgr2=0x7fa0500c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.559+0000 7fa057d82640 1 --2- 172.21.15.55:0/3906998393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa05006f8e0 0x7fa0500c97e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00c500 tx=0x7fa04c00c9c0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.559+0000 7fa057d82640 1 -- 172.21.15.55:0/3906998393 shutdown_connections 2023-07-06T21:54:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.559+0000 7fa057d82640 1 --2- 172.21.15.55:0/3906998393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa05015cc00 0x7fa0501469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.559+0000 7fa057d82640 1 --2- 172.21.15.55:0/3906998393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa05015bc40 0x7fa0500ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.559+0000 7fa057d82640 1 --2- 172.21.15.55:0/3906998393 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fa0340660d0 0x7fa034068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.559+0000 7fa057d82640 1 --2- 172.21.15.55:0/3906998393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa05006f8e0 0x7fa0500c97e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.559+0000 7fa057d82640 1 -- 172.21.15.55:0/3906998393 >> 172.21.15.55:0/3906998393 conn(0x7fa0500cbd80 msgr2=0x7fa05015e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.559+0000 7fa057d82640 1 -- 172.21.15.55:0/3906998393 shutdown_connections 2023-07-06T21:54:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.559+0000 7fa057d82640 1 -- 172.21.15.55:0/3906998393 wait complete. 2023-07-06T21:54:48.576 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:54:48.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.723+0000 7ff197511640 1 Processor -- start 2023-07-06T21:54:48.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.723+0000 7ff197511640 1 -- start start 2023-07-06T21:54:48.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.723+0000 7ff197511640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff190158400 0x7ff1900c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.723+0000 7ff197511640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff1900c9680 0x7ff190070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.723+0000 7ff197511640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1900710c0 0x7ff1900cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.723+0000 7ff197511640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19006fae0 con 0x7ff190158400 2023-07-06T21:54:48.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.723+0000 7ff197511640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19006fdc0 con 0x7ff1900c9680 2023-07-06T21:54:48.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.723+0000 7ff197511640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1900700a0 con 0x7ff1900710c0 2023-07-06T21:54:48.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.723+0000 7ff1952ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff190158400 0x7ff1900c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.723+0000 7ff1952ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff190158400 0x7ff1900c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33104/0 (socket says 172.21.15.55:33104) 2023-07-06T21:54:48.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.723+0000 7ff1952ad640 1 -- 172.21.15.55:0/2066428851 learned_addr learned my addr 172.21.15.55:0/2066428851 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:48.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.723+0000 7ff195aae640 1 --2- 172.21.15.55:0/2066428851 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1900710c0 0x7ff1900cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.723+0000 7ff194aac640 1 --2- 172.21.15.55:0/2066428851 >> v2:172.21.15.138:3300/0 conn(0x7ff1900c9680 0x7ff190070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff1952ad640 1 -- 172.21.15.55:0/2066428851 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1900710c0 msgr2=0x7ff1900cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:48.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff1952ad640 1 --2- 172.21.15.55:0/2066428851 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1900710c0 0x7ff1900cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff1952ad640 1 -- 172.21.15.55:0/2066428851 >> v2:172.21.15.138:3300/0 conn(0x7ff1900c9680 msgr2=0x7ff190070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:48.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff1952ad640 1 --2- 172.21.15.55:0/2066428851 >> v2:172.21.15.138:3300/0 conn(0x7ff1900c9680 0x7ff190070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff1952ad640 1 -- 172.21.15.55:0/2066428851 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff190070380 con 0x7ff190158400 2023-07-06T21:54:48.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff194aac640 1 --2- 172.21.15.55:0/2066428851 >> v2:172.21.15.138:3300/0 conn(0x7ff1900c9680 0x7ff190070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:48.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff1952ad640 1 --2- 172.21.15.55:0/2066428851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff190158400 0x7ff1900c9140 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff19006f060 tx=0x7ff18c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dcd90872e633905 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:48.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff187fff640 1 -- 172.21.15.55:0/2066428851 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c0aa610 con 0x7ff190158400 2023-07-06T21:54:48.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff187fff640 1 -- 172.21.15.55:0/2066428851 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c0a6040 con 0x7ff190158400 2023-07-06T21:54:48.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff187fff640 1 -- 172.21.15.55:0/2066428851 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c0aa990 con 0x7ff190158400 2023-07-06T21:54:48.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff197511640 1 -- 172.21.15.55:0/2066428851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff190158400 msgr2=0x7ff1900c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff197511640 1 --2- 172.21.15.55:0/2066428851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff190158400 0x7ff1900c9140 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff19006f060 tx=0x7ff18c01c4d0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff197511640 1 -- 172.21.15.55:0/2066428851 shutdown_connections 2023-07-06T21:54:48.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff197511640 1 --2- 172.21.15.55:0/2066428851 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1900710c0 0x7ff1900cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff197511640 1 --2- 172.21.15.55:0/2066428851 >> v2:172.21.15.138:3300/0 conn(0x7ff1900c9680 0x7ff190070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff197511640 1 --2- 172.21.15.55:0/2066428851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff190158400 0x7ff1900c9140 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff197511640 1 -- 172.21.15.55:0/2066428851 >> 172.21.15.55:0/2066428851 conn(0x7ff1900cded0 msgr2=0x7ff1900ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:48.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff197511640 1 -- 172.21.15.55:0/2066428851 shutdown_connections 2023-07-06T21:54:48.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.727+0000 7ff197511640 1 -- 172.21.15.55:0/2066428851 wait complete. 2023-07-06T21:54:48.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff197511640 1 Processor -- start 2023-07-06T21:54:48.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff197511640 1 -- start start 2023-07-06T21:54:48.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff197511640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1900710c0 0x7ff190151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff197511640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900c9680 0x7ff1900cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff197511640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff190158400 0x7ff1900ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff197511640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff190153750 con 0x7ff1900c9680 2023-07-06T21:54:48.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff197511640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff190152b60 con 0x7ff1900710c0 2023-07-06T21:54:48.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff197511640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1901594f0 con 0x7ff190158400 2023-07-06T21:54:48.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff194aac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900c9680 0x7ff1900cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff194aac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900c9680 0x7ff1900cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33114/0 (socket says 172.21.15.55:33114) 2023-07-06T21:54:48.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff194aac640 1 -- 172.21.15.55:0/1412553207 learned_addr learned my addr 172.21.15.55:0/1412553207 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:48.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff1952ad640 1 --2- 172.21.15.55:0/1412553207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1900710c0 0x7ff190151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff195aae640 1 --2- 172.21.15.55:0/1412553207 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff190158400 0x7ff1900ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff194aac640 1 -- 172.21.15.55:0/1412553207 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff190158400 msgr2=0x7ff1900ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff194aac640 1 --2- 172.21.15.55:0/1412553207 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff190158400 0x7ff1900ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff194aac640 1 -- 172.21.15.55:0/1412553207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1900710c0 msgr2=0x7ff190151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff194aac640 1 --2- 172.21.15.55:0/1412553207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1900710c0 0x7ff190151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff194aac640 1 -- 172.21.15.55:0/1412553207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0094d0 con 0x7ff1900c9680 2023-07-06T21:54:48.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff194aac640 1 --2- 172.21.15.55:0/1412553207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900c9680 0x7ff1900cca80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff18000e810 tx=0x7ff18000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:48.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff185ffb640 1 -- 172.21.15.55:0/1412553207 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18000c6d0 con 0x7ff1900c9680 2023-07-06T21:54:48.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff185ffb640 1 -- 172.21.15.55:0/1412553207 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18000c830 con 0x7ff1900c9680 2023-07-06T21:54:48.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff185ffb640 1 -- 172.21.15.55:0/1412553207 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18000cbe0 con 0x7ff1900c9680 2023-07-06T21:54:48.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.731+0000 7ff197511640 1 -- 172.21.15.55:0/1412553207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff190152390 con 0x7ff1900c9680 2023-07-06T21:54:48.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.735+0000 7ff197511640 1 -- 172.21.15.55:0/1412553207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff190153100 con 0x7ff1900c9680 2023-07-06T21:54:48.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.735+0000 7ff197511640 1 -- 172.21.15.55:0/1412553207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19006c580 con 0x7ff1900c9680 2023-07-06T21:54:48.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.735+0000 7ff185ffb640 1 -- 172.21.15.55:0/1412553207 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff18000cd40 con 0x7ff1900c9680 2023-07-06T21:54:48.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.735+0000 7ff185ffb640 1 --2- 172.21.15.55:0/1412553207 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ff1740663a0 0x7ff174068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:48.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.735+0000 7ff185ffb640 1 -- 172.21.15.55:0/1412553207 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7385+0+0 (secure 0 0 0) 0x7ff1800842a0 con 0x7ff1900c9680 2023-07-06T21:54:48.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.735+0000 7ff1952ad640 1 --2- 172.21.15.55:0/1412553207 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ff1740663a0 0x7ff174068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:48.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.735+0000 7ff1952ad640 1 --2- 172.21.15.55:0/1412553207 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ff1740663a0 0x7ff174068850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0ae000 tx=0x7ff18c0b5040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:48.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.739+0000 7ff185ffb640 1 -- 172.21.15.55:0/1412553207 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff180050fe0 con 0x7ff1900c9680 2023-07-06T21:54:48.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.927+0000 7ff197511640 1 -- 172.21.15.55:0/1412553207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff190066d60 con 0x7ff1900c9680 2023-07-06T21:54:48.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.931+0000 7ff185ffb640 1 -- 172.21.15.55:0/1412553207 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4677 (secure 0 0 0) 0x7ff180054600 con 0x7ff1900c9680 2023-07-06T21:54:48.930 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:48.930 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2166228749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2166228749},{"type":"v1","addr":"172.21.15.138:6834","nonce":2166228749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3702805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3702805788},{"type":"v1","addr":"172.21.15.138:6835","nonce":3702805788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2574870623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2574870623},{"type":"v1","addr":"172.21.15.55:6836","nonce":2574870623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:43:28.108537+0000","modified":"2023-07-06T21:43:31.358407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1792917100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1792917100},{"type":"v1","addr":"172.21.15.55:6837","nonce":1792917100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T21:54:48.930 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2023-07-06T21:54:48.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.931+0000 7ff197511640 1 -- 172.21.15.55:0/1412553207 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ff1740663a0 msgr2=0x7ff174068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.931+0000 7ff197511640 1 --2- 172.21.15.55:0/1412553207 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ff1740663a0 0x7ff174068850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0ae000 tx=0x7ff18c0b5040 comp rx=0 tx=0).stop 2023-07-06T21:54:48.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.931+0000 7ff197511640 1 -- 172.21.15.55:0/1412553207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900c9680 msgr2=0x7ff1900cca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:48.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.931+0000 7ff197511640 1 --2- 172.21.15.55:0/1412553207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900c9680 0x7ff1900cca80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff18000e810 tx=0x7ff18000ecd0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.931+0000 7ff197511640 1 -- 172.21.15.55:0/1412553207 shutdown_connections 2023-07-06T21:54:48.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.931+0000 7ff197511640 1 --2- 172.21.15.55:0/1412553207 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff190158400 0x7ff1900ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.931+0000 7ff197511640 1 --2- 172.21.15.55:0/1412553207 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ff1740663a0 0x7ff174068850 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.931+0000 7ff197511640 1 --2- 172.21.15.55:0/1412553207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1900c9680 0x7ff1900cca80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.931+0000 7ff197511640 1 --2- 172.21.15.55:0/1412553207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1900710c0 0x7ff190151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:48.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.931+0000 7ff197511640 1 -- 172.21.15.55:0/1412553207 >> 172.21.15.55:0/1412553207 conn(0x7ff1900cded0 msgr2=0x7ff19006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:48.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.931+0000 7ff197511640 1 -- 172.21.15.55:0/1412553207 shutdown_connections 2023-07-06T21:54:48.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:48.931+0000 7ff197511640 1 -- 172.21.15.55:0/1412553207 wait complete. 2023-07-06T21:54:48.950 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:54:49.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.091+0000 7f2e01540640 1 Processor -- start 2023-07-06T21:54:49.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.091+0000 7f2e01540640 1 -- start start 2023-07-06T21:54:49.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2e01540640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2dfc158400 0x7f2dfc0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:49.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2e01540640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2dfc0c9680 0x7f2dfc070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:49.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2e01540640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dfc0710c0 0x7f2dfc0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:49.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2e01540640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dfc06fae0 con 0x7f2dfc0c9680 2023-07-06T21:54:49.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2e01540640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dfc06fdc0 con 0x7f2dfc158400 2023-07-06T21:54:49.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2e01540640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc0700a0 con 0x7f2dfc0710c0 2023-07-06T21:54:49.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2df3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2dfc0c9680 0x7f2dfc070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:49.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2df3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2dfc0c9680 0x7f2dfc070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33120/0 (socket says 172.21.15.55:33120) 2023-07-06T21:54:49.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2df3fff640 1 -- 172.21.15.55:0/2062840885 learned_addr learned my addr 172.21.15.55:0/2062840885 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:49.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2dfaffd640 1 --2- 172.21.15.55:0/2062840885 >> v2:172.21.15.138:3300/0 conn(0x7f2dfc158400 0x7f2dfc0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:49.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2dfb7fe640 1 --2- 172.21.15.55:0/2062840885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dfc0710c0 0x7f2dfc0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:49.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2df3fff640 1 -- 172.21.15.55:0/2062840885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dfc0710c0 msgr2=0x7f2dfc0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:49.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2df3fff640 1 --2- 172.21.15.55:0/2062840885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dfc0710c0 0x7f2dfc0cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2df3fff640 1 -- 172.21.15.55:0/2062840885 >> v2:172.21.15.138:3300/0 conn(0x7f2dfc158400 msgr2=0x7f2dfc0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:49.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2df3fff640 1 --2- 172.21.15.55:0/2062840885 >> v2:172.21.15.138:3300/0 conn(0x7f2dfc158400 0x7f2dfc0c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2df3fff640 1 -- 172.21.15.55:0/2062840885 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc070380 con 0x7f2dfc0c9680 2023-07-06T21:54:49.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.095+0000 7f2dfaffd640 1 --2- 172.21.15.55:0/2062840885 >> v2:172.21.15.138:3300/0 conn(0x7f2dfc158400 0x7f2dfc0c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:49.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2df3fff640 1 --2- 172.21.15.55:0/2062840885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc0c9680 0x7f2dfc070b80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc06ed50 tx=0x7f2de401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e9fd50da445ab5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2dfa7fc640 1 -- 172.21.15.55:0/2062840885 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40a7c50 con 0x7f2dfc0c9680 2023-07-06T21:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2dfa7fc640 1 -- 172.21.15.55:0/2062840885 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de40a7db0 con 0x7f2dfc0c9680 2023-07-06T21:54:49.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2dfa7fc640 1 -- 172.21.15.55:0/2062840885 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40af660 con 0x7f2dfc0c9680 2023-07-06T21:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2e01540640 1 -- 172.21.15.55:0/2062840885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc0c9680 msgr2=0x7f2dfc070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2e01540640 1 --2- 172.21.15.55:0/2062840885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc0c9680 0x7f2dfc070b80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc06ed50 tx=0x7f2de401eba0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2e01540640 1 -- 172.21.15.55:0/2062840885 shutdown_connections 2023-07-06T21:54:49.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2e01540640 1 --2- 172.21.15.55:0/2062840885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dfc0710c0 0x7f2dfc0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2e01540640 1 --2- 172.21.15.55:0/2062840885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc0c9680 0x7f2dfc070b80 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2e01540640 1 --2- 172.21.15.55:0/2062840885 >> v2:172.21.15.138:3300/0 conn(0x7f2dfc158400 0x7f2dfc0c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2e01540640 1 -- 172.21.15.55:0/2062840885 >> 172.21.15.55:0/2062840885 conn(0x7f2dfc0cded0 msgr2=0x7f2dfc0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:49.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2e01540640 1 -- 172.21.15.55:0/2062840885 shutdown_connections 2023-07-06T21:54:49.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2e01540640 1 -- 172.21.15.55:0/2062840885 wait complete. 2023-07-06T21:54:49.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2e01540640 1 Processor -- start 2023-07-06T21:54:49.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.099+0000 7f2e01540640 1 -- start start 2023-07-06T21:54:49.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2e01540640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dfc0710c0 0x7f2dfc1f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:49.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2e01540640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dfc0c9680 0x7f2dfc14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:49.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2e01540640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc158400 0x7f2dfc14f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:49.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2e01540640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc0b1810 con 0x7f2dfc158400 2023-07-06T21:54:49.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2e01540640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc0b0ee0 con 0x7f2dfc0c9680 2023-07-06T21:54:49.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2e01540640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc0b11c0 con 0x7f2dfc0710c0 2023-07-06T21:54:49.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2dfb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc158400 0x7f2dfc14f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:49.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2dfb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc158400 0x7f2dfc14f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33132/0 (socket says 172.21.15.55:33132) 2023-07-06T21:54:49.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2dfb7fe640 1 -- 172.21.15.55:0/4276626204 learned_addr learned my addr 172.21.15.55:0/4276626204 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:49.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2dfaffd640 1 --2- 172.21.15.55:0/4276626204 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dfc0710c0 0x7f2dfc1f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:49.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2df3fff640 1 --2- 172.21.15.55:0/4276626204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dfc0c9680 0x7f2dfc14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2dfb7fe640 1 -- 172.21.15.55:0/4276626204 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dfc0710c0 msgr2=0x7f2dfc1f7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2dfb7fe640 1 --2- 172.21.15.55:0/4276626204 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dfc0710c0 0x7f2dfc1f7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2dfb7fe640 1 -- 172.21.15.55:0/4276626204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dfc0c9680 msgr2=0x7f2dfc14ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2dfb7fe640 1 --2- 172.21.15.55:0/4276626204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dfc0c9680 0x7f2dfc14ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2dfb7fe640 1 -- 172.21.15.55:0/4276626204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de400b770 con 0x7f2dfc158400 2023-07-06T21:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2dfb7fe640 1 --2- 172.21.15.55:0/4276626204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc158400 0x7f2dfc14f1b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2df4007e30 tx=0x7f2df400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2df37fe640 1 -- 172.21.15.55:0/4276626204 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4014420 con 0x7f2dfc158400 2023-07-06T21:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2df37fe640 1 -- 172.21.15.55:0/4276626204 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df4014580 con 0x7f2dfc158400 2023-07-06T21:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2df37fe640 1 -- 172.21.15.55:0/4276626204 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4014930 con 0x7f2dfc158400 2023-07-06T21:54:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2e01540640 1 -- 172.21.15.55:0/4276626204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dfc0b14a0 con 0x7f2dfc158400 2023-07-06T21:54:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2e01540640 1 -- 172.21.15.55:0/4276626204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dfc1f5f10 con 0x7f2dfc158400 2023-07-06T21:54:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2e01540640 1 -- 172.21.15.55:0/4276626204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dfc06c580 con 0x7f2dfc158400 2023-07-06T21:54:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.103+0000 7f2df37fe640 1 -- 172.21.15.55:0/4276626204 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2df4014a90 con 0x7f2dfc158400 2023-07-06T21:54:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.107+0000 7f2df37fe640 1 --2- 172.21.15.55:0/4276626204 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f2ddc0663a0 0x7f2ddc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:49.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.107+0000 7f2df37fe640 1 -- 172.21.15.55:0/4276626204 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7385+0+0 (secure 0 0 0) 0x7f2df4084b90 con 0x7f2dfc158400 2023-07-06T21:54:49.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.107+0000 7f2dfaffd640 1 --2- 172.21.15.55:0/4276626204 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f2ddc0663a0 0x7f2ddc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:49.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.107+0000 7f2dfaffd640 1 --2- 172.21.15.55:0/4276626204 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f2ddc0663a0 0x7f2ddc068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0045f0 tx=0x7f2dec008040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:49.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.111+0000 7f2df37fe640 1 -- 172.21.15.55:0/4276626204 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2df4055510 con 0x7f2dfc158400 2023-07-06T21:54:49.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.267+0000 7f2e01540640 1 -- 172.21.15.55:0/4276626204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2dfc066d60 con 0x7f2dfc158400 2023-07-06T21:54:49.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.267+0000 7f2df37fe640 1 -- 172.21.15.55:0/4276626204 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+20003 (secure 0 0 0) 0x7f2df4009960 con 0x7f2dfc158400 2023-07-06T21:54:49.269 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:49.269 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":60,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:54:46.685710+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:43:26.444989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-06T21:43:27.092120+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":59,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/901057021":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/4077940983":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/2605447220":"2023-07-07T21:43:45.377574+0000","172.21.15.55:6832/1575998409":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/2297905762":"2023-07-07T21:43:45.377574+0000","172.21.15.55:6833/1575998409":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/4216478759":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/3760089478":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/2066223848":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/1485483431":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/1005520698":"2023-07-07T21:43:45.377574+0000","172.21.15.55:6833/1149809384":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/2744432881":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/3786956974":"2023-07-07T21:54:46.685675+0000","172.21.15.55:6832/1149809384":"2023-07-07T21:54:46.685675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":13,"length":1},{"begin":23,"length":1},{"begin":33,"length":1},{"begin":44,"length":1},{"begin":50,"length":1},{"begin":54,"length":1},{"begin":60,"length":1},{"begin":65,"length":1},{"begin":71,"length":2},{"begin":76,"length":1},{"begin":83,"length":1},{"begin":87,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":104,"length":1},{"begin":108,"length":1},{"begin":204,"length":18}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:54:49.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.271+0000 7f2e01540640 1 -- 172.21.15.55:0/4276626204 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f2ddc0663a0 msgr2=0x7f2ddc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:49.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.271+0000 7f2e01540640 1 --2- 172.21.15.55:0/4276626204 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f2ddc0663a0 0x7f2ddc068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0045f0 tx=0x7f2dec008040 comp rx=0 tx=0).stop 2023-07-06T21:54:49.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.271+0000 7f2e01540640 1 -- 172.21.15.55:0/4276626204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc158400 msgr2=0x7f2dfc14f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:49.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.271+0000 7f2e01540640 1 --2- 172.21.15.55:0/4276626204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc158400 0x7f2dfc14f1b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2df4007e30 tx=0x7f2df400e4b0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.271+0000 7f2e01540640 1 -- 172.21.15.55:0/4276626204 shutdown_connections 2023-07-06T21:54:49.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.271+0000 7f2e01540640 1 --2- 172.21.15.55:0/4276626204 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f2ddc0663a0 0x7f2ddc068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.271+0000 7f2e01540640 1 --2- 172.21.15.55:0/4276626204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc158400 0x7f2dfc14f1b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.271+0000 7f2e01540640 1 --2- 172.21.15.55:0/4276626204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dfc0c9680 0x7f2dfc14ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.271+0000 7f2e01540640 1 --2- 172.21.15.55:0/4276626204 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dfc0710c0 0x7f2dfc1f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.271+0000 7f2e01540640 1 -- 172.21.15.55:0/4276626204 >> 172.21.15.55:0/4276626204 conn(0x7f2dfc0cded0 msgr2=0x7f2dfc0af100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:49.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.271+0000 7f2e01540640 1 -- 172.21.15.55:0/4276626204 shutdown_connections 2023-07-06T21:54:49.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.271+0000 7f2e01540640 1 -- 172.21.15.55:0/4276626204 wait complete. 2023-07-06T21:54:49.290 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T21:54:49.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f2dc93640 1 Processor -- start 2023-07-06T21:54:49.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f2dc93640 1 -- start start 2023-07-06T21:54:49.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f2dc93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f28158850 0x7f7f280cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:49.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f2dc93640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7f280ca130 0x7f7f280ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:49.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f2dc93640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f280b2aa0 con 0x7f7f280703e0 2023-07-06T21:54:49.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f2dc93640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f28158c20 con 0x7f7f280ca130 2023-07-06T21:54:49.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f2dc93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280c8db0 con 0x7f7f28158850 2023-07-06T21:54:49.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f277fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f28158850 0x7f7f280cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:49.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f26ffd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7f280ca130 0x7f7f280ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:49.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f27fff640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f7f280703e0 0x7f7f2806eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:37346/0 (socket says 172.21.15.55:37346) 2023-07-06T21:54:49.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f27fff640 1 -- 172.21.15.55:0/466929929 learned_addr learned my addr 172.21.15.55:0/466929929 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:49.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f277fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f28158850 0x7f7f280cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:43670/0 (socket says 172.21.15.55:43670) 2023-07-06T21:54:49.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f267fc640 1 -- 172.21.15.55:0/466929929 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261096956 0 0) 0x7f7f280b2aa0 con 0x7f7f280703e0 2023-07-06T21:54:49.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f277fe640 1 -- 172.21.15.55:0/466929929 >> v2:172.21.15.138:3300/0 conn(0x7f7f280ca130 msgr2=0x7f7f280ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:49.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f277fe640 1 --2- 172.21.15.55:0/466929929 >> v2:172.21.15.138:3300/0 conn(0x7f7f280ca130 0x7f7f280ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f277fe640 1 -- 172.21.15.55:0/466929929 >> v1:172.21.15.138:6789/0 conn(0x7f7f280703e0 legacy=0x7f7f2806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:49.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.435+0000 7f7f277fe640 1 -- 172.21.15.55:0/466929929 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280c9090 con 0x7f7f28158850 2023-07-06T21:54:49.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.439+0000 7f7f277fe640 1 --2- 172.21.15.55:0/466929929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f28158850 0x7f7f280cca30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f180097c0 tx=0x7f7f1801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86fdac75d4965079 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:49.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.439+0000 7f7f267fc640 1 -- 172.21.15.55:0/466929929 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f180a8970 con 0x7f7f28158850 2023-07-06T21:54:49.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.439+0000 7f7f267fc640 1 -- 172.21.15.55:0/466929929 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f180a8ad0 con 0x7f7f28158850 2023-07-06T21:54:49.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.439+0000 7f7f267fc640 1 -- 172.21.15.55:0/466929929 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f180a8e60 con 0x7f7f28158850 2023-07-06T21:54:49.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.439+0000 7f7f2dc93640 1 -- 172.21.15.55:0/466929929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f28158850 msgr2=0x7f7f280cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:49.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.439+0000 7f7f2dc93640 1 --2- 172.21.15.55:0/466929929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f28158850 0x7f7f280cca30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f180097c0 tx=0x7f7f1801ec70 comp rx=0 tx=0).stop 2023-07-06T21:54:49.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.439+0000 7f7f2dc93640 1 -- 172.21.15.55:0/466929929 shutdown_connections 2023-07-06T21:54:49.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.439+0000 7f7f2dc93640 1 --2- 172.21.15.55:0/466929929 >> v2:172.21.15.138:3300/0 conn(0x7f7f280ca130 0x7f7f280ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.439+0000 7f7f2dc93640 1 --2- 172.21.15.55:0/466929929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f28158850 0x7f7f280cca30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.439+0000 7f7f2dc93640 1 -- 172.21.15.55:0/466929929 >> 172.21.15.55:0/466929929 conn(0x7f7f280cea70 msgr2=0x7f7f280ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:49.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.439+0000 7f7f2dc93640 1 -- 172.21.15.55:0/466929929 shutdown_connections 2023-07-06T21:54:49.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.439+0000 7f7f2dc93640 1 -- 172.21.15.55:0/466929929 wait complete. 2023-07-06T21:54:49.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f2dc93640 1 Processor -- start 2023-07-06T21:54:49.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f2dc93640 1 -- start start 2023-07-06T21:54:49.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f2dc93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f280703e0 0x7f7f280c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:49.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f2dc93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f280ca130 0x7f7f280c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:49.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f2dc93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f28158850 0x7f7f280c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:49.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f2dc93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280c2110 con 0x7f7f280ca130 2023-07-06T21:54:49.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f2dc93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2809e290 con 0x7f7f28158850 2023-07-06T21:54:49.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f2dc93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2809dfb0 con 0x7f7f280703e0 2023-07-06T21:54:49.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f26ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f280ca130 0x7f7f280c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:49.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f26ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f280ca130 0x7f7f280c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33136/0 (socket says 172.21.15.55:33136) 2023-07-06T21:54:49.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f26ffd640 1 -- 172.21.15.55:0/1431345910 learned_addr learned my addr 172.21.15.55:0/1431345910 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:49.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f277fe640 1 --2- 172.21.15.55:0/1431345910 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f280703e0 0x7f7f280c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:49.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f27fff640 1 --2- 172.21.15.55:0/1431345910 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f28158850 0x7f7f280c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:49.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f26ffd640 1 -- 172.21.15.55:0/1431345910 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f280703e0 msgr2=0x7f7f280c1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:49.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f26ffd640 1 --2- 172.21.15.55:0/1431345910 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f280703e0 0x7f7f280c1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f26ffd640 1 -- 172.21.15.55:0/1431345910 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f28158850 msgr2=0x7f7f280c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:49.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f26ffd640 1 --2- 172.21.15.55:0/1431345910 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f28158850 0x7f7f280c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:49.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f26ffd640 1 -- 172.21.15.55:0/1431345910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f18009420 con 0x7f7f280ca130 2023-07-06T21:54:49.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.443+0000 7f7f26ffd640 1 --2- 172.21.15.55:0/1431345910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f280ca130 0x7f7f280c3350 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00e930 tx=0x7f7f1c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:49.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.447+0000 7f7f0ffff640 1 -- 172.21.15.55:0/1431345910 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c009690 con 0x7f7f280ca130 2023-07-06T21:54:49.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.447+0000 7f7f0ffff640 1 -- 172.21.15.55:0/1431345910 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c00ca00 con 0x7f7f280ca130 2023-07-06T21:54:49.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.447+0000 7f7f0ffff640 1 -- 172.21.15.55:0/1431345910 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c00cd70 con 0x7f7f280ca130 2023-07-06T21:54:49.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.447+0000 7f7f2dc93640 1 -- 172.21.15.55:0/1431345910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f280ad8e0 con 0x7f7f280ca130 2023-07-06T21:54:49.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.447+0000 7f7f2dc93640 1 -- 172.21.15.55:0/1431345910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f280adea0 con 0x7f7f280ca130 2023-07-06T21:54:49.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.447+0000 7f7f2dc93640 1 -- 172.21.15.55:0/1431345910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f28066d60 con 0x7f7f280ca130 2023-07-06T21:54:49.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.447+0000 7f7f0ffff640 1 -- 172.21.15.55:0/1431345910 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7f1c013470 con 0x7f7f280ca130 2023-07-06T21:54:49.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.447+0000 7f7f0ffff640 1 --2- 172.21.15.55:0/1431345910 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f7f140663d0 0x7f7f14068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:49.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.447+0000 7f7f0ffff640 1 -- 172.21.15.55:0/1431345910 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7385+0+0 (secure 0 0 0) 0x7f7f1c0845a0 con 0x7f7f280ca130 2023-07-06T21:54:49.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.447+0000 7f7f277fe640 1 --2- 172.21.15.55:0/1431345910 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f7f140663d0 0x7f7f14068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:49.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.447+0000 7f7f277fe640 1 --2- 172.21.15.55:0/1431345910 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f7f140663d0 0x7f7f14068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7f180b2000 tx=0x7f7f180aa070 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:49.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.451+0000 7f7f0ffff640 1 -- 172.21.15.55:0/1431345910 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f1c0514a0 con 0x7f7f280ca130 2023-07-06T21:54:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:49.643+0000 7f7f2dc93640 1 -- 172.21.15.55:0/1431345910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7f2806cd30 con 0x7f7f280ca130 2023-07-06T21:54:50.586 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-07-06T21:54:50.587+0000 7f5b6d80c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T21:54:50.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.591+0000 7f7f0ffff640 1 -- 172.21.15.55:0/1431345910 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7f1c054ac0 con 0x7f7f280ca130 2023-07-06T21:54:50.592 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T21:54:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.595+0000 7f7f2dc93640 1 -- 172.21.15.55:0/1431345910 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f7f140663d0 msgr2=0x7f7f14068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.595+0000 7f7f2dc93640 1 --2- 172.21.15.55:0/1431345910 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f7f140663d0 0x7f7f14068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7f180b2000 tx=0x7f7f180aa070 comp rx=0 tx=0).stop 2023-07-06T21:54:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.595+0000 7f7f2dc93640 1 -- 172.21.15.55:0/1431345910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f280ca130 msgr2=0x7f7f280c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.595+0000 7f7f2dc93640 1 --2- 172.21.15.55:0/1431345910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f280ca130 0x7f7f280c3350 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00e930 tx=0x7f7f1c00edf0 comp rx=0 tx=0).stop 2023-07-06T21:54:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.595+0000 7f7f2dc93640 1 -- 172.21.15.55:0/1431345910 shutdown_connections 2023-07-06T21:54:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.595+0000 7f7f2dc93640 1 --2- 172.21.15.55:0/1431345910 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f28158850 0x7f7f280c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.595+0000 7f7f2dc93640 1 --2- 172.21.15.55:0/1431345910 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f7f140663d0 0x7f7f14068880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.595+0000 7f7f2dc93640 1 --2- 172.21.15.55:0/1431345910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f280ca130 0x7f7f280c3350 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.595+0000 7f7f2dc93640 1 --2- 172.21.15.55:0/1431345910 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f280703e0 0x7f7f280c1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.595+0000 7f7f2dc93640 1 -- 172.21.15.55:0/1431345910 >> 172.21.15.55:0/1431345910 conn(0x7f7f280cea70 msgr2=0x7f7f281510e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.595+0000 7f7f2dc93640 1 -- 172.21.15.55:0/1431345910 shutdown_connections 2023-07-06T21:54:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.595+0000 7f7f2dc93640 1 -- 172.21.15.55:0/1431345910 wait complete. 2023-07-06T21:54:50.623 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T21:54:50.667 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-07-06T21:54:50.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.771+0000 7f6a0da0b640 1 Processor -- start 2023-07-06T21:54:50.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.771+0000 7f6a0da0b640 1 -- start start 2023-07-06T21:54:50.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.775+0000 7f6a0da0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a080ca130 0x7f6a080703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:50.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.775+0000 7f6a0da0b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a080cd140 0x7f6a08070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:50.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.775+0000 7f6a0da0b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a08158c20 con 0x7f6a08158850 2023-07-06T21:54:50.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.775+0000 7f6a0da0b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a080b2aa0 con 0x7f6a080cd140 2023-07-06T21:54:50.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.775+0000 7f6a0da0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c8db0 con 0x7f6a080ca130 2023-07-06T21:54:50.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.775+0000 7f6a077fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a080cd140 0x7f6a08070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:50.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.775+0000 7f6a077fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a080cd140 0x7f6a08070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33166/0 (socket says 172.21.15.55:33166) 2023-07-06T21:54:50.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.775+0000 7f6a077fe640 1 -- 172.21.15.55:0/3156212055 learned_addr learned my addr 172.21.15.55:0/3156212055 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:50.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.775+0000 7f69fffff640 1 --2- 172.21.15.55:0/3156212055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a080ca130 0x7f6a080703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:50.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.775+0000 7f6a077fe640 1 -- 172.21.15.55:0/3156212055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a080ca130 msgr2=0x7f6a080703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:50.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.775+0000 7f6a077fe640 1 --2- 172.21.15.55:0/3156212055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a080ca130 0x7f6a080703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:50.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.775+0000 7f6a077fe640 1 -- 172.21.15.55:0/3156212055 >> v1:172.21.15.138:6789/0 conn(0x7f6a08158850 legacy=0x7f6a080cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:50.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.775+0000 7f6a077fe640 1 -- 172.21.15.55:0/3156212055 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080c9090 con 0x7f6a080cd140 2023-07-06T21:54:50.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.779+0000 7f6a077fe640 1 --2- 172.21.15.55:0/3156212055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cd140 0x7f6a08070920 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009e50 tx=0x7f6a0001caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4514d9e2a387306e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:50.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.779+0000 7f6a067fc640 1 -- 172.21.15.55:0/3156212055 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000a66c0 con 0x7f6a080cd140 2023-07-06T21:54:50.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.779+0000 7f6a067fc640 1 -- 172.21.15.55:0/3156212055 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a000a6820 con 0x7f6a080cd140 2023-07-06T21:54:50.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.779+0000 7f6a067fc640 1 -- 172.21.15.55:0/3156212055 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000a6bb0 con 0x7f6a080cd140 2023-07-06T21:54:50.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.779+0000 7f6a0da0b640 1 -- 172.21.15.55:0/3156212055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cd140 msgr2=0x7f6a08070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:50.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.779+0000 7f6a0da0b640 1 --2- 172.21.15.55:0/3156212055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cd140 0x7f6a08070920 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009e50 tx=0x7f6a0001caa0 comp rx=0 tx=0).stop 2023-07-06T21:54:50.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.779+0000 7f6a0da0b640 1 -- 172.21.15.55:0/3156212055 shutdown_connections 2023-07-06T21:54:50.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.779+0000 7f6a0da0b640 1 --2- 172.21.15.55:0/3156212055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cd140 0x7f6a08070920 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:50.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.779+0000 7f6a0da0b640 1 --2- 172.21.15.55:0/3156212055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a080ca130 0x7f6a080703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:50.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.779+0000 7f6a0da0b640 1 -- 172.21.15.55:0/3156212055 >> 172.21.15.55:0/3156212055 conn(0x7f6a080cea70 msgr2=0x7f6a080ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:50.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.779+0000 7f6a0da0b640 1 -- 172.21.15.55:0/3156212055 shutdown_connections 2023-07-06T21:54:50.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.779+0000 7f6a0da0b640 1 -- 172.21.15.55:0/3156212055 wait complete. 2023-07-06T21:54:50.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.779+0000 7f6a0da0b640 1 Processor -- start 2023-07-06T21:54:50.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.779+0000 7f6a0da0b640 1 -- start start 2023-07-06T21:54:50.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a0da0b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a080ca130 0x7f6a080ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:50.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a0da0b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cd140 0x7f6a081f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:50.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a0da0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a08158850 0x7f6a0814fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:50.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a0da0b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c5430 con 0x7f6a080cd140 2023-07-06T21:54:50.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a0da0b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c7ce0 con 0x7f6a080ca130 2023-07-06T21:54:50.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a0da0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080acd50 con 0x7f6a08158850 2023-07-06T21:54:50.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f69fffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cd140 0x7f6a081f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f69fffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cd140 0x7f6a081f6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33170/0 (socket says 172.21.15.55:33170) 2023-07-06T21:54:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f69fffff640 1 -- 172.21.15.55:0/955384730 learned_addr learned my addr 172.21.15.55:0/955384730 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a077fe640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a08158850 0x7f6a0814fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a06ffd640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a080ca130 0x7f6a080ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f69fffff640 1 -- 172.21.15.55:0/955384730 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a08158850 msgr2=0x7f6a0814fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f69fffff640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a08158850 0x7f6a0814fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f69fffff640 1 -- 172.21.15.55:0/955384730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a080ca130 msgr2=0x7f6a080ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:50.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f69fffff640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a080ca130 0x7f6a080ac810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:50.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f69fffff640 1 -- 172.21.15.55:0/955384730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a00009b30 con 0x7f6a080cd140 2023-07-06T21:54:50.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a077fe640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a08158850 0x7f6a0814fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f69fffff640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cd140 0x7f6a081f6b00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f69f000d9f0 tx=0x7f69f000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a04ff9640 1 -- 172.21.15.55:0/955384730 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0007bd0 con 0x7f6a080cd140 2023-07-06T21:54:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a04ff9640 1 -- 172.21.15.55:0/955384730 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f0007d30 con 0x7f6a080cd140 2023-07-06T21:54:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a04ff9640 1 -- 172.21.15.55:0/955384730 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0007ea0 con 0x7f6a080cd140 2023-07-06T21:54:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a0da0b640 1 -- 172.21.15.55:0/955384730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a080c4e20 con 0x7f6a080cd140 2023-07-06T21:54:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a0da0b640 1 -- 172.21.15.55:0/955384730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a081f7580 con 0x7f6a080cd140 2023-07-06T21:54:50.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a0da0b640 1 -- 172.21.15.55:0/955384730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a080c56a0 con 0x7f6a080cd140 2023-07-06T21:54:50.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.783+0000 7f6a04ff9640 1 -- 172.21.15.55:0/955384730 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f69f0010670 con 0x7f6a080cd140 2023-07-06T21:54:50.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.787+0000 7f6a04ff9640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f69e80663a0 0x7f69e8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:50.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.787+0000 7f6a04ff9640 1 -- 172.21.15.55:0/955384730 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7171+0+0 (secure 0 0 0) 0x7f69f00848c0 con 0x7f6a080cd140 2023-07-06T21:54:50.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.787+0000 7f6a06ffd640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f69e80663a0 0x7f69e8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:50.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.787+0000 7f6a06ffd640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f69e80663a0 0x7f69e8068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f69f8000f70 tx=0x7f69f8009040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.791+0000 7f6a04ff9640 1 -- 172.21.15.55:0/955384730 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69f0051620 con 0x7f6a080cd140 2023-07-06T21:54:50.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:50.979+0000 7f6a0da0b640 1 -- 172.21.15.55:0/955384730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6a08163180 con 0x7f6a080cd140 2023-07-06T21:54:51.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.599+0000 7f6a04ff9640 1 -- 172.21.15.55:0/955384730 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f69f0054c40 con 0x7f6a080cd140 2023-07-06T21:54:51.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.603+0000 7f6a0da0b640 1 -- 172.21.15.55:0/955384730 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f69e80663a0 msgr2=0x7f69e8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:51.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.603+0000 7f6a0da0b640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f69e80663a0 0x7f69e8068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f69f8000f70 tx=0x7f69f8009040 comp rx=0 tx=0).stop 2023-07-06T21:54:51.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.603+0000 7f6a0da0b640 1 -- 172.21.15.55:0/955384730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cd140 msgr2=0x7f6a081f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:51.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.603+0000 7f6a0da0b640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cd140 0x7f6a081f6b00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f69f000d9f0 tx=0x7f69f000ddf0 comp rx=0 tx=0).stop 2023-07-06T21:54:51.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.603+0000 7f6a0da0b640 1 -- 172.21.15.55:0/955384730 shutdown_connections 2023-07-06T21:54:51.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.603+0000 7f6a0da0b640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a08158850 0x7f6a0814fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:51.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.603+0000 7f6a0da0b640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f69e80663a0 0x7f69e8068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:51.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.603+0000 7f6a0da0b640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cd140 0x7f6a081f6b00 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:51.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.603+0000 7f6a0da0b640 1 --2- 172.21.15.55:0/955384730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a080ca130 0x7f6a080ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:51.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.603+0000 7f6a0da0b640 1 -- 172.21.15.55:0/955384730 >> 172.21.15.55:0/955384730 conn(0x7f6a080cea70 msgr2=0x7f6a080cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:51.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.603+0000 7f6a0da0b640 1 -- 172.21.15.55:0/955384730 shutdown_connections 2023-07-06T21:54:51.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.603+0000 7f6a0da0b640 1 -- 172.21.15.55:0/955384730 wait complete. 2023-07-06T21:54:51.625 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T21:54:51.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.823+0000 7fb040d74640 1 Processor -- start 2023-07-06T21:54:51.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.827+0000 7fb040d74640 1 -- start start 2023-07-06T21:54:51.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.827+0000 7fb040d74640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb03c06a460 0x7fb03c0caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:51.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.827+0000 7fb040d74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb03c06f960 0x7fb03c06fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.827+0000 7fb040d74640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03c070300 con 0x7fb03c06cb40 2023-07-06T21:54:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.827+0000 7fb040d74640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03c06bac0 con 0x7fb03c06a460 2023-07-06T21:54:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.827+0000 7fb040d74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c069b00 con 0x7fb03c06f960 2023-07-06T21:54:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.827+0000 7fb03a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb03c06a460 0x7fb03c0caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.827+0000 7fb03a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb03c06a460 0x7fb03c0caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33174/0 (socket says 172.21.15.55:33174) 2023-07-06T21:54:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.827+0000 7fb03a59c640 1 -- 172.21.15.55:0/1470306510 learned_addr learned my addr 172.21.15.55:0/1470306510 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:51.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.827+0000 7fb03ad9d640 1 --2- 172.21.15.55:0/1470306510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb03c06f960 0x7fb03c06fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:51.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.827+0000 7fb03a59c640 1 -- 172.21.15.55:0/1470306510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb03c06f960 msgr2=0x7fb03c06fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:51.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.827+0000 7fb03a59c640 1 --2- 172.21.15.55:0/1470306510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb03c06f960 0x7fb03c06fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:51.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.827+0000 7fb03a59c640 1 -- 172.21.15.55:0/1470306510 >> v1:172.21.15.138:6789/0 conn(0x7fb03c06cb40 legacy=0x7fb03c0693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:51.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.827+0000 7fb03a59c640 1 -- 172.21.15.55:0/1470306510 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c0cc650 con 0x7fb03c06a460 2023-07-06T21:54:51.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.831+0000 7fb03a59c640 1 --2- 172.21.15.55:0/1470306510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03c06a460 0x7fb03c0caa80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb02c006fd0 tx=0x7fb02c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7c8bc31785e04c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:51.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.831+0000 7fb039d9b640 1 -- 172.21.15.55:0/1470306510 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c0ab600 con 0x7fb03c06a460 2023-07-06T21:54:51.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.831+0000 7fb039d9b640 1 -- 172.21.15.55:0/1470306510 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c0a7050 con 0x7fb03c06a460 2023-07-06T21:54:51.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.831+0000 7fb039d9b640 1 -- 172.21.15.55:0/1470306510 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c0ab980 con 0x7fb03c06a460 2023-07-06T21:54:51.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.831+0000 7fb040d74640 1 -- 172.21.15.55:0/1470306510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03c06a460 msgr2=0x7fb03c0caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:51.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.831+0000 7fb040d74640 1 --2- 172.21.15.55:0/1470306510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03c06a460 0x7fb03c0caa80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb02c006fd0 tx=0x7fb02c01c450 comp rx=0 tx=0).stop 2023-07-06T21:54:51.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.831+0000 7fb040d74640 1 -- 172.21.15.55:0/1470306510 shutdown_connections 2023-07-06T21:54:51.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.831+0000 7fb040d74640 1 --2- 172.21.15.55:0/1470306510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb03c06f960 0x7fb03c06fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:51.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.831+0000 7fb040d74640 1 --2- 172.21.15.55:0/1470306510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03c06a460 0x7fb03c0caa80 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:51.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.831+0000 7fb040d74640 1 -- 172.21.15.55:0/1470306510 >> 172.21.15.55:0/1470306510 conn(0x7fb03c0ce7f0 msgr2=0x7fb03c0cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:51.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.831+0000 7fb040d74640 1 -- 172.21.15.55:0/1470306510 shutdown_connections 2023-07-06T21:54:51.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.831+0000 7fb040d74640 1 -- 172.21.15.55:0/1470306510 wait complete. 2023-07-06T21:54:51.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.831+0000 7fb040d74640 1 Processor -- start 2023-07-06T21:54:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.831+0000 7fb040d74640 1 -- start start 2023-07-06T21:54:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb040d74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb03c06a460 0x7fb03c153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb040d74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03c06cb40 0x7fb03c14f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb040d74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb03c06f960 0x7fb03c0b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb040d74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c1537d0 con 0x7fb03c06cb40 2023-07-06T21:54:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb040d74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c14fc60 con 0x7fb03c06f960 2023-07-06T21:54:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb040d74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0b3aa0 con 0x7fb03c06a460 2023-07-06T21:54:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb033fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03c06cb40 0x7fb03c14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:51.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb033fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03c06cb40 0x7fb03c14f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33188/0 (socket says 172.21.15.55:33188) 2023-07-06T21:54:51.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb033fff640 1 -- 172.21.15.55:0/1509239056 learned_addr learned my addr 172.21.15.55:0/1509239056 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb03ad9d640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb03c06f960 0x7fb03c0b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb03a59c640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb03c06a460 0x7fb03c153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb033fff640 1 -- 172.21.15.55:0/1509239056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb03c06a460 msgr2=0x7fb03c153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb033fff640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb03c06a460 0x7fb03c153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb033fff640 1 -- 172.21.15.55:0/1509239056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb03c06f960 msgr2=0x7fb03c0b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb033fff640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb03c06f960 0x7fb03c0b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb033fff640 1 -- 172.21.15.55:0/1509239056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c009480 con 0x7fb03c06cb40 2023-07-06T21:54:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb03a59c640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb03c06a460 0x7fb03c153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:54:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb03ad9d640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb03c06f960 0x7fb03c0b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:54:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb033fff640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03c06cb40 0x7fb03c14f720 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb02400c490 tx=0x7fb024001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb032ffd640 1 -- 172.21.15.55:0/1509239056 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024003600 con 0x7fb03c06cb40 2023-07-06T21:54:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb032ffd640 1 -- 172.21.15.55:0/1509239056 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb024003780 con 0x7fb03c06cb40 2023-07-06T21:54:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb040d74640 1 -- 172.21.15.55:0/1509239056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03c0b3d80 con 0x7fb03c06cb40 2023-07-06T21:54:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb032ffd640 1 -- 172.21.15.55:0/1509239056 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024003b70 con 0x7fb03c06cb40 2023-07-06T21:54:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb040d74640 1 -- 172.21.15.55:0/1509239056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c0b4340 con 0x7fb03c06cb40 2023-07-06T21:54:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.835+0000 7fb040d74640 1 -- 172.21.15.55:0/1509239056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c0b4560 con 0x7fb03c06cb40 2023-07-06T21:54:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.839+0000 7fb032ffd640 1 -- 172.21.15.55:0/1509239056 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb024003cd0 con 0x7fb03c06cb40 2023-07-06T21:54:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.839+0000 7fb032ffd640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fb01c0663a0 0x7fb01c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.839+0000 7fb032ffd640 1 -- 172.21.15.55:0/1509239056 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7171+0+0 (secure 0 0 0) 0x7fb0240839e0 con 0x7fb03c06cb40 2023-07-06T21:54:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.839+0000 7fb03a59c640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fb01c0663a0 0x7fb01c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.839+0000 7fb03a59c640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fb01c0663a0 0x7fb01c068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0ad000 tx=0x7fb02c0a4f90 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:51.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.843+0000 7fb032ffd640 1 -- 172.21.15.55:0/1509239056 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb024050850 con 0x7fb03c06cb40 2023-07-06T21:54:51.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:51.999+0000 7fb040d74640 1 -- 172.21.15.55:0/1509239056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb03c1515d0 con 0x7fb03c06cb40 2023-07-06T21:54:52.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.723+0000 7fb032ffd640 1 -- 172.21.15.55:0/1509239056 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb0240170d0 con 0x7fb03c06cb40 2023-07-06T21:54:52.723 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-07-06T21:54:52.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.727+0000 7fb040d74640 1 -- 172.21.15.55:0/1509239056 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fb01c0663a0 msgr2=0x7fb01c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:52.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.727+0000 7fb040d74640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fb01c0663a0 0x7fb01c068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0ad000 tx=0x7fb02c0a4f90 comp rx=0 tx=0).stop 2023-07-06T21:54:52.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.727+0000 7fb040d74640 1 -- 172.21.15.55:0/1509239056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03c06cb40 msgr2=0x7fb03c14f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:52.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.727+0000 7fb040d74640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03c06cb40 0x7fb03c14f720 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb02400c490 tx=0x7fb024001e80 comp rx=0 tx=0).stop 2023-07-06T21:54:52.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.727+0000 7fb040d74640 1 -- 172.21.15.55:0/1509239056 shutdown_connections 2023-07-06T21:54:52.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.727+0000 7fb040d74640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb03c06f960 0x7fb03c0b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:52.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.727+0000 7fb040d74640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fb01c0663a0 0x7fb01c068850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:52.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.727+0000 7fb040d74640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03c06cb40 0x7fb03c14f720 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:52.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.727+0000 7fb040d74640 1 --2- 172.21.15.55:0/1509239056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb03c06a460 0x7fb03c153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:52.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.727+0000 7fb040d74640 1 -- 172.21.15.55:0/1509239056 >> 172.21.15.55:0/1509239056 conn(0x7fb03c0ce7f0 msgr2=0x7fb03c1586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:52.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.727+0000 7fb040d74640 1 -- 172.21.15.55:0/1509239056 shutdown_connections 2023-07-06T21:54:52.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.727+0000 7fb040d74640 1 -- 172.21.15.55:0/1509239056 wait complete. 2023-07-06T21:54:52.750 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T21:54:52.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f8116374640 1 Processor -- start 2023-07-06T21:54:52.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f8116374640 1 -- start start 2023-07-06T21:54:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f8116374640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81100cd0f0 0x7f811015fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f8116374640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81100b5880 con 0x7f811015b930 2023-07-06T21:54:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f8116374640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81100cdcb0 con 0x7f81100cc2e0 2023-07-06T21:54:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f8116374640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81100b5b60 con 0x7f81100cd0f0 2023-07-06T21:54:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f811015b930 0x7f81100cc9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44138/0 (socket says 172.21.15.55:44138) 2023-07-06T21:54:52.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810ffff640 1 -- 172.21.15.55:0/2982075696 learned_addr learned my addr 172.21.15.55:0/2982075696 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:52.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f8114911640 1 --2- 172.21.15.55:0/2982075696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81100cd0f0 0x7f811015fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:52.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684222669 0 0) 0x7f81100b5880 con 0x7f811015b930 2023-07-06T21:54:52.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80f8003530 con 0x7f811015b930 2023-07-06T21:54:52.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042810445 0 0) 0x7f81100cdcb0 con 0x7f81100cc2e0 2023-07-06T21:54:52.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81100b5880 con 0x7f81100cc2e0 2023-07-06T21:54:52.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2532047535 0 0) 0x7f80f8003530 con 0x7f811015b930 2023-07-06T21:54:52.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81100cd0f0 msgr2=0x7f811015fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:52.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 --2- 172.21.15.55:0/2982075696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81100cd0f0 0x7f811015fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:52.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 >> v1:172.21.15.138:6789/0 conn(0x7f81100cc2e0 legacy=0x7f811015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81100cdf90 con 0x7f811015b930 2023-07-06T21:54:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f8100001680 con 0x7f811015b930 2023-07-06T21:54:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 >> v1:172.21.15.55:6789/0 conn(0x7f811015b930 legacy=0x7f81100cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 --2- 172.21.15.55:0/2982075696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81100cd0f0 0x7f80f8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 --2- 172.21.15.55:0/2982075696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80f80040a0 0x7f80f80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 --2- 172.21.15.55:0/2982075696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80f8004d10 0x7f80f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100b5b60 con 0x7f80f8004d10 2023-07-06T21:54:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f800ba40 con 0x7f80f80040a0 2023-07-06T21:54:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f800bc00 con 0x7f81100cd0f0 2023-07-06T21:54:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f8114911640 1 --2- 172.21.15.55:0/2982075696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80f8004d10 0x7f80f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810ffff640 1 --2- 172.21.15.55:0/2982075696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81100cd0f0 0x7f80f8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f810f7fe640 1 --2- 172.21.15.55:0/2982075696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80f80040a0 0x7f80f80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f8114911640 1 -- 172.21.15.55:0/2982075696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81100cd0f0 msgr2=0x7f80f8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f8114911640 1 --2- 172.21.15.55:0/2982075696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81100cd0f0 0x7f80f8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f8114911640 1 -- 172.21.15.55:0/2982075696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80f80040a0 msgr2=0x7f80f80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f8114911640 1 --2- 172.21.15.55:0/2982075696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80f80040a0 0x7f80f80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.903+0000 7f8114911640 1 -- 172.21.15.55:0/2982075696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f8003530 con 0x7f80f8004d10 2023-07-06T21:54:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.907+0000 7f8114911640 1 --2- 172.21.15.55:0/2982075696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80f8004d10 0x7f80f8005180 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8108009f90 tx=0x7f810801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7153e20faeef0378 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.907+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100007ea0 con 0x7f80f8004d10 2023-07-06T21:54:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.907+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810800f040 con 0x7f80f8004d10 2023-07-06T21:54:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.907+0000 7f810effd640 1 -- 172.21.15.55:0/2982075696 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080a5d60 con 0x7f80f8004d10 2023-07-06T21:54:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.907+0000 7f8116374640 1 -- 172.21.15.55:0/2982075696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80f8004d10 msgr2=0x7f80f8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.907+0000 7f8116374640 1 --2- 172.21.15.55:0/2982075696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80f8004d10 0x7f80f8005180 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8108009f90 tx=0x7f810801cc20 comp rx=0 tx=0).stop 2023-07-06T21:54:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.907+0000 7f8114911640 1 -- 172.21.15.55:0/2982075696 reap_dead start 2023-07-06T21:54:52.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.907+0000 7f8116374640 1 -- 172.21.15.55:0/2982075696 shutdown_connections 2023-07-06T21:54:52.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.907+0000 7f8116374640 1 -- 172.21.15.55:0/2982075696 >> 172.21.15.55:0/2982075696 conn(0x7f81100d0c60 msgr2=0x7f81100b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:52.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.907+0000 7f8116374640 1 -- 172.21.15.55:0/2982075696 shutdown_connections 2023-07-06T21:54:52.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.907+0000 7f8116374640 1 -- 172.21.15.55:0/2982075696 wait complete. 2023-07-06T21:54:52.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8116374640 1 Processor -- start 2023-07-06T21:54:52.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8116374640 1 -- start start 2023-07-06T21:54:52.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8116374640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80f8004d10 0x7f81100c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:52.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8116374640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f811015be80 0x7f811015d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:52.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8116374640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81101524f0 0x7f81100c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:52.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8116374640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811015c2f0 con 0x7f81101524f0 2023-07-06T21:54:52.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8116374640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811015ede0 con 0x7f811015be80 2023-07-06T21:54:52.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8116374640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811015c4f0 con 0x7f80f8004d10 2023-07-06T21:54:52.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8114911640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81101524f0 0x7f81100c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:52.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8114911640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81101524f0 0x7f81100c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33202/0 (socket says 172.21.15.55:33202) 2023-07-06T21:54:52.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8114911640 1 -- 172.21.15.55:0/136658713 learned_addr learned my addr 172.21.15.55:0/136658713 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:52.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f810f7fe640 1 --2- 172.21.15.55:0/136658713 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f811015be80 0x7f811015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:52.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f810ffff640 1 --2- 172.21.15.55:0/136658713 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80f8004d10 0x7f81100c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:52.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8114911640 1 -- 172.21.15.55:0/136658713 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80f8004d10 msgr2=0x7f81100c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8114911640 1 --2- 172.21.15.55:0/136658713 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80f8004d10 0x7f81100c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8114911640 1 -- 172.21.15.55:0/136658713 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f811015be80 msgr2=0x7f811015d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8114911640 1 --2- 172.21.15.55:0/136658713 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f811015be80 0x7f811015d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8114911640 1 -- 172.21.15.55:0/136658713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811015c7d0 con 0x7f81101524f0 2023-07-06T21:54:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8114911640 1 --2- 172.21.15.55:0/136658713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81101524f0 0x7f81100c8b70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f81080b0040 tx=0x7f8108009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f810cff9640 1 -- 172.21.15.55:0/136658713 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080039a0 con 0x7f81101524f0 2023-07-06T21:54:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f810cff9640 1 -- 172.21.15.55:0/136658713 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8108003b00 con 0x7f81101524f0 2023-07-06T21:54:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f810cff9640 1 -- 172.21.15.55:0/136658713 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080ad650 con 0x7f81101524f0 2023-07-06T21:54:52.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.911+0000 7f8116374640 1 -- 172.21.15.55:0/136658713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811015cab0 con 0x7f81101524f0 2023-07-06T21:54:52.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.915+0000 7f8116374640 1 -- 172.21.15.55:0/136658713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811015d070 con 0x7f81101524f0 2023-07-06T21:54:52.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.915+0000 7f8116374640 1 -- 172.21.15.55:0/136658713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811015d260 con 0x7f81101524f0 2023-07-06T21:54:52.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.915+0000 7f810cff9640 1 -- 172.21.15.55:0/136658713 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f81080b4040 con 0x7f81101524f0 2023-07-06T21:54:52.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.915+0000 7f810cff9640 1 --2- 172.21.15.55:0/136658713 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f80fc0663d0 0x7f80fc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:52.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.915+0000 7f810cff9640 1 -- 172.21.15.55:0/136658713 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f810811da60 con 0x7f81101524f0 2023-07-06T21:54:52.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.915+0000 7f810ffff640 1 --2- 172.21.15.55:0/136658713 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f80fc0663d0 0x7f80fc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:52.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.915+0000 7f810ffff640 1 --2- 172.21.15.55:0/136658713 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f80fc0663d0 0x7f80fc068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8100000c10 tx=0x7f8100001e30 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:52.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:52.919+0000 7f810cff9640 1 -- 172.21.15.55:0/136658713 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81080eab50 con 0x7f81101524f0 2023-07-06T21:54:53.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.079+0000 7f8116374640 1 -- 172.21.15.55:0/136658713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8110066d60 con 0x7f81101524f0 2023-07-06T21:54:53.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.727+0000 7f810cff9640 1 -- 172.21.15.55:0/136658713 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) v1 ==== 169+0+0 (secure 0 0 0) 0x7f81080b20d0 con 0x7f81101524f0 2023-07-06T21:54:53.728 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-07-06T21:54:53.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.731+0000 7f8116374640 1 -- 172.21.15.55:0/136658713 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f80fc0663d0 msgr2=0x7f80fc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:53.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.731+0000 7f8116374640 1 --2- 172.21.15.55:0/136658713 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f80fc0663d0 0x7f80fc068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8100000c10 tx=0x7f8100001e30 comp rx=0 tx=0).stop 2023-07-06T21:54:53.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.731+0000 7f8116374640 1 -- 172.21.15.55:0/136658713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81101524f0 msgr2=0x7f81100c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:53.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.731+0000 7f8116374640 1 --2- 172.21.15.55:0/136658713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81101524f0 0x7f81100c8b70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f81080b0040 tx=0x7f8108009750 comp rx=0 tx=0).stop 2023-07-06T21:54:53.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.731+0000 7f8116374640 1 -- 172.21.15.55:0/136658713 shutdown_connections 2023-07-06T21:54:53.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.731+0000 7f8116374640 1 --2- 172.21.15.55:0/136658713 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f80fc0663d0 0x7f80fc068880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:53.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.731+0000 7f8116374640 1 --2- 172.21.15.55:0/136658713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81101524f0 0x7f81100c8b70 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:53.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.731+0000 7f8116374640 1 --2- 172.21.15.55:0/136658713 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f811015be80 0x7f811015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:53.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.731+0000 7f8116374640 1 --2- 172.21.15.55:0/136658713 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80f8004d10 0x7f81100c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:53.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.731+0000 7f8116374640 1 -- 172.21.15.55:0/136658713 >> 172.21.15.55:0/136658713 conn(0x7f81100d0c60 msgr2=0x7f8110159e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:53.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.731+0000 7f8116374640 1 -- 172.21.15.55:0/136658713 shutdown_connections 2023-07-06T21:54:53.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.731+0000 7f8116374640 1 -- 172.21.15.55:0/136658713 wait complete. 2023-07-06T21:54:53.762 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-06T21:54:53.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6ff82640 1 Processor -- start 2023-07-06T21:54:53.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6ff82640 1 -- start start 2023-07-06T21:54:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6ff82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68070d70 0x7f0b680b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6ff82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b680b1170 0x7f0b6806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6ff82640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b680cc030 con 0x7f0b680709a0 2023-07-06T21:54:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6ff82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b680b15f0 con 0x7f0b680b1170 2023-07-06T21:54:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6ff82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680cc300 con 0x7f0b68070d70 2023-07-06T21:54:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6e51f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b680b1170 0x7f0b6806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6dd1e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0b680709a0 0x7f0b680cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35732/0 (socket says 172.21.15.55:35732) 2023-07-06T21:54:53.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6dd1e640 1 -- 172.21.15.55:0/2911823414 learned_addr learned my addr 172.21.15.55:0/2911823414 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:53.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6d51d640 1 --2- 172.21.15.55:0/2911823414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68070d70 0x7f0b680b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:53.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6e51f640 1 -- 172.21.15.55:0/2911823414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68070d70 msgr2=0x7f0b680b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6e51f640 1 --2- 172.21.15.55:0/2911823414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68070d70 0x7f0b680b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6e51f640 1 -- 172.21.15.55:0/2911823414 >> v1:172.21.15.55:6789/0 conn(0x7f0b680709a0 legacy=0x7f0b680cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6e51f640 1 -- 172.21.15.55:0/2911823414 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b680cc5e0 con 0x7f0b680b1170 2023-07-06T21:54:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.923+0000 7f0b6cd1c640 1 -- 172.21.15.55:0/2911823414 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046656440 0 0) 0x7f0b680cc030 con 0x7f0b680709a0 2023-07-06T21:54:53.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.927+0000 7f0b6e51f640 1 --2- 172.21.15.55:0/2911823414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680b1170 0x7f0b6806eee0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009dc0 tx=0x7f0b6001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdddb8c3d7bc50c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:53.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.927+0000 7f0b6cd1c640 1 -- 172.21.15.55:0/2911823414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b600a5850 con 0x7f0b680b1170 2023-07-06T21:54:53.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.927+0000 7f0b6cd1c640 1 -- 172.21.15.55:0/2911823414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b600a59b0 con 0x7f0b680b1170 2023-07-06T21:54:53.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.927+0000 7f0b6cd1c640 1 -- 172.21.15.55:0/2911823414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b600a5d40 con 0x7f0b680b1170 2023-07-06T21:54:53.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.927+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2911823414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680b1170 msgr2=0x7f0b6806eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:53.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.927+0000 7f0b6ff82640 1 --2- 172.21.15.55:0/2911823414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680b1170 0x7f0b6806eee0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009dc0 tx=0x7f0b6001c8a0 comp rx=0 tx=0).stop 2023-07-06T21:54:53.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.927+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2911823414 shutdown_connections 2023-07-06T21:54:53.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.927+0000 7f0b6ff82640 1 --2- 172.21.15.55:0/2911823414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68070d70 0x7f0b680b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:53.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.927+0000 7f0b6ff82640 1 --2- 172.21.15.55:0/2911823414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680b1170 0x7f0b6806eee0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:53.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.927+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2911823414 >> 172.21.15.55:0/2911823414 conn(0x7f0b680cea70 msgr2=0x7f0b680ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:53.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.927+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2911823414 shutdown_connections 2023-07-06T21:54:53.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.927+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2911823414 wait complete. 2023-07-06T21:54:53.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6ff82640 1 Processor -- start 2023-07-06T21:54:53.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6ff82640 1 -- start start 2023-07-06T21:54:53.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6ff82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680709a0 0x7f0b6815ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:53.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6ff82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68070d70 0x7f0b68159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:53.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6ff82640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b680b1170 0x7f0b680c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:53.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6ff82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680c3020 con 0x7f0b680709a0 2023-07-06T21:54:53.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6ff82640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680c2a60 con 0x7f0b680b1170 2023-07-06T21:54:53.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6ff82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680c2d40 con 0x7f0b68070d70 2023-07-06T21:54:53.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6dd1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680709a0 0x7f0b6815ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:53.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6dd1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680709a0 0x7f0b6815ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53922/0 (socket says 172.21.15.55:53922) 2023-07-06T21:54:53.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6dd1e640 1 -- 172.21.15.55:0/2871958997 learned_addr learned my addr 172.21.15.55:0/2871958997 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6d51d640 1 --2- 172.21.15.55:0/2871958997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68070d70 0x7f0b68159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6e51f640 1 --2- 172.21.15.55:0/2871958997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b680b1170 0x7f0b680c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:53.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6dd1e640 1 -- 172.21.15.55:0/2871958997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68070d70 msgr2=0x7f0b68159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:53.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6dd1e640 1 --2- 172.21.15.55:0/2871958997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68070d70 0x7f0b68159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:53.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6dd1e640 1 -- 172.21.15.55:0/2871958997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b680b1170 msgr2=0x7f0b680c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:53.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6dd1e640 1 --2- 172.21.15.55:0/2871958997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b680b1170 0x7f0b680c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:53.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6dd1e640 1 -- 172.21.15.55:0/2871958997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60009a70 con 0x7f0b680709a0 2023-07-06T21:54:53.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6dd1e640 1 --2- 172.21.15.55:0/2871958997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680709a0 0x7f0b6815ba20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400c480 tx=0x7f0b6400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:53.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b5e7fc640 1 -- 172.21.15.55:0/2871958997 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b640074e0 con 0x7f0b680709a0 2023-07-06T21:54:53.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b5e7fc640 1 -- 172.21.15.55:0/2871958997 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b64007660 con 0x7f0b680709a0 2023-07-06T21:54:53.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b5e7fc640 1 -- 172.21.15.55:0/2871958997 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64004a30 con 0x7f0b680709a0 2023-07-06T21:54:53.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2871958997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b680c5960 con 0x7f0b680709a0 2023-07-06T21:54:53.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.931+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2871958997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6815a260 con 0x7f0b680709a0 2023-07-06T21:54:53.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.935+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2871958997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b68066d60 con 0x7f0b680709a0 2023-07-06T21:54:53.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.935+0000 7f0b5e7fc640 1 -- 172.21.15.55:0/2871958997 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0b64004b90 con 0x7f0b680709a0 2023-07-06T21:54:53.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.935+0000 7f0b5e7fc640 1 --2- 172.21.15.55:0/2871958997 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f0b4c0663a0 0x7f0b4c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:53.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.935+0000 7f0b5e7fc640 1 -- 172.21.15.55:0/2871958997 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f0b64083080 con 0x7f0b680709a0 2023-07-06T21:54:53.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.935+0000 7f0b6d51d640 1 --2- 172.21.15.55:0/2871958997 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f0b4c0663a0 0x7f0b4c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:53.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.935+0000 7f0b6d51d640 1 --2- 172.21.15.55:0/2871958997 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f0b4c0663a0 0x7f0b4c068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0b6806b320 tx=0x7f0b58008040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:53.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:53.939+0000 7f0b5e7fc640 1 -- 172.21.15.55:0/2871958997 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b64053e40 con 0x7f0b680709a0 2023-07-06T21:54:54.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.099+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2871958997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f0b6809f010 con 0x7f0b680709a0 2023-07-06T21:54:54.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.103+0000 7f0b5e7fc640 1 -- 172.21.15.55:0/2871958997 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v13) v1 ==== 120+0+0 (secure 0 0 0) 0x7f0b640539d0 con 0x7f0b680709a0 2023-07-06T21:54:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.107+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2871958997 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f0b4c0663a0 msgr2=0x7f0b4c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.107+0000 7f0b6ff82640 1 --2- 172.21.15.55:0/2871958997 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f0b4c0663a0 0x7f0b4c068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0b6806b320 tx=0x7f0b58008040 comp rx=0 tx=0).stop 2023-07-06T21:54:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.107+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2871958997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680709a0 msgr2=0x7f0b6815ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.107+0000 7f0b6ff82640 1 --2- 172.21.15.55:0/2871958997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680709a0 0x7f0b6815ba20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400c480 tx=0x7f0b6400c940 comp rx=0 tx=0).stop 2023-07-06T21:54:54.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.107+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2871958997 shutdown_connections 2023-07-06T21:54:54.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.107+0000 7f0b6ff82640 1 --2- 172.21.15.55:0/2871958997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b680b1170 0x7f0b680c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.107+0000 7f0b6ff82640 1 --2- 172.21.15.55:0/2871958997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b68070d70 0x7f0b68159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.107+0000 7f0b6ff82640 1 --2- 172.21.15.55:0/2871958997 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f0b4c0663a0 0x7f0b4c068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.107+0000 7f0b6ff82640 1 --2- 172.21.15.55:0/2871958997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b680709a0 0x7f0b6815ba20 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.107+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2871958997 >> 172.21.15.55:0/2871958997 conn(0x7f0b680cea70 msgr2=0x7f0b6806c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:54.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.107+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2871958997 shutdown_connections 2023-07-06T21:54:54.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.107+0000 7f0b6ff82640 1 -- 172.21.15.55:0/2871958997 wait complete. 2023-07-06T21:54:54.126 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-06T21:54:54.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.275+0000 7f510d912640 1 Processor -- start 2023-07-06T21:54:54.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.275+0000 7f510d912640 1 -- start start 2023-07-06T21:54:54.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.275+0000 7f510d912640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f510815bac0 0x7f51080c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.275+0000 7f510d912640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51080c8990 0x7f51080cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.275+0000 7f510d912640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51080c8df0 con 0x7f5108070970 2023-07-06T21:54:54.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.275+0000 7f510d912640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510815be90 con 0x7f51080c8990 2023-07-06T21:54:54.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.275+0000 7f510d912640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510806f910 con 0x7f510815bac0 2023-07-06T21:54:54.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.275+0000 7f510d111640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51080c8990 0x7f51080cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.275+0000 7f5107fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5108070970 0x7f510806b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35742/0 (socket says 172.21.15.55:35742) 2023-07-06T21:54:54.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.275+0000 7f5107fff640 1 -- 172.21.15.55:0/2209519499 learned_addr learned my addr 172.21.15.55:0/2209519499 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:54.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.279+0000 7f510c910640 1 --2- 172.21.15.55:0/2209519499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f510815bac0 0x7f51080c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.279+0000 7f510d111640 1 -- 172.21.15.55:0/2209519499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f510815bac0 msgr2=0x7f51080c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:54.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.279+0000 7f510d111640 1 --2- 172.21.15.55:0/2209519499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f510815bac0 0x7f51080c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.279+0000 7f510d111640 1 -- 172.21.15.55:0/2209519499 >> v1:172.21.15.55:6789/0 conn(0x7f5108070970 legacy=0x7f510806b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.279+0000 7f510d111640 1 -- 172.21.15.55:0/2209519499 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510806fb60 con 0x7f51080c8990 2023-07-06T21:54:54.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.279+0000 7f51077fe640 1 -- 172.21.15.55:0/2209519499 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491225255 0 0) 0x7f51080c8df0 con 0x7f5108070970 2023-07-06T21:54:54.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.279+0000 7f510c910640 1 --2- 172.21.15.55:0/2209519499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f510815bac0 0x7f51080c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:54:54.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.279+0000 7f510d111640 1 --2- 172.21.15.55:0/2209519499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51080c8990 0x7f51080cc7d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5100009d90 tx=0x7f510001c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7e6c17a1df0c10 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:54.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.279+0000 7f51077fe640 1 -- 172.21.15.55:0/2209519499 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51000a57e0 con 0x7f51080c8990 2023-07-06T21:54:54.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.279+0000 7f51077fe640 1 -- 172.21.15.55:0/2209519499 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51000a5940 con 0x7f51080c8990 2023-07-06T21:54:54.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.279+0000 7f51077fe640 1 -- 172.21.15.55:0/2209519499 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51000a5cd0 con 0x7f51080c8990 2023-07-06T21:54:54.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.279+0000 7f510d912640 1 -- 172.21.15.55:0/2209519499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51080c8990 msgr2=0x7f51080cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.279+0000 7f510d912640 1 --2- 172.21.15.55:0/2209519499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51080c8990 0x7f51080cc7d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5100009d90 tx=0x7f510001c830 comp rx=0 tx=0).stop 2023-07-06T21:54:54.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.279+0000 7f510d912640 1 -- 172.21.15.55:0/2209519499 shutdown_connections 2023-07-06T21:54:54.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d912640 1 --2- 172.21.15.55:0/2209519499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51080c8990 0x7f51080cc7d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d912640 1 --2- 172.21.15.55:0/2209519499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f510815bac0 0x7f51080c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d912640 1 -- 172.21.15.55:0/2209519499 >> 172.21.15.55:0/2209519499 conn(0x7f51080b0410 msgr2=0x7f51080cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:54.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d912640 1 -- 172.21.15.55:0/2209519499 shutdown_connections 2023-07-06T21:54:54.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d912640 1 -- 172.21.15.55:0/2209519499 wait complete. 2023-07-06T21:54:54.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d912640 1 Processor -- start 2023-07-06T21:54:54.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d912640 1 -- start start 2023-07-06T21:54:54.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d912640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5108070970 0x7f510814b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d912640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51080c8990 0x7f51080b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d912640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f510815bac0 0x7f51081583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d912640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510814b600 con 0x7f510815bac0 2023-07-06T21:54:54.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d912640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51080b1540 con 0x7f51080c8990 2023-07-06T21:54:54.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d912640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5108154090 con 0x7f5108070970 2023-07-06T21:54:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d111640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f510815bac0 0x7f51081583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d111640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f510815bac0 0x7f51081583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53942/0 (socket says 172.21.15.55:53942) 2023-07-06T21:54:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d111640 1 -- 172.21.15.55:0/868595862 learned_addr learned my addr 172.21.15.55:0/868595862 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510c910640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5108070970 0x7f510814b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f5107fff640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51080c8990 0x7f51080b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d111640 1 -- 172.21.15.55:0/868595862 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5108070970 msgr2=0x7f510814b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d111640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5108070970 0x7f510814b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d111640 1 -- 172.21.15.55:0/868595862 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51080c8990 msgr2=0x7f51080b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d111640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51080c8990 0x7f51080b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d111640 1 -- 172.21.15.55:0/868595862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5100009a70 con 0x7f510815bac0 2023-07-06T21:54:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510c910640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5108070970 0x7f510814b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f5107fff640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51080c8990 0x7f51080b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.283+0000 7f510d111640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f510815bac0 0x7f51081583e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f510001aee0 tx=0x7f51000195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.287+0000 7f51057fa640 1 -- 172.21.15.55:0/868595862 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51000b9860 con 0x7f510815bac0 2023-07-06T21:54:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.287+0000 7f51057fa640 1 -- 172.21.15.55:0/868595862 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51000b99c0 con 0x7f510815bac0 2023-07-06T21:54:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.287+0000 7f51057fa640 1 -- 172.21.15.55:0/868595862 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51000b9d30 con 0x7f510815bac0 2023-07-06T21:54:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.287+0000 7f510d912640 1 -- 172.21.15.55:0/868595862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5108154370 con 0x7f510815bac0 2023-07-06T21:54:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.287+0000 7f510d912640 1 -- 172.21.15.55:0/868595862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51080b1820 con 0x7f510815bac0 2023-07-06T21:54:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.287+0000 7f510d912640 1 -- 172.21.15.55:0/868595862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5108154890 con 0x7f510815bac0 2023-07-06T21:54:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.287+0000 7f51057fa640 1 -- 172.21.15.55:0/868595862 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f51000039a0 con 0x7f510815bac0 2023-07-06T21:54:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.287+0000 7f51057fa640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f50ec0663d0 0x7f50ec068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.287+0000 7f51057fa640 1 -- 172.21.15.55:0/868595862 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f510011f5a0 con 0x7f510815bac0 2023-07-06T21:54:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.287+0000 7f510c910640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f50ec0663d0 0x7f50ec068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.291+0000 7f510c910640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f50ec0663d0 0x7f50ec068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f51080c1370 tx=0x7f50fc008040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.291+0000 7f51057fa640 1 -- 172.21.15.55:0/868595862 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5108154890 con 0x7f510815bac0 2023-07-06T21:54:54.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.451+0000 7f510d912640 1 -- 172.21.15.55:0/868595862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5108154890 con 0x7f510815bac0 2023-07-06T21:54:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.459+0000 7f51057fa640 1 -- 172.21.15.55:0/868595862 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5108154890 con 0x7f510815bac0 2023-07-06T21:54:54.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.459+0000 7f510d912640 1 -- 172.21.15.55:0/868595862 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f50ec0663d0 msgr2=0x7f50ec068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.459+0000 7f510d912640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f50ec0663d0 0x7f50ec068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f51080c1370 tx=0x7f50fc008040 comp rx=0 tx=0).stop 2023-07-06T21:54:54.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.459+0000 7f510d912640 1 -- 172.21.15.55:0/868595862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f510815bac0 msgr2=0x7f51081583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.459+0000 7f510d912640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f510815bac0 0x7f51081583e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f510001aee0 tx=0x7f51000195d0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.459+0000 7f510d912640 1 -- 172.21.15.55:0/868595862 shutdown_connections 2023-07-06T21:54:54.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.459+0000 7f510d912640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f50ec0663d0 0x7f50ec068880 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.459+0000 7f510d912640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f510815bac0 0x7f51081583e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.459+0000 7f510d912640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51080c8990 0x7f51080b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.459+0000 7f510d912640 1 --2- 172.21.15.55:0/868595862 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5108070970 0x7f510814b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.459+0000 7f510d912640 1 -- 172.21.15.55:0/868595862 >> 172.21.15.55:0/868595862 conn(0x7f51080b0410 msgr2=0x7f510806a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:54.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.459+0000 7f510d912640 1 -- 172.21.15.55:0/868595862 shutdown_connections 2023-07-06T21:54:54.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.459+0000 7f510d912640 1 -- 172.21.15.55:0/868595862 wait complete. 2023-07-06T21:54:54.479 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-06T21:54:54.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.623+0000 7fc951540640 1 Processor -- start 2023-07-06T21:54:54.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc951540640 1 -- start start 2023-07-06T21:54:54.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc951540640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc94c0709a0 0x7fc94c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc951540640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc94c0b1340 0x7fc94c06eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc951540640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c0cc300 con 0x7fc94c0cbe60 2023-07-06T21:54:54.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc951540640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c0cc5e0 con 0x7fc94c0709a0 2023-07-06T21:54:54.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc951540640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0cc8c0 con 0x7fc94c0b1340 2023-07-06T21:54:54.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc943fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc94c0cbe60 0x7fc94c0b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35750/0 (socket says 172.21.15.55:35750) 2023-07-06T21:54:54.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc943fff640 1 -- 172.21.15.55:0/1347843932 learned_addr learned my addr 172.21.15.55:0/1347843932 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:54.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc94b7fe640 1 --2- 172.21.15.55:0/1347843932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc94c0b1340 0x7fc94c06eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc94affd640 1 --2- 172.21.15.55:0/1347843932 >> v2:172.21.15.138:3300/0 conn(0x7fc94c0709a0 0x7fc94c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc94a7fc640 1 -- 172.21.15.55:0/1347843932 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755139454 0 0) 0x7fc94c0cc300 con 0x7fc94c0cbe60 2023-07-06T21:54:54.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc94a7fc640 1 -- 172.21.15.55:0/1347843932 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc938003530 con 0x7fc94c0cbe60 2023-07-06T21:54:54.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc94b7fe640 1 -- 172.21.15.55:0/1347843932 >> v2:172.21.15.138:3300/0 conn(0x7fc94c0709a0 msgr2=0x7fc94c0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:54.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc94b7fe640 1 --2- 172.21.15.55:0/1347843932 >> v2:172.21.15.138:3300/0 conn(0x7fc94c0709a0 0x7fc94c0cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc94b7fe640 1 -- 172.21.15.55:0/1347843932 >> v1:172.21.15.55:6789/0 conn(0x7fc94c0cbe60 legacy=0x7fc94c0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc94b7fe640 1 -- 172.21.15.55:0/1347843932 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c0ccba0 con 0x7fc94c0b1340 2023-07-06T21:54:54.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.627+0000 7fc94affd640 1 --2- 172.21.15.55:0/1347843932 >> v2:172.21.15.138:3300/0 conn(0x7fc94c0709a0 0x7fc94c0cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:54.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.631+0000 7fc94b7fe640 1 --2- 172.21.15.55:0/1347843932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc94c0b1340 0x7fc94c06eee0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc944009d90 tx=0x7fc94401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad266bfb365f665a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:54.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.631+0000 7fc94a7fc640 1 -- 172.21.15.55:0/1347843932 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440a5920 con 0x7fc94c0b1340 2023-07-06T21:54:54.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.631+0000 7fc94a7fc640 1 -- 172.21.15.55:0/1347843932 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9440a5a80 con 0x7fc94c0b1340 2023-07-06T21:54:54.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.631+0000 7fc94a7fc640 1 -- 172.21.15.55:0/1347843932 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440a5e10 con 0x7fc94c0b1340 2023-07-06T21:54:54.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.631+0000 7fc951540640 1 -- 172.21.15.55:0/1347843932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc94c0b1340 msgr2=0x7fc94c06eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.631+0000 7fc951540640 1 --2- 172.21.15.55:0/1347843932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc94c0b1340 0x7fc94c06eee0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc944009d90 tx=0x7fc94401c950 comp rx=0 tx=0).stop 2023-07-06T21:54:54.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.631+0000 7fc951540640 1 -- 172.21.15.55:0/1347843932 shutdown_connections 2023-07-06T21:54:54.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.631+0000 7fc951540640 1 --2- 172.21.15.55:0/1347843932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc94c0b1340 0x7fc94c06eee0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.631+0000 7fc951540640 1 --2- 172.21.15.55:0/1347843932 >> v2:172.21.15.138:3300/0 conn(0x7fc94c0709a0 0x7fc94c0cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.631+0000 7fc951540640 1 -- 172.21.15.55:0/1347843932 >> 172.21.15.55:0/1347843932 conn(0x7fc94c0cea70 msgr2=0x7fc94c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:54.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.631+0000 7fc951540640 1 -- 172.21.15.55:0/1347843932 shutdown_connections 2023-07-06T21:54:54.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.631+0000 7fc951540640 1 -- 172.21.15.55:0/1347843932 wait complete. 2023-07-06T21:54:54.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.631+0000 7fc951540640 1 Processor -- start 2023-07-06T21:54:54.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.631+0000 7fc951540640 1 -- start start 2023-07-06T21:54:54.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc951540640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc94c0709a0 0x7fc94c0ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc951540640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b1340 0x7fc94c15ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc951540640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc94c0cbe60 0x7fc94c0adce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc951540640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c163ee0 con 0x7fc94c0b1340 2023-07-06T21:54:54.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc951540640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c06b720 con 0x7fc94c0709a0 2023-07-06T21:54:54.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc951540640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c15b390 con 0x7fc94c0cbe60 2023-07-06T21:54:54.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc943fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b1340 0x7fc94c15ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc943fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b1340 0x7fc94c15ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53944/0 (socket says 172.21.15.55:53944) 2023-07-06T21:54:54.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc943fff640 1 -- 172.21.15.55:0/1566490209 learned_addr learned my addr 172.21.15.55:0/1566490209 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:54.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc94affd640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc94c0709a0 0x7fc94c0ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc94b7fe640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc94c0cbe60 0x7fc94c0adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc943fff640 1 -- 172.21.15.55:0/1566490209 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc94c0cbe60 msgr2=0x7fc94c0adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc943fff640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc94c0cbe60 0x7fc94c0adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc943fff640 1 -- 172.21.15.55:0/1566490209 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc94c0709a0 msgr2=0x7fc94c0ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc943fff640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc94c0709a0 0x7fc94c0ad370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc943fff640 1 -- 172.21.15.55:0/1566490209 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c009420 con 0x7fc94c0b1340 2023-07-06T21:54:54.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc94b7fe640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc94c0cbe60 0x7fc94c0adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:54.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc943fff640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b1340 0x7fc94c15ae50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc93400c3f0 tx=0x7fc93400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:54.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc9437fe640 1 -- 172.21.15.55:0/1566490209 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934005cf0 con 0x7fc94c0b1340 2023-07-06T21:54:54.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc9437fe640 1 -- 172.21.15.55:0/1566490209 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc934005e50 con 0x7fc94c0b1340 2023-07-06T21:54:54.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc9437fe640 1 -- 172.21.15.55:0/1566490209 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9340072f0 con 0x7fc94c0b1340 2023-07-06T21:54:54.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc951540640 1 -- 172.21.15.55:0/1566490209 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc944009a70 con 0x7fc94c0b1340 2023-07-06T21:54:54.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc951540640 1 -- 172.21.15.55:0/1566490209 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c163540 con 0x7fc94c0b1340 2023-07-06T21:54:54.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.635+0000 7fc951540640 1 -- 172.21.15.55:0/1566490209 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c066d60 con 0x7fc94c0b1340 2023-07-06T21:54:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.639+0000 7fc9437fe640 1 -- 172.21.15.55:0/1566490209 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc934007450 con 0x7fc94c0b1340 2023-07-06T21:54:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.639+0000 7fc9437fe640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fc92c0663a0 0x7fc92c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.639+0000 7fc9437fe640 1 -- 172.21.15.55:0/1566490209 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fc9340834b0 con 0x7fc94c0b1340 2023-07-06T21:54:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.639+0000 7fc94affd640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fc92c0663a0 0x7fc92c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.639+0000 7fc94affd640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fc92c0663a0 0x7fc92c068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009cf0 tx=0x7fc93c009190 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:54.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.643+0000 7fc9437fe640 1 -- 172.21.15.55:0/1566490209 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9340507f0 con 0x7fc94c0b1340 2023-07-06T21:54:54.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.807+0000 7fc951540640 1 -- 172.21.15.55:0/1566490209 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fc94c0c7e50 con 0x7fc94c0b1340 2023-07-06T21:54:54.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.811+0000 7fc9437fe640 1 -- 172.21.15.55:0/1566490209 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v15) v1 ==== 115+0+0 (secure 0 0 0) 0x7fc934053e10 con 0x7fc94c0b1340 2023-07-06T21:54:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.811+0000 7fc951540640 1 -- 172.21.15.55:0/1566490209 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fc92c0663a0 msgr2=0x7fc92c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.811+0000 7fc951540640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fc92c0663a0 0x7fc92c068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009cf0 tx=0x7fc93c009190 comp rx=0 tx=0).stop 2023-07-06T21:54:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.811+0000 7fc951540640 1 -- 172.21.15.55:0/1566490209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b1340 msgr2=0x7fc94c15ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.811+0000 7fc951540640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b1340 0x7fc94c15ae50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc93400c3f0 tx=0x7fc93400c8b0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.811+0000 7fc951540640 1 -- 172.21.15.55:0/1566490209 shutdown_connections 2023-07-06T21:54:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.811+0000 7fc951540640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc94c0cbe60 0x7fc94c0adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.811+0000 7fc951540640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fc92c0663a0 0x7fc92c068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.811+0000 7fc951540640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b1340 0x7fc94c15ae50 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.811+0000 7fc951540640 1 --2- 172.21.15.55:0/1566490209 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc94c0709a0 0x7fc94c0ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.811+0000 7fc951540640 1 -- 172.21.15.55:0/1566490209 >> 172.21.15.55:0/1566490209 conn(0x7fc94c0cea70 msgr2=0x7fc94c0c4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.815+0000 7fc951540640 1 -- 172.21.15.55:0/1566490209 shutdown_connections 2023-07-06T21:54:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.815+0000 7fc951540640 1 -- 172.21.15.55:0/1566490209 wait complete. 2023-07-06T21:54:54.833 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-07-06T21:54:54.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.975+0000 7fb05b048640 1 Processor -- start 2023-07-06T21:54:54.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.975+0000 7fb05b048640 1 -- start start 2023-07-06T21:54:54.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.975+0000 7fb05b048640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0540712f0 0x7fb05406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.975+0000 7fb05b048640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0540b3730 0x7fb0540c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.975+0000 7fb05b048640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb054159cd0 con 0x7fb0540ca280 2023-07-06T21:54:54.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.975+0000 7fb05b048640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0540ca700 con 0x7fb0540712f0 2023-07-06T21:54:54.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.975+0000 7fb05b048640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0540693f0 con 0x7fb0540b3730 2023-07-06T21:54:54.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.975+0000 7fb058de4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0540712f0 0x7fb05406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.975+0000 7fb058de4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0540712f0 0x7fb05406a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53956/0 (socket says 172.21.15.55:53956) 2023-07-06T21:54:54.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.975+0000 7fb058de4640 1 -- 172.21.15.55:0/2372913785 learned_addr learned my addr 172.21.15.55:0/2372913785 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:54.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.975+0000 7fb058de4640 1 -- 172.21.15.55:0/2372913785 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0540b3730 msgr2=0x7fb0540c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:54.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.975+0000 7fb058de4640 1 --2- 172.21.15.55:0/2372913785 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0540b3730 0x7fb0540c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.975+0000 7fb058de4640 1 -- 172.21.15.55:0/2372913785 >> v1:172.21.15.138:6789/0 conn(0x7fb0540ca280 legacy=0x7fb0540c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:54.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.975+0000 7fb058de4640 1 -- 172.21.15.55:0/2372913785 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05406aca0 con 0x7fb0540712f0 2023-07-06T21:54:54.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.979+0000 7fb058de4640 1 --2- 172.21.15.55:0/2372913785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0540712f0 0x7fb05406a610 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb048009870 tx=0x7fb04801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7455ff45a2a514c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:54.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.979+0000 7fb0537fe640 1 -- 172.21.15.55:0/2372913785 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0480ac410 con 0x7fb0540712f0 2023-07-06T21:54:54.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.979+0000 7fb0537fe640 1 -- 172.21.15.55:0/2372913785 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0480ac570 con 0x7fb0540712f0 2023-07-06T21:54:54.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.979+0000 7fb0537fe640 1 -- 172.21.15.55:0/2372913785 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0480ac900 con 0x7fb0540712f0 2023-07-06T21:54:54.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.979+0000 7fb05b048640 1 -- 172.21.15.55:0/2372913785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0540712f0 msgr2=0x7fb05406a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.979+0000 7fb05b048640 1 --2- 172.21.15.55:0/2372913785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0540712f0 0x7fb05406a610 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb048009870 tx=0x7fb04801c4d0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.979+0000 7fb05b048640 1 -- 172.21.15.55:0/2372913785 shutdown_connections 2023-07-06T21:54:54.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.979+0000 7fb05b048640 1 --2- 172.21.15.55:0/2372913785 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0540b3730 0x7fb0540c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.979+0000 7fb05b048640 1 --2- 172.21.15.55:0/2372913785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0540712f0 0x7fb05406a610 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.979+0000 7fb05b048640 1 -- 172.21.15.55:0/2372913785 >> 172.21.15.55:0/2372913785 conn(0x7fb0540cded0 msgr2=0x7fb0540ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:54.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.979+0000 7fb05b048640 1 -- 172.21.15.55:0/2372913785 shutdown_connections 2023-07-06T21:54:54.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.979+0000 7fb05b048640 1 -- 172.21.15.55:0/2372913785 wait complete. 2023-07-06T21:54:54.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb05b048640 1 Processor -- start 2023-07-06T21:54:54.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb05b048640 1 -- start start 2023-07-06T21:54:54.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb05b048640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0540712f0 0x7fb05414b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb05b048640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0540b3730 0x7fb0540c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb05b048640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0540ca280 0x7fb05415be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb05b048640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05415c8a0 con 0x7fb0540712f0 2023-07-06T21:54:54.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb05b048640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05414b870 con 0x7fb0540ca280 2023-07-06T21:54:54.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb05b048640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0540c1a40 con 0x7fb0540b3730 2023-07-06T21:54:54.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb058de4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0540712f0 0x7fb05414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb058de4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0540712f0 0x7fb05414b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53966/0 (socket says 172.21.15.55:53966) 2023-07-06T21:54:54.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb058de4640 1 -- 172.21.15.55:0/1121692721 learned_addr learned my addr 172.21.15.55:0/1121692721 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:54.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb053fff640 1 --2- 172.21.15.55:0/1121692721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0540b3730 0x7fb0540c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb0595e5640 1 --2- 172.21.15.55:0/1121692721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0540ca280 0x7fb05415be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb058de4640 1 -- 172.21.15.55:0/1121692721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0540b3730 msgr2=0x7fb0540c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb058de4640 1 --2- 172.21.15.55:0/1121692721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0540b3730 0x7fb0540c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb058de4640 1 -- 172.21.15.55:0/1121692721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0540ca280 msgr2=0x7fb05415be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:54.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb058de4640 1 --2- 172.21.15.55:0/1121692721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0540ca280 0x7fb05415be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:54.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb058de4640 1 -- 172.21.15.55:0/1121692721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0480094d0 con 0x7fb0540712f0 2023-07-06T21:54:54.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb058de4640 1 --2- 172.21.15.55:0/1121692721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0540712f0 0x7fb05414b330 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb0480af040 tx=0x7fb048019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:54.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb0517fa640 1 -- 172.21.15.55:0/1121692721 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0480ac410 con 0x7fb0540712f0 2023-07-06T21:54:54.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb0517fa640 1 -- 172.21.15.55:0/1121692721 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0480b5630 con 0x7fb0540712f0 2023-07-06T21:54:54.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb0517fa640 1 -- 172.21.15.55:0/1121692721 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0480b59e0 con 0x7fb0540712f0 2023-07-06T21:54:54.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.983+0000 7fb05b048640 1 -- 172.21.15.55:0/1121692721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0540c1d20 con 0x7fb0540712f0 2023-07-06T21:54:54.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.987+0000 7fb05b048640 1 -- 172.21.15.55:0/1121692721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0540c22e0 con 0x7fb0540712f0 2023-07-06T21:54:54.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.987+0000 7fb05b048640 1 -- 172.21.15.55:0/1121692721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0540c24d0 con 0x7fb0540712f0 2023-07-06T21:54:54.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.987+0000 7fb0517fa640 1 -- 172.21.15.55:0/1121692721 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb0480b3070 con 0x7fb0540712f0 2023-07-06T21:54:54.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.987+0000 7fb0517fa640 1 --2- 172.21.15.55:0/1121692721 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fb0380663d0 0x7fb038068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:54.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.987+0000 7fb0517fa640 1 -- 172.21.15.55:0/1121692721 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fb04811e6e0 con 0x7fb0540712f0 2023-07-06T21:54:54.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.987+0000 7fb053fff640 1 --2- 172.21.15.55:0/1121692721 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fb0380663d0 0x7fb038068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:54.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.991+0000 7fb053fff640 1 --2- 172.21.15.55:0/1121692721 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fb0380663d0 0x7fb038068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb040006fd0 tx=0x7fb040008040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:54.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:54.991+0000 7fb0517fa640 1 -- 172.21.15.55:0/1121692721 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0480eb860 con 0x7fb0540712f0 2023-07-06T21:54:55.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.199+0000 7fb05b048640 1 -- 172.21.15.55:0/1121692721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7fb054066d60 con 0x7fb0540712f0 2023-07-06T21:54:55.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.743+0000 7fb0517fa640 1 -- 172.21.15.55:0/1121692721 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v470) v1 ==== 158+0+0 (secure 0 0 0) 0x7fb0480eee80 con 0x7fb0540712f0 2023-07-06T21:54:55.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.743+0000 7fb05b048640 1 -- 172.21.15.55:0/1121692721 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fb0380663d0 msgr2=0x7fb038068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:55.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.743+0000 7fb05b048640 1 --2- 172.21.15.55:0/1121692721 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fb0380663d0 0x7fb038068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb040006fd0 tx=0x7fb040008040 comp rx=0 tx=0).stop 2023-07-06T21:54:55.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.743+0000 7fb05b048640 1 -- 172.21.15.55:0/1121692721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0540712f0 msgr2=0x7fb05414b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:55.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.743+0000 7fb05b048640 1 --2- 172.21.15.55:0/1121692721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0540712f0 0x7fb05414b330 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb0480af040 tx=0x7fb048019270 comp rx=0 tx=0).stop 2023-07-06T21:54:55.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.743+0000 7fb05b048640 1 -- 172.21.15.55:0/1121692721 shutdown_connections 2023-07-06T21:54:55.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.743+0000 7fb05b048640 1 --2- 172.21.15.55:0/1121692721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0540ca280 0x7fb05415be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:55.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.743+0000 7fb05b048640 1 --2- 172.21.15.55:0/1121692721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0540b3730 0x7fb0540c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:55.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.743+0000 7fb05b048640 1 --2- 172.21.15.55:0/1121692721 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fb0380663d0 0x7fb038068880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:55.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.743+0000 7fb05b048640 1 --2- 172.21.15.55:0/1121692721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0540712f0 0x7fb05414b330 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:55.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.743+0000 7fb05b048640 1 -- 172.21.15.55:0/1121692721 >> 172.21.15.55:0/1121692721 conn(0x7fb0540cded0 msgr2=0x7fb0540ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:55.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.743+0000 7fb05b048640 1 -- 172.21.15.55:0/1121692721 shutdown_connections 2023-07-06T21:54:55.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.743+0000 7fb05b048640 1 -- 172.21.15.55:0/1121692721 wait complete. 2023-07-06T21:54:55.766 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-07-06T21:54:55.766 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-07-06T21:54:55.766 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-06T21:54:55.767 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-07-06T21:54:55.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.911+0000 7f118f340640 1 Processor -- start 2023-07-06T21:54:55.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.911+0000 7f118f340640 1 -- start start 2023-07-06T21:54:55.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f118f340640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11881587d0 0x7f1188070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:55.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f118f340640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f11880710c0 0x7f11880cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:55.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f118f340640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118806fae0 con 0x7f1188158400 2023-07-06T21:54:55.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f118f340640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118806fdc0 con 0x7f11880710c0 2023-07-06T21:54:55.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f118f340640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11880700a0 con 0x7f11881587d0 2023-07-06T21:54:55.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f118d0dc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1188158400 0x7f11880c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35764/0 (socket says 172.21.15.55:35764) 2023-07-06T21:54:55.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f118d0dc640 1 -- 172.21.15.55:0/692366478 learned_addr learned my addr 172.21.15.55:0/692366478 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:55.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f118d8dd640 1 --2- 172.21.15.55:0/692366478 >> v2:172.21.15.55:3300/0 conn(0x7f11880710c0 0x7f11880cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:55.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f118c8db640 1 --2- 172.21.15.55:0/692366478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11881587d0 0x7f1188070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:55.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f117ffff640 1 -- 172.21.15.55:0/692366478 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987101053 0 0) 0x7f118806fae0 con 0x7f1188158400 2023-07-06T21:54:55.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f117ffff640 1 -- 172.21.15.55:0/692366478 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1174005740 con 0x7f1188158400 2023-07-06T21:54:55.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f118d8dd640 1 -- 172.21.15.55:0/692366478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11881587d0 msgr2=0x7f1188070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:55.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f118d8dd640 1 --2- 172.21.15.55:0/692366478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11881587d0 0x7f1188070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:55.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f118d8dd640 1 -- 172.21.15.55:0/692366478 >> v1:172.21.15.55:6789/0 conn(0x7f1188158400 legacy=0x7f11880c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:55.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.915+0000 7f118d8dd640 1 -- 172.21.15.55:0/692366478 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1188070380 con 0x7f11880710c0 2023-07-06T21:54:55.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.919+0000 7f118d8dd640 1 --2- 172.21.15.55:0/692366478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11880710c0 0x7f11880cbaa0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1180009d90 tx=0x7f118001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2088f1337c8d5b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.919+0000 7f117ffff640 1 -- 172.21.15.55:0/692366478 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11800a58f0 con 0x7f11880710c0 2023-07-06T21:54:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.919+0000 7f117ffff640 1 -- 172.21.15.55:0/692366478 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11800a5a50 con 0x7f11880710c0 2023-07-06T21:54:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.919+0000 7f117ffff640 1 -- 172.21.15.55:0/692366478 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11800a5de0 con 0x7f11880710c0 2023-07-06T21:54:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.919+0000 7f118f340640 1 -- 172.21.15.55:0/692366478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11880710c0 msgr2=0x7f11880cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.919+0000 7f118f340640 1 --2- 172.21.15.55:0/692366478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11880710c0 0x7f11880cbaa0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1180009d90 tx=0x7f118001c920 comp rx=0 tx=0).stop 2023-07-06T21:54:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.919+0000 7f118f340640 1 -- 172.21.15.55:0/692366478 shutdown_connections 2023-07-06T21:54:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.919+0000 7f118f340640 1 --2- 172.21.15.55:0/692366478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11881587d0 0x7f1188070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.919+0000 7f118f340640 1 --2- 172.21.15.55:0/692366478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11880710c0 0x7f11880cbaa0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.919+0000 7f118f340640 1 -- 172.21.15.55:0/692366478 >> 172.21.15.55:0/692366478 conn(0x7f11880cded0 msgr2=0x7f11880ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:55.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.919+0000 7f118f340640 1 -- 172.21.15.55:0/692366478 shutdown_connections 2023-07-06T21:54:55.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.919+0000 7f118f340640 1 -- 172.21.15.55:0/692366478 wait complete. 2023-07-06T21:54:55.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.919+0000 7f118f340640 1 Processor -- start 2023-07-06T21:54:55.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.919+0000 7f118f340640 1 -- start start 2023-07-06T21:54:55.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118f340640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11880710c0 0x7f11880c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:55.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118f340640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1188158400 0x7f1188150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:55.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118f340640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11881587d0 0x7f11880adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:55.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118f340640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1188152270 con 0x7f11881587d0 2023-07-06T21:54:55.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118f340640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11880c6290 con 0x7f1188158400 2023-07-06T21:54:55.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118f340640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11881f46c0 con 0x7f11880710c0 2023-07-06T21:54:55.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118d0dc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11880710c0 0x7f11880c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:55.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118d8dd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11881587d0 0x7f11880adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:55.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118d0dc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11880710c0 0x7f11880c5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44412/0 (socket says 172.21.15.55:44412) 2023-07-06T21:54:55.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118d0dc640 1 -- 172.21.15.55:0/279553338 learned_addr learned my addr 172.21.15.55:0/279553338 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:55.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118c8db640 1 --2- 172.21.15.55:0/279553338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1188158400 0x7f1188150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:55.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118d8dd640 1 -- 172.21.15.55:0/279553338 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11880710c0 msgr2=0x7f11880c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:55.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118d8dd640 1 --2- 172.21.15.55:0/279553338 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11880710c0 0x7f11880c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:55.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118d8dd640 1 -- 172.21.15.55:0/279553338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1188158400 msgr2=0x7f1188150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:55.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118d8dd640 1 --2- 172.21.15.55:0/279553338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1188158400 0x7f1188150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:55.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118d8dd640 1 -- 172.21.15.55:0/279553338 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1180009a70 con 0x7f11881587d0 2023-07-06T21:54:55.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118d0dc640 1 --2- 172.21.15.55:0/279553338 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11880710c0 0x7f11880c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118d8dd640 1 --2- 172.21.15.55:0/279553338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11881587d0 0x7f11880adf50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f11800ac000 tx=0x7f11800196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f117dffb640 1 -- 172.21.15.55:0/279553338 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11800b9860 con 0x7f11881587d0 2023-07-06T21:54:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f117dffb640 1 -- 172.21.15.55:0/279553338 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11800b99c0 con 0x7f11881587d0 2023-07-06T21:54:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f117dffb640 1 -- 172.21.15.55:0/279553338 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11800b9d70 con 0x7f11881587d0 2023-07-06T21:54:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118f340640 1 -- 172.21.15.55:0/279553338 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1188151980 con 0x7f11881587d0 2023-07-06T21:54:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118f340640 1 -- 172.21.15.55:0/279553338 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1188151f00 con 0x7f11881587d0 2023-07-06T21:54:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f118f340640 1 -- 172.21.15.55:0/279553338 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118806c580 con 0x7f11881587d0 2023-07-06T21:54:55.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.923+0000 7f117dffb640 1 -- 172.21.15.55:0/279553338 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f11800ad440 con 0x7f11881587d0 2023-07-06T21:54:55.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.927+0000 7f117dffb640 1 --2- 172.21.15.55:0/279553338 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f116c0663a0 0x7f116c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:55.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.927+0000 7f117dffb640 1 -- 172.21.15.55:0/279553338 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f118011e7e0 con 0x7f11881587d0 2023-07-06T21:54:55.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.927+0000 7f118d0dc640 1 --2- 172.21.15.55:0/279553338 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f116c0663a0 0x7f116c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:55.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.927+0000 7f118d0dc640 1 --2- 172.21.15.55:0/279553338 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f116c0663a0 0x7f116c068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f11840011f0 tx=0x7f1184009040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:55.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:55.931+0000 7f117dffb640 1 -- 172.21.15.55:0/279553338 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11800eba90 con 0x7f11881587d0 2023-07-06T21:54:56.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.139+0000 7f118f340640 1 -- 172.21.15.55:0/279553338 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f1188066d60 con 0x7f11881587d0 2023-07-06T21:54:56.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.747+0000 7f117dffb640 1 -- 172.21.15.55:0/279553338 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v471) v1 ==== 157+0+0 (secure 0 0 0) 0x7f118011ce60 con 0x7f11881587d0 2023-07-06T21:54:56.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.751+0000 7f118f340640 1 -- 172.21.15.55:0/279553338 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f116c0663a0 msgr2=0x7f116c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:56.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.751+0000 7f118f340640 1 --2- 172.21.15.55:0/279553338 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f116c0663a0 0x7f116c068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f11840011f0 tx=0x7f1184009040 comp rx=0 tx=0).stop 2023-07-06T21:54:56.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.751+0000 7f118f340640 1 -- 172.21.15.55:0/279553338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11881587d0 msgr2=0x7f11880adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:56.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.751+0000 7f118f340640 1 --2- 172.21.15.55:0/279553338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11881587d0 0x7f11880adf50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f11800ac000 tx=0x7f11800196c0 comp rx=0 tx=0).stop 2023-07-06T21:54:56.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.751+0000 7f118f340640 1 -- 172.21.15.55:0/279553338 shutdown_connections 2023-07-06T21:54:56.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.751+0000 7f118f340640 1 --2- 172.21.15.55:0/279553338 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f116c0663a0 0x7f116c068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:56.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.751+0000 7f118f340640 1 --2- 172.21.15.55:0/279553338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11881587d0 0x7f11880adf50 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:56.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.751+0000 7f118f340640 1 --2- 172.21.15.55:0/279553338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1188158400 0x7f1188150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:56.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.751+0000 7f118f340640 1 --2- 172.21.15.55:0/279553338 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11880710c0 0x7f11880c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:56.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.751+0000 7f118f340640 1 -- 172.21.15.55:0/279553338 >> 172.21.15.55:0/279553338 conn(0x7f11880cded0 msgr2=0x7f11880aef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:56.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.751+0000 7f118f340640 1 -- 172.21.15.55:0/279553338 shutdown_connections 2023-07-06T21:54:56.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.751+0000 7f118f340640 1 -- 172.21.15.55:0/279553338 wait complete. 2023-07-06T21:54:56.775 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:54:56.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.923+0000 7f8ed1093640 1 Processor -- start 2023-07-06T21:54:56.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.923+0000 7f8ed1093640 1 -- start start 2023-07-06T21:54:56.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8ed1093640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ecc15bc40 0x7f8ecc06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:56.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8ed1093640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8ecc15cc00 0x7f8ecc15f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:56.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8ed1093640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc15c770 con 0x7f8ecc06f8e0 2023-07-06T21:54:56.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8ed1093640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ecc06d4f0 con 0x7f8ecc15cc00 2023-07-06T21:54:56.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8ed1093640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc06d210 con 0x7f8ecc15bc40 2023-07-06T21:54:56.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8ecb59e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8ecc15cc00 0x7f8ecc15f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:56.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8eca59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ecc15bc40 0x7f8ecc06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:56.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8ecad9d640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f8ecc06f8e0 0x7f8ecc06fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:34138/0 (socket says 172.21.15.55:34138) 2023-07-06T21:54:56.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8ecad9d640 1 -- 172.21.15.55:0/414905449 learned_addr learned my addr 172.21.15.55:0/414905449 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:56.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8ecb59e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8ecc15cc00 0x7f8ecc15f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:56938/0 (socket says 172.21.15.55:56938) 2023-07-06T21:54:56.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8eca59c640 1 -- 172.21.15.55:0/414905449 >> v2:172.21.15.138:3300/0 conn(0x7f8ecc15cc00 msgr2=0x7f8ecc15f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:56.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8eca59c640 1 --2- 172.21.15.55:0/414905449 >> v2:172.21.15.138:3300/0 conn(0x7f8ecc15cc00 0x7f8ecc15f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:56.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8eca59c640 1 -- 172.21.15.55:0/414905449 >> v1:172.21.15.138:6789/0 conn(0x7f8ecc06f8e0 legacy=0x7f8ecc06fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:56.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8eca59c640 1 -- 172.21.15.55:0/414905449 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc15c120 con 0x7f8ecc15bc40 2023-07-06T21:54:56.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8ec9d9b640 1 -- 172.21.15.55:0/414905449 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986053173 0 0) 0x7f8ecc15c770 con 0x7f8ecc06f8e0 2023-07-06T21:54:56.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.927+0000 7f8ecb59e640 1 --2- 172.21.15.55:0/414905449 >> v2:172.21.15.138:3300/0 conn(0x7f8ecc15cc00 0x7f8ecc15f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:56.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.931+0000 7f8eca59c640 1 --2- 172.21.15.55:0/414905449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ecc15bc40 0x7f8ecc06c930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00097c0 tx=0x7f8ec001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5559d551a48892 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:56.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.931+0000 7f8ec9d9b640 1 -- 172.21.15.55:0/414905449 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec00ad680 con 0x7f8ecc15bc40 2023-07-06T21:54:56.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.931+0000 7f8ec9d9b640 1 -- 172.21.15.55:0/414905449 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec00ad7e0 con 0x7f8ecc15bc40 2023-07-06T21:54:56.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.931+0000 7f8ec9d9b640 1 -- 172.21.15.55:0/414905449 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec00adb70 con 0x7f8ecc15bc40 2023-07-06T21:54:56.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.931+0000 7f8ed1093640 1 -- 172.21.15.55:0/414905449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ecc15bc40 msgr2=0x7f8ecc06c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:56.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.931+0000 7f8ed1093640 1 --2- 172.21.15.55:0/414905449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ecc15bc40 0x7f8ecc06c930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00097c0 tx=0x7f8ec001c450 comp rx=0 tx=0).stop 2023-07-06T21:54:56.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.931+0000 7f8ed1093640 1 -- 172.21.15.55:0/414905449 shutdown_connections 2023-07-06T21:54:56.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.931+0000 7f8ed1093640 1 --2- 172.21.15.55:0/414905449 >> v2:172.21.15.138:3300/0 conn(0x7f8ecc15cc00 0x7f8ecc15f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:56.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.931+0000 7f8ed1093640 1 --2- 172.21.15.55:0/414905449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ecc15bc40 0x7f8ecc06c930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:56.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.931+0000 7f8ed1093640 1 -- 172.21.15.55:0/414905449 >> 172.21.15.55:0/414905449 conn(0x7f8ecc0cbd80 msgr2=0x7f8ecc0ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:56.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.931+0000 7f8ed1093640 1 -- 172.21.15.55:0/414905449 shutdown_connections 2023-07-06T21:54:56.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.931+0000 7f8ed1093640 1 -- 172.21.15.55:0/414905449 wait complete. 2023-07-06T21:54:56.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.931+0000 7f8ed1093640 1 Processor -- start 2023-07-06T21:54:56.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.931+0000 7f8ed1093640 1 -- start start 2023-07-06T21:54:56.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ed1093640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ecc06f8e0 0x7f8ecc0c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:56.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ed1093640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ecc15bc40 0x7f8ecc151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:56.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ed1093640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ecc15cc00 0x7f8ecc152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:56.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ed1093640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0c4fc0 con 0x7f8ecc06f8e0 2023-07-06T21:54:56.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ed1093640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0c3400 con 0x7f8ecc15bc40 2023-07-06T21:54:56.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ed1093640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc152050 con 0x7f8ecc15cc00 2023-07-06T21:54:56.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ecad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ecc06f8e0 0x7f8ecc0c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:56.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8eca59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ecc15bc40 0x7f8ecc151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:56.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ecad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ecc06f8e0 0x7f8ecc0c2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53984/0 (socket says 172.21.15.55:53984) 2023-07-06T21:54:56.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ecad9d640 1 -- 172.21.15.55:0/2063536976 learned_addr learned my addr 172.21.15.55:0/2063536976 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:56.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ecb59e640 1 --2- 172.21.15.55:0/2063536976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ecc15cc00 0x7f8ecc152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:56.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ecad9d640 1 -- 172.21.15.55:0/2063536976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ecc15cc00 msgr2=0x7f8ecc152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:56.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ecad9d640 1 --2- 172.21.15.55:0/2063536976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ecc15cc00 0x7f8ecc152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:56.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ecad9d640 1 -- 172.21.15.55:0/2063536976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ecc15bc40 msgr2=0x7f8ecc151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:56.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ecad9d640 1 --2- 172.21.15.55:0/2063536976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ecc15bc40 0x7f8ecc151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:56.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ecad9d640 1 -- 172.21.15.55:0/2063536976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4009a70 con 0x7f8ecc06f8e0 2023-07-06T21:54:56.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ecad9d640 1 --2- 172.21.15.55:0/2063536976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ecc06f8e0 0x7f8ecc0c2ec0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00c550 tx=0x7f8ebc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:56.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8eb37fe640 1 -- 172.21.15.55:0/2063536976 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0074e0 con 0x7f8ecc06f8e0 2023-07-06T21:54:56.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8eb37fe640 1 -- 172.21.15.55:0/2063536976 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc007640 con 0x7f8ecc06f8e0 2023-07-06T21:54:56.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8eb37fe640 1 -- 172.21.15.55:0/2063536976 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0049f0 con 0x7f8ecc06f8e0 2023-07-06T21:54:56.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ed1093640 1 -- 172.21.15.55:0/2063536976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec0009420 con 0x7f8ecc06f8e0 2023-07-06T21:54:56.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ed1093640 1 -- 172.21.15.55:0/2063536976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc1523c0 con 0x7f8ecc06f8e0 2023-07-06T21:54:56.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8ed1093640 1 -- 172.21.15.55:0/2063536976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc152220 con 0x7f8ecc06f8e0 2023-07-06T21:54:56.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.935+0000 7f8eb37fe640 1 -- 172.21.15.55:0/2063536976 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8ebc004b50 con 0x7f8ecc06f8e0 2023-07-06T21:54:56.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.939+0000 7f8eb37fe640 1 --2- 172.21.15.55:0/2063536976 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f8eb80663a0 0x7f8eb8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:56.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.939+0000 7f8eb37fe640 1 -- 172.21.15.55:0/2063536976 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f8ebc0830c0 con 0x7f8ecc06f8e0 2023-07-06T21:54:56.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.939+0000 7f8eca59c640 1 --2- 172.21.15.55:0/2063536976 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f8eb80663a0 0x7f8eb8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:56.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.939+0000 7f8eca59c640 1 --2- 172.21.15.55:0/2063536976 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f8eb80663a0 0x7f8eb8068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00af000 tx=0x7f8ec00a7000 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:56.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:56.943+0000 7f8eb37fe640 1 -- 172.21.15.55:0/2063536976 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ecc152220 con 0x7f8ecc06f8e0 2023-07-06T21:54:57.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.099+0000 7f8ed1093640 1 -- 172.21.15.55:0/2063536976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ecc152220 con 0x7f8ecc06f8e0 2023-07-06T21:54:57.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.099+0000 7f8eb37fe640 1 -- 172.21.15.55:0/2063536976 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+15902 (secure 0 0 0) 0x7f8ecc152220 con 0x7f8ecc06f8e0 2023-07-06T21:54:57.099 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:57.100 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":64,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:54:53.721647+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/1792917100":"2023-07-07T21:54:49.645834+0000","172.21.15.55:6835/1792917100":"2023-07-07T21:54:49.645834+0000","172.21.15.55:0/901057021":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/4077940983":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/2605447220":"2023-07-07T21:43:45.377574+0000","172.21.15.55:6832/1575998409":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/2297905762":"2023-07-07T21:43:45.377574+0000","172.21.15.55:6833/1575998409":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/4216478759":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/3760089478":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/2066223848":"2023-07-07T21:43:45.377574+0000","172.21.15.55:0/1485483431":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/1005520698":"2023-07-07T21:43:45.377574+0000","172.21.15.55:6833/1149809384":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/2744432881":"2023-07-07T21:54:46.685675+0000","172.21.15.55:0/3786956974":"2023-07-07T21:54:46.685675+0000","172.21.15.55:6832/1149809384":"2023-07-07T21:54:46.685675+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:54:57.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.103+0000 7f8ed1093640 1 -- 172.21.15.55:0/2063536976 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f8eb80663a0 msgr2=0x7f8eb8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.103+0000 7f8ed1093640 1 --2- 172.21.15.55:0/2063536976 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f8eb80663a0 0x7f8eb8068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00af000 tx=0x7f8ec00a7000 comp rx=0 tx=0).stop 2023-07-06T21:54:57.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.103+0000 7f8ed1093640 1 -- 172.21.15.55:0/2063536976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ecc06f8e0 msgr2=0x7f8ecc0c2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.103+0000 7f8ed1093640 1 --2- 172.21.15.55:0/2063536976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ecc06f8e0 0x7f8ecc0c2ec0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00c550 tx=0x7f8ebc00c950 comp rx=0 tx=0).stop 2023-07-06T21:54:57.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.103+0000 7f8ed1093640 1 -- 172.21.15.55:0/2063536976 shutdown_connections 2023-07-06T21:54:57.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.103+0000 7f8ed1093640 1 --2- 172.21.15.55:0/2063536976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ecc15cc00 0x7f8ecc152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.103+0000 7f8ed1093640 1 --2- 172.21.15.55:0/2063536976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ecc15bc40 0x7f8ecc151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.103+0000 7f8ed1093640 1 --2- 172.21.15.55:0/2063536976 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f8eb80663a0 0x7f8eb8068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.103+0000 7f8ed1093640 1 --2- 172.21.15.55:0/2063536976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ecc06f8e0 0x7f8ecc0c2ec0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.103+0000 7f8ed1093640 1 -- 172.21.15.55:0/2063536976 >> 172.21.15.55:0/2063536976 conn(0x7f8ecc0cbd80 msgr2=0x7f8ecc15df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:57.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.103+0000 7f8ed1093640 1 -- 172.21.15.55:0/2063536976 shutdown_connections 2023-07-06T21:54:57.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.103+0000 7f8ed1093640 1 -- 172.21.15.55:0/2063536976 wait complete. 2023-07-06T21:54:57.120 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:54:57.121 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:54:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5ccd0cb640 1 Processor -- start 2023-07-06T21:54:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5ccd0cb640 1 -- start start 2023-07-06T21:54:57.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5ccd0cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cc80d1c40 0x7f5cc80b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5ccd0cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5cc80b4130 0x7f5cc80b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5ccd0cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc80b5070 con 0x7f5cc80b7b90 2023-07-06T21:54:57.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5ccd0cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc80b45b0 con 0x7f5cc80b4130 2023-07-06T21:54:57.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5ccd0cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc8160020 con 0x7f5cc80d1c40 2023-07-06T21:54:57.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5cc759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5cc80b4130 0x7f5cc80b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5cc759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5cc80b4130 0x7f5cc80b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53986/0 (socket says 172.21.15.55:53986) 2023-07-06T21:54:57.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5cc759e640 1 -- 172.21.15.55:0/90717398 learned_addr learned my addr 172.21.15.55:0/90717398 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:57.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5cc6d9d640 1 --1- 172.21.15.55:0/90717398 >> v1:172.21.15.138:6789/0 conn(0x7f5cc80b7b90 0x7f5cc80cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:34144/0 (socket says 172.21.15.55:34144) 2023-07-06T21:54:57.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5cc659c640 1 --2- 172.21.15.55:0/90717398 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cc80d1c40 0x7f5cc80b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5cc759e640 1 -- 172.21.15.55:0/90717398 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cc80d1c40 msgr2=0x7f5cc80b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:57.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5cc759e640 1 --2- 172.21.15.55:0/90717398 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cc80d1c40 0x7f5cc80b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5cc759e640 1 -- 172.21.15.55:0/90717398 >> v1:172.21.15.138:6789/0 conn(0x7f5cc80b7b90 legacy=0x7f5cc80cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5cc759e640 1 -- 172.21.15.55:0/90717398 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc80d2090 con 0x7f5cc80b4130 2023-07-06T21:54:57.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.267+0000 7f5cc5d9b640 1 -- 172.21.15.55:0/90717398 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781457818 0 0) 0x7f5cc80b5070 con 0x7f5cc80b7b90 2023-07-06T21:54:57.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.271+0000 7f5cc759e640 1 --2- 172.21.15.55:0/90717398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cc80b4130 0x7f5cc80b1af0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009e50 tx=0x7f5cc001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f5691543b9dc0f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:57.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.271+0000 7f5cc5d9b640 1 -- 172.21.15.55:0/90717398 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00a57d0 con 0x7f5cc80b4130 2023-07-06T21:54:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.271+0000 7f5cc5d9b640 1 -- 172.21.15.55:0/90717398 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc00a5930 con 0x7f5cc80b4130 2023-07-06T21:54:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.271+0000 7f5cc5d9b640 1 -- 172.21.15.55:0/90717398 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00a5cc0 con 0x7f5cc80b4130 2023-07-06T21:54:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.271+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/90717398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cc80b4130 msgr2=0x7f5cc80b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.271+0000 7f5ccd0cb640 1 --2- 172.21.15.55:0/90717398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cc80b4130 0x7f5cc80b1af0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009e50 tx=0x7f5cc001ca10 comp rx=0 tx=0).stop 2023-07-06T21:54:57.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.271+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/90717398 shutdown_connections 2023-07-06T21:54:57.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.271+0000 7f5ccd0cb640 1 --2- 172.21.15.55:0/90717398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cc80b4130 0x7f5cc80b1af0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.271+0000 7f5ccd0cb640 1 --2- 172.21.15.55:0/90717398 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cc80d1c40 0x7f5cc80b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.271+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/90717398 >> 172.21.15.55:0/90717398 conn(0x7f5cc80ceca0 msgr2=0x7f5cc80cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:57.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.271+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/90717398 shutdown_connections 2023-07-06T21:54:57.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.271+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/90717398 wait complete. 2023-07-06T21:54:57.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5ccd0cb640 1 Processor -- start 2023-07-06T21:54:57.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5ccd0cb640 1 -- start start 2023-07-06T21:54:57.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5ccd0cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cc80b4130 0x7f5cc815c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5ccd0cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cc80b7b90 0x7f5cc80c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5ccd0cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cc80d1c40 0x7f5cc813e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5ccd0cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc815ea20 con 0x7f5cc80b7b90 2023-07-06T21:54:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5ccd0cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc815e720 con 0x7f5cc80d1c40 2023-07-06T21:54:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5ccd0cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc81516b0 con 0x7f5cc80b4130 2023-07-06T21:54:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5cc659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cc80b7b90 0x7f5cc80c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5cc659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cc80b7b90 0x7f5cc80c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53990/0 (socket says 172.21.15.55:53990) 2023-07-06T21:54:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5cc659c640 1 -- 172.21.15.55:0/404654299 learned_addr learned my addr 172.21.15.55:0/404654299 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5cc6d9d640 1 --2- 172.21.15.55:0/404654299 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cc80b4130 0x7f5cc815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5cc759e640 1 --2- 172.21.15.55:0/404654299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cc80d1c40 0x7f5cc813e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5cc659c640 1 -- 172.21.15.55:0/404654299 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cc80b4130 msgr2=0x7f5cc815c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5cc659c640 1 --2- 172.21.15.55:0/404654299 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cc80b4130 0x7f5cc815c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5cc659c640 1 -- 172.21.15.55:0/404654299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cc80d1c40 msgr2=0x7f5cc813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5cc659c640 1 --2- 172.21.15.55:0/404654299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cc80d1c40 0x7f5cc813e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5cc659c640 1 -- 172.21.15.55:0/404654299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc0009b30 con 0x7f5cc80b7b90 2023-07-06T21:54:57.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5cc659c640 1 --2- 172.21.15.55:0/404654299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cc80b7b90 0x7f5cc80c86d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00e8a0 tx=0x7f5cbc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:57.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5caf7fe640 1 -- 172.21.15.55:0/404654299 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc009510 con 0x7f5cc80b7b90 2023-07-06T21:54:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5caf7fe640 1 -- 172.21.15.55:0/404654299 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc00c940 con 0x7f5cc80b7b90 2023-07-06T21:54:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/404654299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc8151990 con 0x7f5cc80b7b90 2023-07-06T21:54:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5caf7fe640 1 -- 172.21.15.55:0/404654299 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc00ccb0 con 0x7f5cc80b7b90 2023-07-06T21:54:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.275+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/404654299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc8151c70 con 0x7f5cc80b7b90 2023-07-06T21:54:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.279+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/404654299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc815ebd0 con 0x7f5cc80b7b90 2023-07-06T21:54:57.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.279+0000 7f5caf7fe640 1 -- 172.21.15.55:0/404654299 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5cbc013470 con 0x7f5cc80b7b90 2023-07-06T21:54:57.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.279+0000 7f5caf7fe640 1 --2- 172.21.15.55:0/404654299 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f5cb40663d0 0x7f5cb4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.279+0000 7f5caf7fe640 1 -- 172.21.15.55:0/404654299 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f5cbc083fc0 con 0x7f5cc80b7b90 2023-07-06T21:54:57.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.279+0000 7f5cc6d9d640 1 --2- 172.21.15.55:0/404654299 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f5cb40663d0 0x7f5cb4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.279+0000 7f5cc6d9d640 1 --2- 172.21.15.55:0/404654299 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f5cb40663d0 0x7f5cb4068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8000f70 tx=0x7f5cb8007b60 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:57.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.283+0000 7f5caf7fe640 1 -- 172.21.15.55:0/404654299 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5cc815ebd0 con 0x7f5cc80b7b90 2023-07-06T21:54:57.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.439+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/404654299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5cc815ebd0 con 0x7f5cc80b7b90 2023-07-06T21:54:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.439+0000 7f5caf7fe640 1 -- 172.21.15.55:0/404654299 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5cc815ebd0 con 0x7f5cc80b7b90 2023-07-06T21:54:57.441 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:54:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.443+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/404654299 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f5cb40663d0 msgr2=0x7f5cb4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.443+0000 7f5ccd0cb640 1 --2- 172.21.15.55:0/404654299 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f5cb40663d0 0x7f5cb4068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8000f70 tx=0x7f5cb8007b60 comp rx=0 tx=0).stop 2023-07-06T21:54:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.443+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/404654299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cc80b7b90 msgr2=0x7f5cc80c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.443+0000 7f5ccd0cb640 1 --2- 172.21.15.55:0/404654299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cc80b7b90 0x7f5cc80c86d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00e8a0 tx=0x7f5cbc00eca0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.443+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/404654299 shutdown_connections 2023-07-06T21:54:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.443+0000 7f5ccd0cb640 1 --2- 172.21.15.55:0/404654299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cc80d1c40 0x7f5cc813e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.443+0000 7f5ccd0cb640 1 --2- 172.21.15.55:0/404654299 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f5cb40663d0 0x7f5cb4068880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.443+0000 7f5ccd0cb640 1 --2- 172.21.15.55:0/404654299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cc80b7b90 0x7f5cc80c86d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.443+0000 7f5ccd0cb640 1 --2- 172.21.15.55:0/404654299 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cc80b4130 0x7f5cc815c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.443+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/404654299 >> 172.21.15.55:0/404654299 conn(0x7f5cc80ceca0 msgr2=0x7f5cc8152200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.443+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/404654299 shutdown_connections 2023-07-06T21:54:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.443+0000 7f5ccd0cb640 1 -- 172.21.15.55:0/404654299 wait complete. 2023-07-06T21:54:57.462 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:54:57.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.606+0000 7ff282f74640 1 Processor -- start 2023-07-06T21:54:57.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.606+0000 7ff282f74640 1 -- start start 2023-07-06T21:54:57.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.606+0000 7ff282f74640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff27c0ca130 0x7ff27c0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.606+0000 7ff282f74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff27c0cd140 0x7ff27c070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.606+0000 7ff282f74640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27c158c20 con 0x7ff27c158850 2023-07-06T21:54:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.606+0000 7ff282f74640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27c0b2aa0 con 0x7ff27c0ca130 2023-07-06T21:54:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.606+0000 7ff282f74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0c8db0 con 0x7ff27c0cd140 2023-07-06T21:54:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.606+0000 7ff280d10640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff27c158850 0x7ff27c0cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35774/0 (socket says 172.21.15.55:35774) 2023-07-06T21:54:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.606+0000 7ff280d10640 1 -- 172.21.15.55:0/3685496720 learned_addr learned my addr 172.21.15.55:0/3685496720 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.610+0000 7ff27bfff640 1 --2- 172.21.15.55:0/3685496720 >> v2:172.21.15.138:3300/0 conn(0x7ff27c0ca130 0x7ff27c0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.610+0000 7ff281511640 1 --2- 172.21.15.55:0/3685496720 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff27c0cd140 0x7ff27c070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.610+0000 7ff27b7fe640 1 -- 172.21.15.55:0/3685496720 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465055495 0 0) 0x7ff27c158c20 con 0x7ff27c158850 2023-07-06T21:54:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.610+0000 7ff27b7fe640 1 -- 172.21.15.55:0/3685496720 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff26c003530 con 0x7ff27c158850 2023-07-06T21:54:57.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.610+0000 7ff27bfff640 1 -- 172.21.15.55:0/3685496720 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff27c0cd140 msgr2=0x7ff27c070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:57.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.610+0000 7ff27bfff640 1 --2- 172.21.15.55:0/3685496720 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff27c0cd140 0x7ff27c070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.610+0000 7ff27bfff640 1 -- 172.21.15.55:0/3685496720 >> v1:172.21.15.55:6789/0 conn(0x7ff27c158850 legacy=0x7ff27c0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.610+0000 7ff27bfff640 1 -- 172.21.15.55:0/3685496720 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c0c9090 con 0x7ff27c0ca130 2023-07-06T21:54:57.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.610+0000 7ff281511640 1 --2- 172.21.15.55:0/3685496720 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff27c0cd140 0x7ff27c070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:57.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.610+0000 7ff27bfff640 1 --2- 172.21.15.55:0/3685496720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff27c0ca130 0x7ff27c0703e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff2680097c0 tx=0x7ff26801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31dff14803344d45 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:57.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.610+0000 7ff27b7fe640 1 -- 172.21.15.55:0/3685496720 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2680a8970 con 0x7ff27c0ca130 2023-07-06T21:54:57.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.610+0000 7ff27b7fe640 1 -- 172.21.15.55:0/3685496720 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2680a8ad0 con 0x7ff27c0ca130 2023-07-06T21:54:57.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.610+0000 7ff27b7fe640 1 -- 172.21.15.55:0/3685496720 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2680a8e60 con 0x7ff27c0ca130 2023-07-06T21:54:57.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 -- 172.21.15.55:0/3685496720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff27c0ca130 msgr2=0x7ff27c0703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 --2- 172.21.15.55:0/3685496720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff27c0ca130 0x7ff27c0703e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff2680097c0 tx=0x7ff26801ec70 comp rx=0 tx=0).stop 2023-07-06T21:54:57.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 -- 172.21.15.55:0/3685496720 shutdown_connections 2023-07-06T21:54:57.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 --2- 172.21.15.55:0/3685496720 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff27c0cd140 0x7ff27c070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 --2- 172.21.15.55:0/3685496720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff27c0ca130 0x7ff27c0703e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 -- 172.21.15.55:0/3685496720 >> 172.21.15.55:0/3685496720 conn(0x7ff27c0cea70 msgr2=0x7ff27c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:57.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 -- 172.21.15.55:0/3685496720 shutdown_connections 2023-07-06T21:54:57.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 -- 172.21.15.55:0/3685496720 wait complete. 2023-07-06T21:54:57.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 Processor -- start 2023-07-06T21:54:57.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 -- start start 2023-07-06T21:54:57.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff27c0ca130 0x7ff27c1e57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff27c0cd140 0x7ff27c156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff27c158850 0x7ff27c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c157210 con 0x7ff27c0cd140 2023-07-06T21:54:57.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c069590 con 0x7ff27c0ca130 2023-07-06T21:54:57.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff282f74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c069870 con 0x7ff27c158850 2023-07-06T21:54:57.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff27bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff27c0cd140 0x7ff27c156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff280d10640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff27c0ca130 0x7ff27c1e57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff27bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff27c0cd140 0x7ff27c156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54004/0 (socket says 172.21.15.55:54004) 2023-07-06T21:54:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff27bfff640 1 -- 172.21.15.55:0/3214942565 learned_addr learned my addr 172.21.15.55:0/3214942565 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.614+0000 7ff281511640 1 --2- 172.21.15.55:0/3214942565 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff27c158850 0x7ff27c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff27bfff640 1 -- 172.21.15.55:0/3214942565 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff27c158850 msgr2=0x7ff27c0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff27bfff640 1 --2- 172.21.15.55:0/3214942565 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff27c158850 0x7ff27c0c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff27bfff640 1 -- 172.21.15.55:0/3214942565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff27c0ca130 msgr2=0x7ff27c1e57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff27bfff640 1 --2- 172.21.15.55:0/3214942565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff27c0ca130 0x7ff27c1e57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff27bfff640 1 -- 172.21.15.55:0/3214942565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274009a70 con 0x7ff27c0cd140 2023-07-06T21:54:57.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff27bfff640 1 --2- 172.21.15.55:0/3214942565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff27c0cd140 0x7ff27c156cd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff2680b3040 tx=0x7ff26801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:57.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff2797fa640 1 -- 172.21.15.55:0/3214942565 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2680b0d60 con 0x7ff27c0cd140 2023-07-06T21:54:57.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff2797fa640 1 -- 172.21.15.55:0/3214942565 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff268006e20 con 0x7ff27c0cd140 2023-07-06T21:54:57.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff2797fa640 1 -- 172.21.15.55:0/3214942565 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2680b9670 con 0x7ff27c0cd140 2023-07-06T21:54:57.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff282f74640 1 -- 172.21.15.55:0/3214942565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff268009420 con 0x7ff27c0cd140 2023-07-06T21:54:57.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff282f74640 1 -- 172.21.15.55:0/3214942565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27c069e30 con 0x7ff27c0cd140 2023-07-06T21:54:57.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff282f74640 1 -- 172.21.15.55:0/3214942565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27c06a020 con 0x7ff27c0cd140 2023-07-06T21:54:57.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff2797fa640 1 -- 172.21.15.55:0/3214942565 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff2680b7040 con 0x7ff27c0cd140 2023-07-06T21:54:57.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff2797fa640 1 --2- 172.21.15.55:0/3214942565 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ff2600663d0 0x7ff260068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.618+0000 7ff2797fa640 1 -- 172.21.15.55:0/3214942565 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6261+0+0 (secure 0 0 0) 0x7ff2681218b0 con 0x7ff27c0cd140 2023-07-06T21:54:57.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.622+0000 7ff280d10640 1 --2- 172.21.15.55:0/3214942565 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ff2600663d0 0x7ff260068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.622+0000 7ff280d10640 1 --2- 172.21.15.55:0/3214942565 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ff2600663d0 0x7ff260068880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff2700011f0 tx=0x7ff270007d40 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.622+0000 7ff2797fa640 1 -- 172.21.15.55:0/3214942565 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff2680eeb50 con 0x7ff27c0cd140 2023-07-06T21:54:57.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.782+0000 7ff282f74640 1 -- 172.21.15.55:0/3214942565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff27c066d60 con 0x7ff27c0cd140 2023-07-06T21:54:57.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.782+0000 7ff2797fa640 1 -- 172.21.15.55:0/3214942565 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff2680f2170 con 0x7ff27c0cd140 2023-07-06T21:54:57.782 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:54:57.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.782+0000 7ff282f74640 1 -- 172.21.15.55:0/3214942565 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ff2600663d0 msgr2=0x7ff260068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.782+0000 7ff282f74640 1 --2- 172.21.15.55:0/3214942565 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ff2600663d0 0x7ff260068880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff2700011f0 tx=0x7ff270007d40 comp rx=0 tx=0).stop 2023-07-06T21:54:57.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.782+0000 7ff282f74640 1 -- 172.21.15.55:0/3214942565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff27c0cd140 msgr2=0x7ff27c156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.782+0000 7ff282f74640 1 --2- 172.21.15.55:0/3214942565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff27c0cd140 0x7ff27c156cd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff2680b3040 tx=0x7ff26801ba10 comp rx=0 tx=0).stop 2023-07-06T21:54:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.782+0000 7ff282f74640 1 -- 172.21.15.55:0/3214942565 shutdown_connections 2023-07-06T21:54:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.782+0000 7ff282f74640 1 --2- 172.21.15.55:0/3214942565 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff27c158850 0x7ff27c0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.782+0000 7ff282f74640 1 --2- 172.21.15.55:0/3214942565 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ff2600663d0 0x7ff260068880 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.782+0000 7ff282f74640 1 --2- 172.21.15.55:0/3214942565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff27c0cd140 0x7ff27c156cd0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.782+0000 7ff282f74640 1 --2- 172.21.15.55:0/3214942565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff27c0ca130 0x7ff27c1e57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.782+0000 7ff282f74640 1 -- 172.21.15.55:0/3214942565 >> 172.21.15.55:0/3214942565 conn(0x7ff27c0cea70 msgr2=0x7ff27c09db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:57.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.782+0000 7ff282f74640 1 -- 172.21.15.55:0/3214942565 shutdown_connections 2023-07-06T21:54:57.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.782+0000 7ff282f74640 1 -- 172.21.15.55:0/3214942565 wait complete. 2023-07-06T21:54:57.803 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-06T21:54:57.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e9086d640 1 Processor -- start 2023-07-06T21:54:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e9086d640 1 -- start start 2023-07-06T21:54:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e9086d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e8c0ca130 0x7f3e8c0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e9086d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3e8c0cd140 0x7f3e8c070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e9086d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8c158c20 con 0x7f3e8c158850 2023-07-06T21:54:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e9086d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8c0b2aa0 con 0x7f3e8c0cd140 2023-07-06T21:54:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e9086d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c0c8db0 con 0x7f3e8c0ca130 2023-07-06T21:54:57.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e8ad9d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3e8c0cd140 0x7f3e8c070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e83fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e8c0ca130 0x7f3e8c0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e8a59c640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f3e8c158850 0x7f3e8c0cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:34156/0 (socket says 172.21.15.55:34156) 2023-07-06T21:54:57.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e8a59c640 1 -- 172.21.15.55:0/2406250705 learned_addr learned my addr 172.21.15.55:0/2406250705 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:54:57.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e83fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e8c0ca130 0x7f3e8c0703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44456/0 (socket says 172.21.15.55:44456) 2023-07-06T21:54:57.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e8ad9d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3e8c0cd140 0x7f3e8c070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:56970/0 (socket says 172.21.15.55:56970) 2023-07-06T21:54:57.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e83fff640 1 -- 172.21.15.55:0/2406250705 >> v2:172.21.15.138:3300/0 conn(0x7f3e8c0cd140 msgr2=0x7f3e8c070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:57.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e83fff640 1 --2- 172.21.15.55:0/2406250705 >> v2:172.21.15.138:3300/0 conn(0x7f3e8c0cd140 0x7f3e8c070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e83fff640 1 -- 172.21.15.55:0/2406250705 >> v1:172.21.15.138:6789/0 conn(0x7f3e8c158850 legacy=0x7f3e8c0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e89d9b640 1 -- 172.21.15.55:0/2406250705 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365660926 0 0) 0x7f3e8c158c20 con 0x7f3e8c158850 2023-07-06T21:54:57.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e83fff640 1 -- 172.21.15.55:0/2406250705 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c0c9090 con 0x7f3e8c0ca130 2023-07-06T21:54:57.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.950+0000 7f3e8ad9d640 1 --2- 172.21.15.55:0/2406250705 >> v2:172.21.15.138:3300/0 conn(0x7f3e8c0cd140 0x7f3e8c070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:54:57.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.954+0000 7f3e83fff640 1 --2- 172.21.15.55:0/2406250705 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e8c0ca130 0x7f3e8c0703e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400ba60 tx=0x7f3e7401ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8212d35e3b9c8423 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:57.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.954+0000 7f3e89d9b640 1 -- 172.21.15.55:0/2406250705 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e740a89f0 con 0x7f3e8c0ca130 2023-07-06T21:54:57.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.954+0000 7f3e89d9b640 1 -- 172.21.15.55:0/2406250705 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e740a8b50 con 0x7f3e8c0ca130 2023-07-06T21:54:57.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.954+0000 7f3e89d9b640 1 -- 172.21.15.55:0/2406250705 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e740b0440 con 0x7f3e8c0ca130 2023-07-06T21:54:57.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.954+0000 7f3e9086d640 1 -- 172.21.15.55:0/2406250705 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e8c0ca130 msgr2=0x7f3e8c0703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.954+0000 7f3e9086d640 1 --2- 172.21.15.55:0/2406250705 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e8c0ca130 0x7f3e8c0703e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400ba60 tx=0x7f3e7401ebe0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.954+0000 7f3e9086d640 1 -- 172.21.15.55:0/2406250705 shutdown_connections 2023-07-06T21:54:57.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.954+0000 7f3e9086d640 1 --2- 172.21.15.55:0/2406250705 >> v2:172.21.15.138:3300/0 conn(0x7f3e8c0cd140 0x7f3e8c070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.954+0000 7f3e9086d640 1 --2- 172.21.15.55:0/2406250705 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e8c0ca130 0x7f3e8c0703e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.954+0000 7f3e9086d640 1 -- 172.21.15.55:0/2406250705 >> 172.21.15.55:0/2406250705 conn(0x7f3e8c0cea70 msgr2=0x7f3e8c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:57.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.954+0000 7f3e9086d640 1 -- 172.21.15.55:0/2406250705 shutdown_connections 2023-07-06T21:54:57.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.954+0000 7f3e9086d640 1 -- 172.21.15.55:0/2406250705 wait complete. 2023-07-06T21:54:57.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e9086d640 1 Processor -- start 2023-07-06T21:54:57.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e9086d640 1 -- start start 2023-07-06T21:54:57.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e9086d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e8c0ca130 0x7f3e8c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e9086d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e8c0cd140 0x7f3e8c06b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e9086d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e8c158850 0x7f3e8c06b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e9086d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c154340 con 0x7f3e8c158850 2023-07-06T21:54:57.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e9086d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c06bdd0 con 0x7f3e8c0ca130 2023-07-06T21:54:57.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e9086d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c06c080 con 0x7f3e8c0cd140 2023-07-06T21:54:57.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e8ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e8c158850 0x7f3e8c06b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e8ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e8c158850 0x7f3e8c06b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54010/0 (socket says 172.21.15.55:54010) 2023-07-06T21:54:57.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e8ad9d640 1 -- 172.21.15.55:0/1979748658 learned_addr learned my addr 172.21.15.55:0/1979748658 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:57.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e8a59c640 1 --2- 172.21.15.55:0/1979748658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e8c0ca130 0x7f3e8c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e83fff640 1 --2- 172.21.15.55:0/1979748658 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e8c0cd140 0x7f3e8c06b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e8ad9d640 1 -- 172.21.15.55:0/1979748658 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e8c0cd140 msgr2=0x7f3e8c06b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e8ad9d640 1 --2- 172.21.15.55:0/1979748658 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e8c0cd140 0x7f3e8c06b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e8ad9d640 1 -- 172.21.15.55:0/1979748658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e8c0ca130 msgr2=0x7f3e8c1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:57.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e8ad9d640 1 --2- 172.21.15.55:0/1979748658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e8c0ca130 0x7f3e8c1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:57.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e8ad9d640 1 -- 172.21.15.55:0/1979748658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84009a70 con 0x7f3e8c158850 2023-07-06T21:54:57.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e8ad9d640 1 --2- 172.21.15.55:0/1979748658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e8c158850 0x7f3e8c06b890 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400efc0 tx=0x7f3e84009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:57.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e82ffd640 1 -- 172.21.15.55:0/1979748658 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84009d70 con 0x7f3e8c158850 2023-07-06T21:54:57.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e82ffd640 1 -- 172.21.15.55:0/1979748658 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8400f040 con 0x7f3e8c158850 2023-07-06T21:54:57.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e9086d640 1 -- 172.21.15.55:0/1979748658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7400b6c0 con 0x7f3e8c158850 2023-07-06T21:54:57.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e82ffd640 1 -- 172.21.15.55:0/1979748658 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e840039a0 con 0x7f3e8c158850 2023-07-06T21:54:57.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e9086d640 1 -- 172.21.15.55:0/1979748658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8c153c80 con 0x7f3e8c158850 2023-07-06T21:54:57.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.958+0000 7f3e9086d640 1 -- 172.21.15.55:0/1979748658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8c154480 con 0x7f3e8c158850 2023-07-06T21:54:57.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.962+0000 7f3e82ffd640 1 -- 172.21.15.55:0/1979748658 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3e840144a0 con 0x7f3e8c158850 2023-07-06T21:54:57.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.962+0000 7f3e82ffd640 1 --2- 172.21.15.55:0/1979748658 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f3e6c0663d0 0x7f3e6c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:57.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.962+0000 7f3e82ffd640 1 -- 172.21.15.55:0/1979748658 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f3e84084e10 con 0x7f3e8c158850 2023-07-06T21:54:57.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.962+0000 7f3e8a59c640 1 --2- 172.21.15.55:0/1979748658 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f3e6c0663d0 0x7f3e6c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:57.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.962+0000 7f3e8a59c640 1 --2- 172.21.15.55:0/1979748658 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f3e6c0663d0 0x7f3e6c068880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c000f70 tx=0x7f3e7c007c10 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:57.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:57.966+0000 7f3e82ffd640 1 -- 172.21.15.55:0/1979748658 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3e8c154480 con 0x7f3e8c158850 2023-07-06T21:54:58.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.122+0000 7f3e9086d640 1 -- 172.21.15.55:0/1979748658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3e8c154480 con 0x7f3e8c158850 2023-07-06T21:54:58.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.130+0000 7f3e82ffd640 1 -- 172.21.15.55:0/1979748658 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3e8c154480 con 0x7f3e8c158850 2023-07-06T21:54:58.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.130+0000 7f3e9086d640 1 -- 172.21.15.55:0/1979748658 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f3e6c0663d0 msgr2=0x7f3e6c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:58.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.130+0000 7f3e9086d640 1 --2- 172.21.15.55:0/1979748658 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f3e6c0663d0 0x7f3e6c068880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c000f70 tx=0x7f3e7c007c10 comp rx=0 tx=0).stop 2023-07-06T21:54:58.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.130+0000 7f3e9086d640 1 -- 172.21.15.55:0/1979748658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e8c158850 msgr2=0x7f3e8c06b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:58.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.130+0000 7f3e9086d640 1 --2- 172.21.15.55:0/1979748658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e8c158850 0x7f3e8c06b890 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400efc0 tx=0x7f3e84009f90 comp rx=0 tx=0).stop 2023-07-06T21:54:58.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.130+0000 7f3e9086d640 1 -- 172.21.15.55:0/1979748658 shutdown_connections 2023-07-06T21:54:58.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.130+0000 7f3e9086d640 1 --2- 172.21.15.55:0/1979748658 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f3e6c0663d0 0x7f3e6c068880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.130+0000 7f3e9086d640 1 --2- 172.21.15.55:0/1979748658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e8c158850 0x7f3e8c06b890 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.130+0000 7f3e9086d640 1 --2- 172.21.15.55:0/1979748658 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e8c0cd140 0x7f3e8c06b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.130+0000 7f3e9086d640 1 --2- 172.21.15.55:0/1979748658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e8c0ca130 0x7f3e8c1563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.130+0000 7f3e9086d640 1 -- 172.21.15.55:0/1979748658 >> 172.21.15.55:0/1979748658 conn(0x7f3e8c0cea70 msgr2=0x7f3e8c09d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:58.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.130+0000 7f3e9086d640 1 -- 172.21.15.55:0/1979748658 shutdown_connections 2023-07-06T21:54:58.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.130+0000 7f3e9086d640 1 -- 172.21.15.55:0/1979748658 wait complete. 2023-07-06T21:54:58.151 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T21:54:58.152 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:54:58.219 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:54:58.272 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T21:54:58.272 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:54:58.272 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:54:58.281 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T21:54:58.281 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:54:58.282 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:54:58.290 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:54:58.291 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:54:58.291 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:54:58.332 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T21:54:58.333 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:54:58.333 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:54:58.342 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:54:58.342 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-06T21:54:58.342 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:54:58.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd268496640 1 Processor -- start 2023-07-06T21:54:58.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd268496640 1 -- start start 2023-07-06T21:54:58.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd268496640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd2600b7cd0 0x7fd2600ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:58.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd268496640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd2600ccab0 0x7fd2600b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:58.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd268496640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2600ccf00 0x7fd2600b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:58.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd268496640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2600d2310 con 0x7fd2600b7cd0 2023-07-06T21:54:58.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd268496640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2600b80a0 con 0x7fd2600ccab0 2023-07-06T21:54:58.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd268496640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600d1100 con 0x7fd2600ccf00 2023-07-06T21:54:58.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd266232640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd2600b7cd0 0x7fd2600ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:58.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd266232640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd2600b7cd0 0x7fd2600ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54014/0 (socket says 172.21.15.55:54014) 2023-07-06T21:54:58.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd266232640 1 -- 172.21.15.55:0/1797120571 learned_addr learned my addr 172.21.15.55:0/1797120571 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:58.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd265a31640 1 --2- 172.21.15.55:0/1797120571 >> v2:172.21.15.138:3300/0 conn(0x7fd2600ccab0 0x7fd2600b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:58.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd266232640 1 -- 172.21.15.55:0/1797120571 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2600ccf00 msgr2=0x7fd2600b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:58.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd266232640 1 --2- 172.21.15.55:0/1797120571 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2600ccf00 0x7fd2600b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd266232640 1 -- 172.21.15.55:0/1797120571 >> v2:172.21.15.138:3300/0 conn(0x7fd2600ccab0 msgr2=0x7fd2600b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd266232640 1 --2- 172.21.15.55:0/1797120571 >> v2:172.21.15.138:3300/0 conn(0x7fd2600ccab0 0x7fd2600b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd266232640 1 -- 172.21.15.55:0/1797120571 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2600cecf0 con 0x7fd2600b7cd0 2023-07-06T21:54:58.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.514+0000 7fd265a31640 1 --2- 172.21.15.55:0/1797120571 >> v2:172.21.15.138:3300/0 conn(0x7fd2600ccab0 0x7fd2600b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:54:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.518+0000 7fd266232640 1 --2- 172.21.15.55:0/1797120571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2600b7cd0 0x7fd2600ce610 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd260065af0 tx=0x7fd25c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e079891f1792ef server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.518+0000 7fd265230640 1 -- 172.21.15.55:0/1797120571 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c0ab600 con 0x7fd2600b7cd0 2023-07-06T21:54:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.518+0000 7fd265230640 1 -- 172.21.15.55:0/1797120571 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c0a7050 con 0x7fd2600b7cd0 2023-07-06T21:54:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.518+0000 7fd265230640 1 -- 172.21.15.55:0/1797120571 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c0ab980 con 0x7fd2600b7cd0 2023-07-06T21:54:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.518+0000 7fd268496640 1 -- 172.21.15.55:0/1797120571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2600b7cd0 msgr2=0x7fd2600ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.518+0000 7fd268496640 1 --2- 172.21.15.55:0/1797120571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2600b7cd0 0x7fd2600ce610 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd260065af0 tx=0x7fd25c01c470 comp rx=0 tx=0).stop 2023-07-06T21:54:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.518+0000 7fd268496640 1 -- 172.21.15.55:0/1797120571 shutdown_connections 2023-07-06T21:54:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.518+0000 7fd268496640 1 --2- 172.21.15.55:0/1797120571 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2600ccf00 0x7fd2600b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.518+0000 7fd268496640 1 --2- 172.21.15.55:0/1797120571 >> v2:172.21.15.138:3300/0 conn(0x7fd2600ccab0 0x7fd2600b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.518+0000 7fd268496640 1 --2- 172.21.15.55:0/1797120571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2600b7cd0 0x7fd2600ce610 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.518+0000 7fd268496640 1 -- 172.21.15.55:0/1797120571 >> 172.21.15.55:0/1797120571 conn(0x7fd2600ceee0 msgr2=0x7fd2600cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.518+0000 7fd268496640 1 -- 172.21.15.55:0/1797120571 shutdown_connections 2023-07-06T21:54:58.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.518+0000 7fd268496640 1 -- 172.21.15.55:0/1797120571 wait complete. 2023-07-06T21:54:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd268496640 1 Processor -- start 2023-07-06T21:54:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd268496640 1 -- start start 2023-07-06T21:54:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd268496640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2600b7cd0 0x7fd26015eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd268496640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2600ccab0 0x7fd26015cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd268496640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2600ccf00 0x7fd260152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd268496640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2601575c0 con 0x7fd2600ccab0 2023-07-06T21:54:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd268496640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2601569b0 con 0x7fd2600ccf00 2023-07-06T21:54:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd268496640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd260156c90 con 0x7fd2600b7cd0 2023-07-06T21:54:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd265a31640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2600ccab0 0x7fd26015cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd265a31640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2600ccab0 0x7fd26015cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54030/0 (socket says 172.21.15.55:54030) 2023-07-06T21:54:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd265a31640 1 -- 172.21.15.55:0/1159952894 learned_addr learned my addr 172.21.15.55:0/1159952894 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd266232640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2600b7cd0 0x7fd26015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd266a33640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2600ccf00 0x7fd260152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd265a31640 1 -- 172.21.15.55:0/1159952894 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2600b7cd0 msgr2=0x7fd26015eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd265a31640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2600b7cd0 0x7fd26015eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd265a31640 1 -- 172.21.15.55:0/1159952894 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2600ccf00 msgr2=0x7fd260152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd265a31640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2600ccf00 0x7fd260152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd265a31640 1 -- 172.21.15.55:0/1159952894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c0094d0 con 0x7fd2600ccab0 2023-07-06T21:54:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd266232640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2600b7cd0 0x7fd26015eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:54:58.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd265a31640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2600ccab0 0x7fd26015cf30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd25000c7c0 tx=0x7fd25000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd256ffd640 1 -- 172.21.15.55:0/1159952894 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250007a30 con 0x7fd2600ccab0 2023-07-06T21:54:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd256ffd640 1 -- 172.21.15.55:0/1159952894 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd250007b90 con 0x7fd2600ccab0 2023-07-06T21:54:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd256ffd640 1 -- 172.21.15.55:0/1159952894 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25000ce70 con 0x7fd2600ccab0 2023-07-06T21:54:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd268496640 1 -- 172.21.15.55:0/1159952894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd260156f70 con 0x7fd2600ccab0 2023-07-06T21:54:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd268496640 1 -- 172.21.15.55:0/1159952894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd26015f1e0 con 0x7fd2600ccab0 2023-07-06T21:54:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.522+0000 7fd268496640 1 -- 172.21.15.55:0/1159952894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd260066d60 con 0x7fd2600ccab0 2023-07-06T21:54:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.526+0000 7fd256ffd640 1 -- 172.21.15.55:0/1159952894 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd2500113f0 con 0x7fd2600ccab0 2023-07-06T21:54:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.526+0000 7fd256ffd640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd2440663a0 0x7fd244068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.526+0000 7fd256ffd640 1 -- 172.21.15.55:0/1159952894 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fd250084540 con 0x7fd2600ccab0 2023-07-06T21:54:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.526+0000 7fd266232640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd2440663a0 0x7fd244068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.526+0000 7fd266232640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd2440663a0 0x7fd244068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0ad000 tx=0x7fd25c0a6000 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:58.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.530+0000 7fd256ffd640 1 -- 172.21.15.55:0/1159952894 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2500516d0 con 0x7fd2600ccab0 2023-07-06T21:54:58.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.718+0000 7fd268496640 1 -- 172.21.15.55:0/1159952894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2600b7090 con 0x7fd2600ccab0 2023-07-06T21:54:58.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.718+0000 7fd256ffd640 1 -- 172.21.15.55:0/1159952894 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fd25001ede0 con 0x7fd2600ccab0 2023-07-06T21:54:58.718 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:54:58.718 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2166228749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2166228749},{"type":"v1","addr":"172.21.15.138:6834","nonce":2166228749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3702805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3702805788},{"type":"v1","addr":"172.21.15.138:6835","nonce":3702805788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2574870623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2574870623},{"type":"v1","addr":"172.21.15.55:6836","nonce":2574870623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":6249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3676070579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3676070579},{"type":"v1","addr":"172.21.15.55:6837","nonce":3676070579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-07-06T21:54:58.718 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 19 2023-07-06T21:54:58.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.718+0000 7fd268496640 1 -- 172.21.15.55:0/1159952894 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd2440663a0 msgr2=0x7fd244068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:58.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.718+0000 7fd268496640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd2440663a0 0x7fd244068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0ad000 tx=0x7fd25c0a6000 comp rx=0 tx=0).stop 2023-07-06T21:54:58.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.718+0000 7fd268496640 1 -- 172.21.15.55:0/1159952894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2600ccab0 msgr2=0x7fd26015cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:58.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.718+0000 7fd268496640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2600ccab0 0x7fd26015cf30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd25000c7c0 tx=0x7fd25000cc80 comp rx=0 tx=0).stop 2023-07-06T21:54:58.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.718+0000 7fd268496640 1 -- 172.21.15.55:0/1159952894 shutdown_connections 2023-07-06T21:54:58.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.718+0000 7fd268496640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2600ccf00 0x7fd260152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.718+0000 7fd268496640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd2440663a0 0x7fd244068850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.718+0000 7fd268496640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2600ccab0 0x7fd26015cf30 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.718+0000 7fd268496640 1 --2- 172.21.15.55:0/1159952894 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2600b7cd0 0x7fd26015eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.718+0000 7fd268496640 1 -- 172.21.15.55:0/1159952894 >> 172.21.15.55:0/1159952894 conn(0x7fd2600ceee0 msgr2=0x7fd2600cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:58.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.718+0000 7fd268496640 1 -- 172.21.15.55:0/1159952894 shutdown_connections 2023-07-06T21:54:58.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.718+0000 7fd268496640 1 -- 172.21.15.55:0/1159952894 wait complete. 2023-07-06T21:54:58.739 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T21:54:58.739 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-06T21:54:58.740 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T21:54:58.740 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:54:58.740 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T21:54:58.740 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-06T21:54:58.741 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T21:54:58.741 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:54:58.741 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T21:54:58.741 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-06T21:54:58.742 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T21:54:58.742 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:54:58.742 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T21:54:58.742 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-06T21:54:58.742 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T21:54:58.743 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:54:58.751 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T21:54:58.752 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T21:54:58.754 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T21:54:58.754 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T21:54:58.757 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T21:54:58.757 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T21:54:58.758 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T21:54:58.759 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T21:54:58.799 INFO:tasks.ceph.mds.a:Started 2023-07-06T21:54:58.799 DEBUG:teuthology.parallel:result is None 2023-07-06T21:54:58.801 INFO:tasks.ceph.mds.c:Started 2023-07-06T21:54:58.802 DEBUG:teuthology.parallel:result is None 2023-07-06T21:54:58.803 INFO:tasks.ceph.mds.b:Started 2023-07-06T21:54:58.803 DEBUG:teuthology.parallel:result is None 2023-07-06T21:54:58.806 INFO:tasks.ceph.mds.d:Started 2023-07-06T21:54:58.806 DEBUG:teuthology.parallel:result is None 2023-07-06T21:54:58.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-06T21:54:58.888 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-07-06T21:54:58.888 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T21:54:58.896 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-07-06T21:54:58.896 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-07-06T21:54:58.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.962+0000 7f6ebbfd2640 1 Processor -- start 2023-07-06T21:54:58.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.962+0000 7f6ebbfd2640 1 -- start start 2023-07-06T21:54:58.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.962+0000 7f6ebbfd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6eb4158850 0x7f6eb40cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:58.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.962+0000 7f6ebbfd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6eb4070af0 0x7f6eb40ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:58.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.962+0000 7f6ebbfd2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb4158c20 con 0x7f6eb40ca130 2023-07-06T21:54:58.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.962+0000 7f6ebbfd2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb40b2aa0 con 0x7f6eb4158850 2023-07-06T21:54:58.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.962+0000 7f6ebbfd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40c8db0 con 0x7f6eb4070af0 2023-07-06T21:54:58.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.966+0000 7f6eb9d6e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6eb4158850 0x7f6eb40cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:58.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.966+0000 7f6eb9d6e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6eb4158850 0x7f6eb40cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54062/0 (socket says 172.21.15.55:54062) 2023-07-06T21:54:58.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.966+0000 7f6eb9d6e640 1 -- 172.21.15.55:0/763383987 learned_addr learned my addr 172.21.15.55:0/763383987 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:58.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.966+0000 7f6eba56f640 1 --2- 172.21.15.55:0/763383987 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6eb4070af0 0x7f6eb40ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:58.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.966+0000 7f6eb9d6e640 1 -- 172.21.15.55:0/763383987 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6eb4070af0 msgr2=0x7f6eb40ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:54:58.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.966+0000 7f6eb9d6e640 1 --2- 172.21.15.55:0/763383987 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6eb4070af0 0x7f6eb40ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.966+0000 7f6eb9d6e640 1 -- 172.21.15.55:0/763383987 >> v1:172.21.15.138:6789/0 conn(0x7f6eb40ca130 legacy=0x7f6eb40703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:58.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.966+0000 7f6eb9d6e640 1 -- 172.21.15.55:0/763383987 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb40c9090 con 0x7f6eb4158850 2023-07-06T21:54:58.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.966+0000 7f6eb9d6e640 1 --2- 172.21.15.55:0/763383987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb4158850 0x7f6eb40cca30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009870 tx=0x7f6eb001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18ca863ecd6ee48 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:58.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.966+0000 7f6eb8d6c640 1 -- 172.21.15.55:0/763383987 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00a8a30 con 0x7f6eb4158850 2023-07-06T21:54:58.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.966+0000 7f6eb8d6c640 1 -- 172.21.15.55:0/763383987 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb00a8b90 con 0x7f6eb4158850 2023-07-06T21:54:58.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.966+0000 7f6eb8d6c640 1 -- 172.21.15.55:0/763383987 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00b0440 con 0x7f6eb4158850 2023-07-06T21:54:58.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/763383987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb4158850 msgr2=0x7f6eb40cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:58.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 --2- 172.21.15.55:0/763383987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb4158850 0x7f6eb40cca30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009870 tx=0x7f6eb001ed30 comp rx=0 tx=0).stop 2023-07-06T21:54:58.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/763383987 shutdown_connections 2023-07-06T21:54:58.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 --2- 172.21.15.55:0/763383987 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6eb4070af0 0x7f6eb40ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 --2- 172.21.15.55:0/763383987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb4158850 0x7f6eb40cca30 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/763383987 >> 172.21.15.55:0/763383987 conn(0x7f6eb40cea70 msgr2=0x7f6eb40ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:54:58.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/763383987 shutdown_connections 2023-07-06T21:54:58.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/763383987 wait complete. 2023-07-06T21:54:58.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 Processor -- start 2023-07-06T21:54:58.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 -- start start 2023-07-06T21:54:58.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6eb4070af0 0x7f6eb4157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:58.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6eb40ca130 0x7f6eb40c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:58.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb4158850 0x7f6eb40c0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:58.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4158440 con 0x7f6eb4158850 2023-07-06T21:54:58.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40c6360 con 0x7f6eb40ca130 2023-07-06T21:54:58.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6ebbfd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40c6640 con 0x7f6eb4070af0 2023-07-06T21:54:58.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6eb9d6e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6eb4070af0 0x7f6eb4157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:58.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6eb956d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6eb40ca130 0x7f6eb40c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:58.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6eba56f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb4158850 0x7f6eb40c0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:58.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6eb9d6e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6eb4070af0 0x7f6eb4157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44522/0 (socket says 172.21.15.55:44522) 2023-07-06T21:54:58.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.970+0000 7f6eb9d6e640 1 -- 172.21.15.55:0/1931899570 learned_addr learned my addr 172.21.15.55:0/1931899570 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:54:58.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.974+0000 7f6eb9d6e640 1 -- 172.21.15.55:0/1931899570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6eb40ca130 msgr2=0x7f6eb40c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:58.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.974+0000 7f6eb9d6e640 1 --2- 172.21.15.55:0/1931899570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6eb40ca130 0x7f6eb40c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.974+0000 7f6eb9d6e640 1 -- 172.21.15.55:0/1931899570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb4158850 msgr2=0x7f6eb40c0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:54:58.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.974+0000 7f6eb9d6e640 1 --2- 172.21.15.55:0/1931899570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb4158850 0x7f6eb40c0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:54:58.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.974+0000 7f6eb9d6e640 1 -- 172.21.15.55:0/1931899570 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb00094d0 con 0x7f6eb4070af0 2023-07-06T21:54:58.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.974+0000 7f6eb9d6e640 1 --2- 172.21.15.55:0/1931899570 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6eb4070af0 0x7f6eb4157f00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0000c10 tx=0x7f6eb001bad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:58.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.974+0000 7f6eaa7fc640 1 -- 172.21.15.55:0/1931899570 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00bf070 con 0x7f6eb4070af0 2023-07-06T21:54:58.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.974+0000 7f6eaa7fc640 1 -- 172.21.15.55:0/1931899570 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb00b1c90 con 0x7f6eb4070af0 2023-07-06T21:54:58.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.974+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/1931899570 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb40c6920 con 0x7f6eb4070af0 2023-07-06T21:54:58.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.974+0000 7f6eaa7fc640 1 -- 172.21.15.55:0/1931899570 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00b9410 con 0x7f6eb4070af0 2023-07-06T21:54:58.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.974+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/1931899570 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb4156080 con 0x7f6eb4070af0 2023-07-06T21:54:58.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.974+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/1931899570 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb4156270 con 0x7f6eb4070af0 2023-07-06T21:54:58.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.974+0000 7f6eaa7fc640 1 -- 172.21.15.55:0/1931899570 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6eb00b7040 con 0x7f6eb4070af0 2023-07-06T21:54:58.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.978+0000 7f6eaa7fc640 1 --2- 172.21.15.55:0/1931899570 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f6e980663a0 0x7f6e98068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:54:58.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.978+0000 7f6eaa7fc640 1 -- 172.21.15.55:0/1931899570 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f6eb01219a0 con 0x7f6eb4070af0 2023-07-06T21:54:58.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.978+0000 7f6eb956d640 1 --2- 172.21.15.55:0/1931899570 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f6e980663a0 0x7f6e98068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:54:58.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.978+0000 7f6eb956d640 1 --2- 172.21.15.55:0/1931899570 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f6e980663a0 0x7f6e98068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4152590 tx=0x7f6ea4009040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:54:58.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:58.978+0000 7f6eaa7fc640 1 -- 172.21.15.55:0/1931899570 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6eb00eebc0 con 0x7f6eb4070af0 2023-07-06T21:54:59.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:54:59.146+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/1931899570 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6eb40c6780 con 0x7f6eb4070af0 2023-07-06T21:55:00.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.138+0000 7f6eaa7fc640 1 -- 172.21.15.55:0/1931899570 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v69) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6eb40c6780 con 0x7f6eb4070af0 2023-07-06T21:55:00.140 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-07-06T21:55:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.142+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/1931899570 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f6e980663a0 msgr2=0x7f6e98068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:00.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.142+0000 7f6ebbfd2640 1 --2- 172.21.15.55:0/1931899570 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f6e980663a0 0x7f6e98068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4152590 tx=0x7f6ea4009040 comp rx=0 tx=0).stop 2023-07-06T21:55:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.142+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/1931899570 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6eb4070af0 msgr2=0x7f6eb4157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.142+0000 7f6ebbfd2640 1 --2- 172.21.15.55:0/1931899570 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6eb4070af0 0x7f6eb4157f00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0000c10 tx=0x7f6eb001bad0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.142+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/1931899570 shutdown_connections 2023-07-06T21:55:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.142+0000 7f6ebbfd2640 1 --2- 172.21.15.55:0/1931899570 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f6e980663a0 0x7f6e98068850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.142+0000 7f6ebbfd2640 1 --2- 172.21.15.55:0/1931899570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb4158850 0x7f6eb40c0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.142+0000 7f6ebbfd2640 1 --2- 172.21.15.55:0/1931899570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6eb40ca130 0x7f6eb40c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.142+0000 7f6ebbfd2640 1 --2- 172.21.15.55:0/1931899570 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6eb4070af0 0x7f6eb4157f00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.142+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/1931899570 >> 172.21.15.55:0/1931899570 conn(0x7f6eb40cea70 msgr2=0x7f6eb409e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:00.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.142+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/1931899570 shutdown_connections 2023-07-06T21:55:00.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.142+0000 7f6ebbfd2640 1 -- 172.21.15.55:0/1931899570 wait complete. 2023-07-06T21:55:00.166 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-06T21:55:00.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.310+0000 7fdc8c6cb640 1 Processor -- start 2023-07-06T21:55:00.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.310+0000 7fdc8c6cb640 1 -- start start 2023-07-06T21:55:00.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.314+0000 7fdc8c6cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc840712f0 0x7fdc8406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:00.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.314+0000 7fdc8c6cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc84159cd0 con 0x7fdc840b3730 2023-07-06T21:55:00.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.314+0000 7fdc8c6cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc840693f0 con 0x7fdc840ca450 2023-07-06T21:55:00.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.314+0000 7fdc8c6cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8406aca0 con 0x7fdc840712f0 2023-07-06T21:55:00.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.314+0000 7fdc8a467640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc840712f0 0x7fdc8406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:00.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.314+0000 7fdc8a467640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc840712f0 0x7fdc8406a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54084/0 (socket says 172.21.15.55:54084) 2023-07-06T21:55:00.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.314+0000 7fdc8a467640 1 -- 172.21.15.55:0/645499488 learned_addr learned my addr 172.21.15.55:0/645499488 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:00.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.314+0000 7fdc8a467640 1 -- 172.21.15.55:0/645499488 >> v1:172.21.15.138:6789/0 conn(0x7fdc840ca450 legacy=0x7fdc8415d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:00.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.314+0000 7fdc8a467640 1 -- 172.21.15.55:0/645499488 >> v1:172.21.15.55:6789/0 conn(0x7fdc840b3730 legacy=0x7fdc840c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:00.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.314+0000 7fdc8a467640 1 -- 172.21.15.55:0/645499488 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840696b0 con 0x7fdc840712f0 2023-07-06T21:55:00.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.318+0000 7fdc8a467640 1 --2- 172.21.15.55:0/645499488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc840712f0 0x7fdc8406a610 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fdc80009870 tx=0x7fdc8001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e7e8b90b21b2b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:00.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.318+0000 7fdc89465640 1 -- 172.21.15.55:0/645499488 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc800ab620 con 0x7fdc840712f0 2023-07-06T21:55:00.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.318+0000 7fdc89465640 1 -- 172.21.15.55:0/645499488 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc800ab780 con 0x7fdc840712f0 2023-07-06T21:55:00.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.318+0000 7fdc89465640 1 -- 172.21.15.55:0/645499488 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc800abb10 con 0x7fdc840712f0 2023-07-06T21:55:00.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.318+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/645499488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc840712f0 msgr2=0x7fdc8406a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:00.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.318+0000 7fdc8c6cb640 1 --2- 172.21.15.55:0/645499488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc840712f0 0x7fdc8406a610 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fdc80009870 tx=0x7fdc8001c510 comp rx=0 tx=0).stop 2023-07-06T21:55:00.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.318+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/645499488 shutdown_connections 2023-07-06T21:55:00.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.318+0000 7fdc8c6cb640 1 --2- 172.21.15.55:0/645499488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc840712f0 0x7fdc8406a610 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.318+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/645499488 >> 172.21.15.55:0/645499488 conn(0x7fdc840cded0 msgr2=0x7fdc840ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:00.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.318+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/645499488 shutdown_connections 2023-07-06T21:55:00.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.318+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/645499488 wait complete. 2023-07-06T21:55:00.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.318+0000 7fdc8c6cb640 1 Processor -- start 2023-07-06T21:55:00.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.318+0000 7fdc8c6cb640 1 -- start start 2023-07-06T21:55:00.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc8c6cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc840712f0 0x7fdc84149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:00.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc8c6cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc840b3730 0x7fdc8415b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:00.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc8c6cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc840ca450 0x7fdc840aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:00.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc8c6cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840b1b10 con 0x7fdc840b3730 2023-07-06T21:55:00.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc8c6cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840b1ec0 con 0x7fdc840712f0 2023-07-06T21:55:00.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc8c6cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840b21a0 con 0x7fdc840ca450 2023-07-06T21:55:00.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc89c66640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc840b3730 0x7fdc8415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:00.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc89c66640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc840b3730 0x7fdc8415b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54098/0 (socket says 172.21.15.55:54098) 2023-07-06T21:55:00.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc89c66640 1 -- 172.21.15.55:0/2304973767 learned_addr learned my addr 172.21.15.55:0/2304973767 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:00.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc8a467640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc840712f0 0x7fdc84149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:00.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc8ac68640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc840ca450 0x7fdc840aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:00.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc89c66640 1 -- 172.21.15.55:0/2304973767 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc840ca450 msgr2=0x7fdc840aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:00.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc89c66640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc840ca450 0x7fdc840aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc89c66640 1 -- 172.21.15.55:0/2304973767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc840712f0 msgr2=0x7fdc84149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:00.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc89c66640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc840712f0 0x7fdc84149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc89c66640 1 -- 172.21.15.55:0/2304973767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc800094d0 con 0x7fdc840b3730 2023-07-06T21:55:00.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc8a467640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc840712f0 0x7fdc84149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:55:00.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc89c66640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc840b3730 0x7fdc8415b460 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400c500 tx=0x7fdc7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:00.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc7affd640 1 -- 172.21.15.55:0/2304973767 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74005220 con 0x7fdc840b3730 2023-07-06T21:55:00.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc7affd640 1 -- 172.21.15.55:0/2304973767 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc74005380 con 0x7fdc840b3730 2023-07-06T21:55:00.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc7affd640 1 -- 172.21.15.55:0/2304973767 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74007270 con 0x7fdc840b3730 2023-07-06T21:55:00.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/2304973767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc840b2480 con 0x7fdc840b3730 2023-07-06T21:55:00.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/2304973767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc840b1730 con 0x7fdc840b3730 2023-07-06T21:55:00.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.322+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/2304973767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc840b26c0 con 0x7fdc840b3730 2023-07-06T21:55:00.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.326+0000 7fdc7affd640 1 -- 172.21.15.55:0/2304973767 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdc740073d0 con 0x7fdc840b3730 2023-07-06T21:55:00.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.326+0000 7fdc7affd640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fdc680663a0 0x7fdc68068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:00.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.326+0000 7fdc7affd640 1 -- 172.21.15.55:0/2304973767 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fdc740835b0 con 0x7fdc840b3730 2023-07-06T21:55:00.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.326+0000 7fdc8a467640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fdc680663a0 0x7fdc68068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:00.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.326+0000 7fdc8a467640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fdc680663a0 0x7fdc68068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdc800af000 tx=0x7fdc800a7000 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:00.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.330+0000 7fdc7affd640 1 -- 172.21.15.55:0/2304973767 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc840b26c0 con 0x7fdc840b3730 2023-07-06T21:55:00.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.538+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/2304973767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdc840b26c0 con 0x7fdc840b3730 2023-07-06T21:55:00.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.538+0000 7fdc7affd640 1 -- 172.21.15.55:0/2304973767 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fdc840b26c0 con 0x7fdc840b3730 2023-07-06T21:55:00.539 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:00.539 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T21:55:00.540 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-07-06T21:55:00.540 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.540 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-07-06T21:55:00.540 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkWjb1JxAAMmLy+dPO5qyorBnuzazx6A==", 2023-07-06T21:55:00.540 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.540 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:55:00.541 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:55:00.541 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:55:00.541 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.541 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.541 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.541 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.541 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-07-06T21:55:00.541 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkpLLENBAAxMASh3qbELQMJ3XbPEX0Zw==", 2023-07-06T21:55:00.542 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.542 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:55:00.542 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:55:00.542 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:55:00.542 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.542 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.542 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.543 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.543 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-07-06T21:55:00.543 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkvOSfLxAAMEoqAPg1pb47e5a1G1QtAw==", 2023-07-06T21:55:00.543 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.543 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:55:00.543 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:55:00.543 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:55:00.543 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.544 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.544 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.544 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.544 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-07-06T21:55:00.544 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkeQIBARAApXT5zWLUqqMSdwYygZeatw==", 2023-07-06T21:55:00.544 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.544 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:55:00.545 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:55:00.545 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:55:00.545 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.545 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.545 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.545 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.545 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-07-06T21:55:00.545 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD5NKdkSIfzJxAAlXiG8PWFXQqIeugbdp7Eiw==", 2023-07-06T21:55:00.546 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.546 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:55:00.546 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:55:00.546 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.546 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.546 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.546 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.546 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-07-06T21:55:00.547 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD8NKdkv2iwLxAAxjFucMwaaH66wPQpoYSTGw==", 2023-07-06T21:55:00.547 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.547 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:55:00.547 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:55:00.547 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.547 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.547 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.547 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.548 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-07-06T21:55:00.548 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD/NKdk5w7XOBAAuiup4mcC02ZMCPHCU1Cl3A==", 2023-07-06T21:55:00.548 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.548 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:55:00.548 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:55:00.548 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.548 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.549 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.549 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.549 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-07-06T21:55:00.549 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQADNadksvRLBBAAE1YX9VgA8pWARIEZL8tbsQ==", 2023-07-06T21:55:00.549 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.549 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:55:00.549 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:55:00.549 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.550 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.550 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.550 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.550 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-07-06T21:55:00.550 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAJNadkn2HsChAAgwb7B9lHOMq2h0BNuhB/AQ==", 2023-07-06T21:55:00.550 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.550 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:55:00.550 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:55:00.551 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.551 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.551 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.551 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.551 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-07-06T21:55:00.551 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMNadkbonPERAA2PLg4NMr+4eW+FDAfPig1A==", 2023-07-06T21:55:00.551 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.552 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:55:00.552 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:55:00.552 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.552 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.552 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.552 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.552 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-07-06T21:55:00.552 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAPNadkQw76GBAAY9SIgsTUHqvThwjdpjuwpw==", 2023-07-06T21:55:00.553 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.553 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:55:00.553 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:55:00.553 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.553 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.553 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.553 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.553 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-07-06T21:55:00.554 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQASNadkr3gRHxAALbPUtIgImIK1UUoe6vcyjg==", 2023-07-06T21:55:00.554 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.554 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:55:00.554 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:55:00.554 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.554 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.554 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.555 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.555 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-07-06T21:55:00.555 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkaZgiBRAAvyBUd+qHLh/wwhgoE1MsVA==", 2023-07-06T21:55:00.555 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.555 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:55:00.555 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-07-06T21:55:00.555 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-06T21:55:00.555 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.556 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.556 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.556 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-07-06T21:55:00.556 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkOBqoDBAASIhzvCqkSAFLX2oc99MYqw==", 2023-07-06T21:55:00.556 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.556 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:55:00.556 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:55:00.556 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:55:00.557 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:55:00.557 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.557 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.557 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.557 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-07-06T21:55:00.557 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkgt/fCBAAlQY94DrR/nFTIVwSFCEToQ==", 2023-07-06T21:55:00.557 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.558 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:55:00.558 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:55:00.558 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:55:00.558 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:55:00.558 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.558 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.558 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.558 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-07-06T21:55:00.559 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkd5zAEhAAU0Qo6NROIKRSlOncFUoTxQ==", 2023-07-06T21:55:00.559 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.559 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:55:00.559 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:55:00.559 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:55:00.559 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:55:00.559 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.560 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.560 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.560 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-07-06T21:55:00.560 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkjvG8ChAA5rpuV6+YETQS9UjMRUynxA==", 2023-07-06T21:55:00.560 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.560 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:55:00.560 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:55:00.560 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:55:00.561 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.561 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.561 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.561 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.561 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-07-06T21:55:00.561 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdk+RUVIxAAyQpmGAeL8K+Cy+fgK5BmCQ==", 2023-07-06T21:55:00.561 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.561 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:55:00.562 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T21:55:00.562 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.562 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.562 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:00.562 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:00.562 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-07-06T21:55:00.562 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkLH8aHxAAzzX5YxumCYWYqo0rQfFA9g==", 2023-07-06T21:55:00.563 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:55:00.563 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:55:00.563 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T21:55:00.563 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:55:00.563 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.563 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:00.563 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-07-06T21:55:00.563 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T21:55:00.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.538+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/2304973767 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fdc680663a0 msgr2=0x7fdc68068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:00.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.538+0000 7fdc8c6cb640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fdc680663a0 0x7fdc68068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdc800af000 tx=0x7fdc800a7000 comp rx=0 tx=0).stop 2023-07-06T21:55:00.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.538+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/2304973767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc840b3730 msgr2=0x7fdc8415b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:00.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.538+0000 7fdc8c6cb640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc840b3730 0x7fdc8415b460 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400c500 tx=0x7fdc7400c9c0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.538+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/2304973767 shutdown_connections 2023-07-06T21:55:00.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.538+0000 7fdc8c6cb640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc840ca450 0x7fdc840aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.538+0000 7fdc8c6cb640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fdc680663a0 0x7fdc68068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.538+0000 7fdc8c6cb640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc840b3730 0x7fdc8415b460 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.538+0000 7fdc8c6cb640 1 --2- 172.21.15.55:0/2304973767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc840712f0 0x7fdc84149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.538+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/2304973767 >> 172.21.15.55:0/2304973767 conn(0x7fdc840cded0 msgr2=0x7fdc840cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:00.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.538+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/2304973767 shutdown_connections 2023-07-06T21:55:00.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.542+0000 7fdc8c6cb640 1 -- 172.21.15.55:0/2304973767 wait complete. 2023-07-06T21:55:00.567 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:55:00.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe9353d2640 1 Processor -- start 2023-07-06T21:55:00.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe9353d2640 1 -- start start 2023-07-06T21:55:00.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe9353d2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe9300b7cd0 0x7fe9300ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:00.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe9353d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe9300b1fe0 0x7fe93015f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:00.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe9353d2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9300cecf0 con 0x7fe9300ccab0 2023-07-06T21:55:00.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe9353d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9300d2310 con 0x7fe9300b1fe0 2023-07-06T21:55:00.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe9353d2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9300b80a0 con 0x7fe9300b7cd0 2023-07-06T21:55:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe92f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe9300b1fe0 0x7fe93015f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe92f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe9300b1fe0 0x7fe93015f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54102/0 (socket says 172.21.15.55:54102) 2023-07-06T21:55:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe92f7fe640 1 -- 172.21.15.55:0/364755436 learned_addr learned my addr 172.21.15.55:0/364755436 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe92effd640 1 --2- 172.21.15.55:0/364755436 >> v2:172.21.15.138:3300/0 conn(0x7fe9300b7cd0 0x7fe9300ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe92f7fe640 1 -- 172.21.15.55:0/364755436 >> v2:172.21.15.138:3300/0 conn(0x7fe9300b7cd0 msgr2=0x7fe9300ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe92f7fe640 1 --2- 172.21.15.55:0/364755436 >> v2:172.21.15.138:3300/0 conn(0x7fe9300b7cd0 0x7fe9300ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe92f7fe640 1 -- 172.21.15.55:0/364755436 >> v1:172.21.15.138:6789/0 conn(0x7fe9300ccab0 legacy=0x7fe9300b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.710+0000 7fe92f7fe640 1 -- 172.21.15.55:0/364755436 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300d1d90 con 0x7fe9300b1fe0 2023-07-06T21:55:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.714+0000 7fe92f7fe640 1 --2- 172.21.15.55:0/364755436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9300b1fe0 0x7fe93015f870 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe93008b5d0 tx=0x7fe92801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa638857af8cebc2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.714+0000 7fe92dffb640 1 -- 172.21.15.55:0/364755436 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9280a55c0 con 0x7fe9300b1fe0 2023-07-06T21:55:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.714+0000 7fe92dffb640 1 -- 172.21.15.55:0/364755436 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9280a5720 con 0x7fe9300b1fe0 2023-07-06T21:55:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.714+0000 7fe92dffb640 1 -- 172.21.15.55:0/364755436 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9280a5ab0 con 0x7fe9300b1fe0 2023-07-06T21:55:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.714+0000 7fe9353d2640 1 -- 172.21.15.55:0/364755436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9300b1fe0 msgr2=0x7fe93015f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.714+0000 7fe9353d2640 1 --2- 172.21.15.55:0/364755436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9300b1fe0 0x7fe93015f870 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe93008b5d0 tx=0x7fe92801c900 comp rx=0 tx=0).stop 2023-07-06T21:55:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.714+0000 7fe9353d2640 1 -- 172.21.15.55:0/364755436 shutdown_connections 2023-07-06T21:55:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.714+0000 7fe9353d2640 1 --2- 172.21.15.55:0/364755436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9300b1fe0 0x7fe93015f870 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.714+0000 7fe9353d2640 1 --2- 172.21.15.55:0/364755436 >> v2:172.21.15.138:3300/0 conn(0x7fe9300b7cd0 0x7fe9300ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.714+0000 7fe9353d2640 1 -- 172.21.15.55:0/364755436 >> 172.21.15.55:0/364755436 conn(0x7fe9300ceee0 msgr2=0x7fe9300cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.714+0000 7fe9353d2640 1 -- 172.21.15.55:0/364755436 shutdown_connections 2023-07-06T21:55:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.714+0000 7fe9353d2640 1 -- 172.21.15.55:0/364755436 wait complete. 2023-07-06T21:55:00.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe9353d2640 1 Processor -- start 2023-07-06T21:55:00.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe9353d2640 1 -- start start 2023-07-06T21:55:00.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe9353d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9300b1fe0 0x7fe930152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe9353d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9300b7cd0 0x7fe930069c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe9353d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9300ccab0 0x7fe93006a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe9353d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300c9530 con 0x7fe9300b1fe0 2023-07-06T21:55:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe9353d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93015eb20 con 0x7fe9300b7cd0 2023-07-06T21:55:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe9353d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe930154e50 con 0x7fe9300ccab0 2023-07-06T21:55:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe92effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9300b1fe0 0x7fe930152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe92effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9300b1fe0 0x7fe930152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54114/0 (socket says 172.21.15.55:54114) 2023-07-06T21:55:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe92effd640 1 -- 172.21.15.55:0/4215817958 learned_addr learned my addr 172.21.15.55:0/4215817958 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe92f7fe640 1 --2- 172.21.15.55:0/4215817958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9300ccab0 0x7fe93006a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe92e7fc640 1 --2- 172.21.15.55:0/4215817958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9300b7cd0 0x7fe930069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe92effd640 1 -- 172.21.15.55:0/4215817958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9300ccab0 msgr2=0x7fe93006a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe92effd640 1 --2- 172.21.15.55:0/4215817958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9300ccab0 0x7fe93006a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe92effd640 1 -- 172.21.15.55:0/4215817958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9300b7cd0 msgr2=0x7fe930069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe92effd640 1 --2- 172.21.15.55:0/4215817958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9300b7cd0 0x7fe930069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe92effd640 1 -- 172.21.15.55:0/4215817958 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe928009b30 con 0x7fe9300b1fe0 2023-07-06T21:55:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe92effd640 1 --2- 172.21.15.55:0/4215817958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9300b1fe0 0x7fe930152b80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fe92000d800 tx=0x7fe92000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe9177fe640 1 -- 172.21.15.55:0/4215817958 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92000b6c0 con 0x7fe9300b1fe0 2023-07-06T21:55:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe9177fe640 1 -- 172.21.15.55:0/4215817958 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92000b820 con 0x7fe9300b1fe0 2023-07-06T21:55:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe9177fe640 1 -- 172.21.15.55:0/4215817958 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92000bb90 con 0x7fe9300b1fe0 2023-07-06T21:55:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe9353d2640 1 -- 172.21.15.55:0/4215817958 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9300c9780 con 0x7fe9300b1fe0 2023-07-06T21:55:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe9353d2640 1 -- 172.21.15.55:0/4215817958 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9301530c0 con 0x7fe9300b1fe0 2023-07-06T21:55:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.718+0000 7fe9353d2640 1 -- 172.21.15.55:0/4215817958 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe930066d60 con 0x7fe9300b1fe0 2023-07-06T21:55:00.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.722+0000 7fe9177fe640 1 -- 172.21.15.55:0/4215817958 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe92000bcf0 con 0x7fe9300b1fe0 2023-07-06T21:55:00.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.722+0000 7fe9177fe640 1 --2- 172.21.15.55:0/4215817958 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe91c0663a0 0x7fe91c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:00.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.722+0000 7fe9177fe640 1 -- 172.21.15.55:0/4215817958 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe920084180 con 0x7fe9300b1fe0 2023-07-06T21:55:00.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.722+0000 7fe92e7fc640 1 --2- 172.21.15.55:0/4215817958 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe91c0663a0 0x7fe91c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:00.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.722+0000 7fe92e7fc640 1 --2- 172.21.15.55:0/4215817958 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe91c0663a0 0x7fe91c068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe93015c0f0 tx=0x7fe924009040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.726+0000 7fe9177fe640 1 -- 172.21.15.55:0/4215817958 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe920055180 con 0x7fe9300b1fe0 2023-07-06T21:55:00.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.882+0000 7fe9353d2640 1 -- 172.21.15.55:0/4215817958 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9300b3690 con 0x7fe9300b1fe0 2023-07-06T21:55:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.882+0000 7fe9177fe640 1 -- 172.21.15.55:0/4215817958 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+14832 (secure 0 0 0) 0x7fe920054d10 con 0x7fe9300b1fe0 2023-07-06T21:55:00.885 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:00.886 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":69,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:55:00.133558+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:55:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.886+0000 7fe9353d2640 1 -- 172.21.15.55:0/4215817958 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe91c0663a0 msgr2=0x7fe91c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.886+0000 7fe9353d2640 1 --2- 172.21.15.55:0/4215817958 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe91c0663a0 0x7fe91c068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe93015c0f0 tx=0x7fe924009040 comp rx=0 tx=0).stop 2023-07-06T21:55:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.886+0000 7fe9353d2640 1 -- 172.21.15.55:0/4215817958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9300b1fe0 msgr2=0x7fe930152b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:00.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.886+0000 7fe9353d2640 1 --2- 172.21.15.55:0/4215817958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9300b1fe0 0x7fe930152b80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fe92000d800 tx=0x7fe92000dcc0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.886+0000 7fe9353d2640 1 -- 172.21.15.55:0/4215817958 shutdown_connections 2023-07-06T21:55:00.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.886+0000 7fe9353d2640 1 --2- 172.21.15.55:0/4215817958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9300ccab0 0x7fe93006a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.886+0000 7fe9353d2640 1 --2- 172.21.15.55:0/4215817958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9300b7cd0 0x7fe930069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.886+0000 7fe9353d2640 1 --2- 172.21.15.55:0/4215817958 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe91c0663a0 0x7fe91c068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.886+0000 7fe9353d2640 1 --2- 172.21.15.55:0/4215817958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9300b1fe0 0x7fe930152b80 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:00.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.886+0000 7fe9353d2640 1 -- 172.21.15.55:0/4215817958 >> 172.21.15.55:0/4215817958 conn(0x7fe9300ceee0 msgr2=0x7fe9300b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:00.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.886+0000 7fe9353d2640 1 -- 172.21.15.55:0/4215817958 shutdown_connections 2023-07-06T21:55:00.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:00.886+0000 7fe9353d2640 1 -- 172.21.15.55:0/4215817958 wait complete. 2023-07-06T21:55:00.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:55:00.907 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:55:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f6dc48640 1 Processor -- start 2023-07-06T21:55:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f6dc48640 1 -- start start 2023-07-06T21:55:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f6dc48640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8f680709a0 0x7f8f680cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f6dc48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f680b1340 0x7f8f6806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f6dc48640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f680cc300 con 0x7f8f680cbe60 2023-07-06T21:55:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f6dc48640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f680cc5e0 con 0x7f8f680709a0 2023-07-06T21:55:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f6dc48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f680cc8c0 con 0x7f8f680b1340 2023-07-06T21:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f66ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8f680cbe60 0x7f8f680b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35818/0 (socket says 172.21.15.55:35818) 2023-07-06T21:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f66ffd640 1 -- 172.21.15.55:0/530951003 learned_addr learned my addr 172.21.15.55:0/530951003 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f677fe640 1 --2- 172.21.15.55:0/530951003 >> v2:172.21.15.138:3300/0 conn(0x7f8f680709a0 0x7f8f680cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f67fff640 1 --2- 172.21.15.55:0/530951003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f680b1340 0x7f8f6806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f667fc640 1 -- 172.21.15.55:0/530951003 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69369956 0 0) 0x7f8f680cc300 con 0x7f8f680cbe60 2023-07-06T21:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f667fc640 1 -- 172.21.15.55:0/530951003 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f50003530 con 0x7f8f680cbe60 2023-07-06T21:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f67fff640 1 -- 172.21.15.55:0/530951003 >> v2:172.21.15.138:3300/0 conn(0x7f8f680709a0 msgr2=0x7f8f680cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f67fff640 1 --2- 172.21.15.55:0/530951003 >> v2:172.21.15.138:3300/0 conn(0x7f8f680709a0 0x7f8f680cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f67fff640 1 -- 172.21.15.55:0/530951003 >> v1:172.21.15.55:6789/0 conn(0x7f8f680cbe60 legacy=0x7f8f680b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.054+0000 7f8f67fff640 1 -- 172.21.15.55:0/530951003 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f680ccba0 con 0x7f8f680b1340 2023-07-06T21:55:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.058+0000 7f8f67fff640 1 --2- 172.21.15.55:0/530951003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f680b1340 0x7f8f6806eee0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009d90 tx=0x7f8f6001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13143a635dba207c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.058+0000 7f8f667fc640 1 -- 172.21.15.55:0/530951003 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f600a5920 con 0x7f8f680b1340 2023-07-06T21:55:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.058+0000 7f8f667fc640 1 -- 172.21.15.55:0/530951003 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f600a5a80 con 0x7f8f680b1340 2023-07-06T21:55:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.058+0000 7f8f667fc640 1 -- 172.21.15.55:0/530951003 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f600a5e10 con 0x7f8f680b1340 2023-07-06T21:55:01.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.058+0000 7f8f6dc48640 1 -- 172.21.15.55:0/530951003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f680b1340 msgr2=0x7f8f6806eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.058+0000 7f8f6dc48640 1 --2- 172.21.15.55:0/530951003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f680b1340 0x7f8f6806eee0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009d90 tx=0x7f8f6001c950 comp rx=0 tx=0).stop 2023-07-06T21:55:01.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.058+0000 7f8f6dc48640 1 -- 172.21.15.55:0/530951003 shutdown_connections 2023-07-06T21:55:01.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.058+0000 7f8f6dc48640 1 --2- 172.21.15.55:0/530951003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f680b1340 0x7f8f6806eee0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.058+0000 7f8f6dc48640 1 --2- 172.21.15.55:0/530951003 >> v2:172.21.15.138:3300/0 conn(0x7f8f680709a0 0x7f8f680cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.058+0000 7f8f6dc48640 1 -- 172.21.15.55:0/530951003 >> 172.21.15.55:0/530951003 conn(0x7f8f680cea70 msgr2=0x7f8f680ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.058+0000 7f8f6dc48640 1 -- 172.21.15.55:0/530951003 shutdown_connections 2023-07-06T21:55:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.058+0000 7f8f6dc48640 1 -- 172.21.15.55:0/530951003 wait complete. 2023-07-06T21:55:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f6dc48640 1 Processor -- start 2023-07-06T21:55:01.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f6dc48640 1 -- start start 2023-07-06T21:55:01.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f6dc48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f680709a0 0x7f8f68155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f6dc48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f680b1340 0x7f8f68155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f6dc48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f680cbe60 0x7f8f68155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f6dc48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f681555c0 con 0x7f8f680709a0 2023-07-06T21:55:01.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f6dc48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f680c5ed0 con 0x7f8f680cbe60 2023-07-06T21:55:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f6dc48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f680c61b0 con 0x7f8f680b1340 2023-07-06T21:55:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f677fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f680709a0 0x7f8f68155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f677fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f680709a0 0x7f8f68155080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54124/0 (socket says 172.21.15.55:54124) 2023-07-06T21:55:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f677fe640 1 -- 172.21.15.55:0/387363993 learned_addr learned my addr 172.21.15.55:0/387363993 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:01.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f66ffd640 1 --2- 172.21.15.55:0/387363993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f680b1340 0x7f8f68155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f67fff640 1 --2- 172.21.15.55:0/387363993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f680cbe60 0x7f8f68155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f677fe640 1 -- 172.21.15.55:0/387363993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f680b1340 msgr2=0x7f8f68155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f677fe640 1 --2- 172.21.15.55:0/387363993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f680b1340 0x7f8f68155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f677fe640 1 -- 172.21.15.55:0/387363993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f680cbe60 msgr2=0x7f8f68155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f677fe640 1 --2- 172.21.15.55:0/387363993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f680cbe60 0x7f8f68155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f677fe640 1 -- 172.21.15.55:0/387363993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f60009a70 con 0x7f8f680709a0 2023-07-06T21:55:01.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f677fe640 1 --2- 172.21.15.55:0/387363993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f680709a0 0x7f8f68155080 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800e930 tx=0x7f8f5800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:01.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f4ffff640 1 -- 172.21.15.55:0/387363993 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f58009690 con 0x7f8f680709a0 2023-07-06T21:55:01.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f4ffff640 1 -- 172.21.15.55:0/387363993 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5800ca00 con 0x7f8f680709a0 2023-07-06T21:55:01.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f4ffff640 1 -- 172.21.15.55:0/387363993 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5800cd70 con 0x7f8f680709a0 2023-07-06T21:55:01.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f6dc48640 1 -- 172.21.15.55:0/387363993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f68156c80 con 0x7f8f680709a0 2023-07-06T21:55:01.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.062+0000 7f8f6dc48640 1 -- 172.21.15.55:0/387363993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f680c1860 con 0x7f8f680709a0 2023-07-06T21:55:01.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.066+0000 7f8f6dc48640 1 -- 172.21.15.55:0/387363993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f68066d60 con 0x7f8f680709a0 2023-07-06T21:55:01.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.066+0000 7f8f4ffff640 1 -- 172.21.15.55:0/387363993 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8f58013470 con 0x7f8f680709a0 2023-07-06T21:55:01.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.066+0000 7f8f4ffff640 1 --2- 172.21.15.55:0/387363993 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f8f540663d0 0x7f8f54068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.066+0000 7f8f4ffff640 1 -- 172.21.15.55:0/387363993 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8f58083e40 con 0x7f8f680709a0 2023-07-06T21:55:01.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.066+0000 7f8f66ffd640 1 --2- 172.21.15.55:0/387363993 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f8f540663d0 0x7f8f54068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.066+0000 7f8f66ffd640 1 --2- 172.21.15.55:0/387363993 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f8f540663d0 0x7f8f54068880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8f680cbd10 tx=0x7f8f5c009040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:01.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.070+0000 7f8f4ffff640 1 -- 172.21.15.55:0/387363993 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8f58051510 con 0x7f8f680709a0 2023-07-06T21:55:01.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.226+0000 7f8f6dc48640 1 -- 172.21.15.55:0/387363993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f680c1620 con 0x7f8f680709a0 2023-07-06T21:55:01.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.226+0000 7f8f4ffff640 1 -- 172.21.15.55:0/387363993 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f58054b30 con 0x7f8f680709a0 2023-07-06T21:55:01.228 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:55:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.230+0000 7f8f6dc48640 1 -- 172.21.15.55:0/387363993 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f8f540663d0 msgr2=0x7f8f54068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.230+0000 7f8f6dc48640 1 --2- 172.21.15.55:0/387363993 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f8f540663d0 0x7f8f54068880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8f680cbd10 tx=0x7f8f5c009040 comp rx=0 tx=0).stop 2023-07-06T21:55:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.230+0000 7f8f6dc48640 1 -- 172.21.15.55:0/387363993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f680709a0 msgr2=0x7f8f68155080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.230+0000 7f8f6dc48640 1 --2- 172.21.15.55:0/387363993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f680709a0 0x7f8f68155080 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800e930 tx=0x7f8f5800edf0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.230+0000 7f8f6dc48640 1 -- 172.21.15.55:0/387363993 shutdown_connections 2023-07-06T21:55:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.230+0000 7f8f6dc48640 1 --2- 172.21.15.55:0/387363993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f680cbe60 0x7f8f68155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.230+0000 7f8f6dc48640 1 --2- 172.21.15.55:0/387363993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f680b1340 0x7f8f68155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.230+0000 7f8f6dc48640 1 --2- 172.21.15.55:0/387363993 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f8f540663d0 0x7f8f54068880 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.230+0000 7f8f6dc48640 1 --2- 172.21.15.55:0/387363993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f680709a0 0x7f8f68155080 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.230+0000 7f8f6dc48640 1 -- 172.21.15.55:0/387363993 >> 172.21.15.55:0/387363993 conn(0x7f8f680cea70 msgr2=0x7f8f680b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:01.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.230+0000 7f8f6dc48640 1 -- 172.21.15.55:0/387363993 shutdown_connections 2023-07-06T21:55:01.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.230+0000 7f8f6dc48640 1 -- 172.21.15.55:0/387363993 wait complete. 2023-07-06T21:55:01.249 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:55:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.394+0000 7f478ef40640 1 Processor -- start 2023-07-06T21:55:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.394+0000 7f478ef40640 1 -- start start 2023-07-06T21:55:01.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.394+0000 7f478ef40640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47880cef40 0x7f47880ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.394+0000 7f478ef40640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478815fe80 con 0x7f4788070020 2023-07-06T21:55:01.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.394+0000 7f478ef40640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478815bf60 con 0x7f478815bb90 2023-07-06T21:55:01.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.394+0000 7f478ef40640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478815f620 con 0x7f47880cef40 2023-07-06T21:55:01.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.394+0000 7f4787fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4788070020 0x7f47880c8cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35828/0 (socket says 172.21.15.55:35828) 2023-07-06T21:55:01.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.394+0000 7f4787fff640 1 -- 172.21.15.55:0/3314734259 learned_addr learned my addr 172.21.15.55:0/3314734259 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:55:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.398+0000 7f478d4dd640 1 --2- 172.21.15.55:0/3314734259 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47880cef40 0x7f47880ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.398+0000 7f47877fe640 1 -- 172.21.15.55:0/3314734259 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270243189 0 0) 0x7f478815fe80 con 0x7f4788070020 2023-07-06T21:55:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.398+0000 7f47877fe640 1 -- 172.21.15.55:0/3314734259 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4778003530 con 0x7f4788070020 2023-07-06T21:55:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.398+0000 7f47877fe640 1 -- 172.21.15.55:0/3314734259 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428343176 0 0) 0x7f478815bf60 con 0x7f478815bb90 2023-07-06T21:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.398+0000 7f47877fe640 1 -- 172.21.15.55:0/3314734259 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f478815fe80 con 0x7f478815bb90 2023-07-06T21:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.398+0000 7f478d4dd640 1 -- 172.21.15.55:0/3314734259 >> v1:172.21.15.138:6789/0 conn(0x7f478815bb90 legacy=0x7f478806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.398+0000 7f478d4dd640 1 -- 172.21.15.55:0/3314734259 >> v1:172.21.15.55:6789/0 conn(0x7f4788070020 legacy=0x7f47880c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.398+0000 7f478d4dd640 1 -- 172.21.15.55:0/3314734259 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47880cf440 con 0x7f47880cef40 2023-07-06T21:55:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.398+0000 7f478d4dd640 1 --2- 172.21.15.55:0/3314734259 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47880cef40 0x7f47880ce030 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4780009dc0 tx=0x7f478001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e5fa805baa30b23 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.398+0000 7f47877fe640 1 -- 172.21.15.55:0/3314734259 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47800a5720 con 0x7f47880cef40 2023-07-06T21:55:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f47877fe640 1 -- 172.21.15.55:0/3314734259 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47800a5880 con 0x7f47880cef40 2023-07-06T21:55:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f47877fe640 1 -- 172.21.15.55:0/3314734259 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47800a5bf0 con 0x7f47880cef40 2023-07-06T21:55:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 -- 172.21.15.55:0/3314734259 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47880cef40 msgr2=0x7f47880ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 --2- 172.21.15.55:0/3314734259 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47880cef40 0x7f47880ce030 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4780009dc0 tx=0x7f478001c970 comp rx=0 tx=0).stop 2023-07-06T21:55:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 -- 172.21.15.55:0/3314734259 shutdown_connections 2023-07-06T21:55:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 --2- 172.21.15.55:0/3314734259 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47880cef40 0x7f47880ce030 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 -- 172.21.15.55:0/3314734259 >> 172.21.15.55:0/3314734259 conn(0x7f47880cbd70 msgr2=0x7f47880ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 -- 172.21.15.55:0/3314734259 shutdown_connections 2023-07-06T21:55:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 -- 172.21.15.55:0/3314734259 wait complete. 2023-07-06T21:55:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 Processor -- start 2023-07-06T21:55:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 -- start start 2023-07-06T21:55:01.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4788070020 0x7f478814f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47880cef40 0x7f4788153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f478815bb90 0x7f47880c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880c36d0 con 0x7f47880cef40 2023-07-06T21:55:01.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880c2770 con 0x7f478815bb90 2023-07-06T21:55:01.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f478ef40640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47880c21d0 con 0x7f4788070020 2023-07-06T21:55:01.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f4787fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47880cef40 0x7f4788153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f4787fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47880cef40 0x7f4788153a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54130/0 (socket says 172.21.15.55:54130) 2023-07-06T21:55:01.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.402+0000 7f4787fff640 1 -- 172.21.15.55:0/1064708978 learned_addr learned my addr 172.21.15.55:0/1064708978 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:01.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f478d4dd640 1 --2- 172.21.15.55:0/1064708978 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f478815bb90 0x7f47880c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f478ccdc640 1 --2- 172.21.15.55:0/1064708978 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4788070020 0x7f478814f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f4787fff640 1 -- 172.21.15.55:0/1064708978 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4788070020 msgr2=0x7f478814f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f4787fff640 1 --2- 172.21.15.55:0/1064708978 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4788070020 0x7f478814f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f4787fff640 1 -- 172.21.15.55:0/1064708978 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f478815bb90 msgr2=0x7f47880c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f4787fff640 1 --2- 172.21.15.55:0/1064708978 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f478815bb90 0x7f47880c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f4787fff640 1 -- 172.21.15.55:0/1064708978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4780009a70 con 0x7f47880cef40 2023-07-06T21:55:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f4787fff640 1 --2- 172.21.15.55:0/1064708978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47880cef40 0x7f4788153a80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4774005890 tx=0x7f477400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f47857fa640 1 -- 172.21.15.55:0/1064708978 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774005cf0 con 0x7f47880cef40 2023-07-06T21:55:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f47857fa640 1 -- 172.21.15.55:0/1064708978 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4774005e50 con 0x7f47880cef40 2023-07-06T21:55:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f478ef40640 1 -- 172.21.15.55:0/1064708978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47880c2490 con 0x7f47880cef40 2023-07-06T21:55:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f47857fa640 1 -- 172.21.15.55:0/1064708978 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740072b0 con 0x7f47880cef40 2023-07-06T21:55:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f478ef40640 1 -- 172.21.15.55:0/1064708978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47880c4160 con 0x7f47880cef40 2023-07-06T21:55:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f478ef40640 1 -- 172.21.15.55:0/1064708978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47880c3cc0 con 0x7f47880cef40 2023-07-06T21:55:01.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f47857fa640 1 -- 172.21.15.55:0/1064708978 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4774007410 con 0x7f47880cef40 2023-07-06T21:55:01.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f47857fa640 1 --2- 172.21.15.55:0/1064708978 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f476c0663d0 0x7f476c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f47857fa640 1 -- 172.21.15.55:0/1064708978 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f47740831b0 con 0x7f47880cef40 2023-07-06T21:55:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.406+0000 7f478ccdc640 1 --2- 172.21.15.55:0/1064708978 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f476c0663d0 0x7f476c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.410+0000 7f478ccdc640 1 --2- 172.21.15.55:0/1064708978 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f476c0663d0 0x7f476c068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f477c0011f0 tx=0x7f477c009040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.410+0000 7f47857fa640 1 -- 172.21.15.55:0/1064708978 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f47740507d0 con 0x7f47880cef40 2023-07-06T21:55:01.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.570+0000 7f478ef40640 1 -- 172.21.15.55:0/1064708978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4788066d60 con 0x7f47880cef40 2023-07-06T21:55:01.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.570+0000 7f47857fa640 1 -- 172.21.15.55:0/1064708978 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v69) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4774053df0 con 0x7f47880cef40 2023-07-06T21:55:01.570 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:55:01.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.570+0000 7f478ef40640 1 -- 172.21.15.55:0/1064708978 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f476c0663d0 msgr2=0x7f476c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.570+0000 7f478ef40640 1 --2- 172.21.15.55:0/1064708978 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f476c0663d0 0x7f476c068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f477c0011f0 tx=0x7f477c009040 comp rx=0 tx=0).stop 2023-07-06T21:55:01.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.570+0000 7f478ef40640 1 -- 172.21.15.55:0/1064708978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47880cef40 msgr2=0x7f4788153a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.570+0000 7f478ef40640 1 --2- 172.21.15.55:0/1064708978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47880cef40 0x7f4788153a80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4774005890 tx=0x7f477400c960 comp rx=0 tx=0).stop 2023-07-06T21:55:01.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.570+0000 7f478ef40640 1 -- 172.21.15.55:0/1064708978 shutdown_connections 2023-07-06T21:55:01.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.570+0000 7f478ef40640 1 --2- 172.21.15.55:0/1064708978 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f478815bb90 0x7f47880c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.570+0000 7f478ef40640 1 --2- 172.21.15.55:0/1064708978 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f476c0663d0 0x7f476c068880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.570+0000 7f478ef40640 1 --2- 172.21.15.55:0/1064708978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47880cef40 0x7f4788153a80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.570+0000 7f478ef40640 1 --2- 172.21.15.55:0/1064708978 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4788070020 0x7f478814f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.570+0000 7f478ef40640 1 -- 172.21.15.55:0/1064708978 >> 172.21.15.55:0/1064708978 conn(0x7f47880cbd70 msgr2=0x7f47880abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:01.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.570+0000 7f478ef40640 1 -- 172.21.15.55:0/1064708978 shutdown_connections 2023-07-06T21:55:01.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.570+0000 7f478ef40640 1 -- 172.21.15.55:0/1064708978 wait complete. 2023-07-06T21:55:01.592 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T21:55:01.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.734+0000 7f96fba6d640 1 Processor -- start 2023-07-06T21:55:01.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.734+0000 7f96fba6d640 1 -- start start 2023-07-06T21:55:01.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.734+0000 7f96fba6d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f96f406d670 0x7f96f40d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.734+0000 7f96fba6d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96f40b58e0 0x7f96f40cba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.734+0000 7f96fba6d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f40ce9e0 con 0x7f96f40cf940 2023-07-06T21:55:01.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.734+0000 7f96fba6d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f4159eb0 con 0x7f96f40b58e0 2023-07-06T21:55:01.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.734+0000 7f96fba6d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f40d0960 con 0x7f96f406d670 2023-07-06T21:55:01.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.734+0000 7f96fa00a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96f40b58e0 0x7f96f40cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.738+0000 7f96fa00a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96f40b58e0 0x7f96f40cba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54146/0 (socket says 172.21.15.55:54146) 2023-07-06T21:55:01.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.738+0000 7f96fa00a640 1 -- 172.21.15.55:0/3506311613 learned_addr learned my addr 172.21.15.55:0/3506311613 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:01.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.738+0000 7f96f9008640 1 --2- 172.21.15.55:0/3506311613 >> v2:172.21.15.138:3300/0 conn(0x7f96f406d670 0x7f96f40d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.738+0000 7f96fa00a640 1 -- 172.21.15.55:0/3506311613 >> v2:172.21.15.138:3300/0 conn(0x7f96f406d670 msgr2=0x7f96f40d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:01.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.738+0000 7f96fa00a640 1 --2- 172.21.15.55:0/3506311613 >> v2:172.21.15.138:3300/0 conn(0x7f96f406d670 0x7f96f40d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.738+0000 7f96fa00a640 1 -- 172.21.15.55:0/3506311613 >> v1:172.21.15.55:6789/0 conn(0x7f96f40cf940 legacy=0x7f96f40cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.738+0000 7f96fa00a640 1 -- 172.21.15.55:0/3506311613 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f40cddd0 con 0x7f96f40b58e0 2023-07-06T21:55:01.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.738+0000 7f96fa00a640 1 --2- 172.21.15.55:0/3506311613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96f40b58e0 0x7f96f40cba40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f96f40cf000 tx=0x7f96ec01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1233c554c0f1dde5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:01.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.738+0000 7f96f8807640 1 -- 172.21.15.55:0/3506311613 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec0a57d0 con 0x7f96f40b58e0 2023-07-06T21:55:01.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.738+0000 7f96f8807640 1 -- 172.21.15.55:0/3506311613 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec0a5930 con 0x7f96f40b58e0 2023-07-06T21:55:01.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.738+0000 7f96f8807640 1 -- 172.21.15.55:0/3506311613 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec0a5cc0 con 0x7f96f40b58e0 2023-07-06T21:55:01.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 -- 172.21.15.55:0/3506311613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96f40b58e0 msgr2=0x7f96f40cba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 --2- 172.21.15.55:0/3506311613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96f40b58e0 0x7f96f40cba40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f96f40cf000 tx=0x7f96ec01c910 comp rx=0 tx=0).stop 2023-07-06T21:55:01.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 -- 172.21.15.55:0/3506311613 shutdown_connections 2023-07-06T21:55:01.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 --2- 172.21.15.55:0/3506311613 >> v2:172.21.15.138:3300/0 conn(0x7f96f406d670 0x7f96f40d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 --2- 172.21.15.55:0/3506311613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96f40b58e0 0x7f96f40cba40 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 -- 172.21.15.55:0/3506311613 >> 172.21.15.55:0/3506311613 conn(0x7f96f406ee80 msgr2=0x7f96f406f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 -- 172.21.15.55:0/3506311613 shutdown_connections 2023-07-06T21:55:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 -- 172.21.15.55:0/3506311613 wait complete. 2023-07-06T21:55:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 Processor -- start 2023-07-06T21:55:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 -- start start 2023-07-06T21:55:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96f406d670 0x7f96f40c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96f40b58e0 0x7f96f41485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96f40cf940 0x7f96f4151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f41644a0 con 0x7f96f40b58e0 2023-07-06T21:55:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f4161e20 con 0x7f96f406d670 2023-07-06T21:55:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fba6d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f4148b20 con 0x7f96f40cf940 2023-07-06T21:55:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96f9008640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96f40b58e0 0x7f96f41485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96f9008640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96f40b58e0 0x7f96f41485e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54152/0 (socket says 172.21.15.55:54152) 2023-07-06T21:55:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96f9008640 1 -- 172.21.15.55:0/1648868875 learned_addr learned my addr 172.21.15.55:0/1648868875 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96fa00a640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96f40cf940 0x7f96f4151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.742+0000 7f96f9809640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96f406d670 0x7f96f40c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96f9008640 1 -- 172.21.15.55:0/1648868875 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96f40cf940 msgr2=0x7f96f4151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96f9008640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96f40cf940 0x7f96f4151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96f9008640 1 -- 172.21.15.55:0/1648868875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96f406d670 msgr2=0x7f96f40c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96f9008640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96f406d670 0x7f96f40c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96f9008640 1 -- 172.21.15.55:0/1648868875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec009b30 con 0x7f96f40b58e0 2023-07-06T21:55:01.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96fa00a640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96f40cf940 0x7f96f4151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:55:01.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96f9809640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96f406d670 0x7f96f40c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:55:01.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96f9008640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96f40b58e0 0x7f96f41485e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f96e400e960 tx=0x7f96e400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:01.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96ea7fc640 1 -- 172.21.15.55:0/1648868875 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4009690 con 0x7f96f40b58e0 2023-07-06T21:55:01.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96ea7fc640 1 -- 172.21.15.55:0/1648868875 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e400ca00 con 0x7f96f40b58e0 2023-07-06T21:55:01.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96fba6d640 1 -- 172.21.15.55:0/1648868875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f4163ee0 con 0x7f96f40b58e0 2023-07-06T21:55:01.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96ea7fc640 1 -- 172.21.15.55:0/1648868875 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400cd70 con 0x7f96f40b58e0 2023-07-06T21:55:01.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96fba6d640 1 -- 172.21.15.55:0/1648868875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f4161ab0 con 0x7f96f40b58e0 2023-07-06T21:55:01.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96fba6d640 1 -- 172.21.15.55:0/1648868875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f4066d60 con 0x7f96f40b58e0 2023-07-06T21:55:01.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96ea7fc640 1 -- 172.21.15.55:0/1648868875 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f96e4013470 con 0x7f96f40b58e0 2023-07-06T21:55:01.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96ea7fc640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f96d80663a0 0x7f96d8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:01.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96ea7fc640 1 -- 172.21.15.55:0/1648868875 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f96e4083ea0 con 0x7f96f40b58e0 2023-07-06T21:55:01.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.746+0000 7f96f9809640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f96d80663a0 0x7f96d8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:01.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.750+0000 7f96f9809640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f96d80663a0 0x7f96d8068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f96f0000f70 tx=0x7f96f0009040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:01.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.750+0000 7f96ea7fc640 1 -- 172.21.15.55:0/1648868875 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f96e4051410 con 0x7f96f40b58e0 2023-07-06T21:55:01.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.910+0000 7f96fba6d640 1 -- 172.21.15.55:0/1648868875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f96f40b5f50 con 0x7f96f40b58e0 2023-07-06T21:55:01.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.910+0000 7f96ea7fc640 1 -- 172.21.15.55:0/1648868875 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) v1 ==== 84+0+126 (secure 0 0 0) 0x7f96e4017090 con 0x7f96f40b58e0 2023-07-06T21:55:01.912 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:01.912 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T21:55:01.912 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:01.912 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-07-06T21:55:01.912 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-07-06T21:55:01.913 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:55:01.913 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:01.913 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-07-06T21:55:01.913 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-07-06T21:55:01.913 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:01.913 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T21:55:01.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.914+0000 7f96fba6d640 1 -- 172.21.15.55:0/1648868875 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f96d80663a0 msgr2=0x7f96d8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.914+0000 7f96fba6d640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f96d80663a0 0x7f96d8068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f96f0000f70 tx=0x7f96f0009040 comp rx=0 tx=0).stop 2023-07-06T21:55:01.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.914+0000 7f96fba6d640 1 -- 172.21.15.55:0/1648868875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96f40b58e0 msgr2=0x7f96f41485e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:01.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.914+0000 7f96fba6d640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96f40b58e0 0x7f96f41485e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f96e400e960 tx=0x7f96e400ee20 comp rx=0 tx=0).stop 2023-07-06T21:55:01.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.914+0000 7f96fba6d640 1 -- 172.21.15.55:0/1648868875 shutdown_connections 2023-07-06T21:55:01.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.914+0000 7f96fba6d640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96f40cf940 0x7f96f4151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.914+0000 7f96fba6d640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f96d80663a0 0x7f96d8068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.914+0000 7f96fba6d640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96f40b58e0 0x7f96f41485e0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.914+0000 7f96fba6d640 1 --2- 172.21.15.55:0/1648868875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96f406d670 0x7f96f40c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:01.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.914+0000 7f96fba6d640 1 -- 172.21.15.55:0/1648868875 >> 172.21.15.55:0/1648868875 conn(0x7f96f406ee80 msgr2=0x7f96f4156480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:01.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.914+0000 7f96fba6d640 1 -- 172.21.15.55:0/1648868875 shutdown_connections 2023-07-06T21:55:01.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:01.914+0000 7f96fba6d640 1 -- 172.21.15.55:0/1648868875 wait complete. 2023-07-06T21:55:01.932 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T21:55:01.933 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T21:55:02.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19d22f9640 1 Processor -- start 2023-07-06T21:55:02.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19d22f9640 1 -- start start 2023-07-06T21:55:02.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19d22f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19cc1588d0 0x7f19cc0c9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:02.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19d22f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19cc0c9640 0x7f19cc0ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:02.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19d22f9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19cc0c9b30 con 0x7f19cc0cad20 2023-07-06T21:55:02.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19d22f9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19cc0ce2a0 con 0x7f19cc0c9640 2023-07-06T21:55:02.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19d22f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc0ae110 con 0x7f19cc1588d0 2023-07-06T21:55:02.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19cb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19cc0c9640 0x7f19cc0ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:02.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19cb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19cc0c9640 0x7f19cc0ad4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54162/0 (socket says 172.21.15.55:54162) 2023-07-06T21:55:02.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19cb7fe640 1 -- 172.21.15.55:0/1099985656 learned_addr learned my addr 172.21.15.55:0/1099985656 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:02.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19cbfff640 1 --2- 172.21.15.55:0/1099985656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19cc1588d0 0x7f19cc0c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:02.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19cb7fe640 1 -- 172.21.15.55:0/1099985656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19cc1588d0 msgr2=0x7f19cc0c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:02.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19cb7fe640 1 --2- 172.21.15.55:0/1099985656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19cc1588d0 0x7f19cc0c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:02.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19cb7fe640 1 -- 172.21.15.55:0/1099985656 >> v1:172.21.15.138:6789/0 conn(0x7f19cc0cad20 legacy=0x7f19cc0ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:02.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.078+0000 7f19cb7fe640 1 -- 172.21.15.55:0/1099985656 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc0c9e10 con 0x7f19cc0c9640 2023-07-06T21:55:02.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.082+0000 7f19cb7fe640 1 --2- 172.21.15.55:0/1099985656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19cc0c9640 0x7f19cc0ad4c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009870 tx=0x7f19c001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c8c11014d66546 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:02.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.082+0000 7f19caffd640 1 -- 172.21.15.55:0/1099985656 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c00a7070 con 0x7f19cc0c9640 2023-07-06T21:55:02.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.082+0000 7f19caffd640 1 -- 172.21.15.55:0/1099985656 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c00ab430 con 0x7f19cc0c9640 2023-07-06T21:55:02.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.082+0000 7f19caffd640 1 -- 172.21.15.55:0/1099985656 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c00ab7c0 con 0x7f19cc0c9640 2023-07-06T21:55:02.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.082+0000 7f19d22f9640 1 -- 172.21.15.55:0/1099985656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19cc0c9640 msgr2=0x7f19cc0ad4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:02.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.082+0000 7f19d22f9640 1 --2- 172.21.15.55:0/1099985656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19cc0c9640 0x7f19cc0ad4c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009870 tx=0x7f19c001c540 comp rx=0 tx=0).stop 2023-07-06T21:55:02.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.082+0000 7f19d22f9640 1 -- 172.21.15.55:0/1099985656 shutdown_connections 2023-07-06T21:55:02.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.082+0000 7f19d22f9640 1 --2- 172.21.15.55:0/1099985656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19cc0c9640 0x7f19cc0ad4c0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:02.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.082+0000 7f19d22f9640 1 --2- 172.21.15.55:0/1099985656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19cc1588d0 0x7f19cc0c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:02.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.082+0000 7f19d22f9640 1 -- 172.21.15.55:0/1099985656 >> 172.21.15.55:0/1099985656 conn(0x7f19cc0ce7f0 msgr2=0x7f19cc0cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:02.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.082+0000 7f19d22f9640 1 -- 172.21.15.55:0/1099985656 shutdown_connections 2023-07-06T21:55:02.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.082+0000 7f19d22f9640 1 -- 172.21.15.55:0/1099985656 wait complete. 2023-07-06T21:55:02.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19d22f9640 1 Processor -- start 2023-07-06T21:55:02.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19d22f9640 1 -- start start 2023-07-06T21:55:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19d22f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19cc0c9640 0x7f19cc15b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:02.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19d22f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19cc0cad20 0x7f19cc150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:02.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19d22f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19cc1588d0 0x7f19cc150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:02.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19d22f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc150b90 con 0x7f19cc0c9640 2023-07-06T21:55:02.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19d22f9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc1574f0 con 0x7f19cc0cad20 2023-07-06T21:55:02.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19d22f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc156600 con 0x7f19cc1588d0 2023-07-06T21:55:02.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19cbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19cc0c9640 0x7f19cc15b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:02.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19cbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19cc0c9640 0x7f19cc15b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54178/0 (socket says 172.21.15.55:54178) 2023-07-06T21:55:02.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19cbfff640 1 -- 172.21.15.55:0/3602865855 learned_addr learned my addr 172.21.15.55:0/3602865855 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:02.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19cb7fe640 1 --2- 172.21.15.55:0/3602865855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19cc0cad20 0x7f19cc150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:02.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19d0896640 1 --2- 172.21.15.55:0/3602865855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19cc1588d0 0x7f19cc150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:02.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19cbfff640 1 -- 172.21.15.55:0/3602865855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19cc1588d0 msgr2=0x7f19cc150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:02.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19cbfff640 1 --2- 172.21.15.55:0/3602865855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19cc1588d0 0x7f19cc150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:02.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19cbfff640 1 -- 172.21.15.55:0/3602865855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19cc0cad20 msgr2=0x7f19cc150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:02.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19cbfff640 1 --2- 172.21.15.55:0/3602865855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19cc0cad20 0x7f19cc150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:02.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19cbfff640 1 -- 172.21.15.55:0/3602865855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c00094d0 con 0x7f19cc0c9640 2023-07-06T21:55:02.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19cbfff640 1 --2- 172.21.15.55:0/3602865855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19cc0c9640 0x7f19cc15b4b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00d7d0 tx=0x7f19bc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:02.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19c8ff9640 1 -- 172.21.15.55:0/3602865855 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00b6c0 con 0x7f19cc0c9640 2023-07-06T21:55:02.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19c8ff9640 1 -- 172.21.15.55:0/3602865855 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc00b820 con 0x7f19cc0c9640 2023-07-06T21:55:02.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19d22f9640 1 -- 172.21.15.55:0/3602865855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19cc1568e0 con 0x7f19cc0c9640 2023-07-06T21:55:02.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19c8ff9640 1 -- 172.21.15.55:0/3602865855 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00bbd0 con 0x7f19cc0c9640 2023-07-06T21:55:02.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.086+0000 7f19d22f9640 1 -- 172.21.15.55:0/3602865855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19cc156ea0 con 0x7f19cc0c9640 2023-07-06T21:55:02.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.090+0000 7f19d22f9640 1 -- 172.21.15.55:0/3602865855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19cc066d60 con 0x7f19cc0c9640 2023-07-06T21:55:02.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.090+0000 7f19c8ff9640 1 -- 172.21.15.55:0/3602865855 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f19bc00bd30 con 0x7f19cc0c9640 2023-07-06T21:55:02.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.090+0000 7f19c8ff9640 1 --2- 172.21.15.55:0/3602865855 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f19b80663a0 0x7f19b8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:02.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.090+0000 7f19c8ff9640 1 -- 172.21.15.55:0/3602865855 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f19bc084120 con 0x7f19cc0c9640 2023-07-06T21:55:02.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.090+0000 7f19cb7fe640 1 --2- 172.21.15.55:0/3602865855 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f19b80663a0 0x7f19b8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:02.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.090+0000 7f19cb7fe640 1 --2- 172.21.15.55:0/3602865855 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f19b80663a0 0x7f19b8068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f19c00af000 tx=0x7f19c0008040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:02.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.094+0000 7f19c8ff9640 1 -- 172.21.15.55:0/3602865855 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19bc055090 con 0x7f19cc0c9640 2023-07-06T21:55:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.250+0000 7f19d22f9640 1 -- 172.21.15.55:0/3602865855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f19cc06b960 con 0x7f19cc0c9640 2023-07-06T21:55:02.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.782+0000 7f19c8ff9640 1 -- 172.21.15.55:0/3602865855 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) v1 ==== 138+0+0 (secure 0 0 0) 0x7f19bc054c20 con 0x7f19cc0c9640 2023-07-06T21:55:02.783 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-07-06T21:55:02.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.786+0000 7f19d22f9640 1 -- 172.21.15.55:0/3602865855 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f19b80663a0 msgr2=0x7f19b8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:02.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.786+0000 7f19d22f9640 1 --2- 172.21.15.55:0/3602865855 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f19b80663a0 0x7f19b8068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f19c00af000 tx=0x7f19c0008040 comp rx=0 tx=0).stop 2023-07-06T21:55:02.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.786+0000 7f19d22f9640 1 -- 172.21.15.55:0/3602865855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19cc0c9640 msgr2=0x7f19cc15b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.786+0000 7f19d22f9640 1 --2- 172.21.15.55:0/3602865855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19cc0c9640 0x7f19cc15b4b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00d7d0 tx=0x7f19bc00dc90 comp rx=0 tx=0).stop 2023-07-06T21:55:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.786+0000 7f19d22f9640 1 -- 172.21.15.55:0/3602865855 shutdown_connections 2023-07-06T21:55:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.786+0000 7f19d22f9640 1 --2- 172.21.15.55:0/3602865855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19cc1588d0 0x7f19cc150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.786+0000 7f19d22f9640 1 --2- 172.21.15.55:0/3602865855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19cc0cad20 0x7f19cc150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.786+0000 7f19d22f9640 1 --2- 172.21.15.55:0/3602865855 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f19b80663a0 0x7f19b8068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.786+0000 7f19d22f9640 1 --2- 172.21.15.55:0/3602865855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19cc0c9640 0x7f19cc15b4b0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:02.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.786+0000 7f19d22f9640 1 -- 172.21.15.55:0/3602865855 >> 172.21.15.55:0/3602865855 conn(0x7f19cc0ce7f0 msgr2=0x7f19cc0cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:02.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.786+0000 7f19d22f9640 1 -- 172.21.15.55:0/3602865855 shutdown_connections 2023-07-06T21:55:02.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.786+0000 7f19d22f9640 1 -- 172.21.15.55:0/3602865855 wait complete. 2023-07-06T21:55:02.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T21:55:02.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f3468c9c640 1 Processor -- start 2023-07-06T21:55:02.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f3468c9c640 1 -- start start 2023-07-06T21:55:02.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f3468c9c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34640cbb10 0x7f346415cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:02.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f3468c9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f346406b2f0 0x7f346406b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:02.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f3468c9c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34640cbf60 con 0x7f3464159680 2023-07-06T21:55:02.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f3468c9c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346415d090 con 0x7f34640cbb10 2023-07-06T21:55:02.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f3468c9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346406bcb0 con 0x7f346406b2f0 2023-07-06T21:55:02.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f345bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34640cbb10 0x7f346415cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:02.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f345bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34640cbb10 0x7f346415cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54180/0 (socket says 172.21.15.55:54180) 2023-07-06T21:55:02.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f345bfff640 1 -- 172.21.15.55:0/945131019 learned_addr learned my addr 172.21.15.55:0/945131019 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:02.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f3462d9d640 1 --2- 172.21.15.55:0/945131019 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f346406b2f0 0x7f346406b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:02.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f345bfff640 1 -- 172.21.15.55:0/945131019 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f346406b2f0 msgr2=0x7f346406b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:02.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f345bfff640 1 --2- 172.21.15.55:0/945131019 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f346406b2f0 0x7f346406b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:02.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f345bfff640 1 -- 172.21.15.55:0/945131019 >> v1:172.21.15.55:6789/0 conn(0x7f3464159680 legacy=0x7f346406a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:02.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.962+0000 7f345bfff640 1 -- 172.21.15.55:0/945131019 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34640cc1a0 con 0x7f34640cbb10 2023-07-06T21:55:02.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.966+0000 7f345bfff640 1 --2- 172.21.15.55:0/945131019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34640cbb10 0x7f346415cb50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f344c009870 tx=0x7f344c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293174c5370d3d7f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:02.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.966+0000 7f3461d9b640 1 -- 172.21.15.55:0/945131019 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c0a9400 con 0x7f34640cbb10 2023-07-06T21:55:02.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.966+0000 7f3461d9b640 1 -- 172.21.15.55:0/945131019 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c0a9560 con 0x7f34640cbb10 2023-07-06T21:55:02.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.966+0000 7f3461d9b640 1 -- 172.21.15.55:0/945131019 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c0a98f0 con 0x7f34640cbb10 2023-07-06T21:55:02.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.966+0000 7f3468c9c640 1 -- 172.21.15.55:0/945131019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34640cbb10 msgr2=0x7f346415cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:02.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.966+0000 7f3468c9c640 1 --2- 172.21.15.55:0/945131019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34640cbb10 0x7f346415cb50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f344c009870 tx=0x7f344c01c540 comp rx=0 tx=0).stop 2023-07-06T21:55:02.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.966+0000 7f3468c9c640 1 -- 172.21.15.55:0/945131019 shutdown_connections 2023-07-06T21:55:02.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.966+0000 7f3468c9c640 1 --2- 172.21.15.55:0/945131019 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f346406b2f0 0x7f346406b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:02.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.966+0000 7f3468c9c640 1 --2- 172.21.15.55:0/945131019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34640cbb10 0x7f346415cb50 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:02.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.966+0000 7f3468c9c640 1 -- 172.21.15.55:0/945131019 >> 172.21.15.55:0/945131019 conn(0x7f34640cdf40 msgr2=0x7f34640ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:02.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.966+0000 7f3468c9c640 1 -- 172.21.15.55:0/945131019 shutdown_connections 2023-07-06T21:55:02.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.966+0000 7f3468c9c640 1 -- 172.21.15.55:0/945131019 wait complete. 2023-07-06T21:55:02.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3468c9c640 1 Processor -- start 2023-07-06T21:55:02.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3468c9c640 1 -- start start 2023-07-06T21:55:02.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3468c9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f346406b2f0 0x7f346415b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:02.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3468c9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34640cbb10 0x7f3464145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:02.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3468c9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3464159680 0x7f34640ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:02.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3468c9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34641467c0 con 0x7f3464159680 2023-07-06T21:55:02.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3468c9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3464146aa0 con 0x7f346406b2f0 2023-07-06T21:55:02.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3468c9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3464146d80 con 0x7f34640cbb10 2023-07-06T21:55:02.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3462d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3464159680 0x7f34640ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:02.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3462d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3464159680 0x7f34640ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54182/0 (socket says 172.21.15.55:54182) 2023-07-06T21:55:02.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3462d9d640 1 -- 172.21.15.55:0/3119029262 learned_addr learned my addr 172.21.15.55:0/3119029262 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:02.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f345bfff640 1 --2- 172.21.15.55:0/3119029262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34640cbb10 0x7f3464145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:02.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f346259c640 1 --2- 172.21.15.55:0/3119029262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f346406b2f0 0x7f346415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:02.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3462d9d640 1 -- 172.21.15.55:0/3119029262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34640cbb10 msgr2=0x7f3464145f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:02.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3462d9d640 1 --2- 172.21.15.55:0/3119029262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34640cbb10 0x7f3464145f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3462d9d640 1 -- 172.21.15.55:0/3119029262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f346406b2f0 msgr2=0x7f346415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3462d9d640 1 --2- 172.21.15.55:0/3119029262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f346406b2f0 0x7f346415b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3462d9d640 1 -- 172.21.15.55:0/3119029262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c0094d0 con 0x7f3464159680 2023-07-06T21:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3462d9d640 1 --2- 172.21.15.55:0/3119029262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3464159680 0x7f34640ae680 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f345c007e40 tx=0x7f345c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f345affd640 1 -- 172.21.15.55:0/3119029262 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c014620 con 0x7f3464159680 2023-07-06T21:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f345affd640 1 -- 172.21.15.55:0/3119029262 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c00ee90 con 0x7f3464159680 2023-07-06T21:55:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3468c9c640 1 -- 172.21.15.55:0/3119029262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3464147060 con 0x7f3464159680 2023-07-06T21:55:02.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f345affd640 1 -- 172.21.15.55:0/3119029262 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c0149e0 con 0x7f3464159680 2023-07-06T21:55:02.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.970+0000 7f3468c9c640 1 -- 172.21.15.55:0/3119029262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346415ba40 con 0x7f3464159680 2023-07-06T21:55:02.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.974+0000 7f3468c9c640 1 -- 172.21.15.55:0/3119029262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3464066d60 con 0x7f3464159680 2023-07-06T21:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.974+0000 7f345affd640 1 -- 172.21.15.55:0/3119029262 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f345c014b40 con 0x7f3464159680 2023-07-06T21:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.974+0000 7f345affd640 1 --2- 172.21.15.55:0/3119029262 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f34440663a0 0x7f3444068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.974+0000 7f345affd640 1 -- 172.21.15.55:0/3119029262 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f345c084830 con 0x7f3464159680 2023-07-06T21:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.974+0000 7f346259c640 1 --2- 172.21.15.55:0/3119029262 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f34440663a0 0x7f3444068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.974+0000 7f346259c640 1 --2- 172.21.15.55:0/3119029262 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f34440663a0 0x7f3444068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3454000f70 tx=0x7f3454009040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:02.978+0000 7f345affd640 1 -- 172.21.15.55:0/3119029262 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f345c051ba0 con 0x7f3464159680 2023-07-06T21:55:03.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.134+0000 7f3468c9c640 1 -- 172.21.15.55:0/3119029262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3464147510 con 0x7f3464159680 2023-07-06T21:55:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.786+0000 7f345affd640 1 -- 172.21.15.55:0/3119029262 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) v1 ==== 170+0+0 (secure 0 0 0) 0x7f345c0551c0 con 0x7f3464159680 2023-07-06T21:55:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-07-06T21:55:03.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.798+0000 7f3468c9c640 1 -- 172.21.15.55:0/3119029262 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f34440663a0 msgr2=0x7f3444068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:03.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.798+0000 7f3468c9c640 1 --2- 172.21.15.55:0/3119029262 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f34440663a0 0x7f3444068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3454000f70 tx=0x7f3454009040 comp rx=0 tx=0).stop 2023-07-06T21:55:03.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.798+0000 7f3468c9c640 1 -- 172.21.15.55:0/3119029262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3464159680 msgr2=0x7f34640ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:03.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.798+0000 7f3468c9c640 1 --2- 172.21.15.55:0/3119029262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3464159680 0x7f34640ae680 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f345c007e40 tx=0x7f345c00e4b0 comp rx=0 tx=0).stop 2023-07-06T21:55:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.802+0000 7f3468c9c640 1 -- 172.21.15.55:0/3119029262 shutdown_connections 2023-07-06T21:55:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.802+0000 7f3468c9c640 1 --2- 172.21.15.55:0/3119029262 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f34440663a0 0x7f3444068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.802+0000 7f3468c9c640 1 --2- 172.21.15.55:0/3119029262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3464159680 0x7f34640ae680 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.802+0000 7f3468c9c640 1 --2- 172.21.15.55:0/3119029262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34640cbb10 0x7f3464145f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.802+0000 7f3468c9c640 1 --2- 172.21.15.55:0/3119029262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f346406b2f0 0x7f346415b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.802+0000 7f3468c9c640 1 -- 172.21.15.55:0/3119029262 >> 172.21.15.55:0/3119029262 conn(0x7f34640cdf40 msgr2=0x7f3464155430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:03.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.806+0000 7f3468c9c640 1 -- 172.21.15.55:0/3119029262 shutdown_connections 2023-07-06T21:55:03.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.806+0000 7f3468c9c640 1 -- 172.21.15.55:0/3119029262 wait complete. 2023-07-06T21:55:03.833 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T21:55:03.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca2bb37640 1 Processor -- start 2023-07-06T21:55:03.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca2bb37640 1 -- start start 2023-07-06T21:55:03.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca2bb37640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fca2415bb90 0x7fca240ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:03.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca2bb37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca24070020 0x7fca240c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:03.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca2bb37640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2415fe80 con 0x7fca240cef40 2023-07-06T21:55:03.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca2bb37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2415f620 con 0x7fca24070020 2023-07-06T21:55:03.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca2bb37640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2415bf60 con 0x7fca2415bb90 2023-07-06T21:55:03.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca2a0d4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca24070020 0x7fca240c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:03.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca2a0d4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca24070020 0x7fca240c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42584/0 (socket says 172.21.15.55:42584) 2023-07-06T21:55:03.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca2a0d4640 1 -- 172.21.15.55:0/3830242561 learned_addr learned my addr 172.21.15.55:0/3830242561 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:03.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca2a0d4640 1 -- 172.21.15.55:0/3830242561 >> v2:172.21.15.138:3300/0 conn(0x7fca2415bb90 msgr2=0x7fca240ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:03.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca298d3640 1 --2- 172.21.15.55:0/3830242561 >> v2:172.21.15.138:3300/0 conn(0x7fca2415bb90 0x7fca240ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:03.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca2a0d4640 1 --2- 172.21.15.55:0/3830242561 >> v2:172.21.15.138:3300/0 conn(0x7fca2415bb90 0x7fca240ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:03.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca2a0d4640 1 -- 172.21.15.55:0/3830242561 >> v1:172.21.15.138:6789/0 conn(0x7fca240cef40 legacy=0x7fca2406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:03.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca2a0d4640 1 -- 172.21.15.55:0/3830242561 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca240cf440 con 0x7fca24070020 2023-07-06T21:55:03.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.982+0000 7fca298d3640 1 --2- 172.21.15.55:0/3830242561 >> v2:172.21.15.138:3300/0 conn(0x7fca2415bb90 0x7fca240ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:55:03.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.986+0000 7fca2a0d4640 1 --2- 172.21.15.55:0/3830242561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca24070020 0x7fca240c8cf0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fca2406f530 tx=0x7fca1c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3191b41de34a20d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:03.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.986+0000 7fca288d1640 1 -- 172.21.15.55:0/3830242561 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0a9480 con 0x7fca24070020 2023-07-06T21:55:03.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.986+0000 7fca288d1640 1 -- 172.21.15.55:0/3830242561 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c0a95e0 con 0x7fca24070020 2023-07-06T21:55:03.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.986+0000 7fca288d1640 1 -- 172.21.15.55:0/3830242561 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0a9970 con 0x7fca24070020 2023-07-06T21:55:03.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.986+0000 7fca2bb37640 1 -- 172.21.15.55:0/3830242561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca24070020 msgr2=0x7fca240c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:03.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.986+0000 7fca2bb37640 1 --2- 172.21.15.55:0/3830242561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca24070020 0x7fca240c8cf0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fca2406f530 tx=0x7fca1c01c990 comp rx=0 tx=0).stop 2023-07-06T21:55:03.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.986+0000 7fca2bb37640 1 -- 172.21.15.55:0/3830242561 shutdown_connections 2023-07-06T21:55:03.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.986+0000 7fca2bb37640 1 --2- 172.21.15.55:0/3830242561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca24070020 0x7fca240c8cf0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:03.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.986+0000 7fca2bb37640 1 --2- 172.21.15.55:0/3830242561 >> v2:172.21.15.138:3300/0 conn(0x7fca2415bb90 0x7fca240ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:03.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.986+0000 7fca2bb37640 1 -- 172.21.15.55:0/3830242561 >> 172.21.15.55:0/3830242561 conn(0x7fca240cbd70 msgr2=0x7fca240ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:03.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.986+0000 7fca2bb37640 1 -- 172.21.15.55:0/3830242561 shutdown_connections 2023-07-06T21:55:03.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.986+0000 7fca2bb37640 1 -- 172.21.15.55:0/3830242561 wait complete. 2023-07-06T21:55:03.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2bb37640 1 Processor -- start 2023-07-06T21:55:03.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2bb37640 1 -- start start 2023-07-06T21:55:03.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2bb37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca24070020 0x7fca24149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:03.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2bb37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca240cef40 0x7fca241547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:03.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2bb37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca2415bb90 0x7fca24154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:03.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2bb37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca240b2ac0 con 0x7fca2415bb90 2023-07-06T21:55:03.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2bb37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca24153440 con 0x7fca240cef40 2023-07-06T21:55:03.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2bb37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca24159830 con 0x7fca24070020 2023-07-06T21:55:03.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2a0d4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca2415bb90 0x7fca24154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:03.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2a0d4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca2415bb90 0x7fca24154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42594/0 (socket says 172.21.15.55:42594) 2023-07-06T21:55:03.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2a0d4640 1 -- 172.21.15.55:0/215386079 learned_addr learned my addr 172.21.15.55:0/215386079 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:03.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca298d3640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca24070020 0x7fca24149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:03.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca290d2640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca240cef40 0x7fca241547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:03.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2a0d4640 1 -- 172.21.15.55:0/215386079 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca24070020 msgr2=0x7fca24149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:03.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2a0d4640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca24070020 0x7fca24149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:03.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2a0d4640 1 -- 172.21.15.55:0/215386079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca240cef40 msgr2=0x7fca241547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:03.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2a0d4640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca240cef40 0x7fca241547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:03.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2a0d4640 1 -- 172.21.15.55:0/215386079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c009b30 con 0x7fca2415bb90 2023-07-06T21:55:03.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca290d2640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca240cef40 0x7fca241547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:55:03.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2a0d4640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca2415bb90 0x7fca24154d20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0ab040 tx=0x7fca1c019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:03.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca1a7fc640 1 -- 172.21.15.55:0/215386079 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0a9b60 con 0x7fca2415bb90 2023-07-06T21:55:03.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca1a7fc640 1 -- 172.21.15.55:0/215386079 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c0b6070 con 0x7fca2415bb90 2023-07-06T21:55:03.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2bb37640 1 -- 172.21.15.55:0/215386079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca240c5770 con 0x7fca2415bb90 2023-07-06T21:55:03.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca1a7fc640 1 -- 172.21.15.55:0/215386079 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0bc410 con 0x7fca2415bb90 2023-07-06T21:55:03.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2bb37640 1 -- 172.21.15.55:0/215386079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca24153930 con 0x7fca2415bb90 2023-07-06T21:55:03.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.990+0000 7fca2bb37640 1 -- 172.21.15.55:0/215386079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca241599c0 con 0x7fca2415bb90 2023-07-06T21:55:03.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.994+0000 7fca1a7fc640 1 -- 172.21.15.55:0/215386079 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fca1c0b23f0 con 0x7fca2415bb90 2023-07-06T21:55:03.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.994+0000 7fca1a7fc640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fca080663d0 0x7fca08068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:03.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.994+0000 7fca1a7fc640 1 -- 172.21.15.55:0/215386079 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fca1c11ddb0 con 0x7fca2415bb90 2023-07-06T21:55:03.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.994+0000 7fca298d3640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fca080663d0 0x7fca08068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:03.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.994+0000 7fca298d3640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fca080663d0 0x7fca08068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca2000ab60 tx=0x7fca20008040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:03.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:03.998+0000 7fca1a7fc640 1 -- 172.21.15.55:0/215386079 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fca1c0eb1b0 con 0x7fca2415bb90 2023-07-06T21:55:04.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.186+0000 7fca2bb37640 1 -- 172.21.15.55:0/215386079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fca24066d60 con 0x7fca2415bb90 2023-07-06T21:55:04.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.198+0000 7fca1a7fc640 1 -- 172.21.15.55:0/215386079 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7fca1c0b8020 con 0x7fca2415bb90 2023-07-06T21:55:04.199 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 8 and data pool 9 2023-07-06T21:55:04.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.206+0000 7fca2bb37640 1 -- 172.21.15.55:0/215386079 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fca080663d0 msgr2=0x7fca08068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:04.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.206+0000 7fca2bb37640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fca080663d0 0x7fca08068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca2000ab60 tx=0x7fca20008040 comp rx=0 tx=0).stop 2023-07-06T21:55:04.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.206+0000 7fca2bb37640 1 -- 172.21.15.55:0/215386079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca2415bb90 msgr2=0x7fca24154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:04.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.206+0000 7fca2bb37640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca2415bb90 0x7fca24154d20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0ab040 tx=0x7fca1c019730 comp rx=0 tx=0).stop 2023-07-06T21:55:04.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.206+0000 7fca2bb37640 1 -- 172.21.15.55:0/215386079 shutdown_connections 2023-07-06T21:55:04.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.206+0000 7fca2bb37640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fca080663d0 0x7fca08068880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.206+0000 7fca2bb37640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca2415bb90 0x7fca24154d20 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.206+0000 7fca2bb37640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca240cef40 0x7fca241547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.206+0000 7fca2bb37640 1 --2- 172.21.15.55:0/215386079 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca24070020 0x7fca24149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.206+0000 7fca2bb37640 1 -- 172.21.15.55:0/215386079 >> 172.21.15.55:0/215386079 conn(0x7fca240cbd70 msgr2=0x7fca240acb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:04.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.206+0000 7fca2bb37640 1 -- 172.21.15.55:0/215386079 shutdown_connections 2023-07-06T21:55:04.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.206+0000 7fca2bb37640 1 -- 172.21.15.55:0/215386079 wait complete. 2023-07-06T21:55:04.251 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:55:04.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe96adad640 1 Processor -- start 2023-07-06T21:55:04.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe96adad640 1 -- start start 2023-07-06T21:55:04.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe96adad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9640b7cd0 0x7fe9640ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe96adad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe9640b1fe0 0x7fe96415f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe96adad640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9640cecf0 con 0x7fe9640ccab0 2023-07-06T21:55:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe96adad640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9640d2310 con 0x7fe9640b1fe0 2023-07-06T21:55:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe96adad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640b80a0 con 0x7fe9640b7cd0 2023-07-06T21:55:04.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe96934a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe9640b1fe0 0x7fe96415f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:04.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe96934a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe9640b1fe0 0x7fe96415f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42596/0 (socket says 172.21.15.55:42596) 2023-07-06T21:55:04.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe96934a640 1 -- 172.21.15.55:0/2487135985 learned_addr learned my addr 172.21.15.55:0/2487135985 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:04.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe968b49640 1 --2- 172.21.15.55:0/2487135985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9640b7cd0 0x7fe9640ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:04.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe96934a640 1 -- 172.21.15.55:0/2487135985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9640b7cd0 msgr2=0x7fe9640ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:04.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe96934a640 1 --2- 172.21.15.55:0/2487135985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9640b7cd0 0x7fe9640ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe96934a640 1 -- 172.21.15.55:0/2487135985 >> v1:172.21.15.55:6789/0 conn(0x7fe9640ccab0 legacy=0x7fe9640b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:04.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.394+0000 7fe96934a640 1 -- 172.21.15.55:0/2487135985 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9640d1d90 con 0x7fe9640b1fe0 2023-07-06T21:55:04.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.398+0000 7fe96934a640 1 --2- 172.21.15.55:0/2487135985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9640b1fe0 0x7fe96415f870 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009e50 tx=0x7fe95c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5169d9a8b32f8d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:04.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.398+0000 7fe9637fe640 1 -- 172.21.15.55:0/2487135985 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c0a5640 con 0x7fe9640b1fe0 2023-07-06T21:55:04.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.398+0000 7fe9637fe640 1 -- 172.21.15.55:0/2487135985 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c0a57a0 con 0x7fe9640b1fe0 2023-07-06T21:55:04.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.398+0000 7fe9637fe640 1 -- 172.21.15.55:0/2487135985 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c0a5b30 con 0x7fe9640b1fe0 2023-07-06T21:55:04.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.398+0000 7fe96adad640 1 -- 172.21.15.55:0/2487135985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9640b1fe0 msgr2=0x7fe96415f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:04.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.398+0000 7fe96adad640 1 --2- 172.21.15.55:0/2487135985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9640b1fe0 0x7fe96415f870 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009e50 tx=0x7fe95c01c980 comp rx=0 tx=0).stop 2023-07-06T21:55:04.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.398+0000 7fe96adad640 1 -- 172.21.15.55:0/2487135985 shutdown_connections 2023-07-06T21:55:04.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.398+0000 7fe96adad640 1 --2- 172.21.15.55:0/2487135985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9640b1fe0 0x7fe96415f870 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.398+0000 7fe96adad640 1 --2- 172.21.15.55:0/2487135985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9640b7cd0 0x7fe9640ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.398+0000 7fe96adad640 1 -- 172.21.15.55:0/2487135985 >> 172.21.15.55:0/2487135985 conn(0x7fe9640ceee0 msgr2=0x7fe9640cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:04.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.398+0000 7fe96adad640 1 -- 172.21.15.55:0/2487135985 shutdown_connections 2023-07-06T21:55:04.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.398+0000 7fe96adad640 1 -- 172.21.15.55:0/2487135985 wait complete. 2023-07-06T21:55:04.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96adad640 1 Processor -- start 2023-07-06T21:55:04.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96adad640 1 -- start start 2023-07-06T21:55:04.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96adad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9640b1fe0 0x7fe9640c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:04.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96adad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9640b7cd0 0x7fe9641535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:04.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96adad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9640ccab0 0x7fe96415a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:04.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96adad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9641598b0 con 0x7fe9640ccab0 2023-07-06T21:55:04.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96adad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe964159b90 con 0x7fe9640b1fe0 2023-07-06T21:55:04.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96adad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe964159e70 con 0x7fe9640b7cd0 2023-07-06T21:55:04.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96934a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9640ccab0 0x7fe96415a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96934a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9640ccab0 0x7fe96415a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42612/0 (socket says 172.21.15.55:42612) 2023-07-06T21:55:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96934a640 1 -- 172.21.15.55:0/2098365950 learned_addr learned my addr 172.21.15.55:0/2098365950 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:04.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe963fff640 1 --2- 172.21.15.55:0/2098365950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9640b7cd0 0x7fe9641535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:04.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe968b49640 1 --2- 172.21.15.55:0/2098365950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9640b1fe0 0x7fe9640c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:04.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96934a640 1 -- 172.21.15.55:0/2098365950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9640b7cd0 msgr2=0x7fe9641535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:04.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96934a640 1 --2- 172.21.15.55:0/2098365950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9640b7cd0 0x7fe9641535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96934a640 1 -- 172.21.15.55:0/2098365950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9640b1fe0 msgr2=0x7fe9640c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:04.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96934a640 1 --2- 172.21.15.55:0/2098365950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9640b1fe0 0x7fe9640c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96934a640 1 -- 172.21.15.55:0/2098365950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c009b30 con 0x7fe9640ccab0 2023-07-06T21:55:04.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96934a640 1 --2- 172.21.15.55:0/2098365950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9640ccab0 0x7fe96415a950 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe95c01a5b0 tx=0x7fe95c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:04.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe9617fa640 1 -- 172.21.15.55:0/2098365950 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c0b8670 con 0x7fe9640ccab0 2023-07-06T21:55:04.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe9617fa640 1 -- 172.21.15.55:0/2098365950 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c0b87d0 con 0x7fe9640ccab0 2023-07-06T21:55:04.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96adad640 1 -- 172.21.15.55:0/2098365950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96415a150 con 0x7fe9640ccab0 2023-07-06T21:55:04.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe9617fa640 1 -- 172.21.15.55:0/2098365950 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c0b8b80 con 0x7fe9640ccab0 2023-07-06T21:55:04.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.402+0000 7fe96adad640 1 -- 172.21.15.55:0/2098365950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9640c9a70 con 0x7fe9640ccab0 2023-07-06T21:55:04.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.406+0000 7fe96adad640 1 -- 172.21.15.55:0/2098365950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96415a670 con 0x7fe9640ccab0 2023-07-06T21:55:04.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.406+0000 7fe9617fa640 1 -- 172.21.15.55:0/2098365950 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe95c0b8ce0 con 0x7fe9640ccab0 2023-07-06T21:55:04.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.406+0000 7fe9617fa640 1 --2- 172.21.15.55:0/2098365950 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe9480663a0 0x7fe948068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:04.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.406+0000 7fe9617fa640 1 -- 172.21.15.55:0/2098365950 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe95c11f320 con 0x7fe9640ccab0 2023-07-06T21:55:04.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.406+0000 7fe968b49640 1 --2- 172.21.15.55:0/2098365950 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe9480663a0 0x7fe948068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:04.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.406+0000 7fe968b49640 1 --2- 172.21.15.55:0/2098365950 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe9480663a0 0x7fe948068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe958009b60 tx=0x7fe958009190 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.410+0000 7fe9617fa640 1 -- 172.21.15.55:0/2098365950 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe96415a670 con 0x7fe9640ccab0 2023-07-06T21:55:04.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.570+0000 7fe96adad640 1 -- 172.21.15.55:0/2098365950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe96415a670 con 0x7fe9640ccab0 2023-07-06T21:55:04.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.570+0000 7fe9617fa640 1 -- 172.21.15.55:0/2098365950 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18553 (secure 0 0 0) 0x7fe96415a670 con 0x7fe9640ccab0 2023-07-06T21:55:04.571 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:04.571 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":72,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:55:04.192052+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:55:02.300695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-07-06T21:55:03.183596+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:55:04.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.570+0000 7fe96adad640 1 -- 172.21.15.55:0/2098365950 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe9480663a0 msgr2=0x7fe948068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:04.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.570+0000 7fe96adad640 1 --2- 172.21.15.55:0/2098365950 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe9480663a0 0x7fe948068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe958009b60 tx=0x7fe958009190 comp rx=0 tx=0).stop 2023-07-06T21:55:04.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.570+0000 7fe96adad640 1 -- 172.21.15.55:0/2098365950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9640ccab0 msgr2=0x7fe96415a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:04.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.570+0000 7fe96adad640 1 --2- 172.21.15.55:0/2098365950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9640ccab0 0x7fe96415a950 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe95c01a5b0 tx=0x7fe95c019720 comp rx=0 tx=0).stop 2023-07-06T21:55:04.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.570+0000 7fe96adad640 1 -- 172.21.15.55:0/2098365950 shutdown_connections 2023-07-06T21:55:04.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.570+0000 7fe96adad640 1 --2- 172.21.15.55:0/2098365950 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe9480663a0 0x7fe948068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.570+0000 7fe96adad640 1 --2- 172.21.15.55:0/2098365950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9640ccab0 0x7fe96415a950 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.570+0000 7fe96adad640 1 --2- 172.21.15.55:0/2098365950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9640b7cd0 0x7fe9641535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.570+0000 7fe96adad640 1 --2- 172.21.15.55:0/2098365950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9640b1fe0 0x7fe9640c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.570+0000 7fe96adad640 1 -- 172.21.15.55:0/2098365950 >> 172.21.15.55:0/2098365950 conn(0x7fe9640ceee0 msgr2=0x7fe9640b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:04.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.570+0000 7fe96adad640 1 -- 172.21.15.55:0/2098365950 shutdown_connections 2023-07-06T21:55:04.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.570+0000 7fe96adad640 1 -- 172.21.15.55:0/2098365950 wait complete. 2023-07-06T21:55:04.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:55:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.734+0000 7fc493d1e640 1 Processor -- start 2023-07-06T21:55:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.734+0000 7fc493d1e640 1 -- start start 2023-07-06T21:55:04.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.734+0000 7fc493d1e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc48c0ce610 0x7fc48c0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:04.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.734+0000 7fc493d1e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc48c0b1e10 0x7fc48c15f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:04.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.734+0000 7fc493d1e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c0cd1c0 con 0x7fc48c0b7cd0 2023-07-06T21:55:04.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.734+0000 7fc493d1e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c0d2310 con 0x7fc48c0b1e10 2023-07-06T21:55:04.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.734+0000 7fc493d1e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c0b80a0 con 0x7fc48c0ce610 2023-07-06T21:55:04.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.734+0000 7fc4922bb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc48c0b1e10 0x7fc48c15f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:04.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.734+0000 7fc4922bb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc48c0b1e10 0x7fc48c15f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42624/0 (socket says 172.21.15.55:42624) 2023-07-06T21:55:04.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.734+0000 7fc4922bb640 1 -- 172.21.15.55:0/196371048 learned_addr learned my addr 172.21.15.55:0/196371048 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:04.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.738+0000 7fc4912b9640 1 --2- 172.21.15.55:0/196371048 >> v2:172.21.15.138:3300/0 conn(0x7fc48c0ce610 0x7fc48c0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:04.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.738+0000 7fc4922bb640 1 -- 172.21.15.55:0/196371048 >> v2:172.21.15.138:3300/0 conn(0x7fc48c0ce610 msgr2=0x7fc48c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:04.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.738+0000 7fc4922bb640 1 --2- 172.21.15.55:0/196371048 >> v2:172.21.15.138:3300/0 conn(0x7fc48c0ce610 0x7fc48c0b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.738+0000 7fc4922bb640 1 -- 172.21.15.55:0/196371048 >> v1:172.21.15.138:6789/0 conn(0x7fc48c0b7cd0 legacy=0x7fc48c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.738+0000 7fc4922bb640 1 -- 172.21.15.55:0/196371048 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c0b2270 con 0x7fc48c0b1e10 2023-07-06T21:55:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.738+0000 7fc4922bb640 1 --2- 172.21.15.55:0/196371048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c0b1e10 0x7fc48c15f870 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc48c065af0 tx=0x7fc48401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a38aacc9400489 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.738+0000 7fc490ab8640 1 -- 172.21.15.55:0/196371048 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4840a5600 con 0x7fc48c0b1e10 2023-07-06T21:55:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.738+0000 7fc490ab8640 1 -- 172.21.15.55:0/196371048 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4840a5760 con 0x7fc48c0b1e10 2023-07-06T21:55:04.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.738+0000 7fc490ab8640 1 -- 172.21.15.55:0/196371048 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4840a5af0 con 0x7fc48c0b1e10 2023-07-06T21:55:04.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.738+0000 7fc493d1e640 1 -- 172.21.15.55:0/196371048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c0b1e10 msgr2=0x7fc48c15f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:04.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.738+0000 7fc493d1e640 1 --2- 172.21.15.55:0/196371048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c0b1e10 0x7fc48c15f870 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc48c065af0 tx=0x7fc48401c940 comp rx=0 tx=0).stop 2023-07-06T21:55:04.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc493d1e640 1 -- 172.21.15.55:0/196371048 shutdown_connections 2023-07-06T21:55:04.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc493d1e640 1 --2- 172.21.15.55:0/196371048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c0b1e10 0x7fc48c15f870 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc493d1e640 1 --2- 172.21.15.55:0/196371048 >> v2:172.21.15.138:3300/0 conn(0x7fc48c0ce610 0x7fc48c0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc493d1e640 1 -- 172.21.15.55:0/196371048 >> 172.21.15.55:0/196371048 conn(0x7fc48c0ceee0 msgr2=0x7fc48c0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:04.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc493d1e640 1 -- 172.21.15.55:0/196371048 shutdown_connections 2023-07-06T21:55:04.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc493d1e640 1 -- 172.21.15.55:0/196371048 wait complete. 2023-07-06T21:55:04.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc493d1e640 1 Processor -- start 2023-07-06T21:55:04.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc493d1e640 1 -- start start 2023-07-06T21:55:04.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc493d1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c0b1e10 0x7fc48c147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:04.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc493d1e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc48c0b7cd0 0x7fc48c1532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:04.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc493d1e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc48c0ce610 0x7fc48c06a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:04.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc493d1e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0b5c10 con 0x7fc48c0b1e10 2023-07-06T21:55:04.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc493d1e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c14fc60 con 0x7fc48c0ce610 2023-07-06T21:55:04.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc493d1e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c1484b0 con 0x7fc48c0b7cd0 2023-07-06T21:55:04.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc491aba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c0b1e10 0x7fc48c147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:04.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc491aba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c0b1e10 0x7fc48c147f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42632/0 (socket says 172.21.15.55:42632) 2023-07-06T21:55:04.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc491aba640 1 -- 172.21.15.55:0/626960334 learned_addr learned my addr 172.21.15.55:0/626960334 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:04.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc4922bb640 1 --2- 172.21.15.55:0/626960334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc48c0ce610 0x7fc48c06a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:04.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc4912b9640 1 --2- 172.21.15.55:0/626960334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc48c0b7cd0 0x7fc48c1532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:04.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc491aba640 1 -- 172.21.15.55:0/626960334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc48c0b7cd0 msgr2=0x7fc48c1532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:04.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc491aba640 1 --2- 172.21.15.55:0/626960334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc48c0b7cd0 0x7fc48c1532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc491aba640 1 -- 172.21.15.55:0/626960334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc48c0ce610 msgr2=0x7fc48c06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:04.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc491aba640 1 --2- 172.21.15.55:0/626960334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc48c0ce610 0x7fc48c06a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.742+0000 7fc491aba640 1 -- 172.21.15.55:0/626960334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc484009b30 con 0x7fc48c0b1e10 2023-07-06T21:55:04.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.746+0000 7fc491aba640 1 --2- 172.21.15.55:0/626960334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c0b1e10 0x7fc48c147f70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc48800c530 tx=0x7fc48800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:04.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.746+0000 7fc4827fc640 1 -- 172.21.15.55:0/626960334 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488005220 con 0x7fc48c0b1e10 2023-07-06T21:55:04.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.746+0000 7fc4827fc640 1 -- 172.21.15.55:0/626960334 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc488005380 con 0x7fc48c0b1e10 2023-07-06T21:55:04.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.746+0000 7fc4827fc640 1 -- 172.21.15.55:0/626960334 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488007270 con 0x7fc48c0b1e10 2023-07-06T21:55:04.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.746+0000 7fc493d1e640 1 -- 172.21.15.55:0/626960334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48c0b66c0 con 0x7fc48c0b1e10 2023-07-06T21:55:04.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.746+0000 7fc493d1e640 1 -- 172.21.15.55:0/626960334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48c0b6100 con 0x7fc48c0b1e10 2023-07-06T21:55:04.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.746+0000 7fc493d1e640 1 -- 172.21.15.55:0/626960334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48c14fa30 con 0x7fc48c0b1e10 2023-07-06T21:55:04.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.746+0000 7fc4827fc640 1 -- 172.21.15.55:0/626960334 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc4880073d0 con 0x7fc48c0b1e10 2023-07-06T21:55:04.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.746+0000 7fc4827fc640 1 --2- 172.21.15.55:0/626960334 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fc4700663a0 0x7fc470068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:04.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.746+0000 7fc4827fc640 1 -- 172.21.15.55:0/626960334 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc488083850 con 0x7fc48c0b1e10 2023-07-06T21:55:04.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.746+0000 7fc4912b9640 1 --2- 172.21.15.55:0/626960334 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fc4700663a0 0x7fc470068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:04.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.750+0000 7fc4912b9640 1 --2- 172.21.15.55:0/626960334 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fc4700663a0 0x7fc470068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc48c1f7720 tx=0x7fc47c008040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:04.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.750+0000 7fc4827fc640 1 -- 172.21.15.55:0/626960334 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc48c14fa30 con 0x7fc48c0b1e10 2023-07-06T21:55:04.770 INFO:tasks.ceph.mds.b.smithi138.stderr:2023-07-06T21:55:04.769+0000 7f3982055640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T21:55:04.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.906+0000 7fc493d1e640 1 -- 172.21.15.55:0/626960334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc48c066d60 con 0x7fc48c0b1e10 2023-07-06T21:55:04.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.906+0000 7fc4827fc640 1 -- 172.21.15.55:0/626960334 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18553 (secure 0 0 0) 0x7fc488081e60 con 0x7fc48c0b1e10 2023-07-06T21:55:04.909 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:04.909 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":72,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:55:04.192052+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:55:02.300695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-07-06T21:55:03.183596+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:55:04.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.910+0000 7fc493d1e640 1 -- 172.21.15.55:0/626960334 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fc4700663a0 msgr2=0x7fc470068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:04.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.910+0000 7fc493d1e640 1 --2- 172.21.15.55:0/626960334 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fc4700663a0 0x7fc470068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc48c1f7720 tx=0x7fc47c008040 comp rx=0 tx=0).stop 2023-07-06T21:55:04.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.910+0000 7fc493d1e640 1 -- 172.21.15.55:0/626960334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c0b1e10 msgr2=0x7fc48c147f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:04.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.910+0000 7fc493d1e640 1 --2- 172.21.15.55:0/626960334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c0b1e10 0x7fc48c147f70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc48800c530 tx=0x7fc48800c9f0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.910+0000 7fc493d1e640 1 -- 172.21.15.55:0/626960334 shutdown_connections 2023-07-06T21:55:04.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.910+0000 7fc493d1e640 1 --2- 172.21.15.55:0/626960334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc48c0ce610 0x7fc48c06a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.910+0000 7fc493d1e640 1 --2- 172.21.15.55:0/626960334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc48c0b7cd0 0x7fc48c1532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.910+0000 7fc493d1e640 1 --2- 172.21.15.55:0/626960334 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fc4700663a0 0x7fc470068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.910+0000 7fc493d1e640 1 --2- 172.21.15.55:0/626960334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c0b1e10 0x7fc48c147f70 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:04.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.910+0000 7fc493d1e640 1 -- 172.21.15.55:0/626960334 >> 172.21.15.55:0/626960334 conn(0x7fc48c0ceee0 msgr2=0x7fc48c0cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:04.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.910+0000 7fc493d1e640 1 -- 172.21.15.55:0/626960334 shutdown_connections 2023-07-06T21:55:04.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:04.910+0000 7fc493d1e640 1 -- 172.21.15.55:0/626960334 wait complete. 2023-07-06T21:55:04.930 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T21:55:05.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.074+0000 7f0089c48640 1 Processor -- start 2023-07-06T21:55:05.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.074+0000 7f0089c48640 1 -- start start 2023-07-06T21:55:05.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.074+0000 7f0089c48640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0084158850 0x7f00840cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:05.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.074+0000 7f0089c48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00840ca130 0x7f00840ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:05.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.074+0000 7f0089c48640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00840b2aa0 con 0x7f00840703e0 2023-07-06T21:55:05.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.074+0000 7f0089c48640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0084158c20 con 0x7f0084158850 2023-07-06T21:55:05.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.074+0000 7f0089c48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00840c8db0 con 0x7f00840ca130 2023-07-06T21:55:05.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f0083fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f00840703e0 0x7f008406eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54476/0 (socket says 172.21.15.55:54476) 2023-07-06T21:55:05.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f0083fff640 1 -- 172.21.15.55:0/2062708218 learned_addr learned my addr 172.21.15.55:0/2062708218 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:55:05.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f0082ffd640 1 --2- 172.21.15.55:0/2062708218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00840ca130 0x7f00840ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:05.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00837fe640 1 --2- 172.21.15.55:0/2062708218 >> v2:172.21.15.138:3300/0 conn(0x7f0084158850 0x7f00840cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:05.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 -- 172.21.15.55:0/2062708218 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327230869 0 0) 0x7f00840b2aa0 con 0x7f00840703e0 2023-07-06T21:55:05.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 -- 172.21.15.55:0/2062708218 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f006c003530 con 0x7f00840703e0 2023-07-06T21:55:05.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 -- 172.21.15.55:0/2062708218 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4215145579 0 0) 0x7f006c003530 con 0x7f00840703e0 2023-07-06T21:55:05.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 -- 172.21.15.55:0/2062708218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00840ca130 msgr2=0x7f00840ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:05.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 --2- 172.21.15.55:0/2062708218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00840ca130 0x7f00840ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:05.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 -- 172.21.15.55:0/2062708218 >> v2:172.21.15.138:3300/0 conn(0x7f0084158850 msgr2=0x7f00840cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:05.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 --2- 172.21.15.55:0/2062708218 >> v2:172.21.15.138:3300/0 conn(0x7f0084158850 0x7f00840cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:05.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 -- 172.21.15.55:0/2062708218 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00840c9090 con 0x7f00840703e0 2023-07-06T21:55:05.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 -- 172.21.15.55:0/2062708218 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f007c001a00 con 0x7f00840703e0 2023-07-06T21:55:05.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00837fe640 1 --2- 172.21.15.55:0/2062708218 >> v2:172.21.15.138:3300/0 conn(0x7f0084158850 0x7f00840cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:55:05.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 -- 172.21.15.55:0/2062708218 >> v1:172.21.15.55:6789/0 conn(0x7f00840703e0 legacy=0x7f008406eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:05.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 --2- 172.21.15.55:0/2062708218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f006c003980 0x7f006c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:05.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 --2- 172.21.15.55:0/2062708218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f006c0043b0 0x7f006c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:05.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 --2- 172.21.15.55:0/2062708218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00840ca130 0x7f006c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:05.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 -- 172.21.15.55:0/2062708218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084158c20 con 0x7f006c0043b0 2023-07-06T21:55:05.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 -- 172.21.15.55:0/2062708218 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00840c8db0 con 0x7f006c003980 2023-07-06T21:55:05.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00827fc640 1 -- 172.21.15.55:0/2062708218 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006c00dba0 con 0x7f00840ca130 2023-07-06T21:55:05.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f0082ffd640 1 --2- 172.21.15.55:0/2062708218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f006c0043b0 0x7f006c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:05.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f00837fe640 1 --2- 172.21.15.55:0/2062708218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f006c003980 0x7f006c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:05.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f0083fff640 1 --2- 172.21.15.55:0/2062708218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00840ca130 0x7f006c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:05.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f0082ffd640 1 -- 172.21.15.55:0/2062708218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00840ca130 msgr2=0x7f006c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:05.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f0082ffd640 1 --2- 172.21.15.55:0/2062708218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00840ca130 0x7f006c004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:05.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f0082ffd640 1 -- 172.21.15.55:0/2062708218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f006c003980 msgr2=0x7f006c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:05.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f0082ffd640 1 --2- 172.21.15.55:0/2062708218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f006c003980 0x7f006c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:05.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.078+0000 7f0082ffd640 1 -- 172.21.15.55:0/2062708218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c003530 con 0x7f006c0043b0 2023-07-06T21:55:05.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.082+0000 7f0082ffd640 1 --2- 172.21.15.55:0/2062708218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f006c0043b0 0x7f006c004870 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0078009ae0 tx=0x7f007801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac154df0a5405ed server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:05.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.082+0000 7f00827fc640 1 -- 172.21.15.55:0/2062708218 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780a5640 con 0x7f006c0043b0 2023-07-06T21:55:05.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.082+0000 7f00827fc640 1 -- 172.21.15.55:0/2062708218 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00780a57a0 con 0x7f006c0043b0 2023-07-06T21:55:05.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.082+0000 7f00827fc640 1 -- 172.21.15.55:0/2062708218 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780a5b50 con 0x7f006c0043b0 2023-07-06T21:55:05.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.082+0000 7f0089c48640 1 -- 172.21.15.55:0/2062708218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f006c0043b0 msgr2=0x7f006c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:05.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.082+0000 7f0089c48640 1 --2- 172.21.15.55:0/2062708218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f006c0043b0 0x7f006c004870 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0078009ae0 tx=0x7f007801ca50 comp rx=0 tx=0).stop 2023-07-06T21:55:05.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.082+0000 7f0083fff640 1 -- 172.21.15.55:0/2062708218 reap_dead start 2023-07-06T21:55:05.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.082+0000 7f0089c48640 1 -- 172.21.15.55:0/2062708218 shutdown_connections 2023-07-06T21:55:05.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.082+0000 7f0089c48640 1 -- 172.21.15.55:0/2062708218 >> 172.21.15.55:0/2062708218 conn(0x7f00840cea70 msgr2=0x7f00840ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:05.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.082+0000 7f0089c48640 1 -- 172.21.15.55:0/2062708218 shutdown_connections 2023-07-06T21:55:05.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.082+0000 7f0089c48640 1 -- 172.21.15.55:0/2062708218 wait complete. 2023-07-06T21:55:05.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.082+0000 7f0089c48640 1 Processor -- start 2023-07-06T21:55:05.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.082+0000 7f0089c48640 1 -- start start 2023-07-06T21:55:05.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0089c48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f006c0043b0 0x7f00840b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:05.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0089c48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00841f0ce0 0x7f00840ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:05.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0089c48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00840a90a0 0x7f00840a9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:05.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0089c48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00840a9a50 con 0x7f00840a90a0 2023-07-06T21:55:05.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0089c48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084069710 con 0x7f00841f0ce0 2023-07-06T21:55:05.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0089c48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00840ae220 con 0x7f006c0043b0 2023-07-06T21:55:05.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0083fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00840a90a0 0x7f00840a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:05.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f00837fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f006c0043b0 0x7f00840b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:05.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0083fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00840a90a0 0x7f00840a9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42648/0 (socket says 172.21.15.55:42648) 2023-07-06T21:55:05.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0083fff640 1 -- 172.21.15.55:0/2314468391 learned_addr learned my addr 172.21.15.55:0/2314468391 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:05.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0082ffd640 1 --2- 172.21.15.55:0/2314468391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00841f0ce0 0x7f00840ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:05.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0083fff640 1 -- 172.21.15.55:0/2314468391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f006c0043b0 msgr2=0x7f00840b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:05.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0083fff640 1 --2- 172.21.15.55:0/2314468391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f006c0043b0 0x7f00840b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:05.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0083fff640 1 -- 172.21.15.55:0/2314468391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00841f0ce0 msgr2=0x7f00840ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:05.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0083fff640 1 --2- 172.21.15.55:0/2314468391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00841f0ce0 0x7f00840ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:05.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0083fff640 1 -- 172.21.15.55:0/2314468391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00840ae500 con 0x7f00840a90a0 2023-07-06T21:55:05.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0083fff640 1 --2- 172.21.15.55:0/2314468391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00840a90a0 0x7f00840a9510 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f007c000f90 tx=0x7f007c007960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:05.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f006bfff640 1 -- 172.21.15.55:0/2314468391 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c010510 con 0x7f00840a90a0 2023-07-06T21:55:05.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f006bfff640 1 -- 172.21.15.55:0/2314468391 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007c010670 con 0x7f00840a90a0 2023-07-06T21:55:05.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f006bfff640 1 -- 172.21.15.55:0/2314468391 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c010a20 con 0x7f00840a90a0 2023-07-06T21:55:05.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0089c48640 1 -- 172.21.15.55:0/2314468391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00840ae7e0 con 0x7f00840a90a0 2023-07-06T21:55:05.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0089c48640 1 -- 172.21.15.55:0/2314468391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00840aeda0 con 0x7f00840a90a0 2023-07-06T21:55:05.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f0089c48640 1 -- 172.21.15.55:0/2314468391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00840aef90 con 0x7f00840a90a0 2023-07-06T21:55:05.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.086+0000 7f006bfff640 1 -- 172.21.15.55:0/2314468391 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f007c010b80 con 0x7f00840a90a0 2023-07-06T21:55:05.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.090+0000 7f006bfff640 1 --2- 172.21.15.55:0/2314468391 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f00700663d0 0x7f0070068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:05.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.090+0000 7f006bfff640 1 -- 172.21.15.55:0/2314468391 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f007c0837b0 con 0x7f00840a90a0 2023-07-06T21:55:05.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.090+0000 7f00837fe640 1 --2- 172.21.15.55:0/2314468391 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f00700663d0 0x7f0070068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:05.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.090+0000 7f00837fe640 1 --2- 172.21.15.55:0/2314468391 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f00700663d0 0x7f0070068880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0074009de0 tx=0x7f0074009190 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:05.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.094+0000 7f006bfff640 1 -- 172.21.15.55:0/2314468391 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f007c054590 con 0x7f00840a90a0 2023-07-06T21:55:05.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:05.282+0000 7f0089c48640 1 -- 172.21.15.55:0/2314468391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f00840aef90 con 0x7f00840a90a0 2023-07-06T21:55:06.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.198+0000 7f006bfff640 1 -- 172.21.15.55:0/2314468391 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f007c054120 con 0x7f00840a90a0 2023-07-06T21:55:06.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.202+0000 7f0089c48640 1 -- 172.21.15.55:0/2314468391 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f00700663d0 msgr2=0x7f0070068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:06.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.202+0000 7f0089c48640 1 --2- 172.21.15.55:0/2314468391 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f00700663d0 0x7f0070068880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0074009de0 tx=0x7f0074009190 comp rx=0 tx=0).stop 2023-07-06T21:55:06.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.202+0000 7f0089c48640 1 -- 172.21.15.55:0/2314468391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00840a90a0 msgr2=0x7f00840a9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:06.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.202+0000 7f0089c48640 1 --2- 172.21.15.55:0/2314468391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00840a90a0 0x7f00840a9510 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f007c000f90 tx=0x7f007c007960 comp rx=0 tx=0).stop 2023-07-06T21:55:06.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.202+0000 7f0089c48640 1 -- 172.21.15.55:0/2314468391 shutdown_connections 2023-07-06T21:55:06.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.202+0000 7f0089c48640 1 --2- 172.21.15.55:0/2314468391 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f00700663d0 0x7f0070068880 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:06.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.202+0000 7f0089c48640 1 --2- 172.21.15.55:0/2314468391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00840a90a0 0x7f00840a9510 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:06.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.202+0000 7f0089c48640 1 --2- 172.21.15.55:0/2314468391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00841f0ce0 0x7f00840ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:06.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.202+0000 7f0089c48640 1 --2- 172.21.15.55:0/2314468391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f006c0043b0 0x7f00840b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:06.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.202+0000 7f0089c48640 1 -- 172.21.15.55:0/2314468391 >> 172.21.15.55:0/2314468391 conn(0x7f00840cea70 msgr2=0x7f00840c61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:06.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.202+0000 7f0089c48640 1 -- 172.21.15.55:0/2314468391 shutdown_connections 2023-07-06T21:55:06.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.202+0000 7f0089c48640 1 -- 172.21.15.55:0/2314468391 wait complete. 2023-07-06T21:55:06.224 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-06T21:55:06.225 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T21:55:06.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.374+0000 7f4d3ee76640 1 Processor -- start 2023-07-06T21:55:06.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.374+0000 7f4d3ee76640 1 -- start start 2023-07-06T21:55:06.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3ee76640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d380d0630 0x7f4d3815fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:06.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3ee76640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4d380ce200 0x7f4d380ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:06.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3ee76640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d380cc740 con 0x7f4d380b1250 2023-07-06T21:55:06.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3ee76640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d380ccc90 con 0x7f4d380ce200 2023-07-06T21:55:06.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3ee76640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380b29c0 con 0x7f4d380d0630 2023-07-06T21:55:06.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3de74640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4d380b1250 0x7f4d3815f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54482/0 (socket says 172.21.15.55:54482) 2023-07-06T21:55:06.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3de74640 1 -- 172.21.15.55:0/331654171 learned_addr learned my addr 172.21.15.55:0/331654171 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:55:06.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3d673640 1 --2- 172.21.15.55:0/331654171 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d380d0630 0x7f4d3815fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:06.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3e675640 1 --2- 172.21.15.55:0/331654171 >> v2:172.21.15.138:3300/0 conn(0x7f4d380ce200 0x7f4d380ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:06.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3ce72640 1 -- 172.21.15.55:0/331654171 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051757207 0 0) 0x7f4d380cc740 con 0x7f4d380b1250 2023-07-06T21:55:06.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3ce72640 1 -- 172.21.15.55:0/331654171 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d24003530 con 0x7f4d380b1250 2023-07-06T21:55:06.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3ce72640 1 -- 172.21.15.55:0/331654171 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 579022991 0 0) 0x7f4d24003530 con 0x7f4d380b1250 2023-07-06T21:55:06.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3d673640 1 -- 172.21.15.55:0/331654171 >> v2:172.21.15.138:3300/0 conn(0x7f4d380ce200 msgr2=0x7f4d380ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:06.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3d673640 1 --2- 172.21.15.55:0/331654171 >> v2:172.21.15.138:3300/0 conn(0x7f4d380ce200 0x7f4d380ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:06.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3d673640 1 -- 172.21.15.55:0/331654171 >> v1:172.21.15.55:6789/0 conn(0x7f4d380b1250 legacy=0x7f4d3815f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:06.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.378+0000 7f4d3d673640 1 -- 172.21.15.55:0/331654171 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380d1d10 con 0x7f4d380d0630 2023-07-06T21:55:06.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.382+0000 7f4d3d673640 1 --2- 172.21.15.55:0/331654171 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d380d0630 0x7f4d3815fa90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4d280097c0 tx=0x7f4d2801c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77ed11fd7abdaf09 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:06.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.382+0000 7f4d3ce72640 1 -- 172.21.15.55:0/331654171 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34001680 con 0x7f4d380d0630 2023-07-06T21:55:06.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.382+0000 7f4d3ce72640 1 -- 172.21.15.55:0/331654171 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d280a7050 con 0x7f4d380d0630 2023-07-06T21:55:06.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.382+0000 7f4d3ce72640 1 -- 172.21.15.55:0/331654171 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d280ab620 con 0x7f4d380d0630 2023-07-06T21:55:06.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.382+0000 7f4d3ee76640 1 -- 172.21.15.55:0/331654171 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d380d0630 msgr2=0x7f4d3815fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:06.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.382+0000 7f4d3ee76640 1 --2- 172.21.15.55:0/331654171 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d380d0630 0x7f4d3815fa90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4d280097c0 tx=0x7f4d2801c310 comp rx=0 tx=0).stop 2023-07-06T21:55:06.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.382+0000 7f4d3ee76640 1 -- 172.21.15.55:0/331654171 shutdown_connections 2023-07-06T21:55:06.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.382+0000 7f4d3ee76640 1 --2- 172.21.15.55:0/331654171 >> v2:172.21.15.138:3300/0 conn(0x7f4d380ce200 0x7f4d380ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:06.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.382+0000 7f4d3ee76640 1 --2- 172.21.15.55:0/331654171 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d380d0630 0x7f4d3815fa90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:06.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.382+0000 7f4d3ee76640 1 -- 172.21.15.55:0/331654171 >> 172.21.15.55:0/331654171 conn(0x7f4d380b3b60 msgr2=0x7f4d380b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:06.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.382+0000 7f4d3ee76640 1 -- 172.21.15.55:0/331654171 shutdown_connections 2023-07-06T21:55:06.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.382+0000 7f4d3ee76640 1 -- 172.21.15.55:0/331654171 wait complete. 2023-07-06T21:55:06.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.382+0000 7f4d3ee76640 1 Processor -- start 2023-07-06T21:55:06.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.382+0000 7f4d3ee76640 1 -- start start 2023-07-06T21:55:06.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3ee76640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d380b1250 0x7f4d381525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:06.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3ee76640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d380ce200 0x7f4d38152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:06.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3ee76640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d380d0630 0x7f4d3814f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:06.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3ee76640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380ca100 con 0x7f4d380b1250 2023-07-06T21:55:06.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3ee76640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3814fdf0 con 0x7f4d380ce200 2023-07-06T21:55:06.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3ee76640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380c89c0 con 0x7f4d380d0630 2023-07-06T21:55:06.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3de74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d380b1250 0x7f4d381525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:06.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3de74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d380b1250 0x7f4d381525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42654/0 (socket says 172.21.15.55:42654) 2023-07-06T21:55:06.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3de74640 1 -- 172.21.15.55:0/4204246937 learned_addr learned my addr 172.21.15.55:0/4204246937 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:06.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3d673640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d380ce200 0x7f4d38152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:06.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3e675640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d380d0630 0x7f4d3814f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:06.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3de74640 1 -- 172.21.15.55:0/4204246937 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d380d0630 msgr2=0x7f4d3814f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:06.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3de74640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d380d0630 0x7f4d3814f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:06.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3de74640 1 -- 172.21.15.55:0/4204246937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d380ce200 msgr2=0x7f4d38152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:06.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3de74640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d380ce200 0x7f4d38152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:06.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3de74640 1 -- 172.21.15.55:0/4204246937 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d28009420 con 0x7f4d380b1250 2023-07-06T21:55:06.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3d673640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d380ce200 0x7f4d38152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:55:06.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3e675640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d380d0630 0x7f4d3814f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:55:06.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3de74640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d380b1250 0x7f4d381525d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c750 tx=0x7f4d3400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:06.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d2e7fc640 1 -- 172.21.15.55:0/4204246937 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34005ae0 con 0x7f4d380b1250 2023-07-06T21:55:06.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d2e7fc640 1 -- 172.21.15.55:0/4204246937 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d34005c40 con 0x7f4d380b1250 2023-07-06T21:55:06.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d2e7fc640 1 -- 172.21.15.55:0/4204246937 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34007070 con 0x7f4d380b1250 2023-07-06T21:55:06.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3ee76640 1 -- 172.21.15.55:0/4204246937 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d380c9b40 con 0x7f4d380b1250 2023-07-06T21:55:06.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3ee76640 1 -- 172.21.15.55:0/4204246937 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d38151300 con 0x7f4d380b1250 2023-07-06T21:55:06.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d3ee76640 1 -- 172.21.15.55:0/4204246937 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3804d790 con 0x7f4d380b1250 2023-07-06T21:55:06.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.386+0000 7f4d2e7fc640 1 -- 172.21.15.55:0/4204246937 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4d340071f0 con 0x7f4d380b1250 2023-07-06T21:55:06.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.390+0000 7f4d2e7fc640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f4d1c0663a0 0x7f4d1c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:06.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.390+0000 7f4d2e7fc640 1 -- 172.21.15.55:0/4204246937 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4d34083e70 con 0x7f4d380b1250 2023-07-06T21:55:06.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.390+0000 7f4d3d673640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f4d1c0663a0 0x7f4d1c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:06.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.390+0000 7f4d3d673640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f4d1c0663a0 0x7f4d1c068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d280ad000 tx=0x7f4d28008040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:06.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.394+0000 7f4d2e7fc640 1 -- 172.21.15.55:0/4204246937 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4d34051000 con 0x7f4d380b1250 2023-07-06T21:55:06.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:06.578+0000 7f4d3ee76640 1 -- 172.21.15.55:0/4204246937 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4d3814fbc0 con 0x7f4d380b1250 2023-07-06T21:55:06.790 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:55:06.794 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:55:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.214+0000 7f4d2e7fc640 1 -- 172.21.15.55:0/4204246937 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4d34054620 con 0x7f4d380b1250 2023-07-06T21:55:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.214+0000 7f4d3ee76640 1 -- 172.21.15.55:0/4204246937 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f4d1c0663a0 msgr2=0x7f4d1c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:07.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.214+0000 7f4d3ee76640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f4d1c0663a0 0x7f4d1c068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d280ad000 tx=0x7f4d28008040 comp rx=0 tx=0).stop 2023-07-06T21:55:07.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.214+0000 7f4d3ee76640 1 -- 172.21.15.55:0/4204246937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d380b1250 msgr2=0x7f4d381525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:07.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.214+0000 7f4d3ee76640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d380b1250 0x7f4d381525d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c750 tx=0x7f4d3400cc10 comp rx=0 tx=0).stop 2023-07-06T21:55:07.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.214+0000 7f4d3ee76640 1 -- 172.21.15.55:0/4204246937 shutdown_connections 2023-07-06T21:55:07.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.214+0000 7f4d3ee76640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d380d0630 0x7f4d3814f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.214+0000 7f4d3ee76640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d380ce200 0x7f4d38152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.214+0000 7f4d3ee76640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f4d1c0663a0 0x7f4d1c068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.214+0000 7f4d3ee76640 1 --2- 172.21.15.55:0/4204246937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d380b1250 0x7f4d381525d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.214+0000 7f4d3ee76640 1 -- 172.21.15.55:0/4204246937 >> 172.21.15.55:0/4204246937 conn(0x7f4d380b3b60 msgr2=0x7f4d380b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:07.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.214+0000 7f4d3ee76640 1 -- 172.21.15.55:0/4204246937 shutdown_connections 2023-07-06T21:55:07.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.214+0000 7f4d3ee76640 1 -- 172.21.15.55:0/4204246937 wait complete. 2023-07-06T21:55:07.237 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T21:55:07.237 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:55:07.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1ba8f2c640 1 Processor -- start 2023-07-06T21:55:07.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1ba8f2c640 1 -- start start 2023-07-06T21:55:07.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1ba8f2c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1ba41587d0 0x7f1ba4070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:07.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1ba8f2c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ba40710c0 0x7f1ba40cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:07.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1ba8f2c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba406fae0 con 0x7f1ba4158400 2023-07-06T21:55:07.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1ba8f2c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba406fdc0 con 0x7f1ba41587d0 2023-07-06T21:55:07.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1ba8f2c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba40700a0 con 0x7f1ba40710c0 2023-07-06T21:55:07.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1ba259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1ba4158400 0x7f1ba40c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54488/0 (socket says 172.21.15.55:54488) 2023-07-06T21:55:07.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1ba259c640 1 -- 172.21.15.55:0/3694516054 learned_addr learned my addr 172.21.15.55:0/3694516054 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:55:07.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1b9bfff640 1 --2- 172.21.15.55:0/3694516054 >> v2:172.21.15.55:3300/0 conn(0x7f1ba41587d0 0x7f1ba4070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:07.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1ba2d9d640 1 --2- 172.21.15.55:0/3694516054 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ba40710c0 0x7f1ba40cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:07.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1b9bfff640 1 -- 172.21.15.55:0/3694516054 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ba40710c0 msgr2=0x7f1ba40cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:07.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1b9bfff640 1 --2- 172.21.15.55:0/3694516054 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ba40710c0 0x7f1ba40cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1b9bfff640 1 -- 172.21.15.55:0/3694516054 >> v1:172.21.15.55:6789/0 conn(0x7f1ba4158400 legacy=0x7f1ba40c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:07.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.382+0000 7f1b9bfff640 1 -- 172.21.15.55:0/3694516054 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba4070380 con 0x7f1ba41587d0 2023-07-06T21:55:07.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.386+0000 7f1b9bfff640 1 --2- 172.21.15.55:0/3694516054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ba41587d0 0x7f1ba4070b80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0097c0 tx=0x7f1b8c01e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b261c9c99a8934e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:07.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.386+0000 7f1ba1d9b640 1 -- 172.21.15.55:0/3694516054 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c0ab640 con 0x7f1ba41587d0 2023-07-06T21:55:07.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.386+0000 7f1ba1d9b640 1 -- 172.21.15.55:0/3694516054 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c0ab7a0 con 0x7f1ba41587d0 2023-07-06T21:55:07.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.386+0000 7f1ba1d9b640 1 -- 172.21.15.55:0/3694516054 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c0abb30 con 0x7f1ba41587d0 2023-07-06T21:55:07.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.386+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/3694516054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ba41587d0 msgr2=0x7f1ba4070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:07.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.386+0000 7f1ba8f2c640 1 --2- 172.21.15.55:0/3694516054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ba41587d0 0x7f1ba4070b80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0097c0 tx=0x7f1b8c01e660 comp rx=0 tx=0).stop 2023-07-06T21:55:07.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.386+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/3694516054 shutdown_connections 2023-07-06T21:55:07.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.386+0000 7f1ba8f2c640 1 --2- 172.21.15.55:0/3694516054 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ba40710c0 0x7f1ba40cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.386+0000 7f1ba8f2c640 1 --2- 172.21.15.55:0/3694516054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ba41587d0 0x7f1ba4070b80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.386+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/3694516054 >> 172.21.15.55:0/3694516054 conn(0x7f1ba40cded0 msgr2=0x7f1ba40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:07.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.386+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/3694516054 shutdown_connections 2023-07-06T21:55:07.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.386+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/3694516054 wait complete. 2023-07-06T21:55:07.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba8f2c640 1 Processor -- start 2023-07-06T21:55:07.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba8f2c640 1 -- start start 2023-07-06T21:55:07.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba8f2c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ba40710c0 0x7f1ba40c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:07.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba8f2c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ba4158400 0x7f1ba40c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:07.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba8f2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ba41587d0 0x7f1ba4156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:07.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba8f2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba40c74a0 con 0x7f1ba41587d0 2023-07-06T21:55:07.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba8f2c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba4157b00 con 0x7f1ba4158400 2023-07-06T21:55:07.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba8f2c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba40c4320 con 0x7f1ba40710c0 2023-07-06T21:55:07.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ba41587d0 0x7f1ba4156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:07.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ba41587d0 0x7f1ba4156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42664/0 (socket says 172.21.15.55:42664) 2023-07-06T21:55:07.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba2d9d640 1 -- 172.21.15.55:0/55263858 learned_addr learned my addr 172.21.15.55:0/55263858 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:07.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba259c640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ba40710c0 0x7f1ba40c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:07.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba2d9d640 1 -- 172.21.15.55:0/55263858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ba40710c0 msgr2=0x7f1ba40c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:07.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba2d9d640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ba40710c0 0x7f1ba40c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1b9bfff640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ba4158400 0x7f1ba40c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:07.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba2d9d640 1 -- 172.21.15.55:0/55263858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ba4158400 msgr2=0x7f1ba40c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:07.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba2d9d640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ba4158400 0x7f1ba40c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba2d9d640 1 -- 172.21.15.55:0/55263858 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c009420 con 0x7f1ba41587d0 2023-07-06T21:55:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba259c640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ba40710c0 0x7f1ba40c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:55:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1b9bfff640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ba4158400 0x7f1ba40c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:55:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba2d9d640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ba41587d0 0x7f1ba4156660 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c007e70 tx=0x7f1b9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1b9affd640 1 -- 172.21.15.55:0/55263858 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c014620 con 0x7f1ba41587d0 2023-07-06T21:55:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1b9affd640 1 -- 172.21.15.55:0/55263858 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9c0147a0 con 0x7f1ba41587d0 2023-07-06T21:55:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1b9affd640 1 -- 172.21.15.55:0/55263858 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c014b50 con 0x7f1ba41587d0 2023-07-06T21:55:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/55263858 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba40c6b90 con 0x7f1ba41587d0 2023-07-06T21:55:07.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.390+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/55263858 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba40c60b0 con 0x7f1ba41587d0 2023-07-06T21:55:07.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.394+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/55263858 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba406c580 con 0x7f1ba41587d0 2023-07-06T21:55:07.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.394+0000 7f1b9affd640 1 -- 172.21.15.55:0/55263858 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1b9c014cb0 con 0x7f1ba41587d0 2023-07-06T21:55:07.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.394+0000 7f1b9affd640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f1b840663a0 0x7f1b84068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:07.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.394+0000 7f1b9affd640 1 -- 172.21.15.55:0/55263858 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1b9c0848e0 con 0x7f1ba41587d0 2023-07-06T21:55:07.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.394+0000 7f1ba259c640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f1b840663a0 0x7f1b84068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:07.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.394+0000 7f1ba259c640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f1b840663a0 0x7f1b84068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b94005890 tx=0x7f1b94009040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:07.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.398+0000 7f1b9affd640 1 -- 172.21.15.55:0/55263858 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b9c055630 con 0x7f1ba41587d0 2023-07-06T21:55:07.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.582+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/55263858 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ba40c75e0 con 0x7f1ba41587d0 2023-07-06T21:55:07.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.586+0000 7f1b9affd640 1 -- 172.21.15.55:0/55263858 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f1ba40c75e0 con 0x7f1ba41587d0 2023-07-06T21:55:07.585 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:07.585 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2986611670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2986611670},{"type":"v1","addr":"172.21.15.138:6835","nonce":2986611670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6351,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2521348037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2521348037},{"type":"v1","addr":"172.21.15.55:6836","nonce":2521348037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1716722785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1716722785},{"type":"v1","addr":"172.21.15.55:6837","nonce":1716722785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:55:04.192386+0000","modified":"2023-07-06T21:55:07.200622+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6357":{"gid":6357,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6834/2595020915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2595020915},{"type":"v1","addr":"172.21.15.138:6834","nonce":2595020915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-06T21:55:07.586 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2023-07-06T21:55:07.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.586+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/55263858 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f1b840663a0 msgr2=0x7f1b84068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:07.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.586+0000 7f1ba8f2c640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f1b840663a0 0x7f1b84068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b94005890 tx=0x7f1b94009040 comp rx=0 tx=0).stop 2023-07-06T21:55:07.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.586+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/55263858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ba41587d0 msgr2=0x7f1ba4156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:07.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.586+0000 7f1ba8f2c640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ba41587d0 0x7f1ba4156660 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c007e70 tx=0x7f1b9c00e4b0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.586+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/55263858 shutdown_connections 2023-07-06T21:55:07.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.586+0000 7f1ba8f2c640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f1b840663a0 0x7f1b84068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.586+0000 7f1ba8f2c640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ba41587d0 0x7f1ba4156660 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.586+0000 7f1ba8f2c640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ba4158400 0x7f1ba40c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.586+0000 7f1ba8f2c640 1 --2- 172.21.15.55:0/55263858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ba40710c0 0x7f1ba40c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.586+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/55263858 >> 172.21.15.55:0/55263858 conn(0x7f1ba40cded0 msgr2=0x7f1ba40ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:07.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.586+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/55263858 shutdown_connections 2023-07-06T21:55:07.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.586+0000 7f1ba8f2c640 1 -- 172.21.15.55:0/55263858 wait complete. 2023-07-06T21:55:07.606 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:55:07.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0ed537640 1 Processor -- start 2023-07-06T21:55:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0ed537640 1 -- start start 2023-07-06T21:55:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0ed537640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe0e80b7cd0 0x7fe0e80ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0ed537640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0e80b1fe0 0x7fe0e815f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0ed537640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e80cecf0 con 0x7fe0e80ccab0 2023-07-06T21:55:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0ed537640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e80d2310 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0ed537640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e80b80a0 con 0x7fe0e80b7cd0 2023-07-06T21:55:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0e77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0e80b1fe0 0x7fe0e815f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0e77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0e80b1fe0 0x7fe0e815f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42680/0 (socket says 172.21.15.55:42680) 2023-07-06T21:55:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0e77fe640 1 -- 172.21.15.55:0/2115397142 learned_addr learned my addr 172.21.15.55:0/2115397142 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0e6ffd640 1 --2- 172.21.15.55:0/2115397142 >> v2:172.21.15.138:3300/0 conn(0x7fe0e80b7cd0 0x7fe0e80ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0e77fe640 1 -- 172.21.15.55:0/2115397142 >> v2:172.21.15.138:3300/0 conn(0x7fe0e80b7cd0 msgr2=0x7fe0e80ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0e77fe640 1 --2- 172.21.15.55:0/2115397142 >> v2:172.21.15.138:3300/0 conn(0x7fe0e80b7cd0 0x7fe0e80ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0e77fe640 1 -- 172.21.15.55:0/2115397142 >> v1:172.21.15.55:6789/0 conn(0x7fe0e80ccab0 legacy=0x7fe0e80b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0e77fe640 1 -- 172.21.15.55:0/2115397142 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80d1d90 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.750+0000 7fe0e6ffd640 1 --2- 172.21.15.55:0/2115397142 >> v2:172.21.15.138:3300/0 conn(0x7fe0e80b7cd0 0x7fe0e80ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:55:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.754+0000 7fe0e77fe640 1 --2- 172.21.15.55:0/2115397142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0e80b1fe0 0x7fe0e815f870 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe0e808b5d0 tx=0x7fe0e001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2bb73b2368e5d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.754+0000 7fe0e67fc640 1 -- 172.21.15.55:0/2115397142 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e00a5600 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.754+0000 7fe0e67fc640 1 -- 172.21.15.55:0/2115397142 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e00a5760 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.754+0000 7fe0e67fc640 1 -- 172.21.15.55:0/2115397142 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e00a5af0 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.754+0000 7fe0ed537640 1 -- 172.21.15.55:0/2115397142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0e80b1fe0 msgr2=0x7fe0e815f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.754+0000 7fe0ed537640 1 --2- 172.21.15.55:0/2115397142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0e80b1fe0 0x7fe0e815f870 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe0e808b5d0 tx=0x7fe0e001c940 comp rx=0 tx=0).stop 2023-07-06T21:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.754+0000 7fe0ed537640 1 -- 172.21.15.55:0/2115397142 shutdown_connections 2023-07-06T21:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.754+0000 7fe0ed537640 1 --2- 172.21.15.55:0/2115397142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0e80b1fe0 0x7fe0e815f870 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.754+0000 7fe0ed537640 1 --2- 172.21.15.55:0/2115397142 >> v2:172.21.15.138:3300/0 conn(0x7fe0e80b7cd0 0x7fe0e80ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.754+0000 7fe0ed537640 1 -- 172.21.15.55:0/2115397142 >> 172.21.15.55:0/2115397142 conn(0x7fe0e80ceee0 msgr2=0x7fe0e80cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.754+0000 7fe0ed537640 1 -- 172.21.15.55:0/2115397142 shutdown_connections 2023-07-06T21:55:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.754+0000 7fe0ed537640 1 -- 172.21.15.55:0/2115397142 wait complete. 2023-07-06T21:55:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0ed537640 1 Processor -- start 2023-07-06T21:55:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0ed537640 1 -- start start 2023-07-06T21:55:07.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0ed537640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0e80b1fe0 0x7fe0e815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:07.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0ed537640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0e80b7cd0 0x7fe0e814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:07.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0ed537640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0e80ccab0 0x7fe0e815cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:07.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0ed537640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e815cae0 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0ed537640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e815c800 con 0x7fe0e80ccab0 2023-07-06T21:55:07.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0ed537640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e81f7bd0 con 0x7fe0e80b7cd0 2023-07-06T21:55:07.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0e6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0e80b1fe0 0x7fe0e815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:07.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0e6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0e80b1fe0 0x7fe0e815afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42694/0 (socket says 172.21.15.55:42694) 2023-07-06T21:55:07.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0e6ffd640 1 -- 172.21.15.55:0/1636651414 learned_addr learned my addr 172.21.15.55:0/1636651414 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:07.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0dffff640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0e80b7cd0 0x7fe0e814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0e77fe640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0e80ccab0 0x7fe0e815cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0e6ffd640 1 -- 172.21.15.55:0/1636651414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0e80b7cd0 msgr2=0x7fe0e814dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0e6ffd640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0e80b7cd0 0x7fe0e814dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0e6ffd640 1 -- 172.21.15.55:0/1636651414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0e80ccab0 msgr2=0x7fe0e815cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0e6ffd640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0e80ccab0 0x7fe0e815cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0e6ffd640 1 -- 172.21.15.55:0/1636651414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e0009b30 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0e77fe640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0e80ccab0 0x7fe0e815cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0dffff640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0e80b7cd0 0x7fe0e814dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0e6ffd640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0e80b1fe0 0x7fe0e815afe0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800e810 tx=0x7fe0d800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0df7fe640 1 -- 172.21.15.55:0/1636651414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d800c8d0 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0df7fe640 1 -- 172.21.15.55:0/1636651414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d800ca30 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0df7fe640 1 -- 172.21.15.55:0/1636651414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d800cdc0 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0ed537640 1 -- 172.21.15.55:0/1636651414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e81f7eb0 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.758+0000 7fe0ed537640 1 -- 172.21.15.55:0/1636651414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e814e2a0 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.762+0000 7fe0ed537640 1 -- 172.21.15.55:0/1636651414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e8066d60 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.762+0000 7fe0df7fe640 1 -- 172.21.15.55:0/1636651414 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe0d8013410 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.762+0000 7fe0df7fe640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe0c80663a0 0x7fe0c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:07.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.762+0000 7fe0df7fe640 1 -- 172.21.15.55:0/1636651414 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe0d8083ee0 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.762+0000 7fe0dffff640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe0c80663a0 0x7fe0c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:07.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.762+0000 7fe0dffff640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe0c80663a0 0x7fe0c8068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80cc650 tx=0x7fe0d0009040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:07.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.766+0000 7fe0df7fe640 1 -- 172.21.15.55:0/1636651414 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0d8050ff0 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.926+0000 7fe0ed537640 1 -- 172.21.15.55:0/1636651414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0e80b3690 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.926+0000 7fe0df7fe640 1 -- 172.21.15.55:0/1636651414 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+18540 (secure 0 0 0) 0x7fe0d8054610 con 0x7fe0e80b1fe0 2023-07-06T21:55:07.926 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:07.927 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":73,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:55:05.195014+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:55:02.300695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-07-06T21:55:03.183596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:55:07.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.926+0000 7fe0ed537640 1 -- 172.21.15.55:0/1636651414 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe0c80663a0 msgr2=0x7fe0c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:07.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.926+0000 7fe0ed537640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe0c80663a0 0x7fe0c8068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80cc650 tx=0x7fe0d0009040 comp rx=0 tx=0).stop 2023-07-06T21:55:07.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.926+0000 7fe0ed537640 1 -- 172.21.15.55:0/1636651414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0e80b1fe0 msgr2=0x7fe0e815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:07.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.926+0000 7fe0ed537640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0e80b1fe0 0x7fe0e815afe0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800e810 tx=0x7fe0d800ecd0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.926+0000 7fe0ed537640 1 -- 172.21.15.55:0/1636651414 shutdown_connections 2023-07-06T21:55:07.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.926+0000 7fe0ed537640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0e80ccab0 0x7fe0e815cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.926+0000 7fe0ed537640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0e80b7cd0 0x7fe0e814dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.926+0000 7fe0ed537640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fe0c80663a0 0x7fe0c8068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.926+0000 7fe0ed537640 1 --2- 172.21.15.55:0/1636651414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0e80b1fe0 0x7fe0e815afe0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:07.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.926+0000 7fe0ed537640 1 -- 172.21.15.55:0/1636651414 >> 172.21.15.55:0/1636651414 conn(0x7fe0e80ceee0 msgr2=0x7fe0e80d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:07.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.926+0000 7fe0ed537640 1 -- 172.21.15.55:0/1636651414 shutdown_connections 2023-07-06T21:55:07.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:07.926+0000 7fe0ed537640 1 -- 172.21.15.55:0/1636651414 wait complete. 2023-07-06T21:55:07.947 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T21:55:07.948 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:55:08.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d48dd2640 1 Processor -- start 2023-07-06T21:55:08.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d48dd2640 1 -- start start 2023-07-06T21:55:08.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d48dd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d440b7cd0 0x7f1d440ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d48dd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d440b1fe0 0x7f1d4415f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d48dd2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d440cecf0 con 0x7f1d440ccab0 2023-07-06T21:55:08.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d48dd2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d440d2310 con 0x7f1d440b1fe0 2023-07-06T21:55:08.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d48dd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d440b80a0 con 0x7f1d440b7cd0 2023-07-06T21:55:08.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d42d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d440b1fe0 0x7f1d4415f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d42d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d440b1fe0 0x7f1d4415f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42702/0 (socket says 172.21.15.55:42702) 2023-07-06T21:55:08.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d42d9d640 1 -- 172.21.15.55:0/283341496 learned_addr learned my addr 172.21.15.55:0/283341496 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:08.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d4259c640 1 --2- 172.21.15.55:0/283341496 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d440b7cd0 0x7f1d440ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d42d9d640 1 -- 172.21.15.55:0/283341496 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d440b7cd0 msgr2=0x7f1d440ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:08.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d42d9d640 1 --2- 172.21.15.55:0/283341496 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d440b7cd0 0x7f1d440ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d42d9d640 1 -- 172.21.15.55:0/283341496 >> v1:172.21.15.138:6789/0 conn(0x7f1d440ccab0 legacy=0x7f1d440b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d42d9d640 1 -- 172.21.15.55:0/283341496 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d440d1d90 con 0x7f1d440b1fe0 2023-07-06T21:55:08.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.090+0000 7f1d41d9b640 1 -- 172.21.15.55:0/283341496 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079509049 0 0) 0x7f1d440cecf0 con 0x7f1d440ccab0 2023-07-06T21:55:08.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.094+0000 7f1d42d9d640 1 --2- 172.21.15.55:0/283341496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d440b1fe0 0x7f1d4415f870 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009e50 tx=0x7f1d3c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d26f1381ab265dc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:08.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.094+0000 7f1d41d9b640 1 -- 172.21.15.55:0/283341496 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0a5640 con 0x7f1d440b1fe0 2023-07-06T21:55:08.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.094+0000 7f1d41d9b640 1 -- 172.21.15.55:0/283341496 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c0a57a0 con 0x7f1d440b1fe0 2023-07-06T21:55:08.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.094+0000 7f1d41d9b640 1 -- 172.21.15.55:0/283341496 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0a5b30 con 0x7f1d440b1fe0 2023-07-06T21:55:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.094+0000 7f1d48dd2640 1 -- 172.21.15.55:0/283341496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d440b1fe0 msgr2=0x7f1d4415f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.094+0000 7f1d48dd2640 1 --2- 172.21.15.55:0/283341496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d440b1fe0 0x7f1d4415f870 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009e50 tx=0x7f1d3c01c980 comp rx=0 tx=0).stop 2023-07-06T21:55:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.094+0000 7f1d48dd2640 1 -- 172.21.15.55:0/283341496 shutdown_connections 2023-07-06T21:55:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.094+0000 7f1d48dd2640 1 --2- 172.21.15.55:0/283341496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d440b1fe0 0x7f1d4415f870 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.094+0000 7f1d48dd2640 1 --2- 172.21.15.55:0/283341496 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d440b7cd0 0x7f1d440ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.094+0000 7f1d48dd2640 1 -- 172.21.15.55:0/283341496 >> 172.21.15.55:0/283341496 conn(0x7f1d440ceee0 msgr2=0x7f1d440cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.094+0000 7f1d48dd2640 1 -- 172.21.15.55:0/283341496 shutdown_connections 2023-07-06T21:55:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.094+0000 7f1d48dd2640 1 -- 172.21.15.55:0/283341496 wait complete. 2023-07-06T21:55:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d48dd2640 1 Processor -- start 2023-07-06T21:55:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d48dd2640 1 -- start start 2023-07-06T21:55:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d48dd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d440b1fe0 0x7f1d440c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d48dd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d440b7cd0 0x7f1d441573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d48dd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d440ccab0 0x7f1d44152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d48dd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d440c81a0 con 0x7f1d440b1fe0 2023-07-06T21:55:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d48dd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d440c8440 con 0x7f1d440b7cd0 2023-07-06T21:55:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d48dd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d44154480 con 0x7f1d440ccab0 2023-07-06T21:55:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d4259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d440b1fe0 0x7f1d440c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d4259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d440b1fe0 0x7f1d440c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42710/0 (socket says 172.21.15.55:42710) 2023-07-06T21:55:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d4259c640 1 -- 172.21.15.55:0/2892701590 learned_addr learned my addr 172.21.15.55:0/2892701590 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d39d9b640 1 --2- 172.21.15.55:0/2892701590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d440b7cd0 0x7f1d441573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d42d9d640 1 --2- 172.21.15.55:0/2892701590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d440ccab0 0x7f1d44152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d4259c640 1 -- 172.21.15.55:0/2892701590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d440ccab0 msgr2=0x7f1d44152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d4259c640 1 --2- 172.21.15.55:0/2892701590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d440ccab0 0x7f1d44152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d4259c640 1 -- 172.21.15.55:0/2892701590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d440b7cd0 msgr2=0x7f1d441573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d4259c640 1 --2- 172.21.15.55:0/2892701590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d440b7cd0 0x7f1d441573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d4259c640 1 -- 172.21.15.55:0/2892701590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c009b30 con 0x7f1d440b1fe0 2023-07-06T21:55:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d4259c640 1 --2- 172.21.15.55:0/2892701590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d440b1fe0 0x7f1d440c88d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400e960 tx=0x7f1d3400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d3b7fe640 1 -- 172.21.15.55:0/2892701590 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34009690 con 0x7f1d440b1fe0 2023-07-06T21:55:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d3b7fe640 1 -- 172.21.15.55:0/2892701590 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3400ca00 con 0x7f1d440b1fe0 2023-07-06T21:55:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d3b7fe640 1 -- 172.21.15.55:0/2892701590 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3400cd70 con 0x7f1d440b1fe0 2023-07-06T21:55:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d48dd2640 1 -- 172.21.15.55:0/2892701590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d44154760 con 0x7f1d440b1fe0 2023-07-06T21:55:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.098+0000 7f1d48dd2640 1 -- 172.21.15.55:0/2892701590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d441578e0 con 0x7f1d440b1fe0 2023-07-06T21:55:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.102+0000 7f1d48dd2640 1 -- 172.21.15.55:0/2892701590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d44154c10 con 0x7f1d440b1fe0 2023-07-06T21:55:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.102+0000 7f1d3b7fe640 1 -- 172.21.15.55:0/2892701590 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1d34013470 con 0x7f1d440b1fe0 2023-07-06T21:55:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.102+0000 7f1d3b7fe640 1 --2- 172.21.15.55:0/2892701590 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f1d280663a0 0x7f1d28068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.102+0000 7f1d3b7fe640 1 -- 172.21.15.55:0/2892701590 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1d34084140 con 0x7f1d440b1fe0 2023-07-06T21:55:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.102+0000 7f1d39d9b640 1 --2- 172.21.15.55:0/2892701590 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f1d280663a0 0x7f1d28068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.102+0000 7f1d39d9b640 1 --2- 172.21.15.55:0/2892701590 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f1d280663a0 0x7f1d28068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c000f70 tx=0x7f1d2c009040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:08.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.106+0000 7f1d3b7fe640 1 -- 172.21.15.55:0/2892701590 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d34051420 con 0x7f1d440b1fe0 2023-07-06T21:55:08.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.262+0000 7f1d48dd2640 1 -- 172.21.15.55:0/2892701590 --> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d440b1620 con 0x7f1d280663a0 2023-07-06T21:55:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.270+0000 7f1d3b7fe640 1 -- 172.21.15.55:0/2892701590 <== mgr.6102 v2:172.21.15.55:6832/3843972996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296965 (secure 0 0 0) 0x7f1d2c00f820 con 0x7f1d280663a0 2023-07-06T21:55:08.274 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:08.275 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:55:08.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.274+0000 7f1d48dd2640 1 -- 172.21.15.55:0/2892701590 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f1d280663a0 msgr2=0x7f1d28068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.274+0000 7f1d48dd2640 1 --2- 172.21.15.55:0/2892701590 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f1d280663a0 0x7f1d28068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c000f70 tx=0x7f1d2c009040 comp rx=0 tx=0).stop 2023-07-06T21:55:08.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.274+0000 7f1d48dd2640 1 -- 172.21.15.55:0/2892701590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d440b1fe0 msgr2=0x7f1d440c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.274+0000 7f1d48dd2640 1 --2- 172.21.15.55:0/2892701590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d440b1fe0 0x7f1d440c88d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400e960 tx=0x7f1d3400ee20 comp rx=0 tx=0).stop 2023-07-06T21:55:08.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.274+0000 7f1d48dd2640 1 -- 172.21.15.55:0/2892701590 shutdown_connections 2023-07-06T21:55:08.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.274+0000 7f1d48dd2640 1 --2- 172.21.15.55:0/2892701590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d440ccab0 0x7f1d44152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.274+0000 7f1d48dd2640 1 --2- 172.21.15.55:0/2892701590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d440b7cd0 0x7f1d441573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.274+0000 7f1d48dd2640 1 --2- 172.21.15.55:0/2892701590 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f1d280663a0 0x7f1d28068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.274+0000 7f1d48dd2640 1 --2- 172.21.15.55:0/2892701590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d440b1fe0 0x7f1d440c88d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.274+0000 7f1d48dd2640 1 -- 172.21.15.55:0/2892701590 >> 172.21.15.55:0/2892701590 conn(0x7f1d440ceee0 msgr2=0x7f1d4406a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:08.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.274+0000 7f1d48dd2640 1 -- 172.21.15.55:0/2892701590 shutdown_connections 2023-07-06T21:55:08.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.274+0000 7f1d48dd2640 1 -- 172.21.15.55:0/2892701590 wait complete. 2023-07-06T21:55:08.294 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-06T21:55:06.711258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":268288,"kb_used_data":7616,"kb_used_omap":0,"kb_used_meta":260608,"kb_avail":754706432,"statfs":{"total":773094113280,"available":772819386368,"internally_reserved":0,"allocated":7798784,"data_stored":4593930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":266862592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000783"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"60'139","reported_seq":347,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.142294+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:55:00.142294+0000","last_peered":"2023-07-06T21:55:00.142294+0000","last_clean":"2023-07-06T21:55:00.142294+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:55:00.142294+0000","last_undegraded":"2023-07-06T21:55:00.142294+0000","last_fullsized":"2023-07-06T21:55:00.142294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:36:42.367569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.170739+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:55:00.170739+0000","last_peered":"2023-07-06T21:55:00.170739+0000","last_clean":"2023-07-06T21:55:00.170739+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:55:00.170739+0000","last_undegraded":"2023-07-06T21:55:00.170739+0000","last_fullsized":"2023-07-06T21:55:00.170739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:11:07.080529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":113,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.142298+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:55:00.142298+0000","last_peered":"2023-07-06T21:55:00.142298+0000","last_clean":"2023-07-06T21:55:00.142298+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:55:00.142298+0000","last_undegraded":"2023-07-06T21:55:00.142298+0000","last_fullsized":"2023-07-06T21:55:00.142298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:08:49.054581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.139998+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:55:00.139998+0000","last_peered":"2023-07-06T21:55:00.139998+0000","last_clean":"2023-07-06T21:55:00.139998+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:55:00.139998+0000","last_undegraded":"2023-07-06T21:55:00.139998+0000","last_fullsized":"2023-07-06T21:55:00.139998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:27:41.770817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.170732+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:55:00.170732+0000","last_peered":"2023-07-06T21:55:00.170732+0000","last_clean":"2023-07-06T21:55:00.170732+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:55:00.170732+0000","last_undegraded":"2023-07-06T21:55:00.170732+0000","last_fullsized":"2023-07-06T21:55:00.170732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:43:06.413459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.171317+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:55:00.171317+0000","last_peered":"2023-07-06T21:55:00.171317+0000","last_clean":"2023-07-06T21:55:00.171317+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:55:00.171317+0000","last_undegraded":"2023-07-06T21:55:00.171317+0000","last_fullsized":"2023-07-06T21:55:00.171317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:18:58.916963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":113,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.142291+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:55:00.142291+0000","last_peered":"2023-07-06T21:55:00.142291+0000","last_clean":"2023-07-06T21:55:00.142291+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:55:00.142291+0000","last_undegraded":"2023-07-06T21:55:00.142291+0000","last_fullsized":"2023-07-06T21:55:00.142291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:19:10.883003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.171357+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:55:00.171357+0000","last_peered":"2023-07-06T21:55:00.171357+0000","last_clean":"2023-07-06T21:55:00.171357+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:55:00.171357+0000","last_undegraded":"2023-07-06T21:55:00.171357+0000","last_fullsized":"2023-07-06T21:55:00.171357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:42:40.125341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":102,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.170587+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:55:00.170587+0000","last_peered":"2023-07-06T21:55:00.170587+0000","last_clean":"2023-07-06T21:55:00.170587+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:55:00.170587+0000","last_undegraded":"2023-07-06T21:55:00.170587+0000","last_fullsized":"2023-07-06T21:55:00.170587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:01:13.716462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575008,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1421312,"data_stored":1017272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71599999999999997,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.35199999999999998,"15min":0.30599999999999999},"max":{"1min":0.93999999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71199999999999997,"15min":0.69099999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":0.91300000000000003,"5min":0.98799999999999999,"15min":0.99399999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.47799999999999998,"5min":0.39800000000000002,"15min":0.34799999999999998},"max":{"1min":0.91800000000000004,"5min":1.0449999999999999,"15min":1.0649999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86199999999999999,"5min":0.94099999999999995,"15min":0.97899999999999998},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.878,"5min":0.94799999999999995,"15min":0.94999999999999996},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73299999999999998,"15min":0.72799999999999998},"min":{"1min":0.52000000000000002,"5min":0.436,"15min":0.42599999999999999},"max":{"1min":0.89200000000000002,"5min":1.008,"15min":1.0529999999999999},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.44700000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0469999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":0.93700000000000006,"5min":0.99399999999999999,"15min":1.006},"last":0.79900000000000004}]},{"osd":4,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80700000000000005,"5min":0.94199999999999995,"15min":0.999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.747,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.35699999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57999999999999996,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.98499999999999999},"last":0.376},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":0.874,"5min":0.91100000000000003,"15min":0.99199999999999999},"last":0.40999999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70199999999999996,"15min":0.70099999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.40200000000000002},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":1.0309999999999999},"last":0.44},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65900000000000003,"15min":0.67200000000000004},"min":{"1min":0.51000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95399999999999996,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.48799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575008,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":823296,"data_stored":425885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72499999999999998,"15min":0.70499999999999996},"min":{"1min":0.54600000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.0980000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.74299999999999999,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.38300000000000001},"max":{"1min":0.94799999999999995,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73299999999999998,"15min":0.71299999999999997},"min":{"1min":0.56499999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.753,"15min":0.73199999999999998},"min":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.998,"5min":0.998,"15min":1.1180000000000001},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.71699999999999997},"min":{"1min":0.56499999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.3859999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75700000000000001,"15min":0.73999999999999999},"min":{"1min":0.63500000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76500000000000001,"15min":0.748},"min":{"1min":0.57999999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.204},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.753,"15min":0.73899999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.498},"max":{"1min":0.96199999999999997,"5min":0.98099999999999998,"15min":1.4339999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.59199999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80200000000000005,"5min":0.84999999999999998,"15min":1.1850000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.39300000000000002},"max":{"1min":0.84199999999999997,"5min":0.91900000000000004,"15min":1.321},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":1.0089999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.73599999999999999},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.89200000000000002,"5min":1.0189999999999999,"15min":1.631},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.41699999999999998},"max":{"1min":0.878,"5min":0.92400000000000004,"15min":1.3600000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67200000000000004,"15min":0.69999999999999996},"min":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.6930000000000001},"last":0.45000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575007,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":827392,"data_stored":426904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70599999999999996,"15min":0.69099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.99299999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.71499999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.39200000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.131},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.72499999999999998},"min":{"1min":0.56899999999999995,"5min":0.54400000000000004,"15min":0.41099999999999998},"max":{"1min":0.92400000000000004,"5min":0.94399999999999995,"15min":1.0329999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75800000000000001,"15min":0.73899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75700000000000001,"15min":0.73499999999999999},"min":{"1min":0.51100000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98299999999999998,"5min":0.98599999999999999,"15min":1.0369999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48999999999999999},"max":{"1min":0.93300000000000005,"5min":0.94399999999999995,"15min":0.96099999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77400000000000002,"15min":0.76300000000000001},"min":{"1min":0.64100000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.58799999999999997},"min":{"1min":0.42299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.747,"5min":0.86599999999999999,"15min":1},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59199999999999997,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91800000000000004,"5min":0.93400000000000005,"15min":1.02},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59299999999999997,"15min":0.64300000000000002},"min":{"1min":0.48999999999999999,"5min":0.44700000000000001,"15min":0.44600000000000001},"max":{"1min":0.86799999999999999,"5min":0.91400000000000003,"15min":1.052},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.65100000000000002},"min":{"1min":0.47499999999999998,"5min":0.46300000000000002,"15min":0.41799999999999998},"max":{"1min":0.82799999999999996,"5min":0.86399999999999999,"15min":0.96699999999999997},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.69699999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.45200000000000001},"max":{"1min":0.92200000000000004,"5min":0.96299999999999997,"15min":1.0529999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.70199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31856,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":827392,"data_stored":426904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.60099999999999998,"5min":0.47299999999999998,"15min":0.39400000000000002},"max":{"1min":0.93899999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.52600000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.86499999999999999,"5min":1.0489999999999999,"15min":1.071},"last":0.84599999999999997}]},{"osd":1,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.59199999999999997,"5min":0.51900000000000002,"15min":0.44},"max":{"1min":0.878,"5min":0.89200000000000002,"15min":1.361},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71199999999999997,"15min":0.72299999999999998},"min":{"1min":0.57399999999999995,"5min":0.47899999999999998,"15min":0.40300000000000002},"max":{"1min":0.90200000000000002,"5min":1.01,"15min":1.2829999999999999},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.73399999999999999,"15min":0.72299999999999998},"min":{"1min":0.64300000000000002,"5min":0.50800000000000001,"15min":0.40899999999999997},"max":{"1min":0.84699999999999998,"5min":1.1299999999999999,"15min":1.2170000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.752,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.505,"15min":0.38600000000000001},"max":{"1min":0.91800000000000004,"5min":0.98599999999999999,"15min":1.649},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72899999999999998,"15min":0.73999999999999999},"min":{"1min":0.61099999999999999,"5min":0.53800000000000003,"15min":0.45800000000000002},"max":{"1min":0.85199999999999998,"5min":0.93700000000000006,"15min":1.4219999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.60699999999999998,"5min":0.57199999999999995,"15min":0.49099999999999999},"max":{"1min":0.89100000000000001,"5min":0.97399999999999998,"15min":1.3109999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.308},"max":{"1min":0.80400000000000005,"5min":0.93700000000000006,"15min":1.246},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.63500000000000001},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.32500000000000001},"max":{"1min":0.88800000000000001,"5min":0.97299999999999998,"15min":1.8049999999999999},"last":0.85899999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.63100000000000001},"min":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.36299999999999999},"max":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":1.478},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63,"15min":0.68600000000000005},"min":{"1min":0.48299999999999998,"5min":0.443,"15min":0.34799999999999998},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.7250000000000001},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63900000000000001,"15min":0.68400000000000005},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93200000000000005,"5min":1.028,"15min":1.534},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64700000000000002,"15min":0.69399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90600000000000003,"5min":1.01,"15min":1.585},"last":0.82299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575007,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":827392,"data_stored":426904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26900000000000002},"max":{"1min":0.85499999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.311},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.33400000000000002},"max":{"1min":0.94899999999999995,"5min":0.99099999999999999,"15min":1.7190000000000001},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49199999999999999,"15min":0.47499999999999998},"min":{"1min":0.32400000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.88,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.33500000000000002,"15min":0.32700000000000001},"max":{"1min":0.73399999999999999,"5min":1.109,"15min":1.9590000000000001},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.53000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33000000000000002},"max":{"1min":0.621,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.34799999999999998},"max":{"1min":0.72099999999999997,"5min":1.24,"15min":2.012},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":0.95999999999999996,"5min":1.1339999999999999,"15min":1.855},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80000000000000004,"15min":0.77600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46000000000000002,"15min":0.432},"max":{"1min":1.0329999999999999,"5min":1.097,"15min":1.524},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83399999999999996,"15min":0.79400000000000004},"min":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.42399999999999999},"max":{"1min":0.95599999999999996,"5min":1.236,"15min":1.3720000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80400000000000005,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.45400000000000001,"15min":0.44800000000000001},"max":{"1min":1.0169999999999999,"5min":1.3999999999999999,"15min":1.883},"last":0.754}]},{"osd":6,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.78500000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40000000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.79200000000000004},"min":{"1min":0.56399999999999995,"5min":0.53600000000000003,"15min":0.47899999999999998},"max":{"1min":1.0640000000000001,"5min":1.101,"15min":1.4610000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82999999999999996,"15min":0.80100000000000005},"min":{"1min":0.57999999999999996,"5min":0.51300000000000001,"15min":0.497},"max":{"1min":1.0589999999999999,"5min":1.456,"15min":1.456},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52900000000000003},"max":{"1min":1.0649999999999999,"5min":1.3480000000000001,"15min":1.9830000000000001},"last":0.86599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575007,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":827392,"data_stored":426904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.44900000000000001},"min":{"1min":0.317,"5min":0.29099999999999998,"15min":0.28100000000000003},"max":{"1min":0.66300000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.78300000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.504},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.33700000000000002},"max":{"1min":0.63700000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.443,"5min":0.38400000000000001,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":0.76200000000000001,"15min":0.76500000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.56799999999999995},"min":{"1min":0.48999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77400000000000002,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.64500000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1040000000000001,"5min":1.21,"15min":1.2430000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81899999999999995,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.214,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80100000000000005,"15min":0.78900000000000003},"min":{"1min":0.68999999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0549999999999999,"5min":1.212,"15min":1.246},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83299999999999996,"15min":0.81899999999999995},"min":{"1min":0.70799999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1930000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.83999999999999997,"15min":0.80100000000000005},"min":{"1min":0.54900000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.246,"5min":1.27,"15min":1.27},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.68600000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.105,"5min":1.2410000000000001,"15min":1.3320000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.83799999999999997,"15min":0.82299999999999995},"min":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.54300000000000004},"max":{"1min":1.1439999999999999,"5min":1.2789999999999999,"15min":1.3520000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.85399999999999998,"15min":0.83299999999999996},"min":{"1min":0.67100000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.218,"5min":1.268,"15min":1.369},"last":0.91300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575008,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":827392,"data_stored":426904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.35799999999999998,"5min":0.28999999999999998,"15min":0.27500000000000002},"max":{"1min":0.63700000000000001,"5min":0.66100000000000003,"15min":0.73699999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.34399999999999997,"5min":0.32200000000000001,"15min":0.29399999999999998},"max":{"1min":0.64500000000000002,"5min":0.78900000000000003,"15min":0.92200000000000004},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.34300000000000003,"5min":0.33000000000000002,"15min":0.311},"max":{"1min":0.623,"5min":0.73599999999999999,"15min":0.80200000000000005},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73299999999999998,"5min":0.87,"15min":0.87},"last":0.443}]},{"osd":3,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.46500000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.70699999999999996,"5min":0.84599999999999997,"15min":0.96299999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72799999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78900000000000003,"15min":0.77200000000000002},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.38500000000000001},"max":{"1min":1.143,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79200000000000004,"15min":0.78100000000000003},"min":{"1min":0.65000000000000002,"5min":0.497,"15min":0.44},"max":{"1min":1.0049999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79600000000000004,"15min":0.77700000000000002},"min":{"1min":0.54800000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1890000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.47999999999999998,"15min":0.439},"max":{"1min":1.028,"5min":1.357,"15min":1.357},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.63300000000000001,"5min":0.54300000000000004,"15min":0.53800000000000003},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81200000000000006,"15min":0.80900000000000005},"min":{"1min":0.60999999999999999,"5min":0.51800000000000002,"15min":0.51500000000000001},"max":{"1min":0.97199999999999998,"5min":1.456,"15min":1.456},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.53800000000000003},"max":{"1min":1.0820000000000001,"5min":1.417,"15min":1.417},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.59499999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3280000000000001,"5min":1.397,"15min":1.397},"last":0.88100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575007,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1417216,"data_stored":1016253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.247},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.1459999999999999},"last":0.309},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.33600000000000002,"15min":0.28599999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":1.5189999999999999},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.30099999999999999},"max":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":1.228},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.34000000000000002},"max":{"1min":0.72299999999999998,"5min":0.85799999999999998,"15min":1.454},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.51100000000000001},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.308},"max":{"1min":0.71799999999999997,"5min":0.78900000000000003,"15min":1.7969999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.36799999999999999},"max":{"1min":0.83099999999999996,"5min":0.874,"15min":1.7190000000000001},"last":0.505}]},{"osd":4,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81699999999999995,"15min":0.79800000000000004},"min":{"1min":0.499,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.111,"5min":1.242,"15min":1.911},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.53100000000000003,"15min":0.35799999999999998},"max":{"1min":1.1020000000000001,"5min":1.2729999999999999,"15min":1.3620000000000001},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82599999999999996,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.38400000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.3700000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81499999999999995,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.55200000000000005,"15min":0.44400000000000001},"max":{"1min":1.0329999999999999,"5min":1.1759999999999999,"15min":1.758},"last":0.755}]},{"osd":6,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.52400000000000002},"max":{"1min":1.0780000000000001,"5min":1.2050000000000001,"15min":1.8220000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.47199999999999998},"max":{"1min":1.071,"5min":1.1379999999999999,"15min":2.266},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.63500000000000001,"5min":0.55900000000000005,"15min":0.53800000000000003},"max":{"1min":1.135,"5min":1.147,"15min":2.323},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.84699999999999998,"15min":0.81899999999999995},"min":{"1min":0.65500000000000003,"5min":0.60599999999999998,"15min":0.435},"max":{"1min":1.107,"5min":1.2210000000000001,"15min":1.2829999999999999},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:55:08.302 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:55:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4aa4cb640 1 Processor -- start 2023-07-06T21:55:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4aa4cb640 1 -- start start 2023-07-06T21:55:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4aa4cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4a40cb4a0 0x7fd4a415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4aa4cb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd4a40cbc70 0x7fd4a40cc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4aa4cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a40b5b50 con 0x7fd4a415f740 2023-07-06T21:55:08.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4aa4cb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a415d130 con 0x7fd4a40cbc70 2023-07-06T21:55:08.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4aa4cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a40cc5b0 con 0x7fd4a40cb4a0 2023-07-06T21:55:08.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd4a415f740 0x7fd4a40ca720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54516/0 (socket says 172.21.15.55:54516) 2023-07-06T21:55:08.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a37fe640 1 -- 172.21.15.55:0/2735292598 learned_addr learned my addr 172.21.15.55:0/2735292598 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:55:08.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a8a68640 1 --2- 172.21.15.55:0/2735292598 >> v2:172.21.15.138:3300/0 conn(0x7fd4a40cbc70 0x7fd4a40cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 -- 172.21.15.55:0/2735292598 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459577462 0 0) 0x7fd4a40b5b50 con 0x7fd4a415f740 2023-07-06T21:55:08.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a3fff640 1 --2- 172.21.15.55:0/2735292598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4a40cb4a0 0x7fd4a415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 -- 172.21.15.55:0/2735292598 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd48c003530 con 0x7fd4a415f740 2023-07-06T21:55:08.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 -- 172.21.15.55:0/2735292598 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1940277645 0 0) 0x7fd48c003530 con 0x7fd4a415f740 2023-07-06T21:55:08.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 -- 172.21.15.55:0/2735292598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4a40cb4a0 msgr2=0x7fd4a415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:08.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 --2- 172.21.15.55:0/2735292598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4a40cb4a0 0x7fd4a415cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 -- 172.21.15.55:0/2735292598 >> v2:172.21.15.138:3300/0 conn(0x7fd4a40cbc70 msgr2=0x7fd4a40cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 --2- 172.21.15.55:0/2735292598 >> v2:172.21.15.138:3300/0 conn(0x7fd4a40cbc70 0x7fd4a40cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 -- 172.21.15.55:0/2735292598 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a40cc8e0 con 0x7fd4a415f740 2023-07-06T21:55:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 -- 172.21.15.55:0/2735292598 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fd498001680 con 0x7fd4a415f740 2023-07-06T21:55:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 -- 172.21.15.55:0/2735292598 >> v1:172.21.15.55:6789/0 conn(0x7fd4a415f740 legacy=0x7fd4a40ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 --2- 172.21.15.55:0/2735292598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd48c003980 0x7fd48c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 --2- 172.21.15.55:0/2735292598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd48c0043b0 0x7fd48c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 --2- 172.21.15.55:0/2735292598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4a40cb4a0 0x7fd48c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 -- 172.21.15.55:0/2735292598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a415d130 con 0x7fd48c0043b0 2023-07-06T21:55:08.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 -- 172.21.15.55:0/2735292598 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a40cc5b0 con 0x7fd48c003980 2023-07-06T21:55:08.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a2ffd640 1 -- 172.21.15.55:0/2735292598 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c00b990 con 0x7fd4a40cb4a0 2023-07-06T21:55:08.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.478+0000 7fd4a37fe640 1 --2- 172.21.15.55:0/2735292598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd48c0043b0 0x7fd48c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4a8a68640 1 --2- 172.21.15.55:0/2735292598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4a40cb4a0 0x7fd48c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4a3fff640 1 --2- 172.21.15.55:0/2735292598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd48c003980 0x7fd48c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4a37fe640 1 -- 172.21.15.55:0/2735292598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4a40cb4a0 msgr2=0x7fd48c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:08.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4a37fe640 1 --2- 172.21.15.55:0/2735292598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4a40cb4a0 0x7fd48c004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4a37fe640 1 -- 172.21.15.55:0/2735292598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd48c003980 msgr2=0x7fd48c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:08.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4a37fe640 1 --2- 172.21.15.55:0/2735292598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd48c003980 0x7fd48c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4a37fe640 1 -- 172.21.15.55:0/2735292598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c003530 con 0x7fd48c0043b0 2023-07-06T21:55:08.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4a37fe640 1 --2- 172.21.15.55:0/2735292598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd48c0043b0 0x7fd48c004870 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd4a415fb30 tx=0x7fd49801f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85783c1d9b86cd7a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:08.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4a2ffd640 1 -- 172.21.15.55:0/2735292598 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498005ae0 con 0x7fd48c0043b0 2023-07-06T21:55:08.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4a2ffd640 1 -- 172.21.15.55:0/2735292598 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4980ab070 con 0x7fd48c0043b0 2023-07-06T21:55:08.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4a2ffd640 1 -- 172.21.15.55:0/2735292598 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498005ea0 con 0x7fd48c0043b0 2023-07-06T21:55:08.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/2735292598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd48c0043b0 msgr2=0x7fd48c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4aa4cb640 1 --2- 172.21.15.55:0/2735292598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd48c0043b0 0x7fd48c004870 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd4a415fb30 tx=0x7fd49801f390 comp rx=0 tx=0).stop 2023-07-06T21:55:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4a8a68640 1 -- 172.21.15.55:0/2735292598 reap_dead start 2023-07-06T21:55:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/2735292598 shutdown_connections 2023-07-06T21:55:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.482+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/2735292598 >> 172.21.15.55:0/2735292598 conn(0x7fd4a406ee80 msgr2=0x7fd4a406f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/2735292598 shutdown_connections 2023-07-06T21:55:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/2735292598 wait complete. 2023-07-06T21:55:08.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4aa4cb640 1 Processor -- start 2023-07-06T21:55:08.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4aa4cb640 1 -- start start 2023-07-06T21:55:08.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4aa4cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd48c0043b0 0x7fd4a40c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4aa4cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4a4158690 0x7fd4a40c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4aa4cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a414e4d0 0x7fd4a40c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4aa4cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a40ab900 con 0x7fd4a414e4d0 2023-07-06T21:55:08.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4aa4cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a40c8390 con 0x7fd48c0043b0 2023-07-06T21:55:08.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4aa4cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a40c7780 con 0x7fd4a4158690 2023-07-06T21:55:08.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4a8a68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a414e4d0 0x7fd4a40c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4a8a68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a414e4d0 0x7fd4a40c5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42730/0 (socket says 172.21.15.55:42730) 2023-07-06T21:55:08.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4a3fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd48c0043b0 0x7fd4a40c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4a8a68640 1 -- 172.21.15.55:0/1069062362 learned_addr learned my addr 172.21.15.55:0/1069062362 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:08.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4a37fe640 1 --2- 172.21.15.55:0/1069062362 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4a4158690 0x7fd4a40c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4a8a68640 1 -- 172.21.15.55:0/1069062362 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4a4158690 msgr2=0x7fd4a40c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4a8a68640 1 --2- 172.21.15.55:0/1069062362 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4a4158690 0x7fd4a40c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4a8a68640 1 -- 172.21.15.55:0/1069062362 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd48c0043b0 msgr2=0x7fd4a40c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4a8a68640 1 --2- 172.21.15.55:0/1069062362 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd48c0043b0 0x7fd4a40c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4a8a68640 1 -- 172.21.15.55:0/1069062362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a40c7a60 con 0x7fd4a414e4d0 2023-07-06T21:55:08.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.486+0000 7fd4a3fff640 1 --2- 172.21.15.55:0/1069062362 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd48c0043b0 0x7fd4a40c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:55:08.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.490+0000 7fd4a8a68640 1 --2- 172.21.15.55:0/1069062362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a414e4d0 0x7fd4a40c5450 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40ca6b0 tx=0x7fd49c011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:08.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.490+0000 7fd4a0ff9640 1 -- 172.21.15.55:0/1069062362 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c00e040 con 0x7fd4a414e4d0 2023-07-06T21:55:08.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.490+0000 7fd4a0ff9640 1 -- 172.21.15.55:0/1069062362 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c00f040 con 0x7fd4a414e4d0 2023-07-06T21:55:08.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.490+0000 7fd4a0ff9640 1 -- 172.21.15.55:0/1069062362 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c015a80 con 0x7fd4a414e4d0 2023-07-06T21:55:08.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.490+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/1069062362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a40c7d40 con 0x7fd4a414e4d0 2023-07-06T21:55:08.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.490+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/1069062362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a414e940 con 0x7fd4a414e4d0 2023-07-06T21:55:08.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.490+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/1069062362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a4066d60 con 0x7fd4a414e4d0 2023-07-06T21:55:08.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.490+0000 7fd4a0ff9640 1 -- 172.21.15.55:0/1069062362 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd49c015be0 con 0x7fd4a414e4d0 2023-07-06T21:55:08.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.490+0000 7fd4a0ff9640 1 --2- 172.21.15.55:0/1069062362 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd4900663a0 0x7fd490068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.490+0000 7fd4a0ff9640 1 -- 172.21.15.55:0/1069062362 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd49c084090 con 0x7fd4a414e4d0 2023-07-06T21:55:08.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.490+0000 7fd4a3fff640 1 --2- 172.21.15.55:0/1069062362 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd4900663a0 0x7fd490068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.494+0000 7fd4a3fff640 1 --2- 172.21.15.55:0/1069062362 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd4900663a0 0x7fd490068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd494009e70 tx=0x7fd494009190 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:08.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.494+0000 7fd4a0ff9640 1 -- 172.21.15.55:0/1069062362 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd49c051110 con 0x7fd4a414e4d0 2023-07-06T21:55:08.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.646+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/1069062362 --> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4a415fee0 con 0x7fd4900663a0 2023-07-06T21:55:08.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.654+0000 7fd4a0ff9640 1 -- 172.21.15.55:0/1069062362 <== mgr.6102 v2:172.21.15.55:6832/3843972996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296965 (secure 0 0 0) 0x7fd494019070 con 0x7fd4900663a0 2023-07-06T21:55:08.658 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:08.659 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:55:08.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.658+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/1069062362 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd4900663a0 msgr2=0x7fd490068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.658+0000 7fd4aa4cb640 1 --2- 172.21.15.55:0/1069062362 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd4900663a0 0x7fd490068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd494009e70 tx=0x7fd494009190 comp rx=0 tx=0).stop 2023-07-06T21:55:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.658+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/1069062362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a414e4d0 msgr2=0x7fd4a40c5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.658+0000 7fd4aa4cb640 1 --2- 172.21.15.55:0/1069062362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a414e4d0 0x7fd4a40c5450 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40ca6b0 tx=0x7fd49c011bf0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.658+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/1069062362 shutdown_connections 2023-07-06T21:55:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.658+0000 7fd4aa4cb640 1 --2- 172.21.15.55:0/1069062362 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd4900663a0 0x7fd490068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.658+0000 7fd4aa4cb640 1 --2- 172.21.15.55:0/1069062362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a414e4d0 0x7fd4a40c5450 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.658+0000 7fd4aa4cb640 1 --2- 172.21.15.55:0/1069062362 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4a4158690 0x7fd4a40c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.658+0000 7fd4aa4cb640 1 --2- 172.21.15.55:0/1069062362 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd48c0043b0 0x7fd4a40c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.658+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/1069062362 >> 172.21.15.55:0/1069062362 conn(0x7fd4a406ee80 msgr2=0x7fd4a406f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:08.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.658+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/1069062362 shutdown_connections 2023-07-06T21:55:08.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.658+0000 7fd4aa4cb640 1 -- 172.21.15.55:0/1069062362 wait complete. 2023-07-06T21:55:08.679 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-06T21:55:06.711258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":268288,"kb_used_data":7616,"kb_used_omap":0,"kb_used_meta":260608,"kb_avail":754706432,"statfs":{"total":773094113280,"available":772819386368,"internally_reserved":0,"allocated":7798784,"data_stored":4593930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":266862592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000783"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"60'139","reported_seq":347,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.142294+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:55:00.142294+0000","last_peered":"2023-07-06T21:55:00.142294+0000","last_clean":"2023-07-06T21:55:00.142294+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:55:00.142294+0000","last_undegraded":"2023-07-06T21:55:00.142294+0000","last_fullsized":"2023-07-06T21:55:00.142294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:36:42.367569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.170739+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:55:00.170739+0000","last_peered":"2023-07-06T21:55:00.170739+0000","last_clean":"2023-07-06T21:55:00.170739+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:55:00.170739+0000","last_undegraded":"2023-07-06T21:55:00.170739+0000","last_fullsized":"2023-07-06T21:55:00.170739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:11:07.080529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":113,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.142298+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:55:00.142298+0000","last_peered":"2023-07-06T21:55:00.142298+0000","last_clean":"2023-07-06T21:55:00.142298+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:55:00.142298+0000","last_undegraded":"2023-07-06T21:55:00.142298+0000","last_fullsized":"2023-07-06T21:55:00.142298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:08:49.054581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.139998+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:55:00.139998+0000","last_peered":"2023-07-06T21:55:00.139998+0000","last_clean":"2023-07-06T21:55:00.139998+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:55:00.139998+0000","last_undegraded":"2023-07-06T21:55:00.139998+0000","last_fullsized":"2023-07-06T21:55:00.139998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:27:41.770817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.170732+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:55:00.170732+0000","last_peered":"2023-07-06T21:55:00.170732+0000","last_clean":"2023-07-06T21:55:00.170732+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:55:00.170732+0000","last_undegraded":"2023-07-06T21:55:00.170732+0000","last_fullsized":"2023-07-06T21:55:00.170732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:43:06.413459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.171317+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:55:00.171317+0000","last_peered":"2023-07-06T21:55:00.171317+0000","last_clean":"2023-07-06T21:55:00.171317+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:55:00.171317+0000","last_undegraded":"2023-07-06T21:55:00.171317+0000","last_fullsized":"2023-07-06T21:55:00.171317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:18:58.916963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":113,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.142291+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:55:00.142291+0000","last_peered":"2023-07-06T21:55:00.142291+0000","last_clean":"2023-07-06T21:55:00.142291+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:55:00.142291+0000","last_undegraded":"2023-07-06T21:55:00.142291+0000","last_fullsized":"2023-07-06T21:55:00.142291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:19:10.883003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.171357+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:55:00.171357+0000","last_peered":"2023-07-06T21:55:00.171357+0000","last_clean":"2023-07-06T21:55:00.171357+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:55:00.171357+0000","last_undegraded":"2023-07-06T21:55:00.171357+0000","last_fullsized":"2023-07-06T21:55:00.171357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:42:40.125341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:03.778910+0000","last_change":"2023-07-06T21:55:03.778910+0000","last_active":"2023-07-06T21:55:03.778910+0000","last_peered":"2023-07-06T21:55:03.778910+0000","last_clean":"2023-07-06T21:55:03.778910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:03.778910+0000","last_undegraded":"2023-07-06T21:55:03.778910+0000","last_fullsized":"2023-07-06T21:55:03.778910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:55:02.771223+0000","last_change":"2023-07-06T21:55:02.771223+0000","last_active":"2023-07-06T21:55:02.771223+0000","last_peered":"2023-07-06T21:55:02.771223+0000","last_clean":"2023-07-06T21:55:02.771223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:55:02.771223+0000","last_undegraded":"2023-07-06T21:55:02.771223+0000","last_fullsized":"2023-07-06T21:55:02.771223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":102,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-07-06T21:55:00.170587+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:55:00.170587+0000","last_peered":"2023-07-06T21:55:00.170587+0000","last_clean":"2023-07-06T21:55:00.170587+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:55:00.170587+0000","last_undegraded":"2023-07-06T21:55:00.170587+0000","last_fullsized":"2023-07-06T21:55:00.170587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:01:13.716462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575008,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1421312,"data_stored":1017272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71599999999999997,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.35199999999999998,"15min":0.30599999999999999},"max":{"1min":0.93999999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71199999999999997,"15min":0.69099999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":0.91300000000000003,"5min":0.98799999999999999,"15min":0.99399999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.47799999999999998,"5min":0.39800000000000002,"15min":0.34799999999999998},"max":{"1min":0.91800000000000004,"5min":1.0449999999999999,"15min":1.0649999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86199999999999999,"5min":0.94099999999999995,"15min":0.97899999999999998},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.878,"5min":0.94799999999999995,"15min":0.94999999999999996},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73299999999999998,"15min":0.72799999999999998},"min":{"1min":0.52000000000000002,"5min":0.436,"15min":0.42599999999999999},"max":{"1min":0.89200000000000002,"5min":1.008,"15min":1.0529999999999999},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.44700000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0469999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":0.93700000000000006,"5min":0.99399999999999999,"15min":1.006},"last":0.79900000000000004}]},{"osd":4,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80700000000000005,"5min":0.94199999999999995,"15min":0.999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.747,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.35699999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57999999999999996,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.98499999999999999},"last":0.376},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":0.874,"5min":0.91100000000000003,"15min":0.99199999999999999},"last":0.40999999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70199999999999996,"15min":0.70099999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.40200000000000002},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":1.0309999999999999},"last":0.44},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65900000000000003,"15min":0.67200000000000004},"min":{"1min":0.51000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95399999999999996,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.48799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575008,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":823296,"data_stored":425885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72499999999999998,"15min":0.70499999999999996},"min":{"1min":0.54600000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.0980000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.74299999999999999,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.38300000000000001},"max":{"1min":0.94799999999999995,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73299999999999998,"15min":0.71299999999999997},"min":{"1min":0.56499999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.753,"15min":0.73199999999999998},"min":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.998,"5min":0.998,"15min":1.1180000000000001},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.71699999999999997},"min":{"1min":0.56499999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.3859999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75700000000000001,"15min":0.73999999999999999},"min":{"1min":0.63500000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76500000000000001,"15min":0.748},"min":{"1min":0.57999999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.204},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.753,"15min":0.73899999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.498},"max":{"1min":0.96199999999999997,"5min":0.98099999999999998,"15min":1.4339999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.59199999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80200000000000005,"5min":0.84999999999999998,"15min":1.1850000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.39300000000000002},"max":{"1min":0.84199999999999997,"5min":0.91900000000000004,"15min":1.321},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":1.0089999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.73599999999999999},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.89200000000000002,"5min":1.0189999999999999,"15min":1.631},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.41699999999999998},"max":{"1min":0.878,"5min":0.92400000000000004,"15min":1.3600000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67200000000000004,"15min":0.69999999999999996},"min":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.6930000000000001},"last":0.45000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575007,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":827392,"data_stored":426904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70599999999999996,"15min":0.69099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.99299999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.71499999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.39200000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.131},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.72499999999999998},"min":{"1min":0.56899999999999995,"5min":0.54400000000000004,"15min":0.41099999999999998},"max":{"1min":0.92400000000000004,"5min":0.94399999999999995,"15min":1.0329999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75800000000000001,"15min":0.73899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75700000000000001,"15min":0.73499999999999999},"min":{"1min":0.51100000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98299999999999998,"5min":0.98599999999999999,"15min":1.0369999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48999999999999999},"max":{"1min":0.93300000000000005,"5min":0.94399999999999995,"15min":0.96099999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77400000000000002,"15min":0.76300000000000001},"min":{"1min":0.64100000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.58799999999999997},"min":{"1min":0.42299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.747,"5min":0.86599999999999999,"15min":1},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59199999999999997,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91800000000000004,"5min":0.93400000000000005,"15min":1.02},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59299999999999997,"15min":0.64300000000000002},"min":{"1min":0.48999999999999999,"5min":0.44700000000000001,"15min":0.44600000000000001},"max":{"1min":0.86799999999999999,"5min":0.91400000000000003,"15min":1.052},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.65100000000000002},"min":{"1min":0.47499999999999998,"5min":0.46300000000000002,"15min":0.41799999999999998},"max":{"1min":0.82799999999999996,"5min":0.86399999999999999,"15min":0.96699999999999997},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.69699999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.45200000000000001},"max":{"1min":0.92200000000000004,"5min":0.96299999999999997,"15min":1.0529999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.70199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31856,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":827392,"data_stored":426904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.60099999999999998,"5min":0.47299999999999998,"15min":0.39400000000000002},"max":{"1min":0.93899999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.52600000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.86499999999999999,"5min":1.0489999999999999,"15min":1.071},"last":0.84599999999999997}]},{"osd":1,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.59199999999999997,"5min":0.51900000000000002,"15min":0.44},"max":{"1min":0.878,"5min":0.89200000000000002,"15min":1.361},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71199999999999997,"15min":0.72299999999999998},"min":{"1min":0.57399999999999995,"5min":0.47899999999999998,"15min":0.40300000000000002},"max":{"1min":0.90200000000000002,"5min":1.01,"15min":1.2829999999999999},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.73399999999999999,"15min":0.72299999999999998},"min":{"1min":0.64300000000000002,"5min":0.50800000000000001,"15min":0.40899999999999997},"max":{"1min":0.84699999999999998,"5min":1.1299999999999999,"15min":1.2170000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.752,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.505,"15min":0.38600000000000001},"max":{"1min":0.91800000000000004,"5min":0.98599999999999999,"15min":1.649},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72899999999999998,"15min":0.73999999999999999},"min":{"1min":0.61099999999999999,"5min":0.53800000000000003,"15min":0.45800000000000002},"max":{"1min":0.85199999999999998,"5min":0.93700000000000006,"15min":1.4219999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.60699999999999998,"5min":0.57199999999999995,"15min":0.49099999999999999},"max":{"1min":0.89100000000000001,"5min":0.97399999999999998,"15min":1.3109999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.308},"max":{"1min":0.80400000000000005,"5min":0.93700000000000006,"15min":1.246},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.63500000000000001},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.32500000000000001},"max":{"1min":0.88800000000000001,"5min":0.97299999999999998,"15min":1.8049999999999999},"last":0.85899999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.63100000000000001},"min":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.36299999999999999},"max":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":1.478},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63,"15min":0.68600000000000005},"min":{"1min":0.48299999999999998,"5min":0.443,"15min":0.34799999999999998},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.7250000000000001},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63900000000000001,"15min":0.68400000000000005},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93200000000000005,"5min":1.028,"15min":1.534},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64700000000000002,"15min":0.69399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90600000000000003,"5min":1.01,"15min":1.585},"last":0.82299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575007,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":827392,"data_stored":426904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26900000000000002},"max":{"1min":0.85499999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.311},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.33400000000000002},"max":{"1min":0.94899999999999995,"5min":0.99099999999999999,"15min":1.7190000000000001},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49199999999999999,"15min":0.47499999999999998},"min":{"1min":0.32400000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.88,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.33500000000000002,"15min":0.32700000000000001},"max":{"1min":0.73399999999999999,"5min":1.109,"15min":1.9590000000000001},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.53000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33000000000000002},"max":{"1min":0.621,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.34799999999999998},"max":{"1min":0.72099999999999997,"5min":1.24,"15min":2.012},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":0.95999999999999996,"5min":1.1339999999999999,"15min":1.855},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80000000000000004,"15min":0.77600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46000000000000002,"15min":0.432},"max":{"1min":1.0329999999999999,"5min":1.097,"15min":1.524},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83399999999999996,"15min":0.79400000000000004},"min":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.42399999999999999},"max":{"1min":0.95599999999999996,"5min":1.236,"15min":1.3720000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80400000000000005,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.45400000000000001,"15min":0.44800000000000001},"max":{"1min":1.0169999999999999,"5min":1.3999999999999999,"15min":1.883},"last":0.754}]},{"osd":6,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.78500000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40000000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.79200000000000004},"min":{"1min":0.56399999999999995,"5min":0.53600000000000003,"15min":0.47899999999999998},"max":{"1min":1.0640000000000001,"5min":1.101,"15min":1.4610000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82999999999999996,"15min":0.80100000000000005},"min":{"1min":0.57999999999999996,"5min":0.51300000000000001,"15min":0.497},"max":{"1min":1.0589999999999999,"5min":1.456,"15min":1.456},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52900000000000003},"max":{"1min":1.0649999999999999,"5min":1.3480000000000001,"15min":1.9830000000000001},"last":0.86599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575007,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":827392,"data_stored":426904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.44900000000000001},"min":{"1min":0.317,"5min":0.29099999999999998,"15min":0.28100000000000003},"max":{"1min":0.66300000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.78300000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.504},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.33700000000000002},"max":{"1min":0.63700000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.443,"5min":0.38400000000000001,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":0.76200000000000001,"15min":0.76500000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.56799999999999995},"min":{"1min":0.48999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77400000000000002,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.64500000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1040000000000001,"5min":1.21,"15min":1.2430000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81899999999999995,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.214,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80100000000000005,"15min":0.78900000000000003},"min":{"1min":0.68999999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0549999999999999,"5min":1.212,"15min":1.246},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83299999999999996,"15min":0.81899999999999995},"min":{"1min":0.70799999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1930000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.83999999999999997,"15min":0.80100000000000005},"min":{"1min":0.54900000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.246,"5min":1.27,"15min":1.27},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.68600000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.105,"5min":1.2410000000000001,"15min":1.3320000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.83799999999999997,"15min":0.82299999999999995},"min":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.54300000000000004},"max":{"1min":1.1439999999999999,"5min":1.2789999999999999,"15min":1.3520000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.85399999999999998,"15min":0.83299999999999996},"min":{"1min":0.67100000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.218,"5min":1.268,"15min":1.369},"last":0.91300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575008,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":827392,"data_stored":426904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.35799999999999998,"5min":0.28999999999999998,"15min":0.27500000000000002},"max":{"1min":0.63700000000000001,"5min":0.66100000000000003,"15min":0.73699999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.34399999999999997,"5min":0.32200000000000001,"15min":0.29399999999999998},"max":{"1min":0.64500000000000002,"5min":0.78900000000000003,"15min":0.92200000000000004},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.34300000000000003,"5min":0.33000000000000002,"15min":0.311},"max":{"1min":0.623,"5min":0.73599999999999999,"15min":0.80200000000000005},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73299999999999998,"5min":0.87,"15min":0.87},"last":0.443}]},{"osd":3,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.46500000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.70699999999999996,"5min":0.84599999999999997,"15min":0.96299999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72799999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78900000000000003,"15min":0.77200000000000002},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.38500000000000001},"max":{"1min":1.143,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79200000000000004,"15min":0.78100000000000003},"min":{"1min":0.65000000000000002,"5min":0.497,"15min":0.44},"max":{"1min":1.0049999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79600000000000004,"15min":0.77700000000000002},"min":{"1min":0.54800000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1890000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.47999999999999998,"15min":0.439},"max":{"1min":1.028,"5min":1.357,"15min":1.357},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.63300000000000001,"5min":0.54300000000000004,"15min":0.53800000000000003},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81200000000000006,"15min":0.80900000000000005},"min":{"1min":0.60999999999999999,"5min":0.51800000000000002,"15min":0.51500000000000001},"max":{"1min":0.97199999999999998,"5min":1.456,"15min":1.456},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.53800000000000003},"max":{"1min":1.0820000000000001,"5min":1.417,"15min":1.417},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.59499999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3280000000000001,"5min":1.397,"15min":1.397},"last":0.88100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575007,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1417216,"data_stored":1016253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.247},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.1459999999999999},"last":0.309},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.33600000000000002,"15min":0.28599999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":1.5189999999999999},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.30099999999999999},"max":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":1.228},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.34000000000000002},"max":{"1min":0.72299999999999998,"5min":0.85799999999999998,"15min":1.454},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.51100000000000001},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.308},"max":{"1min":0.71799999999999997,"5min":0.78900000000000003,"15min":1.7969999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.36799999999999999},"max":{"1min":0.83099999999999996,"5min":0.874,"15min":1.7190000000000001},"last":0.505}]},{"osd":4,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81699999999999995,"15min":0.79800000000000004},"min":{"1min":0.499,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.111,"5min":1.242,"15min":1.911},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.53100000000000003,"15min":0.35799999999999998},"max":{"1min":1.1020000000000001,"5min":1.2729999999999999,"15min":1.3620000000000001},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82599999999999996,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.38400000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.3700000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81499999999999995,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.55200000000000005,"15min":0.44400000000000001},"max":{"1min":1.0329999999999999,"5min":1.1759999999999999,"15min":1.758},"last":0.755}]},{"osd":6,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.52400000000000002},"max":{"1min":1.0780000000000001,"5min":1.2050000000000001,"15min":1.8220000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.47199999999999998},"max":{"1min":1.071,"5min":1.1379999999999999,"15min":2.266},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.63500000000000001,"5min":0.55900000000000005,"15min":0.53800000000000003},"max":{"1min":1.135,"5min":1.147,"15min":2.323},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.84699999999999998,"15min":0.81899999999999995},"min":{"1min":0.65500000000000003,"5min":0.60599999999999998,"15min":0.435},"max":{"1min":1.107,"5min":1.2210000000000001,"15min":1.2829999999999999},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:55:08.685 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:55:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd094f9f640 1 Processor -- start 2023-07-06T21:55:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd094f9f640 1 -- start start 2023-07-06T21:55:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd094f9f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd09006f8e0 0x7fd09006fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd094f9f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09015cc00 0x7fd09015f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd094f9f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09015c770 con 0x7fd09015bc40 2023-07-06T21:55:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd094f9f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09006d4f0 con 0x7fd09006f8e0 2023-07-06T21:55:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd094f9f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900701f0 con 0x7fd09015cc00 2023-07-06T21:55:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd08ed9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09015cc00 0x7fd09015f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd08e59c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd09006f8e0 0x7fd09006fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd08ed9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09015cc00 0x7fd09015f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:40276/0 (socket says 172.21.15.55:40276) 2023-07-06T21:55:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd08ed9d640 1 -- 172.21.15.55:0/786952701 learned_addr learned my addr 172.21.15.55:0/786952701 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd08e59c640 1 -- 172.21.15.55:0/786952701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09015cc00 msgr2=0x7fd09015f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd08e59c640 1 --2- 172.21.15.55:0/786952701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09015cc00 0x7fd09015f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd08e59c640 1 -- 172.21.15.55:0/786952701 >> v1:172.21.15.138:6789/0 conn(0x7fd09015bc40 legacy=0x7fd09006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd08e59c640 1 -- 172.21.15.55:0/786952701 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09006d210 con 0x7fd09006f8e0 2023-07-06T21:55:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.862+0000 7fd08ed9d640 1 --2- 172.21.15.55:0/786952701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09015cc00 0x7fd09015f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:55:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.866+0000 7fd08e59c640 1 --2- 172.21.15.55:0/786952701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09006f8e0 0x7fd09006fcb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd0800097f0 tx=0x7fd08001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50cb1e514b3bd188 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.866+0000 7fd08d59a640 1 -- 172.21.15.55:0/786952701 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800ab600 con 0x7fd09006f8e0 2023-07-06T21:55:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.866+0000 7fd08d59a640 1 -- 172.21.15.55:0/786952701 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0800a7050 con 0x7fd09006f8e0 2023-07-06T21:55:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.866+0000 7fd08d59a640 1 -- 172.21.15.55:0/786952701 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800ab980 con 0x7fd09006f8e0 2023-07-06T21:55:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.866+0000 7fd094f9f640 1 -- 172.21.15.55:0/786952701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09006f8e0 msgr2=0x7fd09006fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.866+0000 7fd094f9f640 1 --2- 172.21.15.55:0/786952701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09006f8e0 0x7fd09006fcb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd0800097f0 tx=0x7fd08001c480 comp rx=0 tx=0).stop 2023-07-06T21:55:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd094f9f640 1 -- 172.21.15.55:0/786952701 shutdown_connections 2023-07-06T21:55:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd094f9f640 1 --2- 172.21.15.55:0/786952701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09015cc00 0x7fd09015f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd094f9f640 1 --2- 172.21.15.55:0/786952701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09006f8e0 0x7fd09006fcb0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd094f9f640 1 -- 172.21.15.55:0/786952701 >> 172.21.15.55:0/786952701 conn(0x7fd0900cbd80 msgr2=0x7fd0900ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd094f9f640 1 -- 172.21.15.55:0/786952701 shutdown_connections 2023-07-06T21:55:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd094f9f640 1 -- 172.21.15.55:0/786952701 wait complete. 2023-07-06T21:55:08.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd094f9f640 1 Processor -- start 2023-07-06T21:55:08.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd094f9f640 1 -- start start 2023-07-06T21:55:08.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd094f9f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09006f8e0 0x7fd090157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd094f9f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09015bc40 0x7fd0900ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd094f9f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09015cc00 0x7fd0900abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd094f9f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd090157aa0 con 0x7fd09015bc40 2023-07-06T21:55:08.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd094f9f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd090153050 con 0x7fd09006f8e0 2023-07-06T21:55:08.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd094f9f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd090153330 con 0x7fd09015cc00 2023-07-06T21:55:08.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd08dd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09015bc40 0x7fd0900ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd08dd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09015bc40 0x7fd0900ab870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42738/0 (socket says 172.21.15.55:42738) 2023-07-06T21:55:08.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd08dd9b640 1 -- 172.21.15.55:0/3511787369 learned_addr learned my addr 172.21.15.55:0/3511787369 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:08.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd08ed9d640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09015cc00 0x7fd0900abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd08e59c640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09006f8e0 0x7fd090157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd08dd9b640 1 -- 172.21.15.55:0/3511787369 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09015cc00 msgr2=0x7fd0900abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd08dd9b640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09015cc00 0x7fd0900abdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd08dd9b640 1 -- 172.21.15.55:0/3511787369 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09006f8e0 msgr2=0x7fd090157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:08.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd08dd9b640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09006f8e0 0x7fd090157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:08.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd08dd9b640 1 -- 172.21.15.55:0/3511787369 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088009b30 con 0x7fd09015bc40 2023-07-06T21:55:08.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.870+0000 7fd08e59c640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09006f8e0 0x7fd090157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:55:08.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.874+0000 7fd08dd9b640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09015bc40 0x7fd0900ab870 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd08400c500 tx=0x7fd08400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:08.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.874+0000 7fd07effd640 1 -- 172.21.15.55:0/3511787369 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084005220 con 0x7fd09015bc40 2023-07-06T21:55:08.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.874+0000 7fd07effd640 1 -- 172.21.15.55:0/3511787369 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd084005380 con 0x7fd09015bc40 2023-07-06T21:55:08.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.874+0000 7fd094f9f640 1 -- 172.21.15.55:0/3511787369 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd080009420 con 0x7fd09015bc40 2023-07-06T21:55:08.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.874+0000 7fd07effd640 1 -- 172.21.15.55:0/3511787369 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084007270 con 0x7fd09015bc40 2023-07-06T21:55:08.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.874+0000 7fd094f9f640 1 -- 172.21.15.55:0/3511787369 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0901538f0 con 0x7fd09015bc40 2023-07-06T21:55:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.874+0000 7fd094f9f640 1 -- 172.21.15.55:0/3511787369 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd090155870 con 0x7fd09015bc40 2023-07-06T21:55:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.874+0000 7fd07effd640 1 -- 172.21.15.55:0/3511787369 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd0840073d0 con 0x7fd09015bc40 2023-07-06T21:55:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.874+0000 7fd07effd640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd0700663a0 0x7fd070068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.874+0000 7fd07effd640 1 -- 172.21.15.55:0/3511787369 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd084083920 con 0x7fd09015bc40 2023-07-06T21:55:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.874+0000 7fd08e59c640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd0700663a0 0x7fd070068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:08.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.878+0000 7fd08e59c640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd0700663a0 0x7fd070068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd0800ad000 tx=0x7fd080008040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:08.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:08.878+0000 7fd07effd640 1 -- 172.21.15.55:0/3511787369 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd084050ac0 con 0x7fd09015bc40 2023-07-06T21:55:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.030+0000 7fd094f9f640 1 -- 172.21.15.55:0/3511787369 --> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd090066d60 con 0x7fd0700663a0 2023-07-06T21:55:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.038+0000 7fd07effd640 1 -- 172.21.15.55:0/3511787369 <== mgr.6102 v2:172.21.15.55:6832/3843972996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311632 (secure 0 0 0) 0x7fd090066d60 con 0x7fd0700663a0 2023-07-06T21:55:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:55:09.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.042+0000 7fd094f9f640 1 -- 172.21.15.55:0/3511787369 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd0700663a0 msgr2=0x7fd070068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:09.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.042+0000 7fd094f9f640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd0700663a0 0x7fd070068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd0800ad000 tx=0x7fd080008040 comp rx=0 tx=0).stop 2023-07-06T21:55:09.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.042+0000 7fd094f9f640 1 -- 172.21.15.55:0/3511787369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09015bc40 msgr2=0x7fd0900ab870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:09.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.042+0000 7fd094f9f640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09015bc40 0x7fd0900ab870 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd08400c500 tx=0x7fd08400c9c0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.042+0000 7fd094f9f640 1 -- 172.21.15.55:0/3511787369 shutdown_connections 2023-07-06T21:55:09.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.042+0000 7fd094f9f640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd09015cc00 0x7fd0900abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.042+0000 7fd094f9f640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fd0700663a0 0x7fd070068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.042+0000 7fd094f9f640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09015bc40 0x7fd0900ab870 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.042+0000 7fd094f9f640 1 --2- 172.21.15.55:0/3511787369 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd09006f8e0 0x7fd090157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.042+0000 7fd094f9f640 1 -- 172.21.15.55:0/3511787369 >> 172.21.15.55:0/3511787369 conn(0x7fd0900cbd80 msgr2=0x7fd0900aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.042+0000 7fd094f9f640 1 -- 172.21.15.55:0/3511787369 shutdown_connections 2023-07-06T21:55:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.042+0000 7fd094f9f640 1 -- 172.21.15.55:0/3511787369 wait complete. 2023-07-06T21:55:09.064 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-06T21:55:08.711747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":243,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272832,"kb_used_data":8064,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754701888,"statfs":{"total":773094113280,"available":772814733312,"internally_reserved":0,"allocated":8257536,"data_stored":4821462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.931911"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204184+0000","last_change":"2023-07-06T21:55:04.220798+0000","last_active":"2023-07-06T21:55:05.204184+0000","last_peered":"2023-07-06T21:55:05.204184+0000","last_clean":"2023-07-06T21:55:05.204184+0000","last_became_active":"2023-07-06T21:55:04.220460+0000","last_became_peered":"2023-07-06T21:55:04.220460+0000","last_unstale":"2023-07-06T21:55:05.204184+0000","last_undegraded":"2023-07-06T21:55:05.204184+0000","last_fullsized":"2023-07-06T21:55:05.204184+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:28:57.801202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272938+0000","last_change":"2023-07-06T21:55:04.223711+0000","last_active":"2023-07-06T21:55:05.272938+0000","last_peered":"2023-07-06T21:55:05.272938+0000","last_clean":"2023-07-06T21:55:05.272938+0000","last_became_active":"2023-07-06T21:55:04.223401+0000","last_became_peered":"2023-07-06T21:55:04.223401+0000","last_unstale":"2023-07-06T21:55:05.272938+0000","last_undegraded":"2023-07-06T21:55:05.272938+0000","last_fullsized":"2023-07-06T21:55:05.272938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:19:09.613634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202336+0000","last_change":"2023-07-06T21:55:04.234546+0000","last_active":"2023-07-06T21:55:05.202336+0000","last_peered":"2023-07-06T21:55:05.202336+0000","last_clean":"2023-07-06T21:55:05.202336+0000","last_became_active":"2023-07-06T21:55:04.233591+0000","last_became_peered":"2023-07-06T21:55:04.233591+0000","last_unstale":"2023-07-06T21:55:05.202336+0000","last_undegraded":"2023-07-06T21:55:05.202336+0000","last_fullsized":"2023-07-06T21:55:05.202336+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:50:07.029554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273054+0000","last_change":"2023-07-06T21:55:04.223345+0000","last_active":"2023-07-06T21:55:05.273054+0000","last_peered":"2023-07-06T21:55:05.273054+0000","last_clean":"2023-07-06T21:55:05.273054+0000","last_became_active":"2023-07-06T21:55:04.223026+0000","last_became_peered":"2023-07-06T21:55:04.223026+0000","last_unstale":"2023-07-06T21:55:05.273054+0000","last_undegraded":"2023-07-06T21:55:05.273054+0000","last_fullsized":"2023-07-06T21:55:05.273054+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:29:12.189483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.203950+0000","last_change":"2023-07-06T21:55:04.214162+0000","last_active":"2023-07-06T21:55:05.203950+0000","last_peered":"2023-07-06T21:55:05.203950+0000","last_clean":"2023-07-06T21:55:05.203950+0000","last_became_active":"2023-07-06T21:55:04.213893+0000","last_became_peered":"2023-07-06T21:55:04.213893+0000","last_unstale":"2023-07-06T21:55:05.203950+0000","last_undegraded":"2023-07-06T21:55:05.203950+0000","last_fullsized":"2023-07-06T21:55:05.203950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:13:17.606501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273735+0000","last_change":"2023-07-06T21:55:04.230365+0000","last_active":"2023-07-06T21:55:05.273735+0000","last_peered":"2023-07-06T21:55:05.273735+0000","last_clean":"2023-07-06T21:55:05.273735+0000","last_became_active":"2023-07-06T21:55:04.227667+0000","last_became_peered":"2023-07-06T21:55:04.227667+0000","last_unstale":"2023-07-06T21:55:05.273735+0000","last_undegraded":"2023-07-06T21:55:05.273735+0000","last_fullsized":"2023-07-06T21:55:05.273735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:41:12.845036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272846+0000","last_change":"2023-07-06T21:55:04.216761+0000","last_active":"2023-07-06T21:55:05.272846+0000","last_peered":"2023-07-06T21:55:05.272846+0000","last_clean":"2023-07-06T21:55:05.272846+0000","last_became_active":"2023-07-06T21:55:04.216484+0000","last_became_peered":"2023-07-06T21:55:04.216484+0000","last_unstale":"2023-07-06T21:55:05.272846+0000","last_undegraded":"2023-07-06T21:55:05.272846+0000","last_fullsized":"2023-07-06T21:55:05.272846+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:54:17.807393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272298+0000","last_change":"2023-07-06T21:55:04.224324+0000","last_active":"2023-07-06T21:55:05.272298+0000","last_peered":"2023-07-06T21:55:05.272298+0000","last_clean":"2023-07-06T21:55:05.272298+0000","last_became_active":"2023-07-06T21:55:04.224033+0000","last_became_peered":"2023-07-06T21:55:04.224033+0000","last_unstale":"2023-07-06T21:55:05.272298+0000","last_undegraded":"2023-07-06T21:55:05.272298+0000","last_fullsized":"2023-07-06T21:55:05.272298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:21:49.400060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272879+0000","last_change":"2023-07-06T21:55:04.230849+0000","last_active":"2023-07-06T21:55:05.272879+0000","last_peered":"2023-07-06T21:55:05.272879+0000","last_clean":"2023-07-06T21:55:05.272879+0000","last_became_active":"2023-07-06T21:55:04.230567+0000","last_became_peered":"2023-07-06T21:55:04.230567+0000","last_unstale":"2023-07-06T21:55:05.272879+0000","last_undegraded":"2023-07-06T21:55:05.272879+0000","last_fullsized":"2023-07-06T21:55:05.272879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:46:26.481303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273744+0000","last_change":"2023-07-06T21:55:04.218779+0000","last_active":"2023-07-06T21:55:05.273744+0000","last_peered":"2023-07-06T21:55:05.273744+0000","last_clean":"2023-07-06T21:55:05.273744+0000","last_became_active":"2023-07-06T21:55:04.218481+0000","last_became_peered":"2023-07-06T21:55:04.218481+0000","last_unstale":"2023-07-06T21:55:05.273744+0000","last_undegraded":"2023-07-06T21:55:05.273744+0000","last_fullsized":"2023-07-06T21:55:05.273744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:45:00.915257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272673+0000","last_change":"2023-07-06T21:55:04.223194+0000","last_active":"2023-07-06T21:55:05.272673+0000","last_peered":"2023-07-06T21:55:05.272673+0000","last_clean":"2023-07-06T21:55:05.272673+0000","last_became_active":"2023-07-06T21:55:04.220410+0000","last_became_peered":"2023-07-06T21:55:04.220410+0000","last_unstale":"2023-07-06T21:55:05.272673+0000","last_undegraded":"2023-07-06T21:55:05.272673+0000","last_fullsized":"2023-07-06T21:55:05.272673+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:41:35.576504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273086+0000","last_change":"2023-07-06T21:55:04.232101+0000","last_active":"2023-07-06T21:55:05.273086+0000","last_peered":"2023-07-06T21:55:05.273086+0000","last_clean":"2023-07-06T21:55:05.273086+0000","last_became_active":"2023-07-06T21:55:04.231724+0000","last_became_peered":"2023-07-06T21:55:04.231724+0000","last_unstale":"2023-07-06T21:55:05.273086+0000","last_undegraded":"2023-07-06T21:55:05.273086+0000","last_fullsized":"2023-07-06T21:55:05.273086+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:45:35.836056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201204+0000","last_change":"2023-07-06T21:55:04.225624+0000","last_active":"2023-07-06T21:55:05.201204+0000","last_peered":"2023-07-06T21:55:05.201204+0000","last_clean":"2023-07-06T21:55:05.201204+0000","last_became_active":"2023-07-06T21:55:04.225297+0000","last_became_peered":"2023-07-06T21:55:04.225297+0000","last_unstale":"2023-07-06T21:55:05.201204+0000","last_undegraded":"2023-07-06T21:55:05.201204+0000","last_fullsized":"2023-07-06T21:55:05.201204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:40:51.418030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272225+0000","last_change":"2023-07-06T21:55:04.217483+0000","last_active":"2023-07-06T21:55:05.272225+0000","last_peered":"2023-07-06T21:55:05.272225+0000","last_clean":"2023-07-06T21:55:05.272225+0000","last_became_active":"2023-07-06T21:55:04.217080+0000","last_became_peered":"2023-07-06T21:55:04.217080+0000","last_unstale":"2023-07-06T21:55:05.272225+0000","last_undegraded":"2023-07-06T21:55:05.272225+0000","last_fullsized":"2023-07-06T21:55:05.272225+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:49:47.997199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272218+0000","last_change":"2023-07-06T21:55:04.220785+0000","last_active":"2023-07-06T21:55:05.272218+0000","last_peered":"2023-07-06T21:55:05.272218+0000","last_clean":"2023-07-06T21:55:05.272218+0000","last_became_active":"2023-07-06T21:55:04.220519+0000","last_became_peered":"2023-07-06T21:55:04.220519+0000","last_unstale":"2023-07-06T21:55:05.272218+0000","last_undegraded":"2023-07-06T21:55:05.272218+0000","last_fullsized":"2023-07-06T21:55:05.272218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:09:50.758130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273524+0000","last_change":"2023-07-06T21:55:04.230413+0000","last_active":"2023-07-06T21:55:05.273524+0000","last_peered":"2023-07-06T21:55:05.273524+0000","last_clean":"2023-07-06T21:55:05.273524+0000","last_became_active":"2023-07-06T21:55:04.230108+0000","last_became_peered":"2023-07-06T21:55:04.230108+0000","last_unstale":"2023-07-06T21:55:05.273524+0000","last_undegraded":"2023-07-06T21:55:05.273524+0000","last_fullsized":"2023-07-06T21:55:05.273524+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:54:37.625243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272874+0000","last_change":"2023-07-06T21:55:04.219597+0000","last_active":"2023-07-06T21:55:05.272874+0000","last_peered":"2023-07-06T21:55:05.272874+0000","last_clean":"2023-07-06T21:55:05.272874+0000","last_became_active":"2023-07-06T21:55:04.219310+0000","last_became_peered":"2023-07-06T21:55:04.219310+0000","last_unstale":"2023-07-06T21:55:05.272874+0000","last_undegraded":"2023-07-06T21:55:05.272874+0000","last_fullsized":"2023-07-06T21:55:05.272874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:15:59.948076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202573+0000","last_change":"2023-07-06T21:55:04.232165+0000","last_active":"2023-07-06T21:55:05.202573+0000","last_peered":"2023-07-06T21:55:05.202573+0000","last_clean":"2023-07-06T21:55:05.202573+0000","last_became_active":"2023-07-06T21:55:04.231440+0000","last_became_peered":"2023-07-06T21:55:04.231440+0000","last_unstale":"2023-07-06T21:55:05.202573+0000","last_undegraded":"2023-07-06T21:55:05.202573+0000","last_fullsized":"2023-07-06T21:55:05.202573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:29:00.009924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204147+0000","last_change":"2023-07-06T21:55:04.215150+0000","last_active":"2023-07-06T21:55:05.204147+0000","last_peered":"2023-07-06T21:55:05.204147+0000","last_clean":"2023-07-06T21:55:05.204147+0000","last_became_active":"2023-07-06T21:55:04.214900+0000","last_became_peered":"2023-07-06T21:55:04.214900+0000","last_unstale":"2023-07-06T21:55:05.204147+0000","last_undegraded":"2023-07-06T21:55:05.204147+0000","last_fullsized":"2023-07-06T21:55:05.204147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:10:03.683617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272783+0000","last_change":"2023-07-06T21:55:04.225692+0000","last_active":"2023-07-06T21:55:05.272783+0000","last_peered":"2023-07-06T21:55:05.272783+0000","last_clean":"2023-07-06T21:55:05.272783+0000","last_became_active":"2023-07-06T21:55:04.225387+0000","last_became_peered":"2023-07-06T21:55:04.225387+0000","last_unstale":"2023-07-06T21:55:05.272783+0000","last_undegraded":"2023-07-06T21:55:05.272783+0000","last_fullsized":"2023-07-06T21:55:05.272783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:24:25.395365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202005+0000","last_change":"2023-07-06T21:55:04.234651+0000","last_active":"2023-07-06T21:55:05.202005+0000","last_peered":"2023-07-06T21:55:05.202005+0000","last_clean":"2023-07-06T21:55:05.202005+0000","last_became_active":"2023-07-06T21:55:04.232750+0000","last_became_peered":"2023-07-06T21:55:04.232750+0000","last_unstale":"2023-07-06T21:55:05.202005+0000","last_undegraded":"2023-07-06T21:55:05.202005+0000","last_fullsized":"2023-07-06T21:55:05.202005+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:11:31.728348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272303+0000","last_change":"2023-07-06T21:55:04.223035+0000","last_active":"2023-07-06T21:55:05.272303+0000","last_peered":"2023-07-06T21:55:05.272303+0000","last_clean":"2023-07-06T21:55:05.272303+0000","last_became_active":"2023-07-06T21:55:04.222702+0000","last_became_peered":"2023-07-06T21:55:04.222702+0000","last_unstale":"2023-07-06T21:55:05.272303+0000","last_undegraded":"2023-07-06T21:55:05.272303+0000","last_fullsized":"2023-07-06T21:55:05.272303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:16:16.938720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201778+0000","last_change":"2023-07-06T21:55:04.228903+0000","last_active":"2023-07-06T21:55:05.201778+0000","last_peered":"2023-07-06T21:55:05.201778+0000","last_clean":"2023-07-06T21:55:05.201778+0000","last_became_active":"2023-07-06T21:55:04.228526+0000","last_became_peered":"2023-07-06T21:55:04.228526+0000","last_unstale":"2023-07-06T21:55:05.201778+0000","last_undegraded":"2023-07-06T21:55:05.201778+0000","last_fullsized":"2023-07-06T21:55:05.201778+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:56:18.324736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201014+0000","last_change":"2023-07-06T21:55:04.230641+0000","last_active":"2023-07-06T21:55:05.201014+0000","last_peered":"2023-07-06T21:55:05.201014+0000","last_clean":"2023-07-06T21:55:05.201014+0000","last_became_active":"2023-07-06T21:55:04.230163+0000","last_became_peered":"2023-07-06T21:55:04.230163+0000","last_unstale":"2023-07-06T21:55:05.201014+0000","last_undegraded":"2023-07-06T21:55:05.201014+0000","last_fullsized":"2023-07-06T21:55:05.201014+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:07:26.851153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204239+0000","last_change":"2023-07-06T21:55:04.221375+0000","last_active":"2023-07-06T21:55:05.204239+0000","last_peered":"2023-07-06T21:55:05.204239+0000","last_clean":"2023-07-06T21:55:05.204239+0000","last_became_active":"2023-07-06T21:55:04.220870+0000","last_became_peered":"2023-07-06T21:55:04.220870+0000","last_unstale":"2023-07-06T21:55:05.204239+0000","last_undegraded":"2023-07-06T21:55:05.204239+0000","last_fullsized":"2023-07-06T21:55:05.204239+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:08:03.218641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272825+0000","last_change":"2023-07-06T21:55:04.216751+0000","last_active":"2023-07-06T21:55:05.272825+0000","last_peered":"2023-07-06T21:55:05.272825+0000","last_clean":"2023-07-06T21:55:05.272825+0000","last_became_active":"2023-07-06T21:55:04.216466+0000","last_became_peered":"2023-07-06T21:55:04.216466+0000","last_unstale":"2023-07-06T21:55:05.272825+0000","last_undegraded":"2023-07-06T21:55:05.272825+0000","last_fullsized":"2023-07-06T21:55:05.272825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:20:40.333468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274432+0000","last_change":"2023-07-06T21:55:04.231152+0000","last_active":"2023-07-06T21:55:05.274432+0000","last_peered":"2023-07-06T21:55:05.274432+0000","last_clean":"2023-07-06T21:55:05.274432+0000","last_became_active":"2023-07-06T21:55:04.230811+0000","last_became_peered":"2023-07-06T21:55:04.230811+0000","last_unstale":"2023-07-06T21:55:05.274432+0000","last_undegraded":"2023-07-06T21:55:05.274432+0000","last_fullsized":"2023-07-06T21:55:05.274432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:31:12.550831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204083+0000","last_change":"2023-07-06T21:55:04.224726+0000","last_active":"2023-07-06T21:55:05.204083+0000","last_peered":"2023-07-06T21:55:05.204083+0000","last_clean":"2023-07-06T21:55:05.204083+0000","last_became_active":"2023-07-06T21:55:04.224352+0000","last_became_peered":"2023-07-06T21:55:04.224352+0000","last_unstale":"2023-07-06T21:55:05.204083+0000","last_undegraded":"2023-07-06T21:55:05.204083+0000","last_fullsized":"2023-07-06T21:55:05.204083+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:21:12.731301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272592+0000","last_change":"2023-07-06T21:55:04.219660+0000","last_active":"2023-07-06T21:55:05.272592+0000","last_peered":"2023-07-06T21:55:05.272592+0000","last_clean":"2023-07-06T21:55:05.272592+0000","last_became_active":"2023-07-06T21:55:04.219369+0000","last_became_peered":"2023-07-06T21:55:04.219369+0000","last_unstale":"2023-07-06T21:55:05.272592+0000","last_undegraded":"2023-07-06T21:55:05.272592+0000","last_fullsized":"2023-07-06T21:55:05.272592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:43.630523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202018+0000","last_change":"2023-07-06T21:55:04.226099+0000","last_active":"2023-07-06T21:55:05.202018+0000","last_peered":"2023-07-06T21:55:05.202018+0000","last_clean":"2023-07-06T21:55:05.202018+0000","last_became_active":"2023-07-06T21:55:04.225820+0000","last_became_peered":"2023-07-06T21:55:04.225820+0000","last_unstale":"2023-07-06T21:55:05.202018+0000","last_undegraded":"2023-07-06T21:55:05.202018+0000","last_fullsized":"2023-07-06T21:55:05.202018+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:23:17.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.203887+0000","last_change":"2023-07-06T21:55:04.221087+0000","last_active":"2023-07-06T21:55:05.203887+0000","last_peered":"2023-07-06T21:55:05.203887+0000","last_clean":"2023-07-06T21:55:05.203887+0000","last_became_active":"2023-07-06T21:55:04.220800+0000","last_became_peered":"2023-07-06T21:55:04.220800+0000","last_unstale":"2023-07-06T21:55:05.203887+0000","last_undegraded":"2023-07-06T21:55:05.203887+0000","last_fullsized":"2023-07-06T21:55:05.203887+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:31.101197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273658+0000","last_change":"2023-07-06T21:55:04.233759+0000","last_active":"2023-07-06T21:55:05.273658+0000","last_peered":"2023-07-06T21:55:05.273658+0000","last_clean":"2023-07-06T21:55:05.273658+0000","last_became_active":"2023-07-06T21:55:04.233493+0000","last_became_peered":"2023-07-06T21:55:04.233493+0000","last_unstale":"2023-07-06T21:55:05.273658+0000","last_undegraded":"2023-07-06T21:55:05.273658+0000","last_fullsized":"2023-07-06T21:55:05.273658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:28:32.886511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274173+0000","last_change":"2023-07-06T21:55:04.234548+0000","last_active":"2023-07-06T21:55:05.274173+0000","last_peered":"2023-07-06T21:55:05.274173+0000","last_clean":"2023-07-06T21:55:05.274173+0000","last_became_active":"2023-07-06T21:55:04.234277+0000","last_became_peered":"2023-07-06T21:55:04.234277+0000","last_unstale":"2023-07-06T21:55:05.274173+0000","last_undegraded":"2023-07-06T21:55:05.274173+0000","last_fullsized":"2023-07-06T21:55:05.274173+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:50:17.824151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"72'4","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274276+0000","last_change":"2023-07-06T21:55:03.812090+0000","last_active":"2023-07-06T21:55:05.274276+0000","last_peered":"2023-07-06T21:55:05.274276+0000","last_clean":"2023-07-06T21:55:05.274276+0000","last_became_active":"2023-07-06T21:55:03.811583+0000","last_became_peered":"2023-07-06T21:55:03.811583+0000","last_unstale":"2023-07-06T21:55:05.274276+0000","last_undegraded":"2023-07-06T21:55:05.274276+0000","last_fullsized":"2023-07-06T21:55:05.274276+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:32:35.703514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273599+0000","last_change":"2023-07-06T21:55:04.227368+0000","last_active":"2023-07-06T21:55:05.273599+0000","last_peered":"2023-07-06T21:55:05.273599+0000","last_clean":"2023-07-06T21:55:05.273599+0000","last_became_active":"2023-07-06T21:55:04.227065+0000","last_became_peered":"2023-07-06T21:55:04.227065+0000","last_unstale":"2023-07-06T21:55:05.273599+0000","last_undegraded":"2023-07-06T21:55:05.273599+0000","last_fullsized":"2023-07-06T21:55:05.273599+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:45:52.806377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273077+0000","last_change":"2023-07-06T21:55:03.804948+0000","last_active":"2023-07-06T21:55:05.273077+0000","last_peered":"2023-07-06T21:55:05.273077+0000","last_clean":"2023-07-06T21:55:05.273077+0000","last_became_active":"2023-07-06T21:55:03.804521+0000","last_became_peered":"2023-07-06T21:55:03.804521+0000","last_unstale":"2023-07-06T21:55:05.273077+0000","last_undegraded":"2023-07-06T21:55:05.273077+0000","last_fullsized":"2023-07-06T21:55:05.273077+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:41:37.991036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273962+0000","last_change":"2023-07-06T21:55:04.231223+0000","last_active":"2023-07-06T21:55:05.273962+0000","last_peered":"2023-07-06T21:55:05.273962+0000","last_clean":"2023-07-06T21:55:05.273962+0000","last_became_active":"2023-07-06T21:55:04.230950+0000","last_became_peered":"2023-07-06T21:55:04.230950+0000","last_unstale":"2023-07-06T21:55:05.273962+0000","last_undegraded":"2023-07-06T21:55:05.273962+0000","last_fullsized":"2023-07-06T21:55:05.273962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:25:49.579529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274559+0000","last_change":"2023-07-06T21:55:03.809667+0000","last_active":"2023-07-06T21:55:05.274559+0000","last_peered":"2023-07-06T21:55:05.274559+0000","last_clean":"2023-07-06T21:55:05.274559+0000","last_became_active":"2023-07-06T21:55:03.809442+0000","last_became_peered":"2023-07-06T21:55:03.809442+0000","last_unstale":"2023-07-06T21:55:05.274559+0000","last_undegraded":"2023-07-06T21:55:05.274559+0000","last_fullsized":"2023-07-06T21:55:05.274559+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:58:47.562937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274525+0000","last_change":"2023-07-06T21:55:04.233876+0000","last_active":"2023-07-06T21:55:05.274525+0000","last_peered":"2023-07-06T21:55:05.274525+0000","last_clean":"2023-07-06T21:55:05.274525+0000","last_became_active":"2023-07-06T21:55:04.233103+0000","last_became_peered":"2023-07-06T21:55:04.233103+0000","last_unstale":"2023-07-06T21:55:05.274525+0000","last_undegraded":"2023-07-06T21:55:05.274525+0000","last_fullsized":"2023-07-06T21:55:05.274525+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:50:21.140101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273221+0000","last_change":"2023-07-06T21:55:03.812044+0000","last_active":"2023-07-06T21:55:05.273221+0000","last_peered":"2023-07-06T21:55:05.273221+0000","last_clean":"2023-07-06T21:55:05.273221+0000","last_became_active":"2023-07-06T21:55:03.811771+0000","last_became_peered":"2023-07-06T21:55:03.811771+0000","last_unstale":"2023-07-06T21:55:05.273221+0000","last_undegraded":"2023-07-06T21:55:05.273221+0000","last_fullsized":"2023-07-06T21:55:05.273221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:12:50.277341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272434+0000","last_change":"2023-07-06T21:55:04.216166+0000","last_active":"2023-07-06T21:55:05.272434+0000","last_peered":"2023-07-06T21:55:05.272434+0000","last_clean":"2023-07-06T21:55:05.272434+0000","last_became_active":"2023-07-06T21:55:04.215825+0000","last_became_peered":"2023-07-06T21:55:04.215825+0000","last_unstale":"2023-07-06T21:55:05.272434+0000","last_undegraded":"2023-07-06T21:55:05.272434+0000","last_fullsized":"2023-07-06T21:55:05.272434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:28:16.698506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272572+0000","last_change":"2023-07-06T21:55:03.792388+0000","last_active":"2023-07-06T21:55:05.272572+0000","last_peered":"2023-07-06T21:55:05.272572+0000","last_clean":"2023-07-06T21:55:05.272572+0000","last_became_active":"2023-07-06T21:55:03.792043+0000","last_became_peered":"2023-07-06T21:55:03.792043+0000","last_unstale":"2023-07-06T21:55:05.272572+0000","last_undegraded":"2023-07-06T21:55:05.272572+0000","last_fullsized":"2023-07-06T21:55:05.272572+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:17:32.156313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272318+0000","last_change":"2023-07-06T21:55:04.225727+0000","last_active":"2023-07-06T21:55:05.272318+0000","last_peered":"2023-07-06T21:55:05.272318+0000","last_clean":"2023-07-06T21:55:05.272318+0000","last_became_active":"2023-07-06T21:55:04.225337+0000","last_became_peered":"2023-07-06T21:55:04.225337+0000","last_unstale":"2023-07-06T21:55:05.272318+0000","last_undegraded":"2023-07-06T21:55:05.272318+0000","last_fullsized":"2023-07-06T21:55:05.272318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:27:40.686809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274335+0000","last_change":"2023-07-06T21:55:03.807494+0000","last_active":"2023-07-06T21:55:05.274335+0000","last_peered":"2023-07-06T21:55:05.274335+0000","last_clean":"2023-07-06T21:55:05.274335+0000","last_became_active":"2023-07-06T21:55:03.807187+0000","last_became_peered":"2023-07-06T21:55:03.807187+0000","last_unstale":"2023-07-06T21:55:05.274335+0000","last_undegraded":"2023-07-06T21:55:05.274335+0000","last_fullsized":"2023-07-06T21:55:05.274335+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:55:16.881750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201079+0000","last_change":"2023-07-06T21:55:04.226482+0000","last_active":"2023-07-06T21:55:05.201079+0000","last_peered":"2023-07-06T21:55:05.201079+0000","last_clean":"2023-07-06T21:55:05.201079+0000","last_became_active":"2023-07-06T21:55:04.226134+0000","last_became_peered":"2023-07-06T21:55:04.226134+0000","last_unstale":"2023-07-06T21:55:05.201079+0000","last_undegraded":"2023-07-06T21:55:05.201079+0000","last_fullsized":"2023-07-06T21:55:05.201079+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:41:18.683234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272393+0000","last_change":"2023-07-06T21:55:03.799988+0000","last_active":"2023-07-06T21:55:05.272393+0000","last_peered":"2023-07-06T21:55:05.272393+0000","last_clean":"2023-07-06T21:55:05.272393+0000","last_became_active":"2023-07-06T21:55:03.799579+0000","last_became_peered":"2023-07-06T21:55:03.799579+0000","last_unstale":"2023-07-06T21:55:05.272393+0000","last_undegraded":"2023-07-06T21:55:05.272393+0000","last_fullsized":"2023-07-06T21:55:05.272393+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:54:50.788128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272739+0000","last_change":"2023-07-06T21:55:04.219704+0000","last_active":"2023-07-06T21:55:05.272739+0000","last_peered":"2023-07-06T21:55:05.272739+0000","last_clean":"2023-07-06T21:55:05.272739+0000","last_became_active":"2023-07-06T21:55:04.219356+0000","last_became_peered":"2023-07-06T21:55:04.219356+0000","last_unstale":"2023-07-06T21:55:05.272739+0000","last_undegraded":"2023-07-06T21:55:05.272739+0000","last_fullsized":"2023-07-06T21:55:05.272739+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:01:12.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272996+0000","last_change":"2023-07-06T21:55:03.807065+0000","last_active":"2023-07-06T21:55:05.272996+0000","last_peered":"2023-07-06T21:55:05.272996+0000","last_clean":"2023-07-06T21:55:05.272996+0000","last_became_active":"2023-07-06T21:55:03.806743+0000","last_became_peered":"2023-07-06T21:55:03.806743+0000","last_unstale":"2023-07-06T21:55:05.272996+0000","last_undegraded":"2023-07-06T21:55:05.272996+0000","last_fullsized":"2023-07-06T21:55:05.272996+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:59:00.624031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272542+0000","last_change":"2023-07-06T21:55:04.222148+0000","last_active":"2023-07-06T21:55:05.272542+0000","last_peered":"2023-07-06T21:55:05.272542+0000","last_clean":"2023-07-06T21:55:05.272542+0000","last_became_active":"2023-07-06T21:55:04.221861+0000","last_became_peered":"2023-07-06T21:55:04.221861+0000","last_unstale":"2023-07-06T21:55:05.272542+0000","last_undegraded":"2023-07-06T21:55:05.272542+0000","last_fullsized":"2023-07-06T21:55:05.272542+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:32:10.274300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202564+0000","last_change":"2023-07-06T21:55:03.807178+0000","last_active":"2023-07-06T21:55:05.202564+0000","last_peered":"2023-07-06T21:55:05.202564+0000","last_clean":"2023-07-06T21:55:05.202564+0000","last_became_active":"2023-07-06T21:55:03.806882+0000","last_became_peered":"2023-07-06T21:55:03.806882+0000","last_unstale":"2023-07-06T21:55:05.202564+0000","last_undegraded":"2023-07-06T21:55:05.202564+0000","last_fullsized":"2023-07-06T21:55:05.202564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:49:35.090189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202537+0000","last_change":"2023-07-06T21:55:04.231055+0000","last_active":"2023-07-06T21:55:05.202537+0000","last_peered":"2023-07-06T21:55:05.202537+0000","last_clean":"2023-07-06T21:55:05.202537+0000","last_became_active":"2023-07-06T21:55:04.230743+0000","last_became_peered":"2023-07-06T21:55:04.230743+0000","last_unstale":"2023-07-06T21:55:05.202537+0000","last_undegraded":"2023-07-06T21:55:05.202537+0000","last_fullsized":"2023-07-06T21:55:05.202537+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:16:23.178280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273072+0000","last_change":"2023-07-06T21:55:03.808339+0000","last_active":"2023-07-06T21:55:05.273072+0000","last_peered":"2023-07-06T21:55:05.273072+0000","last_clean":"2023-07-06T21:55:05.273072+0000","last_became_active":"2023-07-06T21:55:03.808030+0000","last_became_peered":"2023-07-06T21:55:03.808030+0000","last_unstale":"2023-07-06T21:55:05.273072+0000","last_undegraded":"2023-07-06T21:55:05.273072+0000","last_fullsized":"2023-07-06T21:55:05.273072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:53:05.435779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273176+0000","last_change":"2023-07-06T21:55:04.221150+0000","last_active":"2023-07-06T21:55:05.273176+0000","last_peered":"2023-07-06T21:55:05.273176+0000","last_clean":"2023-07-06T21:55:05.273176+0000","last_became_active":"2023-07-06T21:55:04.220753+0000","last_became_peered":"2023-07-06T21:55:04.220753+0000","last_unstale":"2023-07-06T21:55:05.273176+0000","last_undegraded":"2023-07-06T21:55:05.273176+0000","last_fullsized":"2023-07-06T21:55:05.273176+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:14:13.107759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"72'3","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202593+0000","last_change":"2023-07-06T21:55:03.807957+0000","last_active":"2023-07-06T21:55:05.202593+0000","last_peered":"2023-07-06T21:55:05.202593+0000","last_clean":"2023-07-06T21:55:05.202593+0000","last_became_active":"2023-07-06T21:55:03.807448+0000","last_became_peered":"2023-07-06T21:55:03.807448+0000","last_unstale":"2023-07-06T21:55:05.202593+0000","last_undegraded":"2023-07-06T21:55:05.202593+0000","last_fullsized":"2023-07-06T21:55:05.202593+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:11:44.003544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202388+0000","last_change":"2023-07-06T21:55:04.234744+0000","last_active":"2023-07-06T21:55:05.202388+0000","last_peered":"2023-07-06T21:55:05.202388+0000","last_clean":"2023-07-06T21:55:05.202388+0000","last_became_active":"2023-07-06T21:55:04.233910+0000","last_became_peered":"2023-07-06T21:55:04.233910+0000","last_unstale":"2023-07-06T21:55:05.202388+0000","last_undegraded":"2023-07-06T21:55:05.202388+0000","last_fullsized":"2023-07-06T21:55:05.202388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:22:39.798722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"72'6","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272837+0000","last_change":"2023-07-06T21:55:03.807413+0000","last_active":"2023-07-06T21:55:05.272837+0000","last_peered":"2023-07-06T21:55:05.272837+0000","last_clean":"2023-07-06T21:55:05.272837+0000","last_became_active":"2023-07-06T21:55:03.807053+0000","last_became_peered":"2023-07-06T21:55:03.807053+0000","last_unstale":"2023-07-06T21:55:05.272837+0000","last_undegraded":"2023-07-06T21:55:05.272837+0000","last_fullsized":"2023-07-06T21:55:05.272837+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:47.778643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272416+0000","last_change":"2023-07-06T21:55:04.224174+0000","last_active":"2023-07-06T21:55:05.272416+0000","last_peered":"2023-07-06T21:55:05.272416+0000","last_clean":"2023-07-06T21:55:05.272416+0000","last_became_active":"2023-07-06T21:55:04.223406+0000","last_became_peered":"2023-07-06T21:55:04.223406+0000","last_unstale":"2023-07-06T21:55:05.272416+0000","last_undegraded":"2023-07-06T21:55:05.272416+0000","last_fullsized":"2023-07-06T21:55:05.272416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:56:11.929414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272454+0000","last_change":"2023-07-06T21:55:03.811485+0000","last_active":"2023-07-06T21:55:05.272454+0000","last_peered":"2023-07-06T21:55:05.272454+0000","last_clean":"2023-07-06T21:55:05.272454+0000","last_became_active":"2023-07-06T21:55:03.811212+0000","last_became_peered":"2023-07-06T21:55:03.811212+0000","last_unstale":"2023-07-06T21:55:05.272454+0000","last_undegraded":"2023-07-06T21:55:05.272454+0000","last_fullsized":"2023-07-06T21:55:05.272454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:11:31.075853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202140+0000","last_change":"2023-07-06T21:55:04.225159+0000","last_active":"2023-07-06T21:55:05.202140+0000","last_peered":"2023-07-06T21:55:05.202140+0000","last_clean":"2023-07-06T21:55:05.202140+0000","last_became_active":"2023-07-06T21:55:04.224843+0000","last_became_peered":"2023-07-06T21:55:04.224843+0000","last_unstale":"2023-07-06T21:55:05.202140+0000","last_undegraded":"2023-07-06T21:55:05.202140+0000","last_fullsized":"2023-07-06T21:55:05.202140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:53:39.618561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201252+0000","last_change":"2023-07-06T21:55:03.805066+0000","last_active":"2023-07-06T21:55:05.201252+0000","last_peered":"2023-07-06T21:55:05.201252+0000","last_clean":"2023-07-06T21:55:05.201252+0000","last_became_active":"2023-07-06T21:55:03.804751+0000","last_became_peered":"2023-07-06T21:55:03.804751+0000","last_unstale":"2023-07-06T21:55:05.201252+0000","last_undegraded":"2023-07-06T21:55:05.201252+0000","last_fullsized":"2023-07-06T21:55:05.201252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:51:12.819787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272942+0000","last_change":"2023-07-06T21:55:04.227420+0000","last_active":"2023-07-06T21:55:05.272942+0000","last_peered":"2023-07-06T21:55:05.272942+0000","last_clean":"2023-07-06T21:55:05.272942+0000","last_became_active":"2023-07-06T21:55:04.227085+0000","last_became_peered":"2023-07-06T21:55:04.227085+0000","last_unstale":"2023-07-06T21:55:05.272942+0000","last_undegraded":"2023-07-06T21:55:05.272942+0000","last_fullsized":"2023-07-06T21:55:05.272942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:09:31.701550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272530+0000","last_change":"2023-07-06T21:55:03.803116+0000","last_active":"2023-07-06T21:55:05.272530+0000","last_peered":"2023-07-06T21:55:05.272530+0000","last_clean":"2023-07-06T21:55:05.272530+0000","last_became_active":"2023-07-06T21:55:03.802152+0000","last_became_peered":"2023-07-06T21:55:03.802152+0000","last_unstale":"2023-07-06T21:55:05.272530+0000","last_undegraded":"2023-07-06T21:55:05.272530+0000","last_fullsized":"2023-07-06T21:55:05.272530+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:37:39.062474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201774+0000","last_change":"2023-07-06T21:55:04.234452+0000","last_active":"2023-07-06T21:55:05.201774+0000","last_peered":"2023-07-06T21:55:05.201774+0000","last_clean":"2023-07-06T21:55:05.201774+0000","last_became_active":"2023-07-06T21:55:04.234074+0000","last_became_peered":"2023-07-06T21:55:04.234074+0000","last_unstale":"2023-07-06T21:55:05.201774+0000","last_undegraded":"2023-07-06T21:55:05.201774+0000","last_fullsized":"2023-07-06T21:55:05.201774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:31:33.634770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"72'8","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201508+0000","last_change":"2023-07-06T21:55:03.805724+0000","last_active":"2023-07-06T21:55:05.201508+0000","last_peered":"2023-07-06T21:55:05.201508+0000","last_clean":"2023-07-06T21:55:05.201508+0000","last_became_active":"2023-07-06T21:55:03.805440+0000","last_became_peered":"2023-07-06T21:55:03.805440+0000","last_unstale":"2023-07-06T21:55:05.201508+0000","last_undegraded":"2023-07-06T21:55:05.201508+0000","last_fullsized":"2023-07-06T21:55:05.201508+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:52:19.464262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272879+0000","last_change":"2023-07-06T21:55:04.220436+0000","last_active":"2023-07-06T21:55:05.272879+0000","last_peered":"2023-07-06T21:55:05.272879+0000","last_clean":"2023-07-06T21:55:05.272879+0000","last_became_active":"2023-07-06T21:55:04.220141+0000","last_became_peered":"2023-07-06T21:55:04.220141+0000","last_unstale":"2023-07-06T21:55:05.272879+0000","last_undegraded":"2023-07-06T21:55:05.272879+0000","last_fullsized":"2023-07-06T21:55:05.272879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:27:41.343194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273620+0000","last_change":"2023-07-06T21:55:03.810233+0000","last_active":"2023-07-06T21:55:05.273620+0000","last_peered":"2023-07-06T21:55:05.273620+0000","last_clean":"2023-07-06T21:55:05.273620+0000","last_became_active":"2023-07-06T21:55:03.809895+0000","last_became_peered":"2023-07-06T21:55:03.809895+0000","last_unstale":"2023-07-06T21:55:05.273620+0000","last_undegraded":"2023-07-06T21:55:05.273620+0000","last_fullsized":"2023-07-06T21:55:05.273620+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:27:33.769012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272975+0000","last_change":"2023-07-06T21:55:04.227295+0000","last_active":"2023-07-06T21:55:05.272975+0000","last_peered":"2023-07-06T21:55:05.272975+0000","last_clean":"2023-07-06T21:55:05.272975+0000","last_became_active":"2023-07-06T21:55:04.227037+0000","last_became_peered":"2023-07-06T21:55:04.227037+0000","last_unstale":"2023-07-06T21:55:05.272975+0000","last_undegraded":"2023-07-06T21:55:05.272975+0000","last_fullsized":"2023-07-06T21:55:05.272975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:52.681786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274286+0000","last_change":"2023-07-06T21:55:03.806612+0000","last_active":"2023-07-06T21:55:05.274286+0000","last_peered":"2023-07-06T21:55:05.274286+0000","last_clean":"2023-07-06T21:55:05.274286+0000","last_became_active":"2023-07-06T21:55:03.806332+0000","last_became_peered":"2023-07-06T21:55:03.806332+0000","last_unstale":"2023-07-06T21:55:05.274286+0000","last_undegraded":"2023-07-06T21:55:05.274286+0000","last_fullsized":"2023-07-06T21:55:05.274286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:06:44.765902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273343+0000","last_change":"2023-07-06T21:55:04.220772+0000","last_active":"2023-07-06T21:55:05.273343+0000","last_peered":"2023-07-06T21:55:05.273343+0000","last_clean":"2023-07-06T21:55:05.273343+0000","last_became_active":"2023-07-06T21:55:04.220461+0000","last_became_peered":"2023-07-06T21:55:04.220461+0000","last_unstale":"2023-07-06T21:55:05.273343+0000","last_undegraded":"2023-07-06T21:55:05.273343+0000","last_fullsized":"2023-07-06T21:55:05.273343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:21:05.967199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201308+0000","last_change":"2023-07-06T21:55:03.805049+0000","last_active":"2023-07-06T21:55:05.201308+0000","last_peered":"2023-07-06T21:55:05.201308+0000","last_clean":"2023-07-06T21:55:05.201308+0000","last_became_active":"2023-07-06T21:55:03.804698+0000","last_became_peered":"2023-07-06T21:55:03.804698+0000","last_unstale":"2023-07-06T21:55:05.201308+0000","last_undegraded":"2023-07-06T21:55:05.201308+0000","last_fullsized":"2023-07-06T21:55:05.201308+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:31:30.590376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274443+0000","last_change":"2023-07-06T21:55:04.234114+0000","last_active":"2023-07-06T21:55:05.274443+0000","last_peered":"2023-07-06T21:55:05.274443+0000","last_clean":"2023-07-06T21:55:05.274443+0000","last_became_active":"2023-07-06T21:55:04.233621+0000","last_became_peered":"2023-07-06T21:55:04.233621+0000","last_unstale":"2023-07-06T21:55:05.274443+0000","last_undegraded":"2023-07-06T21:55:05.274443+0000","last_fullsized":"2023-07-06T21:55:05.274443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:19.551788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273213+0000","last_change":"2023-07-06T21:55:03.803911+0000","last_active":"2023-07-06T21:55:05.273213+0000","last_peered":"2023-07-06T21:55:05.273213+0000","last_clean":"2023-07-06T21:55:05.273213+0000","last_became_active":"2023-07-06T21:55:03.803613+0000","last_became_peered":"2023-07-06T21:55:03.803613+0000","last_unstale":"2023-07-06T21:55:05.273213+0000","last_undegraded":"2023-07-06T21:55:05.273213+0000","last_fullsized":"2023-07-06T21:55:05.273213+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:14:49.214470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272567+0000","last_change":"2023-07-06T21:55:04.223535+0000","last_active":"2023-07-06T21:55:05.272567+0000","last_peered":"2023-07-06T21:55:05.272567+0000","last_clean":"2023-07-06T21:55:05.272567+0000","last_became_active":"2023-07-06T21:55:04.223287+0000","last_became_peered":"2023-07-06T21:55:04.223287+0000","last_unstale":"2023-07-06T21:55:05.272567+0000","last_undegraded":"2023-07-06T21:55:05.272567+0000","last_fullsized":"2023-07-06T21:55:05.272567+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:56:51.262527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273245+0000","last_change":"2023-07-06T21:55:03.804703+0000","last_active":"2023-07-06T21:55:05.273245+0000","last_peered":"2023-07-06T21:55:05.273245+0000","last_clean":"2023-07-06T21:55:05.273245+0000","last_became_active":"2023-07-06T21:55:03.804419+0000","last_became_peered":"2023-07-06T21:55:03.804419+0000","last_unstale":"2023-07-06T21:55:05.273245+0000","last_undegraded":"2023-07-06T21:55:05.273245+0000","last_fullsized":"2023-07-06T21:55:05.273245+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:23:20.788292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202204+0000","last_change":"2023-07-06T21:55:04.234917+0000","last_active":"2023-07-06T21:55:05.202204+0000","last_peered":"2023-07-06T21:55:05.202204+0000","last_clean":"2023-07-06T21:55:05.202204+0000","last_became_active":"2023-07-06T21:55:04.233565+0000","last_became_peered":"2023-07-06T21:55:04.233565+0000","last_unstale":"2023-07-06T21:55:05.202204+0000","last_undegraded":"2023-07-06T21:55:05.202204+0000","last_fullsized":"2023-07-06T21:55:05.202204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:37.557130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272356+0000","last_change":"2023-07-06T21:55:03.808191+0000","last_active":"2023-07-06T21:55:05.272356+0000","last_peered":"2023-07-06T21:55:05.272356+0000","last_clean":"2023-07-06T21:55:05.272356+0000","last_became_active":"2023-07-06T21:55:03.807881+0000","last_became_peered":"2023-07-06T21:55:03.807881+0000","last_unstale":"2023-07-06T21:55:05.272356+0000","last_undegraded":"2023-07-06T21:55:05.272356+0000","last_fullsized":"2023-07-06T21:55:05.272356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:21:47.438191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272752+0000","last_change":"2023-07-06T21:55:04.215271+0000","last_active":"2023-07-06T21:55:05.272752+0000","last_peered":"2023-07-06T21:55:05.272752+0000","last_clean":"2023-07-06T21:55:05.272752+0000","last_became_active":"2023-07-06T21:55:04.214987+0000","last_became_peered":"2023-07-06T21:55:04.214987+0000","last_unstale":"2023-07-06T21:55:05.272752+0000","last_undegraded":"2023-07-06T21:55:05.272752+0000","last_fullsized":"2023-07-06T21:55:05.272752+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:03:48.077161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273097+0000","last_change":"2023-07-06T21:55:03.808513+0000","last_active":"2023-07-06T21:55:05.273097+0000","last_peered":"2023-07-06T21:55:05.273097+0000","last_clean":"2023-07-06T21:55:05.273097+0000","last_became_active":"2023-07-06T21:55:03.808255+0000","last_became_peered":"2023-07-06T21:55:03.808255+0000","last_unstale":"2023-07-06T21:55:05.273097+0000","last_undegraded":"2023-07-06T21:55:05.273097+0000","last_fullsized":"2023-07-06T21:55:05.273097+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:56:51.473088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272614+0000","last_change":"2023-07-06T21:55:04.220280+0000","last_active":"2023-07-06T21:55:05.272614+0000","last_peered":"2023-07-06T21:55:05.272614+0000","last_clean":"2023-07-06T21:55:05.272614+0000","last_became_active":"2023-07-06T21:55:04.219967+0000","last_became_peered":"2023-07-06T21:55:04.219967+0000","last_unstale":"2023-07-06T21:55:05.272614+0000","last_undegraded":"2023-07-06T21:55:05.272614+0000","last_fullsized":"2023-07-06T21:55:05.272614+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:04:50.371503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272570+0000","last_change":"2023-07-06T21:55:03.809420+0000","last_active":"2023-07-06T21:55:05.272570+0000","last_peered":"2023-07-06T21:55:05.272570+0000","last_clean":"2023-07-06T21:55:05.272570+0000","last_became_active":"2023-07-06T21:55:03.809110+0000","last_became_peered":"2023-07-06T21:55:03.809110+0000","last_unstale":"2023-07-06T21:55:05.272570+0000","last_undegraded":"2023-07-06T21:55:05.272570+0000","last_fullsized":"2023-07-06T21:55:05.272570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:45:04.202987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272438+0000","last_change":"2023-07-06T21:55:04.229997+0000","last_active":"2023-07-06T21:55:05.272438+0000","last_peered":"2023-07-06T21:55:05.272438+0000","last_clean":"2023-07-06T21:55:05.272438+0000","last_became_active":"2023-07-06T21:55:04.229709+0000","last_became_peered":"2023-07-06T21:55:04.229709+0000","last_unstale":"2023-07-06T21:55:05.272438+0000","last_undegraded":"2023-07-06T21:55:05.272438+0000","last_fullsized":"2023-07-06T21:55:05.272438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:12:43.599490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201149+0000","last_change":"2023-07-06T21:55:03.810800+0000","last_active":"2023-07-06T21:55:05.201149+0000","last_peered":"2023-07-06T21:55:05.201149+0000","last_clean":"2023-07-06T21:55:05.201149+0000","last_became_active":"2023-07-06T21:55:03.810377+0000","last_became_peered":"2023-07-06T21:55:03.810377+0000","last_unstale":"2023-07-06T21:55:05.201149+0000","last_undegraded":"2023-07-06T21:55:05.201149+0000","last_fullsized":"2023-07-06T21:55:05.201149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:56:59.341675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"60'139","reported_seq":355,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201755+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:55:05.201755+0000","last_peered":"2023-07-06T21:55:05.201755+0000","last_clean":"2023-07-06T21:55:05.201755+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:55:05.201755+0000","last_undegraded":"2023-07-06T21:55:05.201755+0000","last_fullsized":"2023-07-06T21:55:05.201755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:55:24.093240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":111,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273243+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:55:05.273243+0000","last_peered":"2023-07-06T21:55:05.273243+0000","last_clean":"2023-07-06T21:55:05.273243+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:55:05.273243+0000","last_undegraded":"2023-07-06T21:55:05.273243+0000","last_fullsized":"2023-07-06T21:55:05.273243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:44:07.375135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273936+0000","last_change":"2023-07-06T21:55:04.224893+0000","last_active":"2023-07-06T21:55:05.273936+0000","last_peered":"2023-07-06T21:55:05.273936+0000","last_clean":"2023-07-06T21:55:05.273936+0000","last_became_active":"2023-07-06T21:55:04.224576+0000","last_became_peered":"2023-07-06T21:55:04.224576+0000","last_unstale":"2023-07-06T21:55:05.273936+0000","last_undegraded":"2023-07-06T21:55:05.273936+0000","last_fullsized":"2023-07-06T21:55:05.273936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:13:47.968292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273380+0000","last_change":"2023-07-06T21:55:03.797613+0000","last_active":"2023-07-06T21:55:05.273380+0000","last_peered":"2023-07-06T21:55:05.273380+0000","last_clean":"2023-07-06T21:55:05.273380+0000","last_became_active":"2023-07-06T21:55:03.797319+0000","last_became_peered":"2023-07-06T21:55:03.797319+0000","last_unstale":"2023-07-06T21:55:05.273380+0000","last_undegraded":"2023-07-06T21:55:05.273380+0000","last_fullsized":"2023-07-06T21:55:05.273380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:04:54.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201601+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:55:05.201601+0000","last_peered":"2023-07-06T21:55:05.201601+0000","last_clean":"2023-07-06T21:55:05.201601+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:55:05.201601+0000","last_undegraded":"2023-07-06T21:55:05.201601+0000","last_fullsized":"2023-07-06T21:55:05.201601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:20:02.309799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272572+0000","last_change":"2023-07-06T21:55:04.224373+0000","last_active":"2023-07-06T21:55:05.272572+0000","last_peered":"2023-07-06T21:55:05.272572+0000","last_clean":"2023-07-06T21:55:05.272572+0000","last_became_active":"2023-07-06T21:55:04.223861+0000","last_became_peered":"2023-07-06T21:55:04.223861+0000","last_unstale":"2023-07-06T21:55:05.272572+0000","last_undegraded":"2023-07-06T21:55:05.272572+0000","last_fullsized":"2023-07-06T21:55:05.272572+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:10:15.780966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272727+0000","last_change":"2023-07-06T21:55:03.805520+0000","last_active":"2023-07-06T21:55:05.272727+0000","last_peered":"2023-07-06T21:55:05.272727+0000","last_clean":"2023-07-06T21:55:05.272727+0000","last_became_active":"2023-07-06T21:55:03.805236+0000","last_became_peered":"2023-07-06T21:55:03.805236+0000","last_unstale":"2023-07-06T21:55:05.272727+0000","last_undegraded":"2023-07-06T21:55:05.272727+0000","last_fullsized":"2023-07-06T21:55:05.272727+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:05:58.180036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204281+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:55:05.204281+0000","last_peered":"2023-07-06T21:55:05.204281+0000","last_clean":"2023-07-06T21:55:05.204281+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:55:05.204281+0000","last_undegraded":"2023-07-06T21:55:05.204281+0000","last_fullsized":"2023-07-06T21:55:05.204281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:24:43.577061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273528+0000","last_change":"2023-07-06T21:55:04.237089+0000","last_active":"2023-07-06T21:55:05.273528+0000","last_peered":"2023-07-06T21:55:05.273528+0000","last_clean":"2023-07-06T21:55:05.273528+0000","last_became_active":"2023-07-06T21:55:04.236799+0000","last_became_peered":"2023-07-06T21:55:04.236799+0000","last_unstale":"2023-07-06T21:55:05.273528+0000","last_undegraded":"2023-07-06T21:55:05.273528+0000","last_fullsized":"2023-07-06T21:55:05.273528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:51:46.035092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272424+0000","last_change":"2023-07-06T21:55:03.810224+0000","last_active":"2023-07-06T21:55:05.272424+0000","last_peered":"2023-07-06T21:55:05.272424+0000","last_clean":"2023-07-06T21:55:05.272424+0000","last_became_active":"2023-07-06T21:55:03.809937+0000","last_became_peered":"2023-07-06T21:55:03.809937+0000","last_unstale":"2023-07-06T21:55:05.272424+0000","last_undegraded":"2023-07-06T21:55:05.272424+0000","last_fullsized":"2023-07-06T21:55:05.272424+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:40:45.345972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272666+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:55:05.272666+0000","last_peered":"2023-07-06T21:55:05.272666+0000","last_clean":"2023-07-06T21:55:05.272666+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:55:05.272666+0000","last_undegraded":"2023-07-06T21:55:05.272666+0000","last_fullsized":"2023-07-06T21:55:05.272666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:50:51.643352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272816+0000","last_change":"2023-07-06T21:55:04.224761+0000","last_active":"2023-07-06T21:55:05.272816+0000","last_peered":"2023-07-06T21:55:05.272816+0000","last_clean":"2023-07-06T21:55:05.272816+0000","last_became_active":"2023-07-06T21:55:04.223413+0000","last_became_peered":"2023-07-06T21:55:04.223413+0000","last_unstale":"2023-07-06T21:55:05.272816+0000","last_undegraded":"2023-07-06T21:55:05.272816+0000","last_fullsized":"2023-07-06T21:55:05.272816+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:13:21.320036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274227+0000","last_change":"2023-07-06T21:55:03.807462+0000","last_active":"2023-07-06T21:55:05.274227+0000","last_peered":"2023-07-06T21:55:05.274227+0000","last_clean":"2023-07-06T21:55:05.274227+0000","last_became_active":"2023-07-06T21:55:03.807215+0000","last_became_peered":"2023-07-06T21:55:03.807215+0000","last_unstale":"2023-07-06T21:55:05.274227+0000","last_undegraded":"2023-07-06T21:55:05.274227+0000","last_fullsized":"2023-07-06T21:55:05.274227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:27:03.117688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":117,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273426+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:55:05.273426+0000","last_peered":"2023-07-06T21:55:05.273426+0000","last_clean":"2023-07-06T21:55:05.273426+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:55:05.273426+0000","last_undegraded":"2023-07-06T21:55:05.273426+0000","last_fullsized":"2023-07-06T21:55:05.273426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:29:55.230358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202553+0000","last_change":"2023-07-06T21:55:04.232362+0000","last_active":"2023-07-06T21:55:05.202553+0000","last_peered":"2023-07-06T21:55:05.202553+0000","last_clean":"2023-07-06T21:55:05.202553+0000","last_became_active":"2023-07-06T21:55:04.231776+0000","last_became_peered":"2023-07-06T21:55:04.231776+0000","last_unstale":"2023-07-06T21:55:05.202553+0000","last_undegraded":"2023-07-06T21:55:05.202553+0000","last_fullsized":"2023-07-06T21:55:05.202553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:55:16.706601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272997+0000","last_change":"2023-07-06T21:55:03.808380+0000","last_active":"2023-07-06T21:55:05.272997+0000","last_peered":"2023-07-06T21:55:05.272997+0000","last_clean":"2023-07-06T21:55:05.272997+0000","last_became_active":"2023-07-06T21:55:03.808078+0000","last_became_peered":"2023-07-06T21:55:03.808078+0000","last_unstale":"2023-07-06T21:55:05.272997+0000","last_undegraded":"2023-07-06T21:55:05.272997+0000","last_fullsized":"2023-07-06T21:55:05.272997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:19:19.697024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202654+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:55:05.202654+0000","last_peered":"2023-07-06T21:55:05.202654+0000","last_clean":"2023-07-06T21:55:05.202654+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:55:05.202654+0000","last_undegraded":"2023-07-06T21:55:05.202654+0000","last_fullsized":"2023-07-06T21:55:05.202654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:38:24.190196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202552+0000","last_change":"2023-07-06T21:55:04.234940+0000","last_active":"2023-07-06T21:55:05.202552+0000","last_peered":"2023-07-06T21:55:05.202552+0000","last_clean":"2023-07-06T21:55:05.202552+0000","last_became_active":"2023-07-06T21:55:04.234199+0000","last_became_peered":"2023-07-06T21:55:04.234199+0000","last_unstale":"2023-07-06T21:55:05.202552+0000","last_undegraded":"2023-07-06T21:55:05.202552+0000","last_fullsized":"2023-07-06T21:55:05.202552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:11:20.189364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274005+0000","last_change":"2023-07-06T21:55:03.810832+0000","last_active":"2023-07-06T21:55:05.274005+0000","last_peered":"2023-07-06T21:55:05.274005+0000","last_clean":"2023-07-06T21:55:05.274005+0000","last_became_active":"2023-07-06T21:55:03.810525+0000","last_became_peered":"2023-07-06T21:55:03.810525+0000","last_unstale":"2023-07-06T21:55:05.274005+0000","last_undegraded":"2023-07-06T21:55:05.274005+0000","last_fullsized":"2023-07-06T21:55:05.274005+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:19:09.759535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":117,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273814+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:55:05.273814+0000","last_peered":"2023-07-06T21:55:05.273814+0000","last_clean":"2023-07-06T21:55:05.273814+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:55:05.273814+0000","last_undegraded":"2023-07-06T21:55:05.273814+0000","last_fullsized":"2023-07-06T21:55:05.273814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:43:50.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272850+0000","last_change":"2023-07-06T21:55:04.228462+0000","last_active":"2023-07-06T21:55:05.272850+0000","last_peered":"2023-07-06T21:55:05.272850+0000","last_clean":"2023-07-06T21:55:05.272850+0000","last_became_active":"2023-07-06T21:55:04.227151+0000","last_became_peered":"2023-07-06T21:55:04.227151+0000","last_unstale":"2023-07-06T21:55:05.272850+0000","last_undegraded":"2023-07-06T21:55:05.272850+0000","last_fullsized":"2023-07-06T21:55:05.272850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:52:36.037743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273137+0000","last_change":"2023-07-06T21:55:03.811493+0000","last_active":"2023-07-06T21:55:05.273137+0000","last_peered":"2023-07-06T21:55:05.273137+0000","last_clean":"2023-07-06T21:55:05.273137+0000","last_became_active":"2023-07-06T21:55:03.811194+0000","last_became_peered":"2023-07-06T21:55:03.811194+0000","last_unstale":"2023-07-06T21:55:05.273137+0000","last_undegraded":"2023-07-06T21:55:05.273137+0000","last_fullsized":"2023-07-06T21:55:05.273137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:49:36.176146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201438+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:55:05.201438+0000","last_peered":"2023-07-06T21:55:05.201438+0000","last_clean":"2023-07-06T21:55:05.201438+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:55:05.201438+0000","last_undegraded":"2023-07-06T21:55:05.201438+0000","last_fullsized":"2023-07-06T21:55:05.201438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:54:45.732783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575009,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36588,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335252,"statfs":{"total":96636764160,"available":96599298048,"internally_reserved":0,"allocated":1478656,"data_stored":1045283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71599999999999997,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.35199999999999998,"15min":0.30599999999999999},"max":{"1min":0.93999999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71199999999999997,"15min":0.69099999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":0.91300000000000003,"5min":0.98799999999999999,"15min":0.99399999999999999},"last":0.503}]},{"osd":1,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.47799999999999998,"5min":0.39800000000000002,"15min":0.34799999999999998},"max":{"1min":0.91800000000000004,"5min":1.0449999999999999,"15min":1.0649999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86199999999999999,"5min":0.94099999999999995,"15min":0.97899999999999998},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.878,"5min":0.94799999999999995,"15min":0.94999999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73299999999999998,"15min":0.72799999999999998},"min":{"1min":0.52000000000000002,"5min":0.436,"15min":0.42599999999999999},"max":{"1min":0.89200000000000002,"5min":1.008,"15min":1.0529999999999999},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.44700000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0469999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":0.93700000000000006,"5min":0.99399999999999999,"15min":1.006},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80700000000000005,"5min":0.94199999999999995,"15min":0.999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.747,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57999999999999996,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.98499999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":0.874,"5min":0.91100000000000003,"15min":0.99199999999999999},"last":0.626}]},{"osd":6,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70199999999999996,"15min":0.70099999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.40200000000000002},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":1.0309999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65900000000000003,"15min":0.67200000000000004},"min":{"1min":0.51000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95399999999999996,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575009,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":872448,"data_stored":453736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72499999999999998,"15min":0.70499999999999996},"min":{"1min":0.54600000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.0980000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.74299999999999999,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.38300000000000001},"max":{"1min":0.94799999999999995,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73299999999999998,"15min":0.71299999999999997},"min":{"1min":0.56499999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.753,"15min":0.73199999999999998},"min":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.998,"5min":0.998,"15min":1.1180000000000001},"last":0.624}]},{"osd":2,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.71699999999999997},"min":{"1min":0.56499999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.3859999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75700000000000001,"15min":0.73999999999999999},"min":{"1min":0.63500000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76500000000000001,"15min":0.748},"min":{"1min":0.57999999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.204},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.753,"15min":0.73899999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.498},"max":{"1min":0.96199999999999997,"5min":0.98099999999999998,"15min":1.4339999999999999},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.59199999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80200000000000005,"5min":0.84999999999999998,"15min":1.1850000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.39300000000000002},"max":{"1min":0.84199999999999997,"5min":0.91900000000000004,"15min":1.321},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":1.0089999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.73599999999999999},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.89200000000000002,"5min":1.0189999999999999,"15min":1.631},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.41699999999999998},"max":{"1min":0.878,"5min":0.92400000000000004,"15min":1.3600000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67200000000000004,"15min":0.69999999999999996},"min":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.6930000000000001},"last":0.749}]}]},{"osd":5,"up_from":13,"seq":55834575008,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":884736,"data_stored":455407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70599999999999996,"15min":0.69099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.99299999999999999},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.71499999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.39200000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.131},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.72499999999999998},"min":{"1min":0.56899999999999995,"5min":0.54400000000000004,"15min":0.41099999999999998},"max":{"1min":0.92400000000000004,"5min":0.94399999999999995,"15min":1.0329999999999999},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75800000000000001,"15min":0.73899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75700000000000001,"15min":0.73499999999999999},"min":{"1min":0.51100000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98299999999999998,"5min":0.98599999999999999,"15min":1.0369999999999999},"last":0.878}]},{"osd":3,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48999999999999999},"max":{"1min":0.93300000000000005,"5min":0.94399999999999995,"15min":0.96099999999999997},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77400000000000002,"15min":0.76300000000000001},"min":{"1min":0.64100000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.58799999999999997},"min":{"1min":0.42299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.747,"5min":0.86599999999999999,"15min":1},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59199999999999997,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91800000000000004,"5min":0.93400000000000005,"15min":1.02},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59299999999999997,"15min":0.64300000000000002},"min":{"1min":0.48999999999999999,"5min":0.44700000000000001,"15min":0.44600000000000001},"max":{"1min":0.86799999999999999,"5min":0.91400000000000003,"15min":1.052},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.65100000000000002},"min":{"1min":0.47499999999999998,"5min":0.46300000000000002,"15min":0.41799999999999998},"max":{"1min":0.82799999999999996,"5min":0.86399999999999999,"15min":0.96699999999999997},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.69699999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.45200000000000001},"max":{"1min":0.92200000000000004,"5min":0.96299999999999997,"15min":1.0529999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.57599999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575007,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":888832,"data_stored":456319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.60099999999999998,"5min":0.47299999999999998,"15min":0.39400000000000002},"max":{"1min":0.93899999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.52600000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.86499999999999999,"5min":1.0489999999999999,"15min":1.071},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.59199999999999997,"5min":0.51900000000000002,"15min":0.44},"max":{"1min":0.878,"5min":0.89200000000000002,"15min":1.361},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71199999999999997,"15min":0.72299999999999998},"min":{"1min":0.57399999999999995,"5min":0.47899999999999998,"15min":0.40300000000000002},"max":{"1min":0.90200000000000002,"5min":1.01,"15min":1.2829999999999999},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.73399999999999999,"15min":0.72299999999999998},"min":{"1min":0.64300000000000002,"5min":0.50800000000000001,"15min":0.40899999999999997},"max":{"1min":0.84699999999999998,"5min":1.1299999999999999,"15min":1.2170000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.752,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.505,"15min":0.38600000000000001},"max":{"1min":0.91800000000000004,"5min":0.98599999999999999,"15min":1.649},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72899999999999998,"15min":0.73999999999999999},"min":{"1min":0.61099999999999999,"5min":0.53800000000000003,"15min":0.45800000000000002},"max":{"1min":0.85199999999999998,"5min":0.93700000000000006,"15min":1.4219999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.60699999999999998,"5min":0.57199999999999995,"15min":0.49099999999999999},"max":{"1min":0.89100000000000001,"5min":0.97399999999999998,"15min":1.3109999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.308},"max":{"1min":0.80400000000000005,"5min":0.93700000000000006,"15min":1.246},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.63500000000000001},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.32500000000000001},"max":{"1min":0.88800000000000001,"5min":0.97299999999999998,"15min":1.8049999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.63100000000000001},"min":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.36299999999999999},"max":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":1.478},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63,"15min":0.68600000000000005},"min":{"1min":0.48299999999999998,"5min":0.443,"15min":0.34799999999999998},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.7250000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63900000000000001,"15min":0.68400000000000005},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93200000000000005,"5min":1.028,"15min":1.534},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64700000000000002,"15min":0.69399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90600000000000003,"5min":1.01,"15min":1.585},"last":0.55400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575008,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":884736,"data_stored":454811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26900000000000002},"max":{"1min":0.85499999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.33400000000000002},"max":{"1min":0.94899999999999995,"5min":0.99099999999999999,"15min":1.7190000000000001},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49199999999999999,"15min":0.47499999999999998},"min":{"1min":0.32400000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.88,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.309},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.33500000000000002,"15min":0.32700000000000001},"max":{"1min":0.73399999999999999,"5min":1.109,"15min":1.9590000000000001},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.53000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33000000000000002},"max":{"1min":0.621,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.34799999999999998},"max":{"1min":0.72099999999999997,"5min":1.24,"15min":2.012},"last":0.377}]},{"osd":4,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":0.95999999999999996,"5min":1.1339999999999999,"15min":1.855},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80000000000000004,"15min":0.77600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46000000000000002,"15min":0.432},"max":{"1min":1.0329999999999999,"5min":1.097,"15min":1.524},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83399999999999996,"15min":0.79400000000000004},"min":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.42399999999999999},"max":{"1min":0.95599999999999996,"5min":1.236,"15min":1.3720000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80400000000000005,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.45400000000000001,"15min":0.44800000000000001},"max":{"1min":1.0169999999999999,"5min":1.3999999999999999,"15min":1.883},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.78500000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40000000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.75},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.79200000000000004},"min":{"1min":0.56399999999999995,"5min":0.53600000000000003,"15min":0.47899999999999998},"max":{"1min":1.0640000000000001,"5min":1.101,"15min":1.4610000000000001},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82999999999999996,"15min":0.80100000000000005},"min":{"1min":0.57999999999999996,"5min":0.51300000000000001,"15min":0.497},"max":{"1min":1.0589999999999999,"5min":1.456,"15min":1.456},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52900000000000003},"max":{"1min":1.0649999999999999,"5min":1.3480000000000001,"15min":1.9830000000000001},"last":0.72099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575008,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":884736,"data_stored":454811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.44900000000000001},"min":{"1min":0.317,"5min":0.29099999999999998,"15min":0.28100000000000003},"max":{"1min":0.66300000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.315},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.78300000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.504},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.33700000000000002},"max":{"1min":0.63700000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.443,"5min":0.38400000000000001,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":0.76200000000000001,"15min":0.76500000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.56799999999999995},"min":{"1min":0.48999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77400000000000002,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.64500000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1040000000000001,"5min":1.21,"15min":1.2430000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81899999999999995,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.214,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80100000000000005,"15min":0.78900000000000003},"min":{"1min":0.68999999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0549999999999999,"5min":1.212,"15min":1.246},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83299999999999996,"15min":0.81899999999999995},"min":{"1min":0.70799999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1930000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.002}]},{"osd":6,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.83999999999999997,"15min":0.80100000000000005},"min":{"1min":0.54900000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.246,"5min":1.27,"15min":1.27},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.68600000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.105,"5min":1.2410000000000001,"15min":1.3320000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.83799999999999997,"15min":0.82299999999999995},"min":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.54300000000000004},"max":{"1min":1.1439999999999999,"5min":1.2789999999999999,"15min":1.3520000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.85399999999999998,"15min":0.83299999999999996},"min":{"1min":0.67100000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.218,"5min":1.268,"15min":1.369},"last":0.70299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575009,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36004,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335836,"statfs":{"total":96636764160,"available":96599896064,"internally_reserved":0,"allocated":880640,"data_stored":454845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.35799999999999998,"5min":0.28999999999999998,"15min":0.27500000000000002},"max":{"1min":0.63700000000000001,"5min":0.66100000000000003,"15min":0.73699999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.34399999999999997,"5min":0.32200000000000001,"15min":0.29399999999999998},"max":{"1min":0.64500000000000002,"5min":0.78900000000000003,"15min":0.92200000000000004},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.34300000000000003,"5min":0.33000000000000002,"15min":0.311},"max":{"1min":0.623,"5min":0.73599999999999999,"15min":0.80200000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73299999999999998,"5min":0.87,"15min":0.87},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.46500000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.70699999999999996,"5min":0.84599999999999997,"15min":0.96299999999999997},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72799999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78900000000000003,"15min":0.77200000000000002},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.38500000000000001},"max":{"1min":1.143,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.87},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79200000000000004,"15min":0.78100000000000003},"min":{"1min":0.65000000000000002,"5min":0.497,"15min":0.44},"max":{"1min":1.0049999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79600000000000004,"15min":0.77700000000000002},"min":{"1min":0.54800000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1890000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.47999999999999998,"15min":0.439},"max":{"1min":1.028,"5min":1.357,"15min":1.357},"last":0.81299999999999994}]},{"osd":6,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.63300000000000001,"5min":0.54300000000000004,"15min":0.53800000000000003},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81200000000000006,"15min":0.80900000000000005},"min":{"1min":0.60999999999999999,"5min":0.51800000000000002,"15min":0.51500000000000001},"max":{"1min":0.97199999999999998,"5min":1.456,"15min":1.456},"last":0.92000000000000004}]},{"osd":7,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.53800000000000003},"max":{"1min":1.0820000000000001,"5min":1.417,"15min":1.417},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.59499999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3280000000000001,"5min":1.397,"15min":1.397},"last":0.94399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575008,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1482752,"data_stored":1046250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.247},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.1459999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.33600000000000002,"15min":0.28599999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":1.5189999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.30099999999999999},"max":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":1.228},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.34000000000000002},"max":{"1min":0.72299999999999998,"5min":0.85799999999999998,"15min":1.454},"last":0.498}]},{"osd":3,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.51100000000000001},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.308},"max":{"1min":0.71799999999999997,"5min":0.78900000000000003,"15min":1.7969999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.36799999999999999},"max":{"1min":0.83099999999999996,"5min":0.874,"15min":1.7190000000000001},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81699999999999995,"15min":0.79800000000000004},"min":{"1min":0.499,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.111,"5min":1.242,"15min":1.911},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.53100000000000003,"15min":0.35799999999999998},"max":{"1min":1.1020000000000001,"5min":1.2729999999999999,"15min":1.3620000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82599999999999996,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.38400000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.3700000000000001},"last":0.745},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81499999999999995,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.55200000000000005,"15min":0.44400000000000001},"max":{"1min":1.0329999999999999,"5min":1.1759999999999999,"15min":1.758},"last":0.754}]},{"osd":6,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.52400000000000002},"max":{"1min":1.0780000000000001,"5min":1.2050000000000001,"15min":1.8220000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.47199999999999998},"max":{"1min":1.071,"5min":1.1379999999999999,"15min":2.266},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.63500000000000001,"5min":0.55900000000000005,"15min":0.53800000000000003},"max":{"1min":1.135,"5min":1.147,"15min":2.323},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.84699999999999998,"15min":0.81899999999999995},"min":{"1min":0.65500000000000003,"5min":0.60599999999999998,"15min":0.435},"max":{"1min":1.107,"5min":1.2210000000000001,"15min":1.2829999999999999},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:55:09.071 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-06T21:55:09.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.250+0000 7faf89700640 1 Processor -- start 2023-07-06T21:55:09.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.250+0000 7faf89700640 1 -- start start 2023-07-06T21:55:09.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.250+0000 7faf89700640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faf8406f520 0x7faf840cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:09.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.250+0000 7faf89700640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8406fae0 con 0x7faf84158400 2023-07-06T21:55:09.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.250+0000 7faf89700640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8406fdc0 con 0x7faf841587d0 2023-07-06T21:55:09.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.250+0000 7faf89700640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf840700a0 con 0x7faf8406f520 2023-07-06T21:55:09.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.250+0000 7faf82ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faf84158400 0x7faf840c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54522/0 (socket says 172.21.15.55:54522) 2023-07-06T21:55:09.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.250+0000 7faf82ffd640 1 -- 172.21.15.55:0/3374834926 learned_addr learned my addr 172.21.15.55:0/3374834926 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:55:09.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.250+0000 7faf837fe640 1 --2- 172.21.15.55:0/3374834926 >> v2:172.21.15.55:3300/0 conn(0x7faf8406f520 0x7faf840cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:09.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.254+0000 7faf837fe640 1 -- 172.21.15.55:0/3374834926 >> v1:172.21.15.138:6789/0 conn(0x7faf841587d0 legacy=0x7faf84070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:09.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.254+0000 7faf837fe640 1 -- 172.21.15.55:0/3374834926 >> v1:172.21.15.55:6789/0 conn(0x7faf84158400 legacy=0x7faf840c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:09.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.254+0000 7faf837fe640 1 -- 172.21.15.55:0/3374834926 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf84070380 con 0x7faf8406f520 2023-07-06T21:55:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.254+0000 7faf837fe640 1 --2- 172.21.15.55:0/3374834926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf8406f520 0x7faf840cbaa0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009d90 tx=0x7faf7c01eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc233ab9693fbae3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.254+0000 7faf827fc640 1 -- 172.21.15.55:0/3374834926 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0a7b10 con 0x7faf8406f520 2023-07-06T21:55:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.254+0000 7faf827fc640 1 -- 172.21.15.55:0/3374834926 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c0a7c70 con 0x7faf8406f520 2023-07-06T21:55:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.254+0000 7faf827fc640 1 -- 172.21.15.55:0/3374834926 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0af440 con 0x7faf8406f520 2023-07-06T21:55:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 -- 172.21.15.55:0/3374834926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf8406f520 msgr2=0x7faf840cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:09.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 --2- 172.21.15.55:0/3374834926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf8406f520 0x7faf840cbaa0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009d90 tx=0x7faf7c01eb30 comp rx=0 tx=0).stop 2023-07-06T21:55:09.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 -- 172.21.15.55:0/3374834926 shutdown_connections 2023-07-06T21:55:09.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 --2- 172.21.15.55:0/3374834926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf8406f520 0x7faf840cbaa0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 -- 172.21.15.55:0/3374834926 >> 172.21.15.55:0/3374834926 conn(0x7faf840cded0 msgr2=0x7faf840ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 -- 172.21.15.55:0/3374834926 shutdown_connections 2023-07-06T21:55:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 -- 172.21.15.55:0/3374834926 wait complete. 2023-07-06T21:55:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 Processor -- start 2023-07-06T21:55:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 -- start start 2023-07-06T21:55:09.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf8406f520 0x7faf8414a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:09.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf84158400 0x7faf840cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:09.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf841587d0 0x7faf840cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:09.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf841517a0 con 0x7faf841587d0 2023-07-06T21:55:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840c4fa0 con 0x7faf8406f520 2023-07-06T21:55:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf89700640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf840c51f0 con 0x7faf84158400 2023-07-06T21:55:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf837fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf841587d0 0x7faf840cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf837fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf841587d0 0x7faf840cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42760/0 (socket says 172.21.15.55:42760) 2023-07-06T21:55:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf837fe640 1 -- 172.21.15.55:0/175340293 learned_addr learned my addr 172.21.15.55:0/175340293 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf7bfff640 1 --2- 172.21.15.55:0/175340293 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf84158400 0x7faf840cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf82ffd640 1 --2- 172.21.15.55:0/175340293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf8406f520 0x7faf8414a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf837fe640 1 -- 172.21.15.55:0/175340293 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf84158400 msgr2=0x7faf840cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf837fe640 1 --2- 172.21.15.55:0/175340293 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf84158400 0x7faf840cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf837fe640 1 -- 172.21.15.55:0/175340293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf8406f520 msgr2=0x7faf8414a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf837fe640 1 --2- 172.21.15.55:0/175340293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf8406f520 0x7faf8414a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.258+0000 7faf837fe640 1 -- 172.21.15.55:0/175340293 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c009a70 con 0x7faf841587d0 2023-07-06T21:55:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.262+0000 7faf837fe640 1 --2- 172.21.15.55:0/175340293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf841587d0 0x7faf840cb4e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7faf7c01c760 tx=0x7faf7c01b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.262+0000 7faf7b7fe640 1 -- 172.21.15.55:0/175340293 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0a7b10 con 0x7faf841587d0 2023-07-06T21:55:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.262+0000 7faf7b7fe640 1 -- 172.21.15.55:0/175340293 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c0afc40 con 0x7faf841587d0 2023-07-06T21:55:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.262+0000 7faf89700640 1 -- 172.21.15.55:0/175340293 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf840c54d0 con 0x7faf841587d0 2023-07-06T21:55:09.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.262+0000 7faf7b7fe640 1 -- 172.21.15.55:0/175340293 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0b8420 con 0x7faf841587d0 2023-07-06T21:55:09.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.262+0000 7faf89700640 1 -- 172.21.15.55:0/175340293 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf840c5a90 con 0x7faf841587d0 2023-07-06T21:55:09.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.262+0000 7faf89700640 1 -- 172.21.15.55:0/175340293 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8406c580 con 0x7faf841587d0 2023-07-06T21:55:09.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.262+0000 7faf7b7fe640 1 -- 172.21.15.55:0/175340293 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faf7c0b6070 con 0x7faf841587d0 2023-07-06T21:55:09.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.266+0000 7faf7b7fe640 1 --2- 172.21.15.55:0/175340293 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7faf640663a0 0x7faf64068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:09.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.266+0000 7faf7b7fe640 1 -- 172.21.15.55:0/175340293 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faf7c11ed40 con 0x7faf841587d0 2023-07-06T21:55:09.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.266+0000 7faf82ffd640 1 --2- 172.21.15.55:0/175340293 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7faf640663a0 0x7faf64068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:09.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.266+0000 7faf82ffd640 1 --2- 172.21.15.55:0/175340293 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7faf640663a0 0x7faf64068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf74005890 tx=0x7faf74009040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.270+0000 7faf7b7fe640 1 -- 172.21.15.55:0/175340293 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf7c0ec1d0 con 0x7faf841587d0 2023-07-06T21:55:09.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.482+0000 7faf89700640 1 -- 172.21.15.55:0/175340293 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7faf840c5c80 con 0x7faf841587d0 2023-07-06T21:55:09.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.482+0000 7faf7b7fe640 1 -- 172.21.15.55:0/175340293 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3209 (secure 0 0 0) 0x7faf7c0ef7f0 con 0x7faf841587d0 2023-07-06T21:55:09.485 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:09.485 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":804,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":73,"num_osds":8,"num_up_osds":8,"osd_up_since":1688679717,"num_in_osds":8,"osd_in_since":1688679707,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":279379968,"bytes_avail":772814733312,"bytes_total":773094113280,"write_bytes_sec":2416,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":24,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":6357}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-07-06T21:54:50.708409+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-06T21:55:09.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.486+0000 7faf89700640 1 -- 172.21.15.55:0/175340293 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7faf640663a0 msgr2=0x7faf64068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:09.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.486+0000 7faf89700640 1 --2- 172.21.15.55:0/175340293 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7faf640663a0 0x7faf64068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf74005890 tx=0x7faf74009040 comp rx=0 tx=0).stop 2023-07-06T21:55:09.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.486+0000 7faf89700640 1 -- 172.21.15.55:0/175340293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf841587d0 msgr2=0x7faf840cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:09.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.486+0000 7faf89700640 1 --2- 172.21.15.55:0/175340293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf841587d0 0x7faf840cb4e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7faf7c01c760 tx=0x7faf7c01b8d0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.486+0000 7faf89700640 1 -- 172.21.15.55:0/175340293 shutdown_connections 2023-07-06T21:55:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.486+0000 7faf89700640 1 --2- 172.21.15.55:0/175340293 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7faf640663a0 0x7faf64068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.486+0000 7faf89700640 1 --2- 172.21.15.55:0/175340293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf841587d0 0x7faf840cb4e0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.486+0000 7faf89700640 1 --2- 172.21.15.55:0/175340293 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf84158400 0x7faf840cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.486+0000 7faf89700640 1 --2- 172.21.15.55:0/175340293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf8406f520 0x7faf8414a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.486+0000 7faf89700640 1 -- 172.21.15.55:0/175340293 >> 172.21.15.55:0/175340293 conn(0x7faf840cded0 msgr2=0x7faf84156410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.486+0000 7faf89700640 1 -- 172.21.15.55:0/175340293 shutdown_connections 2023-07-06T21:55:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.486+0000 7faf89700640 1 -- 172.21.15.55:0/175340293 wait complete. 2023-07-06T21:55:09.505 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-06T21:55:09.506 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:55:09.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.646+0000 7f38d9fa3640 1 Processor -- start 2023-07-06T21:55:09.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.646+0000 7f38d9fa3640 1 -- start start 2023-07-06T21:55:09.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d9fa3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38d4158400 0x7f38d40c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:09.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d9fa3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38d40c9680 0x7f38d4070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:09.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d9fa3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f38d40710c0 0x7f38d40cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:09.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d9fa3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d406fae0 con 0x7f38d4158400 2023-07-06T21:55:09.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d9fa3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d406fdc0 con 0x7f38d40710c0 2023-07-06T21:55:09.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d9fa3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40700a0 con 0x7f38d40c9680 2023-07-06T21:55:09.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38d4158400 0x7f38d40c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:09.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38d4158400 0x7f38d40c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42764/0 (socket says 172.21.15.55:42764) 2023-07-06T21:55:09.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d37fe640 1 -- 172.21.15.55:0/1106943378 learned_addr learned my addr 172.21.15.55:0/1106943378 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:09.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d2ffd640 1 --2- 172.21.15.55:0/1106943378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38d40c9680 0x7f38d4070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:09.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d3fff640 1 --2- 172.21.15.55:0/1106943378 >> v2:172.21.15.138:3300/0 conn(0x7f38d40710c0 0x7f38d40cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:09.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d37fe640 1 -- 172.21.15.55:0/1106943378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38d40c9680 msgr2=0x7f38d4070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:09.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d37fe640 1 --2- 172.21.15.55:0/1106943378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38d40c9680 0x7f38d4070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d37fe640 1 -- 172.21.15.55:0/1106943378 >> v2:172.21.15.138:3300/0 conn(0x7f38d40710c0 msgr2=0x7f38d40cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:09.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d37fe640 1 --2- 172.21.15.55:0/1106943378 >> v2:172.21.15.138:3300/0 conn(0x7f38d40710c0 0x7f38d40cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d37fe640 1 -- 172.21.15.55:0/1106943378 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d4070380 con 0x7f38d4158400 2023-07-06T21:55:09.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.650+0000 7f38d2ffd640 1 --2- 172.21.15.55:0/1106943378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38d40c9680 0x7f38d4070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:55:09.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d37fe640 1 --2- 172.21.15.55:0/1106943378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d4158400 0x7f38d40c9140 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f38d40ad960 tx=0x7f38c401e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada8b9a009c54792 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:09.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d27fc640 1 -- 172.21.15.55:0/1106943378 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c40a8690 con 0x7f38d4158400 2023-07-06T21:55:09.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d27fc640 1 -- 172.21.15.55:0/1106943378 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c40a87f0 con 0x7f38d4158400 2023-07-06T21:55:09.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d27fc640 1 -- 172.21.15.55:0/1106943378 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c40a8b80 con 0x7f38d4158400 2023-07-06T21:55:09.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d9fa3640 1 -- 172.21.15.55:0/1106943378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d4158400 msgr2=0x7f38d40c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:09.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d9fa3640 1 --2- 172.21.15.55:0/1106943378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d4158400 0x7f38d40c9140 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f38d40ad960 tx=0x7f38c401e6e0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d9fa3640 1 -- 172.21.15.55:0/1106943378 shutdown_connections 2023-07-06T21:55:09.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d9fa3640 1 --2- 172.21.15.55:0/1106943378 >> v2:172.21.15.138:3300/0 conn(0x7f38d40710c0 0x7f38d40cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d9fa3640 1 --2- 172.21.15.55:0/1106943378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38d40c9680 0x7f38d4070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d9fa3640 1 --2- 172.21.15.55:0/1106943378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d4158400 0x7f38d40c9140 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d9fa3640 1 -- 172.21.15.55:0/1106943378 >> 172.21.15.55:0/1106943378 conn(0x7f38d40cded0 msgr2=0x7f38d40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:09.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d9fa3640 1 -- 172.21.15.55:0/1106943378 shutdown_connections 2023-07-06T21:55:09.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d9fa3640 1 -- 172.21.15.55:0/1106943378 wait complete. 2023-07-06T21:55:09.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d9fa3640 1 Processor -- start 2023-07-06T21:55:09.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.654+0000 7f38d9fa3640 1 -- start start 2023-07-06T21:55:09.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d9fa3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38d40710c0 0x7f38d40c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:09.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d9fa3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d40c9680 0x7f38d41f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:09.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d9fa3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38d4158400 0x7f38d41f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:09.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d9fa3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41f5ef0 con 0x7f38d40c9680 2023-07-06T21:55:09.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d9fa3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d4161cf0 con 0x7f38d4158400 2023-07-06T21:55:09.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d9fa3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d4160c50 con 0x7f38d40710c0 2023-07-06T21:55:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d40c9680 0x7f38d41f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d40c9680 0x7f38d41f85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42774/0 (socket says 172.21.15.55:42774) 2023-07-06T21:55:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d2ffd640 1 -- 172.21.15.55:0/540557117 learned_addr learned my addr 172.21.15.55:0/540557117 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d37fe640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38d40710c0 0x7f38d40c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:09.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d3fff640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38d4158400 0x7f38d41f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:09.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d2ffd640 1 -- 172.21.15.55:0/540557117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38d40710c0 msgr2=0x7f38d40c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:09.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d2ffd640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38d40710c0 0x7f38d40c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d2ffd640 1 -- 172.21.15.55:0/540557117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38d4158400 msgr2=0x7f38d41f8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:09.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d2ffd640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38d4158400 0x7f38d41f8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d2ffd640 1 -- 172.21.15.55:0/540557117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c40094d0 con 0x7f38d40c9680 2023-07-06T21:55:09.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d37fe640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38d40710c0 0x7f38d40c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:55:09.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d2ffd640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d40c9680 0x7f38d41f85e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f38c800e810 tx=0x7f38c800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:09.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38bbfff640 1 -- 172.21.15.55:0/540557117 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c800c8d0 con 0x7f38d40c9680 2023-07-06T21:55:09.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38bbfff640 1 -- 172.21.15.55:0/540557117 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c800ca30 con 0x7f38d40c9680 2023-07-06T21:55:09.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38bbfff640 1 -- 172.21.15.55:0/540557117 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c800cdc0 con 0x7f38d40c9680 2023-07-06T21:55:09.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d9fa3640 1 -- 172.21.15.55:0/540557117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d4160f30 con 0x7f38d40c9680 2023-07-06T21:55:09.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d9fa3640 1 -- 172.21.15.55:0/540557117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d41614f0 con 0x7f38d40c9680 2023-07-06T21:55:09.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.658+0000 7f38d9fa3640 1 -- 172.21.15.55:0/540557117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d406c580 con 0x7f38d40c9680 2023-07-06T21:55:09.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.662+0000 7f38bbfff640 1 -- 172.21.15.55:0/540557117 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f38c8013410 con 0x7f38d40c9680 2023-07-06T21:55:09.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.662+0000 7f38bbfff640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f38c00663a0 0x7f38c0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:09.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.662+0000 7f38bbfff640 1 -- 172.21.15.55:0/540557117 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f38c8083fb0 con 0x7f38d40c9680 2023-07-06T21:55:09.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.662+0000 7f38d37fe640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f38c00663a0 0x7f38c0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:09.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.662+0000 7f38d37fe640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f38c00663a0 0x7f38c0068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f38c40b0000 tx=0x7f38c40a9000 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:09.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.666+0000 7f38bbfff640 1 -- 172.21.15.55:0/540557117 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38c8051030 con 0x7f38d40c9680 2023-07-06T21:55:09.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.818+0000 7f38d9fa3640 1 -- 172.21.15.55:0/540557117 --> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38d40cc3f0 con 0x7f38c00663a0 2023-07-06T21:55:09.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.826+0000 7f38bbfff640 1 -- 172.21.15.55:0/540557117 <== mgr.6102 v2:172.21.15.55:6832/3843972996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311632 (secure 0 0 0) 0x7f38c400e1d0 con 0x7f38c00663a0 2023-07-06T21:55:09.830 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:09.831 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:55:09.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.830+0000 7f38d9fa3640 1 -- 172.21.15.55:0/540557117 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f38c00663a0 msgr2=0x7f38c0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:09.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.830+0000 7f38d9fa3640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f38c00663a0 0x7f38c0068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f38c40b0000 tx=0x7f38c40a9000 comp rx=0 tx=0).stop 2023-07-06T21:55:09.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.830+0000 7f38d9fa3640 1 -- 172.21.15.55:0/540557117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d40c9680 msgr2=0x7f38d41f85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.830+0000 7f38d9fa3640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d40c9680 0x7f38d41f85e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f38c800e810 tx=0x7f38c800ecd0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.830+0000 7f38d9fa3640 1 -- 172.21.15.55:0/540557117 shutdown_connections 2023-07-06T21:55:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.830+0000 7f38d9fa3640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38d4158400 0x7f38d41f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.830+0000 7f38d9fa3640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f38c00663a0 0x7f38c0068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.830+0000 7f38d9fa3640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d40c9680 0x7f38d41f85e0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.830+0000 7f38d9fa3640 1 --2- 172.21.15.55:0/540557117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38d40710c0 0x7f38d40c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.830+0000 7f38d9fa3640 1 -- 172.21.15.55:0/540557117 >> 172.21.15.55:0/540557117 conn(0x7f38d40cded0 msgr2=0x7f38d40ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:09.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.830+0000 7f38d9fa3640 1 -- 172.21.15.55:0/540557117 shutdown_connections 2023-07-06T21:55:09.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:09.830+0000 7f38d9fa3640 1 -- 172.21.15.55:0/540557117 wait complete. 2023-07-06T21:55:09.850 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-06T21:55:08.711747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":243,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272832,"kb_used_data":8064,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754701888,"statfs":{"total":773094113280,"available":772814733312,"internally_reserved":0,"allocated":8257536,"data_stored":4821462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.931911"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204184+0000","last_change":"2023-07-06T21:55:04.220798+0000","last_active":"2023-07-06T21:55:05.204184+0000","last_peered":"2023-07-06T21:55:05.204184+0000","last_clean":"2023-07-06T21:55:05.204184+0000","last_became_active":"2023-07-06T21:55:04.220460+0000","last_became_peered":"2023-07-06T21:55:04.220460+0000","last_unstale":"2023-07-06T21:55:05.204184+0000","last_undegraded":"2023-07-06T21:55:05.204184+0000","last_fullsized":"2023-07-06T21:55:05.204184+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:28:57.801202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272938+0000","last_change":"2023-07-06T21:55:04.223711+0000","last_active":"2023-07-06T21:55:05.272938+0000","last_peered":"2023-07-06T21:55:05.272938+0000","last_clean":"2023-07-06T21:55:05.272938+0000","last_became_active":"2023-07-06T21:55:04.223401+0000","last_became_peered":"2023-07-06T21:55:04.223401+0000","last_unstale":"2023-07-06T21:55:05.272938+0000","last_undegraded":"2023-07-06T21:55:05.272938+0000","last_fullsized":"2023-07-06T21:55:05.272938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:19:09.613634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202336+0000","last_change":"2023-07-06T21:55:04.234546+0000","last_active":"2023-07-06T21:55:05.202336+0000","last_peered":"2023-07-06T21:55:05.202336+0000","last_clean":"2023-07-06T21:55:05.202336+0000","last_became_active":"2023-07-06T21:55:04.233591+0000","last_became_peered":"2023-07-06T21:55:04.233591+0000","last_unstale":"2023-07-06T21:55:05.202336+0000","last_undegraded":"2023-07-06T21:55:05.202336+0000","last_fullsized":"2023-07-06T21:55:05.202336+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:50:07.029554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273054+0000","last_change":"2023-07-06T21:55:04.223345+0000","last_active":"2023-07-06T21:55:05.273054+0000","last_peered":"2023-07-06T21:55:05.273054+0000","last_clean":"2023-07-06T21:55:05.273054+0000","last_became_active":"2023-07-06T21:55:04.223026+0000","last_became_peered":"2023-07-06T21:55:04.223026+0000","last_unstale":"2023-07-06T21:55:05.273054+0000","last_undegraded":"2023-07-06T21:55:05.273054+0000","last_fullsized":"2023-07-06T21:55:05.273054+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:29:12.189483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.203950+0000","last_change":"2023-07-06T21:55:04.214162+0000","last_active":"2023-07-06T21:55:05.203950+0000","last_peered":"2023-07-06T21:55:05.203950+0000","last_clean":"2023-07-06T21:55:05.203950+0000","last_became_active":"2023-07-06T21:55:04.213893+0000","last_became_peered":"2023-07-06T21:55:04.213893+0000","last_unstale":"2023-07-06T21:55:05.203950+0000","last_undegraded":"2023-07-06T21:55:05.203950+0000","last_fullsized":"2023-07-06T21:55:05.203950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:13:17.606501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273735+0000","last_change":"2023-07-06T21:55:04.230365+0000","last_active":"2023-07-06T21:55:05.273735+0000","last_peered":"2023-07-06T21:55:05.273735+0000","last_clean":"2023-07-06T21:55:05.273735+0000","last_became_active":"2023-07-06T21:55:04.227667+0000","last_became_peered":"2023-07-06T21:55:04.227667+0000","last_unstale":"2023-07-06T21:55:05.273735+0000","last_undegraded":"2023-07-06T21:55:05.273735+0000","last_fullsized":"2023-07-06T21:55:05.273735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:41:12.845036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272846+0000","last_change":"2023-07-06T21:55:04.216761+0000","last_active":"2023-07-06T21:55:05.272846+0000","last_peered":"2023-07-06T21:55:05.272846+0000","last_clean":"2023-07-06T21:55:05.272846+0000","last_became_active":"2023-07-06T21:55:04.216484+0000","last_became_peered":"2023-07-06T21:55:04.216484+0000","last_unstale":"2023-07-06T21:55:05.272846+0000","last_undegraded":"2023-07-06T21:55:05.272846+0000","last_fullsized":"2023-07-06T21:55:05.272846+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:54:17.807393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272298+0000","last_change":"2023-07-06T21:55:04.224324+0000","last_active":"2023-07-06T21:55:05.272298+0000","last_peered":"2023-07-06T21:55:05.272298+0000","last_clean":"2023-07-06T21:55:05.272298+0000","last_became_active":"2023-07-06T21:55:04.224033+0000","last_became_peered":"2023-07-06T21:55:04.224033+0000","last_unstale":"2023-07-06T21:55:05.272298+0000","last_undegraded":"2023-07-06T21:55:05.272298+0000","last_fullsized":"2023-07-06T21:55:05.272298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:21:49.400060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272879+0000","last_change":"2023-07-06T21:55:04.230849+0000","last_active":"2023-07-06T21:55:05.272879+0000","last_peered":"2023-07-06T21:55:05.272879+0000","last_clean":"2023-07-06T21:55:05.272879+0000","last_became_active":"2023-07-06T21:55:04.230567+0000","last_became_peered":"2023-07-06T21:55:04.230567+0000","last_unstale":"2023-07-06T21:55:05.272879+0000","last_undegraded":"2023-07-06T21:55:05.272879+0000","last_fullsized":"2023-07-06T21:55:05.272879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:46:26.481303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273744+0000","last_change":"2023-07-06T21:55:04.218779+0000","last_active":"2023-07-06T21:55:05.273744+0000","last_peered":"2023-07-06T21:55:05.273744+0000","last_clean":"2023-07-06T21:55:05.273744+0000","last_became_active":"2023-07-06T21:55:04.218481+0000","last_became_peered":"2023-07-06T21:55:04.218481+0000","last_unstale":"2023-07-06T21:55:05.273744+0000","last_undegraded":"2023-07-06T21:55:05.273744+0000","last_fullsized":"2023-07-06T21:55:05.273744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:45:00.915257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272673+0000","last_change":"2023-07-06T21:55:04.223194+0000","last_active":"2023-07-06T21:55:05.272673+0000","last_peered":"2023-07-06T21:55:05.272673+0000","last_clean":"2023-07-06T21:55:05.272673+0000","last_became_active":"2023-07-06T21:55:04.220410+0000","last_became_peered":"2023-07-06T21:55:04.220410+0000","last_unstale":"2023-07-06T21:55:05.272673+0000","last_undegraded":"2023-07-06T21:55:05.272673+0000","last_fullsized":"2023-07-06T21:55:05.272673+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:41:35.576504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273086+0000","last_change":"2023-07-06T21:55:04.232101+0000","last_active":"2023-07-06T21:55:05.273086+0000","last_peered":"2023-07-06T21:55:05.273086+0000","last_clean":"2023-07-06T21:55:05.273086+0000","last_became_active":"2023-07-06T21:55:04.231724+0000","last_became_peered":"2023-07-06T21:55:04.231724+0000","last_unstale":"2023-07-06T21:55:05.273086+0000","last_undegraded":"2023-07-06T21:55:05.273086+0000","last_fullsized":"2023-07-06T21:55:05.273086+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:45:35.836056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201204+0000","last_change":"2023-07-06T21:55:04.225624+0000","last_active":"2023-07-06T21:55:05.201204+0000","last_peered":"2023-07-06T21:55:05.201204+0000","last_clean":"2023-07-06T21:55:05.201204+0000","last_became_active":"2023-07-06T21:55:04.225297+0000","last_became_peered":"2023-07-06T21:55:04.225297+0000","last_unstale":"2023-07-06T21:55:05.201204+0000","last_undegraded":"2023-07-06T21:55:05.201204+0000","last_fullsized":"2023-07-06T21:55:05.201204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:40:51.418030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272225+0000","last_change":"2023-07-06T21:55:04.217483+0000","last_active":"2023-07-06T21:55:05.272225+0000","last_peered":"2023-07-06T21:55:05.272225+0000","last_clean":"2023-07-06T21:55:05.272225+0000","last_became_active":"2023-07-06T21:55:04.217080+0000","last_became_peered":"2023-07-06T21:55:04.217080+0000","last_unstale":"2023-07-06T21:55:05.272225+0000","last_undegraded":"2023-07-06T21:55:05.272225+0000","last_fullsized":"2023-07-06T21:55:05.272225+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:49:47.997199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272218+0000","last_change":"2023-07-06T21:55:04.220785+0000","last_active":"2023-07-06T21:55:05.272218+0000","last_peered":"2023-07-06T21:55:05.272218+0000","last_clean":"2023-07-06T21:55:05.272218+0000","last_became_active":"2023-07-06T21:55:04.220519+0000","last_became_peered":"2023-07-06T21:55:04.220519+0000","last_unstale":"2023-07-06T21:55:05.272218+0000","last_undegraded":"2023-07-06T21:55:05.272218+0000","last_fullsized":"2023-07-06T21:55:05.272218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:09:50.758130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273524+0000","last_change":"2023-07-06T21:55:04.230413+0000","last_active":"2023-07-06T21:55:05.273524+0000","last_peered":"2023-07-06T21:55:05.273524+0000","last_clean":"2023-07-06T21:55:05.273524+0000","last_became_active":"2023-07-06T21:55:04.230108+0000","last_became_peered":"2023-07-06T21:55:04.230108+0000","last_unstale":"2023-07-06T21:55:05.273524+0000","last_undegraded":"2023-07-06T21:55:05.273524+0000","last_fullsized":"2023-07-06T21:55:05.273524+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:54:37.625243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272874+0000","last_change":"2023-07-06T21:55:04.219597+0000","last_active":"2023-07-06T21:55:05.272874+0000","last_peered":"2023-07-06T21:55:05.272874+0000","last_clean":"2023-07-06T21:55:05.272874+0000","last_became_active":"2023-07-06T21:55:04.219310+0000","last_became_peered":"2023-07-06T21:55:04.219310+0000","last_unstale":"2023-07-06T21:55:05.272874+0000","last_undegraded":"2023-07-06T21:55:05.272874+0000","last_fullsized":"2023-07-06T21:55:05.272874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:15:59.948076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202573+0000","last_change":"2023-07-06T21:55:04.232165+0000","last_active":"2023-07-06T21:55:05.202573+0000","last_peered":"2023-07-06T21:55:05.202573+0000","last_clean":"2023-07-06T21:55:05.202573+0000","last_became_active":"2023-07-06T21:55:04.231440+0000","last_became_peered":"2023-07-06T21:55:04.231440+0000","last_unstale":"2023-07-06T21:55:05.202573+0000","last_undegraded":"2023-07-06T21:55:05.202573+0000","last_fullsized":"2023-07-06T21:55:05.202573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:29:00.009924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204147+0000","last_change":"2023-07-06T21:55:04.215150+0000","last_active":"2023-07-06T21:55:05.204147+0000","last_peered":"2023-07-06T21:55:05.204147+0000","last_clean":"2023-07-06T21:55:05.204147+0000","last_became_active":"2023-07-06T21:55:04.214900+0000","last_became_peered":"2023-07-06T21:55:04.214900+0000","last_unstale":"2023-07-06T21:55:05.204147+0000","last_undegraded":"2023-07-06T21:55:05.204147+0000","last_fullsized":"2023-07-06T21:55:05.204147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:10:03.683617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272783+0000","last_change":"2023-07-06T21:55:04.225692+0000","last_active":"2023-07-06T21:55:05.272783+0000","last_peered":"2023-07-06T21:55:05.272783+0000","last_clean":"2023-07-06T21:55:05.272783+0000","last_became_active":"2023-07-06T21:55:04.225387+0000","last_became_peered":"2023-07-06T21:55:04.225387+0000","last_unstale":"2023-07-06T21:55:05.272783+0000","last_undegraded":"2023-07-06T21:55:05.272783+0000","last_fullsized":"2023-07-06T21:55:05.272783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:24:25.395365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202005+0000","last_change":"2023-07-06T21:55:04.234651+0000","last_active":"2023-07-06T21:55:05.202005+0000","last_peered":"2023-07-06T21:55:05.202005+0000","last_clean":"2023-07-06T21:55:05.202005+0000","last_became_active":"2023-07-06T21:55:04.232750+0000","last_became_peered":"2023-07-06T21:55:04.232750+0000","last_unstale":"2023-07-06T21:55:05.202005+0000","last_undegraded":"2023-07-06T21:55:05.202005+0000","last_fullsized":"2023-07-06T21:55:05.202005+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:11:31.728348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272303+0000","last_change":"2023-07-06T21:55:04.223035+0000","last_active":"2023-07-06T21:55:05.272303+0000","last_peered":"2023-07-06T21:55:05.272303+0000","last_clean":"2023-07-06T21:55:05.272303+0000","last_became_active":"2023-07-06T21:55:04.222702+0000","last_became_peered":"2023-07-06T21:55:04.222702+0000","last_unstale":"2023-07-06T21:55:05.272303+0000","last_undegraded":"2023-07-06T21:55:05.272303+0000","last_fullsized":"2023-07-06T21:55:05.272303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:16:16.938720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201778+0000","last_change":"2023-07-06T21:55:04.228903+0000","last_active":"2023-07-06T21:55:05.201778+0000","last_peered":"2023-07-06T21:55:05.201778+0000","last_clean":"2023-07-06T21:55:05.201778+0000","last_became_active":"2023-07-06T21:55:04.228526+0000","last_became_peered":"2023-07-06T21:55:04.228526+0000","last_unstale":"2023-07-06T21:55:05.201778+0000","last_undegraded":"2023-07-06T21:55:05.201778+0000","last_fullsized":"2023-07-06T21:55:05.201778+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:56:18.324736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201014+0000","last_change":"2023-07-06T21:55:04.230641+0000","last_active":"2023-07-06T21:55:05.201014+0000","last_peered":"2023-07-06T21:55:05.201014+0000","last_clean":"2023-07-06T21:55:05.201014+0000","last_became_active":"2023-07-06T21:55:04.230163+0000","last_became_peered":"2023-07-06T21:55:04.230163+0000","last_unstale":"2023-07-06T21:55:05.201014+0000","last_undegraded":"2023-07-06T21:55:05.201014+0000","last_fullsized":"2023-07-06T21:55:05.201014+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:07:26.851153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204239+0000","last_change":"2023-07-06T21:55:04.221375+0000","last_active":"2023-07-06T21:55:05.204239+0000","last_peered":"2023-07-06T21:55:05.204239+0000","last_clean":"2023-07-06T21:55:05.204239+0000","last_became_active":"2023-07-06T21:55:04.220870+0000","last_became_peered":"2023-07-06T21:55:04.220870+0000","last_unstale":"2023-07-06T21:55:05.204239+0000","last_undegraded":"2023-07-06T21:55:05.204239+0000","last_fullsized":"2023-07-06T21:55:05.204239+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:08:03.218641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272825+0000","last_change":"2023-07-06T21:55:04.216751+0000","last_active":"2023-07-06T21:55:05.272825+0000","last_peered":"2023-07-06T21:55:05.272825+0000","last_clean":"2023-07-06T21:55:05.272825+0000","last_became_active":"2023-07-06T21:55:04.216466+0000","last_became_peered":"2023-07-06T21:55:04.216466+0000","last_unstale":"2023-07-06T21:55:05.272825+0000","last_undegraded":"2023-07-06T21:55:05.272825+0000","last_fullsized":"2023-07-06T21:55:05.272825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:20:40.333468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274432+0000","last_change":"2023-07-06T21:55:04.231152+0000","last_active":"2023-07-06T21:55:05.274432+0000","last_peered":"2023-07-06T21:55:05.274432+0000","last_clean":"2023-07-06T21:55:05.274432+0000","last_became_active":"2023-07-06T21:55:04.230811+0000","last_became_peered":"2023-07-06T21:55:04.230811+0000","last_unstale":"2023-07-06T21:55:05.274432+0000","last_undegraded":"2023-07-06T21:55:05.274432+0000","last_fullsized":"2023-07-06T21:55:05.274432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:31:12.550831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204083+0000","last_change":"2023-07-06T21:55:04.224726+0000","last_active":"2023-07-06T21:55:05.204083+0000","last_peered":"2023-07-06T21:55:05.204083+0000","last_clean":"2023-07-06T21:55:05.204083+0000","last_became_active":"2023-07-06T21:55:04.224352+0000","last_became_peered":"2023-07-06T21:55:04.224352+0000","last_unstale":"2023-07-06T21:55:05.204083+0000","last_undegraded":"2023-07-06T21:55:05.204083+0000","last_fullsized":"2023-07-06T21:55:05.204083+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:21:12.731301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272592+0000","last_change":"2023-07-06T21:55:04.219660+0000","last_active":"2023-07-06T21:55:05.272592+0000","last_peered":"2023-07-06T21:55:05.272592+0000","last_clean":"2023-07-06T21:55:05.272592+0000","last_became_active":"2023-07-06T21:55:04.219369+0000","last_became_peered":"2023-07-06T21:55:04.219369+0000","last_unstale":"2023-07-06T21:55:05.272592+0000","last_undegraded":"2023-07-06T21:55:05.272592+0000","last_fullsized":"2023-07-06T21:55:05.272592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:43.630523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202018+0000","last_change":"2023-07-06T21:55:04.226099+0000","last_active":"2023-07-06T21:55:05.202018+0000","last_peered":"2023-07-06T21:55:05.202018+0000","last_clean":"2023-07-06T21:55:05.202018+0000","last_became_active":"2023-07-06T21:55:04.225820+0000","last_became_peered":"2023-07-06T21:55:04.225820+0000","last_unstale":"2023-07-06T21:55:05.202018+0000","last_undegraded":"2023-07-06T21:55:05.202018+0000","last_fullsized":"2023-07-06T21:55:05.202018+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:23:17.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.203887+0000","last_change":"2023-07-06T21:55:04.221087+0000","last_active":"2023-07-06T21:55:05.203887+0000","last_peered":"2023-07-06T21:55:05.203887+0000","last_clean":"2023-07-06T21:55:05.203887+0000","last_became_active":"2023-07-06T21:55:04.220800+0000","last_became_peered":"2023-07-06T21:55:04.220800+0000","last_unstale":"2023-07-06T21:55:05.203887+0000","last_undegraded":"2023-07-06T21:55:05.203887+0000","last_fullsized":"2023-07-06T21:55:05.203887+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:31.101197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273658+0000","last_change":"2023-07-06T21:55:04.233759+0000","last_active":"2023-07-06T21:55:05.273658+0000","last_peered":"2023-07-06T21:55:05.273658+0000","last_clean":"2023-07-06T21:55:05.273658+0000","last_became_active":"2023-07-06T21:55:04.233493+0000","last_became_peered":"2023-07-06T21:55:04.233493+0000","last_unstale":"2023-07-06T21:55:05.273658+0000","last_undegraded":"2023-07-06T21:55:05.273658+0000","last_fullsized":"2023-07-06T21:55:05.273658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:28:32.886511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274173+0000","last_change":"2023-07-06T21:55:04.234548+0000","last_active":"2023-07-06T21:55:05.274173+0000","last_peered":"2023-07-06T21:55:05.274173+0000","last_clean":"2023-07-06T21:55:05.274173+0000","last_became_active":"2023-07-06T21:55:04.234277+0000","last_became_peered":"2023-07-06T21:55:04.234277+0000","last_unstale":"2023-07-06T21:55:05.274173+0000","last_undegraded":"2023-07-06T21:55:05.274173+0000","last_fullsized":"2023-07-06T21:55:05.274173+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:50:17.824151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"72'4","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274276+0000","last_change":"2023-07-06T21:55:03.812090+0000","last_active":"2023-07-06T21:55:05.274276+0000","last_peered":"2023-07-06T21:55:05.274276+0000","last_clean":"2023-07-06T21:55:05.274276+0000","last_became_active":"2023-07-06T21:55:03.811583+0000","last_became_peered":"2023-07-06T21:55:03.811583+0000","last_unstale":"2023-07-06T21:55:05.274276+0000","last_undegraded":"2023-07-06T21:55:05.274276+0000","last_fullsized":"2023-07-06T21:55:05.274276+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:32:35.703514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273599+0000","last_change":"2023-07-06T21:55:04.227368+0000","last_active":"2023-07-06T21:55:05.273599+0000","last_peered":"2023-07-06T21:55:05.273599+0000","last_clean":"2023-07-06T21:55:05.273599+0000","last_became_active":"2023-07-06T21:55:04.227065+0000","last_became_peered":"2023-07-06T21:55:04.227065+0000","last_unstale":"2023-07-06T21:55:05.273599+0000","last_undegraded":"2023-07-06T21:55:05.273599+0000","last_fullsized":"2023-07-06T21:55:05.273599+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:45:52.806377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273077+0000","last_change":"2023-07-06T21:55:03.804948+0000","last_active":"2023-07-06T21:55:05.273077+0000","last_peered":"2023-07-06T21:55:05.273077+0000","last_clean":"2023-07-06T21:55:05.273077+0000","last_became_active":"2023-07-06T21:55:03.804521+0000","last_became_peered":"2023-07-06T21:55:03.804521+0000","last_unstale":"2023-07-06T21:55:05.273077+0000","last_undegraded":"2023-07-06T21:55:05.273077+0000","last_fullsized":"2023-07-06T21:55:05.273077+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:41:37.991036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273962+0000","last_change":"2023-07-06T21:55:04.231223+0000","last_active":"2023-07-06T21:55:05.273962+0000","last_peered":"2023-07-06T21:55:05.273962+0000","last_clean":"2023-07-06T21:55:05.273962+0000","last_became_active":"2023-07-06T21:55:04.230950+0000","last_became_peered":"2023-07-06T21:55:04.230950+0000","last_unstale":"2023-07-06T21:55:05.273962+0000","last_undegraded":"2023-07-06T21:55:05.273962+0000","last_fullsized":"2023-07-06T21:55:05.273962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:25:49.579529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274559+0000","last_change":"2023-07-06T21:55:03.809667+0000","last_active":"2023-07-06T21:55:05.274559+0000","last_peered":"2023-07-06T21:55:05.274559+0000","last_clean":"2023-07-06T21:55:05.274559+0000","last_became_active":"2023-07-06T21:55:03.809442+0000","last_became_peered":"2023-07-06T21:55:03.809442+0000","last_unstale":"2023-07-06T21:55:05.274559+0000","last_undegraded":"2023-07-06T21:55:05.274559+0000","last_fullsized":"2023-07-06T21:55:05.274559+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:58:47.562937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274525+0000","last_change":"2023-07-06T21:55:04.233876+0000","last_active":"2023-07-06T21:55:05.274525+0000","last_peered":"2023-07-06T21:55:05.274525+0000","last_clean":"2023-07-06T21:55:05.274525+0000","last_became_active":"2023-07-06T21:55:04.233103+0000","last_became_peered":"2023-07-06T21:55:04.233103+0000","last_unstale":"2023-07-06T21:55:05.274525+0000","last_undegraded":"2023-07-06T21:55:05.274525+0000","last_fullsized":"2023-07-06T21:55:05.274525+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:50:21.140101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273221+0000","last_change":"2023-07-06T21:55:03.812044+0000","last_active":"2023-07-06T21:55:05.273221+0000","last_peered":"2023-07-06T21:55:05.273221+0000","last_clean":"2023-07-06T21:55:05.273221+0000","last_became_active":"2023-07-06T21:55:03.811771+0000","last_became_peered":"2023-07-06T21:55:03.811771+0000","last_unstale":"2023-07-06T21:55:05.273221+0000","last_undegraded":"2023-07-06T21:55:05.273221+0000","last_fullsized":"2023-07-06T21:55:05.273221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:12:50.277341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272434+0000","last_change":"2023-07-06T21:55:04.216166+0000","last_active":"2023-07-06T21:55:05.272434+0000","last_peered":"2023-07-06T21:55:05.272434+0000","last_clean":"2023-07-06T21:55:05.272434+0000","last_became_active":"2023-07-06T21:55:04.215825+0000","last_became_peered":"2023-07-06T21:55:04.215825+0000","last_unstale":"2023-07-06T21:55:05.272434+0000","last_undegraded":"2023-07-06T21:55:05.272434+0000","last_fullsized":"2023-07-06T21:55:05.272434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:28:16.698506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272572+0000","last_change":"2023-07-06T21:55:03.792388+0000","last_active":"2023-07-06T21:55:05.272572+0000","last_peered":"2023-07-06T21:55:05.272572+0000","last_clean":"2023-07-06T21:55:05.272572+0000","last_became_active":"2023-07-06T21:55:03.792043+0000","last_became_peered":"2023-07-06T21:55:03.792043+0000","last_unstale":"2023-07-06T21:55:05.272572+0000","last_undegraded":"2023-07-06T21:55:05.272572+0000","last_fullsized":"2023-07-06T21:55:05.272572+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:17:32.156313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272318+0000","last_change":"2023-07-06T21:55:04.225727+0000","last_active":"2023-07-06T21:55:05.272318+0000","last_peered":"2023-07-06T21:55:05.272318+0000","last_clean":"2023-07-06T21:55:05.272318+0000","last_became_active":"2023-07-06T21:55:04.225337+0000","last_became_peered":"2023-07-06T21:55:04.225337+0000","last_unstale":"2023-07-06T21:55:05.272318+0000","last_undegraded":"2023-07-06T21:55:05.272318+0000","last_fullsized":"2023-07-06T21:55:05.272318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:27:40.686809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274335+0000","last_change":"2023-07-06T21:55:03.807494+0000","last_active":"2023-07-06T21:55:05.274335+0000","last_peered":"2023-07-06T21:55:05.274335+0000","last_clean":"2023-07-06T21:55:05.274335+0000","last_became_active":"2023-07-06T21:55:03.807187+0000","last_became_peered":"2023-07-06T21:55:03.807187+0000","last_unstale":"2023-07-06T21:55:05.274335+0000","last_undegraded":"2023-07-06T21:55:05.274335+0000","last_fullsized":"2023-07-06T21:55:05.274335+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:55:16.881750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201079+0000","last_change":"2023-07-06T21:55:04.226482+0000","last_active":"2023-07-06T21:55:05.201079+0000","last_peered":"2023-07-06T21:55:05.201079+0000","last_clean":"2023-07-06T21:55:05.201079+0000","last_became_active":"2023-07-06T21:55:04.226134+0000","last_became_peered":"2023-07-06T21:55:04.226134+0000","last_unstale":"2023-07-06T21:55:05.201079+0000","last_undegraded":"2023-07-06T21:55:05.201079+0000","last_fullsized":"2023-07-06T21:55:05.201079+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:41:18.683234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272393+0000","last_change":"2023-07-06T21:55:03.799988+0000","last_active":"2023-07-06T21:55:05.272393+0000","last_peered":"2023-07-06T21:55:05.272393+0000","last_clean":"2023-07-06T21:55:05.272393+0000","last_became_active":"2023-07-06T21:55:03.799579+0000","last_became_peered":"2023-07-06T21:55:03.799579+0000","last_unstale":"2023-07-06T21:55:05.272393+0000","last_undegraded":"2023-07-06T21:55:05.272393+0000","last_fullsized":"2023-07-06T21:55:05.272393+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:54:50.788128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272739+0000","last_change":"2023-07-06T21:55:04.219704+0000","last_active":"2023-07-06T21:55:05.272739+0000","last_peered":"2023-07-06T21:55:05.272739+0000","last_clean":"2023-07-06T21:55:05.272739+0000","last_became_active":"2023-07-06T21:55:04.219356+0000","last_became_peered":"2023-07-06T21:55:04.219356+0000","last_unstale":"2023-07-06T21:55:05.272739+0000","last_undegraded":"2023-07-06T21:55:05.272739+0000","last_fullsized":"2023-07-06T21:55:05.272739+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:01:12.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272996+0000","last_change":"2023-07-06T21:55:03.807065+0000","last_active":"2023-07-06T21:55:05.272996+0000","last_peered":"2023-07-06T21:55:05.272996+0000","last_clean":"2023-07-06T21:55:05.272996+0000","last_became_active":"2023-07-06T21:55:03.806743+0000","last_became_peered":"2023-07-06T21:55:03.806743+0000","last_unstale":"2023-07-06T21:55:05.272996+0000","last_undegraded":"2023-07-06T21:55:05.272996+0000","last_fullsized":"2023-07-06T21:55:05.272996+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:59:00.624031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272542+0000","last_change":"2023-07-06T21:55:04.222148+0000","last_active":"2023-07-06T21:55:05.272542+0000","last_peered":"2023-07-06T21:55:05.272542+0000","last_clean":"2023-07-06T21:55:05.272542+0000","last_became_active":"2023-07-06T21:55:04.221861+0000","last_became_peered":"2023-07-06T21:55:04.221861+0000","last_unstale":"2023-07-06T21:55:05.272542+0000","last_undegraded":"2023-07-06T21:55:05.272542+0000","last_fullsized":"2023-07-06T21:55:05.272542+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:32:10.274300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202564+0000","last_change":"2023-07-06T21:55:03.807178+0000","last_active":"2023-07-06T21:55:05.202564+0000","last_peered":"2023-07-06T21:55:05.202564+0000","last_clean":"2023-07-06T21:55:05.202564+0000","last_became_active":"2023-07-06T21:55:03.806882+0000","last_became_peered":"2023-07-06T21:55:03.806882+0000","last_unstale":"2023-07-06T21:55:05.202564+0000","last_undegraded":"2023-07-06T21:55:05.202564+0000","last_fullsized":"2023-07-06T21:55:05.202564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:49:35.090189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202537+0000","last_change":"2023-07-06T21:55:04.231055+0000","last_active":"2023-07-06T21:55:05.202537+0000","last_peered":"2023-07-06T21:55:05.202537+0000","last_clean":"2023-07-06T21:55:05.202537+0000","last_became_active":"2023-07-06T21:55:04.230743+0000","last_became_peered":"2023-07-06T21:55:04.230743+0000","last_unstale":"2023-07-06T21:55:05.202537+0000","last_undegraded":"2023-07-06T21:55:05.202537+0000","last_fullsized":"2023-07-06T21:55:05.202537+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:16:23.178280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273072+0000","last_change":"2023-07-06T21:55:03.808339+0000","last_active":"2023-07-06T21:55:05.273072+0000","last_peered":"2023-07-06T21:55:05.273072+0000","last_clean":"2023-07-06T21:55:05.273072+0000","last_became_active":"2023-07-06T21:55:03.808030+0000","last_became_peered":"2023-07-06T21:55:03.808030+0000","last_unstale":"2023-07-06T21:55:05.273072+0000","last_undegraded":"2023-07-06T21:55:05.273072+0000","last_fullsized":"2023-07-06T21:55:05.273072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:53:05.435779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273176+0000","last_change":"2023-07-06T21:55:04.221150+0000","last_active":"2023-07-06T21:55:05.273176+0000","last_peered":"2023-07-06T21:55:05.273176+0000","last_clean":"2023-07-06T21:55:05.273176+0000","last_became_active":"2023-07-06T21:55:04.220753+0000","last_became_peered":"2023-07-06T21:55:04.220753+0000","last_unstale":"2023-07-06T21:55:05.273176+0000","last_undegraded":"2023-07-06T21:55:05.273176+0000","last_fullsized":"2023-07-06T21:55:05.273176+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:14:13.107759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"72'3","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202593+0000","last_change":"2023-07-06T21:55:03.807957+0000","last_active":"2023-07-06T21:55:05.202593+0000","last_peered":"2023-07-06T21:55:05.202593+0000","last_clean":"2023-07-06T21:55:05.202593+0000","last_became_active":"2023-07-06T21:55:03.807448+0000","last_became_peered":"2023-07-06T21:55:03.807448+0000","last_unstale":"2023-07-06T21:55:05.202593+0000","last_undegraded":"2023-07-06T21:55:05.202593+0000","last_fullsized":"2023-07-06T21:55:05.202593+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:11:44.003544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202388+0000","last_change":"2023-07-06T21:55:04.234744+0000","last_active":"2023-07-06T21:55:05.202388+0000","last_peered":"2023-07-06T21:55:05.202388+0000","last_clean":"2023-07-06T21:55:05.202388+0000","last_became_active":"2023-07-06T21:55:04.233910+0000","last_became_peered":"2023-07-06T21:55:04.233910+0000","last_unstale":"2023-07-06T21:55:05.202388+0000","last_undegraded":"2023-07-06T21:55:05.202388+0000","last_fullsized":"2023-07-06T21:55:05.202388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:22:39.798722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"72'6","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272837+0000","last_change":"2023-07-06T21:55:03.807413+0000","last_active":"2023-07-06T21:55:05.272837+0000","last_peered":"2023-07-06T21:55:05.272837+0000","last_clean":"2023-07-06T21:55:05.272837+0000","last_became_active":"2023-07-06T21:55:03.807053+0000","last_became_peered":"2023-07-06T21:55:03.807053+0000","last_unstale":"2023-07-06T21:55:05.272837+0000","last_undegraded":"2023-07-06T21:55:05.272837+0000","last_fullsized":"2023-07-06T21:55:05.272837+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:47.778643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272416+0000","last_change":"2023-07-06T21:55:04.224174+0000","last_active":"2023-07-06T21:55:05.272416+0000","last_peered":"2023-07-06T21:55:05.272416+0000","last_clean":"2023-07-06T21:55:05.272416+0000","last_became_active":"2023-07-06T21:55:04.223406+0000","last_became_peered":"2023-07-06T21:55:04.223406+0000","last_unstale":"2023-07-06T21:55:05.272416+0000","last_undegraded":"2023-07-06T21:55:05.272416+0000","last_fullsized":"2023-07-06T21:55:05.272416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:56:11.929414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272454+0000","last_change":"2023-07-06T21:55:03.811485+0000","last_active":"2023-07-06T21:55:05.272454+0000","last_peered":"2023-07-06T21:55:05.272454+0000","last_clean":"2023-07-06T21:55:05.272454+0000","last_became_active":"2023-07-06T21:55:03.811212+0000","last_became_peered":"2023-07-06T21:55:03.811212+0000","last_unstale":"2023-07-06T21:55:05.272454+0000","last_undegraded":"2023-07-06T21:55:05.272454+0000","last_fullsized":"2023-07-06T21:55:05.272454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:11:31.075853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202140+0000","last_change":"2023-07-06T21:55:04.225159+0000","last_active":"2023-07-06T21:55:05.202140+0000","last_peered":"2023-07-06T21:55:05.202140+0000","last_clean":"2023-07-06T21:55:05.202140+0000","last_became_active":"2023-07-06T21:55:04.224843+0000","last_became_peered":"2023-07-06T21:55:04.224843+0000","last_unstale":"2023-07-06T21:55:05.202140+0000","last_undegraded":"2023-07-06T21:55:05.202140+0000","last_fullsized":"2023-07-06T21:55:05.202140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:53:39.618561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201252+0000","last_change":"2023-07-06T21:55:03.805066+0000","last_active":"2023-07-06T21:55:05.201252+0000","last_peered":"2023-07-06T21:55:05.201252+0000","last_clean":"2023-07-06T21:55:05.201252+0000","last_became_active":"2023-07-06T21:55:03.804751+0000","last_became_peered":"2023-07-06T21:55:03.804751+0000","last_unstale":"2023-07-06T21:55:05.201252+0000","last_undegraded":"2023-07-06T21:55:05.201252+0000","last_fullsized":"2023-07-06T21:55:05.201252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:51:12.819787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272942+0000","last_change":"2023-07-06T21:55:04.227420+0000","last_active":"2023-07-06T21:55:05.272942+0000","last_peered":"2023-07-06T21:55:05.272942+0000","last_clean":"2023-07-06T21:55:05.272942+0000","last_became_active":"2023-07-06T21:55:04.227085+0000","last_became_peered":"2023-07-06T21:55:04.227085+0000","last_unstale":"2023-07-06T21:55:05.272942+0000","last_undegraded":"2023-07-06T21:55:05.272942+0000","last_fullsized":"2023-07-06T21:55:05.272942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:09:31.701550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272530+0000","last_change":"2023-07-06T21:55:03.803116+0000","last_active":"2023-07-06T21:55:05.272530+0000","last_peered":"2023-07-06T21:55:05.272530+0000","last_clean":"2023-07-06T21:55:05.272530+0000","last_became_active":"2023-07-06T21:55:03.802152+0000","last_became_peered":"2023-07-06T21:55:03.802152+0000","last_unstale":"2023-07-06T21:55:05.272530+0000","last_undegraded":"2023-07-06T21:55:05.272530+0000","last_fullsized":"2023-07-06T21:55:05.272530+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:37:39.062474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201774+0000","last_change":"2023-07-06T21:55:04.234452+0000","last_active":"2023-07-06T21:55:05.201774+0000","last_peered":"2023-07-06T21:55:05.201774+0000","last_clean":"2023-07-06T21:55:05.201774+0000","last_became_active":"2023-07-06T21:55:04.234074+0000","last_became_peered":"2023-07-06T21:55:04.234074+0000","last_unstale":"2023-07-06T21:55:05.201774+0000","last_undegraded":"2023-07-06T21:55:05.201774+0000","last_fullsized":"2023-07-06T21:55:05.201774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:31:33.634770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"72'8","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201508+0000","last_change":"2023-07-06T21:55:03.805724+0000","last_active":"2023-07-06T21:55:05.201508+0000","last_peered":"2023-07-06T21:55:05.201508+0000","last_clean":"2023-07-06T21:55:05.201508+0000","last_became_active":"2023-07-06T21:55:03.805440+0000","last_became_peered":"2023-07-06T21:55:03.805440+0000","last_unstale":"2023-07-06T21:55:05.201508+0000","last_undegraded":"2023-07-06T21:55:05.201508+0000","last_fullsized":"2023-07-06T21:55:05.201508+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:52:19.464262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272879+0000","last_change":"2023-07-06T21:55:04.220436+0000","last_active":"2023-07-06T21:55:05.272879+0000","last_peered":"2023-07-06T21:55:05.272879+0000","last_clean":"2023-07-06T21:55:05.272879+0000","last_became_active":"2023-07-06T21:55:04.220141+0000","last_became_peered":"2023-07-06T21:55:04.220141+0000","last_unstale":"2023-07-06T21:55:05.272879+0000","last_undegraded":"2023-07-06T21:55:05.272879+0000","last_fullsized":"2023-07-06T21:55:05.272879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:27:41.343194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273620+0000","last_change":"2023-07-06T21:55:03.810233+0000","last_active":"2023-07-06T21:55:05.273620+0000","last_peered":"2023-07-06T21:55:05.273620+0000","last_clean":"2023-07-06T21:55:05.273620+0000","last_became_active":"2023-07-06T21:55:03.809895+0000","last_became_peered":"2023-07-06T21:55:03.809895+0000","last_unstale":"2023-07-06T21:55:05.273620+0000","last_undegraded":"2023-07-06T21:55:05.273620+0000","last_fullsized":"2023-07-06T21:55:05.273620+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:27:33.769012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272975+0000","last_change":"2023-07-06T21:55:04.227295+0000","last_active":"2023-07-06T21:55:05.272975+0000","last_peered":"2023-07-06T21:55:05.272975+0000","last_clean":"2023-07-06T21:55:05.272975+0000","last_became_active":"2023-07-06T21:55:04.227037+0000","last_became_peered":"2023-07-06T21:55:04.227037+0000","last_unstale":"2023-07-06T21:55:05.272975+0000","last_undegraded":"2023-07-06T21:55:05.272975+0000","last_fullsized":"2023-07-06T21:55:05.272975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:52.681786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274286+0000","last_change":"2023-07-06T21:55:03.806612+0000","last_active":"2023-07-06T21:55:05.274286+0000","last_peered":"2023-07-06T21:55:05.274286+0000","last_clean":"2023-07-06T21:55:05.274286+0000","last_became_active":"2023-07-06T21:55:03.806332+0000","last_became_peered":"2023-07-06T21:55:03.806332+0000","last_unstale":"2023-07-06T21:55:05.274286+0000","last_undegraded":"2023-07-06T21:55:05.274286+0000","last_fullsized":"2023-07-06T21:55:05.274286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:06:44.765902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273343+0000","last_change":"2023-07-06T21:55:04.220772+0000","last_active":"2023-07-06T21:55:05.273343+0000","last_peered":"2023-07-06T21:55:05.273343+0000","last_clean":"2023-07-06T21:55:05.273343+0000","last_became_active":"2023-07-06T21:55:04.220461+0000","last_became_peered":"2023-07-06T21:55:04.220461+0000","last_unstale":"2023-07-06T21:55:05.273343+0000","last_undegraded":"2023-07-06T21:55:05.273343+0000","last_fullsized":"2023-07-06T21:55:05.273343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:21:05.967199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201308+0000","last_change":"2023-07-06T21:55:03.805049+0000","last_active":"2023-07-06T21:55:05.201308+0000","last_peered":"2023-07-06T21:55:05.201308+0000","last_clean":"2023-07-06T21:55:05.201308+0000","last_became_active":"2023-07-06T21:55:03.804698+0000","last_became_peered":"2023-07-06T21:55:03.804698+0000","last_unstale":"2023-07-06T21:55:05.201308+0000","last_undegraded":"2023-07-06T21:55:05.201308+0000","last_fullsized":"2023-07-06T21:55:05.201308+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:31:30.590376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274443+0000","last_change":"2023-07-06T21:55:04.234114+0000","last_active":"2023-07-06T21:55:05.274443+0000","last_peered":"2023-07-06T21:55:05.274443+0000","last_clean":"2023-07-06T21:55:05.274443+0000","last_became_active":"2023-07-06T21:55:04.233621+0000","last_became_peered":"2023-07-06T21:55:04.233621+0000","last_unstale":"2023-07-06T21:55:05.274443+0000","last_undegraded":"2023-07-06T21:55:05.274443+0000","last_fullsized":"2023-07-06T21:55:05.274443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:19.551788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273213+0000","last_change":"2023-07-06T21:55:03.803911+0000","last_active":"2023-07-06T21:55:05.273213+0000","last_peered":"2023-07-06T21:55:05.273213+0000","last_clean":"2023-07-06T21:55:05.273213+0000","last_became_active":"2023-07-06T21:55:03.803613+0000","last_became_peered":"2023-07-06T21:55:03.803613+0000","last_unstale":"2023-07-06T21:55:05.273213+0000","last_undegraded":"2023-07-06T21:55:05.273213+0000","last_fullsized":"2023-07-06T21:55:05.273213+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:14:49.214470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272567+0000","last_change":"2023-07-06T21:55:04.223535+0000","last_active":"2023-07-06T21:55:05.272567+0000","last_peered":"2023-07-06T21:55:05.272567+0000","last_clean":"2023-07-06T21:55:05.272567+0000","last_became_active":"2023-07-06T21:55:04.223287+0000","last_became_peered":"2023-07-06T21:55:04.223287+0000","last_unstale":"2023-07-06T21:55:05.272567+0000","last_undegraded":"2023-07-06T21:55:05.272567+0000","last_fullsized":"2023-07-06T21:55:05.272567+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:56:51.262527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273245+0000","last_change":"2023-07-06T21:55:03.804703+0000","last_active":"2023-07-06T21:55:05.273245+0000","last_peered":"2023-07-06T21:55:05.273245+0000","last_clean":"2023-07-06T21:55:05.273245+0000","last_became_active":"2023-07-06T21:55:03.804419+0000","last_became_peered":"2023-07-06T21:55:03.804419+0000","last_unstale":"2023-07-06T21:55:05.273245+0000","last_undegraded":"2023-07-06T21:55:05.273245+0000","last_fullsized":"2023-07-06T21:55:05.273245+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:23:20.788292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202204+0000","last_change":"2023-07-06T21:55:04.234917+0000","last_active":"2023-07-06T21:55:05.202204+0000","last_peered":"2023-07-06T21:55:05.202204+0000","last_clean":"2023-07-06T21:55:05.202204+0000","last_became_active":"2023-07-06T21:55:04.233565+0000","last_became_peered":"2023-07-06T21:55:04.233565+0000","last_unstale":"2023-07-06T21:55:05.202204+0000","last_undegraded":"2023-07-06T21:55:05.202204+0000","last_fullsized":"2023-07-06T21:55:05.202204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:37.557130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272356+0000","last_change":"2023-07-06T21:55:03.808191+0000","last_active":"2023-07-06T21:55:05.272356+0000","last_peered":"2023-07-06T21:55:05.272356+0000","last_clean":"2023-07-06T21:55:05.272356+0000","last_became_active":"2023-07-06T21:55:03.807881+0000","last_became_peered":"2023-07-06T21:55:03.807881+0000","last_unstale":"2023-07-06T21:55:05.272356+0000","last_undegraded":"2023-07-06T21:55:05.272356+0000","last_fullsized":"2023-07-06T21:55:05.272356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:21:47.438191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272752+0000","last_change":"2023-07-06T21:55:04.215271+0000","last_active":"2023-07-06T21:55:05.272752+0000","last_peered":"2023-07-06T21:55:05.272752+0000","last_clean":"2023-07-06T21:55:05.272752+0000","last_became_active":"2023-07-06T21:55:04.214987+0000","last_became_peered":"2023-07-06T21:55:04.214987+0000","last_unstale":"2023-07-06T21:55:05.272752+0000","last_undegraded":"2023-07-06T21:55:05.272752+0000","last_fullsized":"2023-07-06T21:55:05.272752+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:03:48.077161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273097+0000","last_change":"2023-07-06T21:55:03.808513+0000","last_active":"2023-07-06T21:55:05.273097+0000","last_peered":"2023-07-06T21:55:05.273097+0000","last_clean":"2023-07-06T21:55:05.273097+0000","last_became_active":"2023-07-06T21:55:03.808255+0000","last_became_peered":"2023-07-06T21:55:03.808255+0000","last_unstale":"2023-07-06T21:55:05.273097+0000","last_undegraded":"2023-07-06T21:55:05.273097+0000","last_fullsized":"2023-07-06T21:55:05.273097+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:56:51.473088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272614+0000","last_change":"2023-07-06T21:55:04.220280+0000","last_active":"2023-07-06T21:55:05.272614+0000","last_peered":"2023-07-06T21:55:05.272614+0000","last_clean":"2023-07-06T21:55:05.272614+0000","last_became_active":"2023-07-06T21:55:04.219967+0000","last_became_peered":"2023-07-06T21:55:04.219967+0000","last_unstale":"2023-07-06T21:55:05.272614+0000","last_undegraded":"2023-07-06T21:55:05.272614+0000","last_fullsized":"2023-07-06T21:55:05.272614+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:04:50.371503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272570+0000","last_change":"2023-07-06T21:55:03.809420+0000","last_active":"2023-07-06T21:55:05.272570+0000","last_peered":"2023-07-06T21:55:05.272570+0000","last_clean":"2023-07-06T21:55:05.272570+0000","last_became_active":"2023-07-06T21:55:03.809110+0000","last_became_peered":"2023-07-06T21:55:03.809110+0000","last_unstale":"2023-07-06T21:55:05.272570+0000","last_undegraded":"2023-07-06T21:55:05.272570+0000","last_fullsized":"2023-07-06T21:55:05.272570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:45:04.202987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272438+0000","last_change":"2023-07-06T21:55:04.229997+0000","last_active":"2023-07-06T21:55:05.272438+0000","last_peered":"2023-07-06T21:55:05.272438+0000","last_clean":"2023-07-06T21:55:05.272438+0000","last_became_active":"2023-07-06T21:55:04.229709+0000","last_became_peered":"2023-07-06T21:55:04.229709+0000","last_unstale":"2023-07-06T21:55:05.272438+0000","last_undegraded":"2023-07-06T21:55:05.272438+0000","last_fullsized":"2023-07-06T21:55:05.272438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:12:43.599490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201149+0000","last_change":"2023-07-06T21:55:03.810800+0000","last_active":"2023-07-06T21:55:05.201149+0000","last_peered":"2023-07-06T21:55:05.201149+0000","last_clean":"2023-07-06T21:55:05.201149+0000","last_became_active":"2023-07-06T21:55:03.810377+0000","last_became_peered":"2023-07-06T21:55:03.810377+0000","last_unstale":"2023-07-06T21:55:05.201149+0000","last_undegraded":"2023-07-06T21:55:05.201149+0000","last_fullsized":"2023-07-06T21:55:05.201149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:56:59.341675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"60'139","reported_seq":355,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201755+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:55:05.201755+0000","last_peered":"2023-07-06T21:55:05.201755+0000","last_clean":"2023-07-06T21:55:05.201755+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:55:05.201755+0000","last_undegraded":"2023-07-06T21:55:05.201755+0000","last_fullsized":"2023-07-06T21:55:05.201755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:55:24.093240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":111,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273243+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:55:05.273243+0000","last_peered":"2023-07-06T21:55:05.273243+0000","last_clean":"2023-07-06T21:55:05.273243+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:55:05.273243+0000","last_undegraded":"2023-07-06T21:55:05.273243+0000","last_fullsized":"2023-07-06T21:55:05.273243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:44:07.375135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273936+0000","last_change":"2023-07-06T21:55:04.224893+0000","last_active":"2023-07-06T21:55:05.273936+0000","last_peered":"2023-07-06T21:55:05.273936+0000","last_clean":"2023-07-06T21:55:05.273936+0000","last_became_active":"2023-07-06T21:55:04.224576+0000","last_became_peered":"2023-07-06T21:55:04.224576+0000","last_unstale":"2023-07-06T21:55:05.273936+0000","last_undegraded":"2023-07-06T21:55:05.273936+0000","last_fullsized":"2023-07-06T21:55:05.273936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:13:47.968292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273380+0000","last_change":"2023-07-06T21:55:03.797613+0000","last_active":"2023-07-06T21:55:05.273380+0000","last_peered":"2023-07-06T21:55:05.273380+0000","last_clean":"2023-07-06T21:55:05.273380+0000","last_became_active":"2023-07-06T21:55:03.797319+0000","last_became_peered":"2023-07-06T21:55:03.797319+0000","last_unstale":"2023-07-06T21:55:05.273380+0000","last_undegraded":"2023-07-06T21:55:05.273380+0000","last_fullsized":"2023-07-06T21:55:05.273380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:04:54.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201601+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:55:05.201601+0000","last_peered":"2023-07-06T21:55:05.201601+0000","last_clean":"2023-07-06T21:55:05.201601+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:55:05.201601+0000","last_undegraded":"2023-07-06T21:55:05.201601+0000","last_fullsized":"2023-07-06T21:55:05.201601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:20:02.309799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272572+0000","last_change":"2023-07-06T21:55:04.224373+0000","last_active":"2023-07-06T21:55:05.272572+0000","last_peered":"2023-07-06T21:55:05.272572+0000","last_clean":"2023-07-06T21:55:05.272572+0000","last_became_active":"2023-07-06T21:55:04.223861+0000","last_became_peered":"2023-07-06T21:55:04.223861+0000","last_unstale":"2023-07-06T21:55:05.272572+0000","last_undegraded":"2023-07-06T21:55:05.272572+0000","last_fullsized":"2023-07-06T21:55:05.272572+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:10:15.780966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272727+0000","last_change":"2023-07-06T21:55:03.805520+0000","last_active":"2023-07-06T21:55:05.272727+0000","last_peered":"2023-07-06T21:55:05.272727+0000","last_clean":"2023-07-06T21:55:05.272727+0000","last_became_active":"2023-07-06T21:55:03.805236+0000","last_became_peered":"2023-07-06T21:55:03.805236+0000","last_unstale":"2023-07-06T21:55:05.272727+0000","last_undegraded":"2023-07-06T21:55:05.272727+0000","last_fullsized":"2023-07-06T21:55:05.272727+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:05:58.180036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204281+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:55:05.204281+0000","last_peered":"2023-07-06T21:55:05.204281+0000","last_clean":"2023-07-06T21:55:05.204281+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:55:05.204281+0000","last_undegraded":"2023-07-06T21:55:05.204281+0000","last_fullsized":"2023-07-06T21:55:05.204281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:24:43.577061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273528+0000","last_change":"2023-07-06T21:55:04.237089+0000","last_active":"2023-07-06T21:55:05.273528+0000","last_peered":"2023-07-06T21:55:05.273528+0000","last_clean":"2023-07-06T21:55:05.273528+0000","last_became_active":"2023-07-06T21:55:04.236799+0000","last_became_peered":"2023-07-06T21:55:04.236799+0000","last_unstale":"2023-07-06T21:55:05.273528+0000","last_undegraded":"2023-07-06T21:55:05.273528+0000","last_fullsized":"2023-07-06T21:55:05.273528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:51:46.035092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272424+0000","last_change":"2023-07-06T21:55:03.810224+0000","last_active":"2023-07-06T21:55:05.272424+0000","last_peered":"2023-07-06T21:55:05.272424+0000","last_clean":"2023-07-06T21:55:05.272424+0000","last_became_active":"2023-07-06T21:55:03.809937+0000","last_became_peered":"2023-07-06T21:55:03.809937+0000","last_unstale":"2023-07-06T21:55:05.272424+0000","last_undegraded":"2023-07-06T21:55:05.272424+0000","last_fullsized":"2023-07-06T21:55:05.272424+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:40:45.345972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272666+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:55:05.272666+0000","last_peered":"2023-07-06T21:55:05.272666+0000","last_clean":"2023-07-06T21:55:05.272666+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:55:05.272666+0000","last_undegraded":"2023-07-06T21:55:05.272666+0000","last_fullsized":"2023-07-06T21:55:05.272666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:50:51.643352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272816+0000","last_change":"2023-07-06T21:55:04.224761+0000","last_active":"2023-07-06T21:55:05.272816+0000","last_peered":"2023-07-06T21:55:05.272816+0000","last_clean":"2023-07-06T21:55:05.272816+0000","last_became_active":"2023-07-06T21:55:04.223413+0000","last_became_peered":"2023-07-06T21:55:04.223413+0000","last_unstale":"2023-07-06T21:55:05.272816+0000","last_undegraded":"2023-07-06T21:55:05.272816+0000","last_fullsized":"2023-07-06T21:55:05.272816+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:13:21.320036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274227+0000","last_change":"2023-07-06T21:55:03.807462+0000","last_active":"2023-07-06T21:55:05.274227+0000","last_peered":"2023-07-06T21:55:05.274227+0000","last_clean":"2023-07-06T21:55:05.274227+0000","last_became_active":"2023-07-06T21:55:03.807215+0000","last_became_peered":"2023-07-06T21:55:03.807215+0000","last_unstale":"2023-07-06T21:55:05.274227+0000","last_undegraded":"2023-07-06T21:55:05.274227+0000","last_fullsized":"2023-07-06T21:55:05.274227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:27:03.117688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":117,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273426+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:55:05.273426+0000","last_peered":"2023-07-06T21:55:05.273426+0000","last_clean":"2023-07-06T21:55:05.273426+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:55:05.273426+0000","last_undegraded":"2023-07-06T21:55:05.273426+0000","last_fullsized":"2023-07-06T21:55:05.273426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:29:55.230358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202553+0000","last_change":"2023-07-06T21:55:04.232362+0000","last_active":"2023-07-06T21:55:05.202553+0000","last_peered":"2023-07-06T21:55:05.202553+0000","last_clean":"2023-07-06T21:55:05.202553+0000","last_became_active":"2023-07-06T21:55:04.231776+0000","last_became_peered":"2023-07-06T21:55:04.231776+0000","last_unstale":"2023-07-06T21:55:05.202553+0000","last_undegraded":"2023-07-06T21:55:05.202553+0000","last_fullsized":"2023-07-06T21:55:05.202553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:55:16.706601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272997+0000","last_change":"2023-07-06T21:55:03.808380+0000","last_active":"2023-07-06T21:55:05.272997+0000","last_peered":"2023-07-06T21:55:05.272997+0000","last_clean":"2023-07-06T21:55:05.272997+0000","last_became_active":"2023-07-06T21:55:03.808078+0000","last_became_peered":"2023-07-06T21:55:03.808078+0000","last_unstale":"2023-07-06T21:55:05.272997+0000","last_undegraded":"2023-07-06T21:55:05.272997+0000","last_fullsized":"2023-07-06T21:55:05.272997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:19:19.697024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202654+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:55:05.202654+0000","last_peered":"2023-07-06T21:55:05.202654+0000","last_clean":"2023-07-06T21:55:05.202654+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:55:05.202654+0000","last_undegraded":"2023-07-06T21:55:05.202654+0000","last_fullsized":"2023-07-06T21:55:05.202654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:38:24.190196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202552+0000","last_change":"2023-07-06T21:55:04.234940+0000","last_active":"2023-07-06T21:55:05.202552+0000","last_peered":"2023-07-06T21:55:05.202552+0000","last_clean":"2023-07-06T21:55:05.202552+0000","last_became_active":"2023-07-06T21:55:04.234199+0000","last_became_peered":"2023-07-06T21:55:04.234199+0000","last_unstale":"2023-07-06T21:55:05.202552+0000","last_undegraded":"2023-07-06T21:55:05.202552+0000","last_fullsized":"2023-07-06T21:55:05.202552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:11:20.189364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274005+0000","last_change":"2023-07-06T21:55:03.810832+0000","last_active":"2023-07-06T21:55:05.274005+0000","last_peered":"2023-07-06T21:55:05.274005+0000","last_clean":"2023-07-06T21:55:05.274005+0000","last_became_active":"2023-07-06T21:55:03.810525+0000","last_became_peered":"2023-07-06T21:55:03.810525+0000","last_unstale":"2023-07-06T21:55:05.274005+0000","last_undegraded":"2023-07-06T21:55:05.274005+0000","last_fullsized":"2023-07-06T21:55:05.274005+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:19:09.759535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":117,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273814+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:55:05.273814+0000","last_peered":"2023-07-06T21:55:05.273814+0000","last_clean":"2023-07-06T21:55:05.273814+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:55:05.273814+0000","last_undegraded":"2023-07-06T21:55:05.273814+0000","last_fullsized":"2023-07-06T21:55:05.273814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:43:50.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272850+0000","last_change":"2023-07-06T21:55:04.228462+0000","last_active":"2023-07-06T21:55:05.272850+0000","last_peered":"2023-07-06T21:55:05.272850+0000","last_clean":"2023-07-06T21:55:05.272850+0000","last_became_active":"2023-07-06T21:55:04.227151+0000","last_became_peered":"2023-07-06T21:55:04.227151+0000","last_unstale":"2023-07-06T21:55:05.272850+0000","last_undegraded":"2023-07-06T21:55:05.272850+0000","last_fullsized":"2023-07-06T21:55:05.272850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:52:36.037743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273137+0000","last_change":"2023-07-06T21:55:03.811493+0000","last_active":"2023-07-06T21:55:05.273137+0000","last_peered":"2023-07-06T21:55:05.273137+0000","last_clean":"2023-07-06T21:55:05.273137+0000","last_became_active":"2023-07-06T21:55:03.811194+0000","last_became_peered":"2023-07-06T21:55:03.811194+0000","last_unstale":"2023-07-06T21:55:05.273137+0000","last_undegraded":"2023-07-06T21:55:05.273137+0000","last_fullsized":"2023-07-06T21:55:05.273137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:49:36.176146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201438+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:55:05.201438+0000","last_peered":"2023-07-06T21:55:05.201438+0000","last_clean":"2023-07-06T21:55:05.201438+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:55:05.201438+0000","last_undegraded":"2023-07-06T21:55:05.201438+0000","last_fullsized":"2023-07-06T21:55:05.201438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:54:45.732783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575009,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36588,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335252,"statfs":{"total":96636764160,"available":96599298048,"internally_reserved":0,"allocated":1478656,"data_stored":1045283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71599999999999997,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.35199999999999998,"15min":0.30599999999999999},"max":{"1min":0.93999999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71199999999999997,"15min":0.69099999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":0.91300000000000003,"5min":0.98799999999999999,"15min":0.99399999999999999},"last":0.503}]},{"osd":1,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.47799999999999998,"5min":0.39800000000000002,"15min":0.34799999999999998},"max":{"1min":0.91800000000000004,"5min":1.0449999999999999,"15min":1.0649999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86199999999999999,"5min":0.94099999999999995,"15min":0.97899999999999998},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.878,"5min":0.94799999999999995,"15min":0.94999999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73299999999999998,"15min":0.72799999999999998},"min":{"1min":0.52000000000000002,"5min":0.436,"15min":0.42599999999999999},"max":{"1min":0.89200000000000002,"5min":1.008,"15min":1.0529999999999999},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.44700000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0469999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":0.93700000000000006,"5min":0.99399999999999999,"15min":1.006},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80700000000000005,"5min":0.94199999999999995,"15min":0.999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.747,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57999999999999996,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.98499999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":0.874,"5min":0.91100000000000003,"15min":0.99199999999999999},"last":0.626}]},{"osd":6,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70199999999999996,"15min":0.70099999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.40200000000000002},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":1.0309999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65900000000000003,"15min":0.67200000000000004},"min":{"1min":0.51000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95399999999999996,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575009,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":872448,"data_stored":453736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72499999999999998,"15min":0.70499999999999996},"min":{"1min":0.54600000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.0980000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.74299999999999999,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.38300000000000001},"max":{"1min":0.94799999999999995,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73299999999999998,"15min":0.71299999999999997},"min":{"1min":0.56499999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.753,"15min":0.73199999999999998},"min":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.998,"5min":0.998,"15min":1.1180000000000001},"last":0.624}]},{"osd":2,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.71699999999999997},"min":{"1min":0.56499999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.3859999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75700000000000001,"15min":0.73999999999999999},"min":{"1min":0.63500000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76500000000000001,"15min":0.748},"min":{"1min":0.57999999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.204},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.753,"15min":0.73899999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.498},"max":{"1min":0.96199999999999997,"5min":0.98099999999999998,"15min":1.4339999999999999},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.59199999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80200000000000005,"5min":0.84999999999999998,"15min":1.1850000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.39300000000000002},"max":{"1min":0.84199999999999997,"5min":0.91900000000000004,"15min":1.321},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":1.0089999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.73599999999999999},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.89200000000000002,"5min":1.0189999999999999,"15min":1.631},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.41699999999999998},"max":{"1min":0.878,"5min":0.92400000000000004,"15min":1.3600000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67200000000000004,"15min":0.69999999999999996},"min":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.6930000000000001},"last":0.749}]}]},{"osd":5,"up_from":13,"seq":55834575008,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":884736,"data_stored":455407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70599999999999996,"15min":0.69099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.99299999999999999},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.71499999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.39200000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.131},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.72499999999999998},"min":{"1min":0.56899999999999995,"5min":0.54400000000000004,"15min":0.41099999999999998},"max":{"1min":0.92400000000000004,"5min":0.94399999999999995,"15min":1.0329999999999999},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75800000000000001,"15min":0.73899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75700000000000001,"15min":0.73499999999999999},"min":{"1min":0.51100000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98299999999999998,"5min":0.98599999999999999,"15min":1.0369999999999999},"last":0.878}]},{"osd":3,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48999999999999999},"max":{"1min":0.93300000000000005,"5min":0.94399999999999995,"15min":0.96099999999999997},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77400000000000002,"15min":0.76300000000000001},"min":{"1min":0.64100000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.58799999999999997},"min":{"1min":0.42299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.747,"5min":0.86599999999999999,"15min":1},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59199999999999997,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91800000000000004,"5min":0.93400000000000005,"15min":1.02},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59299999999999997,"15min":0.64300000000000002},"min":{"1min":0.48999999999999999,"5min":0.44700000000000001,"15min":0.44600000000000001},"max":{"1min":0.86799999999999999,"5min":0.91400000000000003,"15min":1.052},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.65100000000000002},"min":{"1min":0.47499999999999998,"5min":0.46300000000000002,"15min":0.41799999999999998},"max":{"1min":0.82799999999999996,"5min":0.86399999999999999,"15min":0.96699999999999997},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.69699999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.45200000000000001},"max":{"1min":0.92200000000000004,"5min":0.96299999999999997,"15min":1.0529999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.57599999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575007,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":888832,"data_stored":456319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.60099999999999998,"5min":0.47299999999999998,"15min":0.39400000000000002},"max":{"1min":0.93899999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.52600000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.86499999999999999,"5min":1.0489999999999999,"15min":1.071},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.59199999999999997,"5min":0.51900000000000002,"15min":0.44},"max":{"1min":0.878,"5min":0.89200000000000002,"15min":1.361},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71199999999999997,"15min":0.72299999999999998},"min":{"1min":0.57399999999999995,"5min":0.47899999999999998,"15min":0.40300000000000002},"max":{"1min":0.90200000000000002,"5min":1.01,"15min":1.2829999999999999},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.73399999999999999,"15min":0.72299999999999998},"min":{"1min":0.64300000000000002,"5min":0.50800000000000001,"15min":0.40899999999999997},"max":{"1min":0.84699999999999998,"5min":1.1299999999999999,"15min":1.2170000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.752,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.505,"15min":0.38600000000000001},"max":{"1min":0.91800000000000004,"5min":0.98599999999999999,"15min":1.649},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72899999999999998,"15min":0.73999999999999999},"min":{"1min":0.61099999999999999,"5min":0.53800000000000003,"15min":0.45800000000000002},"max":{"1min":0.85199999999999998,"5min":0.93700000000000006,"15min":1.4219999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.60699999999999998,"5min":0.57199999999999995,"15min":0.49099999999999999},"max":{"1min":0.89100000000000001,"5min":0.97399999999999998,"15min":1.3109999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.308},"max":{"1min":0.80400000000000005,"5min":0.93700000000000006,"15min":1.246},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.63500000000000001},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.32500000000000001},"max":{"1min":0.88800000000000001,"5min":0.97299999999999998,"15min":1.8049999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.63100000000000001},"min":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.36299999999999999},"max":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":1.478},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63,"15min":0.68600000000000005},"min":{"1min":0.48299999999999998,"5min":0.443,"15min":0.34799999999999998},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.7250000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63900000000000001,"15min":0.68400000000000005},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93200000000000005,"5min":1.028,"15min":1.534},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64700000000000002,"15min":0.69399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90600000000000003,"5min":1.01,"15min":1.585},"last":0.55400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575008,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":884736,"data_stored":454811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26900000000000002},"max":{"1min":0.85499999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.33400000000000002},"max":{"1min":0.94899999999999995,"5min":0.99099999999999999,"15min":1.7190000000000001},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49199999999999999,"15min":0.47499999999999998},"min":{"1min":0.32400000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.88,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.309},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.33500000000000002,"15min":0.32700000000000001},"max":{"1min":0.73399999999999999,"5min":1.109,"15min":1.9590000000000001},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.53000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33000000000000002},"max":{"1min":0.621,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.34799999999999998},"max":{"1min":0.72099999999999997,"5min":1.24,"15min":2.012},"last":0.377}]},{"osd":4,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":0.95999999999999996,"5min":1.1339999999999999,"15min":1.855},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80000000000000004,"15min":0.77600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46000000000000002,"15min":0.432},"max":{"1min":1.0329999999999999,"5min":1.097,"15min":1.524},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83399999999999996,"15min":0.79400000000000004},"min":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.42399999999999999},"max":{"1min":0.95599999999999996,"5min":1.236,"15min":1.3720000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80400000000000005,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.45400000000000001,"15min":0.44800000000000001},"max":{"1min":1.0169999999999999,"5min":1.3999999999999999,"15min":1.883},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.78500000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40000000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.75},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.79200000000000004},"min":{"1min":0.56399999999999995,"5min":0.53600000000000003,"15min":0.47899999999999998},"max":{"1min":1.0640000000000001,"5min":1.101,"15min":1.4610000000000001},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82999999999999996,"15min":0.80100000000000005},"min":{"1min":0.57999999999999996,"5min":0.51300000000000001,"15min":0.497},"max":{"1min":1.0589999999999999,"5min":1.456,"15min":1.456},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52900000000000003},"max":{"1min":1.0649999999999999,"5min":1.3480000000000001,"15min":1.9830000000000001},"last":0.72099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575008,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":884736,"data_stored":454811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.44900000000000001},"min":{"1min":0.317,"5min":0.29099999999999998,"15min":0.28100000000000003},"max":{"1min":0.66300000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.315},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.78300000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.504},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.33700000000000002},"max":{"1min":0.63700000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.443,"5min":0.38400000000000001,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":0.76200000000000001,"15min":0.76500000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.56799999999999995},"min":{"1min":0.48999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77400000000000002,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.64500000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1040000000000001,"5min":1.21,"15min":1.2430000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81899999999999995,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.214,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80100000000000005,"15min":0.78900000000000003},"min":{"1min":0.68999999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0549999999999999,"5min":1.212,"15min":1.246},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83299999999999996,"15min":0.81899999999999995},"min":{"1min":0.70799999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1930000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.002}]},{"osd":6,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.83999999999999997,"15min":0.80100000000000005},"min":{"1min":0.54900000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.246,"5min":1.27,"15min":1.27},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.68600000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.105,"5min":1.2410000000000001,"15min":1.3320000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.83799999999999997,"15min":0.82299999999999995},"min":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.54300000000000004},"max":{"1min":1.1439999999999999,"5min":1.2789999999999999,"15min":1.3520000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.85399999999999998,"15min":0.83299999999999996},"min":{"1min":0.67100000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.218,"5min":1.268,"15min":1.369},"last":0.70299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575009,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36004,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335836,"statfs":{"total":96636764160,"available":96599896064,"internally_reserved":0,"allocated":880640,"data_stored":454845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.35799999999999998,"5min":0.28999999999999998,"15min":0.27500000000000002},"max":{"1min":0.63700000000000001,"5min":0.66100000000000003,"15min":0.73699999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.34399999999999997,"5min":0.32200000000000001,"15min":0.29399999999999998},"max":{"1min":0.64500000000000002,"5min":0.78900000000000003,"15min":0.92200000000000004},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.34300000000000003,"5min":0.33000000000000002,"15min":0.311},"max":{"1min":0.623,"5min":0.73599999999999999,"15min":0.80200000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73299999999999998,"5min":0.87,"15min":0.87},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.46500000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.70699999999999996,"5min":0.84599999999999997,"15min":0.96299999999999997},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72799999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78900000000000003,"15min":0.77200000000000002},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.38500000000000001},"max":{"1min":1.143,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.87},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79200000000000004,"15min":0.78100000000000003},"min":{"1min":0.65000000000000002,"5min":0.497,"15min":0.44},"max":{"1min":1.0049999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79600000000000004,"15min":0.77700000000000002},"min":{"1min":0.54800000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1890000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.47999999999999998,"15min":0.439},"max":{"1min":1.028,"5min":1.357,"15min":1.357},"last":0.81299999999999994}]},{"osd":6,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.63300000000000001,"5min":0.54300000000000004,"15min":0.53800000000000003},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81200000000000006,"15min":0.80900000000000005},"min":{"1min":0.60999999999999999,"5min":0.51800000000000002,"15min":0.51500000000000001},"max":{"1min":0.97199999999999998,"5min":1.456,"15min":1.456},"last":0.92000000000000004}]},{"osd":7,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.53800000000000003},"max":{"1min":1.0820000000000001,"5min":1.417,"15min":1.417},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.59499999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3280000000000001,"5min":1.397,"15min":1.397},"last":0.94399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575008,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1482752,"data_stored":1046250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.247},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.1459999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.33600000000000002,"15min":0.28599999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":1.5189999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.30099999999999999},"max":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":1.228},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.34000000000000002},"max":{"1min":0.72299999999999998,"5min":0.85799999999999998,"15min":1.454},"last":0.498}]},{"osd":3,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.51100000000000001},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.308},"max":{"1min":0.71799999999999997,"5min":0.78900000000000003,"15min":1.7969999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.36799999999999999},"max":{"1min":0.83099999999999996,"5min":0.874,"15min":1.7190000000000001},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81699999999999995,"15min":0.79800000000000004},"min":{"1min":0.499,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.111,"5min":1.242,"15min":1.911},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.53100000000000003,"15min":0.35799999999999998},"max":{"1min":1.1020000000000001,"5min":1.2729999999999999,"15min":1.3620000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82599999999999996,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.38400000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.3700000000000001},"last":0.745},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81499999999999995,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.55200000000000005,"15min":0.44400000000000001},"max":{"1min":1.0329999999999999,"5min":1.1759999999999999,"15min":1.758},"last":0.754}]},{"osd":6,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.52400000000000002},"max":{"1min":1.0780000000000001,"5min":1.2050000000000001,"15min":1.8220000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.47199999999999998},"max":{"1min":1.071,"5min":1.1379999999999999,"15min":2.266},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.63500000000000001,"5min":0.55900000000000005,"15min":0.53800000000000003},"max":{"1min":1.135,"5min":1.147,"15min":2.323},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.84699999999999998,"15min":0.81899999999999995},"min":{"1min":0.65500000000000003,"5min":0.60599999999999998,"15min":0.435},"max":{"1min":1.107,"5min":1.2210000000000001,"15min":1.2829999999999999},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:55:12.857 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:55:13.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.010+0000 7ffaa69fa640 1 Processor -- start 2023-07-06T21:55:13.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.010+0000 7ffaa69fa640 1 -- start start 2023-07-06T21:55:13.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.014+0000 7ffaa69fa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ffaa00cd460 0x7ffaa0158720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.014+0000 7ffaa69fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa015c8a0 con 0x7ffaa00cbe50 2023-07-06T21:55:13.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.014+0000 7ffaa69fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa00cc220 con 0x7ffaa00cd900 2023-07-06T21:55:13.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.014+0000 7ffaa69fa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa00cce70 con 0x7ffaa00cd460 2023-07-06T21:55:13.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.014+0000 7ffa9ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ffaa00cbe50 0x7ffaa00c89b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54530/0 (socket says 172.21.15.55:54530) 2023-07-06T21:55:13.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.014+0000 7ffa9ffff640 1 -- 172.21.15.55:0/2341682861 learned_addr learned my addr 172.21.15.55:0/2341682861 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:55:13.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.014+0000 7ffa9f7fe640 1 --2- 172.21.15.55:0/2341682861 >> v2:172.21.15.138:3300/0 conn(0x7ffaa00cd460 0x7ffaa0158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.014+0000 7ffa9effd640 1 -- 172.21.15.55:0/2341682861 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625073498 0 0) 0x7ffaa015c8a0 con 0x7ffaa00cbe50 2023-07-06T21:55:13.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.014+0000 7ffa9effd640 1 -- 172.21.15.55:0/2341682861 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa88003530 con 0x7ffaa00cbe50 2023-07-06T21:55:13.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.014+0000 7ffa9effd640 1 -- 172.21.15.55:0/2341682861 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 585852567 0 0) 0x7ffa88003530 con 0x7ffaa00cbe50 2023-07-06T21:55:13.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.014+0000 7ffa9f7fe640 1 -- 172.21.15.55:0/2341682861 >> v1:172.21.15.138:6789/0 conn(0x7ffaa00cd900 legacy=0x7ffaa0158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.014+0000 7ffa9f7fe640 1 -- 172.21.15.55:0/2341682861 >> v1:172.21.15.55:6789/0 conn(0x7ffaa00cbe50 legacy=0x7ffaa00c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.014+0000 7ffa9f7fe640 1 -- 172.21.15.55:0/2341682861 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa015bc90 con 0x7ffaa00cd460 2023-07-06T21:55:13.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.018+0000 7ffa9f7fe640 1 --2- 172.21.15.55:0/2341682861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa00cd460 0x7ffaa0158720 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ffa940097c0 tx=0x7ffa9401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6e88ce23f5317b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:13.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.018+0000 7ffa9effd640 1 -- 172.21.15.55:0/2341682861 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90001680 con 0x7ffaa00cd460 2023-07-06T21:55:13.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.018+0000 7ffa9effd640 1 -- 172.21.15.55:0/2341682861 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa940a7050 con 0x7ffaa00cd460 2023-07-06T21:55:13.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.018+0000 7ffa9effd640 1 -- 172.21.15.55:0/2341682861 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa940ab620 con 0x7ffaa00cd460 2023-07-06T21:55:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.018+0000 7ffaa69fa640 1 -- 172.21.15.55:0/2341682861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa00cd460 msgr2=0x7ffaa0158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.018+0000 7ffaa69fa640 1 --2- 172.21.15.55:0/2341682861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa00cd460 0x7ffaa0158720 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ffa940097c0 tx=0x7ffa9401c370 comp rx=0 tx=0).stop 2023-07-06T21:55:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.018+0000 7ffaa69fa640 1 -- 172.21.15.55:0/2341682861 shutdown_connections 2023-07-06T21:55:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.018+0000 7ffaa69fa640 1 --2- 172.21.15.55:0/2341682861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa00cd460 0x7ffaa0158720 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.018+0000 7ffaa69fa640 1 -- 172.21.15.55:0/2341682861 >> 172.21.15.55:0/2341682861 conn(0x7ffaa00cded0 msgr2=0x7ffaa00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.018+0000 7ffaa69fa640 1 -- 172.21.15.55:0/2341682861 shutdown_connections 2023-07-06T21:55:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.018+0000 7ffaa69fa640 1 -- 172.21.15.55:0/2341682861 wait complete. 2023-07-06T21:55:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.018+0000 7ffaa69fa640 1 Processor -- start 2023-07-06T21:55:13.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa69fa640 1 -- start start 2023-07-06T21:55:13.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa69fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa00cbe50 0x7ffaa00b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa69fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffaa00cd460 0x7ffaa01635a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa69fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa00cd900 0x7ffaa0152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa69fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0163ae0 con 0x7ffaa00cd900 2023-07-06T21:55:13.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa69fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0152970 con 0x7ffaa00cbe50 2023-07-06T21:55:13.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa69fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa00b2df0 con 0x7ffaa00cd460 2023-07-06T21:55:13.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa4f97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa00cd900 0x7ffaa0152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa00cbe50 0x7ffaa00b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa4f97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa00cd900 0x7ffaa0152430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42776/0 (socket says 172.21.15.55:42776) 2023-07-06T21:55:13.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa4f97640 1 -- 172.21.15.55:0/281020301 learned_addr learned my addr 172.21.15.55:0/281020301 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:13.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffa9f7fe640 1 --2- 172.21.15.55:0/281020301 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffaa00cd460 0x7ffaa01635a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa4f97640 1 -- 172.21.15.55:0/281020301 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffaa00cd460 msgr2=0x7ffaa01635a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa4f97640 1 --2- 172.21.15.55:0/281020301 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffaa00cd460 0x7ffaa01635a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa4f97640 1 -- 172.21.15.55:0/281020301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa00cbe50 msgr2=0x7ffaa00b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa4f97640 1 --2- 172.21.15.55:0/281020301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa00cbe50 0x7ffaa00b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa4f97640 1 -- 172.21.15.55:0/281020301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa94009420 con 0x7ffaa00cd900 2023-07-06T21:55:13.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa4f97640 1 --2- 172.21.15.55:0/281020301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa00cd900 0x7ffaa0152430 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800c770 tx=0x7ffa9800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:13.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffa9cff9640 1 -- 172.21.15.55:0/281020301 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98003b80 con 0x7ffaa00cd900 2023-07-06T21:55:13.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffa9cff9640 1 -- 172.21.15.55:0/281020301 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa98003ce0 con 0x7ffaa00cd900 2023-07-06T21:55:13.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffa9cff9640 1 -- 172.21.15.55:0/281020301 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9800aa90 con 0x7ffaa00cd900 2023-07-06T21:55:13.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa69fa640 1 -- 172.21.15.55:0/281020301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa00b30d0 con 0x7ffaa00cd900 2023-07-06T21:55:13.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa69fa640 1 -- 172.21.15.55:0/281020301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa00b3690 con 0x7ffaa00cd900 2023-07-06T21:55:13.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.022+0000 7ffaa69fa640 1 -- 172.21.15.55:0/281020301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa0066d60 con 0x7ffaa00cd900 2023-07-06T21:55:13.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.026+0000 7ffa9cff9640 1 -- 172.21.15.55:0/281020301 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ffa9800abf0 con 0x7ffaa00cd900 2023-07-06T21:55:13.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.026+0000 7ffa9cff9640 1 --2- 172.21.15.55:0/281020301 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ffa8c0663a0 0x7ffa8c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.026+0000 7ffa9cff9640 1 -- 172.21.15.55:0/281020301 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ffa98083da0 con 0x7ffaa00cd900 2023-07-06T21:55:13.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.026+0000 7ffa9ffff640 1 --2- 172.21.15.55:0/281020301 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ffa8c0663a0 0x7ffa8c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.026+0000 7ffa9ffff640 1 --2- 172.21.15.55:0/281020301 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ffa8c0663a0 0x7ffa8c068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa90000f70 tx=0x7ffa90001d70 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:13.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.030+0000 7ffa9cff9640 1 -- 172.21.15.55:0/281020301 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa98050fe0 con 0x7ffaa00cd900 2023-07-06T21:55:13.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.182+0000 7ffaa69fa640 1 -- 172.21.15.55:0/281020301 --> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffaa015c530 con 0x7ffa8c0663a0 2023-07-06T21:55:13.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.190+0000 7ffa9cff9640 1 -- 172.21.15.55:0/281020301 <== mgr.6102 v2:172.21.15.55:6832/3843972996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311627 (secure 0 0 0) 0x7ffa9000f8e0 con 0x7ffa8c0663a0 2023-07-06T21:55:13.195 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:13.196 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:55:13.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.194+0000 7ffaa69fa640 1 -- 172.21.15.55:0/281020301 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ffa8c0663a0 msgr2=0x7ffa8c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.194+0000 7ffaa69fa640 1 --2- 172.21.15.55:0/281020301 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ffa8c0663a0 0x7ffa8c068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa90000f70 tx=0x7ffa90001d70 comp rx=0 tx=0).stop 2023-07-06T21:55:13.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.194+0000 7ffaa69fa640 1 -- 172.21.15.55:0/281020301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa00cd900 msgr2=0x7ffaa0152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.194+0000 7ffaa69fa640 1 --2- 172.21.15.55:0/281020301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa00cd900 0x7ffaa0152430 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800c770 tx=0x7ffa9800cc30 comp rx=0 tx=0).stop 2023-07-06T21:55:13.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.194+0000 7ffaa69fa640 1 -- 172.21.15.55:0/281020301 shutdown_connections 2023-07-06T21:55:13.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.194+0000 7ffaa69fa640 1 --2- 172.21.15.55:0/281020301 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7ffa8c0663a0 0x7ffa8c068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.194+0000 7ffaa69fa640 1 --2- 172.21.15.55:0/281020301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa00cd900 0x7ffaa0152430 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.194+0000 7ffaa69fa640 1 --2- 172.21.15.55:0/281020301 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffaa00cd460 0x7ffaa01635a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.194+0000 7ffaa69fa640 1 --2- 172.21.15.55:0/281020301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffaa00cbe50 0x7ffaa00b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.194+0000 7ffaa69fa640 1 -- 172.21.15.55:0/281020301 >> 172.21.15.55:0/281020301 conn(0x7ffaa00cded0 msgr2=0x7ffaa00ad890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:13.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.194+0000 7ffaa69fa640 1 -- 172.21.15.55:0/281020301 shutdown_connections 2023-07-06T21:55:13.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.194+0000 7ffaa69fa640 1 -- 172.21.15.55:0/281020301 wait complete. 2023-07-06T21:55:13.215 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-06T21:55:12.712704+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":244,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272832,"kb_used_data":8064,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754701888,"statfs":{"total":773094113280,"available":772814733312,"internally_reserved":0,"allocated":8257536,"data_stored":4821462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.513021"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204184+0000","last_change":"2023-07-06T21:55:04.220798+0000","last_active":"2023-07-06T21:55:05.204184+0000","last_peered":"2023-07-06T21:55:05.204184+0000","last_clean":"2023-07-06T21:55:05.204184+0000","last_became_active":"2023-07-06T21:55:04.220460+0000","last_became_peered":"2023-07-06T21:55:04.220460+0000","last_unstale":"2023-07-06T21:55:05.204184+0000","last_undegraded":"2023-07-06T21:55:05.204184+0000","last_fullsized":"2023-07-06T21:55:05.204184+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:28:57.801202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272938+0000","last_change":"2023-07-06T21:55:04.223711+0000","last_active":"2023-07-06T21:55:05.272938+0000","last_peered":"2023-07-06T21:55:05.272938+0000","last_clean":"2023-07-06T21:55:05.272938+0000","last_became_active":"2023-07-06T21:55:04.223401+0000","last_became_peered":"2023-07-06T21:55:04.223401+0000","last_unstale":"2023-07-06T21:55:05.272938+0000","last_undegraded":"2023-07-06T21:55:05.272938+0000","last_fullsized":"2023-07-06T21:55:05.272938+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:19:09.613634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202336+0000","last_change":"2023-07-06T21:55:04.234546+0000","last_active":"2023-07-06T21:55:05.202336+0000","last_peered":"2023-07-06T21:55:05.202336+0000","last_clean":"2023-07-06T21:55:05.202336+0000","last_became_active":"2023-07-06T21:55:04.233591+0000","last_became_peered":"2023-07-06T21:55:04.233591+0000","last_unstale":"2023-07-06T21:55:05.202336+0000","last_undegraded":"2023-07-06T21:55:05.202336+0000","last_fullsized":"2023-07-06T21:55:05.202336+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:50:07.029554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273054+0000","last_change":"2023-07-06T21:55:04.223345+0000","last_active":"2023-07-06T21:55:05.273054+0000","last_peered":"2023-07-06T21:55:05.273054+0000","last_clean":"2023-07-06T21:55:05.273054+0000","last_became_active":"2023-07-06T21:55:04.223026+0000","last_became_peered":"2023-07-06T21:55:04.223026+0000","last_unstale":"2023-07-06T21:55:05.273054+0000","last_undegraded":"2023-07-06T21:55:05.273054+0000","last_fullsized":"2023-07-06T21:55:05.273054+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:29:12.189483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.203950+0000","last_change":"2023-07-06T21:55:04.214162+0000","last_active":"2023-07-06T21:55:05.203950+0000","last_peered":"2023-07-06T21:55:05.203950+0000","last_clean":"2023-07-06T21:55:05.203950+0000","last_became_active":"2023-07-06T21:55:04.213893+0000","last_became_peered":"2023-07-06T21:55:04.213893+0000","last_unstale":"2023-07-06T21:55:05.203950+0000","last_undegraded":"2023-07-06T21:55:05.203950+0000","last_fullsized":"2023-07-06T21:55:05.203950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:13:17.606501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273735+0000","last_change":"2023-07-06T21:55:04.230365+0000","last_active":"2023-07-06T21:55:05.273735+0000","last_peered":"2023-07-06T21:55:05.273735+0000","last_clean":"2023-07-06T21:55:05.273735+0000","last_became_active":"2023-07-06T21:55:04.227667+0000","last_became_peered":"2023-07-06T21:55:04.227667+0000","last_unstale":"2023-07-06T21:55:05.273735+0000","last_undegraded":"2023-07-06T21:55:05.273735+0000","last_fullsized":"2023-07-06T21:55:05.273735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:41:12.845036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272846+0000","last_change":"2023-07-06T21:55:04.216761+0000","last_active":"2023-07-06T21:55:05.272846+0000","last_peered":"2023-07-06T21:55:05.272846+0000","last_clean":"2023-07-06T21:55:05.272846+0000","last_became_active":"2023-07-06T21:55:04.216484+0000","last_became_peered":"2023-07-06T21:55:04.216484+0000","last_unstale":"2023-07-06T21:55:05.272846+0000","last_undegraded":"2023-07-06T21:55:05.272846+0000","last_fullsized":"2023-07-06T21:55:05.272846+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:54:17.807393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272298+0000","last_change":"2023-07-06T21:55:04.224324+0000","last_active":"2023-07-06T21:55:05.272298+0000","last_peered":"2023-07-06T21:55:05.272298+0000","last_clean":"2023-07-06T21:55:05.272298+0000","last_became_active":"2023-07-06T21:55:04.224033+0000","last_became_peered":"2023-07-06T21:55:04.224033+0000","last_unstale":"2023-07-06T21:55:05.272298+0000","last_undegraded":"2023-07-06T21:55:05.272298+0000","last_fullsized":"2023-07-06T21:55:05.272298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:21:49.400060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272879+0000","last_change":"2023-07-06T21:55:04.230849+0000","last_active":"2023-07-06T21:55:05.272879+0000","last_peered":"2023-07-06T21:55:05.272879+0000","last_clean":"2023-07-06T21:55:05.272879+0000","last_became_active":"2023-07-06T21:55:04.230567+0000","last_became_peered":"2023-07-06T21:55:04.230567+0000","last_unstale":"2023-07-06T21:55:05.272879+0000","last_undegraded":"2023-07-06T21:55:05.272879+0000","last_fullsized":"2023-07-06T21:55:05.272879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:46:26.481303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273744+0000","last_change":"2023-07-06T21:55:04.218779+0000","last_active":"2023-07-06T21:55:05.273744+0000","last_peered":"2023-07-06T21:55:05.273744+0000","last_clean":"2023-07-06T21:55:05.273744+0000","last_became_active":"2023-07-06T21:55:04.218481+0000","last_became_peered":"2023-07-06T21:55:04.218481+0000","last_unstale":"2023-07-06T21:55:05.273744+0000","last_undegraded":"2023-07-06T21:55:05.273744+0000","last_fullsized":"2023-07-06T21:55:05.273744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:45:00.915257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272673+0000","last_change":"2023-07-06T21:55:04.223194+0000","last_active":"2023-07-06T21:55:05.272673+0000","last_peered":"2023-07-06T21:55:05.272673+0000","last_clean":"2023-07-06T21:55:05.272673+0000","last_became_active":"2023-07-06T21:55:04.220410+0000","last_became_peered":"2023-07-06T21:55:04.220410+0000","last_unstale":"2023-07-06T21:55:05.272673+0000","last_undegraded":"2023-07-06T21:55:05.272673+0000","last_fullsized":"2023-07-06T21:55:05.272673+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:41:35.576504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273086+0000","last_change":"2023-07-06T21:55:04.232101+0000","last_active":"2023-07-06T21:55:05.273086+0000","last_peered":"2023-07-06T21:55:05.273086+0000","last_clean":"2023-07-06T21:55:05.273086+0000","last_became_active":"2023-07-06T21:55:04.231724+0000","last_became_peered":"2023-07-06T21:55:04.231724+0000","last_unstale":"2023-07-06T21:55:05.273086+0000","last_undegraded":"2023-07-06T21:55:05.273086+0000","last_fullsized":"2023-07-06T21:55:05.273086+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:45:35.836056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201204+0000","last_change":"2023-07-06T21:55:04.225624+0000","last_active":"2023-07-06T21:55:05.201204+0000","last_peered":"2023-07-06T21:55:05.201204+0000","last_clean":"2023-07-06T21:55:05.201204+0000","last_became_active":"2023-07-06T21:55:04.225297+0000","last_became_peered":"2023-07-06T21:55:04.225297+0000","last_unstale":"2023-07-06T21:55:05.201204+0000","last_undegraded":"2023-07-06T21:55:05.201204+0000","last_fullsized":"2023-07-06T21:55:05.201204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:40:51.418030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272225+0000","last_change":"2023-07-06T21:55:04.217483+0000","last_active":"2023-07-06T21:55:05.272225+0000","last_peered":"2023-07-06T21:55:05.272225+0000","last_clean":"2023-07-06T21:55:05.272225+0000","last_became_active":"2023-07-06T21:55:04.217080+0000","last_became_peered":"2023-07-06T21:55:04.217080+0000","last_unstale":"2023-07-06T21:55:05.272225+0000","last_undegraded":"2023-07-06T21:55:05.272225+0000","last_fullsized":"2023-07-06T21:55:05.272225+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:49:47.997199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272218+0000","last_change":"2023-07-06T21:55:04.220785+0000","last_active":"2023-07-06T21:55:05.272218+0000","last_peered":"2023-07-06T21:55:05.272218+0000","last_clean":"2023-07-06T21:55:05.272218+0000","last_became_active":"2023-07-06T21:55:04.220519+0000","last_became_peered":"2023-07-06T21:55:04.220519+0000","last_unstale":"2023-07-06T21:55:05.272218+0000","last_undegraded":"2023-07-06T21:55:05.272218+0000","last_fullsized":"2023-07-06T21:55:05.272218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:09:50.758130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273524+0000","last_change":"2023-07-06T21:55:04.230413+0000","last_active":"2023-07-06T21:55:05.273524+0000","last_peered":"2023-07-06T21:55:05.273524+0000","last_clean":"2023-07-06T21:55:05.273524+0000","last_became_active":"2023-07-06T21:55:04.230108+0000","last_became_peered":"2023-07-06T21:55:04.230108+0000","last_unstale":"2023-07-06T21:55:05.273524+0000","last_undegraded":"2023-07-06T21:55:05.273524+0000","last_fullsized":"2023-07-06T21:55:05.273524+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:54:37.625243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272874+0000","last_change":"2023-07-06T21:55:04.219597+0000","last_active":"2023-07-06T21:55:05.272874+0000","last_peered":"2023-07-06T21:55:05.272874+0000","last_clean":"2023-07-06T21:55:05.272874+0000","last_became_active":"2023-07-06T21:55:04.219310+0000","last_became_peered":"2023-07-06T21:55:04.219310+0000","last_unstale":"2023-07-06T21:55:05.272874+0000","last_undegraded":"2023-07-06T21:55:05.272874+0000","last_fullsized":"2023-07-06T21:55:05.272874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:15:59.948076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202573+0000","last_change":"2023-07-06T21:55:04.232165+0000","last_active":"2023-07-06T21:55:05.202573+0000","last_peered":"2023-07-06T21:55:05.202573+0000","last_clean":"2023-07-06T21:55:05.202573+0000","last_became_active":"2023-07-06T21:55:04.231440+0000","last_became_peered":"2023-07-06T21:55:04.231440+0000","last_unstale":"2023-07-06T21:55:05.202573+0000","last_undegraded":"2023-07-06T21:55:05.202573+0000","last_fullsized":"2023-07-06T21:55:05.202573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:29:00.009924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204147+0000","last_change":"2023-07-06T21:55:04.215150+0000","last_active":"2023-07-06T21:55:05.204147+0000","last_peered":"2023-07-06T21:55:05.204147+0000","last_clean":"2023-07-06T21:55:05.204147+0000","last_became_active":"2023-07-06T21:55:04.214900+0000","last_became_peered":"2023-07-06T21:55:04.214900+0000","last_unstale":"2023-07-06T21:55:05.204147+0000","last_undegraded":"2023-07-06T21:55:05.204147+0000","last_fullsized":"2023-07-06T21:55:05.204147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:10:03.683617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272783+0000","last_change":"2023-07-06T21:55:04.225692+0000","last_active":"2023-07-06T21:55:05.272783+0000","last_peered":"2023-07-06T21:55:05.272783+0000","last_clean":"2023-07-06T21:55:05.272783+0000","last_became_active":"2023-07-06T21:55:04.225387+0000","last_became_peered":"2023-07-06T21:55:04.225387+0000","last_unstale":"2023-07-06T21:55:05.272783+0000","last_undegraded":"2023-07-06T21:55:05.272783+0000","last_fullsized":"2023-07-06T21:55:05.272783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:24:25.395365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202005+0000","last_change":"2023-07-06T21:55:04.234651+0000","last_active":"2023-07-06T21:55:05.202005+0000","last_peered":"2023-07-06T21:55:05.202005+0000","last_clean":"2023-07-06T21:55:05.202005+0000","last_became_active":"2023-07-06T21:55:04.232750+0000","last_became_peered":"2023-07-06T21:55:04.232750+0000","last_unstale":"2023-07-06T21:55:05.202005+0000","last_undegraded":"2023-07-06T21:55:05.202005+0000","last_fullsized":"2023-07-06T21:55:05.202005+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:11:31.728348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272303+0000","last_change":"2023-07-06T21:55:04.223035+0000","last_active":"2023-07-06T21:55:05.272303+0000","last_peered":"2023-07-06T21:55:05.272303+0000","last_clean":"2023-07-06T21:55:05.272303+0000","last_became_active":"2023-07-06T21:55:04.222702+0000","last_became_peered":"2023-07-06T21:55:04.222702+0000","last_unstale":"2023-07-06T21:55:05.272303+0000","last_undegraded":"2023-07-06T21:55:05.272303+0000","last_fullsized":"2023-07-06T21:55:05.272303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:16:16.938720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201778+0000","last_change":"2023-07-06T21:55:04.228903+0000","last_active":"2023-07-06T21:55:05.201778+0000","last_peered":"2023-07-06T21:55:05.201778+0000","last_clean":"2023-07-06T21:55:05.201778+0000","last_became_active":"2023-07-06T21:55:04.228526+0000","last_became_peered":"2023-07-06T21:55:04.228526+0000","last_unstale":"2023-07-06T21:55:05.201778+0000","last_undegraded":"2023-07-06T21:55:05.201778+0000","last_fullsized":"2023-07-06T21:55:05.201778+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:56:18.324736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201014+0000","last_change":"2023-07-06T21:55:04.230641+0000","last_active":"2023-07-06T21:55:05.201014+0000","last_peered":"2023-07-06T21:55:05.201014+0000","last_clean":"2023-07-06T21:55:05.201014+0000","last_became_active":"2023-07-06T21:55:04.230163+0000","last_became_peered":"2023-07-06T21:55:04.230163+0000","last_unstale":"2023-07-06T21:55:05.201014+0000","last_undegraded":"2023-07-06T21:55:05.201014+0000","last_fullsized":"2023-07-06T21:55:05.201014+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:07:26.851153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204239+0000","last_change":"2023-07-06T21:55:04.221375+0000","last_active":"2023-07-06T21:55:05.204239+0000","last_peered":"2023-07-06T21:55:05.204239+0000","last_clean":"2023-07-06T21:55:05.204239+0000","last_became_active":"2023-07-06T21:55:04.220870+0000","last_became_peered":"2023-07-06T21:55:04.220870+0000","last_unstale":"2023-07-06T21:55:05.204239+0000","last_undegraded":"2023-07-06T21:55:05.204239+0000","last_fullsized":"2023-07-06T21:55:05.204239+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:08:03.218641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272825+0000","last_change":"2023-07-06T21:55:04.216751+0000","last_active":"2023-07-06T21:55:05.272825+0000","last_peered":"2023-07-06T21:55:05.272825+0000","last_clean":"2023-07-06T21:55:05.272825+0000","last_became_active":"2023-07-06T21:55:04.216466+0000","last_became_peered":"2023-07-06T21:55:04.216466+0000","last_unstale":"2023-07-06T21:55:05.272825+0000","last_undegraded":"2023-07-06T21:55:05.272825+0000","last_fullsized":"2023-07-06T21:55:05.272825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:20:40.333468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274432+0000","last_change":"2023-07-06T21:55:04.231152+0000","last_active":"2023-07-06T21:55:05.274432+0000","last_peered":"2023-07-06T21:55:05.274432+0000","last_clean":"2023-07-06T21:55:05.274432+0000","last_became_active":"2023-07-06T21:55:04.230811+0000","last_became_peered":"2023-07-06T21:55:04.230811+0000","last_unstale":"2023-07-06T21:55:05.274432+0000","last_undegraded":"2023-07-06T21:55:05.274432+0000","last_fullsized":"2023-07-06T21:55:05.274432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:31:12.550831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204083+0000","last_change":"2023-07-06T21:55:04.224726+0000","last_active":"2023-07-06T21:55:05.204083+0000","last_peered":"2023-07-06T21:55:05.204083+0000","last_clean":"2023-07-06T21:55:05.204083+0000","last_became_active":"2023-07-06T21:55:04.224352+0000","last_became_peered":"2023-07-06T21:55:04.224352+0000","last_unstale":"2023-07-06T21:55:05.204083+0000","last_undegraded":"2023-07-06T21:55:05.204083+0000","last_fullsized":"2023-07-06T21:55:05.204083+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:21:12.731301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272592+0000","last_change":"2023-07-06T21:55:04.219660+0000","last_active":"2023-07-06T21:55:05.272592+0000","last_peered":"2023-07-06T21:55:05.272592+0000","last_clean":"2023-07-06T21:55:05.272592+0000","last_became_active":"2023-07-06T21:55:04.219369+0000","last_became_peered":"2023-07-06T21:55:04.219369+0000","last_unstale":"2023-07-06T21:55:05.272592+0000","last_undegraded":"2023-07-06T21:55:05.272592+0000","last_fullsized":"2023-07-06T21:55:05.272592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:43.630523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202018+0000","last_change":"2023-07-06T21:55:04.226099+0000","last_active":"2023-07-06T21:55:05.202018+0000","last_peered":"2023-07-06T21:55:05.202018+0000","last_clean":"2023-07-06T21:55:05.202018+0000","last_became_active":"2023-07-06T21:55:04.225820+0000","last_became_peered":"2023-07-06T21:55:04.225820+0000","last_unstale":"2023-07-06T21:55:05.202018+0000","last_undegraded":"2023-07-06T21:55:05.202018+0000","last_fullsized":"2023-07-06T21:55:05.202018+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:23:17.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.203887+0000","last_change":"2023-07-06T21:55:04.221087+0000","last_active":"2023-07-06T21:55:05.203887+0000","last_peered":"2023-07-06T21:55:05.203887+0000","last_clean":"2023-07-06T21:55:05.203887+0000","last_became_active":"2023-07-06T21:55:04.220800+0000","last_became_peered":"2023-07-06T21:55:04.220800+0000","last_unstale":"2023-07-06T21:55:05.203887+0000","last_undegraded":"2023-07-06T21:55:05.203887+0000","last_fullsized":"2023-07-06T21:55:05.203887+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:31.101197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273658+0000","last_change":"2023-07-06T21:55:04.233759+0000","last_active":"2023-07-06T21:55:05.273658+0000","last_peered":"2023-07-06T21:55:05.273658+0000","last_clean":"2023-07-06T21:55:05.273658+0000","last_became_active":"2023-07-06T21:55:04.233493+0000","last_became_peered":"2023-07-06T21:55:04.233493+0000","last_unstale":"2023-07-06T21:55:05.273658+0000","last_undegraded":"2023-07-06T21:55:05.273658+0000","last_fullsized":"2023-07-06T21:55:05.273658+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:28:32.886511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274173+0000","last_change":"2023-07-06T21:55:04.234548+0000","last_active":"2023-07-06T21:55:05.274173+0000","last_peered":"2023-07-06T21:55:05.274173+0000","last_clean":"2023-07-06T21:55:05.274173+0000","last_became_active":"2023-07-06T21:55:04.234277+0000","last_became_peered":"2023-07-06T21:55:04.234277+0000","last_unstale":"2023-07-06T21:55:05.274173+0000","last_undegraded":"2023-07-06T21:55:05.274173+0000","last_fullsized":"2023-07-06T21:55:05.274173+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:50:17.824151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"72'4","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274276+0000","last_change":"2023-07-06T21:55:03.812090+0000","last_active":"2023-07-06T21:55:05.274276+0000","last_peered":"2023-07-06T21:55:05.274276+0000","last_clean":"2023-07-06T21:55:05.274276+0000","last_became_active":"2023-07-06T21:55:03.811583+0000","last_became_peered":"2023-07-06T21:55:03.811583+0000","last_unstale":"2023-07-06T21:55:05.274276+0000","last_undegraded":"2023-07-06T21:55:05.274276+0000","last_fullsized":"2023-07-06T21:55:05.274276+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:32:35.703514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273599+0000","last_change":"2023-07-06T21:55:04.227368+0000","last_active":"2023-07-06T21:55:05.273599+0000","last_peered":"2023-07-06T21:55:05.273599+0000","last_clean":"2023-07-06T21:55:05.273599+0000","last_became_active":"2023-07-06T21:55:04.227065+0000","last_became_peered":"2023-07-06T21:55:04.227065+0000","last_unstale":"2023-07-06T21:55:05.273599+0000","last_undegraded":"2023-07-06T21:55:05.273599+0000","last_fullsized":"2023-07-06T21:55:05.273599+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:45:52.806377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273077+0000","last_change":"2023-07-06T21:55:03.804948+0000","last_active":"2023-07-06T21:55:05.273077+0000","last_peered":"2023-07-06T21:55:05.273077+0000","last_clean":"2023-07-06T21:55:05.273077+0000","last_became_active":"2023-07-06T21:55:03.804521+0000","last_became_peered":"2023-07-06T21:55:03.804521+0000","last_unstale":"2023-07-06T21:55:05.273077+0000","last_undegraded":"2023-07-06T21:55:05.273077+0000","last_fullsized":"2023-07-06T21:55:05.273077+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:41:37.991036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273962+0000","last_change":"2023-07-06T21:55:04.231223+0000","last_active":"2023-07-06T21:55:05.273962+0000","last_peered":"2023-07-06T21:55:05.273962+0000","last_clean":"2023-07-06T21:55:05.273962+0000","last_became_active":"2023-07-06T21:55:04.230950+0000","last_became_peered":"2023-07-06T21:55:04.230950+0000","last_unstale":"2023-07-06T21:55:05.273962+0000","last_undegraded":"2023-07-06T21:55:05.273962+0000","last_fullsized":"2023-07-06T21:55:05.273962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:25:49.579529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274559+0000","last_change":"2023-07-06T21:55:03.809667+0000","last_active":"2023-07-06T21:55:05.274559+0000","last_peered":"2023-07-06T21:55:05.274559+0000","last_clean":"2023-07-06T21:55:05.274559+0000","last_became_active":"2023-07-06T21:55:03.809442+0000","last_became_peered":"2023-07-06T21:55:03.809442+0000","last_unstale":"2023-07-06T21:55:05.274559+0000","last_undegraded":"2023-07-06T21:55:05.274559+0000","last_fullsized":"2023-07-06T21:55:05.274559+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:58:47.562937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274525+0000","last_change":"2023-07-06T21:55:04.233876+0000","last_active":"2023-07-06T21:55:05.274525+0000","last_peered":"2023-07-06T21:55:05.274525+0000","last_clean":"2023-07-06T21:55:05.274525+0000","last_became_active":"2023-07-06T21:55:04.233103+0000","last_became_peered":"2023-07-06T21:55:04.233103+0000","last_unstale":"2023-07-06T21:55:05.274525+0000","last_undegraded":"2023-07-06T21:55:05.274525+0000","last_fullsized":"2023-07-06T21:55:05.274525+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:50:21.140101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273221+0000","last_change":"2023-07-06T21:55:03.812044+0000","last_active":"2023-07-06T21:55:05.273221+0000","last_peered":"2023-07-06T21:55:05.273221+0000","last_clean":"2023-07-06T21:55:05.273221+0000","last_became_active":"2023-07-06T21:55:03.811771+0000","last_became_peered":"2023-07-06T21:55:03.811771+0000","last_unstale":"2023-07-06T21:55:05.273221+0000","last_undegraded":"2023-07-06T21:55:05.273221+0000","last_fullsized":"2023-07-06T21:55:05.273221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:12:50.277341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272434+0000","last_change":"2023-07-06T21:55:04.216166+0000","last_active":"2023-07-06T21:55:05.272434+0000","last_peered":"2023-07-06T21:55:05.272434+0000","last_clean":"2023-07-06T21:55:05.272434+0000","last_became_active":"2023-07-06T21:55:04.215825+0000","last_became_peered":"2023-07-06T21:55:04.215825+0000","last_unstale":"2023-07-06T21:55:05.272434+0000","last_undegraded":"2023-07-06T21:55:05.272434+0000","last_fullsized":"2023-07-06T21:55:05.272434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:28:16.698506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272572+0000","last_change":"2023-07-06T21:55:03.792388+0000","last_active":"2023-07-06T21:55:05.272572+0000","last_peered":"2023-07-06T21:55:05.272572+0000","last_clean":"2023-07-06T21:55:05.272572+0000","last_became_active":"2023-07-06T21:55:03.792043+0000","last_became_peered":"2023-07-06T21:55:03.792043+0000","last_unstale":"2023-07-06T21:55:05.272572+0000","last_undegraded":"2023-07-06T21:55:05.272572+0000","last_fullsized":"2023-07-06T21:55:05.272572+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:17:32.156313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272318+0000","last_change":"2023-07-06T21:55:04.225727+0000","last_active":"2023-07-06T21:55:05.272318+0000","last_peered":"2023-07-06T21:55:05.272318+0000","last_clean":"2023-07-06T21:55:05.272318+0000","last_became_active":"2023-07-06T21:55:04.225337+0000","last_became_peered":"2023-07-06T21:55:04.225337+0000","last_unstale":"2023-07-06T21:55:05.272318+0000","last_undegraded":"2023-07-06T21:55:05.272318+0000","last_fullsized":"2023-07-06T21:55:05.272318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:27:40.686809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274335+0000","last_change":"2023-07-06T21:55:03.807494+0000","last_active":"2023-07-06T21:55:05.274335+0000","last_peered":"2023-07-06T21:55:05.274335+0000","last_clean":"2023-07-06T21:55:05.274335+0000","last_became_active":"2023-07-06T21:55:03.807187+0000","last_became_peered":"2023-07-06T21:55:03.807187+0000","last_unstale":"2023-07-06T21:55:05.274335+0000","last_undegraded":"2023-07-06T21:55:05.274335+0000","last_fullsized":"2023-07-06T21:55:05.274335+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:55:16.881750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201079+0000","last_change":"2023-07-06T21:55:04.226482+0000","last_active":"2023-07-06T21:55:05.201079+0000","last_peered":"2023-07-06T21:55:05.201079+0000","last_clean":"2023-07-06T21:55:05.201079+0000","last_became_active":"2023-07-06T21:55:04.226134+0000","last_became_peered":"2023-07-06T21:55:04.226134+0000","last_unstale":"2023-07-06T21:55:05.201079+0000","last_undegraded":"2023-07-06T21:55:05.201079+0000","last_fullsized":"2023-07-06T21:55:05.201079+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:41:18.683234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272393+0000","last_change":"2023-07-06T21:55:03.799988+0000","last_active":"2023-07-06T21:55:05.272393+0000","last_peered":"2023-07-06T21:55:05.272393+0000","last_clean":"2023-07-06T21:55:05.272393+0000","last_became_active":"2023-07-06T21:55:03.799579+0000","last_became_peered":"2023-07-06T21:55:03.799579+0000","last_unstale":"2023-07-06T21:55:05.272393+0000","last_undegraded":"2023-07-06T21:55:05.272393+0000","last_fullsized":"2023-07-06T21:55:05.272393+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:54:50.788128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272739+0000","last_change":"2023-07-06T21:55:04.219704+0000","last_active":"2023-07-06T21:55:05.272739+0000","last_peered":"2023-07-06T21:55:05.272739+0000","last_clean":"2023-07-06T21:55:05.272739+0000","last_became_active":"2023-07-06T21:55:04.219356+0000","last_became_peered":"2023-07-06T21:55:04.219356+0000","last_unstale":"2023-07-06T21:55:05.272739+0000","last_undegraded":"2023-07-06T21:55:05.272739+0000","last_fullsized":"2023-07-06T21:55:05.272739+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:01:12.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272996+0000","last_change":"2023-07-06T21:55:03.807065+0000","last_active":"2023-07-06T21:55:05.272996+0000","last_peered":"2023-07-06T21:55:05.272996+0000","last_clean":"2023-07-06T21:55:05.272996+0000","last_became_active":"2023-07-06T21:55:03.806743+0000","last_became_peered":"2023-07-06T21:55:03.806743+0000","last_unstale":"2023-07-06T21:55:05.272996+0000","last_undegraded":"2023-07-06T21:55:05.272996+0000","last_fullsized":"2023-07-06T21:55:05.272996+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:59:00.624031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272542+0000","last_change":"2023-07-06T21:55:04.222148+0000","last_active":"2023-07-06T21:55:05.272542+0000","last_peered":"2023-07-06T21:55:05.272542+0000","last_clean":"2023-07-06T21:55:05.272542+0000","last_became_active":"2023-07-06T21:55:04.221861+0000","last_became_peered":"2023-07-06T21:55:04.221861+0000","last_unstale":"2023-07-06T21:55:05.272542+0000","last_undegraded":"2023-07-06T21:55:05.272542+0000","last_fullsized":"2023-07-06T21:55:05.272542+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:32:10.274300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202564+0000","last_change":"2023-07-06T21:55:03.807178+0000","last_active":"2023-07-06T21:55:05.202564+0000","last_peered":"2023-07-06T21:55:05.202564+0000","last_clean":"2023-07-06T21:55:05.202564+0000","last_became_active":"2023-07-06T21:55:03.806882+0000","last_became_peered":"2023-07-06T21:55:03.806882+0000","last_unstale":"2023-07-06T21:55:05.202564+0000","last_undegraded":"2023-07-06T21:55:05.202564+0000","last_fullsized":"2023-07-06T21:55:05.202564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:49:35.090189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202537+0000","last_change":"2023-07-06T21:55:04.231055+0000","last_active":"2023-07-06T21:55:05.202537+0000","last_peered":"2023-07-06T21:55:05.202537+0000","last_clean":"2023-07-06T21:55:05.202537+0000","last_became_active":"2023-07-06T21:55:04.230743+0000","last_became_peered":"2023-07-06T21:55:04.230743+0000","last_unstale":"2023-07-06T21:55:05.202537+0000","last_undegraded":"2023-07-06T21:55:05.202537+0000","last_fullsized":"2023-07-06T21:55:05.202537+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:16:23.178280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273072+0000","last_change":"2023-07-06T21:55:03.808339+0000","last_active":"2023-07-06T21:55:05.273072+0000","last_peered":"2023-07-06T21:55:05.273072+0000","last_clean":"2023-07-06T21:55:05.273072+0000","last_became_active":"2023-07-06T21:55:03.808030+0000","last_became_peered":"2023-07-06T21:55:03.808030+0000","last_unstale":"2023-07-06T21:55:05.273072+0000","last_undegraded":"2023-07-06T21:55:05.273072+0000","last_fullsized":"2023-07-06T21:55:05.273072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:53:05.435779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273176+0000","last_change":"2023-07-06T21:55:04.221150+0000","last_active":"2023-07-06T21:55:05.273176+0000","last_peered":"2023-07-06T21:55:05.273176+0000","last_clean":"2023-07-06T21:55:05.273176+0000","last_became_active":"2023-07-06T21:55:04.220753+0000","last_became_peered":"2023-07-06T21:55:04.220753+0000","last_unstale":"2023-07-06T21:55:05.273176+0000","last_undegraded":"2023-07-06T21:55:05.273176+0000","last_fullsized":"2023-07-06T21:55:05.273176+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:14:13.107759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"72'3","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202593+0000","last_change":"2023-07-06T21:55:03.807957+0000","last_active":"2023-07-06T21:55:05.202593+0000","last_peered":"2023-07-06T21:55:05.202593+0000","last_clean":"2023-07-06T21:55:05.202593+0000","last_became_active":"2023-07-06T21:55:03.807448+0000","last_became_peered":"2023-07-06T21:55:03.807448+0000","last_unstale":"2023-07-06T21:55:05.202593+0000","last_undegraded":"2023-07-06T21:55:05.202593+0000","last_fullsized":"2023-07-06T21:55:05.202593+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:11:44.003544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202388+0000","last_change":"2023-07-06T21:55:04.234744+0000","last_active":"2023-07-06T21:55:05.202388+0000","last_peered":"2023-07-06T21:55:05.202388+0000","last_clean":"2023-07-06T21:55:05.202388+0000","last_became_active":"2023-07-06T21:55:04.233910+0000","last_became_peered":"2023-07-06T21:55:04.233910+0000","last_unstale":"2023-07-06T21:55:05.202388+0000","last_undegraded":"2023-07-06T21:55:05.202388+0000","last_fullsized":"2023-07-06T21:55:05.202388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:22:39.798722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"72'6","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272837+0000","last_change":"2023-07-06T21:55:03.807413+0000","last_active":"2023-07-06T21:55:05.272837+0000","last_peered":"2023-07-06T21:55:05.272837+0000","last_clean":"2023-07-06T21:55:05.272837+0000","last_became_active":"2023-07-06T21:55:03.807053+0000","last_became_peered":"2023-07-06T21:55:03.807053+0000","last_unstale":"2023-07-06T21:55:05.272837+0000","last_undegraded":"2023-07-06T21:55:05.272837+0000","last_fullsized":"2023-07-06T21:55:05.272837+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:47.778643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272416+0000","last_change":"2023-07-06T21:55:04.224174+0000","last_active":"2023-07-06T21:55:05.272416+0000","last_peered":"2023-07-06T21:55:05.272416+0000","last_clean":"2023-07-06T21:55:05.272416+0000","last_became_active":"2023-07-06T21:55:04.223406+0000","last_became_peered":"2023-07-06T21:55:04.223406+0000","last_unstale":"2023-07-06T21:55:05.272416+0000","last_undegraded":"2023-07-06T21:55:05.272416+0000","last_fullsized":"2023-07-06T21:55:05.272416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:56:11.929414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272454+0000","last_change":"2023-07-06T21:55:03.811485+0000","last_active":"2023-07-06T21:55:05.272454+0000","last_peered":"2023-07-06T21:55:05.272454+0000","last_clean":"2023-07-06T21:55:05.272454+0000","last_became_active":"2023-07-06T21:55:03.811212+0000","last_became_peered":"2023-07-06T21:55:03.811212+0000","last_unstale":"2023-07-06T21:55:05.272454+0000","last_undegraded":"2023-07-06T21:55:05.272454+0000","last_fullsized":"2023-07-06T21:55:05.272454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:11:31.075853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202140+0000","last_change":"2023-07-06T21:55:04.225159+0000","last_active":"2023-07-06T21:55:05.202140+0000","last_peered":"2023-07-06T21:55:05.202140+0000","last_clean":"2023-07-06T21:55:05.202140+0000","last_became_active":"2023-07-06T21:55:04.224843+0000","last_became_peered":"2023-07-06T21:55:04.224843+0000","last_unstale":"2023-07-06T21:55:05.202140+0000","last_undegraded":"2023-07-06T21:55:05.202140+0000","last_fullsized":"2023-07-06T21:55:05.202140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:53:39.618561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201252+0000","last_change":"2023-07-06T21:55:03.805066+0000","last_active":"2023-07-06T21:55:05.201252+0000","last_peered":"2023-07-06T21:55:05.201252+0000","last_clean":"2023-07-06T21:55:05.201252+0000","last_became_active":"2023-07-06T21:55:03.804751+0000","last_became_peered":"2023-07-06T21:55:03.804751+0000","last_unstale":"2023-07-06T21:55:05.201252+0000","last_undegraded":"2023-07-06T21:55:05.201252+0000","last_fullsized":"2023-07-06T21:55:05.201252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:51:12.819787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272942+0000","last_change":"2023-07-06T21:55:04.227420+0000","last_active":"2023-07-06T21:55:05.272942+0000","last_peered":"2023-07-06T21:55:05.272942+0000","last_clean":"2023-07-06T21:55:05.272942+0000","last_became_active":"2023-07-06T21:55:04.227085+0000","last_became_peered":"2023-07-06T21:55:04.227085+0000","last_unstale":"2023-07-06T21:55:05.272942+0000","last_undegraded":"2023-07-06T21:55:05.272942+0000","last_fullsized":"2023-07-06T21:55:05.272942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:09:31.701550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272530+0000","last_change":"2023-07-06T21:55:03.803116+0000","last_active":"2023-07-06T21:55:05.272530+0000","last_peered":"2023-07-06T21:55:05.272530+0000","last_clean":"2023-07-06T21:55:05.272530+0000","last_became_active":"2023-07-06T21:55:03.802152+0000","last_became_peered":"2023-07-06T21:55:03.802152+0000","last_unstale":"2023-07-06T21:55:05.272530+0000","last_undegraded":"2023-07-06T21:55:05.272530+0000","last_fullsized":"2023-07-06T21:55:05.272530+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:37:39.062474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201774+0000","last_change":"2023-07-06T21:55:04.234452+0000","last_active":"2023-07-06T21:55:05.201774+0000","last_peered":"2023-07-06T21:55:05.201774+0000","last_clean":"2023-07-06T21:55:05.201774+0000","last_became_active":"2023-07-06T21:55:04.234074+0000","last_became_peered":"2023-07-06T21:55:04.234074+0000","last_unstale":"2023-07-06T21:55:05.201774+0000","last_undegraded":"2023-07-06T21:55:05.201774+0000","last_fullsized":"2023-07-06T21:55:05.201774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:31:33.634770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"72'8","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201508+0000","last_change":"2023-07-06T21:55:03.805724+0000","last_active":"2023-07-06T21:55:05.201508+0000","last_peered":"2023-07-06T21:55:05.201508+0000","last_clean":"2023-07-06T21:55:05.201508+0000","last_became_active":"2023-07-06T21:55:03.805440+0000","last_became_peered":"2023-07-06T21:55:03.805440+0000","last_unstale":"2023-07-06T21:55:05.201508+0000","last_undegraded":"2023-07-06T21:55:05.201508+0000","last_fullsized":"2023-07-06T21:55:05.201508+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:52:19.464262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272879+0000","last_change":"2023-07-06T21:55:04.220436+0000","last_active":"2023-07-06T21:55:05.272879+0000","last_peered":"2023-07-06T21:55:05.272879+0000","last_clean":"2023-07-06T21:55:05.272879+0000","last_became_active":"2023-07-06T21:55:04.220141+0000","last_became_peered":"2023-07-06T21:55:04.220141+0000","last_unstale":"2023-07-06T21:55:05.272879+0000","last_undegraded":"2023-07-06T21:55:05.272879+0000","last_fullsized":"2023-07-06T21:55:05.272879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:27:41.343194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273620+0000","last_change":"2023-07-06T21:55:03.810233+0000","last_active":"2023-07-06T21:55:05.273620+0000","last_peered":"2023-07-06T21:55:05.273620+0000","last_clean":"2023-07-06T21:55:05.273620+0000","last_became_active":"2023-07-06T21:55:03.809895+0000","last_became_peered":"2023-07-06T21:55:03.809895+0000","last_unstale":"2023-07-06T21:55:05.273620+0000","last_undegraded":"2023-07-06T21:55:05.273620+0000","last_fullsized":"2023-07-06T21:55:05.273620+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:27:33.769012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272975+0000","last_change":"2023-07-06T21:55:04.227295+0000","last_active":"2023-07-06T21:55:05.272975+0000","last_peered":"2023-07-06T21:55:05.272975+0000","last_clean":"2023-07-06T21:55:05.272975+0000","last_became_active":"2023-07-06T21:55:04.227037+0000","last_became_peered":"2023-07-06T21:55:04.227037+0000","last_unstale":"2023-07-06T21:55:05.272975+0000","last_undegraded":"2023-07-06T21:55:05.272975+0000","last_fullsized":"2023-07-06T21:55:05.272975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:52.681786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"73'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:07.711304+0000","last_change":"2023-07-06T21:55:03.806612+0000","last_active":"2023-07-06T21:55:07.711304+0000","last_peered":"2023-07-06T21:55:07.711304+0000","last_clean":"2023-07-06T21:55:07.711304+0000","last_became_active":"2023-07-06T21:55:03.806332+0000","last_became_peered":"2023-07-06T21:55:03.806332+0000","last_unstale":"2023-07-06T21:55:07.711304+0000","last_undegraded":"2023-07-06T21:55:07.711304+0000","last_fullsized":"2023-07-06T21:55:07.711304+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:06:44.765902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273343+0000","last_change":"2023-07-06T21:55:04.220772+0000","last_active":"2023-07-06T21:55:05.273343+0000","last_peered":"2023-07-06T21:55:05.273343+0000","last_clean":"2023-07-06T21:55:05.273343+0000","last_became_active":"2023-07-06T21:55:04.220461+0000","last_became_peered":"2023-07-06T21:55:04.220461+0000","last_unstale":"2023-07-06T21:55:05.273343+0000","last_undegraded":"2023-07-06T21:55:05.273343+0000","last_fullsized":"2023-07-06T21:55:05.273343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:21:05.967199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201308+0000","last_change":"2023-07-06T21:55:03.805049+0000","last_active":"2023-07-06T21:55:05.201308+0000","last_peered":"2023-07-06T21:55:05.201308+0000","last_clean":"2023-07-06T21:55:05.201308+0000","last_became_active":"2023-07-06T21:55:03.804698+0000","last_became_peered":"2023-07-06T21:55:03.804698+0000","last_unstale":"2023-07-06T21:55:05.201308+0000","last_undegraded":"2023-07-06T21:55:05.201308+0000","last_fullsized":"2023-07-06T21:55:05.201308+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:31:30.590376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274443+0000","last_change":"2023-07-06T21:55:04.234114+0000","last_active":"2023-07-06T21:55:05.274443+0000","last_peered":"2023-07-06T21:55:05.274443+0000","last_clean":"2023-07-06T21:55:05.274443+0000","last_became_active":"2023-07-06T21:55:04.233621+0000","last_became_peered":"2023-07-06T21:55:04.233621+0000","last_unstale":"2023-07-06T21:55:05.274443+0000","last_undegraded":"2023-07-06T21:55:05.274443+0000","last_fullsized":"2023-07-06T21:55:05.274443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:01:19.551788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273213+0000","last_change":"2023-07-06T21:55:03.803911+0000","last_active":"2023-07-06T21:55:05.273213+0000","last_peered":"2023-07-06T21:55:05.273213+0000","last_clean":"2023-07-06T21:55:05.273213+0000","last_became_active":"2023-07-06T21:55:03.803613+0000","last_became_peered":"2023-07-06T21:55:03.803613+0000","last_unstale":"2023-07-06T21:55:05.273213+0000","last_undegraded":"2023-07-06T21:55:05.273213+0000","last_fullsized":"2023-07-06T21:55:05.273213+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:14:49.214470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272567+0000","last_change":"2023-07-06T21:55:04.223535+0000","last_active":"2023-07-06T21:55:05.272567+0000","last_peered":"2023-07-06T21:55:05.272567+0000","last_clean":"2023-07-06T21:55:05.272567+0000","last_became_active":"2023-07-06T21:55:04.223287+0000","last_became_peered":"2023-07-06T21:55:04.223287+0000","last_unstale":"2023-07-06T21:55:05.272567+0000","last_undegraded":"2023-07-06T21:55:05.272567+0000","last_fullsized":"2023-07-06T21:55:05.272567+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:56:51.262527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273245+0000","last_change":"2023-07-06T21:55:03.804703+0000","last_active":"2023-07-06T21:55:05.273245+0000","last_peered":"2023-07-06T21:55:05.273245+0000","last_clean":"2023-07-06T21:55:05.273245+0000","last_became_active":"2023-07-06T21:55:03.804419+0000","last_became_peered":"2023-07-06T21:55:03.804419+0000","last_unstale":"2023-07-06T21:55:05.273245+0000","last_undegraded":"2023-07-06T21:55:05.273245+0000","last_fullsized":"2023-07-06T21:55:05.273245+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:23:20.788292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202204+0000","last_change":"2023-07-06T21:55:04.234917+0000","last_active":"2023-07-06T21:55:05.202204+0000","last_peered":"2023-07-06T21:55:05.202204+0000","last_clean":"2023-07-06T21:55:05.202204+0000","last_became_active":"2023-07-06T21:55:04.233565+0000","last_became_peered":"2023-07-06T21:55:04.233565+0000","last_unstale":"2023-07-06T21:55:05.202204+0000","last_undegraded":"2023-07-06T21:55:05.202204+0000","last_fullsized":"2023-07-06T21:55:05.202204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:37.557130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272356+0000","last_change":"2023-07-06T21:55:03.808191+0000","last_active":"2023-07-06T21:55:05.272356+0000","last_peered":"2023-07-06T21:55:05.272356+0000","last_clean":"2023-07-06T21:55:05.272356+0000","last_became_active":"2023-07-06T21:55:03.807881+0000","last_became_peered":"2023-07-06T21:55:03.807881+0000","last_unstale":"2023-07-06T21:55:05.272356+0000","last_undegraded":"2023-07-06T21:55:05.272356+0000","last_fullsized":"2023-07-06T21:55:05.272356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:21:47.438191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272752+0000","last_change":"2023-07-06T21:55:04.215271+0000","last_active":"2023-07-06T21:55:05.272752+0000","last_peered":"2023-07-06T21:55:05.272752+0000","last_clean":"2023-07-06T21:55:05.272752+0000","last_became_active":"2023-07-06T21:55:04.214987+0000","last_became_peered":"2023-07-06T21:55:04.214987+0000","last_unstale":"2023-07-06T21:55:05.272752+0000","last_undegraded":"2023-07-06T21:55:05.272752+0000","last_fullsized":"2023-07-06T21:55:05.272752+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:03:48.077161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273097+0000","last_change":"2023-07-06T21:55:03.808513+0000","last_active":"2023-07-06T21:55:05.273097+0000","last_peered":"2023-07-06T21:55:05.273097+0000","last_clean":"2023-07-06T21:55:05.273097+0000","last_became_active":"2023-07-06T21:55:03.808255+0000","last_became_peered":"2023-07-06T21:55:03.808255+0000","last_unstale":"2023-07-06T21:55:05.273097+0000","last_undegraded":"2023-07-06T21:55:05.273097+0000","last_fullsized":"2023-07-06T21:55:05.273097+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:56:51.473088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272614+0000","last_change":"2023-07-06T21:55:04.220280+0000","last_active":"2023-07-06T21:55:05.272614+0000","last_peered":"2023-07-06T21:55:05.272614+0000","last_clean":"2023-07-06T21:55:05.272614+0000","last_became_active":"2023-07-06T21:55:04.219967+0000","last_became_peered":"2023-07-06T21:55:04.219967+0000","last_unstale":"2023-07-06T21:55:05.272614+0000","last_undegraded":"2023-07-06T21:55:05.272614+0000","last_fullsized":"2023-07-06T21:55:05.272614+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:04:50.371503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272570+0000","last_change":"2023-07-06T21:55:03.809420+0000","last_active":"2023-07-06T21:55:05.272570+0000","last_peered":"2023-07-06T21:55:05.272570+0000","last_clean":"2023-07-06T21:55:05.272570+0000","last_became_active":"2023-07-06T21:55:03.809110+0000","last_became_peered":"2023-07-06T21:55:03.809110+0000","last_unstale":"2023-07-06T21:55:05.272570+0000","last_undegraded":"2023-07-06T21:55:05.272570+0000","last_fullsized":"2023-07-06T21:55:05.272570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:45:04.202987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272438+0000","last_change":"2023-07-06T21:55:04.229997+0000","last_active":"2023-07-06T21:55:05.272438+0000","last_peered":"2023-07-06T21:55:05.272438+0000","last_clean":"2023-07-06T21:55:05.272438+0000","last_became_active":"2023-07-06T21:55:04.229709+0000","last_became_peered":"2023-07-06T21:55:04.229709+0000","last_unstale":"2023-07-06T21:55:05.272438+0000","last_undegraded":"2023-07-06T21:55:05.272438+0000","last_fullsized":"2023-07-06T21:55:05.272438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:12:43.599490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201149+0000","last_change":"2023-07-06T21:55:03.810800+0000","last_active":"2023-07-06T21:55:05.201149+0000","last_peered":"2023-07-06T21:55:05.201149+0000","last_clean":"2023-07-06T21:55:05.201149+0000","last_became_active":"2023-07-06T21:55:03.810377+0000","last_became_peered":"2023-07-06T21:55:03.810377+0000","last_unstale":"2023-07-06T21:55:05.201149+0000","last_undegraded":"2023-07-06T21:55:05.201149+0000","last_fullsized":"2023-07-06T21:55:05.201149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:56:59.341675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"60'139","reported_seq":355,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201755+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:55:05.201755+0000","last_peered":"2023-07-06T21:55:05.201755+0000","last_clean":"2023-07-06T21:55:05.201755+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:55:05.201755+0000","last_undegraded":"2023-07-06T21:55:05.201755+0000","last_fullsized":"2023-07-06T21:55:05.201755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:55:24.093240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":111,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273243+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:55:05.273243+0000","last_peered":"2023-07-06T21:55:05.273243+0000","last_clean":"2023-07-06T21:55:05.273243+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:55:05.273243+0000","last_undegraded":"2023-07-06T21:55:05.273243+0000","last_fullsized":"2023-07-06T21:55:05.273243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:44:07.375135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273936+0000","last_change":"2023-07-06T21:55:04.224893+0000","last_active":"2023-07-06T21:55:05.273936+0000","last_peered":"2023-07-06T21:55:05.273936+0000","last_clean":"2023-07-06T21:55:05.273936+0000","last_became_active":"2023-07-06T21:55:04.224576+0000","last_became_peered":"2023-07-06T21:55:04.224576+0000","last_unstale":"2023-07-06T21:55:05.273936+0000","last_undegraded":"2023-07-06T21:55:05.273936+0000","last_fullsized":"2023-07-06T21:55:05.273936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:13:47.968292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273380+0000","last_change":"2023-07-06T21:55:03.797613+0000","last_active":"2023-07-06T21:55:05.273380+0000","last_peered":"2023-07-06T21:55:05.273380+0000","last_clean":"2023-07-06T21:55:05.273380+0000","last_became_active":"2023-07-06T21:55:03.797319+0000","last_became_peered":"2023-07-06T21:55:03.797319+0000","last_unstale":"2023-07-06T21:55:05.273380+0000","last_undegraded":"2023-07-06T21:55:05.273380+0000","last_fullsized":"2023-07-06T21:55:05.273380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:04:54.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201601+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:55:05.201601+0000","last_peered":"2023-07-06T21:55:05.201601+0000","last_clean":"2023-07-06T21:55:05.201601+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:55:05.201601+0000","last_undegraded":"2023-07-06T21:55:05.201601+0000","last_fullsized":"2023-07-06T21:55:05.201601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:20:02.309799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272572+0000","last_change":"2023-07-06T21:55:04.224373+0000","last_active":"2023-07-06T21:55:05.272572+0000","last_peered":"2023-07-06T21:55:05.272572+0000","last_clean":"2023-07-06T21:55:05.272572+0000","last_became_active":"2023-07-06T21:55:04.223861+0000","last_became_peered":"2023-07-06T21:55:04.223861+0000","last_unstale":"2023-07-06T21:55:05.272572+0000","last_undegraded":"2023-07-06T21:55:05.272572+0000","last_fullsized":"2023-07-06T21:55:05.272572+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:10:15.780966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272727+0000","last_change":"2023-07-06T21:55:03.805520+0000","last_active":"2023-07-06T21:55:05.272727+0000","last_peered":"2023-07-06T21:55:05.272727+0000","last_clean":"2023-07-06T21:55:05.272727+0000","last_became_active":"2023-07-06T21:55:03.805236+0000","last_became_peered":"2023-07-06T21:55:03.805236+0000","last_unstale":"2023-07-06T21:55:05.272727+0000","last_undegraded":"2023-07-06T21:55:05.272727+0000","last_fullsized":"2023-07-06T21:55:05.272727+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:05:58.180036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.204281+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:55:05.204281+0000","last_peered":"2023-07-06T21:55:05.204281+0000","last_clean":"2023-07-06T21:55:05.204281+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:55:05.204281+0000","last_undegraded":"2023-07-06T21:55:05.204281+0000","last_fullsized":"2023-07-06T21:55:05.204281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:24:43.577061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273528+0000","last_change":"2023-07-06T21:55:04.237089+0000","last_active":"2023-07-06T21:55:05.273528+0000","last_peered":"2023-07-06T21:55:05.273528+0000","last_clean":"2023-07-06T21:55:05.273528+0000","last_became_active":"2023-07-06T21:55:04.236799+0000","last_became_peered":"2023-07-06T21:55:04.236799+0000","last_unstale":"2023-07-06T21:55:05.273528+0000","last_undegraded":"2023-07-06T21:55:05.273528+0000","last_fullsized":"2023-07-06T21:55:05.273528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:51:46.035092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272424+0000","last_change":"2023-07-06T21:55:03.810224+0000","last_active":"2023-07-06T21:55:05.272424+0000","last_peered":"2023-07-06T21:55:05.272424+0000","last_clean":"2023-07-06T21:55:05.272424+0000","last_became_active":"2023-07-06T21:55:03.809937+0000","last_became_peered":"2023-07-06T21:55:03.809937+0000","last_unstale":"2023-07-06T21:55:05.272424+0000","last_undegraded":"2023-07-06T21:55:05.272424+0000","last_fullsized":"2023-07-06T21:55:05.272424+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:40:45.345972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272666+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:55:05.272666+0000","last_peered":"2023-07-06T21:55:05.272666+0000","last_clean":"2023-07-06T21:55:05.272666+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:55:05.272666+0000","last_undegraded":"2023-07-06T21:55:05.272666+0000","last_fullsized":"2023-07-06T21:55:05.272666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:50:51.643352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272816+0000","last_change":"2023-07-06T21:55:04.224761+0000","last_active":"2023-07-06T21:55:05.272816+0000","last_peered":"2023-07-06T21:55:05.272816+0000","last_clean":"2023-07-06T21:55:05.272816+0000","last_became_active":"2023-07-06T21:55:04.223413+0000","last_became_peered":"2023-07-06T21:55:04.223413+0000","last_unstale":"2023-07-06T21:55:05.272816+0000","last_undegraded":"2023-07-06T21:55:05.272816+0000","last_fullsized":"2023-07-06T21:55:05.272816+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:13:21.320036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"72'2","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274227+0000","last_change":"2023-07-06T21:55:03.807462+0000","last_active":"2023-07-06T21:55:05.274227+0000","last_peered":"2023-07-06T21:55:05.274227+0000","last_clean":"2023-07-06T21:55:05.274227+0000","last_became_active":"2023-07-06T21:55:03.807215+0000","last_became_peered":"2023-07-06T21:55:03.807215+0000","last_unstale":"2023-07-06T21:55:05.274227+0000","last_undegraded":"2023-07-06T21:55:05.274227+0000","last_fullsized":"2023-07-06T21:55:05.274227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:27:03.117688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":117,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273426+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:55:05.273426+0000","last_peered":"2023-07-06T21:55:05.273426+0000","last_clean":"2023-07-06T21:55:05.273426+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:55:05.273426+0000","last_undegraded":"2023-07-06T21:55:05.273426+0000","last_fullsized":"2023-07-06T21:55:05.273426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:29:55.230358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202553+0000","last_change":"2023-07-06T21:55:04.232362+0000","last_active":"2023-07-06T21:55:05.202553+0000","last_peered":"2023-07-06T21:55:05.202553+0000","last_clean":"2023-07-06T21:55:05.202553+0000","last_became_active":"2023-07-06T21:55:04.231776+0000","last_became_peered":"2023-07-06T21:55:04.231776+0000","last_unstale":"2023-07-06T21:55:05.202553+0000","last_undegraded":"2023-07-06T21:55:05.202553+0000","last_fullsized":"2023-07-06T21:55:05.202553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:55:16.706601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272997+0000","last_change":"2023-07-06T21:55:03.808380+0000","last_active":"2023-07-06T21:55:05.272997+0000","last_peered":"2023-07-06T21:55:05.272997+0000","last_clean":"2023-07-06T21:55:05.272997+0000","last_became_active":"2023-07-06T21:55:03.808078+0000","last_became_peered":"2023-07-06T21:55:03.808078+0000","last_unstale":"2023-07-06T21:55:05.272997+0000","last_undegraded":"2023-07-06T21:55:05.272997+0000","last_fullsized":"2023-07-06T21:55:05.272997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:19:19.697024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202654+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:55:05.202654+0000","last_peered":"2023-07-06T21:55:05.202654+0000","last_clean":"2023-07-06T21:55:05.202654+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:55:05.202654+0000","last_undegraded":"2023-07-06T21:55:05.202654+0000","last_fullsized":"2023-07-06T21:55:05.202654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:38:24.190196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.202552+0000","last_change":"2023-07-06T21:55:04.234940+0000","last_active":"2023-07-06T21:55:05.202552+0000","last_peered":"2023-07-06T21:55:05.202552+0000","last_clean":"2023-07-06T21:55:05.202552+0000","last_became_active":"2023-07-06T21:55:04.234199+0000","last_became_peered":"2023-07-06T21:55:04.234199+0000","last_unstale":"2023-07-06T21:55:05.202552+0000","last_undegraded":"2023-07-06T21:55:05.202552+0000","last_fullsized":"2023-07-06T21:55:05.202552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:11:20.189364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.274005+0000","last_change":"2023-07-06T21:55:03.810832+0000","last_active":"2023-07-06T21:55:05.274005+0000","last_peered":"2023-07-06T21:55:05.274005+0000","last_clean":"2023-07-06T21:55:05.274005+0000","last_became_active":"2023-07-06T21:55:03.810525+0000","last_became_peered":"2023-07-06T21:55:03.810525+0000","last_unstale":"2023-07-06T21:55:05.274005+0000","last_undegraded":"2023-07-06T21:55:05.274005+0000","last_fullsized":"2023-07-06T21:55:05.274005+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:19:09.759535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":117,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273814+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:55:05.273814+0000","last_peered":"2023-07-06T21:55:05.273814+0000","last_clean":"2023-07-06T21:55:05.273814+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:55:05.273814+0000","last_undegraded":"2023-07-06T21:55:05.273814+0000","last_fullsized":"2023-07-06T21:55:05.273814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:43:50.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.272850+0000","last_change":"2023-07-06T21:55:04.228462+0000","last_active":"2023-07-06T21:55:05.272850+0000","last_peered":"2023-07-06T21:55:05.272850+0000","last_clean":"2023-07-06T21:55:05.272850+0000","last_became_active":"2023-07-06T21:55:04.227151+0000","last_became_peered":"2023-07-06T21:55:04.227151+0000","last_unstale":"2023-07-06T21:55:05.272850+0000","last_undegraded":"2023-07-06T21:55:05.272850+0000","last_fullsized":"2023-07-06T21:55:05.272850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:03.778910+0000","last_clean_scrub_stamp":"2023-07-06T21:55:03.778910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:52:36.037743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"72'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.273137+0000","last_change":"2023-07-06T21:55:03.811493+0000","last_active":"2023-07-06T21:55:05.273137+0000","last_peered":"2023-07-06T21:55:05.273137+0000","last_clean":"2023-07-06T21:55:05.273137+0000","last_became_active":"2023-07-06T21:55:03.811194+0000","last_became_peered":"2023-07-06T21:55:03.811194+0000","last_unstale":"2023-07-06T21:55:05.273137+0000","last_undegraded":"2023-07-06T21:55:05.273137+0000","last_fullsized":"2023-07-06T21:55:05.273137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:55:02.771223+0000","last_clean_scrub_stamp":"2023-07-06T21:55:02.771223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:49:36.176146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-07-06T21:55:05.201438+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:55:05.201438+0000","last_peered":"2023-07-06T21:55:05.201438+0000","last_clean":"2023-07-06T21:55:05.201438+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:55:05.201438+0000","last_undegraded":"2023-07-06T21:55:05.201438+0000","last_fullsized":"2023-07-06T21:55:05.201438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:54:45.732783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36588,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335252,"statfs":{"total":96636764160,"available":96599298048,"internally_reserved":0,"allocated":1478656,"data_stored":1045283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71599999999999997,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.35199999999999998,"15min":0.30599999999999999},"max":{"1min":0.93999999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.71199999999999997,"15min":0.69099999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":0.91300000000000003,"5min":0.98799999999999999,"15min":0.99399999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.47799999999999998,"5min":0.39800000000000002,"15min":0.34799999999999998},"max":{"1min":0.91800000000000004,"5min":1.0449999999999999,"15min":1.0649999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86199999999999999,"5min":0.94099999999999995,"15min":0.97899999999999998},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.878,"5min":0.94799999999999995,"15min":0.94999999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73299999999999998,"15min":0.72799999999999998},"min":{"1min":0.52000000000000002,"5min":0.436,"15min":0.42599999999999999},"max":{"1min":0.89200000000000002,"5min":1.008,"15min":1.0529999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.44700000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.0469999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":0.93700000000000006,"5min":0.99399999999999999,"15min":1.006},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80700000000000005,"5min":0.94199999999999995,"15min":0.999},"last":0.625},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.747,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57999999999999996,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.98499999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":0.874,"5min":0.91100000000000003,"15min":0.99199999999999999},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:54:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70199999999999996,"15min":0.70099999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.40200000000000002},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":1.0309999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65900000000000003,"15min":0.67200000000000004},"min":{"1min":0.51000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95399999999999996,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.77700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575009,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":872448,"data_stored":453736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72499999999999998,"15min":0.70499999999999996},"min":{"1min":0.54600000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.0980000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.74299999999999999,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.38300000000000001},"max":{"1min":0.94799999999999995,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73299999999999998,"15min":0.71299999999999997},"min":{"1min":0.56499999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.753,"15min":0.73199999999999998},"min":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.998,"5min":0.998,"15min":1.1180000000000001},"last":0.624}]},{"osd":2,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.71699999999999997},"min":{"1min":0.56499999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.3859999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75700000000000001,"15min":0.73999999999999999},"min":{"1min":0.63500000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76500000000000001,"15min":0.748},"min":{"1min":0.57999999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.204},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.753,"15min":0.73899999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.498},"max":{"1min":0.96199999999999997,"5min":0.98099999999999998,"15min":1.4339999999999999},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.59199999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80200000000000005,"5min":0.84999999999999998,"15min":1.1850000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.39300000000000002},"max":{"1min":0.84199999999999997,"5min":0.91900000000000004,"15min":1.321},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63300000000000001,"15min":0.65400000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":1.0089999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.73599999999999999},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.89200000000000002,"5min":1.0189999999999999,"15min":1.631},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.41699999999999998},"max":{"1min":0.878,"5min":0.92400000000000004,"15min":1.3600000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67200000000000004,"15min":0.69999999999999996},"min":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":1.6930000000000001},"last":0.749}]}]},{"osd":5,"up_from":13,"seq":55834575009,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":884736,"data_stored":455407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70599999999999996,"15min":0.69099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.755},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.99299999999999999},"last":0.89200000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.71499999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.39200000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.131},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.72499999999999998},"min":{"1min":0.56899999999999995,"5min":0.54400000000000004,"15min":0.41099999999999998},"max":{"1min":0.92400000000000004,"5min":0.94399999999999995,"15min":1.0329999999999999},"last":0.98699999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75800000000000001,"15min":0.73899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.75700000000000001,"15min":0.73499999999999999},"min":{"1min":0.51100000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98299999999999998,"5min":0.98599999999999999,"15min":1.0369999999999999},"last":0.82499999999999996}]},{"osd":3,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48999999999999999},"max":{"1min":0.93300000000000005,"5min":0.94399999999999995,"15min":0.96099999999999997},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77400000000000002,"15min":0.76300000000000001},"min":{"1min":0.64100000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.96499999999999997}]},{"osd":4,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.58799999999999997},"min":{"1min":0.42299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.747,"5min":0.86599999999999999,"15min":1},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59199999999999997,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91800000000000004,"5min":0.93400000000000005,"15min":1.02},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59299999999999997,"15min":0.64300000000000002},"min":{"1min":0.48999999999999999,"5min":0.44700000000000001,"15min":0.44600000000000001},"max":{"1min":0.86799999999999999,"5min":0.91400000000000003,"15min":1.052},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60799999999999998,"15min":0.65100000000000002},"min":{"1min":0.47499999999999998,"5min":0.46300000000000002,"15min":0.41799999999999998},"max":{"1min":0.82799999999999996,"5min":0.86399999999999999,"15min":0.96699999999999997},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jul 6 21:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.69699999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.45200000000000001},"max":{"1min":0.92200000000000004,"5min":0.96299999999999997,"15min":1.0529999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.70299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575007,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":888832,"data_stored":456319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.60099999999999998,"5min":0.47299999999999998,"15min":0.39400000000000002},"max":{"1min":0.93899999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.52600000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.86499999999999999,"5min":1.0489999999999999,"15min":1.071},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.59199999999999997,"5min":0.51900000000000002,"15min":0.44},"max":{"1min":0.878,"5min":0.89200000000000002,"15min":1.361},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71199999999999997,"15min":0.72299999999999998},"min":{"1min":0.57399999999999995,"5min":0.47899999999999998,"15min":0.40300000000000002},"max":{"1min":0.90200000000000002,"5min":1.01,"15min":1.2829999999999999},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.73399999999999999,"15min":0.72299999999999998},"min":{"1min":0.64300000000000002,"5min":0.50800000000000001,"15min":0.40899999999999997},"max":{"1min":0.84699999999999998,"5min":1.1299999999999999,"15min":1.2170000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.752,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.505,"15min":0.38600000000000001},"max":{"1min":0.91800000000000004,"5min":0.98599999999999999,"15min":1.649},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72899999999999998,"15min":0.73999999999999999},"min":{"1min":0.61099999999999999,"5min":0.53800000000000003,"15min":0.45800000000000002},"max":{"1min":0.85199999999999998,"5min":0.93700000000000006,"15min":1.4219999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.60699999999999998,"5min":0.57199999999999995,"15min":0.49099999999999999},"max":{"1min":0.89100000000000001,"5min":0.97399999999999998,"15min":1.3109999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.308},"max":{"1min":0.80400000000000005,"5min":0.93700000000000006,"15min":1.246},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.63500000000000001},"min":{"1min":0.435,"5min":0.40600000000000003,"15min":0.32500000000000001},"max":{"1min":0.88800000000000001,"5min":0.97299999999999998,"15min":1.8049999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.63100000000000001},"min":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.36299999999999999},"max":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":1.478},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63,"15min":0.68600000000000005},"min":{"1min":0.48299999999999998,"5min":0.443,"15min":0.34799999999999998},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.7250000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63900000000000001,"15min":0.68400000000000005},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93200000000000005,"5min":1.028,"15min":1.534},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64700000000000002,"15min":0.69399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90600000000000003,"5min":1.01,"15min":1.585},"last":0.55400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575009,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":884736,"data_stored":454811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26900000000000002},"max":{"1min":0.85499999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.33400000000000002},"max":{"1min":0.94899999999999995,"5min":0.99099999999999999,"15min":1.7190000000000001},"last":0.623}]},{"osd":1,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49199999999999999,"15min":0.47499999999999998},"min":{"1min":0.32400000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.88,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.33500000000000002,"15min":0.32700000000000001},"max":{"1min":0.73399999999999999,"5min":1.109,"15min":1.9590000000000001},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.53000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33000000000000002},"max":{"1min":0.621,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.34799999999999998},"max":{"1min":0.72099999999999997,"5min":1.24,"15min":2.012},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":0.95999999999999996,"5min":1.1339999999999999,"15min":1.855},"last":0.754},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80000000000000004,"15min":0.77600000000000002},"min":{"1min":0.46600000000000003,"5min":0.46000000000000002,"15min":0.432},"max":{"1min":1.0329999999999999,"5min":1.097,"15min":1.524},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83399999999999996,"15min":0.79400000000000004},"min":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.42399999999999999},"max":{"1min":0.95599999999999996,"5min":1.236,"15min":1.3720000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80400000000000005,"15min":0.79000000000000004},"min":{"1min":0.49399999999999999,"5min":0.45400000000000001,"15min":0.44800000000000001},"max":{"1min":1.0169999999999999,"5min":1.3999999999999999,"15min":1.883},"last":0.81899999999999995}]},{"osd":6,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81799999999999995,"15min":0.78500000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40000000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.79200000000000004},"min":{"1min":0.56399999999999995,"5min":0.53600000000000003,"15min":0.47899999999999998},"max":{"1min":1.0640000000000001,"5min":1.101,"15min":1.4610000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82999999999999996,"15min":0.80100000000000005},"min":{"1min":0.57999999999999996,"5min":0.51300000000000001,"15min":0.497},"max":{"1min":1.0589999999999999,"5min":1.456,"15min":1.456},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52900000000000003},"max":{"1min":1.0649999999999999,"5min":1.3480000000000001,"15min":1.9830000000000001},"last":0.78600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575009,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36008,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335832,"statfs":{"total":96636764160,"available":96599891968,"internally_reserved":0,"allocated":884736,"data_stored":454811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46100000000000002,"15min":0.44900000000000001},"min":{"1min":0.317,"5min":0.29099999999999998,"15min":0.28100000000000003},"max":{"1min":0.66300000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.78300000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.504},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.33700000000000002},"max":{"1min":0.63700000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.443,"5min":0.38400000000000001,"15min":0.34999999999999998},"max":{"1min":0.746,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.622}]},{"osd":3,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":0.76200000000000001,"15min":0.76500000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.56799999999999995},"min":{"1min":0.48999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77400000000000002,"5min":0.83899999999999997,"15min":0.90500000000000003},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.64500000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1040000000000001,"5min":1.21,"15min":1.2430000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81899999999999995,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.214,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80100000000000005,"15min":0.78900000000000003},"min":{"1min":0.68999999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0549999999999999,"5min":1.212,"15min":1.246},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83299999999999996,"15min":0.81899999999999995},"min":{"1min":0.70799999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1930000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.83999999999999997,"15min":0.80100000000000005},"min":{"1min":0.54900000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.246,"5min":1.27,"15min":1.27},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.68600000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.105,"5min":1.2410000000000001,"15min":1.3320000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jul 6 21:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.83799999999999997,"15min":0.82299999999999995},"min":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.54300000000000004},"max":{"1min":1.1439999999999999,"5min":1.2789999999999999,"15min":1.3520000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.85399999999999998,"15min":0.83299999999999996},"min":{"1min":0.67100000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.218,"5min":1.268,"15min":1.369},"last":0.90200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36004,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335836,"statfs":{"total":96636764160,"available":96599896064,"internally_reserved":0,"allocated":880640,"data_stored":454845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.35799999999999998,"5min":0.28999999999999998,"15min":0.27500000000000002},"max":{"1min":0.63700000000000001,"5min":0.66100000000000003,"15min":0.73699999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.34399999999999997,"5min":0.32200000000000001,"15min":0.29399999999999998},"max":{"1min":0.64500000000000002,"5min":0.78900000000000003,"15min":0.92200000000000004},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47999999999999998,"15min":0.47599999999999998},"min":{"1min":0.34300000000000003,"5min":0.33000000000000002,"15min":0.311},"max":{"1min":0.623,"5min":0.73599999999999999,"15min":0.80200000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73299999999999998,"5min":0.87,"15min":0.87},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.46500000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.70699999999999996,"5min":0.84599999999999997,"15min":0.96299999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72799999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78900000000000003,"15min":0.77200000000000002},"min":{"1min":0.49199999999999999,"5min":0.39100000000000001,"15min":0.38500000000000001},"max":{"1min":1.143,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79200000000000004,"15min":0.78100000000000003},"min":{"1min":0.65000000000000002,"5min":0.497,"15min":0.44},"max":{"1min":1.0049999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79600000000000004,"15min":0.77700000000000002},"min":{"1min":0.54800000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1890000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.47999999999999998,"15min":0.439},"max":{"1min":1.028,"5min":1.357,"15min":1.357},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.63300000000000001,"5min":0.54300000000000004,"15min":0.53800000000000003},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81200000000000006,"15min":0.80900000000000005},"min":{"1min":0.60999999999999999,"5min":0.51800000000000002,"15min":0.51500000000000001},"max":{"1min":0.97199999999999998,"5min":1.456,"15min":1.456},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.81799999999999995},"min":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.53800000000000003},"max":{"1min":1.0820000000000001,"5min":1.417,"15min":1.417},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.59499999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3280000000000001,"5min":1.397,"15min":1.397},"last":0.84399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575009,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1482752,"data_stored":1046250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.247},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.1459999999999999},"last":0.37},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.33600000000000002,"15min":0.28599999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":1.5189999999999999},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.30099999999999999},"max":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":1.228},"last":0.441},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.34000000000000002},"max":{"1min":0.72299999999999998,"5min":0.85799999999999998,"15min":1.454},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.51100000000000001},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.308},"max":{"1min":0.71799999999999997,"5min":0.78900000000000003,"15min":1.7969999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.36799999999999999},"max":{"1min":0.83099999999999996,"5min":0.874,"15min":1.7190000000000001},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81699999999999995,"15min":0.79800000000000004},"min":{"1min":0.499,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.111,"5min":1.242,"15min":1.911},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80900000000000005,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.53100000000000003,"15min":0.35799999999999998},"max":{"1min":1.1020000000000001,"5min":1.2729999999999999,"15min":1.3620000000000001},"last":0.623}]},{"osd":5,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82599999999999996,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.38400000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.3700000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81499999999999995,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.55200000000000005,"15min":0.44400000000000001},"max":{"1min":1.0329999999999999,"5min":1.1759999999999999,"15min":1.758},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.52400000000000002},"max":{"1min":1.0780000000000001,"5min":1.2050000000000001,"15min":1.8220000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.47199999999999998},"max":{"1min":1.071,"5min":1.1379999999999999,"15min":2.266},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.63500000000000001,"5min":0.55900000000000005,"15min":0.53800000000000003},"max":{"1min":1.135,"5min":1.147,"15min":2.323},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.84699999999999998,"15min":0.81899999999999995},"min":{"1min":0.65500000000000003,"5min":0.60599999999999998,"15min":0.435},"max":{"1min":1.107,"5min":1.2210000000000001,"15min":1.2829999999999999},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:55:13.221 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T21:55:13.222 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-06T21:55:13.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0f796640 1 Processor -- start 2023-07-06T21:55:13.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0f796640 1 -- start start 2023-07-06T21:55:13.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0f796640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faf0815fde0 0x7faf08164130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0f796640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf081601b0 0x7faf080cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0f796640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf08163c50 con 0x7faf08164670 2023-07-06T21:55:13.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0f796640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf080cd310 con 0x7faf0815fde0 2023-07-06T21:55:13.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0f796640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf080cddc0 con 0x7faf081601b0 2023-07-06T21:55:13.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0d532640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faf0815fde0 0x7faf08164130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0d532640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faf0815fde0 0x7faf08164130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49208/0 (socket says 172.21.15.55:49208) 2023-07-06T21:55:13.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0d532640 1 -- 172.21.15.55:0/4224521795 learned_addr learned my addr 172.21.15.55:0/4224521795 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:13.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0cd31640 1 --2- 172.21.15.55:0/4224521795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf081601b0 0x7faf080cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0d532640 1 -- 172.21.15.55:0/4224521795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf081601b0 msgr2=0x7faf080cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:13.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0d532640 1 --2- 172.21.15.55:0/4224521795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf081601b0 0x7faf080cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0d532640 1 -- 172.21.15.55:0/4224521795 >> v1:172.21.15.138:6789/0 conn(0x7faf08164670 legacy=0x7faf080c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0d532640 1 -- 172.21.15.55:0/4224521795 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf080cd520 con 0x7faf0815fde0 2023-07-06T21:55:13.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.406+0000 7faf0cd31640 1 --2- 172.21.15.55:0/4224521795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf081601b0 0x7faf080cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:55:13.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.410+0000 7faf0d532640 1 --2- 172.21.15.55:0/4224521795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf0815fde0 0x7faf08164130 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7faf04009870 tx=0x7faf0401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1161cd56153e0e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:13.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.410+0000 7faefffff640 1 -- 172.21.15.55:0/4224521795 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040ab620 con 0x7faf0815fde0 2023-07-06T21:55:13.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.410+0000 7faefffff640 1 -- 172.21.15.55:0/4224521795 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf040ab780 con 0x7faf0815fde0 2023-07-06T21:55:13.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.410+0000 7faefffff640 1 -- 172.21.15.55:0/4224521795 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040abb10 con 0x7faf0815fde0 2023-07-06T21:55:13.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.410+0000 7faf0f796640 1 -- 172.21.15.55:0/4224521795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf0815fde0 msgr2=0x7faf08164130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.410+0000 7faf0f796640 1 --2- 172.21.15.55:0/4224521795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf0815fde0 0x7faf08164130 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7faf04009870 tx=0x7faf0401c510 comp rx=0 tx=0).stop 2023-07-06T21:55:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.410+0000 7faf0f796640 1 -- 172.21.15.55:0/4224521795 shutdown_connections 2023-07-06T21:55:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.410+0000 7faf0f796640 1 --2- 172.21.15.55:0/4224521795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf081601b0 0x7faf080cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.410+0000 7faf0f796640 1 --2- 172.21.15.55:0/4224521795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf0815fde0 0x7faf08164130 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.410+0000 7faf0f796640 1 -- 172.21.15.55:0/4224521795 >> 172.21.15.55:0/4224521795 conn(0x7faf080cdf40 msgr2=0x7faf080ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.410+0000 7faf0f796640 1 -- 172.21.15.55:0/4224521795 shutdown_connections 2023-07-06T21:55:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.410+0000 7faf0f796640 1 -- 172.21.15.55:0/4224521795 wait complete. 2023-07-06T21:55:13.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0f796640 1 Processor -- start 2023-07-06T21:55:13.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0f796640 1 -- start start 2023-07-06T21:55:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0f796640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf0815fde0 0x7faf08156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0f796640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf081601b0 0x7faf080c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0f796640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf08164670 0x7faf08162500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0f796640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf081575d0 con 0x7faf0815fde0 2023-07-06T21:55:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0f796640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf080c53f0 con 0x7faf081601b0 2023-07-06T21:55:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0f796640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf080c56d0 con 0x7faf08164670 2023-07-06T21:55:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0d532640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf0815fde0 0x7faf08156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0d532640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf0815fde0 0x7faf08156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49220/0 (socket says 172.21.15.55:49220) 2023-07-06T21:55:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0d532640 1 -- 172.21.15.55:0/1640890428 learned_addr learned my addr 172.21.15.55:0/1640890428 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0cd31640 1 --2- 172.21.15.55:0/1640890428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf081601b0 0x7faf080c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0dd33640 1 --2- 172.21.15.55:0/1640890428 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf08164670 0x7faf08162500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0d532640 1 -- 172.21.15.55:0/1640890428 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf08164670 msgr2=0x7faf08162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0d532640 1 --2- 172.21.15.55:0/1640890428 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf08164670 0x7faf08162500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0d532640 1 -- 172.21.15.55:0/1640890428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf081601b0 msgr2=0x7faf080c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0d532640 1 --2- 172.21.15.55:0/1640890428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf081601b0 0x7faf080c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0d532640 1 -- 172.21.15.55:0/1640890428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040094d0 con 0x7faf0815fde0 2023-07-06T21:55:13.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0d532640 1 --2- 172.21.15.55:0/1640890428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf0815fde0 0x7faf08156aa0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7faf040ad040 tx=0x7faf0401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:13.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faefdffb640 1 -- 172.21.15.55:0/1640890428 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040be3f0 con 0x7faf0815fde0 2023-07-06T21:55:13.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faefdffb640 1 -- 172.21.15.55:0/1640890428 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf040be550 con 0x7faf0815fde0 2023-07-06T21:55:13.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faefdffb640 1 -- 172.21.15.55:0/1640890428 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040be900 con 0x7faf0815fde0 2023-07-06T21:55:13.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.414+0000 7faf0f796640 1 -- 172.21.15.55:0/1640890428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf080c59b0 con 0x7faf0815fde0 2023-07-06T21:55:13.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.418+0000 7faf0f796640 1 -- 172.21.15.55:0/1640890428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf080c5f70 con 0x7faf0815fde0 2023-07-06T21:55:13.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.418+0000 7faf0f796640 1 -- 172.21.15.55:0/1640890428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf08066d60 con 0x7faf0815fde0 2023-07-06T21:55:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.418+0000 7faefdffb640 1 -- 172.21.15.55:0/1640890428 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faf040b43f0 con 0x7faf0815fde0 2023-07-06T21:55:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.418+0000 7faefdffb640 1 --2- 172.21.15.55:0/1640890428 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7faeec0663a0 0x7faeec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.418+0000 7faefdffb640 1 -- 172.21.15.55:0/1640890428 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faf0411e4d0 con 0x7faf0815fde0 2023-07-06T21:55:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.418+0000 7faf0cd31640 1 --2- 172.21.15.55:0/1640890428 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7faeec0663a0 0x7faeec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.418+0000 7faf0cd31640 1 --2- 172.21.15.55:0/1640890428 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7faeec0663a0 0x7faeec068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faf08157c70 tx=0x7faef8008040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:13.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.422+0000 7faefdffb640 1 -- 172.21.15.55:0/1640890428 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf040eb690 con 0x7faf0815fde0 2023-07-06T21:55:13.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.630+0000 7faf0f796640 1 -- 172.21.15.55:0/1640890428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7faf0806a400 con 0x7faf0815fde0 2023-07-06T21:55:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.634+0000 7faefdffb640 1 -- 172.21.15.55:0/1640890428 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7faf040eecb0 con 0x7faf0815fde0 2023-07-06T21:55:13.636 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-07-06T21:55:13.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.638+0000 7faf0f796640 1 -- 172.21.15.55:0/1640890428 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7faeec0663a0 msgr2=0x7faeec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.638+0000 7faf0f796640 1 --2- 172.21.15.55:0/1640890428 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7faeec0663a0 0x7faeec068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faf08157c70 tx=0x7faef8008040 comp rx=0 tx=0).stop 2023-07-06T21:55:13.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.638+0000 7faf0f796640 1 -- 172.21.15.55:0/1640890428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf0815fde0 msgr2=0x7faf08156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.638+0000 7faf0f796640 1 --2- 172.21.15.55:0/1640890428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf0815fde0 0x7faf08156aa0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7faf040ad040 tx=0x7faf0401ad50 comp rx=0 tx=0).stop 2023-07-06T21:55:13.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.638+0000 7faf0f796640 1 -- 172.21.15.55:0/1640890428 shutdown_connections 2023-07-06T21:55:13.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.638+0000 7faf0f796640 1 --2- 172.21.15.55:0/1640890428 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf08164670 0x7faf08162500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.638+0000 7faf0f796640 1 --2- 172.21.15.55:0/1640890428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf081601b0 0x7faf080c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.638+0000 7faf0f796640 1 --2- 172.21.15.55:0/1640890428 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7faeec0663a0 0x7faeec068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.638+0000 7faf0f796640 1 --2- 172.21.15.55:0/1640890428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf0815fde0 0x7faf08156aa0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.638+0000 7faf0f796640 1 -- 172.21.15.55:0/1640890428 >> 172.21.15.55:0/1640890428 conn(0x7faf080cdf40 msgr2=0x7faf080cac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:13.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.638+0000 7faf0f796640 1 -- 172.21.15.55:0/1640890428 shutdown_connections 2023-07-06T21:55:13.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.638+0000 7faf0f796640 1 -- 172.21.15.55:0/1640890428 wait complete. 2023-07-06T21:55:13.657 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:55:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.798+0000 7f05d9c18640 1 Processor -- start 2023-07-06T21:55:13.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d9c18640 1 -- start start 2023-07-06T21:55:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d9c18640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f05d4158400 0x7f05d40c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d9c18640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d406fae0 con 0x7f05d41587d0 2023-07-06T21:55:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d9c18640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d406fdc0 con 0x7f05d40c9680 2023-07-06T21:55:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d9c18640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d40700a0 con 0x7f05d4158400 2023-07-06T21:55:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f05d41587d0 0x7f05d40cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41784/0 (socket says 172.21.15.55:41784) 2023-07-06T21:55:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d3fff640 1 -- 172.21.15.55:0/1854430214 learned_addr learned my addr 172.21.15.55:0/1854430214 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:55:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d37fe640 1 --2- 172.21.15.55:0/1854430214 >> v2:172.21.15.138:3300/0 conn(0x7f05d4158400 0x7f05d40c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 -- 172.21.15.55:0/1854430214 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624064566 0 0) 0x7f05d406fae0 con 0x7f05d41587d0 2023-07-06T21:55:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 -- 172.21.15.55:0/1854430214 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05bc003530 con 0x7f05d41587d0 2023-07-06T21:55:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 -- 172.21.15.55:0/1854430214 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2555120774 0 0) 0x7f05bc003530 con 0x7f05d41587d0 2023-07-06T21:55:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 -- 172.21.15.55:0/1854430214 >> v2:172.21.15.138:3300/0 conn(0x7f05d4158400 msgr2=0x7f05d40c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 --2- 172.21.15.55:0/1854430214 >> v2:172.21.15.138:3300/0 conn(0x7f05d4158400 0x7f05d40c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 -- 172.21.15.55:0/1854430214 >> v1:172.21.15.138:6789/0 conn(0x7f05d40c9680 legacy=0x7f05d4070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 -- 172.21.15.55:0/1854430214 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d4070380 con 0x7f05d41587d0 2023-07-06T21:55:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 -- 172.21.15.55:0/1854430214 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f05cc001a00 con 0x7f05d41587d0 2023-07-06T21:55:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 -- 172.21.15.55:0/1854430214 >> v1:172.21.15.55:6789/0 conn(0x7f05d41587d0 legacy=0x7f05d40cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 --2- 172.21.15.55:0/1854430214 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05bc003980 0x7f05bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 --2- 172.21.15.55:0/1854430214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05bc0047d0 0x7f05bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 --2- 172.21.15.55:0/1854430214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05bc005180 0x7f05bc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 -- 172.21.15.55:0/1854430214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40700a0 con 0x7f05bc0047d0 2023-07-06T21:55:13.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 -- 172.21.15.55:0/1854430214 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc00c090 con 0x7f05bc005180 2023-07-06T21:55:13.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d27fc640 1 -- 172.21.15.55:0/1854430214 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc00e460 con 0x7f05bc003980 2023-07-06T21:55:13.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d2ffd640 1 --2- 172.21.15.55:0/1854430214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05bc0047d0 0x7f05bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d37fe640 1 --2- 172.21.15.55:0/1854430214 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05bc003980 0x7f05bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d3fff640 1 --2- 172.21.15.55:0/1854430214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05bc005180 0x7f05bc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d2ffd640 1 -- 172.21.15.55:0/1854430214 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05bc003980 msgr2=0x7f05bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:13.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d2ffd640 1 --2- 172.21.15.55:0/1854430214 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05bc003980 0x7f05bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d2ffd640 1 -- 172.21.15.55:0/1854430214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05bc005180 msgr2=0x7f05bc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:13.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d2ffd640 1 --2- 172.21.15.55:0/1854430214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05bc005180 0x7f05bc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d3fff640 1 -- 172.21.15.55:0/1854430214 reap_dead start 2023-07-06T21:55:13.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.802+0000 7f05d2ffd640 1 -- 172.21.15.55:0/1854430214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc003530 con 0x7f05bc0047d0 2023-07-06T21:55:13.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.806+0000 7f05d2ffd640 1 --2- 172.21.15.55:0/1854430214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05bc0047d0 0x7f05bc004c40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f05c8001750 tx=0x7f05c801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61be31bf1470cab7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:13.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.806+0000 7f05d27fc640 1 -- 172.21.15.55:0/1854430214 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c80052d0 con 0x7f05bc0047d0 2023-07-06T21:55:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.806+0000 7f05d27fc640 1 -- 172.21.15.55:0/1854430214 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c80a7050 con 0x7f05bc0047d0 2023-07-06T21:55:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.806+0000 7f05d27fc640 1 -- 172.21.15.55:0/1854430214 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8003600 con 0x7f05bc0047d0 2023-07-06T21:55:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.806+0000 7f05d9c18640 1 -- 172.21.15.55:0/1854430214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05bc0047d0 msgr2=0x7f05bc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.806+0000 7f05d9c18640 1 --2- 172.21.15.55:0/1854430214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05bc0047d0 0x7f05bc004c40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f05c8001750 tx=0x7f05c801c370 comp rx=0 tx=0).stop 2023-07-06T21:55:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.806+0000 7f05d9c18640 1 -- 172.21.15.55:0/1854430214 shutdown_connections 2023-07-06T21:55:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.806+0000 7f05d9c18640 1 --2- 172.21.15.55:0/1854430214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05bc0047d0 0x7f05bc004c40 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.806+0000 7f05d9c18640 1 -- 172.21.15.55:0/1854430214 >> 172.21.15.55:0/1854430214 conn(0x7f05d40cded0 msgr2=0x7f05d40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:13.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.806+0000 7f05d9c18640 1 -- 172.21.15.55:0/1854430214 shutdown_connections 2023-07-06T21:55:13.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.806+0000 7f05d9c18640 1 -- 172.21.15.55:0/1854430214 wait complete. 2023-07-06T21:55:13.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d9c18640 1 Processor -- start 2023-07-06T21:55:13.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d9c18640 1 -- start start 2023-07-06T21:55:13.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d9c18640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05bc0047d0 0x7f05d40c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d9c18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d41f1040 0x7f05d40c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d9c18640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05d40b2310 0x7f05d4159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d9c18640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d415c280 con 0x7f05d41f1040 2023-07-06T21:55:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d9c18640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d415b9d0 con 0x7f05d40b2310 2023-07-06T21:55:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d9c18640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40b2fd0 con 0x7f05bc0047d0 2023-07-06T21:55:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d41f1040 0x7f05d40c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d41f1040 0x7f05d40c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49238/0 (socket says 172.21.15.55:49238) 2023-07-06T21:55:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d2ffd640 1 -- 172.21.15.55:0/3777853038 learned_addr learned my addr 172.21.15.55:0/3777853038 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:13.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d37fe640 1 --2- 172.21.15.55:0/3777853038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05bc0047d0 0x7f05d40c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d3fff640 1 --2- 172.21.15.55:0/3777853038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05d40b2310 0x7f05d4159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d2ffd640 1 -- 172.21.15.55:0/3777853038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05bc0047d0 msgr2=0x7f05d40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d2ffd640 1 --2- 172.21.15.55:0/3777853038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05bc0047d0 0x7f05d40c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d2ffd640 1 -- 172.21.15.55:0/3777853038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05d40b2310 msgr2=0x7f05d4159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:13.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d2ffd640 1 --2- 172.21.15.55:0/3777853038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05d40b2310 0x7f05d4159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:13.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d2ffd640 1 -- 172.21.15.55:0/3777853038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d415bc00 con 0x7f05d41f1040 2023-07-06T21:55:13.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d2ffd640 1 --2- 172.21.15.55:0/3777853038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d41f1040 0x7f05d40c66b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f05c8005040 tx=0x7f05bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:13.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05bbfff640 1 -- 172.21.15.55:0/3777853038 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8007500 con 0x7f05d41f1040 2023-07-06T21:55:13.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05bbfff640 1 -- 172.21.15.55:0/3777853038 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c8007660 con 0x7f05d41f1040 2023-07-06T21:55:13.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05bbfff640 1 -- 172.21.15.55:0/3777853038 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c80069e0 con 0x7f05d41f1040 2023-07-06T21:55:13.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d9c18640 1 -- 172.21.15.55:0/3777853038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d40b2cf0 con 0x7f05d41f1040 2023-07-06T21:55:13.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.810+0000 7f05d9c18640 1 -- 172.21.15.55:0/3777853038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d40c6bf0 con 0x7f05d41f1040 2023-07-06T21:55:13.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.814+0000 7f05d9c18640 1 -- 172.21.15.55:0/3777853038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d406c580 con 0x7f05d41f1040 2023-07-06T21:55:13.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.814+0000 7f05bbfff640 1 -- 172.21.15.55:0/3777853038 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f05c8006b40 con 0x7f05d41f1040 2023-07-06T21:55:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.814+0000 7f05bbfff640 1 --2- 172.21.15.55:0/3777853038 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05c00663a0 0x7f05c0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.814+0000 7f05bbfff640 1 -- 172.21.15.55:0/3777853038 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f05c811e3f0 con 0x7f05d41f1040 2023-07-06T21:55:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.814+0000 7f05d37fe640 1 --2- 172.21.15.55:0/3777853038 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05c00663a0 0x7f05c0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.814+0000 7f05d37fe640 1 --2- 172.21.15.55:0/3777853038 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05c00663a0 0x7f05c0068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f05d40cd670 tx=0x7f05c4008040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:13.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:13.818+0000 7f05bbfff640 1 -- 172.21.15.55:0/3777853038 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05c80eef00 con 0x7f05d41f1040 2023-07-06T21:55:14.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.002+0000 7f05d9c18640 1 -- 172.21.15.55:0/3777853038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05d415c3c0 con 0x7f05d41f1040 2023-07-06T21:55:14.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.006+0000 7f05bbfff640 1 -- 172.21.15.55:0/3777853038 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f05d415c3c0 con 0x7f05d41f1040 2023-07-06T21:55:14.005 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:14.006 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2986611670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2986611670},{"type":"v1","addr":"172.21.15.138:6835","nonce":2986611670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6351,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2521348037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2521348037},{"type":"v1","addr":"172.21.15.55:6836","nonce":2521348037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1716722785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1716722785},{"type":"v1","addr":"172.21.15.55:6837","nonce":1716722785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:55:04.192386+0000","modified":"2023-07-06T21:55:07.200622+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6357":{"gid":6357,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6834/2595020915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2595020915},{"type":"v1","addr":"172.21.15.138:6834","nonce":2595020915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-06T21:55:14.006 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2023-07-06T21:55:14.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.006+0000 7f05d9c18640 1 -- 172.21.15.55:0/3777853038 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05c00663a0 msgr2=0x7f05c0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.006+0000 7f05d9c18640 1 --2- 172.21.15.55:0/3777853038 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05c00663a0 0x7f05c0068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f05d40cd670 tx=0x7f05c4008040 comp rx=0 tx=0).stop 2023-07-06T21:55:14.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.006+0000 7f05d9c18640 1 -- 172.21.15.55:0/3777853038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d41f1040 msgr2=0x7f05d40c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.006+0000 7f05d9c18640 1 --2- 172.21.15.55:0/3777853038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d41f1040 0x7f05d40c66b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f05c8005040 tx=0x7f05bc005800 comp rx=0 tx=0).stop 2023-07-06T21:55:14.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.006+0000 7f05d9c18640 1 -- 172.21.15.55:0/3777853038 shutdown_connections 2023-07-06T21:55:14.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.006+0000 7f05d9c18640 1 --2- 172.21.15.55:0/3777853038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05d40b2310 0x7f05d4159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.006+0000 7f05d9c18640 1 --2- 172.21.15.55:0/3777853038 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05c00663a0 0x7f05c0068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.006+0000 7f05d9c18640 1 --2- 172.21.15.55:0/3777853038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d41f1040 0x7f05d40c66b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.006+0000 7f05d9c18640 1 --2- 172.21.15.55:0/3777853038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05bc0047d0 0x7f05d40c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.006+0000 7f05d9c18640 1 -- 172.21.15.55:0/3777853038 >> 172.21.15.55:0/3777853038 conn(0x7f05d40cded0 msgr2=0x7f05d406b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:14.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.006+0000 7f05d9c18640 1 -- 172.21.15.55:0/3777853038 shutdown_connections 2023-07-06T21:55:14.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.006+0000 7f05d9c18640 1 -- 172.21.15.55:0/3777853038 wait complete. 2023-07-06T21:55:14.428 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T21:55:04.192386+0000', 'modified': '2023-07-06T21:55:07.200622+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6357}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6357': {'gid': 6357, 'name': 'b', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.138:6834/2595020915', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6832', 'nonce': 2595020915}, {'type': 'v1', 'addr': '172.21.15.138:6834', 'nonce': 2595020915}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T21:55:14.429 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T21:55:14.429 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-06T21:55:14.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.574+0000 7fccc4be9640 1 Processor -- start 2023-07-06T21:55:14.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.574+0000 7fccc4be9640 1 -- start start 2023-07-06T21:55:14.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.574+0000 7fccc4be9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fccc0070d70 0x7fccc00b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccc4be9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc00cc030 con 0x7fccc00709a0 2023-07-06T21:55:14.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccc4be9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc00cc300 con 0x7fccc00b1170 2023-07-06T21:55:14.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccc4be9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00b15f0 con 0x7fccc0070d70 2023-07-06T21:55:14.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbe59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fccc00709a0 0x7fccc00cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41794/0 (socket says 172.21.15.55:41794) 2023-07-06T21:55:14.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbe59c640 1 -- 172.21.15.55:0/757531295 learned_addr learned my addr 172.21.15.55:0/757531295 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:55:14.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccb7fff640 1 --2- 172.21.15.55:0/757531295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fccc0070d70 0x7fccc00b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 -- 172.21.15.55:0/757531295 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792221384 0 0) 0x7fccc00cc030 con 0x7fccc00709a0 2023-07-06T21:55:14.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 -- 172.21.15.55:0/757531295 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccac003530 con 0x7fccc00709a0 2023-07-06T21:55:14.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 -- 172.21.15.55:0/757531295 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4205370191 0 0) 0x7fccac003530 con 0x7fccc00709a0 2023-07-06T21:55:14.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 -- 172.21.15.55:0/757531295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fccc0070d70 msgr2=0x7fccc00b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:14.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 --2- 172.21.15.55:0/757531295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fccc0070d70 0x7fccc00b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 -- 172.21.15.55:0/757531295 >> v1:172.21.15.138:6789/0 conn(0x7fccc00b1170 legacy=0x7fccc006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 -- 172.21.15.55:0/757531295 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00cc5e0 con 0x7fccc00709a0 2023-07-06T21:55:14.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 -- 172.21.15.55:0/757531295 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fccb0001680 con 0x7fccc00709a0 2023-07-06T21:55:14.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 -- 172.21.15.55:0/757531295 >> v1:172.21.15.55:6789/0 conn(0x7fccc00709a0 legacy=0x7fccc00cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 --2- 172.21.15.55:0/757531295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccac0039b0 0x7fccac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 --2- 172.21.15.55:0/757531295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccac0047d0 0x7fccac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 --2- 172.21.15.55:0/757531295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fccc0070d70 0x7fccac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 -- 172.21.15.55:0/757531295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00b15f0 con 0x7fccac0039b0 2023-07-06T21:55:14.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 -- 172.21.15.55:0/757531295 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac00bac0 con 0x7fccac0047d0 2023-07-06T21:55:14.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbdd9b640 1 -- 172.21.15.55:0/757531295 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac00bc80 con 0x7fccc0070d70 2023-07-06T21:55:14.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbe59c640 1 --2- 172.21.15.55:0/757531295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccac0039b0 0x7fccac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccb7fff640 1 --2- 172.21.15.55:0/757531295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccac0047d0 0x7fccac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbed9d640 1 --2- 172.21.15.55:0/757531295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fccc0070d70 0x7fccac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbe59c640 1 -- 172.21.15.55:0/757531295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fccc0070d70 msgr2=0x7fccac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:14.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbe59c640 1 --2- 172.21.15.55:0/757531295 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fccc0070d70 0x7fccac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbe59c640 1 -- 172.21.15.55:0/757531295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccac0047d0 msgr2=0x7fccac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:14.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbe59c640 1 --2- 172.21.15.55:0/757531295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccac0047d0 0x7fccac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.578+0000 7fccbe59c640 1 -- 172.21.15.55:0/757531295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac003530 con 0x7fccac0039b0 2023-07-06T21:55:14.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.582+0000 7fccbe59c640 1 --2- 172.21.15.55:0/757531295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccac0039b0 0x7fccac003de0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fccb000c240 tx=0x7fccb001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6f9acd527ca90c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:14.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.582+0000 7fccbdd9b640 1 -- 172.21.15.55:0/757531295 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0005ae0 con 0x7fccac0039b0 2023-07-06T21:55:14.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.582+0000 7fccbdd9b640 1 -- 172.21.15.55:0/757531295 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb0005c40 con 0x7fccac0039b0 2023-07-06T21:55:14.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.582+0000 7fccbdd9b640 1 -- 172.21.15.55:0/757531295 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0007070 con 0x7fccac0039b0 2023-07-06T21:55:14.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.582+0000 7fccc4be9640 1 -- 172.21.15.55:0/757531295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccac0039b0 msgr2=0x7fccac003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.582+0000 7fccc4be9640 1 --2- 172.21.15.55:0/757531295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccac0039b0 0x7fccac003de0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fccb000c240 tx=0x7fccb001cb80 comp rx=0 tx=0).stop 2023-07-06T21:55:14.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.582+0000 7fccbed9d640 1 -- 172.21.15.55:0/757531295 reap_dead start 2023-07-06T21:55:14.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.582+0000 7fccc4be9640 1 -- 172.21.15.55:0/757531295 shutdown_connections 2023-07-06T21:55:14.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.582+0000 7fccc4be9640 1 -- 172.21.15.55:0/757531295 >> 172.21.15.55:0/757531295 conn(0x7fccc00cea70 msgr2=0x7fccc00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:14.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.582+0000 7fccc4be9640 1 -- 172.21.15.55:0/757531295 shutdown_connections 2023-07-06T21:55:14.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.582+0000 7fccc4be9640 1 -- 172.21.15.55:0/757531295 wait complete. 2023-07-06T21:55:14.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.582+0000 7fccc4be9640 1 Processor -- start 2023-07-06T21:55:14.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccc4be9640 1 -- start start 2023-07-06T21:55:14.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccc4be9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fccac0039b0 0x7fccc014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccc4be9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccc00694f0 0x7fccc0098dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccc4be9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc015ba40 0x7fccc015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccc4be9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc015c3f0 con 0x7fccc015ba40 2023-07-06T21:55:14.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccc4be9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc006a600 con 0x7fccc00694f0 2023-07-06T21:55:14.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccc4be9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc014c6b0 con 0x7fccac0039b0 2023-07-06T21:55:14.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccbed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc015ba40 0x7fccc015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccbed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc015ba40 0x7fccc015beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49246/0 (socket says 172.21.15.55:49246) 2023-07-06T21:55:14.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccbed9d640 1 -- 172.21.15.55:0/3024573040 learned_addr learned my addr 172.21.15.55:0/3024573040 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:14.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccb7fff640 1 --2- 172.21.15.55:0/3024573040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccc00694f0 0x7fccc0098dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccbed9d640 1 -- 172.21.15.55:0/3024573040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fccac0039b0 msgr2=0x7fccc014c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccbed9d640 1 --2- 172.21.15.55:0/3024573040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fccac0039b0 0x7fccc014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccbed9d640 1 -- 172.21.15.55:0/3024573040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccc00694f0 msgr2=0x7fccc0098dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccbed9d640 1 --2- 172.21.15.55:0/3024573040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccc00694f0 0x7fccc0098dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccbed9d640 1 -- 172.21.15.55:0/3024573040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00699f0 con 0x7fccc015ba40 2023-07-06T21:55:14.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccb7fff640 1 --2- 172.21.15.55:0/3024573040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccc00694f0 0x7fccc0098dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:55:14.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccbed9d640 1 --2- 172.21.15.55:0/3024573040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc015ba40 0x7fccc015beb0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fccc00b1540 tx=0x7fccb800f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:14.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccb6ffd640 1 -- 172.21.15.55:0/3024573040 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb800fe60 con 0x7fccc015ba40 2023-07-06T21:55:14.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccb6ffd640 1 -- 172.21.15.55:0/3024573040 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb8006b60 con 0x7fccc015ba40 2023-07-06T21:55:14.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.586+0000 7fccb6ffd640 1 -- 172.21.15.55:0/3024573040 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8003980 con 0x7fccc015ba40 2023-07-06T21:55:14.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.590+0000 7fccc4be9640 1 -- 172.21.15.55:0/3024573040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc0069cd0 con 0x7fccc015ba40 2023-07-06T21:55:14.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.590+0000 7fccc4be9640 1 -- 172.21.15.55:0/3024573040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc006a290 con 0x7fccc015ba40 2023-07-06T21:55:14.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.590+0000 7fccb6ffd640 1 -- 172.21.15.55:0/3024573040 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fccb8003ae0 con 0x7fccc015ba40 2023-07-06T21:55:14.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.590+0000 7fccb6ffd640 1 --2- 172.21.15.55:0/3024573040 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fcca00663d0 0x7fcca0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.590+0000 7fccb6ffd640 1 -- 172.21.15.55:0/3024573040 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fccb8082c50 con 0x7fccc015ba40 2023-07-06T21:55:14.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.590+0000 7fccbe59c640 1 --2- 172.21.15.55:0/3024573040 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fcca00663d0 0x7fcca0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.590+0000 7fccc7f47000 1 Processor -- start 2023-07-06T21:55:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.590+0000 7fccc7f47000 1 -- start start 2023-07-06T21:55:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccbe59c640 1 --2- 172.21.15.55:0/3024573040 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fcca00663d0 0x7fcca0068880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fccb00ab000 tx=0x7fccb0001a10 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:14.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f89740 0x563ae2f89b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f8a050 0x563ae2f3f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f3fd80 0x563ae2f40150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae2e07ac0 con 0x563ae2f3fd80 2023-07-06T21:55:14.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae2d41840 con 0x563ae2f8a050 2023-07-06T21:55:14.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ae2d952e0 con 0x563ae2f89740 2023-07-06T21:55:14.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccbed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f3fd80 0x563ae2f40150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccbe59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f89740 0x563ae2f89b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccbed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f3fd80 0x563ae2f40150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49256/0 (socket says 172.21.15.55:49256) 2023-07-06T21:55:14.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccbed9d640 1 -- 172.21.15.55:0/3631789042 learned_addr learned my addr 172.21.15.55:0/3631789042 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:14.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccb7fff640 1 --2- 172.21.15.55:0/3631789042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f8a050 0x563ae2f3f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccbed9d640 1 -- 172.21.15.55:0/3631789042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f89740 msgr2=0x563ae2f89b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccbed9d640 1 --2- 172.21.15.55:0/3631789042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f89740 0x563ae2f89b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccbed9d640 1 -- 172.21.15.55:0/3631789042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f8a050 msgr2=0x563ae2f3f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccbed9d640 1 --2- 172.21.15.55:0/3631789042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f8a050 0x563ae2f3f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccbed9d640 1 -- 172.21.15.55:0/3631789042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ae2a8a890 con 0x563ae2f3fd80 2023-07-06T21:55:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccbed9d640 1 --2- 172.21.15.55:0/3631789042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f3fd80 0x563ae2f40150 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fccb8080d20 tx=0x7fccb8053710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ddcfa33b607503 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fcc9ffff640 1 -- 172.21.15.55:0/3631789042 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8055ea0 con 0x563ae2f3fd80 2023-07-06T21:55:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fcc9ffff640 1 -- 172.21.15.55:0/3631789042 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb80501b0 con 0x563ae2f3fd80 2023-07-06T21:55:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fcc9ffff640 1 -- 172.21.15.55:0/3631789042 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8053190 con 0x563ae2f3fd80 2023-07-06T21:55:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 -- 172.21.15.55:0/3631789042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f3fd80 msgr2=0x563ae2f40150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 --2- 172.21.15.55:0/3631789042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f3fd80 0x563ae2f40150 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fccb8080d20 tx=0x7fccb8053710 comp rx=0 tx=0).stop 2023-07-06T21:55:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 -- 172.21.15.55:0/3631789042 shutdown_connections 2023-07-06T21:55:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 --2- 172.21.15.55:0/3631789042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f3fd80 0x563ae2f40150 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 --2- 172.21.15.55:0/3631789042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f8a050 0x563ae2f3f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 --2- 172.21.15.55:0/3631789042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f89740 0x563ae2f89b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 -- 172.21.15.55:0/3631789042 >> 172.21.15.55:0/3631789042 conn(0x563ae2f37800 msgr2=0x563ae2f46800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 -- 172.21.15.55:0/3631789042 shutdown_connections 2023-07-06T21:55:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 -- 172.21.15.55:0/3631789042 wait complete. 2023-07-06T21:55:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 -- start start 2023-07-06T21:55:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.594+0000 7fccc7f47000 1 Processor -- start 2023-07-06T21:55:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f3fd80 0x563ae2f45940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f89740 0x563ae2f4b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f8a050 0x563ae2f4b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae2d8e380 con 0x563ae2f3fd80 2023-07-06T21:55:14.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae2d4aae0 con 0x563ae2f89740 2023-07-06T21:55:14.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ae2d4a780 con 0x563ae2f8a050 2023-07-06T21:55:14.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 10 client.0 _ll_register_callbacks cb 0x563ae2f2be30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T21:55:14.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccbe59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f3fd80 0x563ae2f45940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccbe59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f3fd80 0x563ae2f45940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49260/0 (socket says 172.21.15.55:49260) 2023-07-06T21:55:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccbe59c640 1 -- 172.21.15.55:0/1912809286 learned_addr learned my addr 172.21.15.55:0/1912809286 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccb7fff640 1 --2- 172.21.15.55:0/1912809286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f89740 0x563ae2f4b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccbed9d640 1 --2- 172.21.15.55:0/1912809286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f8a050 0x563ae2f4b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccbe59c640 1 -- 172.21.15.55:0/1912809286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f8a050 msgr2=0x563ae2f4b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccbe59c640 1 --2- 172.21.15.55:0/1912809286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f8a050 0x563ae2f4b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccbe59c640 1 -- 172.21.15.55:0/1912809286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f89740 msgr2=0x563ae2f4b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccbe59c640 1 --2- 172.21.15.55:0/1912809286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f89740 0x563ae2f4b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccbe59c640 1 -- 172.21.15.55:0/1912809286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc006a290 con 0x563ae2f3fd80 2023-07-06T21:55:14.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccbe59c640 1 --2- 172.21.15.55:0/1912809286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f3fd80 0x563ae2f45940 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fccb0001940 tx=0x7fccb00a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74aac5fd9cafb3b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:14.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fcc9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T21:55:14.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fcc9d7fa640 1 -- 172.21.15.55:0/1912809286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb00c2040 con 0x563ae2f3fd80 2023-07-06T21:55:14.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 1 -- 172.21.15.55:0/1912809286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ae2d55a20 con 0x563ae2f3fd80 2023-07-06T21:55:14.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fcc9d7fa640 1 -- 172.21.15.55:0/1912809286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fccb0004c80 con 0x563ae2f3fd80 2023-07-06T21:55:14.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fcc9d7fa640 1 -- 172.21.15.55:0/1912809286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccb00b4070 con 0x563ae2f3fd80 2023-07-06T21:55:14.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 10 client.6525 fetch_fsmap learned FSMap version 24 2023-07-06T21:55:14.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 1 -- 172.21.15.55:0/1912809286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x563ae2d52d10 con 0x563ae2f3fd80 2023-07-06T21:55:14.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fcc9d7fa640 1 -- 172.21.15.55:0/1912809286 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563ae2d55a20 con 0x563ae2f3fd80 2023-07-06T21:55:14.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fcc9d7fa640 1 -- 172.21.15.55:0/1912809286 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fccb0007570 con 0x563ae2f3fd80 2023-07-06T21:55:14.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 10 client.6525 fetch_fsmap finished waiting for FSMap version 24 2023-07-06T21:55:14.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 10 client.6525 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-06T21:55:14.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 20 client.6525 populate_metadata read hostname 'smithi055' 2023-07-06T21:55:14.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 1 --2- 172.21.15.55:0/1912809286 >> [v2:172.21.15.138:6832/2595020915,v1:172.21.15.138:6834/2595020915] conn(0x563ae2f98c80 0x563ae2f9b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 4 client.6525 mds_command: new command op to 6357 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T21:55:14.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccc7f47000 1 -- 172.21.15.55:0/1912809286 --> [v2:172.21.15.138:6832/2595020915,v1:172.21.15.138:6834/2595020915] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ae2dbd710 con 0x563ae2f98c80 2023-07-06T21:55:14.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.598+0000 7fccb7fff640 1 --2- 172.21.15.55:0/1912809286 >> [v2:172.21.15.138:6832/2595020915,v1:172.21.15.138:6834/2595020915] conn(0x563ae2f98c80 0x563ae2f9b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fccb7fff640 1 --2- 172.21.15.55:0/1912809286 >> [v2:172.21.15.138:6832/2595020915,v1:172.21.15.138:6834/2595020915] conn(0x563ae2f98c80 0x563ae2f9b060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5176e15de1b19955 server_cookie=1a3a06fb465913c1 in_seq=0 out_seq=0 2023-07-06T21:55:14.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fcc9d7fa640 10 client.6525 ms_handle_connect on v2:172.21.15.138:6832/2595020915 2023-07-06T21:55:14.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fcc9d7fa640 1 -- 172.21.15.55:0/1912809286 <== mds.0 v2:172.21.15.138:6832/2595020915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563ae2dbd710 con 0x563ae2f98c80 2023-07-06T21:55:14.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fcc9d7fa640 10 client.6525 handle_command_reply: tid=0 2023-07-06T21:55:14.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fccc7f47000 1 client.6525 shutdown 2023-07-06T21:55:14.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fccc7f47000 1 -- 172.21.15.55:0/1912809286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f3fd80 msgr2=0x563ae2f45940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fccc7f47000 1 --2- 172.21.15.55:0/1912809286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f3fd80 0x563ae2f45940 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fccb0001940 tx=0x7fccb00a7000 comp rx=0 tx=0).stop 2023-07-06T21:55:14.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fccc7f47000 1 -- 172.21.15.55:0/1912809286 shutdown_connections 2023-07-06T21:55:14.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fccc7f47000 1 --2- 172.21.15.55:0/1912809286 >> [v2:172.21.15.138:6832/2595020915,v1:172.21.15.138:6834/2595020915] conn(0x563ae2f98c80 0x563ae2f9b060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fccc7f47000 1 --2- 172.21.15.55:0/1912809286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f8a050 0x563ae2f4b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fccc7f47000 1 --2- 172.21.15.55:0/1912809286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f89740 0x563ae2f4b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fcc9d7fa640 0 client.6525 ms_handle_reset on v2:172.21.15.138:6832/2595020915 2023-07-06T21:55:14.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fccc7f47000 1 --2- 172.21.15.55:0/1912809286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f3fd80 0x563ae2f45940 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fccc7f47000 1 -- 172.21.15.55:0/1912809286 >> 172.21.15.55:0/1912809286 conn(0x563ae2f37800 msgr2=0x563ae2f3e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:14.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fccc7f47000 1 -- 172.21.15.55:0/1912809286 shutdown_connections 2023-07-06T21:55:14.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fccc7f47000 1 -- 172.21.15.55:0/1912809286 wait complete. 2023-07-06T21:55:14.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.602+0000 7fccc7f47000 20 client.6525 trim_cache size 0 max 16384 2023-07-06T21:55:14.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccc7f47000 1 Processor -- start 2023-07-06T21:55:14.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccc7f47000 1 -- start start 2023-07-06T21:55:14.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccc7f47000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f3fd80 0x563ae2f3ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccc7f47000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f89740 0x563ae2f3f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccc7f47000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f8a050 0x563ae2f99050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccc7f47000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae2a4b940 con 0x563ae2f8a050 2023-07-06T21:55:14.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccc7f47000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae2d88680 con 0x563ae2f3fd80 2023-07-06T21:55:14.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccc7f47000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ae2d8bb90 con 0x563ae2f89740 2023-07-06T21:55:14.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccbed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f8a050 0x563ae2f99050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccbed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f8a050 0x563ae2f99050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49270/0 (socket says 172.21.15.55:49270) 2023-07-06T21:55:14.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccbed9d640 1 -- 172.21.15.55:0/3306743797 learned_addr learned my addr 172.21.15.55:0/3306743797 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:14.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccbe59c640 1 --2- 172.21.15.55:0/3306743797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f3fd80 0x563ae2f3ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccb7fff640 1 --2- 172.21.15.55:0/3306743797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f89740 0x563ae2f3f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccbed9d640 1 -- 172.21.15.55:0/3306743797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f89740 msgr2=0x563ae2f3f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:14.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccbed9d640 1 --2- 172.21.15.55:0/3306743797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f89740 0x563ae2f3f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccbed9d640 1 -- 172.21.15.55:0/3306743797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f3fd80 msgr2=0x563ae2f3ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:14.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccbed9d640 1 --2- 172.21.15.55:0/3306743797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f3fd80 0x563ae2f3ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccbed9d640 1 -- 172.21.15.55:0/3306743797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ae2f42450 con 0x563ae2f8a050 2023-07-06T21:55:14.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccbed9d640 1 --2- 172.21.15.55:0/3306743797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f8a050 0x563ae2f99050 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fccb8053a30 tx=0x7fccb8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfe4774b611e530 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:14.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccb4ff9640 1 -- 172.21.15.55:0/3306743797 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb807f070 con 0x563ae2f8a050 2023-07-06T21:55:14.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccb4ff9640 1 -- 172.21.15.55:0/3306743797 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb8054e90 con 0x563ae2f8a050 2023-07-06T21:55:14.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.618+0000 7fccb4ff9640 1 -- 172.21.15.55:0/3306743797 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb80535e0 con 0x563ae2f8a050 2023-07-06T21:55:14.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 -- 172.21.15.55:0/3306743797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f8a050 msgr2=0x563ae2f99050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 --2- 172.21.15.55:0/3306743797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f8a050 0x563ae2f99050 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fccb8053a30 tx=0x7fccb8015000 comp rx=0 tx=0).stop 2023-07-06T21:55:14.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 -- 172.21.15.55:0/3306743797 shutdown_connections 2023-07-06T21:55:14.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 --2- 172.21.15.55:0/3306743797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f8a050 0x563ae2f99050 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 --2- 172.21.15.55:0/3306743797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f89740 0x563ae2f3f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 --2- 172.21.15.55:0/3306743797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f3fd80 0x563ae2f3ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 -- 172.21.15.55:0/3306743797 >> 172.21.15.55:0/3306743797 conn(0x563ae2f37800 msgr2=0x563ae2f3e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:14.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 -- 172.21.15.55:0/3306743797 shutdown_connections 2023-07-06T21:55:14.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 -- 172.21.15.55:0/3306743797 wait complete. 2023-07-06T21:55:14.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 -- start start 2023-07-06T21:55:14.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 Processor -- start 2023-07-06T21:55:14.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f3fd80 0x563ae2f9c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f89740 0x563ae2f9c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f8a050 0x563ae2fa44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae2d2d930 con 0x563ae2f8a050 2023-07-06T21:55:14.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ae2d5d320 con 0x563ae2f89740 2023-07-06T21:55:14.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ae2a4b940 con 0x563ae2f3fd80 2023-07-06T21:55:14.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 10 client.0 _ll_register_callbacks cb 0x563ae2d527f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T21:55:14.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccbed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f8a050 0x563ae2fa44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccbed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f8a050 0x563ae2fa44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49276/0 (socket says 172.21.15.55:49276) 2023-07-06T21:55:14.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccbed9d640 1 -- 172.21.15.55:0/1845494403 learned_addr learned my addr 172.21.15.55:0/1845494403 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:14.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccb7fff640 1 --2- 172.21.15.55:0/1845494403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f89740 0x563ae2f9c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccbe59c640 1 --2- 172.21.15.55:0/1845494403 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f3fd80 0x563ae2f9c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccbed9d640 1 -- 172.21.15.55:0/1845494403 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f3fd80 msgr2=0x563ae2f9c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:14.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccbed9d640 1 --2- 172.21.15.55:0/1845494403 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f3fd80 0x563ae2f9c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccbed9d640 1 -- 172.21.15.55:0/1845494403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f89740 msgr2=0x563ae2f9c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:14.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccbed9d640 1 --2- 172.21.15.55:0/1845494403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f89740 0x563ae2f9c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccbed9d640 1 -- 172.21.15.55:0/1845494403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb807ae70 con 0x563ae2f8a050 2023-07-06T21:55:14.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccbed9d640 1 --2- 172.21.15.55:0/1845494403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f8a050 0x563ae2fa44c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fccb805bfb0 tx=0x7fccb8057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f464022a52082c9b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:14.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fcc9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T21:55:14.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fcc9d7fa640 1 -- 172.21.15.55:0/1845494403 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8053190 con 0x563ae2f8a050 2023-07-06T21:55:14.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fcc9d7fa640 1 -- 172.21.15.55:0/1845494403 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fccb805b960 con 0x563ae2f8a050 2023-07-06T21:55:14.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 -- 172.21.15.55:0/1845494403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ae2f436e0 con 0x563ae2f8a050 2023-07-06T21:55:14.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fcc9d7fa640 1 -- 172.21.15.55:0/1845494403 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccb8081030 con 0x563ae2f8a050 2023-07-06T21:55:14.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 10 client.6531 fetch_fsmap learned FSMap version 24 2023-07-06T21:55:14.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fccc7f47000 1 -- 172.21.15.55:0/1845494403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x563ae2d38fa0 con 0x563ae2f8a050 2023-07-06T21:55:14.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.622+0000 7fcc9d7fa640 1 -- 172.21.15.55:0/1845494403 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563ae2f436e0 con 0x563ae2f8a050 2023-07-06T21:55:14.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fcc9d7fa640 1 -- 172.21.15.55:0/1845494403 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fccb8012070 con 0x563ae2f8a050 2023-07-06T21:55:14.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 10 client.6531 fetch_fsmap finished waiting for FSMap version 24 2023-07-06T21:55:14.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 10 client.6531 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-06T21:55:14.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 20 client.6531 populate_metadata read hostname 'smithi055' 2023-07-06T21:55:14.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 1 --2- 172.21.15.55:0/1845494403 >> [v2:172.21.15.138:6832/2595020915,v1:172.21.15.138:6834/2595020915] conn(0x563ae2fa4e80 0x563ae2fef930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 4 client.6531 mds_command: new command op to 6357 tid=0[{"prefix": "status"}] 2023-07-06T21:55:14.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 1 -- 172.21.15.55:0/1845494403 --> [v2:172.21.15.138:6832/2595020915,v1:172.21.15.138:6834/2595020915] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563ae2d8ccd0 con 0x563ae2fa4e80 2023-07-06T21:55:14.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccbe59c640 1 --2- 172.21.15.55:0/1845494403 >> [v2:172.21.15.138:6832/2595020915,v1:172.21.15.138:6834/2595020915] conn(0x563ae2fa4e80 0x563ae2fef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccbe59c640 1 --2- 172.21.15.55:0/1845494403 >> [v2:172.21.15.138:6832/2595020915,v1:172.21.15.138:6834/2595020915] conn(0x563ae2fa4e80 0x563ae2fef930 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f99f3a70a309dfe server_cookie=c9d663330cbf2544 in_seq=0 out_seq=0 2023-07-06T21:55:14.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fcc9d7fa640 10 client.6531 ms_handle_connect on v2:172.21.15.138:6832/2595020915 2023-07-06T21:55:14.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fcc9d7fa640 1 -- 172.21.15.55:0/1845494403 <== mds.0 v2:172.21.15.138:6832/2595020915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x563ae2d8ccd0 con 0x563ae2fa4e80 2023-07-06T21:55:14.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fcc9d7fa640 10 client.6531 handle_command_reply: tid=0 2023-07-06T21:55:14.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 1 client.6531 shutdown 2023-07-06T21:55:14.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 1 -- 172.21.15.55:0/1845494403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f8a050 msgr2=0x563ae2fa44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 1 --2- 172.21.15.55:0/1845494403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f8a050 0x563ae2fa44c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fccb805bfb0 tx=0x7fccb8057040 comp rx=0 tx=0).stop 2023-07-06T21:55:14.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 1 -- 172.21.15.55:0/1845494403 shutdown_connections 2023-07-06T21:55:14.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 1 --2- 172.21.15.55:0/1845494403 >> [v2:172.21.15.138:6832/2595020915,v1:172.21.15.138:6834/2595020915] conn(0x563ae2fa4e80 0x563ae2fef930 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 1 --2- 172.21.15.55:0/1845494403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563ae2f8a050 0x563ae2fa44c0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 1 --2- 172.21.15.55:0/1845494403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ae2f89740 0x563ae2f9c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 1 --2- 172.21.15.55:0/1845494403 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x563ae2f3fd80 0x563ae2f9c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fcc9d7fa640 0 client.6531 ms_handle_reset on v2:172.21.15.138:6832/2595020915 2023-07-06T21:55:14.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 1 -- 172.21.15.55:0/1845494403 >> 172.21.15.55:0/1845494403 conn(0x563ae2f37800 msgr2=0x563ae2f3e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:14.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 1 -- 172.21.15.55:0/1845494403 shutdown_connections 2023-07-06T21:55:14.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 1 -- 172.21.15.55:0/1845494403 wait complete. 2023-07-06T21:55:14.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc7f47000 20 client.6531 trim_cache size 0 max 16384 2023-07-06T21:55:14.634 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T21:55:14.635 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c64f3ef1-e769-47b3-ae15-a714e4e7c4f7", 2023-07-06T21:55:14.635 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-07-06T21:55:14.635 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6357, 2023-07-06T21:55:14.635 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-07-06T21:55:14.635 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-07-06T21:55:14.635 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-07-06T21:55:14.635 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.434041956, 2023-07-06T21:55:14.636 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 24, 2023-07-06T21:55:14.636 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 73, 2023-07-06T21:55:14.636 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 73, 2023-07-06T21:55:14.636 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 15.72441332 2023-07-06T21:55:14.636 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T21:55:14.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc4be9640 1 -- 172.21.15.55:0/3024573040 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fcca00663d0 msgr2=0x7fcca0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc4be9640 1 --2- 172.21.15.55:0/3024573040 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fcca00663d0 0x7fcca0068880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fccb00ab000 tx=0x7fccb0001a10 comp rx=0 tx=0).stop 2023-07-06T21:55:14.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc4be9640 1 -- 172.21.15.55:0/3024573040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc015ba40 msgr2=0x7fccc015beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc4be9640 1 --2- 172.21.15.55:0/3024573040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc015ba40 0x7fccc015beb0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fccc00b1540 tx=0x7fccb800f900 comp rx=0 tx=0).stop 2023-07-06T21:55:14.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc4be9640 1 -- 172.21.15.55:0/3024573040 shutdown_connections 2023-07-06T21:55:14.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc4be9640 1 --2- 172.21.15.55:0/3024573040 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7fcca00663d0 0x7fcca0068880 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc4be9640 1 --2- 172.21.15.55:0/3024573040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc015ba40 0x7fccc015beb0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc4be9640 1 --2- 172.21.15.55:0/3024573040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fccc00694f0 0x7fccc0098dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc4be9640 1 --2- 172.21.15.55:0/3024573040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fccac0039b0 0x7fccc014c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc4be9640 1 -- 172.21.15.55:0/3024573040 >> 172.21.15.55:0/3024573040 conn(0x7fccc00cea70 msgr2=0x7fccc006eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:14.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc4be9640 1 -- 172.21.15.55:0/3024573040 shutdown_connections 2023-07-06T21:55:14.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.626+0000 7fccc4be9640 1 -- 172.21.15.55:0/3024573040 wait complete. 2023-07-06T21:55:14.646 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T21:55:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.790+0000 7f3d2649c640 1 Processor -- start 2023-07-06T21:55:14.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.790+0000 7f3d2649c640 1 -- start start 2023-07-06T21:55:14.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.790+0000 7f3d2649c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d201587d0 0x7f3d20070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.790+0000 7f3d2649c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d200710c0 0x7f3d200cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.790+0000 7f3d2649c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2006fae0 con 0x7f3d20158400 2023-07-06T21:55:14.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.790+0000 7f3d2649c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2006fdc0 con 0x7f3d200710c0 2023-07-06T21:55:14.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.790+0000 7f3d2649c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d200700a0 con 0x7f3d201587d0 2023-07-06T21:55:14.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.790+0000 7f3d24a39640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d200710c0 0x7f3d200cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.790+0000 7f3d24a39640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d200710c0 0x7f3d200cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49288/0 (socket says 172.21.15.55:49288) 2023-07-06T21:55:14.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.790+0000 7f3d24a39640 1 -- 172.21.15.55:0/2252156642 learned_addr learned my addr 172.21.15.55:0/2252156642 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:14.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.790+0000 7f3d1f7fe640 1 --2- 172.21.15.55:0/2252156642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d201587d0 0x7f3d20070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.794+0000 7f3d24a39640 1 -- 172.21.15.55:0/2252156642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d201587d0 msgr2=0x7f3d20070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:14.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.794+0000 7f3d24a39640 1 --2- 172.21.15.55:0/2252156642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d201587d0 0x7f3d20070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.794+0000 7f3d24a39640 1 -- 172.21.15.55:0/2252156642 >> v1:172.21.15.138:6789/0 conn(0x7f3d20158400 legacy=0x7f3d200c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:14.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.794+0000 7f3d24a39640 1 -- 172.21.15.55:0/2252156642 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d20070380 con 0x7f3d200710c0 2023-07-06T21:55:14.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.794+0000 7f3d24a39640 1 --2- 172.21.15.55:0/2252156642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d200710c0 0x7f3d200cbaa0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800d150 tx=0x7f3d1801ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802f3db2ba3c7c20 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:14.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.794+0000 7f3d1effd640 1 -- 172.21.15.55:0/2252156642 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1800b2d0 con 0x7f3d200710c0 2023-07-06T21:55:14.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.794+0000 7f3d1effd640 1 -- 172.21.15.55:0/2252156642 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1800b430 con 0x7f3d200710c0 2023-07-06T21:55:14.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.794+0000 7f3d1effd640 1 -- 172.21.15.55:0/2252156642 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d180a7be0 con 0x7f3d200710c0 2023-07-06T21:55:14.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.794+0000 7f3d2649c640 1 -- 172.21.15.55:0/2252156642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d200710c0 msgr2=0x7f3d200cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.794+0000 7f3d2649c640 1 --2- 172.21.15.55:0/2252156642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d200710c0 0x7f3d200cbaa0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800d150 tx=0x7f3d1801ebe0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.794+0000 7f3d2649c640 1 -- 172.21.15.55:0/2252156642 shutdown_connections 2023-07-06T21:55:14.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.794+0000 7f3d2649c640 1 --2- 172.21.15.55:0/2252156642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d200710c0 0x7f3d200cbaa0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.794+0000 7f3d2649c640 1 --2- 172.21.15.55:0/2252156642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d201587d0 0x7f3d20070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.794+0000 7f3d2649c640 1 -- 172.21.15.55:0/2252156642 >> 172.21.15.55:0/2252156642 conn(0x7f3d200cded0 msgr2=0x7f3d200ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:14.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d2649c640 1 -- 172.21.15.55:0/2252156642 shutdown_connections 2023-07-06T21:55:14.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d2649c640 1 -- 172.21.15.55:0/2252156642 wait complete. 2023-07-06T21:55:14.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d2649c640 1 Processor -- start 2023-07-06T21:55:14.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d2649c640 1 -- start start 2023-07-06T21:55:14.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d2649c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d200710c0 0x7f3d200b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d2649c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d20158400 0x7f3d200c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d2649c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d201587d0 0x7f3d2014cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d2649c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d20153670 con 0x7f3d20158400 2023-07-06T21:55:14.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d2649c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d200c7d90 con 0x7f3d201587d0 2023-07-06T21:55:14.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d2649c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d201538c0 con 0x7f3d200710c0 2023-07-06T21:55:14.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d1f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d20158400 0x7f3d200c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d1f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d20158400 0x7f3d200c73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49294/0 (socket says 172.21.15.55:49294) 2023-07-06T21:55:14.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d1f7fe640 1 -- 172.21.15.55:0/1392508160 learned_addr learned my addr 172.21.15.55:0/1392508160 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:14.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d1ffff640 1 --2- 172.21.15.55:0/1392508160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d200710c0 0x7f3d200b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d24a39640 1 --2- 172.21.15.55:0/1392508160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d201587d0 0x7f3d2014cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d1f7fe640 1 -- 172.21.15.55:0/1392508160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d200710c0 msgr2=0x7f3d200b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d1f7fe640 1 --2- 172.21.15.55:0/1392508160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d200710c0 0x7f3d200b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d1f7fe640 1 -- 172.21.15.55:0/1392508160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d201587d0 msgr2=0x7f3d2014cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d1f7fe640 1 --2- 172.21.15.55:0/1392508160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d201587d0 0x7f3d2014cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d1f7fe640 1 -- 172.21.15.55:0/1392508160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1800bd40 con 0x7f3d20158400 2023-07-06T21:55:14.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.798+0000 7f3d1f7fe640 1 --2- 172.21.15.55:0/1392508160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d20158400 0x7f3d200c73b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400d5f0 tx=0x7f3d1400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:14.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.802+0000 7f3d1cff9640 1 -- 172.21.15.55:0/1392508160 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d140125f0 con 0x7f3d20158400 2023-07-06T21:55:14.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.802+0000 7f3d1cff9640 1 -- 172.21.15.55:0/1392508160 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d14012750 con 0x7f3d20158400 2023-07-06T21:55:14.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.802+0000 7f3d1cff9640 1 -- 172.21.15.55:0/1392508160 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14012ae0 con 0x7f3d20158400 2023-07-06T21:55:14.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.802+0000 7f3d2649c640 1 -- 172.21.15.55:0/1392508160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d20153ba0 con 0x7f3d20158400 2023-07-06T21:55:14.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.802+0000 7f3d2649c640 1 -- 172.21.15.55:0/1392508160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d200b2b10 con 0x7f3d20158400 2023-07-06T21:55:14.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.802+0000 7f3d2649c640 1 -- 172.21.15.55:0/1392508160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2006c580 con 0x7f3d20158400 2023-07-06T21:55:14.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.802+0000 7f3d1cff9640 1 -- 172.21.15.55:0/1392508160 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3d14012c40 con 0x7f3d20158400 2023-07-06T21:55:14.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.802+0000 7f3d1cff9640 1 --2- 172.21.15.55:0/1392508160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f3d0c0663a0 0x7f3d0c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:14.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.802+0000 7f3d1cff9640 1 -- 172.21.15.55:0/1392508160 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3d14084440 con 0x7f3d20158400 2023-07-06T21:55:14.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.802+0000 7f3d1ffff640 1 --2- 172.21.15.55:0/1392508160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f3d0c0663a0 0x7f3d0c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:14.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.802+0000 7f3d1ffff640 1 --2- 172.21.15.55:0/1392508160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f3d0c0663a0 0x7f3d0c068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3d10007fd0 tx=0x7f3d10009040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:14.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.806+0000 7f3d1cff9640 1 -- 172.21.15.55:0/1392508160 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3d14051680 con 0x7f3d20158400 2023-07-06T21:55:14.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.994+0000 7f3d2649c640 1 -- 172.21.15.55:0/1392508160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3d20066d60 con 0x7f3d20158400 2023-07-06T21:55:14.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.994+0000 7f3d1cff9640 1 -- 172.21.15.55:0/1392508160 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3d14007380 con 0x7f3d20158400 2023-07-06T21:55:14.996 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T21:55:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.998+0000 7f3d2649c640 1 -- 172.21.15.55:0/1392508160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f3d0c0663a0 msgr2=0x7f3d0c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.998+0000 7f3d2649c640 1 --2- 172.21.15.55:0/1392508160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f3d0c0663a0 0x7f3d0c068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3d10007fd0 tx=0x7f3d10009040 comp rx=0 tx=0).stop 2023-07-06T21:55:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.998+0000 7f3d2649c640 1 -- 172.21.15.55:0/1392508160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d20158400 msgr2=0x7f3d200c73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.998+0000 7f3d2649c640 1 --2- 172.21.15.55:0/1392508160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d20158400 0x7f3d200c73b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400d5f0 tx=0x7f3d1400dab0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.998+0000 7f3d2649c640 1 -- 172.21.15.55:0/1392508160 shutdown_connections 2023-07-06T21:55:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.998+0000 7f3d2649c640 1 --2- 172.21.15.55:0/1392508160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d201587d0 0x7f3d2014cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.998+0000 7f3d2649c640 1 --2- 172.21.15.55:0/1392508160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f3d0c0663a0 0x7f3d0c068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.998+0000 7f3d2649c640 1 --2- 172.21.15.55:0/1392508160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d20158400 0x7f3d200c73b0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.998+0000 7f3d2649c640 1 --2- 172.21.15.55:0/1392508160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d200710c0 0x7f3d200b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.998+0000 7f3d2649c640 1 -- 172.21.15.55:0/1392508160 >> 172.21.15.55:0/1392508160 conn(0x7f3d200cded0 msgr2=0x7f3d200ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.998+0000 7f3d2649c640 1 -- 172.21.15.55:0/1392508160 shutdown_connections 2023-07-06T21:55:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:14.998+0000 7f3d2649c640 1 -- 172.21.15.55:0/1392508160 wait complete. 2023-07-06T21:55:15.017 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T21:55:15.017 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T21:55:15.017 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-07-06T21:55:15.018 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T21:55:15.018 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T21:55:15.018 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T21:55:15.018 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-06T21:55:15.019 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T21:55:15.019 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:55:15.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:15.020 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-07-06T21:55:15.029 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T21:55:15.029 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T21:55:15.029 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T21:55:15.029 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:55:15.030 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T21:55:15.030 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:55:15.030 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:55:15.030 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:55:15.030 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-07-06T21:55:15.030 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:55:15.030 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:55:15.031 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-07-06T21:55:15.031 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T21:55:15.031 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:55:15.031 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-07-06T21:55:15.031 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-06T21:55:15.031 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41642sec preferred_lft 41642sec 2023-07-06T21:55:15.031 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-07-06T21:55:15.031 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:55:15.032 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:55:15.032 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:55:15.032 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-07-06T21:55:15.032 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T21:55:15.032 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:84:fe:b8:21 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:55:15.032 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T21:55:15.032 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:55:15.033 INFO:teuthology.orchestra.run.smithi055.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T21:55:15.033 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-06T21:55:15.033 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T21:55:15.033 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:55:15.033 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-06T21:55:15.033 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:55:15.033 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T21:55:15.033 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T21:55:15.034 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-06T21:55:15.034 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:55:15.034 INFO:teuthology.orchestra.run.smithi055.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T21:55:15.034 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T21:55:15.034 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-06T21:55:15.034 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:55:15.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:15.035 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T21:55:15.099 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-07-06T21:55:15.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:15.101 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-07-06T21:55:15.154 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-07-06T21:55:15.154 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T21:55:15.154 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-06T21:55:15.154 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T21:55:15.154 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-06T21:55:15.154 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T21:55:15.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:15.155 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:55:15.155 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:55:15.156 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T21:55:15.156 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T21:55:15.156 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T21:55:15.157 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:55:15.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:15.249 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T21:55:15.258 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T21:55:15.259 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T21:55:15.259 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:55:15.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:15.260 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-07-06T21:55:15.321 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:55:15.321 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T21:55:15.372 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:55:15.373 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:55:15.373 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T21:55:15.424 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-06T21:55:15.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:15.425 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:55:15.515 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:55:15.516 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:55:15.530 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:55:15.531 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:55:15.531 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-07-06T21:55:15.531 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.cephfs=/ 2023-07-06T21:55:15.531 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-07-06T21:55:15.535 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T21:55:15.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:15.537 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T21:55:15.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:15.561 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:55:15.619 INFO:teuthology.orchestra.run.smithi055.stdout:client6540 2023-07-06T21:55:15.619 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:55:15.620 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:55:15.669 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-06T21:55:15.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.854+0000 7f81b1537640 1 Processor -- start 2023-07-06T21:55:15.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.854+0000 7f81b1537640 1 -- start start 2023-07-06T21:55:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.858+0000 7f81b1537640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f81ac0ca130 0x7f81ac0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.858+0000 7f81b1537640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ac0c8db0 con 0x7f81ac0cd140 2023-07-06T21:55:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.858+0000 7f81b1537640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ac0c9090 con 0x7f81ac158850 2023-07-06T21:55:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.858+0000 7f81b1537640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ac158ce0 con 0x7f81ac0ca130 2023-07-06T21:55:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.858+0000 7f81ab7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f81ac0cd140 0x7f81ac0b1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41802/0 (socket says 172.21.15.55:41802) 2023-07-06T21:55:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.858+0000 7f81ab7fe640 1 -- 172.21.15.55:0/1638158955 learned_addr learned my addr 172.21.15.55:0/1638158955 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:55:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.858+0000 7f81a3fff640 1 --2- 172.21.15.55:0/1638158955 >> v2:172.21.15.138:3300/0 conn(0x7f81ac0ca130 0x7f81ac0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.858+0000 7f81aa7fc640 1 -- 172.21.15.55:0/1638158955 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356733935 0 0) 0x7f81ac0c8db0 con 0x7f81ac0cd140 2023-07-06T21:55:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.858+0000 7f81aa7fc640 1 -- 172.21.15.55:0/1638158955 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8198005740 con 0x7f81ac0cd140 2023-07-06T21:55:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.858+0000 7f81a3fff640 1 -- 172.21.15.55:0/1638158955 >> v1:172.21.15.138:6789/0 conn(0x7f81ac158850 legacy=0x7f81ac0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.858+0000 7f81a3fff640 1 -- 172.21.15.55:0/1638158955 >> v1:172.21.15.55:6789/0 conn(0x7f81ac0cd140 legacy=0x7f81ac0b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.858+0000 7f81a3fff640 1 -- 172.21.15.55:0/1638158955 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac0c9370 con 0x7f81ac0ca130 2023-07-06T21:55:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.862+0000 7f81a3fff640 1 --2- 172.21.15.55:0/1638158955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81ac0ca130 0x7f81ac0703e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f81940097c0 tx=0x7f819401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=592ed75cbfc039f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.862+0000 7f81aa7fc640 1 -- 172.21.15.55:0/1638158955 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81940ab650 con 0x7f81ac0ca130 2023-07-06T21:55:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.862+0000 7f81aa7fc640 1 -- 172.21.15.55:0/1638158955 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81940ab7b0 con 0x7f81ac0ca130 2023-07-06T21:55:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.862+0000 7f81aa7fc640 1 -- 172.21.15.55:0/1638158955 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81940abb40 con 0x7f81ac0ca130 2023-07-06T21:55:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.862+0000 7f81b1537640 1 -- 172.21.15.55:0/1638158955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81ac0ca130 msgr2=0x7f81ac0703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.862+0000 7f81b1537640 1 --2- 172.21.15.55:0/1638158955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81ac0ca130 0x7f81ac0703e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f81940097c0 tx=0x7f819401c450 comp rx=0 tx=0).stop 2023-07-06T21:55:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.862+0000 7f81b1537640 1 -- 172.21.15.55:0/1638158955 shutdown_connections 2023-07-06T21:55:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.862+0000 7f81b1537640 1 --2- 172.21.15.55:0/1638158955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81ac0ca130 0x7f81ac0703e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.862+0000 7f81b1537640 1 -- 172.21.15.55:0/1638158955 >> 172.21.15.55:0/1638158955 conn(0x7f81ac0cea70 msgr2=0x7f81ac0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.862+0000 7f81b1537640 1 -- 172.21.15.55:0/1638158955 shutdown_connections 2023-07-06T21:55:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.862+0000 7f81b1537640 1 -- 172.21.15.55:0/1638158955 wait complete. 2023-07-06T21:55:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.862+0000 7f81b1537640 1 Processor -- start 2023-07-06T21:55:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.862+0000 7f81b1537640 1 -- start start 2023-07-06T21:55:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81b1537640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81ac0ca130 0x7f81ac09e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81b1537640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81ac0cd140 0x7f81ac06a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81b1537640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81ac158850 0x7f81ac069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81b1537640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac06b410 con 0x7f81ac0cd140 2023-07-06T21:55:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81b1537640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac06b6f0 con 0x7f81ac158850 2023-07-06T21:55:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81b1537640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac06b9d0 con 0x7f81ac0ca130 2023-07-06T21:55:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81a3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81ac0cd140 0x7f81ac06a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81a3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81ac0cd140 0x7f81ac06a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49304/0 (socket says 172.21.15.55:49304) 2023-07-06T21:55:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81a3fff640 1 -- 172.21.15.55:0/904046440 learned_addr learned my addr 172.21.15.55:0/904046440 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81ab7fe640 1 --2- 172.21.15.55:0/904046440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81ac158850 0x7f81ac069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:15.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81aaffd640 1 --2- 172.21.15.55:0/904046440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81ac0ca130 0x7f81ac09e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:15.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81a3fff640 1 -- 172.21.15.55:0/904046440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81ac0ca130 msgr2=0x7f81ac09e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81a3fff640 1 --2- 172.21.15.55:0/904046440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81ac0ca130 0x7f81ac09e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81a3fff640 1 -- 172.21.15.55:0/904046440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81ac158850 msgr2=0x7f81ac069990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81a3fff640 1 --2- 172.21.15.55:0/904046440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81ac158850 0x7f81ac069990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81a3fff640 1 -- 172.21.15.55:0/904046440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8194009420 con 0x7f81ac0cd140 2023-07-06T21:55:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81a3fff640 1 --2- 172.21.15.55:0/904046440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81ac0cd140 0x7f81ac06a9c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f81940ad040 tx=0x7f819401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81a37fe640 1 -- 172.21.15.55:0/904046440 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81940bf610 con 0x7f81ac0cd140 2023-07-06T21:55:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81a37fe640 1 -- 172.21.15.55:0/904046440 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81940bf790 con 0x7f81ac0cd140 2023-07-06T21:55:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81b1537640 1 -- 172.21.15.55:0/904046440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ac06bcb0 con 0x7f81ac0cd140 2023-07-06T21:55:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81a37fe640 1 -- 172.21.15.55:0/904046440 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81940bfb40 con 0x7f81ac0cd140 2023-07-06T21:55:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81b1537640 1 -- 172.21.15.55:0/904046440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ac158fd0 con 0x7f81ac0cd140 2023-07-06T21:55:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81b1537640 1 -- 172.21.15.55:0/904046440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ac066d60 con 0x7f81ac0cd140 2023-07-06T21:55:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.866+0000 7f81a37fe640 1 -- 172.21.15.55:0/904046440 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f81940bfca0 con 0x7f81ac0cd140 2023-07-06T21:55:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.870+0000 7f81a37fe640 1 --2- 172.21.15.55:0/904046440 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f818c0663a0 0x7f818c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.870+0000 7f81a37fe640 1 -- 172.21.15.55:0/904046440 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f819411e9f0 con 0x7f81ac0cd140 2023-07-06T21:55:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.870+0000 7f81aaffd640 1 --2- 172.21.15.55:0/904046440 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f818c0663a0 0x7f818c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:15.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.870+0000 7f81aaffd640 1 --2- 172.21.15.55:0/904046440 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f818c0663a0 0x7f818c068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f819c007fd0 tx=0x7f819c009040 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:15.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:15.874+0000 7f81a37fe640 1 -- 172.21.15.55:0/904046440 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81940ebd50 con 0x7f81ac0cd140 2023-07-06T21:55:16.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.046+0000 7f81b1537640 1 -- 172.21.15.55:0/904046440 --> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f81ac070d30 con 0x7f818c0663a0 2023-07-06T21:55:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.046+0000 7f81a37fe640 1 -- 172.21.15.55:0/904046440 <== mgr.6102 v2:172.21.15.55:6832/3843972996 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f819c001450 con 0x7f818c0663a0 2023-07-06T21:55:16.048 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T21:55:16.049 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:55:16.049 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-07-06T21:55:16.049 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:55:16.049 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T21:55:16.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.050+0000 7f81b1537640 1 -- 172.21.15.55:0/904046440 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f818c0663a0 msgr2=0x7f818c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:16.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.050+0000 7f81b1537640 1 --2- 172.21.15.55:0/904046440 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f818c0663a0 0x7f818c068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f819c007fd0 tx=0x7f819c009040 comp rx=0 tx=0).stop 2023-07-06T21:55:16.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.050+0000 7f81b1537640 1 -- 172.21.15.55:0/904046440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81ac0cd140 msgr2=0x7f81ac06a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.050+0000 7f81b1537640 1 --2- 172.21.15.55:0/904046440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81ac0cd140 0x7f81ac06a9c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f81940ad040 tx=0x7f819401ac90 comp rx=0 tx=0).stop 2023-07-06T21:55:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.050+0000 7f81b1537640 1 -- 172.21.15.55:0/904046440 shutdown_connections 2023-07-06T21:55:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.050+0000 7f81b1537640 1 --2- 172.21.15.55:0/904046440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81ac158850 0x7f81ac069990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.050+0000 7f81b1537640 1 --2- 172.21.15.55:0/904046440 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f818c0663a0 0x7f818c068850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.050+0000 7f81b1537640 1 --2- 172.21.15.55:0/904046440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81ac0cd140 0x7f81ac06a9c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.050+0000 7f81b1537640 1 --2- 172.21.15.55:0/904046440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81ac0ca130 0x7f81ac09e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.050+0000 7f81b1537640 1 -- 172.21.15.55:0/904046440 >> 172.21.15.55:0/904046440 conn(0x7f81ac0cea70 msgr2=0x7f81ac0b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.050+0000 7f81b1537640 1 -- 172.21.15.55:0/904046440 shutdown_connections 2023-07-06T21:55:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.050+0000 7f81b1537640 1 -- 172.21.15.55:0/904046440 wait complete. 2023-07-06T21:55:16.069 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-06T21:55:16.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.214+0000 7f48315fa640 1 Processor -- start 2023-07-06T21:55:16.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.214+0000 7f48315fa640 1 -- start start 2023-07-06T21:55:16.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.214+0000 7f48315fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f482c0709a0 0x7f482c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:16.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.214+0000 7f48315fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c0cc300 con 0x7f482c0cbe60 2023-07-06T21:55:16.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.214+0000 7f48315fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c0cc5e0 con 0x7f482c0b1340 2023-07-06T21:55:16.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.214+0000 7f48315fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482c0cc8c0 con 0x7f482c0709a0 2023-07-06T21:55:16.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.214+0000 7f482affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f482c0709a0 0x7f482c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:16.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.214+0000 7f482a7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f482c0cbe60 0x7f482c0b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41816/0 (socket says 172.21.15.55:41816) 2023-07-06T21:55:16.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.214+0000 7f482a7fc640 1 -- 172.21.15.55:0/3227897433 learned_addr learned my addr 172.21.15.55:0/3227897433 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:55:16.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.214+0000 7f482affd640 1 -- 172.21.15.55:0/3227897433 >> v1:172.21.15.138:6789/0 conn(0x7f482c0b1340 legacy=0x7f482c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:16.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.214+0000 7f482affd640 1 -- 172.21.15.55:0/3227897433 >> v1:172.21.15.55:6789/0 conn(0x7f482c0cbe60 legacy=0x7f482c0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:16.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.214+0000 7f482affd640 1 -- 172.21.15.55:0/3227897433 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c0ccba0 con 0x7f482c0709a0 2023-07-06T21:55:16.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.214+0000 7f4829ffb640 1 -- 172.21.15.55:0/3227897433 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545965563 0 0) 0x7f482c0cc300 con 0x7f482c0cbe60 2023-07-06T21:55:16.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.218+0000 7f482affd640 1 --2- 172.21.15.55:0/3227897433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0709a0 0x7f482c0cb920 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f481c0097c0 tx=0x7f481c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f48e663f93166b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:16.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.218+0000 7f4829ffb640 1 -- 172.21.15.55:0/3227897433 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c0a8050 con 0x7f482c0709a0 2023-07-06T21:55:16.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.218+0000 7f4829ffb640 1 -- 172.21.15.55:0/3227897433 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c0ac5f0 con 0x7f482c0709a0 2023-07-06T21:55:16.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.218+0000 7f4829ffb640 1 -- 172.21.15.55:0/3227897433 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c0ac980 con 0x7f482c0709a0 2023-07-06T21:55:16.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.218+0000 7f48315fa640 1 -- 172.21.15.55:0/3227897433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0709a0 msgr2=0x7f482c0cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:16.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.218+0000 7f48315fa640 1 --2- 172.21.15.55:0/3227897433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0709a0 0x7f482c0cb920 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f481c0097c0 tx=0x7f481c01c480 comp rx=0 tx=0).stop 2023-07-06T21:55:16.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.218+0000 7f48315fa640 1 -- 172.21.15.55:0/3227897433 shutdown_connections 2023-07-06T21:55:16.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.218+0000 7f48315fa640 1 --2- 172.21.15.55:0/3227897433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0709a0 0x7f482c0cb920 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.218+0000 7f48315fa640 1 -- 172.21.15.55:0/3227897433 >> 172.21.15.55:0/3227897433 conn(0x7f482c0cea70 msgr2=0x7f482c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:16.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.218+0000 7f48315fa640 1 -- 172.21.15.55:0/3227897433 shutdown_connections 2023-07-06T21:55:16.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.218+0000 7f48315fa640 1 -- 172.21.15.55:0/3227897433 wait complete. 2023-07-06T21:55:16.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.218+0000 7f48315fa640 1 Processor -- start 2023-07-06T21:55:16.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f48315fa640 1 -- start start 2023-07-06T21:55:16.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f48315fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0709a0 0x7f482c15e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:16.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f48315fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f482c0b1340 0x7f482c158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:16.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f48315fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f482c0cbe60 0x7f482c160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:16.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f48315fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c15e200 con 0x7f482c0709a0 2023-07-06T21:55:16.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f48315fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c15ebd0 con 0x7f482c0cbe60 2023-07-06T21:55:16.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f48315fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c15d5f0 con 0x7f482c0b1340 2023-07-06T21:55:16.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f482affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0709a0 0x7f482c15e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:16.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f482affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0709a0 0x7f482c15e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49326/0 (socket says 172.21.15.55:49326) 2023-07-06T21:55:16.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f482affd640 1 -- 172.21.15.55:0/3356145719 learned_addr learned my addr 172.21.15.55:0/3356145719 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:16.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f482a7fc640 1 --2- 172.21.15.55:0/3356145719 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f482c0b1340 0x7f482c158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:16.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f482b7fe640 1 --2- 172.21.15.55:0/3356145719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f482c0cbe60 0x7f482c160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:16.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f482affd640 1 -- 172.21.15.55:0/3356145719 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f482c0b1340 msgr2=0x7f482c158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:16.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f482affd640 1 --2- 172.21.15.55:0/3356145719 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f482c0b1340 0x7f482c158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f482affd640 1 -- 172.21.15.55:0/3356145719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f482c0cbe60 msgr2=0x7f482c160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:16.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f482affd640 1 --2- 172.21.15.55:0/3356145719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f482c0cbe60 0x7f482c160dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f482affd640 1 -- 172.21.15.55:0/3356145719 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c009420 con 0x7f482c0709a0 2023-07-06T21:55:16.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f482affd640 1 --2- 172.21.15.55:0/3356145719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0709a0 0x7f482c15e690 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f481c0af040 tx=0x7f481c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:16.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f48137fe640 1 -- 172.21.15.55:0/3356145719 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c0b8860 con 0x7f482c0709a0 2023-07-06T21:55:16.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f48137fe640 1 -- 172.21.15.55:0/3356145719 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c0b89c0 con 0x7f482c0709a0 2023-07-06T21:55:16.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f48137fe640 1 -- 172.21.15.55:0/3356145719 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c0b8d70 con 0x7f482c0709a0 2023-07-06T21:55:16.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f48315fa640 1 -- 172.21.15.55:0/3356145719 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482c15d8d0 con 0x7f482c0709a0 2023-07-06T21:55:16.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f48315fa640 1 -- 172.21.15.55:0/3356145719 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482c15de90 con 0x7f482c0709a0 2023-07-06T21:55:16.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.222+0000 7f48315fa640 1 -- 172.21.15.55:0/3356145719 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482c066d60 con 0x7f482c0709a0 2023-07-06T21:55:16.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.226+0000 7f48137fe640 1 -- 172.21.15.55:0/3356145719 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f481c0c2410 con 0x7f482c0709a0 2023-07-06T21:55:16.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.226+0000 7f48137fe640 1 --2- 172.21.15.55:0/3356145719 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f48180663d0 0x7f4818068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:16.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.226+0000 7f48137fe640 1 -- 172.21.15.55:0/3356145719 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f481c11e770 con 0x7f482c0709a0 2023-07-06T21:55:16.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.226+0000 7f482a7fc640 1 --2- 172.21.15.55:0/3356145719 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f48180663d0 0x7f4818068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:16.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.226+0000 7f482a7fc640 1 --2- 172.21.15.55:0/3356145719 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f48180663d0 0x7f4818068880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f482c0ca580 tx=0x7f4820007d10 comp rx=0 tx=0).ready entity=mgr.6102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:16.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.230+0000 7f48137fe640 1 -- 172.21.15.55:0/3356145719 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f481c0eb7f0 con 0x7f482c0709a0 2023-07-06T21:55:16.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.422+0000 7f48315fa640 1 -- 172.21.15.55:0/3356145719 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f482c0c7e50 con 0x7f482c0709a0 2023-07-06T21:55:16.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.614+0000 7f48137fe640 1 -- 172.21.15.55:0/3356145719 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 19) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f481c0ebbc0 con 0x7f482c0709a0 2023-07-06T21:55:16.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.618+0000 7f48137fe640 1 -- 172.21.15.55:0/3356145719 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7f481c103e00 con 0x7f482c0709a0 2023-07-06T21:55:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.618+0000 7f48315fa640 1 -- 172.21.15.55:0/3356145719 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f48180663d0 msgr2=0x7f4818068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.618+0000 7f48315fa640 1 --2- 172.21.15.55:0/3356145719 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f48180663d0 0x7f4818068880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f482c0ca580 tx=0x7f4820007d10 comp rx=0 tx=0).stop 2023-07-06T21:55:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.618+0000 7f48315fa640 1 -- 172.21.15.55:0/3356145719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0709a0 msgr2=0x7f482c15e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.618+0000 7f48315fa640 1 --2- 172.21.15.55:0/3356145719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0709a0 0x7f482c15e690 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f481c0af040 tx=0x7f481c01acc0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.618+0000 7f48315fa640 1 -- 172.21.15.55:0/3356145719 shutdown_connections 2023-07-06T21:55:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.618+0000 7f48315fa640 1 --2- 172.21.15.55:0/3356145719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f482c0cbe60 0x7f482c160dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.618+0000 7f48315fa640 1 --2- 172.21.15.55:0/3356145719 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f482c0b1340 0x7f482c158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.618+0000 7f48315fa640 1 --2- 172.21.15.55:0/3356145719 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f48180663d0 0x7f4818068880 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.618+0000 7f48315fa640 1 --2- 172.21.15.55:0/3356145719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0709a0 0x7f482c15e690 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.618+0000 7f48315fa640 1 -- 172.21.15.55:0/3356145719 >> 172.21.15.55:0/3356145719 conn(0x7f482c0cea70 msgr2=0x7f482c06a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:16.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.618+0000 7f48315fa640 1 -- 172.21.15.55:0/3356145719 shutdown_connections 2023-07-06T21:55:16.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.618+0000 7f48315fa640 1 -- 172.21.15.55:0/3356145719 wait complete. 2023-07-06T21:55:16.648 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-06T21:55:16.782 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:16.781+0000 7f9e2bee9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:55:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f23a5ff6640 1 Processor -- start 2023-07-06T21:55:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f23a5ff6640 1 -- start start 2023-07-06T21:55:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f23a5ff6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23a00b3870 0x7f23a00b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f23a5ff6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23a00d03c0 0x7f23a00d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f23a5ff6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a00b2b80 con 0x7f23a015b850 2023-07-06T21:55:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f23a5ff6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a00cff30 con 0x7f23a00d03c0 2023-07-06T21:55:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f23a5ff6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00b41e0 con 0x7f23a00b3870 2023-07-06T21:55:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f239ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23a00d03c0 0x7f23a00d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f239ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23a00d03c0 0x7f23a00d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49340/0 (socket says 172.21.15.55:49340) 2023-07-06T21:55:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f239ffff640 1 -- 172.21.15.55:0/2975643210 learned_addr learned my addr 172.21.15.55:0/2975643210 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f239effd640 1 --2- 172.21.15.55:0/2975643210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23a00b3870 0x7f23a00b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f239effd640 1 -- 172.21.15.55:0/2975643210 >> v2:172.21.15.55:3300/0 conn(0x7f23a00d03c0 msgr2=0x7f23a00d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:16.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f239effd640 1 --2- 172.21.15.55:0/2975643210 >> v2:172.21.15.55:3300/0 conn(0x7f23a00d03c0 0x7f23a00d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f239effd640 1 -- 172.21.15.55:0/2975643210 >> v1:172.21.15.55:6789/0 conn(0x7f23a015b850 legacy=0x7f23a00cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:16.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f239effd640 1 -- 172.21.15.55:0/2975643210 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a00b22e0 con 0x7f23a00b3870 2023-07-06T21:55:16.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.798+0000 7f239ffff640 1 --2- 172.21.15.55:0/2975643210 >> v2:172.21.15.55:3300/0 conn(0x7f23a00d03c0 0x7f23a00d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:55:16.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.802+0000 7f239effd640 1 --2- 172.21.15.55:0/2975643210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23a00b3870 0x7f23a00b3ca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f23940097c0 tx=0x7f239401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85b9b31fae593a51 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:16.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.802+0000 7f239e7fc640 1 -- 172.21.15.55:0/2975643210 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940ab600 con 0x7f23a00b3870 2023-07-06T21:55:16.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.802+0000 7f239e7fc640 1 -- 172.21.15.55:0/2975643210 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23940a7050 con 0x7f23a00b3870 2023-07-06T21:55:16.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.802+0000 7f239e7fc640 1 -- 172.21.15.55:0/2975643210 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940ab980 con 0x7f23a00b3870 2023-07-06T21:55:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.802+0000 7f23a5ff6640 1 -- 172.21.15.55:0/2975643210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23a00b3870 msgr2=0x7f23a00b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.802+0000 7f23a5ff6640 1 --2- 172.21.15.55:0/2975643210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23a00b3870 0x7f23a00b3ca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f23940097c0 tx=0x7f239401c330 comp rx=0 tx=0).stop 2023-07-06T21:55:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.802+0000 7f23a5ff6640 1 -- 172.21.15.55:0/2975643210 shutdown_connections 2023-07-06T21:55:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.802+0000 7f23a5ff6640 1 --2- 172.21.15.55:0/2975643210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23a00b3870 0x7f23a00b3ca0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.802+0000 7f23a5ff6640 1 --2- 172.21.15.55:0/2975643210 >> v2:172.21.15.55:3300/0 conn(0x7f23a00d03c0 0x7f23a00d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.802+0000 7f23a5ff6640 1 -- 172.21.15.55:0/2975643210 >> 172.21.15.55:0/2975643210 conn(0x7f23a00cec20 msgr2=0x7f23a00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:16.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.802+0000 7f23a5ff6640 1 -- 172.21.15.55:0/2975643210 shutdown_connections 2023-07-06T21:55:16.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.802+0000 7f23a5ff6640 1 -- 172.21.15.55:0/2975643210 wait complete. 2023-07-06T21:55:16.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f23a5ff6640 1 Processor -- start 2023-07-06T21:55:16.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f23a5ff6640 1 -- start start 2023-07-06T21:55:16.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f23a5ff6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23a00b3870 0x7f23a015ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:16.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f23a5ff6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23a00d03c0 0x7f23a00c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f23a5ff6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23a015b850 0x7f23a00caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f23a5ff6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00c9c40 con 0x7f23a00d03c0 2023-07-06T21:55:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f23a5ff6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a015f190 con 0x7f23a015b850 2023-07-06T21:55:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f23a5ff6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a015bfd0 con 0x7f23a00b3870 2023-07-06T21:55:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f239effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23a00d03c0 0x7f23a00c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:16.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f239effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23a00d03c0 0x7f23a00c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49356/0 (socket says 172.21.15.55:49356) 2023-07-06T21:55:16.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f239effd640 1 -- 172.21.15.55:0/3975074718 learned_addr learned my addr 172.21.15.55:0/3975074718 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:16.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f239ffff640 1 --2- 172.21.15.55:0/3975074718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23a015b850 0x7f23a00caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:16.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f239f7fe640 1 --2- 172.21.15.55:0/3975074718 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23a00b3870 0x7f23a015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:16.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f239effd640 1 -- 172.21.15.55:0/3975074718 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23a00b3870 msgr2=0x7f23a015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:16.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f239effd640 1 --2- 172.21.15.55:0/3975074718 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23a00b3870 0x7f23a015ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f239effd640 1 -- 172.21.15.55:0/3975074718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23a015b850 msgr2=0x7f23a00caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:16.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f239effd640 1 --2- 172.21.15.55:0/3975074718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23a015b850 0x7f23a00caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f239effd640 1 -- 172.21.15.55:0/3975074718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2398009b30 con 0x7f23a00d03c0 2023-07-06T21:55:16.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f239effd640 1 --2- 172.21.15.55:0/3975074718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23a00d03c0 0x7f23a00c7e90 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f23940ae040 tx=0x7f23940190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:16.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f2387fff640 1 -- 172.21.15.55:0/3975074718 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940b4410 con 0x7f23a00d03c0 2023-07-06T21:55:16.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f2387fff640 1 -- 172.21.15.55:0/3975074718 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23940b4570 con 0x7f23a00d03c0 2023-07-06T21:55:16.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f23a5ff6640 1 -- 172.21.15.55:0/3975074718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2394009420 con 0x7f23a00d03c0 2023-07-06T21:55:16.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.806+0000 7f2387fff640 1 -- 172.21.15.55:0/3975074718 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940b4920 con 0x7f23a00d03c0 2023-07-06T21:55:16.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.810+0000 7f23a5ff6640 1 -- 172.21.15.55:0/3975074718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a00ca100 con 0x7f23a00d03c0 2023-07-06T21:55:16.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.810+0000 7f23a5ff6640 1 -- 172.21.15.55:0/3975074718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a015c190 con 0x7f23a00d03c0 2023-07-06T21:55:16.812 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:16.810+0000 7f3b4c144180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:55:16.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.810+0000 7f2387fff640 1 -- 172.21.15.55:0/3975074718 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f23940b2040 con 0x7f23a00d03c0 2023-07-06T21:55:16.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.810+0000 7f2387fff640 1 --2- 172.21.15.55:0/3975074718 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f238c0663f0 0x7f238c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:16.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.810+0000 7f239f7fe640 1 -- 172.21.15.55:0/3975074718 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f238c0663f0 msgr2=0x7f238c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3843972996 2023-07-06T21:55:16.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.810+0000 7f2387fff640 1 -- 172.21.15.55:0/3975074718 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f239411e110 con 0x7f23a00d03c0 2023-07-06T21:55:16.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.810+0000 7f239f7fe640 1 --2- 172.21.15.55:0/3975074718 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f238c0663f0 0x7f238c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:55:16.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.814+0000 7f2387fff640 1 -- 172.21.15.55:0/3975074718 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f23940eb240 con 0x7f23a00d03c0 2023-07-06T21:55:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.970+0000 7f23a5ff6640 1 -- 172.21.15.55:0/3975074718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f23a0066d60 con 0x7f23a00d03c0 2023-07-06T21:55:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.978+0000 7f2387fff640 1 -- 172.21.15.55:0/3975074718 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v17)=0 v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f23940ee860 con 0x7f23a00d03c0 2023-07-06T21:55:16.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.978+0000 7f23a5ff6640 1 -- 172.21.15.55:0/3975074718 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f238c0663f0 msgr2=0x7f238c0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:55:16.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.978+0000 7f23a5ff6640 1 --2- 172.21.15.55:0/3975074718 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f238c0663f0 0x7f238c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.978+0000 7f23a5ff6640 1 -- 172.21.15.55:0/3975074718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23a00d03c0 msgr2=0x7f23a00c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.978+0000 7f23a5ff6640 1 --2- 172.21.15.55:0/3975074718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23a00d03c0 0x7f23a00c7e90 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f23940ae040 tx=0x7f23940190d0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.978+0000 7f23a5ff6640 1 -- 172.21.15.55:0/3975074718 shutdown_connections 2023-07-06T21:55:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.978+0000 7f23a5ff6640 1 --2- 172.21.15.55:0/3975074718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23a015b850 0x7f23a00caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.978+0000 7f23a5ff6640 1 --2- 172.21.15.55:0/3975074718 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f238c0663f0 0x7f238c0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.978+0000 7f23a5ff6640 1 --2- 172.21.15.55:0/3975074718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23a00d03c0 0x7f23a00c7e90 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.978+0000 7f23a5ff6640 1 --2- 172.21.15.55:0/3975074718 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23a00b3870 0x7f23a015ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:16.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.978+0000 7f23a5ff6640 1 -- 172.21.15.55:0/3975074718 >> 172.21.15.55:0/3975074718 conn(0x7f23a00cec20 msgr2=0x7f23a015f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:16.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.978+0000 7f23a5ff6640 1 -- 172.21.15.55:0/3975074718 shutdown_connections 2023-07-06T21:55:16.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:16.978+0000 7f23a5ff6640 1 -- 172.21.15.55:0/3975074718 wait complete. 2023-07-06T21:55:17.000 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-06T21:55:17.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.146+0000 7f2f975c5640 1 Processor -- start 2023-07-06T21:55:17.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.146+0000 7f2f975c5640 1 -- start start 2023-07-06T21:55:17.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.150+0000 7f2f975c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f900b3870 0x7f2f900b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:17.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.150+0000 7f2f975c5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2f900d03c0 0x7f2f900d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:17.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.150+0000 7f2f975c5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f900b4210 con 0x7f2f9015b850 2023-07-06T21:55:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.150+0000 7f2f975c5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f900b2b80 con 0x7f2f900b3870 2023-07-06T21:55:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.150+0000 7f2f975c5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f900cff30 con 0x7f2f900d03c0 2023-07-06T21:55:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.150+0000 7f2f94b60640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f900b3870 0x7f2f900b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.150+0000 7f2f94b60640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f900b3870 0x7f2f900b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49370/0 (socket says 172.21.15.55:49370) 2023-07-06T21:55:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.150+0000 7f2f94b60640 1 -- 172.21.15.55:0/3441709117 learned_addr learned my addr 172.21.15.55:0/3441709117 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.150+0000 7f2f95b62640 1 --2- 172.21.15.55:0/3441709117 >> v2:172.21.15.138:3300/0 conn(0x7f2f900d03c0 0x7f2f900d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.150+0000 7f2f94b60640 1 -- 172.21.15.55:0/3441709117 >> v2:172.21.15.138:3300/0 conn(0x7f2f900d03c0 msgr2=0x7f2f900d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.150+0000 7f2f94b60640 1 --2- 172.21.15.55:0/3441709117 >> v2:172.21.15.138:3300/0 conn(0x7f2f900d03c0 0x7f2f900d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.150+0000 7f2f94b60640 1 -- 172.21.15.55:0/3441709117 >> v1:172.21.15.138:6789/0 conn(0x7f2f9015b850 legacy=0x7f2f900cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.150+0000 7f2f94b60640 1 -- 172.21.15.55:0/3441709117 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f900b22e0 con 0x7f2f900b3870 2023-07-06T21:55:17.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.154+0000 7f2f94b60640 1 --2- 172.21.15.55:0/3441709117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f900b3870 0x7f2f900b3cd0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2f900cc780 tx=0x7f2f8001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b411cfa72a6b412b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:17.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.154+0000 7f2f87fff640 1 -- 172.21.15.55:0/3441709117 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800ac410 con 0x7f2f900b3870 2023-07-06T21:55:17.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.154+0000 7f2f87fff640 1 -- 172.21.15.55:0/3441709117 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f800ac570 con 0x7f2f900b3870 2023-07-06T21:55:17.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.154+0000 7f2f87fff640 1 -- 172.21.15.55:0/3441709117 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800ac900 con 0x7f2f900b3870 2023-07-06T21:55:17.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.154+0000 7f2f975c5640 1 -- 172.21.15.55:0/3441709117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f900b3870 msgr2=0x7f2f900b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:17.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.154+0000 7f2f975c5640 1 --2- 172.21.15.55:0/3441709117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f900b3870 0x7f2f900b3cd0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2f900cc780 tx=0x7f2f8001c3b0 comp rx=0 tx=0).stop 2023-07-06T21:55:17.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.154+0000 7f2f975c5640 1 -- 172.21.15.55:0/3441709117 shutdown_connections 2023-07-06T21:55:17.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.154+0000 7f2f975c5640 1 --2- 172.21.15.55:0/3441709117 >> v2:172.21.15.138:3300/0 conn(0x7f2f900d03c0 0x7f2f900d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:17.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.154+0000 7f2f975c5640 1 --2- 172.21.15.55:0/3441709117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f900b3870 0x7f2f900b3cd0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:17.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.154+0000 7f2f975c5640 1 -- 172.21.15.55:0/3441709117 >> 172.21.15.55:0/3441709117 conn(0x7f2f900cec20 msgr2=0x7f2f900cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:17.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.154+0000 7f2f975c5640 1 -- 172.21.15.55:0/3441709117 shutdown_connections 2023-07-06T21:55:17.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.154+0000 7f2f975c5640 1 -- 172.21.15.55:0/3441709117 wait complete. 2023-07-06T21:55:17.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.154+0000 7f2f975c5640 1 Processor -- start 2023-07-06T21:55:17.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.154+0000 7f2f975c5640 1 -- start start 2023-07-06T21:55:17.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f975c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f900b3870 0x7f2f9015cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f975c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f900d03c0 0x7f2f9015e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f975c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f9015b850 0x7f2f90151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f975c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9015ed80 con 0x7f2f900d03c0 2023-07-06T21:55:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f975c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9015de70 con 0x7f2f900b3870 2023-07-06T21:55:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f975c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9015d5d0 con 0x7f2f9015b850 2023-07-06T21:55:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f94b60640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f900d03c0 0x7f2f9015e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f94b60640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f900d03c0 0x7f2f9015e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49380/0 (socket says 172.21.15.55:49380) 2023-07-06T21:55:17.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f94b60640 1 -- 172.21.15.55:0/493807475 learned_addr learned my addr 172.21.15.55:0/493807475 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f94b60640 1 -- 172.21.15.55:0/493807475 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f9015b850 msgr2=0x7f2f90151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f94b60640 1 --2- 172.21.15.55:0/493807475 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f9015b850 0x7f2f90151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f94b60640 1 -- 172.21.15.55:0/493807475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f900b3870 msgr2=0x7f2f9015cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f94b60640 1 --2- 172.21.15.55:0/493807475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f900b3870 0x7f2f9015cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f94b60640 1 -- 172.21.15.55:0/493807475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800094d0 con 0x7f2f900d03c0 2023-07-06T21:55:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f94b60640 1 --2- 172.21.15.55:0/493807475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f900d03c0 0x7f2f9015e840 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2f80018fc0 tx=0x7f2f80019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:17.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f85ffb640 1 -- 172.21.15.55:0/493807475 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800ac410 con 0x7f2f900d03c0 2023-07-06T21:55:17.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f85ffb640 1 -- 172.21.15.55:0/493807475 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f800ace10 con 0x7f2f900d03c0 2023-07-06T21:55:17.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f85ffb640 1 -- 172.21.15.55:0/493807475 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800b6830 con 0x7f2f900d03c0 2023-07-06T21:55:17.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f975c5640 1 -- 172.21.15.55:0/493807475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9015d8b0 con 0x7f2f900d03c0 2023-07-06T21:55:17.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f975c5640 1 -- 172.21.15.55:0/493807475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f900c93a0 con 0x7f2f900d03c0 2023-07-06T21:55:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.158+0000 7f2f975c5640 1 -- 172.21.15.55:0/493807475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f90066d60 con 0x7f2f900d03c0 2023-07-06T21:55:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.162+0000 7f2f85ffb640 1 -- 172.21.15.55:0/493807475 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f2f800b6990 con 0x7f2f900d03c0 2023-07-06T21:55:17.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.162+0000 7f2f85ffb640 1 --2- 172.21.15.55:0/493807475 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f2f74066420 0x7f2f740688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:17.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.162+0000 7f2f95361640 1 -- 172.21.15.55:0/493807475 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f2f74066420 msgr2=0x7f2f740688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3843972996 2023-07-06T21:55:17.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.162+0000 7f2f85ffb640 1 -- 172.21.15.55:0/493807475 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2f8011e8b0 con 0x7f2f900d03c0 2023-07-06T21:55:17.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.162+0000 7f2f95361640 1 --2- 172.21.15.55:0/493807475 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f2f74066420 0x7f2f740688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:55:17.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.166+0000 7f2f85ffb640 1 -- 172.21.15.55:0/493807475 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f800ebbf0 con 0x7f2f900d03c0 2023-07-06T21:55:17.199 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:17.197+0000 7f9e2bee9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:55:17.258 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:17.258+0000 7f3b4c144180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:55:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.322+0000 7f2f975c5640 1 -- 172.21.15.55:0/493807475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f2f900b3420 con 0x7f2f900d03c0 2023-07-06T21:55:17.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.330+0000 7f2f85ffb640 1 -- 172.21.15.55:0/493807475 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v18)=0 v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2f800ef210 con 0x7f2f900d03c0 2023-07-06T21:55:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.330+0000 7f2f975c5640 1 -- 172.21.15.55:0/493807475 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f2f74066420 msgr2=0x7f2f740688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:55:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.330+0000 7f2f975c5640 1 --2- 172.21.15.55:0/493807475 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f2f74066420 0x7f2f740688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.330+0000 7f2f975c5640 1 -- 172.21.15.55:0/493807475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f900d03c0 msgr2=0x7f2f9015e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.330+0000 7f2f975c5640 1 --2- 172.21.15.55:0/493807475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f900d03c0 0x7f2f9015e840 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2f80018fc0 tx=0x7f2f80019150 comp rx=0 tx=0).stop 2023-07-06T21:55:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.330+0000 7f2f975c5640 1 -- 172.21.15.55:0/493807475 shutdown_connections 2023-07-06T21:55:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.330+0000 7f2f975c5640 1 --2- 172.21.15.55:0/493807475 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f9015b850 0x7f2f90151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.330+0000 7f2f975c5640 1 --2- 172.21.15.55:0/493807475 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f2f74066420 0x7f2f740688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.330+0000 7f2f975c5640 1 --2- 172.21.15.55:0/493807475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f900d03c0 0x7f2f9015e840 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.330+0000 7f2f975c5640 1 --2- 172.21.15.55:0/493807475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f900b3870 0x7f2f9015cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.330+0000 7f2f975c5640 1 -- 172.21.15.55:0/493807475 >> 172.21.15.55:0/493807475 conn(0x7f2f900cec20 msgr2=0x7f2f90157f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.330+0000 7f2f975c5640 1 -- 172.21.15.55:0/493807475 shutdown_connections 2023-07-06T21:55:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.330+0000 7f2f975c5640 1 -- 172.21.15.55:0/493807475 wait complete. 2023-07-06T21:55:17.350 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:17.349+0000 7f9e2bee9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:55:17.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:17.352 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-06T21:55:17.367 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-06T21:55:17.420 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:17.418+0000 7f3b4c144180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:55:17.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.554+0000 7f0562434640 1 Processor -- start 2023-07-06T21:55:17.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.554+0000 7f0562434640 1 -- start start 2023-07-06T21:55:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.558+0000 7f0562434640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f055c0ccb70 0x7f055c15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.558+0000 7f0562434640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c0b3e70 con 0x7f055c0c9b90 2023-07-06T21:55:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.558+0000 7f0562434640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c159c30 con 0x7f055c0693f0 2023-07-06T21:55:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.558+0000 7f0562434640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c0c9070 con 0x7f055c0ccb70 2023-07-06T21:55:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.558+0000 7f055bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f055c0c9b90 0x7f055c0c9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41846/0 (socket says 172.21.15.55:41846) 2023-07-06T21:55:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.558+0000 7f055bfff640 1 -- 172.21.15.55:0/187501836 learned_addr learned my addr 172.21.15.55:0/187501836 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:55:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.558+0000 7f055b7fe640 1 --2- 172.21.15.55:0/187501836 >> v2:172.21.15.138:3300/0 conn(0x7f055c0ccb70 0x7f055c15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.558+0000 7f055affd640 1 -- 172.21.15.55:0/187501836 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428937590 0 0) 0x7f054c001120 con 0x7f055c0c9b90 2023-07-06T21:55:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.558+0000 7f055affd640 1 -- 172.21.15.55:0/187501836 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0544003530 con 0x7f055c0c9b90 2023-07-06T21:55:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.558+0000 7f055b7fe640 1 -- 172.21.15.55:0/187501836 >> v1:172.21.15.138:6789/0 conn(0x7f055c0693f0 legacy=0x7f055c069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.558+0000 7f055affd640 1 -- 172.21.15.55:0/187501836 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210267417 0 0) 0x7f055c159c30 con 0x7f055c0693f0 2023-07-06T21:55:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.558+0000 7f055b7fe640 1 -- 172.21.15.55:0/187501836 >> v1:172.21.15.55:6789/0 conn(0x7f055c0c9b90 legacy=0x7f055c0c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.558+0000 7f055b7fe640 1 -- 172.21.15.55:0/187501836 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c0c8480 con 0x7f055c0ccb70 2023-07-06T21:55:17.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.562+0000 7f055b7fe640 1 --2- 172.21.15.55:0/187501836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f055c0ccb70 0x7f055c15dd50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f05500097c0 tx=0x7f055001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7555e100dd21975 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.562+0000 7f055affd640 1 -- 172.21.15.55:0/187501836 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05500ab680 con 0x7f055c0ccb70 2023-07-06T21:55:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.562+0000 7f055affd640 1 -- 172.21.15.55:0/187501836 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05500ab7e0 con 0x7f055c0ccb70 2023-07-06T21:55:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.562+0000 7f055affd640 1 -- 172.21.15.55:0/187501836 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05500abb70 con 0x7f055c0ccb70 2023-07-06T21:55:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.562+0000 7f0562434640 1 -- 172.21.15.55:0/187501836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f055c0ccb70 msgr2=0x7f055c15dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.562+0000 7f0562434640 1 --2- 172.21.15.55:0/187501836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f055c0ccb70 0x7f055c15dd50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f05500097c0 tx=0x7f055001c480 comp rx=0 tx=0).stop 2023-07-06T21:55:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.562+0000 7f0562434640 1 -- 172.21.15.55:0/187501836 shutdown_connections 2023-07-06T21:55:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.562+0000 7f0562434640 1 --2- 172.21.15.55:0/187501836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f055c0ccb70 0x7f055c15dd50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.562+0000 7f0562434640 1 -- 172.21.15.55:0/187501836 >> 172.21.15.55:0/187501836 conn(0x7f055c0cde30 msgr2=0x7f055c0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:17.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.562+0000 7f0562434640 1 -- 172.21.15.55:0/187501836 shutdown_connections 2023-07-06T21:55:17.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.562+0000 7f0562434640 1 -- 172.21.15.55:0/187501836 wait complete. 2023-07-06T21:55:17.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.562+0000 7f0562434640 1 Processor -- start 2023-07-06T21:55:17.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f0562434640 1 -- start start 2023-07-06T21:55:17.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f0562434640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f055c0693f0 0x7f055c163500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:17.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f0562434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f055c0c9b90 0x7f055c159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:17.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f0562434640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f055c0ccb70 0x7f055c159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:17.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f0562434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1f8950 con 0x7f055c0c9b90 2023-07-06T21:55:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f0562434640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1f8670 con 0x7f055c0ccb70 2023-07-06T21:55:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f0562434640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c162a20 con 0x7f055c0693f0 2023-07-06T21:55:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f055b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f055c0c9b90 0x7f055c159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f055bfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f055c0693f0 0x7f055c163500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f055b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f055c0c9b90 0x7f055c159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49386/0 (socket says 172.21.15.55:49386) 2023-07-06T21:55:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f055b7fe640 1 -- 172.21.15.55:0/3108128160 learned_addr learned my addr 172.21.15.55:0/3108128160 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f05609d1640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f055c0ccb70 0x7f055c159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f055b7fe640 1 -- 172.21.15.55:0/3108128160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f055c0693f0 msgr2=0x7f055c163500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f055b7fe640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f055c0693f0 0x7f055c163500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f055b7fe640 1 -- 172.21.15.55:0/3108128160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f055c0ccb70 msgr2=0x7f055c159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f055b7fe640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f055c0ccb70 0x7f055c159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f055b7fe640 1 -- 172.21.15.55:0/3108128160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0550009420 con 0x7f055c0c9b90 2023-07-06T21:55:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f055b7fe640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f055c0c9b90 0x7f055c159050 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f05500097c0 tx=0x7f055001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f0558ff9640 1 -- 172.21.15.55:0/3108128160 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0550004220 con 0x7f055c0c9b90 2023-07-06T21:55:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f0558ff9640 1 -- 172.21.15.55:0/3108128160 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05500043a0 con 0x7f055c0c9b90 2023-07-06T21:55:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f0558ff9640 1 -- 172.21.15.55:0/3108128160 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0550004510 con 0x7f055c0c9b90 2023-07-06T21:55:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f0562434640 1 -- 172.21.15.55:0/3108128160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c162d00 con 0x7f055c0c9b90 2023-07-06T21:55:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.566+0000 7f0562434640 1 -- 172.21.15.55:0/3108128160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c06c510 con 0x7f055c0c9b90 2023-07-06T21:55:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.570+0000 7f0562434640 1 -- 172.21.15.55:0/3108128160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c162880 con 0x7f055c0c9b90 2023-07-06T21:55:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.570+0000 7f0558ff9640 1 -- 172.21.15.55:0/3108128160 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f0550003860 con 0x7f055c0c9b90 2023-07-06T21:55:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.570+0000 7f0558ff9640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05480663f0 0x7f05480688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.570+0000 7f0558ff9640 1 -- 172.21.15.55:0/3108128160 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f055011eca0 con 0x7f055c0c9b90 2023-07-06T21:55:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.570+0000 7f055bfff640 1 -- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05480663f0 msgr2=0x7f05480688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3843972996 2023-07-06T21:55:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.570+0000 7f055bfff640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05480663f0 0x7f05480688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:55:17.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.574+0000 7f0558ff9640 1 -- 172.21.15.55:0/3108128160 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f055c162880 con 0x7f055c0c9b90 2023-07-06T21:55:17.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.750+0000 7f0562434640 1 -- 172.21.15.55:0/3108128160 --> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f055c06a330 con 0x7f05480663f0 2023-07-06T21:55:17.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.774+0000 7f055bfff640 1 -- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05480663f0 msgr2=0x7f05480688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3843972996 2023-07-06T21:55:17.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:17.774+0000 7f055bfff640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05480663f0 0x7f05480688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-06T21:55:17.834 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:17.833+0000 7f9e2bee9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:55:17.892 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:17.889+0000 7f9e2bee9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:55:17.935 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:17.934+0000 7f3b4c144180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:55:17.947 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:17.945+0000 7f9e2bee9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:55:17.997 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:17.998+0000 7f3b4c144180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:55:18.033 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:18.029+0000 7f9e2bee9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:55:18.055 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:18.054+0000 7f3b4c144180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:55:18.090 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:18.089+0000 7f9e2bee9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:55:18.147 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:18.146+0000 7f3b4c144180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:55:18.174 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:18.173+0000 7f9e2bee9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:55:18.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:18.178+0000 7f055bfff640 1 -- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05480663f0 msgr2=0x7f05480688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3843972996 2023-07-06T21:55:18.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:18.178+0000 7f055bfff640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05480663f0 0x7f05480688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-06T21:55:18.208 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:18.206+0000 7f3b4c144180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:55:18.230 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:18.229+0000 7f9e2bee9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:55:18.296 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:18.294+0000 7f3b4c144180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:55:18.356 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:18.354+0000 7f3b4c144180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:55:18.371 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:18.369+0000 7f9e2bee9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:55:18.429 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:18.425+0000 7f9e2bee9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:55:18.505 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:18.506+0000 7f3b4c144180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:55:18.567 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:18.566+0000 7f3b4c144180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:55:18.668 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:55:18.668 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:55:18.668 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:55:18.676 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:18.673+0000 7f9e2bee9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:55:18.810 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:18.809+0000 7f9e2bee9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:55:18.817 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:55:18.817 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:55:18.818 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:55:18.826 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:18.826+0000 7f3b4c144180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:55:18.934 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:18.933+0000 7f9e2bee9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:55:18.967 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:18.966+0000 7f3b4c144180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:55:18.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:18.982+0000 7f055bfff640 1 -- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05480663f0 msgr2=0x7f05480688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3843972996 2023-07-06T21:55:18.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:18.982+0000 7f055bfff640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05480663f0 0x7f05480688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-06T21:55:19.004 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:19.001+0000 7f9e2bee9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:55:19.100 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:19.098+0000 7f3b4c144180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:55:19.137 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:19.137+0000 7f9e2bee9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:55:19.174 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:19.174+0000 7f3b4c144180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:55:19.315 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:19.314+0000 7f3b4c144180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:55:19.676 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:19.673+0000 7f9e2bee9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:55:19.762 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:19.761+0000 7f9e2bee9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:55:19.886 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:19.886+0000 7f3b4c144180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:55:19.911 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:19.909+0000 7f9e2bee9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:55:19.974 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:19.974+0000 7f3b4c144180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:55:19.993 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:19.993+0000 7f9e2bee9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:55:20.129 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:20.126+0000 7f3b4c144180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:55:20.217 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:20.218+0000 7f3b4c144180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:55:20.267 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:20.265+0000 7f9e2bee9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:55:20.327 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:55:20.325+0000 7f9e2bee9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:55:20.506 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:20.506+0000 7f3b4c144180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:55:20.569 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:20.570+0000 7f3b4c144180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:55:20.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:20.582+0000 7f0558ff9640 1 -- 172.21.15.55:0/3108128160 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 20) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f055011cf20 con 0x7f055c0c9b90 2023-07-06T21:55:20.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:20.582+0000 7f0558ff9640 1 -- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05480663f0 msgr2=0x7f05480688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:55:20.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:20.582+0000 7f0558ff9640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3843972996,v1:172.21.15.55:6833/3843972996] conn(0x7f05480663f0 0x7f05480688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:20.704 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:20.702+0000 7f3aca1a0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:55:20.704 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:20.702+0000 7f3aca1a0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:55:20.704 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:20.702+0000 7f3aca1a0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:55:20.704 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:20.702+0000 7f3aca1a0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:55:20.705 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:20.702+0000 7f3aca1a0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:55:20.705 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:20.702+0000 7f3acd9a7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:55:20.705 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:20.702+0000 7f3acd9a7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:55:20.705 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:20.702+0000 7f3acd9a7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:55:20.706 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:20.702+0000 7f3acd9a7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:55:20.706 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:55:20.702+0000 7f3acd9a7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:55:21.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.606+0000 7f0558ff9640 1 -- 172.21.15.55:0/3108128160 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 21) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f05500ec250 con 0x7f055c0c9b90 2023-07-06T21:55:21.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.610+0000 7f0558ff9640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f0548033eb0 0x7f0548070e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:21.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.610+0000 7f0558ff9640 1 -- 172.21.15.55:0/3108128160 --> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f05480038a0 con 0x7f0548033eb0 2023-07-06T21:55:21.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.610+0000 7f055bfff640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f0548033eb0 0x7f0548070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:21.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.614+0000 7f055bfff640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f0548033eb0 0x7f0548070e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f054c005890 tx=0x7f054c007b80 comp rx=0 tx=0).ready entity=mgr.6301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.674+0000 7f0558ff9640 1 -- 172.21.15.55:0/3108128160 <== mgr.6301 v2:172.21.15.55:6832/3229281422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f054c00e8e0 con 0x7f0548033eb0 2023-07-06T21:55:21.677 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path snap_test_dir1 2023-07-06T21:55:21.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.678+0000 7f0562434640 1 -- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f0548033eb0 msgr2=0x7f0548070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:21.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.678+0000 7f0562434640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f0548033eb0 0x7f0548070e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f054c005890 tx=0x7f054c007b80 comp rx=0 tx=0).stop 2023-07-06T21:55:21.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.678+0000 7f0562434640 1 -- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f055c0c9b90 msgr2=0x7f055c159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:21.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.678+0000 7f0562434640 1 --2- 172.21.15.55:0/3108128160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f055c0c9b90 0x7f055c159050 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f05500097c0 tx=0x7f055001acc0 comp rx=0 tx=0).stop 2023-07-06T21:55:21.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.678+0000 7f05609d1640 1 -- 172.21.15.55:0/3108128160 reap_dead start 2023-07-06T21:55:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.678+0000 7f0562434640 1 -- 172.21.15.55:0/3108128160 shutdown_connections 2023-07-06T21:55:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.678+0000 7f0562434640 1 -- 172.21.15.55:0/3108128160 >> 172.21.15.55:0/3108128160 conn(0x7f055c0cde30 msgr2=0x7f055c164940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.678+0000 7f0562434640 1 -- 172.21.15.55:0/3108128160 shutdown_connections 2023-07-06T21:55:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.678+0000 7f0562434640 1 -- 172.21.15.55:0/3108128160 wait complete. 2023-07-06T21:55:21.700 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-06T21:55:21.700 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-07-06T21:55:21.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e0d39f640 1 Processor -- start 2023-07-06T21:55:21.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e0d39f640 1 -- start start 2023-07-06T21:55:21.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e0d39f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3e0815bab0 0x7f3e080d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:21.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e0d39f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3e080ccdb0 0x7f3e080b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:21.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e0d39f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e0815be80 con 0x7f3e080cc930 2023-07-06T21:55:21.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e0d39f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e080d0ed0 con 0x7f3e0815bab0 2023-07-06T21:55:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e0d39f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e080ce910 con 0x7f3e080ccdb0 2023-07-06T21:55:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e06ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3e0815bab0 0x7f3e080d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e06ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3e0815bab0 0x7f3e080d0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49532/0 (socket says 172.21.15.55:49532) 2023-07-06T21:55:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e06ffd640 1 -- 172.21.15.55:0/4272152510 learned_addr learned my addr 172.21.15.55:0/4272152510 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e067fc640 1 --1- 172.21.15.55:0/4272152510 >> v1:172.21.15.55:6789/0 conn(0x7f3e080cc930 0x7f3e080b3d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41852/0 (socket says 172.21.15.55:41852) 2023-07-06T21:55:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e077fe640 1 --2- 172.21.15.55:0/4272152510 >> v2:172.21.15.138:3300/0 conn(0x7f3e080ccdb0 0x7f3e080b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e06ffd640 1 -- 172.21.15.55:0/4272152510 >> v2:172.21.15.138:3300/0 conn(0x7f3e080ccdb0 msgr2=0x7f3e080b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:55:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e06ffd640 1 --2- 172.21.15.55:0/4272152510 >> v2:172.21.15.138:3300/0 conn(0x7f3e080ccdb0 0x7f3e080b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e06ffd640 1 -- 172.21.15.55:0/4272152510 >> v1:172.21.15.55:6789/0 conn(0x7f3e080cc930 legacy=0x7f3e080b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:21.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.894+0000 7f3e06ffd640 1 -- 172.21.15.55:0/4272152510 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e080d19e0 con 0x7f3e0815bab0 2023-07-06T21:55:21.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.898+0000 7f3e06ffd640 1 --2- 172.21.15.55:0/4272152510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e0815bab0 0x7f3e080d0990 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3e080b4eb0 tx=0x7f3df801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bc5859d7ab0f07 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:21.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.898+0000 7f3e05ffb640 1 -- 172.21.15.55:0/4272152510 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df80aa430 con 0x7f3e0815bab0 2023-07-06T21:55:21.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.898+0000 7f3e05ffb640 1 -- 172.21.15.55:0/4272152510 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df80aa590 con 0x7f3e0815bab0 2023-07-06T21:55:21.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.898+0000 7f3e05ffb640 1 -- 172.21.15.55:0/4272152510 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df80aa920 con 0x7f3e0815bab0 2023-07-06T21:55:21.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.898+0000 7f3e0d39f640 1 -- 172.21.15.55:0/4272152510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e0815bab0 msgr2=0x7f3e080d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:21.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.898+0000 7f3e0d39f640 1 --2- 172.21.15.55:0/4272152510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e0815bab0 0x7f3e080d0990 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3e080b4eb0 tx=0x7f3df801c4d0 comp rx=0 tx=0).stop 2023-07-06T21:55:21.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.898+0000 7f3e0d39f640 1 -- 172.21.15.55:0/4272152510 shutdown_connections 2023-07-06T21:55:21.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.898+0000 7f3e0d39f640 1 --2- 172.21.15.55:0/4272152510 >> v2:172.21.15.138:3300/0 conn(0x7f3e080ccdb0 0x7f3e080b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:21.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.898+0000 7f3e0d39f640 1 --2- 172.21.15.55:0/4272152510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e0815bab0 0x7f3e080d0990 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:21.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.898+0000 7f3e0d39f640 1 -- 172.21.15.55:0/4272152510 >> 172.21.15.55:0/4272152510 conn(0x7f3e08070f20 msgr2=0x7f3e080ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:21.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.898+0000 7f3e0d39f640 1 -- 172.21.15.55:0/4272152510 shutdown_connections 2023-07-06T21:55:21.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.898+0000 7f3e0d39f640 1 -- 172.21.15.55:0/4272152510 wait complete. 2023-07-06T21:55:21.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e0d39f640 1 Processor -- start 2023-07-06T21:55:21.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e0d39f640 1 -- start start 2023-07-06T21:55:21.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e0d39f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e080cc930 0x7f3e081511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:21.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e0d39f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e080ccdb0 0x7f3e080c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:21.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e0d39f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e0815bab0 0x7f3e08146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:21.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e0d39f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e08146ea0 con 0x7f3e080ccdb0 2023-07-06T21:55:21.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e0d39f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080b7750 con 0x7f3e080cc930 2023-07-06T21:55:21.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e0d39f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080b7190 con 0x7f3e0815bab0 2023-07-06T21:55:21.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e067fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e080ccdb0 0x7f3e080c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:21.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e067fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e080ccdb0 0x7f3e080c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49548/0 (socket says 172.21.15.55:49548) 2023-07-06T21:55:21.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e067fc640 1 -- 172.21.15.55:0/3688530908 learned_addr learned my addr 172.21.15.55:0/3688530908 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:21.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e06ffd640 1 --2- 172.21.15.55:0/3688530908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e080cc930 0x7f3e081511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:21.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e077fe640 1 --2- 172.21.15.55:0/3688530908 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e0815bab0 0x7f3e08146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:21.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e067fc640 1 -- 172.21.15.55:0/3688530908 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e0815bab0 msgr2=0x7f3e08146960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:21.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e067fc640 1 --2- 172.21.15.55:0/3688530908 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e0815bab0 0x7f3e08146960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:21.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e067fc640 1 -- 172.21.15.55:0/3688530908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e080cc930 msgr2=0x7f3e081511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:21.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e067fc640 1 --2- 172.21.15.55:0/3688530908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e080cc930 0x7f3e081511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:21.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e067fc640 1 -- 172.21.15.55:0/3688530908 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80094d0 con 0x7f3e080ccdb0 2023-07-06T21:55:21.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e067fc640 1 --2- 172.21.15.55:0/3688530908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e080ccdb0 0x7f3e080c8870 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c430 tx=0x7f3dfc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3def7fe640 1 -- 172.21.15.55:0/3688530908 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0074e0 con 0x7f3e080ccdb0 2023-07-06T21:55:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3def7fe640 1 -- 172.21.15.55:0/3688530908 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc007640 con 0x7f3e080ccdb0 2023-07-06T21:55:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3def7fe640 1 -- 172.21.15.55:0/3688530908 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc004a10 con 0x7f3e080ccdb0 2023-07-06T21:55:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e0d39f640 1 -- 172.21.15.55:0/3688530908 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e080b7470 con 0x7f3e080ccdb0 2023-07-06T21:55:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e0d39f640 1 -- 172.21.15.55:0/3688530908 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e081509b0 con 0x7f3e080ccdb0 2023-07-06T21:55:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.902+0000 7f3e0d39f640 1 -- 172.21.15.55:0/3688530908 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e08066d60 con 0x7f3e080ccdb0 2023-07-06T21:55:21.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.906+0000 7f3def7fe640 1 -- 172.21.15.55:0/3688530908 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 21) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f3dfc004b70 con 0x7f3e080ccdb0 2023-07-06T21:55:21.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.906+0000 7f3def7fe640 1 --2- 172.21.15.55:0/3688530908 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f3df4066150 0x7f3df4068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:21.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.906+0000 7f3def7fe640 1 -- 172.21.15.55:0/3688530908 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f3dfc0835d0 con 0x7f3e080ccdb0 2023-07-06T21:55:21.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.906+0000 7f3e06ffd640 1 --2- 172.21.15.55:0/3688530908 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f3df4066150 0x7f3df4068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:21.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.906+0000 7f3e06ffd640 1 --2- 172.21.15.55:0/3688530908 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f3df4066150 0x7f3df4068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3df80ae000 tx=0x7f3df80b5040 comp rx=0 tx=0).ready entity=mgr.6301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:21.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:21.910+0000 7f3def7fe640 1 -- 172.21.15.55:0/3688530908 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3dfc050ad0 con 0x7f3e080ccdb0 2023-07-06T21:55:22.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.082+0000 7f3e0d39f640 1 -- 172.21.15.55:0/3688530908 --> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e080cfeb0 con 0x7f3df4066150 2023-07-06T21:55:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.134+0000 7f3def7fe640 1 -- 172.21.15.55:0/3688530908 <== mgr.6301 v2:172.21.15.55:6832/3229281422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3df80aa960 con 0x7f3df4066150 2023-07-06T21:55:22.134 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path snap_test_dir1 2023-07-06T21:55:22.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.134+0000 7f3e0d39f640 1 -- 172.21.15.55:0/3688530908 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f3df4066150 msgr2=0x7f3df4068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:22.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.134+0000 7f3e0d39f640 1 --2- 172.21.15.55:0/3688530908 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f3df4066150 0x7f3df4068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3df80ae000 tx=0x7f3df80b5040 comp rx=0 tx=0).stop 2023-07-06T21:55:22.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.134+0000 7f3e0d39f640 1 -- 172.21.15.55:0/3688530908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e080ccdb0 msgr2=0x7f3e080c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:22.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.134+0000 7f3e0d39f640 1 --2- 172.21.15.55:0/3688530908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e080ccdb0 0x7f3e080c8870 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c430 tx=0x7f3dfc00c8f0 comp rx=0 tx=0).stop 2023-07-06T21:55:22.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.134+0000 7f3e0d39f640 1 -- 172.21.15.55:0/3688530908 shutdown_connections 2023-07-06T21:55:22.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.134+0000 7f3e0d39f640 1 --2- 172.21.15.55:0/3688530908 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f3df4066150 0x7f3df4068600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:22.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.134+0000 7f3e0d39f640 1 --2- 172.21.15.55:0/3688530908 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e0815bab0 0x7f3e08146960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.134+0000 7f3e0d39f640 1 --2- 172.21.15.55:0/3688530908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e080ccdb0 0x7f3e080c8870 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.134+0000 7f3e0d39f640 1 --2- 172.21.15.55:0/3688530908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e080cc930 0x7f3e081511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.134+0000 7f3e0d39f640 1 -- 172.21.15.55:0/3688530908 >> 172.21.15.55:0/3688530908 conn(0x7f3e08070f20 msgr2=0x7f3e080b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.134+0000 7f3e0d39f640 1 -- 172.21.15.55:0/3688530908 shutdown_connections 2023-07-06T21:55:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.134+0000 7f3e0d39f640 1 -- 172.21.15.55:0/3688530908 wait complete. 2023-07-06T21:55:22.154 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-06T21:55:22.155 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-06-21_56_00 in ~38s... 2023-07-06T21:55:22.156 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-06-21_57_00 in ~98s... 2023-07-06T21:55:22.156 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-07-06T21:55:22.156 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-06T21:55:22.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.302+0000 7f7f64c7b640 1 Processor -- start 2023-07-06T21:55:22.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.302+0000 7f7f64c7b640 1 -- start start 2023-07-06T21:55:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.302+0000 7f7f64c7b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f600c9500 0x7f7f600ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.302+0000 7f7f64c7b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f60152fc0 con 0x7f7f60070020 2023-07-06T21:55:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.302+0000 7f7f64c7b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6015c410 con 0x7f7f600ce710 2023-07-06T21:55:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.302+0000 7f7f64c7b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6015c6f0 con 0x7f7f600c9500 2023-07-06T21:55:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.302+0000 7f7f57fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f600c9500 0x7f7f600ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.302+0000 7f7f57fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f600c9500 0x7f7f600ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49560/0 (socket says 172.21.15.55:49560) 2023-07-06T21:55:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.302+0000 7f7f5e59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7f60070020 0x7f7f600703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41854/0 (socket says 172.21.15.55:41854) 2023-07-06T21:55:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.302+0000 7f7f57fff640 1 -- 172.21.15.55:0/1898620068 learned_addr learned my addr 172.21.15.55:0/1898620068 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.306+0000 7f7f57fff640 1 -- 172.21.15.55:0/1898620068 >> v1:172.21.15.138:6789/0 conn(0x7f7f600ce710 legacy=0x7f7f6015f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:22.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.306+0000 7f7f57fff640 1 -- 172.21.15.55:0/1898620068 >> v1:172.21.15.55:6789/0 conn(0x7f7f60070020 legacy=0x7f7f600703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:22.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.306+0000 7f7f57fff640 1 -- 172.21.15.55:0/1898620068 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6015c9d0 con 0x7f7f600c9500 2023-07-06T21:55:22.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.306+0000 7f7f57fff640 1 --2- 172.21.15.55:0/1898620068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f600c9500 0x7f7f600ce1d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009870 tx=0x7f7f4801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205f8c9c40931d99 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:22.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.306+0000 7f7f5dd9b640 1 -- 172.21.15.55:0/1898620068 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f480ab5f0 con 0x7f7f600c9500 2023-07-06T21:55:22.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.306+0000 7f7f5dd9b640 1 -- 172.21.15.55:0/1898620068 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f480ab750 con 0x7f7f600c9500 2023-07-06T21:55:22.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.306+0000 7f7f5dd9b640 1 -- 172.21.15.55:0/1898620068 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f480abae0 con 0x7f7f600c9500 2023-07-06T21:55:22.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.306+0000 7f7f64c7b640 1 -- 172.21.15.55:0/1898620068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f600c9500 msgr2=0x7f7f600ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:22.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.306+0000 7f7f64c7b640 1 --2- 172.21.15.55:0/1898620068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f600c9500 0x7f7f600ce1d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009870 tx=0x7f7f4801c540 comp rx=0 tx=0).stop 2023-07-06T21:55:22.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.306+0000 7f7f64c7b640 1 -- 172.21.15.55:0/1898620068 shutdown_connections 2023-07-06T21:55:22.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.306+0000 7f7f64c7b640 1 --2- 172.21.15.55:0/1898620068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f600c9500 0x7f7f600ce1d0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:22.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.306+0000 7f7f64c7b640 1 -- 172.21.15.55:0/1898620068 >> 172.21.15.55:0/1898620068 conn(0x7f7f600cfb90 msgr2=0x7f7f600cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.306+0000 7f7f64c7b640 1 -- 172.21.15.55:0/1898620068 shutdown_connections 2023-07-06T21:55:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.306+0000 7f7f64c7b640 1 -- 172.21.15.55:0/1898620068 wait complete. 2023-07-06T21:55:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f64c7b640 1 Processor -- start 2023-07-06T21:55:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f64c7b640 1 -- start start 2023-07-06T21:55:22.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f64c7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f60070020 0x7f7f600af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f64c7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f600c9500 0x7f7f600ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f64c7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f600ce710 0x7f7f600c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f64c7b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f60156830 con 0x7f7f600c9500 2023-07-06T21:55:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f64c7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f60156b10 con 0x7f7f600ce710 2023-07-06T21:55:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f64c7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f60156df0 con 0x7f7f60070020 2023-07-06T21:55:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f57fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f600c9500 0x7f7f600ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:22.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f57fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f600c9500 0x7f7f600ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49570/0 (socket says 172.21.15.55:49570) 2023-07-06T21:55:22.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f57fff640 1 -- 172.21.15.55:0/983827534 learned_addr learned my addr 172.21.15.55:0/983827534 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:55:22.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f5e59c640 1 --2- 172.21.15.55:0/983827534 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f60070020 0x7f7f600af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:22.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f5ed9d640 1 --2- 172.21.15.55:0/983827534 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f600ce710 0x7f7f600c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:22.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f57fff640 1 -- 172.21.15.55:0/983827534 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f60070020 msgr2=0x7f7f600af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:22.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f57fff640 1 --2- 172.21.15.55:0/983827534 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f60070020 0x7f7f600af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:22.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f57fff640 1 -- 172.21.15.55:0/983827534 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f600ce710 msgr2=0x7f7f600c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:22.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f57fff640 1 --2- 172.21.15.55:0/983827534 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f600ce710 0x7f7f600c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:22.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f57fff640 1 -- 172.21.15.55:0/983827534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f480094d0 con 0x7f7f600c9500 2023-07-06T21:55:22.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.310+0000 7f7f57fff640 1 --2- 172.21.15.55:0/983827534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f600c9500 0x7f7f600ad8a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f7f48019150 tx=0x7f7f4801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:22.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.314+0000 7f7f56ffd640 1 -- 172.21.15.55:0/983827534 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f480b4800 con 0x7f7f600c9500 2023-07-06T21:55:22.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.314+0000 7f7f56ffd640 1 -- 172.21.15.55:0/983827534 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f480b4980 con 0x7f7f600c9500 2023-07-06T21:55:22.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.314+0000 7f7f56ffd640 1 -- 172.21.15.55:0/983827534 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f480b4d30 con 0x7f7f600c9500 2023-07-06T21:55:22.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.314+0000 7f7f64c7b640 1 -- 172.21.15.55:0/983827534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f601570d0 con 0x7f7f600c9500 2023-07-06T21:55:22.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.314+0000 7f7f64c7b640 1 -- 172.21.15.55:0/983827534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f600c88f0 con 0x7f7f600c9500 2023-07-06T21:55:22.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.314+0000 7f7f64c7b640 1 -- 172.21.15.55:0/983827534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f600c8ae0 con 0x7f7f600c9500 2023-07-06T21:55:22.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.314+0000 7f7f56ffd640 1 -- 172.21.15.55:0/983827534 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 21) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f7f480b3380 con 0x7f7f600c9500 2023-07-06T21:55:22.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.314+0000 7f7f56ffd640 1 --2- 172.21.15.55:0/983827534 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f7f40066150 0x7f7f40068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:55:22.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.314+0000 7f7f56ffd640 1 -- 172.21.15.55:0/983827534 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f7f480a8050 con 0x7f7f600c9500 2023-07-06T21:55:22.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.314+0000 7f7f5e59c640 1 --2- 172.21.15.55:0/983827534 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f7f40066150 0x7f7f40068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:55:22.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.314+0000 7f7f5e59c640 1 --2- 172.21.15.55:0/983827534 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f7f40066150 0x7f7f40068600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7f50007fd0 tx=0x7f7f50009040 comp rx=0 tx=0).ready entity=mgr.6301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:55:22.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.318+0000 7f7f56ffd640 1 -- 172.21.15.55:0/983827534 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f480eb530 con 0x7f7f600c9500 2023-07-06T21:55:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.490+0000 7f7f64c7b640 1 -- 172.21.15.55:0/983827534 --> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f60156c80 con 0x7f7f40066150 2023-07-06T21:55:22.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.498+0000 7f7f56ffd640 1 -- 172.21.15.55:0/983827534 <== mgr.6301 v2:172.21.15.55:6832/3229281422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7f7f60156c80 con 0x7f7f40066150 2023-07-06T21:55:22.498 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:55:22.498 INFO:teuthology.orchestra.run.smithi055.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-07-06T21:55:22.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.498+0000 7f7f64c7b640 1 -- 172.21.15.55:0/983827534 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f7f40066150 msgr2=0x7f7f40068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:22.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.498+0000 7f7f64c7b640 1 --2- 172.21.15.55:0/983827534 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f7f40066150 0x7f7f40068600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7f50007fd0 tx=0x7f7f50009040 comp rx=0 tx=0).stop 2023-07-06T21:55:22.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.498+0000 7f7f64c7b640 1 -- 172.21.15.55:0/983827534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f600c9500 msgr2=0x7f7f600ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:55:22.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.498+0000 7f7f64c7b640 1 --2- 172.21.15.55:0/983827534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f600c9500 0x7f7f600ad8a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f7f48019150 tx=0x7f7f4801ad80 comp rx=0 tx=0).stop 2023-07-06T21:55:22.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.498+0000 7f7f64c7b640 1 -- 172.21.15.55:0/983827534 shutdown_connections 2023-07-06T21:55:22.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.498+0000 7f7f64c7b640 1 --2- 172.21.15.55:0/983827534 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f7f40066150 0x7f7f40068600 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:22.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.498+0000 7f7f64c7b640 1 --2- 172.21.15.55:0/983827534 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f600ce710 0x7f7f600c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:22.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.498+0000 7f7f64c7b640 1 --2- 172.21.15.55:0/983827534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f600c9500 0x7f7f600ad8a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:22.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.498+0000 7f7f64c7b640 1 --2- 172.21.15.55:0/983827534 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f60070020 0x7f7f600af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:55:22.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.498+0000 7f7f64c7b640 1 -- 172.21.15.55:0/983827534 >> 172.21.15.55:0/983827534 conn(0x7f7f600cfb90 msgr2=0x7f7f600cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:55:22.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.498+0000 7f7f64c7b640 1 -- 172.21.15.55:0/983827534 shutdown_connections 2023-07-06T21:55:22.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:55:22.498+0000 7f7f64c7b640 1 -- 172.21.15.55:0/983827534 wait complete. 2023-07-06T21:55:22.520 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-07-06T21:55:22.520 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-07-06T21:55:22.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:22.521 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:22.533 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:22.533 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:22.533 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:23.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:23.535 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:23.547 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:23.547 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:23.548 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:24.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:24.549 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:24.561 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:24.562 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:24.562 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:25.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:25.563 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:25.575 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:25.576 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:25.576 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:26.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:26.577 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:26.590 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:26.590 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:26.590 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:27.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:27.591 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:27.603 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:27.604 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:27.604 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:28.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:28.606 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:28.618 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:28.619 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:28.619 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:29.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:29.620 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:29.632 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:29.633 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:29.633 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:30.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:30.634 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:30.646 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:30.646 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:30.647 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:31.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:31.648 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:31.661 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:31.661 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:31.662 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:32.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:32.663 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:32.675 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:32.675 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:32.676 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:33.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:33.678 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:33.690 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:33.691 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:33.691 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:34.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:34.693 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:34.705 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:34.705 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:34.705 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:35.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:35.706 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:35.718 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:35.719 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:35.719 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:36.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:36.720 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:36.732 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:36.732 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:36.732 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:36.845 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:55:36.849 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:55:37.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:37.734 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:37.746 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:37.747 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:37.747 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:38.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:38.749 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:38.761 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:38.761 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:38.761 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:39.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:39.763 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:39.775 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:39.776 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:39.776 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:40.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:40.778 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:40.790 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:40.790 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:40.791 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:41.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:41.792 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:41.804 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:41.804 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:41.805 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:42.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:42.806 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:42.817 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:42.818 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:42.818 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:43.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:43.819 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:43.832 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:43.832 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:43.832 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:44.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:44.833 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:44.845 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:44.846 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:44.846 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:45.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:45.848 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:45.859 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:45.860 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:45.860 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:46.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:46.862 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:46.874 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:46.874 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:46.874 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:47.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:47.875 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:47.887 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:47.887 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:47.888 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:48.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:48.889 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:48.901 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:48.902 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:48.902 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:49.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:49.904 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:49.917 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:49.917 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:49.917 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:50.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:50.919 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:50.931 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:50.932 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:50.932 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:51.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:51.934 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:51.946 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:51.946 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:51.947 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:52.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:52.948 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:52.960 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:52.960 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:52.961 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:53.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:53.962 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:53.974 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:53.975 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:53.975 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:54.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:54.977 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:54.988 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:54.989 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:54.989 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:55.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:55.990 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:56.003 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:56.003 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:56.003 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:57.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:57.005 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:57.017 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:57.017 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:57.017 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:58.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:58.069 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:58.082 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:58.083 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:58.083 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:55:59.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:55:59.085 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:55:59.097 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:55:59.097 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:55:59.097 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:00.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:00.099 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:00.111 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T21:56:00.111 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:00.112 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:00.145 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:56:00.146+0000 7f3abd186640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:56:00.145 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:56:00.146+0000 7f3abd186640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:56:00.145 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:56:00.146+0000 7f3abd186640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:56:00.146 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:56:00.146+0000 7f3abd186640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:56:00.146 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:56:00.146+0000 7f3abd186640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:56:01.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:01.113 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:01.126 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:01.127 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:01.127 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:01.127 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:01.127 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-06-21_56_00_UTC'] 2023-07-06T21:56:01.128 DEBUG:tasks.cephfs.test_snap_schedules:exec=1688680522.1554956, now = 1688680561.1281977, timo = 38 2023-07-06T21:56:02.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:02.129 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:02.140 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:02.141 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:02.142 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:02.142 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:03.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:03.144 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:03.155 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:03.156 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:03.156 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:03.156 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:04.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:04.157 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:04.169 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:04.169 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:04.170 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:04.170 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:05.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:05.171 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:05.182 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:05.183 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:05.183 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:05.184 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:06.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:06.185 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:06.196 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:06.197 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:06.198 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:06.198 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:06.908 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:56:06.912 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:56:07.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:07.200 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:07.211 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:07.212 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:07.213 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:07.213 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:08.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:08.215 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:08.227 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:08.228 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:08.229 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:08.229 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:09.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:09.230 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:09.242 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:09.243 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:09.243 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:09.243 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:10.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:10.245 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:10.256 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:10.257 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:10.258 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:10.258 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:11.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:11.260 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:11.271 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:11.272 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:11.272 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:11.273 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:12.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:12.274 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:12.285 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:12.286 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:12.286 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:12.287 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:13.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:13.288 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:13.299 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:13.300 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:13.301 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:13.301 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:14.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:14.303 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:14.314 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:14.315 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:14.316 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:14.316 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:15.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:15.318 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:15.329 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:15.330 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:15.330 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:15.331 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:16.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:16.332 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:16.343 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:16.344 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:16.344 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:16.345 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:17.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:17.346 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:17.357 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:17.358 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:17.359 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:17.359 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:18.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:18.360 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:18.371 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:18.372 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:18.373 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:18.373 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:19.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:19.375 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:19.386 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:19.387 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:19.388 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:19.388 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:20.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:20.389 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:20.401 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:20.402 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:20.402 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:20.402 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:21.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:21.404 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:21.415 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:21.416 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:21.416 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:21.416 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:22.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:22.418 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:22.429 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:22.429 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:22.430 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:22.430 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:23.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:23.432 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:23.442 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:23.443 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:23.444 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:23.444 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:24.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:24.445 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:24.456 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:24.457 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:24.457 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:24.458 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:25.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:25.460 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:25.471 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:25.472 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:25.472 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:25.472 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:26.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:26.474 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:26.485 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:26.486 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:26.487 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:26.487 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:27.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:27.489 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:27.500 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:27.501 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:27.502 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:27.502 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:28.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:28.504 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:28.515 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:28.515 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:28.516 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:28.516 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:29.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:29.518 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:29.532 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:29.533 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:29.533 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:29.533 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:30.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:30.535 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:30.546 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:30.547 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:30.548 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:30.548 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:31.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:31.550 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:31.561 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:31.562 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:31.562 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:31.563 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:32.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:32.564 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:32.575 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:32.576 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:32.576 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:32.577 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:33.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:33.578 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:33.589 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:33.590 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:33.591 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:33.591 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:34.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:34.593 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:34.604 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:34.605 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:34.606 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:34.606 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:35.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:35.607 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:35.619 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:35.620 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:35.620 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:35.620 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:36.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:36.622 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:36.633 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:36.634 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:36.635 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:36.635 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:36.982 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:56:36.986 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:56:37.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:37.636 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:37.647 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:37.648 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:37.649 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:37.649 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:38.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:38.650 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:38.661 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:38.662 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:38.663 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:38.663 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:39.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:39.664 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:39.674 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:39.675 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:39.676 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:39.676 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:40.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:40.678 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:40.689 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:40.689 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:40.690 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:40.690 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:41.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:41.691 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:41.702 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:41.703 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:41.704 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:41.704 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:42.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:42.706 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:42.717 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:42.718 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:42.718 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:42.718 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:43.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:43.719 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:43.731 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:43.731 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:43.732 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:43.732 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:44.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:44.734 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:44.745 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:44.746 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:44.746 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:44.746 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:45.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:45.747 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:45.759 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:45.760 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:45.760 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:45.760 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:46.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:46.761 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:46.773 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:46.773 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:46.774 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:46.774 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:47.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:47.776 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:47.787 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:47.788 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:47.789 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:47.789 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:48.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:48.790 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:48.801 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:48.802 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:48.803 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:48.803 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:49.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:49.804 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:49.815 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:49.816 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:49.816 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:49.817 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:50.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:50.818 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:50.829 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:50.830 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:50.830 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:50.831 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:51.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:51.832 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:51.843 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:51.844 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:51.844 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:51.844 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:52.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:52.845 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:52.856 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:52.857 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:52.857 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:52.857 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:53.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:53.859 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:53.870 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:53.870 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:53.871 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:53.871 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:54.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:54.873 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:54.884 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:54.885 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:54.885 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:54.885 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:55.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:55.887 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:55.899 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:55.900 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:55.901 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:55.901 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:56.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:56.903 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:56.916 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:56.916 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:56.917 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:56.917 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:57.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:57.919 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:57.930 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:57.931 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:57.931 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:57.931 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:58.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:58.932 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:58.944 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:58.945 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:58.945 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:58.945 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:56:59.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:56:59.947 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:56:59.966 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:56:59.967 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:56:59.968 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T21:56:59.968 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:57:00.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:00.969 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:57:00.981 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:57:00.981 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_57_00_UTC 2023-07-06T21:57:00.982 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-21_57_00_UTC', 'scheduled-2023-07-06-21_56_00_UTC'} 2023-07-06T21:57:00.982 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-06-21_57_00_UTC'} 2023-07-06T21:57:00.982 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T21:57:00.983 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-06-21_57_00_UTC'] 2023-07-06T21:57:00.983 DEBUG:tasks.cephfs.test_snap_schedules:exec=1688680522.1554956, now = 1688680620.9833727, timo = 98 2023-07-06T21:57:01.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-06T21:57:02.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.145+0000 7fea7dd40640 1 Processor -- start 2023-07-06T21:57:02.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.145+0000 7fea7dd40640 1 -- start start 2023-07-06T21:57:02.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.145+0000 7fea7dd40640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fea780c9b90 0x7fea7815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:02.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.145+0000 7fea7dd40640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea780b3e70 con 0x7fea780ccb70 2023-07-06T21:57:02.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.145+0000 7fea7dd40640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea78159c30 con 0x7fea780693f0 2023-07-06T21:57:02.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.145+0000 7fea7dd40640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea780c9070 con 0x7fea780c9b90 2023-07-06T21:57:02.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.145+0000 7fea777fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fea780c9b90 0x7fea7815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:02.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.145+0000 7fea777fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fea780c9b90 0x7fea7815dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56374/0 (socket says 172.21.15.55:56374) 2023-07-06T21:57:02.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.145+0000 7fea777fe640 1 -- 172.21.15.55:0/1817278078 learned_addr learned my addr 172.21.15.55:0/1817278078 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:02.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.145+0000 7fea76ffd640 1 --1- 172.21.15.55:0/1817278078 >> v1:172.21.15.55:6789/0 conn(0x7fea780ccb70 0x7fea780c9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48768/0 (socket says 172.21.15.55:48768) 2023-07-06T21:57:02.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.145+0000 7fea777fe640 1 -- 172.21.15.55:0/1817278078 >> v1:172.21.15.138:6789/0 conn(0x7fea780693f0 legacy=0x7fea78069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:02.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.145+0000 7fea777fe640 1 -- 172.21.15.55:0/1817278078 >> v1:172.21.15.55:6789/0 conn(0x7fea780ccb70 legacy=0x7fea780c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:02.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.145+0000 7fea777fe640 1 -- 172.21.15.55:0/1817278078 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea780c8480 con 0x7fea780c9b90 2023-07-06T21:57:02.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.149+0000 7fea777fe640 1 --2- 172.21.15.55:0/1817278078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea780c9b90 0x7fea7815dd50 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fea68009870 tx=0x7fea6801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32e386bb23ebaae server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:02.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.149+0000 7fea767fc640 1 -- 172.21.15.55:0/1817278078 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea680ab610 con 0x7fea780c9b90 2023-07-06T21:57:02.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.149+0000 7fea767fc640 1 -- 172.21.15.55:0/1817278078 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea680ab770 con 0x7fea780c9b90 2023-07-06T21:57:02.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.149+0000 7fea767fc640 1 -- 172.21.15.55:0/1817278078 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea680abb00 con 0x7fea780c9b90 2023-07-06T21:57:02.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.149+0000 7fea7dd40640 1 -- 172.21.15.55:0/1817278078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea780c9b90 msgr2=0x7fea7815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:02.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.149+0000 7fea7dd40640 1 --2- 172.21.15.55:0/1817278078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea780c9b90 0x7fea7815dd50 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fea68009870 tx=0x7fea6801c500 comp rx=0 tx=0).stop 2023-07-06T21:57:02.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.149+0000 7fea7dd40640 1 -- 172.21.15.55:0/1817278078 shutdown_connections 2023-07-06T21:57:02.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.149+0000 7fea7dd40640 1 --2- 172.21.15.55:0/1817278078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea780c9b90 0x7fea7815dd50 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:02.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.149+0000 7fea7dd40640 1 -- 172.21.15.55:0/1817278078 >> 172.21.15.55:0/1817278078 conn(0x7fea780cde30 msgr2=0x7fea780ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:02.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.149+0000 7fea7dd40640 1 -- 172.21.15.55:0/1817278078 shutdown_connections 2023-07-06T21:57:02.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.149+0000 7fea7dd40640 1 -- 172.21.15.55:0/1817278078 wait complete. 2023-07-06T21:57:02.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea7dd40640 1 Processor -- start 2023-07-06T21:57:02.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea7dd40640 1 -- start start 2023-07-06T21:57:02.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea7dd40640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea780693f0 0x7fea781505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:02.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea7dd40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea780c9b90 0x7fea7815c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:02.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea7dd40640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea780ccb70 0x7fea7814fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:02.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea7dd40640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea78150ed0 con 0x7fea780c9b90 2023-07-06T21:57:02.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea7dd40640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7815a670 con 0x7fea780693f0 2023-07-06T21:57:02.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea7dd40640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7815a910 con 0x7fea780ccb70 2023-07-06T21:57:02.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea76ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea780c9b90 0x7fea7815c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:02.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea76ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea780c9b90 0x7fea7815c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56384/0 (socket says 172.21.15.55:56384) 2023-07-06T21:57:02.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea76ffd640 1 -- 172.21.15.55:0/2911823480 learned_addr learned my addr 172.21.15.55:0/2911823480 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:02.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea777fe640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea780693f0 0x7fea781505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:02.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea77fff640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea780ccb70 0x7fea7814fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:02.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea76ffd640 1 -- 172.21.15.55:0/2911823480 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea780ccb70 msgr2=0x7fea7814fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:02.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea76ffd640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea780ccb70 0x7fea7814fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:02.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea76ffd640 1 -- 172.21.15.55:0/2911823480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea780693f0 msgr2=0x7fea781505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:02.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea76ffd640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea780693f0 0x7fea781505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:02.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea76ffd640 1 -- 172.21.15.55:0/2911823480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea680094d0 con 0x7fea780c9b90 2023-07-06T21:57:02.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea77fff640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea780ccb70 0x7fea7814fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:02.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea76ffd640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea780c9b90 0x7fea7815c660 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00c490 tx=0x7fea6c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:02.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea5ffff640 1 -- 172.21.15.55:0/2911823480 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c007480 con 0x7fea780c9b90 2023-07-06T21:57:02.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea5ffff640 1 -- 172.21.15.55:0/2911823480 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c0075e0 con 0x7fea780c9b90 2023-07-06T21:57:02.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea5ffff640 1 -- 172.21.15.55:0/2911823480 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c004a10 con 0x7fea780c9b90 2023-07-06T21:57:02.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.153+0000 7fea7dd40640 1 -- 172.21.15.55:0/2911823480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7815abf0 con 0x7fea780c9b90 2023-07-06T21:57:02.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.157+0000 7fea7dd40640 1 -- 172.21.15.55:0/2911823480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7815cba0 con 0x7fea780c9b90 2023-07-06T21:57:02.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.157+0000 7fea7dd40640 1 -- 172.21.15.55:0/2911823480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea780c94e0 con 0x7fea780c9b90 2023-07-06T21:57:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.157+0000 7fea5ffff640 1 -- 172.21.15.55:0/2911823480 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 24) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fea6c004b70 con 0x7fea780c9b90 2023-07-06T21:57:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.157+0000 7fea5ffff640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fea64066420 0x7fea640688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.157+0000 7fea5ffff640 1 -- 172.21.15.55:0/2911823480 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fea6c082ff0 con 0x7fea780c9b90 2023-07-06T21:57:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.157+0000 7fea777fe640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fea64066420 0x7fea640688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:02.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.157+0000 7fea777fe640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fea64066420 0x7fea640688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fea680af000 tx=0x7fea680b6040 comp rx=0 tx=0).ready entity=mgr.6301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.161+0000 7fea5ffff640 1 -- 172.21.15.55:0/2911823480 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea6c0b3700 con 0x7fea780c9b90 2023-07-06T21:57:02.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.337+0000 7fea7dd40640 1 -- 172.21.15.55:0/2911823480 --> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fea780c8d00 con 0x7fea64066420 2023-07-06T21:57:02.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.401+0000 7fea5ffff640 1 -- 172.21.15.55:0/2911823480 <== mgr.6301 v2:172.21.15.55:6832/3229281422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fea680ab8e0 con 0x7fea64066420 2023-07-06T21:57:02.397 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path snap_test_dir1 2023-07-06T21:57:02.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.401+0000 7fea7dd40640 1 -- 172.21.15.55:0/2911823480 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fea64066420 msgr2=0x7fea640688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:02.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.401+0000 7fea7dd40640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fea64066420 0x7fea640688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fea680af000 tx=0x7fea680b6040 comp rx=0 tx=0).stop 2023-07-06T21:57:02.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.401+0000 7fea7dd40640 1 -- 172.21.15.55:0/2911823480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea780c9b90 msgr2=0x7fea7815c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:02.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.401+0000 7fea7dd40640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea780c9b90 0x7fea7815c660 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00c490 tx=0x7fea6c00c950 comp rx=0 tx=0).stop 2023-07-06T21:57:02.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.401+0000 7fea7dd40640 1 -- 172.21.15.55:0/2911823480 shutdown_connections 2023-07-06T21:57:02.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.401+0000 7fea7dd40640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fea64066420 0x7fea640688d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:02.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.401+0000 7fea7dd40640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea780ccb70 0x7fea7814fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:02.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.401+0000 7fea7dd40640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea780c9b90 0x7fea7815c660 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:02.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.401+0000 7fea7dd40640 1 --2- 172.21.15.55:0/2911823480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea780693f0 0x7fea781505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:02.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.401+0000 7fea7dd40640 1 -- 172.21.15.55:0/2911823480 >> 172.21.15.55:0/2911823480 conn(0x7fea780cde30 msgr2=0x7fea781555d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:02.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.401+0000 7fea7dd40640 1 -- 172.21.15.55:0/2911823480 shutdown_connections 2023-07-06T21:57:02.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.401+0000 7fea7dd40640 1 -- 172.21.15.55:0/2911823480 wait complete. 2023-07-06T21:57:02.418 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-06T21:57:02.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:02.419 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T21:57:02.430 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:57:02.430 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-21_57_00_UTC 2023-07-06T21:57:02.431 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-06-21_56_00_UTC 2023-07-06T21:57:02.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:02.431 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-06-21_56_00_UTC) 2023-07-06T21:57:02.487 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-06-21_57_00_UTC 2023-07-06T21:57:02.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:02.488 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-06-21_57_00_UTC) 2023-07-06T21:57:02.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:02.542 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-06T21:57:02.599 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-06T21:57:02.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.785+0000 7f42e03e9640 1 Processor -- start 2023-07-06T21:57:02.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.785+0000 7f42e03e9640 1 -- start start 2023-07-06T21:57:02.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42e03e9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f42d80709a0 0x7f42d80cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:02.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42e03e9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d80b1340 0x7f42d806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:02.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42e03e9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d80cc300 con 0x7f42d80cbe60 2023-07-06T21:57:02.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42e03e9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d80cc5e0 con 0x7f42d80709a0 2023-07-06T21:57:02.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42e03e9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80cc8c0 con 0x7f42d80b1340 2023-07-06T21:57:02.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd984640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f42d80cbe60 0x7f42d80b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48778/0 (socket says 172.21.15.55:48778) 2023-07-06T21:57:02.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd984640 1 -- 172.21.15.55:0/3077276455 learned_addr learned my addr 172.21.15.55:0/3077276455 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:02.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 -- 172.21.15.55:0/3077276455 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072175580 0 0) 0x7f42d80cc300 con 0x7f42d80cbe60 2023-07-06T21:57:02.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 -- 172.21.15.55:0/3077276455 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c4003530 con 0x7f42d80cbe60 2023-07-06T21:57:02.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42de185640 1 --2- 172.21.15.55:0/3077276455 >> v2:172.21.15.138:3300/0 conn(0x7f42d80709a0 0x7f42d80cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:02.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 -- 172.21.15.55:0/3077276455 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1737781871 0 0) 0x7f42c4003530 con 0x7f42d80cbe60 2023-07-06T21:57:02.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 -- 172.21.15.55:0/3077276455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d80b1340 msgr2=0x7f42d806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:02.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 --2- 172.21.15.55:0/3077276455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d80b1340 0x7f42d806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 -- 172.21.15.55:0/3077276455 >> v2:172.21.15.138:3300/0 conn(0x7f42d80709a0 msgr2=0x7f42d80cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 --2- 172.21.15.55:0/3077276455 >> v2:172.21.15.138:3300/0 conn(0x7f42d80709a0 0x7f42d80cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 -- 172.21.15.55:0/3077276455 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d80ccba0 con 0x7f42d80cbe60 2023-07-06T21:57:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 -- 172.21.15.55:0/3077276455 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f42c8001680 con 0x7f42d80cbe60 2023-07-06T21:57:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42de185640 1 --2- 172.21.15.55:0/3077276455 >> v2:172.21.15.138:3300/0 conn(0x7f42d80709a0 0x7f42d80cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 -- 172.21.15.55:0/3077276455 >> v1:172.21.15.55:6789/0 conn(0x7f42d80cbe60 legacy=0x7f42d80b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 --2- 172.21.15.55:0/3077276455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d80b1340 0x7f42c4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 --2- 172.21.15.55:0/3077276455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42c40040e0 0x7f42c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:02.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 --2- 172.21.15.55:0/3077276455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42c4004e30 0x7f42c40052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:02.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 -- 172.21.15.55:0/3077276455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80cc5e0 con 0x7f42c40040e0 2023-07-06T21:57:02.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 -- 172.21.15.55:0/3077276455 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80cc8c0 con 0x7f42c4004e30 2023-07-06T21:57:02.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd183640 1 -- 172.21.15.55:0/3077276455 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c400bca0 con 0x7f42d80b1340 2023-07-06T21:57:02.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd984640 1 --2- 172.21.15.55:0/3077276455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42c40040e0 0x7f42c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:02.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd984640 1 -- 172.21.15.55:0/3077276455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d80b1340 msgr2=0x7f42c4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:02.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd984640 1 --2- 172.21.15.55:0/3077276455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d80b1340 0x7f42c4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:02.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd984640 1 -- 172.21.15.55:0/3077276455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42c4004e30 msgr2=0x7f42c40052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:02.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd984640 1 --2- 172.21.15.55:0/3077276455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42c4004e30 0x7f42c40052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:02.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.789+0000 7f42dd984640 1 -- 172.21.15.55:0/3077276455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c4003530 con 0x7f42c40040e0 2023-07-06T21:57:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.793+0000 7f42dd984640 1 --2- 172.21.15.55:0/3077276455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42c40040e0 0x7f42c40047d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c110 tx=0x7f42c801f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca378670de0410c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.793+0000 7f42dd183640 1 -- 172.21.15.55:0/3077276455 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8005ae0 con 0x7f42c40040e0 2023-07-06T21:57:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.793+0000 7f42dd183640 1 -- 172.21.15.55:0/3077276455 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c80ab070 con 0x7f42c40040e0 2023-07-06T21:57:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.793+0000 7f42dd183640 1 -- 172.21.15.55:0/3077276455 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8007070 con 0x7f42c40040e0 2023-07-06T21:57:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.793+0000 7f42e03e9640 1 -- 172.21.15.55:0/3077276455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42c40040e0 msgr2=0x7f42c40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:02.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.793+0000 7f42e03e9640 1 --2- 172.21.15.55:0/3077276455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42c40040e0 0x7f42c40047d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c110 tx=0x7f42c801f2f0 comp rx=0 tx=0).stop 2023-07-06T21:57:02.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.793+0000 7f42de986640 1 -- 172.21.15.55:0/3077276455 reap_dead start 2023-07-06T21:57:02.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.793+0000 7f42e03e9640 1 -- 172.21.15.55:0/3077276455 shutdown_connections 2023-07-06T21:57:02.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.793+0000 7f42e03e9640 1 -- 172.21.15.55:0/3077276455 >> 172.21.15.55:0/3077276455 conn(0x7f42d80cea70 msgr2=0x7f42d80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:02.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.793+0000 7f42e03e9640 1 -- 172.21.15.55:0/3077276455 shutdown_connections 2023-07-06T21:57:02.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.793+0000 7f42e03e9640 1 -- 172.21.15.55:0/3077276455 wait complete. 2023-07-06T21:57:02.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42e03e9640 1 Processor -- start 2023-07-06T21:57:02.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42e03e9640 1 -- start start 2023-07-06T21:57:02.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42e03e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42c40040e0 0x7f42d806a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:02.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42e03e9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d815cbb0 0x7f42d81e23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:02.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42e03e9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d81e2cc0 0x7f42d81e3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:02.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42e03e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d81e3670 con 0x7f42c40040e0 2023-07-06T21:57:02.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42e03e9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d806ab50 con 0x7f42d815cbb0 2023-07-06T21:57:02.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42e03e9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d81f1fa0 con 0x7f42d81e2cc0 2023-07-06T21:57:02.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42de185640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42c40040e0 0x7f42d806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:02.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42de185640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42c40040e0 0x7f42d806a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56394/0 (socket says 172.21.15.55:56394) 2023-07-06T21:57:02.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42de185640 1 -- 172.21.15.55:0/4239621100 learned_addr learned my addr 172.21.15.55:0/4239621100 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:02.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42dd984640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d815cbb0 0x7f42d81e23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42de185640 1 -- 172.21.15.55:0/4239621100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d81e2cc0 msgr2=0x7f42d81e3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42de986640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d81e2cc0 0x7f42d81e3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42de185640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d81e2cc0 0x7f42d81e3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42de185640 1 -- 172.21.15.55:0/4239621100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d815cbb0 msgr2=0x7f42d81e23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42de185640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d815cbb0 0x7f42d81e23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42de185640 1 -- 172.21.15.55:0/4239621100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d81f1390 con 0x7f42c40040e0 2023-07-06T21:57:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42de986640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d81e2cc0 0x7f42d81e3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42de185640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42c40040e0 0x7f42d806a610 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f42d400c850 tx=0x7f42d400cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42ceffd640 1 -- 172.21.15.55:0/4239621100 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d40079d0 con 0x7f42c40040e0 2023-07-06T21:57:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42ceffd640 1 -- 172.21.15.55:0/4239621100 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d4007b30 con 0x7f42c40040e0 2023-07-06T21:57:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42ceffd640 1 -- 172.21.15.55:0/4239621100 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d40113f0 con 0x7f42c40040e0 2023-07-06T21:57:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42e03e9640 1 -- 172.21.15.55:0/4239621100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d81f1670 con 0x7f42c40040e0 2023-07-06T21:57:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42e03e9640 1 -- 172.21.15.55:0/4239621100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d81f1c30 con 0x7f42c40040e0 2023-07-06T21:57:02.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.797+0000 7f42e03e9640 1 -- 172.21.15.55:0/4239621100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d8066d60 con 0x7f42c40040e0 2023-07-06T21:57:02.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.801+0000 7f42ceffd640 1 -- 172.21.15.55:0/4239621100 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 24) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f42d4011550 con 0x7f42c40040e0 2023-07-06T21:57:02.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.801+0000 7f42ceffd640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f42bc066420 0x7f42bc0688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:02.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.801+0000 7f42ceffd640 1 -- 172.21.15.55:0/4239621100 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f42d4084410 con 0x7f42c40040e0 2023-07-06T21:57:02.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.801+0000 7f42dd984640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f42bc066420 0x7f42bc0688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:02.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.801+0000 7f42dd984640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f42bc066420 0x7f42bc0688d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f42c80ae000 tx=0x7f42c80019b0 comp rx=0 tx=0).ready entity=mgr.6301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:02.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.805+0000 7f42ceffd640 1 -- 172.21.15.55:0/4239621100 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42d4051330 con 0x7f42c40040e0 2023-07-06T21:57:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:02.993+0000 7f42e03e9640 1 -- 172.21.15.55:0/4239621100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f42d80c7e50 con 0x7f42c40040e0 2023-07-06T21:57:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:03.753+0000 7f42ceffd640 1 -- 172.21.15.55:0/4239621100 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 25) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f42d40840f0 con 0x7f42c40040e0 2023-07-06T21:57:03.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:03.753+0000 7f42ceffd640 1 -- 172.21.15.55:0/4239621100 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v25) v1 ==== 93+0+0 (secure 0 0 0) 0x7f42d406c9c0 con 0x7f42c40040e0 2023-07-06T21:57:03.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:03.757+0000 7f42e03e9640 1 -- 172.21.15.55:0/4239621100 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f42bc066420 msgr2=0x7f42bc0688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:03.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:03.757+0000 7f42e03e9640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f42bc066420 0x7f42bc0688d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f42c80ae000 tx=0x7f42c80019b0 comp rx=0 tx=0).stop 2023-07-06T21:57:03.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:03.757+0000 7f42e03e9640 1 -- 172.21.15.55:0/4239621100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42c40040e0 msgr2=0x7f42d806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:03.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:03.757+0000 7f42e03e9640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42c40040e0 0x7f42d806a610 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f42d400c850 tx=0x7f42d400cd10 comp rx=0 tx=0).stop 2023-07-06T21:57:03.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:03.757+0000 7f42e03e9640 1 -- 172.21.15.55:0/4239621100 shutdown_connections 2023-07-06T21:57:03.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:03.757+0000 7f42e03e9640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f42bc066420 0x7f42bc0688d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:03.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:03.757+0000 7f42e03e9640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d81e2cc0 0x7f42d81e3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:03.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:03.757+0000 7f42e03e9640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d815cbb0 0x7f42d81e23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:03.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:03.757+0000 7f42e03e9640 1 --2- 172.21.15.55:0/4239621100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42c40040e0 0x7f42d806a610 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:03.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:03.757+0000 7f42e03e9640 1 -- 172.21.15.55:0/4239621100 >> 172.21.15.55:0/4239621100 conn(0x7f42d80cea70 msgr2=0x7f42d80c8790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:03.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:03.757+0000 7f42e03e9640 1 -- 172.21.15.55:0/4239621100 shutdown_connections 2023-07-06T21:57:03.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:03.757+0000 7f42e03e9640 1 -- 172.21.15.55:0/4239621100 wait complete. 2023-07-06T21:57:03.777 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T21:57:03.778 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:57:03.844 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:57:03.912 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T21:57:03.912 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:57:03.913 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:03.921 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:57:03.922 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:03.923 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:03.923+0000 7f80f6b77180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:57:03.936 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:03.937+0000 7efc21055180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:57:03.944 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.137+0000 7f856e7a3640 1 Processor -- start 2023-07-06T21:57:04.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.137+0000 7f856e7a3640 1 -- start start 2023-07-06T21:57:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.137+0000 7f856e7a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f856815b9d0 0x7f856815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.137+0000 7f856e7a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85680ce340 0x7f85680ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.137+0000 7f856e7a3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f85680b3d10 0x7f85680b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.137+0000 7f856e7a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856806a160 con 0x7f856815b9d0 2023-07-06T21:57:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.137+0000 7f856e7a3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856815bda0 con 0x7f85680b3d10 2023-07-06T21:57:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.137+0000 7f856e7a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85680b46d0 con 0x7f85680ce340 2023-07-06T21:57:04.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.137+0000 7f8567fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f856815b9d0 0x7f856815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:04.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.137+0000 7f8567fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f856815b9d0 0x7f856815f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50400/0 (socket says 172.21.15.55:50400) 2023-07-06T21:57:04.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.137+0000 7f8567fff640 1 -- 172.21.15.55:0/1623715378 learned_addr learned my addr 172.21.15.55:0/1623715378 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:04.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.137+0000 7f856cd40640 1 --2- 172.21.15.55:0/1623715378 >> v2:172.21.15.138:3300/0 conn(0x7f85680b3d10 0x7f85680b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:04.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.141+0000 7f855ffff640 1 --2- 172.21.15.55:0/1623715378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85680ce340 0x7f85680ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:04.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.141+0000 7f8567fff640 1 -- 172.21.15.55:0/1623715378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85680ce340 msgr2=0x7f85680ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:04.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.141+0000 7f8567fff640 1 --2- 172.21.15.55:0/1623715378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85680ce340 0x7f85680ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.141+0000 7f8567fff640 1 -- 172.21.15.55:0/1623715378 >> v2:172.21.15.138:3300/0 conn(0x7f85680b3d10 msgr2=0x7f85680b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:04.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.141+0000 7f8567fff640 1 --2- 172.21.15.55:0/1623715378 >> v2:172.21.15.138:3300/0 conn(0x7f85680b3d10 0x7f85680b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.141+0000 7f8567fff640 1 -- 172.21.15.55:0/1623715378 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8568069590 con 0x7f856815b9d0 2023-07-06T21:57:04.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.141+0000 7f8567fff640 1 --2- 172.21.15.55:0/1623715378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f856815b9d0 0x7f856815f4e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f85680d1590 tx=0x7f855801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d2db9253534137 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:04.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.141+0000 7f85677fe640 1 -- 172.21.15.55:0/1623715378 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85580aa5f0 con 0x7f856815b9d0 2023-07-06T21:57:04.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.141+0000 7f85677fe640 1 -- 172.21.15.55:0/1623715378 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85580aa750 con 0x7f856815b9d0 2023-07-06T21:57:04.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.141+0000 7f85677fe640 1 -- 172.21.15.55:0/1623715378 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85580aaae0 con 0x7f856815b9d0 2023-07-06T21:57:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 -- 172.21.15.55:0/1623715378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f856815b9d0 msgr2=0x7f856815f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 --2- 172.21.15.55:0/1623715378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f856815b9d0 0x7f856815f4e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f85680d1590 tx=0x7f855801c4d0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 -- 172.21.15.55:0/1623715378 shutdown_connections 2023-07-06T21:57:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 --2- 172.21.15.55:0/1623715378 >> v2:172.21.15.138:3300/0 conn(0x7f85680b3d10 0x7f85680b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 --2- 172.21.15.55:0/1623715378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85680ce340 0x7f85680ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 --2- 172.21.15.55:0/1623715378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f856815b9d0 0x7f856815f4e0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 -- 172.21.15.55:0/1623715378 >> 172.21.15.55:0/1623715378 conn(0x7f85680ced10 msgr2=0x7f85680cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 -- 172.21.15.55:0/1623715378 shutdown_connections 2023-07-06T21:57:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 -- 172.21.15.55:0/1623715378 wait complete. 2023-07-06T21:57:04.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 Processor -- start 2023-07-06T21:57:04.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 -- start start 2023-07-06T21:57:04.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85680b3d10 0x7f85680d20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85680ce340 0x7f85680cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856815b9d0 0x7f85681f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85680d2630 con 0x7f85680b3d10 2023-07-06T21:57:04.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85680d2c80 con 0x7f85680ce340 2023-07-06T21:57:04.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856e7a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85680cc1a0 con 0x7f856815b9d0 2023-07-06T21:57:04.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f8567fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85680b3d10 0x7f85680d20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:04.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f8567fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85680b3d10 0x7f85680d20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50416/0 (socket says 172.21.15.55:50416) 2023-07-06T21:57:04.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f8567fff640 1 -- 172.21.15.55:0/1794243042 learned_addr learned my addr 172.21.15.55:0/1794243042 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:04.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f856cd40640 1 --2- 172.21.15.55:0/1794243042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856815b9d0 0x7f85681f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:04.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.145+0000 7f855ffff640 1 --2- 172.21.15.55:0/1794243042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85680ce340 0x7f85680cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:04.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f856cd40640 1 -- 172.21.15.55:0/1794243042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85680ce340 msgr2=0x7f85680cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f856cd40640 1 --2- 172.21.15.55:0/1794243042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85680ce340 0x7f85680cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f856cd40640 1 -- 172.21.15.55:0/1794243042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85680b3d10 msgr2=0x7f85680d20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f856cd40640 1 --2- 172.21.15.55:0/1794243042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85680b3d10 0x7f85680d20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f856cd40640 1 -- 172.21.15.55:0/1794243042 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85580094d0 con 0x7f856815b9d0 2023-07-06T21:57:04.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f8567fff640 1 --2- 172.21.15.55:0/1794243042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85680b3d10 0x7f85680d20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:04.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f856cd40640 1 --2- 172.21.15.55:0/1794243042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856815b9d0 0x7f85681f74f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f856000eab0 tx=0x7f856000ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:04.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f85657fa640 1 -- 172.21.15.55:0/1794243042 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560010040 con 0x7f856815b9d0 2023-07-06T21:57:04.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f85657fa640 1 -- 172.21.15.55:0/1794243042 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856000bc00 con 0x7f856815b9d0 2023-07-06T21:57:04.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f85657fa640 1 -- 172.21.15.55:0/1794243042 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560014400 con 0x7f856815b9d0 2023-07-06T21:57:04.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f856e7a3640 1 -- 172.21.15.55:0/1794243042 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85680d1c60 con 0x7f856815b9d0 2023-07-06T21:57:04.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f856e7a3640 1 -- 172.21.15.55:0/1794243042 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85681f8100 con 0x7f856815b9d0 2023-07-06T21:57:04.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f856e7a3640 1 -- 172.21.15.55:0/1794243042 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85680d1df0 con 0x7f856815b9d0 2023-07-06T21:57:04.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f85657fa640 1 -- 172.21.15.55:0/1794243042 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 25) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f8560014560 con 0x7f856815b9d0 2023-07-06T21:57:04.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.149+0000 7f85657fa640 1 --2- 172.21.15.55:0/1794243042 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f85480663d0 0x7f8548068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.153+0000 7f8567fff640 1 -- 172.21.15.55:0/1794243042 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f85480663d0 msgr2=0x7f8548068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3229281422 2023-07-06T21:57:04.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.153+0000 7f85657fa640 1 -- 172.21.15.55:0/1794243042 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f8560084990 con 0x7f856815b9d0 2023-07-06T21:57:04.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.153+0000 7f8567fff640 1 --2- 172.21.15.55:0/1794243042 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f85480663d0 0x7f8548068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:04.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.157+0000 7f85657fa640 1 -- 172.21.15.55:0/1794243042 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85600519f0 con 0x7f856815b9d0 2023-07-06T21:57:04.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.325+0000 7f856e7a3640 1 -- 172.21.15.55:0/1794243042 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8568066d60 con 0x7f856815b9d0 2023-07-06T21:57:04.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.329+0000 7f85657fa640 1 -- 172.21.15.55:0/1794243042 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+19039 (secure 0 0 0) 0x7f8560055010 con 0x7f856815b9d0 2023-07-06T21:57:04.325 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:04.326 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":74,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:55:20.576465+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:55:02.300695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-07-06T21:55:03.183596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/827601659":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/3134202503":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/3677020920":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/1723719878":"2023-07-07T21:55:20.576434+0000","172.21.15.55:6833/3843972996":"2023-07-07T21:55:20.576434+0000","172.21.15.55:6832/3843972996":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/2622666608":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/457725185":"2023-07-07T21:55:20.576434+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:04.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.329+0000 7f856e7a3640 1 -- 172.21.15.55:0/1794243042 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f85480663d0 msgr2=0x7f8548068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:04.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.329+0000 7f856e7a3640 1 --2- 172.21.15.55:0/1794243042 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f85480663d0 0x7f8548068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.329+0000 7f856e7a3640 1 -- 172.21.15.55:0/1794243042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856815b9d0 msgr2=0x7f85681f74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.329+0000 7f856e7a3640 1 --2- 172.21.15.55:0/1794243042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856815b9d0 0x7f85681f74f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f856000eab0 tx=0x7f856000ef70 comp rx=0 tx=0).stop 2023-07-06T21:57:04.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.329+0000 7f856e7a3640 1 -- 172.21.15.55:0/1794243042 shutdown_connections 2023-07-06T21:57:04.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.329+0000 7f856e7a3640 1 --2- 172.21.15.55:0/1794243042 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f85480663d0 0x7f8548068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.329+0000 7f856e7a3640 1 --2- 172.21.15.55:0/1794243042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856815b9d0 0x7f85681f74f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.329+0000 7f856e7a3640 1 --2- 172.21.15.55:0/1794243042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85680ce340 0x7f85680cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.329+0000 7f856e7a3640 1 --2- 172.21.15.55:0/1794243042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85680b3d10 0x7f85680d20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.329+0000 7f856e7a3640 1 -- 172.21.15.55:0/1794243042 >> 172.21.15.55:0/1794243042 conn(0x7f85680ced10 msgr2=0x7f856815f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:04.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.329+0000 7f856e7a3640 1 -- 172.21.15.55:0/1794243042 shutdown_connections 2023-07-06T21:57:04.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.329+0000 7f856e7a3640 1 -- 172.21.15.55:0/1794243042 wait complete. 2023-07-06T21:57:04.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:55:02.300695+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:55:03.183596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:57:04.349 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:57:04.350 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:04.347+0000 7f80f6b77180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:57:04.387 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:04.389+0000 7efc21055180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:57:04.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07e5c7b640 1 Processor -- start 2023-07-06T21:57:04.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07e5c7b640 1 -- start start 2023-07-06T21:57:04.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07e5c7b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f07e015b850 0x7f07e00cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07e5c7b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e00b2b80 con 0x7f07e00ccd30 2023-07-06T21:57:04.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07e5c7b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e00cff30 con 0x7f07e00b3f80 2023-07-06T21:57:04.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07e5c7b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e00b22e0 con 0x7f07e015b850 2023-07-06T21:57:04.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07deffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f07e00ccd30 0x7f07e00b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48344/0 (socket says 172.21.15.55:48344) 2023-07-06T21:57:04.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07deffd640 1 -- 172.21.15.55:0/2195025656 learned_addr learned my addr 172.21.15.55:0/2195025656 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:04.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07df7fe640 1 --2- 172.21.15.55:0/2195025656 >> v2:172.21.15.138:3300/0 conn(0x7f07e015b850 0x7f07e00cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:04.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07de7fc640 1 -- 172.21.15.55:0/2195025656 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888543969 0 0) 0x7f07e00cff30 con 0x7f07e00b3f80 2023-07-06T21:57:04.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07de7fc640 1 -- 172.21.15.55:0/2195025656 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c8003530 con 0x7f07e00b3f80 2023-07-06T21:57:04.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07de7fc640 1 -- 172.21.15.55:0/2195025656 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166746936 0 0) 0x7f07e00b2b80 con 0x7f07e00ccd30 2023-07-06T21:57:04.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07df7fe640 1 -- 172.21.15.55:0/2195025656 >> v1:172.21.15.138:6789/0 conn(0x7f07e00b3f80 legacy=0x7f07e00d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07df7fe640 1 -- 172.21.15.55:0/2195025656 >> v1:172.21.15.55:6789/0 conn(0x7f07e00ccd30 legacy=0x7f07e00b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.501+0000 7f07df7fe640 1 -- 172.21.15.55:0/2195025656 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e00b25c0 con 0x7f07e015b850 2023-07-06T21:57:04.502 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:04.503+0000 7f80f6b77180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:57:04.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.505+0000 7f07df7fe640 1 --2- 172.21.15.55:0/2195025656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07e015b850 0x7f07e00cc7f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07d00097c0 tx=0x7f07d001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cc6d47e70388403 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:04.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.505+0000 7f07de7fc640 1 -- 172.21.15.55:0/2195025656 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00ab600 con 0x7f07e015b850 2023-07-06T21:57:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.505+0000 7f07de7fc640 1 -- 172.21.15.55:0/2195025656 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d00a7050 con 0x7f07e015b850 2023-07-06T21:57:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.505+0000 7f07de7fc640 1 -- 172.21.15.55:0/2195025656 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00ab980 con 0x7f07e015b850 2023-07-06T21:57:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.505+0000 7f07e5c7b640 1 -- 172.21.15.55:0/2195025656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07e015b850 msgr2=0x7f07e00cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.505+0000 7f07e5c7b640 1 --2- 172.21.15.55:0/2195025656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07e015b850 0x7f07e00cc7f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07d00097c0 tx=0x7f07d001c330 comp rx=0 tx=0).stop 2023-07-06T21:57:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.505+0000 7f07e5c7b640 1 -- 172.21.15.55:0/2195025656 shutdown_connections 2023-07-06T21:57:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.505+0000 7f07e5c7b640 1 --2- 172.21.15.55:0/2195025656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07e015b850 0x7f07e00cc7f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.505+0000 7f07e5c7b640 1 -- 172.21.15.55:0/2195025656 >> 172.21.15.55:0/2195025656 conn(0x7f07e00cec20 msgr2=0x7f07e00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.505+0000 7f07e5c7b640 1 -- 172.21.15.55:0/2195025656 shutdown_connections 2023-07-06T21:57:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.505+0000 7f07e5c7b640 1 -- 172.21.15.55:0/2195025656 wait complete. 2023-07-06T21:57:04.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07e5c7b640 1 Processor -- start 2023-07-06T21:57:04.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07e5c7b640 1 -- start start 2023-07-06T21:57:04.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07e5c7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07e00b3f80 0x7f07e00cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07e5c7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07e00ccd30 0x7f07e0158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07e5c7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07e015b850 0x7f07e00ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07e5c7b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00c5b90 con 0x7f07e015b850 2023-07-06T21:57:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07e5c7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01596c0 con 0x7f07e00ccd30 2023-07-06T21:57:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07e5c7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01599a0 con 0x7f07e00b3f80 2023-07-06T21:57:04.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07e015b850 0x7f07e00ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:04.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07e015b850 0x7f07e00ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50422/0 (socket says 172.21.15.55:50422) 2023-07-06T21:57:04.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07dffff640 1 -- 172.21.15.55:0/3782638269 learned_addr learned my addr 172.21.15.55:0/3782638269 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:04.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07deffd640 1 --2- 172.21.15.55:0/3782638269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07e00ccd30 0x7f07e0158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07df7fe640 1 --2- 172.21.15.55:0/3782638269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07e00b3f80 0x7f07e00cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07dffff640 1 -- 172.21.15.55:0/3782638269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07e00b3f80 msgr2=0x7f07e00cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07dffff640 1 --2- 172.21.15.55:0/3782638269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07e00b3f80 0x7f07e00cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07dffff640 1 -- 172.21.15.55:0/3782638269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07e00ccd30 msgr2=0x7f07e0158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07dffff640 1 --2- 172.21.15.55:0/3782638269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07e00ccd30 0x7f07e0158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.509+0000 7f07dffff640 1 -- 172.21.15.55:0/3782638269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d0009420 con 0x7f07e015b850 2023-07-06T21:57:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.513+0000 7f07dffff640 1 --2- 172.21.15.55:0/3782638269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07e015b850 0x7f07e00ca590 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c770 tx=0x7f07d800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.513+0000 7f07c7fff640 1 -- 172.21.15.55:0/3782638269 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8003bd0 con 0x7f07e015b850 2023-07-06T21:57:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.513+0000 7f07c7fff640 1 -- 172.21.15.55:0/3782638269 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d8003d30 con 0x7f07e015b850 2023-07-06T21:57:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.513+0000 7f07e5c7b640 1 -- 172.21.15.55:0/3782638269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e015bda0 con 0x7f07e015b850 2023-07-06T21:57:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.513+0000 7f07c7fff640 1 -- 172.21.15.55:0/3782638269 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d800aa90 con 0x7f07e015b850 2023-07-06T21:57:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.513+0000 7f07e5c7b640 1 -- 172.21.15.55:0/3782638269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e00c5e30 con 0x7f07e015b850 2023-07-06T21:57:04.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.513+0000 7f07e5c7b640 1 -- 172.21.15.55:0/3782638269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e00c6020 con 0x7f07e015b850 2023-07-06T21:57:04.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.513+0000 7f07c7fff640 1 -- 172.21.15.55:0/3782638269 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f07d800abf0 con 0x7f07e015b850 2023-07-06T21:57:04.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.513+0000 7f07c7fff640 1 --2- 172.21.15.55:0/3782638269 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f07cc0663a0 0x7f07cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.517+0000 7f07c7fff640 1 -- 172.21.15.55:0/3782638269 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f07d8083fb0 con 0x7f07e015b850 2023-07-06T21:57:04.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.517+0000 7f07df7fe640 1 -- 172.21.15.55:0/3782638269 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f07cc0663a0 msgr2=0x7f07cc068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3229281422 2023-07-06T21:57:04.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.517+0000 7f07df7fe640 1 --2- 172.21.15.55:0/3782638269 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f07cc0663a0 0x7f07cc068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:04.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.517+0000 7f07c7fff640 1 -- 172.21.15.55:0/3782638269 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07d8051090 con 0x7f07e015b850 2023-07-06T21:57:04.549 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:04.553+0000 7efc21055180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:57:04.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.677+0000 7f07e5c7b640 1 -- 172.21.15.55:0/3782638269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07e0066d60 con 0x7f07e015b850 2023-07-06T21:57:04.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.677+0000 7f07c7fff640 1 -- 172.21.15.55:0/3782638269 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07d80546b0 con 0x7f07e015b850 2023-07-06T21:57:04.675 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:57:04.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.677+0000 7f07e5c7b640 1 -- 172.21.15.55:0/3782638269 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f07cc0663a0 msgr2=0x7f07cc068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:04.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.677+0000 7f07e5c7b640 1 --2- 172.21.15.55:0/3782638269 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f07cc0663a0 0x7f07cc068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.677+0000 7f07e5c7b640 1 -- 172.21.15.55:0/3782638269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07e015b850 msgr2=0x7f07e00ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.677+0000 7f07e5c7b640 1 --2- 172.21.15.55:0/3782638269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07e015b850 0x7f07e00ca590 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c770 tx=0x7f07d800cc30 comp rx=0 tx=0).stop 2023-07-06T21:57:04.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.677+0000 7f07e5c7b640 1 -- 172.21.15.55:0/3782638269 shutdown_connections 2023-07-06T21:57:04.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.677+0000 7f07e5c7b640 1 --2- 172.21.15.55:0/3782638269 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f07cc0663a0 0x7f07cc068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.677+0000 7f07e5c7b640 1 --2- 172.21.15.55:0/3782638269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07e015b850 0x7f07e00ca590 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.677+0000 7f07e5c7b640 1 --2- 172.21.15.55:0/3782638269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07e00ccd30 0x7f07e0158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.677+0000 7f07e5c7b640 1 --2- 172.21.15.55:0/3782638269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07e00b3f80 0x7f07e00cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.677+0000 7f07e5c7b640 1 -- 172.21.15.55:0/3782638269 >> 172.21.15.55:0/3782638269 conn(0x7f07e00cec20 msgr2=0x7f07e0156b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:04.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.681+0000 7f07e5c7b640 1 -- 172.21.15.55:0/3782638269 shutdown_connections 2023-07-06T21:57:04.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.681+0000 7f07e5c7b640 1 -- 172.21.15.55:0/3782638269 wait complete. 2023-07-06T21:57:04.696 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:57:04.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.893+0000 7f3c1a819640 1 Processor -- start 2023-07-06T21:57:04.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.893+0000 7f3c1a819640 1 -- start start 2023-07-06T21:57:04.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c1a819640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c140b3870 0x7f3c140b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c1a819640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c140b2b80 con 0x7f3c140d03c0 2023-07-06T21:57:04.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c1a819640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c140cff30 con 0x7f3c1415b850 2023-07-06T21:57:04.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c1a819640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c140b41e0 con 0x7f3c140b3870 2023-07-06T21:57:04.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c18db6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3c140d03c0 0x7f3c140d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48350/0 (socket says 172.21.15.55:48350) 2023-07-06T21:57:04.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c18db6640 1 -- 172.21.15.55:0/1516531738 learned_addr learned my addr 172.21.15.55:0/1516531738 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:04.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c137fe640 1 --2- 172.21.15.55:0/1516531738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c140b3870 0x7f3c140b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:04.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c12ffd640 1 -- 172.21.15.55:0/1516531738 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598652099 0 0) 0x7f3c140b2b80 con 0x7f3c140d03c0 2023-07-06T21:57:04.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c12ffd640 1 -- 172.21.15.55:0/1516531738 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bfc003530 con 0x7f3c140d03c0 2023-07-06T21:57:04.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c12ffd640 1 -- 172.21.15.55:0/1516531738 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117978975 0 0) 0x7f3c140cff30 con 0x7f3c1415b850 2023-07-06T21:57:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c12ffd640 1 -- 172.21.15.55:0/1516531738 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c140b2b80 con 0x7f3c1415b850 2023-07-06T21:57:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c137fe640 1 -- 172.21.15.55:0/1516531738 >> v1:172.21.15.138:6789/0 conn(0x7f3c1415b850 legacy=0x7f3c140cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c137fe640 1 -- 172.21.15.55:0/1516531738 >> v1:172.21.15.55:6789/0 conn(0x7f3c140d03c0 legacy=0x7f3c140d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c12ffd640 1 -- 172.21.15.55:0/1516531738 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2231392757 0 0) 0x7f3bfc003530 con 0x7f3c140d03c0 2023-07-06T21:57:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.897+0000 7f3c137fe640 1 -- 172.21.15.55:0/1516531738 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c140b22e0 con 0x7f3c140b3870 2023-07-06T21:57:04.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.901+0000 7f3c137fe640 1 --2- 172.21.15.55:0/1516531738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c140b3870 0x7f3c140b3ca0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3c080097f0 tx=0x7f3c0801c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aadb9e5dc5a3491 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:04.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.901+0000 7f3c12ffd640 1 -- 172.21.15.55:0/1516531738 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c080a4ea0 con 0x7f3c140b3870 2023-07-06T21:57:04.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.901+0000 7f3c12ffd640 1 -- 172.21.15.55:0/1516531738 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c080a7050 con 0x7f3c140b3870 2023-07-06T21:57:04.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.901+0000 7f3c12ffd640 1 -- 172.21.15.55:0/1516531738 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c001a50 con 0x7f3c140b3870 2023-07-06T21:57:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.901+0000 7f3c1a819640 1 -- 172.21.15.55:0/1516531738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c140b3870 msgr2=0x7f3c140b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.901+0000 7f3c1a819640 1 --2- 172.21.15.55:0/1516531738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c140b3870 0x7f3c140b3ca0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3c080097f0 tx=0x7f3c0801c290 comp rx=0 tx=0).stop 2023-07-06T21:57:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.901+0000 7f3c1a819640 1 -- 172.21.15.55:0/1516531738 shutdown_connections 2023-07-06T21:57:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.901+0000 7f3c1a819640 1 --2- 172.21.15.55:0/1516531738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c140b3870 0x7f3c140b3ca0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.901+0000 7f3c1a819640 1 -- 172.21.15.55:0/1516531738 >> 172.21.15.55:0/1516531738 conn(0x7f3c140cec20 msgr2=0x7f3c140cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:04.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.901+0000 7f3c1a819640 1 -- 172.21.15.55:0/1516531738 shutdown_connections 2023-07-06T21:57:04.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.901+0000 7f3c1a819640 1 -- 172.21.15.55:0/1516531738 wait complete. 2023-07-06T21:57:04.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.901+0000 7f3c1a819640 1 Processor -- start 2023-07-06T21:57:04.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c1a819640 1 -- start start 2023-07-06T21:57:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c1a819640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c140b3870 0x7f3c14153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c1a819640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c140d03c0 0x7f3c1415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c1a819640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c1415b850 0x7f3c14159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c1a819640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1415c430 con 0x7f3c140b3870 2023-07-06T21:57:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c1a819640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1415e500 con 0x7f3c1415b850 2023-07-06T21:57:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c1a819640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1415e7a0 con 0x7f3c140d03c0 2023-07-06T21:57:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c13fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c140b3870 0x7f3c14153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c13fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c140b3870 0x7f3c14153000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50432/0 (socket says 172.21.15.55:50432) 2023-07-06T21:57:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c13fff640 1 -- 172.21.15.55:0/2049623879 learned_addr learned my addr 172.21.15.55:0/2049623879 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c18db6640 1 --2- 172.21.15.55:0/2049623879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c1415b850 0x7f3c14159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c137fe640 1 --2- 172.21.15.55:0/2049623879 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c140d03c0 0x7f3c1415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c13fff640 1 -- 172.21.15.55:0/2049623879 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c140d03c0 msgr2=0x7f3c1415bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c13fff640 1 --2- 172.21.15.55:0/2049623879 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c140d03c0 0x7f3c1415bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c13fff640 1 -- 172.21.15.55:0/2049623879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c1415b850 msgr2=0x7f3c14159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c13fff640 1 --2- 172.21.15.55:0/2049623879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c1415b850 0x7f3c14159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:04.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c13fff640 1 -- 172.21.15.55:0/2049623879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08009420 con 0x7f3c140b3870 2023-07-06T21:57:04.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c13fff640 1 --2- 172.21.15.55:0/2049623879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c140b3870 0x7f3c14153000 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400c490 tx=0x7f3c0400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:04.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c10ff9640 1 -- 172.21.15.55:0/2049623879 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040052d0 con 0x7f3c140b3870 2023-07-06T21:57:04.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c10ff9640 1 -- 172.21.15.55:0/2049623879 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c04005430 con 0x7f3c140b3870 2023-07-06T21:57:04.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c10ff9640 1 -- 172.21.15.55:0/2049623879 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04012870 con 0x7f3c140b3870 2023-07-06T21:57:04.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c1a819640 1 -- 172.21.15.55:0/2049623879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1415ea80 con 0x7f3c140b3870 2023-07-06T21:57:04.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.905+0000 7f3c1a819640 1 -- 172.21.15.55:0/2049623879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1415f040 con 0x7f3c140b3870 2023-07-06T21:57:04.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.909+0000 7f3c1a819640 1 -- 172.21.15.55:0/2049623879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c14066d60 con 0x7f3c140b3870 2023-07-06T21:57:04.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.909+0000 7f3c10ff9640 1 -- 172.21.15.55:0/2049623879 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f3c040129d0 con 0x7f3c140b3870 2023-07-06T21:57:04.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.909+0000 7f3c10ff9640 1 --2- 172.21.15.55:0/2049623879 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f3c000663a0 0x7f3c00068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:04.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.909+0000 7f3c10ff9640 1 -- 172.21.15.55:0/2049623879 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6814+0+0 (secure 0 0 0) 0x7f3c04083ca0 con 0x7f3c140b3870 2023-07-06T21:57:04.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.909+0000 7f3c137fe640 1 -- 172.21.15.55:0/2049623879 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f3c000663a0 msgr2=0x7f3c00068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3229281422 2023-07-06T21:57:04.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.909+0000 7f3c137fe640 1 --2- 172.21.15.55:0/2049623879 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f3c000663a0 0x7f3c00068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:04.913+0000 7f3c10ff9640 1 -- 172.21.15.55:0/2049623879 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3c04050d30 con 0x7f3c140b3870 2023-07-06T21:57:04.998 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:04.999+0000 7f80f6b77180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:57:05.057 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:05.059+0000 7f80f6b77180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:57:05.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.069+0000 7f3c1a819640 1 -- 172.21.15.55:0/2049623879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3c140b3420 con 0x7f3c140b3870 2023-07-06T21:57:05.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.069+0000 7f3c10ff9640 1 -- 172.21.15.55:0/2049623879 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v75) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3c04054350 con 0x7f3c140b3870 2023-07-06T21:57:05.067 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:57:05.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.073+0000 7f3c1a819640 1 -- 172.21.15.55:0/2049623879 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f3c000663a0 msgr2=0x7f3c00068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:05.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.073+0000 7f3c1a819640 1 --2- 172.21.15.55:0/2049623879 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f3c000663a0 0x7f3c00068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.073+0000 7f3c1a819640 1 -- 172.21.15.55:0/2049623879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c140b3870 msgr2=0x7f3c14153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:05.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.073+0000 7f3c1a819640 1 --2- 172.21.15.55:0/2049623879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c140b3870 0x7f3c14153000 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400c490 tx=0x7f3c0400c950 comp rx=0 tx=0).stop 2023-07-06T21:57:05.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.073+0000 7f3c1a819640 1 -- 172.21.15.55:0/2049623879 shutdown_connections 2023-07-06T21:57:05.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.073+0000 7f3c1a819640 1 --2- 172.21.15.55:0/2049623879 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f3c000663a0 0x7f3c00068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.073+0000 7f3c1a819640 1 --2- 172.21.15.55:0/2049623879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c1415b850 0x7f3c14159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.073+0000 7f3c1a819640 1 --2- 172.21.15.55:0/2049623879 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c140d03c0 0x7f3c1415bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.073+0000 7f3c1a819640 1 --2- 172.21.15.55:0/2049623879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c140b3870 0x7f3c14153000 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.073+0000 7f3c1a819640 1 -- 172.21.15.55:0/2049623879 >> 172.21.15.55:0/2049623879 conn(0x7f3c140cec20 msgr2=0x7f3c140ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:05.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.073+0000 7f3c1a819640 1 -- 172.21.15.55:0/2049623879 shutdown_connections 2023-07-06T21:57:05.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.073+0000 7f3c1a819640 1 -- 172.21.15.55:0/2049623879 wait complete. 2023-07-06T21:57:05.071 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:05.073+0000 7efc21055180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:57:05.090 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:57:05.113 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:05.115+0000 7f80f6b77180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:57:05.138 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:05.141+0000 7efc21055180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:57:05.199 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:05.201+0000 7efc21055180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:57:05.203 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:05.203+0000 7f80f6b77180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:57:05.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.249+0000 7fb821500640 1 Processor -- start 2023-07-06T21:57:05.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.249+0000 7fb821500640 1 -- start start 2023-07-06T21:57:05.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.249+0000 7fb821500640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb81c0cf5c0 0x7fb81c06c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:05.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.249+0000 7fb821500640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb81c0b57c0 0x7fb81c06ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:05.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.249+0000 7fb821500640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81c15d850 con 0x7fb81c15d350 2023-07-06T21:57:05.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.249+0000 7fb821500640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81c15db30 con 0x7fb81c0cf5c0 2023-07-06T21:57:05.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.249+0000 7fb821500640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c15de10 con 0x7fb81c0b57c0 2023-07-06T21:57:05.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.249+0000 7fb81b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb81c15d350 0x7fb81c0cbc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48352/0 (socket says 172.21.15.55:48352) 2023-07-06T21:57:05.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.249+0000 7fb81b7fe640 1 -- 172.21.15.55:0/3937061833 learned_addr learned my addr 172.21.15.55:0/3937061833 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:05.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.249+0000 7fb81affd640 1 --2- 172.21.15.55:0/3937061833 >> v2:172.21.15.138:3300/0 conn(0x7fb81c0cf5c0 0x7fb81c06c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:05.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.249+0000 7fb81a7fc640 1 --2- 172.21.15.55:0/3937061833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb81c0b57c0 0x7fb81c06ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:05.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.249+0000 7fb819ffb640 1 -- 172.21.15.55:0/3937061833 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231783904 0 0) 0x7fb81c15d850 con 0x7fb81c15d350 2023-07-06T21:57:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.249+0000 7fb819ffb640 1 -- 172.21.15.55:0/3937061833 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb804003530 con 0x7fb81c15d350 2023-07-06T21:57:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.253+0000 7fb81affd640 1 -- 172.21.15.55:0/3937061833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb81c0b57c0 msgr2=0x7fb81c06ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.253+0000 7fb81affd640 1 --2- 172.21.15.55:0/3937061833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb81c0b57c0 0x7fb81c06ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.253+0000 7fb81affd640 1 -- 172.21.15.55:0/3937061833 >> v1:172.21.15.55:6789/0 conn(0x7fb81c15d350 legacy=0x7fb81c0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.253+0000 7fb81affd640 1 -- 172.21.15.55:0/3937061833 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c15e0f0 con 0x7fb81c0cf5c0 2023-07-06T21:57:05.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.253+0000 7fb81a7fc640 1 --2- 172.21.15.55:0/3937061833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb81c0b57c0 0x7fb81c06ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:05.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.253+0000 7fb81affd640 1 --2- 172.21.15.55:0/3937061833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c0cf5c0 0x7fb81c06c710 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0097f0 tx=0x7fb80c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27707720f378fe4b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:05.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.253+0000 7fb819ffb640 1 -- 172.21.15.55:0/3937061833 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c0a6040 con 0x7fb81c0cf5c0 2023-07-06T21:57:05.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.253+0000 7fb819ffb640 1 -- 172.21.15.55:0/3937061833 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c0aa600 con 0x7fb81c0cf5c0 2023-07-06T21:57:05.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.253+0000 7fb819ffb640 1 -- 172.21.15.55:0/3937061833 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c0aa990 con 0x7fb81c0cf5c0 2023-07-06T21:57:05.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 -- 172.21.15.55:0/3937061833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c0cf5c0 msgr2=0x7fb81c06c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:05.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 --2- 172.21.15.55:0/3937061833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c0cf5c0 0x7fb81c06c710 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0097f0 tx=0x7fb80c01c480 comp rx=0 tx=0).stop 2023-07-06T21:57:05.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 -- 172.21.15.55:0/3937061833 shutdown_connections 2023-07-06T21:57:05.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 --2- 172.21.15.55:0/3937061833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb81c0b57c0 0x7fb81c06ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 --2- 172.21.15.55:0/3937061833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c0cf5c0 0x7fb81c06c710 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 -- 172.21.15.55:0/3937061833 >> 172.21.15.55:0/3937061833 conn(0x7fb81c0d0020 msgr2=0x7fb81c0d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:05.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 -- 172.21.15.55:0/3937061833 shutdown_connections 2023-07-06T21:57:05.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 -- 172.21.15.55:0/3937061833 wait complete. 2023-07-06T21:57:05.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 Processor -- start 2023-07-06T21:57:05.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 -- start start 2023-07-06T21:57:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81c0b57c0 0x7fb81c146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c0cf5c0 0x7fb81c159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb81c15d350 0x7fb81c06c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c06be80 con 0x7fb81c0b57c0 2023-07-06T21:57:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c147510 con 0x7fb81c0cf5c0 2023-07-06T21:57:05.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb821500640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c06afb0 con 0x7fb81c15d350 2023-07-06T21:57:05.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb81affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81c0b57c0 0x7fb81c146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:05.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb81affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81c0b57c0 0x7fb81c146fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50446/0 (socket says 172.21.15.55:50446) 2023-07-06T21:57:05.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb81affd640 1 -- 172.21.15.55:0/1676949636 learned_addr learned my addr 172.21.15.55:0/1676949636 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:05.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb81a7fc640 1 --2- 172.21.15.55:0/1676949636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c0cf5c0 0x7fb81c159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:05.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.257+0000 7fb81b7fe640 1 --2- 172.21.15.55:0/1676949636 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb81c15d350 0x7fb81c06c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:05.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.261+0000 7fb81affd640 1 -- 172.21.15.55:0/1676949636 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb81c15d350 msgr2=0x7fb81c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:05.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.261+0000 7fb81affd640 1 --2- 172.21.15.55:0/1676949636 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb81c15d350 0x7fb81c06c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.261+0000 7fb81affd640 1 -- 172.21.15.55:0/1676949636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c0cf5c0 msgr2=0x7fb81c159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:05.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.261+0000 7fb81affd640 1 --2- 172.21.15.55:0/1676949636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c0cf5c0 0x7fb81c159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.261+0000 7fb81affd640 1 -- 172.21.15.55:0/1676949636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb810009420 con 0x7fb81c0b57c0 2023-07-06T21:57:05.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.261+0000 7fb81affd640 1 --2- 172.21.15.55:0/1676949636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81c0b57c0 0x7fb81c146fd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb80c01ab30 tx=0x7fb80c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:05.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.261+0000 7fb8037fe640 1 -- 172.21.15.55:0/1676949636 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c006e20 con 0x7fb81c0b57c0 2023-07-06T21:57:05.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.261+0000 7fb8037fe640 1 -- 172.21.15.55:0/1676949636 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c0b3600 con 0x7fb81c0b57c0 2023-07-06T21:57:05.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.261+0000 7fb821500640 1 -- 172.21.15.55:0/1676949636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80c009420 con 0x7fb81c0b57c0 2023-07-06T21:57:05.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.261+0000 7fb8037fe640 1 -- 172.21.15.55:0/1676949636 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c0b39d0 con 0x7fb81c0b57c0 2023-07-06T21:57:05.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.261+0000 7fb821500640 1 -- 172.21.15.55:0/1676949636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81c15a390 con 0x7fb81c0b57c0 2023-07-06T21:57:05.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.261+0000 7fb821500640 1 -- 172.21.15.55:0/1676949636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81c06bfc0 con 0x7fb81c0b57c0 2023-07-06T21:57:05.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.261+0000 7fb8037fe640 1 -- 172.21.15.55:0/1676949636 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fb80c0b3b30 con 0x7fb81c0b57c0 2023-07-06T21:57:05.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.265+0000 7fb8037fe640 1 --2- 172.21.15.55:0/1676949636 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fb8080663a0 0x7fb808068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:05.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.265+0000 7fb81a7fc640 1 -- 172.21.15.55:0/1676949636 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fb8080663a0 msgr2=0x7fb808068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3229281422 2023-07-06T21:57:05.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.265+0000 7fb8037fe640 1 -- 172.21.15.55:0/1676949636 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6814+0+0 (secure 0 0 0) 0x7fb80c11ea20 con 0x7fb81c0b57c0 2023-07-06T21:57:05.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.265+0000 7fb81a7fc640 1 --2- 172.21.15.55:0/1676949636 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fb8080663a0 0x7fb808068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:05.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.269+0000 7fb8037fe640 1 -- 172.21.15.55:0/1676949636 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb81c06bfc0 con 0x7fb81c0b57c0 2023-07-06T21:57:05.265 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:05.267+0000 7f80f6b77180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:57:05.307 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:05.309+0000 7efc21055180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:57:05.350 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:05.351+0000 7f80f6b77180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:57:05.367 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:05.369+0000 7efc21055180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:57:05.407 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:05.407+0000 7f80f6b77180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:57:05.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.433+0000 7fb821500640 1 -- 172.21.15.55:0/1676949636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb81c06bfc0 con 0x7fb81c0b57c0 2023-07-06T21:57:05.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.433+0000 7fb8037fe640 1 -- 172.21.15.55:0/1676949636 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb81c06bfc0 con 0x7fb81c0b57c0 2023-07-06T21:57:05.431 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:57:05.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.437+0000 7fb821500640 1 -- 172.21.15.55:0/1676949636 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fb8080663a0 msgr2=0x7fb808068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:05.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.437+0000 7fb821500640 1 --2- 172.21.15.55:0/1676949636 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fb8080663a0 0x7fb808068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.437+0000 7fb821500640 1 -- 172.21.15.55:0/1676949636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81c0b57c0 msgr2=0x7fb81c146fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:05.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.437+0000 7fb821500640 1 --2- 172.21.15.55:0/1676949636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81c0b57c0 0x7fb81c146fd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb80c01ab30 tx=0x7fb80c01acc0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.437+0000 7fb821500640 1 -- 172.21.15.55:0/1676949636 shutdown_connections 2023-07-06T21:57:05.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.437+0000 7fb821500640 1 --2- 172.21.15.55:0/1676949636 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fb8080663a0 0x7fb808068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.437+0000 7fb821500640 1 --2- 172.21.15.55:0/1676949636 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb81c15d350 0x7fb81c06c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.437+0000 7fb821500640 1 --2- 172.21.15.55:0/1676949636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c0cf5c0 0x7fb81c159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.437+0000 7fb821500640 1 --2- 172.21.15.55:0/1676949636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81c0b57c0 0x7fb81c146fd0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.437+0000 7fb821500640 1 -- 172.21.15.55:0/1676949636 >> 172.21.15.55:0/1676949636 conn(0x7fb81c0d0020 msgr2=0x7fb81c1589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:05.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.437+0000 7fb821500640 1 -- 172.21.15.55:0/1676949636 shutdown_connections 2023-07-06T21:57:05.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.437+0000 7fb821500640 1 -- 172.21.15.55:0/1676949636 wait complete. 2023-07-06T21:57:05.453 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:57:05.457 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:05.461+0000 7efc21055180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:57:05.519 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:05.521+0000 7efc21055180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:57:05.554 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:05.555+0000 7f80f6b77180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:57:05.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.601+0000 7fe66ce0b640 1 Processor -- start 2023-07-06T21:57:05.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe66ce0b640 1 -- start start 2023-07-06T21:57:05.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe66ce0b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe6680709a0 0x7fe6680cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:05.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe66ce0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6680cbe60 0x7fe6680b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:05.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe66ce0b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6680cc300 con 0x7fe668070d70 2023-07-06T21:57:05.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe66ce0b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6680cc5e0 con 0x7fe6680709a0 2023-07-06T21:57:05.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe66ce0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680cc8c0 con 0x7fe6680cbe60 2023-07-06T21:57:05.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe66659c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe6680709a0 0x7fe6680cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:05.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe666d9d640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fe668070d70 0x7fe66815d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:58236/0 (socket says 172.21.15.55:58236) 2023-07-06T21:57:05.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe666d9d640 1 -- 172.21.15.55:0/4284449959 learned_addr learned my addr 172.21.15.55:0/4284449959 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:05.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe65ffff640 1 --2- 172.21.15.55:0/4284449959 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6680cbe60 0x7fe6680b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:05.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe66659c640 1 -- 172.21.15.55:0/4284449959 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6680cbe60 msgr2=0x7fe6680b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:05.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe66659c640 1 --2- 172.21.15.55:0/4284449959 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6680cbe60 0x7fe6680b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe66659c640 1 -- 172.21.15.55:0/4284449959 >> v1:172.21.15.138:6789/0 conn(0x7fe668070d70 legacy=0x7fe66815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:05.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe66659c640 1 -- 172.21.15.55:0/4284449959 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680ccba0 con 0x7fe6680709a0 2023-07-06T21:57:05.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.605+0000 7fe665d9b640 1 -- 172.21.15.55:0/4284449959 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031460457 0 0) 0x7fe6680cc300 con 0x7fe668070d70 2023-07-06T21:57:05.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.609+0000 7fe66659c640 1 --2- 172.21.15.55:0/4284449959 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6680709a0 0x7fe6680cb920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe6580097c0 tx=0x7fe65801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98da6089ee88ee39 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:05.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.609+0000 7fe665d9b640 1 -- 172.21.15.55:0/4284449959 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6580ab600 con 0x7fe6680709a0 2023-07-06T21:57:05.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.609+0000 7fe665d9b640 1 -- 172.21.15.55:0/4284449959 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6580a7050 con 0x7fe6680709a0 2023-07-06T21:57:05.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.609+0000 7fe665d9b640 1 -- 172.21.15.55:0/4284449959 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6580ab980 con 0x7fe6680709a0 2023-07-06T21:57:05.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.609+0000 7fe66ce0b640 1 -- 172.21.15.55:0/4284449959 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6680709a0 msgr2=0x7fe6680cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:05.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.609+0000 7fe66ce0b640 1 --2- 172.21.15.55:0/4284449959 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6680709a0 0x7fe6680cb920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe6580097c0 tx=0x7fe65801c480 comp rx=0 tx=0).stop 2023-07-06T21:57:05.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.609+0000 7fe66ce0b640 1 -- 172.21.15.55:0/4284449959 shutdown_connections 2023-07-06T21:57:05.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.609+0000 7fe66ce0b640 1 --2- 172.21.15.55:0/4284449959 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6680cbe60 0x7fe6680b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.609+0000 7fe66ce0b640 1 --2- 172.21.15.55:0/4284449959 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6680709a0 0x7fe6680cb920 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.609+0000 7fe66ce0b640 1 -- 172.21.15.55:0/4284449959 >> 172.21.15.55:0/4284449959 conn(0x7fe6680cea70 msgr2=0x7fe6680ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:05.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.609+0000 7fe66ce0b640 1 -- 172.21.15.55:0/4284449959 shutdown_connections 2023-07-06T21:57:05.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.609+0000 7fe66ce0b640 1 -- 172.21.15.55:0/4284449959 wait complete. 2023-07-06T21:57:05.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.609+0000 7fe66ce0b640 1 Processor -- start 2023-07-06T21:57:05.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.609+0000 7fe66ce0b640 1 -- start start 2023-07-06T21:57:05.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66ce0b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6680709a0 0x7fe66809ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:05.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66ce0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe668070d70 0x7fe6680c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:05.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66ce0b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6680cbe60 0x7fe6680ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:05.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66ce0b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66809e600 con 0x7fe6680709a0 2023-07-06T21:57:05.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66ce0b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66809dd60 con 0x7fe6680cbe60 2023-07-06T21:57:05.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66ce0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66809e040 con 0x7fe668070d70 2023-07-06T21:57:05.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6680709a0 0x7fe66809ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:05.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6680709a0 0x7fe66809ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50448/0 (socket says 172.21.15.55:50448) 2023-07-06T21:57:05.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66659c640 1 -- 172.21.15.55:0/1307832035 learned_addr learned my addr 172.21.15.55:0/1307832035 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:05.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe666d9d640 1 --2- 172.21.15.55:0/1307832035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6680cbe60 0x7fe6680ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:05.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe65ffff640 1 --2- 172.21.15.55:0/1307832035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe668070d70 0x7fe6680c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:05.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66659c640 1 -- 172.21.15.55:0/1307832035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe668070d70 msgr2=0x7fe6680c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:05.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66659c640 1 --2- 172.21.15.55:0/1307832035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe668070d70 0x7fe6680c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66659c640 1 -- 172.21.15.55:0/1307832035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6680cbe60 msgr2=0x7fe6680ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:05.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66659c640 1 --2- 172.21.15.55:0/1307832035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6680cbe60 0x7fe6680ade30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66659c640 1 -- 172.21.15.55:0/1307832035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe658009420 con 0x7fe6680709a0 2023-07-06T21:57:05.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66659c640 1 --2- 172.21.15.55:0/1307832035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6680709a0 0x7fe66809ce00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe6580ae040 tx=0x7fe65801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:05.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe65effd640 1 -- 172.21.15.55:0/1307832035 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6580b7650 con 0x7fe6680709a0 2023-07-06T21:57:05.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe65effd640 1 -- 172.21.15.55:0/1307832035 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6580abe90 con 0x7fe6680709a0 2023-07-06T21:57:05.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe65effd640 1 -- 172.21.15.55:0/1307832035 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6580b7a10 con 0x7fe6680709a0 2023-07-06T21:57:05.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66ce0b640 1 -- 172.21.15.55:0/1307832035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66809e320 con 0x7fe6680709a0 2023-07-06T21:57:05.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66ce0b640 1 -- 172.21.15.55:0/1307832035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66809d340 con 0x7fe6680709a0 2023-07-06T21:57:05.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.613+0000 7fe66ce0b640 1 -- 172.21.15.55:0/1307832035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe668156af0 con 0x7fe6680709a0 2023-07-06T21:57:05.614 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:05.615+0000 7f80f6b77180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:57:05.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.617+0000 7fe65effd640 1 -- 172.21.15.55:0/1307832035 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fe6580b7b70 con 0x7fe6680709a0 2023-07-06T21:57:05.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.617+0000 7fe65effd640 1 --2- 172.21.15.55:0/1307832035 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fe6480663a0 0x7fe648068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:05.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.617+0000 7fe65effd640 1 -- 172.21.15.55:0/1307832035 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6814+0+0 (secure 0 0 0) 0x7fe65811f480 con 0x7fe6680709a0 2023-07-06T21:57:05.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.617+0000 7fe65ffff640 1 -- 172.21.15.55:0/1307832035 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fe6480663a0 msgr2=0x7fe648068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3229281422 2023-07-06T21:57:05.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.617+0000 7fe65ffff640 1 --2- 172.21.15.55:0/1307832035 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fe6480663a0 0x7fe648068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:05.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.621+0000 7fe65effd640 1 -- 172.21.15.55:0/1307832035 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe6580ec5a0 con 0x7fe6680709a0 2023-07-06T21:57:05.674 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:05.677+0000 7efc21055180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:57:05.735 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:05.737+0000 7efc21055180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:57:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.785+0000 7fe66ce0b640 1 -- 172.21.15.55:0/1307832035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe668156af0 con 0x7fe6680709a0 2023-07-06T21:57:05.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.785+0000 7fe65effd640 1 -- 172.21.15.55:0/1307832035 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe668156af0 con 0x7fe6680709a0 2023-07-06T21:57:05.784 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:57:05.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.789+0000 7fe66ce0b640 1 -- 172.21.15.55:0/1307832035 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fe6480663a0 msgr2=0x7fe648068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:05.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.789+0000 7fe66ce0b640 1 --2- 172.21.15.55:0/1307832035 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fe6480663a0 0x7fe648068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.789+0000 7fe66ce0b640 1 -- 172.21.15.55:0/1307832035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6680709a0 msgr2=0x7fe66809ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:05.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.789+0000 7fe66ce0b640 1 --2- 172.21.15.55:0/1307832035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6680709a0 0x7fe66809ce00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe6580ae040 tx=0x7fe65801acc0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.789+0000 7fe66ce0b640 1 -- 172.21.15.55:0/1307832035 shutdown_connections 2023-07-06T21:57:05.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.789+0000 7fe66ce0b640 1 --2- 172.21.15.55:0/1307832035 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fe6480663a0 0x7fe648068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.789+0000 7fe66ce0b640 1 --2- 172.21.15.55:0/1307832035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6680cbe60 0x7fe6680ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.789+0000 7fe66ce0b640 1 --2- 172.21.15.55:0/1307832035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe668070d70 0x7fe6680c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.789+0000 7fe66ce0b640 1 --2- 172.21.15.55:0/1307832035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6680709a0 0x7fe66809ce00 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.789+0000 7fe66ce0b640 1 -- 172.21.15.55:0/1307832035 >> 172.21.15.55:0/1307832035 conn(0x7fe6680cea70 msgr2=0x7fe6680c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.789+0000 7fe66ce0b640 1 -- 172.21.15.55:0/1307832035 shutdown_connections 2023-07-06T21:57:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:05.789+0000 7fe66ce0b640 1 -- 172.21.15.55:0/1307832035 wait complete. 2023-07-06T21:57:05.807 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T21:57:05.856 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:57:05.856 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:57:05.856 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:57:05.864 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:05.863+0000 7f80f6b77180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:57:06.007 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:57:06.007 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:57:06.008 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:57:06.008 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:06.007+0000 7f80f6b77180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:57:06.016 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:06.021+0000 7efc21055180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:57:06.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f463aba9640 1 Processor -- start 2023-07-06T21:57:06.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f463aba9640 1 -- start start 2023-07-06T21:57:06.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f463aba9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46340d0630 0x7f463415fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f463aba9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46340cc740 con 0x7f46340b1250 2023-07-06T21:57:06.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f463aba9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46340ccc90 con 0x7f46340ce200 2023-07-06T21:57:06.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f463aba9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46340b29c0 con 0x7f46340d0630 2023-07-06T21:57:06.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f4639ba7640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f46340b1250 0x7f463415f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48364/0 (socket says 172.21.15.55:48364) 2023-07-06T21:57:06.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f4639ba7640 1 -- 172.21.15.55:0/2054796812 learned_addr learned my addr 172.21.15.55:0/2054796812 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f46393a6640 1 --2- 172.21.15.55:0/2054796812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46340d0630 0x7f463415fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f4638ba5640 1 -- 172.21.15.55:0/2054796812 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529074714 0 0) 0x7f46340cc740 con 0x7f46340b1250 2023-07-06T21:57:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f4638ba5640 1 -- 172.21.15.55:0/2054796812 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4620003530 con 0x7f46340b1250 2023-07-06T21:57:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f46393a6640 1 -- 172.21.15.55:0/2054796812 >> v1:172.21.15.138:6789/0 conn(0x7f46340ce200 legacy=0x7f46340ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f4638ba5640 1 -- 172.21.15.55:0/2054796812 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026951108 0 0) 0x7f46340ccc90 con 0x7f46340ce200 2023-07-06T21:57:06.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f46393a6640 1 -- 172.21.15.55:0/2054796812 >> v1:172.21.15.55:6789/0 conn(0x7f46340b1250 legacy=0x7f463415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.041+0000 7f46393a6640 1 -- 172.21.15.55:0/2054796812 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46340d1d10 con 0x7f46340d0630 2023-07-06T21:57:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.045+0000 7f46393a6640 1 --2- 172.21.15.55:0/2054796812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46340d0630 0x7f463415fa90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f46240097f0 tx=0x7f462401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59b4f0c2058240b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:06.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.045+0000 7f4638ba5640 1 -- 172.21.15.55:0/2054796812 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46240ab600 con 0x7f46340d0630 2023-07-06T21:57:06.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.045+0000 7f4638ba5640 1 -- 172.21.15.55:0/2054796812 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46240a7050 con 0x7f46340d0630 2023-07-06T21:57:06.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.045+0000 7f4638ba5640 1 -- 172.21.15.55:0/2054796812 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46240ab960 con 0x7f46340d0630 2023-07-06T21:57:06.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.045+0000 7f463aba9640 1 -- 172.21.15.55:0/2054796812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46340d0630 msgr2=0x7f463415fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.045+0000 7f463aba9640 1 --2- 172.21.15.55:0/2054796812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46340d0630 0x7f463415fa90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f46240097f0 tx=0x7f462401c430 comp rx=0 tx=0).stop 2023-07-06T21:57:06.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.045+0000 7f463aba9640 1 -- 172.21.15.55:0/2054796812 shutdown_connections 2023-07-06T21:57:06.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.045+0000 7f463aba9640 1 --2- 172.21.15.55:0/2054796812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46340d0630 0x7f463415fa90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.045+0000 7f463aba9640 1 -- 172.21.15.55:0/2054796812 >> 172.21.15.55:0/2054796812 conn(0x7f46340b3b60 msgr2=0x7f46340b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:06.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.045+0000 7f463aba9640 1 -- 172.21.15.55:0/2054796812 shutdown_connections 2023-07-06T21:57:06.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.045+0000 7f463aba9640 1 -- 172.21.15.55:0/2054796812 wait complete. 2023-07-06T21:57:06.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463aba9640 1 Processor -- start 2023-07-06T21:57:06.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463aba9640 1 -- start start 2023-07-06T21:57:06.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463aba9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46340b1250 0x7f463414d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463aba9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46340ce200 0x7f46340693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463aba9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46340d0630 0x7f4634069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463aba9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4634159030 con 0x7f46340d0630 2023-07-06T21:57:06.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463aba9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463414e4d0 con 0x7f46340ce200 2023-07-06T21:57:06.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463aba9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4634158d50 con 0x7f46340b1250 2023-07-06T21:57:06.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463a3a8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46340d0630 0x7f4634069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:06.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463a3a8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46340d0630 0x7f4634069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50456/0 (socket says 172.21.15.55:50456) 2023-07-06T21:57:06.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463a3a8640 1 -- 172.21.15.55:0/1809270627 learned_addr learned my addr 172.21.15.55:0/1809270627 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:06.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f4639ba7640 1 --2- 172.21.15.55:0/1809270627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46340b1250 0x7f463414d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:06.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f46393a6640 1 --2- 172.21.15.55:0/1809270627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46340ce200 0x7f46340693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:06.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463a3a8640 1 -- 172.21.15.55:0/1809270627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46340b1250 msgr2=0x7f463414d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463a3a8640 1 --2- 172.21.15.55:0/1809270627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46340b1250 0x7f463414d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463a3a8640 1 -- 172.21.15.55:0/1809270627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46340ce200 msgr2=0x7f46340693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463a3a8640 1 --2- 172.21.15.55:0/1809270627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46340ce200 0x7f46340693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463a3a8640 1 -- 172.21.15.55:0/1809270627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4624009420 con 0x7f46340d0630 2023-07-06T21:57:06.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f46393a6640 1 --2- 172.21.15.55:0/1809270627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46340ce200 0x7f46340693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:06.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463a3a8640 1 --2- 172.21.15.55:0/1809270627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46340d0630 0x7f4634069930 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f462c00c780 tx=0x7f462c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:06.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f462a7fc640 1 -- 172.21.15.55:0/1809270627 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c003db0 con 0x7f46340d0630 2023-07-06T21:57:06.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f462a7fc640 1 -- 172.21.15.55:0/1809270627 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c00ce30 con 0x7f46340d0630 2023-07-06T21:57:06.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f462a7fc640 1 -- 172.21.15.55:0/1809270627 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c0052b0 con 0x7f46340d0630 2023-07-06T21:57:06.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463aba9640 1 -- 172.21.15.55:0/1809270627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463414de80 con 0x7f46340d0630 2023-07-06T21:57:06.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.049+0000 7f463aba9640 1 -- 172.21.15.55:0/1809270627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463414d9b0 con 0x7f46340d0630 2023-07-06T21:57:06.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.053+0000 7f463aba9640 1 -- 172.21.15.55:0/1809270627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463414dce0 con 0x7f46340d0630 2023-07-06T21:57:06.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.053+0000 7f462a7fc640 1 -- 172.21.15.55:0/1809270627 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f462c005410 con 0x7f46340d0630 2023-07-06T21:57:06.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.053+0000 7f462a7fc640 1 --2- 172.21.15.55:0/1809270627 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f46180663d0 0x7f4618068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.053+0000 7f462a7fc640 1 -- 172.21.15.55:0/1809270627 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6798+0+0 (secure 0 0 0) 0x7f462c083ee0 con 0x7f46340d0630 2023-07-06T21:57:06.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.053+0000 7f4639ba7640 1 -- 172.21.15.55:0/1809270627 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f46180663d0 msgr2=0x7f4618068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3229281422 2023-07-06T21:57:06.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.053+0000 7f4639ba7640 1 --2- 172.21.15.55:0/1809270627 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f46180663d0 0x7f4618068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:06.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.057+0000 7f462a7fc640 1 -- 172.21.15.55:0/1809270627 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f463414dce0 con 0x7f46340d0630 2023-07-06T21:57:06.135 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:06.135+0000 7f80f6b77180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:57:06.160 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:06.165+0000 7efc21055180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:57:06.206 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:06.207+0000 7f80f6b77180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:57:06.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.225+0000 7f463aba9640 1 -- 172.21.15.55:0/1809270627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f463414dce0 con 0x7f46340d0630 2023-07-06T21:57:06.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.229+0000 7f462a7fc640 1 -- 172.21.15.55:0/1809270627 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v76) v1 ==== 80+0+468 (secure 0 0 0) 0x7f463414dce0 con 0x7f46340d0630 2023-07-06T21:57:06.225 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/827601659 2023-07-07T21:55:20.576434+0000 2023-07-06T21:57:06.225 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3134202503 2023-07-07T21:55:20.576434+0000 2023-07-06T21:57:06.225 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3677020920 2023-07-07T21:55:20.576434+0000 2023-07-06T21:57:06.226 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1723719878 2023-07-07T21:55:20.576434+0000 2023-07-06T21:57:06.226 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/3843972996 2023-07-07T21:55:20.576434+0000 2023-07-06T21:57:06.226 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/3843972996 2023-07-07T21:55:20.576434+0000 2023-07-06T21:57:06.226 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2622666608 2023-07-07T21:55:20.576434+0000 2023-07-06T21:57:06.226 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/457725185 2023-07-07T21:55:20.576434+0000 2023-07-06T21:57:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-07-06T21:57:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.229+0000 7f463aba9640 1 -- 172.21.15.55:0/1809270627 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f46180663d0 msgr2=0x7f4618068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.229+0000 7f463aba9640 1 --2- 172.21.15.55:0/1809270627 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f46180663d0 0x7f4618068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.229+0000 7f463aba9640 1 -- 172.21.15.55:0/1809270627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46340d0630 msgr2=0x7f4634069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.229+0000 7f463aba9640 1 --2- 172.21.15.55:0/1809270627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46340d0630 0x7f4634069930 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f462c00c780 tx=0x7f462c00cc40 comp rx=0 tx=0).stop 2023-07-06T21:57:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.229+0000 7f463aba9640 1 -- 172.21.15.55:0/1809270627 shutdown_connections 2023-07-06T21:57:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.229+0000 7f463aba9640 1 --2- 172.21.15.55:0/1809270627 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f46180663d0 0x7f4618068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.229+0000 7f463aba9640 1 --2- 172.21.15.55:0/1809270627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46340d0630 0x7f4634069930 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.229+0000 7f463aba9640 1 --2- 172.21.15.55:0/1809270627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46340ce200 0x7f46340693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.229+0000 7f463aba9640 1 --2- 172.21.15.55:0/1809270627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46340b1250 0x7f463414d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.229+0000 7f463aba9640 1 -- 172.21.15.55:0/1809270627 >> 172.21.15.55:0/1809270627 conn(0x7f46340b3b60 msgr2=0x7f4634156c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:06.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.229+0000 7f463aba9640 1 -- 172.21.15.55:0/1809270627 shutdown_connections 2023-07-06T21:57:06.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.229+0000 7f463aba9640 1 -- 172.21.15.55:0/1809270627 wait complete. 2023-07-06T21:57:06.246 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T21:57:06.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:06.247 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-06T21:57:06.298 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:06.301+0000 7efc21055180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:57:06.310 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T21:57:06.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:06.310 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T21:57:06.320 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:57:06.320 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:06.329 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:57:06.329 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:57:06.329 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:06.342 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:06.343+0000 7f80f6b77180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:57:06.368 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T21:57:06.368 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:57:06.369 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:06.374 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:06.377+0000 7efc21055180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:57:06.377 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:57:06.378 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:57:06.517 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:06.521+0000 7efc21055180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:57:06.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f6930c0b640 1 Processor -- start 2023-07-06T21:57:06.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f6930c0b640 1 -- start start 2023-07-06T21:57:06.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f6930c0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f692c0ca450 0x7f692c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f6930c0b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f692c0b3730 0x7f692c15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f6930c0b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c159cd0 con 0x7f692c0712f0 2023-07-06T21:57:06.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f6930c0b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692c0693f0 con 0x7f692c0b3730 2023-07-06T21:57:06.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f6930c0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c06aca0 con 0x7f692c0ca450 2023-07-06T21:57:06.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f692ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f692c0b3730 0x7f692c15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:06.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f692ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f692c0b3730 0x7f692c15d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50462/0 (socket says 172.21.15.55:50462) 2023-07-06T21:57:06.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f692a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f692c0712f0 0x7f692c0c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48372/0 (socket says 172.21.15.55:48372) 2023-07-06T21:57:06.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f692ad9d640 1 -- 172.21.15.55:0/35894062 learned_addr learned my addr 172.21.15.55:0/35894062 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:06.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f692ad9d640 1 -- 172.21.15.55:0/35894062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f692c0ca450 msgr2=0x7f692c06a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:06.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f692ad9d640 1 --2- 172.21.15.55:0/35894062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f692c0ca450 0x7f692c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f692ad9d640 1 -- 172.21.15.55:0/35894062 >> v1:172.21.15.55:6789/0 conn(0x7f692c0712f0 legacy=0x7f692c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f692ad9d640 1 -- 172.21.15.55:0/35894062 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c0696b0 con 0x7f692c0b3730 2023-07-06T21:57:06.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.525+0000 7f6929d9b640 1 -- 172.21.15.55:0/35894062 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336573798 0 0) 0x7f692c159cd0 con 0x7f692c0712f0 2023-07-06T21:57:06.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.529+0000 7f692ad9d640 1 --2- 172.21.15.55:0/35894062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f692c0b3730 0x7f692c15d3e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6924009e50 tx=0x7f692401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e8049edb6fbd91 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:06.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.529+0000 7f6929d9b640 1 -- 172.21.15.55:0/35894062 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240a58a0 con 0x7f692c0b3730 2023-07-06T21:57:06.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.529+0000 7f6929d9b640 1 -- 172.21.15.55:0/35894062 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69240a5a00 con 0x7f692c0b3730 2023-07-06T21:57:06.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.529+0000 7f6929d9b640 1 -- 172.21.15.55:0/35894062 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240a5d90 con 0x7f692c0b3730 2023-07-06T21:57:06.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.529+0000 7f6930c0b640 1 -- 172.21.15.55:0/35894062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f692c0b3730 msgr2=0x7f692c15d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.529+0000 7f6930c0b640 1 --2- 172.21.15.55:0/35894062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f692c0b3730 0x7f692c15d3e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6924009e50 tx=0x7f692401c9e0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.529+0000 7f6930c0b640 1 -- 172.21.15.55:0/35894062 shutdown_connections 2023-07-06T21:57:06.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.529+0000 7f6930c0b640 1 --2- 172.21.15.55:0/35894062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f692c0ca450 0x7f692c06a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.529+0000 7f6930c0b640 1 --2- 172.21.15.55:0/35894062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f692c0b3730 0x7f692c15d3e0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.529+0000 7f6930c0b640 1 -- 172.21.15.55:0/35894062 >> 172.21.15.55:0/35894062 conn(0x7f692c0cded0 msgr2=0x7f692c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:06.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.529+0000 7f6930c0b640 1 -- 172.21.15.55:0/35894062 shutdown_connections 2023-07-06T21:57:06.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.529+0000 7f6930c0b640 1 -- 172.21.15.55:0/35894062 wait complete. 2023-07-06T21:57:06.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6930c0b640 1 Processor -- start 2023-07-06T21:57:06.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6930c0b640 1 -- start start 2023-07-06T21:57:06.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6930c0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f692c0712f0 0x7f692c0c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6930c0b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f692c0b3730 0x7f692c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6930c0b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f692c0ca450 0x7f692c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6930c0b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c0c4590 con 0x7f692c0b3730 2023-07-06T21:57:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6930c0b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c155220 con 0x7f692c0ca450 2023-07-06T21:57:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6930c0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c1554c0 con 0x7f692c0712f0 2023-07-06T21:57:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6923fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f692c0b3730 0x7f692c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f692a59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f692c0712f0 0x7f692c0c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6923fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f692c0b3730 0x7f692c0ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50468/0 (socket says 172.21.15.55:50468) 2023-07-06T21:57:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6923fff640 1 -- 172.21.15.55:0/698505641 learned_addr learned my addr 172.21.15.55:0/698505641 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f692ad9d640 1 --2- 172.21.15.55:0/698505641 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f692c0ca450 0x7f692c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:06.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f692a59c640 1 -- 172.21.15.55:0/698505641 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f692c0ca450 msgr2=0x7f692c0aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f692a59c640 1 --2- 172.21.15.55:0/698505641 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f692c0ca450 0x7f692c0aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f692a59c640 1 -- 172.21.15.55:0/698505641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f692c0b3730 msgr2=0x7f692c0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f692a59c640 1 --2- 172.21.15.55:0/698505641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f692c0b3730 0x7f692c0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f692a59c640 1 -- 172.21.15.55:0/698505641 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6924009b30 con 0x7f692c0712f0 2023-07-06T21:57:06.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f692a59c640 1 --2- 172.21.15.55:0/698505641 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f692c0712f0 0x7f692c0c4fa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c410 tx=0x7f691c00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:06.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6922ffd640 1 -- 172.21.15.55:0/698505641 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c0074e0 con 0x7f692c0712f0 2023-07-06T21:57:06.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6922ffd640 1 -- 172.21.15.55:0/698505641 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c007640 con 0x7f692c0712f0 2023-07-06T21:57:06.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6922ffd640 1 -- 172.21.15.55:0/698505641 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c004a30 con 0x7f692c0712f0 2023-07-06T21:57:06.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.533+0000 7f6930c0b640 1 -- 172.21.15.55:0/698505641 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692c1557a0 con 0x7f692c0712f0 2023-07-06T21:57:06.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.537+0000 7f6930c0b640 1 -- 172.21.15.55:0/698505641 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692c0c6c60 con 0x7f692c0712f0 2023-07-06T21:57:06.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.537+0000 7f6930c0b640 1 -- 172.21.15.55:0/698505641 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692c0c6ac0 con 0x7f692c0712f0 2023-07-06T21:57:06.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.537+0000 7f6922ffd640 1 -- 172.21.15.55:0/698505641 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 25) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f691c004b90 con 0x7f692c0712f0 2023-07-06T21:57:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.537+0000 7f6922ffd640 1 --2- 172.21.15.55:0/698505641 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f690c0663d0 0x7f690c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.537+0000 7f6923fff640 1 -- 172.21.15.55:0/698505641 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f690c0663d0 msgr2=0x7f690c068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3229281422 2023-07-06T21:57:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.537+0000 7f6922ffd640 1 -- 172.21.15.55:0/698505641 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6798+0+0 (secure 0 0 0) 0x7f691c083e00 con 0x7f692c0712f0 2023-07-06T21:57:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.537+0000 7f6923fff640 1 --2- 172.21.15.55:0/698505641 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f690c0663d0 0x7f690c068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:06.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.541+0000 7f6922ffd640 1 -- 172.21.15.55:0/698505641 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f692c0c6ac0 con 0x7f692c0712f0 2023-07-06T21:57:06.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.729+0000 7f6930c0b640 1 -- 172.21.15.55:0/698505641 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f692c0c6ac0 con 0x7f692c0712f0 2023-07-06T21:57:06.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.729+0000 7f6922ffd640 1 -- 172.21.15.55:0/698505641 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f692c0c6ac0 con 0x7f692c0712f0 2023-07-06T21:57:06.728 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:06.728 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2986611670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2986611670},{"type":"v1","addr":"172.21.15.138:6835","nonce":2986611670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6351,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2521348037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2521348037},{"type":"v1","addr":"172.21.15.55:6836","nonce":2521348037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1716722785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1716722785},{"type":"v1","addr":"172.21.15.55:6837","nonce":1716722785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:55:04.192386+0000","modified":"2023-07-06T21:55:07.200622+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6357":{"gid":6357,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6834/2595020915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2595020915},{"type":"v1","addr":"172.21.15.138:6834","nonce":2595020915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-06T21:57:06.729 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2023-07-06T21:57:06.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.733+0000 7f6930c0b640 1 -- 172.21.15.55:0/698505641 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f690c0663d0 msgr2=0x7f690c068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:06.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.733+0000 7f6930c0b640 1 --2- 172.21.15.55:0/698505641 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f690c0663d0 0x7f690c068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.733+0000 7f6930c0b640 1 -- 172.21.15.55:0/698505641 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f692c0712f0 msgr2=0x7f692c0c4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.733+0000 7f6930c0b640 1 --2- 172.21.15.55:0/698505641 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f692c0712f0 0x7f692c0c4fa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c410 tx=0x7f691c00c810 comp rx=0 tx=0).stop 2023-07-06T21:57:06.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.733+0000 7f6930c0b640 1 -- 172.21.15.55:0/698505641 shutdown_connections 2023-07-06T21:57:06.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.733+0000 7f6930c0b640 1 --2- 172.21.15.55:0/698505641 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7f690c0663d0 0x7f690c068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.733+0000 7f6930c0b640 1 --2- 172.21.15.55:0/698505641 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f692c0ca450 0x7f692c0aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.733+0000 7f6930c0b640 1 --2- 172.21.15.55:0/698505641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f692c0b3730 0x7f692c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.733+0000 7f6930c0b640 1 --2- 172.21.15.55:0/698505641 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f692c0712f0 0x7f692c0c4fa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.733+0000 7f6930c0b640 1 -- 172.21.15.55:0/698505641 >> 172.21.15.55:0/698505641 conn(0x7f692c0cded0 msgr2=0x7f692c15bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:06.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.733+0000 7f6930c0b640 1 -- 172.21.15.55:0/698505641 shutdown_connections 2023-07-06T21:57:06.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.733+0000 7f6930c0b640 1 -- 172.21.15.55:0/698505641 wait complete. 2023-07-06T21:57:06.757 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:06.892 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:06.891+0000 7f80f6b77180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:57:06.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.905+0000 7fdc6e137640 1 Processor -- start 2023-07-06T21:57:06.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.905+0000 7fdc6e137640 1 -- start start 2023-07-06T21:57:06.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.905+0000 7fdc6e137640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdc680ce610 0x7fdc680b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.905+0000 7fdc6e137640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc680b1e10 0x7fdc6815f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.905+0000 7fdc6e137640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc680cd1c0 con 0x7fdc680b7cd0 2023-07-06T21:57:06.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.905+0000 7fdc6e137640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc680d2310 con 0x7fdc680b1e10 2023-07-06T21:57:06.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.905+0000 7fdc6e137640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc680b80a0 con 0x7fdc680ce610 2023-07-06T21:57:06.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.909+0000 7fdc67fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc680b1e10 0x7fdc6815f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:06.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.909+0000 7fdc67fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc680b1e10 0x7fdc6815f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50478/0 (socket says 172.21.15.55:50478) 2023-07-06T21:57:06.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.909+0000 7fdc67fff640 1 -- 172.21.15.55:0/1804289174 learned_addr learned my addr 172.21.15.55:0/1804289174 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:06.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.909+0000 7fdc66ffd640 1 --2- 172.21.15.55:0/1804289174 >> v2:172.21.15.138:3300/0 conn(0x7fdc680ce610 0x7fdc680b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:06.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.909+0000 7fdc67fff640 1 -- 172.21.15.55:0/1804289174 >> v2:172.21.15.138:3300/0 conn(0x7fdc680ce610 msgr2=0x7fdc680b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:06.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.909+0000 7fdc67fff640 1 --2- 172.21.15.55:0/1804289174 >> v2:172.21.15.138:3300/0 conn(0x7fdc680ce610 0x7fdc680b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.909+0000 7fdc67fff640 1 -- 172.21.15.55:0/1804289174 >> v1:172.21.15.138:6789/0 conn(0x7fdc680b7cd0 legacy=0x7fdc680ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.909+0000 7fdc667fc640 1 -- 172.21.15.55:0/1804289174 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142925663 0 0) 0x7fdc680cd1c0 con 0x7fdc680b7cd0 2023-07-06T21:57:06.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.909+0000 7fdc67fff640 1 -- 172.21.15.55:0/1804289174 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc680b2270 con 0x7fdc680b1e10 2023-07-06T21:57:06.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.913+0000 7fdc67fff640 1 --2- 172.21.15.55:0/1804289174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680b1e10 0x7fdc6815f870 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fdc68065af0 tx=0x7fdc6001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223c34a134563ff4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:06.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.913+0000 7fdc667fc640 1 -- 172.21.15.55:0/1804289174 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc600a5600 con 0x7fdc680b1e10 2023-07-06T21:57:06.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.913+0000 7fdc667fc640 1 -- 172.21.15.55:0/1804289174 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc600a5760 con 0x7fdc680b1e10 2023-07-06T21:57:06.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.913+0000 7fdc667fc640 1 -- 172.21.15.55:0/1804289174 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc600a5af0 con 0x7fdc680b1e10 2023-07-06T21:57:06.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.913+0000 7fdc6e137640 1 -- 172.21.15.55:0/1804289174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680b1e10 msgr2=0x7fdc6815f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.913+0000 7fdc6e137640 1 --2- 172.21.15.55:0/1804289174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680b1e10 0x7fdc6815f870 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fdc68065af0 tx=0x7fdc6001c940 comp rx=0 tx=0).stop 2023-07-06T21:57:06.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.913+0000 7fdc6e137640 1 -- 172.21.15.55:0/1804289174 shutdown_connections 2023-07-06T21:57:06.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.913+0000 7fdc6e137640 1 --2- 172.21.15.55:0/1804289174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680b1e10 0x7fdc6815f870 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.913+0000 7fdc6e137640 1 --2- 172.21.15.55:0/1804289174 >> v2:172.21.15.138:3300/0 conn(0x7fdc680ce610 0x7fdc680b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.913+0000 7fdc6e137640 1 -- 172.21.15.55:0/1804289174 >> 172.21.15.55:0/1804289174 conn(0x7fdc680ceee0 msgr2=0x7fdc680cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:06.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.913+0000 7fdc6e137640 1 -- 172.21.15.55:0/1804289174 shutdown_connections 2023-07-06T21:57:06.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.913+0000 7fdc6e137640 1 -- 172.21.15.55:0/1804289174 wait complete. 2023-07-06T21:57:06.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc6e137640 1 Processor -- start 2023-07-06T21:57:06.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc6e137640 1 -- start start 2023-07-06T21:57:06.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc6e137640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680b1e10 0x7fdc680c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc6e137640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc680b7cd0 0x7fdc680cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc6e137640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc680ce610 0x7fdc6814dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc6e137640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6815a4c0 con 0x7fdc680b1e10 2023-07-06T21:57:06.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc6e137640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6814e5d0 con 0x7fdc680ce610 2023-07-06T21:57:06.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc6e137640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680c9a70 con 0x7fdc680b7cd0 2023-07-06T21:57:06.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc677fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680b1e10 0x7fdc680c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:06.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc66ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc680b7cd0 0x7fdc680cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:06.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc677fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680b1e10 0x7fdc680c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50480/0 (socket says 172.21.15.55:50480) 2023-07-06T21:57:06.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc67fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc680ce610 0x7fdc6814dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:06.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc677fe640 1 -- 172.21.15.55:0/733627286 learned_addr learned my addr 172.21.15.55:0/733627286 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:06.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc677fe640 1 -- 172.21.15.55:0/733627286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc680b7cd0 msgr2=0x7fdc680cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc677fe640 1 --2- 172.21.15.55:0/733627286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc680b7cd0 0x7fdc680cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc677fe640 1 -- 172.21.15.55:0/733627286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc680ce610 msgr2=0x7fdc6814dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:06.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc677fe640 1 --2- 172.21.15.55:0/733627286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc680ce610 0x7fdc6814dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:06.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc677fe640 1 -- 172.21.15.55:0/733627286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc60009b30 con 0x7fdc680b1e10 2023-07-06T21:57:06.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc677fe640 1 --2- 172.21.15.55:0/733627286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680b1e10 0x7fdc680c9530 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fdc5800c4d0 tx=0x7fdc5800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:06.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc4ffff640 1 -- 172.21.15.55:0/733627286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58005480 con 0x7fdc680b1e10 2023-07-06T21:57:06.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc4ffff640 1 -- 172.21.15.55:0/733627286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc58003600 con 0x7fdc680b1e10 2023-07-06T21:57:06.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc4ffff640 1 -- 172.21.15.55:0/733627286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580039b0 con 0x7fdc680b1e10 2023-07-06T21:57:06.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc6e137640 1 -- 172.21.15.55:0/733627286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc68159b20 con 0x7fdc680b1e10 2023-07-06T21:57:06.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.917+0000 7fdc6e137640 1 -- 172.21.15.55:0/733627286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6815a0e0 con 0x7fdc680b1e10 2023-07-06T21:57:06.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.921+0000 7fdc6e137640 1 -- 172.21.15.55:0/733627286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc68066d60 con 0x7fdc680b1e10 2023-07-06T21:57:06.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.921+0000 7fdc4ffff640 1 -- 172.21.15.55:0/733627286 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fdc58003b10 con 0x7fdc680b1e10 2023-07-06T21:57:06.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.921+0000 7fdc4ffff640 1 --2- 172.21.15.55:0/733627286 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fdc540663a0 0x7fdc54068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:06.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.921+0000 7fdc4ffff640 1 -- 172.21.15.55:0/733627286 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6798+0+0 (secure 0 0 0) 0x7fdc58083660 con 0x7fdc680b1e10 2023-07-06T21:57:06.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.921+0000 7fdc66ffd640 1 -- 172.21.15.55:0/733627286 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fdc540663a0 msgr2=0x7fdc54068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3229281422 2023-07-06T21:57:06.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.921+0000 7fdc66ffd640 1 --2- 172.21.15.55:0/733627286 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fdc540663a0 0x7fdc54068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:06.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:06.925+0000 7fdc4ffff640 1 -- 172.21.15.55:0/733627286 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc580508f0 con 0x7fdc680b1e10 2023-07-06T21:57:06.979 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:06.979+0000 7f80f6b77180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:57:07.044 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:57:07.048 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:57:07.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.081+0000 7fdc6e137640 1 -- 172.21.15.55:0/733627286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc680b7580 con 0x7fdc680b1e10 2023-07-06T21:57:07.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.085+0000 7fdc4ffff640 1 -- 172.21.15.55:0/733627286 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+19170 (secure 0 0 0) 0x7fdc58053f10 con 0x7fdc680b1e10 2023-07-06T21:57:07.082 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:07.082 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":76,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:57:05.761370+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:55:02.300695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-07-06T21:55:03.183596+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/827601659":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/3134202503":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/3677020920":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/1723719878":"2023-07-07T21:55:20.576434+0000","172.21.15.55:6833/3843972996":"2023-07-07T21:55:20.576434+0000","172.21.15.55:6832/3843972996":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/2622666608":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/457725185":"2023-07-07T21:55:20.576434+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:07.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.085+0000 7fdc6e137640 1 -- 172.21.15.55:0/733627286 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fdc540663a0 msgr2=0x7fdc54068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:07.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.085+0000 7fdc6e137640 1 --2- 172.21.15.55:0/733627286 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fdc540663a0 0x7fdc54068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.085+0000 7fdc6e137640 1 -- 172.21.15.55:0/733627286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680b1e10 msgr2=0x7fdc680c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:07.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.085+0000 7fdc6e137640 1 --2- 172.21.15.55:0/733627286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680b1e10 0x7fdc680c9530 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fdc5800c4d0 tx=0x7fdc5800c990 comp rx=0 tx=0).stop 2023-07-06T21:57:07.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.085+0000 7fdc6e137640 1 -- 172.21.15.55:0/733627286 shutdown_connections 2023-07-06T21:57:07.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.085+0000 7fdc6e137640 1 --2- 172.21.15.55:0/733627286 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fdc540663a0 0x7fdc54068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.085+0000 7fdc6e137640 1 --2- 172.21.15.55:0/733627286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc680ce610 0x7fdc6814dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.085+0000 7fdc6e137640 1 --2- 172.21.15.55:0/733627286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc680b7cd0 0x7fdc680cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.085+0000 7fdc6e137640 1 --2- 172.21.15.55:0/733627286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680b1e10 0x7fdc680c9530 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.085+0000 7fdc6e137640 1 -- 172.21.15.55:0/733627286 >> 172.21.15.55:0/733627286 conn(0x7fdc680ceee0 msgr2=0x7fdc680cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:07.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.085+0000 7fdc6e137640 1 -- 172.21.15.55:0/733627286 shutdown_connections 2023-07-06T21:57:07.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.085+0000 7fdc6e137640 1 -- 172.21.15.55:0/733627286 wait complete. 2023-07-06T21:57:07.104 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:55:02.300695+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:55:03.183596+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 5, 'snap_epoch': 76, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:57:07.105 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:57:07.110 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.113+0000 7efc21055180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:57:07.128 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:07.127+0000 7f80f6b77180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:57:07.200 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.205+0000 7efc21055180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:57:07.212 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:07.211+0000 7f80f6b77180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:57:07.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.257+0000 7fd74cc34640 1 Processor -- start 2023-07-06T21:57:07.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74cc34640 1 -- start start 2023-07-06T21:57:07.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74cc34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd7480709a0 0x7fd7480cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74cc34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7480cbe60 0x7fd7480b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74cc34640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd748070d70 0x7fd7480b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74cc34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7480cc300 con 0x7fd7480709a0 2023-07-06T21:57:07.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74cc34640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7480cc5e0 con 0x7fd748070d70 2023-07-06T21:57:07.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74cc34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480cc8c0 con 0x7fd7480cbe60 2023-07-06T21:57:07.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd7480709a0 0x7fd7480cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd7480709a0 0x7fd7480cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50492/0 (socket says 172.21.15.55:50492) 2023-07-06T21:57:07.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74659c640 1 -- 172.21.15.55:0/1889027221 learned_addr learned my addr 172.21.15.55:0/1889027221 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:07.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd73ffff640 1 --2- 172.21.15.55:0/1889027221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7480cbe60 0x7fd7480b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd746d9d640 1 --2- 172.21.15.55:0/1889027221 >> v2:172.21.15.138:3300/0 conn(0x7fd748070d70 0x7fd7480b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74659c640 1 -- 172.21.15.55:0/1889027221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7480cbe60 msgr2=0x7fd7480b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:07.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74659c640 1 --2- 172.21.15.55:0/1889027221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7480cbe60 0x7fd7480b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74659c640 1 -- 172.21.15.55:0/1889027221 >> v2:172.21.15.138:3300/0 conn(0x7fd748070d70 msgr2=0x7fd7480b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:07.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74659c640 1 --2- 172.21.15.55:0/1889027221 >> v2:172.21.15.138:3300/0 conn(0x7fd748070d70 0x7fd7480b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.261+0000 7fd74659c640 1 -- 172.21.15.55:0/1889027221 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7480ccba0 con 0x7fd7480709a0 2023-07-06T21:57:07.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.265+0000 7fd74659c640 1 --2- 172.21.15.55:0/1889027221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7480709a0 0x7fd7480cb920 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd74806cc70 tx=0x7fd73801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401c2420eea32d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:07.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.265+0000 7fd745d9b640 1 -- 172.21.15.55:0/1889027221 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7380ac630 con 0x7fd7480709a0 2023-07-06T21:57:07.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.265+0000 7fd745d9b640 1 -- 172.21.15.55:0/1889027221 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7380ac790 con 0x7fd7480709a0 2023-07-06T21:57:07.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.265+0000 7fd745d9b640 1 -- 172.21.15.55:0/1889027221 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7380acb20 con 0x7fd7480709a0 2023-07-06T21:57:07.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.265+0000 7fd74cc34640 1 -- 172.21.15.55:0/1889027221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7480709a0 msgr2=0x7fd7480cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:07.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.265+0000 7fd74cc34640 1 --2- 172.21.15.55:0/1889027221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7480709a0 0x7fd7480cb920 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd74806cc70 tx=0x7fd73801c500 comp rx=0 tx=0).stop 2023-07-06T21:57:07.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.265+0000 7fd74cc34640 1 -- 172.21.15.55:0/1889027221 shutdown_connections 2023-07-06T21:57:07.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.265+0000 7fd74cc34640 1 --2- 172.21.15.55:0/1889027221 >> v2:172.21.15.138:3300/0 conn(0x7fd748070d70 0x7fd7480b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.265+0000 7fd74cc34640 1 --2- 172.21.15.55:0/1889027221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7480cbe60 0x7fd7480b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.265+0000 7fd74cc34640 1 --2- 172.21.15.55:0/1889027221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7480709a0 0x7fd7480cb920 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.265+0000 7fd74cc34640 1 -- 172.21.15.55:0/1889027221 >> 172.21.15.55:0/1889027221 conn(0x7fd7480cea70 msgr2=0x7fd7480ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:07.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.265+0000 7fd74cc34640 1 -- 172.21.15.55:0/1889027221 shutdown_connections 2023-07-06T21:57:07.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.265+0000 7fd74cc34640 1 -- 172.21.15.55:0/1889027221 wait complete. 2023-07-06T21:57:07.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd74cc34640 1 Processor -- start 2023-07-06T21:57:07.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd74cc34640 1 -- start start 2023-07-06T21:57:07.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd74cc34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7480709a0 0x7fd7480c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd74cc34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd748070d70 0x7fd7480c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd74cc34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7480cbe60 0x7fd7480693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd74cc34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480c6a00 con 0x7fd748070d70 2023-07-06T21:57:07.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd74cc34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480c7360 con 0x7fd7480cbe60 2023-07-06T21:57:07.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd74cc34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480c5d80 con 0x7fd7480709a0 2023-07-06T21:57:07.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd73ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd748070d70 0x7fd7480c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd73ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd748070d70 0x7fd7480c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50508/0 (socket says 172.21.15.55:50508) 2023-07-06T21:57:07.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd73ffff640 1 -- 172.21.15.55:0/3537409573 learned_addr learned my addr 172.21.15.55:0/3537409573 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:07.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd746d9d640 1 --2- 172.21.15.55:0/3537409573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7480cbe60 0x7fd7480693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd74659c640 1 --2- 172.21.15.55:0/3537409573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7480709a0 0x7fd7480c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd73ffff640 1 -- 172.21.15.55:0/3537409573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7480709a0 msgr2=0x7fd7480c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:07.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd73ffff640 1 --2- 172.21.15.55:0/3537409573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7480709a0 0x7fd7480c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd73ffff640 1 -- 172.21.15.55:0/3537409573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7480cbe60 msgr2=0x7fd7480693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:07.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd73ffff640 1 --2- 172.21.15.55:0/3537409573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7480cbe60 0x7fd7480693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd73ffff640 1 -- 172.21.15.55:0/3537409573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380094d0 con 0x7fd748070d70 2023-07-06T21:57:07.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd73ffff640 1 --2- 172.21.15.55:0/3537409573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd748070d70 0x7fd7480c84e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd73000e870 tx=0x7fd73000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:07.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd73effd640 1 -- 172.21.15.55:0/3537409573 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730009510 con 0x7fd748070d70 2023-07-06T21:57:07.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd73effd640 1 -- 172.21.15.55:0/3537409573 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73000eec0 con 0x7fd748070d70 2023-07-06T21:57:07.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd74cc34640 1 -- 172.21.15.55:0/3537409573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7480c6060 con 0x7fd748070d70 2023-07-06T21:57:07.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd73effd640 1 -- 172.21.15.55:0/3537409573 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73000cb80 con 0x7fd748070d70 2023-07-06T21:57:07.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd74cc34640 1 -- 172.21.15.55:0/3537409573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7480c6620 con 0x7fd748070d70 2023-07-06T21:57:07.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.269+0000 7fd74cc34640 1 -- 172.21.15.55:0/3537409573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd748066d60 con 0x7fd748070d70 2023-07-06T21:57:07.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.273+0000 7fd73effd640 1 -- 172.21.15.55:0/3537409573 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fd73000cce0 con 0x7fd748070d70 2023-07-06T21:57:07.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.273+0000 7fd73effd640 1 --2- 172.21.15.55:0/3537409573 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fd7280663a0 0x7fd728068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.273+0000 7fd74659c640 1 -- 172.21.15.55:0/3537409573 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fd7280663a0 msgr2=0x7fd728068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3229281422 2023-07-06T21:57:07.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.273+0000 7fd73effd640 1 -- 172.21.15.55:0/3537409573 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6798+0+0 (secure 0 0 0) 0x7fd730084190 con 0x7fd748070d70 2023-07-06T21:57:07.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.273+0000 7fd74659c640 1 --2- 172.21.15.55:0/3537409573 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fd7280663a0 0x7fd728068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:07.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.281+0000 7fd73effd640 1 -- 172.21.15.55:0/3537409573 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7300512c0 con 0x7fd748070d70 2023-07-06T21:57:07.363 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.365+0000 7efc21055180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:57:07.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.436+0000 7fd74cc34640 1 -- 172.21.15.55:0/3537409573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd74806d1c0 con 0x7fd748070d70 2023-07-06T21:57:07.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.440+0000 7fd73effd640 1 -- 172.21.15.55:0/3537409573 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7300548e0 con 0x7fd748070d70 2023-07-06T21:57:07.437 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:57:07.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.440+0000 7fd74cc34640 1 -- 172.21.15.55:0/3537409573 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fd7280663a0 msgr2=0x7fd728068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:07.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.440+0000 7fd74cc34640 1 --2- 172.21.15.55:0/3537409573 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fd7280663a0 0x7fd728068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.440+0000 7fd74cc34640 1 -- 172.21.15.55:0/3537409573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd748070d70 msgr2=0x7fd7480c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:07.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.440+0000 7fd74cc34640 1 --2- 172.21.15.55:0/3537409573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd748070d70 0x7fd7480c84e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd73000e870 tx=0x7fd73000ec70 comp rx=0 tx=0).stop 2023-07-06T21:57:07.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.440+0000 7fd74cc34640 1 -- 172.21.15.55:0/3537409573 shutdown_connections 2023-07-06T21:57:07.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.440+0000 7fd74cc34640 1 --2- 172.21.15.55:0/3537409573 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fd7280663a0 0x7fd728068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.440+0000 7fd74cc34640 1 --2- 172.21.15.55:0/3537409573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7480cbe60 0x7fd7480693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.440+0000 7fd74cc34640 1 --2- 172.21.15.55:0/3537409573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd748070d70 0x7fd7480c84e0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.440+0000 7fd74cc34640 1 --2- 172.21.15.55:0/3537409573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7480709a0 0x7fd7480c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.440+0000 7fd74cc34640 1 -- 172.21.15.55:0/3537409573 >> 172.21.15.55:0/3537409573 conn(0x7fd7480cea70 msgr2=0x7fd7480c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:07.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.440+0000 7fd74cc34640 1 -- 172.21.15.55:0/3537409573 shutdown_connections 2023-07-06T21:57:07.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.440+0000 7fd74cc34640 1 -- 172.21.15.55:0/3537409573 wait complete. 2023-07-06T21:57:07.452 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.452+0000 7efc21055180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:57:07.458 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:57:07.488 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:07.487+0000 7f80f6b77180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:57:07.548 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:07.547+0000 7f80f6b77180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:57:07.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd41f1e9640 1 Processor -- start 2023-07-06T21:57:07.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd41f1e9640 1 -- start start 2023-07-06T21:57:07.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd41f1e9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd41815b850 0x7fd4180cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd41f1e9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4180b3f80 0x7fd4180d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd41f1e9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4180b2b80 con 0x7fd4180ccd30 2023-07-06T21:57:07.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd41f1e9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4180cff30 con 0x7fd4180b3f80 2023-07-06T21:57:07.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd41f1e9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4180b22e0 con 0x7fd41815b850 2023-07-06T21:57:07.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd41d786640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4180b3f80 0x7fd4180d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd417fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd4180ccd30 0x7fd4180b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48386/0 (socket says 172.21.15.55:48386) 2023-07-06T21:57:07.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd417fff640 1 -- 172.21.15.55:0/2270977779 learned_addr learned my addr 172.21.15.55:0/2270977779 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:07.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd41cf85640 1 --2- 172.21.15.55:0/2270977779 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd41815b850 0x7fd4180cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd41d786640 1 -- 172.21.15.55:0/2270977779 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd41815b850 msgr2=0x7fd4180cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:07.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd41d786640 1 --2- 172.21.15.55:0/2270977779 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd41815b850 0x7fd4180cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd41d786640 1 -- 172.21.15.55:0/2270977779 >> v1:172.21.15.55:6789/0 conn(0x7fd4180ccd30 legacy=0x7fd4180b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:07.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd41d786640 1 -- 172.21.15.55:0/2270977779 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4180b25c0 con 0x7fd4180b3f80 2023-07-06T21:57:07.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.608+0000 7fd4177fe640 1 -- 172.21.15.55:0/2270977779 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012677394 0 0) 0x7fd4180b2b80 con 0x7fd4180ccd30 2023-07-06T21:57:07.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.612+0000 7fd41d786640 1 --2- 172.21.15.55:0/2270977779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4180b3f80 0x7fd4180d03c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd410009d90 tx=0x7fd41001c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8afd1d6fb370b7e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:07.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.612+0000 7fd4177fe640 1 -- 172.21.15.55:0/2270977779 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100a5850 con 0x7fd4180b3f80 2023-07-06T21:57:07.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.612+0000 7fd4177fe640 1 -- 172.21.15.55:0/2270977779 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4100a59b0 con 0x7fd4180b3f80 2023-07-06T21:57:07.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.612+0000 7fd4177fe640 1 -- 172.21.15.55:0/2270977779 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100a5d40 con 0x7fd4180b3f80 2023-07-06T21:57:07.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.612+0000 7fd41f1e9640 1 -- 172.21.15.55:0/2270977779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4180b3f80 msgr2=0x7fd4180d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:07.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.612+0000 7fd41f1e9640 1 --2- 172.21.15.55:0/2270977779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4180b3f80 0x7fd4180d03c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd410009d90 tx=0x7fd41001c800 comp rx=0 tx=0).stop 2023-07-06T21:57:07.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.612+0000 7fd41f1e9640 1 -- 172.21.15.55:0/2270977779 shutdown_connections 2023-07-06T21:57:07.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.612+0000 7fd41f1e9640 1 --2- 172.21.15.55:0/2270977779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4180b3f80 0x7fd4180d03c0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.612+0000 7fd41f1e9640 1 --2- 172.21.15.55:0/2270977779 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd41815b850 0x7fd4180cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.612+0000 7fd41f1e9640 1 -- 172.21.15.55:0/2270977779 >> 172.21.15.55:0/2270977779 conn(0x7fd4180cec20 msgr2=0x7fd4180cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:07.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.612+0000 7fd41f1e9640 1 -- 172.21.15.55:0/2270977779 shutdown_connections 2023-07-06T21:57:07.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.612+0000 7fd41f1e9640 1 -- 172.21.15.55:0/2270977779 wait complete. 2023-07-06T21:57:07.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd41f1e9640 1 Processor -- start 2023-07-06T21:57:07.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd41f1e9640 1 -- start start 2023-07-06T21:57:07.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd41f1e9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4180b3f80 0x7fd418150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd41f1e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4180ccd30 0x7fd4180b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd41f1e9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd41815b850 0x7fd418153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd41f1e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4181f3db0 con 0x7fd4180ccd30 2023-07-06T21:57:07.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd41f1e9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4180b64f0 con 0x7fd4180b3f80 2023-07-06T21:57:07.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd41f1e9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4180b67d0 con 0x7fd41815b850 2023-07-06T21:57:07.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd417fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4180ccd30 0x7fd4180b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd417fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4180ccd30 0x7fd4180b72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50520/0 (socket says 172.21.15.55:50520) 2023-07-06T21:57:07.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd417fff640 1 -- 172.21.15.55:0/1762185264 learned_addr learned my addr 172.21.15.55:0/1762185264 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:07.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd41cf85640 1 --2- 172.21.15.55:0/1762185264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4180b3f80 0x7fd418150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd41d786640 1 --2- 172.21.15.55:0/1762185264 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd41815b850 0x7fd418153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd417fff640 1 -- 172.21.15.55:0/1762185264 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd41815b850 msgr2=0x7fd418153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:07.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd417fff640 1 --2- 172.21.15.55:0/1762185264 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd41815b850 0x7fd418153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd417fff640 1 -- 172.21.15.55:0/1762185264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4180b3f80 msgr2=0x7fd418150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:07.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd417fff640 1 --2- 172.21.15.55:0/1762185264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4180b3f80 0x7fd418150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd417fff640 1 -- 172.21.15.55:0/1762185264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd410009a70 con 0x7fd4180ccd30 2023-07-06T21:57:07.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd41d786640 1 --2- 172.21.15.55:0/1762185264 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd41815b850 0x7fd418153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:07.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd417fff640 1 --2- 172.21.15.55:0/1762185264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4180ccd30 0x7fd4180b72b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd40400c4b0 tx=0x7fd40400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:07.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd4157fa640 1 -- 172.21.15.55:0/1762185264 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4040074e0 con 0x7fd4180ccd30 2023-07-06T21:57:07.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd4157fa640 1 -- 172.21.15.55:0/1762185264 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd404007660 con 0x7fd4180ccd30 2023-07-06T21:57:07.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd41f1e9640 1 -- 172.21.15.55:0/1762185264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41815bda0 con 0x7fd4180ccd30 2023-07-06T21:57:07.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd4157fa640 1 -- 172.21.15.55:0/1762185264 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404004a30 con 0x7fd4180ccd30 2023-07-06T21:57:07.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.616+0000 7fd41f1e9640 1 -- 172.21.15.55:0/1762185264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4180b6d90 con 0x7fd4180ccd30 2023-07-06T21:57:07.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.620+0000 7fd41f1e9640 1 -- 172.21.15.55:0/1762185264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd418066d60 con 0x7fd4180ccd30 2023-07-06T21:57:07.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.620+0000 7fd4157fa640 1 -- 172.21.15.55:0/1762185264 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fd404004b90 con 0x7fd4180ccd30 2023-07-06T21:57:07.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.620+0000 7fd4157fa640 1 --2- 172.21.15.55:0/1762185264 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fd3fc0663a0 0x7fd3fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.620+0000 7fd4157fa640 1 -- 172.21.15.55:0/1762185264 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6798+0+0 (secure 0 0 0) 0x7fd4040836a0 con 0x7fd4180ccd30 2023-07-06T21:57:07.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.620+0000 7fd41cf85640 1 -- 172.21.15.55:0/1762185264 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fd3fc0663a0 msgr2=0x7fd3fc068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3229281422 2023-07-06T21:57:07.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.620+0000 7fd41cf85640 1 --2- 172.21.15.55:0/1762185264 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fd3fc0663a0 0x7fd3fc068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:07.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.624+0000 7fd4157fa640 1 -- 172.21.15.55:0/1762185264 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4040507e0 con 0x7fd4180ccd30 2023-07-06T21:57:07.745 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.748+0000 7efc21055180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:57:07.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.780+0000 7fd41f1e9640 1 -- 172.21.15.55:0/1762185264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd4180b3420 con 0x7fd4180ccd30 2023-07-06T21:57:07.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.792+0000 7fd4157fa640 1 -- 172.21.15.55:0/1762185264 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v76) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd404053e00 con 0x7fd4180ccd30 2023-07-06T21:57:07.789 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:57:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.792+0000 7fd41f1e9640 1 -- 172.21.15.55:0/1762185264 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fd3fc0663a0 msgr2=0x7fd3fc068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.792+0000 7fd41f1e9640 1 --2- 172.21.15.55:0/1762185264 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fd3fc0663a0 0x7fd3fc068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.792+0000 7fd41f1e9640 1 -- 172.21.15.55:0/1762185264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4180ccd30 msgr2=0x7fd4180b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.792+0000 7fd41f1e9640 1 --2- 172.21.15.55:0/1762185264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4180ccd30 0x7fd4180b72b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd40400c4b0 tx=0x7fd40400c970 comp rx=0 tx=0).stop 2023-07-06T21:57:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.792+0000 7fd41f1e9640 1 -- 172.21.15.55:0/1762185264 shutdown_connections 2023-07-06T21:57:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.792+0000 7fd41f1e9640 1 --2- 172.21.15.55:0/1762185264 >> [v2:172.21.15.55:6832/3229281422,v1:172.21.15.55:6833/3229281422] conn(0x7fd3fc0663a0 0x7fd3fc068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.792+0000 7fd41f1e9640 1 --2- 172.21.15.55:0/1762185264 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd41815b850 0x7fd418153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.792+0000 7fd41f1e9640 1 --2- 172.21.15.55:0/1762185264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4180ccd30 0x7fd4180b72b0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.792+0000 7fd41f1e9640 1 --2- 172.21.15.55:0/1762185264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4180b3f80 0x7fd418150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.792+0000 7fd41f1e9640 1 -- 172.21.15.55:0/1762185264 >> 172.21.15.55:0/1762185264 conn(0x7fd4180cec20 msgr2=0x7fd4180b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:07.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.792+0000 7fd41f1e9640 1 -- 172.21.15.55:0/1762185264 shutdown_connections 2023-07-06T21:57:07.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.792+0000 7fd41f1e9640 1 -- 172.21.15.55:0/1762185264 wait complete. 2023-07-06T21:57:07.813 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:57:07.814 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.816+0000 7efc21055180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:57:07.896 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.896+0000 7efba89cb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:07.897 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.896+0000 7efba89cb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:07.897 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.896+0000 7efba89cb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:07.897 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.896+0000 7efba89cb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:07.897 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.896+0000 7efba89cb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:07.898 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.900+0000 7efbac9d3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:07.898 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.900+0000 7efbac9d3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:07.898 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.900+0000 7efbac9d3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:07.898 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.900+0000 7efbac9d3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:07.898 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:07.900+0000 7efbac9d3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.984+0000 7f35206f9640 1 Processor -- start 2023-07-06T21:57:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.984+0000 7f35206f9640 1 -- start start 2023-07-06T21:57:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.984+0000 7f35206f9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f35180709a0 0x7f35180cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.984+0000 7f35206f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35180b1340 0x7f351806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.984+0000 7f35206f9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35180cc300 con 0x7f35180cbe60 2023-07-06T21:57:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.984+0000 7f35206f9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35180cc5e0 con 0x7f35180709a0 2023-07-06T21:57:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.984+0000 7f35206f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35180cc8c0 con 0x7f35180b1340 2023-07-06T21:57:07.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.988+0000 7f351e495640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f35180709a0 0x7f35180cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.988+0000 7f351ec96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35180b1340 0x7f351806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.988+0000 7f351dc94640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f35180cbe60 0x7f35180b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:58256/0 (socket says 172.21.15.55:58256) 2023-07-06T21:57:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.988+0000 7f351dc94640 1 -- 172.21.15.55:0/1420389718 learned_addr learned my addr 172.21.15.55:0/1420389718 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.988+0000 7f351ec96640 1 -- 172.21.15.55:0/1420389718 >> v2:172.21.15.138:3300/0 conn(0x7f35180709a0 msgr2=0x7f35180cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.988+0000 7f351ec96640 1 --2- 172.21.15.55:0/1420389718 >> v2:172.21.15.138:3300/0 conn(0x7f35180709a0 0x7f35180cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.988+0000 7f351ec96640 1 -- 172.21.15.55:0/1420389718 >> v1:172.21.15.138:6789/0 conn(0x7f35180cbe60 legacy=0x7f35180b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:07.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.988+0000 7f351ec96640 1 -- 172.21.15.55:0/1420389718 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35180ccba0 con 0x7f35180b1340 2023-07-06T21:57:07.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.992+0000 7f351ec96640 1 --2- 172.21.15.55:0/1420389718 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35180b1340 0x7f351806eee0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3510009d90 tx=0x7f351001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f173af85fe46188a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.992+0000 7f351d493640 1 -- 172.21.15.55:0/1420389718 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35100a5920 con 0x7f35180b1340 2023-07-06T21:57:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f351d493640 1 -- 172.21.15.55:0/1420389718 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35100a5a80 con 0x7f35180b1340 2023-07-06T21:57:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f351d493640 1 -- 172.21.15.55:0/1420389718 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35100a5e10 con 0x7f35180b1340 2023-07-06T21:57:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 -- 172.21.15.55:0/1420389718 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35180b1340 msgr2=0x7f351806eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 --2- 172.21.15.55:0/1420389718 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35180b1340 0x7f351806eee0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3510009d90 tx=0x7f351001c950 comp rx=0 tx=0).stop 2023-07-06T21:57:07.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 -- 172.21.15.55:0/1420389718 shutdown_connections 2023-07-06T21:57:07.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 --2- 172.21.15.55:0/1420389718 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35180b1340 0x7f351806eee0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 --2- 172.21.15.55:0/1420389718 >> v2:172.21.15.138:3300/0 conn(0x7f35180709a0 0x7f35180cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 -- 172.21.15.55:0/1420389718 >> 172.21.15.55:0/1420389718 conn(0x7f35180cea70 msgr2=0x7f35180ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:07.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 -- 172.21.15.55:0/1420389718 shutdown_connections 2023-07-06T21:57:07.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 -- 172.21.15.55:0/1420389718 wait complete. 2023-07-06T21:57:07.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 Processor -- start 2023-07-06T21:57:07.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 -- start start 2023-07-06T21:57:07.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35180709a0 0x7f3518163160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35180b1340 0x7f35180a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35180cbe60 0x7f35180c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:07.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35181636a0 con 0x7f35180709a0 2023-07-06T21:57:07.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35180a1460 con 0x7f35180cbe60 2023-07-06T21:57:07.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f35206f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35180a1740 con 0x7f35180b1340 2023-07-06T21:57:07.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f351e495640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35180709a0 0x7f3518163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f351e495640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35180709a0 0x7f3518163160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50624/0 (socket says 172.21.15.55:50624) 2023-07-06T21:57:07.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:07.996+0000 7f351e495640 1 -- 172.21.15.55:0/4152004761 learned_addr learned my addr 172.21.15.55:0/4152004761 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:07.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f351ec96640 1 --2- 172.21.15.55:0/4152004761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35180cbe60 0x7f35180c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:07.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f351e495640 1 -- 172.21.15.55:0/4152004761 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35180b1340 msgr2=0x7f35180a09a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T21:57:07.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f351e495640 1 --2- 172.21.15.55:0/4152004761 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35180b1340 0x7f35180a09a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f351e495640 1 -- 172.21.15.55:0/4152004761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35180cbe60 msgr2=0x7f35180c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:07.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f351e495640 1 --2- 172.21.15.55:0/4152004761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35180cbe60 0x7f35180c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:07.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f351e495640 1 -- 172.21.15.55:0/4152004761 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3510009a70 con 0x7f35180709a0 2023-07-06T21:57:07.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f351e495640 1 --2- 172.21.15.55:0/4152004761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35180709a0 0x7f3518163160 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f351400e930 tx=0x7f351400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:07.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f350effd640 1 -- 172.21.15.55:0/4152004761 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514009690 con 0x7f35180709a0 2023-07-06T21:57:07.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f350effd640 1 -- 172.21.15.55:0/4152004761 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351400ca00 con 0x7f35180709a0 2023-07-06T21:57:07.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f35206f9640 1 -- 172.21.15.55:0/4152004761 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35180a1a20 con 0x7f35180709a0 2023-07-06T21:57:08.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f350effd640 1 -- 172.21.15.55:0/4152004761 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351400cd70 con 0x7f35180709a0 2023-07-06T21:57:08.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f35206f9640 1 -- 172.21.15.55:0/4152004761 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351806a820 con 0x7f35180709a0 2023-07-06T21:57:08.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f35206f9640 1 -- 172.21.15.55:0/4152004761 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3518066d60 con 0x7f35180709a0 2023-07-06T21:57:08.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f350effd640 1 -- 172.21.15.55:0/4152004761 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 27) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f3514013470 con 0x7f35180709a0 2023-07-06T21:57:08.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.000+0000 7f350effd640 1 -- 172.21.15.55:0/4152004761 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7098+0+0 (secure 0 0 0) 0x7f3514083f70 con 0x7f35180709a0 2023-07-06T21:57:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.004+0000 7f350effd640 1 -- 172.21.15.55:0/4152004761 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3514051400 con 0x7f35180709a0 2023-07-06T21:57:08.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.156+0000 7f35206f9640 1 -- 172.21.15.55:0/4152004761 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f35180c7e50 con 0x7f35180709a0 2023-07-06T21:57:08.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.160+0000 7f350effd640 1 -- 172.21.15.55:0/4152004761 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3514017020 con 0x7f35180709a0 2023-07-06T21:57:08.157 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:57:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.160+0000 7f35206f9640 1 -- 172.21.15.55:0/4152004761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35180709a0 msgr2=0x7f3518163160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.160+0000 7f35206f9640 1 --2- 172.21.15.55:0/4152004761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35180709a0 0x7f3518163160 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f351400e930 tx=0x7f351400edf0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.160+0000 7f35206f9640 1 -- 172.21.15.55:0/4152004761 shutdown_connections 2023-07-06T21:57:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.160+0000 7f35206f9640 1 --2- 172.21.15.55:0/4152004761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35180cbe60 0x7f35180c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.160+0000 7f35206f9640 1 --2- 172.21.15.55:0/4152004761 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35180b1340 0x7f35180a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.160+0000 7f35206f9640 1 --2- 172.21.15.55:0/4152004761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35180709a0 0x7f3518163160 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.160+0000 7f35206f9640 1 -- 172.21.15.55:0/4152004761 >> 172.21.15.55:0/4152004761 conn(0x7f35180cea70 msgr2=0x7f35181639c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.160+0000 7f35206f9640 1 -- 172.21.15.55:0/4152004761 shutdown_connections 2023-07-06T21:57:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.160+0000 7f35206f9640 1 -- 172.21.15.55:0/4152004761 wait complete. 2023-07-06T21:57:08.177 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:57:08.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.324+0000 7fe4e6ed8640 1 Processor -- start 2023-07-06T21:57:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.324+0000 7fe4e6ed8640 1 -- start start 2023-07-06T21:57:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.324+0000 7fe4e6ed8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe4e0158850 0x7fe4e00cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.324+0000 7fe4e6ed8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4e00ca130 0x7fe4e00ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.324+0000 7fe4e6ed8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4e00703e0 0x7fe4e0070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.324+0000 7fe4e6ed8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e0070dc0 con 0x7fe4e00703e0 2023-07-06T21:57:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.324+0000 7fe4e6ed8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e0158c20 con 0x7fe4e0158850 2023-07-06T21:57:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.324+0000 7fe4e6ed8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e00c8db0 con 0x7fe4e00ca130 2023-07-06T21:57:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.324+0000 7fe4e5475640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4e00703e0 0x7fe4e0070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.324+0000 7fe4e5475640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4e00703e0 0x7fe4e0070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50634/0 (socket says 172.21.15.55:50634) 2023-07-06T21:57:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.324+0000 7fe4e5475640 1 -- 172.21.15.55:0/3138809455 learned_addr learned my addr 172.21.15.55:0/3138809455 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.324+0000 7fe4dffff640 1 --2- 172.21.15.55:0/3138809455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4e00ca130 0x7fe4e00ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4e5475640 1 -- 172.21.15.55:0/3138809455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4e00ca130 msgr2=0x7fe4e00ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4e5475640 1 --2- 172.21.15.55:0/3138809455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4e00ca130 0x7fe4e00ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4e5475640 1 -- 172.21.15.55:0/3138809455 >> v2:172.21.15.138:3300/0 conn(0x7fe4e0158850 msgr2=0x7fe4e00cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4e5475640 1 --2- 172.21.15.55:0/3138809455 >> v2:172.21.15.138:3300/0 conn(0x7fe4e0158850 0x7fe4e00cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4e5475640 1 -- 172.21.15.55:0/3138809455 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e00c9090 con 0x7fe4e00703e0 2023-07-06T21:57:08.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4e5475640 1 --2- 172.21.15.55:0/3138809455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4e00703e0 0x7fe4e0070880 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe4e006eaf0 tx=0x7fe4d801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cffd75e6d3f558 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4df7fe640 1 -- 172.21.15.55:0/3138809455 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80af400 con 0x7fe4e00703e0 2023-07-06T21:57:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4df7fe640 1 -- 172.21.15.55:0/3138809455 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d80ab050 con 0x7fe4e00703e0 2023-07-06T21:57:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4df7fe640 1 -- 172.21.15.55:0/3138809455 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80af780 con 0x7fe4e00703e0 2023-07-06T21:57:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4e6ed8640 1 -- 172.21.15.55:0/3138809455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4e00703e0 msgr2=0x7fe4e0070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4e6ed8640 1 --2- 172.21.15.55:0/3138809455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4e00703e0 0x7fe4e0070880 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe4e006eaf0 tx=0x7fe4d801f1c0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4e6ed8640 1 -- 172.21.15.55:0/3138809455 shutdown_connections 2023-07-06T21:57:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4e6ed8640 1 --2- 172.21.15.55:0/3138809455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4e00703e0 0x7fe4e0070880 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4e6ed8640 1 --2- 172.21.15.55:0/3138809455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4e00ca130 0x7fe4e00ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4e6ed8640 1 --2- 172.21.15.55:0/3138809455 >> v2:172.21.15.138:3300/0 conn(0x7fe4e0158850 0x7fe4e00cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.328+0000 7fe4e6ed8640 1 -- 172.21.15.55:0/3138809455 >> 172.21.15.55:0/3138809455 conn(0x7fe4e00cea70 msgr2=0x7fe4e00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e6ed8640 1 -- 172.21.15.55:0/3138809455 shutdown_connections 2023-07-06T21:57:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e6ed8640 1 -- 172.21.15.55:0/3138809455 wait complete. 2023-07-06T21:57:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e6ed8640 1 Processor -- start 2023-07-06T21:57:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e6ed8640 1 -- start start 2023-07-06T21:57:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e6ed8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4e00703e0 0x7fe4e006c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e6ed8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00ca130 0x7fe4e00ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e6ed8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4e0158850 0x7fe4e00c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e6ed8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e00c3e20 con 0x7fe4e0158850 2023-07-06T21:57:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e6ed8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e00ae9a0 con 0x7fe4e00ca130 2023-07-06T21:57:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e6ed8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e00acce0 con 0x7fe4e00703e0 2023-07-06T21:57:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e5475640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4e0158850 0x7fe4e00c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e5475640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4e0158850 0x7fe4e00c7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50642/0 (socket says 172.21.15.55:50642) 2023-07-06T21:57:08.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e5475640 1 -- 172.21.15.55:0/616919828 learned_addr learned my addr 172.21.15.55:0/616919828 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:08.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4dffff640 1 --2- 172.21.15.55:0/616919828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00ca130 0x7fe4e00ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:08.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e4c74640 1 --2- 172.21.15.55:0/616919828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4e00703e0 0x7fe4e006c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:08.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e5475640 1 -- 172.21.15.55:0/616919828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4e00703e0 msgr2=0x7fe4e006c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:08.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e5475640 1 --2- 172.21.15.55:0/616919828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4e00703e0 0x7fe4e006c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e5475640 1 -- 172.21.15.55:0/616919828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00ca130 msgr2=0x7fe4e00ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:08.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e5475640 1 --2- 172.21.15.55:0/616919828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00ca130 0x7fe4e00ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e5475640 1 -- 172.21.15.55:0/616919828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d8009b30 con 0x7fe4e0158850 2023-07-06T21:57:08.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.332+0000 7fe4e5475640 1 --2- 172.21.15.55:0/616919828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4e0158850 0x7fe4e00c7720 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80b2040 tx=0x7fe4d801bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:08.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.336+0000 7fe4dd7fa640 1 -- 172.21.15.55:0/616919828 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80afd10 con 0x7fe4e0158850 2023-07-06T21:57:08.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.336+0000 7fe4dd7fa640 1 -- 172.21.15.55:0/616919828 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d80afe70 con 0x7fe4e0158850 2023-07-06T21:57:08.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.336+0000 7fe4dd7fa640 1 -- 172.21.15.55:0/616919828 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80ba640 con 0x7fe4e0158850 2023-07-06T21:57:08.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.336+0000 7fe4e6ed8640 1 -- 172.21.15.55:0/616919828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e00c4550 con 0x7fe4e0158850 2023-07-06T21:57:08.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.336+0000 7fe4e6ed8640 1 -- 172.21.15.55:0/616919828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e00c6f20 con 0x7fe4e0158850 2023-07-06T21:57:08.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.336+0000 7fe4e6ed8640 1 -- 172.21.15.55:0/616919828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e00acf40 con 0x7fe4e0158850 2023-07-06T21:57:08.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.336+0000 7fe4dd7fa640 1 -- 172.21.15.55:0/616919828 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 27) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fe4d80b6040 con 0x7fe4e0158850 2023-07-06T21:57:08.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.336+0000 7fe4dd7fa640 1 -- 172.21.15.55:0/616919828 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7098+0+0 (secure 0 0 0) 0x7fe4d8121d80 con 0x7fe4e0158850 2023-07-06T21:57:08.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.340+0000 7fe4dd7fa640 1 -- 172.21.15.55:0/616919828 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4d80ef200 con 0x7fe4e0158850 2023-07-06T21:57:08.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.496+0000 7fe4e6ed8640 1 -- 172.21.15.55:0/616919828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4e0066d60 con 0x7fe4e0158850 2023-07-06T21:57:08.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.496+0000 7fe4dd7fa640 1 -- 172.21.15.55:0/616919828 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe4d80b40a0 con 0x7fe4e0158850 2023-07-06T21:57:08.494 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:57:08.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.496+0000 7fe4e6ed8640 1 -- 172.21.15.55:0/616919828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4e0158850 msgr2=0x7fe4e00c7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:08.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.496+0000 7fe4e6ed8640 1 --2- 172.21.15.55:0/616919828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4e0158850 0x7fe4e00c7720 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80b2040 tx=0x7fe4d801bf60 comp rx=0 tx=0).stop 2023-07-06T21:57:08.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.496+0000 7fe4e6ed8640 1 -- 172.21.15.55:0/616919828 shutdown_connections 2023-07-06T21:57:08.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.496+0000 7fe4e6ed8640 1 --2- 172.21.15.55:0/616919828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4e0158850 0x7fe4e00c7720 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.496+0000 7fe4e6ed8640 1 --2- 172.21.15.55:0/616919828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4e00ca130 0x7fe4e00ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.496+0000 7fe4e6ed8640 1 --2- 172.21.15.55:0/616919828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4e00703e0 0x7fe4e006c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.496+0000 7fe4e6ed8640 1 -- 172.21.15.55:0/616919828 >> 172.21.15.55:0/616919828 conn(0x7fe4e00cea70 msgr2=0x7fe4e01534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:08.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.496+0000 7fe4e6ed8640 1 -- 172.21.15.55:0/616919828 shutdown_connections 2023-07-06T21:57:08.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.496+0000 7fe4e6ed8640 1 -- 172.21.15.55:0/616919828 wait complete. 2023-07-06T21:57:08.515 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:57:08.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb98b6f9640 1 Processor -- start 2023-07-06T21:57:08.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb98b6f9640 1 -- start start 2023-07-06T21:57:08.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb98b6f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9840b7cd0 0x7fb9840ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:08.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb98b6f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9840ccab0 0x7fb9840b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:08.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb98b6f9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb9840ccf00 0x7fb9840b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:08.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb98b6f9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9840d2310 con 0x7fb9840ccab0 2023-07-06T21:57:08.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb98b6f9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9840b80a0 con 0x7fb9840ccf00 2023-07-06T21:57:08.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb98b6f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9840d1100 con 0x7fb9840b7cd0 2023-07-06T21:57:08.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb988c94640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9840ccab0 0x7fb9840b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:08.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb988c94640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9840ccab0 0x7fb9840b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50654/0 (socket says 172.21.15.55:50654) 2023-07-06T21:57:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb988c94640 1 -- 172.21.15.55:0/295373547 learned_addr learned my addr 172.21.15.55:0/295373547 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb989c96640 1 --2- 172.21.15.55:0/295373547 >> v2:172.21.15.138:3300/0 conn(0x7fb9840ccf00 0x7fb9840b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb989495640 1 --2- 172.21.15.55:0/295373547 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9840b7cd0 0x7fb9840ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb988c94640 1 -- 172.21.15.55:0/295373547 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9840b7cd0 msgr2=0x7fb9840ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb988c94640 1 --2- 172.21.15.55:0/295373547 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9840b7cd0 0x7fb9840ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb988c94640 1 -- 172.21.15.55:0/295373547 >> v2:172.21.15.138:3300/0 conn(0x7fb9840ccf00 msgr2=0x7fb9840b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb988c94640 1 --2- 172.21.15.55:0/295373547 >> v2:172.21.15.138:3300/0 conn(0x7fb9840ccf00 0x7fb9840b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.660+0000 7fb988c94640 1 -- 172.21.15.55:0/295373547 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9840cecf0 con 0x7fb9840ccab0 2023-07-06T21:57:08.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.664+0000 7fb988c94640 1 --2- 172.21.15.55:0/295373547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9840ccab0 0x7fb9840b18d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb9840cd800 tx=0x7fb97401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc50f6a87dd56d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:08.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.664+0000 7fb97bfff640 1 -- 172.21.15.55:0/295373547 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9740ab600 con 0x7fb9840ccab0 2023-07-06T21:57:08.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.664+0000 7fb97bfff640 1 -- 172.21.15.55:0/295373547 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9740a7050 con 0x7fb9840ccab0 2023-07-06T21:57:08.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.664+0000 7fb97bfff640 1 -- 172.21.15.55:0/295373547 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9740ab980 con 0x7fb9840ccab0 2023-07-06T21:57:08.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.664+0000 7fb98b6f9640 1 -- 172.21.15.55:0/295373547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9840ccab0 msgr2=0x7fb9840b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:08.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.664+0000 7fb98b6f9640 1 --2- 172.21.15.55:0/295373547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9840ccab0 0x7fb9840b18d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb9840cd800 tx=0x7fb97401c470 comp rx=0 tx=0).stop 2023-07-06T21:57:08.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.664+0000 7fb98b6f9640 1 -- 172.21.15.55:0/295373547 shutdown_connections 2023-07-06T21:57:08.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.664+0000 7fb98b6f9640 1 --2- 172.21.15.55:0/295373547 >> v2:172.21.15.138:3300/0 conn(0x7fb9840ccf00 0x7fb9840b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.664+0000 7fb98b6f9640 1 --2- 172.21.15.55:0/295373547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9840ccab0 0x7fb9840b18d0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.664+0000 7fb98b6f9640 1 --2- 172.21.15.55:0/295373547 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9840b7cd0 0x7fb9840ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.664+0000 7fb98b6f9640 1 -- 172.21.15.55:0/295373547 >> 172.21.15.55:0/295373547 conn(0x7fb9840ceee0 msgr2=0x7fb9840cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:08.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.664+0000 7fb98b6f9640 1 -- 172.21.15.55:0/295373547 shutdown_connections 2023-07-06T21:57:08.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.664+0000 7fb98b6f9640 1 -- 172.21.15.55:0/295373547 wait complete. 2023-07-06T21:57:08.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb98b6f9640 1 Processor -- start 2023-07-06T21:57:08.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb98b6f9640 1 -- start start 2023-07-06T21:57:08.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb98b6f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9840b7cd0 0x7fb984154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:08.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb98b6f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9840ccab0 0x7fb9840b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:08.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb98b6f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9840ccf00 0x7fb98414f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:08.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb98b6f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98414fec0 con 0x7fb9840b7cd0 2023-07-06T21:57:08.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb98b6f9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9841552c0 con 0x7fb9840ccab0 2023-07-06T21:57:08.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb98b6f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb984150110 con 0x7fb9840ccf00 2023-07-06T21:57:08.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb989495640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9840b7cd0 0x7fb984154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:08.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb989495640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9840b7cd0 0x7fb984154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50658/0 (socket says 172.21.15.55:50658) 2023-07-06T21:57:08.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb989495640 1 -- 172.21.15.55:0/3468600263 learned_addr learned my addr 172.21.15.55:0/3468600263 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:08.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb989c96640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9840ccf00 0x7fb98414f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:08.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb988c94640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9840ccab0 0x7fb9840b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:08.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb989495640 1 -- 172.21.15.55:0/3468600263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9840ccf00 msgr2=0x7fb98414f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:08.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb989495640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9840ccf00 0x7fb98414f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb989495640 1 -- 172.21.15.55:0/3468600263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9840ccab0 msgr2=0x7fb9840b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:08.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb989495640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9840ccab0 0x7fb9840b7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb989495640 1 -- 172.21.15.55:0/3468600263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9740094d0 con 0x7fb9840b7cd0 2023-07-06T21:57:08.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb988c94640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9840ccab0 0x7fb9840b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:08.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb989c96640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9840ccf00 0x7fb98414f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:08.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb989495640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9840b7cd0 0x7fb984154d80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb98000e8b0 tx=0x7fb98000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:08.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb979ffb640 1 -- 172.21.15.55:0/3468600263 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98000c940 con 0x7fb9840b7cd0 2023-07-06T21:57:08.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb979ffb640 1 -- 172.21.15.55:0/3468600263 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98000caa0 con 0x7fb9840b7cd0 2023-07-06T21:57:08.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb979ffb640 1 -- 172.21.15.55:0/3468600263 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98000ce30 con 0x7fb9840b7cd0 2023-07-06T21:57:08.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb98b6f9640 1 -- 172.21.15.55:0/3468600263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9841503f0 con 0x7fb9840b7cd0 2023-07-06T21:57:08.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.668+0000 7fb98b6f9640 1 -- 172.21.15.55:0/3468600263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9841509b0 con 0x7fb9840b7cd0 2023-07-06T21:57:08.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.672+0000 7fb98b6f9640 1 -- 172.21.15.55:0/3468600263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb984066d60 con 0x7fb9840b7cd0 2023-07-06T21:57:08.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.672+0000 7fb979ffb640 1 -- 172.21.15.55:0/3468600263 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 27) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fb980013470 con 0x7fb9840b7cd0 2023-07-06T21:57:08.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.672+0000 7fb979ffb640 1 -- 172.21.15.55:0/3468600263 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7098+0+0 (secure 0 0 0) 0x7fb980083ec0 con 0x7fb9840b7cd0 2023-07-06T21:57:08.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.676+0000 7fb979ffb640 1 -- 172.21.15.55:0/3468600263 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb980051290 con 0x7fb9840b7cd0 2023-07-06T21:57:08.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.836+0000 7fb979ffb640 1 -- 172.21.15.55:0/3468600263 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 28) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fb980050d40 con 0x7fb9840b7cd0 2023-07-06T21:57:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.836+0000 7fb979ffb640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fb96806c630 0x7fb96806ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:08.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.836+0000 7fb988c94640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fb96806c630 0x7fb96806ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:08.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.840+0000 7fb988c94640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fb96806c630 0x7fb96806ea10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb9740ad000 tx=0x7fb974008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:08.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.880+0000 7fb98b6f9640 1 -- 172.21.15.55:0/3468600263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb984166980 con 0x7fb9840b7cd0 2023-07-06T21:57:08.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.880+0000 7fb979ffb640 1 -- 172.21.15.55:0/3468600263 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fb980017090 con 0x7fb9840b7cd0 2023-07-06T21:57:08.879 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:08.879 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2986611670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2986611670},{"type":"v1","addr":"172.21.15.138:6835","nonce":2986611670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6351,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2521348037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2521348037},{"type":"v1","addr":"172.21.15.55:6836","nonce":2521348037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1716722785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1716722785},{"type":"v1","addr":"172.21.15.55:6837","nonce":1716722785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:55:04.192386+0000","modified":"2023-07-06T21:55:07.200622+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6357":{"gid":6357,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6834/2595020915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2595020915},{"type":"v1","addr":"172.21.15.138:6834","nonce":2595020915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-06T21:57:08.879 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2023-07-06T21:57:08.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.884+0000 7fb98b6f9640 1 -- 172.21.15.55:0/3468600263 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fb96806c630 msgr2=0x7fb96806ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:08.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.884+0000 7fb98b6f9640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fb96806c630 0x7fb96806ea10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb9740ad000 tx=0x7fb974008040 comp rx=0 tx=0).stop 2023-07-06T21:57:08.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.884+0000 7fb98b6f9640 1 -- 172.21.15.55:0/3468600263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9840b7cd0 msgr2=0x7fb984154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:08.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.884+0000 7fb98b6f9640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9840b7cd0 0x7fb984154d80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb98000e8b0 tx=0x7fb98000ed70 comp rx=0 tx=0).stop 2023-07-06T21:57:08.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.884+0000 7fb98b6f9640 1 -- 172.21.15.55:0/3468600263 shutdown_connections 2023-07-06T21:57:08.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.884+0000 7fb98b6f9640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fb96806c630 0x7fb96806ea10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.884+0000 7fb98b6f9640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9840ccf00 0x7fb98414f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.884+0000 7fb98b6f9640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9840ccab0 0x7fb9840b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.884+0000 7fb98b6f9640 1 --2- 172.21.15.55:0/3468600263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9840b7cd0 0x7fb984154d80 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.884+0000 7fb98b6f9640 1 -- 172.21.15.55:0/3468600263 >> 172.21.15.55:0/3468600263 conn(0x7fb9840ceee0 msgr2=0x7fb98406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.884+0000 7fb98b6f9640 1 -- 172.21.15.55:0/3468600263 shutdown_connections 2023-07-06T21:57:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:08.884+0000 7fb98b6f9640 1 -- 172.21.15.55:0/3468600263 wait complete. 2023-07-06T21:57:08.900 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.044+0000 7f44ce11e640 1 Processor -- start 2023-07-06T21:57:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.044+0000 7f44ce11e640 1 -- start start 2023-07-06T21:57:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.044+0000 7f44ce11e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f44c815bc40 0x7f44c806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.044+0000 7f44ce11e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44c815cc00 0x7f44c815f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.044+0000 7f44ce11e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c815c770 con 0x7f44c806f8e0 2023-07-06T21:57:09.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.044+0000 7f44ce11e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c806d4f0 con 0x7f44c815bc40 2023-07-06T21:57:09.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.044+0000 7f44ce11e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c806d210 con 0x7f44c815cc00 2023-07-06T21:57:09.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.044+0000 7f44c77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f44c806f8e0 0x7f44c806fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48392/0 (socket says 172.21.15.55:48392) 2023-07-06T21:57:09.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.044+0000 7f44c77fe640 1 -- 172.21.15.55:0/3555527897 learned_addr learned my addr 172.21.15.55:0/3555527897 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:09.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c6ffd640 1 --2- 172.21.15.55:0/3555527897 >> v2:172.21.15.138:3300/0 conn(0x7f44c815bc40 0x7f44c806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c7fff640 1 --2- 172.21.15.55:0/3555527897 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44c815cc00 0x7f44c815f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 -- 172.21.15.55:0/3555527897 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333816365 0 0) 0x7f44c815c770 con 0x7f44c806f8e0 2023-07-06T21:57:09.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 -- 172.21.15.55:0/3555527897 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44b0003530 con 0x7f44c806f8e0 2023-07-06T21:57:09.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 -- 172.21.15.55:0/3555527897 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3834996873 0 0) 0x7f44b0003530 con 0x7f44c806f8e0 2023-07-06T21:57:09.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 -- 172.21.15.55:0/3555527897 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44c815cc00 msgr2=0x7f44c815f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:09.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 --2- 172.21.15.55:0/3555527897 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44c815cc00 0x7f44c815f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 -- 172.21.15.55:0/3555527897 >> v2:172.21.15.138:3300/0 conn(0x7f44c815bc40 msgr2=0x7f44c806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:09.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 --2- 172.21.15.55:0/3555527897 >> v2:172.21.15.138:3300/0 conn(0x7f44c815bc40 0x7f44c806c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 -- 172.21.15.55:0/3555527897 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c815c120 con 0x7f44c806f8e0 2023-07-06T21:57:09.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 -- 172.21.15.55:0/3555527897 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f44b8001680 con 0x7f44c806f8e0 2023-07-06T21:57:09.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 -- 172.21.15.55:0/3555527897 >> v1:172.21.15.55:6789/0 conn(0x7f44c806f8e0 legacy=0x7f44c806fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 --2- 172.21.15.55:0/3555527897 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44b0003980 0x7f44b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 --2- 172.21.15.55:0/3555527897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44b0004360 0x7f44b0004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 --2- 172.21.15.55:0/3555527897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b0004ea0 0x7f44b000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 -- 172.21.15.55:0/3555527897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c806d4f0 con 0x7f44b0004ea0 2023-07-06T21:57:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 -- 172.21.15.55:0/3555527897 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c806d210 con 0x7f44b0004360 2023-07-06T21:57:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c67fc640 1 -- 172.21.15.55:0/3555527897 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b000bed0 con 0x7f44b0003980 2023-07-06T21:57:09.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c7fff640 1 --2- 172.21.15.55:0/3555527897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b0004ea0 0x7f44b000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c77fe640 1 --2- 172.21.15.55:0/3555527897 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44b0003980 0x7f44b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c6ffd640 1 --2- 172.21.15.55:0/3555527897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44b0004360 0x7f44b0004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c7fff640 1 -- 172.21.15.55:0/3555527897 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44b0003980 msgr2=0x7f44b0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c7fff640 1 --2- 172.21.15.55:0/3555527897 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44b0003980 0x7f44b0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c7fff640 1 -- 172.21.15.55:0/3555527897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44b0004360 msgr2=0x7f44b0004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c7fff640 1 --2- 172.21.15.55:0/3555527897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44b0004360 0x7f44b0004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.048+0000 7f44c7fff640 1 -- 172.21.15.55:0/3555527897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b0003530 con 0x7f44b0004ea0 2023-07-06T21:57:09.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.052+0000 7f44c7fff640 1 --2- 172.21.15.55:0/3555527897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b0004ea0 0x7f44b000b990 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f44c815cfd0 tx=0x7f44c001cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0021bbbb4d05c8d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:09.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.052+0000 7f44c67fc640 1 -- 172.21.15.55:0/3555527897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c00a67d0 con 0x7f44b0004ea0 2023-07-06T21:57:09.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.052+0000 7f44c67fc640 1 -- 172.21.15.55:0/3555527897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c000f040 con 0x7f44b0004ea0 2023-07-06T21:57:09.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.052+0000 7f44c67fc640 1 -- 172.21.15.55:0/3555527897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c00a6b90 con 0x7f44b0004ea0 2023-07-06T21:57:09.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.052+0000 7f44ce11e640 1 -- 172.21.15.55:0/3555527897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b0004ea0 msgr2=0x7f44b000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.052+0000 7f44ce11e640 1 --2- 172.21.15.55:0/3555527897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b0004ea0 0x7f44b000b990 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f44c815cfd0 tx=0x7f44c001cb40 comp rx=0 tx=0).stop 2023-07-06T21:57:09.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.052+0000 7f44c7fff640 1 -- 172.21.15.55:0/3555527897 reap_dead start 2023-07-06T21:57:09.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.052+0000 7f44ce11e640 1 -- 172.21.15.55:0/3555527897 shutdown_connections 2023-07-06T21:57:09.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.052+0000 7f44ce11e640 1 -- 172.21.15.55:0/3555527897 >> 172.21.15.55:0/3555527897 conn(0x7f44c80cbd80 msgr2=0x7f44c80ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:09.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.052+0000 7f44ce11e640 1 -- 172.21.15.55:0/3555527897 shutdown_connections 2023-07-06T21:57:09.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.052+0000 7f44ce11e640 1 -- 172.21.15.55:0/3555527897 wait complete. 2023-07-06T21:57:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.052+0000 7f44ce11e640 1 Processor -- start 2023-07-06T21:57:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.052+0000 7f44ce11e640 1 -- start start 2023-07-06T21:57:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44ce11e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44b0004ea0 0x7f44c81f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44ce11e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44c80ada90 0x7f44c81520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44ce11e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80c9cf0 0x7f44c80ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44ce11e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c8155150 con 0x7f44c80ada90 2023-07-06T21:57:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44ce11e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80ca6a0 con 0x7f44c80c9cf0 2023-07-06T21:57:09.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44ce11e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80c49d0 con 0x7f44b0004ea0 2023-07-06T21:57:09.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44c6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44c80ada90 0x7f44c81520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44c6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44c80ada90 0x7f44c81520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50684/0 (socket says 172.21.15.55:50684) 2023-07-06T21:57:09.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44c6ffd640 1 -- 172.21.15.55:0/351527239 learned_addr learned my addr 172.21.15.55:0/351527239 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:09.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44c77fe640 1 --2- 172.21.15.55:0/351527239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44b0004ea0 0x7f44c81f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44c7fff640 1 --2- 172.21.15.55:0/351527239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80c9cf0 0x7f44c80ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44c6ffd640 1 -- 172.21.15.55:0/351527239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44b0004ea0 msgr2=0x7f44c81f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44c6ffd640 1 --2- 172.21.15.55:0/351527239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44b0004ea0 0x7f44c81f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44c6ffd640 1 -- 172.21.15.55:0/351527239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80c9cf0 msgr2=0x7f44c80ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44c6ffd640 1 --2- 172.21.15.55:0/351527239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80c9cf0 0x7f44c80ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44c6ffd640 1 -- 172.21.15.55:0/351527239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c81f4aa0 con 0x7f44c80ada90 2023-07-06T21:57:09.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44c6ffd640 1 --2- 172.21.15.55:0/351527239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44c80ada90 0x7f44c81520f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f44bc011a10 tx=0x7f44bc011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:09.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44affff640 1 -- 172.21.15.55:0/351527239 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc004240 con 0x7f44c80ada90 2023-07-06T21:57:09.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44affff640 1 -- 172.21.15.55:0/351527239 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc0043a0 con 0x7f44c80ada90 2023-07-06T21:57:09.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44affff640 1 -- 172.21.15.55:0/351527239 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc00fb00 con 0x7f44c80ada90 2023-07-06T21:57:09.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44ce11e640 1 -- 172.21.15.55:0/351527239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c80ab9f0 con 0x7f44c80ada90 2023-07-06T21:57:09.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44ce11e640 1 -- 172.21.15.55:0/351527239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c81f4fb0 con 0x7f44c80ada90 2023-07-06T21:57:09.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44ce11e640 1 -- 172.21.15.55:0/351527239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c8066d60 con 0x7f44c80ada90 2023-07-06T21:57:09.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.056+0000 7f44affff640 1 -- 172.21.15.55:0/351527239 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 28) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f44bc00fc60 con 0x7f44c80ada90 2023-07-06T21:57:09.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.060+0000 7f44affff640 1 --2- 172.21.15.55:0/351527239 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f44b40660d0 0x7f44b4068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.060+0000 7f44affff640 1 -- 172.21.15.55:0/351527239 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7098+0+0 (secure 0 0 0) 0x7f44bc084550 con 0x7f44c80ada90 2023-07-06T21:57:09.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.060+0000 7f44c77fe640 1 --2- 172.21.15.55:0/351527239 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f44b40660d0 0x7f44b4068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.060+0000 7f44c77fe640 1 --2- 172.21.15.55:0/351527239 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f44b40660d0 0x7f44b4068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f44b8007c70 tx=0x7f44b8009040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:09.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.064+0000 7f44affff640 1 -- 172.21.15.55:0/351527239 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44bc051830 con 0x7f44c80ada90 2023-07-06T21:57:09.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.220+0000 7f44ce11e640 1 -- 172.21.15.55:0/351527239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44c80abb80 con 0x7f44c80ada90 2023-07-06T21:57:09.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.224+0000 7f44affff640 1 -- 172.21.15.55:0/351527239 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+19606 (secure 0 0 0) 0x7f44c80abb80 con 0x7f44c80ada90 2023-07-06T21:57:09.221 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:09.221 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":77,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:57:07.820389+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:55:02.300695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-07-06T21:55:03.183596+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/2257395431":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/1561392865":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/1366713285":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/3291736307":"2023-07-07T21:57:07.820341+0000","172.21.15.55:6832/3229281422":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/1763014168":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/827601659":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/3134202503":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/3057904124":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/3677020920":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/1723719878":"2023-07-07T21:55:20.576434+0000","172.21.15.55:6833/3843972996":"2023-07-07T21:55:20.576434+0000","172.21.15.55:6832/3843972996":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/2622666608":"2023-07-07T21:55:20.576434+0000","172.21.15.55:6833/3229281422":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/457725185":"2023-07-07T21:55:20.576434+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:09.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.224+0000 7f44ce11e640 1 -- 172.21.15.55:0/351527239 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f44b40660d0 msgr2=0x7f44b4068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.224+0000 7f44ce11e640 1 --2- 172.21.15.55:0/351527239 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f44b40660d0 0x7f44b4068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f44b8007c70 tx=0x7f44b8009040 comp rx=0 tx=0).stop 2023-07-06T21:57:09.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.224+0000 7f44ce11e640 1 -- 172.21.15.55:0/351527239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44c80ada90 msgr2=0x7f44c81520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.224+0000 7f44ce11e640 1 --2- 172.21.15.55:0/351527239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44c80ada90 0x7f44c81520f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f44bc011a10 tx=0x7f44bc011ed0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.224+0000 7f44ce11e640 1 -- 172.21.15.55:0/351527239 shutdown_connections 2023-07-06T21:57:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.224+0000 7f44ce11e640 1 --2- 172.21.15.55:0/351527239 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f44b40660d0 0x7f44b4068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.224+0000 7f44ce11e640 1 --2- 172.21.15.55:0/351527239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80c9cf0 0x7f44c80ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.224+0000 7f44ce11e640 1 --2- 172.21.15.55:0/351527239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44c80ada90 0x7f44c81520f0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.224+0000 7f44ce11e640 1 --2- 172.21.15.55:0/351527239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44b0004ea0 0x7f44c81f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.224+0000 7f44ce11e640 1 -- 172.21.15.55:0/351527239 >> 172.21.15.55:0/351527239 conn(0x7f44c80cbd80 msgr2=0x7f44c80ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.224+0000 7f44ce11e640 1 -- 172.21.15.55:0/351527239 shutdown_connections 2023-07-06T21:57:09.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.224+0000 7f44ce11e640 1 -- 172.21.15.55:0/351527239 wait complete. 2023-07-06T21:57:09.242 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T21:57:09.243 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:57:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc846ccb640 1 Processor -- start 2023-07-06T21:57:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc846ccb640 1 -- start start 2023-07-06T21:57:09.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc846ccb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8400712f0 0x7fc84006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc846ccb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8400b3730 0x7fc8400c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc846ccb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc840159cd0 con 0x7fc8400ca280 2023-07-06T21:57:09.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc846ccb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8400ca700 con 0x7fc8400712f0 2023-07-06T21:57:09.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc846ccb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400693f0 con 0x7fc8400b3730 2023-07-06T21:57:09.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc844a67640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8400712f0 0x7fc84006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc844a67640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8400712f0 0x7fc84006a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50698/0 (socket says 172.21.15.55:50698) 2023-07-06T21:57:09.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc844a67640 1 -- 172.21.15.55:0/431048221 learned_addr learned my addr 172.21.15.55:0/431048221 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:09.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc845268640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc8400ca280 0x7fc8400c8520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48404/0 (socket says 172.21.15.55:48404) 2023-07-06T21:57:09.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc83ffff640 1 --2- 172.21.15.55:0/431048221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8400b3730 0x7fc8400c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc844a67640 1 -- 172.21.15.55:0/431048221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8400b3730 msgr2=0x7fc8400c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:09.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc844a67640 1 --2- 172.21.15.55:0/431048221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8400b3730 0x7fc8400c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc844a67640 1 -- 172.21.15.55:0/431048221 >> v1:172.21.15.55:6789/0 conn(0x7fc8400ca280 legacy=0x7fc8400c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc83f7fe640 1 -- 172.21.15.55:0/431048221 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010790757 0 0) 0x7fc840159cd0 con 0x7fc8400ca280 2023-07-06T21:57:09.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.388+0000 7fc844a67640 1 -- 172.21.15.55:0/431048221 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84006aca0 con 0x7fc8400712f0 2023-07-06T21:57:09.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.392+0000 7fc844a67640 1 --2- 172.21.15.55:0/431048221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400712f0 0x7fc84006a610 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc834009870 tx=0x7fc83401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f7b8203ed43001 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:09.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.392+0000 7fc83f7fe640 1 -- 172.21.15.55:0/431048221 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340ab600 con 0x7fc8400712f0 2023-07-06T21:57:09.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.392+0000 7fc83f7fe640 1 -- 172.21.15.55:0/431048221 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8340a7050 con 0x7fc8400712f0 2023-07-06T21:57:09.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.392+0000 7fc83f7fe640 1 -- 172.21.15.55:0/431048221 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340ab980 con 0x7fc8400712f0 2023-07-06T21:57:09.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.392+0000 7fc846ccb640 1 -- 172.21.15.55:0/431048221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400712f0 msgr2=0x7fc84006a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.392+0000 7fc846ccb640 1 --2- 172.21.15.55:0/431048221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400712f0 0x7fc84006a610 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc834009870 tx=0x7fc83401c510 comp rx=0 tx=0).stop 2023-07-06T21:57:09.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.392+0000 7fc846ccb640 1 -- 172.21.15.55:0/431048221 shutdown_connections 2023-07-06T21:57:09.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.392+0000 7fc846ccb640 1 --2- 172.21.15.55:0/431048221 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8400b3730 0x7fc8400c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.392+0000 7fc846ccb640 1 --2- 172.21.15.55:0/431048221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400712f0 0x7fc84006a610 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.392+0000 7fc846ccb640 1 -- 172.21.15.55:0/431048221 >> 172.21.15.55:0/431048221 conn(0x7fc8400cded0 msgr2=0x7fc8400ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:09.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.392+0000 7fc846ccb640 1 -- 172.21.15.55:0/431048221 shutdown_connections 2023-07-06T21:57:09.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.392+0000 7fc846ccb640 1 -- 172.21.15.55:0/431048221 wait complete. 2023-07-06T21:57:09.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc846ccb640 1 Processor -- start 2023-07-06T21:57:09.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc846ccb640 1 -- start start 2023-07-06T21:57:09.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc846ccb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8400712f0 0x7fc840153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc846ccb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8400b3730 0x7fc8400b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc846ccb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400ca280 0x7fc8400b1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc846ccb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc840153d00 con 0x7fc8400ca280 2023-07-06T21:57:09.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc846ccb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc840154560 con 0x7fc8400b3730 2023-07-06T21:57:09.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc846ccb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84015cb80 con 0x7fc8400712f0 2023-07-06T21:57:09.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc845268640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400ca280 0x7fc8400b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc845268640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400ca280 0x7fc8400b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50706/0 (socket says 172.21.15.55:50706) 2023-07-06T21:57:09.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc845268640 1 -- 172.21.15.55:0/332206211 learned_addr learned my addr 172.21.15.55:0/332206211 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:09.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc844a67640 1 --2- 172.21.15.55:0/332206211 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8400712f0 0x7fc840153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc83ffff640 1 --2- 172.21.15.55:0/332206211 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8400b3730 0x7fc8400b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc845268640 1 -- 172.21.15.55:0/332206211 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8400712f0 msgr2=0x7fc840153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc845268640 1 --2- 172.21.15.55:0/332206211 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8400712f0 0x7fc840153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc845268640 1 -- 172.21.15.55:0/332206211 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8400b3730 msgr2=0x7fc8400b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc845268640 1 --2- 172.21.15.55:0/332206211 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8400b3730 0x7fc8400b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc845268640 1 -- 172.21.15.55:0/332206211 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340094d0 con 0x7fc8400ca280 2023-07-06T21:57:09.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc845268640 1 --2- 172.21.15.55:0/332206211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400ca280 0x7fc8400b1260 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc83800c780 tx=0x7fc83800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:09.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc83d7fa640 1 -- 172.21.15.55:0/332206211 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800ce90 con 0x7fc8400ca280 2023-07-06T21:57:09.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc83d7fa640 1 -- 172.21.15.55:0/332206211 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83800a640 con 0x7fc8400ca280 2023-07-06T21:57:09.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc83d7fa640 1 -- 172.21.15.55:0/332206211 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800a9d0 con 0x7fc8400ca280 2023-07-06T21:57:09.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc846ccb640 1 -- 172.21.15.55:0/332206211 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc840153f10 con 0x7fc8400ca280 2023-07-06T21:57:09.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc846ccb640 1 -- 172.21.15.55:0/332206211 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8401538b0 con 0x7fc8400ca280 2023-07-06T21:57:09.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.396+0000 7fc846ccb640 1 -- 172.21.15.55:0/332206211 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc840154710 con 0x7fc8400ca280 2023-07-06T21:57:09.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.400+0000 7fc83d7fa640 1 -- 172.21.15.55:0/332206211 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 28) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fc83800ab30 con 0x7fc8400ca280 2023-07-06T21:57:09.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.400+0000 7fc83d7fa640 1 --2- 172.21.15.55:0/332206211 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fc824066100 0x7fc8240685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.400+0000 7fc83d7fa640 1 -- 172.21.15.55:0/332206211 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7098+0+0 (secure 0 0 0) 0x7fc838083230 con 0x7fc8400ca280 2023-07-06T21:57:09.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.400+0000 7fc844a67640 1 --2- 172.21.15.55:0/332206211 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fc824066100 0x7fc8240685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.400+0000 7fc844a67640 1 --2- 172.21.15.55:0/332206211 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fc824066100 0x7fc8240685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc84006ee30 tx=0x7fc834009040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:09.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.404+0000 7fc83d7fa640 1 -- 172.21.15.55:0/332206211 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc840154710 con 0x7fc8400ca280 2023-07-06T21:57:09.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.592+0000 7fc846ccb640 1 -- 172.21.15.55:0/332206211 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8401546d0 con 0x7fc8400ca280 2023-07-06T21:57:09.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.592+0000 7fc83d7fa640 1 -- 172.21.15.55:0/332206211 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fc838050510 con 0x7fc8400ca280 2023-07-06T21:57:09.592 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:09.592 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2986611670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2986611670},{"type":"v1","addr":"172.21.15.138:6835","nonce":2986611670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6351,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2521348037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2521348037},{"type":"v1","addr":"172.21.15.55:6836","nonce":2521348037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1716722785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1716722785},{"type":"v1","addr":"172.21.15.55:6837","nonce":1716722785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:55:04.192386+0000","modified":"2023-07-06T21:55:07.200622+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6357":{"gid":6357,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6834/2595020915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2595020915},{"type":"v1","addr":"172.21.15.138:6834","nonce":2595020915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-06T21:57:09.593 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2023-07-06T21:57:09.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.596+0000 7fc846ccb640 1 -- 172.21.15.55:0/332206211 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fc824066100 msgr2=0x7fc8240685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.596+0000 7fc846ccb640 1 --2- 172.21.15.55:0/332206211 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fc824066100 0x7fc8240685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc84006ee30 tx=0x7fc834009040 comp rx=0 tx=0).stop 2023-07-06T21:57:09.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.596+0000 7fc846ccb640 1 -- 172.21.15.55:0/332206211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400ca280 msgr2=0x7fc8400b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.596+0000 7fc846ccb640 1 --2- 172.21.15.55:0/332206211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400ca280 0x7fc8400b1260 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc83800c780 tx=0x7fc83800cc40 comp rx=0 tx=0).stop 2023-07-06T21:57:09.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.596+0000 7fc846ccb640 1 -- 172.21.15.55:0/332206211 shutdown_connections 2023-07-06T21:57:09.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.596+0000 7fc846ccb640 1 --2- 172.21.15.55:0/332206211 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fc824066100 0x7fc8240685b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.596+0000 7fc846ccb640 1 --2- 172.21.15.55:0/332206211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400ca280 0x7fc8400b1260 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.596+0000 7fc846ccb640 1 --2- 172.21.15.55:0/332206211 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8400b3730 0x7fc8400b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.596+0000 7fc846ccb640 1 --2- 172.21.15.55:0/332206211 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8400712f0 0x7fc840153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.596+0000 7fc846ccb640 1 -- 172.21.15.55:0/332206211 >> 172.21.15.55:0/332206211 conn(0x7fc8400cded0 msgr2=0x7fc8400c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:09.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.596+0000 7fc846ccb640 1 -- 172.21.15.55:0/332206211 shutdown_connections 2023-07-06T21:57:09.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.596+0000 7fc846ccb640 1 -- 172.21.15.55:0/332206211 wait complete. 2023-07-06T21:57:09.613 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:57:09.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e47848640 1 Processor -- start 2023-07-06T21:57:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e47848640 1 -- start start 2023-07-06T21:57:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e47848640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5e400b7cd0 0x7f5e400ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e47848640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5e400b1fe0 0x7f5e4015f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e47848640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e400cecf0 con 0x7f5e400ccab0 2023-07-06T21:57:09.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e47848640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e400d2310 con 0x7f5e400b7cd0 2023-07-06T21:57:09.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e47848640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e400b80a0 con 0x7f5e400b1fe0 2023-07-06T21:57:09.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e455e4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5e400b7cd0 0x7f5e400ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e455e4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5e400b7cd0 0x7f5e400ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50708/0 (socket says 172.21.15.55:50708) 2023-07-06T21:57:09.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e455e4640 1 -- 172.21.15.55:0/2101802522 learned_addr learned my addr 172.21.15.55:0/2101802522 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:09.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e45de5640 1 --2- 172.21.15.55:0/2101802522 >> v2:172.21.15.138:3300/0 conn(0x7f5e400b1fe0 0x7f5e4015f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e455e4640 1 -- 172.21.15.55:0/2101802522 >> v2:172.21.15.138:3300/0 conn(0x7f5e400b1fe0 msgr2=0x7f5e4015f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:09.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e455e4640 1 --2- 172.21.15.55:0/2101802522 >> v2:172.21.15.138:3300/0 conn(0x7f5e400b1fe0 0x7f5e4015f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e455e4640 1 -- 172.21.15.55:0/2101802522 >> v1:172.21.15.138:6789/0 conn(0x7f5e400ccab0 legacy=0x7f5e400b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:09.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e455e4640 1 -- 172.21.15.55:0/2101802522 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e400d1d90 con 0x7f5e400b7cd0 2023-07-06T21:57:09.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.760+0000 7f5e45de5640 1 --2- 172.21.15.55:0/2101802522 >> v2:172.21.15.138:3300/0 conn(0x7f5e400b1fe0 0x7f5e4015f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:09.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.764+0000 7f5e455e4640 1 --2- 172.21.15.55:0/2101802522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e400b7cd0 0x7f5e400ce610 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5e400b1310 tx=0x7f5e3c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00ea218a130ca7c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:09.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.764+0000 7f5e37fff640 1 -- 172.21.15.55:0/2101802522 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0ab600 con 0x7f5e400b7cd0 2023-07-06T21:57:09.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.764+0000 7f5e37fff640 1 -- 172.21.15.55:0/2101802522 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c0a7050 con 0x7f5e400b7cd0 2023-07-06T21:57:09.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.764+0000 7f5e37fff640 1 -- 172.21.15.55:0/2101802522 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0ab980 con 0x7f5e400b7cd0 2023-07-06T21:57:09.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.764+0000 7f5e47848640 1 -- 172.21.15.55:0/2101802522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e400b7cd0 msgr2=0x7f5e400ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.764+0000 7f5e47848640 1 --2- 172.21.15.55:0/2101802522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e400b7cd0 0x7f5e400ce610 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5e400b1310 tx=0x7f5e3c01c430 comp rx=0 tx=0).stop 2023-07-06T21:57:09.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.764+0000 7f5e47848640 1 -- 172.21.15.55:0/2101802522 shutdown_connections 2023-07-06T21:57:09.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.764+0000 7f5e47848640 1 --2- 172.21.15.55:0/2101802522 >> v2:172.21.15.138:3300/0 conn(0x7f5e400b1fe0 0x7f5e4015f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.764+0000 7f5e47848640 1 --2- 172.21.15.55:0/2101802522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e400b7cd0 0x7f5e400ce610 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.764+0000 7f5e47848640 1 -- 172.21.15.55:0/2101802522 >> 172.21.15.55:0/2101802522 conn(0x7f5e400ceee0 msgr2=0x7f5e400cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:09.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.764+0000 7f5e47848640 1 -- 172.21.15.55:0/2101802522 shutdown_connections 2023-07-06T21:57:09.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.764+0000 7f5e47848640 1 -- 172.21.15.55:0/2101802522 wait complete. 2023-07-06T21:57:09.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e47848640 1 Processor -- start 2023-07-06T21:57:09.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e47848640 1 -- start start 2023-07-06T21:57:09.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e47848640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e400b1fe0 0x7f5e40153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e47848640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e400b7cd0 0x7f5e400c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e47848640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e400ccab0 0x7f5e4006a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e47848640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4015b9e0 con 0x7f5e400ccab0 2023-07-06T21:57:09.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e47848640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400c7830 con 0x7f5e400b1fe0 2023-07-06T21:57:09.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e47848640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4015b700 con 0x7f5e400b7cd0 2023-07-06T21:57:09.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e45de5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e400ccab0 0x7f5e4006a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e45de5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e400ccab0 0x7f5e4006a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50716/0 (socket says 172.21.15.55:50716) 2023-07-06T21:57:09.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e45de5640 1 -- 172.21.15.55:0/2823796631 learned_addr learned my addr 172.21.15.55:0/2823796631 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:09.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e455e4640 1 --2- 172.21.15.55:0/2823796631 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e400b1fe0 0x7f5e40153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e44de3640 1 --2- 172.21.15.55:0/2823796631 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e400b7cd0 0x7f5e400c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e45de5640 1 -- 172.21.15.55:0/2823796631 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e400b7cd0 msgr2=0x7f5e400c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e45de5640 1 --2- 172.21.15.55:0/2823796631 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e400b7cd0 0x7f5e400c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e45de5640 1 -- 172.21.15.55:0/2823796631 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e400b1fe0 msgr2=0x7f5e40153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e45de5640 1 --2- 172.21.15.55:0/2823796631 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e400b1fe0 0x7f5e40153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e45de5640 1 -- 172.21.15.55:0/2823796631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c0094d0 con 0x7f5e400ccab0 2023-07-06T21:57:09.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e45de5640 1 --2- 172.21.15.55:0/2823796631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e400ccab0 0x7f5e4006a260 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800ce80 tx=0x7f5e3800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:09.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e35ffb640 1 -- 172.21.15.55:0/2823796631 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800d840 con 0x7f5e400ccab0 2023-07-06T21:57:09.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e35ffb640 1 -- 172.21.15.55:0/2823796631 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3800d9e0 con 0x7f5e400ccab0 2023-07-06T21:57:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e35ffb640 1 -- 172.21.15.55:0/2823796631 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800dd90 con 0x7f5e400ccab0 2023-07-06T21:57:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e47848640 1 -- 172.21.15.55:0/2823796631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e400c7ad0 con 0x7f5e400ccab0 2023-07-06T21:57:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.768+0000 7f5e47848640 1 -- 172.21.15.55:0/2823796631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e401541b0 con 0x7f5e400ccab0 2023-07-06T21:57:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.772+0000 7f5e47848640 1 -- 172.21.15.55:0/2823796631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e40066d60 con 0x7f5e400ccab0 2023-07-06T21:57:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.772+0000 7f5e35ffb640 1 -- 172.21.15.55:0/2823796631 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 28) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f5e38015440 con 0x7f5e400ccab0 2023-07-06T21:57:09.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.772+0000 7f5e35ffb640 1 --2- 172.21.15.55:0/2823796631 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5e240660d0 0x7f5e24068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:09.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.772+0000 7f5e35ffb640 1 -- 172.21.15.55:0/2823796631 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7098+0+0 (secure 0 0 0) 0x7f5e380847a0 con 0x7f5e400ccab0 2023-07-06T21:57:09.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.772+0000 7f5e455e4640 1 --2- 172.21.15.55:0/2823796631 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5e240660d0 0x7f5e24068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:09.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.772+0000 7f5e455e4640 1 --2- 172.21.15.55:0/2823796631 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5e240660d0 0x7f5e24068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0ad000 tx=0x7f5e3c008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:09.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.776+0000 7f5e35ffb640 1 -- 172.21.15.55:0/2823796631 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5e38051b30 con 0x7f5e400ccab0 2023-07-06T21:57:09.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.964+0000 7f5e47848640 1 -- 172.21.15.55:0/2823796631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e400b3690 con 0x7f5e400ccab0 2023-07-06T21:57:09.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.964+0000 7f5e35ffb640 1 -- 172.21.15.55:0/2823796631 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f5e38055150 con 0x7f5e400ccab0 2023-07-06T21:57:09.964 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:09.964 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2986611670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2986611670},{"type":"v1","addr":"172.21.15.138:6835","nonce":2986611670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6351,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2521348037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2521348037},{"type":"v1","addr":"172.21.15.55:6836","nonce":2521348037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1716722785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1716722785},{"type":"v1","addr":"172.21.15.55:6837","nonce":1716722785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:55:04.192386+0000","modified":"2023-07-06T21:55:07.200622+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6357":{"gid":6357,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6834/2595020915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2595020915},{"type":"v1","addr":"172.21.15.138:6834","nonce":2595020915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-06T21:57:09.964 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2023-07-06T21:57:09.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.968+0000 7f5e47848640 1 -- 172.21.15.55:0/2823796631 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5e240660d0 msgr2=0x7f5e24068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.968+0000 7f5e47848640 1 --2- 172.21.15.55:0/2823796631 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5e240660d0 0x7f5e24068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0ad000 tx=0x7f5e3c008040 comp rx=0 tx=0).stop 2023-07-06T21:57:09.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.968+0000 7f5e47848640 1 -- 172.21.15.55:0/2823796631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e400ccab0 msgr2=0x7f5e4006a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:09.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.968+0000 7f5e47848640 1 --2- 172.21.15.55:0/2823796631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e400ccab0 0x7f5e4006a260 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800ce80 tx=0x7f5e3800a710 comp rx=0 tx=0).stop 2023-07-06T21:57:09.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.968+0000 7f5e47848640 1 -- 172.21.15.55:0/2823796631 shutdown_connections 2023-07-06T21:57:09.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.968+0000 7f5e47848640 1 --2- 172.21.15.55:0/2823796631 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5e240660d0 0x7f5e24068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.968+0000 7f5e47848640 1 --2- 172.21.15.55:0/2823796631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e400ccab0 0x7f5e4006a260 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.968+0000 7f5e47848640 1 --2- 172.21.15.55:0/2823796631 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5e400b7cd0 0x7f5e400c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.968+0000 7f5e47848640 1 --2- 172.21.15.55:0/2823796631 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e400b1fe0 0x7f5e40153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.968+0000 7f5e47848640 1 -- 172.21.15.55:0/2823796631 >> 172.21.15.55:0/2823796631 conn(0x7f5e400ceee0 msgr2=0x7f5e400693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.968+0000 7f5e47848640 1 -- 172.21.15.55:0/2823796631 shutdown_connections 2023-07-06T21:57:09.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:09.968+0000 7f5e47848640 1 -- 172.21.15.55:0/2823796631 wait complete. 2023-07-06T21:57:09.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:10.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f431526d640 1 Processor -- start 2023-07-06T21:57:10.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f431526d640 1 -- start start 2023-07-06T21:57:10.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f431526d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43100b7cd0 0x7f43100ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f431526d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f43100ccab0 0x7f43100b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f431526d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43100cecf0 con 0x7f43100ccf00 2023-07-06T21:57:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f431526d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43100d2310 con 0x7f43100b7cd0 2023-07-06T21:57:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f431526d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43100b80a0 con 0x7f43100ccab0 2023-07-06T21:57:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f430effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43100b7cd0 0x7f43100ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f430f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f43100ccf00 0x7f43100b38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48420/0 (socket says 172.21.15.55:48420) 2023-07-06T21:57:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f430f7fe640 1 -- 172.21.15.55:0/3079998191 learned_addr learned my addr 172.21.15.55:0/3079998191 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f430e7fc640 1 --2- 172.21.15.55:0/3079998191 >> v2:172.21.15.138:3300/0 conn(0x7f43100ccab0 0x7f43100b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f430dffb640 1 -- 172.21.15.55:0/3079998191 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17606740 0 0) 0x7f43100cecf0 con 0x7f43100ccf00 2023-07-06T21:57:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f430dffb640 1 -- 172.21.15.55:0/3079998191 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42f8003530 con 0x7f43100ccf00 2023-07-06T21:57:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f430effd640 1 -- 172.21.15.55:0/3079998191 >> v2:172.21.15.138:3300/0 conn(0x7f43100ccab0 msgr2=0x7f43100b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f430effd640 1 --2- 172.21.15.55:0/3079998191 >> v2:172.21.15.138:3300/0 conn(0x7f43100ccab0 0x7f43100b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f430effd640 1 -- 172.21.15.55:0/3079998191 >> v1:172.21.15.55:6789/0 conn(0x7f43100ccf00 legacy=0x7f43100b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.132+0000 7f430effd640 1 -- 172.21.15.55:0/3079998191 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43100d1d90 con 0x7f43100b7cd0 2023-07-06T21:57:10.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.136+0000 7f430effd640 1 --2- 172.21.15.55:0/3079998191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100b7cd0 0x7f43100ce610 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4310065af0 tx=0x7f430001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5a546909502de0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:10.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.136+0000 7f430dffb640 1 -- 172.21.15.55:0/3079998191 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43000ab600 con 0x7f43100b7cd0 2023-07-06T21:57:10.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.136+0000 7f430dffb640 1 -- 172.21.15.55:0/3079998191 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43000a7050 con 0x7f43100b7cd0 2023-07-06T21:57:10.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.136+0000 7f430dffb640 1 -- 172.21.15.55:0/3079998191 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43000ab980 con 0x7f43100b7cd0 2023-07-06T21:57:10.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.136+0000 7f431526d640 1 -- 172.21.15.55:0/3079998191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100b7cd0 msgr2=0x7f43100ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:10.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.136+0000 7f431526d640 1 --2- 172.21.15.55:0/3079998191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100b7cd0 0x7f43100ce610 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4310065af0 tx=0x7f430001c3d0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.136+0000 7f431526d640 1 -- 172.21.15.55:0/3079998191 shutdown_connections 2023-07-06T21:57:10.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.136+0000 7f431526d640 1 --2- 172.21.15.55:0/3079998191 >> v2:172.21.15.138:3300/0 conn(0x7f43100ccab0 0x7f43100b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.136+0000 7f431526d640 1 --2- 172.21.15.55:0/3079998191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100b7cd0 0x7f43100ce610 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.136+0000 7f431526d640 1 -- 172.21.15.55:0/3079998191 >> 172.21.15.55:0/3079998191 conn(0x7f43100ceee0 msgr2=0x7f43100cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:10.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.136+0000 7f431526d640 1 -- 172.21.15.55:0/3079998191 shutdown_connections 2023-07-06T21:57:10.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.136+0000 7f431526d640 1 -- 172.21.15.55:0/3079998191 wait complete. 2023-07-06T21:57:10.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f431526d640 1 Processor -- start 2023-07-06T21:57:10.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f431526d640 1 -- start start 2023-07-06T21:57:10.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f431526d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100b7cd0 0x7f431014b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:10.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f431526d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43100ccab0 0x7f43101496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:10.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f431526d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43100ccf00 0x7f4310154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:10.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f431526d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431015b1f0 con 0x7f43100b7cd0 2023-07-06T21:57:10.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f431526d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4310149be0 con 0x7f43100ccf00 2023-07-06T21:57:10.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f431526d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4310159870 con 0x7f43100ccab0 2023-07-06T21:57:10.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f430effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100b7cd0 0x7f431014b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:10.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f430effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100b7cd0 0x7f431014b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50748/0 (socket says 172.21.15.55:50748) 2023-07-06T21:57:10.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f430effd640 1 -- 172.21.15.55:0/341484150 learned_addr learned my addr 172.21.15.55:0/341484150 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:10.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f430effd640 1 -- 172.21.15.55:0/341484150 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43100ccab0 msgr2=0x7f43101496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:10.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f430effd640 1 --2- 172.21.15.55:0/341484150 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43100ccab0 0x7f43101496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f430effd640 1 -- 172.21.15.55:0/341484150 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43100ccf00 msgr2=0x7f4310154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:10.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f430effd640 1 --2- 172.21.15.55:0/341484150 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43100ccf00 0x7f4310154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f430effd640 1 -- 172.21.15.55:0/341484150 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4300009420 con 0x7f43100b7cd0 2023-07-06T21:57:10.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f430effd640 1 --2- 172.21.15.55:0/341484150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100b7cd0 0x7f431014b2e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f43000ae040 tx=0x7f430001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:10.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f42f77fe640 1 -- 172.21.15.55:0/341484150 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43000b7450 con 0x7f43100b7cd0 2023-07-06T21:57:10.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f42f77fe640 1 -- 172.21.15.55:0/341484150 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43000b75b0 con 0x7f43100b7cd0 2023-07-06T21:57:10.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f42f77fe640 1 -- 172.21.15.55:0/341484150 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43000b7940 con 0x7f43100b7cd0 2023-07-06T21:57:10.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f431526d640 1 -- 172.21.15.55:0/341484150 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4310154d80 con 0x7f43100b7cd0 2023-07-06T21:57:10.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.140+0000 7f431526d640 1 -- 172.21.15.55:0/341484150 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431015af10 con 0x7f43100b7cd0 2023-07-06T21:57:10.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.144+0000 7f431526d640 1 -- 172.21.15.55:0/341484150 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43101596d0 con 0x7f43100b7cd0 2023-07-06T21:57:10.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.144+0000 7f42f77fe640 1 -- 172.21.15.55:0/341484150 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 28) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f43000b7aa0 con 0x7f43100b7cd0 2023-07-06T21:57:10.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.144+0000 7f42f77fe640 1 --2- 172.21.15.55:0/341484150 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f42fc066100 0x7f42fc0685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:10.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.144+0000 7f42f77fe640 1 -- 172.21.15.55:0/341484150 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7098+0+0 (secure 0 0 0) 0x7f430011e380 con 0x7f43100b7cd0 2023-07-06T21:57:10.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.144+0000 7f430e7fc640 1 --2- 172.21.15.55:0/341484150 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f42fc066100 0x7f42fc0685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:10.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.144+0000 7f430e7fc640 1 --2- 172.21.15.55:0/341484150 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f42fc066100 0x7f42fc0685b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4310157dc0 tx=0x7f4304008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:10.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.148+0000 7f42f77fe640 1 -- 172.21.15.55:0/341484150 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43101596d0 con 0x7f43100b7cd0 2023-07-06T21:57:10.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.308+0000 7f431526d640 1 -- 172.21.15.55:0/341484150 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43100b1600 con 0x7f43100b7cd0 2023-07-06T21:57:10.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.308+0000 7f42f77fe640 1 -- 172.21.15.55:0/341484150 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+19606 (secure 0 0 0) 0x7f43100b1600 con 0x7f43100b7cd0 2023-07-06T21:57:10.306 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:10.307 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":77,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:57:07.820389+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:55:02.300695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-07-06T21:55:03.183596+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/2257395431":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/1561392865":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/1366713285":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/3291736307":"2023-07-07T21:57:07.820341+0000","172.21.15.55:6832/3229281422":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/1763014168":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/827601659":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/3134202503":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/3057904124":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/3677020920":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/1723719878":"2023-07-07T21:55:20.576434+0000","172.21.15.55:6833/3843972996":"2023-07-07T21:55:20.576434+0000","172.21.15.55:6832/3843972996":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/2622666608":"2023-07-07T21:55:20.576434+0000","172.21.15.55:6833/3229281422":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/457725185":"2023-07-07T21:55:20.576434+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:10.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.308+0000 7f431526d640 1 -- 172.21.15.55:0/341484150 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f42fc066100 msgr2=0x7f42fc0685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:10.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.308+0000 7f431526d640 1 --2- 172.21.15.55:0/341484150 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f42fc066100 0x7f42fc0685b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4310157dc0 tx=0x7f4304008040 comp rx=0 tx=0).stop 2023-07-06T21:57:10.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.308+0000 7f431526d640 1 -- 172.21.15.55:0/341484150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100b7cd0 msgr2=0x7f431014b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:10.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.308+0000 7f431526d640 1 --2- 172.21.15.55:0/341484150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100b7cd0 0x7f431014b2e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f43000ae040 tx=0x7f430001ac10 comp rx=0 tx=0).stop 2023-07-06T21:57:10.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.308+0000 7f431526d640 1 -- 172.21.15.55:0/341484150 shutdown_connections 2023-07-06T21:57:10.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.308+0000 7f431526d640 1 --2- 172.21.15.55:0/341484150 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f42fc066100 0x7f42fc0685b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.308+0000 7f431526d640 1 --2- 172.21.15.55:0/341484150 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43100ccf00 0x7f4310154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.308+0000 7f431526d640 1 --2- 172.21.15.55:0/341484150 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43100ccab0 0x7f43101496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.308+0000 7f431526d640 1 --2- 172.21.15.55:0/341484150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100b7cd0 0x7f431014b2e0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.308+0000 7f431526d640 1 -- 172.21.15.55:0/341484150 >> 172.21.15.55:0/341484150 conn(0x7f43100ceee0 msgr2=0x7f4310158b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:10.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.308+0000 7f431526d640 1 -- 172.21.15.55:0/341484150 shutdown_connections 2023-07-06T21:57:10.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.308+0000 7f431526d640 1 -- 172.21.15.55:0/341484150 wait complete. 2023-07-06T21:57:10.328 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T21:57:10.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.472+0000 7f4db8493640 1 Processor -- start 2023-07-06T21:57:10.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.472+0000 7f4db8493640 1 -- start start 2023-07-06T21:57:10.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db8493640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4db00b3870 0x7f4db00b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:10.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db8493640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4db00d03c0 0x7f4db00d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:10.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db8493640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db00b2b80 con 0x7f4db015b850 2023-07-06T21:57:10.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db8493640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db00cff30 con 0x7f4db00d03c0 2023-07-06T21:57:10.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db8493640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00b41e0 con 0x7f4db00b3870 2023-07-06T21:57:10.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db5a2e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4db00b3870 0x7f4db00b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:10.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db5a2e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4db00b3870 0x7f4db00b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:59050/0 (socket says 172.21.15.55:59050) 2023-07-06T21:57:10.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db5a2e640 1 -- 172.21.15.55:0/2058172518 learned_addr learned my addr 172.21.15.55:0/2058172518 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:10.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db6a30640 1 --2- 172.21.15.55:0/2058172518 >> v2:172.21.15.138:3300/0 conn(0x7f4db00d03c0 0x7f4db00d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:10.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db622f640 1 --1- 172.21.15.55:0/2058172518 >> v1:172.21.15.138:6789/0 conn(0x7f4db015b850 0x7f4db00cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:58268/0 (socket says 172.21.15.55:58268) 2023-07-06T21:57:10.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db5a2e640 1 -- 172.21.15.55:0/2058172518 >> v2:172.21.15.138:3300/0 conn(0x7f4db00d03c0 msgr2=0x7f4db00d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:10.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db5a2e640 1 --2- 172.21.15.55:0/2058172518 >> v2:172.21.15.138:3300/0 conn(0x7f4db00d03c0 0x7f4db00d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db5a2e640 1 -- 172.21.15.55:0/2058172518 >> v1:172.21.15.138:6789/0 conn(0x7f4db015b850 legacy=0x7f4db00cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:10.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db5a2e640 1 -- 172.21.15.55:0/2058172518 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db00b22e0 con 0x7f4db00b3870 2023-07-06T21:57:10.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.476+0000 7f4db6a30640 1 --2- 172.21.15.55:0/2058172518 >> v2:172.21.15.138:3300/0 conn(0x7f4db00d03c0 0x7f4db00d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:10.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.480+0000 7f4db5a2e640 1 --2- 172.21.15.55:0/2058172518 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4db00b3870 0x7f4db00b3ca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4da0009870 tx=0x7f4da001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd4407a58596b5ab server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:10.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.480+0000 7f4db522d640 1 -- 172.21.15.55:0/2058172518 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da00ab5f0 con 0x7f4db00b3870 2023-07-06T21:57:10.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.480+0000 7f4db522d640 1 -- 172.21.15.55:0/2058172518 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da00ab750 con 0x7f4db00b3870 2023-07-06T21:57:10.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.480+0000 7f4db522d640 1 -- 172.21.15.55:0/2058172518 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da00abae0 con 0x7f4db00b3870 2023-07-06T21:57:10.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.480+0000 7f4db8493640 1 -- 172.21.15.55:0/2058172518 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4db00b3870 msgr2=0x7f4db00b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:10.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.480+0000 7f4db8493640 1 --2- 172.21.15.55:0/2058172518 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4db00b3870 0x7f4db00b3ca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4da0009870 tx=0x7f4da001c3f0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.480+0000 7f4db8493640 1 -- 172.21.15.55:0/2058172518 shutdown_connections 2023-07-06T21:57:10.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.480+0000 7f4db8493640 1 --2- 172.21.15.55:0/2058172518 >> v2:172.21.15.138:3300/0 conn(0x7f4db00d03c0 0x7f4db00d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.480+0000 7f4db8493640 1 --2- 172.21.15.55:0/2058172518 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4db00b3870 0x7f4db00b3ca0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.480+0000 7f4db8493640 1 -- 172.21.15.55:0/2058172518 >> 172.21.15.55:0/2058172518 conn(0x7f4db00cec20 msgr2=0x7f4db00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:10.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.480+0000 7f4db8493640 1 -- 172.21.15.55:0/2058172518 shutdown_connections 2023-07-06T21:57:10.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.480+0000 7f4db8493640 1 -- 172.21.15.55:0/2058172518 wait complete. 2023-07-06T21:57:10.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.480+0000 7f4db8493640 1 Processor -- start 2023-07-06T21:57:10.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.480+0000 7f4db8493640 1 -- start start 2023-07-06T21:57:10.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db8493640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4db00b3870 0x7f4db00b7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:10.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db8493640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4db00d03c0 0x7f4db0152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:10.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db8493640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4db015b850 0x7f4db00c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:10.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db8493640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db0156210 con 0x7f4db00b3870 2023-07-06T21:57:10.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db8493640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db014f470 con 0x7f4db00d03c0 2023-07-06T21:57:10.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db8493640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db0154290 con 0x7f4db015b850 2023-07-06T21:57:10.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db622f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4db00b3870 0x7f4db00b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:10.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db622f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4db00b3870 0x7f4db00b7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50754/0 (socket says 172.21.15.55:50754) 2023-07-06T21:57:10.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db622f640 1 -- 172.21.15.55:0/2710710610 learned_addr learned my addr 172.21.15.55:0/2710710610 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:10.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db5a2e640 1 --2- 172.21.15.55:0/2710710610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4db00d03c0 0x7f4db0152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:10.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db6a30640 1 --2- 172.21.15.55:0/2710710610 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4db015b850 0x7f4db00c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:10.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db622f640 1 -- 172.21.15.55:0/2710710610 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4db015b850 msgr2=0x7f4db00c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:10.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db622f640 1 --2- 172.21.15.55:0/2710710610 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4db015b850 0x7f4db00c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db622f640 1 -- 172.21.15.55:0/2710710610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4db00d03c0 msgr2=0x7f4db0152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:10.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db622f640 1 --2- 172.21.15.55:0/2710710610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4db00d03c0 0x7f4db0152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:10.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db622f640 1 -- 172.21.15.55:0/2710710610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da8009a70 con 0x7f4db00b3870 2023-07-06T21:57:10.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db622f640 1 --2- 172.21.15.55:0/2710710610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4db00b3870 0x7f4db00b7640 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00c420 tx=0x7f4dac00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:10.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4da6ffd640 1 -- 172.21.15.55:0/2710710610 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0074e0 con 0x7f4db00b3870 2023-07-06T21:57:10.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4da6ffd640 1 -- 172.21.15.55:0/2710710610 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac007640 con 0x7f4db00b3870 2023-07-06T21:57:10.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db8493640 1 -- 172.21.15.55:0/2710710610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da00094d0 con 0x7f4db00b3870 2023-07-06T21:57:10.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4da6ffd640 1 -- 172.21.15.55:0/2710710610 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac004a30 con 0x7f4db00b3870 2023-07-06T21:57:10.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db8493640 1 -- 172.21.15.55:0/2710710610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db0153fb0 con 0x7f4db00b3870 2023-07-06T21:57:10.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.484+0000 7f4db8493640 1 -- 172.21.15.55:0/2710710610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db0066d60 con 0x7f4db00b3870 2023-07-06T21:57:10.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.488+0000 7f4da6ffd640 1 -- 172.21.15.55:0/2710710610 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 28) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f4dac004b90 con 0x7f4db00b3870 2023-07-06T21:57:10.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.488+0000 7f4da6ffd640 1 --2- 172.21.15.55:0/2710710610 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f4d940660a0 0x7f4d94068550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:10.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.488+0000 7f4da6ffd640 1 -- 172.21.15.55:0/2710710610 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7098+0+0 (secure 0 0 0) 0x7f4dac083660 con 0x7f4db00b3870 2023-07-06T21:57:10.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.488+0000 7f4db5a2e640 1 --2- 172.21.15.55:0/2710710610 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f4d940660a0 0x7f4d94068550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:10.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.488+0000 7f4db5a2e640 1 --2- 172.21.15.55:0/2710710610 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f4d940660a0 0x7f4d94068550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4da00af000 tx=0x7f4da00b6040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:10.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.492+0000 7f4da6ffd640 1 -- 172.21.15.55:0/2710710610 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4dac050a10 con 0x7f4db00b3870 2023-07-06T21:57:10.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.636+0000 7f4da6ffd640 1 -- 172.21.15.55:0/2710710610 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4dac050de0 con 0x7f4db00b3870 2023-07-06T21:57:10.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:10.680+0000 7f4db8493640 1 -- 172.21.15.55:0/2710710610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4db00b3420 con 0x7f4db00b3870 2023-07-06T21:57:11.629 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-07-06T21:57:11.632+0000 7f5b6d80c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T21:57:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.636+0000 7f4da6ffd640 1 -- 172.21.15.55:0/2710710610 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4dac071410 con 0x7f4db00b3870 2023-07-06T21:57:11.635 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T21:57:11.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.640+0000 7f4db8493640 1 -- 172.21.15.55:0/2710710610 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f4d940660a0 msgr2=0x7f4d94068550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.640+0000 7f4db8493640 1 --2- 172.21.15.55:0/2710710610 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f4d940660a0 0x7f4d94068550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4da00af000 tx=0x7f4da00b6040 comp rx=0 tx=0).stop 2023-07-06T21:57:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.640+0000 7f4db8493640 1 -- 172.21.15.55:0/2710710610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4db00b3870 msgr2=0x7f4db00b7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.640+0000 7f4db8493640 1 --2- 172.21.15.55:0/2710710610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4db00b3870 0x7f4db00b7640 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00c420 tx=0x7f4dac00c820 comp rx=0 tx=0).stop 2023-07-06T21:57:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.640+0000 7f4db8493640 1 -- 172.21.15.55:0/2710710610 shutdown_connections 2023-07-06T21:57:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.640+0000 7f4db8493640 1 --2- 172.21.15.55:0/2710710610 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f4d940660a0 0x7f4d94068550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.640+0000 7f4db8493640 1 --2- 172.21.15.55:0/2710710610 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4db015b850 0x7f4db00c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:11.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.640+0000 7f4db8493640 1 --2- 172.21.15.55:0/2710710610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4db00d03c0 0x7f4db0152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:11.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.640+0000 7f4db8493640 1 --2- 172.21.15.55:0/2710710610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4db00b3870 0x7f4db00b7640 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:11.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.640+0000 7f4db8493640 1 -- 172.21.15.55:0/2710710610 >> 172.21.15.55:0/2710710610 conn(0x7f4db00cec20 msgr2=0x7f4db00cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:11.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.640+0000 7f4db8493640 1 -- 172.21.15.55:0/2710710610 shutdown_connections 2023-07-06T21:57:11.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.640+0000 7f4db8493640 1 -- 172.21.15.55:0/2710710610 wait complete. 2023-07-06T21:57:11.660 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T21:57:11.698 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-07-06T21:57:11.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.812+0000 7f2243b00640 1 Processor -- start 2023-07-06T21:57:11.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.812+0000 7f2243b00640 1 -- start start 2023-07-06T21:57:11.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.812+0000 7f2243b00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f223c15b850 0x7f223c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:11.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.812+0000 7f2243b00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f223c0b3f80 0x7f223c0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:11.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.812+0000 7f2243b00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c0b2b80 con 0x7f223c0ccd30 2023-07-06T21:57:11.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.812+0000 7f2243b00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c0cff30 con 0x7f223c15b850 2023-07-06T21:57:11.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.812+0000 7f2243b00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c0b22e0 con 0x7f223c0b3f80 2023-07-06T21:57:11.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.812+0000 7f224189c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f223c15b850 0x7f223c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:11.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.816+0000 7f224209d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f223c0b3f80 0x7f223c0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:11.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.816+0000 7f224209d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f223c0b3f80 0x7f223c0d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:33932/0 (socket says 172.21.15.55:33932) 2023-07-06T21:57:11.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.816+0000 7f224209d640 1 -- 172.21.15.55:0/2410050098 learned_addr learned my addr 172.21.15.55:0/2410050098 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:11.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.816+0000 7f224109b640 1 --1- 172.21.15.55:0/2410050098 >> v1:172.21.15.138:6789/0 conn(0x7f223c0ccd30 0x7f223c0b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:58274/0 (socket says 172.21.15.55:58274) 2023-07-06T21:57:11.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.816+0000 7f224209d640 1 -- 172.21.15.55:0/2410050098 >> v2:172.21.15.55:3300/0 conn(0x7f223c15b850 msgr2=0x7f223c0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:11.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.816+0000 7f224209d640 1 --2- 172.21.15.55:0/2410050098 >> v2:172.21.15.55:3300/0 conn(0x7f223c15b850 0x7f223c0cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:11.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.816+0000 7f224209d640 1 -- 172.21.15.55:0/2410050098 >> v1:172.21.15.138:6789/0 conn(0x7f223c0ccd30 legacy=0x7f223c0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:11.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.816+0000 7f224209d640 1 -- 172.21.15.55:0/2410050098 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c0b25c0 con 0x7f223c0b3f80 2023-07-06T21:57:11.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.816+0000 7f224189c640 1 --2- 172.21.15.55:0/2410050098 >> v2:172.21.15.55:3300/0 conn(0x7f223c15b850 0x7f223c0cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:11.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.816+0000 7f224089a640 1 -- 172.21.15.55:0/2410050098 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736158339 0 0) 0x7f223c0b2b80 con 0x7f223c0ccd30 2023-07-06T21:57:11.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.816+0000 7f224209d640 1 --2- 172.21.15.55:0/2410050098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f223c0b3f80 0x7f223c0d03c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f223c0cc780 tx=0x7f223401c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d775ef8ea1b09830 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:11.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.816+0000 7f224089a640 1 -- 172.21.15.55:0/2410050098 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22340a56d0 con 0x7f223c0b3f80 2023-07-06T21:57:11.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.816+0000 7f224089a640 1 -- 172.21.15.55:0/2410050098 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22340a5830 con 0x7f223c0b3f80 2023-07-06T21:57:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.816+0000 7f224089a640 1 -- 172.21.15.55:0/2410050098 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22340a5bc0 con 0x7f223c0b3f80 2023-07-06T21:57:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 -- 172.21.15.55:0/2410050098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f223c0b3f80 msgr2=0x7f223c0d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 --2- 172.21.15.55:0/2410050098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f223c0b3f80 0x7f223c0d03c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f223c0cc780 tx=0x7f223401c880 comp rx=0 tx=0).stop 2023-07-06T21:57:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 -- 172.21.15.55:0/2410050098 shutdown_connections 2023-07-06T21:57:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 --2- 172.21.15.55:0/2410050098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f223c0b3f80 0x7f223c0d03c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 --2- 172.21.15.55:0/2410050098 >> v2:172.21.15.55:3300/0 conn(0x7f223c15b850 0x7f223c0cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 -- 172.21.15.55:0/2410050098 >> 172.21.15.55:0/2410050098 conn(0x7f223c0cec20 msgr2=0x7f223c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 -- 172.21.15.55:0/2410050098 shutdown_connections 2023-07-06T21:57:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 -- 172.21.15.55:0/2410050098 wait complete. 2023-07-06T21:57:11.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 Processor -- start 2023-07-06T21:57:11.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 -- start start 2023-07-06T21:57:11.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f223c0b3f80 0x7f223c14bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:11.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f223c0ccd30 0x7f223c0cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:11.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f223c15b850 0x7f223c1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c14c490 con 0x7f223c0ccd30 2023-07-06T21:57:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0ca4c0 con 0x7f223c0b3f80 2023-07-06T21:57:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f2243b00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c14f220 con 0x7f223c15b850 2023-07-06T21:57:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f224109b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f223c0ccd30 0x7f223c0cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f224109b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f223c0ccd30 0x7f223c0cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50768/0 (socket says 172.21.15.55:50768) 2023-07-06T21:57:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f224109b640 1 -- 172.21.15.55:0/3159767878 learned_addr learned my addr 172.21.15.55:0/3159767878 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f224189c640 1 --2- 172.21.15.55:0/3159767878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f223c0b3f80 0x7f223c14bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.820+0000 7f224209d640 1 --2- 172.21.15.55:0/3159767878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f223c15b850 0x7f223c1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f224109b640 1 -- 172.21.15.55:0/3159767878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f223c15b850 msgr2=0x7f223c1523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f224109b640 1 --2- 172.21.15.55:0/3159767878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f223c15b850 0x7f223c1523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f224109b640 1 -- 172.21.15.55:0/3159767878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f223c0b3f80 msgr2=0x7f223c14bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f224109b640 1 --2- 172.21.15.55:0/3159767878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f223c0b3f80 0x7f223c14bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f224109b640 1 -- 172.21.15.55:0/3159767878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2238009420 con 0x7f223c0ccd30 2023-07-06T21:57:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f224109b640 1 --2- 172.21.15.55:0/3159767878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f223c0ccd30 0x7f223c0cb060 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f222c0011f0 tx=0x7f222c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f22327fc640 1 -- 172.21.15.55:0/3159767878 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c0074e0 con 0x7f223c0ccd30 2023-07-06T21:57:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f22327fc640 1 -- 172.21.15.55:0/3159767878 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c007640 con 0x7f223c0ccd30 2023-07-06T21:57:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f22327fc640 1 -- 172.21.15.55:0/3159767878 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c004a10 con 0x7f223c0ccd30 2023-07-06T21:57:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f2243b00640 1 -- 172.21.15.55:0/3159767878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2234009b30 con 0x7f223c0ccd30 2023-07-06T21:57:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f2243b00640 1 -- 172.21.15.55:0/3159767878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c15bda0 con 0x7f223c0ccd30 2023-07-06T21:57:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f2243b00640 1 -- 172.21.15.55:0/3159767878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c066d60 con 0x7f223c0ccd30 2023-07-06T21:57:11.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f22327fc640 1 -- 172.21.15.55:0/3159767878 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f222c004b70 con 0x7f223c0ccd30 2023-07-06T21:57:11.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f22327fc640 1 --2- 172.21.15.55:0/3159767878 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f22200663a0 0x7f2220068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:11.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f22327fc640 1 -- 172.21.15.55:0/3159767878 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7184+0+0 (secure 0 0 0) 0x7f222c083510 con 0x7f223c0ccd30 2023-07-06T21:57:11.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.824+0000 7f224189c640 1 --2- 172.21.15.55:0/3159767878 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f22200663a0 0x7f2220068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:11.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.828+0000 7f224189c640 1 --2- 172.21.15.55:0/3159767878 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f22200663a0 0x7f2220068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2238009c50 tx=0x7f2238009190 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:11.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:11.828+0000 7f22327fc640 1 -- 172.21.15.55:0/3159767878 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f222c0504e0 con 0x7f223c0ccd30 2023-07-06T21:57:12.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.020+0000 7f2243b00640 1 -- 172.21.15.55:0/3159767878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f223c0b3420 con 0x7f223c0ccd30 2023-07-06T21:57:12.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.644+0000 7f22327fc640 1 -- 172.21.15.55:0/3159767878 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f222c053b00 con 0x7f223c0ccd30 2023-07-06T21:57:12.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.644+0000 7f2243b00640 1 -- 172.21.15.55:0/3159767878 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f22200663a0 msgr2=0x7f2220068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:12.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.644+0000 7f2243b00640 1 --2- 172.21.15.55:0/3159767878 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f22200663a0 0x7f2220068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2238009c50 tx=0x7f2238009190 comp rx=0 tx=0).stop 2023-07-06T21:57:12.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.644+0000 7f2243b00640 1 -- 172.21.15.55:0/3159767878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f223c0ccd30 msgr2=0x7f223c0cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:12.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.644+0000 7f2243b00640 1 --2- 172.21.15.55:0/3159767878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f223c0ccd30 0x7f223c0cb060 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f222c0011f0 tx=0x7f222c00c9b0 comp rx=0 tx=0).stop 2023-07-06T21:57:12.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.644+0000 7f2243b00640 1 -- 172.21.15.55:0/3159767878 shutdown_connections 2023-07-06T21:57:12.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.644+0000 7f2243b00640 1 --2- 172.21.15.55:0/3159767878 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f22200663a0 0x7f2220068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:12.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.644+0000 7f2243b00640 1 --2- 172.21.15.55:0/3159767878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f223c15b850 0x7f223c1523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:12.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.644+0000 7f2243b00640 1 --2- 172.21.15.55:0/3159767878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f223c0ccd30 0x7f223c0cb060 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:12.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.644+0000 7f2243b00640 1 --2- 172.21.15.55:0/3159767878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f223c0b3f80 0x7f223c14bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:12.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.644+0000 7f2243b00640 1 -- 172.21.15.55:0/3159767878 >> 172.21.15.55:0/3159767878 conn(0x7f223c0cec20 msgr2=0x7f223c157140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:12.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.644+0000 7f2243b00640 1 -- 172.21.15.55:0/3159767878 shutdown_connections 2023-07-06T21:57:12.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.644+0000 7f2243b00640 1 -- 172.21.15.55:0/3159767878 wait complete. 2023-07-06T21:57:12.664 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T21:57:12.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.812+0000 7f359f337640 1 Processor -- start 2023-07-06T21:57:12.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.816+0000 7f359f337640 1 -- start start 2023-07-06T21:57:12.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.816+0000 7f359f337640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35981598e0 0x7f359806a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:12.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.816+0000 7f359f337640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3598070070 0x7f35980cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:12.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.816+0000 7f359f337640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3598070bb0 con 0x7f35980b4010 2023-07-06T21:57:12.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.816+0000 7f359f337640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35980b4800 con 0x7f35981598e0 2023-07-06T21:57:12.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.816+0000 7f359f337640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359806acc0 con 0x7f3598070070 2023-07-06T21:57:12.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.816+0000 7f359d0d3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35981598e0 0x7f359806a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:12.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.816+0000 7f359d0d3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35981598e0 0x7f359806a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50784/0 (socket says 172.21.15.55:50784) 2023-07-06T21:57:12.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.816+0000 7f359d0d3640 1 -- 172.21.15.55:0/429237724 learned_addr learned my addr 172.21.15.55:0/429237724 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:12.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.816+0000 7f359d8d4640 1 --2- 172.21.15.55:0/429237724 >> v2:172.21.15.138:3300/0 conn(0x7f3598070070 0x7f35980cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:12.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.816+0000 7f359d0d3640 1 -- 172.21.15.55:0/429237724 >> v2:172.21.15.138:3300/0 conn(0x7f3598070070 msgr2=0x7f35980cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:12.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.816+0000 7f359d0d3640 1 --2- 172.21.15.55:0/429237724 >> v2:172.21.15.138:3300/0 conn(0x7f3598070070 0x7f35980cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:12.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.816+0000 7f359d0d3640 1 -- 172.21.15.55:0/429237724 >> v1:172.21.15.138:6789/0 conn(0x7f35980b4010 legacy=0x7f359806f960 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T21:57:12.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.816+0000 7f359d0d3640 1 -- 172.21.15.55:0/429237724 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35980ca2a0 con 0x7f35981598e0 2023-07-06T21:57:12.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.820+0000 7f359d0d3640 1 --2- 172.21.15.55:0/429237724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35981598e0 0x7f359806a780 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f359815e750 tx=0x7f359401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f50ccaf263468f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:12.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.820+0000 7f358ffff640 1 -- 172.21.15.55:0/429237724 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35940aa610 con 0x7f35981598e0 2023-07-06T21:57:12.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.820+0000 7f358ffff640 1 -- 172.21.15.55:0/429237724 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35940a6040 con 0x7f35981598e0 2023-07-06T21:57:12.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.820+0000 7f358ffff640 1 -- 172.21.15.55:0/429237724 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35940aa990 con 0x7f35981598e0 2023-07-06T21:57:12.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.820+0000 7f359f337640 1 -- 172.21.15.55:0/429237724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35981598e0 msgr2=0x7f359806a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:12.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.820+0000 7f359f337640 1 --2- 172.21.15.55:0/429237724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35981598e0 0x7f359806a780 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f359815e750 tx=0x7f359401c490 comp rx=0 tx=0).stop 2023-07-06T21:57:12.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.820+0000 7f359f337640 1 -- 172.21.15.55:0/429237724 shutdown_connections 2023-07-06T21:57:12.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.820+0000 7f359f337640 1 --2- 172.21.15.55:0/429237724 >> v2:172.21.15.138:3300/0 conn(0x7f3598070070 0x7f35980cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:12.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.820+0000 7f359f337640 1 --2- 172.21.15.55:0/429237724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35981598e0 0x7f359806a780 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:12.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.820+0000 7f359f337640 1 -- 172.21.15.55:0/429237724 >> 172.21.15.55:0/429237724 conn(0x7f35980ce7f0 msgr2=0x7f35980cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:12.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.820+0000 7f359f337640 1 -- 172.21.15.55:0/429237724 shutdown_connections 2023-07-06T21:57:12.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.820+0000 7f359f337640 1 -- 172.21.15.55:0/429237724 wait complete. 2023-07-06T21:57:12.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.820+0000 7f359f337640 1 Processor -- start 2023-07-06T21:57:12.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.820+0000 7f359f337640 1 -- start start 2023-07-06T21:57:12.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359f337640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3598070070 0x7f359806b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:12.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359f337640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35980b4010 0x7f359814e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:12.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359f337640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35981598e0 0x7f35980abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:12.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359f337640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359806bc20 con 0x7f35980b4010 2023-07-06T21:57:12.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359f337640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359806be80 con 0x7f35981598e0 2023-07-06T21:57:12.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359f337640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359806c160 con 0x7f3598070070 2023-07-06T21:57:12.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359c8d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35980b4010 0x7f359814e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:12.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359c8d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35980b4010 0x7f359814e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50786/0 (socket says 172.21.15.55:50786) 2023-07-06T21:57:12.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359c8d2640 1 -- 172.21.15.55:0/1317829175 learned_addr learned my addr 172.21.15.55:0/1317829175 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:12.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359d0d3640 1 --2- 172.21.15.55:0/1317829175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3598070070 0x7f359806b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:12.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359d8d4640 1 --2- 172.21.15.55:0/1317829175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35981598e0 0x7f35980abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:12.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359c8d2640 1 -- 172.21.15.55:0/1317829175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3598070070 msgr2=0x7f359806b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:12.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359c8d2640 1 --2- 172.21.15.55:0/1317829175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3598070070 0x7f359806b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:12.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359c8d2640 1 -- 172.21.15.55:0/1317829175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35981598e0 msgr2=0x7f35980abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:12.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359c8d2640 1 --2- 172.21.15.55:0/1317829175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35981598e0 0x7f35980abc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:12.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359c8d2640 1 -- 172.21.15.55:0/1317829175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594009480 con 0x7f35980b4010 2023-07-06T21:57:12.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359c8d2640 1 --2- 172.21.15.55:0/1317829175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35980b4010 0x7f359814e450 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f358800b450 tx=0x7f358800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:12.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f358dffb640 1 -- 172.21.15.55:0/1317829175 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3588011890 con 0x7f35980b4010 2023-07-06T21:57:12.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f358dffb640 1 -- 172.21.15.55:0/1317829175 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35880119f0 con 0x7f35980b4010 2023-07-06T21:57:12.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359f337640 1 -- 172.21.15.55:0/1317829175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359806c440 con 0x7f35980b4010 2023-07-06T21:57:12.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f358dffb640 1 -- 172.21.15.55:0/1317829175 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3588011dc0 con 0x7f35980b4010 2023-07-06T21:57:12.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359f337640 1 -- 172.21.15.55:0/1317829175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35980b2480 con 0x7f35980b4010 2023-07-06T21:57:12.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f359f337640 1 -- 172.21.15.55:0/1317829175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3598066d60 con 0x7f35980b4010 2023-07-06T21:57:12.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.824+0000 7f358dffb640 1 -- 172.21.15.55:0/1317829175 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f358801a400 con 0x7f35980b4010 2023-07-06T21:57:12.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.828+0000 7f358dffb640 1 --2- 172.21.15.55:0/1317829175 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f357c0663d0 0x7f357c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:12.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.828+0000 7f358dffb640 1 -- 172.21.15.55:0/1317829175 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7184+0+0 (secure 0 0 0) 0x7f3588084590 con 0x7f35980b4010 2023-07-06T21:57:12.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.828+0000 7f359d0d3640 1 --2- 172.21.15.55:0/1317829175 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f357c0663d0 0x7f357c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:12.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.828+0000 7f359d0d3640 1 --2- 172.21.15.55:0/1317829175 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f357c0663d0 0x7f357c068880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f35940ae000 tx=0x7f35940a7000 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.832+0000 7f358dffb640 1 -- 172.21.15.55:0/1317829175 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35880514c0 con 0x7f35980b4010 2023-07-06T21:57:12.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:12.988+0000 7f359f337640 1 -- 172.21.15.55:0/1317829175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f35980cebc0 con 0x7f35980b4010 2023-07-06T21:57:13.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:13.864+0000 7f358dffb640 1 -- 172.21.15.55:0/1317829175 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3588054ae0 con 0x7f35980b4010 2023-07-06T21:57:13.864 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-07-06T21:57:13.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:13.868+0000 7f359f337640 1 -- 172.21.15.55:0/1317829175 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f357c0663d0 msgr2=0x7f357c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:13.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:13.868+0000 7f359f337640 1 --2- 172.21.15.55:0/1317829175 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f357c0663d0 0x7f357c068880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f35940ae000 tx=0x7f35940a7000 comp rx=0 tx=0).stop 2023-07-06T21:57:13.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:13.868+0000 7f359f337640 1 -- 172.21.15.55:0/1317829175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35980b4010 msgr2=0x7f359814e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:13.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:13.868+0000 7f359f337640 1 --2- 172.21.15.55:0/1317829175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35980b4010 0x7f359814e450 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f358800b450 tx=0x7f358800b910 comp rx=0 tx=0).stop 2023-07-06T21:57:13.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:13.868+0000 7f359f337640 1 -- 172.21.15.55:0/1317829175 shutdown_connections 2023-07-06T21:57:13.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:13.868+0000 7f359f337640 1 --2- 172.21.15.55:0/1317829175 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f357c0663d0 0x7f357c068880 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:13.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:13.868+0000 7f359f337640 1 --2- 172.21.15.55:0/1317829175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35981598e0 0x7f35980abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:13.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:13.868+0000 7f359f337640 1 --2- 172.21.15.55:0/1317829175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35980b4010 0x7f359814e450 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:13.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:13.868+0000 7f359f337640 1 --2- 172.21.15.55:0/1317829175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3598070070 0x7f359806b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:13.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:13.868+0000 7f359f337640 1 -- 172.21.15.55:0/1317829175 >> 172.21.15.55:0/1317829175 conn(0x7f35980ce7f0 msgr2=0x7f35980aecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:13.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:13.868+0000 7f359f337640 1 -- 172.21.15.55:0/1317829175 shutdown_connections 2023-07-06T21:57:13.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:13.868+0000 7f359f337640 1 -- 172.21.15.55:0/1317829175 wait complete. 2023-07-06T21:57:13.892 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T21:57:14.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.044+0000 7f9424a93640 1 Processor -- start 2023-07-06T21:57:14.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.048+0000 7f9424a93640 1 -- start start 2023-07-06T21:57:14.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.048+0000 7f9424a93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94200cd910 0x7f94200c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:14.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.048+0000 7f9424a93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94200cc730 0x7f94200c0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:14.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.048+0000 7f9424a93640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94200ca720 con 0x7f942015ff90 2023-07-06T21:57:14.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.048+0000 7f9424a93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9420160360 con 0x7f94200cc730 2023-07-06T21:57:14.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.048+0000 7f9424a93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94200cba00 con 0x7f94200cd910 2023-07-06T21:57:14.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.052+0000 7f941ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94200cc730 0x7f94200c0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:14.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.052+0000 7f941ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94200cc730 0x7f94200c0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56314/0 (socket says 172.21.15.55:56314) 2023-07-06T21:57:14.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.052+0000 7f941ed9d640 1 -- 172.21.15.55:0/1556694667 learned_addr learned my addr 172.21.15.55:0/1556694667 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:14.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.052+0000 7f941e59c640 1 --1- 172.21.15.55:0/1556694667 >> v1:172.21.15.138:6789/0 conn(0x7f942015ff90 0x7f94200cd200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:49384/0 (socket says 172.21.15.55:49384) 2023-07-06T21:57:14.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.052+0000 7f941ed9d640 1 -- 172.21.15.55:0/1556694667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94200cd910 msgr2=0x7f94200c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:14.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.052+0000 7f941dd9b640 1 --2- 172.21.15.55:0/1556694667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94200cd910 0x7f94200c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:14.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.052+0000 7f941ed9d640 1 --2- 172.21.15.55:0/1556694667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94200cd910 0x7f94200c0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.052+0000 7f941ed9d640 1 -- 172.21.15.55:0/1556694667 >> v1:172.21.15.138:6789/0 conn(0x7f942015ff90 legacy=0x7f94200cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:14.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.052+0000 7f941ed9d640 1 -- 172.21.15.55:0/1556694667 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942006d160 con 0x7f94200cc730 2023-07-06T21:57:14.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.052+0000 7f941dd9b640 1 --2- 172.21.15.55:0/1556694667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94200cd910 0x7f94200c0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:14.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.056+0000 7f941ed9d640 1 --2- 172.21.15.55:0/1556694667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94200cc730 0x7f94200c0fb0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9418009e50 tx=0x7f941801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e07acd65bb541b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:14.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.056+0000 7f941d59a640 1 -- 172.21.15.55:0/1556694667 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180a5790 con 0x7f94200cc730 2023-07-06T21:57:14.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.056+0000 7f941d59a640 1 -- 172.21.15.55:0/1556694667 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94180a58f0 con 0x7f94200cc730 2023-07-06T21:57:14.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.056+0000 7f941d59a640 1 -- 172.21.15.55:0/1556694667 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180a5c80 con 0x7f94200cc730 2023-07-06T21:57:14.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.056+0000 7f9424a93640 1 -- 172.21.15.55:0/1556694667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94200cc730 msgr2=0x7f94200c0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:14.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.056+0000 7f9424a93640 1 --2- 172.21.15.55:0/1556694667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94200cc730 0x7f94200c0fb0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9418009e50 tx=0x7f941801c910 comp rx=0 tx=0).stop 2023-07-06T21:57:14.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.060+0000 7f9424a93640 1 -- 172.21.15.55:0/1556694667 shutdown_connections 2023-07-06T21:57:14.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.060+0000 7f9424a93640 1 --2- 172.21.15.55:0/1556694667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94200cc730 0x7f94200c0fb0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.060+0000 7f9424a93640 1 --2- 172.21.15.55:0/1556694667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94200cd910 0x7f94200c0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.060+0000 7f9424a93640 1 -- 172.21.15.55:0/1556694667 >> 172.21.15.55:0/1556694667 conn(0x7f94200cde30 msgr2=0x7f94200ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:14.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.060+0000 7f9424a93640 1 -- 172.21.15.55:0/1556694667 shutdown_connections 2023-07-06T21:57:14.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.060+0000 7f9424a93640 1 -- 172.21.15.55:0/1556694667 wait complete. 2023-07-06T21:57:14.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.060+0000 7f9424a93640 1 Processor -- start 2023-07-06T21:57:14.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.060+0000 7f9424a93640 1 -- start start 2023-07-06T21:57:14.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.060+0000 7f9424a93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94200cc730 0x7f942014e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:14.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f9424a93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94200cd910 0x7f94200c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:14.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f9424a93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f942015ff90 0x7f9420151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:14.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f9424a93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94200c4f00 con 0x7f94200cc730 2023-07-06T21:57:14.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f9424a93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94200c51e0 con 0x7f94200cd910 2023-07-06T21:57:14.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f9424a93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94200c4070 con 0x7f942015ff90 2023-07-06T21:57:14.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f941e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94200cc730 0x7f942014e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:14.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f941e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94200cc730 0x7f942014e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56320/0 (socket says 172.21.15.55:56320) 2023-07-06T21:57:14.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f941e59c640 1 -- 172.21.15.55:0/4094423072 learned_addr learned my addr 172.21.15.55:0/4094423072 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:14.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f941dd9b640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94200cd910 0x7f94200c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:14.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f941ed9d640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f942015ff90 0x7f9420151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:14.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f941e59c640 1 -- 172.21.15.55:0/4094423072 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f942015ff90 msgr2=0x7f9420151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:14.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f941e59c640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f942015ff90 0x7f9420151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f941e59c640 1 -- 172.21.15.55:0/4094423072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94200cd910 msgr2=0x7f94200c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:14.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f941e59c640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94200cd910 0x7f94200c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f941e59c640 1 -- 172.21.15.55:0/4094423072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9418009b30 con 0x7f94200cc730 2023-07-06T21:57:14.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f941dd9b640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94200cd910 0x7f94200c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:14.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f941e59c640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94200cc730 0x7f942014e8a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f941000b430 tx=0x7f941000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:14.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f940effd640 1 -- 172.21.15.55:0/4094423072 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410011830 con 0x7f94200cc730 2023-07-06T21:57:14.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f940effd640 1 -- 172.21.15.55:0/4094423072 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9410011990 con 0x7f94200cc730 2023-07-06T21:57:14.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f940effd640 1 -- 172.21.15.55:0/4094423072 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410011d80 con 0x7f94200cc730 2023-07-06T21:57:14.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f9424a93640 1 -- 172.21.15.55:0/4094423072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94200c4350 con 0x7f94200cc730 2023-07-06T21:57:14.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f9424a93640 1 -- 172.21.15.55:0/4094423072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94200c7a40 con 0x7f94200cc730 2023-07-06T21:57:14.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f9424a93640 1 -- 172.21.15.55:0/4094423072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f942006cd70 con 0x7f94200cc730 2023-07-06T21:57:14.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.064+0000 7f940effd640 1 -- 172.21.15.55:0/4094423072 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f941001a400 con 0x7f94200cc730 2023-07-06T21:57:14.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.068+0000 7f940effd640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f94000663d0 0x7f9400068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:14.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.068+0000 7f940effd640 1 -- 172.21.15.55:0/4094423072 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6746+0+0 (secure 0 0 0) 0x7f94100842c0 con 0x7f94200cc730 2023-07-06T21:57:14.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.068+0000 7f941dd9b640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f94000663d0 0x7f9400068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:14.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.068+0000 7f941dd9b640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f94000663d0 0x7f9400068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9414006fd0 tx=0x7f9414008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:14.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.072+0000 7f940effd640 1 -- 172.21.15.55:0/4094423072 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9410051380 con 0x7f94200cc730 2023-07-06T21:57:14.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.224+0000 7f9424a93640 1 -- 172.21.15.55:0/4094423072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9420066d60 con 0x7f94200cc730 2023-07-06T21:57:14.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.628+0000 7f940effd640 1 -- 172.21.15.55:0/4094423072 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) v1 ==== 169+0+0 (secure 0 0 0) 0x7f94100549a0 con 0x7f94200cc730 2023-07-06T21:57:14.629 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-07-06T21:57:14.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.632+0000 7f9424a93640 1 -- 172.21.15.55:0/4094423072 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f94000663d0 msgr2=0x7f9400068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:14.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.632+0000 7f9424a93640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f94000663d0 0x7f9400068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9414006fd0 tx=0x7f9414008040 comp rx=0 tx=0).stop 2023-07-06T21:57:14.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.632+0000 7f9424a93640 1 -- 172.21.15.55:0/4094423072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94200cc730 msgr2=0x7f942014e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:14.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.632+0000 7f9424a93640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94200cc730 0x7f942014e8a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f941000b430 tx=0x7f941000b8f0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.632+0000 7f9424a93640 1 -- 172.21.15.55:0/4094423072 shutdown_connections 2023-07-06T21:57:14.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.632+0000 7f9424a93640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f94000663d0 0x7f9400068880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.632+0000 7f9424a93640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f942015ff90 0x7f9420151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.632+0000 7f9424a93640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94200cd910 0x7f94200c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.632+0000 7f9424a93640 1 --2- 172.21.15.55:0/4094423072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94200cc730 0x7f942014e8a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.632+0000 7f9424a93640 1 -- 172.21.15.55:0/4094423072 >> 172.21.15.55:0/4094423072 conn(0x7f94200cde30 msgr2=0x7f942015bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:14.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.632+0000 7f9424a93640 1 -- 172.21.15.55:0/4094423072 shutdown_connections 2023-07-06T21:57:14.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.632+0000 7f9424a93640 1 -- 172.21.15.55:0/4094423072 wait complete. 2023-07-06T21:57:14.659 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-06T21:57:14.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.816+0000 7fa28fe93640 1 Processor -- start 2023-07-06T21:57:14.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.816+0000 7fa28fe93640 1 -- start start 2023-07-06T21:57:14.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.816+0000 7fa28fe93640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa2880c11a0 0x7fa2880cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:14.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.816+0000 7fa28fe93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa28806eee0 0x7fa28806f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:14.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.816+0000 7fa28fe93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2880ccd70 con 0x7fa28806f8c0 2023-07-06T21:57:14.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.816+0000 7fa28fe93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2881605f0 con 0x7fa28806eee0 2023-07-06T21:57:14.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.816+0000 7fa28fe93640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28806ce00 con 0x7fa2880c11a0 2023-07-06T21:57:14.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.816+0000 7fa28d42e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa28806eee0 0x7fa28806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:14.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.816+0000 7fa28d42e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa28806eee0 0x7fa28806f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56332/0 (socket says 172.21.15.55:56332) 2023-07-06T21:57:14.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.816+0000 7fa28d42e640 1 -- 172.21.15.55:0/554298851 learned_addr learned my addr 172.21.15.55:0/554298851 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:14.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.816+0000 7fa28dc2f640 1 --2- 172.21.15.55:0/554298851 >> v2:172.21.15.138:3300/0 conn(0x7fa2880c11a0 0x7fa2880cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:14.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28d42e640 1 -- 172.21.15.55:0/554298851 >> v2:172.21.15.138:3300/0 conn(0x7fa2880c11a0 msgr2=0x7fa2880cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:14.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28d42e640 1 --2- 172.21.15.55:0/554298851 >> v2:172.21.15.138:3300/0 conn(0x7fa2880c11a0 0x7fa2880cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28d42e640 1 -- 172.21.15.55:0/554298851 >> v1:172.21.15.55:6789/0 conn(0x7fa28806f8c0 legacy=0x7fa288163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:14.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28d42e640 1 -- 172.21.15.55:0/554298851 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2880cd9f0 con 0x7fa28806eee0 2023-07-06T21:57:14.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28d42e640 1 --2- 172.21.15.55:0/554298851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa28806eee0 0x7fa28806f380 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa28806d100 tx=0x7fa27801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8587f2f02a9f5de3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:14.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28cc2d640 1 -- 172.21.15.55:0/554298851 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2780ab600 con 0x7fa28806eee0 2023-07-06T21:57:14.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28cc2d640 1 -- 172.21.15.55:0/554298851 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2780a7050 con 0x7fa28806eee0 2023-07-06T21:57:14.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28cc2d640 1 -- 172.21.15.55:0/554298851 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2780ab980 con 0x7fa28806eee0 2023-07-06T21:57:14.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28fe93640 1 -- 172.21.15.55:0/554298851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa28806eee0 msgr2=0x7fa28806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:14.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28fe93640 1 --2- 172.21.15.55:0/554298851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa28806eee0 0x7fa28806f380 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa28806d100 tx=0x7fa27801c470 comp rx=0 tx=0).stop 2023-07-06T21:57:14.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28fe93640 1 -- 172.21.15.55:0/554298851 shutdown_connections 2023-07-06T21:57:14.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28fe93640 1 --2- 172.21.15.55:0/554298851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa28806eee0 0x7fa28806f380 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28fe93640 1 --2- 172.21.15.55:0/554298851 >> v2:172.21.15.138:3300/0 conn(0x7fa2880c11a0 0x7fa2880cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28fe93640 1 -- 172.21.15.55:0/554298851 >> 172.21.15.55:0/554298851 conn(0x7fa2880cea70 msgr2=0x7fa2880ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:14.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28fe93640 1 -- 172.21.15.55:0/554298851 shutdown_connections 2023-07-06T21:57:14.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.820+0000 7fa28fe93640 1 -- 172.21.15.55:0/554298851 wait complete. 2023-07-06T21:57:14.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28fe93640 1 Processor -- start 2023-07-06T21:57:14.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28fe93640 1 -- start start 2023-07-06T21:57:14.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28fe93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa28806eee0 0x7fa28815f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:14.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28fe93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa28806f8c0 0x7fa28815fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:14.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28fe93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880c11a0 0x7fa2880b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:14.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28fe93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa288160340 con 0x7fa2880c11a0 2023-07-06T21:57:14.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28fe93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa288069ea0 con 0x7fa28806eee0 2023-07-06T21:57:14.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28fe93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28806a180 con 0x7fa28806f8c0 2023-07-06T21:57:14.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28e430640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880c11a0 0x7fa2880b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:14.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28e430640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880c11a0 0x7fa2880b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56336/0 (socket says 172.21.15.55:56336) 2023-07-06T21:57:14.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28e430640 1 -- 172.21.15.55:0/2938959756 learned_addr learned my addr 172.21.15.55:0/2938959756 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:14.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28d42e640 1 --2- 172.21.15.55:0/2938959756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa28806f8c0 0x7fa28815fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:14.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28dc2f640 1 --2- 172.21.15.55:0/2938959756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa28806eee0 0x7fa28815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:14.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28e430640 1 -- 172.21.15.55:0/2938959756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa28806f8c0 msgr2=0x7fa28815fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:14.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28e430640 1 --2- 172.21.15.55:0/2938959756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa28806f8c0 0x7fa28815fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28e430640 1 -- 172.21.15.55:0/2938959756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa28806eee0 msgr2=0x7fa28815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:14.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28e430640 1 --2- 172.21.15.55:0/2938959756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa28806eee0 0x7fa28815f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:14.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28e430640 1 -- 172.21.15.55:0/2938959756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2780094d0 con 0x7fa2880c11a0 2023-07-06T21:57:14.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.824+0000 7fa28e430640 1 --2- 172.21.15.55:0/2938959756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880c11a0 0x7fa2880b2480 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa28000c770 tx=0x7fa28000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:14.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.828+0000 7fa27e7fc640 1 -- 172.21.15.55:0/2938959756 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280003b80 con 0x7fa2880c11a0 2023-07-06T21:57:14.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.828+0000 7fa27e7fc640 1 -- 172.21.15.55:0/2938959756 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa280003ce0 con 0x7fa2880c11a0 2023-07-06T21:57:14.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.828+0000 7fa27e7fc640 1 -- 172.21.15.55:0/2938959756 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28000aa90 con 0x7fa2880c11a0 2023-07-06T21:57:14.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.828+0000 7fa28fe93640 1 -- 172.21.15.55:0/2938959756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2880c16f0 con 0x7fa2880c11a0 2023-07-06T21:57:14.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.828+0000 7fa28fe93640 1 -- 172.21.15.55:0/2938959756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28806a740 con 0x7fa2880c11a0 2023-07-06T21:57:14.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.828+0000 7fa28fe93640 1 -- 172.21.15.55:0/2938959756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa288066d60 con 0x7fa2880c11a0 2023-07-06T21:57:14.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.828+0000 7fa27e7fc640 1 -- 172.21.15.55:0/2938959756 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa28000abf0 con 0x7fa2880c11a0 2023-07-06T21:57:14.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.828+0000 7fa27e7fc640 1 --2- 172.21.15.55:0/2938959756 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa26c0663a0 0x7fa26c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:14.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.828+0000 7fa27e7fc640 1 -- 172.21.15.55:0/2938959756 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6332+0+0 (secure 0 0 0) 0x7fa280083c40 con 0x7fa2880c11a0 2023-07-06T21:57:14.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.828+0000 7fa28dc2f640 1 --2- 172.21.15.55:0/2938959756 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa26c0663a0 0x7fa26c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:14.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.828+0000 7fa28dc2f640 1 --2- 172.21.15.55:0/2938959756 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa26c0663a0 0x7fa26c068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa2840079c0 tx=0x7fa284008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:14.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.832+0000 7fa27e7fc640 1 -- 172.21.15.55:0/2938959756 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa280050fe0 con 0x7fa2880c11a0 2023-07-06T21:57:14.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:14.992+0000 7fa28fe93640 1 -- 172.21.15.55:0/2938959756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fa2880cb6c0 con 0x7fa2880c11a0 2023-07-06T21:57:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.000+0000 7fa27e7fc640 1 -- 172.21.15.55:0/2938959756 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v19) v1 ==== 120+0+0 (secure 0 0 0) 0x7fa280054600 con 0x7fa2880c11a0 2023-07-06T21:57:15.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.000+0000 7fa28fe93640 1 -- 172.21.15.55:0/2938959756 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa26c0663a0 msgr2=0x7fa26c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.000+0000 7fa28fe93640 1 --2- 172.21.15.55:0/2938959756 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa26c0663a0 0x7fa26c068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa2840079c0 tx=0x7fa284008040 comp rx=0 tx=0).stop 2023-07-06T21:57:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.000+0000 7fa28fe93640 1 -- 172.21.15.55:0/2938959756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880c11a0 msgr2=0x7fa2880b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.000+0000 7fa28fe93640 1 --2- 172.21.15.55:0/2938959756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880c11a0 0x7fa2880b2480 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa28000c770 tx=0x7fa28000cc30 comp rx=0 tx=0).stop 2023-07-06T21:57:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.000+0000 7fa28fe93640 1 -- 172.21.15.55:0/2938959756 shutdown_connections 2023-07-06T21:57:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.000+0000 7fa28fe93640 1 --2- 172.21.15.55:0/2938959756 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa26c0663a0 0x7fa26c068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.000+0000 7fa28fe93640 1 --2- 172.21.15.55:0/2938959756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880c11a0 0x7fa2880b2480 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.000+0000 7fa28fe93640 1 --2- 172.21.15.55:0/2938959756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa28806f8c0 0x7fa28815fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.000+0000 7fa28fe93640 1 --2- 172.21.15.55:0/2938959756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa28806eee0 0x7fa28815f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.000+0000 7fa28fe93640 1 -- 172.21.15.55:0/2938959756 >> 172.21.15.55:0/2938959756 conn(0x7fa2880cea70 msgr2=0x7fa2880c9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:15.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.004+0000 7fa28fe93640 1 -- 172.21.15.55:0/2938959756 shutdown_connections 2023-07-06T21:57:15.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.004+0000 7fa28fe93640 1 -- 172.21.15.55:0/2938959756 wait complete. 2023-07-06T21:57:15.020 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-06T21:57:15.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.164+0000 7f7d53426640 1 Processor -- start 2023-07-06T21:57:15.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d53426640 1 -- start start 2023-07-06T21:57:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d53426640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d4c0ce220 0x7f7d4c157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d53426640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7d4c06ca30 0x7f7d4c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d53426640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c0cdd60 con 0x7f7d4c06cf80 2023-07-06T21:57:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d53426640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c066010 con 0x7f7d4c06ca30 2023-07-06T21:57:15.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d53426640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0cc5a0 con 0x7f7d4c0ce220 2023-07-06T21:57:15.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d509c1640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7d4c06cf80 0x7f7d4c065900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38406/0 (socket says 172.21.15.55:38406) 2023-07-06T21:57:15.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d509c1640 1 -- 172.21.15.55:0/3577659621 learned_addr learned my addr 172.21.15.55:0/3577659621 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:15.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d519c3640 1 --2- 172.21.15.55:0/3577659621 >> v2:172.21.15.55:3300/0 conn(0x7f7d4c06ca30 0x7f7d4c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d511c2640 1 --2- 172.21.15.55:0/3577659621 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d4c0ce220 0x7f7d4c157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d43fff640 1 -- 172.21.15.55:0/3577659621 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092182078 0 0) 0x7f7d4c0cdd60 con 0x7f7d4c06cf80 2023-07-06T21:57:15.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d43fff640 1 -- 172.21.15.55:0/3577659621 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d38005740 con 0x7f7d4c06cf80 2023-07-06T21:57:15.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d519c3640 1 -- 172.21.15.55:0/3577659621 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d4c0ce220 msgr2=0x7f7d4c157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:15.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d519c3640 1 --2- 172.21.15.55:0/3577659621 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d4c0ce220 0x7f7d4c157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d519c3640 1 -- 172.21.15.55:0/3577659621 >> v1:172.21.15.55:6789/0 conn(0x7f7d4c06cf80 legacy=0x7f7d4c065900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.168+0000 7f7d519c3640 1 -- 172.21.15.55:0/3577659621 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c069f30 con 0x7f7d4c06ca30 2023-07-06T21:57:15.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.172+0000 7f7d519c3640 1 --2- 172.21.15.55:0/3577659621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c06ca30 0x7f7d4c06f910 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009d90 tx=0x7f7d4401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6150ebbe8a33e4e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:15.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.172+0000 7f7d43fff640 1 -- 172.21.15.55:0/3577659621 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440a5800 con 0x7f7d4c06ca30 2023-07-06T21:57:15.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.172+0000 7f7d43fff640 1 -- 172.21.15.55:0/3577659621 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d440a5960 con 0x7f7d4c06ca30 2023-07-06T21:57:15.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.172+0000 7f7d43fff640 1 -- 172.21.15.55:0/3577659621 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440a5cf0 con 0x7f7d4c06ca30 2023-07-06T21:57:15.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.172+0000 7f7d53426640 1 -- 172.21.15.55:0/3577659621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c06ca30 msgr2=0x7f7d4c06f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.172+0000 7f7d53426640 1 --2- 172.21.15.55:0/3577659621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c06ca30 0x7f7d4c06f910 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009d90 tx=0x7f7d4401c830 comp rx=0 tx=0).stop 2023-07-06T21:57:15.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.172+0000 7f7d53426640 1 -- 172.21.15.55:0/3577659621 shutdown_connections 2023-07-06T21:57:15.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.172+0000 7f7d53426640 1 --2- 172.21.15.55:0/3577659621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c06ca30 0x7f7d4c06f910 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.172+0000 7f7d53426640 1 --2- 172.21.15.55:0/3577659621 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d4c0ce220 0x7f7d4c157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.172+0000 7f7d53426640 1 -- 172.21.15.55:0/3577659621 >> 172.21.15.55:0/3577659621 conn(0x7f7d4c0cbd70 msgr2=0x7f7d4c0ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.172+0000 7f7d53426640 1 -- 172.21.15.55:0/3577659621 shutdown_connections 2023-07-06T21:57:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.172+0000 7f7d53426640 1 -- 172.21.15.55:0/3577659621 wait complete. 2023-07-06T21:57:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.172+0000 7f7d53426640 1 Processor -- start 2023-07-06T21:57:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d53426640 1 -- start start 2023-07-06T21:57:15.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d53426640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d4c06ca30 0x7f7d4c14aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d53426640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c06cf80 0x7f7d4c158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d53426640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d4c0ce220 0x7f7d4c14bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d53426640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c159930 con 0x7f7d4c06cf80 2023-07-06T21:57:15.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d53426640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c158a80 con 0x7f7d4c06ca30 2023-07-06T21:57:15.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d53426640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c14c230 con 0x7f7d4c0ce220 2023-07-06T21:57:15.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d509c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c06cf80 0x7f7d4c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d509c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c06cf80 0x7f7d4c158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56352/0 (socket says 172.21.15.55:56352) 2023-07-06T21:57:15.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d509c1640 1 -- 172.21.15.55:0/2354143590 learned_addr learned my addr 172.21.15.55:0/2354143590 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:15.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d519c3640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d4c0ce220 0x7f7d4c14bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d511c2640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d4c06ca30 0x7f7d4c14aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d509c1640 1 -- 172.21.15.55:0/2354143590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d4c0ce220 msgr2=0x7f7d4c14bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d509c1640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d4c0ce220 0x7f7d4c14bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d509c1640 1 -- 172.21.15.55:0/2354143590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d4c06ca30 msgr2=0x7f7d4c14aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d509c1640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d4c06ca30 0x7f7d4c14aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d509c1640 1 -- 172.21.15.55:0/2354143590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d44009a70 con 0x7f7d4c06cf80 2023-07-06T21:57:15.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d511c2640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d4c06ca30 0x7f7d4c14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:15.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d509c1640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c06cf80 0x7f7d4c158540 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00c4d0 tx=0x7f7d3c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:15.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d41ffb640 1 -- 172.21.15.55:0/2354143590 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c005cf0 con 0x7f7d4c06cf80 2023-07-06T21:57:15.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d41ffb640 1 -- 172.21.15.55:0/2354143590 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3c005e50 con 0x7f7d4c06cf80 2023-07-06T21:57:15.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d41ffb640 1 -- 172.21.15.55:0/2354143590 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c007270 con 0x7f7d4c06cf80 2023-07-06T21:57:15.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d53426640 1 -- 172.21.15.55:0/2354143590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c158d20 con 0x7f7d4c06cf80 2023-07-06T21:57:15.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d53426640 1 -- 172.21.15.55:0/2354143590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c1592e0 con 0x7f7d4c06cf80 2023-07-06T21:57:15.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.176+0000 7f7d53426640 1 -- 172.21.15.55:0/2354143590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c159aa0 con 0x7f7d4c06cf80 2023-07-06T21:57:15.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.180+0000 7f7d41ffb640 1 -- 172.21.15.55:0/2354143590 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7d3c0073d0 con 0x7f7d4c06cf80 2023-07-06T21:57:15.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.180+0000 7f7d41ffb640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f7d300663a0 0x7f7d30068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.180+0000 7f7d41ffb640 1 -- 172.21.15.55:0/2354143590 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6332+0+0 (secure 0 0 0) 0x7f7d3c0834f0 con 0x7f7d4c06cf80 2023-07-06T21:57:15.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.180+0000 7f7d511c2640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f7d300663a0 0x7f7d30068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.180+0000 7f7d511c2640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f7d300663a0 0x7f7d30068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c14bae0 tx=0x7f7d48008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:15.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.184+0000 7f7d41ffb640 1 -- 172.21.15.55:0/2354143590 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d3c050760 con 0x7f7d4c06cf80 2023-07-06T21:57:15.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.340+0000 7f7d53426640 1 -- 172.21.15.55:0/2354143590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7d4c066d60 con 0x7f7d4c06cf80 2023-07-06T21:57:15.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.344+0000 7f7d41ffb640 1 -- 172.21.15.55:0/2354143590 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7d3c053d80 con 0x7f7d4c06cf80 2023-07-06T21:57:15.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.348+0000 7f7d53426640 1 -- 172.21.15.55:0/2354143590 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f7d300663a0 msgr2=0x7f7d30068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.348+0000 7f7d53426640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f7d300663a0 0x7f7d30068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c14bae0 tx=0x7f7d48008040 comp rx=0 tx=0).stop 2023-07-06T21:57:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.348+0000 7f7d53426640 1 -- 172.21.15.55:0/2354143590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c06cf80 msgr2=0x7f7d4c158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.348+0000 7f7d53426640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c06cf80 0x7f7d4c158540 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00c4d0 tx=0x7f7d3c00c990 comp rx=0 tx=0).stop 2023-07-06T21:57:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.348+0000 7f7d53426640 1 -- 172.21.15.55:0/2354143590 shutdown_connections 2023-07-06T21:57:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.348+0000 7f7d53426640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f7d300663a0 0x7f7d30068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.348+0000 7f7d53426640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d4c0ce220 0x7f7d4c14bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.348+0000 7f7d53426640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c06cf80 0x7f7d4c158540 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.348+0000 7f7d53426640 1 --2- 172.21.15.55:0/2354143590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d4c06ca30 0x7f7d4c14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.348+0000 7f7d53426640 1 -- 172.21.15.55:0/2354143590 >> 172.21.15.55:0/2354143590 conn(0x7f7d4c0cbd70 msgr2=0x7f7d4c0c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:15.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.348+0000 7f7d53426640 1 -- 172.21.15.55:0/2354143590 shutdown_connections 2023-07-06T21:57:15.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.348+0000 7f7d53426640 1 -- 172.21.15.55:0/2354143590 wait complete. 2023-07-06T21:57:15.365 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-06T21:57:15.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.512+0000 7f145d093640 1 Processor -- start 2023-07-06T21:57:15.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.512+0000 7f145d093640 1 -- start start 2023-07-06T21:57:15.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.512+0000 7f145d093640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1458070d70 0x7f14580b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.512+0000 7f145d093640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f14580b1170 0x7f145806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.512+0000 7f145d093640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14580cc030 con 0x7f14580709a0 2023-07-06T21:57:15.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.512+0000 7f145d093640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14580b15f0 con 0x7f14580b1170 2023-07-06T21:57:15.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.512+0000 7f145d093640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14580cc300 con 0x7f1458070d70 2023-07-06T21:57:15.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.512+0000 7f1456d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f14580709a0 0x7f14580cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38412/0 (socket says 172.21.15.55:38412) 2023-07-06T21:57:15.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.512+0000 7f1456d9d640 1 -- 172.21.15.55:0/1324266251 learned_addr learned my addr 172.21.15.55:0/1324266251 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:15.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.516+0000 7f145759e640 1 --2- 172.21.15.55:0/1324266251 >> v2:172.21.15.138:3300/0 conn(0x7f14580b1170 0x7f145806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.516+0000 7f145659c640 1 --2- 172.21.15.55:0/1324266251 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1458070d70 0x7f14580b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.516+0000 7f1455d9b640 1 -- 172.21.15.55:0/1324266251 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489264164 0 0) 0x7f14580cc030 con 0x7f14580709a0 2023-07-06T21:57:15.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.516+0000 7f1455d9b640 1 -- 172.21.15.55:0/1324266251 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1440003530 con 0x7f14580709a0 2023-07-06T21:57:15.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.516+0000 7f1455d9b640 1 -- 172.21.15.55:0/1324266251 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2896994158 0 0) 0x7f1440003530 con 0x7f14580709a0 2023-07-06T21:57:15.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.516+0000 7f145659c640 1 -- 172.21.15.55:0/1324266251 >> v2:172.21.15.138:3300/0 conn(0x7f14580b1170 msgr2=0x7f145806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:15.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.516+0000 7f145659c640 1 --2- 172.21.15.55:0/1324266251 >> v2:172.21.15.138:3300/0 conn(0x7f14580b1170 0x7f145806eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.516+0000 7f145659c640 1 -- 172.21.15.55:0/1324266251 >> v1:172.21.15.55:6789/0 conn(0x7f14580709a0 legacy=0x7f14580cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.516+0000 7f145659c640 1 -- 172.21.15.55:0/1324266251 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14580cc5e0 con 0x7f1458070d70 2023-07-06T21:57:15.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.516+0000 7f145659c640 1 --2- 172.21.15.55:0/1324266251 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1458070d70 0x7f14580b0c30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f144c0097f0 tx=0x7f144c01c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d9faa4e444dc63b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:15.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.516+0000 7f1455d9b640 1 -- 172.21.15.55:0/1324266251 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448001680 con 0x7f1458070d70 2023-07-06T21:57:15.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.516+0000 7f1455d9b640 1 -- 172.21.15.55:0/1324266251 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c0a7050 con 0x7f1458070d70 2023-07-06T21:57:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.516+0000 7f1455d9b640 1 -- 172.21.15.55:0/1324266251 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c0ab620 con 0x7f1458070d70 2023-07-06T21:57:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 -- 172.21.15.55:0/1324266251 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1458070d70 msgr2=0x7f14580b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 --2- 172.21.15.55:0/1324266251 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1458070d70 0x7f14580b0c30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f144c0097f0 tx=0x7f144c01c310 comp rx=0 tx=0).stop 2023-07-06T21:57:15.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 -- 172.21.15.55:0/1324266251 shutdown_connections 2023-07-06T21:57:15.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 --2- 172.21.15.55:0/1324266251 >> v2:172.21.15.138:3300/0 conn(0x7f14580b1170 0x7f145806eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 --2- 172.21.15.55:0/1324266251 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1458070d70 0x7f14580b0c30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 -- 172.21.15.55:0/1324266251 >> 172.21.15.55:0/1324266251 conn(0x7f14580cea70 msgr2=0x7f14580ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:15.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 -- 172.21.15.55:0/1324266251 shutdown_connections 2023-07-06T21:57:15.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 -- 172.21.15.55:0/1324266251 wait complete. 2023-07-06T21:57:15.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 Processor -- start 2023-07-06T21:57:15.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 -- start start 2023-07-06T21:57:15.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14580709a0 0x7f14580c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1458070d70 0x7f14580acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14580b1170 0x7f1458153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14580ad070 con 0x7f14580b1170 2023-07-06T21:57:15.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1458159550 con 0x7f14580709a0 2023-07-06T21:57:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145d093640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1458158c20 con 0x7f1458070d70 2023-07-06T21:57:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14580b1170 0x7f1458153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14580b1170 0x7f1458153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56366/0 (socket says 172.21.15.55:56366) 2023-07-06T21:57:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.520+0000 7f145759e640 1 -- 172.21.15.55:0/3753056460 learned_addr learned my addr 172.21.15.55:0/3753056460 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:15.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f145659c640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1458070d70 0x7f14580acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f1456d9d640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14580709a0 0x7f14580c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f145759e640 1 -- 172.21.15.55:0/3753056460 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1458070d70 msgr2=0x7f14580acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f145759e640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1458070d70 0x7f14580acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f145759e640 1 -- 172.21.15.55:0/3753056460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14580709a0 msgr2=0x7f14580c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f145759e640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14580709a0 0x7f14580c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f145759e640 1 -- 172.21.15.55:0/3753056460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c009420 con 0x7f14580b1170 2023-07-06T21:57:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f145659c640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1458070d70 0x7f14580acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f145759e640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14580b1170 0x7f1458153a50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f145000efc0 tx=0x7f145000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f143f7fe640 1 -- 172.21.15.55:0/3753056460 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450009ba0 con 0x7f14580b1170 2023-07-06T21:57:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f143f7fe640 1 -- 172.21.15.55:0/3753056460 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145000f040 con 0x7f14580b1170 2023-07-06T21:57:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f143f7fe640 1 -- 172.21.15.55:0/3753056460 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14500146c0 con 0x7f14580b1170 2023-07-06T21:57:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f145d093640 1 -- 172.21.15.55:0/3753056460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1458158f00 con 0x7f14580b1170 2023-07-06T21:57:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f145d093640 1 -- 172.21.15.55:0/3753056460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1458154940 con 0x7f14580b1170 2023-07-06T21:57:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f145d093640 1 -- 172.21.15.55:0/3753056460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1458151670 con 0x7f14580b1170 2023-07-06T21:57:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.524+0000 7f143f7fe640 1 -- 172.21.15.55:0/3753056460 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1450014820 con 0x7f14580b1170 2023-07-06T21:57:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.528+0000 7f143f7fe640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f14440663a0 0x7f1444068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.528+0000 7f143f7fe640 1 -- 172.21.15.55:0/3753056460 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6332+0+0 (secure 0 0 0) 0x7f1450084c50 con 0x7f14580b1170 2023-07-06T21:57:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.528+0000 7f1456d9d640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f14440663a0 0x7f1444068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.528+0000 7f1456d9d640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f14440663a0 0x7f1444068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14480011f0 tx=0x7f1448009040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:15.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.532+0000 7f143f7fe640 1 -- 172.21.15.55:0/3753056460 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1458151670 con 0x7f14580b1170 2023-07-06T21:57:15.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.684+0000 7f145d093640 1 -- 172.21.15.55:0/3753056460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f1458151670 con 0x7f14580b1170 2023-07-06T21:57:15.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.692+0000 7f143f7fe640 1 -- 172.21.15.55:0/3753056460 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1458151670 con 0x7f14580b1170 2023-07-06T21:57:15.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.692+0000 7f145d093640 1 -- 172.21.15.55:0/3753056460 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f14440663a0 msgr2=0x7f1444068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.692+0000 7f145d093640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f14440663a0 0x7f1444068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14480011f0 tx=0x7f1448009040 comp rx=0 tx=0).stop 2023-07-06T21:57:15.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.692+0000 7f145d093640 1 -- 172.21.15.55:0/3753056460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14580b1170 msgr2=0x7f1458153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.692+0000 7f145d093640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14580b1170 0x7f1458153a50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f145000efc0 tx=0x7f145000c490 comp rx=0 tx=0).stop 2023-07-06T21:57:15.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.692+0000 7f145d093640 1 -- 172.21.15.55:0/3753056460 shutdown_connections 2023-07-06T21:57:15.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.692+0000 7f145d093640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f14440663a0 0x7f1444068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.692+0000 7f145d093640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14580b1170 0x7f1458153a50 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.692+0000 7f145d093640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1458070d70 0x7f14580acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.692+0000 7f145d093640 1 --2- 172.21.15.55:0/3753056460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14580709a0 0x7f14580c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.692+0000 7f145d093640 1 -- 172.21.15.55:0/3753056460 >> 172.21.15.55:0/3753056460 conn(0x7f14580cea70 msgr2=0x7f1458159800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:15.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.692+0000 7f145d093640 1 -- 172.21.15.55:0/3753056460 shutdown_connections 2023-07-06T21:57:15.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.692+0000 7f145d093640 1 -- 172.21.15.55:0/3753056460 wait complete. 2023-07-06T21:57:15.712 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-07-06T21:57:15.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.856+0000 7f0ae6448640 1 Processor -- start 2023-07-06T21:57:15.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.856+0000 7f0ae6448640 1 -- start start 2023-07-06T21:57:15.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.856+0000 7f0ae6448640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0ae015ef20 0x7f0ae006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0ae6448640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae00ccbc0 con 0x7f0ae006baf0 2023-07-06T21:57:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0ae6448640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae006bf40 con 0x7f0ae00ca820 2023-07-06T21:57:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0ae6448640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae00cac60 con 0x7f0ae015ef20 2023-07-06T21:57:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adf7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0ae006baf0 0x7f0ae00ca110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38414/0 (socket says 172.21.15.55:38414) 2023-07-06T21:57:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adf7fe640 1 -- 172.21.15.55:0/965538846 learned_addr learned my addr 172.21.15.55:0/965538846 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adffff640 1 --2- 172.21.15.55:0/965538846 >> v2:172.21.15.138:3300/0 conn(0x7f0ae015ef20 0x7f0ae006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 -- 172.21.15.55:0/965538846 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240440346 0 0) 0x7f0ae00ccbc0 con 0x7f0ae006baf0 2023-07-06T21:57:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 -- 172.21.15.55:0/965538846 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ac8003530 con 0x7f0ae006baf0 2023-07-06T21:57:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 -- 172.21.15.55:0/965538846 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 974701286 0 0) 0x7f0ac8003530 con 0x7f0ae006baf0 2023-07-06T21:57:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 -- 172.21.15.55:0/965538846 >> v2:172.21.15.138:3300/0 conn(0x7f0ae015ef20 msgr2=0x7f0ae006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 --2- 172.21.15.55:0/965538846 >> v2:172.21.15.138:3300/0 conn(0x7f0ae015ef20 0x7f0ae006b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 -- 172.21.15.55:0/965538846 >> v1:172.21.15.138:6789/0 conn(0x7f0ae00ca820 legacy=0x7f0ae00693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 -- 172.21.15.55:0/965538846 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae00cbfb0 con 0x7f0ae006baf0 2023-07-06T21:57:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 -- 172.21.15.55:0/965538846 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f0ad4001680 con 0x7f0ae006baf0 2023-07-06T21:57:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adffff640 1 --2- 172.21.15.55:0/965538846 >> v2:172.21.15.138:3300/0 conn(0x7f0ae015ef20 0x7f0ae006b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 -- 172.21.15.55:0/965538846 >> v1:172.21.15.55:6789/0 conn(0x7f0ae006baf0 legacy=0x7f0ae00ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 --2- 172.21.15.55:0/965538846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ac8003980 0x7f0ac8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 --2- 172.21.15.55:0/965538846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac8004370 0x7f0ac8004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 --2- 172.21.15.55:0/965538846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ac8005030 0x7f0ac800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 -- 172.21.15.55:0/965538846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae00cac60 con 0x7f0ac8004370 2023-07-06T21:57:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 -- 172.21.15.55:0/965538846 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac800bf80 con 0x7f0ac8003980 2023-07-06T21:57:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adeffd640 1 -- 172.21.15.55:0/965538846 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac800c140 con 0x7f0ac8005030 2023-07-06T21:57:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adf7fe640 1 --2- 172.21.15.55:0/965538846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac8004370 0x7f0ac8004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adffff640 1 --2- 172.21.15.55:0/965538846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ac8003980 0x7f0ac8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0ae49e5640 1 --2- 172.21.15.55:0/965538846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ac8005030 0x7f0ac800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adf7fe640 1 -- 172.21.15.55:0/965538846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ac8005030 msgr2=0x7f0ac800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adf7fe640 1 --2- 172.21.15.55:0/965538846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ac8005030 0x7f0ac800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adf7fe640 1 -- 172.21.15.55:0/965538846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ac8003980 msgr2=0x7f0ac8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adf7fe640 1 --2- 172.21.15.55:0/965538846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ac8003980 0x7f0ac8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0adf7fe640 1 -- 172.21.15.55:0/965538846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8003530 con 0x7f0ac8004370 2023-07-06T21:57:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.860+0000 7f0ae49e5640 1 -- 172.21.15.55:0/965538846 reap_dead start 2023-07-06T21:57:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.864+0000 7f0adf7fe640 1 --2- 172.21.15.55:0/965538846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac8004370 0x7f0ac8004830 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400c1c0 tx=0x7f0ad401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04553b88de4f28b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.864+0000 7f0adeffd640 1 -- 172.21.15.55:0/965538846 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4005ae0 con 0x7f0ac8004370 2023-07-06T21:57:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.864+0000 7f0adeffd640 1 -- 172.21.15.55:0/965538846 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad4005c40 con 0x7f0ac8004370 2023-07-06T21:57:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.864+0000 7f0adeffd640 1 -- 172.21.15.55:0/965538846 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4007070 con 0x7f0ac8004370 2023-07-06T21:57:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.864+0000 7f0ae6448640 1 -- 172.21.15.55:0/965538846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac8004370 msgr2=0x7f0ac8004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.864+0000 7f0ae6448640 1 --2- 172.21.15.55:0/965538846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac8004370 0x7f0ac8004830 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400c1c0 tx=0x7f0ad401cbe0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.864+0000 7f0ae6448640 1 -- 172.21.15.55:0/965538846 shutdown_connections 2023-07-06T21:57:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.864+0000 7f0ae6448640 1 --2- 172.21.15.55:0/965538846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac8004370 0x7f0ac8004830 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.864+0000 7f0ae6448640 1 -- 172.21.15.55:0/965538846 >> 172.21.15.55:0/965538846 conn(0x7f0ae00ce340 msgr2=0x7f0ae00ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.864+0000 7f0ae6448640 1 -- 172.21.15.55:0/965538846 shutdown_connections 2023-07-06T21:57:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.864+0000 7f0ae6448640 1 -- 172.21.15.55:0/965538846 wait complete. 2023-07-06T21:57:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.864+0000 7f0ae6448640 1 Processor -- start 2023-07-06T21:57:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae6448640 1 -- start start 2023-07-06T21:57:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae6448640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ac8004370 0x7f0ae01f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae6448640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ae01f7430 0x7f0ae01f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae6448640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae00ac9f0 0x7f0ae00ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae6448640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae01f78a0 con 0x7f0ae00ac9f0 2023-07-06T21:57:15.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae6448640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae00ad3a0 con 0x7f0ae01f7430 2023-07-06T21:57:15.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae6448640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae01f5470 con 0x7f0ac8004370 2023-07-06T21:57:15.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae49e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae00ac9f0 0x7f0ae00ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae49e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae00ac9f0 0x7f0ae00ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56392/0 (socket says 172.21.15.55:56392) 2023-07-06T21:57:15.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae49e5640 1 -- 172.21.15.55:0/2770293931 learned_addr learned my addr 172.21.15.55:0/2770293931 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:15.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0adffff640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ac8004370 0x7f0ae01f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0adf7fe640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ae01f7430 0x7f0ae01f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae49e5640 1 -- 172.21.15.55:0/2770293931 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ac8004370 msgr2=0x7f0ae01f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae49e5640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ac8004370 0x7f0ae01f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae49e5640 1 -- 172.21.15.55:0/2770293931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ae01f7430 msgr2=0x7f0ae01f4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae49e5640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ae01f7430 0x7f0ae01f4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae49e5640 1 -- 172.21.15.55:0/2770293931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae00b3180 con 0x7f0ae00ac9f0 2023-07-06T21:57:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0adf7fe640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ae01f7430 0x7f0ae01f4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.868+0000 7f0ae49e5640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae00ac9f0 0x7f0ae00ace60 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00adde0 tx=0x7f0ad800fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.872+0000 7f0adcff9640 1 -- 172.21.15.55:0/2770293931 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8006d70 con 0x7f0ae00ac9f0 2023-07-06T21:57:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.872+0000 7f0ae6448640 1 -- 172.21.15.55:0/2770293931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae00b2600 con 0x7f0ae00ac9f0 2023-07-06T21:57:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.872+0000 7f0adcff9640 1 -- 172.21.15.55:0/2770293931 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad8003980 con 0x7f0ae00ac9f0 2023-07-06T21:57:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.872+0000 7f0adcff9640 1 -- 172.21.15.55:0/2770293931 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8003d30 con 0x7f0ae00ac9f0 2023-07-06T21:57:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.872+0000 7f0ae6448640 1 -- 172.21.15.55:0/2770293931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae00b2bc0 con 0x7f0ae00ac9f0 2023-07-06T21:57:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.872+0000 7f0ae6448640 1 -- 172.21.15.55:0/2770293931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae00c8f70 con 0x7f0ae00ac9f0 2023-07-06T21:57:15.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.872+0000 7f0adcff9640 1 -- 172.21.15.55:0/2770293931 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0ad80050d0 con 0x7f0ae00ac9f0 2023-07-06T21:57:15.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.872+0000 7f0adcff9640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f0acc0663d0 0x7f0acc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.872+0000 7f0adcff9640 1 -- 172.21.15.55:0/2770293931 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6332+0+0 (secure 0 0 0) 0x7f0ad8082d20 con 0x7f0ae00ac9f0 2023-07-06T21:57:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.872+0000 7f0adffff640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f0acc0663d0 0x7f0acc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.876+0000 7f0adffff640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f0acc0663d0 0x7f0acc068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0ae004eaa0 tx=0x7f0ad0009190 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:15.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:15.876+0000 7f0adcff9640 1 -- 172.21.15.55:0/2770293931 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ad8050020 con 0x7f0ae00ac9f0 2023-07-06T21:57:16.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:16.088+0000 7f0ae6448640 1 -- 172.21.15.55:0/2770293931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f0ae00c6aa0 con 0x7f0ae00ac9f0 2023-07-06T21:57:16.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:16.872+0000 7f0adcff9640 1 -- 172.21.15.55:0/2770293931 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v557) v1 ==== 154+0+0 (secure 0 0 0) 0x7f0ae00c6aa0 con 0x7f0ae00ac9f0 2023-07-06T21:57:16.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:16.876+0000 7f0ae6448640 1 -- 172.21.15.55:0/2770293931 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f0acc0663d0 msgr2=0x7f0acc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:16.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:16.876+0000 7f0ae6448640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f0acc0663d0 0x7f0acc068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0ae004eaa0 tx=0x7f0ad0009190 comp rx=0 tx=0).stop 2023-07-06T21:57:16.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:16.876+0000 7f0ae6448640 1 -- 172.21.15.55:0/2770293931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae00ac9f0 msgr2=0x7f0ae00ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:16.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:16.876+0000 7f0ae6448640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae00ac9f0 0x7f0ae00ace60 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00adde0 tx=0x7f0ad800fba0 comp rx=0 tx=0).stop 2023-07-06T21:57:16.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:16.876+0000 7f0ae6448640 1 -- 172.21.15.55:0/2770293931 shutdown_connections 2023-07-06T21:57:16.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:16.876+0000 7f0ae6448640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f0acc0663d0 0x7f0acc068880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:16.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:16.876+0000 7f0ae6448640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae00ac9f0 0x7f0ae00ace60 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:16.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:16.876+0000 7f0ae6448640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ae01f7430 0x7f0ae01f4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:16.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:16.876+0000 7f0ae6448640 1 --2- 172.21.15.55:0/2770293931 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ac8004370 0x7f0ae01f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:16.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:16.876+0000 7f0ae6448640 1 -- 172.21.15.55:0/2770293931 >> 172.21.15.55:0/2770293931 conn(0x7f0ae00ce340 msgr2=0x7f0ae00693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:16.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:16.876+0000 7f0ae6448640 1 -- 172.21.15.55:0/2770293931 shutdown_connections 2023-07-06T21:57:16.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:16.876+0000 7f0ae6448640 1 -- 172.21.15.55:0/2770293931 wait complete. 2023-07-06T21:57:16.898 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-07-06T21:57:16.899 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-07-06T21:57:16.899 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-06T21:57:16.899 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-07-06T21:57:17.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.048+0000 7f2378737640 1 Processor -- start 2023-07-06T21:57:17.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.048+0000 7f2378737640 1 -- start start 2023-07-06T21:57:17.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f2378737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23700ca450 0x7f237006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:17.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f2378737640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23700b3730 0x7f237015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:17.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f2378737640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2370159cd0 con 0x7f23700712f0 2023-07-06T21:57:17.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f2378737640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23700693f0 con 0x7f23700b3730 2023-07-06T21:57:17.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f2378737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237006aca0 con 0x7f23700ca450 2023-07-06T21:57:17.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f23764d3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f23700712f0 0x7f23700c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38430/0 (socket says 172.21.15.55:38430) 2023-07-06T21:57:17.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f23764d3640 1 -- 172.21.15.55:0/1980965286 learned_addr learned my addr 172.21.15.55:0/1980965286 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:17.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f2376cd4640 1 --2- 172.21.15.55:0/1980965286 >> v2:172.21.15.55:3300/0 conn(0x7f23700b3730 0x7f237015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:17.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f2376cd4640 1 -- 172.21.15.55:0/1980965286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23700ca450 msgr2=0x7f237006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:17.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f2376cd4640 1 --2- 172.21.15.55:0/1980965286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23700ca450 0x7f237006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:17.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f2376cd4640 1 -- 172.21.15.55:0/1980965286 >> v1:172.21.15.55:6789/0 conn(0x7f23700712f0 legacy=0x7f23700c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:17.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f2376cd4640 1 -- 172.21.15.55:0/1980965286 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23700696b0 con 0x7f23700b3730 2023-07-06T21:57:17.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f23754d1640 1 -- 172.21.15.55:0/1980965286 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396975035 0 0) 0x7f2370159cd0 con 0x7f23700712f0 2023-07-06T21:57:17.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f2376cd4640 1 --2- 172.21.15.55:0/1980965286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23700b3730 0x7f237015d3e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f2368009d90 tx=0x7f236801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12dd4ca7b23233eb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:17.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f23754d1640 1 -- 172.21.15.55:0/1980965286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23680a59e0 con 0x7f23700b3730 2023-07-06T21:57:17.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f23754d1640 1 -- 172.21.15.55:0/1980965286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23680a5b40 con 0x7f23700b3730 2023-07-06T21:57:17.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.052+0000 7f23754d1640 1 -- 172.21.15.55:0/1980965286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23680ad440 con 0x7f23700b3730 2023-07-06T21:57:17.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 -- 172.21.15.55:0/1980965286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23700b3730 msgr2=0x7f237015d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:17.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 --2- 172.21.15.55:0/1980965286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23700b3730 0x7f237015d3e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f2368009d90 tx=0x7f236801c920 comp rx=0 tx=0).stop 2023-07-06T21:57:17.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 -- 172.21.15.55:0/1980965286 shutdown_connections 2023-07-06T21:57:17.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 --2- 172.21.15.55:0/1980965286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23700ca450 0x7f237006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:17.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 --2- 172.21.15.55:0/1980965286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23700b3730 0x7f237015d3e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:17.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 -- 172.21.15.55:0/1980965286 >> 172.21.15.55:0/1980965286 conn(0x7f23700cded0 msgr2=0x7f23700ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:17.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 -- 172.21.15.55:0/1980965286 shutdown_connections 2023-07-06T21:57:17.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 -- 172.21.15.55:0/1980965286 wait complete. 2023-07-06T21:57:17.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 Processor -- start 2023-07-06T21:57:17.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 -- start start 2023-07-06T21:57:17.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23700712f0 0x7f237014e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:17.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23700b3730 0x7f2370147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:17.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23700ca450 0x7f2370147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:17.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23700abeb0 con 0x7f23700ca450 2023-07-06T21:57:17.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2370150ea0 con 0x7f23700712f0 2023-07-06T21:57:17.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2378737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2370151180 con 0x7f23700b3730 2023-07-06T21:57:17.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2376cd4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23700ca450 0x7f2370147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:17.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2376cd4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23700ca450 0x7f2370147d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56406/0 (socket says 172.21.15.55:56406) 2023-07-06T21:57:17.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.056+0000 7f2376cd4640 1 -- 172.21.15.55:0/1827779843 learned_addr learned my addr 172.21.15.55:0/1827779843 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:17.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2375cd2640 1 --2- 172.21.15.55:0/1827779843 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23700b3730 0x7f2370147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2376cd4640 1 -- 172.21.15.55:0/1827779843 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23700b3730 msgr2=0x7f2370147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2376cd4640 1 --2- 172.21.15.55:0/1827779843 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23700b3730 0x7f2370147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2376cd4640 1 -- 172.21.15.55:0/1827779843 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23700712f0 msgr2=0x7f237014e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2376cd4640 1 --2- 172.21.15.55:0/1827779843 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23700712f0 0x7f237014e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2376cd4640 1 -- 172.21.15.55:0/1827779843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2368009a70 con 0x7f23700ca450 2023-07-06T21:57:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2375cd2640 1 --2- 172.21.15.55:0/1827779843 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23700b3730 0x7f2370147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2376cd4640 1 --2- 172.21.15.55:0/1827779843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23700ca450 0x7f2370147d40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f236801afd0 tx=0x7f23680196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2366ffd640 1 -- 172.21.15.55:0/1827779843 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23680addc0 con 0x7f23700ca450 2023-07-06T21:57:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2366ffd640 1 -- 172.21.15.55:0/1827779843 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23680b9450 con 0x7f23700ca450 2023-07-06T21:57:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2366ffd640 1 -- 172.21.15.55:0/1827779843 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23680b97e0 con 0x7f23700ca450 2023-07-06T21:57:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2378737640 1 -- 172.21.15.55:0/1827779843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2370151460 con 0x7f23700ca450 2023-07-06T21:57:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2378737640 1 -- 172.21.15.55:0/1827779843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237014ee80 con 0x7f23700ca450 2023-07-06T21:57:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2378737640 1 -- 172.21.15.55:0/1827779843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237014f130 con 0x7f23700ca450 2023-07-06T21:57:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.060+0000 7f2366ffd640 1 -- 172.21.15.55:0/1827779843 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f23680b9940 con 0x7f23700ca450 2023-07-06T21:57:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.064+0000 7f2366ffd640 1 --2- 172.21.15.55:0/1827779843 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f23540663a0 0x7f2354068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:17.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.064+0000 7f2366ffd640 1 -- 172.21.15.55:0/1827779843 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6332+0+0 (secure 0 0 0) 0x7f236811f8d0 con 0x7f23700ca450 2023-07-06T21:57:17.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.064+0000 7f23764d3640 1 --2- 172.21.15.55:0/1827779843 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f23540663a0 0x7f2354068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:17.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.064+0000 7f23764d3640 1 --2- 172.21.15.55:0/1827779843 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f23540663a0 0x7f2354068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f236c0015a0 tx=0x7f236c007970 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.064+0000 7f2366ffd640 1 -- 172.21.15.55:0/1827779843 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f23680ecc40 con 0x7f23700ca450 2023-07-06T21:57:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.276+0000 7f2378737640 1 -- 172.21.15.55:0/1827779843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f23700b3e00 con 0x7f23700ca450 2023-07-06T21:57:17.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.884+0000 7f2366ffd640 1 -- 172.21.15.55:0/1827779843 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v558) v1 ==== 159+0+0 (secure 0 0 0) 0x7f23680f0260 con 0x7f23700ca450 2023-07-06T21:57:17.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.888+0000 7f2378737640 1 -- 172.21.15.55:0/1827779843 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f23540663a0 msgr2=0x7f2354068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:17.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.888+0000 7f2378737640 1 --2- 172.21.15.55:0/1827779843 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f23540663a0 0x7f2354068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f236c0015a0 tx=0x7f236c007970 comp rx=0 tx=0).stop 2023-07-06T21:57:17.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.888+0000 7f2378737640 1 -- 172.21.15.55:0/1827779843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23700ca450 msgr2=0x7f2370147d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:17.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.888+0000 7f2378737640 1 --2- 172.21.15.55:0/1827779843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23700ca450 0x7f2370147d40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f236801afd0 tx=0x7f23680196c0 comp rx=0 tx=0).stop 2023-07-06T21:57:17.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.888+0000 7f2378737640 1 -- 172.21.15.55:0/1827779843 shutdown_connections 2023-07-06T21:57:17.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.888+0000 7f2378737640 1 --2- 172.21.15.55:0/1827779843 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f23540663a0 0x7f2354068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:17.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.888+0000 7f2378737640 1 --2- 172.21.15.55:0/1827779843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23700ca450 0x7f2370147d40 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:17.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.888+0000 7f2378737640 1 --2- 172.21.15.55:0/1827779843 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23700b3730 0x7f2370147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:17.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.888+0000 7f2378737640 1 --2- 172.21.15.55:0/1827779843 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23700712f0 0x7f237014e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:17.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.888+0000 7f2378737640 1 -- 172.21.15.55:0/1827779843 >> 172.21.15.55:0/1827779843 conn(0x7f23700cded0 msgr2=0x7f23700b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:17.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.888+0000 7f2378737640 1 -- 172.21.15.55:0/1827779843 shutdown_connections 2023-07-06T21:57:17.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:17.888+0000 7f2378737640 1 -- 172.21.15.55:0/1827779843 wait complete. 2023-07-06T21:57:17.907 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:18.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98d6340640 1 Processor -- start 2023-07-06T21:57:18.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98d6340640 1 -- start start 2023-07-06T21:57:18.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98d6340640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f98d00ce610 0x7f98d00b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98d6340640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d00cd1c0 con 0x7f98d00b1e10 2023-07-06T21:57:18.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98d6340640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d00b2270 con 0x7f98d00b7cd0 2023-07-06T21:57:18.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98d6340640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d00d2310 con 0x7f98d00ce610 2023-07-06T21:57:18.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98d48dd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f98d00b1e10 0x7f98d015f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38442/0 (socket says 172.21.15.55:38442) 2023-07-06T21:57:18.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98d48dd640 1 -- 172.21.15.55:0/1750220895 learned_addr learned my addr 172.21.15.55:0/1750220895 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:18.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98cf7fe640 1 --2- 172.21.15.55:0/1750220895 >> v2:172.21.15.138:3300/0 conn(0x7f98d00ce610 0x7f98d00b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98ceffd640 1 -- 172.21.15.55:0/1750220895 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113706597 0 0) 0x7f98d00cd1c0 con 0x7f98d00b1e10 2023-07-06T21:57:18.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98ceffd640 1 -- 172.21.15.55:0/1750220895 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98b8003530 con 0x7f98d00b1e10 2023-07-06T21:57:18.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98cf7fe640 1 -- 172.21.15.55:0/1750220895 >> v1:172.21.15.138:6789/0 conn(0x7f98d00b7cd0 legacy=0x7f98d00ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98ceffd640 1 -- 172.21.15.55:0/1750220895 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209595832 0 0) 0x7f98d00b2270 con 0x7f98d00b7cd0 2023-07-06T21:57:18.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98cf7fe640 1 -- 172.21.15.55:0/1750220895 >> v1:172.21.15.55:6789/0 conn(0x7f98d00b1e10 legacy=0x7f98d015f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.056+0000 7f98cf7fe640 1 -- 172.21.15.55:0/1750220895 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d00cecf0 con 0x7f98d00ce610 2023-07-06T21:57:18.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.060+0000 7f98cf7fe640 1 --2- 172.21.15.55:0/1750220895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98d00ce610 0x7f98d00b18d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f98c40097c0 tx=0x7f98c401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9776e64ba0399b3b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:18.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.060+0000 7f98ceffd640 1 -- 172.21.15.55:0/1750220895 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c40ab600 con 0x7f98d00ce610 2023-07-06T21:57:18.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.060+0000 7f98ceffd640 1 -- 172.21.15.55:0/1750220895 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c40a7050 con 0x7f98d00ce610 2023-07-06T21:57:18.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.060+0000 7f98ceffd640 1 -- 172.21.15.55:0/1750220895 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c40ab980 con 0x7f98d00ce610 2023-07-06T21:57:18.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.060+0000 7f98d6340640 1 -- 172.21.15.55:0/1750220895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98d00ce610 msgr2=0x7f98d00b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.060+0000 7f98d6340640 1 --2- 172.21.15.55:0/1750220895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98d00ce610 0x7f98d00b18d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f98c40097c0 tx=0x7f98c401c3f0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.060+0000 7f98d6340640 1 -- 172.21.15.55:0/1750220895 shutdown_connections 2023-07-06T21:57:18.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.060+0000 7f98d6340640 1 --2- 172.21.15.55:0/1750220895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98d00ce610 0x7f98d00b18d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.060+0000 7f98d6340640 1 -- 172.21.15.55:0/1750220895 >> 172.21.15.55:0/1750220895 conn(0x7f98d00ceee0 msgr2=0x7f98d00cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:18.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.060+0000 7f98d6340640 1 -- 172.21.15.55:0/1750220895 shutdown_connections 2023-07-06T21:57:18.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.060+0000 7f98d6340640 1 -- 172.21.15.55:0/1750220895 wait complete. 2023-07-06T21:57:18.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98d6340640 1 Processor -- start 2023-07-06T21:57:18.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98d6340640 1 -- start start 2023-07-06T21:57:18.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98d6340640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98d00b1e10 0x7f98d01f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98d6340640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d00b7cd0 0x7f98d01fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98d6340640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98d00ce610 0x7f98d01517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98d6340640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d01f9200 con 0x7f98d00b7cd0 2023-07-06T21:57:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98d6340640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d00cfc30 con 0x7f98d00ce610 2023-07-06T21:57:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98d6340640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d01f8730 con 0x7f98d00b1e10 2023-07-06T21:57:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98cf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d00b7cd0 0x7f98d01fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98cf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d00b7cd0 0x7f98d01fbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56422/0 (socket says 172.21.15.55:56422) 2023-07-06T21:57:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98cf7fe640 1 -- 172.21.15.55:0/2077252077 learned_addr learned my addr 172.21.15.55:0/2077252077 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:18.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98cf7fe640 1 -- 172.21.15.55:0/2077252077 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98d00b1e10 msgr2=0x7f98d01f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98cf7fe640 1 --2- 172.21.15.55:0/2077252077 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98d00b1e10 0x7f98d01f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98cf7fe640 1 -- 172.21.15.55:0/2077252077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98d00ce610 msgr2=0x7f98d01517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98cf7fe640 1 --2- 172.21.15.55:0/2077252077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98d00ce610 0x7f98d01517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98cf7fe640 1 -- 172.21.15.55:0/2077252077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c4009420 con 0x7f98d00b7cd0 2023-07-06T21:57:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98cf7fe640 1 --2- 172.21.15.55:0/2077252077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d00b7cd0 0x7f98d01fbea0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f98c40ae040 tx=0x7f98c4019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98ccff9640 1 -- 172.21.15.55:0/2077252077 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4004020 con 0x7f98d00b7cd0 2023-07-06T21:57:18.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98ccff9640 1 -- 172.21.15.55:0/2077252077 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c4004180 con 0x7f98d00b7cd0 2023-07-06T21:57:18.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98ccff9640 1 -- 172.21.15.55:0/2077252077 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c40044f0 con 0x7f98d00b7cd0 2023-07-06T21:57:18.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.064+0000 7f98d6340640 1 -- 172.21.15.55:0/2077252077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d01fba10 con 0x7f98d00b7cd0 2023-07-06T21:57:18.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.068+0000 7f98d6340640 1 -- 172.21.15.55:0/2077252077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d01f8c40 con 0x7f98d00b7cd0 2023-07-06T21:57:18.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.068+0000 7f98d6340640 1 -- 172.21.15.55:0/2077252077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d01fb7e0 con 0x7f98d00b7cd0 2023-07-06T21:57:18.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.068+0000 7f98ccff9640 1 -- 172.21.15.55:0/2077252077 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f98c40b2040 con 0x7f98d00b7cd0 2023-07-06T21:57:18.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.068+0000 7f98ccff9640 1 --2- 172.21.15.55:0/2077252077 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f98bc0663a0 0x7f98bc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.068+0000 7f98ccff9640 1 -- 172.21.15.55:0/2077252077 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6332+0+0 (secure 0 0 0) 0x7f98c411dea0 con 0x7f98d00b7cd0 2023-07-06T21:57:18.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.068+0000 7f98cffff640 1 --2- 172.21.15.55:0/2077252077 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f98bc0663a0 0x7f98bc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.068+0000 7f98cffff640 1 --2- 172.21.15.55:0/2077252077 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f98bc0663a0 0x7f98bc068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f98c0007fd0 tx=0x7f98c0007920 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:18.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.072+0000 7f98ccff9640 1 -- 172.21.15.55:0/2077252077 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98d01fb7e0 con 0x7f98d00b7cd0 2023-07-06T21:57:18.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.228+0000 7f98d6340640 1 -- 172.21.15.55:0/2077252077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98d0160790 con 0x7f98d00b7cd0 2023-07-06T21:57:18.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.228+0000 7f98ccff9640 1 -- 172.21.15.55:0/2077252077 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16008 (secure 0 0 0) 0x7f98d0160790 con 0x7f98d00b7cd0 2023-07-06T21:57:18.228 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:18.228 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":80,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:57:14.626581+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.138:6834/2595020915":"2023-07-07T21:57:10.685296+0000","172.21.15.138:6832/2595020915":"2023-07-07T21:57:10.685296+0000","172.21.15.55:0/2257395431":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/1561392865":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/1366713285":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/3291736307":"2023-07-07T21:57:07.820341+0000","172.21.15.55:6832/3229281422":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/1763014168":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/827601659":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/3134202503":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/3057904124":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/3677020920":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/1723719878":"2023-07-07T21:55:20.576434+0000","172.21.15.55:6833/3843972996":"2023-07-07T21:55:20.576434+0000","172.21.15.55:6832/3843972996":"2023-07-07T21:55:20.576434+0000","172.21.15.55:0/2622666608":"2023-07-07T21:55:20.576434+0000","172.21.15.55:6833/3229281422":"2023-07-07T21:57:07.820341+0000","172.21.15.55:0/457725185":"2023-07-07T21:55:20.576434+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":9,"snaps":[{"begin":2,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:18.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.232+0000 7f98d6340640 1 -- 172.21.15.55:0/2077252077 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f98bc0663a0 msgr2=0x7f98bc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.232+0000 7f98d6340640 1 --2- 172.21.15.55:0/2077252077 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f98bc0663a0 0x7f98bc068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f98c0007fd0 tx=0x7f98c0007920 comp rx=0 tx=0).stop 2023-07-06T21:57:18.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.232+0000 7f98d6340640 1 -- 172.21.15.55:0/2077252077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d00b7cd0 msgr2=0x7f98d01fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.232+0000 7f98d6340640 1 --2- 172.21.15.55:0/2077252077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d00b7cd0 0x7f98d01fbea0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f98c40ae040 tx=0x7f98c4019190 comp rx=0 tx=0).stop 2023-07-06T21:57:18.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.232+0000 7f98d6340640 1 -- 172.21.15.55:0/2077252077 shutdown_connections 2023-07-06T21:57:18.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.232+0000 7f98d6340640 1 --2- 172.21.15.55:0/2077252077 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f98bc0663a0 0x7f98bc068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.232+0000 7f98d6340640 1 --2- 172.21.15.55:0/2077252077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98d00ce610 0x7f98d01517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.232+0000 7f98d6340640 1 --2- 172.21.15.55:0/2077252077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d00b7cd0 0x7f98d01fbea0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.232+0000 7f98d6340640 1 --2- 172.21.15.55:0/2077252077 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98d00b1e10 0x7f98d01f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.232+0000 7f98d6340640 1 -- 172.21.15.55:0/2077252077 >> 172.21.15.55:0/2077252077 conn(0x7f98d00ceee0 msgr2=0x7f98d006ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:18.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.232+0000 7f98d6340640 1 -- 172.21.15.55:0/2077252077 shutdown_connections 2023-07-06T21:57:18.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.232+0000 7f98d6340640 1 -- 172.21.15.55:0/2077252077 wait complete. 2023-07-06T21:57:18.249 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:57:18.250 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:57:18.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.396+0000 7f19c6dfa640 1 Processor -- start 2023-07-06T21:57:18.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.396+0000 7f19c6dfa640 1 -- start start 2023-07-06T21:57:18.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.396+0000 7f19c6dfa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f19c006fef0 0x7f19c0164820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.396+0000 7f19c6dfa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c00cc030 con 0x7f19c0070d70 2023-07-06T21:57:18.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.396+0000 7f19c6dfa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c00cc300 con 0x7f19c00709a0 2023-07-06T21:57:18.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.396+0000 7f19c6dfa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c00cc5e0 con 0x7f19c006fef0 2023-07-06T21:57:18.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.396+0000 7f19bffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f19c0070d70 0x7f19c00b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38452/0 (socket says 172.21.15.55:38452) 2023-07-06T21:57:18.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.396+0000 7f19bffff640 1 -- 172.21.15.55:0/2963665892 learned_addr learned my addr 172.21.15.55:0/2963665892 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:18.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 -- 172.21.15.55:0/2963665892 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834288370 0 0) 0x7f19c00cc030 con 0x7f19c0070d70 2023-07-06T21:57:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19c5397640 1 --2- 172.21.15.55:0/2963665892 >> v2:172.21.15.138:3300/0 conn(0x7f19c006fef0 0x7f19c0164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 -- 172.21.15.55:0/2963665892 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19b0003530 con 0x7f19c0070d70 2023-07-06T21:57:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 -- 172.21.15.55:0/2963665892 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 426368372 0 0) 0x7f19b0003530 con 0x7f19c0070d70 2023-07-06T21:57:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 -- 172.21.15.55:0/2963665892 >> v2:172.21.15.138:3300/0 conn(0x7f19c006fef0 msgr2=0x7f19c0164820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 --2- 172.21.15.55:0/2963665892 >> v2:172.21.15.138:3300/0 conn(0x7f19c006fef0 0x7f19c0164820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 -- 172.21.15.55:0/2963665892 >> v1:172.21.15.138:6789/0 conn(0x7f19c00709a0 legacy=0x7f19c00cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 -- 172.21.15.55:0/2963665892 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c00cc8c0 con 0x7f19c0070d70 2023-07-06T21:57:18.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 -- 172.21.15.55:0/2963665892 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f19ac001680 con 0x7f19c0070d70 2023-07-06T21:57:18.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 -- 172.21.15.55:0/2963665892 >> v1:172.21.15.55:6789/0 conn(0x7f19c0070d70 legacy=0x7f19c00b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 --2- 172.21.15.55:0/2963665892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19b0003980 0x7f19b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 --2- 172.21.15.55:0/2963665892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19b00047d0 0x7f19b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 --2- 172.21.15.55:0/2963665892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19b0005180 0x7f19b000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 -- 172.21.15.55:0/2963665892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00cc5e0 con 0x7f19b0003980 2023-07-06T21:57:18.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 -- 172.21.15.55:0/2963665892 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b000c110 con 0x7f19b00047d0 2023-07-06T21:57:18.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bf7fe640 1 -- 172.21.15.55:0/2963665892 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b000c2d0 con 0x7f19b0005180 2023-07-06T21:57:18.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19c5397640 1 --2- 172.21.15.55:0/2963665892 >> v2:172.21.15.138:3300/0 conn(0x7f19c006fef0 0x7f19c0164820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:18.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19c4b96640 1 --2- 172.21.15.55:0/2963665892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19b0003980 0x7f19b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19bffff640 1 --2- 172.21.15.55:0/2963665892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19b00047d0 0x7f19b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19c5397640 1 --2- 172.21.15.55:0/2963665892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19b0005180 0x7f19b000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19c4b96640 1 -- 172.21.15.55:0/2963665892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19b0005180 msgr2=0x7f19b000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:18.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19c4b96640 1 --2- 172.21.15.55:0/2963665892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19b0005180 0x7f19b000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19c4b96640 1 -- 172.21.15.55:0/2963665892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19b00047d0 msgr2=0x7f19b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:18.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19c4b96640 1 --2- 172.21.15.55:0/2963665892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19b00047d0 0x7f19b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19c4b96640 1 -- 172.21.15.55:0/2963665892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b0003530 con 0x7f19b0003980 2023-07-06T21:57:18.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19c5397640 1 --2- 172.21.15.55:0/2963665892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19b0005180 0x7f19b000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:18.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.400+0000 7f19c5397640 1 -- 172.21.15.55:0/2963665892 reap_dead start 2023-07-06T21:57:18.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c4b96640 1 --2- 172.21.15.55:0/2963665892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19b0003980 0x7f19b0003d90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f19b4001750 tx=0x7f19b401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687ca4aa7c4c8c35 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:18.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19bf7fe640 1 -- 172.21.15.55:0/2963665892 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b40052d0 con 0x7f19b0003980 2023-07-06T21:57:18.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19bf7fe640 1 -- 172.21.15.55:0/2963665892 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b40a7050 con 0x7f19b0003980 2023-07-06T21:57:18.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19bf7fe640 1 -- 172.21.15.55:0/2963665892 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4003600 con 0x7f19b0003980 2023-07-06T21:57:18.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 -- 172.21.15.55:0/2963665892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19b0003980 msgr2=0x7f19b0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 --2- 172.21.15.55:0/2963665892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19b0003980 0x7f19b0003d90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f19b4001750 tx=0x7f19b401c380 comp rx=0 tx=0).stop 2023-07-06T21:57:18.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 -- 172.21.15.55:0/2963665892 shutdown_connections 2023-07-06T21:57:18.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 --2- 172.21.15.55:0/2963665892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19b0003980 0x7f19b0003d90 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 -- 172.21.15.55:0/2963665892 >> 172.21.15.55:0/2963665892 conn(0x7f19c00cea70 msgr2=0x7f19c00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:18.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 -- 172.21.15.55:0/2963665892 shutdown_connections 2023-07-06T21:57:18.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 -- 172.21.15.55:0/2963665892 wait complete. 2023-07-06T21:57:18.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 Processor -- start 2023-07-06T21:57:18.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 -- start start 2023-07-06T21:57:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19b0003980 0x7f19c00c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19c00c0c10 0x7f19c00693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c00c1060 0x7f19c0069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c006b030 con 0x7f19c00c0c10 2023-07-06T21:57:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c006ac90 con 0x7f19b0003980 2023-07-06T21:57:18.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.404+0000 7f19c6dfa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00afef0 con 0x7f19c00c1060 2023-07-06T21:57:18.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19c00c0c10 0x7f19c00693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19c00c0c10 0x7f19c00693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56428/0 (socket says 172.21.15.55:56428) 2023-07-06T21:57:18.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19bffff640 1 -- 172.21.15.55:0/4061819308 learned_addr learned my addr 172.21.15.55:0/4061819308 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:18.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19bffff640 1 -- 172.21.15.55:0/4061819308 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c00c1060 msgr2=0x7f19c0069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19bffff640 1 --2- 172.21.15.55:0/4061819308 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c00c1060 0x7f19c0069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19c4b96640 1 --2- 172.21.15.55:0/4061819308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19b0003980 0x7f19c00c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19bffff640 1 -- 172.21.15.55:0/4061819308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19b0003980 msgr2=0x7f19c00c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19bffff640 1 --2- 172.21.15.55:0/4061819308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19b0003980 0x7f19c00c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19bffff640 1 -- 172.21.15.55:0/4061819308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c00b01d0 con 0x7f19c00c0c10 2023-07-06T21:57:18.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19c4b96640 1 --2- 172.21.15.55:0/4061819308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19b0003980 0x7f19c00c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:18.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19bffff640 1 --2- 172.21.15.55:0/4061819308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19c00c0c10 0x7f19c00693f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00e700 tx=0x7f19ac00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:18.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19bd7fa640 1 -- 172.21.15.55:0/4061819308 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac00ee10 con 0x7f19c00c0c10 2023-07-06T21:57:18.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19bd7fa640 1 -- 172.21.15.55:0/4061819308 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac00c8d0 con 0x7f19c00c0c10 2023-07-06T21:57:18.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19bd7fa640 1 -- 172.21.15.55:0/4061819308 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac00cc80 con 0x7f19c00c0c10 2023-07-06T21:57:18.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19c6dfa640 1 -- 172.21.15.55:0/4061819308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c00b04b0 con 0x7f19c00c0c10 2023-07-06T21:57:18.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19c6dfa640 1 -- 172.21.15.55:0/4061819308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c0069e70 con 0x7f19c00c0c10 2023-07-06T21:57:18.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19c6dfa640 1 -- 172.21.15.55:0/4061819308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c0066d60 con 0x7f19c00c0c10 2023-07-06T21:57:18.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.408+0000 7f19bd7fa640 1 -- 172.21.15.55:0/4061819308 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f19ac01d460 con 0x7f19c00c0c10 2023-07-06T21:57:18.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.412+0000 7f19bd7fa640 1 --2- 172.21.15.55:0/4061819308 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f19a40663a0 0x7f19a4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.412+0000 7f19bd7fa640 1 -- 172.21.15.55:0/4061819308 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6332+0+0 (secure 0 0 0) 0x7f19ac083f00 con 0x7f19c00c0c10 2023-07-06T21:57:18.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.412+0000 7f19c4b96640 1 --2- 172.21.15.55:0/4061819308 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f19a40663a0 0x7f19a4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.412+0000 7f19c4b96640 1 --2- 172.21.15.55:0/4061819308 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f19a40663a0 0x7f19a4068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f19b00057b0 tx=0x7f19b40011a0 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:18.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.412+0000 7f19bd7fa640 1 -- 172.21.15.55:0/4061819308 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19ac054c80 con 0x7f19c00c0c10 2023-07-06T21:57:18.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.568+0000 7f19c6dfa640 1 -- 172.21.15.55:0/4061819308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19c006add0 con 0x7f19c00c0c10 2023-07-06T21:57:18.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.568+0000 7f19bd7fa640 1 -- 172.21.15.55:0/4061819308 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19ac054810 con 0x7f19c00c0c10 2023-07-06T21:57:18.567 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:57:18.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.572+0000 7f19c6dfa640 1 -- 172.21.15.55:0/4061819308 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f19a40663a0 msgr2=0x7f19a4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.572+0000 7f19c6dfa640 1 --2- 172.21.15.55:0/4061819308 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f19a40663a0 0x7f19a4068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f19b00057b0 tx=0x7f19b40011a0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.572+0000 7f19c6dfa640 1 -- 172.21.15.55:0/4061819308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19c00c0c10 msgr2=0x7f19c00693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.572+0000 7f19c6dfa640 1 --2- 172.21.15.55:0/4061819308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19c00c0c10 0x7f19c00693f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00e700 tx=0x7f19ac00ebc0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.572+0000 7f19c6dfa640 1 -- 172.21.15.55:0/4061819308 shutdown_connections 2023-07-06T21:57:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.572+0000 7f19c6dfa640 1 --2- 172.21.15.55:0/4061819308 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f19a40663a0 0x7f19a4068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.572+0000 7f19c6dfa640 1 --2- 172.21.15.55:0/4061819308 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c00c1060 0x7f19c0069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.572+0000 7f19c6dfa640 1 --2- 172.21.15.55:0/4061819308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19c00c0c10 0x7f19c00693f0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.572+0000 7f19c6dfa640 1 --2- 172.21.15.55:0/4061819308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19b0003980 0x7f19c00c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.572+0000 7f19c6dfa640 1 -- 172.21.15.55:0/4061819308 >> 172.21.15.55:0/4061819308 conn(0x7f19c00cea70 msgr2=0x7f19c00c4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:18.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.572+0000 7f19c6dfa640 1 -- 172.21.15.55:0/4061819308 shutdown_connections 2023-07-06T21:57:18.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.572+0000 7f19c6dfa640 1 -- 172.21.15.55:0/4061819308 wait complete. 2023-07-06T21:57:18.588 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:57:18.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb0e7ad640 1 Processor -- start 2023-07-06T21:57:18.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb0e7ad640 1 -- start start 2023-07-06T21:57:18.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb0e7ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb08158850 0x7ffb080cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb0e7ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb080ca130 0x7ffb080ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb0e7ad640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb080b2aa0 con 0x7ffb080703e0 2023-07-06T21:57:18.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb0e7ad640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb08158c20 con 0x7ffb080ca130 2023-07-06T21:57:18.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb0e7ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb080c8db0 con 0x7ffb08158850 2023-07-06T21:57:18.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb077fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb080ca130 0x7ffb080ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb077fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb080ca130 0x7ffb080ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56432/0 (socket says 172.21.15.55:56432) 2023-07-06T21:57:18.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb077fe640 1 -- 172.21.15.55:0/2689897417 learned_addr learned my addr 172.21.15.55:0/2689897417 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:18.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb077fe640 1 -- 172.21.15.55:0/2689897417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb08158850 msgr2=0x7ffb080cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:18.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb07fff640 1 --2- 172.21.15.55:0/2689897417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb08158850 0x7ffb080cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb077fe640 1 --2- 172.21.15.55:0/2689897417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb08158850 0x7ffb080cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb077fe640 1 -- 172.21.15.55:0/2689897417 >> v1:172.21.15.138:6789/0 conn(0x7ffb080703e0 legacy=0x7ffb0806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:18.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb077fe640 1 -- 172.21.15.55:0/2689897417 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb080c9090 con 0x7ffb080ca130 2023-07-06T21:57:18.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.736+0000 7ffb07fff640 1 --2- 172.21.15.55:0/2689897417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb08158850 0x7ffb080cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:18.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.740+0000 7ffb077fe640 1 --2- 172.21.15.55:0/2689897417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb080ca130 0x7ffb080ccf70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009870 tx=0x7ffafc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1b32664aaad9dd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:18.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.740+0000 7ffb06ffd640 1 -- 172.21.15.55:0/2689897417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc0a89b0 con 0x7ffb080ca130 2023-07-06T21:57:18.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.740+0000 7ffb06ffd640 1 -- 172.21.15.55:0/2689897417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc0a8b10 con 0x7ffb080ca130 2023-07-06T21:57:18.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.740+0000 7ffb06ffd640 1 -- 172.21.15.55:0/2689897417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc0a8ea0 con 0x7ffb080ca130 2023-07-06T21:57:18.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.740+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/2689897417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb080ca130 msgr2=0x7ffb080ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.740+0000 7ffb0e7ad640 1 --2- 172.21.15.55:0/2689897417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb080ca130 0x7ffb080ccf70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009870 tx=0x7ffafc01ecf0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.740+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/2689897417 shutdown_connections 2023-07-06T21:57:18.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.740+0000 7ffb0e7ad640 1 --2- 172.21.15.55:0/2689897417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb080ca130 0x7ffb080ccf70 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.740+0000 7ffb0e7ad640 1 --2- 172.21.15.55:0/2689897417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb08158850 0x7ffb080cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.740+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/2689897417 >> 172.21.15.55:0/2689897417 conn(0x7ffb080cea70 msgr2=0x7ffb080ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:18.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.740+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/2689897417 shutdown_connections 2023-07-06T21:57:18.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.740+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/2689897417 wait complete. 2023-07-06T21:57:18.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.740+0000 7ffb0e7ad640 1 Processor -- start 2023-07-06T21:57:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.740+0000 7ffb0e7ad640 1 -- start start 2023-07-06T21:57:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb0e7ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb080703e0 0x7ffb08155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb0e7ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb080ca130 0x7ffb081f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb0e7ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb08158850 0x7ffb081f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb0e7ad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb081f4cb0 con 0x7ffb080ca130 2023-07-06T21:57:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb0e7ad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb08155d60 con 0x7ffb08158850 2023-07-06T21:57:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb0e7ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb081f1b00 con 0x7ffb080703e0 2023-07-06T21:57:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb080ca130 0x7ffb081f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb080ca130 0x7ffb081f50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56444/0 (socket says 172.21.15.55:56444) 2023-07-06T21:57:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb077fe640 1 -- 172.21.15.55:0/380226341 learned_addr learned my addr 172.21.15.55:0/380226341 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb07fff640 1 --2- 172.21.15.55:0/380226341 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb080703e0 0x7ffb08155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb0cd4a640 1 --2- 172.21.15.55:0/380226341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb08158850 0x7ffb081f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb077fe640 1 -- 172.21.15.55:0/380226341 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb080703e0 msgr2=0x7ffb08155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb077fe640 1 --2- 172.21.15.55:0/380226341 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb080703e0 0x7ffb08155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb077fe640 1 -- 172.21.15.55:0/380226341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb08158850 msgr2=0x7ffb081f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb077fe640 1 --2- 172.21.15.55:0/380226341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb08158850 0x7ffb081f1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb077fe640 1 -- 172.21.15.55:0/380226341 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc0094d0 con 0x7ffb080ca130 2023-07-06T21:57:18.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb077fe640 1 --2- 172.21.15.55:0/380226341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb080ca130 0x7ffb081f50d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ffafc01d3a0 tx=0x7ffafc01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:18.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb04ff9640 1 -- 172.21.15.55:0/380226341 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc0ba600 con 0x7ffb080ca130 2023-07-06T21:57:18.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb04ff9640 1 -- 172.21.15.55:0/380226341 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc0ba780 con 0x7ffb080ca130 2023-07-06T21:57:18.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb04ff9640 1 -- 172.21.15.55:0/380226341 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc0bab30 con 0x7ffb080ca130 2023-07-06T21:57:18.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/380226341 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb081f1de0 con 0x7ffb080ca130 2023-07-06T21:57:18.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/380226341 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb081f20c0 con 0x7ffb080ca130 2023-07-06T21:57:18.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.744+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/380226341 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb081f4df0 con 0x7ffb080ca130 2023-07-06T21:57:18.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.748+0000 7ffb04ff9640 1 -- 172.21.15.55:0/380226341 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ffafc0bac90 con 0x7ffb080ca130 2023-07-06T21:57:18.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.748+0000 7ffb04ff9640 1 --2- 172.21.15.55:0/380226341 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7ffaf40663a0 0x7ffaf4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:18.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.748+0000 7ffb04ff9640 1 -- 172.21.15.55:0/380226341 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6332+0+0 (secure 0 0 0) 0x7ffafc122520 con 0x7ffb080ca130 2023-07-06T21:57:18.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.748+0000 7ffb07fff640 1 --2- 172.21.15.55:0/380226341 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7ffaf40663a0 0x7ffaf4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:18.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.748+0000 7ffb07fff640 1 --2- 172.21.15.55:0/380226341 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7ffaf40663a0 0x7ffaf4068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8006fd0 tx=0x7ffaf8008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:18.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.752+0000 7ffb04ff9640 1 -- 172.21.15.55:0/380226341 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffb081f4df0 con 0x7ffb080ca130 2023-07-06T21:57:18.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.908+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/380226341 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffb081f4df0 con 0x7ffb080ca130 2023-07-06T21:57:18.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.908+0000 7ffb04ff9640 1 -- 172.21.15.55:0/380226341 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffb081f4df0 con 0x7ffb080ca130 2023-07-06T21:57:18.907 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:57:18.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.912+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/380226341 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7ffaf40663a0 msgr2=0x7ffaf4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.912+0000 7ffb0e7ad640 1 --2- 172.21.15.55:0/380226341 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7ffaf40663a0 0x7ffaf4068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8006fd0 tx=0x7ffaf8008040 comp rx=0 tx=0).stop 2023-07-06T21:57:18.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.912+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/380226341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb080ca130 msgr2=0x7ffb081f50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:18.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.912+0000 7ffb0e7ad640 1 --2- 172.21.15.55:0/380226341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb080ca130 0x7ffb081f50d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ffafc01d3a0 tx=0x7ffafc01ba90 comp rx=0 tx=0).stop 2023-07-06T21:57:18.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.912+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/380226341 shutdown_connections 2023-07-06T21:57:18.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.912+0000 7ffb0e7ad640 1 --2- 172.21.15.55:0/380226341 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7ffaf40663a0 0x7ffaf4068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.912+0000 7ffb0e7ad640 1 --2- 172.21.15.55:0/380226341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb08158850 0x7ffb081f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.912+0000 7ffb0e7ad640 1 --2- 172.21.15.55:0/380226341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb080ca130 0x7ffb081f50d0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.912+0000 7ffb0e7ad640 1 --2- 172.21.15.55:0/380226341 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb080703e0 0x7ffb08155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:18.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.912+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/380226341 >> 172.21.15.55:0/380226341 conn(0x7ffb080cea70 msgr2=0x7ffb080cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:18.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.912+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/380226341 shutdown_connections 2023-07-06T21:57:18.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:18.912+0000 7ffb0e7ad640 1 -- 172.21.15.55:0/380226341 wait complete. 2023-07-06T21:57:18.928 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-06T21:57:19.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.076+0000 7ff8973f6640 1 Processor -- start 2023-07-06T21:57:19.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.076+0000 7ff8973f6640 1 -- start start 2023-07-06T21:57:19.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.076+0000 7ff8973f6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff890158850 0x7ff8900cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:19.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.076+0000 7ff8973f6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8900ca130 0x7ff8900ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:19.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.076+0000 7ff8973f6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8900b2aa0 con 0x7ff8900703e0 2023-07-06T21:57:19.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.076+0000 7ff8973f6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff890158c20 con 0x7ff890158850 2023-07-06T21:57:19.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.076+0000 7ff8973f6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900c8db0 con 0x7ff8900ca130 2023-07-06T21:57:19.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.076+0000 7ff895192640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff890158850 0x7ff8900cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:19.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.076+0000 7ff895192640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff890158850 0x7ff8900cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56450/0 (socket says 172.21.15.55:56450) 2023-07-06T21:57:19.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.076+0000 7ff895192640 1 -- 172.21.15.55:0/2530232523 learned_addr learned my addr 172.21.15.55:0/2530232523 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:19.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.076+0000 7ff894991640 1 --2- 172.21.15.55:0/2530232523 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8900ca130 0x7ff8900ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:19.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff895192640 1 -- 172.21.15.55:0/2530232523 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8900ca130 msgr2=0x7ff8900ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:19.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff895192640 1 --2- 172.21.15.55:0/2530232523 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8900ca130 0x7ff8900ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff895192640 1 -- 172.21.15.55:0/2530232523 >> v1:172.21.15.138:6789/0 conn(0x7ff8900703e0 legacy=0x7ff89006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:19.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff895192640 1 -- 172.21.15.55:0/2530232523 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8900c9090 con 0x7ff890158850 2023-07-06T21:57:19.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff894991640 1 --2- 172.21.15.55:0/2530232523 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8900ca130 0x7ff8900ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:19.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff895192640 1 --2- 172.21.15.55:0/2530232523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff890158850 0x7ff8900cca30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009870 tx=0x7ff88c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbdcb91780c22f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:19.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff887fff640 1 -- 172.21.15.55:0/2530232523 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c0a89b0 con 0x7ff890158850 2023-07-06T21:57:19.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff887fff640 1 -- 172.21.15.55:0/2530232523 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c0a8b10 con 0x7ff890158850 2023-07-06T21:57:19.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff887fff640 1 -- 172.21.15.55:0/2530232523 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c0a8ea0 con 0x7ff890158850 2023-07-06T21:57:19.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff8973f6640 1 -- 172.21.15.55:0/2530232523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff890158850 msgr2=0x7ff8900cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:19.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff8973f6640 1 --2- 172.21.15.55:0/2530232523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff890158850 0x7ff8900cca30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009870 tx=0x7ff88c01ecf0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff8973f6640 1 -- 172.21.15.55:0/2530232523 shutdown_connections 2023-07-06T21:57:19.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff8973f6640 1 --2- 172.21.15.55:0/2530232523 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8900ca130 0x7ff8900ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff8973f6640 1 --2- 172.21.15.55:0/2530232523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff890158850 0x7ff8900cca30 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.080+0000 7ff8973f6640 1 -- 172.21.15.55:0/2530232523 >> 172.21.15.55:0/2530232523 conn(0x7ff8900cea70 msgr2=0x7ff8900ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:19.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff8973f6640 1 -- 172.21.15.55:0/2530232523 shutdown_connections 2023-07-06T21:57:19.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff8973f6640 1 -- 172.21.15.55:0/2530232523 wait complete. 2023-07-06T21:57:19.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff8973f6640 1 Processor -- start 2023-07-06T21:57:19.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff8973f6640 1 -- start start 2023-07-06T21:57:19.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff8973f6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8900703e0 0x7ff8901ddce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:19.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff8973f6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8900ca130 0x7ff8901f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:19.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff8973f6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff890158850 0x7ff89009dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:19.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff8973f6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900ae9c0 con 0x7ff890158850 2023-07-06T21:57:19.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff8973f6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900af8f0 con 0x7ff8900703e0 2023-07-06T21:57:19.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff8973f6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900aede0 con 0x7ff8900ca130 2023-07-06T21:57:19.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff895993640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff890158850 0x7ff89009dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:19.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff895993640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff890158850 0x7ff89009dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56464/0 (socket says 172.21.15.55:56464) 2023-07-06T21:57:19.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff895993640 1 -- 172.21.15.55:0/2558280765 learned_addr learned my addr 172.21.15.55:0/2558280765 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:19.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff894991640 1 --2- 172.21.15.55:0/2558280765 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8900ca130 0x7ff8901f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:19.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff895192640 1 --2- 172.21.15.55:0/2558280765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8900703e0 0x7ff8901ddce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:19.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff895993640 1 -- 172.21.15.55:0/2558280765 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8900ca130 msgr2=0x7ff8901f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:19.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff895993640 1 --2- 172.21.15.55:0/2558280765 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8900ca130 0x7ff8901f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff895993640 1 -- 172.21.15.55:0/2558280765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8900703e0 msgr2=0x7ff8901ddce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:19.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff895993640 1 --2- 172.21.15.55:0/2558280765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8900703e0 0x7ff8901ddce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.084+0000 7ff895993640 1 -- 172.21.15.55:0/2558280765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c0094d0 con 0x7ff890158850 2023-07-06T21:57:19.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.088+0000 7ff895993640 1 --2- 172.21.15.55:0/2558280765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff890158850 0x7ff89009dec0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff88800c780 tx=0x7ff88800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:19.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.088+0000 7ff885ffb640 1 -- 172.21.15.55:0/2558280765 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888004b70 con 0x7ff890158850 2023-07-06T21:57:19.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.088+0000 7ff885ffb640 1 -- 172.21.15.55:0/2558280765 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88800ce90 con 0x7ff890158850 2023-07-06T21:57:19.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.088+0000 7ff885ffb640 1 -- 172.21.15.55:0/2558280765 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88800a850 con 0x7ff890158850 2023-07-06T21:57:19.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.088+0000 7ff8973f6640 1 -- 172.21.15.55:0/2558280765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8900add40 con 0x7ff890158850 2023-07-06T21:57:19.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.088+0000 7ff8973f6640 1 -- 172.21.15.55:0/2558280765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8900ae300 con 0x7ff890158850 2023-07-06T21:57:19.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.088+0000 7ff8973f6640 1 -- 172.21.15.55:0/2558280765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8900aeb00 con 0x7ff890158850 2023-07-06T21:57:19.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.088+0000 7ff885ffb640 1 -- 172.21.15.55:0/2558280765 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff88800a9b0 con 0x7ff890158850 2023-07-06T21:57:19.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.088+0000 7ff885ffb640 1 --2- 172.21.15.55:0/2558280765 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7ff8740663d0 0x7ff874068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:19.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.088+0000 7ff885ffb640 1 -- 172.21.15.55:0/2558280765 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6332+0+0 (secure 0 0 0) 0x7ff888083fc0 con 0x7ff890158850 2023-07-06T21:57:19.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.088+0000 7ff895192640 1 --2- 172.21.15.55:0/2558280765 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7ff8740663d0 0x7ff874068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:19.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.092+0000 7ff895192640 1 --2- 172.21.15.55:0/2558280765 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7ff8740663d0 0x7ff874068880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0b2000 tx=0x7ff88c009040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:19.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.092+0000 7ff885ffb640 1 -- 172.21.15.55:0/2558280765 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8900aeb00 con 0x7ff890158850 2023-07-06T21:57:19.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.248+0000 7ff8973f6640 1 -- 172.21.15.55:0/2558280765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff8900aeb00 con 0x7ff890158850 2023-07-06T21:57:19.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.256+0000 7ff885ffb640 1 -- 172.21.15.55:0/2558280765 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff8900aeb00 con 0x7ff890158850 2023-07-06T21:57:19.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.256+0000 7ff8973f6640 1 -- 172.21.15.55:0/2558280765 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7ff8740663d0 msgr2=0x7ff874068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:19.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.256+0000 7ff8973f6640 1 --2- 172.21.15.55:0/2558280765 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7ff8740663d0 0x7ff874068880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0b2000 tx=0x7ff88c009040 comp rx=0 tx=0).stop 2023-07-06T21:57:19.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.256+0000 7ff8973f6640 1 -- 172.21.15.55:0/2558280765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff890158850 msgr2=0x7ff89009dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:19.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.256+0000 7ff8973f6640 1 --2- 172.21.15.55:0/2558280765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff890158850 0x7ff89009dec0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff88800c780 tx=0x7ff88800cc40 comp rx=0 tx=0).stop 2023-07-06T21:57:19.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.256+0000 7ff8973f6640 1 -- 172.21.15.55:0/2558280765 shutdown_connections 2023-07-06T21:57:19.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.256+0000 7ff8973f6640 1 --2- 172.21.15.55:0/2558280765 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7ff8740663d0 0x7ff874068880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.256+0000 7ff8973f6640 1 --2- 172.21.15.55:0/2558280765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff890158850 0x7ff89009dec0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.256+0000 7ff8973f6640 1 --2- 172.21.15.55:0/2558280765 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8900ca130 0x7ff8901f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.256+0000 7ff8973f6640 1 --2- 172.21.15.55:0/2558280765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8900703e0 0x7ff8901ddce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.256+0000 7ff8973f6640 1 -- 172.21.15.55:0/2558280765 >> 172.21.15.55:0/2558280765 conn(0x7ff8900cea70 msgr2=0x7ff8900b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:19.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.256+0000 7ff8973f6640 1 -- 172.21.15.55:0/2558280765 shutdown_connections 2023-07-06T21:57:19.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.256+0000 7ff8973f6640 1 -- 172.21.15.55:0/2558280765 wait complete. 2023-07-06T21:57:19.274 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T21:57:19.275 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:57:19.359 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:57:19.412 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T21:57:19.412 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:57:19.412 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:19.421 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T21:57:19.422 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:57:19.422 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:19.431 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:57:19.431 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:57:19.432 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:19.472 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T21:57:19.472 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:57:19.473 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:19.481 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:57:19.482 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-06T21:57:19.482 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:57:19.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe52826d640 1 Processor -- start 2023-07-06T21:57:19.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe52826d640 1 -- start start 2023-07-06T21:57:19.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe52826d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5200ce610 0x7fe5200b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:19.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe52826d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5200b2290 con 0x7fe5200b1e10 2023-07-06T21:57:19.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe52826d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5200cd1c0 con 0x7fe5200b7cd0 2023-07-06T21:57:19.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe52826d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200d2310 con 0x7fe5200ce610 2023-07-06T21:57:19.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe52680a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe5200b1e10 0x7fe52015f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38460/0 (socket says 172.21.15.55:38460) 2023-07-06T21:57:19.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe52680a640 1 -- 172.21.15.55:0/1544244517 learned_addr learned my addr 172.21.15.55:0/1544244517 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe525007640 1 -- 172.21.15.55:0/1544244517 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109749519 0 0) 0x7fe5200b2290 con 0x7fe5200b1e10 2023-07-06T21:57:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe525007640 1 -- 172.21.15.55:0/1544244517 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe50c003530 con 0x7fe5200b1e10 2023-07-06T21:57:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe525808640 1 --2- 172.21.15.55:0/1544244517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5200ce610 0x7fe5200b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe525007640 1 -- 172.21.15.55:0/1544244517 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1463701486 0 0) 0x7fe50c003530 con 0x7fe5200b1e10 2023-07-06T21:57:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe525007640 1 -- 172.21.15.55:0/1544244517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5200ce610 msgr2=0x7fe5200b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe525007640 1 --2- 172.21.15.55:0/1544244517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5200ce610 0x7fe5200b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe525007640 1 -- 172.21.15.55:0/1544244517 >> v1:172.21.15.138:6789/0 conn(0x7fe5200b7cd0 legacy=0x7fe5200ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe525007640 1 -- 172.21.15.55:0/1544244517 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5200cecf0 con 0x7fe5200b1e10 2023-07-06T21:57:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe525007640 1 -- 172.21.15.55:0/1544244517 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fe518001a00 con 0x7fe5200b1e10 2023-07-06T21:57:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.656+0000 7fe525007640 1 -- 172.21.15.55:0/1544244517 >> v1:172.21.15.55:6789/0 conn(0x7fe5200b1e10 legacy=0x7fe52015f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525007640 1 --2- 172.21.15.55:0/1544244517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5200ce610 0x7fe50c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525007640 1 --2- 172.21.15.55:0/1544244517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe50c003fe0 0x7fe50c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525007640 1 --2- 172.21.15.55:0/1544244517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe50c004d10 0x7fe50c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525007640 1 -- 172.21.15.55:0/1544244517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c00bb70 con 0x7fe50c003fe0 2023-07-06T21:57:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525007640 1 -- 172.21.15.55:0/1544244517 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c00bce0 con 0x7fe50c004d10 2023-07-06T21:57:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525007640 1 -- 172.21.15.55:0/1544244517 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c00bea0 con 0x7fe5200ce610 2023-07-06T21:57:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525808640 1 --2- 172.21.15.55:0/1544244517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe50c003fe0 0x7fe50c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe526009640 1 --2- 172.21.15.55:0/1544244517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5200ce610 0x7fe50c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe52680a640 1 --2- 172.21.15.55:0/1544244517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe50c004d10 0x7fe50c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525808640 1 -- 172.21.15.55:0/1544244517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5200ce610 msgr2=0x7fe50c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525808640 1 --2- 172.21.15.55:0/1544244517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe5200ce610 0x7fe50c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525808640 1 -- 172.21.15.55:0/1544244517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe50c004d10 msgr2=0x7fe50c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525808640 1 --2- 172.21.15.55:0/1544244517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe50c004d10 0x7fe50c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525808640 1 -- 172.21.15.55:0/1544244517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c003530 con 0x7fe50c003fe0 2023-07-06T21:57:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525808640 1 --2- 172.21.15.55:0/1544244517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe50c003fe0 0x7fe50c0047d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fe51000ba30 tx=0x7fe51001c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b260f1bb2bdcab9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525007640 1 -- 172.21.15.55:0/1544244517 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5100ae410 con 0x7fe50c003fe0 2023-07-06T21:57:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525007640 1 -- 172.21.15.55:0/1544244517 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5100a8030 con 0x7fe50c003fe0 2023-07-06T21:57:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.660+0000 7fe525007640 1 -- 172.21.15.55:0/1544244517 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5100ae7b0 con 0x7fe50c003fe0 2023-07-06T21:57:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52826d640 1 -- 172.21.15.55:0/1544244517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe50c003fe0 msgr2=0x7fe50c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52826d640 1 --2- 172.21.15.55:0/1544244517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe50c003fe0 0x7fe50c0047d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fe51000ba30 tx=0x7fe51001c680 comp rx=0 tx=0).stop 2023-07-06T21:57:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52680a640 1 -- 172.21.15.55:0/1544244517 reap_dead start 2023-07-06T21:57:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52826d640 1 -- 172.21.15.55:0/1544244517 shutdown_connections 2023-07-06T21:57:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52826d640 1 -- 172.21.15.55:0/1544244517 >> 172.21.15.55:0/1544244517 conn(0x7fe5200ceee0 msgr2=0x7fe5200cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52826d640 1 -- 172.21.15.55:0/1544244517 shutdown_connections 2023-07-06T21:57:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52826d640 1 -- 172.21.15.55:0/1544244517 wait complete. 2023-07-06T21:57:19.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52826d640 1 Processor -- start 2023-07-06T21:57:19.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52826d640 1 -- start start 2023-07-06T21:57:19.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52826d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe50c003fe0 0x7fe5201f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:19.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52826d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe52015c370 0x7fe5201f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52826d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe52015da90 0x7fe52015df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52826d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52015d490 con 0x7fe50c003fe0 2023-07-06T21:57:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52826d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52015e470 con 0x7fe52015da90 2023-07-06T21:57:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe52826d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200cb6f0 con 0x7fe52015c370 2023-07-06T21:57:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe526009640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe50c003fe0 0x7fe5201f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe526009640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe50c003fe0 0x7fe5201f4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56482/0 (socket says 172.21.15.55:56482) 2023-07-06T21:57:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe526009640 1 -- 172.21.15.55:0/2801366271 learned_addr learned my addr 172.21.15.55:0/2801366271 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:19.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.664+0000 7fe525808640 1 --2- 172.21.15.55:0/2801366271 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe52015c370 0x7fe5201f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:19.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe52680a640 1 --2- 172.21.15.55:0/2801366271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe52015da90 0x7fe52015df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:19.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe526009640 1 -- 172.21.15.55:0/2801366271 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe52015c370 msgr2=0x7fe5201f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:19.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe526009640 1 --2- 172.21.15.55:0/2801366271 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe52015c370 0x7fe5201f3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe526009640 1 -- 172.21.15.55:0/2801366271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe52015da90 msgr2=0x7fe52015df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:19.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe526009640 1 --2- 172.21.15.55:0/2801366271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe52015da90 0x7fe52015df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe526009640 1 -- 172.21.15.55:0/2801366271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52015c810 con 0x7fe50c003fe0 2023-07-06T21:57:19.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe526009640 1 --2- 172.21.15.55:0/2801366271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe50c003fe0 0x7fe5201f4df0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00f7f0 tx=0x7fe51c00fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe516ffd640 1 -- 172.21.15.55:0/2801366271 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0050d0 con 0x7fe50c003fe0 2023-07-06T21:57:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe516ffd640 1 -- 172.21.15.55:0/2801366271 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c005230 con 0x7fe50c003fe0 2023-07-06T21:57:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe52826d640 1 -- 172.21.15.55:0/2801366271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52015caf0 con 0x7fe50c003fe0 2023-07-06T21:57:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe516ffd640 1 -- 172.21.15.55:0/2801366271 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c00d730 con 0x7fe50c003fe0 2023-07-06T21:57:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe52826d640 1 -- 172.21.15.55:0/2801366271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52015d0b0 con 0x7fe50c003fe0 2023-07-06T21:57:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe52826d640 1 -- 172.21.15.55:0/2801366271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe520066d60 con 0x7fe50c003fe0 2023-07-06T21:57:19.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe516ffd640 1 -- 172.21.15.55:0/2801366271 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe51c00d890 con 0x7fe50c003fe0 2023-07-06T21:57:19.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe516ffd640 1 --2- 172.21.15.55:0/2801366271 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fe5040663a0 0x7fe504068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:19.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.668+0000 7fe516ffd640 1 -- 172.21.15.55:0/2801366271 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6332+0+0 (secure 0 0 0) 0x7fe51c083fe0 con 0x7fe50c003fe0 2023-07-06T21:57:19.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.672+0000 7fe525808640 1 --2- 172.21.15.55:0/2801366271 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fe5040663a0 0x7fe504068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.672+0000 7fe525808640 1 --2- 172.21.15.55:0/2801366271 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fe5040663a0 0x7fe504068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe5100b0000 tx=0x7fe5100046d0 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:19.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.672+0000 7fe516ffd640 1 -- 172.21.15.55:0/2801366271 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe51c0511c0 con 0x7fe50c003fe0 2023-07-06T21:57:19.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.860+0000 7fe52826d640 1 -- 172.21.15.55:0/2801366271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5200b3690 con 0x7fe50c003fe0 2023-07-06T21:57:19.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.864+0000 7fe516ffd640 1 -- 172.21.15.55:0/2801366271 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fe51c0547e0 con 0x7fe50c003fe0 2023-07-06T21:57:19.861 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:19.861 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2986611670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2986611670},{"type":"v1","addr":"172.21.15.138:6835","nonce":2986611670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6351,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2521348037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2521348037},{"type":"v1","addr":"172.21.15.55:6836","nonce":2521348037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1716722785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1716722785},{"type":"v1","addr":"172.21.15.55:6837","nonce":1716722785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6526,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3984466882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3984466882},{"type":"v1","addr":"172.21.15.138:6834","nonce":3984466882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-07-06T21:57:19.862 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 26 2023-07-06T21:57:19.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.864+0000 7fe52826d640 1 -- 172.21.15.55:0/2801366271 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fe5040663a0 msgr2=0x7fe504068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:19.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.864+0000 7fe52826d640 1 --2- 172.21.15.55:0/2801366271 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fe5040663a0 0x7fe504068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe5100b0000 tx=0x7fe5100046d0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.864+0000 7fe52826d640 1 -- 172.21.15.55:0/2801366271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe50c003fe0 msgr2=0x7fe5201f4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:19.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.864+0000 7fe52826d640 1 --2- 172.21.15.55:0/2801366271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe50c003fe0 0x7fe5201f4df0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00f7f0 tx=0x7fe51c00fcb0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.864+0000 7fe52826d640 1 -- 172.21.15.55:0/2801366271 shutdown_connections 2023-07-06T21:57:19.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.864+0000 7fe52826d640 1 --2- 172.21.15.55:0/2801366271 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fe5040663a0 0x7fe504068850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.864+0000 7fe52826d640 1 --2- 172.21.15.55:0/2801366271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe52015da90 0x7fe52015df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.864+0000 7fe52826d640 1 --2- 172.21.15.55:0/2801366271 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe52015c370 0x7fe5201f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.864+0000 7fe52826d640 1 --2- 172.21.15.55:0/2801366271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe50c003fe0 0x7fe5201f4df0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:19.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.864+0000 7fe52826d640 1 -- 172.21.15.55:0/2801366271 >> 172.21.15.55:0/2801366271 conn(0x7fe5200ceee0 msgr2=0x7fe52015b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:19.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.864+0000 7fe52826d640 1 -- 172.21.15.55:0/2801366271 shutdown_connections 2023-07-06T21:57:19.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:19.864+0000 7fe52826d640 1 -- 172.21.15.55:0/2801366271 wait complete. 2023-07-06T21:57:19.882 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T21:57:19.882 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-06T21:57:19.882 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T21:57:19.883 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:57:19.883 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T21:57:19.883 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-06T21:57:19.883 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T21:57:19.884 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:57:19.884 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T21:57:19.884 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-06T21:57:19.884 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T21:57:19.885 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:57:19.885 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T21:57:19.885 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-06T21:57:19.885 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T21:57:19.885 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:57:19.894 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T21:57:19.894 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T21:57:19.895 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T21:57:19.896 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T21:57:19.899 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T21:57:19.899 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T21:57:19.900 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T21:57:19.900 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T21:57:19.942 INFO:tasks.ceph.mds.a:Started 2023-07-06T21:57:19.943 DEBUG:teuthology.parallel:result is None 2023-07-06T21:57:19.945 INFO:tasks.ceph.mds.c:Started 2023-07-06T21:57:19.945 DEBUG:teuthology.parallel:result is None 2023-07-06T21:57:19.947 INFO:tasks.ceph.mds.d:Started 2023-07-06T21:57:19.947 DEBUG:teuthology.parallel:result is None 2023-07-06T21:57:19.949 INFO:tasks.ceph.mds.b:Started 2023-07-06T21:57:19.950 DEBUG:teuthology.parallel:result is None 2023-07-06T21:57:19.950 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-06T21:57:20.032 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-07-06T21:57:20.032 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T21:57:20.041 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-07-06T21:57:20.043 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-07-06T21:57:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.104+0000 7f6f5be5c640 1 Processor -- start 2023-07-06T21:57:20.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f5be5c640 1 -- start start 2023-07-06T21:57:20.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f5be5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5415b850 0x7f6f540cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:20.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f5be5c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6f540ccd30 0x7f6f540b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:20.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f5be5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f540b4210 con 0x7f6f540b3db0 2023-07-06T21:57:20.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f5be5c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f540b2b80 con 0x7f6f540ccd30 2023-07-06T21:57:20.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f5be5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540cff30 con 0x7f6f5415b850 2023-07-06T21:57:20.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f5a3f9640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6f540b3db0 0x7f6f5415f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38480/0 (socket says 172.21.15.55:38480) 2023-07-06T21:57:20.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f5a3f9640 1 -- 172.21.15.55:0/688247400 learned_addr learned my addr 172.21.15.55:0/688247400 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:20.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f593f7640 1 --2- 172.21.15.55:0/688247400 >> v2:172.21.15.138:3300/0 conn(0x7f6f540ccd30 0x7f6f540b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:20.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f59bf8640 1 --2- 172.21.15.55:0/688247400 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5415b850 0x7f6f540cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:20.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f58bf6640 1 -- 172.21.15.55:0/688247400 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198693462 0 0) 0x7f6f540b4210 con 0x7f6f540b3db0 2023-07-06T21:57:20.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f58bf6640 1 -- 172.21.15.55:0/688247400 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f40003530 con 0x7f6f540b3db0 2023-07-06T21:57:20.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f59bf8640 1 -- 172.21.15.55:0/688247400 >> v2:172.21.15.138:3300/0 conn(0x7f6f540ccd30 msgr2=0x7f6f540b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:20.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f59bf8640 1 --2- 172.21.15.55:0/688247400 >> v2:172.21.15.138:3300/0 conn(0x7f6f540ccd30 0x7f6f540b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:20.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f59bf8640 1 -- 172.21.15.55:0/688247400 >> v1:172.21.15.55:6789/0 conn(0x7f6f540b3db0 legacy=0x7f6f5415f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:20.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f59bf8640 1 -- 172.21.15.55:0/688247400 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f540b22e0 con 0x7f6f5415b850 2023-07-06T21:57:20.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.108+0000 7f6f593f7640 1 --2- 172.21.15.55:0/688247400 >> v2:172.21.15.138:3300/0 conn(0x7f6f540ccd30 0x7f6f540b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:20.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.112+0000 7f6f59bf8640 1 --2- 172.21.15.55:0/688247400 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5415b850 0x7f6f540cc7f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f500097c0 tx=0x7f6f5001c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f4e18c4c340bc2e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:20.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.112+0000 7f6f58bf6640 1 -- 172.21.15.55:0/688247400 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f500ab600 con 0x7f6f5415b850 2023-07-06T21:57:20.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.112+0000 7f6f58bf6640 1 -- 172.21.15.55:0/688247400 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f500a7050 con 0x7f6f5415b850 2023-07-06T21:57:20.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.112+0000 7f6f58bf6640 1 -- 172.21.15.55:0/688247400 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f500ab980 con 0x7f6f5415b850 2023-07-06T21:57:20.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.112+0000 7f6f5be5c640 1 -- 172.21.15.55:0/688247400 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5415b850 msgr2=0x7f6f540cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:20.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.112+0000 7f6f5be5c640 1 --2- 172.21.15.55:0/688247400 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5415b850 0x7f6f540cc7f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f500097c0 tx=0x7f6f5001c330 comp rx=0 tx=0).stop 2023-07-06T21:57:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.112+0000 7f6f5be5c640 1 -- 172.21.15.55:0/688247400 shutdown_connections 2023-07-06T21:57:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.112+0000 7f6f5be5c640 1 --2- 172.21.15.55:0/688247400 >> v2:172.21.15.138:3300/0 conn(0x7f6f540ccd30 0x7f6f540b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.112+0000 7f6f5be5c640 1 --2- 172.21.15.55:0/688247400 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5415b850 0x7f6f540cc7f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.112+0000 7f6f5be5c640 1 -- 172.21.15.55:0/688247400 >> 172.21.15.55:0/688247400 conn(0x7f6f540cec20 msgr2=0x7f6f540cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.112+0000 7f6f5be5c640 1 -- 172.21.15.55:0/688247400 shutdown_connections 2023-07-06T21:57:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.112+0000 7f6f5be5c640 1 -- 172.21.15.55:0/688247400 wait complete. 2023-07-06T21:57:20.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f5be5c640 1 Processor -- start 2023-07-06T21:57:20.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f5be5c640 1 -- start start 2023-07-06T21:57:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f5be5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f540b3db0 0x7f6f5414f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f5be5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540ccd30 0x7f6f5415e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f5be5c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5415b850 0x7f6f5414ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:20.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f5be5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5415c7e0 con 0x7f6f540ccd30 2023-07-06T21:57:20.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f5be5c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5415cac0 con 0x7f6f5415b850 2023-07-06T21:57:20.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f5be5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540cbe40 con 0x7f6f540b3db0 2023-07-06T21:57:20.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f593f7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540ccd30 0x7f6f5415e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:20.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f593f7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540ccd30 0x7f6f5415e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56512/0 (socket says 172.21.15.55:56512) 2023-07-06T21:57:20.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f5a3f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5415b850 0x7f6f5414ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:20.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f59bf8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f540b3db0 0x7f6f5414f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:20.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f593f7640 1 -- 172.21.15.55:0/4113898496 learned_addr learned my addr 172.21.15.55:0/4113898496 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:20.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f593f7640 1 -- 172.21.15.55:0/4113898496 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f540b3db0 msgr2=0x7f6f5414f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f593f7640 1 --2- 172.21.15.55:0/4113898496 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f540b3db0 0x7f6f5414f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f593f7640 1 -- 172.21.15.55:0/4113898496 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5415b850 msgr2=0x7f6f5414ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f593f7640 1 --2- 172.21.15.55:0/4113898496 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5415b850 0x7f6f5414ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f593f7640 1 -- 172.21.15.55:0/4113898496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f44009420 con 0x7f6f540ccd30 2023-07-06T21:57:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f593f7640 1 --2- 172.21.15.55:0/4113898496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540ccd30 0x7f6f5415e670 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400e9d0 tx=0x7f6f4400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f4a7fc640 1 -- 172.21.15.55:0/4113898496 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4400ca60 con 0x7f6f540ccd30 2023-07-06T21:57:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f4a7fc640 1 -- 172.21.15.55:0/4113898496 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4400cbc0 con 0x7f6f540ccd30 2023-07-06T21:57:20.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f4a7fc640 1 -- 172.21.15.55:0/4113898496 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f44013470 con 0x7f6f540ccd30 2023-07-06T21:57:20.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f5be5c640 1 -- 172.21.15.55:0/4113898496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f50009420 con 0x7f6f540ccd30 2023-07-06T21:57:20.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f5be5c640 1 -- 172.21.15.55:0/4113898496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5415bda0 con 0x7f6f540ccd30 2023-07-06T21:57:20.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.116+0000 7f6f5be5c640 1 -- 172.21.15.55:0/4113898496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f54066d60 con 0x7f6f540ccd30 2023-07-06T21:57:20.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.120+0000 7f6f4a7fc640 1 -- 172.21.15.55:0/4113898496 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6f440135d0 con 0x7f6f540ccd30 2023-07-06T21:57:20.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.120+0000 7f6f4a7fc640 1 --2- 172.21.15.55:0/4113898496 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6f380663a0 0x7f6f38068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:20.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.120+0000 7f6f4a7fc640 1 -- 172.21.15.55:0/4113898496 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f6f44083f10 con 0x7f6f540ccd30 2023-07-06T21:57:20.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.120+0000 7f6f59bf8640 1 --2- 172.21.15.55:0/4113898496 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6f380663a0 0x7f6f38068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:20.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.120+0000 7f6f59bf8640 1 --2- 172.21.15.55:0/4113898496 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6f380663a0 0x7f6f38068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6f500ad000 tx=0x7f6f500a6000 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.124+0000 7f6f4a7fc640 1 -- 172.21.15.55:0/4113898496 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f440511c0 con 0x7f6f540ccd30 2023-07-06T21:57:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:20.292+0000 7f6f5be5c640 1 -- 172.21.15.55:0/4113898496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6f540b3420 con 0x7f6f540ccd30 2023-07-06T21:57:21.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.100+0000 7f6f4a7fc640 1 -- 172.21.15.55:0/4113898496 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v85) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6f440547e0 con 0x7f6f540ccd30 2023-07-06T21:57:21.098 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-07-06T21:57:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.100+0000 7f6f5be5c640 1 -- 172.21.15.55:0/4113898496 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6f380663a0 msgr2=0x7f6f38068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.100+0000 7f6f5be5c640 1 --2- 172.21.15.55:0/4113898496 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6f380663a0 0x7f6f38068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6f500ad000 tx=0x7f6f500a6000 comp rx=0 tx=0).stop 2023-07-06T21:57:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.100+0000 7f6f5be5c640 1 -- 172.21.15.55:0/4113898496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540ccd30 msgr2=0x7f6f5415e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.100+0000 7f6f5be5c640 1 --2- 172.21.15.55:0/4113898496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540ccd30 0x7f6f5415e670 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400e9d0 tx=0x7f6f4400ee90 comp rx=0 tx=0).stop 2023-07-06T21:57:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.100+0000 7f6f5be5c640 1 -- 172.21.15.55:0/4113898496 shutdown_connections 2023-07-06T21:57:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.100+0000 7f6f5be5c640 1 --2- 172.21.15.55:0/4113898496 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6f380663a0 0x7f6f38068850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.100+0000 7f6f5be5c640 1 --2- 172.21.15.55:0/4113898496 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5415b850 0x7f6f5414ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.100+0000 7f6f5be5c640 1 --2- 172.21.15.55:0/4113898496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540ccd30 0x7f6f5415e670 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.100+0000 7f6f5be5c640 1 --2- 172.21.15.55:0/4113898496 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f540b3db0 0x7f6f5414f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.100+0000 7f6f5be5c640 1 -- 172.21.15.55:0/4113898496 >> 172.21.15.55:0/4113898496 conn(0x7f6f540cec20 msgr2=0x7f6f540b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.100+0000 7f6f5be5c640 1 -- 172.21.15.55:0/4113898496 shutdown_connections 2023-07-06T21:57:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.100+0000 7f6f5be5c640 1 -- 172.21.15.55:0/4113898496 wait complete. 2023-07-06T21:57:21.123 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-06T21:57:21.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cfc1d2640 1 Processor -- start 2023-07-06T21:57:21.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cfc1d2640 1 -- start start 2023-07-06T21:57:21.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cfc1d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf40b7cd0 0x7f5cf40ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:21.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cfc1d2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5cf40b1fe0 0x7f5cf415f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:21.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cfc1d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf40cecf0 con 0x7f5cf40ccab0 2023-07-06T21:57:21.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cfc1d2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf40d2310 con 0x7f5cf40b1fe0 2023-07-06T21:57:21.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cfc1d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf40b80a0 con 0x7f5cf40b7cd0 2023-07-06T21:57:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cf976d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5cf40ccab0 0x7f5cf40b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38494/0 (socket says 172.21.15.55:38494) 2023-07-06T21:57:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cf976d640 1 -- 172.21.15.55:0/2314675801 learned_addr learned my addr 172.21.15.55:0/2314675801 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cf9f6e640 1 --2- 172.21.15.55:0/2314675801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf40b7cd0 0x7f5cf40ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cfa76f640 1 --2- 172.21.15.55:0/2314675801 >> v2:172.21.15.138:3300/0 conn(0x7f5cf40b1fe0 0x7f5cf415f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cf8f6c640 1 -- 172.21.15.55:0/2314675801 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465290019 0 0) 0x7f5cf40cecf0 con 0x7f5cf40ccab0 2023-07-06T21:57:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cf8f6c640 1 -- 172.21.15.55:0/2314675801 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ce0003530 con 0x7f5cf40ccab0 2023-07-06T21:57:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cf9f6e640 1 -- 172.21.15.55:0/2314675801 >> v2:172.21.15.138:3300/0 conn(0x7f5cf40b1fe0 msgr2=0x7f5cf415f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cf9f6e640 1 --2- 172.21.15.55:0/2314675801 >> v2:172.21.15.138:3300/0 conn(0x7f5cf40b1fe0 0x7f5cf415f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.272+0000 7f5cf9f6e640 1 -- 172.21.15.55:0/2314675801 >> v1:172.21.15.55:6789/0 conn(0x7f5cf40ccab0 legacy=0x7f5cf40b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.276+0000 7f5cf9f6e640 1 -- 172.21.15.55:0/2314675801 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf40d1d90 con 0x7f5cf40b7cd0 2023-07-06T21:57:21.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.276+0000 7f5cf9f6e640 1 --2- 172.21.15.55:0/2314675801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf40b7cd0 0x7f5cf40ce610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00097c0 tx=0x7f5cf001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b398da4fa1e88ee4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:21.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.276+0000 7f5cf8f6c640 1 -- 172.21.15.55:0/2314675801 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00ab600 con 0x7f5cf40b7cd0 2023-07-06T21:57:21.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.276+0000 7f5cf8f6c640 1 -- 172.21.15.55:0/2314675801 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf00a7050 con 0x7f5cf40b7cd0 2023-07-06T21:57:21.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.276+0000 7f5cf8f6c640 1 -- 172.21.15.55:0/2314675801 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00ab980 con 0x7f5cf40b7cd0 2023-07-06T21:57:21.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.276+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/2314675801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf40b7cd0 msgr2=0x7f5cf40ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:21.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.276+0000 7f5cfc1d2640 1 --2- 172.21.15.55:0/2314675801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf40b7cd0 0x7f5cf40ce610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00097c0 tx=0x7f5cf001c3f0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.276+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/2314675801 shutdown_connections 2023-07-06T21:57:21.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.276+0000 7f5cfc1d2640 1 --2- 172.21.15.55:0/2314675801 >> v2:172.21.15.138:3300/0 conn(0x7f5cf40b1fe0 0x7f5cf415f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.276+0000 7f5cfc1d2640 1 --2- 172.21.15.55:0/2314675801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf40b7cd0 0x7f5cf40ce610 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.276+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/2314675801 >> 172.21.15.55:0/2314675801 conn(0x7f5cf40ceee0 msgr2=0x7f5cf40cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:21.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/2314675801 shutdown_connections 2023-07-06T21:57:21.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/2314675801 wait complete. 2023-07-06T21:57:21.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cfc1d2640 1 Processor -- start 2023-07-06T21:57:21.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cfc1d2640 1 -- start start 2023-07-06T21:57:21.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cfc1d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf40b1fe0 0x7f5cf414dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cfc1d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cf40b7cd0 0x7f5cf414e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cfc1d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf40ccab0 0x7f5cf40b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cfc1d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf415e3f0 con 0x7f5cf40b1fe0 2023-07-06T21:57:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cfc1d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf414ed10 con 0x7f5cf40b7cd0 2023-07-06T21:57:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cfc1d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf415e640 con 0x7f5cf40ccab0 2023-07-06T21:57:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cf9f6e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf40b1fe0 0x7f5cf414dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cf9f6e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf40b1fe0 0x7f5cf414dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56516/0 (socket says 172.21.15.55:56516) 2023-07-06T21:57:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cf9f6e640 1 -- 172.21.15.55:0/1890732589 learned_addr learned my addr 172.21.15.55:0/1890732589 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cf976d640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cf40b7cd0 0x7f5cf414e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cfa76f640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf40ccab0 0x7f5cf40b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cf9f6e640 1 -- 172.21.15.55:0/1890732589 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf40ccab0 msgr2=0x7f5cf40b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cf9f6e640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf40ccab0 0x7f5cf40b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cf9f6e640 1 -- 172.21.15.55:0/1890732589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cf40b7cd0 msgr2=0x7f5cf414e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cf9f6e640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cf40b7cd0 0x7f5cf414e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cf9f6e640 1 -- 172.21.15.55:0/1890732589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0009420 con 0x7f5cf40b1fe0 2023-07-06T21:57:21.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cf976d640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cf40b7cd0 0x7f5cf414e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:21.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cf9f6e640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf40b1fe0 0x7f5cf414dd60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00ae040 tx=0x7f5cf0019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:21.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cea7fc640 1 -- 172.21.15.55:0/1890732589 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00b4430 con 0x7f5cf40b1fe0 2023-07-06T21:57:21.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cea7fc640 1 -- 172.21.15.55:0/1890732589 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf00b45b0 con 0x7f5cf40b1fe0 2023-07-06T21:57:21.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cea7fc640 1 -- 172.21.15.55:0/1890732589 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00b4960 con 0x7f5cf40b1fe0 2023-07-06T21:57:21.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.280+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/1890732589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf415e920 con 0x7f5cf40b1fe0 2023-07-06T21:57:21.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.284+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/1890732589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf415eee0 con 0x7f5cf40b1fe0 2023-07-06T21:57:21.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.284+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/1890732589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf4066d60 con 0x7f5cf40b1fe0 2023-07-06T21:57:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.284+0000 7f5cea7fc640 1 -- 172.21.15.55:0/1890732589 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5cf00b2040 con 0x7f5cf40b1fe0 2023-07-06T21:57:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.284+0000 7f5cea7fc640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5cd80663d0 0x7f5cd8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.284+0000 7f5cea7fc640 1 -- 172.21.15.55:0/1890732589 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5cf011dc30 con 0x7f5cf40b1fe0 2023-07-06T21:57:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.284+0000 7f5cf976d640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5cd80663d0 0x7f5cd8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:21.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.288+0000 7f5cf976d640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5cd80663d0 0x7f5cd8068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4069db0 tx=0x7f5ce4009040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:21.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.288+0000 7f5cea7fc640 1 -- 172.21.15.55:0/1890732589 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5cf00eb090 con 0x7f5cf40b1fe0 2023-07-06T21:57:21.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.496+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/1890732589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5cf4071aa0 con 0x7f5cf40b1fe0 2023-07-06T21:57:21.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.496+0000 7f5cea7fc640 1 -- 172.21.15.55:0/1890732589 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5cf00ee6b0 con 0x7f5cf40b1fe0 2023-07-06T21:57:21.494 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:21.495 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T21:57:21.495 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-07-06T21:57:21.495 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.495 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-07-06T21:57:21.495 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkWjb1JxAAMmLy+dPO5qyorBnuzazx6A==", 2023-07-06T21:57:21.495 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.495 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:21.496 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:57:21.496 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:57:21.496 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.496 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.496 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.496 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.496 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-07-06T21:57:21.497 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkpLLENBAAxMASh3qbELQMJ3XbPEX0Zw==", 2023-07-06T21:57:21.497 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.497 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:21.497 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:57:21.497 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:57:21.497 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.497 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.497 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.498 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.498 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-07-06T21:57:21.498 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkvOSfLxAAMEoqAPg1pb47e5a1G1QtAw==", 2023-07-06T21:57:21.498 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.498 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:21.498 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:57:21.498 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:57:21.498 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.499 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.499 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.499 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.499 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-07-06T21:57:21.499 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkeQIBARAApXT5zWLUqqMSdwYygZeatw==", 2023-07-06T21:57:21.499 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.499 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:21.499 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:57:21.500 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:57:21.500 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.500 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.500 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.500 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.500 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-07-06T21:57:21.500 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD5NKdkSIfzJxAAlXiG8PWFXQqIeugbdp7Eiw==", 2023-07-06T21:57:21.501 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.501 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:21.501 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:21.501 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.501 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.501 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.501 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.501 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-07-06T21:57:21.502 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD8NKdkv2iwLxAAxjFucMwaaH66wPQpoYSTGw==", 2023-07-06T21:57:21.502 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.502 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:21.502 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:21.502 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.502 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.502 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.502 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.503 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-07-06T21:57:21.503 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD/NKdk5w7XOBAAuiup4mcC02ZMCPHCU1Cl3A==", 2023-07-06T21:57:21.503 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.503 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:21.503 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:21.503 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.503 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.503 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.504 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.504 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-07-06T21:57:21.504 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQADNadksvRLBBAAE1YX9VgA8pWARIEZL8tbsQ==", 2023-07-06T21:57:21.504 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.504 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:21.504 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:21.504 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.505 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.505 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.505 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.505 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-07-06T21:57:21.505 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAJNadkn2HsChAAgwb7B9lHOMq2h0BNuhB/AQ==", 2023-07-06T21:57:21.505 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.505 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:21.505 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:21.506 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.506 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.506 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.506 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.506 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-07-06T21:57:21.506 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMNadkbonPERAA2PLg4NMr+4eW+FDAfPig1A==", 2023-07-06T21:57:21.506 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.506 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:21.507 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:21.507 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.507 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.507 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.507 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.507 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-07-06T21:57:21.507 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAPNadkQw76GBAAY9SIgsTUHqvThwjdpjuwpw==", 2023-07-06T21:57:21.507 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.508 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:21.508 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:21.508 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.508 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.508 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.508 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.508 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-07-06T21:57:21.509 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQASNadkr3gRHxAALbPUtIgImIK1UUoe6vcyjg==", 2023-07-06T21:57:21.509 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.509 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:21.509 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:21.509 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.509 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.509 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.509 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.510 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-07-06T21:57:21.510 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkaZgiBRAAvyBUd+qHLh/wwhgoE1MsVA==", 2023-07-06T21:57:21.510 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.510 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:21.510 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-07-06T21:57:21.510 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-06T21:57:21.510 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.510 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.511 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.511 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-07-06T21:57:21.511 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkOBqoDBAASIhzvCqkSAFLX2oc99MYqw==", 2023-07-06T21:57:21.511 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.511 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:21.511 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:57:21.511 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:57:21.511 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:57:21.512 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.512 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.512 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.512 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-07-06T21:57:21.512 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkgt/fCBAAlQY94DrR/nFTIVwSFCEToQ==", 2023-07-06T21:57:21.512 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.512 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:21.512 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:57:21.513 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:57:21.513 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:57:21.513 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.513 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.513 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.513 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-07-06T21:57:21.513 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkd5zAEhAAU0Qo6NROIKRSlOncFUoTxQ==", 2023-07-06T21:57:21.514 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.514 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:21.514 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:57:21.514 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:57:21.514 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:57:21.514 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.514 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.514 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.515 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-07-06T21:57:21.515 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkjvG8ChAA5rpuV6+YETQS9UjMRUynxA==", 2023-07-06T21:57:21.515 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.515 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:57:21.515 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:57:21.515 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:57:21.515 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.515 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.516 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.516 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.516 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-07-06T21:57:21.516 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdk+RUVIxAAyQpmGAeL8K+Cy+fgK5BmCQ==", 2023-07-06T21:57:21.516 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.516 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:57:21.516 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T21:57:21.517 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.517 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.517 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:21.517 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:21.517 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-07-06T21:57:21.517 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkLH8aHxAAzzX5YxumCYWYqo0rQfFA9g==", 2023-07-06T21:57:21.517 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:21.517 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:57:21.518 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T21:57:21.518 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:21.518 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.518 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:21.518 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-07-06T21:57:21.518 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T21:57:21.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.496+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/1890732589 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5cd80663d0 msgr2=0x7f5cd8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:21.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.496+0000 7f5cfc1d2640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5cd80663d0 0x7f5cd8068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4069db0 tx=0x7f5ce4009040 comp rx=0 tx=0).stop 2023-07-06T21:57:21.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.496+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/1890732589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf40b1fe0 msgr2=0x7f5cf414dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:21.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.496+0000 7f5cfc1d2640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf40b1fe0 0x7f5cf414dd60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00ae040 tx=0x7f5cf0019190 comp rx=0 tx=0).stop 2023-07-06T21:57:21.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.496+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/1890732589 shutdown_connections 2023-07-06T21:57:21.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.496+0000 7f5cfc1d2640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5cd80663d0 0x7f5cd8068880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.496+0000 7f5cfc1d2640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cf40ccab0 0x7f5cf40b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.496+0000 7f5cfc1d2640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cf40b7cd0 0x7f5cf414e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.496+0000 7f5cfc1d2640 1 --2- 172.21.15.55:0/1890732589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf40b1fe0 0x7f5cf414dd60 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.496+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/1890732589 >> 172.21.15.55:0/1890732589 conn(0x7f5cf40ceee0 msgr2=0x7f5cf406a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:21.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.496+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/1890732589 shutdown_connections 2023-07-06T21:57:21.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.496+0000 7f5cfc1d2640 1 -- 172.21.15.55:0/1890732589 wait complete. 2023-07-06T21:57:21.521 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:21.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.664+0000 7f2e790f9640 1 Processor -- start 2023-07-06T21:57:21.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.664+0000 7f2e790f9640 1 -- start start 2023-07-06T21:57:21.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e790f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e74158400 0x7f2e740c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e790f9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2e740c9680 0x7f2e74070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e790f9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7406fae0 con 0x7f2e740710c0 2023-07-06T21:57:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e790f9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7406fdc0 con 0x7f2e74158400 2023-07-06T21:57:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e790f9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e740700a0 con 0x7f2e740c9680 2023-07-06T21:57:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e72d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e74158400 0x7f2e740c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e7359e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2e740710c0 0x7f2e740cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38504/0 (socket says 172.21.15.55:38504) 2023-07-06T21:57:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e7359e640 1 -- 172.21.15.55:0/3396211564 learned_addr learned my addr 172.21.15.55:0/3396211564 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e6bfff640 1 --2- 172.21.15.55:0/3396211564 >> v2:172.21.15.138:3300/0 conn(0x7f2e740c9680 0x7f2e74070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e72d9d640 1 -- 172.21.15.55:0/3396211564 >> v2:172.21.15.138:3300/0 conn(0x7f2e740c9680 msgr2=0x7f2e74070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e72d9d640 1 --2- 172.21.15.55:0/3396211564 >> v2:172.21.15.138:3300/0 conn(0x7f2e740c9680 0x7f2e74070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e72d9d640 1 -- 172.21.15.55:0/3396211564 >> v1:172.21.15.55:6789/0 conn(0x7f2e740710c0 legacy=0x7f2e740cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e72d9d640 1 -- 172.21.15.55:0/3396211564 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e74070380 con 0x7f2e74158400 2023-07-06T21:57:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e6bfff640 1 --2- 172.21.15.55:0/3396211564 >> v2:172.21.15.138:3300/0 conn(0x7f2e740c9680 0x7f2e74070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.668+0000 7f2e7259c640 1 -- 172.21.15.55:0/3396211564 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265117904 0 0) 0x7f2e7406fae0 con 0x7f2e740710c0 2023-07-06T21:57:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.672+0000 7f2e72d9d640 1 --2- 172.21.15.55:0/3396211564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e74158400 0x7f2e740c9140 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f2e7406f060 tx=0x7f2e6401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0190003923f8384 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.672+0000 7f2e7259c640 1 -- 172.21.15.55:0/3396211564 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640ac620 con 0x7f2e74158400 2023-07-06T21:57:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.672+0000 7f2e7259c640 1 -- 172.21.15.55:0/3396211564 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e640ac780 con 0x7f2e74158400 2023-07-06T21:57:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.672+0000 7f2e7259c640 1 -- 172.21.15.55:0/3396211564 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640acb10 con 0x7f2e74158400 2023-07-06T21:57:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.672+0000 7f2e790f9640 1 -- 172.21.15.55:0/3396211564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e74158400 msgr2=0x7f2e740c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.672+0000 7f2e790f9640 1 --2- 172.21.15.55:0/3396211564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e74158400 0x7f2e740c9140 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f2e7406f060 tx=0x7f2e6401c3a0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.672+0000 7f2e790f9640 1 -- 172.21.15.55:0/3396211564 shutdown_connections 2023-07-06T21:57:21.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.672+0000 7f2e790f9640 1 --2- 172.21.15.55:0/3396211564 >> v2:172.21.15.138:3300/0 conn(0x7f2e740c9680 0x7f2e74070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.672+0000 7f2e790f9640 1 --2- 172.21.15.55:0/3396211564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e74158400 0x7f2e740c9140 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.672+0000 7f2e790f9640 1 -- 172.21.15.55:0/3396211564 >> 172.21.15.55:0/3396211564 conn(0x7f2e740cded0 msgr2=0x7f2e740ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:21.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.672+0000 7f2e790f9640 1 -- 172.21.15.55:0/3396211564 shutdown_connections 2023-07-06T21:57:21.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.672+0000 7f2e790f9640 1 -- 172.21.15.55:0/3396211564 wait complete. 2023-07-06T21:57:21.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.672+0000 7f2e790f9640 1 Processor -- start 2023-07-06T21:57:21.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.672+0000 7f2e790f9640 1 -- start start 2023-07-06T21:57:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e790f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e740710c0 0x7f2e7414ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e790f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e740c9680 0x7f2e74154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e790f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e74158400 0x7f2e74151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e790f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e741577f0 con 0x7f2e740c9680 2023-07-06T21:57:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e790f9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74156a10 con 0x7f2e74158400 2023-07-06T21:57:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e790f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74156c70 con 0x7f2e740710c0 2023-07-06T21:57:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e6bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e740c9680 0x7f2e74154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e6bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e740c9680 0x7f2e74154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56540/0 (socket says 172.21.15.55:56540) 2023-07-06T21:57:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e6bfff640 1 -- 172.21.15.55:0/2080981571 learned_addr learned my addr 172.21.15.55:0/2080981571 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e72d9d640 1 --2- 172.21.15.55:0/2080981571 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e740710c0 0x7f2e7414ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e7359e640 1 --2- 172.21.15.55:0/2080981571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e74158400 0x7f2e74151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:21.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e6bfff640 1 -- 172.21.15.55:0/2080981571 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e740710c0 msgr2=0x7f2e7414ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:21.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e6bfff640 1 --2- 172.21.15.55:0/2080981571 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e740710c0 0x7f2e7414ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e6bfff640 1 -- 172.21.15.55:0/2080981571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e74158400 msgr2=0x7f2e74151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:21.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e6bfff640 1 --2- 172.21.15.55:0/2080981571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e74158400 0x7f2e74151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e6bfff640 1 -- 172.21.15.55:0/2080981571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64009420 con 0x7f2e740c9680 2023-07-06T21:57:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e6bfff640 1 --2- 172.21.15.55:0/2080981571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e740c9680 0x7f2e74154460 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00e810 tx=0x7f2e5c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e6b7fe640 1 -- 172.21.15.55:0/2080981571 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c00c6d0 con 0x7f2e740c9680 2023-07-06T21:57:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e6b7fe640 1 -- 172.21.15.55:0/2080981571 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c00c830 con 0x7f2e740c9680 2023-07-06T21:57:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e6b7fe640 1 -- 172.21.15.55:0/2080981571 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c00cbe0 con 0x7f2e740c9680 2023-07-06T21:57:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e790f9640 1 -- 172.21.15.55:0/2080981571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e74156f50 con 0x7f2e740c9680 2023-07-06T21:57:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e790f9640 1 -- 172.21.15.55:0/2080981571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e74157510 con 0x7f2e740c9680 2023-07-06T21:57:21.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e790f9640 1 -- 172.21.15.55:0/2080981571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7406c580 con 0x7f2e740c9680 2023-07-06T21:57:21.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.676+0000 7f2e6b7fe640 1 -- 172.21.15.55:0/2080981571 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2e5c00cd40 con 0x7f2e740c9680 2023-07-06T21:57:21.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.680+0000 7f2e6b7fe640 1 --2- 172.21.15.55:0/2080981571 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2e540663d0 0x7f2e54068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:21.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.680+0000 7f2e6b7fe640 1 -- 172.21.15.55:0/2080981571 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2e5c083b50 con 0x7f2e740c9680 2023-07-06T21:57:21.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.680+0000 7f2e72d9d640 1 --2- 172.21.15.55:0/2080981571 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2e540663d0 0x7f2e54068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:21.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.680+0000 7f2e72d9d640 1 --2- 172.21.15.55:0/2080981571 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2e540663d0 0x7f2e54068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e640ae000 tx=0x7f2e640a7000 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.684+0000 7f2e6b7fe640 1 -- 172.21.15.55:0/2080981571 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e5c0549b0 con 0x7f2e740c9680 2023-07-06T21:57:21.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.836+0000 7f2e790f9640 1 -- 172.21.15.55:0/2080981571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e74066d60 con 0x7f2e740c9680 2023-07-06T21:57:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.840+0000 7f2e6b7fe640 1 -- 172.21.15.55:0/2080981571 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+14832 (secure 0 0 0) 0x7f2e5c054540 con 0x7f2e740c9680 2023-07-06T21:57:21.838 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:21.838 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":85,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:57:21.091239+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:21.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.840+0000 7f2e790f9640 1 -- 172.21.15.55:0/2080981571 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2e540663d0 msgr2=0x7f2e54068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.840+0000 7f2e790f9640 1 --2- 172.21.15.55:0/2080981571 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2e540663d0 0x7f2e54068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e640ae000 tx=0x7f2e640a7000 comp rx=0 tx=0).stop 2023-07-06T21:57:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.840+0000 7f2e790f9640 1 -- 172.21.15.55:0/2080981571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e740c9680 msgr2=0x7f2e74154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.840+0000 7f2e790f9640 1 --2- 172.21.15.55:0/2080981571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e740c9680 0x7f2e74154460 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00e810 tx=0x7f2e5c00ecd0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.840+0000 7f2e790f9640 1 -- 172.21.15.55:0/2080981571 shutdown_connections 2023-07-06T21:57:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.840+0000 7f2e790f9640 1 --2- 172.21.15.55:0/2080981571 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2e540663d0 0x7f2e54068880 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.840+0000 7f2e790f9640 1 --2- 172.21.15.55:0/2080981571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e74158400 0x7f2e74151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.840+0000 7f2e790f9640 1 --2- 172.21.15.55:0/2080981571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e740c9680 0x7f2e74154460 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.840+0000 7f2e790f9640 1 --2- 172.21.15.55:0/2080981571 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e740710c0 0x7f2e7414ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.840+0000 7f2e790f9640 1 -- 172.21.15.55:0/2080981571 >> 172.21.15.55:0/2080981571 conn(0x7f2e740cded0 msgr2=0x7f2e740ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.840+0000 7f2e790f9640 1 -- 172.21.15.55:0/2080981571 shutdown_connections 2023-07-06T21:57:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:21.840+0000 7f2e790f9640 1 -- 172.21.15.55:0/2080981571 wait complete. 2023-07-06T21:57:21.859 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:57:21.860 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:57:22.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11cd51e640 1 Processor -- start 2023-07-06T21:57:22.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11cd51e640 1 -- start start 2023-07-06T21:57:22.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11cd51e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11c8156180 0x7f11c80ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11cd51e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f11c80cbeb0 0x7f11c806ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11cd51e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c806f360 con 0x7f11c806e9d0 2023-07-06T21:57:22.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11cd51e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c8160250 con 0x7f11c80cbeb0 2023-07-06T21:57:22.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11cd51e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80cc310 con 0x7f11c8156180 2023-07-06T21:57:22.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11c77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f11c80cbeb0 0x7f11c806ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11c77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f11c80cbeb0 0x7f11c806ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56544/0 (socket says 172.21.15.55:56544) 2023-07-06T21:57:22.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11c77fe640 1 -- 172.21.15.55:0/149642184 learned_addr learned my addr 172.21.15.55:0/149642184 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:22.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11c6ffd640 1 --2- 172.21.15.55:0/149642184 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11c8156180 0x7f11c80ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11c77fe640 1 -- 172.21.15.55:0/149642184 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11c8156180 msgr2=0x7f11c80ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:22.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11c77fe640 1 --2- 172.21.15.55:0/149642184 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11c8156180 0x7f11c80ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11c77fe640 1 -- 172.21.15.55:0/149642184 >> v1:172.21.15.138:6789/0 conn(0x7f11c806e9d0 legacy=0x7f11c80cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:22.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11c77fe640 1 -- 172.21.15.55:0/149642184 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c815f5d0 con 0x7f11c80cbeb0 2023-07-06T21:57:22.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.008+0000 7f11c6ffd640 1 --2- 172.21.15.55:0/149642184 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11c8156180 0x7f11c80ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:22.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.012+0000 7f11c77fe640 1 --2- 172.21.15.55:0/149642184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c80cbeb0 0x7f11c806ee20 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009e50 tx=0x7f11c001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfd5088576fd161 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:22.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.012+0000 7f11c67fc640 1 -- 172.21.15.55:0/149642184 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00a5790 con 0x7f11c80cbeb0 2023-07-06T21:57:22.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.012+0000 7f11c67fc640 1 -- 172.21.15.55:0/149642184 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c00a58f0 con 0x7f11c80cbeb0 2023-07-06T21:57:22.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.012+0000 7f11c67fc640 1 -- 172.21.15.55:0/149642184 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00a5c80 con 0x7f11c80cbeb0 2023-07-06T21:57:22.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.012+0000 7f11cd51e640 1 -- 172.21.15.55:0/149642184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c80cbeb0 msgr2=0x7f11c806ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.012+0000 7f11cd51e640 1 --2- 172.21.15.55:0/149642184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c80cbeb0 0x7f11c806ee20 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009e50 tx=0x7f11c001c910 comp rx=0 tx=0).stop 2023-07-06T21:57:22.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.012+0000 7f11cd51e640 1 -- 172.21.15.55:0/149642184 shutdown_connections 2023-07-06T21:57:22.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.012+0000 7f11cd51e640 1 --2- 172.21.15.55:0/149642184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c80cbeb0 0x7f11c806ee20 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.012+0000 7f11cd51e640 1 --2- 172.21.15.55:0/149642184 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11c8156180 0x7f11c80ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.012+0000 7f11cd51e640 1 -- 172.21.15.55:0/149642184 >> 172.21.15.55:0/149642184 conn(0x7f11c80d0c50 msgr2=0x7f11c80cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:22.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.012+0000 7f11cd51e640 1 -- 172.21.15.55:0/149642184 shutdown_connections 2023-07-06T21:57:22.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.012+0000 7f11cd51e640 1 -- 172.21.15.55:0/149642184 wait complete. 2023-07-06T21:57:22.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11cd51e640 1 Processor -- start 2023-07-06T21:57:22.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11cd51e640 1 -- start start 2023-07-06T21:57:22.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11cd51e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11c806e9d0 0x7f11c814dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11cd51e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11c80cbeb0 0x7f11c81f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11cd51e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c8156180 0x7f11c81f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11cd51e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c814d2d0 con 0x7f11c8156180 2023-07-06T21:57:22.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11cd51e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c814cd10 con 0x7f11c806e9d0 2023-07-06T21:57:22.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11cd51e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c814cff0 con 0x7f11c80cbeb0 2023-07-06T21:57:22.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11c77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c8156180 0x7f11c81f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11c77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c8156180 0x7f11c81f7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56560/0 (socket says 172.21.15.55:56560) 2023-07-06T21:57:22.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11c77fe640 1 -- 172.21.15.55:0/1932054810 learned_addr learned my addr 172.21.15.55:0/1932054810 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:22.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11c6ffd640 1 --2- 172.21.15.55:0/1932054810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11c806e9d0 0x7f11c814dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11bffff640 1 --2- 172.21.15.55:0/1932054810 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11c80cbeb0 0x7f11c81f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11c77fe640 1 -- 172.21.15.55:0/1932054810 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11c80cbeb0 msgr2=0x7f11c81f7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11c77fe640 1 --2- 172.21.15.55:0/1932054810 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11c80cbeb0 0x7f11c81f7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11c77fe640 1 -- 172.21.15.55:0/1932054810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11c806e9d0 msgr2=0x7f11c814dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11c77fe640 1 --2- 172.21.15.55:0/1932054810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11c806e9d0 0x7f11c814dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11c77fe640 1 -- 172.21.15.55:0/1932054810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c0009b30 con 0x7f11c8156180 2023-07-06T21:57:22.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11c77fe640 1 --2- 172.21.15.55:0/1932054810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c8156180 0x7f11c81f7da0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f11c001afc0 tx=0x7f11c00196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:22.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11bf7fe640 1 -- 172.21.15.55:0/1932054810 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00b8670 con 0x7f11c8156180 2023-07-06T21:57:22.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11bf7fe640 1 -- 172.21.15.55:0/1932054810 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c00b87d0 con 0x7f11c8156180 2023-07-06T21:57:22.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11bf7fe640 1 -- 172.21.15.55:0/1932054810 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00b8b80 con 0x7f11c8156180 2023-07-06T21:57:22.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11cd51e640 1 -- 172.21.15.55:0/1932054810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c8150700 con 0x7f11c8156180 2023-07-06T21:57:22.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.016+0000 7f11cd51e640 1 -- 172.21.15.55:0/1932054810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c814e320 con 0x7f11c8156180 2023-07-06T21:57:22.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.020+0000 7f11cd51e640 1 -- 172.21.15.55:0/1932054810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c814e4b0 con 0x7f11c8156180 2023-07-06T21:57:22.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.020+0000 7f11bf7fe640 1 -- 172.21.15.55:0/1932054810 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f11c00b8ce0 con 0x7f11c8156180 2023-07-06T21:57:22.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.020+0000 7f11bf7fe640 1 --2- 172.21.15.55:0/1932054810 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f11a80663a0 0x7f11a8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.020+0000 7f11bf7fe640 1 -- 172.21.15.55:0/1932054810 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f11c011f250 con 0x7f11c8156180 2023-07-06T21:57:22.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.020+0000 7f11c6ffd640 1 --2- 172.21.15.55:0/1932054810 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f11a80663a0 0x7f11a8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.020+0000 7f11c6ffd640 1 --2- 172.21.15.55:0/1932054810 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f11a80663a0 0x7f11a8068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f11b8006fd0 tx=0x7f11b8008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:22.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.024+0000 7f11bf7fe640 1 -- 172.21.15.55:0/1932054810 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11c00eca40 con 0x7f11c8156180 2023-07-06T21:57:22.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.180+0000 7f11cd51e640 1 -- 172.21.15.55:0/1932054810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11c806f360 con 0x7f11c8156180 2023-07-06T21:57:22.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.180+0000 7f11bf7fe640 1 -- 172.21.15.55:0/1932054810 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f11c806f360 con 0x7f11c8156180 2023-07-06T21:57:22.179 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:57:22.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.184+0000 7f11cd51e640 1 -- 172.21.15.55:0/1932054810 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f11a80663a0 msgr2=0x7f11a8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.184+0000 7f11cd51e640 1 --2- 172.21.15.55:0/1932054810 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f11a80663a0 0x7f11a8068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f11b8006fd0 tx=0x7f11b8008040 comp rx=0 tx=0).stop 2023-07-06T21:57:22.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.184+0000 7f11cd51e640 1 -- 172.21.15.55:0/1932054810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c8156180 msgr2=0x7f11c81f7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.184+0000 7f11cd51e640 1 --2- 172.21.15.55:0/1932054810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c8156180 0x7f11c81f7da0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f11c001afc0 tx=0x7f11c00196b0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.184+0000 7f11cd51e640 1 -- 172.21.15.55:0/1932054810 shutdown_connections 2023-07-06T21:57:22.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.184+0000 7f11cd51e640 1 --2- 172.21.15.55:0/1932054810 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f11a80663a0 0x7f11a8068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.184+0000 7f11cd51e640 1 --2- 172.21.15.55:0/1932054810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c8156180 0x7f11c81f7da0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.184+0000 7f11cd51e640 1 --2- 172.21.15.55:0/1932054810 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11c80cbeb0 0x7f11c81f7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.184+0000 7f11cd51e640 1 --2- 172.21.15.55:0/1932054810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11c806e9d0 0x7f11c814dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.184+0000 7f11cd51e640 1 -- 172.21.15.55:0/1932054810 >> 172.21.15.55:0/1932054810 conn(0x7f11c80d0c50 msgr2=0x7f11c815d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:22.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.184+0000 7f11cd51e640 1 -- 172.21.15.55:0/1932054810 shutdown_connections 2023-07-06T21:57:22.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.184+0000 7f11cd51e640 1 -- 172.21.15.55:0/1932054810 wait complete. 2023-07-06T21:57:22.200 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:57:22.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e7a48640 1 Processor -- start 2023-07-06T21:57:22.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e7a48640 1 -- start start 2023-07-06T21:57:22.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e7a48640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6e015ba30 0x7fd6e00cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e7a48640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd6e00ad0c0 0x7fd6e009ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e7a48640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e009d780 con 0x7fd6e009d340 2023-07-06T21:57:22.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e7a48640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e00c83a0 con 0x7fd6e015ba30 2023-07-06T21:57:22.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e7a48640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e00ccbb0 con 0x7fd6e00ad0c0 2023-07-06T21:57:22.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e57e4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6e015ba30 0x7fd6e00cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e57e4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6e015ba30 0x7fd6e00cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56562/0 (socket says 172.21.15.55:56562) 2023-07-06T21:57:22.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e57e4640 1 -- 172.21.15.55:0/219839801 learned_addr learned my addr 172.21.15.55:0/219839801 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:22.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e5fe5640 1 --1- 172.21.15.55:0/219839801 >> v1:172.21.15.55:6789/0 conn(0x7fd6e009d340 0x7fd6e015f6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38518/0 (socket says 172.21.15.55:38518) 2023-07-06T21:57:22.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e4fe3640 1 --2- 172.21.15.55:0/219839801 >> v2:172.21.15.138:3300/0 conn(0x7fd6e00ad0c0 0x7fd6e009ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e57e4640 1 -- 172.21.15.55:0/219839801 >> v2:172.21.15.138:3300/0 conn(0x7fd6e00ad0c0 msgr2=0x7fd6e009ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:22.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e57e4640 1 --2- 172.21.15.55:0/219839801 >> v2:172.21.15.138:3300/0 conn(0x7fd6e00ad0c0 0x7fd6e009ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6d7fff640 1 -- 172.21.15.55:0/219839801 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022833730 0 0) 0x7fd6e009d780 con 0x7fd6e009d340 2023-07-06T21:57:22.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e57e4640 1 -- 172.21.15.55:0/219839801 >> v1:172.21.15.55:6789/0 conn(0x7fd6e009d340 legacy=0x7fd6e015f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e57e4640 1 -- 172.21.15.55:0/219839801 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e00cce90 con 0x7fd6e015ba30 2023-07-06T21:57:22.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.348+0000 7fd6e4fe3640 1 --2- 172.21.15.55:0/219839801 >> v2:172.21.15.138:3300/0 conn(0x7fd6e00ad0c0 0x7fd6e009ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:22.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.352+0000 7fd6e57e4640 1 --2- 172.21.15.55:0/219839801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6e015ba30 0x7fd6e00cd800 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd6e006ea90 tx=0x7fd6dc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd7626983a24375 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:22.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.352+0000 7fd6d7fff640 1 -- 172.21.15.55:0/219839801 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0aa430 con 0x7fd6e015ba30 2023-07-06T21:57:22.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.352+0000 7fd6d7fff640 1 -- 172.21.15.55:0/219839801 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc0aa590 con 0x7fd6e015ba30 2023-07-06T21:57:22.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.352+0000 7fd6d7fff640 1 -- 172.21.15.55:0/219839801 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0aa920 con 0x7fd6e015ba30 2023-07-06T21:57:22.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.352+0000 7fd6e7a48640 1 -- 172.21.15.55:0/219839801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6e015ba30 msgr2=0x7fd6e00cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.352+0000 7fd6e7a48640 1 --2- 172.21.15.55:0/219839801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6e015ba30 0x7fd6e00cd800 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd6e006ea90 tx=0x7fd6dc01c4d0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.352+0000 7fd6e7a48640 1 -- 172.21.15.55:0/219839801 shutdown_connections 2023-07-06T21:57:22.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.352+0000 7fd6e7a48640 1 --2- 172.21.15.55:0/219839801 >> v2:172.21.15.138:3300/0 conn(0x7fd6e00ad0c0 0x7fd6e009ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.352+0000 7fd6e7a48640 1 --2- 172.21.15.55:0/219839801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6e015ba30 0x7fd6e00cd800 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.352+0000 7fd6e7a48640 1 -- 172.21.15.55:0/219839801 >> 172.21.15.55:0/219839801 conn(0x7fd6e00cea70 msgr2=0x7fd6e00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:22.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.352+0000 7fd6e7a48640 1 -- 172.21.15.55:0/219839801 shutdown_connections 2023-07-06T21:57:22.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.352+0000 7fd6e7a48640 1 -- 172.21.15.55:0/219839801 wait complete. 2023-07-06T21:57:22.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.352+0000 7fd6e7a48640 1 Processor -- start 2023-07-06T21:57:22.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e7a48640 1 -- start start 2023-07-06T21:57:22.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e7a48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6e009d340 0x7fd6e0152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e7a48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6e00ad0c0 0x7fd6e0155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e7a48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd6e015ba30 0x7fd6e01563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e7a48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e0153310 con 0x7fd6e009d340 2023-07-06T21:57:22.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e7a48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e0154b50 con 0x7fd6e00ad0c0 2023-07-06T21:57:22.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e7a48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e0153f40 con 0x7fd6e015ba30 2023-07-06T21:57:22.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e57e4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6e009d340 0x7fd6e0152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e57e4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6e009d340 0x7fd6e0152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56566/0 (socket says 172.21.15.55:56566) 2023-07-06T21:57:22.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e57e4640 1 -- 172.21.15.55:0/284037056 learned_addr learned my addr 172.21.15.55:0/284037056 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e57e4640 1 -- 172.21.15.55:0/284037056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd6e015ba30 msgr2=0x7fd6e01563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e5fe5640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd6e015ba30 0x7fd6e01563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e4fe3640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6e00ad0c0 0x7fd6e0155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e57e4640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd6e015ba30 0x7fd6e01563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e57e4640 1 -- 172.21.15.55:0/284037056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6e00ad0c0 msgr2=0x7fd6e0155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e57e4640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6e00ad0c0 0x7fd6e0155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e57e4640 1 -- 172.21.15.55:0/284037056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0094d0 con 0x7fd6e009d340 2023-07-06T21:57:22.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e5fe5640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd6e015ba30 0x7fd6e01563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:22.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e4fe3640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6e00ad0c0 0x7fd6e0155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:22.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e57e4640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6e009d340 0x7fd6e0152dd0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0190e0 tx=0x7fd6dc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:22.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6d5ffb640 1 -- 172.21.15.55:0/284037056 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0b3800 con 0x7fd6e009d340 2023-07-06T21:57:22.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6d5ffb640 1 -- 172.21.15.55:0/284037056 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc0b3960 con 0x7fd6e009d340 2023-07-06T21:57:22.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e7a48640 1 -- 172.21.15.55:0/284037056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e0154220 con 0x7fd6e009d340 2023-07-06T21:57:22.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6d5ffb640 1 -- 172.21.15.55:0/284037056 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0b3cf0 con 0x7fd6e009d340 2023-07-06T21:57:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e7a48640 1 -- 172.21.15.55:0/284037056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e01547e0 con 0x7fd6e009d340 2023-07-06T21:57:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.356+0000 7fd6e7a48640 1 -- 172.21.15.55:0/284037056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e0066d60 con 0x7fd6e009d340 2023-07-06T21:57:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.360+0000 7fd6d5ffb640 1 -- 172.21.15.55:0/284037056 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd6dc0b2380 con 0x7fd6e009d340 2023-07-06T21:57:22.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.360+0000 7fd6d5ffb640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fd6c40663a0 0x7fd6c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.360+0000 7fd6d5ffb640 1 -- 172.21.15.55:0/284037056 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd6dc11dff0 con 0x7fd6e009d340 2023-07-06T21:57:22.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.360+0000 7fd6e4fe3640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fd6c40663a0 0x7fd6c4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.360+0000 7fd6e4fe3640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fd6c40663a0 0x7fd6c4068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00b0500 tx=0x7fd6d0008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:22.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.364+0000 7fd6d5ffb640 1 -- 172.21.15.55:0/284037056 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6dc0eb470 con 0x7fd6e009d340 2023-07-06T21:57:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.516+0000 7fd6e7a48640 1 -- 172.21.15.55:0/284037056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd6e00cb6c0 con 0x7fd6e009d340 2023-07-06T21:57:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.516+0000 7fd6d5ffb640 1 -- 172.21.15.55:0/284037056 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v85) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd6dc0c30a0 con 0x7fd6e009d340 2023-07-06T21:57:22.516 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:57:22.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.520+0000 7fd6e7a48640 1 -- 172.21.15.55:0/284037056 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fd6c40663a0 msgr2=0x7fd6c4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.520+0000 7fd6e7a48640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fd6c40663a0 0x7fd6c4068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00b0500 tx=0x7fd6d0008040 comp rx=0 tx=0).stop 2023-07-06T21:57:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.520+0000 7fd6e7a48640 1 -- 172.21.15.55:0/284037056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6e009d340 msgr2=0x7fd6e0152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.520+0000 7fd6e7a48640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6e009d340 0x7fd6e0152dd0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0190e0 tx=0x7fd6dc01ad10 comp rx=0 tx=0).stop 2023-07-06T21:57:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.520+0000 7fd6e7a48640 1 -- 172.21.15.55:0/284037056 shutdown_connections 2023-07-06T21:57:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.520+0000 7fd6e7a48640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fd6c40663a0 0x7fd6c4068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.520+0000 7fd6e7a48640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd6e015ba30 0x7fd6e01563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.520+0000 7fd6e7a48640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6e00ad0c0 0x7fd6e0155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.520+0000 7fd6e7a48640 1 --2- 172.21.15.55:0/284037056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6e009d340 0x7fd6e0152dd0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.520+0000 7fd6e7a48640 1 -- 172.21.15.55:0/284037056 >> 172.21.15.55:0/284037056 conn(0x7fd6e00cea70 msgr2=0x7fd6e006f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.520+0000 7fd6e7a48640 1 -- 172.21.15.55:0/284037056 shutdown_connections 2023-07-06T21:57:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.520+0000 7fd6e7a48640 1 -- 172.21.15.55:0/284037056 wait complete. 2023-07-06T21:57:22.537 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T21:57:22.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f9e93640 1 Processor -- start 2023-07-06T21:57:22.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f9e93640 1 -- start start 2023-07-06T21:57:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f9e93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71f40c8d80 0x7f71f40cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f9e93640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f71f406bb60 0x7f71f406bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f9e93640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f406c4f0 con 0x7f71f40c89b0 2023-07-06T21:57:22.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f9e93640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f40cce70 con 0x7f71f406bb60 2023-07-06T21:57:22.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f9e93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f415c8a0 con 0x7f71f40c8d80 2023-07-06T21:57:22.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f2ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71f40c8d80 0x7f71f40cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f3fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f71f406bb60 0x7f71f406bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f2ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71f40c8d80 0x7f71f40cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:37204/0 (socket says 172.21.15.55:37204) 2023-07-06T21:57:22.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f37fe640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f71f40c89b0 0x7f71f40cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:49478/0 (socket says 172.21.15.55:49478) 2023-07-06T21:57:22.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f2ffd640 1 -- 172.21.15.55:0/668161102 learned_addr learned my addr 172.21.15.55:0/668161102 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:22.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f3fff640 1 -- 172.21.15.55:0/668161102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71f40c8d80 msgr2=0x7f71f40cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:22.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f3fff640 1 --2- 172.21.15.55:0/668161102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71f40c8d80 0x7f71f40cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f3fff640 1 -- 172.21.15.55:0/668161102 >> v1:172.21.15.138:6789/0 conn(0x7f71f40c89b0 legacy=0x7f71f40cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f3fff640 1 -- 172.21.15.55:0/668161102 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f40cdb70 con 0x7f71f406bb60 2023-07-06T21:57:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.684+0000 7f71f27fc640 1 -- 172.21.15.55:0/668161102 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611971179 0 0) 0x7f71e4001120 con 0x7f71f40c89b0 2023-07-06T21:57:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.688+0000 7f71f3fff640 1 --2- 172.21.15.55:0/668161102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71f406bb60 0x7f71f406bfb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009d90 tx=0x7f71ec01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76591e92d069d122 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:22.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.688+0000 7f71f27fc640 1 -- 172.21.15.55:0/668161102 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0a5960 con 0x7f71f406bb60 2023-07-06T21:57:22.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.688+0000 7f71f27fc640 1 -- 172.21.15.55:0/668161102 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec0a5ac0 con 0x7f71f406bb60 2023-07-06T21:57:22.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.688+0000 7f71f27fc640 1 -- 172.21.15.55:0/668161102 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0a5e50 con 0x7f71f406bb60 2023-07-06T21:57:22.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.688+0000 7f71f9e93640 1 -- 172.21.15.55:0/668161102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71f406bb60 msgr2=0x7f71f406bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.688+0000 7f71f9e93640 1 --2- 172.21.15.55:0/668161102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71f406bb60 0x7f71f406bfb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009d90 tx=0x7f71ec01c920 comp rx=0 tx=0).stop 2023-07-06T21:57:22.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.688+0000 7f71f9e93640 1 -- 172.21.15.55:0/668161102 shutdown_connections 2023-07-06T21:57:22.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.688+0000 7f71f9e93640 1 --2- 172.21.15.55:0/668161102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71f406bb60 0x7f71f406bfb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.688+0000 7f71f9e93640 1 --2- 172.21.15.55:0/668161102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71f40c8d80 0x7f71f40cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.688+0000 7f71f9e93640 1 -- 172.21.15.55:0/668161102 >> 172.21.15.55:0/668161102 conn(0x7f71f40cded0 msgr2=0x7f71f40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:22.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.688+0000 7f71f9e93640 1 -- 172.21.15.55:0/668161102 shutdown_connections 2023-07-06T21:57:22.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.688+0000 7f71f9e93640 1 -- 172.21.15.55:0/668161102 wait complete. 2023-07-06T21:57:22.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f9e93640 1 Processor -- start 2023-07-06T21:57:22.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f9e93640 1 -- start start 2023-07-06T21:57:22.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f9e93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71f406bb60 0x7f71f40c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f9e93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71f40c89b0 0x7f71f4070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f9e93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71f40c8d80 0x7f71f40705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f9e93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4071130 con 0x7f71f406bb60 2023-07-06T21:57:22.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f9e93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4153770 con 0x7f71f40c8d80 2023-07-06T21:57:22.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f9e93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4153a50 con 0x7f71f40c89b0 2023-07-06T21:57:22.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71f406bb60 0x7f71f40c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71f406bb60 0x7f71f40c0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56574/0 (socket says 172.21.15.55:56574) 2023-07-06T21:57:22.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f37fe640 1 -- 172.21.15.55:0/4293449323 learned_addr learned my addr 172.21.15.55:0/4293449323 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:22.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f3fff640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71f40c8d80 0x7f71f40705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f2ffd640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71f40c89b0 0x7f71f4070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f37fe640 1 -- 172.21.15.55:0/4293449323 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71f40c89b0 msgr2=0x7f71f4070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f37fe640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71f40c89b0 0x7f71f4070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f37fe640 1 -- 172.21.15.55:0/4293449323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71f40c8d80 msgr2=0x7f71f40705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f37fe640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71f40c8d80 0x7f71f40705d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f37fe640 1 -- 172.21.15.55:0/4293449323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec009a70 con 0x7f71f406bb60 2023-07-06T21:57:22.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f2ffd640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71f40c89b0 0x7f71f4070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:22.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f37fe640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71f406bb60 0x7f71f40c0bb0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f71e400c410 tx=0x7f71e400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:22.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71dbfff640 1 -- 172.21.15.55:0/4293449323 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40074e0 con 0x7f71f406bb60 2023-07-06T21:57:22.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71dbfff640 1 -- 172.21.15.55:0/4293449323 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e4007640 con 0x7f71f406bb60 2023-07-06T21:57:22.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71dbfff640 1 -- 172.21.15.55:0/4293449323 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4004a30 con 0x7f71f406bb60 2023-07-06T21:57:22.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f9e93640 1 -- 172.21.15.55:0/4293449323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f4153d30 con 0x7f71f406bb60 2023-07-06T21:57:22.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.692+0000 7f71f9e93640 1 -- 172.21.15.55:0/4293449323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f40b3ad0 con 0x7f71f406bb60 2023-07-06T21:57:22.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.696+0000 7f71f9e93640 1 -- 172.21.15.55:0/4293449323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f4153f50 con 0x7f71f406bb60 2023-07-06T21:57:22.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.696+0000 7f71dbfff640 1 -- 172.21.15.55:0/4293449323 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f71e4004b90 con 0x7f71f406bb60 2023-07-06T21:57:22.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.696+0000 7f71dbfff640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f71e00663a0 0x7f71e0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:22.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.696+0000 7f71dbfff640 1 -- 172.21.15.55:0/4293449323 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f71e4083780 con 0x7f71f406bb60 2023-07-06T21:57:22.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.696+0000 7f71f2ffd640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f71e00663a0 0x7f71e0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:22.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.696+0000 7f71f2ffd640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f71e00663a0 0x7f71e0068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f71f4157db0 tx=0x7f71e8008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:22.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.700+0000 7f71dbfff640 1 -- 172.21.15.55:0/4293449323 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f71e4050d90 con 0x7f71f406bb60 2023-07-06T21:57:22.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.860+0000 7f71f9e93640 1 -- 172.21.15.55:0/4293449323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f71f41535a0 con 0x7f71f406bb60 2023-07-06T21:57:22.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.860+0000 7f71dbfff640 1 -- 172.21.15.55:0/4293449323 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v85) v1 ==== 84+0+126 (secure 0 0 0) 0x7f71e40543b0 con 0x7f71f406bb60 2023-07-06T21:57:22.858 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:22.858 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T21:57:22.858 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:22.858 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-07-06T21:57:22.858 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-07-06T21:57:22.858 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:22.858 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:22.859 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-07-06T21:57:22.859 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-07-06T21:57:22.859 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:22.859 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T21:57:22.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.860+0000 7f71f9e93640 1 -- 172.21.15.55:0/4293449323 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f71e00663a0 msgr2=0x7f71e0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.860+0000 7f71f9e93640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f71e00663a0 0x7f71e0068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f71f4157db0 tx=0x7f71e8008040 comp rx=0 tx=0).stop 2023-07-06T21:57:22.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.860+0000 7f71f9e93640 1 -- 172.21.15.55:0/4293449323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71f406bb60 msgr2=0x7f71f40c0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:22.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.860+0000 7f71f9e93640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71f406bb60 0x7f71f40c0bb0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f71e400c410 tx=0x7f71e400c8d0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.860+0000 7f71f9e93640 1 -- 172.21.15.55:0/4293449323 shutdown_connections 2023-07-06T21:57:22.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.860+0000 7f71f9e93640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f71e00663a0 0x7f71e0068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.860+0000 7f71f9e93640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71f40c8d80 0x7f71f40705d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.860+0000 7f71f9e93640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71f40c89b0 0x7f71f4070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.860+0000 7f71f9e93640 1 --2- 172.21.15.55:0/4293449323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71f406bb60 0x7f71f40c0bb0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:22.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.860+0000 7f71f9e93640 1 -- 172.21.15.55:0/4293449323 >> 172.21.15.55:0/4293449323 conn(0x7f71f40cded0 msgr2=0x7f71f4156430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:22.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.860+0000 7f71f9e93640 1 -- 172.21.15.55:0/4293449323 shutdown_connections 2023-07-06T21:57:22.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:22.860+0000 7f71f9e93640 1 -- 172.21.15.55:0/4293449323 wait complete. 2023-07-06T21:57:22.879 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T21:57:22.879 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T21:57:23.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.028+0000 7f8a66f82640 1 Processor -- start 2023-07-06T21:57:23.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.028+0000 7f8a66f82640 1 -- start start 2023-07-06T21:57:23.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.032+0000 7f8a66f82640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8a600c89b0 0x7f8a600c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:23.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.032+0000 7f8a66f82640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a60158b50 con 0x7f8a600cbfa0 2023-07-06T21:57:23.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.032+0000 7f8a66f82640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a600c9350 con 0x7f8a60158780 2023-07-06T21:57:23.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.032+0000 7f8a66f82640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6006fb00 con 0x7f8a600c89b0 2023-07-06T21:57:23.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.032+0000 7f8a5ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8a600cbfa0 0x7f8a6006f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38524/0 (socket says 172.21.15.55:38524) 2023-07-06T21:57:23.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.032+0000 7f8a5ffff640 1 -- 172.21.15.55:0/3540002132 learned_addr learned my addr 172.21.15.55:0/3540002132 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.032+0000 7f8a6551f640 1 --2- 172.21.15.55:0/3540002132 >> v2:172.21.15.138:3300/0 conn(0x7f8a600c89b0 0x7f8a600c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.032+0000 7f8a5f7fe640 1 -- 172.21.15.55:0/3540002132 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245892728 0 0) 0x7f8a60158b50 con 0x7f8a600cbfa0 2023-07-06T21:57:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.032+0000 7f8a5f7fe640 1 -- 172.21.15.55:0/3540002132 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a50003530 con 0x7f8a600cbfa0 2023-07-06T21:57:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.032+0000 7f8a6551f640 1 -- 172.21.15.55:0/3540002132 >> v1:172.21.15.138:6789/0 conn(0x7f8a60158780 legacy=0x7f8a600cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.032+0000 7f8a5f7fe640 1 -- 172.21.15.55:0/3540002132 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149562029 0 0) 0x7f8a600c9350 con 0x7f8a60158780 2023-07-06T21:57:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.032+0000 7f8a6551f640 1 -- 172.21.15.55:0/3540002132 >> v1:172.21.15.55:6789/0 conn(0x7f8a600cbfa0 legacy=0x7f8a6006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.032+0000 7f8a6551f640 1 -- 172.21.15.55:0/3540002132 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6006b390 con 0x7f8a600c89b0 2023-07-06T21:57:23.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.036+0000 7f8a6551f640 1 --2- 172.21.15.55:0/3540002132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a600c89b0 0x7f8a600c8e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009d90 tx=0x7f8a5801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fc40c3b00ef22e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:23.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.036+0000 7f8a5f7fe640 1 -- 172.21.15.55:0/3540002132 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a580a5870 con 0x7f8a600c89b0 2023-07-06T21:57:23.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.036+0000 7f8a5f7fe640 1 -- 172.21.15.55:0/3540002132 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a580a59d0 con 0x7f8a600c89b0 2023-07-06T21:57:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.036+0000 7f8a5f7fe640 1 -- 172.21.15.55:0/3540002132 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a580a5d60 con 0x7f8a600c89b0 2023-07-06T21:57:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.036+0000 7f8a66f82640 1 -- 172.21.15.55:0/3540002132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a600c89b0 msgr2=0x7f8a600c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.036+0000 7f8a66f82640 1 --2- 172.21.15.55:0/3540002132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a600c89b0 0x7f8a600c8e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009d90 tx=0x7f8a5801c8c0 comp rx=0 tx=0).stop 2023-07-06T21:57:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.036+0000 7f8a66f82640 1 -- 172.21.15.55:0/3540002132 shutdown_connections 2023-07-06T21:57:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.036+0000 7f8a66f82640 1 --2- 172.21.15.55:0/3540002132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a600c89b0 0x7f8a600c8e10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.036+0000 7f8a66f82640 1 -- 172.21.15.55:0/3540002132 >> 172.21.15.55:0/3540002132 conn(0x7f8a600cde30 msgr2=0x7f8a600ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.036+0000 7f8a66f82640 1 -- 172.21.15.55:0/3540002132 shutdown_connections 2023-07-06T21:57:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.036+0000 7f8a66f82640 1 -- 172.21.15.55:0/3540002132 wait complete. 2023-07-06T21:57:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.036+0000 7f8a66f82640 1 Processor -- start 2023-07-06T21:57:23.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.036+0000 7f8a66f82640 1 -- start start 2023-07-06T21:57:23.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a66f82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a600c89b0 0x7f8a601576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:23.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a66f82640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a600cbfa0 0x7f8a601522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:23.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a66f82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a60158780 0x7f8a601514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:23.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a66f82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6014e520 con 0x7f8a600c89b0 2023-07-06T21:57:23.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a66f82640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6014ff90 con 0x7f8a600cbfa0 2023-07-06T21:57:23.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a66f82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6014df60 con 0x7f8a60158780 2023-07-06T21:57:23.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a64d1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a600c89b0 0x7f8a601576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:23.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a64d1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a600c89b0 0x7f8a601576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56580/0 (socket says 172.21.15.55:56580) 2023-07-06T21:57:23.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a64d1e640 1 -- 172.21.15.55:0/2596964861 learned_addr learned my addr 172.21.15.55:0/2596964861 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:23.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a5ffff640 1 --2- 172.21.15.55:0/2596964861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a600cbfa0 0x7f8a601522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:23.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a6551f640 1 --2- 172.21.15.55:0/2596964861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a60158780 0x7f8a601514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:23.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a64d1e640 1 -- 172.21.15.55:0/2596964861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a60158780 msgr2=0x7f8a601514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:23.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a64d1e640 1 --2- 172.21.15.55:0/2596964861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a60158780 0x7f8a601514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:23.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a64d1e640 1 -- 172.21.15.55:0/2596964861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a600cbfa0 msgr2=0x7f8a601522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:23.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a64d1e640 1 --2- 172.21.15.55:0/2596964861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a600cbfa0 0x7f8a601522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:23.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a64d1e640 1 -- 172.21.15.55:0/2596964861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a58009a70 con 0x7f8a600c89b0 2023-07-06T21:57:23.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a64d1e640 1 --2- 172.21.15.55:0/2596964861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a600c89b0 0x7f8a601576c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400c410 tx=0x7f8a5400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:23.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a5d7fa640 1 -- 172.21.15.55:0/2596964861 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a540054e0 con 0x7f8a600c89b0 2023-07-06T21:57:23.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a5d7fa640 1 -- 172.21.15.55:0/2596964861 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a54003600 con 0x7f8a600c89b0 2023-07-06T21:57:23.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a5d7fa640 1 -- 172.21.15.55:0/2596964861 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a540039b0 con 0x7f8a600c89b0 2023-07-06T21:57:23.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a66f82640 1 -- 172.21.15.55:0/2596964861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6014e240 con 0x7f8a600c89b0 2023-07-06T21:57:23.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a66f82640 1 -- 172.21.15.55:0/2596964861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6014fc20 con 0x7f8a600c89b0 2023-07-06T21:57:23.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.040+0000 7f8a66f82640 1 -- 172.21.15.55:0/2596964861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a60066d60 con 0x7f8a600c89b0 2023-07-06T21:57:23.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.044+0000 7f8a5d7fa640 1 -- 172.21.15.55:0/2596964861 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8a54003b10 con 0x7f8a600c89b0 2023-07-06T21:57:23.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.044+0000 7f8a5d7fa640 1 --2- 172.21.15.55:0/2596964861 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f8a440663d0 0x7f8a44068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:23.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.044+0000 7f8a5d7fa640 1 -- 172.21.15.55:0/2596964861 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8a54083110 con 0x7f8a600c89b0 2023-07-06T21:57:23.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.044+0000 7f8a5ffff640 1 --2- 172.21.15.55:0/2596964861 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f8a440663d0 0x7f8a44068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:23.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.044+0000 7f8a5ffff640 1 --2- 172.21.15.55:0/2596964861 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f8a440663d0 0x7f8a44068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8a60155510 tx=0x7f8a4c007d40 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:23.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.048+0000 7f8a5d7fa640 1 -- 172.21.15.55:0/2596964861 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a540507d0 con 0x7f8a600c89b0 2023-07-06T21:57:23.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:23.204+0000 7f8a66f82640 1 -- 172.21.15.55:0/2596964861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8a600cbd80 con 0x7f8a600c89b0 2023-07-06T21:57:24.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.124+0000 7f8a5d7fa640 1 -- 172.21.15.55:0/2596964861 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v86) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8a54053df0 con 0x7f8a600c89b0 2023-07-06T21:57:24.121 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-07-06T21:57:24.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.128+0000 7f8a66f82640 1 -- 172.21.15.55:0/2596964861 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f8a440663d0 msgr2=0x7f8a44068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:24.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.128+0000 7f8a66f82640 1 --2- 172.21.15.55:0/2596964861 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f8a440663d0 0x7f8a44068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8a60155510 tx=0x7f8a4c007d40 comp rx=0 tx=0).stop 2023-07-06T21:57:24.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.128+0000 7f8a66f82640 1 -- 172.21.15.55:0/2596964861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a600c89b0 msgr2=0x7f8a601576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:24.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.128+0000 7f8a66f82640 1 --2- 172.21.15.55:0/2596964861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a600c89b0 0x7f8a601576c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400c410 tx=0x7f8a5400c8d0 comp rx=0 tx=0).stop 2023-07-06T21:57:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.128+0000 7f8a66f82640 1 -- 172.21.15.55:0/2596964861 shutdown_connections 2023-07-06T21:57:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.128+0000 7f8a66f82640 1 --2- 172.21.15.55:0/2596964861 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f8a440663d0 0x7f8a44068880 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:24.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.128+0000 7f8a66f82640 1 --2- 172.21.15.55:0/2596964861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a60158780 0x7f8a601514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:24.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.128+0000 7f8a66f82640 1 --2- 172.21.15.55:0/2596964861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a600cbfa0 0x7f8a601522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:24.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.128+0000 7f8a66f82640 1 --2- 172.21.15.55:0/2596964861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a600c89b0 0x7f8a601576c0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:24.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.128+0000 7f8a66f82640 1 -- 172.21.15.55:0/2596964861 >> 172.21.15.55:0/2596964861 conn(0x7f8a600cde30 msgr2=0x7f8a600ac730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:24.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.132+0000 7f8a66f82640 1 -- 172.21.15.55:0/2596964861 shutdown_connections 2023-07-06T21:57:24.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.132+0000 7f8a66f82640 1 -- 172.21.15.55:0/2596964861 wait complete. 2023-07-06T21:57:24.152 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T21:57:24.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.308+0000 7f5c9a5df640 1 Processor -- start 2023-07-06T21:57:24.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.308+0000 7f5c9a5df640 1 -- start start 2023-07-06T21:57:24.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.308+0000 7f5c9a5df640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5c94158770 0x7f5c9406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:24.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.308+0000 7f5c9a5df640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c940cc220 0x7f5c9406b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:24.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.308+0000 7f5c9a5df640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c94071660 con 0x7f5c940c8a30 2023-07-06T21:57:24.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.308+0000 7f5c9a5df640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9406a500 con 0x7f5c940cc220 2023-07-06T21:57:24.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.308+0000 7f5c9a5df640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9406a750 con 0x7f5c94158770 2023-07-06T21:57:24.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.308+0000 7f5c98b7c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c940cc220 0x7f5c9406b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:24.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.312+0000 7f5c98b7c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c940cc220 0x7f5c9406b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46314/0 (socket says 172.21.15.55:46314) 2023-07-06T21:57:24.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.312+0000 7f5c98b7c640 1 -- 172.21.15.55:0/2844780002 learned_addr learned my addr 172.21.15.55:0/2844780002 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:24.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.312+0000 7f5c93fff640 1 --2- 172.21.15.55:0/2844780002 >> v2:172.21.15.138:3300/0 conn(0x7f5c94158770 0x7f5c9406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:24.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.312+0000 7f5c98b7c640 1 -- 172.21.15.55:0/2844780002 >> v2:172.21.15.138:3300/0 conn(0x7f5c94158770 msgr2=0x7f5c9406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:24.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.312+0000 7f5c98b7c640 1 --2- 172.21.15.55:0/2844780002 >> v2:172.21.15.138:3300/0 conn(0x7f5c94158770 0x7f5c9406b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:24.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.312+0000 7f5c98b7c640 1 -- 172.21.15.55:0/2844780002 >> v1:172.21.15.138:6789/0 conn(0x7f5c940c8a30 legacy=0x7f5c940cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:24.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.312+0000 7f5c98b7c640 1 -- 172.21.15.55:0/2844780002 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9406f9c0 con 0x7f5c940cc220 2023-07-06T21:57:24.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.312+0000 7f5c98b7c640 1 --2- 172.21.15.55:0/2844780002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c940cc220 0x7f5c9406b830 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5c940ca920 tx=0x7f5c8c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5654f8356f947f1e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:24.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.312+0000 7f5c92ffd640 1 -- 172.21.15.55:0/2844780002 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c0a5860 con 0x7f5c940cc220 2023-07-06T21:57:24.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.312+0000 7f5c92ffd640 1 -- 172.21.15.55:0/2844780002 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c0a59c0 con 0x7f5c940cc220 2023-07-06T21:57:24.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.312+0000 7f5c92ffd640 1 -- 172.21.15.55:0/2844780002 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c0a5d50 con 0x7f5c940cc220 2023-07-06T21:57:24.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2844780002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c940cc220 msgr2=0x7f5c9406b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:24.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 --2- 172.21.15.55:0/2844780002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c940cc220 0x7f5c9406b830 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5c940ca920 tx=0x7f5c8c01c9a0 comp rx=0 tx=0).stop 2023-07-06T21:57:24.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2844780002 shutdown_connections 2023-07-06T21:57:24.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 --2- 172.21.15.55:0/2844780002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c940cc220 0x7f5c9406b830 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:24.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 --2- 172.21.15.55:0/2844780002 >> v2:172.21.15.138:3300/0 conn(0x7f5c94158770 0x7f5c9406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:24.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2844780002 >> 172.21.15.55:0/2844780002 conn(0x7f5c940cdf40 msgr2=0x7f5c940ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:24.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2844780002 shutdown_connections 2023-07-06T21:57:24.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2844780002 wait complete. 2023-07-06T21:57:24.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 Processor -- start 2023-07-06T21:57:24.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 -- start start 2023-07-06T21:57:24.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c940c8a30 0x7f5c9414d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:24.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c940cc220 0x7f5c940ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c94158770 0x7f5c940cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940cd710 con 0x7f5c940cc220 2023-07-06T21:57:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940ad120 con 0x7f5c940c8a30 2023-07-06T21:57:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c9a5df640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940cd220 con 0x7f5c94158770 2023-07-06T21:57:24.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c937fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c940cc220 0x7f5c940ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:24.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c937fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c940cc220 0x7f5c940ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46316/0 (socket says 172.21.15.55:46316) 2023-07-06T21:57:24.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c937fe640 1 -- 172.21.15.55:0/2107872399 learned_addr learned my addr 172.21.15.55:0/2107872399 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:24.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c93fff640 1 --2- 172.21.15.55:0/2107872399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c940c8a30 0x7f5c9414d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:24.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c98b7c640 1 --2- 172.21.15.55:0/2107872399 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c94158770 0x7f5c940cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:24.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c937fe640 1 -- 172.21.15.55:0/2107872399 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c94158770 msgr2=0x7f5c940cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:24.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c937fe640 1 --2- 172.21.15.55:0/2107872399 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c94158770 0x7f5c940cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:24.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c937fe640 1 -- 172.21.15.55:0/2107872399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c940c8a30 msgr2=0x7f5c9414d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:24.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c937fe640 1 --2- 172.21.15.55:0/2107872399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c940c8a30 0x7f5c9414d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:24.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.316+0000 7f5c937fe640 1 -- 172.21.15.55:0/2107872399 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c009b30 con 0x7f5c940cc220 2023-07-06T21:57:24.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.320+0000 7f5c937fe640 1 --2- 172.21.15.55:0/2107872399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c940cc220 0x7f5c940ca7e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800c390 tx=0x7f5c8800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:24.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.320+0000 7f5c90ff9640 1 -- 172.21.15.55:0/2107872399 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c880052d0 con 0x7f5c940cc220 2023-07-06T21:57:24.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.320+0000 7f5c90ff9640 1 -- 172.21.15.55:0/2107872399 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c88005430 con 0x7f5c940cc220 2023-07-06T21:57:24.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.320+0000 7f5c90ff9640 1 -- 172.21.15.55:0/2107872399 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c88003820 con 0x7f5c940cc220 2023-07-06T21:57:24.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.320+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2107872399 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9414e0e0 con 0x7f5c940cc220 2023-07-06T21:57:24.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.320+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2107872399 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c940ccb30 con 0x7f5c940cc220 2023-07-06T21:57:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.320+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2107872399 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c940ace80 con 0x7f5c940cc220 2023-07-06T21:57:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.320+0000 7f5c90ff9640 1 -- 172.21.15.55:0/2107872399 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5c88003980 con 0x7f5c940cc220 2023-07-06T21:57:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.320+0000 7f5c90ff9640 1 --2- 172.21.15.55:0/2107872399 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5c800663a0 0x7f5c80068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.324+0000 7f5c90ff9640 1 -- 172.21.15.55:0/2107872399 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f5c880835b0 con 0x7f5c940cc220 2023-07-06T21:57:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.324+0000 7f5c93fff640 1 --2- 172.21.15.55:0/2107872399 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5c800663a0 0x7f5c80068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.324+0000 7f5c93fff640 1 --2- 172.21.15.55:0/2107872399 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5c800663a0 0x7f5c80068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5c940aefe0 tx=0x7f5c84008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:24.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.324+0000 7f5c90ff9640 1 -- 172.21.15.55:0/2107872399 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5c88050a60 con 0x7f5c940cc220 2023-07-06T21:57:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:24.480+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2107872399 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5c940ace80 con 0x7f5c940cc220 2023-07-06T21:57:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.144+0000 7f5c90ff9640 1 -- 172.21.15.55:0/2107872399 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v87) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5c940ace80 con 0x7f5c940cc220 2023-07-06T21:57:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-07-06T21:57:25.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.148+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2107872399 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5c800663a0 msgr2=0x7f5c80068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:25.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.148+0000 7f5c9a5df640 1 --2- 172.21.15.55:0/2107872399 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5c800663a0 0x7f5c80068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5c940aefe0 tx=0x7f5c84008040 comp rx=0 tx=0).stop 2023-07-06T21:57:25.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.148+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2107872399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c940cc220 msgr2=0x7f5c940ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:25.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.148+0000 7f5c9a5df640 1 --2- 172.21.15.55:0/2107872399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c940cc220 0x7f5c940ca7e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800c390 tx=0x7f5c8800c850 comp rx=0 tx=0).stop 2023-07-06T21:57:25.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.152+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2107872399 shutdown_connections 2023-07-06T21:57:25.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.152+0000 7f5c9a5df640 1 --2- 172.21.15.55:0/2107872399 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f5c800663a0 0x7f5c80068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.152+0000 7f5c9a5df640 1 --2- 172.21.15.55:0/2107872399 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c94158770 0x7f5c940cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.152+0000 7f5c9a5df640 1 --2- 172.21.15.55:0/2107872399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c940cc220 0x7f5c940ca7e0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.152+0000 7f5c9a5df640 1 --2- 172.21.15.55:0/2107872399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c940c8a30 0x7f5c9414d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.152+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2107872399 >> 172.21.15.55:0/2107872399 conn(0x7f5c940cdf40 msgr2=0x7f5c9406b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:25.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.152+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2107872399 shutdown_connections 2023-07-06T21:57:25.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.152+0000 7f5c9a5df640 1 -- 172.21.15.55:0/2107872399 wait complete. 2023-07-06T21:57:25.184 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T21:57:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af4196640 1 Processor -- start 2023-07-06T21:57:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af4196640 1 -- start start 2023-07-06T21:57:25.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af4196640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0aec0c11a0 0x7f0aec0cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:25.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af4196640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0aec0c84a0 0x7f0aec0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:25.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af4196640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec0ccd70 con 0x7f0aec06eee0 2023-07-06T21:57:25.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af4196640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aec1605f0 con 0x7f0aec0c11a0 2023-07-06T21:57:25.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af4196640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aec06ce00 con 0x7f0aec0c84a0 2023-07-06T21:57:25.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af1f32640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0aec0c11a0 0x7f0aec0cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af1f32640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0aec0c11a0 0x7f0aec0cd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46332/0 (socket says 172.21.15.55:46332) 2023-07-06T21:57:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af1f32640 1 -- 172.21.15.55:0/11268363 learned_addr learned my addr 172.21.15.55:0/11268363 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af2733640 1 --2- 172.21.15.55:0/11268363 >> v2:172.21.15.138:3300/0 conn(0x7f0aec0c84a0 0x7f0aec0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af1f32640 1 -- 172.21.15.55:0/11268363 >> v2:172.21.15.138:3300/0 conn(0x7f0aec0c84a0 msgr2=0x7f0aec0c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af1f32640 1 --2- 172.21.15.55:0/11268363 >> v2:172.21.15.138:3300/0 conn(0x7f0aec0c84a0 0x7f0aec0c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af1f32640 1 -- 172.21.15.55:0/11268363 >> v1:172.21.15.138:6789/0 conn(0x7f0aec06eee0 legacy=0x7f0aec06f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.336+0000 7f0af1f32640 1 -- 172.21.15.55:0/11268363 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec0cd9f0 con 0x7f0aec0c11a0 2023-07-06T21:57:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.340+0000 7f0af1f32640 1 --2- 172.21.15.55:0/11268363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aec0c11a0 0x7f0aec0cd4b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f0aec09f260 tx=0x7f0ae801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3907b98b73ee9d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:25.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.340+0000 7f0af0f30640 1 -- 172.21.15.55:0/11268363 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80ab600 con 0x7f0aec0c11a0 2023-07-06T21:57:25.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.340+0000 7f0af0f30640 1 -- 172.21.15.55:0/11268363 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae80a7050 con 0x7f0aec0c11a0 2023-07-06T21:57:25.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.340+0000 7f0af0f30640 1 -- 172.21.15.55:0/11268363 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80ab980 con 0x7f0aec0c11a0 2023-07-06T21:57:25.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.340+0000 7f0af4196640 1 -- 172.21.15.55:0/11268363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aec0c11a0 msgr2=0x7f0aec0cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:25.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.340+0000 7f0af4196640 1 --2- 172.21.15.55:0/11268363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aec0c11a0 0x7f0aec0cd4b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f0aec09f260 tx=0x7f0ae801c430 comp rx=0 tx=0).stop 2023-07-06T21:57:25.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.340+0000 7f0af4196640 1 -- 172.21.15.55:0/11268363 shutdown_connections 2023-07-06T21:57:25.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.340+0000 7f0af4196640 1 --2- 172.21.15.55:0/11268363 >> v2:172.21.15.138:3300/0 conn(0x7f0aec0c84a0 0x7f0aec0c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.340+0000 7f0af4196640 1 --2- 172.21.15.55:0/11268363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aec0c11a0 0x7f0aec0cd4b0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.340+0000 7f0af4196640 1 -- 172.21.15.55:0/11268363 >> 172.21.15.55:0/11268363 conn(0x7f0aec0cea70 msgr2=0x7f0aec0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:25.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.340+0000 7f0af4196640 1 -- 172.21.15.55:0/11268363 shutdown_connections 2023-07-06T21:57:25.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.340+0000 7f0af4196640 1 -- 172.21.15.55:0/11268363 wait complete. 2023-07-06T21:57:25.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af4196640 1 Processor -- start 2023-07-06T21:57:25.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af4196640 1 -- start start 2023-07-06T21:57:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af4196640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aec06eee0 0x7f0aec15bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af4196640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aec0c11a0 0x7f0aec159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af4196640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aec0c84a0 0x7f0aec15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af4196640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec162470 con 0x7f0aec0c84a0 2023-07-06T21:57:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af4196640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec161bd0 con 0x7f0aec06eee0 2023-07-06T21:57:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af4196640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec161eb0 con 0x7f0aec0c11a0 2023-07-06T21:57:25.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af2733640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aec0c84a0 0x7f0aec15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:25.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af1f32640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aec06eee0 0x7f0aec15bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:25.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af2733640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aec0c84a0 0x7f0aec15a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46342/0 (socket says 172.21.15.55:46342) 2023-07-06T21:57:25.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af2733640 1 -- 172.21.15.55:0/4213000682 learned_addr learned my addr 172.21.15.55:0/4213000682 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:25.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af1731640 1 --2- 172.21.15.55:0/4213000682 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aec0c11a0 0x7f0aec159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:25.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af2733640 1 -- 172.21.15.55:0/4213000682 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aec0c11a0 msgr2=0x7f0aec159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:25.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af2733640 1 --2- 172.21.15.55:0/4213000682 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aec0c11a0 0x7f0aec159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af2733640 1 -- 172.21.15.55:0/4213000682 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aec06eee0 msgr2=0x7f0aec15bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:25.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af2733640 1 --2- 172.21.15.55:0/4213000682 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aec06eee0 0x7f0aec15bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af2733640 1 -- 172.21.15.55:0/4213000682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae80094d0 con 0x7f0aec0c84a0 2023-07-06T21:57:25.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af2733640 1 --2- 172.21.15.55:0/4213000682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aec0c84a0 0x7f0aec15a3f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4007e60 tx=0x7f0ae400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:25.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0ae27fc640 1 -- 172.21.15.55:0/4213000682 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4014420 con 0x7f0aec0c84a0 2023-07-06T21:57:25.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0ae27fc640 1 -- 172.21.15.55:0/4213000682 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae40145a0 con 0x7f0aec0c84a0 2023-07-06T21:57:25.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af4196640 1 -- 172.21.15.55:0/4213000682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aec0c16f0 con 0x7f0aec0c84a0 2023-07-06T21:57:25.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0ae27fc640 1 -- 172.21.15.55:0/4213000682 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4014950 con 0x7f0aec0c84a0 2023-07-06T21:57:25.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af4196640 1 -- 172.21.15.55:0/4213000682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec069570 con 0x7f0aec0c84a0 2023-07-06T21:57:25.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.344+0000 7f0af4196640 1 -- 172.21.15.55:0/4213000682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aec066d60 con 0x7f0aec0c84a0 2023-07-06T21:57:25.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.348+0000 7f0ae27fc640 1 -- 172.21.15.55:0/4213000682 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0ae4014ab0 con 0x7f0aec0c84a0 2023-07-06T21:57:25.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.348+0000 7f0ae27fc640 1 --2- 172.21.15.55:0/4213000682 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f0ad00663d0 0x7f0ad0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:25.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.348+0000 7f0ae27fc640 1 -- 172.21.15.55:0/4213000682 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f0ae4085670 con 0x7f0aec0c84a0 2023-07-06T21:57:25.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.348+0000 7f0af1f32640 1 --2- 172.21.15.55:0/4213000682 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f0ad00663d0 0x7f0ad0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:25.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.348+0000 7f0af1f32640 1 --2- 172.21.15.55:0/4213000682 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f0ad00663d0 0x7f0ad0068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80ad000 tx=0x7f0ae8008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:25.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.352+0000 7f0ae27fc640 1 -- 172.21.15.55:0/4213000682 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ae4056420 con 0x7f0aec0c84a0 2023-07-06T21:57:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.540+0000 7f0af4196640 1 -- 172.21.15.55:0/4213000682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0aec0cb6c0 con 0x7f0aec0c84a0 2023-07-06T21:57:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.548+0000 7f0ae27fc640 1 -- 172.21.15.55:0/4213000682 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v28) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0ae4055fb0 con 0x7f0aec0c84a0 2023-07-06T21:57:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 10 and data pool 11 2023-07-06T21:57:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.556+0000 7f0af4196640 1 -- 172.21.15.55:0/4213000682 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f0ad00663d0 msgr2=0x7f0ad0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.556+0000 7f0af4196640 1 --2- 172.21.15.55:0/4213000682 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f0ad00663d0 0x7f0ad0068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80ad000 tx=0x7f0ae8008040 comp rx=0 tx=0).stop 2023-07-06T21:57:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.556+0000 7f0af4196640 1 -- 172.21.15.55:0/4213000682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aec0c84a0 msgr2=0x7f0aec15a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.556+0000 7f0af4196640 1 --2- 172.21.15.55:0/4213000682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aec0c84a0 0x7f0aec15a3f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4007e60 tx=0x7f0ae400e4b0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.556+0000 7f0af4196640 1 -- 172.21.15.55:0/4213000682 shutdown_connections 2023-07-06T21:57:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.556+0000 7f0af4196640 1 --2- 172.21.15.55:0/4213000682 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f0ad00663d0 0x7f0ad0068880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.556+0000 7f0af4196640 1 --2- 172.21.15.55:0/4213000682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0aec0c84a0 0x7f0aec15a3f0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.556+0000 7f0af4196640 1 --2- 172.21.15.55:0/4213000682 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0aec0c11a0 0x7f0aec159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.556+0000 7f0af4196640 1 --2- 172.21.15.55:0/4213000682 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0aec06eee0 0x7f0aec15bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.556+0000 7f0af4196640 1 -- 172.21.15.55:0/4213000682 >> 172.21.15.55:0/4213000682 conn(0x7f0aec0cea70 msgr2=0x7f0aec0b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.560+0000 7f0af4196640 1 -- 172.21.15.55:0/4213000682 shutdown_connections 2023-07-06T21:57:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.560+0000 7f0af4196640 1 -- 172.21.15.55:0/4213000682 wait complete. 2023-07-06T21:57:25.659 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f54979d2640 1 Processor -- start 2023-07-06T21:57:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f54979d2640 1 -- start start 2023-07-06T21:57:25.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f54979d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5490158400 0x7f54900c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f54979d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54900c9680 0x7f5490070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f54979d2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549006fae0 con 0x7f54900710c0 2023-07-06T21:57:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f54979d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549006fdc0 con 0x7f5490158400 2023-07-06T21:57:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f54979d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54900700a0 con 0x7f54900c9680 2023-07-06T21:57:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f549576e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5490158400 0x7f54900c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f549576e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5490158400 0x7f54900c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46358/0 (socket says 172.21.15.55:46358) 2023-07-06T21:57:25.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f549576e640 1 -- 172.21.15.55:0/1320720684 learned_addr learned my addr 172.21.15.55:0/1320720684 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:25.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f5494f6d640 1 --2- 172.21.15.55:0/1320720684 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54900c9680 0x7f5490070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:25.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f549576e640 1 -- 172.21.15.55:0/1320720684 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54900c9680 msgr2=0x7f5490070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:25.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f549576e640 1 --2- 172.21.15.55:0/1320720684 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54900c9680 0x7f5490070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f549576e640 1 -- 172.21.15.55:0/1320720684 >> v1:172.21.15.138:6789/0 conn(0x7f54900710c0 legacy=0x7f54900cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:25.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f549576e640 1 -- 172.21.15.55:0/1320720684 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5490070380 con 0x7f5490158400 2023-07-06T21:57:25.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.804+0000 7f5494f6d640 1 --2- 172.21.15.55:0/1320720684 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54900c9680 0x7f5490070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.808+0000 7f549576e640 1 --2- 172.21.15.55:0/1320720684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5490158400 0x7f54900c9140 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f548c009870 tx=0x7f548c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a00593391d227b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.808+0000 7f5487fff640 1 -- 172.21.15.55:0/1320720684 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0aa610 con 0x7f5490158400 2023-07-06T21:57:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.808+0000 7f5487fff640 1 -- 172.21.15.55:0/1320720684 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c0a6040 con 0x7f5490158400 2023-07-06T21:57:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.808+0000 7f5487fff640 1 -- 172.21.15.55:0/1320720684 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0aa990 con 0x7f5490158400 2023-07-06T21:57:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.808+0000 7f54979d2640 1 -- 172.21.15.55:0/1320720684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5490158400 msgr2=0x7f54900c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.808+0000 7f54979d2640 1 --2- 172.21.15.55:0/1320720684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5490158400 0x7f54900c9140 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f548c009870 tx=0x7f548c01c4d0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.808+0000 7f54979d2640 1 -- 172.21.15.55:0/1320720684 shutdown_connections 2023-07-06T21:57:25.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.808+0000 7f54979d2640 1 --2- 172.21.15.55:0/1320720684 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54900c9680 0x7f5490070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.808+0000 7f54979d2640 1 --2- 172.21.15.55:0/1320720684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5490158400 0x7f54900c9140 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.808+0000 7f54979d2640 1 -- 172.21.15.55:0/1320720684 >> 172.21.15.55:0/1320720684 conn(0x7f54900cded0 msgr2=0x7f54900ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:25.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.808+0000 7f54979d2640 1 -- 172.21.15.55:0/1320720684 shutdown_connections 2023-07-06T21:57:25.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.808+0000 7f54979d2640 1 -- 172.21.15.55:0/1320720684 wait complete. 2023-07-06T21:57:25.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f54979d2640 1 Processor -- start 2023-07-06T21:57:25.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f54979d2640 1 -- start start 2023-07-06T21:57:25.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f54979d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54900710c0 0x7f54900b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:25.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f54979d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54900c9680 0x7f54900c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:25.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f54979d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5490158400 0x7f549014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:25.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f54979d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54900b21a0 con 0x7f54900710c0 2023-07-06T21:57:25.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f54979d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54900b2480 con 0x7f5490158400 2023-07-06T21:57:25.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f54979d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54900b2760 con 0x7f54900c9680 2023-07-06T21:57:25.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f549576e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54900710c0 0x7f54900b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:25.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f549576e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54900710c0 0x7f54900b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46370/0 (socket says 172.21.15.55:46370) 2023-07-06T21:57:25.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f549576e640 1 -- 172.21.15.55:0/826760064 learned_addr learned my addr 172.21.15.55:0/826760064 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:25.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f5494f6d640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54900c9680 0x7f54900c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:25.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f5495f6f640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5490158400 0x7f549014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:25.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f549576e640 1 -- 172.21.15.55:0/826760064 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54900c9680 msgr2=0x7f54900c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:25.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f549576e640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54900c9680 0x7f54900c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f549576e640 1 -- 172.21.15.55:0/826760064 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5490158400 msgr2=0x7f549014a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:25.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f549576e640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5490158400 0x7f549014a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f549576e640 1 -- 172.21.15.55:0/826760064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c0094d0 con 0x7f54900710c0 2023-07-06T21:57:25.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f5494f6d640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54900c9680 0x7f54900c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:25.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f549576e640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54900710c0 0x7f54900b1b10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f548c0ac040 tx=0x7f548c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:25.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f5485ffb640 1 -- 172.21.15.55:0/826760064 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0bd5f0 con 0x7f54900710c0 2023-07-06T21:57:25.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f5485ffb640 1 -- 172.21.15.55:0/826760064 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c0bd770 con 0x7f54900710c0 2023-07-06T21:57:25.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f5485ffb640 1 -- 172.21.15.55:0/826760064 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0bdb20 con 0x7f54900710c0 2023-07-06T21:57:25.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f54979d2640 1 -- 172.21.15.55:0/826760064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54900b2a40 con 0x7f54900710c0 2023-07-06T21:57:25.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.812+0000 7f54979d2640 1 -- 172.21.15.55:0/826760064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54900c7020 con 0x7f54900710c0 2023-07-06T21:57:25.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.816+0000 7f54979d2640 1 -- 172.21.15.55:0/826760064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549006c580 con 0x7f54900710c0 2023-07-06T21:57:25.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.816+0000 7f5485ffb640 1 -- 172.21.15.55:0/826760064 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f548c0b33f0 con 0x7f54900710c0 2023-07-06T21:57:25.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.816+0000 7f5485ffb640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f54740663a0 0x7f5474068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:25.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.816+0000 7f5485ffb640 1 -- 172.21.15.55:0/826760064 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f548c11ed70 con 0x7f54900710c0 2023-07-06T21:57:25.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.816+0000 7f5494f6d640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f54740663a0 0x7f5474068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:25.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.816+0000 7f5494f6d640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f54740663a0 0x7f5474068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5480006fd0 tx=0x7f5480008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:25.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.820+0000 7f5485ffb640 1 -- 172.21.15.55:0/826760064 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f548c0ebeb0 con 0x7f54900710c0 2023-07-06T21:57:25.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.980+0000 7f54979d2640 1 -- 172.21.15.55:0/826760064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54900b2f60 con 0x7f54900710c0 2023-07-06T21:57:25.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.980+0000 7f5485ffb640 1 -- 172.21.15.55:0/826760064 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+18556 (secure 0 0 0) 0x7f548c0c3020 con 0x7f54900710c0 2023-07-06T21:57:25.980 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:25.981 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":88,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:57:25.541611+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:57:23.252496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-06T21:57:24.528387+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:25.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.984+0000 7f54979d2640 1 -- 172.21.15.55:0/826760064 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f54740663a0 msgr2=0x7f5474068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:25.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.984+0000 7f54979d2640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f54740663a0 0x7f5474068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5480006fd0 tx=0x7f5480008040 comp rx=0 tx=0).stop 2023-07-06T21:57:25.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.984+0000 7f54979d2640 1 -- 172.21.15.55:0/826760064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54900710c0 msgr2=0x7f54900b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:25.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.984+0000 7f54979d2640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54900710c0 0x7f54900b1b10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f548c0ac040 tx=0x7f548c01ad10 comp rx=0 tx=0).stop 2023-07-06T21:57:25.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.984+0000 7f54979d2640 1 -- 172.21.15.55:0/826760064 shutdown_connections 2023-07-06T21:57:25.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.984+0000 7f54979d2640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f54740663a0 0x7f5474068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.984+0000 7f54979d2640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5490158400 0x7f549014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.984+0000 7f54979d2640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54900c9680 0x7f54900c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.984+0000 7f54979d2640 1 --2- 172.21.15.55:0/826760064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54900710c0 0x7f54900b1b10 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:25.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.984+0000 7f54979d2640 1 -- 172.21.15.55:0/826760064 >> 172.21.15.55:0/826760064 conn(0x7f54900cded0 msgr2=0x7f549006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:25.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.984+0000 7f54979d2640 1 -- 172.21.15.55:0/826760064 shutdown_connections 2023-07-06T21:57:25.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:25.984+0000 7f54979d2640 1 -- 172.21.15.55:0/826760064 wait complete. 2023-07-06T21:57:26.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.144+0000 7f6b774f9640 1 Processor -- start 2023-07-06T21:57:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b774f9640 1 -- start start 2023-07-06T21:57:26.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b774f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b700ce610 0x7f6b700b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:26.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b774f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b700b1e10 0x7f6b7015f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:26.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b774f9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b700b2290 con 0x7f6b700b7cd0 2023-07-06T21:57:26.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b774f9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b700d2310 con 0x7f6b700ce610 2023-07-06T21:57:26.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b774f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700b80a0 con 0x7f6b700b1e10 2023-07-06T21:57:26.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b75295640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6b700b7cd0 0x7f6b700ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56868/0 (socket says 172.21.15.55:56868) 2023-07-06T21:57:26.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b75295640 1 -- 172.21.15.55:0/3938447983 learned_addr learned my addr 172.21.15.55:0/3938447983 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b74a94640 1 --2- 172.21.15.55:0/3938447983 >> v2:172.21.15.55:3300/0 conn(0x7f6b700ce610 0x7f6b700b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b75a96640 1 --2- 172.21.15.55:0/3938447983 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b700b1e10 0x7f6b7015f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b67fff640 1 -- 172.21.15.55:0/3938447983 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323391555 0 0) 0x7f6b700b2290 con 0x7f6b700b7cd0 2023-07-06T21:57:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b67fff640 1 -- 172.21.15.55:0/3938447983 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b5c003530 con 0x7f6b700b7cd0 2023-07-06T21:57:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b74a94640 1 -- 172.21.15.55:0/3938447983 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b700b1e10 msgr2=0x7f6b7015f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b74a94640 1 --2- 172.21.15.55:0/3938447983 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b700b1e10 0x7f6b7015f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b74a94640 1 -- 172.21.15.55:0/3938447983 >> v1:172.21.15.55:6789/0 conn(0x7f6b700b7cd0 legacy=0x7f6b700ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.148+0000 7f6b74a94640 1 -- 172.21.15.55:0/3938447983 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b700cd1c0 con 0x7f6b700ce610 2023-07-06T21:57:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.152+0000 7f6b74a94640 1 --2- 172.21.15.55:0/3938447983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700ce610 0x7f6b700b18d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f6b600097c0 tx=0x7f6b6001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5f8e700582d914 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.152+0000 7f6b67fff640 1 -- 172.21.15.55:0/3938447983 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600ab600 con 0x7f6b700ce610 2023-07-06T21:57:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.152+0000 7f6b67fff640 1 -- 172.21.15.55:0/3938447983 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b600a7050 con 0x7f6b700ce610 2023-07-06T21:57:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.152+0000 7f6b67fff640 1 -- 172.21.15.55:0/3938447983 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600ab980 con 0x7f6b700ce610 2023-07-06T21:57:26.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.152+0000 7f6b774f9640 1 -- 172.21.15.55:0/3938447983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700ce610 msgr2=0x7f6b700b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:26.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.152+0000 7f6b774f9640 1 --2- 172.21.15.55:0/3938447983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700ce610 0x7f6b700b18d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f6b600097c0 tx=0x7f6b6001c3f0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.152+0000 7f6b774f9640 1 -- 172.21.15.55:0/3938447983 shutdown_connections 2023-07-06T21:57:26.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.152+0000 7f6b774f9640 1 --2- 172.21.15.55:0/3938447983 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b700b1e10 0x7f6b7015f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.152+0000 7f6b774f9640 1 --2- 172.21.15.55:0/3938447983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700ce610 0x7f6b700b18d0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.152+0000 7f6b774f9640 1 -- 172.21.15.55:0/3938447983 >> 172.21.15.55:0/3938447983 conn(0x7f6b700ceee0 msgr2=0x7f6b700cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:26.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.152+0000 7f6b774f9640 1 -- 172.21.15.55:0/3938447983 shutdown_connections 2023-07-06T21:57:26.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.152+0000 7f6b774f9640 1 -- 172.21.15.55:0/3938447983 wait complete. 2023-07-06T21:57:26.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b774f9640 1 Processor -- start 2023-07-06T21:57:26.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b774f9640 1 -- start start 2023-07-06T21:57:26.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b774f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b700b1e10 0x7f6b7014c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:26.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b774f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b700b7cd0 0x7f6b701550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:26.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b774f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700ce610 0x7f6b701555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:26.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b774f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7015e280 con 0x7f6b700ce610 2023-07-06T21:57:26.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b774f9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7015e560 con 0x7f6b700b1e10 2023-07-06T21:57:26.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b774f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7015e840 con 0x7f6b700b7cd0 2023-07-06T21:57:26.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b75a96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700ce610 0x7f6b701555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:26.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b75a96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700ce610 0x7f6b701555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46384/0 (socket says 172.21.15.55:46384) 2023-07-06T21:57:26.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b75a96640 1 -- 172.21.15.55:0/3884827803 learned_addr learned my addr 172.21.15.55:0/3884827803 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b74a94640 1 --2- 172.21.15.55:0/3884827803 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b700b7cd0 0x7f6b701550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b75295640 1 --2- 172.21.15.55:0/3884827803 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b700b1e10 0x7f6b7014c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b75a96640 1 -- 172.21.15.55:0/3884827803 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b700b7cd0 msgr2=0x7f6b701550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b75a96640 1 --2- 172.21.15.55:0/3884827803 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b700b7cd0 0x7f6b701550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b75a96640 1 -- 172.21.15.55:0/3884827803 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b700b1e10 msgr2=0x7f6b7014c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b75a96640 1 --2- 172.21.15.55:0/3884827803 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b700b1e10 0x7f6b7014c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b75a96640 1 -- 172.21.15.55:0/3884827803 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b60009420 con 0x7f6b700ce610 2023-07-06T21:57:26.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b75a96640 1 --2- 172.21.15.55:0/3884827803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700ce610 0x7f6b701555f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800efc0 tx=0x7f6b6800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:26.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b65ffb640 1 -- 172.21.15.55:0/3884827803 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68009ba0 con 0x7f6b700ce610 2023-07-06T21:57:26.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b65ffb640 1 -- 172.21.15.55:0/3884827803 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6800f040 con 0x7f6b700ce610 2023-07-06T21:57:26.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b65ffb640 1 -- 172.21.15.55:0/3884827803 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680146c0 con 0x7f6b700ce610 2023-07-06T21:57:26.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b774f9640 1 -- 172.21.15.55:0/3884827803 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7015eb20 con 0x7f6b700ce610 2023-07-06T21:57:26.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b774f9640 1 -- 172.21.15.55:0/3884827803 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7015bdc0 con 0x7f6b700ce610 2023-07-06T21:57:26.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.156+0000 7f6b774f9640 1 -- 172.21.15.55:0/3884827803 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7015ed10 con 0x7f6b700ce610 2023-07-06T21:57:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.160+0000 7f6b65ffb640 1 -- 172.21.15.55:0/3884827803 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6b68014820 con 0x7f6b700ce610 2023-07-06T21:57:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.160+0000 7f6b65ffb640 1 --2- 172.21.15.55:0/3884827803 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6b540663a0 0x7f6b54068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.160+0000 7f6b65ffb640 1 -- 172.21.15.55:0/3884827803 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6b68084bf0 con 0x7f6b700ce610 2023-07-06T21:57:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.160+0000 7f6b75295640 1 --2- 172.21.15.55:0/3884827803 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6b540663a0 0x7f6b54068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.160+0000 7f6b75295640 1 --2- 172.21.15.55:0/3884827803 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6b540663a0 0x7f6b54068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0011f0 tx=0x7f6b6c009040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.164+0000 7f6b65ffb640 1 -- 172.21.15.55:0/3884827803 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b68051d00 con 0x7f6b700ce610 2023-07-06T21:57:26.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.320+0000 7f6b774f9640 1 -- 172.21.15.55:0/3884827803 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b70066d60 con 0x7f6b700ce610 2023-07-06T21:57:26.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.320+0000 7f6b65ffb640 1 -- 172.21.15.55:0/3884827803 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+18556 (secure 0 0 0) 0x7f6b68018090 con 0x7f6b700ce610 2023-07-06T21:57:26.319 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:26.319 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":88,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:57:25.541611+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:57:23.252496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-06T21:57:24.528387+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:26.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.320+0000 7f6b774f9640 1 -- 172.21.15.55:0/3884827803 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6b540663a0 msgr2=0x7f6b54068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:26.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.320+0000 7f6b774f9640 1 --2- 172.21.15.55:0/3884827803 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6b540663a0 0x7f6b54068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0011f0 tx=0x7f6b6c009040 comp rx=0 tx=0).stop 2023-07-06T21:57:26.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.320+0000 7f6b774f9640 1 -- 172.21.15.55:0/3884827803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700ce610 msgr2=0x7f6b701555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:26.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.320+0000 7f6b774f9640 1 --2- 172.21.15.55:0/3884827803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700ce610 0x7f6b701555f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800efc0 tx=0x7f6b6800c490 comp rx=0 tx=0).stop 2023-07-06T21:57:26.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.320+0000 7f6b774f9640 1 -- 172.21.15.55:0/3884827803 shutdown_connections 2023-07-06T21:57:26.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.320+0000 7f6b774f9640 1 --2- 172.21.15.55:0/3884827803 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6b540663a0 0x7f6b54068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.320+0000 7f6b774f9640 1 --2- 172.21.15.55:0/3884827803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b700ce610 0x7f6b701555f0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.320+0000 7f6b774f9640 1 --2- 172.21.15.55:0/3884827803 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b700b7cd0 0x7f6b701550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.320+0000 7f6b774f9640 1 --2- 172.21.15.55:0/3884827803 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b700b1e10 0x7f6b7014c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.320+0000 7f6b774f9640 1 -- 172.21.15.55:0/3884827803 >> 172.21.15.55:0/3884827803 conn(0x7f6b700ceee0 msgr2=0x7f6b7006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:26.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.324+0000 7f6b774f9640 1 -- 172.21.15.55:0/3884827803 shutdown_connections 2023-07-06T21:57:26.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.324+0000 7f6b774f9640 1 -- 172.21.15.55:0/3884827803 wait complete. 2023-07-06T21:57:26.340 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T21:57:26.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d963d2640 1 Processor -- start 2023-07-06T21:57:26.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d963d2640 1 -- start start 2023-07-06T21:57:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d963d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d9015ba30 0x7f4d900cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d963d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d900ad0c0 0x7f4d9009ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d963d2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4d9009d340 0x7f4d9015f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d963d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d900c83a0 con 0x7f4d9015ba30 2023-07-06T21:57:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d963d2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9009d7c0 con 0x7f4d9009d340 2023-07-06T21:57:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d963d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900ccbb0 con 0x7f4d900ad0c0 2023-07-06T21:57:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d8ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d9015ba30 0x7f4d900cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:26.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d8ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d9015ba30 0x7f4d900cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46398/0 (socket says 172.21.15.55:46398) 2023-07-06T21:57:26.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d8ffff640 1 -- 172.21.15.55:0/3023350973 learned_addr learned my addr 172.21.15.55:0/3023350973 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:26.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d8f7fe640 1 --2- 172.21.15.55:0/3023350973 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d900ad0c0 0x7f4d9009ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:26.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d9496f640 1 --2- 172.21.15.55:0/3023350973 >> v2:172.21.15.138:3300/0 conn(0x7f4d9009d340 0x7f4d9015f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d8ffff640 1 -- 172.21.15.55:0/3023350973 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d900ad0c0 msgr2=0x7f4d9009ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d8ffff640 1 --2- 172.21.15.55:0/3023350973 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d900ad0c0 0x7f4d9009ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d8ffff640 1 -- 172.21.15.55:0/3023350973 >> v2:172.21.15.138:3300/0 conn(0x7f4d9009d340 msgr2=0x7f4d9015f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d8ffff640 1 --2- 172.21.15.55:0/3023350973 >> v2:172.21.15.138:3300/0 conn(0x7f4d9009d340 0x7f4d9015f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d8ffff640 1 -- 172.21.15.55:0/3023350973 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d900cce90 con 0x7f4d9015ba30 2023-07-06T21:57:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.488+0000 7f4d8f7fe640 1 --2- 172.21.15.55:0/3023350973 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d900ad0c0 0x7f4d9009ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:26.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.492+0000 7f4d8ffff640 1 --2- 172.21.15.55:0/3023350973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d9015ba30 0x7f4d900cd800 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4d900cdd40 tx=0x7f4d8001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f35b2e76016dac server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:26.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.492+0000 7f4d8effd640 1 -- 172.21.15.55:0/3023350973 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d800ab600 con 0x7f4d9015ba30 2023-07-06T21:57:26.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.492+0000 7f4d8effd640 1 -- 172.21.15.55:0/3023350973 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d800a7050 con 0x7f4d9015ba30 2023-07-06T21:57:26.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.492+0000 7f4d8effd640 1 -- 172.21.15.55:0/3023350973 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d800ab980 con 0x7f4d9015ba30 2023-07-06T21:57:26.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.492+0000 7f4d963d2640 1 -- 172.21.15.55:0/3023350973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d9015ba30 msgr2=0x7f4d900cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:26.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.492+0000 7f4d963d2640 1 --2- 172.21.15.55:0/3023350973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d9015ba30 0x7f4d900cd800 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4d900cdd40 tx=0x7f4d8001c210 comp rx=0 tx=0).stop 2023-07-06T21:57:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.492+0000 7f4d963d2640 1 -- 172.21.15.55:0/3023350973 shutdown_connections 2023-07-06T21:57:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.492+0000 7f4d963d2640 1 --2- 172.21.15.55:0/3023350973 >> v2:172.21.15.138:3300/0 conn(0x7f4d9009d340 0x7f4d9015f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.492+0000 7f4d963d2640 1 --2- 172.21.15.55:0/3023350973 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d900ad0c0 0x7f4d9009ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.492+0000 7f4d963d2640 1 --2- 172.21.15.55:0/3023350973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d9015ba30 0x7f4d900cd800 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.492+0000 7f4d963d2640 1 -- 172.21.15.55:0/3023350973 >> 172.21.15.55:0/3023350973 conn(0x7f4d900cea70 msgr2=0x7f4d900ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.492+0000 7f4d963d2640 1 -- 172.21.15.55:0/3023350973 shutdown_connections 2023-07-06T21:57:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.492+0000 7f4d963d2640 1 -- 172.21.15.55:0/3023350973 wait complete. 2023-07-06T21:57:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d963d2640 1 Processor -- start 2023-07-06T21:57:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d963d2640 1 -- start start 2023-07-06T21:57:26.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d963d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d9009d340 0x7f4d9015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:26.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d963d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d900ad0c0 0x7f4d901463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:26.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d963d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d9015ba30 0x7f4d901468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:26.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d963d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900c3b00 con 0x7f4d9009d340 2023-07-06T21:57:26.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d963d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d90154d60 con 0x7f4d900ad0c0 2023-07-06T21:57:26.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d963d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900c3d10 con 0x7f4d9015ba30 2023-07-06T21:57:26.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d8ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d9009d340 0x7f4d9015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:26.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d8ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d9009d340 0x7f4d9015e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46402/0 (socket says 172.21.15.55:46402) 2023-07-06T21:57:26.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d8ffff640 1 -- 172.21.15.55:0/1660208769 learned_addr learned my addr 172.21.15.55:0/1660208769 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:26.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d8f7fe640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d900ad0c0 0x7f4d901463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:26.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d9496f640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d9015ba30 0x7f4d901468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:26.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d8ffff640 1 -- 172.21.15.55:0/1660208769 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d9015ba30 msgr2=0x7f4d901468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d8ffff640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d9015ba30 0x7f4d901468e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d8ffff640 1 -- 172.21.15.55:0/1660208769 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d900ad0c0 msgr2=0x7f4d901463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d8ffff640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d900ad0c0 0x7f4d901463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d8ffff640 1 -- 172.21.15.55:0/1660208769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d800094d0 con 0x7f4d9009d340 2023-07-06T21:57:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d9496f640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d9015ba30 0x7f4d901468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d8ffff640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d9009d340 0x7f4d9015e8b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4d800ae040 tx=0x7f4d8001aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d8cff9640 1 -- 172.21.15.55:0/1660208769 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d800b6420 con 0x7f4d9009d340 2023-07-06T21:57:26.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d8cff9640 1 -- 172.21.15.55:0/1660208769 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d800b6580 con 0x7f4d9009d340 2023-07-06T21:57:26.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d8cff9640 1 -- 172.21.15.55:0/1660208769 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d800b6930 con 0x7f4d9009d340 2023-07-06T21:57:26.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d963d2640 1 -- 172.21.15.55:0/1660208769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d900c3ff0 con 0x7f4d9009d340 2023-07-06T21:57:26.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d963d2640 1 -- 172.21.15.55:0/1660208769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d900c45b0 con 0x7f4d9009d340 2023-07-06T21:57:26.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.496+0000 7f4d963d2640 1 -- 172.21.15.55:0/1660208769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d900c47a0 con 0x7f4d9009d340 2023-07-06T21:57:26.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.500+0000 7f4d8cff9640 1 -- 172.21.15.55:0/1660208769 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4d800b2040 con 0x7f4d9009d340 2023-07-06T21:57:26.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.500+0000 7f4d8cff9640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f4d7c0663a0 0x7f4d7c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:26.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.500+0000 7f4d8cff9640 1 -- 172.21.15.55:0/1660208769 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4d8011e220 con 0x7f4d9009d340 2023-07-06T21:57:26.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.500+0000 7f4d8f7fe640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f4d7c0663a0 0x7f4d7c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:26.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.500+0000 7f4d8f7fe640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f4d7c0663a0 0x7f4d7c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4d901669a0 tx=0x7f4d84008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:26.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.504+0000 7f4d8cff9640 1 -- 172.21.15.55:0/1660208769 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4d800eb3e0 con 0x7f4d9009d340 2023-07-06T21:57:26.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:26.692+0000 7f4d963d2640 1 -- 172.21.15.55:0/1660208769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4d90066d60 con 0x7f4d9009d340 2023-07-06T21:57:27.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.572+0000 7f4d8cff9640 1 -- 172.21.15.55:0/1660208769 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4d800eea00 con 0x7f4d9009d340 2023-07-06T21:57:27.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.576+0000 7f4d963d2640 1 -- 172.21.15.55:0/1660208769 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f4d7c0663a0 msgr2=0x7f4d7c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:27.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.576+0000 7f4d963d2640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f4d7c0663a0 0x7f4d7c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4d901669a0 tx=0x7f4d84008040 comp rx=0 tx=0).stop 2023-07-06T21:57:27.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.576+0000 7f4d963d2640 1 -- 172.21.15.55:0/1660208769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d9009d340 msgr2=0x7f4d9015e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:27.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.576+0000 7f4d963d2640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d9009d340 0x7f4d9015e8b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4d800ae040 tx=0x7f4d8001aa50 comp rx=0 tx=0).stop 2023-07-06T21:57:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.576+0000 7f4d963d2640 1 -- 172.21.15.55:0/1660208769 shutdown_connections 2023-07-06T21:57:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.576+0000 7f4d963d2640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f4d7c0663a0 0x7f4d7c068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.576+0000 7f4d963d2640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d9015ba30 0x7f4d901468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.576+0000 7f4d963d2640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d900ad0c0 0x7f4d901463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.576+0000 7f4d963d2640 1 --2- 172.21.15.55:0/1660208769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d9009d340 0x7f4d9015e8b0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.576+0000 7f4d963d2640 1 -- 172.21.15.55:0/1660208769 >> 172.21.15.55:0/1660208769 conn(0x7f4d900cea70 msgr2=0x7f4d900b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.576+0000 7f4d963d2640 1 -- 172.21.15.55:0/1660208769 shutdown_connections 2023-07-06T21:57:27.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.576+0000 7f4d963d2640 1 -- 172.21.15.55:0/1660208769 wait complete. 2023-07-06T21:57:27.598 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-06T21:57:27.599 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T21:57:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.752+0000 7f151d248640 1 Processor -- start 2023-07-06T21:57:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.752+0000 7f151d248640 1 -- start start 2023-07-06T21:57:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f151d248640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1518158850 0x7f15180cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f151d248640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15180ca130 0x7f15180ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f151d248640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15180703e0 0x7f1518070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f151d248640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1518070dc0 con 0x7f15180703e0 2023-07-06T21:57:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f151d248640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1518158c20 con 0x7f1518158850 2023-07-06T21:57:27.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f151d248640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15180c8db0 con 0x7f15180ca130 2023-07-06T21:57:27.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f151759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15180703e0 0x7f1518070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f151759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15180703e0 0x7f1518070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46418/0 (socket says 172.21.15.55:46418) 2023-07-06T21:57:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f151759e640 1 -- 172.21.15.55:0/1966272388 learned_addr learned my addr 172.21.15.55:0/1966272388 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f1516d9d640 1 --2- 172.21.15.55:0/1966272388 >> v2:172.21.15.138:3300/0 conn(0x7f1518158850 0x7f15180cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f150ffff640 1 --2- 172.21.15.55:0/1966272388 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15180ca130 0x7f15180ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f151759e640 1 -- 172.21.15.55:0/1966272388 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15180ca130 msgr2=0x7f15180ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f151759e640 1 --2- 172.21.15.55:0/1966272388 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15180ca130 0x7f15180ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f151759e640 1 -- 172.21.15.55:0/1966272388 >> v2:172.21.15.138:3300/0 conn(0x7f1518158850 msgr2=0x7f15180cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:27.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f151759e640 1 --2- 172.21.15.55:0/1966272388 >> v2:172.21.15.138:3300/0 conn(0x7f1518158850 0x7f15180cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:27.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.756+0000 7f151759e640 1 -- 172.21.15.55:0/1966272388 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15180c9090 con 0x7f15180703e0 2023-07-06T21:57:27.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151759e640 1 --2- 172.21.15.55:0/1966272388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15180703e0 0x7f1518070880 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f151806eaf0 tx=0x7f15100213d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e74bbe7a9eb9b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151659c640 1 -- 172.21.15.55:0/1966272388 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15100b1400 con 0x7f15180703e0 2023-07-06T21:57:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151659c640 1 -- 172.21.15.55:0/1966272388 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15100ad050 con 0x7f15180703e0 2023-07-06T21:57:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151659c640 1 -- 172.21.15.55:0/1966272388 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15100b1780 con 0x7f15180703e0 2023-07-06T21:57:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151d248640 1 -- 172.21.15.55:0/1966272388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15180703e0 msgr2=0x7f1518070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151d248640 1 --2- 172.21.15.55:0/1966272388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15180703e0 0x7f1518070880 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f151806eaf0 tx=0x7f15100213d0 comp rx=0 tx=0).stop 2023-07-06T21:57:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151d248640 1 -- 172.21.15.55:0/1966272388 shutdown_connections 2023-07-06T21:57:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151d248640 1 --2- 172.21.15.55:0/1966272388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15180703e0 0x7f1518070880 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151d248640 1 --2- 172.21.15.55:0/1966272388 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15180ca130 0x7f15180ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151d248640 1 --2- 172.21.15.55:0/1966272388 >> v2:172.21.15.138:3300/0 conn(0x7f1518158850 0x7f15180cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151d248640 1 -- 172.21.15.55:0/1966272388 >> 172.21.15.55:0/1966272388 conn(0x7f15180cea70 msgr2=0x7f15180ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151d248640 1 -- 172.21.15.55:0/1966272388 shutdown_connections 2023-07-06T21:57:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151d248640 1 -- 172.21.15.55:0/1966272388 wait complete. 2023-07-06T21:57:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151d248640 1 Processor -- start 2023-07-06T21:57:27.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.760+0000 7f151d248640 1 -- start start 2023-07-06T21:57:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f151d248640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15180703e0 0x7f15180c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f151d248640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15180ca130 0x7f15181545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f151d248640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1518158850 0x7f151806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f151d248640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1518156220 con 0x7f15180703e0 2023-07-06T21:57:27.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f151d248640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1518155c60 con 0x7f1518158850 2023-07-06T21:57:27.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f151d248640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1518155f40 con 0x7f15180ca130 2023-07-06T21:57:27.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f1516d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15180703e0 0x7f15180c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:27.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f1516d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15180703e0 0x7f15180c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46432/0 (socket says 172.21.15.55:46432) 2023-07-06T21:57:27.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f1516d9d640 1 -- 172.21.15.55:0/913149256 learned_addr learned my addr 172.21.15.55:0/913149256 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:27.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f151759e640 1 --2- 172.21.15.55:0/913149256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1518158850 0x7f151806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:27.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f150ffff640 1 --2- 172.21.15.55:0/913149256 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15180ca130 0x7f15181545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:27.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f1516d9d640 1 -- 172.21.15.55:0/913149256 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15180ca130 msgr2=0x7f15181545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:27.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f1516d9d640 1 --2- 172.21.15.55:0/913149256 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15180ca130 0x7f15181545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:27.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f1516d9d640 1 -- 172.21.15.55:0/913149256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1518158850 msgr2=0x7f151806b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:27.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f1516d9d640 1 --2- 172.21.15.55:0/913149256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1518158850 0x7f151806b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:27.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f1516d9d640 1 -- 172.21.15.55:0/913149256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1510009b30 con 0x7f15180703e0 2023-07-06T21:57:27.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f1516d9d640 1 --2- 172.21.15.55:0/913149256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15180703e0 0x7f15180c7860 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f150800d5f0 tx=0x7f150800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:27.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f150f7fe640 1 -- 172.21.15.55:0/913149256 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15080125f0 con 0x7f15180703e0 2023-07-06T21:57:27.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f150f7fe640 1 -- 172.21.15.55:0/913149256 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1508012750 con 0x7f15180703e0 2023-07-06T21:57:27.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f150f7fe640 1 -- 172.21.15.55:0/913149256 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508012ae0 con 0x7f15180703e0 2023-07-06T21:57:27.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f151d248640 1 -- 172.21.15.55:0/913149256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15180c4f30 con 0x7f15180703e0 2023-07-06T21:57:27.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f151d248640 1 -- 172.21.15.55:0/913149256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15180693f0 con 0x7f15180703e0 2023-07-06T21:57:27.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f151d248640 1 -- 172.21.15.55:0/913149256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1518066d60 con 0x7f15180703e0 2023-07-06T21:57:27.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.764+0000 7f150f7fe640 1 -- 172.21.15.55:0/913149256 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1508012c40 con 0x7f15180703e0 2023-07-06T21:57:27.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.768+0000 7f150f7fe640 1 --2- 172.21.15.55:0/913149256 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f14f80663a0 0x7f14f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:27.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.768+0000 7f150f7fe640 1 -- 172.21.15.55:0/913149256 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1508084300 con 0x7f15180703e0 2023-07-06T21:57:27.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.768+0000 7f150ffff640 1 --2- 172.21.15.55:0/913149256 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f14f80663a0 0x7f14f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:27.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.768+0000 7f150ffff640 1 --2- 172.21.15.55:0/913149256 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f14f80663a0 0x7f14f8068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f15181ddc00 tx=0x7f1500008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:27.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.772+0000 7f150f7fe640 1 -- 172.21.15.55:0/913149256 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f15080515d0 con 0x7f15180703e0 2023-07-06T21:57:27.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:27.960+0000 7f151d248640 1 -- 172.21.15.55:0/913149256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f151806cd30 con 0x7f15180703e0 2023-07-06T21:57:28.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.596+0000 7f150f7fe640 1 -- 172.21.15.55:0/913149256 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1508054bf0 con 0x7f15180703e0 2023-07-06T21:57:28.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.596+0000 7f151d248640 1 -- 172.21.15.55:0/913149256 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f14f80663a0 msgr2=0x7f14f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:28.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.596+0000 7f151d248640 1 --2- 172.21.15.55:0/913149256 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f14f80663a0 0x7f14f8068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f15181ddc00 tx=0x7f1500008040 comp rx=0 tx=0).stop 2023-07-06T21:57:28.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.596+0000 7f151d248640 1 -- 172.21.15.55:0/913149256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15180703e0 msgr2=0x7f15180c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:28.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.596+0000 7f151d248640 1 --2- 172.21.15.55:0/913149256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15180703e0 0x7f15180c7860 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f150800d5f0 tx=0x7f150800dab0 comp rx=0 tx=0).stop 2023-07-06T21:57:28.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.596+0000 7f151d248640 1 -- 172.21.15.55:0/913149256 shutdown_connections 2023-07-06T21:57:28.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.596+0000 7f151d248640 1 --2- 172.21.15.55:0/913149256 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f14f80663a0 0x7f14f8068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:28.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.596+0000 7f151d248640 1 --2- 172.21.15.55:0/913149256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1518158850 0x7f151806b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:28.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.596+0000 7f151d248640 1 --2- 172.21.15.55:0/913149256 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15180ca130 0x7f15181545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:28.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.596+0000 7f151d248640 1 --2- 172.21.15.55:0/913149256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15180703e0 0x7f15180c7860 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:28.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.596+0000 7f151d248640 1 -- 172.21.15.55:0/913149256 >> 172.21.15.55:0/913149256 conn(0x7f15180cea70 msgr2=0x7f1518157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:28.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.596+0000 7f151d248640 1 -- 172.21.15.55:0/913149256 shutdown_connections 2023-07-06T21:57:28.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.596+0000 7f151d248640 1 -- 172.21.15.55:0/913149256 wait complete. 2023-07-06T21:57:28.617 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T21:57:28.617 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:57:28.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.764+0000 7f3d59c9c640 1 Processor -- start 2023-07-06T21:57:28.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.764+0000 7f3d59c9c640 1 -- start start 2023-07-06T21:57:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.764+0000 7f3d59c9c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d54160300 0x7f3d5415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.764+0000 7f3d59c9c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d540cdc80 con 0x7f3d5415b7e0 2023-07-06T21:57:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.764+0000 7f3d59c9c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d540cd6c0 con 0x7f3d540c8520 2023-07-06T21:57:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.764+0000 7f3d59c9c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d540cd9a0 con 0x7f3d54160300 2023-07-06T21:57:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.764+0000 7f3d52ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d54160300 0x7f3d5415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.764+0000 7f3d52ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d54160300 0x7f3d5415cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46444/0 (socket says 172.21.15.55:46444) 2023-07-06T21:57:28.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.764+0000 7f3d52ffd640 1 -- 172.21.15.55:0/1251047350 learned_addr learned my addr 172.21.15.55:0/1251047350 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:28.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.764+0000 7f3d537fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3d5415b7e0 0x7f3d540cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56872/0 (socket says 172.21.15.55:56872) 2023-07-06T21:57:28.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.764+0000 7f3d52ffd640 1 -- 172.21.15.55:0/1251047350 >> v1:172.21.15.138:6789/0 conn(0x7f3d540c8520 legacy=0x7f3d5406b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:28.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.764+0000 7f3d52ffd640 1 -- 172.21.15.55:0/1251047350 >> v1:172.21.15.55:6789/0 conn(0x7f3d5415b7e0 legacy=0x7f3d540cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:28.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.764+0000 7f3d527fc640 1 -- 172.21.15.55:0/1251047350 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835096635 0 0) 0x7f3d540cdc80 con 0x7f3d5415b7e0 2023-07-06T21:57:28.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.764+0000 7f3d52ffd640 1 -- 172.21.15.55:0/1251047350 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d54069490 con 0x7f3d54160300 2023-07-06T21:57:28.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.768+0000 7f3d52ffd640 1 --2- 172.21.15.55:0/1251047350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d54160300 0x7f3d5415cbc0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009870 tx=0x7f3d4801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f769297654a16fac server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:28.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.768+0000 7f3d527fc640 1 -- 172.21.15.55:0/1251047350 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d480a95f0 con 0x7f3d54160300 2023-07-06T21:57:28.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.768+0000 7f3d527fc640 1 -- 172.21.15.55:0/1251047350 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d480a9750 con 0x7f3d54160300 2023-07-06T21:57:28.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.768+0000 7f3d527fc640 1 -- 172.21.15.55:0/1251047350 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d480a9ae0 con 0x7f3d54160300 2023-07-06T21:57:28.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.768+0000 7f3d59c9c640 1 -- 172.21.15.55:0/1251047350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d54160300 msgr2=0x7f3d5415cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:28.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.768+0000 7f3d59c9c640 1 --2- 172.21.15.55:0/1251047350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d54160300 0x7f3d5415cbc0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009870 tx=0x7f3d4801c510 comp rx=0 tx=0).stop 2023-07-06T21:57:28.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.768+0000 7f3d59c9c640 1 -- 172.21.15.55:0/1251047350 shutdown_connections 2023-07-06T21:57:28.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.768+0000 7f3d59c9c640 1 --2- 172.21.15.55:0/1251047350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d54160300 0x7f3d5415cbc0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:28.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.768+0000 7f3d59c9c640 1 -- 172.21.15.55:0/1251047350 >> 172.21.15.55:0/1251047350 conn(0x7f3d540cded0 msgr2=0x7f3d540ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:28.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.768+0000 7f3d59c9c640 1 -- 172.21.15.55:0/1251047350 shutdown_connections 2023-07-06T21:57:28.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.768+0000 7f3d59c9c640 1 -- 172.21.15.55:0/1251047350 wait complete. 2023-07-06T21:57:28.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d59c9c640 1 Processor -- start 2023-07-06T21:57:28.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d59c9c640 1 -- start start 2023-07-06T21:57:28.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d59c9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d540c8520 0x7f3d540b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:28.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d59c9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d5415b7e0 0x7f3d5414f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:28.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d59c9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d54160300 0x7f3d54152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:28.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d59c9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5414f840 con 0x7f3d5415b7e0 2023-07-06T21:57:28.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d59c9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5414f570 con 0x7f3d540c8520 2023-07-06T21:57:28.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d59c9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d54159990 con 0x7f3d54160300 2023-07-06T21:57:28.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d52ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d5415b7e0 0x7f3d5414f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:28.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d52ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d5415b7e0 0x7f3d5414f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46458/0 (socket says 172.21.15.55:46458) 2023-07-06T21:57:28.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d52ffd640 1 -- 172.21.15.55:0/3053591363 learned_addr learned my addr 172.21.15.55:0/3053591363 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:28.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d537fe640 1 --2- 172.21.15.55:0/3053591363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d540c8520 0x7f3d540b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:28.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d53fff640 1 --2- 172.21.15.55:0/3053591363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d54160300 0x7f3d54152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:28.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d52ffd640 1 -- 172.21.15.55:0/3053591363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d54160300 msgr2=0x7f3d54152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:28.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d52ffd640 1 --2- 172.21.15.55:0/3053591363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d54160300 0x7f3d54152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:28.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d52ffd640 1 -- 172.21.15.55:0/3053591363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d540c8520 msgr2=0x7f3d540b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:28.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d52ffd640 1 --2- 172.21.15.55:0/3053591363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d540c8520 0x7f3d540b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:28.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d52ffd640 1 -- 172.21.15.55:0/3053591363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d480094d0 con 0x7f3d5415b7e0 2023-07-06T21:57:28.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d52ffd640 1 --2- 172.21.15.55:0/3053591363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d5415b7e0 0x7f3d5414f030 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f3d480ab040 tx=0x7f3d480192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:28.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.772+0000 7f3d3bfff640 1 -- 172.21.15.55:0/3053591363 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d480b14b0 con 0x7f3d5415b7e0 2023-07-06T21:57:28.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.776+0000 7f3d3bfff640 1 -- 172.21.15.55:0/3053591363 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d480b1650 con 0x7f3d5415b7e0 2023-07-06T21:57:28.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.776+0000 7f3d3bfff640 1 -- 172.21.15.55:0/3053591363 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d480b1a00 con 0x7f3d5415b7e0 2023-07-06T21:57:28.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.776+0000 7f3d59c9c640 1 -- 172.21.15.55:0/3053591363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d54159c70 con 0x7f3d5415b7e0 2023-07-06T21:57:28.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.776+0000 7f3d59c9c640 1 -- 172.21.15.55:0/3053591363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5415a230 con 0x7f3d5415b7e0 2023-07-06T21:57:28.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.776+0000 7f3d59c9c640 1 -- 172.21.15.55:0/3053591363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d54066d60 con 0x7f3d5415b7e0 2023-07-06T21:57:28.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.776+0000 7f3d3bfff640 1 -- 172.21.15.55:0/3053591363 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3d480b1b60 con 0x7f3d5415b7e0 2023-07-06T21:57:28.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.776+0000 7f3d3bfff640 1 --2- 172.21.15.55:0/3053591363 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f3d400663a0 0x7f3d40068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:28.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.776+0000 7f3d3bfff640 1 -- 172.21.15.55:0/3053591363 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3d4811e370 con 0x7f3d5415b7e0 2023-07-06T21:57:28.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.776+0000 7f3d537fe640 1 --2- 172.21.15.55:0/3053591363 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f3d400663a0 0x7f3d40068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:28.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.780+0000 7f3d537fe640 1 --2- 172.21.15.55:0/3053591363 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f3d400663a0 0x7f3d40068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3d44007ab0 tx=0x7f3d44007a00 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:28.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.780+0000 7f3d3bfff640 1 -- 172.21.15.55:0/3053591363 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3d480eb4a0 con 0x7f3d5415b7e0 2023-07-06T21:57:28.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.972+0000 7f3d59c9c640 1 -- 172.21.15.55:0/3053591363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d5406c4f0 con 0x7f3d5415b7e0 2023-07-06T21:57:28.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.972+0000 7f3d3bfff640 1 -- 172.21.15.55:0/3053591363 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f3d480bf090 con 0x7f3d5415b7e0 2023-07-06T21:57:28.971 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:28.971 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2651551074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2651551074},{"type":"v1","addr":"172.21.15.138:6835","nonce":2651551074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1024060506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1024060506},{"type":"v1","addr":"172.21.15.138:6834","nonce":1024060506}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6933,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3347534333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3347534333},{"type":"v1","addr":"172.21.15.55:6836","nonce":3347534333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:57:25.541950+0000","modified":"2023-07-06T21:57:28.574413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3154142571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3154142571},{"type":"v1","addr":"172.21.15.55:6837","nonce":3154142571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-06T21:57:28.971 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 32 2023-07-06T21:57:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.972+0000 7f3d59c9c640 1 -- 172.21.15.55:0/3053591363 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f3d400663a0 msgr2=0x7f3d40068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.972+0000 7f3d59c9c640 1 --2- 172.21.15.55:0/3053591363 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f3d400663a0 0x7f3d40068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3d44007ab0 tx=0x7f3d44007a00 comp rx=0 tx=0).stop 2023-07-06T21:57:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.972+0000 7f3d59c9c640 1 -- 172.21.15.55:0/3053591363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d5415b7e0 msgr2=0x7f3d5414f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.972+0000 7f3d59c9c640 1 --2- 172.21.15.55:0/3053591363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d5415b7e0 0x7f3d5414f030 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f3d480ab040 tx=0x7f3d480192b0 comp rx=0 tx=0).stop 2023-07-06T21:57:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.972+0000 7f3d59c9c640 1 -- 172.21.15.55:0/3053591363 shutdown_connections 2023-07-06T21:57:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.972+0000 7f3d59c9c640 1 --2- 172.21.15.55:0/3053591363 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f3d400663a0 0x7f3d40068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.972+0000 7f3d59c9c640 1 --2- 172.21.15.55:0/3053591363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d54160300 0x7f3d54152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.972+0000 7f3d59c9c640 1 --2- 172.21.15.55:0/3053591363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d5415b7e0 0x7f3d5414f030 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.972+0000 7f3d59c9c640 1 --2- 172.21.15.55:0/3053591363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d540c8520 0x7f3d540b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.972+0000 7f3d59c9c640 1 -- 172.21.15.55:0/3053591363 >> 172.21.15.55:0/3053591363 conn(0x7f3d540cded0 msgr2=0x7f3d5415d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.976+0000 7f3d59c9c640 1 -- 172.21.15.55:0/3053591363 shutdown_connections 2023-07-06T21:57:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:28.976+0000 7f3d59c9c640 1 -- 172.21.15.55:0/3053591363 wait complete. 2023-07-06T21:57:28.991 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:29.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.136+0000 7fa829f67640 1 Processor -- start 2023-07-06T21:57:29.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.136+0000 7fa829f67640 1 -- start start 2023-07-06T21:57:29.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.136+0000 7fa829f67640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8240ca450 0x7fa82406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.136+0000 7fa829f67640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa8240b3730 0x7fa82415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.136+0000 7fa829f67640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa824159cd0 con 0x7fa8240712f0 2023-07-06T21:57:29.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.136+0000 7fa829f67640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8240693f0 con 0x7fa8240b3730 2023-07-06T21:57:29.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.136+0000 7fa829f67640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82406aca0 con 0x7fa8240ca450 2023-07-06T21:57:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.136+0000 7fa822ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8240ca450 0x7fa82406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.136+0000 7fa823fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa8240b3730 0x7fa82415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.136+0000 7fa822ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8240ca450 0x7fa82406a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:57744/0 (socket says 172.21.15.55:57744) 2023-07-06T21:57:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.136+0000 7fa823fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa8240b3730 0x7fa82415d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:38842/0 (socket says 172.21.15.55:38842) 2023-07-06T21:57:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.136+0000 7fa822ffd640 1 -- 172.21.15.55:0/3530554245 learned_addr learned my addr 172.21.15.55:0/3530554245 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.136+0000 7fa8237fe640 1 --1- 172.21.15.55:0/3530554245 >> v1:172.21.15.138:6789/0 conn(0x7fa8240712f0 0x7fa8240c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:53098/0 (socket says 172.21.15.55:53098) 2023-07-06T21:57:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.140+0000 7fa822ffd640 1 -- 172.21.15.55:0/3530554245 >> v2:172.21.15.138:3300/0 conn(0x7fa8240b3730 msgr2=0x7fa82415d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.140+0000 7fa822ffd640 1 --2- 172.21.15.55:0/3530554245 >> v2:172.21.15.138:3300/0 conn(0x7fa8240b3730 0x7fa82415d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.140+0000 7fa822ffd640 1 -- 172.21.15.55:0/3530554245 >> v1:172.21.15.138:6789/0 conn(0x7fa8240712f0 legacy=0x7fa8240c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.140+0000 7fa822ffd640 1 -- 172.21.15.55:0/3530554245 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8240696b0 con 0x7fa8240ca450 2023-07-06T21:57:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.140+0000 7fa823fff640 1 --2- 172.21.15.55:0/3530554245 >> v2:172.21.15.138:3300/0 conn(0x7fa8240b3730 0x7fa82415d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:29.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.140+0000 7fa822ffd640 1 --2- 172.21.15.55:0/3530554245 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8240ca450 0x7fa82406a610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa818009870 tx=0x7fa81801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57b37678af818a89 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.140+0000 7fa8227fc640 1 -- 172.21.15.55:0/3530554245 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8180aa670 con 0x7fa8240ca450 2023-07-06T21:57:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.140+0000 7fa8227fc640 1 -- 172.21.15.55:0/3530554245 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8180aa7d0 con 0x7fa8240ca450 2023-07-06T21:57:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.140+0000 7fa8227fc640 1 -- 172.21.15.55:0/3530554245 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8180aab60 con 0x7fa8240ca450 2023-07-06T21:57:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 -- 172.21.15.55:0/3530554245 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8240ca450 msgr2=0x7fa82406a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 --2- 172.21.15.55:0/3530554245 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8240ca450 0x7fa82406a610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa818009870 tx=0x7fa81801c510 comp rx=0 tx=0).stop 2023-07-06T21:57:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 -- 172.21.15.55:0/3530554245 shutdown_connections 2023-07-06T21:57:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 --2- 172.21.15.55:0/3530554245 >> v2:172.21.15.138:3300/0 conn(0x7fa8240b3730 0x7fa82415d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 --2- 172.21.15.55:0/3530554245 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8240ca450 0x7fa82406a610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 -- 172.21.15.55:0/3530554245 >> 172.21.15.55:0/3530554245 conn(0x7fa8240cded0 msgr2=0x7fa8240ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 -- 172.21.15.55:0/3530554245 shutdown_connections 2023-07-06T21:57:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 -- 172.21.15.55:0/3530554245 wait complete. 2023-07-06T21:57:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 Processor -- start 2023-07-06T21:57:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 -- start start 2023-07-06T21:57:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8240712f0 0x7fa8241529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8240b3730 0x7fa824154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8240ca450 0x7fa82414b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa824152f80 con 0x7fa8240712f0 2023-07-06T21:57:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa824153260 con 0x7fa8240ca450 2023-07-06T21:57:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa829f67640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa824153540 con 0x7fa8240b3730 2023-07-06T21:57:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa8237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8240712f0 0x7fa8241529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa8237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8240712f0 0x7fa8241529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46468/0 (socket says 172.21.15.55:46468) 2023-07-06T21:57:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa8237fe640 1 -- 172.21.15.55:0/2371021439 learned_addr learned my addr 172.21.15.55:0/2371021439 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa823fff640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8240ca450 0x7fa82414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.144+0000 7fa822ffd640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8240b3730 0x7fa824154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.148+0000 7fa823fff640 1 -- 172.21.15.55:0/2371021439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8240b3730 msgr2=0x7fa824154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.148+0000 7fa823fff640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8240b3730 0x7fa824154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.148+0000 7fa823fff640 1 -- 172.21.15.55:0/2371021439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8240712f0 msgr2=0x7fa8241529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.148+0000 7fa823fff640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8240712f0 0x7fa8241529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.148+0000 7fa823fff640 1 -- 172.21.15.55:0/2371021439 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c009a70 con 0x7fa8240ca450 2023-07-06T21:57:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.148+0000 7fa8237fe640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8240712f0 0x7fa8241529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.148+0000 7fa823fff640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8240ca450 0x7fa82414b330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00efc0 tx=0x7fa81c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.148+0000 7fa80bfff640 1 -- 172.21.15.55:0/2371021439 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c00cd30 con 0x7fa8240ca450 2023-07-06T21:57:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.148+0000 7fa80bfff640 1 -- 172.21.15.55:0/2371021439 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c00f040 con 0x7fa8240ca450 2023-07-06T21:57:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.148+0000 7fa80bfff640 1 -- 172.21.15.55:0/2371021439 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c003be0 con 0x7fa8240ca450 2023-07-06T21:57:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.148+0000 7fa829f67640 1 -- 172.21.15.55:0/2371021439 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8180094d0 con 0x7fa8240ca450 2023-07-06T21:57:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.148+0000 7fa829f67640 1 -- 172.21.15.55:0/2371021439 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa824153b00 con 0x7fa8240ca450 2023-07-06T21:57:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.148+0000 7fa829f67640 1 -- 172.21.15.55:0/2371021439 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa824153cf0 con 0x7fa8240ca450 2023-07-06T21:57:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.148+0000 7fa80bfff640 1 -- 172.21.15.55:0/2371021439 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa81c014480 con 0x7fa8240ca450 2023-07-06T21:57:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.152+0000 7fa80bfff640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa8100663a0 0x7fa810068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.152+0000 7fa80bfff640 1 -- 172.21.15.55:0/2371021439 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa81c085200 con 0x7fa8240ca450 2023-07-06T21:57:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.152+0000 7fa8237fe640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa8100663a0 0x7fa810068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.152+0000 7fa8237fe640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa8100663a0 0x7fa810068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa814000f70 tx=0x7fa814007f10 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:29.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.156+0000 7fa80bfff640 1 -- 172.21.15.55:0/2371021439 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa81c0524b0 con 0x7fa8240ca450 2023-07-06T21:57:29.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.308+0000 7fa829f67640 1 -- 172.21.15.55:0/2371021439 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8241533a0 con 0x7fa8240ca450 2023-07-06T21:57:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.312+0000 7fa80bfff640 1 -- 172.21.15.55:0/2371021439 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+18543 (secure 0 0 0) 0x7fa8241533a0 con 0x7fa8240ca450 2023-07-06T21:57:29.309 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:29.309 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":89,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:57:26.545455+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:57:23.252496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-06T21:57:24.528387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:29.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.312+0000 7fa829f67640 1 -- 172.21.15.55:0/2371021439 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa8100663a0 msgr2=0x7fa810068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.312+0000 7fa829f67640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa8100663a0 0x7fa810068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa814000f70 tx=0x7fa814007f10 comp rx=0 tx=0).stop 2023-07-06T21:57:29.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.312+0000 7fa829f67640 1 -- 172.21.15.55:0/2371021439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8240ca450 msgr2=0x7fa82414b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.312+0000 7fa829f67640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8240ca450 0x7fa82414b330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00efc0 tx=0x7fa81c00c490 comp rx=0 tx=0).stop 2023-07-06T21:57:29.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.312+0000 7fa829f67640 1 -- 172.21.15.55:0/2371021439 shutdown_connections 2023-07-06T21:57:29.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.312+0000 7fa829f67640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa8100663a0 0x7fa810068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.312+0000 7fa829f67640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8240ca450 0x7fa82414b330 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.312+0000 7fa829f67640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8240b3730 0x7fa824154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.312+0000 7fa829f67640 1 --2- 172.21.15.55:0/2371021439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8240712f0 0x7fa8241529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.312+0000 7fa829f67640 1 -- 172.21.15.55:0/2371021439 >> 172.21.15.55:0/2371021439 conn(0x7fa8240cded0 msgr2=0x7fa8240cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:29.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.312+0000 7fa829f67640 1 -- 172.21.15.55:0/2371021439 shutdown_connections 2023-07-06T21:57:29.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.312+0000 7fa829f67640 1 -- 172.21.15.55:0/2371021439 wait complete. 2023-07-06T21:57:29.330 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T21:57:29.330 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:57:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.476+0000 7f8bd309c640 1 Processor -- start 2023-07-06T21:57:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.476+0000 7f8bd309c640 1 -- start start 2023-07-06T21:57:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.476+0000 7f8bd309c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8bcc1587d0 0x7f8bcc070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.476+0000 7f8bd309c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8bcc0710c0 0x7f8bcc0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.476+0000 7f8bd309c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bcc06fae0 con 0x7f8bcc158400 2023-07-06T21:57:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.476+0000 7f8bd309c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bcc06fdc0 con 0x7f8bcc1587d0 2023-07-06T21:57:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.476+0000 7f8bd309c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bcc0700a0 con 0x7f8bcc0710c0 2023-07-06T21:57:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.476+0000 7f8bcbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8bcc1587d0 0x7f8bcc070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.480+0000 7f8bcbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8bcc1587d0 0x7f8bcc070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46472/0 (socket says 172.21.15.55:46472) 2023-07-06T21:57:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.480+0000 7f8bcbfff640 1 -- 172.21.15.55:0/1774172973 learned_addr learned my addr 172.21.15.55:0/1774172973 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.480+0000 7f8bcbfff640 1 -- 172.21.15.55:0/1774172973 >> v2:172.21.15.138:3300/0 conn(0x7f8bcc0710c0 msgr2=0x7f8bcc0cbaa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T21:57:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.480+0000 7f8bcbfff640 1 --2- 172.21.15.55:0/1774172973 >> v2:172.21.15.138:3300/0 conn(0x7f8bcc0710c0 0x7f8bcc0cbaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.480+0000 7f8bcbfff640 1 -- 172.21.15.55:0/1774172973 >> v1:172.21.15.138:6789/0 conn(0x7f8bcc158400 legacy=0x7f8bcc0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.480+0000 7f8bcbfff640 1 -- 172.21.15.55:0/1774172973 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc070380 con 0x7f8bcc1587d0 2023-07-06T21:57:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.480+0000 7f8bcbfff640 1 --2- 172.21.15.55:0/1774172973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bcc1587d0 0x7f8bcc070b80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0ca570 tx=0x7f8bb801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c94c9de6651a1f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.480+0000 7f8bcb7fe640 1 -- 172.21.15.55:0/1774172973 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb80ac620 con 0x7f8bcc1587d0 2023-07-06T21:57:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.480+0000 7f8bcb7fe640 1 -- 172.21.15.55:0/1774172973 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb80ac780 con 0x7f8bcc1587d0 2023-07-06T21:57:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.480+0000 7f8bcb7fe640 1 -- 172.21.15.55:0/1774172973 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb80acb10 con 0x7f8bcc1587d0 2023-07-06T21:57:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.480+0000 7f8bd309c640 1 -- 172.21.15.55:0/1774172973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bcc1587d0 msgr2=0x7f8bcc070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.480+0000 7f8bd309c640 1 --2- 172.21.15.55:0/1774172973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bcc1587d0 0x7f8bcc070b80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0ca570 tx=0x7f8bb801c4b0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd309c640 1 -- 172.21.15.55:0/1774172973 shutdown_connections 2023-07-06T21:57:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd309c640 1 --2- 172.21.15.55:0/1774172973 >> v2:172.21.15.138:3300/0 conn(0x7f8bcc0710c0 0x7f8bcc0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd309c640 1 --2- 172.21.15.55:0/1774172973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bcc1587d0 0x7f8bcc070b80 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd309c640 1 -- 172.21.15.55:0/1774172973 >> 172.21.15.55:0/1774172973 conn(0x7f8bcc0cded0 msgr2=0x7f8bcc0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd309c640 1 -- 172.21.15.55:0/1774172973 shutdown_connections 2023-07-06T21:57:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd309c640 1 -- 172.21.15.55:0/1774172973 wait complete. 2023-07-06T21:57:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd309c640 1 Processor -- start 2023-07-06T21:57:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd309c640 1 -- start start 2023-07-06T21:57:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd309c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bcc0710c0 0x7f8bcc15c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd309c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bcc158400 0x7f8bcc146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd309c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bcc1587d0 0x7f8bcc0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd309c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc15a7c0 con 0x7f8bcc1587d0 2023-07-06T21:57:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd309c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc15aaa0 con 0x7f8bcc0710c0 2023-07-06T21:57:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd309c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc15ad80 con 0x7f8bcc158400 2023-07-06T21:57:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd1639640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bcc1587d0 0x7f8bcc0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd1639640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bcc1587d0 0x7f8bcc0aece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46484/0 (socket says 172.21.15.55:46484) 2023-07-06T21:57:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd1639640 1 -- 172.21.15.55:0/3493030379 learned_addr learned my addr 172.21.15.55:0/3493030379 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bcbfff640 1 --2- 172.21.15.55:0/3493030379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bcc158400 0x7f8bcc146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd0e38640 1 --2- 172.21.15.55:0/3493030379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bcc0710c0 0x7f8bcc15c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd1639640 1 -- 172.21.15.55:0/3493030379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bcc158400 msgr2=0x7f8bcc146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd1639640 1 --2- 172.21.15.55:0/3493030379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bcc158400 0x7f8bcc146250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd1639640 1 -- 172.21.15.55:0/3493030379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bcc0710c0 msgr2=0x7f8bcc15c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd1639640 1 --2- 172.21.15.55:0/3493030379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bcc0710c0 0x7f8bcc15c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.484+0000 7f8bd1639640 1 -- 172.21.15.55:0/3493030379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb80094d0 con 0x7f8bcc1587d0 2023-07-06T21:57:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.488+0000 7f8bd1639640 1 --2- 172.21.15.55:0/3493030379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bcc1587d0 0x7f8bcc0aece0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400b990 tx=0x7f8bc400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.488+0000 7f8bc97fa640 1 -- 172.21.15.55:0/3493030379 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400cba0 con 0x7f8bcc1587d0 2023-07-06T21:57:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.488+0000 7f8bc97fa640 1 -- 172.21.15.55:0/3493030379 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc400cd00 con 0x7f8bcc1587d0 2023-07-06T21:57:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.488+0000 7f8bc97fa640 1 -- 172.21.15.55:0/3493030379 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4014680 con 0x7f8bcc1587d0 2023-07-06T21:57:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.488+0000 7f8bd309c640 1 -- 172.21.15.55:0/3493030379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bcc15b060 con 0x7f8bcc1587d0 2023-07-06T21:57:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.488+0000 7f8bd309c640 1 -- 172.21.15.55:0/3493030379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bcc15b620 con 0x7f8bcc1587d0 2023-07-06T21:57:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.488+0000 7f8bd309c640 1 -- 172.21.15.55:0/3493030379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bcc06c580 con 0x7f8bcc1587d0 2023-07-06T21:57:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.488+0000 7f8bc97fa640 1 -- 172.21.15.55:0/3493030379 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8bc401d3b0 con 0x7f8bcc1587d0 2023-07-06T21:57:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.488+0000 7f8bc97fa640 1 --2- 172.21.15.55:0/3493030379 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f8bb00663a0 0x7f8bb0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.488+0000 7f8bc97fa640 1 -- 172.21.15.55:0/3493030379 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8bc4083ff0 con 0x7f8bcc1587d0 2023-07-06T21:57:29.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.488+0000 7f8bd0e38640 1 --2- 172.21.15.55:0/3493030379 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f8bb00663a0 0x7f8bb0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.488+0000 7f8bd0e38640 1 --2- 172.21.15.55:0/3493030379 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f8bb00663a0 0x7f8bb0068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00016c0 tx=0x7f8bc0009040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:29.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.492+0000 7f8bc97fa640 1 -- 172.21.15.55:0/3493030379 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8bc40b4700 con 0x7f8bcc1587d0 2023-07-06T21:57:29.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.648+0000 7f8bd309c640 1 -- 172.21.15.55:0/3493030379 --> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8bcc0cc3f0 con 0x7f8bb00663a0 2023-07-06T21:57:29.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.656+0000 7f8bc97fa640 1 -- 172.21.15.55:0/3493030379 <== mgr.6681 v2:172.21.15.55:6832/3540074910 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296588 (secure 0 0 0) 0x7f8bc0001c40 con 0x7f8bb00663a0 2023-07-06T21:57:29.659 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:29.660 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:57:29.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.660+0000 7f8bd309c640 1 -- 172.21.15.55:0/3493030379 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f8bb00663a0 msgr2=0x7f8bb0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.660+0000 7f8bd309c640 1 --2- 172.21.15.55:0/3493030379 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f8bb00663a0 0x7f8bb0068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00016c0 tx=0x7f8bc0009040 comp rx=0 tx=0).stop 2023-07-06T21:57:29.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.660+0000 7f8bd309c640 1 -- 172.21.15.55:0/3493030379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bcc1587d0 msgr2=0x7f8bcc0aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.660+0000 7f8bd309c640 1 --2- 172.21.15.55:0/3493030379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bcc1587d0 0x7f8bcc0aece0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400b990 tx=0x7f8bc400be50 comp rx=0 tx=0).stop 2023-07-06T21:57:29.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.660+0000 7f8bd309c640 1 -- 172.21.15.55:0/3493030379 shutdown_connections 2023-07-06T21:57:29.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.660+0000 7f8bd309c640 1 --2- 172.21.15.55:0/3493030379 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f8bb00663a0 0x7f8bb0068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.660+0000 7f8bd309c640 1 --2- 172.21.15.55:0/3493030379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bcc1587d0 0x7f8bcc0aece0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.660+0000 7f8bd309c640 1 --2- 172.21.15.55:0/3493030379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bcc158400 0x7f8bcc146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.660+0000 7f8bd309c640 1 --2- 172.21.15.55:0/3493030379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bcc0710c0 0x7f8bcc15c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.660+0000 7f8bd309c640 1 -- 172.21.15.55:0/3493030379 >> 172.21.15.55:0/3493030379 conn(0x7f8bcc0cded0 msgr2=0x7f8bcc0ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:29.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.660+0000 7f8bd309c640 1 -- 172.21.15.55:0/3493030379 shutdown_connections 2023-07-06T21:57:29.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.660+0000 7f8bd309c640 1 -- 172.21.15.55:0/3493030379 wait complete. 2023-07-06T21:57:29.679 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T21:57:27.846599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":273984,"kb_used_data":9216,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754700736,"statfs":{"total":773094113280,"available":772813553664,"internally_reserved":0,"allocated":9437184,"data_stored":5488850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000594"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"77'161","reported_seq":456,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-06T21:57:21.290633+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:57:21.290633+0000","last_peered":"2023-07-06T21:57:21.290633+0000","last_clean":"2023-07-06T21:57:21.290633+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:57:21.290633+0000","last_undegraded":"2023-07-06T21:57:21.290633+0000","last_fullsized":"2023-07-06T21:57:21.290633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:04:11.443704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-06T21:57:21.290233+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:57:21.290233+0000","last_peered":"2023-07-06T21:57:21.290233+0000","last_clean":"2023-07-06T21:57:21.290233+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:57:21.290233+0000","last_undegraded":"2023-07-06T21:57:21.290233+0000","last_fullsized":"2023-07-06T21:57:21.290233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:24:34.324748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":144,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-06T21:57:21.290538+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:57:21.290538+0000","last_peered":"2023-07-06T21:57:21.290538+0000","last_clean":"2023-07-06T21:57:21.290538+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:57:21.290538+0000","last_undegraded":"2023-07-06T21:57:21.290538+0000","last_fullsized":"2023-07-06T21:57:21.290538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:24:39.185683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-06T21:57:21.100541+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:57:21.100541+0000","last_peered":"2023-07-06T21:57:21.100541+0000","last_clean":"2023-07-06T21:57:21.100541+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:57:21.100541+0000","last_undegraded":"2023-07-06T21:57:21.100541+0000","last_fullsized":"2023-07-06T21:57:21.100541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:27:14.283285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-06T21:57:21.290205+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:57:21.290205+0000","last_peered":"2023-07-06T21:57:21.290205+0000","last_clean":"2023-07-06T21:57:21.290205+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:57:21.290205+0000","last_undegraded":"2023-07-06T21:57:21.290205+0000","last_fullsized":"2023-07-06T21:57:21.290205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:31:43.465644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":138,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-06T21:57:21.099496+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:57:21.099496+0000","last_peered":"2023-07-06T21:57:21.099496+0000","last_clean":"2023-07-06T21:57:21.099496+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:57:21.099496+0000","last_undegraded":"2023-07-06T21:57:21.099496+0000","last_fullsized":"2023-07-06T21:57:21.099496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:35:38.670516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":144,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-06T21:57:21.290557+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:57:21.290557+0000","last_peered":"2023-07-06T21:57:21.290557+0000","last_clean":"2023-07-06T21:57:21.290557+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:57:21.290557+0000","last_undegraded":"2023-07-06T21:57:21.290557+0000","last_fullsized":"2023-07-06T21:57:21.290557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:55:00.595110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-06T21:57:21.099512+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:57:21.099512+0000","last_peered":"2023-07-06T21:57:21.099512+0000","last_clean":"2023-07-06T21:57:21.099512+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:57:21.099512+0000","last_undegraded":"2023-07-06T21:57:21.099512+0000","last_fullsized":"2023-07-06T21:57:21.099512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:39:19.306235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:25.122155+0000","last_change":"2023-07-06T21:57:25.122155+0000","last_active":"2023-07-06T21:57:25.122155+0000","last_peered":"2023-07-06T21:57:25.122155+0000","last_clean":"2023-07-06T21:57:25.122155+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:25.122155+0000","last_undegraded":"2023-07-06T21:57:25.122155+0000","last_fullsized":"2023-07-06T21:57:25.122155+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:24.105563+0000","last_change":"2023-07-06T21:57:24.105563+0000","last_active":"2023-07-06T21:57:24.105563+0000","last_peered":"2023-07-06T21:57:24.105563+0000","last_clean":"2023-07-06T21:57:24.105563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:24.105563+0000","last_undegraded":"2023-07-06T21:57:24.105563+0000","last_fullsized":"2023-07-06T21:57:24.105563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-06T21:57:21.290294+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:57:21.290294+0000","last_peered":"2023-07-06T21:57:21.290294+0000","last_clean":"2023-07-06T21:57:21.290294+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:57:21.290294+0000","last_undegraded":"2023-07-06T21:57:21.290294+0000","last_fullsized":"2023-07-06T21:57:21.290294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:37:16.394860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1588,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1626112,"data_stored":1129137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.68899999999999995},"min":{"1min":0.45200000000000001,"5min":0.35199999999999998,"15min":0.30599999999999999},"max":{"1min":0.92500000000000004,"5min":0.93999999999999995,"15min":0.97699999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.70299999999999996,"15min":0.69699999999999995},"min":{"1min":0.498,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":0.95899999999999996,"5min":0.98799999999999999,"15min":0.99399999999999999},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Jul 6 21:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.59699999999999998,"5min":0.39800000000000002,"15min":0.34799999999999998},"max":{"1min":0.97699999999999998,"5min":1.0449999999999999,"15min":1.0649999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.70599999999999996,"15min":0.71299999999999997},"min":{"1min":0.626,"5min":0.434,"15min":0.434},"max":{"1min":0.90400000000000003,"5min":0.94099999999999995,"15min":0.97899999999999998},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.57199999999999995,"5min":0.377,"15min":0.377},"max":{"1min":0.92000000000000004,"5min":0.94799999999999995,"15min":0.94999999999999996},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.64100000000000001,"5min":0.436,"15min":0.42599999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0529999999999999},"last":0.754}]},{"osd":3,"last update":"Thu Jul 6 21:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70399999999999996,"15min":0.71599999999999997},"min":{"1min":0.60899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":0.91800000000000004,"15min":1.0469999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73099999999999998,"15min":0.73799999999999999},"min":{"1min":0.61299999999999999,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":0.89700000000000002,"5min":0.96599999999999997,"15min":1.006},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.38500000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55600000000000005,"15min":0.57799999999999996},"min":{"1min":0.46600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.96299999999999997},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jul 6 21:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.42299999999999999,"5min":0.376,"15min":0.34999999999999998},"max":{"1min":0.76600000000000001,"5min":0.89500000000000002,"15min":0.98499999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":0.77500000000000002,"5min":0.874,"15min":0.99199999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.47399999999999998,"5min":0.44,"15min":0.40200000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0309999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.48299999999999998,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.79600000000000004,"5min":0.98399999999999999,"15min":1.0940000000000001},"last":0.496}]}]},{"osd":6,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":1028096,"data_stored":537750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.70299999999999996,"15min":0.70399999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90400000000000003,"5min":0.97899999999999998,"15min":1.0980000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.45800000000000002,"15min":0.38300000000000001},"max":{"1min":1.0429999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.623}]},{"osd":1,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70699999999999996,"15min":0.71199999999999997},"min":{"1min":0.49399999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94099999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.749,"15min":0.73699999999999999},"min":{"1min":0.56699999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.48199999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90400000000000003,"5min":1.0129999999999999,"15min":1.3859999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97199999999999998,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.84799999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.755,"15min":0.748},"min":{"1min":0.58699999999999997,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1120000000000001,"5min":1.159,"15min":1.204},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.73199999999999998,"15min":0.73399999999999999},"min":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.498},"max":{"1min":0.94799999999999995,"5min":0.98099999999999998,"15min":1.4339999999999999},"last":0.80600000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56399999999999995,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.94499999999999995,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57899999999999996,"15min":0.61099999999999999},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76500000000000001,"5min":1.0509999999999999,"15min":1.321},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.63800000000000001},"min":{"1min":0.442,"5min":0.38600000000000001,"15min":0.36299999999999999},"max":{"1min":0.91400000000000003,"5min":0.93400000000000005,"15min":1.0089999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68700000000000006,"15min":0.71799999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0009999999999999,"5min":1.3089999999999999,"15min":1.631},"last":0.90800000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.67800000000000005},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.41699999999999998},"max":{"1min":0.97199999999999998,"5min":1.2549999999999999,"15min":1.3600000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64900000000000002,"15min":0.67600000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.874,"5min":0.93400000000000005,"15min":1.6930000000000001},"last":0.83199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575034,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":1032192,"data_stored":538769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.56399999999999995,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.96899999999999997,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.626},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.70299999999999996,"15min":0.71999999999999997},"min":{"1min":0.60699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93500000000000005,"5min":0.95999999999999996,"15min":0.99299999999999999},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.68999999999999995,"15min":0.71399999999999997},"min":{"1min":0.58599999999999997,"5min":0.40200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93100000000000005,"5min":1.0269999999999999,"15min":1.131},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.624,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93899999999999995,"5min":0.98699999999999999,"15min":1.0329999999999999},"last":0.754}]},{"osd":2,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.57899999999999996,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92000000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.58199999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97799999999999998,"5min":0.98299999999999998,"15min":1.0369999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.72699999999999998,"15min":0.749},"min":{"1min":0.56499999999999995,"5min":0.443,"15min":0.443},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.96099999999999997},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.63100000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93200000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54600000000000004,"15min":0.57599999999999996},"min":{"1min":0.48599999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":1},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.61199999999999999},"min":{"1min":0.46000000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.85199999999999998,"5min":0.91800000000000004,"15min":1.02},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58299999999999996,"15min":0.625},"min":{"1min":0.40100000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75900000000000001,"5min":0.86799999999999999,"15min":1.052},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.60099999999999998,"15min":0.63700000000000001},"min":{"1min":0.54000000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.96699999999999997},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.63300000000000001,"15min":0.67700000000000005},"min":{"1min":0.51900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88500000000000001,"5min":0.92200000000000004,"15min":1.0529999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65100000000000002,"15min":0.68799999999999994},"min":{"1min":0.54100000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81499999999999995,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.58399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575033,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32056,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":1032192,"data_stored":538769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.46500000000000002,"15min":0.39400000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88,"5min":1.123,"15min":1.123},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.44},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.361},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2829999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":0.84799999999999998,"5min":0.95299999999999996,"15min":1.2170000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.751},"min":{"1min":0.498,"5min":0.498,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":0.94299999999999995,"15min":1.649},"last":0.498}]},{"osd":3,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.4219999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.49099999999999999},"max":{"1min":0.91400000000000003,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.308},"max":{"1min":0.85999999999999999,"5min":0.86399999999999999,"15min":1.246},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.96099999999999997,"5min":0.97299999999999998,"15min":1.8049999999999999},"last":0.377}]},{"osd":6,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.36299999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.478},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":0.94999999999999996,"5min":0.99199999999999999,"15min":1.7250000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42399999999999999},"max":{"1min":1.0149999999999999,"5min":1.0720000000000001,"15min":1.534},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.47099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96399999999999997,"5min":1.01,"15min":1.585},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575034,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":1032192,"data_stored":538769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45500000000000002,"15min":0.45100000000000001},"min":{"1min":0.35599999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.63500000000000001,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.441},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.33400000000000002},"max":{"1min":0.70099999999999996,"5min":2.77,"15min":2.77},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jul 6 21:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.24299999999999999},"max":{"1min":0.88800000000000001,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":1.351,"15min":1.9590000000000001},"last":0.497}]},{"osd":2,"last update":"Thu Jul 6 21:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":0.79900000000000004,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79900000000000004,"5min":1.24,"15min":2.012},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jul 6 21:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.60099999999999998,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.855},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.78800000000000003,"15min":0.78400000000000003},"min":{"1min":0.63,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.383,"5min":1.383,"15min":1.524},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.82199999999999995,"15min":0.80300000000000005},"min":{"1min":0.64100000000000001,"5min":0.53100000000000003,"15min":0.42399999999999999},"max":{"1min":1.2709999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.79800000000000004,"15min":0.79400000000000004},"min":{"1min":0.57499999999999996,"5min":0.49399999999999999,"15min":0.44800000000000001},"max":{"1min":1.327,"5min":1.3999999999999999,"15min":1.883},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80800000000000005,"15min":0.79500000000000004},"min":{"1min":0.63700000000000001,"5min":0.46600000000000003,"15min":0.40000000000000002},"max":{"1min":1.3140000000000001,"5min":1.425,"15min":1.425},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.83599999999999997,"15min":0.80700000000000005},"min":{"1min":0.65300000000000002,"5min":0.56399999999999995,"15min":0.47899999999999998},"max":{"1min":1.419,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82699999999999996,"15min":0.81299999999999994},"min":{"1min":0.58499999999999996,"5min":0.5,"15min":0.497},"max":{"1min":1.2150000000000001,"5min":3.097,"15min":3.097},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.61899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1140000000000001,"5min":1.3480000000000001,"15min":1.9830000000000001},"last":0.84299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575034,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":1032192,"data_stored":538769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.32100000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.79200000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.316},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.49099999999999999},"min":{"1min":0.32400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.68500000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52000000000000002,"15min":0.50900000000000001},"min":{"1min":0.38600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68400000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.878},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.44400000000000001,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51900000000000002,"15min":0.503},"min":{"1min":0.39200000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.72399999999999998,"15min":0.76500000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.57399999999999995},"min":{"1min":0.46100000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74399999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.78400000000000003,"15min":0.78700000000000003},"min":{"1min":0.60599999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.80700000000000005,"15min":0.79100000000000004},"min":{"1min":0.67500000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.61399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.58299999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.81299999999999994,"15min":0.80500000000000005},"min":{"1min":0.59399999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.61099999999999999,"5min":0.497,"15min":0.497},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.82399999999999995,"15min":0.82199999999999995},"min":{"1min":0.57399999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83599999999999997,"15min":0.83499999999999996},"min":{"1min":0.63800000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.369},"last":0.83799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":1032192,"data_stored":538769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45100000000000001,"15min":0.441},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.27500000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.372},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.499,"15min":0.503},"min":{"1min":0.34799999999999998,"5min":0.32200000000000001,"15min":0.29399999999999998},"max":{"1min":0.69899999999999995,"5min":0.78900000000000003,"15min":0.92200000000000004},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.377,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.41499999999999998,"5min":0.34399999999999997,"15min":0.33300000000000002},"max":{"1min":0.79800000000000004,"5min":0.87,"15min":0.87},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.47499999999999998,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.73499999999999999,"5min":0.80600000000000005,"15min":0.96299999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.32000000000000001},"max":{"1min":0.70099999999999996,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.77000000000000002},"min":{"1min":0.55300000000000005,"5min":0.49199999999999999,"15min":0.38500000000000001},"max":{"1min":0.98699999999999999,"5min":1.143,"15min":1.3140000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.79100000000000004,"15min":0.78200000000000003},"min":{"1min":0.628,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":1.022,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.77800000000000002},"min":{"1min":0.59399999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0329999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.79100000000000004},"min":{"1min":0.52100000000000002,"5min":0.498,"15min":0.439},"max":{"1min":1.044,"5min":1.357,"15min":1.357},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79100000000000004,"15min":0.79300000000000004},"min":{"1min":0.58099999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.091,"5min":1.278,"15min":1.278},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80700000000000005,"15min":0.80000000000000004},"min":{"1min":0.55300000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0820000000000001,"5min":1.456,"15min":1.456},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.628,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0549999999999999,"5min":1.417,"15min":1.417},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81599999999999995,"15min":0.81999999999999995},"min":{"1min":0.63800000000000001,"5min":0.5,"15min":0.5},"max":{"1min":0.98199999999999998,"5min":1.397,"15min":1.397},"last":0.71599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575034,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1622016,"data_stored":1128118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.434,"15min":0.441},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.72399999999999998,"5min":0.86399999999999999,"15min":1.1459999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.623,"5min":0.98099999999999998,"15min":1.5189999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.41599999999999998,"5min":0.317,"15min":0.30099999999999999},"max":{"1min":0.63700000000000001,"5min":0.81699999999999995,"15min":1.228},"last":0.44},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.45600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68899999999999995,"5min":1.2050000000000001,"15min":1.454},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.308},"max":{"1min":0.76000000000000001,"5min":1.151,"15min":1.7969999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.47899999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72699999999999998,"5min":0.874,"15min":1.7190000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77700000000000002,"15min":0.78900000000000003},"min":{"1min":0.60799999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.101,"5min":1.1319999999999999,"15min":1.911},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77900000000000003,"15min":0.78500000000000003},"min":{"1min":0.623,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":0.999,"5min":1.139,"15min":1.3620000000000001},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.38400000000000001},"max":{"1min":1.123,"5min":1.1539999999999999,"15min":1.3700000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.64400000000000002,"5min":0.50700000000000001,"15min":0.44400000000000001},"max":{"1min":0.94499999999999995,"5min":1.163,"15min":1.758},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.80100000000000005,"15min":0.81100000000000005},"min":{"1min":0.67600000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.081,"5min":1.1020000000000001,"15min":1.8220000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.57899999999999996,"5min":0.53200000000000003,"15min":0.47199999999999998},"max":{"1min":1.0069999999999999,"5min":1.093,"15min":2.266},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.82099999999999995},"min":{"1min":0.68300000000000005,"5min":0.55900000000000005,"15min":0.53800000000000003},"max":{"1min":0.98399999999999999,"5min":1.1719999999999999,"15min":2.323},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81699999999999995,"15min":0.81299999999999994},"min":{"1min":0.64700000000000002,"5min":0.50900000000000001,"15min":0.435},"max":{"1min":1.04,"5min":1.1910000000000001,"15min":1.2829999999999999},"last":0.88100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:57:29.686 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:57:29.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.864+0000 7f2501f59640 1 Processor -- start 2023-07-06T21:57:29.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.864+0000 7f2501f59640 1 -- start start 2023-07-06T21:57:29.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.868+0000 7f2501f59640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24fc158400 0x7f24fc0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.868+0000 7f2501f59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24fc1587d0 0x7f24fc0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.868+0000 7f2501f59640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24fc06fae0 con 0x7f24fc0c9680 2023-07-06T21:57:29.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.868+0000 7f2501f59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24fc06fdc0 con 0x7f24fc1587d0 2023-07-06T21:57:29.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.868+0000 7f2501f59640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc0700a0 con 0x7f24fc158400 2023-07-06T21:57:29.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.868+0000 7f24fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24fc1587d0 0x7f24fc0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.868+0000 7f24fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24fc1587d0 0x7f24fc0cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46500/0 (socket says 172.21.15.55:46500) 2023-07-06T21:57:29.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.868+0000 7f24fbfff640 1 -- 172.21.15.55:0/2008888435 learned_addr learned my addr 172.21.15.55:0/2008888435 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:29.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.868+0000 7f24fb7fe640 1 --2- 172.21.15.55:0/2008888435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24fc158400 0x7f24fc0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.868+0000 7f24fbfff640 1 -- 172.21.15.55:0/2008888435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24fc158400 msgr2=0x7f24fc0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:29.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.868+0000 7f24fbfff640 1 --2- 172.21.15.55:0/2008888435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24fc158400 0x7f24fc0c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.868+0000 7f24fbfff640 1 -- 172.21.15.55:0/2008888435 >> v1:172.21.15.138:6789/0 conn(0x7f24fc0c9680 legacy=0x7f24fc070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.868+0000 7f24fbfff640 1 -- 172.21.15.55:0/2008888435 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc070380 con 0x7f24fc1587d0 2023-07-06T21:57:29.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f24fbfff640 1 --2- 172.21.15.55:0/2008888435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc1587d0 0x7f24fc0cbaa0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009e50 tx=0x7f24f401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1903e21637d13951 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:29.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f24fa7fc640 1 -- 172.21.15.55:0/2008888435 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f40a57c0 con 0x7f24fc1587d0 2023-07-06T21:57:29.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f24fa7fc640 1 -- 172.21.15.55:0/2008888435 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f40a5920 con 0x7f24fc1587d0 2023-07-06T21:57:29.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f24fa7fc640 1 -- 172.21.15.55:0/2008888435 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f40a5cb0 con 0x7f24fc1587d0 2023-07-06T21:57:29.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f2501f59640 1 -- 172.21.15.55:0/2008888435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc1587d0 msgr2=0x7f24fc0cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f2501f59640 1 --2- 172.21.15.55:0/2008888435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc1587d0 0x7f24fc0cbaa0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009e50 tx=0x7f24f401c9e0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f2501f59640 1 -- 172.21.15.55:0/2008888435 shutdown_connections 2023-07-06T21:57:29.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f2501f59640 1 --2- 172.21.15.55:0/2008888435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc1587d0 0x7f24fc0cbaa0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f2501f59640 1 --2- 172.21.15.55:0/2008888435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24fc158400 0x7f24fc0c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f2501f59640 1 -- 172.21.15.55:0/2008888435 >> 172.21.15.55:0/2008888435 conn(0x7f24fc0cded0 msgr2=0x7f24fc0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:29.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f2501f59640 1 -- 172.21.15.55:0/2008888435 shutdown_connections 2023-07-06T21:57:29.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f2501f59640 1 -- 172.21.15.55:0/2008888435 wait complete. 2023-07-06T21:57:29.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f2501f59640 1 Processor -- start 2023-07-06T21:57:29.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f2501f59640 1 -- start start 2023-07-06T21:57:29.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f2501f59640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24fc0c9680 0x7f24fc0c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.872+0000 7f2501f59640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24fc158400 0x7f24fc0c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f2501f59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc1587d0 0x7f24fc154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f2501f59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc1f4c70 con 0x7f24fc1587d0 2023-07-06T21:57:29.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f2501f59640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc0c7e60 con 0x7f24fc158400 2023-07-06T21:57:29.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f2501f59640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc1f4920 con 0x7f24fc0c9680 2023-07-06T21:57:29.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc1587d0 0x7f24fc154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24fb7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24fc0c9680 0x7f24fc0c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc1587d0 0x7f24fc154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46504/0 (socket says 172.21.15.55:46504) 2023-07-06T21:57:29.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24fb7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24fc0c9680 0x7f24fc0c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:57782/0 (socket says 172.21.15.55:57782) 2023-07-06T21:57:29.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24fbfff640 1 -- 172.21.15.55:0/4112936056 learned_addr learned my addr 172.21.15.55:0/4112936056 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:29.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24faffd640 1 --2- 172.21.15.55:0/4112936056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24fc158400 0x7f24fc0c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24fbfff640 1 -- 172.21.15.55:0/4112936056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24fc0c9680 msgr2=0x7f24fc0c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24fbfff640 1 --2- 172.21.15.55:0/4112936056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24fc0c9680 0x7f24fc0c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24fbfff640 1 -- 172.21.15.55:0/4112936056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24fc158400 msgr2=0x7f24fc0c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:29.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24fbfff640 1 --2- 172.21.15.55:0/4112936056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24fc158400 0x7f24fc0c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:29.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24fbfff640 1 -- 172.21.15.55:0/4112936056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f4009b30 con 0x7f24fc1587d0 2023-07-06T21:57:29.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24fbfff640 1 --2- 172.21.15.55:0/4112936056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc1587d0 0x7f24fc154c30 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f24f40af040 tx=0x7f24f4019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:29.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24e3fff640 1 -- 172.21.15.55:0/4112936056 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f40b8670 con 0x7f24fc1587d0 2023-07-06T21:57:29.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24e3fff640 1 -- 172.21.15.55:0/4112936056 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f40b87f0 con 0x7f24fc1587d0 2023-07-06T21:57:29.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f2501f59640 1 -- 172.21.15.55:0/4112936056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24fc0c6f50 con 0x7f24fc1587d0 2023-07-06T21:57:29.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24e3fff640 1 -- 172.21.15.55:0/4112936056 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f40b8ba0 con 0x7f24fc1587d0 2023-07-06T21:57:29.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f2501f59640 1 -- 172.21.15.55:0/4112936056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24fc0c6990 con 0x7f24fc1587d0 2023-07-06T21:57:29.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f2501f59640 1 -- 172.21.15.55:0/4112936056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24fc06c580 con 0x7f24fc1587d0 2023-07-06T21:57:29.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.876+0000 7f24e3fff640 1 -- 172.21.15.55:0/4112936056 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f24f40b8d00 con 0x7f24fc1587d0 2023-07-06T21:57:29.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.880+0000 7f24e3fff640 1 --2- 172.21.15.55:0/4112936056 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f24e80663a0 0x7f24e8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:29.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.880+0000 7f24e3fff640 1 -- 172.21.15.55:0/4112936056 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f24f411f540 con 0x7f24fc1587d0 2023-07-06T21:57:29.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.880+0000 7f24fb7fe640 1 --2- 172.21.15.55:0/4112936056 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f24e80663a0 0x7f24e8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:29.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.880+0000 7f24fb7fe640 1 --2- 172.21.15.55:0/4112936056 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f24e80663a0 0x7f24e8068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f24ec006aa0 tx=0x7f24ec008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:29.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:29.884+0000 7f24e3fff640 1 -- 172.21.15.55:0/4112936056 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f24f40ec8a0 con 0x7f24fc1587d0 2023-07-06T21:57:30.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.036+0000 7f2501f59640 1 -- 172.21.15.55:0/4112936056 --> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24fc0cc3f0 con 0x7f24e80663a0 2023-07-06T21:57:30.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.044+0000 7f24e3fff640 1 -- 172.21.15.55:0/4112936056 <== mgr.6681 v2:172.21.15.55:6832/3540074910 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311420 (secure 0 0 0) 0x7f24ec004030 con 0x7f24e80663a0 2023-07-06T21:57:30.045 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:30.047 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:57:30.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.048+0000 7f2501f59640 1 -- 172.21.15.55:0/4112936056 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f24e80663a0 msgr2=0x7f24e8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.048+0000 7f2501f59640 1 --2- 172.21.15.55:0/4112936056 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f24e80663a0 0x7f24e8068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f24ec006aa0 tx=0x7f24ec008040 comp rx=0 tx=0).stop 2023-07-06T21:57:30.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.048+0000 7f2501f59640 1 -- 172.21.15.55:0/4112936056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc1587d0 msgr2=0x7f24fc154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.048+0000 7f2501f59640 1 --2- 172.21.15.55:0/4112936056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc1587d0 0x7f24fc154c30 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f24f40af040 tx=0x7f24f4019780 comp rx=0 tx=0).stop 2023-07-06T21:57:30.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.048+0000 7f2501f59640 1 -- 172.21.15.55:0/4112936056 shutdown_connections 2023-07-06T21:57:30.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.048+0000 7f2501f59640 1 --2- 172.21.15.55:0/4112936056 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f24e80663a0 0x7f24e8068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.048+0000 7f2501f59640 1 --2- 172.21.15.55:0/4112936056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc1587d0 0x7f24fc154c30 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.048+0000 7f2501f59640 1 --2- 172.21.15.55:0/4112936056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24fc158400 0x7f24fc0c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.048+0000 7f2501f59640 1 --2- 172.21.15.55:0/4112936056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24fc0c9680 0x7f24fc0c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.048+0000 7f2501f59640 1 -- 172.21.15.55:0/4112936056 >> 172.21.15.55:0/4112936056 conn(0x7f24fc0cded0 msgr2=0x7f24fc0b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:30.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.048+0000 7f2501f59640 1 -- 172.21.15.55:0/4112936056 shutdown_connections 2023-07-06T21:57:30.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.048+0000 7f2501f59640 1 -- 172.21.15.55:0/4112936056 wait complete. 2023-07-06T21:57:30.066 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-06T21:57:29.847003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":283,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":292480,"kb_used_data":9664,"kb_used_omap":0,"kb_used_meta":282752,"kb_avail":754682240,"statfs":{"total":773094113280,"available":772794613760,"internally_reserved":0,"allocated":9895936,"data_stored":5716446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":289538048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.724382"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561170+0000","last_change":"2023-07-06T21:57:25.564254+0000","last_active":"2023-07-06T21:57:26.561170+0000","last_peered":"2023-07-06T21:57:26.561170+0000","last_clean":"2023-07-06T21:57:26.561170+0000","last_became_active":"2023-07-06T21:57:25.563908+0000","last_became_peered":"2023-07-06T21:57:25.563908+0000","last_unstale":"2023-07-06T21:57:26.561170+0000","last_undegraded":"2023-07-06T21:57:26.561170+0000","last_fullsized":"2023-07-06T21:57:26.561170+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:33:27.956611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.108327+0000","last_change":"2023-07-06T21:57:25.575421+0000","last_active":"2023-07-06T21:57:27.108327+0000","last_peered":"2023-07-06T21:57:27.108327+0000","last_clean":"2023-07-06T21:57:27.108327+0000","last_became_active":"2023-07-06T21:57:25.575150+0000","last_became_peered":"2023-07-06T21:57:25.575150+0000","last_unstale":"2023-07-06T21:57:27.108327+0000","last_undegraded":"2023-07-06T21:57:27.108327+0000","last_fullsized":"2023-07-06T21:57:27.108327+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:12:40.583358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.310515+0000","last_change":"2023-07-06T21:57:25.568079+0000","last_active":"2023-07-06T21:57:27.310515+0000","last_peered":"2023-07-06T21:57:27.310515+0000","last_clean":"2023-07-06T21:57:27.310515+0000","last_became_active":"2023-07-06T21:57:25.567704+0000","last_became_peered":"2023-07-06T21:57:25.567704+0000","last_unstale":"2023-07-06T21:57:27.310515+0000","last_undegraded":"2023-07-06T21:57:27.310515+0000","last_fullsized":"2023-07-06T21:57:27.310515+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:44:44.788635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608893+0000","last_change":"2023-07-06T21:57:25.586340+0000","last_active":"2023-07-06T21:57:27.608893+0000","last_peered":"2023-07-06T21:57:27.608893+0000","last_clean":"2023-07-06T21:57:27.608893+0000","last_became_active":"2023-07-06T21:57:25.586012+0000","last_became_peered":"2023-07-06T21:57:25.586012+0000","last_unstale":"2023-07-06T21:57:27.608893+0000","last_undegraded":"2023-07-06T21:57:27.608893+0000","last_fullsized":"2023-07-06T21:57:27.608893+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:33:15.859866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560574+0000","last_change":"2023-07-06T21:57:25.563251+0000","last_active":"2023-07-06T21:57:26.560574+0000","last_peered":"2023-07-06T21:57:26.560574+0000","last_clean":"2023-07-06T21:57:26.560574+0000","last_became_active":"2023-07-06T21:57:25.562981+0000","last_became_peered":"2023-07-06T21:57:25.562981+0000","last_unstale":"2023-07-06T21:57:26.560574+0000","last_undegraded":"2023-07-06T21:57:26.560574+0000","last_fullsized":"2023-07-06T21:57:26.560574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:51:58.900374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.107647+0000","last_change":"2023-07-06T21:57:25.581441+0000","last_active":"2023-07-06T21:57:27.107647+0000","last_peered":"2023-07-06T21:57:27.107647+0000","last_clean":"2023-07-06T21:57:27.107647+0000","last_became_active":"2023-07-06T21:57:25.580916+0000","last_became_peered":"2023-07-06T21:57:25.580916+0000","last_unstale":"2023-07-06T21:57:27.107647+0000","last_undegraded":"2023-07-06T21:57:27.107647+0000","last_fullsized":"2023-07-06T21:57:27.107647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:21:33.605172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.607810+0000","last_change":"2023-07-06T21:57:25.567865+0000","last_active":"2023-07-06T21:57:27.607810+0000","last_peered":"2023-07-06T21:57:27.607810+0000","last_clean":"2023-07-06T21:57:27.607810+0000","last_became_active":"2023-07-06T21:57:25.567540+0000","last_became_peered":"2023-07-06T21:57:25.567540+0000","last_unstale":"2023-07-06T21:57:27.607810+0000","last_undegraded":"2023-07-06T21:57:27.607810+0000","last_fullsized":"2023-07-06T21:57:27.607810+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:13:18.813925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.107755+0000","last_change":"2023-07-06T21:57:25.582891+0000","last_active":"2023-07-06T21:57:27.107755+0000","last_peered":"2023-07-06T21:57:27.107755+0000","last_clean":"2023-07-06T21:57:27.107755+0000","last_became_active":"2023-07-06T21:57:25.582599+0000","last_became_peered":"2023-07-06T21:57:25.582599+0000","last_unstale":"2023-07-06T21:57:27.107755+0000","last_undegraded":"2023-07-06T21:57:27.107755+0000","last_fullsized":"2023-07-06T21:57:27.107755+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:12:13.076338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560811+0000","last_change":"2023-07-06T21:57:25.571947+0000","last_active":"2023-07-06T21:57:26.560811+0000","last_peered":"2023-07-06T21:57:26.560811+0000","last_clean":"2023-07-06T21:57:26.560811+0000","last_became_active":"2023-07-06T21:57:25.571497+0000","last_became_peered":"2023-07-06T21:57:25.571497+0000","last_unstale":"2023-07-06T21:57:26.560811+0000","last_undegraded":"2023-07-06T21:57:26.560811+0000","last_fullsized":"2023-07-06T21:57:26.560811+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:57:38.049846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561166+0000","last_change":"2023-07-06T21:57:25.562348+0000","last_active":"2023-07-06T21:57:26.561166+0000","last_peered":"2023-07-06T21:57:26.561166+0000","last_clean":"2023-07-06T21:57:26.561166+0000","last_became_active":"2023-07-06T21:57:25.561629+0000","last_became_peered":"2023-07-06T21:57:25.561629+0000","last_unstale":"2023-07-06T21:57:26.561166+0000","last_undegraded":"2023-07-06T21:57:26.561166+0000","last_fullsized":"2023-07-06T21:57:26.561166+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:34:54.125628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561164+0000","last_change":"2023-07-06T21:57:25.565621+0000","last_active":"2023-07-06T21:57:26.561164+0000","last_peered":"2023-07-06T21:57:26.561164+0000","last_clean":"2023-07-06T21:57:26.561164+0000","last_became_active":"2023-07-06T21:57:25.565341+0000","last_became_peered":"2023-07-06T21:57:25.565341+0000","last_unstale":"2023-07-06T21:57:26.561164+0000","last_undegraded":"2023-07-06T21:57:26.561164+0000","last_fullsized":"2023-07-06T21:57:26.561164+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:22:14.716614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.609069+0000","last_change":"2023-07-06T21:57:25.577781+0000","last_active":"2023-07-06T21:57:27.609069+0000","last_peered":"2023-07-06T21:57:27.609069+0000","last_clean":"2023-07-06T21:57:27.609069+0000","last_became_active":"2023-07-06T21:57:25.576892+0000","last_became_peered":"2023-07-06T21:57:25.576892+0000","last_unstale":"2023-07-06T21:57:27.609069+0000","last_undegraded":"2023-07-06T21:57:27.609069+0000","last_fullsized":"2023-07-06T21:57:27.609069+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:41.190922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608634+0000","last_change":"2023-07-06T21:57:25.583330+0000","last_active":"2023-07-06T21:57:27.608634+0000","last_peered":"2023-07-06T21:57:27.608634+0000","last_clean":"2023-07-06T21:57:27.608634+0000","last_became_active":"2023-07-06T21:57:25.583020+0000","last_became_peered":"2023-07-06T21:57:25.583020+0000","last_unstale":"2023-07-06T21:57:27.608634+0000","last_undegraded":"2023-07-06T21:57:27.608634+0000","last_fullsized":"2023-07-06T21:57:27.608634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:42:44.393548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560613+0000","last_change":"2023-07-06T21:57:25.573846+0000","last_active":"2023-07-06T21:57:26.560613+0000","last_peered":"2023-07-06T21:57:26.560613+0000","last_clean":"2023-07-06T21:57:26.560613+0000","last_became_active":"2023-07-06T21:57:25.573601+0000","last_became_peered":"2023-07-06T21:57:25.573601+0000","last_unstale":"2023-07-06T21:57:26.560613+0000","last_undegraded":"2023-07-06T21:57:26.560613+0000","last_fullsized":"2023-07-06T21:57:26.560613+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:52:28.372799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.609007+0000","last_change":"2023-07-06T21:57:25.569588+0000","last_active":"2023-07-06T21:57:27.609007+0000","last_peered":"2023-07-06T21:57:27.609007+0000","last_clean":"2023-07-06T21:57:27.609007+0000","last_became_active":"2023-07-06T21:57:25.569338+0000","last_became_peered":"2023-07-06T21:57:25.569338+0000","last_unstale":"2023-07-06T21:57:27.609007+0000","last_undegraded":"2023-07-06T21:57:27.609007+0000","last_fullsized":"2023-07-06T21:57:27.609007+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:25:19.191617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560286+0000","last_change":"2023-07-06T21:57:25.583296+0000","last_active":"2023-07-06T21:57:26.560286+0000","last_peered":"2023-07-06T21:57:26.560286+0000","last_clean":"2023-07-06T21:57:26.560286+0000","last_became_active":"2023-07-06T21:57:25.583018+0000","last_became_peered":"2023-07-06T21:57:25.583018+0000","last_unstale":"2023-07-06T21:57:26.560286+0000","last_undegraded":"2023-07-06T21:57:26.560286+0000","last_fullsized":"2023-07-06T21:57:26.560286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:51:21.759895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560878+0000","last_change":"2023-07-06T21:57:25.571776+0000","last_active":"2023-07-06T21:57:26.560878+0000","last_peered":"2023-07-06T21:57:26.560878+0000","last_clean":"2023-07-06T21:57:26.560878+0000","last_became_active":"2023-07-06T21:57:25.571111+0000","last_became_peered":"2023-07-06T21:57:25.571111+0000","last_unstale":"2023-07-06T21:57:26.560878+0000","last_undegraded":"2023-07-06T21:57:26.560878+0000","last_fullsized":"2023-07-06T21:57:26.560878+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:31:21.353168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.609489+0000","last_change":"2023-07-06T21:57:25.584173+0000","last_active":"2023-07-06T21:57:27.609489+0000","last_peered":"2023-07-06T21:57:27.609489+0000","last_clean":"2023-07-06T21:57:27.609489+0000","last_became_active":"2023-07-06T21:57:25.583821+0000","last_became_peered":"2023-07-06T21:57:25.583821+0000","last_unstale":"2023-07-06T21:57:27.609489+0000","last_undegraded":"2023-07-06T21:57:27.609489+0000","last_fullsized":"2023-07-06T21:57:27.609489+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:09:10.751299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.107993+0000","last_change":"2023-07-06T21:57:25.581040+0000","last_active":"2023-07-06T21:57:27.107993+0000","last_peered":"2023-07-06T21:57:27.107993+0000","last_clean":"2023-07-06T21:57:27.107993+0000","last_became_active":"2023-07-06T21:57:25.580696+0000","last_became_peered":"2023-07-06T21:57:25.580696+0000","last_unstale":"2023-07-06T21:57:27.107993+0000","last_undegraded":"2023-07-06T21:57:27.107993+0000","last_fullsized":"2023-07-06T21:57:27.107993+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:45:02.913834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608740+0000","last_change":"2023-07-06T21:57:25.567985+0000","last_active":"2023-07-06T21:57:27.608740+0000","last_peered":"2023-07-06T21:57:27.608740+0000","last_clean":"2023-07-06T21:57:27.608740+0000","last_became_active":"2023-07-06T21:57:25.567723+0000","last_became_peered":"2023-07-06T21:57:25.567723+0000","last_unstale":"2023-07-06T21:57:27.608740+0000","last_undegraded":"2023-07-06T21:57:27.608740+0000","last_fullsized":"2023-07-06T21:57:27.608740+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:03:33.888742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560636+0000","last_change":"2023-07-06T21:57:25.568085+0000","last_active":"2023-07-06T21:57:26.560636+0000","last_peered":"2023-07-06T21:57:26.560636+0000","last_clean":"2023-07-06T21:57:26.560636+0000","last_became_active":"2023-07-06T21:57:25.567800+0000","last_became_peered":"2023-07-06T21:57:25.567800+0000","last_unstale":"2023-07-06T21:57:26.560636+0000","last_undegraded":"2023-07-06T21:57:26.560636+0000","last_fullsized":"2023-07-06T21:57:26.560636+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:15:22.910861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560500+0000","last_change":"2023-07-06T21:57:25.559775+0000","last_active":"2023-07-06T21:57:26.560500+0000","last_peered":"2023-07-06T21:57:26.560500+0000","last_clean":"2023-07-06T21:57:26.560500+0000","last_became_active":"2023-07-06T21:57:25.559453+0000","last_became_peered":"2023-07-06T21:57:25.559453+0000","last_unstale":"2023-07-06T21:57:26.560500+0000","last_undegraded":"2023-07-06T21:57:26.560500+0000","last_fullsized":"2023-07-06T21:57:26.560500+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:16:04.760808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560677+0000","last_change":"2023-07-06T21:57:25.568815+0000","last_active":"2023-07-06T21:57:26.560677+0000","last_peered":"2023-07-06T21:57:26.560677+0000","last_clean":"2023-07-06T21:57:26.560677+0000","last_became_active":"2023-07-06T21:57:25.568472+0000","last_became_peered":"2023-07-06T21:57:25.568472+0000","last_unstale":"2023-07-06T21:57:26.560677+0000","last_undegraded":"2023-07-06T21:57:26.560677+0000","last_fullsized":"2023-07-06T21:57:26.560677+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:27:52.025191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560495+0000","last_change":"2023-07-06T21:57:25.583605+0000","last_active":"2023-07-06T21:57:26.560495+0000","last_peered":"2023-07-06T21:57:26.560495+0000","last_clean":"2023-07-06T21:57:26.560495+0000","last_became_active":"2023-07-06T21:57:25.583307+0000","last_became_peered":"2023-07-06T21:57:25.583307+0000","last_unstale":"2023-07-06T21:57:26.560495+0000","last_undegraded":"2023-07-06T21:57:26.560495+0000","last_fullsized":"2023-07-06T21:57:26.560495+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:45:56.235274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561765+0000","last_change":"2023-07-06T21:57:25.570330+0000","last_active":"2023-07-06T21:57:26.561765+0000","last_peered":"2023-07-06T21:57:26.561765+0000","last_clean":"2023-07-06T21:57:26.561765+0000","last_became_active":"2023-07-06T21:57:25.570034+0000","last_became_peered":"2023-07-06T21:57:25.570034+0000","last_unstale":"2023-07-06T21:57:26.561765+0000","last_undegraded":"2023-07-06T21:57:26.561765+0000","last_fullsized":"2023-07-06T21:57:26.561765+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:20:50.080127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608211+0000","last_change":"2023-07-06T21:57:25.583401+0000","last_active":"2023-07-06T21:57:27.608211+0000","last_peered":"2023-07-06T21:57:27.608211+0000","last_clean":"2023-07-06T21:57:27.608211+0000","last_became_active":"2023-07-06T21:57:25.583128+0000","last_became_peered":"2023-07-06T21:57:25.583128+0000","last_unstale":"2023-07-06T21:57:27.608211+0000","last_undegraded":"2023-07-06T21:57:27.608211+0000","last_fullsized":"2023-07-06T21:57:27.608211+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:17:30.323177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.310680+0000","last_change":"2023-07-06T21:57:25.570928+0000","last_active":"2023-07-06T21:57:27.310680+0000","last_peered":"2023-07-06T21:57:27.310680+0000","last_clean":"2023-07-06T21:57:27.310680+0000","last_became_active":"2023-07-06T21:57:25.570653+0000","last_became_peered":"2023-07-06T21:57:25.570653+0000","last_unstale":"2023-07-06T21:57:27.310680+0000","last_undegraded":"2023-07-06T21:57:27.310680+0000","last_fullsized":"2023-07-06T21:57:27.310680+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:02:47.803939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561253+0000","last_change":"2023-07-06T21:57:25.561362+0000","last_active":"2023-07-06T21:57:26.561253+0000","last_peered":"2023-07-06T21:57:26.561253+0000","last_clean":"2023-07-06T21:57:26.561253+0000","last_became_active":"2023-07-06T21:57:25.560360+0000","last_became_peered":"2023-07-06T21:57:25.560360+0000","last_unstale":"2023-07-06T21:57:26.561253+0000","last_undegraded":"2023-07-06T21:57:26.561253+0000","last_fullsized":"2023-07-06T21:57:26.561253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:09:33.679620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.310402+0000","last_change":"2023-07-06T21:57:25.568684+0000","last_active":"2023-07-06T21:57:27.310402+0000","last_peered":"2023-07-06T21:57:27.310402+0000","last_clean":"2023-07-06T21:57:27.310402+0000","last_became_active":"2023-07-06T21:57:25.568435+0000","last_became_peered":"2023-07-06T21:57:25.568435+0000","last_unstale":"2023-07-06T21:57:27.310402+0000","last_undegraded":"2023-07-06T21:57:27.310402+0000","last_fullsized":"2023-07-06T21:57:27.310402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:19:38.416578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.607964+0000","last_change":"2023-07-06T21:57:25.582886+0000","last_active":"2023-07-06T21:57:27.607964+0000","last_peered":"2023-07-06T21:57:27.607964+0000","last_clean":"2023-07-06T21:57:27.607964+0000","last_became_active":"2023-07-06T21:57:25.582594+0000","last_became_peered":"2023-07-06T21:57:25.582594+0000","last_unstale":"2023-07-06T21:57:27.607964+0000","last_undegraded":"2023-07-06T21:57:27.607964+0000","last_fullsized":"2023-07-06T21:57:27.607964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:58:22.051257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.607970+0000","last_change":"2023-07-06T21:57:25.566301+0000","last_active":"2023-07-06T21:57:27.607970+0000","last_peered":"2023-07-06T21:57:27.607970+0000","last_clean":"2023-07-06T21:57:27.607970+0000","last_became_active":"2023-07-06T21:57:25.565969+0000","last_became_peered":"2023-07-06T21:57:25.565969+0000","last_unstale":"2023-07-06T21:57:27.607970+0000","last_undegraded":"2023-07-06T21:57:27.607970+0000","last_fullsized":"2023-07-06T21:57:27.607970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:55:48.751059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.107896+0000","last_change":"2023-07-06T21:57:25.582102+0000","last_active":"2023-07-06T21:57:27.107896+0000","last_peered":"2023-07-06T21:57:27.107896+0000","last_clean":"2023-07-06T21:57:27.107896+0000","last_became_active":"2023-07-06T21:57:25.581412+0000","last_became_peered":"2023-07-06T21:57:25.581412+0000","last_unstale":"2023-07-06T21:57:27.107896+0000","last_undegraded":"2023-07-06T21:57:27.107896+0000","last_fullsized":"2023-07-06T21:57:27.107896+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:33:15.859866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561426+0000","last_change":"2023-07-06T21:57:25.583597+0000","last_active":"2023-07-06T21:57:26.561426+0000","last_peered":"2023-07-06T21:57:26.561426+0000","last_clean":"2023-07-06T21:57:26.561426+0000","last_became_active":"2023-07-06T21:57:25.583271+0000","last_became_peered":"2023-07-06T21:57:25.583271+0000","last_unstale":"2023-07-06T21:57:26.561426+0000","last_undegraded":"2023-07-06T21:57:26.561426+0000","last_fullsized":"2023-07-06T21:57:26.561426+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:08:53.216751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"88'4","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561757+0000","last_change":"2023-07-06T21:57:25.166561+0000","last_active":"2023-07-06T21:57:26.561757+0000","last_peered":"2023-07-06T21:57:26.561757+0000","last_clean":"2023-07-06T21:57:26.561757+0000","last_became_active":"2023-07-06T21:57:25.166283+0000","last_became_peered":"2023-07-06T21:57:25.166283+0000","last_unstale":"2023-07-06T21:57:26.561757+0000","last_undegraded":"2023-07-06T21:57:26.561757+0000","last_fullsized":"2023-07-06T21:57:26.561757+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:38:38.430033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560900+0000","last_change":"2023-07-06T21:57:25.565959+0000","last_active":"2023-07-06T21:57:26.560900+0000","last_peered":"2023-07-06T21:57:26.560900+0000","last_clean":"2023-07-06T21:57:26.560900+0000","last_became_active":"2023-07-06T21:57:25.565701+0000","last_became_peered":"2023-07-06T21:57:25.565701+0000","last_unstale":"2023-07-06T21:57:26.560900+0000","last_undegraded":"2023-07-06T21:57:26.560900+0000","last_fullsized":"2023-07-06T21:57:26.560900+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:53:44.924737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"88'1","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.609295+0000","last_change":"2023-07-06T21:57:25.164629+0000","last_active":"2023-07-06T21:57:27.609295+0000","last_peered":"2023-07-06T21:57:27.609295+0000","last_clean":"2023-07-06T21:57:27.609295+0000","last_became_active":"2023-07-06T21:57:25.164338+0000","last_became_peered":"2023-07-06T21:57:25.164338+0000","last_unstale":"2023-07-06T21:57:27.609295+0000","last_undegraded":"2023-07-06T21:57:27.609295+0000","last_fullsized":"2023-07-06T21:57:27.609295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:45:55.218682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.107956+0000","last_change":"2023-07-06T21:57:25.581627+0000","last_active":"2023-07-06T21:57:27.107956+0000","last_peered":"2023-07-06T21:57:27.107956+0000","last_clean":"2023-07-06T21:57:27.107956+0000","last_became_active":"2023-07-06T21:57:25.580784+0000","last_became_peered":"2023-07-06T21:57:25.580784+0000","last_unstale":"2023-07-06T21:57:27.107956+0000","last_undegraded":"2023-07-06T21:57:27.107956+0000","last_fullsized":"2023-07-06T21:57:27.107956+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:32.993594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"88'2","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561173+0000","last_change":"2023-07-06T21:57:25.167113+0000","last_active":"2023-07-06T21:57:26.561173+0000","last_peered":"2023-07-06T21:57:26.561173+0000","last_clean":"2023-07-06T21:57:26.561173+0000","last_became_active":"2023-07-06T21:57:25.166832+0000","last_became_peered":"2023-07-06T21:57:25.166832+0000","last_unstale":"2023-07-06T21:57:26.561173+0000","last_undegraded":"2023-07-06T21:57:26.561173+0000","last_fullsized":"2023-07-06T21:57:26.561173+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:24:57.838928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561247+0000","last_change":"2023-07-06T21:57:25.566233+0000","last_active":"2023-07-06T21:57:26.561247+0000","last_peered":"2023-07-06T21:57:26.561247+0000","last_clean":"2023-07-06T21:57:26.561247+0000","last_became_active":"2023-07-06T21:57:25.565963+0000","last_became_peered":"2023-07-06T21:57:25.565963+0000","last_unstale":"2023-07-06T21:57:26.561247+0000","last_undegraded":"2023-07-06T21:57:26.561247+0000","last_fullsized":"2023-07-06T21:57:26.561247+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:16:43.975326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"88'2","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.108134+0000","last_change":"2023-07-06T21:57:25.169190+0000","last_active":"2023-07-06T21:57:27.108134+0000","last_peered":"2023-07-06T21:57:27.108134+0000","last_clean":"2023-07-06T21:57:27.108134+0000","last_became_active":"2023-07-06T21:57:25.168396+0000","last_became_peered":"2023-07-06T21:57:25.168396+0000","last_unstale":"2023-07-06T21:57:27.108134+0000","last_undegraded":"2023-07-06T21:57:27.108134+0000","last_fullsized":"2023-07-06T21:57:27.108134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:09:09.734707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608151+0000","last_change":"2023-07-06T21:57:25.571646+0000","last_active":"2023-07-06T21:57:27.608151+0000","last_peered":"2023-07-06T21:57:27.608151+0000","last_clean":"2023-07-06T21:57:27.608151+0000","last_became_active":"2023-07-06T21:57:25.571352+0000","last_became_peered":"2023-07-06T21:57:25.571352+0000","last_unstale":"2023-07-06T21:57:27.608151+0000","last_undegraded":"2023-07-06T21:57:27.608151+0000","last_fullsized":"2023-07-06T21:57:27.608151+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:16:04.760808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"88'1","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.310647+0000","last_change":"2023-07-06T21:57:25.152490+0000","last_active":"2023-07-06T21:57:27.310647+0000","last_peered":"2023-07-06T21:57:27.310647+0000","last_clean":"2023-07-06T21:57:27.310647+0000","last_became_active":"2023-07-06T21:57:25.152176+0000","last_became_peered":"2023-07-06T21:57:25.152176+0000","last_unstale":"2023-07-06T21:57:27.310647+0000","last_undegraded":"2023-07-06T21:57:27.310647+0000","last_fullsized":"2023-07-06T21:57:27.310647+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:28:57.482104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560765+0000","last_change":"2023-07-06T21:57:25.560520+0000","last_active":"2023-07-06T21:57:26.560765+0000","last_peered":"2023-07-06T21:57:26.560765+0000","last_clean":"2023-07-06T21:57:26.560765+0000","last_became_active":"2023-07-06T21:57:25.560244+0000","last_became_peered":"2023-07-06T21:57:25.560244+0000","last_unstale":"2023-07-06T21:57:26.560765+0000","last_undegraded":"2023-07-06T21:57:26.560765+0000","last_fullsized":"2023-07-06T21:57:26.560765+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:17:30.323177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"88'1","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.107755+0000","last_change":"2023-07-06T21:57:25.171195+0000","last_active":"2023-07-06T21:57:27.107755+0000","last_peered":"2023-07-06T21:57:27.107755+0000","last_clean":"2023-07-06T21:57:27.107755+0000","last_became_active":"2023-07-06T21:57:25.170929+0000","last_became_peered":"2023-07-06T21:57:25.170929+0000","last_unstale":"2023-07-06T21:57:27.107755+0000","last_undegraded":"2023-07-06T21:57:27.107755+0000","last_fullsized":"2023-07-06T21:57:27.107755+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:15:06.871463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560280+0000","last_change":"2023-07-06T21:57:25.554504+0000","last_active":"2023-07-06T21:57:26.560280+0000","last_peered":"2023-07-06T21:57:26.560280+0000","last_clean":"2023-07-06T21:57:26.560280+0000","last_became_active":"2023-07-06T21:57:25.554237+0000","last_became_peered":"2023-07-06T21:57:25.554237+0000","last_unstale":"2023-07-06T21:57:26.560280+0000","last_undegraded":"2023-07-06T21:57:26.560280+0000","last_fullsized":"2023-07-06T21:57:26.560280+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:10:51.066114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608716+0000","last_change":"2023-07-06T21:57:25.161570+0000","last_active":"2023-07-06T21:57:27.608716+0000","last_peered":"2023-07-06T21:57:27.608716+0000","last_clean":"2023-07-06T21:57:27.608716+0000","last_became_active":"2023-07-06T21:57:25.161293+0000","last_became_peered":"2023-07-06T21:57:25.161293+0000","last_unstale":"2023-07-06T21:57:27.608716+0000","last_undegraded":"2023-07-06T21:57:27.608716+0000","last_fullsized":"2023-07-06T21:57:27.608716+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:04.518765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.609138+0000","last_change":"2023-07-06T21:57:25.572050+0000","last_active":"2023-07-06T21:57:27.609138+0000","last_peered":"2023-07-06T21:57:27.609138+0000","last_clean":"2023-07-06T21:57:27.609138+0000","last_became_active":"2023-07-06T21:57:25.571802+0000","last_became_peered":"2023-07-06T21:57:25.571802+0000","last_unstale":"2023-07-06T21:57:27.609138+0000","last_undegraded":"2023-07-06T21:57:27.609138+0000","last_fullsized":"2023-07-06T21:57:27.609138+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:16:30.096219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560312+0000","last_change":"2023-07-06T21:57:25.163055+0000","last_active":"2023-07-06T21:57:26.560312+0000","last_peered":"2023-07-06T21:57:26.560312+0000","last_clean":"2023-07-06T21:57:26.560312+0000","last_became_active":"2023-07-06T21:57:25.162787+0000","last_became_peered":"2023-07-06T21:57:25.162787+0000","last_unstale":"2023-07-06T21:57:26.560312+0000","last_undegraded":"2023-07-06T21:57:26.560312+0000","last_fullsized":"2023-07-06T21:57:26.560312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:13:52.055001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608065+0000","last_change":"2023-07-06T21:57:25.568950+0000","last_active":"2023-07-06T21:57:27.608065+0000","last_peered":"2023-07-06T21:57:27.608065+0000","last_clean":"2023-07-06T21:57:27.608065+0000","last_became_active":"2023-07-06T21:57:25.568684+0000","last_became_peered":"2023-07-06T21:57:25.568684+0000","last_unstale":"2023-07-06T21:57:27.608065+0000","last_undegraded":"2023-07-06T21:57:27.608065+0000","last_fullsized":"2023-07-06T21:57:27.608065+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:51:21.759895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561850+0000","last_change":"2023-07-06T21:57:25.165746+0000","last_active":"2023-07-06T21:57:26.561850+0000","last_peered":"2023-07-06T21:57:26.561850+0000","last_clean":"2023-07-06T21:57:26.561850+0000","last_became_active":"2023-07-06T21:57:25.165457+0000","last_became_peered":"2023-07-06T21:57:25.165457+0000","last_unstale":"2023-07-06T21:57:26.561850+0000","last_undegraded":"2023-07-06T21:57:26.561850+0000","last_fullsized":"2023-07-06T21:57:26.561850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:26:41.195056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561254+0000","last_change":"2023-07-06T21:57:25.584301+0000","last_active":"2023-07-06T21:57:26.561254+0000","last_peered":"2023-07-06T21:57:26.561254+0000","last_clean":"2023-07-06T21:57:26.561254+0000","last_became_active":"2023-07-06T21:57:25.583645+0000","last_became_peered":"2023-07-06T21:57:25.583645+0000","last_unstale":"2023-07-06T21:57:26.561254+0000","last_undegraded":"2023-07-06T21:57:26.561254+0000","last_fullsized":"2023-07-06T21:57:26.561254+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:31.289318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.108292+0000","last_change":"2023-07-06T21:57:25.168962+0000","last_active":"2023-07-06T21:57:27.108292+0000","last_peered":"2023-07-06T21:57:27.108292+0000","last_clean":"2023-07-06T21:57:27.108292+0000","last_became_active":"2023-07-06T21:57:25.168666+0000","last_became_peered":"2023-07-06T21:57:25.168666+0000","last_unstale":"2023-07-06T21:57:27.108292+0000","last_undegraded":"2023-07-06T21:57:27.108292+0000","last_fullsized":"2023-07-06T21:57:27.108292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:16:41.569062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.107962+0000","last_change":"2023-07-06T21:57:25.577645+0000","last_active":"2023-07-06T21:57:27.107962+0000","last_peered":"2023-07-06T21:57:27.107962+0000","last_clean":"2023-07-06T21:57:27.107962+0000","last_became_active":"2023-07-06T21:57:25.574256+0000","last_became_peered":"2023-07-06T21:57:25.574256+0000","last_unstale":"2023-07-06T21:57:27.107962+0000","last_undegraded":"2023-07-06T21:57:27.107962+0000","last_fullsized":"2023-07-06T21:57:27.107962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:51:25.532177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"88'3","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.310700+0000","last_change":"2023-07-06T21:57:25.163458+0000","last_active":"2023-07-06T21:57:27.310700+0000","last_peered":"2023-07-06T21:57:27.310700+0000","last_clean":"2023-07-06T21:57:27.310700+0000","last_became_active":"2023-07-06T21:57:25.160882+0000","last_became_peered":"2023-07-06T21:57:25.160882+0000","last_unstale":"2023-07-06T21:57:27.310700+0000","last_undegraded":"2023-07-06T21:57:27.310700+0000","last_fullsized":"2023-07-06T21:57:27.310700+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:51:32.836161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560722+0000","last_change":"2023-07-06T21:57:25.568854+0000","last_active":"2023-07-06T21:57:26.560722+0000","last_peered":"2023-07-06T21:57:26.560722+0000","last_clean":"2023-07-06T21:57:26.560722+0000","last_became_active":"2023-07-06T21:57:25.568547+0000","last_became_peered":"2023-07-06T21:57:25.568547+0000","last_unstale":"2023-07-06T21:57:26.560722+0000","last_undegraded":"2023-07-06T21:57:26.560722+0000","last_fullsized":"2023-07-06T21:57:26.560722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:18:44.521524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"88'6","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.609350+0000","last_change":"2023-07-06T21:57:25.163589+0000","last_active":"2023-07-06T21:57:27.609350+0000","last_peered":"2023-07-06T21:57:27.609350+0000","last_clean":"2023-07-06T21:57:27.609350+0000","last_became_active":"2023-07-06T21:57:25.162651+0000","last_became_peered":"2023-07-06T21:57:25.162651+0000","last_unstale":"2023-07-06T21:57:27.609350+0000","last_undegraded":"2023-07-06T21:57:27.609350+0000","last_fullsized":"2023-07-06T21:57:27.609350+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:51:24.515585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560825+0000","last_change":"2023-07-06T21:57:25.563740+0000","last_active":"2023-07-06T21:57:26.560825+0000","last_peered":"2023-07-06T21:57:26.560825+0000","last_clean":"2023-07-06T21:57:26.560825+0000","last_became_active":"2023-07-06T21:57:25.558339+0000","last_became_peered":"2023-07-06T21:57:25.558339+0000","last_unstale":"2023-07-06T21:57:26.560825+0000","last_undegraded":"2023-07-06T21:57:26.560825+0000","last_fullsized":"2023-07-06T21:57:26.560825+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:28:05.985995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"88'2","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608867+0000","last_change":"2023-07-06T21:57:25.161571+0000","last_active":"2023-07-06T21:57:27.608867+0000","last_peered":"2023-07-06T21:57:27.608867+0000","last_clean":"2023-07-06T21:57:27.608867+0000","last_became_active":"2023-07-06T21:57:25.161344+0000","last_became_peered":"2023-07-06T21:57:25.161344+0000","last_unstale":"2023-07-06T21:57:27.608867+0000","last_undegraded":"2023-07-06T21:57:27.608867+0000","last_fullsized":"2023-07-06T21:57:27.608867+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:33:06.863606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.607850+0000","last_change":"2023-07-06T21:57:25.570069+0000","last_active":"2023-07-06T21:57:27.607850+0000","last_peered":"2023-07-06T21:57:27.607850+0000","last_clean":"2023-07-06T21:57:27.607850+0000","last_became_active":"2023-07-06T21:57:25.569807+0000","last_became_peered":"2023-07-06T21:57:25.569807+0000","last_unstale":"2023-07-06T21:57:27.607850+0000","last_undegraded":"2023-07-06T21:57:27.607850+0000","last_fullsized":"2023-07-06T21:57:27.607850+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:40:53.374192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.107854+0000","last_change":"2023-07-06T21:57:25.169468+0000","last_active":"2023-07-06T21:57:27.107854+0000","last_peered":"2023-07-06T21:57:27.107854+0000","last_clean":"2023-07-06T21:57:27.107854+0000","last_became_active":"2023-07-06T21:57:25.169087+0000","last_became_peered":"2023-07-06T21:57:25.169087+0000","last_unstale":"2023-07-06T21:57:27.107854+0000","last_undegraded":"2023-07-06T21:57:27.107854+0000","last_fullsized":"2023-07-06T21:57:27.107854+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:33:06.863606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608466+0000","last_change":"2023-07-06T21:57:25.584294+0000","last_active":"2023-07-06T21:57:27.608466+0000","last_peered":"2023-07-06T21:57:27.608466+0000","last_clean":"2023-07-06T21:57:27.608466+0000","last_became_active":"2023-07-06T21:57:25.584022+0000","last_became_peered":"2023-07-06T21:57:25.584022+0000","last_unstale":"2023-07-06T21:57:27.608466+0000","last_undegraded":"2023-07-06T21:57:27.608466+0000","last_fullsized":"2023-07-06T21:57:27.608466+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:05:25.711089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608025+0000","last_change":"2023-07-06T21:57:25.163371+0000","last_active":"2023-07-06T21:57:27.608025+0000","last_peered":"2023-07-06T21:57:27.608025+0000","last_clean":"2023-07-06T21:57:27.608025+0000","last_became_active":"2023-07-06T21:57:25.163080+0000","last_became_peered":"2023-07-06T21:57:25.163080+0000","last_unstale":"2023-07-06T21:57:27.608025+0000","last_undegraded":"2023-07-06T21:57:27.608025+0000","last_fullsized":"2023-07-06T21:57:27.608025+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:43:45.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560382+0000","last_change":"2023-07-06T21:57:25.572819+0000","last_active":"2023-07-06T21:57:26.560382+0000","last_peered":"2023-07-06T21:57:26.560382+0000","last_clean":"2023-07-06T21:57:26.560382+0000","last_became_active":"2023-07-06T21:57:25.572573+0000","last_became_peered":"2023-07-06T21:57:25.572573+0000","last_unstale":"2023-07-06T21:57:26.560382+0000","last_undegraded":"2023-07-06T21:57:26.560382+0000","last_fullsized":"2023-07-06T21:57:26.560382+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:25:38.886237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"88'8","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560355+0000","last_change":"2023-07-06T21:57:25.158896+0000","last_active":"2023-07-06T21:57:26.560355+0000","last_peered":"2023-07-06T21:57:26.560355+0000","last_clean":"2023-07-06T21:57:26.560355+0000","last_became_active":"2023-07-06T21:57:25.158574+0000","last_became_peered":"2023-07-06T21:57:25.158574+0000","last_unstale":"2023-07-06T21:57:26.560355+0000","last_undegraded":"2023-07-06T21:57:26.560355+0000","last_fullsized":"2023-07-06T21:57:26.560355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:19:00.111711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.609357+0000","last_change":"2023-07-06T21:57:25.569070+0000","last_active":"2023-07-06T21:57:27.609357+0000","last_peered":"2023-07-06T21:57:27.609357+0000","last_clean":"2023-07-06T21:57:27.609357+0000","last_became_active":"2023-07-06T21:57:25.568813+0000","last_became_peered":"2023-07-06T21:57:25.568813+0000","last_unstale":"2023-07-06T21:57:27.609357+0000","last_undegraded":"2023-07-06T21:57:27.609357+0000","last_fullsized":"2023-07-06T21:57:27.609357+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:56:03.332343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"88'2","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.108210+0000","last_change":"2023-07-06T21:57:25.169721+0000","last_active":"2023-07-06T21:57:27.108210+0000","last_peered":"2023-07-06T21:57:27.108210+0000","last_clean":"2023-07-06T21:57:27.108210+0000","last_became_active":"2023-07-06T21:57:25.169430+0000","last_became_peered":"2023-07-06T21:57:25.169430+0000","last_unstale":"2023-07-06T21:57:27.108210+0000","last_undegraded":"2023-07-06T21:57:27.108210+0000","last_fullsized":"2023-07-06T21:57:27.108210+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:51.943681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608096+0000","last_change":"2023-07-06T21:57:25.570647+0000","last_active":"2023-07-06T21:57:27.608096+0000","last_peered":"2023-07-06T21:57:27.608096+0000","last_clean":"2023-07-06T21:57:27.608096+0000","last_became_active":"2023-07-06T21:57:25.570378+0000","last_became_peered":"2023-07-06T21:57:25.570378+0000","last_unstale":"2023-07-06T21:57:27.608096+0000","last_undegraded":"2023-07-06T21:57:27.608096+0000","last_fullsized":"2023-07-06T21:57:27.608096+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:43:01.537225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608268+0000","last_change":"2023-07-06T21:57:25.163394+0000","last_active":"2023-07-06T21:57:27.608268+0000","last_peered":"2023-07-06T21:57:27.608268+0000","last_clean":"2023-07-06T21:57:27.608268+0000","last_became_active":"2023-07-06T21:57:25.163070+0000","last_became_peered":"2023-07-06T21:57:25.163070+0000","last_unstale":"2023-07-06T21:57:27.608268+0000","last_undegraded":"2023-07-06T21:57:27.608268+0000","last_fullsized":"2023-07-06T21:57:27.608268+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:24:57.838928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560896+0000","last_change":"2023-07-06T21:57:25.583945+0000","last_active":"2023-07-06T21:57:26.560896+0000","last_peered":"2023-07-06T21:57:26.560896+0000","last_clean":"2023-07-06T21:57:26.560896+0000","last_became_active":"2023-07-06T21:57:25.583282+0000","last_became_peered":"2023-07-06T21:57:25.583282+0000","last_unstale":"2023-07-06T21:57:26.560896+0000","last_undegraded":"2023-07-06T21:57:26.560896+0000","last_fullsized":"2023-07-06T21:57:26.560896+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:35:23.139240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560851+0000","last_change":"2023-07-06T21:57:25.161721+0000","last_active":"2023-07-06T21:57:26.560851+0000","last_peered":"2023-07-06T21:57:26.560851+0000","last_clean":"2023-07-06T21:57:26.560851+0000","last_became_active":"2023-07-06T21:57:25.161429+0000","last_became_peered":"2023-07-06T21:57:25.161429+0000","last_unstale":"2023-07-06T21:57:26.560851+0000","last_undegraded":"2023-07-06T21:57:26.560851+0000","last_fullsized":"2023-07-06T21:57:26.560851+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:51:56.424528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561337+0000","last_change":"2023-07-06T21:57:25.568560+0000","last_active":"2023-07-06T21:57:26.561337+0000","last_peered":"2023-07-06T21:57:26.561337+0000","last_clean":"2023-07-06T21:57:26.561337+0000","last_became_active":"2023-07-06T21:57:25.568276+0000","last_became_peered":"2023-07-06T21:57:25.568276+0000","last_unstale":"2023-07-06T21:57:26.561337+0000","last_undegraded":"2023-07-06T21:57:26.561337+0000","last_fullsized":"2023-07-06T21:57:26.561337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:51:39.796709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608860+0000","last_change":"2023-07-06T21:57:25.163012+0000","last_active":"2023-07-06T21:57:27.608860+0000","last_peered":"2023-07-06T21:57:27.608860+0000","last_clean":"2023-07-06T21:57:27.608860+0000","last_became_active":"2023-07-06T21:57:25.162655+0000","last_became_peered":"2023-07-06T21:57:25.162655+0000","last_unstale":"2023-07-06T21:57:27.608860+0000","last_undegraded":"2023-07-06T21:57:27.608860+0000","last_fullsized":"2023-07-06T21:57:27.608860+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:23:41.924279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560631+0000","last_change":"2023-07-06T21:57:25.562752+0000","last_active":"2023-07-06T21:57:26.560631+0000","last_peered":"2023-07-06T21:57:26.560631+0000","last_clean":"2023-07-06T21:57:26.560631+0000","last_became_active":"2023-07-06T21:57:25.562408+0000","last_became_peered":"2023-07-06T21:57:25.562408+0000","last_unstale":"2023-07-06T21:57:26.560631+0000","last_undegraded":"2023-07-06T21:57:26.560631+0000","last_fullsized":"2023-07-06T21:57:26.560631+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:25:01.141967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560751+0000","last_change":"2023-07-06T21:57:25.159834+0000","last_active":"2023-07-06T21:57:26.560751+0000","last_peered":"2023-07-06T21:57:26.560751+0000","last_clean":"2023-07-06T21:57:26.560751+0000","last_became_active":"2023-07-06T21:57:25.159541+0000","last_became_peered":"2023-07-06T21:57:25.159541+0000","last_unstale":"2023-07-06T21:57:26.560751+0000","last_undegraded":"2023-07-06T21:57:26.560751+0000","last_fullsized":"2023-07-06T21:57:26.560751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:13:40.516017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.107779+0000","last_change":"2023-07-06T21:57:25.578620+0000","last_active":"2023-07-06T21:57:27.107779+0000","last_peered":"2023-07-06T21:57:27.107779+0000","last_clean":"2023-07-06T21:57:27.107779+0000","last_became_active":"2023-07-06T21:57:25.578312+0000","last_became_peered":"2023-07-06T21:57:25.578312+0000","last_unstale":"2023-07-06T21:57:27.107779+0000","last_undegraded":"2023-07-06T21:57:27.107779+0000","last_fullsized":"2023-07-06T21:57:27.107779+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:05.535357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608494+0000","last_change":"2023-07-06T21:57:25.162304+0000","last_active":"2023-07-06T21:57:27.608494+0000","last_peered":"2023-07-06T21:57:27.608494+0000","last_clean":"2023-07-06T21:57:27.608494+0000","last_became_active":"2023-07-06T21:57:25.162005+0000","last_became_peered":"2023-07-06T21:57:25.162005+0000","last_unstale":"2023-07-06T21:57:27.608494+0000","last_undegraded":"2023-07-06T21:57:27.608494+0000","last_fullsized":"2023-07-06T21:57:27.608494+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:15:06.871463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608348+0000","last_change":"2023-07-06T21:57:25.572378+0000","last_active":"2023-07-06T21:57:27.608348+0000","last_peered":"2023-07-06T21:57:27.608348+0000","last_clean":"2023-07-06T21:57:27.608348+0000","last_became_active":"2023-07-06T21:57:25.572111+0000","last_became_peered":"2023-07-06T21:57:25.572111+0000","last_unstale":"2023-07-06T21:57:27.608348+0000","last_undegraded":"2023-07-06T21:57:27.608348+0000","last_fullsized":"2023-07-06T21:57:27.608348+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:12:13.076338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560456+0000","last_change":"2023-07-06T21:57:25.158846+0000","last_active":"2023-07-06T21:57:26.560456+0000","last_peered":"2023-07-06T21:57:26.560456+0000","last_clean":"2023-07-06T21:57:26.560456+0000","last_became_active":"2023-07-06T21:57:25.158522+0000","last_became_peered":"2023-07-06T21:57:25.158522+0000","last_unstale":"2023-07-06T21:57:26.560456+0000","last_undegraded":"2023-07-06T21:57:26.560456+0000","last_fullsized":"2023-07-06T21:57:26.560456+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:43:00.520634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.107498+0000","last_change":"2023-07-06T21:57:25.581173+0000","last_active":"2023-07-06T21:57:27.107498+0000","last_peered":"2023-07-06T21:57:27.107498+0000","last_clean":"2023-07-06T21:57:27.107498+0000","last_became_active":"2023-07-06T21:57:25.580761+0000","last_became_peered":"2023-07-06T21:57:25.580761+0000","last_unstale":"2023-07-06T21:57:27.107498+0000","last_undegraded":"2023-07-06T21:57:27.107498+0000","last_fullsized":"2023-07-06T21:57:27.107498+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:20:18.308095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.107937+0000","last_change":"2023-07-06T21:57:25.168992+0000","last_active":"2023-07-06T21:57:27.107937+0000","last_peered":"2023-07-06T21:57:27.107937+0000","last_clean":"2023-07-06T21:57:27.107937+0000","last_became_active":"2023-07-06T21:57:25.168695+0000","last_became_peered":"2023-07-06T21:57:25.168695+0000","last_unstale":"2023-07-06T21:57:27.107937+0000","last_undegraded":"2023-07-06T21:57:27.107937+0000","last_fullsized":"2023-07-06T21:57:27.107937+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:40.174331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.310535+0000","last_change":"2023-07-06T21:57:25.575003+0000","last_active":"2023-07-06T21:57:27.310535+0000","last_peered":"2023-07-06T21:57:27.310535+0000","last_clean":"2023-07-06T21:57:27.310535+0000","last_became_active":"2023-07-06T21:57:25.574733+0000","last_became_peered":"2023-07-06T21:57:25.574733+0000","last_unstale":"2023-07-06T21:57:27.310535+0000","last_undegraded":"2023-07-06T21:57:27.310535+0000","last_fullsized":"2023-07-06T21:57:27.310535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:20.912072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"88'2","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.107753+0000","last_change":"2023-07-06T21:57:25.168660+0000","last_active":"2023-07-06T21:57:27.107753+0000","last_peered":"2023-07-06T21:57:27.107753+0000","last_clean":"2023-07-06T21:57:27.107753+0000","last_became_active":"2023-07-06T21:57:25.168343+0000","last_became_peered":"2023-07-06T21:57:25.168343+0000","last_unstale":"2023-07-06T21:57:27.107753+0000","last_undegraded":"2023-07-06T21:57:27.107753+0000","last_fullsized":"2023-07-06T21:57:27.107753+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:49.600164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"77'161","reported_seq":464,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560606+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:57:26.560606+0000","last_peered":"2023-07-06T21:57:26.560606+0000","last_clean":"2023-07-06T21:57:26.560606+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:57:26.560606+0000","last_undegraded":"2023-07-06T21:57:26.560606+0000","last_fullsized":"2023-07-06T21:57:26.560606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:48:22.789845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608047+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:57:27.608047+0000","last_peered":"2023-07-06T21:57:27.608047+0000","last_clean":"2023-07-06T21:57:27.608047+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:57:27.608047+0000","last_undegraded":"2023-07-06T21:57:27.608047+0000","last_fullsized":"2023-07-06T21:57:27.608047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:03:40.393761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.310449+0000","last_change":"2023-07-06T21:57:25.583287+0000","last_active":"2023-07-06T21:57:27.310449+0000","last_peered":"2023-07-06T21:57:27.310449+0000","last_clean":"2023-07-06T21:57:27.310449+0000","last_became_active":"2023-07-06T21:57:25.583020+0000","last_became_peered":"2023-07-06T21:57:25.583020+0000","last_unstale":"2023-07-06T21:57:27.310449+0000","last_undegraded":"2023-07-06T21:57:27.310449+0000","last_fullsized":"2023-07-06T21:57:27.310449+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:10:21.329651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608376+0000","last_change":"2023-07-06T21:57:25.165478+0000","last_active":"2023-07-06T21:57:27.608376+0000","last_peered":"2023-07-06T21:57:27.608376+0000","last_clean":"2023-07-06T21:57:27.608376+0000","last_became_active":"2023-07-06T21:57:25.165177+0000","last_became_peered":"2023-07-06T21:57:25.165177+0000","last_unstale":"2023-07-06T21:57:27.608376+0000","last_undegraded":"2023-07-06T21:57:27.608376+0000","last_fullsized":"2023-07-06T21:57:27.608376+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:44:46.529608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560449+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:57:26.560449+0000","last_peered":"2023-07-06T21:57:26.560449+0000","last_clean":"2023-07-06T21:57:26.560449+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:57:26.560449+0000","last_undegraded":"2023-07-06T21:57:26.560449+0000","last_fullsized":"2023-07-06T21:57:26.560449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:40:42.597802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.310557+0000","last_change":"2023-07-06T21:57:25.584680+0000","last_active":"2023-07-06T21:57:27.310557+0000","last_peered":"2023-07-06T21:57:27.310557+0000","last_clean":"2023-07-06T21:57:27.310557+0000","last_became_active":"2023-07-06T21:57:25.584401+0000","last_became_peered":"2023-07-06T21:57:25.584401+0000","last_unstale":"2023-07-06T21:57:27.310557+0000","last_undegraded":"2023-07-06T21:57:27.310557+0000","last_fullsized":"2023-07-06T21:57:27.310557+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:29:27.775807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608203+0000","last_change":"2023-07-06T21:57:25.161950+0000","last_active":"2023-07-06T21:57:27.608203+0000","last_peered":"2023-07-06T21:57:27.608203+0000","last_clean":"2023-07-06T21:57:27.608203+0000","last_became_active":"2023-07-06T21:57:25.161673+0000","last_became_peered":"2023-07-06T21:57:25.161673+0000","last_unstale":"2023-07-06T21:57:27.608203+0000","last_undegraded":"2023-07-06T21:57:27.608203+0000","last_fullsized":"2023-07-06T21:57:27.608203+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:15:21.894269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560501+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:57:26.560501+0000","last_peered":"2023-07-06T21:57:26.560501+0000","last_clean":"2023-07-06T21:57:26.560501+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:57:26.560501+0000","last_undegraded":"2023-07-06T21:57:26.560501+0000","last_fullsized":"2023-07-06T21:57:26.560501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:40:40.227264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.310447+0000","last_change":"2023-07-06T21:57:25.569310+0000","last_active":"2023-07-06T21:57:27.310447+0000","last_peered":"2023-07-06T21:57:27.310447+0000","last_clean":"2023-07-06T21:57:27.310447+0000","last_became_active":"2023-07-06T21:57:25.569053+0000","last_became_peered":"2023-07-06T21:57:25.569053+0000","last_unstale":"2023-07-06T21:57:27.310447+0000","last_undegraded":"2023-07-06T21:57:27.310447+0000","last_fullsized":"2023-07-06T21:57:27.310447+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:28:09.262900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.108007+0000","last_change":"2023-07-06T21:57:25.168507+0000","last_active":"2023-07-06T21:57:27.108007+0000","last_peered":"2023-07-06T21:57:27.108007+0000","last_clean":"2023-07-06T21:57:27.108007+0000","last_became_active":"2023-07-06T21:57:25.167821+0000","last_became_peered":"2023-07-06T21:57:25.167821+0000","last_unstale":"2023-07-06T21:57:27.108007+0000","last_undegraded":"2023-07-06T21:57:27.108007+0000","last_fullsized":"2023-07-06T21:57:27.108007+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:00:53.842961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.608175+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:57:27.608175+0000","last_peered":"2023-07-06T21:57:27.608175+0000","last_clean":"2023-07-06T21:57:27.608175+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:57:27.608175+0000","last_undegraded":"2023-07-06T21:57:27.608175+0000","last_fullsized":"2023-07-06T21:57:27.608175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:19:33.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.560884+0000","last_change":"2023-07-06T21:57:25.561929+0000","last_active":"2023-07-06T21:57:26.560884+0000","last_peered":"2023-07-06T21:57:26.560884+0000","last_clean":"2023-07-06T21:57:26.560884+0000","last_became_active":"2023-07-06T21:57:25.561417+0000","last_became_peered":"2023-07-06T21:57:25.561417+0000","last_unstale":"2023-07-06T21:57:26.560884+0000","last_undegraded":"2023-07-06T21:57:26.560884+0000","last_fullsized":"2023-07-06T21:57:26.560884+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:14:06.354475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561068+0000","last_change":"2023-07-06T21:57:25.159210+0000","last_active":"2023-07-06T21:57:26.561068+0000","last_peered":"2023-07-06T21:57:26.561068+0000","last_clean":"2023-07-06T21:57:26.561068+0000","last_became_active":"2023-07-06T21:57:25.158890+0000","last_became_peered":"2023-07-06T21:57:25.158890+0000","last_unstale":"2023-07-06T21:57:26.561068+0000","last_undegraded":"2023-07-06T21:57:26.561068+0000","last_fullsized":"2023-07-06T21:57:26.561068+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:33:13.690364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.609430+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:57:27.609430+0000","last_peered":"2023-07-06T21:57:27.609430+0000","last_clean":"2023-07-06T21:57:27.609430+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:57:27.609430+0000","last_undegraded":"2023-07-06T21:57:27.609430+0000","last_fullsized":"2023-07-06T21:57:27.609430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:29:42.179292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.609219+0000","last_change":"2023-07-06T21:57:25.577930+0000","last_active":"2023-07-06T21:57:27.609219+0000","last_peered":"2023-07-06T21:57:27.609219+0000","last_clean":"2023-07-06T21:57:27.609219+0000","last_became_active":"2023-07-06T21:57:25.576428+0000","last_became_peered":"2023-07-06T21:57:25.576428+0000","last_unstale":"2023-07-06T21:57:27.609219+0000","last_undegraded":"2023-07-06T21:57:27.609219+0000","last_fullsized":"2023-07-06T21:57:27.609219+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:32.993594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"88'1","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.108333+0000","last_change":"2023-07-06T21:57:25.165700+0000","last_active":"2023-07-06T21:57:27.108333+0000","last_peered":"2023-07-06T21:57:27.108333+0000","last_clean":"2023-07-06T21:57:27.108333+0000","last_became_active":"2023-07-06T21:57:25.165389+0000","last_became_peered":"2023-07-06T21:57:25.165389+0000","last_unstale":"2023-07-06T21:57:27.108333+0000","last_undegraded":"2023-07-06T21:57:27.108333+0000","last_fullsized":"2023-07-06T21:57:27.108333+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:55:40.955925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561426+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:57:26.561426+0000","last_peered":"2023-07-06T21:57:26.561426+0000","last_clean":"2023-07-06T21:57:26.561426+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:57:26.561426+0000","last_undegraded":"2023-07-06T21:57:26.561426+0000","last_fullsized":"2023-07-06T21:57:26.561426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:41:04.986886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561611+0000","last_change":"2023-07-06T21:57:25.570357+0000","last_active":"2023-07-06T21:57:26.561611+0000","last_peered":"2023-07-06T21:57:26.561611+0000","last_clean":"2023-07-06T21:57:26.561611+0000","last_became_active":"2023-07-06T21:57:25.569710+0000","last_became_peered":"2023-07-06T21:57:25.569710+0000","last_unstale":"2023-07-06T21:57:26.561611+0000","last_undegraded":"2023-07-06T21:57:26.561611+0000","last_fullsized":"2023-07-06T21:57:26.561611+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:24:31.170497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"88'2","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561642+0000","last_change":"2023-07-06T21:57:25.166497+0000","last_active":"2023-07-06T21:57:26.561642+0000","last_peered":"2023-07-06T21:57:26.561642+0000","last_clean":"2023-07-06T21:57:26.561642+0000","last_became_active":"2023-07-06T21:57:25.166235+0000","last_became_peered":"2023-07-06T21:57:25.166235+0000","last_unstale":"2023-07-06T21:57:26.561642+0000","last_undegraded":"2023-07-06T21:57:26.561642+0000","last_fullsized":"2023-07-06T21:57:26.561642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:27:20.540648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.609446+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:57:27.609446+0000","last_peered":"2023-07-06T21:57:27.609446+0000","last_clean":"2023-07-06T21:57:27.609446+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:57:27.609446+0000","last_undegraded":"2023-07-06T21:57:27.609446+0000","last_fullsized":"2023-07-06T21:57:27.609446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:45:34.125011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:26.561620+0000","last_change":"2023-07-06T21:57:25.567373+0000","last_active":"2023-07-06T21:57:26.561620+0000","last_peered":"2023-07-06T21:57:26.561620+0000","last_clean":"2023-07-06T21:57:26.561620+0000","last_became_active":"2023-07-06T21:57:25.566946+0000","last_became_peered":"2023-07-06T21:57:25.566946+0000","last_unstale":"2023-07-06T21:57:26.561620+0000","last_undegraded":"2023-07-06T21:57:26.561620+0000","last_fullsized":"2023-07-06T21:57:26.561620+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:25.122155+0000","last_clean_scrub_stamp":"2023-07-06T21:57:25.122155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:21:58.555248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"88'1","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.108328+0000","last_change":"2023-07-06T21:57:25.167198+0000","last_active":"2023-07-06T21:57:27.108328+0000","last_peered":"2023-07-06T21:57:27.108328+0000","last_clean":"2023-07-06T21:57:27.108328+0000","last_became_active":"2023-07-06T21:57:25.166929+0000","last_became_peered":"2023-07-06T21:57:25.166929+0000","last_unstale":"2023-07-06T21:57:27.108328+0000","last_undegraded":"2023-07-06T21:57:27.108328+0000","last_fullsized":"2023-07-06T21:57:27.108328+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:24.105563+0000","last_clean_scrub_stamp":"2023-07-06T21:57:24.105563+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:40:54.502989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":138,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-07-06T21:57:27.108306+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:57:27.108306+0000","last_peered":"2023-07-06T21:57:27.108306+0000","last_clean":"2023-07-06T21:57:27.108306+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:57:27.108306+0000","last_undegraded":"2023-07-06T21:57:27.108306+0000","last_fullsized":"2023-07-06T21:57:27.108306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:10:41.282146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36788,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335052,"statfs":{"total":96636764160,"available":96599093248,"internally_reserved":0,"allocated":1683456,"data_stored":1157612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.68899999999999995},"min":{"1min":0.45200000000000001,"5min":0.35199999999999998,"15min":0.30599999999999999},"max":{"1min":0.92500000000000004,"5min":0.93999999999999995,"15min":0.97699999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.70299999999999996,"15min":0.69699999999999995},"min":{"1min":0.498,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":0.95899999999999996,"5min":0.98799999999999999,"15min":0.99399999999999999},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jul 6 21:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.59699999999999998,"5min":0.39800000000000002,"15min":0.34799999999999998},"max":{"1min":0.97699999999999998,"5min":1.0449999999999999,"15min":1.0649999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.70599999999999996,"15min":0.71299999999999997},"min":{"1min":0.626,"5min":0.434,"15min":0.434},"max":{"1min":0.90400000000000003,"5min":0.94099999999999995,"15min":0.97899999999999998},"last":0.751}]},{"osd":2,"last update":"Thu Jul 6 21:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.57199999999999995,"5min":0.377,"15min":0.377},"max":{"1min":0.92000000000000004,"5min":0.94799999999999995,"15min":0.94999999999999996},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.64100000000000001,"5min":0.436,"15min":0.42599999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0529999999999999},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jul 6 21:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70399999999999996,"15min":0.71599999999999997},"min":{"1min":0.60899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89600000000000002,"5min":0.91800000000000004,"15min":1.0469999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73099999999999998,"15min":0.73799999999999999},"min":{"1min":0.61299999999999999,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":0.89700000000000002,"5min":0.96599999999999997,"15min":1.006},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.38500000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55600000000000005,"15min":0.57799999999999996},"min":{"1min":0.46600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.96299999999999997},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jul 6 21:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.42299999999999999,"5min":0.376,"15min":0.34999999999999998},"max":{"1min":0.76600000000000001,"5min":0.89500000000000002,"15min":0.98499999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":0.77500000000000002,"5min":0.874,"15min":0.99199999999999999},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:56:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.47399999999999998,"5min":0.44,"15min":0.40200000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0309999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.48299999999999998,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.79600000000000004,"5min":0.98399999999999999,"15min":1.0940000000000001},"last":0.73499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1085440,"data_stored":565701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70799999999999996,"15min":0.70499999999999996},"min":{"1min":0.502,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94699999999999995,"5min":0.97899999999999998,"15min":1.0980000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.38300000000000001},"max":{"1min":1.1830000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.71299999999999997},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.73899999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.41599999999999998},"max":{"1min":0.874,"5min":1.0129999999999999,"15min":1.3859999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.749,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":1.135,"5min":1.159,"15min":1.204},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.498},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":1.4339999999999999},"last":0.874}]},{"osd":4,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82699999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0509999999999999,"15min":1.321},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.63100000000000001},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.36299999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.0089999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68700000000000006,"15min":0.71099999999999997},"min":{"1min":0.55200000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":1.3089999999999999,"15min":1.631},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.41699999999999998},"max":{"1min":1.0029999999999999,"5min":1.2549999999999999,"15min":1.3600000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.66500000000000004},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.6930000000000001},"last":0.80500000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575035,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36204,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335636,"statfs":{"total":96636764160,"available":96599691264,"internally_reserved":0,"allocated":1085440,"data_stored":566718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.92300000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69999999999999996,"15min":0.72099999999999997},"min":{"1min":0.51600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.55400000000000005,"5min":0.40200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89700000000000002,"5min":1.0269999999999999,"15min":1.131},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":1.0329999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.56000000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0369999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.58099999999999996,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98899999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.77600000000000002,"5min":0.78900000000000003,"15min":1},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.91800000000000004,"15min":1.02},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":1.052},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.45400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81899999999999995,"5min":0.83599999999999997,"15min":0.96699999999999997},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63400000000000001,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85799999999999998,"5min":0.92200000000000004,"15min":1.0529999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65300000000000002,"15min":0.68100000000000005},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95299999999999996,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.84099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575034,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1085440,"data_stored":566698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.46500000000000002,"15min":0.39400000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88,"5min":1.123,"15min":1.123},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.44},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.361},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2829999999999999},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":0.84799999999999998,"5min":0.95299999999999996,"15min":1.2170000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.751},"min":{"1min":0.498,"5min":0.498,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":0.94299999999999995,"15min":1.649},"last":0.89400000000000002}]},{"osd":3,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.4219999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.49099999999999999},"max":{"1min":0.91400000000000003,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.308},"max":{"1min":0.85999999999999999,"5min":0.86399999999999999,"15min":1.246},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.96099999999999997,"5min":0.97299999999999998,"15min":1.8049999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.36299999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.478},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":0.94999999999999996,"5min":0.99199999999999999,"15min":1.7250000000000001},"last":0.92200000000000004}]},{"osd":7,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42399999999999999},"max":{"1min":1.0149999999999999,"5min":1.0720000000000001,"15min":1.534},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.47099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96399999999999997,"5min":1.01,"15min":1.585},"last":0.71699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":1089536,"data_stored":566740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45500000000000002,"15min":0.45100000000000001},"min":{"1min":0.35599999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.63500000000000001,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.33400000000000002},"max":{"1min":0.70099999999999996,"5min":2.77,"15min":2.77},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.24299999999999999},"max":{"1min":0.88800000000000001,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.44500000000000001,"5min":0.41399999999999998,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":1.351,"15min":1.9590000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jul 6 21:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":0.79900000000000004,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79900000000000004,"5min":1.24,"15min":2.012},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jul 6 21:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.60099999999999998,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.855},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.78800000000000003,"15min":0.78400000000000003},"min":{"1min":0.63,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.383,"5min":1.383,"15min":1.524},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.82199999999999995,"15min":0.80300000000000005},"min":{"1min":0.64100000000000001,"5min":0.53100000000000003,"15min":0.42399999999999999},"max":{"1min":1.2709999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.79800000000000004,"15min":0.79400000000000004},"min":{"1min":0.57499999999999996,"5min":0.49399999999999999,"15min":0.44800000000000001},"max":{"1min":1.327,"5min":1.3999999999999999,"15min":1.883},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80800000000000005,"15min":0.79500000000000004},"min":{"1min":0.63700000000000001,"5min":0.46600000000000003,"15min":0.40000000000000002},"max":{"1min":1.3140000000000001,"5min":1.425,"15min":1.425},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.83599999999999997,"15min":0.80700000000000005},"min":{"1min":0.65300000000000002,"5min":0.56399999999999995,"15min":0.47899999999999998},"max":{"1min":1.419,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.99199999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82699999999999996,"15min":0.81299999999999994},"min":{"1min":0.58499999999999996,"5min":0.5,"15min":0.497},"max":{"1min":1.2150000000000001,"5min":3.097,"15min":3.097},"last":1.004},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.61899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1140000000000001,"5min":1.3480000000000001,"15min":1.9830000000000001},"last":1.03}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36212,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335628,"statfs":{"total":96636764160,"available":96599683072,"internally_reserved":0,"allocated":1093632,"data_stored":568192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.32100000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.79200000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.49099999999999999},"min":{"1min":0.32400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.68500000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52000000000000002,"15min":0.50900000000000001},"min":{"1min":0.38600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68400000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.44400000000000001,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51900000000000002,"15min":0.503},"min":{"1min":0.39200000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71999999999999997,"5min":0.72399999999999998,"15min":0.76500000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.57399999999999995},"min":{"1min":0.46100000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74399999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.443}]},{"osd":4,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.78400000000000003,"15min":0.78700000000000003},"min":{"1min":0.60599999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.80700000000000005,"15min":0.79100000000000004},"min":{"1min":0.67500000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.61399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.58299999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.81299999999999994,"15min":0.80500000000000005},"min":{"1min":0.59399999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.61099999999999999,"5min":0.497,"15min":0.497},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.82399999999999995,"15min":0.82199999999999995},"min":{"1min":0.57399999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.629},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83599999999999997,"15min":0.83499999999999996},"min":{"1min":0.63800000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.369},"last":0.72899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54268,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317572,"statfs":{"total":96636764160,"available":96581193728,"internally_reserved":0,"allocated":1101824,"data_stored":568808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45100000000000001,"15min":0.441},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.27500000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.499,"15min":0.503},"min":{"1min":0.34799999999999998,"5min":0.32200000000000001,"15min":0.29399999999999998},"max":{"1min":0.69899999999999995,"5min":0.78900000000000003,"15min":0.92200000000000004},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.377,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.41499999999999998,"5min":0.34399999999999997,"15min":0.33300000000000002},"max":{"1min":0.79800000000000004,"5min":0.87,"15min":0.87},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.47499999999999998,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.73499999999999999,"5min":0.80600000000000005,"15min":0.96299999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.32000000000000001},"max":{"1min":0.70099999999999996,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.77000000000000002},"min":{"1min":0.55300000000000005,"5min":0.49199999999999999,"15min":0.38500000000000001},"max":{"1min":0.98699999999999999,"5min":1.143,"15min":1.3140000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.79100000000000004,"15min":0.78200000000000003},"min":{"1min":0.628,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":1.022,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.77800000000000002},"min":{"1min":0.59399999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0329999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.497},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.79100000000000004},"min":{"1min":0.52100000000000002,"5min":0.498,"15min":0.439},"max":{"1min":1.044,"5min":1.357,"15min":1.357},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79100000000000004,"15min":0.79300000000000004},"min":{"1min":0.58099999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.091,"5min":1.278,"15min":1.278},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80700000000000005,"15min":0.80000000000000004},"min":{"1min":0.55300000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0820000000000001,"5min":1.456,"15min":1.456},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.628,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0549999999999999,"5min":1.417,"15min":1.417},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81599999999999995,"15min":0.81999999999999995},"min":{"1min":0.63800000000000001,"5min":0.5,"15min":0.5},"max":{"1min":0.98199999999999998,"5min":1.397,"15min":1.397},"last":0.628}]}]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1671168,"data_stored":1155977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.434,"15min":0.441},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.72399999999999998,"5min":0.86399999999999999,"15min":1.1459999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.623,"5min":0.98099999999999998,"15min":1.5189999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.41599999999999998,"5min":0.317,"15min":0.30099999999999999},"max":{"1min":0.63700000000000001,"5min":0.81699999999999995,"15min":1.228},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.45600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68899999999999995,"5min":1.2050000000000001,"15min":1.454},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.308},"max":{"1min":0.76000000000000001,"5min":1.151,"15min":1.7969999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.47899999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72699999999999998,"5min":0.874,"15min":1.7190000000000001},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77700000000000002,"15min":0.78900000000000003},"min":{"1min":0.60799999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.101,"5min":1.1319999999999999,"15min":1.911},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77900000000000003,"15min":0.78500000000000003},"min":{"1min":0.623,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":0.999,"5min":1.139,"15min":1.3620000000000001},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.38400000000000001},"max":{"1min":1.123,"5min":1.1539999999999999,"15min":1.3700000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.64400000000000002,"5min":0.50700000000000001,"15min":0.44400000000000001},"max":{"1min":0.94499999999999995,"5min":1.163,"15min":1.758},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.80100000000000005,"15min":0.81100000000000005},"min":{"1min":0.67600000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.081,"5min":1.1020000000000001,"15min":1.8220000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.57899999999999996,"5min":0.53200000000000003,"15min":0.47199999999999998},"max":{"1min":1.0069999999999999,"5min":1.093,"15min":2.266},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jul 6 21:56:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.82099999999999995},"min":{"1min":0.68300000000000005,"5min":0.55900000000000005,"15min":0.53800000000000003},"max":{"1min":0.98399999999999999,"5min":1.1719999999999999,"15min":2.323},"last":0.753},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81699999999999995,"15min":0.81299999999999994},"min":{"1min":0.64700000000000002,"5min":0.50900000000000001,"15min":0.435},"max":{"1min":1.04,"5min":1.1910000000000001,"15min":1.2829999999999999},"last":0.77900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:57:30.072 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T21:57:30.073 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-06T21:57:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa374a34640 1 Processor -- start 2023-07-06T21:57:30.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa374a34640 1 -- start start 2023-07-06T21:57:30.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa374a34640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa37015fd80 0x7fa3701669a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:30.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa374a34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37006bb00 con 0x7fa37015bd60 2023-07-06T21:57:30.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa374a34640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3700c9510 con 0x7fa37015b990 2023-07-06T21:57:30.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa374a34640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3700c8f50 con 0x7fa37015fd80 2023-07-06T21:57:30.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36dd9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa37015bd60 0x7fa37015f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56880/0 (socket says 172.21.15.55:56880) 2023-07-06T21:57:30.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36dd9b640 1 -- 172.21.15.55:0/3451169633 learned_addr learned my addr 172.21.15.55:0/3451169633 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:30.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 -- 172.21.15.55:0/3451169633 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693076944 0 0) 0x7fa37006bb00 con 0x7fa37015bd60 2023-07-06T21:57:30.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36ed9d640 1 --2- 172.21.15.55:0/3451169633 >> v2:172.21.15.138:3300/0 conn(0x7fa37015fd80 0x7fa3701669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 -- 172.21.15.55:0/3451169633 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa358003530 con 0x7fa37015bd60 2023-07-06T21:57:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 -- 172.21.15.55:0/3451169633 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4178529592 0 0) 0x7fa358003530 con 0x7fa37015bd60 2023-07-06T21:57:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 -- 172.21.15.55:0/3451169633 >> v2:172.21.15.138:3300/0 conn(0x7fa37015fd80 msgr2=0x7fa3701669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 --2- 172.21.15.55:0/3451169633 >> v2:172.21.15.138:3300/0 conn(0x7fa37015fd80 0x7fa3701669a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 -- 172.21.15.55:0/3451169633 >> v1:172.21.15.138:6789/0 conn(0x7fa37015b990 legacy=0x7fa37006dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 -- 172.21.15.55:0/3451169633 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3700c9230 con 0x7fa37015bd60 2023-07-06T21:57:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 -- 172.21.15.55:0/3451169633 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fa364001680 con 0x7fa37015bd60 2023-07-06T21:57:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 -- 172.21.15.55:0/3451169633 >> v1:172.21.15.55:6789/0 conn(0x7fa37015bd60 legacy=0x7fa37015f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 --2- 172.21.15.55:0/3451169633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa358003980 0x7fa358003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:30.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 --2- 172.21.15.55:0/3451169633 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3580047d0 0x7fa358004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:30.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 --2- 172.21.15.55:0/3451169633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3580052a0 0x7fa35800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:30.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 -- 172.21.15.55:0/3451169633 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700c8f50 con 0x7fa3580052a0 2023-07-06T21:57:30.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 -- 172.21.15.55:0/3451169633 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35800c160 con 0x7fa358003980 2023-07-06T21:57:30.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36d59a640 1 -- 172.21.15.55:0/3451169633 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35800c320 con 0x7fa3580047d0 2023-07-06T21:57:30.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36ed9d640 1 --2- 172.21.15.55:0/3451169633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3580052a0 0x7fa35800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36e59c640 1 --2- 172.21.15.55:0/3451169633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa358003980 0x7fa358003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36ed9d640 1 -- 172.21.15.55:0/3451169633 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3580047d0 msgr2=0x7fa358004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36ed9d640 1 --2- 172.21.15.55:0/3451169633 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3580047d0 0x7fa358004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36ed9d640 1 -- 172.21.15.55:0/3451169633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa358003980 msgr2=0x7fa358003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36ed9d640 1 --2- 172.21.15.55:0/3451169633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa358003980 0x7fa358003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36ed9d640 1 -- 172.21.15.55:0/3451169633 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa358003530 con 0x7fa3580052a0 2023-07-06T21:57:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.264+0000 7fa36e59c640 1 --2- 172.21.15.55:0/3451169633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa358003980 0x7fa358003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:30.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.268+0000 7fa36ed9d640 1 -- 172.21.15.55:0/3451169633 reap_dead start 2023-07-06T21:57:30.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.268+0000 7fa36ed9d640 1 --2- 172.21.15.55:0/3451169633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3580052a0 0x7fa35800b990 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa368007360 tx=0x7fa36801ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6863d2ab45aa10 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.268+0000 7fa36d59a640 1 -- 172.21.15.55:0/3451169633 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3680a5d60 con 0x7fa3580052a0 2023-07-06T21:57:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.268+0000 7fa36d59a640 1 -- 172.21.15.55:0/3451169633 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3680039a0 con 0x7fa3580052a0 2023-07-06T21:57:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.268+0000 7fa36d59a640 1 -- 172.21.15.55:0/3451169633 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa368003d50 con 0x7fa3580052a0 2023-07-06T21:57:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.268+0000 7fa374a34640 1 -- 172.21.15.55:0/3451169633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3580052a0 msgr2=0x7fa35800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.268+0000 7fa374a34640 1 --2- 172.21.15.55:0/3451169633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3580052a0 0x7fa35800b990 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa368007360 tx=0x7fa36801ce60 comp rx=0 tx=0).stop 2023-07-06T21:57:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.268+0000 7fa374a34640 1 -- 172.21.15.55:0/3451169633 shutdown_connections 2023-07-06T21:57:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.268+0000 7fa374a34640 1 --2- 172.21.15.55:0/3451169633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3580052a0 0x7fa35800b990 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.268+0000 7fa374a34640 1 -- 172.21.15.55:0/3451169633 >> 172.21.15.55:0/3451169633 conn(0x7fa3700cf3c0 msgr2=0x7fa3700cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:30.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.268+0000 7fa374a34640 1 -- 172.21.15.55:0/3451169633 shutdown_connections 2023-07-06T21:57:30.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.268+0000 7fa374a34640 1 -- 172.21.15.55:0/3451169633 wait complete. 2023-07-06T21:57:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa374a34640 1 Processor -- start 2023-07-06T21:57:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa374a34640 1 -- start start 2023-07-06T21:57:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa374a34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3580052a0 0x7fa370152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa374a34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa37006d790 0x7fa370157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa374a34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa370158180 0x7fa3700b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa374a34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa370153170 con 0x7fa370158180 2023-07-06T21:57:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa374a34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37006c6f0 con 0x7fa3580052a0 2023-07-06T21:57:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa374a34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37006c9d0 con 0x7fa37006d790 2023-07-06T21:57:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa36ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa370158180 0x7fa3700b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa36ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa370158180 0x7fa3700b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46518/0 (socket says 172.21.15.55:46518) 2023-07-06T21:57:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa36ed9d640 1 -- 172.21.15.55:0/1963240440 learned_addr learned my addr 172.21.15.55:0/1963240440 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa36e59c640 1 --2- 172.21.15.55:0/1963240440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3580052a0 0x7fa370152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa36dd9b640 1 --2- 172.21.15.55:0/1963240440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa37006d790 0x7fa370157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:30.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa36ed9d640 1 -- 172.21.15.55:0/1963240440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa37006d790 msgr2=0x7fa370157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa36ed9d640 1 --2- 172.21.15.55:0/1963240440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa37006d790 0x7fa370157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa36ed9d640 1 -- 172.21.15.55:0/1963240440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3580052a0 msgr2=0x7fa370152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa36ed9d640 1 --2- 172.21.15.55:0/1963240440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3580052a0 0x7fa370152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa36ed9d640 1 -- 172.21.15.55:0/1963240440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37006ccb0 con 0x7fa370158180 2023-07-06T21:57:30.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa36ed9d640 1 --2- 172.21.15.55:0/1963240440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa370158180 0x7fa3700b1650 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa36801d700 tx=0x7fa368019c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:30.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa35effd640 1 -- 172.21.15.55:0/1963240440 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3680adb00 con 0x7fa370158180 2023-07-06T21:57:30.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa35effd640 1 -- 172.21.15.55:0/1963240440 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3680adc60 con 0x7fa370158180 2023-07-06T21:57:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa35effd640 1 -- 172.21.15.55:0/1963240440 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3680b5400 con 0x7fa370158180 2023-07-06T21:57:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa374a34640 1 -- 172.21.15.55:0/1963240440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37006cf90 con 0x7fa370158180 2023-07-06T21:57:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.272+0000 7fa374a34640 1 -- 172.21.15.55:0/1963240440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37006dc00 con 0x7fa370158180 2023-07-06T21:57:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.276+0000 7fa374a34640 1 -- 172.21.15.55:0/1963240440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa370066d60 con 0x7fa370158180 2023-07-06T21:57:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.276+0000 7fa35effd640 1 -- 172.21.15.55:0/1963240440 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa3680bd3a0 con 0x7fa370158180 2023-07-06T21:57:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.276+0000 7fa35effd640 1 --2- 172.21.15.55:0/1963240440 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa3500663a0 0x7fa350068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.276+0000 7fa35effd640 1 -- 172.21.15.55:0/1963240440 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa36811e260 con 0x7fa370158180 2023-07-06T21:57:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.276+0000 7fa36e59c640 1 --2- 172.21.15.55:0/1963240440 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa3500663a0 0x7fa350068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.276+0000 7fa36e59c640 1 --2- 172.21.15.55:0/1963240440 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa3500663a0 0x7fa350068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa360000c10 tx=0x7fa360009040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:30.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.280+0000 7fa35effd640 1 -- 172.21.15.55:0/1963240440 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3680eb3f0 con 0x7fa370158180 2023-07-06T21:57:30.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.492+0000 7fa374a34640 1 -- 172.21.15.55:0/1963240440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa37006d440 con 0x7fa370158180 2023-07-06T21:57:30.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.500+0000 7fa35effd640 1 -- 172.21.15.55:0/1963240440 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa3680eea10 con 0x7fa370158180 2023-07-06T21:57:30.498 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-07-06T21:57:30.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.500+0000 7fa374a34640 1 -- 172.21.15.55:0/1963240440 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa3500663a0 msgr2=0x7fa350068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.500+0000 7fa374a34640 1 --2- 172.21.15.55:0/1963240440 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa3500663a0 0x7fa350068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa360000c10 tx=0x7fa360009040 comp rx=0 tx=0).stop 2023-07-06T21:57:30.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.500+0000 7fa374a34640 1 -- 172.21.15.55:0/1963240440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa370158180 msgr2=0x7fa3700b1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.500+0000 7fa374a34640 1 --2- 172.21.15.55:0/1963240440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa370158180 0x7fa3700b1650 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa36801d700 tx=0x7fa368019c00 comp rx=0 tx=0).stop 2023-07-06T21:57:30.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.500+0000 7fa374a34640 1 -- 172.21.15.55:0/1963240440 shutdown_connections 2023-07-06T21:57:30.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.500+0000 7fa374a34640 1 --2- 172.21.15.55:0/1963240440 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fa3500663a0 0x7fa350068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.500+0000 7fa374a34640 1 --2- 172.21.15.55:0/1963240440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa370158180 0x7fa3700b1650 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.500+0000 7fa374a34640 1 --2- 172.21.15.55:0/1963240440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa37006d790 0x7fa370157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.500+0000 7fa374a34640 1 --2- 172.21.15.55:0/1963240440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3580052a0 0x7fa370152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.500+0000 7fa374a34640 1 -- 172.21.15.55:0/1963240440 >> 172.21.15.55:0/1963240440 conn(0x7fa3700cf3c0 msgr2=0x7fa37006a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:30.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.500+0000 7fa374a34640 1 -- 172.21.15.55:0/1963240440 shutdown_connections 2023-07-06T21:57:30.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.504+0000 7fa374a34640 1 -- 172.21.15.55:0/1963240440 wait complete. 2023-07-06T21:57:30.519 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:57:30.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f9465140640 1 Processor -- start 2023-07-06T21:57:30.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f9465140640 1 -- start start 2023-07-06T21:57:30.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f9465140640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600cb4a0 0x7f946015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:30.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f9465140640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94600cbc70 0x7f94600cc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:30.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f9465140640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94600b5b50 con 0x7f946015f740 2023-07-06T21:57:30.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f9465140640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946015d130 con 0x7f94600cbc70 2023-07-06T21:57:30.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f9465140640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94600cc5b0 con 0x7f94600cb4a0 2023-07-06T21:57:30.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f945f59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94600cbc70 0x7f94600cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:30.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f945e59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f946015f740 0x7f94600ca720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56888/0 (socket says 172.21.15.55:56888) 2023-07-06T21:57:30.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f945f59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94600cbc70 0x7f94600cc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46534/0 (socket says 172.21.15.55:46534) 2023-07-06T21:57:30.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f945e59c640 1 -- 172.21.15.55:0/2049085129 learned_addr learned my addr 172.21.15.55:0/2049085129 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:30.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f945ed9d640 1 --2- 172.21.15.55:0/2049085129 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600cb4a0 0x7f946015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:30.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f945f59e640 1 -- 172.21.15.55:0/2049085129 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600cb4a0 msgr2=0x7f946015cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:30.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f945f59e640 1 --2- 172.21.15.55:0/2049085129 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600cb4a0 0x7f946015cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f945f59e640 1 -- 172.21.15.55:0/2049085129 >> v1:172.21.15.55:6789/0 conn(0x7f946015f740 legacy=0x7f94600ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f945f59e640 1 -- 172.21.15.55:0/2049085129 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94600cc8e0 con 0x7f94600cbc70 2023-07-06T21:57:30.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.664+0000 7f945dd9b640 1 -- 172.21.15.55:0/2049085129 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486833578 0 0) 0x7f94600b5b50 con 0x7f946015f740 2023-07-06T21:57:30.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.668+0000 7f945f59e640 1 --2- 172.21.15.55:0/2049085129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600cbc70 0x7f94600cc070 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f9458009d90 tx=0x7f945801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc31ee10736c11b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:30.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.668+0000 7f945dd9b640 1 -- 172.21.15.55:0/2049085129 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580a5900 con 0x7f94600cbc70 2023-07-06T21:57:30.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.668+0000 7f945dd9b640 1 -- 172.21.15.55:0/2049085129 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94580a5a60 con 0x7f94600cbc70 2023-07-06T21:57:30.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.668+0000 7f945dd9b640 1 -- 172.21.15.55:0/2049085129 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580a5df0 con 0x7f94600cbc70 2023-07-06T21:57:30.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.668+0000 7f9465140640 1 -- 172.21.15.55:0/2049085129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600cbc70 msgr2=0x7f94600cc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.668+0000 7f9465140640 1 --2- 172.21.15.55:0/2049085129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600cbc70 0x7f94600cc070 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f9458009d90 tx=0x7f945801c950 comp rx=0 tx=0).stop 2023-07-06T21:57:30.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.668+0000 7f9465140640 1 -- 172.21.15.55:0/2049085129 shutdown_connections 2023-07-06T21:57:30.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.668+0000 7f9465140640 1 --2- 172.21.15.55:0/2049085129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600cbc70 0x7f94600cc070 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.668+0000 7f9465140640 1 --2- 172.21.15.55:0/2049085129 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600cb4a0 0x7f946015cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.668+0000 7f9465140640 1 -- 172.21.15.55:0/2049085129 >> 172.21.15.55:0/2049085129 conn(0x7f946006ee80 msgr2=0x7f946006f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:30.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.668+0000 7f9465140640 1 -- 172.21.15.55:0/2049085129 shutdown_connections 2023-07-06T21:57:30.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.668+0000 7f9465140640 1 -- 172.21.15.55:0/2049085129 wait complete. 2023-07-06T21:57:30.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f9465140640 1 Processor -- start 2023-07-06T21:57:30.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f9465140640 1 -- start start 2023-07-06T21:57:30.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f9465140640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94600cb4a0 0x7f9460157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:30.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f9465140640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600cbc70 0x7f946006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:30.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f9465140640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f946015f740 0x7f94600b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:30.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f9465140640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946006a660 con 0x7f94600cbc70 2023-07-06T21:57:30.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f9465140640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94600c8c00 con 0x7f94600cb4a0 2023-07-06T21:57:30.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f9465140640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94600c9780 con 0x7f946015f740 2023-07-06T21:57:30.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f945e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600cbc70 0x7f946006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:30.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f945e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600cbc70 0x7f946006e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46542/0 (socket says 172.21.15.55:46542) 2023-07-06T21:57:30.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f945e59c640 1 -- 172.21.15.55:0/1747748836 learned_addr learned my addr 172.21.15.55:0/1747748836 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:30.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f945ed9d640 1 --2- 172.21.15.55:0/1747748836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94600cb4a0 0x7f9460157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:30.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f945e59c640 1 -- 172.21.15.55:0/1747748836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f946015f740 msgr2=0x7f94600b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f945e59c640 1 --2- 172.21.15.55:0/1747748836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f946015f740 0x7f94600b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f945e59c640 1 -- 172.21.15.55:0/1747748836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94600cb4a0 msgr2=0x7f9460157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f945e59c640 1 --2- 172.21.15.55:0/1747748836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94600cb4a0 0x7f9460157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f945e59c640 1 -- 172.21.15.55:0/1747748836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9458009a70 con 0x7f94600cbc70 2023-07-06T21:57:30.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f945e59c640 1 --2- 172.21.15.55:0/1747748836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600cbc70 0x7f946006e110 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f945400c480 tx=0x7f945400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:30.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f94477fe640 1 -- 172.21.15.55:0/1747748836 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540074e0 con 0x7f94600cbc70 2023-07-06T21:57:30.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f94477fe640 1 -- 172.21.15.55:0/1747748836 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9454007640 con 0x7f94600cbc70 2023-07-06T21:57:30.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f94477fe640 1 -- 172.21.15.55:0/1747748836 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540049f0 con 0x7f94600cbc70 2023-07-06T21:57:30.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.672+0000 7f9465140640 1 -- 172.21.15.55:0/1747748836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946006e650 con 0x7f94600cbc70 2023-07-06T21:57:30.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.676+0000 7f9465140640 1 -- 172.21.15.55:0/1747748836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94600c9130 con 0x7f94600cbc70 2023-07-06T21:57:30.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.676+0000 7f9465140640 1 -- 172.21.15.55:0/1747748836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9460066d60 con 0x7f94600cbc70 2023-07-06T21:57:30.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.676+0000 7f94477fe640 1 -- 172.21.15.55:0/1747748836 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9454004b50 con 0x7f94600cbc70 2023-07-06T21:57:30.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.676+0000 7f94477fe640 1 --2- 172.21.15.55:0/1747748836 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f944c0663a0 0x7f944c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:30.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.676+0000 7f94477fe640 1 -- 172.21.15.55:0/1747748836 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f94540830d0 con 0x7f94600cbc70 2023-07-06T21:57:30.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.676+0000 7f945ed9d640 1 --2- 172.21.15.55:0/1747748836 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f944c0663a0 0x7f944c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:30.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.680+0000 7f945ed9d640 1 --2- 172.21.15.55:0/1747748836 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f944c0663a0 0x7f944c068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f94600b5370 tx=0x7f9450008040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:30.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.680+0000 7f94477fe640 1 -- 172.21.15.55:0/1747748836 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9454053ed0 con 0x7f94600cbc70 2023-07-06T21:57:30.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.876+0000 7f9465140640 1 -- 172.21.15.55:0/1747748836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94600c98c0 con 0x7f94600cbc70 2023-07-06T21:57:30.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.876+0000 7f94477fe640 1 -- 172.21.15.55:0/1747748836 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f9454018090 con 0x7f94600cbc70 2023-07-06T21:57:30.875 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:30.875 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2651551074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2651551074},{"type":"v1","addr":"172.21.15.138:6835","nonce":2651551074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1024060506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1024060506},{"type":"v1","addr":"172.21.15.138:6834","nonce":1024060506}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6933,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3347534333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3347534333},{"type":"v1","addr":"172.21.15.55:6836","nonce":3347534333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:57:25.541950+0000","modified":"2023-07-06T21:57:28.574413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3154142571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3154142571},{"type":"v1","addr":"172.21.15.55:6837","nonce":3154142571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-06T21:57:30.875 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 32 2023-07-06T21:57:30.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.876+0000 7f9465140640 1 -- 172.21.15.55:0/1747748836 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f944c0663a0 msgr2=0x7f944c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.876+0000 7f9465140640 1 --2- 172.21.15.55:0/1747748836 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f944c0663a0 0x7f944c068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f94600b5370 tx=0x7f9450008040 comp rx=0 tx=0).stop 2023-07-06T21:57:30.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.876+0000 7f9465140640 1 -- 172.21.15.55:0/1747748836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600cbc70 msgr2=0x7f946006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:30.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.876+0000 7f9465140640 1 --2- 172.21.15.55:0/1747748836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600cbc70 0x7f946006e110 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f945400c480 tx=0x7f945400c940 comp rx=0 tx=0).stop 2023-07-06T21:57:30.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.876+0000 7f9465140640 1 -- 172.21.15.55:0/1747748836 shutdown_connections 2023-07-06T21:57:30.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.876+0000 7f9465140640 1 --2- 172.21.15.55:0/1747748836 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f944c0663a0 0x7f944c068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.876+0000 7f9465140640 1 --2- 172.21.15.55:0/1747748836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f946015f740 0x7f94600b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.876+0000 7f9465140640 1 --2- 172.21.15.55:0/1747748836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600cbc70 0x7f946006e110 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.876+0000 7f9465140640 1 --2- 172.21.15.55:0/1747748836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94600cb4a0 0x7f9460157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.876+0000 7f9465140640 1 -- 172.21.15.55:0/1747748836 >> 172.21.15.55:0/1747748836 conn(0x7f946006ee80 msgr2=0x7f946015b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.880+0000 7f9465140640 1 -- 172.21.15.55:0/1747748836 shutdown_connections 2023-07-06T21:57:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:30.880+0000 7f9465140640 1 -- 172.21.15.55:0/1747748836 wait complete. 2023-07-06T21:57:30.904 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-07-06T21:57:30.904+0000 7fb611ff1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T21:57:31.298 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T21:57:25.541950+0000', 'modified': '2023-07-06T21:57:28.574413+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6936}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6936': {'gid': 6936, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6837/3154142571', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 3154142571}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3154142571}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T21:57:31.299 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T21:57:31.299 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-06T21:57:31.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc25dd2640 1 Processor -- start 2023-07-06T21:57:31.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc25dd2640 1 -- start start 2023-07-06T21:57:31.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc25dd2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcc201646a0 0x7fcc20166a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc25dd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc200cc740 con 0x7fcc200b1250 2023-07-06T21:57:31.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc25dd2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc201601a0 con 0x7fcc200d0630 2023-07-06T21:57:31.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc25dd2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc200ccc90 con 0x7fcc201646a0 2023-07-06T21:57:31.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc24dd0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcc200b1250 0x7fcc2015f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56900/0 (socket says 172.21.15.55:56900) 2023-07-06T21:57:31.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc24dd0640 1 -- 172.21.15.55:0/509750174 learned_addr learned my addr 172.21.15.55:0/509750174 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:31.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc255d1640 1 --2- 172.21.15.55:0/509750174 >> v2:172.21.15.138:3300/0 conn(0x7fcc201646a0 0x7fcc20166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 -- 172.21.15.55:0/509750174 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536470546 0 0) 0x7fcc200cc740 con 0x7fcc200b1250 2023-07-06T21:57:31.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 -- 172.21.15.55:0/509750174 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc10003530 con 0x7fcc200b1250 2023-07-06T21:57:31.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 -- 172.21.15.55:0/509750174 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2630681938 0 0) 0x7fcc10003530 con 0x7fcc200b1250 2023-07-06T21:57:31.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 -- 172.21.15.55:0/509750174 >> v2:172.21.15.138:3300/0 conn(0x7fcc201646a0 msgr2=0x7fcc20166a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:31.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 --2- 172.21.15.55:0/509750174 >> v2:172.21.15.138:3300/0 conn(0x7fcc201646a0 0x7fcc20166a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 -- 172.21.15.55:0/509750174 >> v1:172.21.15.138:6789/0 conn(0x7fcc200d0630 legacy=0x7fcc2015fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 -- 172.21.15.55:0/509750174 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc200b29c0 con 0x7fcc200b1250 2023-07-06T21:57:31.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 -- 172.21.15.55:0/509750174 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fcc14001680 con 0x7fcc200b1250 2023-07-06T21:57:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 -- 172.21.15.55:0/509750174 >> v1:172.21.15.55:6789/0 conn(0x7fcc200b1250 legacy=0x7fcc2015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 --2- 172.21.15.55:0/509750174 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc10003980 0x7fcc10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 --2- 172.21.15.55:0/509750174 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcc100047d0 0x7fcc10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 --2- 172.21.15.55:0/509750174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc10005180 0x7fcc1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 -- 172.21.15.55:0/509750174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc200ccc90 con 0x7fcc10005180 2023-07-06T21:57:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 -- 172.21.15.55:0/509750174 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1000c000 con 0x7fcc10003980 2023-07-06T21:57:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1f7fe640 1 -- 172.21.15.55:0/509750174 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1000c1c0 con 0x7fcc100047d0 2023-07-06T21:57:31.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc255d1640 1 --2- 172.21.15.55:0/509750174 >> v2:172.21.15.138:3300/0 conn(0x7fcc201646a0 0x7fcc20166a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc255d1640 1 --2- 172.21.15.55:0/509750174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc10005180 0x7fcc1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc24dd0640 1 --2- 172.21.15.55:0/509750174 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc10003980 0x7fcc10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.448+0000 7fcc1ffff640 1 --2- 172.21.15.55:0/509750174 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcc100047d0 0x7fcc10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc255d1640 1 -- 172.21.15.55:0/509750174 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcc100047d0 msgr2=0x7fcc10004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc255d1640 1 --2- 172.21.15.55:0/509750174 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcc100047d0 0x7fcc10004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc255d1640 1 -- 172.21.15.55:0/509750174 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc10003980 msgr2=0x7fcc10003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc255d1640 1 --2- 172.21.15.55:0/509750174 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc10003980 0x7fcc10003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc255d1640 1 -- 172.21.15.55:0/509750174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc10003530 con 0x7fcc10005180 2023-07-06T21:57:31.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc24dd0640 1 --2- 172.21.15.55:0/509750174 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc10003980 0x7fcc10003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:31.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc255d1640 1 -- 172.21.15.55:0/509750174 reap_dead start 2023-07-06T21:57:31.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc255d1640 1 --2- 172.21.15.55:0/509750174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc10005180 0x7fcc1000b990 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800e320 tx=0x7fcc1801ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfdaf881229b17a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:31.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc1f7fe640 1 -- 172.21.15.55:0/509750174 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc180a5e10 con 0x7fcc10005180 2023-07-06T21:57:31.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc1f7fe640 1 -- 172.21.15.55:0/509750174 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1800f040 con 0x7fcc10005180 2023-07-06T21:57:31.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc1f7fe640 1 -- 172.21.15.55:0/509750174 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18003bc0 con 0x7fcc10005180 2023-07-06T21:57:31.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc25dd2640 1 -- 172.21.15.55:0/509750174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc10005180 msgr2=0x7fcc1000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc25dd2640 1 --2- 172.21.15.55:0/509750174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc10005180 0x7fcc1000b990 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800e320 tx=0x7fcc1801ce00 comp rx=0 tx=0).stop 2023-07-06T21:57:31.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc25dd2640 1 -- 172.21.15.55:0/509750174 shutdown_connections 2023-07-06T21:57:31.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc25dd2640 1 --2- 172.21.15.55:0/509750174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc10005180 0x7fcc1000b990 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.452+0000 7fcc25dd2640 1 -- 172.21.15.55:0/509750174 >> 172.21.15.55:0/509750174 conn(0x7fcc200b3b60 msgr2=0x7fcc200b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:31.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc25dd2640 1 -- 172.21.15.55:0/509750174 shutdown_connections 2023-07-06T21:57:31.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc25dd2640 1 -- 172.21.15.55:0/509750174 wait complete. 2023-07-06T21:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc25dd2640 1 Processor -- start 2023-07-06T21:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc25dd2640 1 -- start start 2023-07-06T21:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc25dd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc10005180 0x7fcc2014f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc25dd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcc20069d90 0x7fcc2006a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc25dd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc200c62b0 0x7fcc200c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc25dd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2006a740 con 0x7fcc10005180 2023-07-06T21:57:31.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc25dd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc200c5b40 con 0x7fcc200c62b0 2023-07-06T21:57:31.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc25dd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2015b1e0 con 0x7fcc20069d90 2023-07-06T21:57:31.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc24dd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc10005180 0x7fcc2014f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc24dd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc10005180 0x7fcc2014f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46562/0 (socket says 172.21.15.55:46562) 2023-07-06T21:57:31.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc24dd0640 1 -- 172.21.15.55:0/4145958390 learned_addr learned my addr 172.21.15.55:0/4145958390 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:31.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc1ffff640 1 --2- 172.21.15.55:0/4145958390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcc20069d90 0x7fcc2006a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc255d1640 1 --2- 172.21.15.55:0/4145958390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc200c62b0 0x7fcc200c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc24dd0640 1 -- 172.21.15.55:0/4145958390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcc20069d90 msgr2=0x7fcc2006a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc24dd0640 1 --2- 172.21.15.55:0/4145958390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcc20069d90 0x7fcc2006a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc24dd0640 1 -- 172.21.15.55:0/4145958390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc200c62b0 msgr2=0x7fcc200c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc24dd0640 1 --2- 172.21.15.55:0/4145958390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc200c62b0 0x7fcc200c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc24dd0640 1 -- 172.21.15.55:0/4145958390 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2015b4c0 con 0x7fcc10005180 2023-07-06T21:57:31.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.456+0000 7fcc24dd0640 1 --2- 172.21.15.55:0/4145958390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc10005180 0x7fcc2014f040 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fcc14001000 tx=0x7fcc1400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:31.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.460+0000 7fcc1d7fa640 1 -- 172.21.15.55:0/4145958390 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400ee00 con 0x7fcc10005180 2023-07-06T21:57:31.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.460+0000 7fcc1d7fa640 1 -- 172.21.15.55:0/4145958390 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1400c8a0 con 0x7fcc10005180 2023-07-06T21:57:31.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.460+0000 7fcc25dd2640 1 -- 172.21.15.55:0/4145958390 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2015b7a0 con 0x7fcc10005180 2023-07-06T21:57:31.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.460+0000 7fcc1d7fa640 1 -- 172.21.15.55:0/4145958390 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400cc10 con 0x7fcc10005180 2023-07-06T21:57:31.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.460+0000 7fcc25dd2640 1 -- 172.21.15.55:0/4145958390 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc201563c0 con 0x7fcc10005180 2023-07-06T21:57:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.460+0000 7fcc1d7fa640 1 -- 172.21.15.55:0/4145958390 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcc14013420 con 0x7fcc10005180 2023-07-06T21:57:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc1d7fa640 1 --2- 172.21.15.55:0/4145958390 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fcc040663d0 0x7fcc04068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc1d7fa640 1 -- 172.21.15.55:0/4145958390 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcc14083900 con 0x7fcc10005180 2023-07-06T21:57:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc1ffff640 1 --2- 172.21.15.55:0/4145958390 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fcc040663d0 0x7fcc04068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 Processor -- start 2023-07-06T21:57:31.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 -- start start 2023-07-06T21:57:31.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc1ffff640 1 --2- 172.21.15.55:0/4145958390 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fcc040663d0 0x7fcc04068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcc2015ca10 tx=0x7fcc0c009040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:31.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c10da740 0x55d6c10dab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 0x55d6c1090840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c1090d80 0x55d6c1091150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c0f58ac0 con 0x55d6c1090d80 2023-07-06T21:57:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c0e92840 con 0x55d6c10db050 2023-07-06T21:57:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6c0ee62e0 con 0x55d6c10da740 2023-07-06T21:57:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc255d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c1090d80 0x55d6c1091150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc255d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c1090d80 0x55d6c1091150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46578/0 (socket says 172.21.15.55:46578) 2023-07-06T21:57:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc255d1640 1 -- 172.21.15.55:0/2620967097 learned_addr learned my addr 172.21.15.55:0/2620967097 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc1ffff640 1 --2- 172.21.15.55:0/2620967097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 0x55d6c1090840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc24dd0640 1 --2- 172.21.15.55:0/2620967097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c10da740 0x55d6c10dab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc255d1640 1 -- 172.21.15.55:0/2620967097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c10da740 msgr2=0x55d6c10dab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc255d1640 1 --2- 172.21.15.55:0/2620967097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c10da740 0x55d6c10dab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc255d1640 1 -- 172.21.15.55:0/2620967097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 msgr2=0x55d6c1090840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc255d1640 1 --2- 172.21.15.55:0/2620967097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 0x55d6c1090840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc255d1640 1 -- 172.21.15.55:0/2620967097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6c0bdb890 con 0x55d6c1090d80 2023-07-06T21:57:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc1ffff640 1 --2- 172.21.15.55:0/2620967097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 0x55d6c1090840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc255d1640 1 --2- 172.21.15.55:0/2620967097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c1090d80 0x55d6c1091150 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fcc1801cc30 tx=0x7fcc1801b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee9e966c20ea524 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc0a7fc640 1 -- 172.21.15.55:0/2620967097 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1800e040 con 0x55d6c1090d80 2023-07-06T21:57:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc0a7fc640 1 -- 172.21.15.55:0/2620967097 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc180039a0 con 0x55d6c1090d80 2023-07-06T21:57:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc0a7fc640 1 -- 172.21.15.55:0/2620967097 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18003d10 con 0x55d6c1090d80 2023-07-06T21:57:31.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 -- 172.21.15.55:0/2620967097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c1090d80 msgr2=0x55d6c1091150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 --2- 172.21.15.55:0/2620967097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c1090d80 0x55d6c1091150 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fcc1801cc30 tx=0x7fcc1801b640 comp rx=0 tx=0).stop 2023-07-06T21:57:31.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 -- 172.21.15.55:0/2620967097 shutdown_connections 2023-07-06T21:57:31.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 --2- 172.21.15.55:0/2620967097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c1090d80 0x55d6c1091150 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 --2- 172.21.15.55:0/2620967097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 0x55d6c1090840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 --2- 172.21.15.55:0/2620967097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c10da740 0x55d6c10dab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 -- 172.21.15.55:0/2620967097 >> 172.21.15.55:0/2620967097 conn(0x55d6c1088800 msgr2=0x55d6c1097800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:31.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 -- 172.21.15.55:0/2620967097 shutdown_connections 2023-07-06T21:57:31.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.464+0000 7fcc2a397000 1 -- 172.21.15.55:0/2620967097 wait complete. 2023-07-06T21:57:31.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 1 -- start start 2023-07-06T21:57:31.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 1 Processor -- start 2023-07-06T21:57:31.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c1090d80 0x55d6c10966d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c10da740 0x55d6c109c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 0x55d6c109c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c0edf380 con 0x55d6c10da740 2023-07-06T21:57:31.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c0e9bae0 con 0x55d6c10db050 2023-07-06T21:57:31.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6c0e9b780 con 0x55d6c1090d80 2023-07-06T21:57:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 10 client.0 _ll_register_callbacks cb 0x55d6c107ce30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T21:57:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc1ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c10da740 0x55d6c109c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc1ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c10da740 0x55d6c109c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46590/0 (socket says 172.21.15.55:46590) 2023-07-06T21:57:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc1ffff640 1 -- 172.21.15.55:0/3273731322 learned_addr learned my addr 172.21.15.55:0/3273731322 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc255d1640 1 --2- 172.21.15.55:0/3273731322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 0x55d6c109c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc24dd0640 1 --2- 172.21.15.55:0/3273731322 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c1090d80 0x55d6c10966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc1ffff640 1 -- 172.21.15.55:0/3273731322 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c1090d80 msgr2=0x55d6c10966d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc1ffff640 1 --2- 172.21.15.55:0/3273731322 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c1090d80 0x55d6c10966d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc1ffff640 1 -- 172.21.15.55:0/3273731322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 msgr2=0x55d6c109c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc1ffff640 1 --2- 172.21.15.55:0/3273731322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 0x55d6c109c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc1ffff640 1 -- 172.21.15.55:0/3273731322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc10003530 con 0x55d6c10da740 2023-07-06T21:57:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc1ffff640 1 --2- 172.21.15.55:0/3273731322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c10da740 0x55d6c109c0e0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c007970 tx=0x7fcc0c001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd66f5d08f9022f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcbff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T21:57:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcbff7fe640 1 -- 172.21.15.55:0/3273731322 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c021630 con 0x55d6c10da740 2023-07-06T21:57:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 1 -- 172.21.15.55:0/3273731322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6c0ea6a20 con 0x55d6c10da740 2023-07-06T21:57:31.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcbff7fe640 1 -- 172.21.15.55:0/3273731322 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcc0c01a040 con 0x55d6c10da740 2023-07-06T21:57:31.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcbff7fe640 1 -- 172.21.15.55:0/3273731322 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc0c021790 con 0x55d6c10da740 2023-07-06T21:57:31.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 10 client.7077 fetch_fsmap learned FSMap version 32 2023-07-06T21:57:31.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 1 -- 172.21.15.55:0/3273731322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55d6c0ea3d10 con 0x55d6c10da740 2023-07-06T21:57:31.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcbff7fe640 1 -- 172.21.15.55:0/3273731322 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d6c0ea6a20 con 0x55d6c10da740 2023-07-06T21:57:31.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcbff7fe640 1 -- 172.21.15.55:0/3273731322 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcc0c0218f0 con 0x55d6c10da740 2023-07-06T21:57:31.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 10 client.7077 fetch_fsmap finished waiting for FSMap version 32 2023-07-06T21:57:31.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 10 client.7077 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T21:57:31.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 20 client.7077 populate_metadata read hostname 'smithi055' 2023-07-06T21:57:31.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 1 --2- 172.21.15.55:0/3273731322 >> [v2:172.21.15.55:6835/3154142571,v1:172.21.15.55:6837/3154142571] conn(0x55d6c10e97b0 0x55d6c10ebb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 4 client.7077 mds_command: new command op to 6936 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T21:57:31.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc2a397000 1 -- 172.21.15.55:0/3273731322 --> [v2:172.21.15.55:6835/3154142571,v1:172.21.15.55:6837/3154142571] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6c0f0e710 con 0x55d6c10e97b0 2023-07-06T21:57:31.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.468+0000 7fcc24dd0640 1 --2- 172.21.15.55:0/3273731322 >> [v2:172.21.15.55:6835/3154142571,v1:172.21.15.55:6837/3154142571] conn(0x55d6c10e97b0 0x55d6c10ebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcc24dd0640 1 --2- 172.21.15.55:0/3273731322 >> [v2:172.21.15.55:6835/3154142571,v1:172.21.15.55:6837/3154142571] conn(0x55d6c10e97b0 0x55d6c10ebb90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f38073259e11453f server_cookie=d8e0bbbcb10b6a96 in_seq=0 out_seq=0 2023-07-06T21:57:31.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcbff7fe640 10 client.7077 ms_handle_connect on v2:172.21.15.55:6835/3154142571 2023-07-06T21:57:31.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcbff7fe640 1 -- 172.21.15.55:0/3273731322 <== mds.0 v2:172.21.15.55:6835/3154142571 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d6c0f0e710 con 0x55d6c10e97b0 2023-07-06T21:57:31.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcbff7fe640 10 client.7077 handle_command_reply: tid=0 2023-07-06T21:57:31.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcc2a397000 1 client.7077 shutdown 2023-07-06T21:57:31.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcc2a397000 1 -- 172.21.15.55:0/3273731322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c10da740 msgr2=0x55d6c109c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcc2a397000 1 --2- 172.21.15.55:0/3273731322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c10da740 0x55d6c109c0e0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c007970 tx=0x7fcc0c001130 comp rx=0 tx=0).stop 2023-07-06T21:57:31.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcc2a397000 1 -- 172.21.15.55:0/3273731322 shutdown_connections 2023-07-06T21:57:31.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcc2a397000 1 --2- 172.21.15.55:0/3273731322 >> [v2:172.21.15.55:6835/3154142571,v1:172.21.15.55:6837/3154142571] conn(0x55d6c10e97b0 0x55d6c10ebb90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcc2a397000 1 --2- 172.21.15.55:0/3273731322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 0x55d6c109c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcc2a397000 1 --2- 172.21.15.55:0/3273731322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c10da740 0x55d6c109c0e0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcc2a397000 1 --2- 172.21.15.55:0/3273731322 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c1090d80 0x55d6c10966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcbff7fe640 0 client.7077 ms_handle_reset on v2:172.21.15.55:6835/3154142571 2023-07-06T21:57:31.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcc2a397000 1 -- 172.21.15.55:0/3273731322 >> 172.21.15.55:0/3273731322 conn(0x55d6c1088800 msgr2=0x55d6c108f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:31.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcc2a397000 1 -- 172.21.15.55:0/3273731322 shutdown_connections 2023-07-06T21:57:31.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcc2a397000 1 -- 172.21.15.55:0/3273731322 wait complete. 2023-07-06T21:57:31.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.472+0000 7fcc2a397000 20 client.7077 trim_cache size 0 max 16384 2023-07-06T21:57:31.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 Processor -- start 2023-07-06T21:57:31.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 -- start start 2023-07-06T21:57:31.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c1090d80 0x55d6c108ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10da740 0x55d6c1090480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c10db050 0x55d6c10e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c0b9c940 con 0x55d6c10db050 2023-07-06T21:57:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c0ee7570 con 0x55d6c10da740 2023-07-06T21:57:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6c0edacf0 con 0x55d6c1090d80 2023-07-06T21:57:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc255d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c10db050 0x55d6c10e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc255d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c10db050 0x55d6c10e9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46594/0 (socket says 172.21.15.55:46594) 2023-07-06T21:57:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc255d1640 1 -- 172.21.15.55:0/633377740 learned_addr learned my addr 172.21.15.55:0/633377740 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:31.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc24dd0640 1 --2- 172.21.15.55:0/633377740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c1090d80 0x55d6c108ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc1ffff640 1 --2- 172.21.15.55:0/633377740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10da740 0x55d6c1090480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc255d1640 1 -- 172.21.15.55:0/633377740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c1090d80 msgr2=0x55d6c108ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:31.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc255d1640 1 --2- 172.21.15.55:0/633377740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c1090d80 0x55d6c108ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc255d1640 1 -- 172.21.15.55:0/633377740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10da740 msgr2=0x55d6c1090480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:31.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc255d1640 1 --2- 172.21.15.55:0/633377740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10da740 0x55d6c1090480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc255d1640 1 -- 172.21.15.55:0/633377740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6c1093450 con 0x55d6c10db050 2023-07-06T21:57:31.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc1ffff640 1 --2- 172.21.15.55:0/633377740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10da740 0x55d6c1090480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:31.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc255d1640 1 --2- 172.21.15.55:0/633377740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c10db050 0x55d6c10e9b80 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fcc1801cc30 tx=0x7fcc18004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99153f4e1f8be0c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:31.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc0affd640 1 -- 172.21.15.55:0/633377740 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc180bd070 con 0x55d6c10db050 2023-07-06T21:57:31.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc0affd640 1 -- 172.21.15.55:0/633377740 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc180039a0 con 0x55d6c10db050 2023-07-06T21:57:31.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc0affd640 1 -- 172.21.15.55:0/633377740 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1800e040 con 0x55d6c10db050 2023-07-06T21:57:31.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 -- 172.21.15.55:0/633377740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c10db050 msgr2=0x55d6c10e9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 --2- 172.21.15.55:0/633377740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c10db050 0x55d6c10e9b80 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fcc1801cc30 tx=0x7fcc18004a50 comp rx=0 tx=0).stop 2023-07-06T21:57:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 -- 172.21.15.55:0/633377740 shutdown_connections 2023-07-06T21:57:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 --2- 172.21.15.55:0/633377740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c10db050 0x55d6c10e9b80 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 --2- 172.21.15.55:0/633377740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10da740 0x55d6c1090480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 --2- 172.21.15.55:0/633377740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c1090d80 0x55d6c108ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 -- 172.21.15.55:0/633377740 >> 172.21.15.55:0/633377740 conn(0x55d6c1088800 msgr2=0x55d6c108f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 -- 172.21.15.55:0/633377740 shutdown_connections 2023-07-06T21:57:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.488+0000 7fcc2a397000 1 -- 172.21.15.55:0/633377740 wait complete. 2023-07-06T21:57:31.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 1 -- start start 2023-07-06T21:57:31.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 1 Processor -- start 2023-07-06T21:57:31.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c1090d80 0x55d6c10ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c10da740 0x55d6c10ed320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 0x55d6c10f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c0ed9680 con 0x55d6c1090d80 2023-07-06T21:57:31.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c0f22ad0 con 0x55d6c10db050 2023-07-06T21:57:31.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6c0eade10 con 0x55d6c10da740 2023-07-06T21:57:31.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 10 client.0 _ll_register_callbacks cb 0x55d6c0ea37f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T21:57:31.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc24dd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c1090d80 0x55d6c10ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc24dd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c1090d80 0x55d6c10ecde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46600/0 (socket says 172.21.15.55:46600) 2023-07-06T21:57:31.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc24dd0640 1 -- 172.21.15.55:0/3801540095 learned_addr learned my addr 172.21.15.55:0/3801540095 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:31.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc1ffff640 1 --2- 172.21.15.55:0/3801540095 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c10da740 0x55d6c10ed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc255d1640 1 --2- 172.21.15.55:0/3801540095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 0x55d6c10f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc24dd0640 1 -- 172.21.15.55:0/3801540095 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c10da740 msgr2=0x55d6c10ed320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:31.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc24dd0640 1 --2- 172.21.15.55:0/3801540095 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c10da740 0x55d6c10ed320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc24dd0640 1 -- 172.21.15.55:0/3801540095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 msgr2=0x55d6c10f4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:31.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc24dd0640 1 --2- 172.21.15.55:0/3801540095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 0x55d6c10f4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc24dd0640 1 -- 172.21.15.55:0/3801540095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d6c0bdb890 con 0x55d6c1090d80 2023-07-06T21:57:31.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc255d1640 1 --2- 172.21.15.55:0/3801540095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 0x55d6c10f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:31.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc24dd0640 1 --2- 172.21.15.55:0/3801540095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c1090d80 0x55d6c10ecde0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fcc14017000 tx=0x7fcc140013c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabfbafa981e50e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:31.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcbff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T21:57:31.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcbff7fe640 1 -- 172.21.15.55:0/3801540095 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14081d50 con 0x55d6c1090d80 2023-07-06T21:57:31.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcbff7fe640 1 -- 172.21.15.55:0/3801540095 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcc1400ce30 con 0x55d6c1090d80 2023-07-06T21:57:31.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 1 -- 172.21.15.55:0/3801540095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6c10946e0 con 0x55d6c1090d80 2023-07-06T21:57:31.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcbff7fe640 1 -- 172.21.15.55:0/3801540095 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc1405c740 con 0x55d6c1090d80 2023-07-06T21:57:31.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 10 client.7083 fetch_fsmap learned FSMap version 32 2023-07-06T21:57:31.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 1 -- 172.21.15.55:0/3801540095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55d6c0e89fa0 con 0x55d6c1090d80 2023-07-06T21:57:31.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcbff7fe640 1 -- 172.21.15.55:0/3801540095 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d6c10946e0 con 0x55d6c1090d80 2023-07-06T21:57:31.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcbff7fe640 1 -- 172.21.15.55:0/3801540095 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcc14072b10 con 0x55d6c1090d80 2023-07-06T21:57:31.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 10 client.7083 fetch_fsmap finished waiting for FSMap version 32 2023-07-06T21:57:31.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 10 client.7083 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T21:57:31.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 20 client.7083 populate_metadata read hostname 'smithi055' 2023-07-06T21:57:31.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 1 --2- 172.21.15.55:0/3801540095 >> [v2:172.21.15.55:6835/3154142571,v1:172.21.15.55:6837/3154142571] conn(0x55d6c10f5b00 0x55d6c1140460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 4 client.7083 mds_command: new command op to 6936 tid=0[{"prefix": "status"}] 2023-07-06T21:57:31.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc2a397000 1 -- 172.21.15.55:0/3801540095 --> [v2:172.21.15.55:6835/3154142571,v1:172.21.15.55:6837/3154142571] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d6c0eddcd0 con 0x55d6c10f5b00 2023-07-06T21:57:31.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.492+0000 7fcc1ffff640 1 --2- 172.21.15.55:0/3801540095 >> [v2:172.21.15.55:6835/3154142571,v1:172.21.15.55:6837/3154142571] conn(0x55d6c10f5b00 0x55d6c1140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc1ffff640 1 --2- 172.21.15.55:0/3801540095 >> [v2:172.21.15.55:6835/3154142571,v1:172.21.15.55:6837/3154142571] conn(0x55d6c10f5b00 0x55d6c1140460 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fc263774718a1ed server_cookie=3033426da9cff0e4 in_seq=0 out_seq=0 2023-07-06T21:57:31.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcbff7fe640 10 client.7083 ms_handle_connect on v2:172.21.15.55:6835/3154142571 2023-07-06T21:57:31.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcbff7fe640 1 -- 172.21.15.55:0/3801540095 <== mds.0 v2:172.21.15.55:6835/3154142571 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55d6c0eddcd0 con 0x55d6c10f5b00 2023-07-06T21:57:31.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcbff7fe640 10 client.7083 handle_command_reply: tid=0 2023-07-06T21:57:31.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc2a397000 1 client.7083 shutdown 2023-07-06T21:57:31.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc2a397000 1 -- 172.21.15.55:0/3801540095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c1090d80 msgr2=0x55d6c10ecde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc2a397000 1 --2- 172.21.15.55:0/3801540095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c1090d80 0x55d6c10ecde0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fcc14017000 tx=0x7fcc140013c0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc2a397000 1 -- 172.21.15.55:0/3801540095 shutdown_connections 2023-07-06T21:57:31.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc2a397000 1 --2- 172.21.15.55:0/3801540095 >> [v2:172.21.15.55:6835/3154142571,v1:172.21.15.55:6837/3154142571] conn(0x55d6c10f5b00 0x55d6c1140460 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc2a397000 1 --2- 172.21.15.55:0/3801540095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d6c10db050 0x55d6c10f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc2a397000 1 --2- 172.21.15.55:0/3801540095 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d6c10da740 0x55d6c10ed320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc2a397000 1 --2- 172.21.15.55:0/3801540095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d6c1090d80 0x55d6c10ecde0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcbff7fe640 0 client.7083 ms_handle_reset on v2:172.21.15.55:6835/3154142571 2023-07-06T21:57:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc2a397000 1 -- 172.21.15.55:0/3801540095 >> 172.21.15.55:0/3801540095 conn(0x55d6c1088800 msgr2=0x55d6c108f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc2a397000 1 -- 172.21.15.55:0/3801540095 shutdown_connections 2023-07-06T21:57:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc2a397000 1 -- 172.21.15.55:0/3801540095 wait complete. 2023-07-06T21:57:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc2a397000 20 client.7083 trim_cache size 0 max 16384 2023-07-06T21:57:31.501 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T21:57:31.502 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c64f3ef1-e769-47b3-ae15-a714e4e7c4f7", 2023-07-06T21:57:31.502 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-07-06T21:57:31.502 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6936, 2023-07-06T21:57:31.502 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-07-06T21:57:31.502 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-07-06T21:57:31.502 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-07-06T21:57:31.502 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 5.9523929840000003, 2023-07-06T21:57:31.503 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 32, 2023-07-06T21:57:31.503 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 89, 2023-07-06T21:57:31.503 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 89, 2023-07-06T21:57:31.503 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 11.457064269 2023-07-06T21:57:31.503 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T21:57:31.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc25dd2640 1 -- 172.21.15.55:0/4145958390 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fcc040663d0 msgr2=0x7fcc04068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc25dd2640 1 --2- 172.21.15.55:0/4145958390 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fcc040663d0 0x7fcc04068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcc2015ca10 tx=0x7fcc0c009040 comp rx=0 tx=0).stop 2023-07-06T21:57:31.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc25dd2640 1 -- 172.21.15.55:0/4145958390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc10005180 msgr2=0x7fcc2014f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc25dd2640 1 --2- 172.21.15.55:0/4145958390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc10005180 0x7fcc2014f040 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fcc14001000 tx=0x7fcc1400ec10 comp rx=0 tx=0).stop 2023-07-06T21:57:31.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc25dd2640 1 -- 172.21.15.55:0/4145958390 shutdown_connections 2023-07-06T21:57:31.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc25dd2640 1 --2- 172.21.15.55:0/4145958390 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fcc040663d0 0x7fcc04068880 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc25dd2640 1 --2- 172.21.15.55:0/4145958390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc200c62b0 0x7fcc200c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc25dd2640 1 --2- 172.21.15.55:0/4145958390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcc20069d90 0x7fcc2006a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc25dd2640 1 --2- 172.21.15.55:0/4145958390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc10005180 0x7fcc2014f040 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc25dd2640 1 -- 172.21.15.55:0/4145958390 >> 172.21.15.55:0/4145958390 conn(0x7fcc200b3b60 msgr2=0x7fcc200cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:31.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc25dd2640 1 -- 172.21.15.55:0/4145958390 shutdown_connections 2023-07-06T21:57:31.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.496+0000 7fcc25dd2640 1 -- 172.21.15.55:0/4145958390 wait complete. 2023-07-06T21:57:31.513 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T21:57:31.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.656+0000 7f49e7bc5640 1 Processor -- start 2023-07-06T21:57:31.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.656+0000 7f49e7bc5640 1 -- start start 2023-07-06T21:57:31.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e7bc5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f49e00cd330 0x7f49e00cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e7bc5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e006bd00 con 0x7f49e0160030 2023-07-06T21:57:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e7bc5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e00c9ba0 con 0x7f49e00cbce0 2023-07-06T21:57:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e7bc5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e0160400 con 0x7f49e00cd330 2023-07-06T21:57:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e5961640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f49e0160030 0x7f49e0070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56914/0 (socket says 172.21.15.55:56914) 2023-07-06T21:57:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e5961640 1 -- 172.21.15.55:0/2444258467 learned_addr learned my addr 172.21.15.55:0/2444258467 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:31.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e5160640 1 --2- 172.21.15.55:0/2444258467 >> v2:172.21.15.138:3300/0 conn(0x7f49e00cd330 0x7f49e00cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660638232 0 0) 0x7f49e006bd00 con 0x7f49e0160030 2023-07-06T21:57:31.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49cc003530 con 0x7f49e0160030 2023-07-06T21:57:31.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319539448 0 0) 0x7f49e00c9ba0 con 0x7f49e00cbce0 2023-07-06T21:57:31.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49e006bd00 con 0x7f49e00cbce0 2023-07-06T21:57:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 384844875 0 0) 0x7f49cc003530 con 0x7f49e0160030 2023-07-06T21:57:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 >> v2:172.21.15.138:3300/0 conn(0x7f49e00cd330 msgr2=0x7f49e00cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 --2- 172.21.15.55:0/2444258467 >> v2:172.21.15.138:3300/0 conn(0x7f49e00cd330 0x7f49e00cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 >> v1:172.21.15.138:6789/0 conn(0x7f49e00cbce0 legacy=0x7f49e00cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e0071540 con 0x7f49e0160030 2023-07-06T21:57:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f49dc001680 con 0x7f49e0160030 2023-07-06T21:57:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 >> v1:172.21.15.55:6789/0 conn(0x7f49e0160030 legacy=0x7f49e0070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 --2- 172.21.15.55:0/2444258467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49cc003b10 0x7f49cc003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 --2- 172.21.15.55:0/2444258467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49cc0047d0 0x7f49cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 --2- 172.21.15.55:0/2444258467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49cc005180 0x7f49cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e0160400 con 0x7f49cc005180 2023-07-06T21:57:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc00bfe0 con 0x7f49cc0047d0 2023-07-06T21:57:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc00c1a0 con 0x7f49cc003b10 2023-07-06T21:57:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e6162640 1 --2- 172.21.15.55:0/2444258467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49cc005180 0x7f49cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e5160640 1 --2- 172.21.15.55:0/2444258467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49cc0047d0 0x7f49cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e5961640 1 --2- 172.21.15.55:0/2444258467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49cc003b10 0x7f49cc003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e6162640 1 -- 172.21.15.55:0/2444258467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49cc003b10 msgr2=0x7f49cc003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:31.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e6162640 1 --2- 172.21.15.55:0/2444258467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49cc003b10 0x7f49cc003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e6162640 1 -- 172.21.15.55:0/2444258467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49cc0047d0 msgr2=0x7f49cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:31.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e6162640 1 --2- 172.21.15.55:0/2444258467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49cc0047d0 0x7f49cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.660+0000 7f49e6162640 1 -- 172.21.15.55:0/2444258467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc003530 con 0x7f49cc005180 2023-07-06T21:57:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.664+0000 7f49e6162640 1 -- 172.21.15.55:0/2444258467 reap_dead start 2023-07-06T21:57:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.664+0000 7f49e6162640 1 --2- 172.21.15.55:0/2444258467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49cc005180 0x7f49cc00b990 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f49d8001fd0 tx=0x7f49d801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deac3a06ff7dcfeb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.664+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc007ea0 con 0x7f49cc005180 2023-07-06T21:57:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.664+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d8003ba0 con 0x7f49cc005180 2023-07-06T21:57:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.664+0000 7f49e495f640 1 -- 172.21.15.55:0/2444258467 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d80050d0 con 0x7f49cc005180 2023-07-06T21:57:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.664+0000 7f49e7bc5640 1 -- 172.21.15.55:0/2444258467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49cc005180 msgr2=0x7f49cc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.664+0000 7f49e7bc5640 1 --2- 172.21.15.55:0/2444258467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49cc005180 0x7f49cc00b990 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f49d8001fd0 tx=0x7f49d801c8e0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.664+0000 7f49e7bc5640 1 -- 172.21.15.55:0/2444258467 shutdown_connections 2023-07-06T21:57:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.664+0000 7f49e7bc5640 1 --2- 172.21.15.55:0/2444258467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49cc005180 0x7f49cc00b990 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.664+0000 7f49e7bc5640 1 -- 172.21.15.55:0/2444258467 >> 172.21.15.55:0/2444258467 conn(0x7f49e00cded0 msgr2=0x7f49e00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.664+0000 7f49e7bc5640 1 -- 172.21.15.55:0/2444258467 shutdown_connections 2023-07-06T21:57:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.664+0000 7f49e7bc5640 1 -- 172.21.15.55:0/2444258467 wait complete. 2023-07-06T21:57:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e7bc5640 1 Processor -- start 2023-07-06T21:57:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e7bc5640 1 -- start start 2023-07-06T21:57:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e7bc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49cc005180 0x7f49e00c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e7bc5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49e00ae360 0x7f49e00b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e7bc5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00b2b80 0x7f49e00b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e7bc5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00c1ab0 con 0x7f49e00ae360 2023-07-06T21:57:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e7bc5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00b1050 con 0x7f49e00b2b80 2023-07-06T21:57:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e7bc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00c4950 con 0x7f49cc005180 2023-07-06T21:57:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e5160640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49e00ae360 0x7f49e00b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e5160640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49e00ae360 0x7f49e00b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46612/0 (socket says 172.21.15.55:46612) 2023-07-06T21:57:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e5160640 1 -- 172.21.15.55:0/4143397417 learned_addr learned my addr 172.21.15.55:0/4143397417 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e5961640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49cc005180 0x7f49e00c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e6162640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00b2b80 0x7f49e00b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e5160640 1 -- 172.21.15.55:0/4143397417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49cc005180 msgr2=0x7f49e00c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e5160640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49cc005180 0x7f49e00c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e5160640 1 -- 172.21.15.55:0/4143397417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00b2b80 msgr2=0x7f49e00b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e5160640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00b2b80 0x7f49e00b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e5160640 1 -- 172.21.15.55:0/4143397417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e00b3540 con 0x7f49e00ae360 2023-07-06T21:57:31.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e5961640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49cc005180 0x7f49e00c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:31.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e5160640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49e00ae360 0x7f49e00b2640 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f49d0011990 tx=0x7f49d0011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:31.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49d67fc640 1 -- 172.21.15.55:0/4143397417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000fad0 con 0x7f49e00ae360 2023-07-06T21:57:31.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49d67fc640 1 -- 172.21.15.55:0/4143397417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d000fc30 con 0x7f49e00ae360 2023-07-06T21:57:31.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49d67fc640 1 -- 172.21.15.55:0/4143397417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0014440 con 0x7f49e00ae360 2023-07-06T21:57:31.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e7bc5640 1 -- 172.21.15.55:0/4143397417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e015da80 con 0x7f49e00ae360 2023-07-06T21:57:31.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.668+0000 7f49e7bc5640 1 -- 172.21.15.55:0/4143397417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e00aeb40 con 0x7f49e00ae360 2023-07-06T21:57:31.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.672+0000 7f49e7bc5640 1 -- 172.21.15.55:0/4143397417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e0066d60 con 0x7f49e00ae360 2023-07-06T21:57:31.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.672+0000 7f49d67fc640 1 -- 172.21.15.55:0/4143397417 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f49d00145a0 con 0x7f49e00ae360 2023-07-06T21:57:31.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.672+0000 7f49d67fc640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f49c40663a0 0x7f49c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.672+0000 7f49d67fc640 1 -- 172.21.15.55:0/4143397417 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f49d00847d0 con 0x7f49e00ae360 2023-07-06T21:57:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.672+0000 7f49e5961640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f49c40663a0 0x7f49c4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.672+0000 7f49e5961640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f49c40663a0 0x7f49c4068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f49dc001c30 tx=0x7f49dc009040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:31.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.676+0000 7f49d67fc640 1 -- 172.21.15.55:0/4143397417 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f49d00519f0 con 0x7f49e00ae360 2023-07-06T21:57:31.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.864+0000 7f49e7bc5640 1 -- 172.21.15.55:0/4143397417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f49e0163570 con 0x7f49e00ae360 2023-07-06T21:57:31.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.868+0000 7f49d67fc640 1 -- 172.21.15.55:0/4143397417 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f49d0055010 con 0x7f49e00ae360 2023-07-06T21:57:31.865 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T21:57:31.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.868+0000 7f49e7bc5640 1 -- 172.21.15.55:0/4143397417 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f49c40663a0 msgr2=0x7f49c4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.868+0000 7f49e7bc5640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f49c40663a0 0x7f49c4068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f49dc001c30 tx=0x7f49dc009040 comp rx=0 tx=0).stop 2023-07-06T21:57:31.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.868+0000 7f49e7bc5640 1 -- 172.21.15.55:0/4143397417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49e00ae360 msgr2=0x7f49e00b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:31.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.868+0000 7f49e7bc5640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49e00ae360 0x7f49e00b2640 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f49d0011990 tx=0x7f49d0011e50 comp rx=0 tx=0).stop 2023-07-06T21:57:31.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.868+0000 7f49e7bc5640 1 -- 172.21.15.55:0/4143397417 shutdown_connections 2023-07-06T21:57:31.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.868+0000 7f49e7bc5640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f49c40663a0 0x7f49c4068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.868+0000 7f49e7bc5640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00b2b80 0x7f49e00b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.868+0000 7f49e7bc5640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49e00ae360 0x7f49e00b2640 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.868+0000 7f49e7bc5640 1 --2- 172.21.15.55:0/4143397417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49cc005180 0x7f49e00c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:31.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.868+0000 7f49e7bc5640 1 -- 172.21.15.55:0/4143397417 >> 172.21.15.55:0/4143397417 conn(0x7f49e00cded0 msgr2=0x7f49e015e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:31.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.868+0000 7f49e7bc5640 1 -- 172.21.15.55:0/4143397417 shutdown_connections 2023-07-06T21:57:31.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:31.868+0000 7f49e7bc5640 1 -- 172.21.15.55:0/4143397417 wait complete. 2023-07-06T21:57:31.886 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T21:57:31.886 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T21:57:31.886 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-07-06T21:57:31.887 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T21:57:31.887 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T21:57:31.887 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T21:57:31.887 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-06T21:57:31.888 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T21:57:31.888 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:57:31.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:31.889 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-07-06T21:57:31.898 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T21:57:31.898 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T21:57:31.898 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T21:57:31.898 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:57:31.899 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T21:57:31.899 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:57:31.899 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:57:31.899 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:57:31.899 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-07-06T21:57:31.899 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:57:31.899 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:57:31.900 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-07-06T21:57:31.900 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T21:57:31.900 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:57:31.900 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-07-06T21:57:31.900 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-06T21:57:31.900 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41505sec preferred_lft 41505sec 2023-07-06T21:57:31.900 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-07-06T21:57:31.901 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:57:31.901 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:57:31.901 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:57:31.901 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-07-06T21:57:31.901 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T21:57:31.901 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:84:fe:b8:21 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:57:31.901 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T21:57:31.902 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:57:31.902 INFO:teuthology.orchestra.run.smithi055.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T21:57:31.902 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-06T21:57:31.902 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T21:57:31.902 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:57:31.902 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-06T21:57:31.902 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:57:31.902 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T21:57:31.903 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T21:57:31.903 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-06T21:57:31.903 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:57:31.903 INFO:teuthology.orchestra.run.smithi055.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T21:57:31.903 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T21:57:31.903 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-06T21:57:31.903 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:57:31.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:31.904 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T21:57:31.971 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-07-06T21:57:31.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:31.973 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-07-06T21:57:32.029 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-07-06T21:57:32.029 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T21:57:32.030 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-06T21:57:32.030 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T21:57:32.030 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-06T21:57:32.030 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T21:57:32.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:32.031 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:57:32.031 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:57:32.031 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T21:57:32.032 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T21:57:32.032 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T21:57:32.032 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:57:32.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:32.126 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T21:57:32.135 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T21:57:32.135 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T21:57:32.136 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:57:32.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:32.137 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-07-06T21:57:32.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:57:32.205 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T21:57:32.256 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:57:32.256 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:57:32.256 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T21:57:32.311 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-06T21:57:32.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:32.312 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:57:32.408 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:57:32.408 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:57:32.420 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:57:32.420 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:57:32.420 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-07-06T21:57:32.421 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.cephfs=/ 2023-07-06T21:57:32.421 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-07-06T21:57:32.424 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T21:57:32.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:32.424 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T21:57:32.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:32.446 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:57:32.503 INFO:teuthology.orchestra.run.smithi055.stdout:client7092 2023-07-06T21:57:32.504 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:57:32.504 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:32.552 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-06T21:57:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.740+0000 7fadb18d8640 1 Processor -- start 2023-07-06T21:57:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.740+0000 7fadb18d8640 1 -- start start 2023-07-06T21:57:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.740+0000 7fadb18d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fadac158850 0x7fadac0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.740+0000 7fadb18d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadac070af0 0x7fadac0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.740+0000 7fadb18d8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadac158c20 con 0x7fadac0ca130 2023-07-06T21:57:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.740+0000 7fadb18d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadac0b2aa0 con 0x7fadac158850 2023-07-06T21:57:32.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.740+0000 7fadb18d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadac0c8db0 con 0x7fadac070af0 2023-07-06T21:57:32.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.744+0000 7fadaaffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fadac158850 0x7fadac0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:32.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.744+0000 7fadaaffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fadac158850 0x7fadac0cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46618/0 (socket says 172.21.15.55:46618) 2023-07-06T21:57:32.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.744+0000 7fadaaffd640 1 -- 172.21.15.55:0/893841431 learned_addr learned my addr 172.21.15.55:0/893841431 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:32.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.744+0000 7fadab7fe640 1 --2- 172.21.15.55:0/893841431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadac070af0 0x7fadac0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:32.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.744+0000 7fadaaffd640 1 -- 172.21.15.55:0/893841431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadac070af0 msgr2=0x7fadac0ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:32.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.744+0000 7fadaaffd640 1 --2- 172.21.15.55:0/893841431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadac070af0 0x7fadac0ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:32.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.744+0000 7fadaaffd640 1 -- 172.21.15.55:0/893841431 >> v1:172.21.15.138:6789/0 conn(0x7fadac0ca130 legacy=0x7fadac0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:32.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.744+0000 7fadaaffd640 1 -- 172.21.15.55:0/893841431 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac0c9090 con 0x7fadac158850 2023-07-06T21:57:32.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.744+0000 7fadaaffd640 1 --2- 172.21.15.55:0/893841431 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadac158850 0x7fadac0cca30 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009870 tx=0x7fad9c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5fc87e3b48c704e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.744+0000 7fadaa7fc640 1 -- 172.21.15.55:0/893841431 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c0a8a30 con 0x7fadac158850 2023-07-06T21:57:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.744+0000 7fadaa7fc640 1 -- 172.21.15.55:0/893841431 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c0a8b90 con 0x7fadac158850 2023-07-06T21:57:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.744+0000 7fadaa7fc640 1 -- 172.21.15.55:0/893841431 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c0b0440 con 0x7fadac158850 2023-07-06T21:57:32.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 -- 172.21.15.55:0/893841431 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadac158850 msgr2=0x7fadac0cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:32.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 --2- 172.21.15.55:0/893841431 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadac158850 0x7fadac0cca30 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009870 tx=0x7fad9c01ed30 comp rx=0 tx=0).stop 2023-07-06T21:57:32.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 -- 172.21.15.55:0/893841431 shutdown_connections 2023-07-06T21:57:32.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 --2- 172.21.15.55:0/893841431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadac070af0 0x7fadac0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:32.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 --2- 172.21.15.55:0/893841431 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadac158850 0x7fadac0cca30 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:32.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 -- 172.21.15.55:0/893841431 >> 172.21.15.55:0/893841431 conn(0x7fadac0cea70 msgr2=0x7fadac0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:32.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 -- 172.21.15.55:0/893841431 shutdown_connections 2023-07-06T21:57:32.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 -- 172.21.15.55:0/893841431 wait complete. 2023-07-06T21:57:32.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 Processor -- start 2023-07-06T21:57:32.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 -- start start 2023-07-06T21:57:32.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadac070af0 0x7fadac0cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:32.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadac0ca130 0x7fadac163260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:32.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadac158850 0x7fadac164d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:32.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac1519d0 con 0x7fadac070af0 2023-07-06T21:57:32.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac151cb0 con 0x7fadac158850 2023-07-06T21:57:32.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadb18d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadac151f90 con 0x7fadac0ca130 2023-07-06T21:57:32.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadaaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadac070af0 0x7fadac0cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:32.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadaaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadac070af0 0x7fadac0cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46632/0 (socket says 172.21.15.55:46632) 2023-07-06T21:57:32.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadaaffd640 1 -- 172.21.15.55:0/4189341000 learned_addr learned my addr 172.21.15.55:0/4189341000 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:32.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fada3fff640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadac0ca130 0x7fadac163260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:32.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadab7fe640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadac158850 0x7fadac164d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:32.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadaaffd640 1 -- 172.21.15.55:0/4189341000 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadac0ca130 msgr2=0x7fadac163260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:32.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadaaffd640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadac0ca130 0x7fadac163260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:32.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadaaffd640 1 -- 172.21.15.55:0/4189341000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadac158850 msgr2=0x7fadac164d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:32.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadaaffd640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadac158850 0x7fadac164d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:32.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadaaffd640 1 -- 172.21.15.55:0/4189341000 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c0094d0 con 0x7fadac070af0 2023-07-06T21:57:32.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.748+0000 7fadab7fe640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadac158850 0x7fadac164d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:32.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.752+0000 7fadaaffd640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadac070af0 0x7fadac0cced0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0b3040 tx=0x7fad9c01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:32.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.752+0000 7fada8ff9640 1 -- 172.21.15.55:0/4189341000 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c0be070 con 0x7fadac070af0 2023-07-06T21:57:32.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.752+0000 7fada8ff9640 1 -- 172.21.15.55:0/4189341000 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c0ba400 con 0x7fadac070af0 2023-07-06T21:57:32.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.752+0000 7fada8ff9640 1 -- 172.21.15.55:0/4189341000 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c0ba7d0 con 0x7fadac070af0 2023-07-06T21:57:32.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.752+0000 7fadb18d8640 1 -- 172.21.15.55:0/4189341000 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadac09cea0 con 0x7fadac070af0 2023-07-06T21:57:32.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.752+0000 7fadb18d8640 1 -- 172.21.15.55:0/4189341000 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadac165260 con 0x7fadac070af0 2023-07-06T21:57:32.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.752+0000 7fadb18d8640 1 -- 172.21.15.55:0/4189341000 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadac066d60 con 0x7fadac070af0 2023-07-06T21:57:32.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.752+0000 7fada8ff9640 1 -- 172.21.15.55:0/4189341000 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fad9c0c3410 con 0x7fadac070af0 2023-07-06T21:57:32.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.752+0000 7fada8ff9640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fad8c0663a0 0x7fad8c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:32.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.752+0000 7fada8ff9640 1 -- 172.21.15.55:0/4189341000 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fad9c121a60 con 0x7fadac070af0 2023-07-06T21:57:32.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.752+0000 7fada3fff640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fad8c0663a0 0x7fad8c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:32.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.756+0000 7fada3fff640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fad8c0663a0 0x7fad8c068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fadac0afcc0 tx=0x7fad94009040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:32.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.756+0000 7fada8ff9640 1 -- 172.21.15.55:0/4189341000 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fad9c0eec80 con 0x7fadac070af0 2023-07-06T21:57:32.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.932+0000 7fadb18d8640 1 -- 172.21.15.55:0/4189341000 --> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fadac151e20 con 0x7fad8c0663a0 2023-07-06T21:57:32.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.932+0000 7fada8ff9640 1 -- 172.21.15.55:0/4189341000 <== mgr.6681 v2:172.21.15.55:6832/3540074910 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fadac151e20 con 0x7fad8c0663a0 2023-07-06T21:57:32.930 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T21:57:32.931 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:32.931 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-07-06T21:57:32.931 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:32.931 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T21:57:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.932+0000 7fadb18d8640 1 -- 172.21.15.55:0/4189341000 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fad8c0663a0 msgr2=0x7fad8c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.932+0000 7fadb18d8640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fad8c0663a0 0x7fad8c068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fadac0afcc0 tx=0x7fad94009040 comp rx=0 tx=0).stop 2023-07-06T21:57:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.932+0000 7fadb18d8640 1 -- 172.21.15.55:0/4189341000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadac070af0 msgr2=0x7fadac0cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.932+0000 7fadb18d8640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadac070af0 0x7fadac0cced0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0b3040 tx=0x7fad9c01bad0 comp rx=0 tx=0).stop 2023-07-06T21:57:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.932+0000 7fadb18d8640 1 -- 172.21.15.55:0/4189341000 shutdown_connections 2023-07-06T21:57:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.932+0000 7fadb18d8640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fad8c0663a0 0x7fad8c068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.932+0000 7fadb18d8640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadac158850 0x7fadac164d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.932+0000 7fadb18d8640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fadac0ca130 0x7fadac163260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.932+0000 7fadb18d8640 1 --2- 172.21.15.55:0/4189341000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadac070af0 0x7fadac0cced0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.932+0000 7fadb18d8640 1 -- 172.21.15.55:0/4189341000 >> 172.21.15.55:0/4189341000 conn(0x7fadac0cea70 msgr2=0x7fadac0c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.936+0000 7fadb18d8640 1 -- 172.21.15.55:0/4189341000 shutdown_connections 2023-07-06T21:57:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:32.936+0000 7fadb18d8640 1 -- 172.21.15.55:0/4189341000 wait complete. 2023-07-06T21:57:32.951 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-06T21:57:33.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.096+0000 7fc1cdb74640 1 Processor -- start 2023-07-06T21:57:33.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.096+0000 7fc1cdb74640 1 -- start start 2023-07-06T21:57:33.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1cdb74640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc1c8070020 0x7fc1c80ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:33.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1cdb74640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c815fe80 con 0x7fc1c815bb90 2023-07-06T21:57:33.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1cdb74640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c815bf60 con 0x7fc1c80cef40 2023-07-06T21:57:33.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1cdb74640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c815f620 con 0x7fc1c8070020 2023-07-06T21:57:33.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc1c815bb90 0x7fc1c806f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56920/0 (socket says 172.21.15.55:56920) 2023-07-06T21:57:33.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c77fe640 1 -- 172.21.15.55:0/814983024 learned_addr learned my addr 172.21.15.55:0/814983024 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:33.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c6ffd640 1 --2- 172.21.15.55:0/814983024 >> v2:172.21.15.138:3300/0 conn(0x7fc1c8070020 0x7fc1c80ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:33.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 -- 172.21.15.55:0/814983024 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526783982 0 0) 0x7fc1c815fe80 con 0x7fc1c815bb90 2023-07-06T21:57:33.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 -- 172.21.15.55:0/814983024 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b0003530 con 0x7fc1c815bb90 2023-07-06T21:57:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 -- 172.21.15.55:0/814983024 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3203256473 0 0) 0x7fc1b0003530 con 0x7fc1c815bb90 2023-07-06T21:57:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 -- 172.21.15.55:0/814983024 >> v2:172.21.15.138:3300/0 conn(0x7fc1c8070020 msgr2=0x7fc1c80ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 --2- 172.21.15.55:0/814983024 >> v2:172.21.15.138:3300/0 conn(0x7fc1c8070020 0x7fc1c80ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 -- 172.21.15.55:0/814983024 >> v1:172.21.15.138:6789/0 conn(0x7fc1c80cef40 legacy=0x7fc1c80c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 -- 172.21.15.55:0/814983024 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c80cf440 con 0x7fc1c815bb90 2023-07-06T21:57:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 -- 172.21.15.55:0/814983024 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fc1b8001680 con 0x7fc1c815bb90 2023-07-06T21:57:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 -- 172.21.15.55:0/814983024 >> v1:172.21.15.55:6789/0 conn(0x7fc1c815bb90 legacy=0x7fc1c806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:33.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 --2- 172.21.15.55:0/814983024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b0003980 0x7fc1b0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:33.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 --2- 172.21.15.55:0/814983024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b0004370 0x7fc1b0004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:33.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 --2- 172.21.15.55:0/814983024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1b0005030 0x7fc1b000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:33.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 -- 172.21.15.55:0/814983024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c815f620 con 0x7fc1b0003980 2023-07-06T21:57:33.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 -- 172.21.15.55:0/814983024 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b000bf80 con 0x7fc1b0004370 2023-07-06T21:57:33.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c67fc640 1 -- 172.21.15.55:0/814983024 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b000c140 con 0x7fc1b0005030 2023-07-06T21:57:33.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c6ffd640 1 --2- 172.21.15.55:0/814983024 >> v2:172.21.15.138:3300/0 conn(0x7fc1c8070020 0x7fc1c80ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:33.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c77fe640 1 --2- 172.21.15.55:0/814983024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b0003980 0x7fc1b0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:33.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c7fff640 1 --2- 172.21.15.55:0/814983024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1b0005030 0x7fc1b000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:33.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c6ffd640 1 --2- 172.21.15.55:0/814983024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b0004370 0x7fc1b0004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:33.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c77fe640 1 -- 172.21.15.55:0/814983024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1b0005030 msgr2=0x7fc1b000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:33.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c77fe640 1 --2- 172.21.15.55:0/814983024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1b0005030 0x7fc1b000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c77fe640 1 -- 172.21.15.55:0/814983024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b0004370 msgr2=0x7fc1b0004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:33.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c77fe640 1 --2- 172.21.15.55:0/814983024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b0004370 0x7fc1b0004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c77fe640 1 -- 172.21.15.55:0/814983024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0003530 con 0x7fc1b0003980 2023-07-06T21:57:33.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.100+0000 7fc1c7fff640 1 -- 172.21.15.55:0/814983024 reap_dead start 2023-07-06T21:57:33.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.104+0000 7fc1c77fe640 1 --2- 172.21.15.55:0/814983024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b0003980 0x7fc1b0003d50 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800c210 tx=0x7fc1b801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9024acae7242b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:33.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.104+0000 7fc1c67fc640 1 -- 172.21.15.55:0/814983024 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8005ae0 con 0x7fc1b0003980 2023-07-06T21:57:33.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.104+0000 7fc1c67fc640 1 -- 172.21.15.55:0/814983024 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b8005c60 con 0x7fc1b0003980 2023-07-06T21:57:33.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.104+0000 7fc1c67fc640 1 -- 172.21.15.55:0/814983024 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b80a5a30 con 0x7fc1b0003980 2023-07-06T21:57:33.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.104+0000 7fc1cdb74640 1 -- 172.21.15.55:0/814983024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b0003980 msgr2=0x7fc1b0003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:33.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.104+0000 7fc1cdb74640 1 --2- 172.21.15.55:0/814983024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b0003980 0x7fc1b0003d50 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800c210 tx=0x7fc1b801cc30 comp rx=0 tx=0).stop 2023-07-06T21:57:33.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.104+0000 7fc1cdb74640 1 -- 172.21.15.55:0/814983024 shutdown_connections 2023-07-06T21:57:33.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.104+0000 7fc1cdb74640 1 --2- 172.21.15.55:0/814983024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b0003980 0x7fc1b0003d50 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.104+0000 7fc1cdb74640 1 -- 172.21.15.55:0/814983024 >> 172.21.15.55:0/814983024 conn(0x7fc1c80cbd70 msgr2=0x7fc1c80ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:33.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.104+0000 7fc1cdb74640 1 -- 172.21.15.55:0/814983024 shutdown_connections 2023-07-06T21:57:33.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.104+0000 7fc1cdb74640 1 -- 172.21.15.55:0/814983024 wait complete. 2023-07-06T21:57:33.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1cdb74640 1 Processor -- start 2023-07-06T21:57:33.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1cdb74640 1 -- start start 2023-07-06T21:57:33.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1cdb74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b0003980 0x7fc1c81537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:33.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1cdb74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1c8150ae0 0x7fc1c8151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:33.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1cdb74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1c815e350 0x7fc1c815e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:33.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1cdb74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c814e3e0 con 0x7fc1c8150ae0 2023-07-06T21:57:33.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1cdb74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c815ed00 con 0x7fc1b0003980 2023-07-06T21:57:33.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1cdb74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c81549f0 con 0x7fc1c815e350 2023-07-06T21:57:33.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1c6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1c8150ae0 0x7fc1c8151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:33.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1c6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1c8150ae0 0x7fc1c8151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46648/0 (socket says 172.21.15.55:46648) 2023-07-06T21:57:33.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1c6ffd640 1 -- 172.21.15.55:0/3554033659 learned_addr learned my addr 172.21.15.55:0/3554033659 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:33.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1c7fff640 1 --2- 172.21.15.55:0/3554033659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1c815e350 0x7fc1c815e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:33.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1c77fe640 1 --2- 172.21.15.55:0/3554033659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b0003980 0x7fc1c81537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:33.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1c6ffd640 1 -- 172.21.15.55:0/3554033659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1c815e350 msgr2=0x7fc1c815e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:33.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1c6ffd640 1 --2- 172.21.15.55:0/3554033659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1c815e350 0x7fc1c815e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1c6ffd640 1 -- 172.21.15.55:0/3554033659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b0003980 msgr2=0x7fc1c81537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:33.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1c6ffd640 1 --2- 172.21.15.55:0/3554033659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b0003980 0x7fc1c81537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1c6ffd640 1 -- 172.21.15.55:0/3554033659 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c815f0a0 con 0x7fc1c8150ae0 2023-07-06T21:57:33.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1c6ffd640 1 --2- 172.21.15.55:0/3554033659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1c8150ae0 0x7fc1c8151860 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc011860 tx=0x7fc1bc011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:33.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1affff640 1 -- 172.21.15.55:0/3554033659 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc015870 con 0x7fc1c8150ae0 2023-07-06T21:57:33.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1affff640 1 -- 172.21.15.55:0/3554033659 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc0159d0 con 0x7fc1c8150ae0 2023-07-06T21:57:33.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1affff640 1 -- 172.21.15.55:0/3554033659 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc015d40 con 0x7fc1c8150ae0 2023-07-06T21:57:33.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1cdb74640 1 -- 172.21.15.55:0/3554033659 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c8153de0 con 0x7fc1c8150ae0 2023-07-06T21:57:33.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.108+0000 7fc1cdb74640 1 -- 172.21.15.55:0/3554033659 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c81543a0 con 0x7fc1c8150ae0 2023-07-06T21:57:33.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.112+0000 7fc1cdb74640 1 -- 172.21.15.55:0/3554033659 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c8066d60 con 0x7fc1c8150ae0 2023-07-06T21:57:33.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.112+0000 7fc1affff640 1 -- 172.21.15.55:0/3554033659 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc1bc0143e0 con 0x7fc1c8150ae0 2023-07-06T21:57:33.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.112+0000 7fc1affff640 1 --2- 172.21.15.55:0/3554033659 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fc1b40663d0 0x7fc1b4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:33.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.112+0000 7fc1affff640 1 -- 172.21.15.55:0/3554033659 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc1bc084420 con 0x7fc1c8150ae0 2023-07-06T21:57:33.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.112+0000 7fc1c77fe640 1 --2- 172.21.15.55:0/3554033659 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fc1b40663d0 0x7fc1b4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:33.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.112+0000 7fc1c77fe640 1 --2- 172.21.15.55:0/3554033659 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fc1b40663d0 0x7fc1b4068880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80ab000 tx=0x7fc1b80b1040 comp rx=0 tx=0).ready entity=mgr.6681 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:33.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.116+0000 7fc1affff640 1 -- 172.21.15.55:0/3554033659 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc1bc0516f0 con 0x7fc1c8150ae0 2023-07-06T21:57:33.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.312+0000 7fc1cdb74640 1 -- 172.21.15.55:0/3554033659 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fc1c80b4620 con 0x7fc1c8150ae0 2023-07-06T21:57:33.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.680+0000 7fc1affff640 1 -- 172.21.15.55:0/3554033659 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 30) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fc1bc0840f0 con 0x7fc1c8150ae0 2023-07-06T21:57:33.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.680+0000 7fc1affff640 1 -- 172.21.15.55:0/3554033659 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v30) v1 ==== 92+0+0 (secure 0 0 0) 0x7fc1bc040410 con 0x7fc1c8150ae0 2023-07-06T21:57:33.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.684+0000 7fc1cdb74640 1 -- 172.21.15.55:0/3554033659 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fc1b40663d0 msgr2=0x7fc1b4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:33.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.684+0000 7fc1cdb74640 1 --2- 172.21.15.55:0/3554033659 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fc1b40663d0 0x7fc1b4068880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80ab000 tx=0x7fc1b80b1040 comp rx=0 tx=0).stop 2023-07-06T21:57:33.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.684+0000 7fc1cdb74640 1 -- 172.21.15.55:0/3554033659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1c8150ae0 msgr2=0x7fc1c8151860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:33.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.684+0000 7fc1cdb74640 1 --2- 172.21.15.55:0/3554033659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1c8150ae0 0x7fc1c8151860 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc011860 tx=0x7fc1bc011950 comp rx=0 tx=0).stop 2023-07-06T21:57:33.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.684+0000 7fc1cdb74640 1 -- 172.21.15.55:0/3554033659 shutdown_connections 2023-07-06T21:57:33.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.684+0000 7fc1cdb74640 1 --2- 172.21.15.55:0/3554033659 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7fc1b40663d0 0x7fc1b4068880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.684+0000 7fc1cdb74640 1 --2- 172.21.15.55:0/3554033659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1c815e350 0x7fc1c815e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.684+0000 7fc1cdb74640 1 --2- 172.21.15.55:0/3554033659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1c8150ae0 0x7fc1c8151860 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.684+0000 7fc1cdb74640 1 --2- 172.21.15.55:0/3554033659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b0003980 0x7fc1c81537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.684+0000 7fc1cdb74640 1 -- 172.21.15.55:0/3554033659 >> 172.21.15.55:0/3554033659 conn(0x7fc1c80cbd70 msgr2=0x7fc1c806b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:33.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.684+0000 7fc1cdb74640 1 -- 172.21.15.55:0/3554033659 shutdown_connections 2023-07-06T21:57:33.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.684+0000 7fc1cdb74640 1 -- 172.21.15.55:0/3554033659 wait complete. 2023-07-06T21:57:33.703 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-06T21:57:33.846 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:33.846+0000 7fa7ddd90180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:57:33.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.852+0000 7f6f62acb640 1 Processor -- start 2023-07-06T21:57:33.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.852+0000 7f6f62acb640 1 -- start start 2023-07-06T21:57:33.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f62acb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6f5c0b3870 0x7f6f5c0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:33.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f62acb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5c0d03c0 0x7f6f5c0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:33.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f62acb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c0b4210 con 0x7f6f5c15b850 2023-07-06T21:57:33.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f62acb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c0b2b80 con 0x7f6f5c0b3870 2023-07-06T21:57:33.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f62acb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0cff30 con 0x7f6f5c0d03c0 2023-07-06T21:57:33.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f60867640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6f5c15b850 0x7f6f5c0cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50818/0 (socket says 172.21.15.55:50818) 2023-07-06T21:57:33.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f60867640 1 -- 172.21.15.55:0/2429019157 learned_addr learned my addr 172.21.15.55:0/2429019157 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:33.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f5bfff640 1 --2- 172.21.15.55:0/2429019157 >> v2:172.21.15.138:3300/0 conn(0x7f6f5c0b3870 0x7f6f5c0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:33.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f61068640 1 --2- 172.21.15.55:0/2429019157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5c0d03c0 0x7f6f5c0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:33.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f5b7fe640 1 -- 172.21.15.55:0/2429019157 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131337166 0 0) 0x7f6f5c0b4210 con 0x7f6f5c15b850 2023-07-06T21:57:33.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f5b7fe640 1 -- 172.21.15.55:0/2429019157 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f4c003530 con 0x7f6f5c15b850 2023-07-06T21:57:33.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f5bfff640 1 -- 172.21.15.55:0/2429019157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5c0d03c0 msgr2=0x7f6f5c0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:33.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f5bfff640 1 --2- 172.21.15.55:0/2429019157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5c0d03c0 0x7f6f5c0d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f5bfff640 1 -- 172.21.15.55:0/2429019157 >> v1:172.21.15.55:6789/0 conn(0x7f6f5c15b850 legacy=0x7f6f5c0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:33.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f5bfff640 1 -- 172.21.15.55:0/2429019157 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0b22e0 con 0x7f6f5c0b3870 2023-07-06T21:57:33.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.856+0000 7f6f61068640 1 --2- 172.21.15.55:0/2429019157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5c0d03c0 0x7f6f5c0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:33.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f6f5bfff640 1 --2- 172.21.15.55:0/2429019157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c0b3870 0x7f6f5c0b3cd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6f480097c0 tx=0x7f6f4801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e2d47b644cb39fd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:33.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f6f5b7fe640 1 -- 172.21.15.55:0/2429019157 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480ab600 con 0x7f6f5c0b3870 2023-07-06T21:57:33.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f6f5b7fe640 1 -- 172.21.15.55:0/2429019157 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f480a7050 con 0x7f6f5c0b3870 2023-07-06T21:57:33.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f6f5b7fe640 1 -- 172.21.15.55:0/2429019157 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480ab980 con 0x7f6f5c0b3870 2023-07-06T21:57:33.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f6f62acb640 1 -- 172.21.15.55:0/2429019157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c0b3870 msgr2=0x7f6f5c0b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:33.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f6f62acb640 1 --2- 172.21.15.55:0/2429019157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c0b3870 0x7f6f5c0b3cd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6f480097c0 tx=0x7f6f4801c330 comp rx=0 tx=0).stop 2023-07-06T21:57:33.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f6f62acb640 1 -- 172.21.15.55:0/2429019157 shutdown_connections 2023-07-06T21:57:33.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f6f62acb640 1 --2- 172.21.15.55:0/2429019157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5c0d03c0 0x7f6f5c0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f6f62acb640 1 --2- 172.21.15.55:0/2429019157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c0b3870 0x7f6f5c0b3cd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f6f62acb640 1 -- 172.21.15.55:0/2429019157 >> 172.21.15.55:0/2429019157 conn(0x7f6f5c0cec20 msgr2=0x7f6f5c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:33.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f6f62acb640 1 -- 172.21.15.55:0/2429019157 shutdown_connections 2023-07-06T21:57:33.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f6f62acb640 1 -- 172.21.15.55:0/2429019157 wait complete. 2023-07-06T21:57:33.860 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f5b711a4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:57:33.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f6f62acb640 1 Processor -- start 2023-07-06T21:57:33.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.860+0000 7f6f62acb640 1 -- start start 2023-07-06T21:57:33.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f62acb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c0b3870 0x7f6f5c0b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:33.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f62acb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5c0d03c0 0x7f6f5c150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:33.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f62acb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f5c15b850 0x7f6f5c1f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:33.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f62acb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c150750 con 0x7f6f5c15b850 2023-07-06T21:57:33.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f62acb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0b6bd0 con 0x7f6f5c0b3870 2023-07-06T21:57:33.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f62acb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0b6eb0 con 0x7f6f5c0d03c0 2023-07-06T21:57:33.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f61068640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f5c15b850 0x7f6f5c1f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:33.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f60867640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c0b3870 0x7f6f5c0b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:33.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f60867640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c0b3870 0x7f6f5c0b6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:42222/0 (socket says 172.21.15.55:42222) 2023-07-06T21:57:33.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f61068640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f5c15b850 0x7f6f5c1f4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45544/0 (socket says 172.21.15.55:45544) 2023-07-06T21:57:33.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f60867640 1 -- 172.21.15.55:0/3627931620 learned_addr learned my addr 172.21.15.55:0/3627931620 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:33.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f5bfff640 1 --2- 172.21.15.55:0/3627931620 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5c0d03c0 0x7f6f5c150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:33.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f60867640 1 -- 172.21.15.55:0/3627931620 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5c0d03c0 msgr2=0x7f6f5c150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:33.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f60867640 1 --2- 172.21.15.55:0/3627931620 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5c0d03c0 0x7f6f5c150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f60867640 1 -- 172.21.15.55:0/3627931620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f5c15b850 msgr2=0x7f6f5c1f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:33.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f60867640 1 --2- 172.21.15.55:0/3627931620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f5c15b850 0x7f6f5c1f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:33.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f60867640 1 -- 172.21.15.55:0/3627931620 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f54009a70 con 0x7f6f5c0b3870 2023-07-06T21:57:33.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f61068640 1 --2- 172.21.15.55:0/3627931620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f5c15b850 0x7f6f5c1f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:33.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f60867640 1 --2- 172.21.15.55:0/3627931620 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c0b3870 0x7f6f5c0b6560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000c4d0 tx=0x7f6f5000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:33.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f597fa640 1 -- 172.21.15.55:0/3627931620 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50005cf0 con 0x7f6f5c0b3870 2023-07-06T21:57:33.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f597fa640 1 -- 172.21.15.55:0/3627931620 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f50005e50 con 0x7f6f5c0b3870 2023-07-06T21:57:33.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f62acb640 1 -- 172.21.15.55:0/3627931620 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f48009420 con 0x7f6f5c0b3870 2023-07-06T21:57:33.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f597fa640 1 -- 172.21.15.55:0/3627931620 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f500072d0 con 0x7f6f5c0b3870 2023-07-06T21:57:33.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f62acb640 1 -- 172.21.15.55:0/3627931620 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c0b7470 con 0x7f6f5c0b3870 2023-07-06T21:57:33.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.864+0000 7f6f62acb640 1 -- 172.21.15.55:0/3627931620 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c066d60 con 0x7f6f5c0b3870 2023-07-06T21:57:33.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.868+0000 7f6f597fa640 1 -- 172.21.15.55:0/3627931620 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 30) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f6f50007430 con 0x7f6f5c0b3870 2023-07-06T21:57:33.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.868+0000 7f6f597fa640 1 --2- 172.21.15.55:0/3627931620 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6f400663f0 0x7f6f400688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:33.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.868+0000 7f6f597fa640 1 -- 172.21.15.55:0/3627931620 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6f50083570 con 0x7f6f5c0b3870 2023-07-06T21:57:33.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.868+0000 7f6f5bfff640 1 -- 172.21.15.55:0/3627931620 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6f400663f0 msgr2=0x7f6f400688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3540074910 2023-07-06T21:57:33.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.868+0000 7f6f5bfff640 1 --2- 172.21.15.55:0/3627931620 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6f400663f0 0x7f6f400688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:33.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:33.872+0000 7f6f597fa640 1 -- 172.21.15.55:0/3627931620 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f50050840 con 0x7f6f5c0b3870 2023-07-06T21:57:34.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.032+0000 7f6f62acb640 1 -- 172.21.15.55:0/3627931620 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f6f5c0b3420 con 0x7f6f5c0b3870 2023-07-06T21:57:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.036+0000 7f6f597fa640 1 -- 172.21.15.55:0/3627931620 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6f50053e60 con 0x7f6f5c0b3870 2023-07-06T21:57:34.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.040+0000 7f6f62acb640 1 -- 172.21.15.55:0/3627931620 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6f400663f0 msgr2=0x7f6f400688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:34.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.040+0000 7f6f62acb640 1 --2- 172.21.15.55:0/3627931620 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6f400663f0 0x7f6f400688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.040+0000 7f6f62acb640 1 -- 172.21.15.55:0/3627931620 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c0b3870 msgr2=0x7f6f5c0b6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:34.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.040+0000 7f6f62acb640 1 --2- 172.21.15.55:0/3627931620 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c0b3870 0x7f6f5c0b6560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000c4d0 tx=0x7f6f5000c8d0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.040+0000 7f6f62acb640 1 -- 172.21.15.55:0/3627931620 shutdown_connections 2023-07-06T21:57:34.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.040+0000 7f6f62acb640 1 --2- 172.21.15.55:0/3627931620 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f6f400663f0 0x7f6f400688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.040+0000 7f6f62acb640 1 --2- 172.21.15.55:0/3627931620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f5c15b850 0x7f6f5c1f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.040+0000 7f6f62acb640 1 --2- 172.21.15.55:0/3627931620 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f5c0d03c0 0x7f6f5c150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.040+0000 7f6f62acb640 1 --2- 172.21.15.55:0/3627931620 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c0b3870 0x7f6f5c0b6560 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.040+0000 7f6f62acb640 1 -- 172.21.15.55:0/3627931620 >> 172.21.15.55:0/3627931620 conn(0x7f6f5c0cec20 msgr2=0x7f6f5c0cc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:34.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.040+0000 7f6f62acb640 1 -- 172.21.15.55:0/3627931620 shutdown_connections 2023-07-06T21:57:34.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.040+0000 7f6f62acb640 1 -- 172.21.15.55:0/3627931620 wait complete. 2023-07-06T21:57:34.059 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-06T21:57:34.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.208+0000 7f32e49a3640 1 Processor -- start 2023-07-06T21:57:34.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.208+0000 7f32e49a3640 1 -- start start 2023-07-06T21:57:34.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.208+0000 7f32e49a3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f32e00b3870 0x7f32e00b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:34.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.208+0000 7f32e49a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f32e00d03c0 0x7f32e00d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:34.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.208+0000 7f32e49a3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e00b4210 con 0x7f32e015b850 2023-07-06T21:57:34.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.208+0000 7f32e49a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e00b2b80 con 0x7f32e00d03c0 2023-07-06T21:57:34.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.208+0000 7f32e49a3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e00cff30 con 0x7f32e00b3870 2023-07-06T21:57:34.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.208+0000 7f32ded9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f32e00d03c0 0x7f32e00d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:34.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.208+0000 7f32ded9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f32e00d03c0 0x7f32e00d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45556/0 (socket says 172.21.15.55:45556) 2023-07-06T21:57:34.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.208+0000 7f32ded9d640 1 -- 172.21.15.55:0/2152671430 learned_addr learned my addr 172.21.15.55:0/2152671430 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:34.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.208+0000 7f32d7fff640 1 --2- 172.21.15.55:0/2152671430 >> v2:172.21.15.138:3300/0 conn(0x7f32e00b3870 0x7f32e00b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:34.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.212+0000 7f32ded9d640 1 -- 172.21.15.55:0/2152671430 >> v2:172.21.15.138:3300/0 conn(0x7f32e00b3870 msgr2=0x7f32e00b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:34.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.212+0000 7f32ded9d640 1 --2- 172.21.15.55:0/2152671430 >> v2:172.21.15.138:3300/0 conn(0x7f32e00b3870 0x7f32e00b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.212+0000 7f32ded9d640 1 -- 172.21.15.55:0/2152671430 >> v1:172.21.15.138:6789/0 conn(0x7f32e015b850 legacy=0x7f32e00cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:34.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.212+0000 7f32ded9d640 1 -- 172.21.15.55:0/2152671430 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e00b22e0 con 0x7f32e00d03c0 2023-07-06T21:57:34.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.212+0000 7f32ded9d640 1 --2- 172.21.15.55:0/2152671430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32e00d03c0 0x7f32e00d07c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f32e00cebd0 tx=0x7f32d801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b56a2529c1c7739 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:34.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.212+0000 7f32ddd9b640 1 -- 172.21.15.55:0/2152671430 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d80a5740 con 0x7f32e00d03c0 2023-07-06T21:57:34.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.212+0000 7f32ddd9b640 1 -- 172.21.15.55:0/2152671430 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d80a58a0 con 0x7f32e00d03c0 2023-07-06T21:57:34.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.212+0000 7f32ddd9b640 1 -- 172.21.15.55:0/2152671430 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d80a5c30 con 0x7f32e00d03c0 2023-07-06T21:57:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.212+0000 7f32e49a3640 1 -- 172.21.15.55:0/2152671430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32e00d03c0 msgr2=0x7f32e00d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.212+0000 7f32e49a3640 1 --2- 172.21.15.55:0/2152671430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32e00d03c0 0x7f32e00d07c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f32e00cebd0 tx=0x7f32d801c880 comp rx=0 tx=0).stop 2023-07-06T21:57:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32e49a3640 1 -- 172.21.15.55:0/2152671430 shutdown_connections 2023-07-06T21:57:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32e49a3640 1 --2- 172.21.15.55:0/2152671430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32e00d03c0 0x7f32e00d07c0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32e49a3640 1 --2- 172.21.15.55:0/2152671430 >> v2:172.21.15.138:3300/0 conn(0x7f32e00b3870 0x7f32e00b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32e49a3640 1 -- 172.21.15.55:0/2152671430 >> 172.21.15.55:0/2152671430 conn(0x7f32e00cec20 msgr2=0x7f32e00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:34.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32e49a3640 1 -- 172.21.15.55:0/2152671430 shutdown_connections 2023-07-06T21:57:34.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32e49a3640 1 -- 172.21.15.55:0/2152671430 wait complete. 2023-07-06T21:57:34.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32e49a3640 1 Processor -- start 2023-07-06T21:57:34.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32e49a3640 1 -- start start 2023-07-06T21:57:34.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32e49a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32e00b3870 0x7f32e01532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:34.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32e49a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32e00d03c0 0x7f32e015a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:34.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32e49a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32e015b850 0x7f32e0069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:34.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32e49a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00c8840 con 0x7f32e00b3870 2023-07-06T21:57:34.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32e49a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e0159510 con 0x7f32e015b850 2023-07-06T21:57:34.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32e49a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e0159760 con 0x7f32e00d03c0 2023-07-06T21:57:34.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32de59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32e00b3870 0x7f32e01532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:34.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32de59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32e00b3870 0x7f32e01532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45560/0 (socket says 172.21.15.55:45560) 2023-07-06T21:57:34.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32de59c640 1 -- 172.21.15.55:0/1957562307 learned_addr learned my addr 172.21.15.55:0/1957562307 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:34.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32d7fff640 1 --2- 172.21.15.55:0/1957562307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32e00d03c0 0x7f32e015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:34.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32ded9d640 1 --2- 172.21.15.55:0/1957562307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32e015b850 0x7f32e0069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:34.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32de59c640 1 -- 172.21.15.55:0/1957562307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32e00d03c0 msgr2=0x7f32e015a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:34.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32de59c640 1 --2- 172.21.15.55:0/1957562307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32e00d03c0 0x7f32e015a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32de59c640 1 -- 172.21.15.55:0/1957562307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32e015b850 msgr2=0x7f32e0069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:34.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32de59c640 1 --2- 172.21.15.55:0/1957562307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32e015b850 0x7f32e0069fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32de59c640 1 -- 172.21.15.55:0/1957562307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d8009b30 con 0x7f32e00b3870 2023-07-06T21:57:34.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.216+0000 7f32ded9d640 1 --2- 172.21.15.55:0/1957562307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32e015b850 0x7f32e0069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:34.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.220+0000 7f32de59c640 1 --2- 172.21.15.55:0/1957562307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32e00b3870 0x7f32e01532b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f32d000c3c0 tx=0x7f32d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:34.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.220+0000 7f32d6ffd640 1 -- 172.21.15.55:0/1957562307 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d00052d0 con 0x7f32e00b3870 2023-07-06T21:57:34.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.220+0000 7f32d6ffd640 1 -- 172.21.15.55:0/1957562307 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d0005430 con 0x7f32e00b3870 2023-07-06T21:57:34.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.220+0000 7f32e49a3640 1 -- 172.21.15.55:0/1957562307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e0159a40 con 0x7f32e00b3870 2023-07-06T21:57:34.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.220+0000 7f32d6ffd640 1 -- 172.21.15.55:0/1957562307 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0003840 con 0x7f32e00b3870 2023-07-06T21:57:34.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.220+0000 7f32e49a3640 1 -- 172.21.15.55:0/1957562307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e015a2e0 con 0x7f32e00b3870 2023-07-06T21:57:34.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.220+0000 7f32e49a3640 1 -- 172.21.15.55:0/1957562307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e0159e30 con 0x7f32e00b3870 2023-07-06T21:57:34.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.220+0000 7f32d6ffd640 1 -- 172.21.15.55:0/1957562307 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f32d00039a0 con 0x7f32e00b3870 2023-07-06T21:57:34.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.220+0000 7f32d6ffd640 1 --2- 172.21.15.55:0/1957562307 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f32c00663f0 0x7f32c00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:34.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.220+0000 7f32d6ffd640 1 -- 172.21.15.55:0/1957562307 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f32d0083580 con 0x7f32e00b3870 2023-07-06T21:57:34.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.220+0000 7f32d7fff640 1 -- 172.21.15.55:0/1957562307 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f32c00663f0 msgr2=0x7f32c00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3540074910 2023-07-06T21:57:34.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.220+0000 7f32d7fff640 1 --2- 172.21.15.55:0/1957562307 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f32c00663f0 0x7f32c00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:34.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.224+0000 7f32d6ffd640 1 -- 172.21.15.55:0/1957562307 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f32d00507c0 con 0x7f32e00b3870 2023-07-06T21:57:34.262 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:34.262+0000 7fa7ddd90180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:57:34.308 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:34.308+0000 7f5b711a4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:57:34.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.384+0000 7f32e49a3640 1 -- 172.21.15.55:0/1957562307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f32e0066d60 con 0x7f32e00b3870 2023-07-06T21:57:34.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.392+0000 7f32d6ffd640 1 -- 172.21.15.55:0/1957562307 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f32d0053de0 con 0x7f32e00b3870 2023-07-06T21:57:34.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.392+0000 7f32e49a3640 1 -- 172.21.15.55:0/1957562307 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f32c00663f0 msgr2=0x7f32c00688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:34.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.392+0000 7f32e49a3640 1 --2- 172.21.15.55:0/1957562307 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f32c00663f0 0x7f32c00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.396+0000 7f32e49a3640 1 -- 172.21.15.55:0/1957562307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32e00b3870 msgr2=0x7f32e01532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:34.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.396+0000 7f32e49a3640 1 --2- 172.21.15.55:0/1957562307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32e00b3870 0x7f32e01532b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f32d000c3c0 tx=0x7f32d000c880 comp rx=0 tx=0).stop 2023-07-06T21:57:34.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.396+0000 7f32e49a3640 1 -- 172.21.15.55:0/1957562307 shutdown_connections 2023-07-06T21:57:34.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.396+0000 7f32e49a3640 1 --2- 172.21.15.55:0/1957562307 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f32c00663f0 0x7f32c00688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.396+0000 7f32e49a3640 1 --2- 172.21.15.55:0/1957562307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32e015b850 0x7f32e0069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.396+0000 7f32e49a3640 1 --2- 172.21.15.55:0/1957562307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32e00d03c0 0x7f32e015a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.396+0000 7f32e49a3640 1 --2- 172.21.15.55:0/1957562307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32e00b3870 0x7f32e01532b0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.396+0000 7f32e49a3640 1 -- 172.21.15.55:0/1957562307 >> 172.21.15.55:0/1957562307 conn(0x7f32e00cec20 msgr2=0x7f32e01579d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:34.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.396+0000 7f32e49a3640 1 -- 172.21.15.55:0/1957562307 shutdown_connections 2023-07-06T21:57:34.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.396+0000 7f32e49a3640 1 -- 172.21.15.55:0/1957562307 wait complete. 2023-07-06T21:57:34.411 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:34.410+0000 7fa7ddd90180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:57:34.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:34.412 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-06T21:57:34.428 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-06T21:57:34.471 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:34.472+0000 7f5b711a4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:57:34.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2ae1137640 1 Processor -- start 2023-07-06T21:57:34.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2ae1137640 1 -- start start 2023-07-06T21:57:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2ae1137640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2adc0b3c90 0x7f2adc0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2ae1137640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2adc0b18a0 0x7f2adc0b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2ae1137640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc0ccd50 con 0x7f2adc0d1d30 2023-07-06T21:57:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2ae1137640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc0cd0a0 con 0x7f2adc0b18a0 2023-07-06T21:57:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2ae1137640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc069ea0 con 0x7f2adc0b3c90 2023-07-06T21:57:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2ad3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2adc0b18a0 0x7f2adc0b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2ad3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2adc0b18a0 0x7f2adc0b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45564/0 (socket says 172.21.15.55:45564) 2023-07-06T21:57:34.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2ad3fff640 1 -- 172.21.15.55:0/867802499 learned_addr learned my addr 172.21.15.55:0/867802499 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:34.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2adad9d640 1 --2- 172.21.15.55:0/867802499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2adc0b3c90 0x7f2adc0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:34.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2ad3fff640 1 -- 172.21.15.55:0/867802499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2adc0b3c90 msgr2=0x7f2adc0ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:34.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2ad3fff640 1 --2- 172.21.15.55:0/867802499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2adc0b3c90 0x7f2adc0ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2ad3fff640 1 -- 172.21.15.55:0/867802499 >> v1:172.21.15.55:6789/0 conn(0x7f2adc0d1d30 legacy=0x7f2adc15f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:34.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.620+0000 7f2ad3fff640 1 -- 172.21.15.55:0/867802499 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc0b45a0 con 0x7f2adc0b18a0 2023-07-06T21:57:34.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.624+0000 7f2ad3fff640 1 --2- 172.21.15.55:0/867802499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2adc0b18a0 0x7f2adc0b4060 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009870 tx=0x7f2ac401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8d561cc7ee7b9f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:34.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.624+0000 7f2ada59c640 1 -- 172.21.15.55:0/867802499 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40aa670 con 0x7f2adc0b18a0 2023-07-06T21:57:34.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.624+0000 7f2ada59c640 1 -- 172.21.15.55:0/867802499 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac40aa7d0 con 0x7f2adc0b18a0 2023-07-06T21:57:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.624+0000 7f2ada59c640 1 -- 172.21.15.55:0/867802499 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40aab60 con 0x7f2adc0b18a0 2023-07-06T21:57:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.624+0000 7f2ae1137640 1 -- 172.21.15.55:0/867802499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2adc0b18a0 msgr2=0x7f2adc0b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.624+0000 7f2ae1137640 1 --2- 172.21.15.55:0/867802499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2adc0b18a0 0x7f2adc0b4060 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009870 tx=0x7f2ac401c510 comp rx=0 tx=0).stop 2023-07-06T21:57:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.624+0000 7f2ae1137640 1 -- 172.21.15.55:0/867802499 shutdown_connections 2023-07-06T21:57:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.624+0000 7f2ae1137640 1 --2- 172.21.15.55:0/867802499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2adc0b18a0 0x7f2adc0b4060 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.624+0000 7f2ae1137640 1 --2- 172.21.15.55:0/867802499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2adc0b3c90 0x7f2adc0ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.624+0000 7f2ae1137640 1 -- 172.21.15.55:0/867802499 >> 172.21.15.55:0/867802499 conn(0x7f2adc06bf40 msgr2=0x7f2adc0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.624+0000 7f2ae1137640 1 -- 172.21.15.55:0/867802499 shutdown_connections 2023-07-06T21:57:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.624+0000 7f2ae1137640 1 -- 172.21.15.55:0/867802499 wait complete. 2023-07-06T21:57:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2ae1137640 1 Processor -- start 2023-07-06T21:57:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2ae1137640 1 -- start start 2023-07-06T21:57:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2ae1137640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2adc0b18a0 0x7f2adc15a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2ae1137640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2adc0b3c90 0x7f2adc0c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2ae1137640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2adc0d1d30 0x7f2adc0c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2ae1137640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc15b440 con 0x7f2adc0d1d30 2023-07-06T21:57:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2ae1137640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0cc6a0 con 0x7f2adc0b3c90 2023-07-06T21:57:34.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2ae1137640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc15ada0 con 0x7f2adc0b18a0 2023-07-06T21:57:34.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2adb59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2adc0d1d30 0x7f2adc0c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:34.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2adb59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2adc0d1d30 0x7f2adc0c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45566/0 (socket says 172.21.15.55:45566) 2023-07-06T21:57:34.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2adb59e640 1 -- 172.21.15.55:0/4290535325 learned_addr learned my addr 172.21.15.55:0/4290535325 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:34.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2adad9d640 1 --2- 172.21.15.55:0/4290535325 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2adc0b18a0 0x7f2adc15a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:34.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2ad3fff640 1 --2- 172.21.15.55:0/4290535325 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2adc0b3c90 0x7f2adc0c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:34.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2adad9d640 1 -- 172.21.15.55:0/4290535325 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2adc0b3c90 msgr2=0x7f2adc0c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:34.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2adad9d640 1 --2- 172.21.15.55:0/4290535325 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2adc0b3c90 0x7f2adc0c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2adad9d640 1 -- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2adc0d1d30 msgr2=0x7f2adc0c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:34.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2adad9d640 1 --2- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2adc0d1d30 0x7f2adc0c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:34.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2adad9d640 1 -- 172.21.15.55:0/4290535325 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac40094d0 con 0x7f2adc0b18a0 2023-07-06T21:57:34.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.628+0000 7f2adad9d640 1 --2- 172.21.15.55:0/4290535325 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2adc0b18a0 0x7f2adc15a080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00e870 tx=0x7f2acc00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:34.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.632+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4290535325 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0095d0 con 0x7f2adc0b18a0 2023-07-06T21:57:34.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.632+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4290535325 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc00c940 con 0x7f2adc0b18a0 2023-07-06T21:57:34.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.632+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4290535325 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00ccb0 con 0x7f2adc0b18a0 2023-07-06T21:57:34.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.632+0000 7f2ae1137640 1 -- 172.21.15.55:0/4290535325 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc0c9ff0 con 0x7f2adc0b18a0 2023-07-06T21:57:34.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.632+0000 7f2ae1137640 1 -- 172.21.15.55:0/4290535325 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc15b060 con 0x7f2adc0b18a0 2023-07-06T21:57:34.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.632+0000 7f2ae1137640 1 -- 172.21.15.55:0/4290535325 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2adc066d60 con 0x7f2adc0b18a0 2023-07-06T21:57:34.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.632+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4290535325 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 30) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f2acc013470 con 0x7f2adc0b18a0 2023-07-06T21:57:34.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.632+0000 7f2ad37fe640 1 --2- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2abc0663f0 0x7f2abc0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:34.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.632+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4290535325 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2acc084110 con 0x7f2adc0b18a0 2023-07-06T21:57:34.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.632+0000 7f2ad3fff640 1 -- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2abc0663f0 msgr2=0x7f2abc0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3540074910 2023-07-06T21:57:34.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.632+0000 7f2ad3fff640 1 --2- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2abc0663f0 0x7f2abc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:34.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.640+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4290535325 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2acc0513e0 con 0x7f2adc0b18a0 2023-07-06T21:57:34.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.816+0000 7f2ae1137640 1 -- 172.21.15.55:0/4290535325 --> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2adc168880 con 0x7f2abc0663f0 2023-07-06T21:57:34.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.836+0000 7f2ad3fff640 1 -- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2abc0663f0 msgr2=0x7f2abc0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3540074910 2023-07-06T21:57:34.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:34.836+0000 7f2ad3fff640 1 --2- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2abc0663f0 0x7f2abc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-06T21:57:34.892 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:34.890+0000 7fa7ddd90180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:57:34.951 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:34.950+0000 7fa7ddd90180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:57:34.982 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:34.984+0000 7f5b711a4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:57:35.005 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:35.006+0000 7fa7ddd90180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:57:35.044 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:35.044+0000 7f5b711a4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:57:35.091 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:35.090+0000 7fa7ddd90180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:57:35.102 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:35.104+0000 7f5b711a4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:57:35.149 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:35.146+0000 7fa7ddd90180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:57:35.193 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:35.196+0000 7f5b711a4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:57:35.232 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:35.230+0000 7fa7ddd90180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:57:35.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:35.240+0000 7f2ad3fff640 1 -- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2abc0663f0 msgr2=0x7f2abc0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3540074910 2023-07-06T21:57:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:35.240+0000 7f2ad3fff640 1 --2- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2abc0663f0 0x7f2abc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-06T21:57:35.252 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:35.256+0000 7f5b711a4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:57:35.288 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:35.286+0000 7fa7ddd90180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:57:35.341 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:35.344+0000 7f5b711a4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:57:35.400 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:35.400+0000 7f5b711a4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:57:35.428 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:35.426+0000 7fa7ddd90180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:57:35.485 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:35.486+0000 7fa7ddd90180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:57:35.549 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:35.552+0000 7f5b711a4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:57:35.610 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:35.612+0000 7f5b711a4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:57:35.723 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:57:35.723 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:57:35.723 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:57:35.731 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:35.730+0000 7fa7ddd90180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:57:35.861 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:57:35.861 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:57:35.861 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:57:35.863 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:35.862+0000 7fa7ddd90180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:57:35.869 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:35.872+0000 7f5b711a4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:57:35.987 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:35.986+0000 7fa7ddd90180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:57:36.009 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:36.012+0000 7f5b711a4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:57:36.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:36.044+0000 7f2ad3fff640 1 -- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2abc0663f0 msgr2=0x7f2abc0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3540074910 2023-07-06T21:57:36.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:36.044+0000 7f2ad3fff640 1 --2- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2abc0663f0 0x7f2abc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-06T21:57:36.056 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:36.054+0000 7fa7ddd90180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:57:36.141 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:36.144+0000 7f5b711a4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:57:36.190 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:36.190+0000 7fa7ddd90180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:57:36.215 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:36.216+0000 7f5b711a4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:57:36.356 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:36.356+0000 7f5b711a4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:57:36.721 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:36.722+0000 7fa7ddd90180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:57:36.807 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:36.806+0000 7fa7ddd90180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:57:36.921 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:36.924+0000 7f5b711a4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:57:36.952 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:36.950+0000 7fa7ddd90180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:57:37.009 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.012+0000 7f5b711a4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:57:37.035 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:37.034+0000 7fa7ddd90180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:57:37.108 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:57:37.112 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:57:37.165 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.168+0000 7f5b711a4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:57:37.253 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.256+0000 7f5b711a4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:57:37.304 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:37.302+0000 7fa7ddd90180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:57:37.364 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:37.362+0000 7fa7ddd90180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:57:37.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:37.428+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4290535325 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mgrmap(e 31) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f2acc0517b0 con 0x7f2adc0b18a0 2023-07-06T21:57:37.541 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.544+0000 7f5b711a4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:57:37.605 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.608+0000 7f5b711a4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:57:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:37.620+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4290535325 <== mon.2 v2:172.21.15.138:3301/0 8 ==== mgrmap(e 32) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f2acc0822f0 con 0x7f2adc0b18a0 2023-07-06T21:57:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:37.624+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2abc0663f0 msgr2=0x7f2abc0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:37.624+0000 7f2ad37fe640 1 --2- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:6832/3540074910,v1:172.21.15.55:6833/3540074910] conn(0x7f2abc0663f0 0x7f2abc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:37.745 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.748+0000 7f5aefb04640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:37.746 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.748+0000 7f5aefb04640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:37.746 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.748+0000 7f5aefb04640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:37.746 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.748+0000 7f5aefb04640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:37.746 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.748+0000 7f5aefb04640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:37.747 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.748+0000 7f5af330b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:37.747 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.748+0000 7f5af330b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:37.747 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.748+0000 7f5af330b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:37.747 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.748+0000 7f5af330b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:37.748 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:37.748+0000 7f5af330b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:38.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.628+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4290535325 <== mon.2 v2:172.21.15.138:3301/0 9 ==== mgrmap(e 33) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f2acc07c0a0 con 0x7f2adc0b18a0 2023-07-06T21:57:38.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.628+0000 7f2ad37fe640 1 --2- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f2abc06ee40 0x7f2abc071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:38.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.628+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4290535325 --> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2abc034290 con 0x7f2abc06ee40 2023-07-06T21:57:38.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.632+0000 7f2ad3fff640 1 --2- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f2abc06ee40 0x7f2abc071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:38.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.636+0000 7f2ad3fff640 1 --2- 172.21.15.55:0/4290535325 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f2abc06ee40 0x7f2abc071220 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2ac40ae000 tx=0x7f2ac40a7000 comp rx=0 tx=0).ready entity=mgr.6194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:38.642 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:38.644+0000 7f5afa319640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-06T21:57:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.644+0000 7f2ad37fe640 1 -- 172.21.15.55:0/4290535325 <== mgr.6194 v2:172.21.15.55:6832/1694297670 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f2abc034290 con 0x7f2abc06ee40 2023-07-06T21:57:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-06T21:57:38.651 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-06T21:57:38.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:38.652 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-06T21:57:38.707 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-06T21:57:38.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb81ed03640 1 Processor -- start 2023-07-06T21:57:38.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb81ed03640 1 -- start start 2023-07-06T21:57:38.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb81ed03640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8180d1c40 0x7fb8180b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:38.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb81ed03640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb8180b4130 0x7fb8180b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:38.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb81ed03640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8180b5070 con 0x7fb8180b7b90 2023-07-06T21:57:38.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb81ed03640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8180b45b0 con 0x7fb8180b4130 2023-07-06T21:57:38.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb81ed03640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb818160020 con 0x7fb8180d1c40 2023-07-06T21:57:38.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb81ca9f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb8180b7b90 0x7fb8180cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50832/0 (socket says 172.21.15.55:50832) 2023-07-06T21:57:38.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb81ca9f640 1 -- 172.21.15.55:0/551399427 learned_addr learned my addr 172.21.15.55:0/551399427 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:38.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb817fff640 1 --2- 172.21.15.55:0/551399427 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8180d1c40 0x7fb8180b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:38.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb81d2a0640 1 --2- 172.21.15.55:0/551399427 >> v2:172.21.15.138:3300/0 conn(0x7fb8180b4130 0x7fb8180b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:38.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb8177fe640 1 -- 172.21.15.55:0/551399427 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538012717 0 0) 0x7fb8180b5070 con 0x7fb8180b7b90 2023-07-06T21:57:38.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb8177fe640 1 -- 172.21.15.55:0/551399427 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb808003530 con 0x7fb8180b7b90 2023-07-06T21:57:38.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb817fff640 1 -- 172.21.15.55:0/551399427 >> v2:172.21.15.138:3300/0 conn(0x7fb8180b4130 msgr2=0x7fb8180b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:38.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb817fff640 1 --2- 172.21.15.55:0/551399427 >> v2:172.21.15.138:3300/0 conn(0x7fb8180b4130 0x7fb8180b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:38.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.896+0000 7fb817fff640 1 -- 172.21.15.55:0/551399427 >> v1:172.21.15.55:6789/0 conn(0x7fb8180b7b90 legacy=0x7fb8180cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:38.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.900+0000 7fb817fff640 1 -- 172.21.15.55:0/551399427 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8180d2090 con 0x7fb8180d1c40 2023-07-06T21:57:38.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.900+0000 7fb817fff640 1 --2- 172.21.15.55:0/551399427 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8180d1c40 0x7fb8180b3bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb8040097c0 tx=0x7fb80401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f724e2335073315 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:38.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.900+0000 7fb8177fe640 1 -- 172.21.15.55:0/551399427 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8040ab600 con 0x7fb8180d1c40 2023-07-06T21:57:38.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.900+0000 7fb8177fe640 1 -- 172.21.15.55:0/551399427 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8040a7050 con 0x7fb8180d1c40 2023-07-06T21:57:38.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.900+0000 7fb8177fe640 1 -- 172.21.15.55:0/551399427 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8040ab980 con 0x7fb8180d1c40 2023-07-06T21:57:38.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.900+0000 7fb81ed03640 1 -- 172.21.15.55:0/551399427 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8180d1c40 msgr2=0x7fb8180b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:38.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.900+0000 7fb81ed03640 1 --2- 172.21.15.55:0/551399427 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8180d1c40 0x7fb8180b3bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb8040097c0 tx=0x7fb80401c480 comp rx=0 tx=0).stop 2023-07-06T21:57:38.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.900+0000 7fb81ed03640 1 -- 172.21.15.55:0/551399427 shutdown_connections 2023-07-06T21:57:38.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.900+0000 7fb81ed03640 1 --2- 172.21.15.55:0/551399427 >> v2:172.21.15.138:3300/0 conn(0x7fb8180b4130 0x7fb8180b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:38.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81ed03640 1 --2- 172.21.15.55:0/551399427 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8180d1c40 0x7fb8180b3bf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:38.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81ed03640 1 -- 172.21.15.55:0/551399427 >> 172.21.15.55:0/551399427 conn(0x7fb8180ceca0 msgr2=0x7fb8180cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:38.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81ed03640 1 -- 172.21.15.55:0/551399427 shutdown_connections 2023-07-06T21:57:38.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81ed03640 1 -- 172.21.15.55:0/551399427 wait complete. 2023-07-06T21:57:38.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81ed03640 1 Processor -- start 2023-07-06T21:57:38.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81ed03640 1 -- start start 2023-07-06T21:57:38.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81ed03640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8180b4130 0x7fb81814f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:38.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81ed03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8180b7b90 0x7fb8180d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:38.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81ed03640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8180d1c40 0x7fb818157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81ed03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180ca930 con 0x7fb8180b7b90 2023-07-06T21:57:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81ed03640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180cac10 con 0x7fb8180b4130 2023-07-06T21:57:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81ed03640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180caef0 con 0x7fb8180d1c40 2023-07-06T21:57:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb817fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8180b7b90 0x7fb8180d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb817fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8180b7b90 0x7fb8180d0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45704/0 (socket says 172.21.15.55:45704) 2023-07-06T21:57:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb817fff640 1 -- 172.21.15.55:0/397888055 learned_addr learned my addr 172.21.15.55:0/397888055 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:38.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81ca9f640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8180b4130 0x7fb81814f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:38.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81d2a0640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8180d1c40 0x7fb818157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:38.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb817fff640 1 -- 172.21.15.55:0/397888055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8180d1c40 msgr2=0x7fb818157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:38.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb817fff640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8180d1c40 0x7fb818157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:38.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb817fff640 1 -- 172.21.15.55:0/397888055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8180b4130 msgr2=0x7fb81814f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:38.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb817fff640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8180b4130 0x7fb81814f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:38.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb817fff640 1 -- 172.21.15.55:0/397888055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb804009420 con 0x7fb8180b7b90 2023-07-06T21:57:38.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81ca9f640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8180b4130 0x7fb81814f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb81d2a0640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8180d1c40 0x7fb818157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.904+0000 7fb817fff640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8180b7b90 0x7fb8180d0b30 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fb8040ae040 tx=0x7fb804019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.908+0000 7fb8157fa640 1 -- 172.21.15.55:0/397888055 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8040b4430 con 0x7fb8180b7b90 2023-07-06T21:57:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.908+0000 7fb8157fa640 1 -- 172.21.15.55:0/397888055 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8040b45b0 con 0x7fb8180b7b90 2023-07-06T21:57:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.908+0000 7fb8157fa640 1 -- 172.21.15.55:0/397888055 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8040b4960 con 0x7fb8180b7b90 2023-07-06T21:57:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.908+0000 7fb81ed03640 1 -- 172.21.15.55:0/397888055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8180cb1d0 con 0x7fb8180b7b90 2023-07-06T21:57:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.908+0000 7fb81ed03640 1 -- 172.21.15.55:0/397888055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81814f540 con 0x7fb8180b7b90 2023-07-06T21:57:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.908+0000 7fb81ed03640 1 -- 172.21.15.55:0/397888055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb818066d60 con 0x7fb8180b7b90 2023-07-06T21:57:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.908+0000 7fb8157fa640 1 -- 172.21.15.55:0/397888055 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 33) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fb8040b2040 con 0x7fb8180b7b90 2023-07-06T21:57:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.908+0000 7fb8157fa640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fb7fc066120 0x7fb7fc0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.908+0000 7fb8157fa640 1 -- 172.21.15.55:0/397888055 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fb80411dad0 con 0x7fb8180b7b90 2023-07-06T21:57:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.908+0000 7fb81ca9f640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fb7fc066120 0x7fb7fc0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.912+0000 7fb81ca9f640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fb7fc066120 0x7fb7fc0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0011f0 tx=0x7fb80c009040 comp rx=0 tx=0).ready entity=mgr.6194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:38.912+0000 7fb8157fa640 1 -- 172.21.15.55:0/397888055 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb8040eaf20 con 0x7fb8180b7b90 2023-07-06T21:57:39.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.104+0000 7fb81ed03640 1 -- 172.21.15.55:0/397888055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fb81806a000 con 0x7fb8180b7b90 2023-07-06T21:57:39.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.636+0000 7fb8157fa640 1 -- 172.21.15.55:0/397888055 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fb8040eb2f0 con 0x7fb8180b7b90 2023-07-06T21:57:39.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.636+0000 7fb8157fa640 1 -- 172.21.15.55:0/397888055 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v34) v1 ==== 93+0+0 (secure 0 0 0) 0x7fb8041167a0 con 0x7fb8180b7b90 2023-07-06T21:57:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.640+0000 7fb81ed03640 1 -- 172.21.15.55:0/397888055 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fb7fc066120 msgr2=0x7fb7fc0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.640+0000 7fb81ed03640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fb7fc066120 0x7fb7fc0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0011f0 tx=0x7fb80c009040 comp rx=0 tx=0).stop 2023-07-06T21:57:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.640+0000 7fb81ed03640 1 -- 172.21.15.55:0/397888055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8180b7b90 msgr2=0x7fb8180d0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.640+0000 7fb81ed03640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8180b7b90 0x7fb8180d0b30 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fb8040ae040 tx=0x7fb804019220 comp rx=0 tx=0).stop 2023-07-06T21:57:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.640+0000 7fb81ed03640 1 -- 172.21.15.55:0/397888055 shutdown_connections 2023-07-06T21:57:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.640+0000 7fb81ed03640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fb7fc066120 0x7fb7fc0685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.640+0000 7fb81ed03640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8180d1c40 0x7fb818157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.640+0000 7fb81ed03640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8180b7b90 0x7fb8180d0b30 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.640+0000 7fb81ed03640 1 --2- 172.21.15.55:0/397888055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8180b4130 0x7fb81814f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.640+0000 7fb81ed03640 1 -- 172.21.15.55:0/397888055 >> 172.21.15.55:0/397888055 conn(0x7fb8180ceca0 msgr2=0x7fb818065070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.640+0000 7fb81ed03640 1 -- 172.21.15.55:0/397888055 shutdown_connections 2023-07-06T21:57:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:39.640+0000 7fb81ed03640 1 -- 172.21.15.55:0/397888055 wait complete. 2023-07-06T21:57:39.661 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T21:57:39.661 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:57:39.731 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:57:39.795 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T21:57:39.796 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:57:39.796 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:39.803 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:39.802+0000 7f98d523a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:57:39.805 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:57:39.805 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:39.816 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:39.816+0000 7f646fe46180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:57:39.824 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:40.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fc4cec640 1 Processor -- start 2023-07-06T21:57:40.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fc4cec640 1 -- start start 2023-07-06T21:57:40.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fc4cec640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2fc00cb4a0 0x7f2fc015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fc4cec640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc015f740 0x7f2fc00ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fc4cec640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc00b5b50 con 0x7f2fc00cbc70 2023-07-06T21:57:40.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fc4cec640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc015d130 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fc4cec640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc00cc8e0 con 0x7f2fc015f740 2023-07-06T21:57:40.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fbe59c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2fc00cb4a0 0x7f2fc015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fb7fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc015f740 0x7f2fc00ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fbe59c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2fc00cb4a0 0x7f2fc015cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:42470/0 (socket says 172.21.15.55:42470) 2023-07-06T21:57:40.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fbe59c640 1 -- 172.21.15.55:0/2351771031 learned_addr learned my addr 172.21.15.55:0/2351771031 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:40.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fbe59c640 1 -- 172.21.15.55:0/2351771031 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc015f740 msgr2=0x7f2fc00ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:40.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fbe59c640 1 --2- 172.21.15.55:0/2351771031 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc015f740 0x7f2fc00ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fbe59c640 1 -- 172.21.15.55:0/2351771031 >> v1:172.21.15.138:6789/0 conn(0x7f2fc00cbc70 legacy=0x7f2fc00cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:40.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.020+0000 7f2fbe59c640 1 -- 172.21.15.55:0/2351771031 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc015fc00 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.024+0000 7f2fbe59c640 1 --2- 172.21.15.55:0/2351771031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc00cb4a0 0x7f2fc015cbf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009870 tx=0x7f2fb001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60d20f737aa1fbcc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:40.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.024+0000 7f2fbdd9b640 1 -- 172.21.15.55:0/2351771031 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00a7070 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.024+0000 7f2fbdd9b640 1 -- 172.21.15.55:0/2351771031 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb00ab430 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.024+0000 7f2fbdd9b640 1 -- 172.21.15.55:0/2351771031 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00ab7c0 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.024+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2351771031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc00cb4a0 msgr2=0x7f2fc015cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:40.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.024+0000 7f2fc4cec640 1 --2- 172.21.15.55:0/2351771031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc00cb4a0 0x7f2fc015cbf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009870 tx=0x7f2fb001c540 comp rx=0 tx=0).stop 2023-07-06T21:57:40.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.024+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2351771031 shutdown_connections 2023-07-06T21:57:40.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.024+0000 7f2fc4cec640 1 --2- 172.21.15.55:0/2351771031 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc015f740 0x7f2fc00ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.024+0000 7f2fc4cec640 1 --2- 172.21.15.55:0/2351771031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc00cb4a0 0x7f2fc015cbf0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.024+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2351771031 >> 172.21.15.55:0/2351771031 conn(0x7f2fc006ee80 msgr2=0x7f2fc006f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:40.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.024+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2351771031 shutdown_connections 2023-07-06T21:57:40.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2351771031 wait complete. 2023-07-06T21:57:40.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fc4cec640 1 Processor -- start 2023-07-06T21:57:40.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fc4cec640 1 -- start start 2023-07-06T21:57:40.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fc4cec640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc00cb4a0 0x7f2fc00b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fc4cec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc00cbc70 0x7f2fc0156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fc4cec640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc015f740 0x7f2fc00b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fc4cec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc00c5770 con 0x7f2fc00cbc70 2023-07-06T21:57:40.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fc4cec640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc00b4980 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fc4cec640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc00c4b60 con 0x7f2fc015f740 2023-07-06T21:57:40.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fb7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc00cbc70 0x7f2fc0156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fb7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc00cbc70 0x7f2fc0156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45730/0 (socket says 172.21.15.55:45730) 2023-07-06T21:57:40.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fb7fff640 1 -- 172.21.15.55:0/2783228869 learned_addr learned my addr 172.21.15.55:0/2783228869 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:40.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fbe59c640 1 --2- 172.21.15.55:0/2783228869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc00cb4a0 0x7f2fc00b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fbed9d640 1 --2- 172.21.15.55:0/2783228869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc015f740 0x7f2fc00b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fbe59c640 1 -- 172.21.15.55:0/2783228869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc015f740 msgr2=0x7f2fc00b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:40.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fbe59c640 1 --2- 172.21.15.55:0/2783228869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc015f740 0x7f2fc00b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fbe59c640 1 -- 172.21.15.55:0/2783228869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc00cbc70 msgr2=0x7f2fc0156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:40.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fbe59c640 1 --2- 172.21.15.55:0/2783228869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc00cbc70 0x7f2fc0156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fbe59c640 1 -- 172.21.15.55:0/2783228869 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00094d0 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.028+0000 7f2fb7fff640 1 --2- 172.21.15.55:0/2783228869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc00cbc70 0x7f2fc0156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:40.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.032+0000 7f2fbe59c640 1 --2- 172.21.15.55:0/2783228869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc00cb4a0 0x7f2fc00b4440 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00ac000 tx=0x7f2fb00192e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:40.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.032+0000 7f2fb6ffd640 1 -- 172.21.15.55:0/2783228869 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00b4620 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.032+0000 7f2fb6ffd640 1 -- 172.21.15.55:0/2783228869 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb00b47a0 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.032+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2783228869 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc00c4e40 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.032+0000 7f2fb6ffd640 1 -- 172.21.15.55:0/2783228869 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00b4b50 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.032+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2783228869 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc00c5400 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.032+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2783228869 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc0066d60 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.032+0000 7f2fb6ffd640 1 -- 172.21.15.55:0/2783228869 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f2fb00bf3a0 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.032+0000 7f2fb6ffd640 1 --2- 172.21.15.55:0/2783228869 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f2fa0066460 0x7f2fa0068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.032+0000 7f2fb7fff640 1 -- 172.21.15.55:0/2783228869 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f2fa0066460 msgr2=0x7f2fa0068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1694297670 2023-07-06T21:57:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.032+0000 7f2fb6ffd640 1 -- 172.21.15.55:0/2783228869 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f2fb011dbc0 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.032+0000 7f2fb7fff640 1 --2- 172.21.15.55:0/2783228869 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f2fa0066460 0x7f2fa0068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:40.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.036+0000 7f2fb6ffd640 1 -- 172.21.15.55:0/2783228869 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2fb00eab50 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.196+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2783228869 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fc00cee60 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.200+0000 7f2fb6ffd640 1 -- 172.21.15.55:0/2783228869 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+19044 (secure 0 0 0) 0x7f2fb00ee170 con 0x7f2fc00cb4a0 2023-07-06T21:57:40.197 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:40.198 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":90,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:57:37.612130+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:57:23.252496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-06T21:57:24.528387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/1073362678":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1848976334":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1541327786":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1765249513":"2023-07-07T21:57:37.612097+0000","172.21.15.55:6833/3540074910":"2023-07-07T21:57:37.612097+0000","172.21.15.55:6832/3540074910":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1768372577":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1203793928":"2023-07-07T21:57:37.612097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:40.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.200+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2783228869 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f2fa0066460 msgr2=0x7f2fa0068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:40.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.200+0000 7f2fc4cec640 1 --2- 172.21.15.55:0/2783228869 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f2fa0066460 0x7f2fa0068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.200+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2783228869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc00cb4a0 msgr2=0x7f2fc00b4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:40.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.200+0000 7f2fc4cec640 1 --2- 172.21.15.55:0/2783228869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc00cb4a0 0x7f2fc00b4440 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00ac000 tx=0x7f2fb00192e0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.200+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2783228869 shutdown_connections 2023-07-06T21:57:40.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.200+0000 7f2fc4cec640 1 --2- 172.21.15.55:0/2783228869 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f2fa0066460 0x7f2fa0068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.200+0000 7f2fc4cec640 1 --2- 172.21.15.55:0/2783228869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc015f740 0x7f2fc00b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.200+0000 7f2fc4cec640 1 --2- 172.21.15.55:0/2783228869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc00cbc70 0x7f2fc0156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.200+0000 7f2fc4cec640 1 --2- 172.21.15.55:0/2783228869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc00cb4a0 0x7f2fc00b4440 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.200+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2783228869 >> 172.21.15.55:0/2783228869 conn(0x7f2fc006ee80 msgr2=0x7f2fc015bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:40.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.200+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2783228869 shutdown_connections 2023-07-06T21:57:40.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.200+0000 7f2fc4cec640 1 -- 172.21.15.55:0/2783228869 wait complete. 2023-07-06T21:57:40.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:57:23.252496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:57:24.528387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:57:40.221 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:57:40.221 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:40.222+0000 7f98d523a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:57:40.262 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:40.264+0000 7f646fe46180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:57:40.370 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:40.370+0000 7f98d523a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:57:40.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.372+0000 7f8b6aa7b640 1 Processor -- start 2023-07-06T21:57:40.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.372+0000 7f8b6aa7b640 1 -- start start 2023-07-06T21:57:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.372+0000 7f8b6aa7b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b640b7b90 0x7f8b640d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.372+0000 7f8b6aa7b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8b640cc870 0x7f8b640b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.372+0000 7f8b6aa7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b640b4130 0x7f8b640d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.372+0000 7f8b6aa7b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b640b45b0 con 0x7f8b640b7b90 2023-07-06T21:57:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.372+0000 7f8b6aa7b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b640b5070 con 0x7f8b640cc870 2023-07-06T21:57:40.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.372+0000 7f8b6aa7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b64160020 con 0x7f8b640b4130 2023-07-06T21:57:40.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.376+0000 7f8b68817640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b640b7b90 0x7f8b640d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.376+0000 7f8b68817640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b640b7b90 0x7f8b640d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45740/0 (socket says 172.21.15.55:45740) 2023-07-06T21:57:40.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.376+0000 7f8b68817640 1 -- 172.21.15.55:0/3939129327 learned_addr learned my addr 172.21.15.55:0/3939129327 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:40.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.376+0000 7f8b63fff640 1 --2- 172.21.15.55:0/3939129327 >> v2:172.21.15.138:3300/0 conn(0x7f8b640cc870 0x7f8b640b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.376+0000 7f8b69018640 1 --2- 172.21.15.55:0/3939129327 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b640b4130 0x7f8b640d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.376+0000 7f8b68817640 1 -- 172.21.15.55:0/3939129327 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b640b4130 msgr2=0x7f8b640d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:40.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.376+0000 7f8b68817640 1 --2- 172.21.15.55:0/3939129327 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b640b4130 0x7f8b640d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.376+0000 7f8b68817640 1 -- 172.21.15.55:0/3939129327 >> v2:172.21.15.138:3300/0 conn(0x7f8b640cc870 msgr2=0x7f8b640b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:40.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.376+0000 7f8b68817640 1 --2- 172.21.15.55:0/3939129327 >> v2:172.21.15.138:3300/0 conn(0x7f8b640cc870 0x7f8b640b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.376+0000 7f8b68817640 1 -- 172.21.15.55:0/3939129327 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b641604b0 con 0x7f8b640b7b90 2023-07-06T21:57:40.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.376+0000 7f8b68817640 1 --2- 172.21.15.55:0/3939129327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640b7b90 0x7f8b640d1c40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8b6408b540 tx=0x7f8b5801c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d425ea08bb02e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:40.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.376+0000 7f8b637fe640 1 -- 172.21.15.55:0/3939129327 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580ab600 con 0x7f8b640b7b90 2023-07-06T21:57:40.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.376+0000 7f8b637fe640 1 -- 172.21.15.55:0/3939129327 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b580a7050 con 0x7f8b640b7b90 2023-07-06T21:57:40.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.376+0000 7f8b637fe640 1 -- 172.21.15.55:0/3939129327 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580ab980 con 0x7f8b640b7b90 2023-07-06T21:57:40.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/3939129327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640b7b90 msgr2=0x7f8b640d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:40.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 --2- 172.21.15.55:0/3939129327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640b7b90 0x7f8b640d1c40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8b6408b540 tx=0x7f8b5801c220 comp rx=0 tx=0).stop 2023-07-06T21:57:40.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/3939129327 shutdown_connections 2023-07-06T21:57:40.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 --2- 172.21.15.55:0/3939129327 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b640b4130 0x7f8b640d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 --2- 172.21.15.55:0/3939129327 >> v2:172.21.15.138:3300/0 conn(0x7f8b640cc870 0x7f8b640b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 --2- 172.21.15.55:0/3939129327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640b7b90 0x7f8b640d1c40 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/3939129327 >> 172.21.15.55:0/3939129327 conn(0x7f8b640ceca0 msgr2=0x7f8b640cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:40.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/3939129327 shutdown_connections 2023-07-06T21:57:40.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/3939129327 wait complete. 2023-07-06T21:57:40.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 Processor -- start 2023-07-06T21:57:40.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 -- start start 2023-07-06T21:57:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b640b4130 0x7f8b6415ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b640b7b90 0x7f8b641547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640cc870 0x7f8b6406a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b64157300 con 0x7f8b640cc870 2023-07-06T21:57:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b64158160 con 0x7f8b640b4130 2023-07-06T21:57:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b6aa7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6415f180 con 0x7f8b640b7b90 2023-07-06T21:57:40.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b69018640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640cc870 0x7f8b6406a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b68817640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b640b4130 0x7f8b6415ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b63fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b640b7b90 0x7f8b641547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b68817640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b640b4130 0x7f8b6415ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:42504/0 (socket says 172.21.15.55:42504) 2023-07-06T21:57:40.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b69018640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640cc870 0x7f8b6406a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45752/0 (socket says 172.21.15.55:45752) 2023-07-06T21:57:40.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.380+0000 7f8b68817640 1 -- 172.21.15.55:0/13963257 learned_addr learned my addr 172.21.15.55:0/13963257 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:40.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.384+0000 7f8b68817640 1 -- 172.21.15.55:0/13963257 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b640b7b90 msgr2=0x7f8b641547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:40.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.384+0000 7f8b68817640 1 --2- 172.21.15.55:0/13963257 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b640b7b90 0x7f8b641547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.384+0000 7f8b68817640 1 -- 172.21.15.55:0/13963257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640cc870 msgr2=0x7f8b6406a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:40.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.384+0000 7f8b68817640 1 --2- 172.21.15.55:0/13963257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640cc870 0x7f8b6406a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.384+0000 7f8b68817640 1 -- 172.21.15.55:0/13963257 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b580094d0 con 0x7f8b640b4130 2023-07-06T21:57:40.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.384+0000 7f8b68817640 1 --2- 172.21.15.55:0/13963257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b640b4130 0x7f8b6415ec40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8b580ae040 tx=0x7f8b5801aa60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:40.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.384+0000 7f8b617fa640 1 -- 172.21.15.55:0/13963257 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580b6420 con 0x7f8b640b4130 2023-07-06T21:57:40.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.384+0000 7f8b617fa640 1 -- 172.21.15.55:0/13963257 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b580b6580 con 0x7f8b640b4130 2023-07-06T21:57:40.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.384+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/13963257 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b641585f0 con 0x7f8b640b4130 2023-07-06T21:57:40.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.384+0000 7f8b617fa640 1 -- 172.21.15.55:0/13963257 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580b6930 con 0x7f8b640b4130 2023-07-06T21:57:40.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.384+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/13963257 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b64157830 con 0x7f8b640b4130 2023-07-06T21:57:40.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.384+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/13963257 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b64066d60 con 0x7f8b640b4130 2023-07-06T21:57:40.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.384+0000 7f8b617fa640 1 -- 172.21.15.55:0/13963257 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f8b580b2040 con 0x7f8b640b4130 2023-07-06T21:57:40.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.388+0000 7f8b617fa640 1 --2- 172.21.15.55:0/13963257 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f8b48066430 0x7f8b480688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.388+0000 7f8b617fa640 1 -- 172.21.15.55:0/13963257 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f8b5811e5b0 con 0x7f8b640b4130 2023-07-06T21:57:40.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.388+0000 7f8b63fff640 1 -- 172.21.15.55:0/13963257 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f8b48066430 msgr2=0x7f8b480688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1694297670 2023-07-06T21:57:40.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.388+0000 7f8b63fff640 1 --2- 172.21.15.55:0/13963257 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f8b48066430 0x7f8b480688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:40.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.392+0000 7f8b617fa640 1 -- 172.21.15.55:0/13963257 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8b580eb410 con 0x7f8b640b4130 2023-07-06T21:57:40.425 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:40.428+0000 7f646fe46180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:57:40.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.548+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/13963257 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b640ce540 con 0x7f8b640b4130 2023-07-06T21:57:40.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.548+0000 7f8b617fa640 1 -- 172.21.15.55:0/13963257 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b580eea30 con 0x7f8b640b4130 2023-07-06T21:57:40.545 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:57:40.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.548+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/13963257 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f8b48066430 msgr2=0x7f8b480688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:40.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.548+0000 7f8b6aa7b640 1 --2- 172.21.15.55:0/13963257 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f8b48066430 0x7f8b480688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.548+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/13963257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b640b4130 msgr2=0x7f8b6415ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:40.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.548+0000 7f8b6aa7b640 1 --2- 172.21.15.55:0/13963257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b640b4130 0x7f8b6415ec40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8b580ae040 tx=0x7f8b5801aa60 comp rx=0 tx=0).stop 2023-07-06T21:57:40.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.548+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/13963257 shutdown_connections 2023-07-06T21:57:40.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.548+0000 7f8b6aa7b640 1 --2- 172.21.15.55:0/13963257 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f8b48066430 0x7f8b480688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.548+0000 7f8b6aa7b640 1 --2- 172.21.15.55:0/13963257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640cc870 0x7f8b6406a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.548+0000 7f8b6aa7b640 1 --2- 172.21.15.55:0/13963257 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b640b7b90 0x7f8b641547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.548+0000 7f8b6aa7b640 1 --2- 172.21.15.55:0/13963257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b640b4130 0x7f8b6415ec40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.548+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/13963257 >> 172.21.15.55:0/13963257 conn(0x7f8b640ceca0 msgr2=0x7f8b64165cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:40.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.548+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/13963257 shutdown_connections 2023-07-06T21:57:40.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.548+0000 7f8b6aa7b640 1 -- 172.21.15.55:0/13963257 wait complete. 2023-07-06T21:57:40.568 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:57:40.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f85056f9640 1 Processor -- start 2023-07-06T21:57:40.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f85056f9640 1 -- start start 2023-07-06T21:57:40.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f85056f9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f85000d1c40 0x7f85000b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f85056f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85000b4130 0x7f85000b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f85056f9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85000b5070 con 0x7f85000b7b90 2023-07-06T21:57:40.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f85056f9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85000d20c0 con 0x7f85000d1c40 2023-07-06T21:57:40.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f85056f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85000b45b0 con 0x7f85000b4130 2023-07-06T21:57:40.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f84feffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f85000b7b90 0x7f85000cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50838/0 (socket says 172.21.15.55:50838) 2023-07-06T21:57:40.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f84feffd640 1 -- 172.21.15.55:0/168954793 learned_addr learned my addr 172.21.15.55:0/168954793 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:40.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f84fe7fc640 1 --2- 172.21.15.55:0/168954793 >> v2:172.21.15.138:3300/0 conn(0x7f85000d1c40 0x7f85000b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f84ff7fe640 1 --2- 172.21.15.55:0/168954793 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85000b4130 0x7f85000b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f84fdffb640 1 -- 172.21.15.55:0/168954793 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172887185 0 0) 0x7f85000b5070 con 0x7f85000b7b90 2023-07-06T21:57:40.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f84fdffb640 1 -- 172.21.15.55:0/168954793 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84e8003530 con 0x7f85000b7b90 2023-07-06T21:57:40.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f84fe7fc640 1 -- 172.21.15.55:0/168954793 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85000b4130 msgr2=0x7f85000b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:40.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f84fe7fc640 1 --2- 172.21.15.55:0/168954793 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85000b4130 0x7f85000b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f84fe7fc640 1 -- 172.21.15.55:0/168954793 >> v1:172.21.15.55:6789/0 conn(0x7f85000b7b90 legacy=0x7f85000cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:40.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.760+0000 7f84fe7fc640 1 -- 172.21.15.55:0/168954793 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8500160020 con 0x7f85000d1c40 2023-07-06T21:57:40.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.764+0000 7f84fe7fc640 1 --2- 172.21.15.55:0/168954793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85000d1c40 0x7f85000b3bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f84f40097c0 tx=0x7f84f401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b691fba3f9fa71de server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:40.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.764+0000 7f84fdffb640 1 -- 172.21.15.55:0/168954793 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40ab600 con 0x7f85000d1c40 2023-07-06T21:57:40.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.764+0000 7f84fdffb640 1 -- 172.21.15.55:0/168954793 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f40a7050 con 0x7f85000d1c40 2023-07-06T21:57:40.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.764+0000 7f84fdffb640 1 -- 172.21.15.55:0/168954793 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40ab980 con 0x7f85000d1c40 2023-07-06T21:57:40.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.764+0000 7f85056f9640 1 -- 172.21.15.55:0/168954793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85000d1c40 msgr2=0x7f85000b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:40.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.764+0000 7f85056f9640 1 --2- 172.21.15.55:0/168954793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85000d1c40 0x7f85000b3bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f84f40097c0 tx=0x7f84f401c480 comp rx=0 tx=0).stop 2023-07-06T21:57:40.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.764+0000 7f85056f9640 1 -- 172.21.15.55:0/168954793 shutdown_connections 2023-07-06T21:57:40.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.764+0000 7f85056f9640 1 --2- 172.21.15.55:0/168954793 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85000b4130 0x7f85000b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.764+0000 7f85056f9640 1 --2- 172.21.15.55:0/168954793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85000d1c40 0x7f85000b3bf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.764+0000 7f85056f9640 1 -- 172.21.15.55:0/168954793 >> 172.21.15.55:0/168954793 conn(0x7f85000ceca0 msgr2=0x7f85000cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:40.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.764+0000 7f85056f9640 1 -- 172.21.15.55:0/168954793 shutdown_connections 2023-07-06T21:57:40.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.764+0000 7f85056f9640 1 -- 172.21.15.55:0/168954793 wait complete. 2023-07-06T21:57:40.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f85056f9640 1 Processor -- start 2023-07-06T21:57:40.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f85056f9640 1 -- start start 2023-07-06T21:57:40.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f85056f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85000b4130 0x7f85001f7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f85056f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85000b7b90 0x7f8500069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f85056f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85000d1c40 0x7f85000ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f85056f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85000cbf40 con 0x7f85000b7b90 2023-07-06T21:57:40.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f85056f9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85001f8120 con 0x7f85000d1c40 2023-07-06T21:57:40.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f85056f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85001f7880 con 0x7f85000b4130 2023-07-06T21:57:40.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84fe7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85000b7b90 0x7f8500069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84fe7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85000b7b90 0x7f8500069e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45766/0 (socket says 172.21.15.55:45766) 2023-07-06T21:57:40.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84fe7fc640 1 -- 172.21.15.55:0/526363115 learned_addr learned my addr 172.21.15.55:0/526363115 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:40.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84feffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85000b4130 0x7f85001f7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84ff7fe640 1 --2- 172.21.15.55:0/526363115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85000d1c40 0x7f85000ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:40.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84fe7fc640 1 -- 172.21.15.55:0/526363115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85000b4130 msgr2=0x7f85001f7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:40.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84fe7fc640 1 --2- 172.21.15.55:0/526363115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85000b4130 0x7f85001f7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84fe7fc640 1 -- 172.21.15.55:0/526363115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85000d1c40 msgr2=0x7f85000ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:40.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84fe7fc640 1 --2- 172.21.15.55:0/526363115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85000d1c40 0x7f85000ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84fe7fc640 1 -- 172.21.15.55:0/526363115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f4009420 con 0x7f85000b7b90 2023-07-06T21:57:40.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84ff7fe640 1 --2- 172.21.15.55:0/526363115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85000d1c40 0x7f85000ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:40.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84fe7fc640 1 --2- 172.21.15.55:0/526363115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85000b7b90 0x7f8500069e00 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f84f401ab30 tx=0x7f84f4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:40.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84e77fe640 1 -- 172.21.15.55:0/526363115 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40b4400 con 0x7f85000b7b90 2023-07-06T21:57:40.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84e77fe640 1 -- 172.21.15.55:0/526363115 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f40b4580 con 0x7f85000b7b90 2023-07-06T21:57:40.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f85056f9640 1 -- 172.21.15.55:0/526363115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85001f7b60 con 0x7f85000b7b90 2023-07-06T21:57:40.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f84e77fe640 1 -- 172.21.15.55:0/526363115 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40b4930 con 0x7f85000b7b90 2023-07-06T21:57:40.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.768+0000 7f85056f9640 1 -- 172.21.15.55:0/526363115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85001f3e40 con 0x7f85000b7b90 2023-07-06T21:57:40.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.772+0000 7f85056f9640 1 -- 172.21.15.55:0/526363115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85001f3c70 con 0x7f85000b7b90 2023-07-06T21:57:40.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.772+0000 7f84e77fe640 1 -- 172.21.15.55:0/526363115 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f84f40b2040 con 0x7f85000b7b90 2023-07-06T21:57:40.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.772+0000 7f84e77fe640 1 --2- 172.21.15.55:0/526363115 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f84ec066430 0x7f84ec0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:40.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.772+0000 7f84e77fe640 1 -- 172.21.15.55:0/526363115 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f84f411e0b0 con 0x7f85000b7b90 2023-07-06T21:57:40.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.772+0000 7f84feffd640 1 -- 172.21.15.55:0/526363115 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f84ec066430 msgr2=0x7f84ec0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1694297670 2023-07-06T21:57:40.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.772+0000 7f84feffd640 1 --2- 172.21.15.55:0/526363115 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f84ec066430 0x7f84ec0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:40.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.776+0000 7f84e77fe640 1 -- 172.21.15.55:0/526363115 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84f40eafa0 con 0x7f85000b7b90 2023-07-06T21:57:40.856 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:40.854+0000 7f98d523a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:57:40.914 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:40.914+0000 7f98d523a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:57:40.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.932+0000 7f85056f9640 1 -- 172.21.15.55:0/526363115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f85001f4030 con 0x7f85000b7b90 2023-07-06T21:57:40.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.932+0000 7f84e77fe640 1 -- 172.21.15.55:0/526363115 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v90) v1 ==== 92+0+10 (secure 0 0 0) 0x7f84f40ee5c0 con 0x7f85000b7b90 2023-07-06T21:57:40.931 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:57:40.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.936+0000 7f85056f9640 1 -- 172.21.15.55:0/526363115 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f84ec066430 msgr2=0x7f84ec0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:40.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.936+0000 7f85056f9640 1 --2- 172.21.15.55:0/526363115 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f84ec066430 0x7f84ec0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.936+0000 7f85056f9640 1 -- 172.21.15.55:0/526363115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85000b7b90 msgr2=0x7f8500069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:40.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.936+0000 7f85056f9640 1 --2- 172.21.15.55:0/526363115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85000b7b90 0x7f8500069e00 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f84f401ab30 tx=0x7f84f4019220 comp rx=0 tx=0).stop 2023-07-06T21:57:40.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.936+0000 7f85056f9640 1 -- 172.21.15.55:0/526363115 shutdown_connections 2023-07-06T21:57:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.936+0000 7f85056f9640 1 --2- 172.21.15.55:0/526363115 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f84ec066430 0x7f84ec0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.936+0000 7f85056f9640 1 --2- 172.21.15.55:0/526363115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85000d1c40 0x7f85000ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.936+0000 7f85056f9640 1 --2- 172.21.15.55:0/526363115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85000b7b90 0x7f8500069e00 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.936+0000 7f85056f9640 1 --2- 172.21.15.55:0/526363115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85000b4130 0x7f85001f7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.936+0000 7f85056f9640 1 -- 172.21.15.55:0/526363115 >> 172.21.15.55:0/526363115 conn(0x7f85000ceca0 msgr2=0x7f85000ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.936+0000 7f85056f9640 1 -- 172.21.15.55:0/526363115 shutdown_connections 2023-07-06T21:57:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:40.936+0000 7f85056f9640 1 -- 172.21.15.55:0/526363115 wait complete. 2023-07-06T21:57:40.943 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:40.944+0000 7f646fe46180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:57:40.953 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:57:40.969 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:40.970+0000 7f98d523a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:57:41.008 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:41.008+0000 7f646fe46180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:57:41.054 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:41.054+0000 7f98d523a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:57:41.068 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:41.068+0000 7f646fe46180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:57:41.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.104+0000 7fdd6bb82640 1 Processor -- start 2023-07-06T21:57:41.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.104+0000 7fdd6bb82640 1 -- start start 2023-07-06T21:57:41.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6bb82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd6415b850 0x7fdd640cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6bb82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd640ccd30 0x7fdd640b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6bb82640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd640b4210 con 0x7fdd640b3db0 2023-07-06T21:57:41.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6bb82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd640b2b80 con 0x7fdd640ccd30 2023-07-06T21:57:41.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6bb82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640cff30 con 0x7fdd6415b850 2023-07-06T21:57:41.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6911d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd640ccd30 0x7fdd640b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6a11f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdd640b3db0 0x7fdd6415f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50852/0 (socket says 172.21.15.55:50852) 2023-07-06T21:57:41.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6991e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd6415b850 0x7fdd640cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6a11f640 1 -- 172.21.15.55:0/3080551139 learned_addr learned my addr 172.21.15.55:0/3080551139 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:41.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6911d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd640ccd30 0x7fdd640b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45780/0 (socket says 172.21.15.55:45780) 2023-07-06T21:57:41.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6911d640 1 -- 172.21.15.55:0/3080551139 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd6415b850 msgr2=0x7fdd640cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:41.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6911d640 1 --2- 172.21.15.55:0/3080551139 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd6415b850 0x7fdd640cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6911d640 1 -- 172.21.15.55:0/3080551139 >> v1:172.21.15.55:6789/0 conn(0x7fdd640b3db0 legacy=0x7fdd6415f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:41.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6911d640 1 -- 172.21.15.55:0/3080551139 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd640b22e0 con 0x7fdd640ccd30 2023-07-06T21:57:41.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.108+0000 7fdd6891c640 1 -- 172.21.15.55:0/3080551139 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656550880 0 0) 0x7fdd640b4210 con 0x7fdd640b3db0 2023-07-06T21:57:41.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.112+0000 7fdd6911d640 1 --2- 172.21.15.55:0/3080551139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd640ccd30 0x7fdd640b3870 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fdd540097c0 tx=0x7fdd5401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7d73b9847f44b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:41.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.112+0000 7fdd6891c640 1 -- 172.21.15.55:0/3080551139 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd540ab600 con 0x7fdd640ccd30 2023-07-06T21:57:41.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.112+0000 7fdd6891c640 1 -- 172.21.15.55:0/3080551139 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd540a7050 con 0x7fdd640ccd30 2023-07-06T21:57:41.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.112+0000 7fdd6891c640 1 -- 172.21.15.55:0/3080551139 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd540ab980 con 0x7fdd640ccd30 2023-07-06T21:57:41.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.112+0000 7fdd6bb82640 1 -- 172.21.15.55:0/3080551139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd640ccd30 msgr2=0x7fdd640b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:41.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.112+0000 7fdd6bb82640 1 --2- 172.21.15.55:0/3080551139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd640ccd30 0x7fdd640b3870 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fdd540097c0 tx=0x7fdd5401c330 comp rx=0 tx=0).stop 2023-07-06T21:57:41.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.112+0000 7fdd6bb82640 1 -- 172.21.15.55:0/3080551139 shutdown_connections 2023-07-06T21:57:41.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.112+0000 7fdd6bb82640 1 --2- 172.21.15.55:0/3080551139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd640ccd30 0x7fdd640b3870 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.112+0000 7fdd6bb82640 1 --2- 172.21.15.55:0/3080551139 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd6415b850 0x7fdd640cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.112+0000 7fdd6bb82640 1 -- 172.21.15.55:0/3080551139 >> 172.21.15.55:0/3080551139 conn(0x7fdd640cec20 msgr2=0x7fdd640cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.112+0000 7fdd6bb82640 1 -- 172.21.15.55:0/3080551139 shutdown_connections 2023-07-06T21:57:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.112+0000 7fdd6bb82640 1 -- 172.21.15.55:0/3080551139 wait complete. 2023-07-06T21:57:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.112+0000 7fdd6bb82640 1 Processor -- start 2023-07-06T21:57:41.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.112+0000 7fdd6bb82640 1 -- start start 2023-07-06T21:57:41.112 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:41.110+0000 7f98d523a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:57:41.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6bb82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd640b3db0 0x7fdd6414d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6bb82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd640ccd30 0x7fdd6415c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6bb82640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd6415b850 0x7fdd6415e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6bb82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64153560 con 0x7fdd640b3db0 2023-07-06T21:57:41.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6bb82640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64153800 con 0x7fdd6415b850 2023-07-06T21:57:41.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6bb82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64153ae0 con 0x7fdd640ccd30 2023-07-06T21:57:41.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6991e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd640b3db0 0x7fdd6414d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6991e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd640b3db0 0x7fdd6414d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45786/0 (socket says 172.21.15.55:45786) 2023-07-06T21:57:41.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6991e640 1 -- 172.21.15.55:0/1793874444 learned_addr learned my addr 172.21.15.55:0/1793874444 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:41.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6911d640 1 --2- 172.21.15.55:0/1793874444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd640ccd30 0x7fdd6415c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6a11f640 1 --2- 172.21.15.55:0/1793874444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd6415b850 0x7fdd6415e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6991e640 1 -- 172.21.15.55:0/1793874444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd640ccd30 msgr2=0x7fdd6415c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:41.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6991e640 1 --2- 172.21.15.55:0/1793874444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd640ccd30 0x7fdd6415c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6991e640 1 -- 172.21.15.55:0/1793874444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd6415b850 msgr2=0x7fdd6415e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:41.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6991e640 1 --2- 172.21.15.55:0/1793874444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd6415b850 0x7fdd6415e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6991e640 1 -- 172.21.15.55:0/1793874444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54009420 con 0x7fdd640b3db0 2023-07-06T21:57:41.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6991e640 1 --2- 172.21.15.55:0/1793874444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd640b3db0 0x7fdd6414d2b0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000e870 tx=0x7fdd6000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:41.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd5a7fc640 1 -- 172.21.15.55:0/1793874444 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60009510 con 0x7fdd640b3db0 2023-07-06T21:57:41.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd5a7fc640 1 -- 172.21.15.55:0/1793874444 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6000eec0 con 0x7fdd640b3db0 2023-07-06T21:57:41.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd5a7fc640 1 -- 172.21.15.55:0/1793874444 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000cb40 con 0x7fdd640b3db0 2023-07-06T21:57:41.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6bb82640 1 -- 172.21.15.55:0/1793874444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6415bda0 con 0x7fdd640b3db0 2023-07-06T21:57:41.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6bb82640 1 -- 172.21.15.55:0/1793874444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd641540a0 con 0x7fdd640b3db0 2023-07-06T21:57:41.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd6bb82640 1 -- 172.21.15.55:0/1793874444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd64066d60 con 0x7fdd640b3db0 2023-07-06T21:57:41.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.116+0000 7fdd5a7fc640 1 -- 172.21.15.55:0/1793874444 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fdd6000cca0 con 0x7fdd640b3db0 2023-07-06T21:57:41.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.120+0000 7fdd5a7fc640 1 --2- 172.21.15.55:0/1793874444 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fdd48066430 0x7fdd480688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.120+0000 7fdd5a7fc640 1 -- 172.21.15.55:0/1793874444 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fdd60084340 con 0x7fdd640b3db0 2023-07-06T21:57:41.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.120+0000 7fdd6911d640 1 -- 172.21.15.55:0/1793874444 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fdd48066430 msgr2=0x7fdd480688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1694297670 2023-07-06T21:57:41.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.120+0000 7fdd6911d640 1 --2- 172.21.15.55:0/1793874444 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fdd48066430 0x7fdd480688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:41.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.124+0000 7fdd5a7fc640 1 -- 172.21.15.55:0/1793874444 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd60051360 con 0x7fdd640b3db0 2023-07-06T21:57:41.181 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:41.184+0000 7f646fe46180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:57:41.198 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:41.198+0000 7f98d523a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:57:41.241 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:41.244+0000 7f646fe46180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:57:41.254 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:41.254+0000 7f98d523a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:57:41.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.296+0000 7fdd6bb82640 1 -- 172.21.15.55:0/1793874444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd640b3420 con 0x7fdd640b3db0 2023-07-06T21:57:41.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.296+0000 7fdd5a7fc640 1 -- 172.21.15.55:0/1793874444 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdd60054980 con 0x7fdd640b3db0 2023-07-06T21:57:41.296 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:57:41.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.300+0000 7fdd6bb82640 1 -- 172.21.15.55:0/1793874444 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fdd48066430 msgr2=0x7fdd480688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:41.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.300+0000 7fdd6bb82640 1 --2- 172.21.15.55:0/1793874444 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fdd48066430 0x7fdd480688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.300+0000 7fdd6bb82640 1 -- 172.21.15.55:0/1793874444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd640b3db0 msgr2=0x7fdd6414d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:41.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.300+0000 7fdd6bb82640 1 --2- 172.21.15.55:0/1793874444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd640b3db0 0x7fdd6414d2b0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000e870 tx=0x7fdd6000ec70 comp rx=0 tx=0).stop 2023-07-06T21:57:41.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.300+0000 7fdd6bb82640 1 -- 172.21.15.55:0/1793874444 shutdown_connections 2023-07-06T21:57:41.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.300+0000 7fdd6bb82640 1 --2- 172.21.15.55:0/1793874444 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fdd48066430 0x7fdd480688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.300+0000 7fdd6bb82640 1 --2- 172.21.15.55:0/1793874444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd6415b850 0x7fdd6415e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.300+0000 7fdd6bb82640 1 --2- 172.21.15.55:0/1793874444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd640ccd30 0x7fdd6415c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.300+0000 7fdd6bb82640 1 --2- 172.21.15.55:0/1793874444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd640b3db0 0x7fdd6414d2b0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.300+0000 7fdd6bb82640 1 -- 172.21.15.55:0/1793874444 >> 172.21.15.55:0/1793874444 conn(0x7fdd640cec20 msgr2=0x7fdd640b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:41.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.300+0000 7fdd6bb82640 1 -- 172.21.15.55:0/1793874444 shutdown_connections 2023-07-06T21:57:41.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.300+0000 7fdd6bb82640 1 -- 172.21.15.55:0/1793874444 wait complete. 2023-07-06T21:57:41.318 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:57:41.331 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:41.332+0000 7f646fe46180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:57:41.392 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:41.392+0000 7f646fe46180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:57:41.395 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:41.394+0000 7f98d523a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:57:41.453 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:41.454+0000 7f98d523a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:57:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21fec34640 1 Processor -- start 2023-07-06T21:57:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21fec34640 1 -- start start 2023-07-06T21:57:41.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21fec34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f815b850 0x7f21f80cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21fec34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f21f80b3f80 0x7f21f80d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21fec34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f80b2b80 con 0x7f21f80ccd30 2023-07-06T21:57:41.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21fec34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f80cff30 con 0x7f21f80b3f80 2023-07-06T21:57:41.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21fec34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80b22e0 con 0x7f21f815b850 2023-07-06T21:57:41.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21fd1d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f21f80b3f80 0x7f21f80d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21f7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f21f80ccd30 0x7f21f80b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50866/0 (socket says 172.21.15.55:50866) 2023-07-06T21:57:41.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21f7fff640 1 -- 172.21.15.55:0/1671268370 learned_addr learned my addr 172.21.15.55:0/1671268370 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21fc9d0640 1 --2- 172.21.15.55:0/1671268370 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f815b850 0x7f21f80cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21fd1d1640 1 -- 172.21.15.55:0/1671268370 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f815b850 msgr2=0x7f21f80cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21fd1d1640 1 --2- 172.21.15.55:0/1671268370 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f815b850 0x7f21f80cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21fd1d1640 1 -- 172.21.15.55:0/1671268370 >> v1:172.21.15.55:6789/0 conn(0x7f21f80ccd30 legacy=0x7f21f80b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21fd1d1640 1 -- 172.21.15.55:0/1671268370 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f80b25c0 con 0x7f21f80b3f80 2023-07-06T21:57:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.468+0000 7f21f77fe640 1 -- 172.21.15.55:0/1671268370 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017503372 0 0) 0x7f21f80b2b80 con 0x7f21f80ccd30 2023-07-06T21:57:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.472+0000 7f21fd1d1640 1 --2- 172.21.15.55:0/1671268370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21f80b3f80 0x7f21f80d03c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009d90 tx=0x7f21f001c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c58f0053489976a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.472+0000 7f21f77fe640 1 -- 172.21.15.55:0/1671268370 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f00a5850 con 0x7f21f80b3f80 2023-07-06T21:57:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.472+0000 7f21f77fe640 1 -- 172.21.15.55:0/1671268370 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f00a59b0 con 0x7f21f80b3f80 2023-07-06T21:57:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.472+0000 7f21f77fe640 1 -- 172.21.15.55:0/1671268370 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f00a5d40 con 0x7f21f80b3f80 2023-07-06T21:57:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.472+0000 7f21fec34640 1 -- 172.21.15.55:0/1671268370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21f80b3f80 msgr2=0x7f21f80d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.472+0000 7f21fec34640 1 --2- 172.21.15.55:0/1671268370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21f80b3f80 0x7f21f80d03c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009d90 tx=0x7f21f001c800 comp rx=0 tx=0).stop 2023-07-06T21:57:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.472+0000 7f21fec34640 1 -- 172.21.15.55:0/1671268370 shutdown_connections 2023-07-06T21:57:41.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.472+0000 7f21fec34640 1 --2- 172.21.15.55:0/1671268370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21f80b3f80 0x7f21f80d03c0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.472+0000 7f21fec34640 1 --2- 172.21.15.55:0/1671268370 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f815b850 0x7f21f80cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.472+0000 7f21fec34640 1 -- 172.21.15.55:0/1671268370 >> 172.21.15.55:0/1671268370 conn(0x7f21f80cec20 msgr2=0x7f21f80cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:41.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.472+0000 7f21fec34640 1 -- 172.21.15.55:0/1671268370 shutdown_connections 2023-07-06T21:57:41.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.472+0000 7f21fec34640 1 -- 172.21.15.55:0/1671268370 wait complete. 2023-07-06T21:57:41.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fec34640 1 Processor -- start 2023-07-06T21:57:41.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fec34640 1 -- start start 2023-07-06T21:57:41.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fec34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21f80b3f80 0x7f21f814e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fec34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21f80ccd30 0x7f21f8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fec34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f815b850 0x7f21f80b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fec34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f815c040 con 0x7f21f80b3f80 2023-07-06T21:57:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fec34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8158710 con 0x7f21f80ccd30 2023-07-06T21:57:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fec34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8156ef0 con 0x7f21f815b850 2023-07-06T21:57:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fc9d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21f80b3f80 0x7f21f814e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fc9d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21f80b3f80 0x7f21f814e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45814/0 (socket says 172.21.15.55:45814) 2023-07-06T21:57:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fc9d0640 1 -- 172.21.15.55:0/4029880763 learned_addr learned my addr 172.21.15.55:0/4029880763 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21f7fff640 1 --2- 172.21.15.55:0/4029880763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21f80ccd30 0x7f21f8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fd1d1640 1 --2- 172.21.15.55:0/4029880763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f815b850 0x7f21f80b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fc9d0640 1 -- 172.21.15.55:0/4029880763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f815b850 msgr2=0x7f21f80b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:41.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fc9d0640 1 --2- 172.21.15.55:0/4029880763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f815b850 0x7f21f80b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fc9d0640 1 -- 172.21.15.55:0/4029880763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21f80ccd30 msgr2=0x7f21f8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:41.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fc9d0640 1 --2- 172.21.15.55:0/4029880763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21f80ccd30 0x7f21f8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fc9d0640 1 -- 172.21.15.55:0/4029880763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f0009a70 con 0x7f21f80b3f80 2023-07-06T21:57:41.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fd1d1640 1 --2- 172.21.15.55:0/4029880763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f815b850 0x7f21f80b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:41.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fc9d0640 1 --2- 172.21.15.55:0/4029880763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21f80b3f80 0x7f21f814e1a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00e870 tx=0x7f21ec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:41.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21f57fa640 1 -- 172.21.15.55:0/4029880763 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec009510 con 0x7f21f80b3f80 2023-07-06T21:57:41.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21f57fa640 1 -- 172.21.15.55:0/4029880763 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec00eec0 con 0x7f21f80b3f80 2023-07-06T21:57:41.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fec34640 1 -- 172.21.15.55:0/4029880763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f815bda0 con 0x7f21f80b3f80 2023-07-06T21:57:41.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21f57fa640 1 -- 172.21.15.55:0/4029880763 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec00cb40 con 0x7f21f80b3f80 2023-07-06T21:57:41.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fec34640 1 -- 172.21.15.55:0/4029880763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f8156c10 con 0x7f21f80b3f80 2023-07-06T21:57:41.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.476+0000 7f21fec34640 1 -- 172.21.15.55:0/4029880763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f8066d60 con 0x7f21f80b3f80 2023-07-06T21:57:41.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.480+0000 7f21f57fa640 1 -- 172.21.15.55:0/4029880763 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f21ec00ccc0 con 0x7f21f80b3f80 2023-07-06T21:57:41.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.480+0000 7f21f57fa640 1 --2- 172.21.15.55:0/4029880763 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f21dc066430 0x7f21dc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.480+0000 7f21f57fa640 1 -- 172.21.15.55:0/4029880763 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f21ec0846c0 con 0x7f21f80b3f80 2023-07-06T21:57:41.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.480+0000 7f21f7fff640 1 -- 172.21.15.55:0/4029880763 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f21dc066430 msgr2=0x7f21dc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1694297670 2023-07-06T21:57:41.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.480+0000 7f21f7fff640 1 --2- 172.21.15.55:0/4029880763 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f21dc066430 0x7f21dc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:41.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.484+0000 7f21f57fa640 1 -- 172.21.15.55:0/4029880763 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21ec0516c0 con 0x7f21f80b3f80 2023-07-06T21:57:41.547 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:41.548+0000 7f646fe46180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:57:41.612 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:41.616+0000 7f646fe46180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:57:41.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.644+0000 7f21fec34640 1 -- 172.21.15.55:0/4029880763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21f80b7f70 con 0x7f21f80b3f80 2023-07-06T21:57:41.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.644+0000 7f21f57fa640 1 -- 172.21.15.55:0/4029880763 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f21ec054ce0 con 0x7f21f80b3f80 2023-07-06T21:57:41.643 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:57:41.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.648+0000 7f21fec34640 1 -- 172.21.15.55:0/4029880763 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f21dc066430 msgr2=0x7f21dc0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:41.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.648+0000 7f21fec34640 1 --2- 172.21.15.55:0/4029880763 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f21dc066430 0x7f21dc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.648+0000 7f21fec34640 1 -- 172.21.15.55:0/4029880763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21f80b3f80 msgr2=0x7f21f814e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:41.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.648+0000 7f21fec34640 1 --2- 172.21.15.55:0/4029880763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21f80b3f80 0x7f21f814e1a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00e870 tx=0x7f21ec00ec70 comp rx=0 tx=0).stop 2023-07-06T21:57:41.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.648+0000 7f21fec34640 1 -- 172.21.15.55:0/4029880763 shutdown_connections 2023-07-06T21:57:41.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.648+0000 7f21fec34640 1 --2- 172.21.15.55:0/4029880763 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f21dc066430 0x7f21dc0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.648+0000 7f21fec34640 1 --2- 172.21.15.55:0/4029880763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f815b850 0x7f21f80b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.648+0000 7f21fec34640 1 --2- 172.21.15.55:0/4029880763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21f80ccd30 0x7f21f8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.648+0000 7f21fec34640 1 --2- 172.21.15.55:0/4029880763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21f80b3f80 0x7f21f814e1a0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.648+0000 7f21fec34640 1 -- 172.21.15.55:0/4029880763 >> 172.21.15.55:0/4029880763 conn(0x7f21f80cec20 msgr2=0x7f21f8069c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:41.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.648+0000 7f21fec34640 1 -- 172.21.15.55:0/4029880763 shutdown_connections 2023-07-06T21:57:41.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.648+0000 7f21fec34640 1 -- 172.21.15.55:0/4029880763 wait complete. 2023-07-06T21:57:41.666 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T21:57:41.698 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:57:41.698 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:57:41.698 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:57:41.707 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:41.706+0000 7f98d523a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:57:41.840 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:41.838+0000 7f98d523a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:57:41.866 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:57:41.866 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:57:41.866 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:57:41.875 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:41.876+0000 7f646fe46180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:57:41.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.888+0000 7fd47b937640 1 Processor -- start 2023-07-06T21:57:41.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.888+0000 7fd47b937640 1 -- start start 2023-07-06T21:57:41.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.892+0000 7fd47b937640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd4740b3870 0x7fd4740b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.892+0000 7fd47b937640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4740d03c0 0x7fd4740d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.892+0000 7fd47b937640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4740b4210 con 0x7fd47415b850 2023-07-06T21:57:41.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.892+0000 7fd47b937640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4740b2b80 con 0x7fd4740d03c0 2023-07-06T21:57:41.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.892+0000 7fd47b937640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4740cff30 con 0x7fd4740b3870 2023-07-06T21:57:41.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.892+0000 7fd479ed4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4740d03c0 0x7fd4740d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.892+0000 7fd478ed2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd4740b3870 0x7fd4740b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.892+0000 7fd479ed4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4740d03c0 0x7fd4740d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45828/0 (socket says 172.21.15.55:45828) 2023-07-06T21:57:41.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.892+0000 7fd479ed4640 1 -- 172.21.15.55:0/1968874548 learned_addr learned my addr 172.21.15.55:0/1968874548 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:41.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.892+0000 7fd479ed4640 1 -- 172.21.15.55:0/1968874548 >> v2:172.21.15.138:3300/0 conn(0x7fd4740b3870 msgr2=0x7fd4740b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:41.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.892+0000 7fd479ed4640 1 --2- 172.21.15.55:0/1968874548 >> v2:172.21.15.138:3300/0 conn(0x7fd4740b3870 0x7fd4740b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.892+0000 7fd479ed4640 1 -- 172.21.15.55:0/1968874548 >> v1:172.21.15.138:6789/0 conn(0x7fd47415b850 legacy=0x7fd4740cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:41.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.892+0000 7fd479ed4640 1 -- 172.21.15.55:0/1968874548 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4740b22e0 con 0x7fd4740d03c0 2023-07-06T21:57:41.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.896+0000 7fd479ed4640 1 --2- 172.21.15.55:0/1968874548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740d03c0 0x7fd4740d07c0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd4740cebd0 tx=0x7fd46c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a9ab682bc31117 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:41.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.896+0000 7fd46bfff640 1 -- 172.21.15.55:0/1968874548 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0a5740 con 0x7fd4740d03c0 2023-07-06T21:57:41.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.896+0000 7fd46bfff640 1 -- 172.21.15.55:0/1968874548 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c0a58a0 con 0x7fd4740d03c0 2023-07-06T21:57:41.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.896+0000 7fd46bfff640 1 -- 172.21.15.55:0/1968874548 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0a5c30 con 0x7fd4740d03c0 2023-07-06T21:57:41.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.896+0000 7fd47b937640 1 -- 172.21.15.55:0/1968874548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740d03c0 msgr2=0x7fd4740d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:41.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.896+0000 7fd47b937640 1 --2- 172.21.15.55:0/1968874548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740d03c0 0x7fd4740d07c0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd4740cebd0 tx=0x7fd46c01c880 comp rx=0 tx=0).stop 2023-07-06T21:57:41.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.896+0000 7fd47b937640 1 -- 172.21.15.55:0/1968874548 shutdown_connections 2023-07-06T21:57:41.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.896+0000 7fd47b937640 1 --2- 172.21.15.55:0/1968874548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740d03c0 0x7fd4740d07c0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.896+0000 7fd47b937640 1 --2- 172.21.15.55:0/1968874548 >> v2:172.21.15.138:3300/0 conn(0x7fd4740b3870 0x7fd4740b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.896+0000 7fd47b937640 1 -- 172.21.15.55:0/1968874548 >> 172.21.15.55:0/1968874548 conn(0x7fd4740cec20 msgr2=0x7fd4740cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:41.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.896+0000 7fd47b937640 1 -- 172.21.15.55:0/1968874548 shutdown_connections 2023-07-06T21:57:41.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.896+0000 7fd47b937640 1 -- 172.21.15.55:0/1968874548 wait complete. 2023-07-06T21:57:41.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd47b937640 1 Processor -- start 2023-07-06T21:57:41.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd47b937640 1 -- start start 2023-07-06T21:57:41.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd47b937640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740b3870 0x7fd474152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd47b937640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4740d03c0 0x7fd474153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd47b937640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd47415b850 0x7fd4741539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd47b937640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47415c520 con 0x7fd4740b3870 2023-07-06T21:57:41.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd47b937640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47415bf60 con 0x7fd47415b850 2023-07-06T21:57:41.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd47b937640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47415c240 con 0x7fd4740d03c0 2023-07-06T21:57:41.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd4796d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740b3870 0x7fd474152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd4796d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740b3870 0x7fd474152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45840/0 (socket says 172.21.15.55:45840) 2023-07-06T21:57:41.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd4796d3640 1 -- 172.21.15.55:0/1186463112 learned_addr learned my addr 172.21.15.55:0/1186463112 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:41.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd478ed2640 1 --2- 172.21.15.55:0/1186463112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4740d03c0 0x7fd474153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd479ed4640 1 --2- 172.21.15.55:0/1186463112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd47415b850 0x7fd4741539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:41.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd4796d3640 1 -- 172.21.15.55:0/1186463112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4740d03c0 msgr2=0x7fd474153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:41.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd4796d3640 1 --2- 172.21.15.55:0/1186463112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4740d03c0 0x7fd474153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd4796d3640 1 -- 172.21.15.55:0/1186463112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd47415b850 msgr2=0x7fd4741539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:41.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd4796d3640 1 --2- 172.21.15.55:0/1186463112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd47415b850 0x7fd4741539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:41.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd4796d3640 1 -- 172.21.15.55:0/1186463112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c009b30 con 0x7fd4740b3870 2023-07-06T21:57:41.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd4796d3640 1 --2- 172.21.15.55:0/1186463112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740b3870 0x7fd474152f30 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fd47000c3c0 tx=0x7fd47000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:41.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd469ffb640 1 -- 172.21.15.55:0/1186463112 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4700052d0 con 0x7fd4740b3870 2023-07-06T21:57:41.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd469ffb640 1 -- 172.21.15.55:0/1186463112 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd470005430 con 0x7fd4740b3870 2023-07-06T21:57:41.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd469ffb640 1 -- 172.21.15.55:0/1186463112 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470003840 con 0x7fd4740b3870 2023-07-06T21:57:41.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd47b937640 1 -- 172.21.15.55:0/1186463112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd474158c80 con 0x7fd4740b3870 2023-07-06T21:57:41.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.900+0000 7fd47b937640 1 -- 172.21.15.55:0/1186463112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4740c9390 con 0x7fd4740b3870 2023-07-06T21:57:41.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.904+0000 7fd47b937640 1 -- 172.21.15.55:0/1186463112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd474158ae0 con 0x7fd4740b3870 2023-07-06T21:57:41.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.904+0000 7fd469ffb640 1 -- 172.21.15.55:0/1186463112 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fd4700039a0 con 0x7fd4740b3870 2023-07-06T21:57:41.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.904+0000 7fd469ffb640 1 --2- 172.21.15.55:0/1186463112 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fd458066430 0x7fd4580688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:41.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.904+0000 7fd469ffb640 1 -- 172.21.15.55:0/1186463112 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fd470083740 con 0x7fd4740b3870 2023-07-06T21:57:41.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.904+0000 7fd478ed2640 1 -- 172.21.15.55:0/1186463112 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fd458066430 msgr2=0x7fd4580688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1694297670 2023-07-06T21:57:41.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.904+0000 7fd478ed2640 1 --2- 172.21.15.55:0/1186463112 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fd458066430 0x7fd4580688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:41.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:41.912+0000 7fd469ffb640 1 -- 172.21.15.55:0/1186463112 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd474158ae0 con 0x7fd4740b3870 2023-07-06T21:57:41.965 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:41.966+0000 7f98d523a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:57:42.023 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:42.024+0000 7f646fe46180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:57:42.034 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:42.034+0000 7f98d523a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:57:42.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.080+0000 7fd47b937640 1 -- 172.21.15.55:0/1186463112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd474158ae0 con 0x7fd4740b3870 2023-07-06T21:57:42.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.080+0000 7fd469ffb640 1 -- 172.21.15.55:0/1186463112 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v90) v1 ==== 80+0+470 (secure 0 0 0) 0x7fd474158ae0 con 0x7fd4740b3870 2023-07-06T21:57:42.078 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1073362678 2023-07-07T21:57:37.612097+0000 2023-07-06T21:57:42.078 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1848976334 2023-07-07T21:57:37.612097+0000 2023-07-06T21:57:42.079 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1541327786 2023-07-07T21:57:37.612097+0000 2023-07-06T21:57:42.079 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1765249513 2023-07-07T21:57:37.612097+0000 2023-07-06T21:57:42.079 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/3540074910 2023-07-07T21:57:37.612097+0000 2023-07-06T21:57:42.079 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/3540074910 2023-07-07T21:57:37.612097+0000 2023-07-06T21:57:42.079 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1768372577 2023-07-07T21:57:37.612097+0000 2023-07-06T21:57:42.079 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1203793928 2023-07-07T21:57:37.612097+0000 2023-07-06T21:57:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-07-06T21:57:42.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.084+0000 7fd47b937640 1 -- 172.21.15.55:0/1186463112 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fd458066430 msgr2=0x7fd4580688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:42.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.084+0000 7fd47b937640 1 --2- 172.21.15.55:0/1186463112 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fd458066430 0x7fd4580688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.084+0000 7fd47b937640 1 -- 172.21.15.55:0/1186463112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740b3870 msgr2=0x7fd474152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:42.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.084+0000 7fd47b937640 1 --2- 172.21.15.55:0/1186463112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740b3870 0x7fd474152f30 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fd47000c3c0 tx=0x7fd47000c880 comp rx=0 tx=0).stop 2023-07-06T21:57:42.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.084+0000 7fd47b937640 1 -- 172.21.15.55:0/1186463112 shutdown_connections 2023-07-06T21:57:42.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.084+0000 7fd47b937640 1 --2- 172.21.15.55:0/1186463112 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fd458066430 0x7fd4580688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.084+0000 7fd47b937640 1 --2- 172.21.15.55:0/1186463112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd47415b850 0x7fd4741539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.084+0000 7fd47b937640 1 --2- 172.21.15.55:0/1186463112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4740d03c0 0x7fd474153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.084+0000 7fd47b937640 1 --2- 172.21.15.55:0/1186463112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740b3870 0x7fd474152f30 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.084+0000 7fd47b937640 1 -- 172.21.15.55:0/1186463112 >> 172.21.15.55:0/1186463112 conn(0x7fd4740cec20 msgr2=0x7fd4740693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:42.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.084+0000 7fd47b937640 1 -- 172.21.15.55:0/1186463112 shutdown_connections 2023-07-06T21:57:42.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.084+0000 7fd47b937640 1 -- 172.21.15.55:0/1186463112 wait complete. 2023-07-06T21:57:42.100 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T21:57:42.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:42.101 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-06T21:57:42.159 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:42.160+0000 7f646fe46180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:57:42.165 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T21:57:42.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:57:42.165 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T21:57:42.167 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:42.166+0000 7f98d523a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:57:42.175 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:57:42.175 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:42.184 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:57:42.184 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:57:42.185 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:42.224 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T21:57:42.224 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:57:42.225 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:42.233 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:57:42.234 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:57:42.235 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:42.236+0000 7f646fe46180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:57:42.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.380+0000 7fe3eaf9f640 1 Processor -- start 2023-07-06T21:57:42.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.380+0000 7fe3eaf9f640 1 -- start start 2023-07-06T21:57:42.379 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:42.380+0000 7f646fe46180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:57:42.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.380+0000 7fe3eaf9f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3e40b1fe0 0x7fe3e4166ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:42.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.380+0000 7fe3eaf9f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e40cd1c0 con 0x7fe3e40ce610 2023-07-06T21:57:42.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.380+0000 7fe3eaf9f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e40cecf0 con 0x7fe3e40b7cd0 2023-07-06T21:57:42.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.380+0000 7fe3eaf9f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e40d2310 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.380+0000 7fe3e953c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3e40b1fe0 0x7fe3e4166ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:42.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.380+0000 7fe3e953c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3e40b1fe0 0x7fe3e4166ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45854/0 (socket says 172.21.15.55:45854) 2023-07-06T21:57:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.380+0000 7fe3e953c640 1 -- 172.21.15.55:0/2260541661 learned_addr learned my addr 172.21.15.55:0/2260541661 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.380+0000 7fe3e953c640 1 -- 172.21.15.55:0/2260541661 >> v1:172.21.15.138:6789/0 conn(0x7fe3e40b7cd0 legacy=0x7fe3e40ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.380+0000 7fe3e953c640 1 -- 172.21.15.55:0/2260541661 >> v1:172.21.15.55:6789/0 conn(0x7fe3e40ce610 legacy=0x7fe3e40b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.384+0000 7fe3e953c640 1 -- 172.21.15.55:0/2260541661 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e40cea60 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.384+0000 7fe3e953c640 1 --2- 172.21.15.55:0/2260541661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40b1fe0 0x7fe3e4166ba0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009e50 tx=0x7fe3dc01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e763adfee4f5e4d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.384+0000 7fe3e37fe640 1 -- 172.21.15.55:0/2260541661 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc0a5640 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.384+0000 7fe3e37fe640 1 -- 172.21.15.55:0/2260541661 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc0a57a0 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.384+0000 7fe3e37fe640 1 -- 172.21.15.55:0/2260541661 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc0a5b30 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.384+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/2260541661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40b1fe0 msgr2=0x7fe3e4166ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:42.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.384+0000 7fe3eaf9f640 1 --2- 172.21.15.55:0/2260541661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40b1fe0 0x7fe3e4166ba0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009e50 tx=0x7fe3dc01c980 comp rx=0 tx=0).stop 2023-07-06T21:57:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.384+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/2260541661 shutdown_connections 2023-07-06T21:57:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.384+0000 7fe3eaf9f640 1 --2- 172.21.15.55:0/2260541661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40b1fe0 0x7fe3e4166ba0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.384+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/2260541661 >> 172.21.15.55:0/2260541661 conn(0x7fe3e40ceee0 msgr2=0x7fe3e40cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.384+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/2260541661 shutdown_connections 2023-07-06T21:57:42.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.384+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/2260541661 wait complete. 2023-07-06T21:57:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3eaf9f640 1 Processor -- start 2023-07-06T21:57:42.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3eaf9f640 1 -- start start 2023-07-06T21:57:42.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3eaf9f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3e40b1fe0 0x7fe3e415aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:42.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3eaf9f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3e40b7cd0 0x7fe3e40cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:42.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3eaf9f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40ce610 0x7fe3e40cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:42.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3eaf9f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e40cc4b0 con 0x7fe3e40ce610 2023-07-06T21:57:42.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3eaf9f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e41f3f60 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3eaf9f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e41f41d0 con 0x7fe3e40b7cd0 2023-07-06T21:57:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3e953c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40ce610 0x7fe3e40cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3e953c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40ce610 0x7fe3e40cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45870/0 (socket says 172.21.15.55:45870) 2023-07-06T21:57:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3e953c640 1 -- 172.21.15.55:0/1157810132 learned_addr learned my addr 172.21.15.55:0/1157810132 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3e8d3b640 1 --2- 172.21.15.55:0/1157810132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3e40b1fe0 0x7fe3e415aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3e3fff640 1 --2- 172.21.15.55:0/1157810132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3e40b7cd0 0x7fe3e40cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3e8d3b640 1 -- 172.21.15.55:0/1157810132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3e40b7cd0 msgr2=0x7fe3e40cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3e8d3b640 1 --2- 172.21.15.55:0/1157810132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3e40b7cd0 0x7fe3e40cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3e8d3b640 1 -- 172.21.15.55:0/1157810132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40ce610 msgr2=0x7fe3e40cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3e8d3b640 1 --2- 172.21.15.55:0/1157810132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40ce610 0x7fe3e40cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3e8d3b640 1 -- 172.21.15.55:0/1157810132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc009b30 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.388+0000 7fe3e8d3b640 1 --2- 172.21.15.55:0/1157810132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3e40b1fe0 0x7fe3e415aa70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8001ec0 tx=0x7fe3d800c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.392+0000 7fe3e17fa640 1 -- 172.21.15.55:0/1157810132 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d80052d0 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.392+0000 7fe3e17fa640 1 -- 172.21.15.55:0/1157810132 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d8005430 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.392+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/1157810132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e40ca590 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.392+0000 7fe3e17fa640 1 -- 172.21.15.55:0/1157810132 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8003840 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.392+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/1157810132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e41f4470 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.392+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/1157810132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e4066d60 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.392+0000 7fe3e17fa640 1 -- 172.21.15.55:0/1157810132 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fe3d80039a0 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.392+0000 7fe3e17fa640 1 --2- 172.21.15.55:0/1157810132 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fe3c8066430 0x7fe3c80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.392+0000 7fe3e3fff640 1 -- 172.21.15.55:0/1157810132 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fe3c8066430 msgr2=0x7fe3c80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1694297670 2023-07-06T21:57:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.392+0000 7fe3e17fa640 1 -- 172.21.15.55:0/1157810132 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fe3d80837b0 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.392+0000 7fe3e3fff640 1 --2- 172.21.15.55:0/1157810132 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fe3c8066430 0x7fe3c80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:42.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.396+0000 7fe3e17fa640 1 -- 172.21.15.55:0/1157810132 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3d80507d0 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.584+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/1157810132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3e4071aa0 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.584+0000 7fe3e17fa640 1 -- 172.21.15.55:0/1157810132 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fe3d8053df0 con 0x7fe3e40b1fe0 2023-07-06T21:57:42.584 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:42.584 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2651551074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2651551074},{"type":"v1","addr":"172.21.15.138:6835","nonce":2651551074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1024060506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1024060506},{"type":"v1","addr":"172.21.15.138:6834","nonce":1024060506}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6933,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3347534333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3347534333},{"type":"v1","addr":"172.21.15.55:6836","nonce":3347534333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:57:25.541950+0000","modified":"2023-07-06T21:57:28.574413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3154142571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3154142571},{"type":"v1","addr":"172.21.15.55:6837","nonce":3154142571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-06T21:57:42.584 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 32 2023-07-06T21:57:42.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.588+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/1157810132 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fe3c8066430 msgr2=0x7fe3c80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:42.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.588+0000 7fe3eaf9f640 1 --2- 172.21.15.55:0/1157810132 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fe3c8066430 0x7fe3c80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.588+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/1157810132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3e40b1fe0 msgr2=0x7fe3e415aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:42.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.588+0000 7fe3eaf9f640 1 --2- 172.21.15.55:0/1157810132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3e40b1fe0 0x7fe3e415aa70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8001ec0 tx=0x7fe3d800c890 comp rx=0 tx=0).stop 2023-07-06T21:57:42.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.588+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/1157810132 shutdown_connections 2023-07-06T21:57:42.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.588+0000 7fe3eaf9f640 1 --2- 172.21.15.55:0/1157810132 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fe3c8066430 0x7fe3c80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.588+0000 7fe3eaf9f640 1 --2- 172.21.15.55:0/1157810132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40ce610 0x7fe3e40cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.588+0000 7fe3eaf9f640 1 --2- 172.21.15.55:0/1157810132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3e40b7cd0 0x7fe3e40cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.588+0000 7fe3eaf9f640 1 --2- 172.21.15.55:0/1157810132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3e40b1fe0 0x7fe3e415aa70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.588+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/1157810132 >> 172.21.15.55:0/1157810132 conn(0x7fe3e40ceee0 msgr2=0x7fe3e40ccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:42.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.588+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/1157810132 shutdown_connections 2023-07-06T21:57:42.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.588+0000 7fe3eaf9f640 1 -- 172.21.15.55:0/1157810132 wait complete. 2023-07-06T21:57:42.605 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:42.708 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:42.706+0000 7f98d523a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:57:42.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.752+0000 7fab8540b640 1 Processor -- start 2023-07-06T21:57:42.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.752+0000 7fab8540b640 1 -- start start 2023-07-06T21:57:42.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab8540b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fab8015b9d0 0x7fab8015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:42.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab8540b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab800ce340 0x7fab800ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:42.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab8540b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8006a160 con 0x7fab800b3d10 2023-07-06T21:57:42.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab8540b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8015bda0 con 0x7fab8015b9d0 2023-07-06T21:57:42.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab8540b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab80069590 con 0x7fab800ce340 2023-07-06T21:57:42.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab7f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fab800b3d10 0x7fab8015c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50876/0 (socket says 172.21.15.55:50876) 2023-07-06T21:57:42.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab7f7fe640 1 -- 172.21.15.55:0/656570744 learned_addr learned my addr 172.21.15.55:0/656570744 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:42.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab7effd640 1 --2- 172.21.15.55:0/656570744 >> v2:172.21.15.138:3300/0 conn(0x7fab8015b9d0 0x7fab8015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:42.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab77fff640 1 --2- 172.21.15.55:0/656570744 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab800ce340 0x7fab800ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:42.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab7e7fc640 1 -- 172.21.15.55:0/656570744 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334901339 0 0) 0x7fab8006a160 con 0x7fab800b3d10 2023-07-06T21:57:42.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab7e7fc640 1 -- 172.21.15.55:0/656570744 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab6c003530 con 0x7fab800b3d10 2023-07-06T21:57:42.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab7effd640 1 -- 172.21.15.55:0/656570744 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab800ce340 msgr2=0x7fab800ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:42.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab7effd640 1 --2- 172.21.15.55:0/656570744 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab800ce340 0x7fab800ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab7effd640 1 -- 172.21.15.55:0/656570744 >> v1:172.21.15.55:6789/0 conn(0x7fab800b3d10 legacy=0x7fab8015c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:42.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab7effd640 1 -- 172.21.15.55:0/656570744 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab80069830 con 0x7fab8015b9d0 2023-07-06T21:57:42.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.756+0000 7fab77fff640 1 --2- 172.21.15.55:0/656570744 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab800ce340 0x7fab800ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:42.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab7effd640 1 --2- 172.21.15.55:0/656570744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab8015b9d0 0x7fab8015f4e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fab700097c0 tx=0x7fab7001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b75cda43048a29a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:42.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab7e7fc640 1 -- 172.21.15.55:0/656570744 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab700ab620 con 0x7fab8015b9d0 2023-07-06T21:57:42.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab7e7fc640 1 -- 172.21.15.55:0/656570744 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab700ab780 con 0x7fab8015b9d0 2023-07-06T21:57:42.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab7e7fc640 1 -- 172.21.15.55:0/656570744 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab700abb10 con 0x7fab8015b9d0 2023-07-06T21:57:42.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 -- 172.21.15.55:0/656570744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab8015b9d0 msgr2=0x7fab8015f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:42.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 --2- 172.21.15.55:0/656570744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab8015b9d0 0x7fab8015f4e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fab700097c0 tx=0x7fab7001c450 comp rx=0 tx=0).stop 2023-07-06T21:57:42.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 -- 172.21.15.55:0/656570744 shutdown_connections 2023-07-06T21:57:42.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 --2- 172.21.15.55:0/656570744 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab800ce340 0x7fab800ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 --2- 172.21.15.55:0/656570744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab8015b9d0 0x7fab8015f4e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 -- 172.21.15.55:0/656570744 >> 172.21.15.55:0/656570744 conn(0x7fab800ced10 msgr2=0x7fab800cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:42.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 -- 172.21.15.55:0/656570744 shutdown_connections 2023-07-06T21:57:42.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 -- 172.21.15.55:0/656570744 wait complete. 2023-07-06T21:57:42.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 Processor -- start 2023-07-06T21:57:42.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 -- start start 2023-07-06T21:57:42.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab800b3d10 0x7fab800c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:42.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab800ce340 0x7fab800b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:42.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab8015b9d0 0x7fab800d1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:42.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab800c8800 con 0x7fab8015b9d0 2023-07-06T21:57:42.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab800b56f0 con 0x7fab800b3d10 2023-07-06T21:57:42.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.760+0000 7fab8540b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab800b7e90 con 0x7fab800ce340 2023-07-06T21:57:42.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab7f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab8015b9d0 0x7fab800d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:42.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab7f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab8015b9d0 0x7fab800d1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45884/0 (socket says 172.21.15.55:45884) 2023-07-06T21:57:42.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab7f7fe640 1 -- 172.21.15.55:0/1687763381 learned_addr learned my addr 172.21.15.55:0/1687763381 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:42.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab77fff640 1 --2- 172.21.15.55:0/1687763381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab800ce340 0x7fab800b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:42.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab7effd640 1 --2- 172.21.15.55:0/1687763381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab800b3d10 0x7fab800c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:42.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab7f7fe640 1 -- 172.21.15.55:0/1687763381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab800ce340 msgr2=0x7fab800b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:42.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab7f7fe640 1 --2- 172.21.15.55:0/1687763381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab800ce340 0x7fab800b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab7f7fe640 1 -- 172.21.15.55:0/1687763381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab800b3d10 msgr2=0x7fab800c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:42.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab7f7fe640 1 --2- 172.21.15.55:0/1687763381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab800b3d10 0x7fab800c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab7f7fe640 1 -- 172.21.15.55:0/1687763381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab68009420 con 0x7fab8015b9d0 2023-07-06T21:57:42.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab7f7fe640 1 --2- 172.21.15.55:0/1687763381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab8015b9d0 0x7fab800d1690 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fab7800caa0 tx=0x7fab7800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:42.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab777fe640 1 -- 172.21.15.55:0/1687763381 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7800ac00 con 0x7fab8015b9d0 2023-07-06T21:57:42.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab777fe640 1 -- 172.21.15.55:0/1687763381 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7800ad60 con 0x7fab8015b9d0 2023-07-06T21:57:42.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab777fe640 1 -- 172.21.15.55:0/1687763381 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78012620 con 0x7fab8015b9d0 2023-07-06T21:57:42.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab8540b640 1 -- 172.21.15.55:0/1687763381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab70009420 con 0x7fab8015b9d0 2023-07-06T21:57:42.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab8540b640 1 -- 172.21.15.55:0/1687763381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab800cbad0 con 0x7fab8015b9d0 2023-07-06T21:57:42.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab8540b640 1 -- 172.21.15.55:0/1687763381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab800b5860 con 0x7fab8015b9d0 2023-07-06T21:57:42.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.764+0000 7fab777fe640 1 -- 172.21.15.55:0/1687763381 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fab78007070 con 0x7fab8015b9d0 2023-07-06T21:57:42.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.768+0000 7fab777fe640 1 --2- 172.21.15.55:0/1687763381 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fab60066430 0x7fab600688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:42.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.768+0000 7fab777fe640 1 -- 172.21.15.55:0/1687763381 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fab780841a0 con 0x7fab8015b9d0 2023-07-06T21:57:42.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.768+0000 7fab7effd640 1 -- 172.21.15.55:0/1687763381 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fab60066430 msgr2=0x7fab600688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1694297670 2023-07-06T21:57:42.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.768+0000 7fab7effd640 1 --2- 172.21.15.55:0/1687763381 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fab60066430 0x7fab600688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.772+0000 7fab777fe640 1 -- 172.21.15.55:0/1687763381 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab78051250 con 0x7fab8015b9d0 2023-07-06T21:57:42.794 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:42.794+0000 7f98d523a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:57:42.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.928+0000 7fab8540b640 1 -- 172.21.15.55:0/1687763381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab80066d60 con 0x7fab8015b9d0 2023-07-06T21:57:42.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.928+0000 7fab777fe640 1 -- 172.21.15.55:0/1687763381 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+19044 (secure 0 0 0) 0x7fab78054870 con 0x7fab8015b9d0 2023-07-06T21:57:42.927 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:42.928 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":90,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:57:37.612130+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:57:23.252496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-06T21:57:24.528387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/1073362678":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1848976334":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1541327786":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1765249513":"2023-07-07T21:57:37.612097+0000","172.21.15.55:6833/3540074910":"2023-07-07T21:57:37.612097+0000","172.21.15.55:6832/3540074910":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1768372577":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1203793928":"2023-07-07T21:57:37.612097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:42.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.932+0000 7fab8540b640 1 -- 172.21.15.55:0/1687763381 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fab60066430 msgr2=0x7fab600688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:42.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.932+0000 7fab8540b640 1 --2- 172.21.15.55:0/1687763381 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fab60066430 0x7fab600688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.932+0000 7fab8540b640 1 -- 172.21.15.55:0/1687763381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab8015b9d0 msgr2=0x7fab800d1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:42.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.932+0000 7fab8540b640 1 --2- 172.21.15.55:0/1687763381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab8015b9d0 0x7fab800d1690 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fab7800caa0 tx=0x7fab7800cf60 comp rx=0 tx=0).stop 2023-07-06T21:57:42.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.932+0000 7fab8540b640 1 -- 172.21.15.55:0/1687763381 shutdown_connections 2023-07-06T21:57:42.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.932+0000 7fab8540b640 1 --2- 172.21.15.55:0/1687763381 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fab60066430 0x7fab600688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.932+0000 7fab8540b640 1 --2- 172.21.15.55:0/1687763381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab8015b9d0 0x7fab800d1690 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.932+0000 7fab8540b640 1 --2- 172.21.15.55:0/1687763381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab800ce340 0x7fab800b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.932+0000 7fab8540b640 1 --2- 172.21.15.55:0/1687763381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab800b3d10 0x7fab800c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:42.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.932+0000 7fab8540b640 1 -- 172.21.15.55:0/1687763381 >> 172.21.15.55:0/1687763381 conn(0x7fab800ced10 msgr2=0x7fab80154c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:42.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.932+0000 7fab8540b640 1 -- 172.21.15.55:0/1687763381 shutdown_connections 2023-07-06T21:57:42.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:42.932+0000 7fab8540b640 1 -- 172.21.15.55:0/1687763381 wait complete. 2023-07-06T21:57:42.940 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:42.938+0000 7f98d523a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:57:42.950 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:57:23.252496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:57:24.528387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:57:42.951 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:57:42.964 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:42.968+0000 7f646fe46180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:57:43.023 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:43.022+0000 7f98d523a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:57:43.055 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.056+0000 7f646fe46180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:57:43.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb1096f9640 1 Processor -- start 2023-07-06T21:57:43.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb1096f9640 1 -- start start 2023-07-06T21:57:43.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb1096f9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb10406f470 0x7fb1040c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb1096f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1040c9360 0x7fb10406f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb1096f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb10406fd80 0x7fb10415bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb1096f9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb104158550 con 0x7fb1040c9360 2023-07-06T21:57:43.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb1096f9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1040c9800 con 0x7fb10406f470 2023-07-06T21:57:43.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb1096f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040c9ae0 con 0x7fb10406fd80 2023-07-06T21:57:43.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb0fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1040c9360 0x7fb10406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb0fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1040c9360 0x7fb10406f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45892/0 (socket says 172.21.15.55:45892) 2023-07-06T21:57:43.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb0fbfff640 1 -- 172.21.15.55:0/3374588165 learned_addr learned my addr 172.21.15.55:0/3374588165 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:43.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb1037fe640 1 --2- 172.21.15.55:0/3374588165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb10406fd80 0x7fb10415bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb102ffd640 1 --2- 172.21.15.55:0/3374588165 >> v2:172.21.15.138:3300/0 conn(0x7fb10406f470 0x7fb1040c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb0fbfff640 1 -- 172.21.15.55:0/3374588165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb10406fd80 msgr2=0x7fb10415bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:43.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb0fbfff640 1 --2- 172.21.15.55:0/3374588165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb10406fd80 0x7fb10415bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb0fbfff640 1 -- 172.21.15.55:0/3374588165 >> v2:172.21.15.138:3300/0 conn(0x7fb10406f470 msgr2=0x7fb1040c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:43.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb0fbfff640 1 --2- 172.21.15.55:0/3374588165 >> v2:172.21.15.138:3300/0 conn(0x7fb10406f470 0x7fb1040c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.100+0000 7fb0fbfff640 1 -- 172.21.15.55:0/3374588165 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1040c9dc0 con 0x7fb1040c9360 2023-07-06T21:57:43.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.104+0000 7fb0fbfff640 1 --2- 172.21.15.55:0/3374588165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1040c9360 0x7fb10406f840 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fb1040cb8d0 tx=0x7fb0ec01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58087a19c9296bb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:43.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.104+0000 7fb1027fc640 1 -- 172.21.15.55:0/3374588165 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0a7bb0 con 0x7fb1040c9360 2023-07-06T21:57:43.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.104+0000 7fb1027fc640 1 -- 172.21.15.55:0/3374588165 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec0a7d10 con 0x7fb1040c9360 2023-07-06T21:57:43.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.104+0000 7fb1027fc640 1 -- 172.21.15.55:0/3374588165 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0af660 con 0x7fb1040c9360 2023-07-06T21:57:43.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.104+0000 7fb1096f9640 1 -- 172.21.15.55:0/3374588165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1040c9360 msgr2=0x7fb10406f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:43.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.104+0000 7fb1096f9640 1 --2- 172.21.15.55:0/3374588165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1040c9360 0x7fb10406f840 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fb1040cb8d0 tx=0x7fb0ec01eba0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.104+0000 7fb1096f9640 1 -- 172.21.15.55:0/3374588165 shutdown_connections 2023-07-06T21:57:43.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.104+0000 7fb1096f9640 1 --2- 172.21.15.55:0/3374588165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb10406fd80 0x7fb10415bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.104+0000 7fb1096f9640 1 --2- 172.21.15.55:0/3374588165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1040c9360 0x7fb10406f840 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.104+0000 7fb1096f9640 1 --2- 172.21.15.55:0/3374588165 >> v2:172.21.15.138:3300/0 conn(0x7fb10406f470 0x7fb1040c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.104+0000 7fb1096f9640 1 -- 172.21.15.55:0/3374588165 >> 172.21.15.55:0/3374588165 conn(0x7fb1040cea70 msgr2=0x7fb1040ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:43.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.104+0000 7fb1096f9640 1 -- 172.21.15.55:0/3374588165 shutdown_connections 2023-07-06T21:57:43.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.104+0000 7fb1096f9640 1 -- 172.21.15.55:0/3374588165 wait complete. 2023-07-06T21:57:43.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb1096f9640 1 Processor -- start 2023-07-06T21:57:43.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb1096f9640 1 -- start start 2023-07-06T21:57:43.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb1096f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb10406f470 0x7fb10415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb1096f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb10406fd80 0x7fb1040c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb1096f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1040c9360 0x7fb10406b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb1096f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10415b1b0 con 0x7fb1040c9360 2023-07-06T21:57:43.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb1096f9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb104159bd0 con 0x7fb10406f470 2023-07-06T21:57:43.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb1096f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb104159eb0 con 0x7fb10406fd80 2023-07-06T21:57:43.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb1037fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1040c9360 0x7fb10406b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb102ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb10406f470 0x7fb10415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb1037fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1040c9360 0x7fb10406b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45894/0 (socket says 172.21.15.55:45894) 2023-07-06T21:57:43.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb1037fe640 1 -- 172.21.15.55:0/1877433415 learned_addr learned my addr 172.21.15.55:0/1877433415 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:43.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb0fbfff640 1 --2- 172.21.15.55:0/1877433415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb10406fd80 0x7fb1040c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb0fbfff640 1 -- 172.21.15.55:0/1877433415 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb10406f470 msgr2=0x7fb10415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:43.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb0fbfff640 1 --2- 172.21.15.55:0/1877433415 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb10406f470 0x7fb10415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb0fbfff640 1 -- 172.21.15.55:0/1877433415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1040c9360 msgr2=0x7fb10406b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:43.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb0fbfff640 1 --2- 172.21.15.55:0/1877433415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1040c9360 0x7fb10406b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb0fbfff640 1 -- 172.21.15.55:0/1877433415 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec00b770 con 0x7fb10406fd80 2023-07-06T21:57:43.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb1037fe640 1 --2- 172.21.15.55:0/1877433415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1040c9360 0x7fb10406b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:43.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb0fbfff640 1 --2- 172.21.15.55:0/1877433415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb10406fd80 0x7fb1040c7580 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0ae000 tx=0x7fb0ec01b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:43.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.108+0000 7fb0fb7fe640 1 -- 172.21.15.55:0/1877433415 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0afd60 con 0x7fb10406fd80 2023-07-06T21:57:43.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.112+0000 7fb0fb7fe640 1 -- 172.21.15.55:0/1877433415 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec0ba460 con 0x7fb10406fd80 2023-07-06T21:57:43.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.112+0000 7fb1096f9640 1 -- 172.21.15.55:0/1877433415 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10415a190 con 0x7fb10406fd80 2023-07-06T21:57:43.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.112+0000 7fb0fb7fe640 1 -- 172.21.15.55:0/1877433415 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0ba810 con 0x7fb10406fd80 2023-07-06T21:57:43.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.112+0000 7fb1096f9640 1 -- 172.21.15.55:0/1877433415 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10415a750 con 0x7fb10406fd80 2023-07-06T21:57:43.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.112+0000 7fb1096f9640 1 -- 172.21.15.55:0/1877433415 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10415a940 con 0x7fb10406fd80 2023-07-06T21:57:43.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.112+0000 7fb0fb7fe640 1 -- 172.21.15.55:0/1877433415 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fb0ec0ba970 con 0x7fb10406fd80 2023-07-06T21:57:43.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.112+0000 7fb0fb7fe640 1 --2- 172.21.15.55:0/1877433415 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fb0e4066430 0x7fb0e40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.112+0000 7fb102ffd640 1 -- 172.21.15.55:0/1877433415 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fb0e4066430 msgr2=0x7fb0e40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1694297670 2023-07-06T21:57:43.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.112+0000 7fb0fb7fe640 1 -- 172.21.15.55:0/1877433415 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fb0ec11eb70 con 0x7fb10406fd80 2023-07-06T21:57:43.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.112+0000 7fb102ffd640 1 --2- 172.21.15.55:0/1877433415 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fb0e4066430 0x7fb0e40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:43.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.116+0000 7fb0fb7fe640 1 -- 172.21.15.55:0/1877433415 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0ec0ebc80 con 0x7fb10406fd80 2023-07-06T21:57:43.214 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.216+0000 7f646fe46180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:57:43.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.272+0000 7fb1096f9640 1 -- 172.21.15.55:0/1877433415 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb104159ff0 con 0x7fb10406fd80 2023-07-06T21:57:43.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.272+0000 7fb0fb7fe640 1 -- 172.21.15.55:0/1877433415 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb104159ff0 con 0x7fb10406fd80 2023-07-06T21:57:43.270 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:57:43.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.272+0000 7fb1096f9640 1 -- 172.21.15.55:0/1877433415 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fb0e4066430 msgr2=0x7fb0e40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:43.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.272+0000 7fb1096f9640 1 --2- 172.21.15.55:0/1877433415 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fb0e4066430 0x7fb0e40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.272+0000 7fb1096f9640 1 -- 172.21.15.55:0/1877433415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb10406fd80 msgr2=0x7fb1040c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:43.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.272+0000 7fb1096f9640 1 --2- 172.21.15.55:0/1877433415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb10406fd80 0x7fb1040c7580 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0ae000 tx=0x7fb0ec01b940 comp rx=0 tx=0).stop 2023-07-06T21:57:43.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.272+0000 7fb1096f9640 1 -- 172.21.15.55:0/1877433415 shutdown_connections 2023-07-06T21:57:43.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.272+0000 7fb1096f9640 1 --2- 172.21.15.55:0/1877433415 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7fb0e4066430 0x7fb0e40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.272+0000 7fb1096f9640 1 --2- 172.21.15.55:0/1877433415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1040c9360 0x7fb10406b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.272+0000 7fb1096f9640 1 --2- 172.21.15.55:0/1877433415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb10406fd80 0x7fb1040c7580 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.272+0000 7fb1096f9640 1 --2- 172.21.15.55:0/1877433415 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb10406f470 0x7fb10415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.272+0000 7fb1096f9640 1 -- 172.21.15.55:0/1877433415 >> 172.21.15.55:0/1877433415 conn(0x7fb1040cea70 msgr2=0x7fb104157b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:43.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.272+0000 7fb1096f9640 1 -- 172.21.15.55:0/1877433415 shutdown_connections 2023-07-06T21:57:43.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.272+0000 7fb1096f9640 1 -- 172.21.15.55:0/1877433415 wait complete. 2023-07-06T21:57:43.291 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:57:43.293 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:43.294+0000 7f98d523a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:57:43.304 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.304+0000 7f646fe46180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:57:43.352 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:57:43.350+0000 7f98d523a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:57:43.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42f9b37640 1 Processor -- start 2023-07-06T21:57:43.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42f9b37640 1 -- start start 2023-07-06T21:57:43.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42f9b37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f4070d70 0x7f42f40b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42f9b37640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f42f40b1170 0x7f42f406eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42f9b37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f40cc030 con 0x7f42f40709a0 2023-07-06T21:57:43.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42f9b37640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f40b15f0 con 0x7f42f40b1170 2023-07-06T21:57:43.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42f9b37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40cc300 con 0x7f42f4070d70 2023-07-06T21:57:43.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42f37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f42f40709a0 0x7f42f40cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43580/0 (socket says 172.21.15.55:43580) 2023-07-06T21:57:43.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42f37fe640 1 -- 172.21.15.55:0/1720093752 learned_addr learned my addr 172.21.15.55:0/1720093752 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:43.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42ebfff640 1 --2- 172.21.15.55:0/1720093752 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f4070d70 0x7f42f40b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42f3fff640 1 --2- 172.21.15.55:0/1720093752 >> v2:172.21.15.138:3300/0 conn(0x7f42f40b1170 0x7f42f406eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42f2ffd640 1 -- 172.21.15.55:0/1720093752 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729331782 0 0) 0x7f42f40cc030 con 0x7f42f40709a0 2023-07-06T21:57:43.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42f2ffd640 1 -- 172.21.15.55:0/1720093752 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42e0003530 con 0x7f42f40709a0 2023-07-06T21:57:43.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42ebfff640 1 -- 172.21.15.55:0/1720093752 >> v2:172.21.15.138:3300/0 conn(0x7f42f40b1170 msgr2=0x7f42f406eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:43.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42ebfff640 1 --2- 172.21.15.55:0/1720093752 >> v2:172.21.15.138:3300/0 conn(0x7f42f40b1170 0x7f42f406eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42ebfff640 1 -- 172.21.15.55:0/1720093752 >> v1:172.21.15.55:6789/0 conn(0x7f42f40709a0 legacy=0x7f42f40cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:43.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.452+0000 7f42ebfff640 1 -- 172.21.15.55:0/1720093752 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f40cc5e0 con 0x7f42f4070d70 2023-07-06T21:57:43.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.456+0000 7f42ebfff640 1 --2- 172.21.15.55:0/1720093752 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f4070d70 0x7f42f40b0c30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0097f0 tx=0x7f42dc01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e56b7eb1d2eb3145 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:43.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.456+0000 7f42f2ffd640 1 -- 172.21.15.55:0/1720093752 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc0ab600 con 0x7f42f4070d70 2023-07-06T21:57:43.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.456+0000 7f42f2ffd640 1 -- 172.21.15.55:0/1720093752 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc0a7050 con 0x7f42f4070d70 2023-07-06T21:57:43.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.456+0000 7f42f2ffd640 1 -- 172.21.15.55:0/1720093752 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc0ab960 con 0x7f42f4070d70 2023-07-06T21:57:43.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.456+0000 7f42f9b37640 1 -- 172.21.15.55:0/1720093752 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f4070d70 msgr2=0x7f42f40b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:43.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.456+0000 7f42f9b37640 1 --2- 172.21.15.55:0/1720093752 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f4070d70 0x7f42f40b0c30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0097f0 tx=0x7f42dc01c3f0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f9b37640 1 -- 172.21.15.55:0/1720093752 shutdown_connections 2023-07-06T21:57:43.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f9b37640 1 --2- 172.21.15.55:0/1720093752 >> v2:172.21.15.138:3300/0 conn(0x7f42f40b1170 0x7f42f406eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f9b37640 1 --2- 172.21.15.55:0/1720093752 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f4070d70 0x7f42f40b0c30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f9b37640 1 -- 172.21.15.55:0/1720093752 >> 172.21.15.55:0/1720093752 conn(0x7f42f40cea70 msgr2=0x7f42f40ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:43.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f9b37640 1 -- 172.21.15.55:0/1720093752 shutdown_connections 2023-07-06T21:57:43.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f9b37640 1 -- 172.21.15.55:0/1720093752 wait complete. 2023-07-06T21:57:43.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f9b37640 1 Processor -- start 2023-07-06T21:57:43.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f9b37640 1 -- start start 2023-07-06T21:57:43.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f9b37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40709a0 0x7f42f406a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f9b37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42f4070d70 0x7f42f409ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f9b37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f40b1170 0x7f42f409d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f9b37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40c9130 con 0x7f42f40709a0 2023-07-06T21:57:43.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f9b37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40c8b00 con 0x7f42f4070d70 2023-07-06T21:57:43.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f9b37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f406abb0 con 0x7f42f40b1170 2023-07-06T21:57:43.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40709a0 0x7f42f406a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40709a0 0x7f42f406a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46382/0 (socket says 172.21.15.55:46382) 2023-07-06T21:57:43.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f37fe640 1 -- 172.21.15.55:0/3046866162 learned_addr learned my addr 172.21.15.55:0/3046866162 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:43.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42ebfff640 1 --2- 172.21.15.55:0/3046866162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42f4070d70 0x7f42f409ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f3fff640 1 --2- 172.21.15.55:0/3046866162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f40b1170 0x7f42f409d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f37fe640 1 -- 172.21.15.55:0/3046866162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f40b1170 msgr2=0x7f42f409d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:43.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f37fe640 1 --2- 172.21.15.55:0/3046866162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f40b1170 0x7f42f409d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f37fe640 1 -- 172.21.15.55:0/3046866162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42f4070d70 msgr2=0x7f42f409ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:43.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f37fe640 1 --2- 172.21.15.55:0/3046866162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42f4070d70 0x7f42f409ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f37fe640 1 -- 172.21.15.55:0/3046866162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc009420 con 0x7f42f40709a0 2023-07-06T21:57:43.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.460+0000 7f42f37fe640 1 --2- 172.21.15.55:0/3046866162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40709a0 0x7f42f406a670 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f42e400c3c0 tx=0x7f42e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:43.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.464+0000 7f42f0ff9640 1 -- 172.21.15.55:0/3046866162 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4005cf0 con 0x7f42f40709a0 2023-07-06T21:57:43.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.464+0000 7f42f0ff9640 1 -- 172.21.15.55:0/3046866162 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e4005e50 con 0x7f42f40709a0 2023-07-06T21:57:43.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.464+0000 7f42f0ff9640 1 -- 172.21.15.55:0/3046866162 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e40072f0 con 0x7f42f40709a0 2023-07-06T21:57:43.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.464+0000 7f42f9b37640 1 -- 172.21.15.55:0/3046866162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f40c8e50 con 0x7f42f40709a0 2023-07-06T21:57:43.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.464+0000 7f42f9b37640 1 -- 172.21.15.55:0/3046866162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f40c8820 con 0x7f42f40709a0 2023-07-06T21:57:43.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.464+0000 7f42f9b37640 1 -- 172.21.15.55:0/3046866162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f40c83a0 con 0x7f42f40709a0 2023-07-06T21:57:43.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.464+0000 7f42f0ff9640 1 -- 172.21.15.55:0/3046866162 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f42e4007450 con 0x7f42f40709a0 2023-07-06T21:57:43.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.464+0000 7f42f0ff9640 1 --2- 172.21.15.55:0/3046866162 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f42d4066430 0x7f42d40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.464+0000 7f42f0ff9640 1 -- 172.21.15.55:0/3046866162 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f42e4083820 con 0x7f42f40709a0 2023-07-06T21:57:43.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.464+0000 7f42ebfff640 1 -- 172.21.15.55:0/3046866162 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f42d4066430 msgr2=0x7f42d40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1694297670 2023-07-06T21:57:43.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.464+0000 7f42ebfff640 1 --2- 172.21.15.55:0/3046866162 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f42d4066430 0x7f42d40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:57:43.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.468+0000 7f42f0ff9640 1 -- 172.21.15.55:0/3046866162 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42f40c83a0 con 0x7f42f40709a0 2023-07-06T21:57:43.597 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.600+0000 7f646fe46180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:57:43.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.624+0000 7f42f9b37640 1 -- 172.21.15.55:0/3046866162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f42f40c83a0 con 0x7f42f40709a0 2023-07-06T21:57:43.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.624+0000 7f42f0ff9640 1 -- 172.21.15.55:0/3046866162 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v90) v1 ==== 92+0+10 (secure 0 0 0) 0x7f42e4017020 con 0x7f42f40709a0 2023-07-06T21:57:43.624 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:57:43.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.628+0000 7f42f9b37640 1 -- 172.21.15.55:0/3046866162 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f42d4066430 msgr2=0x7f42d40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:57:43.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.628+0000 7f42f9b37640 1 --2- 172.21.15.55:0/3046866162 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f42d4066430 0x7f42d40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.628+0000 7f42f9b37640 1 -- 172.21.15.55:0/3046866162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40709a0 msgr2=0x7f42f406a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:43.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.628+0000 7f42f9b37640 1 --2- 172.21.15.55:0/3046866162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40709a0 0x7f42f406a670 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f42e400c3c0 tx=0x7f42e400c880 comp rx=0 tx=0).stop 2023-07-06T21:57:43.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.628+0000 7f42f9b37640 1 -- 172.21.15.55:0/3046866162 shutdown_connections 2023-07-06T21:57:43.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.628+0000 7f42f9b37640 1 --2- 172.21.15.55:0/3046866162 >> [v2:172.21.15.55:6832/1694297670,v1:172.21.15.55:6833/1694297670] conn(0x7f42d4066430 0x7f42d40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.628+0000 7f42f9b37640 1 --2- 172.21.15.55:0/3046866162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42f40b1170 0x7f42f409d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.628+0000 7f42f9b37640 1 --2- 172.21.15.55:0/3046866162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42f4070d70 0x7f42f409ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.628+0000 7f42f9b37640 1 --2- 172.21.15.55:0/3046866162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42f40709a0 0x7f42f406a670 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.628+0000 7f42f9b37640 1 -- 172.21.15.55:0/3046866162 >> 172.21.15.55:0/3046866162 conn(0x7f42f40cea70 msgr2=0x7f42f40ad370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:43.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.628+0000 7f42f9b37640 1 -- 172.21.15.55:0/3046866162 shutdown_connections 2023-07-06T21:57:43.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.628+0000 7f42f9b37640 1 -- 172.21.15.55:0/3046866162 wait complete. 2023-07-06T21:57:43.645 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:57:43.662 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.664+0000 7f646fe46180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:57:43.756 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.756+0000 7f63f7388640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:43.757 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.756+0000 7f63f7388640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:43.757 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.756+0000 7f63f7388640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:43.757 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.756+0000 7f63f7388640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:43.757 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.756+0000 7f63f7388640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:43.758 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.760+0000 7f63fab8f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:43.758 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.760+0000 7f63fab8f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:43.758 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.760+0000 7f63fab8f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:43.758 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.760+0000 7f63fab8f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:43.758 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:57:43.760+0000 7f63fab8f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:57:43.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23dce48640 1 Processor -- start 2023-07-06T21:57:43.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23dce48640 1 -- start start 2023-07-06T21:57:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23dce48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23d8070d70 0x7f23d80b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23dce48640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f23d80b1170 0x7f23d806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23dce48640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d80cc030 con 0x7f23d80709a0 2023-07-06T21:57:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23dce48640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d80b15f0 con 0x7f23d80b1170 2023-07-06T21:57:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23dce48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80cc300 con 0x7f23d8070d70 2023-07-06T21:57:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23d659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f23d80709a0 0x7f23d80cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43588/0 (socket says 172.21.15.55:43588) 2023-07-06T21:57:43.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23d659c640 1 -- 172.21.15.55:0/1922181480 learned_addr learned my addr 172.21.15.55:0/1922181480 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:43.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23d5d9b640 1 --2- 172.21.15.55:0/1922181480 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23d8070d70 0x7f23d80b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23d6d9d640 1 --2- 172.21.15.55:0/1922181480 >> v2:172.21.15.138:3300/0 conn(0x7f23d80b1170 0x7f23d806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23d559a640 1 -- 172.21.15.55:0/1922181480 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191982375 0 0) 0x7f23d80cc030 con 0x7f23d80709a0 2023-07-06T21:57:43.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23d559a640 1 -- 172.21.15.55:0/1922181480 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23c0003530 con 0x7f23d80709a0 2023-07-06T21:57:43.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23d5d9b640 1 -- 172.21.15.55:0/1922181480 >> v2:172.21.15.138:3300/0 conn(0x7f23d80b1170 msgr2=0x7f23d806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:43.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23d5d9b640 1 --2- 172.21.15.55:0/1922181480 >> v2:172.21.15.138:3300/0 conn(0x7f23d80b1170 0x7f23d806eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23d5d9b640 1 -- 172.21.15.55:0/1922181480 >> v1:172.21.15.55:6789/0 conn(0x7f23d80709a0 legacy=0x7f23d80cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:43.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.824+0000 7f23d5d9b640 1 -- 172.21.15.55:0/1922181480 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d80cc5e0 con 0x7f23d8070d70 2023-07-06T21:57:43.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.828+0000 7f23d5d9b640 1 --2- 172.21.15.55:0/1922181480 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23d8070d70 0x7f23d80b0c30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0097f0 tx=0x7f23cc01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d61e9fc0109cd99f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:43.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.828+0000 7f23d559a640 1 -- 172.21.15.55:0/1922181480 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0ab600 con 0x7f23d8070d70 2023-07-06T21:57:43.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.828+0000 7f23d559a640 1 -- 172.21.15.55:0/1922181480 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc0a7050 con 0x7f23d8070d70 2023-07-06T21:57:43.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.828+0000 7f23d559a640 1 -- 172.21.15.55:0/1922181480 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0ab980 con 0x7f23d8070d70 2023-07-06T21:57:43.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.828+0000 7f23dce48640 1 -- 172.21.15.55:0/1922181480 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23d8070d70 msgr2=0x7f23d80b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:43.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.828+0000 7f23dce48640 1 --2- 172.21.15.55:0/1922181480 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23d8070d70 0x7f23d80b0c30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0097f0 tx=0x7f23cc01c3f0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.828+0000 7f23dce48640 1 -- 172.21.15.55:0/1922181480 shutdown_connections 2023-07-06T21:57:43.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.828+0000 7f23dce48640 1 --2- 172.21.15.55:0/1922181480 >> v2:172.21.15.138:3300/0 conn(0x7f23d80b1170 0x7f23d806eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.828+0000 7f23dce48640 1 --2- 172.21.15.55:0/1922181480 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23d8070d70 0x7f23d80b0c30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.828+0000 7f23dce48640 1 -- 172.21.15.55:0/1922181480 >> 172.21.15.55:0/1922181480 conn(0x7f23d80cea70 msgr2=0x7f23d80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:43.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.828+0000 7f23dce48640 1 -- 172.21.15.55:0/1922181480 shutdown_connections 2023-07-06T21:57:43.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.828+0000 7f23dce48640 1 -- 172.21.15.55:0/1922181480 wait complete. 2023-07-06T21:57:43.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23dce48640 1 Processor -- start 2023-07-06T21:57:43.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23dce48640 1 -- start start 2023-07-06T21:57:43.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23dce48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d80709a0 0x7f23d815bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23dce48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23d8070d70 0x7f23d809d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23dce48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23d80b1170 0x7f23d81f7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:43.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23dce48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d815c890 con 0x7f23d80b1170 2023-07-06T21:57:43.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23dce48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80c8b00 con 0x7f23d80709a0 2023-07-06T21:57:43.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23dce48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80c9530 con 0x7f23d8070d70 2023-07-06T21:57:43.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23d6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23d80b1170 0x7f23d81f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23d6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23d80b1170 0x7f23d81f7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46512/0 (socket says 172.21.15.55:46512) 2023-07-06T21:57:43.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23d6d9d640 1 -- 172.21.15.55:0/3949008393 learned_addr learned my addr 172.21.15.55:0/3949008393 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:43.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23d5d9b640 1 --2- 172.21.15.55:0/3949008393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23d8070d70 0x7f23d809d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23d659c640 1 --2- 172.21.15.55:0/3949008393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d80709a0 0x7f23d815bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:43.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23d6d9d640 1 -- 172.21.15.55:0/3949008393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23d8070d70 msgr2=0x7f23d809d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:43.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23d6d9d640 1 --2- 172.21.15.55:0/3949008393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23d8070d70 0x7f23d809d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23d6d9d640 1 -- 172.21.15.55:0/3949008393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d80709a0 msgr2=0x7f23d815bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:43.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23d6d9d640 1 --2- 172.21.15.55:0/3949008393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d80709a0 0x7f23d815bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23d6d9d640 1 -- 172.21.15.55:0/3949008393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc009420 con 0x7f23d80b1170 2023-07-06T21:57:43.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23d659c640 1 --2- 172.21.15.55:0/3949008393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d80709a0 0x7f23d815bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:43.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23d6d9d640 1 --2- 172.21.15.55:0/3949008393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23d80b1170 0x7f23d81f7750 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f23d000efc0 tx=0x7f23d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:43.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23c6ffd640 1 -- 172.21.15.55:0/3949008393 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0014480 con 0x7f23d80b1170 2023-07-06T21:57:43.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23c6ffd640 1 -- 172.21.15.55:0/3949008393 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d000f040 con 0x7f23d80b1170 2023-07-06T21:57:43.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23c6ffd640 1 -- 172.21.15.55:0/3949008393 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0014820 con 0x7f23d80b1170 2023-07-06T21:57:43.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23dce48640 1 -- 172.21.15.55:0/3949008393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d80c9250 con 0x7f23d80b1170 2023-07-06T21:57:43.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.832+0000 7f23dce48640 1 -- 172.21.15.55:0/3949008393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d80c8820 con 0x7f23d80b1170 2023-07-06T21:57:43.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.836+0000 7f23dce48640 1 -- 172.21.15.55:0/3949008393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d80c83a0 con 0x7f23d80b1170 2023-07-06T21:57:43.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.836+0000 7f23c6ffd640 1 -- 172.21.15.55:0/3949008393 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 36) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f23d0014980 con 0x7f23d80b1170 2023-07-06T21:57:43.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.836+0000 7f23c6ffd640 1 -- 172.21.15.55:0/3949008393 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 7113+0+0 (secure 0 0 0) 0x7f23d0084820 con 0x7f23d80b1170 2023-07-06T21:57:43.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.840+0000 7f23c6ffd640 1 -- 172.21.15.55:0/3949008393 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f23d80c83a0 con 0x7f23d80b1170 2023-07-06T21:57:43.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.996+0000 7f23dce48640 1 -- 172.21.15.55:0/3949008393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23d80c83a0 con 0x7f23d80b1170 2023-07-06T21:57:43.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:43.996+0000 7f23c6ffd640 1 -- 172.21.15.55:0/3949008393 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23d80c83a0 con 0x7f23d80b1170 2023-07-06T21:57:43.995 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:57:43.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.000+0000 7f23dce48640 1 -- 172.21.15.55:0/3949008393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23d80b1170 msgr2=0x7f23d81f7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:43.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.000+0000 7f23dce48640 1 --2- 172.21.15.55:0/3949008393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23d80b1170 0x7f23d81f7750 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f23d000efc0 tx=0x7f23d000c490 comp rx=0 tx=0).stop 2023-07-06T21:57:43.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.000+0000 7f23dce48640 1 -- 172.21.15.55:0/3949008393 shutdown_connections 2023-07-06T21:57:43.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.000+0000 7f23dce48640 1 --2- 172.21.15.55:0/3949008393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23d80b1170 0x7f23d81f7750 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.000+0000 7f23dce48640 1 --2- 172.21.15.55:0/3949008393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23d8070d70 0x7f23d809d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.000+0000 7f23dce48640 1 --2- 172.21.15.55:0/3949008393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d80709a0 0x7f23d815bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:43.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.000+0000 7f23dce48640 1 -- 172.21.15.55:0/3949008393 >> 172.21.15.55:0/3949008393 conn(0x7f23d80cea70 msgr2=0x7f23d80c75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:43.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.000+0000 7f23dce48640 1 -- 172.21.15.55:0/3949008393 shutdown_connections 2023-07-06T21:57:43.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.000+0000 7f23dce48640 1 -- 172.21.15.55:0/3949008393 wait complete. 2023-07-06T21:57:44.016 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:57:44.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f4167640 1 Processor -- start 2023-07-06T21:57:44.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f4167640 1 -- start start 2023-07-06T21:57:44.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f4167640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f14ec0c11a0 0x7f14ec0cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f4167640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14ec0c84a0 0x7f14ec0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f4167640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec0ccd70 con 0x7f14ec06eee0 2023-07-06T21:57:44.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f4167640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ec1605f0 con 0x7f14ec0c84a0 2023-07-06T21:57:44.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f4167640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ec06ce00 con 0x7f14ec0c11a0 2023-07-06T21:57:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f2704640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14ec0c84a0 0x7f14ec0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f1702640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f14ec06eee0 0x7f14ec06f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43590/0 (socket says 172.21.15.55:43590) 2023-07-06T21:57:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f1702640 1 -- 172.21.15.55:0/1940096302 learned_addr learned my addr 172.21.15.55:0/1940096302 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f1f03640 1 --2- 172.21.15.55:0/1940096302 >> v2:172.21.15.138:3300/0 conn(0x7f14ec0c11a0 0x7f14ec0cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f2704640 1 -- 172.21.15.55:0/1940096302 >> v2:172.21.15.138:3300/0 conn(0x7f14ec0c11a0 msgr2=0x7f14ec0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f2704640 1 --2- 172.21.15.55:0/1940096302 >> v2:172.21.15.138:3300/0 conn(0x7f14ec0c11a0 0x7f14ec0cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f2704640 1 -- 172.21.15.55:0/1940096302 >> v1:172.21.15.55:6789/0 conn(0x7f14ec06eee0 legacy=0x7f14ec06f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f2704640 1 -- 172.21.15.55:0/1940096302 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec0cd9f0 con 0x7f14ec0c84a0 2023-07-06T21:57:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.208+0000 7f14f0f01640 1 -- 172.21.15.55:0/1940096302 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688390125 0 0) 0x7f14ec0ccd70 con 0x7f14ec06eee0 2023-07-06T21:57:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.212+0000 7f14f2704640 1 --2- 172.21.15.55:0/1940096302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14ec0c84a0 0x7f14ec0c8920 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f14ec06d100 tx=0x7f14e401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9deeaa0ccac8c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.212+0000 7f14f0f01640 1 -- 172.21.15.55:0/1940096302 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e40a5830 con 0x7f14ec0c84a0 2023-07-06T21:57:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.212+0000 7f14f0f01640 1 -- 172.21.15.55:0/1940096302 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e40a5990 con 0x7f14ec0c84a0 2023-07-06T21:57:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.212+0000 7f14f0f01640 1 -- 172.21.15.55:0/1940096302 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e40a5d20 con 0x7f14ec0c84a0 2023-07-06T21:57:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.212+0000 7f14f4167640 1 -- 172.21.15.55:0/1940096302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14ec0c84a0 msgr2=0x7f14ec0c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.212+0000 7f14f4167640 1 --2- 172.21.15.55:0/1940096302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14ec0c84a0 0x7f14ec0c8920 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f14ec06d100 tx=0x7f14e401c880 comp rx=0 tx=0).stop 2023-07-06T21:57:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.212+0000 7f14f4167640 1 -- 172.21.15.55:0/1940096302 shutdown_connections 2023-07-06T21:57:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.212+0000 7f14f4167640 1 --2- 172.21.15.55:0/1940096302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14ec0c84a0 0x7f14ec0c8920 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.212+0000 7f14f4167640 1 --2- 172.21.15.55:0/1940096302 >> v2:172.21.15.138:3300/0 conn(0x7f14ec0c11a0 0x7f14ec0cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.212+0000 7f14f4167640 1 -- 172.21.15.55:0/1940096302 >> 172.21.15.55:0/1940096302 conn(0x7f14ec0cea70 msgr2=0x7f14ec0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.212+0000 7f14f4167640 1 -- 172.21.15.55:0/1940096302 shutdown_connections 2023-07-06T21:57:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.212+0000 7f14f4167640 1 -- 172.21.15.55:0/1940096302 wait complete. 2023-07-06T21:57:44.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f4167640 1 Processor -- start 2023-07-06T21:57:44.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f4167640 1 -- start start 2023-07-06T21:57:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f4167640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14ec06eee0 0x7f14ec0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f4167640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14ec0c11a0 0x7f14ec06bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f4167640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14ec0c84a0 0x7f14ec15b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f4167640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec162130 con 0x7f14ec0c11a0 2023-07-06T21:57:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f4167640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec161520 con 0x7f14ec0c84a0 2023-07-06T21:57:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f4167640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec161800 con 0x7f14ec06eee0 2023-07-06T21:57:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f1702640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14ec0c11a0 0x7f14ec06bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f1702640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14ec0c11a0 0x7f14ec06bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46532/0 (socket says 172.21.15.55:46532) 2023-07-06T21:57:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f1702640 1 -- 172.21.15.55:0/4152164214 learned_addr learned my addr 172.21.15.55:0/4152164214 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f1f03640 1 --2- 172.21.15.55:0/4152164214 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14ec06eee0 0x7f14ec0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f2704640 1 --2- 172.21.15.55:0/4152164214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14ec0c84a0 0x7f14ec15b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f1702640 1 -- 172.21.15.55:0/4152164214 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14ec06eee0 msgr2=0x7f14ec0b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f1702640 1 --2- 172.21.15.55:0/4152164214 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14ec06eee0 0x7f14ec0b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f1702640 1 -- 172.21.15.55:0/4152164214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14ec0c84a0 msgr2=0x7f14ec15b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f1702640 1 --2- 172.21.15.55:0/4152164214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14ec0c84a0 0x7f14ec15b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f1702640 1 -- 172.21.15.55:0/4152164214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e4009a70 con 0x7f14ec0c11a0 2023-07-06T21:57:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f1702640 1 --2- 172.21.15.55:0/4152164214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14ec0c11a0 0x7f14ec06bb20 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0011f0 tx=0x7f14dc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14e27fc640 1 -- 172.21.15.55:0/4152164214 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0074e0 con 0x7f14ec0c11a0 2023-07-06T21:57:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14e27fc640 1 -- 172.21.15.55:0/4152164214 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc007640 con 0x7f14ec0c11a0 2023-07-06T21:57:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14e27fc640 1 -- 172.21.15.55:0/4152164214 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc004a10 con 0x7f14ec0c11a0 2023-07-06T21:57:44.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f4167640 1 -- 172.21.15.55:0/4152164214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ec0c16f0 con 0x7f14ec0c11a0 2023-07-06T21:57:44.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f4167640 1 -- 172.21.15.55:0/4152164214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ec161dc0 con 0x7f14ec0c11a0 2023-07-06T21:57:44.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.216+0000 7f14f4167640 1 -- 172.21.15.55:0/4152164214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ec066d60 con 0x7f14ec0c11a0 2023-07-06T21:57:44.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.220+0000 7f14e27fc640 1 -- 172.21.15.55:0/4152164214 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 36) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f14dc004b70 con 0x7f14ec0c11a0 2023-07-06T21:57:44.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.220+0000 7f14e27fc640 1 -- 172.21.15.55:0/4152164214 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 7113+0+0 (secure 0 0 0) 0x7f14dc082ef0 con 0x7f14ec0c11a0 2023-07-06T21:57:44.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.224+0000 7f14e27fc640 1 -- 172.21.15.55:0/4152164214 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14dc050360 con 0x7f14ec0c11a0 2023-07-06T21:57:44.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.376+0000 7f14f4167640 1 -- 172.21.15.55:0/4152164214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14ec162270 con 0x7f14ec0c11a0 2023-07-06T21:57:44.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.376+0000 7f14e27fc640 1 -- 172.21.15.55:0/4152164214 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14dc018020 con 0x7f14ec0c11a0 2023-07-06T21:57:44.375 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:57:44.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.380+0000 7f14f4167640 1 -- 172.21.15.55:0/4152164214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14ec0c11a0 msgr2=0x7f14ec06bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.380+0000 7f14f4167640 1 --2- 172.21.15.55:0/4152164214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14ec0c11a0 0x7f14ec06bb20 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0011f0 tx=0x7f14dc00c9b0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.380+0000 7f14f4167640 1 -- 172.21.15.55:0/4152164214 shutdown_connections 2023-07-06T21:57:44.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.380+0000 7f14f4167640 1 --2- 172.21.15.55:0/4152164214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14ec0c84a0 0x7f14ec15b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.380+0000 7f14f4167640 1 --2- 172.21.15.55:0/4152164214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14ec0c11a0 0x7f14ec06bb20 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.380+0000 7f14f4167640 1 --2- 172.21.15.55:0/4152164214 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14ec06eee0 0x7f14ec0b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.380+0000 7f14f4167640 1 -- 172.21.15.55:0/4152164214 >> 172.21.15.55:0/4152164214 conn(0x7f14ec0cea70 msgr2=0x7f14ec0b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:44.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.380+0000 7f14f4167640 1 -- 172.21.15.55:0/4152164214 shutdown_connections 2023-07-06T21:57:44.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.380+0000 7f14f4167640 1 -- 172.21.15.55:0/4152164214 wait complete. 2023-07-06T21:57:44.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:57:44.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd2564bc640 1 Processor -- start 2023-07-06T21:57:44.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd2564bc640 1 -- start start 2023-07-06T21:57:44.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd2564bc640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd2500ce5e0 0x7fd2500b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd2564bc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd2500b40e0 0x7fd2500d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd2564bc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2500cc770 con 0x7fd25015b9d0 2023-07-06T21:57:44.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd2564bc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2500b4560 con 0x7fd2500b40e0 2023-07-06T21:57:44.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd2564bc640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2500cc9c0 con 0x7fd2500ce5e0 2023-07-06T21:57:44.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd255cbb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd2500b40e0 0x7fd2500d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd2554ba640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd25015b9d0 0x7fd2500b2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43594/0 (socket says 172.21.15.55:43594) 2023-07-06T21:57:44.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd2554ba640 1 -- 172.21.15.55:0/1102070352 learned_addr learned my addr 172.21.15.55:0/1102070352 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:44.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd254cb9640 1 --2- 172.21.15.55:0/1102070352 >> v2:172.21.15.138:3300/0 conn(0x7fd2500ce5e0 0x7fd2500b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd247fff640 1 -- 172.21.15.55:0/1102070352 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53554262 0 0) 0x7fd2500cc770 con 0x7fd25015b9d0 2023-07-06T21:57:44.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd255cbb640 1 -- 172.21.15.55:0/1102070352 >> v2:172.21.15.138:3300/0 conn(0x7fd2500ce5e0 msgr2=0x7fd2500b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:44.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd255cbb640 1 --2- 172.21.15.55:0/1102070352 >> v2:172.21.15.138:3300/0 conn(0x7fd2500ce5e0 0x7fd2500b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd255cbb640 1 -- 172.21.15.55:0/1102070352 >> v1:172.21.15.55:6789/0 conn(0x7fd25015b9d0 legacy=0x7fd2500b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.540+0000 7fd255cbb640 1 -- 172.21.15.55:0/1102070352 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2500ccca0 con 0x7fd2500b40e0 2023-07-06T21:57:44.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.544+0000 7fd255cbb640 1 --2- 172.21.15.55:0/1102070352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2500b40e0 0x7fd2500d0650 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd2500d31f0 tx=0x7fd24801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdc070d05380bc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:44.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.544+0000 7fd247fff640 1 -- 172.21.15.55:0/1102070352 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2480a5990 con 0x7fd2500b40e0 2023-07-06T21:57:44.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.544+0000 7fd247fff640 1 -- 172.21.15.55:0/1102070352 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2480a5af0 con 0x7fd2500b40e0 2023-07-06T21:57:44.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.544+0000 7fd247fff640 1 -- 172.21.15.55:0/1102070352 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2480a5e80 con 0x7fd2500b40e0 2023-07-06T21:57:44.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.544+0000 7fd2564bc640 1 -- 172.21.15.55:0/1102070352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2500b40e0 msgr2=0x7fd2500d0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.544+0000 7fd2564bc640 1 --2- 172.21.15.55:0/1102070352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2500b40e0 0x7fd2500d0650 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd2500d31f0 tx=0x7fd24801c910 comp rx=0 tx=0).stop 2023-07-06T21:57:44.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.544+0000 7fd2564bc640 1 -- 172.21.15.55:0/1102070352 shutdown_connections 2023-07-06T21:57:44.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.544+0000 7fd2564bc640 1 --2- 172.21.15.55:0/1102070352 >> v2:172.21.15.138:3300/0 conn(0x7fd2500ce5e0 0x7fd2500b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.544+0000 7fd2564bc640 1 --2- 172.21.15.55:0/1102070352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2500b40e0 0x7fd2500d0650 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.544+0000 7fd2564bc640 1 -- 172.21.15.55:0/1102070352 >> 172.21.15.55:0/1102070352 conn(0x7fd25006c2b0 msgr2=0x7fd2500ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:44.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.544+0000 7fd2564bc640 1 -- 172.21.15.55:0/1102070352 shutdown_connections 2023-07-06T21:57:44.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.544+0000 7fd2564bc640 1 -- 172.21.15.55:0/1102070352 wait complete. 2023-07-06T21:57:44.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2564bc640 1 Processor -- start 2023-07-06T21:57:44.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2564bc640 1 -- start start 2023-07-06T21:57:44.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2564bc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2500b40e0 0x7fd2500c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2564bc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2500ce5e0 0x7fd2500c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2564bc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd25015b9d0 0x7fd25015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2564bc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500c73a0 con 0x7fd2500b40e0 2023-07-06T21:57:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2564bc640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500c7cd0 con 0x7fd25015b9d0 2023-07-06T21:57:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2564bc640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2501f4d60 con 0x7fd2500ce5e0 2023-07-06T21:57:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2554ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2500b40e0 0x7fd2500c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2554ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2500b40e0 0x7fd2500c6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46552/0 (socket says 172.21.15.55:46552) 2023-07-06T21:57:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2554ba640 1 -- 172.21.15.55:0/4065923218 learned_addr learned my addr 172.21.15.55:0/4065923218 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd255cbb640 1 --2- 172.21.15.55:0/4065923218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd25015b9d0 0x7fd25015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd254cb9640 1 --2- 172.21.15.55:0/4065923218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2500ce5e0 0x7fd2500c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2554ba640 1 -- 172.21.15.55:0/4065923218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2500ce5e0 msgr2=0x7fd2500c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2554ba640 1 --2- 172.21.15.55:0/4065923218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2500ce5e0 0x7fd2500c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2554ba640 1 -- 172.21.15.55:0/4065923218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd25015b9d0 msgr2=0x7fd25015a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2554ba640 1 --2- 172.21.15.55:0/4065923218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd25015b9d0 0x7fd25015a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2554ba640 1 -- 172.21.15.55:0/4065923218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd248009a70 con 0x7fd2500b40e0 2023-07-06T21:57:44.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2554ba640 1 --2- 172.21.15.55:0/4065923218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2500b40e0 0x7fd2500c6e60 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fd24c00c480 tx=0x7fd24c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:44.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd245ffb640 1 -- 172.21.15.55:0/4065923218 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c0074e0 con 0x7fd2500b40e0 2023-07-06T21:57:44.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd245ffb640 1 -- 172.21.15.55:0/4065923218 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c007660 con 0x7fd2500b40e0 2023-07-06T21:57:44.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd245ffb640 1 -- 172.21.15.55:0/4065923218 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c004a30 con 0x7fd2500b40e0 2023-07-06T21:57:44.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2564bc640 1 -- 172.21.15.55:0/4065923218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2500c76c0 con 0x7fd2500b40e0 2023-07-06T21:57:44.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.548+0000 7fd2564bc640 1 -- 172.21.15.55:0/4065923218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2500c7960 con 0x7fd2500b40e0 2023-07-06T21:57:44.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.552+0000 7fd2564bc640 1 -- 172.21.15.55:0/4065923218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25004d790 con 0x7fd2500b40e0 2023-07-06T21:57:44.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.552+0000 7fd245ffb640 1 -- 172.21.15.55:0/4065923218 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 36) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fd24c004b90 con 0x7fd2500b40e0 2023-07-06T21:57:44.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.552+0000 7fd245ffb640 1 -- 172.21.15.55:0/4065923218 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 7113+0+0 (secure 0 0 0) 0x7fd24c082cd0 con 0x7fd2500b40e0 2023-07-06T21:57:44.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.556+0000 7fd245ffb640 1 -- 172.21.15.55:0/4065923218 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd24c050060 con 0x7fd2500b40e0 2023-07-06T21:57:44.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.688+0000 7fd245ffb640 1 -- 172.21.15.55:0/4065923218 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 37) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fd24c04fce0 con 0x7fd2500b40e0 2023-07-06T21:57:44.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.692+0000 7fd245ffb640 1 --2- 172.21.15.55:0/4065923218 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fd23406c620 0x7fd23406ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.692+0000 7fd254cb9640 1 --2- 172.21.15.55:0/4065923218 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fd23406c620 0x7fd23406ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.692+0000 7fd254cb9640 1 --2- 172.21.15.55:0/4065923218 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fd23406c620 0x7fd23406ea00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd2500c6df0 tx=0x7fd240008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:44.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.752+0000 7fd2564bc640 1 -- 172.21.15.55:0/4065923218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2500b31e0 con 0x7fd2500b40e0 2023-07-06T21:57:44.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.752+0000 7fd245ffb640 1 -- 172.21.15.55:0/4065923218 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fd24c06d190 con 0x7fd2500b40e0 2023-07-06T21:57:44.752 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:44.752 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2651551074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2651551074},{"type":"v1","addr":"172.21.15.138:6835","nonce":2651551074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1024060506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1024060506},{"type":"v1","addr":"172.21.15.138:6834","nonce":1024060506}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6933,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3347534333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3347534333},{"type":"v1","addr":"172.21.15.55:6836","nonce":3347534333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:57:25.541950+0000","modified":"2023-07-06T21:57:28.574413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3154142571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3154142571},{"type":"v1","addr":"172.21.15.55:6837","nonce":3154142571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-06T21:57:44.752 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 32 2023-07-06T21:57:44.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.756+0000 7fd2564bc640 1 -- 172.21.15.55:0/4065923218 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fd23406c620 msgr2=0x7fd23406ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.756+0000 7fd2564bc640 1 --2- 172.21.15.55:0/4065923218 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fd23406c620 0x7fd23406ea00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd2500c6df0 tx=0x7fd240008040 comp rx=0 tx=0).stop 2023-07-06T21:57:44.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.756+0000 7fd2564bc640 1 -- 172.21.15.55:0/4065923218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2500b40e0 msgr2=0x7fd2500c6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.756+0000 7fd2564bc640 1 --2- 172.21.15.55:0/4065923218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2500b40e0 0x7fd2500c6e60 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fd24c00c480 tx=0x7fd24c00c940 comp rx=0 tx=0).stop 2023-07-06T21:57:44.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.756+0000 7fd2564bc640 1 -- 172.21.15.55:0/4065923218 shutdown_connections 2023-07-06T21:57:44.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.756+0000 7fd2564bc640 1 --2- 172.21.15.55:0/4065923218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd25015b9d0 0x7fd25015a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.756+0000 7fd2564bc640 1 --2- 172.21.15.55:0/4065923218 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fd23406c620 0x7fd23406ea00 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.756+0000 7fd2564bc640 1 --2- 172.21.15.55:0/4065923218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2500ce5e0 0x7fd2500c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.756+0000 7fd2564bc640 1 --2- 172.21.15.55:0/4065923218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2500b40e0 0x7fd2500c6e60 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.756+0000 7fd2564bc640 1 -- 172.21.15.55:0/4065923218 >> 172.21.15.55:0/4065923218 conn(0x7fd25006c2b0 msgr2=0x7fd25006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:44.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.756+0000 7fd2564bc640 1 -- 172.21.15.55:0/4065923218 shutdown_connections 2023-07-06T21:57:44.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.756+0000 7fd2564bc640 1 -- 172.21.15.55:0/4065923218 wait complete. 2023-07-06T21:57:44.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:44.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.916+0000 7f0d8e626640 1 Processor -- start 2023-07-06T21:57:44.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.916+0000 7f0d8e626640 1 -- start start 2023-07-06T21:57:44.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.920+0000 7f0d8e626640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d8806d670 0x7f0d880d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.920+0000 7f0d8e626640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d880ce9e0 con 0x7f0d880cf940 2023-07-06T21:57:44.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.920+0000 7f0d8e626640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d88159eb0 con 0x7f0d880b58e0 2023-07-06T21:57:44.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.920+0000 7f0d8e626640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d880d0960 con 0x7f0d8806d670 2023-07-06T21:57:44.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.920+0000 7f0d87fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0d880cf940 0x7f0d880cfd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43604/0 (socket says 172.21.15.55:43604) 2023-07-06T21:57:44.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.920+0000 7f0d87fff640 1 -- 172.21.15.55:0/1145964402 learned_addr learned my addr 172.21.15.55:0/1145964402 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:44.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.920+0000 7f0d877fe640 1 --2- 172.21.15.55:0/1145964402 >> v2:172.21.15.55:3300/0 conn(0x7f0d8806d670 0x7f0d880d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.920+0000 7f0d86ffd640 1 -- 172.21.15.55:0/1145964402 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907400187 0 0) 0x7f0d880ce9e0 con 0x7f0d880cf940 2023-07-06T21:57:44.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.920+0000 7f0d86ffd640 1 -- 172.21.15.55:0/1145964402 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d70003530 con 0x7f0d880cf940 2023-07-06T21:57:44.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.920+0000 7f0d877fe640 1 -- 172.21.15.55:0/1145964402 >> v1:172.21.15.138:6789/0 conn(0x7f0d880b58e0 legacy=0x7f0d880cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:44.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.920+0000 7f0d877fe640 1 -- 172.21.15.55:0/1145964402 >> v1:172.21.15.55:6789/0 conn(0x7f0d880cf940 legacy=0x7f0d880cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.920+0000 7f0d877fe640 1 -- 172.21.15.55:0/1145964402 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d880cddd0 con 0x7f0d8806d670 2023-07-06T21:57:44.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.924+0000 7f0d877fe640 1 --2- 172.21.15.55:0/1145964402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d8806d670 0x7f0d880d0420 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0097c0 tx=0x7f0d7c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832464b808119740 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:44.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.924+0000 7f0d86ffd640 1 -- 172.21.15.55:0/1145964402 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0ac620 con 0x7f0d8806d670 2023-07-06T21:57:44.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.924+0000 7f0d86ffd640 1 -- 172.21.15.55:0/1145964402 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c0ac780 con 0x7f0d8806d670 2023-07-06T21:57:44.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.924+0000 7f0d86ffd640 1 -- 172.21.15.55:0/1145964402 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0acb10 con 0x7f0d8806d670 2023-07-06T21:57:44.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.924+0000 7f0d8e626640 1 -- 172.21.15.55:0/1145964402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d8806d670 msgr2=0x7f0d880d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.924+0000 7f0d8e626640 1 --2- 172.21.15.55:0/1145964402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d8806d670 0x7f0d880d0420 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0097c0 tx=0x7f0d7c01c3c0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.924+0000 7f0d8e626640 1 -- 172.21.15.55:0/1145964402 shutdown_connections 2023-07-06T21:57:44.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.924+0000 7f0d8e626640 1 --2- 172.21.15.55:0/1145964402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d8806d670 0x7f0d880d0420 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.924+0000 7f0d8e626640 1 -- 172.21.15.55:0/1145964402 >> 172.21.15.55:0/1145964402 conn(0x7f0d8806ee80 msgr2=0x7f0d8806f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:44.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.924+0000 7f0d8e626640 1 -- 172.21.15.55:0/1145964402 shutdown_connections 2023-07-06T21:57:44.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.924+0000 7f0d8e626640 1 -- 172.21.15.55:0/1145964402 wait complete. 2023-07-06T21:57:44.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.924+0000 7f0d8e626640 1 Processor -- start 2023-07-06T21:57:44.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.924+0000 7f0d8e626640 1 -- start start 2023-07-06T21:57:44.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d8e626640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d8806d670 0x7f0d880c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d8e626640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d880b58e0 0x7f0d8815aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d8e626640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d880cf940 0x7f0d8806b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d8e626640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d880c9f50 con 0x7f0d880b58e0 2023-07-06T21:57:44.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d8e626640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d881f84c0 con 0x7f0d8806d670 2023-07-06T21:57:44.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d8e626640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d88154710 con 0x7f0d880cf940 2023-07-06T21:57:44.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d877fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d880b58e0 0x7f0d8815aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d877fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d880b58e0 0x7f0d8815aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46560/0 (socket says 172.21.15.55:46560) 2023-07-06T21:57:44.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d877fe640 1 -- 172.21.15.55:0/743929676 learned_addr learned my addr 172.21.15.55:0/743929676 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:44.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d87fff640 1 --2- 172.21.15.55:0/743929676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d8806d670 0x7f0d880c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d8cbc3640 1 --2- 172.21.15.55:0/743929676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d880cf940 0x7f0d8806b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d877fe640 1 -- 172.21.15.55:0/743929676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d880cf940 msgr2=0x7f0d8806b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d877fe640 1 --2- 172.21.15.55:0/743929676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d880cf940 0x7f0d8806b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d877fe640 1 -- 172.21.15.55:0/743929676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d8806d670 msgr2=0x7f0d880c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:44.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d877fe640 1 --2- 172.21.15.55:0/743929676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d8806d670 0x7f0d880c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:44.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d877fe640 1 -- 172.21.15.55:0/743929676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c009420 con 0x7f0d880b58e0 2023-07-06T21:57:44.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d877fe640 1 --2- 172.21.15.55:0/743929676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d880b58e0 0x7f0d8815aa10 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c018fd0 tx=0x7f0d7c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:44.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d84ff9640 1 -- 172.21.15.55:0/743929676 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0b5410 con 0x7f0d880b58e0 2023-07-06T21:57:44.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d84ff9640 1 -- 172.21.15.55:0/743929676 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c0b5590 con 0x7f0d880b58e0 2023-07-06T21:57:44.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d84ff9640 1 -- 172.21.15.55:0/743929676 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0b5940 con 0x7f0d880b58e0 2023-07-06T21:57:44.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d8e626640 1 -- 172.21.15.55:0/743929676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d881f8780 con 0x7f0d880b58e0 2023-07-06T21:57:44.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d8e626640 1 -- 172.21.15.55:0/743929676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d881f8d40 con 0x7f0d880b58e0 2023-07-06T21:57:44.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.928+0000 7f0d8e626640 1 -- 172.21.15.55:0/743929676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d88066d60 con 0x7f0d880b58e0 2023-07-06T21:57:44.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.932+0000 7f0d84ff9640 1 -- 172.21.15.55:0/743929676 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f0d7c0b3040 con 0x7f0d880b58e0 2023-07-06T21:57:44.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.932+0000 7f0d84ff9640 1 --2- 172.21.15.55:0/743929676 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f0d740660d0 0x7f0d74068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:44.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.932+0000 7f0d84ff9640 1 -- 172.21.15.55:0/743929676 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 7113+0+0 (secure 0 0 0) 0x7f0d7c11d940 con 0x7f0d880b58e0 2023-07-06T21:57:44.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.932+0000 7f0d87fff640 1 --2- 172.21.15.55:0/743929676 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f0d740660d0 0x7f0d74068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:44.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.932+0000 7f0d87fff640 1 --2- 172.21.15.55:0/743929676 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f0d740660d0 0x7f0d74068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d780011f0 tx=0x7f0d78007d40 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:44.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:44.936+0000 7f0d84ff9640 1 -- 172.21.15.55:0/743929676 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d7c0eacc0 con 0x7f0d880b58e0 2023-07-06T21:57:45.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.096+0000 7f0d8e626640 1 -- 172.21.15.55:0/743929676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d880d0fe0 con 0x7f0d880b58e0 2023-07-06T21:57:45.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.096+0000 7f0d84ff9640 1 -- 172.21.15.55:0/743929676 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+19605 (secure 0 0 0) 0x7f0d7c0ee2e0 con 0x7f0d880b58e0 2023-07-06T21:57:45.095 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:45.095 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:57:43.676372+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:57:23.252496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-06T21:57:24.528387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3832295075":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/2958882201":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/3615728228":"2023-07-07T21:57:43.676340+0000","172.21.15.55:6833/1694297670":"2023-07-07T21:57:43.676340+0000","172.21.15.55:6832/1694297670":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/5393205":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/2896474133":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/1802623894":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/1987324425":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/1073362678":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1848976334":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1541327786":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1765249513":"2023-07-07T21:57:37.612097+0000","172.21.15.55:6833/3540074910":"2023-07-07T21:57:37.612097+0000","172.21.15.55:6832/3540074910":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1768372577":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1203793928":"2023-07-07T21:57:37.612097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:45.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.100+0000 7f0d8e626640 1 -- 172.21.15.55:0/743929676 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f0d740660d0 msgr2=0x7f0d74068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:45.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.100+0000 7f0d8e626640 1 --2- 172.21.15.55:0/743929676 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f0d740660d0 0x7f0d74068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d780011f0 tx=0x7f0d78007d40 comp rx=0 tx=0).stop 2023-07-06T21:57:45.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.100+0000 7f0d8e626640 1 -- 172.21.15.55:0/743929676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d880b58e0 msgr2=0x7f0d8815aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:45.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.100+0000 7f0d8e626640 1 --2- 172.21.15.55:0/743929676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d880b58e0 0x7f0d8815aa10 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c018fd0 tx=0x7f0d7c019160 comp rx=0 tx=0).stop 2023-07-06T21:57:45.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.100+0000 7f0d8e626640 1 -- 172.21.15.55:0/743929676 shutdown_connections 2023-07-06T21:57:45.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.100+0000 7f0d8e626640 1 --2- 172.21.15.55:0/743929676 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f0d740660d0 0x7f0d74068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.100+0000 7f0d8e626640 1 --2- 172.21.15.55:0/743929676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d880cf940 0x7f0d8806b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.100+0000 7f0d8e626640 1 --2- 172.21.15.55:0/743929676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d880b58e0 0x7f0d8815aa10 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.100+0000 7f0d8e626640 1 --2- 172.21.15.55:0/743929676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d8806d670 0x7f0d880c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.100+0000 7f0d8e626640 1 -- 172.21.15.55:0/743929676 >> 172.21.15.55:0/743929676 conn(0x7f0d8806ee80 msgr2=0x7f0d88147d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:45.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.100+0000 7f0d8e626640 1 -- 172.21.15.55:0/743929676 shutdown_connections 2023-07-06T21:57:45.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.100+0000 7f0d8e626640 1 -- 172.21.15.55:0/743929676 wait complete. 2023-07-06T21:57:45.116 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T21:57:45.116 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:57:45.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.260+0000 7f80095fa640 1 Processor -- start 2023-07-06T21:57:45.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.260+0000 7f80095fa640 1 -- start start 2023-07-06T21:57:45.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f80095fa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8004158400 0x7f80040c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:45.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f80095fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80040c9680 0x7f8004070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:45.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f80095fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80040710c0 0x7f80040cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:45.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f80095fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800406fae0 con 0x7f80040710c0 2023-07-06T21:57:45.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f80095fa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800406fdc0 con 0x7f8004158400 2023-07-06T21:57:45.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f80095fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80040700a0 con 0x7f80040c9680 2023-07-06T21:57:45.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f80037fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80040710c0 0x7f80040cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:45.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f80037fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80040710c0 0x7f80040cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46574/0 (socket says 172.21.15.55:46574) 2023-07-06T21:57:45.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f80037fe640 1 -- 172.21.15.55:0/3647511615 learned_addr learned my addr 172.21.15.55:0/3647511615 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:45.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f8002ffd640 1 --2- 172.21.15.55:0/3647511615 >> v2:172.21.15.138:3300/0 conn(0x7f8004158400 0x7f80040c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:45.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f7ffbfff640 1 --2- 172.21.15.55:0/3647511615 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80040c9680 0x7f8004070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:45.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f80037fe640 1 -- 172.21.15.55:0/3647511615 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80040c9680 msgr2=0x7f8004070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:45.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f80037fe640 1 --2- 172.21.15.55:0/3647511615 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80040c9680 0x7f8004070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f80037fe640 1 -- 172.21.15.55:0/3647511615 >> v2:172.21.15.138:3300/0 conn(0x7f8004158400 msgr2=0x7f80040c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:45.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f80037fe640 1 --2- 172.21.15.55:0/3647511615 >> v2:172.21.15.138:3300/0 conn(0x7f8004158400 0x7f80040c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.264+0000 7f80037fe640 1 -- 172.21.15.55:0/3647511615 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004070380 con 0x7f80040710c0 2023-07-06T21:57:45.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80037fe640 1 --2- 172.21.15.55:0/3647511615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80040710c0 0x7f80040cbaa0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f800406ed50 tx=0x7f7ffc01ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499ff0a42060cd86 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:45.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80027fc640 1 -- 172.21.15.55:0/3647511615 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0a7a60 con 0x7f80040710c0 2023-07-06T21:57:45.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80027fc640 1 -- 172.21.15.55:0/3647511615 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc0a7bc0 con 0x7f80040710c0 2023-07-06T21:57:45.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80027fc640 1 -- 172.21.15.55:0/3647511615 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0af3f0 con 0x7f80040710c0 2023-07-06T21:57:45.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 -- 172.21.15.55:0/3647511615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80040710c0 msgr2=0x7f80040cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:45.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 --2- 172.21.15.55:0/3647511615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80040710c0 0x7f80040cbaa0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f800406ed50 tx=0x7f7ffc01ebb0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 -- 172.21.15.55:0/3647511615 shutdown_connections 2023-07-06T21:57:45.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 --2- 172.21.15.55:0/3647511615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80040710c0 0x7f80040cbaa0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 --2- 172.21.15.55:0/3647511615 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80040c9680 0x7f8004070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 --2- 172.21.15.55:0/3647511615 >> v2:172.21.15.138:3300/0 conn(0x7f8004158400 0x7f80040c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 -- 172.21.15.55:0/3647511615 >> 172.21.15.55:0/3647511615 conn(0x7f80040cded0 msgr2=0x7f80040ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:45.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 -- 172.21.15.55:0/3647511615 shutdown_connections 2023-07-06T21:57:45.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 -- 172.21.15.55:0/3647511615 wait complete. 2023-07-06T21:57:45.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 Processor -- start 2023-07-06T21:57:45.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 -- start start 2023-07-06T21:57:45.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80040710c0 0x7f80040c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:45.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80040c9680 0x7f80041f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:45.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8004158400 0x7f80040ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:45.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80040c7eb0 con 0x7f80040c9680 2023-07-06T21:57:45.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80040b0ee0 con 0x7f8004158400 2023-07-06T21:57:45.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.268+0000 7f80095fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80040c7610 con 0x7f80040710c0 2023-07-06T21:57:45.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80040c9680 0x7f80041f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:45.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80040c9680 0x7f80041f4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46584/0 (socket says 172.21.15.55:46584) 2023-07-06T21:57:45.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffbfff640 1 -- 172.21.15.55:0/1659926993 learned_addr learned my addr 172.21.15.55:0/1659926993 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:45.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f80037fe640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8004158400 0x7f80040ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:45.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f8002ffd640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80040710c0 0x7f80040c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:45.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffbfff640 1 -- 172.21.15.55:0/1659926993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80040710c0 msgr2=0x7f80040c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:45.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffbfff640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80040710c0 0x7f80040c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffbfff640 1 -- 172.21.15.55:0/1659926993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8004158400 msgr2=0x7f80040ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:45.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffbfff640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8004158400 0x7f80040ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffbfff640 1 -- 172.21.15.55:0/1659926993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc009b30 con 0x7f80040c9680 2023-07-06T21:57:45.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f80037fe640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8004158400 0x7f80040ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:45.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f8002ffd640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80040710c0 0x7f80040c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:45.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffbfff640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80040c9680 0x7f80041f4fa0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00d800 tx=0x7f7fec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:45.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffb7fe640 1 -- 172.21.15.55:0/1659926993 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0096a0 con 0x7f80040c9680 2023-07-06T21:57:45.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffb7fe640 1 -- 172.21.15.55:0/1659926993 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec009800 con 0x7f80040c9680 2023-07-06T21:57:45.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffb7fe640 1 -- 172.21.15.55:0/1659926993 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec009b70 con 0x7f80040c9680 2023-07-06T21:57:45.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f80095fa640 1 -- 172.21.15.55:0/1659926993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80040c78f0 con 0x7f80040c9680 2023-07-06T21:57:45.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f80095fa640 1 -- 172.21.15.55:0/1659926993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80041f54e0 con 0x7f80040c9680 2023-07-06T21:57:45.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f80095fa640 1 -- 172.21.15.55:0/1659926993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800406c580 con 0x7f80040c9680 2023-07-06T21:57:45.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffb7fe640 1 -- 172.21.15.55:0/1659926993 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f7fec009cd0 con 0x7f80040c9680 2023-07-06T21:57:45.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffb7fe640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f7fe40660d0 0x7f7fe4068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:45.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.272+0000 7f7ffb7fe640 1 -- 172.21.15.55:0/1659926993 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 7113+0+0 (secure 0 0 0) 0x7f7fec084580 con 0x7f80040c9680 2023-07-06T21:57:45.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.276+0000 7f8002ffd640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f7fe40660d0 0x7f7fe4068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:45.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.276+0000 7f8002ffd640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f7fe40660d0 0x7f7fe4068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400b9f0 tx=0x7f7ff4008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:45.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.276+0000 7f7ffb7fe640 1 -- 172.21.15.55:0/1659926993 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fec0518e0 con 0x7f80040c9680 2023-07-06T21:57:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.468+0000 7f80095fa640 1 -- 172.21.15.55:0/1659926993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8004066d60 con 0x7f80040c9680 2023-07-06T21:57:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.468+0000 7f7ffb7fe640 1 -- 172.21.15.55:0/1659926993 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f7fec054f00 con 0x7f80040c9680 2023-07-06T21:57:45.468 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:45.468 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2651551074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2651551074},{"type":"v1","addr":"172.21.15.138:6835","nonce":2651551074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1024060506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1024060506},{"type":"v1","addr":"172.21.15.138:6834","nonce":1024060506}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6933,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3347534333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3347534333},{"type":"v1","addr":"172.21.15.55:6836","nonce":3347534333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:57:25.541950+0000","modified":"2023-07-06T21:57:28.574413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3154142571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3154142571},{"type":"v1","addr":"172.21.15.55:6837","nonce":3154142571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-06T21:57:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 32 2023-07-06T21:57:45.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.472+0000 7f80095fa640 1 -- 172.21.15.55:0/1659926993 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f7fe40660d0 msgr2=0x7f7fe4068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:45.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.472+0000 7f80095fa640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f7fe40660d0 0x7f7fe4068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400b9f0 tx=0x7f7ff4008040 comp rx=0 tx=0).stop 2023-07-06T21:57:45.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.472+0000 7f80095fa640 1 -- 172.21.15.55:0/1659926993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80040c9680 msgr2=0x7f80041f4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:45.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.472+0000 7f80095fa640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80040c9680 0x7f80041f4fa0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00d800 tx=0x7f7fec00dcc0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.472+0000 7f80095fa640 1 -- 172.21.15.55:0/1659926993 shutdown_connections 2023-07-06T21:57:45.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.472+0000 7f80095fa640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8004158400 0x7f80040ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.472+0000 7f80095fa640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80040c9680 0x7f80041f4fa0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.472+0000 7f80095fa640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f7fe40660d0 0x7f7fe4068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.472+0000 7f80095fa640 1 --2- 172.21.15.55:0/1659926993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80040710c0 0x7f80040c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.472+0000 7f80095fa640 1 -- 172.21.15.55:0/1659926993 >> 172.21.15.55:0/1659926993 conn(0x7f80040cded0 msgr2=0x7f8004162940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.472+0000 7f80095fa640 1 -- 172.21.15.55:0/1659926993 shutdown_connections 2023-07-06T21:57:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.472+0000 7f80095fa640 1 -- 172.21.15.55:0/1659926993 wait complete. 2023-07-06T21:57:45.489 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:57:45.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.632+0000 7ff50b434640 1 Processor -- start 2023-07-06T21:57:45.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.632+0000 7ff50b434640 1 -- start start 2023-07-06T21:57:45.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.636+0000 7ff50b434640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5040712f0 0x7ff50406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:45.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.636+0000 7ff50b434640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5040ca450 0x7ff50415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:45.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.636+0000 7ff50b434640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff504159cd0 con 0x7ff5040b3730 2023-07-06T21:57:45.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.636+0000 7ff50b434640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5040693f0 con 0x7ff5040712f0 2023-07-06T21:57:45.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.636+0000 7ff50b434640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50406aca0 con 0x7ff5040ca450 2023-07-06T21:57:45.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.636+0000 7ff5091d0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5040712f0 0x7ff50406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:45.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.636+0000 7ff5089cf640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff5040b3730 0x7ff5040c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43616/0 (socket says 172.21.15.55:43616) 2023-07-06T21:57:45.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.636+0000 7ff5089cf640 1 -- 172.21.15.55:0/1404366013 learned_addr learned my addr 172.21.15.55:0/1404366013 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:45.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.636+0000 7ff5099d1640 1 --2- 172.21.15.55:0/1404366013 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5040ca450 0x7ff50415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:45.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.636+0000 7ff5091d0640 1 -- 172.21.15.55:0/1404366013 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5040ca450 msgr2=0x7ff50415d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:45.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.636+0000 7ff5091d0640 1 --2- 172.21.15.55:0/1404366013 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5040ca450 0x7ff50415d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.636+0000 7ff5091d0640 1 -- 172.21.15.55:0/1404366013 >> v1:172.21.15.55:6789/0 conn(0x7ff5040b3730 legacy=0x7ff5040c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:45.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.636+0000 7ff5091d0640 1 -- 172.21.15.55:0/1404366013 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5040696b0 con 0x7ff5040712f0 2023-07-06T21:57:45.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.636+0000 7ff4fbfff640 1 -- 172.21.15.55:0/1404366013 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293667344 0 0) 0x7ff504159cd0 con 0x7ff5040b3730 2023-07-06T21:57:45.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.640+0000 7ff5091d0640 1 --2- 172.21.15.55:0/1404366013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5040712f0 0x7ff50406a610 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7ff5000097c0 tx=0x7ff50001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193dc96f69f0a446 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:45.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.640+0000 7ff4fbfff640 1 -- 172.21.15.55:0/1404366013 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5000ab650 con 0x7ff5040712f0 2023-07-06T21:57:45.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.640+0000 7ff4fbfff640 1 -- 172.21.15.55:0/1404366013 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5000ab7b0 con 0x7ff5040712f0 2023-07-06T21:57:45.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.640+0000 7ff4fbfff640 1 -- 172.21.15.55:0/1404366013 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5000abb40 con 0x7ff5040712f0 2023-07-06T21:57:45.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.640+0000 7ff50b434640 1 -- 172.21.15.55:0/1404366013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5040712f0 msgr2=0x7ff50406a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:45.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.640+0000 7ff50b434640 1 --2- 172.21.15.55:0/1404366013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5040712f0 0x7ff50406a610 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7ff5000097c0 tx=0x7ff50001c450 comp rx=0 tx=0).stop 2023-07-06T21:57:45.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.640+0000 7ff50b434640 1 -- 172.21.15.55:0/1404366013 shutdown_connections 2023-07-06T21:57:45.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.640+0000 7ff50b434640 1 --2- 172.21.15.55:0/1404366013 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5040ca450 0x7ff50415d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.640+0000 7ff50b434640 1 --2- 172.21.15.55:0/1404366013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5040712f0 0x7ff50406a610 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.640+0000 7ff50b434640 1 -- 172.21.15.55:0/1404366013 >> 172.21.15.55:0/1404366013 conn(0x7ff5040cded0 msgr2=0x7ff5040ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:45.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.640+0000 7ff50b434640 1 -- 172.21.15.55:0/1404366013 shutdown_connections 2023-07-06T21:57:45.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.640+0000 7ff50b434640 1 -- 172.21.15.55:0/1404366013 wait complete. 2023-07-06T21:57:45.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.640+0000 7ff50b434640 1 Processor -- start 2023-07-06T21:57:45.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.640+0000 7ff50b434640 1 -- start start 2023-07-06T21:57:45.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff50b434640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5040712f0 0x7ff50414a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:45.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff50b434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5040b3730 0x7ff504156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:45.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff50b434640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5040ca450 0x7ff504157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:45.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff50b434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50415cd90 con 0x7ff5040b3730 2023-07-06T21:57:45.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff50b434640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5041529b0 con 0x7ff5040712f0 2023-07-06T21:57:45.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff50b434640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff504152c50 con 0x7ff5040ca450 2023-07-06T21:57:45.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff5089cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5040b3730 0x7ff504156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:45.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff5089cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5040b3730 0x7ff504156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46606/0 (socket says 172.21.15.55:46606) 2023-07-06T21:57:45.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff5089cf640 1 -- 172.21.15.55:0/4101156969 learned_addr learned my addr 172.21.15.55:0/4101156969 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:45.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff5091d0640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5040712f0 0x7ff50414a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:45.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff5099d1640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5040ca450 0x7ff504157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:45.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff5089cf640 1 -- 172.21.15.55:0/4101156969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5040ca450 msgr2=0x7ff504157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:45.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff5089cf640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5040ca450 0x7ff504157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff5089cf640 1 -- 172.21.15.55:0/4101156969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5040712f0 msgr2=0x7ff50414a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:45.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff5089cf640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5040712f0 0x7ff50414a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff5089cf640 1 -- 172.21.15.55:0/4101156969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff500009420 con 0x7ff5040b3730 2023-07-06T21:57:45.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff5099d1640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5040ca450 0x7ff504157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:45.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff5089cf640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5040b3730 0x7ff504156de0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4007fd0 tx=0x7ff4f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:45.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff4f9ffb640 1 -- 172.21.15.55:0/4101156969 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4005cf0 con 0x7ff5040b3730 2023-07-06T21:57:45.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff4f9ffb640 1 -- 172.21.15.55:0/4101156969 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f4005e70 con 0x7ff5040b3730 2023-07-06T21:57:45.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff4f9ffb640 1 -- 172.21.15.55:0/4101156969 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f40072f0 con 0x7ff5040b3730 2023-07-06T21:57:45.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff50b434640 1 -- 172.21.15.55:0/4101156969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff504152f30 con 0x7ff5040b3730 2023-07-06T21:57:45.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff50b434640 1 -- 172.21.15.55:0/4101156969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50414a8f0 con 0x7ff5040b3730 2023-07-06T21:57:45.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff50b434640 1 -- 172.21.15.55:0/4101156969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff504066d60 con 0x7ff5040b3730 2023-07-06T21:57:45.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.644+0000 7ff4f9ffb640 1 -- 172.21.15.55:0/4101156969 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 85496+0+0 (secure 0 0 0) 0x7ff4f4007450 con 0x7ff5040b3730 2023-07-06T21:57:45.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.648+0000 7ff4f9ffb640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff4e8066100 0x7ff4e80685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:45.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.648+0000 7ff4f9ffb640 1 -- 172.21.15.55:0/4101156969 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 7113+0+0 (secure 0 0 0) 0x7ff4f40833a0 con 0x7ff5040b3730 2023-07-06T21:57:45.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.648+0000 7ff5091d0640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff4e8066100 0x7ff4e80685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:45.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.648+0000 7ff5091d0640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff4e8066100 0x7ff4e80685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff5000af000 tx=0x7ff5000a7000 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:45.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.652+0000 7ff4f9ffb640 1 -- 172.21.15.55:0/4101156969 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4f4050720 con 0x7ff5040b3730 2023-07-06T21:57:45.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.708+0000 7ff4f9ffb640 1 -- 172.21.15.55:0/4101156969 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff4f4050af0 con 0x7ff5040b3730 2023-07-06T21:57:45.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.844+0000 7ff50b434640 1 -- 172.21.15.55:0/4101156969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5041533e0 con 0x7ff5040b3730 2023-07-06T21:57:45.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.844+0000 7ff4f9ffb640 1 -- 172.21.15.55:0/4101156969 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4679 (secure 0 0 0) 0x7ff4f406fc60 con 0x7ff5040b3730 2023-07-06T21:57:45.843 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:45.843 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2651551074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2651551074},{"type":"v1","addr":"172.21.15.138:6835","nonce":2651551074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1024060506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1024060506},{"type":"v1","addr":"172.21.15.138:6834","nonce":1024060506}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6933,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3347534333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3347534333},{"type":"v1","addr":"172.21.15.55:6836","nonce":3347534333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:57:25.541950+0000","modified":"2023-07-06T21:57:28.574413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3154142571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3154142571},{"type":"v1","addr":"172.21.15.55:6837","nonce":3154142571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-06T21:57:45.843 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 32 2023-07-06T21:57:45.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.844+0000 7ff50b434640 1 -- 172.21.15.55:0/4101156969 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff4e8066100 msgr2=0x7ff4e80685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:45.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.844+0000 7ff50b434640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff4e8066100 0x7ff4e80685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff5000af000 tx=0x7ff5000a7000 comp rx=0 tx=0).stop 2023-07-06T21:57:45.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.844+0000 7ff50b434640 1 -- 172.21.15.55:0/4101156969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5040b3730 msgr2=0x7ff504156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:45.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.844+0000 7ff50b434640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5040b3730 0x7ff504156de0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4007fd0 tx=0x7ff4f400c8e0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.844+0000 7ff50b434640 1 -- 172.21.15.55:0/4101156969 shutdown_connections 2023-07-06T21:57:45.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.844+0000 7ff50b434640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff4e8066100 0x7ff4e80685b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.844+0000 7ff50b434640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5040ca450 0x7ff504157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.844+0000 7ff50b434640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5040b3730 0x7ff504156de0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.844+0000 7ff50b434640 1 --2- 172.21.15.55:0/4101156969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5040712f0 0x7ff50414a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:45.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.844+0000 7ff50b434640 1 -- 172.21.15.55:0/4101156969 >> 172.21.15.55:0/4101156969 conn(0x7ff5040cded0 msgr2=0x7ff5040cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:45.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.848+0000 7ff50b434640 1 -- 172.21.15.55:0/4101156969 shutdown_connections 2023-07-06T21:57:45.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:45.848+0000 7ff50b434640 1 -- 172.21.15.55:0/4101156969 wait complete. 2023-07-06T21:57:45.863 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:46.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.008+0000 7f52b39d2640 1 Processor -- start 2023-07-06T21:57:46.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.008+0000 7f52b39d2640 1 -- start start 2023-07-06T21:57:46.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.008+0000 7f52b39d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52ac0b1fe0 0x7f52ac166ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.008+0000 7f52b39d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ac0cd1c0 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.008+0000 7f52b39d2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ac0cecf0 con 0x7f52ac0ce610 2023-07-06T21:57:46.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.008+0000 7f52b39d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ac0d2310 con 0x7f52ac0b1fe0 2023-07-06T21:57:46.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.008+0000 7f52b176e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f52ac0b7cd0 0x7f52ac0ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43626/0 (socket says 172.21.15.55:43626) 2023-07-06T21:57:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.008+0000 7f52b176e640 1 -- 172.21.15.55:0/1083974454 learned_addr learned my addr 172.21.15.55:0/1083974454 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.008+0000 7f52b1f6f640 1 --2- 172.21.15.55:0/1083974454 >> v2:172.21.15.55:3300/0 conn(0x7f52ac0b1fe0 0x7f52ac166ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.008+0000 7f52a3fff640 1 -- 172.21.15.55:0/1083974454 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793388367 0 0) 0x7f52ac0cd1c0 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.008+0000 7f52a3fff640 1 -- 172.21.15.55:0/1083974454 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5298003530 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.008+0000 7f52b1f6f640 1 -- 172.21.15.55:0/1083974454 >> v1:172.21.15.138:6789/0 conn(0x7f52ac0ce610 legacy=0x7f52ac0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.008+0000 7f52b1f6f640 1 -- 172.21.15.55:0/1083974454 >> v1:172.21.15.55:6789/0 conn(0x7f52ac0b7cd0 legacy=0x7f52ac0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.008+0000 7f52b1f6f640 1 -- 172.21.15.55:0/1083974454 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac0cea60 con 0x7f52ac0b1fe0 2023-07-06T21:57:46.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.012+0000 7f52b1f6f640 1 --2- 172.21.15.55:0/1083974454 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0b1fe0 0x7f52ac166ba0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009d90 tx=0x7f52a401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41373fc59f9bc915 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:46.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.012+0000 7f52a3fff640 1 -- 172.21.15.55:0/1083974454 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a40a5780 con 0x7f52ac0b1fe0 2023-07-06T21:57:46.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.012+0000 7f52a3fff640 1 -- 172.21.15.55:0/1083974454 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a40a58e0 con 0x7f52ac0b1fe0 2023-07-06T21:57:46.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.012+0000 7f52a3fff640 1 -- 172.21.15.55:0/1083974454 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a40a5c70 con 0x7f52ac0b1fe0 2023-07-06T21:57:46.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.012+0000 7f52b39d2640 1 -- 172.21.15.55:0/1083974454 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0b1fe0 msgr2=0x7f52ac166ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.012+0000 7f52b39d2640 1 --2- 172.21.15.55:0/1083974454 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0b1fe0 0x7f52ac166ba0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009d90 tx=0x7f52a401c8c0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.012+0000 7f52b39d2640 1 -- 172.21.15.55:0/1083974454 shutdown_connections 2023-07-06T21:57:46.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.012+0000 7f52b39d2640 1 --2- 172.21.15.55:0/1083974454 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0b1fe0 0x7f52ac166ba0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.012+0000 7f52b39d2640 1 -- 172.21.15.55:0/1083974454 >> 172.21.15.55:0/1083974454 conn(0x7f52ac0ceee0 msgr2=0x7f52ac0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:46.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.012+0000 7f52b39d2640 1 -- 172.21.15.55:0/1083974454 shutdown_connections 2023-07-06T21:57:46.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.012+0000 7f52b39d2640 1 -- 172.21.15.55:0/1083974454 wait complete. 2023-07-06T21:57:46.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b39d2640 1 Processor -- start 2023-07-06T21:57:46.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b39d2640 1 -- start start 2023-07-06T21:57:46.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b39d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52ac0b1fe0 0x7f52ac158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b39d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0b7cd0 0x7f52ac1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b39d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52ac0ce610 0x7f52ac0d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b39d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac1540c0 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b39d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac15b320 con 0x7f52ac0b1fe0 2023-07-06T21:57:46.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b39d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac15aaa0 con 0x7f52ac0ce610 2023-07-06T21:57:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b0f6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0b7cd0 0x7f52ac1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b0f6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0b7cd0 0x7f52ac1536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46614/0 (socket says 172.21.15.55:46614) 2023-07-06T21:57:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b0f6d640 1 -- 172.21.15.55:0/2168533297 learned_addr learned my addr 172.21.15.55:0/2168533297 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b176e640 1 --2- 172.21.15.55:0/2168533297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52ac0b1fe0 0x7f52ac158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b1f6f640 1 --2- 172.21.15.55:0/2168533297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52ac0ce610 0x7f52ac0d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b0f6d640 1 -- 172.21.15.55:0/2168533297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52ac0ce610 msgr2=0x7f52ac0d2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b0f6d640 1 --2- 172.21.15.55:0/2168533297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52ac0ce610 0x7f52ac0d2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b0f6d640 1 -- 172.21.15.55:0/2168533297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52ac0b1fe0 msgr2=0x7f52ac158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b0f6d640 1 --2- 172.21.15.55:0/2168533297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52ac0b1fe0 0x7f52ac158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b0f6d640 1 -- 172.21.15.55:0/2168533297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a4009a70 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b0f6d640 1 --2- 172.21.15.55:0/2168533297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0b7cd0 0x7f52ac1536a0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f529c00c420 tx=0x7f529c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:46.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52a1ffb640 1 -- 172.21.15.55:0/2168533297 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c0052d0 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52a1ffb640 1 -- 172.21.15.55:0/2168533297 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c005430 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52a1ffb640 1 -- 172.21.15.55:0/2168533297 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c007260 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b39d2640 1 -- 172.21.15.55:0/2168533297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ac15ad60 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.016+0000 7f52b39d2640 1 -- 172.21.15.55:0/2168533297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ac1588d0 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.020+0000 7f52b39d2640 1 -- 172.21.15.55:0/2168533297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ac154270 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.020+0000 7f52a1ffb640 1 -- 172.21.15.55:0/2168533297 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f529c0073c0 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.020+0000 7f52a1ffb640 1 --2- 172.21.15.55:0/2168533297 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f52900663f0 0x7f52900688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.020+0000 7f52a1ffb640 1 -- 172.21.15.55:0/2168533297 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 7113+0+0 (secure 0 0 0) 0x7f529c083470 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.020+0000 7f52b176e640 1 --2- 172.21.15.55:0/2168533297 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f52900663f0 0x7f52900688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.020+0000 7f52b176e640 1 --2- 172.21.15.55:0/2168533297 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f52900663f0 0x7f52900688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f52a80011f0 tx=0x7f52a8007d40 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:46.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.024+0000 7f52a1ffb640 1 -- 172.21.15.55:0/2168533297 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f529c0505e0 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.180+0000 7f52b39d2640 1 -- 172.21.15.55:0/2168533297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52ac066d60 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.184+0000 7f52a1ffb640 1 -- 172.21.15.55:0/2168533297 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+19605 (secure 0 0 0) 0x7f529c053c00 con 0x7f52ac0b7cd0 2023-07-06T21:57:46.181 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:46.181 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:57:43.676372+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:57:23.252496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-06T21:57:24.528387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3832295075":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/2958882201":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/3615728228":"2023-07-07T21:57:43.676340+0000","172.21.15.55:6833/1694297670":"2023-07-07T21:57:43.676340+0000","172.21.15.55:6832/1694297670":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/5393205":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/2896474133":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/1802623894":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/1987324425":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/1073362678":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1848976334":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1541327786":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1765249513":"2023-07-07T21:57:37.612097+0000","172.21.15.55:6833/3540074910":"2023-07-07T21:57:37.612097+0000","172.21.15.55:6832/3540074910":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1768372577":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1203793928":"2023-07-07T21:57:37.612097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.184+0000 7f52b39d2640 1 -- 172.21.15.55:0/2168533297 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f52900663f0 msgr2=0x7f52900688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.184+0000 7f52b39d2640 1 --2- 172.21.15.55:0/2168533297 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f52900663f0 0x7f52900688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f52a80011f0 tx=0x7f52a8007d40 comp rx=0 tx=0).stop 2023-07-06T21:57:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.184+0000 7f52b39d2640 1 -- 172.21.15.55:0/2168533297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0b7cd0 msgr2=0x7f52ac1536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.184+0000 7f52b39d2640 1 --2- 172.21.15.55:0/2168533297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0b7cd0 0x7f52ac1536a0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f529c00c420 tx=0x7f529c00c8e0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.184+0000 7f52b39d2640 1 -- 172.21.15.55:0/2168533297 shutdown_connections 2023-07-06T21:57:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.184+0000 7f52b39d2640 1 --2- 172.21.15.55:0/2168533297 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f52900663f0 0x7f52900688a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.184+0000 7f52b39d2640 1 --2- 172.21.15.55:0/2168533297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52ac0ce610 0x7f52ac0d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.184+0000 7f52b39d2640 1 --2- 172.21.15.55:0/2168533297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52ac0b7cd0 0x7f52ac1536a0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.184+0000 7f52b39d2640 1 --2- 172.21.15.55:0/2168533297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52ac0b1fe0 0x7f52ac158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.184+0000 7f52b39d2640 1 -- 172.21.15.55:0/2168533297 >> 172.21.15.55:0/2168533297 conn(0x7f52ac0ceee0 msgr2=0x7f52ac157260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:46.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.184+0000 7f52b39d2640 1 -- 172.21.15.55:0/2168533297 shutdown_connections 2023-07-06T21:57:46.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.184+0000 7f52b39d2640 1 -- 172.21.15.55:0/2168533297 wait complete. 2023-07-06T21:57:46.203 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T21:57:46.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.348+0000 7f602da48640 1 Processor -- start 2023-07-06T21:57:46.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.348+0000 7f602da48640 1 -- start start 2023-07-06T21:57:46.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.352+0000 7f602da48640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60281597d0 0x7f60280ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.352+0000 7f602da48640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60280cd490 con 0x7f60280cac10 2023-07-06T21:57:46.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.352+0000 7f602da48640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602815cf60 con 0x7f6028070700 2023-07-06T21:57:46.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.352+0000 7f602da48640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60280cb040 con 0x7f60281597d0 2023-07-06T21:57:46.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.352+0000 7f601ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f60280cac10 0x7f602806fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43640/0 (socket says 172.21.15.55:43640) 2023-07-06T21:57:46.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.352+0000 7f601ffff640 1 -- 172.21.15.55:0/3377110024 learned_addr learned my addr 172.21.15.55:0/3377110024 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.352+0000 7f6026ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60281597d0 0x7f60280ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.352+0000 7f60267fc640 1 -- 172.21.15.55:0/3377110024 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310154220 0 0) 0x7f60280cd490 con 0x7f60280cac10 2023-07-06T21:57:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.352+0000 7f6026ffd640 1 -- 172.21.15.55:0/3377110024 >> v1:172.21.15.138:6789/0 conn(0x7f6028070700 legacy=0x7f60280b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.352+0000 7f6026ffd640 1 -- 172.21.15.55:0/3377110024 >> v1:172.21.15.55:6789/0 conn(0x7f60280cac10 legacy=0x7f602806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.352+0000 7f6026ffd640 1 -- 172.21.15.55:0/3377110024 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60280ccb60 con 0x7f60281597d0 2023-07-06T21:57:46.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.352+0000 7f6026ffd640 1 --2- 172.21.15.55:0/3377110024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60281597d0 0x7f60280ca6d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f60180097c0 tx=0x7f601801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc27b187735519fb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:46.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f60267fc640 1 -- 172.21.15.55:0/3377110024 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60180ac620 con 0x7f60281597d0 2023-07-06T21:57:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f60267fc640 1 -- 172.21.15.55:0/3377110024 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60180ac780 con 0x7f60281597d0 2023-07-06T21:57:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f60267fc640 1 -- 172.21.15.55:0/3377110024 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60180acb10 con 0x7f60281597d0 2023-07-06T21:57:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 -- 172.21.15.55:0/3377110024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60281597d0 msgr2=0x7f60280ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 --2- 172.21.15.55:0/3377110024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60281597d0 0x7f60280ca6d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f60180097c0 tx=0x7f601801c3c0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 -- 172.21.15.55:0/3377110024 shutdown_connections 2023-07-06T21:57:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 --2- 172.21.15.55:0/3377110024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60281597d0 0x7f60280ca6d0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 -- 172.21.15.55:0/3377110024 >> 172.21.15.55:0/3377110024 conn(0x7f60280cb970 msgr2=0x7f60280cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 -- 172.21.15.55:0/3377110024 shutdown_connections 2023-07-06T21:57:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 -- 172.21.15.55:0/3377110024 wait complete. 2023-07-06T21:57:46.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 Processor -- start 2023-07-06T21:57:46.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 -- start start 2023-07-06T21:57:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6028070700 0x7f6028157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60280cac10 0x7f602814e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60280b4840 0x7f6028151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60280c7850 con 0x7f60280cac10 2023-07-06T21:57:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6028158410 con 0x7f60280b4840 2023-07-06T21:57:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f602da48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60280c7190 con 0x7f6028070700 2023-07-06T21:57:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f601ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60280cac10 0x7f602814e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f601ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60280cac10 0x7f602814e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46634/0 (socket says 172.21.15.55:46634) 2023-07-06T21:57:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.356+0000 7f601ffff640 1 -- 172.21.15.55:0/1562839434 learned_addr learned my addr 172.21.15.55:0/1562839434 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:46.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f6026ffd640 1 --2- 172.21.15.55:0/1562839434 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6028070700 0x7f6028157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f60277fe640 1 --2- 172.21.15.55:0/1562839434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60280b4840 0x7f6028151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f601ffff640 1 -- 172.21.15.55:0/1562839434 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6028070700 msgr2=0x7f6028157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f601ffff640 1 --2- 172.21.15.55:0/1562839434 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6028070700 0x7f6028157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f601ffff640 1 -- 172.21.15.55:0/1562839434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60280b4840 msgr2=0x7f6028151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f601ffff640 1 --2- 172.21.15.55:0/1562839434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60280b4840 0x7f6028151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f601ffff640 1 -- 172.21.15.55:0/1562839434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6018009420 con 0x7f60280cac10 2023-07-06T21:57:46.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f601ffff640 1 --2- 172.21.15.55:0/1562839434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60280cac10 0x7f602814e350 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f601000c4a0 tx=0x7f601000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:46.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f6024ff9640 1 -- 172.21.15.55:0/1562839434 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60100074e0 con 0x7f60280cac10 2023-07-06T21:57:46.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f6024ff9640 1 -- 172.21.15.55:0/1562839434 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6010007640 con 0x7f60280cac10 2023-07-06T21:57:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f6024ff9640 1 -- 172.21.15.55:0/1562839434 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010004a30 con 0x7f60280cac10 2023-07-06T21:57:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f602da48640 1 -- 172.21.15.55:0/1562839434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60280c7470 con 0x7f60280cac10 2023-07-06T21:57:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f602da48640 1 -- 172.21.15.55:0/1562839434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602814e890 con 0x7f60280cac10 2023-07-06T21:57:46.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f602da48640 1 -- 172.21.15.55:0/1562839434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60280cd900 con 0x7f60280cac10 2023-07-06T21:57:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f6024ff9640 1 -- 172.21.15.55:0/1562839434 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6010004b90 con 0x7f60280cac10 2023-07-06T21:57:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.360+0000 7f6024ff9640 1 --2- 172.21.15.55:0/1562839434 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f60080663d0 0x7f6008068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.364+0000 7f6024ff9640 1 -- 172.21.15.55:0/1562839434 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 7113+0+0 (secure 0 0 0) 0x7f6010083440 con 0x7f60280cac10 2023-07-06T21:57:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.364+0000 7f6026ffd640 1 --2- 172.21.15.55:0/1562839434 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f60080663d0 0x7f6008068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.364+0000 7f6026ffd640 1 --2- 172.21.15.55:0/1562839434 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f60080663d0 0x7f6008068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f60180ae000 tx=0x7f60180a7000 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:46.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.364+0000 7f6024ff9640 1 -- 172.21.15.55:0/1562839434 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60280cd900 con 0x7f60280cac10 2023-07-06T21:57:46.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.556+0000 7f602da48640 1 -- 172.21.15.55:0/1562839434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f60280c7990 con 0x7f60280cac10 2023-07-06T21:57:46.696 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-07-06T21:57:46.696+0000 7f5b6d80c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T21:57:46.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.712+0000 7f6024ff9640 1 -- 172.21.15.55:0/1562839434 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f60280c7990 con 0x7f60280cac10 2023-07-06T21:57:46.709 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T21:57:46.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.712+0000 7f602da48640 1 -- 172.21.15.55:0/1562839434 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f60080663d0 msgr2=0x7f6008068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.712+0000 7f602da48640 1 --2- 172.21.15.55:0/1562839434 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f60080663d0 0x7f6008068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f60180ae000 tx=0x7f60180a7000 comp rx=0 tx=0).stop 2023-07-06T21:57:46.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.712+0000 7f602da48640 1 -- 172.21.15.55:0/1562839434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60280cac10 msgr2=0x7f602814e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.712+0000 7f602da48640 1 --2- 172.21.15.55:0/1562839434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60280cac10 0x7f602814e350 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f601000c4a0 tx=0x7f601000c960 comp rx=0 tx=0).stop 2023-07-06T21:57:46.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.712+0000 7f602da48640 1 -- 172.21.15.55:0/1562839434 shutdown_connections 2023-07-06T21:57:46.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.712+0000 7f602da48640 1 --2- 172.21.15.55:0/1562839434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60280b4840 0x7f6028151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.712+0000 7f602da48640 1 --2- 172.21.15.55:0/1562839434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60280cac10 0x7f602814e350 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.712+0000 7f602da48640 1 --2- 172.21.15.55:0/1562839434 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f60080663d0 0x7f6008068880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.712+0000 7f602da48640 1 --2- 172.21.15.55:0/1562839434 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6028070700 0x7f6028157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.712+0000 7f602da48640 1 -- 172.21.15.55:0/1562839434 >> 172.21.15.55:0/1562839434 conn(0x7f60280cb970 msgr2=0x7f60280cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:46.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.712+0000 7f602da48640 1 -- 172.21.15.55:0/1562839434 shutdown_connections 2023-07-06T21:57:46.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.712+0000 7f602da48640 1 -- 172.21.15.55:0/1562839434 wait complete. 2023-07-06T21:57:46.716 INFO:tasks.ceph.mds.c.smithi055.stderr: -3819> 2023-07-06T21:57:30.904+0000 7fb611ff1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T21:57:46.731 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T21:57:46.766 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T21:57:46.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.880+0000 7fbf6926d640 1 Processor -- start 2023-07-06T21:57:46.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.880+0000 7fbf6926d640 1 -- start start 2023-07-06T21:57:46.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf6926d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf64070d70 0x7fbf640b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf6926d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbf640b1170 0x7fbf6406eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf6926d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf640cc030 con 0x7fbf640709a0 2023-07-06T21:57:46.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf6926d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf640b15f0 con 0x7fbf640b1170 2023-07-06T21:57:46.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf6926d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640cc300 con 0x7fbf64070d70 2023-07-06T21:57:46.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf62ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbf640709a0 0x7fbf640cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43644/0 (socket says 172.21.15.55:43644) 2023-07-06T21:57:46.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf62ffd640 1 -- 172.21.15.55:0/3865639357 learned_addr learned my addr 172.21.15.55:0/3865639357 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:46.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf5bfff640 1 --2- 172.21.15.55:0/3865639357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf64070d70 0x7fbf640b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf637fe640 1 --2- 172.21.15.55:0/3865639357 >> v2:172.21.15.138:3300/0 conn(0x7fbf640b1170 0x7fbf6406eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 -- 172.21.15.55:0/3865639357 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160003812 0 0) 0x7fbf640cc030 con 0x7fbf640709a0 2023-07-06T21:57:46.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 -- 172.21.15.55:0/3865639357 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf50003530 con 0x7fbf640709a0 2023-07-06T21:57:46.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 -- 172.21.15.55:0/3865639357 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 778471618 0 0) 0x7fbf50003530 con 0x7fbf640709a0 2023-07-06T21:57:46.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 -- 172.21.15.55:0/3865639357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf64070d70 msgr2=0x7fbf640b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:46.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 --2- 172.21.15.55:0/3865639357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf64070d70 0x7fbf640b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 -- 172.21.15.55:0/3865639357 >> v2:172.21.15.138:3300/0 conn(0x7fbf640b1170 msgr2=0x7fbf6406eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:46.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 --2- 172.21.15.55:0/3865639357 >> v2:172.21.15.138:3300/0 conn(0x7fbf640b1170 0x7fbf6406eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 -- 172.21.15.55:0/3865639357 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf640cc5e0 con 0x7fbf640709a0 2023-07-06T21:57:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 -- 172.21.15.55:0/3865639357 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fbf54001680 con 0x7fbf640709a0 2023-07-06T21:57:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 -- 172.21.15.55:0/3865639357 >> v1:172.21.15.55:6789/0 conn(0x7fbf640709a0 legacy=0x7fbf640cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 --2- 172.21.15.55:0/3865639357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf64070d70 0x7fbf50003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 --2- 172.21.15.55:0/3865639357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf50003f00 0x7fbf500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 --2- 172.21.15.55:0/3865639357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf50004d10 0x7fbf50005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 -- 172.21.15.55:0/3865639357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640b15f0 con 0x7fbf50003f00 2023-07-06T21:57:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 -- 172.21.15.55:0/3865639357 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640cc300 con 0x7fbf50004d10 2023-07-06T21:57:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf627fc640 1 -- 172.21.15.55:0/3865639357 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5000b9c0 con 0x7fbf64070d70 2023-07-06T21:57:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf5bfff640 1 --2- 172.21.15.55:0/3865639357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf50003f00 0x7fbf500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf62ffd640 1 --2- 172.21.15.55:0/3865639357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf64070d70 0x7fbf50003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf637fe640 1 --2- 172.21.15.55:0/3865639357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf50004d10 0x7fbf50005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf5bfff640 1 -- 172.21.15.55:0/3865639357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf64070d70 msgr2=0x7fbf50003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf5bfff640 1 --2- 172.21.15.55:0/3865639357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf64070d70 0x7fbf50003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf5bfff640 1 -- 172.21.15.55:0/3865639357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf50004d10 msgr2=0x7fbf50005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf5bfff640 1 --2- 172.21.15.55:0/3865639357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf50004d10 0x7fbf50005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.884+0000 7fbf5bfff640 1 -- 172.21.15.55:0/3865639357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf50003530 con 0x7fbf50003f00 2023-07-06T21:57:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.888+0000 7fbf5bfff640 1 --2- 172.21.15.55:0/3865639357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf50003f00 0x7fbf500047d0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009ae0 tx=0x7fbf4c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219ab397609ed46a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.888+0000 7fbf627fc640 1 -- 172.21.15.55:0/3865639357 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c0a5530 con 0x7fbf50003f00 2023-07-06T21:57:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.888+0000 7fbf627fc640 1 -- 172.21.15.55:0/3865639357 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c0a5690 con 0x7fbf50003f00 2023-07-06T21:57:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.888+0000 7fbf627fc640 1 -- 172.21.15.55:0/3865639357 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c0a5a80 con 0x7fbf50003f00 2023-07-06T21:57:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.888+0000 7fbf6926d640 1 -- 172.21.15.55:0/3865639357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf50003f00 msgr2=0x7fbf500047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.888+0000 7fbf6926d640 1 --2- 172.21.15.55:0/3865639357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf50003f00 0x7fbf500047d0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009ae0 tx=0x7fbf4c01c9f0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.888+0000 7fbf637fe640 1 -- 172.21.15.55:0/3865639357 reap_dead start 2023-07-06T21:57:46.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.888+0000 7fbf6926d640 1 -- 172.21.15.55:0/3865639357 shutdown_connections 2023-07-06T21:57:46.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.888+0000 7fbf6926d640 1 -- 172.21.15.55:0/3865639357 >> 172.21.15.55:0/3865639357 conn(0x7fbf640cea70 msgr2=0x7fbf640ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:46.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.888+0000 7fbf6926d640 1 -- 172.21.15.55:0/3865639357 shutdown_connections 2023-07-06T21:57:46.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.888+0000 7fbf6926d640 1 -- 172.21.15.55:0/3865639357 wait complete. 2023-07-06T21:57:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf6926d640 1 Processor -- start 2023-07-06T21:57:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf6926d640 1 -- start start 2023-07-06T21:57:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf6926d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf50003f00 0x7fbf64159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf6926d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf64159810 0x7fbf6415de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf6926d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf640c8b10 0x7fbf640c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf6926d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6406a3c0 con 0x7fbf50003f00 2023-07-06T21:57:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf6926d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640697b0 con 0x7fbf640c8b10 2023-07-06T21:57:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf6926d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf64069a90 con 0x7fbf64159810 2023-07-06T21:57:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf62ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf50003f00 0x7fbf64159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf62ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf50003f00 0x7fbf64159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46672/0 (socket says 172.21.15.55:46672) 2023-07-06T21:57:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf62ffd640 1 -- 172.21.15.55:0/600721738 learned_addr learned my addr 172.21.15.55:0/600721738 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf5bfff640 1 --2- 172.21.15.55:0/600721738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf64159810 0x7fbf6415de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf637fe640 1 --2- 172.21.15.55:0/600721738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf640c8b10 0x7fbf640c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf62ffd640 1 -- 172.21.15.55:0/600721738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf64159810 msgr2=0x7fbf6415de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf62ffd640 1 --2- 172.21.15.55:0/600721738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf64159810 0x7fbf6415de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf62ffd640 1 -- 172.21.15.55:0/600721738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf640c8b10 msgr2=0x7fbf640c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf62ffd640 1 --2- 172.21.15.55:0/600721738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf640c8b10 0x7fbf640c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:46.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf62ffd640 1 -- 172.21.15.55:0/600721738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf64069d70 con 0x7fbf50003f00 2023-07-06T21:57:46.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf62ffd640 1 --2- 172.21.15.55:0/600721738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf50003f00 0x7fbf64159230 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fbf54007290 tx=0x7fbf54007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:46.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf5b7fe640 1 -- 172.21.15.55:0/600721738 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf540014b0 con 0x7fbf50003f00 2023-07-06T21:57:46.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf5b7fe640 1 -- 172.21.15.55:0/600721738 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5400f940 con 0x7fbf50003f00 2023-07-06T21:57:46.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf5b7fe640 1 -- 172.21.15.55:0/600721738 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400fd10 con 0x7fbf50003f00 2023-07-06T21:57:46.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf6926d640 1 -- 172.21.15.55:0/600721738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6406a050 con 0x7fbf50003f00 2023-07-06T21:57:46.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf6926d640 1 -- 172.21.15.55:0/600721738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf640693f0 con 0x7fbf50003f00 2023-07-06T21:57:46.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.892+0000 7fbf6926d640 1 -- 172.21.15.55:0/600721738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf64066d60 con 0x7fbf50003f00 2023-07-06T21:57:46.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.896+0000 7fbf5b7fe640 1 -- 172.21.15.55:0/600721738 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbf5401d460 con 0x7fbf50003f00 2023-07-06T21:57:46.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.896+0000 7fbf5b7fe640 1 --2- 172.21.15.55:0/600721738 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fbf440663a0 0x7fbf44068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:46.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.896+0000 7fbf5b7fe640 1 -- 172.21.15.55:0/600721738 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 7199+0+0 (secure 0 0 0) 0x7fbf54084620 con 0x7fbf50003f00 2023-07-06T21:57:46.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.896+0000 7fbf5bfff640 1 --2- 172.21.15.55:0/600721738 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fbf440663a0 0x7fbf44068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:46.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.896+0000 7fbf5bfff640 1 --2- 172.21.15.55:0/600721738 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fbf440663a0 0x7fbf44068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0af000 tx=0x7fbf4c0046d0 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:46.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:46.900+0000 7fbf5b7fe640 1 -- 172.21.15.55:0/600721738 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf54054f10 con 0x7fbf50003f00 2023-07-06T21:57:47.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.088+0000 7fbf6926d640 1 -- 172.21.15.55:0/600721738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbf640aebd0 con 0x7fbf50003f00 2023-07-06T21:57:47.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.728+0000 7fbf5b7fe640 1 -- 172.21.15.55:0/600721738 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbf54054aa0 con 0x7fbf50003f00 2023-07-06T21:57:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.728+0000 7fbf6926d640 1 -- 172.21.15.55:0/600721738 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fbf440663a0 msgr2=0x7fbf44068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.728+0000 7fbf6926d640 1 --2- 172.21.15.55:0/600721738 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fbf440663a0 0x7fbf44068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0af000 tx=0x7fbf4c0046d0 comp rx=0 tx=0).stop 2023-07-06T21:57:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.728+0000 7fbf6926d640 1 -- 172.21.15.55:0/600721738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf50003f00 msgr2=0x7fbf64159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.728+0000 7fbf6926d640 1 --2- 172.21.15.55:0/600721738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf50003f00 0x7fbf64159230 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fbf54007290 tx=0x7fbf54007750 comp rx=0 tx=0).stop 2023-07-06T21:57:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.728+0000 7fbf6926d640 1 -- 172.21.15.55:0/600721738 shutdown_connections 2023-07-06T21:57:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.728+0000 7fbf6926d640 1 --2- 172.21.15.55:0/600721738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf640c8b10 0x7fbf640c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.728+0000 7fbf6926d640 1 --2- 172.21.15.55:0/600721738 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fbf440663a0 0x7fbf44068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.728+0000 7fbf6926d640 1 --2- 172.21.15.55:0/600721738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf64159810 0x7fbf6415de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.728+0000 7fbf6926d640 1 --2- 172.21.15.55:0/600721738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf50003f00 0x7fbf64159230 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:47.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.728+0000 7fbf6926d640 1 -- 172.21.15.55:0/600721738 >> 172.21.15.55:0/600721738 conn(0x7fbf640cea70 msgr2=0x7fbf640ca7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:47.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.728+0000 7fbf6926d640 1 -- 172.21.15.55:0/600721738 shutdown_connections 2023-07-06T21:57:47.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.732+0000 7fbf6926d640 1 -- 172.21.15.55:0/600721738 wait complete. 2023-07-06T21:57:47.751 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T21:57:47.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.948+0000 7fdfd9f74640 1 Processor -- start 2023-07-06T21:57:47.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.948+0000 7fdfd9f74640 1 -- start start 2023-07-06T21:57:47.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.952+0000 7fdfd9f74640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfd40cd3e0 0x7fdfd40cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:47.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.952+0000 7fdfd9f74640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd4159350 con 0x7fdfd40cc150 2023-07-06T21:57:47.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.952+0000 7fdfd9f74640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd4158d90 con 0x7fdfd40c8910 2023-07-06T21:57:47.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.952+0000 7fdfd9f74640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd40ccf50 con 0x7fdfd40cd3e0 2023-07-06T21:57:47.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.952+0000 7fdfd2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfd40cd3e0 0x7fdfd40cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:47.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.952+0000 7fdfd3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdfd40cc150 0x7fdfd406bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43652/0 (socket says 172.21.15.55:43652) 2023-07-06T21:57:47.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.952+0000 7fdfd3fff640 1 -- 172.21.15.55:0/2231452977 learned_addr learned my addr 172.21.15.55:0/2231452977 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:47.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.952+0000 7fdfd2ffd640 1 -- 172.21.15.55:0/2231452977 >> v1:172.21.15.138:6789/0 conn(0x7fdfd40c8910 legacy=0x7fdfd4158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:47.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.952+0000 7fdfd2ffd640 1 -- 172.21.15.55:0/2231452977 >> v1:172.21.15.55:6789/0 conn(0x7fdfd40cc150 legacy=0x7fdfd406bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:47.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.952+0000 7fdfd2ffd640 1 -- 172.21.15.55:0/2231452977 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd4159070 con 0x7fdfd40cd3e0 2023-07-06T21:57:47.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.952+0000 7fdfd27fc640 1 -- 172.21.15.55:0/2231452977 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382026158 0 0) 0x7fdfd4159350 con 0x7fdfd40cc150 2023-07-06T21:57:47.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd2ffd640 1 --2- 172.21.15.55:0/2231452977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd40cd3e0 0x7fdfd40cbc10 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800a960 tx=0x7fdfc801d750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2335de523e56e11e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:47.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd27fc640 1 -- 172.21.15.55:0/2231452977 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80a6800 con 0x7fdfd40cd3e0 2023-07-06T21:57:47.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd27fc640 1 -- 172.21.15.55:0/2231452977 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc80a6960 con 0x7fdfd40cd3e0 2023-07-06T21:57:47.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd27fc640 1 -- 172.21.15.55:0/2231452977 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80a6cf0 con 0x7fdfd40cd3e0 2023-07-06T21:57:47.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2231452977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd40cd3e0 msgr2=0x7fdfd40cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:47.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 --2- 172.21.15.55:0/2231452977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd40cd3e0 0x7fdfd40cbc10 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800a960 tx=0x7fdfc801d750 comp rx=0 tx=0).stop 2023-07-06T21:57:47.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2231452977 shutdown_connections 2023-07-06T21:57:47.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 --2- 172.21.15.55:0/2231452977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd40cd3e0 0x7fdfd40cbc10 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:47.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2231452977 >> 172.21.15.55:0/2231452977 conn(0x7fdfd40cde30 msgr2=0x7fdfd40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:47.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2231452977 shutdown_connections 2023-07-06T21:57:47.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2231452977 wait complete. 2023-07-06T21:57:47.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 Processor -- start 2023-07-06T21:57:47.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 -- start start 2023-07-06T21:57:47.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd40c8910 0x7fdfd41445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:47.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfd40cc150 0x7fdfd414cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:47.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd40b0d20 0x7fdfd414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:47.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40b1870 con 0x7fdfd40b0d20 2023-07-06T21:57:47.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40c40e0 con 0x7fdfd40c8910 2023-07-06T21:57:47.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd9f74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40c43c0 con 0x7fdfd40cc150 2023-07-06T21:57:47.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.956+0000 7fdfd3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd40b0d20 0x7fdfd414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:47.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfd3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd40b0d20 0x7fdfd414d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46684/0 (socket says 172.21.15.55:46684) 2023-07-06T21:57:47.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfd3fff640 1 -- 172.21.15.55:0/2443708460 learned_addr learned my addr 172.21.15.55:0/2443708460 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:47.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfd37fe640 1 --2- 172.21.15.55:0/2443708460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd40c8910 0x7fdfd41445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:47.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfd2ffd640 1 --2- 172.21.15.55:0/2443708460 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfd40cc150 0x7fdfd414cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:47.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfd3fff640 1 -- 172.21.15.55:0/2443708460 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfd40cc150 msgr2=0x7fdfd414cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:47.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfd3fff640 1 --2- 172.21.15.55:0/2443708460 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfd40cc150 0x7fdfd414cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:47.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfd3fff640 1 -- 172.21.15.55:0/2443708460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd40c8910 msgr2=0x7fdfd41445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:47.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfd3fff640 1 --2- 172.21.15.55:0/2443708460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd40c8910 0x7fdfd41445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:47.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfd3fff640 1 -- 172.21.15.55:0/2443708460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc800a5c0 con 0x7fdfd40b0d20 2023-07-06T21:57:47.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfd3fff640 1 --2- 172.21.15.55:0/2443708460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd40b0d20 0x7fdfd414d1a0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc001570 tx=0x7fdfcc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:47.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfbbfff640 1 -- 172.21.15.55:0/2443708460 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00a640 con 0x7fdfd40b0d20 2023-07-06T21:57:47.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfbbfff640 1 -- 172.21.15.55:0/2443708460 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc00a7c0 con 0x7fdfd40b0d20 2023-07-06T21:57:47.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfbbfff640 1 -- 172.21.15.55:0/2443708460 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00ab70 con 0x7fdfd40b0d20 2023-07-06T21:57:47.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2443708460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd40c46a0 con 0x7fdfd40b0d20 2023-07-06T21:57:47.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2443708460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd40b28a0 con 0x7fdfd40b0d20 2023-07-06T21:57:47.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2443708460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd40c4890 con 0x7fdfd40b0d20 2023-07-06T21:57:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfbbfff640 1 -- 172.21.15.55:0/2443708460 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdfcc00acd0 con 0x7fdfd40b0d20 2023-07-06T21:57:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfbbfff640 1 --2- 172.21.15.55:0/2443708460 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fdfc00663d0 0x7fdfc0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.960+0000 7fdfbbfff640 1 -- 172.21.15.55:0/2443708460 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 7199+0+0 (secure 0 0 0) 0x7fdfcc0836d0 con 0x7fdfd40b0d20 2023-07-06T21:57:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.964+0000 7fdfd37fe640 1 --2- 172.21.15.55:0/2443708460 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fdfc00663d0 0x7fdfc0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.964+0000 7fdfd37fe640 1 --2- 172.21.15.55:0/2443708460 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fdfc00663d0 0x7fdfc0068880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4157550 tx=0x7fdfc4009040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:47.964+0000 7fdfbbfff640 1 -- 172.21.15.55:0/2443708460 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfcc050670 con 0x7fdfd40b0d20 2023-07-06T21:57:48.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.124+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2443708460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdfd4066d60 con 0x7fdfd40b0d20 2023-07-06T21:57:48.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.732+0000 7fdfbbfff640 1 -- 172.21.15.55:0/2443708460 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdfcc053c90 con 0x7fdfd40b0d20 2023-07-06T21:57:48.731 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-07-06T21:57:48.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.736+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2443708460 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fdfc00663d0 msgr2=0x7fdfc0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:48.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.736+0000 7fdfd9f74640 1 --2- 172.21.15.55:0/2443708460 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fdfc00663d0 0x7fdfc0068880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4157550 tx=0x7fdfc4009040 comp rx=0 tx=0).stop 2023-07-06T21:57:48.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.736+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2443708460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd40b0d20 msgr2=0x7fdfd414d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:48.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.736+0000 7fdfd9f74640 1 --2- 172.21.15.55:0/2443708460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd40b0d20 0x7fdfd414d1a0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc001570 tx=0x7fdfcc00cca0 comp rx=0 tx=0).stop 2023-07-06T21:57:48.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.736+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2443708460 shutdown_connections 2023-07-06T21:57:48.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.736+0000 7fdfd9f74640 1 --2- 172.21.15.55:0/2443708460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd40b0d20 0x7fdfd414d1a0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:48.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.736+0000 7fdfd9f74640 1 --2- 172.21.15.55:0/2443708460 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fdfc00663d0 0x7fdfc0068880 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:48.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.736+0000 7fdfd9f74640 1 --2- 172.21.15.55:0/2443708460 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfd40cc150 0x7fdfd414cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:48.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.736+0000 7fdfd9f74640 1 --2- 172.21.15.55:0/2443708460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd40c8910 0x7fdfd41445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:48.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.736+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2443708460 >> 172.21.15.55:0/2443708460 conn(0x7fdfd40cde30 msgr2=0x7fdfd4151160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:48.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.740+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2443708460 shutdown_connections 2023-07-06T21:57:48.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.740+0000 7fdfd9f74640 1 -- 172.21.15.55:0/2443708460 wait complete. 2023-07-06T21:57:48.761 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T21:57:48.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.912+0000 7faba260b640 1 Processor -- start 2023-07-06T21:57:48.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.912+0000 7faba260b640 1 -- start start 2023-07-06T21:57:48.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.912+0000 7faba260b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fab9c0ccb70 0x7fab9c15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:48.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.912+0000 7faba260b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab9c0b3e70 con 0x7fab9c0c9b90 2023-07-06T21:57:48.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.912+0000 7faba260b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab9c159c30 con 0x7fab9c0693f0 2023-07-06T21:57:48.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.912+0000 7faba260b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab9c0c9070 con 0x7fab9c0ccb70 2023-07-06T21:57:48.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.912+0000 7fab9bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fab9c0c9b90 0x7fab9c0c9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43656/0 (socket says 172.21.15.55:43656) 2023-07-06T21:57:48.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.912+0000 7fab9bfff640 1 -- 172.21.15.55:0/2985203137 learned_addr learned my addr 172.21.15.55:0/2985203137 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.912+0000 7fab9b7fe640 1 --2- 172.21.15.55:0/2985203137 >> v2:172.21.15.138:3300/0 conn(0x7fab9c0ccb70 0x7fab9c15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.912+0000 7fab9affd640 1 -- 172.21.15.55:0/2985203137 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10490243 0 0) 0x7fab8c001120 con 0x7fab9c0c9b90 2023-07-06T21:57:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.912+0000 7fab9affd640 1 -- 172.21.15.55:0/2985203137 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab84003530 con 0x7fab9c0c9b90 2023-07-06T21:57:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9affd640 1 -- 172.21.15.55:0/2985203137 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3232176731 0 0) 0x7fab84003530 con 0x7fab9c0c9b90 2023-07-06T21:57:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9affd640 1 -- 172.21.15.55:0/2985203137 >> v2:172.21.15.138:3300/0 conn(0x7fab9c0ccb70 msgr2=0x7fab9c15dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9affd640 1 --2- 172.21.15.55:0/2985203137 >> v2:172.21.15.138:3300/0 conn(0x7fab9c0ccb70 0x7fab9c15dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9affd640 1 -- 172.21.15.55:0/2985203137 >> v1:172.21.15.138:6789/0 conn(0x7fab9c0693f0 legacy=0x7fab9c069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9affd640 1 -- 172.21.15.55:0/2985203137 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c0c8480 con 0x7fab9c0c9b90 2023-07-06T21:57:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9b7fe640 1 --2- 172.21.15.55:0/2985203137 >> v2:172.21.15.138:3300/0 conn(0x7fab9c0ccb70 0x7fab9c15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9affd640 1 -- 172.21.15.55:0/2985203137 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fab8c001810 con 0x7fab9c0c9b90 2023-07-06T21:57:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9affd640 1 -- 172.21.15.55:0/2985203137 >> v1:172.21.15.55:6789/0 conn(0x7fab9c0c9b90 legacy=0x7fab9c0c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9affd640 1 --2- 172.21.15.55:0/2985203137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab84003980 0x7fab84003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9affd640 1 --2- 172.21.15.55:0/2985203137 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab840047d0 0x7fab84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9affd640 1 --2- 172.21.15.55:0/2985203137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab84005180 0x7fab8400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:48.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9affd640 1 -- 172.21.15.55:0/2985203137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c0c9070 con 0x7fab84005180 2023-07-06T21:57:48.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9affd640 1 -- 172.21.15.55:0/2985203137 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8400c000 con 0x7fab84003980 2023-07-06T21:57:48.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9affd640 1 -- 172.21.15.55:0/2985203137 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8400c1c0 con 0x7fab840047d0 2023-07-06T21:57:48.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9bfff640 1 --2- 172.21.15.55:0/2985203137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab84003980 0x7fab84003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:48.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7faba0ba8640 1 --2- 172.21.15.55:0/2985203137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab84005180 0x7fab8400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:48.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7fab9b7fe640 1 --2- 172.21.15.55:0/2985203137 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab840047d0 0x7fab84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:48.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7faba0ba8640 1 -- 172.21.15.55:0/2985203137 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab840047d0 msgr2=0x7fab84004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:48.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7faba0ba8640 1 --2- 172.21.15.55:0/2985203137 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab840047d0 0x7fab84004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:48.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7faba0ba8640 1 -- 172.21.15.55:0/2985203137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab84003980 msgr2=0x7fab84003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:48.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7faba0ba8640 1 --2- 172.21.15.55:0/2985203137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab84003980 0x7fab84003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:48.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7faba0ba8640 1 -- 172.21.15.55:0/2985203137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84003530 con 0x7fab84005180 2023-07-06T21:57:48.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7faba0ba8640 1 -- 172.21.15.55:0/2985203137 reap_dead start 2023-07-06T21:57:48.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.916+0000 7faba0ba8640 1 --2- 172.21.15.55:0/2985203137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab84005180 0x7fab8400b990 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fab94001e70 tx=0x7fab9401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb9eb386f1fafde server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:48.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7fab9affd640 1 -- 172.21.15.55:0/2985203137 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94003b80 con 0x7fab84005180 2023-07-06T21:57:48.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7fab9affd640 1 -- 172.21.15.55:0/2985203137 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab94003d20 con 0x7fab84005180 2023-07-06T21:57:48.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7fab9affd640 1 -- 172.21.15.55:0/2985203137 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94005260 con 0x7fab84005180 2023-07-06T21:57:48.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 -- 172.21.15.55:0/2985203137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab84005180 msgr2=0x7fab8400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:48.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 --2- 172.21.15.55:0/2985203137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab84005180 0x7fab8400b990 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fab94001e70 tx=0x7fab9401c760 comp rx=0 tx=0).stop 2023-07-06T21:57:48.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 -- 172.21.15.55:0/2985203137 shutdown_connections 2023-07-06T21:57:48.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 --2- 172.21.15.55:0/2985203137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab84005180 0x7fab8400b990 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 -- 172.21.15.55:0/2985203137 >> 172.21.15.55:0/2985203137 conn(0x7fab9c0cde30 msgr2=0x7fab9c0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 -- 172.21.15.55:0/2985203137 shutdown_connections 2023-07-06T21:57:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 -- 172.21.15.55:0/2985203137 wait complete. 2023-07-06T21:57:48.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 Processor -- start 2023-07-06T21:57:48.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 -- start start 2023-07-06T21:57:48.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab84005180 0x7fab9c0ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:48.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab9c14e5e0 0x7fab9c0aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:48.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab9c0c5910 0x7fab9c0c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:48.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c0c7070 con 0x7fab84005180 2023-07-06T21:57:48.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c14f6c0 con 0x7fab9c0c5910 2023-07-06T21:57:48.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7faba260b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c0c62c0 con 0x7fab9c14e5e0 2023-07-06T21:57:48.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7fab9bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab84005180 0x7fab9c0ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:48.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7fab9bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab84005180 0x7fab9c0ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46694/0 (socket says 172.21.15.55:46694) 2023-07-06T21:57:48.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.920+0000 7fab9bfff640 1 -- 172.21.15.55:0/4045199810 learned_addr learned my addr 172.21.15.55:0/4045199810 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:48.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7fab9b7fe640 1 --2- 172.21.15.55:0/4045199810 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab9c14e5e0 0x7fab9c0aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:48.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7faba0ba8640 1 --2- 172.21.15.55:0/4045199810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab9c0c5910 0x7fab9c0c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:48.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7fab9bfff640 1 -- 172.21.15.55:0/4045199810 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab9c14e5e0 msgr2=0x7fab9c0aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:48.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7fab9bfff640 1 --2- 172.21.15.55:0/4045199810 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab9c14e5e0 0x7fab9c0aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:48.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7fab9bfff640 1 -- 172.21.15.55:0/4045199810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab9c0c5910 msgr2=0x7fab9c0c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:48.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7fab9bfff640 1 --2- 172.21.15.55:0/4045199810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab9c0c5910 0x7fab9c0c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:48.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7fab9bfff640 1 -- 172.21.15.55:0/4045199810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c15c2e0 con 0x7fab84005180 2023-07-06T21:57:48.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7fab9bfff640 1 --2- 172.21.15.55:0/4045199810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab84005180 0x7fab9c0ae770 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fab8c001030 tx=0x7fab8c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:48.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7fab98ff9640 1 -- 172.21.15.55:0/4045199810 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c007740 con 0x7fab84005180 2023-07-06T21:57:48.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7fab98ff9640 1 -- 172.21.15.55:0/4045199810 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c00f990 con 0x7fab84005180 2023-07-06T21:57:48.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7fab98ff9640 1 -- 172.21.15.55:0/4045199810 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c00fd40 con 0x7fab84005180 2023-07-06T21:57:48.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7faba260b640 1 -- 172.21.15.55:0/4045199810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9c0c64f0 con 0x7fab84005180 2023-07-06T21:57:48.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7faba260b640 1 -- 172.21.15.55:0/4045199810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9c0c6ab0 con 0x7fab84005180 2023-07-06T21:57:48.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7faba260b640 1 -- 172.21.15.55:0/4045199810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9c066d60 con 0x7fab84005180 2023-07-06T21:57:48.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.924+0000 7fab98ff9640 1 -- 172.21.15.55:0/4045199810 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fab8c01d460 con 0x7fab84005180 2023-07-06T21:57:48.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.928+0000 7fab98ff9640 1 --2- 172.21.15.55:0/4045199810 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fab880663d0 0x7fab88068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:48.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.928+0000 7fab98ff9640 1 -- 172.21.15.55:0/4045199810 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fab8c083f10 con 0x7fab84005180 2023-07-06T21:57:48.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.928+0000 7fab9b7fe640 1 --2- 172.21.15.55:0/4045199810 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fab880663d0 0x7fab88068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:48.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.928+0000 7fab9b7fe640 1 --2- 172.21.15.55:0/4045199810 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fab880663d0 0x7fab88068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0c4eb0 tx=0x7fab90009190 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:48.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:48.928+0000 7fab98ff9640 1 -- 172.21.15.55:0/4045199810 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab8c051060 con 0x7fab84005180 2023-07-06T21:57:49.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.084+0000 7faba260b640 1 -- 172.21.15.55:0/4045199810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fab9c0b3e70 con 0x7fab84005180 2023-07-06T21:57:49.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.736+0000 7fab98ff9640 1 -- 172.21.15.55:0/4045199810 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) v1 ==== 169+0+0 (secure 0 0 0) 0x7fab9c0b3e70 con 0x7fab84005180 2023-07-06T21:57:49.734 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-07-06T21:57:49.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.736+0000 7faba260b640 1 -- 172.21.15.55:0/4045199810 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fab880663d0 msgr2=0x7fab88068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:49.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.736+0000 7faba260b640 1 --2- 172.21.15.55:0/4045199810 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fab880663d0 0x7fab88068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0c4eb0 tx=0x7fab90009190 comp rx=0 tx=0).stop 2023-07-06T21:57:49.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.736+0000 7faba260b640 1 -- 172.21.15.55:0/4045199810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab84005180 msgr2=0x7fab9c0ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:49.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.736+0000 7faba260b640 1 --2- 172.21.15.55:0/4045199810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab84005180 0x7fab9c0ae770 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fab8c001030 tx=0x7fab8c0074f0 comp rx=0 tx=0).stop 2023-07-06T21:57:49.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.740+0000 7faba260b640 1 -- 172.21.15.55:0/4045199810 shutdown_connections 2023-07-06T21:57:49.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.740+0000 7faba260b640 1 --2- 172.21.15.55:0/4045199810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab9c0c5910 0x7fab9c0c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:49.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.740+0000 7faba260b640 1 --2- 172.21.15.55:0/4045199810 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fab880663d0 0x7fab88068880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:49.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.740+0000 7faba260b640 1 --2- 172.21.15.55:0/4045199810 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab9c14e5e0 0x7fab9c0aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:49.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.740+0000 7faba260b640 1 --2- 172.21.15.55:0/4045199810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab84005180 0x7fab9c0ae770 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:49.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.740+0000 7faba260b640 1 -- 172.21.15.55:0/4045199810 >> 172.21.15.55:0/4045199810 conn(0x7fab9c0cde30 msgr2=0x7fab9c14ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:49.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.740+0000 7faba260b640 1 -- 172.21.15.55:0/4045199810 shutdown_connections 2023-07-06T21:57:49.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.740+0000 7faba260b640 1 -- 172.21.15.55:0/4045199810 wait complete. 2023-07-06T21:57:49.762 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-06T21:57:49.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.912+0000 7f948b59e640 1 Processor -- start 2023-07-06T21:57:49.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.912+0000 7f948b59e640 1 -- start start 2023-07-06T21:57:49.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.912+0000 7f948b59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f948c0c8b60 0x7f948c0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:49.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.912+0000 7f948b59e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c06f910 con 0x7f948c06c380 2023-07-06T21:57:49.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.912+0000 7f948b59e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c06fb60 con 0x7f948c15bac0 2023-07-06T21:57:49.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.912+0000 7f948b59e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948c15be90 con 0x7f948c0c8b60 2023-07-06T21:57:49.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.912+0000 7f948ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f948c06c380 0x7f948c0cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43658/0 (socket says 172.21.15.55:43658) 2023-07-06T21:57:49.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.912+0000 7f948ad9d640 1 -- 172.21.15.55:0/668058687 learned_addr learned my addr 172.21.15.55:0/668058687 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:49.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.912+0000 7f9489d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f948c0c8b60 0x7f948c0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:49.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.912+0000 7f9489d9b640 1 -- 172.21.15.55:0/668058687 >> v1:172.21.15.138:6789/0 conn(0x7f948c15bac0 legacy=0x7f948c0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:49.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.912+0000 7f9489d9b640 1 -- 172.21.15.55:0/668058687 >> v1:172.21.15.55:6789/0 conn(0x7f948c06c380 legacy=0x7f948c0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:49.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.912+0000 7f948959a640 1 -- 172.21.15.55:0/668058687 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812425692 0 0) 0x7f948c06f910 con 0x7f948c06c380 2023-07-06T21:57:49.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.912+0000 7f9489d9b640 1 -- 172.21.15.55:0/668058687 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c06fe40 con 0x7f948c0c8b60 2023-07-06T21:57:49.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.916+0000 7f9489d9b640 1 --2- 172.21.15.55:0/668058687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948c0c8b60 0x7f948c0cb7c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f94800097c0 tx=0x7f948001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574cbd978134b470 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:49.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.916+0000 7f948959a640 1 -- 172.21.15.55:0/668058687 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800ab600 con 0x7f948c0c8b60 2023-07-06T21:57:49.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.916+0000 7f948959a640 1 -- 172.21.15.55:0/668058687 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94800a7050 con 0x7f948c0c8b60 2023-07-06T21:57:49.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.916+0000 7f948959a640 1 -- 172.21.15.55:0/668058687 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800ab980 con 0x7f948c0c8b60 2023-07-06T21:57:49.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.916+0000 7f948b59e640 1 -- 172.21.15.55:0/668058687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948c0c8b60 msgr2=0x7f948c0cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:49.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.916+0000 7f948b59e640 1 --2- 172.21.15.55:0/668058687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948c0c8b60 0x7f948c0cb7c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f94800097c0 tx=0x7f948001c360 comp rx=0 tx=0).stop 2023-07-06T21:57:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.916+0000 7f948b59e640 1 -- 172.21.15.55:0/668058687 shutdown_connections 2023-07-06T21:57:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.916+0000 7f948b59e640 1 --2- 172.21.15.55:0/668058687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948c0c8b60 0x7f948c0cb7c0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.916+0000 7f948b59e640 1 -- 172.21.15.55:0/668058687 >> 172.21.15.55:0/668058687 conn(0x7f948c0b0410 msgr2=0x7f948c0cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.916+0000 7f948b59e640 1 -- 172.21.15.55:0/668058687 shutdown_connections 2023-07-06T21:57:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.916+0000 7f948b59e640 1 -- 172.21.15.55:0/668058687 wait complete. 2023-07-06T21:57:49.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f948b59e640 1 Processor -- start 2023-07-06T21:57:49.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f948b59e640 1 -- start start 2023-07-06T21:57:49.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f948b59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f948c06c380 0x7f948c155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:49.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f948b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948c0c8b60 0x7f948c1f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:49.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f948b59e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f948c15bac0 0x7f948c0b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:49.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f948b59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0b0a80 con 0x7f948c0c8b60 2023-07-06T21:57:49.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f948b59e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0b0d60 con 0x7f948c15bac0 2023-07-06T21:57:49.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f948b59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0b1040 con 0x7f948c06c380 2023-07-06T21:57:49.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f9489d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948c0c8b60 0x7f948c1f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:49.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f9489d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948c0c8b60 0x7f948c1f3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46718/0 (socket says 172.21.15.55:46718) 2023-07-06T21:57:49.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f9489d9b640 1 -- 172.21.15.55:0/1841148007 learned_addr learned my addr 172.21.15.55:0/1841148007 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:49.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f948ad9d640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f948c15bac0 0x7f948c0b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:49.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f948a59c640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f948c06c380 0x7f948c155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:49.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f9489d9b640 1 -- 172.21.15.55:0/1841148007 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f948c06c380 msgr2=0x7f948c155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:49.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f9489d9b640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f948c06c380 0x7f948c155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:49.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f9489d9b640 1 -- 172.21.15.55:0/1841148007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f948c15bac0 msgr2=0x7f948c0b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:49.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f9489d9b640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f948c15bac0 0x7f948c0b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:49.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f9489d9b640 1 -- 172.21.15.55:0/1841148007 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9480009420 con 0x7f948c0c8b60 2023-07-06T21:57:49.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f948a59c640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f948c06c380 0x7f948c155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:49.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f9489d9b640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948c0c8b60 0x7f948c1f3f10 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f9480018f70 tx=0x7f9480019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:49.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f947affd640 1 -- 172.21.15.55:0/1841148007 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800b4610 con 0x7f948c0c8b60 2023-07-06T21:57:49.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f947affd640 1 -- 172.21.15.55:0/1841148007 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94800abe90 con 0x7f948c0c8b60 2023-07-06T21:57:49.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f947affd640 1 -- 172.21.15.55:0/1841148007 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800b49d0 con 0x7f948c0c8b60 2023-07-06T21:57:49.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f948b59e640 1 -- 172.21.15.55:0/1841148007 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c0b1320 con 0x7f948c0c8b60 2023-07-06T21:57:49.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f948b59e640 1 -- 172.21.15.55:0/1841148007 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c155fa0 con 0x7f948c0c8b60 2023-07-06T21:57:49.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.920+0000 7f948b59e640 1 -- 172.21.15.55:0/1841148007 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c04d790 con 0x7f948c0c8b60 2023-07-06T21:57:49.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.924+0000 7f947affd640 1 -- 172.21.15.55:0/1841148007 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f94800b2040 con 0x7f948c0c8b60 2023-07-06T21:57:49.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.924+0000 7f947affd640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f946c0663a0 0x7f946c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:49.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.924+0000 7f947affd640 1 -- 172.21.15.55:0/1841148007 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f948011e1f0 con 0x7f948c0c8b60 2023-07-06T21:57:49.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.924+0000 7f948a59c640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f946c0663a0 0x7f946c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:49.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.924+0000 7f948a59c640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f946c0663a0 0x7f946c068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f947c000f70 tx=0x7f947c009040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:49.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:49.928+0000 7f947affd640 1 -- 172.21.15.55:0/1841148007 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94800eb320 con 0x7f948c0c8b60 2023-07-06T21:57:50.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.088+0000 7f948b59e640 1 -- 172.21.15.55:0/1841148007 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f948c0b17d0 con 0x7f948c0c8b60 2023-07-06T21:57:50.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.096+0000 7f947affd640 1 -- 172.21.15.55:0/1841148007 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v25) v1 ==== 120+0+0 (secure 0 0 0) 0x7f94800ee940 con 0x7f948c0c8b60 2023-07-06T21:57:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.096+0000 7f948b59e640 1 -- 172.21.15.55:0/1841148007 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f946c0663a0 msgr2=0x7f946c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.096+0000 7f948b59e640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f946c0663a0 0x7f946c068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f947c000f70 tx=0x7f947c009040 comp rx=0 tx=0).stop 2023-07-06T21:57:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.096+0000 7f948b59e640 1 -- 172.21.15.55:0/1841148007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948c0c8b60 msgr2=0x7f948c1f3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.096+0000 7f948b59e640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948c0c8b60 0x7f948c1f3f10 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f9480018f70 tx=0x7f9480019100 comp rx=0 tx=0).stop 2023-07-06T21:57:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.096+0000 7f948b59e640 1 -- 172.21.15.55:0/1841148007 shutdown_connections 2023-07-06T21:57:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.096+0000 7f948b59e640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f948c15bac0 0x7f948c0b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.096+0000 7f948b59e640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948c0c8b60 0x7f948c1f3f10 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.096+0000 7f948b59e640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f946c0663a0 0x7f946c068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.096+0000 7f948b59e640 1 --2- 172.21.15.55:0/1841148007 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f948c06c380 0x7f948c155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.096+0000 7f948b59e640 1 -- 172.21.15.55:0/1841148007 >> 172.21.15.55:0/1841148007 conn(0x7f948c0b0410 msgr2=0x7f948c06a370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:50.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.096+0000 7f948b59e640 1 -- 172.21.15.55:0/1841148007 shutdown_connections 2023-07-06T21:57:50.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.096+0000 7f948b59e640 1 -- 172.21.15.55:0/1841148007 wait complete. 2023-07-06T21:57:50.116 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-06T21:57:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5ae1340640 1 Processor -- start 2023-07-06T21:57:50.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5ae1340640 1 -- start start 2023-07-06T21:57:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5ae1340640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5adc1597d0 0x7f5adc0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5ae1340640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5adc0cac10 0x7f5adc06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5ae1340640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc0cd490 con 0x7f5adc070530 2023-07-06T21:57:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5ae1340640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc0cb040 con 0x7f5adc0cac10 2023-07-06T21:57:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5ae1340640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc0709b0 con 0x7f5adc1597d0 2023-07-06T21:57:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5ad3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5adc0cac10 0x7f5adc06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5ad3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5adc0cac10 0x7f5adc06fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46720/0 (socket says 172.21.15.55:46720) 2023-07-06T21:57:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5ad3fff640 1 -- 172.21.15.55:0/441023668 learned_addr learned my addr 172.21.15.55:0/441023668 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5adaffd640 1 --2- 172.21.15.55:0/441023668 >> v2:172.21.15.138:3300/0 conn(0x7f5adc1597d0 0x7f5adc0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5ad3fff640 1 -- 172.21.15.55:0/441023668 >> v2:172.21.15.138:3300/0 conn(0x7f5adc1597d0 msgr2=0x7f5adc0ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5ad3fff640 1 --2- 172.21.15.55:0/441023668 >> v2:172.21.15.138:3300/0 conn(0x7f5adc1597d0 0x7f5adc0ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5ad3fff640 1 -- 172.21.15.55:0/441023668 >> v1:172.21.15.138:6789/0 conn(0x7f5adc070530 legacy=0x7f5adc0c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.264+0000 7f5ad3fff640 1 -- 172.21.15.55:0/441023668 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc15cf60 con 0x7f5adc0cac10 2023-07-06T21:57:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.268+0000 7f5ad3fff640 1 --2- 172.21.15.55:0/441023668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc0cac10 0x7f5adc06fff0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0cc680 tx=0x7f5ac401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f4699a96b14ec0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.268+0000 7f5ada7fc640 1 -- 172.21.15.55:0/441023668 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac40ad660 con 0x7f5adc0cac10 2023-07-06T21:57:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.268+0000 7f5ada7fc640 1 -- 172.21.15.55:0/441023668 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac40ad7c0 con 0x7f5adc0cac10 2023-07-06T21:57:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.268+0000 7f5ada7fc640 1 -- 172.21.15.55:0/441023668 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac40adb50 con 0x7f5adc0cac10 2023-07-06T21:57:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.268+0000 7f5ae1340640 1 -- 172.21.15.55:0/441023668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc0cac10 msgr2=0x7f5adc06fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.268+0000 7f5ae1340640 1 --2- 172.21.15.55:0/441023668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc0cac10 0x7f5adc06fff0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0cc680 tx=0x7f5ac401c440 comp rx=0 tx=0).stop 2023-07-06T21:57:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.268+0000 7f5ae1340640 1 -- 172.21.15.55:0/441023668 shutdown_connections 2023-07-06T21:57:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.268+0000 7f5ae1340640 1 --2- 172.21.15.55:0/441023668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc0cac10 0x7f5adc06fff0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.268+0000 7f5ae1340640 1 --2- 172.21.15.55:0/441023668 >> v2:172.21.15.138:3300/0 conn(0x7f5adc1597d0 0x7f5adc0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.268+0000 7f5ae1340640 1 -- 172.21.15.55:0/441023668 >> 172.21.15.55:0/441023668 conn(0x7f5adc0cb970 msgr2=0x7f5adc0cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:50.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.268+0000 7f5ae1340640 1 -- 172.21.15.55:0/441023668 shutdown_connections 2023-07-06T21:57:50.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.268+0000 7f5ae1340640 1 -- 172.21.15.55:0/441023668 wait complete. 2023-07-06T21:57:50.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.268+0000 7f5ae1340640 1 Processor -- start 2023-07-06T21:57:50.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5ae1340640 1 -- start start 2023-07-06T21:57:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5ae1340640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5adc070530 0x7f5adc14eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5ae1340640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5adc0cac10 0x7f5adc0b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5ae1340640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc1444f0 0x7f5adc0b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5ae1340640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0b3830 con 0x7f5adc1444f0 2023-07-06T21:57:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5ae1340640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc145d20 con 0x7f5adc0cac10 2023-07-06T21:57:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5ae1340640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc14c9b0 con 0x7f5adc070530 2023-07-06T21:57:50.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5adb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc1444f0 0x7f5adc0b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5adb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc1444f0 0x7f5adc0b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46730/0 (socket says 172.21.15.55:46730) 2023-07-06T21:57:50.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5adb7fe640 1 -- 172.21.15.55:0/2526086851 learned_addr learned my addr 172.21.15.55:0/2526086851 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:50.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5ad3fff640 1 --2- 172.21.15.55:0/2526086851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5adc0cac10 0x7f5adc0b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5adaffd640 1 --2- 172.21.15.55:0/2526086851 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5adc070530 0x7f5adc14eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5adb7fe640 1 -- 172.21.15.55:0/2526086851 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5adc070530 msgr2=0x7f5adc14eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5adb7fe640 1 --2- 172.21.15.55:0/2526086851 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5adc070530 0x7f5adc14eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5adb7fe640 1 -- 172.21.15.55:0/2526086851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5adc0cac10 msgr2=0x7f5adc0b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5adb7fe640 1 --2- 172.21.15.55:0/2526086851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5adc0cac10 0x7f5adc0b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5adb7fe640 1 -- 172.21.15.55:0/2526086851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40094d0 con 0x7f5adc1444f0 2023-07-06T21:57:50.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5adb7fe640 1 --2- 172.21.15.55:0/2526086851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc1444f0 0x7f5adc0b32f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400c760 tx=0x7f5ad400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:50.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5ad37fe640 1 -- 172.21.15.55:0/2526086851 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4003b80 con 0x7f5adc1444f0 2023-07-06T21:57:50.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5ad37fe640 1 -- 172.21.15.55:0/2526086851 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad4003ce0 con 0x7f5adc1444f0 2023-07-06T21:57:50.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5ad37fe640 1 -- 172.21.15.55:0/2526086851 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad400aa30 con 0x7f5adc1444f0 2023-07-06T21:57:50.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5ae1340640 1 -- 172.21.15.55:0/2526086851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc14d210 con 0x7f5adc1444f0 2023-07-06T21:57:50.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5ae1340640 1 -- 172.21.15.55:0/2526086851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc14cf30 con 0x7f5adc1444f0 2023-07-06T21:57:50.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.272+0000 7f5ae1340640 1 -- 172.21.15.55:0/2526086851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc066d60 con 0x7f5adc1444f0 2023-07-06T21:57:50.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.276+0000 7f5ad37fe640 1 -- 172.21.15.55:0/2526086851 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5ad400ab90 con 0x7f5adc1444f0 2023-07-06T21:57:50.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.276+0000 7f5ad37fe640 1 --2- 172.21.15.55:0/2526086851 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f5abc0663d0 0x7f5abc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.276+0000 7f5ad37fe640 1 -- 172.21.15.55:0/2526086851 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f5ad4083be0 con 0x7f5adc1444f0 2023-07-06T21:57:50.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.276+0000 7f5adaffd640 1 --2- 172.21.15.55:0/2526086851 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f5abc0663d0 0x7f5abc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.276+0000 7f5adaffd640 1 --2- 172.21.15.55:0/2526086851 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f5abc0663d0 0x7f5abc068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0b5060 tx=0x7f5acc008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:50.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.280+0000 7f5ad37fe640 1 -- 172.21.15.55:0/2526086851 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ad4050ed0 con 0x7f5adc1444f0 2023-07-06T21:57:50.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.436+0000 7f5ae1340640 1 -- 172.21.15.55:0/2526086851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5adc150aa0 con 0x7f5adc1444f0 2023-07-06T21:57:50.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.440+0000 7f5ad37fe640 1 -- 172.21.15.55:0/2526086851 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5ad40544f0 con 0x7f5adc1444f0 2023-07-06T21:57:50.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.444+0000 7f5ae1340640 1 -- 172.21.15.55:0/2526086851 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f5abc0663d0 msgr2=0x7f5abc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.444+0000 7f5ae1340640 1 --2- 172.21.15.55:0/2526086851 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f5abc0663d0 0x7f5abc068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0b5060 tx=0x7f5acc008040 comp rx=0 tx=0).stop 2023-07-06T21:57:50.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.444+0000 7f5ae1340640 1 -- 172.21.15.55:0/2526086851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc1444f0 msgr2=0x7f5adc0b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.444+0000 7f5ae1340640 1 --2- 172.21.15.55:0/2526086851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc1444f0 0x7f5adc0b32f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400c760 tx=0x7f5ad400cc20 comp rx=0 tx=0).stop 2023-07-06T21:57:50.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.444+0000 7f5ae1340640 1 -- 172.21.15.55:0/2526086851 shutdown_connections 2023-07-06T21:57:50.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.444+0000 7f5ae1340640 1 --2- 172.21.15.55:0/2526086851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc1444f0 0x7f5adc0b32f0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.444+0000 7f5ae1340640 1 --2- 172.21.15.55:0/2526086851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5adc0cac10 0x7f5adc0b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.444+0000 7f5ae1340640 1 --2- 172.21.15.55:0/2526086851 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f5abc0663d0 0x7f5abc068880 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.444+0000 7f5ae1340640 1 --2- 172.21.15.55:0/2526086851 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5adc070530 0x7f5adc14eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.444+0000 7f5ae1340640 1 -- 172.21.15.55:0/2526086851 >> 172.21.15.55:0/2526086851 conn(0x7f5adc0cb970 msgr2=0x7f5adc150390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:50.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.444+0000 7f5ae1340640 1 -- 172.21.15.55:0/2526086851 shutdown_connections 2023-07-06T21:57:50.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.444+0000 7f5ae1340640 1 -- 172.21.15.55:0/2526086851 wait complete. 2023-07-06T21:57:50.461 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-06T21:57:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa529619640 1 Processor -- start 2023-07-06T21:57:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa529619640 1 -- start start 2023-07-06T21:57:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa529619640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa52406f0e0 0x7fa5240ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa529619640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5240cc2f0 con 0x7fa5240cb7a0 2023-07-06T21:57:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa529619640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52415f5d0 con 0x7fa524156180 2023-07-06T21:57:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa529619640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa524160250 con 0x7fa52406f0e0 2023-07-06T21:57:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5237fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa5240cb7a0 0x7fa5240cbbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43662/0 (socket says 172.21.15.55:43662) 2023-07-06T21:57:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5237fe640 1 -- 172.21.15.55:0/2636438297 learned_addr learned my addr 172.21.15.55:0/2636438297 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa51bfff640 1 --2- 172.21.15.55:0/2636438297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa52406f0e0 0x7fa5240ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706894302 0 0) 0x7fa5240cc2f0 con 0x7fa5240cb7a0 2023-07-06T21:57:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa510003530 con 0x7fa5240cb7a0 2023-07-06T21:57:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886298966 0 0) 0x7fa52415f5d0 con 0x7fa524156180 2023-07-06T21:57:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5240cc2f0 con 0x7fa524156180 2023-07-06T21:57:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2578469504 0 0) 0x7fa510003530 con 0x7fa5240cb7a0 2023-07-06T21:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa52406f0e0 msgr2=0x7fa5240ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 --2- 172.21.15.55:0/2636438297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa52406f0e0 0x7fa5240ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 >> v1:172.21.15.138:6789/0 conn(0x7fa524156180 legacy=0x7fa52406e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52415f8b0 con 0x7fa5240cb7a0 2023-07-06T21:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fa51c001a00 con 0x7fa5240cb7a0 2023-07-06T21:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 >> v1:172.21.15.55:6789/0 conn(0x7fa5240cb7a0 legacy=0x7fa5240cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 --2- 172.21.15.55:0/2636438297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa52406f0e0 0x7fa510003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 --2- 172.21.15.55:0/2636438297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5100040f0 0x7fa5100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 --2- 172.21.15.55:0/2636438297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa510004d10 0x7fa510005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa524160250 con 0x7fa5100040f0 2023-07-06T21:57:50.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51000bb20 con 0x7fa510004d10 2023-07-06T21:57:50.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51000bce0 con 0x7fa52406f0e0 2023-07-06T21:57:50.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa51bfff640 1 --2- 172.21.15.55:0/2636438297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5100040f0 0x7fa5100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa5237fe640 1 --2- 172.21.15.55:0/2636438297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa510004d10 0x7fa510005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.608+0000 7fa522ffd640 1 --2- 172.21.15.55:0/2636438297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa52406f0e0 0x7fa510003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.612+0000 7fa51bfff640 1 -- 172.21.15.55:0/2636438297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa52406f0e0 msgr2=0x7fa510003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.612+0000 7fa51bfff640 1 --2- 172.21.15.55:0/2636438297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa52406f0e0 0x7fa510003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.612+0000 7fa51bfff640 1 -- 172.21.15.55:0/2636438297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa510004d10 msgr2=0x7fa510005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.612+0000 7fa51bfff640 1 --2- 172.21.15.55:0/2636438297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa510004d10 0x7fa510005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.612+0000 7fa51bfff640 1 -- 172.21.15.55:0/2636438297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa510003530 con 0x7fa5100040f0 2023-07-06T21:57:50.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.612+0000 7fa51bfff640 1 --2- 172.21.15.55:0/2636438297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5100040f0 0x7fa5100047d0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009ab0 tx=0x7fa50c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4e3e62368be8be server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:50.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.612+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0a55f0 con 0x7fa5100040f0 2023-07-06T21:57:50.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.612+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c0a5750 con 0x7fa5100040f0 2023-07-06T21:57:50.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.612+0000 7fa5227fc640 1 -- 172.21.15.55:0/2636438297 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0a5b00 con 0x7fa5100040f0 2023-07-06T21:57:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.612+0000 7fa529619640 1 -- 172.21.15.55:0/2636438297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5100040f0 msgr2=0x7fa5100047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.612+0000 7fa529619640 1 --2- 172.21.15.55:0/2636438297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5100040f0 0x7fa5100047d0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009ab0 tx=0x7fa50c01ca00 comp rx=0 tx=0).stop 2023-07-06T21:57:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.612+0000 7fa5237fe640 1 -- 172.21.15.55:0/2636438297 reap_dead start 2023-07-06T21:57:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.612+0000 7fa529619640 1 -- 172.21.15.55:0/2636438297 shutdown_connections 2023-07-06T21:57:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.612+0000 7fa529619640 1 -- 172.21.15.55:0/2636438297 >> 172.21.15.55:0/2636438297 conn(0x7fa5240d0c50 msgr2=0x7fa5240cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa529619640 1 -- 172.21.15.55:0/2636438297 shutdown_connections 2023-07-06T21:57:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa529619640 1 -- 172.21.15.55:0/2636438297 wait complete. 2023-07-06T21:57:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa529619640 1 Processor -- start 2023-07-06T21:57:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa529619640 1 -- start start 2023-07-06T21:57:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa529619640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5100040f0 0x7fa52414b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa529619640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa52414b040 0x7fa5240c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa529619640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa524157470 0x7fa52415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa529619640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52414c790 con 0x7fa524157470 2023-07-06T21:57:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa529619640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52414bb80 con 0x7fa5100040f0 2023-07-06T21:57:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa529619640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52414be60 con 0x7fa52414b040 2023-07-06T21:57:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa5237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa524157470 0x7fa52415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa5237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa524157470 0x7fa52415daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46746/0 (socket says 172.21.15.55:46746) 2023-07-06T21:57:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa5237fe640 1 -- 172.21.15.55:0/1685228855 learned_addr learned my addr 172.21.15.55:0/1685228855 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa51bfff640 1 --2- 172.21.15.55:0/1685228855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa52414b040 0x7fa5240c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa522ffd640 1 --2- 172.21.15.55:0/1685228855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5100040f0 0x7fa52414b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa5237fe640 1 -- 172.21.15.55:0/1685228855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa52414b040 msgr2=0x7fa5240c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa5237fe640 1 --2- 172.21.15.55:0/1685228855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa52414b040 0x7fa5240c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa5237fe640 1 -- 172.21.15.55:0/1685228855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5100040f0 msgr2=0x7fa52414b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa5237fe640 1 --2- 172.21.15.55:0/1685228855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5100040f0 0x7fa52414b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa5237fe640 1 -- 172.21.15.55:0/1685228855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52414c140 con 0x7fa524157470 2023-07-06T21:57:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa5237fe640 1 --2- 172.21.15.55:0/1685228855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa524157470 0x7fa52415daf0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fa5240b5700 tx=0x7fa51c007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa51b7fe640 1 -- 172.21.15.55:0/1685228855 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c007ae0 con 0x7fa524157470 2023-07-06T21:57:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa51b7fe640 1 -- 172.21.15.55:0/1685228855 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c013600 con 0x7fa524157470 2023-07-06T21:57:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.616+0000 7fa529619640 1 -- 172.21.15.55:0/1685228855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52414c420 con 0x7fa524157470 2023-07-06T21:57:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.620+0000 7fa51b7fe640 1 -- 172.21.15.55:0/1685228855 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0139d0 con 0x7fa524157470 2023-07-06T21:57:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.620+0000 7fa529619640 1 -- 172.21.15.55:0/1685228855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52415e030 con 0x7fa524157470 2023-07-06T21:57:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.620+0000 7fa529619640 1 -- 172.21.15.55:0/1685228855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52414c5b0 con 0x7fa524157470 2023-07-06T21:57:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.620+0000 7fa51b7fe640 1 -- 172.21.15.55:0/1685228855 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa51c013b30 con 0x7fa524157470 2023-07-06T21:57:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.620+0000 7fa51b7fe640 1 --2- 172.21.15.55:0/1685228855 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fa5040663d0 0x7fa504068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.620+0000 7fa51b7fe640 1 -- 172.21.15.55:0/1685228855 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6347+0+0 (secure 0 0 0) 0x7fa51c083f90 con 0x7fa524157470 2023-07-06T21:57:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.620+0000 7fa522ffd640 1 --2- 172.21.15.55:0/1685228855 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fa5040663d0 0x7fa504068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.620+0000 7fa522ffd640 1 --2- 172.21.15.55:0/1685228855 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fa5040663d0 0x7fa504068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa514007fd0 tx=0x7fa514009040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.624+0000 7fa51b7fe640 1 -- 172.21.15.55:0/1685228855 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa51c051280 con 0x7fa524157470 2023-07-06T21:57:50.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.784+0000 7fa529619640 1 -- 172.21.15.55:0/1685228855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fa524066d60 con 0x7fa524157470 2023-07-06T21:57:50.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.788+0000 7fa51b7fe640 1 -- 172.21.15.55:0/1685228855 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v27) v1 ==== 115+0+0 (secure 0 0 0) 0x7fa51c017070 con 0x7fa524157470 2023-07-06T21:57:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.788+0000 7fa529619640 1 -- 172.21.15.55:0/1685228855 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fa5040663d0 msgr2=0x7fa504068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.788+0000 7fa529619640 1 --2- 172.21.15.55:0/1685228855 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fa5040663d0 0x7fa504068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa514007fd0 tx=0x7fa514009040 comp rx=0 tx=0).stop 2023-07-06T21:57:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.788+0000 7fa529619640 1 -- 172.21.15.55:0/1685228855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa524157470 msgr2=0x7fa52415daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.788+0000 7fa529619640 1 --2- 172.21.15.55:0/1685228855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa524157470 0x7fa52415daf0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fa5240b5700 tx=0x7fa51c007730 comp rx=0 tx=0).stop 2023-07-06T21:57:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.788+0000 7fa529619640 1 -- 172.21.15.55:0/1685228855 shutdown_connections 2023-07-06T21:57:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.788+0000 7fa529619640 1 --2- 172.21.15.55:0/1685228855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa524157470 0x7fa52415daf0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.788+0000 7fa529619640 1 --2- 172.21.15.55:0/1685228855 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fa5040663d0 0x7fa504068880 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.788+0000 7fa529619640 1 --2- 172.21.15.55:0/1685228855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa52414b040 0x7fa5240c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.788+0000 7fa529619640 1 --2- 172.21.15.55:0/1685228855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5100040f0 0x7fa52414b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.788+0000 7fa529619640 1 -- 172.21.15.55:0/1685228855 >> 172.21.15.55:0/1685228855 conn(0x7fa5240d0c50 msgr2=0x7fa52415b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.792+0000 7fa529619640 1 -- 172.21.15.55:0/1685228855 shutdown_connections 2023-07-06T21:57:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.792+0000 7fa529619640 1 -- 172.21.15.55:0/1685228855 wait complete. 2023-07-06T21:57:50.808 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-07-06T21:57:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.956+0000 7f3cfca93640 1 Processor -- start 2023-07-06T21:57:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.956+0000 7f3cfca93640 1 -- start start 2023-07-06T21:57:50.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.956+0000 7f3cfca93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80712f0 0x7f3cf806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.956+0000 7f3cfca93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3cf80b3730 0x7f3cf80c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.956+0000 7f3cfca93640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf8159cd0 con 0x7f3cf80ca280 2023-07-06T21:57:50.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.956+0000 7f3cfca93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf80ca700 con 0x7f3cf80b3730 2023-07-06T21:57:50.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.956+0000 7f3cfca93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80693f0 con 0x7f3cf80712f0 2023-07-06T21:57:50.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.960+0000 7f3ceffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3cf80b3730 0x7f3cf80c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.960+0000 7f3ceffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3cf80b3730 0x7f3cf80c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46754/0 (socket says 172.21.15.55:46754) 2023-07-06T21:57:50.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.960+0000 7f3ceffff640 1 -- 172.21.15.55:0/2666072317 learned_addr learned my addr 172.21.15.55:0/2666072317 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:50.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.960+0000 7f3cf659c640 1 --2- 172.21.15.55:0/2666072317 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80712f0 0x7f3cf806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.960+0000 7f3ceffff640 1 -- 172.21.15.55:0/2666072317 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80712f0 msgr2=0x7f3cf806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:50.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.960+0000 7f3ceffff640 1 --2- 172.21.15.55:0/2666072317 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80712f0 0x7f3cf806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.960+0000 7f3ceffff640 1 -- 172.21.15.55:0/2666072317 >> v1:172.21.15.138:6789/0 conn(0x7f3cf80ca280 legacy=0x7f3cf80c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:50.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.960+0000 7f3ceffff640 1 -- 172.21.15.55:0/2666072317 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf806aca0 con 0x7f3cf80b3730 2023-07-06T21:57:50.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.960+0000 7f3ceffff640 1 --2- 172.21.15.55:0/2666072317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cf80b3730 0x7f3cf80c9d40 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009870 tx=0x7f3ce001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28ec8274db52854 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:50.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.960+0000 7f3cf5d9b640 1 -- 172.21.15.55:0/2666072317 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00ac410 con 0x7f3cf80b3730 2023-07-06T21:57:50.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.960+0000 7f3cf5d9b640 1 -- 172.21.15.55:0/2666072317 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce00ac570 con 0x7f3cf80b3730 2023-07-06T21:57:50.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.960+0000 7f3cf5d9b640 1 -- 172.21.15.55:0/2666072317 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00ac900 con 0x7f3cf80b3730 2023-07-06T21:57:50.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 -- 172.21.15.55:0/2666072317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cf80b3730 msgr2=0x7f3cf80c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 --2- 172.21.15.55:0/2666072317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cf80b3730 0x7f3cf80c9d40 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009870 tx=0x7f3ce001c4d0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 -- 172.21.15.55:0/2666072317 shutdown_connections 2023-07-06T21:57:50.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 --2- 172.21.15.55:0/2666072317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cf80b3730 0x7f3cf80c9d40 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 --2- 172.21.15.55:0/2666072317 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80712f0 0x7f3cf806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 -- 172.21.15.55:0/2666072317 >> 172.21.15.55:0/2666072317 conn(0x7f3cf80cded0 msgr2=0x7f3cf80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:50.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 -- 172.21.15.55:0/2666072317 shutdown_connections 2023-07-06T21:57:50.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 -- 172.21.15.55:0/2666072317 wait complete. 2023-07-06T21:57:50.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 Processor -- start 2023-07-06T21:57:50.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 -- start start 2023-07-06T21:57:50.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cf80712f0 0x7f3cf80c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80b3730 0x7f3cf80c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cf80ca280 0x7f3cf81f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80c47e0 con 0x7f3cf80ca280 2023-07-06T21:57:50.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80c1e60 con 0x7f3cf80712f0 2023-07-06T21:57:50.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cfca93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80c2140 con 0x7f3cf80b3730 2023-07-06T21:57:50.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cf6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cf80ca280 0x7f3cf81f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3ceffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80b3730 0x7f3cf80c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3cf659c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cf80712f0 0x7f3cf80c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3ceffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80b3730 0x7f3cf80c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:48462/0 (socket says 172.21.15.55:48462) 2023-07-06T21:57:50.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.964+0000 7f3ceffff640 1 -- 172.21.15.55:0/1606240319 learned_addr learned my addr 172.21.15.55:0/1606240319 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:50.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3cf6d9d640 1 -- 172.21.15.55:0/1606240319 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80b3730 msgr2=0x7f3cf80c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3cf6d9d640 1 --2- 172.21.15.55:0/1606240319 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80b3730 0x7f3cf80c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3cf6d9d640 1 -- 172.21.15.55:0/1606240319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cf80712f0 msgr2=0x7f3cf80c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:50.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3cf6d9d640 1 --2- 172.21.15.55:0/1606240319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cf80712f0 0x7f3cf80c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:50.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3cf6d9d640 1 -- 172.21.15.55:0/1606240319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce00094d0 con 0x7f3cf80ca280 2023-07-06T21:57:50.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3cf6d9d640 1 --2- 172.21.15.55:0/1606240319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cf80ca280 0x7f3cf81f7280 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000c780 tx=0x7f3cf000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:50.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3ceeffd640 1 -- 172.21.15.55:0/1606240319 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf000aa50 con 0x7f3cf80ca280 2023-07-06T21:57:50.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3ceeffd640 1 -- 172.21.15.55:0/1606240319 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf000abb0 con 0x7f3cf80ca280 2023-07-06T21:57:50.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3cfca93640 1 -- 172.21.15.55:0/1606240319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf80c2420 con 0x7f3cf80ca280 2023-07-06T21:57:50.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3ceeffd640 1 -- 172.21.15.55:0/1606240319 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf000ce30 con 0x7f3cf80ca280 2023-07-06T21:57:50.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3cfca93640 1 -- 172.21.15.55:0/1606240319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf80c29e0 con 0x7f3cf80ca280 2023-07-06T21:57:50.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3cfca93640 1 -- 172.21.15.55:0/1606240319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf8066d60 con 0x7f3cf80ca280 2023-07-06T21:57:50.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3ceeffd640 1 -- 172.21.15.55:0/1606240319 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3cf0012420 con 0x7f3cf80ca280 2023-07-06T21:57:50.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3ceeffd640 1 --2- 172.21.15.55:0/1606240319 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3cd80663a0 0x7f3cd8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:50.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.968+0000 7f3ceeffd640 1 -- 172.21.15.55:0/1606240319 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f3cf0083f60 con 0x7f3cf80ca280 2023-07-06T21:57:50.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.972+0000 7f3cf659c640 1 --2- 172.21.15.55:0/1606240319 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3cd80663a0 0x7f3cd8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:50.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.972+0000 7f3cf659c640 1 --2- 172.21.15.55:0/1606240319 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3cd80663a0 0x7f3cd8068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80079c0 tx=0x7f3ce8008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:50.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:50.972+0000 7f3ceeffd640 1 -- 172.21.15.55:0/1606240319 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3cf0051250 con 0x7f3cf80ca280 2023-07-06T21:57:51.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.184+0000 7f3cfca93640 1 -- 172.21.15.55:0/1606240319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f3cf80c7fe0 con 0x7f3cf80ca280 2023-07-06T21:57:51.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.756+0000 7f3ceeffd640 1 -- 172.21.15.55:0/1606240319 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v589) v1 ==== 156+0+0 (secure 0 0 0) 0x7f3cf0016020 con 0x7f3cf80ca280 2023-07-06T21:57:51.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.760+0000 7f3cfca93640 1 -- 172.21.15.55:0/1606240319 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3cd80663a0 msgr2=0x7f3cd8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:51.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.760+0000 7f3cfca93640 1 --2- 172.21.15.55:0/1606240319 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3cd80663a0 0x7f3cd8068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80079c0 tx=0x7f3ce8008040 comp rx=0 tx=0).stop 2023-07-06T21:57:51.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.760+0000 7f3cfca93640 1 -- 172.21.15.55:0/1606240319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cf80ca280 msgr2=0x7f3cf81f7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:51.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.760+0000 7f3cfca93640 1 --2- 172.21.15.55:0/1606240319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cf80ca280 0x7f3cf81f7280 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000c780 tx=0x7f3cf000cc40 comp rx=0 tx=0).stop 2023-07-06T21:57:51.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.760+0000 7f3cfca93640 1 -- 172.21.15.55:0/1606240319 shutdown_connections 2023-07-06T21:57:51.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.760+0000 7f3cfca93640 1 --2- 172.21.15.55:0/1606240319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cf80ca280 0x7f3cf81f7280 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:51.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.760+0000 7f3cfca93640 1 --2- 172.21.15.55:0/1606240319 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3cd80663a0 0x7f3cd8068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:51.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.760+0000 7f3cfca93640 1 --2- 172.21.15.55:0/1606240319 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80b3730 0x7f3cf80c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:51.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.760+0000 7f3cfca93640 1 --2- 172.21.15.55:0/1606240319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cf80712f0 0x7f3cf80c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:51.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.760+0000 7f3cfca93640 1 -- 172.21.15.55:0/1606240319 >> 172.21.15.55:0/1606240319 conn(0x7f3cf80cded0 msgr2=0x7f3cf80b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:51.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.760+0000 7f3cfca93640 1 -- 172.21.15.55:0/1606240319 shutdown_connections 2023-07-06T21:57:51.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.760+0000 7f3cfca93640 1 -- 172.21.15.55:0/1606240319 wait complete. 2023-07-06T21:57:51.779 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-07-06T21:57:51.779 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-07-06T21:57:51.780 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-06T21:57:51.780 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-07-06T21:57:51.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.928+0000 7ff9e27db640 1 Processor -- start 2023-07-06T21:57:51.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.928+0000 7ff9e27db640 1 -- start start 2023-07-06T21:57:51.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.928+0000 7ff9e27db640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff9dc158400 0x7ff9dc0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:51.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.928+0000 7ff9e27db640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9dc0c9680 0x7ff9dc070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:51.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.928+0000 7ff9e27db640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9dc06fae0 con 0x7ff9dc0710c0 2023-07-06T21:57:51.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.928+0000 7ff9e27db640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9dc06fdc0 con 0x7ff9dc0c9680 2023-07-06T21:57:51.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.928+0000 7ff9e27db640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9dc0700a0 con 0x7ff9dc158400 2023-07-06T21:57:51.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.928+0000 7ff9e0d78640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff9dc0710c0 0x7ff9dc0cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43670/0 (socket says 172.21.15.55:43670) 2023-07-06T21:57:51.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.928+0000 7ff9db7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9dc0c9680 0x7ff9dc070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:51.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.928+0000 7ff9e0d78640 1 -- 172.21.15.55:0/2347674462 learned_addr learned my addr 172.21.15.55:0/2347674462 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:51.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.928+0000 7ff9dbfff640 1 --2- 172.21.15.55:0/2347674462 >> v2:172.21.15.138:3300/0 conn(0x7ff9dc158400 0x7ff9dc0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:51.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9db7fe640 1 -- 172.21.15.55:0/2347674462 >> v2:172.21.15.138:3300/0 conn(0x7ff9dc158400 msgr2=0x7ff9dc0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:51.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9db7fe640 1 --2- 172.21.15.55:0/2347674462 >> v2:172.21.15.138:3300/0 conn(0x7ff9dc158400 0x7ff9dc0c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:51.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9db7fe640 1 -- 172.21.15.55:0/2347674462 >> v1:172.21.15.55:6789/0 conn(0x7ff9dc0710c0 legacy=0x7ff9dc0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:51.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9db7fe640 1 -- 172.21.15.55:0/2347674462 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc070380 con 0x7ff9dc0c9680 2023-07-06T21:57:51.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9daffd640 1 -- 172.21.15.55:0/2347674462 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414032634 0 0) 0x7ff9dc06fae0 con 0x7ff9dc0710c0 2023-07-06T21:57:51.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9db7fe640 1 --2- 172.21.15.55:0/2347674462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0c9680 0x7ff9dc070b80 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc06ed50 tx=0x7ff9d001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2148c1705a04dfd0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:51.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9daffd640 1 -- 172.21.15.55:0/2347674462 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00ac620 con 0x7ff9dc0c9680 2023-07-06T21:57:51.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9daffd640 1 -- 172.21.15.55:0/2347674462 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d00ac780 con 0x7ff9dc0c9680 2023-07-06T21:57:51.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9daffd640 1 -- 172.21.15.55:0/2347674462 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00acb10 con 0x7ff9dc0c9680 2023-07-06T21:57:51.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9e27db640 1 -- 172.21.15.55:0/2347674462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0c9680 msgr2=0x7ff9dc070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:51.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9e27db640 1 --2- 172.21.15.55:0/2347674462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0c9680 0x7ff9dc070b80 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc06ed50 tx=0x7ff9d001c3a0 comp rx=0 tx=0).stop 2023-07-06T21:57:51.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9e27db640 1 -- 172.21.15.55:0/2347674462 shutdown_connections 2023-07-06T21:57:51.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9e27db640 1 --2- 172.21.15.55:0/2347674462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0c9680 0x7ff9dc070b80 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:51.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9e27db640 1 --2- 172.21.15.55:0/2347674462 >> v2:172.21.15.138:3300/0 conn(0x7ff9dc158400 0x7ff9dc0c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:51.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.932+0000 7ff9e27db640 1 -- 172.21.15.55:0/2347674462 >> 172.21.15.55:0/2347674462 conn(0x7ff9dc0cded0 msgr2=0x7ff9dc0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:51.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9e27db640 1 -- 172.21.15.55:0/2347674462 shutdown_connections 2023-07-06T21:57:51.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9e27db640 1 -- 172.21.15.55:0/2347674462 wait complete. 2023-07-06T21:57:51.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9e27db640 1 Processor -- start 2023-07-06T21:57:51.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9e27db640 1 -- start start 2023-07-06T21:57:51.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9e27db640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9dc0710c0 0x7ff9dc164ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:51.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9e27db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0c9680 0x7ff9dc164880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:51.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9e27db640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9dc158400 0x7ff9dc0c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:51.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9e27db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc157ce0 con 0x7ff9dc0c9680 2023-07-06T21:57:51.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9e27db640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc166560 con 0x7ff9dc0710c0 2023-07-06T21:57:51.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9e27db640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc1654c0 con 0x7ff9dc158400 2023-07-06T21:57:51.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9db7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0c9680 0x7ff9dc164880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:51.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9db7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0c9680 0x7ff9dc164880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46784/0 (socket says 172.21.15.55:46784) 2023-07-06T21:57:51.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9db7fe640 1 -- 172.21.15.55:0/4202416663 learned_addr learned my addr 172.21.15.55:0/4202416663 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:51.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9db7fe640 1 -- 172.21.15.55:0/4202416663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9dc158400 msgr2=0x7ff9dc0c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:51.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9db7fe640 1 --2- 172.21.15.55:0/4202416663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9dc158400 0x7ff9dc0c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:51.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9db7fe640 1 -- 172.21.15.55:0/4202416663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9dc0710c0 msgr2=0x7ff9dc164ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:51.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9db7fe640 1 --2- 172.21.15.55:0/4202416663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9dc0710c0 0x7ff9dc164ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:51.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9db7fe640 1 -- 172.21.15.55:0/4202416663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d0009420 con 0x7ff9dc0c9680 2023-07-06T21:57:51.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.936+0000 7ff9db7fe640 1 --2- 172.21.15.55:0/4202416663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0c9680 0x7ff9dc164880 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00af040 tx=0x7ff9d0019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:51.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.940+0000 7ff9d8ff9640 1 -- 172.21.15.55:0/4202416663 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00b5410 con 0x7ff9dc0c9680 2023-07-06T21:57:51.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.940+0000 7ff9d8ff9640 1 -- 172.21.15.55:0/4202416663 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d00b5570 con 0x7ff9dc0c9680 2023-07-06T21:57:51.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.940+0000 7ff9d8ff9640 1 -- 172.21.15.55:0/4202416663 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00b5920 con 0x7ff9dc0c9680 2023-07-06T21:57:51.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.940+0000 7ff9e27db640 1 -- 172.21.15.55:0/4202416663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9dc1657a0 con 0x7ff9dc0c9680 2023-07-06T21:57:51.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.940+0000 7ff9e27db640 1 -- 172.21.15.55:0/4202416663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9dc165d60 con 0x7ff9dc0c9680 2023-07-06T21:57:51.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.940+0000 7ff9e27db640 1 -- 172.21.15.55:0/4202416663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9dc06c580 con 0x7ff9dc0c9680 2023-07-06T21:57:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.940+0000 7ff9d8ff9640 1 -- 172.21.15.55:0/4202416663 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff9d00b3040 con 0x7ff9dc0c9680 2023-07-06T21:57:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.940+0000 7ff9d8ff9640 1 --2- 172.21.15.55:0/4202416663 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff9c80663a0 0x7ff9c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.940+0000 7ff9d8ff9640 1 -- 172.21.15.55:0/4202416663 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6347+0+0 (secure 0 0 0) 0x7ff9d011e290 con 0x7ff9dc0c9680 2023-07-06T21:57:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.940+0000 7ff9dbfff640 1 --2- 172.21.15.55:0/4202416663 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff9c80663a0 0x7ff9c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.940+0000 7ff9dbfff640 1 --2- 172.21.15.55:0/4202416663 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff9c80663a0 0x7ff9c8068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00b850 tx=0x7ff9cc008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:51.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:51.944+0000 7ff9d8ff9640 1 -- 172.21.15.55:0/4202416663 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff9d00eb3c0 con 0x7ff9dc0c9680 2023-07-06T21:57:52.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.152+0000 7ff9e27db640 1 -- 172.21.15.55:0/4202416663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7ff9dc0b1ea0 con 0x7ff9dc0c9680 2023-07-06T21:57:52.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.756+0000 7ff9d8ff9640 1 -- 172.21.15.55:0/4202416663 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v590) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff9d00ee9e0 con 0x7ff9dc0c9680 2023-07-06T21:57:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.760+0000 7ff9e27db640 1 -- 172.21.15.55:0/4202416663 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff9c80663a0 msgr2=0x7ff9c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.760+0000 7ff9e27db640 1 --2- 172.21.15.55:0/4202416663 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff9c80663a0 0x7ff9c8068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00b850 tx=0x7ff9cc008040 comp rx=0 tx=0).stop 2023-07-06T21:57:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.760+0000 7ff9e27db640 1 -- 172.21.15.55:0/4202416663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0c9680 msgr2=0x7ff9dc164880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.760+0000 7ff9e27db640 1 --2- 172.21.15.55:0/4202416663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0c9680 0x7ff9dc164880 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00af040 tx=0x7ff9d0019140 comp rx=0 tx=0).stop 2023-07-06T21:57:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.760+0000 7ff9e27db640 1 -- 172.21.15.55:0/4202416663 shutdown_connections 2023-07-06T21:57:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.760+0000 7ff9e27db640 1 --2- 172.21.15.55:0/4202416663 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff9c80663a0 0x7ff9c8068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.760+0000 7ff9e27db640 1 --2- 172.21.15.55:0/4202416663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9dc158400 0x7ff9dc0c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.760+0000 7ff9e27db640 1 --2- 172.21.15.55:0/4202416663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0c9680 0x7ff9dc164880 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.760+0000 7ff9e27db640 1 --2- 172.21.15.55:0/4202416663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9dc0710c0 0x7ff9dc164ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.760+0000 7ff9e27db640 1 -- 172.21.15.55:0/4202416663 >> 172.21.15.55:0/4202416663 conn(0x7ff9dc0cded0 msgr2=0x7ff9dc0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:52.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.760+0000 7ff9e27db640 1 -- 172.21.15.55:0/4202416663 shutdown_connections 2023-07-06T21:57:52.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.760+0000 7ff9e27db640 1 -- 172.21.15.55:0/4202416663 wait complete. 2023-07-06T21:57:52.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:52.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e188d7640 1 Processor -- start 2023-07-06T21:57:52.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e188d7640 1 -- start start 2023-07-06T21:57:52.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e188d7640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8e14157e20 0x7f8e1406bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:52.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e188d7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e141581f0 0x7f8e1406ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:52.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e188d7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e140c8d60 con 0x7f8e140cd620 2023-07-06T21:57:52.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e188d7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e140c84c0 con 0x7f8e141581f0 2023-07-06T21:57:52.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e188d7640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e140c87a0 con 0x7f8e14157e20 2023-07-06T21:57:52.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e1359e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8e140cd620 0x7f8e14069c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43682/0 (socket says 172.21.15.55:43682) 2023-07-06T21:57:52.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e1359e640 1 -- 172.21.15.55:0/1263334412 learned_addr learned my addr 172.21.15.55:0/1263334412 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:52.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e0bfff640 1 --2- 172.21.15.55:0/1263334412 >> v2:172.21.15.55:3300/0 conn(0x7f8e141581f0 0x7f8e1406ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:52.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e12d9d640 1 --2- 172.21.15.55:0/1263334412 >> v2:172.21.15.138:3300/0 conn(0x7f8e14157e20 0x7f8e1406bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:52.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e1259c640 1 -- 172.21.15.55:0/1263334412 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3213102473 0 0) 0x7f8e140c8d60 con 0x7f8e140cd620 2023-07-06T21:57:52.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e0bfff640 1 -- 172.21.15.55:0/1263334412 >> v2:172.21.15.138:3300/0 conn(0x7f8e14157e20 msgr2=0x7f8e1406bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:52.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e0bfff640 1 --2- 172.21.15.55:0/1263334412 >> v2:172.21.15.138:3300/0 conn(0x7f8e14157e20 0x7f8e1406bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:52.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e0bfff640 1 -- 172.21.15.55:0/1263334412 >> v1:172.21.15.55:6789/0 conn(0x7f8e140cd620 legacy=0x7f8e14069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:52.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.932+0000 7f8e0bfff640 1 -- 172.21.15.55:0/1263334412 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e140c8a80 con 0x7f8e141581f0 2023-07-06T21:57:52.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.936+0000 7f8e0bfff640 1 --2- 172.21.15.55:0/1263334412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e141581f0 0x7f8e1406ee90 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8e140ceb00 tx=0x7f8dfc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692342576f25a7e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:52.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.936+0000 7f8e1259c640 1 -- 172.21.15.55:0/1263334412 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0ad660 con 0x7f8e141581f0 2023-07-06T21:57:52.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.936+0000 7f8e1259c640 1 -- 172.21.15.55:0/1263334412 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc0ad7c0 con 0x7f8e141581f0 2023-07-06T21:57:52.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.936+0000 7f8e1259c640 1 -- 172.21.15.55:0/1263334412 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0adb50 con 0x7f8e141581f0 2023-07-06T21:57:52.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.936+0000 7f8e188d7640 1 -- 172.21.15.55:0/1263334412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e141581f0 msgr2=0x7f8e1406ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:52.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.936+0000 7f8e188d7640 1 --2- 172.21.15.55:0/1263334412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e141581f0 0x7f8e1406ee90 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8e140ceb00 tx=0x7f8dfc01c3a0 comp rx=0 tx=0).stop 2023-07-06T21:57:52.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.936+0000 7f8e188d7640 1 -- 172.21.15.55:0/1263334412 shutdown_connections 2023-07-06T21:57:52.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.936+0000 7f8e188d7640 1 --2- 172.21.15.55:0/1263334412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e141581f0 0x7f8e1406ee90 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:52.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.936+0000 7f8e188d7640 1 --2- 172.21.15.55:0/1263334412 >> v2:172.21.15.138:3300/0 conn(0x7f8e14157e20 0x7f8e1406bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:52.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.936+0000 7f8e188d7640 1 -- 172.21.15.55:0/1263334412 >> 172.21.15.55:0/1263334412 conn(0x7f8e140cdcd0 msgr2=0x7f8e140ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:52.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.936+0000 7f8e188d7640 1 -- 172.21.15.55:0/1263334412 shutdown_connections 2023-07-06T21:57:52.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.936+0000 7f8e188d7640 1 -- 172.21.15.55:0/1263334412 wait complete. 2023-07-06T21:57:52.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.936+0000 7f8e188d7640 1 Processor -- start 2023-07-06T21:57:52.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e188d7640 1 -- start start 2023-07-06T21:57:52.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e188d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e140cd620 0x7f8e1414eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:52.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e188d7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e14157e20 0x7f8e140c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:52.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e188d7640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e141581f0 0x7f8e140c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:52.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e188d7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140c3d90 con 0x7f8e140cd620 2023-07-06T21:57:52.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e188d7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140b0b80 con 0x7f8e14157e20 2023-07-06T21:57:52.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e188d7640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140b0dd0 con 0x7f8e141581f0 2023-07-06T21:57:52.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e12d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e140cd620 0x7f8e1414eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:52.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e12d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e140cd620 0x7f8e1414eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46808/0 (socket says 172.21.15.55:46808) 2023-07-06T21:57:52.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e12d9d640 1 -- 172.21.15.55:0/1902028244 learned_addr learned my addr 172.21.15.55:0/1902028244 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:52.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e0bfff640 1 --2- 172.21.15.55:0/1902028244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e14157e20 0x7f8e140c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:52.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e1359e640 1 --2- 172.21.15.55:0/1902028244 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e141581f0 0x7f8e140c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:52.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e12d9d640 1 -- 172.21.15.55:0/1902028244 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e141581f0 msgr2=0x7f8e140c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:52.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e12d9d640 1 --2- 172.21.15.55:0/1902028244 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e141581f0 0x7f8e140c3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:52.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e12d9d640 1 -- 172.21.15.55:0/1902028244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e14157e20 msgr2=0x7f8e140c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:52.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e12d9d640 1 --2- 172.21.15.55:0/1902028244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e14157e20 0x7f8e140c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:52.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e12d9d640 1 -- 172.21.15.55:0/1902028244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc009420 con 0x7f8e140cd620 2023-07-06T21:57:52.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e12d9d640 1 --2- 172.21.15.55:0/1902028244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e140cd620 0x7f8e1414eed0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400d830 tx=0x7f8e0400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:52.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e0b7fe640 1 -- 172.21.15.55:0/1902028244 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400b6c0 con 0x7f8e140cd620 2023-07-06T21:57:52.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e0b7fe640 1 -- 172.21.15.55:0/1902028244 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0400b820 con 0x7f8e140cd620 2023-07-06T21:57:52.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e0b7fe640 1 -- 172.21.15.55:0/1902028244 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400bb90 con 0x7f8e140cd620 2023-07-06T21:57:52.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e188d7640 1 -- 172.21.15.55:0/1902028244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e140b10b0 con 0x7f8e140cd620 2023-07-06T21:57:52.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e188d7640 1 -- 172.21.15.55:0/1902028244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e140b1670 con 0x7f8e140cd620 2023-07-06T21:57:52.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.940+0000 7f8e188d7640 1 -- 172.21.15.55:0/1902028244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1404d790 con 0x7f8e140cd620 2023-07-06T21:57:52.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.944+0000 7f8e0b7fe640 1 -- 172.21.15.55:0/1902028244 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8e0401e460 con 0x7f8e140cd620 2023-07-06T21:57:52.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.944+0000 7f8e0b7fe640 1 --2- 172.21.15.55:0/1902028244 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f8df40663a0 0x7f8df4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:52.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.944+0000 7f8e0b7fe640 1 -- 172.21.15.55:0/1902028244 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f8e04084790 con 0x7f8e140cd620 2023-07-06T21:57:52.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.944+0000 7f8e0bfff640 1 --2- 172.21.15.55:0/1902028244 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f8df40663a0 0x7f8df4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:52.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.944+0000 7f8e0bfff640 1 --2- 172.21.15.55:0/1902028244 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f8df40663a0 0x7f8df4068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0af000 tx=0x7f8dfc008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:52.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:52.948+0000 7f8e0b7fe640 1 -- 172.21.15.55:0/1902028244 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e04051940 con 0x7f8e140cd620 2023-07-06T21:57:53.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.104+0000 7f8e188d7640 1 -- 172.21.15.55:0/1902028244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e140cb210 con 0x7f8e140cd620 2023-07-06T21:57:53.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.104+0000 7f8e0b7fe640 1 -- 172.21.15.55:0/1902028244 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16025 (secure 0 0 0) 0x7f8e04054f60 con 0x7f8e140cd620 2023-07-06T21:57:53.102 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:53.102 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":94,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:57:49.730476+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3154142571":"2023-07-07T21:57:46.559359+0000","172.21.15.55:6835/3154142571":"2023-07-07T21:57:46.559359+0000","172.21.15.55:0/3832295075":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/2958882201":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/3615728228":"2023-07-07T21:57:43.676340+0000","172.21.15.55:6833/1694297670":"2023-07-07T21:57:43.676340+0000","172.21.15.55:6832/1694297670":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/5393205":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/2896474133":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/1802623894":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/1987324425":"2023-07-07T21:57:43.676340+0000","172.21.15.55:0/1073362678":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1848976334":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1541327786":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1765249513":"2023-07-07T21:57:37.612097+0000","172.21.15.55:6833/3540074910":"2023-07-07T21:57:37.612097+0000","172.21.15.55:6832/3540074910":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1768372577":"2023-07-07T21:57:37.612097+0000","172.21.15.55:0/1203793928":"2023-07-07T21:57:37.612097+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:53.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.104+0000 7f8e188d7640 1 -- 172.21.15.55:0/1902028244 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f8df40663a0 msgr2=0x7f8df4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.104+0000 7f8e188d7640 1 --2- 172.21.15.55:0/1902028244 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f8df40663a0 0x7f8df4068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0af000 tx=0x7f8dfc008040 comp rx=0 tx=0).stop 2023-07-06T21:57:53.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.104+0000 7f8e188d7640 1 -- 172.21.15.55:0/1902028244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e140cd620 msgr2=0x7f8e1414eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.104+0000 7f8e188d7640 1 --2- 172.21.15.55:0/1902028244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e140cd620 0x7f8e1414eed0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400d830 tx=0x7f8e0400dcf0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.104+0000 7f8e188d7640 1 -- 172.21.15.55:0/1902028244 shutdown_connections 2023-07-06T21:57:53.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.104+0000 7f8e188d7640 1 --2- 172.21.15.55:0/1902028244 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f8df40663a0 0x7f8df4068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.104+0000 7f8e188d7640 1 --2- 172.21.15.55:0/1902028244 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e141581f0 0x7f8e140c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.104+0000 7f8e188d7640 1 --2- 172.21.15.55:0/1902028244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e14157e20 0x7f8e140c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.104+0000 7f8e188d7640 1 --2- 172.21.15.55:0/1902028244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e140cd620 0x7f8e1414eed0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.104+0000 7f8e188d7640 1 -- 172.21.15.55:0/1902028244 >> 172.21.15.55:0/1902028244 conn(0x7f8e140cdcd0 msgr2=0x7f8e14069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:53.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.104+0000 7f8e188d7640 1 -- 172.21.15.55:0/1902028244 shutdown_connections 2023-07-06T21:57:53.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.104+0000 7f8e188d7640 1 -- 172.21.15.55:0/1902028244 wait complete. 2023-07-06T21:57:53.123 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:57:53.124 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:57:53.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.272+0000 7faee19c5640 1 Processor -- start 2023-07-06T21:57:53.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.272+0000 7faee19c5640 1 -- start start 2023-07-06T21:57:53.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.272+0000 7faee19c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faedc0ca130 0x7faedc0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.272+0000 7faee19c5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faedc0c8db0 con 0x7faedc158850 2023-07-06T21:57:53.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.272+0000 7faee19c5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faedc0c9090 con 0x7faedc0cd140 2023-07-06T21:57:53.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.272+0000 7faee19c5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faedc158ce0 con 0x7faedc0ca130 2023-07-06T21:57:53.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.272+0000 7faedaffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faedc158850 0x7faedc0cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58834/0 (socket says 172.21.15.55:58834) 2023-07-06T21:57:53.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.272+0000 7faedaffd640 1 -- 172.21.15.55:0/1611868251 learned_addr learned my addr 172.21.15.55:0/1611868251 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:53.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.272+0000 7faeda7fc640 1 --2- 172.21.15.55:0/1611868251 >> v2:172.21.15.55:3300/0 conn(0x7faedc0ca130 0x7faedc0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.272+0000 7faed9ffb640 1 -- 172.21.15.55:0/1611868251 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908316869 0 0) 0x7faedc0c8db0 con 0x7faedc158850 2023-07-06T21:57:53.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.272+0000 7faed9ffb640 1 -- 172.21.15.55:0/1611868251 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec4005740 con 0x7faedc158850 2023-07-06T21:57:53.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.272+0000 7faeda7fc640 1 -- 172.21.15.55:0/1611868251 >> v1:172.21.15.138:6789/0 conn(0x7faedc0cd140 legacy=0x7faedc0b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:53.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.272+0000 7faeda7fc640 1 -- 172.21.15.55:0/1611868251 >> v1:172.21.15.55:6789/0 conn(0x7faedc158850 legacy=0x7faedc0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.272+0000 7faeda7fc640 1 -- 172.21.15.55:0/1611868251 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc0c9370 con 0x7faedc0ca130 2023-07-06T21:57:53.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.276+0000 7faeda7fc640 1 --2- 172.21.15.55:0/1611868251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faedc0ca130 0x7faedc0703e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7faed00097c0 tx=0x7faed001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d56d3014914ddcf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:53.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.276+0000 7faed9ffb640 1 -- 172.21.15.55:0/1611868251 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed00ab610 con 0x7faedc0ca130 2023-07-06T21:57:53.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.276+0000 7faed9ffb640 1 -- 172.21.15.55:0/1611868251 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed00ab770 con 0x7faedc0ca130 2023-07-06T21:57:53.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.276+0000 7faed9ffb640 1 -- 172.21.15.55:0/1611868251 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed00abae0 con 0x7faedc0ca130 2023-07-06T21:57:53.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.276+0000 7faee19c5640 1 -- 172.21.15.55:0/1611868251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faedc0ca130 msgr2=0x7faedc0703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.276+0000 7faee19c5640 1 --2- 172.21.15.55:0/1611868251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faedc0ca130 0x7faedc0703e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7faed00097c0 tx=0x7faed001c410 comp rx=0 tx=0).stop 2023-07-06T21:57:53.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.276+0000 7faee19c5640 1 -- 172.21.15.55:0/1611868251 shutdown_connections 2023-07-06T21:57:53.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.276+0000 7faee19c5640 1 --2- 172.21.15.55:0/1611868251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faedc0ca130 0x7faedc0703e0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.276+0000 7faee19c5640 1 -- 172.21.15.55:0/1611868251 >> 172.21.15.55:0/1611868251 conn(0x7faedc0cea70 msgr2=0x7faedc0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:53.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.276+0000 7faee19c5640 1 -- 172.21.15.55:0/1611868251 shutdown_connections 2023-07-06T21:57:53.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.276+0000 7faee19c5640 1 -- 172.21.15.55:0/1611868251 wait complete. 2023-07-06T21:57:53.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.276+0000 7faee19c5640 1 Processor -- start 2023-07-06T21:57:53.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faee19c5640 1 -- start start 2023-07-06T21:57:53.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faee19c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faedc0ca130 0x7faedc0c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faee19c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faedc0cd140 0x7faedc0c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faee19c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faedc158850 0x7faedc0c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faee19c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0c5830 con 0x7faedc0ca130 2023-07-06T21:57:53.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faee19c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0c40f0 con 0x7faedc0cd140 2023-07-06T21:57:53.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faee19c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0c5a80 con 0x7faedc158850 2023-07-06T21:57:53.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faedaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faedc0ca130 0x7faedc0c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faedaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faedc0ca130 0x7faedc0c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51122/0 (socket says 172.21.15.55:51122) 2023-07-06T21:57:53.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faedaffd640 1 -- 172.21.15.55:0/3434186618 learned_addr learned my addr 172.21.15.55:0/3434186618 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:53.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faeda7fc640 1 --2- 172.21.15.55:0/3434186618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faedc0cd140 0x7faedc0c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faedb7fe640 1 --2- 172.21.15.55:0/3434186618 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faedc158850 0x7faedc0c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faedaffd640 1 -- 172.21.15.55:0/3434186618 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faedc158850 msgr2=0x7faedc0c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faedaffd640 1 --2- 172.21.15.55:0/3434186618 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faedc158850 0x7faedc0c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faedaffd640 1 -- 172.21.15.55:0/3434186618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faedc0cd140 msgr2=0x7faedc0c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faedaffd640 1 --2- 172.21.15.55:0/3434186618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faedc0cd140 0x7faedc0c3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faedaffd640 1 -- 172.21.15.55:0/3434186618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0009420 con 0x7faedc0ca130 2023-07-06T21:57:53.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faedaffd640 1 --2- 172.21.15.55:0/3434186618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faedc0ca130 0x7faedc0c50d0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7faecc00c3c0 tx=0x7faecc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:53.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faec3fff640 1 -- 172.21.15.55:0/3434186618 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc005cf0 con 0x7faedc0ca130 2023-07-06T21:57:53.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faec3fff640 1 -- 172.21.15.55:0/3434186618 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc005e50 con 0x7faedc0ca130 2023-07-06T21:57:53.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faec3fff640 1 -- 172.21.15.55:0/3434186618 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc0072f0 con 0x7faedc0ca130 2023-07-06T21:57:53.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faee19c5640 1 -- 172.21.15.55:0/3434186618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc0c5d60 con 0x7faedc0ca130 2023-07-06T21:57:53.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faee19c5640 1 -- 172.21.15.55:0/3434186618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc0c6040 con 0x7faedc0ca130 2023-07-06T21:57:53.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.280+0000 7faee19c5640 1 -- 172.21.15.55:0/3434186618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faedc066d60 con 0x7faedc0ca130 2023-07-06T21:57:53.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.284+0000 7faec3fff640 1 -- 172.21.15.55:0/3434186618 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faecc007450 con 0x7faedc0ca130 2023-07-06T21:57:53.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.284+0000 7faec3fff640 1 --2- 172.21.15.55:0/3434186618 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7faec80663a0 0x7faec8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.284+0000 7faec3fff640 1 -- 172.21.15.55:0/3434186618 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6347+0+0 (secure 0 0 0) 0x7faecc083580 con 0x7faedc0ca130 2023-07-06T21:57:53.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.284+0000 7faeda7fc640 1 --2- 172.21.15.55:0/3434186618 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7faec80663a0 0x7faec8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.284+0000 7faeda7fc640 1 --2- 172.21.15.55:0/3434186618 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7faec80663a0 0x7faec8068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faed00af000 tx=0x7faed00a7000 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:53.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.288+0000 7faec3fff640 1 -- 172.21.15.55:0/3434186618 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faecc0507e0 con 0x7faedc0ca130 2023-07-06T21:57:53.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.440+0000 7faee19c5640 1 -- 172.21.15.55:0/3434186618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faedc152910 con 0x7faedc0ca130 2023-07-06T21:57:53.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.440+0000 7faec3fff640 1 -- 172.21.15.55:0/3434186618 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7faecc053e00 con 0x7faedc0ca130 2023-07-06T21:57:53.439 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:57:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.444+0000 7faee19c5640 1 -- 172.21.15.55:0/3434186618 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7faec80663a0 msgr2=0x7faec8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.444+0000 7faee19c5640 1 --2- 172.21.15.55:0/3434186618 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7faec80663a0 0x7faec8068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faed00af000 tx=0x7faed00a7000 comp rx=0 tx=0).stop 2023-07-06T21:57:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.444+0000 7faee19c5640 1 -- 172.21.15.55:0/3434186618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faedc0ca130 msgr2=0x7faedc0c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.444+0000 7faee19c5640 1 --2- 172.21.15.55:0/3434186618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faedc0ca130 0x7faedc0c50d0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7faecc00c3c0 tx=0x7faecc00c880 comp rx=0 tx=0).stop 2023-07-06T21:57:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.444+0000 7faee19c5640 1 -- 172.21.15.55:0/3434186618 shutdown_connections 2023-07-06T21:57:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.444+0000 7faee19c5640 1 --2- 172.21.15.55:0/3434186618 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7faec80663a0 0x7faec8068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.444+0000 7faee19c5640 1 --2- 172.21.15.55:0/3434186618 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faedc158850 0x7faedc0c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.444+0000 7faee19c5640 1 --2- 172.21.15.55:0/3434186618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faedc0cd140 0x7faedc0c3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.444+0000 7faee19c5640 1 --2- 172.21.15.55:0/3434186618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faedc0ca130 0x7faedc0c50d0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.444+0000 7faee19c5640 1 -- 172.21.15.55:0/3434186618 >> 172.21.15.55:0/3434186618 conn(0x7faedc0cea70 msgr2=0x7faedc0ad770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.444+0000 7faee19c5640 1 -- 172.21.15.55:0/3434186618 shutdown_connections 2023-07-06T21:57:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.444+0000 7faee19c5640 1 -- 172.21.15.55:0/3434186618 wait complete. 2023-07-06T21:57:53.460 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:57:53.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d58303640 1 Processor -- start 2023-07-06T21:57:53.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d58303640 1 -- start start 2023-07-06T21:57:53.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d58303640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6d500709a0 0x7f6d500cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d58303640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d500b1340 0x7f6d5006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d58303640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d500cc300 con 0x7f6d500cbe60 2023-07-06T21:57:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d58303640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d500cc5e0 con 0x7f6d500709a0 2023-07-06T21:57:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d58303640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500cc8c0 con 0x7f6d500b1340 2023-07-06T21:57:53.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d5609f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6d500709a0 0x7f6d500cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d568a0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d500b1340 0x7f6d5006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d5609f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6d500709a0 0x7f6d500cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:53776/0 (socket says 172.21.15.55:53776) 2023-07-06T21:57:53.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d5609f640 1 -- 172.21.15.55:0/3706600335 learned_addr learned my addr 172.21.15.55:0/3706600335 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:53.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d5609f640 1 -- 172.21.15.55:0/3706600335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d500b1340 msgr2=0x7f6d5006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:53.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d5609f640 1 --2- 172.21.15.55:0/3706600335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d500b1340 0x7f6d5006eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d5609f640 1 -- 172.21.15.55:0/3706600335 >> v1:172.21.15.138:6789/0 conn(0x7f6d500cbe60 legacy=0x7f6d500b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.608+0000 7f6d5609f640 1 -- 172.21.15.55:0/3706600335 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d500ccba0 con 0x7f6d500709a0 2023-07-06T21:57:53.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.612+0000 7f6d5609f640 1 --2- 172.21.15.55:0/3706600335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500709a0 0x7f6d500cb920 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009870 tx=0x7f6d4c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e16c0c91f3adcfeb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:53.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.612+0000 7f6d5509d640 1 -- 172.21.15.55:0/3706600335 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c0ab650 con 0x7f6d500709a0 2023-07-06T21:57:53.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.612+0000 7f6d5509d640 1 -- 172.21.15.55:0/3706600335 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c0ab7b0 con 0x7f6d500709a0 2023-07-06T21:57:53.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.612+0000 7f6d5509d640 1 -- 172.21.15.55:0/3706600335 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c0abb40 con 0x7f6d500709a0 2023-07-06T21:57:53.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.612+0000 7f6d58303640 1 -- 172.21.15.55:0/3706600335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500709a0 msgr2=0x7f6d500cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.612+0000 7f6d58303640 1 --2- 172.21.15.55:0/3706600335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500709a0 0x7f6d500cb920 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009870 tx=0x7f6d4c01c540 comp rx=0 tx=0).stop 2023-07-06T21:57:53.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.612+0000 7f6d58303640 1 -- 172.21.15.55:0/3706600335 shutdown_connections 2023-07-06T21:57:53.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.612+0000 7f6d58303640 1 --2- 172.21.15.55:0/3706600335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d500b1340 0x7f6d5006eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.612+0000 7f6d58303640 1 --2- 172.21.15.55:0/3706600335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500709a0 0x7f6d500cb920 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.612+0000 7f6d58303640 1 -- 172.21.15.55:0/3706600335 >> 172.21.15.55:0/3706600335 conn(0x7f6d500cea70 msgr2=0x7f6d500ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:53.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.612+0000 7f6d58303640 1 -- 172.21.15.55:0/3706600335 shutdown_connections 2023-07-06T21:57:53.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.612+0000 7f6d58303640 1 -- 172.21.15.55:0/3706600335 wait complete. 2023-07-06T21:57:53.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d58303640 1 Processor -- start 2023-07-06T21:57:53.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d58303640 1 -- start start 2023-07-06T21:57:53.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d58303640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500709a0 0x7f6d5015faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d58303640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d500b1340 0x7f6d50156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d58303640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d500cbe60 0x7f6d5015d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d58303640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5015cb70 con 0x7f6d500cbe60 2023-07-06T21:57:53.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d58303640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50158990 con 0x7f6d500709a0 2023-07-06T21:57:53.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d58303640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5015cd80 con 0x7f6d500b1340 2023-07-06T21:57:53.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d568a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d500cbe60 0x7f6d5015d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d568a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d500cbe60 0x7f6d5015d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51126/0 (socket says 172.21.15.55:51126) 2023-07-06T21:57:53.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d568a0640 1 -- 172.21.15.55:0/89793311 learned_addr learned my addr 172.21.15.55:0/89793311 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:53.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d5609f640 1 --2- 172.21.15.55:0/89793311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500709a0 0x7f6d5015faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d5589e640 1 --2- 172.21.15.55:0/89793311 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d500b1340 0x7f6d50156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d568a0640 1 -- 172.21.15.55:0/89793311 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d500b1340 msgr2=0x7f6d50156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d568a0640 1 --2- 172.21.15.55:0/89793311 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d500b1340 0x7f6d50156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d568a0640 1 -- 172.21.15.55:0/89793311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500709a0 msgr2=0x7f6d5015faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d568a0640 1 --2- 172.21.15.55:0/89793311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500709a0 0x7f6d5015faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d568a0640 1 -- 172.21.15.55:0/89793311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c0094d0 con 0x7f6d500cbe60 2023-07-06T21:57:53.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d568a0640 1 --2- 172.21.15.55:0/89793311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d500cbe60 0x7f6d5015d2f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800efc0 tx=0x7f6d4800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:53.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d46ffd640 1 -- 172.21.15.55:0/89793311 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48014480 con 0x7f6d500cbe60 2023-07-06T21:57:53.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d46ffd640 1 -- 172.21.15.55:0/89793311 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4800f040 con 0x7f6d500cbe60 2023-07-06T21:57:53.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d46ffd640 1 -- 172.21.15.55:0/89793311 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48014820 con 0x7f6d500cbe60 2023-07-06T21:57:53.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d58303640 1 -- 172.21.15.55:0/89793311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5015e070 con 0x7f6d500cbe60 2023-07-06T21:57:53.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.616+0000 7f6d58303640 1 -- 172.21.15.55:0/89793311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5015e590 con 0x7f6d500cbe60 2023-07-06T21:57:53.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.620+0000 7f6d58303640 1 -- 172.21.15.55:0/89793311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d50066d60 con 0x7f6d500cbe60 2023-07-06T21:57:53.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.620+0000 7f6d46ffd640 1 -- 172.21.15.55:0/89793311 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6d48014980 con 0x7f6d500cbe60 2023-07-06T21:57:53.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.620+0000 7f6d46ffd640 1 --2- 172.21.15.55:0/89793311 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6d340663a0 0x7f6d34068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.620+0000 7f6d46ffd640 1 -- 172.21.15.55:0/89793311 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f6d48084e80 con 0x7f6d500cbe60 2023-07-06T21:57:53.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.620+0000 7f6d5609f640 1 --2- 172.21.15.55:0/89793311 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6d340663a0 0x7f6d34068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.620+0000 7f6d5609f640 1 --2- 172.21.15.55:0/89793311 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6d340663a0 0x7f6d34068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c0af000 tx=0x7f6d4c0b6040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:53.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.624+0000 7f6d46ffd640 1 -- 172.21.15.55:0/89793311 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6d48051fd0 con 0x7f6d500cbe60 2023-07-06T21:57:53.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.784+0000 7f6d58303640 1 -- 172.21.15.55:0/89793311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6d5015e260 con 0x7f6d500cbe60 2023-07-06T21:57:53.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.788+0000 7f6d46ffd640 1 -- 172.21.15.55:0/89793311 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v94) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6d480180a0 con 0x7f6d500cbe60 2023-07-06T21:57:53.785 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:57:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.788+0000 7f6d58303640 1 -- 172.21.15.55:0/89793311 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6d340663a0 msgr2=0x7f6d34068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.788+0000 7f6d58303640 1 --2- 172.21.15.55:0/89793311 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6d340663a0 0x7f6d34068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c0af000 tx=0x7f6d4c0b6040 comp rx=0 tx=0).stop 2023-07-06T21:57:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.788+0000 7f6d58303640 1 -- 172.21.15.55:0/89793311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d500cbe60 msgr2=0x7f6d5015d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.788+0000 7f6d58303640 1 --2- 172.21.15.55:0/89793311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d500cbe60 0x7f6d5015d2f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800efc0 tx=0x7f6d4800c490 comp rx=0 tx=0).stop 2023-07-06T21:57:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.788+0000 7f6d58303640 1 -- 172.21.15.55:0/89793311 shutdown_connections 2023-07-06T21:57:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.788+0000 7f6d58303640 1 --2- 172.21.15.55:0/89793311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d500cbe60 0x7f6d5015d2f0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.788+0000 7f6d58303640 1 --2- 172.21.15.55:0/89793311 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6d340663a0 0x7f6d34068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.788+0000 7f6d58303640 1 --2- 172.21.15.55:0/89793311 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6d500b1340 0x7f6d50156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.788+0000 7f6d58303640 1 --2- 172.21.15.55:0/89793311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d500709a0 0x7f6d5015faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.788+0000 7f6d58303640 1 -- 172.21.15.55:0/89793311 >> 172.21.15.55:0/89793311 conn(0x7f6d500cea70 msgr2=0x7f6d500b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.788+0000 7f6d58303640 1 -- 172.21.15.55:0/89793311 shutdown_connections 2023-07-06T21:57:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.788+0000 7f6d58303640 1 -- 172.21.15.55:0/89793311 wait complete. 2023-07-06T21:57:53.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-06T21:57:53.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.952+0000 7f1d59c9c640 1 Processor -- start 2023-07-06T21:57:53.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.952+0000 7f1d59c9c640 1 -- start start 2023-07-06T21:57:53.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.952+0000 7f1d59c9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d5415bb90 0x7f1d540ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.952+0000 7f1d59c9c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5415fe80 con 0x7f1d540cef40 2023-07-06T21:57:53.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.952+0000 7f1d59c9c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5415bf60 con 0x7f1d54070020 2023-07-06T21:57:53.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.952+0000 7f1d59c9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5415f620 con 0x7f1d5415bb90 2023-07-06T21:57:53.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.956+0000 7f1d52ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1d540cef40 0x7f1d5406f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58850/0 (socket says 172.21.15.55:58850) 2023-07-06T21:57:53.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.956+0000 7f1d52ffd640 1 -- 172.21.15.55:0/1030779738 learned_addr learned my addr 172.21.15.55:0/1030779738 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:53.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.956+0000 7f1d537fe640 1 --2- 172.21.15.55:0/1030779738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d5415bb90 0x7f1d540ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.956+0000 7f1d527fc640 1 -- 172.21.15.55:0/1030779738 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454308430 0 0) 0x7f1d5415fe80 con 0x7f1d540cef40 2023-07-06T21:57:53.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.956+0000 7f1d527fc640 1 -- 172.21.15.55:0/1030779738 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d3c003530 con 0x7f1d540cef40 2023-07-06T21:57:53.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.956+0000 7f1d527fc640 1 -- 172.21.15.55:0/1030779738 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083542150 0 0) 0x7f1d5415bf60 con 0x7f1d54070020 2023-07-06T21:57:53.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.956+0000 7f1d527fc640 1 -- 172.21.15.55:0/1030779738 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d5415fe80 con 0x7f1d54070020 2023-07-06T21:57:53.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.956+0000 7f1d537fe640 1 -- 172.21.15.55:0/1030779738 >> v1:172.21.15.138:6789/0 conn(0x7f1d54070020 legacy=0x7f1d540c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.956+0000 7f1d527fc640 1 -- 172.21.15.55:0/1030779738 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 184705005 0 0) 0x7f1d3c003530 con 0x7f1d540cef40 2023-07-06T21:57:53.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.956+0000 7f1d537fe640 1 -- 172.21.15.55:0/1030779738 >> v1:172.21.15.55:6789/0 conn(0x7f1d540cef40 legacy=0x7f1d5406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.956+0000 7f1d537fe640 1 -- 172.21.15.55:0/1030779738 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d540cf440 con 0x7f1d5415bb90 2023-07-06T21:57:53.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d537fe640 1 --2- 172.21.15.55:0/1030779738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d5415bb90 0x7f1d540ce030 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1d440097f0 tx=0x7f1d4401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae8b951ee1aab831 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:53.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d527fc640 1 -- 172.21.15.55:0/1030779738 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48001680 con 0x7f1d5415bb90 2023-07-06T21:57:53.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d527fc640 1 -- 172.21.15.55:0/1030779738 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d440a7050 con 0x7f1d5415bb90 2023-07-06T21:57:53.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d527fc640 1 -- 172.21.15.55:0/1030779738 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d440ab400 con 0x7f1d5415bb90 2023-07-06T21:57:53.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1030779738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d5415bb90 msgr2=0x7f1d540ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 --2- 172.21.15.55:0/1030779738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d5415bb90 0x7f1d540ce030 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1d440097f0 tx=0x7f1d4401c3e0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1030779738 shutdown_connections 2023-07-06T21:57:53.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 --2- 172.21.15.55:0/1030779738 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d5415bb90 0x7f1d540ce030 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1030779738 >> 172.21.15.55:0/1030779738 conn(0x7f1d540cbd70 msgr2=0x7f1d540ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:53.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1030779738 shutdown_connections 2023-07-06T21:57:53.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1030779738 wait complete. 2023-07-06T21:57:53.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 Processor -- start 2023-07-06T21:57:53.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 -- start start 2023-07-06T21:57:53.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d54070020 0x7f1d540c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d540cef40 0x7f1d540ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d5415bb90 0x7f1d540abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d54157e30 con 0x7f1d540cef40 2023-07-06T21:57:53.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540c4830 con 0x7f1d5415bb90 2023-07-06T21:57:53.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.960+0000 7f1d59c9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540c4b10 con 0x7f1d54070020 2023-07-06T21:57:53.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d52ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d540cef40 0x7f1d540ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d52ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d540cef40 0x7f1d540ab870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51140/0 (socket says 172.21.15.55:51140) 2023-07-06T21:57:53.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d52ffd640 1 -- 172.21.15.55:0/1143301605 learned_addr learned my addr 172.21.15.55:0/1143301605 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:53.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d537fe640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d54070020 0x7f1d540c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d53fff640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d5415bb90 0x7f1d540abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d52ffd640 1 -- 172.21.15.55:0/1143301605 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d54070020 msgr2=0x7f1d540c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d52ffd640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d54070020 0x7f1d540c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d52ffd640 1 -- 172.21.15.55:0/1143301605 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d5415bb90 msgr2=0x7f1d540abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:53.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d52ffd640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d5415bb90 0x7f1d540abdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:53.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d52ffd640 1 -- 172.21.15.55:0/1143301605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d44009420 con 0x7f1d540cef40 2023-07-06T21:57:53.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d537fe640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d54070020 0x7f1d540c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:53.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d52ffd640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d540cef40 0x7f1d540ab870 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800c750 tx=0x7f1d4800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:53.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d3bfff640 1 -- 172.21.15.55:0/1143301605 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48005af0 con 0x7f1d540cef40 2023-07-06T21:57:53.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d3bfff640 1 -- 172.21.15.55:0/1143301605 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d48005c50 con 0x7f1d540cef40 2023-07-06T21:57:53.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d3bfff640 1 -- 172.21.15.55:0/1143301605 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48007070 con 0x7f1d540cef40 2023-07-06T21:57:53.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1143301605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d540c4df0 con 0x7f1d540cef40 2023-07-06T21:57:53.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1143301605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d540c43a0 con 0x7f1d540cef40 2023-07-06T21:57:53.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1143301605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d54066d60 con 0x7f1d540cef40 2023-07-06T21:57:53.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d3bfff640 1 -- 172.21.15.55:0/1143301605 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1d480071d0 con 0x7f1d540cef40 2023-07-06T21:57:53.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.964+0000 7f1d3bfff640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f1d400663d0 0x7f1d40068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:53.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.968+0000 7f1d3bfff640 1 -- 172.21.15.55:0/1143301605 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f1d48083d40 con 0x7f1d540cef40 2023-07-06T21:57:53.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.968+0000 7f1d537fe640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f1d400663d0 0x7f1d40068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:53.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.968+0000 7f1d537fe640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f1d400663d0 0x7f1d40068880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1d440ad000 tx=0x7f1d440a6000 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:53.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:53.972+0000 7f1d3bfff640 1 -- 172.21.15.55:0/1143301605 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d48050f00 con 0x7f1d540cef40 2023-07-06T21:57:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.124+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1143301605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1d541582a0 con 0x7f1d540cef40 2023-07-06T21:57:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.128+0000 7f1d3bfff640 1 -- 172.21.15.55:0/1143301605 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1d48054520 con 0x7f1d540cef40 2023-07-06T21:57:54.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.132+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1143301605 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f1d400663d0 msgr2=0x7f1d40068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:54.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.132+0000 7f1d59c9c640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f1d400663d0 0x7f1d40068880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1d440ad000 tx=0x7f1d440a6000 comp rx=0 tx=0).stop 2023-07-06T21:57:54.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.132+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1143301605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d540cef40 msgr2=0x7f1d540ab870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:54.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.132+0000 7f1d59c9c640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d540cef40 0x7f1d540ab870 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800c750 tx=0x7f1d4800cc10 comp rx=0 tx=0).stop 2023-07-06T21:57:54.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.132+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1143301605 shutdown_connections 2023-07-06T21:57:54.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.132+0000 7f1d59c9c640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d5415bb90 0x7f1d540abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.132+0000 7f1d59c9c640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d540cef40 0x7f1d540ab870 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.132+0000 7f1d59c9c640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f1d400663d0 0x7f1d40068880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.132+0000 7f1d59c9c640 1 --2- 172.21.15.55:0/1143301605 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d54070020 0x7f1d540c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.132+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1143301605 >> 172.21.15.55:0/1143301605 conn(0x7f1d540cbd70 msgr2=0x7f1d540ad070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:54.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.132+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1143301605 shutdown_connections 2023-07-06T21:57:54.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.132+0000 7f1d59c9c640 1 -- 172.21.15.55:0/1143301605 wait complete. 2023-07-06T21:57:54.150 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T21:57:54.150 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:57:54.199 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:57:54.272 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T21:57:54.272 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:57:54.273 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:54.281 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T21:57:54.282 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:57:54.282 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:54.291 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:57:54.292 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:57:54.292 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:54.332 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T21:57:54.332 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:57:54.332 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:57:54.344 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:57:54.344 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-06T21:57:54.345 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:57:54.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a7a737640 1 Processor -- start 2023-07-06T21:57:54.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a7a737640 1 -- start start 2023-07-06T21:57:54.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a7a737640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3a740ca450 0x7f3a7406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:54.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a7a737640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3a740b3730 0x7f3a7415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:54.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a7a737640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a74159cd0 con 0x7f3a740712f0 2023-07-06T21:57:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a7a737640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a740693f0 con 0x7f3a740ca450 2023-07-06T21:57:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a7a737640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7406aca0 con 0x7f3a740b3730 2023-07-06T21:57:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a73fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3a740712f0 0x7f3a740c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58866/0 (socket says 172.21.15.55:58866) 2023-07-06T21:57:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a73fff640 1 -- 172.21.15.55:0/3111686820 learned_addr learned my addr 172.21.15.55:0/3111686820 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a737fe640 1 --2- 172.21.15.55:0/3111686820 >> v2:172.21.15.55:3300/0 conn(0x7f3a740ca450 0x7f3a7406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a78cd4640 1 --2- 172.21.15.55:0/3111686820 >> v2:172.21.15.138:3300/0 conn(0x7f3a740b3730 0x7f3a7415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a72ffd640 1 -- 172.21.15.55:0/3111686820 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026567378 0 0) 0x7f3a74159cd0 con 0x7f3a740712f0 2023-07-06T21:57:54.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a72ffd640 1 -- 172.21.15.55:0/3111686820 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a5c003530 con 0x7f3a740712f0 2023-07-06T21:57:54.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a737fe640 1 -- 172.21.15.55:0/3111686820 >> v2:172.21.15.138:3300/0 conn(0x7f3a740b3730 msgr2=0x7f3a7415d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:54.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a737fe640 1 --2- 172.21.15.55:0/3111686820 >> v2:172.21.15.138:3300/0 conn(0x7f3a740b3730 0x7f3a7415d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a737fe640 1 -- 172.21.15.55:0/3111686820 >> v1:172.21.15.55:6789/0 conn(0x7f3a740712f0 legacy=0x7f3a740c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:54.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.516+0000 7f3a737fe640 1 -- 172.21.15.55:0/3111686820 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a740696b0 con 0x7f3a740ca450 2023-07-06T21:57:54.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.520+0000 7f3a737fe640 1 --2- 172.21.15.55:0/3111686820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a740ca450 0x7f3a7406a610 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f3a740c9cd0 tx=0x7f3a6801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a615df7333ad27cb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:54.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.520+0000 7f3a72ffd640 1 -- 172.21.15.55:0/3111686820 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a680a7070 con 0x7f3a740ca450 2023-07-06T21:57:54.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.520+0000 7f3a72ffd640 1 -- 172.21.15.55:0/3111686820 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a680ab430 con 0x7f3a740ca450 2023-07-06T21:57:54.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.520+0000 7f3a72ffd640 1 -- 172.21.15.55:0/3111686820 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a680ab7c0 con 0x7f3a740ca450 2023-07-06T21:57:54.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.520+0000 7f3a7a737640 1 -- 172.21.15.55:0/3111686820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a740ca450 msgr2=0x7f3a7406a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:54.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.520+0000 7f3a7a737640 1 --2- 172.21.15.55:0/3111686820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a740ca450 0x7f3a7406a610 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f3a740c9cd0 tx=0x7f3a6801c430 comp rx=0 tx=0).stop 2023-07-06T21:57:54.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.520+0000 7f3a7a737640 1 -- 172.21.15.55:0/3111686820 shutdown_connections 2023-07-06T21:57:54.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.520+0000 7f3a7a737640 1 --2- 172.21.15.55:0/3111686820 >> v2:172.21.15.138:3300/0 conn(0x7f3a740b3730 0x7f3a7415d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.520+0000 7f3a7a737640 1 --2- 172.21.15.55:0/3111686820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a740ca450 0x7f3a7406a610 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.520+0000 7f3a7a737640 1 -- 172.21.15.55:0/3111686820 >> 172.21.15.55:0/3111686820 conn(0x7f3a740cded0 msgr2=0x7f3a740ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:54.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.520+0000 7f3a7a737640 1 -- 172.21.15.55:0/3111686820 shutdown_connections 2023-07-06T21:57:54.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.520+0000 7f3a7a737640 1 -- 172.21.15.55:0/3111686820 wait complete. 2023-07-06T21:57:54.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a7a737640 1 Processor -- start 2023-07-06T21:57:54.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a7a737640 1 -- start start 2023-07-06T21:57:54.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a7a737640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a740712f0 0x7f3a7415c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:54.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a7a737640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a740b3730 0x7f3a74159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:54.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a7a737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a740ca450 0x7f3a74150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:54.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a7a737640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7415b070 con 0x7f3a740712f0 2023-07-06T21:57:54.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a7a737640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7415a860 con 0x7f3a740b3730 2023-07-06T21:57:54.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a7a737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7415cb20 con 0x7f3a740ca450 2023-07-06T21:57:54.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a73fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a740712f0 0x7f3a7415c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:54.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a73fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a740712f0 0x7f3a7415c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51158/0 (socket says 172.21.15.55:51158) 2023-07-06T21:57:54.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a73fff640 1 -- 172.21.15.55:0/3570205374 learned_addr learned my addr 172.21.15.55:0/3570205374 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:54.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a737fe640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a740b3730 0x7f3a74159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:54.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a78cd4640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a740ca450 0x7f3a74150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:54.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a73fff640 1 -- 172.21.15.55:0/3570205374 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a740ca450 msgr2=0x7f3a74150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:54.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a73fff640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a740ca450 0x7f3a74150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a73fff640 1 -- 172.21.15.55:0/3570205374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a740b3730 msgr2=0x7f3a74159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:54.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a73fff640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a740b3730 0x7f3a74159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a73fff640 1 -- 172.21.15.55:0/3570205374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68009420 con 0x7f3a740712f0 2023-07-06T21:57:54.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a737fe640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a740b3730 0x7f3a74159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:54.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a73fff640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a740712f0 0x7f3a7415c520 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400c420 tx=0x7f3a6400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:54.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a70ff9640 1 -- 172.21.15.55:0/3570205374 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64005cf0 con 0x7f3a740712f0 2023-07-06T21:57:54.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a70ff9640 1 -- 172.21.15.55:0/3570205374 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a64005e50 con 0x7f3a740712f0 2023-07-06T21:57:54.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a70ff9640 1 -- 172.21.15.55:0/3570205374 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a640072d0 con 0x7f3a740712f0 2023-07-06T21:57:54.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.524+0000 7f3a7a737640 1 -- 172.21.15.55:0/3570205374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7415aab0 con 0x7f3a740712f0 2023-07-06T21:57:54.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.528+0000 7f3a7a737640 1 -- 172.21.15.55:0/3570205374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7415a400 con 0x7f3a740712f0 2023-07-06T21:57:54.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.528+0000 7f3a7a737640 1 -- 172.21.15.55:0/3570205374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a74066d60 con 0x7f3a740712f0 2023-07-06T21:57:54.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.528+0000 7f3a70ff9640 1 -- 172.21.15.55:0/3570205374 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3a64007430 con 0x7f3a740712f0 2023-07-06T21:57:54.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.528+0000 7f3a70ff9640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3a600663a0 0x7f3a60068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:54.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.528+0000 7f3a70ff9640 1 -- 172.21.15.55:0/3570205374 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f3a64083510 con 0x7f3a740712f0 2023-07-06T21:57:54.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.528+0000 7f3a737fe640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3a600663a0 0x7f3a60068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:54.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.528+0000 7f3a737fe640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3a600663a0 0x7f3a60068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3a680af000 tx=0x7f3a680a7000 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:54.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.532+0000 7f3a70ff9640 1 -- 172.21.15.55:0/3570205374 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3a64054290 con 0x7f3a740712f0 2023-07-06T21:57:54.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.720+0000 7f3a7a737640 1 -- 172.21.15.55:0/3570205374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a7406c380 con 0x7f3a740712f0 2023-07-06T21:57:54.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.720+0000 7f3a70ff9640 1 -- 172.21.15.55:0/3570205374 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f3a64017de0 con 0x7f3a740712f0 2023-07-06T21:57:54.718 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:54.718 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6080,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2651551074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2651551074},{"type":"v1","addr":"172.21.15.138:6835","nonce":2651551074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/1024060506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1024060506},{"type":"v1","addr":"172.21.15.138:6834","nonce":1024060506}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6933,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3347534333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3347534333},{"type":"v1","addr":"172.21.15.55:6836","nonce":3347534333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":7368,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/4020629730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":4020629730},{"type":"v1","addr":"172.21.15.55:6837","nonce":4020629730}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2023-07-06T21:57:54.719 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 34 2023-07-06T21:57:54.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.720+0000 7f3a7a737640 1 -- 172.21.15.55:0/3570205374 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3a600663a0 msgr2=0x7f3a60068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:54.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.720+0000 7f3a7a737640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3a600663a0 0x7f3a60068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3a680af000 tx=0x7f3a680a7000 comp rx=0 tx=0).stop 2023-07-06T21:57:54.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.720+0000 7f3a7a737640 1 -- 172.21.15.55:0/3570205374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a740712f0 msgr2=0x7f3a7415c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:54.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.720+0000 7f3a7a737640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a740712f0 0x7f3a7415c520 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400c420 tx=0x7f3a6400c8e0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.720+0000 7f3a7a737640 1 -- 172.21.15.55:0/3570205374 shutdown_connections 2023-07-06T21:57:54.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.720+0000 7f3a7a737640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3a600663a0 0x7f3a60068850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.720+0000 7f3a7a737640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a740ca450 0x7f3a74150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.720+0000 7f3a7a737640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a740b3730 0x7f3a74159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.720+0000 7f3a7a737640 1 --2- 172.21.15.55:0/3570205374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a740712f0 0x7f3a7415c520 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.720+0000 7f3a7a737640 1 -- 172.21.15.55:0/3570205374 >> 172.21.15.55:0/3570205374 conn(0x7f3a740cded0 msgr2=0x7f3a741578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:54.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.720+0000 7f3a7a737640 1 -- 172.21.15.55:0/3570205374 shutdown_connections 2023-07-06T21:57:54.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.720+0000 7f3a7a737640 1 -- 172.21.15.55:0/3570205374 wait complete. 2023-07-06T21:57:54.740 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T21:57:54.740 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-06T21:57:54.740 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T21:57:54.740 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:57:54.741 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T21:57:54.741 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-06T21:57:54.741 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T21:57:54.741 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:57:54.741 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T21:57:54.742 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-06T21:57:54.742 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T21:57:54.742 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:57:54.742 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T21:57:54.742 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-06T21:57:54.743 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T21:57:54.743 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:57:54.753 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T21:57:54.753 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T21:57:54.754 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T21:57:54.755 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T21:57:54.756 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T21:57:54.757 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T21:57:54.758 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T21:57:54.759 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T21:57:54.798 INFO:tasks.ceph.mds.a:Started 2023-07-06T21:57:54.799 DEBUG:teuthology.parallel:result is None 2023-07-06T21:57:54.801 INFO:tasks.ceph.mds.c:Started 2023-07-06T21:57:54.801 DEBUG:teuthology.parallel:result is None 2023-07-06T21:57:54.803 INFO:tasks.ceph.mds.b:Started 2023-07-06T21:57:54.803 DEBUG:teuthology.parallel:result is None 2023-07-06T21:57:54.805 INFO:tasks.ceph.mds.d:Started 2023-07-06T21:57:54.806 DEBUG:teuthology.parallel:result is None 2023-07-06T21:57:54.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-06T21:57:54.887 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-07-06T21:57:54.890 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T21:57:54.897 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-07-06T21:57:54.898 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-07-06T21:57:54.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f80249a2640 1 Processor -- start 2023-07-06T21:57:54.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f80249a2640 1 -- start start 2023-07-06T21:57:54.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f80249a2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80200b1250 0x7f802015f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:54.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f80249a2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200ce200 0x7f80200ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:54.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f80249a2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80200cc740 con 0x7f80200d0630 2023-07-06T21:57:54.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f80249a2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80200ccc90 con 0x7f80200b1250 2023-07-06T21:57:54.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f80249a2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80200b29c0 con 0x7f80200ce200 2023-07-06T21:57:54.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f801ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80200b1250 0x7f802015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:54.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f8017fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f80200d0630 0x7f802015f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58878/0 (socket says 172.21.15.55:58878) 2023-07-06T21:57:54.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f8017fff640 1 -- 172.21.15.55:0/987434997 learned_addr learned my addr 172.21.15.55:0/987434997 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:54.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f801f59e640 1 --2- 172.21.15.55:0/987434997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200ce200 0x7f80200ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:54.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f801ed9d640 1 -- 172.21.15.55:0/987434997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200ce200 msgr2=0x7f80200ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:54.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f801ed9d640 1 --2- 172.21.15.55:0/987434997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200ce200 0x7f80200ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f801ed9d640 1 -- 172.21.15.55:0/987434997 >> v1:172.21.15.55:6789/0 conn(0x7f80200d0630 legacy=0x7f802015f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:54.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f801ed9d640 1 -- 172.21.15.55:0/987434997 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80200d1d10 con 0x7f80200b1250 2023-07-06T21:57:54.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.960+0000 7f801e59c640 1 -- 172.21.15.55:0/987434997 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353167730 0 0) 0x7f80200cc740 con 0x7f80200d0630 2023-07-06T21:57:54.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.964+0000 7f801ed9d640 1 --2- 172.21.15.55:0/987434997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200b1250 0x7f802015f380 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f80100097c0 tx=0x7f801001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792855d52996d4bd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:54.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.964+0000 7f801e59c640 1 -- 172.21.15.55:0/987434997 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80100ab600 con 0x7f80200b1250 2023-07-06T21:57:54.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.964+0000 7f801e59c640 1 -- 172.21.15.55:0/987434997 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80100a7050 con 0x7f80200b1250 2023-07-06T21:57:54.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.964+0000 7f801e59c640 1 -- 172.21.15.55:0/987434997 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80100ab980 con 0x7f80200b1250 2023-07-06T21:57:54.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.964+0000 7f80249a2640 1 -- 172.21.15.55:0/987434997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200b1250 msgr2=0x7f802015f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:54.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.964+0000 7f80249a2640 1 --2- 172.21.15.55:0/987434997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200b1250 0x7f802015f380 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f80100097c0 tx=0x7f801001c480 comp rx=0 tx=0).stop 2023-07-06T21:57:54.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.964+0000 7f80249a2640 1 -- 172.21.15.55:0/987434997 shutdown_connections 2023-07-06T21:57:54.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.964+0000 7f80249a2640 1 --2- 172.21.15.55:0/987434997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200ce200 0x7f80200ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.964+0000 7f80249a2640 1 --2- 172.21.15.55:0/987434997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200b1250 0x7f802015f380 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.964+0000 7f80249a2640 1 -- 172.21.15.55:0/987434997 >> 172.21.15.55:0/987434997 conn(0x7f80200b3b60 msgr2=0x7f80200b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:54.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.964+0000 7f80249a2640 1 -- 172.21.15.55:0/987434997 shutdown_connections 2023-07-06T21:57:54.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.964+0000 7f80249a2640 1 -- 172.21.15.55:0/987434997 wait complete. 2023-07-06T21:57:54.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f80249a2640 1 Processor -- start 2023-07-06T21:57:54.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f80249a2640 1 -- start start 2023-07-06T21:57:54.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f80249a2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200b1250 0x7f80201502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:54.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f80249a2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200ce200 0x7f80200ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:54.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f80249a2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80200d0630 0x7f802014f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:54.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f80249a2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80201515c0 con 0x7f80200ce200 2023-07-06T21:57:54.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f80249a2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802015dda0 con 0x7f80200d0630 2023-07-06T21:57:54.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f80249a2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8020150940 con 0x7f80200b1250 2023-07-06T21:57:54.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f8017fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200ce200 0x7f80200ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:54.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f8017fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200ce200 0x7f80200ca030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51204/0 (socket says 172.21.15.55:51204) 2023-07-06T21:57:54.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f8017fff640 1 -- 172.21.15.55:0/498146382 learned_addr learned my addr 172.21.15.55:0/498146382 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:54.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f801f59e640 1 --2- 172.21.15.55:0/498146382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80200d0630 0x7f802014f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:54.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f801ed9d640 1 --2- 172.21.15.55:0/498146382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200b1250 0x7f80201502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:54.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f8017fff640 1 -- 172.21.15.55:0/498146382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200b1250 msgr2=0x7f80201502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:54.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f8017fff640 1 --2- 172.21.15.55:0/498146382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200b1250 0x7f80201502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f8017fff640 1 -- 172.21.15.55:0/498146382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80200d0630 msgr2=0x7f802014f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:54.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f8017fff640 1 --2- 172.21.15.55:0/498146382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80200d0630 0x7f802014f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:54.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f8017fff640 1 -- 172.21.15.55:0/498146382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8010009420 con 0x7f80200ce200 2023-07-06T21:57:54.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.968+0000 7f8017fff640 1 --2- 172.21.15.55:0/498146382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200ce200 0x7f80200ca030 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f80080011f0 tx=0x7f800800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:54.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.972+0000 7f80177fe640 1 -- 172.21.15.55:0/498146382 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80080074e0 con 0x7f80200ce200 2023-07-06T21:57:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.972+0000 7f80177fe640 1 -- 172.21.15.55:0/498146382 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8008007640 con 0x7f80200ce200 2023-07-06T21:57:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.972+0000 7f80177fe640 1 -- 172.21.15.55:0/498146382 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008004a10 con 0x7f80200ce200 2023-07-06T21:57:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.972+0000 7f80249a2640 1 -- 172.21.15.55:0/498146382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8020150c20 con 0x7f80200ce200 2023-07-06T21:57:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.972+0000 7f80249a2640 1 -- 172.21.15.55:0/498146382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80201511e0 con 0x7f80200ce200 2023-07-06T21:57:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.972+0000 7f80249a2640 1 -- 172.21.15.55:0/498146382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802004d790 con 0x7f80200ce200 2023-07-06T21:57:54.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.972+0000 7f80177fe640 1 -- 172.21.15.55:0/498146382 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8008004b70 con 0x7f80200ce200 2023-07-06T21:57:54.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.972+0000 7f80177fe640 1 --2- 172.21.15.55:0/498146382 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f80000663a0 0x7f8000068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:54.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.972+0000 7f80177fe640 1 -- 172.21.15.55:0/498146382 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f8008083040 con 0x7f80200ce200 2023-07-06T21:57:54.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.972+0000 7f801ed9d640 1 --2- 172.21.15.55:0/498146382 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f80000663a0 0x7f8000068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:54.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.972+0000 7f801ed9d640 1 --2- 172.21.15.55:0/498146382 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f80000663a0 0x7f8000068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f80100ad000 tx=0x7f80100a6000 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:54.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:54.976+0000 7f80177fe640 1 -- 172.21.15.55:0/498146382 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f80080503d0 con 0x7f80200ce200 2023-07-06T21:57:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:55.140+0000 7f80249a2640 1 -- 172.21.15.55:0/498146382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f80200b3240 con 0x7f80200ce200 2023-07-06T21:57:55.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:55.940+0000 7f80177fe640 1 -- 172.21.15.55:0/498146382 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v99) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8008018080 con 0x7f80200ce200 2023-07-06T21:57:55.939 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-07-06T21:57:55.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:55.944+0000 7f80249a2640 1 -- 172.21.15.55:0/498146382 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f80000663a0 msgr2=0x7f8000068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:55.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:55.944+0000 7f80249a2640 1 --2- 172.21.15.55:0/498146382 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f80000663a0 0x7f8000068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f80100ad000 tx=0x7f80100a6000 comp rx=0 tx=0).stop 2023-07-06T21:57:55.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:55.944+0000 7f80249a2640 1 -- 172.21.15.55:0/498146382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200ce200 msgr2=0x7f80200ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:55.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:55.944+0000 7f80249a2640 1 --2- 172.21.15.55:0/498146382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200ce200 0x7f80200ca030 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f80080011f0 tx=0x7f800800c9b0 comp rx=0 tx=0).stop 2023-07-06T21:57:55.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:55.944+0000 7f80249a2640 1 -- 172.21.15.55:0/498146382 shutdown_connections 2023-07-06T21:57:55.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:55.944+0000 7f80249a2640 1 --2- 172.21.15.55:0/498146382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80200d0630 0x7f802014f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:55.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:55.944+0000 7f80249a2640 1 --2- 172.21.15.55:0/498146382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200ce200 0x7f80200ca030 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:55.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:55.944+0000 7f80249a2640 1 --2- 172.21.15.55:0/498146382 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f80000663a0 0x7f8000068850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:55.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:55.944+0000 7f80249a2640 1 --2- 172.21.15.55:0/498146382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200b1250 0x7f80201502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:55.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:55.944+0000 7f80249a2640 1 -- 172.21.15.55:0/498146382 >> 172.21.15.55:0/498146382 conn(0x7f80200b3b60 msgr2=0x7f80200b4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:55.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:55.944+0000 7f80249a2640 1 -- 172.21.15.55:0/498146382 shutdown_connections 2023-07-06T21:57:55.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:55.944+0000 7f80249a2640 1 -- 172.21.15.55:0/498146382 wait complete. 2023-07-06T21:57:55.964 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-06T21:57:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.112+0000 7f948b567640 1 Processor -- start 2023-07-06T21:57:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.112+0000 7f948b567640 1 -- start start 2023-07-06T21:57:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.116+0000 7f948b567640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f948415b7e0 0x7f94840cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.116+0000 7f948b567640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f948415cbc0 0x7f948406b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.116+0000 7f948b567640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94840cdc80 con 0x7f9484160300 2023-07-06T21:57:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.116+0000 7f948b567640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94840cd6c0 con 0x7f948415cbc0 2023-07-06T21:57:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.116+0000 7f948b567640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94840cd9a0 con 0x7f948415b7e0 2023-07-06T21:57:56.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.116+0000 7f9489b04640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f948415cbc0 0x7f948406b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.116+0000 7f9489b04640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f948415cbc0 0x7f948406b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51216/0 (socket says 172.21.15.55:51216) 2023-07-06T21:57:56.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.116+0000 7f9489b04640 1 -- 172.21.15.55:0/922943635 learned_addr learned my addr 172.21.15.55:0/922943635 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:56.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.116+0000 7f9489303640 1 --2- 172.21.15.55:0/922943635 >> v2:172.21.15.138:3300/0 conn(0x7f948415b7e0 0x7f94840cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.116+0000 7f9489b04640 1 -- 172.21.15.55:0/922943635 >> v2:172.21.15.138:3300/0 conn(0x7f948415b7e0 msgr2=0x7f94840cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:56.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.116+0000 7f9489b04640 1 --2- 172.21.15.55:0/922943635 >> v2:172.21.15.138:3300/0 conn(0x7f948415b7e0 0x7f94840cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.116+0000 7f9489b04640 1 -- 172.21.15.55:0/922943635 >> v1:172.21.15.138:6789/0 conn(0x7f9484160300 legacy=0x7f94840c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.116+0000 7f9489b04640 1 -- 172.21.15.55:0/922943635 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9484069490 con 0x7f948415cbc0 2023-07-06T21:57:56.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.116+0000 7f9489303640 1 --2- 172.21.15.55:0/922943635 >> v2:172.21.15.138:3300/0 conn(0x7f948415b7e0 0x7f94840cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:56.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f9489b04640 1 --2- 172.21.15.55:0/922943635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948415cbc0 0x7f948406b2d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f948406ed50 tx=0x7f947c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f71a8c4a060af9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f947bfff640 1 -- 172.21.15.55:0/922943635 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c0a57a0 con 0x7f948415cbc0 2023-07-06T21:57:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f947bfff640 1 -- 172.21.15.55:0/922943635 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c0a5900 con 0x7f948415cbc0 2023-07-06T21:57:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f947bfff640 1 -- 172.21.15.55:0/922943635 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c0a5c90 con 0x7f948415cbc0 2023-07-06T21:57:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 -- 172.21.15.55:0/922943635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948415cbc0 msgr2=0x7f948406b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 --2- 172.21.15.55:0/922943635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948415cbc0 0x7f948406b2d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f948406ed50 tx=0x7f947c01c9d0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 -- 172.21.15.55:0/922943635 shutdown_connections 2023-07-06T21:57:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 --2- 172.21.15.55:0/922943635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f948415cbc0 0x7f948406b2d0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 --2- 172.21.15.55:0/922943635 >> v2:172.21.15.138:3300/0 conn(0x7f948415b7e0 0x7f94840cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 -- 172.21.15.55:0/922943635 >> 172.21.15.55:0/922943635 conn(0x7f94840cded0 msgr2=0x7f94840ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 -- 172.21.15.55:0/922943635 shutdown_connections 2023-07-06T21:57:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 -- 172.21.15.55:0/922943635 wait complete. 2023-07-06T21:57:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 Processor -- start 2023-07-06T21:57:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 -- start start 2023-07-06T21:57:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f948415b7e0 0x7f948415e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f948415cbc0 0x7f94840705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9484160300 0x7f9484150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9484158af0 con 0x7f9484160300 2023-07-06T21:57:56.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9484158810 con 0x7f948415b7e0 2023-07-06T21:57:56.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.120+0000 7f948b567640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948406fb10 con 0x7f948415cbc0 2023-07-06T21:57:56.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9489b04640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9484160300 0x7f9484150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9489b04640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9484160300 0x7f9484150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51226/0 (socket says 172.21.15.55:51226) 2023-07-06T21:57:56.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9489b04640 1 -- 172.21.15.55:0/292008226 learned_addr learned my addr 172.21.15.55:0/292008226 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:56.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9489303640 1 --2- 172.21.15.55:0/292008226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f948415b7e0 0x7f948415e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9488b02640 1 --2- 172.21.15.55:0/292008226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f948415cbc0 0x7f94840705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9489b04640 1 -- 172.21.15.55:0/292008226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f948415cbc0 msgr2=0x7f94840705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9489b04640 1 --2- 172.21.15.55:0/292008226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f948415cbc0 0x7f94840705f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9489b04640 1 -- 172.21.15.55:0/292008226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f948415b7e0 msgr2=0x7f948415e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9489b04640 1 --2- 172.21.15.55:0/292008226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f948415b7e0 0x7f948415e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9489b04640 1 -- 172.21.15.55:0/292008226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c009b30 con 0x7f9484160300 2023-07-06T21:57:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9489b04640 1 --2- 172.21.15.55:0/292008226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9484160300 0x7f9484150440 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f947c0af040 tx=0x7f947c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9479ffb640 1 -- 172.21.15.55:0/292008226 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c0b8670 con 0x7f9484160300 2023-07-06T21:57:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9479ffb640 1 -- 172.21.15.55:0/292008226 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c0b87d0 con 0x7f9484160300 2023-07-06T21:57:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9479ffb640 1 -- 172.21.15.55:0/292008226 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c0b8b40 con 0x7f9484160300 2023-07-06T21:57:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f948b567640 1 -- 172.21.15.55:0/292008226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948406fdf0 con 0x7f9484160300 2023-07-06T21:57:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f948b567640 1 -- 172.21.15.55:0/292008226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94840ae260 con 0x7f9484160300 2023-07-06T21:57:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f948b567640 1 -- 172.21.15.55:0/292008226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948406f940 con 0x7f9484160300 2023-07-06T21:57:56.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.124+0000 7f9479ffb640 1 -- 172.21.15.55:0/292008226 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f947c0b8ca0 con 0x7f9484160300 2023-07-06T21:57:56.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.128+0000 7f9479ffb640 1 --2- 172.21.15.55:0/292008226 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f9468066370 0x7f9468068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.128+0000 7f9479ffb640 1 -- 172.21.15.55:0/292008226 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f947c11eff0 con 0x7f9484160300 2023-07-06T21:57:56.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.128+0000 7f9489303640 1 --2- 172.21.15.55:0/292008226 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f9468066370 0x7f9468068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.128+0000 7f9489303640 1 --2- 172.21.15.55:0/292008226 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f9468066370 0x7f9468068820 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f94840712c0 tx=0x7f9480008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:56.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.132+0000 7f9479ffb640 1 -- 172.21.15.55:0/292008226 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f947c0ec670 con 0x7f9484160300 2023-07-06T21:57:56.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.336+0000 7f948b567640 1 -- 172.21.15.55:0/292008226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f948406d2e0 con 0x7f9484160300 2023-07-06T21:57:56.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.336+0000 7f9479ffb640 1 -- 172.21.15.55:0/292008226 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f947c0efc90 con 0x7f9484160300 2023-07-06T21:57:56.335 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:56.335 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T21:57:56.335 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-07-06T21:57:56.335 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.336 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-07-06T21:57:56.336 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkWjb1JxAAMmLy+dPO5qyorBnuzazx6A==", 2023-07-06T21:57:56.336 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.336 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:56.336 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:57:56.336 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:57:56.336 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.337 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.337 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.337 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.337 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-07-06T21:57:56.337 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkpLLENBAAxMASh3qbELQMJ3XbPEX0Zw==", 2023-07-06T21:57:56.337 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.337 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:56.337 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:57:56.338 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:57:56.338 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.338 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.338 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.338 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.338 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-07-06T21:57:56.338 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkvOSfLxAAMEoqAPg1pb47e5a1G1QtAw==", 2023-07-06T21:57:56.338 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.339 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:56.339 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:57:56.339 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:57:56.339 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.339 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.339 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.339 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.340 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-07-06T21:57:56.340 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkeQIBARAApXT5zWLUqqMSdwYygZeatw==", 2023-07-06T21:57:56.340 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.340 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:56.340 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:57:56.340 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:57:56.340 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.340 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.341 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.341 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.341 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-07-06T21:57:56.341 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD5NKdkSIfzJxAAlXiG8PWFXQqIeugbdp7Eiw==", 2023-07-06T21:57:56.341 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.341 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:56.341 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:56.341 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.342 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.342 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.342 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.342 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-07-06T21:57:56.342 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD8NKdkv2iwLxAAxjFucMwaaH66wPQpoYSTGw==", 2023-07-06T21:57:56.342 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.342 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:56.342 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:56.343 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.343 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.343 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.343 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.343 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-07-06T21:57:56.343 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD/NKdk5w7XOBAAuiup4mcC02ZMCPHCU1Cl3A==", 2023-07-06T21:57:56.343 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.344 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:56.344 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:56.344 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.344 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.344 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.344 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.344 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-07-06T21:57:56.344 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQADNadksvRLBBAAE1YX9VgA8pWARIEZL8tbsQ==", 2023-07-06T21:57:56.345 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.345 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:56.345 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:56.345 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.345 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.345 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.345 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.345 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-07-06T21:57:56.346 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAJNadkn2HsChAAgwb7B9lHOMq2h0BNuhB/AQ==", 2023-07-06T21:57:56.346 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.346 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:56.346 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:56.346 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.346 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.346 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.347 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.347 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-07-06T21:57:56.347 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMNadkbonPERAA2PLg4NMr+4eW+FDAfPig1A==", 2023-07-06T21:57:56.347 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.347 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:56.347 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:56.347 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.347 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.348 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.348 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.348 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-07-06T21:57:56.348 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAPNadkQw76GBAAY9SIgsTUHqvThwjdpjuwpw==", 2023-07-06T21:57:56.348 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.348 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:56.348 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:56.348 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.349 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.349 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.349 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.349 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-07-06T21:57:56.349 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQASNadkr3gRHxAALbPUtIgImIK1UUoe6vcyjg==", 2023-07-06T21:57:56.349 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.349 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:57:56.350 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:57:56.350 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.350 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.350 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.350 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.350 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-07-06T21:57:56.350 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkaZgiBRAAvyBUd+qHLh/wwhgoE1MsVA==", 2023-07-06T21:57:56.350 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.351 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:56.351 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-07-06T21:57:56.351 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-06T21:57:56.351 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.351 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.351 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.351 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-07-06T21:57:56.351 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkOBqoDBAASIhzvCqkSAFLX2oc99MYqw==", 2023-07-06T21:57:56.352 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.352 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:56.352 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:57:56.352 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:57:56.352 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:57:56.352 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.352 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.352 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.353 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-07-06T21:57:56.353 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkgt/fCBAAlQY94DrR/nFTIVwSFCEToQ==", 2023-07-06T21:57:56.353 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.353 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:56.353 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:57:56.353 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:57:56.353 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:57:56.354 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.354 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.354 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.354 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-07-06T21:57:56.354 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkd5zAEhAAU0Qo6NROIKRSlOncFUoTxQ==", 2023-07-06T21:57:56.354 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.354 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:57:56.354 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:57:56.355 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:57:56.355 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:57:56.355 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.355 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.355 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.355 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-07-06T21:57:56.355 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkjvG8ChAA5rpuV6+YETQS9UjMRUynxA==", 2023-07-06T21:57:56.355 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.356 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:57:56.356 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:57:56.356 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:57:56.356 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.356 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.356 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.356 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.357 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-07-06T21:57:56.357 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdk+RUVIxAAyQpmGAeL8K+Cy+fgK5BmCQ==", 2023-07-06T21:57:56.357 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.357 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:57:56.357 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T21:57:56.357 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.357 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.357 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:56.358 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:56.358 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-07-06T21:57:56.358 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkLH8aHxAAzzX5YxumCYWYqo0rQfFA9g==", 2023-07-06T21:57:56.358 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:57:56.358 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:57:56.358 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T21:57:56.358 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:57:56.358 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.359 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:56.359 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-07-06T21:57:56.359 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T21:57:56.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.336+0000 7f948b567640 1 -- 172.21.15.55:0/292008226 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f9468066370 msgr2=0x7f9468068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.336+0000 7f948b567640 1 --2- 172.21.15.55:0/292008226 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f9468066370 0x7f9468068820 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f94840712c0 tx=0x7f9480008040 comp rx=0 tx=0).stop 2023-07-06T21:57:56.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.336+0000 7f948b567640 1 -- 172.21.15.55:0/292008226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9484160300 msgr2=0x7f9484150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.336+0000 7f948b567640 1 --2- 172.21.15.55:0/292008226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9484160300 0x7f9484150440 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f947c0af040 tx=0x7f947c019770 comp rx=0 tx=0).stop 2023-07-06T21:57:56.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.336+0000 7f948b567640 1 -- 172.21.15.55:0/292008226 shutdown_connections 2023-07-06T21:57:56.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.336+0000 7f948b567640 1 --2- 172.21.15.55:0/292008226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9484160300 0x7f9484150440 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.336+0000 7f948b567640 1 --2- 172.21.15.55:0/292008226 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f9468066370 0x7f9468068820 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.336+0000 7f948b567640 1 --2- 172.21.15.55:0/292008226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f948415cbc0 0x7f94840705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.336+0000 7f948b567640 1 --2- 172.21.15.55:0/292008226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f948415b7e0 0x7f948415e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.336+0000 7f948b567640 1 -- 172.21.15.55:0/292008226 >> 172.21.15.55:0/292008226 conn(0x7f94840cded0 msgr2=0x7f94840ca8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:56.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.340+0000 7f948b567640 1 -- 172.21.15.55:0/292008226 shutdown_connections 2023-07-06T21:57:56.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.340+0000 7f948b567640 1 -- 172.21.15.55:0/292008226 wait complete. 2023-07-06T21:57:56.362 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:57:56.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab8f2c640 1 Processor -- start 2023-07-06T21:57:56.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab8f2c640 1 -- start start 2023-07-06T21:57:56.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab8f2c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbab40b4420 0x7fbab415c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab8f2c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab406a160 con 0x7fbab415b9d0 2023-07-06T21:57:56.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab8f2c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab415bda0 con 0x7fbab415f4e0 2023-07-06T21:57:56.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab8f2c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab4069590 con 0x7fbab40b4420 2023-07-06T21:57:56.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbab415b9d0 0x7fbab40ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58882/0 (socket says 172.21.15.55:58882) 2023-07-06T21:57:56.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab259c640 1 -- 172.21.15.55:0/1952528854 learned_addr learned my addr 172.21.15.55:0/1952528854 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:56.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab2d9d640 1 --2- 172.21.15.55:0/1952528854 >> v2:172.21.15.138:3300/0 conn(0x7fbab40b4420 0x7fbab415c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293990055 0 0) 0x7fbab406a160 con 0x7fbab415b9d0 2023-07-06T21:57:56.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba9c003530 con 0x7fbab415b9d0 2023-07-06T21:57:56.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732563628 0 0) 0x7fbab415bda0 con 0x7fbab415f4e0 2023-07-06T21:57:56.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab406a160 con 0x7fbab415f4e0 2023-07-06T21:57:56.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 393358981 0 0) 0x7fba9c003530 con 0x7fbab415b9d0 2023-07-06T21:57:56.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 >> v2:172.21.15.138:3300/0 conn(0x7fbab40b4420 msgr2=0x7fbab415c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:56.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab159a640 1 --2- 172.21.15.55:0/1952528854 >> v2:172.21.15.138:3300/0 conn(0x7fbab40b4420 0x7fbab415c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 >> v1:172.21.15.138:6789/0 conn(0x7fbab415f4e0 legacy=0x7fbab40b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4069830 con 0x7fbab415b9d0 2023-07-06T21:57:56.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fbaa4001680 con 0x7fbab415b9d0 2023-07-06T21:57:56.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 >> v1:172.21.15.55:6789/0 conn(0x7fbab415b9d0 legacy=0x7fbab40ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab159a640 1 --2- 172.21.15.55:0/1952528854 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba9c003b60 0x7fba9c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab159a640 1 --2- 172.21.15.55:0/1952528854 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba9c0047d0 0x7fba9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.508+0000 7fbab159a640 1 --2- 172.21.15.55:0/1952528854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9c005180 0x7fba9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4069590 con 0x7fba9c005180 2023-07-06T21:57:56.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c00c060 con 0x7fba9c0047d0 2023-07-06T21:57:56.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c00c1f0 con 0x7fba9c003b60 2023-07-06T21:57:56.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab2d9d640 1 --2- 172.21.15.55:0/1952528854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9c005180 0x7fba9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab1d9b640 1 --2- 172.21.15.55:0/1952528854 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba9c0047d0 0x7fba9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab259c640 1 --2- 172.21.15.55:0/1952528854 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba9c003b60 0x7fba9c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab2d9d640 1 -- 172.21.15.55:0/1952528854 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba9c003b60 msgr2=0x7fba9c003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:56.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab2d9d640 1 --2- 172.21.15.55:0/1952528854 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba9c003b60 0x7fba9c003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab2d9d640 1 -- 172.21.15.55:0/1952528854 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba9c0047d0 msgr2=0x7fba9c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:56.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab2d9d640 1 --2- 172.21.15.55:0/1952528854 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba9c0047d0 0x7fba9c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab2d9d640 1 -- 172.21.15.55:0/1952528854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c003530 con 0x7fba9c005180 2023-07-06T21:57:56.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab2d9d640 1 -- 172.21.15.55:0/1952528854 reap_dead start 2023-07-06T21:57:56.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab2d9d640 1 --2- 172.21.15.55:0/1952528854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9c005180 0x7fba9c00b990 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fbaac009f90 tx=0x7fbaac01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90af898da6238b5b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:56.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac003ba0 con 0x7fba9c005180 2023-07-06T21:57:56.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac00f040 con 0x7fba9c005180 2023-07-06T21:57:56.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.512+0000 7fbab159a640 1 -- 172.21.15.55:0/1952528854 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0a5960 con 0x7fba9c005180 2023-07-06T21:57:56.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 -- 172.21.15.55:0/1952528854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9c005180 msgr2=0x7fba9c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 --2- 172.21.15.55:0/1952528854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9c005180 0x7fba9c00b990 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fbaac009f90 tx=0x7fbaac01cc60 comp rx=0 tx=0).stop 2023-07-06T21:57:56.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 -- 172.21.15.55:0/1952528854 shutdown_connections 2023-07-06T21:57:56.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 --2- 172.21.15.55:0/1952528854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9c005180 0x7fba9c00b990 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 -- 172.21.15.55:0/1952528854 >> 172.21.15.55:0/1952528854 conn(0x7fbab40ced10 msgr2=0x7fbab40cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:56.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 -- 172.21.15.55:0/1952528854 shutdown_connections 2023-07-06T21:57:56.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 -- 172.21.15.55:0/1952528854 wait complete. 2023-07-06T21:57:56.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 Processor -- start 2023-07-06T21:57:56.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 -- start start 2023-07-06T21:57:56.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9c005180 0x7fbab40b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbab4155a70 0x7fbab41f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbab41f1940 0x7fbab415c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab41f4f50 con 0x7fba9c005180 2023-07-06T21:57:56.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab41f5230 con 0x7fbab4155a70 2023-07-06T21:57:56.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab8f2c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab41f5510 con 0x7fbab41f1940 2023-07-06T21:57:56.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9c005180 0x7fbab40b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9c005180 0x7fbab40b79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51252/0 (socket says 172.21.15.55:51252) 2023-07-06T21:57:56.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab259c640 1 -- 172.21.15.55:0/3291086849 learned_addr learned my addr 172.21.15.55:0/3291086849 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:56.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab1d9b640 1 --2- 172.21.15.55:0/3291086849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbab4155a70 0x7fbab41f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.516+0000 7fbab2d9d640 1 --2- 172.21.15.55:0/3291086849 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbab41f1940 0x7fbab415c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbab259c640 1 -- 172.21.15.55:0/3291086849 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbab41f1940 msgr2=0x7fbab415c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbab259c640 1 --2- 172.21.15.55:0/3291086849 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbab41f1940 0x7fbab415c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbab259c640 1 -- 172.21.15.55:0/3291086849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbab4155a70 msgr2=0x7fbab41f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbab259c640 1 --2- 172.21.15.55:0/3291086849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbab4155a70 0x7fbab41f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbab259c640 1 -- 172.21.15.55:0/3291086849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab41f1420 con 0x7fba9c005180 2023-07-06T21:57:56.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbab259c640 1 --2- 172.21.15.55:0/3291086849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9c005180 0x7fbab40b79a0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4012490 tx=0x7fbaa4012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:56.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbaa2ffd640 1 -- 172.21.15.55:0/3291086849 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4014750 con 0x7fba9c005180 2023-07-06T21:57:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbaa2ffd640 1 -- 172.21.15.55:0/3291086849 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa40148b0 con 0x7fba9c005180 2023-07-06T21:57:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbaa2ffd640 1 -- 172.21.15.55:0/3291086849 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4014c40 con 0x7fba9c005180 2023-07-06T21:57:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbab8f2c640 1 -- 172.21.15.55:0/3291086849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab41f4c40 con 0x7fba9c005180 2023-07-06T21:57:56.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbab8f2c640 1 -- 172.21.15.55:0/3291086849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab41f10b0 con 0x7fba9c005180 2023-07-06T21:57:56.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbab8f2c640 1 -- 172.21.15.55:0/3291086849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab41f1660 con 0x7fba9c005180 2023-07-06T21:57:56.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbaa2ffd640 1 -- 172.21.15.55:0/3291086849 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbaa40153e0 con 0x7fba9c005180 2023-07-06T21:57:56.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbaa2ffd640 1 --2- 172.21.15.55:0/3291086849 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fba940663d0 0x7fba94068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.520+0000 7fbaa2ffd640 1 -- 172.21.15.55:0/3291086849 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fbaa40864f0 con 0x7fba9c005180 2023-07-06T21:57:56.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.524+0000 7fbab1d9b640 1 --2- 172.21.15.55:0/3291086849 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fba940663d0 0x7fba94068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.524+0000 7fbab1d9b640 1 --2- 172.21.15.55:0/3291086849 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fba940663d0 0x7fba94068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbab40ccc50 tx=0x7fbaa8009040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.524+0000 7fbaa2ffd640 1 -- 172.21.15.55:0/3291086849 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbab41f1660 con 0x7fba9c005180 2023-07-06T21:57:56.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.684+0000 7fbab8f2c640 1 -- 172.21.15.55:0/3291086849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbab41f1660 con 0x7fba9c005180 2023-07-06T21:57:56.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.688+0000 7fbaa2ffd640 1 -- 172.21.15.55:0/3291086849 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+14833 (secure 0 0 0) 0x7fbab41f1660 con 0x7fba9c005180 2023-07-06T21:57:56.685 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:56.685 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":99,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:57:55.930767+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:57:56.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.688+0000 7fbab8f2c640 1 -- 172.21.15.55:0/3291086849 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fba940663d0 msgr2=0x7fba94068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.688+0000 7fbab8f2c640 1 --2- 172.21.15.55:0/3291086849 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fba940663d0 0x7fba94068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbab40ccc50 tx=0x7fbaa8009040 comp rx=0 tx=0).stop 2023-07-06T21:57:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.688+0000 7fbab8f2c640 1 -- 172.21.15.55:0/3291086849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9c005180 msgr2=0x7fbab40b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.688+0000 7fbab8f2c640 1 --2- 172.21.15.55:0/3291086849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9c005180 0x7fbab40b79a0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4012490 tx=0x7fbaa4012950 comp rx=0 tx=0).stop 2023-07-06T21:57:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.688+0000 7fbab8f2c640 1 -- 172.21.15.55:0/3291086849 shutdown_connections 2023-07-06T21:57:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.688+0000 7fbab8f2c640 1 --2- 172.21.15.55:0/3291086849 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fba940663d0 0x7fba94068880 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.688+0000 7fbab8f2c640 1 --2- 172.21.15.55:0/3291086849 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbab41f1940 0x7fbab415c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.688+0000 7fbab8f2c640 1 --2- 172.21.15.55:0/3291086849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbab4155a70 0x7fbab41f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.688+0000 7fbab8f2c640 1 --2- 172.21.15.55:0/3291086849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9c005180 0x7fbab40b79a0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.688+0000 7fbab8f2c640 1 -- 172.21.15.55:0/3291086849 >> 172.21.15.55:0/3291086849 conn(0x7fbab40ced10 msgr2=0x7fbab415dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:56.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.688+0000 7fbab8f2c640 1 -- 172.21.15.55:0/3291086849 shutdown_connections 2023-07-06T21:57:56.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.688+0000 7fbab8f2c640 1 -- 172.21.15.55:0/3291086849 wait complete. 2023-07-06T21:57:56.706 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:57:56.706 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:57:56.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.856+0000 7fb75ebc5640 1 Processor -- start 2023-07-06T21:57:56.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.856+0000 7fb75ebc5640 1 -- start start 2023-07-06T21:57:56.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.856+0000 7fb75ebc5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7580709a0 0x7fb7580cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.856+0000 7fb75ebc5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb7580cbe60 0x7fb7580b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.856+0000 7fb75ebc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb758070d70 0x7fb7580b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.856+0000 7fb75ebc5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7580cc300 con 0x7fb7580709a0 2023-07-06T21:57:56.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.856+0000 7fb75ebc5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7580cc5e0 con 0x7fb7580cbe60 2023-07-06T21:57:56.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.856+0000 7fb75ebc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7580cc8c0 con 0x7fb758070d70 2023-07-06T21:57:56.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.856+0000 7fb75c961640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7580709a0 0x7fb7580cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.860+0000 7fb75c961640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7580709a0 0x7fb7580cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51268/0 (socket says 172.21.15.55:51268) 2023-07-06T21:57:56.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.860+0000 7fb75c961640 1 -- 172.21.15.55:0/4015342596 learned_addr learned my addr 172.21.15.55:0/4015342596 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:56.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.860+0000 7fb757fff640 1 --2- 172.21.15.55:0/4015342596 >> v2:172.21.15.138:3300/0 conn(0x7fb7580cbe60 0x7fb7580b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.860+0000 7fb75d162640 1 --2- 172.21.15.55:0/4015342596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb758070d70 0x7fb7580b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.860+0000 7fb75c961640 1 -- 172.21.15.55:0/4015342596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb758070d70 msgr2=0x7fb7580b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:56.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.860+0000 7fb75c961640 1 --2- 172.21.15.55:0/4015342596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb758070d70 0x7fb7580b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.860+0000 7fb75c961640 1 -- 172.21.15.55:0/4015342596 >> v2:172.21.15.138:3300/0 conn(0x7fb7580cbe60 msgr2=0x7fb7580b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:56.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.860+0000 7fb75c961640 1 --2- 172.21.15.55:0/4015342596 >> v2:172.21.15.138:3300/0 conn(0x7fb7580cbe60 0x7fb7580b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.860+0000 7fb75c961640 1 -- 172.21.15.55:0/4015342596 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7580ccba0 con 0x7fb7580709a0 2023-07-06T21:57:56.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.860+0000 7fb75c961640 1 --2- 172.21.15.55:0/4015342596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7580709a0 0x7fb7580cb920 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fb7580ca7c0 tx=0x7fb74c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4faacaff6d40c4ac server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:56.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.860+0000 7fb7577fe640 1 -- 172.21.15.55:0/4015342596 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c0ac630 con 0x7fb7580709a0 2023-07-06T21:57:56.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb7577fe640 1 -- 172.21.15.55:0/4015342596 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c0ac790 con 0x7fb7580709a0 2023-07-06T21:57:56.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb7577fe640 1 -- 172.21.15.55:0/4015342596 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c0acb20 con 0x7fb7580709a0 2023-07-06T21:57:56.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 -- 172.21.15.55:0/4015342596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7580709a0 msgr2=0x7fb7580cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 --2- 172.21.15.55:0/4015342596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7580709a0 0x7fb7580cb920 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fb7580ca7c0 tx=0x7fb74c01c500 comp rx=0 tx=0).stop 2023-07-06T21:57:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 -- 172.21.15.55:0/4015342596 shutdown_connections 2023-07-06T21:57:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 --2- 172.21.15.55:0/4015342596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb758070d70 0x7fb7580b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 --2- 172.21.15.55:0/4015342596 >> v2:172.21.15.138:3300/0 conn(0x7fb7580cbe60 0x7fb7580b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 --2- 172.21.15.55:0/4015342596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7580709a0 0x7fb7580cb920 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 -- 172.21.15.55:0/4015342596 >> 172.21.15.55:0/4015342596 conn(0x7fb7580cea70 msgr2=0x7fb7580ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 -- 172.21.15.55:0/4015342596 shutdown_connections 2023-07-06T21:57:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 -- 172.21.15.55:0/4015342596 wait complete. 2023-07-06T21:57:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 Processor -- start 2023-07-06T21:57:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 -- start start 2023-07-06T21:57:56.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7580709a0 0x7fb75809e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb758070d70 0x7fb75806a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7580cbe60 0x7fb75815b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb758155cf0 con 0x7fb758070d70 2023-07-06T21:57:56.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7581573b0 con 0x7fb7580709a0 2023-07-06T21:57:56.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.864+0000 7fb75ebc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb758157690 con 0x7fb7580cbe60 2023-07-06T21:57:56.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb757fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb758070d70 0x7fb75806a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb757fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb758070d70 0x7fb75806a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51282/0 (socket says 172.21.15.55:51282) 2023-07-06T21:57:56.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb757fff640 1 -- 172.21.15.55:0/3618045846 learned_addr learned my addr 172.21.15.55:0/3618045846 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:56.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb75c961640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7580709a0 0x7fb75809e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb75d162640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7580cbe60 0x7fb75815b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb757fff640 1 -- 172.21.15.55:0/3618045846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7580cbe60 msgr2=0x7fb75815b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb757fff640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7580cbe60 0x7fb75815b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb757fff640 1 -- 172.21.15.55:0/3618045846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7580709a0 msgr2=0x7fb75809e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb757fff640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7580709a0 0x7fb75809e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb757fff640 1 -- 172.21.15.55:0/3618045846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c0094d0 con 0x7fb758070d70 2023-07-06T21:57:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb75d162640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7580cbe60 0x7fb75815b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb757fff640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb758070d70 0x7fb75806a4a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fb74400e870 tx=0x7fb74400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb7557fa640 1 -- 172.21.15.55:0/3618045846 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744009510 con 0x7fb758070d70 2023-07-06T21:57:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb7557fa640 1 -- 172.21.15.55:0/3618045846 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74400eec0 con 0x7fb758070d70 2023-07-06T21:57:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb7557fa640 1 -- 172.21.15.55:0/3618045846 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74400cb40 con 0x7fb758070d70 2023-07-06T21:57:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb75ebc5640 1 -- 172.21.15.55:0/3618045846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb758155980 con 0x7fb758070d70 2023-07-06T21:57:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb75ebc5640 1 -- 172.21.15.55:0/3618045846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75809e720 con 0x7fb758070d70 2023-07-06T21:57:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb75ebc5640 1 -- 172.21.15.55:0/3618045846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7581557e0 con 0x7fb758070d70 2023-07-06T21:57:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.868+0000 7fb7557fa640 1 -- 172.21.15.55:0/3618045846 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb74400ccc0 con 0x7fb758070d70 2023-07-06T21:57:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.872+0000 7fb7557fa640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb73c0663a0 0x7fb73c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.872+0000 7fb7557fa640 1 -- 172.21.15.55:0/3618045846 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb744083d50 con 0x7fb758070d70 2023-07-06T21:57:56.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.872+0000 7fb75c961640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb73c0663a0 0x7fb73c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:56.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.872+0000 7fb75c961640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb73c0663a0 0x7fb73c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb74c0ae000 tx=0x7fb74c008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:56.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:56.876+0000 7fb7557fa640 1 -- 172.21.15.55:0/3618045846 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb7581557e0 con 0x7fb758070d70 2023-07-06T21:57:57.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.028+0000 7fb75ebc5640 1 -- 172.21.15.55:0/3618045846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7581557e0 con 0x7fb758070d70 2023-07-06T21:57:57.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.028+0000 7fb7557fa640 1 -- 172.21.15.55:0/3618045846 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7581557e0 con 0x7fb758070d70 2023-07-06T21:57:57.027 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:57:57.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.032+0000 7fb75ebc5640 1 -- 172.21.15.55:0/3618045846 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb73c0663a0 msgr2=0x7fb73c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.032+0000 7fb75ebc5640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb73c0663a0 0x7fb73c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb74c0ae000 tx=0x7fb74c008040 comp rx=0 tx=0).stop 2023-07-06T21:57:57.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.032+0000 7fb75ebc5640 1 -- 172.21.15.55:0/3618045846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb758070d70 msgr2=0x7fb75806a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.032+0000 7fb75ebc5640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb758070d70 0x7fb75806a4a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fb74400e870 tx=0x7fb74400ec70 comp rx=0 tx=0).stop 2023-07-06T21:57:57.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.032+0000 7fb75ebc5640 1 -- 172.21.15.55:0/3618045846 shutdown_connections 2023-07-06T21:57:57.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.032+0000 7fb75ebc5640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb73c0663a0 0x7fb73c068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.032+0000 7fb75ebc5640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7580cbe60 0x7fb75815b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.032+0000 7fb75ebc5640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb758070d70 0x7fb75806a4a0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.032+0000 7fb75ebc5640 1 --2- 172.21.15.55:0/3618045846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7580709a0 0x7fb75809e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.032+0000 7fb75ebc5640 1 -- 172.21.15.55:0/3618045846 >> 172.21.15.55:0/3618045846 conn(0x7fb7580cea70 msgr2=0x7fb7580ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:57.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.032+0000 7fb75ebc5640 1 -- 172.21.15.55:0/3618045846 shutdown_connections 2023-07-06T21:57:57.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.032+0000 7fb75ebc5640 1 -- 172.21.15.55:0/3618045846 wait complete. 2023-07-06T21:57:57.048 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:57:57.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7feda53a3640 1 Processor -- start 2023-07-06T21:57:57.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7feda53a3640 1 -- start start 2023-07-06T21:57:57.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7feda53a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feda0156180 0x7feda00ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7feda53a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feda006e9d0 0x7feda006ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7feda53a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda006f360 con 0x7feda00cb7a0 2023-07-06T21:57:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7feda53a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda0160250 con 0x7feda006e9d0 2023-07-06T21:57:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7feda53a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda00cc310 con 0x7feda0156180 2023-07-06T21:57:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7fed97fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feda006e9d0 0x7feda006ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7fed9f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feda00cb7a0 0x7feda00cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58896/0 (socket says 172.21.15.55:58896) 2023-07-06T21:57:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7fed9f7fe640 1 -- 172.21.15.55:0/2488601085 learned_addr learned my addr 172.21.15.55:0/2488601085 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:57.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7fed9effd640 1 --2- 172.21.15.55:0/2488601085 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feda0156180 0x7feda00ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7fed9e7fc640 1 -- 172.21.15.55:0/2488601085 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046931676 0 0) 0x7fed980014a0 con 0x7feda00cb7a0 2023-07-06T21:57:57.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7fed9e7fc640 1 -- 172.21.15.55:0/2488601085 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed8c003530 con 0x7feda00cb7a0 2023-07-06T21:57:57.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7fed97fff640 1 -- 172.21.15.55:0/2488601085 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feda0156180 msgr2=0x7feda00ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:57.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7fed97fff640 1 --2- 172.21.15.55:0/2488601085 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feda0156180 0x7feda00ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7fed97fff640 1 -- 172.21.15.55:0/2488601085 >> v1:172.21.15.55:6789/0 conn(0x7feda00cb7a0 legacy=0x7feda00cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7fed97fff640 1 -- 172.21.15.55:0/2488601085 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda015f5d0 con 0x7feda006e9d0 2023-07-06T21:57:57.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.196+0000 7fed9effd640 1 --2- 172.21.15.55:0/2488601085 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feda0156180 0x7feda00ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:57:57.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.200+0000 7fed97fff640 1 --2- 172.21.15.55:0/2488601085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feda006e9d0 0x7feda006ee20 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fed880097c0 tx=0x7fed8801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac1545e8a1118b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:57.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.200+0000 7fed9e7fc640 1 -- 172.21.15.55:0/2488601085 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed880ac620 con 0x7feda006e9d0 2023-07-06T21:57:57.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.200+0000 7fed9e7fc640 1 -- 172.21.15.55:0/2488601085 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed880ac780 con 0x7feda006e9d0 2023-07-06T21:57:57.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.200+0000 7fed9e7fc640 1 -- 172.21.15.55:0/2488601085 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed880acb10 con 0x7feda006e9d0 2023-07-06T21:57:57.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.200+0000 7feda53a3640 1 -- 172.21.15.55:0/2488601085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feda006e9d0 msgr2=0x7feda006ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.200+0000 7feda53a3640 1 --2- 172.21.15.55:0/2488601085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feda006e9d0 0x7feda006ee20 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fed880097c0 tx=0x7fed8801c3c0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.200+0000 7feda53a3640 1 -- 172.21.15.55:0/2488601085 shutdown_connections 2023-07-06T21:57:57.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.200+0000 7feda53a3640 1 --2- 172.21.15.55:0/2488601085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feda006e9d0 0x7feda006ee20 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.200+0000 7feda53a3640 1 --2- 172.21.15.55:0/2488601085 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feda0156180 0x7feda00ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.200+0000 7feda53a3640 1 -- 172.21.15.55:0/2488601085 >> 172.21.15.55:0/2488601085 conn(0x7feda00d0c50 msgr2=0x7feda00cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:57.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.200+0000 7feda53a3640 1 -- 172.21.15.55:0/2488601085 shutdown_connections 2023-07-06T21:57:57.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.200+0000 7feda53a3640 1 -- 172.21.15.55:0/2488601085 wait complete. 2023-07-06T21:57:57.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7feda53a3640 1 Processor -- start 2023-07-06T21:57:57.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7feda53a3640 1 -- start start 2023-07-06T21:57:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7feda53a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feda006e9d0 0x7feda00c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7feda53a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feda00cb7a0 0x7feda014d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7feda53a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feda0156180 0x7feda014e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7feda53a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda0148d90 con 0x7feda00cb7a0 2023-07-06T21:57:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7feda53a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda0149560 con 0x7feda0156180 2023-07-06T21:57:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7feda53a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda00c5af0 con 0x7feda006e9d0 2023-07-06T21:57:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed97fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feda00cb7a0 0x7feda014d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed97fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feda00cb7a0 0x7feda014d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51308/0 (socket says 172.21.15.55:51308) 2023-07-06T21:57:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed97fff640 1 -- 172.21.15.55:0/1326362344 learned_addr learned my addr 172.21.15.55:0/1326362344 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed9f7fe640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feda0156180 0x7feda014e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed9effd640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feda006e9d0 0x7feda00c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed97fff640 1 -- 172.21.15.55:0/1326362344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feda006e9d0 msgr2=0x7feda00c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed97fff640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feda006e9d0 0x7feda00c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed97fff640 1 -- 172.21.15.55:0/1326362344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feda0156180 msgr2=0x7feda014e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed97fff640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feda0156180 0x7feda014e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed97fff640 1 -- 172.21.15.55:0/1326362344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90009420 con 0x7feda00cb7a0 2023-07-06T21:57:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed9f7fe640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feda0156180 0x7feda014e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:57.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed97fff640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feda00cb7a0 0x7feda014d460 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fed880af040 tx=0x7fed88019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:57.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed977fe640 1 -- 172.21.15.55:0/1326362344 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed880ac620 con 0x7feda00cb7a0 2023-07-06T21:57:57.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed977fe640 1 -- 172.21.15.55:0/1326362344 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed880b5410 con 0x7feda00cb7a0 2023-07-06T21:57:57.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7feda53a3640 1 -- 172.21.15.55:0/1326362344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed88009420 con 0x7feda00cb7a0 2023-07-06T21:57:57.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7fed977fe640 1 -- 172.21.15.55:0/1326362344 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed880b57e0 con 0x7feda00cb7a0 2023-07-06T21:57:57.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.204+0000 7feda53a3640 1 -- 172.21.15.55:0/1326362344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda00c4030 con 0x7feda00cb7a0 2023-07-06T21:57:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.208+0000 7feda53a3640 1 -- 172.21.15.55:0/1326362344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda00c5c80 con 0x7feda00cb7a0 2023-07-06T21:57:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.208+0000 7fed977fe640 1 -- 172.21.15.55:0/1326362344 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed880b3040 con 0x7feda00cb7a0 2023-07-06T21:57:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.208+0000 7fed977fe640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fed800663a0 0x7fed80068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.208+0000 7fed977fe640 1 -- 172.21.15.55:0/1326362344 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fed8811dc50 con 0x7feda00cb7a0 2023-07-06T21:57:57.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.208+0000 7fed9effd640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fed800663a0 0x7fed80068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.208+0000 7fed9effd640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fed800663a0 0x7fed80068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fed90009c50 tx=0x7fed90009190 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:57.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.212+0000 7fed977fe640 1 -- 172.21.15.55:0/1326362344 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed880eb020 con 0x7feda00cb7a0 2023-07-06T21:57:57.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.364+0000 7feda53a3640 1 -- 172.21.15.55:0/1326362344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feda0066d60 con 0x7feda00cb7a0 2023-07-06T21:57:57.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.368+0000 7fed977fe640 1 -- 172.21.15.55:0/1326362344 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v99) v1 ==== 92+0+10 (secure 0 0 0) 0x7fed880ee640 con 0x7feda00cb7a0 2023-07-06T21:57:57.365 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:57:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.368+0000 7feda53a3640 1 -- 172.21.15.55:0/1326362344 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fed800663a0 msgr2=0x7fed80068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.368+0000 7feda53a3640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fed800663a0 0x7fed80068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fed90009c50 tx=0x7fed90009190 comp rx=0 tx=0).stop 2023-07-06T21:57:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.368+0000 7feda53a3640 1 -- 172.21.15.55:0/1326362344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feda00cb7a0 msgr2=0x7feda014d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.368+0000 7feda53a3640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feda00cb7a0 0x7feda014d460 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fed880af040 tx=0x7fed88019160 comp rx=0 tx=0).stop 2023-07-06T21:57:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.368+0000 7feda53a3640 1 -- 172.21.15.55:0/1326362344 shutdown_connections 2023-07-06T21:57:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.368+0000 7feda53a3640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feda0156180 0x7feda014e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.368+0000 7feda53a3640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feda00cb7a0 0x7feda014d460 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.368+0000 7feda53a3640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fed800663a0 0x7fed80068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.368+0000 7feda53a3640 1 --2- 172.21.15.55:0/1326362344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feda006e9d0 0x7feda00c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.368+0000 7feda53a3640 1 -- 172.21.15.55:0/1326362344 >> 172.21.15.55:0/1326362344 conn(0x7feda00d0c50 msgr2=0x7feda00cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.368+0000 7feda53a3640 1 -- 172.21.15.55:0/1326362344 shutdown_connections 2023-07-06T21:57:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.368+0000 7feda53a3640 1 -- 172.21.15.55:0/1326362344 wait complete. 2023-07-06T21:57:57.386 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T21:57:57.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f0899a34640 1 Processor -- start 2023-07-06T21:57:57.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f0899a34640 1 -- start start 2023-07-06T21:57:57.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f0899a34640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f08940d15f0 0x7f08940b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f0899a34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08940cccf0 con 0x7f08940b78a0 2023-07-06T21:57:57.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f0899a34640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08940b7c70 con 0x7f08940b4080 2023-07-06T21:57:57.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f0899a34640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08940b23c0 con 0x7f08940d15f0 2023-07-06T21:57:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f0892ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f08940b78a0 0x7f08940ce310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58906/0 (socket says 172.21.15.55:58906) 2023-07-06T21:57:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f0892ffd640 1 -- 172.21.15.55:0/1157357693 learned_addr learned my addr 172.21.15.55:0/1157357693 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:57.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f08927fc640 1 --2- 172.21.15.55:0/1157357693 >> v2:172.21.15.138:3300/0 conn(0x7f08940d15f0 0x7f08940b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f0891ffb640 1 -- 172.21.15.55:0/1157357693 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404571166 0 0) 0x7f08940cccf0 con 0x7f08940b78a0 2023-07-06T21:57:57.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f0891ffb640 1 -- 172.21.15.55:0/1157357693 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f087c003530 con 0x7f08940b78a0 2023-07-06T21:57:57.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f0891ffb640 1 -- 172.21.15.55:0/1157357693 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401767237 0 0) 0x7f08940b7c70 con 0x7f08940b4080 2023-07-06T21:57:57.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f0891ffb640 1 -- 172.21.15.55:0/1157357693 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08940cccf0 con 0x7f08940b4080 2023-07-06T21:57:57.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f0891ffb640 1 -- 172.21.15.55:0/1157357693 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 304599794 0 0) 0x7f087c003530 con 0x7f08940b78a0 2023-07-06T21:57:57.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f08927fc640 1 -- 172.21.15.55:0/1157357693 >> v1:172.21.15.138:6789/0 conn(0x7f08940b4080 legacy=0x7f08940cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f08927fc640 1 -- 172.21.15.55:0/1157357693 >> v1:172.21.15.55:6789/0 conn(0x7f08940b78a0 legacy=0x7f08940ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.532+0000 7f08927fc640 1 -- 172.21.15.55:0/1157357693 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08940b25d0 con 0x7f08940d15f0 2023-07-06T21:57:57.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.536+0000 7f08927fc640 1 --2- 172.21.15.55:0/1157357693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08940d15f0 0x7f08940b3b40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f08880097c0 tx=0x7f088801c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eb467f51159c326 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:57.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.536+0000 7f0891ffb640 1 -- 172.21.15.55:0/1157357693 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0884001680 con 0x7f08940d15f0 2023-07-06T21:57:57.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.536+0000 7f0891ffb640 1 -- 172.21.15.55:0/1157357693 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08880a7050 con 0x7f08940d15f0 2023-07-06T21:57:57.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.536+0000 7f0891ffb640 1 -- 172.21.15.55:0/1157357693 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08880ab620 con 0x7f08940d15f0 2023-07-06T21:57:57.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.536+0000 7f0899a34640 1 -- 172.21.15.55:0/1157357693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08940d15f0 msgr2=0x7f08940b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.536+0000 7f0899a34640 1 --2- 172.21.15.55:0/1157357693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08940d15f0 0x7f08940b3b40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f08880097c0 tx=0x7f088801c280 comp rx=0 tx=0).stop 2023-07-06T21:57:57.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.536+0000 7f0899a34640 1 -- 172.21.15.55:0/1157357693 shutdown_connections 2023-07-06T21:57:57.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.536+0000 7f0899a34640 1 --2- 172.21.15.55:0/1157357693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08940d15f0 0x7f08940b3b40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.536+0000 7f0899a34640 1 -- 172.21.15.55:0/1157357693 >> 172.21.15.55:0/1157357693 conn(0x7f08940cead0 msgr2=0x7f08940ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:57.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.536+0000 7f0899a34640 1 -- 172.21.15.55:0/1157357693 shutdown_connections 2023-07-06T21:57:57.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.536+0000 7f0899a34640 1 -- 172.21.15.55:0/1157357693 wait complete. 2023-07-06T21:57:57.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f0899a34640 1 Processor -- start 2023-07-06T21:57:57.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f0899a34640 1 -- start start 2023-07-06T21:57:57.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f0899a34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08940b4080 0x7f089415e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f0899a34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08940b78a0 0x7f08941f3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f0899a34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08940d15f0 0x7f08940c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f0899a34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08940cadb0 con 0x7f08940b78a0 2023-07-06T21:57:57.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f0899a34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08940ca210 con 0x7f08940d15f0 2023-07-06T21:57:57.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f0899a34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089415ed60 con 0x7f08940b4080 2023-07-06T21:57:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f08927fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08940b78a0 0x7f08941f3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f08927fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08940b78a0 0x7f08941f3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51316/0 (socket says 172.21.15.55:51316) 2023-07-06T21:57:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f08927fc640 1 -- 172.21.15.55:0/6345196 learned_addr learned my addr 172.21.15.55:0/6345196 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f0892ffd640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08940b4080 0x7f089415e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f08937fe640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08940d15f0 0x7f08940c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f08927fc640 1 -- 172.21.15.55:0/6345196 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08940b4080 msgr2=0x7f089415e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f08927fc640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08940b4080 0x7f089415e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f08927fc640 1 -- 172.21.15.55:0/6345196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08940d15f0 msgr2=0x7f08940c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f08927fc640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08940d15f0 0x7f08940c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f08927fc640 1 -- 172.21.15.55:0/6345196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0888009420 con 0x7f08940b78a0 2023-07-06T21:57:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f08937fe640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08940d15f0 0x7f08940c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f08927fc640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08940b78a0 0x7f08941f3e70 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f08880097c0 tx=0x7f088801aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f087bfff640 1 -- 172.21.15.55:0/6345196 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08880abcf0 con 0x7f08940b78a0 2023-07-06T21:57:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f087bfff640 1 -- 172.21.15.55:0/6345196 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08880abe50 con 0x7f08940b78a0 2023-07-06T21:57:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f0899a34640 1 -- 172.21.15.55:0/6345196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08940ca480 con 0x7f08940b78a0 2023-07-06T21:57:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f087bfff640 1 -- 172.21.15.55:0/6345196 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888004220 con 0x7f08940b78a0 2023-07-06T21:57:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.540+0000 7f0899a34640 1 -- 172.21.15.55:0/6345196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08940caa40 con 0x7f08940b78a0 2023-07-06T21:57:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.544+0000 7f0899a34640 1 -- 172.21.15.55:0/6345196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08940caf60 con 0x7f08940b78a0 2023-07-06T21:57:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.544+0000 7f087bfff640 1 -- 172.21.15.55:0/6345196 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0888004380 con 0x7f08940b78a0 2023-07-06T21:57:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.544+0000 7f087bfff640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f08800663d0 0x7f0880068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.544+0000 7f087bfff640 1 -- 172.21.15.55:0/6345196 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f088811e3e0 con 0x7f08940b78a0 2023-07-06T21:57:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.544+0000 7f0892ffd640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f08800663d0 0x7f0880068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.544+0000 7f0892ffd640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f08800663d0 0x7f0880068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0884000f70 tx=0x7f0884009040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.548+0000 7f087bfff640 1 -- 172.21.15.55:0/6345196 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08940caf60 con 0x7f08940b78a0 2023-07-06T21:57:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.704+0000 7f0899a34640 1 -- 172.21.15.55:0/6345196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f08940caf60 con 0x7f08940b78a0 2023-07-06T21:57:57.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.704+0000 7f087bfff640 1 -- 172.21.15.55:0/6345196 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v99) v1 ==== 84+0+126 (secure 0 0 0) 0x7f08940caf60 con 0x7f08940b78a0 2023-07-06T21:57:57.703 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:57:57.703 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T21:57:57.704 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:57.704 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-07-06T21:57:57.704 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-07-06T21:57:57.704 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:57:57.704 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:57:57.704 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-07-06T21:57:57.704 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-07-06T21:57:57.705 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:57:57.705 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T21:57:57.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.708+0000 7f0899a34640 1 -- 172.21.15.55:0/6345196 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f08800663d0 msgr2=0x7f0880068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.708+0000 7f0899a34640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f08800663d0 0x7f0880068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0884000f70 tx=0x7f0884009040 comp rx=0 tx=0).stop 2023-07-06T21:57:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.708+0000 7f0899a34640 1 -- 172.21.15.55:0/6345196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08940b78a0 msgr2=0x7f08941f3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.708+0000 7f0899a34640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08940b78a0 0x7f08941f3e70 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f08880097c0 tx=0x7f088801aac0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.708+0000 7f0899a34640 1 -- 172.21.15.55:0/6345196 shutdown_connections 2023-07-06T21:57:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.708+0000 7f0899a34640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08940d15f0 0x7f08940c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.708+0000 7f0899a34640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08940b78a0 0x7f08941f3e70 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.708+0000 7f0899a34640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f08800663d0 0x7f0880068880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.708+0000 7f0899a34640 1 --2- 172.21.15.55:0/6345196 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08940b4080 0x7f089415e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.708+0000 7f0899a34640 1 -- 172.21.15.55:0/6345196 >> 172.21.15.55:0/6345196 conn(0x7f08940cead0 msgr2=0x7f08940b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.708+0000 7f0899a34640 1 -- 172.21.15.55:0/6345196 shutdown_connections 2023-07-06T21:57:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.708+0000 7f0899a34640 1 -- 172.21.15.55:0/6345196 wait complete. 2023-07-06T21:57:57.724 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T21:57:57.724 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T21:57:57.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.872+0000 7ff3a065c640 1 Processor -- start 2023-07-06T21:57:57.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.872+0000 7ff3a065c640 1 -- start start 2023-07-06T21:57:57.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff3a065c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff3980b18a0 0x7ff3980ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff3a065c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff3980d1d30 0x7ff3980cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff3a065c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3980ccd50 con 0x7ff3980b3c90 2023-07-06T21:57:57.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff3a065c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3980cd0a0 con 0x7ff3980d1d30 2023-07-06T21:57:57.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff3a065c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff398069ea0 con 0x7ff3980b18a0 2023-07-06T21:57:57.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff39e3f8640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff3980b3c90 0x7ff3980b4060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58908/0 (socket says 172.21.15.55:58908) 2023-07-06T21:57:57.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff39e3f8640 1 -- 172.21.15.55:0/2134625888 learned_addr learned my addr 172.21.15.55:0/2134625888 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:57.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff39ebf9640 1 --2- 172.21.15.55:0/2134625888 >> v2:172.21.15.55:3300/0 conn(0x7ff3980d1d30 0x7ff3980cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff39dbf7640 1 --2- 172.21.15.55:0/2134625888 >> v2:172.21.15.138:3300/0 conn(0x7ff3980b18a0 0x7ff3980ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff39d3f6640 1 -- 172.21.15.55:0/2134625888 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567059526 0 0) 0x7ff3980ccd50 con 0x7ff3980b3c90 2023-07-06T21:57:57.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff39d3f6640 1 -- 172.21.15.55:0/2134625888 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff384003530 con 0x7ff3980b3c90 2023-07-06T21:57:57.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff39ebf9640 1 -- 172.21.15.55:0/2134625888 >> v2:172.21.15.138:3300/0 conn(0x7ff3980b18a0 msgr2=0x7ff3980ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:57.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff39ebf9640 1 --2- 172.21.15.55:0/2134625888 >> v2:172.21.15.138:3300/0 conn(0x7ff3980b18a0 0x7ff3980ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff39ebf9640 1 -- 172.21.15.55:0/2134625888 >> v1:172.21.15.55:6789/0 conn(0x7ff3980b3c90 legacy=0x7ff3980b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.876+0000 7ff39ebf9640 1 -- 172.21.15.55:0/2134625888 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39806a140 con 0x7ff3980d1d30 2023-07-06T21:57:57.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff39ebf9640 1 --2- 172.21.15.55:0/2134625888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3980d1d30 0x7ff3980cfee0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7ff3980b4e00 tx=0x7ff39001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e889a361a998f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:57.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff39d3f6640 1 -- 172.21.15.55:0/2134625888 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3900a59c0 con 0x7ff3980d1d30 2023-07-06T21:57:57.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff39d3f6640 1 -- 172.21.15.55:0/2134625888 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3900a5b20 con 0x7ff3980d1d30 2023-07-06T21:57:57.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff39d3f6640 1 -- 172.21.15.55:0/2134625888 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3900ad440 con 0x7ff3980d1d30 2023-07-06T21:57:57.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff3a065c640 1 -- 172.21.15.55:0/2134625888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3980d1d30 msgr2=0x7ff3980cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff3a065c640 1 --2- 172.21.15.55:0/2134625888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3980d1d30 0x7ff3980cfee0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7ff3980b4e00 tx=0x7ff39001c8e0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff3a065c640 1 -- 172.21.15.55:0/2134625888 shutdown_connections 2023-07-06T21:57:57.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff3a065c640 1 --2- 172.21.15.55:0/2134625888 >> v2:172.21.15.138:3300/0 conn(0x7ff3980b18a0 0x7ff3980ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff3a065c640 1 --2- 172.21.15.55:0/2134625888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3980d1d30 0x7ff3980cfee0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff3a065c640 1 -- 172.21.15.55:0/2134625888 >> 172.21.15.55:0/2134625888 conn(0x7ff39806bf40 msgr2=0x7ff3980cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:57.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff3a065c640 1 -- 172.21.15.55:0/2134625888 shutdown_connections 2023-07-06T21:57:57.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff3a065c640 1 -- 172.21.15.55:0/2134625888 wait complete. 2023-07-06T21:57:57.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff3a065c640 1 Processor -- start 2023-07-06T21:57:57.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff3a065c640 1 -- start start 2023-07-06T21:57:57.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff3a065c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3980b18a0 0x7ff3980c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.880+0000 7ff3a065c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3980b3c90 0x7ff398149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff3a065c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3980d1d30 0x7ff3980b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff3a065c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff398149c50 con 0x7ff3980b18a0 2023-07-06T21:57:57.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff3a065c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3981515f0 con 0x7ff3980d1d30 2023-07-06T21:57:57.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff3a065c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff398150cc0 con 0x7ff3980b3c90 2023-07-06T21:57:57.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff39e3f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3980b18a0 0x7ff3980c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff39e3f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3980b18a0 0x7ff3980c5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51332/0 (socket says 172.21.15.55:51332) 2023-07-06T21:57:57.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff39e3f8640 1 -- 172.21.15.55:0/670113021 learned_addr learned my addr 172.21.15.55:0/670113021 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff39ebf9640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3980d1d30 0x7ff3980b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff39dbf7640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3980b3c90 0x7ff398149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff39e3f8640 1 -- 172.21.15.55:0/670113021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3980b3c90 msgr2=0x7ff398149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff39e3f8640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3980b3c90 0x7ff398149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff39e3f8640 1 -- 172.21.15.55:0/670113021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3980d1d30 msgr2=0x7ff3980b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff39e3f8640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3980d1d30 0x7ff3980b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff39e3f8640 1 -- 172.21.15.55:0/670113021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff390009a70 con 0x7ff3980b18a0 2023-07-06T21:57:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff39dbf7640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3980b3c90 0x7ff398149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:57:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff39e3f8640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3980b18a0 0x7ff3980c5d00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ff39400c4d0 tx=0x7ff39400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff38effd640 1 -- 172.21.15.55:0/670113021 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394005cf0 con 0x7ff3980b18a0 2023-07-06T21:57:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff38effd640 1 -- 172.21.15.55:0/670113021 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff394005e50 con 0x7ff3980b18a0 2023-07-06T21:57:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff3a065c640 1 -- 172.21.15.55:0/670113021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff398150fa0 con 0x7ff3980b18a0 2023-07-06T21:57:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff38effd640 1 -- 172.21.15.55:0/670113021 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394007270 con 0x7ff3980b18a0 2023-07-06T21:57:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff3a065c640 1 -- 172.21.15.55:0/670113021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff398152d20 con 0x7ff3980b18a0 2023-07-06T21:57:57.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff3a065c640 1 -- 172.21.15.55:0/670113021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff398066d60 con 0x7ff3980b18a0 2023-07-06T21:57:57.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.884+0000 7ff38effd640 1 -- 172.21.15.55:0/670113021 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff3940073d0 con 0x7ff3980b18a0 2023-07-06T21:57:57.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.888+0000 7ff38effd640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff37c0663d0 0x7ff37c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:57.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.888+0000 7ff38effd640 1 -- 172.21.15.55:0/670113021 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff394083160 con 0x7ff3980b18a0 2023-07-06T21:57:57.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.888+0000 7ff39dbf7640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff37c0663d0 0x7ff37c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:57.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.888+0000 7ff39dbf7640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff37c0663d0 0x7ff37c068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff39815f470 tx=0x7ff388008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:57.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:57.892+0000 7ff38effd640 1 -- 172.21.15.55:0/670113021 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff394050780 con 0x7ff3980b18a0 2023-07-06T21:57:58.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.044+0000 7ff3a065c640 1 -- 172.21.15.55:0/670113021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff39806ac30 con 0x7ff3980b18a0 2023-07-06T21:57:58.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.800+0000 7ff38effd640 1 -- 172.21.15.55:0/670113021 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v100) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff394053da0 con 0x7ff3980b18a0 2023-07-06T21:57:58.799 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-07-06T21:57:58.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.804+0000 7ff3a065c640 1 -- 172.21.15.55:0/670113021 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff37c0663d0 msgr2=0x7ff37c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:58.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.804+0000 7ff3a065c640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff37c0663d0 0x7ff37c068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff39815f470 tx=0x7ff388008040 comp rx=0 tx=0).stop 2023-07-06T21:57:58.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.804+0000 7ff3a065c640 1 -- 172.21.15.55:0/670113021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3980b18a0 msgr2=0x7ff3980c5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:58.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.804+0000 7ff3a065c640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3980b18a0 0x7ff3980c5d00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ff39400c4d0 tx=0x7ff39400c990 comp rx=0 tx=0).stop 2023-07-06T21:57:58.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.808+0000 7ff3a065c640 1 -- 172.21.15.55:0/670113021 shutdown_connections 2023-07-06T21:57:58.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.808+0000 7ff3a065c640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3980d1d30 0x7ff3980b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:58.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.808+0000 7ff3a065c640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff37c0663d0 0x7ff37c068880 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:58.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.808+0000 7ff3a065c640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3980b3c90 0x7ff398149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:58.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.808+0000 7ff3a065c640 1 --2- 172.21.15.55:0/670113021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3980b18a0 0x7ff3980c5d00 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:58.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.808+0000 7ff3a065c640 1 -- 172.21.15.55:0/670113021 >> 172.21.15.55:0/670113021 conn(0x7ff39806bf40 msgr2=0x7ff3980b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:58.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.808+0000 7ff3a065c640 1 -- 172.21.15.55:0/670113021 shutdown_connections 2023-07-06T21:57:58.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.812+0000 7ff3a065c640 1 -- 172.21.15.55:0/670113021 wait complete. 2023-07-06T21:57:58.832 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T21:57:58.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f42303c5640 1 Processor -- start 2023-07-06T21:57:58.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f42303c5640 1 -- start start 2023-07-06T21:57:58.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f42303c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4228159ad0 0x7f422806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:58.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f42303c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4228070770 0x7f422806b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:58.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f42303c5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42280b0d90 con 0x7f422806c380 2023-07-06T21:57:58.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f42303c5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42280c8620 con 0x7f4228159ad0 2023-07-06T21:57:58.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f42303c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4228070c50 con 0x7f4228070770 2023-07-06T21:57:58.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f422e161640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4228159ad0 0x7f422806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:58.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f422d960640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f422806c380 0x7f42280693f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58912/0 (socket says 172.21.15.55:58912) 2023-07-06T21:57:58.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f422d960640 1 -- 172.21.15.55:0/3481286703 learned_addr learned my addr 172.21.15.55:0/3481286703 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:57:58.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f422e962640 1 --2- 172.21.15.55:0/3481286703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4228070770 0x7f422806b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:58.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f422e161640 1 -- 172.21.15.55:0/3481286703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4228070770 msgr2=0x7f422806b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:57:58.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f422e161640 1 --2- 172.21.15.55:0/3481286703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4228070770 0x7f422806b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:58.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f422e161640 1 -- 172.21.15.55:0/3481286703 >> v1:172.21.15.55:6789/0 conn(0x7f422806c380 legacy=0x7f42280693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:58.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f422e161640 1 -- 172.21.15.55:0/3481286703 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228070f30 con 0x7f4228159ad0 2023-07-06T21:57:58.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.988+0000 7f422d15f640 1 -- 172.21.15.55:0/3481286703 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282555251 0 0) 0x7f42280b0d90 con 0x7f422806c380 2023-07-06T21:57:58.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.992+0000 7f422e161640 1 --2- 172.21.15.55:0/3481286703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4228159ad0 0x7f422806b2f0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f42240097c0 tx=0x7f422401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5ec7d6bfaa3cdb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:58.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.992+0000 7f422d15f640 1 -- 172.21.15.55:0/3481286703 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42240ac620 con 0x7f4228159ad0 2023-07-06T21:57:58.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.992+0000 7f422d15f640 1 -- 172.21.15.55:0/3481286703 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42240ac780 con 0x7f4228159ad0 2023-07-06T21:57:58.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.992+0000 7f422d15f640 1 -- 172.21.15.55:0/3481286703 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42240acb10 con 0x7f4228159ad0 2023-07-06T21:57:58.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.992+0000 7f42303c5640 1 -- 172.21.15.55:0/3481286703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4228159ad0 msgr2=0x7f422806b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:58.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.992+0000 7f42303c5640 1 --2- 172.21.15.55:0/3481286703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4228159ad0 0x7f422806b2f0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f42240097c0 tx=0x7f422401c3c0 comp rx=0 tx=0).stop 2023-07-06T21:57:58.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.992+0000 7f42303c5640 1 -- 172.21.15.55:0/3481286703 shutdown_connections 2023-07-06T21:57:58.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.992+0000 7f42303c5640 1 --2- 172.21.15.55:0/3481286703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4228070770 0x7f422806b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:58.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.992+0000 7f42303c5640 1 --2- 172.21.15.55:0/3481286703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4228159ad0 0x7f422806b2f0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:58.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.992+0000 7f42303c5640 1 -- 172.21.15.55:0/3481286703 >> 172.21.15.55:0/3481286703 conn(0x7f42280cdf40 msgr2=0x7f42280ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:58.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.992+0000 7f42303c5640 1 -- 172.21.15.55:0/3481286703 shutdown_connections 2023-07-06T21:57:58.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.992+0000 7f42303c5640 1 -- 172.21.15.55:0/3481286703 wait complete. 2023-07-06T21:57:58.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f42303c5640 1 Processor -- start 2023-07-06T21:57:58.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f42303c5640 1 -- start start 2023-07-06T21:57:58.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f42303c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422806c380 0x7f42280b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:58.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f42303c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4228070770 0x7f4228155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:58.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f42303c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4228159ad0 0x7f4228145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:58.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f42303c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4228146940 con 0x7f4228159ad0 2023-07-06T21:57:58.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f42303c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4228155d50 con 0x7f422806c380 2023-07-06T21:57:58.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f42303c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42280b2880 con 0x7f4228070770 2023-07-06T21:57:58.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f422e962640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4228159ad0 0x7f4228145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:58.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f422e962640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4228159ad0 0x7f4228145e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51350/0 (socket says 172.21.15.55:51350) 2023-07-06T21:57:58.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f422e962640 1 -- 172.21.15.55:0/1158610622 learned_addr learned my addr 172.21.15.55:0/1158610622 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:57:58.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f422d960640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4228070770 0x7f4228155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:58.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f422e161640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422806c380 0x7f42280b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:58.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f422e962640 1 -- 172.21.15.55:0/1158610622 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4228070770 msgr2=0x7f4228155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:58.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f422e962640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4228070770 0x7f4228155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:58.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f422e962640 1 -- 172.21.15.55:0/1158610622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422806c380 msgr2=0x7f42280b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:58.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f422e962640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422806c380 0x7f42280b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:58.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f422e962640 1 -- 172.21.15.55:0/1158610622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4224009420 con 0x7f4228159ad0 2023-07-06T21:57:58.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f422d960640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4228070770 0x7f4228155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:58.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f422e161640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422806c380 0x7f42280b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:57:58.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f422e962640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4228159ad0 0x7f4228145e50 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f422000efc0 tx=0x7f422000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:58.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f421effd640 1 -- 172.21.15.55:0/1158610622 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220009ca0 con 0x7f4228159ad0 2023-07-06T21:57:58.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f421effd640 1 -- 172.21.15.55:0/1158610622 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422000f040 con 0x7f4228159ad0 2023-07-06T21:57:58.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f421effd640 1 -- 172.21.15.55:0/1158610622 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42200146c0 con 0x7f4228159ad0 2023-07-06T21:57:58.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f42303c5640 1 -- 172.21.15.55:0/1158610622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4228146390 con 0x7f4228159ad0 2023-07-06T21:57:58.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:58.996+0000 7f42303c5640 1 -- 172.21.15.55:0/1158610622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42280b1f50 con 0x7f4228159ad0 2023-07-06T21:57:58.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.000+0000 7f42303c5640 1 -- 172.21.15.55:0/1158610622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42280b29f0 con 0x7f4228159ad0 2023-07-06T21:57:59.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.000+0000 7f421effd640 1 -- 172.21.15.55:0/1158610622 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4220014820 con 0x7f4228159ad0 2023-07-06T21:57:59.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.000+0000 7f421effd640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f420c0663a0 0x7f420c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:57:59.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.000+0000 7f421effd640 1 -- 172.21.15.55:0/1158610622 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f4220085290 con 0x7f4228159ad0 2023-07-06T21:57:59.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.000+0000 7f422e161640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f420c0663a0 0x7f420c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:57:59.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.004+0000 7f422e161640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f420c0663a0 0x7f420c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42240ae000 tx=0x7f42240a7000 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:57:59.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.004+0000 7f421effd640 1 -- 172.21.15.55:0/1158610622 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4220052670 con 0x7f4228159ad0 2023-07-06T21:57:59.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.160+0000 7f42303c5640 1 -- 172.21.15.55:0/1158610622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4228066d60 con 0x7f4228159ad0 2023-07-06T21:57:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.816+0000 7f421effd640 1 -- 172.21.15.55:0/1158610622 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v101) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4220055c90 con 0x7f4228159ad0 2023-07-06T21:57:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-07-06T21:57:59.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.824+0000 7f42303c5640 1 -- 172.21.15.55:0/1158610622 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f420c0663a0 msgr2=0x7f420c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:59.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.824+0000 7f42303c5640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f420c0663a0 0x7f420c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42240ae000 tx=0x7f42240a7000 comp rx=0 tx=0).stop 2023-07-06T21:57:59.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.824+0000 7f42303c5640 1 -- 172.21.15.55:0/1158610622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4228159ad0 msgr2=0x7f4228145e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:57:59.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.824+0000 7f42303c5640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4228159ad0 0x7f4228145e50 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f422000efc0 tx=0x7f422000c490 comp rx=0 tx=0).stop 2023-07-06T21:57:59.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.824+0000 7f42303c5640 1 -- 172.21.15.55:0/1158610622 shutdown_connections 2023-07-06T21:57:59.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.824+0000 7f42303c5640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4228159ad0 0x7f4228145e50 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:59.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.824+0000 7f42303c5640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f420c0663a0 0x7f420c068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:59.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.824+0000 7f42303c5640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4228070770 0x7f4228155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:59.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.824+0000 7f42303c5640 1 --2- 172.21.15.55:0/1158610622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422806c380 0x7f42280b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:57:59.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.824+0000 7f42303c5640 1 -- 172.21.15.55:0/1158610622 >> 172.21.15.55:0/1158610622 conn(0x7f42280cdf40 msgr2=0x7f42281579c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:57:59.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.832+0000 7f42303c5640 1 -- 172.21.15.55:0/1158610622 shutdown_connections 2023-07-06T21:57:59.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:57:59.832+0000 7f42303c5640 1 -- 172.21.15.55:0/1158610622 wait complete. 2023-07-06T21:57:59.860 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T21:58:00.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3dae47b640 1 Processor -- start 2023-07-06T21:58:00.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3dae47b640 1 -- start start 2023-07-06T21:58:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3dae47b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3da8070020 0x7f3da80ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3dae47b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da815fe80 con 0x7f3da815bb90 2023-07-06T21:58:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3dae47b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da815bf60 con 0x7f3da80cef40 2023-07-06T21:58:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3dae47b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da815f620 con 0x7f3da8070020 2023-07-06T21:58:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3da815bb90 0x7f3da806f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58928/0 (socket says 172.21.15.55:58928) 2023-07-06T21:58:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da7fff640 1 -- 172.21.15.55:0/2253272061 learned_addr learned my addr 172.21.15.55:0/2253272061 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:00.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da77fe640 1 --2- 172.21.15.55:0/2253272061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3da8070020 0x7f3da80ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 -- 172.21.15.55:0/2253272061 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731199700 0 0) 0x7f3da815fe80 con 0x7f3da815bb90 2023-07-06T21:58:00.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 -- 172.21.15.55:0/2253272061 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d90003530 con 0x7f3da815bb90 2023-07-06T21:58:00.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 -- 172.21.15.55:0/2253272061 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4140272529 0 0) 0x7f3d90003530 con 0x7f3da815bb90 2023-07-06T21:58:00.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 -- 172.21.15.55:0/2253272061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3da8070020 msgr2=0x7f3da80ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:00.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 --2- 172.21.15.55:0/2253272061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3da8070020 0x7f3da80ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 -- 172.21.15.55:0/2253272061 >> v1:172.21.15.138:6789/0 conn(0x7f3da80cef40 legacy=0x7f3da80c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 -- 172.21.15.55:0/2253272061 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da80cf440 con 0x7f3da815bb90 2023-07-06T21:58:00.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 -- 172.21.15.55:0/2253272061 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f3d98001680 con 0x7f3da815bb90 2023-07-06T21:58:00.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 -- 172.21.15.55:0/2253272061 >> v1:172.21.15.55:6789/0 conn(0x7f3da815bb90 legacy=0x7f3da806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 --2- 172.21.15.55:0/2253272061 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d900039b0 0x7f3d90003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 --2- 172.21.15.55:0/2253272061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d900047d0 0x7f3d90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 --2- 172.21.15.55:0/2253272061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3da8070020 0x7f3d90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 -- 172.21.15.55:0/2253272061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da815f620 con 0x7f3d900047d0 2023-07-06T21:58:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 -- 172.21.15.55:0/2253272061 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9000ba40 con 0x7f3d900039b0 2023-07-06T21:58:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.012+0000 7f3da6ffd640 1 -- 172.21.15.55:0/2253272061 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9000bbd0 con 0x7f3da8070020 2023-07-06T21:58:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3da77fe640 1 --2- 172.21.15.55:0/2253272061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d900047d0 0x7f3d90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3da7fff640 1 --2- 172.21.15.55:0/2253272061 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d900039b0 0x7f3d90003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3daca18640 1 --2- 172.21.15.55:0/2253272061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3da8070020 0x7f3d90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3da77fe640 1 -- 172.21.15.55:0/2253272061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3da8070020 msgr2=0x7f3d90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:00.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3da77fe640 1 --2- 172.21.15.55:0/2253272061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3da8070020 0x7f3d90005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3da77fe640 1 -- 172.21.15.55:0/2253272061 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d900039b0 msgr2=0x7f3d90003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:00.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3da77fe640 1 --2- 172.21.15.55:0/2253272061 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d900039b0 0x7f3d90003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3da77fe640 1 -- 172.21.15.55:0/2253272061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d90003530 con 0x7f3d900047d0 2023-07-06T21:58:00.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3daca18640 1 --2- 172.21.15.55:0/2253272061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3da8070020 0x7f3d90005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:00.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3da77fe640 1 --2- 172.21.15.55:0/2253272061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d900047d0 0x7f3d90004c40 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009ab0 tx=0x7f3d9c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10512fbe42e69af5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:00.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3da6ffd640 1 -- 172.21.15.55:0/2253272061 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c0a5520 con 0x7f3d900047d0 2023-07-06T21:58:00.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3da6ffd640 1 -- 172.21.15.55:0/2253272061 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c0a5680 con 0x7f3d900047d0 2023-07-06T21:58:00.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3da6ffd640 1 -- 172.21.15.55:0/2253272061 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c0a5a30 con 0x7f3d900047d0 2023-07-06T21:58:00.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3dae47b640 1 -- 172.21.15.55:0/2253272061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d900047d0 msgr2=0x7f3d90004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3dae47b640 1 --2- 172.21.15.55:0/2253272061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d900047d0 0x7f3d90004c40 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009ab0 tx=0x7f3d9c01ca30 comp rx=0 tx=0).stop 2023-07-06T21:58:00.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.016+0000 7f3daca18640 1 -- 172.21.15.55:0/2253272061 reap_dead start 2023-07-06T21:58:00.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3dae47b640 1 -- 172.21.15.55:0/2253272061 shutdown_connections 2023-07-06T21:58:00.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3dae47b640 1 -- 172.21.15.55:0/2253272061 >> 172.21.15.55:0/2253272061 conn(0x7f3da80cbd70 msgr2=0x7f3da80ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:00.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3dae47b640 1 -- 172.21.15.55:0/2253272061 shutdown_connections 2023-07-06T21:58:00.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3dae47b640 1 -- 172.21.15.55:0/2253272061 wait complete. 2023-07-06T21:58:00.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3dae47b640 1 Processor -- start 2023-07-06T21:58:00.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3dae47b640 1 -- start start 2023-07-06T21:58:00.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3dae47b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d900047d0 0x7f3da8150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3dae47b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3da815e320 0x7f3da80b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3dae47b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3da80b3ae0 0x7f3da8154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3dae47b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da8156c30 con 0x7f3d900047d0 2023-07-06T21:58:00.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3dae47b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da815d5f0 con 0x7f3da80b3ae0 2023-07-06T21:58:00.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3dae47b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80b3f50 con 0x7f3da815e320 2023-07-06T21:58:00.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3da7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d900047d0 0x7f3da8150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3da7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d900047d0 0x7f3da8150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51366/0 (socket says 172.21.15.55:51366) 2023-07-06T21:58:00.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3da7fff640 1 -- 172.21.15.55:0/2386583693 learned_addr learned my addr 172.21.15.55:0/2386583693 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:00.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3da77fe640 1 --2- 172.21.15.55:0/2386583693 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3da815e320 0x7f3da80b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3daca18640 1 --2- 172.21.15.55:0/2386583693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3da80b3ae0 0x7f3da8154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3da7fff640 1 -- 172.21.15.55:0/2386583693 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3da815e320 msgr2=0x7f3da80b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3da7fff640 1 --2- 172.21.15.55:0/2386583693 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3da815e320 0x7f3da80b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3da7fff640 1 -- 172.21.15.55:0/2386583693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3da80b3ae0 msgr2=0x7f3da8154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3da7fff640 1 --2- 172.21.15.55:0/2386583693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3da80b3ae0 0x7f3da8154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.020+0000 7f3da7fff640 1 -- 172.21.15.55:0/2386583693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da81556e0 con 0x7f3d900047d0 2023-07-06T21:58:00.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.024+0000 7f3da7fff640 1 --2- 172.21.15.55:0/2386583693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d900047d0 0x7f3da8150700 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3d980124c0 tx=0x7f3d980128c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.024+0000 7f3da4ff9640 1 -- 172.21.15.55:0/2386583693 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98014810 con 0x7f3d900047d0 2023-07-06T21:58:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.024+0000 7f3da4ff9640 1 -- 172.21.15.55:0/2386583693 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d98014970 con 0x7f3d900047d0 2023-07-06T21:58:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.024+0000 7f3da4ff9640 1 -- 172.21.15.55:0/2386583693 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98014d20 con 0x7f3d900047d0 2023-07-06T21:58:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.024+0000 7f3dae47b640 1 -- 172.21.15.55:0/2386583693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da815d840 con 0x7f3d900047d0 2023-07-06T21:58:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.024+0000 7f3dae47b640 1 -- 172.21.15.55:0/2386583693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da815de00 con 0x7f3d900047d0 2023-07-06T21:58:00.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.024+0000 7f3dae47b640 1 -- 172.21.15.55:0/2386583693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da8066d60 con 0x7f3d900047d0 2023-07-06T21:58:00.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.024+0000 7f3da4ff9640 1 -- 172.21.15.55:0/2386583693 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3d980153e0 con 0x7f3d900047d0 2023-07-06T21:58:00.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.024+0000 7f3da4ff9640 1 --2- 172.21.15.55:0/2386583693 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3d940663a0 0x7f3d94068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.028+0000 7f3da4ff9640 1 -- 172.21.15.55:0/2386583693 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f3d98086ad0 con 0x7f3d900047d0 2023-07-06T21:58:00.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.028+0000 7f3da77fe640 1 --2- 172.21.15.55:0/2386583693 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3d940663a0 0x7f3d94068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.028+0000 7f3da77fe640 1 --2- 172.21.15.55:0/2386583693 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3d940663a0 0x7f3d94068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0af000 tx=0x7f3d9c0046d0 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:00.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.028+0000 7f3da4ff9640 1 -- 172.21.15.55:0/2386583693 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3d98053e80 con 0x7f3d900047d0 2023-07-06T21:58:00.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.216+0000 7f3dae47b640 1 -- 172.21.15.55:0/2386583693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3da80b4620 con 0x7f3d900047d0 2023-07-06T21:58:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.228+0000 7f3da4ff9640 1 -- 172.21.15.55:0/2386583693 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3d980574a0 con 0x7f3d900047d0 2023-07-06T21:58:00.230 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 12 and data pool 13 2023-07-06T21:58:00.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.236+0000 7f3dae47b640 1 -- 172.21.15.55:0/2386583693 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3d940663a0 msgr2=0x7f3d94068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.236+0000 7f3dae47b640 1 --2- 172.21.15.55:0/2386583693 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3d940663a0 0x7f3d94068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0af000 tx=0x7f3d9c0046d0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.236+0000 7f3dae47b640 1 -- 172.21.15.55:0/2386583693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d900047d0 msgr2=0x7f3da8150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.236+0000 7f3dae47b640 1 --2- 172.21.15.55:0/2386583693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d900047d0 0x7f3da8150700 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3d980124c0 tx=0x7f3d980128c0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.240+0000 7f3dae47b640 1 -- 172.21.15.55:0/2386583693 shutdown_connections 2023-07-06T21:58:00.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.240+0000 7f3dae47b640 1 --2- 172.21.15.55:0/2386583693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3da80b3ae0 0x7f3da8154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.240+0000 7f3dae47b640 1 --2- 172.21.15.55:0/2386583693 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3d940663a0 0x7f3d94068850 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0af000 tx=0x7f3d9c0046d0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.240+0000 7f3dae47b640 1 --2- 172.21.15.55:0/2386583693 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3da815e320 0x7f3da80b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.240+0000 7f3dae47b640 1 --2- 172.21.15.55:0/2386583693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d900047d0 0x7f3da8150700 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.240+0000 7f3dae47b640 1 -- 172.21.15.55:0/2386583693 >> 172.21.15.55:0/2386583693 conn(0x7f3da80cbd70 msgr2=0x7f3da80b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:00.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.240+0000 7f3dae47b640 1 -- 172.21.15.55:0/2386583693 shutdown_connections 2023-07-06T21:58:00.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.248+0000 7f3dae47b640 1 -- 172.21.15.55:0/2386583693 wait complete. 2023-07-06T21:58:00.279 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:58:00.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c7c8ec640 1 Processor -- start 2023-07-06T21:58:00.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c7c8ec640 1 -- start start 2023-07-06T21:58:00.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c7c8ec640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6c780b7cd0 0x7f6c780ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c7c8ec640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c780b1fe0 0x7f6c7815f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c7c8ec640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c780cecf0 con 0x7f6c780ccab0 2023-07-06T21:58:00.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c7c8ec640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c780d2310 con 0x7f6c780b7cd0 2023-07-06T21:58:00.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c7c8ec640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c780b80a0 con 0x7f6c780b1fe0 2023-07-06T21:58:00.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c6ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6c780ccab0 0x7f6c780b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58934/0 (socket says 172.21.15.55:58934) 2023-07-06T21:58:00.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c6ffff640 1 -- 172.21.15.55:0/2294881962 learned_addr learned my addr 172.21.15.55:0/2294881962 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:00.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c76d9d640 1 --2- 172.21.15.55:0/2294881962 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c780b1fe0 0x7f6c7815f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c7659c640 1 --2- 172.21.15.55:0/2294881962 >> v2:172.21.15.138:3300/0 conn(0x7f6c780b7cd0 0x7f6c780ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c75d9b640 1 -- 172.21.15.55:0/2294881962 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497773640 0 0) 0x7f6c780cecf0 con 0x7f6c780ccab0 2023-07-06T21:58:00.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c75d9b640 1 -- 172.21.15.55:0/2294881962 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c64003530 con 0x7f6c780ccab0 2023-07-06T21:58:00.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c76d9d640 1 -- 172.21.15.55:0/2294881962 >> v2:172.21.15.138:3300/0 conn(0x7f6c780b7cd0 msgr2=0x7f6c780ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:00.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c76d9d640 1 --2- 172.21.15.55:0/2294881962 >> v2:172.21.15.138:3300/0 conn(0x7f6c780b7cd0 0x7f6c780ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c76d9d640 1 -- 172.21.15.55:0/2294881962 >> v1:172.21.15.55:6789/0 conn(0x7f6c780ccab0 legacy=0x7f6c780b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c76d9d640 1 -- 172.21.15.55:0/2294881962 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c780d1d90 con 0x7f6c780b1fe0 2023-07-06T21:58:00.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.424+0000 7f6c7659c640 1 --2- 172.21.15.55:0/2294881962 >> v2:172.21.15.138:3300/0 conn(0x7f6c780b7cd0 0x7f6c780ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:00.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.428+0000 7f6c76d9d640 1 --2- 172.21.15.55:0/2294881962 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c780b1fe0 0x7f6c7815f870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009d90 tx=0x7f6c7001c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62e700a84c1dd641 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:00.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.428+0000 7f6c75d9b640 1 -- 172.21.15.55:0/2294881962 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700a5780 con 0x7f6c780b1fe0 2023-07-06T21:58:00.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.428+0000 7f6c75d9b640 1 -- 172.21.15.55:0/2294881962 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c700a58e0 con 0x7f6c780b1fe0 2023-07-06T21:58:00.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.428+0000 7f6c75d9b640 1 -- 172.21.15.55:0/2294881962 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700a5c70 con 0x7f6c780b1fe0 2023-07-06T21:58:00.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.428+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2294881962 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c780b1fe0 msgr2=0x7f6c7815f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.428+0000 7f6c7c8ec640 1 --2- 172.21.15.55:0/2294881962 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c780b1fe0 0x7f6c7815f870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009d90 tx=0x7f6c7001c8c0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.428+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2294881962 shutdown_connections 2023-07-06T21:58:00.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.428+0000 7f6c7c8ec640 1 --2- 172.21.15.55:0/2294881962 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c780b1fe0 0x7f6c7815f870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.428+0000 7f6c7c8ec640 1 --2- 172.21.15.55:0/2294881962 >> v2:172.21.15.138:3300/0 conn(0x7f6c780b7cd0 0x7f6c780ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.428+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2294881962 >> 172.21.15.55:0/2294881962 conn(0x7f6c780ceee0 msgr2=0x7f6c780cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:00.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.428+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2294881962 shutdown_connections 2023-07-06T21:58:00.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.428+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2294881962 wait complete. 2023-07-06T21:58:00.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c7c8ec640 1 Processor -- start 2023-07-06T21:58:00.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c7c8ec640 1 -- start start 2023-07-06T21:58:00.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c7c8ec640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c780b1fe0 0x7f6c780b6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c7c8ec640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c780b7cd0 0x7f6c78157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c7c8ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c780ccab0 0x7f6c780cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c7c8ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c78157750 con 0x7f6c780ccab0 2023-07-06T21:58:00.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c7c8ec640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c78156eb0 con 0x7f6c780b1fe0 2023-07-06T21:58:00.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c7c8ec640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c78157190 con 0x7f6c780b7cd0 2023-07-06T21:58:00.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c76d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c780ccab0 0x7f6c780cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c76d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c780ccab0 0x7f6c780cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51372/0 (socket says 172.21.15.55:51372) 2023-07-06T21:58:00.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c76d9d640 1 -- 172.21.15.55:0/2341294354 learned_addr learned my addr 172.21.15.55:0/2341294354 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:00.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c6ffff640 1 --2- 172.21.15.55:0/2341294354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c780b7cd0 0x7f6c78157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c7659c640 1 --2- 172.21.15.55:0/2341294354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c780b1fe0 0x7f6c780b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c76d9d640 1 -- 172.21.15.55:0/2341294354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c780b7cd0 msgr2=0x7f6c78157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c76d9d640 1 --2- 172.21.15.55:0/2341294354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c780b7cd0 0x7f6c78157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c76d9d640 1 -- 172.21.15.55:0/2341294354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c780b1fe0 msgr2=0x7f6c780b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c76d9d640 1 --2- 172.21.15.55:0/2341294354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c780b1fe0 0x7f6c780b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c76d9d640 1 -- 172.21.15.55:0/2341294354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c68009420 con 0x7f6c780ccab0 2023-07-06T21:58:00.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c76d9d640 1 --2- 172.21.15.55:0/2341294354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c780ccab0 0x7f6c780cf2b0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f6c700b0040 tx=0x7f6c70019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:00.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c6effd640 1 -- 172.21.15.55:0/2341294354 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700b9650 con 0x7f6c780ccab0 2023-07-06T21:58:00.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c6effd640 1 -- 172.21.15.55:0/2341294354 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c700b97b0 con 0x7f6c780ccab0 2023-07-06T21:58:00.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c6effd640 1 -- 172.21.15.55:0/2341294354 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700b9b60 con 0x7f6c780ccab0 2023-07-06T21:58:00.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.432+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2341294354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c70009a70 con 0x7f6c780ccab0 2023-07-06T21:58:00.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.436+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2341294354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c78152c70 con 0x7f6c780ccab0 2023-07-06T21:58:00.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.436+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2341294354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c78066d60 con 0x7f6c780ccab0 2023-07-06T21:58:00.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.436+0000 7f6c6effd640 1 -- 172.21.15.55:0/2341294354 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6c700b9cc0 con 0x7f6c780ccab0 2023-07-06T21:58:00.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.436+0000 7f6c6effd640 1 --2- 172.21.15.55:0/2341294354 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6c580663a0 0x7f6c58068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.436+0000 7f6c6effd640 1 -- 172.21.15.55:0/2341294354 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6c7011ef80 con 0x7f6c780ccab0 2023-07-06T21:58:00.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.436+0000 7f6c7659c640 1 --2- 172.21.15.55:0/2341294354 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6c580663a0 0x7f6c58068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.436+0000 7f6c7659c640 1 --2- 172.21.15.55:0/2341294354 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6c580663a0 0x7f6c58068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009cf0 tx=0x7f6c68009190 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:00.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.440+0000 7f6c6effd640 1 -- 172.21.15.55:0/2341294354 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c700ec390 con 0x7f6c780ccab0 2023-07-06T21:58:00.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.596+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2341294354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c78071aa0 con 0x7f6c780ccab0 2023-07-06T21:58:00.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.600+0000 7f6c6effd640 1 -- 172.21.15.55:0/2341294354 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+18559 (secure 0 0 0) 0x7f6c700bd090 con 0x7f6c780ccab0 2023-07-06T21:58:00.598 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:00.598 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":102,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:58:00.220910+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:57:58.092354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-07-06T21:57:59.209040+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:58:00.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.600+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2341294354 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6c580663a0 msgr2=0x7f6c58068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.600+0000 7f6c7c8ec640 1 --2- 172.21.15.55:0/2341294354 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6c580663a0 0x7f6c58068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009cf0 tx=0x7f6c68009190 comp rx=0 tx=0).stop 2023-07-06T21:58:00.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.600+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2341294354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c780ccab0 msgr2=0x7f6c780cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.600+0000 7f6c7c8ec640 1 --2- 172.21.15.55:0/2341294354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c780ccab0 0x7f6c780cf2b0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f6c700b0040 tx=0x7f6c70019660 comp rx=0 tx=0).stop 2023-07-06T21:58:00.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.600+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2341294354 shutdown_connections 2023-07-06T21:58:00.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.600+0000 7f6c7c8ec640 1 --2- 172.21.15.55:0/2341294354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c780ccab0 0x7f6c780cf2b0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.600+0000 7f6c7c8ec640 1 --2- 172.21.15.55:0/2341294354 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6c580663a0 0x7f6c58068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.600+0000 7f6c7c8ec640 1 --2- 172.21.15.55:0/2341294354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c780b7cd0 0x7f6c78157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.600+0000 7f6c7c8ec640 1 --2- 172.21.15.55:0/2341294354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c780b1fe0 0x7f6c780b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.600+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2341294354 >> 172.21.15.55:0/2341294354 conn(0x7f6c780ceee0 msgr2=0x7f6c78069c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:00.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.600+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2341294354 shutdown_connections 2023-07-06T21:58:00.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.600+0000 7f6c7c8ec640 1 -- 172.21.15.55:0/2341294354 wait complete. 2023-07-06T21:58:00.619 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:58:00.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.764+0000 7fc1bcf11640 1 Processor -- start 2023-07-06T21:58:00.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.764+0000 7fc1bcf11640 1 -- start start 2023-07-06T21:58:00.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.764+0000 7fc1bcf11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1b815b9d0 0x7fc1b815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.764+0000 7fc1bcf11640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b806a160 con 0x7fc1b80b4420 2023-07-06T21:58:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.764+0000 7fc1bcf11640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b815bda0 con 0x7fc1b80ce340 2023-07-06T21:58:00.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.764+0000 7fc1bcf11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b8069590 con 0x7fc1b815b9d0 2023-07-06T21:58:00.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.764+0000 7fc1b659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1b815b9d0 0x7fc1b815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.764+0000 7fc1b6d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc1b80b4420 0x7fc1b815c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58940/0 (socket says 172.21.15.55:58940) 2023-07-06T21:58:00.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.764+0000 7fc1b6d9d640 1 -- 172.21.15.55:0/1148912079 learned_addr learned my addr 172.21.15.55:0/1148912079 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:00.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1b659c640 1 -- 172.21.15.55:0/1148912079 >> v1:172.21.15.138:6789/0 conn(0x7fc1b80ce340 legacy=0x7fc1b80b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1b659c640 1 -- 172.21.15.55:0/1148912079 >> v1:172.21.15.55:6789/0 conn(0x7fc1b80b4420 legacy=0x7fc1b815c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1b659c640 1 -- 172.21.15.55:0/1148912079 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b8069830 con 0x7fc1b815b9d0 2023-07-06T21:58:00.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1b559a640 1 -- 172.21.15.55:0/1148912079 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638173968 0 0) 0x7fc1b806a160 con 0x7fc1b80b4420 2023-07-06T21:58:00.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1b659c640 1 --2- 172.21.15.55:0/1148912079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b815b9d0 0x7fc1b815f4e0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80097c0 tx=0x7fc1a801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed61246553db9f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:00.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1b559a640 1 -- 172.21.15.55:0/1148912079 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80ab600 con 0x7fc1b815b9d0 2023-07-06T21:58:00.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1b559a640 1 -- 172.21.15.55:0/1148912079 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a80a7050 con 0x7fc1b815b9d0 2023-07-06T21:58:00.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1b559a640 1 -- 172.21.15.55:0/1148912079 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80ab980 con 0x7fc1b815b9d0 2023-07-06T21:58:00.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1bcf11640 1 -- 172.21.15.55:0/1148912079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b815b9d0 msgr2=0x7fc1b815f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1bcf11640 1 --2- 172.21.15.55:0/1148912079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b815b9d0 0x7fc1b815f4e0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80097c0 tx=0x7fc1a801c450 comp rx=0 tx=0).stop 2023-07-06T21:58:00.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1bcf11640 1 -- 172.21.15.55:0/1148912079 shutdown_connections 2023-07-06T21:58:00.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1bcf11640 1 --2- 172.21.15.55:0/1148912079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b815b9d0 0x7fc1b815f4e0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1bcf11640 1 -- 172.21.15.55:0/1148912079 >> 172.21.15.55:0/1148912079 conn(0x7fc1b80ced10 msgr2=0x7fc1b80cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:00.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1bcf11640 1 -- 172.21.15.55:0/1148912079 shutdown_connections 2023-07-06T21:58:00.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.768+0000 7fc1bcf11640 1 -- 172.21.15.55:0/1148912079 wait complete. 2023-07-06T21:58:00.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1bcf11640 1 Processor -- start 2023-07-06T21:58:00.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1bcf11640 1 -- start start 2023-07-06T21:58:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1bcf11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1b80b4420 0x7fc1b80c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1bcf11640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b80ce340 0x7fc1b80c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1bcf11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b815b9d0 0x7fc1b80c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1bcf11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b8157e20 con 0x7fc1b815b9d0 2023-07-06T21:58:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1bcf11640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80c6d80 con 0x7fc1b80ce340 2023-07-06T21:58:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1bcf11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80c77c0 con 0x7fc1b80b4420 2023-07-06T21:58:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1b6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b815b9d0 0x7fc1b80c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1b6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b815b9d0 0x7fc1b80c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51388/0 (socket says 172.21.15.55:51388) 2023-07-06T21:58:00.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1b6d9d640 1 -- 172.21.15.55:0/65776453 learned_addr learned my addr 172.21.15.55:0/65776453 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1b5d9b640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b80ce340 0x7fc1b80c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1b659c640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1b80b4420 0x7fc1b80c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1b6d9d640 1 -- 172.21.15.55:0/65776453 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1b80b4420 msgr2=0x7fc1b80c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1b6d9d640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1b80b4420 0x7fc1b80c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1b6d9d640 1 -- 172.21.15.55:0/65776453 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b80ce340 msgr2=0x7fc1b80c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1b6d9d640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b80ce340 0x7fc1b80c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1b6d9d640 1 -- 172.21.15.55:0/65776453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a8009420 con 0x7fc1b815b9d0 2023-07-06T21:58:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1b5d9b640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b80ce340 0x7fc1b80c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.772+0000 7fc1b6d9d640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b815b9d0 0x7fc1b80c6840 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000c7e0 tx=0x7fc1b000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:00.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.776+0000 7fc1a6ffd640 1 -- 172.21.15.55:0/65776453 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b000a640 con 0x7fc1b815b9d0 2023-07-06T21:58:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.776+0000 7fc1a6ffd640 1 -- 172.21.15.55:0/65776453 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b000a7a0 con 0x7fc1b815b9d0 2023-07-06T21:58:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.776+0000 7fc1a6ffd640 1 -- 172.21.15.55:0/65776453 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b000ab50 con 0x7fc1b815b9d0 2023-07-06T21:58:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.776+0000 7fc1bcf11640 1 -- 172.21.15.55:0/65776453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b8152410 con 0x7fc1b815b9d0 2023-07-06T21:58:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.776+0000 7fc1bcf11640 1 -- 172.21.15.55:0/65776453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b81529d0 con 0x7fc1b815b9d0 2023-07-06T21:58:00.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.776+0000 7fc1bcf11640 1 -- 172.21.15.55:0/65776453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b8157fd0 con 0x7fc1b815b9d0 2023-07-06T21:58:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.776+0000 7fc1a6ffd640 1 -- 172.21.15.55:0/65776453 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc1b000acb0 con 0x7fc1b815b9d0 2023-07-06T21:58:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.776+0000 7fc1a6ffd640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fc1980663a0 0x7fc198068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.776+0000 7fc1a6ffd640 1 -- 172.21.15.55:0/65776453 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc1b0083440 con 0x7fc1b815b9d0 2023-07-06T21:58:00.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.776+0000 7fc1b659c640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fc1980663a0 0x7fc198068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:00.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.780+0000 7fc1b659c640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fc1980663a0 0x7fc198068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80ad000 tx=0x7fc1a80a6000 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:00.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.780+0000 7fc1a6ffd640 1 -- 172.21.15.55:0/65776453 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc1b8157fd0 con 0x7fc1b815b9d0 2023-07-06T21:58:00.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.936+0000 7fc1bcf11640 1 -- 172.21.15.55:0/65776453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1b8157fd0 con 0x7fc1b815b9d0 2023-07-06T21:58:00.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.940+0000 7fc1a6ffd640 1 -- 172.21.15.55:0/65776453 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+18559 (secure 0 0 0) 0x7fc1b8157fd0 con 0x7fc1b815b9d0 2023-07-06T21:58:00.938 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:00.938 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":102,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:58:00.220910+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:57:58.092354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-07-06T21:57:59.209040+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:58:00.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.940+0000 7fc1bcf11640 1 -- 172.21.15.55:0/65776453 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fc1980663a0 msgr2=0x7fc198068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.940+0000 7fc1bcf11640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fc1980663a0 0x7fc198068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80ad000 tx=0x7fc1a80a6000 comp rx=0 tx=0).stop 2023-07-06T21:58:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.940+0000 7fc1bcf11640 1 -- 172.21.15.55:0/65776453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b815b9d0 msgr2=0x7fc1b80c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.940+0000 7fc1bcf11640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b815b9d0 0x7fc1b80c6840 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000c7e0 tx=0x7fc1b000cca0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.940+0000 7fc1bcf11640 1 -- 172.21.15.55:0/65776453 shutdown_connections 2023-07-06T21:58:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.940+0000 7fc1bcf11640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1b815b9d0 0x7fc1b80c6840 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.940+0000 7fc1bcf11640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1b80ce340 0x7fc1b80c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.940+0000 7fc1bcf11640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fc1980663a0 0x7fc198068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.940+0000 7fc1bcf11640 1 --2- 172.21.15.55:0/65776453 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1b80b4420 0x7fc1b80c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:00.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.940+0000 7fc1bcf11640 1 -- 172.21.15.55:0/65776453 >> 172.21.15.55:0/65776453 conn(0x7fc1b80ced10 msgr2=0x7fc1b8156700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:00.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.940+0000 7fc1bcf11640 1 -- 172.21.15.55:0/65776453 shutdown_connections 2023-07-06T21:58:00.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:00.940+0000 7fc1bcf11640 1 -- 172.21.15.55:0/65776453 wait complete. 2023-07-06T21:58:00.959 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T21:58:01.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.104+0000 7fb10f900640 1 Processor -- start 2023-07-06T21:58:01.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.108+0000 7fb10f900640 1 -- start start 2023-07-06T21:58:01.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.108+0000 7fb10f900640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb1080709a0 0x7fb1080cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:01.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.108+0000 7fb10f900640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1080cbe60 0x7fb1080b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:01.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.108+0000 7fb10f900640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1080cc300 con 0x7fb108070d70 2023-07-06T21:58:01.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.108+0000 7fb10f900640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1080cc5e0 con 0x7fb1080cbe60 2023-07-06T21:58:01.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.108+0000 7fb10f900640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1080cc8c0 con 0x7fb1080709a0 2023-07-06T21:58:01.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.108+0000 7fb10ce9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1080cbe60 0x7fb1080b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:01.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.108+0000 7fb10ce9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1080cbe60 0x7fb1080b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51392/0 (socket says 172.21.15.55:51392) 2023-07-06T21:58:01.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.108+0000 7fb10ce9b640 1 -- 172.21.15.55:0/2400379145 learned_addr learned my addr 172.21.15.55:0/2400379145 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:01.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.108+0000 7fb10d69c640 1 --2- 172.21.15.55:0/2400379145 >> v2:172.21.15.138:3300/0 conn(0x7fb1080709a0 0x7fb1080cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:01.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.108+0000 7fb10ce9b640 1 -- 172.21.15.55:0/2400379145 >> v2:172.21.15.138:3300/0 conn(0x7fb1080709a0 msgr2=0x7fb1080cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:01.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.108+0000 7fb10ce9b640 1 --2- 172.21.15.55:0/2400379145 >> v2:172.21.15.138:3300/0 conn(0x7fb1080709a0 0x7fb1080cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:01.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.108+0000 7fb10ce9b640 1 -- 172.21.15.55:0/2400379145 >> v1:172.21.15.138:6789/0 conn(0x7fb108070d70 legacy=0x7fb10815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:01.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.108+0000 7fb10ce9b640 1 -- 172.21.15.55:0/2400379145 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080ccba0 con 0x7fb1080cbe60 2023-07-06T21:58:01.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.112+0000 7fb10ce9b640 1 --2- 172.21.15.55:0/2400379145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1080cbe60 0x7fb1080b0c30 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fb10806ec60 tx=0x7fb0f801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2270af011e20bfea server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:01.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.112+0000 7fb0fffff640 1 -- 172.21.15.55:0/2400379145 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80ab600 con 0x7fb1080cbe60 2023-07-06T21:58:01.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.112+0000 7fb0fffff640 1 -- 172.21.15.55:0/2400379145 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f80a7050 con 0x7fb1080cbe60 2023-07-06T21:58:01.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.112+0000 7fb0fffff640 1 -- 172.21.15.55:0/2400379145 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80ab980 con 0x7fb1080cbe60 2023-07-06T21:58:01.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.112+0000 7fb10f900640 1 -- 172.21.15.55:0/2400379145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1080cbe60 msgr2=0x7fb1080b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:01.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.112+0000 7fb10f900640 1 --2- 172.21.15.55:0/2400379145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1080cbe60 0x7fb1080b0c30 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fb10806ec60 tx=0x7fb0f801c500 comp rx=0 tx=0).stop 2023-07-06T21:58:01.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.112+0000 7fb10f900640 1 -- 172.21.15.55:0/2400379145 shutdown_connections 2023-07-06T21:58:01.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.112+0000 7fb10f900640 1 --2- 172.21.15.55:0/2400379145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1080cbe60 0x7fb1080b0c30 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:01.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.112+0000 7fb10f900640 1 --2- 172.21.15.55:0/2400379145 >> v2:172.21.15.138:3300/0 conn(0x7fb1080709a0 0x7fb1080cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:01.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.112+0000 7fb10f900640 1 -- 172.21.15.55:0/2400379145 >> 172.21.15.55:0/2400379145 conn(0x7fb1080cea70 msgr2=0x7fb1080ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:01.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.112+0000 7fb10f900640 1 -- 172.21.15.55:0/2400379145 shutdown_connections 2023-07-06T21:58:01.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.112+0000 7fb10f900640 1 -- 172.21.15.55:0/2400379145 wait complete. 2023-07-06T21:58:01.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.112+0000 7fb10f900640 1 Processor -- start 2023-07-06T21:58:01.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.112+0000 7fb10f900640 1 -- start start 2023-07-06T21:58:01.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10f900640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1080709a0 0x7fb1080c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:01.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10f900640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb108070d70 0x7fb108158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:01.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10f900640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1080cbe60 0x7fb108155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:01.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10f900640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080bfdf0 con 0x7fb1080709a0 2023-07-06T21:58:01.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10f900640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080bf4c0 con 0x7fb108070d70 2023-07-06T21:58:01.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10f900640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080bf7a0 con 0x7fb1080cbe60 2023-07-06T21:58:01.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10d69c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1080709a0 0x7fb1080c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:01.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10d69c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1080709a0 0x7fb1080c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51400/0 (socket says 172.21.15.55:51400) 2023-07-06T21:58:01.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10d69c640 1 -- 172.21.15.55:0/1485865763 learned_addr learned my addr 172.21.15.55:0/1485865763 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:01.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10ce9b640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb108070d70 0x7fb108158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:01.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10de9d640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1080cbe60 0x7fb108155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:01.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10d69c640 1 -- 172.21.15.55:0/1485865763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1080cbe60 msgr2=0x7fb108155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:01.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10d69c640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1080cbe60 0x7fb108155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:01.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10d69c640 1 -- 172.21.15.55:0/1485865763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb108070d70 msgr2=0x7fb108158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:01.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10d69c640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb108070d70 0x7fb108158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:01.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10d69c640 1 -- 172.21.15.55:0/1485865763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f80094d0 con 0x7fb1080709a0 2023-07-06T21:58:01.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10de9d640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1080cbe60 0x7fb108155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:01.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10d69c640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1080709a0 0x7fb1080c9e30 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fb10400e930 tx=0x7fb10400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:01.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb0fdffb640 1 -- 172.21.15.55:0/1485865763 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb104009690 con 0x7fb1080709a0 2023-07-06T21:58:01.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb0fdffb640 1 -- 172.21.15.55:0/1485865763 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10400ca00 con 0x7fb1080709a0 2023-07-06T21:58:01.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb0fdffb640 1 -- 172.21.15.55:0/1485865763 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10400cd70 con 0x7fb1080709a0 2023-07-06T21:58:01.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10f900640 1 -- 172.21.15.55:0/1485865763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1080bfa80 con 0x7fb1080709a0 2023-07-06T21:58:01.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10f900640 1 -- 172.21.15.55:0/1485865763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb108155010 con 0x7fb1080709a0 2023-07-06T21:58:01.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb10f900640 1 -- 172.21.15.55:0/1485865763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb108066d60 con 0x7fb1080709a0 2023-07-06T21:58:01.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.116+0000 7fb0fdffb640 1 -- 172.21.15.55:0/1485865763 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb104013470 con 0x7fb1080709a0 2023-07-06T21:58:01.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.120+0000 7fb0fdffb640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb0ec0663a0 0x7fb0ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:01.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.120+0000 7fb0fdffb640 1 -- 172.21.15.55:0/1485865763 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb1040841d0 con 0x7fb1080709a0 2023-07-06T21:58:01.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.120+0000 7fb10ce9b640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb0ec0663a0 0x7fb0ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:01.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.120+0000 7fb10ce9b640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb0ec0663a0 0x7fb0ec068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80ad000 tx=0x7fb0f8008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:01.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.124+0000 7fb0fdffb640 1 -- 172.21.15.55:0/1485865763 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb104051570 con 0x7fb1080709a0 2023-07-06T21:58:01.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:01.312+0000 7fb10f900640 1 -- 172.21.15.55:0/1485865763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb1080c7e50 con 0x7fb1080709a0 2023-07-06T21:58:02.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.248+0000 7fb0fdffb640 1 -- 172.21.15.55:0/1485865763 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb104054b90 con 0x7fb1080709a0 2023-07-06T21:58:02.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.252+0000 7fb10f900640 1 -- 172.21.15.55:0/1485865763 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb0ec0663a0 msgr2=0x7fb0ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:02.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.252+0000 7fb10f900640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb0ec0663a0 0x7fb0ec068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80ad000 tx=0x7fb0f8008040 comp rx=0 tx=0).stop 2023-07-06T21:58:02.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.252+0000 7fb10f900640 1 -- 172.21.15.55:0/1485865763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1080709a0 msgr2=0x7fb1080c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:02.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.252+0000 7fb10f900640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1080709a0 0x7fb1080c9e30 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fb10400e930 tx=0x7fb10400edf0 comp rx=0 tx=0).stop 2023-07-06T21:58:02.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.252+0000 7fb10f900640 1 -- 172.21.15.55:0/1485865763 shutdown_connections 2023-07-06T21:58:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.252+0000 7fb10f900640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb0ec0663a0 0x7fb0ec068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.252+0000 7fb10f900640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1080cbe60 0x7fb108155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.252+0000 7fb10f900640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb108070d70 0x7fb108158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.252+0000 7fb10f900640 1 --2- 172.21.15.55:0/1485865763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1080709a0 0x7fb1080c9e30 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.252+0000 7fb10f900640 1 -- 172.21.15.55:0/1485865763 >> 172.21.15.55:0/1485865763 conn(0x7fb1080cea70 msgr2=0x7fb1080c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.252+0000 7fb10f900640 1 -- 172.21.15.55:0/1485865763 shutdown_connections 2023-07-06T21:58:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.252+0000 7fb10f900640 1 -- 172.21.15.55:0/1485865763 wait complete. 2023-07-06T21:58:02.271 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-06T21:58:02.272 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T21:58:02.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f1469dc5640 1 Processor -- start 2023-07-06T21:58:02.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f1469dc5640 1 -- start start 2023-07-06T21:58:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f1469dc5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f14640b7b90 0x7f14640d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f1469dc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14640b4300 0x7f14640b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f1469dc5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14640b5070 con 0x7f14640cc870 2023-07-06T21:58:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f1469dc5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1464160020 con 0x7f14640b7b90 2023-07-06T21:58:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f1469dc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14641604b0 con 0x7f14640b4300 2023-07-06T21:58:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f1462ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f14640cc870 0x7f14640b3bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58956/0 (socket says 172.21.15.55:58956) 2023-07-06T21:58:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f1462ffd640 1 -- 172.21.15.55:0/1662607690 learned_addr learned my addr 172.21.15.55:0/1662607690 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:02.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f14637fe640 1 --2- 172.21.15.55:0/1662607690 >> v2:172.21.15.138:3300/0 conn(0x7f14640b7b90 0x7f14640d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:02.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f1463fff640 1 --2- 172.21.15.55:0/1662607690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14640b4300 0x7f14640b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:02.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f14627fc640 1 -- 172.21.15.55:0/1662607690 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902200974 0 0) 0x7f14640b5070 con 0x7f14640cc870 2023-07-06T21:58:02.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f14627fc640 1 -- 172.21.15.55:0/1662607690 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f144c003530 con 0x7f14640cc870 2023-07-06T21:58:02.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f14627fc640 1 -- 172.21.15.55:0/1662607690 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3056548660 0 0) 0x7f144c003530 con 0x7f14640cc870 2023-07-06T21:58:02.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f14627fc640 1 -- 172.21.15.55:0/1662607690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14640b4300 msgr2=0x7f14640b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:02.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f14627fc640 1 --2- 172.21.15.55:0/1662607690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14640b4300 0x7f14640b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:02.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f14627fc640 1 -- 172.21.15.55:0/1662607690 >> v2:172.21.15.138:3300/0 conn(0x7f14640b7b90 msgr2=0x7f14640d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:02.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f14627fc640 1 --2- 172.21.15.55:0/1662607690 >> v2:172.21.15.138:3300/0 conn(0x7f14640b7b90 0x7f14640d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:02.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f14627fc640 1 -- 172.21.15.55:0/1662607690 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14640cd030 con 0x7f14640cc870 2023-07-06T21:58:02.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f14627fc640 1 -- 172.21.15.55:0/1662607690 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f1458001680 con 0x7f14640cc870 2023-07-06T21:58:02.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.424+0000 7f14627fc640 1 -- 172.21.15.55:0/1662607690 >> v1:172.21.15.55:6789/0 conn(0x7f14640cc870 legacy=0x7f14640b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:02.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f14627fc640 1 --2- 172.21.15.55:0/1662607690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f144c003980 0x7f144c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:02.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f14627fc640 1 --2- 172.21.15.55:0/1662607690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f144c0043b0 0x7f144c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:02.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f14627fc640 1 --2- 172.21.15.55:0/1662607690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14640b4300 0x7f144c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:02.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f14627fc640 1 -- 172.21.15.55:0/1662607690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1464160020 con 0x7f144c0043b0 2023-07-06T21:58:02.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f14627fc640 1 -- 172.21.15.55:0/1662607690 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14641604b0 con 0x7f144c003980 2023-07-06T21:58:02.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f14627fc640 1 -- 172.21.15.55:0/1662607690 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144c00b990 con 0x7f14640b4300 2023-07-06T21:58:02.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f1462ffd640 1 --2- 172.21.15.55:0/1662607690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f144c0043b0 0x7f144c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:02.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f1463fff640 1 --2- 172.21.15.55:0/1662607690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14640b4300 0x7f144c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:02.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f14637fe640 1 --2- 172.21.15.55:0/1662607690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f144c003980 0x7f144c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:02.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f1462ffd640 1 -- 172.21.15.55:0/1662607690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14640b4300 msgr2=0x7f144c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:02.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f1462ffd640 1 --2- 172.21.15.55:0/1662607690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14640b4300 0x7f144c004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:02.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f1462ffd640 1 -- 172.21.15.55:0/1662607690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f144c003980 msgr2=0x7f144c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:02.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f1462ffd640 1 --2- 172.21.15.55:0/1662607690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f144c003980 0x7f144c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:02.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f1462ffd640 1 -- 172.21.15.55:0/1662607690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c003530 con 0x7f144c0043b0 2023-07-06T21:58:02.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f1462ffd640 1 --2- 172.21.15.55:0/1662607690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f144c0043b0 0x7f144c004870 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f145800c240 tx=0x7f145801f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92b6487fb001690 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:02.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f14627fc640 1 -- 172.21.15.55:0/1662607690 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458005ae0 con 0x7f144c0043b0 2023-07-06T21:58:02.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f14627fc640 1 -- 172.21.15.55:0/1662607690 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14580ab070 con 0x7f144c0043b0 2023-07-06T21:58:02.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.428+0000 7f14627fc640 1 -- 172.21.15.55:0/1662607690 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458005ea0 con 0x7f144c0043b0 2023-07-06T21:58:02.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1469dc5640 1 -- 172.21.15.55:0/1662607690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f144c0043b0 msgr2=0x7f144c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:02.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1469dc5640 1 --2- 172.21.15.55:0/1662607690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f144c0043b0 0x7f144c004870 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f145800c240 tx=0x7f145801f3d0 comp rx=0 tx=0).stop 2023-07-06T21:58:02.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1463fff640 1 -- 172.21.15.55:0/1662607690 reap_dead start 2023-07-06T21:58:02.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1469dc5640 1 -- 172.21.15.55:0/1662607690 shutdown_connections 2023-07-06T21:58:02.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1469dc5640 1 -- 172.21.15.55:0/1662607690 >> 172.21.15.55:0/1662607690 conn(0x7f14640ceca0 msgr2=0x7f14640cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:02.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1469dc5640 1 -- 172.21.15.55:0/1662607690 shutdown_connections 2023-07-06T21:58:02.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1469dc5640 1 -- 172.21.15.55:0/1662607690 wait complete. 2023-07-06T21:58:02.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1469dc5640 1 Processor -- start 2023-07-06T21:58:02.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1469dc5640 1 -- start start 2023-07-06T21:58:02.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1469dc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f144c0043b0 0x7f14640c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:02.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1469dc5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14640c9ae0 0x7f14640c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:02.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1469dc5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1464151ad0 0x7f1464151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:02.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1469dc5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14640ca9e0 con 0x7f1464151ad0 2023-07-06T21:58:02.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1469dc5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14640ca490 con 0x7f14640c9ae0 2023-07-06T21:58:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1469dc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1464152a30 con 0x7f144c0043b0 2023-07-06T21:58:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1463fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1464151ad0 0x7f1464151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1463fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1464151ad0 0x7f1464151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51416/0 (socket says 172.21.15.55:51416) 2023-07-06T21:58:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1463fff640 1 -- 172.21.15.55:0/4192553996 learned_addr learned my addr 172.21.15.55:0/4192553996 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f14637fe640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f144c0043b0 0x7f14640c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.432+0000 7f1462ffd640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14640c9ae0 0x7f14640c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f1463fff640 1 -- 172.21.15.55:0/4192553996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f144c0043b0 msgr2=0x7f14640c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:02.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f1463fff640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f144c0043b0 0x7f14640c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:02.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f1463fff640 1 -- 172.21.15.55:0/4192553996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14640c9ae0 msgr2=0x7f14640c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:02.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f1463fff640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14640c9ae0 0x7f14640c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:02.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f1463fff640 1 -- 172.21.15.55:0/4192553996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1464152480 con 0x7f1464151ad0 2023-07-06T21:58:02.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f14637fe640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f144c0043b0 0x7f14640c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:02.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f1463fff640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1464151ad0 0x7f1464151f40 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f14640cfb50 tx=0x7f145c007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:02.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f144bfff640 1 -- 172.21.15.55:0/4192553996 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c00e070 con 0x7f1464151ad0 2023-07-06T21:58:02.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f144bfff640 1 -- 172.21.15.55:0/4192553996 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c003c70 con 0x7f1464151ad0 2023-07-06T21:58:02.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f1469dc5640 1 -- 172.21.15.55:0/4192553996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1464152750 con 0x7f1464151ad0 2023-07-06T21:58:02.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f144bfff640 1 -- 172.21.15.55:0/4192553996 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c003e20 con 0x7f1464151ad0 2023-07-06T21:58:02.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f1469dc5640 1 -- 172.21.15.55:0/4192553996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14640b5b10 con 0x7f1464151ad0 2023-07-06T21:58:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f1469dc5640 1 -- 172.21.15.55:0/4192553996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1464066d60 con 0x7f1464151ad0 2023-07-06T21:58:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f144bfff640 1 -- 172.21.15.55:0/4192553996 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f145c004030 con 0x7f1464151ad0 2023-07-06T21:58:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f144bfff640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f14500663a0 0x7f1450068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.436+0000 7f144bfff640 1 -- 172.21.15.55:0/4192553996 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f145c083fe0 con 0x7f1464151ad0 2023-07-06T21:58:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.440+0000 7f14637fe640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f14500663a0 0x7f1450068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.440+0000 7f14637fe640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f14500663a0 0x7f1450068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1454009ed0 tx=0x7f1454008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:02.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.444+0000 7f144bfff640 1 -- 172.21.15.55:0/4192553996 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f145c051090 con 0x7f1464151ad0 2023-07-06T21:58:02.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:02.632+0000 7f1469dc5640 1 -- 172.21.15.55:0/4192553996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f14640d30b0 con 0x7f1464151ad0 2023-07-06T21:58:03.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.252+0000 7f144bfff640 1 -- 172.21.15.55:0/4192553996 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f145c0546b0 con 0x7f1464151ad0 2023-07-06T21:58:03.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.252+0000 7f1469dc5640 1 -- 172.21.15.55:0/4192553996 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f14500663a0 msgr2=0x7f1450068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.252+0000 7f1469dc5640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f14500663a0 0x7f1450068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1454009ed0 tx=0x7f1454008040 comp rx=0 tx=0).stop 2023-07-06T21:58:03.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.252+0000 7f1469dc5640 1 -- 172.21.15.55:0/4192553996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1464151ad0 msgr2=0x7f1464151f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.252+0000 7f1469dc5640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1464151ad0 0x7f1464151f40 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f14640cfb50 tx=0x7f145c007db0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.252+0000 7f1469dc5640 1 -- 172.21.15.55:0/4192553996 shutdown_connections 2023-07-06T21:58:03.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.252+0000 7f1469dc5640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1464151ad0 0x7f1464151f40 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.252+0000 7f1469dc5640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14640c9ae0 0x7f14640c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.252+0000 7f1469dc5640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f14500663a0 0x7f1450068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.252+0000 7f1469dc5640 1 --2- 172.21.15.55:0/4192553996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f144c0043b0 0x7f14640c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.252+0000 7f1469dc5640 1 -- 172.21.15.55:0/4192553996 >> 172.21.15.55:0/4192553996 conn(0x7f14640ceca0 msgr2=0x7f1464153b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:03.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.252+0000 7f1469dc5640 1 -- 172.21.15.55:0/4192553996 shutdown_connections 2023-07-06T21:58:03.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.252+0000 7f1469dc5640 1 -- 172.21.15.55:0/4192553996 wait complete. 2023-07-06T21:58:03.274 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T21:58:03.275 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:58:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f56b9f640 1 Processor -- start 2023-07-06T21:58:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f56b9f640 1 -- start start 2023-07-06T21:58:03.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f56b9f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f500b1fe0 0x7f1f50166ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:03.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f56b9f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f500cd1c0 con 0x7f1f500ce610 2023-07-06T21:58:03.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f56b9f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f500cecf0 con 0x7f1f500b7cd0 2023-07-06T21:58:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f56b9f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500d2310 con 0x7f1f500b1fe0 2023-07-06T21:58:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1f500ce610 0x7f1f500b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56944/0 (socket says 172.21.15.55:56944) 2023-07-06T21:58:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4ffff640 1 -- 172.21.15.55:0/1262324797 learned_addr learned my addr 172.21.15.55:0/1262324797 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f5513c640 1 --2- 172.21.15.55:0/1262324797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f500b1fe0 0x7f1f50166ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 -- 172.21.15.55:0/1262324797 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664435483 0 0) 0x7f1f500cd1c0 con 0x7f1f500ce610 2023-07-06T21:58:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 -- 172.21.15.55:0/1262324797 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f40003530 con 0x7f1f500ce610 2023-07-06T21:58:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 -- 172.21.15.55:0/1262324797 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3131277093 0 0) 0x7f1f40003530 con 0x7f1f500ce610 2023-07-06T21:58:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 -- 172.21.15.55:0/1262324797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f500b1fe0 msgr2=0x7f1f50166ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 --2- 172.21.15.55:0/1262324797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f500b1fe0 0x7f1f50166ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 -- 172.21.15.55:0/1262324797 >> v1:172.21.15.138:6789/0 conn(0x7f1f500b7cd0 legacy=0x7f1f500ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 -- 172.21.15.55:0/1262324797 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f500cea60 con 0x7f1f500ce610 2023-07-06T21:58:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 -- 172.21.15.55:0/1262324797 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f1f3c001680 con 0x7f1f500ce610 2023-07-06T21:58:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 -- 172.21.15.55:0/1262324797 >> v1:172.21.15.55:6789/0 conn(0x7f1f500ce610 legacy=0x7f1f500b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 --2- 172.21.15.55:0/1262324797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f400039b0 0x7f1f40003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 --2- 172.21.15.55:0/1262324797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f500b1fe0 0x7f1f400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 --2- 172.21.15.55:0/1262324797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f40004d10 0x7f1f40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 -- 172.21.15.55:0/1262324797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4000bb20 con 0x7f1f40004d10 2023-07-06T21:58:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 -- 172.21.15.55:0/1262324797 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4000bc90 con 0x7f1f400039b0 2023-07-06T21:58:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4f7fe640 1 -- 172.21.15.55:0/1262324797 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4000be50 con 0x7f1f500b1fe0 2023-07-06T21:58:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f5493b640 1 --2- 172.21.15.55:0/1262324797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f400039b0 0x7f1f40003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:03.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f5513c640 1 --2- 172.21.15.55:0/1262324797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f40004d10 0x7f1f40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:03.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f4ffff640 1 --2- 172.21.15.55:0/1262324797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f500b1fe0 0x7f1f400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:03.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f5513c640 1 -- 172.21.15.55:0/1262324797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f500b1fe0 msgr2=0x7f1f400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:03.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f5513c640 1 --2- 172.21.15.55:0/1262324797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f500b1fe0 0x7f1f400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f5513c640 1 -- 172.21.15.55:0/1262324797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f400039b0 msgr2=0x7f1f40003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:03.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f5513c640 1 --2- 172.21.15.55:0/1262324797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f400039b0 0x7f1f40003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.424+0000 7f1f5513c640 1 -- 172.21.15.55:0/1262324797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f40003530 con 0x7f1f40004d10 2023-07-06T21:58:03.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.428+0000 7f1f5513c640 1 --2- 172.21.15.55:0/1262324797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f40004d10 0x7f1f40005180 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f1f48007330 tx=0x7f1f4801ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40df3622793a54f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:03.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.428+0000 7f1f4f7fe640 1 -- 172.21.15.55:0/1262324797 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f480a5c00 con 0x7f1f40004d10 2023-07-06T21:58:03.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.428+0000 7f1f4f7fe640 1 -- 172.21.15.55:0/1262324797 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f480a5d60 con 0x7f1f40004d10 2023-07-06T21:58:03.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.428+0000 7f1f4f7fe640 1 -- 172.21.15.55:0/1262324797 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f480ad660 con 0x7f1f40004d10 2023-07-06T21:58:03.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.428+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1262324797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f40004d10 msgr2=0x7f1f40005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.428+0000 7f1f56b9f640 1 --2- 172.21.15.55:0/1262324797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f40004d10 0x7f1f40005180 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f1f48007330 tx=0x7f1f4801ce00 comp rx=0 tx=0).stop 2023-07-06T21:58:03.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.428+0000 7f1f5513c640 1 -- 172.21.15.55:0/1262324797 reap_dead start 2023-07-06T21:58:03.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.428+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1262324797 shutdown_connections 2023-07-06T21:58:03.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.428+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1262324797 >> 172.21.15.55:0/1262324797 conn(0x7f1f500ceee0 msgr2=0x7f1f500cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:03.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.428+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1262324797 shutdown_connections 2023-07-06T21:58:03.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.428+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1262324797 wait complete. 2023-07-06T21:58:03.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f56b9f640 1 Processor -- start 2023-07-06T21:58:03.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f56b9f640 1 -- start start 2023-07-06T21:58:03.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f56b9f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f40004d10 0x7f1f500cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:03.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f56b9f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f501f20b0 0x7f1f501509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:03.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f56b9f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f500b6460 0x7f1f500c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:03.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f56b9f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500b53c0 con 0x7f1f40004d10 2023-07-06T21:58:03.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f56b9f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500b56a0 con 0x7f1f501f20b0 2023-07-06T21:58:03.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f56b9f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500b5980 con 0x7f1f500b6460 2023-07-06T21:58:03.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f5493b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f40004d10 0x7f1f500cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:03.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f5493b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f40004d10 0x7f1f500cbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34740/0 (socket says 172.21.15.55:34740) 2023-07-06T21:58:03.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f5493b640 1 -- 172.21.15.55:0/1423196818 learned_addr learned my addr 172.21.15.55:0/1423196818 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:03.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f4ffff640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f501f20b0 0x7f1f501509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:03.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f5513c640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f500b6460 0x7f1f500c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:03.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f5493b640 1 -- 172.21.15.55:0/1423196818 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f500b6460 msgr2=0x7f1f500c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f5493b640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f500b6460 0x7f1f500c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f5493b640 1 -- 172.21.15.55:0/1423196818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f501f20b0 msgr2=0x7f1f501509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f5493b640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f501f20b0 0x7f1f501509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f5493b640 1 -- 172.21.15.55:0/1423196818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f500b5c60 con 0x7f1f40004d10 2023-07-06T21:58:03.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f5513c640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f500b6460 0x7f1f500c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:03.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f5493b640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f40004d10 0x7f1f500cbe10 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400f7f0 tx=0x7f1f4400fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:03.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.432+0000 7f1f4d7fa640 1 -- 172.21.15.55:0/1423196818 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440050d0 con 0x7f1f40004d10 2023-07-06T21:58:03.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.436+0000 7f1f4d7fa640 1 -- 172.21.15.55:0/1423196818 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f44005230 con 0x7f1f40004d10 2023-07-06T21:58:03.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.436+0000 7f1f4d7fa640 1 -- 172.21.15.55:0/1423196818 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4400d730 con 0x7f1f40004d10 2023-07-06T21:58:03.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.436+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1423196818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f500b5f40 con 0x7f1f40004d10 2023-07-06T21:58:03.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.436+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1423196818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f50150ef0 con 0x7f1f40004d10 2023-07-06T21:58:03.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.436+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1423196818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f500b6100 con 0x7f1f40004d10 2023-07-06T21:58:03.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.436+0000 7f1f4d7fa640 1 -- 172.21.15.55:0/1423196818 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1f4400d890 con 0x7f1f40004d10 2023-07-06T21:58:03.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.436+0000 7f1f4d7fa640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f1f340663d0 0x7f1f34068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:03.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.436+0000 7f1f4d7fa640 1 -- 172.21.15.55:0/1423196818 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1f44083e20 con 0x7f1f40004d10 2023-07-06T21:58:03.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.436+0000 7f1f4ffff640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f1f340663d0 0x7f1f34068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:03.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.436+0000 7f1f4ffff640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f1f340663d0 0x7f1f34068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1f500cc610 tx=0x7f1f3c000ee0 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:03.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.440+0000 7f1f4d7fa640 1 -- 172.21.15.55:0/1423196818 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1f440510e0 con 0x7f1f40004d10 2023-07-06T21:58:03.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.628+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1423196818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f50066d60 con 0x7f1f40004d10 2023-07-06T21:58:03.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.628+0000 7f1f4d7fa640 1 -- 172.21.15.55:0/1423196818 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f1f44054700 con 0x7f1f40004d10 2023-07-06T21:58:03.627 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:03.628 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2387174661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2387174661},{"type":"v1","addr":"172.21.15.138:6835","nonce":2387174661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7081,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3545643267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3545643267},{"type":"v1","addr":"172.21.15.138:6834","nonce":3545643267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7470,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1177943393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1177943393},{"type":"v1","addr":"172.21.15.55:6835","nonce":1177943393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:58:00.221256+0000","modified":"2023-07-06T21:58:03.247845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7479},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7479":{"gid":7479,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1437542997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1437542997},{"type":"v1","addr":"172.21.15.55:6837","nonce":1437542997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-06T21:58:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 40 2023-07-06T21:58:03.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.632+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1423196818 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f1f340663d0 msgr2=0x7f1f34068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.632+0000 7f1f56b9f640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f1f340663d0 0x7f1f34068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1f500cc610 tx=0x7f1f3c000ee0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.632+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1423196818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f40004d10 msgr2=0x7f1f500cbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.632+0000 7f1f56b9f640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f40004d10 0x7f1f500cbe10 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400f7f0 tx=0x7f1f4400fbf0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.632+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1423196818 shutdown_connections 2023-07-06T21:58:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.632+0000 7f1f56b9f640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f1f340663d0 0x7f1f34068880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.632+0000 7f1f56b9f640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f500b6460 0x7f1f500c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.632+0000 7f1f56b9f640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f501f20b0 0x7f1f501509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.632+0000 7f1f56b9f640 1 --2- 172.21.15.55:0/1423196818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f40004d10 0x7f1f500cbe10 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.632+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1423196818 >> 172.21.15.55:0/1423196818 conn(0x7f1f500ceee0 msgr2=0x7f1f50153d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:03.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.632+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1423196818 shutdown_connections 2023-07-06T21:58:03.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.632+0000 7f1f56b9f640 1 -- 172.21.15.55:0/1423196818 wait complete. 2023-07-06T21:58:03.648 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:58:03.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff91d87b640 1 Processor -- start 2023-07-06T21:58:03.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff91d87b640 1 -- start start 2023-07-06T21:58:03.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff91d87b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9181587d0 0x7ff918070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:03.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff91d87b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff9180710c0 0x7ff9180cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:03.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff91d87b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91806fae0 con 0x7ff918158400 2023-07-06T21:58:03.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff91d87b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91806fdc0 con 0x7ff9181587d0 2023-07-06T21:58:03.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff91d87b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9180700a0 con 0x7ff9180710c0 2023-07-06T21:58:03.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff90ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9181587d0 0x7ff918070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff90ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9181587d0 0x7ff918070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34754/0 (socket says 172.21.15.55:34754) 2023-07-06T21:58:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff90ffff640 1 -- 172.21.15.55:0/720486228 learned_addr learned my addr 172.21.15.55:0/720486228 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff916ffd640 1 --1- 172.21.15.55:0/720486228 >> v1:172.21.15.55:6789/0 conn(0x7ff918158400 0x7ff9180c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56960/0 (socket says 172.21.15.55:56960) 2023-07-06T21:58:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff9177fe640 1 --2- 172.21.15.55:0/720486228 >> v2:172.21.15.138:3300/0 conn(0x7ff9180710c0 0x7ff9180cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff90ffff640 1 -- 172.21.15.55:0/720486228 >> v2:172.21.15.138:3300/0 conn(0x7ff9180710c0 msgr2=0x7ff9180cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff90ffff640 1 --2- 172.21.15.55:0/720486228 >> v2:172.21.15.138:3300/0 conn(0x7ff9180710c0 0x7ff9180cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff90ffff640 1 -- 172.21.15.55:0/720486228 >> v1:172.21.15.55:6789/0 conn(0x7ff918158400 legacy=0x7ff9180c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.796+0000 7ff90ffff640 1 -- 172.21.15.55:0/720486228 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918070380 con 0x7ff9181587d0 2023-07-06T21:58:03.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.800+0000 7ff90ffff640 1 --2- 172.21.15.55:0/720486228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9181587d0 0x7ff918070b80 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff9180ca570 tx=0x7ff90001e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231bd53de42ac396 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:03.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.800+0000 7ff9167fc640 1 -- 172.21.15.55:0/720486228 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9000aa620 con 0x7ff9181587d0 2023-07-06T21:58:03.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.800+0000 7ff9167fc640 1 -- 172.21.15.55:0/720486228 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9000aa780 con 0x7ff9181587d0 2023-07-06T21:58:03.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.800+0000 7ff9167fc640 1 -- 172.21.15.55:0/720486228 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9000aab10 con 0x7ff9181587d0 2023-07-06T21:58:03.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.800+0000 7ff91d87b640 1 -- 172.21.15.55:0/720486228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9181587d0 msgr2=0x7ff918070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.800+0000 7ff91d87b640 1 --2- 172.21.15.55:0/720486228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9181587d0 0x7ff918070b80 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff9180ca570 tx=0x7ff90001e6e0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.800+0000 7ff91d87b640 1 -- 172.21.15.55:0/720486228 shutdown_connections 2023-07-06T21:58:03.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.800+0000 7ff91d87b640 1 --2- 172.21.15.55:0/720486228 >> v2:172.21.15.138:3300/0 conn(0x7ff9180710c0 0x7ff9180cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.800+0000 7ff91d87b640 1 --2- 172.21.15.55:0/720486228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9181587d0 0x7ff918070b80 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.800+0000 7ff91d87b640 1 -- 172.21.15.55:0/720486228 >> 172.21.15.55:0/720486228 conn(0x7ff9180cded0 msgr2=0x7ff9180ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:03.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.800+0000 7ff91d87b640 1 -- 172.21.15.55:0/720486228 shutdown_connections 2023-07-06T21:58:03.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.800+0000 7ff91d87b640 1 -- 172.21.15.55:0/720486228 wait complete. 2023-07-06T21:58:03.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.800+0000 7ff91d87b640 1 Processor -- start 2023-07-06T21:58:03.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.800+0000 7ff91d87b640 1 -- start start 2023-07-06T21:58:03.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff91d87b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9180710c0 0x7ff918069770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:03.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff91d87b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff918158400 0x7ff9181568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:03.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff91d87b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9181587d0 0x7ff918156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff91d87b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff918155a70 con 0x7ff918158400 2023-07-06T21:58:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff91d87b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff918154b80 con 0x7ff9181587d0 2023-07-06T21:58:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff91d87b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff918154e60 con 0x7ff9180710c0 2023-07-06T21:58:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff90ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff918158400 0x7ff9181568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff90ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff918158400 0x7ff9181568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34768/0 (socket says 172.21.15.55:34768) 2023-07-06T21:58:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff90ffff640 1 -- 172.21.15.55:0/4152832927 learned_addr learned my addr 172.21.15.55:0/4152832927 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff9177fe640 1 --2- 172.21.15.55:0/4152832927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9181587d0 0x7ff918156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff916ffd640 1 --2- 172.21.15.55:0/4152832927 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9180710c0 0x7ff918069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff90ffff640 1 -- 172.21.15.55:0/4152832927 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9180710c0 msgr2=0x7ff918069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff90ffff640 1 --2- 172.21.15.55:0/4152832927 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9180710c0 0x7ff918069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff90ffff640 1 -- 172.21.15.55:0/4152832927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9181587d0 msgr2=0x7ff918156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff90ffff640 1 --2- 172.21.15.55:0/4152832927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9181587d0 0x7ff918156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff90ffff640 1 -- 172.21.15.55:0/4152832927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9000094d0 con 0x7ff918158400 2023-07-06T21:58:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff90ffff640 1 --2- 172.21.15.55:0/4152832927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff918158400 0x7ff9181568f0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff90001b2f0 tx=0x7ff90001b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff914ff9640 1 -- 172.21.15.55:0/4152832927 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9000b2810 con 0x7ff918158400 2023-07-06T21:58:03.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff914ff9640 1 -- 172.21.15.55:0/4152832927 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9000b2970 con 0x7ff918158400 2023-07-06T21:58:03.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff914ff9640 1 -- 172.21.15.55:0/4152832927 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9000b2ce0 con 0x7ff918158400 2023-07-06T21:58:03.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff91d87b640 1 -- 172.21.15.55:0/4152832927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff918155140 con 0x7ff918158400 2023-07-06T21:58:03.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff91d87b640 1 -- 172.21.15.55:0/4152832927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff918155700 con 0x7ff918158400 2023-07-06T21:58:03.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.804+0000 7ff91d87b640 1 -- 172.21.15.55:0/4152832927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91806c580 con 0x7ff918158400 2023-07-06T21:58:03.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.808+0000 7ff914ff9640 1 -- 172.21.15.55:0/4152832927 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff9000a83c0 con 0x7ff918158400 2023-07-06T21:58:03.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.808+0000 7ff914ff9640 1 --2- 172.21.15.55:0/4152832927 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff8f80663a0 0x7ff8f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:03.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.808+0000 7ff914ff9640 1 -- 172.21.15.55:0/4152832927 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff90011e5e0 con 0x7ff918158400 2023-07-06T21:58:03.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.808+0000 7ff916ffd640 1 --2- 172.21.15.55:0/4152832927 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff8f80663a0 0x7ff8f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:03.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.808+0000 7ff916ffd640 1 --2- 172.21.15.55:0/4152832927 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff8f80663a0 0x7ff8f8068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff908000f70 tx=0x7ff908007cb0 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:03.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.812+0000 7ff914ff9640 1 -- 172.21.15.55:0/4152832927 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff9000eb770 con 0x7ff918158400 2023-07-06T21:58:03.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.968+0000 7ff91d87b640 1 -- 172.21.15.55:0/4152832927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff918066d60 con 0x7ff918158400 2023-07-06T21:58:03.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.968+0000 7ff914ff9640 1 -- 172.21.15.55:0/4152832927 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+18546 (secure 0 0 0) 0x7ff9000eed90 con 0x7ff918158400 2023-07-06T21:58:03.966 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:03.967 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":103,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:58:01.223868+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:57:58.092354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-07-06T21:57:59.209040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:58:03.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.968+0000 7ff91d87b640 1 -- 172.21.15.55:0/4152832927 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff8f80663a0 msgr2=0x7ff8f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.968+0000 7ff91d87b640 1 --2- 172.21.15.55:0/4152832927 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff8f80663a0 0x7ff8f8068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff908000f70 tx=0x7ff908007cb0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.968+0000 7ff91d87b640 1 -- 172.21.15.55:0/4152832927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff918158400 msgr2=0x7ff9181568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:03.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.968+0000 7ff91d87b640 1 --2- 172.21.15.55:0/4152832927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff918158400 0x7ff9181568f0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff90001b2f0 tx=0x7ff90001b480 comp rx=0 tx=0).stop 2023-07-06T21:58:03.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.968+0000 7ff91d87b640 1 -- 172.21.15.55:0/4152832927 shutdown_connections 2023-07-06T21:58:03.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.968+0000 7ff91d87b640 1 --2- 172.21.15.55:0/4152832927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9181587d0 0x7ff918156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.968+0000 7ff91d87b640 1 --2- 172.21.15.55:0/4152832927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff918158400 0x7ff9181568f0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.968+0000 7ff91d87b640 1 --2- 172.21.15.55:0/4152832927 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff8f80663a0 0x7ff8f8068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.968+0000 7ff91d87b640 1 --2- 172.21.15.55:0/4152832927 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9180710c0 0x7ff918069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:03.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.968+0000 7ff91d87b640 1 -- 172.21.15.55:0/4152832927 >> 172.21.15.55:0/4152832927 conn(0x7ff9180cded0 msgr2=0x7ff918161770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:03.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.968+0000 7ff91d87b640 1 -- 172.21.15.55:0/4152832927 shutdown_connections 2023-07-06T21:58:03.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:03.968+0000 7ff91d87b640 1 -- 172.21.15.55:0/4152832927 wait complete. 2023-07-06T21:58:03.987 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T21:58:03.988 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:58:04.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe832e34640 1 Processor -- start 2023-07-06T21:58:04.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe832e34640 1 -- start start 2023-07-06T21:58:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe832e34640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe82c158400 0x7fe82c0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe832e34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe82c0c9680 0x7fe82c070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe832e34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c06fae0 con 0x7fe82c0710c0 2023-07-06T21:58:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe832e34640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82c06fdc0 con 0x7fe82c158400 2023-07-06T21:58:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe832e34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0700a0 con 0x7fe82c0c9680 2023-07-06T21:58:04.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe8313d1640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe82c0710c0 0x7fe82c0cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56974/0 (socket says 172.21.15.55:56974) 2023-07-06T21:58:04.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe8313d1640 1 -- 172.21.15.55:0/3646171458 learned_addr learned my addr 172.21.15.55:0/3646171458 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 -- 172.21.15.55:0/3646171458 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668027447 0 0) 0x7fe82c06fae0 con 0x7fe82c0710c0 2023-07-06T21:58:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 -- 172.21.15.55:0/3646171458 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe81c003530 con 0x7fe82c0710c0 2023-07-06T21:58:04.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe830bd0640 1 --2- 172.21.15.55:0/3646171458 >> v2:172.21.15.138:3300/0 conn(0x7fe82c158400 0x7fe82c0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82bfff640 1 --2- 172.21.15.55:0/3646171458 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe82c0c9680 0x7fe82c070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 -- 172.21.15.55:0/3646171458 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3046180308 0 0) 0x7fe81c003530 con 0x7fe82c0710c0 2023-07-06T21:58:04.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 -- 172.21.15.55:0/3646171458 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe82c0c9680 msgr2=0x7fe82c070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:04.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 --2- 172.21.15.55:0/3646171458 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe82c0c9680 0x7fe82c070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 -- 172.21.15.55:0/3646171458 >> v2:172.21.15.138:3300/0 conn(0x7fe82c158400 msgr2=0x7fe82c0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 --2- 172.21.15.55:0/3646171458 >> v2:172.21.15.138:3300/0 conn(0x7fe82c158400 0x7fe82c0c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 -- 172.21.15.55:0/3646171458 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c070380 con 0x7fe82c0710c0 2023-07-06T21:58:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 -- 172.21.15.55:0/3646171458 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fe824001a00 con 0x7fe82c0710c0 2023-07-06T21:58:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 -- 172.21.15.55:0/3646171458 >> v1:172.21.15.55:6789/0 conn(0x7fe82c0710c0 legacy=0x7fe82c0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 --2- 172.21.15.55:0/3646171458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe81c003980 0x7fe81c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 --2- 172.21.15.55:0/3646171458 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe82c0c9680 0x7fe81c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 --2- 172.21.15.55:0/3646171458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe81c004d10 0x7fe81c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 -- 172.21.15.55:0/3646171458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c06fdc0 con 0x7fe81c003980 2023-07-06T21:58:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 -- 172.21.15.55:0/3646171458 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0700a0 con 0x7fe81c004d10 2023-07-06T21:58:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe82b7fe640 1 -- 172.21.15.55:0/3646171458 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c00ba70 con 0x7fe82c0c9680 2023-07-06T21:58:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.132+0000 7fe830bd0640 1 --2- 172.21.15.55:0/3646171458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe81c003980 0x7fe81c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.136+0000 7fe82bfff640 1 --2- 172.21.15.55:0/3646171458 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe82c0c9680 0x7fe81c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.136+0000 7fe8313d1640 1 --2- 172.21.15.55:0/3646171458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe81c004d10 0x7fe81c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.136+0000 7fe830bd0640 1 -- 172.21.15.55:0/3646171458 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe82c0c9680 msgr2=0x7fe81c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.136+0000 7fe830bd0640 1 --2- 172.21.15.55:0/3646171458 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe82c0c9680 0x7fe81c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.136+0000 7fe830bd0640 1 -- 172.21.15.55:0/3646171458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe81c004d10 msgr2=0x7fe81c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:04.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.136+0000 7fe830bd0640 1 --2- 172.21.15.55:0/3646171458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe81c004d10 0x7fe81c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.136+0000 7fe830bd0640 1 -- 172.21.15.55:0/3646171458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c003530 con 0x7fe81c003980 2023-07-06T21:58:04.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.136+0000 7fe8313d1640 1 --2- 172.21.15.55:0/3646171458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe81c004d10 0x7fe81c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:04.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.136+0000 7fe830bd0640 1 --2- 172.21.15.55:0/3646171458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe81c003980 0x7fe81c003d90 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fe82000dd40 tx=0x7fe82001f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455e7006e0a10321 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:04.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.136+0000 7fe82b7fe640 1 -- 172.21.15.55:0/3646171458 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200b0410 con 0x7fe81c003980 2023-07-06T21:58:04.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.136+0000 7fe82b7fe640 1 -- 172.21.15.55:0/3646171458 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8200aa030 con 0x7fe81c003980 2023-07-06T21:58:04.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.136+0000 7fe82b7fe640 1 -- 172.21.15.55:0/3646171458 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200b07b0 con 0x7fe81c003980 2023-07-06T21:58:04.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe832e34640 1 -- 172.21.15.55:0/3646171458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe81c003980 msgr2=0x7fe81c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe832e34640 1 --2- 172.21.15.55:0/3646171458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe81c003980 0x7fe81c003d90 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fe82000dd40 tx=0x7fe82001f200 comp rx=0 tx=0).stop 2023-07-06T21:58:04.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe8313d1640 1 -- 172.21.15.55:0/3646171458 reap_dead start 2023-07-06T21:58:04.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe832e34640 1 -- 172.21.15.55:0/3646171458 shutdown_connections 2023-07-06T21:58:04.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe832e34640 1 -- 172.21.15.55:0/3646171458 >> 172.21.15.55:0/3646171458 conn(0x7fe82c0cded0 msgr2=0x7fe82c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:04.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe832e34640 1 -- 172.21.15.55:0/3646171458 shutdown_connections 2023-07-06T21:58:04.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe832e34640 1 -- 172.21.15.55:0/3646171458 wait complete. 2023-07-06T21:58:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe832e34640 1 Processor -- start 2023-07-06T21:58:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe832e34640 1 -- start start 2023-07-06T21:58:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe832e34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe81c003980 0x7fe82c0ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe832e34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe82c0aea30 0x7fe82c0aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe832e34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe82c14c2b0 0x7fe82c14c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe832e34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0af3e0 con 0x7fe82c14c2b0 2023-07-06T21:58:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe832e34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0ad680 con 0x7fe82c0aea30 2023-07-06T21:58:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe832e34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0b2140 con 0x7fe81c003980 2023-07-06T21:58:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe8313d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe82c14c2b0 0x7fe82c14c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe8313d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe82c14c2b0 0x7fe82c14c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34798/0 (socket says 172.21.15.55:34798) 2023-07-06T21:58:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe8313d1640 1 -- 172.21.15.55:0/2123357796 learned_addr learned my addr 172.21.15.55:0/2123357796 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe830bd0640 1 --2- 172.21.15.55:0/2123357796 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe81c003980 0x7fe82c0ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.140+0000 7fe82bfff640 1 --2- 172.21.15.55:0/2123357796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe82c0aea30 0x7fe82c0aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.144+0000 7fe8313d1640 1 -- 172.21.15.55:0/2123357796 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe81c003980 msgr2=0x7fe82c0ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.144+0000 7fe8313d1640 1 --2- 172.21.15.55:0/2123357796 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe81c003980 0x7fe82c0ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.144+0000 7fe8313d1640 1 -- 172.21.15.55:0/2123357796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe82c0aea30 msgr2=0x7fe82c0aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.144+0000 7fe8313d1640 1 --2- 172.21.15.55:0/2123357796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe82c0aea30 0x7fe82c0aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.144+0000 7fe8313d1640 1 -- 172.21.15.55:0/2123357796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c14cfa0 con 0x7fe82c14c2b0 2023-07-06T21:58:04.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.144+0000 7fe8313d1640 1 --2- 172.21.15.55:0/2123357796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe82c14c2b0 0x7fe82c14c720 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fe824000f90 tx=0x7fe824007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:04.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.144+0000 7fe8297fa640 1 -- 172.21.15.55:0/2123357796 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240114f0 con 0x7fe82c14c2b0 2023-07-06T21:58:04.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.144+0000 7fe8297fa640 1 -- 172.21.15.55:0/2123357796 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe824011690 con 0x7fe82c14c2b0 2023-07-06T21:58:04.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.144+0000 7fe832e34640 1 -- 172.21.15.55:0/2123357796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c14d280 con 0x7fe82c14c2b0 2023-07-06T21:58:04.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.144+0000 7fe8297fa640 1 -- 172.21.15.55:0/2123357796 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe824011a40 con 0x7fe82c14c2b0 2023-07-06T21:58:04.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.144+0000 7fe832e34640 1 -- 172.21.15.55:0/2123357796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c14d840 con 0x7fe82c14c2b0 2023-07-06T21:58:04.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.144+0000 7fe832e34640 1 -- 172.21.15.55:0/2123357796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82c06c580 con 0x7fe82c14c2b0 2023-07-06T21:58:04.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.144+0000 7fe8297fa640 1 -- 172.21.15.55:0/2123357796 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe824011ba0 con 0x7fe82c14c2b0 2023-07-06T21:58:04.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.148+0000 7fe8297fa640 1 --2- 172.21.15.55:0/2123357796 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fe8100663a0 0x7fe810068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.148+0000 7fe8297fa640 1 -- 172.21.15.55:0/2123357796 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe824083810 con 0x7fe82c14c2b0 2023-07-06T21:58:04.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.148+0000 7fe830bd0640 1 --2- 172.21.15.55:0/2123357796 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fe8100663a0 0x7fe810068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.148+0000 7fe830bd0640 1 --2- 172.21.15.55:0/2123357796 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fe8100663a0 0x7fe810068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe8200b2000 tx=0x7fe820008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:04.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.152+0000 7fe8297fa640 1 -- 172.21.15.55:0/2123357796 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe824050a50 con 0x7fe82c14c2b0 2023-07-06T21:58:04.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.300+0000 7fe832e34640 1 -- 172.21.15.55:0/2123357796 --> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe82c0cc1b0 con 0x7fe8100663a0 2023-07-06T21:58:04.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.312+0000 7fe8297fa640 1 -- 172.21.15.55:0/2123357796 <== mgr.7191 v2:172.21.15.55:6832/703944479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299578 (secure 0 0 0) 0x7fe820006be0 con 0x7fe8100663a0 2023-07-06T21:58:04.313 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:58:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.316+0000 7fe832e34640 1 -- 172.21.15.55:0/2123357796 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fe8100663a0 msgr2=0x7fe810068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.316+0000 7fe832e34640 1 --2- 172.21.15.55:0/2123357796 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fe8100663a0 0x7fe810068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe8200b2000 tx=0x7fe820008040 comp rx=0 tx=0).stop 2023-07-06T21:58:04.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.316+0000 7fe832e34640 1 -- 172.21.15.55:0/2123357796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe82c14c2b0 msgr2=0x7fe82c14c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.316+0000 7fe832e34640 1 --2- 172.21.15.55:0/2123357796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe82c14c2b0 0x7fe82c14c720 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fe824000f90 tx=0x7fe824007a20 comp rx=0 tx=0).stop 2023-07-06T21:58:04.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.316+0000 7fe832e34640 1 -- 172.21.15.55:0/2123357796 shutdown_connections 2023-07-06T21:58:04.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.316+0000 7fe832e34640 1 --2- 172.21.15.55:0/2123357796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe82c14c2b0 0x7fe82c14c720 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.316+0000 7fe832e34640 1 --2- 172.21.15.55:0/2123357796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe82c0aea30 0x7fe82c0aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.316+0000 7fe832e34640 1 --2- 172.21.15.55:0/2123357796 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fe8100663a0 0x7fe810068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.316+0000 7fe832e34640 1 --2- 172.21.15.55:0/2123357796 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe81c003980 0x7fe82c0ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.316+0000 7fe832e34640 1 -- 172.21.15.55:0/2123357796 >> 172.21.15.55:0/2123357796 conn(0x7fe82c0cded0 msgr2=0x7fe82c0c8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:04.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.316+0000 7fe832e34640 1 -- 172.21.15.55:0/2123357796 shutdown_connections 2023-07-06T21:58:04.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.316+0000 7fe832e34640 1 -- 172.21.15.55:0/2123357796 wait complete. 2023-07-06T21:58:04.333 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T21:58:03.706020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":301704,"kb_used_data":10696,"kb_used_omap":0,"kb_used_meta":290944,"kb_avail":754673016,"statfs":{"total":773094113280,"available":772785168384,"internally_reserved":0,"allocated":10952704,"data_stored":6305974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":297926656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.905224"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809651+0000","last_change":"2023-07-06T21:57:58.809651+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809651+0000","last_undegraded":"2023-07-06T21:57:58.809651+0000","last_fullsized":"2023-07-06T21:57:58.809651+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.808045+0000","last_change":"2023-07-06T21:57:58.808045+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.808045+0000","last_undegraded":"2023-07-06T21:57:58.808045+0000","last_fullsized":"2023-07-06T21:57:58.808045+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807353+0000","last_change":"2023-07-06T21:57:58.807353+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807353+0000","last_undegraded":"2023-07-06T21:57:58.807353+0000","last_fullsized":"2023-07-06T21:57:58.807353+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807928+0000","last_change":"2023-07-06T21:57:58.807928+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807928+0000","last_undegraded":"2023-07-06T21:57:58.807928+0000","last_fullsized":"2023-07-06T21:57:58.807928+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807934+0000","last_change":"2023-07-06T21:57:58.807934+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807934+0000","last_undegraded":"2023-07-06T21:57:58.807934+0000","last_fullsized":"2023-07-06T21:57:58.807934+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807490+0000","last_change":"2023-07-06T21:57:58.807490+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807490+0000","last_undegraded":"2023-07-06T21:57:58.807490+0000","last_fullsized":"2023-07-06T21:57:58.807490+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807264+0000","last_change":"2023-07-06T21:57:58.807264+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807264+0000","last_undegraded":"2023-07-06T21:57:58.807264+0000","last_fullsized":"2023-07-06T21:57:58.807264+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.808701+0000","last_change":"2023-07-06T21:57:58.808701+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.808701+0000","last_undegraded":"2023-07-06T21:57:58.808701+0000","last_fullsized":"2023-07-06T21:57:58.808701+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809154+0000","last_change":"2023-07-06T21:57:58.809154+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809154+0000","last_undegraded":"2023-07-06T21:57:58.809154+0000","last_fullsized":"2023-07-06T21:57:58.809154+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807574+0000","last_change":"2023-07-06T21:57:58.807574+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807574+0000","last_undegraded":"2023-07-06T21:57:58.807574+0000","last_fullsized":"2023-07-06T21:57:58.807574+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809075+0000","last_change":"2023-07-06T21:57:58.809075+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809075+0000","last_undegraded":"2023-07-06T21:57:58.809075+0000","last_fullsized":"2023-07-06T21:57:58.809075+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.810159+0000","last_change":"2023-07-06T21:57:58.810159+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.810159+0000","last_undegraded":"2023-07-06T21:57:58.810159+0000","last_fullsized":"2023-07-06T21:57:58.810159+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809451+0000","last_change":"2023-07-06T21:57:58.809451+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809451+0000","last_undegraded":"2023-07-06T21:57:58.809451+0000","last_fullsized":"2023-07-06T21:57:58.809451+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.812158+0000","last_change":"2023-07-06T21:57:58.812158+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.812158+0000","last_undegraded":"2023-07-06T21:57:58.812158+0000","last_fullsized":"2023-07-06T21:57:58.812158+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.810423+0000","last_change":"2023-07-06T21:57:58.810423+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.810423+0000","last_undegraded":"2023-07-06T21:57:58.810423+0000","last_fullsized":"2023-07-06T21:57:58.810423+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807324+0000","last_change":"2023-07-06T21:57:58.807324+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807324+0000","last_undegraded":"2023-07-06T21:57:58.807324+0000","last_fullsized":"2023-07-06T21:57:58.807324+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.808769+0000","last_change":"2023-07-06T21:57:58.808769+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.808769+0000","last_undegraded":"2023-07-06T21:57:58.808769+0000","last_fullsized":"2023-07-06T21:57:58.808769+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809439+0000","last_change":"2023-07-06T21:57:58.809439+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809439+0000","last_undegraded":"2023-07-06T21:57:58.809439+0000","last_fullsized":"2023-07-06T21:57:58.809439+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809646+0000","last_change":"2023-07-06T21:57:58.809646+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809646+0000","last_undegraded":"2023-07-06T21:57:58.809646+0000","last_fullsized":"2023-07-06T21:57:58.809646+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807432+0000","last_change":"2023-07-06T21:57:58.807432+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807432+0000","last_undegraded":"2023-07-06T21:57:58.807432+0000","last_fullsized":"2023-07-06T21:57:58.807432+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807708+0000","last_change":"2023-07-06T21:57:58.807708+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807708+0000","last_undegraded":"2023-07-06T21:57:58.807708+0000","last_fullsized":"2023-07-06T21:57:58.807708+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.806862+0000","last_change":"2023-07-06T21:57:58.806862+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.806862+0000","last_undegraded":"2023-07-06T21:57:58.806862+0000","last_fullsized":"2023-07-06T21:57:58.806862+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809323+0000","last_change":"2023-07-06T21:57:58.809323+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809323+0000","last_undegraded":"2023-07-06T21:57:58.809323+0000","last_fullsized":"2023-07-06T21:57:58.809323+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.806963+0000","last_change":"2023-07-06T21:57:58.806963+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.806963+0000","last_undegraded":"2023-07-06T21:57:58.806963+0000","last_fullsized":"2023-07-06T21:57:58.806963+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.805718+0000","last_change":"2023-07-06T21:57:58.805718+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.805718+0000","last_undegraded":"2023-07-06T21:57:58.805718+0000","last_fullsized":"2023-07-06T21:57:58.805718+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"91'183","reported_seq":562,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.806300+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:57:58.806300+0000","last_peered":"2023-07-06T21:57:58.806300+0000","last_clean":"2023-07-06T21:57:58.806300+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:57:58.806300+0000","last_undegraded":"2023-07-06T21:57:58.806300+0000","last_fullsized":"2023-07-06T21:57:58.806300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:23:13.567230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":156,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.811023+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:57:58.811023+0000","last_peered":"2023-07-06T21:57:58.811023+0000","last_clean":"2023-07-06T21:57:58.811023+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:57:58.811023+0000","last_undegraded":"2023-07-06T21:57:58.811023+0000","last_fullsized":"2023-07-06T21:57:58.811023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:09.361677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.808310+0000","last_change":"2023-07-06T21:57:58.808310+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.808310+0000","last_undegraded":"2023-07-06T21:57:58.808310+0000","last_fullsized":"2023-07-06T21:57:58.808310+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.806211+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:57:58.806211+0000","last_peered":"2023-07-06T21:57:58.806211+0000","last_clean":"2023-07-06T21:57:58.806211+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:57:58.806211+0000","last_undegraded":"2023-07-06T21:57:58.806211+0000","last_fullsized":"2023-07-06T21:57:58.806211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:31:14.596762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807487+0000","last_change":"2023-07-06T21:57:58.807487+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807487+0000","last_undegraded":"2023-07-06T21:57:58.807487+0000","last_fullsized":"2023-07-06T21:57:58.807487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.802640+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:57:58.802640+0000","last_peered":"2023-07-06T21:57:58.802640+0000","last_clean":"2023-07-06T21:57:58.802640+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:57:58.802640+0000","last_undegraded":"2023-07-06T21:57:58.802640+0000","last_fullsized":"2023-07-06T21:57:58.802640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:29:42.179292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807380+0000","last_change":"2023-07-06T21:57:58.807380+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807380+0000","last_undegraded":"2023-07-06T21:57:58.807380+0000","last_fullsized":"2023-07-06T21:57:58.807380+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.811013+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:57:58.811013+0000","last_peered":"2023-07-06T21:57:58.811013+0000","last_clean":"2023-07-06T21:57:58.811013+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:57:58.811013+0000","last_undegraded":"2023-07-06T21:57:58.811013+0000","last_fullsized":"2023-07-06T21:57:58.811013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:09:58.457076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.804652+0000","last_change":"2023-07-06T21:57:58.804652+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.804652+0000","last_undegraded":"2023-07-06T21:57:58.804652+0000","last_fullsized":"2023-07-06T21:57:58.804652+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.810509+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:57:58.810509+0000","last_peered":"2023-07-06T21:57:58.810509+0000","last_clean":"2023-07-06T21:57:58.810509+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:57:58.810509+0000","last_undegraded":"2023-07-06T21:57:58.810509+0000","last_fullsized":"2023-07-06T21:57:58.810509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:41:19.613069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.812095+0000","last_change":"2023-07-06T21:57:58.812095+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.812095+0000","last_undegraded":"2023-07-06T21:57:58.812095+0000","last_fullsized":"2023-07-06T21:57:58.812095+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.806521+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:57:58.806521+0000","last_peered":"2023-07-06T21:57:58.806521+0000","last_clean":"2023-07-06T21:57:58.806521+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:57:58.806521+0000","last_undegraded":"2023-07-06T21:57:58.806521+0000","last_fullsized":"2023-07-06T21:57:58.806521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:05:03.904478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.812398+0000","last_change":"2023-07-06T21:57:58.812398+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.812398+0000","last_undegraded":"2023-07-06T21:57:58.812398+0000","last_fullsized":"2023-07-06T21:57:58.812398+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.810656+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:57:58.810656+0000","last_peered":"2023-07-06T21:57:58.810656+0000","last_clean":"2023-07-06T21:57:58.810656+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:57:58.810656+0000","last_undegraded":"2023-07-06T21:57:58.810656+0000","last_fullsized":"2023-07-06T21:57:58.810656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:06:47.388507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.804610+0000","last_change":"2023-07-06T21:57:58.804610+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.804610+0000","last_undegraded":"2023-07-06T21:57:58.804610+0000","last_fullsized":"2023-07-06T21:57:58.804610+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.810277+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:57:58.810277+0000","last_peered":"2023-07-06T21:57:58.810277+0000","last_clean":"2023-07-06T21:57:58.810277+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:57:58.810277+0000","last_undegraded":"2023-07-06T21:57:58.810277+0000","last_fullsized":"2023-07-06T21:57:58.810277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:19:33.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575041,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36920,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334920,"statfs":{"total":96636764160,"available":96598958080,"internally_reserved":0,"allocated":1818624,"data_stored":1232900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.54200000000000004,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":0.93600000000000005,"5min":0.93999999999999995,"15min":0.97699999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.56599999999999995,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":0.876,"5min":0.98799999999999999,"15min":0.99399999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.34799999999999998},"max":{"1min":0.89200000000000002,"5min":0.98399999999999999,"15min":1.0649999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.90500000000000003,"5min":0.94099999999999995,"15min":0.97899999999999998},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.56299999999999994,"5min":0.377,"15min":0.377},"max":{"1min":0.86099999999999999,"5min":0.94799999999999995,"15min":0.94999999999999996},"last":0.623},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.46899999999999997,"15min":0.42599999999999999},"max":{"1min":0.91600000000000004,"5min":1.0209999999999999,"15min":1.0529999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71299999999999997,"15min":0.71899999999999997},"min":{"1min":0.60099999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84499999999999997,"5min":0.91800000000000004,"15min":1.0469999999999999},"last":0.745},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.55000000000000004,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":0.96599999999999997,"15min":1.006},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.83299999999999996,"15min":0.999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.96299999999999997},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56799999999999995,"15min":0.58399999999999996},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.34999999999999998},"max":{"1min":0.83199999999999996,"5min":0.89500000000000002,"15min":0.98499999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.99199999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.51200000000000001,"5min":0.44,"15min":0.40200000000000002},"max":{"1min":0.85799999999999998,"5min":0.93200000000000005,"15min":1.0309999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.496,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.79900000000000004,"5min":0.98399999999999999,"15min":1.0940000000000001},"last":0.77400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575041,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1220608,"data_stored":641513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70799999999999996,"15min":0.70499999999999996},"min":{"1min":0.502,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94699999999999995,"5min":0.97899999999999998,"15min":1.0980000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.38300000000000001},"max":{"1min":1.1830000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.71299999999999997},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.73899999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.41599999999999998},"max":{"1min":0.874,"5min":1.0129999999999999,"15min":1.3859999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.749,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":1.135,"5min":1.159,"15min":1.204},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.498},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":1.4339999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82699999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0509999999999999,"15min":1.321},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.63100000000000001},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.36299999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.0089999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68700000000000006,"15min":0.71099999999999997},"min":{"1min":0.55200000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":1.3089999999999999,"15min":1.631},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.41699999999999998},"max":{"1min":1.0029999999999999,"5min":1.2549999999999999,"15min":1.3600000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.66500000000000004},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.6930000000000001},"last":0.70699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1224704,"data_stored":642532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.92300000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69999999999999996,"15min":0.72099999999999997},"min":{"1min":0.51600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.55400000000000005,"5min":0.40200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89700000000000002,"5min":1.0269999999999999,"15min":1.131},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":1.0329999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.56000000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0369999999999999},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.58099999999999996,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98899999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.79600000000000004}]},{"osd":4,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.77600000000000002,"5min":0.78900000000000003,"15min":1},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.91800000000000004,"15min":1.02},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":1.052},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.45400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81899999999999995,"5min":0.83599999999999997,"15min":0.96699999999999997},"last":0.82099999999999995}]},{"osd":7,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63400000000000001,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85799999999999998,"5min":0.92200000000000004,"15min":1.0529999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65300000000000002,"15min":0.68100000000000005},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95299999999999996,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.83399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1212416,"data_stored":636042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.46500000000000002,"15min":0.39400000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88,"5min":1.123,"15min":1.123},"last":0.80900000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.44},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.361},"last":0.747},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2829999999999999},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":0.84799999999999998,"5min":0.95299999999999996,"15min":1.2170000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.751},"min":{"1min":0.498,"5min":0.498,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":0.94299999999999995,"15min":1.649},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.4219999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.49099999999999999},"max":{"1min":0.91400000000000003,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.308},"max":{"1min":0.85999999999999999,"5min":0.86399999999999999,"15min":1.246},"last":0.502},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.96099999999999997,"5min":0.97299999999999998,"15min":1.8049999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.36299999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.478},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":0.94999999999999996,"5min":0.99199999999999999,"15min":1.7250000000000001},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42399999999999999},"max":{"1min":1.0149999999999999,"5min":1.0720000000000001,"15min":1.534},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.47099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96399999999999997,"5min":1.01,"15min":1.585},"last":0.76500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1212416,"data_stored":636042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.85499999999999998,"15min":1.0489999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.67800000000000005,"5min":2.77,"15min":2.77},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.503,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.309,"15min":0.24299999999999999},"max":{"1min":0.77600000000000002,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":1.351,"15min":1.9590000000000001},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":0.73999999999999999,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.497},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":2.012},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":0.97299999999999998,"5min":1.1930000000000001,"15min":1.855},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0109999999999999,"5min":1.383,"15min":1.524},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80300000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.625},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.44800000000000001},"max":{"1min":1.0700000000000001,"5min":1.327,"15min":1.883},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.46600000000000003,"15min":0.40000000000000002},"max":{"1min":1.129,"5min":1.425,"15min":1.425},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.81399999999999995,"15min":0.80700000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47899999999999998},"max":{"1min":1.097,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.51000000000000001,"5min":0.5,"15min":0.497},"max":{"1min":1.004,"5min":3.097,"15min":3.097},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.81100000000000005},"min":{"1min":0.54500000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.1140000000000001,"15min":1.9830000000000001},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1224704,"data_stored":642532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45900000000000002,"15min":0.45100000000000001},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67100000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.495},"min":{"1min":0.28699999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.71799999999999997,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.878,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.76100000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.34499999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.76500000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.57599999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.71899999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.56000000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.113,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80900000000000005,"15min":0.79700000000000004},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0469999999999999,"5min":1.591,"15min":1.591},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80200000000000005,"15min":0.79300000000000004},"min":{"1min":0.57499999999999996,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.1399999999999999,"5min":1.333,"15min":1.333},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81000000000000005,"15min":0.81699999999999995},"min":{"1min":0.60299999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1850000000000001,"5min":1.327,"15min":1.327},"last":0.98799999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.58499999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.497},"max":{"1min":1.153,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.629,"5min":0.496,"15min":0.496},"max":{"1min":1.262,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.878},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83099999999999996,"15min":0.83599999999999997},"min":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2170000000000001,"5min":1.296,"15min":1.369},"last":0.91100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575041,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58484,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313356,"statfs":{"total":96636764160,"available":96576876544,"internally_reserved":0,"allocated":1224704,"data_stored":642532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.309,"5min":0.29499999999999998,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.68899999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.33300000000000002},"max":{"1min":0.68700000000000006,"5min":0.87,"15min":0.87},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.32000000000000001},"max":{"1min":0.71699999999999997,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.505}]},{"osd":4,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.61899999999999999,"5min":0.49199999999999999,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.143,"15min":1.3140000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":1.02,"5min":1.022,"15min":1.2290000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.497,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.095,"5min":1.1890000000000001,"15min":1.4359999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78400000000000003,"15min":0.79300000000000004},"min":{"1min":0.66100000000000003,"5min":0.50700000000000001,"15min":0.439},"max":{"1min":1.026,"5min":1.044,"15min":1.357},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.53400000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.042,"5min":1.278,"15min":1.278},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79900000000000004,"15min":0.80100000000000005},"min":{"1min":0.65000000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.456},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.80500000000000005,"15min":0.80800000000000005},"min":{"1min":0.61499999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.056,"5min":1.0820000000000001,"15min":1.417},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80300000000000005,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.5,"15min":0.5},"max":{"1min":1.0349999999999999,"5min":1.3280000000000001,"15min":1.397},"last":0.629}]}]},{"osd":0,"up_from":13,"seq":55834575040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36916,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334924,"statfs":{"total":96636764160,"available":96598962176,"internally_reserved":0,"allocated":1814528,"data_stored":1231881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.54900000000000004,"5min":0.86399999999999999,"15min":1.1459999999999999},"last":0.374},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.28599999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86799999999999999,"5min":0.98099999999999998,"15min":1.5189999999999999},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.313,"5min":0.313,"15min":0.30099999999999999},"max":{"1min":0.61099999999999999,"5min":0.81100000000000005,"15min":1.228},"last":0.499},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67000000000000004,"5min":1.2050000000000001,"15min":1.454},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70999999999999996,"5min":1.151,"15min":1.7969999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76400000000000001,"5min":0.83099999999999996,"15min":1.7190000000000001},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76600000000000001,"15min":0.78900000000000003},"min":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0109999999999999,"5min":1.1319999999999999,"15min":1.911},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3620000000000001},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.38400000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.3700000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.77200000000000002,"15min":0.79500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50700000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":1.163,"15min":1.758},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.8220000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47199999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":2.266},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81599999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":2.323},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.57499999999999996,"5min":0.50900000000000001,"15min":0.435},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:58:04.341 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:58:04.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.524+0000 7ff7eabdf640 1 Processor -- start 2023-07-06T21:58:04.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.524+0000 7ff7eabdf640 1 -- start start 2023-07-06T21:58:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.524+0000 7ff7eabdf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7e4158400 0x7ff7e40c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.524+0000 7ff7eabdf640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e41587d0 0x7ff7e40cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.524+0000 7ff7eabdf640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e406fae0 con 0x7ff7e40c9680 2023-07-06T21:58:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.524+0000 7ff7eabdf640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e406fdc0 con 0x7ff7e4158400 2023-07-06T21:58:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.524+0000 7ff7eabdf640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e40700a0 con 0x7ff7e41587d0 2023-07-06T21:58:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.524+0000 7ff7e897b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7e4158400 0x7ff7e40c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.524+0000 7ff7e897b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7e4158400 0x7ff7e40c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34806/0 (socket says 172.21.15.55:34806) 2023-07-06T21:58:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.524+0000 7ff7e897b640 1 -- 172.21.15.55:0/665183465 learned_addr learned my addr 172.21.15.55:0/665183465 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.528+0000 7ff7e917c640 1 --2- 172.21.15.55:0/665183465 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e41587d0 0x7ff7e40cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.528+0000 7ff7e897b640 1 -- 172.21.15.55:0/665183465 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e41587d0 msgr2=0x7ff7e40cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:04.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.528+0000 7ff7e897b640 1 --2- 172.21.15.55:0/665183465 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e41587d0 0x7ff7e40cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.528+0000 7ff7e897b640 1 -- 172.21.15.55:0/665183465 >> v1:172.21.15.138:6789/0 conn(0x7ff7e40c9680 legacy=0x7ff7e4070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:04.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.528+0000 7ff7e897b640 1 -- 172.21.15.55:0/665183465 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e4070380 con 0x7ff7e4158400 2023-07-06T21:58:04.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.528+0000 7ff7e897b640 1 --2- 172.21.15.55:0/665183465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7e4158400 0x7ff7e40c9140 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800bb10 tx=0x7ff7d801ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51dd8caa093d60 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:04.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.528+0000 7ff7e37fe640 1 -- 172.21.15.55:0/665183465 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d80a7bc0 con 0x7ff7e4158400 2023-07-06T21:58:04.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.528+0000 7ff7e37fe640 1 -- 172.21.15.55:0/665183465 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d80a7d20 con 0x7ff7e4158400 2023-07-06T21:58:04.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.528+0000 7ff7e37fe640 1 -- 172.21.15.55:0/665183465 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d80af660 con 0x7ff7e4158400 2023-07-06T21:58:04.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 -- 172.21.15.55:0/665183465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7e4158400 msgr2=0x7ff7e40c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 --2- 172.21.15.55:0/665183465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7e4158400 0x7ff7e40c9140 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800bb10 tx=0x7ff7d801ebe0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 -- 172.21.15.55:0/665183465 shutdown_connections 2023-07-06T21:58:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 --2- 172.21.15.55:0/665183465 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e41587d0 0x7ff7e40cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 --2- 172.21.15.55:0/665183465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7e4158400 0x7ff7e40c9140 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 -- 172.21.15.55:0/665183465 >> 172.21.15.55:0/665183465 conn(0x7ff7e40cded0 msgr2=0x7ff7e40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 -- 172.21.15.55:0/665183465 shutdown_connections 2023-07-06T21:58:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 -- 172.21.15.55:0/665183465 wait complete. 2023-07-06T21:58:04.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 Processor -- start 2023-07-06T21:58:04.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 -- start start 2023-07-06T21:58:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e40c9680 0x7ff7e414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e4158400 0x7ff7e40b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7e41587d0 0x7ff7e4151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e414da30 con 0x7ff7e41587d0 2023-07-06T21:58:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e414fba0 con 0x7ff7e4158400 2023-07-06T21:58:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7eabdf640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e414f1c0 con 0x7ff7e40c9680 2023-07-06T21:58:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7e917c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7e41587d0 0x7ff7e4151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7e917c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7e41587d0 0x7ff7e4151500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34814/0 (socket says 172.21.15.55:34814) 2023-07-06T21:58:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7e917c640 1 -- 172.21.15.55:0/1218191070 learned_addr learned my addr 172.21.15.55:0/1218191070 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7e897b640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e40c9680 0x7ff7e414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7e3fff640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e4158400 0x7ff7e40b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7e917c640 1 -- 172.21.15.55:0/1218191070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e40c9680 msgr2=0x7ff7e414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.532+0000 7ff7e917c640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e40c9680 0x7ff7e414f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7e917c640 1 -- 172.21.15.55:0/1218191070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e4158400 msgr2=0x7ff7e40b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7e917c640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e4158400 0x7ff7e40b2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7e917c640 1 -- 172.21.15.55:0/1218191070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d800b770 con 0x7ff7e41587d0 2023-07-06T21:58:04.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7e3fff640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e4158400 0x7ff7e40b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:04.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7e917c640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7e41587d0 0x7ff7e4151500 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc007e90 tx=0x7ff7dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:04.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7e17fa640 1 -- 172.21.15.55:0/1218191070 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc014420 con 0x7ff7e41587d0 2023-07-06T21:58:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7e17fa640 1 -- 172.21.15.55:0/1218191070 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc014580 con 0x7ff7e41587d0 2023-07-06T21:58:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7e17fa640 1 -- 172.21.15.55:0/1218191070 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc014930 con 0x7ff7e41587d0 2023-07-06T21:58:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7eabdf640 1 -- 172.21.15.55:0/1218191070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e414cdb0 con 0x7ff7e41587d0 2023-07-06T21:58:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7eabdf640 1 -- 172.21.15.55:0/1218191070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e414d650 con 0x7ff7e41587d0 2023-07-06T21:58:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7eabdf640 1 -- 172.21.15.55:0/1218191070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e406c580 con 0x7ff7e41587d0 2023-07-06T21:58:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7e17fa640 1 -- 172.21.15.55:0/1218191070 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff7dc014a90 con 0x7ff7e41587d0 2023-07-06T21:58:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7e17fa640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff7c80663a0 0x7ff7c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7e17fa640 1 -- 172.21.15.55:0/1218191070 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff7dc084850 con 0x7ff7e41587d0 2023-07-06T21:58:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.536+0000 7ff7e897b640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff7c80663a0 0x7ff7c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.540+0000 7ff7e897b640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff7c80663a0 0x7ff7c8068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80b1000 tx=0x7ff7d80a9070 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:04.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.540+0000 7ff7e17fa640 1 -- 172.21.15.55:0/1218191070 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7dc055500 con 0x7ff7e41587d0 2023-07-06T21:58:04.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.692+0000 7ff7eabdf640 1 -- 172.21.15.55:0/1218191070 --> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7e40cc3f0 con 0x7ff7c80663a0 2023-07-06T21:58:04.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.704+0000 7ff7e17fa640 1 -- 172.21.15.55:0/1218191070 <== mgr.7191 v2:172.21.15.55:6832/703944479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299578 (secure 0 0 0) 0x7ff7d80be090 con 0x7ff7c80663a0 2023-07-06T21:58:04.703 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:58:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.704+0000 7ff7eabdf640 1 -- 172.21.15.55:0/1218191070 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff7c80663a0 msgr2=0x7ff7c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.704+0000 7ff7eabdf640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff7c80663a0 0x7ff7c8068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80b1000 tx=0x7ff7d80a9070 comp rx=0 tx=0).stop 2023-07-06T21:58:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.704+0000 7ff7eabdf640 1 -- 172.21.15.55:0/1218191070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7e41587d0 msgr2=0x7ff7e4151500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.704+0000 7ff7eabdf640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7e41587d0 0x7ff7e4151500 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc007e90 tx=0x7ff7dc00e4b0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.708+0000 7ff7eabdf640 1 -- 172.21.15.55:0/1218191070 shutdown_connections 2023-07-06T21:58:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.708+0000 7ff7eabdf640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7e41587d0 0x7ff7e4151500 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.708+0000 7ff7eabdf640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e4158400 0x7ff7e40b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.708+0000 7ff7eabdf640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7ff7c80663a0 0x7ff7c8068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.708+0000 7ff7eabdf640 1 --2- 172.21.15.55:0/1218191070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e40c9680 0x7ff7e414f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.708+0000 7ff7eabdf640 1 -- 172.21.15.55:0/1218191070 >> 172.21.15.55:0/1218191070 conn(0x7ff7e40cded0 msgr2=0x7ff7e4070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:04.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.708+0000 7ff7eabdf640 1 -- 172.21.15.55:0/1218191070 shutdown_connections 2023-07-06T21:58:04.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.708+0000 7ff7eabdf640 1 -- 172.21.15.55:0/1218191070 wait complete. 2023-07-06T21:58:04.724 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T21:58:03.706020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":301704,"kb_used_data":10696,"kb_used_omap":0,"kb_used_meta":290944,"kb_avail":754673016,"statfs":{"total":773094113280,"available":772785168384,"internally_reserved":0,"allocated":10952704,"data_stored":6305974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":297926656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.905224"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809651+0000","last_change":"2023-07-06T21:57:58.809651+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809651+0000","last_undegraded":"2023-07-06T21:57:58.809651+0000","last_fullsized":"2023-07-06T21:57:58.809651+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.808045+0000","last_change":"2023-07-06T21:57:58.808045+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.808045+0000","last_undegraded":"2023-07-06T21:57:58.808045+0000","last_fullsized":"2023-07-06T21:57:58.808045+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807353+0000","last_change":"2023-07-06T21:57:58.807353+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807353+0000","last_undegraded":"2023-07-06T21:57:58.807353+0000","last_fullsized":"2023-07-06T21:57:58.807353+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807928+0000","last_change":"2023-07-06T21:57:58.807928+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807928+0000","last_undegraded":"2023-07-06T21:57:58.807928+0000","last_fullsized":"2023-07-06T21:57:58.807928+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807934+0000","last_change":"2023-07-06T21:57:58.807934+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807934+0000","last_undegraded":"2023-07-06T21:57:58.807934+0000","last_fullsized":"2023-07-06T21:57:58.807934+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807490+0000","last_change":"2023-07-06T21:57:58.807490+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807490+0000","last_undegraded":"2023-07-06T21:57:58.807490+0000","last_fullsized":"2023-07-06T21:57:58.807490+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807264+0000","last_change":"2023-07-06T21:57:58.807264+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807264+0000","last_undegraded":"2023-07-06T21:57:58.807264+0000","last_fullsized":"2023-07-06T21:57:58.807264+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.808701+0000","last_change":"2023-07-06T21:57:58.808701+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.808701+0000","last_undegraded":"2023-07-06T21:57:58.808701+0000","last_fullsized":"2023-07-06T21:57:58.808701+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809154+0000","last_change":"2023-07-06T21:57:58.809154+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809154+0000","last_undegraded":"2023-07-06T21:57:58.809154+0000","last_fullsized":"2023-07-06T21:57:58.809154+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807574+0000","last_change":"2023-07-06T21:57:58.807574+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807574+0000","last_undegraded":"2023-07-06T21:57:58.807574+0000","last_fullsized":"2023-07-06T21:57:58.807574+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809075+0000","last_change":"2023-07-06T21:57:58.809075+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809075+0000","last_undegraded":"2023-07-06T21:57:58.809075+0000","last_fullsized":"2023-07-06T21:57:58.809075+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.810159+0000","last_change":"2023-07-06T21:57:58.810159+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.810159+0000","last_undegraded":"2023-07-06T21:57:58.810159+0000","last_fullsized":"2023-07-06T21:57:58.810159+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809451+0000","last_change":"2023-07-06T21:57:58.809451+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809451+0000","last_undegraded":"2023-07-06T21:57:58.809451+0000","last_fullsized":"2023-07-06T21:57:58.809451+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.812158+0000","last_change":"2023-07-06T21:57:58.812158+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.812158+0000","last_undegraded":"2023-07-06T21:57:58.812158+0000","last_fullsized":"2023-07-06T21:57:58.812158+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.810423+0000","last_change":"2023-07-06T21:57:58.810423+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.810423+0000","last_undegraded":"2023-07-06T21:57:58.810423+0000","last_fullsized":"2023-07-06T21:57:58.810423+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807324+0000","last_change":"2023-07-06T21:57:58.807324+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807324+0000","last_undegraded":"2023-07-06T21:57:58.807324+0000","last_fullsized":"2023-07-06T21:57:58.807324+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.808769+0000","last_change":"2023-07-06T21:57:58.808769+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.808769+0000","last_undegraded":"2023-07-06T21:57:58.808769+0000","last_fullsized":"2023-07-06T21:57:58.808769+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809439+0000","last_change":"2023-07-06T21:57:58.809439+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809439+0000","last_undegraded":"2023-07-06T21:57:58.809439+0000","last_fullsized":"2023-07-06T21:57:58.809439+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809646+0000","last_change":"2023-07-06T21:57:58.809646+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809646+0000","last_undegraded":"2023-07-06T21:57:58.809646+0000","last_fullsized":"2023-07-06T21:57:58.809646+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807432+0000","last_change":"2023-07-06T21:57:58.807432+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807432+0000","last_undegraded":"2023-07-06T21:57:58.807432+0000","last_fullsized":"2023-07-06T21:57:58.807432+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807708+0000","last_change":"2023-07-06T21:57:58.807708+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807708+0000","last_undegraded":"2023-07-06T21:57:58.807708+0000","last_fullsized":"2023-07-06T21:57:58.807708+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.806862+0000","last_change":"2023-07-06T21:57:58.806862+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.806862+0000","last_undegraded":"2023-07-06T21:57:58.806862+0000","last_fullsized":"2023-07-06T21:57:58.806862+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809323+0000","last_change":"2023-07-06T21:57:58.809323+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809323+0000","last_undegraded":"2023-07-06T21:57:58.809323+0000","last_fullsized":"2023-07-06T21:57:58.809323+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.806963+0000","last_change":"2023-07-06T21:57:58.806963+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.806963+0000","last_undegraded":"2023-07-06T21:57:58.806963+0000","last_fullsized":"2023-07-06T21:57:58.806963+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.805718+0000","last_change":"2023-07-06T21:57:58.805718+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.805718+0000","last_undegraded":"2023-07-06T21:57:58.805718+0000","last_fullsized":"2023-07-06T21:57:58.805718+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"91'183","reported_seq":562,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.806300+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:57:58.806300+0000","last_peered":"2023-07-06T21:57:58.806300+0000","last_clean":"2023-07-06T21:57:58.806300+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:57:58.806300+0000","last_undegraded":"2023-07-06T21:57:58.806300+0000","last_fullsized":"2023-07-06T21:57:58.806300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:23:13.567230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":156,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.811023+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:57:58.811023+0000","last_peered":"2023-07-06T21:57:58.811023+0000","last_clean":"2023-07-06T21:57:58.811023+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:57:58.811023+0000","last_undegraded":"2023-07-06T21:57:58.811023+0000","last_fullsized":"2023-07-06T21:57:58.811023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:09.361677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.808310+0000","last_change":"2023-07-06T21:57:58.808310+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.808310+0000","last_undegraded":"2023-07-06T21:57:58.808310+0000","last_fullsized":"2023-07-06T21:57:58.808310+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.806211+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:57:58.806211+0000","last_peered":"2023-07-06T21:57:58.806211+0000","last_clean":"2023-07-06T21:57:58.806211+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:57:58.806211+0000","last_undegraded":"2023-07-06T21:57:58.806211+0000","last_fullsized":"2023-07-06T21:57:58.806211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:31:14.596762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807487+0000","last_change":"2023-07-06T21:57:58.807487+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807487+0000","last_undegraded":"2023-07-06T21:57:58.807487+0000","last_fullsized":"2023-07-06T21:57:58.807487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.802640+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:57:58.802640+0000","last_peered":"2023-07-06T21:57:58.802640+0000","last_clean":"2023-07-06T21:57:58.802640+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:57:58.802640+0000","last_undegraded":"2023-07-06T21:57:58.802640+0000","last_fullsized":"2023-07-06T21:57:58.802640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:29:42.179292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807380+0000","last_change":"2023-07-06T21:57:58.807380+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807380+0000","last_undegraded":"2023-07-06T21:57:58.807380+0000","last_fullsized":"2023-07-06T21:57:58.807380+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.811013+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:57:58.811013+0000","last_peered":"2023-07-06T21:57:58.811013+0000","last_clean":"2023-07-06T21:57:58.811013+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:57:58.811013+0000","last_undegraded":"2023-07-06T21:57:58.811013+0000","last_fullsized":"2023-07-06T21:57:58.811013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:09:58.457076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.804652+0000","last_change":"2023-07-06T21:57:58.804652+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.804652+0000","last_undegraded":"2023-07-06T21:57:58.804652+0000","last_fullsized":"2023-07-06T21:57:58.804652+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.810509+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:57:58.810509+0000","last_peered":"2023-07-06T21:57:58.810509+0000","last_clean":"2023-07-06T21:57:58.810509+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:57:58.810509+0000","last_undegraded":"2023-07-06T21:57:58.810509+0000","last_fullsized":"2023-07-06T21:57:58.810509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:41:19.613069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.812095+0000","last_change":"2023-07-06T21:57:58.812095+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.812095+0000","last_undegraded":"2023-07-06T21:57:58.812095+0000","last_fullsized":"2023-07-06T21:57:58.812095+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.806521+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:57:58.806521+0000","last_peered":"2023-07-06T21:57:58.806521+0000","last_clean":"2023-07-06T21:57:58.806521+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:57:58.806521+0000","last_undegraded":"2023-07-06T21:57:58.806521+0000","last_fullsized":"2023-07-06T21:57:58.806521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:05:03.904478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.812398+0000","last_change":"2023-07-06T21:57:58.812398+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.812398+0000","last_undegraded":"2023-07-06T21:57:58.812398+0000","last_fullsized":"2023-07-06T21:57:58.812398+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.810656+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:57:58.810656+0000","last_peered":"2023-07-06T21:57:58.810656+0000","last_clean":"2023-07-06T21:57:58.810656+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:57:58.810656+0000","last_undegraded":"2023-07-06T21:57:58.810656+0000","last_fullsized":"2023-07-06T21:57:58.810656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:06:47.388507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.804610+0000","last_change":"2023-07-06T21:57:58.804610+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.804610+0000","last_undegraded":"2023-07-06T21:57:58.804610+0000","last_fullsized":"2023-07-06T21:57:58.804610+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.810277+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:57:58.810277+0000","last_peered":"2023-07-06T21:57:58.810277+0000","last_clean":"2023-07-06T21:57:58.810277+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:57:58.810277+0000","last_undegraded":"2023-07-06T21:57:58.810277+0000","last_fullsized":"2023-07-06T21:57:58.810277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:19:33.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575041,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36920,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334920,"statfs":{"total":96636764160,"available":96598958080,"internally_reserved":0,"allocated":1818624,"data_stored":1232900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.54200000000000004,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":0.93600000000000005,"5min":0.93999999999999995,"15min":0.97699999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.56599999999999995,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":0.876,"5min":0.98799999999999999,"15min":0.99399999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.34799999999999998},"max":{"1min":0.89200000000000002,"5min":0.98399999999999999,"15min":1.0649999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.90500000000000003,"5min":0.94099999999999995,"15min":0.97899999999999998},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.56299999999999994,"5min":0.377,"15min":0.377},"max":{"1min":0.86099999999999999,"5min":0.94799999999999995,"15min":0.94999999999999996},"last":0.623},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.46899999999999997,"15min":0.42599999999999999},"max":{"1min":0.91600000000000004,"5min":1.0209999999999999,"15min":1.0529999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71299999999999997,"15min":0.71899999999999997},"min":{"1min":0.60099999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84499999999999997,"5min":0.91800000000000004,"15min":1.0469999999999999},"last":0.745},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.55000000000000004,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":0.96599999999999997,"15min":1.006},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.83299999999999996,"15min":0.999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.96299999999999997},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56799999999999995,"15min":0.58399999999999996},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.34999999999999998},"max":{"1min":0.83199999999999996,"5min":0.89500000000000002,"15min":0.98499999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.99199999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.51200000000000001,"5min":0.44,"15min":0.40200000000000002},"max":{"1min":0.85799999999999998,"5min":0.93200000000000005,"15min":1.0309999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.496,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.79900000000000004,"5min":0.98399999999999999,"15min":1.0940000000000001},"last":0.77400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575041,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1220608,"data_stored":641513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70799999999999996,"15min":0.70499999999999996},"min":{"1min":0.502,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94699999999999995,"5min":0.97899999999999998,"15min":1.0980000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.38300000000000001},"max":{"1min":1.1830000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.71299999999999997},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.73899999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.41599999999999998},"max":{"1min":0.874,"5min":1.0129999999999999,"15min":1.3859999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.749,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":1.135,"5min":1.159,"15min":1.204},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.498},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":1.4339999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82699999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0509999999999999,"15min":1.321},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.63100000000000001},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.36299999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.0089999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68700000000000006,"15min":0.71099999999999997},"min":{"1min":0.55200000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":1.3089999999999999,"15min":1.631},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.41699999999999998},"max":{"1min":1.0029999999999999,"5min":1.2549999999999999,"15min":1.3600000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.66500000000000004},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.6930000000000001},"last":0.70699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1224704,"data_stored":642532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.92300000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69999999999999996,"15min":0.72099999999999997},"min":{"1min":0.51600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.55400000000000005,"5min":0.40200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89700000000000002,"5min":1.0269999999999999,"15min":1.131},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":1.0329999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.56000000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0369999999999999},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.58099999999999996,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98899999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.79600000000000004}]},{"osd":4,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.77600000000000002,"5min":0.78900000000000003,"15min":1},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.91800000000000004,"15min":1.02},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":1.052},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.45400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81899999999999995,"5min":0.83599999999999997,"15min":0.96699999999999997},"last":0.82099999999999995}]},{"osd":7,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63400000000000001,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85799999999999998,"5min":0.92200000000000004,"15min":1.0529999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65300000000000002,"15min":0.68100000000000005},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95299999999999996,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.83399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1212416,"data_stored":636042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.46500000000000002,"15min":0.39400000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88,"5min":1.123,"15min":1.123},"last":0.80900000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.44},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.361},"last":0.747},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2829999999999999},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":0.84799999999999998,"5min":0.95299999999999996,"15min":1.2170000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.751},"min":{"1min":0.498,"5min":0.498,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":0.94299999999999995,"15min":1.649},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.4219999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.49099999999999999},"max":{"1min":0.91400000000000003,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.308},"max":{"1min":0.85999999999999999,"5min":0.86399999999999999,"15min":1.246},"last":0.502},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.96099999999999997,"5min":0.97299999999999998,"15min":1.8049999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.36299999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.478},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":0.94999999999999996,"5min":0.99199999999999999,"15min":1.7250000000000001},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42399999999999999},"max":{"1min":1.0149999999999999,"5min":1.0720000000000001,"15min":1.534},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.47099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96399999999999997,"5min":1.01,"15min":1.585},"last":0.76500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1212416,"data_stored":636042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.85499999999999998,"15min":1.0489999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.67800000000000005,"5min":2.77,"15min":2.77},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.503,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.309,"15min":0.24299999999999999},"max":{"1min":0.77600000000000002,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":1.351,"15min":1.9590000000000001},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":0.73999999999999999,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.497},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":2.012},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":0.97299999999999998,"5min":1.1930000000000001,"15min":1.855},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0109999999999999,"5min":1.383,"15min":1.524},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80300000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.625},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.44800000000000001},"max":{"1min":1.0700000000000001,"5min":1.327,"15min":1.883},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.46600000000000003,"15min":0.40000000000000002},"max":{"1min":1.129,"5min":1.425,"15min":1.425},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.81399999999999995,"15min":0.80700000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47899999999999998},"max":{"1min":1.097,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.51000000000000001,"5min":0.5,"15min":0.497},"max":{"1min":1.004,"5min":3.097,"15min":3.097},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.81100000000000005},"min":{"1min":0.54500000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.1140000000000001,"15min":1.9830000000000001},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1224704,"data_stored":642532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45900000000000002,"15min":0.45100000000000001},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67100000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.495},"min":{"1min":0.28699999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.71799999999999997,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.878,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.76100000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.34499999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.76500000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.57599999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.71899999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.56000000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.113,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80900000000000005,"15min":0.79700000000000004},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0469999999999999,"5min":1.591,"15min":1.591},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80200000000000005,"15min":0.79300000000000004},"min":{"1min":0.57499999999999996,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.1399999999999999,"5min":1.333,"15min":1.333},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81000000000000005,"15min":0.81699999999999995},"min":{"1min":0.60299999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1850000000000001,"5min":1.327,"15min":1.327},"last":0.98799999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.58499999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.497},"max":{"1min":1.153,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.629,"5min":0.496,"15min":0.496},"max":{"1min":1.262,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.878},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83099999999999996,"15min":0.83599999999999997},"min":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2170000000000001,"5min":1.296,"15min":1.369},"last":0.91100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575041,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58484,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313356,"statfs":{"total":96636764160,"available":96576876544,"internally_reserved":0,"allocated":1224704,"data_stored":642532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.309,"5min":0.29499999999999998,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.68899999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.33300000000000002},"max":{"1min":0.68700000000000006,"5min":0.87,"15min":0.87},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.32000000000000001},"max":{"1min":0.71699999999999997,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.505}]},{"osd":4,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.61899999999999999,"5min":0.49199999999999999,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.143,"15min":1.3140000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":1.02,"5min":1.022,"15min":1.2290000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.497,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.095,"5min":1.1890000000000001,"15min":1.4359999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78400000000000003,"15min":0.79300000000000004},"min":{"1min":0.66100000000000003,"5min":0.50700000000000001,"15min":0.439},"max":{"1min":1.026,"5min":1.044,"15min":1.357},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.53400000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.042,"5min":1.278,"15min":1.278},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79900000000000004,"15min":0.80100000000000005},"min":{"1min":0.65000000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.456},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.80500000000000005,"15min":0.80800000000000005},"min":{"1min":0.61499999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.056,"5min":1.0820000000000001,"15min":1.417},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80300000000000005,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.5,"15min":0.5},"max":{"1min":1.0349999999999999,"5min":1.3280000000000001,"15min":1.397},"last":0.629}]}]},{"osd":0,"up_from":13,"seq":55834575040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36916,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334924,"statfs":{"total":96636764160,"available":96598962176,"internally_reserved":0,"allocated":1814528,"data_stored":1231881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.54900000000000004,"5min":0.86399999999999999,"15min":1.1459999999999999},"last":0.374},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.28599999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86799999999999999,"5min":0.98099999999999998,"15min":1.5189999999999999},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.313,"5min":0.313,"15min":0.30099999999999999},"max":{"1min":0.61099999999999999,"5min":0.81100000000000005,"15min":1.228},"last":0.499},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67000000000000004,"5min":1.2050000000000001,"15min":1.454},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70999999999999996,"5min":1.151,"15min":1.7969999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76400000000000001,"5min":0.83099999999999996,"15min":1.7190000000000001},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76600000000000001,"15min":0.78900000000000003},"min":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0109999999999999,"5min":1.1319999999999999,"15min":1.911},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3620000000000001},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.38400000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.3700000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.77200000000000002,"15min":0.79500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50700000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":1.163,"15min":1.758},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.8220000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47199999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":2.266},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81599999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":2.323},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.57499999999999996,"5min":0.50900000000000001,"15min":0.435},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:58:04.731 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:58:04.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.916+0000 7f69063d2640 1 Processor -- start 2023-07-06T21:58:04.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.916+0000 7f69063d2640 1 -- start start 2023-07-06T21:58:04.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.916+0000 7f69063d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f69001587d0 0x7f6900070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.916+0000 7f69063d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690006fae0 con 0x7f69000710c0 2023-07-06T21:58:04.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.916+0000 7f69063d2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690006fdc0 con 0x7f6900158400 2023-07-06T21:58:04.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.916+0000 7f69063d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69000700a0 con 0x7f69001587d0 2023-07-06T21:58:04.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.916+0000 7f68ff7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f69001587d0 0x7f6900070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.916+0000 7f690496f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f69000710c0 0x7f69000cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56976/0 (socket says 172.21.15.55:56976) 2023-07-06T21:58:04.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.916+0000 7f690496f640 1 -- 172.21.15.55:0/817243589 learned_addr learned my addr 172.21.15.55:0/817243589 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:04.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.920+0000 7f68ff7fe640 1 -- 172.21.15.55:0/817243589 >> v1:172.21.15.138:6789/0 conn(0x7f6900158400 legacy=0x7f69000c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.920+0000 7f68ff7fe640 1 -- 172.21.15.55:0/817243589 >> v1:172.21.15.55:6789/0 conn(0x7f69000710c0 legacy=0x7f69000cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.920+0000 7f68ff7fe640 1 -- 172.21.15.55:0/817243589 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6900070380 con 0x7f69001587d0 2023-07-06T21:58:04.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.920+0000 7f68feffd640 1 -- 172.21.15.55:0/817243589 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970967486 0 0) 0x7f690006fae0 con 0x7f69000710c0 2023-07-06T21:58:04.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.920+0000 7f68ff7fe640 1 --2- 172.21.15.55:0/817243589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69001587d0 0x7f6900070b80 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f68f40097c0 tx=0x7f68f401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec865cad2049e7f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:04.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.920+0000 7f68feffd640 1 -- 172.21.15.55:0/817243589 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f40ad660 con 0x7f69001587d0 2023-07-06T21:58:04.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.920+0000 7f68feffd640 1 -- 172.21.15.55:0/817243589 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f40ad7c0 con 0x7f69001587d0 2023-07-06T21:58:04.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.920+0000 7f68feffd640 1 -- 172.21.15.55:0/817243589 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f40adb50 con 0x7f69001587d0 2023-07-06T21:58:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 -- 172.21.15.55:0/817243589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69001587d0 msgr2=0x7f6900070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 --2- 172.21.15.55:0/817243589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69001587d0 0x7f6900070b80 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f68f40097c0 tx=0x7f68f401c450 comp rx=0 tx=0).stop 2023-07-06T21:58:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 -- 172.21.15.55:0/817243589 shutdown_connections 2023-07-06T21:58:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 --2- 172.21.15.55:0/817243589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69001587d0 0x7f6900070b80 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 -- 172.21.15.55:0/817243589 >> 172.21.15.55:0/817243589 conn(0x7f69000cded0 msgr2=0x7f69000ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:04.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 -- 172.21.15.55:0/817243589 shutdown_connections 2023-07-06T21:58:04.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 -- 172.21.15.55:0/817243589 wait complete. 2023-07-06T21:58:04.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 Processor -- start 2023-07-06T21:58:04.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 -- start start 2023-07-06T21:58:04.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69000710c0 0x7f6900142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6900158400 0x7f6900143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69001587d0 0x7f69001436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690014f630 con 0x7f6900158400 2023-07-06T21:58:04.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69001f8d10 con 0x7f69001587d0 2023-07-06T21:58:04.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f69063d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690014f880 con 0x7f69000710c0 2023-07-06T21:58:04.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f68ff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6900158400 0x7f6900143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f68ff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6900158400 0x7f6900143190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34834/0 (socket says 172.21.15.55:34834) 2023-07-06T21:58:04.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f68ff7fe640 1 -- 172.21.15.55:0/1336948142 learned_addr learned my addr 172.21.15.55:0/1336948142 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:04.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f690496f640 1 --2- 172.21.15.55:0/1336948142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69001587d0 0x7f69001436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f68fffff640 1 --2- 172.21.15.55:0/1336948142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69000710c0 0x7f6900142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f68ff7fe640 1 -- 172.21.15.55:0/1336948142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69000710c0 msgr2=0x7f6900142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f68ff7fe640 1 --2- 172.21.15.55:0/1336948142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69000710c0 0x7f6900142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f68ff7fe640 1 -- 172.21.15.55:0/1336948142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69001587d0 msgr2=0x7f69001436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:04.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f68ff7fe640 1 --2- 172.21.15.55:0/1336948142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69001587d0 0x7f69001436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:04.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.924+0000 7f68ff7fe640 1 -- 172.21.15.55:0/1336948142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f4009420 con 0x7f6900158400 2023-07-06T21:58:04.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.928+0000 7f68ff7fe640 1 --2- 172.21.15.55:0/1336948142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6900158400 0x7f6900143190 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f68f40b0040 tx=0x7f68f401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:04.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.928+0000 7f68fcff9640 1 -- 172.21.15.55:0/1336948142 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f40b9860 con 0x7f6900158400 2023-07-06T21:58:04.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.928+0000 7f68fcff9640 1 -- 172.21.15.55:0/1336948142 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f40b99e0 con 0x7f6900158400 2023-07-06T21:58:04.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.928+0000 7f68fcff9640 1 -- 172.21.15.55:0/1336948142 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f40b9d90 con 0x7f6900158400 2023-07-06T21:58:04.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.928+0000 7f69063d2640 1 -- 172.21.15.55:0/1336948142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690014fb60 con 0x7f6900158400 2023-07-06T21:58:04.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.928+0000 7f69063d2640 1 -- 172.21.15.55:0/1336948142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6900150120 con 0x7f6900158400 2023-07-06T21:58:04.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.928+0000 7f69063d2640 1 -- 172.21.15.55:0/1336948142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690006c580 con 0x7f6900158400 2023-07-06T21:58:04.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.928+0000 7f68fcff9640 1 -- 172.21.15.55:0/1336948142 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f68f40c4460 con 0x7f6900158400 2023-07-06T21:58:04.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.928+0000 7f68fcff9640 1 --2- 172.21.15.55:0/1336948142 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f68ec0663a0 0x7f68ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:04.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.932+0000 7f68fcff9640 1 -- 172.21.15.55:0/1336948142 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f68f411ec60 con 0x7f6900158400 2023-07-06T21:58:04.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.932+0000 7f68fffff640 1 --2- 172.21.15.55:0/1336948142 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f68ec0663a0 0x7f68ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:04.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.932+0000 7f68fffff640 1 --2- 172.21.15.55:0/1336948142 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f68ec0663a0 0x7f68ec068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f68f0007fd0 tx=0x7f68f0009040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:04.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:04.936+0000 7f68fcff9640 1 -- 172.21.15.55:0/1336948142 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f68f40ebeb0 con 0x7f6900158400 2023-07-06T21:58:05.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.088+0000 7f69063d2640 1 -- 172.21.15.55:0/1336948142 --> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69001665e0 con 0x7f68ec0663a0 2023-07-06T21:58:05.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.096+0000 7f68fcff9640 1 -- 172.21.15.55:0/1336948142 <== mgr.7191 v2:172.21.15.55:6832/703944479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299578 (secure 0 0 0) 0x7f68f00014f0 con 0x7f68ec0663a0 2023-07-06T21:58:05.099 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:05.100 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:58:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.100+0000 7f69063d2640 1 -- 172.21.15.55:0/1336948142 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f68ec0663a0 msgr2=0x7f68ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.100+0000 7f69063d2640 1 --2- 172.21.15.55:0/1336948142 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f68ec0663a0 0x7f68ec068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f68f0007fd0 tx=0x7f68f0009040 comp rx=0 tx=0).stop 2023-07-06T21:58:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.100+0000 7f69063d2640 1 -- 172.21.15.55:0/1336948142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6900158400 msgr2=0x7f6900143190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.100+0000 7f69063d2640 1 --2- 172.21.15.55:0/1336948142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6900158400 0x7f6900143190 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f68f40b0040 tx=0x7f68f401ac90 comp rx=0 tx=0).stop 2023-07-06T21:58:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.100+0000 7f69063d2640 1 -- 172.21.15.55:0/1336948142 shutdown_connections 2023-07-06T21:58:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.100+0000 7f69063d2640 1 --2- 172.21.15.55:0/1336948142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69001587d0 0x7f69001436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.100+0000 7f69063d2640 1 --2- 172.21.15.55:0/1336948142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6900158400 0x7f6900143190 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.100+0000 7f69063d2640 1 --2- 172.21.15.55:0/1336948142 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f68ec0663a0 0x7f68ec068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.100+0000 7f69063d2640 1 --2- 172.21.15.55:0/1336948142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69000710c0 0x7f6900142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.100+0000 7f69063d2640 1 -- 172.21.15.55:0/1336948142 >> 172.21.15.55:0/1336948142 conn(0x7f69000cded0 msgr2=0x7f6900151970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.100+0000 7f69063d2640 1 -- 172.21.15.55:0/1336948142 shutdown_connections 2023-07-06T21:58:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.100+0000 7f69063d2640 1 -- 172.21.15.55:0/1336948142 wait complete. 2023-07-06T21:58:05.119 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T21:58:03.706020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":301704,"kb_used_data":10696,"kb_used_omap":0,"kb_used_meta":290944,"kb_avail":754673016,"statfs":{"total":773094113280,"available":772785168384,"internally_reserved":0,"allocated":10952704,"data_stored":6305974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":297926656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.905224"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809651+0000","last_change":"2023-07-06T21:57:58.809651+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809651+0000","last_undegraded":"2023-07-06T21:57:58.809651+0000","last_fullsized":"2023-07-06T21:57:58.809651+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.808045+0000","last_change":"2023-07-06T21:57:58.808045+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.808045+0000","last_undegraded":"2023-07-06T21:57:58.808045+0000","last_fullsized":"2023-07-06T21:57:58.808045+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807353+0000","last_change":"2023-07-06T21:57:58.807353+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807353+0000","last_undegraded":"2023-07-06T21:57:58.807353+0000","last_fullsized":"2023-07-06T21:57:58.807353+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807928+0000","last_change":"2023-07-06T21:57:58.807928+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807928+0000","last_undegraded":"2023-07-06T21:57:58.807928+0000","last_fullsized":"2023-07-06T21:57:58.807928+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807934+0000","last_change":"2023-07-06T21:57:58.807934+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807934+0000","last_undegraded":"2023-07-06T21:57:58.807934+0000","last_fullsized":"2023-07-06T21:57:58.807934+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807490+0000","last_change":"2023-07-06T21:57:58.807490+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807490+0000","last_undegraded":"2023-07-06T21:57:58.807490+0000","last_fullsized":"2023-07-06T21:57:58.807490+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807264+0000","last_change":"2023-07-06T21:57:58.807264+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807264+0000","last_undegraded":"2023-07-06T21:57:58.807264+0000","last_fullsized":"2023-07-06T21:57:58.807264+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.808701+0000","last_change":"2023-07-06T21:57:58.808701+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.808701+0000","last_undegraded":"2023-07-06T21:57:58.808701+0000","last_fullsized":"2023-07-06T21:57:58.808701+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809154+0000","last_change":"2023-07-06T21:57:58.809154+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809154+0000","last_undegraded":"2023-07-06T21:57:58.809154+0000","last_fullsized":"2023-07-06T21:57:58.809154+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807574+0000","last_change":"2023-07-06T21:57:58.807574+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807574+0000","last_undegraded":"2023-07-06T21:57:58.807574+0000","last_fullsized":"2023-07-06T21:57:58.807574+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809075+0000","last_change":"2023-07-06T21:57:58.809075+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809075+0000","last_undegraded":"2023-07-06T21:57:58.809075+0000","last_fullsized":"2023-07-06T21:57:58.809075+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.810159+0000","last_change":"2023-07-06T21:57:58.810159+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.810159+0000","last_undegraded":"2023-07-06T21:57:58.810159+0000","last_fullsized":"2023-07-06T21:57:58.810159+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809451+0000","last_change":"2023-07-06T21:57:58.809451+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809451+0000","last_undegraded":"2023-07-06T21:57:58.809451+0000","last_fullsized":"2023-07-06T21:57:58.809451+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.812158+0000","last_change":"2023-07-06T21:57:58.812158+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.812158+0000","last_undegraded":"2023-07-06T21:57:58.812158+0000","last_fullsized":"2023-07-06T21:57:58.812158+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.810423+0000","last_change":"2023-07-06T21:57:58.810423+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.810423+0000","last_undegraded":"2023-07-06T21:57:58.810423+0000","last_fullsized":"2023-07-06T21:57:58.810423+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807324+0000","last_change":"2023-07-06T21:57:58.807324+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807324+0000","last_undegraded":"2023-07-06T21:57:58.807324+0000","last_fullsized":"2023-07-06T21:57:58.807324+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.808769+0000","last_change":"2023-07-06T21:57:58.808769+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.808769+0000","last_undegraded":"2023-07-06T21:57:58.808769+0000","last_fullsized":"2023-07-06T21:57:58.808769+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809439+0000","last_change":"2023-07-06T21:57:58.809439+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809439+0000","last_undegraded":"2023-07-06T21:57:58.809439+0000","last_fullsized":"2023-07-06T21:57:58.809439+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809646+0000","last_change":"2023-07-06T21:57:58.809646+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809646+0000","last_undegraded":"2023-07-06T21:57:58.809646+0000","last_fullsized":"2023-07-06T21:57:58.809646+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807432+0000","last_change":"2023-07-06T21:57:58.807432+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807432+0000","last_undegraded":"2023-07-06T21:57:58.807432+0000","last_fullsized":"2023-07-06T21:57:58.807432+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807708+0000","last_change":"2023-07-06T21:57:58.807708+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807708+0000","last_undegraded":"2023-07-06T21:57:58.807708+0000","last_fullsized":"2023-07-06T21:57:58.807708+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.806862+0000","last_change":"2023-07-06T21:57:58.806862+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.806862+0000","last_undegraded":"2023-07-06T21:57:58.806862+0000","last_fullsized":"2023-07-06T21:57:58.806862+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.809323+0000","last_change":"2023-07-06T21:57:58.809323+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.809323+0000","last_undegraded":"2023-07-06T21:57:58.809323+0000","last_fullsized":"2023-07-06T21:57:58.809323+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.806963+0000","last_change":"2023-07-06T21:57:58.806963+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.806963+0000","last_undegraded":"2023-07-06T21:57:58.806963+0000","last_fullsized":"2023-07-06T21:57:58.806963+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.805718+0000","last_change":"2023-07-06T21:57:58.805718+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.805718+0000","last_undegraded":"2023-07-06T21:57:58.805718+0000","last_fullsized":"2023-07-06T21:57:58.805718+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"91'183","reported_seq":562,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.806300+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:57:58.806300+0000","last_peered":"2023-07-06T21:57:58.806300+0000","last_clean":"2023-07-06T21:57:58.806300+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:57:58.806300+0000","last_undegraded":"2023-07-06T21:57:58.806300+0000","last_fullsized":"2023-07-06T21:57:58.806300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:23:13.567230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":156,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.811023+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:57:58.811023+0000","last_peered":"2023-07-06T21:57:58.811023+0000","last_clean":"2023-07-06T21:57:58.811023+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:57:58.811023+0000","last_undegraded":"2023-07-06T21:57:58.811023+0000","last_fullsized":"2023-07-06T21:57:58.811023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:09.361677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.808310+0000","last_change":"2023-07-06T21:57:58.808310+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.808310+0000","last_undegraded":"2023-07-06T21:57:58.808310+0000","last_fullsized":"2023-07-06T21:57:58.808310+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.806211+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:57:58.806211+0000","last_peered":"2023-07-06T21:57:58.806211+0000","last_clean":"2023-07-06T21:57:58.806211+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:57:58.806211+0000","last_undegraded":"2023-07-06T21:57:58.806211+0000","last_fullsized":"2023-07-06T21:57:58.806211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:31:14.596762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807487+0000","last_change":"2023-07-06T21:57:58.807487+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807487+0000","last_undegraded":"2023-07-06T21:57:58.807487+0000","last_fullsized":"2023-07-06T21:57:58.807487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.802640+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:57:58.802640+0000","last_peered":"2023-07-06T21:57:58.802640+0000","last_clean":"2023-07-06T21:57:58.802640+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:57:58.802640+0000","last_undegraded":"2023-07-06T21:57:58.802640+0000","last_fullsized":"2023-07-06T21:57:58.802640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:29:42.179292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.807380+0000","last_change":"2023-07-06T21:57:58.807380+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.807380+0000","last_undegraded":"2023-07-06T21:57:58.807380+0000","last_fullsized":"2023-07-06T21:57:58.807380+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.811013+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:57:58.811013+0000","last_peered":"2023-07-06T21:57:58.811013+0000","last_clean":"2023-07-06T21:57:58.811013+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:57:58.811013+0000","last_undegraded":"2023-07-06T21:57:58.811013+0000","last_fullsized":"2023-07-06T21:57:58.811013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:09:58.457076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.804652+0000","last_change":"2023-07-06T21:57:58.804652+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.804652+0000","last_undegraded":"2023-07-06T21:57:58.804652+0000","last_fullsized":"2023-07-06T21:57:58.804652+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.810509+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:57:58.810509+0000","last_peered":"2023-07-06T21:57:58.810509+0000","last_clean":"2023-07-06T21:57:58.810509+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:57:58.810509+0000","last_undegraded":"2023-07-06T21:57:58.810509+0000","last_fullsized":"2023-07-06T21:57:58.810509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:41:19.613069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.812095+0000","last_change":"2023-07-06T21:57:58.812095+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.812095+0000","last_undegraded":"2023-07-06T21:57:58.812095+0000","last_fullsized":"2023-07-06T21:57:58.812095+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.806521+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:57:58.806521+0000","last_peered":"2023-07-06T21:57:58.806521+0000","last_clean":"2023-07-06T21:57:58.806521+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:57:58.806521+0000","last_undegraded":"2023-07-06T21:57:58.806521+0000","last_fullsized":"2023-07-06T21:57:58.806521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:05:03.904478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.812398+0000","last_change":"2023-07-06T21:57:58.812398+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.812398+0000","last_undegraded":"2023-07-06T21:57:58.812398+0000","last_fullsized":"2023-07-06T21:57:58.812398+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.810656+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:57:58.810656+0000","last_peered":"2023-07-06T21:57:58.810656+0000","last_clean":"2023-07-06T21:57:58.810656+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:57:58.810656+0000","last_undegraded":"2023-07-06T21:57:58.810656+0000","last_fullsized":"2023-07-06T21:57:58.810656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:06:47.388507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:57:59.800148+0000","last_change":"2023-07-06T21:57:59.800148+0000","last_active":"2023-07-06T21:57:59.800148+0000","last_peered":"2023-07-06T21:57:59.800148+0000","last_clean":"2023-07-06T21:57:59.800148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:59.800148+0000","last_undegraded":"2023-07-06T21:57:59.800148+0000","last_fullsized":"2023-07-06T21:57:59.800148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2023-07-06T21:57:58.804610+0000","last_change":"2023-07-06T21:57:58.804610+0000","last_active":"2023-07-06T21:57:58.789003+0000","last_peered":"2023-07-06T21:57:58.789003+0000","last_clean":"2023-07-06T21:57:58.789003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:57:58.804610+0000","last_undegraded":"2023-07-06T21:57:58.804610+0000","last_fullsized":"2023-07-06T21:57:58.804610+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-07-06T21:57:58.810277+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:57:58.810277+0000","last_peered":"2023-07-06T21:57:58.810277+0000","last_clean":"2023-07-06T21:57:58.810277+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:57:58.810277+0000","last_undegraded":"2023-07-06T21:57:58.810277+0000","last_fullsized":"2023-07-06T21:57:58.810277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:19:33.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575041,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36920,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334920,"statfs":{"total":96636764160,"available":96598958080,"internally_reserved":0,"allocated":1818624,"data_stored":1232900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.54200000000000004,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":0.93600000000000005,"5min":0.93999999999999995,"15min":0.97699999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.56599999999999995,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":0.876,"5min":0.98799999999999999,"15min":0.99399999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.34799999999999998},"max":{"1min":0.89200000000000002,"5min":0.98399999999999999,"15min":1.0649999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.90500000000000003,"5min":0.94099999999999995,"15min":0.97899999999999998},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.56299999999999994,"5min":0.377,"15min":0.377},"max":{"1min":0.86099999999999999,"5min":0.94799999999999995,"15min":0.94999999999999996},"last":0.623},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.46899999999999997,"15min":0.42599999999999999},"max":{"1min":0.91600000000000004,"5min":1.0209999999999999,"15min":1.0529999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71299999999999997,"15min":0.71899999999999997},"min":{"1min":0.60099999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84499999999999997,"5min":0.91800000000000004,"15min":1.0469999999999999},"last":0.745},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.55000000000000004,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":0.96599999999999997,"15min":1.006},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.83299999999999996,"15min":0.999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.96299999999999997},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56799999999999995,"15min":0.58399999999999996},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.34999999999999998},"max":{"1min":0.83199999999999996,"5min":0.89500000000000002,"15min":0.98499999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.99199999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.51200000000000001,"5min":0.44,"15min":0.40200000000000002},"max":{"1min":0.85799999999999998,"5min":0.93200000000000005,"15min":1.0309999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.496,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.79900000000000004,"5min":0.98399999999999999,"15min":1.0940000000000001},"last":0.77400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575041,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1220608,"data_stored":641513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70799999999999996,"15min":0.70499999999999996},"min":{"1min":0.502,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94699999999999995,"5min":0.97899999999999998,"15min":1.0980000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.38300000000000001},"max":{"1min":1.1830000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.71299999999999997},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.73899999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.41599999999999998},"max":{"1min":0.874,"5min":1.0129999999999999,"15min":1.3859999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.749,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":1.135,"5min":1.159,"15min":1.204},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.498},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":1.4339999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82699999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0509999999999999,"15min":1.321},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.63100000000000001},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.36299999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.0089999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68700000000000006,"15min":0.71099999999999997},"min":{"1min":0.55200000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":1.3089999999999999,"15min":1.631},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.41699999999999998},"max":{"1min":1.0029999999999999,"5min":1.2549999999999999,"15min":1.3600000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.66500000000000004},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.6930000000000001},"last":0.70699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1224704,"data_stored":642532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.92300000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69999999999999996,"15min":0.72099999999999997},"min":{"1min":0.51600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.55400000000000005,"5min":0.40200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89700000000000002,"5min":1.0269999999999999,"15min":1.131},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":1.0329999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.56000000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0369999999999999},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.58099999999999996,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98899999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.79600000000000004}]},{"osd":4,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.77600000000000002,"5min":0.78900000000000003,"15min":1},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.91800000000000004,"15min":1.02},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":1.052},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.45400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81899999999999995,"5min":0.83599999999999997,"15min":0.96699999999999997},"last":0.82099999999999995}]},{"osd":7,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63400000000000001,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85799999999999998,"5min":0.92200000000000004,"15min":1.0529999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65300000000000002,"15min":0.68100000000000005},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95299999999999996,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.83399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1212416,"data_stored":636042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.46500000000000002,"15min":0.39400000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88,"5min":1.123,"15min":1.123},"last":0.80900000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.44},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.361},"last":0.747},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2829999999999999},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":0.84799999999999998,"5min":0.95299999999999996,"15min":1.2170000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.751},"min":{"1min":0.498,"5min":0.498,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":0.94299999999999995,"15min":1.649},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.4219999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.49099999999999999},"max":{"1min":0.91400000000000003,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.308},"max":{"1min":0.85999999999999999,"5min":0.86399999999999999,"15min":1.246},"last":0.502},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.96099999999999997,"5min":0.97299999999999998,"15min":1.8049999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.36299999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.478},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":0.94999999999999996,"5min":0.99199999999999999,"15min":1.7250000000000001},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42399999999999999},"max":{"1min":1.0149999999999999,"5min":1.0720000000000001,"15min":1.534},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.47099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96399999999999997,"5min":1.01,"15min":1.585},"last":0.76500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1212416,"data_stored":636042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.85499999999999998,"15min":1.0489999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.67800000000000005,"5min":2.77,"15min":2.77},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.503,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.309,"15min":0.24299999999999999},"max":{"1min":0.77600000000000002,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":1.351,"15min":1.9590000000000001},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":0.73999999999999999,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.497},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":2.012},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":0.97299999999999998,"5min":1.1930000000000001,"15min":1.855},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0109999999999999,"5min":1.383,"15min":1.524},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80300000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.625},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.44800000000000001},"max":{"1min":1.0700000000000001,"5min":1.327,"15min":1.883},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.46600000000000003,"15min":0.40000000000000002},"max":{"1min":1.129,"5min":1.425,"15min":1.425},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.81399999999999995,"15min":0.80700000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47899999999999998},"max":{"1min":1.097,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.51000000000000001,"5min":0.5,"15min":0.497},"max":{"1min":1.004,"5min":3.097,"15min":3.097},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.81100000000000005},"min":{"1min":0.54500000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.1140000000000001,"15min":1.9830000000000001},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1224704,"data_stored":642532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45900000000000002,"15min":0.45100000000000001},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67100000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.495},"min":{"1min":0.28699999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.71799999999999997,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.878,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.76100000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.34499999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.76500000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.57599999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.71899999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.56000000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.113,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80900000000000005,"15min":0.79700000000000004},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0469999999999999,"5min":1.591,"15min":1.591},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80200000000000005,"15min":0.79300000000000004},"min":{"1min":0.57499999999999996,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.1399999999999999,"5min":1.333,"15min":1.333},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81000000000000005,"15min":0.81699999999999995},"min":{"1min":0.60299999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1850000000000001,"5min":1.327,"15min":1.327},"last":0.98799999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.58499999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.497},"max":{"1min":1.153,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.629,"5min":0.496,"15min":0.496},"max":{"1min":1.262,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.878},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83099999999999996,"15min":0.83599999999999997},"min":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2170000000000001,"5min":1.296,"15min":1.369},"last":0.91100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575041,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58484,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313356,"statfs":{"total":96636764160,"available":96576876544,"internally_reserved":0,"allocated":1224704,"data_stored":642532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.309,"5min":0.29499999999999998,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.68899999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.33300000000000002},"max":{"1min":0.68700000000000006,"5min":0.87,"15min":0.87},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.32000000000000001},"max":{"1min":0.71699999999999997,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.505}]},{"osd":4,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.61899999999999999,"5min":0.49199999999999999,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.143,"15min":1.3140000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":1.02,"5min":1.022,"15min":1.2290000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.497,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.095,"5min":1.1890000000000001,"15min":1.4359999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78400000000000003,"15min":0.79300000000000004},"min":{"1min":0.66100000000000003,"5min":0.50700000000000001,"15min":0.439},"max":{"1min":1.026,"5min":1.044,"15min":1.357},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.53400000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.042,"5min":1.278,"15min":1.278},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79900000000000004,"15min":0.80100000000000005},"min":{"1min":0.65000000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.456},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.80500000000000005,"15min":0.80800000000000005},"min":{"1min":0.61499999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.056,"5min":1.0820000000000001,"15min":1.417},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80300000000000005,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.5,"15min":0.5},"max":{"1min":1.0349999999999999,"5min":1.3280000000000001,"15min":1.397},"last":0.629}]}]},{"osd":0,"up_from":13,"seq":55834575040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36916,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334924,"statfs":{"total":96636764160,"available":96598962176,"internally_reserved":0,"allocated":1814528,"data_stored":1231881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.54900000000000004,"5min":0.86399999999999999,"15min":1.1459999999999999},"last":0.374},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.28599999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86799999999999999,"5min":0.98099999999999998,"15min":1.5189999999999999},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.313,"5min":0.313,"15min":0.30099999999999999},"max":{"1min":0.61099999999999999,"5min":0.81100000000000005,"15min":1.228},"last":0.499},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67000000000000004,"5min":1.2050000000000001,"15min":1.454},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70999999999999996,"5min":1.151,"15min":1.7969999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76400000000000001,"5min":0.83099999999999996,"15min":1.7190000000000001},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76600000000000001,"15min":0.78900000000000003},"min":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0109999999999999,"5min":1.1319999999999999,"15min":1.911},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3620000000000001},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.38400000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.3700000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.77200000000000002,"15min":0.79500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50700000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":1.163,"15min":1.758},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.8220000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47199999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":2.266},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81599999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":2.323},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.57499999999999996,"5min":0.50900000000000001,"15min":0.435},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:58:05.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-07-06T21:58:05.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-07-06T21:58:05.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-07-06T21:58:05.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2023-07-06T21:58:05.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-07-06T21:58:05.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-07-06T21:58:05.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2023-07-06T21:58:05.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-07-06T21:58:05.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-07-06T21:58:05.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-07-06T21:58:05.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-07-06T21:58:05.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-07-06T21:58:05.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-07-06T21:58:05.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2023-07-06T21:58:05.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-07-06T21:58:05.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-07-06T21:58:05.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-07-06T21:58:05.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2023-07-06T21:58:05.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-07-06T21:58:05.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2023-07-06T21:58:05.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2023-07-06T21:58:05.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-07-06T21:58:05.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-07-06T21:58:05.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2023-07-06T21:58:05.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-07-06T21:58:05.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-07-06T21:58:05.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-07-06T21:58:05.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-07-06T21:58:05.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-07-06T21:58:05.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-07-06T21:58:05.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-07-06T21:58:05.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-07-06T21:58:05.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-07-06T21:58:05.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-07-06T21:58:05.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.809651+0000', 'last_change': '2023-07-06T21:57:58.809651+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.809651+0000', 'last_undegraded': '2023-07-06T21:57:58.809651+0000', 'last_fullsized': '2023-07-06T21:57:58.809651+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T21:58:05.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-07-06T21:58:05.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-07-06T21:58:05.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.808045+0000', 'last_change': '2023-07-06T21:57:58.808045+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.808045+0000', 'last_undegraded': '2023-07-06T21:57:58.808045+0000', 'last_fullsized': '2023-07-06T21:57:58.808045+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T21:58:05.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-07-06T21:58:05.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-07-06T21:58:05.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.807353+0000', 'last_change': '2023-07-06T21:57:58.807353+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.807353+0000', 'last_undegraded': '2023-07-06T21:57:58.807353+0000', 'last_fullsized': '2023-07-06T21:57:58.807353+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:05.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-07-06T21:58:05.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-07-06T21:58:05.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.807928+0000', 'last_change': '2023-07-06T21:57:58.807928+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.807928+0000', 'last_undegraded': '2023-07-06T21:57:58.807928+0000', 'last_fullsized': '2023-07-06T21:57:58.807928+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:05.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-07-06T21:58:05.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-07-06T21:58:05.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.807934+0000', 'last_change': '2023-07-06T21:57:58.807934+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.807934+0000', 'last_undegraded': '2023-07-06T21:57:58.807934+0000', 'last_fullsized': '2023-07-06T21:57:58.807934+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T21:58:05.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-07-06T21:58:05.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-07-06T21:58:05.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.807490+0000', 'last_change': '2023-07-06T21:57:58.807490+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.807490+0000', 'last_undegraded': '2023-07-06T21:57:58.807490+0000', 'last_fullsized': '2023-07-06T21:57:58.807490+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T21:58:05.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-07-06T21:58:05.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-07-06T21:58:05.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.807264+0000', 'last_change': '2023-07-06T21:57:58.807264+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.807264+0000', 'last_undegraded': '2023-07-06T21:57:58.807264+0000', 'last_fullsized': '2023-07-06T21:57:58.807264+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:05.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-07-06T21:58:05.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-07-06T21:58:05.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.808701+0000', 'last_change': '2023-07-06T21:57:58.808701+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.808701+0000', 'last_undegraded': '2023-07-06T21:57:58.808701+0000', 'last_fullsized': '2023-07-06T21:57:58.808701+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T21:58:05.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-07-06T21:58:05.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-07-06T21:58:05.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.809154+0000', 'last_change': '2023-07-06T21:57:58.809154+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.809154+0000', 'last_undegraded': '2023-07-06T21:57:58.809154+0000', 'last_fullsized': '2023-07-06T21:57:58.809154+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T21:58:05.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-07-06T21:58:05.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-07-06T21:58:05.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.807574+0000', 'last_change': '2023-07-06T21:57:58.807574+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.807574+0000', 'last_undegraded': '2023-07-06T21:57:58.807574+0000', 'last_fullsized': '2023-07-06T21:57:58.807574+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T21:58:05.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-07-06T21:58:05.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-07-06T21:58:05.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.809075+0000', 'last_change': '2023-07-06T21:57:58.809075+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.809075+0000', 'last_undegraded': '2023-07-06T21:57:58.809075+0000', 'last_fullsized': '2023-07-06T21:57:58.809075+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T21:58:05.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-07-06T21:58:05.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-07-06T21:58:05.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.810159+0000', 'last_change': '2023-07-06T21:57:58.810159+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.810159+0000', 'last_undegraded': '2023-07-06T21:57:58.810159+0000', 'last_fullsized': '2023-07-06T21:57:58.810159+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T21:58:05.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-07-06T21:58:05.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-07-06T21:58:05.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.809451+0000', 'last_change': '2023-07-06T21:57:58.809451+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.809451+0000', 'last_undegraded': '2023-07-06T21:57:58.809451+0000', 'last_fullsized': '2023-07-06T21:57:58.809451+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T21:58:05.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-07-06T21:58:05.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-07-06T21:58:05.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.812158+0000', 'last_change': '2023-07-06T21:57:58.812158+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.812158+0000', 'last_undegraded': '2023-07-06T21:57:58.812158+0000', 'last_fullsized': '2023-07-06T21:57:58.812158+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T21:58:05.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-07-06T21:58:05.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-07-06T21:58:05.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.810423+0000', 'last_change': '2023-07-06T21:57:58.810423+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.810423+0000', 'last_undegraded': '2023-07-06T21:57:58.810423+0000', 'last_fullsized': '2023-07-06T21:57:58.810423+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T21:58:05.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-07-06T21:58:05.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-07-06T21:58:05.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.807324+0000', 'last_change': '2023-07-06T21:57:58.807324+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.807324+0000', 'last_undegraded': '2023-07-06T21:57:58.807324+0000', 'last_fullsized': '2023-07-06T21:57:58.807324+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:05.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-07-06T21:58:05.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-07-06T21:58:05.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.808769+0000', 'last_change': '2023-07-06T21:57:58.808769+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.808769+0000', 'last_undegraded': '2023-07-06T21:57:58.808769+0000', 'last_fullsized': '2023-07-06T21:57:58.808769+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T21:58:05.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-07-06T21:58:05.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-07-06T21:58:05.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.809439+0000', 'last_change': '2023-07-06T21:57:58.809439+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.809439+0000', 'last_undegraded': '2023-07-06T21:57:58.809439+0000', 'last_fullsized': '2023-07-06T21:57:58.809439+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T21:58:05.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-07-06T21:58:05.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-07-06T21:58:05.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.809646+0000', 'last_change': '2023-07-06T21:57:58.809646+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.809646+0000', 'last_undegraded': '2023-07-06T21:57:58.809646+0000', 'last_fullsized': '2023-07-06T21:57:58.809646+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T21:58:05.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-07-06T21:58:05.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-07-06T21:58:05.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.807432+0000', 'last_change': '2023-07-06T21:57:58.807432+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.807432+0000', 'last_undegraded': '2023-07-06T21:57:58.807432+0000', 'last_fullsized': '2023-07-06T21:57:58.807432+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T21:58:05.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-07-06T21:58:05.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-07-06T21:58:05.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.807708+0000', 'last_change': '2023-07-06T21:57:58.807708+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.807708+0000', 'last_undegraded': '2023-07-06T21:57:58.807708+0000', 'last_fullsized': '2023-07-06T21:57:58.807708+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:05.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-07-06T21:58:05.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-07-06T21:58:05.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.806862+0000', 'last_change': '2023-07-06T21:57:58.806862+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.806862+0000', 'last_undegraded': '2023-07-06T21:57:58.806862+0000', 'last_fullsized': '2023-07-06T21:57:58.806862+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T21:58:05.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-07-06T21:58:05.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-07-06T21:58:05.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.809323+0000', 'last_change': '2023-07-06T21:57:58.809323+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.809323+0000', 'last_undegraded': '2023-07-06T21:57:58.809323+0000', 'last_fullsized': '2023-07-06T21:57:58.809323+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T21:58:05.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-07-06T21:58:05.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-07-06T21:58:05.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.806963+0000', 'last_change': '2023-07-06T21:57:58.806963+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.806963+0000', 'last_undegraded': '2023-07-06T21:57:58.806963+0000', 'last_fullsized': '2023-07-06T21:57:58.806963+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T21:58:05.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-07-06T21:58:05.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-07-06T21:58:05.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.805718+0000', 'last_change': '2023-07-06T21:57:58.805718+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.805718+0000', 'last_undegraded': '2023-07-06T21:57:58.805718+0000', 'last_fullsized': '2023-07-06T21:57:58.805718+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T21:58:05.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-07-06T21:58:05.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-07-06T21:58:05.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.808310+0000', 'last_change': '2023-07-06T21:57:58.808310+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.808310+0000', 'last_undegraded': '2023-07-06T21:57:58.808310+0000', 'last_fullsized': '2023-07-06T21:57:58.808310+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:05.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-07-06T21:58:05.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-07-06T21:58:05.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.807487+0000', 'last_change': '2023-07-06T21:57:58.807487+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.807487+0000', 'last_undegraded': '2023-07-06T21:57:58.807487+0000', 'last_fullsized': '2023-07-06T21:57:58.807487+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T21:58:05.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-07-06T21:58:05.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-07-06T21:58:05.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.807380+0000', 'last_change': '2023-07-06T21:57:58.807380+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.807380+0000', 'last_undegraded': '2023-07-06T21:57:58.807380+0000', 'last_fullsized': '2023-07-06T21:57:58.807380+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:05.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-07-06T21:58:05.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-07-06T21:58:05.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.804652+0000', 'last_change': '2023-07-06T21:57:58.804652+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.804652+0000', 'last_undegraded': '2023-07-06T21:57:58.804652+0000', 'last_fullsized': '2023-07-06T21:57:58.804652+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T21:58:05.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-07-06T21:58:05.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-07-06T21:58:05.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.812095+0000', 'last_change': '2023-07-06T21:57:58.812095+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.812095+0000', 'last_undegraded': '2023-07-06T21:57:58.812095+0000', 'last_fullsized': '2023-07-06T21:57:58.812095+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T21:58:05.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-07-06T21:58:05.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-07-06T21:58:05.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.812398+0000', 'last_change': '2023-07-06T21:57:58.812398+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.812398+0000', 'last_undegraded': '2023-07-06T21:57:58.812398+0000', 'last_fullsized': '2023-07-06T21:57:58.812398+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T21:58:05.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-07-06T21:58:05.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:57:59.800148+0000', 'last_change': '2023-07-06T21:57:59.800148+0000', 'last_active': '2023-07-06T21:57:59.800148+0000', 'last_peered': '2023-07-06T21:57:59.800148+0000', 'last_clean': '2023-07-06T21:57:59.800148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:59.800148+0000', 'last_undegraded': '2023-07-06T21:57:59.800148+0000', 'last_fullsized': '2023-07-06T21:57:59.800148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:59.800148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:05.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-07-06T21:58:05.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:57:58.804610+0000', 'last_change': '2023-07-06T21:57:58.804610+0000', 'last_active': '2023-07-06T21:57:58.789003+0000', 'last_peered': '2023-07-06T21:57:58.789003+0000', 'last_clean': '2023-07-06T21:57:58.789003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:57:58.804610+0000', 'last_undegraded': '2023-07-06T21:57:58.804610+0000', 'last_fullsized': '2023-07-06T21:57:58.804610+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'last_clean_scrub_stamp': '2023-07-06T21:57:58.789003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T21:58:05.188 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-06T21:58:05.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.332+0000 7f966df82640 1 Processor -- start 2023-07-06T21:58:05.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.332+0000 7f966df82640 1 -- start start 2023-07-06T21:58:05.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.332+0000 7f966df82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96680712f0 0x7f966806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:05.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.332+0000 7f966df82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96680b3730 0x7f96680c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:05.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.332+0000 7f966df82640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9668159cd0 con 0x7f96680ca280 2023-07-06T21:58:05.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.332+0000 7f966df82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96680ca700 con 0x7f96680b3730 2023-07-06T21:58:05.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.332+0000 7f966df82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96680693f0 con 0x7f96680712f0 2023-07-06T21:58:05.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.332+0000 7f965ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96680b3730 0x7f96680c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:05.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.332+0000 7f965ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96680b3730 0x7f96680c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34846/0 (socket says 172.21.15.55:34846) 2023-07-06T21:58:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.332+0000 7f965ffff640 1 -- 172.21.15.55:0/1883157433 learned_addr learned my addr 172.21.15.55:0/1883157433 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.332+0000 7f965ffff640 1 -- 172.21.15.55:0/1883157433 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96680712f0 msgr2=0x7f966806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.332+0000 7f965ffff640 1 --2- 172.21.15.55:0/1883157433 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96680712f0 0x7f966806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.332+0000 7f965ffff640 1 -- 172.21.15.55:0/1883157433 >> v1:172.21.15.138:6789/0 conn(0x7f96680ca280 legacy=0x7f96680c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:05.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.332+0000 7f965ffff640 1 -- 172.21.15.55:0/1883157433 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966806aca0 con 0x7f96680b3730 2023-07-06T21:58:05.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.336+0000 7f965ffff640 1 --2- 172.21.15.55:0/1883157433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96680b3730 0x7f96680c9d40 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f9650009870 tx=0x7f965001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc06053bee9541a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:05.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.336+0000 7f9666ffd640 1 -- 172.21.15.55:0/1883157433 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500ac410 con 0x7f96680b3730 2023-07-06T21:58:05.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.336+0000 7f9666ffd640 1 -- 172.21.15.55:0/1883157433 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96500ac570 con 0x7f96680b3730 2023-07-06T21:58:05.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.336+0000 7f9666ffd640 1 -- 172.21.15.55:0/1883157433 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500ac900 con 0x7f96680b3730 2023-07-06T21:58:05.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.336+0000 7f966df82640 1 -- 172.21.15.55:0/1883157433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96680b3730 msgr2=0x7f96680c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:05.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.336+0000 7f966df82640 1 --2- 172.21.15.55:0/1883157433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96680b3730 0x7f96680c9d40 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f9650009870 tx=0x7f965001c4d0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.336+0000 7f966df82640 1 -- 172.21.15.55:0/1883157433 shutdown_connections 2023-07-06T21:58:05.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.336+0000 7f966df82640 1 --2- 172.21.15.55:0/1883157433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96680b3730 0x7f96680c9d40 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.336+0000 7f966df82640 1 --2- 172.21.15.55:0/1883157433 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96680712f0 0x7f966806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.336+0000 7f966df82640 1 -- 172.21.15.55:0/1883157433 >> 172.21.15.55:0/1883157433 conn(0x7f96680cded0 msgr2=0x7f96680ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:05.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.336+0000 7f966df82640 1 -- 172.21.15.55:0/1883157433 shutdown_connections 2023-07-06T21:58:05.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.336+0000 7f966df82640 1 -- 172.21.15.55:0/1883157433 wait complete. 2023-07-06T21:58:05.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f966df82640 1 Processor -- start 2023-07-06T21:58:05.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f966df82640 1 -- start start 2023-07-06T21:58:05.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f966df82640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96680712f0 0x7f9668151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:05.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f966df82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96680b3730 0x7f966814ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:05.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f966df82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96680ca280 0x7f966814f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:05.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f966df82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96680aceb0 con 0x7f96680b3730 2023-07-06T21:58:05.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f966df82640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966814fe40 con 0x7f96680712f0 2023-07-06T21:58:05.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f966df82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966814f880 con 0x7f96680ca280 2023-07-06T21:58:05.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f965ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96680b3730 0x7f966814ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:05.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f965ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96680b3730 0x7f966814ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34852/0 (socket says 172.21.15.55:34852) 2023-07-06T21:58:05.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f965ffff640 1 -- 172.21.15.55:0/703219706 learned_addr learned my addr 172.21.15.55:0/703219706 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:05.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f96677fe640 1 --2- 172.21.15.55:0/703219706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96680712f0 0x7f9668151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:05.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f9667fff640 1 --2- 172.21.15.55:0/703219706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96680ca280 0x7f966814f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:05.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f965ffff640 1 -- 172.21.15.55:0/703219706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96680ca280 msgr2=0x7f966814f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:05.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f965ffff640 1 --2- 172.21.15.55:0/703219706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96680ca280 0x7f966814f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f965ffff640 1 -- 172.21.15.55:0/703219706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96680712f0 msgr2=0x7f9668151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:05.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f965ffff640 1 --2- 172.21.15.55:0/703219706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96680712f0 0x7f9668151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f965ffff640 1 -- 172.21.15.55:0/703219706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96500094d0 con 0x7f96680b3730 2023-07-06T21:58:05.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f965ffff640 1 --2- 172.21.15.55:0/703219706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96680b3730 0x7f966814ebc0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f965001cd70 tx=0x7f9650019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:05.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f9664ff9640 1 -- 172.21.15.55:0/703219706 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500ac410 con 0x7f96680b3730 2023-07-06T21:58:05.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f9664ff9640 1 -- 172.21.15.55:0/703219706 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96500b7630 con 0x7f96680b3730 2023-07-06T21:58:05.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f9664ff9640 1 -- 172.21.15.55:0/703219706 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500b7a00 con 0x7f96680b3730 2023-07-06T21:58:05.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.340+0000 7f966df82640 1 -- 172.21.15.55:0/703219706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966814fb60 con 0x7f96680b3730 2023-07-06T21:58:05.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.344+0000 7f966df82640 1 -- 172.21.15.55:0/703219706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9668151880 con 0x7f96680b3730 2023-07-06T21:58:05.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.344+0000 7f966df82640 1 -- 172.21.15.55:0/703219706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96680acff0 con 0x7f96680b3730 2023-07-06T21:58:05.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.344+0000 7f9664ff9640 1 -- 172.21.15.55:0/703219706 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f96500b3040 con 0x7f96680b3730 2023-07-06T21:58:05.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.344+0000 7f9664ff9640 1 --2- 172.21.15.55:0/703219706 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f96480663a0 0x7f9648068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:05.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.344+0000 7f9664ff9640 1 -- 172.21.15.55:0/703219706 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f965011e9c0 con 0x7f96680b3730 2023-07-06T21:58:05.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.344+0000 7f96677fe640 1 --2- 172.21.15.55:0/703219706 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f96480663a0 0x7f9648068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:05.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.348+0000 7f96677fe640 1 --2- 172.21.15.55:0/703219706 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f96480663a0 0x7f9648068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9658006fd0 tx=0x7f9658008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:05.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.348+0000 7f9664ff9640 1 -- 172.21.15.55:0/703219706 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f96680acff0 con 0x7f96680b3730 2023-07-06T21:58:05.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.560+0000 7f966df82640 1 -- 172.21.15.55:0/703219706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f96680acff0 con 0x7f96680b3730 2023-07-06T21:58:05.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.560+0000 7f9664ff9640 1 -- 172.21.15.55:0/703219706 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3306 (secure 0 0 0) 0x7f96680acff0 con 0x7f96680b3730 2023-07-06T21:58:05.558 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:05.558 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":980,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":103,"num_osds":8,"num_up_osds":8,"osd_up_since":1688679717,"num_in_osds":8,"osd_in_since":1688679707,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":308944896,"bytes_avail":772785168384,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":40,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":7479}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-07-06T21:57:47.703102+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-06T21:58:05.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.560+0000 7f966df82640 1 -- 172.21.15.55:0/703219706 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f96480663a0 msgr2=0x7f9648068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:05.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.560+0000 7f966df82640 1 --2- 172.21.15.55:0/703219706 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f96480663a0 0x7f9648068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9658006fd0 tx=0x7f9658008040 comp rx=0 tx=0).stop 2023-07-06T21:58:05.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.560+0000 7f966df82640 1 -- 172.21.15.55:0/703219706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96680b3730 msgr2=0x7f966814ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:05.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.560+0000 7f966df82640 1 --2- 172.21.15.55:0/703219706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96680b3730 0x7f966814ebc0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f965001cd70 tx=0x7f9650019270 comp rx=0 tx=0).stop 2023-07-06T21:58:05.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.560+0000 7f966df82640 1 -- 172.21.15.55:0/703219706 shutdown_connections 2023-07-06T21:58:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.560+0000 7f966df82640 1 --2- 172.21.15.55:0/703219706 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f96480663a0 0x7f9648068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.560+0000 7f966df82640 1 --2- 172.21.15.55:0/703219706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96680ca280 0x7f966814f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.560+0000 7f966df82640 1 --2- 172.21.15.55:0/703219706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96680b3730 0x7f966814ebc0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.560+0000 7f966df82640 1 --2- 172.21.15.55:0/703219706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96680712f0 0x7f9668151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.560+0000 7f966df82640 1 -- 172.21.15.55:0/703219706 >> 172.21.15.55:0/703219706 conn(0x7f96680cded0 msgr2=0x7f96680b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.560+0000 7f966df82640 1 -- 172.21.15.55:0/703219706 shutdown_connections 2023-07-06T21:58:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.560+0000 7f966df82640 1 -- 172.21.15.55:0/703219706 wait complete. 2023-07-06T21:58:05.579 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-06T21:58:05.579 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:58:05.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.724+0000 7f3f77967640 1 Processor -- start 2023-07-06T21:58:05.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.724+0000 7f3f77967640 1 -- start start 2023-07-06T21:58:05.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.724+0000 7f3f77967640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3f7015f4e0 0x7f3f700b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:05.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.724+0000 7f3f77967640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f700b4250 0x7f3f7015c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:05.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.724+0000 7f3f77967640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7006a160 con 0x7f3f7015b9d0 2023-07-06T21:58:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.724+0000 7f3f77967640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f7015bda0 con 0x7f3f700b4250 2023-07-06T21:58:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.724+0000 7f3f77967640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f70069590 con 0x7f3f7015f4e0 2023-07-06T21:58:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.728+0000 7f3f75f04640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f700b4250 0x7f3f7015c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.728+0000 7f3f75f04640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f700b4250 0x7f3f7015c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34860/0 (socket says 172.21.15.55:34860) 2023-07-06T21:58:05.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.728+0000 7f3f75f04640 1 -- 172.21.15.55:0/2770070615 learned_addr learned my addr 172.21.15.55:0/2770070615 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:05.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.728+0000 7f3f74f02640 1 --2- 172.21.15.55:0/2770070615 >> v2:172.21.15.138:3300/0 conn(0x7f3f7015f4e0 0x7f3f700b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:05.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.728+0000 7f3f75f04640 1 -- 172.21.15.55:0/2770070615 >> v2:172.21.15.138:3300/0 conn(0x7f3f7015f4e0 msgr2=0x7f3f700b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:05.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.728+0000 7f3f75f04640 1 --2- 172.21.15.55:0/2770070615 >> v2:172.21.15.138:3300/0 conn(0x7f3f7015f4e0 0x7f3f700b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.728+0000 7f3f75f04640 1 -- 172.21.15.55:0/2770070615 >> v1:172.21.15.138:6789/0 conn(0x7f3f7015b9d0 legacy=0x7f3f700ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:05.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.728+0000 7f3f75f04640 1 -- 172.21.15.55:0/2770070615 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f700b4670 con 0x7f3f700b4250 2023-07-06T21:58:05.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.728+0000 7f3f75f04640 1 --2- 172.21.15.55:0/2770070615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f700b4250 0x7f3f7015c110 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f3f70073370 tx=0x7f3f6801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe616979612580b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:05.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.728+0000 7f3f67fff640 1 -- 172.21.15.55:0/2770070615 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680090d0 con 0x7f3f700b4250 2023-07-06T21:58:05.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.728+0000 7f3f67fff640 1 -- 172.21.15.55:0/2770070615 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f68009230 con 0x7f3f700b4250 2023-07-06T21:58:05.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.728+0000 7f3f67fff640 1 -- 172.21.15.55:0/2770070615 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680a5ab0 con 0x7f3f700b4250 2023-07-06T21:58:05.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 -- 172.21.15.55:0/2770070615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f700b4250 msgr2=0x7f3f7015c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:05.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 --2- 172.21.15.55:0/2770070615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f700b4250 0x7f3f7015c110 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f3f70073370 tx=0x7f3f6801c9d0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 -- 172.21.15.55:0/2770070615 shutdown_connections 2023-07-06T21:58:05.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 --2- 172.21.15.55:0/2770070615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f700b4250 0x7f3f7015c110 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 --2- 172.21.15.55:0/2770070615 >> v2:172.21.15.138:3300/0 conn(0x7f3f7015f4e0 0x7f3f700b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 -- 172.21.15.55:0/2770070615 >> 172.21.15.55:0/2770070615 conn(0x7f3f700ced10 msgr2=0x7f3f700cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:05.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 -- 172.21.15.55:0/2770070615 shutdown_connections 2023-07-06T21:58:05.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 -- 172.21.15.55:0/2770070615 wait complete. 2023-07-06T21:58:05.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 Processor -- start 2023-07-06T21:58:05.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 -- start start 2023-07-06T21:58:05.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f700b4250 0x7f3f7014e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:05.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7015b9d0 0x7f3f7015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:05.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7015f4e0 0x7f3f701510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:05.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7014f0a0 con 0x7f3f700b4250 2023-07-06T21:58:05.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7014f660 con 0x7f3f7015f4e0 2023-07-06T21:58:05.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f77967640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7014ee90 con 0x7f3f7015b9d0 2023-07-06T21:58:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f75703640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f700b4250 0x7f3f7014e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f75703640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f700b4250 0x7f3f7014e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34868/0 (socket says 172.21.15.55:34868) 2023-07-06T21:58:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f75703640 1 -- 172.21.15.55:0/1844923938 learned_addr learned my addr 172.21.15.55:0/1844923938 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f75f04640 1 --2- 172.21.15.55:0/1844923938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7015f4e0 0x7f3f701510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f74f02640 1 --2- 172.21.15.55:0/1844923938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7015b9d0 0x7f3f7015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:05.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f75703640 1 -- 172.21.15.55:0/1844923938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7015b9d0 msgr2=0x7f3f7015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:05.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f75703640 1 --2- 172.21.15.55:0/1844923938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7015b9d0 0x7f3f7015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f75703640 1 -- 172.21.15.55:0/1844923938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7015f4e0 msgr2=0x7f3f701510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:05.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f75703640 1 --2- 172.21.15.55:0/1844923938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7015f4e0 0x7f3f701510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.732+0000 7f3f75703640 1 -- 172.21.15.55:0/1844923938 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f68009b30 con 0x7f3f700b4250 2023-07-06T21:58:05.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.736+0000 7f3f75703640 1 --2- 172.21.15.55:0/1844923938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f700b4250 0x7f3f7014e950 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00c500 tx=0x7f3f6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:05.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.736+0000 7f3f65ffb640 1 -- 172.21.15.55:0/1844923938 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c005220 con 0x7f3f700b4250 2023-07-06T21:58:05.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.736+0000 7f3f65ffb640 1 -- 172.21.15.55:0/1844923938 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c005380 con 0x7f3f700b4250 2023-07-06T21:58:05.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.736+0000 7f3f65ffb640 1 -- 172.21.15.55:0/1844923938 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c007270 con 0x7f3f700b4250 2023-07-06T21:58:05.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.736+0000 7f3f77967640 1 -- 172.21.15.55:0/1844923938 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7015ade0 con 0x7f3f700b4250 2023-07-06T21:58:05.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.736+0000 7f3f77967640 1 -- 172.21.15.55:0/1844923938 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7014f2f0 con 0x7f3f700b4250 2023-07-06T21:58:05.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.736+0000 7f3f77967640 1 -- 172.21.15.55:0/1844923938 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f70066d60 con 0x7f3f700b4250 2023-07-06T21:58:05.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.736+0000 7f3f65ffb640 1 -- 172.21.15.55:0/1844923938 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3f6c0073d0 con 0x7f3f700b4250 2023-07-06T21:58:05.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.736+0000 7f3f65ffb640 1 --2- 172.21.15.55:0/1844923938 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3f540663a0 0x7f3f54068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:05.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.736+0000 7f3f65ffb640 1 -- 172.21.15.55:0/1844923938 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3f6c083760 con 0x7f3f700b4250 2023-07-06T21:58:05.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.736+0000 7f3f74f02640 1 --2- 172.21.15.55:0/1844923938 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3f540663a0 0x7f3f54068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:05.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.740+0000 7f3f74f02640 1 --2- 172.21.15.55:0/1844923938 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3f540663a0 0x7f3f54068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3f700cc930 tx=0x7f3f60009190 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:05.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.740+0000 7f3f65ffb640 1 -- 172.21.15.55:0/1844923938 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f6c050a50 con 0x7f3f700b4250 2023-07-06T21:58:05.782 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-07-06T21:58:05.784+0000 7f220ee74640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T21:58:05.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.892+0000 7f3f77967640 1 -- 172.21.15.55:0/1844923938 --> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f700cea50 con 0x7f3f540663a0 2023-07-06T21:58:05.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.900+0000 7f3f65ffb640 1 -- 172.21.15.55:0/1844923938 <== mgr.7191 v2:172.21.15.55:6832/703944479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311794 (secure 0 0 0) 0x7f3f600119d0 con 0x7f3f540663a0 2023-07-06T21:58:05.902 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:05.903 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:58:05.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.904+0000 7f3f77967640 1 -- 172.21.15.55:0/1844923938 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3f540663a0 msgr2=0x7f3f54068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:05.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.904+0000 7f3f77967640 1 --2- 172.21.15.55:0/1844923938 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3f540663a0 0x7f3f54068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3f700cc930 tx=0x7f3f60009190 comp rx=0 tx=0).stop 2023-07-06T21:58:05.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.904+0000 7f3f77967640 1 -- 172.21.15.55:0/1844923938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f700b4250 msgr2=0x7f3f7014e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:05.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.904+0000 7f3f77967640 1 --2- 172.21.15.55:0/1844923938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f700b4250 0x7f3f7014e950 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00c500 tx=0x7f3f6c00c9c0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.904+0000 7f3f77967640 1 -- 172.21.15.55:0/1844923938 shutdown_connections 2023-07-06T21:58:05.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.904+0000 7f3f77967640 1 --2- 172.21.15.55:0/1844923938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7015f4e0 0x7f3f701510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.904+0000 7f3f77967640 1 --2- 172.21.15.55:0/1844923938 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f3f540663a0 0x7f3f54068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.904+0000 7f3f77967640 1 --2- 172.21.15.55:0/1844923938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7015b9d0 0x7f3f7015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.904+0000 7f3f77967640 1 --2- 172.21.15.55:0/1844923938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f700b4250 0x7f3f7014e950 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:05.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.904+0000 7f3f77967640 1 -- 172.21.15.55:0/1844923938 >> 172.21.15.55:0/1844923938 conn(0x7f3f700ced10 msgr2=0x7f3f7015e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:05.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.904+0000 7f3f77967640 1 -- 172.21.15.55:0/1844923938 shutdown_connections 2023-07-06T21:58:05.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:05.904+0000 7f3f77967640 1 -- 172.21.15.55:0/1844923938 wait complete. 2023-07-06T21:58:05.922 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-06T21:58:05.706397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":323,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":306176,"kb_used_data":11072,"kb_used_omap":0,"kb_used_meta":295040,"kb_avail":754668544,"statfs":{"total":773094113280,"available":772780589056,"internally_reserved":0,"allocated":11337728,"data_stored":6494630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":302120960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001240"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881401+0000","last_change":"2023-07-06T21:58:00.259911+0000","last_active":"2023-07-06T21:58:02.881401+0000","last_peered":"2023-07-06T21:58:02.881401+0000","last_clean":"2023-07-06T21:58:02.881401+0000","last_became_active":"2023-07-06T21:58:00.259649+0000","last_became_peered":"2023-07-06T21:58:00.259649+0000","last_unstale":"2023-07-06T21:58:02.881401+0000","last_undegraded":"2023-07-06T21:58:02.881401+0000","last_fullsized":"2023-07-06T21:58:02.881401+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:42:13.510208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553403+0000","last_change":"2023-07-06T21:58:00.252415+0000","last_active":"2023-07-06T21:58:02.553403+0000","last_peered":"2023-07-06T21:58:02.553403+0000","last_clean":"2023-07-06T21:58:02.553403+0000","last_became_active":"2023-07-06T21:58:00.251954+0000","last_became_peered":"2023-07-06T21:58:00.251954+0000","last_unstale":"2023-07-06T21:58:02.553403+0000","last_undegraded":"2023-07-06T21:58:02.553403+0000","last_fullsized":"2023-07-06T21:58:02.553403+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:21:24.758120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.229969+0000","last_change":"2023-07-06T21:58:00.248335+0000","last_active":"2023-07-06T21:58:01.229969+0000","last_peered":"2023-07-06T21:58:01.229969+0000","last_clean":"2023-07-06T21:58:01.229969+0000","last_became_active":"2023-07-06T21:58:00.247833+0000","last_became_peered":"2023-07-06T21:58:00.247833+0000","last_unstale":"2023-07-06T21:58:01.229969+0000","last_undegraded":"2023-07-06T21:58:01.229969+0000","last_fullsized":"2023-07-06T21:58:01.229969+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:16:33.479949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230629+0000","last_change":"2023-07-06T21:58:00.252995+0000","last_active":"2023-07-06T21:58:01.230629+0000","last_peered":"2023-07-06T21:58:01.230629+0000","last_clean":"2023-07-06T21:58:01.230629+0000","last_became_active":"2023-07-06T21:58:00.252695+0000","last_became_peered":"2023-07-06T21:58:00.252695+0000","last_unstale":"2023-07-06T21:58:01.230629+0000","last_undegraded":"2023-07-06T21:58:01.230629+0000","last_fullsized":"2023-07-06T21:58:01.230629+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:26:22.461816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231211+0000","last_change":"2023-07-06T21:58:00.252660+0000","last_active":"2023-07-06T21:58:01.231211+0000","last_peered":"2023-07-06T21:58:01.231211+0000","last_clean":"2023-07-06T21:58:01.231211+0000","last_became_active":"2023-07-06T21:58:00.252318+0000","last_became_peered":"2023-07-06T21:58:00.252318+0000","last_unstale":"2023-07-06T21:58:01.231211+0000","last_undegraded":"2023-07-06T21:58:01.231211+0000","last_fullsized":"2023-07-06T21:58:01.231211+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:59:09.848702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880677+0000","last_change":"2023-07-06T21:58:00.249913+0000","last_active":"2023-07-06T21:58:02.880677+0000","last_peered":"2023-07-06T21:58:02.880677+0000","last_clean":"2023-07-06T21:58:02.880677+0000","last_became_active":"2023-07-06T21:58:00.249518+0000","last_became_peered":"2023-07-06T21:58:00.249518+0000","last_unstale":"2023-07-06T21:58:02.880677+0000","last_undegraded":"2023-07-06T21:58:02.880677+0000","last_fullsized":"2023-07-06T21:58:02.880677+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:44.084196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230103+0000","last_change":"2023-07-06T21:58:00.236368+0000","last_active":"2023-07-06T21:58:01.230103+0000","last_peered":"2023-07-06T21:58:01.230103+0000","last_clean":"2023-07-06T21:58:01.230103+0000","last_became_active":"2023-07-06T21:58:00.236095+0000","last_became_peered":"2023-07-06T21:58:00.236095+0000","last_unstale":"2023-07-06T21:58:01.230103+0000","last_undegraded":"2023-07-06T21:58:01.230103+0000","last_fullsized":"2023-07-06T21:58:01.230103+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:04.788763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880719+0000","last_change":"2023-07-06T21:58:00.244966+0000","last_active":"2023-07-06T21:58:02.880719+0000","last_peered":"2023-07-06T21:58:02.880719+0000","last_clean":"2023-07-06T21:58:02.880719+0000","last_became_active":"2023-07-06T21:58:00.244329+0000","last_became_peered":"2023-07-06T21:58:00.244329+0000","last_unstale":"2023-07-06T21:58:02.880719+0000","last_undegraded":"2023-07-06T21:58:02.880719+0000","last_fullsized":"2023-07-06T21:58:02.880719+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:47:23.430834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881213+0000","last_change":"2023-07-06T21:58:00.252322+0000","last_active":"2023-07-06T21:58:02.881213+0000","last_peered":"2023-07-06T21:58:02.881213+0000","last_clean":"2023-07-06T21:58:02.881213+0000","last_became_active":"2023-07-06T21:58:00.251987+0000","last_became_peered":"2023-07-06T21:58:00.251987+0000","last_unstale":"2023-07-06T21:58:02.881213+0000","last_undegraded":"2023-07-06T21:58:02.881213+0000","last_fullsized":"2023-07-06T21:58:02.881213+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:05:18.615269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881310+0000","last_change":"2023-07-06T21:58:00.250861+0000","last_active":"2023-07-06T21:58:02.881310+0000","last_peered":"2023-07-06T21:58:02.881310+0000","last_clean":"2023-07-06T21:58:02.881310+0000","last_became_active":"2023-07-06T21:58:00.250584+0000","last_became_peered":"2023-07-06T21:58:00.250584+0000","last_unstale":"2023-07-06T21:58:02.881310+0000","last_undegraded":"2023-07-06T21:58:02.881310+0000","last_fullsized":"2023-07-06T21:58:02.881310+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:17:42.295642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553351+0000","last_change":"2023-07-06T21:58:00.244660+0000","last_active":"2023-07-06T21:58:02.553351+0000","last_peered":"2023-07-06T21:58:02.553351+0000","last_clean":"2023-07-06T21:58:02.553351+0000","last_became_active":"2023-07-06T21:58:00.244371+0000","last_became_peered":"2023-07-06T21:58:00.244371+0000","last_unstale":"2023-07-06T21:58:02.553351+0000","last_undegraded":"2023-07-06T21:58:02.553351+0000","last_fullsized":"2023-07-06T21:58:02.553351+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:27:56.235233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881306+0000","last_change":"2023-07-06T21:58:00.250862+0000","last_active":"2023-07-06T21:58:02.881306+0000","last_peered":"2023-07-06T21:58:02.881306+0000","last_clean":"2023-07-06T21:58:02.881306+0000","last_became_active":"2023-07-06T21:58:00.250513+0000","last_became_peered":"2023-07-06T21:58:00.250513+0000","last_unstale":"2023-07-06T21:58:02.881306+0000","last_undegraded":"2023-07-06T21:58:02.881306+0000","last_fullsized":"2023-07-06T21:58:02.881306+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:32:23.259132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230001+0000","last_change":"2023-07-06T21:58:00.247870+0000","last_active":"2023-07-06T21:58:01.230001+0000","last_peered":"2023-07-06T21:58:01.230001+0000","last_clean":"2023-07-06T21:58:01.230001+0000","last_became_active":"2023-07-06T21:58:00.247571+0000","last_became_peered":"2023-07-06T21:58:00.247571+0000","last_unstale":"2023-07-06T21:58:01.230001+0000","last_undegraded":"2023-07-06T21:58:01.230001+0000","last_fullsized":"2023-07-06T21:58:01.230001+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:52:46.623472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230417+0000","last_change":"2023-07-06T21:58:00.245778+0000","last_active":"2023-07-06T21:58:01.230417+0000","last_peered":"2023-07-06T21:58:01.230417+0000","last_clean":"2023-07-06T21:58:01.230417+0000","last_became_active":"2023-07-06T21:58:00.245505+0000","last_became_peered":"2023-07-06T21:58:00.245505+0000","last_unstale":"2023-07-06T21:58:01.230417+0000","last_undegraded":"2023-07-06T21:58:01.230417+0000","last_fullsized":"2023-07-06T21:58:01.230417+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:10.696546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880963+0000","last_change":"2023-07-06T21:58:00.248136+0000","last_active":"2023-07-06T21:58:02.880963+0000","last_peered":"2023-07-06T21:58:02.880963+0000","last_clean":"2023-07-06T21:58:02.880963+0000","last_became_active":"2023-07-06T21:58:00.244318+0000","last_became_peered":"2023-07-06T21:58:00.244318+0000","last_unstale":"2023-07-06T21:58:02.880963+0000","last_undegraded":"2023-07-06T21:58:02.880963+0000","last_fullsized":"2023-07-06T21:58:02.880963+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:55:28.223700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230993+0000","last_change":"2023-07-06T21:58:00.246348+0000","last_active":"2023-07-06T21:58:01.230993+0000","last_peered":"2023-07-06T21:58:01.230993+0000","last_clean":"2023-07-06T21:58:01.230993+0000","last_became_active":"2023-07-06T21:58:00.246013+0000","last_became_peered":"2023-07-06T21:58:00.246013+0000","last_unstale":"2023-07-06T21:58:01.230993+0000","last_undegraded":"2023-07-06T21:58:01.230993+0000","last_fullsized":"2023-07-06T21:58:01.230993+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:26:33.781672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231887+0000","last_change":"2023-07-06T21:58:00.254294+0000","last_active":"2023-07-06T21:58:01.231887+0000","last_peered":"2023-07-06T21:58:01.231887+0000","last_clean":"2023-07-06T21:58:01.231887+0000","last_became_active":"2023-07-06T21:58:00.253322+0000","last_became_peered":"2023-07-06T21:58:00.253322+0000","last_unstale":"2023-07-06T21:58:01.231887+0000","last_undegraded":"2023-07-06T21:58:01.231887+0000","last_fullsized":"2023-07-06T21:58:01.231887+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:55:39.790259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230647+0000","last_change":"2023-07-06T21:58:00.248034+0000","last_active":"2023-07-06T21:58:01.230647+0000","last_peered":"2023-07-06T21:58:01.230647+0000","last_clean":"2023-07-06T21:58:01.230647+0000","last_became_active":"2023-07-06T21:58:00.247695+0000","last_became_peered":"2023-07-06T21:58:00.247695+0000","last_unstale":"2023-07-06T21:58:01.230647+0000","last_undegraded":"2023-07-06T21:58:01.230647+0000","last_fullsized":"2023-07-06T21:58:01.230647+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:50:26.765313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883512+0000","last_change":"2023-07-06T21:58:00.255858+0000","last_active":"2023-07-06T21:58:02.883512+0000","last_peered":"2023-07-06T21:58:02.883512+0000","last_clean":"2023-07-06T21:58:02.883512+0000","last_became_active":"2023-07-06T21:58:00.255589+0000","last_became_peered":"2023-07-06T21:58:00.255589+0000","last_unstale":"2023-07-06T21:58:02.883512+0000","last_undegraded":"2023-07-06T21:58:02.883512+0000","last_fullsized":"2023-07-06T21:58:02.883512+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:00:40.448120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230691+0000","last_change":"2023-07-06T21:58:00.257221+0000","last_active":"2023-07-06T21:58:01.230691+0000","last_peered":"2023-07-06T21:58:01.230691+0000","last_clean":"2023-07-06T21:58:01.230691+0000","last_became_active":"2023-07-06T21:58:00.256894+0000","last_became_peered":"2023-07-06T21:58:00.256894+0000","last_unstale":"2023-07-06T21:58:01.230691+0000","last_undegraded":"2023-07-06T21:58:01.230691+0000","last_fullsized":"2023-07-06T21:58:01.230691+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:20:22.871818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230270+0000","last_change":"2023-07-06T21:58:00.257282+0000","last_active":"2023-07-06T21:58:01.230270+0000","last_peered":"2023-07-06T21:58:01.230270+0000","last_clean":"2023-07-06T21:58:01.230270+0000","last_became_active":"2023-07-06T21:58:00.256956+0000","last_became_peered":"2023-07-06T21:58:00.256956+0000","last_unstale":"2023-07-06T21:58:01.230270+0000","last_undegraded":"2023-07-06T21:58:01.230270+0000","last_fullsized":"2023-07-06T21:58:01.230270+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:00.443303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553125+0000","last_change":"2023-07-06T21:58:00.264147+0000","last_active":"2023-07-06T21:58:02.553125+0000","last_peered":"2023-07-06T21:58:02.553125+0000","last_clean":"2023-07-06T21:58:02.553125+0000","last_became_active":"2023-07-06T21:58:00.263853+0000","last_became_peered":"2023-07-06T21:58:00.263853+0000","last_unstale":"2023-07-06T21:58:02.553125+0000","last_undegraded":"2023-07-06T21:58:02.553125+0000","last_fullsized":"2023-07-06T21:58:02.553125+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:35:28.803621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881483+0000","last_change":"2023-07-06T21:58:00.258856+0000","last_active":"2023-07-06T21:58:02.881483+0000","last_peered":"2023-07-06T21:58:02.881483+0000","last_clean":"2023-07-06T21:58:02.881483+0000","last_became_active":"2023-07-06T21:58:00.258554+0000","last_became_peered":"2023-07-06T21:58:00.258554+0000","last_unstale":"2023-07-06T21:58:02.881483+0000","last_undegraded":"2023-07-06T21:58:02.881483+0000","last_fullsized":"2023-07-06T21:58:02.881483+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:20:05.877094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230402+0000","last_change":"2023-07-06T21:58:00.257421+0000","last_active":"2023-07-06T21:58:01.230402+0000","last_peered":"2023-07-06T21:58:01.230402+0000","last_clean":"2023-07-06T21:58:01.230402+0000","last_became_active":"2023-07-06T21:58:00.257147+0000","last_became_peered":"2023-07-06T21:58:00.257147+0000","last_unstale":"2023-07-06T21:58:01.230402+0000","last_undegraded":"2023-07-06T21:58:01.230402+0000","last_fullsized":"2023-07-06T21:58:01.230402+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:31.724104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553464+0000","last_change":"2023-07-06T21:58:00.250321+0000","last_active":"2023-07-06T21:58:02.553464+0000","last_peered":"2023-07-06T21:58:02.553464+0000","last_clean":"2023-07-06T21:58:02.553464+0000","last_became_active":"2023-07-06T21:58:00.250059+0000","last_became_peered":"2023-07-06T21:58:00.250059+0000","last_unstale":"2023-07-06T21:58:02.553464+0000","last_undegraded":"2023-07-06T21:58:02.553464+0000","last_fullsized":"2023-07-06T21:58:02.553464+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:46:08.686384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230274+0000","last_change":"2023-07-06T21:58:00.246956+0000","last_active":"2023-07-06T21:58:01.230274+0000","last_peered":"2023-07-06T21:58:01.230274+0000","last_clean":"2023-07-06T21:58:01.230274+0000","last_became_active":"2023-07-06T21:58:00.246633+0000","last_became_peered":"2023-07-06T21:58:00.246633+0000","last_unstale":"2023-07-06T21:58:01.230274+0000","last_undegraded":"2023-07-06T21:58:01.230274+0000","last_fullsized":"2023-07-06T21:58:01.230274+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:17:20.868579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231353+0000","last_change":"2023-07-06T21:58:00.257902+0000","last_active":"2023-07-06T21:58:01.231353+0000","last_peered":"2023-07-06T21:58:01.231353+0000","last_clean":"2023-07-06T21:58:01.231353+0000","last_became_active":"2023-07-06T21:58:00.257413+0000","last_became_peered":"2023-07-06T21:58:00.257413+0000","last_unstale":"2023-07-06T21:58:01.231353+0000","last_undegraded":"2023-07-06T21:58:01.231353+0000","last_fullsized":"2023-07-06T21:58:01.231353+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:00:52.189302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881585+0000","last_change":"2023-07-06T21:58:00.258943+0000","last_active":"2023-07-06T21:58:02.881585+0000","last_peered":"2023-07-06T21:58:02.881585+0000","last_clean":"2023-07-06T21:58:02.881585+0000","last_became_active":"2023-07-06T21:58:00.258620+0000","last_became_peered":"2023-07-06T21:58:00.258620+0000","last_unstale":"2023-07-06T21:58:02.881585+0000","last_undegraded":"2023-07-06T21:58:02.881585+0000","last_fullsized":"2023-07-06T21:58:02.881585+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:19:07.642294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553068+0000","last_change":"2023-07-06T21:58:00.260151+0000","last_active":"2023-07-06T21:58:02.553068+0000","last_peered":"2023-07-06T21:58:02.553068+0000","last_clean":"2023-07-06T21:58:02.553068+0000","last_became_active":"2023-07-06T21:58:00.259642+0000","last_became_peered":"2023-07-06T21:58:00.259642+0000","last_unstale":"2023-07-06T21:58:02.553068+0000","last_undegraded":"2023-07-06T21:58:02.553068+0000","last_fullsized":"2023-07-06T21:58:02.553068+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:18:05.001170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.552942+0000","last_change":"2023-07-06T21:58:00.259433+0000","last_active":"2023-07-06T21:58:02.552942+0000","last_peered":"2023-07-06T21:58:02.552942+0000","last_clean":"2023-07-06T21:58:02.552942+0000","last_became_active":"2023-07-06T21:58:00.254274+0000","last_became_peered":"2023-07-06T21:58:00.254274+0000","last_unstale":"2023-07-06T21:58:02.552942+0000","last_undegraded":"2023-07-06T21:58:02.552942+0000","last_fullsized":"2023-07-06T21:58:02.552942+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:43:36.215218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231244+0000","last_change":"2023-07-06T21:58:00.257201+0000","last_active":"2023-07-06T21:58:01.231244+0000","last_peered":"2023-07-06T21:58:01.231244+0000","last_clean":"2023-07-06T21:58:01.231244+0000","last_became_active":"2023-07-06T21:58:00.256862+0000","last_became_peered":"2023-07-06T21:58:00.256862+0000","last_unstale":"2023-07-06T21:58:01.231244+0000","last_undegraded":"2023-07-06T21:58:01.231244+0000","last_fullsized":"2023-07-06T21:58:01.231244+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:34:34.370606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880871+0000","last_change":"2023-07-06T21:58:00.260764+0000","last_active":"2023-07-06T21:58:02.880871+0000","last_peered":"2023-07-06T21:58:02.880871+0000","last_clean":"2023-07-06T21:58:02.880871+0000","last_became_active":"2023-07-06T21:58:00.260457+0000","last_became_peered":"2023-07-06T21:58:00.260457+0000","last_unstale":"2023-07-06T21:58:02.880871+0000","last_undegraded":"2023-07-06T21:58:02.880871+0000","last_fullsized":"2023-07-06T21:58:02.880871+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:08:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231729+0000","last_change":"2023-07-06T21:58:00.253088+0000","last_active":"2023-07-06T21:58:01.231729+0000","last_peered":"2023-07-06T21:58:01.231729+0000","last_clean":"2023-07-06T21:58:01.231729+0000","last_became_active":"2023-07-06T21:58:00.252769+0000","last_became_peered":"2023-07-06T21:58:00.252769+0000","last_unstale":"2023-07-06T21:58:01.231729+0000","last_undegraded":"2023-07-06T21:58:01.231729+0000","last_fullsized":"2023-07-06T21:58:01.231729+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:19:50.205458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"102'4","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881506+0000","last_change":"2023-07-06T21:57:59.844555+0000","last_active":"2023-07-06T21:58:02.881506+0000","last_peered":"2023-07-06T21:58:02.881506+0000","last_clean":"2023-07-06T21:58:02.881506+0000","last_became_active":"2023-07-06T21:57:59.844190+0000","last_became_peered":"2023-07-06T21:57:59.844190+0000","last_unstale":"2023-07-06T21:58:02.881506+0000","last_undegraded":"2023-07-06T21:58:02.881506+0000","last_fullsized":"2023-07-06T21:58:02.881506+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:36:05.375589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881865+0000","last_change":"2023-07-06T21:58:00.257248+0000","last_active":"2023-07-06T21:58:02.881865+0000","last_peered":"2023-07-06T21:58:02.881865+0000","last_clean":"2023-07-06T21:58:02.881865+0000","last_became_active":"2023-07-06T21:58:00.256958+0000","last_became_peered":"2023-07-06T21:58:00.256958+0000","last_unstale":"2023-07-06T21:58:02.881865+0000","last_undegraded":"2023-07-06T21:58:02.881865+0000","last_fullsized":"2023-07-06T21:58:02.881865+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:30:28.866385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"102'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231833+0000","last_change":"2023-07-06T21:57:59.838426+0000","last_active":"2023-07-06T21:58:01.231833+0000","last_peered":"2023-07-06T21:58:01.231833+0000","last_clean":"2023-07-06T21:58:01.231833+0000","last_became_active":"2023-07-06T21:57:59.836297+0000","last_became_peered":"2023-07-06T21:57:59.836297+0000","last_unstale":"2023-07-06T21:58:01.231833+0000","last_undegraded":"2023-07-06T21:58:01.231833+0000","last_fullsized":"2023-07-06T21:58:01.231833+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:08:45.235839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881461+0000","last_change":"2023-07-06T21:58:00.267957+0000","last_active":"2023-07-06T21:58:02.881461+0000","last_peered":"2023-07-06T21:58:02.881461+0000","last_clean":"2023-07-06T21:58:02.881461+0000","last_became_active":"2023-07-06T21:58:00.267700+0000","last_became_peered":"2023-07-06T21:58:00.267700+0000","last_unstale":"2023-07-06T21:58:02.881461+0000","last_undegraded":"2023-07-06T21:58:02.881461+0000","last_fullsized":"2023-07-06T21:58:02.881461+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:21:26.691994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"102'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883620+0000","last_change":"2023-07-06T21:57:59.843906+0000","last_active":"2023-07-06T21:58:02.883620+0000","last_peered":"2023-07-06T21:58:02.883620+0000","last_clean":"2023-07-06T21:58:02.883620+0000","last_became_active":"2023-07-06T21:57:59.843632+0000","last_became_peered":"2023-07-06T21:57:59.843632+0000","last_unstale":"2023-07-06T21:58:02.883620+0000","last_undegraded":"2023-07-06T21:58:02.883620+0000","last_fullsized":"2023-07-06T21:58:02.883620+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:57:49.658859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230413+0000","last_change":"2023-07-06T21:58:00.248646+0000","last_active":"2023-07-06T21:58:01.230413+0000","last_peered":"2023-07-06T21:58:01.230413+0000","last_clean":"2023-07-06T21:58:01.230413+0000","last_became_active":"2023-07-06T21:58:00.248328+0000","last_became_peered":"2023-07-06T21:58:00.248328+0000","last_unstale":"2023-07-06T21:58:01.230413+0000","last_undegraded":"2023-07-06T21:58:01.230413+0000","last_fullsized":"2023-07-06T21:58:01.230413+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:59:27.017612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"102'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883465+0000","last_change":"2023-07-06T21:57:59.842999+0000","last_active":"2023-07-06T21:58:02.883465+0000","last_peered":"2023-07-06T21:58:02.883465+0000","last_clean":"2023-07-06T21:58:02.883465+0000","last_became_active":"2023-07-06T21:57:59.842729+0000","last_became_peered":"2023-07-06T21:57:59.842729+0000","last_unstale":"2023-07-06T21:58:02.883465+0000","last_undegraded":"2023-07-06T21:58:02.883465+0000","last_fullsized":"2023-07-06T21:58:02.883465+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:04:00.700304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.552969+0000","last_change":"2023-07-06T21:58:00.263531+0000","last_active":"2023-07-06T21:58:02.552969+0000","last_peered":"2023-07-06T21:58:02.552969+0000","last_clean":"2023-07-06T21:58:02.552969+0000","last_became_active":"2023-07-06T21:58:00.254359+0000","last_became_peered":"2023-07-06T21:58:00.254359+0000","last_unstale":"2023-07-06T21:58:02.552969+0000","last_undegraded":"2023-07-06T21:58:02.552969+0000","last_fullsized":"2023-07-06T21:58:02.552969+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:16:39.438801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"102'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231387+0000","last_change":"2023-07-06T21:57:59.832907+0000","last_active":"2023-07-06T21:58:01.231387+0000","last_peered":"2023-07-06T21:58:01.231387+0000","last_clean":"2023-07-06T21:58:01.231387+0000","last_became_active":"2023-07-06T21:57:59.832617+0000","last_became_peered":"2023-07-06T21:57:59.832617+0000","last_unstale":"2023-07-06T21:58:01.231387+0000","last_undegraded":"2023-07-06T21:58:01.231387+0000","last_fullsized":"2023-07-06T21:58:01.231387+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:24:22.578209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231283+0000","last_change":"2023-07-06T21:58:00.254722+0000","last_active":"2023-07-06T21:58:01.231283+0000","last_peered":"2023-07-06T21:58:01.231283+0000","last_clean":"2023-07-06T21:58:01.231283+0000","last_became_active":"2023-07-06T21:58:00.252539+0000","last_became_peered":"2023-07-06T21:58:00.252539+0000","last_unstale":"2023-07-06T21:58:01.231283+0000","last_undegraded":"2023-07-06T21:58:01.231283+0000","last_fullsized":"2023-07-06T21:58:01.231283+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:05:18.615269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"102'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231201+0000","last_change":"2023-07-06T21:57:59.838365+0000","last_active":"2023-07-06T21:58:01.231201+0000","last_peered":"2023-07-06T21:58:01.231201+0000","last_clean":"2023-07-06T21:58:01.231201+0000","last_became_active":"2023-07-06T21:57:59.836597+0000","last_became_peered":"2023-07-06T21:57:59.836597+0000","last_unstale":"2023-07-06T21:58:01.231201+0000","last_undegraded":"2023-07-06T21:58:01.231201+0000","last_fullsized":"2023-07-06T21:58:01.231201+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:13:54.477860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.229735+0000","last_change":"2023-07-06T21:58:00.259956+0000","last_active":"2023-07-06T21:58:01.229735+0000","last_peered":"2023-07-06T21:58:01.229735+0000","last_clean":"2023-07-06T21:58:01.229735+0000","last_became_active":"2023-07-06T21:58:00.259634+0000","last_became_peered":"2023-07-06T21:58:00.259634+0000","last_unstale":"2023-07-06T21:58:01.229735+0000","last_undegraded":"2023-07-06T21:58:01.229735+0000","last_fullsized":"2023-07-06T21:58:01.229735+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:48:40.076468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883459+0000","last_change":"2023-07-06T21:57:59.838096+0000","last_active":"2023-07-06T21:58:02.883459+0000","last_peered":"2023-07-06T21:58:02.883459+0000","last_clean":"2023-07-06T21:58:02.883459+0000","last_became_active":"2023-07-06T21:57:59.837773+0000","last_became_peered":"2023-07-06T21:57:59.837773+0000","last_unstale":"2023-07-06T21:58:02.883459+0000","last_undegraded":"2023-07-06T21:58:02.883459+0000","last_fullsized":"2023-07-06T21:58:02.883459+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:32:14.585082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881059+0000","last_change":"2023-07-06T21:58:00.244573+0000","last_active":"2023-07-06T21:58:02.881059+0000","last_peered":"2023-07-06T21:58:02.881059+0000","last_clean":"2023-07-06T21:58:02.881059+0000","last_became_active":"2023-07-06T21:58:00.243967+0000","last_became_peered":"2023-07-06T21:58:00.243967+0000","last_unstale":"2023-07-06T21:58:02.881059+0000","last_undegraded":"2023-07-06T21:58:02.881059+0000","last_fullsized":"2023-07-06T21:58:02.881059+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:24:38.205002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.552930+0000","last_change":"2023-07-06T21:57:59.831116+0000","last_active":"2023-07-06T21:58:02.552930+0000","last_peered":"2023-07-06T21:58:02.552930+0000","last_clean":"2023-07-06T21:58:02.552930+0000","last_became_active":"2023-07-06T21:57:59.830874+0000","last_became_peered":"2023-07-06T21:57:59.830874+0000","last_unstale":"2023-07-06T21:58:02.552930+0000","last_undegraded":"2023-07-06T21:58:02.552930+0000","last_fullsized":"2023-07-06T21:58:02.552930+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:15:56.577710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881403+0000","last_change":"2023-07-06T21:58:00.252795+0000","last_active":"2023-07-06T21:58:02.881403+0000","last_peered":"2023-07-06T21:58:02.881403+0000","last_clean":"2023-07-06T21:58:02.881403+0000","last_became_active":"2023-07-06T21:58:00.252512+0000","last_became_peered":"2023-07-06T21:58:00.252512+0000","last_unstale":"2023-07-06T21:58:02.881403+0000","last_undegraded":"2023-07-06T21:58:02.881403+0000","last_fullsized":"2023-07-06T21:58:02.881403+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:02:36.631810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881670+0000","last_change":"2023-07-06T21:57:59.840272+0000","last_active":"2023-07-06T21:58:02.881670+0000","last_peered":"2023-07-06T21:58:02.881670+0000","last_clean":"2023-07-06T21:58:02.881670+0000","last_became_active":"2023-07-06T21:57:59.840004+0000","last_became_peered":"2023-07-06T21:57:59.840004+0000","last_unstale":"2023-07-06T21:58:02.881670+0000","last_undegraded":"2023-07-06T21:58:02.881670+0000","last_fullsized":"2023-07-06T21:58:02.881670+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:01:36.648388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881323+0000","last_change":"2023-07-06T21:58:00.248055+0000","last_active":"2023-07-06T21:58:02.881323+0000","last_peered":"2023-07-06T21:58:02.881323+0000","last_clean":"2023-07-06T21:58:02.881323+0000","last_became_active":"2023-07-06T21:58:00.247679+0000","last_became_peered":"2023-07-06T21:58:00.247679+0000","last_unstale":"2023-07-06T21:58:02.881323+0000","last_undegraded":"2023-07-06T21:58:02.881323+0000","last_fullsized":"2023-07-06T21:58:02.881323+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:00:52.189302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881320+0000","last_change":"2023-07-06T21:57:59.841836+0000","last_active":"2023-07-06T21:58:02.881320+0000","last_peered":"2023-07-06T21:58:02.881320+0000","last_clean":"2023-07-06T21:58:02.881320+0000","last_became_active":"2023-07-06T21:57:59.841517+0000","last_became_peered":"2023-07-06T21:57:59.841517+0000","last_unstale":"2023-07-06T21:58:02.881320+0000","last_undegraded":"2023-07-06T21:58:02.881320+0000","last_fullsized":"2023-07-06T21:58:02.881320+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:59:17.301930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883339+0000","last_change":"2023-07-06T21:58:00.255586+0000","last_active":"2023-07-06T21:58:02.883339+0000","last_peered":"2023-07-06T21:58:02.883339+0000","last_clean":"2023-07-06T21:58:02.883339+0000","last_became_active":"2023-07-06T21:58:00.255265+0000","last_became_peered":"2023-07-06T21:58:00.255265+0000","last_unstale":"2023-07-06T21:58:02.883339+0000","last_undegraded":"2023-07-06T21:58:02.883339+0000","last_fullsized":"2023-07-06T21:58:02.883339+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:41:20.285854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"102'3","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881087+0000","last_change":"2023-07-06T21:57:59.841276+0000","last_active":"2023-07-06T21:58:02.881087+0000","last_peered":"2023-07-06T21:58:02.881087+0000","last_clean":"2023-07-06T21:58:02.881087+0000","last_became_active":"2023-07-06T21:57:59.841003+0000","last_became_peered":"2023-07-06T21:57:59.841003+0000","last_unstale":"2023-07-06T21:58:02.881087+0000","last_undegraded":"2023-07-06T21:58:02.881087+0000","last_fullsized":"2023-07-06T21:58:02.881087+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:08.131679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231571+0000","last_change":"2023-07-06T21:58:00.257910+0000","last_active":"2023-07-06T21:58:01.231571+0000","last_peered":"2023-07-06T21:58:01.231571+0000","last_clean":"2023-07-06T21:58:01.231571+0000","last_became_active":"2023-07-06T21:58:00.257589+0000","last_became_peered":"2023-07-06T21:58:00.257589+0000","last_unstale":"2023-07-06T21:58:01.231571+0000","last_undegraded":"2023-07-06T21:58:01.231571+0000","last_fullsized":"2023-07-06T21:58:01.231571+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:23.302421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"102'6","reported_seq":19,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880776+0000","last_change":"2023-07-06T21:57:59.842849+0000","last_active":"2023-07-06T21:58:02.880776+0000","last_peered":"2023-07-06T21:58:02.880776+0000","last_clean":"2023-07-06T21:58:02.880776+0000","last_became_active":"2023-07-06T21:57:59.842586+0000","last_became_peered":"2023-07-06T21:57:59.842586+0000","last_unstale":"2023-07-06T21:58:02.880776+0000","last_undegraded":"2023-07-06T21:58:02.880776+0000","last_fullsized":"2023-07-06T21:58:02.880776+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:26:32.770527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883375+0000","last_change":"2023-07-06T21:58:00.257898+0000","last_active":"2023-07-06T21:58:02.883375+0000","last_peered":"2023-07-06T21:58:02.883375+0000","last_clean":"2023-07-06T21:58:02.883375+0000","last_became_active":"2023-07-06T21:58:00.257638+0000","last_became_peered":"2023-07-06T21:58:00.257638+0000","last_unstale":"2023-07-06T21:58:02.883375+0000","last_undegraded":"2023-07-06T21:58:02.883375+0000","last_fullsized":"2023-07-06T21:58:02.883375+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:03:43.968455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"102'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553254+0000","last_change":"2023-07-06T21:57:59.836414+0000","last_active":"2023-07-06T21:58:02.553254+0000","last_peered":"2023-07-06T21:58:02.553254+0000","last_clean":"2023-07-06T21:58:02.553254+0000","last_became_active":"2023-07-06T21:57:59.836070+0000","last_became_peered":"2023-07-06T21:57:59.836070+0000","last_unstale":"2023-07-06T21:58:02.553254+0000","last_undegraded":"2023-07-06T21:58:02.553254+0000","last_fullsized":"2023-07-06T21:58:02.553254+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:22:32.222097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230149+0000","last_change":"2023-07-06T21:58:00.255926+0000","last_active":"2023-07-06T21:58:01.230149+0000","last_peered":"2023-07-06T21:58:01.230149+0000","last_clean":"2023-07-06T21:58:01.230149+0000","last_became_active":"2023-07-06T21:58:00.255644+0000","last_became_peered":"2023-07-06T21:58:00.255644+0000","last_unstale":"2023-07-06T21:58:01.230149+0000","last_undegraded":"2023-07-06T21:58:01.230149+0000","last_fullsized":"2023-07-06T21:58:01.230149+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:42:41.700574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881138+0000","last_change":"2023-07-06T21:57:59.832716+0000","last_active":"2023-07-06T21:58:02.881138+0000","last_peered":"2023-07-06T21:58:02.881138+0000","last_clean":"2023-07-06T21:58:02.881138+0000","last_became_active":"2023-07-06T21:57:59.832398+0000","last_became_peered":"2023-07-06T21:57:59.832398+0000","last_unstale":"2023-07-06T21:58:02.881138+0000","last_undegraded":"2023-07-06T21:58:02.881138+0000","last_fullsized":"2023-07-06T21:58:02.881138+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:53:07.202687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.552854+0000","last_change":"2023-07-06T21:58:00.259198+0000","last_active":"2023-07-06T21:58:02.552854+0000","last_peered":"2023-07-06T21:58:02.552854+0000","last_clean":"2023-07-06T21:58:02.552854+0000","last_became_active":"2023-07-06T21:58:00.254332+0000","last_became_peered":"2023-07-06T21:58:00.254332+0000","last_unstale":"2023-07-06T21:58:02.552854+0000","last_undegraded":"2023-07-06T21:58:02.552854+0000","last_fullsized":"2023-07-06T21:58:02.552854+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:19:35.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881385+0000","last_change":"2023-07-06T21:57:59.841796+0000","last_active":"2023-07-06T21:58:02.881385+0000","last_peered":"2023-07-06T21:58:02.881385+0000","last_clean":"2023-07-06T21:58:02.881385+0000","last_became_active":"2023-07-06T21:57:59.841526+0000","last_became_peered":"2023-07-06T21:57:59.841526+0000","last_unstale":"2023-07-06T21:58:02.881385+0000","last_undegraded":"2023-07-06T21:58:02.881385+0000","last_fullsized":"2023-07-06T21:58:02.881385+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:41:48.547303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.552834+0000","last_change":"2023-07-06T21:58:00.247902+0000","last_active":"2023-07-06T21:58:02.552834+0000","last_peered":"2023-07-06T21:58:02.552834+0000","last_clean":"2023-07-06T21:58:02.552834+0000","last_became_active":"2023-07-06T21:58:00.247628+0000","last_became_peered":"2023-07-06T21:58:00.247628+0000","last_unstale":"2023-07-06T21:58:02.552834+0000","last_undegraded":"2023-07-06T21:58:02.552834+0000","last_fullsized":"2023-07-06T21:58:02.552834+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:51:56.437887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"102'8","reported_seq":21,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883180+0000","last_change":"2023-07-06T21:57:59.839253+0000","last_active":"2023-07-06T21:58:02.883180+0000","last_peered":"2023-07-06T21:58:02.883180+0000","last_clean":"2023-07-06T21:58:02.883180+0000","last_became_active":"2023-07-06T21:57:59.838907+0000","last_became_peered":"2023-07-06T21:57:59.838907+0000","last_unstale":"2023-07-06T21:58:02.883180+0000","last_undegraded":"2023-07-06T21:58:02.883180+0000","last_fullsized":"2023-07-06T21:58:02.883180+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:36:42.443047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231824+0000","last_change":"2023-07-06T21:58:00.256362+0000","last_active":"2023-07-06T21:58:01.231824+0000","last_peered":"2023-07-06T21:58:01.231824+0000","last_clean":"2023-07-06T21:58:01.231824+0000","last_became_active":"2023-07-06T21:58:00.253078+0000","last_became_peered":"2023-07-06T21:58:00.253078+0000","last_unstale":"2023-07-06T21:58:01.231824+0000","last_undegraded":"2023-07-06T21:58:01.231824+0000","last_fullsized":"2023-07-06T21:58:01.231824+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:11:08.632497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"102'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553434+0000","last_change":"2023-07-06T21:57:59.841940+0000","last_active":"2023-07-06T21:58:02.553434+0000","last_peered":"2023-07-06T21:58:02.553434+0000","last_clean":"2023-07-06T21:58:02.553434+0000","last_became_active":"2023-07-06T21:57:59.841642+0000","last_became_peered":"2023-07-06T21:57:59.841642+0000","last_unstale":"2023-07-06T21:58:02.553434+0000","last_undegraded":"2023-07-06T21:58:02.553434+0000","last_fullsized":"2023-07-06T21:58:02.553434+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:51:48.515302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230140+0000","last_change":"2023-07-06T21:58:00.248737+0000","last_active":"2023-07-06T21:58:01.230140+0000","last_peered":"2023-07-06T21:58:01.230140+0000","last_clean":"2023-07-06T21:58:01.230140+0000","last_became_active":"2023-07-06T21:58:00.248296+0000","last_became_peered":"2023-07-06T21:58:00.248296+0000","last_unstale":"2023-07-06T21:58:01.230140+0000","last_undegraded":"2023-07-06T21:58:01.230140+0000","last_fullsized":"2023-07-06T21:58:01.230140+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:52:43.449882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553430+0000","last_change":"2023-07-06T21:57:59.837178+0000","last_active":"2023-07-06T21:58:02.553430+0000","last_peered":"2023-07-06T21:58:02.553430+0000","last_clean":"2023-07-06T21:58:02.553430+0000","last_became_active":"2023-07-06T21:57:59.836906+0000","last_became_peered":"2023-07-06T21:57:59.836906+0000","last_unstale":"2023-07-06T21:58:02.553430+0000","last_undegraded":"2023-07-06T21:58:02.553430+0000","last_fullsized":"2023-07-06T21:58:02.553430+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:27:15.878496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881666+0000","last_change":"2023-07-06T21:58:00.252408+0000","last_active":"2023-07-06T21:58:02.881666+0000","last_peered":"2023-07-06T21:58:02.881666+0000","last_clean":"2023-07-06T21:58:02.881666+0000","last_became_active":"2023-07-06T21:58:00.252095+0000","last_became_peered":"2023-07-06T21:58:00.252095+0000","last_unstale":"2023-07-06T21:58:02.881666+0000","last_undegraded":"2023-07-06T21:58:02.881666+0000","last_fullsized":"2023-07-06T21:58:02.881666+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:18:06.822876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881038+0000","last_change":"2023-07-06T21:57:59.844528+0000","last_active":"2023-07-06T21:58:02.881038+0000","last_peered":"2023-07-06T21:58:02.881038+0000","last_clean":"2023-07-06T21:58:02.881038+0000","last_became_active":"2023-07-06T21:57:59.844172+0000","last_became_peered":"2023-07-06T21:57:59.844172+0000","last_unstale":"2023-07-06T21:58:02.881038+0000","last_undegraded":"2023-07-06T21:58:02.881038+0000","last_fullsized":"2023-07-06T21:58:02.881038+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:08.653916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231710+0000","last_change":"2023-07-06T21:58:00.257706+0000","last_active":"2023-07-06T21:58:01.231710+0000","last_peered":"2023-07-06T21:58:01.231710+0000","last_clean":"2023-07-06T21:58:01.231710+0000","last_became_active":"2023-07-06T21:58:00.257095+0000","last_became_peered":"2023-07-06T21:58:00.257095+0000","last_unstale":"2023-07-06T21:58:01.231710+0000","last_undegraded":"2023-07-06T21:58:01.231710+0000","last_fullsized":"2023-07-06T21:58:01.231710+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:48.229918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881651+0000","last_change":"2023-07-06T21:57:59.839150+0000","last_active":"2023-07-06T21:58:02.881651+0000","last_peered":"2023-07-06T21:58:02.881651+0000","last_clean":"2023-07-06T21:58:02.881651+0000","last_became_active":"2023-07-06T21:57:59.838822+0000","last_became_peered":"2023-07-06T21:57:59.838822+0000","last_unstale":"2023-07-06T21:58:02.881651+0000","last_undegraded":"2023-07-06T21:58:02.881651+0000","last_fullsized":"2023-07-06T21:58:02.881651+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:06:38.762078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880999+0000","last_change":"2023-07-06T21:58:00.244386+0000","last_active":"2023-07-06T21:58:02.880999+0000","last_peered":"2023-07-06T21:58:02.880999+0000","last_clean":"2023-07-06T21:58:02.880999+0000","last_became_active":"2023-07-06T21:58:00.243947+0000","last_became_peered":"2023-07-06T21:58:00.243947+0000","last_unstale":"2023-07-06T21:58:02.880999+0000","last_undegraded":"2023-07-06T21:58:02.880999+0000","last_fullsized":"2023-07-06T21:58:02.880999+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:59:09.848702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883408+0000","last_change":"2023-07-06T21:57:59.838047+0000","last_active":"2023-07-06T21:58:02.883408+0000","last_peered":"2023-07-06T21:58:02.883408+0000","last_clean":"2023-07-06T21:58:02.883408+0000","last_became_active":"2023-07-06T21:57:59.837512+0000","last_became_peered":"2023-07-06T21:57:59.837512+0000","last_unstale":"2023-07-06T21:58:02.883408+0000","last_undegraded":"2023-07-06T21:58:02.883408+0000","last_fullsized":"2023-07-06T21:58:02.883408+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:11:39.219240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883322+0000","last_change":"2023-07-06T21:58:00.257773+0000","last_active":"2023-07-06T21:58:02.883322+0000","last_peered":"2023-07-06T21:58:02.883322+0000","last_clean":"2023-07-06T21:58:02.883322+0000","last_became_active":"2023-07-06T21:58:00.257525+0000","last_became_peered":"2023-07-06T21:58:00.257525+0000","last_unstale":"2023-07-06T21:58:02.883322+0000","last_undegraded":"2023-07-06T21:58:02.883322+0000","last_fullsized":"2023-07-06T21:58:02.883322+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:20:08.339281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231374+0000","last_change":"2023-07-06T21:57:59.836814+0000","last_active":"2023-07-06T21:58:01.231374+0000","last_peered":"2023-07-06T21:58:01.231374+0000","last_clean":"2023-07-06T21:58:01.231374+0000","last_became_active":"2023-07-06T21:57:59.834939+0000","last_became_peered":"2023-07-06T21:57:59.834939+0000","last_unstale":"2023-07-06T21:58:01.231374+0000","last_undegraded":"2023-07-06T21:58:01.231374+0000","last_fullsized":"2023-07-06T21:58:01.231374+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:41:48.547303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.229810+0000","last_change":"2023-07-06T21:58:00.246203+0000","last_active":"2023-07-06T21:58:01.229810+0000","last_peered":"2023-07-06T21:58:01.229810+0000","last_clean":"2023-07-06T21:58:01.229810+0000","last_became_active":"2023-07-06T21:58:00.245877+0000","last_became_peered":"2023-07-06T21:58:00.245877+0000","last_unstale":"2023-07-06T21:58:01.229810+0000","last_undegraded":"2023-07-06T21:58:01.229810+0000","last_fullsized":"2023-07-06T21:58:01.229810+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:38:51.320178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881088+0000","last_change":"2023-07-06T21:57:59.839963+0000","last_active":"2023-07-06T21:58:02.881088+0000","last_peered":"2023-07-06T21:58:02.881088+0000","last_clean":"2023-07-06T21:58:02.881088+0000","last_became_active":"2023-07-06T21:57:59.839698+0000","last_became_peered":"2023-07-06T21:57:59.839698+0000","last_unstale":"2023-07-06T21:58:02.881088+0000","last_undegraded":"2023-07-06T21:58:02.881088+0000","last_fullsized":"2023-07-06T21:58:02.881088+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:54.853645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880972+0000","last_change":"2023-07-06T21:58:00.251624+0000","last_active":"2023-07-06T21:58:02.880972+0000","last_peered":"2023-07-06T21:58:02.880972+0000","last_clean":"2023-07-06T21:58:02.880972+0000","last_became_active":"2023-07-06T21:58:00.251245+0000","last_became_peered":"2023-07-06T21:58:00.251245+0000","last_unstale":"2023-07-06T21:58:02.880972+0000","last_undegraded":"2023-07-06T21:58:02.880972+0000","last_fullsized":"2023-07-06T21:58:02.880972+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:36:28.113602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231034+0000","last_change":"2023-07-06T21:57:59.838654+0000","last_active":"2023-07-06T21:58:01.231034+0000","last_peered":"2023-07-06T21:58:01.231034+0000","last_clean":"2023-07-06T21:58:01.231034+0000","last_became_active":"2023-07-06T21:57:59.836469+0000","last_became_peered":"2023-07-06T21:57:59.836469+0000","last_unstale":"2023-07-06T21:58:01.231034+0000","last_undegraded":"2023-07-06T21:58:01.231034+0000","last_fullsized":"2023-07-06T21:58:01.231034+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:35.206447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553177+0000","last_change":"2023-07-06T21:58:00.247174+0000","last_active":"2023-07-06T21:58:02.553177+0000","last_peered":"2023-07-06T21:58:02.553177+0000","last_clean":"2023-07-06T21:58:02.553177+0000","last_became_active":"2023-07-06T21:58:00.246908+0000","last_became_peered":"2023-07-06T21:58:00.246908+0000","last_unstale":"2023-07-06T21:58:02.553177+0000","last_undegraded":"2023-07-06T21:58:02.553177+0000","last_fullsized":"2023-07-06T21:58:02.553177+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:10:08.357612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"102'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230259+0000","last_change":"2023-07-06T21:57:59.842706+0000","last_active":"2023-07-06T21:58:01.230259+0000","last_peered":"2023-07-06T21:58:01.230259+0000","last_clean":"2023-07-06T21:58:01.230259+0000","last_became_active":"2023-07-06T21:57:59.842444+0000","last_became_peered":"2023-07-06T21:57:59.842444+0000","last_unstale":"2023-07-06T21:58:01.230259+0000","last_undegraded":"2023-07-06T21:58:01.230259+0000","last_fullsized":"2023-07-06T21:58:01.230259+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:33:57.856687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"91'183","reported_seq":568,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230216+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:58:01.230216+0000","last_peered":"2023-07-06T21:58:01.230216+0000","last_clean":"2023-07-06T21:58:01.230216+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:58:01.230216+0000","last_undegraded":"2023-07-06T21:58:01.230216+0000","last_fullsized":"2023-07-06T21:58:01.230216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:49:39.566591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880804+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:58:02.880804+0000","last_peered":"2023-07-06T21:58:02.880804+0000","last_clean":"2023-07-06T21:58:02.880804+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:58:02.880804+0000","last_undegraded":"2023-07-06T21:58:02.880804+0000","last_fullsized":"2023-07-06T21:58:02.880804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:12:40.805057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881549+0000","last_change":"2023-07-06T21:58:00.243918+0000","last_active":"2023-07-06T21:58:02.881549+0000","last_peered":"2023-07-06T21:58:02.881549+0000","last_clean":"2023-07-06T21:58:02.881549+0000","last_became_active":"2023-07-06T21:58:00.243584+0000","last_became_peered":"2023-07-06T21:58:00.243584+0000","last_unstale":"2023-07-06T21:58:02.881549+0000","last_undegraded":"2023-07-06T21:58:02.881549+0000","last_fullsized":"2023-07-06T21:58:02.881549+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:24:31.240997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"102'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883554+0000","last_change":"2023-07-06T21:57:59.845773+0000","last_active":"2023-07-06T21:58:02.883554+0000","last_peered":"2023-07-06T21:58:02.883554+0000","last_clean":"2023-07-06T21:58:02.883554+0000","last_became_active":"2023-07-06T21:57:59.845498+0000","last_became_peered":"2023-07-06T21:57:59.845498+0000","last_unstale":"2023-07-06T21:58:02.883554+0000","last_undegraded":"2023-07-06T21:58:02.883554+0000","last_fullsized":"2023-07-06T21:58:02.883554+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:43:47.319123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230034+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:58:01.230034+0000","last_peered":"2023-07-06T21:58:01.230034+0000","last_clean":"2023-07-06T21:58:01.230034+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:58:01.230034+0000","last_undegraded":"2023-07-06T21:58:01.230034+0000","last_fullsized":"2023-07-06T21:58:01.230034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:12:15.246916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230314+0000","last_change":"2023-07-06T21:58:00.234864+0000","last_active":"2023-07-06T21:58:01.230314+0000","last_peered":"2023-07-06T21:58:01.230314+0000","last_clean":"2023-07-06T21:58:01.230314+0000","last_became_active":"2023-07-06T21:58:00.234552+0000","last_became_peered":"2023-07-06T21:58:00.234552+0000","last_unstale":"2023-07-06T21:58:01.230314+0000","last_undegraded":"2023-07-06T21:58:01.230314+0000","last_fullsized":"2023-07-06T21:58:01.230314+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:14:48.278197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"102'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881745+0000","last_change":"2023-07-06T21:57:59.837978+0000","last_active":"2023-07-06T21:58:02.881745+0000","last_peered":"2023-07-06T21:58:02.881745+0000","last_clean":"2023-07-06T21:58:02.881745+0000","last_became_active":"2023-07-06T21:57:59.837693+0000","last_became_peered":"2023-07-06T21:57:59.837693+0000","last_unstale":"2023-07-06T21:58:02.881745+0000","last_undegraded":"2023-07-06T21:58:02.881745+0000","last_fullsized":"2023-07-06T21:58:02.881745+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:12:38.322713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230180+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:58:01.230180+0000","last_peered":"2023-07-06T21:58:01.230180+0000","last_clean":"2023-07-06T21:58:01.230180+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:58:01.230180+0000","last_undegraded":"2023-07-06T21:58:01.230180+0000","last_fullsized":"2023-07-06T21:58:01.230180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:37:34.870829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231627+0000","last_change":"2023-07-06T21:58:00.256191+0000","last_active":"2023-07-06T21:58:01.231627+0000","last_peered":"2023-07-06T21:58:01.231627+0000","last_clean":"2023-07-06T21:58:01.231627+0000","last_became_active":"2023-07-06T21:58:00.252740+0000","last_became_peered":"2023-07-06T21:58:00.252740+0000","last_unstale":"2023-07-06T21:58:01.231627+0000","last_undegraded":"2023-07-06T21:58:01.231627+0000","last_fullsized":"2023-07-06T21:58:01.231627+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:40:27.768656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883522+0000","last_change":"2023-07-06T21:57:59.839037+0000","last_active":"2023-07-06T21:58:02.883522+0000","last_peered":"2023-07-06T21:58:02.883522+0000","last_clean":"2023-07-06T21:58:02.883522+0000","last_became_active":"2023-07-06T21:57:59.838747+0000","last_became_peered":"2023-07-06T21:57:59.838747+0000","last_unstale":"2023-07-06T21:58:02.883522+0000","last_undegraded":"2023-07-06T21:58:02.883522+0000","last_fullsized":"2023-07-06T21:58:02.883522+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:12:48.779886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881107+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:58:02.881107+0000","last_peered":"2023-07-06T21:58:02.881107+0000","last_clean":"2023-07-06T21:58:02.881107+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:58:02.881107+0000","last_undegraded":"2023-07-06T21:58:02.881107+0000","last_fullsized":"2023-07-06T21:58:02.881107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:58:00.076471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880721+0000","last_change":"2023-07-06T21:58:00.247776+0000","last_active":"2023-07-06T21:58:02.880721+0000","last_peered":"2023-07-06T21:58:02.880721+0000","last_clean":"2023-07-06T21:58:02.880721+0000","last_became_active":"2023-07-06T21:58:00.247423+0000","last_became_peered":"2023-07-06T21:58:00.247423+0000","last_unstale":"2023-07-06T21:58:02.880721+0000","last_undegraded":"2023-07-06T21:58:02.880721+0000","last_fullsized":"2023-07-06T21:58:02.880721+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:11:47.424677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230648+0000","last_change":"2023-07-06T21:57:59.840318+0000","last_active":"2023-07-06T21:58:01.230648+0000","last_peered":"2023-07-06T21:58:01.230648+0000","last_clean":"2023-07-06T21:58:01.230648+0000","last_became_active":"2023-07-06T21:57:59.840014+0000","last_became_peered":"2023-07-06T21:57:59.840014+0000","last_unstale":"2023-07-06T21:58:01.230648+0000","last_undegraded":"2023-07-06T21:58:01.230648+0000","last_fullsized":"2023-07-06T21:58:01.230648+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:50.061641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553151+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:58:02.553151+0000","last_peered":"2023-07-06T21:58:02.553151+0000","last_clean":"2023-07-06T21:58:02.553151+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:58:02.553151+0000","last_undegraded":"2023-07-06T21:58:02.553151+0000","last_fullsized":"2023-07-06T21:58:02.553151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:09:38.120978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230557+0000","last_change":"2023-07-06T21:58:00.245444+0000","last_active":"2023-07-06T21:58:01.230557+0000","last_peered":"2023-07-06T21:58:01.230557+0000","last_clean":"2023-07-06T21:58:01.230557+0000","last_became_active":"2023-07-06T21:58:00.245174+0000","last_became_peered":"2023-07-06T21:58:00.245174+0000","last_unstale":"2023-07-06T21:58:01.230557+0000","last_undegraded":"2023-07-06T21:58:01.230557+0000","last_fullsized":"2023-07-06T21:58:01.230557+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:56:43.201346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"102'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881083+0000","last_change":"2023-07-06T21:57:59.827270+0000","last_active":"2023-07-06T21:58:02.881083+0000","last_peered":"2023-07-06T21:58:02.881083+0000","last_clean":"2023-07-06T21:58:02.881083+0000","last_became_active":"2023-07-06T21:57:59.826976+0000","last_became_peered":"2023-07-06T21:57:59.826976+0000","last_unstale":"2023-07-06T21:58:02.881083+0000","last_undegraded":"2023-07-06T21:58:02.881083+0000","last_fullsized":"2023-07-06T21:58:02.881083+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:19:05.769681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230392+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:58:01.230392+0000","last_peered":"2023-07-06T21:58:01.230392+0000","last_clean":"2023-07-06T21:58:01.230392+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:58:01.230392+0000","last_undegraded":"2023-07-06T21:58:01.230392+0000","last_fullsized":"2023-07-06T21:58:01.230392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:09:19.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881113+0000","last_change":"2023-07-06T21:58:00.252878+0000","last_active":"2023-07-06T21:58:02.881113+0000","last_peered":"2023-07-06T21:58:02.881113+0000","last_clean":"2023-07-06T21:58:02.881113+0000","last_became_active":"2023-07-06T21:58:00.252001+0000","last_became_peered":"2023-07-06T21:58:00.252001+0000","last_unstale":"2023-07-06T21:58:02.881113+0000","last_undegraded":"2023-07-06T21:58:02.881113+0000","last_fullsized":"2023-07-06T21:58:02.881113+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:34:34.370606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880893+0000","last_change":"2023-07-06T21:57:59.835906+0000","last_active":"2023-07-06T21:58:02.880893+0000","last_peered":"2023-07-06T21:58:02.880893+0000","last_clean":"2023-07-06T21:58:02.880893+0000","last_became_active":"2023-07-06T21:57:59.835563+0000","last_became_peered":"2023-07-06T21:57:59.835563+0000","last_unstale":"2023-07-06T21:58:02.880893+0000","last_undegraded":"2023-07-06T21:58:02.880893+0000","last_fullsized":"2023-07-06T21:58:02.880893+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:08:19.322865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553496+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:58:02.553496+0000","last_peered":"2023-07-06T21:58:02.553496+0000","last_clean":"2023-07-06T21:58:02.553496+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:58:02.553496+0000","last_undegraded":"2023-07-06T21:58:02.553496+0000","last_fullsized":"2023-07-06T21:58:02.553496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:51:45.416855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230193+0000","last_change":"2023-07-06T21:58:00.235045+0000","last_active":"2023-07-06T21:58:01.230193+0000","last_peered":"2023-07-06T21:58:01.230193+0000","last_clean":"2023-07-06T21:58:01.230193+0000","last_became_active":"2023-07-06T21:58:00.234734+0000","last_became_peered":"2023-07-06T21:58:00.234734+0000","last_unstale":"2023-07-06T21:58:01.230193+0000","last_undegraded":"2023-07-06T21:58:01.230193+0000","last_fullsized":"2023-07-06T21:58:01.230193+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:06:12.489120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230148+0000","last_change":"2023-07-06T21:57:59.835525+0000","last_active":"2023-07-06T21:58:01.230148+0000","last_peered":"2023-07-06T21:58:01.230148+0000","last_clean":"2023-07-06T21:58:01.230148+0000","last_became_active":"2023-07-06T21:57:59.835227+0000","last_became_peered":"2023-07-06T21:57:59.835227+0000","last_unstale":"2023-07-06T21:58:01.230148+0000","last_undegraded":"2023-07-06T21:58:01.230148+0000","last_fullsized":"2023-07-06T21:58:01.230148+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:32:47.947040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881819+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:58:02.881819+0000","last_peered":"2023-07-06T21:58:02.881819+0000","last_clean":"2023-07-06T21:58:02.881819+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:58:02.881819+0000","last_undegraded":"2023-07-06T21:58:02.881819+0000","last_fullsized":"2023-07-06T21:58:02.881819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:19:41.376082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575042,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36960,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334880,"statfs":{"total":96636764160,"available":96598917120,"internally_reserved":0,"allocated":1859584,"data_stored":1254339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.54200000000000004,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":0.93600000000000005,"5min":0.93999999999999995,"15min":0.97699999999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.56599999999999995,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":0.876,"5min":0.98799999999999999,"15min":0.99399999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.34799999999999998},"max":{"1min":0.89200000000000002,"5min":0.98399999999999999,"15min":1.0649999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.90500000000000003,"5min":0.94099999999999995,"15min":0.97899999999999998},"last":0.82399999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.56299999999999994,"5min":0.377,"15min":0.377},"max":{"1min":0.86099999999999999,"5min":0.94799999999999995,"15min":0.94999999999999996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.46899999999999997,"15min":0.42599999999999999},"max":{"1min":0.91600000000000004,"5min":1.0209999999999999,"15min":1.0529999999999999},"last":0.91000000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71299999999999997,"15min":0.71899999999999997},"min":{"1min":0.60099999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84499999999999997,"5min":0.91800000000000004,"15min":1.0469999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.55000000000000004,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":0.96599999999999997,"15min":1.006},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.83299999999999996,"15min":0.999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.96299999999999997},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56799999999999995,"15min":0.58399999999999996},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.34999999999999998},"max":{"1min":0.83199999999999996,"5min":0.89500000000000002,"15min":0.98499999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.99199999999999999},"last":0.624}]},{"osd":6,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.51200000000000001,"5min":0.44,"15min":0.40200000000000002},"max":{"1min":0.85799999999999998,"5min":0.93200000000000005,"15min":1.0309999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.496,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.79900000000000004,"5min":0.98399999999999999,"15min":1.0940000000000001},"last":0.47299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36384,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335456,"statfs":{"total":96636764160,"available":96599506944,"internally_reserved":0,"allocated":1269760,"data_stored":663576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70799999999999996,"15min":0.70499999999999996},"min":{"1min":0.502,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94699999999999995,"5min":0.97899999999999998,"15min":1.0980000000000001},"last":0.629},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.38300000000000001},"max":{"1min":1.1830000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.71299999999999997},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.73899999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.41599999999999998},"max":{"1min":0.874,"5min":1.0129999999999999,"15min":1.3859999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.749,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":1.135,"5min":1.159,"15min":1.204},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.498},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":1.4339999999999999},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82699999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0509999999999999,"15min":1.321},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.63100000000000001},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.36299999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.0089999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68700000000000006,"15min":0.71099999999999997},"min":{"1min":0.55200000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":1.3089999999999999,"15min":1.631},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.41699999999999998},"max":{"1min":1.0029999999999999,"5min":1.2549999999999999,"15min":1.3600000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.66500000000000004},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.6930000000000001},"last":0.64500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575041,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":1277952,"data_stored":665487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.92300000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69999999999999996,"15min":0.72099999999999997},"min":{"1min":0.51600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.55400000000000005,"5min":0.40200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89700000000000002,"5min":1.0269999999999999,"15min":1.131},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":1.0329999999999999},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.56000000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0369999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.58099999999999996,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98899999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.77600000000000002,"5min":0.78900000000000003,"15min":1},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.91800000000000004,"15min":1.02},"last":0.747}]},{"osd":6,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":1.052},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.45400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81899999999999995,"5min":0.83599999999999997,"15min":0.96699999999999997},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63400000000000001,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85799999999999998,"5min":0.92200000000000004,"15min":1.0529999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65300000000000002,"15min":0.68100000000000005},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95299999999999996,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.77300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575040,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1261568,"data_stored":663901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.46500000000000002,"15min":0.39400000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88,"5min":1.123,"15min":1.123},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.44},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.361},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2829999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":0.84799999999999998,"5min":0.95299999999999996,"15min":1.2170000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.751},"min":{"1min":0.498,"5min":0.498,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":0.94299999999999995,"15min":1.649},"last":0.86499999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.4219999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.49099999999999999},"max":{"1min":0.91400000000000003,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.308},"max":{"1min":0.85999999999999999,"5min":0.86399999999999999,"15min":1.246},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.96099999999999997,"5min":0.97299999999999998,"15min":1.8049999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.36299999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.478},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":0.94999999999999996,"5min":0.99199999999999999,"15min":1.7250000000000001},"last":1}]},{"osd":7,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42399999999999999},"max":{"1min":1.0149999999999999,"5min":1.0720000000000001,"15min":1.534},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.47099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96399999999999997,"5min":1.01,"15min":1.585},"last":0.93600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575041,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1273856,"data_stored":665465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.85499999999999998,"15min":1.0489999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.67800000000000005,"5min":2.77,"15min":2.77},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.503,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.309,"15min":0.24299999999999999},"max":{"1min":0.77600000000000002,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":1.351,"15min":1.9590000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":0.73999999999999999,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.38},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":2.012},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":0.97299999999999998,"5min":1.1930000000000001,"15min":1.855},"last":0.751},{"interface":"front","average":{"1min":0.755,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0109999999999999,"5min":1.383,"15min":1.524},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80300000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.44800000000000001},"max":{"1min":1.0700000000000001,"5min":1.327,"15min":1.883},"last":0.86799999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.46600000000000003,"15min":0.40000000000000002},"max":{"1min":1.129,"5min":1.425,"15min":1.425},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.81399999999999995,"15min":0.80700000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47899999999999998},"max":{"1min":1.097,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.51000000000000001,"5min":0.5,"15min":0.497},"max":{"1min":1.004,"5min":3.097,"15min":3.097},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.81100000000000005},"min":{"1min":0.54500000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.1140000000000001,"15min":1.9830000000000001},"last":0.72699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575041,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36380,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335460,"statfs":{"total":96636764160,"available":96599511040,"internally_reserved":0,"allocated":1265664,"data_stored":664483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45900000000000002,"15min":0.45100000000000001},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67100000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.495},"min":{"1min":0.28699999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.71799999999999997,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.26000000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.878,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.76100000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.34499999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.76500000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.57599999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.71899999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.437}]},{"osd":4,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.56000000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.113,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80900000000000005,"15min":0.79700000000000004},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0469999999999999,"5min":1.591,"15min":1.591},"last":0.623}]},{"osd":5,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80200000000000005,"15min":0.79300000000000004},"min":{"1min":0.57499999999999996,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.1399999999999999,"5min":1.333,"15min":1.333},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81000000000000005,"15min":0.81699999999999995},"min":{"1min":0.60299999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1850000000000001,"5min":1.327,"15min":1.327},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.58499999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.497},"max":{"1min":1.153,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.629,"5min":0.496,"15min":0.496},"max":{"1min":1.262,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83099999999999996,"15min":0.83599999999999997},"min":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2170000000000001,"5min":1.296,"15min":1.369},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58532,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313308,"statfs":{"total":96636764160,"available":96576827392,"internally_reserved":0,"allocated":1273856,"data_stored":664095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.309,"5min":0.29499999999999998,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.68899999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.33300000000000002},"max":{"1min":0.68700000000000006,"5min":0.87,"15min":0.87},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.32000000000000001},"max":{"1min":0.71699999999999997,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.61899999999999999,"5min":0.49199999999999999,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.143,"15min":1.3140000000000001},"last":0.749},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":1.02,"5min":1.022,"15min":1.2290000000000001},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.497,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.095,"5min":1.1890000000000001,"15min":1.4359999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78400000000000003,"15min":0.79300000000000004},"min":{"1min":0.66100000000000003,"5min":0.50700000000000001,"15min":0.439},"max":{"1min":1.026,"5min":1.044,"15min":1.357},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.53400000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.042,"5min":1.278,"15min":1.278},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79900000000000004,"15min":0.80100000000000005},"min":{"1min":0.65000000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.456},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.80500000000000005,"15min":0.80800000000000005},"min":{"1min":0.61499999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.056,"5min":1.0820000000000001,"15min":1.417},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80300000000000005,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.5,"15min":0.5},"max":{"1min":1.0349999999999999,"5min":1.3280000000000001,"15min":1.397},"last":0.82799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575041,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36956,"kb_used_data":1812,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334884,"statfs":{"total":96636764160,"available":96598921216,"internally_reserved":0,"allocated":1855488,"data_stored":1253284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.54900000000000004,"5min":0.86399999999999999,"15min":1.1459999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.28599999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86799999999999999,"5min":0.98099999999999998,"15min":1.5189999999999999},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.313,"5min":0.313,"15min":0.30099999999999999},"max":{"1min":0.61099999999999999,"5min":0.81100000000000005,"15min":1.228},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67000000000000004,"5min":1.2050000000000001,"15min":1.454},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70999999999999996,"5min":1.151,"15min":1.7969999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76400000000000001,"5min":0.83099999999999996,"15min":1.7190000000000001},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76600000000000001,"15min":0.78900000000000003},"min":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0109999999999999,"5min":1.1319999999999999,"15min":1.911},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3620000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.38400000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.3700000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.77200000000000002,"15min":0.79500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50700000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":1.163,"15min":1.758},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.8220000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47199999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":2.266},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81599999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":2.323},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.57499999999999996,"5min":0.50900000000000001,"15min":0.435},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.69999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:58:07.172 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:58:07.176 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:58:08.930 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:58:09.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.083+0000 7feca7b9f640 1 Processor -- start 2023-07-06T21:58:09.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.083+0000 7feca7b9f640 1 -- start start 2023-07-06T21:58:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca7b9f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feca00712f0 0x7feca006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca7b9f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7feca00ca450 0x7feca015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca7b9f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca0159cd0 con 0x7feca00b3730 2023-07-06T21:58:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca7b9f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca00693f0 con 0x7feca00ca450 2023-07-06T21:58:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca7b9f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca006aca0 con 0x7feca00712f0 2023-07-06T21:58:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca513a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feca00b3730 0x7feca00c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56990/0 (socket says 172.21.15.55:56990) 2023-07-06T21:58:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca513a640 1 -- 172.21.15.55:0/357543380 learned_addr learned my addr 172.21.15.55:0/357543380 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca613c640 1 --2- 172.21.15.55:0/357543380 >> v2:172.21.15.138:3300/0 conn(0x7feca00ca450 0x7feca015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca593b640 1 --2- 172.21.15.55:0/357543380 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feca00712f0 0x7feca006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca4939640 1 -- 172.21.15.55:0/357543380 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840421073 0 0) 0x7feca0159cd0 con 0x7feca00b3730 2023-07-06T21:58:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca4939640 1 -- 172.21.15.55:0/357543380 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec8c003530 con 0x7feca00b3730 2023-07-06T21:58:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca613c640 1 -- 172.21.15.55:0/357543380 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feca00712f0 msgr2=0x7feca006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca613c640 1 --2- 172.21.15.55:0/357543380 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feca00712f0 0x7feca006a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca613c640 1 -- 172.21.15.55:0/357543380 >> v1:172.21.15.55:6789/0 conn(0x7feca00b3730 legacy=0x7feca00c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.087+0000 7feca613c640 1 -- 172.21.15.55:0/357543380 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca00696b0 con 0x7feca00ca450 2023-07-06T21:58:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.091+0000 7feca613c640 1 --2- 172.21.15.55:0/357543380 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feca00ca450 0x7feca015d3e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fec98009d90 tx=0x7fec9801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=864a4670d386434f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.091+0000 7feca4939640 1 -- 172.21.15.55:0/357543380 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec980a58f0 con 0x7feca00ca450 2023-07-06T21:58:09.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.091+0000 7feca4939640 1 -- 172.21.15.55:0/357543380 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec980a5a50 con 0x7feca00ca450 2023-07-06T21:58:09.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.091+0000 7feca4939640 1 -- 172.21.15.55:0/357543380 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec980a5dc0 con 0x7feca00ca450 2023-07-06T21:58:09.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.091+0000 7feca7b9f640 1 -- 172.21.15.55:0/357543380 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feca00ca450 msgr2=0x7feca015d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.091+0000 7feca7b9f640 1 --2- 172.21.15.55:0/357543380 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feca00ca450 0x7feca015d3e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fec98009d90 tx=0x7fec9801c920 comp rx=0 tx=0).stop 2023-07-06T21:58:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.091+0000 7feca7b9f640 1 -- 172.21.15.55:0/357543380 shutdown_connections 2023-07-06T21:58:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.091+0000 7feca7b9f640 1 --2- 172.21.15.55:0/357543380 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feca00ca450 0x7feca015d3e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.091+0000 7feca7b9f640 1 --2- 172.21.15.55:0/357543380 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feca00712f0 0x7feca006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.091+0000 7feca7b9f640 1 -- 172.21.15.55:0/357543380 >> 172.21.15.55:0/357543380 conn(0x7feca00cded0 msgr2=0x7feca00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.091+0000 7feca7b9f640 1 -- 172.21.15.55:0/357543380 shutdown_connections 2023-07-06T21:58:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.091+0000 7feca7b9f640 1 -- 172.21.15.55:0/357543380 wait complete. 2023-07-06T21:58:09.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.091+0000 7feca7b9f640 1 Processor -- start 2023-07-06T21:58:09.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.091+0000 7feca7b9f640 1 -- start start 2023-07-06T21:58:09.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca7b9f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feca00712f0 0x7feca00b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca7b9f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feca00b3730 0x7feca01f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca7b9f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feca00ca450 0x7feca0150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca7b9f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca015bcd0 con 0x7feca00b3730 2023-07-06T21:58:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca7b9f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca01f86f0 con 0x7feca00712f0 2023-07-06T21:58:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca7b9f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca0150dd0 con 0x7feca00ca450 2023-07-06T21:58:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca513a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feca00b3730 0x7feca01f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca513a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feca00b3730 0x7feca01f81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34884/0 (socket says 172.21.15.55:34884) 2023-07-06T21:58:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca513a640 1 -- 172.21.15.55:0/2288304005 learned_addr learned my addr 172.21.15.55:0/2288304005 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca593b640 1 --2- 172.21.15.55:0/2288304005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feca00712f0 0x7feca00b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca613c640 1 --2- 172.21.15.55:0/2288304005 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feca00ca450 0x7feca0150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca513a640 1 -- 172.21.15.55:0/2288304005 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feca00ca450 msgr2=0x7feca0150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca513a640 1 --2- 172.21.15.55:0/2288304005 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feca00ca450 0x7feca0150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca513a640 1 -- 172.21.15.55:0/2288304005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feca00712f0 msgr2=0x7feca00b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca513a640 1 --2- 172.21.15.55:0/2288304005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feca00712f0 0x7feca00b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca513a640 1 -- 172.21.15.55:0/2288304005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec98009a70 con 0x7feca00b3730 2023-07-06T21:58:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca513a640 1 --2- 172.21.15.55:0/2288304005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feca00b3730 0x7feca01f81b0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fec9000c3c0 tx=0x7fec9000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:09.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7fec967fc640 1 -- 172.21.15.55:0/2288304005 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90005cf0 con 0x7feca00b3730 2023-07-06T21:58:09.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7fec967fc640 1 -- 172.21.15.55:0/2288304005 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec90005e50 con 0x7feca00b3730 2023-07-06T21:58:09.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca7b9f640 1 -- 172.21.15.55:0/2288304005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca015b0c0 con 0x7feca00b3730 2023-07-06T21:58:09.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7fec967fc640 1 -- 172.21.15.55:0/2288304005 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900072f0 con 0x7feca00b3730 2023-07-06T21:58:09.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca7b9f640 1 -- 172.21.15.55:0/2288304005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca015b680 con 0x7feca00b3730 2023-07-06T21:58:09.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.095+0000 7feca7b9f640 1 -- 172.21.15.55:0/2288304005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca0066d60 con 0x7feca00b3730 2023-07-06T21:58:09.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.099+0000 7fec967fc640 1 -- 172.21.15.55:0/2288304005 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fec90007450 con 0x7feca00b3730 2023-07-06T21:58:09.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.099+0000 7fec967fc640 1 --2- 172.21.15.55:0/2288304005 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fec840663a0 0x7fec84068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.099+0000 7fec967fc640 1 -- 172.21.15.55:0/2288304005 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fec900835b0 con 0x7feca00b3730 2023-07-06T21:58:09.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.099+0000 7feca593b640 1 --2- 172.21.15.55:0/2288304005 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fec840663a0 0x7fec84068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.099+0000 7feca593b640 1 --2- 172.21.15.55:0/2288304005 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fec840663a0 0x7fec84068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009a50 tx=0x7fec9c008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:09.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.103+0000 7fec967fc640 1 -- 172.21.15.55:0/2288304005 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec900507e0 con 0x7feca00b3730 2023-07-06T21:58:09.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.255+0000 7feca7b9f640 1 -- 172.21.15.55:0/2288304005 --> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feca0157f00 con 0x7fec840663a0 2023-07-06T21:58:09.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.263+0000 7fec967fc640 1 -- 172.21.15.55:0/2288304005 <== mgr.7191 v2:172.21.15.55:6832/703944479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311794 (secure 0 0 0) 0x7feca0157f00 con 0x7fec840663a0 2023-07-06T21:58:09.265 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:09.266 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:58:09.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.267+0000 7feca7b9f640 1 -- 172.21.15.55:0/2288304005 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fec840663a0 msgr2=0x7fec84068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.267+0000 7feca7b9f640 1 --2- 172.21.15.55:0/2288304005 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fec840663a0 0x7fec84068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009a50 tx=0x7fec9c008040 comp rx=0 tx=0).stop 2023-07-06T21:58:09.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.267+0000 7feca7b9f640 1 -- 172.21.15.55:0/2288304005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feca00b3730 msgr2=0x7feca01f81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.267+0000 7feca7b9f640 1 --2- 172.21.15.55:0/2288304005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feca00b3730 0x7feca01f81b0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fec9000c3c0 tx=0x7fec9000c880 comp rx=0 tx=0).stop 2023-07-06T21:58:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.267+0000 7feca7b9f640 1 -- 172.21.15.55:0/2288304005 shutdown_connections 2023-07-06T21:58:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.267+0000 7feca7b9f640 1 --2- 172.21.15.55:0/2288304005 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fec840663a0 0x7fec84068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.267+0000 7feca7b9f640 1 --2- 172.21.15.55:0/2288304005 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feca00ca450 0x7feca0150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.267+0000 7feca7b9f640 1 --2- 172.21.15.55:0/2288304005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feca00b3730 0x7feca01f81b0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.267+0000 7feca7b9f640 1 --2- 172.21.15.55:0/2288304005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feca00712f0 0x7feca00b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.267+0000 7feca7b9f640 1 -- 172.21.15.55:0/2288304005 >> 172.21.15.55:0/2288304005 conn(0x7feca00cded0 msgr2=0x7feca0159310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:09.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.267+0000 7feca7b9f640 1 -- 172.21.15.55:0/2288304005 shutdown_connections 2023-07-06T21:58:09.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.267+0000 7feca7b9f640 1 -- 172.21.15.55:0/2288304005 wait complete. 2023-07-06T21:58:09.285 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-06T21:58:07.706921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":323,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":306176,"kb_used_data":11072,"kb_used_omap":0,"kb_used_meta":295040,"kb_avail":754668544,"statfs":{"total":773094113280,"available":772780589056,"internally_reserved":0,"allocated":11337728,"data_stored":6494630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":302120960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.891175"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881401+0000","last_change":"2023-07-06T21:58:00.259911+0000","last_active":"2023-07-06T21:58:02.881401+0000","last_peered":"2023-07-06T21:58:02.881401+0000","last_clean":"2023-07-06T21:58:02.881401+0000","last_became_active":"2023-07-06T21:58:00.259649+0000","last_became_peered":"2023-07-06T21:58:00.259649+0000","last_unstale":"2023-07-06T21:58:02.881401+0000","last_undegraded":"2023-07-06T21:58:02.881401+0000","last_fullsized":"2023-07-06T21:58:02.881401+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:42:13.510208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553403+0000","last_change":"2023-07-06T21:58:00.252415+0000","last_active":"2023-07-06T21:58:02.553403+0000","last_peered":"2023-07-06T21:58:02.553403+0000","last_clean":"2023-07-06T21:58:02.553403+0000","last_became_active":"2023-07-06T21:58:00.251954+0000","last_became_peered":"2023-07-06T21:58:00.251954+0000","last_unstale":"2023-07-06T21:58:02.553403+0000","last_undegraded":"2023-07-06T21:58:02.553403+0000","last_fullsized":"2023-07-06T21:58:02.553403+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:21:24.758120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.229969+0000","last_change":"2023-07-06T21:58:00.248335+0000","last_active":"2023-07-06T21:58:01.229969+0000","last_peered":"2023-07-06T21:58:01.229969+0000","last_clean":"2023-07-06T21:58:01.229969+0000","last_became_active":"2023-07-06T21:58:00.247833+0000","last_became_peered":"2023-07-06T21:58:00.247833+0000","last_unstale":"2023-07-06T21:58:01.229969+0000","last_undegraded":"2023-07-06T21:58:01.229969+0000","last_fullsized":"2023-07-06T21:58:01.229969+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:16:33.479949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230629+0000","last_change":"2023-07-06T21:58:00.252995+0000","last_active":"2023-07-06T21:58:01.230629+0000","last_peered":"2023-07-06T21:58:01.230629+0000","last_clean":"2023-07-06T21:58:01.230629+0000","last_became_active":"2023-07-06T21:58:00.252695+0000","last_became_peered":"2023-07-06T21:58:00.252695+0000","last_unstale":"2023-07-06T21:58:01.230629+0000","last_undegraded":"2023-07-06T21:58:01.230629+0000","last_fullsized":"2023-07-06T21:58:01.230629+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:26:22.461816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231211+0000","last_change":"2023-07-06T21:58:00.252660+0000","last_active":"2023-07-06T21:58:01.231211+0000","last_peered":"2023-07-06T21:58:01.231211+0000","last_clean":"2023-07-06T21:58:01.231211+0000","last_became_active":"2023-07-06T21:58:00.252318+0000","last_became_peered":"2023-07-06T21:58:00.252318+0000","last_unstale":"2023-07-06T21:58:01.231211+0000","last_undegraded":"2023-07-06T21:58:01.231211+0000","last_fullsized":"2023-07-06T21:58:01.231211+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:59:09.848702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880677+0000","last_change":"2023-07-06T21:58:00.249913+0000","last_active":"2023-07-06T21:58:02.880677+0000","last_peered":"2023-07-06T21:58:02.880677+0000","last_clean":"2023-07-06T21:58:02.880677+0000","last_became_active":"2023-07-06T21:58:00.249518+0000","last_became_peered":"2023-07-06T21:58:00.249518+0000","last_unstale":"2023-07-06T21:58:02.880677+0000","last_undegraded":"2023-07-06T21:58:02.880677+0000","last_fullsized":"2023-07-06T21:58:02.880677+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:44.084196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230103+0000","last_change":"2023-07-06T21:58:00.236368+0000","last_active":"2023-07-06T21:58:01.230103+0000","last_peered":"2023-07-06T21:58:01.230103+0000","last_clean":"2023-07-06T21:58:01.230103+0000","last_became_active":"2023-07-06T21:58:00.236095+0000","last_became_peered":"2023-07-06T21:58:00.236095+0000","last_unstale":"2023-07-06T21:58:01.230103+0000","last_undegraded":"2023-07-06T21:58:01.230103+0000","last_fullsized":"2023-07-06T21:58:01.230103+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:04.788763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880719+0000","last_change":"2023-07-06T21:58:00.244966+0000","last_active":"2023-07-06T21:58:02.880719+0000","last_peered":"2023-07-06T21:58:02.880719+0000","last_clean":"2023-07-06T21:58:02.880719+0000","last_became_active":"2023-07-06T21:58:00.244329+0000","last_became_peered":"2023-07-06T21:58:00.244329+0000","last_unstale":"2023-07-06T21:58:02.880719+0000","last_undegraded":"2023-07-06T21:58:02.880719+0000","last_fullsized":"2023-07-06T21:58:02.880719+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:47:23.430834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881213+0000","last_change":"2023-07-06T21:58:00.252322+0000","last_active":"2023-07-06T21:58:02.881213+0000","last_peered":"2023-07-06T21:58:02.881213+0000","last_clean":"2023-07-06T21:58:02.881213+0000","last_became_active":"2023-07-06T21:58:00.251987+0000","last_became_peered":"2023-07-06T21:58:00.251987+0000","last_unstale":"2023-07-06T21:58:02.881213+0000","last_undegraded":"2023-07-06T21:58:02.881213+0000","last_fullsized":"2023-07-06T21:58:02.881213+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:05:18.615269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881310+0000","last_change":"2023-07-06T21:58:00.250861+0000","last_active":"2023-07-06T21:58:02.881310+0000","last_peered":"2023-07-06T21:58:02.881310+0000","last_clean":"2023-07-06T21:58:02.881310+0000","last_became_active":"2023-07-06T21:58:00.250584+0000","last_became_peered":"2023-07-06T21:58:00.250584+0000","last_unstale":"2023-07-06T21:58:02.881310+0000","last_undegraded":"2023-07-06T21:58:02.881310+0000","last_fullsized":"2023-07-06T21:58:02.881310+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:17:42.295642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553351+0000","last_change":"2023-07-06T21:58:00.244660+0000","last_active":"2023-07-06T21:58:02.553351+0000","last_peered":"2023-07-06T21:58:02.553351+0000","last_clean":"2023-07-06T21:58:02.553351+0000","last_became_active":"2023-07-06T21:58:00.244371+0000","last_became_peered":"2023-07-06T21:58:00.244371+0000","last_unstale":"2023-07-06T21:58:02.553351+0000","last_undegraded":"2023-07-06T21:58:02.553351+0000","last_fullsized":"2023-07-06T21:58:02.553351+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:27:56.235233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881306+0000","last_change":"2023-07-06T21:58:00.250862+0000","last_active":"2023-07-06T21:58:02.881306+0000","last_peered":"2023-07-06T21:58:02.881306+0000","last_clean":"2023-07-06T21:58:02.881306+0000","last_became_active":"2023-07-06T21:58:00.250513+0000","last_became_peered":"2023-07-06T21:58:00.250513+0000","last_unstale":"2023-07-06T21:58:02.881306+0000","last_undegraded":"2023-07-06T21:58:02.881306+0000","last_fullsized":"2023-07-06T21:58:02.881306+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:32:23.259132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230001+0000","last_change":"2023-07-06T21:58:00.247870+0000","last_active":"2023-07-06T21:58:01.230001+0000","last_peered":"2023-07-06T21:58:01.230001+0000","last_clean":"2023-07-06T21:58:01.230001+0000","last_became_active":"2023-07-06T21:58:00.247571+0000","last_became_peered":"2023-07-06T21:58:00.247571+0000","last_unstale":"2023-07-06T21:58:01.230001+0000","last_undegraded":"2023-07-06T21:58:01.230001+0000","last_fullsized":"2023-07-06T21:58:01.230001+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:52:46.623472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230417+0000","last_change":"2023-07-06T21:58:00.245778+0000","last_active":"2023-07-06T21:58:01.230417+0000","last_peered":"2023-07-06T21:58:01.230417+0000","last_clean":"2023-07-06T21:58:01.230417+0000","last_became_active":"2023-07-06T21:58:00.245505+0000","last_became_peered":"2023-07-06T21:58:00.245505+0000","last_unstale":"2023-07-06T21:58:01.230417+0000","last_undegraded":"2023-07-06T21:58:01.230417+0000","last_fullsized":"2023-07-06T21:58:01.230417+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:10.696546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880963+0000","last_change":"2023-07-06T21:58:00.248136+0000","last_active":"2023-07-06T21:58:02.880963+0000","last_peered":"2023-07-06T21:58:02.880963+0000","last_clean":"2023-07-06T21:58:02.880963+0000","last_became_active":"2023-07-06T21:58:00.244318+0000","last_became_peered":"2023-07-06T21:58:00.244318+0000","last_unstale":"2023-07-06T21:58:02.880963+0000","last_undegraded":"2023-07-06T21:58:02.880963+0000","last_fullsized":"2023-07-06T21:58:02.880963+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:55:28.223700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230993+0000","last_change":"2023-07-06T21:58:00.246348+0000","last_active":"2023-07-06T21:58:01.230993+0000","last_peered":"2023-07-06T21:58:01.230993+0000","last_clean":"2023-07-06T21:58:01.230993+0000","last_became_active":"2023-07-06T21:58:00.246013+0000","last_became_peered":"2023-07-06T21:58:00.246013+0000","last_unstale":"2023-07-06T21:58:01.230993+0000","last_undegraded":"2023-07-06T21:58:01.230993+0000","last_fullsized":"2023-07-06T21:58:01.230993+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:26:33.781672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231887+0000","last_change":"2023-07-06T21:58:00.254294+0000","last_active":"2023-07-06T21:58:01.231887+0000","last_peered":"2023-07-06T21:58:01.231887+0000","last_clean":"2023-07-06T21:58:01.231887+0000","last_became_active":"2023-07-06T21:58:00.253322+0000","last_became_peered":"2023-07-06T21:58:00.253322+0000","last_unstale":"2023-07-06T21:58:01.231887+0000","last_undegraded":"2023-07-06T21:58:01.231887+0000","last_fullsized":"2023-07-06T21:58:01.231887+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:55:39.790259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230647+0000","last_change":"2023-07-06T21:58:00.248034+0000","last_active":"2023-07-06T21:58:01.230647+0000","last_peered":"2023-07-06T21:58:01.230647+0000","last_clean":"2023-07-06T21:58:01.230647+0000","last_became_active":"2023-07-06T21:58:00.247695+0000","last_became_peered":"2023-07-06T21:58:00.247695+0000","last_unstale":"2023-07-06T21:58:01.230647+0000","last_undegraded":"2023-07-06T21:58:01.230647+0000","last_fullsized":"2023-07-06T21:58:01.230647+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:50:26.765313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883512+0000","last_change":"2023-07-06T21:58:00.255858+0000","last_active":"2023-07-06T21:58:02.883512+0000","last_peered":"2023-07-06T21:58:02.883512+0000","last_clean":"2023-07-06T21:58:02.883512+0000","last_became_active":"2023-07-06T21:58:00.255589+0000","last_became_peered":"2023-07-06T21:58:00.255589+0000","last_unstale":"2023-07-06T21:58:02.883512+0000","last_undegraded":"2023-07-06T21:58:02.883512+0000","last_fullsized":"2023-07-06T21:58:02.883512+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:00:40.448120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230691+0000","last_change":"2023-07-06T21:58:00.257221+0000","last_active":"2023-07-06T21:58:01.230691+0000","last_peered":"2023-07-06T21:58:01.230691+0000","last_clean":"2023-07-06T21:58:01.230691+0000","last_became_active":"2023-07-06T21:58:00.256894+0000","last_became_peered":"2023-07-06T21:58:00.256894+0000","last_unstale":"2023-07-06T21:58:01.230691+0000","last_undegraded":"2023-07-06T21:58:01.230691+0000","last_fullsized":"2023-07-06T21:58:01.230691+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:20:22.871818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230270+0000","last_change":"2023-07-06T21:58:00.257282+0000","last_active":"2023-07-06T21:58:01.230270+0000","last_peered":"2023-07-06T21:58:01.230270+0000","last_clean":"2023-07-06T21:58:01.230270+0000","last_became_active":"2023-07-06T21:58:00.256956+0000","last_became_peered":"2023-07-06T21:58:00.256956+0000","last_unstale":"2023-07-06T21:58:01.230270+0000","last_undegraded":"2023-07-06T21:58:01.230270+0000","last_fullsized":"2023-07-06T21:58:01.230270+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:00.443303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553125+0000","last_change":"2023-07-06T21:58:00.264147+0000","last_active":"2023-07-06T21:58:02.553125+0000","last_peered":"2023-07-06T21:58:02.553125+0000","last_clean":"2023-07-06T21:58:02.553125+0000","last_became_active":"2023-07-06T21:58:00.263853+0000","last_became_peered":"2023-07-06T21:58:00.263853+0000","last_unstale":"2023-07-06T21:58:02.553125+0000","last_undegraded":"2023-07-06T21:58:02.553125+0000","last_fullsized":"2023-07-06T21:58:02.553125+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:35:28.803621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881483+0000","last_change":"2023-07-06T21:58:00.258856+0000","last_active":"2023-07-06T21:58:02.881483+0000","last_peered":"2023-07-06T21:58:02.881483+0000","last_clean":"2023-07-06T21:58:02.881483+0000","last_became_active":"2023-07-06T21:58:00.258554+0000","last_became_peered":"2023-07-06T21:58:00.258554+0000","last_unstale":"2023-07-06T21:58:02.881483+0000","last_undegraded":"2023-07-06T21:58:02.881483+0000","last_fullsized":"2023-07-06T21:58:02.881483+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:20:05.877094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230402+0000","last_change":"2023-07-06T21:58:00.257421+0000","last_active":"2023-07-06T21:58:01.230402+0000","last_peered":"2023-07-06T21:58:01.230402+0000","last_clean":"2023-07-06T21:58:01.230402+0000","last_became_active":"2023-07-06T21:58:00.257147+0000","last_became_peered":"2023-07-06T21:58:00.257147+0000","last_unstale":"2023-07-06T21:58:01.230402+0000","last_undegraded":"2023-07-06T21:58:01.230402+0000","last_fullsized":"2023-07-06T21:58:01.230402+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:31.724104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553464+0000","last_change":"2023-07-06T21:58:00.250321+0000","last_active":"2023-07-06T21:58:02.553464+0000","last_peered":"2023-07-06T21:58:02.553464+0000","last_clean":"2023-07-06T21:58:02.553464+0000","last_became_active":"2023-07-06T21:58:00.250059+0000","last_became_peered":"2023-07-06T21:58:00.250059+0000","last_unstale":"2023-07-06T21:58:02.553464+0000","last_undegraded":"2023-07-06T21:58:02.553464+0000","last_fullsized":"2023-07-06T21:58:02.553464+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:46:08.686384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230274+0000","last_change":"2023-07-06T21:58:00.246956+0000","last_active":"2023-07-06T21:58:01.230274+0000","last_peered":"2023-07-06T21:58:01.230274+0000","last_clean":"2023-07-06T21:58:01.230274+0000","last_became_active":"2023-07-06T21:58:00.246633+0000","last_became_peered":"2023-07-06T21:58:00.246633+0000","last_unstale":"2023-07-06T21:58:01.230274+0000","last_undegraded":"2023-07-06T21:58:01.230274+0000","last_fullsized":"2023-07-06T21:58:01.230274+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:17:20.868579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231353+0000","last_change":"2023-07-06T21:58:00.257902+0000","last_active":"2023-07-06T21:58:01.231353+0000","last_peered":"2023-07-06T21:58:01.231353+0000","last_clean":"2023-07-06T21:58:01.231353+0000","last_became_active":"2023-07-06T21:58:00.257413+0000","last_became_peered":"2023-07-06T21:58:00.257413+0000","last_unstale":"2023-07-06T21:58:01.231353+0000","last_undegraded":"2023-07-06T21:58:01.231353+0000","last_fullsized":"2023-07-06T21:58:01.231353+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:00:52.189302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881585+0000","last_change":"2023-07-06T21:58:00.258943+0000","last_active":"2023-07-06T21:58:02.881585+0000","last_peered":"2023-07-06T21:58:02.881585+0000","last_clean":"2023-07-06T21:58:02.881585+0000","last_became_active":"2023-07-06T21:58:00.258620+0000","last_became_peered":"2023-07-06T21:58:00.258620+0000","last_unstale":"2023-07-06T21:58:02.881585+0000","last_undegraded":"2023-07-06T21:58:02.881585+0000","last_fullsized":"2023-07-06T21:58:02.881585+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:19:07.642294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553068+0000","last_change":"2023-07-06T21:58:00.260151+0000","last_active":"2023-07-06T21:58:02.553068+0000","last_peered":"2023-07-06T21:58:02.553068+0000","last_clean":"2023-07-06T21:58:02.553068+0000","last_became_active":"2023-07-06T21:58:00.259642+0000","last_became_peered":"2023-07-06T21:58:00.259642+0000","last_unstale":"2023-07-06T21:58:02.553068+0000","last_undegraded":"2023-07-06T21:58:02.553068+0000","last_fullsized":"2023-07-06T21:58:02.553068+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:18:05.001170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.552942+0000","last_change":"2023-07-06T21:58:00.259433+0000","last_active":"2023-07-06T21:58:02.552942+0000","last_peered":"2023-07-06T21:58:02.552942+0000","last_clean":"2023-07-06T21:58:02.552942+0000","last_became_active":"2023-07-06T21:58:00.254274+0000","last_became_peered":"2023-07-06T21:58:00.254274+0000","last_unstale":"2023-07-06T21:58:02.552942+0000","last_undegraded":"2023-07-06T21:58:02.552942+0000","last_fullsized":"2023-07-06T21:58:02.552942+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:43:36.215218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231244+0000","last_change":"2023-07-06T21:58:00.257201+0000","last_active":"2023-07-06T21:58:01.231244+0000","last_peered":"2023-07-06T21:58:01.231244+0000","last_clean":"2023-07-06T21:58:01.231244+0000","last_became_active":"2023-07-06T21:58:00.256862+0000","last_became_peered":"2023-07-06T21:58:00.256862+0000","last_unstale":"2023-07-06T21:58:01.231244+0000","last_undegraded":"2023-07-06T21:58:01.231244+0000","last_fullsized":"2023-07-06T21:58:01.231244+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:34:34.370606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880871+0000","last_change":"2023-07-06T21:58:00.260764+0000","last_active":"2023-07-06T21:58:02.880871+0000","last_peered":"2023-07-06T21:58:02.880871+0000","last_clean":"2023-07-06T21:58:02.880871+0000","last_became_active":"2023-07-06T21:58:00.260457+0000","last_became_peered":"2023-07-06T21:58:00.260457+0000","last_unstale":"2023-07-06T21:58:02.880871+0000","last_undegraded":"2023-07-06T21:58:02.880871+0000","last_fullsized":"2023-07-06T21:58:02.880871+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:08:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231729+0000","last_change":"2023-07-06T21:58:00.253088+0000","last_active":"2023-07-06T21:58:01.231729+0000","last_peered":"2023-07-06T21:58:01.231729+0000","last_clean":"2023-07-06T21:58:01.231729+0000","last_became_active":"2023-07-06T21:58:00.252769+0000","last_became_peered":"2023-07-06T21:58:00.252769+0000","last_unstale":"2023-07-06T21:58:01.231729+0000","last_undegraded":"2023-07-06T21:58:01.231729+0000","last_fullsized":"2023-07-06T21:58:01.231729+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:19:50.205458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"102'4","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881506+0000","last_change":"2023-07-06T21:57:59.844555+0000","last_active":"2023-07-06T21:58:02.881506+0000","last_peered":"2023-07-06T21:58:02.881506+0000","last_clean":"2023-07-06T21:58:02.881506+0000","last_became_active":"2023-07-06T21:57:59.844190+0000","last_became_peered":"2023-07-06T21:57:59.844190+0000","last_unstale":"2023-07-06T21:58:02.881506+0000","last_undegraded":"2023-07-06T21:58:02.881506+0000","last_fullsized":"2023-07-06T21:58:02.881506+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:36:05.375589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881865+0000","last_change":"2023-07-06T21:58:00.257248+0000","last_active":"2023-07-06T21:58:02.881865+0000","last_peered":"2023-07-06T21:58:02.881865+0000","last_clean":"2023-07-06T21:58:02.881865+0000","last_became_active":"2023-07-06T21:58:00.256958+0000","last_became_peered":"2023-07-06T21:58:00.256958+0000","last_unstale":"2023-07-06T21:58:02.881865+0000","last_undegraded":"2023-07-06T21:58:02.881865+0000","last_fullsized":"2023-07-06T21:58:02.881865+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:30:28.866385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"102'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231833+0000","last_change":"2023-07-06T21:57:59.838426+0000","last_active":"2023-07-06T21:58:01.231833+0000","last_peered":"2023-07-06T21:58:01.231833+0000","last_clean":"2023-07-06T21:58:01.231833+0000","last_became_active":"2023-07-06T21:57:59.836297+0000","last_became_peered":"2023-07-06T21:57:59.836297+0000","last_unstale":"2023-07-06T21:58:01.231833+0000","last_undegraded":"2023-07-06T21:58:01.231833+0000","last_fullsized":"2023-07-06T21:58:01.231833+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:08:45.235839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881461+0000","last_change":"2023-07-06T21:58:00.267957+0000","last_active":"2023-07-06T21:58:02.881461+0000","last_peered":"2023-07-06T21:58:02.881461+0000","last_clean":"2023-07-06T21:58:02.881461+0000","last_became_active":"2023-07-06T21:58:00.267700+0000","last_became_peered":"2023-07-06T21:58:00.267700+0000","last_unstale":"2023-07-06T21:58:02.881461+0000","last_undegraded":"2023-07-06T21:58:02.881461+0000","last_fullsized":"2023-07-06T21:58:02.881461+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:21:26.691994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"102'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883620+0000","last_change":"2023-07-06T21:57:59.843906+0000","last_active":"2023-07-06T21:58:02.883620+0000","last_peered":"2023-07-06T21:58:02.883620+0000","last_clean":"2023-07-06T21:58:02.883620+0000","last_became_active":"2023-07-06T21:57:59.843632+0000","last_became_peered":"2023-07-06T21:57:59.843632+0000","last_unstale":"2023-07-06T21:58:02.883620+0000","last_undegraded":"2023-07-06T21:58:02.883620+0000","last_fullsized":"2023-07-06T21:58:02.883620+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:57:49.658859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230413+0000","last_change":"2023-07-06T21:58:00.248646+0000","last_active":"2023-07-06T21:58:01.230413+0000","last_peered":"2023-07-06T21:58:01.230413+0000","last_clean":"2023-07-06T21:58:01.230413+0000","last_became_active":"2023-07-06T21:58:00.248328+0000","last_became_peered":"2023-07-06T21:58:00.248328+0000","last_unstale":"2023-07-06T21:58:01.230413+0000","last_undegraded":"2023-07-06T21:58:01.230413+0000","last_fullsized":"2023-07-06T21:58:01.230413+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:59:27.017612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"102'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883465+0000","last_change":"2023-07-06T21:57:59.842999+0000","last_active":"2023-07-06T21:58:02.883465+0000","last_peered":"2023-07-06T21:58:02.883465+0000","last_clean":"2023-07-06T21:58:02.883465+0000","last_became_active":"2023-07-06T21:57:59.842729+0000","last_became_peered":"2023-07-06T21:57:59.842729+0000","last_unstale":"2023-07-06T21:58:02.883465+0000","last_undegraded":"2023-07-06T21:58:02.883465+0000","last_fullsized":"2023-07-06T21:58:02.883465+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:04:00.700304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.552969+0000","last_change":"2023-07-06T21:58:00.263531+0000","last_active":"2023-07-06T21:58:02.552969+0000","last_peered":"2023-07-06T21:58:02.552969+0000","last_clean":"2023-07-06T21:58:02.552969+0000","last_became_active":"2023-07-06T21:58:00.254359+0000","last_became_peered":"2023-07-06T21:58:00.254359+0000","last_unstale":"2023-07-06T21:58:02.552969+0000","last_undegraded":"2023-07-06T21:58:02.552969+0000","last_fullsized":"2023-07-06T21:58:02.552969+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:16:39.438801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"102'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231387+0000","last_change":"2023-07-06T21:57:59.832907+0000","last_active":"2023-07-06T21:58:01.231387+0000","last_peered":"2023-07-06T21:58:01.231387+0000","last_clean":"2023-07-06T21:58:01.231387+0000","last_became_active":"2023-07-06T21:57:59.832617+0000","last_became_peered":"2023-07-06T21:57:59.832617+0000","last_unstale":"2023-07-06T21:58:01.231387+0000","last_undegraded":"2023-07-06T21:58:01.231387+0000","last_fullsized":"2023-07-06T21:58:01.231387+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:24:22.578209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231283+0000","last_change":"2023-07-06T21:58:00.254722+0000","last_active":"2023-07-06T21:58:01.231283+0000","last_peered":"2023-07-06T21:58:01.231283+0000","last_clean":"2023-07-06T21:58:01.231283+0000","last_became_active":"2023-07-06T21:58:00.252539+0000","last_became_peered":"2023-07-06T21:58:00.252539+0000","last_unstale":"2023-07-06T21:58:01.231283+0000","last_undegraded":"2023-07-06T21:58:01.231283+0000","last_fullsized":"2023-07-06T21:58:01.231283+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:05:18.615269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"102'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231201+0000","last_change":"2023-07-06T21:57:59.838365+0000","last_active":"2023-07-06T21:58:01.231201+0000","last_peered":"2023-07-06T21:58:01.231201+0000","last_clean":"2023-07-06T21:58:01.231201+0000","last_became_active":"2023-07-06T21:57:59.836597+0000","last_became_peered":"2023-07-06T21:57:59.836597+0000","last_unstale":"2023-07-06T21:58:01.231201+0000","last_undegraded":"2023-07-06T21:58:01.231201+0000","last_fullsized":"2023-07-06T21:58:01.231201+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:13:54.477860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.229735+0000","last_change":"2023-07-06T21:58:00.259956+0000","last_active":"2023-07-06T21:58:01.229735+0000","last_peered":"2023-07-06T21:58:01.229735+0000","last_clean":"2023-07-06T21:58:01.229735+0000","last_became_active":"2023-07-06T21:58:00.259634+0000","last_became_peered":"2023-07-06T21:58:00.259634+0000","last_unstale":"2023-07-06T21:58:01.229735+0000","last_undegraded":"2023-07-06T21:58:01.229735+0000","last_fullsized":"2023-07-06T21:58:01.229735+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:48:40.076468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883459+0000","last_change":"2023-07-06T21:57:59.838096+0000","last_active":"2023-07-06T21:58:02.883459+0000","last_peered":"2023-07-06T21:58:02.883459+0000","last_clean":"2023-07-06T21:58:02.883459+0000","last_became_active":"2023-07-06T21:57:59.837773+0000","last_became_peered":"2023-07-06T21:57:59.837773+0000","last_unstale":"2023-07-06T21:58:02.883459+0000","last_undegraded":"2023-07-06T21:58:02.883459+0000","last_fullsized":"2023-07-06T21:58:02.883459+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:32:14.585082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881059+0000","last_change":"2023-07-06T21:58:00.244573+0000","last_active":"2023-07-06T21:58:02.881059+0000","last_peered":"2023-07-06T21:58:02.881059+0000","last_clean":"2023-07-06T21:58:02.881059+0000","last_became_active":"2023-07-06T21:58:00.243967+0000","last_became_peered":"2023-07-06T21:58:00.243967+0000","last_unstale":"2023-07-06T21:58:02.881059+0000","last_undegraded":"2023-07-06T21:58:02.881059+0000","last_fullsized":"2023-07-06T21:58:02.881059+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:24:38.205002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.552930+0000","last_change":"2023-07-06T21:57:59.831116+0000","last_active":"2023-07-06T21:58:02.552930+0000","last_peered":"2023-07-06T21:58:02.552930+0000","last_clean":"2023-07-06T21:58:02.552930+0000","last_became_active":"2023-07-06T21:57:59.830874+0000","last_became_peered":"2023-07-06T21:57:59.830874+0000","last_unstale":"2023-07-06T21:58:02.552930+0000","last_undegraded":"2023-07-06T21:58:02.552930+0000","last_fullsized":"2023-07-06T21:58:02.552930+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:15:56.577710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881403+0000","last_change":"2023-07-06T21:58:00.252795+0000","last_active":"2023-07-06T21:58:02.881403+0000","last_peered":"2023-07-06T21:58:02.881403+0000","last_clean":"2023-07-06T21:58:02.881403+0000","last_became_active":"2023-07-06T21:58:00.252512+0000","last_became_peered":"2023-07-06T21:58:00.252512+0000","last_unstale":"2023-07-06T21:58:02.881403+0000","last_undegraded":"2023-07-06T21:58:02.881403+0000","last_fullsized":"2023-07-06T21:58:02.881403+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:02:36.631810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881670+0000","last_change":"2023-07-06T21:57:59.840272+0000","last_active":"2023-07-06T21:58:02.881670+0000","last_peered":"2023-07-06T21:58:02.881670+0000","last_clean":"2023-07-06T21:58:02.881670+0000","last_became_active":"2023-07-06T21:57:59.840004+0000","last_became_peered":"2023-07-06T21:57:59.840004+0000","last_unstale":"2023-07-06T21:58:02.881670+0000","last_undegraded":"2023-07-06T21:58:02.881670+0000","last_fullsized":"2023-07-06T21:58:02.881670+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:01:36.648388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881323+0000","last_change":"2023-07-06T21:58:00.248055+0000","last_active":"2023-07-06T21:58:02.881323+0000","last_peered":"2023-07-06T21:58:02.881323+0000","last_clean":"2023-07-06T21:58:02.881323+0000","last_became_active":"2023-07-06T21:58:00.247679+0000","last_became_peered":"2023-07-06T21:58:00.247679+0000","last_unstale":"2023-07-06T21:58:02.881323+0000","last_undegraded":"2023-07-06T21:58:02.881323+0000","last_fullsized":"2023-07-06T21:58:02.881323+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:00:52.189302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881320+0000","last_change":"2023-07-06T21:57:59.841836+0000","last_active":"2023-07-06T21:58:02.881320+0000","last_peered":"2023-07-06T21:58:02.881320+0000","last_clean":"2023-07-06T21:58:02.881320+0000","last_became_active":"2023-07-06T21:57:59.841517+0000","last_became_peered":"2023-07-06T21:57:59.841517+0000","last_unstale":"2023-07-06T21:58:02.881320+0000","last_undegraded":"2023-07-06T21:58:02.881320+0000","last_fullsized":"2023-07-06T21:58:02.881320+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:59:17.301930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883339+0000","last_change":"2023-07-06T21:58:00.255586+0000","last_active":"2023-07-06T21:58:02.883339+0000","last_peered":"2023-07-06T21:58:02.883339+0000","last_clean":"2023-07-06T21:58:02.883339+0000","last_became_active":"2023-07-06T21:58:00.255265+0000","last_became_peered":"2023-07-06T21:58:00.255265+0000","last_unstale":"2023-07-06T21:58:02.883339+0000","last_undegraded":"2023-07-06T21:58:02.883339+0000","last_fullsized":"2023-07-06T21:58:02.883339+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:41:20.285854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"102'3","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881087+0000","last_change":"2023-07-06T21:57:59.841276+0000","last_active":"2023-07-06T21:58:02.881087+0000","last_peered":"2023-07-06T21:58:02.881087+0000","last_clean":"2023-07-06T21:58:02.881087+0000","last_became_active":"2023-07-06T21:57:59.841003+0000","last_became_peered":"2023-07-06T21:57:59.841003+0000","last_unstale":"2023-07-06T21:58:02.881087+0000","last_undegraded":"2023-07-06T21:58:02.881087+0000","last_fullsized":"2023-07-06T21:58:02.881087+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:08.131679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231571+0000","last_change":"2023-07-06T21:58:00.257910+0000","last_active":"2023-07-06T21:58:01.231571+0000","last_peered":"2023-07-06T21:58:01.231571+0000","last_clean":"2023-07-06T21:58:01.231571+0000","last_became_active":"2023-07-06T21:58:00.257589+0000","last_became_peered":"2023-07-06T21:58:00.257589+0000","last_unstale":"2023-07-06T21:58:01.231571+0000","last_undegraded":"2023-07-06T21:58:01.231571+0000","last_fullsized":"2023-07-06T21:58:01.231571+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:23.302421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"102'6","reported_seq":19,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880776+0000","last_change":"2023-07-06T21:57:59.842849+0000","last_active":"2023-07-06T21:58:02.880776+0000","last_peered":"2023-07-06T21:58:02.880776+0000","last_clean":"2023-07-06T21:58:02.880776+0000","last_became_active":"2023-07-06T21:57:59.842586+0000","last_became_peered":"2023-07-06T21:57:59.842586+0000","last_unstale":"2023-07-06T21:58:02.880776+0000","last_undegraded":"2023-07-06T21:58:02.880776+0000","last_fullsized":"2023-07-06T21:58:02.880776+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:26:32.770527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883375+0000","last_change":"2023-07-06T21:58:00.257898+0000","last_active":"2023-07-06T21:58:02.883375+0000","last_peered":"2023-07-06T21:58:02.883375+0000","last_clean":"2023-07-06T21:58:02.883375+0000","last_became_active":"2023-07-06T21:58:00.257638+0000","last_became_peered":"2023-07-06T21:58:00.257638+0000","last_unstale":"2023-07-06T21:58:02.883375+0000","last_undegraded":"2023-07-06T21:58:02.883375+0000","last_fullsized":"2023-07-06T21:58:02.883375+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:03:43.968455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"102'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553254+0000","last_change":"2023-07-06T21:57:59.836414+0000","last_active":"2023-07-06T21:58:02.553254+0000","last_peered":"2023-07-06T21:58:02.553254+0000","last_clean":"2023-07-06T21:58:02.553254+0000","last_became_active":"2023-07-06T21:57:59.836070+0000","last_became_peered":"2023-07-06T21:57:59.836070+0000","last_unstale":"2023-07-06T21:58:02.553254+0000","last_undegraded":"2023-07-06T21:58:02.553254+0000","last_fullsized":"2023-07-06T21:58:02.553254+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:22:32.222097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230149+0000","last_change":"2023-07-06T21:58:00.255926+0000","last_active":"2023-07-06T21:58:01.230149+0000","last_peered":"2023-07-06T21:58:01.230149+0000","last_clean":"2023-07-06T21:58:01.230149+0000","last_became_active":"2023-07-06T21:58:00.255644+0000","last_became_peered":"2023-07-06T21:58:00.255644+0000","last_unstale":"2023-07-06T21:58:01.230149+0000","last_undegraded":"2023-07-06T21:58:01.230149+0000","last_fullsized":"2023-07-06T21:58:01.230149+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:42:41.700574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881138+0000","last_change":"2023-07-06T21:57:59.832716+0000","last_active":"2023-07-06T21:58:02.881138+0000","last_peered":"2023-07-06T21:58:02.881138+0000","last_clean":"2023-07-06T21:58:02.881138+0000","last_became_active":"2023-07-06T21:57:59.832398+0000","last_became_peered":"2023-07-06T21:57:59.832398+0000","last_unstale":"2023-07-06T21:58:02.881138+0000","last_undegraded":"2023-07-06T21:58:02.881138+0000","last_fullsized":"2023-07-06T21:58:02.881138+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:53:07.202687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.552854+0000","last_change":"2023-07-06T21:58:00.259198+0000","last_active":"2023-07-06T21:58:02.552854+0000","last_peered":"2023-07-06T21:58:02.552854+0000","last_clean":"2023-07-06T21:58:02.552854+0000","last_became_active":"2023-07-06T21:58:00.254332+0000","last_became_peered":"2023-07-06T21:58:00.254332+0000","last_unstale":"2023-07-06T21:58:02.552854+0000","last_undegraded":"2023-07-06T21:58:02.552854+0000","last_fullsized":"2023-07-06T21:58:02.552854+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:19:35.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881385+0000","last_change":"2023-07-06T21:57:59.841796+0000","last_active":"2023-07-06T21:58:02.881385+0000","last_peered":"2023-07-06T21:58:02.881385+0000","last_clean":"2023-07-06T21:58:02.881385+0000","last_became_active":"2023-07-06T21:57:59.841526+0000","last_became_peered":"2023-07-06T21:57:59.841526+0000","last_unstale":"2023-07-06T21:58:02.881385+0000","last_undegraded":"2023-07-06T21:58:02.881385+0000","last_fullsized":"2023-07-06T21:58:02.881385+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:41:48.547303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.552834+0000","last_change":"2023-07-06T21:58:00.247902+0000","last_active":"2023-07-06T21:58:02.552834+0000","last_peered":"2023-07-06T21:58:02.552834+0000","last_clean":"2023-07-06T21:58:02.552834+0000","last_became_active":"2023-07-06T21:58:00.247628+0000","last_became_peered":"2023-07-06T21:58:00.247628+0000","last_unstale":"2023-07-06T21:58:02.552834+0000","last_undegraded":"2023-07-06T21:58:02.552834+0000","last_fullsized":"2023-07-06T21:58:02.552834+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:51:56.437887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"102'8","reported_seq":21,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883180+0000","last_change":"2023-07-06T21:57:59.839253+0000","last_active":"2023-07-06T21:58:02.883180+0000","last_peered":"2023-07-06T21:58:02.883180+0000","last_clean":"2023-07-06T21:58:02.883180+0000","last_became_active":"2023-07-06T21:57:59.838907+0000","last_became_peered":"2023-07-06T21:57:59.838907+0000","last_unstale":"2023-07-06T21:58:02.883180+0000","last_undegraded":"2023-07-06T21:58:02.883180+0000","last_fullsized":"2023-07-06T21:58:02.883180+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:36:42.443047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231824+0000","last_change":"2023-07-06T21:58:00.256362+0000","last_active":"2023-07-06T21:58:01.231824+0000","last_peered":"2023-07-06T21:58:01.231824+0000","last_clean":"2023-07-06T21:58:01.231824+0000","last_became_active":"2023-07-06T21:58:00.253078+0000","last_became_peered":"2023-07-06T21:58:00.253078+0000","last_unstale":"2023-07-06T21:58:01.231824+0000","last_undegraded":"2023-07-06T21:58:01.231824+0000","last_fullsized":"2023-07-06T21:58:01.231824+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:11:08.632497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"102'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553434+0000","last_change":"2023-07-06T21:57:59.841940+0000","last_active":"2023-07-06T21:58:02.553434+0000","last_peered":"2023-07-06T21:58:02.553434+0000","last_clean":"2023-07-06T21:58:02.553434+0000","last_became_active":"2023-07-06T21:57:59.841642+0000","last_became_peered":"2023-07-06T21:57:59.841642+0000","last_unstale":"2023-07-06T21:58:02.553434+0000","last_undegraded":"2023-07-06T21:58:02.553434+0000","last_fullsized":"2023-07-06T21:58:02.553434+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:51:48.515302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230140+0000","last_change":"2023-07-06T21:58:00.248737+0000","last_active":"2023-07-06T21:58:01.230140+0000","last_peered":"2023-07-06T21:58:01.230140+0000","last_clean":"2023-07-06T21:58:01.230140+0000","last_became_active":"2023-07-06T21:58:00.248296+0000","last_became_peered":"2023-07-06T21:58:00.248296+0000","last_unstale":"2023-07-06T21:58:01.230140+0000","last_undegraded":"2023-07-06T21:58:01.230140+0000","last_fullsized":"2023-07-06T21:58:01.230140+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:52:43.449882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553430+0000","last_change":"2023-07-06T21:57:59.837178+0000","last_active":"2023-07-06T21:58:02.553430+0000","last_peered":"2023-07-06T21:58:02.553430+0000","last_clean":"2023-07-06T21:58:02.553430+0000","last_became_active":"2023-07-06T21:57:59.836906+0000","last_became_peered":"2023-07-06T21:57:59.836906+0000","last_unstale":"2023-07-06T21:58:02.553430+0000","last_undegraded":"2023-07-06T21:58:02.553430+0000","last_fullsized":"2023-07-06T21:58:02.553430+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:27:15.878496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881666+0000","last_change":"2023-07-06T21:58:00.252408+0000","last_active":"2023-07-06T21:58:02.881666+0000","last_peered":"2023-07-06T21:58:02.881666+0000","last_clean":"2023-07-06T21:58:02.881666+0000","last_became_active":"2023-07-06T21:58:00.252095+0000","last_became_peered":"2023-07-06T21:58:00.252095+0000","last_unstale":"2023-07-06T21:58:02.881666+0000","last_undegraded":"2023-07-06T21:58:02.881666+0000","last_fullsized":"2023-07-06T21:58:02.881666+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:18:06.822876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881038+0000","last_change":"2023-07-06T21:57:59.844528+0000","last_active":"2023-07-06T21:58:02.881038+0000","last_peered":"2023-07-06T21:58:02.881038+0000","last_clean":"2023-07-06T21:58:02.881038+0000","last_became_active":"2023-07-06T21:57:59.844172+0000","last_became_peered":"2023-07-06T21:57:59.844172+0000","last_unstale":"2023-07-06T21:58:02.881038+0000","last_undegraded":"2023-07-06T21:58:02.881038+0000","last_fullsized":"2023-07-06T21:58:02.881038+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:08.653916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231710+0000","last_change":"2023-07-06T21:58:00.257706+0000","last_active":"2023-07-06T21:58:01.231710+0000","last_peered":"2023-07-06T21:58:01.231710+0000","last_clean":"2023-07-06T21:58:01.231710+0000","last_became_active":"2023-07-06T21:58:00.257095+0000","last_became_peered":"2023-07-06T21:58:00.257095+0000","last_unstale":"2023-07-06T21:58:01.231710+0000","last_undegraded":"2023-07-06T21:58:01.231710+0000","last_fullsized":"2023-07-06T21:58:01.231710+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:30:48.229918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881651+0000","last_change":"2023-07-06T21:57:59.839150+0000","last_active":"2023-07-06T21:58:02.881651+0000","last_peered":"2023-07-06T21:58:02.881651+0000","last_clean":"2023-07-06T21:58:02.881651+0000","last_became_active":"2023-07-06T21:57:59.838822+0000","last_became_peered":"2023-07-06T21:57:59.838822+0000","last_unstale":"2023-07-06T21:58:02.881651+0000","last_undegraded":"2023-07-06T21:58:02.881651+0000","last_fullsized":"2023-07-06T21:58:02.881651+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:06:38.762078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880999+0000","last_change":"2023-07-06T21:58:00.244386+0000","last_active":"2023-07-06T21:58:02.880999+0000","last_peered":"2023-07-06T21:58:02.880999+0000","last_clean":"2023-07-06T21:58:02.880999+0000","last_became_active":"2023-07-06T21:58:00.243947+0000","last_became_peered":"2023-07-06T21:58:00.243947+0000","last_unstale":"2023-07-06T21:58:02.880999+0000","last_undegraded":"2023-07-06T21:58:02.880999+0000","last_fullsized":"2023-07-06T21:58:02.880999+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:59:09.848702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883408+0000","last_change":"2023-07-06T21:57:59.838047+0000","last_active":"2023-07-06T21:58:02.883408+0000","last_peered":"2023-07-06T21:58:02.883408+0000","last_clean":"2023-07-06T21:58:02.883408+0000","last_became_active":"2023-07-06T21:57:59.837512+0000","last_became_peered":"2023-07-06T21:57:59.837512+0000","last_unstale":"2023-07-06T21:58:02.883408+0000","last_undegraded":"2023-07-06T21:58:02.883408+0000","last_fullsized":"2023-07-06T21:58:02.883408+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:11:39.219240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883322+0000","last_change":"2023-07-06T21:58:00.257773+0000","last_active":"2023-07-06T21:58:02.883322+0000","last_peered":"2023-07-06T21:58:02.883322+0000","last_clean":"2023-07-06T21:58:02.883322+0000","last_became_active":"2023-07-06T21:58:00.257525+0000","last_became_peered":"2023-07-06T21:58:00.257525+0000","last_unstale":"2023-07-06T21:58:02.883322+0000","last_undegraded":"2023-07-06T21:58:02.883322+0000","last_fullsized":"2023-07-06T21:58:02.883322+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:20:08.339281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231374+0000","last_change":"2023-07-06T21:57:59.836814+0000","last_active":"2023-07-06T21:58:01.231374+0000","last_peered":"2023-07-06T21:58:01.231374+0000","last_clean":"2023-07-06T21:58:01.231374+0000","last_became_active":"2023-07-06T21:57:59.834939+0000","last_became_peered":"2023-07-06T21:57:59.834939+0000","last_unstale":"2023-07-06T21:58:01.231374+0000","last_undegraded":"2023-07-06T21:58:01.231374+0000","last_fullsized":"2023-07-06T21:58:01.231374+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:41:48.547303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.229810+0000","last_change":"2023-07-06T21:58:00.246203+0000","last_active":"2023-07-06T21:58:01.229810+0000","last_peered":"2023-07-06T21:58:01.229810+0000","last_clean":"2023-07-06T21:58:01.229810+0000","last_became_active":"2023-07-06T21:58:00.245877+0000","last_became_peered":"2023-07-06T21:58:00.245877+0000","last_unstale":"2023-07-06T21:58:01.229810+0000","last_undegraded":"2023-07-06T21:58:01.229810+0000","last_fullsized":"2023-07-06T21:58:01.229810+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:38:51.320178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881088+0000","last_change":"2023-07-06T21:57:59.839963+0000","last_active":"2023-07-06T21:58:02.881088+0000","last_peered":"2023-07-06T21:58:02.881088+0000","last_clean":"2023-07-06T21:58:02.881088+0000","last_became_active":"2023-07-06T21:57:59.839698+0000","last_became_peered":"2023-07-06T21:57:59.839698+0000","last_unstale":"2023-07-06T21:58:02.881088+0000","last_undegraded":"2023-07-06T21:58:02.881088+0000","last_fullsized":"2023-07-06T21:58:02.881088+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:54.853645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880972+0000","last_change":"2023-07-06T21:58:00.251624+0000","last_active":"2023-07-06T21:58:02.880972+0000","last_peered":"2023-07-06T21:58:02.880972+0000","last_clean":"2023-07-06T21:58:02.880972+0000","last_became_active":"2023-07-06T21:58:00.251245+0000","last_became_peered":"2023-07-06T21:58:00.251245+0000","last_unstale":"2023-07-06T21:58:02.880972+0000","last_undegraded":"2023-07-06T21:58:02.880972+0000","last_fullsized":"2023-07-06T21:58:02.880972+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:36:28.113602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231034+0000","last_change":"2023-07-06T21:57:59.838654+0000","last_active":"2023-07-06T21:58:01.231034+0000","last_peered":"2023-07-06T21:58:01.231034+0000","last_clean":"2023-07-06T21:58:01.231034+0000","last_became_active":"2023-07-06T21:57:59.836469+0000","last_became_peered":"2023-07-06T21:57:59.836469+0000","last_unstale":"2023-07-06T21:58:01.231034+0000","last_undegraded":"2023-07-06T21:58:01.231034+0000","last_fullsized":"2023-07-06T21:58:01.231034+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:28:35.206447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553177+0000","last_change":"2023-07-06T21:58:00.247174+0000","last_active":"2023-07-06T21:58:02.553177+0000","last_peered":"2023-07-06T21:58:02.553177+0000","last_clean":"2023-07-06T21:58:02.553177+0000","last_became_active":"2023-07-06T21:58:00.246908+0000","last_became_peered":"2023-07-06T21:58:00.246908+0000","last_unstale":"2023-07-06T21:58:02.553177+0000","last_undegraded":"2023-07-06T21:58:02.553177+0000","last_fullsized":"2023-07-06T21:58:02.553177+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:10:08.357612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"102'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230259+0000","last_change":"2023-07-06T21:57:59.842706+0000","last_active":"2023-07-06T21:58:01.230259+0000","last_peered":"2023-07-06T21:58:01.230259+0000","last_clean":"2023-07-06T21:58:01.230259+0000","last_became_active":"2023-07-06T21:57:59.842444+0000","last_became_peered":"2023-07-06T21:57:59.842444+0000","last_unstale":"2023-07-06T21:58:01.230259+0000","last_undegraded":"2023-07-06T21:58:01.230259+0000","last_fullsized":"2023-07-06T21:58:01.230259+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:33:57.856687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"91'183","reported_seq":568,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230216+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:58:01.230216+0000","last_peered":"2023-07-06T21:58:01.230216+0000","last_clean":"2023-07-06T21:58:01.230216+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:58:01.230216+0000","last_undegraded":"2023-07-06T21:58:01.230216+0000","last_fullsized":"2023-07-06T21:58:01.230216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:49:39.566591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880804+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:58:02.880804+0000","last_peered":"2023-07-06T21:58:02.880804+0000","last_clean":"2023-07-06T21:58:02.880804+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:58:02.880804+0000","last_undegraded":"2023-07-06T21:58:02.880804+0000","last_fullsized":"2023-07-06T21:58:02.880804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:12:40.805057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881549+0000","last_change":"2023-07-06T21:58:00.243918+0000","last_active":"2023-07-06T21:58:02.881549+0000","last_peered":"2023-07-06T21:58:02.881549+0000","last_clean":"2023-07-06T21:58:02.881549+0000","last_became_active":"2023-07-06T21:58:00.243584+0000","last_became_peered":"2023-07-06T21:58:00.243584+0000","last_unstale":"2023-07-06T21:58:02.881549+0000","last_undegraded":"2023-07-06T21:58:02.881549+0000","last_fullsized":"2023-07-06T21:58:02.881549+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:24:31.240997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"102'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883554+0000","last_change":"2023-07-06T21:57:59.845773+0000","last_active":"2023-07-06T21:58:02.883554+0000","last_peered":"2023-07-06T21:58:02.883554+0000","last_clean":"2023-07-06T21:58:02.883554+0000","last_became_active":"2023-07-06T21:57:59.845498+0000","last_became_peered":"2023-07-06T21:57:59.845498+0000","last_unstale":"2023-07-06T21:58:02.883554+0000","last_undegraded":"2023-07-06T21:58:02.883554+0000","last_fullsized":"2023-07-06T21:58:02.883554+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:43:47.319123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230034+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:58:01.230034+0000","last_peered":"2023-07-06T21:58:01.230034+0000","last_clean":"2023-07-06T21:58:01.230034+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:58:01.230034+0000","last_undegraded":"2023-07-06T21:58:01.230034+0000","last_fullsized":"2023-07-06T21:58:01.230034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:12:15.246916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230314+0000","last_change":"2023-07-06T21:58:00.234864+0000","last_active":"2023-07-06T21:58:01.230314+0000","last_peered":"2023-07-06T21:58:01.230314+0000","last_clean":"2023-07-06T21:58:01.230314+0000","last_became_active":"2023-07-06T21:58:00.234552+0000","last_became_peered":"2023-07-06T21:58:00.234552+0000","last_unstale":"2023-07-06T21:58:01.230314+0000","last_undegraded":"2023-07-06T21:58:01.230314+0000","last_fullsized":"2023-07-06T21:58:01.230314+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:14:48.278197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"102'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881745+0000","last_change":"2023-07-06T21:57:59.837978+0000","last_active":"2023-07-06T21:58:02.881745+0000","last_peered":"2023-07-06T21:58:02.881745+0000","last_clean":"2023-07-06T21:58:02.881745+0000","last_became_active":"2023-07-06T21:57:59.837693+0000","last_became_peered":"2023-07-06T21:57:59.837693+0000","last_unstale":"2023-07-06T21:58:02.881745+0000","last_undegraded":"2023-07-06T21:58:02.881745+0000","last_fullsized":"2023-07-06T21:58:02.881745+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:12:38.322713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230180+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:58:01.230180+0000","last_peered":"2023-07-06T21:58:01.230180+0000","last_clean":"2023-07-06T21:58:01.230180+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:58:01.230180+0000","last_undegraded":"2023-07-06T21:58:01.230180+0000","last_fullsized":"2023-07-06T21:58:01.230180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:37:34.870829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.231627+0000","last_change":"2023-07-06T21:58:00.256191+0000","last_active":"2023-07-06T21:58:01.231627+0000","last_peered":"2023-07-06T21:58:01.231627+0000","last_clean":"2023-07-06T21:58:01.231627+0000","last_became_active":"2023-07-06T21:58:00.252740+0000","last_became_peered":"2023-07-06T21:58:00.252740+0000","last_unstale":"2023-07-06T21:58:01.231627+0000","last_undegraded":"2023-07-06T21:58:01.231627+0000","last_fullsized":"2023-07-06T21:58:01.231627+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:40:27.768656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.883522+0000","last_change":"2023-07-06T21:57:59.839037+0000","last_active":"2023-07-06T21:58:02.883522+0000","last_peered":"2023-07-06T21:58:02.883522+0000","last_clean":"2023-07-06T21:58:02.883522+0000","last_became_active":"2023-07-06T21:57:59.838747+0000","last_became_peered":"2023-07-06T21:57:59.838747+0000","last_unstale":"2023-07-06T21:58:02.883522+0000","last_undegraded":"2023-07-06T21:58:02.883522+0000","last_fullsized":"2023-07-06T21:58:02.883522+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:12:48.779886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881107+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:58:02.881107+0000","last_peered":"2023-07-06T21:58:02.881107+0000","last_clean":"2023-07-06T21:58:02.881107+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:58:02.881107+0000","last_undegraded":"2023-07-06T21:58:02.881107+0000","last_fullsized":"2023-07-06T21:58:02.881107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:58:00.076471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880721+0000","last_change":"2023-07-06T21:58:00.247776+0000","last_active":"2023-07-06T21:58:02.880721+0000","last_peered":"2023-07-06T21:58:02.880721+0000","last_clean":"2023-07-06T21:58:02.880721+0000","last_became_active":"2023-07-06T21:58:00.247423+0000","last_became_peered":"2023-07-06T21:58:00.247423+0000","last_unstale":"2023-07-06T21:58:02.880721+0000","last_undegraded":"2023-07-06T21:58:02.880721+0000","last_fullsized":"2023-07-06T21:58:02.880721+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:11:47.424677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230648+0000","last_change":"2023-07-06T21:57:59.840318+0000","last_active":"2023-07-06T21:58:01.230648+0000","last_peered":"2023-07-06T21:58:01.230648+0000","last_clean":"2023-07-06T21:58:01.230648+0000","last_became_active":"2023-07-06T21:57:59.840014+0000","last_became_peered":"2023-07-06T21:57:59.840014+0000","last_unstale":"2023-07-06T21:58:01.230648+0000","last_undegraded":"2023-07-06T21:58:01.230648+0000","last_fullsized":"2023-07-06T21:58:01.230648+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:50.061641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553151+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:58:02.553151+0000","last_peered":"2023-07-06T21:58:02.553151+0000","last_clean":"2023-07-06T21:58:02.553151+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:58:02.553151+0000","last_undegraded":"2023-07-06T21:58:02.553151+0000","last_fullsized":"2023-07-06T21:58:02.553151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:09:38.120978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230557+0000","last_change":"2023-07-06T21:58:00.245444+0000","last_active":"2023-07-06T21:58:01.230557+0000","last_peered":"2023-07-06T21:58:01.230557+0000","last_clean":"2023-07-06T21:58:01.230557+0000","last_became_active":"2023-07-06T21:58:00.245174+0000","last_became_peered":"2023-07-06T21:58:00.245174+0000","last_unstale":"2023-07-06T21:58:01.230557+0000","last_undegraded":"2023-07-06T21:58:01.230557+0000","last_fullsized":"2023-07-06T21:58:01.230557+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:56:43.201346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"102'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881083+0000","last_change":"2023-07-06T21:57:59.827270+0000","last_active":"2023-07-06T21:58:02.881083+0000","last_peered":"2023-07-06T21:58:02.881083+0000","last_clean":"2023-07-06T21:58:02.881083+0000","last_became_active":"2023-07-06T21:57:59.826976+0000","last_became_peered":"2023-07-06T21:57:59.826976+0000","last_unstale":"2023-07-06T21:58:02.881083+0000","last_undegraded":"2023-07-06T21:58:02.881083+0000","last_fullsized":"2023-07-06T21:58:02.881083+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:19:05.769681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230392+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:58:01.230392+0000","last_peered":"2023-07-06T21:58:01.230392+0000","last_clean":"2023-07-06T21:58:01.230392+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:58:01.230392+0000","last_undegraded":"2023-07-06T21:58:01.230392+0000","last_fullsized":"2023-07-06T21:58:01.230392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:09:19.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881113+0000","last_change":"2023-07-06T21:58:00.252878+0000","last_active":"2023-07-06T21:58:02.881113+0000","last_peered":"2023-07-06T21:58:02.881113+0000","last_clean":"2023-07-06T21:58:02.881113+0000","last_became_active":"2023-07-06T21:58:00.252001+0000","last_became_peered":"2023-07-06T21:58:00.252001+0000","last_unstale":"2023-07-06T21:58:02.881113+0000","last_undegraded":"2023-07-06T21:58:02.881113+0000","last_fullsized":"2023-07-06T21:58:02.881113+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:34:34.370606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.880893+0000","last_change":"2023-07-06T21:57:59.835906+0000","last_active":"2023-07-06T21:58:02.880893+0000","last_peered":"2023-07-06T21:58:02.880893+0000","last_clean":"2023-07-06T21:58:02.880893+0000","last_became_active":"2023-07-06T21:57:59.835563+0000","last_became_peered":"2023-07-06T21:57:59.835563+0000","last_unstale":"2023-07-06T21:58:02.880893+0000","last_undegraded":"2023-07-06T21:58:02.880893+0000","last_fullsized":"2023-07-06T21:58:02.880893+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:08:19.322865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.553496+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:58:02.553496+0000","last_peered":"2023-07-06T21:58:02.553496+0000","last_clean":"2023-07-06T21:58:02.553496+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:58:02.553496+0000","last_undegraded":"2023-07-06T21:58:02.553496+0000","last_fullsized":"2023-07-06T21:58:02.553496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:51:45.416855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230193+0000","last_change":"2023-07-06T21:58:00.235045+0000","last_active":"2023-07-06T21:58:01.230193+0000","last_peered":"2023-07-06T21:58:01.230193+0000","last_clean":"2023-07-06T21:58:01.230193+0000","last_became_active":"2023-07-06T21:58:00.234734+0000","last_became_peered":"2023-07-06T21:58:00.234734+0000","last_unstale":"2023-07-06T21:58:01.230193+0000","last_undegraded":"2023-07-06T21:58:01.230193+0000","last_fullsized":"2023-07-06T21:58:01.230193+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:59.800148+0000","last_clean_scrub_stamp":"2023-07-06T21:57:59.800148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:06:12.489120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:01.230148+0000","last_change":"2023-07-06T21:57:59.835525+0000","last_active":"2023-07-06T21:58:01.230148+0000","last_peered":"2023-07-06T21:58:01.230148+0000","last_clean":"2023-07-06T21:58:01.230148+0000","last_became_active":"2023-07-06T21:57:59.835227+0000","last_became_peered":"2023-07-06T21:57:59.835227+0000","last_unstale":"2023-07-06T21:58:01.230148+0000","last_undegraded":"2023-07-06T21:58:01.230148+0000","last_fullsized":"2023-07-06T21:58:01.230148+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:57:58.789003+0000","last_clean_scrub_stamp":"2023-07-06T21:57:58.789003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:32:47.947040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-06T21:58:02.881819+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:58:02.881819+0000","last_peered":"2023-07-06T21:58:02.881819+0000","last_clean":"2023-07-06T21:58:02.881819+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:58:02.881819+0000","last_undegraded":"2023-07-06T21:58:02.881819+0000","last_fullsized":"2023-07-06T21:58:02.881819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:19:41.376082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575042,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36960,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334880,"statfs":{"total":96636764160,"available":96598917120,"internally_reserved":0,"allocated":1859584,"data_stored":1254339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.54200000000000004,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":0.93600000000000005,"5min":0.93999999999999995,"15min":0.97699999999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.56599999999999995,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":0.876,"5min":0.98799999999999999,"15min":0.99399999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.34799999999999998},"max":{"1min":0.89200000000000002,"5min":0.98399999999999999,"15min":1.0649999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.90500000000000003,"5min":0.94099999999999995,"15min":0.97899999999999998},"last":0.82399999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.56299999999999994,"5min":0.377,"15min":0.377},"max":{"1min":0.86099999999999999,"5min":0.94799999999999995,"15min":0.94999999999999996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.46899999999999997,"15min":0.42599999999999999},"max":{"1min":0.91600000000000004,"5min":1.0209999999999999,"15min":1.0529999999999999},"last":0.91000000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71299999999999997,"15min":0.71899999999999997},"min":{"1min":0.60099999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84499999999999997,"5min":0.91800000000000004,"15min":1.0469999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.55000000000000004,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":0.96599999999999997,"15min":1.006},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.83299999999999996,"15min":0.999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.96299999999999997},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56799999999999995,"15min":0.58399999999999996},"min":{"1min":0.38700000000000001,"5min":0.376,"15min":0.34999999999999998},"max":{"1min":0.83199999999999996,"5min":0.89500000000000002,"15min":0.98499999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.99199999999999999},"last":0.624}]},{"osd":6,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.51200000000000001,"5min":0.44,"15min":0.40200000000000002},"max":{"1min":0.85799999999999998,"5min":0.93200000000000005,"15min":1.0309999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.496,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.79900000000000004,"5min":0.98399999999999999,"15min":1.0940000000000001},"last":0.47299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36384,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335456,"statfs":{"total":96636764160,"available":96599506944,"internally_reserved":0,"allocated":1269760,"data_stored":663576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70799999999999996,"15min":0.70499999999999996},"min":{"1min":0.502,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.94699999999999995,"5min":0.97899999999999998,"15min":1.0980000000000001},"last":0.629},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.38300000000000001},"max":{"1min":1.1830000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.71299999999999997},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.73899999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.41599999999999998},"max":{"1min":0.874,"5min":1.0129999999999999,"15min":1.3859999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.749,"15min":0.746},"min":{"1min":0.47399999999999998,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":1.135,"5min":1.159,"15min":1.204},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.498},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":1.4339999999999999},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82699999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0509999999999999,"15min":1.321},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.63100000000000001},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.36299999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.0089999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68700000000000006,"15min":0.71099999999999997},"min":{"1min":0.55200000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":1.3089999999999999,"15min":1.631},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jul 6 21:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.66900000000000004},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.41699999999999998},"max":{"1min":1.0029999999999999,"5min":1.2549999999999999,"15min":1.3600000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.66500000000000004},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.6930000000000001},"last":0.64500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575041,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":1277952,"data_stored":665487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.92300000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69999999999999996,"15min":0.72099999999999997},"min":{"1min":0.51600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.55400000000000005,"5min":0.40200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89700000000000002,"5min":1.0269999999999999,"15min":1.131},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":1.0329999999999999},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.56000000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0369999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.58099999999999996,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.57899999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98899999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.77600000000000002,"5min":0.78900000000000003,"15min":1},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.91800000000000004,"15min":1.02},"last":0.747}]},{"osd":6,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":1.052},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.45400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81899999999999995,"5min":0.83599999999999997,"15min":0.96699999999999997},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:57:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63400000000000001,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85799999999999998,"5min":0.92200000000000004,"15min":1.0529999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65300000000000002,"15min":0.68100000000000005},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95299999999999996,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.77300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575040,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1261568,"data_stored":663901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.46500000000000002,"15min":0.39400000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88,"5min":1.123,"15min":1.123},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.44},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.361},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2829999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":0.84799999999999998,"5min":0.95299999999999996,"15min":1.2170000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.751},"min":{"1min":0.498,"5min":0.498,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":0.94299999999999995,"15min":1.649},"last":0.86499999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.4219999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.49099999999999999},"max":{"1min":0.91400000000000003,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.308},"max":{"1min":0.85999999999999999,"5min":0.86399999999999999,"15min":1.246},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.96099999999999997,"5min":0.97299999999999998,"15min":1.8049999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.625,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.36299999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.478},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":0.94999999999999996,"5min":0.99199999999999999,"15min":1.7250000000000001},"last":1}]},{"osd":7,"last update":"Thu Jul 6 21:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.67900000000000005,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42399999999999999},"max":{"1min":1.0149999999999999,"5min":1.0720000000000001,"15min":1.534},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.47099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96399999999999997,"5min":1.01,"15min":1.585},"last":0.93600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575041,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1273856,"data_stored":665465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.85499999999999998,"15min":1.0489999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.67800000000000005,"5min":2.77,"15min":2.77},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.503,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.309,"15min":0.24299999999999999},"max":{"1min":0.77600000000000002,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":1.351,"15min":1.9590000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":0.73999999999999999,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.38},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":2.012},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":0.97299999999999998,"5min":1.1930000000000001,"15min":1.855},"last":0.751},{"interface":"front","average":{"1min":0.755,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0109999999999999,"5min":1.383,"15min":1.524},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80300000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.44800000000000001},"max":{"1min":1.0700000000000001,"5min":1.327,"15min":1.883},"last":0.86799999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.46600000000000003,"15min":0.40000000000000002},"max":{"1min":1.129,"5min":1.425,"15min":1.425},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.81399999999999995,"15min":0.80700000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47899999999999998},"max":{"1min":1.097,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.51000000000000001,"5min":0.5,"15min":0.497},"max":{"1min":1.004,"5min":3.097,"15min":3.097},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.81100000000000005},"min":{"1min":0.54500000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.1140000000000001,"15min":1.9830000000000001},"last":0.72699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575041,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36380,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335460,"statfs":{"total":96636764160,"available":96599511040,"internally_reserved":0,"allocated":1265664,"data_stored":664483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45900000000000002,"15min":0.45100000000000001},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67100000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.495},"min":{"1min":0.28699999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.71799999999999997,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.26000000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.878,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":0.76100000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.34499999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.76500000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.57599999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.71899999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.437}]},{"osd":4,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.56000000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.113,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80900000000000005,"15min":0.79700000000000004},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0469999999999999,"5min":1.591,"15min":1.591},"last":0.623}]},{"osd":5,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80200000000000005,"15min":0.79300000000000004},"min":{"1min":0.57499999999999996,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.1399999999999999,"5min":1.333,"15min":1.333},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81000000000000005,"15min":0.81699999999999995},"min":{"1min":0.60299999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1850000000000001,"5min":1.327,"15min":1.327},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.58499999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.497},"max":{"1min":1.153,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.629,"5min":0.496,"15min":0.496},"max":{"1min":1.262,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83099999999999996,"15min":0.83599999999999997},"min":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2170000000000001,"5min":1.296,"15min":1.369},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58532,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313308,"statfs":{"total":96636764160,"available":96576827392,"internally_reserved":0,"allocated":1273856,"data_stored":664095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.309,"5min":0.29499999999999998,"15min":0.27500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.38800000000000001,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.68899999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.33300000000000002},"max":{"1min":0.68700000000000006,"5min":0.87,"15min":0.87},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.32000000000000001},"max":{"1min":0.71699999999999997,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.61899999999999999,"5min":0.49199999999999999,"15min":0.38500000000000001},"max":{"1min":1.077,"5min":1.143,"15min":1.3140000000000001},"last":0.749},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":1.02,"5min":1.022,"15min":1.2290000000000001},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.497,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.095,"5min":1.1890000000000001,"15min":1.4359999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78400000000000003,"15min":0.79300000000000004},"min":{"1min":0.66100000000000003,"5min":0.50700000000000001,"15min":0.439},"max":{"1min":1.026,"5min":1.044,"15min":1.357},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.53400000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.042,"5min":1.278,"15min":1.278},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79900000000000004,"15min":0.80100000000000005},"min":{"1min":0.65000000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.456},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:57:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.80500000000000005,"15min":0.80800000000000005},"min":{"1min":0.61499999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.056,"5min":1.0820000000000001,"15min":1.417},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80300000000000005,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.5,"15min":0.5},"max":{"1min":1.0349999999999999,"5min":1.3280000000000001,"15min":1.397},"last":0.82799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575041,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36956,"kb_used_data":1812,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334884,"statfs":{"total":96636764160,"available":96598921216,"internally_reserved":0,"allocated":1855488,"data_stored":1253284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.54900000000000004,"5min":0.86399999999999999,"15min":1.1459999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.28599999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86799999999999999,"5min":0.98099999999999998,"15min":1.5189999999999999},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48999999999999999,"15min":0.503},"min":{"1min":0.313,"5min":0.313,"15min":0.30099999999999999},"max":{"1min":0.61099999999999999,"5min":0.81100000000000005,"15min":1.228},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67000000000000004,"5min":1.2050000000000001,"15min":1.454},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70999999999999996,"5min":1.151,"15min":1.7969999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.57499999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76400000000000001,"5min":0.83099999999999996,"15min":1.7190000000000001},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76600000000000001,"15min":0.78900000000000003},"min":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0109999999999999,"5min":1.1319999999999999,"15min":1.911},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3620000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.38400000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.3700000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.77200000000000002,"15min":0.79500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50700000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":1.163,"15min":1.758},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.8220000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47199999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":2.266},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jul 6 21:57:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81599999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":2.323},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.57499999999999996,"5min":0.50900000000000001,"15min":0.435},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.69999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:58:09.292 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T21:58:09.292 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-06T21:58:09.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefdd537640 1 Processor -- start 2023-07-06T21:58:09.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefdd537640 1 -- start start 2023-07-06T21:58:09.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefdd537640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fefd806ba00 0x7fefd80c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefdd537640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd80b0d90 con 0x7fefd8159ad0 2023-07-06T21:58:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefdd537640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd8070c50 con 0x7fefd806c380 2023-07-06T21:58:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefdd537640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd80c8620 con 0x7fefd806ba00 2023-07-06T21:58:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefd6ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fefd8159ad0 0x7fefd806b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57004/0 (socket says 172.21.15.55:57004) 2023-07-06T21:58:09.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefd6ffd640 1 -- 172.21.15.55:0/65026013 learned_addr learned my addr 172.21.15.55:0/65026013 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefd77fe640 1 --2- 172.21.15.55:0/65026013 >> v2:172.21.15.138:3300/0 conn(0x7fefd806ba00 0x7fefd80c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefd67fc640 1 -- 172.21.15.55:0/65026013 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413174022 0 0) 0x7fefd80b0d90 con 0x7fefd8159ad0 2023-07-06T21:58:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefd67fc640 1 -- 172.21.15.55:0/65026013 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefc4003530 con 0x7fefd8159ad0 2023-07-06T21:58:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefd67fc640 1 -- 172.21.15.55:0/65026013 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306919987 0 0) 0x7fefd8070c50 con 0x7fefd806c380 2023-07-06T21:58:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefd67fc640 1 -- 172.21.15.55:0/65026013 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd80b0d90 con 0x7fefd806c380 2023-07-06T21:58:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefd67fc640 1 -- 172.21.15.55:0/65026013 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 612369866 0 0) 0x7fefc4003530 con 0x7fefd8159ad0 2023-07-06T21:58:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefd77fe640 1 -- 172.21.15.55:0/65026013 >> v1:172.21.15.138:6789/0 conn(0x7fefd806c380 legacy=0x7fefd80c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.479+0000 7fefd77fe640 1 -- 172.21.15.55:0/65026013 >> v1:172.21.15.55:6789/0 conn(0x7fefd8159ad0 legacy=0x7fefd806b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.483+0000 7fefd77fe640 1 -- 172.21.15.55:0/65026013 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd8070f30 con 0x7fefd806ba00 2023-07-06T21:58:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.483+0000 7fefd77fe640 1 --2- 172.21.15.55:0/65026013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefd806ba00 0x7fefd80c9180 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009d90 tx=0x7fefd001c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67fccbe46b6b13d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.483+0000 7fefd67fc640 1 -- 172.21.15.55:0/65026013 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8001680 con 0x7fefd806ba00 2023-07-06T21:58:09.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.483+0000 7fefd67fc640 1 -- 172.21.15.55:0/65026013 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd00a55f0 con 0x7fefd806ba00 2023-07-06T21:58:09.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.483+0000 7fefd67fc640 1 -- 172.21.15.55:0/65026013 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00a5980 con 0x7fefd806ba00 2023-07-06T21:58:09.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.483+0000 7fefdd537640 1 -- 172.21.15.55:0/65026013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefd806ba00 msgr2=0x7fefd80c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.483+0000 7fefdd537640 1 --2- 172.21.15.55:0/65026013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefd806ba00 0x7fefd80c9180 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009d90 tx=0x7fefd001c7b0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.483+0000 7fefdd537640 1 -- 172.21.15.55:0/65026013 shutdown_connections 2023-07-06T21:58:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.483+0000 7fefdd537640 1 --2- 172.21.15.55:0/65026013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefd806ba00 0x7fefd80c9180 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.483+0000 7fefdd537640 1 -- 172.21.15.55:0/65026013 >> 172.21.15.55:0/65026013 conn(0x7fefd80cdf40 msgr2=0x7fefd80ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.483+0000 7fefdd537640 1 -- 172.21.15.55:0/65026013 shutdown_connections 2023-07-06T21:58:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefdd537640 1 -- 172.21.15.55:0/65026013 wait complete. 2023-07-06T21:58:09.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefdd537640 1 Processor -- start 2023-07-06T21:58:09.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefdd537640 1 -- start start 2023-07-06T21:58:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefdd537640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefd806ba00 0x7fefd8146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefdd537640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefd806c380 0x7fefd80aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefdd537640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fefd8159ad0 0x7fefd80aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefdd537640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd814c570 con 0x7fefd806ba00 2023-07-06T21:58:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefdd537640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd815c120 con 0x7fefd806c380 2023-07-06T21:58:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefdd537640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd814c7c0 con 0x7fefd8159ad0 2023-07-06T21:58:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefd6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefd806ba00 0x7fefd8146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefd6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefd806ba00 0x7fefd8146bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34886/0 (socket says 172.21.15.55:34886) 2023-07-06T21:58:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefd6ffd640 1 -- 172.21.15.55:0/1378902732 learned_addr learned my addr 172.21.15.55:0/1378902732 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:09.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefcffff640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefd806c380 0x7fefd80aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefd77fe640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fefd8159ad0 0x7fefd80aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefd6ffd640 1 -- 172.21.15.55:0/1378902732 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fefd8159ad0 msgr2=0x7fefd80aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefd6ffd640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fefd8159ad0 0x7fefd80aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefd6ffd640 1 -- 172.21.15.55:0/1378902732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefd806c380 msgr2=0x7fefd80aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefd6ffd640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefd806c380 0x7fefd80aea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefd6ffd640 1 -- 172.21.15.55:0/1378902732 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd0009a70 con 0x7fefd806ba00 2023-07-06T21:58:09.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefcffff640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefd806c380 0x7fefd80aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:09.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefd77fe640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fefd8159ad0 0x7fefd80aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:09.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefd6ffd640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefd806ba00 0x7fefd8146bc0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fefc800c730 tx=0x7fefc800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:09.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefcf7fe640 1 -- 172.21.15.55:0/1378902732 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8005ae0 con 0x7fefd806ba00 2023-07-06T21:58:09.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefcf7fe640 1 -- 172.21.15.55:0/1378902732 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc8005c60 con 0x7fefd806ba00 2023-07-06T21:58:09.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefcf7fe640 1 -- 172.21.15.55:0/1378902732 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8007070 con 0x7fefd806ba00 2023-07-06T21:58:09.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.487+0000 7fefdd537640 1 -- 172.21.15.55:0/1378902732 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd814caa0 con 0x7fefd806ba00 2023-07-06T21:58:09.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.491+0000 7fefdd537640 1 -- 172.21.15.55:0/1378902732 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd8147100 con 0x7fefd806ba00 2023-07-06T21:58:09.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.491+0000 7fefdd537640 1 -- 172.21.15.55:0/1378902732 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd8066d60 con 0x7fefd806ba00 2023-07-06T21:58:09.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.491+0000 7fefcf7fe640 1 -- 172.21.15.55:0/1378902732 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fefc80071d0 con 0x7fefd806ba00 2023-07-06T21:58:09.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.491+0000 7fefcf7fe640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fefb80663a0 0x7fefb8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.491+0000 7fefcf7fe640 1 -- 172.21.15.55:0/1378902732 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fefc8083890 con 0x7fefd806ba00 2023-07-06T21:58:09.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.491+0000 7fefcffff640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fefb80663a0 0x7fefb8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.491+0000 7fefcffff640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fefb80663a0 0x7fefb8068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fefd80c49a0 tx=0x7fefc0009040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:09.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.495+0000 7fefcf7fe640 1 -- 172.21.15.55:0/1378902732 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fefc8050a20 con 0x7fefd806ba00 2023-07-06T21:58:09.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.711+0000 7fefdd537640 1 -- 172.21.15.55:0/1378902732 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fefd8165210 con 0x7fefd806ba00 2023-07-06T21:58:09.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.715+0000 7fefcf7fe640 1 -- 172.21.15.55:0/1378902732 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7fefc8054040 con 0x7fefd806ba00 2023-07-06T21:58:09.715 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-07-06T21:58:09.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.719+0000 7fefdd537640 1 -- 172.21.15.55:0/1378902732 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fefb80663a0 msgr2=0x7fefb8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.719+0000 7fefdd537640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fefb80663a0 0x7fefb8068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fefd80c49a0 tx=0x7fefc0009040 comp rx=0 tx=0).stop 2023-07-06T21:58:09.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.719+0000 7fefdd537640 1 -- 172.21.15.55:0/1378902732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefd806ba00 msgr2=0x7fefd8146bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.719+0000 7fefdd537640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefd806ba00 0x7fefd8146bc0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fefc800c730 tx=0x7fefc800cbf0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.719+0000 7fefdd537640 1 -- 172.21.15.55:0/1378902732 shutdown_connections 2023-07-06T21:58:09.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.719+0000 7fefdd537640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fefb80663a0 0x7fefb8068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.719+0000 7fefdd537640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fefd8159ad0 0x7fefd80aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.719+0000 7fefdd537640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefd806c380 0x7fefd80aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.719+0000 7fefdd537640 1 --2- 172.21.15.55:0/1378902732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefd806ba00 0x7fefd8146bc0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.719+0000 7fefdd537640 1 -- 172.21.15.55:0/1378902732 >> 172.21.15.55:0/1378902732 conn(0x7fefd80cdf40 msgr2=0x7fefd81521f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:09.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.719+0000 7fefdd537640 1 -- 172.21.15.55:0/1378902732 shutdown_connections 2023-07-06T21:58:09.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.719+0000 7fefdd537640 1 -- 172.21.15.55:0/1378902732 wait complete. 2023-07-06T21:58:09.736 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:58:09.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.879+0000 7f9a07ffa640 1 Processor -- start 2023-07-06T21:58:09.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.879+0000 7f9a07ffa640 1 -- start start 2023-07-06T21:58:09.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.879+0000 7f9a07ffa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9a00160030 0x7f9a00070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.879+0000 7f9a07ffa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9a00071050 0x7f9a000cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.879+0000 7f9a07ffa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0006bd00 con 0x7f9a000cd870 2023-07-06T21:58:09.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.879+0000 7f9a07ffa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a00160400 con 0x7f9a00071050 2023-07-06T21:58:09.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.879+0000 7f9a07ffa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a00071540 con 0x7f9a00160030 2023-07-06T21:58:09.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.883+0000 7f9a06597640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9a000cd870 0x7f9a00163a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57020/0 (socket says 172.21.15.55:57020) 2023-07-06T21:58:09.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.883+0000 7f9a06597640 1 -- 172.21.15.55:0/4020572672 learned_addr learned my addr 172.21.15.55:0/4020572672 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:09.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.883+0000 7f9a05595640 1 --2- 172.21.15.55:0/4020572672 >> v2:172.21.15.55:3300/0 conn(0x7f9a00071050 0x7f9a000cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.883+0000 7f9a05d96640 1 --2- 172.21.15.55:0/4020572672 >> v2:172.21.15.138:3300/0 conn(0x7f9a00160030 0x7f9a00070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.883+0000 7f9a04d94640 1 -- 172.21.15.55:0/4020572672 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658089953 0 0) 0x7f9a0006bd00 con 0x7f9a000cd870 2023-07-06T21:58:09.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.883+0000 7f9a04d94640 1 -- 172.21.15.55:0/4020572672 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99ec003530 con 0x7f9a000cd870 2023-07-06T21:58:09.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.883+0000 7f9a05595640 1 -- 172.21.15.55:0/4020572672 >> v2:172.21.15.138:3300/0 conn(0x7f9a00160030 msgr2=0x7f9a00070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:09.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.883+0000 7f9a05595640 1 --2- 172.21.15.55:0/4020572672 >> v2:172.21.15.138:3300/0 conn(0x7f9a00160030 0x7f9a00070b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.883+0000 7f9a05595640 1 -- 172.21.15.55:0/4020572672 >> v1:172.21.15.55:6789/0 conn(0x7f9a000cd870 legacy=0x7f9a00163a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.883+0000 7f9a05595640 1 -- 172.21.15.55:0/4020572672 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a000cdcd0 con 0x7f9a00071050 2023-07-06T21:58:09.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.883+0000 7f9a05595640 1 --2- 172.21.15.55:0/4020572672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a00071050 0x7f9a000cd330 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f9a00071c00 tx=0x7f99f001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520aa588a9ca0db5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:09.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.883+0000 7f9a04d94640 1 -- 172.21.15.55:0/4020572672 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f00ab600 con 0x7f9a00071050 2023-07-06T21:58:09.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a04d94640 1 -- 172.21.15.55:0/4020572672 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f00a7050 con 0x7f9a00071050 2023-07-06T21:58:09.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a04d94640 1 -- 172.21.15.55:0/4020572672 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f00ab980 con 0x7f9a00071050 2023-07-06T21:58:09.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 -- 172.21.15.55:0/4020572672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a00071050 msgr2=0x7f9a000cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 --2- 172.21.15.55:0/4020572672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a00071050 0x7f9a000cd330 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f9a00071c00 tx=0x7f99f001c460 comp rx=0 tx=0).stop 2023-07-06T21:58:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 -- 172.21.15.55:0/4020572672 shutdown_connections 2023-07-06T21:58:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 --2- 172.21.15.55:0/4020572672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a00071050 0x7f9a000cd330 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 --2- 172.21.15.55:0/4020572672 >> v2:172.21.15.138:3300/0 conn(0x7f9a00160030 0x7f9a00070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 -- 172.21.15.55:0/4020572672 >> 172.21.15.55:0/4020572672 conn(0x7f9a000cded0 msgr2=0x7f9a000ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 -- 172.21.15.55:0/4020572672 shutdown_connections 2023-07-06T21:58:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 -- 172.21.15.55:0/4020572672 wait complete. 2023-07-06T21:58:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 Processor -- start 2023-07-06T21:58:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 -- start start 2023-07-06T21:58:09.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a00071050 0x7f9a00162aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a000cd870 0x7f9a00160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a00160030 0x7f9a0015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a00161490 con 0x7f9a00071050 2023-07-06T21:58:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a001616c0 con 0x7f9a000cd870 2023-07-06T21:58:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a07ffa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a001619a0 con 0x7f9a00160030 2023-07-06T21:58:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a05d96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a00071050 0x7f9a00162aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a05d96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a00071050 0x7f9a00162aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34916/0 (socket says 172.21.15.55:34916) 2023-07-06T21:58:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a05d96640 1 -- 172.21.15.55:0/3040544700 learned_addr learned my addr 172.21.15.55:0/3040544700 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a05595640 1 --2- 172.21.15.55:0/3040544700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a000cd870 0x7f9a00160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.887+0000 7f9a06597640 1 --2- 172.21.15.55:0/3040544700 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a00160030 0x7f9a0015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f9a05d96640 1 -- 172.21.15.55:0/3040544700 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a00160030 msgr2=0x7f9a0015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f9a05d96640 1 --2- 172.21.15.55:0/3040544700 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a00160030 0x7f9a0015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f9a05d96640 1 -- 172.21.15.55:0/3040544700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a000cd870 msgr2=0x7f9a00160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f9a05d96640 1 --2- 172.21.15.55:0/3040544700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a000cd870 0x7f9a00160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f9a05d96640 1 -- 172.21.15.55:0/3040544700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f0009420 con 0x7f9a00071050 2023-07-06T21:58:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f9a05d96640 1 --2- 172.21.15.55:0/3040544700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a00071050 0x7f9a00162aa0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00e930 tx=0x7f99fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f99f67fc640 1 -- 172.21.15.55:0/3040544700 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc009690 con 0x7f9a00071050 2023-07-06T21:58:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f99f67fc640 1 -- 172.21.15.55:0/3040544700 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc00ca00 con 0x7f9a00071050 2023-07-06T21:58:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f9a07ffa640 1 -- 172.21.15.55:0/3040544700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a000c9ba0 con 0x7f9a00071050 2023-07-06T21:58:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f99f67fc640 1 -- 172.21.15.55:0/3040544700 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00cd70 con 0x7f9a00071050 2023-07-06T21:58:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f9a07ffa640 1 -- 172.21.15.55:0/3040544700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a00161f60 con 0x7f9a00071050 2023-07-06T21:58:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f9a07ffa640 1 -- 172.21.15.55:0/3040544700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a00066d60 con 0x7f9a00071050 2023-07-06T21:58:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f99f67fc640 1 -- 172.21.15.55:0/3040544700 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f99fc013470 con 0x7f9a00071050 2023-07-06T21:58:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f99f67fc640 1 --2- 172.21.15.55:0/3040544700 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f99e40663a0 0x7f99e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.891+0000 7f99f67fc640 1 -- 172.21.15.55:0/3040544700 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f99fc084150 con 0x7f9a00071050 2023-07-06T21:58:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.895+0000 7f9a05595640 1 --2- 172.21.15.55:0/3040544700 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f99e40663a0 0x7f99e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.895+0000 7f9a05595640 1 --2- 172.21.15.55:0/3040544700 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f99e40663a0 0x7f99e4068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99f00ad000 tx=0x7f99f0008040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:09.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:09.899+0000 7f99f67fc640 1 -- 172.21.15.55:0/3040544700 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99fc0514e0 con 0x7f9a00071050 2023-07-06T21:58:10.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.083+0000 7f9a07ffa640 1 -- 172.21.15.55:0/3040544700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a00163570 con 0x7f9a00071050 2023-07-06T21:58:10.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.087+0000 7f99f67fc640 1 -- 172.21.15.55:0/3040544700 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f99fc054b00 con 0x7f9a00071050 2023-07-06T21:58:10.085 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:10.085 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2387174661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2387174661},{"type":"v1","addr":"172.21.15.138:6835","nonce":2387174661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7081,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3545643267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3545643267},{"type":"v1","addr":"172.21.15.138:6834","nonce":3545643267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7470,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1177943393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1177943393},{"type":"v1","addr":"172.21.15.55:6835","nonce":1177943393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:58:00.221256+0000","modified":"2023-07-06T21:58:03.247845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7479},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7479":{"gid":7479,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1437542997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1437542997},{"type":"v1","addr":"172.21.15.55:6837","nonce":1437542997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-06T21:58:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 40 2023-07-06T21:58:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.087+0000 7f9a07ffa640 1 -- 172.21.15.55:0/3040544700 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f99e40663a0 msgr2=0x7f99e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.087+0000 7f9a07ffa640 1 --2- 172.21.15.55:0/3040544700 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f99e40663a0 0x7f99e4068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99f00ad000 tx=0x7f99f0008040 comp rx=0 tx=0).stop 2023-07-06T21:58:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.087+0000 7f9a07ffa640 1 -- 172.21.15.55:0/3040544700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a00071050 msgr2=0x7f9a00162aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.087+0000 7f9a07ffa640 1 --2- 172.21.15.55:0/3040544700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a00071050 0x7f9a00162aa0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00e930 tx=0x7f99fc00edf0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.087+0000 7f9a07ffa640 1 -- 172.21.15.55:0/3040544700 shutdown_connections 2023-07-06T21:58:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.087+0000 7f9a07ffa640 1 --2- 172.21.15.55:0/3040544700 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f99e40663a0 0x7f99e4068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.087+0000 7f9a07ffa640 1 --2- 172.21.15.55:0/3040544700 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a00160030 0x7f9a0015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.087+0000 7f9a07ffa640 1 --2- 172.21.15.55:0/3040544700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a000cd870 0x7f9a00160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.087+0000 7f9a07ffa640 1 --2- 172.21.15.55:0/3040544700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a00071050 0x7f9a00162aa0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.087+0000 7f9a07ffa640 1 -- 172.21.15.55:0/3040544700 >> 172.21.15.55:0/3040544700 conn(0x7f9a000cded0 msgr2=0x7f9a0015b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.087+0000 7f9a07ffa640 1 -- 172.21.15.55:0/3040544700 shutdown_connections 2023-07-06T21:58:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.087+0000 7f9a07ffa640 1 -- 172.21.15.55:0/3040544700 wait complete. 2023-07-06T21:58:10.507 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T21:58:00.221256+0000', 'modified': '2023-07-06T21:58:03.247845+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7479}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7479': {'gid': 7479, 'name': 'c', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6837/1437542997', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6836', 'nonce': 1437542997}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 1437542997}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T21:58:10.508 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T21:58:10.508 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-06T21:58:10.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.659+0000 7f7fca9fa640 1 Processor -- start 2023-07-06T21:58:10.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.659+0000 7f7fca9fa640 1 -- start start 2023-07-06T21:58:10.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.659+0000 7f7fca9fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7fc40b3cd0 0x7f7fc40d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.659+0000 7f7fca9fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc40b2b80 con 0x7f7fc40b3870 2023-07-06T21:58:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.659+0000 7f7fca9fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc40cff30 con 0x7f7fc415b850 2023-07-06T21:58:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.659+0000 7f7fca9fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc40b22e0 con 0x7f7fc40b3cd0 2023-07-06T21:58:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.659+0000 7f7fc37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7fc40b3870 0x7f7fc40d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57036/0 (socket says 172.21.15.55:57036) 2023-07-06T21:58:10.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.659+0000 7f7fc37fe640 1 -- 172.21.15.55:0/3149904196 learned_addr learned my addr 172.21.15.55:0/3149904196 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:10.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.659+0000 7f7fc8f97640 1 --2- 172.21.15.55:0/3149904196 >> v2:172.21.15.55:3300/0 conn(0x7f7fc40b3cd0 0x7f7fc40d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.659+0000 7f7fc8f97640 1 -- 172.21.15.55:0/3149904196 >> v1:172.21.15.138:6789/0 conn(0x7f7fc415b850 legacy=0x7f7fc40cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.659+0000 7f7fc8f97640 1 -- 172.21.15.55:0/3149904196 >> v1:172.21.15.55:6789/0 conn(0x7f7fc40b3870 legacy=0x7f7fc40d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.659+0000 7f7fc8f97640 1 -- 172.21.15.55:0/3149904196 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc40b25c0 con 0x7f7fc40b3cd0 2023-07-06T21:58:10.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.663+0000 7f7fc8f97640 1 --2- 172.21.15.55:0/3149904196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fc40b3cd0 0x7f7fc40d0ad0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009d90 tx=0x7f7fbc01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a864ea9ed13da73c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:10.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.667+0000 7f7fc2ffd640 1 -- 172.21.15.55:0/3149904196 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0a5880 con 0x7f7fc40b3cd0 2023-07-06T21:58:10.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.667+0000 7f7fc2ffd640 1 -- 172.21.15.55:0/3149904196 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc0a59e0 con 0x7f7fc40b3cd0 2023-07-06T21:58:10.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.667+0000 7f7fc2ffd640 1 -- 172.21.15.55:0/3149904196 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0a5d70 con 0x7f7fc40b3cd0 2023-07-06T21:58:10.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.667+0000 7f7fca9fa640 1 -- 172.21.15.55:0/3149904196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fc40b3cd0 msgr2=0x7f7fc40d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.667+0000 7f7fca9fa640 1 --2- 172.21.15.55:0/3149904196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fc40b3cd0 0x7f7fc40d0ad0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009d90 tx=0x7f7fbc01c800 comp rx=0 tx=0).stop 2023-07-06T21:58:10.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.667+0000 7f7fca9fa640 1 -- 172.21.15.55:0/3149904196 shutdown_connections 2023-07-06T21:58:10.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.667+0000 7f7fca9fa640 1 --2- 172.21.15.55:0/3149904196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fc40b3cd0 0x7f7fc40d0ad0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.667+0000 7f7fca9fa640 1 -- 172.21.15.55:0/3149904196 >> 172.21.15.55:0/3149904196 conn(0x7f7fc40cec20 msgr2=0x7f7fc40cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:10.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.667+0000 7f7fca9fa640 1 -- 172.21.15.55:0/3149904196 shutdown_connections 2023-07-06T21:58:10.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.667+0000 7f7fca9fa640 1 -- 172.21.15.55:0/3149904196 wait complete. 2023-07-06T21:58:10.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.667+0000 7f7fca9fa640 1 Processor -- start 2023-07-06T21:58:10.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fca9fa640 1 -- start start 2023-07-06T21:58:10.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fca9fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fc40b3870 0x7f7fc40cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fca9fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fc40b3cd0 0x7f7fc40c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fca9fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fc415b850 0x7f7fc4151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fca9fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40ca5b0 con 0x7f7fc40b3cd0 2023-07-06T21:58:10.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fca9fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc41532a0 con 0x7f7fc40b3870 2023-07-06T21:58:10.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fca9fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc4153580 con 0x7f7fc415b850 2023-07-06T21:58:10.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fc37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fc40b3cd0 0x7f7fc40c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fc37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fc40b3cd0 0x7f7fc40c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34936/0 (socket says 172.21.15.55:34936) 2023-07-06T21:58:10.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fc37fe640 1 -- 172.21.15.55:0/743059139 learned_addr learned my addr 172.21.15.55:0/743059139 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:10.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/743059139 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fc40b3870 0x7f7fc40cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fc8f97640 1 --2- 172.21.15.55:0/743059139 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fc415b850 0x7f7fc4151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fc37fe640 1 -- 172.21.15.55:0/743059139 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fc415b850 msgr2=0x7f7fc4151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fc37fe640 1 --2- 172.21.15.55:0/743059139 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fc415b850 0x7f7fc4151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fc37fe640 1 -- 172.21.15.55:0/743059139 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fc40b3870 msgr2=0x7f7fc40cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fc37fe640 1 --2- 172.21.15.55:0/743059139 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fc40b3870 0x7f7fc40cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fc37fe640 1 -- 172.21.15.55:0/743059139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc009a70 con 0x7f7fc40b3cd0 2023-07-06T21:58:10.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fc37fe640 1 --2- 172.21.15.55:0/743059139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fc40b3cd0 0x7f7fc40c9c30 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800c400 tx=0x7f7fb800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:10.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fc0ff9640 1 -- 172.21.15.55:0/743059139 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8005cf0 con 0x7f7fc40b3cd0 2023-07-06T21:58:10.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fc0ff9640 1 -- 172.21.15.55:0/743059139 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb8005e50 con 0x7f7fc40b3cd0 2023-07-06T21:58:10.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fc0ff9640 1 -- 172.21.15.55:0/743059139 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80072d0 con 0x7f7fc40b3cd0 2023-07-06T21:58:10.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fca9fa640 1 -- 172.21.15.55:0/743059139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc4153860 con 0x7f7fc40b3cd0 2023-07-06T21:58:10.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.671+0000 7f7fca9fa640 1 -- 172.21.15.55:0/743059139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc40cb470 con 0x7f7fc40b3cd0 2023-07-06T21:58:10.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc0ff9640 1 -- 172.21.15.55:0/743059139 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7fb8007430 con 0x7f7fc40b3cd0 2023-07-06T21:58:10.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc0ff9640 1 --2- 172.21.15.55:0/743059139 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f7fb00663a0 0x7f7fb0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc0ff9640 1 -- 172.21.15.55:0/743059139 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7fb8083480 con 0x7f7fc40b3cd0 2023-07-06T21:58:10.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/743059139 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f7fb00663a0 0x7f7fb0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fcdd51000 1 Processor -- start 2023-07-06T21:58:10.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fcdd51000 1 -- start start 2023-07-06T21:58:10.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/743059139 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f7fb00663a0 0x7f7fb0068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4007fd0 tx=0x7f7fb4009040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:10.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fcdd51000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a3bd740 0x55b91a3bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fcdd51000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3be050 0x55b91a373840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fcdd51000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a373d80 0x55b91a374150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fcdd51000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91a23bac0 con 0x55b91a3bd740 2023-07-06T21:58:10.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fcdd51000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91a175840 con 0x55b91a3be050 2023-07-06T21:58:10.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fcdd51000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b91a1c92e0 con 0x55b91a373d80 2023-07-06T21:58:10.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a3bd740 0x55b91a3bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a3bd740 0x55b91a3bdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34952/0 (socket says 172.21.15.55:34952) 2023-07-06T21:58:10.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc3fff640 1 -- 172.21.15.55:0/4268676358 learned_addr learned my addr 172.21.15.55:0/4268676358 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:10.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc37fe640 1 --2- 172.21.15.55:0/4268676358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3be050 0x55b91a373840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc8f97640 1 --2- 172.21.15.55:0/4268676358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a373d80 0x55b91a374150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc3fff640 1 -- 172.21.15.55:0/4268676358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a373d80 msgr2=0x55b91a374150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:10.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/4268676358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a373d80 0x55b91a374150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc3fff640 1 -- 172.21.15.55:0/4268676358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3be050 msgr2=0x55b91a373840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:10.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/4268676358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3be050 0x55b91a373840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.675+0000 7f7fc3fff640 1 -- 172.21.15.55:0/4268676358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b919ebe890 con 0x55b91a3bd740 2023-07-06T21:58:10.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/4268676358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a3bd740 0x55b91a3bdb10 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400f950 tx=0x7f7fb4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00d5bf8b9f087b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:10.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fa9ffb640 1 -- 172.21.15.55:0/4268676358 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb400fed0 con 0x55b91a3bd740 2023-07-06T21:58:10.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fa9ffb640 1 -- 172.21.15.55:0/4268676358 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb4014be0 con 0x55b91a3bd740 2023-07-06T21:58:10.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fa9ffb640 1 -- 172.21.15.55:0/4268676358 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4020410 con 0x55b91a3bd740 2023-07-06T21:58:10.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 -- 172.21.15.55:0/4268676358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a3bd740 msgr2=0x55b91a3bdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/4268676358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a3bd740 0x55b91a3bdb10 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400f950 tx=0x7f7fb4012000 comp rx=0 tx=0).stop 2023-07-06T21:58:10.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 -- 172.21.15.55:0/4268676358 shutdown_connections 2023-07-06T21:58:10.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/4268676358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a373d80 0x55b91a374150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/4268676358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3be050 0x55b91a373840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/4268676358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a3bd740 0x55b91a3bdb10 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 -- 172.21.15.55:0/4268676358 >> 172.21.15.55:0/4268676358 conn(0x55b91a36b800 msgr2=0x55b91a37a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:10.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 -- 172.21.15.55:0/4268676358 shutdown_connections 2023-07-06T21:58:10.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 -- 172.21.15.55:0/4268676358 wait complete. 2023-07-06T21:58:10.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 -- start start 2023-07-06T21:58:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 Processor -- start 2023-07-06T21:58:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a373d80 0x55b91a379940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a3bd740 0x55b91a37f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3be050 0x55b91a37f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91a1c2380 con 0x55b91a373d80 2023-07-06T21:58:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91a17eae0 con 0x55b91a3be050 2023-07-06T21:58:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b91a17e780 con 0x55b91a3bd740 2023-07-06T21:58:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fcdd51000 10 client.0 _ll_register_callbacks cb 0x55b91a35fe30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T21:58:10.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fc3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a373d80 0x55b91a379940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fc3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a373d80 0x55b91a379940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34958/0 (socket says 172.21.15.55:34958) 2023-07-06T21:58:10.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fc3fff640 1 -- 172.21.15.55:0/1119381131 learned_addr learned my addr 172.21.15.55:0/1119381131 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:10.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fc8f97640 1 --2- 172.21.15.55:0/1119381131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3be050 0x55b91a37f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.679+0000 7f7fc37fe640 1 --2- 172.21.15.55:0/1119381131 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a3bd740 0x55b91a37f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fc3fff640 1 -- 172.21.15.55:0/1119381131 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a3bd740 msgr2=0x55b91a37f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:10.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/1119381131 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a3bd740 0x55b91a37f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fc3fff640 1 -- 172.21.15.55:0/1119381131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3be050 msgr2=0x55b91a37f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/1119381131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3be050 0x55b91a37f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fc3fff640 1 -- 172.21.15.55:0/1119381131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc40cff30 con 0x55b91a373d80 2023-07-06T21:58:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/1119381131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a373d80 0x55b91a379940 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4000f70 tx=0x7f7fb4001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49f17dc1f3581c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fa2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T21:58:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fa2ffd640 1 -- 172.21.15.55:0/1119381131 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4020c90 con 0x55b91a373d80 2023-07-06T21:58:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fa2ffd640 1 -- 172.21.15.55:0/1119381131 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7fb401c040 con 0x55b91a373d80 2023-07-06T21:58:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 -- 172.21.15.55:0/1119381131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b91a189a20 con 0x55b91a373d80 2023-07-06T21:58:10.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fa2ffd640 1 -- 172.21.15.55:0/1119381131 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fb4020df0 con 0x55b91a373d80 2023-07-06T21:58:10.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 10 client.7659 fetch_fsmap learned FSMap version 40 2023-07-06T21:58:10.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 -- 172.21.15.55:0/1119381131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x55b91a186d10 con 0x55b91a373d80 2023-07-06T21:58:10.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fa2ffd640 1 -- 172.21.15.55:0/1119381131 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b91a189a20 con 0x55b91a373d80 2023-07-06T21:58:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fa2ffd640 1 -- 172.21.15.55:0/1119381131 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 40) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7fb4012070 con 0x55b91a373d80 2023-07-06T21:58:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 10 client.7659 fetch_fsmap finished waiting for FSMap version 40 2023-07-06T21:58:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 10 client.7659 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T21:58:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 20 client.7659 populate_metadata read hostname 'smithi055' 2023-07-06T21:58:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/1119381131 >> [v2:172.21.15.55:6836/1437542997,v1:172.21.15.55:6837/1437542997] conn(0x55b91a3ccc80 0x55b91a3cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 4 client.7659 mds_command: new command op to 7479 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T21:58:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 -- 172.21.15.55:0/1119381131 --> [v2:172.21.15.55:6836/1437542997,v1:172.21.15.55:6837/1437542997] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b91a1f1710 con 0x55b91a3ccc80 2023-07-06T21:58:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fc37fe640 1 --2- 172.21.15.55:0/1119381131 >> [v2:172.21.15.55:6836/1437542997,v1:172.21.15.55:6837/1437542997] conn(0x55b91a3ccc80 0x55b91a3cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fc37fe640 1 --2- 172.21.15.55:0/1119381131 >> [v2:172.21.15.55:6836/1437542997,v1:172.21.15.55:6837/1437542997] conn(0x55b91a3ccc80 0x55b91a3cf060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aa3ec5a1555c396 server_cookie=fcee113fefa89214 in_seq=0 out_seq=0 2023-07-06T21:58:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fa2ffd640 10 client.7659 ms_handle_connect on v2:172.21.15.55:6836/1437542997 2023-07-06T21:58:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fa2ffd640 1 -- 172.21.15.55:0/1119381131 <== mds.0 v2:172.21.15.55:6836/1437542997 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b91a1f1710 con 0x55b91a3ccc80 2023-07-06T21:58:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fa2ffd640 10 client.7659 handle_command_reply: tid=0 2023-07-06T21:58:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 client.7659 shutdown 2023-07-06T21:58:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 -- 172.21.15.55:0/1119381131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a373d80 msgr2=0x55b91a379940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/1119381131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a373d80 0x55b91a379940 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4000f70 tx=0x7f7fb4001130 comp rx=0 tx=0).stop 2023-07-06T21:58:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 -- 172.21.15.55:0/1119381131 shutdown_connections 2023-07-06T21:58:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/1119381131 >> [v2:172.21.15.55:6836/1437542997,v1:172.21.15.55:6837/1437542997] conn(0x55b91a3ccc80 0x55b91a3cf060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/1119381131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3be050 0x55b91a37f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/1119381131 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a3bd740 0x55b91a37f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/1119381131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a373d80 0x55b91a379940 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fa2ffd640 0 client.7659 ms_handle_reset on v2:172.21.15.55:6836/1437542997 2023-07-06T21:58:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 -- 172.21.15.55:0/1119381131 >> 172.21.15.55:0/1119381131 conn(0x55b91a36b800 msgr2=0x55b91a372830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:10.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 -- 172.21.15.55:0/1119381131 shutdown_connections 2023-07-06T21:58:10.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 1 -- 172.21.15.55:0/1119381131 wait complete. 2023-07-06T21:58:10.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.683+0000 7f7fcdd51000 20 client.7659 trim_cache size 0 max 16384 2023-07-06T21:58:10.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.699+0000 7f7fcdd51000 1 Processor -- start 2023-07-06T21:58:10.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.699+0000 7f7fcdd51000 1 -- start start 2023-07-06T21:58:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.699+0000 7f7fcdd51000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a373d80 0x55b91a3d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.699+0000 7f7fcdd51000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3bd740 0x55b91a3cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.699+0000 7f7fcdd51000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a3be050 0x55b91a3cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.699+0000 7f7fcdd51000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b919e7f940 con 0x55b91a373d80 2023-07-06T21:58:10.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.699+0000 7f7fcdd51000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91a1c8800 con 0x55b91a3bd740 2023-07-06T21:58:10.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.699+0000 7f7fcdd51000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b91a1bdcf0 con 0x55b91a3be050 2023-07-06T21:58:10.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.699+0000 7f7fc3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a373d80 0x55b91a3d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.699+0000 7f7fc3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a373d80 0x55b91a3d0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34964/0 (socket says 172.21.15.55:34964) 2023-07-06T21:58:10.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.699+0000 7f7fc3fff640 1 -- 172.21.15.55:0/3669287248 learned_addr learned my addr 172.21.15.55:0/3669287248 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:10.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.699+0000 7f7fc8f97640 1 --2- 172.21.15.55:0/3669287248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a3be050 0x55b91a3cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc37fe640 1 --2- 172.21.15.55:0/3669287248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3bd740 0x55b91a3cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc3fff640 1 -- 172.21.15.55:0/3669287248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a3be050 msgr2=0x55b91a3cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/3669287248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a3be050 0x55b91a3cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc3fff640 1 -- 172.21.15.55:0/3669287248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3bd740 msgr2=0x55b91a3cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/3669287248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3bd740 0x55b91a3cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc3fff640 1 -- 172.21.15.55:0/3669287248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b91a376450 con 0x55b91a373d80 2023-07-06T21:58:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc8f97640 1 --2- 172.21.15.55:0/3669287248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a3be050 0x55b91a3cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/3669287248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a373d80 0x55b91a3d0fd0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4001170 tx=0x7f7fb402a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db6f4d9b62fbbbe server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7faa7fc640 1 -- 172.21.15.55:0/3669287248 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4033690 con 0x55b91a373d80 2023-07-06T21:58:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7faa7fc640 1 -- 172.21.15.55:0/3669287248 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb40337f0 con 0x55b91a373d80 2023-07-06T21:58:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7faa7fc640 1 -- 172.21.15.55:0/3669287248 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4020c90 con 0x55b91a373d80 2023-07-06T21:58:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 -- 172.21.15.55:0/3669287248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a373d80 msgr2=0x55b91a3d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/3669287248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a373d80 0x55b91a3d0fd0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4001170 tx=0x7f7fb402a000 comp rx=0 tx=0).stop 2023-07-06T21:58:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 -- 172.21.15.55:0/3669287248 shutdown_connections 2023-07-06T21:58:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/3669287248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a3be050 0x55b91a3cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/3669287248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3bd740 0x55b91a3cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/3669287248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a373d80 0x55b91a3d0fd0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 -- 172.21.15.55:0/3669287248 >> 172.21.15.55:0/3669287248 conn(0x55b91a36b800 msgr2=0x55b91a372eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 -- 172.21.15.55:0/3669287248 shutdown_connections 2023-07-06T21:58:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 -- 172.21.15.55:0/3669287248 wait complete. 2023-07-06T21:58:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 -- start start 2023-07-06T21:58:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 Processor -- start 2023-07-06T21:58:10.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a373d80 0x55b91a3d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3bd740 0x55b91a3d84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a3be050 0x55b91a3d8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91a37aa30 con 0x55b91a3be050 2023-07-06T21:58:10.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91a1c1210 con 0x55b91a3bd740 2023-07-06T21:58:10.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b91a378340 con 0x55b91a373d80 2023-07-06T21:58:10.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fcdd51000 10 client.0 _ll_register_callbacks cb 0x55b91a1867f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T21:58:10.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc8f97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a3be050 0x55b91a3d8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc8f97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a3be050 0x55b91a3d8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34970/0 (socket says 172.21.15.55:34970) 2023-07-06T21:58:10.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc8f97640 1 -- 172.21.15.55:0/2590561524 learned_addr learned my addr 172.21.15.55:0/2590561524 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:10.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc37fe640 1 --2- 172.21.15.55:0/2590561524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3bd740 0x55b91a3d84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/2590561524 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a373d80 0x55b91a3d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc8f97640 1 -- 172.21.15.55:0/2590561524 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a373d80 msgr2=0x55b91a3d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:10.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc8f97640 1 --2- 172.21.15.55:0/2590561524 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a373d80 0x55b91a3d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc8f97640 1 -- 172.21.15.55:0/2590561524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3bd740 msgr2=0x55b91a3d84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:10.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc8f97640 1 --2- 172.21.15.55:0/2590561524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3bd740 0x55b91a3d84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.703+0000 7f7fc8f97640 1 -- 172.21.15.55:0/2590561524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b91a186d10 con 0x55b91a3be050 2023-07-06T21:58:10.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fc37fe640 1 --2- 172.21.15.55:0/2590561524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3bd740 0x55b91a3d84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:10.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fc8f97640 1 --2- 172.21.15.55:0/2590561524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a3be050 0x55b91a3d8a00 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc019410 tx=0x7f7fbc0195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ad780bb496a38f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:10.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fa2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T21:58:10.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fa2ffd640 1 -- 172.21.15.55:0/2590561524 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0b7700 con 0x55b91a3be050 2023-07-06T21:58:10.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 -- 172.21.15.55:0/2590561524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b91a3776e0 con 0x55b91a3be050 2023-07-06T21:58:10.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fa2ffd640 1 -- 172.21.15.55:0/2590561524 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7fbc0bc040 con 0x55b91a3be050 2023-07-06T21:58:10.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fa2ffd640 1 -- 172.21.15.55:0/2590561524 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fbc0b7860 con 0x55b91a3be050 2023-07-06T21:58:10.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 10 client.7665 fetch_fsmap learned FSMap version 40 2023-07-06T21:58:10.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 -- 172.21.15.55:0/2590561524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x55b91a16cfa0 con 0x55b91a3be050 2023-07-06T21:58:10.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fa2ffd640 1 -- 172.21.15.55:0/2590561524 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b91a3776e0 con 0x55b91a3be050 2023-07-06T21:58:10.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fa2ffd640 1 -- 172.21.15.55:0/2590561524 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 40) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7fbc0b79c0 con 0x55b91a3be050 2023-07-06T21:58:10.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 10 client.7665 fetch_fsmap finished waiting for FSMap version 40 2023-07-06T21:58:10.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 10 client.7665 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T21:58:10.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 20 client.7665 populate_metadata read hostname 'smithi055' 2023-07-06T21:58:10.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/2590561524 >> [v2:172.21.15.55:6836/1437542997,v1:172.21.15.55:6837/1437542997] conn(0x55b91a41bd10 0x55b91a41c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 4 client.7665 mds_command: new command op to 7479 tid=0[{"prefix": "status"}] 2023-07-06T21:58:10.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 -- 172.21.15.55:0/2590561524 --> [v2:172.21.15.55:6836/1437542997,v1:172.21.15.55:6837/1437542997] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b91a1c0cd0 con 0x55b91a41bd10 2023-07-06T21:58:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/2590561524 >> [v2:172.21.15.55:6836/1437542997,v1:172.21.15.55:6837/1437542997] conn(0x55b91a41bd10 0x55b91a41c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/2590561524 >> [v2:172.21.15.55:6836/1437542997,v1:172.21.15.55:6837/1437542997] conn(0x55b91a41bd10 0x55b91a41c0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a51fae2c714bd4ee server_cookie=6a4baab5723bee3e in_seq=0 out_seq=0 2023-07-06T21:58:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fa2ffd640 10 client.7665 ms_handle_connect on v2:172.21.15.55:6836/1437542997 2023-07-06T21:58:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fa2ffd640 1 -- 172.21.15.55:0/2590561524 <== mds.0 v2:172.21.15.55:6836/1437542997 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55b91a1c0cd0 con 0x55b91a41bd10 2023-07-06T21:58:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fa2ffd640 10 client.7665 handle_command_reply: tid=0 2023-07-06T21:58:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 client.7665 shutdown 2023-07-06T21:58:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 -- 172.21.15.55:0/2590561524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a3be050 msgr2=0x55b91a3d8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/2590561524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a3be050 0x55b91a3d8a00 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc019410 tx=0x7f7fbc0195a0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 -- 172.21.15.55:0/2590561524 shutdown_connections 2023-07-06T21:58:10.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/2590561524 >> [v2:172.21.15.55:6836/1437542997,v1:172.21.15.55:6837/1437542997] conn(0x55b91a41bd10 0x55b91a41c0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/2590561524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b91a3be050 0x55b91a3d8a00 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/2590561524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b91a3bd740 0x55b91a3d84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fa2ffd640 0 client.7665 ms_handle_reset on v2:172.21.15.55:6836/1437542997 2023-07-06T21:58:10.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 --2- 172.21.15.55:0/2590561524 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b91a373d80 0x55b91a3d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 -- 172.21.15.55:0/2590561524 >> 172.21.15.55:0/2590561524 conn(0x55b91a36b800 msgr2=0x55b91a3bc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:10.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 -- 172.21.15.55:0/2590561524 shutdown_connections 2023-07-06T21:58:10.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 1 -- 172.21.15.55:0/2590561524 wait complete. 2023-07-06T21:58:10.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fcdd51000 20 client.7665 trim_cache size 0 max 16384 2023-07-06T21:58:10.715 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T21:58:10.715 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c64f3ef1-e769-47b3-ae15-a714e4e7c4f7", 2023-07-06T21:58:10.715 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-07-06T21:58:10.716 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7479, 2023-07-06T21:58:10.716 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-07-06T21:58:10.716 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-07-06T21:58:10.716 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-07-06T21:58:10.716 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.486674595, 2023-07-06T21:58:10.716 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 40, 2023-07-06T21:58:10.716 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 103, 2023-07-06T21:58:10.717 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 103, 2023-07-06T21:58:10.717 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 15.811191815000001 2023-07-06T21:58:10.717 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T21:58:10.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fca9fa640 1 -- 172.21.15.55:0/743059139 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f7fb00663a0 msgr2=0x7f7fb0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fca9fa640 1 --2- 172.21.15.55:0/743059139 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f7fb00663a0 0x7f7fb0068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4007fd0 tx=0x7f7fb4009040 comp rx=0 tx=0).stop 2023-07-06T21:58:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fca9fa640 1 -- 172.21.15.55:0/743059139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fc40b3cd0 msgr2=0x7f7fc40c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fca9fa640 1 --2- 172.21.15.55:0/743059139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fc40b3cd0 0x7f7fc40c9c30 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800c400 tx=0x7f7fb800c8c0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fca9fa640 1 -- 172.21.15.55:0/743059139 shutdown_connections 2023-07-06T21:58:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fca9fa640 1 --2- 172.21.15.55:0/743059139 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f7fb00663a0 0x7f7fb0068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fca9fa640 1 --2- 172.21.15.55:0/743059139 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fc415b850 0x7f7fc4151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fca9fa640 1 --2- 172.21.15.55:0/743059139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fc40b3cd0 0x7f7fc40c9c30 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fca9fa640 1 --2- 172.21.15.55:0/743059139 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fc40b3870 0x7f7fc40cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.707+0000 7f7fca9fa640 1 -- 172.21.15.55:0/743059139 >> 172.21.15.55:0/743059139 conn(0x7f7fc40cec20 msgr2=0x7f7fc406a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.711+0000 7f7fca9fa640 1 -- 172.21.15.55:0/743059139 shutdown_connections 2023-07-06T21:58:10.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.711+0000 7f7fca9fa640 1 -- 172.21.15.55:0/743059139 wait complete. 2023-07-06T21:58:10.726 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T21:58:10.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb258f37640 1 Processor -- start 2023-07-06T21:58:10.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb258f37640 1 -- start start 2023-07-06T21:58:10.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb258f37640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb2540ce610 0x7fb2540b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb258f37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2540cd1c0 con 0x7fb2540b7cd0 2023-07-06T21:58:10.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb258f37640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2540b2270 con 0x7fb2540b1e10 2023-07-06T21:58:10.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb258f37640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2540d2310 con 0x7fb2540ce610 2023-07-06T21:58:10.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb25259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb2540b7cd0 0x7fb2540ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57048/0 (socket says 172.21.15.55:57048) 2023-07-06T21:58:10.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb25259c640 1 -- 172.21.15.55:0/532398227 learned_addr learned my addr 172.21.15.55:0/532398227 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:10.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb24bfff640 1 --2- 172.21.15.55:0/532398227 >> v2:172.21.15.138:3300/0 conn(0x7fb2540ce610 0x7fb2540b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb251d9b640 1 -- 172.21.15.55:0/532398227 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250694032 0 0) 0x7fb2540cd1c0 con 0x7fb2540b7cd0 2023-07-06T21:58:10.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb251d9b640 1 -- 172.21.15.55:0/532398227 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb240003530 con 0x7fb2540b7cd0 2023-07-06T21:58:10.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb251d9b640 1 -- 172.21.15.55:0/532398227 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638184273 0 0) 0x7fb2540b2270 con 0x7fb2540b1e10 2023-07-06T21:58:10.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb251d9b640 1 -- 172.21.15.55:0/532398227 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2540cd1c0 con 0x7fb2540b1e10 2023-07-06T21:58:10.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb24bfff640 1 -- 172.21.15.55:0/532398227 >> v1:172.21.15.138:6789/0 conn(0x7fb2540b1e10 legacy=0x7fb25415f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb24bfff640 1 -- 172.21.15.55:0/532398227 >> v1:172.21.15.55:6789/0 conn(0x7fb2540b7cd0 legacy=0x7fb2540ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb251d9b640 1 -- 172.21.15.55:0/532398227 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1290130258 0 0) 0x7fb240003530 con 0x7fb2540b7cd0 2023-07-06T21:58:10.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.871+0000 7fb24bfff640 1 -- 172.21.15.55:0/532398227 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2540cecf0 con 0x7fb2540ce610 2023-07-06T21:58:10.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.875+0000 7fb24bfff640 1 --2- 172.21.15.55:0/532398227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2540ce610 0x7fb2540b18d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0097c0 tx=0x7fb23c01c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a617b11da27e0296 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:10.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.875+0000 7fb251d9b640 1 -- 172.21.15.55:0/532398227 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244001680 con 0x7fb2540ce610 2023-07-06T21:58:10.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.875+0000 7fb251d9b640 1 -- 172.21.15.55:0/532398227 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c0a7050 con 0x7fb2540ce610 2023-07-06T21:58:10.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.875+0000 7fb251d9b640 1 -- 172.21.15.55:0/532398227 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0ab620 con 0x7fb2540ce610 2023-07-06T21:58:10.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.875+0000 7fb258f37640 1 -- 172.21.15.55:0/532398227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2540ce610 msgr2=0x7fb2540b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.875+0000 7fb258f37640 1 --2- 172.21.15.55:0/532398227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2540ce610 0x7fb2540b18d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0097c0 tx=0x7fb23c01c310 comp rx=0 tx=0).stop 2023-07-06T21:58:10.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.875+0000 7fb258f37640 1 -- 172.21.15.55:0/532398227 shutdown_connections 2023-07-06T21:58:10.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.875+0000 7fb258f37640 1 --2- 172.21.15.55:0/532398227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2540ce610 0x7fb2540b18d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.875+0000 7fb258f37640 1 -- 172.21.15.55:0/532398227 >> 172.21.15.55:0/532398227 conn(0x7fb2540ceee0 msgr2=0x7fb2540cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:10.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.875+0000 7fb258f37640 1 -- 172.21.15.55:0/532398227 shutdown_connections 2023-07-06T21:58:10.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.875+0000 7fb258f37640 1 -- 172.21.15.55:0/532398227 wait complete. 2023-07-06T21:58:10.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb258f37640 1 Processor -- start 2023-07-06T21:58:10.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb258f37640 1 -- start start 2023-07-06T21:58:10.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb258f37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2540b1e10 0x7fb25415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb258f37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2540b7cd0 0x7fb25415e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb258f37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2540ce610 0x7fb2540c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb258f37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25414e180 con 0x7fb2540b1e10 2023-07-06T21:58:10.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb258f37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2540c6fb0 con 0x7fb2540ce610 2023-07-06T21:58:10.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb258f37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25415ea00 con 0x7fb2540b7cd0 2023-07-06T21:58:10.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb25259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2540b1e10 0x7fb25415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb25259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2540b1e10 0x7fb25415d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34986/0 (socket says 172.21.15.55:34986) 2023-07-06T21:58:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb25259c640 1 -- 172.21.15.55:0/102975154 learned_addr learned my addr 172.21.15.55:0/102975154 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb24bfff640 1 --2- 172.21.15.55:0/102975154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2540b7cd0 0x7fb25415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb252d9d640 1 --2- 172.21.15.55:0/102975154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2540ce610 0x7fb2540c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb25259c640 1 -- 172.21.15.55:0/102975154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2540b7cd0 msgr2=0x7fb25415e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb25259c640 1 --2- 172.21.15.55:0/102975154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2540b7cd0 0x7fb25415e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb25259c640 1 -- 172.21.15.55:0/102975154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2540ce610 msgr2=0x7fb2540c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb25259c640 1 --2- 172.21.15.55:0/102975154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2540ce610 0x7fb2540c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb25259c640 1 -- 172.21.15.55:0/102975154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c009420 con 0x7fb2540b1e10 2023-07-06T21:58:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb25259c640 1 --2- 172.21.15.55:0/102975154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2540b1e10 0x7fb25415d5b0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fb24400c780 tx=0x7fb24400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb24affd640 1 -- 172.21.15.55:0/102975154 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244005cf0 con 0x7fb2540b1e10 2023-07-06T21:58:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb24affd640 1 -- 172.21.15.55:0/102975154 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb244005e50 con 0x7fb2540b1e10 2023-07-06T21:58:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb24affd640 1 -- 172.21.15.55:0/102975154 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2440072b0 con 0x7fb2540b1e10 2023-07-06T21:58:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb258f37640 1 -- 172.21.15.55:0/102975154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2540c7220 con 0x7fb2540b1e10 2023-07-06T21:58:10.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.879+0000 7fb258f37640 1 -- 172.21.15.55:0/102975154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25415ece0 con 0x7fb2540b1e10 2023-07-06T21:58:10.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.883+0000 7fb258f37640 1 -- 172.21.15.55:0/102975154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2540c6e10 con 0x7fb2540b1e10 2023-07-06T21:58:10.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.883+0000 7fb24affd640 1 -- 172.21.15.55:0/102975154 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb244007410 con 0x7fb2540b1e10 2023-07-06T21:58:10.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.883+0000 7fb24affd640 1 --2- 172.21.15.55:0/102975154 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb2340663a0 0x7fb234068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:10.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.883+0000 7fb24affd640 1 -- 172.21.15.55:0/102975154 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb2440837e0 con 0x7fb2540b1e10 2023-07-06T21:58:10.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.883+0000 7fb24bfff640 1 --2- 172.21.15.55:0/102975154 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb2340663a0 0x7fb234068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:10.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.883+0000 7fb24bfff640 1 --2- 172.21.15.55:0/102975154 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb2340663a0 0x7fb234068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0ad000 tx=0x7fb23c0a6000 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:10.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:10.887+0000 7fb24affd640 1 -- 172.21.15.55:0/102975154 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2540c6e10 con 0x7fb2540b1e10 2023-07-06T21:58:11.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.075+0000 7fb258f37640 1 -- 172.21.15.55:0/102975154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb2540c6e10 con 0x7fb2540b1e10 2023-07-06T21:58:11.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.075+0000 7fb24affd640 1 -- 172.21.15.55:0/102975154 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb2540c6e10 con 0x7fb2540b1e10 2023-07-06T21:58:11.075 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T21:58:11.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.075+0000 7fb258f37640 1 -- 172.21.15.55:0/102975154 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb2340663a0 msgr2=0x7fb234068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:11.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.075+0000 7fb258f37640 1 --2- 172.21.15.55:0/102975154 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb2340663a0 0x7fb234068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0ad000 tx=0x7fb23c0a6000 comp rx=0 tx=0).stop 2023-07-06T21:58:11.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.075+0000 7fb258f37640 1 -- 172.21.15.55:0/102975154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2540b1e10 msgr2=0x7fb25415d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:11.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.075+0000 7fb258f37640 1 --2- 172.21.15.55:0/102975154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2540b1e10 0x7fb25415d5b0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fb24400c780 tx=0x7fb24400cc40 comp rx=0 tx=0).stop 2023-07-06T21:58:11.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.079+0000 7fb258f37640 1 -- 172.21.15.55:0/102975154 shutdown_connections 2023-07-06T21:58:11.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.079+0000 7fb258f37640 1 --2- 172.21.15.55:0/102975154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2540ce610 0x7fb2540c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:11.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.079+0000 7fb258f37640 1 --2- 172.21.15.55:0/102975154 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fb2340663a0 0x7fb234068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:11.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.079+0000 7fb258f37640 1 --2- 172.21.15.55:0/102975154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2540b7cd0 0x7fb25415e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:11.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.079+0000 7fb258f37640 1 --2- 172.21.15.55:0/102975154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2540b1e10 0x7fb25415d5b0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:11.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.079+0000 7fb258f37640 1 -- 172.21.15.55:0/102975154 >> 172.21.15.55:0/102975154 conn(0x7fb2540ceee0 msgr2=0x7fb2540693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:11.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.079+0000 7fb258f37640 1 -- 172.21.15.55:0/102975154 shutdown_connections 2023-07-06T21:58:11.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.079+0000 7fb258f37640 1 -- 172.21.15.55:0/102975154 wait complete. 2023-07-06T21:58:11.095 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T21:58:11.095 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T21:58:11.096 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-07-06T21:58:11.096 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T21:58:11.096 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T21:58:11.097 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T21:58:11.097 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-06T21:58:11.097 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T21:58:11.097 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:58:11.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:11.098 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-07-06T21:58:11.107 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T21:58:11.108 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T21:58:11.108 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T21:58:11.108 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:11.108 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T21:58:11.108 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:11.108 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:58:11.108 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:58:11.109 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-07-06T21:58:11.109 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:58:11.109 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:58:11.109 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-07-06T21:58:11.109 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T21:58:11.109 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:58:11.109 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-07-06T21:58:11.109 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-06T21:58:11.110 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41466sec preferred_lft 41466sec 2023-07-06T21:58:11.110 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-07-06T21:58:11.110 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:11.110 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:58:11.110 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:58:11.110 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-07-06T21:58:11.110 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T21:58:11.110 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:84:fe:b8:21 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:58:11.111 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T21:58:11.111 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:11.111 INFO:teuthology.orchestra.run.smithi055.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T21:58:11.111 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-06T21:58:11.111 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T21:58:11.111 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:11.111 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-06T21:58:11.112 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:11.112 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T21:58:11.112 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T21:58:11.112 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-06T21:58:11.112 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:11.112 INFO:teuthology.orchestra.run.smithi055.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T21:58:11.112 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T21:58:11.112 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-06T21:58:11.113 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:11.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:11.114 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T21:58:11.179 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-07-06T21:58:11.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:11.181 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-07-06T21:58:11.237 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-07-06T21:58:11.237 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T21:58:11.237 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-06T21:58:11.237 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T21:58:11.238 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-06T21:58:11.238 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T21:58:11.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:11.238 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:58:11.239 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:58:11.239 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T21:58:11.239 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T21:58:11.240 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T21:58:11.240 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:58:11.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:11.333 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T21:58:11.342 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T21:58:11.342 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T21:58:11.343 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:58:11.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:11.343 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-07-06T21:58:11.409 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:58:11.409 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T21:58:11.460 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:58:11.460 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:58:11.461 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T21:58:11.511 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-06T21:58:11.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:11.512 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:58:11.608 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:58:11.608 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:58:11.621 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:58:11.621 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:58:11.621 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-07-06T21:58:11.621 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.cephfs=/ 2023-07-06T21:58:11.621 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-07-06T21:58:11.624 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T21:58:11.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:11.625 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T21:58:11.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:11.646 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:58:11.708 INFO:teuthology.orchestra.run.smithi055.stdout:client7249 2023-07-06T21:58:11.709 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:58:11.709 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:58:11.760 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-06T21:58:11.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.951+0000 7f2176c48640 1 Processor -- start 2023-07-06T21:58:11.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.951+0000 7f2176c48640 1 -- start start 2023-07-06T21:58:11.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.951+0000 7f2176c48640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f21700709a0 0x7f21700cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:11.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.951+0000 7f2176c48640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21700cc300 con 0x7f21700cbe60 2023-07-06T21:58:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.951+0000 7f2176c48640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21700cc5e0 con 0x7f21700b1340 2023-07-06T21:58:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.951+0000 7f2176c48640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21700cc8c0 con 0x7f21700709a0 2023-07-06T21:58:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.951+0000 7f216ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f21700cbe60 0x7f21700b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57052/0 (socket says 172.21.15.55:57052) 2023-07-06T21:58:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.951+0000 7f216ffff640 1 -- 172.21.15.55:0/1379379839 learned_addr learned my addr 172.21.15.55:0/1379379839 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:11.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.951+0000 7f21749e4640 1 --2- 172.21.15.55:0/1379379839 >> v2:172.21.15.138:3300/0 conn(0x7f21700709a0 0x7f21700cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:11.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.951+0000 7f216f7fe640 1 -- 172.21.15.55:0/1379379839 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006444719 0 0) 0x7f21700cc300 con 0x7f21700cbe60 2023-07-06T21:58:11.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.951+0000 7f216f7fe640 1 -- 172.21.15.55:0/1379379839 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2160003530 con 0x7f21700cbe60 2023-07-06T21:58:11.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 -- 172.21.15.55:0/1379379839 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 681428576 0 0) 0x7f2160003530 con 0x7f21700cbe60 2023-07-06T21:58:11.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 -- 172.21.15.55:0/1379379839 >> v2:172.21.15.138:3300/0 conn(0x7f21700709a0 msgr2=0x7f21700cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:11.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 --2- 172.21.15.55:0/1379379839 >> v2:172.21.15.138:3300/0 conn(0x7f21700709a0 0x7f21700cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 -- 172.21.15.55:0/1379379839 >> v1:172.21.15.138:6789/0 conn(0x7f21700b1340 legacy=0x7f217006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 -- 172.21.15.55:0/1379379839 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700ccba0 con 0x7f21700cbe60 2023-07-06T21:58:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 -- 172.21.15.55:0/1379379839 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f215c001680 con 0x7f21700cbe60 2023-07-06T21:58:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f21749e4640 1 --2- 172.21.15.55:0/1379379839 >> v2:172.21.15.138:3300/0 conn(0x7f21700709a0 0x7f21700cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 -- 172.21.15.55:0/1379379839 >> v1:172.21.15.55:6789/0 conn(0x7f21700cbe60 legacy=0x7f21700b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 --2- 172.21.15.55:0/1379379839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2160003980 0x7f2160003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 --2- 172.21.15.55:0/1379379839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2160004370 0x7f2160004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 --2- 172.21.15.55:0/1379379839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2160005030 0x7f216000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 -- 172.21.15.55:0/1379379839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21700cc8c0 con 0x7f2160004370 2023-07-06T21:58:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 -- 172.21.15.55:0/1379379839 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216000bf80 con 0x7f2160003980 2023-07-06T21:58:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 -- 172.21.15.55:0/1379379839 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216000c140 con 0x7f2160005030 2023-07-06T21:58:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216ffff640 1 --2- 172.21.15.55:0/1379379839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2160004370 0x7f2160004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f21749e4640 1 --2- 172.21.15.55:0/1379379839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2160003980 0x7f2160003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f21751e5640 1 --2- 172.21.15.55:0/1379379839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2160005030 0x7f216000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216ffff640 1 -- 172.21.15.55:0/1379379839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2160005030 msgr2=0x7f216000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216ffff640 1 --2- 172.21.15.55:0/1379379839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2160005030 0x7f216000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216ffff640 1 -- 172.21.15.55:0/1379379839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2160003980 msgr2=0x7f2160003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216ffff640 1 --2- 172.21.15.55:0/1379379839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2160003980 0x7f2160003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216ffff640 1 -- 172.21.15.55:0/1379379839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160003530 con 0x7f2160004370 2023-07-06T21:58:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f21751e5640 1 --2- 172.21.15.55:0/1379379839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2160005030 0x7f216000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f21751e5640 1 -- 172.21.15.55:0/1379379839 reap_dead start 2023-07-06T21:58:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216ffff640 1 --2- 172.21.15.55:0/1379379839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2160004370 0x7f2160004830 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f215c00c210 tx=0x7f215c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf90e28e83f6df9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 -- 172.21.15.55:0/1379379839 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c005ae0 con 0x7f2160004370 2023-07-06T21:58:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.955+0000 7f216f7fe640 1 -- 172.21.15.55:0/1379379839 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c005c60 con 0x7f2160004370 2023-07-06T21:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f216f7fe640 1 -- 172.21.15.55:0/1379379839 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c0a59f0 con 0x7f2160004370 2023-07-06T21:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 -- 172.21.15.55:0/1379379839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2160004370 msgr2=0x7f2160004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 --2- 172.21.15.55:0/1379379839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2160004370 0x7f2160004830 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f215c00c210 tx=0x7f215c01cc40 comp rx=0 tx=0).stop 2023-07-06T21:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 -- 172.21.15.55:0/1379379839 shutdown_connections 2023-07-06T21:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 --2- 172.21.15.55:0/1379379839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2160004370 0x7f2160004830 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 -- 172.21.15.55:0/1379379839 >> 172.21.15.55:0/1379379839 conn(0x7f21700cea70 msgr2=0x7f21700ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 -- 172.21.15.55:0/1379379839 shutdown_connections 2023-07-06T21:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 -- 172.21.15.55:0/1379379839 wait complete. 2023-07-06T21:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 Processor -- start 2023-07-06T21:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 -- start start 2023-07-06T21:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2160004370 0x7f21701590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f217009fd70 0x7f21700a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21700a18b0 0x7f21700a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21700a2260 con 0x7f217009fd70 2023-07-06T21:58:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2170159600 con 0x7f2160004370 2023-07-06T21:58:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f2176c48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217015d070 con 0x7f21700a18b0 2023-07-06T21:58:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f216ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f217009fd70 0x7f21700a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f21749e4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2160004370 0x7f21701590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f216ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f217009fd70 0x7f21700a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34996/0 (socket says 172.21.15.55:34996) 2023-07-06T21:58:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.959+0000 7f216ffff640 1 -- 172.21.15.55:0/3981561109 learned_addr learned my addr 172.21.15.55:0/3981561109 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f21751e5640 1 --2- 172.21.15.55:0/3981561109 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21700a18b0 0x7f21700a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:11.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f21749e4640 1 -- 172.21.15.55:0/3981561109 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21700a18b0 msgr2=0x7f21700a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:11.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f21749e4640 1 --2- 172.21.15.55:0/3981561109 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21700a18b0 0x7f21700a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:11.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f21749e4640 1 -- 172.21.15.55:0/3981561109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f217009fd70 msgr2=0x7f21700a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:11.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f21749e4640 1 --2- 172.21.15.55:0/3981561109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f217009fd70 0x7f21700a01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:11.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f21749e4640 1 -- 172.21.15.55:0/3981561109 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700a08e0 con 0x7f2160004370 2023-07-06T21:58:11.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f216ffff640 1 --2- 172.21.15.55:0/3981561109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f217009fd70 0x7f21700a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:11.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f21749e4640 1 --2- 172.21.15.55:0/3981561109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2160004370 0x7f21701590c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2164011a00 tx=0x7f2164011ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:11.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f216d7fa640 1 -- 172.21.15.55:0/3981561109 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216400fc10 con 0x7f2160004370 2023-07-06T21:58:11.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f216d7fa640 1 -- 172.21.15.55:0/3981561109 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216400fd70 con 0x7f2160004370 2023-07-06T21:58:11.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f216d7fa640 1 -- 172.21.15.55:0/3981561109 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216400fee0 con 0x7f2160004370 2023-07-06T21:58:11.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f2176c48640 1 -- 172.21.15.55:0/3981561109 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21700a0bc0 con 0x7f2160004370 2023-07-06T21:58:11.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f2176c48640 1 -- 172.21.15.55:0/3981561109 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21700a1180 con 0x7f2160004370 2023-07-06T21:58:11.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f2176c48640 1 -- 172.21.15.55:0/3981561109 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2170066d60 con 0x7f2160004370 2023-07-06T21:58:11.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.963+0000 7f216d7fa640 1 -- 172.21.15.55:0/3981561109 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2164004270 con 0x7f2160004370 2023-07-06T21:58:11.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.967+0000 7f216d7fa640 1 --2- 172.21.15.55:0/3981561109 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f21540663a0 0x7f2154068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:11.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.967+0000 7f216d7fa640 1 -- 172.21.15.55:0/3981561109 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2164084920 con 0x7f2160004370 2023-07-06T21:58:11.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.967+0000 7f216ffff640 1 --2- 172.21.15.55:0/3981561109 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f21540663a0 0x7f2154068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:11.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.967+0000 7f216ffff640 1 --2- 172.21.15.55:0/3981561109 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f21540663a0 0x7f2154068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f21700a35e0 tx=0x7f215c0b1040 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:11.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:11.967+0000 7f216d7fa640 1 -- 172.21.15.55:0/3981561109 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2164051ce0 con 0x7f2160004370 2023-07-06T21:58:12.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.143+0000 7f2176c48640 1 -- 172.21.15.55:0/3981561109 --> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f21700b2fe0 con 0x7f21540663a0 2023-07-06T21:58:12.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.143+0000 7f216d7fa640 1 -- 172.21.15.55:0/3981561109 <== mgr.7191 v2:172.21.15.55:6832/703944479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f215c0b5040 con 0x7f21540663a0 2023-07-06T21:58:12.143 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T21:58:12.143 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:12.144 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-07-06T21:58:12.144 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:12.144 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T21:58:12.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.147+0000 7f2176c48640 1 -- 172.21.15.55:0/3981561109 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f21540663a0 msgr2=0x7f2154068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:12.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.147+0000 7f2176c48640 1 --2- 172.21.15.55:0/3981561109 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f21540663a0 0x7f2154068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f21700a35e0 tx=0x7f215c0b1040 comp rx=0 tx=0).stop 2023-07-06T21:58:12.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.147+0000 7f2176c48640 1 -- 172.21.15.55:0/3981561109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2160004370 msgr2=0x7f21701590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:12.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.147+0000 7f2176c48640 1 --2- 172.21.15.55:0/3981561109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2160004370 0x7f21701590c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2164011a00 tx=0x7f2164011ec0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.147+0000 7f2176c48640 1 -- 172.21.15.55:0/3981561109 shutdown_connections 2023-07-06T21:58:12.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.147+0000 7f2176c48640 1 --2- 172.21.15.55:0/3981561109 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f21540663a0 0x7f2154068850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.147+0000 7f2176c48640 1 --2- 172.21.15.55:0/3981561109 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21700a18b0 0x7f21700a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.147+0000 7f2176c48640 1 --2- 172.21.15.55:0/3981561109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f217009fd70 0x7f21700a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.147+0000 7f2176c48640 1 --2- 172.21.15.55:0/3981561109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2160004370 0x7f21701590c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.147+0000 7f2176c48640 1 -- 172.21.15.55:0/3981561109 >> 172.21.15.55:0/3981561109 conn(0x7f21700cea70 msgr2=0x7f217009da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:12.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.147+0000 7f2176c48640 1 -- 172.21.15.55:0/3981561109 shutdown_connections 2023-07-06T21:58:12.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.147+0000 7f2176c48640 1 -- 172.21.15.55:0/3981561109 wait complete. 2023-07-06T21:58:12.164 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-06T21:58:12.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.311+0000 7fab3f47b640 1 Processor -- start 2023-07-06T21:58:12.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.311+0000 7fab3f47b640 1 -- start start 2023-07-06T21:58:12.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.311+0000 7fab3f47b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fab380c94b0 0x7fab3816af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:12.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.311+0000 7fab3f47b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab380ccd70 con 0x7fab3806eee0 2023-07-06T21:58:12.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab3f47b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3806cb20 con 0x7fab380c11a0 2023-07-06T21:58:12.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab3f47b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab381605f0 con 0x7fab380c94b0 2023-07-06T21:58:12.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab3ca16640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fab3806eee0 0x7fab3806f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57054/0 (socket says 172.21.15.55:57054) 2023-07-06T21:58:12.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab3ca16640 1 -- 172.21.15.55:0/595380721 learned_addr learned my addr 172.21.15.55:0/595380721 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:12.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab3da18640 1 --2- 172.21.15.55:0/595380721 >> v2:172.21.15.138:3300/0 conn(0x7fab380c94b0 0x7fab3816af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:12.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 -- 172.21.15.55:0/595380721 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841578655 0 0) 0x7fab380ccd70 con 0x7fab3806eee0 2023-07-06T21:58:12.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 -- 172.21.15.55:0/595380721 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab24003530 con 0x7fab3806eee0 2023-07-06T21:58:12.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 -- 172.21.15.55:0/595380721 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 956542551 0 0) 0x7fab24003530 con 0x7fab3806eee0 2023-07-06T21:58:12.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 -- 172.21.15.55:0/595380721 >> v2:172.21.15.138:3300/0 conn(0x7fab380c94b0 msgr2=0x7fab3816af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:12.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 --2- 172.21.15.55:0/595380721 >> v2:172.21.15.138:3300/0 conn(0x7fab380c94b0 0x7fab3816af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 -- 172.21.15.55:0/595380721 >> v1:172.21.15.138:6789/0 conn(0x7fab380c11a0 legacy=0x7fab380cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:12.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 -- 172.21.15.55:0/595380721 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab380cca00 con 0x7fab3806eee0 2023-07-06T21:58:12.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 -- 172.21.15.55:0/595380721 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fab28001680 con 0x7fab3806eee0 2023-07-06T21:58:12.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 -- 172.21.15.55:0/595380721 >> v1:172.21.15.55:6789/0 conn(0x7fab3806eee0 legacy=0x7fab3806f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:12.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 --2- 172.21.15.55:0/595380721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab24003980 0x7fab24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:12.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 --2- 172.21.15.55:0/595380721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab240047d0 0x7fab24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:12.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 --2- 172.21.15.55:0/595380721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab24005180 0x7fab2400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:12.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 -- 172.21.15.55:0/595380721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab381605f0 con 0x7fab24005180 2023-07-06T21:58:12.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 -- 172.21.15.55:0/595380721 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2400c090 con 0x7fab24003980 2023-07-06T21:58:12.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab2ffff640 1 -- 172.21.15.55:0/595380721 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2400c250 con 0x7fab240047d0 2023-07-06T21:58:12.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab3d217640 1 --2- 172.21.15.55:0/595380721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab24003980 0x7fab24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:12.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab3ca16640 1 --2- 172.21.15.55:0/595380721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab240047d0 0x7fab24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:12.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab3da18640 1 --2- 172.21.15.55:0/595380721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab24005180 0x7fab2400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:12.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab3d217640 1 -- 172.21.15.55:0/595380721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab240047d0 msgr2=0x7fab24004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:12.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab3d217640 1 --2- 172.21.15.55:0/595380721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab240047d0 0x7fab24004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab3d217640 1 -- 172.21.15.55:0/595380721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab24005180 msgr2=0x7fab2400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:12.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab3d217640 1 --2- 172.21.15.55:0/595380721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab24005180 0x7fab2400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab3d217640 1 -- 172.21.15.55:0/595380721 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab24003530 con 0x7fab24003980 2023-07-06T21:58:12.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.315+0000 7fab3da18640 1 -- 172.21.15.55:0/595380721 reap_dead start 2023-07-06T21:58:12.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.319+0000 7fab3d217640 1 --2- 172.21.15.55:0/595380721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab24003980 0x7fab24003d90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fab34001780 tx=0x7fab3401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeea1fbcddeda43e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:12.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.319+0000 7fab2ffff640 1 -- 172.21.15.55:0/595380721 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340052d0 con 0x7fab24003980 2023-07-06T21:58:12.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.319+0000 7fab2ffff640 1 -- 172.21.15.55:0/595380721 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab340a7050 con 0x7fab24003980 2023-07-06T21:58:12.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.319+0000 7fab2ffff640 1 -- 172.21.15.55:0/595380721 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34003600 con 0x7fab24003980 2023-07-06T21:58:12.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.319+0000 7fab3f47b640 1 -- 172.21.15.55:0/595380721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab24003980 msgr2=0x7fab24003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:12.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.319+0000 7fab3f47b640 1 --2- 172.21.15.55:0/595380721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab24003980 0x7fab24003d90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fab34001780 tx=0x7fab3401c3e0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.319+0000 7fab3f47b640 1 -- 172.21.15.55:0/595380721 shutdown_connections 2023-07-06T21:58:12.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.319+0000 7fab3f47b640 1 --2- 172.21.15.55:0/595380721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab24003980 0x7fab24003d90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.319+0000 7fab3f47b640 1 -- 172.21.15.55:0/595380721 >> 172.21.15.55:0/595380721 conn(0x7fab380cea70 msgr2=0x7fab380ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:12.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.319+0000 7fab3f47b640 1 -- 172.21.15.55:0/595380721 shutdown_connections 2023-07-06T21:58:12.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.319+0000 7fab3f47b640 1 -- 172.21.15.55:0/595380721 wait complete. 2023-07-06T21:58:12.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.319+0000 7fab3f47b640 1 Processor -- start 2023-07-06T21:58:12.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.319+0000 7fab3f47b640 1 -- start start 2023-07-06T21:58:12.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3f47b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab24003980 0x7fab38153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:12.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3f47b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab380c6ff0 0x7fab380c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:12.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3f47b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab380b2cb0 0x7fab380b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:12.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3f47b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab380af080 con 0x7fab24003980 2023-07-06T21:58:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3f47b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab380b3660 con 0x7fab380b2cb0 2023-07-06T21:58:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3f47b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab38154340 con 0x7fab380c6ff0 2023-07-06T21:58:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3d217640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab24003980 0x7fab38153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3d217640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab24003980 0x7fab38153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35012/0 (socket says 172.21.15.55:35012) 2023-07-06T21:58:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3d217640 1 -- 172.21.15.55:0/7426574 learned_addr learned my addr 172.21.15.55:0/7426574 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3ca16640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab380c6ff0 0x7fab380c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3da18640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab380b2cb0 0x7fab380b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:12.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3d217640 1 -- 172.21.15.55:0/7426574 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab380c6ff0 msgr2=0x7fab380c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:12.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3d217640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab380c6ff0 0x7fab380c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3d217640 1 -- 172.21.15.55:0/7426574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab380b2cb0 msgr2=0x7fab380b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:12.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3d217640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab380b2cb0 0x7fab380b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3d217640 1 -- 172.21.15.55:0/7426574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab380c16f0 con 0x7fab24003980 2023-07-06T21:58:12.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3ca16640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab380c6ff0 0x7fab380c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:12.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3da18640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab380b2cb0 0x7fab380b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:12.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3d217640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab24003980 0x7fab38153e00 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fab34005040 tx=0x7fab24005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:12.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab2dffb640 1 -- 172.21.15.55:0/7426574 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34007500 con 0x7fab24003980 2023-07-06T21:58:12.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab2dffb640 1 -- 172.21.15.55:0/7426574 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab34007660 con 0x7fab24003980 2023-07-06T21:58:12.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab2dffb640 1 -- 172.21.15.55:0/7426574 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34006a00 con 0x7fab24003980 2023-07-06T21:58:12.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3f47b640 1 -- 172.21.15.55:0/7426574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab380c7a40 con 0x7fab24003980 2023-07-06T21:58:12.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3f47b640 1 -- 172.21.15.55:0/7426574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab380c8000 con 0x7fab24003980 2023-07-06T21:58:12.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.323+0000 7fab3f47b640 1 -- 172.21.15.55:0/7426574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab38072da0 con 0x7fab24003980 2023-07-06T21:58:12.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.327+0000 7fab2dffb640 1 -- 172.21.15.55:0/7426574 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fab34006b60 con 0x7fab24003980 2023-07-06T21:58:12.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.327+0000 7fab2dffb640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fab1c0663a0 0x7fab1c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:12.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.327+0000 7fab2dffb640 1 -- 172.21.15.55:0/7426574 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fab3411e380 con 0x7fab24003980 2023-07-06T21:58:12.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.327+0000 7fab3ca16640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fab1c0663a0 0x7fab1c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:12.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.327+0000 7fab3ca16640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fab1c0663a0 0x7fab1c068850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fab280011f0 tx=0x7fab28001160 comp rx=0 tx=0).ready entity=mgr.7191 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:12.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.331+0000 7fab2dffb640 1 -- 172.21.15.55:0/7426574 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab340eee90 con 0x7fab24003980 2023-07-06T21:58:12.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.519+0000 7fab3f47b640 1 -- 172.21.15.55:0/7426574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fab38066d60 con 0x7fab24003980 2023-07-06T21:58:12.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.683+0000 7fab2dffb640 1 -- 172.21.15.55:0/7426574 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 39) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fab3411e070 con 0x7fab24003980 2023-07-06T21:58:12.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.683+0000 7fab2dffb640 1 -- 172.21.15.55:0/7426574 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v39) v1 ==== 92+0+0 (secure 0 0 0) 0x7fab34102cc0 con 0x7fab24003980 2023-07-06T21:58:12.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.687+0000 7fab3f47b640 1 -- 172.21.15.55:0/7426574 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fab1c0663a0 msgr2=0x7fab1c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:12.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.687+0000 7fab3f47b640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fab1c0663a0 0x7fab1c068850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fab280011f0 tx=0x7fab28001160 comp rx=0 tx=0).stop 2023-07-06T21:58:12.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.687+0000 7fab3f47b640 1 -- 172.21.15.55:0/7426574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab24003980 msgr2=0x7fab38153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:12.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.687+0000 7fab3f47b640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab24003980 0x7fab38153e00 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fab34005040 tx=0x7fab24005800 comp rx=0 tx=0).stop 2023-07-06T21:58:12.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.687+0000 7fab3f47b640 1 -- 172.21.15.55:0/7426574 shutdown_connections 2023-07-06T21:58:12.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.687+0000 7fab3f47b640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab380b2cb0 0x7fab380b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.687+0000 7fab3f47b640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7fab1c0663a0 0x7fab1c068850 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.687+0000 7fab3f47b640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab380c6ff0 0x7fab380c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.687+0000 7fab3f47b640 1 --2- 172.21.15.55:0/7426574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab24003980 0x7fab38153e00 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.687+0000 7fab3f47b640 1 -- 172.21.15.55:0/7426574 >> 172.21.15.55:0/7426574 conn(0x7fab380cea70 msgr2=0x7fab380c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:12.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.687+0000 7fab3f47b640 1 -- 172.21.15.55:0/7426574 shutdown_connections 2023-07-06T21:58:12.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.687+0000 7fab3f47b640 1 -- 172.21.15.55:0/7426574 wait complete. 2023-07-06T21:58:12.713 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-06T21:58:12.846 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:12.846+0000 7f9fc1255180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:58:12.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.863+0000 7f4dcf540640 1 Processor -- start 2023-07-06T21:58:12.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.863+0000 7f4dcf540640 1 -- start start 2023-07-06T21:58:12.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.863+0000 7f4dcf540640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4dc815b850 0x7f4dc80cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:12.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.863+0000 7f4dcf540640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dc80ccd30 0x7f4dc80b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:12.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.863+0000 7f4dcf540640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc80b4210 con 0x7f4dc80b3db0 2023-07-06T21:58:12.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.863+0000 7f4dcf540640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc80b2b80 con 0x7f4dc815b850 2023-07-06T21:58:12.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.863+0000 7f4dcf540640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80cff30 con 0x7f4dc80ccd30 2023-07-06T21:58:12.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.863+0000 7f4dcd2dc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4dc815b850 0x7f4dc80cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:12.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.863+0000 7f4dcd2dc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4dc815b850 0x7f4dc80cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35042/0 (socket says 172.21.15.55:35042) 2023-07-06T21:58:12.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.863+0000 7f4dcd2dc640 1 -- 172.21.15.55:0/2310012276 learned_addr learned my addr 172.21.15.55:0/2310012276 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:12.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.863+0000 7f4dccadb640 1 --2- 172.21.15.55:0/2310012276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dc80ccd30 0x7f4dc80b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:12.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.867+0000 7f4dcd2dc640 1 -- 172.21.15.55:0/2310012276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dc80ccd30 msgr2=0x7f4dc80b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:12.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.867+0000 7f4dcd2dc640 1 --2- 172.21.15.55:0/2310012276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dc80ccd30 0x7f4dc80b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.867+0000 7f4dcd2dc640 1 -- 172.21.15.55:0/2310012276 >> v1:172.21.15.55:6789/0 conn(0x7f4dc80b3db0 legacy=0x7f4dc815f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:12.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.867+0000 7f4dcd2dc640 1 -- 172.21.15.55:0/2310012276 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc80b22e0 con 0x7f4dc815b850 2023-07-06T21:58:12.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.867+0000 7f4dcd2dc640 1 --2- 172.21.15.55:0/2310012276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dc815b850 0x7f4dc80cc7f0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009870 tx=0x7f4dc401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7ae0193a34a579 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:12.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.867+0000 7f4dbffff640 1 -- 172.21.15.55:0/2310012276 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc40ab5f0 con 0x7f4dc815b850 2023-07-06T21:58:12.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.867+0000 7f4dbffff640 1 -- 172.21.15.55:0/2310012276 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc40ab750 con 0x7f4dc815b850 2023-07-06T21:58:12.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.867+0000 7f4dbffff640 1 -- 172.21.15.55:0/2310012276 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc40abae0 con 0x7f4dc815b850 2023-07-06T21:58:12.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.867+0000 7f4dcf540640 1 -- 172.21.15.55:0/2310012276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dc815b850 msgr2=0x7f4dc80cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:12.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.867+0000 7f4dcf540640 1 --2- 172.21.15.55:0/2310012276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dc815b850 0x7f4dc80cc7f0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009870 tx=0x7f4dc401c3f0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.867+0000 7f4dcf540640 1 -- 172.21.15.55:0/2310012276 shutdown_connections 2023-07-06T21:58:12.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.867+0000 7f4dcf540640 1 --2- 172.21.15.55:0/2310012276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dc80ccd30 0x7f4dc80b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.867+0000 7f4dcf540640 1 --2- 172.21.15.55:0/2310012276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dc815b850 0x7f4dc80cc7f0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.867+0000 7f4dcf540640 1 -- 172.21.15.55:0/2310012276 >> 172.21.15.55:0/2310012276 conn(0x7f4dc80cec20 msgr2=0x7f4dc80cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:12.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dcf540640 1 -- 172.21.15.55:0/2310012276 shutdown_connections 2023-07-06T21:58:12.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dcf540640 1 -- 172.21.15.55:0/2310012276 wait complete. 2023-07-06T21:58:12.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dcf540640 1 Processor -- start 2023-07-06T21:58:12.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dcf540640 1 -- start start 2023-07-06T21:58:12.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dcf540640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dc80b3db0 0x7f4dc8159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:12.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dcf540640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dc80ccd30 0x7f4dc815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dcf540640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dc815b850 0x7f4dc80c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dcf540640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc8153a90 con 0x7f4dc80ccd30 2023-07-06T21:58:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dcf540640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80cc180 con 0x7f4dc815b850 2023-07-06T21:58:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dcf540640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc8153600 con 0x7f4dc80b3db0 2023-07-06T21:58:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dccadb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dc80ccd30 0x7f4dc815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dccadb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dc80ccd30 0x7f4dc815bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35054/0 (socket says 172.21.15.55:35054) 2023-07-06T21:58:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dccadb640 1 -- 172.21.15.55:0/3848773379 learned_addr learned my addr 172.21.15.55:0/3848773379 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:12.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dcd2dc640 1 --2- 172.21.15.55:0/3848773379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dc80b3db0 0x7f4dc8159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:12.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dcdadd640 1 --2- 172.21.15.55:0/3848773379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dc815b850 0x7f4dc80c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dccadb640 1 -- 172.21.15.55:0/3848773379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dc80b3db0 msgr2=0x7f4dc8159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dccadb640 1 --2- 172.21.15.55:0/3848773379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dc80b3db0 0x7f4dc8159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dccadb640 1 -- 172.21.15.55:0/3848773379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dc815b850 msgr2=0x7f4dc80c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dccadb640 1 --2- 172.21.15.55:0/3848773379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dc815b850 0x7f4dc80c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dccadb640 1 -- 172.21.15.55:0/3848773379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40094d0 con 0x7f4dc80ccd30 2023-07-06T21:58:12.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.871+0000 7f4dccadb640 1 --2- 172.21.15.55:0/3848773379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dc80ccd30 0x7f4dc815bf30 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f4db800e930 tx=0x7f4db800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.875+0000 7f4dbdffb640 1 -- 172.21.15.55:0/3848773379 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8009690 con 0x7f4dc80ccd30 2023-07-06T21:58:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.875+0000 7f4dbdffb640 1 -- 172.21.15.55:0/3848773379 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db800ca00 con 0x7f4dc80ccd30 2023-07-06T21:58:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.875+0000 7f4dcf540640 1 -- 172.21.15.55:0/3848773379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc815bda0 con 0x7f4dc80ccd30 2023-07-06T21:58:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.875+0000 7f4dbdffb640 1 -- 172.21.15.55:0/3848773379 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800cdb0 con 0x7f4dc80ccd30 2023-07-06T21:58:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.875+0000 7f4dcf540640 1 -- 172.21.15.55:0/3848773379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc80d2b30 con 0x7f4dc80ccd30 2023-07-06T21:58:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.875+0000 7f4dcf540640 1 -- 172.21.15.55:0/3848773379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc8066d60 con 0x7f4dc80ccd30 2023-07-06T21:58:12.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.875+0000 7f4dbdffb640 1 -- 172.21.15.55:0/3848773379 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 39) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f4db8013470 con 0x7f4dc80ccd30 2023-07-06T21:58:12.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.875+0000 7f4dbdffb640 1 --2- 172.21.15.55:0/3848773379 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f4dac0663f0 0x7f4dac0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:12.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.875+0000 7f4dbdffb640 1 -- 172.21.15.55:0/3848773379 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4db8084170 con 0x7f4dc80ccd30 2023-07-06T21:58:12.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.875+0000 7f4dcd2dc640 1 -- 172.21.15.55:0/3848773379 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f4dac0663f0 msgr2=0x7f4dac0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/703944479 2023-07-06T21:58:12.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.875+0000 7f4dcd2dc640 1 --2- 172.21.15.55:0/3848773379 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f4dac0663f0 0x7f4dac0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:12.877 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:12.879+0000 7f40b7cd3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:58:12.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:12.879+0000 7f4dbdffb640 1 -- 172.21.15.55:0/3848773379 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4db8051500 con 0x7f4dc80ccd30 2023-07-06T21:58:13.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.039+0000 7f4dcf540640 1 -- 172.21.15.55:0/3848773379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f4dc8153740 con 0x7f4dc80ccd30 2023-07-06T21:58:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.043+0000 7f4dbdffb640 1 -- 172.21.15.55:0/3848773379 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4db8054b20 con 0x7f4dc80ccd30 2023-07-06T21:58:13.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.047+0000 7f4dcf540640 1 -- 172.21.15.55:0/3848773379 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f4dac0663f0 msgr2=0x7f4dac0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:13.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.047+0000 7f4dcf540640 1 --2- 172.21.15.55:0/3848773379 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f4dac0663f0 0x7f4dac0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.047+0000 7f4dcf540640 1 -- 172.21.15.55:0/3848773379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dc80ccd30 msgr2=0x7f4dc815bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:13.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.047+0000 7f4dcf540640 1 --2- 172.21.15.55:0/3848773379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dc80ccd30 0x7f4dc815bf30 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f4db800e930 tx=0x7f4db800edf0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.047+0000 7f4dcf540640 1 -- 172.21.15.55:0/3848773379 shutdown_connections 2023-07-06T21:58:13.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.047+0000 7f4dcf540640 1 --2- 172.21.15.55:0/3848773379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dc815b850 0x7f4dc80c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.047+0000 7f4dcf540640 1 --2- 172.21.15.55:0/3848773379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dc80ccd30 0x7f4dc815bf30 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.047+0000 7f4dcf540640 1 --2- 172.21.15.55:0/3848773379 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f4dac0663f0 0x7f4dac0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.047+0000 7f4dcf540640 1 --2- 172.21.15.55:0/3848773379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4dc80b3db0 0x7f4dc8159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.047+0000 7f4dcf540640 1 -- 172.21.15.55:0/3848773379 >> 172.21.15.55:0/3848773379 conn(0x7f4dc80cec20 msgr2=0x7f4dc8154080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:13.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.047+0000 7f4dcf540640 1 -- 172.21.15.55:0/3848773379 shutdown_connections 2023-07-06T21:58:13.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.047+0000 7f4dcf540640 1 -- 172.21.15.55:0/3848773379 wait complete. 2023-07-06T21:58:13.065 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-06T21:58:13.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.215+0000 7f6f11996640 1 Processor -- start 2023-07-06T21:58:13.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.215+0000 7f6f11996640 1 -- start start 2023-07-06T21:58:13.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.215+0000 7f6f11996640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f0c0ca130 0x7f6f0c0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:13.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.215+0000 7f6f11996640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0c0c8db0 con 0x7f6f0c158850 2023-07-06T21:58:13.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.215+0000 7f6f11996640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0c0c9090 con 0x7f6f0c0cd140 2023-07-06T21:58:13.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.215+0000 7f6f11996640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f0c158ce0 con 0x7f6f0c0ca130 2023-07-06T21:58:13.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.215+0000 7f6f03fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f0c0ca130 0x7f6f0c0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:13.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.215+0000 7f6f03fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f0c0ca130 0x7f6f0c0703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35070/0 (socket says 172.21.15.55:35070) 2023-07-06T21:58:13.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.215+0000 7f6f03fff640 1 -- 172.21.15.55:0/3337519173 learned_addr learned my addr 172.21.15.55:0/3337519173 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:13.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.215+0000 7f6f03fff640 1 -- 172.21.15.55:0/3337519173 >> v1:172.21.15.138:6789/0 conn(0x7f6f0c0cd140 legacy=0x7f6f0c0b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:13.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.215+0000 7f6f03fff640 1 -- 172.21.15.55:0/3337519173 >> v1:172.21.15.55:6789/0 conn(0x7f6f0c158850 legacy=0x7f6f0c0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:13.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.215+0000 7f6f03fff640 1 -- 172.21.15.55:0/3337519173 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c0c9370 con 0x7f6f0c0ca130 2023-07-06T21:58:13.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.219+0000 7f6f03fff640 1 --2- 172.21.15.55:0/3337519173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c0ca130 0x7f6f0c0703e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009870 tx=0x7f6ef401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdecab10a1f647fc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:13.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.219+0000 7f6f0a7fc640 1 -- 172.21.15.55:0/3337519173 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40aa670 con 0x7f6f0c0ca130 2023-07-06T21:58:13.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.219+0000 7f6f0a7fc640 1 -- 172.21.15.55:0/3337519173 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef40aa7d0 con 0x7f6f0c0ca130 2023-07-06T21:58:13.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.219+0000 7f6f0a7fc640 1 -- 172.21.15.55:0/3337519173 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40aab60 con 0x7f6f0c0ca130 2023-07-06T21:58:13.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.219+0000 7f6f11996640 1 -- 172.21.15.55:0/3337519173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c0ca130 msgr2=0x7f6f0c0703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:13.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.219+0000 7f6f11996640 1 --2- 172.21.15.55:0/3337519173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c0ca130 0x7f6f0c0703e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009870 tx=0x7f6ef401c510 comp rx=0 tx=0).stop 2023-07-06T21:58:13.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.219+0000 7f6f11996640 1 -- 172.21.15.55:0/3337519173 shutdown_connections 2023-07-06T21:58:13.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.219+0000 7f6f11996640 1 --2- 172.21.15.55:0/3337519173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c0ca130 0x7f6f0c0703e0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.219+0000 7f6f11996640 1 -- 172.21.15.55:0/3337519173 >> 172.21.15.55:0/3337519173 conn(0x7f6f0c0cea70 msgr2=0x7f6f0c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:13.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.219+0000 7f6f11996640 1 -- 172.21.15.55:0/3337519173 shutdown_connections 2023-07-06T21:58:13.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.219+0000 7f6f11996640 1 -- 172.21.15.55:0/3337519173 wait complete. 2023-07-06T21:58:13.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.219+0000 7f6f11996640 1 Processor -- start 2023-07-06T21:58:13.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.219+0000 7f6f11996640 1 -- start start 2023-07-06T21:58:13.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f11996640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f0c0ca130 0x7f6f0c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:13.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f11996640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f0c0cd140 0x7f6f0c1f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:13.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f11996640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c158850 0x7f6f0c158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:13.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f11996640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c0c6ee0 con 0x7f6f0c158850 2023-07-06T21:58:13.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f11996640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c156530 con 0x7f6f0c0cd140 2023-07-06T21:58:13.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f11996640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c0c6260 con 0x7f6f0c0ca130 2023-07-06T21:58:13.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f0b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c158850 0x7f6f0c158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:13.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f03fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f0c0cd140 0x7f6f0c1f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:13.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f0affd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f0c0ca130 0x7f6f0c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:13.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f03fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f0c0cd140 0x7f6f0c1f4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:38866/0 (socket says 172.21.15.55:38866) 2023-07-06T21:58:13.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f03fff640 1 -- 172.21.15.55:0/1626780264 learned_addr learned my addr 172.21.15.55:0/1626780264 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:13.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f0b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c158850 0x7f6f0c158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35078/0 (socket says 172.21.15.55:35078) 2023-07-06T21:58:13.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f03fff640 1 -- 172.21.15.55:0/1626780264 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f0c0ca130 msgr2=0x7f6f0c0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:13.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f03fff640 1 --2- 172.21.15.55:0/1626780264 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f0c0ca130 0x7f6f0c0c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f03fff640 1 -- 172.21.15.55:0/1626780264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c158850 msgr2=0x7f6f0c158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:13.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f03fff640 1 --2- 172.21.15.55:0/1626780264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c158850 0x7f6f0c158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f03fff640 1 -- 172.21.15.55:0/1626780264 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef40094d0 con 0x7f6f0c0cd140 2023-07-06T21:58:13.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f03fff640 1 --2- 172.21.15.55:0/1626780264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f0c0cd140 0x7f6f0c1f4470 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4019120 tx=0x7f6ef401ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:13.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f08ff9640 1 -- 172.21.15.55:0/1626780264 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40b38c0 con 0x7f6f0c0cd140 2023-07-06T21:58:13.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f08ff9640 1 -- 172.21.15.55:0/1626780264 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef40b3a20 con 0x7f6f0c0cd140 2023-07-06T21:58:13.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f08ff9640 1 -- 172.21.15.55:0/1626780264 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40b3dd0 con 0x7f6f0c0cd140 2023-07-06T21:58:13.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f11996640 1 -- 172.21.15.55:0/1626780264 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0c0c6540 con 0x7f6f0c0cd140 2023-07-06T21:58:13.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f11996640 1 -- 172.21.15.55:0/1626780264 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0c0c6b00 con 0x7f6f0c0cd140 2023-07-06T21:58:13.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.223+0000 7f6f11996640 1 -- 172.21.15.55:0/1626780264 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0c0c7020 con 0x7f6f0c0cd140 2023-07-06T21:58:13.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.227+0000 7f6f08ff9640 1 -- 172.21.15.55:0/1626780264 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f6ef40b2380 con 0x7f6f0c0cd140 2023-07-06T21:58:13.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.227+0000 7f6f08ff9640 1 --2- 172.21.15.55:0/1626780264 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6eec0663f0 0x7f6eec0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:13.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.227+0000 7f6f08ff9640 1 -- 172.21.15.55:0/1626780264 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6ef411eb50 con 0x7f6f0c0cd140 2023-07-06T21:58:13.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.227+0000 7f6f0affd640 1 -- 172.21.15.55:0/1626780264 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6eec0663f0 msgr2=0x7f6eec0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/703944479 2023-07-06T21:58:13.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.227+0000 7f6f0affd640 1 --2- 172.21.15.55:0/1626780264 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6eec0663f0 0x7f6eec0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:13.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.231+0000 7f6f08ff9640 1 -- 172.21.15.55:0/1626780264 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f0c0c7020 con 0x7f6f0c0cd140 2023-07-06T21:58:13.259 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:13.258+0000 7f9fc1255180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:58:13.323 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:13.323+0000 7f40b7cd3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:58:13.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.391+0000 7f6f11996640 1 -- 172.21.15.55:0/1626780264 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f6f0c0c7020 con 0x7f6f0c0cd140 2023-07-06T21:58:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.399+0000 7f6f08ff9640 1 -- 172.21.15.55:0/1626780264 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6f0c0c7020 con 0x7f6f0c0cd140 2023-07-06T21:58:13.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.403+0000 7f6f11996640 1 -- 172.21.15.55:0/1626780264 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6eec0663f0 msgr2=0x7f6eec0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:13.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.403+0000 7f6f11996640 1 --2- 172.21.15.55:0/1626780264 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6eec0663f0 0x7f6eec0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.403+0000 7f6f11996640 1 -- 172.21.15.55:0/1626780264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f0c0cd140 msgr2=0x7f6f0c1f4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:13.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.403+0000 7f6f11996640 1 --2- 172.21.15.55:0/1626780264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f0c0cd140 0x7f6f0c1f4470 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4019120 tx=0x7f6ef401ad50 comp rx=0 tx=0).stop 2023-07-06T21:58:13.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.403+0000 7f6f11996640 1 -- 172.21.15.55:0/1626780264 shutdown_connections 2023-07-06T21:58:13.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.403+0000 7f6f11996640 1 --2- 172.21.15.55:0/1626780264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c158850 0x7f6f0c158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.403+0000 7f6f11996640 1 --2- 172.21.15.55:0/1626780264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f0c0cd140 0x7f6f0c1f4470 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.403+0000 7f6f11996640 1 --2- 172.21.15.55:0/1626780264 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f6eec0663f0 0x7f6eec0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.403+0000 7f6f11996640 1 --2- 172.21.15.55:0/1626780264 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f0c0ca130 0x7f6f0c0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.403+0000 7f6f11996640 1 -- 172.21.15.55:0/1626780264 >> 172.21.15.55:0/1626780264 conn(0x7f6f0c0cea70 msgr2=0x7f6f0c1568f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:13.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.403+0000 7f6f11996640 1 -- 172.21.15.55:0/1626780264 shutdown_connections 2023-07-06T21:58:13.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.403+0000 7f6f11996640 1 -- 172.21.15.55:0/1626780264 wait complete. 2023-07-06T21:58:13.409 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:13.410+0000 7f9fc1255180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:58:13.421 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-06T21:58:13.485 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:13.487+0000 7f40b7cd3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:58:13.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.571+0000 7f30029ad640 1 Processor -- start 2023-07-06T21:58:13.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.571+0000 7f30029ad640 1 -- start start 2023-07-06T21:58:13.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.571+0000 7f30029ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ffc0b18a0 0x7f2ffc0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:13.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.571+0000 7f30029ad640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2ffc0d1d30 0x7f2ffc0cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:13.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.571+0000 7f30029ad640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ffc0ccd50 con 0x7f2ffc0b3c90 2023-07-06T21:58:13.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.571+0000 7f30029ad640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ffc0cd0a0 con 0x7f2ffc0b18a0 2023-07-06T21:58:13.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.571+0000 7f30029ad640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ffc069ea0 con 0x7f2ffc0d1d30 2023-07-06T21:58:13.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.571+0000 7f2ffb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ffc0b18a0 0x7f2ffc0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:13.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.571+0000 7f2ffb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ffc0b18a0 0x7f2ffc0ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44776/0 (socket says 172.21.15.55:44776) 2023-07-06T21:58:13.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.571+0000 7f2ffbfff640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f2ffc0b3c90 0x7f2ffc0b4060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:58558/0 (socket says 172.21.15.55:58558) 2023-07-06T21:58:13.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.571+0000 7f2ffb7fe640 1 -- 172.21.15.55:0/1212349846 learned_addr learned my addr 172.21.15.55:0/1212349846 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:13.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.571+0000 7f3000f4a640 1 --2- 172.21.15.55:0/1212349846 >> v2:172.21.15.138:3300/0 conn(0x7f2ffc0d1d30 0x7f2ffc0cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:13.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.575+0000 7f2ffaffd640 1 -- 172.21.15.55:0/1212349846 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924278897 0 0) 0x7f2ffc0ccd50 con 0x7f2ffc0b3c90 2023-07-06T21:58:13.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.575+0000 7f2ffb7fe640 1 -- 172.21.15.55:0/1212349846 >> v2:172.21.15.138:3300/0 conn(0x7f2ffc0d1d30 msgr2=0x7f2ffc0cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:13.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.575+0000 7f2ffb7fe640 1 --2- 172.21.15.55:0/1212349846 >> v2:172.21.15.138:3300/0 conn(0x7f2ffc0d1d30 0x7f2ffc0cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.575+0000 7f2ffb7fe640 1 -- 172.21.15.55:0/1212349846 >> v1:172.21.15.138:6789/0 conn(0x7f2ffc0b3c90 legacy=0x7f2ffc0b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:13.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.575+0000 7f2ffb7fe640 1 -- 172.21.15.55:0/1212349846 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc06a140 con 0x7f2ffc0b18a0 2023-07-06T21:58:13.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.575+0000 7f3000f4a640 1 --2- 172.21.15.55:0/1212349846 >> v2:172.21.15.138:3300/0 conn(0x7f2ffc0d1d30 0x7f2ffc0cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:13.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.575+0000 7f2ffb7fe640 1 --2- 172.21.15.55:0/1212349846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ffc0b18a0 0x7f2ffc0ce460 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0b8360 tx=0x7f2ff001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4a31022e894194 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:13.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.575+0000 7f2ffaffd640 1 -- 172.21.15.55:0/1212349846 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00aa650 con 0x7f2ffc0b18a0 2023-07-06T21:58:13.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.575+0000 7f2ffaffd640 1 -- 172.21.15.55:0/1212349846 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff00aa7b0 con 0x7f2ffc0b18a0 2023-07-06T21:58:13.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.575+0000 7f2ffaffd640 1 -- 172.21.15.55:0/1212349846 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00aab40 con 0x7f2ffc0b18a0 2023-07-06T21:58:13.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 -- 172.21.15.55:0/1212349846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ffc0b18a0 msgr2=0x7f2ffc0ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:13.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 --2- 172.21.15.55:0/1212349846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ffc0b18a0 0x7f2ffc0ce460 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0b8360 tx=0x7f2ff001c4d0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 -- 172.21.15.55:0/1212349846 shutdown_connections 2023-07-06T21:58:13.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 --2- 172.21.15.55:0/1212349846 >> v2:172.21.15.138:3300/0 conn(0x7f2ffc0d1d30 0x7f2ffc0cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 --2- 172.21.15.55:0/1212349846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ffc0b18a0 0x7f2ffc0ce460 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 -- 172.21.15.55:0/1212349846 >> 172.21.15.55:0/1212349846 conn(0x7f2ffc06bf40 msgr2=0x7f2ffc0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:13.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 -- 172.21.15.55:0/1212349846 shutdown_connections 2023-07-06T21:58:13.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 -- 172.21.15.55:0/1212349846 wait complete. 2023-07-06T21:58:13.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 Processor -- start 2023-07-06T21:58:13.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 -- start start 2023-07-06T21:58:13.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ffc0b18a0 0x7f2ffc0c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:13.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ffc0b3c90 0x7f2ffc0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:13.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ffc0d1d30 0x7f2ffc15f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:13.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc0cbe80 con 0x7f2ffc0d1d30 2023-07-06T21:58:13.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc0b6310 con 0x7f2ffc0b3c90 2023-07-06T21:58:13.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f30029ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc0c98c0 con 0x7f2ffc0b18a0 2023-07-06T21:58:13.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f3000f4a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ffc0d1d30 0x7f2ffc15f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:13.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f3000f4a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ffc0d1d30 0x7f2ffc15f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44780/0 (socket says 172.21.15.55:44780) 2023-07-06T21:58:13.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f3000f4a640 1 -- 172.21.15.55:0/2672164579 learned_addr learned my addr 172.21.15.55:0/2672164579 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:13.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f2ffb7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ffc0b3c90 0x7f2ffc0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:13.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.579+0000 7f2ffbfff640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ffc0b18a0 0x7f2ffc0c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:13.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f3000f4a640 1 -- 172.21.15.55:0/2672164579 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ffc0b18a0 msgr2=0x7f2ffc0c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:13.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f3000f4a640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ffc0b18a0 0x7f2ffc0c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f3000f4a640 1 -- 172.21.15.55:0/2672164579 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ffc0b3c90 msgr2=0x7f2ffc0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:13.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f3000f4a640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ffc0b3c90 0x7f2ffc0b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:13.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f3000f4a640 1 -- 172.21.15.55:0/2672164579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff4009a70 con 0x7f2ffc0d1d30 2023-07-06T21:58:13.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f2ffb7fe640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ffc0b3c90 0x7f2ffc0b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:13.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f3000f4a640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ffc0d1d30 0x7f2ffc15f730 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400efc0 tx=0x7f2ff400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:13.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f2ff8ff9640 1 -- 172.21.15.55:0/2672164579 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4009cd0 con 0x7f2ffc0d1d30 2023-07-06T21:58:13.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f2ff8ff9640 1 -- 172.21.15.55:0/2672164579 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff400f040 con 0x7f2ffc0d1d30 2023-07-06T21:58:13.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f30029ad640 1 -- 172.21.15.55:0/2672164579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff00094d0 con 0x7f2ffc0d1d30 2023-07-06T21:58:13.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f2ff8ff9640 1 -- 172.21.15.55:0/2672164579 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff40039a0 con 0x7f2ffc0d1d30 2023-07-06T21:58:13.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f30029ad640 1 -- 172.21.15.55:0/2672164579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ffc0c9e80 con 0x7f2ffc0d1d30 2023-07-06T21:58:13.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f30029ad640 1 -- 172.21.15.55:0/2672164579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ffc066d60 con 0x7f2ffc0d1d30 2023-07-06T21:58:13.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f2ff8ff9640 1 -- 172.21.15.55:0/2672164579 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 39) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f2ff4014480 con 0x7f2ffc0d1d30 2023-07-06T21:58:13.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.583+0000 7f2ff8ff9640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f2fe80663f0 0x7f2fe80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:13.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.587+0000 7f2ff8ff9640 1 -- 172.21.15.55:0/2672164579 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2ff4084e10 con 0x7f2ffc0d1d30 2023-07-06T21:58:13.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.587+0000 7f2ffbfff640 1 -- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f2fe80663f0 msgr2=0x7f2fe80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/703944479 2023-07-06T21:58:13.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.587+0000 7f2ffbfff640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f2fe80663f0 0x7f2fe80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:13.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.587+0000 7f2ff8ff9640 1 -- 172.21.15.55:0/2672164579 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ff4088030 con 0x7f2ffc0d1d30 2023-07-06T21:58:13.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.767+0000 7f30029ad640 1 -- 172.21.15.55:0/2672164579 --> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ffc06ac30 con 0x7f2fe80663f0 2023-07-06T21:58:13.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.791+0000 7f2ffbfff640 1 -- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f2fe80663f0 msgr2=0x7f2fe80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/703944479 2023-07-06T21:58:13.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:13.791+0000 7f2ffbfff640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f2fe80663f0 0x7f2fe80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-06T21:58:13.885 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:13.886+0000 7f9fc1255180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:58:13.943 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:13.942+0000 7f9fc1255180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:58:13.998 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:13.998+0000 7f9fc1255180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:58:14.000 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:14.003+0000 7f40b7cd3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:58:14.062 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:14.063+0000 7f40b7cd3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:58:14.082 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:14.082+0000 7f9fc1255180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:58:14.121 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:14.123+0000 7f40b7cd3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:58:14.138 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:14.138+0000 7f9fc1255180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:58:14.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:14.195+0000 7f2ffbfff640 1 -- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f2fe80663f0 msgr2=0x7f2fe80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/703944479 2023-07-06T21:58:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:14.195+0000 7f2ffbfff640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f2fe80663f0 0x7f2fe80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-06T21:58:14.213 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:14.215+0000 7f40b7cd3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:58:14.222 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:14.222+0000 7f9fc1255180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:58:14.272 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:14.271+0000 7f40b7cd3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:58:14.277 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:14.278+0000 7f9fc1255180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:58:14.360 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:14.363+0000 7f40b7cd3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:58:14.417 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:14.418+0000 7f9fc1255180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:58:14.419 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:14.419+0000 7f40b7cd3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:58:14.475 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:14.474+0000 7f9fc1255180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:58:14.569 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:14.571+0000 7f40b7cd3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:58:14.630 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:14.631+0000 7f40b7cd3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:58:14.712 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:58:14.713 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:58:14.713 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:58:14.721 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:14.722+0000 7f9fc1255180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:58:14.854 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:14.854+0000 7f9fc1255180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:58:14.881 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:58:14.881 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:58:14.881 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:58:14.889 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:14.891+0000 7f40b7cd3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:58:14.980 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:14.978+0000 7f9fc1255180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:58:14.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:14.999+0000 7f2ffbfff640 1 -- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f2fe80663f0 msgr2=0x7f2fe80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/703944479 2023-07-06T21:58:14.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:14.999+0000 7f2ffbfff640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f2fe80663f0 0x7f2fe80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-06T21:58:15.032 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:15.035+0000 7f40b7cd3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:58:15.050 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:15.050+0000 7f9fc1255180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:58:15.165 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:15.167+0000 7f40b7cd3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:58:15.183 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:15.182+0000 7f9fc1255180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:58:15.239 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:15.239+0000 7f40b7cd3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:58:15.380 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:15.383+0000 7f40b7cd3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:58:15.713 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:15.714+0000 7f9fc1255180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:58:15.797 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:15.798+0000 7f9fc1255180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:58:15.945 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:15.946+0000 7f9fc1255180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:58:15.949 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:15.951+0000 7f40b7cd3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:58:16.028 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:16.026+0000 7f9fc1255180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:58:16.038 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.039+0000 7f40b7cd3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:58:16.193 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.195+0000 7f40b7cd3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:58:16.285 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.287+0000 7f40b7cd3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:58:16.297 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:16.298+0000 7f9fc1255180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:58:16.356 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:16.354+0000 7f9fc1255180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:58:16.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:16.419+0000 7f2ff8ff9640 1 -- 172.21.15.55:0/2672164579 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 40) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f2ff4052200 con 0x7f2ffc0d1d30 2023-07-06T21:58:16.574 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.575+0000 7f40b7cd3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:58:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:16.603+0000 7f2ffbfff640 1 -- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f2fe80663f0 msgr2=0x7f2fe80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/703944479 2023-07-06T21:58:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:16.603+0000 7f2ffbfff640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f2fe80663f0 0x7f2fe80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-07-06T21:58:16.637 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.639+0000 7f40b7cd3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:58:16.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:16.651+0000 7f2ff8ff9640 1 -- 172.21.15.55:0/2672164579 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 41) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f2ff4082ff0 con 0x7f2ffc0d1d30 2023-07-06T21:58:16.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:16.651+0000 7f2ff8ff9640 1 -- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f2fe80663f0 msgr2=0x7f2fe80688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:16.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:16.651+0000 7f2ff8ff9640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/703944479,v1:172.21.15.55:6833/703944479] conn(0x7f2fe80663f0 0x7f2fe80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:16.788 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.791+0000 7f403662a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:16.789 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.791+0000 7f403662a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:16.789 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.791+0000 7f403662a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:16.789 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.791+0000 7f403662a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:16.789 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.791+0000 7f403662a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:16.790 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.791+0000 7f403862e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:16.790 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.791+0000 7f403862e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:16.790 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.791+0000 7f403862e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:16.790 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.791+0000 7f403862e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:16.790 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:16.791+0000 7f403862e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:17.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.655+0000 7f2ff8ff9640 1 -- 172.21.15.55:0/2672164579 <== mon.0 v2:172.21.15.55:3300/0 9 ==== mgrmap(e 42) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f2ff4052ad0 con 0x7f2ffc0d1d30 2023-07-06T21:58:17.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.655+0000 7f2ff8ff9640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f2fe806edc0 0x7f2fe80711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:17.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.655+0000 7f2ff8ff9640 1 -- 172.21.15.55:0/2672164579 --> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ffc06ac30 con 0x7f2fe806edc0 2023-07-06T21:58:17.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.659+0000 7f2ffbfff640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f2fe806edc0 0x7f2fe80711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:17.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.659+0000 7f2ffbfff640 1 --2- 172.21.15.55:0/2672164579 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f2fe806edc0 0x7f2fe80711a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2fec007f80 tx=0x7f2fec007f10 comp rx=0 tx=0).ready entity=mgr.7698 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:17.672 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:17.671+0000 7f4040e3f640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-06T21:58:17.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.671+0000 7f2ff8ff9640 1 -- 172.21.15.55:0/2672164579 <== mgr.7698 v2:172.21.15.55:6832/1286790431 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f2ffc06ac30 con 0x7f2fe806edc0 2023-07-06T21:58:17.673 INFO:teuthology.orchestra.run.smithi055.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-06T21:58:17.682 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-06T21:58:17.682 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-06T21:58:17.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.831+0000 7ff0ff567640 1 Processor -- start 2023-07-06T21:58:17.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.831+0000 7ff0ff567640 1 -- start start 2023-07-06T21:58:17.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0ff567640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff0f815b850 0x7ff0f80cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:17.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0ff567640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0f80b3f80 0x7ff0f80d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:17.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0ff567640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f80b2b80 con 0x7ff0f80ccd30 2023-07-06T21:58:17.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0ff567640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f80cff30 con 0x7ff0f815b850 2023-07-06T21:58:17.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0ff567640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80b22e0 con 0x7ff0f80b3f80 2023-07-06T21:58:17.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0fd303640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff0f815b850 0x7ff0f80cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:17.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0fd303640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff0f815b850 0x7ff0f80cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44930/0 (socket says 172.21.15.55:44930) 2023-07-06T21:58:17.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0fd303640 1 -- 172.21.15.55:0/3162860670 learned_addr learned my addr 172.21.15.55:0/3162860670 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:17.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0fdb04640 1 --2- 172.21.15.55:0/3162860670 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0f80b3f80 0x7ff0f80d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:17.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0fd303640 1 -- 172.21.15.55:0/3162860670 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0f80b3f80 msgr2=0x7ff0f80d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:17.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0fd303640 1 --2- 172.21.15.55:0/3162860670 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0f80b3f80 0x7ff0f80d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:17.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0fd303640 1 -- 172.21.15.55:0/3162860670 >> v1:172.21.15.138:6789/0 conn(0x7ff0f80ccd30 legacy=0x7ff0f80b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:17.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0fd303640 1 -- 172.21.15.55:0/3162860670 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f80b25c0 con 0x7ff0f815b850 2023-07-06T21:58:17.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0fd303640 1 --2- 172.21.15.55:0/3162860670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0f815b850 0x7ff0f80cc7f0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009870 tx=0x7ff0f401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a004c36ab168939 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:17.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.835+0000 7ff0effff640 1 -- 172.21.15.55:0/3162860670 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f40ad680 con 0x7ff0f815b850 2023-07-06T21:58:17.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0effff640 1 -- 172.21.15.55:0/3162860670 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f40ad7e0 con 0x7ff0f815b850 2023-07-06T21:58:17.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0effff640 1 -- 172.21.15.55:0/3162860670 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f40adb70 con 0x7ff0f815b850 2023-07-06T21:58:17.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 -- 172.21.15.55:0/3162860670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0f815b850 msgr2=0x7ff0f80cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:17.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 --2- 172.21.15.55:0/3162860670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0f815b850 0x7ff0f80cc7f0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009870 tx=0x7ff0f401c3f0 comp rx=0 tx=0).stop 2023-07-06T21:58:17.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 -- 172.21.15.55:0/3162860670 shutdown_connections 2023-07-06T21:58:17.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 --2- 172.21.15.55:0/3162860670 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0f80b3f80 0x7ff0f80d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:17.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 --2- 172.21.15.55:0/3162860670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0f815b850 0x7ff0f80cc7f0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:17.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 -- 172.21.15.55:0/3162860670 >> 172.21.15.55:0/3162860670 conn(0x7ff0f80cec20 msgr2=0x7ff0f80cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:17.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 -- 172.21.15.55:0/3162860670 shutdown_connections 2023-07-06T21:58:17.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 -- 172.21.15.55:0/3162860670 wait complete. 2023-07-06T21:58:17.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 Processor -- start 2023-07-06T21:58:17.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 -- start start 2023-07-06T21:58:17.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0f80b3f80 0x7ff0f8152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:17.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0f80ccd30 0x7ff0f815db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:17.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0f815b850 0x7ff0f80b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:17.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f8153e80 con 0x7ff0f80b3f80 2023-07-06T21:58:17.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f8153270 con 0x7ff0f80ccd30 2023-07-06T21:58:17.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0ff567640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f8153550 con 0x7ff0f815b850 2023-07-06T21:58:17.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0fd303640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0f80b3f80 0x7ff0f8152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:17.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0fd303640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0f80b3f80 0x7ff0f8152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44942/0 (socket says 172.21.15.55:44942) 2023-07-06T21:58:17.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0fd303640 1 -- 172.21.15.55:0/1269006876 learned_addr learned my addr 172.21.15.55:0/1269006876 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:17.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0fcb02640 1 --2- 172.21.15.55:0/1269006876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0f80ccd30 0x7ff0f815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:17.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.839+0000 7ff0fdb04640 1 --2- 172.21.15.55:0/1269006876 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0f815b850 0x7ff0f80b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:17.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0fd303640 1 -- 172.21.15.55:0/1269006876 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0f815b850 msgr2=0x7ff0f80b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:17.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0fd303640 1 --2- 172.21.15.55:0/1269006876 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0f815b850 0x7ff0f80b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:17.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0fd303640 1 -- 172.21.15.55:0/1269006876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0f80ccd30 msgr2=0x7ff0f815db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:17.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0fd303640 1 --2- 172.21.15.55:0/1269006876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0f80ccd30 0x7ff0f815db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:17.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0fd303640 1 -- 172.21.15.55:0/1269006876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f40094d0 con 0x7ff0f80b3f80 2023-07-06T21:58:17.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0fd303640 1 --2- 172.21.15.55:0/1269006876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0f80b3f80 0x7ff0f8152970 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7ff0f401aaa0 tx=0x7ff0f401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:17.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0edffb640 1 -- 172.21.15.55:0/1269006876 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f40b8450 con 0x7ff0f80b3f80 2023-07-06T21:58:17.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0edffb640 1 -- 172.21.15.55:0/1269006876 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f40b85d0 con 0x7ff0f80b3f80 2023-07-06T21:58:17.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0edffb640 1 -- 172.21.15.55:0/1269006876 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f40b8980 con 0x7ff0f80b3f80 2023-07-06T21:58:17.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0ff567640 1 -- 172.21.15.55:0/1269006876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f815bda0 con 0x7ff0f80b3f80 2023-07-06T21:58:17.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0ff567640 1 -- 172.21.15.55:0/1269006876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f8152eb0 con 0x7ff0f80b3f80 2023-07-06T21:58:17.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0ff567640 1 -- 172.21.15.55:0/1269006876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f8153040 con 0x7ff0f80b3f80 2023-07-06T21:58:17.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0edffb640 1 -- 172.21.15.55:0/1269006876 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 42) v1 ==== 85513+0+0 (secure 0 0 0) 0x7ff0f40b4070 con 0x7ff0f80b3f80 2023-07-06T21:58:17.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0edffb640 1 --2- 172.21.15.55:0/1269006876 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7ff0dc066120 0x7ff0dc0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:17.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.843+0000 7ff0edffb640 1 -- 172.21.15.55:0/1269006876 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6726+0+0 (secure 0 0 0) 0x7ff0f411e2f0 con 0x7ff0f80b3f80 2023-07-06T21:58:17.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.847+0000 7ff0fcb02640 1 --2- 172.21.15.55:0/1269006876 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7ff0dc066120 0x7ff0dc0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:17.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.847+0000 7ff0fcb02640 1 --2- 172.21.15.55:0/1269006876 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7ff0dc066120 0x7ff0dc0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80cc750 tx=0x7ff0e8009040 comp rx=0 tx=0).ready entity=mgr.7698 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:17.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:17.847+0000 7ff0edffb640 1 -- 172.21.15.55:0/1269006876 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff0f40eb7f0 con 0x7ff0f80b3f80 2023-07-06T21:58:18.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.043+0000 7ff0ff567640 1 -- 172.21.15.55:0/1269006876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7ff0f8066d60 con 0x7ff0f80b3f80 2023-07-06T21:58:18.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.663+0000 7ff0edffb640 1 -- 172.21.15.55:0/1269006876 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 43) v1 ==== 85817+0+0 (secure 0 0 0) 0x7ff0f411e020 con 0x7ff0f80b3f80 2023-07-06T21:58:18.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.663+0000 7ff0edffb640 1 -- 172.21.15.55:0/1269006876 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v43) v1 ==== 93+0+0 (secure 0 0 0) 0x7ff0f40ef280 con 0x7ff0f80b3f80 2023-07-06T21:58:18.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.667+0000 7ff0ff567640 1 -- 172.21.15.55:0/1269006876 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7ff0dc066120 msgr2=0x7ff0dc0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:18.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.667+0000 7ff0ff567640 1 --2- 172.21.15.55:0/1269006876 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7ff0dc066120 0x7ff0dc0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80cc750 tx=0x7ff0e8009040 comp rx=0 tx=0).stop 2023-07-06T21:58:18.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.667+0000 7ff0ff567640 1 -- 172.21.15.55:0/1269006876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0f80b3f80 msgr2=0x7ff0f8152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:18.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.667+0000 7ff0ff567640 1 --2- 172.21.15.55:0/1269006876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0f80b3f80 0x7ff0f8152970 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7ff0f401aaa0 tx=0x7ff0f401ac30 comp rx=0 tx=0).stop 2023-07-06T21:58:18.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.667+0000 7ff0ff567640 1 -- 172.21.15.55:0/1269006876 shutdown_connections 2023-07-06T21:58:18.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.667+0000 7ff0ff567640 1 --2- 172.21.15.55:0/1269006876 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7ff0dc066120 0x7ff0dc0685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:18.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.667+0000 7ff0ff567640 1 --2- 172.21.15.55:0/1269006876 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0f815b850 0x7ff0f80b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:18.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.667+0000 7ff0ff567640 1 --2- 172.21.15.55:0/1269006876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0f80ccd30 0x7ff0f815db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:18.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.667+0000 7ff0ff567640 1 --2- 172.21.15.55:0/1269006876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0f80b3f80 0x7ff0f8152970 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:18.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.667+0000 7ff0ff567640 1 -- 172.21.15.55:0/1269006876 >> 172.21.15.55:0/1269006876 conn(0x7ff0f80cec20 msgr2=0x7ff0f80b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:18.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.667+0000 7ff0ff567640 1 -- 172.21.15.55:0/1269006876 shutdown_connections 2023-07-06T21:58:18.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:18.667+0000 7ff0ff567640 1 -- 172.21.15.55:0/1269006876 wait complete. 2023-07-06T21:58:18.690 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T21:58:18.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:58:18.760 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:58:18.815 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T21:58:18.816 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:58:18.816 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:58:18.825 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:58:18.825 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:58:18.830 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:18.829+0000 7f5e22e46180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:58:18.848 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:18.847+0000 7f8261848180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:58:18.856 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:58:19.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.043+0000 7f5b79782640 1 Processor -- start 2023-07-06T21:58:19.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.043+0000 7f5b79782640 1 -- start start 2023-07-06T21:58:19.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b79782640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b740ca450 0x7f5b7406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b79782640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5b740b3730 0x7f5b7415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b79782640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b74159cd0 con 0x7f5b740712f0 2023-07-06T21:58:19.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b79782640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b740693f0 con 0x7f5b740b3730 2023-07-06T21:58:19.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b79782640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7406aca0 con 0x7f5b740ca450 2023-07-06T21:58:19.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b72ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5b740712f0 0x7f5b740c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39798/0 (socket says 172.21.15.55:39798) 2023-07-06T21:58:19.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b72ffd640 1 -- 172.21.15.55:0/990319976 learned_addr learned my addr 172.21.15.55:0/990319976 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:19.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b737fe640 1 --2- 172.21.15.55:0/990319976 >> v2:172.21.15.138:3300/0 conn(0x7f5b740b3730 0x7f5b7415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b6bfff640 1 --2- 172.21.15.55:0/990319976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b740ca450 0x7f5b7406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b727fc640 1 -- 172.21.15.55:0/990319976 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126396591 0 0) 0x7f5b74159cd0 con 0x7f5b740712f0 2023-07-06T21:58:19.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b727fc640 1 -- 172.21.15.55:0/990319976 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b60003530 con 0x7f5b740712f0 2023-07-06T21:58:19.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b737fe640 1 -- 172.21.15.55:0/990319976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b740ca450 msgr2=0x7f5b7406a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:19.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b737fe640 1 --2- 172.21.15.55:0/990319976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b740ca450 0x7f5b7406a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b737fe640 1 -- 172.21.15.55:0/990319976 >> v1:172.21.15.55:6789/0 conn(0x7f5b740712f0 legacy=0x7f5b740c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b737fe640 1 -- 172.21.15.55:0/990319976 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b740696b0 con 0x7f5b740b3730 2023-07-06T21:58:19.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.047+0000 7f5b6bfff640 1 --2- 172.21.15.55:0/990319976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b740ca450 0x7f5b7406a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:19.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.051+0000 7f5b737fe640 1 --2- 172.21.15.55:0/990319976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b740b3730 0x7f5b7415d3e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009d90 tx=0x7f5b6c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63acd97ec344488d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:19.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.051+0000 7f5b727fc640 1 -- 172.21.15.55:0/990319976 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0a59e0 con 0x7f5b740b3730 2023-07-06T21:58:19.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.051+0000 7f5b727fc640 1 -- 172.21.15.55:0/990319976 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0a5b40 con 0x7f5b740b3730 2023-07-06T21:58:19.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.051+0000 7f5b727fc640 1 -- 172.21.15.55:0/990319976 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0ad440 con 0x7f5b740b3730 2023-07-06T21:58:19.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.051+0000 7f5b79782640 1 -- 172.21.15.55:0/990319976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b740b3730 msgr2=0x7f5b7415d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.051+0000 7f5b79782640 1 --2- 172.21.15.55:0/990319976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b740b3730 0x7f5b7415d3e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009d90 tx=0x7f5b6c01c920 comp rx=0 tx=0).stop 2023-07-06T21:58:19.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.051+0000 7f5b79782640 1 -- 172.21.15.55:0/990319976 shutdown_connections 2023-07-06T21:58:19.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.051+0000 7f5b79782640 1 --2- 172.21.15.55:0/990319976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b740b3730 0x7f5b7415d3e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.051+0000 7f5b79782640 1 --2- 172.21.15.55:0/990319976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b740ca450 0x7f5b7406a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.051+0000 7f5b79782640 1 -- 172.21.15.55:0/990319976 >> 172.21.15.55:0/990319976 conn(0x7f5b740cded0 msgr2=0x7f5b740ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:19.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.051+0000 7f5b79782640 1 -- 172.21.15.55:0/990319976 shutdown_connections 2023-07-06T21:58:19.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.051+0000 7f5b79782640 1 -- 172.21.15.55:0/990319976 wait complete. 2023-07-06T21:58:19.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.051+0000 7f5b79782640 1 Processor -- start 2023-07-06T21:58:19.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b79782640 1 -- start start 2023-07-06T21:58:19.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b79782640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b740712f0 0x7f5b740b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b79782640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b740b3730 0x7f5b74153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b79782640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b740ca450 0x7f5b7415c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b79782640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b740b2d90 con 0x7f5b740ca450 2023-07-06T21:58:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b79782640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b741530a0 con 0x7f5b740712f0 2023-07-06T21:58:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b79782640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7415a9d0 con 0x7f5b740b3730 2023-07-06T21:58:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b740ca450 0x7f5b7415c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b740ca450 0x7f5b7415c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44978/0 (socket says 172.21.15.55:44978) 2023-07-06T21:58:19.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b737fe640 1 -- 172.21.15.55:0/2689552154 learned_addr learned my addr 172.21.15.55:0/2689552154 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:19.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b72ffd640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b740712f0 0x7f5b740b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b6bfff640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b740b3730 0x7f5b74153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b737fe640 1 -- 172.21.15.55:0/2689552154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b740b3730 msgr2=0x7f5b74153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b737fe640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b740b3730 0x7f5b74153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b737fe640 1 -- 172.21.15.55:0/2689552154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b740712f0 msgr2=0x7f5b740b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b737fe640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b740712f0 0x7f5b740b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b737fe640 1 -- 172.21.15.55:0/2689552154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c009420 con 0x7f5b740ca450 2023-07-06T21:58:19.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b6bfff640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b740b3730 0x7f5b74153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b72ffd640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b740712f0 0x7f5b740b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b737fe640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b740ca450 0x7f5b7415c530 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c01a550 tx=0x7f5b6c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b6b7fe640 1 -- 172.21.15.55:0/2689552154 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0aec30 con 0x7f5b740ca450 2023-07-06T21:58:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b6b7fe640 1 -- 172.21.15.55:0/2689552154 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0aed90 con 0x7f5b740ca450 2023-07-06T21:58:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b6b7fe640 1 -- 172.21.15.55:0/2689552154 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0b7650 con 0x7f5b740ca450 2023-07-06T21:58:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b79782640 1 -- 172.21.15.55:0/2689552154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6c009a70 con 0x7f5b740ca450 2023-07-06T21:58:19.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b79782640 1 -- 172.21.15.55:0/2689552154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b74153340 con 0x7f5b740ca450 2023-07-06T21:58:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.055+0000 7f5b79782640 1 -- 172.21.15.55:0/2689552154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b74066d60 con 0x7f5b740ca450 2023-07-06T21:58:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.059+0000 7f5b6b7fe640 1 -- 172.21.15.55:0/2689552154 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 43) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f5b6c0b4050 con 0x7f5b740ca450 2023-07-06T21:58:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.059+0000 7f5b6b7fe640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f5b54066430 0x7f5b540688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.059+0000 7f5b72ffd640 1 -- 172.21.15.55:0/2689552154 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f5b54066430 msgr2=0x7f5b540688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1286790431 2023-07-06T21:58:19.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.059+0000 7f5b6b7fe640 1 -- 172.21.15.55:0/2689552154 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f5b6c11f110 con 0x7f5b740ca450 2023-07-06T21:58:19.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.059+0000 7f5b72ffd640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f5b54066430 0x7f5b540688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:19.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.063+0000 7f5b6b7fe640 1 -- 172.21.15.55:0/2689552154 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5b6c0ec080 con 0x7f5b740ca450 2023-07-06T21:58:19.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.219+0000 7f5b79782640 1 -- 172.21.15.55:0/2689552154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b74153530 con 0x7f5b740ca450 2023-07-06T21:58:19.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.223+0000 7f5b6b7fe640 1 -- 172.21.15.55:0/2689552154 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+19045 (secure 0 0 0) 0x7f5b6c0ef6a0 con 0x7f5b740ca450 2023-07-06T21:58:19.221 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:19.221 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":104,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:58:16.643436+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:57:58.092354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-07-06T21:57:59.209040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/1619591920":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/2678332066":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/3781336149":"2023-07-07T21:58:16.643406+0000","172.21.15.55:6832/703944479":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/3528659743":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/4200932499":"2023-07-07T21:58:16.643406+0000","172.21.15.55:6833/703944479":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/1766014464":"2023-07-07T21:58:16.643406+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:58:19.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.223+0000 7f5b79782640 1 -- 172.21.15.55:0/2689552154 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f5b54066430 msgr2=0x7f5b540688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:19.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.227+0000 7f5b79782640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f5b54066430 0x7f5b540688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.227+0000 7f5b79782640 1 -- 172.21.15.55:0/2689552154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b740ca450 msgr2=0x7f5b7415c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.227+0000 7f5b79782640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b740ca450 0x7f5b7415c530 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c01a550 tx=0x7f5b6c0196c0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.227+0000 7f5b79782640 1 -- 172.21.15.55:0/2689552154 shutdown_connections 2023-07-06T21:58:19.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.227+0000 7f5b79782640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f5b54066430 0x7f5b540688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.227+0000 7f5b79782640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b740ca450 0x7f5b7415c530 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.227+0000 7f5b79782640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b740b3730 0x7f5b74153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.227+0000 7f5b79782640 1 --2- 172.21.15.55:0/2689552154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b740712f0 0x7f5b740b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.227+0000 7f5b79782640 1 -- 172.21.15.55:0/2689552154 >> 172.21.15.55:0/2689552154 conn(0x7f5b740cded0 msgr2=0x7f5b740c93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.227+0000 7f5b79782640 1 -- 172.21.15.55:0/2689552154 shutdown_connections 2023-07-06T21:58:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.227+0000 7f5b79782640 1 -- 172.21.15.55:0/2689552154 wait complete. 2023-07-06T21:58:19.244 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:19.241+0000 7f5e22e46180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:58:19.245 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:57:58.092354+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:57:59.209040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:58:19.246 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:58:19.300 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:19.299+0000 7f8261848180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:58:19.392 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:19.389+0000 7f5e22e46180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:58:19.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.395+0000 7f3b5c5e9640 1 Processor -- start 2023-07-06T21:58:19.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.395+0000 7f3b5c5e9640 1 -- start start 2023-07-06T21:58:19.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b5c5e9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b5415b850 0x7f3b540cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b5c5e9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3b540ccd30 0x7f3b540b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b5c5e9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b540b2b80 con 0x7f3b540b3db0 2023-07-06T21:58:19.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b5c5e9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b540cff30 con 0x7f3b5415b850 2023-07-06T21:58:19.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b5c5e9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b540b41d0 con 0x7f3b540ccd30 2023-07-06T21:58:19.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b5a385640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b5415b850 0x7f3b540cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b5ab86640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3b540b3db0 0x7f3b5415f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39814/0 (socket says 172.21.15.55:39814) 2023-07-06T21:58:19.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b5a385640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b5415b850 0x7f3b540cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44984/0 (socket says 172.21.15.55:44984) 2023-07-06T21:58:19.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b5ab86640 1 -- 172.21.15.55:0/1275921316 learned_addr learned my addr 172.21.15.55:0/1275921316 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:19.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b59b84640 1 --2- 172.21.15.55:0/1275921316 >> v2:172.21.15.138:3300/0 conn(0x7f3b540ccd30 0x7f3b540b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b5a385640 1 -- 172.21.15.55:0/1275921316 >> v2:172.21.15.138:3300/0 conn(0x7f3b540ccd30 msgr2=0x7f3b540b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:19.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b5a385640 1 --2- 172.21.15.55:0/1275921316 >> v2:172.21.15.138:3300/0 conn(0x7f3b540ccd30 0x7f3b540b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b5a385640 1 -- 172.21.15.55:0/1275921316 >> v1:172.21.15.55:6789/0 conn(0x7f3b540b3db0 legacy=0x7f3b5415f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b59383640 1 -- 172.21.15.55:0/1275921316 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731068581 0 0) 0x7f3b540b2b80 con 0x7f3b540b3db0 2023-07-06T21:58:19.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.399+0000 7f3b5a385640 1 -- 172.21.15.55:0/1275921316 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b540b22e0 con 0x7f3b5415b850 2023-07-06T21:58:19.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.403+0000 7f3b5a385640 1 --2- 172.21.15.55:0/1275921316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5415b850 0x7f3b540cc7f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f3b540cebd0 tx=0x7f3b5001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a331610f70fd2e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:19.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.403+0000 7f3b59383640 1 -- 172.21.15.55:0/1275921316 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b500ac640 con 0x7f3b5415b850 2023-07-06T21:58:19.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.403+0000 7f3b59383640 1 -- 172.21.15.55:0/1275921316 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b500ac7a0 con 0x7f3b5415b850 2023-07-06T21:58:19.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.403+0000 7f3b59383640 1 -- 172.21.15.55:0/1275921316 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b500acb30 con 0x7f3b5415b850 2023-07-06T21:58:19.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.403+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/1275921316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5415b850 msgr2=0x7f3b540cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.403+0000 7f3b5c5e9640 1 --2- 172.21.15.55:0/1275921316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5415b850 0x7f3b540cc7f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f3b540cebd0 tx=0x7f3b5001c310 comp rx=0 tx=0).stop 2023-07-06T21:58:19.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.403+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/1275921316 shutdown_connections 2023-07-06T21:58:19.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.403+0000 7f3b5c5e9640 1 --2- 172.21.15.55:0/1275921316 >> v2:172.21.15.138:3300/0 conn(0x7f3b540ccd30 0x7f3b540b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.403+0000 7f3b5c5e9640 1 --2- 172.21.15.55:0/1275921316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5415b850 0x7f3b540cc7f0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.403+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/1275921316 >> 172.21.15.55:0/1275921316 conn(0x7f3b540cec20 msgr2=0x7f3b540cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:19.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.403+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/1275921316 shutdown_connections 2023-07-06T21:58:19.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.403+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/1275921316 wait complete. 2023-07-06T21:58:19.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5c5e9640 1 Processor -- start 2023-07-06T21:58:19.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5c5e9640 1 -- start start 2023-07-06T21:58:19.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5c5e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b540b3db0 0x7f3b54153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5c5e9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b540ccd30 0x7f3b54152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5c5e9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b5415b850 0x7f3b540cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5c5e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5415d710 con 0x7f3b540b3db0 2023-07-06T21:58:19.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5c5e9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b54152f90 con 0x7f3b540ccd30 2023-07-06T21:58:19.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5c5e9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5415d3c0 con 0x7f3b5415b850 2023-07-06T21:58:19.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5a385640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b540b3db0 0x7f3b54153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5a385640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b540b3db0 0x7f3b54153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44998/0 (socket says 172.21.15.55:44998) 2023-07-06T21:58:19.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5a385640 1 -- 172.21.15.55:0/3468368439 learned_addr learned my addr 172.21.15.55:0/3468368439 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:19.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b59b84640 1 --2- 172.21.15.55:0/3468368439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b540ccd30 0x7f3b54152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5ab86640 1 --2- 172.21.15.55:0/3468368439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b5415b850 0x7f3b540cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5a385640 1 -- 172.21.15.55:0/3468368439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b5415b850 msgr2=0x7f3b540cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5a385640 1 --2- 172.21.15.55:0/3468368439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b5415b850 0x7f3b540cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5a385640 1 -- 172.21.15.55:0/3468368439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b540ccd30 msgr2=0x7f3b54152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5a385640 1 --2- 172.21.15.55:0/3468368439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b540ccd30 0x7f3b54152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5a385640 1 -- 172.21.15.55:0/3468368439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b50009420 con 0x7f3b540b3db0 2023-07-06T21:58:19.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.407+0000 7f3b5a385640 1 --2- 172.21.15.55:0/3468368439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b540b3db0 0x7f3b54153140 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f3b500af040 tx=0x7f3b500190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:19.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.411+0000 7f3b4affd640 1 -- 172.21.15.55:0/3468368439 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b500b5610 con 0x7f3b540b3db0 2023-07-06T21:58:19.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.411+0000 7f3b4affd640 1 -- 172.21.15.55:0/3468368439 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b500b5790 con 0x7f3b540b3db0 2023-07-06T21:58:19.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.411+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/3468368439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5415bda0 con 0x7f3b540b3db0 2023-07-06T21:58:19.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.411+0000 7f3b4affd640 1 -- 172.21.15.55:0/3468368439 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b500b5b40 con 0x7f3b540b3db0 2023-07-06T21:58:19.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.411+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/3468368439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b540c8ba0 con 0x7f3b540b3db0 2023-07-06T21:58:19.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.411+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/3468368439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b54066d60 con 0x7f3b540b3db0 2023-07-06T21:58:19.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.411+0000 7f3b4affd640 1 -- 172.21.15.55:0/3468368439 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 43) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f3b500b3040 con 0x7f3b540b3db0 2023-07-06T21:58:19.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.415+0000 7f3b4affd640 1 --2- 172.21.15.55:0/3468368439 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f3b38066460 0x7f3b38068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.415+0000 7f3b4affd640 1 -- 172.21.15.55:0/3468368439 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f3b5011e460 con 0x7f3b540b3db0 2023-07-06T21:58:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.415+0000 7f3b59b84640 1 -- 172.21.15.55:0/3468368439 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f3b38066460 msgr2=0x7f3b38068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1286790431 2023-07-06T21:58:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.415+0000 7f3b59b84640 1 --2- 172.21.15.55:0/3468368439 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f3b38066460 0x7f3b38068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:19.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.419+0000 7f3b4affd640 1 -- 172.21.15.55:0/3468368439 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b500eb340 con 0x7f3b540b3db0 2023-07-06T21:58:19.467 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:19.467+0000 7f8261848180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:58:19.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.575+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/3468368439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b540b3420 con 0x7f3b540b3db0 2023-07-06T21:58:19.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.575+0000 7f3b4affd640 1 -- 172.21.15.55:0/3468368439 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b500ee960 con 0x7f3b540b3db0 2023-07-06T21:58:19.576 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:58:19.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.579+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/3468368439 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f3b38066460 msgr2=0x7f3b38068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:19.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.579+0000 7f3b5c5e9640 1 --2- 172.21.15.55:0/3468368439 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f3b38066460 0x7f3b38068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.579+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/3468368439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b540b3db0 msgr2=0x7f3b54153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.579+0000 7f3b5c5e9640 1 --2- 172.21.15.55:0/3468368439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b540b3db0 0x7f3b54153140 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f3b500af040 tx=0x7f3b500190b0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.579+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/3468368439 shutdown_connections 2023-07-06T21:58:19.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.579+0000 7f3b5c5e9640 1 --2- 172.21.15.55:0/3468368439 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f3b38066460 0x7f3b38068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.579+0000 7f3b5c5e9640 1 --2- 172.21.15.55:0/3468368439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b5415b850 0x7f3b540cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.579+0000 7f3b5c5e9640 1 --2- 172.21.15.55:0/3468368439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b540ccd30 0x7f3b54152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.579+0000 7f3b5c5e9640 1 --2- 172.21.15.55:0/3468368439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b540b3db0 0x7f3b54153140 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.579+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/3468368439 >> 172.21.15.55:0/3468368439 conn(0x7f3b540cec20 msgr2=0x7f3b540b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:19.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.579+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/3468368439 shutdown_connections 2023-07-06T21:58:19.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.579+0000 7f3b5c5e9640 1 -- 172.21.15.55:0/3468368439 wait complete. 2023-07-06T21:58:19.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:58:19.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.751+0000 7ff96d648640 1 Processor -- start 2023-07-06T21:58:19.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.751+0000 7ff96d648640 1 -- start start 2023-07-06T21:58:19.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff96d648640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff968070d70 0x7ff9680b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff96d648640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9680b1170 0x7ff96806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff96d648640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680cc030 con 0x7ff9680709a0 2023-07-06T21:58:19.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff96d648640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9680b15f0 con 0x7ff9680b1170 2023-07-06T21:58:19.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff96d648640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680cc300 con 0x7ff968070d70 2023-07-06T21:58:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff966ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff9680709a0 0x7ff9680cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39826/0 (socket says 172.21.15.55:39826) 2023-07-06T21:58:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff966ffd640 1 -- 172.21.15.55:0/2891877042 learned_addr learned my addr 172.21.15.55:0/2891877042 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff9677fe640 1 --2- 172.21.15.55:0/2891877042 >> v2:172.21.15.55:3300/0 conn(0x7ff9680b1170 0x7ff96806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff95ffff640 1 --2- 172.21.15.55:0/2891877042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff968070d70 0x7ff9680b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff9677fe640 1 -- 172.21.15.55:0/2891877042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff968070d70 msgr2=0x7ff9680b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff9677fe640 1 --2- 172.21.15.55:0/2891877042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff968070d70 0x7ff9680b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff9677fe640 1 -- 172.21.15.55:0/2891877042 >> v1:172.21.15.55:6789/0 conn(0x7ff9680709a0 legacy=0x7ff9680cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff9667fc640 1 -- 172.21.15.55:0/2891877042 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476999908 0 0) 0x7ff9680cc030 con 0x7ff9680709a0 2023-07-06T21:58:19.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff9677fe640 1 -- 172.21.15.55:0/2891877042 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680cc5e0 con 0x7ff9680b1170 2023-07-06T21:58:19.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.755+0000 7ff95ffff640 1 --2- 172.21.15.55:0/2891877042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff968070d70 0x7ff9680b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:19.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.759+0000 7ff9677fe640 1 --2- 172.21.15.55:0/2891877042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680b1170 0x7ff96806eee0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7ff960009dc0 tx=0x7ff96001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b45a66be64db99f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:19.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.759+0000 7ff9667fc640 1 -- 172.21.15.55:0/2891877042 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9600a5850 con 0x7ff9680b1170 2023-07-06T21:58:19.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.759+0000 7ff9667fc640 1 -- 172.21.15.55:0/2891877042 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9600a59b0 con 0x7ff9680b1170 2023-07-06T21:58:19.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.759+0000 7ff9667fc640 1 -- 172.21.15.55:0/2891877042 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9600a5d40 con 0x7ff9680b1170 2023-07-06T21:58:19.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.759+0000 7ff96d648640 1 -- 172.21.15.55:0/2891877042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680b1170 msgr2=0x7ff96806eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.759+0000 7ff96d648640 1 --2- 172.21.15.55:0/2891877042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680b1170 0x7ff96806eee0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7ff960009dc0 tx=0x7ff96001c8a0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.759+0000 7ff96d648640 1 -- 172.21.15.55:0/2891877042 shutdown_connections 2023-07-06T21:58:19.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.759+0000 7ff96d648640 1 --2- 172.21.15.55:0/2891877042 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff968070d70 0x7ff9680b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.759+0000 7ff96d648640 1 --2- 172.21.15.55:0/2891877042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680b1170 0x7ff96806eee0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.759+0000 7ff96d648640 1 -- 172.21.15.55:0/2891877042 >> 172.21.15.55:0/2891877042 conn(0x7ff9680cea70 msgr2=0x7ff9680ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:19.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.759+0000 7ff96d648640 1 -- 172.21.15.55:0/2891877042 shutdown_connections 2023-07-06T21:58:19.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.759+0000 7ff96d648640 1 -- 172.21.15.55:0/2891877042 wait complete. 2023-07-06T21:58:19.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff96d648640 1 Processor -- start 2023-07-06T21:58:19.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff96d648640 1 -- start start 2023-07-06T21:58:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff96d648640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680709a0 0x7ff968156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff96d648640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff968070d70 0x7ff9680adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff96d648640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9680b1170 0x7ff9680ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff96d648640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96809b750 con 0x7ff9680709a0 2023-07-06T21:58:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff96d648640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96809ba30 con 0x7ff968070d70 2023-07-06T21:58:19.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff96d648640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96809bd10 con 0x7ff9680b1170 2023-07-06T21:58:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff966ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680709a0 0x7ff968156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff966ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680709a0 0x7ff968156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45020/0 (socket says 172.21.15.55:45020) 2023-07-06T21:58:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff966ffd640 1 -- 172.21.15.55:0/1674161892 learned_addr learned my addr 172.21.15.55:0/1674161892 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff9677fe640 1 --2- 172.21.15.55:0/1674161892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9680b1170 0x7ff9680ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff95ffff640 1 --2- 172.21.15.55:0/1674161892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff968070d70 0x7ff9680adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff966ffd640 1 -- 172.21.15.55:0/1674161892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9680b1170 msgr2=0x7ff9680ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff966ffd640 1 --2- 172.21.15.55:0/1674161892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9680b1170 0x7ff9680ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff966ffd640 1 -- 172.21.15.55:0/1674161892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff968070d70 msgr2=0x7ff9680adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff966ffd640 1 --2- 172.21.15.55:0/1674161892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff968070d70 0x7ff9680adf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff966ffd640 1 -- 172.21.15.55:0/1674161892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff950009420 con 0x7ff9680709a0 2023-07-06T21:58:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff966ffd640 1 --2- 172.21.15.55:0/1674161892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680709a0 0x7ff968156c10 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7ff95800c480 tx=0x7ff95800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff95f7fe640 1 -- 172.21.15.55:0/1674161892 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9580074e0 con 0x7ff9680709a0 2023-07-06T21:58:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff95f7fe640 1 -- 172.21.15.55:0/1674161892 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff958007660 con 0x7ff9680709a0 2023-07-06T21:58:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff96d648640 1 -- 172.21.15.55:0/1674161892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff960009a70 con 0x7ff9680709a0 2023-07-06T21:58:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff95f7fe640 1 -- 172.21.15.55:0/1674161892 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958004a30 con 0x7ff9680709a0 2023-07-06T21:58:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.763+0000 7ff96d648640 1 -- 172.21.15.55:0/1674161892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96809c2d0 con 0x7ff9680709a0 2023-07-06T21:58:19.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.767+0000 7ff96d648640 1 -- 172.21.15.55:0/1674161892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff968066d60 con 0x7ff9680709a0 2023-07-06T21:58:19.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.767+0000 7ff95f7fe640 1 -- 172.21.15.55:0/1674161892 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 43) v1 ==== 85817+0+0 (secure 0 0 0) 0x7ff958004b90 con 0x7ff9680709a0 2023-07-06T21:58:19.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.767+0000 7ff95f7fe640 1 --2- 172.21.15.55:0/1674161892 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7ff948066430 0x7ff9480688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:19.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.767+0000 7ff95ffff640 1 -- 172.21.15.55:0/1674161892 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7ff948066430 msgr2=0x7ff9480688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1286790431 2023-07-06T21:58:19.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.767+0000 7ff95f7fe640 1 -- 172.21.15.55:0/1674161892 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6726+0+0 (secure 0 0 0) 0x7ff958083600 con 0x7ff9680709a0 2023-07-06T21:58:19.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.767+0000 7ff95ffff640 1 --2- 172.21.15.55:0/1674161892 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7ff948066430 0x7ff9480688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:19.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.771+0000 7ff95f7fe640 1 -- 172.21.15.55:0/1674161892 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff958050750 con 0x7ff9680709a0 2023-07-06T21:58:19.870 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:19.869+0000 7f5e22e46180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:58:19.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.927+0000 7ff96d648640 1 -- 172.21.15.55:0/1674161892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff9680c7e50 con 0x7ff9680709a0 2023-07-06T21:58:19.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.931+0000 7ff95f7fe640 1 -- 172.21.15.55:0/1674161892 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v104) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff958053d70 con 0x7ff9680709a0 2023-07-06T21:58:19.929 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:58:19.929 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:19.929+0000 7f5e22e46180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:58:19.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.931+0000 7ff96d648640 1 -- 172.21.15.55:0/1674161892 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7ff948066430 msgr2=0x7ff9480688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:19.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.931+0000 7ff96d648640 1 --2- 172.21.15.55:0/1674161892 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7ff948066430 0x7ff9480688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.931+0000 7ff96d648640 1 -- 172.21.15.55:0/1674161892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680709a0 msgr2=0x7ff968156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:19.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.931+0000 7ff96d648640 1 --2- 172.21.15.55:0/1674161892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680709a0 0x7ff968156c10 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7ff95800c480 tx=0x7ff95800c940 comp rx=0 tx=0).stop 2023-07-06T21:58:19.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.931+0000 7ff96d648640 1 -- 172.21.15.55:0/1674161892 shutdown_connections 2023-07-06T21:58:19.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.931+0000 7ff96d648640 1 --2- 172.21.15.55:0/1674161892 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7ff948066430 0x7ff9480688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.931+0000 7ff96d648640 1 --2- 172.21.15.55:0/1674161892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9680b1170 0x7ff9680ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.931+0000 7ff96d648640 1 --2- 172.21.15.55:0/1674161892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff968070d70 0x7ff9680adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.931+0000 7ff96d648640 1 --2- 172.21.15.55:0/1674161892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680709a0 0x7ff968156c10 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.931+0000 7ff96d648640 1 -- 172.21.15.55:0/1674161892 >> 172.21.15.55:0/1674161892 conn(0x7ff9680cea70 msgr2=0x7ff9680c6850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.931+0000 7ff96d648640 1 -- 172.21.15.55:0/1674161892 shutdown_connections 2023-07-06T21:58:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:19.931+0000 7ff96d648640 1 -- 172.21.15.55:0/1674161892 wait complete. 2023-07-06T21:58:19.951 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:58:19.985 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:19.985+0000 7f5e22e46180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:58:19.987 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:19.987+0000 7f8261848180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:58:20.051 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:20.051+0000 7f8261848180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:58:20.070 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:20.069+0000 7f5e22e46180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:58:20.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.099+0000 7f46a6b34640 1 Processor -- start 2023-07-06T21:58:20.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.099+0000 7f46a6b34640 1 -- start start 2023-07-06T21:58:20.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a6b34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46a00b1250 0x7f46a015f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a6b34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46a00ce200 0x7f46a00ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a6b34640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a00cc740 con 0x7f46a00d0630 2023-07-06T21:58:20.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a6b34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a00ccc90 con 0x7f46a00ce200 2023-07-06T21:58:20.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a6b34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00b29c0 con 0x7f46a00b1250 2023-07-06T21:58:20.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a6333640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46a00ce200 0x7f46a00ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:20.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a5b32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46a00b1250 0x7f46a015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:20.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a5331640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f46a00d0630 0x7f46a015f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:58592/0 (socket says 172.21.15.55:58592) 2023-07-06T21:58:20.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a5331640 1 -- 172.21.15.55:0/677989902 learned_addr learned my addr 172.21.15.55:0/677989902 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:20.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a6333640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46a00ce200 0x7f46a00ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45022/0 (socket says 172.21.15.55:45022) 2023-07-06T21:58:20.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a4b30640 1 -- 172.21.15.55:0/677989902 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910170162 0 0) 0x7f46a00cc740 con 0x7f46a00d0630 2023-07-06T21:58:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a6333640 1 -- 172.21.15.55:0/677989902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46a00b1250 msgr2=0x7f46a015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a6333640 1 --2- 172.21.15.55:0/677989902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46a00b1250 0x7f46a015f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a6333640 1 -- 172.21.15.55:0/677989902 >> v1:172.21.15.138:6789/0 conn(0x7f46a00d0630 legacy=0x7f46a015f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a6333640 1 -- 172.21.15.55:0/677989902 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00d1d10 con 0x7f46a00ce200 2023-07-06T21:58:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.103+0000 7f46a5b32640 1 --2- 172.21.15.55:0/677989902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46a00b1250 0x7f46a015f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:20.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.107+0000 7f46a6333640 1 --2- 172.21.15.55:0/677989902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46a00ce200 0x7f46a00ce680 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f4698009d90 tx=0x7f469801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9830a0bee087b12 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:20.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.107+0000 7f46a4b30640 1 -- 172.21.15.55:0/677989902 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980a5870 con 0x7f46a00ce200 2023-07-06T21:58:20.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.107+0000 7f46a4b30640 1 -- 172.21.15.55:0/677989902 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46980a59d0 con 0x7f46a00ce200 2023-07-06T21:58:20.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.107+0000 7f46a4b30640 1 -- 172.21.15.55:0/677989902 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980a5d60 con 0x7f46a00ce200 2023-07-06T21:58:20.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.107+0000 7f46a6b34640 1 -- 172.21.15.55:0/677989902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46a00ce200 msgr2=0x7f46a00ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.107+0000 7f46a6b34640 1 --2- 172.21.15.55:0/677989902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46a00ce200 0x7f46a00ce680 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f4698009d90 tx=0x7f469801c8c0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.107+0000 7f46a6b34640 1 -- 172.21.15.55:0/677989902 shutdown_connections 2023-07-06T21:58:20.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.107+0000 7f46a6b34640 1 --2- 172.21.15.55:0/677989902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46a00ce200 0x7f46a00ce680 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.107+0000 7f46a6b34640 1 --2- 172.21.15.55:0/677989902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46a00b1250 0x7f46a015f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.107+0000 7f46a6b34640 1 -- 172.21.15.55:0/677989902 >> 172.21.15.55:0/677989902 conn(0x7f46a00b3b60 msgr2=0x7f46a00b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:20.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.107+0000 7f46a6b34640 1 -- 172.21.15.55:0/677989902 shutdown_connections 2023-07-06T21:58:20.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.107+0000 7f46a6b34640 1 -- 172.21.15.55:0/677989902 wait complete. 2023-07-06T21:58:20.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a6b34640 1 Processor -- start 2023-07-06T21:58:20.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a6b34640 1 -- start start 2023-07-06T21:58:20.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a6b34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46a00b1250 0x7f46a0151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a6b34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46a00ce200 0x7f46a01569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a6b34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46a00d0630 0x7f46a00c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a6b34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a01511b0 con 0x7f46a00ce200 2023-07-06T21:58:20.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a6b34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00c8ac0 con 0x7f46a00b1250 2023-07-06T21:58:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a6b34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0156510 con 0x7f46a00d0630 2023-07-06T21:58:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a5331640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46a00ce200 0x7f46a01569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a5331640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46a00ce200 0x7f46a01569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45038/0 (socket says 172.21.15.55:45038) 2023-07-06T21:58:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a5331640 1 -- 172.21.15.55:0/1647580590 learned_addr learned my addr 172.21.15.55:0/1647580590 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a5b32640 1 --2- 172.21.15.55:0/1647580590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46a00b1250 0x7f46a0151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a6333640 1 --2- 172.21.15.55:0/1647580590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46a00d0630 0x7f46a00c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:20.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a5331640 1 -- 172.21.15.55:0/1647580590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46a00d0630 msgr2=0x7f46a00c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a5331640 1 --2- 172.21.15.55:0/1647580590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46a00d0630 0x7f46a00c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a5331640 1 -- 172.21.15.55:0/1647580590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46a00b1250 msgr2=0x7f46a0151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a5331640 1 --2- 172.21.15.55:0/1647580590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46a00b1250 0x7f46a0151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a5331640 1 -- 172.21.15.55:0/1647580590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c009420 con 0x7f46a00ce200 2023-07-06T21:58:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a5b32640 1 --2- 172.21.15.55:0/1647580590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46a00b1250 0x7f46a0151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a5331640 1 --2- 172.21.15.55:0/1647580590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46a00ce200 0x7f46a01569a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f469000c520 tx=0x7f469000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46967fc640 1 -- 172.21.15.55:0/1647580590 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46900074e0 con 0x7f46a00ce200 2023-07-06T21:58:20.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46967fc640 1 -- 172.21.15.55:0/1647580590 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4690007640 con 0x7f46a00ce200 2023-07-06T21:58:20.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a6b34640 1 -- 172.21.15.55:0/1647580590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4698009a70 con 0x7f46a00ce200 2023-07-06T21:58:20.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46967fc640 1 -- 172.21.15.55:0/1647580590 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46900049f0 con 0x7f46a00ce200 2023-07-06T21:58:20.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.111+0000 7f46a6b34640 1 -- 172.21.15.55:0/1647580590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a01561a0 con 0x7f46a00ce200 2023-07-06T21:58:20.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.115+0000 7f46a6b34640 1 -- 172.21.15.55:0/1647580590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a01566a0 con 0x7f46a00ce200 2023-07-06T21:58:20.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.115+0000 7f46967fc640 1 -- 172.21.15.55:0/1647580590 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 43) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f4690004b50 con 0x7f46a00ce200 2023-07-06T21:58:20.116 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:20.115+0000 7f8261848180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:58:20.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.115+0000 7f46967fc640 1 --2- 172.21.15.55:0/1647580590 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f4684066430 0x7f46840688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.115+0000 7f46a5b32640 1 -- 172.21.15.55:0/1647580590 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f4684066430 msgr2=0x7f46840688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1286790431 2023-07-06T21:58:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.115+0000 7f46967fc640 1 -- 172.21.15.55:0/1647580590 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f46900837d0 con 0x7f46a00ce200 2023-07-06T21:58:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.115+0000 7f46a5b32640 1 --2- 172.21.15.55:0/1647580590 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f4684066430 0x7f46840688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:20.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.119+0000 7f46967fc640 1 -- 172.21.15.55:0/1647580590 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4690050890 con 0x7f46a00ce200 2023-07-06T21:58:20.128 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:20.125+0000 7f5e22e46180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:58:20.209 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:20.211+0000 7f8261848180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:58:20.212 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:20.209+0000 7f5e22e46180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:58:20.268 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:20.265+0000 7f5e22e46180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:58:20.270 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:20.271+0000 7f8261848180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:58:20.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.279+0000 7f46a6b34640 1 -- 172.21.15.55:0/1647580590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46a004d790 con 0x7f46a00ce200 2023-07-06T21:58:20.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.279+0000 7f46967fc640 1 -- 172.21.15.55:0/1647580590 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v104) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4690018020 con 0x7f46a00ce200 2023-07-06T21:58:20.278 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:58:20.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.279+0000 7f46a6b34640 1 -- 172.21.15.55:0/1647580590 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f4684066430 msgr2=0x7f46840688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:20.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.279+0000 7f46a6b34640 1 --2- 172.21.15.55:0/1647580590 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f4684066430 0x7f46840688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.279+0000 7f46a6b34640 1 -- 172.21.15.55:0/1647580590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46a00ce200 msgr2=0x7f46a01569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.279+0000 7f46a6b34640 1 --2- 172.21.15.55:0/1647580590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46a00ce200 0x7f46a01569a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f469000c520 tx=0x7f469000c9e0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.279+0000 7f46a6b34640 1 -- 172.21.15.55:0/1647580590 shutdown_connections 2023-07-06T21:58:20.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.279+0000 7f46a6b34640 1 --2- 172.21.15.55:0/1647580590 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f4684066430 0x7f46840688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.279+0000 7f46a6b34640 1 --2- 172.21.15.55:0/1647580590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f46a00d0630 0x7f46a00c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.279+0000 7f46a6b34640 1 --2- 172.21.15.55:0/1647580590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46a00ce200 0x7f46a01569a0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.279+0000 7f46a6b34640 1 --2- 172.21.15.55:0/1647580590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f46a00b1250 0x7f46a0151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.279+0000 7f46a6b34640 1 -- 172.21.15.55:0/1647580590 >> 172.21.15.55:0/1647580590 conn(0x7f46a00b3b60 msgr2=0x7f46a00b4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:20.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.279+0000 7f46a6b34640 1 -- 172.21.15.55:0/1647580590 shutdown_connections 2023-07-06T21:58:20.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.279+0000 7f46a6b34640 1 -- 172.21.15.55:0/1647580590 wait complete. 2023-07-06T21:58:20.300 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:58:20.361 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:20.363+0000 7f8261848180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:58:20.409 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:20.409+0000 7f5e22e46180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:58:20.422 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:20.423+0000 7f8261848180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:58:20.466 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:20.465+0000 7f5e22e46180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:58:20.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.491+0000 7f4e8b937640 1 Processor -- start 2023-07-06T21:58:20.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.491+0000 7f4e8b937640 1 -- start start 2023-07-06T21:58:20.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.491+0000 7f4e8b937640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4e840b7b90 0x7f4e840d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.491+0000 7f4e8b937640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e840b5070 con 0x7f4e840cc870 2023-07-06T21:58:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.491+0000 7f4e8b937640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e84160020 con 0x7f4e840b4300 2023-07-06T21:58:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.491+0000 7f4e8b937640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e841604b0 con 0x7f4e840b7b90 2023-07-06T21:58:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.491+0000 7f4e88ed2640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4e840cc870 0x7f4e840b3bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39834/0 (socket says 172.21.15.55:39834) 2023-07-06T21:58:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.491+0000 7f4e88ed2640 1 -- 172.21.15.55:0/3580279004 learned_addr learned my addr 172.21.15.55:0/3580279004 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.491+0000 7f4e896d3640 1 --2- 172.21.15.55:0/3580279004 >> v2:172.21.15.138:3300/0 conn(0x7f4e840b7b90 0x7f4e840d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.491+0000 7f4e7bfff640 1 -- 172.21.15.55:0/3580279004 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372245159 0 0) 0x7f4e840b5070 con 0x7f4e840cc870 2023-07-06T21:58:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.491+0000 7f4e7bfff640 1 -- 172.21.15.55:0/3580279004 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e70003530 con 0x7f4e840cc870 2023-07-06T21:58:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.491+0000 7f4e896d3640 1 -- 172.21.15.55:0/3580279004 >> v1:172.21.15.138:6789/0 conn(0x7f4e840b4300 legacy=0x7f4e840b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.495+0000 7f4e896d3640 1 -- 172.21.15.55:0/3580279004 >> v1:172.21.15.55:6789/0 conn(0x7f4e840cc870 legacy=0x7f4e840b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.495+0000 7f4e896d3640 1 -- 172.21.15.55:0/3580279004 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e840cd030 con 0x7f4e840b7b90 2023-07-06T21:58:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.495+0000 7f4e896d3640 1 --2- 172.21.15.55:0/3580279004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e840b7b90 0x7f4e840d1c40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4e800097c0 tx=0x7f4e8001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=875fd8bbad9eef1a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.495+0000 7f4e7bfff640 1 -- 172.21.15.55:0/3580279004 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e800ab650 con 0x7f4e840b7b90 2023-07-06T21:58:20.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.495+0000 7f4e7bfff640 1 -- 172.21.15.55:0/3580279004 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e800ab7b0 con 0x7f4e840b7b90 2023-07-06T21:58:20.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.495+0000 7f4e7bfff640 1 -- 172.21.15.55:0/3580279004 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e800abb40 con 0x7f4e840b7b90 2023-07-06T21:58:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.495+0000 7f4e8b937640 1 -- 172.21.15.55:0/3580279004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e840b7b90 msgr2=0x7f4e840d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.495+0000 7f4e8b937640 1 --2- 172.21.15.55:0/3580279004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e840b7b90 0x7f4e840d1c40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4e800097c0 tx=0x7f4e8001c450 comp rx=0 tx=0).stop 2023-07-06T21:58:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.495+0000 7f4e8b937640 1 -- 172.21.15.55:0/3580279004 shutdown_connections 2023-07-06T21:58:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.495+0000 7f4e8b937640 1 --2- 172.21.15.55:0/3580279004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e840b7b90 0x7f4e840d1c40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.495+0000 7f4e8b937640 1 -- 172.21.15.55:0/3580279004 >> 172.21.15.55:0/3580279004 conn(0x7f4e840ceca0 msgr2=0x7f4e840cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e8b937640 1 -- 172.21.15.55:0/3580279004 shutdown_connections 2023-07-06T21:58:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e8b937640 1 -- 172.21.15.55:0/3580279004 wait complete. 2023-07-06T21:58:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e8b937640 1 Processor -- start 2023-07-06T21:58:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e8b937640 1 -- start start 2023-07-06T21:58:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e8b937640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e840b4300 0x7f4e84156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e8b937640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e840b7b90 0x7f4e840d1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e8b937640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e840cc870 0x7f4e840d1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e8b937640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e84158630 con 0x7f4e840b4300 2023-07-06T21:58:20.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e8b937640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e84158910 con 0x7f4e840b7b90 2023-07-06T21:58:20.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e8b937640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e84158bf0 con 0x7f4e840cc870 2023-07-06T21:58:20.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e896d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e840b4300 0x7f4e84156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:20.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e896d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e840b4300 0x7f4e84156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45040/0 (socket says 172.21.15.55:45040) 2023-07-06T21:58:20.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e896d3640 1 -- 172.21.15.55:0/3280433841 learned_addr learned my addr 172.21.15.55:0/3280433841 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:20.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e88ed2640 1 --2- 172.21.15.55:0/3280433841 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e840b7b90 0x7f4e840d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:20.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e89ed4640 1 --2- 172.21.15.55:0/3280433841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e840cc870 0x7f4e840d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:20.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e896d3640 1 -- 172.21.15.55:0/3280433841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e840cc870 msgr2=0x7f4e840d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e896d3640 1 --2- 172.21.15.55:0/3280433841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e840cc870 0x7f4e840d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e896d3640 1 -- 172.21.15.55:0/3280433841 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e840b7b90 msgr2=0x7f4e840d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e896d3640 1 --2- 172.21.15.55:0/3280433841 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e840b7b90 0x7f4e840d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e896d3640 1 -- 172.21.15.55:0/3280433841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e80009420 con 0x7f4e840b4300 2023-07-06T21:58:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e89ed4640 1 --2- 172.21.15.55:0/3280433841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e840cc870 0x7f4e840d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.499+0000 7f4e896d3640 1 --2- 172.21.15.55:0/3280433841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e840b4300 0x7f4e84156ed0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4e800ad040 tx=0x7f4e8001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.503+0000 7f4e79ffb640 1 -- 172.21.15.55:0/3280433841 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e800b5810 con 0x7f4e840b4300 2023-07-06T21:58:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.503+0000 7f4e79ffb640 1 -- 172.21.15.55:0/3280433841 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e800b5990 con 0x7f4e840b4300 2023-07-06T21:58:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.503+0000 7f4e8b937640 1 -- 172.21.15.55:0/3280433841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e84158ed0 con 0x7f4e840b4300 2023-07-06T21:58:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.503+0000 7f4e79ffb640 1 -- 172.21.15.55:0/3280433841 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e800b5d40 con 0x7f4e840b4300 2023-07-06T21:58:20.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.503+0000 7f4e8b937640 1 -- 172.21.15.55:0/3280433841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e84157410 con 0x7f4e840b4300 2023-07-06T21:58:20.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.503+0000 7f4e8b937640 1 -- 172.21.15.55:0/3280433841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e84066d60 con 0x7f4e840b4300 2023-07-06T21:58:20.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.503+0000 7f4e79ffb640 1 -- 172.21.15.55:0/3280433841 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 43) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f4e800bf410 con 0x7f4e840b4300 2023-07-06T21:58:20.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.503+0000 7f4e79ffb640 1 --2- 172.21.15.55:0/3280433841 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f4e68066460 0x7f4e68068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.507+0000 7f4e79ffb640 1 -- 172.21.15.55:0/3280433841 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f4e8011ef30 con 0x7f4e840b4300 2023-07-06T21:58:20.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.507+0000 7f4e88ed2640 1 -- 172.21.15.55:0/3280433841 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f4e68066460 msgr2=0x7f4e68068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1286790431 2023-07-06T21:58:20.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.507+0000 7f4e88ed2640 1 --2- 172.21.15.55:0/3280433841 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f4e68066460 0x7f4e68068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:20.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.507+0000 7f4e79ffb640 1 -- 172.21.15.55:0/3280433841 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e800ebf30 con 0x7f4e840b4300 2023-07-06T21:58:20.576 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:20.575+0000 7f8261848180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:58:20.638 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:20.639+0000 7f8261848180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:58:20.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.663+0000 7f4e8b937640 1 -- 172.21.15.55:0/3280433841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4e840b66c0 con 0x7f4e840b4300 2023-07-06T21:58:20.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.663+0000 7f4e79ffb640 1 -- 172.21.15.55:0/3280433841 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v104) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4e800ab610 con 0x7f4e840b4300 2023-07-06T21:58:20.664 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:58:20.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.667+0000 7f4e8b937640 1 -- 172.21.15.55:0/3280433841 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f4e68066460 msgr2=0x7f4e68068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.667+0000 7f4e8b937640 1 --2- 172.21.15.55:0/3280433841 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f4e68066460 0x7f4e68068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.667+0000 7f4e8b937640 1 -- 172.21.15.55:0/3280433841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e840b4300 msgr2=0x7f4e84156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.667+0000 7f4e8b937640 1 --2- 172.21.15.55:0/3280433841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e840b4300 0x7f4e84156ed0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4e800ad040 tx=0x7f4e8001ac90 comp rx=0 tx=0).stop 2023-07-06T21:58:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.667+0000 7f4e8b937640 1 -- 172.21.15.55:0/3280433841 shutdown_connections 2023-07-06T21:58:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.667+0000 7f4e8b937640 1 --2- 172.21.15.55:0/3280433841 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f4e68066460 0x7f4e68068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.667+0000 7f4e8b937640 1 --2- 172.21.15.55:0/3280433841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4e840cc870 0x7f4e840d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.667+0000 7f4e8b937640 1 --2- 172.21.15.55:0/3280433841 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e840b7b90 0x7f4e840d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.667+0000 7f4e8b937640 1 --2- 172.21.15.55:0/3280433841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e840b4300 0x7f4e84156ed0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.667+0000 7f4e8b937640 1 -- 172.21.15.55:0/3280433841 >> 172.21.15.55:0/3280433841 conn(0x7f4e840ceca0 msgr2=0x7f4e8415ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.667+0000 7f4e8b937640 1 -- 172.21.15.55:0/3280433841 shutdown_connections 2023-07-06T21:58:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.667+0000 7f4e8b937640 1 -- 172.21.15.55:0/3280433841 wait complete. 2023-07-06T21:58:20.688 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T21:58:20.707 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:58:20.707 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:58:20.707 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:58:20.715 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:20.713+0000 7f5e22e46180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:58:20.849 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:20.849+0000 7f5e22e46180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:58:20.898 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:58:20.898 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:58:20.899 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:58:20.907 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:20.907+0000 7f8261848180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:58:20.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.907+0000 7fc5f1e5c640 1 Processor -- start 2023-07-06T21:58:20.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.907+0000 7fc5f1e5c640 1 -- start start 2023-07-06T21:58:20.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5f1e5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5ec0b3870 0x7fc5ec0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5f1e5c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc5ec0d03c0 0x7fc5ec0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5f1e5c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ec0b2b80 con 0x7fc5ec15b850 2023-07-06T21:58:20.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5f1e5c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ec0cff30 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5f1e5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec0b41e0 con 0x7fc5ec0b3870 2023-07-06T21:58:20.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5eaffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5ec0b3870 0x7fc5ec0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:20.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5ebfff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc5ec0d03c0 0x7fc5ec0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:20.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5eaffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5ec0b3870 0x7fc5ec0b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:57992/0 (socket says 172.21.15.55:57992) 2023-07-06T21:58:20.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5eaffd640 1 -- 172.21.15.55:0/2207896130 learned_addr learned my addr 172.21.15.55:0/2207896130 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:20.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5ebfff640 1 -- 172.21.15.55:0/2207896130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5ec0b3870 msgr2=0x7fc5ec0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:20.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5ebfff640 1 --2- 172.21.15.55:0/2207896130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5ec0b3870 0x7fc5ec0b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5ebfff640 1 -- 172.21.15.55:0/2207896130 >> v1:172.21.15.138:6789/0 conn(0x7fc5ec15b850 legacy=0x7fc5ec0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5ebfff640 1 -- 172.21.15.55:0/2207896130 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec0b22e0 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5eaffd640 1 --2- 172.21.15.55:0/2207896130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5ec0b3870 0x7fc5ec0b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:20.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.911+0000 7fc5ea7fc640 1 -- 172.21.15.55:0/2207896130 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445942920 0 0) 0x7fc5ec0b2b80 con 0x7fc5ec15b850 2023-07-06T21:58:20.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.915+0000 7fc5ebfff640 1 --2- 172.21.15.55:0/2207896130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0d03c0 0x7fc5ec0d0820 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4009d90 tx=0x7fc5e401c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=900308442e1d8eeb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:20.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.915+0000 7fc5ea7fc640 1 -- 172.21.15.55:0/2207896130 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e40a58c0 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.915+0000 7fc5ea7fc640 1 -- 172.21.15.55:0/2207896130 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e40a5a20 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.915+0000 7fc5ea7fc640 1 -- 172.21.15.55:0/2207896130 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e40a5db0 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.915+0000 7fc5f1e5c640 1 -- 172.21.15.55:0/2207896130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0d03c0 msgr2=0x7fc5ec0d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.915+0000 7fc5f1e5c640 1 --2- 172.21.15.55:0/2207896130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0d03c0 0x7fc5ec0d0820 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4009d90 tx=0x7fc5e401c800 comp rx=0 tx=0).stop 2023-07-06T21:58:20.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.915+0000 7fc5f1e5c640 1 -- 172.21.15.55:0/2207896130 shutdown_connections 2023-07-06T21:58:20.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.915+0000 7fc5f1e5c640 1 --2- 172.21.15.55:0/2207896130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0d03c0 0x7fc5ec0d0820 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.915+0000 7fc5f1e5c640 1 --2- 172.21.15.55:0/2207896130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5ec0b3870 0x7fc5ec0b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.915+0000 7fc5f1e5c640 1 -- 172.21.15.55:0/2207896130 >> 172.21.15.55:0/2207896130 conn(0x7fc5ec0cec20 msgr2=0x7fc5ec0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:20.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.915+0000 7fc5f1e5c640 1 -- 172.21.15.55:0/2207896130 shutdown_connections 2023-07-06T21:58:20.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.915+0000 7fc5f1e5c640 1 -- 172.21.15.55:0/2207896130 wait complete. 2023-07-06T21:58:20.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.915+0000 7fc5f1e5c640 1 Processor -- start 2023-07-06T21:58:20.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.915+0000 7fc5f1e5c640 1 -- start start 2023-07-06T21:58:20.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5f1e5c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0b3870 0x7fc5ec15e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5f1e5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5ec0d03c0 0x7fc5ec1f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5f1e5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5ec15b850 0x7fc5ec1f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5f1e5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec1f47f0 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5f1e5c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec0ca970 con 0x7fc5ec0b3870 2023-07-06T21:58:20.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5f1e5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec0cac50 con 0x7fc5ec15b850 2023-07-06T21:58:20.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5eaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5ec0d03c0 0x7fc5ec1f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:20.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5eaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5ec0d03c0 0x7fc5ec1f3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45046/0 (socket says 172.21.15.55:45046) 2023-07-06T21:58:20.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5eaffd640 1 -- 172.21.15.55:0/270075596 learned_addr learned my addr 172.21.15.55:0/270075596 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:20.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5eb7fe640 1 --2- 172.21.15.55:0/270075596 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0b3870 0x7fc5ec15e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:20.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5ebfff640 1 --2- 172.21.15.55:0/270075596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5ec15b850 0x7fc5ec1f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:20.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5eaffd640 1 -- 172.21.15.55:0/270075596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5ec15b850 msgr2=0x7fc5ec1f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5eaffd640 1 --2- 172.21.15.55:0/270075596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5ec15b850 0x7fc5ec1f42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5eaffd640 1 -- 172.21.15.55:0/270075596 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0b3870 msgr2=0x7fc5ec15e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:20.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5eaffd640 1 --2- 172.21.15.55:0/270075596 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0b3870 0x7fc5ec15e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:20.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5eaffd640 1 -- 172.21.15.55:0/270075596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e00094d0 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5eb7fe640 1 --2- 172.21.15.55:0/270075596 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0b3870 0x7fc5ec15e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:20.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5eaffd640 1 --2- 172.21.15.55:0/270075596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5ec0d03c0 0x7fc5ec1f3d70 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000e930 tx=0x7fc5e000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:20.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5d3fff640 1 -- 172.21.15.55:0/270075596 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000ca00 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5d3fff640 1 -- 172.21.15.55:0/270075596 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e000cb60 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5f1e5c640 1 -- 172.21.15.55:0/270075596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e4009a70 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5d3fff640 1 -- 172.21.15.55:0/270075596 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0013470 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5f1e5c640 1 -- 172.21.15.55:0/270075596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ec1f5330 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.919+0000 7fc5d1ffb640 1 -- 172.21.15.55:0/270075596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c4005260 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.923+0000 7fc5d3fff640 1 -- 172.21.15.55:0/270075596 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 43) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fc5e00135d0 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.923+0000 7fc5d3fff640 1 --2- 172.21.15.55:0/270075596 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7fc5d8066430 0x7fc5d80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:20.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.923+0000 7fc5d3fff640 1 -- 172.21.15.55:0/270075596 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fc5e0084450 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.923+0000 7fc5eb7fe640 1 -- 172.21.15.55:0/270075596 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7fc5d8066430 msgr2=0x7fc5d80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1286790431 2023-07-06T21:58:20.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.923+0000 7fc5eb7fe640 1 --2- 172.21.15.55:0/270075596 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7fc5d8066430 0x7fc5d80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:20.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:20.931+0000 7fc5d3fff640 1 -- 172.21.15.55:0/270075596 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc5e0051500 con 0x7fc5ec0d03c0 2023-07-06T21:58:20.974 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:20.973+0000 7f5e22e46180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:58:21.043 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:21.041+0000 7f5e22e46180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:58:21.054 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:21.055+0000 7f8261848180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:58:21.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.095+0000 7fc5d1ffb640 1 -- 172.21.15.55:0/270075596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc5c4005510 con 0x7fc5ec0d03c0 2023-07-06T21:58:21.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.099+0000 7fc5d3fff640 1 -- 172.21.15.55:0/270075596 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v104) v1 ==== 80+0+468 (secure 0 0 0) 0x7fc5e0054b20 con 0x7fc5ec0d03c0 2023-07-06T21:58:21.097 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1619591920 2023-07-07T21:58:16.643406+0000 2023-07-06T21:58:21.097 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2678332066 2023-07-07T21:58:16.643406+0000 2023-07-06T21:58:21.098 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3781336149 2023-07-07T21:58:16.643406+0000 2023-07-06T21:58:21.098 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/703944479 2023-07-07T21:58:16.643406+0000 2023-07-06T21:58:21.098 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3528659743 2023-07-07T21:58:16.643406+0000 2023-07-06T21:58:21.098 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/4200932499 2023-07-07T21:58:16.643406+0000 2023-07-06T21:58:21.098 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/703944479 2023-07-07T21:58:16.643406+0000 2023-07-06T21:58:21.098 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1766014464 2023-07-07T21:58:16.643406+0000 2023-07-06T21:58:21.099 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-07-06T21:58:21.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.099+0000 7fc5d1ffb640 1 -- 172.21.15.55:0/270075596 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7fc5d8066430 msgr2=0x7fc5d80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:21.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.099+0000 7fc5d1ffb640 1 --2- 172.21.15.55:0/270075596 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7fc5d8066430 0x7fc5d80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.099+0000 7fc5d1ffb640 1 -- 172.21.15.55:0/270075596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5ec0d03c0 msgr2=0x7fc5ec1f3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.099+0000 7fc5d1ffb640 1 --2- 172.21.15.55:0/270075596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5ec0d03c0 0x7fc5ec1f3d70 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000e930 tx=0x7fc5e000edf0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.099+0000 7fc5d1ffb640 1 -- 172.21.15.55:0/270075596 shutdown_connections 2023-07-06T21:58:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.099+0000 7fc5d1ffb640 1 --2- 172.21.15.55:0/270075596 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7fc5d8066430 0x7fc5d80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.099+0000 7fc5d1ffb640 1 --2- 172.21.15.55:0/270075596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5ec15b850 0x7fc5ec1f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.099+0000 7fc5d1ffb640 1 --2- 172.21.15.55:0/270075596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5ec0d03c0 0x7fc5ec1f3d70 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.099+0000 7fc5d1ffb640 1 --2- 172.21.15.55:0/270075596 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5ec0b3870 0x7fc5ec15e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.099+0000 7fc5d1ffb640 1 -- 172.21.15.55:0/270075596 >> 172.21.15.55:0/270075596 conn(0x7fc5ec0cec20 msgr2=0x7fc5ec157720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.099+0000 7fc5d1ffb640 1 -- 172.21.15.55:0/270075596 shutdown_connections 2023-07-06T21:58:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.099+0000 7fc5d1ffb640 1 -- 172.21.15.55:0/270075596 wait complete. 2023-07-06T21:58:21.118 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T21:58:21.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:21.119 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-06T21:58:21.176 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:21.173+0000 7f5e22e46180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:58:21.177 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T21:58:21.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:21.178 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T21:58:21.188 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:58:21.188 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:58:21.193 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:21.195+0000 7f8261848180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:58:21.198 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:58:21.198 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:58:21.199 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:58:21.207 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T21:58:21.208 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:58:21.208 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:58:21.248 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:58:21.249 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:58:21.267 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:21.267+0000 7f8261848180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:58:21.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.391+0000 7faa1323a640 1 Processor -- start 2023-07-06T21:58:21.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa1323a640 1 -- start start 2023-07-06T21:58:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa1323a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0c0d0540 0x7faa0c0b5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa1323a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c0b16b0 con 0x7faa0c0d00f0 2023-07-06T21:58:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa1323a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c0b3dd0 con 0x7faa0c0b12e0 2023-07-06T21:58:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa1323a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0b3be0 con 0x7faa0c0d0540 2023-07-06T21:58:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa11a37640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faa0c0d00f0 0x7faa0c0b4f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39850/0 (socket says 172.21.15.55:39850) 2023-07-06T21:58:21.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa11a37640 1 -- 172.21.15.55:0/705133821 learned_addr learned my addr 172.21.15.55:0/705133821 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:21.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa12a39640 1 --2- 172.21.15.55:0/705133821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0c0d0540 0x7faa0c0b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:21.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa11236640 1 -- 172.21.15.55:0/705133821 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205004813 0 0) 0x7faa0c0b16b0 con 0x7faa0c0d00f0 2023-07-06T21:58:21.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa11236640 1 -- 172.21.15.55:0/705133821 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f8003530 con 0x7faa0c0d00f0 2023-07-06T21:58:21.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa11236640 1 -- 172.21.15.55:0/705133821 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660250546 0 0) 0x7faa0c0b3dd0 con 0x7faa0c0b12e0 2023-07-06T21:58:21.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa11236640 1 -- 172.21.15.55:0/705133821 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa0c0b16b0 con 0x7faa0c0b12e0 2023-07-06T21:58:21.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa12a39640 1 -- 172.21.15.55:0/705133821 >> v1:172.21.15.138:6789/0 conn(0x7faa0c0b12e0 legacy=0x7faa0c0d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:21.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa12a39640 1 -- 172.21.15.55:0/705133821 >> v1:172.21.15.55:6789/0 conn(0x7faa0c0d00f0 legacy=0x7faa0c0b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:21.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.395+0000 7faa12a39640 1 -- 172.21.15.55:0/705133821 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c0cce70 con 0x7faa0c0d0540 2023-07-06T21:58:21.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.399+0000 7faa12a39640 1 --2- 172.21.15.55:0/705133821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0c0d0540 0x7faa0c0b5640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faa04009dc0 tx=0x7faa0401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59173e37a590062c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:21.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.399+0000 7faa11236640 1 -- 172.21.15.55:0/705133821 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa040a5830 con 0x7faa0c0d0540 2023-07-06T21:58:21.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.399+0000 7faa11236640 1 -- 172.21.15.55:0/705133821 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa040a5990 con 0x7faa0c0d0540 2023-07-06T21:58:21.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.399+0000 7faa11236640 1 -- 172.21.15.55:0/705133821 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa040a5d20 con 0x7faa0c0d0540 2023-07-06T21:58:21.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.399+0000 7faa1323a640 1 -- 172.21.15.55:0/705133821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0c0d0540 msgr2=0x7faa0c0b5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:21.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.399+0000 7faa1323a640 1 --2- 172.21.15.55:0/705133821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0c0d0540 0x7faa0c0b5640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faa04009dc0 tx=0x7faa0401c970 comp rx=0 tx=0).stop 2023-07-06T21:58:21.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.399+0000 7faa1323a640 1 -- 172.21.15.55:0/705133821 shutdown_connections 2023-07-06T21:58:21.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.399+0000 7faa1323a640 1 --2- 172.21.15.55:0/705133821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0c0d0540 0x7faa0c0b5640 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.399+0000 7faa1323a640 1 -- 172.21.15.55:0/705133821 >> 172.21.15.55:0/705133821 conn(0x7faa0c0d20e0 msgr2=0x7faa0c0d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:21.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.399+0000 7faa1323a640 1 -- 172.21.15.55:0/705133821 shutdown_connections 2023-07-06T21:58:21.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.399+0000 7faa1323a640 1 -- 172.21.15.55:0/705133821 wait complete. 2023-07-06T21:58:21.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa1323a640 1 Processor -- start 2023-07-06T21:58:21.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa1323a640 1 -- start start 2023-07-06T21:58:21.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa1323a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0c0b12e0 0x7faa0c0c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:21.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa1323a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0c0d00f0 0x7faa0c145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:21.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa1323a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa0c0d0540 0x7faa0c0c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:21.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa1323a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0ca070 con 0x7faa0c0d00f0 2023-07-06T21:58:21.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa1323a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c14b330 con 0x7faa0c0d0540 2023-07-06T21:58:21.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa1323a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c14b610 con 0x7faa0c0b12e0 2023-07-06T21:58:21.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa11a37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0c0d00f0 0x7faa0c145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:21.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa12238640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0c0b12e0 0x7faa0c0c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:21.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa11a37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0c0d00f0 0x7faa0c145eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45048/0 (socket says 172.21.15.55:45048) 2023-07-06T21:58:21.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa11a37640 1 -- 172.21.15.55:0/3689554363 learned_addr learned my addr 172.21.15.55:0/3689554363 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:21.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa12a39640 1 --2- 172.21.15.55:0/3689554363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa0c0d0540 0x7faa0c0c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:21.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa11a37640 1 -- 172.21.15.55:0/3689554363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0c0b12e0 msgr2=0x7faa0c0c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:21.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa11a37640 1 --2- 172.21.15.55:0/3689554363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0c0b12e0 0x7faa0c0c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa11a37640 1 -- 172.21.15.55:0/3689554363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa0c0d0540 msgr2=0x7faa0c0c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:21.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa11a37640 1 --2- 172.21.15.55:0/3689554363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa0c0d0540 0x7faa0c0c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa11a37640 1 -- 172.21.15.55:0/3689554363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa04009a70 con 0x7faa0c0d00f0 2023-07-06T21:58:21.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa11a37640 1 --2- 172.21.15.55:0/3689554363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0c0d00f0 0x7faa0c145eb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c410 tx=0x7fa9fc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:21.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa02ffd640 1 -- 172.21.15.55:0/3689554363 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc005cf0 con 0x7faa0c0d00f0 2023-07-06T21:58:21.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa02ffd640 1 -- 172.21.15.55:0/3689554363 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc005e50 con 0x7faa0c0d00f0 2023-07-06T21:58:21.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa1323a640 1 -- 172.21.15.55:0/3689554363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0c14b8f0 con 0x7faa0c0d00f0 2023-07-06T21:58:21.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa02ffd640 1 -- 172.21.15.55:0/3689554363 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc007310 con 0x7faa0c0d00f0 2023-07-06T21:58:21.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.403+0000 7faa1323a640 1 -- 172.21.15.55:0/3689554363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c14beb0 con 0x7faa0c0d00f0 2023-07-06T21:58:21.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.407+0000 7faa1323a640 1 -- 172.21.15.55:0/3689554363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0c04d790 con 0x7faa0c0d00f0 2023-07-06T21:58:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.407+0000 7faa02ffd640 1 -- 172.21.15.55:0/3689554363 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 43) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fa9fc007470 con 0x7faa0c0d00f0 2023-07-06T21:58:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.407+0000 7faa02ffd640 1 --2- 172.21.15.55:0/3689554363 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7fa9f0066430 0x7fa9f00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.407+0000 7faa12238640 1 -- 172.21.15.55:0/3689554363 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7fa9f0066430 msgr2=0x7fa9f00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1286790431 2023-07-06T21:58:21.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.407+0000 7faa02ffd640 1 -- 172.21.15.55:0/3689554363 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fa9fc083880 con 0x7faa0c0d00f0 2023-07-06T21:58:21.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.407+0000 7faa12238640 1 --2- 172.21.15.55:0/3689554363 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7fa9f0066430 0x7fa9f00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.415+0000 7faa02ffd640 1 -- 172.21.15.55:0/3689554363 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9fc0508b0 con 0x7faa0c0d00f0 2023-07-06T21:58:21.417 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:21.419+0000 7f8261848180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:58:21.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.603+0000 7faa1323a640 1 -- 172.21.15.55:0/3689554363 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa0c14c070 con 0x7faa0c0d00f0 2023-07-06T21:58:21.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.603+0000 7faa02ffd640 1 -- 172.21.15.55:0/3689554363 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fa9fc053ed0 con 0x7faa0c0d00f0 2023-07-06T21:58:21.604 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:21.605 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2387174661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2387174661},{"type":"v1","addr":"172.21.15.138:6835","nonce":2387174661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7081,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3545643267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3545643267},{"type":"v1","addr":"172.21.15.138:6834","nonce":3545643267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7470,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1177943393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1177943393},{"type":"v1","addr":"172.21.15.55:6835","nonce":1177943393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:58:00.221256+0000","modified":"2023-07-06T21:58:03.247845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7479},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7479":{"gid":7479,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1437542997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1437542997},{"type":"v1","addr":"172.21.15.55:6837","nonce":1437542997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-06T21:58:21.605 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 40 2023-07-06T21:58:21.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.607+0000 7faa1323a640 1 -- 172.21.15.55:0/3689554363 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7fa9f0066430 msgr2=0x7fa9f00688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:21.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.607+0000 7faa1323a640 1 --2- 172.21.15.55:0/3689554363 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7fa9f0066430 0x7fa9f00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.607+0000 7faa1323a640 1 -- 172.21.15.55:0/3689554363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0c0d00f0 msgr2=0x7faa0c145eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.607+0000 7faa1323a640 1 --2- 172.21.15.55:0/3689554363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0c0d00f0 0x7faa0c145eb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c410 tx=0x7fa9fc00c8d0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.607+0000 7faa1323a640 1 -- 172.21.15.55:0/3689554363 shutdown_connections 2023-07-06T21:58:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.607+0000 7faa1323a640 1 --2- 172.21.15.55:0/3689554363 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7fa9f0066430 0x7fa9f00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.607+0000 7faa1323a640 1 --2- 172.21.15.55:0/3689554363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa0c0d0540 0x7faa0c0c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.607+0000 7faa1323a640 1 --2- 172.21.15.55:0/3689554363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0c0d00f0 0x7faa0c145eb0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.607+0000 7faa1323a640 1 --2- 172.21.15.55:0/3689554363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0c0b12e0 0x7faa0c0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.607+0000 7faa1323a640 1 -- 172.21.15.55:0/3689554363 >> 172.21.15.55:0/3689554363 conn(0x7faa0c0d20e0 msgr2=0x7faa0c156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:21.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.607+0000 7faa1323a640 1 -- 172.21.15.55:0/3689554363 shutdown_connections 2023-07-06T21:58:21.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.607+0000 7faa1323a640 1 -- 172.21.15.55:0/3689554363 wait complete. 2023-07-06T21:58:21.626 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:58:21.713 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:21.713+0000 7f5e22e46180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:58:21.799 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:21.797+0000 7f5e22e46180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:58:21.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f3818a34640 1 Processor -- start 2023-07-06T21:58:21.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f3818a34640 1 -- start start 2023-07-06T21:58:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f3818a34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38140b3730 0x7f381406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f3818a34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3814159cd0 con 0x7f38140ca450 2023-07-06T21:58:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f3818a34640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38140693f0 con 0x7f38140712f0 2023-07-06T21:58:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f3818a34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381406aca0 con 0x7f38140b3730 2023-07-06T21:58:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f3811d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f38140ca450 0x7f381415d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39858/0 (socket says 172.21.15.55:39858) 2023-07-06T21:58:21.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f3811d9b640 1 -- 172.21.15.55:0/2165429063 learned_addr learned my addr 172.21.15.55:0/2165429063 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:21.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f3812d9d640 1 --2- 172.21.15.55:0/2165429063 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38140b3730 0x7f381406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:21.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f381159a640 1 -- 172.21.15.55:0/2165429063 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168456964 0 0) 0x7f3814159cd0 con 0x7f38140ca450 2023-07-06T21:58:21.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f381159a640 1 -- 172.21.15.55:0/2165429063 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37fc003530 con 0x7f38140ca450 2023-07-06T21:58:21.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f3812d9d640 1 -- 172.21.15.55:0/2165429063 >> v1:172.21.15.138:6789/0 conn(0x7f38140712f0 legacy=0x7f38140c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:21.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f3812d9d640 1 -- 172.21.15.55:0/2165429063 >> v1:172.21.15.55:6789/0 conn(0x7f38140ca450 legacy=0x7f381415d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:21.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f381159a640 1 -- 172.21.15.55:0/2165429063 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808637784 0 0) 0x7f38140693f0 con 0x7f38140712f0 2023-07-06T21:58:21.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.815+0000 7f3812d9d640 1 -- 172.21.15.55:0/2165429063 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38140696b0 con 0x7f38140b3730 2023-07-06T21:58:21.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.819+0000 7f3812d9d640 1 --2- 172.21.15.55:0/2165429063 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38140b3730 0x7f381406a610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f380c009dc0 tx=0x7f380c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbe96b14c348879b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:21.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.819+0000 7f381159a640 1 -- 172.21.15.55:0/2165429063 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c0a5a00 con 0x7f38140b3730 2023-07-06T21:58:21.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.819+0000 7f381159a640 1 -- 172.21.15.55:0/2165429063 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c0a5b60 con 0x7f38140b3730 2023-07-06T21:58:21.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.819+0000 7f381159a640 1 -- 172.21.15.55:0/2165429063 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c0ad440 con 0x7f38140b3730 2023-07-06T21:58:21.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.819+0000 7f3818a34640 1 -- 172.21.15.55:0/2165429063 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38140b3730 msgr2=0x7f381406a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:21.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.819+0000 7f3818a34640 1 --2- 172.21.15.55:0/2165429063 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38140b3730 0x7f381406a610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f380c009dc0 tx=0x7f380c01c940 comp rx=0 tx=0).stop 2023-07-06T21:58:21.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.819+0000 7f3818a34640 1 -- 172.21.15.55:0/2165429063 shutdown_connections 2023-07-06T21:58:21.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.819+0000 7f3818a34640 1 --2- 172.21.15.55:0/2165429063 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38140b3730 0x7f381406a610 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.819+0000 7f3818a34640 1 -- 172.21.15.55:0/2165429063 >> 172.21.15.55:0/2165429063 conn(0x7f38140cded0 msgr2=0x7f38140ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:21.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.819+0000 7f3818a34640 1 -- 172.21.15.55:0/2165429063 shutdown_connections 2023-07-06T21:58:21.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.819+0000 7f3818a34640 1 -- 172.21.15.55:0/2165429063 wait complete. 2023-07-06T21:58:21.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3818a34640 1 Processor -- start 2023-07-06T21:58:21.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3818a34640 1 -- start start 2023-07-06T21:58:21.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3818a34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38140712f0 0x7f38141f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:21.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3818a34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38140b3730 0x7f381414b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:21.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3818a34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38140ca450 0x7f3814149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:21.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3818a34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38140aca70 con 0x7f38140712f0 2023-07-06T21:58:21.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3818a34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381414a0b0 con 0x7f38140ca450 2023-07-06T21:58:21.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3818a34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381414ace0 con 0x7f38140b3730 2023-07-06T21:58:21.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f381259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38140712f0 0x7f38141f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:21.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f381259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38140712f0 0x7f38141f4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45064/0 (socket says 172.21.15.55:45064) 2023-07-06T21:58:21.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f381259c640 1 -- 172.21.15.55:0/3230940843 learned_addr learned my addr 172.21.15.55:0/3230940843 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:21.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3812d9d640 1 --2- 172.21.15.55:0/3230940843 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38140ca450 0x7f3814149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:21.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3811d9b640 1 --2- 172.21.15.55:0/3230940843 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38140b3730 0x7f381414b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:21.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f381259c640 1 -- 172.21.15.55:0/3230940843 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38140b3730 msgr2=0x7f381414b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:21.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f381259c640 1 --2- 172.21.15.55:0/3230940843 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38140b3730 0x7f381414b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f381259c640 1 -- 172.21.15.55:0/3230940843 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38140ca450 msgr2=0x7f3814149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f381259c640 1 --2- 172.21.15.55:0/3230940843 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38140ca450 0x7f3814149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f381259c640 1 -- 172.21.15.55:0/3230940843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c009a70 con 0x7f38140712f0 2023-07-06T21:58:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f381259c640 1 --2- 172.21.15.55:0/3230940843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38140712f0 0x7f38141f4660 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f380400c450 tx=0x7f380400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3802ffd640 1 -- 172.21.15.55:0/3230940843 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804005480 con 0x7f38140712f0 2023-07-06T21:58:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3802ffd640 1 -- 172.21.15.55:0/3230940843 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3804003600 con 0x7f38140712f0 2023-07-06T21:58:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3802ffd640 1 -- 172.21.15.55:0/3230940843 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040039b0 con 0x7f38140712f0 2023-07-06T21:58:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3818a34640 1 -- 172.21.15.55:0/3230940843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381414a3b0 con 0x7f38140712f0 2023-07-06T21:58:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.823+0000 7f3818a34640 1 -- 172.21.15.55:0/3230940843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381414a970 con 0x7f38140712f0 2023-07-06T21:58:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.827+0000 7f3818a34640 1 -- 172.21.15.55:0/3230940843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38140b3e10 con 0x7f38140712f0 2023-07-06T21:58:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.827+0000 7f3802ffd640 1 -- 172.21.15.55:0/3230940843 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 43) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f3804003b10 con 0x7f38140712f0 2023-07-06T21:58:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.827+0000 7f3802ffd640 1 --2- 172.21.15.55:0/3230940843 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f37f4066430 0x7f37f40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.827+0000 7f3802ffd640 1 -- 172.21.15.55:0/3230940843 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f3804083750 con 0x7f38140712f0 2023-07-06T21:58:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.827+0000 7f3811d9b640 1 -- 172.21.15.55:0/3230940843 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f37f4066430 msgr2=0x7f37f40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1286790431 2023-07-06T21:58:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.827+0000 7f3811d9b640 1 --2- 172.21.15.55:0/3230940843 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f37f4066430 0x7f37f40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:21.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.831+0000 7f3802ffd640 1 -- 172.21.15.55:0/3230940843 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38140b3e10 con 0x7f38140712f0 2023-07-06T21:58:21.947 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:21.945+0000 7f5e22e46180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:58:21.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.995+0000 7f3818a34640 1 -- 172.21.15.55:0/3230940843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38140b3e10 con 0x7f38140712f0 2023-07-06T21:58:21.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.995+0000 7f3802ffd640 1 -- 172.21.15.55:0/3230940843 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+19045 (secure 0 0 0) 0x7f38140b3e10 con 0x7f38140712f0 2023-07-06T21:58:21.994 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:21.994 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":104,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:58:16.643436+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:57:58.092354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-07-06T21:57:59.209040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/1619591920":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/2678332066":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/3781336149":"2023-07-07T21:58:16.643406+0000","172.21.15.55:6832/703944479":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/3528659743":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/4200932499":"2023-07-07T21:58:16.643406+0000","172.21.15.55:6833/703944479":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/1766014464":"2023-07-07T21:58:16.643406+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:58:21.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.995+0000 7f3818a34640 1 -- 172.21.15.55:0/3230940843 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f37f4066430 msgr2=0x7f37f40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:21.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.995+0000 7f3818a34640 1 --2- 172.21.15.55:0/3230940843 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f37f4066430 0x7f37f40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.995+0000 7f3818a34640 1 -- 172.21.15.55:0/3230940843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38140712f0 msgr2=0x7f38141f4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:21.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.995+0000 7f3818a34640 1 --2- 172.21.15.55:0/3230940843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38140712f0 0x7f38141f4660 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f380400c450 tx=0x7f380400c910 comp rx=0 tx=0).stop 2023-07-06T21:58:21.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.995+0000 7f3818a34640 1 -- 172.21.15.55:0/3230940843 shutdown_connections 2023-07-06T21:58:21.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.995+0000 7f3818a34640 1 --2- 172.21.15.55:0/3230940843 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f37f4066430 0x7f37f40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.995+0000 7f3818a34640 1 --2- 172.21.15.55:0/3230940843 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38140ca450 0x7f3814149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.995+0000 7f3818a34640 1 --2- 172.21.15.55:0/3230940843 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38140b3730 0x7f381414b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.995+0000 7f3818a34640 1 --2- 172.21.15.55:0/3230940843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38140712f0 0x7f38141f4660 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:21.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.995+0000 7f3818a34640 1 -- 172.21.15.55:0/3230940843 >> 172.21.15.55:0/3230940843 conn(0x7f38140cded0 msgr2=0x7f38140c9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:21.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.995+0000 7f3818a34640 1 -- 172.21.15.55:0/3230940843 shutdown_connections 2023-07-06T21:58:21.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:21.995+0000 7f3818a34640 1 -- 172.21.15.55:0/3230940843 wait complete. 2023-07-06T21:58:21.998 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:21.999+0000 7f8261848180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:58:22.016 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:57:58.092354+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:57:59.209040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:58:22.017 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:58:22.030 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:22.029+0000 7f5e22e46180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:58:22.090 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.091+0000 7f8261848180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:58:22.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.167+0000 7f01bc4ec640 1 Processor -- start 2023-07-06T21:58:22.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.167+0000 7f01bc4ec640 1 -- start start 2023-07-06T21:58:22.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.167+0000 7f01bc4ec640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01b40b3870 0x7f01b40b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.167+0000 7f01bc4ec640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f01b40d03c0 0x7f01b40d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.167+0000 7f01bc4ec640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b40b2b80 con 0x7f01b415b850 2023-07-06T21:58:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.167+0000 7f01bc4ec640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b40cff30 con 0x7f01b40d03c0 2023-07-06T21:58:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.167+0000 7f01bc4ec640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b40b41e0 con 0x7f01b40b3870 2023-07-06T21:58:22.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.167+0000 7f01b9a87640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01b40b3870 0x7f01b40b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.167+0000 7f01baa89640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f01b40d03c0 0x7f01b40d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.167+0000 7f01b9a87640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01b40b3870 0x7f01b40b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:58028/0 (socket says 172.21.15.55:58028) 2023-07-06T21:58:22.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.167+0000 7f01b9a87640 1 -- 172.21.15.55:0/3422515044 learned_addr learned my addr 172.21.15.55:0/3422515044 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:22.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.171+0000 7f01b9a87640 1 -- 172.21.15.55:0/3422515044 >> v2:172.21.15.138:3300/0 conn(0x7f01b40d03c0 msgr2=0x7f01b40d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:22.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.171+0000 7f01b9a87640 1 --2- 172.21.15.55:0/3422515044 >> v2:172.21.15.138:3300/0 conn(0x7f01b40d03c0 0x7f01b40d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.171+0000 7f01b9a87640 1 -- 172.21.15.55:0/3422515044 >> v1:172.21.15.138:6789/0 conn(0x7f01b415b850 legacy=0x7f01b40cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:22.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.171+0000 7f01b9a87640 1 -- 172.21.15.55:0/3422515044 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b40b22e0 con 0x7f01b40b3870 2023-07-06T21:58:22.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.171+0000 7f01b9a87640 1 --2- 172.21.15.55:0/3422515044 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01b40b3870 0x7f01b40b3ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009870 tx=0x7f01a401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0a85e5578f46bbc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:22.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.171+0000 7f01b9286640 1 -- 172.21.15.55:0/3422515044 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a40ab5f0 con 0x7f01b40b3870 2023-07-06T21:58:22.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.171+0000 7f01b9286640 1 -- 172.21.15.55:0/3422515044 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a40ab750 con 0x7f01b40b3870 2023-07-06T21:58:22.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.171+0000 7f01b9286640 1 -- 172.21.15.55:0/3422515044 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a40abae0 con 0x7f01b40b3870 2023-07-06T21:58:22.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.171+0000 7f01bc4ec640 1 -- 172.21.15.55:0/3422515044 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01b40b3870 msgr2=0x7f01b40b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.171+0000 7f01bc4ec640 1 --2- 172.21.15.55:0/3422515044 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01b40b3870 0x7f01b40b3ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009870 tx=0x7f01a401c3f0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01bc4ec640 1 -- 172.21.15.55:0/3422515044 shutdown_connections 2023-07-06T21:58:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01bc4ec640 1 --2- 172.21.15.55:0/3422515044 >> v2:172.21.15.138:3300/0 conn(0x7f01b40d03c0 0x7f01b40d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01bc4ec640 1 --2- 172.21.15.55:0/3422515044 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01b40b3870 0x7f01b40b3ca0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01bc4ec640 1 -- 172.21.15.55:0/3422515044 >> 172.21.15.55:0/3422515044 conn(0x7f01b40cec20 msgr2=0x7f01b40cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01bc4ec640 1 -- 172.21.15.55:0/3422515044 shutdown_connections 2023-07-06T21:58:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01bc4ec640 1 -- 172.21.15.55:0/3422515044 wait complete. 2023-07-06T21:58:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01bc4ec640 1 Processor -- start 2023-07-06T21:58:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01bc4ec640 1 -- start start 2023-07-06T21:58:22.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01bc4ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b40b3870 0x7f01b415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01bc4ec640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01b40d03c0 0x7f01b40c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01bc4ec640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01b415b850 0x7f01b40c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01bc4ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b40cc610 con 0x7f01b40b3870 2023-07-06T21:58:22.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01bc4ec640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b415aff0 con 0x7f01b415b850 2023-07-06T21:58:22.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01bc4ec640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b40cb2d0 con 0x7f01b40d03c0 2023-07-06T21:58:22.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01ba288640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b40b3870 0x7f01b415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01ba288640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b40b3870 0x7f01b415aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45078/0 (socket says 172.21.15.55:45078) 2023-07-06T21:58:22.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01ba288640 1 -- 172.21.15.55:0/584442743 learned_addr learned my addr 172.21.15.55:0/584442743 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:22.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01b9a87640 1 --2- 172.21.15.55:0/584442743 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01b40d03c0 0x7f01b40c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01baa89640 1 --2- 172.21.15.55:0/584442743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01b415b850 0x7f01b40c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01ba288640 1 -- 172.21.15.55:0/584442743 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01b40d03c0 msgr2=0x7f01b40c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:22.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01ba288640 1 --2- 172.21.15.55:0/584442743 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01b40d03c0 0x7f01b40c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01ba288640 1 -- 172.21.15.55:0/584442743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01b415b850 msgr2=0x7f01b40c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:22.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01ba288640 1 --2- 172.21.15.55:0/584442743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01b415b850 0x7f01b40c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.175+0000 7f01ba288640 1 -- 172.21.15.55:0/584442743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40094d0 con 0x7f01b40b3870 2023-07-06T21:58:22.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.179+0000 7f01ba288640 1 --2- 172.21.15.55:0/584442743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b40b3870 0x7f01b415aab0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f01b000c500 tx=0x7f01b000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:22.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.179+0000 7f01aaffd640 1 -- 172.21.15.55:0/584442743 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0005220 con 0x7f01b40b3870 2023-07-06T21:58:22.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.179+0000 7f01aaffd640 1 -- 172.21.15.55:0/584442743 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b0005380 con 0x7f01b40b3870 2023-07-06T21:58:22.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.179+0000 7f01aaffd640 1 -- 172.21.15.55:0/584442743 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0007270 con 0x7f01b40b3870 2023-07-06T21:58:22.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.179+0000 7f01bc4ec640 1 -- 172.21.15.55:0/584442743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b40cb570 con 0x7f01b40b3870 2023-07-06T21:58:22.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.179+0000 7f01bc4ec640 1 -- 172.21.15.55:0/584442743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b40cbb30 con 0x7f01b40b3870 2023-07-06T21:58:22.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.179+0000 7f01bc4ec640 1 -- 172.21.15.55:0/584442743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b4066d60 con 0x7f01b40b3870 2023-07-06T21:58:22.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.179+0000 7f01aaffd640 1 -- 172.21.15.55:0/584442743 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 43) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f01b00073d0 con 0x7f01b40b3870 2023-07-06T21:58:22.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.179+0000 7f01aaffd640 1 --2- 172.21.15.55:0/584442743 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f0198066430 0x7f01980688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.183+0000 7f01b9a87640 1 -- 172.21.15.55:0/584442743 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f0198066430 msgr2=0x7f01980688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1286790431 2023-07-06T21:58:22.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.183+0000 7f01aaffd640 1 -- 172.21.15.55:0/584442743 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f01b0083bc0 con 0x7f01b40b3870 2023-07-06T21:58:22.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.183+0000 7f01b9a87640 1 --2- 172.21.15.55:0/584442743 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f0198066430 0x7f01980688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:22.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.187+0000 7f01aaffd640 1 -- 172.21.15.55:0/584442743 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01b0050b40 con 0x7f01b40b3870 2023-07-06T21:58:22.251 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.251+0000 7f8261848180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:58:22.298 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:22.297+0000 7f5e22e46180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:58:22.339 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.339+0000 7f8261848180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:58:22.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.343+0000 7f01bc4ec640 1 -- 172.21.15.55:0/584442743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01b40b3420 con 0x7f01b40b3870 2023-07-06T21:58:22.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.343+0000 7f01aaffd640 1 -- 172.21.15.55:0/584442743 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01b0054160 con 0x7f01b40b3870 2023-07-06T21:58:22.341 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:58:22.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.343+0000 7f01bc4ec640 1 -- 172.21.15.55:0/584442743 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f0198066430 msgr2=0x7f01980688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:22.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.343+0000 7f01bc4ec640 1 --2- 172.21.15.55:0/584442743 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f0198066430 0x7f01980688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.343+0000 7f01bc4ec640 1 -- 172.21.15.55:0/584442743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b40b3870 msgr2=0x7f01b415aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:22.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.343+0000 7f01bc4ec640 1 --2- 172.21.15.55:0/584442743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b40b3870 0x7f01b415aab0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f01b000c500 tx=0x7f01b000c9c0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.343+0000 7f01bc4ec640 1 -- 172.21.15.55:0/584442743 shutdown_connections 2023-07-06T21:58:22.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.343+0000 7f01bc4ec640 1 --2- 172.21.15.55:0/584442743 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f0198066430 0x7f01980688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.343+0000 7f01bc4ec640 1 --2- 172.21.15.55:0/584442743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01b415b850 0x7f01b40c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.343+0000 7f01bc4ec640 1 --2- 172.21.15.55:0/584442743 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01b40d03c0 0x7f01b40c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.343+0000 7f01bc4ec640 1 --2- 172.21.15.55:0/584442743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b40b3870 0x7f01b415aab0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.343+0000 7f01bc4ec640 1 -- 172.21.15.55:0/584442743 >> 172.21.15.55:0/584442743 conn(0x7f01b40cec20 msgr2=0x7f01b40cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:22.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.343+0000 7f01bc4ec640 1 -- 172.21.15.55:0/584442743 shutdown_connections 2023-07-06T21:58:22.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.343+0000 7f01bc4ec640 1 -- 172.21.15.55:0/584442743 wait complete. 2023-07-06T21:58:22.357 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:22.357+0000 7f5e22e46180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:58:22.363 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:58:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.511+0000 7f0d06cd8640 1 Processor -- start 2023-07-06T21:58:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.511+0000 7f0d06cd8640 1 -- start start 2023-07-06T21:58:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.511+0000 7f0d06cd8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0d000ca130 0x7f0d000703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.511+0000 7f0d06cd8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d000cd140 0x7f0d00070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.511+0000 7f0d06cd8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d00158c20 con 0x7f0d00158850 2023-07-06T21:58:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.511+0000 7f0d06cd8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d000b2aa0 con 0x7f0d000ca130 2023-07-06T21:58:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.511+0000 7f0d06cd8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000c8db0 con 0x7f0d000cd140 2023-07-06T21:58:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.511+0000 7f0d04a74640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0d00158850 0x7f0d000cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39862/0 (socket says 172.21.15.55:39862) 2023-07-06T21:58:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.511+0000 7f0d04a74640 1 -- 172.21.15.55:0/3993787663 learned_addr learned my addr 172.21.15.55:0/3993787663 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.511+0000 7f0cfffff640 1 --2- 172.21.15.55:0/3993787663 >> v2:172.21.15.138:3300/0 conn(0x7f0d000ca130 0x7f0d000703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.511+0000 7f0d05275640 1 --2- 172.21.15.55:0/3993787663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d000cd140 0x7f0d00070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.515+0000 7f0cff7fe640 1 -- 172.21.15.55:0/3993787663 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976948412 0 0) 0x7f0d00158c20 con 0x7f0d00158850 2023-07-06T21:58:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.515+0000 7f0cff7fe640 1 -- 172.21.15.55:0/3993787663 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cf0003530 con 0x7f0d00158850 2023-07-06T21:58:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.515+0000 7f0cfffff640 1 -- 172.21.15.55:0/3993787663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d000cd140 msgr2=0x7f0d00070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.515+0000 7f0cfffff640 1 --2- 172.21.15.55:0/3993787663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d000cd140 0x7f0d00070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.515+0000 7f0cfffff640 1 -- 172.21.15.55:0/3993787663 >> v1:172.21.15.55:6789/0 conn(0x7f0d00158850 legacy=0x7f0d000cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.515+0000 7f0cfffff640 1 -- 172.21.15.55:0/3993787663 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d000c9090 con 0x7f0d000ca130 2023-07-06T21:58:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.515+0000 7f0cfffff640 1 --2- 172.21.15.55:0/3993787663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d000ca130 0x7f0d000703e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0097c0 tx=0x7f0cec01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aee37d0af6c72b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.515+0000 7f0cff7fe640 1 -- 172.21.15.55:0/3993787663 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0a8970 con 0x7f0d000ca130 2023-07-06T21:58:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.515+0000 7f0cff7fe640 1 -- 172.21.15.55:0/3993787663 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec0a8ad0 con 0x7f0d000ca130 2023-07-06T21:58:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.515+0000 7f0cff7fe640 1 -- 172.21.15.55:0/3993787663 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0a8e40 con 0x7f0d000ca130 2023-07-06T21:58:22.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3993787663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d000ca130 msgr2=0x7f0d000703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:22.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 --2- 172.21.15.55:0/3993787663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d000ca130 0x7f0d000703e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0097c0 tx=0x7f0cec01ec70 comp rx=0 tx=0).stop 2023-07-06T21:58:22.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3993787663 shutdown_connections 2023-07-06T21:58:22.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 --2- 172.21.15.55:0/3993787663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d000cd140 0x7f0d00070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 --2- 172.21.15.55:0/3993787663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d000ca130 0x7f0d000703e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3993787663 >> 172.21.15.55:0/3993787663 conn(0x7f0d000cea70 msgr2=0x7f0d000ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:22.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3993787663 shutdown_connections 2023-07-06T21:58:22.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3993787663 wait complete. 2023-07-06T21:58:22.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 Processor -- start 2023-07-06T21:58:22.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 -- start start 2023-07-06T21:58:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d000ca130 0x7f0d00155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d000cd140 0x7f0d000af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d00158850 0x7f0d0006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d001e5f00 con 0x7f0d000ca130 2023-07-06T21:58:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d001e5280 con 0x7f0d000cd140 2023-07-06T21:58:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d06cd8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d001e5560 con 0x7f0d00158850 2023-07-06T21:58:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d04a74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d000ca130 0x7f0d00155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d04a74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d000ca130 0x7f0d00155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45094/0 (socket says 172.21.15.55:45094) 2023-07-06T21:58:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d04a74640 1 -- 172.21.15.55:0/3319116263 learned_addr learned my addr 172.21.15.55:0/3319116263 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0cfffff640 1 --2- 172.21.15.55:0/3319116263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d000cd140 0x7f0d000af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d05275640 1 --2- 172.21.15.55:0/3319116263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d00158850 0x7f0d0006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0cfffff640 1 -- 172.21.15.55:0/3319116263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d00158850 msgr2=0x7f0d0006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0cfffff640 1 --2- 172.21.15.55:0/3319116263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d00158850 0x7f0d0006eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0cfffff640 1 -- 172.21.15.55:0/3319116263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d000ca130 msgr2=0x7f0d00155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0cfffff640 1 --2- 172.21.15.55:0/3319116263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d000ca130 0x7f0d00155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0cfffff640 1 -- 172.21.15.55:0/3319116263 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec009420 con 0x7f0d000cd140 2023-07-06T21:58:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.519+0000 7f0d04a74640 1 --2- 172.21.15.55:0/3319116263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d000ca130 0x7f0d00155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.523+0000 7f0cfffff640 1 --2- 172.21.15.55:0/3319116263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d000cd140 0x7f0d000af570 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0af000 tx=0x7f0cec01ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.523+0000 7f0cfd7fa640 1 -- 172.21.15.55:0/3319116263 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec004450 con 0x7f0d000cd140 2023-07-06T21:58:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.523+0000 7f0cfd7fa640 1 -- 172.21.15.55:0/3319116263 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec003620 con 0x7f0d000cd140 2023-07-06T21:58:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.523+0000 7f0cfd7fa640 1 -- 172.21.15.55:0/3319116263 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0039b0 con 0x7f0d000cd140 2023-07-06T21:58:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.523+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3319116263 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d001e5840 con 0x7f0d000cd140 2023-07-06T21:58:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.523+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3319116263 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d00155ff0 con 0x7f0d000cd140 2023-07-06T21:58:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.523+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3319116263 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d00066d60 con 0x7f0d000cd140 2023-07-06T21:58:22.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.523+0000 7f0cfd7fa640 1 -- 172.21.15.55:0/3319116263 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 43) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f0cec0b7040 con 0x7f0d000cd140 2023-07-06T21:58:22.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.523+0000 7f0cfd7fa640 1 --2- 172.21.15.55:0/3319116263 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f0ce4066430 0x7f0ce40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.523+0000 7f0d04a74640 1 -- 172.21.15.55:0/3319116263 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f0ce4066430 msgr2=0x7f0ce40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1286790431 2023-07-06T21:58:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.523+0000 7f0cfd7fa640 1 -- 172.21.15.55:0/3319116263 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f0cec121af0 con 0x7f0d000cd140 2023-07-06T21:58:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.523+0000 7f0d04a74640 1 --2- 172.21.15.55:0/3319116263 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f0ce4066430 0x7f0ce40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:22.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.531+0000 7f0cfd7fa640 1 -- 172.21.15.55:0/3319116263 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0cec0eeaf0 con 0x7f0d000cd140 2023-07-06T21:58:22.634 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.635+0000 7f8261848180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:58:22.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.691+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3319116263 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0d0006cd30 con 0x7f0d000cd140 2023-07-06T21:58:22.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.699+0000 7f0cfd7fa640 1 -- 172.21.15.55:0/3319116263 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mgrmap(e 44) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f0cec0eeec0 con 0x7f0d000cd140 2023-07-06T21:58:22.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.699+0000 7f0cfd7fa640 1 -- 172.21.15.55:0/3319116263 <== mon.1 v2:172.21.15.138:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v104) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0cec108040 con 0x7f0d000cd140 2023-07-06T21:58:22.700 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:58:22.700 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.703+0000 7f8261848180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:58:22.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.703+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3319116263 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f0ce4066430 msgr2=0x7f0ce40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:22.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.703+0000 7f0d06cd8640 1 --2- 172.21.15.55:0/3319116263 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f0ce4066430 0x7f0ce40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.703+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3319116263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d000cd140 msgr2=0x7f0d000af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:22.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.703+0000 7f0d06cd8640 1 --2- 172.21.15.55:0/3319116263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d000cd140 0x7f0d000af570 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0af000 tx=0x7f0cec01ba10 comp rx=0 tx=0).stop 2023-07-06T21:58:22.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.703+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3319116263 shutdown_connections 2023-07-06T21:58:22.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.703+0000 7f0d06cd8640 1 --2- 172.21.15.55:0/3319116263 >> [v2:172.21.15.55:6832/1286790431,v1:172.21.15.55:6833/1286790431] conn(0x7f0ce4066430 0x7f0ce40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.703+0000 7f0d06cd8640 1 --2- 172.21.15.55:0/3319116263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d00158850 0x7f0d0006eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.703+0000 7f0d06cd8640 1 --2- 172.21.15.55:0/3319116263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d000cd140 0x7f0d000af570 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.703+0000 7f0d06cd8640 1 --2- 172.21.15.55:0/3319116263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d000ca130 0x7f0d00155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.703+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3319116263 >> 172.21.15.55:0/3319116263 conn(0x7f0d000cea70 msgr2=0x7f0d0009dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:22.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.703+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3319116263 shutdown_connections 2023-07-06T21:58:22.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.703+0000 7f0d06cd8640 1 -- 172.21.15.55:0/3319116263 wait complete. 2023-07-06T21:58:22.727 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T21:58:22.789 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.791+0000 7f81ec58f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:22.790 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.791+0000 7f81ec58f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:22.790 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.791+0000 7f81ec58f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:22.790 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.791+0000 7f81ec58f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:22.790 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.791+0000 7f81ec58f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:22.791 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.791+0000 7f81e8587640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:22.791 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.791+0000 7f81e8587640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:22.791 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.791+0000 7f81e8587640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:22.791 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.791+0000 7f81e8587640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:22.791 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:22.791+0000 7f81e8587640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:22.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.887+0000 7fda28e48640 1 Processor -- start 2023-07-06T21:58:22.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.887+0000 7fda28e48640 1 -- start start 2023-07-06T21:58:22.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.891+0000 7fda28e48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda24158850 0x7fda240cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.891+0000 7fda28e48640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fda24070af0 0x7fda240ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.891+0000 7fda28e48640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda24158c20 con 0x7fda240ca130 2023-07-06T21:58:22.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.891+0000 7fda28e48640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda240b2aa0 con 0x7fda24070af0 2023-07-06T21:58:22.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.891+0000 7fda28e48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda240c8db0 con 0x7fda24158850 2023-07-06T21:58:22.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.891+0000 7fda22d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fda24070af0 0x7fda240ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.891+0000 7fda22d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fda24070af0 0x7fda240ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45214/0 (socket says 172.21.15.55:45214) 2023-07-06T21:58:22.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.891+0000 7fda22d9d640 1 -- 172.21.15.55:0/4184358743 learned_addr learned my addr 172.21.15.55:0/4184358743 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:22.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.891+0000 7fda2259c640 1 --2- 172.21.15.55:0/4184358743 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda24158850 0x7fda240cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.891+0000 7fda22d9d640 1 -- 172.21.15.55:0/4184358743 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda24158850 msgr2=0x7fda240cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:22.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.891+0000 7fda22d9d640 1 --2- 172.21.15.55:0/4184358743 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda24158850 0x7fda240cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.891+0000 7fda22d9d640 1 -- 172.21.15.55:0/4184358743 >> v1:172.21.15.55:6789/0 conn(0x7fda240ca130 legacy=0x7fda240703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:22.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.891+0000 7fda22d9d640 1 -- 172.21.15.55:0/4184358743 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda240c9090 con 0x7fda24070af0 2023-07-06T21:58:22.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.895+0000 7fda22d9d640 1 --2- 172.21.15.55:0/4184358743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda24070af0 0x7fda240ccf70 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009e50 tx=0x7fda1c021400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171b846742b595c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:22.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.895+0000 7fda21d9b640 1 -- 172.21.15.55:0/4184358743 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0b1400 con 0x7fda24070af0 2023-07-06T21:58:22.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.895+0000 7fda21d9b640 1 -- 172.21.15.55:0/4184358743 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c0ad050 con 0x7fda24070af0 2023-07-06T21:58:22.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.895+0000 7fda21d9b640 1 -- 172.21.15.55:0/4184358743 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0b1780 con 0x7fda24070af0 2023-07-06T21:58:22.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.895+0000 7fda28e48640 1 -- 172.21.15.55:0/4184358743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda24070af0 msgr2=0x7fda240ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:22.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.895+0000 7fda28e48640 1 --2- 172.21.15.55:0/4184358743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda24070af0 0x7fda240ccf70 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009e50 tx=0x7fda1c021400 comp rx=0 tx=0).stop 2023-07-06T21:58:22.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.895+0000 7fda28e48640 1 -- 172.21.15.55:0/4184358743 shutdown_connections 2023-07-06T21:58:22.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.895+0000 7fda28e48640 1 --2- 172.21.15.55:0/4184358743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda24070af0 0x7fda240ccf70 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.895+0000 7fda28e48640 1 --2- 172.21.15.55:0/4184358743 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda24158850 0x7fda240cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.895+0000 7fda28e48640 1 -- 172.21.15.55:0/4184358743 >> 172.21.15.55:0/4184358743 conn(0x7fda240cea70 msgr2=0x7fda240ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:22.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.895+0000 7fda28e48640 1 -- 172.21.15.55:0/4184358743 shutdown_connections 2023-07-06T21:58:22.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.895+0000 7fda28e48640 1 -- 172.21.15.55:0/4184358743 wait complete. 2023-07-06T21:58:22.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.895+0000 7fda28e48640 1 Processor -- start 2023-07-06T21:58:22.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.895+0000 7fda28e48640 1 -- start start 2023-07-06T21:58:22.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda28e48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda24070af0 0x7fda240c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda28e48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda240ca130 0x7fda2406bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda28e48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda24158850 0x7fda2406c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:22.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda28e48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2414ace0 con 0x7fda24158850 2023-07-06T21:58:22.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda28e48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2406c900 con 0x7fda24070af0 2023-07-06T21:58:22.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda28e48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2414a690 con 0x7fda240ca130 2023-07-06T21:58:22.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda22d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda24158850 0x7fda2406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda22d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda24158850 0x7fda2406c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45226/0 (socket says 172.21.15.55:45226) 2023-07-06T21:58:22.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda22d9d640 1 -- 172.21.15.55:0/1969893776 learned_addr learned my addr 172.21.15.55:0/1969893776 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:22.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda2259c640 1 --2- 172.21.15.55:0/1969893776 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda24070af0 0x7fda240c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda1bfff640 1 --2- 172.21.15.55:0/1969893776 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda240ca130 0x7fda2406bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:22.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda22d9d640 1 -- 172.21.15.55:0/1969893776 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda240ca130 msgr2=0x7fda2406bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:22.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda22d9d640 1 --2- 172.21.15.55:0/1969893776 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda240ca130 0x7fda2406bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda22d9d640 1 -- 172.21.15.55:0/1969893776 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda24070af0 msgr2=0x7fda240c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:22.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda22d9d640 1 --2- 172.21.15.55:0/1969893776 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda24070af0 0x7fda240c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:22.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda22d9d640 1 -- 172.21.15.55:0/1969893776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c009b30 con 0x7fda24158850 2023-07-06T21:58:22.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda2259c640 1 --2- 172.21.15.55:0/1969893776 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda24070af0 0x7fda240c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:22.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda22d9d640 1 --2- 172.21.15.55:0/1969893776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda24158850 0x7fda2406c280 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fda1c01f030 tx=0x7fda1c01e1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:22.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda1affd640 1 -- 172.21.15.55:0/1969893776 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0b1d10 con 0x7fda24158850 2023-07-06T21:58:22.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda1affd640 1 -- 172.21.15.55:0/1969893776 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c00e150 con 0x7fda24158850 2023-07-06T21:58:22.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda1affd640 1 -- 172.21.15.55:0/1969893776 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0bc680 con 0x7fda24158850 2023-07-06T21:58:22.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda28e48640 1 -- 172.21.15.55:0/1969893776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2414a970 con 0x7fda24158850 2023-07-06T21:58:22.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda28e48640 1 -- 172.21.15.55:0/1969893776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda24069620 con 0x7fda24158850 2023-07-06T21:58:22.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.899+0000 7fda28e48640 1 -- 172.21.15.55:0/1969893776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2414ae50 con 0x7fda24158850 2023-07-06T21:58:22.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.903+0000 7fda1affd640 1 -- 172.21.15.55:0/1969893776 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fda1c0bb3e0 con 0x7fda24158850 2023-07-06T21:58:22.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.903+0000 7fda1affd640 1 -- 172.21.15.55:0/1969893776 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7113+0+0 (secure 0 0 0) 0x7fda1c1213e0 con 0x7fda24158850 2023-07-06T21:58:22.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:22.907+0000 7fda1affd640 1 -- 172.21.15.55:0/1969893776 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda1c0ee880 con 0x7fda24158850 2023-07-06T21:58:23.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.059+0000 7fda28e48640 1 -- 172.21.15.55:0/1969893776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda24066d60 con 0x7fda24158850 2023-07-06T21:58:23.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.059+0000 7fda1affd640 1 -- 172.21.15.55:0/1969893776 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v105) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda1c009510 con 0x7fda24158850 2023-07-06T21:58:23.061 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T21:58:23.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.063+0000 7fda28e48640 1 -- 172.21.15.55:0/1969893776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda24158850 msgr2=0x7fda2406c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.063+0000 7fda28e48640 1 --2- 172.21.15.55:0/1969893776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda24158850 0x7fda2406c280 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fda1c01f030 tx=0x7fda1c01e1a0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.063+0000 7fda28e48640 1 -- 172.21.15.55:0/1969893776 shutdown_connections 2023-07-06T21:58:23.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.063+0000 7fda28e48640 1 --2- 172.21.15.55:0/1969893776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda24158850 0x7fda2406c280 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.063+0000 7fda28e48640 1 --2- 172.21.15.55:0/1969893776 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda240ca130 0x7fda2406bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.063+0000 7fda28e48640 1 --2- 172.21.15.55:0/1969893776 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda24070af0 0x7fda240c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.063+0000 7fda28e48640 1 -- 172.21.15.55:0/1969893776 >> 172.21.15.55:0/1969893776 conn(0x7fda240cea70 msgr2=0x7fda2409da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:23.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.063+0000 7fda28e48640 1 -- 172.21.15.55:0/1969893776 shutdown_connections 2023-07-06T21:58:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.063+0000 7fda28e48640 1 -- 172.21.15.55:0/1969893776 wait complete. 2023-07-06T21:58:23.081 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T21:58:23.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f85a667b640 1 Processor -- start 2023-07-06T21:58:23.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f85a667b640 1 -- start start 2023-07-06T21:58:23.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f85a667b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85a006f470 0x7f85a00c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f85a667b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f85a006ff50 0x7f85a00cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f85a667b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a0070350 con 0x7f85a00c9360 2023-07-06T21:58:23.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f85a667b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a0158550 con 0x7f85a006ff50 2023-07-06T21:58:23.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f85a667b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00c9800 con 0x7f85a006f470 2023-07-06T21:58:23.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f8597fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f85a00c9360 0x7f85a006f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58480/0 (socket says 172.21.15.55:58480) 2023-07-06T21:58:23.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f8597fff640 1 -- 172.21.15.55:0/2719133115 learned_addr learned my addr 172.21.15.55:0/2719133115 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:23.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f859ffff640 1 --2- 172.21.15.55:0/2719133115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85a006f470 0x7f85a00c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f85a4c18640 1 --2- 172.21.15.55:0/2719133115 >> v2:172.21.15.138:3300/0 conn(0x7f85a006ff50 0x7f85a00cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f859f7fe640 1 -- 172.21.15.55:0/2719133115 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437324447 0 0) 0x7f85a0070350 con 0x7f85a00c9360 2023-07-06T21:58:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f859ffff640 1 -- 172.21.15.55:0/2719133115 >> v2:172.21.15.138:3300/0 conn(0x7f85a006ff50 msgr2=0x7f85a00cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f859ffff640 1 --2- 172.21.15.55:0/2719133115 >> v2:172.21.15.138:3300/0 conn(0x7f85a006ff50 0x7f85a00cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f859ffff640 1 -- 172.21.15.55:0/2719133115 >> v1:172.21.15.55:6789/0 conn(0x7f85a00c9360 legacy=0x7f85a006f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.227+0000 7f859ffff640 1 -- 172.21.15.55:0/2719133115 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a00c9ae0 con 0x7f85a006f470 2023-07-06T21:58:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.231+0000 7f859ffff640 1 --2- 172.21.15.55:0/2719133115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85a006f470 0x7f85a00c8e20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f85900097c0 tx=0x7f859001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e8cd68aa6a9321 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.231+0000 7f859f7fe640 1 -- 172.21.15.55:0/2719133115 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900ab600 con 0x7f85a006f470 2023-07-06T21:58:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.231+0000 7f859f7fe640 1 -- 172.21.15.55:0/2719133115 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85900a7050 con 0x7f85a006f470 2023-07-06T21:58:23.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.231+0000 7f859f7fe640 1 -- 172.21.15.55:0/2719133115 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900ab980 con 0x7f85a006f470 2023-07-06T21:58:23.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.231+0000 7f85a667b640 1 -- 172.21.15.55:0/2719133115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85a006f470 msgr2=0x7f85a00c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.231+0000 7f85a667b640 1 --2- 172.21.15.55:0/2719133115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85a006f470 0x7f85a00c8e20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f85900097c0 tx=0x7f859001c450 comp rx=0 tx=0).stop 2023-07-06T21:58:23.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.231+0000 7f85a667b640 1 -- 172.21.15.55:0/2719133115 shutdown_connections 2023-07-06T21:58:23.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.231+0000 7f85a667b640 1 --2- 172.21.15.55:0/2719133115 >> v2:172.21.15.138:3300/0 conn(0x7f85a006ff50 0x7f85a00cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.231+0000 7f85a667b640 1 --2- 172.21.15.55:0/2719133115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85a006f470 0x7f85a00c8e20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.231+0000 7f85a667b640 1 -- 172.21.15.55:0/2719133115 >> 172.21.15.55:0/2719133115 conn(0x7f85a00cea70 msgr2=0x7f85a00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:23.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.231+0000 7f85a667b640 1 -- 172.21.15.55:0/2719133115 shutdown_connections 2023-07-06T21:58:23.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.231+0000 7f85a667b640 1 -- 172.21.15.55:0/2719133115 wait complete. 2023-07-06T21:58:23.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f85a667b640 1 Processor -- start 2023-07-06T21:58:23.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f85a667b640 1 -- start start 2023-07-06T21:58:23.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f85a667b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85a006f470 0x7f85a00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f85a667b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a006ff50 0x7f85a014f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f85a667b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85a00c9360 0x7f85a0157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f85a667b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a014fad0 con 0x7f85a006ff50 2023-07-06T21:58:23.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f85a667b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0151e30 con 0x7f85a006f470 2023-07-06T21:58:23.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f85a667b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0157c50 con 0x7f85a00c9360 2023-07-06T21:58:23.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f8597fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a006ff50 0x7f85a014f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f8597fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a006ff50 0x7f85a014f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33166/0 (socket says 172.21.15.55:33166) 2023-07-06T21:58:23.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f8597fff640 1 -- 172.21.15.55:0/395015393 learned_addr learned my addr 172.21.15.55:0/395015393 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:23.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f859ffff640 1 --2- 172.21.15.55:0/395015393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85a006f470 0x7f85a00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f85a4c18640 1 --2- 172.21.15.55:0/395015393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85a00c9360 0x7f85a0157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f8597fff640 1 -- 172.21.15.55:0/395015393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85a00c9360 msgr2=0x7f85a0157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f8597fff640 1 --2- 172.21.15.55:0/395015393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85a00c9360 0x7f85a0157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f8597fff640 1 -- 172.21.15.55:0/395015393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85a006f470 msgr2=0x7f85a00b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f8597fff640 1 --2- 172.21.15.55:0/395015393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85a006f470 0x7f85a00b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f8597fff640 1 -- 172.21.15.55:0/395015393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8590009420 con 0x7f85a006ff50 2023-07-06T21:58:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f859ffff640 1 --2- 172.21.15.55:0/395015393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85a006f470 0x7f85a00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:23.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f8597fff640 1 --2- 172.21.15.55:0/395015393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a006ff50 0x7f85a014f590 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f858800c450 tx=0x7f858800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:23.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f859d7fa640 1 -- 172.21.15.55:0/395015393 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85880074e0 con 0x7f85a006ff50 2023-07-06T21:58:23.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f859d7fa640 1 -- 172.21.15.55:0/395015393 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8588007640 con 0x7f85a006ff50 2023-07-06T21:58:23.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f85a667b640 1 -- 172.21.15.55:0/395015393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a014fd00 con 0x7f85a006ff50 2023-07-06T21:58:23.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f859d7fa640 1 -- 172.21.15.55:0/395015393 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85880049f0 con 0x7f85a006ff50 2023-07-06T21:58:23.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.235+0000 7f85a667b640 1 -- 172.21.15.55:0/395015393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a01502c0 con 0x7f85a006ff50 2023-07-06T21:58:23.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.239+0000 7f85a667b640 1 -- 172.21.15.55:0/395015393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a0066d60 con 0x7f85a006ff50 2023-07-06T21:58:23.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.239+0000 7f859d7fa640 1 -- 172.21.15.55:0/395015393 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f8588004b50 con 0x7f85a006ff50 2023-07-06T21:58:23.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.239+0000 7f859d7fa640 1 -- 172.21.15.55:0/395015393 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7113+0+0 (secure 0 0 0) 0x7f8588083230 con 0x7f85a006ff50 2023-07-06T21:58:23.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.243+0000 7f859d7fa640 1 -- 172.21.15.55:0/395015393 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8588050420 con 0x7f85a006ff50 2023-07-06T21:58:23.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.395+0000 7f85a667b640 1 -- 172.21.15.55:0/395015393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f85a00cd240 con 0x7f85a006ff50 2023-07-06T21:58:23.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.395+0000 7f859d7fa640 1 -- 172.21.15.55:0/395015393 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v105) v1 ==== 100+0+11 (secure 0 0 0) 0x7f85880180a0 con 0x7f85a006ff50 2023-07-06T21:58:23.396 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T21:58:23.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.399+0000 7f85a667b640 1 -- 172.21.15.55:0/395015393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a006ff50 msgr2=0x7f85a014f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.399+0000 7f85a667b640 1 --2- 172.21.15.55:0/395015393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a006ff50 0x7f85a014f590 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f858800c450 tx=0x7f858800c910 comp rx=0 tx=0).stop 2023-07-06T21:58:23.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.399+0000 7f85a667b640 1 -- 172.21.15.55:0/395015393 shutdown_connections 2023-07-06T21:58:23.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.399+0000 7f85a667b640 1 --2- 172.21.15.55:0/395015393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85a00c9360 0x7f85a0157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.399+0000 7f85a667b640 1 --2- 172.21.15.55:0/395015393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a006ff50 0x7f85a014f590 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.399+0000 7f85a667b640 1 --2- 172.21.15.55:0/395015393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85a006f470 0x7f85a00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.399+0000 7f85a667b640 1 -- 172.21.15.55:0/395015393 >> 172.21.15.55:0/395015393 conn(0x7f85a00cea70 msgr2=0x7f85a00ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:23.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.399+0000 7f85a667b640 1 -- 172.21.15.55:0/395015393 shutdown_connections 2023-07-06T21:58:23.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.399+0000 7f85a667b640 1 -- 172.21.15.55:0/395015393 wait complete. 2023-07-06T21:58:23.417 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:58:23.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.559+0000 7fa1b99ad640 1 Processor -- start 2023-07-06T21:58:23.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.559+0000 7fa1b99ad640 1 -- start start 2023-07-06T21:58:23.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1b99ad640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa1b40cb4a0 0x7fa1b415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1b99ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1b415f740 0x7fa1b40ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1b99ad640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b40b5b50 con 0x7fa1b40cbc70 2023-07-06T21:58:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1b99ad640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b415d130 con 0x7fa1b415f740 2023-07-06T21:58:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1b99ad640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b40cc8e0 con 0x7fa1b40cb4a0 2023-07-06T21:58:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1abfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1b415f740 0x7fa1b40ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1b37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa1b40cbc70 0x7fa1b40ccdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58492/0 (socket says 172.21.15.55:58492) 2023-07-06T21:58:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1abfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1b415f740 0x7fa1b40ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33170/0 (socket says 172.21.15.55:33170) 2023-07-06T21:58:23.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1b37fe640 1 -- 172.21.15.55:0/1455923862 learned_addr learned my addr 172.21.15.55:0/1455923862 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:23.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1b2ffd640 1 --2- 172.21.15.55:0/1455923862 >> v2:172.21.15.138:3300/0 conn(0x7fa1b40cb4a0 0x7fa1b415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1abfff640 1 -- 172.21.15.55:0/1455923862 >> v2:172.21.15.138:3300/0 conn(0x7fa1b40cb4a0 msgr2=0x7fa1b415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:23.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1abfff640 1 --2- 172.21.15.55:0/1455923862 >> v2:172.21.15.138:3300/0 conn(0x7fa1b40cb4a0 0x7fa1b415cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1abfff640 1 -- 172.21.15.55:0/1455923862 >> v1:172.21.15.55:6789/0 conn(0x7fa1b40cbc70 legacy=0x7fa1b40ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1b27fc640 1 -- 172.21.15.55:0/1455923862 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567379356 0 0) 0x7fa1b40b5b50 con 0x7fa1b40cbc70 2023-07-06T21:58:23.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.563+0000 7fa1abfff640 1 -- 172.21.15.55:0/1455923862 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b415fc00 con 0x7fa1b415f740 2023-07-06T21:58:23.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.567+0000 7fa1abfff640 1 --2- 172.21.15.55:0/1455923862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b415f740 0x7fa1b40ca720 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40cdb90 tx=0x7fa19c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8cc581f5c35cef server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:23.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.567+0000 7fa1b27fc640 1 -- 172.21.15.55:0/1455923862 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c004230 con 0x7fa1b415f740 2023-07-06T21:58:23.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.567+0000 7fa1b27fc640 1 -- 172.21.15.55:0/1455923862 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c0a7050 con 0x7fa1b415f740 2023-07-06T21:58:23.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.567+0000 7fa1b27fc640 1 -- 172.21.15.55:0/1455923862 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c003620 con 0x7fa1b415f740 2023-07-06T21:58:23.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.567+0000 7fa1b99ad640 1 -- 172.21.15.55:0/1455923862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b415f740 msgr2=0x7fa1b40ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.567+0000 7fa1b99ad640 1 --2- 172.21.15.55:0/1455923862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b415f740 0x7fa1b40ca720 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40cdb90 tx=0x7fa19c01c460 comp rx=0 tx=0).stop 2023-07-06T21:58:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.567+0000 7fa1b99ad640 1 -- 172.21.15.55:0/1455923862 shutdown_connections 2023-07-06T21:58:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.567+0000 7fa1b99ad640 1 --2- 172.21.15.55:0/1455923862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b415f740 0x7fa1b40ca720 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.567+0000 7fa1b99ad640 1 --2- 172.21.15.55:0/1455923862 >> v2:172.21.15.138:3300/0 conn(0x7fa1b40cb4a0 0x7fa1b415cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.567+0000 7fa1b99ad640 1 -- 172.21.15.55:0/1455923862 >> 172.21.15.55:0/1455923862 conn(0x7fa1b406ee80 msgr2=0x7fa1b406f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.567+0000 7fa1b99ad640 1 -- 172.21.15.55:0/1455923862 shutdown_connections 2023-07-06T21:58:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.567+0000 7fa1b99ad640 1 -- 172.21.15.55:0/1455923862 wait complete. 2023-07-06T21:58:23.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.567+0000 7fa1b99ad640 1 Processor -- start 2023-07-06T21:58:23.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.567+0000 7fa1b99ad640 1 -- start start 2023-07-06T21:58:23.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b99ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1b40cb4a0 0x7fa1b4151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b99ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1b40cbc70 0x7fa1b41580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b99ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b415f740 0x7fa1b41585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b99ad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b41521e0 con 0x7fa1b415f740 2023-07-06T21:58:23.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b99ad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40c8190 con 0x7fa1b40cbc70 2023-07-06T21:58:23.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b99ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40c8470 con 0x7fa1b40cb4a0 2023-07-06T21:58:23.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b415f740 0x7fa1b41585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b415f740 0x7fa1b41585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33172/0 (socket says 172.21.15.55:33172) 2023-07-06T21:58:23.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b37fe640 1 -- 172.21.15.55:0/3529588821 learned_addr learned my addr 172.21.15.55:0/3529588821 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:23.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1abfff640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1b40cbc70 0x7fa1b41580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b37fe640 1 -- 172.21.15.55:0/3529588821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1b40cb4a0 msgr2=0x7fa1b4151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b2ffd640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1b40cb4a0 0x7fa1b4151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b37fe640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1b40cb4a0 0x7fa1b4151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b37fe640 1 -- 172.21.15.55:0/3529588821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1b40cbc70 msgr2=0x7fa1b41580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b37fe640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1b40cbc70 0x7fa1b41580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b37fe640 1 -- 172.21.15.55:0/3529588821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c009420 con 0x7fa1b415f740 2023-07-06T21:58:23.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1abfff640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1b40cbc70 0x7fa1b41580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:23.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b2ffd640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1b40cb4a0 0x7fa1b4151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:23.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b37fe640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b415f740 0x7fa1b41585f0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac001570 tx=0x7fa1ac00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:23.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b0ff9640 1 -- 172.21.15.55:0/3529588821 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac00a640 con 0x7fa1b415f740 2023-07-06T21:58:23.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b0ff9640 1 -- 172.21.15.55:0/3529588821 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ac00a7c0 con 0x7fa1b415f740 2023-07-06T21:58:23.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b0ff9640 1 -- 172.21.15.55:0/3529588821 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac00ab70 con 0x7fa1b415f740 2023-07-06T21:58:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b99ad640 1 -- 172.21.15.55:0/3529588821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b40c8750 con 0x7fa1b415f740 2023-07-06T21:58:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b99ad640 1 -- 172.21.15.55:0/3529588821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b40c8d10 con 0x7fa1b415f740 2023-07-06T21:58:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b99ad640 1 -- 172.21.15.55:0/3529588821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b40c8f30 con 0x7fa1b415f740 2023-07-06T21:58:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.571+0000 7fa1b0ff9640 1 -- 172.21.15.55:0/3529588821 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fa1ac00acd0 con 0x7fa1b415f740 2023-07-06T21:58:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.575+0000 7fa1b0ff9640 1 -- 172.21.15.55:0/3529588821 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7113+0+0 (secure 0 0 0) 0x7fa1ac0831a0 con 0x7fa1b415f740 2023-07-06T21:58:23.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.579+0000 7fa1b0ff9640 1 -- 172.21.15.55:0/3529588821 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1ac050650 con 0x7fa1b415f740 2023-07-06T21:58:23.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.719+0000 7fa1b0ff9640 1 -- 172.21.15.55:0/3529588821 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 46) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fa1ac050100 con 0x7fa1b415f740 2023-07-06T21:58:23.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.719+0000 7fa1b0ff9640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa19406c620 0x7fa19406ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.723+0000 7fa1b2ffd640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa19406c620 0x7fa19406ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.723+0000 7fa1b2ffd640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa19406c620 0x7fa19406ea00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4157dd0 tx=0x7fa1a4008040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:23.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.775+0000 7fa1b99ad640 1 -- 172.21.15.55:0/3529588821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1b4066d60 con 0x7fa1b415f740 2023-07-06T21:58:23.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.775+0000 7fa1b0ff9640 1 -- 172.21.15.55:0/3529588821 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fa1ac070b30 con 0x7fa1b415f740 2023-07-06T21:58:23.775 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:23.775 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2387174661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2387174661},{"type":"v1","addr":"172.21.15.138:6835","nonce":2387174661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7081,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3545643267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3545643267},{"type":"v1","addr":"172.21.15.138:6834","nonce":3545643267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7470,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1177943393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1177943393},{"type":"v1","addr":"172.21.15.55:6835","nonce":1177943393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:58:00.221256+0000","modified":"2023-07-06T21:58:03.247845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7479},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7479":{"gid":7479,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1437542997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1437542997},{"type":"v1","addr":"172.21.15.55:6837","nonce":1437542997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-06T21:58:23.775 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 40 2023-07-06T21:58:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.775+0000 7fa1b99ad640 1 -- 172.21.15.55:0/3529588821 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa19406c620 msgr2=0x7fa19406ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.775+0000 7fa1b99ad640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa19406c620 0x7fa19406ea00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4157dd0 tx=0x7fa1a4008040 comp rx=0 tx=0).stop 2023-07-06T21:58:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.775+0000 7fa1b99ad640 1 -- 172.21.15.55:0/3529588821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b415f740 msgr2=0x7fa1b41585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.775+0000 7fa1b99ad640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b415f740 0x7fa1b41585f0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac001570 tx=0x7fa1ac00cca0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.775+0000 7fa1b99ad640 1 -- 172.21.15.55:0/3529588821 shutdown_connections 2023-07-06T21:58:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.775+0000 7fa1b99ad640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa19406c620 0x7fa19406ea00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.775+0000 7fa1b99ad640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b415f740 0x7fa1b41585f0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.775+0000 7fa1b99ad640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1b40cbc70 0x7fa1b41580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.775+0000 7fa1b99ad640 1 --2- 172.21.15.55:0/3529588821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1b40cb4a0 0x7fa1b4151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.775+0000 7fa1b99ad640 1 -- 172.21.15.55:0/3529588821 >> 172.21.15.55:0/3529588821 conn(0x7fa1b406ee80 msgr2=0x7fa1b415b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.775+0000 7fa1b99ad640 1 -- 172.21.15.55:0/3529588821 shutdown_connections 2023-07-06T21:58:23.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.775+0000 7fa1b99ad640 1 -- 172.21.15.55:0/3529588821 wait complete. 2023-07-06T21:58:23.796 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:58:23.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.939+0000 7ffa9b4d8640 1 Processor -- start 2023-07-06T21:58:23.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.939+0000 7ffa9b4d8640 1 -- start start 2023-07-06T21:58:23.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.943+0000 7ffa9b4d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa9415bc40 0x7ffa9406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.943+0000 7ffa9b4d8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ffa9415cc00 0x7ffa9415f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.943+0000 7ffa9b4d8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9415c770 con 0x7ffa9406f8e0 2023-07-06T21:58:23.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.943+0000 7ffa9b4d8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9406d4f0 con 0x7ffa9415cc00 2023-07-06T21:58:23.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.943+0000 7ffa9b4d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9406d210 con 0x7ffa9415bc40 2023-07-06T21:58:23.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.943+0000 7ffa98a73640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa9415bc40 0x7ffa9406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.943+0000 7ffa98a73640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa9415bc40 0x7ffa9406c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:43352/0 (socket says 172.21.15.55:43352) 2023-07-06T21:58:23.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.943+0000 7ffa98a73640 1 -- 172.21.15.55:0/4186133439 learned_addr learned my addr 172.21.15.55:0/4186133439 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:23.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.943+0000 7ffa99a75640 1 --2- 172.21.15.55:0/4186133439 >> v2:172.21.15.138:3300/0 conn(0x7ffa9415cc00 0x7ffa9415f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.943+0000 7ffa98a73640 1 -- 172.21.15.55:0/4186133439 >> v2:172.21.15.138:3300/0 conn(0x7ffa9415cc00 msgr2=0x7ffa9415f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:23.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.943+0000 7ffa98a73640 1 --2- 172.21.15.55:0/4186133439 >> v2:172.21.15.138:3300/0 conn(0x7ffa9415cc00 0x7ffa9415f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.943+0000 7ffa98a73640 1 -- 172.21.15.55:0/4186133439 >> v1:172.21.15.138:6789/0 conn(0x7ffa9406f8e0 legacy=0x7ffa9406fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.943+0000 7ffa98a73640 1 -- 172.21.15.55:0/4186133439 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9415c120 con 0x7ffa9415bc40 2023-07-06T21:58:23.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.943+0000 7ffa99a75640 1 --2- 172.21.15.55:0/4186133439 >> v2:172.21.15.138:3300/0 conn(0x7ffa9415cc00 0x7ffa9415f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:23.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.947+0000 7ffa98a73640 1 --2- 172.21.15.55:0/4186133439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa9415bc40 0x7ffa9406c930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009870 tx=0x7ffa8401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adec60513ba00a01 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:23.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.947+0000 7ffa8bfff640 1 -- 172.21.15.55:0/4186133439 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa840ab640 con 0x7ffa9415bc40 2023-07-06T21:58:23.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.947+0000 7ffa8bfff640 1 -- 172.21.15.55:0/4186133439 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa840a7070 con 0x7ffa9415bc40 2023-07-06T21:58:23.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.947+0000 7ffa8bfff640 1 -- 172.21.15.55:0/4186133439 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa840ab9c0 con 0x7ffa9415bc40 2023-07-06T21:58:23.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.947+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/4186133439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa9415bc40 msgr2=0x7ffa9406c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.947+0000 7ffa9b4d8640 1 --2- 172.21.15.55:0/4186133439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa9415bc40 0x7ffa9406c930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009870 tx=0x7ffa8401c510 comp rx=0 tx=0).stop 2023-07-06T21:58:23.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.947+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/4186133439 shutdown_connections 2023-07-06T21:58:23.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.947+0000 7ffa9b4d8640 1 --2- 172.21.15.55:0/4186133439 >> v2:172.21.15.138:3300/0 conn(0x7ffa9415cc00 0x7ffa9415f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.947+0000 7ffa9b4d8640 1 --2- 172.21.15.55:0/4186133439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa9415bc40 0x7ffa9406c930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.947+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/4186133439 >> 172.21.15.55:0/4186133439 conn(0x7ffa940cbd80 msgr2=0x7ffa940ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:23.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.947+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/4186133439 shutdown_connections 2023-07-06T21:58:23.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.947+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/4186133439 wait complete. 2023-07-06T21:58:23.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.947+0000 7ffa9b4d8640 1 Processor -- start 2023-07-06T21:58:23.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.947+0000 7ffa9b4d8640 1 -- start start 2023-07-06T21:58:23.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa9b4d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa9406f8e0 0x7ffa941518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa9b4d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa9415bc40 0x7ffa94159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa9b4d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa9415cc00 0x7ffa94159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa9b4d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa940ca830 con 0x7ffa9406f8e0 2023-07-06T21:58:23.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa9b4d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa940c9c20 con 0x7ffa9415bc40 2023-07-06T21:58:23.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa9b4d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa940c9f00 con 0x7ffa9415cc00 2023-07-06T21:58:23.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa99274640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa9406f8e0 0x7ffa941518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa99274640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa9406f8e0 0x7ffa941518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33178/0 (socket says 172.21.15.55:33178) 2023-07-06T21:58:23.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa99274640 1 -- 172.21.15.55:0/1273280944 learned_addr learned my addr 172.21.15.55:0/1273280944 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:23.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa99a75640 1 --2- 172.21.15.55:0/1273280944 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa9415cc00 0x7ffa94159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa98a73640 1 --2- 172.21.15.55:0/1273280944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa9415bc40 0x7ffa94159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa99274640 1 -- 172.21.15.55:0/1273280944 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa9415cc00 msgr2=0x7ffa94159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa99274640 1 --2- 172.21.15.55:0/1273280944 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa9415cc00 0x7ffa94159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa99274640 1 -- 172.21.15.55:0/1273280944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa9415bc40 msgr2=0x7ffa94159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:23.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa99274640 1 --2- 172.21.15.55:0/1273280944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa9415bc40 0x7ffa94159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:23.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa99274640 1 -- 172.21.15.55:0/1273280944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c009a70 con 0x7ffa9406f8e0 2023-07-06T21:58:23.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa99274640 1 --2- 172.21.15.55:0/1273280944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa9406f8e0 0x7ffa941518e0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c500 tx=0x7ffa9000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:23.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa89ffb640 1 -- 172.21.15.55:0/1273280944 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa900052d0 con 0x7ffa9406f8e0 2023-07-06T21:58:23.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa89ffb640 1 -- 172.21.15.55:0/1273280944 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa90005430 con 0x7ffa9406f8e0 2023-07-06T21:58:23.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/1273280944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa840094d0 con 0x7ffa9406f8e0 2023-07-06T21:58:23.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa89ffb640 1 -- 172.21.15.55:0/1273280944 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90003840 con 0x7ffa9406f8e0 2023-07-06T21:58:23.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/1273280944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa940ca4c0 con 0x7ffa9406f8e0 2023-07-06T21:58:23.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.951+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/1273280944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa94066d60 con 0x7ffa9406f8e0 2023-07-06T21:58:23.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.955+0000 7ffa89ffb640 1 -- 172.21.15.55:0/1273280944 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 46) v1 ==== 85496+0+0 (secure 0 0 0) 0x7ffa900039a0 con 0x7ffa9406f8e0 2023-07-06T21:58:23.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.955+0000 7ffa89ffb640 1 --2- 172.21.15.55:0/1273280944 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7ffa780660d0 0x7ffa78068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:23.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.955+0000 7ffa89ffb640 1 -- 172.21.15.55:0/1273280944 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7113+0+0 (secure 0 0 0) 0x7ffa90083330 con 0x7ffa9406f8e0 2023-07-06T21:58:23.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.955+0000 7ffa98a73640 1 --2- 172.21.15.55:0/1273280944 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7ffa780660d0 0x7ffa78068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:23.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.955+0000 7ffa98a73640 1 --2- 172.21.15.55:0/1273280944 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7ffa780660d0 0x7ffa78068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffa840af000 tx=0x7ffa840b6040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:23.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:23.959+0000 7ffa89ffb640 1 -- 172.21.15.55:0/1273280944 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa900506b0 con 0x7ffa9406f8e0 2023-07-06T21:58:24.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.115+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/1273280944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa940cf1b0 con 0x7ffa9406f8e0 2023-07-06T21:58:24.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.115+0000 7ffa89ffb640 1 -- 172.21.15.55:0/1273280944 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+19608 (secure 0 0 0) 0x7ffa90053cd0 con 0x7ffa9406f8e0 2023-07-06T21:58:24.116 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:24.116 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":105,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:58:22.707294+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:57:58.092354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-07-06T21:57:59.209040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/1711412404":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/541053535":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/2207136597":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/3822427711":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/2499362367":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/1216783276":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/2012337213":"2023-07-07T21:58:22.707261+0000","172.21.15.55:6833/1286790431":"2023-07-07T21:58:22.707261+0000","172.21.15.55:6832/1286790431":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/1619591920":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/2678332066":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/3781336149":"2023-07-07T21:58:16.643406+0000","172.21.15.55:6832/703944479":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/3528659743":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/4200932499":"2023-07-07T21:58:16.643406+0000","172.21.15.55:6833/703944479":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/1766014464":"2023-07-07T21:58:16.643406+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:58:24.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.119+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/1273280944 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7ffa780660d0 msgr2=0x7ffa78068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.119+0000 7ffa9b4d8640 1 --2- 172.21.15.55:0/1273280944 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7ffa780660d0 0x7ffa78068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffa840af000 tx=0x7ffa840b6040 comp rx=0 tx=0).stop 2023-07-06T21:58:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.119+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/1273280944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa9406f8e0 msgr2=0x7ffa941518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.119+0000 7ffa9b4d8640 1 --2- 172.21.15.55:0/1273280944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa9406f8e0 0x7ffa941518e0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c500 tx=0x7ffa9000c900 comp rx=0 tx=0).stop 2023-07-06T21:58:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.119+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/1273280944 shutdown_connections 2023-07-06T21:58:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.119+0000 7ffa9b4d8640 1 --2- 172.21.15.55:0/1273280944 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7ffa780660d0 0x7ffa78068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.119+0000 7ffa9b4d8640 1 --2- 172.21.15.55:0/1273280944 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa9415cc00 0x7ffa94159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.119+0000 7ffa9b4d8640 1 --2- 172.21.15.55:0/1273280944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa9415bc40 0x7ffa94159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.119+0000 7ffa9b4d8640 1 --2- 172.21.15.55:0/1273280944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa9406f8e0 0x7ffa941518e0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.119+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/1273280944 >> 172.21.15.55:0/1273280944 conn(0x7ffa940cbd80 msgr2=0x7ffa940cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:24.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.119+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/1273280944 shutdown_connections 2023-07-06T21:58:24.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.119+0000 7ffa9b4d8640 1 -- 172.21.15.55:0/1273280944 wait complete. 2023-07-06T21:58:24.137 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T21:58:24.137 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:58:24.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8aad37640 1 Processor -- start 2023-07-06T21:58:24.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8aad37640 1 -- start start 2023-07-06T21:58:24.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8aad37640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd8a40ce610 0x7fd8a40b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8aad37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b1e10 0x7fd8a415f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8aad37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a40b2290 con 0x7fd8a40b7cd0 2023-07-06T21:58:24.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8aad37640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a40d2310 con 0x7fd8a40ce610 2023-07-06T21:58:24.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8aad37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40b80a0 con 0x7fd8a40b1e10 2023-07-06T21:58:24.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a8ad3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd8a40b7cd0 0x7fd8a40ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58508/0 (socket says 172.21.15.55:58508) 2023-07-06T21:58:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a8ad3640 1 -- 172.21.15.55:0/2355333391 learned_addr learned my addr 172.21.15.55:0/2355333391 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 -- 172.21.15.55:0/2355333391 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128141874 0 0) 0x7fd8a40b2290 con 0x7fd8a40b7cd0 2023-07-06T21:58:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 -- 172.21.15.55:0/2355333391 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd894003530 con 0x7fd8a40b7cd0 2023-07-06T21:58:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a3fff640 1 --2- 172.21.15.55:0/2355333391 >> v2:172.21.15.138:3300/0 conn(0x7fd8a40ce610 0x7fd8a40b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a92d4640 1 --2- 172.21.15.55:0/2355333391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b1e10 0x7fd8a415f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 -- 172.21.15.55:0/2355333391 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3280171195 0 0) 0x7fd894003530 con 0x7fd8a40b7cd0 2023-07-06T21:58:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 -- 172.21.15.55:0/2355333391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b1e10 msgr2=0x7fd8a415f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 --2- 172.21.15.55:0/2355333391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b1e10 0x7fd8a415f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 -- 172.21.15.55:0/2355333391 >> v2:172.21.15.138:3300/0 conn(0x7fd8a40ce610 msgr2=0x7fd8a40b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 --2- 172.21.15.55:0/2355333391 >> v2:172.21.15.138:3300/0 conn(0x7fd8a40ce610 0x7fd8a40b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 -- 172.21.15.55:0/2355333391 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a40cd1c0 con 0x7fd8a40b7cd0 2023-07-06T21:58:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 -- 172.21.15.55:0/2355333391 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fd898001680 con 0x7fd8a40b7cd0 2023-07-06T21:58:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a92d4640 1 --2- 172.21.15.55:0/2355333391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b1e10 0x7fd8a415f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 -- 172.21.15.55:0/2355333391 >> v1:172.21.15.55:6789/0 conn(0x7fd8a40b7cd0 legacy=0x7fd8a40ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 --2- 172.21.15.55:0/2355333391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b1e10 0x7fd894003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 --2- 172.21.15.55:0/2355333391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd894003ec0 0x7fd8940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 --2- 172.21.15.55:0/2355333391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd894004d10 0x7fd894005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 -- 172.21.15.55:0/2355333391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40b80a0 con 0x7fd894003ec0 2023-07-06T21:58:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 -- 172.21.15.55:0/2355333391 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89400b9c0 con 0x7fd894004d10 2023-07-06T21:58:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a37fe640 1 -- 172.21.15.55:0/2355333391 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89400bb80 con 0x7fd8a40b1e10 2023-07-06T21:58:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a3fff640 1 --2- 172.21.15.55:0/2355333391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd894003ec0 0x7fd8940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.283+0000 7fd8a8ad3640 1 --2- 172.21.15.55:0/2355333391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b1e10 0x7fd894003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8a92d4640 1 --2- 172.21.15.55:0/2355333391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd894004d10 0x7fd894005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8a3fff640 1 -- 172.21.15.55:0/2355333391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b1e10 msgr2=0x7fd894003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8a3fff640 1 --2- 172.21.15.55:0/2355333391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b1e10 0x7fd894003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8a3fff640 1 -- 172.21.15.55:0/2355333391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd894004d10 msgr2=0x7fd894005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8a3fff640 1 --2- 172.21.15.55:0/2355333391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd894004d10 0x7fd894005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8a3fff640 1 -- 172.21.15.55:0/2355333391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894003530 con 0x7fd894003ec0 2023-07-06T21:58:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8a8ad3640 1 --2- 172.21.15.55:0/2355333391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a40b1e10 0x7fd894003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:24.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8a3fff640 1 --2- 172.21.15.55:0/2355333391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd894003ec0 0x7fd8940047d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fd890009ab0 tx=0x7fd89001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb06293a37053f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:24.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8a37fe640 1 -- 172.21.15.55:0/2355333391 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8900a6450 con 0x7fd894003ec0 2023-07-06T21:58:24.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8a37fe640 1 -- 172.21.15.55:0/2355333391 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8900a65b0 con 0x7fd894003ec0 2023-07-06T21:58:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8a37fe640 1 -- 172.21.15.55:0/2355333391 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8900a6960 con 0x7fd894003ec0 2023-07-06T21:58:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8aad37640 1 -- 172.21.15.55:0/2355333391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd894003ec0 msgr2=0x7fd8940047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8aad37640 1 --2- 172.21.15.55:0/2355333391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd894003ec0 0x7fd8940047d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fd890009ab0 tx=0x7fd89001ca70 comp rx=0 tx=0).stop 2023-07-06T21:58:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8a92d4640 1 -- 172.21.15.55:0/2355333391 reap_dead start 2023-07-06T21:58:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8aad37640 1 -- 172.21.15.55:0/2355333391 shutdown_connections 2023-07-06T21:58:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.287+0000 7fd8aad37640 1 -- 172.21.15.55:0/2355333391 >> 172.21.15.55:0/2355333391 conn(0x7fd8a40ceee0 msgr2=0x7fd8a40cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8aad37640 1 -- 172.21.15.55:0/2355333391 shutdown_connections 2023-07-06T21:58:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8aad37640 1 -- 172.21.15.55:0/2355333391 wait complete. 2023-07-06T21:58:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8aad37640 1 Processor -- start 2023-07-06T21:58:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8aad37640 1 -- start start 2023-07-06T21:58:24.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8aad37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd894003ec0 0x7fd8a414c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8aad37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a41566a0 0x7fd8a415c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8aad37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8a415c8b0 0x7fd8a40cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8aad37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a414c980 con 0x7fd894003ec0 2023-07-06T21:58:24.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8aad37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a415d2f0 con 0x7fd8a415c8b0 2023-07-06T21:58:24.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8aad37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a415cd30 con 0x7fd8a41566a0 2023-07-06T21:58:24.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8a8ad3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd894003ec0 0x7fd8a414c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8a8ad3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd894003ec0 0x7fd8a414c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33198/0 (socket says 172.21.15.55:33198) 2023-07-06T21:58:24.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8a8ad3640 1 -- 172.21.15.55:0/2683588439 learned_addr learned my addr 172.21.15.55:0/2683588439 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:24.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8a92d4640 1 --2- 172.21.15.55:0/2683588439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8a415c8b0 0x7fd8a40cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8a3fff640 1 --2- 172.21.15.55:0/2683588439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a41566a0 0x7fd8a415c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8a8ad3640 1 -- 172.21.15.55:0/2683588439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a41566a0 msgr2=0x7fd8a415c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:24.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8a8ad3640 1 --2- 172.21.15.55:0/2683588439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a41566a0 0x7fd8a415c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8a8ad3640 1 -- 172.21.15.55:0/2683588439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8a415c8b0 msgr2=0x7fd8a40cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:24.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8a8ad3640 1 --2- 172.21.15.55:0/2683588439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8a415c8b0 0x7fd8a40cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8a8ad3640 1 -- 172.21.15.55:0/2683588439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a415d010 con 0x7fd894003ec0 2023-07-06T21:58:24.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.291+0000 7fd8a8ad3640 1 --2- 172.21.15.55:0/2683588439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd894003ec0 0x7fd8a414c440 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fd89800e800 tx=0x7fd89800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.295+0000 7fd8a17fa640 1 -- 172.21.15.55:0/2683588439 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89800c850 con 0x7fd894003ec0 2023-07-06T21:58:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.295+0000 7fd8a17fa640 1 -- 172.21.15.55:0/2683588439 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89800c9b0 con 0x7fd894003ec0 2023-07-06T21:58:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.295+0000 7fd8a17fa640 1 -- 172.21.15.55:0/2683588439 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89800cd20 con 0x7fd894003ec0 2023-07-06T21:58:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.295+0000 7fd8aad37640 1 -- 172.21.15.55:0/2683588439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a4154840 con 0x7fd894003ec0 2023-07-06T21:58:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.295+0000 7fd8aad37640 1 -- 172.21.15.55:0/2683588439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a40c5f90 con 0x7fd894003ec0 2023-07-06T21:58:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.295+0000 7fd8aad37640 1 -- 172.21.15.55:0/2683588439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a41546a0 con 0x7fd894003ec0 2023-07-06T21:58:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.295+0000 7fd8a17fa640 1 -- 172.21.15.55:0/2683588439 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 46) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fd89801d460 con 0x7fd894003ec0 2023-07-06T21:58:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.295+0000 7fd8a17fa640 1 --2- 172.21.15.55:0/2683588439 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fd8880660d0 0x7fd888068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.295+0000 7fd8a17fa640 1 -- 172.21.15.55:0/2683588439 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7113+0+0 (secure 0 0 0) 0x7fd898083d10 con 0x7fd894003ec0 2023-07-06T21:58:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.295+0000 7fd8a3fff640 1 --2- 172.21.15.55:0/2683588439 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fd8880660d0 0x7fd888068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.295+0000 7fd8a3fff640 1 --2- 172.21.15.55:0/2683588439 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fd8880660d0 0x7fd888068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd8900ad000 tx=0x7fd8900b2040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:24.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.299+0000 7fd8a17fa640 1 -- 172.21.15.55:0/2683588439 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd8a41546a0 con 0x7fd894003ec0 2023-07-06T21:58:24.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.487+0000 7fd8aad37640 1 -- 172.21.15.55:0/2683588439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8a41546a0 con 0x7fd894003ec0 2023-07-06T21:58:24.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.487+0000 7fd8a17fa640 1 -- 172.21.15.55:0/2683588439 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fd8a41546a0 con 0x7fd894003ec0 2023-07-06T21:58:24.487 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:24.487 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2387174661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2387174661},{"type":"v1","addr":"172.21.15.138:6835","nonce":2387174661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7081,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3545643267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3545643267},{"type":"v1","addr":"172.21.15.138:6834","nonce":3545643267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7470,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1177943393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1177943393},{"type":"v1","addr":"172.21.15.55:6835","nonce":1177943393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:58:00.221256+0000","modified":"2023-07-06T21:58:03.247845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7479},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7479":{"gid":7479,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1437542997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1437542997},{"type":"v1","addr":"172.21.15.55:6837","nonce":1437542997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-06T21:58:24.487 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 40 2023-07-06T21:58:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.491+0000 7fd8aad37640 1 -- 172.21.15.55:0/2683588439 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fd8880660d0 msgr2=0x7fd888068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.491+0000 7fd8aad37640 1 --2- 172.21.15.55:0/2683588439 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fd8880660d0 0x7fd888068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd8900ad000 tx=0x7fd8900b2040 comp rx=0 tx=0).stop 2023-07-06T21:58:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.491+0000 7fd8aad37640 1 -- 172.21.15.55:0/2683588439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd894003ec0 msgr2=0x7fd8a414c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.491+0000 7fd8aad37640 1 --2- 172.21.15.55:0/2683588439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd894003ec0 0x7fd8a414c440 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fd89800e800 tx=0x7fd89800ecc0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.491+0000 7fd8aad37640 1 -- 172.21.15.55:0/2683588439 shutdown_connections 2023-07-06T21:58:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.491+0000 7fd8aad37640 1 --2- 172.21.15.55:0/2683588439 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fd8880660d0 0x7fd888068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.491+0000 7fd8aad37640 1 --2- 172.21.15.55:0/2683588439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8a415c8b0 0x7fd8a40cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.491+0000 7fd8aad37640 1 --2- 172.21.15.55:0/2683588439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8a41566a0 0x7fd8a415c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.491+0000 7fd8aad37640 1 --2- 172.21.15.55:0/2683588439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd894003ec0 0x7fd8a414c440 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.491+0000 7fd8aad37640 1 -- 172.21.15.55:0/2683588439 >> 172.21.15.55:0/2683588439 conn(0x7fd8a40ceee0 msgr2=0x7fd8a4150860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.491+0000 7fd8aad37640 1 -- 172.21.15.55:0/2683588439 shutdown_connections 2023-07-06T21:58:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.491+0000 7fd8aad37640 1 -- 172.21.15.55:0/2683588439 wait complete. 2023-07-06T21:58:24.508 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:58:24.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.651+0000 7fb90f574640 1 Processor -- start 2023-07-06T21:58:24.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.651+0000 7fb90f574640 1 -- start start 2023-07-06T21:58:24.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.651+0000 7fb90f574640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb90815bc40 0x7fb90806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.651+0000 7fb90f574640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb90815cc00 0x7fb90815f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.651+0000 7fb90f574640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90815c770 con 0x7fb90806f8e0 2023-07-06T21:58:24.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.651+0000 7fb90f574640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90806d4f0 con 0x7fb90815bc40 2023-07-06T21:58:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.651+0000 7fb90f574640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90806d210 con 0x7fb90815cc00 2023-07-06T21:58:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.651+0000 7fb90d310640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb90806f8e0 0x7fb90806fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58520/0 (socket says 172.21.15.55:58520) 2023-07-06T21:58:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.651+0000 7fb90d310640 1 -- 172.21.15.55:0/2019113670 learned_addr learned my addr 172.21.15.55:0/2019113670 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.651+0000 7fb90cb0f640 1 --2- 172.21.15.55:0/2019113670 >> v2:172.21.15.55:3300/0 conn(0x7fb90815bc40 0x7fb90806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.655+0000 7fb90db11640 1 --2- 172.21.15.55:0/2019113670 >> v2:172.21.15.138:3300/0 conn(0x7fb90815cc00 0x7fb90815f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.655+0000 7fb8fffff640 1 -- 172.21.15.55:0/2019113670 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063177547 0 0) 0x7fb90815c770 con 0x7fb90806f8e0 2023-07-06T21:58:24.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.655+0000 7fb90cb0f640 1 -- 172.21.15.55:0/2019113670 >> v2:172.21.15.138:3300/0 conn(0x7fb90815cc00 msgr2=0x7fb90815f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:24.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.655+0000 7fb90cb0f640 1 --2- 172.21.15.55:0/2019113670 >> v2:172.21.15.138:3300/0 conn(0x7fb90815cc00 0x7fb90815f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.655+0000 7fb90cb0f640 1 -- 172.21.15.55:0/2019113670 >> v1:172.21.15.55:6789/0 conn(0x7fb90806f8e0 legacy=0x7fb90806fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:24.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.655+0000 7fb90cb0f640 1 -- 172.21.15.55:0/2019113670 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90815c120 con 0x7fb90815bc40 2023-07-06T21:58:24.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.659+0000 7fb90cb0f640 1 --2- 172.21.15.55:0/2019113670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90815bc40 0x7fb90806c930 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80097c0 tx=0x7fb8f801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6528e86d2cc4a684 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:24.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.659+0000 7fb8fffff640 1 -- 172.21.15.55:0/2019113670 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f80ab600 con 0x7fb90815bc40 2023-07-06T21:58:24.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.659+0000 7fb8fffff640 1 -- 172.21.15.55:0/2019113670 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f80a7050 con 0x7fb90815bc40 2023-07-06T21:58:24.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.659+0000 7fb8fffff640 1 -- 172.21.15.55:0/2019113670 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f80ab980 con 0x7fb90815bc40 2023-07-06T21:58:24.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.659+0000 7fb90f574640 1 -- 172.21.15.55:0/2019113670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90815bc40 msgr2=0x7fb90806c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:24.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.659+0000 7fb90f574640 1 --2- 172.21.15.55:0/2019113670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90815bc40 0x7fb90806c930 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80097c0 tx=0x7fb8f801c410 comp rx=0 tx=0).stop 2023-07-06T21:58:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.659+0000 7fb90f574640 1 -- 172.21.15.55:0/2019113670 shutdown_connections 2023-07-06T21:58:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.659+0000 7fb90f574640 1 --2- 172.21.15.55:0/2019113670 >> v2:172.21.15.138:3300/0 conn(0x7fb90815cc00 0x7fb90815f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.659+0000 7fb90f574640 1 --2- 172.21.15.55:0/2019113670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90815bc40 0x7fb90806c930 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.659+0000 7fb90f574640 1 -- 172.21.15.55:0/2019113670 >> 172.21.15.55:0/2019113670 conn(0x7fb9080cbd80 msgr2=0x7fb9080ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.659+0000 7fb90f574640 1 -- 172.21.15.55:0/2019113670 shutdown_connections 2023-07-06T21:58:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.659+0000 7fb90f574640 1 -- 172.21.15.55:0/2019113670 wait complete. 2023-07-06T21:58:24.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.659+0000 7fb90f574640 1 Processor -- start 2023-07-06T21:58:24.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.659+0000 7fb90f574640 1 -- start start 2023-07-06T21:58:24.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90f574640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90806f8e0 0x7fb90814a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90f574640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb90815bc40 0x7fb9080aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90f574640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb90815cc00 0x7fb9080ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90f574640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9080ab910 con 0x7fb90806f8e0 2023-07-06T21:58:24.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90f574640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9080abbf0 con 0x7fb90815cc00 2023-07-06T21:58:24.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90f574640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9080abed0 con 0x7fb90815bc40 2023-07-06T21:58:24.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90d310640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90806f8e0 0x7fb90814a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90d310640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90806f8e0 0x7fb90814a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33204/0 (socket says 172.21.15.55:33204) 2023-07-06T21:58:24.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90d310640 1 -- 172.21.15.55:0/3415082015 learned_addr learned my addr 172.21.15.55:0/3415082015 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:24.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90cb0f640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb90815bc40 0x7fb9080aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90db11640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb90815cc00 0x7fb9080ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90d310640 1 -- 172.21.15.55:0/3415082015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb90815bc40 msgr2=0x7fb9080aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:24.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90d310640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb90815bc40 0x7fb9080aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90d310640 1 -- 172.21.15.55:0/3415082015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb90815cc00 msgr2=0x7fb9080ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:24.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90d310640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb90815cc00 0x7fb9080ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90d310640 1 -- 172.21.15.55:0/3415082015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f8009420 con 0x7fb90806f8e0 2023-07-06T21:58:24.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90db11640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb90815cc00 0x7fb9080ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:24.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90d310640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90806f8e0 0x7fb90814a990 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fb9040011f0 tx=0x7fb90400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:24.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb8fdffb640 1 -- 172.21.15.55:0/3415082015 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9040074e0 con 0x7fb90806f8e0 2023-07-06T21:58:24.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb8fdffb640 1 -- 172.21.15.55:0/3415082015 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904007640 con 0x7fb90806f8e0 2023-07-06T21:58:24.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90f574640 1 -- 172.21.15.55:0/3415082015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9080ac1b0 con 0x7fb90806f8e0 2023-07-06T21:58:24.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb8fdffb640 1 -- 172.21.15.55:0/3415082015 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904004a10 con 0x7fb90806f8e0 2023-07-06T21:58:24.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90f574640 1 -- 172.21.15.55:0/3415082015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90814aed0 con 0x7fb90806f8e0 2023-07-06T21:58:24.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb90f574640 1 -- 172.21.15.55:0/3415082015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb908066d60 con 0x7fb90806f8e0 2023-07-06T21:58:24.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.663+0000 7fb8fdffb640 1 -- 172.21.15.55:0/3415082015 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 46) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fb904004b70 con 0x7fb90806f8e0 2023-07-06T21:58:24.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.667+0000 7fb8fdffb640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8ec066100 0x7fb8ec0685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:24.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.667+0000 7fb8fdffb640 1 -- 172.21.15.55:0/3415082015 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7113+0+0 (secure 0 0 0) 0x7fb904083250 con 0x7fb90806f8e0 2023-07-06T21:58:24.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.667+0000 7fb90cb0f640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8ec066100 0x7fb8ec0685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:24.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.667+0000 7fb90cb0f640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8ec066100 0x7fb8ec0685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb908066120 tx=0x7fb8f80a6000 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:24.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.671+0000 7fb8fdffb640 1 -- 172.21.15.55:0/3415082015 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb904050660 con 0x7fb90806f8e0 2023-07-06T21:58:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.863+0000 7fb90f574640 1 -- 172.21.15.55:0/3415082015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9080cddb0 con 0x7fb90806f8e0 2023-07-06T21:58:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.863+0000 7fb8fdffb640 1 -- 172.21.15.55:0/3415082015 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fb904053c80 con 0x7fb90806f8e0 2023-07-06T21:58:24.862 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:24.862 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2387174661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2387174661},{"type":"v1","addr":"172.21.15.138:6835","nonce":2387174661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7081,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3545643267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3545643267},{"type":"v1","addr":"172.21.15.138:6834","nonce":3545643267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7470,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1177943393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1177943393},{"type":"v1","addr":"172.21.15.55:6835","nonce":1177943393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:58:00.221256+0000","modified":"2023-07-06T21:58:03.247845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7479},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7479":{"gid":7479,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1437542997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1437542997},{"type":"v1","addr":"172.21.15.55:6837","nonce":1437542997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-06T21:58:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 40 2023-07-06T21:58:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.863+0000 7fb90f574640 1 -- 172.21.15.55:0/3415082015 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8ec066100 msgr2=0x7fb8ec0685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.863+0000 7fb90f574640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8ec066100 0x7fb8ec0685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb908066120 tx=0x7fb8f80a6000 comp rx=0 tx=0).stop 2023-07-06T21:58:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.863+0000 7fb90f574640 1 -- 172.21.15.55:0/3415082015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90806f8e0 msgr2=0x7fb90814a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.863+0000 7fb90f574640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90806f8e0 0x7fb90814a990 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fb9040011f0 tx=0x7fb90400c9b0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.863+0000 7fb90f574640 1 -- 172.21.15.55:0/3415082015 shutdown_connections 2023-07-06T21:58:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.863+0000 7fb90f574640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8ec066100 0x7fb8ec0685b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.863+0000 7fb90f574640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb90815cc00 0x7fb9080ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.863+0000 7fb90f574640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb90815bc40 0x7fb9080aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.863+0000 7fb90f574640 1 --2- 172.21.15.55:0/3415082015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb90806f8e0 0x7fb90814a990 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.863+0000 7fb90f574640 1 -- 172.21.15.55:0/3415082015 >> 172.21.15.55:0/3415082015 conn(0x7fb9080cbd80 msgr2=0x7fb9080b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.863+0000 7fb90f574640 1 -- 172.21.15.55:0/3415082015 shutdown_connections 2023-07-06T21:58:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:24.863+0000 7fb90f574640 1 -- 172.21.15.55:0/3415082015 wait complete. 2023-07-06T21:58:24.882 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:58:25.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.027+0000 7f17a8737640 1 Processor -- start 2023-07-06T21:58:25.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.027+0000 7f17a8737640 1 -- start start 2023-07-06T21:58:25.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.031+0000 7f17a8737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a015b9d0 0x7f17a015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.031+0000 7f17a8737640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f17a00b4420 0x7f17a00ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.031+0000 7f17a8737640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a006a160 con 0x7f17a00ce340 2023-07-06T21:58:25.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.031+0000 7f17a8737640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a015bda0 con 0x7f17a00b4420 2023-07-06T21:58:25.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.031+0000 7f17a8737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a0069590 con 0x7f17a015b9d0 2023-07-06T21:58:25.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.031+0000 7f17a6cd4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f17a00b4420 0x7f17a00ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.031+0000 7f17a6cd4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f17a00b4420 0x7f17a00ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33220/0 (socket says 172.21.15.55:33220) 2023-07-06T21:58:25.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.031+0000 7f17a5cd2640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f17a00ce340 0x7f17a00b3d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58534/0 (socket says 172.21.15.55:58534) 2023-07-06T21:58:25.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.031+0000 7f17a6cd4640 1 -- 172.21.15.55:0/825367440 learned_addr learned my addr 172.21.15.55:0/825367440 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:25.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.031+0000 7f17a64d3640 1 --2- 172.21.15.55:0/825367440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a015b9d0 0x7f17a015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.031+0000 7f17a6cd4640 1 -- 172.21.15.55:0/825367440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a015b9d0 msgr2=0x7f17a015f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:25.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.031+0000 7f17a6cd4640 1 --2- 172.21.15.55:0/825367440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a015b9d0 0x7f17a015f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.031+0000 7f17a6cd4640 1 -- 172.21.15.55:0/825367440 >> v1:172.21.15.55:6789/0 conn(0x7f17a00ce340 legacy=0x7f17a00b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.031+0000 7f17a6cd4640 1 -- 172.21.15.55:0/825367440 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a0069830 con 0x7f17a00b4420 2023-07-06T21:58:25.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.035+0000 7f17a6cd4640 1 --2- 172.21.15.55:0/825367440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a00b4420 0x7f17a00ce770 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f1798009e50 tx=0x7f179801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507d4bda620a15d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:25.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.035+0000 7f17a54d1640 1 -- 172.21.15.55:0/825367440 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17980a58a0 con 0x7f17a00b4420 2023-07-06T21:58:25.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.035+0000 7f17a54d1640 1 -- 172.21.15.55:0/825367440 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17980a5a00 con 0x7f17a00b4420 2023-07-06T21:58:25.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.035+0000 7f17a54d1640 1 -- 172.21.15.55:0/825367440 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17980a5d90 con 0x7f17a00b4420 2023-07-06T21:58:25.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.035+0000 7f17a8737640 1 -- 172.21.15.55:0/825367440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a00b4420 msgr2=0x7f17a00ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.035+0000 7f17a8737640 1 --2- 172.21.15.55:0/825367440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a00b4420 0x7f17a00ce770 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f1798009e50 tx=0x7f179801c9e0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.035+0000 7f17a8737640 1 -- 172.21.15.55:0/825367440 shutdown_connections 2023-07-06T21:58:25.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.035+0000 7f17a8737640 1 --2- 172.21.15.55:0/825367440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a00b4420 0x7f17a00ce770 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.035+0000 7f17a8737640 1 --2- 172.21.15.55:0/825367440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a015b9d0 0x7f17a015f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.035+0000 7f17a8737640 1 -- 172.21.15.55:0/825367440 >> 172.21.15.55:0/825367440 conn(0x7f17a00ced10 msgr2=0x7f17a00cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:25.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.035+0000 7f17a8737640 1 -- 172.21.15.55:0/825367440 shutdown_connections 2023-07-06T21:58:25.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.035+0000 7f17a8737640 1 -- 172.21.15.55:0/825367440 wait complete. 2023-07-06T21:58:25.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.035+0000 7f17a8737640 1 Processor -- start 2023-07-06T21:58:25.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.035+0000 7f17a8737640 1 -- start start 2023-07-06T21:58:25.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a8737640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a00b4420 0x7f17a0153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a8737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00ce340 0x7f17a00c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a8737640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a015b9d0 0x7f17a00ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a8737640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a0141e00 con 0x7f17a00b4420 2023-07-06T21:58:25.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a8737640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a0153030 con 0x7f17a015b9d0 2023-07-06T21:58:25.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a8737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a0153310 con 0x7f17a00ce340 2023-07-06T21:58:25.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a64d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a00b4420 0x7f17a0153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a64d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a00b4420 0x7f17a0153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33226/0 (socket says 172.21.15.55:33226) 2023-07-06T21:58:25.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a64d3640 1 -- 172.21.15.55:0/1974136868 learned_addr learned my addr 172.21.15.55:0/1974136868 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:25.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a5cd2640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00ce340 0x7f17a00c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a6cd4640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a015b9d0 0x7f17a00ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a64d3640 1 -- 172.21.15.55:0/1974136868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00ce340 msgr2=0x7f17a00c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a64d3640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00ce340 0x7f17a00c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a64d3640 1 -- 172.21.15.55:0/1974136868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a015b9d0 msgr2=0x7f17a00ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a64d3640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a015b9d0 0x7f17a00ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a64d3640 1 -- 172.21.15.55:0/1974136868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1798009b30 con 0x7f17a00b4420 2023-07-06T21:58:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a5cd2640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00ce340 0x7f17a00c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a64d3640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a00b4420 0x7f17a0153df0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f179c00d5f0 tx=0x7f179c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f1796ffd640 1 -- 172.21.15.55:0/1974136868 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c0125f0 con 0x7f17a00b4420 2023-07-06T21:58:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f1796ffd640 1 -- 172.21.15.55:0/1974136868 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c012750 con 0x7f17a00b4420 2023-07-06T21:58:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a8737640 1 -- 172.21.15.55:0/1974136868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a01535f0 con 0x7f17a00b4420 2023-07-06T21:58:25.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f1796ffd640 1 -- 172.21.15.55:0/1974136868 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c012ae0 con 0x7f17a00b4420 2023-07-06T21:58:25.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a8737640 1 -- 172.21.15.55:0/1974136868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a00c8420 con 0x7f17a00b4420 2023-07-06T21:58:25.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f17a8737640 1 -- 172.21.15.55:0/1974136868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a00cda10 con 0x7f17a00b4420 2023-07-06T21:58:25.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.039+0000 7f1796ffd640 1 -- 172.21.15.55:0/1974136868 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 46) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f179c012c40 con 0x7f17a00b4420 2023-07-06T21:58:25.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.043+0000 7f1796ffd640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f1784066100 0x7f17840685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.043+0000 7f1796ffd640 1 -- 172.21.15.55:0/1974136868 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7113+0+0 (secure 0 0 0) 0x7f179c0842f0 con 0x7f17a00b4420 2023-07-06T21:58:25.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.043+0000 7f17a5cd2640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f1784066100 0x7f17840685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.043+0000 7f17a5cd2640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f1784066100 0x7f17840685b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17a00b80c0 tx=0x7f1790007d50 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:25.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.047+0000 7f1796ffd640 1 -- 172.21.15.55:0/1974136868 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f179c0515c0 con 0x7f17a00b4420 2023-07-06T21:58:25.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.207+0000 7f17a8737640 1 -- 172.21.15.55:0/1974136868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17a015d460 con 0x7f17a00b4420 2023-07-06T21:58:25.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.207+0000 7f1796ffd640 1 -- 172.21.15.55:0/1974136868 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+19608 (secure 0 0 0) 0x7f179c054be0 con 0x7f17a00b4420 2023-07-06T21:58:25.207 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:25.207 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":105,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:58:22.707294+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:57:58.092354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-07-06T21:57:59.209040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/1711412404":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/541053535":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/2207136597":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/3822427711":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/2499362367":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/1216783276":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/2012337213":"2023-07-07T21:58:22.707261+0000","172.21.15.55:6833/1286790431":"2023-07-07T21:58:22.707261+0000","172.21.15.55:6832/1286790431":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/1619591920":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/2678332066":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/3781336149":"2023-07-07T21:58:16.643406+0000","172.21.15.55:6832/703944479":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/3528659743":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/4200932499":"2023-07-07T21:58:16.643406+0000","172.21.15.55:6833/703944479":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/1766014464":"2023-07-07T21:58:16.643406+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:58:25.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.211+0000 7f17a8737640 1 -- 172.21.15.55:0/1974136868 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f1784066100 msgr2=0x7f17840685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.211+0000 7f17a8737640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f1784066100 0x7f17840685b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17a00b80c0 tx=0x7f1790007d50 comp rx=0 tx=0).stop 2023-07-06T21:58:25.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.211+0000 7f17a8737640 1 -- 172.21.15.55:0/1974136868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a00b4420 msgr2=0x7f17a0153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.211+0000 7f17a8737640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a00b4420 0x7f17a0153df0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f179c00d5f0 tx=0x7f179c00dab0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.211+0000 7f17a8737640 1 -- 172.21.15.55:0/1974136868 shutdown_connections 2023-07-06T21:58:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.211+0000 7f17a8737640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f1784066100 0x7f17840685b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.211+0000 7f17a8737640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a015b9d0 0x7f17a00ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.211+0000 7f17a8737640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00ce340 0x7f17a00c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.211+0000 7f17a8737640 1 --2- 172.21.15.55:0/1974136868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a00b4420 0x7f17a0153df0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.211+0000 7f17a8737640 1 -- 172.21.15.55:0/1974136868 >> 172.21.15.55:0/1974136868 conn(0x7f17a00ced10 msgr2=0x7f17a015e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.211+0000 7f17a8737640 1 -- 172.21.15.55:0/1974136868 shutdown_connections 2023-07-06T21:58:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.211+0000 7f17a8737640 1 -- 172.21.15.55:0/1974136868 wait complete. 2023-07-06T21:58:25.228 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T21:58:25.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.371+0000 7f908d407640 1 Processor -- start 2023-07-06T21:58:25.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.371+0000 7f908d407640 1 -- start start 2023-07-06T21:58:25.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f908d407640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f90880ca130 0x7f90880703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f908d407640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90880c8db0 con 0x7f90880cd140 2023-07-06T21:58:25.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f908d407640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90880c9090 con 0x7f9088158850 2023-07-06T21:58:25.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f908d407640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9088158ce0 con 0x7f90880ca130 2023-07-06T21:58:25.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f90877fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f90880cd140 0x7f90880b1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58550/0 (socket says 172.21.15.55:58550) 2023-07-06T21:58:25.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f90877fe640 1 -- 172.21.15.55:0/2045701044 learned_addr learned my addr 172.21.15.55:0/2045701044 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:25.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f907ffff640 1 --2- 172.21.15.55:0/2045701044 >> v2:172.21.15.138:3300/0 conn(0x7f90880ca130 0x7f90880703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f90867fc640 1 -- 172.21.15.55:0/2045701044 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038985275 0 0) 0x7f90880c8db0 con 0x7f90880cd140 2023-07-06T21:58:25.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f90867fc640 1 -- 172.21.15.55:0/2045701044 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9074005740 con 0x7f90880cd140 2023-07-06T21:58:25.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f90867fc640 1 -- 172.21.15.55:0/2045701044 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920227219 0 0) 0x7f90880c9090 con 0x7f9088158850 2023-07-06T21:58:25.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f90867fc640 1 -- 172.21.15.55:0/2045701044 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90880c8db0 con 0x7f9088158850 2023-07-06T21:58:25.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f90867fc640 1 -- 172.21.15.55:0/2045701044 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1074359984 0 0) 0x7f9074005740 con 0x7f90880cd140 2023-07-06T21:58:25.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f907ffff640 1 -- 172.21.15.55:0/2045701044 >> v1:172.21.15.138:6789/0 conn(0x7f9088158850 legacy=0x7f90880cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f907ffff640 1 -- 172.21.15.55:0/2045701044 >> v1:172.21.15.55:6789/0 conn(0x7f90880cd140 legacy=0x7f90880b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.375+0000 7f907ffff640 1 -- 172.21.15.55:0/2045701044 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90880c9370 con 0x7f90880ca130 2023-07-06T21:58:25.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.379+0000 7f907ffff640 1 --2- 172.21.15.55:0/2045701044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880ca130 0x7f90880703e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f90700097c0 tx=0x7f907001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9ee0dd88fe99c95 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:25.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.379+0000 7f90867fc640 1 -- 172.21.15.55:0/2045701044 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080001a00 con 0x7f90880ca130 2023-07-06T21:58:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.379+0000 7f90867fc640 1 -- 172.21.15.55:0/2045701044 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90700a7050 con 0x7f90880ca130 2023-07-06T21:58:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.379+0000 7f90867fc640 1 -- 172.21.15.55:0/2045701044 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90700ab620 con 0x7f90880ca130 2023-07-06T21:58:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.379+0000 7f908d407640 1 -- 172.21.15.55:0/2045701044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880ca130 msgr2=0x7f90880703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.379+0000 7f908d407640 1 --2- 172.21.15.55:0/2045701044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880ca130 0x7f90880703e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f90700097c0 tx=0x7f907001c370 comp rx=0 tx=0).stop 2023-07-06T21:58:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.379+0000 7f908d407640 1 -- 172.21.15.55:0/2045701044 shutdown_connections 2023-07-06T21:58:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.379+0000 7f908d407640 1 --2- 172.21.15.55:0/2045701044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880ca130 0x7f90880703e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.379+0000 7f908d407640 1 -- 172.21.15.55:0/2045701044 >> 172.21.15.55:0/2045701044 conn(0x7f90880cea70 msgr2=0x7f90880ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.379+0000 7f908d407640 1 -- 172.21.15.55:0/2045701044 shutdown_connections 2023-07-06T21:58:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.379+0000 7f908d407640 1 -- 172.21.15.55:0/2045701044 wait complete. 2023-07-06T21:58:25.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.379+0000 7f908d407640 1 Processor -- start 2023-07-06T21:58:25.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.379+0000 7f908d407640 1 -- start start 2023-07-06T21:58:25.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f908d407640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880ca130 0x7f90880c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f908d407640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90880cd140 0x7f90881f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f908d407640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088158850 0x7f908809e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f908d407640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908806aab0 con 0x7f9088158850 2023-07-06T21:58:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f908d407640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9088069ea0 con 0x7f90880ca130 2023-07-06T21:58:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f908d407640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908806a180 con 0x7f90880cd140 2023-07-06T21:58:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f90877fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088158850 0x7f908809e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f90877fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088158850 0x7f908809e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33228/0 (socket says 172.21.15.55:33228) 2023-07-06T21:58:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f90877fe640 1 -- 172.21.15.55:0/2843975108 learned_addr learned my addr 172.21.15.55:0/2843975108 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f9086ffd640 1 --2- 172.21.15.55:0/2843975108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880ca130 0x7f90880c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f907ffff640 1 --2- 172.21.15.55:0/2843975108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90880cd140 0x7f90881f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f90877fe640 1 -- 172.21.15.55:0/2843975108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90880cd140 msgr2=0x7f90881f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f90877fe640 1 --2- 172.21.15.55:0/2843975108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90880cd140 0x7f90881f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f90877fe640 1 -- 172.21.15.55:0/2843975108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880ca130 msgr2=0x7f90880c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f90877fe640 1 --2- 172.21.15.55:0/2843975108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880ca130 0x7f90880c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f90877fe640 1 -- 172.21.15.55:0/2843975108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9070009420 con 0x7f9088158850 2023-07-06T21:58:25.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f90877fe640 1 --2- 172.21.15.55:0/2843975108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088158850 0x7f908809e250 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9080002010 tx=0x7f908000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:25.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f907f7fe640 1 -- 172.21.15.55:0/2843975108 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080012400 con 0x7f9088158850 2023-07-06T21:58:25.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f907f7fe640 1 -- 172.21.15.55:0/2843975108 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9080012580 con 0x7f9088158850 2023-07-06T21:58:25.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f907f7fe640 1 -- 172.21.15.55:0/2843975108 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080012970 con 0x7f9088158850 2023-07-06T21:58:25.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f908d407640 1 -- 172.21.15.55:0/2843975108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908806a460 con 0x7f9088158850 2023-07-06T21:58:25.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f908d407640 1 -- 172.21.15.55:0/2843975108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90880c41a0 con 0x7f9088158850 2023-07-06T21:58:25.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.383+0000 7f908d407640 1 -- 172.21.15.55:0/2843975108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908806ac20 con 0x7f9088158850 2023-07-06T21:58:25.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.387+0000 7f907f7fe640 1 -- 172.21.15.55:0/2843975108 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 46) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f9080012ad0 con 0x7f9088158850 2023-07-06T21:58:25.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.387+0000 7f907f7fe640 1 --2- 172.21.15.55:0/2843975108 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f9068066100 0x7f90680685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.387+0000 7f907f7fe640 1 -- 172.21.15.55:0/2843975108 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7113+0+0 (secure 0 0 0) 0x7f90800843f0 con 0x7f9088158850 2023-07-06T21:58:25.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.387+0000 7f9086ffd640 1 --2- 172.21.15.55:0/2843975108 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f9068066100 0x7f90680685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.387+0000 7f9086ffd640 1 --2- 172.21.15.55:0/2843975108 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f9068066100 0x7f90680685b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f90780011f0 tx=0x7f9078009040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:25.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.391+0000 7f907f7fe640 1 -- 172.21.15.55:0/2843975108 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9080051840 con 0x7f9088158850 2023-07-06T21:58:25.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.579+0000 7f908d407640 1 -- 172.21.15.55:0/2843975108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9088066d60 con 0x7f9088158850 2023-07-06T21:58:25.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.663+0000 7f907f7fe640 1 -- 172.21.15.55:0/2843975108 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f90800840d0 con 0x7f9088158850 2023-07-06T21:58:25.725 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-07-06T21:58:25.727+0000 7f5b6d80c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T21:58:25.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.739+0000 7f907f7fe640 1 -- 172.21.15.55:0/2843975108 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9080070560 con 0x7f9088158850 2023-07-06T21:58:25.738 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T21:58:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.743+0000 7f908d407640 1 -- 172.21.15.55:0/2843975108 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f9068066100 msgr2=0x7f90680685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.743+0000 7f908d407640 1 --2- 172.21.15.55:0/2843975108 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f9068066100 0x7f90680685b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f90780011f0 tx=0x7f9078009040 comp rx=0 tx=0).stop 2023-07-06T21:58:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.743+0000 7f908d407640 1 -- 172.21.15.55:0/2843975108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088158850 msgr2=0x7f908809e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.743+0000 7f908d407640 1 --2- 172.21.15.55:0/2843975108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088158850 0x7f908809e250 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9080002010 tx=0x7f908000a430 comp rx=0 tx=0).stop 2023-07-06T21:58:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.743+0000 7f908d407640 1 -- 172.21.15.55:0/2843975108 shutdown_connections 2023-07-06T21:58:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.743+0000 7f908d407640 1 --2- 172.21.15.55:0/2843975108 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f9068066100 0x7f90680685b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.743+0000 7f908d407640 1 --2- 172.21.15.55:0/2843975108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088158850 0x7f908809e250 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.743+0000 7f908d407640 1 --2- 172.21.15.55:0/2843975108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90880cd140 0x7f90881f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.743+0000 7f908d407640 1 --2- 172.21.15.55:0/2843975108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880ca130 0x7f90880c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.743+0000 7f908d407640 1 -- 172.21.15.55:0/2843975108 >> 172.21.15.55:0/2843975108 conn(0x7f90880cea70 msgr2=0x7f90880c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.743+0000 7f908d407640 1 -- 172.21.15.55:0/2843975108 shutdown_connections 2023-07-06T21:58:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.743+0000 7f908d407640 1 -- 172.21.15.55:0/2843975108 wait complete. 2023-07-06T21:58:25.745 INFO:tasks.ceph.mds.c.smithi055.stderr: -2605> 2023-07-06T21:58:05.784+0000 7f220ee74640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T21:58:25.766 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T21:58:25.799 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T21:58:25.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.911+0000 7f214ef1e640 1 Processor -- start 2023-07-06T21:58:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.911+0000 7f214ef1e640 1 -- start start 2023-07-06T21:58:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f214ef1e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f21480709a0 0x7f21480cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f214ef1e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21480b1340 0x7f214806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f214ef1e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21480cc300 con 0x7f21480cbe60 2023-07-06T21:58:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f214ef1e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21480cc5e0 con 0x7f21480709a0 2023-07-06T21:58:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f214ef1e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21480cc8c0 con 0x7f21480b1340 2023-07-06T21:58:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f2147fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f21480cbe60 0x7f21480b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58562/0 (socket says 172.21.15.55:58562) 2023-07-06T21:58:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f2147fff640 1 -- 172.21.15.55:0/472784801 learned_addr learned my addr 172.21.15.55:0/472784801 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f214d4bb640 1 --2- 172.21.15.55:0/472784801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21480b1340 0x7f214806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f214ccba640 1 --2- 172.21.15.55:0/472784801 >> v2:172.21.15.138:3300/0 conn(0x7f21480709a0 0x7f21480cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f21477fe640 1 -- 172.21.15.55:0/472784801 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921587007 0 0) 0x7f21480cc300 con 0x7f21480cbe60 2023-07-06T21:58:25.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f21477fe640 1 -- 172.21.15.55:0/472784801 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2138003530 con 0x7f21480cbe60 2023-07-06T21:58:25.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f214d4bb640 1 -- 172.21.15.55:0/472784801 >> v2:172.21.15.138:3300/0 conn(0x7f21480709a0 msgr2=0x7f21480cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:25.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f214d4bb640 1 --2- 172.21.15.55:0/472784801 >> v2:172.21.15.138:3300/0 conn(0x7f21480709a0 0x7f21480cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f214d4bb640 1 -- 172.21.15.55:0/472784801 >> v1:172.21.15.55:6789/0 conn(0x7f21480cbe60 legacy=0x7f21480b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f214d4bb640 1 -- 172.21.15.55:0/472784801 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21480ccba0 con 0x7f21480b1340 2023-07-06T21:58:25.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.915+0000 7f214ccba640 1 --2- 172.21.15.55:0/472784801 >> v2:172.21.15.138:3300/0 conn(0x7f21480709a0 0x7f21480cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:25.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.919+0000 7f214d4bb640 1 --2- 172.21.15.55:0/472784801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21480b1340 0x7f214806eee0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2140009d90 tx=0x7f214001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=349a17238e629404 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:25.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.919+0000 7f21477fe640 1 -- 172.21.15.55:0/472784801 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21400a5920 con 0x7f21480b1340 2023-07-06T21:58:25.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.919+0000 7f21477fe640 1 -- 172.21.15.55:0/472784801 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21400a5a80 con 0x7f21480b1340 2023-07-06T21:58:25.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.919+0000 7f21477fe640 1 -- 172.21.15.55:0/472784801 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21400a5e10 con 0x7f21480b1340 2023-07-06T21:58:25.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.919+0000 7f214ef1e640 1 -- 172.21.15.55:0/472784801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21480b1340 msgr2=0x7f214806eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.919+0000 7f214ef1e640 1 --2- 172.21.15.55:0/472784801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21480b1340 0x7f214806eee0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2140009d90 tx=0x7f214001c950 comp rx=0 tx=0).stop 2023-07-06T21:58:25.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.919+0000 7f214ef1e640 1 -- 172.21.15.55:0/472784801 shutdown_connections 2023-07-06T21:58:25.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.919+0000 7f214ef1e640 1 --2- 172.21.15.55:0/472784801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21480b1340 0x7f214806eee0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.919+0000 7f214ef1e640 1 --2- 172.21.15.55:0/472784801 >> v2:172.21.15.138:3300/0 conn(0x7f21480709a0 0x7f21480cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.919+0000 7f214ef1e640 1 -- 172.21.15.55:0/472784801 >> 172.21.15.55:0/472784801 conn(0x7f21480cea70 msgr2=0x7f21480ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:25.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.919+0000 7f214ef1e640 1 -- 172.21.15.55:0/472784801 shutdown_connections 2023-07-06T21:58:25.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.919+0000 7f214ef1e640 1 -- 172.21.15.55:0/472784801 wait complete. 2023-07-06T21:58:25.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.919+0000 7f214ef1e640 1 Processor -- start 2023-07-06T21:58:25.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.919+0000 7f214ef1e640 1 -- start start 2023-07-06T21:58:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ef1e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21480709a0 0x7f21481571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ef1e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21480b1340 0x7f21481582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ef1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21480cbe60 0x7f2148161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ef1e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2148157710 con 0x7f21480cbe60 2023-07-06T21:58:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ef1e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2148160080 con 0x7f21480709a0 2023-07-06T21:58:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ef1e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2148160c00 con 0x7f21480b1340 2023-07-06T21:58:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214d4bb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21480cbe60 0x7f2148161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ccba640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21480709a0 0x7f21481571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ccba640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21480709a0 0x7f21481571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:47904/0 (socket says 172.21.15.55:47904) 2023-07-06T21:58:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ccba640 1 -- 172.21.15.55:0/2813300559 learned_addr learned my addr 172.21.15.55:0/2813300559 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f2147fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21480b1340 0x7f21481582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ccba640 1 -- 172.21.15.55:0/2813300559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21480b1340 msgr2=0x7f21481582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ccba640 1 --2- 172.21.15.55:0/2813300559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21480b1340 0x7f21481582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ccba640 1 -- 172.21.15.55:0/2813300559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21480cbe60 msgr2=0x7f2148161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:25.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ccba640 1 --2- 172.21.15.55:0/2813300559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21480cbe60 0x7f2148161090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:25.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ccba640 1 -- 172.21.15.55:0/2813300559 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c009420 con 0x7f21480709a0 2023-07-06T21:58:25.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ccba640 1 --2- 172.21.15.55:0/2813300559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21480709a0 0x7f21481571d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f213c00ebe0 tx=0x7f213c00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:25.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f21457fa640 1 -- 172.21.15.55:0/2813300559 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c00eee0 con 0x7f21480709a0 2023-07-06T21:58:25.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f21457fa640 1 -- 172.21.15.55:0/2813300559 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c00cc30 con 0x7f21480709a0 2023-07-06T21:58:25.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ef1e640 1 -- 172.21.15.55:0/2813300559 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2140009a70 con 0x7f21480709a0 2023-07-06T21:58:25.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f21457fa640 1 -- 172.21.15.55:0/2813300559 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c013470 con 0x7f21480709a0 2023-07-06T21:58:25.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ef1e640 1 -- 172.21.15.55:0/2813300559 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21481605b0 con 0x7f21480709a0 2023-07-06T21:58:25.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.923+0000 7f214ef1e640 1 -- 172.21.15.55:0/2813300559 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2148066d60 con 0x7f21480709a0 2023-07-06T21:58:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.927+0000 7f21457fa640 1 -- 172.21.15.55:0/2813300559 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f213c0059a0 con 0x7f21480709a0 2023-07-06T21:58:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.927+0000 7f21457fa640 1 --2- 172.21.15.55:0/2813300559 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f212c0663a0 0x7f212c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.927+0000 7f21457fa640 1 -- 172.21.15.55:0/2813300559 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7199+0+0 (secure 0 0 0) 0x7f213c084bb0 con 0x7f21480709a0 2023-07-06T21:58:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.927+0000 7f2147fff640 1 --2- 172.21.15.55:0/2813300559 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f212c0663a0 0x7f212c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.927+0000 7f2147fff640 1 --2- 172.21.15.55:0/2813300559 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f212c0663a0 0x7f212c068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2134007fd0 tx=0x7f2134009040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:25.931+0000 7f21457fa640 1 -- 172.21.15.55:0/2813300559 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f213c051b50 con 0x7f21480709a0 2023-07-06T21:58:26.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.115+0000 7f214ef1e640 1 -- 172.21.15.55:0/2813300559 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2148159340 con 0x7f21480709a0 2023-07-06T21:58:26.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.751+0000 7f21457fa640 1 -- 172.21.15.55:0/2813300559 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7f213c055170 con 0x7f21480709a0 2023-07-06T21:58:26.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.755+0000 7f214ef1e640 1 -- 172.21.15.55:0/2813300559 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f212c0663a0 msgr2=0x7f212c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:26.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.755+0000 7f214ef1e640 1 --2- 172.21.15.55:0/2813300559 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f212c0663a0 0x7f212c068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2134007fd0 tx=0x7f2134009040 comp rx=0 tx=0).stop 2023-07-06T21:58:26.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.755+0000 7f214ef1e640 1 -- 172.21.15.55:0/2813300559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21480709a0 msgr2=0x7f21481571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:26.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.755+0000 7f214ef1e640 1 --2- 172.21.15.55:0/2813300559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21480709a0 0x7f21481571d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f213c00ebe0 tx=0x7f213c00c520 comp rx=0 tx=0).stop 2023-07-06T21:58:26.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.755+0000 7f214ef1e640 1 -- 172.21.15.55:0/2813300559 shutdown_connections 2023-07-06T21:58:26.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.755+0000 7f214ef1e640 1 --2- 172.21.15.55:0/2813300559 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f212c0663a0 0x7f212c068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:26.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.755+0000 7f214ef1e640 1 --2- 172.21.15.55:0/2813300559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21480cbe60 0x7f2148161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.755+0000 7f214ef1e640 1 --2- 172.21.15.55:0/2813300559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21480b1340 0x7f21481582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.755+0000 7f214ef1e640 1 --2- 172.21.15.55:0/2813300559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21480709a0 0x7f21481571d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.755+0000 7f214ef1e640 1 -- 172.21.15.55:0/2813300559 >> 172.21.15.55:0/2813300559 conn(0x7f21480cea70 msgr2=0x7f21480c5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.755+0000 7f214ef1e640 1 -- 172.21.15.55:0/2813300559 shutdown_connections 2023-07-06T21:58:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.755+0000 7f214ef1e640 1 -- 172.21.15.55:0/2813300559 wait complete. 2023-07-06T21:58:26.776 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T21:58:26.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f107b52c640 1 Processor -- start 2023-07-06T21:58:26.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f107b52c640 1 -- start start 2023-07-06T21:58:26.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f107b52c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f10740cf0f0 0x7f10740cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:26.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f107b52c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10741599d0 0x7f10740cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:26.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f107b52c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f107406c710 0x7f10740cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:26.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f107b52c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10740cfa00 con 0x7f107406c710 2023-07-06T21:58:26.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f107b52c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10740ce180 con 0x7f10740cf0f0 2023-07-06T21:58:26.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f107b52c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10740ce460 con 0x7f10741599d0 2023-07-06T21:58:26.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f1079ac9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f107406c710 0x7f10740cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:26.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f1079ac9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f107406c710 0x7f10740cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33252/0 (socket says 172.21.15.55:33252) 2023-07-06T21:58:26.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f1079ac9640 1 -- 172.21.15.55:0/2172311828 learned_addr learned my addr 172.21.15.55:0/2172311828 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:26.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f10792c8640 1 --2- 172.21.15.55:0/2172311828 >> v2:172.21.15.138:3300/0 conn(0x7f10740cf0f0 0x7f10740cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:26.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f1078ac7640 1 --2- 172.21.15.55:0/2172311828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10741599d0 0x7f10740cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:26.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f1079ac9640 1 -- 172.21.15.55:0/2172311828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10741599d0 msgr2=0x7f10740cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:26.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f1079ac9640 1 --2- 172.21.15.55:0/2172311828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10741599d0 0x7f10740cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:26.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f1079ac9640 1 -- 172.21.15.55:0/2172311828 >> v2:172.21.15.138:3300/0 conn(0x7f10740cf0f0 msgr2=0x7f10740cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:26.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f1079ac9640 1 --2- 172.21.15.55:0/2172311828 >> v2:172.21.15.138:3300/0 conn(0x7f10740cf0f0 0x7f10740cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:26.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.971+0000 7f1079ac9640 1 -- 172.21.15.55:0/2172311828 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10740ce740 con 0x7f107406c710 2023-07-06T21:58:26.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.975+0000 7f1079ac9640 1 --2- 172.21.15.55:0/2172311828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107406c710 0x7f10740cb9f0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f1074070da0 tx=0x7f106c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b69f50645252d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:26.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.975+0000 7f106bfff640 1 -- 172.21.15.55:0/2172311828 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c0a5820 con 0x7f107406c710 2023-07-06T21:58:26.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.975+0000 7f106bfff640 1 -- 172.21.15.55:0/2172311828 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c0a5980 con 0x7f107406c710 2023-07-06T21:58:26.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.975+0000 7f106bfff640 1 -- 172.21.15.55:0/2172311828 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c0a5d10 con 0x7f107406c710 2023-07-06T21:58:26.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.975+0000 7f107b52c640 1 -- 172.21.15.55:0/2172311828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107406c710 msgr2=0x7f10740cb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:26.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.975+0000 7f107b52c640 1 --2- 172.21.15.55:0/2172311828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107406c710 0x7f10740cb9f0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f1074070da0 tx=0x7f106c01c9a0 comp rx=0 tx=0).stop 2023-07-06T21:58:26.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.975+0000 7f107b52c640 1 -- 172.21.15.55:0/2172311828 shutdown_connections 2023-07-06T21:58:26.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.975+0000 7f107b52c640 1 --2- 172.21.15.55:0/2172311828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107406c710 0x7f10740cb9f0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:26.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.975+0000 7f107b52c640 1 --2- 172.21.15.55:0/2172311828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10741599d0 0x7f10740cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:26.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.975+0000 7f107b52c640 1 --2- 172.21.15.55:0/2172311828 >> v2:172.21.15.138:3300/0 conn(0x7f10740cf0f0 0x7f10740cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:26.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.975+0000 7f107b52c640 1 -- 172.21.15.55:0/2172311828 >> 172.21.15.55:0/2172311828 conn(0x7f10740d0c60 msgr2=0x7f10740b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:26.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.975+0000 7f107b52c640 1 -- 172.21.15.55:0/2172311828 shutdown_connections 2023-07-06T21:58:26.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.975+0000 7f107b52c640 1 -- 172.21.15.55:0/2172311828 wait complete. 2023-07-06T21:58:26.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f107b52c640 1 Processor -- start 2023-07-06T21:58:26.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f107b52c640 1 -- start start 2023-07-06T21:58:26.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f107b52c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f107406c710 0x7f107414b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:26.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f107b52c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740cf0f0 0x7f107414d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:26.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f107b52c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10741599d0 0x7f107414d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:26.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f107b52c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107415b4e0 con 0x7f10741599d0 2023-07-06T21:58:26.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f107b52c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107415c2d0 con 0x7f10740cf0f0 2023-07-06T21:58:26.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f107b52c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107414b690 con 0x7f107406c710 2023-07-06T21:58:26.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f1079ac9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10741599d0 0x7f107414d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:26.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f1079ac9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10741599d0 0x7f107414d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33256/0 (socket says 172.21.15.55:33256) 2023-07-06T21:58:26.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f1079ac9640 1 -- 172.21.15.55:0/2513392690 learned_addr learned my addr 172.21.15.55:0/2513392690 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:26.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f10792c8640 1 --2- 172.21.15.55:0/2513392690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f107406c710 0x7f107414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:26.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f1078ac7640 1 --2- 172.21.15.55:0/2513392690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740cf0f0 0x7f107414d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:26.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f1079ac9640 1 -- 172.21.15.55:0/2513392690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f107406c710 msgr2=0x7f107414b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:26.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f1079ac9640 1 --2- 172.21.15.55:0/2513392690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f107406c710 0x7f107414b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:26.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f1079ac9640 1 -- 172.21.15.55:0/2513392690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740cf0f0 msgr2=0x7f107414d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:26.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f1079ac9640 1 --2- 172.21.15.55:0/2513392690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740cf0f0 0x7f107414d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:26.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f1079ac9640 1 -- 172.21.15.55:0/2513392690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c009b30 con 0x7f10741599d0 2023-07-06T21:58:26.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f1079ac9640 1 --2- 172.21.15.55:0/2513392690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10741599d0 0x7f107414d790 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f106c0af040 tx=0x7f106c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:26.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f1069ffb640 1 -- 172.21.15.55:0/2513392690 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c0b8670 con 0x7f10741599d0 2023-07-06T21:58:26.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f1069ffb640 1 -- 172.21.15.55:0/2513392690 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c0b87d0 con 0x7f10741599d0 2023-07-06T21:58:26.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f1069ffb640 1 -- 172.21.15.55:0/2513392690 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c0b8b80 con 0x7f10741599d0 2023-07-06T21:58:26.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f107b52c640 1 -- 172.21.15.55:0/2513392690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10740af8e0 con 0x7f10741599d0 2023-07-06T21:58:26.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.979+0000 7f107b52c640 1 -- 172.21.15.55:0/2513392690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107415b9a0 con 0x7f10741599d0 2023-07-06T21:58:26.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.983+0000 7f107b52c640 1 -- 172.21.15.55:0/2513392690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10741540a0 con 0x7f10741599d0 2023-07-06T21:58:26.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.983+0000 7f1069ffb640 1 -- 172.21.15.55:0/2513392690 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f106c0b8ce0 con 0x7f10741599d0 2023-07-06T21:58:26.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.983+0000 7f1069ffb640 1 --2- 172.21.15.55:0/2513392690 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f10580663a0 0x7f1058068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:26.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.983+0000 7f1069ffb640 1 -- 172.21.15.55:0/2513392690 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7199+0+0 (secure 0 0 0) 0x7f106c11f850 con 0x7f10741599d0 2023-07-06T21:58:26.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.983+0000 7f10792c8640 1 --2- 172.21.15.55:0/2513392690 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f10580663a0 0x7f1058068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:26.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.987+0000 7f10792c8640 1 --2- 172.21.15.55:0/2513392690 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f10580663a0 0x7f1058068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f10700045f0 tx=0x7f1070008040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:26.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:26.991+0000 7f1069ffb640 1 -- 172.21.15.55:0/2513392690 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f10741540a0 con 0x7f10741599d0 2023-07-06T21:58:27.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.143+0000 7f107b52c640 1 -- 172.21.15.55:0/2513392690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f10741540a0 con 0x7f10741599d0 2023-07-06T21:58:27.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.763+0000 7f1069ffb640 1 -- 172.21.15.55:0/2513392690 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v107) v1 ==== 181+0+0 (secure 0 0 0) 0x7f10741540a0 con 0x7f10741599d0 2023-07-06T21:58:27.763 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-07-06T21:58:27.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.767+0000 7f107b52c640 1 -- 172.21.15.55:0/2513392690 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f10580663a0 msgr2=0x7f1058068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:27.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.767+0000 7f107b52c640 1 --2- 172.21.15.55:0/2513392690 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f10580663a0 0x7f1058068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f10700045f0 tx=0x7f1070008040 comp rx=0 tx=0).stop 2023-07-06T21:58:27.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.767+0000 7f107b52c640 1 -- 172.21.15.55:0/2513392690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10741599d0 msgr2=0x7f107414d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:27.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.767+0000 7f107b52c640 1 --2- 172.21.15.55:0/2513392690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10741599d0 0x7f107414d790 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f106c0af040 tx=0x7f106c019740 comp rx=0 tx=0).stop 2023-07-06T21:58:27.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.767+0000 7f107b52c640 1 -- 172.21.15.55:0/2513392690 shutdown_connections 2023-07-06T21:58:27.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.767+0000 7f107b52c640 1 --2- 172.21.15.55:0/2513392690 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f10580663a0 0x7f1058068850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:27.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.767+0000 7f107b52c640 1 --2- 172.21.15.55:0/2513392690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10741599d0 0x7f107414d790 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:27.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.767+0000 7f107b52c640 1 --2- 172.21.15.55:0/2513392690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740cf0f0 0x7f107414d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:27.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.767+0000 7f107b52c640 1 --2- 172.21.15.55:0/2513392690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f107406c710 0x7f107414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:27.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.767+0000 7f107b52c640 1 -- 172.21.15.55:0/2513392690 >> 172.21.15.55:0/2513392690 conn(0x7f10740d0c60 msgr2=0x7f10740b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:27.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.767+0000 7f107b52c640 1 -- 172.21.15.55:0/2513392690 shutdown_connections 2023-07-06T21:58:27.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.767+0000 7f107b52c640 1 -- 172.21.15.55:0/2513392690 wait complete. 2023-07-06T21:58:27.792 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T21:58:27.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5fb11640 1 Processor -- start 2023-07-06T21:58:27.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5fb11640 1 -- start start 2023-07-06T21:58:27.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5fb11640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8a5815ff90 0x7f8a580cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:27.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5fb11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a58070ab0 0x7f8a580cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:27.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5fb11640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a580ca720 con 0x7f8a580cc730 2023-07-06T21:58:27.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5fb11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a58160360 con 0x7f8a58070ab0 2023-07-06T21:58:27.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5fb11640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a580cba00 con 0x7f8a5815ff90 2023-07-06T21:58:27.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5d0ac640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8a580cc730 0x7f8a580c0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58568/0 (socket says 172.21.15.55:58568) 2023-07-06T21:58:27.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5d0ac640 1 -- 172.21.15.55:0/2666960355 learned_addr learned my addr 172.21.15.55:0/2666960355 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:27.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5e0ae640 1 --2- 172.21.15.55:0/2666960355 >> v2:172.21.15.55:3300/0 conn(0x7f8a58070ab0 0x7f8a580cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:27.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5d8ad640 1 --2- 172.21.15.55:0/2666960355 >> v2:172.21.15.138:3300/0 conn(0x7f8a5815ff90 0x7f8a580cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:27.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5c8ab640 1 -- 172.21.15.55:0/2666960355 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527537855 0 0) 0x7f8a580ca720 con 0x7f8a580cc730 2023-07-06T21:58:27.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5c8ab640 1 -- 172.21.15.55:0/2666960355 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a44003530 con 0x7f8a580cc730 2023-07-06T21:58:27.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5e0ae640 1 -- 172.21.15.55:0/2666960355 >> v2:172.21.15.138:3300/0 conn(0x7f8a5815ff90 msgr2=0x7f8a580cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:27.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5e0ae640 1 --2- 172.21.15.55:0/2666960355 >> v2:172.21.15.138:3300/0 conn(0x7f8a5815ff90 0x7f8a580cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:27.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5e0ae640 1 -- 172.21.15.55:0/2666960355 >> v1:172.21.15.55:6789/0 conn(0x7f8a580cc730 legacy=0x7f8a580c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:27.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.951+0000 7f8a5e0ae640 1 -- 172.21.15.55:0/2666960355 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5806d160 con 0x7f8a58070ab0 2023-07-06T21:58:27.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.955+0000 7f8a5e0ae640 1 --2- 172.21.15.55:0/2666960355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a58070ab0 0x7f8a580cd740 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f8a5806af90 tx=0x7f8a5001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213a99bf179dd398 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:27.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.955+0000 7f8a5c8ab640 1 -- 172.21.15.55:0/2666960355 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a500a5910 con 0x7f8a58070ab0 2023-07-06T21:58:27.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.955+0000 7f8a5c8ab640 1 -- 172.21.15.55:0/2666960355 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a500a5a70 con 0x7f8a58070ab0 2023-07-06T21:58:27.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.955+0000 7f8a5c8ab640 1 -- 172.21.15.55:0/2666960355 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a500a5e00 con 0x7f8a58070ab0 2023-07-06T21:58:27.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.955+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2666960355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a58070ab0 msgr2=0x7f8a580cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:27.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.955+0000 7f8a5fb11640 1 --2- 172.21.15.55:0/2666960355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a58070ab0 0x7f8a580cd740 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f8a5806af90 tx=0x7f8a5001c850 comp rx=0 tx=0).stop 2023-07-06T21:58:27.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.955+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2666960355 shutdown_connections 2023-07-06T21:58:27.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.955+0000 7f8a5fb11640 1 --2- 172.21.15.55:0/2666960355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a58070ab0 0x7f8a580cd740 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:27.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.955+0000 7f8a5fb11640 1 --2- 172.21.15.55:0/2666960355 >> v2:172.21.15.138:3300/0 conn(0x7f8a5815ff90 0x7f8a580cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:27.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.955+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2666960355 >> 172.21.15.55:0/2666960355 conn(0x7f8a580cde30 msgr2=0x7f8a580ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:27.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.955+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2666960355 shutdown_connections 2023-07-06T21:58:27.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.955+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2666960355 wait complete. 2023-07-06T21:58:27.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5fb11640 1 Processor -- start 2023-07-06T21:58:27.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5fb11640 1 -- start start 2023-07-06T21:58:27.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5fb11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a58070ab0 0x7f8a58159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:27.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5fb11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a580cc730 0x7f8a58155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:27.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5fb11640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a5815ff90 0x7f8a580693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:27.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5fb11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5815a3f0 con 0x7f8a58070ab0 2023-07-06T21:58:27.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5fb11640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a581597e0 con 0x7f8a5815ff90 2023-07-06T21:58:27.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5fb11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a58159ac0 con 0x7f8a580cc730 2023-07-06T21:58:27.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5d8ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a58070ab0 0x7f8a58159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:27.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5d8ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a58070ab0 0x7f8a58159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33272/0 (socket says 172.21.15.55:33272) 2023-07-06T21:58:27.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5d8ad640 1 -- 172.21.15.55:0/2264176254 learned_addr learned my addr 172.21.15.55:0/2264176254 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:27.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5d0ac640 1 --2- 172.21.15.55:0/2264176254 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a580cc730 0x7f8a58155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:27.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5e0ae640 1 --2- 172.21.15.55:0/2264176254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a5815ff90 0x7f8a580693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:27.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5d8ad640 1 -- 172.21.15.55:0/2264176254 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a580cc730 msgr2=0x7f8a58155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:27.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5d8ad640 1 --2- 172.21.15.55:0/2264176254 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a580cc730 0x7f8a58155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:27.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5d8ad640 1 -- 172.21.15.55:0/2264176254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a5815ff90 msgr2=0x7f8a580693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:27.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5d8ad640 1 --2- 172.21.15.55:0/2264176254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a5815ff90 0x7f8a580693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:27.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5d8ad640 1 -- 172.21.15.55:0/2264176254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a50009a70 con 0x7f8a58070ab0 2023-07-06T21:58:27.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5d8ad640 1 --2- 172.21.15.55:0/2264176254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a58070ab0 0x7f8a58159200 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400d800 tx=0x7f8a5400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:27.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a4e7fc640 1 -- 172.21.15.55:0/2264176254 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400b6c0 con 0x7f8a58070ab0 2023-07-06T21:58:27.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a4e7fc640 1 -- 172.21.15.55:0/2264176254 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5400b820 con 0x7f8a58070ab0 2023-07-06T21:58:27.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a4e7fc640 1 -- 172.21.15.55:0/2264176254 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400bb90 con 0x7f8a58070ab0 2023-07-06T21:58:27.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2264176254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a58159da0 con 0x7f8a58070ab0 2023-07-06T21:58:27.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.959+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2264176254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a581527c0 con 0x7f8a58070ab0 2023-07-06T21:58:27.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.963+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2264176254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a581529e0 con 0x7f8a58070ab0 2023-07-06T21:58:27.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.963+0000 7f8a4e7fc640 1 -- 172.21.15.55:0/2264176254 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8a5400bcf0 con 0x7f8a58070ab0 2023-07-06T21:58:27.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.963+0000 7f8a4e7fc640 1 --2- 172.21.15.55:0/2264176254 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8a3c0663a0 0x7f8a3c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:27.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.963+0000 7f8a4e7fc640 1 -- 172.21.15.55:0/2264176254 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f8a54084640 con 0x7f8a58070ab0 2023-07-06T21:58:27.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.963+0000 7f8a5d0ac640 1 --2- 172.21.15.55:0/2264176254 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8a3c0663a0 0x7f8a3c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:27.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.963+0000 7f8a5d0ac640 1 --2- 172.21.15.55:0/2264176254 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8a3c0663a0 0x7f8a3c068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8a580b3d90 tx=0x7f8a48009040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:27.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:27.967+0000 7f8a4e7fc640 1 -- 172.21.15.55:0/2264176254 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a54055210 con 0x7f8a58070ab0 2023-07-06T21:58:28.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.123+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2264176254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8a5806cd70 con 0x7f8a58070ab0 2023-07-06T21:58:28.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.771+0000 7f8a4e7fc640 1 -- 172.21.15.55:0/2264176254 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v108) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8a54054da0 con 0x7f8a58070ab0 2023-07-06T21:58:28.772 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-07-06T21:58:28.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.775+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2264176254 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8a3c0663a0 msgr2=0x7f8a3c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:28.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.775+0000 7f8a5fb11640 1 --2- 172.21.15.55:0/2264176254 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8a3c0663a0 0x7f8a3c068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8a580b3d90 tx=0x7f8a48009040 comp rx=0 tx=0).stop 2023-07-06T21:58:28.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.775+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2264176254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a58070ab0 msgr2=0x7f8a58159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:28.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.775+0000 7f8a5fb11640 1 --2- 172.21.15.55:0/2264176254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a58070ab0 0x7f8a58159200 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400d800 tx=0x7f8a5400dcc0 comp rx=0 tx=0).stop 2023-07-06T21:58:28.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.775+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2264176254 shutdown_connections 2023-07-06T21:58:28.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.775+0000 7f8a5fb11640 1 --2- 172.21.15.55:0/2264176254 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8a3c0663a0 0x7f8a3c068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:28.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.775+0000 7f8a5fb11640 1 --2- 172.21.15.55:0/2264176254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a5815ff90 0x7f8a580693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:28.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.775+0000 7f8a5fb11640 1 --2- 172.21.15.55:0/2264176254 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a580cc730 0x7f8a58155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:28.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.775+0000 7f8a5fb11640 1 --2- 172.21.15.55:0/2264176254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a58070ab0 0x7f8a58159200 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:28.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.775+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2264176254 >> 172.21.15.55:0/2264176254 conn(0x7f8a580cde30 msgr2=0x7f8a580ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:28.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.775+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2264176254 shutdown_connections 2023-07-06T21:58:28.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.775+0000 7f8a5fb11640 1 -- 172.21.15.55:0/2264176254 wait complete. 2023-07-06T21:58:28.817 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-06T21:58:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f37a600b640 1 Processor -- start 2023-07-06T21:58:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f37a600b640 1 -- start start 2023-07-06T21:58:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f37a600b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37a0158850 0x7f37a00cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f37a600b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37a0070af0 0x7f37a00ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:28.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f37a600b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a0158c20 con 0x7f37a00ca130 2023-07-06T21:58:28.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f37a600b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a00b2aa0 con 0x7f37a0070af0 2023-07-06T21:58:28.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f37a600b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00c8db0 con 0x7f37a0158850 2023-07-06T21:58:28.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f379effd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f37a00ca130 0x7f37a00703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58584/0 (socket says 172.21.15.55:58584) 2023-07-06T21:58:28.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f379effd640 1 -- 172.21.15.55:0/3751696946 learned_addr learned my addr 172.21.15.55:0/3751696946 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:28.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f379ffff640 1 --2- 172.21.15.55:0/3751696946 >> v2:172.21.15.55:3300/0 conn(0x7f37a0070af0 0x7f37a00ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:28.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f379f7fe640 1 --2- 172.21.15.55:0/3751696946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37a0158850 0x7f37a00cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:28.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f379e7fc640 1 -- 172.21.15.55:0/3751696946 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720682728 0 0) 0x7f37a0158c20 con 0x7f37a00ca130 2023-07-06T21:58:28.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f379e7fc640 1 -- 172.21.15.55:0/3751696946 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3788003530 con 0x7f37a00ca130 2023-07-06T21:58:28.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f379ffff640 1 -- 172.21.15.55:0/3751696946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37a0158850 msgr2=0x7f37a00cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f379ffff640 1 --2- 172.21.15.55:0/3751696946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37a0158850 0x7f37a00cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f379ffff640 1 -- 172.21.15.55:0/3751696946 >> v1:172.21.15.55:6789/0 conn(0x7f37a00ca130 legacy=0x7f37a00703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.967+0000 7f379ffff640 1 -- 172.21.15.55:0/3751696946 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a00c9090 con 0x7f37a0070af0 2023-07-06T21:58:28.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.971+0000 7f379ffff640 1 --2- 172.21.15.55:0/3751696946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a0070af0 0x7f37a00ccf70 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f3798009d90 tx=0x7f379801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9b6137b3aa1f22 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:28.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.971+0000 7f379e7fc640 1 -- 172.21.15.55:0/3751696946 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37980af600 con 0x7f37a0070af0 2023-07-06T21:58:28.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.971+0000 7f379e7fc640 1 -- 172.21.15.55:0/3751696946 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37980ab050 con 0x7f37a0070af0 2023-07-06T21:58:28.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.971+0000 7f379e7fc640 1 -- 172.21.15.55:0/3751696946 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37980af960 con 0x7f37a0070af0 2023-07-06T21:58:28.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.971+0000 7f37a600b640 1 -- 172.21.15.55:0/3751696946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a0070af0 msgr2=0x7f37a00ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:28.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.971+0000 7f37a600b640 1 --2- 172.21.15.55:0/3751696946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a0070af0 0x7f37a00ccf70 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f3798009d90 tx=0x7f379801f130 comp rx=0 tx=0).stop 2023-07-06T21:58:28.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.971+0000 7f37a600b640 1 -- 172.21.15.55:0/3751696946 shutdown_connections 2023-07-06T21:58:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.971+0000 7f37a600b640 1 --2- 172.21.15.55:0/3751696946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a0070af0 0x7f37a00ccf70 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.971+0000 7f37a600b640 1 --2- 172.21.15.55:0/3751696946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37a0158850 0x7f37a00cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.971+0000 7f37a600b640 1 -- 172.21.15.55:0/3751696946 >> 172.21.15.55:0/3751696946 conn(0x7f37a00cea70 msgr2=0x7f37a00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.971+0000 7f37a600b640 1 -- 172.21.15.55:0/3751696946 shutdown_connections 2023-07-06T21:58:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.971+0000 7f37a600b640 1 -- 172.21.15.55:0/3751696946 wait complete. 2023-07-06T21:58:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f37a600b640 1 Processor -- start 2023-07-06T21:58:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f37a600b640 1 -- start start 2023-07-06T21:58:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f37a600b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37a0070af0 0x7f37a00c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f37a600b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37a00ca130 0x7f37a00c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f37a600b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a0158850 0x7f37a00ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f37a600b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00c79d0 con 0x7f37a0158850 2023-07-06T21:58:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f37a600b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00c6dc0 con 0x7f37a0070af0 2023-07-06T21:58:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f37a600b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00c70a0 con 0x7f37a00ca130 2023-07-06T21:58:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f379ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a0158850 0x7f37a00ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f379ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a0158850 0x7f37a00ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33294/0 (socket says 172.21.15.55:33294) 2023-07-06T21:58:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f379ffff640 1 -- 172.21.15.55:0/3469495197 learned_addr learned my addr 172.21.15.55:0/3469495197 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f379effd640 1 --2- 172.21.15.55:0/3469495197 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37a00ca130 0x7f37a00c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f379f7fe640 1 --2- 172.21.15.55:0/3469495197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37a0070af0 0x7f37a00c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f379ffff640 1 -- 172.21.15.55:0/3469495197 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37a00ca130 msgr2=0x7f37a00c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f379ffff640 1 --2- 172.21.15.55:0/3469495197 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37a00ca130 0x7f37a00c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f379ffff640 1 -- 172.21.15.55:0/3469495197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37a0070af0 msgr2=0x7f37a00c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f379ffff640 1 --2- 172.21.15.55:0/3469495197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37a0070af0 0x7f37a00c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f379ffff640 1 -- 172.21.15.55:0/3469495197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3798009a70 con 0x7f37a0158850 2023-07-06T21:58:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f379ffff640 1 --2- 172.21.15.55:0/3469495197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a0158850 0x7f37a00ae410 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f379801cd60 tx=0x7f379801bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f3787fff640 1 -- 172.21.15.55:0/3469495197 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798009450 con 0x7f37a0158850 2023-07-06T21:58:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f3787fff640 1 -- 172.21.15.55:0/3469495197 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37980afcf0 con 0x7f37a0158850 2023-07-06T21:58:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f37a600b640 1 -- 172.21.15.55:0/3469495197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a00c7380 con 0x7f37a0158850 2023-07-06T21:58:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f3787fff640 1 -- 172.21.15.55:0/3469495197 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37980ba620 con 0x7f37a0158850 2023-07-06T21:58:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.975+0000 7f37a600b640 1 -- 172.21.15.55:0/3469495197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a00c44c0 con 0x7f37a0158850 2023-07-06T21:58:28.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.979+0000 7f37a600b640 1 -- 172.21.15.55:0/3469495197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a00c7b80 con 0x7f37a0158850 2023-07-06T21:58:28.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.979+0000 7f3787fff640 1 -- 172.21.15.55:0/3469495197 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f37980ba780 con 0x7f37a0158850 2023-07-06T21:58:28.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.979+0000 7f3787fff640 1 --2- 172.21.15.55:0/3469495197 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f378c0663a0 0x7f378c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:28.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.979+0000 7f3787fff640 1 -- 172.21.15.55:0/3469495197 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f3798122890 con 0x7f37a0158850 2023-07-06T21:58:28.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.979+0000 7f379f7fe640 1 --2- 172.21.15.55:0/3469495197 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f378c0663a0 0x7f378c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:28.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.979+0000 7f379f7fe640 1 --2- 172.21.15.55:0/3469495197 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f378c0663a0 0x7f378c068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3790009a50 tx=0x7f3790008040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:28.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:28.983+0000 7f3787fff640 1 -- 172.21.15.55:0/3469495197 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f37a00c7b80 con 0x7f37a0158850 2023-07-06T21:58:29.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.135+0000 7f37a600b640 1 -- 172.21.15.55:0/3469495197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f37a0066d60 con 0x7f37a0158850 2023-07-06T21:58:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.143+0000 7f3787fff640 1 -- 172.21.15.55:0/3469495197 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v31) v1 ==== 120+0+0 (secure 0 0 0) 0x7f37980f3450 con 0x7f37a0158850 2023-07-06T21:58:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.143+0000 7f37a600b640 1 -- 172.21.15.55:0/3469495197 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f378c0663a0 msgr2=0x7f378c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.143+0000 7f37a600b640 1 --2- 172.21.15.55:0/3469495197 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f378c0663a0 0x7f378c068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3790009a50 tx=0x7f3790008040 comp rx=0 tx=0).stop 2023-07-06T21:58:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.143+0000 7f37a600b640 1 -- 172.21.15.55:0/3469495197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a0158850 msgr2=0x7f37a00ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.143+0000 7f37a600b640 1 --2- 172.21.15.55:0/3469495197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a0158850 0x7f37a00ae410 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f379801cd60 tx=0x7f379801bed0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.143+0000 7f37a600b640 1 -- 172.21.15.55:0/3469495197 shutdown_connections 2023-07-06T21:58:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.143+0000 7f37a600b640 1 --2- 172.21.15.55:0/3469495197 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f378c0663a0 0x7f378c068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.143+0000 7f37a600b640 1 --2- 172.21.15.55:0/3469495197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a0158850 0x7f37a00ae410 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.143+0000 7f37a600b640 1 --2- 172.21.15.55:0/3469495197 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37a00ca130 0x7f37a00c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.143+0000 7f37a600b640 1 --2- 172.21.15.55:0/3469495197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37a0070af0 0x7f37a00c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.143+0000 7f37a600b640 1 -- 172.21.15.55:0/3469495197 >> 172.21.15.55:0/3469495197 conn(0x7f37a00cea70 msgr2=0x7f37a014fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.143+0000 7f37a600b640 1 -- 172.21.15.55:0/3469495197 shutdown_connections 2023-07-06T21:58:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.143+0000 7f37a600b640 1 -- 172.21.15.55:0/3469495197 wait complete. 2023-07-06T21:58:29.164 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-06T21:58:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.307+0000 7fa082940640 1 Processor -- start 2023-07-06T21:58:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.307+0000 7fa082940640 1 -- start start 2023-07-06T21:58:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa082940640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa07c0cd140 0x7fa07c163380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa082940640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c0b2aa0 con 0x7fa07c158850 2023-07-06T21:58:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa082940640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c158c20 con 0x7fa07c0ca130 2023-07-06T21:58:29.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa082940640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0c8db0 con 0x7fa07c0cd140 2023-07-06T21:58:29.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa07c158850 0x7fa07c0cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58592/0 (socket says 172.21.15.55:58592) 2023-07-06T21:58:29.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07bfff640 1 -- 172.21.15.55:0/2860094881 learned_addr learned my addr 172.21.15.55:0/2860094881 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:29.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa080edd640 1 --2- 172.21.15.55:0/2860094881 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa07c0cd140 0x7fa07c163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:29.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048694684 0 0) 0x7fa07c0b2aa0 con 0x7fa07c158850 2023-07-06T21:58:29.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa064005740 con 0x7fa07c158850 2023-07-06T21:58:29.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396860864 0 0) 0x7fa07c158c20 con 0x7fa07c0ca130 2023-07-06T21:58:29.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa07c0b2aa0 con 0x7fa07c0ca130 2023-07-06T21:58:29.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1485937813 0 0) 0x7fa064005740 con 0x7fa07c158850 2023-07-06T21:58:29.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa07c0cd140 msgr2=0x7fa07c163380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:29.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 --2- 172.21.15.55:0/2860094881 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa07c0cd140 0x7fa07c163380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 >> v1:172.21.15.138:6789/0 conn(0x7fa07c0ca130 legacy=0x7fa07c0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c0c9090 con 0x7fa07c158850 2023-07-06T21:58:29.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fa06c001680 con 0x7fa07c158850 2023-07-06T21:58:29.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 >> v1:172.21.15.55:6789/0 conn(0x7fa07c158850 legacy=0x7fa07c0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 --2- 172.21.15.55:0/2860094881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa064005d50 0x7fa064006140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:29.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 --2- 172.21.15.55:0/2860094881 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa07c0cd140 0x7fa0640069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:29.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 --2- 172.21.15.55:0/2860094881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa064006f20 0x7fa064007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0c8db0 con 0x7fa064005d50 2023-07-06T21:58:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06400dc50 con 0x7fa064006f20 2023-07-06T21:58:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06400ddc0 con 0x7fa07c0cd140 2023-07-06T21:58:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07bfff640 1 --2- 172.21.15.55:0/2860094881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa064005d50 0x7fa064006140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa080edd640 1 --2- 172.21.15.55:0/2860094881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa064006f20 0x7fa064007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07b7fe640 1 --2- 172.21.15.55:0/2860094881 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa07c0cd140 0x7fa0640069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07bfff640 1 -- 172.21.15.55:0/2860094881 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa07c0cd140 msgr2=0x7fa0640069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07bfff640 1 --2- 172.21.15.55:0/2860094881 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa07c0cd140 0x7fa0640069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07bfff640 1 -- 172.21.15.55:0/2860094881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa064006f20 msgr2=0x7fa064007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07bfff640 1 --2- 172.21.15.55:0/2860094881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa064006f20 0x7fa064007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07bfff640 1 -- 172.21.15.55:0/2860094881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa064005740 con 0x7fa064005d50 2023-07-06T21:58:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.311+0000 7fa07b7fe640 1 --2- 172.21.15.55:0/2860094881 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa07c0cd140 0x7fa0640069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.315+0000 7fa07bfff640 1 --2- 172.21.15.55:0/2860094881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa064005d50 0x7fa064006140 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00c160 tx=0x7fa06c01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92edfce64192bc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.315+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0058e0 con 0x7fa064005d50 2023-07-06T21:58:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.315+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c005a60 con 0x7fa064005d50 2023-07-06T21:58:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.315+0000 7fa07affd640 1 -- 172.21.15.55:0/2860094881 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c005e10 con 0x7fa064005d50 2023-07-06T21:58:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.315+0000 7fa082940640 1 -- 172.21.15.55:0/2860094881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa064005d50 msgr2=0x7fa064006140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.315+0000 7fa082940640 1 --2- 172.21.15.55:0/2860094881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa064005d50 0x7fa064006140 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00c160 tx=0x7fa06c01cb60 comp rx=0 tx=0).stop 2023-07-06T21:58:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.315+0000 7fa080edd640 1 -- 172.21.15.55:0/2860094881 reap_dead start 2023-07-06T21:58:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.315+0000 7fa082940640 1 -- 172.21.15.55:0/2860094881 shutdown_connections 2023-07-06T21:58:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.315+0000 7fa082940640 1 -- 172.21.15.55:0/2860094881 >> 172.21.15.55:0/2860094881 conn(0x7fa07c0cea70 msgr2=0x7fa07c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.315+0000 7fa082940640 1 -- 172.21.15.55:0/2860094881 shutdown_connections 2023-07-06T21:58:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.315+0000 7fa082940640 1 -- 172.21.15.55:0/2860094881 wait complete. 2023-07-06T21:58:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa082940640 1 Processor -- start 2023-07-06T21:58:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa082940640 1 -- start start 2023-07-06T21:58:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa082940640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa064005d50 0x7fa07c1f1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa082940640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa07c156710 0x7fa07c06bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa082940640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa07c156b60 0x7fa07c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa082940640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0c7870 con 0x7fa07c156b60 2023-07-06T21:58:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa082940640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c06a110 con 0x7fa064005d50 2023-07-06T21:58:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa082940640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0697e0 con 0x7fa07c156710 2023-07-06T21:58:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa080edd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa07c156b60 0x7fa07c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa080edd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa07c156b60 0x7fa07c06c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33312/0 (socket says 172.21.15.55:33312) 2023-07-06T21:58:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa080edd640 1 -- 172.21.15.55:0/3339679753 learned_addr learned my addr 172.21.15.55:0/3339679753 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa07bfff640 1 --2- 172.21.15.55:0/3339679753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa064005d50 0x7fa07c1f1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa07b7fe640 1 --2- 172.21.15.55:0/3339679753 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa07c156710 0x7fa07c06bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:29.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa080edd640 1 -- 172.21.15.55:0/3339679753 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa07c156710 msgr2=0x7fa07c06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa080edd640 1 --2- 172.21.15.55:0/3339679753 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa07c156710 0x7fa07c06bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa080edd640 1 -- 172.21.15.55:0/3339679753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa064005d50 msgr2=0x7fa07c1f1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa080edd640 1 --2- 172.21.15.55:0/3339679753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa064005d50 0x7fa07c1f1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa080edd640 1 -- 172.21.15.55:0/3339679753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c069ac0 con 0x7fa07c156b60 2023-07-06T21:58:29.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa080edd640 1 --2- 172.21.15.55:0/3339679753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa07c156b60 0x7fa07c06c510 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0b12f0 tx=0x7fa074011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:29.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa078ff9640 1 -- 172.21.15.55:0/3339679753 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07400e040 con 0x7fa07c156b60 2023-07-06T21:58:29.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa078ff9640 1 -- 172.21.15.55:0/3339679753 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07400f040 con 0x7fa07c156b60 2023-07-06T21:58:29.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa078ff9640 1 -- 172.21.15.55:0/3339679753 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074015a80 con 0x7fa07c156b60 2023-07-06T21:58:29.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa082940640 1 -- 172.21.15.55:0/3339679753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07c069da0 con 0x7fa07c156b60 2023-07-06T21:58:29.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa082940640 1 -- 172.21.15.55:0/3339679753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07c0c6cc0 con 0x7fa07c156b60 2023-07-06T21:58:29.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.319+0000 7fa082940640 1 -- 172.21.15.55:0/3339679753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07c06a2a0 con 0x7fa07c156b60 2023-07-06T21:58:29.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.323+0000 7fa078ff9640 1 -- 172.21.15.55:0/3339679753 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa074015be0 con 0x7fa07c156b60 2023-07-06T21:58:29.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.323+0000 7fa078ff9640 1 --2- 172.21.15.55:0/3339679753 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa0680663a0 0x7fa068068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:29.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.323+0000 7fa078ff9640 1 -- 172.21.15.55:0/3339679753 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6347+0+0 (secure 0 0 0) 0x7fa074084180 con 0x7fa07c156b60 2023-07-06T21:58:29.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.323+0000 7fa07bfff640 1 --2- 172.21.15.55:0/3339679753 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa0680663a0 0x7fa068068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:29.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.323+0000 7fa07bfff640 1 --2- 172.21.15.55:0/3339679753 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa0680663a0 0x7fa068068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00c160 tx=0x7fa06c001a00 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:29.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.327+0000 7fa078ff9640 1 -- 172.21.15.55:0/3339679753 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa074054cb0 con 0x7fa07c156b60 2023-07-06T21:58:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.483+0000 7fa082940640 1 -- 172.21.15.55:0/3339679753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa07c066d60 con 0x7fa07c156b60 2023-07-06T21:58:29.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.491+0000 7fa078ff9640 1 -- 172.21.15.55:0/3339679753 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa074054840 con 0x7fa07c156b60 2023-07-06T21:58:29.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.495+0000 7fa082940640 1 -- 172.21.15.55:0/3339679753 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa0680663a0 msgr2=0x7fa068068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.495+0000 7fa082940640 1 --2- 172.21.15.55:0/3339679753 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa0680663a0 0x7fa068068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00c160 tx=0x7fa06c001a00 comp rx=0 tx=0).stop 2023-07-06T21:58:29.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.495+0000 7fa082940640 1 -- 172.21.15.55:0/3339679753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa07c156b60 msgr2=0x7fa07c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.495+0000 7fa082940640 1 --2- 172.21.15.55:0/3339679753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa07c156b60 0x7fa07c06c510 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0b12f0 tx=0x7fa074011cb0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.495+0000 7fa082940640 1 -- 172.21.15.55:0/3339679753 shutdown_connections 2023-07-06T21:58:29.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.495+0000 7fa082940640 1 --2- 172.21.15.55:0/3339679753 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa0680663a0 0x7fa068068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.495+0000 7fa082940640 1 --2- 172.21.15.55:0/3339679753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa07c156b60 0x7fa07c06c510 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.495+0000 7fa082940640 1 --2- 172.21.15.55:0/3339679753 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa07c156710 0x7fa07c06bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.495+0000 7fa082940640 1 --2- 172.21.15.55:0/3339679753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa064005d50 0x7fa07c1f1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.495+0000 7fa082940640 1 -- 172.21.15.55:0/3339679753 >> 172.21.15.55:0/3339679753 conn(0x7fa07c0cea70 msgr2=0x7fa07c0af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:29.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.495+0000 7fa082940640 1 -- 172.21.15.55:0/3339679753 shutdown_connections 2023-07-06T21:58:29.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.495+0000 7fa082940640 1 -- 172.21.15.55:0/3339679753 wait complete. 2023-07-06T21:58:29.512 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-06T21:58:29.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe63d511640 1 Processor -- start 2023-07-06T21:58:29.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe63d511640 1 -- start start 2023-07-06T21:58:29.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe63d511640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe638157290 0x7fe63815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:29.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe63d511640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe63815d2d0 0x7fe63806e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:29.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe63d511640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe638157660 con 0x7fe63815d6e0 2023-07-06T21:58:29.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe63d511640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe638159ce0 con 0x7fe63815d2d0 2023-07-06T21:58:29.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe63d511640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63815ac10 con 0x7fe638157290 2023-07-06T21:58:29.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe62e7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe63815d2d0 0x7fe63806e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:29.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe62e7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe63815d2d0 0x7fe63806e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33314/0 (socket says 172.21.15.55:33314) 2023-07-06T21:58:29.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe62e7fc640 1 -- 172.21.15.55:0/1344467613 learned_addr learned my addr 172.21.15.55:0/1344467613 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:29.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe636ffd640 1 --2- 172.21.15.55:0/1344467613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe638157290 0x7fe63815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:29.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe62e7fc640 1 -- 172.21.15.55:0/1344467613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe638157290 msgr2=0x7fe63815a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:29.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe62e7fc640 1 --2- 172.21.15.55:0/1344467613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe638157290 0x7fe63815a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe62e7fc640 1 -- 172.21.15.55:0/1344467613 >> v1:172.21.15.138:6789/0 conn(0x7fe63815d6e0 legacy=0x7fe6380cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.659+0000 7fe62e7fc640 1 -- 172.21.15.55:0/1344467613 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63815dc90 con 0x7fe63815d2d0 2023-07-06T21:58:29.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.663+0000 7fe62e7fc640 1 --2- 172.21.15.55:0/1344467613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63815d2d0 0x7fe63806e9d0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fe620009e50 tx=0x7fe62001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6b05a2a6d559e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:29.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.663+0000 7fe6367fc640 1 -- 172.21.15.55:0/1344467613 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6200a5750 con 0x7fe63815d2d0 2023-07-06T21:58:29.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.663+0000 7fe6367fc640 1 -- 172.21.15.55:0/1344467613 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6200a58b0 con 0x7fe63815d2d0 2023-07-06T21:58:29.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.663+0000 7fe6367fc640 1 -- 172.21.15.55:0/1344467613 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6200a5c40 con 0x7fe63815d2d0 2023-07-06T21:58:29.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.663+0000 7fe63d511640 1 -- 172.21.15.55:0/1344467613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63815d2d0 msgr2=0x7fe63806e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.663+0000 7fe63d511640 1 --2- 172.21.15.55:0/1344467613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63815d2d0 0x7fe63806e9d0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fe620009e50 tx=0x7fe62001c980 comp rx=0 tx=0).stop 2023-07-06T21:58:29.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.663+0000 7fe63d511640 1 -- 172.21.15.55:0/1344467613 shutdown_connections 2023-07-06T21:58:29.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.663+0000 7fe63d511640 1 --2- 172.21.15.55:0/1344467613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63815d2d0 0x7fe63806e9d0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.663+0000 7fe63d511640 1 --2- 172.21.15.55:0/1344467613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe638157290 0x7fe63815a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.663+0000 7fe63d511640 1 -- 172.21.15.55:0/1344467613 >> 172.21.15.55:0/1344467613 conn(0x7fe6380d0c50 msgr2=0x7fe6380cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:29.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.663+0000 7fe63d511640 1 -- 172.21.15.55:0/1344467613 shutdown_connections 2023-07-06T21:58:29.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.663+0000 7fe63d511640 1 -- 172.21.15.55:0/1344467613 wait complete. 2023-07-06T21:58:29.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe63d511640 1 Processor -- start 2023-07-06T21:58:29.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe63d511640 1 -- start start 2023-07-06T21:58:29.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe63d511640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe638157290 0x7fe63814b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:29.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe63d511640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63815d2d0 0x7fe63814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:29.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe63d511640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe63815d6e0 0x7fe6380b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:29.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe63d511640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63814b5b0 con 0x7fe63815d2d0 2023-07-06T21:58:29.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe63d511640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe638154700 con 0x7fe638157290 2023-07-06T21:58:29.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe63d511640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6381549e0 con 0x7fe63815d6e0 2023-07-06T21:58:29.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe62e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63815d2d0 0x7fe63814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:29.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe62e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63815d2d0 0x7fe63814ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33324/0 (socket says 172.21.15.55:33324) 2023-07-06T21:58:29.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe62e7fc640 1 -- 172.21.15.55:0/169185328 learned_addr learned my addr 172.21.15.55:0/169185328 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:29.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe636ffd640 1 --2- 172.21.15.55:0/169185328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe638157290 0x7fe63814b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:29.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe6377fe640 1 --2- 172.21.15.55:0/169185328 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe63815d6e0 0x7fe6380b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:29.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe62e7fc640 1 -- 172.21.15.55:0/169185328 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe63815d6e0 msgr2=0x7fe6380b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe62e7fc640 1 --2- 172.21.15.55:0/169185328 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe63815d6e0 0x7fe6380b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe62e7fc640 1 -- 172.21.15.55:0/169185328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe638157290 msgr2=0x7fe63814b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe62e7fc640 1 --2- 172.21.15.55:0/169185328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe638157290 0x7fe63814b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe62e7fc640 1 -- 172.21.15.55:0/169185328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe620009b30 con 0x7fe63815d2d0 2023-07-06T21:58:29.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe62e7fc640 1 --2- 172.21.15.55:0/169185328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63815d2d0 0x7fe63814ccd0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fe62001a5b0 tx=0x7fe620019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:29.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe62ffff640 1 -- 172.21.15.55:0/169185328 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6200b8670 con 0x7fe63815d2d0 2023-07-06T21:58:29.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe62ffff640 1 -- 172.21.15.55:0/169185328 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6200b87d0 con 0x7fe63815d2d0 2023-07-06T21:58:29.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe62ffff640 1 -- 172.21.15.55:0/169185328 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6200b8b80 con 0x7fe63815d2d0 2023-07-06T21:58:29.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe63d511640 1 -- 172.21.15.55:0/169185328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe638154cc0 con 0x7fe63815d2d0 2023-07-06T21:58:29.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.667+0000 7fe63d511640 1 -- 172.21.15.55:0/169185328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe638155280 con 0x7fe63815d2d0 2023-07-06T21:58:29.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.671+0000 7fe63d511640 1 -- 172.21.15.55:0/169185328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe638155470 con 0x7fe63815d2d0 2023-07-06T21:58:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.671+0000 7fe62ffff640 1 -- 172.21.15.55:0/169185328 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe6200b8ce0 con 0x7fe63815d2d0 2023-07-06T21:58:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.671+0000 7fe62ffff640 1 --2- 172.21.15.55:0/169185328 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fe6180663d0 0x7fe618068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.671+0000 7fe62ffff640 1 -- 172.21.15.55:0/169185328 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6347+0+0 (secure 0 0 0) 0x7fe62011f070 con 0x7fe63815d2d0 2023-07-06T21:58:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.671+0000 7fe636ffd640 1 --2- 172.21.15.55:0/169185328 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fe6180663d0 0x7fe618068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.671+0000 7fe636ffd640 1 --2- 172.21.15.55:0/169185328 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fe6180663d0 0x7fe618068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe6280079c0 tx=0x7fe628008040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:29.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.675+0000 7fe62ffff640 1 -- 172.21.15.55:0/169185328 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe6200ec360 con 0x7fe63815d2d0 2023-07-06T21:58:29.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.831+0000 7fe63d511640 1 -- 172.21.15.55:0/169185328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fe638066d60 con 0x7fe63815d2d0 2023-07-06T21:58:29.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.839+0000 7fe62ffff640 1 -- 172.21.15.55:0/169185328 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v33) v1 ==== 115+0+0 (secure 0 0 0) 0x7fe6200ef980 con 0x7fe63815d2d0 2023-07-06T21:58:29.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.839+0000 7fe63d511640 1 -- 172.21.15.55:0/169185328 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fe6180663d0 msgr2=0x7fe618068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.839+0000 7fe63d511640 1 --2- 172.21.15.55:0/169185328 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fe6180663d0 0x7fe618068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe6280079c0 tx=0x7fe628008040 comp rx=0 tx=0).stop 2023-07-06T21:58:29.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.839+0000 7fe63d511640 1 -- 172.21.15.55:0/169185328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63815d2d0 msgr2=0x7fe63814ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:29.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.839+0000 7fe63d511640 1 --2- 172.21.15.55:0/169185328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63815d2d0 0x7fe63814ccd0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fe62001a5b0 tx=0x7fe620019720 comp rx=0 tx=0).stop 2023-07-06T21:58:29.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.839+0000 7fe63d511640 1 -- 172.21.15.55:0/169185328 shutdown_connections 2023-07-06T21:58:29.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.839+0000 7fe63d511640 1 --2- 172.21.15.55:0/169185328 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fe6180663d0 0x7fe618068880 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.839+0000 7fe63d511640 1 --2- 172.21.15.55:0/169185328 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe63815d6e0 0x7fe6380b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.839+0000 7fe63d511640 1 --2- 172.21.15.55:0/169185328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63815d2d0 0x7fe63814ccd0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.839+0000 7fe63d511640 1 --2- 172.21.15.55:0/169185328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe638157290 0x7fe63814b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:29.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.839+0000 7fe63d511640 1 -- 172.21.15.55:0/169185328 >> 172.21.15.55:0/169185328 conn(0x7fe6380d0c50 msgr2=0x7fe63815c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:29.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.839+0000 7fe63d511640 1 -- 172.21.15.55:0/169185328 shutdown_connections 2023-07-06T21:58:29.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:29.839+0000 7fe63d511640 1 -- 172.21.15.55:0/169185328 wait complete. 2023-07-06T21:58:29.859 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-07-06T21:58:30.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.003+0000 7fad60359640 1 Processor -- start 2023-07-06T21:58:30.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.003+0000 7fad60359640 1 -- start start 2023-07-06T21:58:30.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad60359640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad5815bc30 0x7fad5806ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:30.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad60359640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fad5806f110 0x7fad580cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:30.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad60359640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad580cf9c0 0x7fad580ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:30.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad60359640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad580cc800 con 0x7fad5815bc30 2023-07-06T21:58:30.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad60359640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5806f580 con 0x7fad5806f110 2023-07-06T21:58:30.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad60359640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad580cfe40 con 0x7fad580cf9c0 2023-07-06T21:58:30.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad5e0f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad5815bc30 0x7fad5806ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:30.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad5e0f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad5815bc30 0x7fad5806ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33338/0 (socket says 172.21.15.55:33338) 2023-07-06T21:58:30.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad5e0f5640 1 -- 172.21.15.55:0/532796423 learned_addr learned my addr 172.21.15.55:0/532796423 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:30.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad5d8f4640 1 --2- 172.21.15.55:0/532796423 >> v2:172.21.15.138:3300/0 conn(0x7fad5806f110 0x7fad580cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:30.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad5e0f5640 1 -- 172.21.15.55:0/532796423 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad580cf9c0 msgr2=0x7fad580ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:30.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad5e0f5640 1 --2- 172.21.15.55:0/532796423 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad580cf9c0 0x7fad580ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad5e0f5640 1 -- 172.21.15.55:0/532796423 >> v2:172.21.15.138:3300/0 conn(0x7fad5806f110 msgr2=0x7fad580cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:30.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad5e0f5640 1 --2- 172.21.15.55:0/532796423 >> v2:172.21.15.138:3300/0 conn(0x7fad5806f110 0x7fad580cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad5e0f5640 1 -- 172.21.15.55:0/532796423 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5815f750 con 0x7fad5815bc30 2023-07-06T21:58:30.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad5d8f4640 1 --2- 172.21.15.55:0/532796423 >> v2:172.21.15.138:3300/0 conn(0x7fad5806f110 0x7fad580cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:30.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.007+0000 7fad5e0f5640 1 --2- 172.21.15.55:0/532796423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad5815bc30 0x7fad5806ebd0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fad580d0f10 tx=0x7fad5401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80ab85a6f7307c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:30.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad5d0f3640 1 -- 172.21.15.55:0/532796423 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540ab600 con 0x7fad5815bc30 2023-07-06T21:58:30.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad5d0f3640 1 -- 172.21.15.55:0/532796423 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad540a7050 con 0x7fad5815bc30 2023-07-06T21:58:30.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad5d0f3640 1 -- 172.21.15.55:0/532796423 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540ab980 con 0x7fad5815bc30 2023-07-06T21:58:30.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 -- 172.21.15.55:0/532796423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad5815bc30 msgr2=0x7fad5806ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:30.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 --2- 172.21.15.55:0/532796423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad5815bc30 0x7fad5806ebd0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fad580d0f10 tx=0x7fad5401c210 comp rx=0 tx=0).stop 2023-07-06T21:58:30.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 -- 172.21.15.55:0/532796423 shutdown_connections 2023-07-06T21:58:30.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 --2- 172.21.15.55:0/532796423 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad580cf9c0 0x7fad580ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 --2- 172.21.15.55:0/532796423 >> v2:172.21.15.138:3300/0 conn(0x7fad5806f110 0x7fad580cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 --2- 172.21.15.55:0/532796423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad5815bc30 0x7fad5806ebd0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 -- 172.21.15.55:0/532796423 >> 172.21.15.55:0/532796423 conn(0x7fad580b2840 msgr2=0x7fad580d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:30.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 -- 172.21.15.55:0/532796423 shutdown_connections 2023-07-06T21:58:30.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 -- 172.21.15.55:0/532796423 wait complete. 2023-07-06T21:58:30.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 Processor -- start 2023-07-06T21:58:30.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 -- start start 2023-07-06T21:58:30.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad5806f110 0x7fad5814c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:30.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad580cf9c0 0x7fad5814dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:30.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad5815bc30 0x7fad580c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:30.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad580c51b0 con 0x7fad580cf9c0 2023-07-06T21:58:30.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad580c45c0 con 0x7fad5806f110 2023-07-06T21:58:30.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad60359640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad580c4810 con 0x7fad5815bc30 2023-07-06T21:58:30.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.011+0000 7fad5d8f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad580cf9c0 0x7fad5814dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:30.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad5d8f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad580cf9c0 0x7fad5814dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33354/0 (socket says 172.21.15.55:33354) 2023-07-06T21:58:30.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad5d8f4640 1 -- 172.21.15.55:0/187367093 learned_addr learned my addr 172.21.15.55:0/187367093 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:30.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad5e0f5640 1 --2- 172.21.15.55:0/187367093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad5806f110 0x7fad5814c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:30.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad5e8f6640 1 --2- 172.21.15.55:0/187367093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad5815bc30 0x7fad580c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:30.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad5d8f4640 1 -- 172.21.15.55:0/187367093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad5815bc30 msgr2=0x7fad580c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:30.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad5d8f4640 1 --2- 172.21.15.55:0/187367093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad5815bc30 0x7fad580c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad5d8f4640 1 -- 172.21.15.55:0/187367093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad5806f110 msgr2=0x7fad5814c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:30.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad5d8f4640 1 --2- 172.21.15.55:0/187367093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad5806f110 0x7fad5814c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad5d8f4640 1 -- 172.21.15.55:0/187367093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad540094d0 con 0x7fad580cf9c0 2023-07-06T21:58:30.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad5d8f4640 1 --2- 172.21.15.55:0/187367093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad580cf9c0 0x7fad5814dcf0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fad4800c7c0 tx=0x7fad4800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:30.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad4effd640 1 -- 172.21.15.55:0/187367093 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48007a30 con 0x7fad580cf9c0 2023-07-06T21:58:30.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad4effd640 1 -- 172.21.15.55:0/187367093 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad48007b90 con 0x7fad580cf9c0 2023-07-06T21:58:30.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad4effd640 1 -- 172.21.15.55:0/187367093 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4800ce70 con 0x7fad580cf9c0 2023-07-06T21:58:30.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad60359640 1 -- 172.21.15.55:0/187367093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad580c4af0 con 0x7fad580cf9c0 2023-07-06T21:58:30.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad60359640 1 -- 172.21.15.55:0/187367093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5814c800 con 0x7fad580cf9c0 2023-07-06T21:58:30.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad60359640 1 -- 172.21.15.55:0/187367093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad58066d60 con 0x7fad580cf9c0 2023-07-06T21:58:30.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad4effd640 1 -- 172.21.15.55:0/187367093 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fad480113f0 con 0x7fad580cf9c0 2023-07-06T21:58:30.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.015+0000 7fad4effd640 1 --2- 172.21.15.55:0/187367093 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fad3c0663a0 0x7fad3c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:30.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.019+0000 7fad4effd640 1 -- 172.21.15.55:0/187367093 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6347+0+0 (secure 0 0 0) 0x7fad48084580 con 0x7fad580cf9c0 2023-07-06T21:58:30.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.019+0000 7fad5e0f5640 1 --2- 172.21.15.55:0/187367093 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fad3c0663a0 0x7fad3c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:30.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.019+0000 7fad5e0f5640 1 --2- 172.21.15.55:0/187367093 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fad3c0663a0 0x7fad3c068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fad540ad000 tx=0x7fad540a6000 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:30.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.019+0000 7fad4effd640 1 -- 172.21.15.55:0/187367093 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fad480516b0 con 0x7fad580cf9c0 2023-07-06T21:58:30.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.231+0000 7fad60359640 1 -- 172.21.15.55:0/187367093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fad5815f2e0 con 0x7fad580cf9c0 2023-07-06T21:58:30.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.787+0000 7fad4effd640 1 -- 172.21.15.55:0/187367093 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v624) v1 ==== 166+0+0 (secure 0 0 0) 0x7fad48054cd0 con 0x7fad580cf9c0 2023-07-06T21:58:30.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.787+0000 7fad60359640 1 -- 172.21.15.55:0/187367093 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fad3c0663a0 msgr2=0x7fad3c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:30.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.787+0000 7fad60359640 1 --2- 172.21.15.55:0/187367093 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fad3c0663a0 0x7fad3c068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fad540ad000 tx=0x7fad540a6000 comp rx=0 tx=0).stop 2023-07-06T21:58:30.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.787+0000 7fad60359640 1 -- 172.21.15.55:0/187367093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad580cf9c0 msgr2=0x7fad5814dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:30.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.787+0000 7fad60359640 1 --2- 172.21.15.55:0/187367093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad580cf9c0 0x7fad5814dcf0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fad4800c7c0 tx=0x7fad4800cc80 comp rx=0 tx=0).stop 2023-07-06T21:58:30.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.787+0000 7fad60359640 1 -- 172.21.15.55:0/187367093 shutdown_connections 2023-07-06T21:58:30.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.787+0000 7fad60359640 1 --2- 172.21.15.55:0/187367093 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fad3c0663a0 0x7fad3c068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.787+0000 7fad60359640 1 --2- 172.21.15.55:0/187367093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad5815bc30 0x7fad580c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.787+0000 7fad60359640 1 --2- 172.21.15.55:0/187367093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad580cf9c0 0x7fad5814dcf0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.787+0000 7fad60359640 1 --2- 172.21.15.55:0/187367093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad5806f110 0x7fad5814c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.787+0000 7fad60359640 1 -- 172.21.15.55:0/187367093 >> 172.21.15.55:0/187367093 conn(0x7fad580b2840 msgr2=0x7fad580ce930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:30.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.787+0000 7fad60359640 1 -- 172.21.15.55:0/187367093 shutdown_connections 2023-07-06T21:58:30.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.787+0000 7fad60359640 1 -- 172.21.15.55:0/187367093 wait complete. 2023-07-06T21:58:30.808 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-07-06T21:58:30.808 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-06T21:58:30.809 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-07-06T21:58:30.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be9297640 1 Processor -- start 2023-07-06T21:58:30.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be9297640 1 -- start start 2023-07-06T21:58:30.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be9297640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3be40b12e0 0x7f3be40d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:30.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be9297640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3be40d00f0 0x7f3be40d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:30.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be9297640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3be40b1a40 0x7f3be40b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:30.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be9297640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be40b3be0 con 0x7f3be40d00f0 2023-07-06T21:58:30.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be9297640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be40b4590 con 0x7f3be40b1a40 2023-07-06T21:58:30.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be9297640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be40cc6a0 con 0x7f3be40b12e0 2023-07-06T21:58:30.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3be40d00f0 0x7f3be40d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:30.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3be40d00f0 0x7f3be40d0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33362/0 (socket says 172.21.15.55:33362) 2023-07-06T21:58:30.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be37fe640 1 -- 172.21.15.55:0/2268383844 learned_addr learned my addr 172.21.15.55:0/2268383844 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:30.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be8a96640 1 --2- 172.21.15.55:0/2268383844 >> v2:172.21.15.138:3300/0 conn(0x7f3be40b1a40 0x7f3be40b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:30.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be3fff640 1 --2- 172.21.15.55:0/2268383844 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3be40b12e0 0x7f3be40d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:30.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be37fe640 1 -- 172.21.15.55:0/2268383844 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3be40b12e0 msgr2=0x7f3be40d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:30.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be37fe640 1 --2- 172.21.15.55:0/2268383844 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3be40b12e0 0x7f3be40d1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be37fe640 1 -- 172.21.15.55:0/2268383844 >> v2:172.21.15.138:3300/0 conn(0x7f3be40b1a40 msgr2=0x7f3be40b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:30.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be37fe640 1 --2- 172.21.15.55:0/2268383844 >> v2:172.21.15.138:3300/0 conn(0x7f3be40b1a40 0x7f3be40b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.955+0000 7f3be37fe640 1 -- 172.21.15.55:0/2268383844 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be40d0a80 con 0x7f3be40d00f0 2023-07-06T21:58:30.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.959+0000 7f3be37fe640 1 --2- 172.21.15.55:0/2268383844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be40d00f0 0x7f3be40d0540 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f3be40d2c80 tx=0x7f3bd801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4849285bd4cdcdb1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:30.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.959+0000 7f3be2ffd640 1 -- 172.21.15.55:0/2268383844 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80ab600 con 0x7f3be40d00f0 2023-07-06T21:58:30.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.959+0000 7f3be2ffd640 1 -- 172.21.15.55:0/2268383844 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd80a7050 con 0x7f3be40d00f0 2023-07-06T21:58:30.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.959+0000 7f3be2ffd640 1 -- 172.21.15.55:0/2268383844 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80ab980 con 0x7f3be40d00f0 2023-07-06T21:58:30.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.959+0000 7f3be9297640 1 -- 172.21.15.55:0/2268383844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be40d00f0 msgr2=0x7f3be40d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:30.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.959+0000 7f3be9297640 1 --2- 172.21.15.55:0/2268383844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be40d00f0 0x7f3be40d0540 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f3be40d2c80 tx=0x7f3bd801c500 comp rx=0 tx=0).stop 2023-07-06T21:58:30.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.959+0000 7f3be9297640 1 -- 172.21.15.55:0/2268383844 shutdown_connections 2023-07-06T21:58:30.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.959+0000 7f3be9297640 1 --2- 172.21.15.55:0/2268383844 >> v2:172.21.15.138:3300/0 conn(0x7f3be40b1a40 0x7f3be40b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.959+0000 7f3be9297640 1 --2- 172.21.15.55:0/2268383844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be40d00f0 0x7f3be40d0540 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.959+0000 7f3be9297640 1 --2- 172.21.15.55:0/2268383844 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3be40b12e0 0x7f3be40d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.959+0000 7f3be9297640 1 -- 172.21.15.55:0/2268383844 >> 172.21.15.55:0/2268383844 conn(0x7f3be40d20e0 msgr2=0x7f3be40d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:30.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.959+0000 7f3be9297640 1 -- 172.21.15.55:0/2268383844 shutdown_connections 2023-07-06T21:58:30.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.959+0000 7f3be9297640 1 -- 172.21.15.55:0/2268383844 wait complete. 2023-07-06T21:58:30.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.959+0000 7f3be9297640 1 Processor -- start 2023-07-06T21:58:30.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be9297640 1 -- start start 2023-07-06T21:58:30.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be9297640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3be40b12e0 0x7f3be4152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:30.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be9297640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3be40b1a40 0x7f3be4153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:30.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be9297640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be40d00f0 0x7f3be40ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:30.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be9297640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be4152640 con 0x7f3be40d00f0 2023-07-06T21:58:30.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be9297640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be4154270 con 0x7f3be40b12e0 2023-07-06T21:58:30.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be9297640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be4154550 con 0x7f3be40b1a40 2023-07-06T21:58:30.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be8a96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be40d00f0 0x7f3be40ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:30.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be8a96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be40d00f0 0x7f3be40ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33370/0 (socket says 172.21.15.55:33370) 2023-07-06T21:58:30.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be8a96640 1 -- 172.21.15.55:0/2138828107 learned_addr learned my addr 172.21.15.55:0/2138828107 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:30.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be37fe640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3be40b1a40 0x7f3be4153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:30.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be3fff640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3be40b12e0 0x7f3be4152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:30.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be8a96640 1 -- 172.21.15.55:0/2138828107 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3be40b1a40 msgr2=0x7f3be4153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:30.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be8a96640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3be40b1a40 0x7f3be4153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be8a96640 1 -- 172.21.15.55:0/2138828107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3be40b12e0 msgr2=0x7f3be4152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:30.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be8a96640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3be40b12e0 0x7f3be4152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be8a96640 1 -- 172.21.15.55:0/2138828107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80094d0 con 0x7f3be40d00f0 2023-07-06T21:58:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be37fe640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3be40b1a40 0x7f3be4153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be3fff640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3be40b12e0 0x7f3be4152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be8a96640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be40d00f0 0x7f3be40ce2d0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc007e40 tx=0x7f3bdc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be0ff9640 1 -- 172.21.15.55:0/2138828107 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc014620 con 0x7f3be40d00f0 2023-07-06T21:58:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be0ff9640 1 -- 172.21.15.55:0/2138828107 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc00ee90 con 0x7f3be40d00f0 2023-07-06T21:58:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be0ff9640 1 -- 172.21.15.55:0/2138828107 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0149e0 con 0x7f3be40d00f0 2023-07-06T21:58:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be9297640 1 -- 172.21.15.55:0/2138828107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be4154830 con 0x7f3be40d00f0 2023-07-06T21:58:30.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be9297640 1 -- 172.21.15.55:0/2138828107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be4154df0 con 0x7f3be40d00f0 2023-07-06T21:58:30.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.963+0000 7f3be9297640 1 -- 172.21.15.55:0/2138828107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be4154fe0 con 0x7f3be40d00f0 2023-07-06T21:58:30.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.967+0000 7f3be0ff9640 1 -- 172.21.15.55:0/2138828107 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3bdc014b40 con 0x7f3be40d00f0 2023-07-06T21:58:30.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.967+0000 7f3be0ff9640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f3bd00663a0 0x7f3bd0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:30.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.967+0000 7f3be0ff9640 1 -- 172.21.15.55:0/2138828107 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f3bdc0849f0 con 0x7f3be40d00f0 2023-07-06T21:58:30.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.967+0000 7f3be3fff640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f3bd00663a0 0x7f3bd0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:30.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.967+0000 7f3be3fff640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f3bd00663a0 0x7f3bd0068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3be4153870 tx=0x7f3bd4008040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:30.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:30.971+0000 7f3be0ff9640 1 -- 172.21.15.55:0/2138828107 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3bdc051ba0 con 0x7f3be40d00f0 2023-07-06T21:58:31.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.179+0000 7f3be9297640 1 -- 172.21.15.55:0/2138828107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f3be404d790 con 0x7f3be40d00f0 2023-07-06T21:58:31.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.783+0000 7f3be0ff9640 1 -- 172.21.15.55:0/2138828107 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v625) v1 ==== 186+0+0 (secure 0 0 0) 0x7f3bdc0551c0 con 0x7f3be40d00f0 2023-07-06T21:58:31.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.787+0000 7f3be9297640 1 -- 172.21.15.55:0/2138828107 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f3bd00663a0 msgr2=0x7f3bd0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:31.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.787+0000 7f3be9297640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f3bd00663a0 0x7f3bd0068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3be4153870 tx=0x7f3bd4008040 comp rx=0 tx=0).stop 2023-07-06T21:58:31.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.787+0000 7f3be9297640 1 -- 172.21.15.55:0/2138828107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be40d00f0 msgr2=0x7f3be40ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:31.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.787+0000 7f3be9297640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be40d00f0 0x7f3be40ce2d0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc007e40 tx=0x7f3bdc00e4b0 comp rx=0 tx=0).stop 2023-07-06T21:58:31.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.787+0000 7f3be9297640 1 -- 172.21.15.55:0/2138828107 shutdown_connections 2023-07-06T21:58:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.787+0000 7f3be9297640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f3bd00663a0 0x7f3bd0068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.787+0000 7f3be9297640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be40d00f0 0x7f3be40ce2d0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.787+0000 7f3be9297640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3be40b1a40 0x7f3be4153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.787+0000 7f3be9297640 1 --2- 172.21.15.55:0/2138828107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3be40b12e0 0x7f3be4152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.787+0000 7f3be9297640 1 -- 172.21.15.55:0/2138828107 >> 172.21.15.55:0/2138828107 conn(0x7f3be40d20e0 msgr2=0x7f3be4155cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.787+0000 7f3be9297640 1 -- 172.21.15.55:0/2138828107 shutdown_connections 2023-07-06T21:58:31.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.787+0000 7f3be9297640 1 -- 172.21.15.55:0/2138828107 wait complete. 2023-07-06T21:58:31.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:58:31.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.951+0000 7f955e940640 1 Processor -- start 2023-07-06T21:58:31.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.951+0000 7f955e940640 1 -- start start 2023-07-06T21:58:31.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.951+0000 7f955e940640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95581587d0 0x7f9558070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:31.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.951+0000 7f955e940640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f95580710c0 0x7f95580cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:31.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.951+0000 7f955e940640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955806fae0 con 0x7f9558158400 2023-07-06T21:58:31.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.951+0000 7f955e940640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955806fdc0 con 0x7f95580710c0 2023-07-06T21:58:31.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.951+0000 7f955e940640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95580700a0 con 0x7f95581587d0 2023-07-06T21:58:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9557fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9558158400 0x7f95580c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58594/0 (socket says 172.21.15.55:58594) 2023-07-06T21:58:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9557fff640 1 -- 172.21.15.55:0/1974200886 learned_addr learned my addr 172.21.15.55:0/1974200886 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f95577fe640 1 --2- 172.21.15.55:0/1974200886 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95581587d0 0x7f9558070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f955cedd640 1 --2- 172.21.15.55:0/1974200886 >> v2:172.21.15.138:3300/0 conn(0x7f95580710c0 0x7f95580cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 -- 172.21.15.55:0/1974200886 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383934367 0 0) 0x7f955806fae0 con 0x7f9558158400 2023-07-06T21:58:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 -- 172.21.15.55:0/1974200886 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9540005740 con 0x7f9558158400 2023-07-06T21:58:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 -- 172.21.15.55:0/1974200886 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3059275159 0 0) 0x7f9540005740 con 0x7f9558158400 2023-07-06T21:58:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 -- 172.21.15.55:0/1974200886 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95581587d0 msgr2=0x7f9558070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 --2- 172.21.15.55:0/1974200886 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95581587d0 0x7f9558070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 -- 172.21.15.55:0/1974200886 >> v2:172.21.15.138:3300/0 conn(0x7f95580710c0 msgr2=0x7f95580cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 --2- 172.21.15.55:0/1974200886 >> v2:172.21.15.138:3300/0 conn(0x7f95580710c0 0x7f95580cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 -- 172.21.15.55:0/1974200886 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9558070380 con 0x7f9558158400 2023-07-06T21:58:31.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 -- 172.21.15.55:0/1974200886 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f9548001680 con 0x7f9558158400 2023-07-06T21:58:31.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 -- 172.21.15.55:0/1974200886 >> v1:172.21.15.55:6789/0 conn(0x7f9558158400 legacy=0x7f95580c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:31.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 --2- 172.21.15.55:0/1974200886 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95581587d0 0x7f9540005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:31.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 --2- 172.21.15.55:0/1974200886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95400060d0 0x7f95400069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:31.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 --2- 172.21.15.55:0/1974200886 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9540006540 0x7f9540006f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:31.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 -- 172.21.15.55:0/1974200886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955806fdc0 con 0x7f95400060d0 2023-07-06T21:58:31.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 -- 172.21.15.55:0/1974200886 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95580700a0 con 0x7f9540006540 2023-07-06T21:58:31.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9556ffd640 1 -- 172.21.15.55:0/1974200886 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9540007770 con 0x7f95581587d0 2023-07-06T21:58:31.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f95577fe640 1 --2- 172.21.15.55:0/1974200886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95400060d0 0x7f95400069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:31.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f9557fff640 1 --2- 172.21.15.55:0/1974200886 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95581587d0 0x7f9540005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:31.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f955cedd640 1 --2- 172.21.15.55:0/1974200886 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9540006540 0x7f9540006f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:31.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f95577fe640 1 -- 172.21.15.55:0/1974200886 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95581587d0 msgr2=0x7f9540005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:31.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f95577fe640 1 --2- 172.21.15.55:0/1974200886 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95581587d0 0x7f9540005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:31.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f95577fe640 1 -- 172.21.15.55:0/1974200886 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9540006540 msgr2=0x7f9540006f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:31.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f95577fe640 1 --2- 172.21.15.55:0/1974200886 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9540006540 0x7f9540006f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:31.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.955+0000 7f95577fe640 1 -- 172.21.15.55:0/1974200886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9540005740 con 0x7f95400060d0 2023-07-06T21:58:31.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.959+0000 7f95577fe640 1 --2- 172.21.15.55:0/1974200886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95400060d0 0x7f95400069e0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f954c009ae0 tx=0x7f954c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6b00d6445d12ca server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:31.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.959+0000 7f9556ffd640 1 -- 172.21.15.55:0/1974200886 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c0a5640 con 0x7f95400060d0 2023-07-06T21:58:31.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.959+0000 7f9556ffd640 1 -- 172.21.15.55:0/1974200886 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c0a57a0 con 0x7f95400060d0 2023-07-06T21:58:31.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.959+0000 7f9556ffd640 1 -- 172.21.15.55:0/1974200886 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c0a5b50 con 0x7f95400060d0 2023-07-06T21:58:31.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.959+0000 7f955e940640 1 -- 172.21.15.55:0/1974200886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95400060d0 msgr2=0x7f95400069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:31.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.959+0000 7f955e940640 1 --2- 172.21.15.55:0/1974200886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95400060d0 0x7f95400069e0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f954c009ae0 tx=0x7f954c01ca50 comp rx=0 tx=0).stop 2023-07-06T21:58:31.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.959+0000 7f955cedd640 1 -- 172.21.15.55:0/1974200886 reap_dead start 2023-07-06T21:58:31.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.959+0000 7f955e940640 1 -- 172.21.15.55:0/1974200886 shutdown_connections 2023-07-06T21:58:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.959+0000 7f955e940640 1 -- 172.21.15.55:0/1974200886 >> 172.21.15.55:0/1974200886 conn(0x7f95580cded0 msgr2=0x7f95580ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.959+0000 7f955e940640 1 -- 172.21.15.55:0/1974200886 shutdown_connections 2023-07-06T21:58:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.959+0000 7f955e940640 1 -- 172.21.15.55:0/1974200886 wait complete. 2023-07-06T21:58:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.959+0000 7f955e940640 1 Processor -- start 2023-07-06T21:58:31.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.959+0000 7f955e940640 1 -- start start 2023-07-06T21:58:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955e940640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95400060d0 0x7f95581ec7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955e940640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95580b2810 0x7f95580b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955e940640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9558151840 0x7f9558151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955e940640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95581521f0 con 0x7f9558151840 2023-07-06T21:58:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955e940640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95580b3280 con 0x7f95580b2810 2023-07-06T21:58:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955e940640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9558152d00 con 0x7f95400060d0 2023-07-06T21:58:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955cedd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9558151840 0x7f9558151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955cedd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9558151840 0x7f9558151cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33380/0 (socket says 172.21.15.55:33380) 2023-07-06T21:58:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955cedd640 1 -- 172.21.15.55:0/2742195102 learned_addr learned my addr 172.21.15.55:0/2742195102 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955cedd640 1 -- 172.21.15.55:0/2742195102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95400060d0 msgr2=0x7f95581ec7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f95577fe640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95580b2810 0x7f95580b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f9557fff640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95400060d0 0x7f95581ec7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955cedd640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95400060d0 0x7f95581ec7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955cedd640 1 -- 172.21.15.55:0/2742195102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95580b2810 msgr2=0x7f95580b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955cedd640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95580b2810 0x7f95580b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955cedd640 1 -- 172.21.15.55:0/2742195102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9558152fe0 con 0x7f9558151840 2023-07-06T21:58:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f95577fe640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95580b2810 0x7f95580b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f9557fff640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95400060d0 0x7f95581ec7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955cedd640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9558151840 0x7f9558151cb0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f95580ad960 tx=0x7f9550011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f9554ff9640 1 -- 172.21.15.55:0/2742195102 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955000e040 con 0x7f9558151840 2023-07-06T21:58:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f9554ff9640 1 -- 172.21.15.55:0/2742195102 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955000f040 con 0x7f9558151840 2023-07-06T21:58:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f9554ff9640 1 -- 172.21.15.55:0/2742195102 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550015a80 con 0x7f9558151840 2023-07-06T21:58:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955e940640 1 -- 172.21.15.55:0/2742195102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95581532c0 con 0x7f9558151840 2023-07-06T21:58:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955e940640 1 -- 172.21.15.55:0/2742195102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9558153ac0 con 0x7f9558151840 2023-07-06T21:58:31.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.963+0000 7f955e940640 1 -- 172.21.15.55:0/2742195102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955806c580 con 0x7f9558151840 2023-07-06T21:58:31.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.967+0000 7f9554ff9640 1 -- 172.21.15.55:0/2742195102 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9550015be0 con 0x7f9558151840 2023-07-06T21:58:31.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.967+0000 7f9554ff9640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f95440663a0 0x7f9544068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:31.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.967+0000 7f9554ff9640 1 -- 172.21.15.55:0/2742195102 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f95500840d0 con 0x7f9558151840 2023-07-06T21:58:31.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.967+0000 7f9557fff640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f95440663a0 0x7f9544068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:31.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.967+0000 7f9557fff640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f95440663a0 0x7f9544068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f95480017e0 tx=0x7f9548007900 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:31.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:31.971+0000 7f9554ff9640 1 -- 172.21.15.55:0/2742195102 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9550054c00 con 0x7f9558151840 2023-07-06T21:58:32.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.127+0000 7f955e940640 1 -- 172.21.15.55:0/2742195102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9558066d60 con 0x7f9558151840 2023-07-06T21:58:32.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.127+0000 7f9554ff9640 1 -- 172.21.15.55:0/2742195102 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16034 (secure 0 0 0) 0x7f9550054790 con 0x7f9558151840 2023-07-06T21:58:32.126 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:32.126 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":108,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:58:28.763199+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/1711412404":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/541053535":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/2207136597":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/3822427711":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/2499362367":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/1216783276":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/2012337213":"2023-07-07T21:58:22.707261+0000","172.21.15.55:6836/1437542997":"2023-07-07T21:58:25.581894+0000","172.21.15.55:6833/1286790431":"2023-07-07T21:58:22.707261+0000","172.21.15.55:6832/1286790431":"2023-07-07T21:58:22.707261+0000","172.21.15.55:0/1619591920":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/2678332066":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/3781336149":"2023-07-07T21:58:16.643406+0000","172.21.15.55:6837/1437542997":"2023-07-07T21:58:25.581894+0000","172.21.15.55:6832/703944479":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/3528659743":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/4200932499":"2023-07-07T21:58:16.643406+0000","172.21.15.55:6833/703944479":"2023-07-07T21:58:16.643406+0000","172.21.15.55:0/1766014464":"2023-07-07T21:58:16.643406+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:58:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.127+0000 7f955e940640 1 -- 172.21.15.55:0/2742195102 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f95440663a0 msgr2=0x7f9544068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.127+0000 7f955e940640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f95440663a0 0x7f9544068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f95480017e0 tx=0x7f9548007900 comp rx=0 tx=0).stop 2023-07-06T21:58:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.127+0000 7f955e940640 1 -- 172.21.15.55:0/2742195102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9558151840 msgr2=0x7f9558151cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.127+0000 7f955e940640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9558151840 0x7f9558151cb0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f95580ad960 tx=0x7f9550011cb0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.127+0000 7f955e940640 1 -- 172.21.15.55:0/2742195102 shutdown_connections 2023-07-06T21:58:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.127+0000 7f955e940640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f95440663a0 0x7f9544068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.127+0000 7f955e940640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9558151840 0x7f9558151cb0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.127+0000 7f955e940640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95580b2810 0x7f95580b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.127+0000 7f955e940640 1 --2- 172.21.15.55:0/2742195102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95400060d0 0x7f95581ec7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.127+0000 7f955e940640 1 -- 172.21.15.55:0/2742195102 >> 172.21.15.55:0/2742195102 conn(0x7f95580cded0 msgr2=0x7f95580cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.127+0000 7f955e940640 1 -- 172.21.15.55:0/2742195102 shutdown_connections 2023-07-06T21:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.127+0000 7f955e940640 1 -- 172.21.15.55:0/2742195102 wait complete. 2023-07-06T21:58:32.147 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:58:32.148 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:58:32.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c12d9f640 1 Processor -- start 2023-07-06T21:58:32.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c12d9f640 1 -- start start 2023-07-06T21:58:32.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c12d9f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8c0c0b7b90 0x7f8c0c0d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c12d9f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c0c0cc870 0x7f8c0c0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c12d9f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0c0b5070 con 0x7f8c0c0b4130 2023-07-06T21:58:32.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c12d9f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0c160020 con 0x7f8c0c0cc870 2023-07-06T21:58:32.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c12d9f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0c0b4570 con 0x7f8c0c0b7b90 2023-07-06T21:58:32.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c0bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c0c0cc870 0x7f8c0c0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c1133c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8c0c0b4130 0x7f8c0c0d0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58606/0 (socket says 172.21.15.55:58606) 2023-07-06T21:58:32.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c0bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c0c0cc870 0x7f8c0c0b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33386/0 (socket says 172.21.15.55:33386) 2023-07-06T21:58:32.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c1133c640 1 -- 172.21.15.55:0/3470197064 learned_addr learned my addr 172.21.15.55:0/3470197064 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:32.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c10b3b640 1 --2- 172.21.15.55:0/3470197064 >> v2:172.21.15.138:3300/0 conn(0x7f8c0c0b7b90 0x7f8c0c0d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c0b7fe640 1 -- 172.21.15.55:0/3470197064 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4016110758 0 0) 0x7f8c0c0b5070 con 0x7f8c0c0b4130 2023-07-06T21:58:32.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c0b7fe640 1 -- 172.21.15.55:0/3470197064 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bfc003530 con 0x7f8c0c0b4130 2023-07-06T21:58:32.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c0bfff640 1 -- 172.21.15.55:0/3470197064 >> v2:172.21.15.138:3300/0 conn(0x7f8c0c0b7b90 msgr2=0x7f8c0c0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:32.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c0bfff640 1 --2- 172.21.15.55:0/3470197064 >> v2:172.21.15.138:3300/0 conn(0x7f8c0c0b7b90 0x7f8c0c0d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c0bfff640 1 -- 172.21.15.55:0/3470197064 >> v1:172.21.15.55:6789/0 conn(0x7f8c0c0b4130 legacy=0x7f8c0c0d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c0bfff640 1 -- 172.21.15.55:0/3470197064 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c1604b0 con 0x7f8c0c0cc870 2023-07-06T21:58:32.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.295+0000 7f8c10b3b640 1 --2- 172.21.15.55:0/3470197064 >> v2:172.21.15.138:3300/0 conn(0x7f8c0c0b7b90 0x7f8c0c0d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:32.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.299+0000 7f8c0bfff640 1 --2- 172.21.15.55:0/3470197064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0cc870 0x7f8c0c0b3bf0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0b2e80 tx=0x7f8bf801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860f8ac1348133d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:32.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.299+0000 7f8c0b7fe640 1 -- 172.21.15.55:0/3470197064 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf80ad660 con 0x7f8c0c0cc870 2023-07-06T21:58:32.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.299+0000 7f8c0b7fe640 1 -- 172.21.15.55:0/3470197064 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf80ad7c0 con 0x7f8c0c0cc870 2023-07-06T21:58:32.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.299+0000 7f8c0b7fe640 1 -- 172.21.15.55:0/3470197064 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf80adb50 con 0x7f8c0c0cc870 2023-07-06T21:58:32.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.299+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3470197064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0cc870 msgr2=0x7f8c0c0b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.299+0000 7f8c12d9f640 1 --2- 172.21.15.55:0/3470197064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0cc870 0x7f8c0c0b3bf0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0b2e80 tx=0x7f8bf801c440 comp rx=0 tx=0).stop 2023-07-06T21:58:32.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.299+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3470197064 shutdown_connections 2023-07-06T21:58:32.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.299+0000 7f8c12d9f640 1 --2- 172.21.15.55:0/3470197064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0cc870 0x7f8c0c0b3bf0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.299+0000 7f8c12d9f640 1 --2- 172.21.15.55:0/3470197064 >> v2:172.21.15.138:3300/0 conn(0x7f8c0c0b7b90 0x7f8c0c0d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.299+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3470197064 >> 172.21.15.55:0/3470197064 conn(0x7f8c0c0ceca0 msgr2=0x7f8c0c0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:32.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.299+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3470197064 shutdown_connections 2023-07-06T21:58:32.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.299+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3470197064 wait complete. 2023-07-06T21:58:32.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c12d9f640 1 Processor -- start 2023-07-06T21:58:32.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c12d9f640 1 -- start start 2023-07-06T21:58:32.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c12d9f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c0c0b4130 0x7f8c0c14bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c12d9f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8c0c0b7b90 0x7f8c0c0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c12d9f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0cc870 0x7f8c0c14fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c12d9f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c152540 con 0x7f8c0c0cc870 2023-07-06T21:58:32.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c12d9f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c152820 con 0x7f8c0c0b4130 2023-07-06T21:58:32.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c12d9f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c152b00 con 0x7f8c0c0b7b90 2023-07-06T21:58:32.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c1133c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0cc870 0x7f8c0c14fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c1133c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0cc870 0x7f8c0c14fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33394/0 (socket says 172.21.15.55:33394) 2023-07-06T21:58:32.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c1133c640 1 -- 172.21.15.55:0/3343018880 learned_addr learned my addr 172.21.15.55:0/3343018880 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:32.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c1133c640 1 -- 172.21.15.55:0/3343018880 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8c0c0b7b90 msgr2=0x7f8c0c0cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c10b3b640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c0c0b4130 0x7f8c0c14bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c0bfff640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8c0c0b7b90 0x7f8c0c0cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c1133c640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8c0c0b7b90 0x7f8c0c0cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c1133c640 1 -- 172.21.15.55:0/3343018880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c0c0b4130 msgr2=0x7f8c0c14bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c1133c640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c0c0b4130 0x7f8c0c14bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c1133c640 1 -- 172.21.15.55:0/3343018880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf8009420 con 0x7f8c0c0cc870 2023-07-06T21:58:32.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c0bfff640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8c0c0b7b90 0x7f8c0c0cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:32.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c10b3b640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c0c0b4130 0x7f8c0c14bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:32.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c1133c640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0cc870 0x7f8c0c14fad0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400cb40 tx=0x7f8c0400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:32.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c097fa640 1 -- 172.21.15.55:0/3343018880 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0400aca0 con 0x7f8c0c0cc870 2023-07-06T21:58:32.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c097fa640 1 -- 172.21.15.55:0/3343018880 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0400ae00 con 0x7f8c0c0cc870 2023-07-06T21:58:32.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c097fa640 1 -- 172.21.15.55:0/3343018880 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04012620 con 0x7f8c0c0cc870 2023-07-06T21:58:32.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.303+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3343018880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c152de0 con 0x7f8c0c0cc870 2023-07-06T21:58:32.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.307+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3343018880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c14c2b0 con 0x7f8c0c0cc870 2023-07-06T21:58:32.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.307+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3343018880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c066d60 con 0x7f8c0c0cc870 2023-07-06T21:58:32.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.307+0000 7f8c097fa640 1 -- 172.21.15.55:0/3343018880 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8c04007070 con 0x7f8c0c0cc870 2023-07-06T21:58:32.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.307+0000 7f8c097fa640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8bf00663d0 0x7f8bf0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.307+0000 7f8c097fa640 1 -- 172.21.15.55:0/3343018880 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f8c04083fc0 con 0x7f8c0c0cc870 2023-07-06T21:58:32.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.307+0000 7f8c10b3b640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8bf00663d0 0x7f8bf0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.311+0000 7f8c10b3b640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8bf00663d0 0x7f8bf0068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009980 tx=0x7f8c00008040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:32.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.311+0000 7f8c097fa640 1 -- 172.21.15.55:0/3343018880 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8c04051200 con 0x7f8c0c0cc870 2023-07-06T21:58:32.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.467+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3343018880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8c0c0b3260 con 0x7f8c0c0cc870 2023-07-06T21:58:32.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.467+0000 7f8c097fa640 1 -- 172.21.15.55:0/3343018880 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8c04017020 con 0x7f8c0c0cc870 2023-07-06T21:58:32.466 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:58:32.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.467+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3343018880 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8bf00663d0 msgr2=0x7f8bf0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.467+0000 7f8c12d9f640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8bf00663d0 0x7f8bf0068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009980 tx=0x7f8c00008040 comp rx=0 tx=0).stop 2023-07-06T21:58:32.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.467+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3343018880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0cc870 msgr2=0x7f8c0c14fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.467+0000 7f8c12d9f640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0cc870 0x7f8c0c14fad0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400cb40 tx=0x7f8c0400a060 comp rx=0 tx=0).stop 2023-07-06T21:58:32.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.467+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3343018880 shutdown_connections 2023-07-06T21:58:32.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.467+0000 7f8c12d9f640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8bf00663d0 0x7f8bf0068880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.467+0000 7f8c12d9f640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0cc870 0x7f8c0c14fad0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.467+0000 7f8c12d9f640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8c0c0b7b90 0x7f8c0c0cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.467+0000 7f8c12d9f640 1 --2- 172.21.15.55:0/3343018880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c0c0b4130 0x7f8c0c14bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.467+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3343018880 >> 172.21.15.55:0/3343018880 conn(0x7f8c0c0ceca0 msgr2=0x7f8c0c0693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:32.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.467+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3343018880 shutdown_connections 2023-07-06T21:58:32.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.467+0000 7f8c12d9f640 1 -- 172.21.15.55:0/3343018880 wait complete. 2023-07-06T21:58:32.486 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:58:32.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.631+0000 7fd479448640 1 Processor -- start 2023-07-06T21:58:32.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.631+0000 7fd479448640 1 -- start start 2023-07-06T21:58:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.635+0000 7fd479448640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd474156180 0x7fd4740ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.635+0000 7fd479448640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4740cbeb0 0x7fd47406ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.635+0000 7fd479448640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47415f5d0 con 0x7fd47406e9d0 2023-07-06T21:58:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.635+0000 7fd479448640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd474160250 con 0x7fd4740cbeb0 2023-07-06T21:58:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.635+0000 7fd479448640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47406f390 con 0x7fd474156180 2023-07-06T21:58:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.635+0000 7fd4737fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4740cbeb0 0x7fd47406ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.635+0000 7fd4737fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4740cbeb0 0x7fd47406ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33404/0 (socket says 172.21.15.55:33404) 2023-07-06T21:58:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.635+0000 7fd4737fe640 1 -- 172.21.15.55:0/1965403940 learned_addr learned my addr 172.21.15.55:0/1965403940 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.635+0000 7fd472ffd640 1 --2- 172.21.15.55:0/1965403940 >> v2:172.21.15.138:3300/0 conn(0x7fd474156180 0x7fd4740ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.635+0000 7fd4737fe640 1 -- 172.21.15.55:0/1965403940 >> v2:172.21.15.138:3300/0 conn(0x7fd474156180 msgr2=0x7fd4740ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.635+0000 7fd4737fe640 1 --2- 172.21.15.55:0/1965403940 >> v2:172.21.15.138:3300/0 conn(0x7fd474156180 0x7fd4740ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.635+0000 7fd4737fe640 1 -- 172.21.15.55:0/1965403940 >> v1:172.21.15.138:6789/0 conn(0x7fd47406e9d0 legacy=0x7fd4740cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.635+0000 7fd4737fe640 1 -- 172.21.15.55:0/1965403940 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47415f8b0 con 0x7fd4740cbeb0 2023-07-06T21:58:32.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.635+0000 7fd4737fe640 1 --2- 172.21.15.55:0/1965403940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740cbeb0 0x7fd47406ee50 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fd474071c90 tx=0x7fd46c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850fddaa1506652c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:32.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd4727fc640 1 -- 172.21.15.55:0/1965403940 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0a57d0 con 0x7fd4740cbeb0 2023-07-06T21:58:32.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd4727fc640 1 -- 172.21.15.55:0/1965403940 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c0a5930 con 0x7fd4740cbeb0 2023-07-06T21:58:32.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd4727fc640 1 -- 172.21.15.55:0/1965403940 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0a5cc0 con 0x7fd4740cbeb0 2023-07-06T21:58:32.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 -- 172.21.15.55:0/1965403940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740cbeb0 msgr2=0x7fd47406ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 --2- 172.21.15.55:0/1965403940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740cbeb0 0x7fd47406ee50 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fd474071c90 tx=0x7fd46c01c910 comp rx=0 tx=0).stop 2023-07-06T21:58:32.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 -- 172.21.15.55:0/1965403940 shutdown_connections 2023-07-06T21:58:32.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 --2- 172.21.15.55:0/1965403940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740cbeb0 0x7fd47406ee50 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 --2- 172.21.15.55:0/1965403940 >> v2:172.21.15.138:3300/0 conn(0x7fd474156180 0x7fd4740ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 -- 172.21.15.55:0/1965403940 >> 172.21.15.55:0/1965403940 conn(0x7fd4740d0c50 msgr2=0x7fd4740cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:32.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 -- 172.21.15.55:0/1965403940 shutdown_connections 2023-07-06T21:58:32.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 -- 172.21.15.55:0/1965403940 wait complete. 2023-07-06T21:58:32.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 Processor -- start 2023-07-06T21:58:32.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 -- start start 2023-07-06T21:58:32.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd47406e9d0 0x7fd47414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4740cbeb0 0x7fd4740c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd474156180 0x7fd4740b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47414d5a0 con 0x7fd474156180 2023-07-06T21:58:32.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4740ca0a0 con 0x7fd4740cbeb0 2023-07-06T21:58:32.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd479448640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd474153680 con 0x7fd47406e9d0 2023-07-06T21:58:32.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd4737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd474156180 0x7fd4740b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd4737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd474156180 0x7fd4740b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33418/0 (socket says 172.21.15.55:33418) 2023-07-06T21:58:32.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.639+0000 7fd4737fe640 1 -- 172.21.15.55:0/3851417049 learned_addr learned my addr 172.21.15.55:0/3851417049 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:32.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd472ffd640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd47406e9d0 0x7fd47414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd46bfff640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4740cbeb0 0x7fd4740c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd4737fe640 1 -- 172.21.15.55:0/3851417049 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd47406e9d0 msgr2=0x7fd47414d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd4737fe640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd47406e9d0 0x7fd47414d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd4737fe640 1 -- 172.21.15.55:0/3851417049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4740cbeb0 msgr2=0x7fd4740c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd4737fe640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4740cbeb0 0x7fd4740c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd4737fe640 1 -- 172.21.15.55:0/3851417049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c009b30 con 0x7fd474156180 2023-07-06T21:58:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd472ffd640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd47406e9d0 0x7fd47414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd46bfff640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4740cbeb0 0x7fd4740c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd4737fe640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd474156180 0x7fd4740b1bf0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0af040 tx=0x7fd46c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd46b7fe640 1 -- 172.21.15.55:0/3851417049 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0b8670 con 0x7fd474156180 2023-07-06T21:58:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd46b7fe640 1 -- 172.21.15.55:0/3851417049 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c0b87d0 con 0x7fd474156180 2023-07-06T21:58:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd46b7fe640 1 -- 172.21.15.55:0/3851417049 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0b8b60 con 0x7fd474156180 2023-07-06T21:58:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd479448640 1 -- 172.21.15.55:0/3851417049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd474153960 con 0x7fd474156180 2023-07-06T21:58:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd479448640 1 -- 172.21.15.55:0/3851417049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd474153f20 con 0x7fd474156180 2023-07-06T21:58:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd479448640 1 -- 172.21.15.55:0/3851417049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd474066d60 con 0x7fd474156180 2023-07-06T21:58:32.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.643+0000 7fd46b7fe640 1 -- 172.21.15.55:0/3851417049 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd46c0b8cc0 con 0x7fd474156180 2023-07-06T21:58:32.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.647+0000 7fd46b7fe640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fd4540663a0 0x7fd454068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.647+0000 7fd46b7fe640 1 -- 172.21.15.55:0/3851417049 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6347+0+0 (secure 0 0 0) 0x7fd46c11f600 con 0x7fd474156180 2023-07-06T21:58:32.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.647+0000 7fd472ffd640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fd4540663a0 0x7fd454068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.647+0000 7fd472ffd640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fd4540663a0 0x7fd454068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd46400b9f0 tx=0x7fd464008040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:32.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.651+0000 7fd46b7fe640 1 -- 172.21.15.55:0/3851417049 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd46c0ec900 con 0x7fd474156180 2023-07-06T21:58:32.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.807+0000 7fd479448640 1 -- 172.21.15.55:0/3851417049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd4740cd930 con 0x7fd474156180 2023-07-06T21:58:32.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.807+0000 7fd46b7fe640 1 -- 172.21.15.55:0/3851417049 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd46c0eff20 con 0x7fd474156180 2023-07-06T21:58:32.807 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:58:32.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.807+0000 7fd479448640 1 -- 172.21.15.55:0/3851417049 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fd4540663a0 msgr2=0x7fd454068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.807+0000 7fd479448640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fd4540663a0 0x7fd454068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd46400b9f0 tx=0x7fd464008040 comp rx=0 tx=0).stop 2023-07-06T21:58:32.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.807+0000 7fd479448640 1 -- 172.21.15.55:0/3851417049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd474156180 msgr2=0x7fd4740b1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.807+0000 7fd479448640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd474156180 0x7fd4740b1bf0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0af040 tx=0x7fd46c0196b0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.811+0000 7fd479448640 1 -- 172.21.15.55:0/3851417049 shutdown_connections 2023-07-06T21:58:32.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.811+0000 7fd479448640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fd4540663a0 0x7fd454068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.811+0000 7fd479448640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd474156180 0x7fd4740b1bf0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.811+0000 7fd479448640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4740cbeb0 0x7fd4740c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.811+0000 7fd479448640 1 --2- 172.21.15.55:0/3851417049 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd47406e9d0 0x7fd47414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.811+0000 7fd479448640 1 -- 172.21.15.55:0/3851417049 >> 172.21.15.55:0/3851417049 conn(0x7fd4740d0c50 msgr2=0x7fd474151750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:32.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.811+0000 7fd479448640 1 -- 172.21.15.55:0/3851417049 shutdown_connections 2023-07-06T21:58:32.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.811+0000 7fd479448640 1 -- 172.21.15.55:0/3851417049 wait complete. 2023-07-06T21:58:32.828 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-06T21:58:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98e506d640 1 Processor -- start 2023-07-06T21:58:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98e506d640 1 -- start start 2023-07-06T21:58:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98e506d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f98e00cd140 0x7f98e0163380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98e506d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e0158c20 con 0x7f98e00ca130 2023-07-06T21:58:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98e506d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e00c8db0 con 0x7f98e0158850 2023-07-06T21:58:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98e506d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e00c9090 con 0x7f98e00cd140 2023-07-06T21:58:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98d7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f98e00ca130 0x7f98e00703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58614/0 (socket says 172.21.15.55:58614) 2023-07-06T21:58:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98d7fff640 1 -- 172.21.15.55:0/2528804655 learned_addr learned my addr 172.21.15.55:0/2528804655 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98df59e640 1 --2- 172.21.15.55:0/2528804655 >> v2:172.21.15.138:3300/0 conn(0x7f98e00cd140 0x7f98e0163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98de59c640 1 -- 172.21.15.55:0/2528804655 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266856309 0 0) 0x7f98e0158c20 con 0x7f98e00ca130 2023-07-06T21:58:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98de59c640 1 -- 172.21.15.55:0/2528804655 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98cc005740 con 0x7f98e00ca130 2023-07-06T21:58:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98de59c640 1 -- 172.21.15.55:0/2528804655 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049581784 0 0) 0x7f98e00c8db0 con 0x7f98e0158850 2023-07-06T21:58:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98de59c640 1 -- 172.21.15.55:0/2528804655 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98e0158c20 con 0x7f98e0158850 2023-07-06T21:58:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98de59c640 1 -- 172.21.15.55:0/2528804655 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3764070808 0 0) 0x7f98cc005740 con 0x7f98e00ca130 2023-07-06T21:58:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98df59e640 1 -- 172.21.15.55:0/2528804655 >> v1:172.21.15.138:6789/0 conn(0x7f98e0158850 legacy=0x7f98e00cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98df59e640 1 -- 172.21.15.55:0/2528804655 >> v1:172.21.15.55:6789/0 conn(0x7f98e00ca130 legacy=0x7f98e00703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.975+0000 7f98df59e640 1 -- 172.21.15.55:0/2528804655 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e00c9370 con 0x7f98e00cd140 2023-07-06T21:58:32.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.979+0000 7f98df59e640 1 --2- 172.21.15.55:0/2528804655 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e00cd140 0x7f98e0163380 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009d90 tx=0x7f98d801c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f100e7f920fc075 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:32.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.979+0000 7f98de59c640 1 -- 172.21.15.55:0/2528804655 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8001680 con 0x7f98e00cd140 2023-07-06T21:58:32.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.979+0000 7f98de59c640 1 -- 172.21.15.55:0/2528804655 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d80a9410 con 0x7f98e00cd140 2023-07-06T21:58:32.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.979+0000 7f98de59c640 1 -- 172.21.15.55:0/2528804655 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d80a97a0 con 0x7f98e00cd140 2023-07-06T21:58:32.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.979+0000 7f98e506d640 1 -- 172.21.15.55:0/2528804655 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e00cd140 msgr2=0x7f98e0163380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.979+0000 7f98e506d640 1 --2- 172.21.15.55:0/2528804655 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e00cd140 0x7f98e0163380 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009d90 tx=0x7f98d801c900 comp rx=0 tx=0).stop 2023-07-06T21:58:32.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.979+0000 7f98e506d640 1 -- 172.21.15.55:0/2528804655 shutdown_connections 2023-07-06T21:58:32.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.979+0000 7f98e506d640 1 --2- 172.21.15.55:0/2528804655 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e00cd140 0x7f98e0163380 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.979+0000 7f98e506d640 1 -- 172.21.15.55:0/2528804655 >> 172.21.15.55:0/2528804655 conn(0x7f98e00cea70 msgr2=0x7f98e00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:32.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.979+0000 7f98e506d640 1 -- 172.21.15.55:0/2528804655 shutdown_connections 2023-07-06T21:58:32.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.979+0000 7f98e506d640 1 -- 172.21.15.55:0/2528804655 wait complete. 2023-07-06T21:58:32.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98e506d640 1 Processor -- start 2023-07-06T21:58:32.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98e506d640 1 -- start start 2023-07-06T21:58:32.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98e506d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98e00ca130 0x7f98e00c3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98e506d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e00cd140 0x7f98e01f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98e506d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e0158850 0x7f98e006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98e506d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e01f4480 con 0x7f98e0158850 2023-07-06T21:58:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98e506d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e01f4de0 con 0x7f98e00cd140 2023-07-06T21:58:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98e506d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0069ab0 con 0x7f98e00ca130 2023-07-06T21:58:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98df59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e0158850 0x7f98e006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98df59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e0158850 0x7f98e006bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33420/0 (socket says 172.21.15.55:33420) 2023-07-06T21:58:32.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98df59e640 1 -- 172.21.15.55:0/1284977334 learned_addr learned my addr 172.21.15.55:0/1284977334 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:32.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98d7fff640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e00cd140 0x7f98e01f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98ded9d640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98e00ca130 0x7f98e00c3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98df59e640 1 -- 172.21.15.55:0/1284977334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98e00ca130 msgr2=0x7f98e00c3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98df59e640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98e00ca130 0x7f98e00c3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98df59e640 1 -- 172.21.15.55:0/1284977334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e00cd140 msgr2=0x7f98e01f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:32.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98df59e640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e00cd140 0x7f98e01f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:32.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98df59e640 1 -- 172.21.15.55:0/1284977334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d8009a70 con 0x7f98e0158850 2023-07-06T21:58:32.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98d7fff640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e00cd140 0x7f98e01f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:32.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98ded9d640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98e00ca130 0x7f98e00c3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:32.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98df59e640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e0158850 0x7f98e006bfb0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f98d801c370 tx=0x7f98d80196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:32.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98d77fe640 1 -- 172.21.15.55:0/1284977334 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d80039a0 con 0x7f98e0158850 2023-07-06T21:58:32.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98d77fe640 1 -- 172.21.15.55:0/1284977334 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d80b7040 con 0x7f98e0158850 2023-07-06T21:58:32.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98d77fe640 1 -- 172.21.15.55:0/1284977334 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8003d40 con 0x7f98e0158850 2023-07-06T21:58:32.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98e506d640 1 -- 172.21.15.55:0/1284977334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e01f3b80 con 0x7f98e0158850 2023-07-06T21:58:32.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98e506d640 1 -- 172.21.15.55:0/1284977334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e006c4f0 con 0x7f98e0158850 2023-07-06T21:58:32.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.983+0000 7f98e506d640 1 -- 172.21.15.55:0/1284977334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e01f45c0 con 0x7f98e0158850 2023-07-06T21:58:32.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.987+0000 7f98d77fe640 1 -- 172.21.15.55:0/1284977334 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f98d80a7040 con 0x7f98e0158850 2023-07-06T21:58:32.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.987+0000 7f98d77fe640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f98c00663a0 0x7f98c0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:32.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.987+0000 7f98d77fe640 1 -- 172.21.15.55:0/1284977334 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f98d811eff0 con 0x7f98e0158850 2023-07-06T21:58:32.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.987+0000 7f98ded9d640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f98c00663a0 0x7f98c0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:32.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.987+0000 7f98ded9d640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f98c00663a0 0x7f98c0068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f98d00011f0 tx=0x7f98d0009040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:32.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:32.991+0000 7f98d77fe640 1 -- 172.21.15.55:0/1284977334 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98e01f45c0 con 0x7f98e0158850 2023-07-06T21:58:33.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.147+0000 7f98e506d640 1 -- 172.21.15.55:0/1284977334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f98e006c4f0 con 0x7f98e0158850 2023-07-06T21:58:33.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.151+0000 7f98d77fe640 1 -- 172.21.15.55:0/1284977334 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f98e006c4f0 con 0x7f98e0158850 2023-07-06T21:58:33.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.151+0000 7f98e506d640 1 -- 172.21.15.55:0/1284977334 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f98c00663a0 msgr2=0x7f98c0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:33.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.151+0000 7f98e506d640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f98c00663a0 0x7f98c0068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f98d00011f0 tx=0x7f98d0009040 comp rx=0 tx=0).stop 2023-07-06T21:58:33.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.151+0000 7f98e506d640 1 -- 172.21.15.55:0/1284977334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e0158850 msgr2=0x7f98e006bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:33.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.151+0000 7f98e506d640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e0158850 0x7f98e006bfb0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f98d801c370 tx=0x7f98d80196a0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.155+0000 7f98e506d640 1 -- 172.21.15.55:0/1284977334 shutdown_connections 2023-07-06T21:58:33.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.155+0000 7f98e506d640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f98c00663a0 0x7f98c0068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.155+0000 7f98e506d640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e0158850 0x7f98e006bfb0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.155+0000 7f98e506d640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e00cd140 0x7f98e01f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.155+0000 7f98e506d640 1 --2- 172.21.15.55:0/1284977334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98e00ca130 0x7f98e00c3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.155+0000 7f98e506d640 1 -- 172.21.15.55:0/1284977334 >> 172.21.15.55:0/1284977334 conn(0x7f98e00cea70 msgr2=0x7f98e00af780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:33.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.155+0000 7f98e506d640 1 -- 172.21.15.55:0/1284977334 shutdown_connections 2023-07-06T21:58:33.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.155+0000 7f98e506d640 1 -- 172.21.15.55:0/1284977334 wait complete. 2023-07-06T21:58:33.171 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T21:58:33.171 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:58:33.235 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:58:33.295 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T21:58:33.296 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:58:33.296 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:58:33.304 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T21:58:33.305 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:58:33.305 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:58:33.314 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:58:33.315 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:58:33.315 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:58:33.356 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T21:58:33.356 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T21:58:33.356 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:58:33.366 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T21:58:33.366 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-06T21:58:33.367 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:58:33.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b83e5c640 1 Processor -- start 2023-07-06T21:58:33.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b83e5c640 1 -- start start 2023-07-06T21:58:33.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b83e5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b7c0b1fe0 0x7f3b7c166ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:33.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b83e5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7c0cd1c0 con 0x7f3b7c0b7cd0 2023-07-06T21:58:33.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b83e5c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7c0cecf0 con 0x7f3b7c0ce610 2023-07-06T21:58:33.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b83e5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c0d2310 con 0x7f3b7c0b1fe0 2023-07-06T21:58:33.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b81bf8640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3b7c0b7cd0 0x7f3b7c0ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33884/0 (socket says 172.21.15.55:33884) 2023-07-06T21:58:33.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b81bf8640 1 -- 172.21.15.55:0/3430065871 learned_addr learned my addr 172.21.15.55:0/3430065871 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:33.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b823f9640 1 --2- 172.21.15.55:0/3430065871 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b7c0b1fe0 0x7f3b7c166ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:33.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 -- 172.21.15.55:0/3430065871 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223471530 0 0) 0x7f3b7c0cd1c0 con 0x7f3b7c0b7cd0 2023-07-06T21:58:33.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 -- 172.21.15.55:0/3430065871 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b68003530 con 0x7f3b7c0b7cd0 2023-07-06T21:58:33.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 -- 172.21.15.55:0/3430065871 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4262989557 0 0) 0x7f3b68003530 con 0x7f3b7c0b7cd0 2023-07-06T21:58:33.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 -- 172.21.15.55:0/3430065871 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b7c0b1fe0 msgr2=0x7f3b7c166ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:33.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 --2- 172.21.15.55:0/3430065871 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b7c0b1fe0 0x7f3b7c166ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 -- 172.21.15.55:0/3430065871 >> v1:172.21.15.138:6789/0 conn(0x7f3b7c0ce610 legacy=0x7f3b7c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:33.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 -- 172.21.15.55:0/3430065871 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c0cea60 con 0x7f3b7c0b7cd0 2023-07-06T21:58:33.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 -- 172.21.15.55:0/3430065871 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f3b78001680 con 0x7f3b7c0b7cd0 2023-07-06T21:58:33.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 -- 172.21.15.55:0/3430065871 >> v1:172.21.15.55:6789/0 conn(0x7f3b7c0b7cd0 legacy=0x7f3b7c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:33.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 --2- 172.21.15.55:0/3430065871 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b7c0b1fe0 0x7f3b680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:33.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 --2- 172.21.15.55:0/3430065871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b68003f30 0x7f3b680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:33.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 --2- 172.21.15.55:0/3430065871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b68004d10 0x7f3b68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:33.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 -- 172.21.15.55:0/3430065871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6800bb20 con 0x7f3b68003f30 2023-07-06T21:58:33.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 -- 172.21.15.55:0/3430065871 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6800bc60 con 0x7f3b68004d10 2023-07-06T21:58:33.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b80bf6640 1 -- 172.21.15.55:0/3430065871 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6800be20 con 0x7f3b7c0b1fe0 2023-07-06T21:58:33.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b813f7640 1 --2- 172.21.15.55:0/3430065871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b68003f30 0x7f3b680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:33.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b81bf8640 1 --2- 172.21.15.55:0/3430065871 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b7c0b1fe0 0x7f3b680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:33.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.543+0000 7f3b823f9640 1 --2- 172.21.15.55:0/3430065871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b68004d10 0x7f3b68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:33.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b813f7640 1 -- 172.21.15.55:0/3430065871 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b7c0b1fe0 msgr2=0x7f3b680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:33.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b813f7640 1 --2- 172.21.15.55:0/3430065871 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b7c0b1fe0 0x7f3b680039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b813f7640 1 -- 172.21.15.55:0/3430065871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b68004d10 msgr2=0x7f3b68005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:33.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b813f7640 1 --2- 172.21.15.55:0/3430065871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b68004d10 0x7f3b68005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b813f7640 1 -- 172.21.15.55:0/3430065871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b68003530 con 0x7f3b68003f30 2023-07-06T21:58:33.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b823f9640 1 --2- 172.21.15.55:0/3430065871 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b68004d10 0x7f3b68005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:33.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b813f7640 1 --2- 172.21.15.55:0/3430065871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b68003f30 0x7f3b680047d0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c001750 tx=0x7f3b6c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e6097703574778 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:33.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b80bf6640 1 -- 172.21.15.55:0/3430065871 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0052d0 con 0x7f3b68003f30 2023-07-06T21:58:33.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b80bf6640 1 -- 172.21.15.55:0/3430065871 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c0a7050 con 0x7f3b68003f30 2023-07-06T21:58:33.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b80bf6640 1 -- 172.21.15.55:0/3430065871 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c003600 con 0x7f3b68003f30 2023-07-06T21:58:33.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b83e5c640 1 -- 172.21.15.55:0/3430065871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b68003f30 msgr2=0x7f3b680047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:33.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b83e5c640 1 --2- 172.21.15.55:0/3430065871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b68003f30 0x7f3b680047d0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c001750 tx=0x7f3b6c01c3c0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b823f9640 1 -- 172.21.15.55:0/3430065871 reap_dead start 2023-07-06T21:58:33.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b83e5c640 1 -- 172.21.15.55:0/3430065871 shutdown_connections 2023-07-06T21:58:33.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.547+0000 7f3b83e5c640 1 -- 172.21.15.55:0/3430065871 >> 172.21.15.55:0/3430065871 conn(0x7f3b7c0ceee0 msgr2=0x7f3b7c0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:33.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b83e5c640 1 -- 172.21.15.55:0/3430065871 shutdown_connections 2023-07-06T21:58:33.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b83e5c640 1 -- 172.21.15.55:0/3430065871 wait complete. 2023-07-06T21:58:33.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b83e5c640 1 Processor -- start 2023-07-06T21:58:33.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b83e5c640 1 -- start start 2023-07-06T21:58:33.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b83e5c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b68003f30 0x7f3b7c154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b83e5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b7c14ae30 0x7f3b7c14b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b83e5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c14bac0 0x7f3b7c151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b83e5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c1546d0 con 0x7f3b7c14bac0 2023-07-06T21:58:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b83e5c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c153ac0 con 0x7f3b68003f30 2023-07-06T21:58:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b83e5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c153da0 con 0x7f3b7c14ae30 2023-07-06T21:58:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b823f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c14bac0 0x7f3b7c151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b823f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c14bac0 0x7f3b7c151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44378/0 (socket says 172.21.15.55:44378) 2023-07-06T21:58:33.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b823f9640 1 -- 172.21.15.55:0/682695839 learned_addr learned my addr 172.21.15.55:0/682695839 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:33.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b81bf8640 1 --2- 172.21.15.55:0/682695839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b68003f30 0x7f3b7c154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:33.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b813f7640 1 --2- 172.21.15.55:0/682695839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b7c14ae30 0x7f3b7c14b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:33.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b823f9640 1 -- 172.21.15.55:0/682695839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b7c14ae30 msgr2=0x7f3b7c14b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:33.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b823f9640 1 --2- 172.21.15.55:0/682695839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b7c14ae30 0x7f3b7c14b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b823f9640 1 -- 172.21.15.55:0/682695839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b68003f30 msgr2=0x7f3b7c154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:33.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b823f9640 1 --2- 172.21.15.55:0/682695839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b68003f30 0x7f3b7c154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b823f9640 1 -- 172.21.15.55:0/682695839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c154080 con 0x7f3b7c14bac0 2023-07-06T21:58:33.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.551+0000 7f3b823f9640 1 --2- 172.21.15.55:0/682695839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c14bac0 0x7f3b7c151e00 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c08b4c0 tx=0x7f3b74007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:33.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.555+0000 7f3b727fc640 1 -- 172.21.15.55:0/682695839 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7401b070 con 0x7f3b7c14bac0 2023-07-06T21:58:33.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.555+0000 7f3b727fc640 1 -- 172.21.15.55:0/682695839 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7400f040 con 0x7f3b7c14bac0 2023-07-06T21:58:33.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.555+0000 7f3b727fc640 1 -- 172.21.15.55:0/682695839 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7400e050 con 0x7f3b7c14bac0 2023-07-06T21:58:33.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.555+0000 7f3b83e5c640 1 -- 172.21.15.55:0/682695839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c154360 con 0x7f3b7c14bac0 2023-07-06T21:58:33.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.555+0000 7f3b83e5c640 1 -- 172.21.15.55:0/682695839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c14b2a0 con 0x7f3b7c14bac0 2023-07-06T21:58:33.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.555+0000 7f3b83e5c640 1 -- 172.21.15.55:0/682695839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7c066d60 con 0x7f3b7c14bac0 2023-07-06T21:58:33.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.555+0000 7f3b727fc640 1 -- 172.21.15.55:0/682695839 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3b74003be0 con 0x7f3b7c14bac0 2023-07-06T21:58:33.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.555+0000 7f3b727fc640 1 --2- 172.21.15.55:0/682695839 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f3b600663d0 0x7f3b60068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:33.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.555+0000 7f3b727fc640 1 -- 172.21.15.55:0/682695839 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f3b74083e80 con 0x7f3b7c14bac0 2023-07-06T21:58:33.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.555+0000 7f3b81bf8640 1 --2- 172.21.15.55:0/682695839 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f3b600663d0 0x7f3b60068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:33.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.559+0000 7f3b81bf8640 1 --2- 172.21.15.55:0/682695839 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f3b600663d0 0x7f3b60068880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b78001c20 tx=0x7f3b78001b30 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:33.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.559+0000 7f3b727fc640 1 -- 172.21.15.55:0/682695839 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b74050fe0 con 0x7f3b7c14bac0 2023-07-06T21:58:33.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.747+0000 7f3b83e5c640 1 -- 172.21.15.55:0/682695839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b7c0cce50 con 0x7f3b7c14bac0 2023-07-06T21:58:33.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.747+0000 7f3b727fc640 1 -- 172.21.15.55:0/682695839 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f3b74054600 con 0x7f3b7c14bac0 2023-07-06T21:58:33.748 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:33.748 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2387174661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2387174661},{"type":"v1","addr":"172.21.15.138:6835","nonce":2387174661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7081,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3545643267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3545643267},{"type":"v1","addr":"172.21.15.138:6834","nonce":3545643267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7470,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1177943393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1177943393},{"type":"v1","addr":"172.21.15.55:6835","nonce":1177943393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7941,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2665934151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":2665934151},{"type":"v1","addr":"172.21.15.55:6837","nonce":2665934151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[]} 2023-07-06T21:58:33.748 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 42 2023-07-06T21:58:33.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.751+0000 7f3b83e5c640 1 -- 172.21.15.55:0/682695839 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f3b600663d0 msgr2=0x7f3b60068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:33.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.751+0000 7f3b83e5c640 1 --2- 172.21.15.55:0/682695839 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f3b600663d0 0x7f3b60068880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b78001c20 tx=0x7f3b78001b30 comp rx=0 tx=0).stop 2023-07-06T21:58:33.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.751+0000 7f3b83e5c640 1 -- 172.21.15.55:0/682695839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c14bac0 msgr2=0x7f3b7c151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:33.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.751+0000 7f3b83e5c640 1 --2- 172.21.15.55:0/682695839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c14bac0 0x7f3b7c151e00 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c08b4c0 tx=0x7f3b74007e40 comp rx=0 tx=0).stop 2023-07-06T21:58:33.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.751+0000 7f3b83e5c640 1 -- 172.21.15.55:0/682695839 shutdown_connections 2023-07-06T21:58:33.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.751+0000 7f3b83e5c640 1 --2- 172.21.15.55:0/682695839 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f3b600663d0 0x7f3b60068880 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.751+0000 7f3b83e5c640 1 --2- 172.21.15.55:0/682695839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c14bac0 0x7f3b7c151e00 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.751+0000 7f3b83e5c640 1 --2- 172.21.15.55:0/682695839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b7c14ae30 0x7f3b7c14b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.751+0000 7f3b83e5c640 1 --2- 172.21.15.55:0/682695839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b68003f30 0x7f3b7c154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.751+0000 7f3b83e5c640 1 -- 172.21.15.55:0/682695839 >> 172.21.15.55:0/682695839 conn(0x7f3b7c0ceee0 msgr2=0x7f3b7c0b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:33.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.751+0000 7f3b83e5c640 1 -- 172.21.15.55:0/682695839 shutdown_connections 2023-07-06T21:58:33.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.751+0000 7f3b83e5c640 1 -- 172.21.15.55:0/682695839 wait complete. 2023-07-06T21:58:33.768 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T21:58:33.769 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-06T21:58:33.769 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T21:58:33.769 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:58:33.769 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T21:58:33.770 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-06T21:58:33.770 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T21:58:33.770 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:58:33.770 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T21:58:33.770 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-06T21:58:33.771 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T21:58:33.771 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:58:33.771 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T21:58:33.771 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-06T21:58:33.772 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T21:58:33.772 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T21:58:33.781 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T21:58:33.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T21:58:33.783 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T21:58:33.783 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T21:58:33.786 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T21:58:33.787 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T21:58:33.787 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T21:58:33.788 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T21:58:33.826 INFO:tasks.ceph.mds.a:Started 2023-07-06T21:58:33.827 DEBUG:teuthology.parallel:result is None 2023-07-06T21:58:33.829 INFO:tasks.ceph.mds.c:Started 2023-07-06T21:58:33.829 DEBUG:teuthology.parallel:result is None 2023-07-06T21:58:33.835 INFO:tasks.ceph.mds.b:Started 2023-07-06T21:58:33.835 DEBUG:teuthology.parallel:result is None 2023-07-06T21:58:33.837 INFO:tasks.ceph.mds.d:Started 2023-07-06T21:58:33.837 DEBUG:teuthology.parallel:result is None 2023-07-06T21:58:33.838 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-06T21:58:33.914 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-07-06T21:58:33.915 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T21:58:33.933 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-07-06T21:58:33.934 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-07-06T21:58:33.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f29740640 1 Processor -- start 2023-07-06T21:58:33.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f29740640 1 -- start start 2023-07-06T21:58:33.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f29740640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2f24158850 0x7f2f240cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:33.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f29740640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f240ca130 0x7f2f240ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:33.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f29740640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f240703e0 0x7f2f24070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:33.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f29740640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f24070dc0 con 0x7f2f240ca130 2023-07-06T21:58:33.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f29740640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f24158c20 con 0x7f2f24158850 2023-07-06T21:58:33.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f29740640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f240c8db0 con 0x7f2f240703e0 2023-07-06T21:58:33.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f1a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f240ca130 0x7f2f240ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:33.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f1a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f240ca130 0x7f2f240ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44394/0 (socket says 172.21.15.55:44394) 2023-07-06T21:58:33.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f1a7fc640 1 -- 172.21.15.55:0/1103842951 learned_addr learned my addr 172.21.15.55:0/1103842951 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:33.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f22ffd640 1 --2- 172.21.15.55:0/1103842951 >> v2:172.21.15.138:3300/0 conn(0x7f2f24158850 0x7f2f240cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:33.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f237fe640 1 --2- 172.21.15.55:0/1103842951 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f240703e0 0x7f2f24070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:33.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f1a7fc640 1 -- 172.21.15.55:0/1103842951 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f240703e0 msgr2=0x7f2f24070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:33.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f1a7fc640 1 --2- 172.21.15.55:0/1103842951 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f240703e0 0x7f2f24070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f1a7fc640 1 -- 172.21.15.55:0/1103842951 >> v2:172.21.15.138:3300/0 conn(0x7f2f24158850 msgr2=0x7f2f240cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:33.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f1a7fc640 1 --2- 172.21.15.55:0/1103842951 >> v2:172.21.15.138:3300/0 conn(0x7f2f24158850 0x7f2f240cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.991+0000 7f2f1a7fc640 1 -- 172.21.15.55:0/1103842951 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f240c9090 con 0x7f2f240ca130 2023-07-06T21:58:33.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.995+0000 7f2f1a7fc640 1 --2- 172.21.15.55:0/1103842951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f240ca130 0x7f2f240ccf70 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f2f2406eaf0 tx=0x7f2f0c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27751cf0d5aa1aca server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:33.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.995+0000 7f2f227fc640 1 -- 172.21.15.55:0/1103842951 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0a89b0 con 0x7f2f240ca130 2023-07-06T21:58:33.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.995+0000 7f2f227fc640 1 -- 172.21.15.55:0/1103842951 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c0a8b10 con 0x7f2f240ca130 2023-07-06T21:58:33.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.995+0000 7f2f227fc640 1 -- 172.21.15.55:0/1103842951 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0a8ea0 con 0x7f2f240ca130 2023-07-06T21:58:33.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.995+0000 7f2f29740640 1 -- 172.21.15.55:0/1103842951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f240ca130 msgr2=0x7f2f240ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:33.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.995+0000 7f2f29740640 1 --2- 172.21.15.55:0/1103842951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f240ca130 0x7f2f240ccf70 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f2f2406eaf0 tx=0x7f2f0c01ecf0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.995+0000 7f2f29740640 1 -- 172.21.15.55:0/1103842951 shutdown_connections 2023-07-06T21:58:33.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.995+0000 7f2f29740640 1 --2- 172.21.15.55:0/1103842951 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f240703e0 0x7f2f24070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.995+0000 7f2f29740640 1 --2- 172.21.15.55:0/1103842951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f240ca130 0x7f2f240ccf70 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.995+0000 7f2f29740640 1 --2- 172.21.15.55:0/1103842951 >> v2:172.21.15.138:3300/0 conn(0x7f2f24158850 0x7f2f240cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:33.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.995+0000 7f2f29740640 1 -- 172.21.15.55:0/1103842951 >> 172.21.15.55:0/1103842951 conn(0x7f2f240cea70 msgr2=0x7f2f240ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:33.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.995+0000 7f2f29740640 1 -- 172.21.15.55:0/1103842951 shutdown_connections 2023-07-06T21:58:33.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.995+0000 7f2f29740640 1 -- 172.21.15.55:0/1103842951 wait complete. 2023-07-06T21:58:33.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f29740640 1 Processor -- start 2023-07-06T21:58:33.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f29740640 1 -- start start 2023-07-06T21:58:33.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f29740640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f240703e0 0x7f2f24157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f29740640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f240ca130 0x7f2f240c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f29740640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f24158850 0x7f2f24069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f29740640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f24069900 con 0x7f2f240703e0 2023-07-06T21:58:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f29740640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f24158240 con 0x7f2f240ca130 2023-07-06T21:58:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f29740640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f240c5560 con 0x7f2f24158850 2023-07-06T21:58:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f22ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f240703e0 0x7f2f24157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f22ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f240703e0 0x7f2f24157d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44406/0 (socket says 172.21.15.55:44406) 2023-07-06T21:58:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f22ffd640 1 -- 172.21.15.55:0/1857669276 learned_addr learned my addr 172.21.15.55:0/1857669276 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f237fe640 1 --2- 172.21.15.55:0/1857669276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f24158850 0x7f2f24069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f1a7fc640 1 --2- 172.21.15.55:0/1857669276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f240ca130 0x7f2f240c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:34.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f22ffd640 1 -- 172.21.15.55:0/1857669276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f24158850 msgr2=0x7f2f24069d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:34.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f22ffd640 1 --2- 172.21.15.55:0/1857669276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f24158850 0x7f2f24069d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:34.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f22ffd640 1 -- 172.21.15.55:0/1857669276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f240ca130 msgr2=0x7f2f240c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:34.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f22ffd640 1 --2- 172.21.15.55:0/1857669276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f240ca130 0x7f2f240c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:34.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f22ffd640 1 -- 172.21.15.55:0/1857669276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c0094d0 con 0x7f2f240703e0 2023-07-06T21:58:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f22ffd640 1 --2- 172.21.15.55:0/1857669276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f240703e0 0x7f2f24157d00 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400e870 tx=0x7f2f1400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f1bfff640 1 -- 172.21.15.55:0/1857669276 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14009510 con 0x7f2f240703e0 2023-07-06T21:58:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f1bfff640 1 -- 172.21.15.55:0/1857669276 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1400eec0 con 0x7f2f240703e0 2023-07-06T21:58:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f1bfff640 1 -- 172.21.15.55:0/1857669276 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1400cb40 con 0x7f2f240703e0 2023-07-06T21:58:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f29740640 1 -- 172.21.15.55:0/1857669276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f240c5ea0 con 0x7f2f240703e0 2023-07-06T21:58:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f29740640 1 -- 172.21.15.55:0/1857669276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f24069520 con 0x7f2f240703e0 2023-07-06T21:58:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:33.999+0000 7f2f29740640 1 -- 172.21.15.55:0/1857669276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f24066d60 con 0x7f2f240703e0 2023-07-06T21:58:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.003+0000 7f2f1bfff640 1 -- 172.21.15.55:0/1857669276 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2f1400cca0 con 0x7f2f240703e0 2023-07-06T21:58:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.003+0000 7f2f1bfff640 1 --2- 172.21.15.55:0/1857669276 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2f040663a0 0x7f2f04068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.003+0000 7f2f1bfff640 1 -- 172.21.15.55:0/1857669276 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6347+0+0 (secure 0 0 0) 0x7f2f14083fd0 con 0x7f2f240703e0 2023-07-06T21:58:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.003+0000 7f2f1a7fc640 1 --2- 172.21.15.55:0/1857669276 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2f040663a0 0x7f2f04068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:34.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.003+0000 7f2f1a7fc640 1 --2- 172.21.15.55:0/1857669276 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2f040663a0 0x7f2f04068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0b2000 tx=0x7f2f0c009040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.007+0000 7f2f1bfff640 1 -- 172.21.15.55:0/1857669276 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f140512c0 con 0x7f2f240703e0 2023-07-06T21:58:34.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.175+0000 7f2f29740640 1 -- 172.21.15.55:0/1857669276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2f2409e2e0 con 0x7f2f240703e0 2023-07-06T21:58:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.975+0000 7f2f1bfff640 1 -- 172.21.15.55:0/1857669276 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v113) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2f14017080 con 0x7f2f240703e0 2023-07-06T21:58:34.974 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-07-06T21:58:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.975+0000 7f2f29740640 1 -- 172.21.15.55:0/1857669276 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2f040663a0 msgr2=0x7f2f04068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.975+0000 7f2f29740640 1 --2- 172.21.15.55:0/1857669276 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2f040663a0 0x7f2f04068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0b2000 tx=0x7f2f0c009040 comp rx=0 tx=0).stop 2023-07-06T21:58:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.979+0000 7f2f29740640 1 -- 172.21.15.55:0/1857669276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f240703e0 msgr2=0x7f2f24157d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.979+0000 7f2f29740640 1 --2- 172.21.15.55:0/1857669276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f240703e0 0x7f2f24157d00 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400e870 tx=0x7f2f1400ec70 comp rx=0 tx=0).stop 2023-07-06T21:58:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.979+0000 7f2f29740640 1 -- 172.21.15.55:0/1857669276 shutdown_connections 2023-07-06T21:58:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.979+0000 7f2f29740640 1 --2- 172.21.15.55:0/1857669276 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2f040663a0 0x7f2f04068850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.979+0000 7f2f29740640 1 --2- 172.21.15.55:0/1857669276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f24158850 0x7f2f24069d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.979+0000 7f2f29740640 1 --2- 172.21.15.55:0/1857669276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f240ca130 0x7f2f240c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.979+0000 7f2f29740640 1 --2- 172.21.15.55:0/1857669276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f240703e0 0x7f2f24157d00 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.979+0000 7f2f29740640 1 -- 172.21.15.55:0/1857669276 >> 172.21.15.55:0/1857669276 conn(0x7f2f240cea70 msgr2=0x7f2f240b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.979+0000 7f2f29740640 1 -- 172.21.15.55:0/1857669276 shutdown_connections 2023-07-06T21:58:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:34.979+0000 7f2f29740640 1 -- 172.21.15.55:0/1857669276 wait complete. 2023-07-06T21:58:34.999 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-06T21:58:35.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.147+0000 7fecbd89c640 1 Processor -- start 2023-07-06T21:58:35.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.147+0000 7fecbd89c640 1 -- start start 2023-07-06T21:58:35.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.147+0000 7fecbd89c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fecb8158400 0x7fecb80c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.147+0000 7fecbd89c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb806fae0 con 0x7fecb80c9680 2023-07-06T21:58:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.147+0000 7fecbd89c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb806fdc0 con 0x7fecb81587d0 2023-07-06T21:58:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.147+0000 7fecbd89c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb80700a0 con 0x7fecb8158400 2023-07-06T21:58:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.147+0000 7fecae7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fecb80c9680 0x7fecb8070b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33896/0 (socket says 172.21.15.55:33896) 2023-07-06T21:58:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.147+0000 7fecae7fc640 1 -- 172.21.15.55:0/992754820 learned_addr learned my addr 172.21.15.55:0/992754820 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.147+0000 7fecb6ffd640 1 --2- 172.21.15.55:0/992754820 >> v2:172.21.15.55:3300/0 conn(0x7fecb8158400 0x7fecb80c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.151+0000 7fecb67fc640 1 -- 172.21.15.55:0/992754820 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159859293 0 0) 0x7fecb806fae0 con 0x7fecb80c9680 2023-07-06T21:58:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.151+0000 7fecb6ffd640 1 -- 172.21.15.55:0/992754820 >> v1:172.21.15.138:6789/0 conn(0x7fecb81587d0 legacy=0x7fecb80cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.151+0000 7fecb6ffd640 1 -- 172.21.15.55:0/992754820 >> v1:172.21.15.55:6789/0 conn(0x7fecb80c9680 legacy=0x7fecb8070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.151+0000 7fecb6ffd640 1 -- 172.21.15.55:0/992754820 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb8070380 con 0x7fecb8158400 2023-07-06T21:58:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.151+0000 7fecb6ffd640 1 --2- 172.21.15.55:0/992754820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb8158400 0x7fecb80c9140 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7feca00097c0 tx=0x7feca001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f0e226af60cf8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:35.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.151+0000 7fecb67fc640 1 -- 172.21.15.55:0/992754820 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00ab600 con 0x7fecb8158400 2023-07-06T21:58:35.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.151+0000 7fecb67fc640 1 -- 172.21.15.55:0/992754820 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca00a7050 con 0x7fecb8158400 2023-07-06T21:58:35.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.151+0000 7fecb67fc640 1 -- 172.21.15.55:0/992754820 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00ab980 con 0x7fecb8158400 2023-07-06T21:58:35.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.151+0000 7fecbd89c640 1 -- 172.21.15.55:0/992754820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb8158400 msgr2=0x7fecb80c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.151+0000 7fecbd89c640 1 --2- 172.21.15.55:0/992754820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb8158400 0x7fecb80c9140 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7feca00097c0 tx=0x7feca001c3c0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.151+0000 7fecbd89c640 1 -- 172.21.15.55:0/992754820 shutdown_connections 2023-07-06T21:58:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.151+0000 7fecbd89c640 1 --2- 172.21.15.55:0/992754820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb8158400 0x7fecb80c9140 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.151+0000 7fecbd89c640 1 -- 172.21.15.55:0/992754820 >> 172.21.15.55:0/992754820 conn(0x7fecb80cded0 msgr2=0x7fecb80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecbd89c640 1 -- 172.21.15.55:0/992754820 shutdown_connections 2023-07-06T21:58:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecbd89c640 1 -- 172.21.15.55:0/992754820 wait complete. 2023-07-06T21:58:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecbd89c640 1 Processor -- start 2023-07-06T21:58:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecbd89c640 1 -- start start 2023-07-06T21:58:35.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecbd89c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb80c9680 0x7fecb80cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecbd89c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecb8158400 0x7fecb8156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecbd89c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecb81587d0 0x7fecb8149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecbd89c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80c5cc0 con 0x7fecb80c9680 2023-07-06T21:58:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecbd89c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80c5fa0 con 0x7fecb81587d0 2023-07-06T21:58:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecbd89c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80c6280 con 0x7fecb8158400 2023-07-06T21:58:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecb6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb80c9680 0x7fecb80cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecb6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb80c9680 0x7fecb80cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44422/0 (socket says 172.21.15.55:44422) 2023-07-06T21:58:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecb6ffd640 1 -- 172.21.15.55:0/200017250 learned_addr learned my addr 172.21.15.55:0/200017250 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecae7fc640 1 --2- 172.21.15.55:0/200017250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecb8158400 0x7fecb8156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecb77fe640 1 --2- 172.21.15.55:0/200017250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecb81587d0 0x7fecb8149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecb6ffd640 1 -- 172.21.15.55:0/200017250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecb8158400 msgr2=0x7fecb8156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecb6ffd640 1 --2- 172.21.15.55:0/200017250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecb8158400 0x7fecb8156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecb6ffd640 1 -- 172.21.15.55:0/200017250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecb81587d0 msgr2=0x7fecb8149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecb6ffd640 1 --2- 172.21.15.55:0/200017250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecb81587d0 0x7fecb8149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.155+0000 7fecb6ffd640 1 -- 172.21.15.55:0/200017250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca0009420 con 0x7fecb80c9680 2023-07-06T21:58:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.159+0000 7fecb6ffd640 1 --2- 172.21.15.55:0/200017250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb80c9680 0x7fecb80cd1c0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7feca0018fd0 tx=0x7feca001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.159+0000 7fecb4ff9640 1 -- 172.21.15.55:0/200017250 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00b7650 con 0x7fecb80c9680 2023-07-06T21:58:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.159+0000 7fecb4ff9640 1 -- 172.21.15.55:0/200017250 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca00abe90 con 0x7fecb80c9680 2023-07-06T21:58:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.159+0000 7fecbd89c640 1 -- 172.21.15.55:0/200017250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb80c6560 con 0x7fecb80c9680 2023-07-06T21:58:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.159+0000 7fecb4ff9640 1 -- 172.21.15.55:0/200017250 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00b7a10 con 0x7fecb80c9680 2023-07-06T21:58:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.159+0000 7fecbd89c640 1 -- 172.21.15.55:0/200017250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb814a920 con 0x7fecb80c9680 2023-07-06T21:58:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.159+0000 7fecbd89c640 1 -- 172.21.15.55:0/200017250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb806c580 con 0x7fecb80c9680 2023-07-06T21:58:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.159+0000 7fecb4ff9640 1 -- 172.21.15.55:0/200017250 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feca00b7b70 con 0x7fecb80c9680 2023-07-06T21:58:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.159+0000 7fecb4ff9640 1 --2- 172.21.15.55:0/200017250 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fec980663a0 0x7fec98068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.159+0000 7fecb4ff9640 1 -- 172.21.15.55:0/200017250 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5530+0+0 (secure 0 0 0) 0x7feca011e640 con 0x7fecb80c9680 2023-07-06T21:58:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.159+0000 7fecae7fc640 1 --2- 172.21.15.55:0/200017250 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fec980663a0 0x7fec98068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.163+0000 7fecae7fc640 1 --2- 172.21.15.55:0/200017250 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fec980663a0 0x7fec98068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fecb8157720 tx=0x7feca8007240 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.163+0000 7fecb4ff9640 1 -- 172.21.15.55:0/200017250 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feca00ebac0 con 0x7fecb80c9680 2023-07-06T21:58:35.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.379+0000 7fecbd89c640 1 -- 172.21.15.55:0/200017250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fecb8066d60 con 0x7fecb80c9680 2023-07-06T21:58:35.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.379+0000 7fecb4ff9640 1 -- 172.21.15.55:0/200017250 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7feca00ef0e0 con 0x7fecb80c9680 2023-07-06T21:58:35.378 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:35.378 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T21:58:35.378 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-07-06T21:58:35.378 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.378 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-07-06T21:58:35.378 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkWjb1JxAAMmLy+dPO5qyorBnuzazx6A==", 2023-07-06T21:58:35.379 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.379 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:58:35.379 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:58:35.379 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:58:35.379 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.379 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.380 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.380 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.380 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-07-06T21:58:35.380 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkpLLENBAAxMASh3qbELQMJ3XbPEX0Zw==", 2023-07-06T21:58:35.380 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.380 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:58:35.380 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:58:35.380 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:58:35.381 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.381 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.381 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.381 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.381 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-07-06T21:58:35.381 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkvOSfLxAAMEoqAPg1pb47e5a1G1QtAw==", 2023-07-06T21:58:35.381 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.382 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:58:35.382 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:58:35.382 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:58:35.382 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.382 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.382 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.382 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.383 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-07-06T21:58:35.383 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkeQIBARAApXT5zWLUqqMSdwYygZeatw==", 2023-07-06T21:58:35.383 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.383 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:58:35.383 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:58:35.383 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:58:35.383 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.383 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.384 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.384 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.384 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-07-06T21:58:35.384 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD5NKdkSIfzJxAAlXiG8PWFXQqIeugbdp7Eiw==", 2023-07-06T21:58:35.384 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.384 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:58:35.384 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:58:35.385 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.385 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.385 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.385 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.385 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-07-06T21:58:35.385 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD8NKdkv2iwLxAAxjFucMwaaH66wPQpoYSTGw==", 2023-07-06T21:58:35.385 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.385 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:58:35.386 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:58:35.386 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.386 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.386 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.386 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.386 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-07-06T21:58:35.386 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD/NKdk5w7XOBAAuiup4mcC02ZMCPHCU1Cl3A==", 2023-07-06T21:58:35.387 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.387 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:58:35.387 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:58:35.387 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.387 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.387 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.387 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.387 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-07-06T21:58:35.388 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQADNadksvRLBBAAE1YX9VgA8pWARIEZL8tbsQ==", 2023-07-06T21:58:35.388 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.388 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:58:35.388 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:58:35.388 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.388 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.388 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.388 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.389 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-07-06T21:58:35.389 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAJNadkn2HsChAAgwb7B9lHOMq2h0BNuhB/AQ==", 2023-07-06T21:58:35.389 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.389 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:58:35.389 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:58:35.389 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.390 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.390 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.390 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.390 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-07-06T21:58:35.390 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMNadkbonPERAA2PLg4NMr+4eW+FDAfPig1A==", 2023-07-06T21:58:35.390 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.390 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:58:35.390 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:58:35.391 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.391 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.391 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.391 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.391 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-07-06T21:58:35.391 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAPNadkQw76GBAAY9SIgsTUHqvThwjdpjuwpw==", 2023-07-06T21:58:35.391 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.391 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:58:35.392 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:58:35.392 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.392 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.392 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.392 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.392 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-07-06T21:58:35.392 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQASNadkr3gRHxAALbPUtIgImIK1UUoe6vcyjg==", 2023-07-06T21:58:35.393 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.393 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T21:58:35.393 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T21:58:35.393 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.393 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.393 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.393 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.394 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-07-06T21:58:35.394 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkaZgiBRAAvyBUd+qHLh/wwhgoE1MsVA==", 2023-07-06T21:58:35.394 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.395 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:58:35.395 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-07-06T21:58:35.395 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-06T21:58:35.395 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.396 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.396 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.396 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-07-06T21:58:35.396 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkOBqoDBAASIhzvCqkSAFLX2oc99MYqw==", 2023-07-06T21:58:35.397 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.397 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:58:35.397 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:58:35.397 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:58:35.398 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:58:35.398 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.398 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.398 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.398 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-07-06T21:58:35.398 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkgt/fCBAAlQY94DrR/nFTIVwSFCEToQ==", 2023-07-06T21:58:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:58:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:58:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:58:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:58:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-07-06T21:58:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkd5zAEhAAU0Qo6NROIKRSlOncFUoTxQ==", 2023-07-06T21:58:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T21:58:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T21:58:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T21:58:35.401 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T21:58:35.401 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.401 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.401 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.401 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-07-06T21:58:35.401 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkjvG8ChAA5rpuV6+YETQS9UjMRUynxA==", 2023-07-06T21:58:35.401 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.401 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:58:35.402 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T21:58:35.402 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T21:58:35.402 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.402 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.402 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.402 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.402 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-07-06T21:58:35.402 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdk+RUVIxAAyQpmGAeL8K+Cy+fgK5BmCQ==", 2023-07-06T21:58:35.403 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.403 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:58:35.403 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T21:58:35.403 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.403 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.403 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:35.403 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:35.403 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-07-06T21:58:35.404 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkLH8aHxAAzzX5YxumCYWYqo0rQfFA9g==", 2023-07-06T21:58:35.404 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T21:58:35.404 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T21:58:35.404 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T21:58:35.404 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T21:58:35.404 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.404 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:35.405 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-07-06T21:58:35.405 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T21:58:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.379+0000 7fecbd89c640 1 -- 172.21.15.55:0/200017250 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fec980663a0 msgr2=0x7fec98068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.379+0000 7fecbd89c640 1 --2- 172.21.15.55:0/200017250 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fec980663a0 0x7fec98068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fecb8157720 tx=0x7feca8007240 comp rx=0 tx=0).stop 2023-07-06T21:58:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.379+0000 7fecbd89c640 1 -- 172.21.15.55:0/200017250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb80c9680 msgr2=0x7fecb80cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.379+0000 7fecbd89c640 1 --2- 172.21.15.55:0/200017250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb80c9680 0x7fecb80cd1c0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7feca0018fd0 tx=0x7feca001ac00 comp rx=0 tx=0).stop 2023-07-06T21:58:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.379+0000 7fecbd89c640 1 -- 172.21.15.55:0/200017250 shutdown_connections 2023-07-06T21:58:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.379+0000 7fecbd89c640 1 --2- 172.21.15.55:0/200017250 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fec980663a0 0x7fec98068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.379+0000 7fecbd89c640 1 --2- 172.21.15.55:0/200017250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecb81587d0 0x7fecb8149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.379+0000 7fecbd89c640 1 --2- 172.21.15.55:0/200017250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecb8158400 0x7fecb8156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.379+0000 7fecbd89c640 1 --2- 172.21.15.55:0/200017250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb80c9680 0x7fecb80cd1c0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.379+0000 7fecbd89c640 1 -- 172.21.15.55:0/200017250 >> 172.21.15.55:0/200017250 conn(0x7fecb80cded0 msgr2=0x7fecb80b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.379+0000 7fecbd89c640 1 -- 172.21.15.55:0/200017250 shutdown_connections 2023-07-06T21:58:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.379+0000 7fecbd89c640 1 -- 172.21.15.55:0/200017250 wait complete. 2023-07-06T21:58:35.408 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:58:35.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.551+0000 7f040db2c640 1 Processor -- start 2023-07-06T21:58:35.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.551+0000 7f040db2c640 1 -- start start 2023-07-06T21:58:35.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.551+0000 7f040db2c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04080ca450 0x7f040806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.551+0000 7f040db2c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0408159cd0 con 0x7f04080b3730 2023-07-06T21:58:35.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.551+0000 7f040db2c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04080693f0 con 0x7f04080712f0 2023-07-06T21:58:35.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.551+0000 7f040db2c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040806aca0 con 0x7f04080ca450 2023-07-06T21:58:35.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.555+0000 7f0407fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f04080b3730 0x7f040815d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33898/0 (socket says 172.21.15.55:33898) 2023-07-06T21:58:35.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.555+0000 7f0407fff640 1 -- 172.21.15.55:0/1641963933 learned_addr learned my addr 172.21.15.55:0/1641963933 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:35.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.555+0000 7f0406ffd640 1 --2- 172.21.15.55:0/1641963933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04080ca450 0x7f040806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.555+0000 7f04067fc640 1 -- 172.21.15.55:0/1641963933 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910169325 0 0) 0x7f0408159cd0 con 0x7f04080b3730 2023-07-06T21:58:35.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.555+0000 7f04067fc640 1 -- 172.21.15.55:0/1641963933 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03f0003530 con 0x7f04080b3730 2023-07-06T21:58:35.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.555+0000 7f04067fc640 1 -- 172.21.15.55:0/1641963933 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601036310 0 0) 0x7f04080693f0 con 0x7f04080712f0 2023-07-06T21:58:35.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.555+0000 7f0406ffd640 1 -- 172.21.15.55:0/1641963933 >> v1:172.21.15.138:6789/0 conn(0x7f04080712f0 legacy=0x7f04080c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.555+0000 7f0406ffd640 1 -- 172.21.15.55:0/1641963933 >> v1:172.21.15.55:6789/0 conn(0x7f04080b3730 legacy=0x7f040815d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.555+0000 7f0406ffd640 1 -- 172.21.15.55:0/1641963933 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04080696b0 con 0x7f04080ca450 2023-07-06T21:58:35.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.555+0000 7f0406ffd640 1 --2- 172.21.15.55:0/1641963933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04080ca450 0x7f040806a610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0097f0 tx=0x7f03fc01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4cb0bd9a9c5869a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:35.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.555+0000 7f04067fc640 1 -- 172.21.15.55:0/1641963933 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0aa5f0 con 0x7f04080ca450 2023-07-06T21:58:35.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f04067fc640 1 -- 172.21.15.55:0/1641963933 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc0aa750 con 0x7f04080ca450 2023-07-06T21:58:35.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f04067fc640 1 -- 172.21.15.55:0/1641963933 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0aaae0 con 0x7f04080ca450 2023-07-06T21:58:35.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 -- 172.21.15.55:0/1641963933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04080ca450 msgr2=0x7f040806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 --2- 172.21.15.55:0/1641963933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04080ca450 0x7f040806a610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0097f0 tx=0x7f03fc01c490 comp rx=0 tx=0).stop 2023-07-06T21:58:35.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 -- 172.21.15.55:0/1641963933 shutdown_connections 2023-07-06T21:58:35.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 --2- 172.21.15.55:0/1641963933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04080ca450 0x7f040806a610 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 -- 172.21.15.55:0/1641963933 >> 172.21.15.55:0/1641963933 conn(0x7f04080cded0 msgr2=0x7f04080ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:35.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 -- 172.21.15.55:0/1641963933 shutdown_connections 2023-07-06T21:58:35.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 -- 172.21.15.55:0/1641963933 wait complete. 2023-07-06T21:58:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 Processor -- start 2023-07-06T21:58:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 -- start start 2023-07-06T21:58:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04080712f0 0x7f04081542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04080b3730 0x7f0408155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04080ca450 0x7f04080b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04081547e0 con 0x7f04080712f0 2023-07-06T21:58:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0408156590 con 0x7f04080ca450 2023-07-06T21:58:35.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f040db2c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0408156870 con 0x7f04080b3730 2023-07-06T21:58:35.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f04077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04080712f0 0x7f04081542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f04077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04080712f0 0x7f04081542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44428/0 (socket says 172.21.15.55:44428) 2023-07-06T21:58:35.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f04077fe640 1 -- 172.21.15.55:0/152548079 learned_addr learned my addr 172.21.15.55:0/152548079 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:35.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f0406ffd640 1 --2- 172.21.15.55:0/152548079 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04080b3730 0x7f0408155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.559+0000 7f0407fff640 1 --2- 172.21.15.55:0/152548079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04080ca450 0x7f04080b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.563+0000 7f04077fe640 1 -- 172.21.15.55:0/152548079 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04080b3730 msgr2=0x7f0408155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.563+0000 7f04077fe640 1 --2- 172.21.15.55:0/152548079 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04080b3730 0x7f0408155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.563+0000 7f04077fe640 1 -- 172.21.15.55:0/152548079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04080ca450 msgr2=0x7f04080b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.563+0000 7f04077fe640 1 --2- 172.21.15.55:0/152548079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04080ca450 0x7f04080b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.563+0000 7f04077fe640 1 -- 172.21.15.55:0/152548079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc009420 con 0x7f04080712f0 2023-07-06T21:58:35.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.563+0000 7f04077fe640 1 --2- 172.21.15.55:0/152548079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04080712f0 0x7f04081542a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f03f8001ec0 tx=0x7f03f800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:35.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.563+0000 7f03effff640 1 -- 172.21.15.55:0/152548079 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f80054e0 con 0x7f04080712f0 2023-07-06T21:58:35.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.563+0000 7f03effff640 1 -- 172.21.15.55:0/152548079 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f8003600 con 0x7f04080712f0 2023-07-06T21:58:35.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.563+0000 7f040db2c640 1 -- 172.21.15.55:0/152548079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0408156b50 con 0x7f04080712f0 2023-07-06T21:58:35.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.563+0000 7f03effff640 1 -- 172.21.15.55:0/152548079 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f80039b0 con 0x7f04080712f0 2023-07-06T21:58:35.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.563+0000 7f040db2c640 1 -- 172.21.15.55:0/152548079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0408157110 con 0x7f04080712f0 2023-07-06T21:58:35.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.563+0000 7f040db2c640 1 -- 172.21.15.55:0/152548079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0408154950 con 0x7f04080712f0 2023-07-06T21:58:35.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.563+0000 7f03effff640 1 -- 172.21.15.55:0/152548079 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f03f8003b10 con 0x7f04080712f0 2023-07-06T21:58:35.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.567+0000 7f03effff640 1 --2- 172.21.15.55:0/152548079 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f03f40663a0 0x7f03f4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.567+0000 7f03effff640 1 -- 172.21.15.55:0/152548079 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f03f8083180 con 0x7f04080712f0 2023-07-06T21:58:35.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.567+0000 7f0406ffd640 1 --2- 172.21.15.55:0/152548079 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f03f40663a0 0x7f03f4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.567+0000 7f0406ffd640 1 --2- 172.21.15.55:0/152548079 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f03f40663a0 0x7f03f4068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0ae000 tx=0x7f03fc0a7000 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:35.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.571+0000 7f03effff640 1 -- 172.21.15.55:0/152548079 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0408154950 con 0x7f04080712f0 2023-07-06T21:58:35.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.727+0000 7f040db2c640 1 -- 172.21.15.55:0/152548079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0408154920 con 0x7f04080712f0 2023-07-06T21:58:35.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.731+0000 7f03effff640 1 -- 172.21.15.55:0/152548079 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+14842 (secure 0 0 0) 0x7f03f80507b0 con 0x7f04080712f0 2023-07-06T21:58:35.729 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:35.729 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":113,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:58:34.971502+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:58:35.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.731+0000 7f040db2c640 1 -- 172.21.15.55:0/152548079 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f03f40663a0 msgr2=0x7f03f4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.731+0000 7f040db2c640 1 --2- 172.21.15.55:0/152548079 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f03f40663a0 0x7f03f4068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0ae000 tx=0x7f03fc0a7000 comp rx=0 tx=0).stop 2023-07-06T21:58:35.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.731+0000 7f040db2c640 1 -- 172.21.15.55:0/152548079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04080712f0 msgr2=0x7f04081542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.731+0000 7f040db2c640 1 --2- 172.21.15.55:0/152548079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04080712f0 0x7f04081542a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f03f8001ec0 tx=0x7f03f800c8e0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.731+0000 7f040db2c640 1 -- 172.21.15.55:0/152548079 shutdown_connections 2023-07-06T21:58:35.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.731+0000 7f040db2c640 1 --2- 172.21.15.55:0/152548079 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f03f40663a0 0x7f03f4068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.731+0000 7f040db2c640 1 --2- 172.21.15.55:0/152548079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04080ca450 0x7f04080b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.731+0000 7f040db2c640 1 --2- 172.21.15.55:0/152548079 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04080b3730 0x7f0408155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.731+0000 7f040db2c640 1 --2- 172.21.15.55:0/152548079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04080712f0 0x7f04081542a0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.731+0000 7f040db2c640 1 -- 172.21.15.55:0/152548079 >> 172.21.15.55:0/152548079 conn(0x7f04080cded0 msgr2=0x7f04081594a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:35.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.731+0000 7f040db2c640 1 -- 172.21.15.55:0/152548079 shutdown_connections 2023-07-06T21:58:35.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.731+0000 7f040db2c640 1 -- 172.21.15.55:0/152548079 wait complete. 2023-07-06T21:58:35.750 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:58:35.751 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:58:35.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f977d2640 1 Processor -- start 2023-07-06T21:58:35.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f977d2640 1 -- start start 2023-07-06T21:58:35.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f977d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f9015bb90 0x7f2f900ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f977d2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2f900cef40 0x7f2f9006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f977d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f9006fe50 0x7f2f900693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f977d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9015f620 con 0x7f2f9006fe50 2023-07-06T21:58:35.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f977d2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f900702d0 con 0x7f2f900cef40 2023-07-06T21:58:35.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f977d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9015fe80 con 0x7f2f9015bb90 2023-07-06T21:58:35.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f95d6f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f9006fe50 0x7f2f900693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f95d6f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f9006fe50 0x7f2f900693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44442/0 (socket says 172.21.15.55:44442) 2023-07-06T21:58:35.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f95d6f640 1 -- 172.21.15.55:0/4273195069 learned_addr learned my addr 172.21.15.55:0/4273195069 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:35.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f9556e640 1 --2- 172.21.15.55:0/4273195069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f9015bb90 0x7f2f900ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f94d6d640 1 --2- 172.21.15.55:0/4273195069 >> v2:172.21.15.138:3300/0 conn(0x7f2f900cef40 0x7f2f9006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f95d6f640 1 -- 172.21.15.55:0/4273195069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f9015bb90 msgr2=0x7f2f900ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f95d6f640 1 --2- 172.21.15.55:0/4273195069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f9015bb90 0x7f2f900ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f95d6f640 1 -- 172.21.15.55:0/4273195069 >> v2:172.21.15.138:3300/0 conn(0x7f2f900cef40 msgr2=0x7f2f9006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f95d6f640 1 --2- 172.21.15.55:0/4273195069 >> v2:172.21.15.138:3300/0 conn(0x7f2f900cef40 0x7f2f9006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f95d6f640 1 -- 172.21.15.55:0/4273195069 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9015bf60 con 0x7f2f9006fe50 2023-07-06T21:58:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.899+0000 7f2f94d6d640 1 --2- 172.21.15.55:0/4273195069 >> v2:172.21.15.138:3300/0 conn(0x7f2f900cef40 0x7f2f9006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:35.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.903+0000 7f2f95d6f640 1 --2- 172.21.15.55:0/4273195069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f9006fe50 0x7f2f900693f0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f2f9006f560 tx=0x7f2f8801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e688ceeaa59260f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:35.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.903+0000 7f2f87fff640 1 -- 172.21.15.55:0/4273195069 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880a6490 con 0x7f2f9006fe50 2023-07-06T21:58:35.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.903+0000 7f2f87fff640 1 -- 172.21.15.55:0/4273195069 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f880a65f0 con 0x7f2f9006fe50 2023-07-06T21:58:35.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.903+0000 7f2f87fff640 1 -- 172.21.15.55:0/4273195069 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880a6980 con 0x7f2f9006fe50 2023-07-06T21:58:35.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.903+0000 7f2f977d2640 1 -- 172.21.15.55:0/4273195069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f9006fe50 msgr2=0x7f2f900693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.903+0000 7f2f977d2640 1 --2- 172.21.15.55:0/4273195069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f9006fe50 0x7f2f900693f0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f2f9006f560 tx=0x7f2f8801c710 comp rx=0 tx=0).stop 2023-07-06T21:58:35.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.903+0000 7f2f977d2640 1 -- 172.21.15.55:0/4273195069 shutdown_connections 2023-07-06T21:58:35.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.903+0000 7f2f977d2640 1 --2- 172.21.15.55:0/4273195069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f9006fe50 0x7f2f900693f0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.903+0000 7f2f977d2640 1 --2- 172.21.15.55:0/4273195069 >> v2:172.21.15.138:3300/0 conn(0x7f2f900cef40 0x7f2f9006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.903+0000 7f2f977d2640 1 --2- 172.21.15.55:0/4273195069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f9015bb90 0x7f2f900ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.903+0000 7f2f977d2640 1 -- 172.21.15.55:0/4273195069 >> 172.21.15.55:0/4273195069 conn(0x7f2f900cbd70 msgr2=0x7f2f900ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:35.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.903+0000 7f2f977d2640 1 -- 172.21.15.55:0/4273195069 shutdown_connections 2023-07-06T21:58:35.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.903+0000 7f2f977d2640 1 -- 172.21.15.55:0/4273195069 wait complete. 2023-07-06T21:58:35.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f977d2640 1 Processor -- start 2023-07-06T21:58:35.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f977d2640 1 -- start start 2023-07-06T21:58:35.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f977d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f9006fe50 0x7f2f901531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f977d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f900cef40 0x7f2f900b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f977d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f9015bb90 0x7f2f9014a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f977d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900adf30 con 0x7f2f9006fe50 2023-07-06T21:58:35.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f977d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900b2960 con 0x7f2f900cef40 2023-07-06T21:58:35.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f977d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900b23a0 con 0x7f2f9015bb90 2023-07-06T21:58:35.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f9556e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f9006fe50 0x7f2f901531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f9556e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f9006fe50 0x7f2f901531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44456/0 (socket says 172.21.15.55:44456) 2023-07-06T21:58:35.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f9556e640 1 -- 172.21.15.55:0/3917626692 learned_addr learned my addr 172.21.15.55:0/3917626692 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:35.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f94d6d640 1 --2- 172.21.15.55:0/3917626692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f900cef40 0x7f2f900b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f95d6f640 1 --2- 172.21.15.55:0/3917626692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f9015bb90 0x7f2f9014a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f9556e640 1 -- 172.21.15.55:0/3917626692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f9015bb90 msgr2=0x7f2f9014a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f9556e640 1 --2- 172.21.15.55:0/3917626692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f9015bb90 0x7f2f9014a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f9556e640 1 -- 172.21.15.55:0/3917626692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f900cef40 msgr2=0x7f2f900b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:35.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f9556e640 1 --2- 172.21.15.55:0/3917626692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f900cef40 0x7f2f900b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:35.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f9556e640 1 -- 172.21.15.55:0/3917626692 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f88009b30 con 0x7f2f9006fe50 2023-07-06T21:58:35.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f9556e640 1 --2- 172.21.15.55:0/3917626692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f9006fe50 0x7f2f901531f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00e930 tx=0x7f2f8c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:35.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f85ffb640 1 -- 172.21.15.55:0/3917626692 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c009690 con 0x7f2f9006fe50 2023-07-06T21:58:35.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f85ffb640 1 -- 172.21.15.55:0/3917626692 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8c00ca00 con 0x7f2f9006fe50 2023-07-06T21:58:35.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f977d2640 1 -- 172.21.15.55:0/3917626692 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f900b2680 con 0x7f2f9006fe50 2023-07-06T21:58:35.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f85ffb640 1 -- 172.21.15.55:0/3917626692 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c00cd70 con 0x7f2f9006fe50 2023-07-06T21:58:35.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.907+0000 7f2f977d2640 1 -- 172.21.15.55:0/3917626692 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f90159040 con 0x7f2f9006fe50 2023-07-06T21:58:35.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.911+0000 7f2f977d2640 1 -- 172.21.15.55:0/3917626692 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f90066d60 con 0x7f2f9006fe50 2023-07-06T21:58:35.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.911+0000 7f2f85ffb640 1 -- 172.21.15.55:0/3917626692 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2f8c013470 con 0x7f2f9006fe50 2023-07-06T21:58:35.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.911+0000 7f2f85ffb640 1 --2- 172.21.15.55:0/3917626692 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2f740663a0 0x7f2f74068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:35.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.911+0000 7f2f85ffb640 1 -- 172.21.15.55:0/3917626692 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2f8c083ea0 con 0x7f2f9006fe50 2023-07-06T21:58:35.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.911+0000 7f2f94d6d640 1 --2- 172.21.15.55:0/3917626692 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2f740663a0 0x7f2f74068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:35.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.911+0000 7f2f94d6d640 1 --2- 172.21.15.55:0/3917626692 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2f740663a0 0x7f2f74068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2f900c8c10 tx=0x7f2f80008040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:35.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:35.915+0000 7f2f85ffb640 1 -- 172.21.15.55:0/3917626692 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f8c0514e0 con 0x7f2f9006fe50 2023-07-06T21:58:36.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.067+0000 7f2f977d2640 1 -- 172.21.15.55:0/3917626692 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f9015aa70 con 0x7f2f9006fe50 2023-07-06T21:58:36.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.071+0000 7f2f85ffb640 1 -- 172.21.15.55:0/3917626692 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f8c0170a0 con 0x7f2f9006fe50 2023-07-06T21:58:36.069 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:58:36.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.071+0000 7f2f977d2640 1 -- 172.21.15.55:0/3917626692 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2f740663a0 msgr2=0x7f2f74068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.071+0000 7f2f977d2640 1 --2- 172.21.15.55:0/3917626692 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2f740663a0 0x7f2f74068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2f900c8c10 tx=0x7f2f80008040 comp rx=0 tx=0).stop 2023-07-06T21:58:36.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.071+0000 7f2f977d2640 1 -- 172.21.15.55:0/3917626692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f9006fe50 msgr2=0x7f2f901531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.071+0000 7f2f977d2640 1 --2- 172.21.15.55:0/3917626692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f9006fe50 0x7f2f901531f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00e930 tx=0x7f2f8c00edf0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.071+0000 7f2f977d2640 1 -- 172.21.15.55:0/3917626692 shutdown_connections 2023-07-06T21:58:36.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.071+0000 7f2f977d2640 1 --2- 172.21.15.55:0/3917626692 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2f740663a0 0x7f2f74068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.071+0000 7f2f977d2640 1 --2- 172.21.15.55:0/3917626692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f9015bb90 0x7f2f9014a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.071+0000 7f2f977d2640 1 --2- 172.21.15.55:0/3917626692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f900cef40 0x7f2f900b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.071+0000 7f2f977d2640 1 --2- 172.21.15.55:0/3917626692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f9006fe50 0x7f2f901531f0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.071+0000 7f2f977d2640 1 -- 172.21.15.55:0/3917626692 >> 172.21.15.55:0/3917626692 conn(0x7f2f900cbd70 msgr2=0x7f2f90154c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:36.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.071+0000 7f2f977d2640 1 -- 172.21.15.55:0/3917626692 shutdown_connections 2023-07-06T21:58:36.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.071+0000 7f2f977d2640 1 -- 172.21.15.55:0/3917626692 wait complete. 2023-07-06T21:58:36.089 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:58:36.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.235+0000 7fa6211f6640 1 Processor -- start 2023-07-06T21:58:36.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.235+0000 7fa6211f6640 1 -- start start 2023-07-06T21:58:36.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.239+0000 7fa6211f6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa61c15bb90 0x7fa61c0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.239+0000 7fa6211f6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa61c070020 0x7fa61c0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.239+0000 7fa6211f6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61c15fe80 con 0x7fa61c0cef40 2023-07-06T21:58:36.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.239+0000 7fa6211f6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61c15f620 con 0x7fa61c070020 2023-07-06T21:58:36.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.239+0000 7fa6211f6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61c15bf60 con 0x7fa61c15bb90 2023-07-06T21:58:36.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.239+0000 7fa613fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa61c0cef40 0x7fa61c06f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33900/0 (socket says 172.21.15.55:33900) 2023-07-06T21:58:36.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.239+0000 7fa613fff640 1 -- 172.21.15.55:0/3868272157 learned_addr learned my addr 172.21.15.55:0/3868272157 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:36.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.239+0000 7fa61b59e640 1 --2- 172.21.15.55:0/3868272157 >> v2:172.21.15.55:3300/0 conn(0x7fa61c070020 0x7fa61c0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.239+0000 7fa61ad9d640 1 --2- 172.21.15.55:0/3868272157 >> v2:172.21.15.138:3300/0 conn(0x7fa61c15bb90 0x7fa61c0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.239+0000 7fa61b59e640 1 -- 172.21.15.55:0/3868272157 >> v2:172.21.15.138:3300/0 conn(0x7fa61c15bb90 msgr2=0x7fa61c0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:36.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.239+0000 7fa61b59e640 1 --2- 172.21.15.55:0/3868272157 >> v2:172.21.15.138:3300/0 conn(0x7fa61c15bb90 0x7fa61c0ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.239+0000 7fa61b59e640 1 -- 172.21.15.55:0/3868272157 >> v1:172.21.15.55:6789/0 conn(0x7fa61c0cef40 legacy=0x7fa61c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.239+0000 7fa61b59e640 1 -- 172.21.15.55:0/3868272157 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c0cf440 con 0x7fa61c070020 2023-07-06T21:58:36.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.239+0000 7fa61a59c640 1 -- 172.21.15.55:0/3868272157 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533878173 0 0) 0x7fa61c15fe80 con 0x7fa61c0cef40 2023-07-06T21:58:36.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.243+0000 7fa61b59e640 1 --2- 172.21.15.55:0/3868272157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa61c070020 0x7fa61c0c8cf0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fa61c06f530 tx=0x7fa61401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ec7061bfdd059b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:36.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.243+0000 7fa61a59c640 1 -- 172.21.15.55:0/3868272157 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6140a9400 con 0x7fa61c070020 2023-07-06T21:58:36.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.243+0000 7fa61a59c640 1 -- 172.21.15.55:0/3868272157 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6140a9560 con 0x7fa61c070020 2023-07-06T21:58:36.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.243+0000 7fa61a59c640 1 -- 172.21.15.55:0/3868272157 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6140a98f0 con 0x7fa61c070020 2023-07-06T21:58:36.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.243+0000 7fa6211f6640 1 -- 172.21.15.55:0/3868272157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa61c070020 msgr2=0x7fa61c0c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.243+0000 7fa6211f6640 1 --2- 172.21.15.55:0/3868272157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa61c070020 0x7fa61c0c8cf0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fa61c06f530 tx=0x7fa61401c910 comp rx=0 tx=0).stop 2023-07-06T21:58:36.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.243+0000 7fa6211f6640 1 -- 172.21.15.55:0/3868272157 shutdown_connections 2023-07-06T21:58:36.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.243+0000 7fa6211f6640 1 --2- 172.21.15.55:0/3868272157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa61c070020 0x7fa61c0c8cf0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.243+0000 7fa6211f6640 1 --2- 172.21.15.55:0/3868272157 >> v2:172.21.15.138:3300/0 conn(0x7fa61c15bb90 0x7fa61c0ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.243+0000 7fa6211f6640 1 -- 172.21.15.55:0/3868272157 >> 172.21.15.55:0/3868272157 conn(0x7fa61c0cbd70 msgr2=0x7fa61c0ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:36.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.243+0000 7fa6211f6640 1 -- 172.21.15.55:0/3868272157 shutdown_connections 2023-07-06T21:58:36.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.243+0000 7fa6211f6640 1 -- 172.21.15.55:0/3868272157 wait complete. 2023-07-06T21:58:36.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.243+0000 7fa6211f6640 1 Processor -- start 2023-07-06T21:58:36.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.243+0000 7fa6211f6640 1 -- start start 2023-07-06T21:58:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa6211f6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa61c070020 0x7fa61c153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa6211f6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa61c0cef40 0x7fa61c148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa6211f6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa61c15bb90 0x7fa61c0c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa6211f6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c148b60 con 0x7fa61c15bb90 2023-07-06T21:58:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa6211f6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c152790 con 0x7fa61c0cef40 2023-07-06T21:58:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa6211f6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c0b1c90 con 0x7fa61c070020 2023-07-06T21:58:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa61b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa61c15bb90 0x7fa61c0c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa61b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa61c15bb90 0x7fa61c0c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44478/0 (socket says 172.21.15.55:44478) 2023-07-06T21:58:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa61b59e640 1 -- 172.21.15.55:0/2762809793 learned_addr learned my addr 172.21.15.55:0/2762809793 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa61ad9d640 1 --2- 172.21.15.55:0/2762809793 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa61c070020 0x7fa61c153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa613fff640 1 --2- 172.21.15.55:0/2762809793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa61c0cef40 0x7fa61c148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa61b59e640 1 -- 172.21.15.55:0/2762809793 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa61c070020 msgr2=0x7fa61c153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa61b59e640 1 --2- 172.21.15.55:0/2762809793 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa61c070020 0x7fa61c153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa61b59e640 1 -- 172.21.15.55:0/2762809793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa61c0cef40 msgr2=0x7fa61c148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa61b59e640 1 --2- 172.21.15.55:0/2762809793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa61c0cef40 0x7fa61c148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa61b59e640 1 -- 172.21.15.55:0/2762809793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa614009a70 con 0x7fa61c15bb90 2023-07-06T21:58:36.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa61b59e640 1 --2- 172.21.15.55:0/2762809793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa61c15bb90 0x7fa61c0c9e10 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fa614019520 tx=0x7fa61401b150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:36.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa6137fe640 1 -- 172.21.15.55:0/2762809793 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6140a9e90 con 0x7fa61c15bb90 2023-07-06T21:58:36.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa6137fe640 1 -- 172.21.15.55:0/2762809793 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa614009450 con 0x7fa61c15bb90 2023-07-06T21:58:36.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa6137fe640 1 -- 172.21.15.55:0/2762809793 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6140b2880 con 0x7fa61c15bb90 2023-07-06T21:58:36.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa6211f6640 1 -- 172.21.15.55:0/2762809793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61c0b19b0 con 0x7fa61c15bb90 2023-07-06T21:58:36.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa6211f6640 1 -- 172.21.15.55:0/2762809793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61c152420 con 0x7fa61c15bb90 2023-07-06T21:58:36.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa6211f6640 1 -- 172.21.15.55:0/2762809793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61c066d60 con 0x7fa61c15bb90 2023-07-06T21:58:36.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.247+0000 7fa6137fe640 1 -- 172.21.15.55:0/2762809793 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa6140b29e0 con 0x7fa61c15bb90 2023-07-06T21:58:36.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.251+0000 7fa6137fe640 1 --2- 172.21.15.55:0/2762809793 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa5fc0663a0 0x7fa5fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.251+0000 7fa6137fe640 1 -- 172.21.15.55:0/2762809793 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa61411e580 con 0x7fa61c15bb90 2023-07-06T21:58:36.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.251+0000 7fa61ad9d640 1 --2- 172.21.15.55:0/2762809793 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa5fc0663a0 0x7fa5fc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.251+0000 7fa61ad9d640 1 --2- 172.21.15.55:0/2762809793 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa5fc0663a0 0x7fa5fc068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009ac0 tx=0x7fa60c009190 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.255+0000 7fa6137fe640 1 -- 172.21.15.55:0/2762809793 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6140ef490 con 0x7fa61c15bb90 2023-07-06T21:58:36.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.411+0000 7fa6211f6640 1 -- 172.21.15.55:0/2762809793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa61c1528d0 con 0x7fa61c15bb90 2023-07-06T21:58:36.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.411+0000 7fa6137fe640 1 -- 172.21.15.55:0/2762809793 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v113) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa6140a6030 con 0x7fa61c15bb90 2023-07-06T21:58:36.411 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T21:58:36.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.415+0000 7fa6211f6640 1 -- 172.21.15.55:0/2762809793 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa5fc0663a0 msgr2=0x7fa5fc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.415+0000 7fa6211f6640 1 --2- 172.21.15.55:0/2762809793 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa5fc0663a0 0x7fa5fc068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009ac0 tx=0x7fa60c009190 comp rx=0 tx=0).stop 2023-07-06T21:58:36.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.415+0000 7fa6211f6640 1 -- 172.21.15.55:0/2762809793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa61c15bb90 msgr2=0x7fa61c0c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.415+0000 7fa6211f6640 1 --2- 172.21.15.55:0/2762809793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa61c15bb90 0x7fa61c0c9e10 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fa614019520 tx=0x7fa61401b150 comp rx=0 tx=0).stop 2023-07-06T21:58:36.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.415+0000 7fa6211f6640 1 -- 172.21.15.55:0/2762809793 shutdown_connections 2023-07-06T21:58:36.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.415+0000 7fa6211f6640 1 --2- 172.21.15.55:0/2762809793 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fa5fc0663a0 0x7fa5fc068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.415+0000 7fa6211f6640 1 --2- 172.21.15.55:0/2762809793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa61c15bb90 0x7fa61c0c9e10 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.415+0000 7fa6211f6640 1 --2- 172.21.15.55:0/2762809793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa61c0cef40 0x7fa61c148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.415+0000 7fa6211f6640 1 --2- 172.21.15.55:0/2762809793 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa61c070020 0x7fa61c153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.415+0000 7fa6211f6640 1 -- 172.21.15.55:0/2762809793 >> 172.21.15.55:0/2762809793 conn(0x7fa61c0cbd70 msgr2=0x7fa61c0c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.415+0000 7fa6211f6640 1 -- 172.21.15.55:0/2762809793 shutdown_connections 2023-07-06T21:58:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.415+0000 7fa6211f6640 1 -- 172.21.15.55:0/2762809793 wait complete. 2023-07-06T21:58:36.432 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T21:58:36.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.575+0000 7fbafdc93640 1 Processor -- start 2023-07-06T21:58:36.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.575+0000 7fbafdc93640 1 -- start start 2023-07-06T21:58:36.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbafdc93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbaf8158400 0x7fbaf80c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbafdc93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf806fae0 con 0x7fbaf80c9680 2023-07-06T21:58:36.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbafdc93640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf806fdc0 con 0x7fbaf81587d0 2023-07-06T21:58:36.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbafdc93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80700a0 con 0x7fbaf8158400 2023-07-06T21:58:36.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf6ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbaf80c9680 0x7fbaf8070b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33904/0 (socket says 172.21.15.55:33904) 2023-07-06T21:58:36.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf6ffd640 1 -- 172.21.15.55:0/721355650 learned_addr learned my addr 172.21.15.55:0/721355650 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:36.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf77fe640 1 --2- 172.21.15.55:0/721355650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbaf8158400 0x7fbaf80c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677864019 0 0) 0x7fbaf806fae0 con 0x7fbaf80c9680 2023-07-06T21:58:36.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbae0003530 con 0x7fbaf80c9680 2023-07-06T21:58:36.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550298296 0 0) 0x7fbaf806fdc0 con 0x7fbaf81587d0 2023-07-06T21:58:36.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf806fae0 con 0x7fbaf81587d0 2023-07-06T21:58:36.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3523353317 0 0) 0x7fbae0003530 con 0x7fbaf80c9680 2023-07-06T21:58:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbaf8158400 msgr2=0x7fbaf80c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 --2- 172.21.15.55:0/721355650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbaf8158400 0x7fbaf80c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 >> v1:172.21.15.138:6789/0 conn(0x7fbaf81587d0 legacy=0x7fbaf80cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf8070380 con 0x7fbaf80c9680 2023-07-06T21:58:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fbaec001680 con 0x7fbaf80c9680 2023-07-06T21:58:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 >> v1:172.21.15.55:6789/0 conn(0x7fbaf80c9680 legacy=0x7fbaf8070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 --2- 172.21.15.55:0/721355650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbaf8158400 0x7fbae0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 --2- 172.21.15.55:0/721355650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae00040a0 0x7fbae00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 --2- 172.21.15.55:0/721355650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbae0004d10 0x7fbae0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80700a0 con 0x7fbae00040a0 2023-07-06T21:58:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae000dc50 con 0x7fbae0004d10 2023-07-06T21:58:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae000de10 con 0x7fbaf8158400 2023-07-06T21:58:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf6ffd640 1 --2- 172.21.15.55:0/721355650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae00040a0 0x7fbae00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf77fe640 1 --2- 172.21.15.55:0/721355650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbaf8158400 0x7fbae0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf7fff640 1 --2- 172.21.15.55:0/721355650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbae0004d10 0x7fbae0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf6ffd640 1 -- 172.21.15.55:0/721355650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbaf8158400 msgr2=0x7fbae0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf6ffd640 1 --2- 172.21.15.55:0/721355650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbaf8158400 0x7fbae0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf6ffd640 1 -- 172.21.15.55:0/721355650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbae0004d10 msgr2=0x7fbae0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf6ffd640 1 --2- 172.21.15.55:0/721355650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbae0004d10 0x7fbae0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.579+0000 7fbaf6ffd640 1 -- 172.21.15.55:0/721355650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae0003530 con 0x7fbae00040a0 2023-07-06T21:58:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.583+0000 7fbaf6ffd640 1 --2- 172.21.15.55:0/721355650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae00040a0 0x7fbae00047d0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fbaec001ec0 tx=0x7fbaec01cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3b998adeceedf4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.583+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0058e0 con 0x7fbae00040a0 2023-07-06T21:58:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.583+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec005a60 con 0x7fbae00040a0 2023-07-06T21:58:36.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.583+0000 7fbaf67fc640 1 -- 172.21.15.55:0/721355650 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec005e50 con 0x7fbae00040a0 2023-07-06T21:58:36.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.583+0000 7fbafdc93640 1 -- 172.21.15.55:0/721355650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae00040a0 msgr2=0x7fbae00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.583+0000 7fbafdc93640 1 --2- 172.21.15.55:0/721355650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae00040a0 0x7fbae00047d0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fbaec001ec0 tx=0x7fbaec01cb80 comp rx=0 tx=0).stop 2023-07-06T21:58:36.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.583+0000 7fbaf7fff640 1 -- 172.21.15.55:0/721355650 reap_dead start 2023-07-06T21:58:36.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.583+0000 7fbafdc93640 1 -- 172.21.15.55:0/721355650 shutdown_connections 2023-07-06T21:58:36.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.583+0000 7fbafdc93640 1 -- 172.21.15.55:0/721355650 >> 172.21.15.55:0/721355650 conn(0x7fbaf80cded0 msgr2=0x7fbaf80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:36.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.583+0000 7fbafdc93640 1 -- 172.21.15.55:0/721355650 shutdown_connections 2023-07-06T21:58:36.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.583+0000 7fbafdc93640 1 -- 172.21.15.55:0/721355650 wait complete. 2023-07-06T21:58:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.583+0000 7fbafdc93640 1 Processor -- start 2023-07-06T21:58:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.583+0000 7fbafdc93640 1 -- start start 2023-07-06T21:58:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbafdc93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbae00040a0 0x7fbaf81ecdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbafdc93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8159680 0x7fbaf80af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbafdc93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbaf815c4a0 0x7fbaf80b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbafdc93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf815a790 con 0x7fbaf8159680 2023-07-06T21:58:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbafdc93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf81ed310 con 0x7fbae00040a0 2023-07-06T21:58:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbafdc93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf8159b80 con 0x7fbaf815c4a0 2023-07-06T21:58:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbaf6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8159680 0x7fbaf80af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbaf6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8159680 0x7fbaf80af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44498/0 (socket says 172.21.15.55:44498) 2023-07-06T21:58:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbaf6ffd640 1 -- 172.21.15.55:0/3869391213 learned_addr learned my addr 172.21.15.55:0/3869391213 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbaf77fe640 1 --2- 172.21.15.55:0/3869391213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbae00040a0 0x7fbaf81ecdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbaf7fff640 1 --2- 172.21.15.55:0/3869391213 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbaf815c4a0 0x7fbaf80b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbaf6ffd640 1 -- 172.21.15.55:0/3869391213 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbaf815c4a0 msgr2=0x7fbaf80b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbaf6ffd640 1 --2- 172.21.15.55:0/3869391213 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbaf815c4a0 0x7fbaf80b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbaf6ffd640 1 -- 172.21.15.55:0/3869391213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbae00040a0 msgr2=0x7fbaf81ecdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbaf6ffd640 1 --2- 172.21.15.55:0/3869391213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbae00040a0 0x7fbaf81ecdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbaf6ffd640 1 -- 172.21.15.55:0/3869391213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf8159e60 con 0x7fbaf8159680 2023-07-06T21:58:36.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbaf6ffd640 1 --2- 172.21.15.55:0/3869391213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8159680 0x7fbaf80af1f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0ab040 tx=0x7fbae0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:36.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbadffff640 1 -- 172.21.15.55:0/3869391213 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0a5c90 con 0x7fbaf8159680 2023-07-06T21:58:36.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbadffff640 1 -- 172.21.15.55:0/3869391213 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec0a5df0 con 0x7fbaf8159680 2023-07-06T21:58:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbadffff640 1 -- 172.21.15.55:0/3869391213 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec004a10 con 0x7fbaf8159680 2023-07-06T21:58:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbafdc93640 1 -- 172.21.15.55:0/3869391213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf815a140 con 0x7fbaf8159680 2023-07-06T21:58:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbafdc93640 1 -- 172.21.15.55:0/3869391213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf80af730 con 0x7fbaf8159680 2023-07-06T21:58:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.587+0000 7fbafdc93640 1 -- 172.21.15.55:0/3869391213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf806c580 con 0x7fbaf8159680 2023-07-06T21:58:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.591+0000 7fbadffff640 1 -- 172.21.15.55:0/3869391213 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbaec004b70 con 0x7fbaf8159680 2023-07-06T21:58:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.591+0000 7fbadffff640 1 --2- 172.21.15.55:0/3869391213 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fbae40663a0 0x7fbae4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.591+0000 7fbadffff640 1 -- 172.21.15.55:0/3869391213 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fbaec11d670 con 0x7fbaf8159680 2023-07-06T21:58:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.591+0000 7fbaf77fe640 1 --2- 172.21.15.55:0/3869391213 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fbae40663a0 0x7fbae4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.591+0000 7fbaf77fe640 1 --2- 172.21.15.55:0/3869391213 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fbae40663a0 0x7fbae4068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009b00 tx=0x7fbae8009190 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:36.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.595+0000 7fbadffff640 1 -- 172.21.15.55:0/3869391213 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbaec0eac00 con 0x7fbaf8159680 2023-07-06T21:58:36.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.751+0000 7fbafdc93640 1 -- 172.21.15.55:0/3869391213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbaf8066d60 con 0x7fbaf8159680 2023-07-06T21:58:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.751+0000 7fbadffff640 1 -- 172.21.15.55:0/3869391213 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v113) v1 ==== 84+0+126 (secure 0 0 0) 0x7fbaec001be0 con 0x7fbaf8159680 2023-07-06T21:58:36.751 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:36.751 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T21:58:36.751 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:36.751 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-07-06T21:58:36.752 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-07-06T21:58:36.752 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T21:58:36.752 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:36.752 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-07-06T21:58:36.752 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-07-06T21:58:36.752 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:36.752 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T21:58:36.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.755+0000 7fbafdc93640 1 -- 172.21.15.55:0/3869391213 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fbae40663a0 msgr2=0x7fbae4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.755+0000 7fbafdc93640 1 --2- 172.21.15.55:0/3869391213 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fbae40663a0 0x7fbae4068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009b00 tx=0x7fbae8009190 comp rx=0 tx=0).stop 2023-07-06T21:58:36.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.755+0000 7fbafdc93640 1 -- 172.21.15.55:0/3869391213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8159680 msgr2=0x7fbaf80af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.755+0000 7fbafdc93640 1 --2- 172.21.15.55:0/3869391213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8159680 0x7fbaf80af1f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0ab040 tx=0x7fbae0005800 comp rx=0 tx=0).stop 2023-07-06T21:58:36.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.755+0000 7fbafdc93640 1 -- 172.21.15.55:0/3869391213 shutdown_connections 2023-07-06T21:58:36.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.755+0000 7fbafdc93640 1 --2- 172.21.15.55:0/3869391213 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fbae40663a0 0x7fbae4068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.755+0000 7fbafdc93640 1 --2- 172.21.15.55:0/3869391213 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbaf815c4a0 0x7fbaf80b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.755+0000 7fbafdc93640 1 --2- 172.21.15.55:0/3869391213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8159680 0x7fbaf80af1f0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.755+0000 7fbafdc93640 1 --2- 172.21.15.55:0/3869391213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbae00040a0 0x7fbaf81ecdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.755+0000 7fbafdc93640 1 -- 172.21.15.55:0/3869391213 >> 172.21.15.55:0/3869391213 conn(0x7fbaf80cded0 msgr2=0x7fbaf80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:36.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.755+0000 7fbafdc93640 1 -- 172.21.15.55:0/3869391213 shutdown_connections 2023-07-06T21:58:36.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.755+0000 7fbafdc93640 1 -- 172.21.15.55:0/3869391213 wait complete. 2023-07-06T21:58:36.772 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T21:58:36.772 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T21:58:36.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.919+0000 7f45a83fa640 1 Processor -- start 2023-07-06T21:58:36.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.919+0000 7f45a83fa640 1 -- start start 2023-07-06T21:58:36.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.919+0000 7f45a83fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a0070020 0x7f45a00703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.919+0000 7f45a83fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a0152fc0 con 0x7f45a00c9500 2023-07-06T21:58:36.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.919+0000 7f45a83fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a0070930 con 0x7f45a00ce8e0 2023-07-06T21:58:36.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.919+0000 7f45a83fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a015c410 con 0x7f45a0070020 2023-07-06T21:58:36.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.923+0000 7f45a5995640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f45a00c9500 0x7f45a00ce1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33912/0 (socket says 172.21.15.55:33912) 2023-07-06T21:58:36.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.923+0000 7f45a5995640 1 -- 172.21.15.55:0/3741539449 learned_addr learned my addr 172.21.15.55:0/3741539449 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:36.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.923+0000 7f45a6196640 1 --2- 172.21.15.55:0/3741539449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a0070020 0x7f45a00703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.923+0000 7f45a5194640 1 -- 172.21.15.55:0/3741539449 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071437349 0 0) 0x7f45a0152fc0 con 0x7f45a00c9500 2023-07-06T21:58:36.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.923+0000 7f45a5194640 1 -- 172.21.15.55:0/3741539449 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f458c003530 con 0x7f45a00c9500 2023-07-06T21:58:36.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.923+0000 7f45a6196640 1 -- 172.21.15.55:0/3741539449 >> v1:172.21.15.138:6789/0 conn(0x7f45a00ce8e0 legacy=0x7f45a015f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.923+0000 7f45a6196640 1 -- 172.21.15.55:0/3741539449 >> v1:172.21.15.55:6789/0 conn(0x7f45a00c9500 legacy=0x7f45a00ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.923+0000 7f45a5194640 1 -- 172.21.15.55:0/3741539449 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812407696 0 0) 0x7f45a0070930 con 0x7f45a00ce8e0 2023-07-06T21:58:36.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.923+0000 7f45a6196640 1 -- 172.21.15.55:0/3741539449 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a015c6f0 con 0x7f45a0070020 2023-07-06T21:58:36.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.923+0000 7f45a6196640 1 --2- 172.21.15.55:0/3741539449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a0070020 0x7f45a00703f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f459c0097d0 tx=0x7f459c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ad1f698d1e30765 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:36.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a5194640 1 -- 172.21.15.55:0/3741539449 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c0a8050 con 0x7f45a0070020 2023-07-06T21:58:36.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a5194640 1 -- 172.21.15.55:0/3741539449 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c0ac5f0 con 0x7f45a0070020 2023-07-06T21:58:36.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a5194640 1 -- 172.21.15.55:0/3741539449 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c0ac960 con 0x7f45a0070020 2023-07-06T21:58:36.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 -- 172.21.15.55:0/3741539449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a0070020 msgr2=0x7f45a00703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 --2- 172.21.15.55:0/3741539449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a0070020 0x7f45a00703f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f459c0097d0 tx=0x7f459c01c4a0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 -- 172.21.15.55:0/3741539449 shutdown_connections 2023-07-06T21:58:36.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 --2- 172.21.15.55:0/3741539449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a0070020 0x7f45a00703f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 -- 172.21.15.55:0/3741539449 >> 172.21.15.55:0/3741539449 conn(0x7f45a00cfb90 msgr2=0x7f45a00cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:36.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 -- 172.21.15.55:0/3741539449 shutdown_connections 2023-07-06T21:58:36.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 -- 172.21.15.55:0/3741539449 wait complete. 2023-07-06T21:58:36.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 Processor -- start 2023-07-06T21:58:36.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 -- start start 2023-07-06T21:58:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a0070020 0x7f45a00c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a00c9500 0x7f45a015ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a00ce8e0 0x7f45a014a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00c5840 con 0x7f45a00c9500 2023-07-06T21:58:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a01539d0 con 0x7f45a0070020 2023-07-06T21:58:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a83fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a0153cb0 con 0x7f45a00ce8e0 2023-07-06T21:58:36.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a5995640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a00c9500 0x7f45a015ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a5995640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a00c9500 0x7f45a015ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44500/0 (socket says 172.21.15.55:44500) 2023-07-06T21:58:36.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.927+0000 7f45a5995640 1 -- 172.21.15.55:0/1289040223 learned_addr learned my addr 172.21.15.55:0/1289040223 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:36.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f45a6196640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a0070020 0x7f45a00c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f45a6997640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a00ce8e0 0x7f45a014a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f45a5995640 1 -- 172.21.15.55:0/1289040223 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a00ce8e0 msgr2=0x7f45a014a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f45a5995640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a00ce8e0 0x7f45a014a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f45a5995640 1 -- 172.21.15.55:0/1289040223 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a0070020 msgr2=0x7f45a00c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:36.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f45a5995640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a0070020 0x7f45a00c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:36.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f45a5995640 1 -- 172.21.15.55:0/1289040223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c0093b0 con 0x7f45a00c9500 2023-07-06T21:58:36.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f45a6196640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a0070020 0x7f45a00c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:36.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f45a6997640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a00ce8e0 0x7f45a014a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:36.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f45a5995640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a00c9500 0x7f45a015ea40 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f459000c3c0 tx=0x7f459000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f4596ffd640 1 -- 172.21.15.55:0/1289040223 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4590005cf0 con 0x7f45a00c9500 2023-07-06T21:58:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f4596ffd640 1 -- 172.21.15.55:0/1289040223 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4590005e50 con 0x7f45a00c9500 2023-07-06T21:58:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f4596ffd640 1 -- 172.21.15.55:0/1289040223 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45900072f0 con 0x7f45a00c9500 2023-07-06T21:58:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f45a83fa640 1 -- 172.21.15.55:0/1289040223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a0153f90 con 0x7f45a00c9500 2023-07-06T21:58:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f45a83fa640 1 -- 172.21.15.55:0/1289040223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a0154550 con 0x7f45a00c9500 2023-07-06T21:58:36.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f45a83fa640 1 -- 172.21.15.55:0/1289040223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a0066d60 con 0x7f45a00c9500 2023-07-06T21:58:36.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f4596ffd640 1 -- 172.21.15.55:0/1289040223 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4590007450 con 0x7f45a00c9500 2023-07-06T21:58:36.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f4596ffd640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f45840663a0 0x7f4584068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:36.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f4596ffd640 1 -- 172.21.15.55:0/1289040223 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4590083270 con 0x7f45a00c9500 2023-07-06T21:58:36.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.931+0000 7f45a6196640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f45840663a0 0x7f4584068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:36.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.935+0000 7f45a6196640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f45840663a0 0x7f4584068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f459c0ae000 tx=0x7f459c0a7000 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:36.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:36.935+0000 7f4596ffd640 1 -- 172.21.15.55:0/1289040223 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45900507e0 con 0x7f45a00c9500 2023-07-06T21:58:37.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:37.095+0000 7f45a83fa640 1 -- 172.21.15.55:0/1289040223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f45a00cdfb0 con 0x7f45a00c9500 2023-07-06T21:58:37.236 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:58:37.240 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:58:37.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:37.823+0000 7f4596ffd640 1 -- 172.21.15.55:0/1289040223 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v114) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4590053e00 con 0x7f45a00c9500 2023-07-06T21:58:37.824 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-07-06T21:58:37.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:37.831+0000 7f45a83fa640 1 -- 172.21.15.55:0/1289040223 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f45840663a0 msgr2=0x7f4584068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:37.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:37.831+0000 7f45a83fa640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f45840663a0 0x7f4584068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f459c0ae000 tx=0x7f459c0a7000 comp rx=0 tx=0).stop 2023-07-06T21:58:37.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:37.831+0000 7f45a83fa640 1 -- 172.21.15.55:0/1289040223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a00c9500 msgr2=0x7f45a015ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:37.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:37.831+0000 7f45a83fa640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a00c9500 0x7f45a015ea40 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f459000c3c0 tx=0x7f459000c880 comp rx=0 tx=0).stop 2023-07-06T21:58:37.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:37.835+0000 7f45a83fa640 1 -- 172.21.15.55:0/1289040223 shutdown_connections 2023-07-06T21:58:37.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:37.835+0000 7f45a83fa640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f45840663a0 0x7f4584068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:37.835+0000 7f45a83fa640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45a00ce8e0 0x7f45a014a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:37.835+0000 7f45a83fa640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a00c9500 0x7f45a015ea40 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:37.835+0000 7f45a83fa640 1 --2- 172.21.15.55:0/1289040223 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a0070020 0x7f45a00c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:37.835+0000 7f45a83fa640 1 -- 172.21.15.55:0/1289040223 >> 172.21.15.55:0/1289040223 conn(0x7f45a00cfb90 msgr2=0x7f45a00b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:37.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:37.835+0000 7f45a83fa640 1 -- 172.21.15.55:0/1289040223 shutdown_connections 2023-07-06T21:58:37.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:37.835+0000 7f45a83fa640 1 -- 172.21.15.55:0/1289040223 wait complete. 2023-07-06T21:58:37.856 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T21:58:38.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f544c982640 1 Processor -- start 2023-07-06T21:58:38.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f544c982640 1 -- start start 2023-07-06T21:58:38.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f544c982640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54480d2f80 0x7f544806a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:38.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f544c982640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f544815f5d0 0x7f544815fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:38.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f544c982640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5448069f30 con 0x7f5448156140 2023-07-06T21:58:38.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f544c982640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544815ff90 con 0x7f544815f5d0 2023-07-06T21:58:38.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f544c982640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54480ccb70 con 0x7f54480d2f80 2023-07-06T21:58:38.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f5446d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f544815f5d0 0x7f544815fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:38.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f5446d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f544815f5d0 0x7f544815fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44514/0 (socket says 172.21.15.55:44514) 2023-07-06T21:58:38.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f5446d9d640 1 -- 172.21.15.55:0/3040250404 learned_addr learned my addr 172.21.15.55:0/3040250404 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:38.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f543ffff640 1 --2- 172.21.15.55:0/3040250404 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54480d2f80 0x7f544806a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:38.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f5446d9d640 1 -- 172.21.15.55:0/3040250404 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54480d2f80 msgr2=0x7f544806a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:38.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f5446d9d640 1 --2- 172.21.15.55:0/3040250404 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54480d2f80 0x7f544806a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:38.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f5446d9d640 1 -- 172.21.15.55:0/3040250404 >> v1:172.21.15.138:6789/0 conn(0x7f5448156140 legacy=0x7f54480ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:38.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f5446d9d640 1 -- 172.21.15.55:0/3040250404 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480cce50 con 0x7f544815f5d0 2023-07-06T21:58:38.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.011+0000 7f543ffff640 1 --2- 172.21.15.55:0/3040250404 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54480d2f80 0x7f544806a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:38.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.015+0000 7f5446d9d640 1 --2- 172.21.15.55:0/3040250404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544815f5d0 0x7f544815fa50 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f5440009e50 tx=0x7f544001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e8fa8cab8f516f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:38.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.015+0000 7f5445d9b640 1 -- 172.21.15.55:0/3040250404 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54400a5720 con 0x7f544815f5d0 2023-07-06T21:58:38.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.015+0000 7f5445d9b640 1 -- 172.21.15.55:0/3040250404 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54400a5880 con 0x7f544815f5d0 2023-07-06T21:58:38.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.015+0000 7f5445d9b640 1 -- 172.21.15.55:0/3040250404 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54400a5c10 con 0x7f544815f5d0 2023-07-06T21:58:38.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.015+0000 7f544c982640 1 -- 172.21.15.55:0/3040250404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544815f5d0 msgr2=0x7f544815fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:38.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.015+0000 7f544c982640 1 --2- 172.21.15.55:0/3040250404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544815f5d0 0x7f544815fa50 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f5440009e50 tx=0x7f544001c950 comp rx=0 tx=0).stop 2023-07-06T21:58:38.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.015+0000 7f544c982640 1 -- 172.21.15.55:0/3040250404 shutdown_connections 2023-07-06T21:58:38.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.015+0000 7f544c982640 1 --2- 172.21.15.55:0/3040250404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544815f5d0 0x7f544815fa50 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:38.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.015+0000 7f544c982640 1 --2- 172.21.15.55:0/3040250404 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54480d2f80 0x7f544806a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:38.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.015+0000 7f544c982640 1 -- 172.21.15.55:0/3040250404 >> 172.21.15.55:0/3040250404 conn(0x7f54480cfa90 msgr2=0x7f54480d2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:38.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.015+0000 7f544c982640 1 -- 172.21.15.55:0/3040250404 shutdown_connections 2023-07-06T21:58:38.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.015+0000 7f544c982640 1 -- 172.21.15.55:0/3040250404 wait complete. 2023-07-06T21:58:38.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f544c982640 1 Processor -- start 2023-07-06T21:58:38.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f544c982640 1 -- start start 2023-07-06T21:58:38.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f544c982640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54480d2f80 0x7f544814c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:38.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f544c982640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5448156140 0x7f5448153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:38.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f544c982640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f544815f5d0 0x7f54481553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:38.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f544c982640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544814cc40 con 0x7f5448156140 2023-07-06T21:58:38.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f544c982640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448154d60 con 0x7f544815f5d0 2023-07-06T21:58:38.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f544c982640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5448153cc0 con 0x7f54480d2f80 2023-07-06T21:58:38.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f543ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5448156140 0x7f5448153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:38.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f5446d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f544815f5d0 0x7f54481553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:38.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f544659c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54480d2f80 0x7f544814c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:38.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f543ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5448156140 0x7f5448153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44520/0 (socket says 172.21.15.55:44520) 2023-07-06T21:58:38.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f543ffff640 1 -- 172.21.15.55:0/3198731504 learned_addr learned my addr 172.21.15.55:0/3198731504 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:38.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f543ffff640 1 -- 172.21.15.55:0/3198731504 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54480d2f80 msgr2=0x7f544814c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:38.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f543ffff640 1 --2- 172.21.15.55:0/3198731504 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54480d2f80 0x7f544814c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:38.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f543ffff640 1 -- 172.21.15.55:0/3198731504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f544815f5d0 msgr2=0x7f54481553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:38.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f543ffff640 1 --2- 172.21.15.55:0/3198731504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f544815f5d0 0x7f54481553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:38.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f543ffff640 1 -- 172.21.15.55:0/3198731504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5440009b30 con 0x7f5448156140 2023-07-06T21:58:38.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f543ffff640 1 --2- 172.21.15.55:0/3198731504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5448156140 0x7f5448153320 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f543000d800 tx=0x7f543000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:38.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f543effd640 1 -- 172.21.15.55:0/3198731504 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54300096c0 con 0x7f5448156140 2023-07-06T21:58:38.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f543effd640 1 -- 172.21.15.55:0/3198731504 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5430009820 con 0x7f5448156140 2023-07-06T21:58:38.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f544c982640 1 -- 172.21.15.55:0/3198731504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5448153fa0 con 0x7f5448156140 2023-07-06T21:58:38.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f543effd640 1 -- 172.21.15.55:0/3198731504 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430009bd0 con 0x7f5448156140 2023-07-06T21:58:38.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.019+0000 7f544c982640 1 -- 172.21.15.55:0/3198731504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5448154560 con 0x7f5448156140 2023-07-06T21:58:38.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.023+0000 7f544c982640 1 -- 172.21.15.55:0/3198731504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5448066d60 con 0x7f5448156140 2023-07-06T21:58:38.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.023+0000 7f543effd640 1 -- 172.21.15.55:0/3198731504 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5430009d30 con 0x7f5448156140 2023-07-06T21:58:38.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.023+0000 7f543effd640 1 --2- 172.21.15.55:0/3198731504 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f54280663a0 0x7f5428068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:38.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.027+0000 7f543effd640 1 -- 172.21.15.55:0/3198731504 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f5430084a10 con 0x7f5448156140 2023-07-06T21:58:38.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.027+0000 7f544659c640 1 --2- 172.21.15.55:0/3198731504 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f54280663a0 0x7f5428068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:38.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.027+0000 7f544659c640 1 --2- 172.21.15.55:0/3198731504 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f54280663a0 0x7f5428068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5438007fd0 tx=0x7f5438009040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:38.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.027+0000 7f543effd640 1 -- 172.21.15.55:0/3198731504 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5430051eb0 con 0x7f5448156140 2023-07-06T21:58:38.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.183+0000 7f544c982640 1 -- 172.21.15.55:0/3198731504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f54480d2cf0 con 0x7f5448156140 2023-07-06T21:58:38.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.851+0000 7f543effd640 1 -- 172.21.15.55:0/3198731504 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v115) v1 ==== 170+0+0 (secure 0 0 0) 0x7f54300554d0 con 0x7f5448156140 2023-07-06T21:58:38.850 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-07-06T21:58:38.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.855+0000 7f544c982640 1 -- 172.21.15.55:0/3198731504 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f54280663a0 msgr2=0x7f5428068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:38.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.855+0000 7f544c982640 1 --2- 172.21.15.55:0/3198731504 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f54280663a0 0x7f5428068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5438007fd0 tx=0x7f5438009040 comp rx=0 tx=0).stop 2023-07-06T21:58:38.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.855+0000 7f544c982640 1 -- 172.21.15.55:0/3198731504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5448156140 msgr2=0x7f5448153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:38.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.855+0000 7f544c982640 1 --2- 172.21.15.55:0/3198731504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5448156140 0x7f5448153320 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f543000d800 tx=0x7f543000dcc0 comp rx=0 tx=0).stop 2023-07-06T21:58:38.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.859+0000 7f544c982640 1 -- 172.21.15.55:0/3198731504 shutdown_connections 2023-07-06T21:58:38.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.859+0000 7f544c982640 1 --2- 172.21.15.55:0/3198731504 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f54280663a0 0x7f5428068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:38.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.859+0000 7f544c982640 1 --2- 172.21.15.55:0/3198731504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f544815f5d0 0x7f54481553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:38.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.859+0000 7f544c982640 1 --2- 172.21.15.55:0/3198731504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5448156140 0x7f5448153320 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:38.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.859+0000 7f544c982640 1 --2- 172.21.15.55:0/3198731504 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54480d2f80 0x7f544814c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:38.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.859+0000 7f544c982640 1 -- 172.21.15.55:0/3198731504 >> 172.21.15.55:0/3198731504 conn(0x7f54480cfa90 msgr2=0x7f54480d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:38.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.859+0000 7f544c982640 1 -- 172.21.15.55:0/3198731504 shutdown_connections 2023-07-06T21:58:38.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:38.859+0000 7f544c982640 1 -- 172.21.15.55:0/3198731504 wait complete. 2023-07-06T21:58:38.887 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T21:58:39.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.035+0000 7f2cf7ad8640 1 Processor -- start 2023-07-06T21:58:39.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.035+0000 7f2cf7ad8640 1 -- start start 2023-07-06T21:58:39.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.035+0000 7f2cf7ad8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2cf0158850 0x7f2cf00cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.035+0000 7f2cf7ad8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf0158cb0 con 0x7f2cf0070af0 2023-07-06T21:58:39.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.035+0000 7f2cf7ad8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf00c8db0 con 0x7f2cf00ca130 2023-07-06T21:58:39.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.035+0000 7f2cf7ad8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf00c9090 con 0x7f2cf0158850 2023-07-06T21:58:39.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.035+0000 7f2cf6075640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2cf0070af0 0x7f2cf00b1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33924/0 (socket says 172.21.15.55:33924) 2023-07-06T21:58:39.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.035+0000 7f2cf6075640 1 -- 172.21.15.55:0/504285292 learned_addr learned my addr 172.21.15.55:0/504285292 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:39.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.035+0000 7f2cf5874640 1 --2- 172.21.15.55:0/504285292 >> v2:172.21.15.138:3300/0 conn(0x7f2cf0158850 0x7f2cf00cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.035+0000 7f2cf4872640 1 -- 172.21.15.55:0/504285292 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529938043 0 0) 0x7f2cf0158cb0 con 0x7f2cf0070af0 2023-07-06T21:58:39.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.035+0000 7f2cf4872640 1 -- 172.21.15.55:0/504285292 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cdc003530 con 0x7f2cf0070af0 2023-07-06T21:58:39.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf4872640 1 -- 172.21.15.55:0/504285292 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2220129340 0 0) 0x7f2cdc003530 con 0x7f2cf0070af0 2023-07-06T21:58:39.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf4872640 1 -- 172.21.15.55:0/504285292 >> v2:172.21.15.138:3300/0 conn(0x7f2cf0158850 msgr2=0x7f2cf00cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:39.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf4872640 1 --2- 172.21.15.55:0/504285292 >> v2:172.21.15.138:3300/0 conn(0x7f2cf0158850 0x7f2cf00cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf4872640 1 -- 172.21.15.55:0/504285292 >> v1:172.21.15.138:6789/0 conn(0x7f2cf00ca130 legacy=0x7f2cf00703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf4872640 1 -- 172.21.15.55:0/504285292 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf00c9370 con 0x7f2cf0070af0 2023-07-06T21:58:39.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf4872640 1 -- 172.21.15.55:0/504285292 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f2ce8001a00 con 0x7f2cf0070af0 2023-07-06T21:58:39.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf4872640 1 -- 172.21.15.55:0/504285292 >> v1:172.21.15.55:6789/0 conn(0x7f2cf0070af0 legacy=0x7f2cf00b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf4872640 1 --2- 172.21.15.55:0/504285292 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc003980 0x7f2cdc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf4872640 1 --2- 172.21.15.55:0/504285292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cdc0047d0 0x7f2cdc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf4872640 1 --2- 172.21.15.55:0/504285292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc005180 0x7f2cdc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf4872640 1 -- 172.21.15.55:0/504285292 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00c9090 con 0x7f2cdc005180 2023-07-06T21:58:39.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf4872640 1 -- 172.21.15.55:0/504285292 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc00c000 con 0x7f2cdc0047d0 2023-07-06T21:58:39.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf4872640 1 -- 172.21.15.55:0/504285292 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc00c1c0 con 0x7f2cdc003980 2023-07-06T21:58:39.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf6075640 1 --2- 172.21.15.55:0/504285292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc005180 0x7f2cdc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf5874640 1 --2- 172.21.15.55:0/504285292 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc003980 0x7f2cdc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf5073640 1 --2- 172.21.15.55:0/504285292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cdc0047d0 0x7f2cdc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf5874640 1 -- 172.21.15.55:0/504285292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cdc0047d0 msgr2=0x7f2cdc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:39.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf5874640 1 --2- 172.21.15.55:0/504285292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cdc0047d0 0x7f2cdc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf5874640 1 -- 172.21.15.55:0/504285292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc005180 msgr2=0x7f2cdc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:39.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf5874640 1 --2- 172.21.15.55:0/504285292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc005180 0x7f2cdc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf5874640 1 -- 172.21.15.55:0/504285292 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc003530 con 0x7f2cdc003980 2023-07-06T21:58:39.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf5073640 1 --2- 172.21.15.55:0/504285292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cdc0047d0 0x7f2cdc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:39.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf6075640 1 --2- 172.21.15.55:0/504285292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc005180 0x7f2cdc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:39.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.039+0000 7f2cf6075640 1 -- 172.21.15.55:0/504285292 reap_dead start 2023-07-06T21:58:39.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.043+0000 7f2cf5874640 1 --2- 172.21.15.55:0/504285292 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc003980 0x7f2cdc003d90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2cec009ae0 tx=0x7f2cec01ca50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39e96b1e2f4a5105 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:39.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.043+0000 7f2cf4872640 1 -- 172.21.15.55:0/504285292 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0a5560 con 0x7f2cdc003980 2023-07-06T21:58:39.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.043+0000 7f2cf4872640 1 -- 172.21.15.55:0/504285292 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec0a56c0 con 0x7f2cdc003980 2023-07-06T21:58:39.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.043+0000 7f2cf4872640 1 -- 172.21.15.55:0/504285292 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0a5a70 con 0x7f2cdc003980 2023-07-06T21:58:39.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.043+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/504285292 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc003980 msgr2=0x7f2cdc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.043+0000 7f2cf7ad8640 1 --2- 172.21.15.55:0/504285292 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc003980 0x7f2cdc003d90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2cec009ae0 tx=0x7f2cec01ca50 comp rx=0 tx=0).stop 2023-07-06T21:58:39.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.043+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/504285292 shutdown_connections 2023-07-06T21:58:39.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.043+0000 7f2cf7ad8640 1 --2- 172.21.15.55:0/504285292 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc003980 0x7f2cdc003d90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.043+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/504285292 >> 172.21.15.55:0/504285292 conn(0x7f2cf00cea70 msgr2=0x7f2cf00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:39.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.043+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/504285292 shutdown_connections 2023-07-06T21:58:39.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.043+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/504285292 wait complete. 2023-07-06T21:58:39.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.043+0000 7f2cf7ad8640 1 Processor -- start 2023-07-06T21:58:39.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.043+0000 7f2cf7ad8640 1 -- start start 2023-07-06T21:58:39.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.043+0000 7f2cf7ad8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc003980 0x7f2cf01e3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf7ad8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf00c5580 0x7f2cf0157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf7ad8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf00cb920 0x7f2cf00cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf7ad8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00cc2d0 con 0x7f2cdc003980 2023-07-06T21:58:39.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf7ad8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf01e49d0 con 0x7f2cf00c5580 2023-07-06T21:58:39.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf7ad8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00c5d40 con 0x7f2cf00cb920 2023-07-06T21:58:39.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf5874640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc003980 0x7f2cf01e3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf5874640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc003980 0x7f2cf01e3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44524/0 (socket says 172.21.15.55:44524) 2023-07-06T21:58:39.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf5874640 1 -- 172.21.15.55:0/1684209354 learned_addr learned my addr 172.21.15.55:0/1684209354 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:39.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf5073640 1 --2- 172.21.15.55:0/1684209354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf00c5580 0x7f2cf0157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf6075640 1 --2- 172.21.15.55:0/1684209354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf00cb920 0x7f2cf00cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf5874640 1 -- 172.21.15.55:0/1684209354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf00cb920 msgr2=0x7f2cf00cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf5874640 1 --2- 172.21.15.55:0/1684209354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf00cb920 0x7f2cf00cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf5874640 1 -- 172.21.15.55:0/1684209354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf00c5580 msgr2=0x7f2cf0157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf5874640 1 --2- 172.21.15.55:0/1684209354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf00c5580 0x7f2cf0157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf5874640 1 -- 172.21.15.55:0/1684209354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf00c6020 con 0x7f2cdc003980 2023-07-06T21:58:39.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf5874640 1 --2- 172.21.15.55:0/1684209354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc003980 0x7f2cf01e3e70 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0b0040 tx=0x7f2cec0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:39.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2ce67fc640 1 -- 172.21.15.55:0/1684209354 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec004220 con 0x7f2cdc003980 2023-07-06T21:58:39.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2ce67fc640 1 -- 172.21.15.55:0/1684209354 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec0043c0 con 0x7f2cdc003980 2023-07-06T21:58:39.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2ce67fc640 1 -- 172.21.15.55:0/1684209354 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec003860 con 0x7f2cdc003980 2023-07-06T21:58:39.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/1684209354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf00c6300 con 0x7f2cdc003980 2023-07-06T21:58:39.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/1684209354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf00c59d0 con 0x7f2cdc003980 2023-07-06T21:58:39.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/1684209354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf0066d60 con 0x7f2cdc003980 2023-07-06T21:58:39.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.047+0000 7f2ce67fc640 1 -- 172.21.15.55:0/1684209354 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2cec0b4070 con 0x7f2cdc003980 2023-07-06T21:58:39.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.051+0000 7f2ce67fc640 1 --2- 172.21.15.55:0/1684209354 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2cd4066390 0x7f2cd4068840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.051+0000 7f2ce67fc640 1 -- 172.21.15.55:0/1684209354 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f2cec11e560 con 0x7f2cdc003980 2023-07-06T21:58:39.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.051+0000 7f2cf5073640 1 --2- 172.21.15.55:0/1684209354 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2cd4066390 0x7f2cd4068840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.051+0000 7f2cf5073640 1 --2- 172.21.15.55:0/1684209354 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2cd4066390 0x7f2cd4068840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2cf009d970 tx=0x7f2ce0009040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:39.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.055+0000 7f2ce67fc640 1 -- 172.21.15.55:0/1684209354 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2cec0eb880 con 0x7f2cdc003980 2023-07-06T21:58:39.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.239+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/1684209354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2cf00c9900 con 0x7f2cdc003980 2023-07-06T21:58:39.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.251+0000 7f2ce67fc640 1 -- 172.21.15.55:0/1684209354 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2cec0eeea0 con 0x7f2cdc003980 2023-07-06T21:58:39.252 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 14 and data pool 15 2023-07-06T21:58:39.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.255+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/1684209354 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2cd4066390 msgr2=0x7f2cd4068840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.255+0000 7f2cf7ad8640 1 --2- 172.21.15.55:0/1684209354 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2cd4066390 0x7f2cd4068840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2cf009d970 tx=0x7f2ce0009040 comp rx=0 tx=0).stop 2023-07-06T21:58:39.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.255+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/1684209354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc003980 msgr2=0x7f2cf01e3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.255+0000 7f2cf7ad8640 1 --2- 172.21.15.55:0/1684209354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc003980 0x7f2cf01e3e70 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0b0040 tx=0x7f2cec0197f0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.255+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/1684209354 shutdown_connections 2023-07-06T21:58:39.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.255+0000 7f2cf7ad8640 1 --2- 172.21.15.55:0/1684209354 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f2cd4066390 0x7f2cd4068840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.259+0000 7f2cf7ad8640 1 --2- 172.21.15.55:0/1684209354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf00cb920 0x7f2cf00cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.259+0000 7f2cf7ad8640 1 --2- 172.21.15.55:0/1684209354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf00c5580 0x7f2cf0157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.259+0000 7f2cf7ad8640 1 --2- 172.21.15.55:0/1684209354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc003980 0x7f2cf01e3e70 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.259+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/1684209354 >> 172.21.15.55:0/1684209354 conn(0x7f2cf00cea70 msgr2=0x7f2cf009e120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:39.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.263+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/1684209354 shutdown_connections 2023-07-06T21:58:39.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.263+0000 7f2cf7ad8640 1 -- 172.21.15.55:0/1684209354 wait complete. 2023-07-06T21:58:39.303 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:58:39.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.447+0000 7f68a6b00640 1 Processor -- start 2023-07-06T21:58:39.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.447+0000 7f68a6b00640 1 -- start start 2023-07-06T21:58:39.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.447+0000 7f68a6b00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68a00b4440 0x7f68a00d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.447+0000 7f68a6b00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a00d1e30 con 0x7f68a015bcb0 2023-07-06T21:58:39.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.447+0000 7f68a6b00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a00ccaa0 con 0x7f68a00d19a0 2023-07-06T21:58:39.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.447+0000 7f68a6b00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a015c080 con 0x7f68a00b4440 2023-07-06T21:58:39.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.447+0000 7f68a489c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f68a015bcb0 0x7f68a00b3d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33938/0 (socket says 172.21.15.55:33938) 2023-07-06T21:58:39.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.447+0000 7f68a489c640 1 -- 172.21.15.55:0/850859090 learned_addr learned my addr 172.21.15.55:0/850859090 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:39.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.447+0000 7f68a509d640 1 --2- 172.21.15.55:0/850859090 >> v2:172.21.15.55:3300/0 conn(0x7f68a00b4440 0x7f68a00d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.447+0000 7f689f7fe640 1 -- 172.21.15.55:0/850859090 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745494782 0 0) 0x7f68a00d1e30 con 0x7f68a015bcb0 2023-07-06T21:58:39.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.447+0000 7f689f7fe640 1 -- 172.21.15.55:0/850859090 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6890003530 con 0x7f68a015bcb0 2023-07-06T21:58:39.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.447+0000 7f68a509d640 1 -- 172.21.15.55:0/850859090 >> v1:172.21.15.138:6789/0 conn(0x7f68a00d19a0 legacy=0x7f68a00b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.447+0000 7f68a509d640 1 -- 172.21.15.55:0/850859090 >> v1:172.21.15.55:6789/0 conn(0x7f68a015bcb0 legacy=0x7f68a00b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.447+0000 7f68a509d640 1 -- 172.21.15.55:0/850859090 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a00ccd80 con 0x7f68a00b4440 2023-07-06T21:58:39.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.451+0000 7f68a509d640 1 --2- 172.21.15.55:0/850859090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b4440 0x7f68a00d0bc0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f6898009d90 tx=0x7f689801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47953ac20e6f036 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:39.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.451+0000 7f689f7fe640 1 -- 172.21.15.55:0/850859090 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68980a5870 con 0x7f68a00b4440 2023-07-06T21:58:39.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.451+0000 7f689f7fe640 1 -- 172.21.15.55:0/850859090 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68980a59d0 con 0x7f68a00b4440 2023-07-06T21:58:39.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.451+0000 7f689f7fe640 1 -- 172.21.15.55:0/850859090 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68980a5d40 con 0x7f68a00b4440 2023-07-06T21:58:39.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.451+0000 7f68a6b00640 1 -- 172.21.15.55:0/850859090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b4440 msgr2=0x7f68a00d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.451+0000 7f68a6b00640 1 --2- 172.21.15.55:0/850859090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b4440 0x7f68a00d0bc0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f6898009d90 tx=0x7f689801c830 comp rx=0 tx=0).stop 2023-07-06T21:58:39.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.451+0000 7f68a6b00640 1 -- 172.21.15.55:0/850859090 shutdown_connections 2023-07-06T21:58:39.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.451+0000 7f68a6b00640 1 --2- 172.21.15.55:0/850859090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b4440 0x7f68a00d0bc0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.451+0000 7f68a6b00640 1 -- 172.21.15.55:0/850859090 >> 172.21.15.55:0/850859090 conn(0x7f68a00ced30 msgr2=0x7f68a00cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:39.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.451+0000 7f68a6b00640 1 -- 172.21.15.55:0/850859090 shutdown_connections 2023-07-06T21:58:39.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.451+0000 7f68a6b00640 1 -- 172.21.15.55:0/850859090 wait complete. 2023-07-06T21:58:39.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a6b00640 1 Processor -- start 2023-07-06T21:58:39.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a6b00640 1 -- start start 2023-07-06T21:58:39.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a6b00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b4440 0x7f68a00cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a6b00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a00d19a0 0x7f68a014f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a6b00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68a015bcb0 0x7f68a01496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a6b00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a015c1c0 con 0x7f68a00b4440 2023-07-06T21:58:39.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a6b00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a015cd40 con 0x7f68a00d19a0 2023-07-06T21:58:39.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a6b00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a015c410 con 0x7f68a015bcb0 2023-07-06T21:58:39.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a489c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b4440 0x7f68a00cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a489c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b4440 0x7f68a00cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44548/0 (socket says 172.21.15.55:44548) 2023-07-06T21:58:39.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a489c640 1 -- 172.21.15.55:0/3382730866 learned_addr learned my addr 172.21.15.55:0/3382730866 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:39.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a509d640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68a015bcb0 0x7f68a01496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f689ffff640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a00d19a0 0x7f68a014f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a489c640 1 -- 172.21.15.55:0/3382730866 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68a015bcb0 msgr2=0x7f68a01496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a489c640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68a015bcb0 0x7f68a01496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a489c640 1 -- 172.21.15.55:0/3382730866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a00d19a0 msgr2=0x7f68a014f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a489c640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a00d19a0 0x7f68a014f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a489c640 1 -- 172.21.15.55:0/3382730866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6898009a70 con 0x7f68a00b4440 2023-07-06T21:58:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f689ffff640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a00d19a0 0x7f68a014f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a489c640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b4440 0x7f68a00cc180 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f689400c450 tx=0x7f689400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f689d7fa640 1 -- 172.21.15.55:0/3382730866 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894005cf0 con 0x7f68a00b4440 2023-07-06T21:58:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f689d7fa640 1 -- 172.21.15.55:0/3382730866 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6894005e50 con 0x7f68a00b4440 2023-07-06T21:58:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f689d7fa640 1 -- 172.21.15.55:0/3382730866 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894007270 con 0x7f68a00b4440 2023-07-06T21:58:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a6b00640 1 -- 172.21.15.55:0/3382730866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a015c6f0 con 0x7f68a00b4440 2023-07-06T21:58:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a6b00640 1 -- 172.21.15.55:0/3382730866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a00c9760 con 0x7f68a00b4440 2023-07-06T21:58:39.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.455+0000 7f68a6b00640 1 -- 172.21.15.55:0/3382730866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a00d1630 con 0x7f68a00b4440 2023-07-06T21:58:39.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.459+0000 7f689d7fa640 1 -- 172.21.15.55:0/3382730866 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f68940073d0 con 0x7f68a00b4440 2023-07-06T21:58:39.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.459+0000 7f689d7fa640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f68840663d0 0x7f6884068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.459+0000 7f689d7fa640 1 -- 172.21.15.55:0/3382730866 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6894083110 con 0x7f68a00b4440 2023-07-06T21:58:39.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.459+0000 7f689ffff640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f68840663d0 0x7f6884068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.459+0000 7f689ffff640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f68840663d0 0x7f6884068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f68a014b050 tx=0x7f688c009040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:39.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.463+0000 7f689d7fa640 1 -- 172.21.15.55:0/3382730866 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6894050410 con 0x7f68a00b4440 2023-07-06T21:58:39.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.619+0000 7f68a6b00640 1 -- 172.21.15.55:0/3382730866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68a0066d60 con 0x7f68a00b4440 2023-07-06T21:58:39.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.623+0000 7f689d7fa640 1 -- 172.21.15.55:0/3382730866 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+18507 (secure 0 0 0) 0x7f6894053a30 con 0x7f68a00b4440 2023-07-06T21:58:39.622 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:39.622 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":116,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:58:39.245554+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:58:37.143680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-07-06T21:58:38.234438+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:58:39.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.623+0000 7f68a6b00640 1 -- 172.21.15.55:0/3382730866 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f68840663d0 msgr2=0x7f6884068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.623+0000 7f68a6b00640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f68840663d0 0x7f6884068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f68a014b050 tx=0x7f688c009040 comp rx=0 tx=0).stop 2023-07-06T21:58:39.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.623+0000 7f68a6b00640 1 -- 172.21.15.55:0/3382730866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b4440 msgr2=0x7f68a00cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.623+0000 7f68a6b00640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b4440 0x7f68a00cc180 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f689400c450 tx=0x7f689400c910 comp rx=0 tx=0).stop 2023-07-06T21:58:39.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.623+0000 7f68a6b00640 1 -- 172.21.15.55:0/3382730866 shutdown_connections 2023-07-06T21:58:39.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.623+0000 7f68a6b00640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f68840663d0 0x7f6884068880 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.623+0000 7f68a6b00640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68a015bcb0 0x7f68a01496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.623+0000 7f68a6b00640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a00d19a0 0x7f68a014f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.623+0000 7f68a6b00640 1 --2- 172.21.15.55:0/3382730866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b4440 0x7f68a00cc180 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.623+0000 7f68a6b00640 1 -- 172.21.15.55:0/3382730866 >> 172.21.15.55:0/3382730866 conn(0x7f68a00ced30 msgr2=0x7f68a0151060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:39.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.623+0000 7f68a6b00640 1 -- 172.21.15.55:0/3382730866 shutdown_connections 2023-07-06T21:58:39.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.623+0000 7f68a6b00640 1 -- 172.21.15.55:0/3382730866 wait complete. 2023-07-06T21:58:39.643 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:58:39.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.787+0000 7fc21e07b640 1 Processor -- start 2023-07-06T21:58:39.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.787+0000 7fc21e07b640 1 -- start start 2023-07-06T21:58:39.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.791+0000 7fc21e07b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc218158400 0x7fc2180c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.791+0000 7fc21e07b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2180c9680 0x7fc218070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.791+0000 7fc21e07b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21806fae0 con 0x7fc2180710c0 2023-07-06T21:58:39.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.791+0000 7fc21e07b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21806fdc0 con 0x7fc218158400 2023-07-06T21:58:39.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.791+0000 7fc21e07b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180700a0 con 0x7fc2180c9680 2023-07-06T21:58:39.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.791+0000 7fc2177fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc218158400 0x7fc2180c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.791+0000 7fc217fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc2180710c0 0x7fc2180cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33942/0 (socket says 172.21.15.55:33942) 2023-07-06T21:58:39.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.791+0000 7fc217fff640 1 -- 172.21.15.55:0/879569574 learned_addr learned my addr 172.21.15.55:0/879569574 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:39.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.791+0000 7fc20ffff640 1 --2- 172.21.15.55:0/879569574 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2180c9680 0x7fc218070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.791+0000 7fc2177fe640 1 -- 172.21.15.55:0/879569574 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2180c9680 msgr2=0x7fc218070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:39.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.791+0000 7fc2177fe640 1 --2- 172.21.15.55:0/879569574 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2180c9680 0x7fc218070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.791+0000 7fc2177fe640 1 -- 172.21.15.55:0/879569574 >> v1:172.21.15.55:6789/0 conn(0x7fc2180710c0 legacy=0x7fc2180cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.791+0000 7fc2177fe640 1 -- 172.21.15.55:0/879569574 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc218070380 con 0x7fc218158400 2023-07-06T21:58:39.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc2177fe640 1 --2- 172.21.15.55:0/879569574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc218158400 0x7fc2180c9140 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fc2080097c0 tx=0x7fc20801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49d333e86af957 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:39.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc216ffd640 1 -- 172.21.15.55:0/879569574 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2080ab670 con 0x7fc218158400 2023-07-06T21:58:39.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc216ffd640 1 -- 172.21.15.55:0/879569574 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2080ab7d0 con 0x7fc218158400 2023-07-06T21:58:39.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc216ffd640 1 -- 172.21.15.55:0/879569574 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2080abb60 con 0x7fc218158400 2023-07-06T21:58:39.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 -- 172.21.15.55:0/879569574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc218158400 msgr2=0x7fc2180c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 --2- 172.21.15.55:0/879569574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc218158400 0x7fc2180c9140 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fc2080097c0 tx=0x7fc20801c450 comp rx=0 tx=0).stop 2023-07-06T21:58:39.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 -- 172.21.15.55:0/879569574 shutdown_connections 2023-07-06T21:58:39.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 --2- 172.21.15.55:0/879569574 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2180c9680 0x7fc218070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 --2- 172.21.15.55:0/879569574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc218158400 0x7fc2180c9140 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 -- 172.21.15.55:0/879569574 >> 172.21.15.55:0/879569574 conn(0x7fc2180cded0 msgr2=0x7fc2180ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:39.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 -- 172.21.15.55:0/879569574 shutdown_connections 2023-07-06T21:58:39.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 -- 172.21.15.55:0/879569574 wait complete. 2023-07-06T21:58:39.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 Processor -- start 2023-07-06T21:58:39.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 -- start start 2023-07-06T21:58:39.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2180710c0 0x7fc218153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2180c9680 0x7fc21815da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc218158400 0x7fc2180b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21815fe70 con 0x7fc2180710c0 2023-07-06T21:58:39.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180ad210 con 0x7fc218158400 2023-07-06T21:58:39.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.795+0000 7fc21e07b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21815fb20 con 0x7fc2180c9680 2023-07-06T21:58:39.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc2177fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2180710c0 0x7fc218153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc2177fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2180710c0 0x7fc218153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44560/0 (socket says 172.21.15.55:44560) 2023-07-06T21:58:39.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc2177fe640 1 -- 172.21.15.55:0/3959975902 learned_addr learned my addr 172.21.15.55:0/3959975902 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:39.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc20ffff640 1 --2- 172.21.15.55:0/3959975902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2180c9680 0x7fc21815da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc217fff640 1 --2- 172.21.15.55:0/3959975902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc218158400 0x7fc2180b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc2177fe640 1 -- 172.21.15.55:0/3959975902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2180c9680 msgr2=0x7fc21815da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc2177fe640 1 --2- 172.21.15.55:0/3959975902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2180c9680 0x7fc21815da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc2177fe640 1 -- 172.21.15.55:0/3959975902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc218158400 msgr2=0x7fc2180b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc2177fe640 1 --2- 172.21.15.55:0/3959975902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc218158400 0x7fc2180b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc2177fe640 1 -- 172.21.15.55:0/3959975902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208009420 con 0x7fc2180710c0 2023-07-06T21:58:39.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc2177fe640 1 --2- 172.21.15.55:0/3959975902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2180710c0 0x7fc218153d40 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fc2080ad040 tx=0x7fc20801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:39.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc214ff9640 1 -- 172.21.15.55:0/3959975902 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2080b5810 con 0x7fc2180710c0 2023-07-06T21:58:39.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc214ff9640 1 -- 172.21.15.55:0/3959975902 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2080b5990 con 0x7fc2180710c0 2023-07-06T21:58:39.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc214ff9640 1 -- 172.21.15.55:0/3959975902 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2080b5d40 con 0x7fc2180710c0 2023-07-06T21:58:39.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc21e07b640 1 -- 172.21.15.55:0/3959975902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc218162820 con 0x7fc2180710c0 2023-07-06T21:58:39.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc21e07b640 1 -- 172.21.15.55:0/3959975902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc218155270 con 0x7fc2180710c0 2023-07-06T21:58:39.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc21e07b640 1 -- 172.21.15.55:0/3959975902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21806c580 con 0x7fc2180710c0 2023-07-06T21:58:39.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.799+0000 7fc214ff9640 1 -- 172.21.15.55:0/3959975902 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc2080bf410 con 0x7fc2180710c0 2023-07-06T21:58:39.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.803+0000 7fc214ff9640 1 --2- 172.21.15.55:0/3959975902 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fc1f80663a0 0x7fc1f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:39.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.803+0000 7fc214ff9640 1 -- 172.21.15.55:0/3959975902 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc20811ebf0 con 0x7fc2180710c0 2023-07-06T21:58:39.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.803+0000 7fc20ffff640 1 --2- 172.21.15.55:0/3959975902 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fc1f80663a0 0x7fc1f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:39.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.803+0000 7fc20ffff640 1 --2- 172.21.15.55:0/3959975902 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fc1f80663a0 0x7fc1f8068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc2181621c0 tx=0x7fc200008040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:39.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.807+0000 7fc214ff9640 1 -- 172.21.15.55:0/3959975902 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2080ebe20 con 0x7fc2180710c0 2023-07-06T21:58:39.808 INFO:tasks.ceph.mds.b.smithi138.stderr:2023-07-06T21:58:39.809+0000 7f48d74fd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T21:58:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.963+0000 7fc21e07b640 1 -- 172.21.15.55:0/3959975902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc218066d60 con 0x7fc2180710c0 2023-07-06T21:58:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.963+0000 7fc214ff9640 1 -- 172.21.15.55:0/3959975902 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+18507 (secure 0 0 0) 0x7fc2080ab630 con 0x7fc2180710c0 2023-07-06T21:58:39.964 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:39.964 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":116,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:58:39.245554+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:58:37.143680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-07-06T21:58:38.234438+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:58:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.967+0000 7fc21e07b640 1 -- 172.21.15.55:0/3959975902 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fc1f80663a0 msgr2=0x7fc1f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.967+0000 7fc21e07b640 1 --2- 172.21.15.55:0/3959975902 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fc1f80663a0 0x7fc1f8068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc2181621c0 tx=0x7fc200008040 comp rx=0 tx=0).stop 2023-07-06T21:58:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.967+0000 7fc21e07b640 1 -- 172.21.15.55:0/3959975902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2180710c0 msgr2=0x7fc218153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.967+0000 7fc21e07b640 1 --2- 172.21.15.55:0/3959975902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2180710c0 0x7fc218153d40 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fc2080ad040 tx=0x7fc20801ac90 comp rx=0 tx=0).stop 2023-07-06T21:58:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.967+0000 7fc21e07b640 1 -- 172.21.15.55:0/3959975902 shutdown_connections 2023-07-06T21:58:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.967+0000 7fc21e07b640 1 --2- 172.21.15.55:0/3959975902 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fc1f80663a0 0x7fc1f8068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.967+0000 7fc21e07b640 1 --2- 172.21.15.55:0/3959975902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc218158400 0x7fc2180b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.967+0000 7fc21e07b640 1 --2- 172.21.15.55:0/3959975902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2180c9680 0x7fc21815da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.967+0000 7fc21e07b640 1 --2- 172.21.15.55:0/3959975902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2180710c0 0x7fc218153d40 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.967+0000 7fc21e07b640 1 -- 172.21.15.55:0/3959975902 >> 172.21.15.55:0/3959975902 conn(0x7fc2180cded0 msgr2=0x7fc2180aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.967+0000 7fc21e07b640 1 -- 172.21.15.55:0/3959975902 shutdown_connections 2023-07-06T21:58:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:39.967+0000 7fc21e07b640 1 -- 172.21.15.55:0/3959975902 wait complete. 2023-07-06T21:58:39.985 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T21:58:40.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.131+0000 7ff481574640 1 Processor -- start 2023-07-06T21:58:40.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.135+0000 7ff481574640 1 -- start start 2023-07-06T21:58:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.135+0000 7ff481574640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff47c070d70 0x7ff47c0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.135+0000 7ff481574640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47c0b15a0 con 0x7ff47c0b1170 2023-07-06T21:58:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.135+0000 7ff481574640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47c0cc030 con 0x7ff47c0709a0 2023-07-06T21:58:40.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.135+0000 7ff481574640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47c0cc300 con 0x7ff47c070d70 2023-07-06T21:58:40.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.135+0000 7ff473fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff47c070d70 0x7ff47c0b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:40.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.135+0000 7ff47b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff47c0b1170 0x7ff47c06eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33944/0 (socket says 172.21.15.55:33944) 2023-07-06T21:58:40.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.135+0000 7ff47b7fe640 1 -- 172.21.15.55:0/1431763738 learned_addr learned my addr 172.21.15.55:0/1431763738 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:40.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.135+0000 7ff473fff640 1 -- 172.21.15.55:0/1431763738 >> v1:172.21.15.138:6789/0 conn(0x7ff47c0709a0 legacy=0x7ff47c0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:40.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.135+0000 7ff473fff640 1 -- 172.21.15.55:0/1431763738 >> v1:172.21.15.55:6789/0 conn(0x7ff47c0b1170 legacy=0x7ff47c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:40.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.135+0000 7ff473fff640 1 -- 172.21.15.55:0/1431763738 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c0cc5e0 con 0x7ff47c070d70 2023-07-06T21:58:40.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.139+0000 7ff473fff640 1 --2- 172.21.15.55:0/1431763738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c070d70 0x7ff47c0b0c30 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7ff4640097c0 tx=0x7ff46401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe7f158698f833e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:40.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.139+0000 7ff47a7fc640 1 -- 172.21.15.55:0/1431763738 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4640ab600 con 0x7ff47c070d70 2023-07-06T21:58:40.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.139+0000 7ff47a7fc640 1 -- 172.21.15.55:0/1431763738 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4640a7050 con 0x7ff47c070d70 2023-07-06T21:58:40.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.139+0000 7ff47a7fc640 1 -- 172.21.15.55:0/1431763738 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4640ab980 con 0x7ff47c070d70 2023-07-06T21:58:40.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.139+0000 7ff481574640 1 -- 172.21.15.55:0/1431763738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c070d70 msgr2=0x7ff47c0b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:40.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.139+0000 7ff481574640 1 --2- 172.21.15.55:0/1431763738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c070d70 0x7ff47c0b0c30 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7ff4640097c0 tx=0x7ff46401c440 comp rx=0 tx=0).stop 2023-07-06T21:58:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.139+0000 7ff481574640 1 -- 172.21.15.55:0/1431763738 shutdown_connections 2023-07-06T21:58:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.139+0000 7ff481574640 1 --2- 172.21.15.55:0/1431763738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c070d70 0x7ff47c0b0c30 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.139+0000 7ff481574640 1 -- 172.21.15.55:0/1431763738 >> 172.21.15.55:0/1431763738 conn(0x7ff47c0cea70 msgr2=0x7ff47c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.139+0000 7ff481574640 1 -- 172.21.15.55:0/1431763738 shutdown_connections 2023-07-06T21:58:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.139+0000 7ff481574640 1 -- 172.21.15.55:0/1431763738 wait complete. 2023-07-06T21:58:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.139+0000 7ff481574640 1 Processor -- start 2023-07-06T21:58:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.139+0000 7ff481574640 1 -- start start 2023-07-06T21:58:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff481574640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff47c0709a0 0x7ff47c0693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff481574640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c070d70 0x7ff47c0c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff481574640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff47c0b1170 0x7ff47c0c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:40.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff481574640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c069d40 con 0x7ff47c070d70 2023-07-06T21:58:40.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff481574640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c06a020 con 0x7ff47c0b1170 2023-07-06T21:58:40.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff481574640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c06a300 con 0x7ff47c0709a0 2023-07-06T21:58:40.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff473fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c070d70 0x7ff47c0c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:40.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff473fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c070d70 0x7ff47c0c3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44580/0 (socket says 172.21.15.55:44580) 2023-07-06T21:58:40.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff473fff640 1 -- 172.21.15.55:0/5587586 learned_addr learned my addr 172.21.15.55:0/5587586 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:40.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff47affd640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff47c0709a0 0x7ff47c0693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:40.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff47b7fe640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff47c0b1170 0x7ff47c0c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:40.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff473fff640 1 -- 172.21.15.55:0/5587586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff47c0709a0 msgr2=0x7ff47c0693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:40.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff473fff640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff47c0709a0 0x7ff47c0693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:40.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff473fff640 1 -- 172.21.15.55:0/5587586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff47c0b1170 msgr2=0x7ff47c0c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:40.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff473fff640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff47c0b1170 0x7ff47c0c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:40.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff473fff640 1 -- 172.21.15.55:0/5587586 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464009420 con 0x7ff47c070d70 2023-07-06T21:58:40.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff47affd640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff47c0709a0 0x7ff47c0693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:40.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff47b7fe640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff47c0b1170 0x7ff47c0c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:40.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff473fff640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c070d70 0x7ff47c0c3370 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7ff4640ae040 tx=0x7ff46401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:40.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff4737fe640 1 -- 172.21.15.55:0/5587586 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4640b7650 con 0x7ff47c070d70 2023-07-06T21:58:40.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff4737fe640 1 -- 172.21.15.55:0/5587586 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4640abe90 con 0x7ff47c070d70 2023-07-06T21:58:40.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff4737fe640 1 -- 172.21.15.55:0/5587586 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4640b7a10 con 0x7ff47c070d70 2023-07-06T21:58:40.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff481574640 1 -- 172.21.15.55:0/5587586 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47c06a5e0 con 0x7ff47c070d70 2023-07-06T21:58:40.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff481574640 1 -- 172.21.15.55:0/5587586 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c06ade0 con 0x7ff47c070d70 2023-07-06T21:58:40.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff481574640 1 -- 172.21.15.55:0/5587586 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47c066d60 con 0x7ff47c070d70 2023-07-06T21:58:40.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.143+0000 7ff4737fe640 1 -- 172.21.15.55:0/5587586 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff4640b7b70 con 0x7ff47c070d70 2023-07-06T21:58:40.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.147+0000 7ff4737fe640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7ff45c0663a0 0x7ff45c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:40.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.147+0000 7ff4737fe640 1 -- 172.21.15.55:0/5587586 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff46411ead0 con 0x7ff47c070d70 2023-07-06T21:58:40.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.147+0000 7ff47affd640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7ff45c0663a0 0x7ff45c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:40.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.147+0000 7ff47affd640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7ff45c0663a0 0x7ff45c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff46c003ec0 tx=0x7ff46c009040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:40.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.151+0000 7ff4737fe640 1 -- 172.21.15.55:0/5587586 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4640ebb50 con 0x7ff47c070d70 2023-07-06T21:58:40.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:40.343+0000 7ff481574640 1 -- 172.21.15.55:0/5587586 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff47c06aa90 con 0x7ff47c070d70 2023-07-06T21:58:41.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.259+0000 7ff4737fe640 1 -- 172.21.15.55:0/5587586 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff4640b00b0 con 0x7ff47c070d70 2023-07-06T21:58:41.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.263+0000 7ff481574640 1 -- 172.21.15.55:0/5587586 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7ff45c0663a0 msgr2=0x7ff45c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:41.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.263+0000 7ff481574640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7ff45c0663a0 0x7ff45c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff46c003ec0 tx=0x7ff46c009040 comp rx=0 tx=0).stop 2023-07-06T21:58:41.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.263+0000 7ff481574640 1 -- 172.21.15.55:0/5587586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c070d70 msgr2=0x7ff47c0c3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:41.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.263+0000 7ff481574640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c070d70 0x7ff47c0c3370 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7ff4640ae040 tx=0x7ff46401ac80 comp rx=0 tx=0).stop 2023-07-06T21:58:41.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.263+0000 7ff481574640 1 -- 172.21.15.55:0/5587586 shutdown_connections 2023-07-06T21:58:41.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.263+0000 7ff481574640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7ff45c0663a0 0x7ff45c068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.263+0000 7ff481574640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff47c0b1170 0x7ff47c0c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.263+0000 7ff481574640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c070d70 0x7ff47c0c3370 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.263+0000 7ff481574640 1 --2- 172.21.15.55:0/5587586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff47c0709a0 0x7ff47c0693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.263+0000 7ff481574640 1 -- 172.21.15.55:0/5587586 >> 172.21.15.55:0/5587586 conn(0x7ff47c0cea70 msgr2=0x7ff47c159310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.263+0000 7ff481574640 1 -- 172.21.15.55:0/5587586 shutdown_connections 2023-07-06T21:58:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.263+0000 7ff481574640 1 -- 172.21.15.55:0/5587586 wait complete. 2023-07-06T21:58:41.285 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-06T21:58:41.285 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T21:58:41.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.435+0000 7f8b36448640 1 Processor -- start 2023-07-06T21:58:41.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b36448640 1 -- start start 2023-07-06T21:58:41.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b36448640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b300709a0 0x7f8b300cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:41.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b36448640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b300cc300 con 0x7f8b300b1340 2023-07-06T21:58:41.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b36448640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b300cc5e0 con 0x7f8b300cbe60 2023-07-06T21:58:41.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b36448640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300cc8c0 con 0x7f8b300709a0 2023-07-06T21:58:41.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b349e5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8b300b1340 0x7f8b3006eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33952/0 (socket says 172.21.15.55:33952) 2023-07-06T21:58:41.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b349e5640 1 -- 172.21.15.55:0/1757473128 learned_addr learned my addr 172.21.15.55:0/1757473128 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:41.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2ffff640 1 --2- 172.21.15.55:0/1757473128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b300709a0 0x7f8b300cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:41.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216678414 0 0) 0x7f8b300cc300 con 0x7f8b300b1340 2023-07-06T21:58:41.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b18003530 con 0x7f8b300b1340 2023-07-06T21:58:41.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149257526 0 0) 0x7f8b300cc5e0 con 0x7f8b300cbe60 2023-07-06T21:58:41.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b300cc300 con 0x7f8b300cbe60 2023-07-06T21:58:41.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2477766261 0 0) 0x7f8b18003530 con 0x7f8b300b1340 2023-07-06T21:58:41.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b300709a0 msgr2=0x7f8b300cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:41.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 --2- 172.21.15.55:0/1757473128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b300709a0 0x7f8b300cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:41.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 >> v1:172.21.15.138:6789/0 conn(0x7f8b300cbe60 legacy=0x7f8b300b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:41.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b300ccba0 con 0x7f8b300b1340 2023-07-06T21:58:41.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f8b28001a00 con 0x7f8b300b1340 2023-07-06T21:58:41.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 >> v1:172.21.15.55:6789/0 conn(0x7f8b300b1340 legacy=0x7f8b3006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:41.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 --2- 172.21.15.55:0/1757473128 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b18003b40 0x7f8b18003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:41.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 --2- 172.21.15.55:0/1757473128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b180047d0 0x7f8b18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:41.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 --2- 172.21.15.55:0/1757473128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b300709a0 0x7f8b18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:41.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300cc8c0 con 0x7f8b180047d0 2023-07-06T21:58:41.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1800ba40 con 0x7f8b18003b40 2023-07-06T21:58:41.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1800bbb0 con 0x7f8b300709a0 2023-07-06T21:58:41.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2f7fe640 1 --2- 172.21.15.55:0/1757473128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b180047d0 0x7f8b18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:41.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b349e5640 1 --2- 172.21.15.55:0/1757473128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b300709a0 0x7f8b18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:41.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2ffff640 1 --2- 172.21.15.55:0/1757473128 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b18003b40 0x7f8b18003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:41.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2f7fe640 1 -- 172.21.15.55:0/1757473128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b300709a0 msgr2=0x7f8b18005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:41.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2f7fe640 1 --2- 172.21.15.55:0/1757473128 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b300709a0 0x7f8b18005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:41.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2f7fe640 1 -- 172.21.15.55:0/1757473128 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b18003b40 msgr2=0x7f8b18003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:41.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2f7fe640 1 --2- 172.21.15.55:0/1757473128 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b18003b40 0x7f8b18003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:41.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.439+0000 7f8b2f7fe640 1 -- 172.21.15.55:0/1757473128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b18003530 con 0x7f8b180047d0 2023-07-06T21:58:41.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.443+0000 7f8b2f7fe640 1 --2- 172.21.15.55:0/1757473128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b180047d0 0x7f8b18004c40 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f8b300cc230 tx=0x7f8b2401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7231ea048d572e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:41.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.443+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b240052d0 con 0x7f8b180047d0 2023-07-06T21:58:41.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.443+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b24005450 con 0x7f8b180047d0 2023-07-06T21:58:41.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.443+0000 7f8b2effd640 1 -- 172.21.15.55:0/1757473128 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b240a8910 con 0x7f8b180047d0 2023-07-06T21:58:41.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.443+0000 7f8b36448640 1 -- 172.21.15.55:0/1757473128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b180047d0 msgr2=0x7f8b18004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.443+0000 7f8b36448640 1 --2- 172.21.15.55:0/1757473128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b180047d0 0x7f8b18004c40 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f8b300cc230 tx=0x7f8b2401ecb0 comp rx=0 tx=0).stop 2023-07-06T21:58:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.443+0000 7f8b349e5640 1 -- 172.21.15.55:0/1757473128 reap_dead start 2023-07-06T21:58:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.443+0000 7f8b36448640 1 -- 172.21.15.55:0/1757473128 shutdown_connections 2023-07-06T21:58:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.443+0000 7f8b36448640 1 -- 172.21.15.55:0/1757473128 >> 172.21.15.55:0/1757473128 conn(0x7f8b300cea70 msgr2=0x7f8b300ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.443+0000 7f8b36448640 1 -- 172.21.15.55:0/1757473128 shutdown_connections 2023-07-06T21:58:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.443+0000 7f8b36448640 1 -- 172.21.15.55:0/1757473128 wait complete. 2023-07-06T21:58:41.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b36448640 1 Processor -- start 2023-07-06T21:58:41.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b36448640 1 -- start start 2023-07-06T21:58:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b36448640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b180047d0 0x7f8b301f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b36448640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b301f0a50 0x7f8b300c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b36448640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b300c9960 0x7f8b3006add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b36448640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300c9de0 con 0x7f8b301f0a50 2023-07-06T21:58:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b36448640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3006bb00 con 0x7f8b300c9960 2023-07-06T21:58:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b36448640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3009cfa0 con 0x7f8b180047d0 2023-07-06T21:58:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b301f0a50 0x7f8b300c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b301f0a50 0x7f8b300c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44590/0 (socket says 172.21.15.55:44590) 2023-07-06T21:58:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b2f7fe640 1 -- 172.21.15.55:0/3956342667 learned_addr learned my addr 172.21.15.55:0/3956342667 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b2ffff640 1 --2- 172.21.15.55:0/3956342667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b180047d0 0x7f8b301f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b349e5640 1 --2- 172.21.15.55:0/3956342667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b300c9960 0x7f8b3006add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b2f7fe640 1 -- 172.21.15.55:0/3956342667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b180047d0 msgr2=0x7f8b301f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b2f7fe640 1 --2- 172.21.15.55:0/3956342667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b180047d0 0x7f8b301f22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b2f7fe640 1 -- 172.21.15.55:0/3956342667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b300c9960 msgr2=0x7f8b3006add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b2f7fe640 1 --2- 172.21.15.55:0/3956342667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b300c9960 0x7f8b3006add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b2f7fe640 1 -- 172.21.15.55:0/3956342667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3009d280 con 0x7f8b301f0a50 2023-07-06T21:58:41.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b2f7fe640 1 --2- 172.21.15.55:0/3956342667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b301f0a50 0x7f8b300c9420 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f8b24001990 tx=0x7f8b18005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b2cff9640 1 -- 172.21.15.55:0/3956342667 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b240a8d30 con 0x7f8b301f0a50 2023-07-06T21:58:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b2cff9640 1 -- 172.21.15.55:0/3956342667 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b240a8e90 con 0x7f8b301f0a50 2023-07-06T21:58:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b36448640 1 -- 172.21.15.55:0/3956342667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3009d560 con 0x7f8b301f0a50 2023-07-06T21:58:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b2cff9640 1 -- 172.21.15.55:0/3956342667 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b240052d0 con 0x7f8b301f0a50 2023-07-06T21:58:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.447+0000 7f8b36448640 1 -- 172.21.15.55:0/3956342667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3006b310 con 0x7f8b301f0a50 2023-07-06T21:58:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.451+0000 7f8b36448640 1 -- 172.21.15.55:0/3956342667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3009ce00 con 0x7f8b301f0a50 2023-07-06T21:58:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.451+0000 7f8b2cff9640 1 -- 172.21.15.55:0/3956342667 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8b240067e0 con 0x7f8b301f0a50 2023-07-06T21:58:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.451+0000 7f8b2cff9640 1 --2- 172.21.15.55:0/3956342667 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8b1c0663d0 0x7f8b1c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.451+0000 7f8b2cff9640 1 -- 172.21.15.55:0/3956342667 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8b24120dc0 con 0x7f8b301f0a50 2023-07-06T21:58:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.451+0000 7f8b2ffff640 1 --2- 172.21.15.55:0/3956342667 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8b1c0663d0 0x7f8b1c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:41.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.451+0000 7f8b2ffff640 1 --2- 172.21.15.55:0/3956342667 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8b1c0663d0 0x7f8b1c068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b300c7b80 tx=0x7f8b20009190 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:41.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.455+0000 7f8b2cff9640 1 -- 172.21.15.55:0/3956342667 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8b3009ce00 con 0x7f8b301f0a50 2023-07-06T21:58:41.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:41.643+0000 7f8b36448640 1 -- 172.21.15.55:0/3956342667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8b3009ce00 con 0x7f8b301f0a50 2023-07-06T21:58:42.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.275+0000 7f8b2cff9640 1 -- 172.21.15.55:0/3956342667 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8b3009ce00 con 0x7f8b301f0a50 2023-07-06T21:58:42.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.275+0000 7f8b36448640 1 -- 172.21.15.55:0/3956342667 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8b1c0663d0 msgr2=0x7f8b1c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:42.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.275+0000 7f8b36448640 1 --2- 172.21.15.55:0/3956342667 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8b1c0663d0 0x7f8b1c068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b300c7b80 tx=0x7f8b20009190 comp rx=0 tx=0).stop 2023-07-06T21:58:42.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.275+0000 7f8b36448640 1 -- 172.21.15.55:0/3956342667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b301f0a50 msgr2=0x7f8b300c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:42.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.275+0000 7f8b36448640 1 --2- 172.21.15.55:0/3956342667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b301f0a50 0x7f8b300c9420 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f8b24001990 tx=0x7f8b18005800 comp rx=0 tx=0).stop 2023-07-06T21:58:42.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.275+0000 7f8b36448640 1 -- 172.21.15.55:0/3956342667 shutdown_connections 2023-07-06T21:58:42.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.275+0000 7f8b36448640 1 --2- 172.21.15.55:0/3956342667 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f8b1c0663d0 0x7f8b1c068880 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.275+0000 7f8b36448640 1 --2- 172.21.15.55:0/3956342667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b300c9960 0x7f8b3006add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.275+0000 7f8b36448640 1 --2- 172.21.15.55:0/3956342667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b301f0a50 0x7f8b300c9420 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.275+0000 7f8b36448640 1 --2- 172.21.15.55:0/3956342667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b180047d0 0x7f8b301f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.275+0000 7f8b36448640 1 -- 172.21.15.55:0/3956342667 >> 172.21.15.55:0/3956342667 conn(0x7f8b300cea70 msgr2=0x7f8b300b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:42.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.275+0000 7f8b36448640 1 -- 172.21.15.55:0/3956342667 shutdown_connections 2023-07-06T21:58:42.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.275+0000 7f8b36448640 1 -- 172.21.15.55:0/3956342667 wait complete. 2023-07-06T21:58:42.296 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T21:58:42.346 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:58:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.491+0000 7fb859974640 1 Processor -- start 2023-07-06T21:58:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.491+0000 7fb859974640 1 -- start start 2023-07-06T21:58:42.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb859974640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb85415b7e0 0x7fb8540cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:42.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb859974640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb85415cbc0 0x7fb85406b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:42.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb859974640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8540cdc80 con 0x7fb854160300 2023-07-06T21:58:42.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb859974640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8540cd6c0 con 0x7fb85415b7e0 2023-07-06T21:58:42.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb859974640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8540cd9a0 con 0x7fb85415cbc0 2023-07-06T21:58:42.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb852ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb85415b7e0 0x7fb8540cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:42.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb852ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb85415b7e0 0x7fb8540cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44592/0 (socket says 172.21.15.55:44592) 2023-07-06T21:58:42.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb852ffd640 1 -- 172.21.15.55:0/1835141998 learned_addr learned my addr 172.21.15.55:0/1835141998 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:42.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb8537fe640 1 --2- 172.21.15.55:0/1835141998 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb85415cbc0 0x7fb85406b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:42.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb852ffd640 1 -- 172.21.15.55:0/1835141998 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb85415cbc0 msgr2=0x7fb85406b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:42.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb852ffd640 1 --2- 172.21.15.55:0/1835141998 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb85415cbc0 0x7fb85406b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb852ffd640 1 -- 172.21.15.55:0/1835141998 >> v1:172.21.15.138:6789/0 conn(0x7fb854160300 legacy=0x7fb8540c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:42.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb852ffd640 1 -- 172.21.15.55:0/1835141998 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb854069490 con 0x7fb85415b7e0 2023-07-06T21:58:42.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb8537fe640 1 --2- 172.21.15.55:0/1835141998 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb85415cbc0 0x7fb85406b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:42.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.495+0000 7fb852ffd640 1 --2- 172.21.15.55:0/1835141998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85415b7e0 0x7fb8540cbaa0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fb844009870 tx=0x7fb84401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa02f68ca91e352 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:42.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb8527fc640 1 -- 172.21.15.55:0/1835141998 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8440ab620 con 0x7fb85415b7e0 2023-07-06T21:58:42.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb8527fc640 1 -- 172.21.15.55:0/1835141998 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8440ab780 con 0x7fb85415b7e0 2023-07-06T21:58:42.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb8527fc640 1 -- 172.21.15.55:0/1835141998 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8440abb10 con 0x7fb85415b7e0 2023-07-06T21:58:42.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 -- 172.21.15.55:0/1835141998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85415b7e0 msgr2=0x7fb8540cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:42.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 --2- 172.21.15.55:0/1835141998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85415b7e0 0x7fb8540cbaa0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fb844009870 tx=0x7fb84401c510 comp rx=0 tx=0).stop 2023-07-06T21:58:42.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 -- 172.21.15.55:0/1835141998 shutdown_connections 2023-07-06T21:58:42.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 --2- 172.21.15.55:0/1835141998 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb85415cbc0 0x7fb85406b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 --2- 172.21.15.55:0/1835141998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85415b7e0 0x7fb8540cbaa0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 -- 172.21.15.55:0/1835141998 >> 172.21.15.55:0/1835141998 conn(0x7fb8540cded0 msgr2=0x7fb8540ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:42.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 -- 172.21.15.55:0/1835141998 shutdown_connections 2023-07-06T21:58:42.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 -- 172.21.15.55:0/1835141998 wait complete. 2023-07-06T21:58:42.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 Processor -- start 2023-07-06T21:58:42.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 -- start start 2023-07-06T21:58:42.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb85415b7e0 0x7fb8540c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:42.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb85415cbc0 0x7fb85415df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:42.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854160300 0x7fb85415e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb854153dd0 con 0x7fb854160300 2023-07-06T21:58:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb854152cb0 con 0x7fb85415b7e0 2023-07-06T21:58:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.499+0000 7fb859974640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85415eac0 con 0x7fb85415cbc0 2023-07-06T21:58:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb8537fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854160300 0x7fb85415e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb852ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb85415b7e0 0x7fb8540c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb852ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb85415b7e0 0x7fb8540c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:58546/0 (socket says 172.21.15.55:58546) 2023-07-06T21:58:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb852ffd640 1 -- 172.21.15.55:0/298060186 learned_addr learned my addr 172.21.15.55:0/298060186 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:42.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb84bfff640 1 --2- 172.21.15.55:0/298060186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb85415cbc0 0x7fb85415df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb8537fe640 1 -- 172.21.15.55:0/298060186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb85415cbc0 msgr2=0x7fb85415df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb8537fe640 1 --2- 172.21.15.55:0/298060186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb85415cbc0 0x7fb85415df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb8537fe640 1 -- 172.21.15.55:0/298060186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb85415b7e0 msgr2=0x7fb8540c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb8537fe640 1 --2- 172.21.15.55:0/298060186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb85415b7e0 0x7fb8540c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb8537fe640 1 -- 172.21.15.55:0/298060186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440094d0 con 0x7fb854160300 2023-07-06T21:58:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb852ffd640 1 --2- 172.21.15.55:0/298060186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb85415b7e0 0x7fb8540c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb8537fe640 1 --2- 172.21.15.55:0/298060186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854160300 0x7fb85415e4b0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fb84c007e60 tx=0x7fb84c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb850ff9640 1 -- 172.21.15.55:0/298060186 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c003ba0 con 0x7fb854160300 2023-07-06T21:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb850ff9640 1 -- 172.21.15.55:0/298060186 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c00f040 con 0x7fb854160300 2023-07-06T21:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb850ff9640 1 -- 172.21.15.55:0/298060186 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00de80 con 0x7fb854160300 2023-07-06T21:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb859974640 1 -- 172.21.15.55:0/298060186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85415eda0 con 0x7fb854160300 2023-07-06T21:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb859974640 1 -- 172.21.15.55:0/298060186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85415f080 con 0x7fb854160300 2023-07-06T21:58:42.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb859974640 1 -- 172.21.15.55:0/298060186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8541538c0 con 0x7fb854160300 2023-07-06T21:58:42.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.503+0000 7fb850ff9640 1 -- 172.21.15.55:0/298060186 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb84c004030 con 0x7fb854160300 2023-07-06T21:58:42.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.507+0000 7fb850ff9640 1 --2- 172.21.15.55:0/298060186 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8340663a0 0x7fb834068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:42.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.507+0000 7fb850ff9640 1 -- 172.21.15.55:0/298060186 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb84c0843a0 con 0x7fb854160300 2023-07-06T21:58:42.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.507+0000 7fb852ffd640 1 --2- 172.21.15.55:0/298060186 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8340663a0 0x7fb834068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:42.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.507+0000 7fb852ffd640 1 --2- 172.21.15.55:0/298060186 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8340663a0 0x7fb834068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb84401c550 tx=0x7fb8440b6040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:42.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.507+0000 7fb850ff9640 1 -- 172.21.15.55:0/298060186 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb8541538c0 con 0x7fb854160300 2023-07-06T21:58:42.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.699+0000 7fb859974640 1 -- 172.21.15.55:0/298060186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8541538c0 con 0x7fb854160300 2023-07-06T21:58:42.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.699+0000 7fb850ff9640 1 -- 172.21.15.55:0/298060186 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4673 (secure 0 0 0) 0x7fb8541538c0 con 0x7fb854160300 2023-07-06T21:58:42.700 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:42.700 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4122510097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4122510097},{"type":"v1","addr":"172.21.15.138:6835","nonce":4122510097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/154452928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":154452928},{"type":"v1","addr":"172.21.15.55:6836","nonce":154452928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8037,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/414200688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":414200688},{"type":"v1","addr":"172.21.15.55:6837","nonce":414200688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:58:39.245889+0000","modified":"2023-07-06T21:58:42.261872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8049},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8049":{"gid":8049,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6833/1552399486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1552399486},{"type":"v1","addr":"172.21.15.138:6833","nonce":1552399486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-06T21:58:42.700 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 47 2023-07-06T21:58:42.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.703+0000 7fb859974640 1 -- 172.21.15.55:0/298060186 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8340663a0 msgr2=0x7fb834068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:42.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.703+0000 7fb859974640 1 --2- 172.21.15.55:0/298060186 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8340663a0 0x7fb834068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb84401c550 tx=0x7fb8440b6040 comp rx=0 tx=0).stop 2023-07-06T21:58:42.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.703+0000 7fb859974640 1 -- 172.21.15.55:0/298060186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854160300 msgr2=0x7fb85415e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:42.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.703+0000 7fb859974640 1 --2- 172.21.15.55:0/298060186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854160300 0x7fb85415e4b0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fb84c007e60 tx=0x7fb84c00d4a0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.703+0000 7fb859974640 1 -- 172.21.15.55:0/298060186 shutdown_connections 2023-07-06T21:58:42.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.703+0000 7fb859974640 1 --2- 172.21.15.55:0/298060186 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8340663a0 0x7fb834068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.703+0000 7fb859974640 1 --2- 172.21.15.55:0/298060186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854160300 0x7fb85415e4b0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.703+0000 7fb859974640 1 --2- 172.21.15.55:0/298060186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb85415cbc0 0x7fb85415df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.703+0000 7fb859974640 1 --2- 172.21.15.55:0/298060186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb85415b7e0 0x7fb8540c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.703+0000 7fb859974640 1 -- 172.21.15.55:0/298060186 >> 172.21.15.55:0/298060186 conn(0x7fb8540cded0 msgr2=0x7fb8540c8500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:42.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.703+0000 7fb859974640 1 -- 172.21.15.55:0/298060186 shutdown_connections 2023-07-06T21:58:42.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.703+0000 7fb859974640 1 -- 172.21.15.55:0/298060186 wait complete. 2023-07-06T21:58:42.721 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:58:42.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.863+0000 7fb18392c640 1 Processor -- start 2023-07-06T21:58:42.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.867+0000 7fb18392c640 1 -- start start 2023-07-06T21:58:42.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.867+0000 7fb18392c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb17c15ca30 0x7fb17c06c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:42.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.867+0000 7fb18392c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb17c06c920 0x7fb17c158c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:42.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.867+0000 7fb18392c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c070fd0 con 0x7fb17c06af90 2023-07-06T21:58:42.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.867+0000 7fb18392c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c070bb0 con 0x7fb17c06c920 2023-07-06T21:58:42.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.867+0000 7fb18392c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0c9e00 con 0x7fb17c15ca30 2023-07-06T21:58:42.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.867+0000 7fb181ec9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb17c06c920 0x7fb17c158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:42.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.867+0000 7fb180ec7640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb17c15ca30 0x7fb17c06c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:42.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.867+0000 7fb181ec9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb17c06c920 0x7fb17c158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:58550/0 (socket says 172.21.15.55:58550) 2023-07-06T21:58:42.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.867+0000 7fb181ec9640 1 -- 172.21.15.55:0/1783976298 learned_addr learned my addr 172.21.15.55:0/1783976298 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:42.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.867+0000 7fb181ec9640 1 -- 172.21.15.55:0/1783976298 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb17c15ca30 msgr2=0x7fb17c06c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.867+0000 7fb181ec9640 1 --2- 172.21.15.55:0/1783976298 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb17c15ca30 0x7fb17c06c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.867+0000 7fb181ec9640 1 -- 172.21.15.55:0/1783976298 >> v1:172.21.15.138:6789/0 conn(0x7fb17c06af90 legacy=0x7fb17c0c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:42.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.867+0000 7fb181ec9640 1 -- 172.21.15.55:0/1783976298 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c06cd60 con 0x7fb17c06c920 2023-07-06T21:58:42.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.871+0000 7fb181ec9640 1 --2- 172.21.15.55:0/1783976298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb17c06c920 0x7fb17c158c20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb174009e50 tx=0x7fb17401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=402812f78d4b6a73 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.871+0000 7fb173fff640 1 -- 172.21.15.55:0/1783976298 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740a55c0 con 0x7fb17c06c920 2023-07-06T21:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.871+0000 7fb173fff640 1 -- 172.21.15.55:0/1783976298 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1740a5720 con 0x7fb17c06c920 2023-07-06T21:58:42.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.871+0000 7fb173fff640 1 -- 172.21.15.55:0/1783976298 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740a5ab0 con 0x7fb17c06c920 2023-07-06T21:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.871+0000 7fb18392c640 1 -- 172.21.15.55:0/1783976298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb17c06c920 msgr2=0x7fb17c158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.871+0000 7fb18392c640 1 --2- 172.21.15.55:0/1783976298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb17c06c920 0x7fb17c158c20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb174009e50 tx=0x7fb17401c940 comp rx=0 tx=0).stop 2023-07-06T21:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.871+0000 7fb18392c640 1 -- 172.21.15.55:0/1783976298 shutdown_connections 2023-07-06T21:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.871+0000 7fb18392c640 1 --2- 172.21.15.55:0/1783976298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb17c06c920 0x7fb17c158c20 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.871+0000 7fb18392c640 1 --2- 172.21.15.55:0/1783976298 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb17c15ca30 0x7fb17c06c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.871+0000 7fb18392c640 1 -- 172.21.15.55:0/1783976298 >> 172.21.15.55:0/1783976298 conn(0x7fb17c0cfc60 msgr2=0x7fb17c0cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.871+0000 7fb18392c640 1 -- 172.21.15.55:0/1783976298 shutdown_connections 2023-07-06T21:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.871+0000 7fb18392c640 1 -- 172.21.15.55:0/1783976298 wait complete. 2023-07-06T21:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb18392c640 1 Processor -- start 2023-07-06T21:58:42.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb18392c640 1 -- start start 2023-07-06T21:58:42.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb18392c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb17c06af90 0x7fb17c0c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb18392c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb17c06c920 0x7fb17c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb18392c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb17c15ca30 0x7fb17c152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb18392c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0b24c0 con 0x7fb17c15ca30 2023-07-06T21:58:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb18392c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0cd520 con 0x7fb17c06af90 2023-07-06T21:58:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb18392c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0cd800 con 0x7fb17c06c920 2023-07-06T21:58:42.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb181ec9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb17c15ca30 0x7fb17c152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:42.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb181ec9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb17c15ca30 0x7fb17c152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44602/0 (socket says 172.21.15.55:44602) 2023-07-06T21:58:42.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb181ec9640 1 -- 172.21.15.55:0/272588845 learned_addr learned my addr 172.21.15.55:0/272588845 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:42.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb1816c8640 1 --2- 172.21.15.55:0/272588845 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb17c06af90 0x7fb17c0c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:42.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb180ec7640 1 --2- 172.21.15.55:0/272588845 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb17c06c920 0x7fb17c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:42.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb181ec9640 1 -- 172.21.15.55:0/272588845 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb17c06c920 msgr2=0x7fb17c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:42.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb181ec9640 1 --2- 172.21.15.55:0/272588845 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb17c06c920 0x7fb17c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb181ec9640 1 -- 172.21.15.55:0/272588845 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb17c06af90 msgr2=0x7fb17c0c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:42.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb181ec9640 1 --2- 172.21.15.55:0/272588845 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb17c06af90 0x7fb17c0c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:42.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb181ec9640 1 -- 172.21.15.55:0/272588845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb174009b30 con 0x7fb17c15ca30 2023-07-06T21:58:42.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb181ec9640 1 --2- 172.21.15.55:0/272588845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb17c15ca30 0x7fb17c152e20 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fb1740af040 tx=0x7fb1740196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:42.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb171ffb640 1 -- 172.21.15.55:0/272588845 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740a55c0 con 0x7fb17c15ca30 2023-07-06T21:58:42.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb171ffb640 1 -- 172.21.15.55:0/272588845 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1740b8670 con 0x7fb17c15ca30 2023-07-06T21:58:42.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb171ffb640 1 -- 172.21.15.55:0/272588845 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740b8a20 con 0x7fb17c15ca30 2023-07-06T21:58:42.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb18392c640 1 -- 172.21.15.55:0/272588845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c0b1e00 con 0x7fb17c15ca30 2023-07-06T21:58:42.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb18392c640 1 -- 172.21.15.55:0/272588845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c0cd140 con 0x7fb17c15ca30 2023-07-06T21:58:42.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.875+0000 7fb18392c640 1 -- 172.21.15.55:0/272588845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c0cd2d0 con 0x7fb17c15ca30 2023-07-06T21:58:42.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.879+0000 7fb171ffb640 1 -- 172.21.15.55:0/272588845 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb1740b8b80 con 0x7fb17c15ca30 2023-07-06T21:58:42.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.879+0000 7fb171ffb640 1 --2- 172.21.15.55:0/272588845 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb1600663a0 0x7fb160068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:42.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.879+0000 7fb171ffb640 1 -- 172.21.15.55:0/272588845 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb17411f4c0 con 0x7fb17c15ca30 2023-07-06T21:58:42.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.879+0000 7fb1816c8640 1 --2- 172.21.15.55:0/272588845 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb1600663a0 0x7fb160068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:42.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.879+0000 7fb1816c8640 1 --2- 172.21.15.55:0/272588845 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb1600663a0 0x7fb160068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb17c150ae0 tx=0x7fb178009040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:42.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:42.883+0000 7fb171ffb640 1 -- 172.21.15.55:0/272588845 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1740ec770 con 0x7fb17c15ca30 2023-07-06T21:58:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.039+0000 7fb18392c640 1 -- 172.21.15.55:0/272588845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb17c066d60 con 0x7fb17c15ca30 2023-07-06T21:58:43.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.039+0000 7fb171ffb640 1 -- 172.21.15.55:0/272588845 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+18494 (secure 0 0 0) 0x7fb174009510 con 0x7fb17c15ca30 2023-07-06T21:58:43.038 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:43.039 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":117,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:58:40.248643+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:58:37.143680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-07-06T21:58:38.234438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:58:43.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.039+0000 7fb18392c640 1 -- 172.21.15.55:0/272588845 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb1600663a0 msgr2=0x7fb160068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.039+0000 7fb18392c640 1 --2- 172.21.15.55:0/272588845 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb1600663a0 0x7fb160068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb17c150ae0 tx=0x7fb178009040 comp rx=0 tx=0).stop 2023-07-06T21:58:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.039+0000 7fb18392c640 1 -- 172.21.15.55:0/272588845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb17c15ca30 msgr2=0x7fb17c152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.039+0000 7fb18392c640 1 --2- 172.21.15.55:0/272588845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb17c15ca30 0x7fb17c152e20 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fb1740af040 tx=0x7fb1740196e0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.043+0000 7fb18392c640 1 -- 172.21.15.55:0/272588845 shutdown_connections 2023-07-06T21:58:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.043+0000 7fb18392c640 1 --2- 172.21.15.55:0/272588845 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb1600663a0 0x7fb160068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.043+0000 7fb18392c640 1 --2- 172.21.15.55:0/272588845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb17c15ca30 0x7fb17c152e20 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.043+0000 7fb18392c640 1 --2- 172.21.15.55:0/272588845 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb17c06c920 0x7fb17c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.043+0000 7fb18392c640 1 --2- 172.21.15.55:0/272588845 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb17c06af90 0x7fb17c0c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.043+0000 7fb18392c640 1 -- 172.21.15.55:0/272588845 >> 172.21.15.55:0/272588845 conn(0x7fb17c0cfc60 msgr2=0x7fb17c150ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.043+0000 7fb18392c640 1 -- 172.21.15.55:0/272588845 shutdown_connections 2023-07-06T21:58:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.043+0000 7fb18392c640 1 -- 172.21.15.55:0/272588845 wait complete. 2023-07-06T21:58:43.059 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T21:58:43.060 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:58:43.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.203+0000 7fb19ae6d640 1 Processor -- start 2023-07-06T21:58:43.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.203+0000 7fb19ae6d640 1 -- start start 2023-07-06T21:58:43.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.203+0000 7fb19ae6d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb19406a400 0x7fb1940ca820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.203+0000 7fb19ae6d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1940ccbc0 con 0x7fb19415ef20 2023-07-06T21:58:43.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.203+0000 7fb19ae6d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1940cbfb0 con 0x7fb19406bcc0 2023-07-06T21:58:43.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.203+0000 7fb19ae6d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940cc290 con 0x7fb19406a400 2023-07-06T21:58:43.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.203+0000 7fb198c09640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb19415ef20 0x7fb19406b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33964/0 (socket says 172.21.15.55:33964) 2023-07-06T21:58:43.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.203+0000 7fb198c09640 1 -- 172.21.15.55:0/1449308376 learned_addr learned my addr 172.21.15.55:0/1449308376 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.207+0000 7fb19940a640 1 --2- 172.21.15.55:0/1449308376 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb19406a400 0x7fb1940ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.207+0000 7fb1937fe640 1 -- 172.21.15.55:0/1449308376 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489621210 0 0) 0x7fb1940ccbc0 con 0x7fb19415ef20 2023-07-06T21:58:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.207+0000 7fb1937fe640 1 -- 172.21.15.55:0/1449308376 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb184003530 con 0x7fb19415ef20 2023-07-06T21:58:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.207+0000 7fb1937fe640 1 -- 172.21.15.55:0/1449308376 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921706921 0 0) 0x7fb1940cbfb0 con 0x7fb19406bcc0 2023-07-06T21:58:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.207+0000 7fb1937fe640 1 -- 172.21.15.55:0/1449308376 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1940ccbc0 con 0x7fb19406bcc0 2023-07-06T21:58:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.207+0000 7fb19940a640 1 -- 172.21.15.55:0/1449308376 >> v1:172.21.15.138:6789/0 conn(0x7fb19406bcc0 legacy=0x7fb1940ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.207+0000 7fb19940a640 1 -- 172.21.15.55:0/1449308376 >> v1:172.21.15.55:6789/0 conn(0x7fb19415ef20 legacy=0x7fb19406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.207+0000 7fb1937fe640 1 -- 172.21.15.55:0/1449308376 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1748974010 0 0) 0x7fb184003530 con 0x7fb19415ef20 2023-07-06T21:58:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.207+0000 7fb19940a640 1 -- 172.21.15.55:0/1449308376 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1940cc570 con 0x7fb19406a400 2023-07-06T21:58:43.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.207+0000 7fb19940a640 1 --2- 172.21.15.55:0/1449308376 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb19406a400 0x7fb1940ca820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009dc0 tx=0x7fb18c01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf58bc50d8074797 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:43.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.207+0000 7fb1937fe640 1 -- 172.21.15.55:0/1449308376 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188001680 con 0x7fb19406a400 2023-07-06T21:58:43.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb1937fe640 1 -- 172.21.15.55:0/1449308376 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c0a55e0 con 0x7fb19406a400 2023-07-06T21:58:43.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb1937fe640 1 -- 172.21.15.55:0/1449308376 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0a5970 con 0x7fb19406a400 2023-07-06T21:58:43.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 -- 172.21.15.55:0/1449308376 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb19406a400 msgr2=0x7fb1940ca820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 --2- 172.21.15.55:0/1449308376 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb19406a400 0x7fb1940ca820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009dc0 tx=0x7fb18c01c890 comp rx=0 tx=0).stop 2023-07-06T21:58:43.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 -- 172.21.15.55:0/1449308376 shutdown_connections 2023-07-06T21:58:43.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 --2- 172.21.15.55:0/1449308376 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb19406a400 0x7fb1940ca820 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 -- 172.21.15.55:0/1449308376 >> 172.21.15.55:0/1449308376 conn(0x7fb1940ce340 msgr2=0x7fb1940ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:43.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 -- 172.21.15.55:0/1449308376 shutdown_connections 2023-07-06T21:58:43.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 -- 172.21.15.55:0/1449308376 wait complete. 2023-07-06T21:58:43.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 Processor -- start 2023-07-06T21:58:43.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 -- start start 2023-07-06T21:58:43.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19406a400 0x7fb194155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb19406bcc0 0x7fb1941470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb19415ef20 0x7fb1940c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940c2a40 con 0x7fb19415ef20 2023-07-06T21:58:43.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1941563c0 con 0x7fb19406a400 2023-07-06T21:58:43.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19ae6d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb194147620 con 0x7fb19406bcc0 2023-07-06T21:58:43.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19940a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb19415ef20 0x7fb1940c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19940a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb19415ef20 0x7fb1940c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44610/0 (socket says 172.21.15.55:44610) 2023-07-06T21:58:43.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb19940a640 1 -- 172.21.15.55:0/3539759263 learned_addr learned my addr 172.21.15.55:0/3539759263 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:43.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb198c09640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19406a400 0x7fb194155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.211+0000 7fb193fff640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb19406bcc0 0x7fb1941470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb19940a640 1 -- 172.21.15.55:0/3539759263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb19406bcc0 msgr2=0x7fb1941470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb19940a640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb19406bcc0 0x7fb1941470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb19940a640 1 -- 172.21.15.55:0/3539759263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19406a400 msgr2=0x7fb194155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb19940a640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19406a400 0x7fb194155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb19940a640 1 -- 172.21.15.55:0/3539759263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c009a70 con 0x7fb19415ef20 2023-07-06T21:58:43.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb193fff640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb19406bcc0 0x7fb1941470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:43.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb19940a640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb19415ef20 0x7fb1940c4690 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0b0040 tx=0x7fb18c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:43.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb1917fa640 1 -- 172.21.15.55:0/3539759263 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c003ba0 con 0x7fb19415ef20 2023-07-06T21:58:43.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb1917fa640 1 -- 172.21.15.55:0/3539759263 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c003d20 con 0x7fb19415ef20 2023-07-06T21:58:43.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb1917fa640 1 -- 172.21.15.55:0/3539759263 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c004270 con 0x7fb19415ef20 2023-07-06T21:58:43.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb19ae6d640 1 -- 172.21.15.55:0/3539759263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1940c21a0 con 0x7fb19415ef20 2023-07-06T21:58:43.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb19ae6d640 1 -- 172.21.15.55:0/3539759263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1940c2760 con 0x7fb19415ef20 2023-07-06T21:58:43.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb19ae6d640 1 -- 172.21.15.55:0/3539759263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1940c8f70 con 0x7fb19415ef20 2023-07-06T21:58:43.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb1917fa640 1 -- 172.21.15.55:0/3539759263 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb18c0b4050 con 0x7fb19415ef20 2023-07-06T21:58:43.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb1917fa640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb1780663a0 0x7fb178068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb1917fa640 1 -- 172.21.15.55:0/3539759263 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb18c11efb0 con 0x7fb19415ef20 2023-07-06T21:58:43.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.215+0000 7fb198c09640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb1780663a0 0x7fb178068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.219+0000 7fb198c09640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb1780663a0 0x7fb178068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb188000f70 tx=0x7fb1880016c0 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:43.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.219+0000 7fb1917fa640 1 -- 172.21.15.55:0/3539759263 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb18c0ec320 con 0x7fb19415ef20 2023-07-06T21:58:43.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.375+0000 7fb19ae6d640 1 -- 172.21.15.55:0/3539759263 --> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb1940adcd0 con 0x7fb1780663a0 2023-07-06T21:58:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.383+0000 7fb1917fa640 1 -- 172.21.15.55:0/3539759263 <== mgr.7782 v2:172.21.15.55:6832/1408736549 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299661 (secure 0 0 0) 0x7fb1940adcd0 con 0x7fb1780663a0 2023-07-06T21:58:43.385 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:58:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.387+0000 7fb19ae6d640 1 -- 172.21.15.55:0/3539759263 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb1780663a0 msgr2=0x7fb178068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.387+0000 7fb19ae6d640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb1780663a0 0x7fb178068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb188000f70 tx=0x7fb1880016c0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.387+0000 7fb19ae6d640 1 -- 172.21.15.55:0/3539759263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb19415ef20 msgr2=0x7fb1940c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.387+0000 7fb19ae6d640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb19415ef20 0x7fb1940c4690 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0b0040 tx=0x7fb18c019630 comp rx=0 tx=0).stop 2023-07-06T21:58:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.387+0000 7fb19ae6d640 1 -- 172.21.15.55:0/3539759263 shutdown_connections 2023-07-06T21:58:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.387+0000 7fb19ae6d640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb1780663a0 0x7fb178068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.387+0000 7fb19ae6d640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb19415ef20 0x7fb1940c4690 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.387+0000 7fb19ae6d640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb19406bcc0 0x7fb1941470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.387+0000 7fb19ae6d640 1 --2- 172.21.15.55:0/3539759263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19406a400 0x7fb194155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.387+0000 7fb19ae6d640 1 -- 172.21.15.55:0/3539759263 >> 172.21.15.55:0/3539759263 conn(0x7fb1940ce340 msgr2=0x7fb1940cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.387+0000 7fb19ae6d640 1 -- 172.21.15.55:0/3539759263 shutdown_connections 2023-07-06T21:58:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.387+0000 7fb19ae6d640 1 -- 172.21.15.55:0/3539759263 wait complete. 2023-07-06T21:58:43.405 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T21:58:42.738442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307220,"kb_used_data":12116,"kb_used_omap":0,"kb_used_meta":295040,"kb_avail":754667500,"statfs":{"total":773094113280,"available":772779520000,"internally_reserved":0,"allocated":12406784,"data_stored":7090648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":302120960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.912641"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.835709+0000","last_change":"2023-07-06T21:58:37.835709+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.835709+0000","last_undegraded":"2023-07-06T21:58:37.835709+0000","last_fullsized":"2023-07-06T21:58:37.835709+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827967+0000","last_change":"2023-07-06T21:58:37.827967+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827967+0000","last_undegraded":"2023-07-06T21:58:37.827967+0000","last_fullsized":"2023-07-06T21:58:37.827967+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.834699+0000","last_change":"2023-07-06T21:58:37.834699+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.834699+0000","last_undegraded":"2023-07-06T21:58:37.834699+0000","last_fullsized":"2023-07-06T21:58:37.834699+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833844+0000","last_change":"2023-07-06T21:58:37.833844+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833844+0000","last_undegraded":"2023-07-06T21:58:37.833844+0000","last_fullsized":"2023-07-06T21:58:37.833844+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.834291+0000","last_change":"2023-07-06T21:58:37.834291+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.834291+0000","last_undegraded":"2023-07-06T21:58:37.834291+0000","last_fullsized":"2023-07-06T21:58:37.834291+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.835339+0000","last_change":"2023-07-06T21:58:37.835339+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.835339+0000","last_undegraded":"2023-07-06T21:58:37.835339+0000","last_fullsized":"2023-07-06T21:58:37.835339+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.830974+0000","last_change":"2023-07-06T21:58:37.830974+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.830974+0000","last_undegraded":"2023-07-06T21:58:37.830974+0000","last_fullsized":"2023-07-06T21:58:37.830974+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833190+0000","last_change":"2023-07-06T21:58:37.833190+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833190+0000","last_undegraded":"2023-07-06T21:58:37.833190+0000","last_fullsized":"2023-07-06T21:58:37.833190+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.832771+0000","last_change":"2023-07-06T21:58:37.832771+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.832771+0000","last_undegraded":"2023-07-06T21:58:37.832771+0000","last_fullsized":"2023-07-06T21:58:37.832771+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.830870+0000","last_change":"2023-07-06T21:58:37.830870+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.830870+0000","last_undegraded":"2023-07-06T21:58:37.830870+0000","last_fullsized":"2023-07-06T21:58:37.830870+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827932+0000","last_change":"2023-07-06T21:58:37.827932+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827932+0000","last_undegraded":"2023-07-06T21:58:37.827932+0000","last_fullsized":"2023-07-06T21:58:37.827932+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827580+0000","last_change":"2023-07-06T21:58:37.827580+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827580+0000","last_undegraded":"2023-07-06T21:58:37.827580+0000","last_fullsized":"2023-07-06T21:58:37.827580+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.829155+0000","last_change":"2023-07-06T21:58:37.829155+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.829155+0000","last_undegraded":"2023-07-06T21:58:37.829155+0000","last_fullsized":"2023-07-06T21:58:37.829155+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.829131+0000","last_change":"2023-07-06T21:58:37.829131+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.829131+0000","last_undegraded":"2023-07-06T21:58:37.829131+0000","last_fullsized":"2023-07-06T21:58:37.829131+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827613+0000","last_change":"2023-07-06T21:58:37.827613+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827613+0000","last_undegraded":"2023-07-06T21:58:37.827613+0000","last_fullsized":"2023-07-06T21:58:37.827613+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.832694+0000","last_change":"2023-07-06T21:58:37.832694+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.832694+0000","last_undegraded":"2023-07-06T21:58:37.832694+0000","last_fullsized":"2023-07-06T21:58:37.832694+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833521+0000","last_change":"2023-07-06T21:58:37.833521+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833521+0000","last_undegraded":"2023-07-06T21:58:37.833521+0000","last_fullsized":"2023-07-06T21:58:37.833521+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.834437+0000","last_change":"2023-07-06T21:58:37.834437+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.834437+0000","last_undegraded":"2023-07-06T21:58:37.834437+0000","last_fullsized":"2023-07-06T21:58:37.834437+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.834168+0000","last_change":"2023-07-06T21:58:37.834168+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.834168+0000","last_undegraded":"2023-07-06T21:58:37.834168+0000","last_fullsized":"2023-07-06T21:58:37.834168+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.831111+0000","last_change":"2023-07-06T21:58:37.831111+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.831111+0000","last_undegraded":"2023-07-06T21:58:37.831111+0000","last_fullsized":"2023-07-06T21:58:37.831111+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833063+0000","last_change":"2023-07-06T21:58:37.833063+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833063+0000","last_undegraded":"2023-07-06T21:58:37.833063+0000","last_fullsized":"2023-07-06T21:58:37.833063+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.831014+0000","last_change":"2023-07-06T21:58:37.831014+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.831014+0000","last_undegraded":"2023-07-06T21:58:37.831014+0000","last_fullsized":"2023-07-06T21:58:37.831014+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.830935+0000","last_change":"2023-07-06T21:58:37.830935+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.830935+0000","last_undegraded":"2023-07-06T21:58:37.830935+0000","last_fullsized":"2023-07-06T21:58:37.830935+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.829100+0000","last_change":"2023-07-06T21:58:37.829100+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.829100+0000","last_undegraded":"2023-07-06T21:58:37.829100+0000","last_fullsized":"2023-07-06T21:58:37.829100+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827964+0000","last_change":"2023-07-06T21:58:37.827964+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827964+0000","last_undegraded":"2023-07-06T21:58:37.827964+0000","last_fullsized":"2023-07-06T21:58:37.827964+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"105'205","reported_seq":669,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.828832+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:58:37.828832+0000","last_peered":"2023-07-06T21:58:37.828832+0000","last_clean":"2023-07-06T21:58:37.828832+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:58:37.828832+0000","last_undegraded":"2023-07-06T21:58:37.828832+0000","last_fullsized":"2023-07-06T21:58:37.828832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:18:55.182825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":178,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.834212+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:58:37.834212+0000","last_peered":"2023-07-06T21:58:37.834212+0000","last_clean":"2023-07-06T21:58:37.834212+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:58:37.834212+0000","last_undegraded":"2023-07-06T21:58:37.834212+0000","last_fullsized":"2023-07-06T21:58:37.834212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:59.906001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833328+0000","last_change":"2023-07-06T21:58:37.833328+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833328+0000","last_undegraded":"2023-07-06T21:58:37.833328+0000","last_fullsized":"2023-07-06T21:58:37.833328+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":201,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.828588+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:58:37.828588+0000","last_peered":"2023-07-06T21:58:37.828588+0000","last_clean":"2023-07-06T21:58:37.828588+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:58:37.828588+0000","last_undegraded":"2023-07-06T21:58:37.828588+0000","last_fullsized":"2023-07-06T21:58:37.828588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:25:38.821167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.831092+0000","last_change":"2023-07-06T21:58:37.831092+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.831092+0000","last_undegraded":"2023-07-06T21:58:37.831092+0000","last_fullsized":"2023-07-06T21:58:37.831092+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.827742+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:58:37.827742+0000","last_peered":"2023-07-06T21:58:37.827742+0000","last_clean":"2023-07-06T21:58:37.827742+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:58:37.827742+0000","last_undegraded":"2023-07-06T21:58:37.827742+0000","last_fullsized":"2023-07-06T21:58:37.827742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:30:13.273850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827580+0000","last_change":"2023-07-06T21:58:37.827580+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827580+0000","last_undegraded":"2023-07-06T21:58:37.827580+0000","last_fullsized":"2023-07-06T21:58:37.827580+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":178,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.834360+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:58:37.834360+0000","last_peered":"2023-07-06T21:58:37.834360+0000","last_clean":"2023-07-06T21:58:37.834360+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:58:37.834360+0000","last_undegraded":"2023-07-06T21:58:37.834360+0000","last_fullsized":"2023-07-06T21:58:37.834360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:18:04.883605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833003+0000","last_change":"2023-07-06T21:58:37.833003+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833003+0000","last_undegraded":"2023-07-06T21:58:37.833003+0000","last_fullsized":"2023-07-06T21:58:37.833003+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.836030+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:58:37.836030+0000","last_peered":"2023-07-06T21:58:37.836030+0000","last_clean":"2023-07-06T21:58:37.836030+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:58:37.836030+0000","last_undegraded":"2023-07-06T21:58:37.836030+0000","last_fullsized":"2023-07-06T21:58:37.836030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:10:38.369138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833494+0000","last_change":"2023-07-06T21:58:37.833494+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833494+0000","last_undegraded":"2023-07-06T21:58:37.833494+0000","last_fullsized":"2023-07-06T21:58:37.833494+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":200,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.828925+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:58:37.828925+0000","last_peered":"2023-07-06T21:58:37.828925+0000","last_clean":"2023-07-06T21:58:37.828925+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:58:37.828925+0000","last_undegraded":"2023-07-06T21:58:37.828925+0000","last_fullsized":"2023-07-06T21:58:37.828925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:37:40.103705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833545+0000","last_change":"2023-07-06T21:58:37.833545+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833545+0000","last_undegraded":"2023-07-06T21:58:37.833545+0000","last_fullsized":"2023-07-06T21:58:37.833545+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.836132+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:58:37.836132+0000","last_peered":"2023-07-06T21:58:37.836132+0000","last_clean":"2023-07-06T21:58:37.836132+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:58:37.836132+0000","last_undegraded":"2023-07-06T21:58:37.836132+0000","last_fullsized":"2023-07-06T21:58:37.836132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:12:40.805057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833584+0000","last_change":"2023-07-06T21:58:37.833584+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833584+0000","last_undegraded":"2023-07-06T21:58:37.833584+0000","last_fullsized":"2023-07-06T21:58:37.833584+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.832305+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:58:37.832305+0000","last_peered":"2023-07-06T21:58:37.832305+0000","last_clean":"2023-07-06T21:58:37.832305+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:58:37.832305+0000","last_undegraded":"2023-07-06T21:58:37.832305+0000","last_fullsized":"2023-07-06T21:58:37.832305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:21:51.006452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575048,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1998848,"data_stored":1330173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.441,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68300000000000005,"15min":0.70199999999999996},"min":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.71299999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69499999999999995,"15min":0.71499999999999997},"min":{"1min":0.45300000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.746}]},{"osd":2,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.42799999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.42599999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.71699999999999997},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71599999999999997,"15min":0.73899999999999999},"min":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.77400000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.41799999999999998,"5min":0.376,"15min":0.35599999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.876},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.61299999999999999},"min":{"1min":0.47399999999999998,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.90200000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.69399999999999995,"15min":0.70299999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.92600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575048,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36512,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335328,"statfs":{"total":96636764160,"available":96599375872,"internally_reserved":0,"allocated":1400832,"data_stored":738786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68300000000000005,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.81799999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.71199999999999997},"min":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.41599999999999998},"max":{"1min":0.76900000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.627},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93100000000000005,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.497}]},{"osd":3,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.74299999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.45800000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70299999999999996,"15min":0.72499999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.498},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":1.0629999999999999},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57599999999999996,"15min":0.56499999999999995},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78100000000000003,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91300000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60899999999999999,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86599999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.56000000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96299999999999997,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94999999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.53400000000000003,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.86399999999999999,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575047,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36516,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335324,"statfs":{"total":96636764160,"available":96599371776,"internally_reserved":0,"allocated":1404928,"data_stored":739805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.44800000000000001,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.87,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.69699999999999995,"15min":0.71799999999999997},"min":{"1min":0.45400000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85699999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.71399999999999997},"min":{"1min":0.52000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88500000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.46100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82199999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.82099999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.73499999999999999},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86199999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.873,"5min":1.0309999999999999,"15min":1.0369999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70899999999999996,"15min":0.74299999999999999},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72999999999999998,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83599999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.879}]},{"osd":4,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.41299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.874,"5min":0.91800000000000004,"15min":1.02},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85499999999999998,"5min":0.86899999999999999,"15min":1.004},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82099999999999995,"5min":0.83599999999999997,"15min":0.95699999999999996},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.93200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575046,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1392640,"data_stored":733315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.39400000000000002},"max":{"1min":0.84399999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69799999999999995,"15min":0.71399999999999997},"min":{"1min":0.49099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93899999999999995,"5min":1.123,"15min":1.123},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.71699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86799999999999999,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.626,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.45000000000000001,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":0.91500000000000004,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69999999999999996,"15min":0.71599999999999997},"min":{"1min":0.48599999999999999,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":0.92300000000000004,"5min":0.94599999999999995,"15min":1.1299999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.98899999999999999},"last":0.873}]},{"osd":3,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70899999999999996,"15min":0.72399999999999998},"min":{"1min":0.46700000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92000000000000004,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.49299999999999999},"max":{"1min":0.89300000000000002,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.308},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.94299999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.439,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.82699999999999996,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.624,"15min":0.59899999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89300000000000002,"5min":1.036,"15min":1.036},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.34799999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67400000000000004,"15min":0.65200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98199999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.442,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.01},"last":0.624}]}]},{"osd":3,"up_from":13,"seq":55834575047,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1404928,"data_stored":739805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.85499999999999998,"15min":1.0489999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.67800000000000005,"5min":2.77,"15min":2.77},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.503,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.309,"15min":0.24299999999999999},"max":{"1min":0.77600000000000002,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":1.351,"15min":1.9590000000000001},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":0.73999999999999999,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":2.012},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":0.97299999999999998,"5min":1.1930000000000001,"15min":1.855},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0109999999999999,"5min":1.383,"15min":1.524},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80300000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.44800000000000001},"max":{"1min":1.0700000000000001,"5min":1.327,"15min":1.883},"last":0.63}]},{"osd":6,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.46600000000000003,"15min":0.40000000000000002},"max":{"1min":1.129,"5min":1.425,"15min":1.425},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.81399999999999995,"15min":0.80700000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47899999999999998},"max":{"1min":1.097,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.51000000000000001,"5min":0.5,"15min":0.497},"max":{"1min":1.004,"5min":3.097,"15min":3.097},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.81100000000000005},"min":{"1min":0.54500000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.1140000000000001,"15min":1.9830000000000001},"last":0.745}]}]},{"osd":2,"up_from":13,"seq":55834575047,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36516,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335324,"statfs":{"total":96636764160,"available":96599371776,"internally_reserved":0,"allocated":1404928,"data_stored":739805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.28199999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52700000000000002,"5min":0.81699999999999995,"15min":0.85999999999999999},"last":0.443},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48299999999999998,"15min":0.497},"min":{"1min":0.26000000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.60299999999999998,"5min":0.84399999999999997,"15min":0.85999999999999999},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.63900000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83499999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.504},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63400000000000001,"5min":0.72399999999999998,"15min":0.76500000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.61299999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.47999999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.091,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.53100000000000003,"5min":0.47499999999999998,"15min":0.41399999999999998},"max":{"1min":1.1000000000000001,"5min":1.591,"15min":1.591},"last":0.879}]},{"osd":5,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.52200000000000002,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.139,"5min":1.333,"15min":1.333},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79100000000000004,"15min":0.81000000000000005},"min":{"1min":0.53800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0169999999999999,"5min":1.327,"15min":1.327},"last":0.80500000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.466,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.0509999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.872}]},{"osd":7,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.54100000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.135,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.83499999999999996},"min":{"1min":0.54800000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.85199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575048,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58660,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313180,"statfs":{"total":96636764160,"available":96576696320,"internally_reserved":0,"allocated":1404928,"data_stored":739805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.438,"15min":0.44},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.49099999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.48999999999999999,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56799999999999995,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83999999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.64000000000000001,"5min":0.79800000000000004,"15min":0.87},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56000000000000005,"15min":0.58499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.59099999999999997,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51600000000000001,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.32000000000000001},"max":{"1min":0.60899999999999999,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.38500000000000001},"max":{"1min":0.89100000000000001,"5min":1.143,"15min":1.3140000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":0.89500000000000002,"5min":1.022,"15min":1.2290000000000001},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":0.92300000000000004,"5min":1.1890000000000001,"15min":1.4359999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":1.044,"15min":1.357},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.75,"15min":0.78200000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90100000000000002,"5min":1.278,"15min":1.278},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77400000000000002,"15min":0.79300000000000004},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91500000000000004,"5min":1.0820000000000001,"15min":1.456},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.77300000000000002,"15min":0.79900000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.84199999999999997,"5min":1.0820000000000001,"15min":1.417},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":0.81299999999999994},"min":{"1min":0.53200000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.90400000000000003,"5min":1.3280000000000001,"15min":1.397},"last":0.73899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575047,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37092,"kb_used_data":1948,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1994752,"data_stored":1329154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.41999999999999998,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.54100000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.48599999999999999,"15min":0.50600000000000001},"min":{"1min":0.28299999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.747,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.47699999999999998,"15min":0.496},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.30099999999999999},"max":{"1min":0.50800000000000001,"5min":0.81100000000000005,"15min":0.82399999999999995},"last":0.502},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.52100000000000002,"15min":0.53400000000000003},"min":{"1min":0.40699999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66700000000000004,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.49299999999999999,"15min":0.505},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66600000000000004,"5min":1.151,"15min":1.151},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.54200000000000004,"15min":0.56699999999999995},"min":{"1min":0.373,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.60099999999999998,"5min":0.83099999999999996,"15min":0.874},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73699999999999999,"15min":0.78400000000000003},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92700000000000005,"5min":1.1319999999999999,"15min":1.242},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73999999999999999,"15min":0.77800000000000002},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":0.81899999999999995,"5min":1.3560000000000001,"15min":1.3620000000000001},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.755,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.38400000000000001},"max":{"1min":0.89900000000000002,"5min":1.254,"15min":1.3700000000000001},"last":0.871},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.73099999999999998,"15min":0.78200000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":0.77400000000000002,"5min":1.0329999999999999,"15min":1.1759999999999999},"last":0.745}]},{"osd":6,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.52200000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93000000000000005,"5min":1.113,"15min":1.2050000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.754,"15min":0.78500000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":0.996,"5min":1.2010000000000001,"15min":1.2989999999999999},"last":0.83099999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.77000000000000002,"15min":0.80500000000000005},"min":{"1min":0.51100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.84199999999999997,"5min":1.3120000000000001,"15min":1.3640000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78200000000000003,"15min":0.81200000000000006},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.435},"max":{"1min":0.95099999999999996,"5min":1.325,"15min":1.325},"last":0.81100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:58:43.412 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:58:43.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4ee527b640 1 Processor -- start 2023-07-06T21:58:43.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4ee527b640 1 -- start start 2023-07-06T21:58:43.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4ee527b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4ee00712f0 0x7f4ee006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4ee527b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4ee00b3730 0x7f4ee00c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4ee527b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ee00ca280 0x7f4ee00c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4ee527b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee00ca6e0 con 0x7f4ee00712f0 2023-07-06T21:58:43.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4ee527b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee0159cd0 con 0x7f4ee00b3730 2023-07-06T21:58:43.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4ee527b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00693f0 con 0x7f4ee00ca280 2023-07-06T21:58:43.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4edeffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4ee00712f0 0x7f4ee006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4edeffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4ee00712f0 0x7f4ee006a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50194/0 (socket says 172.21.15.55:50194) 2023-07-06T21:58:43.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4edeffd640 1 -- 172.21.15.55:0/206699989 learned_addr learned my addr 172.21.15.55:0/206699989 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:43.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4ed7fff640 1 --2- 172.21.15.55:0/206699989 >> v2:172.21.15.138:3300/0 conn(0x7f4ee00b3730 0x7f4ee00c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4edf7fe640 1 --2- 172.21.15.55:0/206699989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ee00ca280 0x7f4ee00c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4edeffd640 1 -- 172.21.15.55:0/206699989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ee00ca280 msgr2=0x7f4ee00c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:43.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4edeffd640 1 --2- 172.21.15.55:0/206699989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ee00ca280 0x7f4ee00c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4edeffd640 1 -- 172.21.15.55:0/206699989 >> v2:172.21.15.138:3300/0 conn(0x7f4ee00b3730 msgr2=0x7f4ee00c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:43.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4edeffd640 1 --2- 172.21.15.55:0/206699989 >> v2:172.21.15.138:3300/0 conn(0x7f4ee00b3730 0x7f4ee00c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.591+0000 7f4edeffd640 1 -- 172.21.15.55:0/206699989 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee006aca0 con 0x7f4ee00712f0 2023-07-06T21:58:43.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.595+0000 7f4edeffd640 1 --2- 172.21.15.55:0/206699989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ee00712f0 0x7f4ee006a610 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0071a70 tx=0x7f4ed001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8315856fe95421 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:43.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.595+0000 7f4ede7fc640 1 -- 172.21.15.55:0/206699989 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00ab600 con 0x7f4ee00712f0 2023-07-06T21:58:43.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.595+0000 7f4ede7fc640 1 -- 172.21.15.55:0/206699989 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed00a7050 con 0x7f4ee00712f0 2023-07-06T21:58:43.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.595+0000 7f4ede7fc640 1 -- 172.21.15.55:0/206699989 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00ab980 con 0x7f4ee00712f0 2023-07-06T21:58:43.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.595+0000 7f4ee527b640 1 -- 172.21.15.55:0/206699989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ee00712f0 msgr2=0x7f4ee006a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.595+0000 7f4ee527b640 1 --2- 172.21.15.55:0/206699989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ee00712f0 0x7f4ee006a610 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0071a70 tx=0x7f4ed001c210 comp rx=0 tx=0).stop 2023-07-06T21:58:43.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.595+0000 7f4ee527b640 1 -- 172.21.15.55:0/206699989 shutdown_connections 2023-07-06T21:58:43.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.595+0000 7f4ee527b640 1 --2- 172.21.15.55:0/206699989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ee00ca280 0x7f4ee00c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.595+0000 7f4ee527b640 1 --2- 172.21.15.55:0/206699989 >> v2:172.21.15.138:3300/0 conn(0x7f4ee00b3730 0x7f4ee00c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.595+0000 7f4ee527b640 1 --2- 172.21.15.55:0/206699989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ee00712f0 0x7f4ee006a610 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.595+0000 7f4ee527b640 1 -- 172.21.15.55:0/206699989 >> 172.21.15.55:0/206699989 conn(0x7f4ee00cded0 msgr2=0x7f4ee00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:43.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.595+0000 7f4ee527b640 1 -- 172.21.15.55:0/206699989 shutdown_connections 2023-07-06T21:58:43.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ee527b640 1 -- 172.21.15.55:0/206699989 wait complete. 2023-07-06T21:58:43.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ee527b640 1 Processor -- start 2023-07-06T21:58:43.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ee527b640 1 -- start start 2023-07-06T21:58:43.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ee527b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ee00712f0 0x7f4ee00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ee527b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ee00b3730 0x7f4ee0152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ee527b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee00ca280 0x7f4ee00b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ee527b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee015ae70 con 0x7f4ee00b3730 2023-07-06T21:58:43.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ee527b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee015ab90 con 0x7f4ee00ca280 2023-07-06T21:58:43.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ee527b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00b12b0 con 0x7f4ee00712f0 2023-07-06T21:58:43.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ed7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ee00b3730 0x7f4ee0152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ed7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ee00b3730 0x7f4ee0152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50196/0 (socket says 172.21.15.55:50196) 2023-07-06T21:58:43.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ed7fff640 1 -- 172.21.15.55:0/445775330 learned_addr learned my addr 172.21.15.55:0/445775330 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:43.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4edeffd640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ee00712f0 0x7f4ee00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4edf7fe640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee00ca280 0x7f4ee00b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ed7fff640 1 -- 172.21.15.55:0/445775330 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ee00712f0 msgr2=0x7f4ee00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ed7fff640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ee00712f0 0x7f4ee00b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ed7fff640 1 -- 172.21.15.55:0/445775330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee00ca280 msgr2=0x7f4ee00b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ed7fff640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee00ca280 0x7f4ee00b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ed7fff640 1 -- 172.21.15.55:0/445775330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed00094d0 con 0x7f4ee00b3730 2023-07-06T21:58:43.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4edf7fe640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee00ca280 0x7f4ee00b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:43.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ed7fff640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ee00b3730 0x7f4ee0152860 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f4ec800d800 tx=0x7f4ec800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:43.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ed77fe640 1 -- 172.21.15.55:0/445775330 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec80096a0 con 0x7f4ee00b3730 2023-07-06T21:58:43.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ed77fe640 1 -- 172.21.15.55:0/445775330 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec8009800 con 0x7f4ee00b3730 2023-07-06T21:58:43.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.599+0000 7f4ee527b640 1 -- 172.21.15.55:0/445775330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee00b1590 con 0x7f4ee00b3730 2023-07-06T21:58:43.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.603+0000 7f4ed77fe640 1 -- 172.21.15.55:0/445775330 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8009990 con 0x7f4ee00b3730 2023-07-06T21:58:43.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.603+0000 7f4ee527b640 1 -- 172.21.15.55:0/445775330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee0152da0 con 0x7f4ee00b3730 2023-07-06T21:58:43.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.603+0000 7f4ee527b640 1 -- 172.21.15.55:0/445775330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee0066d60 con 0x7f4ee00b3730 2023-07-06T21:58:43.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.603+0000 7f4ed77fe640 1 -- 172.21.15.55:0/445775330 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4ec8009af0 con 0x7f4ee00b3730 2023-07-06T21:58:43.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.603+0000 7f4ed77fe640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f4ec00663a0 0x7f4ec0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.603+0000 7f4ed77fe640 1 -- 172.21.15.55:0/445775330 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4ec8084430 con 0x7f4ee00b3730 2023-07-06T21:58:43.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.603+0000 7f4edeffd640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f4ec00663a0 0x7f4ec0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.603+0000 7f4edeffd640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f4ec00663a0 0x7f4ec0068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00ad000 tx=0x7f4ed00a6000 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.607+0000 7f4ed77fe640 1 -- 172.21.15.55:0/445775330 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4ec8051650 con 0x7f4ee00b3730 2023-07-06T21:58:43.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.759+0000 7f4ee527b640 1 -- 172.21.15.55:0/445775330 --> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ee00b3e30 con 0x7f4ec00663a0 2023-07-06T21:58:43.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.767+0000 7f4ed77fe640 1 -- 172.21.15.55:0/445775330 <== mgr.7782 v2:172.21.15.55:6832/1408736549 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299661 (secure 0 0 0) 0x7f4ed00ab5a0 con 0x7f4ec00663a0 2023-07-06T21:58:43.770 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:43.771 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:58:43.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.771+0000 7f4ee527b640 1 -- 172.21.15.55:0/445775330 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f4ec00663a0 msgr2=0x7f4ec0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.771+0000 7f4ee527b640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f4ec00663a0 0x7f4ec0068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00ad000 tx=0x7f4ed00a6000 comp rx=0 tx=0).stop 2023-07-06T21:58:43.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.771+0000 7f4ee527b640 1 -- 172.21.15.55:0/445775330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ee00b3730 msgr2=0x7f4ee0152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.771+0000 7f4ee527b640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ee00b3730 0x7f4ee0152860 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f4ec800d800 tx=0x7f4ec800dcc0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.771+0000 7f4ee527b640 1 -- 172.21.15.55:0/445775330 shutdown_connections 2023-07-06T21:58:43.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.771+0000 7f4ee527b640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f4ec00663a0 0x7f4ec0068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.771+0000 7f4ee527b640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ee00ca280 0x7f4ee00b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.771+0000 7f4ee527b640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ee00b3730 0x7f4ee0152860 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.771+0000 7f4ee527b640 1 --2- 172.21.15.55:0/445775330 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ee00712f0 0x7f4ee00b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.771+0000 7f4ee527b640 1 -- 172.21.15.55:0/445775330 >> 172.21.15.55:0/445775330 conn(0x7f4ee00cded0 msgr2=0x7f4ee00ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:43.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.771+0000 7f4ee527b640 1 -- 172.21.15.55:0/445775330 shutdown_connections 2023-07-06T21:58:43.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.771+0000 7f4ee527b640 1 -- 172.21.15.55:0/445775330 wait complete. 2023-07-06T21:58:43.790 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T21:58:42.738442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307220,"kb_used_data":12116,"kb_used_omap":0,"kb_used_meta":295040,"kb_avail":754667500,"statfs":{"total":773094113280,"available":772779520000,"internally_reserved":0,"allocated":12406784,"data_stored":7090648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":302120960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.912641"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.835709+0000","last_change":"2023-07-06T21:58:37.835709+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.835709+0000","last_undegraded":"2023-07-06T21:58:37.835709+0000","last_fullsized":"2023-07-06T21:58:37.835709+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827967+0000","last_change":"2023-07-06T21:58:37.827967+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827967+0000","last_undegraded":"2023-07-06T21:58:37.827967+0000","last_fullsized":"2023-07-06T21:58:37.827967+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.834699+0000","last_change":"2023-07-06T21:58:37.834699+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.834699+0000","last_undegraded":"2023-07-06T21:58:37.834699+0000","last_fullsized":"2023-07-06T21:58:37.834699+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833844+0000","last_change":"2023-07-06T21:58:37.833844+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833844+0000","last_undegraded":"2023-07-06T21:58:37.833844+0000","last_fullsized":"2023-07-06T21:58:37.833844+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.834291+0000","last_change":"2023-07-06T21:58:37.834291+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.834291+0000","last_undegraded":"2023-07-06T21:58:37.834291+0000","last_fullsized":"2023-07-06T21:58:37.834291+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.835339+0000","last_change":"2023-07-06T21:58:37.835339+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.835339+0000","last_undegraded":"2023-07-06T21:58:37.835339+0000","last_fullsized":"2023-07-06T21:58:37.835339+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.830974+0000","last_change":"2023-07-06T21:58:37.830974+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.830974+0000","last_undegraded":"2023-07-06T21:58:37.830974+0000","last_fullsized":"2023-07-06T21:58:37.830974+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833190+0000","last_change":"2023-07-06T21:58:37.833190+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833190+0000","last_undegraded":"2023-07-06T21:58:37.833190+0000","last_fullsized":"2023-07-06T21:58:37.833190+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.832771+0000","last_change":"2023-07-06T21:58:37.832771+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.832771+0000","last_undegraded":"2023-07-06T21:58:37.832771+0000","last_fullsized":"2023-07-06T21:58:37.832771+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.830870+0000","last_change":"2023-07-06T21:58:37.830870+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.830870+0000","last_undegraded":"2023-07-06T21:58:37.830870+0000","last_fullsized":"2023-07-06T21:58:37.830870+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827932+0000","last_change":"2023-07-06T21:58:37.827932+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827932+0000","last_undegraded":"2023-07-06T21:58:37.827932+0000","last_fullsized":"2023-07-06T21:58:37.827932+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827580+0000","last_change":"2023-07-06T21:58:37.827580+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827580+0000","last_undegraded":"2023-07-06T21:58:37.827580+0000","last_fullsized":"2023-07-06T21:58:37.827580+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.829155+0000","last_change":"2023-07-06T21:58:37.829155+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.829155+0000","last_undegraded":"2023-07-06T21:58:37.829155+0000","last_fullsized":"2023-07-06T21:58:37.829155+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.829131+0000","last_change":"2023-07-06T21:58:37.829131+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.829131+0000","last_undegraded":"2023-07-06T21:58:37.829131+0000","last_fullsized":"2023-07-06T21:58:37.829131+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827613+0000","last_change":"2023-07-06T21:58:37.827613+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827613+0000","last_undegraded":"2023-07-06T21:58:37.827613+0000","last_fullsized":"2023-07-06T21:58:37.827613+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.832694+0000","last_change":"2023-07-06T21:58:37.832694+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.832694+0000","last_undegraded":"2023-07-06T21:58:37.832694+0000","last_fullsized":"2023-07-06T21:58:37.832694+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833521+0000","last_change":"2023-07-06T21:58:37.833521+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833521+0000","last_undegraded":"2023-07-06T21:58:37.833521+0000","last_fullsized":"2023-07-06T21:58:37.833521+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.834437+0000","last_change":"2023-07-06T21:58:37.834437+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.834437+0000","last_undegraded":"2023-07-06T21:58:37.834437+0000","last_fullsized":"2023-07-06T21:58:37.834437+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.834168+0000","last_change":"2023-07-06T21:58:37.834168+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.834168+0000","last_undegraded":"2023-07-06T21:58:37.834168+0000","last_fullsized":"2023-07-06T21:58:37.834168+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.831111+0000","last_change":"2023-07-06T21:58:37.831111+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.831111+0000","last_undegraded":"2023-07-06T21:58:37.831111+0000","last_fullsized":"2023-07-06T21:58:37.831111+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833063+0000","last_change":"2023-07-06T21:58:37.833063+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833063+0000","last_undegraded":"2023-07-06T21:58:37.833063+0000","last_fullsized":"2023-07-06T21:58:37.833063+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.831014+0000","last_change":"2023-07-06T21:58:37.831014+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.831014+0000","last_undegraded":"2023-07-06T21:58:37.831014+0000","last_fullsized":"2023-07-06T21:58:37.831014+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.830935+0000","last_change":"2023-07-06T21:58:37.830935+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.830935+0000","last_undegraded":"2023-07-06T21:58:37.830935+0000","last_fullsized":"2023-07-06T21:58:37.830935+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.829100+0000","last_change":"2023-07-06T21:58:37.829100+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.829100+0000","last_undegraded":"2023-07-06T21:58:37.829100+0000","last_fullsized":"2023-07-06T21:58:37.829100+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827964+0000","last_change":"2023-07-06T21:58:37.827964+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827964+0000","last_undegraded":"2023-07-06T21:58:37.827964+0000","last_fullsized":"2023-07-06T21:58:37.827964+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"105'205","reported_seq":669,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.828832+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:58:37.828832+0000","last_peered":"2023-07-06T21:58:37.828832+0000","last_clean":"2023-07-06T21:58:37.828832+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:58:37.828832+0000","last_undegraded":"2023-07-06T21:58:37.828832+0000","last_fullsized":"2023-07-06T21:58:37.828832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:18:55.182825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":178,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.834212+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:58:37.834212+0000","last_peered":"2023-07-06T21:58:37.834212+0000","last_clean":"2023-07-06T21:58:37.834212+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:58:37.834212+0000","last_undegraded":"2023-07-06T21:58:37.834212+0000","last_fullsized":"2023-07-06T21:58:37.834212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:59.906001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833328+0000","last_change":"2023-07-06T21:58:37.833328+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833328+0000","last_undegraded":"2023-07-06T21:58:37.833328+0000","last_fullsized":"2023-07-06T21:58:37.833328+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":201,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.828588+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:58:37.828588+0000","last_peered":"2023-07-06T21:58:37.828588+0000","last_clean":"2023-07-06T21:58:37.828588+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:58:37.828588+0000","last_undegraded":"2023-07-06T21:58:37.828588+0000","last_fullsized":"2023-07-06T21:58:37.828588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:25:38.821167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.831092+0000","last_change":"2023-07-06T21:58:37.831092+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.831092+0000","last_undegraded":"2023-07-06T21:58:37.831092+0000","last_fullsized":"2023-07-06T21:58:37.831092+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.827742+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:58:37.827742+0000","last_peered":"2023-07-06T21:58:37.827742+0000","last_clean":"2023-07-06T21:58:37.827742+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:58:37.827742+0000","last_undegraded":"2023-07-06T21:58:37.827742+0000","last_fullsized":"2023-07-06T21:58:37.827742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:30:13.273850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827580+0000","last_change":"2023-07-06T21:58:37.827580+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827580+0000","last_undegraded":"2023-07-06T21:58:37.827580+0000","last_fullsized":"2023-07-06T21:58:37.827580+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":178,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.834360+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:58:37.834360+0000","last_peered":"2023-07-06T21:58:37.834360+0000","last_clean":"2023-07-06T21:58:37.834360+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:58:37.834360+0000","last_undegraded":"2023-07-06T21:58:37.834360+0000","last_fullsized":"2023-07-06T21:58:37.834360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:18:04.883605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833003+0000","last_change":"2023-07-06T21:58:37.833003+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833003+0000","last_undegraded":"2023-07-06T21:58:37.833003+0000","last_fullsized":"2023-07-06T21:58:37.833003+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.836030+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:58:37.836030+0000","last_peered":"2023-07-06T21:58:37.836030+0000","last_clean":"2023-07-06T21:58:37.836030+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:58:37.836030+0000","last_undegraded":"2023-07-06T21:58:37.836030+0000","last_fullsized":"2023-07-06T21:58:37.836030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:10:38.369138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833494+0000","last_change":"2023-07-06T21:58:37.833494+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833494+0000","last_undegraded":"2023-07-06T21:58:37.833494+0000","last_fullsized":"2023-07-06T21:58:37.833494+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":200,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.828925+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:58:37.828925+0000","last_peered":"2023-07-06T21:58:37.828925+0000","last_clean":"2023-07-06T21:58:37.828925+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:58:37.828925+0000","last_undegraded":"2023-07-06T21:58:37.828925+0000","last_fullsized":"2023-07-06T21:58:37.828925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:37:40.103705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833545+0000","last_change":"2023-07-06T21:58:37.833545+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833545+0000","last_undegraded":"2023-07-06T21:58:37.833545+0000","last_fullsized":"2023-07-06T21:58:37.833545+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.836132+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:58:37.836132+0000","last_peered":"2023-07-06T21:58:37.836132+0000","last_clean":"2023-07-06T21:58:37.836132+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:58:37.836132+0000","last_undegraded":"2023-07-06T21:58:37.836132+0000","last_fullsized":"2023-07-06T21:58:37.836132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:12:40.805057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833584+0000","last_change":"2023-07-06T21:58:37.833584+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833584+0000","last_undegraded":"2023-07-06T21:58:37.833584+0000","last_fullsized":"2023-07-06T21:58:37.833584+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.832305+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:58:37.832305+0000","last_peered":"2023-07-06T21:58:37.832305+0000","last_clean":"2023-07-06T21:58:37.832305+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:58:37.832305+0000","last_undegraded":"2023-07-06T21:58:37.832305+0000","last_fullsized":"2023-07-06T21:58:37.832305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:21:51.006452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575048,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1998848,"data_stored":1330173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.441,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68300000000000005,"15min":0.70199999999999996},"min":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.71299999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69499999999999995,"15min":0.71499999999999997},"min":{"1min":0.45300000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.746}]},{"osd":2,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.42799999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.42599999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.71699999999999997},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71599999999999997,"15min":0.73899999999999999},"min":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.77400000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.41799999999999998,"5min":0.376,"15min":0.35599999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.876},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.61299999999999999},"min":{"1min":0.47399999999999998,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.90200000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.69399999999999995,"15min":0.70299999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.92600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575048,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36512,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335328,"statfs":{"total":96636764160,"available":96599375872,"internally_reserved":0,"allocated":1400832,"data_stored":738786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68300000000000005,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.81799999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.71199999999999997},"min":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.41599999999999998},"max":{"1min":0.76900000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.627},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93100000000000005,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.497}]},{"osd":3,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.74299999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.45800000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70299999999999996,"15min":0.72499999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.498},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":1.0629999999999999},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57599999999999996,"15min":0.56499999999999995},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78100000000000003,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91300000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60899999999999999,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86599999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.56000000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96299999999999997,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94999999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.53400000000000003,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.86399999999999999,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575047,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36516,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335324,"statfs":{"total":96636764160,"available":96599371776,"internally_reserved":0,"allocated":1404928,"data_stored":739805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.44800000000000001,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.87,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.69699999999999995,"15min":0.71799999999999997},"min":{"1min":0.45400000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85699999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.71399999999999997},"min":{"1min":0.52000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88500000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.46100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82199999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.82099999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.73499999999999999},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86199999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.873,"5min":1.0309999999999999,"15min":1.0369999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70899999999999996,"15min":0.74299999999999999},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72999999999999998,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83599999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.879}]},{"osd":4,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.41299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.874,"5min":0.91800000000000004,"15min":1.02},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85499999999999998,"5min":0.86899999999999999,"15min":1.004},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82099999999999995,"5min":0.83599999999999997,"15min":0.95699999999999996},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.93200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575046,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1392640,"data_stored":733315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.39400000000000002},"max":{"1min":0.84399999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69799999999999995,"15min":0.71399999999999997},"min":{"1min":0.49099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93899999999999995,"5min":1.123,"15min":1.123},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.71699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86799999999999999,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.626,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.45000000000000001,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":0.91500000000000004,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69999999999999996,"15min":0.71599999999999997},"min":{"1min":0.48599999999999999,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":0.92300000000000004,"5min":0.94599999999999995,"15min":1.1299999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.98899999999999999},"last":0.873}]},{"osd":3,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70899999999999996,"15min":0.72399999999999998},"min":{"1min":0.46700000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92000000000000004,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.49299999999999999},"max":{"1min":0.89300000000000002,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.308},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.94299999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.439,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.82699999999999996,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.624,"15min":0.59899999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89300000000000002,"5min":1.036,"15min":1.036},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.34799999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67400000000000004,"15min":0.65200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98199999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.442,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.01},"last":0.624}]}]},{"osd":3,"up_from":13,"seq":55834575047,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1404928,"data_stored":739805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.85499999999999998,"15min":1.0489999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.67800000000000005,"5min":2.77,"15min":2.77},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.503,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.309,"15min":0.24299999999999999},"max":{"1min":0.77600000000000002,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":1.351,"15min":1.9590000000000001},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":0.73999999999999999,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":2.012},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":0.97299999999999998,"5min":1.1930000000000001,"15min":1.855},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0109999999999999,"5min":1.383,"15min":1.524},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80300000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.44800000000000001},"max":{"1min":1.0700000000000001,"5min":1.327,"15min":1.883},"last":0.63}]},{"osd":6,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.46600000000000003,"15min":0.40000000000000002},"max":{"1min":1.129,"5min":1.425,"15min":1.425},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.81399999999999995,"15min":0.80700000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47899999999999998},"max":{"1min":1.097,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.51000000000000001,"5min":0.5,"15min":0.497},"max":{"1min":1.004,"5min":3.097,"15min":3.097},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.81100000000000005},"min":{"1min":0.54500000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.1140000000000001,"15min":1.9830000000000001},"last":0.745}]}]},{"osd":2,"up_from":13,"seq":55834575047,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36516,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335324,"statfs":{"total":96636764160,"available":96599371776,"internally_reserved":0,"allocated":1404928,"data_stored":739805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.28199999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52700000000000002,"5min":0.81699999999999995,"15min":0.85999999999999999},"last":0.443},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48299999999999998,"15min":0.497},"min":{"1min":0.26000000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.60299999999999998,"5min":0.84399999999999997,"15min":0.85999999999999999},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.63900000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83499999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.504},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63400000000000001,"5min":0.72399999999999998,"15min":0.76500000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.61299999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.47999999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.091,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.53100000000000003,"5min":0.47499999999999998,"15min":0.41399999999999998},"max":{"1min":1.1000000000000001,"5min":1.591,"15min":1.591},"last":0.879}]},{"osd":5,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.52200000000000002,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.139,"5min":1.333,"15min":1.333},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79100000000000004,"15min":0.81000000000000005},"min":{"1min":0.53800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0169999999999999,"5min":1.327,"15min":1.327},"last":0.80500000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.466,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.0509999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.872}]},{"osd":7,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.54100000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.135,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.83499999999999996},"min":{"1min":0.54800000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.85199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575048,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58660,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313180,"statfs":{"total":96636764160,"available":96576696320,"internally_reserved":0,"allocated":1404928,"data_stored":739805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.438,"15min":0.44},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.49099999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.48999999999999999,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56799999999999995,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83999999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.64000000000000001,"5min":0.79800000000000004,"15min":0.87},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56000000000000005,"15min":0.58499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.59099999999999997,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51600000000000001,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.32000000000000001},"max":{"1min":0.60899999999999999,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.38500000000000001},"max":{"1min":0.89100000000000001,"5min":1.143,"15min":1.3140000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":0.89500000000000002,"5min":1.022,"15min":1.2290000000000001},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":0.92300000000000004,"5min":1.1890000000000001,"15min":1.4359999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":1.044,"15min":1.357},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.75,"15min":0.78200000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90100000000000002,"5min":1.278,"15min":1.278},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77400000000000002,"15min":0.79300000000000004},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91500000000000004,"5min":1.0820000000000001,"15min":1.456},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.77300000000000002,"15min":0.79900000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.84199999999999997,"5min":1.0820000000000001,"15min":1.417},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":0.81299999999999994},"min":{"1min":0.53200000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.90400000000000003,"5min":1.3280000000000001,"15min":1.397},"last":0.73899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575047,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37092,"kb_used_data":1948,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1994752,"data_stored":1329154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.41999999999999998,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.54100000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.48599999999999999,"15min":0.50600000000000001},"min":{"1min":0.28299999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.747,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.47699999999999998,"15min":0.496},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.30099999999999999},"max":{"1min":0.50800000000000001,"5min":0.81100000000000005,"15min":0.82399999999999995},"last":0.502},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.52100000000000002,"15min":0.53400000000000003},"min":{"1min":0.40699999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66700000000000004,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.49299999999999999,"15min":0.505},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66600000000000004,"5min":1.151,"15min":1.151},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.54200000000000004,"15min":0.56699999999999995},"min":{"1min":0.373,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.60099999999999998,"5min":0.83099999999999996,"15min":0.874},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73699999999999999,"15min":0.78400000000000003},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92700000000000005,"5min":1.1319999999999999,"15min":1.242},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73999999999999999,"15min":0.77800000000000002},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":0.81899999999999995,"5min":1.3560000000000001,"15min":1.3620000000000001},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.755,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.38400000000000001},"max":{"1min":0.89900000000000002,"5min":1.254,"15min":1.3700000000000001},"last":0.871},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.73099999999999998,"15min":0.78200000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":0.77400000000000002,"5min":1.0329999999999999,"15min":1.1759999999999999},"last":0.745}]},{"osd":6,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.52200000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93000000000000005,"5min":1.113,"15min":1.2050000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.754,"15min":0.78500000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":0.996,"5min":1.2010000000000001,"15min":1.2989999999999999},"last":0.83099999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.77000000000000002,"15min":0.80500000000000005},"min":{"1min":0.51100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.84199999999999997,"5min":1.3120000000000001,"15min":1.3640000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78200000000000003,"15min":0.81200000000000006},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.435},"max":{"1min":0.95099999999999996,"5min":1.325,"15min":1.325},"last":0.81100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:58:43.797 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:58:43.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.975+0000 7f7beb19f640 1 Processor -- start 2023-07-06T21:58:43.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.975+0000 7f7beb19f640 1 -- start start 2023-07-06T21:58:43.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.975+0000 7f7beb19f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7be415ca30 0x7f7be406c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7beb19f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be4070fd0 con 0x7f7be406c920 2023-07-06T21:58:43.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7beb19f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be40c9e00 con 0x7f7be406af90 2023-07-06T21:58:43.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7beb19f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be4070bb0 con 0x7f7be415ca30 2023-07-06T21:58:43.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be973c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7be406c920 0x7f7be4158c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44454/0 (socket says 172.21.15.55:44454) 2023-07-06T21:58:43.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be973c640 1 -- 172.21.15.55:0/3570154576 learned_addr learned my addr 172.21.15.55:0/3570154576 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:43.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be3fff640 1 --2- 172.21.15.55:0/3570154576 >> v2:172.21.15.138:3300/0 conn(0x7f7be415ca30 0x7f7be406c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 -- 172.21.15.55:0/3570154576 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171317187 0 0) 0x7f7be4070fd0 con 0x7f7be406c920 2023-07-06T21:58:43.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 -- 172.21.15.55:0/3570154576 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bd4003530 con 0x7f7be406c920 2023-07-06T21:58:43.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 -- 172.21.15.55:0/3570154576 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1749362202 0 0) 0x7f7bd4003530 con 0x7f7be406c920 2023-07-06T21:58:43.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 -- 172.21.15.55:0/3570154576 >> v2:172.21.15.138:3300/0 conn(0x7f7be415ca30 msgr2=0x7f7be406c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:43.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 --2- 172.21.15.55:0/3570154576 >> v2:172.21.15.138:3300/0 conn(0x7f7be415ca30 0x7f7be406c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 -- 172.21.15.55:0/3570154576 >> v1:172.21.15.138:6789/0 conn(0x7f7be406af90 legacy=0x7f7be40c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 -- 172.21.15.55:0/3570154576 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be415ceb0 con 0x7f7be406c920 2023-07-06T21:58:43.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 -- 172.21.15.55:0/3570154576 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f7bdc001a00 con 0x7f7be406c920 2023-07-06T21:58:43.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 -- 172.21.15.55:0/3570154576 >> v1:172.21.15.55:6789/0 conn(0x7f7be406c920 legacy=0x7f7be4158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 --2- 172.21.15.55:0/3570154576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bd4003980 0x7f7bd4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 --2- 172.21.15.55:0/3570154576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bd40047d0 0x7f7bd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 --2- 172.21.15.55:0/3570154576 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7bd4005180 0x7f7bd400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 -- 172.21.15.55:0/3570154576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be4070bb0 con 0x7f7bd40047d0 2023-07-06T21:58:43.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 -- 172.21.15.55:0/3570154576 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd400c090 con 0x7f7bd4003980 2023-07-06T21:58:43.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be37fe640 1 -- 172.21.15.55:0/3570154576 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd400c250 con 0x7f7bd4005180 2023-07-06T21:58:43.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be8f3b640 1 --2- 172.21.15.55:0/3570154576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bd4003980 0x7f7bd4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be3fff640 1 --2- 172.21.15.55:0/3570154576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bd40047d0 0x7f7bd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be973c640 1 --2- 172.21.15.55:0/3570154576 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7bd4005180 0x7f7bd400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be3fff640 1 -- 172.21.15.55:0/3570154576 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7bd4005180 msgr2=0x7f7bd400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:43.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be3fff640 1 --2- 172.21.15.55:0/3570154576 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7bd4005180 0x7f7bd400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be3fff640 1 -- 172.21.15.55:0/3570154576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bd4003980 msgr2=0x7f7bd4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:43.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be3fff640 1 --2- 172.21.15.55:0/3570154576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bd4003980 0x7f7bd4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be3fff640 1 -- 172.21.15.55:0/3570154576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd4003530 con 0x7f7bd40047d0 2023-07-06T21:58:43.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be8f3b640 1 --2- 172.21.15.55:0/3570154576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bd4003980 0x7f7bd4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:43.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.979+0000 7f7be973c640 1 -- 172.21.15.55:0/3570154576 reap_dead start 2023-07-06T21:58:43.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.983+0000 7f7be3fff640 1 --2- 172.21.15.55:0/3570154576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bd40047d0 0x7f7bd4004c40 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009ae0 tx=0x7f7bd001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94d01be782ace6c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:43.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.983+0000 7f7be37fe640 1 -- 172.21.15.55:0/3570154576 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00a6450 con 0x7f7bd40047d0 2023-07-06T21:58:43.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.983+0000 7f7be37fe640 1 -- 172.21.15.55:0/3570154576 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd00a65b0 con 0x7f7bd40047d0 2023-07-06T21:58:43.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.983+0000 7f7be37fe640 1 -- 172.21.15.55:0/3570154576 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00a6960 con 0x7f7bd40047d0 2023-07-06T21:58:43.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.983+0000 7f7beb19f640 1 -- 172.21.15.55:0/3570154576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bd40047d0 msgr2=0x7f7bd4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.983+0000 7f7beb19f640 1 --2- 172.21.15.55:0/3570154576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bd40047d0 0x7f7bd4004c40 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009ae0 tx=0x7f7bd001ca70 comp rx=0 tx=0).stop 2023-07-06T21:58:43.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.983+0000 7f7beb19f640 1 -- 172.21.15.55:0/3570154576 shutdown_connections 2023-07-06T21:58:43.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.983+0000 7f7beb19f640 1 --2- 172.21.15.55:0/3570154576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bd40047d0 0x7f7bd4004c40 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.983+0000 7f7beb19f640 1 -- 172.21.15.55:0/3570154576 >> 172.21.15.55:0/3570154576 conn(0x7f7be40cfc60 msgr2=0x7f7be40cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:43.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.983+0000 7f7beb19f640 1 -- 172.21.15.55:0/3570154576 shutdown_connections 2023-07-06T21:58:43.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.983+0000 7f7beb19f640 1 -- 172.21.15.55:0/3570154576 wait complete. 2023-07-06T21:58:43.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.983+0000 7f7beb19f640 1 Processor -- start 2023-07-06T21:58:43.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.983+0000 7f7beb19f640 1 -- start start 2023-07-06T21:58:43.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7beb19f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7bd40047d0 0x7f7be40c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7beb19f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be41f3ad0 0x7f7be40c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7beb19f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be40c81e0 0x7f7be40b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7beb19f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40c4740 con 0x7f7be40c81e0 2023-07-06T21:58:43.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7beb19f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40c5320 con 0x7f7be41f3ad0 2023-07-06T21:58:43.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7beb19f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40c5600 con 0x7f7bd40047d0 2023-07-06T21:58:43.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7be973c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be40c81e0 0x7f7be40b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7be973c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be40c81e0 0x7f7be40b31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50210/0 (socket says 172.21.15.55:50210) 2023-07-06T21:58:43.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7be973c640 1 -- 172.21.15.55:0/2996416121 learned_addr learned my addr 172.21.15.55:0/2996416121 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:43.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7be3fff640 1 --2- 172.21.15.55:0/2996416121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be41f3ad0 0x7f7be40c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7be8f3b640 1 --2- 172.21.15.55:0/2996416121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7bd40047d0 0x7f7be40c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7be973c640 1 -- 172.21.15.55:0/2996416121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7bd40047d0 msgr2=0x7f7be40c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7be973c640 1 --2- 172.21.15.55:0/2996416121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7bd40047d0 0x7f7be40c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7be973c640 1 -- 172.21.15.55:0/2996416121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be41f3ad0 msgr2=0x7f7be40c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:43.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7be973c640 1 --2- 172.21.15.55:0/2996416121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be41f3ad0 0x7f7be40c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:43.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7be973c640 1 -- 172.21.15.55:0/2996416121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be40c58e0 con 0x7f7be40c81e0 2023-07-06T21:58:43.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7be973c640 1 --2- 172.21.15.55:0/2996416121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be40c81e0 0x7f7be40b31f0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc000f90 tx=0x7f7bdc007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:43.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7be17fa640 1 -- 172.21.15.55:0/2996416121 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc013600 con 0x7f7be40c81e0 2023-07-06T21:58:43.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7be17fa640 1 -- 172.21.15.55:0/2996416121 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc013780 con 0x7f7be40c81e0 2023-07-06T21:58:43.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7be17fa640 1 -- 172.21.15.55:0/2996416121 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc013b30 con 0x7f7be40c81e0 2023-07-06T21:58:43.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7beb19f640 1 -- 172.21.15.55:0/2996416121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be40c8650 con 0x7f7be40c81e0 2023-07-06T21:58:43.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7beb19f640 1 -- 172.21.15.55:0/2996416121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be40b3730 con 0x7f7be40c81e0 2023-07-06T21:58:43.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.987+0000 7f7beb19f640 1 -- 172.21.15.55:0/2996416121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be4066d60 con 0x7f7be40c81e0 2023-07-06T21:58:43.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.991+0000 7f7be17fa640 1 -- 172.21.15.55:0/2996416121 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7bdc013c90 con 0x7f7be40c81e0 2023-07-06T21:58:43.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.991+0000 7f7be17fa640 1 --2- 172.21.15.55:0/2996416121 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f7bc80663d0 0x7f7bc8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:43.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.991+0000 7f7be17fa640 1 -- 172.21.15.55:0/2996416121 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7bdc0840b0 con 0x7f7be40c81e0 2023-07-06T21:58:43.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.991+0000 7f7be8f3b640 1 --2- 172.21.15.55:0/2996416121 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f7bc80663d0 0x7f7bc8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:43.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.991+0000 7f7be8f3b640 1 --2- 172.21.15.55:0/2996416121 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f7bc80663d0 0x7f7bc8068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7be404eaa0 tx=0x7f7bd8009040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:43.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:43.995+0000 7f7be17fa640 1 -- 172.21.15.55:0/2996416121 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7bdc051370 con 0x7f7be40c81e0 2023-07-06T21:58:44.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.147+0000 7f7beb19f640 1 -- 172.21.15.55:0/2996416121 --> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7be40c5490 con 0x7f7bc80663d0 2023-07-06T21:58:44.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.155+0000 7f7be17fa640 1 -- 172.21.15.55:0/2996416121 <== mgr.7782 v2:172.21.15.55:6832/1408736549 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299661 (secure 0 0 0) 0x7f7be40c5490 con 0x7f7bc80663d0 2023-07-06T21:58:44.158 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:44.160 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:58:44.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.159+0000 7f7beb19f640 1 -- 172.21.15.55:0/2996416121 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f7bc80663d0 msgr2=0x7f7bc8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.159+0000 7f7beb19f640 1 --2- 172.21.15.55:0/2996416121 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f7bc80663d0 0x7f7bc8068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7be404eaa0 tx=0x7f7bd8009040 comp rx=0 tx=0).stop 2023-07-06T21:58:44.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.159+0000 7f7beb19f640 1 -- 172.21.15.55:0/2996416121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be40c81e0 msgr2=0x7f7be40b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.159+0000 7f7beb19f640 1 --2- 172.21.15.55:0/2996416121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be40c81e0 0x7f7be40b31f0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc000f90 tx=0x7f7bdc007800 comp rx=0 tx=0).stop 2023-07-06T21:58:44.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.159+0000 7f7beb19f640 1 -- 172.21.15.55:0/2996416121 shutdown_connections 2023-07-06T21:58:44.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.159+0000 7f7beb19f640 1 --2- 172.21.15.55:0/2996416121 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f7bc80663d0 0x7f7bc8068880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.159+0000 7f7beb19f640 1 --2- 172.21.15.55:0/2996416121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7be40c81e0 0x7f7be40b31f0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.159+0000 7f7beb19f640 1 --2- 172.21.15.55:0/2996416121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7be41f3ad0 0x7f7be40c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.159+0000 7f7beb19f640 1 --2- 172.21.15.55:0/2996416121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7bd40047d0 0x7f7be40c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.159+0000 7f7beb19f640 1 -- 172.21.15.55:0/2996416121 >> 172.21.15.55:0/2996416121 conn(0x7f7be40cfc60 msgr2=0x7f7be40cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:44.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.159+0000 7f7beb19f640 1 -- 172.21.15.55:0/2996416121 shutdown_connections 2023-07-06T21:58:44.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.159+0000 7f7beb19f640 1 -- 172.21.15.55:0/2996416121 wait complete. 2023-07-06T21:58:44.178 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T21:58:42.738442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307220,"kb_used_data":12116,"kb_used_omap":0,"kb_used_meta":295040,"kb_avail":754667500,"statfs":{"total":773094113280,"available":772779520000,"internally_reserved":0,"allocated":12406784,"data_stored":7090648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":302120960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.912641"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.835709+0000","last_change":"2023-07-06T21:58:37.835709+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.835709+0000","last_undegraded":"2023-07-06T21:58:37.835709+0000","last_fullsized":"2023-07-06T21:58:37.835709+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827967+0000","last_change":"2023-07-06T21:58:37.827967+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827967+0000","last_undegraded":"2023-07-06T21:58:37.827967+0000","last_fullsized":"2023-07-06T21:58:37.827967+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.834699+0000","last_change":"2023-07-06T21:58:37.834699+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.834699+0000","last_undegraded":"2023-07-06T21:58:37.834699+0000","last_fullsized":"2023-07-06T21:58:37.834699+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833844+0000","last_change":"2023-07-06T21:58:37.833844+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833844+0000","last_undegraded":"2023-07-06T21:58:37.833844+0000","last_fullsized":"2023-07-06T21:58:37.833844+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.834291+0000","last_change":"2023-07-06T21:58:37.834291+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.834291+0000","last_undegraded":"2023-07-06T21:58:37.834291+0000","last_fullsized":"2023-07-06T21:58:37.834291+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.835339+0000","last_change":"2023-07-06T21:58:37.835339+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.835339+0000","last_undegraded":"2023-07-06T21:58:37.835339+0000","last_fullsized":"2023-07-06T21:58:37.835339+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.830974+0000","last_change":"2023-07-06T21:58:37.830974+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.830974+0000","last_undegraded":"2023-07-06T21:58:37.830974+0000","last_fullsized":"2023-07-06T21:58:37.830974+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833190+0000","last_change":"2023-07-06T21:58:37.833190+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833190+0000","last_undegraded":"2023-07-06T21:58:37.833190+0000","last_fullsized":"2023-07-06T21:58:37.833190+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.832771+0000","last_change":"2023-07-06T21:58:37.832771+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.832771+0000","last_undegraded":"2023-07-06T21:58:37.832771+0000","last_fullsized":"2023-07-06T21:58:37.832771+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.830870+0000","last_change":"2023-07-06T21:58:37.830870+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.830870+0000","last_undegraded":"2023-07-06T21:58:37.830870+0000","last_fullsized":"2023-07-06T21:58:37.830870+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827932+0000","last_change":"2023-07-06T21:58:37.827932+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827932+0000","last_undegraded":"2023-07-06T21:58:37.827932+0000","last_fullsized":"2023-07-06T21:58:37.827932+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827580+0000","last_change":"2023-07-06T21:58:37.827580+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827580+0000","last_undegraded":"2023-07-06T21:58:37.827580+0000","last_fullsized":"2023-07-06T21:58:37.827580+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.829155+0000","last_change":"2023-07-06T21:58:37.829155+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.829155+0000","last_undegraded":"2023-07-06T21:58:37.829155+0000","last_fullsized":"2023-07-06T21:58:37.829155+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.829131+0000","last_change":"2023-07-06T21:58:37.829131+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.829131+0000","last_undegraded":"2023-07-06T21:58:37.829131+0000","last_fullsized":"2023-07-06T21:58:37.829131+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827613+0000","last_change":"2023-07-06T21:58:37.827613+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827613+0000","last_undegraded":"2023-07-06T21:58:37.827613+0000","last_fullsized":"2023-07-06T21:58:37.827613+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.832694+0000","last_change":"2023-07-06T21:58:37.832694+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.832694+0000","last_undegraded":"2023-07-06T21:58:37.832694+0000","last_fullsized":"2023-07-06T21:58:37.832694+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833521+0000","last_change":"2023-07-06T21:58:37.833521+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833521+0000","last_undegraded":"2023-07-06T21:58:37.833521+0000","last_fullsized":"2023-07-06T21:58:37.833521+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.834437+0000","last_change":"2023-07-06T21:58:37.834437+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.834437+0000","last_undegraded":"2023-07-06T21:58:37.834437+0000","last_fullsized":"2023-07-06T21:58:37.834437+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.834168+0000","last_change":"2023-07-06T21:58:37.834168+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.834168+0000","last_undegraded":"2023-07-06T21:58:37.834168+0000","last_fullsized":"2023-07-06T21:58:37.834168+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.831111+0000","last_change":"2023-07-06T21:58:37.831111+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.831111+0000","last_undegraded":"2023-07-06T21:58:37.831111+0000","last_fullsized":"2023-07-06T21:58:37.831111+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833063+0000","last_change":"2023-07-06T21:58:37.833063+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833063+0000","last_undegraded":"2023-07-06T21:58:37.833063+0000","last_fullsized":"2023-07-06T21:58:37.833063+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.831014+0000","last_change":"2023-07-06T21:58:37.831014+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.831014+0000","last_undegraded":"2023-07-06T21:58:37.831014+0000","last_fullsized":"2023-07-06T21:58:37.831014+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.830935+0000","last_change":"2023-07-06T21:58:37.830935+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.830935+0000","last_undegraded":"2023-07-06T21:58:37.830935+0000","last_fullsized":"2023-07-06T21:58:37.830935+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.829100+0000","last_change":"2023-07-06T21:58:37.829100+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.829100+0000","last_undegraded":"2023-07-06T21:58:37.829100+0000","last_fullsized":"2023-07-06T21:58:37.829100+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827964+0000","last_change":"2023-07-06T21:58:37.827964+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827964+0000","last_undegraded":"2023-07-06T21:58:37.827964+0000","last_fullsized":"2023-07-06T21:58:37.827964+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"105'205","reported_seq":669,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.828832+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:58:37.828832+0000","last_peered":"2023-07-06T21:58:37.828832+0000","last_clean":"2023-07-06T21:58:37.828832+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:58:37.828832+0000","last_undegraded":"2023-07-06T21:58:37.828832+0000","last_fullsized":"2023-07-06T21:58:37.828832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:18:55.182825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":178,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.834212+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:58:37.834212+0000","last_peered":"2023-07-06T21:58:37.834212+0000","last_clean":"2023-07-06T21:58:37.834212+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:58:37.834212+0000","last_undegraded":"2023-07-06T21:58:37.834212+0000","last_fullsized":"2023-07-06T21:58:37.834212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:59.906001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833328+0000","last_change":"2023-07-06T21:58:37.833328+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833328+0000","last_undegraded":"2023-07-06T21:58:37.833328+0000","last_fullsized":"2023-07-06T21:58:37.833328+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":201,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.828588+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:58:37.828588+0000","last_peered":"2023-07-06T21:58:37.828588+0000","last_clean":"2023-07-06T21:58:37.828588+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:58:37.828588+0000","last_undegraded":"2023-07-06T21:58:37.828588+0000","last_fullsized":"2023-07-06T21:58:37.828588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:25:38.821167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.831092+0000","last_change":"2023-07-06T21:58:37.831092+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.831092+0000","last_undegraded":"2023-07-06T21:58:37.831092+0000","last_fullsized":"2023-07-06T21:58:37.831092+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.827742+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:58:37.827742+0000","last_peered":"2023-07-06T21:58:37.827742+0000","last_clean":"2023-07-06T21:58:37.827742+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:58:37.827742+0000","last_undegraded":"2023-07-06T21:58:37.827742+0000","last_fullsized":"2023-07-06T21:58:37.827742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:30:13.273850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.827580+0000","last_change":"2023-07-06T21:58:37.827580+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.827580+0000","last_undegraded":"2023-07-06T21:58:37.827580+0000","last_fullsized":"2023-07-06T21:58:37.827580+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":178,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.834360+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:58:37.834360+0000","last_peered":"2023-07-06T21:58:37.834360+0000","last_clean":"2023-07-06T21:58:37.834360+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:58:37.834360+0000","last_undegraded":"2023-07-06T21:58:37.834360+0000","last_fullsized":"2023-07-06T21:58:37.834360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:18:04.883605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833003+0000","last_change":"2023-07-06T21:58:37.833003+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833003+0000","last_undegraded":"2023-07-06T21:58:37.833003+0000","last_fullsized":"2023-07-06T21:58:37.833003+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.836030+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:58:37.836030+0000","last_peered":"2023-07-06T21:58:37.836030+0000","last_clean":"2023-07-06T21:58:37.836030+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:58:37.836030+0000","last_undegraded":"2023-07-06T21:58:37.836030+0000","last_fullsized":"2023-07-06T21:58:37.836030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:10:38.369138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833494+0000","last_change":"2023-07-06T21:58:37.833494+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833494+0000","last_undegraded":"2023-07-06T21:58:37.833494+0000","last_fullsized":"2023-07-06T21:58:37.833494+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":200,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.828925+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:58:37.828925+0000","last_peered":"2023-07-06T21:58:37.828925+0000","last_clean":"2023-07-06T21:58:37.828925+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:58:37.828925+0000","last_undegraded":"2023-07-06T21:58:37.828925+0000","last_fullsized":"2023-07-06T21:58:37.828925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:37:40.103705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833545+0000","last_change":"2023-07-06T21:58:37.833545+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833545+0000","last_undegraded":"2023-07-06T21:58:37.833545+0000","last_fullsized":"2023-07-06T21:58:37.833545+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.836132+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:58:37.836132+0000","last_peered":"2023-07-06T21:58:37.836132+0000","last_clean":"2023-07-06T21:58:37.836132+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:58:37.836132+0000","last_undegraded":"2023-07-06T21:58:37.836132+0000","last_fullsized":"2023-07-06T21:58:37.836132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:12:40.805057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T21:58:38.824910+0000","last_change":"2023-07-06T21:58:38.824910+0000","last_active":"2023-07-06T21:58:38.824910+0000","last_peered":"2023-07-06T21:58:38.824910+0000","last_clean":"2023-07-06T21:58:38.824910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:38.824910+0000","last_undegraded":"2023-07-06T21:58:38.824910+0000","last_fullsized":"2023-07-06T21:58:38.824910+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2023-07-06T21:58:37.833584+0000","last_change":"2023-07-06T21:58:37.833584+0000","last_active":"2023-07-06T21:58:37.813712+0000","last_peered":"2023-07-06T21:58:37.813712+0000","last_clean":"2023-07-06T21:58:37.813712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T21:58:37.833584+0000","last_undegraded":"2023-07-06T21:58:37.833584+0000","last_fullsized":"2023-07-06T21:58:37.833584+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-07-06T21:58:37.832305+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:58:37.832305+0000","last_peered":"2023-07-06T21:58:37.832305+0000","last_clean":"2023-07-06T21:58:37.832305+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:58:37.832305+0000","last_undegraded":"2023-07-06T21:58:37.832305+0000","last_fullsized":"2023-07-06T21:58:37.832305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:21:51.006452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575048,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1998848,"data_stored":1330173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.441,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68300000000000005,"15min":0.70199999999999996},"min":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.71299999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69499999999999995,"15min":0.71499999999999997},"min":{"1min":0.45300000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.746}]},{"osd":2,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.42799999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.42599999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.71699999999999997},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71599999999999997,"15min":0.73899999999999999},"min":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.77400000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.41799999999999998,"5min":0.376,"15min":0.35599999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.876},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.61299999999999999},"min":{"1min":0.47399999999999998,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.90200000000000002}]},{"osd":6,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.69399999999999995,"15min":0.70299999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.92600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575048,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36512,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335328,"statfs":{"total":96636764160,"available":96599375872,"internally_reserved":0,"allocated":1400832,"data_stored":738786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68300000000000005,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.81799999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.71199999999999997},"min":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.41599999999999998},"max":{"1min":0.76900000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.627},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93100000000000005,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.497}]},{"osd":3,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.74299999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.45800000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70299999999999996,"15min":0.72499999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.498},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":1.0629999999999999},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57599999999999996,"15min":0.56499999999999995},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78100000000000003,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91300000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60899999999999999,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86599999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.56000000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96299999999999997,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94999999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.53400000000000003,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.86399999999999999,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575047,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36516,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335324,"statfs":{"total":96636764160,"available":96599371776,"internally_reserved":0,"allocated":1404928,"data_stored":739805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.44800000000000001,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.87,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.69699999999999995,"15min":0.71799999999999997},"min":{"1min":0.45400000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85699999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.71399999999999997},"min":{"1min":0.52000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88500000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.46100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82199999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.82099999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.73499999999999999},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86199999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.873,"5min":1.0309999999999999,"15min":1.0369999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70899999999999996,"15min":0.74299999999999999},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72999999999999998,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83599999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.879}]},{"osd":4,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.41299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.874,"5min":0.91800000000000004,"15min":1.02},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85499999999999998,"5min":0.86899999999999999,"15min":1.004},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82099999999999995,"5min":0.83599999999999997,"15min":0.95699999999999996},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.93200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575046,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1392640,"data_stored":733315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.39400000000000002},"max":{"1min":0.84399999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69799999999999995,"15min":0.71399999999999997},"min":{"1min":0.49099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93899999999999995,"5min":1.123,"15min":1.123},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.71699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86799999999999999,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.626,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.45000000000000001,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":0.91500000000000004,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69999999999999996,"15min":0.71599999999999997},"min":{"1min":0.48599999999999999,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":0.92300000000000004,"5min":0.94599999999999995,"15min":1.1299999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.98899999999999999},"last":0.873}]},{"osd":3,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70899999999999996,"15min":0.72399999999999998},"min":{"1min":0.46700000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92000000000000004,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.49299999999999999},"max":{"1min":0.89300000000000002,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.308},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.94299999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.439,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.82699999999999996,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.624,"15min":0.59899999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89300000000000002,"5min":1.036,"15min":1.036},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.34799999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67400000000000004,"15min":0.65200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98199999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.442,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.01},"last":0.624}]}]},{"osd":3,"up_from":13,"seq":55834575047,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1404928,"data_stored":739805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.441,"15min":0.45100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.85499999999999998,"15min":1.0489999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.67800000000000005,"5min":2.77,"15min":2.77},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.503,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.309,"15min":0.24299999999999999},"max":{"1min":0.77600000000000002,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":1.351,"15min":1.9590000000000001},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":0.73999999999999999,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":2.012},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73999999999999999,"15min":0.76300000000000001},"min":{"1min":0.51600000000000001,"5min":0.42699999999999999,"15min":0.34699999999999998},"max":{"1min":0.97299999999999998,"5min":1.1930000000000001,"15min":1.855},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0109999999999999,"5min":1.383,"15min":1.524},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79400000000000004,"15min":0.80300000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.44800000000000001},"max":{"1min":1.0700000000000001,"5min":1.327,"15min":1.883},"last":0.63}]},{"osd":6,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.46600000000000003,"15min":0.40000000000000002},"max":{"1min":1.129,"5min":1.425,"15min":1.425},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.81399999999999995,"15min":0.80700000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47899999999999998},"max":{"1min":1.097,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jul 6 21:57:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.51000000000000001,"5min":0.5,"15min":0.497},"max":{"1min":1.004,"5min":3.097,"15min":3.097},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.81100000000000005},"min":{"1min":0.54500000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.1140000000000001,"15min":1.9830000000000001},"last":0.745}]}]},{"osd":2,"up_from":13,"seq":55834575047,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36516,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335324,"statfs":{"total":96636764160,"available":96599371776,"internally_reserved":0,"allocated":1404928,"data_stored":739805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.28199999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52700000000000002,"5min":0.81699999999999995,"15min":0.85999999999999999},"last":0.443},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48299999999999998,"15min":0.497},"min":{"1min":0.26000000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.60299999999999998,"5min":0.84399999999999997,"15min":0.85999999999999999},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.63900000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83499999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.504},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63400000000000001,"5min":0.72399999999999998,"15min":0.76500000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.61299999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.47999999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.091,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.53100000000000003,"5min":0.47499999999999998,"15min":0.41399999999999998},"max":{"1min":1.1000000000000001,"5min":1.591,"15min":1.591},"last":0.879}]},{"osd":5,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.52200000000000002,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.139,"5min":1.333,"15min":1.333},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79100000000000004,"15min":0.81000000000000005},"min":{"1min":0.53800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0169999999999999,"5min":1.327,"15min":1.327},"last":0.80500000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.466,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.0509999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.872}]},{"osd":7,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.54100000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.135,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.83499999999999996},"min":{"1min":0.54800000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.85199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575048,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58660,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313180,"statfs":{"total":96636764160,"available":96576696320,"internally_reserved":0,"allocated":1404928,"data_stored":739805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.438,"15min":0.44},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.49099999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.48999999999999999,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56799999999999995,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83999999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.64000000000000001,"5min":0.79800000000000004,"15min":0.87},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56000000000000005,"15min":0.58499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.59099999999999997,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51600000000000001,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.32000000000000001},"max":{"1min":0.60899999999999999,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.38500000000000001},"max":{"1min":0.89100000000000001,"5min":1.143,"15min":1.3140000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":0.89500000000000002,"5min":1.022,"15min":1.2290000000000001},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":0.92300000000000004,"5min":1.1890000000000001,"15min":1.4359999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":1.044,"15min":1.357},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.75,"15min":0.78200000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90100000000000002,"5min":1.278,"15min":1.278},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77400000000000002,"15min":0.79300000000000004},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91500000000000004,"5min":1.0820000000000001,"15min":1.456},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.77300000000000002,"15min":0.79900000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.84199999999999997,"5min":1.0820000000000001,"15min":1.417},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":0.81299999999999994},"min":{"1min":0.53200000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.90400000000000003,"5min":1.3280000000000001,"15min":1.397},"last":0.73899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575047,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37092,"kb_used_data":1948,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1994752,"data_stored":1329154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.41999999999999998,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.54100000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.48599999999999999,"15min":0.50600000000000001},"min":{"1min":0.28299999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.747,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.47699999999999998,"15min":0.496},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.30099999999999999},"max":{"1min":0.50800000000000001,"5min":0.81100000000000005,"15min":0.82399999999999995},"last":0.502},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.52100000000000002,"15min":0.53400000000000003},"min":{"1min":0.40699999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66700000000000004,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.49299999999999999,"15min":0.505},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66600000000000004,"5min":1.151,"15min":1.151},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.54200000000000004,"15min":0.56699999999999995},"min":{"1min":0.373,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.60099999999999998,"5min":0.83099999999999996,"15min":0.874},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73699999999999999,"15min":0.78400000000000003},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92700000000000005,"5min":1.1319999999999999,"15min":1.242},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73999999999999999,"15min":0.77800000000000002},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":0.81899999999999995,"5min":1.3560000000000001,"15min":1.3620000000000001},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.755,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.38400000000000001},"max":{"1min":0.89900000000000002,"5min":1.254,"15min":1.3700000000000001},"last":0.871},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.73099999999999998,"15min":0.78200000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":0.77400000000000002,"5min":1.0329999999999999,"15min":1.1759999999999999},"last":0.745}]},{"osd":6,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.52200000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93000000000000005,"5min":1.113,"15min":1.2050000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.754,"15min":0.78500000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":0.996,"5min":1.2010000000000001,"15min":1.2989999999999999},"last":0.83099999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.77000000000000002,"15min":0.80500000000000005},"min":{"1min":0.51100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.84199999999999997,"5min":1.3120000000000001,"15min":1.3640000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78200000000000003,"15min":0.81200000000000006},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.435},"max":{"1min":0.95099999999999996,"5min":1.325,"15min":1.325},"last":0.81100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:58:44.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2023-07-06T21:58:44.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2023-07-06T21:58:44.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2023-07-06T21:58:44.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2023-07-06T21:58:44.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2023-07-06T21:58:44.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2023-07-06T21:58:44.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2023-07-06T21:58:44.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2023-07-06T21:58:44.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2023-07-06T21:58:44.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2023-07-06T21:58:44.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2023-07-06T21:58:44.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2023-07-06T21:58:44.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2023-07-06T21:58:44.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2023-07-06T21:58:44.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2023-07-06T21:58:44.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2023-07-06T21:58:44.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2023-07-06T21:58:44.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2023-07-06T21:58:44.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2023-07-06T21:58:44.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2023-07-06T21:58:44.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2023-07-06T21:58:44.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2023-07-06T21:58:44.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2023-07-06T21:58:44.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2023-07-06T21:58:44.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2023-07-06T21:58:44.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2023-07-06T21:58:44.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2023-07-06T21:58:44.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2023-07-06T21:58:44.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2023-07-06T21:58:44.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2023-07-06T21:58:44.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2023-07-06T21:58:44.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2023-07-06T21:58:44.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2023-07-06T21:58:44.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-07-06T21:58:44.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.835709+0000', 'last_change': '2023-07-06T21:58:37.835709+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.835709+0000', 'last_undegraded': '2023-07-06T21:58:37.835709+0000', 'last_fullsized': '2023-07-06T21:58:37.835709+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:44.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-07-06T21:58:44.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-07-06T21:58:44.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.827967+0000', 'last_change': '2023-07-06T21:58:37.827967+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.827967+0000', 'last_undegraded': '2023-07-06T21:58:37.827967+0000', 'last_fullsized': '2023-07-06T21:58:37.827967+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T21:58:44.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-07-06T21:58:44.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-07-06T21:58:44.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.834699+0000', 'last_change': '2023-07-06T21:58:37.834699+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.834699+0000', 'last_undegraded': '2023-07-06T21:58:37.834699+0000', 'last_fullsized': '2023-07-06T21:58:37.834699+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:44.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-07-06T21:58:44.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-07-06T21:58:44.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.833844+0000', 'last_change': '2023-07-06T21:58:37.833844+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.833844+0000', 'last_undegraded': '2023-07-06T21:58:37.833844+0000', 'last_fullsized': '2023-07-06T21:58:37.833844+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:44.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2023-07-06T21:58:44.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-07-06T21:58:44.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.834291+0000', 'last_change': '2023-07-06T21:58:37.834291+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.834291+0000', 'last_undegraded': '2023-07-06T21:58:37.834291+0000', 'last_fullsized': '2023-07-06T21:58:37.834291+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T21:58:44.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2023-07-06T21:58:44.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-07-06T21:58:44.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.835339+0000', 'last_change': '2023-07-06T21:58:37.835339+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.835339+0000', 'last_undegraded': '2023-07-06T21:58:37.835339+0000', 'last_fullsized': '2023-07-06T21:58:37.835339+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:44.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-07-06T21:58:44.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-07-06T21:58:44.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.830974+0000', 'last_change': '2023-07-06T21:58:37.830974+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.830974+0000', 'last_undegraded': '2023-07-06T21:58:37.830974+0000', 'last_fullsized': '2023-07-06T21:58:37.830974+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T21:58:44.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-07-06T21:58:44.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-07-06T21:58:44.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.833190+0000', 'last_change': '2023-07-06T21:58:37.833190+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.833190+0000', 'last_undegraded': '2023-07-06T21:58:37.833190+0000', 'last_fullsized': '2023-07-06T21:58:37.833190+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T21:58:44.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-07-06T21:58:44.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-07-06T21:58:44.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.832771+0000', 'last_change': '2023-07-06T21:58:37.832771+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.832771+0000', 'last_undegraded': '2023-07-06T21:58:37.832771+0000', 'last_fullsized': '2023-07-06T21:58:37.832771+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T21:58:44.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-07-06T21:58:44.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-07-06T21:58:44.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.830870+0000', 'last_change': '2023-07-06T21:58:37.830870+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.830870+0000', 'last_undegraded': '2023-07-06T21:58:37.830870+0000', 'last_fullsized': '2023-07-06T21:58:37.830870+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T21:58:44.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-07-06T21:58:44.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-07-06T21:58:44.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.827932+0000', 'last_change': '2023-07-06T21:58:37.827932+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.827932+0000', 'last_undegraded': '2023-07-06T21:58:37.827932+0000', 'last_fullsized': '2023-07-06T21:58:37.827932+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T21:58:44.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2023-07-06T21:58:44.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-07-06T21:58:44.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.827580+0000', 'last_change': '2023-07-06T21:58:37.827580+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.827580+0000', 'last_undegraded': '2023-07-06T21:58:37.827580+0000', 'last_fullsized': '2023-07-06T21:58:37.827580+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T21:58:44.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-07-06T21:58:44.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-07-06T21:58:44.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.829155+0000', 'last_change': '2023-07-06T21:58:37.829155+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.829155+0000', 'last_undegraded': '2023-07-06T21:58:37.829155+0000', 'last_fullsized': '2023-07-06T21:58:37.829155+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T21:58:44.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-07-06T21:58:44.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-07-06T21:58:44.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.829131+0000', 'last_change': '2023-07-06T21:58:37.829131+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.829131+0000', 'last_undegraded': '2023-07-06T21:58:37.829131+0000', 'last_fullsized': '2023-07-06T21:58:37.829131+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T21:58:44.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-07-06T21:58:44.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-07-06T21:58:44.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.827613+0000', 'last_change': '2023-07-06T21:58:37.827613+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.827613+0000', 'last_undegraded': '2023-07-06T21:58:37.827613+0000', 'last_fullsized': '2023-07-06T21:58:37.827613+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T21:58:44.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2023-07-06T21:58:44.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-07-06T21:58:44.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.832694+0000', 'last_change': '2023-07-06T21:58:37.832694+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.832694+0000', 'last_undegraded': '2023-07-06T21:58:37.832694+0000', 'last_fullsized': '2023-07-06T21:58:37.832694+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T21:58:44.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-07-06T21:58:44.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-07-06T21:58:44.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.833521+0000', 'last_change': '2023-07-06T21:58:37.833521+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.833521+0000', 'last_undegraded': '2023-07-06T21:58:37.833521+0000', 'last_fullsized': '2023-07-06T21:58:37.833521+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T21:58:44.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-07-06T21:58:44.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-07-06T21:58:44.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.834437+0000', 'last_change': '2023-07-06T21:58:37.834437+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.834437+0000', 'last_undegraded': '2023-07-06T21:58:37.834437+0000', 'last_fullsized': '2023-07-06T21:58:37.834437+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:44.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-07-06T21:58:44.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-07-06T21:58:44.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.834168+0000', 'last_change': '2023-07-06T21:58:37.834168+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.834168+0000', 'last_undegraded': '2023-07-06T21:58:37.834168+0000', 'last_fullsized': '2023-07-06T21:58:37.834168+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:44.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-07-06T21:58:44.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-07-06T21:58:44.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.831111+0000', 'last_change': '2023-07-06T21:58:37.831111+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.831111+0000', 'last_undegraded': '2023-07-06T21:58:37.831111+0000', 'last_fullsized': '2023-07-06T21:58:37.831111+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T21:58:44.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2023-07-06T21:58:44.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-07-06T21:58:44.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.833063+0000', 'last_change': '2023-07-06T21:58:37.833063+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.833063+0000', 'last_undegraded': '2023-07-06T21:58:37.833063+0000', 'last_fullsized': '2023-07-06T21:58:37.833063+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:44.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-07-06T21:58:44.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-07-06T21:58:44.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.831014+0000', 'last_change': '2023-07-06T21:58:37.831014+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.831014+0000', 'last_undegraded': '2023-07-06T21:58:37.831014+0000', 'last_fullsized': '2023-07-06T21:58:37.831014+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T21:58:44.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2023-07-06T21:58:44.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-07-06T21:58:44.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.830935+0000', 'last_change': '2023-07-06T21:58:37.830935+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.830935+0000', 'last_undegraded': '2023-07-06T21:58:37.830935+0000', 'last_fullsized': '2023-07-06T21:58:37.830935+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T21:58:44.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-07-06T21:58:44.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-07-06T21:58:44.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.829100+0000', 'last_change': '2023-07-06T21:58:37.829100+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.829100+0000', 'last_undegraded': '2023-07-06T21:58:37.829100+0000', 'last_fullsized': '2023-07-06T21:58:37.829100+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T21:58:44.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2023-07-06T21:58:44.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-07-06T21:58:44.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.827964+0000', 'last_change': '2023-07-06T21:58:37.827964+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.827964+0000', 'last_undegraded': '2023-07-06T21:58:37.827964+0000', 'last_fullsized': '2023-07-06T21:58:37.827964+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T21:58:44.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2023-07-06T21:58:44.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-07-06T21:58:44.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.833328+0000', 'last_change': '2023-07-06T21:58:37.833328+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.833328+0000', 'last_undegraded': '2023-07-06T21:58:37.833328+0000', 'last_fullsized': '2023-07-06T21:58:37.833328+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:44.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2023-07-06T21:58:44.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-07-06T21:58:44.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.831092+0000', 'last_change': '2023-07-06T21:58:37.831092+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.831092+0000', 'last_undegraded': '2023-07-06T21:58:37.831092+0000', 'last_fullsized': '2023-07-06T21:58:37.831092+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T21:58:44.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-07-06T21:58:44.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-07-06T21:58:44.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.827580+0000', 'last_change': '2023-07-06T21:58:37.827580+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.827580+0000', 'last_undegraded': '2023-07-06T21:58:37.827580+0000', 'last_fullsized': '2023-07-06T21:58:37.827580+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T21:58:44.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-07-06T21:58:44.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-07-06T21:58:44.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.833003+0000', 'last_change': '2023-07-06T21:58:37.833003+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.833003+0000', 'last_undegraded': '2023-07-06T21:58:37.833003+0000', 'last_fullsized': '2023-07-06T21:58:37.833003+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:44.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2023-07-06T21:58:44.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-07-06T21:58:44.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.833494+0000', 'last_change': '2023-07-06T21:58:37.833494+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.833494+0000', 'last_undegraded': '2023-07-06T21:58:37.833494+0000', 'last_fullsized': '2023-07-06T21:58:37.833494+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T21:58:44.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2023-07-06T21:58:44.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-07-06T21:58:44.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.833545+0000', 'last_change': '2023-07-06T21:58:37.833545+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.833545+0000', 'last_undegraded': '2023-07-06T21:58:37.833545+0000', 'last_fullsized': '2023-07-06T21:58:37.833545+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T21:58:44.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2023-07-06T21:58:44.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T21:58:38.824910+0000', 'last_change': '2023-07-06T21:58:38.824910+0000', 'last_active': '2023-07-06T21:58:38.824910+0000', 'last_peered': '2023-07-06T21:58:38.824910+0000', 'last_clean': '2023-07-06T21:58:38.824910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:38.824910+0000', 'last_undegraded': '2023-07-06T21:58:38.824910+0000', 'last_fullsized': '2023-07-06T21:58:38.824910+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:38.824910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T21:58:44.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-07-06T21:58:44.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2023-07-06T21:58:37.833584+0000', 'last_change': '2023-07-06T21:58:37.833584+0000', 'last_active': '2023-07-06T21:58:37.813712+0000', 'last_peered': '2023-07-06T21:58:37.813712+0000', 'last_clean': '2023-07-06T21:58:37.813712+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T21:58:37.833584+0000', 'last_undegraded': '2023-07-06T21:58:37.833584+0000', 'last_fullsized': '2023-07-06T21:58:37.833584+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'last_clean_scrub_stamp': '2023-07-06T21:58:37.813712+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T21:58:44.250 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-06T21:58:44.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce7d74640 1 Processor -- start 2023-07-06T21:58:44.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce7d74640 1 -- start start 2023-07-06T21:58:44.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce7d74640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcce0160030 0x7fcce0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:44.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce7d74640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcce00cda40 0x7fcce00cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:44.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce7d74640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce006bd00 con 0x7fcce0071050 2023-07-06T21:58:44.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce7d74640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce0160400 con 0x7fcce0160030 2023-07-06T21:58:44.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce7d74640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce0071540 con 0x7fcce00cda40 2023-07-06T21:58:44.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce530f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcce0071050 0x7fcce00cd330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44458/0 (socket says 172.21.15.55:44458) 2023-07-06T21:58:44.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce530f640 1 -- 172.21.15.55:0/2837297803 learned_addr learned my addr 172.21.15.55:0/2837297803 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:44.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce5b10640 1 --2- 172.21.15.55:0/2837297803 >> v2:172.21.15.55:3300/0 conn(0x7fcce0160030 0x7fcce0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:44.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce6311640 1 --2- 172.21.15.55:0/2837297803 >> v2:172.21.15.138:3300/0 conn(0x7fcce00cda40 0x7fcce00cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:44.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce5b10640 1 -- 172.21.15.55:0/2837297803 >> v2:172.21.15.138:3300/0 conn(0x7fcce00cda40 msgr2=0x7fcce00cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:44.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce5b10640 1 --2- 172.21.15.55:0/2837297803 >> v2:172.21.15.138:3300/0 conn(0x7fcce00cda40 0x7fcce00cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce5b10640 1 -- 172.21.15.55:0/2837297803 >> v1:172.21.15.55:6789/0 conn(0x7fcce0071050 legacy=0x7fcce00cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.395+0000 7fcce5b10640 1 -- 172.21.15.55:0/2837297803 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce00c9ba0 con 0x7fcce0160030 2023-07-06T21:58:44.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.399+0000 7fcce5b10640 1 --2- 172.21.15.55:0/2837297803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce0160030 0x7fcce0070b10 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fcce00ad900 tx=0x7fccdc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78410e0a0cfef07c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:44.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.399+0000 7fcce4b0e640 1 -- 172.21.15.55:0/2837297803 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc004230 con 0x7fcce0160030 2023-07-06T21:58:44.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.399+0000 7fcce4b0e640 1 -- 172.21.15.55:0/2837297803 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc0a7050 con 0x7fcce0160030 2023-07-06T21:58:44.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.399+0000 7fcce4b0e640 1 -- 172.21.15.55:0/2837297803 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc003620 con 0x7fcce0160030 2023-07-06T21:58:44.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.399+0000 7fcce7d74640 1 -- 172.21.15.55:0/2837297803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce0160030 msgr2=0x7fcce0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.399+0000 7fcce7d74640 1 --2- 172.21.15.55:0/2837297803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce0160030 0x7fcce0070b10 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fcce00ad900 tx=0x7fccdc01c460 comp rx=0 tx=0).stop 2023-07-06T21:58:44.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.399+0000 7fcce7d74640 1 -- 172.21.15.55:0/2837297803 shutdown_connections 2023-07-06T21:58:44.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.399+0000 7fcce7d74640 1 --2- 172.21.15.55:0/2837297803 >> v2:172.21.15.138:3300/0 conn(0x7fcce00cda40 0x7fcce00cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.399+0000 7fcce7d74640 1 --2- 172.21.15.55:0/2837297803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce0160030 0x7fcce0070b10 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.399+0000 7fcce7d74640 1 -- 172.21.15.55:0/2837297803 >> 172.21.15.55:0/2837297803 conn(0x7fcce00cded0 msgr2=0x7fcce00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:44.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.399+0000 7fcce7d74640 1 -- 172.21.15.55:0/2837297803 shutdown_connections 2023-07-06T21:58:44.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.399+0000 7fcce7d74640 1 -- 172.21.15.55:0/2837297803 wait complete. 2023-07-06T21:58:44.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce7d74640 1 Processor -- start 2023-07-06T21:58:44.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce7d74640 1 -- start start 2023-07-06T21:58:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce7d74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce0071050 0x7fcce00aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce7d74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcce00cda40 0x7fcce00af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce7d74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcce0160030 0x7fcce00c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce7d74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0160540 con 0x7fcce0071050 2023-07-06T21:58:44.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce7d74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0161360 con 0x7fcce0160030 2023-07-06T21:58:44.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce7d74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0161e70 con 0x7fcce00cda40 2023-07-06T21:58:44.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce5b10640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce0071050 0x7fcce00aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:44.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce5b10640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce0071050 0x7fcce00aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50222/0 (socket says 172.21.15.55:50222) 2023-07-06T21:58:44.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce5b10640 1 -- 172.21.15.55:0/2288021386 learned_addr learned my addr 172.21.15.55:0/2288021386 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:44.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce6311640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcce0160030 0x7fcce00c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:44.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce530f640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcce00cda40 0x7fcce00af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:44.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce5b10640 1 -- 172.21.15.55:0/2288021386 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcce00cda40 msgr2=0x7fcce00af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce5b10640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcce00cda40 0x7fcce00af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce5b10640 1 -- 172.21.15.55:0/2288021386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcce0160030 msgr2=0x7fcce00c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce5b10640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcce0160030 0x7fcce00c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce5b10640 1 -- 172.21.15.55:0/2288021386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc009420 con 0x7fcce0071050 2023-07-06T21:58:44.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce530f640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcce00cda40 0x7fcce00af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:44.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce5b10640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce0071050 0x7fcce00aeb10 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0ae040 tx=0x7fccdc019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:44.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fccd67fc640 1 -- 172.21.15.55:0/2288021386 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc003b70 con 0x7fcce0071050 2023-07-06T21:58:44.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fccd67fc640 1 -- 172.21.15.55:0/2288021386 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc003cd0 con 0x7fcce0071050 2023-07-06T21:58:44.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fccd67fc640 1 -- 172.21.15.55:0/2288021386 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0ab680 con 0x7fcce0071050 2023-07-06T21:58:44.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce7d74640 1 -- 172.21.15.55:0/2288021386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce0160750 con 0x7fcce0071050 2023-07-06T21:58:44.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce7d74640 1 -- 172.21.15.55:0/2288021386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce0160d10 con 0x7fcce0071050 2023-07-06T21:58:44.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.403+0000 7fcce7d74640 1 -- 172.21.15.55:0/2288021386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce0066d60 con 0x7fcce0071050 2023-07-06T21:58:44.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.407+0000 7fccd67fc640 1 -- 172.21.15.55:0/2288021386 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fccdc0b2040 con 0x7fcce0071050 2023-07-06T21:58:44.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.407+0000 7fccd67fc640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fccc40663a0 0x7fccc4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:44.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.407+0000 7fccd67fc640 1 -- 172.21.15.55:0/2288021386 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fccdc11dfb0 con 0x7fcce0071050 2023-07-06T21:58:44.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.407+0000 7fcce530f640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fccc40663a0 0x7fccc4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:44.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.407+0000 7fcce530f640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fccc40663a0 0x7fccc4068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcce00c1b20 tx=0x7fccd0009040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:44.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.411+0000 7fccd67fc640 1 -- 172.21.15.55:0/2288021386 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fccdc0eb030 con 0x7fcce0071050 2023-07-06T21:58:44.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.623+0000 7fcce7d74640 1 -- 172.21.15.55:0/2288021386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fcce00b3e50 con 0x7fcce0071050 2023-07-06T21:58:44.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.623+0000 7fccd67fc640 1 -- 172.21.15.55:0/2288021386 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3307 (secure 0 0 0) 0x7fccdc0ee650 con 0x7fcce0071050 2023-07-06T21:58:44.622 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:44.622 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1020,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":117,"num_osds":8,"num_up_osds":8,"osd_up_since":1688679717,"num_in_osds":8,"osd_in_since":1688679707,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":314593280,"bytes_avail":772779520000,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":47,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"b","status":"up:active","gid":8049}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-07-06T21:58:26.735402+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-06T21:58:44.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.623+0000 7fcce7d74640 1 -- 172.21.15.55:0/2288021386 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fccc40663a0 msgr2=0x7fccc4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.623+0000 7fcce7d74640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fccc40663a0 0x7fccc4068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcce00c1b20 tx=0x7fccd0009040 comp rx=0 tx=0).stop 2023-07-06T21:58:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.623+0000 7fcce7d74640 1 -- 172.21.15.55:0/2288021386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce0071050 msgr2=0x7fcce00aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.623+0000 7fcce7d74640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce0071050 0x7fcce00aeb10 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0ae040 tx=0x7fccdc019200 comp rx=0 tx=0).stop 2023-07-06T21:58:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.623+0000 7fcce7d74640 1 -- 172.21.15.55:0/2288021386 shutdown_connections 2023-07-06T21:58:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.623+0000 7fcce7d74640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fccc40663a0 0x7fccc4068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.623+0000 7fcce7d74640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcce0160030 0x7fcce00c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.623+0000 7fcce7d74640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcce00cda40 0x7fcce00af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.623+0000 7fcce7d74640 1 --2- 172.21.15.55:0/2288021386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce0071050 0x7fcce00aeb10 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.623+0000 7fcce7d74640 1 -- 172.21.15.55:0/2288021386 >> 172.21.15.55:0/2288021386 conn(0x7fcce00cded0 msgr2=0x7fcce006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.623+0000 7fcce7d74640 1 -- 172.21.15.55:0/2288021386 shutdown_connections 2023-07-06T21:58:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.623+0000 7fcce7d74640 1 -- 172.21.15.55:0/2288021386 wait complete. 2023-07-06T21:58:44.643 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-06T21:58:44.643 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:58:44.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.787+0000 7f9bb3a18640 1 Processor -- start 2023-07-06T21:58:44.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.787+0000 7f9bb3a18640 1 -- start start 2023-07-06T21:58:44.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.791+0000 7f9bb3a18640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9bac15fd40 0x7f9bac06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:44.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.791+0000 7f9bb3a18640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bac0ca880 con 0x7f9bac160110 2023-07-06T21:58:44.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.791+0000 7f9bb3a18640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bac15cd90 con 0x7f9bac06caf0 2023-07-06T21:58:44.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.791+0000 7f9bb3a18640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bac0c9c90 con 0x7f9bac15fd40 2023-07-06T21:58:44.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.791+0000 7f9bb0fb3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9bac160110 0x7f9bac06c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44472/0 (socket says 172.21.15.55:44472) 2023-07-06T21:58:44.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.791+0000 7f9bb0fb3640 1 -- 172.21.15.55:0/2580327045 learned_addr learned my addr 172.21.15.55:0/2580327045 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:44.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.791+0000 7f9bb17b4640 1 --2- 172.21.15.55:0/2580327045 >> v2:172.21.15.138:3300/0 conn(0x7f9bac15fd40 0x7f9bac06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:44.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.791+0000 7f9ba3fff640 1 -- 172.21.15.55:0/2580327045 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847376250 0 0) 0x7f9bac0ca880 con 0x7f9bac160110 2023-07-06T21:58:44.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.791+0000 7f9ba3fff640 1 -- 172.21.15.55:0/2580327045 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b98003530 con 0x7f9bac160110 2023-07-06T21:58:44.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.791+0000 7f9bb17b4640 1 -- 172.21.15.55:0/2580327045 >> v1:172.21.15.138:6789/0 conn(0x7f9bac06caf0 legacy=0x7f9bac0ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.791+0000 7f9bb17b4640 1 -- 172.21.15.55:0/2580327045 >> v1:172.21.15.55:6789/0 conn(0x7f9bac160110 legacy=0x7f9bac06c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.791+0000 7f9bb17b4640 1 -- 172.21.15.55:0/2580327045 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac0c9f50 con 0x7f9bac15fd40 2023-07-06T21:58:44.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.795+0000 7f9bb17b4640 1 --2- 172.21.15.55:0/2580327045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac15fd40 0x7f9bac06e590 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80097c0 tx=0x7f9ba801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fe3419de24730cf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:44.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.795+0000 7f9ba3fff640 1 -- 172.21.15.55:0/2580327045 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80ab650 con 0x7f9bac15fd40 2023-07-06T21:58:44.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.795+0000 7f9ba3fff640 1 -- 172.21.15.55:0/2580327045 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba80ab7b0 con 0x7f9bac15fd40 2023-07-06T21:58:44.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.795+0000 7f9ba3fff640 1 -- 172.21.15.55:0/2580327045 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80abb40 con 0x7f9bac15fd40 2023-07-06T21:58:44.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.795+0000 7f9bb3a18640 1 -- 172.21.15.55:0/2580327045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac15fd40 msgr2=0x7f9bac06e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.795+0000 7f9bb3a18640 1 --2- 172.21.15.55:0/2580327045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac15fd40 0x7f9bac06e590 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80097c0 tx=0x7f9ba801c450 comp rx=0 tx=0).stop 2023-07-06T21:58:44.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.795+0000 7f9bb3a18640 1 -- 172.21.15.55:0/2580327045 shutdown_connections 2023-07-06T21:58:44.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.795+0000 7f9bb3a18640 1 --2- 172.21.15.55:0/2580327045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac15fd40 0x7f9bac06e590 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.795+0000 7f9bb3a18640 1 -- 172.21.15.55:0/2580327045 >> 172.21.15.55:0/2580327045 conn(0x7f9bac0b1730 msgr2=0x7f9bac0cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:44.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.795+0000 7f9bb3a18640 1 -- 172.21.15.55:0/2580327045 shutdown_connections 2023-07-06T21:58:44.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.795+0000 7f9bb3a18640 1 -- 172.21.15.55:0/2580327045 wait complete. 2023-07-06T21:58:44.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.795+0000 7f9bb3a18640 1 Processor -- start 2023-07-06T21:58:44.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.795+0000 7f9bb3a18640 1 -- start start 2023-07-06T21:58:44.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb3a18640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bac06caf0 0x7f9bac150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:44.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb3a18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bac15fd40 0x7f9bac0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:44.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb3a18640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac160110 0x7f9bac0c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:44.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb3a18640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac1512e0 con 0x7f9bac15fd40 2023-07-06T21:58:44.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb3a18640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0c9150 con 0x7f9bac160110 2023-07-06T21:58:44.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb3a18640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0c41f0 con 0x7f9bac06caf0 2023-07-06T21:58:44.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb0fb3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bac15fd40 0x7f9bac0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:44.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb0fb3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bac15fd40 0x7f9bac0c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50224/0 (socket says 172.21.15.55:50224) 2023-07-06T21:58:44.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb0fb3640 1 -- 172.21.15.55:0/856309586 learned_addr learned my addr 172.21.15.55:0/856309586 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:44.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb17b4640 1 --2- 172.21.15.55:0/856309586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bac06caf0 0x7f9bac150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:44.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb1fb5640 1 --2- 172.21.15.55:0/856309586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac160110 0x7f9bac0c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:44.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb0fb3640 1 -- 172.21.15.55:0/856309586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bac06caf0 msgr2=0x7f9bac150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb0fb3640 1 --2- 172.21.15.55:0/856309586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bac06caf0 0x7f9bac150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb0fb3640 1 -- 172.21.15.55:0/856309586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac160110 msgr2=0x7f9bac0c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb0fb3640 1 --2- 172.21.15.55:0/856309586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac160110 0x7f9bac0c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb0fb3640 1 -- 172.21.15.55:0/856309586 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba8009420 con 0x7f9bac15fd40 2023-07-06T21:58:44.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb0fb3640 1 --2- 172.21.15.55:0/856309586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bac15fd40 0x7f9bac0c6040 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00c420 tx=0x7f9b9c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:44.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9ba1ffb640 1 -- 172.21.15.55:0/856309586 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c005cf0 con 0x7f9bac15fd40 2023-07-06T21:58:44.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9ba1ffb640 1 -- 172.21.15.55:0/856309586 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c005e50 con 0x7f9bac15fd40 2023-07-06T21:58:44.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb3a18640 1 -- 172.21.15.55:0/856309586 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bac06ec50 con 0x7f9bac15fd40 2023-07-06T21:58:44.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9ba1ffb640 1 -- 172.21.15.55:0/856309586 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0072d0 con 0x7f9bac15fd40 2023-07-06T21:58:44.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb3a18640 1 -- 172.21.15.55:0/856309586 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac0c47b0 con 0x7f9bac15fd40 2023-07-06T21:58:44.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.799+0000 7f9bb3a18640 1 -- 172.21.15.55:0/856309586 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac066d60 con 0x7f9bac15fd40 2023-07-06T21:58:44.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.803+0000 7f9ba1ffb640 1 -- 172.21.15.55:0/856309586 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9b9c007430 con 0x7f9bac15fd40 2023-07-06T21:58:44.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.803+0000 7f9ba1ffb640 1 --2- 172.21.15.55:0/856309586 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f9b900663a0 0x7f9b90068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:44.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.803+0000 7f9ba1ffb640 1 -- 172.21.15.55:0/856309586 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9b9c083550 con 0x7f9bac15fd40 2023-07-06T21:58:44.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.803+0000 7f9bb17b4640 1 --2- 172.21.15.55:0/856309586 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f9b900663a0 0x7f9b90068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:44.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.803+0000 7f9bb17b4640 1 --2- 172.21.15.55:0/856309586 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f9b900663a0 0x7f9b90068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80af000 tx=0x7f9ba80a7000 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:44.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.807+0000 7f9ba1ffb640 1 -- 172.21.15.55:0/856309586 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b9c050790 con 0x7f9bac15fd40 2023-07-06T21:58:44.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.959+0000 7f9bb3a18640 1 -- 172.21.15.55:0/856309586 --> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9bac06ead0 con 0x7f9b900663a0 2023-07-06T21:58:44.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.967+0000 7f9ba1ffb640 1 -- 172.21.15.55:0/856309586 <== mgr.7782 v2:172.21.15.55:6832/1408736549 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312058 (secure 0 0 0) 0x7f9ba80ab920 con 0x7f9b900663a0 2023-07-06T21:58:44.968 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:44.969 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:58:44.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.971+0000 7f9bb3a18640 1 -- 172.21.15.55:0/856309586 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f9b900663a0 msgr2=0x7f9b90068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.971+0000 7f9bb3a18640 1 --2- 172.21.15.55:0/856309586 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f9b900663a0 0x7f9b90068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80af000 tx=0x7f9ba80a7000 comp rx=0 tx=0).stop 2023-07-06T21:58:44.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.971+0000 7f9bb3a18640 1 -- 172.21.15.55:0/856309586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bac15fd40 msgr2=0x7f9bac0c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:44.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.971+0000 7f9bb3a18640 1 --2- 172.21.15.55:0/856309586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bac15fd40 0x7f9bac0c6040 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00c420 tx=0x7f9b9c00c8e0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.971+0000 7f9bb3a18640 1 -- 172.21.15.55:0/856309586 shutdown_connections 2023-07-06T21:58:44.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.971+0000 7f9bb3a18640 1 --2- 172.21.15.55:0/856309586 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f9b900663a0 0x7f9b90068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.971+0000 7f9bb3a18640 1 --2- 172.21.15.55:0/856309586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac160110 0x7f9bac0c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.971+0000 7f9bb3a18640 1 --2- 172.21.15.55:0/856309586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bac15fd40 0x7f9bac0c6040 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.971+0000 7f9bb3a18640 1 --2- 172.21.15.55:0/856309586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bac06caf0 0x7f9bac150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:44.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.971+0000 7f9bb3a18640 1 -- 172.21.15.55:0/856309586 >> 172.21.15.55:0/856309586 conn(0x7f9bac0b1730 msgr2=0x7f9bac15b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:44.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.971+0000 7f9bb3a18640 1 -- 172.21.15.55:0/856309586 shutdown_connections 2023-07-06T21:58:44.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:44.971+0000 7f9bb3a18640 1 -- 172.21.15.55:0/856309586 wait complete. 2023-07-06T21:58:44.988 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-06T21:58:44.738789+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":363,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":243,"ondisk_log_size":243,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307584,"kb_used_data":12480,"kb_used_omap":0,"kb_used_meta":295040,"kb_avail":754667136,"statfs":{"total":773094113280,"available":772779147264,"internally_reserved":0,"allocated":12779520,"data_stored":7272814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":302120960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001236"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.256948+0000","last_change":"2023-07-06T21:58:39.282453+0000","last_active":"2023-07-06T21:58:40.256948+0000","last_peered":"2023-07-06T21:58:40.256948+0000","last_clean":"2023-07-06T21:58:40.256948+0000","last_became_active":"2023-07-06T21:58:39.282134+0000","last_became_peered":"2023-07-06T21:58:39.282134+0000","last_unstale":"2023-07-06T21:58:40.256948+0000","last_undegraded":"2023-07-06T21:58:40.256948+0000","last_fullsized":"2023-07-06T21:58:40.256948+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:47:30.651611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599107+0000","last_change":"2023-07-06T21:58:39.289707+0000","last_active":"2023-07-06T21:58:40.599107+0000","last_peered":"2023-07-06T21:58:40.599107+0000","last_clean":"2023-07-06T21:58:40.599107+0000","last_became_active":"2023-07-06T21:58:39.289350+0000","last_became_peered":"2023-07-06T21:58:39.289350+0000","last_unstale":"2023-07-06T21:58:40.599107+0000","last_undegraded":"2023-07-06T21:58:40.599107+0000","last_fullsized":"2023-07-06T21:58:40.599107+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:53:42.601956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257431+0000","last_change":"2023-07-06T21:58:39.277012+0000","last_active":"2023-07-06T21:58:40.257431+0000","last_peered":"2023-07-06T21:58:40.257431+0000","last_clean":"2023-07-06T21:58:40.257431+0000","last_became_active":"2023-07-06T21:58:39.276742+0000","last_became_peered":"2023-07-06T21:58:39.276742+0000","last_unstale":"2023-07-06T21:58:40.257431+0000","last_undegraded":"2023-07-06T21:58:40.257431+0000","last_fullsized":"2023-07-06T21:58:40.257431+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:02:28.324674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599395+0000","last_change":"2023-07-06T21:58:39.269556+0000","last_active":"2023-07-06T21:58:40.599395+0000","last_peered":"2023-07-06T21:58:40.599395+0000","last_clean":"2023-07-06T21:58:40.599395+0000","last_became_active":"2023-07-06T21:58:39.269307+0000","last_became_peered":"2023-07-06T21:58:39.269307+0000","last_unstale":"2023-07-06T21:58:40.599395+0000","last_undegraded":"2023-07-06T21:58:40.599395+0000","last_fullsized":"2023-07-06T21:58:40.599395+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:19:53.392577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599414+0000","last_change":"2023-07-06T21:58:39.286746+0000","last_active":"2023-07-06T21:58:40.599414+0000","last_peered":"2023-07-06T21:58:40.599414+0000","last_clean":"2023-07-06T21:58:40.599414+0000","last_became_active":"2023-07-06T21:58:39.286373+0000","last_became_peered":"2023-07-06T21:58:39.286373+0000","last_unstale":"2023-07-06T21:58:40.599414+0000","last_undegraded":"2023-07-06T21:58:40.599414+0000","last_fullsized":"2023-07-06T21:58:40.599414+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:19.472882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387026+0000","last_change":"2023-07-06T21:58:39.280606+0000","last_active":"2023-07-06T21:58:40.387026+0000","last_peered":"2023-07-06T21:58:40.387026+0000","last_clean":"2023-07-06T21:58:40.387026+0000","last_became_active":"2023-07-06T21:58:39.280323+0000","last_became_peered":"2023-07-06T21:58:39.280323+0000","last_unstale":"2023-07-06T21:58:40.387026+0000","last_undegraded":"2023-07-06T21:58:40.387026+0000","last_fullsized":"2023-07-06T21:58:40.387026+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:42:17.057952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387040+0000","last_change":"2023-07-06T21:58:39.277753+0000","last_active":"2023-07-06T21:58:40.387040+0000","last_peered":"2023-07-06T21:58:40.387040+0000","last_clean":"2023-07-06T21:58:40.387040+0000","last_became_active":"2023-07-06T21:58:39.277407+0000","last_became_peered":"2023-07-06T21:58:39.277407+0000","last_unstale":"2023-07-06T21:58:40.387040+0000","last_undegraded":"2023-07-06T21:58:40.387040+0000","last_fullsized":"2023-07-06T21:58:40.387040+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:36:07.215019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598641+0000","last_change":"2023-07-06T21:58:39.269638+0000","last_active":"2023-07-06T21:58:40.598641+0000","last_peered":"2023-07-06T21:58:40.598641+0000","last_clean":"2023-07-06T21:58:40.598641+0000","last_became_active":"2023-07-06T21:58:39.269372+0000","last_became_peered":"2023-07-06T21:58:39.269372+0000","last_unstale":"2023-07-06T21:58:40.598641+0000","last_undegraded":"2023-07-06T21:58:40.598641+0000","last_fullsized":"2023-07-06T21:58:40.598641+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:20.263915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599481+0000","last_change":"2023-07-06T21:58:39.274340+0000","last_active":"2023-07-06T21:58:40.599481+0000","last_peered":"2023-07-06T21:58:40.599481+0000","last_clean":"2023-07-06T21:58:40.599481+0000","last_became_active":"2023-07-06T21:58:39.273758+0000","last_became_peered":"2023-07-06T21:58:39.273758+0000","last_unstale":"2023-07-06T21:58:40.599481+0000","last_undegraded":"2023-07-06T21:58:40.599481+0000","last_fullsized":"2023-07-06T21:58:40.599481+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:53:22.474644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599642+0000","last_change":"2023-07-06T21:58:39.282561+0000","last_active":"2023-07-06T21:58:40.599642+0000","last_peered":"2023-07-06T21:58:40.599642+0000","last_clean":"2023-07-06T21:58:40.599642+0000","last_became_active":"2023-07-06T21:58:39.282275+0000","last_became_peered":"2023-07-06T21:58:39.282275+0000","last_unstale":"2023-07-06T21:58:40.599642+0000","last_undegraded":"2023-07-06T21:58:40.599642+0000","last_fullsized":"2023-07-06T21:58:40.599642+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:44.272927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.386896+0000","last_change":"2023-07-06T21:58:39.275129+0000","last_active":"2023-07-06T21:58:40.386896+0000","last_peered":"2023-07-06T21:58:40.386896+0000","last_clean":"2023-07-06T21:58:40.386896+0000","last_became_active":"2023-07-06T21:58:39.274822+0000","last_became_peered":"2023-07-06T21:58:39.274822+0000","last_unstale":"2023-07-06T21:58:40.386896+0000","last_undegraded":"2023-07-06T21:58:40.386896+0000","last_fullsized":"2023-07-06T21:58:40.386896+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:08:43.129480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599939+0000","last_change":"2023-07-06T21:58:39.279809+0000","last_active":"2023-07-06T21:58:40.599939+0000","last_peered":"2023-07-06T21:58:40.599939+0000","last_clean":"2023-07-06T21:58:40.599939+0000","last_became_active":"2023-07-06T21:58:39.279525+0000","last_became_peered":"2023-07-06T21:58:39.279525+0000","last_unstale":"2023-07-06T21:58:40.599939+0000","last_undegraded":"2023-07-06T21:58:40.599939+0000","last_fullsized":"2023-07-06T21:58:40.599939+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:06:20.242221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599299+0000","last_change":"2023-07-06T21:58:39.275399+0000","last_active":"2023-07-06T21:58:40.599299+0000","last_peered":"2023-07-06T21:58:40.599299+0000","last_clean":"2023-07-06T21:58:40.599299+0000","last_became_active":"2023-07-06T21:58:39.274381+0000","last_became_peered":"2023-07-06T21:58:39.274381+0000","last_unstale":"2023-07-06T21:58:40.599299+0000","last_undegraded":"2023-07-06T21:58:40.599299+0000","last_fullsized":"2023-07-06T21:58:40.599299+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:36:30.315472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258347+0000","last_change":"2023-07-06T21:58:39.279019+0000","last_active":"2023-07-06T21:58:40.258347+0000","last_peered":"2023-07-06T21:58:40.258347+0000","last_clean":"2023-07-06T21:58:40.258347+0000","last_became_active":"2023-07-06T21:58:39.278748+0000","last_became_peered":"2023-07-06T21:58:39.278748+0000","last_unstale":"2023-07-06T21:58:40.258347+0000","last_undegraded":"2023-07-06T21:58:40.258347+0000","last_fullsized":"2023-07-06T21:58:40.258347+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:07:50.048872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598575+0000","last_change":"2023-07-06T21:58:39.269209+0000","last_active":"2023-07-06T21:58:40.598575+0000","last_peered":"2023-07-06T21:58:40.598575+0000","last_clean":"2023-07-06T21:58:40.598575+0000","last_became_active":"2023-07-06T21:58:39.268941+0000","last_became_peered":"2023-07-06T21:58:39.268941+0000","last_unstale":"2023-07-06T21:58:40.598575+0000","last_undegraded":"2023-07-06T21:58:40.598575+0000","last_fullsized":"2023-07-06T21:58:40.598575+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:45:57.180404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.386881+0000","last_change":"2023-07-06T21:58:39.275722+0000","last_active":"2023-07-06T21:58:40.386881+0000","last_peered":"2023-07-06T21:58:40.386881+0000","last_clean":"2023-07-06T21:58:40.386881+0000","last_became_active":"2023-07-06T21:58:39.271933+0000","last_became_peered":"2023-07-06T21:58:39.271933+0000","last_unstale":"2023-07-06T21:58:40.386881+0000","last_undegraded":"2023-07-06T21:58:40.386881+0000","last_fullsized":"2023-07-06T21:58:40.386881+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:46:41.341881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599158+0000","last_change":"2023-07-06T21:58:39.289925+0000","last_active":"2023-07-06T21:58:40.599158+0000","last_peered":"2023-07-06T21:58:40.599158+0000","last_clean":"2023-07-06T21:58:40.599158+0000","last_became_active":"2023-07-06T21:58:39.289603+0000","last_became_peered":"2023-07-06T21:58:39.289603+0000","last_unstale":"2023-07-06T21:58:40.599158+0000","last_undegraded":"2023-07-06T21:58:40.599158+0000","last_fullsized":"2023-07-06T21:58:40.599158+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:18:57.399675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599601+0000","last_change":"2023-07-06T21:58:39.270453+0000","last_active":"2023-07-06T21:58:40.599601+0000","last_peered":"2023-07-06T21:58:40.599601+0000","last_clean":"2023-07-06T21:58:40.599601+0000","last_became_active":"2023-07-06T21:58:39.270194+0000","last_became_peered":"2023-07-06T21:58:39.270194+0000","last_unstale":"2023-07-06T21:58:40.599601+0000","last_undegraded":"2023-07-06T21:58:40.599601+0000","last_fullsized":"2023-07-06T21:58:40.599601+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:08:48.342650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258695+0000","last_change":"2023-07-06T21:58:39.277368+0000","last_active":"2023-07-06T21:58:40.258695+0000","last_peered":"2023-07-06T21:58:40.258695+0000","last_clean":"2023-07-06T21:58:40.258695+0000","last_became_active":"2023-07-06T21:58:39.277073+0000","last_became_peered":"2023-07-06T21:58:39.277073+0000","last_unstale":"2023-07-06T21:58:40.258695+0000","last_undegraded":"2023-07-06T21:58:40.258695+0000","last_fullsized":"2023-07-06T21:58:40.258695+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:33:02.283894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599983+0000","last_change":"2023-07-06T21:58:39.274095+0000","last_active":"2023-07-06T21:58:40.599983+0000","last_peered":"2023-07-06T21:58:40.599983+0000","last_clean":"2023-07-06T21:58:40.599983+0000","last_became_active":"2023-07-06T21:58:39.273786+0000","last_became_peered":"2023-07-06T21:58:39.273786+0000","last_unstale":"2023-07-06T21:58:40.599983+0000","last_undegraded":"2023-07-06T21:58:40.599983+0000","last_fullsized":"2023-07-06T21:58:40.599983+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:15:27.302960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258631+0000","last_change":"2023-07-06T21:58:39.277955+0000","last_active":"2023-07-06T21:58:40.258631+0000","last_peered":"2023-07-06T21:58:40.258631+0000","last_clean":"2023-07-06T21:58:40.258631+0000","last_became_active":"2023-07-06T21:58:39.277704+0000","last_became_peered":"2023-07-06T21:58:39.277704+0000","last_unstale":"2023-07-06T21:58:40.258631+0000","last_undegraded":"2023-07-06T21:58:40.258631+0000","last_fullsized":"2023-07-06T21:58:40.258631+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:48.167586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598744+0000","last_change":"2023-07-06T21:58:39.289577+0000","last_active":"2023-07-06T21:58:40.598744+0000","last_peered":"2023-07-06T21:58:40.598744+0000","last_clean":"2023-07-06T21:58:40.598744+0000","last_became_active":"2023-07-06T21:58:39.289240+0000","last_became_peered":"2023-07-06T21:58:39.289240+0000","last_unstale":"2023-07-06T21:58:40.598744+0000","last_undegraded":"2023-07-06T21:58:40.598744+0000","last_fullsized":"2023-07-06T21:58:40.598744+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:34:36.068693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599611+0000","last_change":"2023-07-06T21:58:39.278386+0000","last_active":"2023-07-06T21:58:40.599611+0000","last_peered":"2023-07-06T21:58:40.599611+0000","last_clean":"2023-07-06T21:58:40.599611+0000","last_became_active":"2023-07-06T21:58:39.278138+0000","last_became_peered":"2023-07-06T21:58:39.278138+0000","last_unstale":"2023-07-06T21:58:40.599611+0000","last_undegraded":"2023-07-06T21:58:40.599611+0000","last_fullsized":"2023-07-06T21:58:40.599611+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:15:50.197397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387164+0000","last_change":"2023-07-06T21:58:39.275974+0000","last_active":"2023-07-06T21:58:40.387164+0000","last_peered":"2023-07-06T21:58:40.387164+0000","last_clean":"2023-07-06T21:58:40.387164+0000","last_became_active":"2023-07-06T21:58:39.272538+0000","last_became_peered":"2023-07-06T21:58:39.272538+0000","last_unstale":"2023-07-06T21:58:40.387164+0000","last_undegraded":"2023-07-06T21:58:40.387164+0000","last_fullsized":"2023-07-06T21:58:40.387164+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:34.754788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599789+0000","last_change":"2023-07-06T21:58:39.292400+0000","last_active":"2023-07-06T21:58:40.599789+0000","last_peered":"2023-07-06T21:58:40.599789+0000","last_clean":"2023-07-06T21:58:40.599789+0000","last_became_active":"2023-07-06T21:58:39.292035+0000","last_became_peered":"2023-07-06T21:58:39.292035+0000","last_unstale":"2023-07-06T21:58:40.599789+0000","last_undegraded":"2023-07-06T21:58:40.599789+0000","last_fullsized":"2023-07-06T21:58:40.599789+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:31:43.264672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599240+0000","last_change":"2023-07-06T21:58:39.278059+0000","last_active":"2023-07-06T21:58:40.599240+0000","last_peered":"2023-07-06T21:58:40.599240+0000","last_clean":"2023-07-06T21:58:40.599240+0000","last_became_active":"2023-07-06T21:58:39.277791+0000","last_became_peered":"2023-07-06T21:58:39.277791+0000","last_unstale":"2023-07-06T21:58:40.599240+0000","last_undegraded":"2023-07-06T21:58:40.599240+0000","last_fullsized":"2023-07-06T21:58:40.599240+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:29:23.279429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.386966+0000","last_change":"2023-07-06T21:58:39.270461+0000","last_active":"2023-07-06T21:58:40.386966+0000","last_peered":"2023-07-06T21:58:40.386966+0000","last_clean":"2023-07-06T21:58:40.386966+0000","last_became_active":"2023-07-06T21:58:39.270179+0000","last_became_peered":"2023-07-06T21:58:39.270179+0000","last_unstale":"2023-07-06T21:58:40.386966+0000","last_undegraded":"2023-07-06T21:58:40.386966+0000","last_fullsized":"2023-07-06T21:58:40.386966+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:06.284421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599466+0000","last_change":"2023-07-06T21:58:39.281570+0000","last_active":"2023-07-06T21:58:40.599466+0000","last_peered":"2023-07-06T21:58:40.599466+0000","last_clean":"2023-07-06T21:58:40.599466+0000","last_became_active":"2023-07-06T21:58:39.281276+0000","last_became_peered":"2023-07-06T21:58:39.281276+0000","last_unstale":"2023-07-06T21:58:40.599466+0000","last_undegraded":"2023-07-06T21:58:40.599466+0000","last_fullsized":"2023-07-06T21:58:40.599466+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:13:28.815793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598780+0000","last_change":"2023-07-06T21:58:39.277858+0000","last_active":"2023-07-06T21:58:40.598780+0000","last_peered":"2023-07-06T21:58:40.598780+0000","last_clean":"2023-07-06T21:58:40.598780+0000","last_became_active":"2023-07-06T21:58:39.277586+0000","last_became_peered":"2023-07-06T21:58:39.277586+0000","last_unstale":"2023-07-06T21:58:40.598780+0000","last_undegraded":"2023-07-06T21:58:40.598780+0000","last_fullsized":"2023-07-06T21:58:40.598780+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:26:16.572936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258485+0000","last_change":"2023-07-06T21:58:39.279846+0000","last_active":"2023-07-06T21:58:40.258485+0000","last_peered":"2023-07-06T21:58:40.258485+0000","last_clean":"2023-07-06T21:58:40.258485+0000","last_became_active":"2023-07-06T21:58:39.279589+0000","last_became_peered":"2023-07-06T21:58:39.279589+0000","last_unstale":"2023-07-06T21:58:40.258485+0000","last_undegraded":"2023-07-06T21:58:40.258485+0000","last_fullsized":"2023-07-06T21:58:40.258485+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:37:07.138365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598635+0000","last_change":"2023-07-06T21:58:39.281869+0000","last_active":"2023-07-06T21:58:40.598635+0000","last_peered":"2023-07-06T21:58:40.598635+0000","last_clean":"2023-07-06T21:58:40.598635+0000","last_became_active":"2023-07-06T21:58:39.281389+0000","last_became_peered":"2023-07-06T21:58:39.281389+0000","last_unstale":"2023-07-06T21:58:40.598635+0000","last_undegraded":"2023-07-06T21:58:40.598635+0000","last_fullsized":"2023-07-06T21:58:40.598635+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:00:29.819480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.256790+0000","last_change":"2023-07-06T21:58:39.279403+0000","last_active":"2023-07-06T21:58:40.256790+0000","last_peered":"2023-07-06T21:58:40.256790+0000","last_clean":"2023-07-06T21:58:40.256790+0000","last_became_active":"2023-07-06T21:58:39.279127+0000","last_became_peered":"2023-07-06T21:58:39.279127+0000","last_unstale":"2023-07-06T21:58:40.256790+0000","last_undegraded":"2023-07-06T21:58:40.256790+0000","last_fullsized":"2023-07-06T21:58:40.256790+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:08:20.087239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258574+0000","last_change":"2023-07-06T21:58:39.270912+0000","last_active":"2023-07-06T21:58:40.258574+0000","last_peered":"2023-07-06T21:58:40.258574+0000","last_clean":"2023-07-06T21:58:40.258574+0000","last_became_active":"2023-07-06T21:58:39.270646+0000","last_became_peered":"2023-07-06T21:58:39.270646+0000","last_unstale":"2023-07-06T21:58:40.258574+0000","last_undegraded":"2023-07-06T21:58:40.258574+0000","last_fullsized":"2023-07-06T21:58:40.258574+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:48.689823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"116'4","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599185+0000","last_change":"2023-07-06T21:58:38.859006+0000","last_active":"2023-07-06T21:58:40.599185+0000","last_peered":"2023-07-06T21:58:40.599185+0000","last_clean":"2023-07-06T21:58:40.599185+0000","last_became_active":"2023-07-06T21:58:38.858729+0000","last_became_peered":"2023-07-06T21:58:38.858729+0000","last_unstale":"2023-07-06T21:58:40.599185+0000","last_undegraded":"2023-07-06T21:58:40.599185+0000","last_fullsized":"2023-07-06T21:58:40.599185+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:22:47.883033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599639+0000","last_change":"2023-07-06T21:58:39.280528+0000","last_active":"2023-07-06T21:58:40.599639+0000","last_peered":"2023-07-06T21:58:40.599639+0000","last_clean":"2023-07-06T21:58:40.599639+0000","last_became_active":"2023-07-06T21:58:39.280257+0000","last_became_peered":"2023-07-06T21:58:39.280257+0000","last_unstale":"2023-07-06T21:58:40.599639+0000","last_undegraded":"2023-07-06T21:58:40.599639+0000","last_fullsized":"2023-07-06T21:58:40.599639+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:52:51.653640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"116'1","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387013+0000","last_change":"2023-07-06T21:58:38.863528+0000","last_active":"2023-07-06T21:58:40.387013+0000","last_peered":"2023-07-06T21:58:40.387013+0000","last_clean":"2023-07-06T21:58:40.387013+0000","last_became_active":"2023-07-06T21:58:38.863170+0000","last_became_peered":"2023-07-06T21:58:38.863170+0000","last_unstale":"2023-07-06T21:58:40.387013+0000","last_undegraded":"2023-07-06T21:58:40.387013+0000","last_fullsized":"2023-07-06T21:58:40.387013+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:08:28.420572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257487+0000","last_change":"2023-07-06T21:58:39.286563+0000","last_active":"2023-07-06T21:58:40.257487+0000","last_peered":"2023-07-06T21:58:40.257487+0000","last_clean":"2023-07-06T21:58:40.257487+0000","last_became_active":"2023-07-06T21:58:39.286268+0000","last_became_peered":"2023-07-06T21:58:39.286268+0000","last_unstale":"2023-07-06T21:58:40.257487+0000","last_undegraded":"2023-07-06T21:58:40.257487+0000","last_fullsized":"2023-07-06T21:58:40.257487+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:45:50.670627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"116'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598930+0000","last_change":"2023-07-06T21:58:38.870850+0000","last_active":"2023-07-06T21:58:40.598930+0000","last_peered":"2023-07-06T21:58:40.598930+0000","last_clean":"2023-07-06T21:58:40.598930+0000","last_became_active":"2023-07-06T21:58:38.870582+0000","last_became_peered":"2023-07-06T21:58:38.870582+0000","last_unstale":"2023-07-06T21:58:40.598930+0000","last_undegraded":"2023-07-06T21:58:40.598930+0000","last_fullsized":"2023-07-06T21:58:40.598930+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:40.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599543+0000","last_change":"2023-07-06T21:58:39.279294+0000","last_active":"2023-07-06T21:58:40.599543+0000","last_peered":"2023-07-06T21:58:40.599543+0000","last_clean":"2023-07-06T21:58:40.599543+0000","last_became_active":"2023-07-06T21:58:39.279030+0000","last_became_peered":"2023-07-06T21:58:39.279030+0000","last_unstale":"2023-07-06T21:58:40.599543+0000","last_undegraded":"2023-07-06T21:58:40.599543+0000","last_fullsized":"2023-07-06T21:58:40.599543+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:17:59.893341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"116'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598939+0000","last_change":"2023-07-06T21:58:38.863184+0000","last_active":"2023-07-06T21:58:40.598939+0000","last_peered":"2023-07-06T21:58:40.598939+0000","last_clean":"2023-07-06T21:58:40.598939+0000","last_became_active":"2023-07-06T21:58:38.862879+0000","last_became_peered":"2023-07-06T21:58:38.862879+0000","last_unstale":"2023-07-06T21:58:40.598939+0000","last_undegraded":"2023-07-06T21:58:40.598939+0000","last_fullsized":"2023-07-06T21:58:40.598939+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:34:01.632784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.255689+0000","last_change":"2023-07-06T21:58:39.286847+0000","last_active":"2023-07-06T21:58:40.255689+0000","last_peered":"2023-07-06T21:58:40.255689+0000","last_clean":"2023-07-06T21:58:40.255689+0000","last_became_active":"2023-07-06T21:58:39.286573+0000","last_became_peered":"2023-07-06T21:58:39.286573+0000","last_unstale":"2023-07-06T21:58:40.255689+0000","last_undegraded":"2023-07-06T21:58:40.255689+0000","last_fullsized":"2023-07-06T21:58:40.255689+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:24:06.974711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"116'1","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257118+0000","last_change":"2023-07-06T21:58:38.859991+0000","last_active":"2023-07-06T21:58:40.257118+0000","last_peered":"2023-07-06T21:58:40.257118+0000","last_clean":"2023-07-06T21:58:40.257118+0000","last_became_active":"2023-07-06T21:58:38.859520+0000","last_became_peered":"2023-07-06T21:58:38.859520+0000","last_unstale":"2023-07-06T21:58:40.257118+0000","last_undegraded":"2023-07-06T21:58:40.257118+0000","last_fullsized":"2023-07-06T21:58:40.257118+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:03:25.370088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.386996+0000","last_change":"2023-07-06T21:58:39.278469+0000","last_active":"2023-07-06T21:58:40.386996+0000","last_peered":"2023-07-06T21:58:40.386996+0000","last_clean":"2023-07-06T21:58:40.386996+0000","last_became_active":"2023-07-06T21:58:39.278191+0000","last_became_peered":"2023-07-06T21:58:39.278191+0000","last_unstale":"2023-07-06T21:58:40.386996+0000","last_undegraded":"2023-07-06T21:58:40.386996+0000","last_fullsized":"2023-07-06T21:58:40.386996+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:45:40.163025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"116'1","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598819+0000","last_change":"2023-07-06T21:58:38.863867+0000","last_active":"2023-07-06T21:58:40.598819+0000","last_peered":"2023-07-06T21:58:40.598819+0000","last_clean":"2023-07-06T21:58:40.598819+0000","last_became_active":"2023-07-06T21:58:38.863565+0000","last_became_peered":"2023-07-06T21:58:38.863565+0000","last_unstale":"2023-07-06T21:58:40.598819+0000","last_undegraded":"2023-07-06T21:58:40.598819+0000","last_fullsized":"2023-07-06T21:58:40.598819+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:17:57.873693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598555+0000","last_change":"2023-07-06T21:58:39.270238+0000","last_active":"2023-07-06T21:58:40.598555+0000","last_peered":"2023-07-06T21:58:40.598555+0000","last_clean":"2023-07-06T21:58:40.598555+0000","last_became_active":"2023-07-06T21:58:39.269847+0000","last_became_peered":"2023-07-06T21:58:39.269847+0000","last_unstale":"2023-07-06T21:58:40.598555+0000","last_undegraded":"2023-07-06T21:58:40.598555+0000","last_fullsized":"2023-07-06T21:58:40.598555+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:10:02.394652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599067+0000","last_change":"2023-07-06T21:58:38.862193+0000","last_active":"2023-07-06T21:58:40.599067+0000","last_peered":"2023-07-06T21:58:40.599067+0000","last_clean":"2023-07-06T21:58:40.599067+0000","last_became_active":"2023-07-06T21:58:38.861880+0000","last_became_peered":"2023-07-06T21:58:38.861880+0000","last_unstale":"2023-07-06T21:58:40.599067+0000","last_undegraded":"2023-07-06T21:58:40.599067+0000","last_fullsized":"2023-07-06T21:58:40.599067+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:04:39.725013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599144+0000","last_change":"2023-07-06T21:58:39.278749+0000","last_active":"2023-07-06T21:58:40.599144+0000","last_peered":"2023-07-06T21:58:40.599144+0000","last_clean":"2023-07-06T21:58:40.599144+0000","last_became_active":"2023-07-06T21:58:39.278483+0000","last_became_peered":"2023-07-06T21:58:39.278483+0000","last_unstale":"2023-07-06T21:58:40.599144+0000","last_undegraded":"2023-07-06T21:58:40.599144+0000","last_fullsized":"2023-07-06T21:58:40.599144+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:17:12.504711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.256854+0000","last_change":"2023-07-06T21:58:38.861556+0000","last_active":"2023-07-06T21:58:40.256854+0000","last_peered":"2023-07-06T21:58:40.256854+0000","last_clean":"2023-07-06T21:58:40.256854+0000","last_became_active":"2023-07-06T21:58:38.860833+0000","last_became_peered":"2023-07-06T21:58:38.860833+0000","last_unstale":"2023-07-06T21:58:40.256854+0000","last_undegraded":"2023-07-06T21:58:40.256854+0000","last_fullsized":"2023-07-06T21:58:40.256854+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:06:07.104516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599368+0000","last_change":"2023-07-06T21:58:39.289773+0000","last_active":"2023-07-06T21:58:40.599368+0000","last_peered":"2023-07-06T21:58:40.599368+0000","last_clean":"2023-07-06T21:58:40.599368+0000","last_became_active":"2023-07-06T21:58:39.289484+0000","last_became_peered":"2023-07-06T21:58:39.289484+0000","last_unstale":"2023-07-06T21:58:40.599368+0000","last_undegraded":"2023-07-06T21:58:40.599368+0000","last_fullsized":"2023-07-06T21:58:40.599368+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:13:05.099929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257036+0000","last_change":"2023-07-06T21:58:38.859846+0000","last_active":"2023-07-06T21:58:40.257036+0000","last_peered":"2023-07-06T21:58:40.257036+0000","last_clean":"2023-07-06T21:58:40.257036+0000","last_became_active":"2023-07-06T21:58:38.859532+0000","last_became_peered":"2023-07-06T21:58:38.859532+0000","last_unstale":"2023-07-06T21:58:40.257036+0000","last_undegraded":"2023-07-06T21:58:40.257036+0000","last_fullsized":"2023-07-06T21:58:40.257036+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:59:17.553148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599543+0000","last_change":"2023-07-06T21:58:39.284976+0000","last_active":"2023-07-06T21:58:40.599543+0000","last_peered":"2023-07-06T21:58:40.599543+0000","last_clean":"2023-07-06T21:58:40.599543+0000","last_became_active":"2023-07-06T21:58:39.284692+0000","last_became_peered":"2023-07-06T21:58:39.284692+0000","last_unstale":"2023-07-06T21:58:40.599543+0000","last_undegraded":"2023-07-06T21:58:40.599543+0000","last_fullsized":"2023-07-06T21:58:40.599543+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:43:20.725336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599563+0000","last_change":"2023-07-06T21:58:38.870893+0000","last_active":"2023-07-06T21:58:40.599563+0000","last_peered":"2023-07-06T21:58:40.599563+0000","last_clean":"2023-07-06T21:58:40.599563+0000","last_became_active":"2023-07-06T21:58:38.870589+0000","last_became_peered":"2023-07-06T21:58:38.870589+0000","last_unstale":"2023-07-06T21:58:40.599563+0000","last_undegraded":"2023-07-06T21:58:40.599563+0000","last_fullsized":"2023-07-06T21:58:40.599563+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:51:13.454310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599627+0000","last_change":"2023-07-06T21:58:39.292491+0000","last_active":"2023-07-06T21:58:40.599627+0000","last_peered":"2023-07-06T21:58:40.599627+0000","last_clean":"2023-07-06T21:58:40.599627+0000","last_became_active":"2023-07-06T21:58:39.292089+0000","last_became_peered":"2023-07-06T21:58:39.292089+0000","last_unstale":"2023-07-06T21:58:40.599627+0000","last_undegraded":"2023-07-06T21:58:40.599627+0000","last_fullsized":"2023-07-06T21:58:40.599627+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:58:29.694766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"116'3","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387277+0000","last_change":"2023-07-06T21:58:38.856335+0000","last_active":"2023-07-06T21:58:40.387277+0000","last_peered":"2023-07-06T21:58:40.387277+0000","last_clean":"2023-07-06T21:58:40.387277+0000","last_became_active":"2023-07-06T21:58:38.856010+0000","last_became_peered":"2023-07-06T21:58:38.856010+0000","last_unstale":"2023-07-06T21:58:40.387277+0000","last_undegraded":"2023-07-06T21:58:40.387277+0000","last_fullsized":"2023-07-06T21:58:40.387277+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:16:46.713137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387158+0000","last_change":"2023-07-06T21:58:39.287150+0000","last_active":"2023-07-06T21:58:40.387158+0000","last_peered":"2023-07-06T21:58:40.387158+0000","last_clean":"2023-07-06T21:58:40.387158+0000","last_became_active":"2023-07-06T21:58:39.285773+0000","last_became_peered":"2023-07-06T21:58:39.285773+0000","last_unstale":"2023-07-06T21:58:40.387158+0000","last_undegraded":"2023-07-06T21:58:40.387158+0000","last_fullsized":"2023-07-06T21:58:40.387158+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:27:00.917700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"116'6","reported_seq":19,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.600030+0000","last_change":"2023-07-06T21:58:38.855449+0000","last_active":"2023-07-06T21:58:40.600030+0000","last_peered":"2023-07-06T21:58:40.600030+0000","last_clean":"2023-07-06T21:58:40.600030+0000","last_became_active":"2023-07-06T21:58:38.854829+0000","last_became_peered":"2023-07-06T21:58:38.854829+0000","last_unstale":"2023-07-06T21:58:40.600030+0000","last_undegraded":"2023-07-06T21:58:40.600030+0000","last_fullsized":"2023-07-06T21:58:40.600030+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:05.031176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599235+0000","last_change":"2023-07-06T21:58:39.263456+0000","last_active":"2023-07-06T21:58:40.599235+0000","last_peered":"2023-07-06T21:58:40.599235+0000","last_clean":"2023-07-06T21:58:40.599235+0000","last_became_active":"2023-07-06T21:58:39.262749+0000","last_became_peered":"2023-07-06T21:58:39.262749+0000","last_unstale":"2023-07-06T21:58:40.599235+0000","last_undegraded":"2023-07-06T21:58:40.599235+0000","last_fullsized":"2023-07-06T21:58:40.599235+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:52.698792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"116'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258875+0000","last_change":"2023-07-06T21:58:38.868303+0000","last_active":"2023-07-06T21:58:40.258875+0000","last_peered":"2023-07-06T21:58:40.258875+0000","last_clean":"2023-07-06T21:58:40.258875+0000","last_became_active":"2023-07-06T21:58:38.867548+0000","last_became_peered":"2023-07-06T21:58:38.867548+0000","last_unstale":"2023-07-06T21:58:40.258875+0000","last_undegraded":"2023-07-06T21:58:40.258875+0000","last_fullsized":"2023-07-06T21:58:40.258875+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:20:43.890658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257109+0000","last_change":"2023-07-06T21:58:39.273775+0000","last_active":"2023-07-06T21:58:40.257109+0000","last_peered":"2023-07-06T21:58:40.257109+0000","last_clean":"2023-07-06T21:58:40.257109+0000","last_became_active":"2023-07-06T21:58:39.273519+0000","last_became_peered":"2023-07-06T21:58:39.273519+0000","last_unstale":"2023-07-06T21:58:40.257109+0000","last_undegraded":"2023-07-06T21:58:40.257109+0000","last_fullsized":"2023-07-06T21:58:40.257109+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:01:18.276121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258803+0000","last_change":"2023-07-06T21:58:38.868897+0000","last_active":"2023-07-06T21:58:40.258803+0000","last_peered":"2023-07-06T21:58:40.258803+0000","last_clean":"2023-07-06T21:58:40.258803+0000","last_became_active":"2023-07-06T21:58:38.868609+0000","last_became_peered":"2023-07-06T21:58:38.868609+0000","last_unstale":"2023-07-06T21:58:40.258803+0000","last_undegraded":"2023-07-06T21:58:40.258803+0000","last_fullsized":"2023-07-06T21:58:40.258803+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:22:04.705558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599610+0000","last_change":"2023-07-06T21:58:39.277878+0000","last_active":"2023-07-06T21:58:40.599610+0000","last_peered":"2023-07-06T21:58:40.599610+0000","last_clean":"2023-07-06T21:58:40.599610+0000","last_became_active":"2023-07-06T21:58:39.277618+0000","last_became_peered":"2023-07-06T21:58:39.277618+0000","last_unstale":"2023-07-06T21:58:40.599610+0000","last_undegraded":"2023-07-06T21:58:40.599610+0000","last_fullsized":"2023-07-06T21:58:40.599610+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:39:30.344941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599195+0000","last_change":"2023-07-06T21:58:38.857989+0000","last_active":"2023-07-06T21:58:40.599195+0000","last_peered":"2023-07-06T21:58:40.599195+0000","last_clean":"2023-07-06T21:58:40.599195+0000","last_became_active":"2023-07-06T21:58:38.857724+0000","last_became_peered":"2023-07-06T21:58:38.857724+0000","last_unstale":"2023-07-06T21:58:40.599195+0000","last_undegraded":"2023-07-06T21:58:40.599195+0000","last_fullsized":"2023-07-06T21:58:40.599195+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:53:24.637036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258457+0000","last_change":"2023-07-06T21:58:39.286501+0000","last_active":"2023-07-06T21:58:40.258457+0000","last_peered":"2023-07-06T21:58:40.258457+0000","last_clean":"2023-07-06T21:58:40.258457+0000","last_became_active":"2023-07-06T21:58:39.286203+0000","last_became_peered":"2023-07-06T21:58:39.286203+0000","last_unstale":"2023-07-06T21:58:40.258457+0000","last_undegraded":"2023-07-06T21:58:40.258457+0000","last_fullsized":"2023-07-06T21:58:40.258457+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:08:45.163253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"116'8","reported_seq":21,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.256876+0000","last_change":"2023-07-06T21:58:38.863733+0000","last_active":"2023-07-06T21:58:40.256876+0000","last_peered":"2023-07-06T21:58:40.256876+0000","last_clean":"2023-07-06T21:58:40.256876+0000","last_became_active":"2023-07-06T21:58:38.863424+0000","last_became_peered":"2023-07-06T21:58:38.863424+0000","last_unstale":"2023-07-06T21:58:40.256876+0000","last_undegraded":"2023-07-06T21:58:40.256876+0000","last_fullsized":"2023-07-06T21:58:40.256876+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:09:53.922462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599463+0000","last_change":"2023-07-06T21:58:39.278177+0000","last_active":"2023-07-06T21:58:40.599463+0000","last_peered":"2023-07-06T21:58:40.599463+0000","last_clean":"2023-07-06T21:58:40.599463+0000","last_became_active":"2023-07-06T21:58:39.277900+0000","last_became_peered":"2023-07-06T21:58:39.277900+0000","last_unstale":"2023-07-06T21:58:40.599463+0000","last_undegraded":"2023-07-06T21:58:40.599463+0000","last_fullsized":"2023-07-06T21:58:40.599463+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:49:19.292761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"116'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.256137+0000","last_change":"2023-07-06T21:58:38.853727+0000","last_active":"2023-07-06T21:58:40.256137+0000","last_peered":"2023-07-06T21:58:40.256137+0000","last_clean":"2023-07-06T21:58:40.256137+0000","last_became_active":"2023-07-06T21:58:38.853397+0000","last_became_peered":"2023-07-06T21:58:38.853397+0000","last_unstale":"2023-07-06T21:58:40.256137+0000","last_undegraded":"2023-07-06T21:58:40.256137+0000","last_fullsized":"2023-07-06T21:58:40.256137+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:43:02.219921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257039+0000","last_change":"2023-07-06T21:58:39.273781+0000","last_active":"2023-07-06T21:58:40.257039+0000","last_peered":"2023-07-06T21:58:40.257039+0000","last_clean":"2023-07-06T21:58:40.257039+0000","last_became_active":"2023-07-06T21:58:39.273506+0000","last_became_peered":"2023-07-06T21:58:39.273506+0000","last_unstale":"2023-07-06T21:58:40.257039+0000","last_undegraded":"2023-07-06T21:58:40.257039+0000","last_fullsized":"2023-07-06T21:58:40.257039+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:34:52.399762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599450+0000","last_change":"2023-07-06T21:58:38.870932+0000","last_active":"2023-07-06T21:58:40.599450+0000","last_peered":"2023-07-06T21:58:40.599450+0000","last_clean":"2023-07-06T21:58:40.599450+0000","last_became_active":"2023-07-06T21:58:38.870615+0000","last_became_peered":"2023-07-06T21:58:38.870615+0000","last_unstale":"2023-07-06T21:58:40.599450+0000","last_undegraded":"2023-07-06T21:58:40.599450+0000","last_fullsized":"2023-07-06T21:58:40.599450+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:03:09.941487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257358+0000","last_change":"2023-07-06T21:58:39.281696+0000","last_active":"2023-07-06T21:58:40.257358+0000","last_peered":"2023-07-06T21:58:40.257358+0000","last_clean":"2023-07-06T21:58:40.257358+0000","last_became_active":"2023-07-06T21:58:39.281440+0000","last_became_peered":"2023-07-06T21:58:39.281440+0000","last_unstale":"2023-07-06T21:58:40.257358+0000","last_undegraded":"2023-07-06T21:58:40.257358+0000","last_fullsized":"2023-07-06T21:58:40.257358+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:29:54.981790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599040+0000","last_change":"2023-07-06T21:58:38.852166+0000","last_active":"2023-07-06T21:58:40.599040+0000","last_peered":"2023-07-06T21:58:40.599040+0000","last_clean":"2023-07-06T21:58:40.599040+0000","last_became_active":"2023-07-06T21:58:38.851876+0000","last_became_peered":"2023-07-06T21:58:38.851876+0000","last_unstale":"2023-07-06T21:58:40.599040+0000","last_undegraded":"2023-07-06T21:58:40.599040+0000","last_fullsized":"2023-07-06T21:58:40.599040+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:23:13.397884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599477+0000","last_change":"2023-07-06T21:58:39.281969+0000","last_active":"2023-07-06T21:58:40.599477+0000","last_peered":"2023-07-06T21:58:40.599477+0000","last_clean":"2023-07-06T21:58:40.599477+0000","last_became_active":"2023-07-06T21:58:39.281330+0000","last_became_peered":"2023-07-06T21:58:39.281330+0000","last_unstale":"2023-07-06T21:58:40.599477+0000","last_undegraded":"2023-07-06T21:58:40.599477+0000","last_fullsized":"2023-07-06T21:58:40.599477+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:44:27.355029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.600099+0000","last_change":"2023-07-06T21:58:38.858983+0000","last_active":"2023-07-06T21:58:40.600099+0000","last_peered":"2023-07-06T21:58:40.600099+0000","last_clean":"2023-07-06T21:58:40.600099+0000","last_became_active":"2023-07-06T21:58:38.858625+0000","last_became_peered":"2023-07-06T21:58:38.858625+0000","last_unstale":"2023-07-06T21:58:40.600099+0000","last_undegraded":"2023-07-06T21:58:40.600099+0000","last_fullsized":"2023-07-06T21:58:40.600099+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:16:01.084252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258764+0000","last_change":"2023-07-06T21:58:39.284966+0000","last_active":"2023-07-06T21:58:40.258764+0000","last_peered":"2023-07-06T21:58:40.258764+0000","last_clean":"2023-07-06T21:58:40.258764+0000","last_became_active":"2023-07-06T21:58:39.284659+0000","last_became_peered":"2023-07-06T21:58:39.284659+0000","last_unstale":"2023-07-06T21:58:40.258764+0000","last_undegraded":"2023-07-06T21:58:40.258764+0000","last_fullsized":"2023-07-06T21:58:40.258764+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:42:52.534971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598882+0000","last_change":"2023-07-06T21:58:38.856738+0000","last_active":"2023-07-06T21:58:40.598882+0000","last_peered":"2023-07-06T21:58:40.598882+0000","last_clean":"2023-07-06T21:58:40.598882+0000","last_became_active":"2023-07-06T21:58:38.856460+0000","last_became_peered":"2023-07-06T21:58:38.856460+0000","last_unstale":"2023-07-06T21:58:40.598882+0000","last_undegraded":"2023-07-06T21:58:40.598882+0000","last_fullsized":"2023-07-06T21:58:40.598882+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:50:53.771166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599378+0000","last_change":"2023-07-06T21:58:39.284384+0000","last_active":"2023-07-06T21:58:40.599378+0000","last_peered":"2023-07-06T21:58:40.599378+0000","last_clean":"2023-07-06T21:58:40.599378+0000","last_became_active":"2023-07-06T21:58:39.284082+0000","last_became_peered":"2023-07-06T21:58:39.284082+0000","last_unstale":"2023-07-06T21:58:40.599378+0000","last_undegraded":"2023-07-06T21:58:40.599378+0000","last_fullsized":"2023-07-06T21:58:40.599378+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:28:49.684213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598904+0000","last_change":"2023-07-06T21:58:38.865135+0000","last_active":"2023-07-06T21:58:40.598904+0000","last_peered":"2023-07-06T21:58:40.598904+0000","last_clean":"2023-07-06T21:58:40.598904+0000","last_became_active":"2023-07-06T21:58:38.864802+0000","last_became_peered":"2023-07-06T21:58:38.864802+0000","last_unstale":"2023-07-06T21:58:40.598904+0000","last_undegraded":"2023-07-06T21:58:40.598904+0000","last_fullsized":"2023-07-06T21:58:40.598904+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:12:18.243948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258323+0000","last_change":"2023-07-06T21:58:39.286489+0000","last_active":"2023-07-06T21:58:40.258323+0000","last_peered":"2023-07-06T21:58:40.258323+0000","last_clean":"2023-07-06T21:58:40.258323+0000","last_became_active":"2023-07-06T21:58:39.286198+0000","last_became_peered":"2023-07-06T21:58:39.286198+0000","last_unstale":"2023-07-06T21:58:40.258323+0000","last_undegraded":"2023-07-06T21:58:40.258323+0000","last_fullsized":"2023-07-06T21:58:40.258323+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:43:16.615758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599170+0000","last_change":"2023-07-06T21:58:38.865381+0000","last_active":"2023-07-06T21:58:40.599170+0000","last_peered":"2023-07-06T21:58:40.599170+0000","last_clean":"2023-07-06T21:58:40.599170+0000","last_became_active":"2023-07-06T21:58:38.865093+0000","last_became_peered":"2023-07-06T21:58:38.865093+0000","last_unstale":"2023-07-06T21:58:40.599170+0000","last_undegraded":"2023-07-06T21:58:40.599170+0000","last_fullsized":"2023-07-06T21:58:40.599170+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:52:38.288581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599094+0000","last_change":"2023-07-06T21:58:39.282301+0000","last_active":"2023-07-06T21:58:40.599094+0000","last_peered":"2023-07-06T21:58:40.599094+0000","last_clean":"2023-07-06T21:58:40.599094+0000","last_became_active":"2023-07-06T21:58:39.281895+0000","last_became_peered":"2023-07-06T21:58:39.281895+0000","last_unstale":"2023-07-06T21:58:40.599094+0000","last_undegraded":"2023-07-06T21:58:40.599094+0000","last_fullsized":"2023-07-06T21:58:40.599094+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:32:54.620989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258415+0000","last_change":"2023-07-06T21:58:38.867637+0000","last_active":"2023-07-06T21:58:40.258415+0000","last_peered":"2023-07-06T21:58:40.258415+0000","last_clean":"2023-07-06T21:58:40.258415+0000","last_became_active":"2023-07-06T21:58:38.867340+0000","last_became_peered":"2023-07-06T21:58:38.867340+0000","last_unstale":"2023-07-06T21:58:40.258415+0000","last_undegraded":"2023-07-06T21:58:40.258415+0000","last_fullsized":"2023-07-06T21:58:40.258415+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:04:38.792409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258712+0000","last_change":"2023-07-06T21:58:39.274101+0000","last_active":"2023-07-06T21:58:40.258712+0000","last_peered":"2023-07-06T21:58:40.258712+0000","last_clean":"2023-07-06T21:58:40.258712+0000","last_became_active":"2023-07-06T21:58:39.273802+0000","last_became_peered":"2023-07-06T21:58:39.273802+0000","last_unstale":"2023-07-06T21:58:40.258712+0000","last_undegraded":"2023-07-06T21:58:40.258712+0000","last_fullsized":"2023-07-06T21:58:40.258712+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:18:21.320404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"116'1","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387068+0000","last_change":"2023-07-06T21:58:38.854821+0000","last_active":"2023-07-06T21:58:40.387068+0000","last_peered":"2023-07-06T21:58:40.387068+0000","last_clean":"2023-07-06T21:58:40.387068+0000","last_became_active":"2023-07-06T21:58:38.854517+0000","last_became_peered":"2023-07-06T21:58:38.854517+0000","last_unstale":"2023-07-06T21:58:40.387068+0000","last_undegraded":"2023-07-06T21:58:40.387068+0000","last_fullsized":"2023-07-06T21:58:40.387068+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:35:00.854487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"105'205","reported_seq":675,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387287+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:58:40.387287+0000","last_peered":"2023-07-06T21:58:40.387287+0000","last_clean":"2023-07-06T21:58:40.387287+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:58:40.387287+0000","last_undegraded":"2023-07-06T21:58:40.387287+0000","last_fullsized":"2023-07-06T21:58:40.387287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:40:22.049664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":184,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.255836+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:58:40.255836+0000","last_peered":"2023-07-06T21:58:40.255836+0000","last_clean":"2023-07-06T21:58:40.255836+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:58:40.255836+0000","last_undegraded":"2023-07-06T21:58:40.255836+0000","last_fullsized":"2023-07-06T21:58:40.255836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:33:32.004290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387232+0000","last_change":"2023-07-06T21:58:39.285314+0000","last_active":"2023-07-06T21:58:40.387232+0000","last_peered":"2023-07-06T21:58:40.387232+0000","last_clean":"2023-07-06T21:58:40.387232+0000","last_became_active":"2023-07-06T21:58:39.285040+0000","last_became_peered":"2023-07-06T21:58:39.285040+0000","last_unstale":"2023-07-06T21:58:40.387232+0000","last_undegraded":"2023-07-06T21:58:40.387232+0000","last_fullsized":"2023-07-06T21:58:40.387232+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:15:36.232870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598957+0000","last_change":"2023-07-06T21:58:38.852292+0000","last_active":"2023-07-06T21:58:40.598957+0000","last_peered":"2023-07-06T21:58:40.598957+0000","last_clean":"2023-07-06T21:58:40.598957+0000","last_became_active":"2023-07-06T21:58:38.852035+0000","last_became_peered":"2023-07-06T21:58:38.852035+0000","last_unstale":"2023-07-06T21:58:40.598957+0000","last_undegraded":"2023-07-06T21:58:40.598957+0000","last_fullsized":"2023-07-06T21:58:40.598957+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:17:43.522363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":207,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387190+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:58:40.387190+0000","last_peered":"2023-07-06T21:58:40.387190+0000","last_clean":"2023-07-06T21:58:40.387190+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:58:40.387190+0000","last_undegraded":"2023-07-06T21:58:40.387190+0000","last_fullsized":"2023-07-06T21:58:40.387190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:16:45.082903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.255777+0000","last_change":"2023-07-06T21:58:39.283156+0000","last_active":"2023-07-06T21:58:40.255777+0000","last_peered":"2023-07-06T21:58:40.255777+0000","last_clean":"2023-07-06T21:58:40.255777+0000","last_became_active":"2023-07-06T21:58:39.282873+0000","last_became_peered":"2023-07-06T21:58:39.282873+0000","last_unstale":"2023-07-06T21:58:40.255777+0000","last_undegraded":"2023-07-06T21:58:40.255777+0000","last_fullsized":"2023-07-06T21:58:40.255777+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:18:12.266031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"116'1","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599585+0000","last_change":"2023-07-06T21:58:38.853879+0000","last_active":"2023-07-06T21:58:40.599585+0000","last_peered":"2023-07-06T21:58:40.599585+0000","last_clean":"2023-07-06T21:58:40.599585+0000","last_became_active":"2023-07-06T21:58:38.853503+0000","last_became_peered":"2023-07-06T21:58:38.853503+0000","last_unstale":"2023-07-06T21:58:40.599585+0000","last_undegraded":"2023-07-06T21:58:40.599585+0000","last_fullsized":"2023-07-06T21:58:40.599585+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:06:55.014202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":209,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258326+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:58:40.258326+0000","last_peered":"2023-07-06T21:58:40.258326+0000","last_clean":"2023-07-06T21:58:40.258326+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:58:40.258326+0000","last_undegraded":"2023-07-06T21:58:40.258326+0000","last_fullsized":"2023-07-06T21:58:40.258326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:18:08.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599852+0000","last_change":"2023-07-06T21:58:39.288596+0000","last_active":"2023-07-06T21:58:40.599852+0000","last_peered":"2023-07-06T21:58:40.599852+0000","last_clean":"2023-07-06T21:58:40.599852+0000","last_became_active":"2023-07-06T21:58:39.288338+0000","last_became_peered":"2023-07-06T21:58:39.288338+0000","last_unstale":"2023-07-06T21:58:40.599852+0000","last_undegraded":"2023-07-06T21:58:40.599852+0000","last_fullsized":"2023-07-06T21:58:40.599852+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:42:51.556761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"116'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599881+0000","last_change":"2023-07-06T21:58:38.867590+0000","last_active":"2023-07-06T21:58:40.599881+0000","last_peered":"2023-07-06T21:58:40.599881+0000","last_clean":"2023-07-06T21:58:40.599881+0000","last_became_active":"2023-07-06T21:58:38.867352+0000","last_became_peered":"2023-07-06T21:58:38.867352+0000","last_unstale":"2023-07-06T21:58:40.599881+0000","last_undegraded":"2023-07-06T21:58:40.599881+0000","last_fullsized":"2023-07-06T21:58:40.599881+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:34:36.881396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":185,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.255818+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:58:40.255818+0000","last_peered":"2023-07-06T21:58:40.255818+0000","last_clean":"2023-07-06T21:58:40.255818+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:58:40.255818+0000","last_undegraded":"2023-07-06T21:58:40.255818+0000","last_fullsized":"2023-07-06T21:58:40.255818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:56:55.067772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598898+0000","last_change":"2023-07-06T21:58:39.283126+0000","last_active":"2023-07-06T21:58:40.598898+0000","last_peered":"2023-07-06T21:58:40.598898+0000","last_clean":"2023-07-06T21:58:40.598898+0000","last_became_active":"2023-07-06T21:58:39.282655+0000","last_became_peered":"2023-07-06T21:58:39.282655+0000","last_unstale":"2023-07-06T21:58:40.598898+0000","last_undegraded":"2023-07-06T21:58:40.598898+0000","last_fullsized":"2023-07-06T21:58:40.598898+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:41:59.310617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598735+0000","last_change":"2023-07-06T21:58:38.863234+0000","last_active":"2023-07-06T21:58:40.598735+0000","last_peered":"2023-07-06T21:58:40.598735+0000","last_clean":"2023-07-06T21:58:40.598735+0000","last_became_active":"2023-07-06T21:58:38.862944+0000","last_became_peered":"2023-07-06T21:58:38.862944+0000","last_unstale":"2023-07-06T21:58:40.598735+0000","last_undegraded":"2023-07-06T21:58:40.598735+0000","last_fullsized":"2023-07-06T21:58:40.598735+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:54:11.292747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":190,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257559+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:58:40.257559+0000","last_peered":"2023-07-06T21:58:40.257559+0000","last_clean":"2023-07-06T21:58:40.257559+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:58:40.257559+0000","last_undegraded":"2023-07-06T21:58:40.257559+0000","last_fullsized":"2023-07-06T21:58:40.257559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:53:12.702520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258327+0000","last_change":"2023-07-06T21:58:39.274300+0000","last_active":"2023-07-06T21:58:40.258327+0000","last_peered":"2023-07-06T21:58:40.258327+0000","last_clean":"2023-07-06T21:58:40.258327+0000","last_became_active":"2023-07-06T21:58:39.273947+0000","last_became_peered":"2023-07-06T21:58:39.273947+0000","last_unstale":"2023-07-06T21:58:40.258327+0000","last_undegraded":"2023-07-06T21:58:40.258327+0000","last_fullsized":"2023-07-06T21:58:40.258327+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:45:20.205301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.255524+0000","last_change":"2023-07-06T21:58:38.855346+0000","last_active":"2023-07-06T21:58:40.255524+0000","last_peered":"2023-07-06T21:58:40.255524+0000","last_clean":"2023-07-06T21:58:40.255524+0000","last_became_active":"2023-07-06T21:58:38.854473+0000","last_became_peered":"2023-07-06T21:58:38.854473+0000","last_unstale":"2023-07-06T21:58:40.255524+0000","last_undegraded":"2023-07-06T21:58:40.255524+0000","last_fullsized":"2023-07-06T21:58:40.255524+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:21:37.330576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":206,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387291+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:58:40.387291+0000","last_peered":"2023-07-06T21:58:40.387291+0000","last_clean":"2023-07-06T21:58:40.387291+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:58:40.387291+0000","last_undegraded":"2023-07-06T21:58:40.387291+0000","last_fullsized":"2023-07-06T21:58:40.387291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:58:33.067249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258708+0000","last_change":"2023-07-06T21:58:39.272973+0000","last_active":"2023-07-06T21:58:40.258708+0000","last_peered":"2023-07-06T21:58:40.258708+0000","last_clean":"2023-07-06T21:58:40.258708+0000","last_became_active":"2023-07-06T21:58:39.272719+0000","last_became_peered":"2023-07-06T21:58:39.272719+0000","last_unstale":"2023-07-06T21:58:40.258708+0000","last_undegraded":"2023-07-06T21:58:40.258708+0000","last_fullsized":"2023-07-06T21:58:40.258708+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:59:57.337837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.255627+0000","last_change":"2023-07-06T21:58:38.862155+0000","last_active":"2023-07-06T21:58:40.255627+0000","last_peered":"2023-07-06T21:58:40.255627+0000","last_clean":"2023-07-06T21:58:40.255627+0000","last_became_active":"2023-07-06T21:58:38.861875+0000","last_became_peered":"2023-07-06T21:58:38.861875+0000","last_unstale":"2023-07-06T21:58:40.255627+0000","last_undegraded":"2023-07-06T21:58:40.255627+0000","last_fullsized":"2023-07-06T21:58:40.255627+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:56:05.223351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":190,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257421+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:58:40.257421+0000","last_peered":"2023-07-06T21:58:40.257421+0000","last_clean":"2023-07-06T21:58:40.257421+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:58:40.257421+0000","last_undegraded":"2023-07-06T21:58:40.257421+0000","last_fullsized":"2023-07-06T21:58:40.257421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:23:26.514448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258626+0000","last_change":"2023-07-06T21:58:39.274389+0000","last_active":"2023-07-06T21:58:40.258626+0000","last_peered":"2023-07-06T21:58:40.258626+0000","last_clean":"2023-07-06T21:58:40.258626+0000","last_became_active":"2023-07-06T21:58:39.274068+0000","last_became_peered":"2023-07-06T21:58:39.274068+0000","last_unstale":"2023-07-06T21:58:40.258626+0000","last_undegraded":"2023-07-06T21:58:40.258626+0000","last_fullsized":"2023-07-06T21:58:40.258626+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:02:34.889552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"116'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598785+0000","last_change":"2023-07-06T21:58:38.870046+0000","last_active":"2023-07-06T21:58:40.598785+0000","last_peered":"2023-07-06T21:58:40.598785+0000","last_clean":"2023-07-06T21:58:40.598785+0000","last_became_active":"2023-07-06T21:58:38.866030+0000","last_became_peered":"2023-07-06T21:58:38.866030+0000","last_unstale":"2023-07-06T21:58:40.598785+0000","last_undegraded":"2023-07-06T21:58:40.598785+0000","last_fullsized":"2023-07-06T21:58:40.598785+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:02:27.030299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599894+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:58:40.599894+0000","last_peered":"2023-07-06T21:58:40.599894+0000","last_clean":"2023-07-06T21:58:40.599894+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:58:40.599894+0000","last_undegraded":"2023-07-06T21:58:40.599894+0000","last_fullsized":"2023-07-06T21:58:40.599894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:38:38.311850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575049,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37140,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334700,"statfs":{"total":96636764160,"available":96598732800,"internally_reserved":0,"allocated":2043904,"data_stored":1351654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.441,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68300000000000005,"15min":0.70199999999999996},"min":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.71299999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69499999999999995,"15min":0.71499999999999997},"min":{"1min":0.45300000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.42799999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.42599999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.876}]},{"osd":3,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.71699999999999997},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.746},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71599999999999997,"15min":0.73899999999999999},"min":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.41799999999999998,"5min":0.376,"15min":0.35599999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.61299999999999999},"min":{"1min":0.47399999999999998,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.69399999999999995,"15min":0.70299999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.82999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575049,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1445888,"data_stored":760807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68300000000000005,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.81799999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.71199999999999997},"min":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.41599999999999998},"max":{"1min":0.76900000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93100000000000005,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.74299999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.45800000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.501},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70299999999999996,"15min":0.72499999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.498},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":1.0629999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57599999999999996,"15min":0.56499999999999995},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78100000000000003,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91300000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60899999999999999,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86599999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.56000000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96299999999999997,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94999999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.53400000000000003,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.86399999999999999,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834575048,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1445888,"data_stored":761244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.44800000000000001,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.87,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.69699999999999995,"15min":0.71799999999999997},"min":{"1min":0.45400000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85699999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.71399999999999997},"min":{"1min":0.52000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88500000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.46100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82199999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.73499999999999999},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86199999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.873,"5min":1.0309999999999999,"15min":1.0369999999999999},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70899999999999996,"15min":0.74299999999999999},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72999999999999998,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83599999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.41299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.874,"5min":0.91800000000000004,"15min":1.02},"last":0.88400000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85499999999999998,"5min":0.86899999999999999,"15min":1.004},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82099999999999995,"5min":0.83599999999999997,"15min":0.95699999999999996},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.84699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575047,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1428,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1462272,"data_stored":762862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.39400000000000002},"max":{"1min":0.84399999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69799999999999995,"15min":0.71399999999999997},"min":{"1min":0.49099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93899999999999995,"5min":1.123,"15min":1.123},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.71699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86799999999999999,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.45000000000000001,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":0.91500000000000004,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69999999999999996,"15min":0.71599999999999997},"min":{"1min":0.48599999999999999,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":0.92300000000000004,"5min":0.94599999999999995,"15min":1.1299999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.98899999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70899999999999996,"15min":0.72399999999999998},"min":{"1min":0.46700000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92000000000000004,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.49299999999999999},"max":{"1min":0.89300000000000002,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.621}]},{"osd":5,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.308},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.94299999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.439,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.82699999999999996,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.436}]},{"osd":6,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.624,"15min":0.59899999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89300000000000002,"5min":1.036,"15min":1.036},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.34799999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67400000000000004,"15min":0.65200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98199999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.442,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.01},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575048,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1458176,"data_stored":762760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.42999999999999999,"15min":0.44900000000000001},"min":{"1min":0.25600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.64200000000000002,"5min":0.85499999999999998,"15min":1.0489999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.56599999999999995,"5min":2.77,"15min":2.77},"last":0.434}]},{"osd":1,"last update":"Thu Jul 6 21:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.318,"5min":0.309,"15min":0.24299999999999999},"max":{"1min":0.52400000000000002,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.56399999999999995,"15min":0.58199999999999996},"min":{"1min":0.36399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.68799999999999994,"5min":1.351,"15min":1.351},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.51000000000000001,"15min":0.53200000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.61699999999999999,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.52200000000000002,"15min":0.54400000000000004},"min":{"1min":0.38500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69499999999999995,"5min":0.82899999999999996,"15min":1.24},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73099999999999998,"15min":0.76100000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34699999999999998},"max":{"1min":1.1020000000000001,"5min":1.1930000000000001,"15min":1.3009999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.745,"15min":0.77900000000000003},"min":{"1min":0.52000000000000002,"5min":0.46600000000000003,"15min":0.46000000000000002},"max":{"1min":0.84299999999999997,"5min":1.383,"15min":1.383},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.76200000000000001,"15min":0.79700000000000004},"min":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.42399999999999999},"max":{"1min":0.82899999999999996,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.76700000000000002,"15min":0.78600000000000003},"min":{"1min":0.56599999999999995,"5min":0.49399999999999999,"15min":0.44800000000000001},"max":{"1min":0.93799999999999994,"5min":1.327,"15min":1.3999999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.77200000000000002,"15min":0.79500000000000004},"min":{"1min":0.53800000000000003,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":0.89300000000000002,"5min":1.425,"15min":1.425},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.79400000000000004,"15min":0.80300000000000005},"min":{"1min":0.52300000000000002,"5min":0.49299999999999999,"15min":0.47899999999999998},"max":{"1min":1.075,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.80600000000000005},"min":{"1min":0.55700000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.81299999999999994,"5min":3.097,"15min":3.097},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.77400000000000002,"15min":0.80400000000000005},"min":{"1min":0.50600000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0429999999999999,"5min":1.1140000000000001,"15min":1.3480000000000001},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575048,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1445888,"data_stored":761208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.28199999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52700000000000002,"5min":0.81699999999999995,"15min":0.85999999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48299999999999998,"15min":0.497},"min":{"1min":0.26000000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.60299999999999998,"5min":0.84399999999999997,"15min":0.85999999999999999},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.63900000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83499999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.504},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63400000000000001,"5min":0.72399999999999998,"15min":0.76500000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.61299999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.47999999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.091,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.53100000000000003,"5min":0.47499999999999998,"15min":0.41399999999999998},"max":{"1min":1.1000000000000001,"5min":1.591,"15min":1.591},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.52200000000000002,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.139,"5min":1.333,"15min":1.333},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79100000000000004,"15min":0.81000000000000005},"min":{"1min":0.53800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0169999999999999,"5min":1.327,"15min":1.327},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.466,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.0509999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.54100000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.135,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.83499999999999996},"min":{"1min":0.54800000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.70099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575049,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58696,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313144,"statfs":{"total":96636764160,"available":96576659456,"internally_reserved":0,"allocated":1441792,"data_stored":761174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.438,"15min":0.44},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.49099999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.48999999999999999,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56799999999999995,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83999999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.64000000000000001,"5min":0.79800000000000004,"15min":0.87},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56000000000000005,"15min":0.58499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.59099999999999997,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51600000000000001,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.32000000000000001},"max":{"1min":0.60899999999999999,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.38500000000000001},"max":{"1min":0.89100000000000001,"5min":1.143,"15min":1.3140000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":0.89500000000000002,"5min":1.022,"15min":1.2290000000000001},"last":0.94199999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":0.92300000000000004,"5min":1.1890000000000001,"15min":1.4359999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":1.044,"15min":1.357},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.75,"15min":0.78200000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90100000000000002,"5min":1.278,"15min":1.278},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77400000000000002,"15min":0.79300000000000004},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91500000000000004,"5min":1.0820000000000001,"15min":1.456},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.77300000000000002,"15min":0.79900000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.84199999999999997,"5min":1.0820000000000001,"15min":1.417},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":0.81299999999999994},"min":{"1min":0.53200000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.90400000000000003,"5min":1.3280000000000001,"15min":1.397},"last":0.89600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575048,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37132,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334708,"statfs":{"total":96636764160,"available":96598740992,"internally_reserved":0,"allocated":2035712,"data_stored":1351105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.41999999999999998,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.54100000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.48599999999999999,"15min":0.50600000000000001},"min":{"1min":0.28299999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.747,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.47699999999999998,"15min":0.496},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.30099999999999999},"max":{"1min":0.50800000000000001,"5min":0.81100000000000005,"15min":0.82399999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.52100000000000002,"15min":0.53400000000000003},"min":{"1min":0.40699999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66700000000000004,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.49299999999999999,"15min":0.505},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66600000000000004,"5min":1.151,"15min":1.151},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.54200000000000004,"15min":0.56699999999999995},"min":{"1min":0.373,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.60099999999999998,"5min":0.83099999999999996,"15min":0.874},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73699999999999999,"15min":0.78400000000000003},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92700000000000005,"5min":1.1319999999999999,"15min":1.242},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73999999999999999,"15min":0.77800000000000002},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":0.81899999999999995,"5min":1.3560000000000001,"15min":1.3620000000000001},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.755,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.38400000000000001},"max":{"1min":0.89900000000000002,"5min":1.254,"15min":1.3700000000000001},"last":0.629},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.73099999999999998,"15min":0.78200000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":0.77400000000000002,"5min":1.0329999999999999,"15min":1.1759999999999999},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.52200000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93000000000000005,"5min":1.113,"15min":1.2050000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.754,"15min":0.78500000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":0.996,"5min":1.2010000000000001,"15min":1.2989999999999999},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.77000000000000002,"15min":0.80500000000000005},"min":{"1min":0.51100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.84199999999999997,"5min":1.3120000000000001,"15min":1.3640000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78200000000000003,"15min":0.81200000000000006},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.435},"max":{"1min":0.95099999999999996,"5min":1.325,"15min":1.325},"last":0.66200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:58:47.996 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T21:58:48.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.151+0000 7fdc21d74640 1 Processor -- start 2023-07-06T21:58:48.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.151+0000 7fdc21d74640 1 -- start start 2023-07-06T21:58:48.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc21d74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc1c0ca450 0x7fdc1c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc21d74640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1c159cd0 con 0x7fdc1c0712f0 2023-07-06T21:58:48.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc21d74640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1c0693f0 con 0x7fdc1c0b3730 2023-07-06T21:58:48.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc21d74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c06aca0 con 0x7fdc1c0ca450 2023-07-06T21:58:48.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc1c0712f0 0x7fdc1c0c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44484/0 (socket says 172.21.15.55:44484) 2023-07-06T21:58:48.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1b7fe640 1 -- 172.21.15.55:0/1965869176 learned_addr learned my addr 172.21.15.55:0/1965869176 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:48.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 -- 172.21.15.55:0/1965869176 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147061192 0 0) 0x7fdc1c159cd0 con 0x7fdc1c0712f0 2023-07-06T21:58:48.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1affd640 1 --2- 172.21.15.55:0/1965869176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc1c0ca450 0x7fdc1c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 -- 172.21.15.55:0/1965869176 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc04003530 con 0x7fdc1c0712f0 2023-07-06T21:58:48.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 -- 172.21.15.55:0/1965869176 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 597987622 0 0) 0x7fdc04003530 con 0x7fdc1c0712f0 2023-07-06T21:58:48.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 -- 172.21.15.55:0/1965869176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc1c0ca450 msgr2=0x7fdc1c06a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:48.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 --2- 172.21.15.55:0/1965869176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc1c0ca450 0x7fdc1c06a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 -- 172.21.15.55:0/1965869176 >> v1:172.21.15.138:6789/0 conn(0x7fdc1c0b3730 legacy=0x7fdc1c15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 -- 172.21.15.55:0/1965869176 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c0696b0 con 0x7fdc1c0712f0 2023-07-06T21:58:48.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 -- 172.21.15.55:0/1965869176 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fdc0c001680 con 0x7fdc1c0712f0 2023-07-06T21:58:48.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 -- 172.21.15.55:0/1965869176 >> v1:172.21.15.55:6789/0 conn(0x7fdc1c0712f0 legacy=0x7fdc1c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 --2- 172.21.15.55:0/1965869176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc040039b0 0x7fdc04003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 --2- 172.21.15.55:0/1965869176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc040047d0 0x7fdc04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 --2- 172.21.15.55:0/1965869176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc1c0ca450 0x7fdc04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 -- 172.21.15.55:0/1965869176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c06aca0 con 0x7fdc040047d0 2023-07-06T21:58:48.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 -- 172.21.15.55:0/1965869176 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0400ba40 con 0x7fdc040039b0 2023-07-06T21:58:48.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1a7fc640 1 -- 172.21.15.55:0/1965869176 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0400bbd0 con 0x7fdc1c0ca450 2023-07-06T21:58:48.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1affd640 1 --2- 172.21.15.55:0/1965869176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc040047d0 0x7fdc04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1bfff640 1 --2- 172.21.15.55:0/1965869176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc1c0ca450 0x7fdc04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1b7fe640 1 --2- 172.21.15.55:0/1965869176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc040039b0 0x7fdc04003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1affd640 1 -- 172.21.15.55:0/1965869176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc1c0ca450 msgr2=0x7fdc04005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:48.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1affd640 1 --2- 172.21.15.55:0/1965869176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc1c0ca450 0x7fdc04005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1affd640 1 -- 172.21.15.55:0/1965869176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc040039b0 msgr2=0x7fdc04003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:48.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1affd640 1 --2- 172.21.15.55:0/1965869176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc040039b0 0x7fdc04003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.155+0000 7fdc1affd640 1 -- 172.21.15.55:0/1965869176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc04003530 con 0x7fdc040047d0 2023-07-06T21:58:48.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.159+0000 7fdc1affd640 1 --2- 172.21.15.55:0/1965869176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc040047d0 0x7fdc04004c40 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009ab0 tx=0x7fdc1001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c285700e830607a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:48.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.159+0000 7fdc1a7fc640 1 -- 172.21.15.55:0/1965869176 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc100a5510 con 0x7fdc040047d0 2023-07-06T21:58:48.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.159+0000 7fdc1a7fc640 1 -- 172.21.15.55:0/1965869176 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc100a5670 con 0x7fdc040047d0 2023-07-06T21:58:48.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.159+0000 7fdc1a7fc640 1 -- 172.21.15.55:0/1965869176 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc100a5a20 con 0x7fdc040047d0 2023-07-06T21:58:48.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.159+0000 7fdc21d74640 1 -- 172.21.15.55:0/1965869176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc040047d0 msgr2=0x7fdc04004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.159+0000 7fdc21d74640 1 --2- 172.21.15.55:0/1965869176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc040047d0 0x7fdc04004c40 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009ab0 tx=0x7fdc1001ca30 comp rx=0 tx=0).stop 2023-07-06T21:58:48.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.159+0000 7fdc1bfff640 1 -- 172.21.15.55:0/1965869176 reap_dead start 2023-07-06T21:58:48.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.159+0000 7fdc21d74640 1 -- 172.21.15.55:0/1965869176 shutdown_connections 2023-07-06T21:58:48.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.159+0000 7fdc21d74640 1 -- 172.21.15.55:0/1965869176 >> 172.21.15.55:0/1965869176 conn(0x7fdc1c0cded0 msgr2=0x7fdc1c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:48.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.159+0000 7fdc21d74640 1 -- 172.21.15.55:0/1965869176 shutdown_connections 2023-07-06T21:58:48.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.159+0000 7fdc21d74640 1 -- 172.21.15.55:0/1965869176 wait complete. 2023-07-06T21:58:48.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc21d74640 1 Processor -- start 2023-07-06T21:58:48.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc21d74640 1 -- start start 2023-07-06T21:58:48.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc21d74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc040047d0 0x7fdc1c0c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc21d74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc1c152760 0x7fdc1c151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc21d74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc1c15be10 0x7fdc1c0cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc21d74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c152fe0 con 0x7fdc1c152760 2023-07-06T21:58:48.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc21d74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c0c2170 con 0x7fdc1c15be10 2023-07-06T21:58:48.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc21d74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c15cce0 con 0x7fdc040047d0 2023-07-06T21:58:48.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc1affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc1c152760 0x7fdc1c151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc1affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc1c152760 0x7fdc1c151a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50242/0 (socket says 172.21.15.55:50242) 2023-07-06T21:58:48.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc1affd640 1 -- 172.21.15.55:0/3893615354 learned_addr learned my addr 172.21.15.55:0/3893615354 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:48.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc1b7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc040047d0 0x7fdc1c0c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc1bfff640 1 --2- 172.21.15.55:0/3893615354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc1c15be10 0x7fdc1c0cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc1affd640 1 -- 172.21.15.55:0/3893615354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc040047d0 msgr2=0x7fdc1c0c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc1affd640 1 --2- 172.21.15.55:0/3893615354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc040047d0 0x7fdc1c0c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc1affd640 1 -- 172.21.15.55:0/3893615354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc1c15be10 msgr2=0x7fdc1c0cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc1affd640 1 --2- 172.21.15.55:0/3893615354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc1c15be10 0x7fdc1c0cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc1affd640 1 -- 172.21.15.55:0/3893615354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c15c720 con 0x7fdc1c152760 2023-07-06T21:58:48.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc1affd640 1 --2- 172.21.15.55:0/3893615354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc1c152760 0x7fdc1c151a70 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009ab0 tx=0x7fdc04005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:48.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc03fff640 1 -- 172.21.15.55:0/3893615354 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc100be070 con 0x7fdc1c152760 2023-07-06T21:58:48.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc03fff640 1 -- 172.21.15.55:0/3893615354 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc10004020 con 0x7fdc1c152760 2023-07-06T21:58:48.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc03fff640 1 -- 172.21.15.55:0/3893615354 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10004390 con 0x7fdc1c152760 2023-07-06T21:58:48.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc21d74640 1 -- 172.21.15.55:0/3893615354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1c15ca00 con 0x7fdc1c152760 2023-07-06T21:58:48.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.163+0000 7fdc21d74640 1 -- 172.21.15.55:0/3893615354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1c151fb0 con 0x7fdc1c152760 2023-07-06T21:58:48.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.167+0000 7fdc21d74640 1 -- 172.21.15.55:0/3893615354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1c066d60 con 0x7fdc1c152760 2023-07-06T21:58:48.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.167+0000 7fdc03fff640 1 -- 172.21.15.55:0/3893615354 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdc100b4040 con 0x7fdc1c152760 2023-07-06T21:58:48.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.167+0000 7fdc03fff640 1 --2- 172.21.15.55:0/3893615354 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fdc080663a0 0x7fdc08068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.167+0000 7fdc03fff640 1 -- 172.21.15.55:0/3893615354 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdc1011dc20 con 0x7fdc1c152760 2023-07-06T21:58:48.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.167+0000 7fdc1b7fe640 1 --2- 172.21.15.55:0/3893615354 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fdc080663a0 0x7fdc08068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.167+0000 7fdc1b7fe640 1 --2- 172.21.15.55:0/3893615354 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fdc080663a0 0x7fdc08068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c005480 tx=0x7fdc0c004840 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:48.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.171+0000 7fdc03fff640 1 -- 172.21.15.55:0/3893615354 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc100eae70 con 0x7fdc1c152760 2023-07-06T21:58:48.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.323+0000 7fdc21d74640 1 -- 172.21.15.55:0/3893615354 --> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc1c069c70 con 0x7fdc080663a0 2023-07-06T21:58:48.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.331+0000 7fdc03fff640 1 -- 172.21.15.55:0/3893615354 <== mgr.7782 v2:172.21.15.55:6832/1408736549 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312058 (secure 0 0 0) 0x7fdc0c001b50 con 0x7fdc080663a0 2023-07-06T21:58:48.333 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:48.335 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T21:58:48.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.335+0000 7fdc21d74640 1 -- 172.21.15.55:0/3893615354 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fdc080663a0 msgr2=0x7fdc08068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.335+0000 7fdc21d74640 1 --2- 172.21.15.55:0/3893615354 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fdc080663a0 0x7fdc08068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c005480 tx=0x7fdc0c004840 comp rx=0 tx=0).stop 2023-07-06T21:58:48.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.335+0000 7fdc21d74640 1 -- 172.21.15.55:0/3893615354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc1c152760 msgr2=0x7fdc1c151a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.335+0000 7fdc21d74640 1 --2- 172.21.15.55:0/3893615354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc1c152760 0x7fdc1c151a70 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009ab0 tx=0x7fdc04005800 comp rx=0 tx=0).stop 2023-07-06T21:58:48.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.335+0000 7fdc21d74640 1 -- 172.21.15.55:0/3893615354 shutdown_connections 2023-07-06T21:58:48.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.335+0000 7fdc21d74640 1 --2- 172.21.15.55:0/3893615354 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fdc080663a0 0x7fdc08068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.335+0000 7fdc21d74640 1 --2- 172.21.15.55:0/3893615354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc1c15be10 0x7fdc1c0cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.335+0000 7fdc21d74640 1 --2- 172.21.15.55:0/3893615354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc1c152760 0x7fdc1c151a70 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.335+0000 7fdc21d74640 1 --2- 172.21.15.55:0/3893615354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc040047d0 0x7fdc1c0c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.335+0000 7fdc21d74640 1 -- 172.21.15.55:0/3893615354 >> 172.21.15.55:0/3893615354 conn(0x7fdc1c0cded0 msgr2=0x7fdc1c0cd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:48.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.335+0000 7fdc21d74640 1 -- 172.21.15.55:0/3893615354 shutdown_connections 2023-07-06T21:58:48.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.335+0000 7fdc21d74640 1 -- 172.21.15.55:0/3893615354 wait complete. 2023-07-06T21:58:48.354 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-06T21:58:46.739334+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":363,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":243,"ondisk_log_size":243,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307584,"kb_used_data":12480,"kb_used_omap":0,"kb_used_meta":295040,"kb_avail":754667136,"statfs":{"total":773094113280,"available":772779147264,"internally_reserved":0,"allocated":12779520,"data_stored":7272814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":302120960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.900808"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.256948+0000","last_change":"2023-07-06T21:58:39.282453+0000","last_active":"2023-07-06T21:58:40.256948+0000","last_peered":"2023-07-06T21:58:40.256948+0000","last_clean":"2023-07-06T21:58:40.256948+0000","last_became_active":"2023-07-06T21:58:39.282134+0000","last_became_peered":"2023-07-06T21:58:39.282134+0000","last_unstale":"2023-07-06T21:58:40.256948+0000","last_undegraded":"2023-07-06T21:58:40.256948+0000","last_fullsized":"2023-07-06T21:58:40.256948+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:47:30.651611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599107+0000","last_change":"2023-07-06T21:58:39.289707+0000","last_active":"2023-07-06T21:58:40.599107+0000","last_peered":"2023-07-06T21:58:40.599107+0000","last_clean":"2023-07-06T21:58:40.599107+0000","last_became_active":"2023-07-06T21:58:39.289350+0000","last_became_peered":"2023-07-06T21:58:39.289350+0000","last_unstale":"2023-07-06T21:58:40.599107+0000","last_undegraded":"2023-07-06T21:58:40.599107+0000","last_fullsized":"2023-07-06T21:58:40.599107+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:53:42.601956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257431+0000","last_change":"2023-07-06T21:58:39.277012+0000","last_active":"2023-07-06T21:58:40.257431+0000","last_peered":"2023-07-06T21:58:40.257431+0000","last_clean":"2023-07-06T21:58:40.257431+0000","last_became_active":"2023-07-06T21:58:39.276742+0000","last_became_peered":"2023-07-06T21:58:39.276742+0000","last_unstale":"2023-07-06T21:58:40.257431+0000","last_undegraded":"2023-07-06T21:58:40.257431+0000","last_fullsized":"2023-07-06T21:58:40.257431+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:02:28.324674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599395+0000","last_change":"2023-07-06T21:58:39.269556+0000","last_active":"2023-07-06T21:58:40.599395+0000","last_peered":"2023-07-06T21:58:40.599395+0000","last_clean":"2023-07-06T21:58:40.599395+0000","last_became_active":"2023-07-06T21:58:39.269307+0000","last_became_peered":"2023-07-06T21:58:39.269307+0000","last_unstale":"2023-07-06T21:58:40.599395+0000","last_undegraded":"2023-07-06T21:58:40.599395+0000","last_fullsized":"2023-07-06T21:58:40.599395+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:19:53.392577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599414+0000","last_change":"2023-07-06T21:58:39.286746+0000","last_active":"2023-07-06T21:58:40.599414+0000","last_peered":"2023-07-06T21:58:40.599414+0000","last_clean":"2023-07-06T21:58:40.599414+0000","last_became_active":"2023-07-06T21:58:39.286373+0000","last_became_peered":"2023-07-06T21:58:39.286373+0000","last_unstale":"2023-07-06T21:58:40.599414+0000","last_undegraded":"2023-07-06T21:58:40.599414+0000","last_fullsized":"2023-07-06T21:58:40.599414+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:19.472882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387026+0000","last_change":"2023-07-06T21:58:39.280606+0000","last_active":"2023-07-06T21:58:40.387026+0000","last_peered":"2023-07-06T21:58:40.387026+0000","last_clean":"2023-07-06T21:58:40.387026+0000","last_became_active":"2023-07-06T21:58:39.280323+0000","last_became_peered":"2023-07-06T21:58:39.280323+0000","last_unstale":"2023-07-06T21:58:40.387026+0000","last_undegraded":"2023-07-06T21:58:40.387026+0000","last_fullsized":"2023-07-06T21:58:40.387026+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:42:17.057952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387040+0000","last_change":"2023-07-06T21:58:39.277753+0000","last_active":"2023-07-06T21:58:40.387040+0000","last_peered":"2023-07-06T21:58:40.387040+0000","last_clean":"2023-07-06T21:58:40.387040+0000","last_became_active":"2023-07-06T21:58:39.277407+0000","last_became_peered":"2023-07-06T21:58:39.277407+0000","last_unstale":"2023-07-06T21:58:40.387040+0000","last_undegraded":"2023-07-06T21:58:40.387040+0000","last_fullsized":"2023-07-06T21:58:40.387040+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:36:07.215019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598641+0000","last_change":"2023-07-06T21:58:39.269638+0000","last_active":"2023-07-06T21:58:40.598641+0000","last_peered":"2023-07-06T21:58:40.598641+0000","last_clean":"2023-07-06T21:58:40.598641+0000","last_became_active":"2023-07-06T21:58:39.269372+0000","last_became_peered":"2023-07-06T21:58:39.269372+0000","last_unstale":"2023-07-06T21:58:40.598641+0000","last_undegraded":"2023-07-06T21:58:40.598641+0000","last_fullsized":"2023-07-06T21:58:40.598641+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:20.263915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599481+0000","last_change":"2023-07-06T21:58:39.274340+0000","last_active":"2023-07-06T21:58:40.599481+0000","last_peered":"2023-07-06T21:58:40.599481+0000","last_clean":"2023-07-06T21:58:40.599481+0000","last_became_active":"2023-07-06T21:58:39.273758+0000","last_became_peered":"2023-07-06T21:58:39.273758+0000","last_unstale":"2023-07-06T21:58:40.599481+0000","last_undegraded":"2023-07-06T21:58:40.599481+0000","last_fullsized":"2023-07-06T21:58:40.599481+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:53:22.474644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599642+0000","last_change":"2023-07-06T21:58:39.282561+0000","last_active":"2023-07-06T21:58:40.599642+0000","last_peered":"2023-07-06T21:58:40.599642+0000","last_clean":"2023-07-06T21:58:40.599642+0000","last_became_active":"2023-07-06T21:58:39.282275+0000","last_became_peered":"2023-07-06T21:58:39.282275+0000","last_unstale":"2023-07-06T21:58:40.599642+0000","last_undegraded":"2023-07-06T21:58:40.599642+0000","last_fullsized":"2023-07-06T21:58:40.599642+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:44.272927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.386896+0000","last_change":"2023-07-06T21:58:39.275129+0000","last_active":"2023-07-06T21:58:40.386896+0000","last_peered":"2023-07-06T21:58:40.386896+0000","last_clean":"2023-07-06T21:58:40.386896+0000","last_became_active":"2023-07-06T21:58:39.274822+0000","last_became_peered":"2023-07-06T21:58:39.274822+0000","last_unstale":"2023-07-06T21:58:40.386896+0000","last_undegraded":"2023-07-06T21:58:40.386896+0000","last_fullsized":"2023-07-06T21:58:40.386896+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:08:43.129480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599939+0000","last_change":"2023-07-06T21:58:39.279809+0000","last_active":"2023-07-06T21:58:40.599939+0000","last_peered":"2023-07-06T21:58:40.599939+0000","last_clean":"2023-07-06T21:58:40.599939+0000","last_became_active":"2023-07-06T21:58:39.279525+0000","last_became_peered":"2023-07-06T21:58:39.279525+0000","last_unstale":"2023-07-06T21:58:40.599939+0000","last_undegraded":"2023-07-06T21:58:40.599939+0000","last_fullsized":"2023-07-06T21:58:40.599939+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:06:20.242221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599299+0000","last_change":"2023-07-06T21:58:39.275399+0000","last_active":"2023-07-06T21:58:40.599299+0000","last_peered":"2023-07-06T21:58:40.599299+0000","last_clean":"2023-07-06T21:58:40.599299+0000","last_became_active":"2023-07-06T21:58:39.274381+0000","last_became_peered":"2023-07-06T21:58:39.274381+0000","last_unstale":"2023-07-06T21:58:40.599299+0000","last_undegraded":"2023-07-06T21:58:40.599299+0000","last_fullsized":"2023-07-06T21:58:40.599299+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:36:30.315472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258347+0000","last_change":"2023-07-06T21:58:39.279019+0000","last_active":"2023-07-06T21:58:40.258347+0000","last_peered":"2023-07-06T21:58:40.258347+0000","last_clean":"2023-07-06T21:58:40.258347+0000","last_became_active":"2023-07-06T21:58:39.278748+0000","last_became_peered":"2023-07-06T21:58:39.278748+0000","last_unstale":"2023-07-06T21:58:40.258347+0000","last_undegraded":"2023-07-06T21:58:40.258347+0000","last_fullsized":"2023-07-06T21:58:40.258347+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:07:50.048872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598575+0000","last_change":"2023-07-06T21:58:39.269209+0000","last_active":"2023-07-06T21:58:40.598575+0000","last_peered":"2023-07-06T21:58:40.598575+0000","last_clean":"2023-07-06T21:58:40.598575+0000","last_became_active":"2023-07-06T21:58:39.268941+0000","last_became_peered":"2023-07-06T21:58:39.268941+0000","last_unstale":"2023-07-06T21:58:40.598575+0000","last_undegraded":"2023-07-06T21:58:40.598575+0000","last_fullsized":"2023-07-06T21:58:40.598575+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:45:57.180404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.386881+0000","last_change":"2023-07-06T21:58:39.275722+0000","last_active":"2023-07-06T21:58:40.386881+0000","last_peered":"2023-07-06T21:58:40.386881+0000","last_clean":"2023-07-06T21:58:40.386881+0000","last_became_active":"2023-07-06T21:58:39.271933+0000","last_became_peered":"2023-07-06T21:58:39.271933+0000","last_unstale":"2023-07-06T21:58:40.386881+0000","last_undegraded":"2023-07-06T21:58:40.386881+0000","last_fullsized":"2023-07-06T21:58:40.386881+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:46:41.341881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599158+0000","last_change":"2023-07-06T21:58:39.289925+0000","last_active":"2023-07-06T21:58:40.599158+0000","last_peered":"2023-07-06T21:58:40.599158+0000","last_clean":"2023-07-06T21:58:40.599158+0000","last_became_active":"2023-07-06T21:58:39.289603+0000","last_became_peered":"2023-07-06T21:58:39.289603+0000","last_unstale":"2023-07-06T21:58:40.599158+0000","last_undegraded":"2023-07-06T21:58:40.599158+0000","last_fullsized":"2023-07-06T21:58:40.599158+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:18:57.399675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599601+0000","last_change":"2023-07-06T21:58:39.270453+0000","last_active":"2023-07-06T21:58:40.599601+0000","last_peered":"2023-07-06T21:58:40.599601+0000","last_clean":"2023-07-06T21:58:40.599601+0000","last_became_active":"2023-07-06T21:58:39.270194+0000","last_became_peered":"2023-07-06T21:58:39.270194+0000","last_unstale":"2023-07-06T21:58:40.599601+0000","last_undegraded":"2023-07-06T21:58:40.599601+0000","last_fullsized":"2023-07-06T21:58:40.599601+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:08:48.342650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258695+0000","last_change":"2023-07-06T21:58:39.277368+0000","last_active":"2023-07-06T21:58:40.258695+0000","last_peered":"2023-07-06T21:58:40.258695+0000","last_clean":"2023-07-06T21:58:40.258695+0000","last_became_active":"2023-07-06T21:58:39.277073+0000","last_became_peered":"2023-07-06T21:58:39.277073+0000","last_unstale":"2023-07-06T21:58:40.258695+0000","last_undegraded":"2023-07-06T21:58:40.258695+0000","last_fullsized":"2023-07-06T21:58:40.258695+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:33:02.283894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599983+0000","last_change":"2023-07-06T21:58:39.274095+0000","last_active":"2023-07-06T21:58:40.599983+0000","last_peered":"2023-07-06T21:58:40.599983+0000","last_clean":"2023-07-06T21:58:40.599983+0000","last_became_active":"2023-07-06T21:58:39.273786+0000","last_became_peered":"2023-07-06T21:58:39.273786+0000","last_unstale":"2023-07-06T21:58:40.599983+0000","last_undegraded":"2023-07-06T21:58:40.599983+0000","last_fullsized":"2023-07-06T21:58:40.599983+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:15:27.302960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258631+0000","last_change":"2023-07-06T21:58:39.277955+0000","last_active":"2023-07-06T21:58:40.258631+0000","last_peered":"2023-07-06T21:58:40.258631+0000","last_clean":"2023-07-06T21:58:40.258631+0000","last_became_active":"2023-07-06T21:58:39.277704+0000","last_became_peered":"2023-07-06T21:58:39.277704+0000","last_unstale":"2023-07-06T21:58:40.258631+0000","last_undegraded":"2023-07-06T21:58:40.258631+0000","last_fullsized":"2023-07-06T21:58:40.258631+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:48.167586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598744+0000","last_change":"2023-07-06T21:58:39.289577+0000","last_active":"2023-07-06T21:58:40.598744+0000","last_peered":"2023-07-06T21:58:40.598744+0000","last_clean":"2023-07-06T21:58:40.598744+0000","last_became_active":"2023-07-06T21:58:39.289240+0000","last_became_peered":"2023-07-06T21:58:39.289240+0000","last_unstale":"2023-07-06T21:58:40.598744+0000","last_undegraded":"2023-07-06T21:58:40.598744+0000","last_fullsized":"2023-07-06T21:58:40.598744+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:34:36.068693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599611+0000","last_change":"2023-07-06T21:58:39.278386+0000","last_active":"2023-07-06T21:58:40.599611+0000","last_peered":"2023-07-06T21:58:40.599611+0000","last_clean":"2023-07-06T21:58:40.599611+0000","last_became_active":"2023-07-06T21:58:39.278138+0000","last_became_peered":"2023-07-06T21:58:39.278138+0000","last_unstale":"2023-07-06T21:58:40.599611+0000","last_undegraded":"2023-07-06T21:58:40.599611+0000","last_fullsized":"2023-07-06T21:58:40.599611+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:15:50.197397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387164+0000","last_change":"2023-07-06T21:58:39.275974+0000","last_active":"2023-07-06T21:58:40.387164+0000","last_peered":"2023-07-06T21:58:40.387164+0000","last_clean":"2023-07-06T21:58:40.387164+0000","last_became_active":"2023-07-06T21:58:39.272538+0000","last_became_peered":"2023-07-06T21:58:39.272538+0000","last_unstale":"2023-07-06T21:58:40.387164+0000","last_undegraded":"2023-07-06T21:58:40.387164+0000","last_fullsized":"2023-07-06T21:58:40.387164+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:34.754788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599789+0000","last_change":"2023-07-06T21:58:39.292400+0000","last_active":"2023-07-06T21:58:40.599789+0000","last_peered":"2023-07-06T21:58:40.599789+0000","last_clean":"2023-07-06T21:58:40.599789+0000","last_became_active":"2023-07-06T21:58:39.292035+0000","last_became_peered":"2023-07-06T21:58:39.292035+0000","last_unstale":"2023-07-06T21:58:40.599789+0000","last_undegraded":"2023-07-06T21:58:40.599789+0000","last_fullsized":"2023-07-06T21:58:40.599789+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:31:43.264672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599240+0000","last_change":"2023-07-06T21:58:39.278059+0000","last_active":"2023-07-06T21:58:40.599240+0000","last_peered":"2023-07-06T21:58:40.599240+0000","last_clean":"2023-07-06T21:58:40.599240+0000","last_became_active":"2023-07-06T21:58:39.277791+0000","last_became_peered":"2023-07-06T21:58:39.277791+0000","last_unstale":"2023-07-06T21:58:40.599240+0000","last_undegraded":"2023-07-06T21:58:40.599240+0000","last_fullsized":"2023-07-06T21:58:40.599240+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:29:23.279429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.386966+0000","last_change":"2023-07-06T21:58:39.270461+0000","last_active":"2023-07-06T21:58:40.386966+0000","last_peered":"2023-07-06T21:58:40.386966+0000","last_clean":"2023-07-06T21:58:40.386966+0000","last_became_active":"2023-07-06T21:58:39.270179+0000","last_became_peered":"2023-07-06T21:58:39.270179+0000","last_unstale":"2023-07-06T21:58:40.386966+0000","last_undegraded":"2023-07-06T21:58:40.386966+0000","last_fullsized":"2023-07-06T21:58:40.386966+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:56:06.284421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599466+0000","last_change":"2023-07-06T21:58:39.281570+0000","last_active":"2023-07-06T21:58:40.599466+0000","last_peered":"2023-07-06T21:58:40.599466+0000","last_clean":"2023-07-06T21:58:40.599466+0000","last_became_active":"2023-07-06T21:58:39.281276+0000","last_became_peered":"2023-07-06T21:58:39.281276+0000","last_unstale":"2023-07-06T21:58:40.599466+0000","last_undegraded":"2023-07-06T21:58:40.599466+0000","last_fullsized":"2023-07-06T21:58:40.599466+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:13:28.815793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598780+0000","last_change":"2023-07-06T21:58:39.277858+0000","last_active":"2023-07-06T21:58:40.598780+0000","last_peered":"2023-07-06T21:58:40.598780+0000","last_clean":"2023-07-06T21:58:40.598780+0000","last_became_active":"2023-07-06T21:58:39.277586+0000","last_became_peered":"2023-07-06T21:58:39.277586+0000","last_unstale":"2023-07-06T21:58:40.598780+0000","last_undegraded":"2023-07-06T21:58:40.598780+0000","last_fullsized":"2023-07-06T21:58:40.598780+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:26:16.572936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258485+0000","last_change":"2023-07-06T21:58:39.279846+0000","last_active":"2023-07-06T21:58:40.258485+0000","last_peered":"2023-07-06T21:58:40.258485+0000","last_clean":"2023-07-06T21:58:40.258485+0000","last_became_active":"2023-07-06T21:58:39.279589+0000","last_became_peered":"2023-07-06T21:58:39.279589+0000","last_unstale":"2023-07-06T21:58:40.258485+0000","last_undegraded":"2023-07-06T21:58:40.258485+0000","last_fullsized":"2023-07-06T21:58:40.258485+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:37:07.138365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598635+0000","last_change":"2023-07-06T21:58:39.281869+0000","last_active":"2023-07-06T21:58:40.598635+0000","last_peered":"2023-07-06T21:58:40.598635+0000","last_clean":"2023-07-06T21:58:40.598635+0000","last_became_active":"2023-07-06T21:58:39.281389+0000","last_became_peered":"2023-07-06T21:58:39.281389+0000","last_unstale":"2023-07-06T21:58:40.598635+0000","last_undegraded":"2023-07-06T21:58:40.598635+0000","last_fullsized":"2023-07-06T21:58:40.598635+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:00:29.819480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.256790+0000","last_change":"2023-07-06T21:58:39.279403+0000","last_active":"2023-07-06T21:58:40.256790+0000","last_peered":"2023-07-06T21:58:40.256790+0000","last_clean":"2023-07-06T21:58:40.256790+0000","last_became_active":"2023-07-06T21:58:39.279127+0000","last_became_peered":"2023-07-06T21:58:39.279127+0000","last_unstale":"2023-07-06T21:58:40.256790+0000","last_undegraded":"2023-07-06T21:58:40.256790+0000","last_fullsized":"2023-07-06T21:58:40.256790+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:08:20.087239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258574+0000","last_change":"2023-07-06T21:58:39.270912+0000","last_active":"2023-07-06T21:58:40.258574+0000","last_peered":"2023-07-06T21:58:40.258574+0000","last_clean":"2023-07-06T21:58:40.258574+0000","last_became_active":"2023-07-06T21:58:39.270646+0000","last_became_peered":"2023-07-06T21:58:39.270646+0000","last_unstale":"2023-07-06T21:58:40.258574+0000","last_undegraded":"2023-07-06T21:58:40.258574+0000","last_fullsized":"2023-07-06T21:58:40.258574+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:48.689823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"116'4","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599185+0000","last_change":"2023-07-06T21:58:38.859006+0000","last_active":"2023-07-06T21:58:40.599185+0000","last_peered":"2023-07-06T21:58:40.599185+0000","last_clean":"2023-07-06T21:58:40.599185+0000","last_became_active":"2023-07-06T21:58:38.858729+0000","last_became_peered":"2023-07-06T21:58:38.858729+0000","last_unstale":"2023-07-06T21:58:40.599185+0000","last_undegraded":"2023-07-06T21:58:40.599185+0000","last_fullsized":"2023-07-06T21:58:40.599185+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:22:47.883033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599639+0000","last_change":"2023-07-06T21:58:39.280528+0000","last_active":"2023-07-06T21:58:40.599639+0000","last_peered":"2023-07-06T21:58:40.599639+0000","last_clean":"2023-07-06T21:58:40.599639+0000","last_became_active":"2023-07-06T21:58:39.280257+0000","last_became_peered":"2023-07-06T21:58:39.280257+0000","last_unstale":"2023-07-06T21:58:40.599639+0000","last_undegraded":"2023-07-06T21:58:40.599639+0000","last_fullsized":"2023-07-06T21:58:40.599639+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:52:51.653640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"116'1","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387013+0000","last_change":"2023-07-06T21:58:38.863528+0000","last_active":"2023-07-06T21:58:40.387013+0000","last_peered":"2023-07-06T21:58:40.387013+0000","last_clean":"2023-07-06T21:58:40.387013+0000","last_became_active":"2023-07-06T21:58:38.863170+0000","last_became_peered":"2023-07-06T21:58:38.863170+0000","last_unstale":"2023-07-06T21:58:40.387013+0000","last_undegraded":"2023-07-06T21:58:40.387013+0000","last_fullsized":"2023-07-06T21:58:40.387013+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:08:28.420572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257487+0000","last_change":"2023-07-06T21:58:39.286563+0000","last_active":"2023-07-06T21:58:40.257487+0000","last_peered":"2023-07-06T21:58:40.257487+0000","last_clean":"2023-07-06T21:58:40.257487+0000","last_became_active":"2023-07-06T21:58:39.286268+0000","last_became_peered":"2023-07-06T21:58:39.286268+0000","last_unstale":"2023-07-06T21:58:40.257487+0000","last_undegraded":"2023-07-06T21:58:40.257487+0000","last_fullsized":"2023-07-06T21:58:40.257487+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:45:50.670627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"116'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598930+0000","last_change":"2023-07-06T21:58:38.870850+0000","last_active":"2023-07-06T21:58:40.598930+0000","last_peered":"2023-07-06T21:58:40.598930+0000","last_clean":"2023-07-06T21:58:40.598930+0000","last_became_active":"2023-07-06T21:58:38.870582+0000","last_became_peered":"2023-07-06T21:58:38.870582+0000","last_unstale":"2023-07-06T21:58:40.598930+0000","last_undegraded":"2023-07-06T21:58:40.598930+0000","last_fullsized":"2023-07-06T21:58:40.598930+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:40.071513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599543+0000","last_change":"2023-07-06T21:58:39.279294+0000","last_active":"2023-07-06T21:58:40.599543+0000","last_peered":"2023-07-06T21:58:40.599543+0000","last_clean":"2023-07-06T21:58:40.599543+0000","last_became_active":"2023-07-06T21:58:39.279030+0000","last_became_peered":"2023-07-06T21:58:39.279030+0000","last_unstale":"2023-07-06T21:58:40.599543+0000","last_undegraded":"2023-07-06T21:58:40.599543+0000","last_fullsized":"2023-07-06T21:58:40.599543+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:17:59.893341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"116'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598939+0000","last_change":"2023-07-06T21:58:38.863184+0000","last_active":"2023-07-06T21:58:40.598939+0000","last_peered":"2023-07-06T21:58:40.598939+0000","last_clean":"2023-07-06T21:58:40.598939+0000","last_became_active":"2023-07-06T21:58:38.862879+0000","last_became_peered":"2023-07-06T21:58:38.862879+0000","last_unstale":"2023-07-06T21:58:40.598939+0000","last_undegraded":"2023-07-06T21:58:40.598939+0000","last_fullsized":"2023-07-06T21:58:40.598939+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:34:01.632784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.255689+0000","last_change":"2023-07-06T21:58:39.286847+0000","last_active":"2023-07-06T21:58:40.255689+0000","last_peered":"2023-07-06T21:58:40.255689+0000","last_clean":"2023-07-06T21:58:40.255689+0000","last_became_active":"2023-07-06T21:58:39.286573+0000","last_became_peered":"2023-07-06T21:58:39.286573+0000","last_unstale":"2023-07-06T21:58:40.255689+0000","last_undegraded":"2023-07-06T21:58:40.255689+0000","last_fullsized":"2023-07-06T21:58:40.255689+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:24:06.974711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"116'1","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257118+0000","last_change":"2023-07-06T21:58:38.859991+0000","last_active":"2023-07-06T21:58:40.257118+0000","last_peered":"2023-07-06T21:58:40.257118+0000","last_clean":"2023-07-06T21:58:40.257118+0000","last_became_active":"2023-07-06T21:58:38.859520+0000","last_became_peered":"2023-07-06T21:58:38.859520+0000","last_unstale":"2023-07-06T21:58:40.257118+0000","last_undegraded":"2023-07-06T21:58:40.257118+0000","last_fullsized":"2023-07-06T21:58:40.257118+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:03:25.370088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.386996+0000","last_change":"2023-07-06T21:58:39.278469+0000","last_active":"2023-07-06T21:58:40.386996+0000","last_peered":"2023-07-06T21:58:40.386996+0000","last_clean":"2023-07-06T21:58:40.386996+0000","last_became_active":"2023-07-06T21:58:39.278191+0000","last_became_peered":"2023-07-06T21:58:39.278191+0000","last_unstale":"2023-07-06T21:58:40.386996+0000","last_undegraded":"2023-07-06T21:58:40.386996+0000","last_fullsized":"2023-07-06T21:58:40.386996+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:45:40.163025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"116'1","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598819+0000","last_change":"2023-07-06T21:58:38.863867+0000","last_active":"2023-07-06T21:58:40.598819+0000","last_peered":"2023-07-06T21:58:40.598819+0000","last_clean":"2023-07-06T21:58:40.598819+0000","last_became_active":"2023-07-06T21:58:38.863565+0000","last_became_peered":"2023-07-06T21:58:38.863565+0000","last_unstale":"2023-07-06T21:58:40.598819+0000","last_undegraded":"2023-07-06T21:58:40.598819+0000","last_fullsized":"2023-07-06T21:58:40.598819+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:17:57.873693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598555+0000","last_change":"2023-07-06T21:58:39.270238+0000","last_active":"2023-07-06T21:58:40.598555+0000","last_peered":"2023-07-06T21:58:40.598555+0000","last_clean":"2023-07-06T21:58:40.598555+0000","last_became_active":"2023-07-06T21:58:39.269847+0000","last_became_peered":"2023-07-06T21:58:39.269847+0000","last_unstale":"2023-07-06T21:58:40.598555+0000","last_undegraded":"2023-07-06T21:58:40.598555+0000","last_fullsized":"2023-07-06T21:58:40.598555+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:10:02.394652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599067+0000","last_change":"2023-07-06T21:58:38.862193+0000","last_active":"2023-07-06T21:58:40.599067+0000","last_peered":"2023-07-06T21:58:40.599067+0000","last_clean":"2023-07-06T21:58:40.599067+0000","last_became_active":"2023-07-06T21:58:38.861880+0000","last_became_peered":"2023-07-06T21:58:38.861880+0000","last_unstale":"2023-07-06T21:58:40.599067+0000","last_undegraded":"2023-07-06T21:58:40.599067+0000","last_fullsized":"2023-07-06T21:58:40.599067+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:04:39.725013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599144+0000","last_change":"2023-07-06T21:58:39.278749+0000","last_active":"2023-07-06T21:58:40.599144+0000","last_peered":"2023-07-06T21:58:40.599144+0000","last_clean":"2023-07-06T21:58:40.599144+0000","last_became_active":"2023-07-06T21:58:39.278483+0000","last_became_peered":"2023-07-06T21:58:39.278483+0000","last_unstale":"2023-07-06T21:58:40.599144+0000","last_undegraded":"2023-07-06T21:58:40.599144+0000","last_fullsized":"2023-07-06T21:58:40.599144+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:17:12.504711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.256854+0000","last_change":"2023-07-06T21:58:38.861556+0000","last_active":"2023-07-06T21:58:40.256854+0000","last_peered":"2023-07-06T21:58:40.256854+0000","last_clean":"2023-07-06T21:58:40.256854+0000","last_became_active":"2023-07-06T21:58:38.860833+0000","last_became_peered":"2023-07-06T21:58:38.860833+0000","last_unstale":"2023-07-06T21:58:40.256854+0000","last_undegraded":"2023-07-06T21:58:40.256854+0000","last_fullsized":"2023-07-06T21:58:40.256854+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:06:07.104516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599368+0000","last_change":"2023-07-06T21:58:39.289773+0000","last_active":"2023-07-06T21:58:40.599368+0000","last_peered":"2023-07-06T21:58:40.599368+0000","last_clean":"2023-07-06T21:58:40.599368+0000","last_became_active":"2023-07-06T21:58:39.289484+0000","last_became_peered":"2023-07-06T21:58:39.289484+0000","last_unstale":"2023-07-06T21:58:40.599368+0000","last_undegraded":"2023-07-06T21:58:40.599368+0000","last_fullsized":"2023-07-06T21:58:40.599368+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:13:05.099929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257036+0000","last_change":"2023-07-06T21:58:38.859846+0000","last_active":"2023-07-06T21:58:40.257036+0000","last_peered":"2023-07-06T21:58:40.257036+0000","last_clean":"2023-07-06T21:58:40.257036+0000","last_became_active":"2023-07-06T21:58:38.859532+0000","last_became_peered":"2023-07-06T21:58:38.859532+0000","last_unstale":"2023-07-06T21:58:40.257036+0000","last_undegraded":"2023-07-06T21:58:40.257036+0000","last_fullsized":"2023-07-06T21:58:40.257036+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:59:17.553148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599543+0000","last_change":"2023-07-06T21:58:39.284976+0000","last_active":"2023-07-06T21:58:40.599543+0000","last_peered":"2023-07-06T21:58:40.599543+0000","last_clean":"2023-07-06T21:58:40.599543+0000","last_became_active":"2023-07-06T21:58:39.284692+0000","last_became_peered":"2023-07-06T21:58:39.284692+0000","last_unstale":"2023-07-06T21:58:40.599543+0000","last_undegraded":"2023-07-06T21:58:40.599543+0000","last_fullsized":"2023-07-06T21:58:40.599543+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:43:20.725336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599563+0000","last_change":"2023-07-06T21:58:38.870893+0000","last_active":"2023-07-06T21:58:40.599563+0000","last_peered":"2023-07-06T21:58:40.599563+0000","last_clean":"2023-07-06T21:58:40.599563+0000","last_became_active":"2023-07-06T21:58:38.870589+0000","last_became_peered":"2023-07-06T21:58:38.870589+0000","last_unstale":"2023-07-06T21:58:40.599563+0000","last_undegraded":"2023-07-06T21:58:40.599563+0000","last_fullsized":"2023-07-06T21:58:40.599563+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:51:13.454310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599627+0000","last_change":"2023-07-06T21:58:39.292491+0000","last_active":"2023-07-06T21:58:40.599627+0000","last_peered":"2023-07-06T21:58:40.599627+0000","last_clean":"2023-07-06T21:58:40.599627+0000","last_became_active":"2023-07-06T21:58:39.292089+0000","last_became_peered":"2023-07-06T21:58:39.292089+0000","last_unstale":"2023-07-06T21:58:40.599627+0000","last_undegraded":"2023-07-06T21:58:40.599627+0000","last_fullsized":"2023-07-06T21:58:40.599627+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:58:29.694766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"116'3","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387277+0000","last_change":"2023-07-06T21:58:38.856335+0000","last_active":"2023-07-06T21:58:40.387277+0000","last_peered":"2023-07-06T21:58:40.387277+0000","last_clean":"2023-07-06T21:58:40.387277+0000","last_became_active":"2023-07-06T21:58:38.856010+0000","last_became_peered":"2023-07-06T21:58:38.856010+0000","last_unstale":"2023-07-06T21:58:40.387277+0000","last_undegraded":"2023-07-06T21:58:40.387277+0000","last_fullsized":"2023-07-06T21:58:40.387277+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:16:46.713137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387158+0000","last_change":"2023-07-06T21:58:39.287150+0000","last_active":"2023-07-06T21:58:40.387158+0000","last_peered":"2023-07-06T21:58:40.387158+0000","last_clean":"2023-07-06T21:58:40.387158+0000","last_became_active":"2023-07-06T21:58:39.285773+0000","last_became_peered":"2023-07-06T21:58:39.285773+0000","last_unstale":"2023-07-06T21:58:40.387158+0000","last_undegraded":"2023-07-06T21:58:40.387158+0000","last_fullsized":"2023-07-06T21:58:40.387158+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:27:00.917700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"116'6","reported_seq":19,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.600030+0000","last_change":"2023-07-06T21:58:38.855449+0000","last_active":"2023-07-06T21:58:40.600030+0000","last_peered":"2023-07-06T21:58:40.600030+0000","last_clean":"2023-07-06T21:58:40.600030+0000","last_became_active":"2023-07-06T21:58:38.854829+0000","last_became_peered":"2023-07-06T21:58:38.854829+0000","last_unstale":"2023-07-06T21:58:40.600030+0000","last_undegraded":"2023-07-06T21:58:40.600030+0000","last_fullsized":"2023-07-06T21:58:40.600030+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:05.031176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599235+0000","last_change":"2023-07-06T21:58:39.263456+0000","last_active":"2023-07-06T21:58:40.599235+0000","last_peered":"2023-07-06T21:58:40.599235+0000","last_clean":"2023-07-06T21:58:40.599235+0000","last_became_active":"2023-07-06T21:58:39.262749+0000","last_became_peered":"2023-07-06T21:58:39.262749+0000","last_unstale":"2023-07-06T21:58:40.599235+0000","last_undegraded":"2023-07-06T21:58:40.599235+0000","last_fullsized":"2023-07-06T21:58:40.599235+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:52.698792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"116'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258875+0000","last_change":"2023-07-06T21:58:38.868303+0000","last_active":"2023-07-06T21:58:40.258875+0000","last_peered":"2023-07-06T21:58:40.258875+0000","last_clean":"2023-07-06T21:58:40.258875+0000","last_became_active":"2023-07-06T21:58:38.867548+0000","last_became_peered":"2023-07-06T21:58:38.867548+0000","last_unstale":"2023-07-06T21:58:40.258875+0000","last_undegraded":"2023-07-06T21:58:40.258875+0000","last_fullsized":"2023-07-06T21:58:40.258875+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:20:43.890658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257109+0000","last_change":"2023-07-06T21:58:39.273775+0000","last_active":"2023-07-06T21:58:40.257109+0000","last_peered":"2023-07-06T21:58:40.257109+0000","last_clean":"2023-07-06T21:58:40.257109+0000","last_became_active":"2023-07-06T21:58:39.273519+0000","last_became_peered":"2023-07-06T21:58:39.273519+0000","last_unstale":"2023-07-06T21:58:40.257109+0000","last_undegraded":"2023-07-06T21:58:40.257109+0000","last_fullsized":"2023-07-06T21:58:40.257109+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:01:18.276121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258803+0000","last_change":"2023-07-06T21:58:38.868897+0000","last_active":"2023-07-06T21:58:40.258803+0000","last_peered":"2023-07-06T21:58:40.258803+0000","last_clean":"2023-07-06T21:58:40.258803+0000","last_became_active":"2023-07-06T21:58:38.868609+0000","last_became_peered":"2023-07-06T21:58:38.868609+0000","last_unstale":"2023-07-06T21:58:40.258803+0000","last_undegraded":"2023-07-06T21:58:40.258803+0000","last_fullsized":"2023-07-06T21:58:40.258803+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:22:04.705558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599610+0000","last_change":"2023-07-06T21:58:39.277878+0000","last_active":"2023-07-06T21:58:40.599610+0000","last_peered":"2023-07-06T21:58:40.599610+0000","last_clean":"2023-07-06T21:58:40.599610+0000","last_became_active":"2023-07-06T21:58:39.277618+0000","last_became_peered":"2023-07-06T21:58:39.277618+0000","last_unstale":"2023-07-06T21:58:40.599610+0000","last_undegraded":"2023-07-06T21:58:40.599610+0000","last_fullsized":"2023-07-06T21:58:40.599610+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:39:30.344941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599195+0000","last_change":"2023-07-06T21:58:38.857989+0000","last_active":"2023-07-06T21:58:40.599195+0000","last_peered":"2023-07-06T21:58:40.599195+0000","last_clean":"2023-07-06T21:58:40.599195+0000","last_became_active":"2023-07-06T21:58:38.857724+0000","last_became_peered":"2023-07-06T21:58:38.857724+0000","last_unstale":"2023-07-06T21:58:40.599195+0000","last_undegraded":"2023-07-06T21:58:40.599195+0000","last_fullsized":"2023-07-06T21:58:40.599195+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:53:24.637036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258457+0000","last_change":"2023-07-06T21:58:39.286501+0000","last_active":"2023-07-06T21:58:40.258457+0000","last_peered":"2023-07-06T21:58:40.258457+0000","last_clean":"2023-07-06T21:58:40.258457+0000","last_became_active":"2023-07-06T21:58:39.286203+0000","last_became_peered":"2023-07-06T21:58:39.286203+0000","last_unstale":"2023-07-06T21:58:40.258457+0000","last_undegraded":"2023-07-06T21:58:40.258457+0000","last_fullsized":"2023-07-06T21:58:40.258457+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:08:45.163253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"116'8","reported_seq":21,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.256876+0000","last_change":"2023-07-06T21:58:38.863733+0000","last_active":"2023-07-06T21:58:40.256876+0000","last_peered":"2023-07-06T21:58:40.256876+0000","last_clean":"2023-07-06T21:58:40.256876+0000","last_became_active":"2023-07-06T21:58:38.863424+0000","last_became_peered":"2023-07-06T21:58:38.863424+0000","last_unstale":"2023-07-06T21:58:40.256876+0000","last_undegraded":"2023-07-06T21:58:40.256876+0000","last_fullsized":"2023-07-06T21:58:40.256876+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:09:53.922462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599463+0000","last_change":"2023-07-06T21:58:39.278177+0000","last_active":"2023-07-06T21:58:40.599463+0000","last_peered":"2023-07-06T21:58:40.599463+0000","last_clean":"2023-07-06T21:58:40.599463+0000","last_became_active":"2023-07-06T21:58:39.277900+0000","last_became_peered":"2023-07-06T21:58:39.277900+0000","last_unstale":"2023-07-06T21:58:40.599463+0000","last_undegraded":"2023-07-06T21:58:40.599463+0000","last_fullsized":"2023-07-06T21:58:40.599463+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:49:19.292761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"116'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.256137+0000","last_change":"2023-07-06T21:58:38.853727+0000","last_active":"2023-07-06T21:58:40.256137+0000","last_peered":"2023-07-06T21:58:40.256137+0000","last_clean":"2023-07-06T21:58:40.256137+0000","last_became_active":"2023-07-06T21:58:38.853397+0000","last_became_peered":"2023-07-06T21:58:38.853397+0000","last_unstale":"2023-07-06T21:58:40.256137+0000","last_undegraded":"2023-07-06T21:58:40.256137+0000","last_fullsized":"2023-07-06T21:58:40.256137+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:43:02.219921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257039+0000","last_change":"2023-07-06T21:58:39.273781+0000","last_active":"2023-07-06T21:58:40.257039+0000","last_peered":"2023-07-06T21:58:40.257039+0000","last_clean":"2023-07-06T21:58:40.257039+0000","last_became_active":"2023-07-06T21:58:39.273506+0000","last_became_peered":"2023-07-06T21:58:39.273506+0000","last_unstale":"2023-07-06T21:58:40.257039+0000","last_undegraded":"2023-07-06T21:58:40.257039+0000","last_fullsized":"2023-07-06T21:58:40.257039+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:34:52.399762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599450+0000","last_change":"2023-07-06T21:58:38.870932+0000","last_active":"2023-07-06T21:58:40.599450+0000","last_peered":"2023-07-06T21:58:40.599450+0000","last_clean":"2023-07-06T21:58:40.599450+0000","last_became_active":"2023-07-06T21:58:38.870615+0000","last_became_peered":"2023-07-06T21:58:38.870615+0000","last_unstale":"2023-07-06T21:58:40.599450+0000","last_undegraded":"2023-07-06T21:58:40.599450+0000","last_fullsized":"2023-07-06T21:58:40.599450+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:03:09.941487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257358+0000","last_change":"2023-07-06T21:58:39.281696+0000","last_active":"2023-07-06T21:58:40.257358+0000","last_peered":"2023-07-06T21:58:40.257358+0000","last_clean":"2023-07-06T21:58:40.257358+0000","last_became_active":"2023-07-06T21:58:39.281440+0000","last_became_peered":"2023-07-06T21:58:39.281440+0000","last_unstale":"2023-07-06T21:58:40.257358+0000","last_undegraded":"2023-07-06T21:58:40.257358+0000","last_fullsized":"2023-07-06T21:58:40.257358+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:29:54.981790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599040+0000","last_change":"2023-07-06T21:58:38.852166+0000","last_active":"2023-07-06T21:58:40.599040+0000","last_peered":"2023-07-06T21:58:40.599040+0000","last_clean":"2023-07-06T21:58:40.599040+0000","last_became_active":"2023-07-06T21:58:38.851876+0000","last_became_peered":"2023-07-06T21:58:38.851876+0000","last_unstale":"2023-07-06T21:58:40.599040+0000","last_undegraded":"2023-07-06T21:58:40.599040+0000","last_fullsized":"2023-07-06T21:58:40.599040+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:23:13.397884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599477+0000","last_change":"2023-07-06T21:58:39.281969+0000","last_active":"2023-07-06T21:58:40.599477+0000","last_peered":"2023-07-06T21:58:40.599477+0000","last_clean":"2023-07-06T21:58:40.599477+0000","last_became_active":"2023-07-06T21:58:39.281330+0000","last_became_peered":"2023-07-06T21:58:39.281330+0000","last_unstale":"2023-07-06T21:58:40.599477+0000","last_undegraded":"2023-07-06T21:58:40.599477+0000","last_fullsized":"2023-07-06T21:58:40.599477+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:44:27.355029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.600099+0000","last_change":"2023-07-06T21:58:38.858983+0000","last_active":"2023-07-06T21:58:40.600099+0000","last_peered":"2023-07-06T21:58:40.600099+0000","last_clean":"2023-07-06T21:58:40.600099+0000","last_became_active":"2023-07-06T21:58:38.858625+0000","last_became_peered":"2023-07-06T21:58:38.858625+0000","last_unstale":"2023-07-06T21:58:40.600099+0000","last_undegraded":"2023-07-06T21:58:40.600099+0000","last_fullsized":"2023-07-06T21:58:40.600099+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:16:01.084252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258764+0000","last_change":"2023-07-06T21:58:39.284966+0000","last_active":"2023-07-06T21:58:40.258764+0000","last_peered":"2023-07-06T21:58:40.258764+0000","last_clean":"2023-07-06T21:58:40.258764+0000","last_became_active":"2023-07-06T21:58:39.284659+0000","last_became_peered":"2023-07-06T21:58:39.284659+0000","last_unstale":"2023-07-06T21:58:40.258764+0000","last_undegraded":"2023-07-06T21:58:40.258764+0000","last_fullsized":"2023-07-06T21:58:40.258764+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:42:52.534971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598882+0000","last_change":"2023-07-06T21:58:38.856738+0000","last_active":"2023-07-06T21:58:40.598882+0000","last_peered":"2023-07-06T21:58:40.598882+0000","last_clean":"2023-07-06T21:58:40.598882+0000","last_became_active":"2023-07-06T21:58:38.856460+0000","last_became_peered":"2023-07-06T21:58:38.856460+0000","last_unstale":"2023-07-06T21:58:40.598882+0000","last_undegraded":"2023-07-06T21:58:40.598882+0000","last_fullsized":"2023-07-06T21:58:40.598882+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:50:53.771166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599378+0000","last_change":"2023-07-06T21:58:39.284384+0000","last_active":"2023-07-06T21:58:40.599378+0000","last_peered":"2023-07-06T21:58:40.599378+0000","last_clean":"2023-07-06T21:58:40.599378+0000","last_became_active":"2023-07-06T21:58:39.284082+0000","last_became_peered":"2023-07-06T21:58:39.284082+0000","last_unstale":"2023-07-06T21:58:40.599378+0000","last_undegraded":"2023-07-06T21:58:40.599378+0000","last_fullsized":"2023-07-06T21:58:40.599378+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:28:49.684213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598904+0000","last_change":"2023-07-06T21:58:38.865135+0000","last_active":"2023-07-06T21:58:40.598904+0000","last_peered":"2023-07-06T21:58:40.598904+0000","last_clean":"2023-07-06T21:58:40.598904+0000","last_became_active":"2023-07-06T21:58:38.864802+0000","last_became_peered":"2023-07-06T21:58:38.864802+0000","last_unstale":"2023-07-06T21:58:40.598904+0000","last_undegraded":"2023-07-06T21:58:40.598904+0000","last_fullsized":"2023-07-06T21:58:40.598904+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:12:18.243948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258323+0000","last_change":"2023-07-06T21:58:39.286489+0000","last_active":"2023-07-06T21:58:40.258323+0000","last_peered":"2023-07-06T21:58:40.258323+0000","last_clean":"2023-07-06T21:58:40.258323+0000","last_became_active":"2023-07-06T21:58:39.286198+0000","last_became_peered":"2023-07-06T21:58:39.286198+0000","last_unstale":"2023-07-06T21:58:40.258323+0000","last_undegraded":"2023-07-06T21:58:40.258323+0000","last_fullsized":"2023-07-06T21:58:40.258323+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:43:16.615758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599170+0000","last_change":"2023-07-06T21:58:38.865381+0000","last_active":"2023-07-06T21:58:40.599170+0000","last_peered":"2023-07-06T21:58:40.599170+0000","last_clean":"2023-07-06T21:58:40.599170+0000","last_became_active":"2023-07-06T21:58:38.865093+0000","last_became_peered":"2023-07-06T21:58:38.865093+0000","last_unstale":"2023-07-06T21:58:40.599170+0000","last_undegraded":"2023-07-06T21:58:40.599170+0000","last_fullsized":"2023-07-06T21:58:40.599170+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:52:38.288581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599094+0000","last_change":"2023-07-06T21:58:39.282301+0000","last_active":"2023-07-06T21:58:40.599094+0000","last_peered":"2023-07-06T21:58:40.599094+0000","last_clean":"2023-07-06T21:58:40.599094+0000","last_became_active":"2023-07-06T21:58:39.281895+0000","last_became_peered":"2023-07-06T21:58:39.281895+0000","last_unstale":"2023-07-06T21:58:40.599094+0000","last_undegraded":"2023-07-06T21:58:40.599094+0000","last_fullsized":"2023-07-06T21:58:40.599094+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:32:54.620989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258415+0000","last_change":"2023-07-06T21:58:38.867637+0000","last_active":"2023-07-06T21:58:40.258415+0000","last_peered":"2023-07-06T21:58:40.258415+0000","last_clean":"2023-07-06T21:58:40.258415+0000","last_became_active":"2023-07-06T21:58:38.867340+0000","last_became_peered":"2023-07-06T21:58:38.867340+0000","last_unstale":"2023-07-06T21:58:40.258415+0000","last_undegraded":"2023-07-06T21:58:40.258415+0000","last_fullsized":"2023-07-06T21:58:40.258415+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:04:38.792409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258712+0000","last_change":"2023-07-06T21:58:39.274101+0000","last_active":"2023-07-06T21:58:40.258712+0000","last_peered":"2023-07-06T21:58:40.258712+0000","last_clean":"2023-07-06T21:58:40.258712+0000","last_became_active":"2023-07-06T21:58:39.273802+0000","last_became_peered":"2023-07-06T21:58:39.273802+0000","last_unstale":"2023-07-06T21:58:40.258712+0000","last_undegraded":"2023-07-06T21:58:40.258712+0000","last_fullsized":"2023-07-06T21:58:40.258712+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:18:21.320404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"116'1","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387068+0000","last_change":"2023-07-06T21:58:38.854821+0000","last_active":"2023-07-06T21:58:40.387068+0000","last_peered":"2023-07-06T21:58:40.387068+0000","last_clean":"2023-07-06T21:58:40.387068+0000","last_became_active":"2023-07-06T21:58:38.854517+0000","last_became_peered":"2023-07-06T21:58:38.854517+0000","last_unstale":"2023-07-06T21:58:40.387068+0000","last_undegraded":"2023-07-06T21:58:40.387068+0000","last_fullsized":"2023-07-06T21:58:40.387068+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:35:00.854487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"105'205","reported_seq":675,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387287+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T21:58:40.387287+0000","last_peered":"2023-07-06T21:58:40.387287+0000","last_clean":"2023-07-06T21:58:40.387287+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T21:58:40.387287+0000","last_undegraded":"2023-07-06T21:58:40.387287+0000","last_fullsized":"2023-07-06T21:58:40.387287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:40:22.049664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":184,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.255836+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T21:58:40.255836+0000","last_peered":"2023-07-06T21:58:40.255836+0000","last_clean":"2023-07-06T21:58:40.255836+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T21:58:40.255836+0000","last_undegraded":"2023-07-06T21:58:40.255836+0000","last_fullsized":"2023-07-06T21:58:40.255836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:33:32.004290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387232+0000","last_change":"2023-07-06T21:58:39.285314+0000","last_active":"2023-07-06T21:58:40.387232+0000","last_peered":"2023-07-06T21:58:40.387232+0000","last_clean":"2023-07-06T21:58:40.387232+0000","last_became_active":"2023-07-06T21:58:39.285040+0000","last_became_peered":"2023-07-06T21:58:39.285040+0000","last_unstale":"2023-07-06T21:58:40.387232+0000","last_undegraded":"2023-07-06T21:58:40.387232+0000","last_fullsized":"2023-07-06T21:58:40.387232+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:15:36.232870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598957+0000","last_change":"2023-07-06T21:58:38.852292+0000","last_active":"2023-07-06T21:58:40.598957+0000","last_peered":"2023-07-06T21:58:40.598957+0000","last_clean":"2023-07-06T21:58:40.598957+0000","last_became_active":"2023-07-06T21:58:38.852035+0000","last_became_peered":"2023-07-06T21:58:38.852035+0000","last_unstale":"2023-07-06T21:58:40.598957+0000","last_undegraded":"2023-07-06T21:58:40.598957+0000","last_fullsized":"2023-07-06T21:58:40.598957+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:17:43.522363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":207,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387190+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T21:58:40.387190+0000","last_peered":"2023-07-06T21:58:40.387190+0000","last_clean":"2023-07-06T21:58:40.387190+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T21:58:40.387190+0000","last_undegraded":"2023-07-06T21:58:40.387190+0000","last_fullsized":"2023-07-06T21:58:40.387190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:16:45.082903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.255777+0000","last_change":"2023-07-06T21:58:39.283156+0000","last_active":"2023-07-06T21:58:40.255777+0000","last_peered":"2023-07-06T21:58:40.255777+0000","last_clean":"2023-07-06T21:58:40.255777+0000","last_became_active":"2023-07-06T21:58:39.282873+0000","last_became_peered":"2023-07-06T21:58:39.282873+0000","last_unstale":"2023-07-06T21:58:40.255777+0000","last_undegraded":"2023-07-06T21:58:40.255777+0000","last_fullsized":"2023-07-06T21:58:40.255777+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:18:12.266031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"116'1","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599585+0000","last_change":"2023-07-06T21:58:38.853879+0000","last_active":"2023-07-06T21:58:40.599585+0000","last_peered":"2023-07-06T21:58:40.599585+0000","last_clean":"2023-07-06T21:58:40.599585+0000","last_became_active":"2023-07-06T21:58:38.853503+0000","last_became_peered":"2023-07-06T21:58:38.853503+0000","last_unstale":"2023-07-06T21:58:40.599585+0000","last_undegraded":"2023-07-06T21:58:40.599585+0000","last_fullsized":"2023-07-06T21:58:40.599585+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:06:55.014202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":209,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258326+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T21:58:40.258326+0000","last_peered":"2023-07-06T21:58:40.258326+0000","last_clean":"2023-07-06T21:58:40.258326+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T21:58:40.258326+0000","last_undegraded":"2023-07-06T21:58:40.258326+0000","last_fullsized":"2023-07-06T21:58:40.258326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:18:08.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599852+0000","last_change":"2023-07-06T21:58:39.288596+0000","last_active":"2023-07-06T21:58:40.599852+0000","last_peered":"2023-07-06T21:58:40.599852+0000","last_clean":"2023-07-06T21:58:40.599852+0000","last_became_active":"2023-07-06T21:58:39.288338+0000","last_became_peered":"2023-07-06T21:58:39.288338+0000","last_unstale":"2023-07-06T21:58:40.599852+0000","last_undegraded":"2023-07-06T21:58:40.599852+0000","last_fullsized":"2023-07-06T21:58:40.599852+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:42:51.556761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"116'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599881+0000","last_change":"2023-07-06T21:58:38.867590+0000","last_active":"2023-07-06T21:58:40.599881+0000","last_peered":"2023-07-06T21:58:40.599881+0000","last_clean":"2023-07-06T21:58:40.599881+0000","last_became_active":"2023-07-06T21:58:38.867352+0000","last_became_peered":"2023-07-06T21:58:38.867352+0000","last_unstale":"2023-07-06T21:58:40.599881+0000","last_undegraded":"2023-07-06T21:58:40.599881+0000","last_fullsized":"2023-07-06T21:58:40.599881+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:34:36.881396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":185,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.255818+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T21:58:40.255818+0000","last_peered":"2023-07-06T21:58:40.255818+0000","last_clean":"2023-07-06T21:58:40.255818+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T21:58:40.255818+0000","last_undegraded":"2023-07-06T21:58:40.255818+0000","last_fullsized":"2023-07-06T21:58:40.255818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:56:55.067772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598898+0000","last_change":"2023-07-06T21:58:39.283126+0000","last_active":"2023-07-06T21:58:40.598898+0000","last_peered":"2023-07-06T21:58:40.598898+0000","last_clean":"2023-07-06T21:58:40.598898+0000","last_became_active":"2023-07-06T21:58:39.282655+0000","last_became_peered":"2023-07-06T21:58:39.282655+0000","last_unstale":"2023-07-06T21:58:40.598898+0000","last_undegraded":"2023-07-06T21:58:40.598898+0000","last_fullsized":"2023-07-06T21:58:40.598898+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:41:59.310617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598735+0000","last_change":"2023-07-06T21:58:38.863234+0000","last_active":"2023-07-06T21:58:40.598735+0000","last_peered":"2023-07-06T21:58:40.598735+0000","last_clean":"2023-07-06T21:58:40.598735+0000","last_became_active":"2023-07-06T21:58:38.862944+0000","last_became_peered":"2023-07-06T21:58:38.862944+0000","last_unstale":"2023-07-06T21:58:40.598735+0000","last_undegraded":"2023-07-06T21:58:40.598735+0000","last_fullsized":"2023-07-06T21:58:40.598735+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:54:11.292747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":190,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257559+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T21:58:40.257559+0000","last_peered":"2023-07-06T21:58:40.257559+0000","last_clean":"2023-07-06T21:58:40.257559+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T21:58:40.257559+0000","last_undegraded":"2023-07-06T21:58:40.257559+0000","last_fullsized":"2023-07-06T21:58:40.257559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:53:12.702520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258327+0000","last_change":"2023-07-06T21:58:39.274300+0000","last_active":"2023-07-06T21:58:40.258327+0000","last_peered":"2023-07-06T21:58:40.258327+0000","last_clean":"2023-07-06T21:58:40.258327+0000","last_became_active":"2023-07-06T21:58:39.273947+0000","last_became_peered":"2023-07-06T21:58:39.273947+0000","last_unstale":"2023-07-06T21:58:40.258327+0000","last_undegraded":"2023-07-06T21:58:40.258327+0000","last_fullsized":"2023-07-06T21:58:40.258327+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:45:20.205301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.255524+0000","last_change":"2023-07-06T21:58:38.855346+0000","last_active":"2023-07-06T21:58:40.255524+0000","last_peered":"2023-07-06T21:58:40.255524+0000","last_clean":"2023-07-06T21:58:40.255524+0000","last_became_active":"2023-07-06T21:58:38.854473+0000","last_became_peered":"2023-07-06T21:58:38.854473+0000","last_unstale":"2023-07-06T21:58:40.255524+0000","last_undegraded":"2023-07-06T21:58:40.255524+0000","last_fullsized":"2023-07-06T21:58:40.255524+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:21:37.330576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":206,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.387291+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T21:58:40.387291+0000","last_peered":"2023-07-06T21:58:40.387291+0000","last_clean":"2023-07-06T21:58:40.387291+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T21:58:40.387291+0000","last_undegraded":"2023-07-06T21:58:40.387291+0000","last_fullsized":"2023-07-06T21:58:40.387291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:58:33.067249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258708+0000","last_change":"2023-07-06T21:58:39.272973+0000","last_active":"2023-07-06T21:58:40.258708+0000","last_peered":"2023-07-06T21:58:40.258708+0000","last_clean":"2023-07-06T21:58:40.258708+0000","last_became_active":"2023-07-06T21:58:39.272719+0000","last_became_peered":"2023-07-06T21:58:39.272719+0000","last_unstale":"2023-07-06T21:58:40.258708+0000","last_undegraded":"2023-07-06T21:58:40.258708+0000","last_fullsized":"2023-07-06T21:58:40.258708+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:59:57.337837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.255627+0000","last_change":"2023-07-06T21:58:38.862155+0000","last_active":"2023-07-06T21:58:40.255627+0000","last_peered":"2023-07-06T21:58:40.255627+0000","last_clean":"2023-07-06T21:58:40.255627+0000","last_became_active":"2023-07-06T21:58:38.861875+0000","last_became_peered":"2023-07-06T21:58:38.861875+0000","last_unstale":"2023-07-06T21:58:40.255627+0000","last_undegraded":"2023-07-06T21:58:40.255627+0000","last_fullsized":"2023-07-06T21:58:40.255627+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:56:05.223351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":190,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.257421+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T21:58:40.257421+0000","last_peered":"2023-07-06T21:58:40.257421+0000","last_clean":"2023-07-06T21:58:40.257421+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T21:58:40.257421+0000","last_undegraded":"2023-07-06T21:58:40.257421+0000","last_fullsized":"2023-07-06T21:58:40.257421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:23:26.514448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.258626+0000","last_change":"2023-07-06T21:58:39.274389+0000","last_active":"2023-07-06T21:58:40.258626+0000","last_peered":"2023-07-06T21:58:40.258626+0000","last_clean":"2023-07-06T21:58:40.258626+0000","last_became_active":"2023-07-06T21:58:39.274068+0000","last_became_peered":"2023-07-06T21:58:39.274068+0000","last_unstale":"2023-07-06T21:58:40.258626+0000","last_undegraded":"2023-07-06T21:58:40.258626+0000","last_fullsized":"2023-07-06T21:58:40.258626+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:38.824910+0000","last_clean_scrub_stamp":"2023-07-06T21:58:38.824910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:02:34.889552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"116'2","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.598785+0000","last_change":"2023-07-06T21:58:38.870046+0000","last_active":"2023-07-06T21:58:40.598785+0000","last_peered":"2023-07-06T21:58:40.598785+0000","last_clean":"2023-07-06T21:58:40.598785+0000","last_became_active":"2023-07-06T21:58:38.866030+0000","last_became_peered":"2023-07-06T21:58:38.866030+0000","last_unstale":"2023-07-06T21:58:40.598785+0000","last_undegraded":"2023-07-06T21:58:40.598785+0000","last_fullsized":"2023-07-06T21:58:40.598785+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:58:37.813712+0000","last_clean_scrub_stamp":"2023-07-06T21:58:37.813712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:02:27.030299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":117,"state":"active+clean","last_fresh":"2023-07-06T21:58:40.599894+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T21:58:40.599894+0000","last_peered":"2023-07-06T21:58:40.599894+0000","last_clean":"2023-07-06T21:58:40.599894+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T21:58:40.599894+0000","last_undegraded":"2023-07-06T21:58:40.599894+0000","last_fullsized":"2023-07-06T21:58:40.599894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:38:38.311850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575049,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37140,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334700,"statfs":{"total":96636764160,"available":96598732800,"internally_reserved":0,"allocated":2043904,"data_stored":1351654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.441,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68300000000000005,"15min":0.70199999999999996},"min":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.44},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.71299999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69499999999999995,"15min":0.71499999999999997},"min":{"1min":0.45300000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.42799999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.42599999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.876}]},{"osd":3,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.71699999999999997},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.746},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71599999999999997,"15min":0.73899999999999999},"min":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.39500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57299999999999995,"15min":0.58399999999999996},"min":{"1min":0.41799999999999998,"5min":0.376,"15min":0.35599999999999998},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.61299999999999999},"min":{"1min":0.47399999999999998,"5min":0.40699999999999997,"15min":0.39000000000000001},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.69399999999999995,"15min":0.70299999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.82999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575049,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1445888,"data_stored":760807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68300000000000005,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.81799999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.71199999999999997},"min":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.41599999999999998},"max":{"1min":0.76900000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93100000000000005,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.74299999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.45800000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.501},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70299999999999996,"15min":0.72499999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.498},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":1.0629999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57599999999999996,"15min":0.56499999999999995},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78100000000000003,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91300000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60899999999999999,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86599999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.56000000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96299999999999997,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:58:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94999999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.53400000000000003,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.86399999999999999,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834575048,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1445888,"data_stored":761244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.44800000000000001,"5min":0.36699999999999999,"15min":0.35999999999999999},"max":{"1min":0.87,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.69699999999999995,"15min":0.71799999999999997},"min":{"1min":0.45400000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85699999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.71399999999999997},"min":{"1min":0.52000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88500000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.46100000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82199999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.73499999999999999},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86199999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.873,"5min":1.0309999999999999,"15min":1.0369999999999999},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70899999999999996,"15min":0.74299999999999999},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72999999999999998,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83599999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.41299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.874,"5min":0.91800000000000004,"15min":1.02},"last":0.88400000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58899999999999997,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85499999999999998,"5min":0.86899999999999999,"15min":1.004},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82099999999999995,"5min":0.83599999999999997,"15min":0.95699999999999996},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.84699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575047,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1428,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1462272,"data_stored":762862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.39400000000000002},"max":{"1min":0.84399999999999997,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69799999999999995,"15min":0.71399999999999997},"min":{"1min":0.49099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93899999999999995,"5min":1.123,"15min":1.123},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.71699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86799999999999999,"5min":0.91800000000000004,"15min":0.98599999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.45000000000000001,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":0.91500000000000004,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69999999999999996,"15min":0.71599999999999997},"min":{"1min":0.48599999999999999,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":0.92300000000000004,"5min":0.94599999999999995,"15min":1.1299999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.98899999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70899999999999996,"15min":0.72399999999999998},"min":{"1min":0.46700000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92000000000000004,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.49299999999999999},"max":{"1min":0.89300000000000002,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.621}]},{"osd":5,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.308},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.94299999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.439,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.82699999999999996,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.436}]},{"osd":6,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.624,"15min":0.59899999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89300000000000002,"5min":1.036,"15min":1.036},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.49199999999999999,"5min":0.47399999999999998,"15min":0.34799999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jul 6 21:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.67400000000000004,"15min":0.65200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98199999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.442,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.01},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575048,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1458176,"data_stored":762760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.42999999999999999,"15min":0.44900000000000001},"min":{"1min":0.25600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.64200000000000002,"5min":0.85499999999999998,"15min":1.0489999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.34499999999999997,"15min":0.33400000000000002},"max":{"1min":0.56599999999999995,"5min":2.77,"15min":2.77},"last":0.434}]},{"osd":1,"last update":"Thu Jul 6 21:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.318,"5min":0.309,"15min":0.24299999999999999},"max":{"1min":0.52400000000000002,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.56399999999999995,"15min":0.58199999999999996},"min":{"1min":0.36399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.68799999999999994,"5min":1.351,"15min":1.351},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.51000000000000001,"15min":0.53200000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.61699999999999999,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.52200000000000002,"15min":0.54400000000000004},"min":{"1min":0.38500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69499999999999995,"5min":0.82899999999999996,"15min":1.24},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73099999999999998,"15min":0.76100000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34699999999999998},"max":{"1min":1.1020000000000001,"5min":1.1930000000000001,"15min":1.3009999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.745,"15min":0.77900000000000003},"min":{"1min":0.52000000000000002,"5min":0.46600000000000003,"15min":0.46000000000000002},"max":{"1min":0.84299999999999997,"5min":1.383,"15min":1.383},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.76200000000000001,"15min":0.79700000000000004},"min":{"1min":0.56399999999999995,"5min":0.51700000000000002,"15min":0.42399999999999999},"max":{"1min":0.82899999999999996,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.76700000000000002,"15min":0.78600000000000003},"min":{"1min":0.56599999999999995,"5min":0.49399999999999999,"15min":0.44800000000000001},"max":{"1min":0.93799999999999994,"5min":1.327,"15min":1.3999999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.77200000000000002,"15min":0.79500000000000004},"min":{"1min":0.53800000000000003,"5min":0.46600000000000003,"15min":0.442},"max":{"1min":0.89300000000000002,"5min":1.425,"15min":1.425},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.79400000000000004,"15min":0.80300000000000005},"min":{"1min":0.52300000000000002,"5min":0.49299999999999999,"15min":0.47899999999999998},"max":{"1min":1.075,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.80600000000000005},"min":{"1min":0.55700000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.81299999999999994,"5min":3.097,"15min":3.097},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.77400000000000002,"15min":0.80400000000000005},"min":{"1min":0.50600000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0429999999999999,"5min":1.1140000000000001,"15min":1.3480000000000001},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575048,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1445888,"data_stored":761208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.28199999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52700000000000002,"5min":0.81699999999999995,"15min":0.85999999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48299999999999998,"15min":0.497},"min":{"1min":0.26000000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.60299999999999998,"5min":0.84399999999999997,"15min":0.85999999999999999},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.63900000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83499999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.504},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63400000000000001,"5min":0.72399999999999998,"15min":0.76500000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.61299999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.47999999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.091,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.53100000000000003,"5min":0.47499999999999998,"15min":0.41399999999999998},"max":{"1min":1.1000000000000001,"5min":1.591,"15min":1.591},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.52200000000000002,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.139,"5min":1.333,"15min":1.333},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79100000000000004,"15min":0.81000000000000005},"min":{"1min":0.53800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0169999999999999,"5min":1.327,"15min":1.327},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.466,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.0509999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.54100000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.135,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.83499999999999996},"min":{"1min":0.54800000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.70099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575049,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58696,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313144,"statfs":{"total":96636764160,"available":96576659456,"internally_reserved":0,"allocated":1441792,"data_stored":761174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.438,"15min":0.44},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.49099999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.48999999999999999,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56799999999999995,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83999999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.64000000000000001,"5min":0.79800000000000004,"15min":0.87},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56000000000000005,"15min":0.58499999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.59099999999999997,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51600000000000001,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.32000000000000001},"max":{"1min":0.60899999999999999,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.38500000000000001},"max":{"1min":0.89100000000000001,"5min":1.143,"15min":1.3140000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":0.89500000000000002,"5min":1.022,"15min":1.2290000000000001},"last":0.94199999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":0.92300000000000004,"5min":1.1890000000000001,"15min":1.4359999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":1.044,"15min":1.357},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.75,"15min":0.78200000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90100000000000002,"5min":1.278,"15min":1.278},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77400000000000002,"15min":0.79300000000000004},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91500000000000004,"5min":1.0820000000000001,"15min":1.456},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jul 6 21:58:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.77300000000000002,"15min":0.79900000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.84199999999999997,"5min":1.0820000000000001,"15min":1.417},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":0.81299999999999994},"min":{"1min":0.53200000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.90400000000000003,"5min":1.3280000000000001,"15min":1.397},"last":0.89600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575048,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37132,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334708,"statfs":{"total":96636764160,"available":96598740992,"internally_reserved":0,"allocated":2035712,"data_stored":1351105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.41999999999999998,"15min":0.432},"min":{"1min":0.27100000000000002,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.54100000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.48599999999999999,"15min":0.50600000000000001},"min":{"1min":0.28299999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.747,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.47699999999999998,"15min":0.496},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.30099999999999999},"max":{"1min":0.50800000000000001,"5min":0.81100000000000005,"15min":0.82399999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.52100000000000002,"15min":0.53400000000000003},"min":{"1min":0.40699999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.66700000000000004,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.49299999999999999,"15min":0.505},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66600000000000004,"5min":1.151,"15min":1.151},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.54200000000000004,"15min":0.56699999999999995},"min":{"1min":0.373,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.60099999999999998,"5min":0.83099999999999996,"15min":0.874},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73699999999999999,"15min":0.78400000000000003},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92700000000000005,"5min":1.1319999999999999,"15min":1.242},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73999999999999999,"15min":0.77800000000000002},"min":{"1min":0.495,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":0.81899999999999995,"5min":1.3560000000000001,"15min":1.3620000000000001},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.755,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.38400000000000001},"max":{"1min":0.89900000000000002,"5min":1.254,"15min":1.3700000000000001},"last":0.629},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.73099999999999998,"15min":0.78200000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":0.77400000000000002,"5min":1.0329999999999999,"15min":1.1759999999999999},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.52200000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93000000000000005,"5min":1.113,"15min":1.2050000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.754,"15min":0.78500000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":0.996,"5min":1.2010000000000001,"15min":1.2989999999999999},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.77000000000000002,"15min":0.80500000000000005},"min":{"1min":0.51100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.84199999999999997,"5min":1.3120000000000001,"15min":1.3640000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.78200000000000003,"15min":0.81200000000000006},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.435},"max":{"1min":0.95099999999999996,"5min":1.325,"15min":1.325},"last":0.66200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T21:58:48.360 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T21:58:48.361 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-06T21:58:48.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb8599fa640 1 Processor -- start 2023-07-06T21:58:48.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb8599fa640 1 -- start start 2023-07-06T21:58:48.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb8599fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb854158770 0x7fb85406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb8599fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8540c8a30 0x7fb85406b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb8599fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb854071660 con 0x7fb8540cbb10 2023-07-06T21:58:48.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb8599fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85406a500 con 0x7fb854158770 2023-07-06T21:58:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb8599fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85406a750 con 0x7fb8540c8a30 2023-07-06T21:58:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb8537fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb8540cbb10 0x7fb8540704a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44500/0 (socket says 172.21.15.55:44500) 2023-07-06T21:58:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb8537fe640 1 -- 172.21.15.55:0/2750500369 learned_addr learned my addr 172.21.15.55:0/2750500369 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb852ffd640 1 --2- 172.21.15.55:0/2750500369 >> v2:172.21.15.55:3300/0 conn(0x7fb854158770 0x7fb85406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb8527fc640 1 --2- 172.21.15.55:0/2750500369 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8540c8a30 0x7fb85406b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb851ffb640 1 -- 172.21.15.55:0/2750500369 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261063794 0 0) 0x7fb854071660 con 0x7fb8540cbb10 2023-07-06T21:58:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb851ffb640 1 -- 172.21.15.55:0/2750500369 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb83c005740 con 0x7fb8540cbb10 2023-07-06T21:58:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb852ffd640 1 -- 172.21.15.55:0/2750500369 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8540c8a30 msgr2=0x7fb85406b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb852ffd640 1 --2- 172.21.15.55:0/2750500369 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8540c8a30 0x7fb85406b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb852ffd640 1 -- 172.21.15.55:0/2750500369 >> v1:172.21.15.55:6789/0 conn(0x7fb8540cbb10 legacy=0x7fb8540704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.547+0000 7fb852ffd640 1 -- 172.21.15.55:0/2750500369 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85406f9c0 con 0x7fb854158770 2023-07-06T21:58:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.551+0000 7fb852ffd640 1 --2- 172.21.15.55:0/2750500369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854158770 0x7fb85406b2f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fb8440097c0 tx=0x7fb84401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9993c02503aaf1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:48.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.551+0000 7fb851ffb640 1 -- 172.21.15.55:0/2750500369 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844004230 con 0x7fb854158770 2023-07-06T21:58:48.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.551+0000 7fb851ffb640 1 -- 172.21.15.55:0/2750500369 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8440a7050 con 0x7fb854158770 2023-07-06T21:58:48.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.551+0000 7fb851ffb640 1 -- 172.21.15.55:0/2750500369 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844003620 con 0x7fb854158770 2023-07-06T21:58:48.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.551+0000 7fb8599fa640 1 -- 172.21.15.55:0/2750500369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854158770 msgr2=0x7fb85406b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.551+0000 7fb8599fa640 1 --2- 172.21.15.55:0/2750500369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854158770 0x7fb85406b2f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fb8440097c0 tx=0x7fb84401c450 comp rx=0 tx=0).stop 2023-07-06T21:58:48.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.551+0000 7fb8599fa640 1 -- 172.21.15.55:0/2750500369 shutdown_connections 2023-07-06T21:58:48.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.551+0000 7fb8599fa640 1 --2- 172.21.15.55:0/2750500369 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8540c8a30 0x7fb85406b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.551+0000 7fb8599fa640 1 --2- 172.21.15.55:0/2750500369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854158770 0x7fb85406b2f0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.551+0000 7fb8599fa640 1 -- 172.21.15.55:0/2750500369 >> 172.21.15.55:0/2750500369 conn(0x7fb8540cdf40 msgr2=0x7fb8540ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:48.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.551+0000 7fb8599fa640 1 -- 172.21.15.55:0/2750500369 shutdown_connections 2023-07-06T21:58:48.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.551+0000 7fb8599fa640 1 -- 172.21.15.55:0/2750500369 wait complete. 2023-07-06T21:58:48.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8599fa640 1 Processor -- start 2023-07-06T21:58:48.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8599fa640 1 -- start start 2023-07-06T21:58:48.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8599fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8540c8a30 0x7fb85414f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8599fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8540cbb10 0x7fb8540b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8599fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854158770 0x7fb8540b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8599fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85414fde0 con 0x7fb854158770 2023-07-06T21:58:48.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8599fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8540c5ac0 con 0x7fb8540cbb10 2023-07-06T21:58:48.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8599fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8540c5da0 con 0x7fb8540c8a30 2023-07-06T21:58:48.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8537fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854158770 0x7fb8540b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8537fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854158770 0x7fb8540b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50264/0 (socket says 172.21.15.55:50264) 2023-07-06T21:58:48.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8537fe640 1 -- 172.21.15.55:0/1503400051 learned_addr learned my addr 172.21.15.55:0/1503400051 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:48.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb852ffd640 1 --2- 172.21.15.55:0/1503400051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8540c8a30 0x7fb85414f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8527fc640 1 --2- 172.21.15.55:0/1503400051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8540cbb10 0x7fb8540b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8537fe640 1 -- 172.21.15.55:0/1503400051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8540c8a30 msgr2=0x7fb85414f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8537fe640 1 --2- 172.21.15.55:0/1503400051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8540c8a30 0x7fb85414f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8537fe640 1 -- 172.21.15.55:0/1503400051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8540cbb10 msgr2=0x7fb8540b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8537fe640 1 --2- 172.21.15.55:0/1503400051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8540cbb10 0x7fb8540b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8537fe640 1 -- 172.21.15.55:0/1503400051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb844009420 con 0x7fb854158770 2023-07-06T21:58:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8537fe640 1 --2- 172.21.15.55:0/1503400051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854158770 0x7fb8540b1610 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00cb40 tx=0x7fb84c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb83bfff640 1 -- 172.21.15.55:0/1503400051 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00aca0 con 0x7fb854158770 2023-07-06T21:58:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb83bfff640 1 -- 172.21.15.55:0/1503400051 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c00ae00 con 0x7fb854158770 2023-07-06T21:58:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8599fa640 1 -- 172.21.15.55:0/1503400051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8540c6080 con 0x7fb854158770 2023-07-06T21:58:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb83bfff640 1 -- 172.21.15.55:0/1503400051 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c012620 con 0x7fb854158770 2023-07-06T21:58:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8599fa640 1 -- 172.21.15.55:0/1503400051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8540c6640 con 0x7fb854158770 2023-07-06T21:58:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.555+0000 7fb8599fa640 1 -- 172.21.15.55:0/1503400051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8540c6830 con 0x7fb854158770 2023-07-06T21:58:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.559+0000 7fb83bfff640 1 -- 172.21.15.55:0/1503400051 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb84c007070 con 0x7fb854158770 2023-07-06T21:58:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.559+0000 7fb83bfff640 1 --2- 172.21.15.55:0/1503400051 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8400663a0 0x7fb840068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.559+0000 7fb83bfff640 1 -- 172.21.15.55:0/1503400051 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb84c083ff0 con 0x7fb854158770 2023-07-06T21:58:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.559+0000 7fb852ffd640 1 --2- 172.21.15.55:0/1503400051 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8400663a0 0x7fb840068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.559+0000 7fb852ffd640 1 --2- 172.21.15.55:0/1503400051 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8400663a0 0x7fb840068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb8440ad000 tx=0x7fb844008040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:48.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.563+0000 7fb83bfff640 1 -- 172.21.15.55:0/1503400051 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb84c0b4700 con 0x7fb854158770 2023-07-06T21:58:48.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.771+0000 7fb8599fa640 1 -- 172.21.15.55:0/1503400051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb854066d60 con 0x7fb854158770 2023-07-06T21:58:48.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.779+0000 7fb83bfff640 1 -- 172.21.15.55:0/1503400051 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb84c017020 con 0x7fb854158770 2023-07-06T21:58:48.777 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-07-06T21:58:48.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.779+0000 7fb8599fa640 1 -- 172.21.15.55:0/1503400051 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8400663a0 msgr2=0x7fb840068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.779+0000 7fb8599fa640 1 --2- 172.21.15.55:0/1503400051 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8400663a0 0x7fb840068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb8440ad000 tx=0x7fb844008040 comp rx=0 tx=0).stop 2023-07-06T21:58:48.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.779+0000 7fb8599fa640 1 -- 172.21.15.55:0/1503400051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854158770 msgr2=0x7fb8540b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.779+0000 7fb8599fa640 1 --2- 172.21.15.55:0/1503400051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854158770 0x7fb8540b1610 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00cb40 tx=0x7fb84c00a060 comp rx=0 tx=0).stop 2023-07-06T21:58:48.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.779+0000 7fb8599fa640 1 -- 172.21.15.55:0/1503400051 shutdown_connections 2023-07-06T21:58:48.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.779+0000 7fb8599fa640 1 --2- 172.21.15.55:0/1503400051 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb8400663a0 0x7fb840068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.779+0000 7fb8599fa640 1 --2- 172.21.15.55:0/1503400051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854158770 0x7fb8540b1610 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.779+0000 7fb8599fa640 1 --2- 172.21.15.55:0/1503400051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8540cbb10 0x7fb8540b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.779+0000 7fb8599fa640 1 --2- 172.21.15.55:0/1503400051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8540c8a30 0x7fb85414f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.779+0000 7fb8599fa640 1 -- 172.21.15.55:0/1503400051 >> 172.21.15.55:0/1503400051 conn(0x7fb8540cdf40 msgr2=0x7fb8540ada00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:48.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.779+0000 7fb8599fa640 1 -- 172.21.15.55:0/1503400051 shutdown_connections 2023-07-06T21:58:48.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.779+0000 7fb8599fa640 1 -- 172.21.15.55:0/1503400051 wait complete. 2023-07-06T21:58:48.798 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T21:58:48.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.943+0000 7fe49f1c5640 1 Processor -- start 2023-07-06T21:58:48.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.943+0000 7fe49f1c5640 1 -- start start 2023-07-06T21:58:48.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.943+0000 7fe49f1c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe49815ca30 0x7fe49806c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.943+0000 7fe49f1c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe49806c920 0x7fe498158c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.943+0000 7fe49f1c5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe498070fd0 con 0x7fe49806af90 2023-07-06T21:58:48.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.943+0000 7fe49f1c5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe498070bb0 con 0x7fe49815ca30 2023-07-06T21:58:48.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.943+0000 7fe49f1c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4980c9e00 con 0x7fe49806c920 2023-07-06T21:58:48.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.943+0000 7fe497fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe49815ca30 0x7fe49806c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.943+0000 7fe49cf61640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe49806af90 0x7fe4980c9620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44514/0 (socket says 172.21.15.55:44514) 2023-07-06T21:58:48.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.943+0000 7fe49cf61640 1 -- 172.21.15.55:0/338892186 learned_addr learned my addr 172.21.15.55:0/338892186 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:48.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.947+0000 7fe49d762640 1 --2- 172.21.15.55:0/338892186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe49806c920 0x7fe498158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.947+0000 7fe497fff640 1 -- 172.21.15.55:0/338892186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe49806c920 msgr2=0x7fe498158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:48.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.947+0000 7fe497fff640 1 --2- 172.21.15.55:0/338892186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe49806c920 0x7fe498158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.947+0000 7fe497fff640 1 -- 172.21.15.55:0/338892186 >> v1:172.21.15.55:6789/0 conn(0x7fe49806af90 legacy=0x7fe4980c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.947+0000 7fe4977fe640 1 -- 172.21.15.55:0/338892186 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490355345 0 0) 0x7fe498070fd0 con 0x7fe49806af90 2023-07-06T21:58:48.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.947+0000 7fe497fff640 1 -- 172.21.15.55:0/338892186 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49815ceb0 con 0x7fe49815ca30 2023-07-06T21:58:48.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.947+0000 7fe497fff640 1 --2- 172.21.15.55:0/338892186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe49815ca30 0x7fe49806c3e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fe4840097c0 tx=0x7fe48401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12cb276d63e6c315 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:48.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.947+0000 7fe4977fe640 1 -- 172.21.15.55:0/338892186 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840ab600 con 0x7fe49815ca30 2023-07-06T21:58:48.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.947+0000 7fe4977fe640 1 -- 172.21.15.55:0/338892186 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4840a7050 con 0x7fe49815ca30 2023-07-06T21:58:48.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.947+0000 7fe4977fe640 1 -- 172.21.15.55:0/338892186 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840ab980 con 0x7fe49815ca30 2023-07-06T21:58:48.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.947+0000 7fe49f1c5640 1 -- 172.21.15.55:0/338892186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe49815ca30 msgr2=0x7fe49806c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.947+0000 7fe49f1c5640 1 --2- 172.21.15.55:0/338892186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe49815ca30 0x7fe49806c3e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fe4840097c0 tx=0x7fe48401c3f0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49f1c5640 1 -- 172.21.15.55:0/338892186 shutdown_connections 2023-07-06T21:58:48.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49f1c5640 1 --2- 172.21.15.55:0/338892186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe49806c920 0x7fe498158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49f1c5640 1 --2- 172.21.15.55:0/338892186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe49815ca30 0x7fe49806c3e0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49f1c5640 1 -- 172.21.15.55:0/338892186 >> 172.21.15.55:0/338892186 conn(0x7fe4980cfc60 msgr2=0x7fe4980cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:48.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49f1c5640 1 -- 172.21.15.55:0/338892186 shutdown_connections 2023-07-06T21:58:48.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49f1c5640 1 -- 172.21.15.55:0/338892186 wait complete. 2023-07-06T21:58:48.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49f1c5640 1 Processor -- start 2023-07-06T21:58:48.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49f1c5640 1 -- start start 2023-07-06T21:58:48.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49f1c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe49806af90 0x7fe498146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49f1c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe49806c920 0x7fe4980c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49f1c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe49815ca30 0x7fe49815e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49f1c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49814ec30 con 0x7fe49815ca30 2023-07-06T21:58:48.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49f1c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49814ef10 con 0x7fe49806af90 2023-07-06T21:58:48.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49f1c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49814f1f0 con 0x7fe49806c920 2023-07-06T21:58:48.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49d762640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe49815ca30 0x7fe49815e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49d762640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe49815ca30 0x7fe49815e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50290/0 (socket says 172.21.15.55:50290) 2023-07-06T21:58:48.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49d762640 1 -- 172.21.15.55:0/3513935682 learned_addr learned my addr 172.21.15.55:0/3513935682 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:48.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe497fff640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe49806c920 0x7fe4980c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49d762640 1 -- 172.21.15.55:0/3513935682 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe49806c920 msgr2=0x7fe4980c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49d762640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe49806c920 0x7fe4980c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49cf61640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe49806af90 0x7fe498146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49d762640 1 -- 172.21.15.55:0/3513935682 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe49806af90 msgr2=0x7fe498146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:48.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49d762640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe49806af90 0x7fe498146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:48.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49d762640 1 -- 172.21.15.55:0/3513935682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484009420 con 0x7fe49815ca30 2023-07-06T21:58:48.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.951+0000 7fe49cf61640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe49806af90 0x7fe498146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:48.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.955+0000 7fe49d762640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe49815ca30 0x7fe49815e1d0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fe490007e40 tx=0x7fe49000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:48.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.955+0000 7fe4957fa640 1 -- 172.21.15.55:0/3513935682 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe490014620 con 0x7fe49815ca30 2023-07-06T21:58:48.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.955+0000 7fe4957fa640 1 -- 172.21.15.55:0/3513935682 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49000ee90 con 0x7fe49815ca30 2023-07-06T21:58:48.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.955+0000 7fe49f1c5640 1 -- 172.21.15.55:0/3513935682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49814f4d0 con 0x7fe49815ca30 2023-07-06T21:58:48.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.955+0000 7fe4957fa640 1 -- 172.21.15.55:0/3513935682 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4900149e0 con 0x7fe49815ca30 2023-07-06T21:58:48.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.955+0000 7fe49f1c5640 1 -- 172.21.15.55:0/3513935682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe498146bc0 con 0x7fe49815ca30 2023-07-06T21:58:48.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.955+0000 7fe49f1c5640 1 -- 172.21.15.55:0/3513935682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4980b1a60 con 0x7fe49815ca30 2023-07-06T21:58:48.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.955+0000 7fe4957fa640 1 -- 172.21.15.55:0/3513935682 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe490014b40 con 0x7fe49815ca30 2023-07-06T21:58:48.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.955+0000 7fe4957fa640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fe47c0663a0 0x7fe47c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:48.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.955+0000 7fe4957fa640 1 -- 172.21.15.55:0/3513935682 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe490084980 con 0x7fe49815ca30 2023-07-06T21:58:48.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.955+0000 7fe49cf61640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fe47c0663a0 0x7fe47c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:48.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.959+0000 7fe49cf61640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fe47c0663a0 0x7fe47c068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe48c000f70 tx=0x7fe48c009040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:48.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:48.959+0000 7fe4957fa640 1 -- 172.21.15.55:0/3513935682 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe490051ba0 con 0x7fe49815ca30 2023-07-06T21:58:49.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.147+0000 7fe49f1c5640 1 -- 172.21.15.55:0/3513935682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe49814ed70 con 0x7fe49815ca30 2023-07-06T21:58:49.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.147+0000 7fe4957fa640 1 -- 172.21.15.55:0/3513935682 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4673 (secure 0 0 0) 0x7fe49814ed70 con 0x7fe49815ca30 2023-07-06T21:58:49.146 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:49.147 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4122510097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4122510097},{"type":"v1","addr":"172.21.15.138:6835","nonce":4122510097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/154452928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":154452928},{"type":"v1","addr":"172.21.15.55:6836","nonce":154452928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8037,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/414200688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":414200688},{"type":"v1","addr":"172.21.15.55:6837","nonce":414200688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:58:39.245889+0000","modified":"2023-07-06T21:58:42.261872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8049},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8049":{"gid":8049,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6833/1552399486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1552399486},{"type":"v1","addr":"172.21.15.138:6833","nonce":1552399486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-06T21:58:49.147 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 47 2023-07-06T21:58:49.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.147+0000 7fe49f1c5640 1 -- 172.21.15.55:0/3513935682 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fe47c0663a0 msgr2=0x7fe47c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.147+0000 7fe49f1c5640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fe47c0663a0 0x7fe47c068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe48c000f70 tx=0x7fe48c009040 comp rx=0 tx=0).stop 2023-07-06T21:58:49.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.147+0000 7fe49f1c5640 1 -- 172.21.15.55:0/3513935682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe49815ca30 msgr2=0x7fe49815e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.147+0000 7fe49f1c5640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe49815ca30 0x7fe49815e1d0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fe490007e40 tx=0x7fe49000e4b0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.151+0000 7fe49f1c5640 1 -- 172.21.15.55:0/3513935682 shutdown_connections 2023-07-06T21:58:49.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.151+0000 7fe49f1c5640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fe47c0663a0 0x7fe47c068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.151+0000 7fe49f1c5640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe49815ca30 0x7fe49815e1d0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.151+0000 7fe49f1c5640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe49806c920 0x7fe4980c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.151+0000 7fe49f1c5640 1 --2- 172.21.15.55:0/3513935682 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe49806af90 0x7fe498146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.151+0000 7fe49f1c5640 1 -- 172.21.15.55:0/3513935682 >> 172.21.15.55:0/3513935682 conn(0x7fe4980cfc60 msgr2=0x7fe498158720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:49.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.151+0000 7fe49f1c5640 1 -- 172.21.15.55:0/3513935682 shutdown_connections 2023-07-06T21:58:49.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.151+0000 7fe49f1c5640 1 -- 172.21.15.55:0/3513935682 wait complete. 2023-07-06T21:58:49.569 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T21:58:39.245889+0000', 'modified': '2023-07-06T21:58:42.261872+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8049}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8049': {'gid': 8049, 'name': 'b', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.138:6833/1552399486', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6832', 'nonce': 1552399486}, {'type': 'v1', 'addr': '172.21.15.138:6833', 'nonce': 1552399486}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T21:58:49.570 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T21:58:49.570 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-06T21:58:49.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10e2a34640 1 Processor -- start 2023-07-06T21:58:49.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10e2a34640 1 -- start start 2023-07-06T21:58:49.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10e2a34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10dc158850 0x7f10dc0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10e2a34640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f10dc0ca130 0x7f10dc0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10e2a34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc0b2aa0 con 0x7f10dc0703e0 2023-07-06T21:58:49.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10e2a34640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc158c20 con 0x7f10dc0ca130 2023-07-06T21:58:49.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10e2a34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0c8db0 con 0x7f10dc158850 2023-07-06T21:58:49.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10e0fd1640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f10dc0703e0 0x7f10dc06eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44524/0 (socket says 172.21.15.55:44524) 2023-07-06T21:58:49.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10e0fd1640 1 -- 172.21.15.55:0/3871705365 learned_addr learned my addr 172.21.15.55:0/3871705365 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:49.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10dbfff640 1 --2- 172.21.15.55:0/3871705365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10dc158850 0x7f10dc0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10d3fff640 1 --2- 172.21.15.55:0/3871705365 >> v2:172.21.15.138:3300/0 conn(0x7f10dc0ca130 0x7f10dc0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10db7fe640 1 -- 172.21.15.55:0/3871705365 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153448265 0 0) 0x7f10dc0b2aa0 con 0x7f10dc0703e0 2023-07-06T21:58:49.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10db7fe640 1 -- 172.21.15.55:0/3871705365 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c8003530 con 0x7f10dc0703e0 2023-07-06T21:58:49.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10dbfff640 1 -- 172.21.15.55:0/3871705365 >> v2:172.21.15.138:3300/0 conn(0x7f10dc0ca130 msgr2=0x7f10dc0ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:49.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10dbfff640 1 --2- 172.21.15.55:0/3871705365 >> v2:172.21.15.138:3300/0 conn(0x7f10dc0ca130 0x7f10dc0ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10dbfff640 1 -- 172.21.15.55:0/3871705365 >> v1:172.21.15.55:6789/0 conn(0x7f10dc0703e0 legacy=0x7f10dc06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10dbfff640 1 -- 172.21.15.55:0/3871705365 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc0c9090 con 0x7f10dc158850 2023-07-06T21:58:49.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.719+0000 7f10d3fff640 1 --2- 172.21.15.55:0/3871705365 >> v2:172.21.15.138:3300/0 conn(0x7f10dc0ca130 0x7f10dc0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:49.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.723+0000 7f10dbfff640 1 --2- 172.21.15.55:0/3871705365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10dc158850 0x7f10dc0cca30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0097c0 tx=0x7f10cc01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55c224b7a2e9e21b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:49.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.723+0000 7f10db7fe640 1 -- 172.21.15.55:0/3871705365 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0a8970 con 0x7f10dc158850 2023-07-06T21:58:49.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.723+0000 7f10db7fe640 1 -- 172.21.15.55:0/3871705365 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc0a8ad0 con 0x7f10dc158850 2023-07-06T21:58:49.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.723+0000 7f10db7fe640 1 -- 172.21.15.55:0/3871705365 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0a8e60 con 0x7f10dc158850 2023-07-06T21:58:49.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.723+0000 7f10e2a34640 1 -- 172.21.15.55:0/3871705365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10dc158850 msgr2=0x7f10dc0cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.723+0000 7f10e2a34640 1 --2- 172.21.15.55:0/3871705365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10dc158850 0x7f10dc0cca30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0097c0 tx=0x7f10cc01ec70 comp rx=0 tx=0).stop 2023-07-06T21:58:49.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.723+0000 7f10e2a34640 1 -- 172.21.15.55:0/3871705365 shutdown_connections 2023-07-06T21:58:49.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.723+0000 7f10e2a34640 1 --2- 172.21.15.55:0/3871705365 >> v2:172.21.15.138:3300/0 conn(0x7f10dc0ca130 0x7f10dc0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.723+0000 7f10e2a34640 1 --2- 172.21.15.55:0/3871705365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10dc158850 0x7f10dc0cca30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.723+0000 7f10e2a34640 1 -- 172.21.15.55:0/3871705365 >> 172.21.15.55:0/3871705365 conn(0x7f10dc0cea70 msgr2=0x7f10dc0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:49.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.723+0000 7f10e2a34640 1 -- 172.21.15.55:0/3871705365 shutdown_connections 2023-07-06T21:58:49.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.723+0000 7f10e2a34640 1 -- 172.21.15.55:0/3871705365 wait complete. 2023-07-06T21:58:49.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10e2a34640 1 Processor -- start 2023-07-06T21:58:49.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10e2a34640 1 -- start start 2023-07-06T21:58:49.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10e2a34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10dc0703e0 0x7f10dc0aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10e2a34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10dc0ca130 0x7f10dc0c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10e2a34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10dc158850 0x7f10dc0af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10e2a34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0c5d30 con 0x7f10dc0703e0 2023-07-06T21:58:49.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10e2a34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0aaf10 con 0x7f10dc158850 2023-07-06T21:58:49.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10e2a34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0ab1f0 con 0x7f10dc0ca130 2023-07-06T21:58:49.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10dc0703e0 0x7f10dc0aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10dc0703e0 0x7f10dc0aa930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50302/0 (socket says 172.21.15.55:50302) 2023-07-06T21:58:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10dbfff640 1 -- 172.21.15.55:0/3073014513 learned_addr learned my addr 172.21.15.55:0/3073014513 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10d3fff640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10dc0ca130 0x7f10dc0c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10e0fd1640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10dc158850 0x7f10dc0af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10dbfff640 1 -- 172.21.15.55:0/3073014513 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10dc0ca130 msgr2=0x7f10dc0c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10dbfff640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10dc0ca130 0x7f10dc0c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10dbfff640 1 -- 172.21.15.55:0/3073014513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10dc158850 msgr2=0x7f10dc0af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10dbfff640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10dc158850 0x7f10dc0af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10dbfff640 1 -- 172.21.15.55:0/3073014513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c4009420 con 0x7f10dc0703e0 2023-07-06T21:58:49.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10d3fff640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10dc0ca130 0x7f10dc0c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:49.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10e0fd1640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10dc158850 0x7f10dc0af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:49.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10dbfff640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10dc0703e0 0x7f10dc0aa930 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f10cc01d320 tx=0x7f10cc01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:49.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10d97fa640 1 -- 172.21.15.55:0/3073014513 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0b0d60 con 0x7f10dc0703e0 2023-07-06T21:58:49.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10d97fa640 1 -- 172.21.15.55:0/3073014513 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc0bb440 con 0x7f10dc0703e0 2023-07-06T21:58:49.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10d97fa640 1 -- 172.21.15.55:0/3073014513 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0bb7f0 con 0x7f10dc0703e0 2023-07-06T21:58:49.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10e2a34640 1 -- 172.21.15.55:0/3073014513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc009420 con 0x7f10dc0703e0 2023-07-06T21:58:49.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.727+0000 7f10e2a34640 1 -- 172.21.15.55:0/3073014513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc0ab7b0 con 0x7f10dc0703e0 2023-07-06T21:58:49.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.731+0000 7f10d97fa640 1 -- 172.21.15.55:0/3073014513 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f10cc0b7040 con 0x7f10dc0703e0 2023-07-06T21:58:49.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.731+0000 7f10d97fa640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f10bc0663a0 0x7f10bc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.731+0000 7f10d97fa640 1 -- 172.21.15.55:0/3073014513 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f10cc121ea0 con 0x7f10dc0703e0 2023-07-06T21:58:49.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.731+0000 7f10d3fff640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f10bc0663a0 0x7f10bc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.731+0000 7f10e5d79000 1 Processor -- start 2023-07-06T21:58:49.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.731+0000 7f10e5d79000 1 -- start start 2023-07-06T21:58:49.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.731+0000 7f10d3fff640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f10bc0663a0 0x7f10bc068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0c84c0 tx=0x7f10c4008040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:49.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc55d40 0x559e7cc56110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc56650 0x559e7cc0bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 0x559e7cc0c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e7cacfac0 con 0x559e7cc56650 2023-07-06T21:58:49.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e7ca09840 con 0x559e7cc55d40 2023-07-06T21:58:49.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e7ca5d2e0 con 0x559e7cc0c190 2023-07-06T21:58:49.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10d3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc56650 0x559e7cc0bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10d3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc56650 0x559e7cc0bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50314/0 (socket says 172.21.15.55:50314) 2023-07-06T21:58:49.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10d3fff640 1 -- 172.21.15.55:0/36204081 learned_addr learned my addr 172.21.15.55:0/36204081 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:49.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e0fd1640 1 --2- 172.21.15.55:0/36204081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 0x559e7cc0c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10dbfff640 1 --2- 172.21.15.55:0/36204081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc55d40 0x559e7cc56110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10d3fff640 1 -- 172.21.15.55:0/36204081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 msgr2=0x559e7cc0c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:49.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10d3fff640 1 --2- 172.21.15.55:0/36204081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 0x559e7cc0c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10d3fff640 1 -- 172.21.15.55:0/36204081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc55d40 msgr2=0x559e7cc56110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:49.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10d3fff640 1 --2- 172.21.15.55:0/36204081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc55d40 0x559e7cc56110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10d3fff640 1 -- 172.21.15.55:0/36204081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e7c752890 con 0x559e7cc56650 2023-07-06T21:58:49.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10d3fff640 1 --2- 172.21.15.55:0/36204081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc56650 0x559e7cc0bc50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f10c40097c0 tx=0x7f10c4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9474949911bfa30c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:49.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10d1ffb640 1 -- 172.21.15.55:0/36204081 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4021440 con 0x559e7cc56650 2023-07-06T21:58:49.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10d1ffb640 1 -- 172.21.15.55:0/36204081 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c40215a0 con 0x559e7cc56650 2023-07-06T21:58:49.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10d1ffb640 1 -- 172.21.15.55:0/36204081 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4021910 con 0x559e7cc56650 2023-07-06T21:58:49.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 -- 172.21.15.55:0/36204081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc56650 msgr2=0x559e7cc0bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 --2- 172.21.15.55:0/36204081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc56650 0x559e7cc0bc50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f10c40097c0 tx=0x7f10c4014000 comp rx=0 tx=0).stop 2023-07-06T21:58:49.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 -- 172.21.15.55:0/36204081 shutdown_connections 2023-07-06T21:58:49.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 --2- 172.21.15.55:0/36204081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 0x559e7cc0c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 --2- 172.21.15.55:0/36204081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc56650 0x559e7cc0bc50 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 --2- 172.21.15.55:0/36204081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc55d40 0x559e7cc56110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 -- 172.21.15.55:0/36204081 >> 172.21.15.55:0/36204081 conn(0x559e7cbff800 msgr2=0x559e7cc0e800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:49.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 -- 172.21.15.55:0/36204081 shutdown_connections 2023-07-06T21:58:49.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 -- 172.21.15.55:0/36204081 wait complete. 2023-07-06T21:58:49.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 -- start start 2023-07-06T21:58:49.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.735+0000 7f10e5d79000 1 Processor -- start 2023-07-06T21:58:49.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc0c190 0x559e7cc43ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc55d40 0x559e7cc43ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc56650 0x559e7cc44530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e7ca56380 con 0x559e7cc0c190 2023-07-06T21:58:49.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e7ca12ae0 con 0x559e7cc56650 2023-07-06T21:58:49.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e7ca12780 con 0x559e7cc55d40 2023-07-06T21:58:49.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 10 client.0 _ll_register_callbacks cb 0x559e7cbf3e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T21:58:49.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc0c190 0x559e7cc43ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc0c190 0x559e7cc43ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50326/0 (socket says 172.21.15.55:50326) 2023-07-06T21:58:49.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10dbfff640 1 -- 172.21.15.55:0/1048685379 learned_addr learned my addr 172.21.15.55:0/1048685379 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:49.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10d3fff640 1 --2- 172.21.15.55:0/1048685379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc55d40 0x559e7cc43ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e0fd1640 1 --2- 172.21.15.55:0/1048685379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc56650 0x559e7cc44530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10dbfff640 1 -- 172.21.15.55:0/1048685379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc55d40 msgr2=0x559e7cc43ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:49.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10dbfff640 1 --2- 172.21.15.55:0/1048685379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc55d40 0x559e7cc43ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10dbfff640 1 -- 172.21.15.55:0/1048685379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc56650 msgr2=0x559e7cc44530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:49.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10dbfff640 1 --2- 172.21.15.55:0/1048685379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc56650 0x559e7cc44530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10dbfff640 1 -- 172.21.15.55:0/1048685379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c4011d40 con 0x559e7cc0c190 2023-07-06T21:58:49.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10dbfff640 1 --2- 172.21.15.55:0/1048685379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc0c190 0x559e7cc43ab0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0097c0 tx=0x7f10cc0f6e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e134a71c8abf9ce1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10baffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T21:58:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10baffd640 1 -- 172.21.15.55:0/1048685379 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0f2500 con 0x559e7cc0c190 2023-07-06T21:58:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10baffd640 1 -- 172.21.15.55:0/1048685379 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f10cc0facd0 con 0x559e7cc0c190 2023-07-06T21:58:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 1 -- 172.21.15.55:0/1048685379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e7ca1da20 con 0x559e7cc0c190 2023-07-06T21:58:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10baffd640 1 -- 172.21.15.55:0/1048685379 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10cc0faeb0 con 0x559e7cc0c190 2023-07-06T21:58:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 10 client.8223 fetch_fsmap learned FSMap version 47 2023-07-06T21:58:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 1 -- 172.21.15.55:0/1048685379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x559e7ca1ad10 con 0x559e7cc0c190 2023-07-06T21:58:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10baffd640 1 -- 172.21.15.55:0/1048685379 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e7ca1da20 con 0x559e7cc0c190 2023-07-06T21:58:49.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10baffd640 1 -- 172.21.15.55:0/1048685379 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 47) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f10cc0eec00 con 0x559e7cc0c190 2023-07-06T21:58:49.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 10 client.8223 fetch_fsmap finished waiting for FSMap version 47 2023-07-06T21:58:49.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 10 client.8223 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-06T21:58:49.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 20 client.8223 populate_metadata read hostname 'smithi055' 2023-07-06T21:58:49.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 1 --2- 172.21.15.55:0/1048685379 >> [v2:172.21.15.138:6832/1552399486,v1:172.21.15.138:6833/1552399486] conn(0x559e7cc44e00 0x559e7cc67290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 4 client.8223 mds_command: new command op to 8049 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T21:58:49.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10e5d79000 1 -- 172.21.15.55:0/1048685379 --> [v2:172.21.15.138:6832/1552399486,v1:172.21.15.138:6833/1552399486] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e7ca85710 con 0x559e7cc44e00 2023-07-06T21:58:49.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10d3fff640 1 --2- 172.21.15.55:0/1048685379 >> [v2:172.21.15.138:6832/1552399486,v1:172.21.15.138:6833/1552399486] conn(0x559e7cc44e00 0x559e7cc67290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10d3fff640 1 --2- 172.21.15.55:0/1048685379 >> [v2:172.21.15.138:6832/1552399486,v1:172.21.15.138:6833/1552399486] conn(0x559e7cc44e00 0x559e7cc67290 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bcdd2fa1c75ec8e server_cookie=d525156696af0e40 in_seq=0 out_seq=0 2023-07-06T21:58:49.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.739+0000 7f10baffd640 10 client.8223 ms_handle_connect on v2:172.21.15.138:6832/1552399486 2023-07-06T21:58:49.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10baffd640 1 -- 172.21.15.55:0/1048685379 <== mds.0 v2:172.21.15.138:6832/1552399486 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559e7ca85710 con 0x559e7cc44e00 2023-07-06T21:58:49.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10baffd640 10 client.8223 handle_command_reply: tid=0 2023-07-06T21:58:49.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10e5d79000 1 client.8223 shutdown 2023-07-06T21:58:49.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10e5d79000 1 -- 172.21.15.55:0/1048685379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc0c190 msgr2=0x559e7cc43ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10e5d79000 1 --2- 172.21.15.55:0/1048685379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc0c190 0x559e7cc43ab0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0097c0 tx=0x7f10cc0f6e90 comp rx=0 tx=0).stop 2023-07-06T21:58:49.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10e5d79000 1 -- 172.21.15.55:0/1048685379 shutdown_connections 2023-07-06T21:58:49.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10e5d79000 1 --2- 172.21.15.55:0/1048685379 >> [v2:172.21.15.138:6832/1552399486,v1:172.21.15.138:6833/1552399486] conn(0x559e7cc44e00 0x559e7cc67290 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10e5d79000 1 --2- 172.21.15.55:0/1048685379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc56650 0x559e7cc44530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10e5d79000 1 --2- 172.21.15.55:0/1048685379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc55d40 0x559e7cc43ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10e5d79000 1 --2- 172.21.15.55:0/1048685379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc0c190 0x559e7cc43ab0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10baffd640 0 client.8223 ms_handle_reset on v2:172.21.15.138:6832/1552399486 2023-07-06T21:58:49.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10e5d79000 1 -- 172.21.15.55:0/1048685379 >> 172.21.15.55:0/1048685379 conn(0x559e7cbff800 msgr2=0x559e7cc0d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:49.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10e5d79000 1 -- 172.21.15.55:0/1048685379 shutdown_connections 2023-07-06T21:58:49.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10e5d79000 1 -- 172.21.15.55:0/1048685379 wait complete. 2023-07-06T21:58:49.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.743+0000 7f10e5d79000 20 client.8223 trim_cache size 0 max 16384 2023-07-06T21:58:49.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 Processor -- start 2023-07-06T21:58:49.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 -- start start 2023-07-06T21:58:49.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 0x559e7cc066b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc55d40 0x559e7cc06bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc56650 0x559e7cc65280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e7c713940 con 0x559e7cc55d40 2023-07-06T21:58:49.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e7ca55210 con 0x559e7cc56650 2023-07-06T21:58:49.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e7ca24e10 con 0x559e7cc0c190 2023-07-06T21:58:49.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10d3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc55d40 0x559e7cc06bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10d3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc55d40 0x559e7cc06bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50332/0 (socket says 172.21.15.55:50332) 2023-07-06T21:58:49.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10d3fff640 1 -- 172.21.15.55:0/315430140 learned_addr learned my addr 172.21.15.55:0/315430140 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:49.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10dbfff640 1 --2- 172.21.15.55:0/315430140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 0x559e7cc066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e0fd1640 1 --2- 172.21.15.55:0/315430140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc56650 0x559e7cc65280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10d3fff640 1 -- 172.21.15.55:0/315430140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 msgr2=0x559e7cc066b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:49.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10d3fff640 1 --2- 172.21.15.55:0/315430140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 0x559e7cc066b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10d3fff640 1 -- 172.21.15.55:0/315430140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc56650 msgr2=0x559e7cc65280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:49.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10d3fff640 1 --2- 172.21.15.55:0/315430140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc56650 0x559e7cc65280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10d3fff640 1 -- 172.21.15.55:0/315430140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e7ca00fa0 con 0x559e7cc55d40 2023-07-06T21:58:49.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10d3fff640 1 --2- 172.21.15.55:0/315430140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc55d40 0x559e7cc06bf0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f10c4008010 tx=0x7f10c4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f74397d5105a1c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:49.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10d27fc640 1 -- 172.21.15.55:0/315430140 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4030040 con 0x559e7cc55d40 2023-07-06T21:58:49.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10d27fc640 1 -- 172.21.15.55:0/315430140 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4032040 con 0x559e7cc55d40 2023-07-06T21:58:49.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10d27fc640 1 -- 172.21.15.55:0/315430140 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4009e60 con 0x559e7cc55d40 2023-07-06T21:58:49.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 -- 172.21.15.55:0/315430140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc55d40 msgr2=0x559e7cc06bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 --2- 172.21.15.55:0/315430140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc55d40 0x559e7cc06bf0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f10c4008010 tx=0x7f10c4016000 comp rx=0 tx=0).stop 2023-07-06T21:58:49.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 -- 172.21.15.55:0/315430140 shutdown_connections 2023-07-06T21:58:49.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 --2- 172.21.15.55:0/315430140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc56650 0x559e7cc65280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 --2- 172.21.15.55:0/315430140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc55d40 0x559e7cc06bf0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 --2- 172.21.15.55:0/315430140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 0x559e7cc066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 -- 172.21.15.55:0/315430140 >> 172.21.15.55:0/315430140 conn(0x559e7cbff800 msgr2=0x559e7cc05fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:49.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 -- 172.21.15.55:0/315430140 shutdown_connections 2023-07-06T21:58:49.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 -- 172.21.15.55:0/315430140 wait complete. 2023-07-06T21:58:49.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 -- start start 2023-07-06T21:58:49.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.759+0000 7f10e5d79000 1 Processor -- start 2023-07-06T21:58:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 0x559e7cc68120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc55d40 0x559e7cc706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc56650 0x559e7cc70c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e7ca53780 con 0x559e7cc56650 2023-07-06T21:58:49.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e7c9fe450 con 0x559e7cc55d40 2023-07-06T21:58:49.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e7c9f3a80 con 0x559e7cc0c190 2023-07-06T21:58:49.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 10 client.0 _ll_register_callbacks cb 0x559e7ca1a7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T21:58:49.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e0fd1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc56650 0x559e7cc70c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e0fd1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc56650 0x559e7cc70c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50338/0 (socket says 172.21.15.55:50338) 2023-07-06T21:58:49.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e0fd1640 1 -- 172.21.15.55:0/2117955598 learned_addr learned my addr 172.21.15.55:0/2117955598 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:49.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10dbfff640 1 --2- 172.21.15.55:0/2117955598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 0x559e7cc68120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10d3fff640 1 --2- 172.21.15.55:0/2117955598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc55d40 0x559e7cc706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e0fd1640 1 -- 172.21.15.55:0/2117955598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 msgr2=0x559e7cc68120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:49.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e0fd1640 1 --2- 172.21.15.55:0/2117955598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 0x559e7cc68120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e0fd1640 1 -- 172.21.15.55:0/2117955598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc55d40 msgr2=0x559e7cc706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:49.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e0fd1640 1 --2- 172.21.15.55:0/2117955598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc55d40 0x559e7cc706f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e0fd1640 1 -- 172.21.15.55:0/2117955598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e7c752890 con 0x559e7cc56650 2023-07-06T21:58:49.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10d3fff640 1 --2- 172.21.15.55:0/2117955598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc55d40 0x559e7cc706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T21:58:49.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e0fd1640 1 --2- 172.21.15.55:0/2117955598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc56650 0x559e7cc70c30 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f10d4017bb0 tx=0x7f10d4015780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9caa86c00c419fbe server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:49.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10baffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T21:58:49.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10baffd640 1 -- 172.21.15.55:0/2117955598 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4007320 con 0x559e7cc56650 2023-07-06T21:58:49.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10baffd640 1 -- 172.21.15.55:0/2117955598 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f10d4007480 con 0x559e7cc56650 2023-07-06T21:58:49.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 1 -- 172.21.15.55:0/2117955598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e7cc14940 con 0x559e7cc56650 2023-07-06T21:58:49.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10baffd640 1 -- 172.21.15.55:0/2117955598 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10d4007640 con 0x559e7cc56650 2023-07-06T21:58:49.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 10 client.8229 fetch_fsmap learned FSMap version 47 2023-07-06T21:58:49.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 1 -- 172.21.15.55:0/2117955598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x559e7c752cc0 con 0x559e7cc56650 2023-07-06T21:58:49.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10baffd640 1 -- 172.21.15.55:0/2117955598 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e7cc14940 con 0x559e7cc56650 2023-07-06T21:58:49.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10baffd640 1 -- 172.21.15.55:0/2117955598 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 47) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f10d40077a0 con 0x559e7cc56650 2023-07-06T21:58:49.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 10 client.8229 fetch_fsmap finished waiting for FSMap version 47 2023-07-06T21:58:49.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 10 client.8229 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-06T21:58:49.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 20 client.8229 populate_metadata read hostname 'smithi055' 2023-07-06T21:58:49.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 1 --2- 172.21.15.55:0/2117955598 >> [v2:172.21.15.138:6832/1552399486,v1:172.21.15.138:6833/1552399486] conn(0x559e7cc71170 0x559e7ccbbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 4 client.8229 mds_command: new command op to 8049 tid=0[{"prefix": "status"}] 2023-07-06T21:58:49.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10e5d79000 1 -- 172.21.15.55:0/2117955598 --> [v2:172.21.15.138:6832/1552399486,v1:172.21.15.138:6833/1552399486] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559e7ca54cd0 con 0x559e7cc71170 2023-07-06T21:58:49.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10dbfff640 1 --2- 172.21.15.55:0/2117955598 >> [v2:172.21.15.138:6832/1552399486,v1:172.21.15.138:6833/1552399486] conn(0x559e7cc71170 0x559e7ccbbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10dbfff640 1 --2- 172.21.15.55:0/2117955598 >> [v2:172.21.15.138:6832/1552399486,v1:172.21.15.138:6833/1552399486] conn(0x559e7cc71170 0x559e7ccbbb60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fc955b0d70d0c7b server_cookie=17b98d084ece77f2 in_seq=0 out_seq=0 2023-07-06T21:58:49.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10baffd640 10 client.8229 ms_handle_connect on v2:172.21.15.138:6832/1552399486 2023-07-06T21:58:49.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.763+0000 7f10baffd640 1 -- 172.21.15.55:0/2117955598 <== mds.0 v2:172.21.15.138:6832/1552399486 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x559e7ca54cd0 con 0x559e7cc71170 2023-07-06T21:58:49.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10baffd640 10 client.8229 handle_command_reply: tid=0 2023-07-06T21:58:49.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e5d79000 1 client.8229 shutdown 2023-07-06T21:58:49.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e5d79000 1 -- 172.21.15.55:0/2117955598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc56650 msgr2=0x559e7cc70c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e5d79000 1 --2- 172.21.15.55:0/2117955598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc56650 0x559e7cc70c30 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f10d4017bb0 tx=0x7f10d4015780 comp rx=0 tx=0).stop 2023-07-06T21:58:49.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e5d79000 1 -- 172.21.15.55:0/2117955598 shutdown_connections 2023-07-06T21:58:49.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e5d79000 1 --2- 172.21.15.55:0/2117955598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559e7cc56650 0x559e7cc70c30 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e5d79000 1 --2- 172.21.15.55:0/2117955598 >> [v2:172.21.15.138:6832/1552399486,v1:172.21.15.138:6833/1552399486] conn(0x559e7cc71170 0x559e7ccbbb60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e5d79000 1 --2- 172.21.15.55:0/2117955598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559e7cc55d40 0x559e7cc706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e5d79000 1 --2- 172.21.15.55:0/2117955598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559e7cc0c190 0x559e7cc68120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e5d79000 1 -- 172.21.15.55:0/2117955598 >> 172.21.15.55:0/2117955598 conn(0x559e7cbff800 msgr2=0x559e7cc068c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:49.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10baffd640 0 client.8229 ms_handle_reset on v2:172.21.15.138:6832/1552399486 2023-07-06T21:58:49.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e5d79000 1 -- 172.21.15.55:0/2117955598 shutdown_connections 2023-07-06T21:58:49.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e5d79000 1 -- 172.21.15.55:0/2117955598 wait complete. 2023-07-06T21:58:49.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e5d79000 20 client.8229 trim_cache size 0 max 16384 2023-07-06T21:58:49.773 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T21:58:49.773 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c64f3ef1-e769-47b3-ae15-a714e4e7c4f7", 2023-07-06T21:58:49.773 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-07-06T21:58:49.773 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 8049, 2023-07-06T21:58:49.773 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-07-06T21:58:49.773 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-07-06T21:58:49.773 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-07-06T21:58:49.774 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.51952191, 2023-07-06T21:58:49.774 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 47, 2023-07-06T21:58:49.774 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 117, 2023-07-06T21:58:49.774 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 117, 2023-07-06T21:58:49.774 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 15.828064317999999 2023-07-06T21:58:49.774 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T21:58:49.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e2a34640 1 -- 172.21.15.55:0/3073014513 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f10bc0663a0 msgr2=0x7f10bc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e2a34640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f10bc0663a0 0x7f10bc068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0c84c0 tx=0x7f10c4008040 comp rx=0 tx=0).stop 2023-07-06T21:58:49.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e2a34640 1 -- 172.21.15.55:0/3073014513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10dc0703e0 msgr2=0x7f10dc0aa930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e2a34640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10dc0703e0 0x7f10dc0aa930 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f10cc01d320 tx=0x7f10cc01ba10 comp rx=0 tx=0).stop 2023-07-06T21:58:49.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e2a34640 1 -- 172.21.15.55:0/3073014513 shutdown_connections 2023-07-06T21:58:49.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e2a34640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f10bc0663a0 0x7f10bc068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e2a34640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10dc158850 0x7f10dc0af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e2a34640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10dc0ca130 0x7f10dc0c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e2a34640 1 --2- 172.21.15.55:0/3073014513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10dc0703e0 0x7f10dc0aa930 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e2a34640 1 -- 172.21.15.55:0/3073014513 >> 172.21.15.55:0/3073014513 conn(0x7f10dc0cea70 msgr2=0x7f10dc0cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:49.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e2a34640 1 -- 172.21.15.55:0/3073014513 shutdown_connections 2023-07-06T21:58:49.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.767+0000 7f10e2a34640 1 -- 172.21.15.55:0/3073014513 wait complete. 2023-07-06T21:58:49.785 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T21:58:49.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.927+0000 7fcfd3311640 1 Processor -- start 2023-07-06T21:58:49.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.927+0000 7fcfd3311640 1 -- start start 2023-07-06T21:58:49.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.931+0000 7fcfd3311640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcfcc0712f0 0x7fcfcc06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.931+0000 7fcfd3311640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcfcc0b3730 0x7fcfcc0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.931+0000 7fcfd3311640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfcc0ca6a0 con 0x7fcfcc0ca280 2023-07-06T21:58:49.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.931+0000 7fcfd3311640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfcc159cd0 con 0x7fcfcc0712f0 2023-07-06T21:58:49.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.931+0000 7fcfd3311640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfcc0693f0 con 0x7fcfcc0b3730 2023-07-06T21:58:49.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.931+0000 7fcfd18ae640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcfcc0ca280 0x7fcfcc0c8520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44526/0 (socket says 172.21.15.55:44526) 2023-07-06T21:58:49.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.931+0000 7fcfd18ae640 1 -- 172.21.15.55:0/2939419366 learned_addr learned my addr 172.21.15.55:0/2939419366 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:49.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.931+0000 7fcfd10ad640 1 --2- 172.21.15.55:0/2939419366 >> v2:172.21.15.55:3300/0 conn(0x7fcfcc0712f0 0x7fcfcc06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.931+0000 7fcfd08ac640 1 --2- 172.21.15.55:0/2939419366 >> v2:172.21.15.138:3300/0 conn(0x7fcfcc0b3730 0x7fcfcc0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.931+0000 7fcfd10ad640 1 -- 172.21.15.55:0/2939419366 >> v2:172.21.15.138:3300/0 conn(0x7fcfcc0b3730 msgr2=0x7fcfcc0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:49.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.931+0000 7fcfd10ad640 1 --2- 172.21.15.55:0/2939419366 >> v2:172.21.15.138:3300/0 conn(0x7fcfcc0b3730 0x7fcfcc0c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.931+0000 7fcfd10ad640 1 -- 172.21.15.55:0/2939419366 >> v1:172.21.15.55:6789/0 conn(0x7fcfcc0ca280 legacy=0x7fcfcc0c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.931+0000 7fcfd10ad640 1 -- 172.21.15.55:0/2939419366 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc06aca0 con 0x7fcfcc0712f0 2023-07-06T21:58:49.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.935+0000 7fcfd10ad640 1 --2- 172.21.15.55:0/2939419366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfcc0712f0 0x7fcfcc06a610 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc071a70 tx=0x7fcfc801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2f1e760e3adee server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:49.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.935+0000 7fcfc3fff640 1 -- 172.21.15.55:0/2939419366 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80ab600 con 0x7fcfcc0712f0 2023-07-06T21:58:49.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.935+0000 7fcfc3fff640 1 -- 172.21.15.55:0/2939419366 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc80a7050 con 0x7fcfcc0712f0 2023-07-06T21:58:49.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.935+0000 7fcfc3fff640 1 -- 172.21.15.55:0/2939419366 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80ab980 con 0x7fcfcc0712f0 2023-07-06T21:58:49.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.935+0000 7fcfd3311640 1 -- 172.21.15.55:0/2939419366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfcc0712f0 msgr2=0x7fcfcc06a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.935+0000 7fcfd3311640 1 --2- 172.21.15.55:0/2939419366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfcc0712f0 0x7fcfcc06a610 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc071a70 tx=0x7fcfc801c430 comp rx=0 tx=0).stop 2023-07-06T21:58:49.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.935+0000 7fcfd3311640 1 -- 172.21.15.55:0/2939419366 shutdown_connections 2023-07-06T21:58:49.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.935+0000 7fcfd3311640 1 --2- 172.21.15.55:0/2939419366 >> v2:172.21.15.138:3300/0 conn(0x7fcfcc0b3730 0x7fcfcc0c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.935+0000 7fcfd3311640 1 --2- 172.21.15.55:0/2939419366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfcc0712f0 0x7fcfcc06a610 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.935+0000 7fcfd3311640 1 -- 172.21.15.55:0/2939419366 >> 172.21.15.55:0/2939419366 conn(0x7fcfcc0cded0 msgr2=0x7fcfcc0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:49.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.935+0000 7fcfd3311640 1 -- 172.21.15.55:0/2939419366 shutdown_connections 2023-07-06T21:58:49.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.935+0000 7fcfd3311640 1 -- 172.21.15.55:0/2939419366 wait complete. 2023-07-06T21:58:49.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.935+0000 7fcfd3311640 1 Processor -- start 2023-07-06T21:58:49.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.935+0000 7fcfd3311640 1 -- start start 2023-07-06T21:58:49.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd3311640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfcc0712f0 0x7fcfcc147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd3311640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc0b3730 0x7fcfcc0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd3311640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfcc0ca280 0x7fcfcc0aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd3311640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc157d60 con 0x7fcfcc0712f0 2023-07-06T21:58:49.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd3311640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc157120 con 0x7fcfcc0ca280 2023-07-06T21:58:49.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd3311640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc1573c0 con 0x7fcfcc0b3730 2023-07-06T21:58:49.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd10ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfcc0712f0 0x7fcfcc147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd10ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfcc0712f0 0x7fcfcc147a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50358/0 (socket says 172.21.15.55:50358) 2023-07-06T21:58:49.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd10ad640 1 -- 172.21.15.55:0/489929872 learned_addr learned my addr 172.21.15.55:0/489929872 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:49.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd08ac640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc0b3730 0x7fcfcc0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd18ae640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfcc0ca280 0x7fcfcc0aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd10ad640 1 -- 172.21.15.55:0/489929872 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc0b3730 msgr2=0x7fcfcc0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd10ad640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc0b3730 0x7fcfcc0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd10ad640 1 -- 172.21.15.55:0/489929872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfcc0ca280 msgr2=0x7fcfcc0aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:49.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd10ad640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfcc0ca280 0x7fcfcc0aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:49.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd10ad640 1 -- 172.21.15.55:0/489929872 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc8009420 con 0x7fcfcc0712f0 2023-07-06T21:58:49.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd18ae640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfcc0ca280 0x7fcfcc0aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:49.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd10ad640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfcc0712f0 0x7fcfcc147a10 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80ae040 tx=0x7fcfc80191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:49.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfc1ffb640 1 -- 172.21.15.55:0/489929872 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80b4840 con 0x7fcfcc0712f0 2023-07-06T21:58:49.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfc1ffb640 1 -- 172.21.15.55:0/489929872 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc80b49c0 con 0x7fcfcc0712f0 2023-07-06T21:58:49.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfc1ffb640 1 -- 172.21.15.55:0/489929872 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80b4d70 con 0x7fcfcc0712f0 2023-07-06T21:58:49.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd3311640 1 -- 172.21.15.55:0/489929872 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc1576a0 con 0x7fcfcc0712f0 2023-07-06T21:58:49.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd3311640 1 -- 172.21.15.55:0/489929872 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfcc147f50 con 0x7fcfcc0712f0 2023-07-06T21:58:49.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfd3311640 1 -- 172.21.15.55:0/489929872 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfcc158080 con 0x7fcfcc0712f0 2023-07-06T21:58:49.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.939+0000 7fcfc1ffb640 1 -- 172.21.15.55:0/489929872 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcfc80b2040 con 0x7fcfcc0712f0 2023-07-06T21:58:49.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.943+0000 7fcfc1ffb640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fcfb00663a0 0x7fcfb0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:49.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.943+0000 7fcfc1ffb640 1 -- 172.21.15.55:0/489929872 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcfc811e3a0 con 0x7fcfcc0712f0 2023-07-06T21:58:49.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.943+0000 7fcfd08ac640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fcfb00663a0 0x7fcfb0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:49.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.943+0000 7fcfd08ac640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fcfb00663a0 0x7fcfb0068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0c5e20 tx=0x7fcfbc008040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:49.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:49.947+0000 7fcfc1ffb640 1 -- 172.21.15.55:0/489929872 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcfc80eb5c0 con 0x7fcfcc0712f0 2023-07-06T21:58:50.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.135+0000 7fcfd3311640 1 -- 172.21.15.55:0/489929872 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcfcc1480e0 con 0x7fcfcc0712f0 2023-07-06T21:58:50.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.135+0000 7fcfc1ffb640 1 -- 172.21.15.55:0/489929872 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcfc80eebe0 con 0x7fcfcc0712f0 2023-07-06T21:58:50.135 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T21:58:50.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.139+0000 7fcfd3311640 1 -- 172.21.15.55:0/489929872 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fcfb00663a0 msgr2=0x7fcfb0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:50.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.139+0000 7fcfd3311640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fcfb00663a0 0x7fcfb0068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0c5e20 tx=0x7fcfbc008040 comp rx=0 tx=0).stop 2023-07-06T21:58:50.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.139+0000 7fcfd3311640 1 -- 172.21.15.55:0/489929872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfcc0712f0 msgr2=0x7fcfcc147a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:50.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.139+0000 7fcfd3311640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfcc0712f0 0x7fcfcc147a10 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80ae040 tx=0x7fcfc80191d0 comp rx=0 tx=0).stop 2023-07-06T21:58:50.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.139+0000 7fcfd3311640 1 -- 172.21.15.55:0/489929872 shutdown_connections 2023-07-06T21:58:50.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.139+0000 7fcfd3311640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fcfb00663a0 0x7fcfb0068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:50.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.139+0000 7fcfd3311640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfcc0ca280 0x7fcfcc0aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:50.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.139+0000 7fcfd3311640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc0b3730 0x7fcfcc0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:50.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.139+0000 7fcfd3311640 1 --2- 172.21.15.55:0/489929872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfcc0712f0 0x7fcfcc147a10 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:50.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.139+0000 7fcfd3311640 1 -- 172.21.15.55:0/489929872 >> 172.21.15.55:0/489929872 conn(0x7fcfcc0cded0 msgr2=0x7fcfcc0708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:50.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.139+0000 7fcfd3311640 1 -- 172.21.15.55:0/489929872 shutdown_connections 2023-07-06T21:58:50.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.139+0000 7fcfd3311640 1 -- 172.21.15.55:0/489929872 wait complete. 2023-07-06T21:58:50.157 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T21:58:50.158 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T21:58:50.158 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-07-06T21:58:50.158 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T21:58:50.159 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T21:58:50.159 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T21:58:50.159 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-06T21:58:50.159 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T21:58:50.160 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:58:50.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:50.160 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-07-06T21:58:50.171 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T21:58:50.171 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T21:58:50.171 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T21:58:50.171 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:50.171 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T21:58:50.171 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:50.172 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:58:50.172 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:58:50.172 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-07-06T21:58:50.172 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:58:50.172 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:58:50.172 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-07-06T21:58:50.172 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T21:58:50.172 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:58:50.173 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-07-06T21:58:50.173 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-06T21:58:50.173 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41426sec preferred_lft 41426sec 2023-07-06T21:58:50.173 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-07-06T21:58:50.173 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:50.173 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T21:58:50.173 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:58:50.174 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-07-06T21:58:50.174 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T21:58:50.174 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:84:fe:b8:21 brd ff:ff:ff:ff:ff:ff 2023-07-06T21:58:50.174 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T21:58:50.174 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:50.174 INFO:teuthology.orchestra.run.smithi055.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T21:58:50.174 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-06T21:58:50.174 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T21:58:50.175 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:50.175 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-06T21:58:50.175 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:50.175 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T21:58:50.175 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T21:58:50.175 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-06T21:58:50.175 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:50.175 INFO:teuthology.orchestra.run.smithi055.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T21:58:50.176 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T21:58:50.176 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-06T21:58:50.176 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T21:58:50.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:50.177 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T21:58:50.235 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-07-06T21:58:50.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:50.237 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-07-06T21:58:50.289 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-07-06T21:58:50.289 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T21:58:50.289 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-06T21:58:50.290 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T21:58:50.290 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-06T21:58:50.290 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T21:58:50.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:50.291 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T21:58:50.291 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T21:58:50.291 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T21:58:50.291 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T21:58:50.292 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T21:58:50.292 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T21:58:50.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:50.386 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T21:58:50.395 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T21:58:50.395 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T21:58:50.396 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:58:50.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:50.397 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-07-06T21:58:50.461 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:58:50.461 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T21:58:50.512 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T21:58:50.512 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T21:58:50.512 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T21:58:50.563 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-06T21:58:50.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:50.564 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:58:50.655 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:58:50.655 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:58:50.669 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T21:58:50.669 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T21:58:50.670 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-07-06T21:58:50.670 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.cephfs=/ 2023-07-06T21:58:50.670 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-07-06T21:58:50.674 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T21:58:50.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:50.674 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T21:58:50.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T21:58:50.697 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T21:58:50.761 INFO:teuthology.orchestra.run.smithi055.stdout:client6977 2023-07-06T21:58:50.761 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:58:50.761 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:58:50.812 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-06T21:58:50.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.999+0000 7f1d104cb640 1 Processor -- start 2023-07-06T21:58:50.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.999+0000 7f1d104cb640 1 -- start start 2023-07-06T21:58:51.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.999+0000 7f1d104cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d080ca130 0x7f1d080703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:51.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.999+0000 7f1d104cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d080c8db0 con 0x7f1d080cd140 2023-07-06T21:58:51.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.999+0000 7f1d104cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d080c9090 con 0x7f1d08158850 2023-07-06T21:58:51.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:50.999+0000 7f1d104cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d08158ce0 con 0x7f1d080ca130 2023-07-06T21:58:51.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.003+0000 7f1d0da66640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d080ca130 0x7f1d080703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:51.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.003+0000 7f1d0ea68640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1d080cd140 0x7f1d080b1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44534/0 (socket says 172.21.15.55:44534) 2023-07-06T21:58:51.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.003+0000 7f1d0e267640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f1d08158850 0x7f1d080cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:38608/0 (socket says 172.21.15.55:38608) 2023-07-06T21:58:51.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.003+0000 7f1d0ea68640 1 -- 172.21.15.55:0/2803117568 learned_addr learned my addr 172.21.15.55:0/2803117568 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:51.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.003+0000 7f1d0da66640 1 -- 172.21.15.55:0/2803117568 >> v1:172.21.15.138:6789/0 conn(0x7f1d08158850 legacy=0x7f1d080cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:51.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.003+0000 7f1d0da66640 1 -- 172.21.15.55:0/2803117568 >> v1:172.21.15.55:6789/0 conn(0x7f1d080cd140 legacy=0x7f1d080b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:51.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.003+0000 7f1d0da66640 1 -- 172.21.15.55:0/2803117568 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d080c9370 con 0x7f1d080ca130 2023-07-06T21:58:51.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.003+0000 7f1d0da66640 1 --2- 172.21.15.55:0/2803117568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d080ca130 0x7f1d080703e0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80097c0 tx=0x7f1cf801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7d58bc0ca499a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:51.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.003+0000 7f1d0d265640 1 -- 172.21.15.55:0/2803117568 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80ab650 con 0x7f1d080ca130 2023-07-06T21:58:51.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.003+0000 7f1d0d265640 1 -- 172.21.15.55:0/2803117568 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf80ab7b0 con 0x7f1d080ca130 2023-07-06T21:58:51.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.003+0000 7f1d0d265640 1 -- 172.21.15.55:0/2803117568 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80abb40 con 0x7f1d080ca130 2023-07-06T21:58:51.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 -- 172.21.15.55:0/2803117568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d080ca130 msgr2=0x7f1d080703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:51.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 --2- 172.21.15.55:0/2803117568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d080ca130 0x7f1d080703e0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80097c0 tx=0x7f1cf801c450 comp rx=0 tx=0).stop 2023-07-06T21:58:51.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 -- 172.21.15.55:0/2803117568 shutdown_connections 2023-07-06T21:58:51.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 --2- 172.21.15.55:0/2803117568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d080ca130 0x7f1d080703e0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 -- 172.21.15.55:0/2803117568 >> 172.21.15.55:0/2803117568 conn(0x7f1d080cea70 msgr2=0x7f1d080ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:51.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 -- 172.21.15.55:0/2803117568 shutdown_connections 2023-07-06T21:58:51.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 -- 172.21.15.55:0/2803117568 wait complete. 2023-07-06T21:58:51.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 Processor -- start 2023-07-06T21:58:51.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 -- start start 2023-07-06T21:58:51.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d080ca130 0x7f1d080c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:51.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d080cd140 0x7f1d080ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:51.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d08158850 0x7f1d080c2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:51.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080c7970 con 0x7f1d080ca130 2023-07-06T21:58:51.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080c84c0 con 0x7f1d080cd140 2023-07-06T21:58:51.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d104cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0814e600 con 0x7f1d08158850 2023-07-06T21:58:51.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d0e267640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d080ca130 0x7f1d080c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:51.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d0e267640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d080ca130 0x7f1d080c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50374/0 (socket says 172.21.15.55:50374) 2023-07-06T21:58:51.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d0e267640 1 -- 172.21.15.55:0/1161194782 learned_addr learned my addr 172.21.15.55:0/1161194782 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:51.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d0da66640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d080cd140 0x7f1d080ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:51.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d0ea68640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d08158850 0x7f1d080c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:51.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d0e267640 1 -- 172.21.15.55:0/1161194782 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d08158850 msgr2=0x7f1d080c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:51.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d0e267640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d08158850 0x7f1d080c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d0e267640 1 -- 172.21.15.55:0/1161194782 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d080cd140 msgr2=0x7f1d080ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:51.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d0e267640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d080cd140 0x7f1d080ad9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d0e267640 1 -- 172.21.15.55:0/1161194782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf8009420 con 0x7f1d080ca130 2023-07-06T21:58:51.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.007+0000 7f1d0ea68640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d08158850 0x7f1d080c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:51.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.011+0000 7f1d0e267640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d080ca130 0x7f1d080c7e70 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400c430 tx=0x7f1d0400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:51.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.011+0000 7f1cfeffd640 1 -- 172.21.15.55:0/1161194782 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d040074e0 con 0x7f1d080ca130 2023-07-06T21:58:51.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.011+0000 7f1cfeffd640 1 -- 172.21.15.55:0/1161194782 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d04007640 con 0x7f1d080ca130 2023-07-06T21:58:51.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.011+0000 7f1cfeffd640 1 -- 172.21.15.55:0/1161194782 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04004a10 con 0x7f1d080ca130 2023-07-06T21:58:51.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.011+0000 7f1d104cb640 1 -- 172.21.15.55:0/1161194782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0814e8e0 con 0x7f1d080ca130 2023-07-06T21:58:51.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.011+0000 7f1d104cb640 1 -- 172.21.15.55:0/1161194782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0814eea0 con 0x7f1d080ca130 2023-07-06T21:58:51.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.011+0000 7f1d104cb640 1 -- 172.21.15.55:0/1161194782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d08066d60 con 0x7f1d080ca130 2023-07-06T21:58:51.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.011+0000 7f1cfeffd640 1 -- 172.21.15.55:0/1161194782 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1d04004b70 con 0x7f1d080ca130 2023-07-06T21:58:51.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.011+0000 7f1cfeffd640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f1cec0663a0 0x7f1cec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:51.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.011+0000 7f1cfeffd640 1 -- 172.21.15.55:0/1161194782 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1d04083aa0 con 0x7f1d080ca130 2023-07-06T21:58:51.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.011+0000 7f1d0da66640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f1cec0663a0 0x7f1cec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:51.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.015+0000 7f1d0da66640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f1cec0663a0 0x7f1cec068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80af000 tx=0x7f1cf80a7000 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.015+0000 7f1cfeffd640 1 -- 172.21.15.55:0/1161194782 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d04050c30 con 0x7f1d080ca130 2023-07-06T21:58:51.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.191+0000 7f1d104cb640 1 -- 172.21.15.55:0/1161194782 --> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d08070d30 con 0x7f1cec0663a0 2023-07-06T21:58:51.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.195+0000 7f1cfeffd640 1 -- 172.21.15.55:0/1161194782 <== mgr.7782 v2:172.21.15.55:6832/1408736549 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f1cf80aba20 con 0x7f1cec0663a0 2023-07-06T21:58:51.193 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T21:58:51.193 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T21:58:51.194 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-07-06T21:58:51.194 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T21:58:51.194 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T21:58:51.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.195+0000 7f1d104cb640 1 -- 172.21.15.55:0/1161194782 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f1cec0663a0 msgr2=0x7f1cec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:51.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.195+0000 7f1d104cb640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f1cec0663a0 0x7f1cec068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80af000 tx=0x7f1cf80a7000 comp rx=0 tx=0).stop 2023-07-06T21:58:51.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.195+0000 7f1d104cb640 1 -- 172.21.15.55:0/1161194782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d080ca130 msgr2=0x7f1d080c7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:51.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.195+0000 7f1d104cb640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d080ca130 0x7f1d080c7e70 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400c430 tx=0x7f1d0400c8f0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.195+0000 7f1d104cb640 1 -- 172.21.15.55:0/1161194782 shutdown_connections 2023-07-06T21:58:51.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.195+0000 7f1d104cb640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f1cec0663a0 0x7f1cec068850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.195+0000 7f1d104cb640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d08158850 0x7f1d080c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.195+0000 7f1d104cb640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d080cd140 0x7f1d080ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.195+0000 7f1d104cb640 1 --2- 172.21.15.55:0/1161194782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d080ca130 0x7f1d080c7e70 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.195+0000 7f1d104cb640 1 -- 172.21.15.55:0/1161194782 >> 172.21.15.55:0/1161194782 conn(0x7f1d080cea70 msgr2=0x7f1d08153e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:51.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.195+0000 7f1d104cb640 1 -- 172.21.15.55:0/1161194782 shutdown_connections 2023-07-06T21:58:51.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.195+0000 7f1d104cb640 1 -- 172.21.15.55:0/1161194782 wait complete. 2023-07-06T21:58:51.214 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-06T21:58:51.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.359+0000 7f041c27b640 1 Processor -- start 2023-07-06T21:58:51.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.359+0000 7f041c27b640 1 -- start start 2023-07-06T21:58:51.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f041c27b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0414158850 0x7f04140cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:51.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f041c27b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04140ca130 0x7f04140ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:51.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f041c27b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04140703e0 0x7f0414070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:51.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f041c27b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0414070dc0 con 0x7f04140ca130 2023-07-06T21:58:51.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f041c27b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0414158c20 con 0x7f0414158850 2023-07-06T21:58:51.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f041c27b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04140c8db0 con 0x7f04140703e0 2023-07-06T21:58:51.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f0419816640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04140ca130 0x7f04140ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:51.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f0419816640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04140ca130 0x7f04140ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50388/0 (socket says 172.21.15.55:50388) 2023-07-06T21:58:51.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f0419816640 1 -- 172.21.15.55:0/2467704585 learned_addr learned my addr 172.21.15.55:0/2467704585 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:51.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f041a818640 1 --2- 172.21.15.55:0/2467704585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04140703e0 0x7f0414070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:51.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f041a017640 1 --2- 172.21.15.55:0/2467704585 >> v2:172.21.15.138:3300/0 conn(0x7f0414158850 0x7f04140cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:51.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f0419816640 1 -- 172.21.15.55:0/2467704585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04140703e0 msgr2=0x7f0414070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:51.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f0419816640 1 --2- 172.21.15.55:0/2467704585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04140703e0 0x7f0414070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f0419816640 1 -- 172.21.15.55:0/2467704585 >> v2:172.21.15.138:3300/0 conn(0x7f0414158850 msgr2=0x7f04140cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:51.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f0419816640 1 --2- 172.21.15.55:0/2467704585 >> v2:172.21.15.138:3300/0 conn(0x7f0414158850 0x7f04140cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f0419816640 1 -- 172.21.15.55:0/2467704585 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04140c9090 con 0x7f04140ca130 2023-07-06T21:58:51.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f0419816640 1 --2- 172.21.15.55:0/2467704585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04140ca130 0x7f04140ccf70 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f041406eaf0 tx=0x7f040401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6149cdc0e3da9bc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:51.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.363+0000 7f0419015640 1 -- 172.21.15.55:0/2467704585 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04040a89b0 con 0x7f04140ca130 2023-07-06T21:58:51.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f0419015640 1 -- 172.21.15.55:0/2467704585 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04040a8b10 con 0x7f04140ca130 2023-07-06T21:58:51.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f0419015640 1 -- 172.21.15.55:0/2467704585 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04040a8ea0 con 0x7f04140ca130 2023-07-06T21:58:51.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 -- 172.21.15.55:0/2467704585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04140ca130 msgr2=0x7f04140ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:51.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 --2- 172.21.15.55:0/2467704585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04140ca130 0x7f04140ccf70 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f041406eaf0 tx=0x7f040401ecf0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 -- 172.21.15.55:0/2467704585 shutdown_connections 2023-07-06T21:58:51.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 --2- 172.21.15.55:0/2467704585 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04140703e0 0x7f0414070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 --2- 172.21.15.55:0/2467704585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04140ca130 0x7f04140ccf70 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 --2- 172.21.15.55:0/2467704585 >> v2:172.21.15.138:3300/0 conn(0x7f0414158850 0x7f04140cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 -- 172.21.15.55:0/2467704585 >> 172.21.15.55:0/2467704585 conn(0x7f04140cea70 msgr2=0x7f04140ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:51.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 -- 172.21.15.55:0/2467704585 shutdown_connections 2023-07-06T21:58:51.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 -- 172.21.15.55:0/2467704585 wait complete. 2023-07-06T21:58:51.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 Processor -- start 2023-07-06T21:58:51.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 -- start start 2023-07-06T21:58:51.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04140703e0 0x7f04140c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:51.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04140ca130 0x7f04141578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:51.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0414158850 0x7f0414157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:51.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0414158340 con 0x7f04140703e0 2023-07-06T21:58:51.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04141566d0 con 0x7f04140ca130 2023-07-06T21:58:51.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041c27b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04140c5e90 con 0x7f0414158850 2023-07-06T21:58:51.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041a017640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04140703e0 0x7f04140c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:51.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041a017640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04140703e0 0x7f04140c5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50396/0 (socket says 172.21.15.55:50396) 2023-07-06T21:58:51.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041a017640 1 -- 172.21.15.55:0/3167608263 learned_addr learned my addr 172.21.15.55:0/3167608263 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:51.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f041a818640 1 --2- 172.21.15.55:0/3167608263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0414158850 0x7f0414157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:51.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.367+0000 7f0419816640 1 --2- 172.21.15.55:0/3167608263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04140ca130 0x7f04141578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:51.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f041a017640 1 -- 172.21.15.55:0/3167608263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0414158850 msgr2=0x7f0414157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:51.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f041a017640 1 --2- 172.21.15.55:0/3167608263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0414158850 0x7f0414157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f041a017640 1 -- 172.21.15.55:0/3167608263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04140ca130 msgr2=0x7f04141578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:51.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f041a017640 1 --2- 172.21.15.55:0/3167608263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04140ca130 0x7f04141578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f041a017640 1 -- 172.21.15.55:0/3167608263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04040094d0 con 0x7f04140703e0 2023-07-06T21:58:51.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f041a017640 1 --2- 172.21.15.55:0/3167608263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04140703e0 0x7f04140c5950 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f041000e870 tx=0x7f041000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:51.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f040affd640 1 -- 172.21.15.55:0/3167608263 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410009510 con 0x7f04140703e0 2023-07-06T21:58:51.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f040affd640 1 -- 172.21.15.55:0/3167608263 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041000eec0 con 0x7f04140703e0 2023-07-06T21:58:51.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f040affd640 1 -- 172.21.15.55:0/3167608263 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041000cb40 con 0x7f04140703e0 2023-07-06T21:58:51.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f041c27b640 1 -- 172.21.15.55:0/3167608263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04140c6170 con 0x7f04140703e0 2023-07-06T21:58:51.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f041c27b640 1 -- 172.21.15.55:0/3167608263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04141e3960 con 0x7f04140703e0 2023-07-06T21:58:51.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f041c27b640 1 -- 172.21.15.55:0/3167608263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0414066d60 con 0x7f04140703e0 2023-07-06T21:58:51.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f040affd640 1 -- 172.21.15.55:0/3167608263 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f041000cca0 con 0x7f04140703e0 2023-07-06T21:58:51.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f040affd640 1 --2- 172.21.15.55:0/3167608263 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f03f80663a0 0x7f03f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:51.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.371+0000 7f040affd640 1 -- 172.21.15.55:0/3167608263 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0410084080 con 0x7f04140703e0 2023-07-06T21:58:51.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.375+0000 7f0419816640 1 --2- 172.21.15.55:0/3167608263 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f03f80663a0 0x7f03f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:51.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.375+0000 7f0419816640 1 --2- 172.21.15.55:0/3167608263 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f03f80663a0 0x7f03f8068850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04040b2000 tx=0x7f0404009040 comp rx=0 tx=0).ready entity=mgr.7782 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:51.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.375+0000 7f040affd640 1 -- 172.21.15.55:0/3167608263 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04100b4700 con 0x7f04140703e0 2023-07-06T21:58:51.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.567+0000 7f041c27b640 1 -- 172.21.15.55:0/3167608263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f04140c4290 con 0x7f04140703e0 2023-07-06T21:58:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.855+0000 7f040affd640 1 -- 172.21.15.55:0/3167608263 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 48) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f0410051690 con 0x7f04140703e0 2023-07-06T21:58:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.859+0000 7f040affd640 1 -- 172.21.15.55:0/3167608263 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v48) v1 ==== 92+0+0 (secure 0 0 0) 0x7f041006d460 con 0x7f04140703e0 2023-07-06T21:58:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.859+0000 7f041c27b640 1 -- 172.21.15.55:0/3167608263 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f03f80663a0 msgr2=0x7f03f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.859+0000 7f041c27b640 1 --2- 172.21.15.55:0/3167608263 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f03f80663a0 0x7f03f8068850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04040b2000 tx=0x7f0404009040 comp rx=0 tx=0).stop 2023-07-06T21:58:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.859+0000 7f041c27b640 1 -- 172.21.15.55:0/3167608263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04140703e0 msgr2=0x7f04140c5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.859+0000 7f041c27b640 1 --2- 172.21.15.55:0/3167608263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04140703e0 0x7f04140c5950 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f041000e870 tx=0x7f041000ec70 comp rx=0 tx=0).stop 2023-07-06T21:58:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.859+0000 7f041c27b640 1 -- 172.21.15.55:0/3167608263 shutdown_connections 2023-07-06T21:58:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.859+0000 7f041c27b640 1 --2- 172.21.15.55:0/3167608263 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f03f80663a0 0x7f03f8068850 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.859+0000 7f041c27b640 1 --2- 172.21.15.55:0/3167608263 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0414158850 0x7f0414157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.859+0000 7f041c27b640 1 --2- 172.21.15.55:0/3167608263 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04140ca130 0x7f04141578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.859+0000 7f041c27b640 1 --2- 172.21.15.55:0/3167608263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04140703e0 0x7f04140c5950 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.859+0000 7f041c27b640 1 -- 172.21.15.55:0/3167608263 >> 172.21.15.55:0/3167608263 conn(0x7f04140cea70 msgr2=0x7f04141545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.859+0000 7f041c27b640 1 -- 172.21.15.55:0/3167608263 shutdown_connections 2023-07-06T21:58:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:51.859+0000 7f041c27b640 1 -- 172.21.15.55:0/3167608263 wait complete. 2023-07-06T21:58:51.880 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-06T21:58:52.024 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:52.025+0000 7fc09bc38180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:58:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.031+0000 7f8630941640 1 Processor -- start 2023-07-06T21:58:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.031+0000 7f8630941640 1 -- start start 2023-07-06T21:58:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.031+0000 7f8630941640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f862c0d0630 0x7f862c15fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.031+0000 7f8630941640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f862c0cc740 con 0x7f862c0ce200 2023-07-06T21:58:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.035+0000 7f8630941640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f862c0ccc90 con 0x7f862c0b1250 2023-07-06T21:58:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.035+0000 7f8630941640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862c0b29c0 con 0x7f862c0d0630 2023-07-06T21:58:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.035+0000 7f862bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f862c0ce200 0x7f862c0ce640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44564/0 (socket says 172.21.15.55:44564) 2023-07-06T21:58:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.035+0000 7f862bfff640 1 -- 172.21.15.55:0/4223780326 learned_addr learned my addr 172.21.15.55:0/4223780326 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:52.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.035+0000 7f862affd640 1 --2- 172.21.15.55:0/4223780326 >> v2:172.21.15.138:3300/0 conn(0x7f862c0d0630 0x7f862c15fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:52.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.035+0000 7f862a7fc640 1 -- 172.21.15.55:0/4223780326 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35723961 0 0) 0x7f862c0cc740 con 0x7f862c0ce200 2023-07-06T21:58:52.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.035+0000 7f862a7fc640 1 -- 172.21.15.55:0/4223780326 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8614003530 con 0x7f862c0ce200 2023-07-06T21:58:52.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.035+0000 7f862affd640 1 -- 172.21.15.55:0/4223780326 >> v1:172.21.15.138:6789/0 conn(0x7f862c0b1250 legacy=0x7f862c15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:52.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.035+0000 7f862a7fc640 1 -- 172.21.15.55:0/4223780326 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137826251 0 0) 0x7f862c0ccc90 con 0x7f862c0b1250 2023-07-06T21:58:52.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.035+0000 7f862affd640 1 -- 172.21.15.55:0/4223780326 >> v1:172.21.15.55:6789/0 conn(0x7f862c0ce200 legacy=0x7f862c0ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:52.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.035+0000 7f862affd640 1 -- 172.21.15.55:0/4223780326 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c0d1d10 con 0x7f862c0d0630 2023-07-06T21:58:52.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.035+0000 7f862affd640 1 --2- 172.21.15.55:0/4223780326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f862c0d0630 0x7f862c15fa90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f86200097c0 tx=0x7f862001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a65382254fbf457e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:52.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f862a7fc640 1 -- 172.21.15.55:0/4223780326 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86200ab600 con 0x7f862c0d0630 2023-07-06T21:58:52.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f862a7fc640 1 -- 172.21.15.55:0/4223780326 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86200a7050 con 0x7f862c0d0630 2023-07-06T21:58:52.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f862a7fc640 1 -- 172.21.15.55:0/4223780326 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86200ab980 con 0x7f862c0d0630 2023-07-06T21:58:52.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 -- 172.21.15.55:0/4223780326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f862c0d0630 msgr2=0x7f862c15fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:52.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 --2- 172.21.15.55:0/4223780326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f862c0d0630 0x7f862c15fa90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f86200097c0 tx=0x7f862001c450 comp rx=0 tx=0).stop 2023-07-06T21:58:52.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 -- 172.21.15.55:0/4223780326 shutdown_connections 2023-07-06T21:58:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 --2- 172.21.15.55:0/4223780326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f862c0d0630 0x7f862c15fa90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 -- 172.21.15.55:0/4223780326 >> 172.21.15.55:0/4223780326 conn(0x7f862c0b3b60 msgr2=0x7f862c0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 -- 172.21.15.55:0/4223780326 shutdown_connections 2023-07-06T21:58:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 -- 172.21.15.55:0/4223780326 wait complete. 2023-07-06T21:58:52.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 Processor -- start 2023-07-06T21:58:52.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 -- start start 2023-07-06T21:58:52.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f862c0b1250 0x7f862c14dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862c0ce200 0x7f862c14c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f862c0d0630 0x7f862c154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c154ae0 con 0x7f862c0ce200 2023-07-06T21:58:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c154dc0 con 0x7f862c0d0630 2023-07-06T21:58:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f8630941640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c1550a0 con 0x7f862c0b1250 2023-07-06T21:58:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f862affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862c0ce200 0x7f862c14c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f862affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862c0ce200 0x7f862c14c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50418/0 (socket says 172.21.15.55:50418) 2023-07-06T21:58:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f862affd640 1 -- 172.21.15.55:0/3810049703 learned_addr learned my addr 172.21.15.55:0/3810049703 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f862bfff640 1 --2- 172.21.15.55:0/3810049703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f862c0d0630 0x7f862c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:52.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.039+0000 7f862b7fe640 1 --2- 172.21.15.55:0/3810049703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f862c0b1250 0x7f862c14dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:52.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f862affd640 1 -- 172.21.15.55:0/3810049703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f862c0b1250 msgr2=0x7f862c14dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:52.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f862affd640 1 --2- 172.21.15.55:0/3810049703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f862c0b1250 0x7f862c14dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f862affd640 1 -- 172.21.15.55:0/3810049703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f862c0d0630 msgr2=0x7f862c154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:52.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f862affd640 1 --2- 172.21.15.55:0/3810049703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f862c0d0630 0x7f862c154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f862affd640 1 -- 172.21.15.55:0/3810049703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8620009420 con 0x7f862c0ce200 2023-07-06T21:58:52.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f862affd640 1 --2- 172.21.15.55:0/3810049703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862c0ce200 0x7f862c14c480 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f8620019060 tx=0x7f86200191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:52.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f8613fff640 1 -- 172.21.15.55:0/3810049703 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620004020 con 0x7f862c0ce200 2023-07-06T21:58:52.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f8613fff640 1 -- 172.21.15.55:0/3810049703 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8620004180 con 0x7f862c0ce200 2023-07-06T21:58:52.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f8613fff640 1 -- 172.21.15.55:0/3810049703 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86200044f0 con 0x7f862c0ce200 2023-07-06T21:58:52.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f8630941640 1 -- 172.21.15.55:0/3810049703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862c0c7280 con 0x7f862c0ce200 2023-07-06T21:58:52.044 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f53fd1a6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:58:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f8630941640 1 -- 172.21.15.55:0/3810049703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862c14c9c0 con 0x7f862c0ce200 2023-07-06T21:58:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f8630941640 1 -- 172.21.15.55:0/3810049703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862c04d790 con 0x7f862c0ce200 2023-07-06T21:58:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f8613fff640 1 -- 172.21.15.55:0/3810049703 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 48) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f86200b2050 con 0x7f862c0ce200 2023-07-06T21:58:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.043+0000 7f8613fff640 1 --2- 172.21.15.55:0/3810049703 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f86180663f0 0x7f86180688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.047+0000 7f862b7fe640 1 -- 172.21.15.55:0/3810049703 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f86180663f0 msgr2=0x7f86180688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1408736549 2023-07-06T21:58:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.047+0000 7f8613fff640 1 -- 172.21.15.55:0/3810049703 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f862011e0d0 con 0x7f862c0ce200 2023-07-06T21:58:52.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.047+0000 7f862b7fe640 1 --2- 172.21.15.55:0/3810049703 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f86180663f0 0x7f86180688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:52.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.051+0000 7f8613fff640 1 -- 172.21.15.55:0/3810049703 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f86200eb290 con 0x7f862c0ce200 2023-07-06T21:58:52.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.207+0000 7f8630941640 1 -- 172.21.15.55:0/3810049703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f862c0b3240 con 0x7f862c0ce200 2023-07-06T21:58:52.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.219+0000 7f8613fff640 1 -- 172.21.15.55:0/3810049703 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f86200b00d0 con 0x7f862c0ce200 2023-07-06T21:58:52.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.223+0000 7f8630941640 1 -- 172.21.15.55:0/3810049703 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f86180663f0 msgr2=0x7f86180688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:52.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.223+0000 7f8630941640 1 --2- 172.21.15.55:0/3810049703 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f86180663f0 0x7f86180688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.223+0000 7f8630941640 1 -- 172.21.15.55:0/3810049703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862c0ce200 msgr2=0x7f862c14c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:52.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.223+0000 7f8630941640 1 --2- 172.21.15.55:0/3810049703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862c0ce200 0x7f862c14c480 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f8620019060 tx=0x7f86200191f0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.223+0000 7f8630941640 1 -- 172.21.15.55:0/3810049703 shutdown_connections 2023-07-06T21:58:52.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.223+0000 7f8630941640 1 --2- 172.21.15.55:0/3810049703 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f86180663f0 0x7f86180688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.223+0000 7f8630941640 1 --2- 172.21.15.55:0/3810049703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f862c0d0630 0x7f862c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.223+0000 7f8630941640 1 --2- 172.21.15.55:0/3810049703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862c0ce200 0x7f862c14c480 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.223+0000 7f8630941640 1 --2- 172.21.15.55:0/3810049703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f862c0b1250 0x7f862c14dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.223+0000 7f8630941640 1 -- 172.21.15.55:0/3810049703 >> 172.21.15.55:0/3810049703 conn(0x7f862c0b3b60 msgr2=0x7f862c06acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:52.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.223+0000 7f8630941640 1 -- 172.21.15.55:0/3810049703 shutdown_connections 2023-07-06T21:58:52.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.223+0000 7f8630941640 1 -- 172.21.15.55:0/3810049703 wait complete. 2023-07-06T21:58:52.240 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-06T21:58:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7e5a34640 1 Processor -- start 2023-07-06T21:58:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7e5a34640 1 -- start start 2023-07-06T21:58:52.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7e5a34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7e00b7b90 0x7fb7e00d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7e5a34640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb7e00cc870 0x7fb7e00b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7e5a34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7e00b4130 0x7fb7e00d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7e5a34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e00b45b0 con 0x7fb7e00b7b90 2023-07-06T21:58:52.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7e5a34640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e00b5070 con 0x7fb7e00cc870 2023-07-06T21:58:52.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7e5a34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0160020 con 0x7fb7e00b4130 2023-07-06T21:58:52.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7deffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7e00b7b90 0x7fb7e00d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:52.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7deffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7e00b7b90 0x7fb7e00d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50424/0 (socket says 172.21.15.55:50424) 2023-07-06T21:58:52.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7deffd640 1 -- 172.21.15.55:0/3408277647 learned_addr learned my addr 172.21.15.55:0/3408277647 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:52.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7d7fff640 1 --2- 172.21.15.55:0/3408277647 >> v2:172.21.15.138:3300/0 conn(0x7fb7e00cc870 0x7fb7e00b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:52.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7df7fe640 1 --2- 172.21.15.55:0/3408277647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7e00b4130 0x7fb7e00d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:52.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7deffd640 1 -- 172.21.15.55:0/3408277647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7e00b4130 msgr2=0x7fb7e00d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:52.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7deffd640 1 --2- 172.21.15.55:0/3408277647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7e00b4130 0x7fb7e00d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7deffd640 1 -- 172.21.15.55:0/3408277647 >> v2:172.21.15.138:3300/0 conn(0x7fb7e00cc870 msgr2=0x7fb7e00b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:52.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7deffd640 1 --2- 172.21.15.55:0/3408277647 >> v2:172.21.15.138:3300/0 conn(0x7fb7e00cc870 0x7fb7e00b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.391+0000 7fb7deffd640 1 -- 172.21.15.55:0/3408277647 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e01604b0 con 0x7fb7e00b7b90 2023-07-06T21:58:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.395+0000 7fb7deffd640 1 --2- 172.21.15.55:0/3408277647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7e00b7b90 0x7fb7e00d1c40 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fb7e008b540 tx=0x7fb7d001c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c133013cf263a7a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.395+0000 7fb7de7fc640 1 -- 172.21.15.55:0/3408277647 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d00ab600 con 0x7fb7e00b7b90 2023-07-06T21:58:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.395+0000 7fb7de7fc640 1 -- 172.21.15.55:0/3408277647 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d00a7050 con 0x7fb7e00b7b90 2023-07-06T21:58:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.395+0000 7fb7de7fc640 1 -- 172.21.15.55:0/3408277647 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d00ab980 con 0x7fb7e00b7b90 2023-07-06T21:58:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.395+0000 7fb7e5a34640 1 -- 172.21.15.55:0/3408277647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7e00b7b90 msgr2=0x7fb7e00d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.395+0000 7fb7e5a34640 1 --2- 172.21.15.55:0/3408277647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7e00b7b90 0x7fb7e00d1c40 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fb7e008b540 tx=0x7fb7d001c220 comp rx=0 tx=0).stop 2023-07-06T21:58:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.395+0000 7fb7e5a34640 1 -- 172.21.15.55:0/3408277647 shutdown_connections 2023-07-06T21:58:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.395+0000 7fb7e5a34640 1 --2- 172.21.15.55:0/3408277647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7e00b4130 0x7fb7e00d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.395+0000 7fb7e5a34640 1 --2- 172.21.15.55:0/3408277647 >> v2:172.21.15.138:3300/0 conn(0x7fb7e00cc870 0x7fb7e00b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.395+0000 7fb7e5a34640 1 --2- 172.21.15.55:0/3408277647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7e00b7b90 0x7fb7e00d1c40 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.395+0000 7fb7e5a34640 1 -- 172.21.15.55:0/3408277647 >> 172.21.15.55:0/3408277647 conn(0x7fb7e00ceca0 msgr2=0x7fb7e00cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.395+0000 7fb7e5a34640 1 -- 172.21.15.55:0/3408277647 shutdown_connections 2023-07-06T21:58:52.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.395+0000 7fb7e5a34640 1 -- 172.21.15.55:0/3408277647 wait complete. 2023-07-06T21:58:52.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.395+0000 7fb7e5a34640 1 Processor -- start 2023-07-06T21:58:52.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7e5a34640 1 -- start start 2023-07-06T21:58:52.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7e5a34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7e00b4130 0x7fb7e015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7e5a34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7e00b7b90 0x7fb7e01547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7e5a34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7e00cc870 0x7fb7e006a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7e5a34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0157300 con 0x7fb7e00cc870 2023-07-06T21:58:52.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7e5a34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0158160 con 0x7fb7e00b4130 2023-07-06T21:58:52.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7e5a34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e015f180 con 0x7fb7e00b7b90 2023-07-06T21:58:52.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7df7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7e00cc870 0x7fb7e006a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:52.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7df7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7e00cc870 0x7fb7e006a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50440/0 (socket says 172.21.15.55:50440) 2023-07-06T21:58:52.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7df7fe640 1 -- 172.21.15.55:0/2570327898 learned_addr learned my addr 172.21.15.55:0/2570327898 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:52.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7deffd640 1 --2- 172.21.15.55:0/2570327898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7e00b4130 0x7fb7e015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:52.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7d7fff640 1 --2- 172.21.15.55:0/2570327898 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7e00b7b90 0x7fb7e01547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7df7fe640 1 -- 172.21.15.55:0/2570327898 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7e00b7b90 msgr2=0x7fb7e01547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7df7fe640 1 --2- 172.21.15.55:0/2570327898 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7e00b7b90 0x7fb7e01547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7df7fe640 1 -- 172.21.15.55:0/2570327898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7e00b4130 msgr2=0x7fb7e015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7df7fe640 1 --2- 172.21.15.55:0/2570327898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7e00b4130 0x7fb7e015ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7df7fe640 1 -- 172.21.15.55:0/2570327898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d00094d0 con 0x7fb7e00cc870 2023-07-06T21:58:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7df7fe640 1 --2- 172.21.15.55:0/2570327898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7e00cc870 0x7fb7e006a3a0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8007e70 tx=0x7fb7d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7dcff9640 1 -- 172.21.15.55:0/2570327898 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8014620 con 0x7fb7e00cc870 2023-07-06T21:58:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7dcff9640 1 -- 172.21.15.55:0/2570327898 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d80147a0 con 0x7fb7e00cc870 2023-07-06T21:58:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7dcff9640 1 -- 172.21.15.55:0/2570327898 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8014b50 con 0x7fb7e00cc870 2023-07-06T21:58:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7e5a34640 1 -- 172.21.15.55:0/2570327898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e01585f0 con 0x7fb7e00cc870 2023-07-06T21:58:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7e5a34640 1 -- 172.21.15.55:0/2570327898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e0157830 con 0x7fb7e00cc870 2023-07-06T21:58:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.399+0000 7fb7e5a34640 1 -- 172.21.15.55:0/2570327898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e01582f0 con 0x7fb7e00cc870 2023-07-06T21:58:52.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.403+0000 7fb7dcff9640 1 -- 172.21.15.55:0/2570327898 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 48) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fb7d8014cb0 con 0x7fb7e00cc870 2023-07-06T21:58:52.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.403+0000 7fb7dcff9640 1 --2- 172.21.15.55:0/2570327898 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb7c00663f0 0x7fb7c00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.403+0000 7fb7dcff9640 1 -- 172.21.15.55:0/2570327898 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb7d8084930 con 0x7fb7e00cc870 2023-07-06T21:58:52.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.403+0000 7fb7deffd640 1 -- 172.21.15.55:0/2570327898 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb7c00663f0 msgr2=0x7fb7c00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1408736549 2023-07-06T21:58:52.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.403+0000 7fb7deffd640 1 --2- 172.21.15.55:0/2570327898 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb7c00663f0 0x7fb7c00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:52.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.407+0000 7fb7dcff9640 1 -- 172.21.15.55:0/2570327898 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb7d8055600 con 0x7fb7e00cc870 2023-07-06T21:58:52.441 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:52.441+0000 7fc09bc38180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:58:52.493 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:52.495+0000 7f53fd1a6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:58:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.563+0000 7fb7e5a34640 1 -- 172.21.15.55:0/2570327898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fb7e0066d60 con 0x7fb7e00cc870 2023-07-06T21:58:52.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.575+0000 7fb7dcff9640 1 -- 172.21.15.55:0/2570327898 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v36)=0 v36) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb7d8055190 con 0x7fb7e00cc870 2023-07-06T21:58:52.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.575+0000 7fb7e5a34640 1 -- 172.21.15.55:0/2570327898 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb7c00663f0 msgr2=0x7fb7c00688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:52.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.575+0000 7fb7e5a34640 1 --2- 172.21.15.55:0/2570327898 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb7c00663f0 0x7fb7c00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.575+0000 7fb7e5a34640 1 -- 172.21.15.55:0/2570327898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7e00cc870 msgr2=0x7fb7e006a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:52.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.575+0000 7fb7e5a34640 1 --2- 172.21.15.55:0/2570327898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7e00cc870 0x7fb7e006a3a0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8007e70 tx=0x7fb7d800e4b0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.575+0000 7fb7e5a34640 1 -- 172.21.15.55:0/2570327898 shutdown_connections 2023-07-06T21:58:52.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.575+0000 7fb7e5a34640 1 --2- 172.21.15.55:0/2570327898 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7fb7c00663f0 0x7fb7c00688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.575+0000 7fb7e5a34640 1 --2- 172.21.15.55:0/2570327898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7e00cc870 0x7fb7e006a3a0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.575+0000 7fb7e5a34640 1 --2- 172.21.15.55:0/2570327898 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb7e00b7b90 0x7fb7e01547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.575+0000 7fb7e5a34640 1 --2- 172.21.15.55:0/2570327898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7e00b4130 0x7fb7e015ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.575+0000 7fb7e5a34640 1 -- 172.21.15.55:0/2570327898 >> 172.21.15.55:0/2570327898 conn(0x7fb7e00ceca0 msgr2=0x7fb7e0165cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.575+0000 7fb7e5a34640 1 -- 172.21.15.55:0/2570327898 shutdown_connections 2023-07-06T21:58:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.575+0000 7fb7e5a34640 1 -- 172.21.15.55:0/2570327898 wait complete. 2023-07-06T21:58:52.591 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:52.589+0000 7fc09bc38180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:58:52.595 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-07-06T21:58:52.655 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:52.655+0000 7f53fd1a6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:58:52.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34dc2cb640 1 Processor -- start 2023-07-06T21:58:52.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34dc2cb640 1 -- start start 2023-07-06T21:58:52.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34dc2cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d40b3c90 0x7f34d40ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34dc2cb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f34d40b18a0 0x7f34d40b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34dc2cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d40ccd50 con 0x7f34d40d1d30 2023-07-06T21:58:52.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34dc2cb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d40cd0a0 con 0x7f34d40b18a0 2023-07-06T21:58:52.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34dc2cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d4069ea0 con 0x7f34d40b3c90 2023-07-06T21:58:52.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34da868640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f34d40d1d30 0x7f34d415f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44572/0 (socket says 172.21.15.55:44572) 2023-07-06T21:58:52.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34da868640 1 -- 172.21.15.55:0/3963800151 learned_addr learned my addr 172.21.15.55:0/3963800151 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:58:52.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 -- 172.21.15.55:0/3963800151 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643380309 0 0) 0x7f34d40ccd50 con 0x7f34d40d1d30 2023-07-06T21:58:52.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 -- 172.21.15.55:0/3963800151 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34c0003530 con 0x7f34d40d1d30 2023-07-06T21:58:52.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 -- 172.21.15.55:0/3963800151 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1259343377 0 0) 0x7f34c0003530 con 0x7f34d40d1d30 2023-07-06T21:58:52.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 -- 172.21.15.55:0/3963800151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d40b3c90 msgr2=0x7f34d40ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:52.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 --2- 172.21.15.55:0/3963800151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d40b3c90 0x7f34d40ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 -- 172.21.15.55:0/3963800151 >> v2:172.21.15.138:3300/0 conn(0x7f34d40b18a0 msgr2=0x7f34d40b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:52.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 --2- 172.21.15.55:0/3963800151 >> v2:172.21.15.138:3300/0 conn(0x7f34d40b18a0 0x7f34d40b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 -- 172.21.15.55:0/3963800151 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d40b45a0 con 0x7f34d40d1d30 2023-07-06T21:58:52.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 -- 172.21.15.55:0/3963800151 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f34cc001a00 con 0x7f34d40d1d30 2023-07-06T21:58:52.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 -- 172.21.15.55:0/3963800151 >> v1:172.21.15.55:6789/0 conn(0x7f34d40d1d30 legacy=0x7f34d415f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:52.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 --2- 172.21.15.55:0/3963800151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d40b3c90 0x7f34c0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 --2- 172.21.15.55:0/3963800151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c0004090 0x7f34c00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 --2- 172.21.15.55:0/3963800151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c0004d60 0x7f34c00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 -- 172.21.15.55:0/3963800151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40cd0a0 con 0x7f34c0004090 2023-07-06T21:58:52.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 -- 172.21.15.55:0/3963800151 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d4069ea0 con 0x7f34c0004d60 2023-07-06T21:58:52.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9065640 1 -- 172.21.15.55:0/3963800151 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c000bc50 con 0x7f34d40b3c90 2023-07-06T21:58:52.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9866640 1 --2- 172.21.15.55:0/3963800151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c0004090 0x7f34c00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:52.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9866640 1 -- 172.21.15.55:0/3963800151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d40b3c90 msgr2=0x7f34c0003980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T21:58:52.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9866640 1 --2- 172.21.15.55:0/3963800151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d40b3c90 0x7f34c0003980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9866640 1 -- 172.21.15.55:0/3963800151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c0004d60 msgr2=0x7f34c00051d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T21:58:52.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9866640 1 --2- 172.21.15.55:0/3963800151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c0004d60 0x7f34c00051d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.747+0000 7f34d9866640 1 -- 172.21.15.55:0/3963800151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c0003530 con 0x7f34c0004090 2023-07-06T21:58:52.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.751+0000 7f34d9866640 1 --2- 172.21.15.55:0/3963800151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c0004090 0x7f34c00047d0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f34c0004750 tx=0x7f34c401c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d89d9b1f441602e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:52.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.751+0000 7f34d9065640 1 -- 172.21.15.55:0/3963800151 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c40ab600 con 0x7f34c0004090 2023-07-06T21:58:52.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.751+0000 7f34d9065640 1 -- 172.21.15.55:0/3963800151 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c40a7050 con 0x7f34c0004090 2023-07-06T21:58:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.751+0000 7f34d9065640 1 -- 172.21.15.55:0/3963800151 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c40ab9c0 con 0x7f34c0004090 2023-07-06T21:58:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.751+0000 7f34dc2cb640 1 -- 172.21.15.55:0/3963800151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c0004090 msgr2=0x7f34c00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.751+0000 7f34dc2cb640 1 --2- 172.21.15.55:0/3963800151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c0004090 0x7f34c00047d0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f34c0004750 tx=0x7f34c401c300 comp rx=0 tx=0).stop 2023-07-06T21:58:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.751+0000 7f34da868640 1 -- 172.21.15.55:0/3963800151 reap_dead start 2023-07-06T21:58:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.751+0000 7f34dc2cb640 1 -- 172.21.15.55:0/3963800151 shutdown_connections 2023-07-06T21:58:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.751+0000 7f34dc2cb640 1 -- 172.21.15.55:0/3963800151 >> 172.21.15.55:0/3963800151 conn(0x7f34d406bf40 msgr2=0x7f34d40cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.751+0000 7f34dc2cb640 1 -- 172.21.15.55:0/3963800151 shutdown_connections 2023-07-06T21:58:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.751+0000 7f34dc2cb640 1 -- 172.21.15.55:0/3963800151 wait complete. 2023-07-06T21:58:52.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34dc2cb640 1 Processor -- start 2023-07-06T21:58:52.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34dc2cb640 1 -- start start 2023-07-06T21:58:52.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34dc2cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c0004090 0x7f34d4154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34dc2cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d41532f0 0x7f34d40cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34dc2cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34d4153760 0x7f34d40cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34dc2cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40ca340 con 0x7f34d4153760 2023-07-06T21:58:52.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34dc2cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40c5e70 con 0x7f34c0004090 2023-07-06T21:58:52.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34dc2cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40c6150 con 0x7f34d41532f0 2023-07-06T21:58:52.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34da868640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34d4153760 0x7f34d40cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:52.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34d9866640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d41532f0 0x7f34d40cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:52.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34da067640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c0004090 0x7f34d4154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:52.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34d9866640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d41532f0 0x7f34d40cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44010/0 (socket says 172.21.15.55:44010) 2023-07-06T21:58:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34d9866640 1 -- 172.21.15.55:0/2508762953 learned_addr learned my addr 172.21.15.55:0/2508762953 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34da868640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34d4153760 0x7f34d40cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50454/0 (socket says 172.21.15.55:50454) 2023-07-06T21:58:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34da868640 1 -- 172.21.15.55:0/2508762953 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d41532f0 msgr2=0x7f34d40cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34da868640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d41532f0 0x7f34d40cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34da868640 1 -- 172.21.15.55:0/2508762953 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c0004090 msgr2=0x7f34d4154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34da868640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c0004090 0x7f34d4154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34da868640 1 -- 172.21.15.55:0/2508762953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d40c6430 con 0x7f34d4153760 2023-07-06T21:58:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34d9866640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d41532f0 0x7f34d40cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T21:58:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34da868640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34d4153760 0x7f34d40cb350 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f34d40b10d0 tx=0x7f34cc00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34caffd640 1 -- 172.21.15.55:0/2508762953 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc00a2e0 con 0x7f34d4153760 2023-07-06T21:58:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34caffd640 1 -- 172.21.15.55:0/2508762953 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc00a440 con 0x7f34d4153760 2023-07-06T21:58:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34caffd640 1 -- 172.21.15.55:0/2508762953 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc00a7f0 con 0x7f34d4153760 2023-07-06T21:58:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34dc2cb640 1 -- 172.21.15.55:0/2508762953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d40c6710 con 0x7f34d4153760 2023-07-06T21:58:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.755+0000 7f34dc2cb640 1 -- 172.21.15.55:0/2508762953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d40c95a0 con 0x7f34d4153760 2023-07-06T21:58:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.759+0000 7f34dc2cb640 1 -- 172.21.15.55:0/2508762953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d4066d60 con 0x7f34d4153760 2023-07-06T21:58:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.759+0000 7f34caffd640 1 -- 172.21.15.55:0/2508762953 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 48) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f34cc00a950 con 0x7f34d4153760 2023-07-06T21:58:52.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.759+0000 7f34caffd640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f34b80663f0 0x7f34b80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:52.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.759+0000 7f34caffd640 1 -- 172.21.15.55:0/2508762953 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f34cc086720 con 0x7f34d4153760 2023-07-06T21:58:52.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.759+0000 7f34da067640 1 -- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f34b80663f0 msgr2=0x7f34b80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1408736549 2023-07-06T21:58:52.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.759+0000 7f34da067640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f34b80663f0 0x7f34b80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:58:52.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.763+0000 7f34caffd640 1 -- 172.21.15.55:0/2508762953 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f34cc0539f0 con 0x7f34d4153760 2023-07-06T21:58:52.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.939+0000 7f34dc2cb640 1 -- 172.21.15.55:0/2508762953 --> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f34d40cc9e0 con 0x7f34b80663f0 2023-07-06T21:58:52.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.963+0000 7f34da067640 1 -- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f34b80663f0 msgr2=0x7f34b80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1408736549 2023-07-06T21:58:52.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:52.963+0000 7f34da067640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f34b80663f0 0x7f34b80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-06T21:58:53.071 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:53.069+0000 7fc09bc38180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:58:53.130 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:53.129+0000 7fc09bc38180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:58:53.165 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:53.167+0000 7f53fd1a6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T21:58:53.185 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:53.185+0000 7fc09bc38180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:58:53.226 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:53.227+0000 7f53fd1a6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T21:58:53.270 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:53.269+0000 7fc09bc38180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:58:53.284 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:53.287+0000 7f53fd1a6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T21:58:53.328 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:53.325+0000 7fc09bc38180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:58:53.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:53.367+0000 7f34da067640 1 -- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f34b80663f0 msgr2=0x7f34b80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1408736549 2023-07-06T21:58:53.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:53.367+0000 7f34da067640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f34b80663f0 0x7f34b80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-06T21:58:53.376 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:53.375+0000 7f53fd1a6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T21:58:53.411 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:53.409+0000 7fc09bc38180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:58:53.434 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:53.435+0000 7f53fd1a6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T21:58:53.468 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:53.469+0000 7fc09bc38180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:58:53.523 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:53.523+0000 7f53fd1a6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T21:58:53.582 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:53.583+0000 7f53fd1a6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T21:58:53.610 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:53.609+0000 7fc09bc38180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:58:53.668 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:53.669+0000 7fc09bc38180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:58:53.731 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:53.731+0000 7f53fd1a6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T21:58:53.791 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:53.791+0000 7f53fd1a6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T21:58:53.910 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:58:53.910 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:58:53.910 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:58:53.918 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:53.917+0000 7fc09bc38180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:58:54.043 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T21:58:54.044 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T21:58:54.044 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T21:58:54.052 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:54.055+0000 7f53fd1a6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T21:58:54.053 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:54.053+0000 7fc09bc38180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:58:54.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:54.171+0000 7f34da067640 1 -- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f34b80663f0 msgr2=0x7f34b80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1408736549 2023-07-06T21:58:54.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:54.171+0000 7f34da067640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f34b80663f0 0x7f34b80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-06T21:58:54.178 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:54.177+0000 7fc09bc38180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:58:54.192 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:54.195+0000 7f53fd1a6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:58:54.247 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:54.245+0000 7fc09bc38180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:58:54.323 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:54.323+0000 7f53fd1a6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T21:58:54.381 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:54.381+0000 7fc09bc38180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:58:54.397 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:54.399+0000 7f53fd1a6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T21:58:54.538 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:54.539+0000 7f53fd1a6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T21:58:54.919 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:54.917+0000 7fc09bc38180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:58:55.005 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:55.005+0000 7fc09bc38180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:58:55.108 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.107+0000 7f53fd1a6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T21:58:55.152 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:55.153+0000 7fc09bc38180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:58:55.196 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.199+0000 7f53fd1a6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T21:58:55.236 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:55.237+0000 7fc09bc38180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:58:55.355 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.355+0000 7f53fd1a6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T21:58:55.442 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.443+0000 7f53fd1a6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T21:58:55.510 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:55.509+0000 7fc09bc38180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:58:55.569 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:58:55.569+0000 7fc09bc38180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:58:55.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:55.683+0000 7f34caffd640 1 -- 172.21.15.55:0/2508762953 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 49) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f34cc053dc0 con 0x7f34d4153760 2023-07-06T21:58:55.730 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.731+0000 7f53fd1a6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T21:58:55.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:55.775+0000 7f34da067640 1 -- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f34b80663f0 msgr2=0x7f34b80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1408736549 2023-07-06T21:58:55.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:55.775+0000 7f34da067640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f34b80663f0 0x7f34b80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-07-06T21:58:55.792 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.795+0000 7f53fd1a6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T21:58:55.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:55.807+0000 7f34caffd640 1 -- 172.21.15.55:0/2508762953 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 50) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f34cc084900 con 0x7f34d4153760 2023-07-06T21:58:55.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:55.807+0000 7f34caffd640 1 -- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f34b80663f0 msgr2=0x7f34b80688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:58:55.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:55.807+0000 7f34caffd640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/1408736549,v1:172.21.15.55:6833/1408736549] conn(0x7f34b80663f0 0x7f34b80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:55.927 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.927+0000 7f537c218640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:55.928 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.927+0000 7f537c218640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:55.928 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.927+0000 7f537c218640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:55.928 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.927+0000 7f537c218640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:55.928 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.927+0000 7f537c218640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:55.928 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.927+0000 7f537f21e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:55.929 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.927+0000 7f537f21e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:55.929 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.927+0000 7f537f21e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:55.929 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.927+0000 7f537f21e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:55.929 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:58:55.927+0000 7f537f21e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:58:56.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.815+0000 7f34caffd640 1 -- 172.21.15.55:0/2508762953 <== mon.0 v2:172.21.15.55:3300/0 9 ==== mgrmap(e 51) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f34cc079260 con 0x7f34d4153760 2023-07-06T21:58:56.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.815+0000 7f34caffd640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f34b806ee40 0x7f34b8071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:56.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.815+0000 7f34caffd640 1 -- 172.21.15.55:0/2508762953 --> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f34b8034290 con 0x7f34b806ee40 2023-07-06T21:58:56.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.819+0000 7f34da067640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f34b806ee40 0x7f34b8071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:56.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.823+0000 7f34da067640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f34b806ee40 0x7f34b8071220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009380 tx=0x7f34d00090e0 comp rx=0 tx=0).ready entity=mgr.8268 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.887+0000 7f34caffd640 1 -- 172.21.15.55:0/2508762953 <== mgr.8268 v2:172.21.15.55:6832/3474707671 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f34b8034290 con 0x7f34b806ee40 2023-07-06T21:58:56.887 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /bad-path 2023-07-06T21:58:56.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.891+0000 7f34dc2cb640 1 -- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f34b806ee40 msgr2=0x7f34b8071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:56.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.891+0000 7f34dc2cb640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f34b806ee40 0x7f34b8071220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009380 tx=0x7f34d00090e0 comp rx=0 tx=0).stop 2023-07-06T21:58:56.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.891+0000 7f34dc2cb640 1 -- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34d4153760 msgr2=0x7f34d40cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:56.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.891+0000 7f34dc2cb640 1 --2- 172.21.15.55:0/2508762953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34d4153760 0x7f34d40cb350 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f34d40b10d0 tx=0x7f34cc00fb30 comp rx=0 tx=0).stop 2023-07-06T21:58:56.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.891+0000 7f34da868640 1 -- 172.21.15.55:0/2508762953 reap_dead start 2023-07-06T21:58:56.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.891+0000 7f34dc2cb640 1 -- 172.21.15.55:0/2508762953 shutdown_connections 2023-07-06T21:58:56.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.891+0000 7f34dc2cb640 1 -- 172.21.15.55:0/2508762953 >> 172.21.15.55:0/2508762953 conn(0x7f34d406bf40 msgr2=0x7f34d40b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:56.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.891+0000 7f34dc2cb640 1 -- 172.21.15.55:0/2508762953 shutdown_connections 2023-07-06T21:58:56.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:56.891+0000 7f34dc2cb640 1 -- 172.21.15.55:0/2508762953 wait complete. 2023-07-06T21:58:56.910 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-07-06T21:58:56.910 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-07-06T21:58:57.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb0dee5640 1 Processor -- start 2023-07-06T21:58:57.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb0dee5640 1 -- start start 2023-07-06T21:58:57.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb0dee5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb0806a460 0x7fbb080caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:57.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb0dee5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbb0806cb40 0x7fbb080693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:57.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb0dee5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb080cc650 con 0x7fbb0806f960 2023-07-06T21:58:57.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb0dee5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0806bac0 con 0x7fbb0806a460 2023-07-06T21:58:57.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb0dee5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0806d130 con 0x7fbb0806cb40 2023-07-06T21:58:57.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb077fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb0806a460 0x7fbb080caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:57.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb077fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb0806a460 0x7fbb080caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42832/0 (socket says 172.21.15.55:42832) 2023-07-06T21:58:57.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb077fe640 1 -- 172.21.15.55:0/790251862 learned_addr learned my addr 172.21.15.55:0/790251862 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:57.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb07fff640 1 --1- 172.21.15.55:0/790251862 >> v1:172.21.15.55:6789/0 conn(0x7fbb0806f960 0x7fbb0806fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59736/0 (socket says 172.21.15.55:59736) 2023-07-06T21:58:57.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb06ffd640 1 --2- 172.21.15.55:0/790251862 >> v2:172.21.15.138:3300/0 conn(0x7fbb0806cb40 0x7fbb080693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:57.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb077fe640 1 -- 172.21.15.55:0/790251862 >> v2:172.21.15.138:3300/0 conn(0x7fbb0806cb40 msgr2=0x7fbb080693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:58:57.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb077fe640 1 --2- 172.21.15.55:0/790251862 >> v2:172.21.15.138:3300/0 conn(0x7fbb0806cb40 0x7fbb080693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:57.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb077fe640 1 -- 172.21.15.55:0/790251862 >> v1:172.21.15.55:6789/0 conn(0x7fbb0806f960 legacy=0x7fbb0806fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:57.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb077fe640 1 -- 172.21.15.55:0/790251862 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0806d3d0 con 0x7fbb0806a460 2023-07-06T21:58:57.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.059+0000 7fbb06ffd640 1 --2- 172.21.15.55:0/790251862 >> v2:172.21.15.138:3300/0 conn(0x7fbb0806cb40 0x7fbb080693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:58:57.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.063+0000 7fbb077fe640 1 --2- 172.21.15.55:0/790251862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb0806a460 0x7fbb080caa80 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fbb0806f730 tx=0x7fbaf801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198bfe7805af528b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:57.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.063+0000 7fbb067fc640 1 -- 172.21.15.55:0/790251862 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8004230 con 0x7fbb0806a460 2023-07-06T21:58:57.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.063+0000 7fbb067fc640 1 -- 172.21.15.55:0/790251862 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf80a7050 con 0x7fbb0806a460 2023-07-06T21:58:57.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.063+0000 7fbb067fc640 1 -- 172.21.15.55:0/790251862 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8003620 con 0x7fbb0806a460 2023-07-06T21:58:57.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.063+0000 7fbb0dee5640 1 -- 172.21.15.55:0/790251862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb0806a460 msgr2=0x7fbb080caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:57.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.063+0000 7fbb0dee5640 1 --2- 172.21.15.55:0/790251862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb0806a460 0x7fbb080caa80 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fbb0806f730 tx=0x7fbaf801c440 comp rx=0 tx=0).stop 2023-07-06T21:58:57.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.063+0000 7fbb0dee5640 1 -- 172.21.15.55:0/790251862 shutdown_connections 2023-07-06T21:58:57.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.063+0000 7fbb0dee5640 1 --2- 172.21.15.55:0/790251862 >> v2:172.21.15.138:3300/0 conn(0x7fbb0806cb40 0x7fbb080693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:57.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.063+0000 7fbb0dee5640 1 --2- 172.21.15.55:0/790251862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb0806a460 0x7fbb080caa80 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:57.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.063+0000 7fbb0dee5640 1 -- 172.21.15.55:0/790251862 >> 172.21.15.55:0/790251862 conn(0x7fbb080ce7f0 msgr2=0x7fbb080cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:57.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.063+0000 7fbb0dee5640 1 -- 172.21.15.55:0/790251862 shutdown_connections 2023-07-06T21:58:57.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.063+0000 7fbb0dee5640 1 -- 172.21.15.55:0/790251862 wait complete. 2023-07-06T21:58:57.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb0dee5640 1 Processor -- start 2023-07-06T21:58:57.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb0dee5640 1 -- start start 2023-07-06T21:58:57.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb0dee5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb0806a460 0x7fbb081507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:57.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb0dee5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb0806cb40 0x7fbb080b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:57.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb0dee5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb0806f960 0x7fbb080b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:57.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb0dee5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08151030 con 0x7fbb0806f960 2023-07-06T21:58:57.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb0dee5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08151310 con 0x7fbb0806cb40 2023-07-06T21:58:57.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb0dee5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb081515f0 con 0x7fbb0806a460 2023-07-06T21:58:57.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb07fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb0806f960 0x7fbb080b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:57.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb07fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb0806f960 0x7fbb080b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42848/0 (socket says 172.21.15.55:42848) 2023-07-06T21:58:57.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb07fff640 1 -- 172.21.15.55:0/4249581846 learned_addr learned my addr 172.21.15.55:0/4249581846 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:58:57.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb06ffd640 1 --2- 172.21.15.55:0/4249581846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb0806cb40 0x7fbb080b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:57.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb077fe640 1 --2- 172.21.15.55:0/4249581846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb0806a460 0x7fbb081507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:57.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb07fff640 1 -- 172.21.15.55:0/4249581846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb0806a460 msgr2=0x7fbb081507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:57.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb07fff640 1 --2- 172.21.15.55:0/4249581846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb0806a460 0x7fbb081507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:57.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb07fff640 1 -- 172.21.15.55:0/4249581846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb0806cb40 msgr2=0x7fbb080b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:57.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb07fff640 1 --2- 172.21.15.55:0/4249581846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb0806cb40 0x7fbb080b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:57.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb07fff640 1 -- 172.21.15.55:0/4249581846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf8009480 con 0x7fbb0806f960 2023-07-06T21:58:57.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb07fff640 1 --2- 172.21.15.55:0/4249581846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb0806f960 0x7fbb080b1b60 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000c700 tx=0x7fbb0000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbaeffff640 1 -- 172.21.15.55:0/4249581846 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0000ce10 con 0x7fbb0806f960 2023-07-06T21:58:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbaeffff640 1 -- 172.21.15.55:0/4249581846 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0000a640 con 0x7fbb0806f960 2023-07-06T21:58:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbaeffff640 1 -- 172.21.15.55:0/4249581846 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0000a9b0 con 0x7fbb0806f960 2023-07-06T21:58:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb0dee5640 1 -- 172.21.15.55:0/4249581846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb081518d0 con 0x7fbb0806f960 2023-07-06T21:58:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.067+0000 7fbb0dee5640 1 -- 172.21.15.55:0/4249581846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb080b3ac0 con 0x7fbb0806f960 2023-07-06T21:58:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.071+0000 7fbb0dee5640 1 -- 172.21.15.55:0/4249581846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb08066d60 con 0x7fbb0806f960 2023-07-06T21:58:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.071+0000 7fbaeffff640 1 -- 172.21.15.55:0/4249581846 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 51) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fbb0000ab10 con 0x7fbb0806f960 2023-07-06T21:58:57.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.071+0000 7fbaeffff640 1 --2- 172.21.15.55:0/4249581846 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fbaf4066150 0x7fbaf4068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:58:57.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.071+0000 7fbaeffff640 1 -- 172.21.15.55:0/4249581846 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fbb00083400 con 0x7fbb0806f960 2023-07-06T21:58:57.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.071+0000 7fbb077fe640 1 --2- 172.21.15.55:0/4249581846 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fbaf4066150 0x7fbaf4068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:58:57.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.071+0000 7fbb077fe640 1 --2- 172.21.15.55:0/4249581846 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fbaf4066150 0x7fbaf4068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80ad000 tx=0x7fbaf80a6000 comp rx=0 tx=0).ready entity=mgr.8268 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:58:57.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.075+0000 7fbaeffff640 1 -- 172.21.15.55:0/4249581846 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb00050900 con 0x7fbb0806f960 2023-07-06T21:58:57.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.251+0000 7fbb0dee5640 1 -- 172.21.15.55:0/4249581846 --> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb0806a830 con 0x7fbaf4066150 2023-07-06T21:58:57.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.255+0000 7fbaeffff640 1 -- 172.21.15.55:0/4249581846 <== mgr.8268 v2:172.21.15.55:6832/3474707671 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7fbaf8004030 con 0x7fbaf4066150 2023-07-06T21:58:57.256 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:58:57.256 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:58:56", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-07-06T21:58:57.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.259+0000 7fbb0dee5640 1 -- 172.21.15.55:0/4249581846 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fbaf4066150 msgr2=0x7fbaf4068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:57.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.259+0000 7fbb0dee5640 1 --2- 172.21.15.55:0/4249581846 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fbaf4066150 0x7fbaf4068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80ad000 tx=0x7fbaf80a6000 comp rx=0 tx=0).stop 2023-07-06T21:58:57.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.259+0000 7fbb0dee5640 1 -- 172.21.15.55:0/4249581846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb0806f960 msgr2=0x7fbb080b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:58:57.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.259+0000 7fbb0dee5640 1 --2- 172.21.15.55:0/4249581846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb0806f960 0x7fbb080b1b60 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000c700 tx=0x7fbb0000cbc0 comp rx=0 tx=0).stop 2023-07-06T21:58:57.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.259+0000 7fbb0dee5640 1 -- 172.21.15.55:0/4249581846 shutdown_connections 2023-07-06T21:58:57.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.259+0000 7fbb0dee5640 1 --2- 172.21.15.55:0/4249581846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb0806f960 0x7fbb080b1b60 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:57.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.259+0000 7fbb0dee5640 1 --2- 172.21.15.55:0/4249581846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb0806cb40 0x7fbb080b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:57.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.259+0000 7fbb0dee5640 1 --2- 172.21.15.55:0/4249581846 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fbaf4066150 0x7fbaf4068600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:57.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.259+0000 7fbb0dee5640 1 --2- 172.21.15.55:0/4249581846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbb0806a460 0x7fbb081507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:58:57.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.259+0000 7fbb0dee5640 1 -- 172.21.15.55:0/4249581846 >> 172.21.15.55:0/4249581846 conn(0x7fbb080ce7f0 msgr2=0x7fbb080ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:58:57.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.259+0000 7fbb0dee5640 1 -- 172.21.15.55:0/4249581846 shutdown_connections 2023-07-06T21:58:57.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:58:57.259+0000 7fbb0dee5640 1 -- 172.21.15.55:0/4249581846 wait complete. 2023-07-06T21:58:57.277 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:58:56", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-07-06T21:59:00.900 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:59:00.899+0000 7f536e9fd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:59:00.900 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:59:00.899+0000 7f536e9fd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:59:00.900 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:59:00.899+0000 7f536e9fd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:59:00.900 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:59:00.899+0000 7f536e9fd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:59:00.901 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:59:00.899+0000 7f536e9fd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T21:59:07.295 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:59:07.299 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:59:37.352 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:59:37.356 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:59:57.278 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-07-06T21:59:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc9b47b640 1 Processor -- start 2023-07-06T21:59:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc9b47b640 1 -- start start 2023-07-06T21:59:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc9b47b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc940c89b0 0x7fdc940c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc9b47b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc94158b50 con 0x7fdc94158780 2023-07-06T21:59:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc9b47b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9406fb00 con 0x7fdc940cbfa0 2023-07-06T21:59:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc9b47b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940c9370 con 0x7fdc940c89b0 2023-07-06T21:59:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc99217640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc94158780 0x7fdc940cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60028/0 (socket says 172.21.15.55:60028) 2023-07-06T21:59:57.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc99217640 1 -- 172.21.15.55:0/1527436016 learned_addr learned my addr 172.21.15.55:0/1527436016 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:59:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 -- 172.21.15.55:0/1527436016 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954591691 0 0) 0x7fdc94158b50 con 0x7fdc94158780 2023-07-06T21:59:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 -- 172.21.15.55:0/1527436016 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc80003530 con 0x7fdc94158780 2023-07-06T21:59:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 -- 172.21.15.55:0/1527436016 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 751338614 0 0) 0x7fdc80003530 con 0x7fdc94158780 2023-07-06T21:59:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 -- 172.21.15.55:0/1527436016 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc940c89b0 msgr2=0x7fdc940c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:59:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 --2- 172.21.15.55:0/1527436016 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc940c89b0 0x7fdc940c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 -- 172.21.15.55:0/1527436016 >> v1:172.21.15.138:6789/0 conn(0x7fdc940cbfa0 legacy=0x7fdc9406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 -- 172.21.15.55:0/1527436016 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9406b390 con 0x7fdc94158780 2023-07-06T21:59:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 -- 172.21.15.55:0/1527436016 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fdc90001680 con 0x7fdc94158780 2023-07-06T21:59:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 -- 172.21.15.55:0/1527436016 >> v1:172.21.15.55:6789/0 conn(0x7fdc94158780 legacy=0x7fdc940cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 --2- 172.21.15.55:0/1527436016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc800039b0 0x7fdc80003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 --2- 172.21.15.55:0/1527436016 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc940c89b0 0x7fdc800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 --2- 172.21.15.55:0/1527436016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc80004d10 0x7fdc80005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 -- 172.21.15.55:0/1527436016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940c9370 con 0x7fdc800039b0 2023-07-06T21:59:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 -- 172.21.15.55:0/1527436016 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8000ddb0 con 0x7fdc80004d10 2023-07-06T21:59:57.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.434+0000 7fdc8bfff640 1 -- 172.21.15.55:0/1527436016 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8000df70 con 0x7fdc940c89b0 2023-07-06T21:59:57.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc99217640 1 --2- 172.21.15.55:0/1527436016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc800039b0 0x7fdc80003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:57.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc99217640 1 -- 172.21.15.55:0/1527436016 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc940c89b0 msgr2=0x7fdc800047d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T21:59:57.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc99217640 1 --2- 172.21.15.55:0/1527436016 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc940c89b0 0x7fdc800047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:57.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc99217640 1 -- 172.21.15.55:0/1527436016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc80004d10 msgr2=0x7fdc80005160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T21:59:57.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc99217640 1 --2- 172.21.15.55:0/1527436016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc80004d10 0x7fdc80005160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:57.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc99217640 1 -- 172.21.15.55:0/1527436016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc80003530 con 0x7fdc800039b0 2023-07-06T21:59:57.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc99217640 1 --2- 172.21.15.55:0/1527436016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc800039b0 0x7fdc80003d80 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000c190 tx=0x7fdc9001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3fbcff7224b631 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:59:57.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc8bfff640 1 -- 172.21.15.55:0/1527436016 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90005ae0 con 0x7fdc800039b0 2023-07-06T21:59:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc8bfff640 1 -- 172.21.15.55:0/1527436016 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc90005c40 con 0x7fdc800039b0 2023-07-06T21:59:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc8bfff640 1 -- 172.21.15.55:0/1527436016 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc90007070 con 0x7fdc800039b0 2023-07-06T21:59:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc9b47b640 1 -- 172.21.15.55:0/1527436016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc800039b0 msgr2=0x7fdc80003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc9b47b640 1 --2- 172.21.15.55:0/1527436016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc800039b0 0x7fdc80003d80 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000c190 tx=0x7fdc9001cc20 comp rx=0 tx=0).stop 2023-07-06T21:59:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc99a18640 1 -- 172.21.15.55:0/1527436016 reap_dead start 2023-07-06T21:59:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc9b47b640 1 -- 172.21.15.55:0/1527436016 shutdown_connections 2023-07-06T21:59:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.438+0000 7fdc9b47b640 1 -- 172.21.15.55:0/1527436016 >> 172.21.15.55:0/1527436016 conn(0x7fdc940cde30 msgr2=0x7fdc940ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:59:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc9b47b640 1 -- 172.21.15.55:0/1527436016 shutdown_connections 2023-07-06T21:59:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc9b47b640 1 -- 172.21.15.55:0/1527436016 wait complete. 2023-07-06T21:59:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc9b47b640 1 Processor -- start 2023-07-06T21:59:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc9b47b640 1 -- start start 2023-07-06T21:59:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc9b47b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc800039b0 0x7fdc9415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc9b47b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc9414a9f0 0x7fdc9414b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc9b47b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc940c9810 0x7fdc940c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc9b47b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940ca1d0 con 0x7fdc940c9810 2023-07-06T21:59:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc9b47b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9414ae60 con 0x7fdc9414a9f0 2023-07-06T21:59:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc9b47b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9414beb0 con 0x7fdc800039b0 2023-07-06T21:59:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc99a18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc940c9810 0x7fdc940c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:57.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc99a18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc940c9810 0x7fdc940c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34758/0 (socket says 172.21.15.55:34758) 2023-07-06T21:59:57.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc99a18640 1 -- 172.21.15.55:0/2082776089 learned_addr learned my addr 172.21.15.55:0/2082776089 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:59:57.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc98a16640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc9414a9f0 0x7fdc9414b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:57.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc99217640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc800039b0 0x7fdc9415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:57.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc99a18640 1 -- 172.21.15.55:0/2082776089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc800039b0 msgr2=0x7fdc9415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:57.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc99a18640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc800039b0 0x7fdc9415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:57.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc99a18640 1 -- 172.21.15.55:0/2082776089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc9414a9f0 msgr2=0x7fdc9414b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc99a18640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc9414a9f0 0x7fdc9414b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc99a18640 1 -- 172.21.15.55:0/2082776089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9414c190 con 0x7fdc940c9810 2023-07-06T21:59:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc99217640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc800039b0 0x7fdc9415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:59:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc98a16640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc9414a9f0 0x7fdc9414b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T21:59:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc99a18640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc940c9810 0x7fdc940c9c90 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fdc9406d4f0 tx=0x7fdc8c00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:59:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc89ffb640 1 -- 172.21.15.55:0/2082776089 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c013610 con 0x7fdc940c9810 2023-07-06T21:59:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc89ffb640 1 -- 172.21.15.55:0/2082776089 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c013790 con 0x7fdc940c9810 2023-07-06T21:59:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc89ffb640 1 -- 172.21.15.55:0/2082776089 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c013b40 con 0x7fdc940c9810 2023-07-06T21:59:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.442+0000 7fdc9b47b640 1 -- 172.21.15.55:0/2082776089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9414c470 con 0x7fdc940c9810 2023-07-06T21:59:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.446+0000 7fdc9b47b640 1 -- 172.21.15.55:0/2082776089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9414ca30 con 0x7fdc940c9810 2023-07-06T21:59:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.446+0000 7fdc9b47b640 1 -- 172.21.15.55:0/2082776089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc94066d60 con 0x7fdc940c9810 2023-07-06T21:59:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.446+0000 7fdc89ffb640 1 -- 172.21.15.55:0/2082776089 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 53) v1 ==== 85891+0+0 (secure 0 0 0) 0x7fdc8c0123b0 con 0x7fdc940c9810 2023-07-06T21:59:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.446+0000 7fdc89ffb640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fdc78066540 0x7fdc780689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.446+0000 7fdc89ffb640 1 -- 172.21.15.55:0/2082776089 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fdc8c083bc0 con 0x7fdc940c9810 2023-07-06T21:59:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.446+0000 7fdc99217640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fdc78066540 0x7fdc780689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.450+0000 7fdc99217640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fdc78066540 0x7fdc780689f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdc900ab000 tx=0x7fdc900a7070 comp rx=0 tx=0).ready entity=mgr.8268 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:59:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.450+0000 7fdc89ffb640 1 -- 172.21.15.55:0/2082776089 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc8c050a30 con 0x7fdc940c9810 2023-07-06T21:59:57.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.630+0000 7fdc9b47b640 1 -- 172.21.15.55:0/2082776089 --> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc940cd6a0 con 0x7fdc78066540 2023-07-06T21:59:57.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.634+0000 7fdc89ffb640 1 -- 172.21.15.55:0/2082776089 <== mgr.8268 v2:172.21.15.55:6832/3474707671 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7fdc90005db0 con 0x7fdc78066540 2023-07-06T21:59:57.635 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:59:57.635 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:58:56", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-07-06T21:59:57.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.638+0000 7fdc9b47b640 1 -- 172.21.15.55:0/2082776089 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fdc78066540 msgr2=0x7fdc780689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:57.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.638+0000 7fdc9b47b640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fdc78066540 0x7fdc780689f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdc900ab000 tx=0x7fdc900a7070 comp rx=0 tx=0).stop 2023-07-06T21:59:57.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.638+0000 7fdc9b47b640 1 -- 172.21.15.55:0/2082776089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc940c9810 msgr2=0x7fdc940c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.638+0000 7fdc9b47b640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc940c9810 0x7fdc940c9c90 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fdc9406d4f0 tx=0x7fdc8c00cb30 comp rx=0 tx=0).stop 2023-07-06T21:59:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.638+0000 7fdc9b47b640 1 -- 172.21.15.55:0/2082776089 shutdown_connections 2023-07-06T21:59:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.638+0000 7fdc9b47b640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc940c9810 0x7fdc940c9c90 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.638+0000 7fdc9b47b640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc9414a9f0 0x7fdc9414b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.638+0000 7fdc9b47b640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fdc78066540 0x7fdc780689f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.638+0000 7fdc9b47b640 1 --2- 172.21.15.55:0/2082776089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc800039b0 0x7fdc9415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.638+0000 7fdc9b47b640 1 -- 172.21.15.55:0/2082776089 >> 172.21.15.55:0/2082776089 conn(0x7fdc940cde30 msgr2=0x7fdc9406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:59:57.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.638+0000 7fdc9b47b640 1 -- 172.21.15.55:0/2082776089 shutdown_connections 2023-07-06T21:59:57.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.638+0000 7fdc9b47b640 1 -- 172.21.15.55:0/2082776089 wait complete. 2023-07-06T21:59:57.655 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T21:58:56", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-07-06T21:59:57.656 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-07-06T21:59:57.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.802+0000 7fedd7bc5640 1 Processor -- start 2023-07-06T21:59:57.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.802+0000 7fedd7bc5640 1 -- start start 2023-07-06T21:59:57.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.802+0000 7fedd7bc5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fedd00c9b90 0x7fedd015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:57.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.802+0000 7fedd7bc5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd00b3e70 con 0x7fedd00693f0 2023-07-06T21:59:57.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.802+0000 7fedd7bc5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd0159c30 con 0x7fedd00ccb70 2023-07-06T21:59:57.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.802+0000 7fedd7bc5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd00c9070 con 0x7fedd00c9b90 2023-07-06T21:59:57.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.802+0000 7fedd5961640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fedd00c9b90 0x7fedd015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:57.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.802+0000 7fedd5961640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fedd00c9b90 0x7fedd015dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34762/0 (socket says 172.21.15.55:34762) 2023-07-06T21:59:57.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.802+0000 7fedd5961640 1 -- 172.21.15.55:0/3077035234 learned_addr learned my addr 172.21.15.55:0/3077035234 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:59:57.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.806+0000 7fedd5961640 1 -- 172.21.15.55:0/3077035234 >> v1:172.21.15.138:6789/0 conn(0x7fedd00ccb70 legacy=0x7fedd00c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:57.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.806+0000 7fedd5961640 1 -- 172.21.15.55:0/3077035234 >> v1:172.21.15.55:6789/0 conn(0x7fedd00693f0 legacy=0x7fedd0069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:57.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.806+0000 7fedd495f640 1 -- 172.21.15.55:0/3077035234 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260950048 0 0) 0x7fedc80014a0 con 0x7fedd00693f0 2023-07-06T21:59:57.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.806+0000 7fedd5961640 1 -- 172.21.15.55:0/3077035234 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd00c8480 con 0x7fedd00c9b90 2023-07-06T21:59:57.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.806+0000 7fedd5961640 1 --2- 172.21.15.55:0/3077035234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd00c9b90 0x7fedd015dd50 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009870 tx=0x7fedcc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95da47d183db5c50 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:59:57.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.806+0000 7fedd495f640 1 -- 172.21.15.55:0/3077035234 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0ab650 con 0x7fedd00c9b90 2023-07-06T21:59:57.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.806+0000 7fedd495f640 1 -- 172.21.15.55:0/3077035234 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc0ab7b0 con 0x7fedd00c9b90 2023-07-06T21:59:57.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.806+0000 7fedd495f640 1 -- 172.21.15.55:0/3077035234 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0abb40 con 0x7fedd00c9b90 2023-07-06T21:59:57.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.806+0000 7fedd7bc5640 1 -- 172.21.15.55:0/3077035234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd00c9b90 msgr2=0x7fedd015dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:57.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.806+0000 7fedd7bc5640 1 --2- 172.21.15.55:0/3077035234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd00c9b90 0x7fedd015dd50 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009870 tx=0x7fedcc01c540 comp rx=0 tx=0).stop 2023-07-06T21:59:57.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.806+0000 7fedd7bc5640 1 -- 172.21.15.55:0/3077035234 shutdown_connections 2023-07-06T21:59:57.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.806+0000 7fedd7bc5640 1 --2- 172.21.15.55:0/3077035234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd00c9b90 0x7fedd015dd50 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:57.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.806+0000 7fedd7bc5640 1 -- 172.21.15.55:0/3077035234 >> 172.21.15.55:0/3077035234 conn(0x7fedd00cde30 msgr2=0x7fedd00ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:59:57.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd7bc5640 1 -- 172.21.15.55:0/3077035234 shutdown_connections 2023-07-06T21:59:57.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd7bc5640 1 -- 172.21.15.55:0/3077035234 wait complete. 2023-07-06T21:59:57.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd7bc5640 1 Processor -- start 2023-07-06T21:59:57.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd7bc5640 1 -- start start 2023-07-06T21:59:57.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd7bc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedd00693f0 0x7fedd0158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:57.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd7bc5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd00c9b90 0x7fedd0156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:57.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd7bc5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd00ccb70 0x7fedd00c1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:57.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd7bc5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd0159120 con 0x7fedd00c9b90 2023-07-06T21:59:57.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd7bc5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd00af3b0 con 0x7fedd00ccb70 2023-07-06T21:59:57.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd7bc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd00af690 con 0x7fedd00693f0 2023-07-06T21:59:57.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd5160640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd00c9b90 0x7fedd0156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:57.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd5160640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd00c9b90 0x7fedd0156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34768/0 (socket says 172.21.15.55:34768) 2023-07-06T21:59:57.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd5160640 1 -- 172.21.15.55:0/2893083280 learned_addr learned my addr 172.21.15.55:0/2893083280 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:59:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd6162640 1 --2- 172.21.15.55:0/2893083280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd00ccb70 0x7fedd00c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd5160640 1 -- 172.21.15.55:0/2893083280 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedd00693f0 msgr2=0x7fedd0158be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T21:59:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd5160640 1 --2- 172.21.15.55:0/2893083280 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedd00693f0 0x7fedd0158be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd5160640 1 -- 172.21.15.55:0/2893083280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd00ccb70 msgr2=0x7fedd00c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd5160640 1 --2- 172.21.15.55:0/2893083280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd00ccb70 0x7fedd00c1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd5160640 1 -- 172.21.15.55:0/2893083280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc0094d0 con 0x7fedd00c9b90 2023-07-06T21:59:57.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd5160640 1 --2- 172.21.15.55:0/2893083280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd00c9b90 0x7fedd0156d30 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fedc000c500 tx=0x7fedc000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:59:57.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedc67fc640 1 -- 172.21.15.55:0/2893083280 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0005220 con 0x7fedd00c9b90 2023-07-06T21:59:57.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedc67fc640 1 -- 172.21.15.55:0/2893083280 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc0005380 con 0x7fedd00c9b90 2023-07-06T21:59:57.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd7bc5640 1 -- 172.21.15.55:0/2893083280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd015b800 con 0x7fedd00c9b90 2023-07-06T21:59:57.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedc67fc640 1 -- 172.21.15.55:0/2893083280 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0007270 con 0x7fedd00c9b90 2023-07-06T21:59:57.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.810+0000 7fedd7bc5640 1 -- 172.21.15.55:0/2893083280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd015bdc0 con 0x7fedd00c9b90 2023-07-06T21:59:57.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.814+0000 7fedd7bc5640 1 -- 172.21.15.55:0/2893083280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd00c94e0 con 0x7fedd00c9b90 2023-07-06T21:59:57.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.814+0000 7fedc67fc640 1 -- 172.21.15.55:0/2893083280 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 53) v1 ==== 85891+0+0 (secure 0 0 0) 0x7fedc00073d0 con 0x7fedd00c9b90 2023-07-06T21:59:57.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.814+0000 7fedc67fc640 1 --2- 172.21.15.55:0/2893083280 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fedb4066540 0x7fedb40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:57.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.814+0000 7fedc67fc640 1 -- 172.21.15.55:0/2893083280 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fedc0083db0 con 0x7fedd00c9b90 2023-07-06T21:59:57.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.814+0000 7fedd5961640 1 --2- 172.21.15.55:0/2893083280 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fedb4066540 0x7fedb40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:57.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.814+0000 7fedd5961640 1 --2- 172.21.15.55:0/2893083280 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fedb4066540 0x7fedb40689f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0af000 tx=0x7fedcc008040 comp rx=0 tx=0).ready entity=mgr.8268 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:59:57.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.818+0000 7fedc67fc640 1 -- 172.21.15.55:0/2893083280 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fedd00c94e0 con 0x7fedd00c9b90 2023-07-06T21:59:57.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:57.994+0000 7fedd7bc5640 1 -- 172.21.15.55:0/2893083280 --> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7fedd006a330 con 0x7fedb4066540 2023-07-06T21:59:58.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.070+0000 7fedc67fc640 1 -- 172.21.15.55:0/2893083280 <== mgr.8268 v2:172.21.15.55:6832/3474707671 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7fedcc0ba0b0 con 0x7fedb4066540 2023-07-06T21:59:58.070 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /bad-path 2023-07-06T21:59:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.070+0000 7fedd7bc5640 1 -- 172.21.15.55:0/2893083280 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fedb4066540 msgr2=0x7fedb40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.070+0000 7fedd7bc5640 1 --2- 172.21.15.55:0/2893083280 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fedb4066540 0x7fedb40689f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0af000 tx=0x7fedcc008040 comp rx=0 tx=0).stop 2023-07-06T21:59:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.070+0000 7fedd7bc5640 1 -- 172.21.15.55:0/2893083280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd00c9b90 msgr2=0x7fedd0156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.070+0000 7fedd7bc5640 1 --2- 172.21.15.55:0/2893083280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd00c9b90 0x7fedd0156d30 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fedc000c500 tx=0x7fedc000c9c0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.070+0000 7fedd7bc5640 1 -- 172.21.15.55:0/2893083280 shutdown_connections 2023-07-06T21:59:58.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.070+0000 7fedd7bc5640 1 --2- 172.21.15.55:0/2893083280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd00ccb70 0x7fedd00c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.070+0000 7fedd7bc5640 1 --2- 172.21.15.55:0/2893083280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd00c9b90 0x7fedd0156d30 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.070+0000 7fedd7bc5640 1 --2- 172.21.15.55:0/2893083280 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7fedb4066540 0x7fedb40689f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.070+0000 7fedd7bc5640 1 --2- 172.21.15.55:0/2893083280 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedd00693f0 0x7fedd0158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.070+0000 7fedd7bc5640 1 -- 172.21.15.55:0/2893083280 >> 172.21.15.55:0/2893083280 conn(0x7fedd00cde30 msgr2=0x7fedd0154e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:59:58.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.074+0000 7fedd7bc5640 1 -- 172.21.15.55:0/2893083280 shutdown_connections 2023-07-06T21:59:58.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.074+0000 7fedd7bc5640 1 -- 172.21.15.55:0/2893083280 wait complete. 2023-07-06T21:59:58.090 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-07-06T21:59:58.091 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-06T21:59:58.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f0375648640 1 Processor -- start 2023-07-06T21:59:58.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f0375648640 1 -- start start 2023-07-06T21:59:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f0375648640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0370158850 0x7f03700cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f0375648640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0370070af0 0x7f03700ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f0375648640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0370158c20 con 0x7f03700ca130 2023-07-06T21:59:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f0375648640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03700b2aa0 con 0x7f0370070af0 2023-07-06T21:59:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f0375648640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03700c8db0 con 0x7f0370158850 2023-07-06T21:59:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f036effd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0370158850 0x7f03700cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f036f7fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0370070af0 0x7f03700ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f036effd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0370158850 0x7f03700cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:53162/0 (socket says 172.21.15.55:53162) 2023-07-06T21:59:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f036effd640 1 -- 172.21.15.55:0/3342335058 learned_addr learned my addr 172.21.15.55:0/3342335058 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:59:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f036effd640 1 -- 172.21.15.55:0/3342335058 >> v2:172.21.15.138:3300/0 conn(0x7f0370070af0 msgr2=0x7f03700ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:59:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f036effd640 1 --2- 172.21.15.55:0/3342335058 >> v2:172.21.15.138:3300/0 conn(0x7f0370070af0 0x7f03700ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f036effd640 1 -- 172.21.15.55:0/3342335058 >> v1:172.21.15.138:6789/0 conn(0x7f03700ca130 legacy=0x7f03700703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.238+0000 7f036effd640 1 -- 172.21.15.55:0/3342335058 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03700c9090 con 0x7f0370158850 2023-07-06T21:59:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.242+0000 7f036effd640 1 --2- 172.21.15.55:0/3342335058 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0370158850 0x7f03700cca30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0360009870 tx=0x7f036001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32ab818c68df0f63 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:59:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.242+0000 7f036e7fc640 1 -- 172.21.15.55:0/3342335058 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03600a8a30 con 0x7f0370158850 2023-07-06T21:59:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.242+0000 7f036e7fc640 1 -- 172.21.15.55:0/3342335058 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03600a8b90 con 0x7f0370158850 2023-07-06T21:59:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.242+0000 7f036e7fc640 1 -- 172.21.15.55:0/3342335058 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03600b0440 con 0x7f0370158850 2023-07-06T21:59:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.242+0000 7f0375648640 1 -- 172.21.15.55:0/3342335058 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0370158850 msgr2=0x7f03700cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.242+0000 7f0375648640 1 --2- 172.21.15.55:0/3342335058 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0370158850 0x7f03700cca30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0360009870 tx=0x7f036001ed30 comp rx=0 tx=0).stop 2023-07-06T21:59:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.242+0000 7f0375648640 1 -- 172.21.15.55:0/3342335058 shutdown_connections 2023-07-06T21:59:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.242+0000 7f0375648640 1 --2- 172.21.15.55:0/3342335058 >> v2:172.21.15.138:3300/0 conn(0x7f0370070af0 0x7f03700ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.242+0000 7f0375648640 1 --2- 172.21.15.55:0/3342335058 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0370158850 0x7f03700cca30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.242+0000 7f0375648640 1 -- 172.21.15.55:0/3342335058 >> 172.21.15.55:0/3342335058 conn(0x7f03700cea70 msgr2=0x7f03700ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:59:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.242+0000 7f0375648640 1 -- 172.21.15.55:0/3342335058 shutdown_connections 2023-07-06T21:59:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.242+0000 7f0375648640 1 -- 172.21.15.55:0/3342335058 wait complete. 2023-07-06T21:59:58.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f0375648640 1 Processor -- start 2023-07-06T21:59:58.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f0375648640 1 -- start start 2023-07-06T21:59:58.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f0375648640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0370070af0 0x7f03700ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:58.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f0375648640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03700ca130 0x7f037006be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:58.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f0375648640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0370158850 0x7f03701f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:58.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f0375648640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03700ae970 con 0x7f0370070af0 2023-07-06T21:59:58.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f0375648640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037006f910 con 0x7f03700ca130 2023-07-06T21:59:58.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f0375648640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03701f4aa0 con 0x7f0370158850 2023-07-06T21:59:58.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f036effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0370070af0 0x7f03700ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:58.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f036effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0370070af0 0x7f03700ad220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34784/0 (socket says 172.21.15.55:34784) 2023-07-06T21:59:58.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f036effd640 1 -- 172.21.15.55:0/2350652393 learned_addr learned my addr 172.21.15.55:0/2350652393 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:59:58.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f036f7fe640 1 --2- 172.21.15.55:0/2350652393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0370158850 0x7f03701f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:58.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f0367fff640 1 --2- 172.21.15.55:0/2350652393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03700ca130 0x7f037006be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:58.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f036effd640 1 -- 172.21.15.55:0/2350652393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0370158850 msgr2=0x7f03701f51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:58.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f036effd640 1 --2- 172.21.15.55:0/2350652393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0370158850 0x7f03701f51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f036effd640 1 -- 172.21.15.55:0/2350652393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03700ca130 msgr2=0x7f037006be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:58.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f036effd640 1 --2- 172.21.15.55:0/2350652393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03700ca130 0x7f037006be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f036effd640 1 -- 172.21.15.55:0/2350652393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03600094d0 con 0x7f0370070af0 2023-07-06T21:59:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f036effd640 1 --2- 172.21.15.55:0/2350652393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0370070af0 0x7f03700ad220 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f03600b3040 tx=0x7f036001bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:59:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f03677fe640 1 -- 172.21.15.55:0/2350652393 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03600b9620 con 0x7f0370070af0 2023-07-06T21:59:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f03677fe640 1 -- 172.21.15.55:0/2350652393 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03600b97a0 con 0x7f0370070af0 2023-07-06T21:59:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f0375648640 1 -- 172.21.15.55:0/2350652393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03701f4d40 con 0x7f0370070af0 2023-07-06T21:59:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f03677fe640 1 -- 172.21.15.55:0/2350652393 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03600b9b50 con 0x7f0370070af0 2023-07-06T21:59:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f0375648640 1 -- 172.21.15.55:0/2350652393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03700ae3b0 con 0x7f0370070af0 2023-07-06T21:59:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.246+0000 7f0375648640 1 -- 172.21.15.55:0/2350652393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0370066d60 con 0x7f0370070af0 2023-07-06T21:59:58.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.250+0000 7f03677fe640 1 -- 172.21.15.55:0/2350652393 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 53) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f03600b7070 con 0x7f0370070af0 2023-07-06T21:59:58.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.250+0000 7f03677fe640 1 --2- 172.21.15.55:0/2350652393 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f0350066510 0x7f03500689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:58.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.250+0000 7f03677fe640 1 -- 172.21.15.55:0/2350652393 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f03601223a0 con 0x7f0370070af0 2023-07-06T21:59:58.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.250+0000 7f0367fff640 1 --2- 172.21.15.55:0/2350652393 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f0350066510 0x7f03500689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:58.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.250+0000 7f0367fff640 1 --2- 172.21.15.55:0/2350652393 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f0350066510 0x7f03500689c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f03701583e0 tx=0x7f0358009040 comp rx=0 tx=0).ready entity=mgr.8268 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:59:58.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.254+0000 7f03677fe640 1 -- 172.21.15.55:0/2350652393 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f03600ef180 con 0x7f0370070af0 2023-07-06T21:59:58.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.446+0000 7f0375648640 1 -- 172.21.15.55:0/2350652393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f037006cd30 con 0x7f0370070af0 2023-07-06T21:59:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.922+0000 7f03677fe640 1 -- 172.21.15.55:0/2350652393 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f03600ef550 con 0x7f0370070af0 2023-07-06T21:59:58.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.922+0000 7f03677fe640 1 -- 172.21.15.55:0/2350652393 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v54) v1 ==== 93+0+0 (secure 0 0 0) 0x7f03600f5bb0 con 0x7f0370070af0 2023-07-06T21:59:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.926+0000 7f0375648640 1 -- 172.21.15.55:0/2350652393 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f0350066510 msgr2=0x7f03500689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.926+0000 7f0375648640 1 --2- 172.21.15.55:0/2350652393 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f0350066510 0x7f03500689c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f03701583e0 tx=0x7f0358009040 comp rx=0 tx=0).stop 2023-07-06T21:59:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.926+0000 7f0375648640 1 -- 172.21.15.55:0/2350652393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0370070af0 msgr2=0x7f03700ad220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.926+0000 7f0375648640 1 --2- 172.21.15.55:0/2350652393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0370070af0 0x7f03700ad220 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f03600b3040 tx=0x7f036001bad0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.926+0000 7f0375648640 1 -- 172.21.15.55:0/2350652393 shutdown_connections 2023-07-06T21:59:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.926+0000 7f0375648640 1 --2- 172.21.15.55:0/2350652393 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f0350066510 0x7f03500689c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.926+0000 7f0375648640 1 --2- 172.21.15.55:0/2350652393 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0370158850 0x7f03701f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.926+0000 7f0375648640 1 --2- 172.21.15.55:0/2350652393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03700ca130 0x7f037006be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.926+0000 7f0375648640 1 --2- 172.21.15.55:0/2350652393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0370070af0 0x7f03700ad220 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.926+0000 7f0375648640 1 -- 172.21.15.55:0/2350652393 >> 172.21.15.55:0/2350652393 conn(0x7f03700cea70 msgr2=0x7f037009d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:59:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.926+0000 7f0375648640 1 -- 172.21.15.55:0/2350652393 shutdown_connections 2023-07-06T21:59:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:58.926+0000 7f0375648640 1 -- 172.21.15.55:0/2350652393 wait complete. 2023-07-06T21:59:58.946 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T21:59:58.947 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:59:59.002 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T21:59:59.074 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T21:59:59.075 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:59:59.075 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:59:59.084 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T21:59:59.084 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T21:59:59.091 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:59:59.092+0000 7fa051e0a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:59:59.104 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:59:59.106+0000 7f678ba49180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T21:59:59.114 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T21:59:59.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f071d5d2640 1 Processor -- start 2023-07-06T21:59:59.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f071d5d2640 1 -- start start 2023-07-06T21:59:59.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f071d5d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f071815bc30 0x7f071806ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:59.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f071d5d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f071806f110 0x7f07180cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:59.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f071d5d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07180cfe40 con 0x7f07180cf9c0 2023-07-06T21:59:59.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f071d5d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07180cc800 con 0x7f071806f110 2023-07-06T21:59:59.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f071d5d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071806f580 con 0x7f071815bc30 2023-07-06T21:59:59.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f070ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f071806f110 0x7f07180cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:59.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f07177fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f07180cf9c0 0x7f07180ca6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60062/0 (socket says 172.21.15.55:60062) 2023-07-06T21:59:59.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f07177fe640 1 -- 172.21.15.55:0/135538791 learned_addr learned my addr 172.21.15.55:0/135538791 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T21:59:59.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f0716ffd640 1 --2- 172.21.15.55:0/135538791 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f071815bc30 0x7f071806ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:59.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f07167fc640 1 -- 172.21.15.55:0/135538791 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537566276 0 0) 0x7f07180cfe40 con 0x7f07180cf9c0 2023-07-06T21:59:59.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f07167fc640 1 -- 172.21.15.55:0/135538791 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0704003530 con 0x7f07180cf9c0 2023-07-06T21:59:59.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f070ffff640 1 -- 172.21.15.55:0/135538791 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f071815bc30 msgr2=0x7f071806ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:59:59.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f070ffff640 1 --2- 172.21.15.55:0/135538791 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f071815bc30 0x7f071806ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f070ffff640 1 -- 172.21.15.55:0/135538791 >> v1:172.21.15.55:6789/0 conn(0x7f07180cf9c0 legacy=0x7f07180ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:59.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.306+0000 7f070ffff640 1 -- 172.21.15.55:0/135538791 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071815f750 con 0x7f071806f110 2023-07-06T21:59:59.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.310+0000 7f070ffff640 1 --2- 172.21.15.55:0/135538791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806f110 0x7f07180cf480 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f07000097f0 tx=0x7f070001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adec624d3ca490d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:59:59.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.310+0000 7f07167fc640 1 -- 172.21.15.55:0/135538791 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07000ab600 con 0x7f071806f110 2023-07-06T21:59:59.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.310+0000 7f07167fc640 1 -- 172.21.15.55:0/135538791 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07000a7050 con 0x7f071806f110 2023-07-06T21:59:59.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.310+0000 7f07167fc640 1 -- 172.21.15.55:0/135538791 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07000ab960 con 0x7f071806f110 2023-07-06T21:59:59.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.310+0000 7f071d5d2640 1 -- 172.21.15.55:0/135538791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806f110 msgr2=0x7f07180cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:59.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.310+0000 7f071d5d2640 1 --2- 172.21.15.55:0/135538791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806f110 0x7f07180cf480 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f07000097f0 tx=0x7f070001c450 comp rx=0 tx=0).stop 2023-07-06T21:59:59.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.310+0000 7f071d5d2640 1 -- 172.21.15.55:0/135538791 shutdown_connections 2023-07-06T21:59:59.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.310+0000 7f071d5d2640 1 --2- 172.21.15.55:0/135538791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806f110 0x7f07180cf480 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.310+0000 7f071d5d2640 1 --2- 172.21.15.55:0/135538791 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f071815bc30 0x7f071806ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.310+0000 7f071d5d2640 1 -- 172.21.15.55:0/135538791 >> 172.21.15.55:0/135538791 conn(0x7f07180b2840 msgr2=0x7f07180d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:59:59.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.310+0000 7f071d5d2640 1 -- 172.21.15.55:0/135538791 shutdown_connections 2023-07-06T21:59:59.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.310+0000 7f071d5d2640 1 -- 172.21.15.55:0/135538791 wait complete. 2023-07-06T21:59:59.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f071d5d2640 1 Processor -- start 2023-07-06T21:59:59.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f071d5d2640 1 -- start start 2023-07-06T21:59:59.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f071d5d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806f110 0x7f071814c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:59.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f071d5d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07180cf9c0 0x7f07180c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:59.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f071d5d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f071815bc30 0x7f0718159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:59.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f071d5d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071814ee40 con 0x7f071806f110 2023-07-06T21:59:59.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f071d5d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07180c80a0 con 0x7f07180cf9c0 2023-07-06T21:59:59.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f071d5d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071814e1c0 con 0x7f071815bc30 2023-07-06T21:59:59.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f0716ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806f110 0x7f071814c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:59.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f0716ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806f110 0x7f071814c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34828/0 (socket says 172.21.15.55:34828) 2023-07-06T21:59:59.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f0716ffd640 1 -- 172.21.15.55:0/2812877890 learned_addr learned my addr 172.21.15.55:0/2812877890 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:59:59.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f070ffff640 1 --2- 172.21.15.55:0/2812877890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07180cf9c0 0x7f07180c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:59.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f07177fe640 1 --2- 172.21.15.55:0/2812877890 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f071815bc30 0x7f0718159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:59.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f0716ffd640 1 -- 172.21.15.55:0/2812877890 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f071815bc30 msgr2=0x7f0718159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:59.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f0716ffd640 1 --2- 172.21.15.55:0/2812877890 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f071815bc30 0x7f0718159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f0716ffd640 1 -- 172.21.15.55:0/2812877890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07180cf9c0 msgr2=0x7f07180c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:59.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f0716ffd640 1 --2- 172.21.15.55:0/2812877890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07180cf9c0 0x7f07180c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f0716ffd640 1 -- 172.21.15.55:0/2812877890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700009420 con 0x7f071806f110 2023-07-06T21:59:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f0716ffd640 1 --2- 172.21.15.55:0/2812877890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806f110 0x7f071814c680 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f070800e870 tx=0x7f070800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:59:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f070f7fe640 1 -- 172.21.15.55:0/2812877890 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708009510 con 0x7f071806f110 2023-07-06T21:59:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f070f7fe640 1 -- 172.21.15.55:0/2812877890 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070800eec0 con 0x7f071806f110 2023-07-06T21:59:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f070f7fe640 1 -- 172.21.15.55:0/2812877890 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070800cb40 con 0x7f071806f110 2023-07-06T21:59:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f071d5d2640 1 -- 172.21.15.55:0/2812877890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071814e4a0 con 0x7f071806f110 2023-07-06T21:59:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.314+0000 7f071d5d2640 1 -- 172.21.15.55:0/2812877890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071814ea60 con 0x7f071806f110 2023-07-06T21:59:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.318+0000 7f071d5d2640 1 -- 172.21.15.55:0/2812877890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071814cbc0 con 0x7f071806f110 2023-07-06T21:59:59.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.318+0000 7f070f7fe640 1 -- 172.21.15.55:0/2812877890 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f070800cca0 con 0x7f071806f110 2023-07-06T21:59:59.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.318+0000 7f070f7fe640 1 --2- 172.21.15.55:0/2812877890 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f06f80664c0 0x7f06f8068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:59.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.318+0000 7f070f7fe640 1 -- 172.21.15.55:0/2812877890 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f0708084cc0 con 0x7f071806f110 2023-07-06T21:59:59.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.318+0000 7f070ffff640 1 -- 172.21.15.55:0/2812877890 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f06f80664c0 msgr2=0x7f06f8068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3474707671 2023-07-06T21:59:59.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.318+0000 7f070ffff640 1 --2- 172.21.15.55:0/2812877890 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f06f80664c0 0x7f06f8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:59:59.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.322+0000 7f070f7fe640 1 -- 172.21.15.55:0/2812877890 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0708051bd0 con 0x7f071806f110 2023-07-06T21:59:59.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.478+0000 7f071d5d2640 1 -- 172.21.15.55:0/2812877890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0718066d60 con 0x7f071806f110 2023-07-06T21:59:59.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.478+0000 7f070f7fe640 1 -- 172.21.15.55:0/2812877890 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+18991 (secure 0 0 0) 0x7f0708017090 con 0x7f071806f110 2023-07-06T21:59:59.480 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T21:59:59.480 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":118,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:58:55.799319+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:58:37.143680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-07-06T21:58:38.234438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/2589708229":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/782998468":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/4121483447":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/1183916649":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/11434186":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/494913604":"2023-07-07T21:58:55.799288+0000","172.21.15.55:6833/1408736549":"2023-07-07T21:58:55.799288+0000","172.21.15.55:6832/1408736549":"2023-07-07T21:58:55.799288+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T21:59:59.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.482+0000 7f071d5d2640 1 -- 172.21.15.55:0/2812877890 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f06f80664c0 msgr2=0x7f06f8068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:59:59.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.482+0000 7f071d5d2640 1 --2- 172.21.15.55:0/2812877890 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f06f80664c0 0x7f06f8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.482+0000 7f071d5d2640 1 -- 172.21.15.55:0/2812877890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806f110 msgr2=0x7f071814c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:59.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.482+0000 7f071d5d2640 1 --2- 172.21.15.55:0/2812877890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806f110 0x7f071814c680 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f070800e870 tx=0x7f070800ec70 comp rx=0 tx=0).stop 2023-07-06T21:59:59.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.482+0000 7f071d5d2640 1 -- 172.21.15.55:0/2812877890 shutdown_connections 2023-07-06T21:59:59.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.482+0000 7f071d5d2640 1 --2- 172.21.15.55:0/2812877890 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f06f80664c0 0x7f06f8068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.482+0000 7f071d5d2640 1 --2- 172.21.15.55:0/2812877890 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f071815bc30 0x7f0718159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.482+0000 7f071d5d2640 1 --2- 172.21.15.55:0/2812877890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07180cf9c0 0x7f07180c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.482+0000 7f071d5d2640 1 --2- 172.21.15.55:0/2812877890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806f110 0x7f071814c680 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.482+0000 7f071d5d2640 1 -- 172.21.15.55:0/2812877890 >> 172.21.15.55:0/2812877890 conn(0x7f07180b2840 msgr2=0x7f07180b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:59:59.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.482+0000 7f071d5d2640 1 -- 172.21.15.55:0/2812877890 shutdown_connections 2023-07-06T21:59:59.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.482+0000 7f071d5d2640 1 -- 172.21.15.55:0/2812877890 wait complete. 2023-07-06T21:59:59.503 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:58:37.143680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:58:38.234438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T21:59:59.504 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T21:59:59.510 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:59:59.512+0000 7fa051e0a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:59:59.560 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:59:59.562+0000 7f678ba49180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T21:59:59.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.650+0000 7f0af7896640 1 Processor -- start 2023-07-06T21:59:59.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af7896640 1 -- start start 2023-07-06T21:59:59.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af7896640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0af015b850 0x7f0af00cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:59.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af7896640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0af00ccd30 0x7f0af00b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:59.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af7896640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0af00b3db0 0x7f0af015f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:59.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af7896640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af00b4210 con 0x7f0af015b850 2023-07-06T21:59:59.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af7896640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af00b2b80 con 0x7f0af00ccd30 2023-07-06T21:59:59.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af7896640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00cff30 con 0x7f0af00b3db0 2023-07-06T21:59:59.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af5632640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0af015b850 0x7f0af00cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:59.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af5632640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0af015b850 0x7f0af00cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34834/0 (socket says 172.21.15.55:34834) 2023-07-06T21:59:59.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af5632640 1 -- 172.21.15.55:0/2019182768 learned_addr learned my addr 172.21.15.55:0/2019182768 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:59:59.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af5e33640 1 --2- 172.21.15.55:0/2019182768 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0af00b3db0 0x7f0af015f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:59.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af5632640 1 -- 172.21.15.55:0/2019182768 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0af00b3db0 msgr2=0x7f0af015f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:59:59.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af5632640 1 --2- 172.21.15.55:0/2019182768 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0af00b3db0 0x7f0af015f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af5632640 1 -- 172.21.15.55:0/2019182768 >> v2:172.21.15.138:3300/0 conn(0x7f0af00ccd30 msgr2=0x7f0af00b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T21:59:59.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af5632640 1 --2- 172.21.15.55:0/2019182768 >> v2:172.21.15.138:3300/0 conn(0x7f0af00ccd30 0x7f0af00b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.654+0000 7f0af5632640 1 -- 172.21.15.55:0/2019182768 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00b22e0 con 0x7f0af015b850 2023-07-06T21:59:59.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.658+0000 7f0af5632640 1 --2- 172.21.15.55:0/2019182768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af015b850 0x7f0af00cc7f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f0af00cebd0 tx=0x7f0aec01c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf00547f01a7cb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:59:59.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.658+0000 7f0ae7fff640 1 -- 172.21.15.55:0/2019182768 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0ab600 con 0x7f0af015b850 2023-07-06T21:59:59.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.658+0000 7f0ae7fff640 1 -- 172.21.15.55:0/2019182768 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec0a7050 con 0x7f0af015b850 2023-07-06T21:59:59.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.658+0000 7f0ae7fff640 1 -- 172.21.15.55:0/2019182768 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0ab980 con 0x7f0af015b850 2023-07-06T21:59:59.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.658+0000 7f0af7896640 1 -- 172.21.15.55:0/2019182768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af015b850 msgr2=0x7f0af00cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:59.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.658+0000 7f0af7896640 1 --2- 172.21.15.55:0/2019182768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af015b850 0x7f0af00cc7f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f0af00cebd0 tx=0x7f0aec01c0f0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.658+0000 7f0af7896640 1 -- 172.21.15.55:0/2019182768 shutdown_connections 2023-07-06T21:59:59.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.658+0000 7f0af7896640 1 --2- 172.21.15.55:0/2019182768 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0af00b3db0 0x7f0af015f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.658+0000 7f0af7896640 1 --2- 172.21.15.55:0/2019182768 >> v2:172.21.15.138:3300/0 conn(0x7f0af00ccd30 0x7f0af00b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.658+0000 7f0af7896640 1 --2- 172.21.15.55:0/2019182768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af015b850 0x7f0af00cc7f0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.658+0000 7f0af7896640 1 -- 172.21.15.55:0/2019182768 >> 172.21.15.55:0/2019182768 conn(0x7f0af00cec20 msgr2=0x7f0af00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:59:59.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.658+0000 7f0af7896640 1 -- 172.21.15.55:0/2019182768 shutdown_connections 2023-07-06T21:59:59.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.658+0000 7f0af7896640 1 -- 172.21.15.55:0/2019182768 wait complete. 2023-07-06T21:59:59.660 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T21:59:59.660+0000 7fa051e0a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:59:59.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af7896640 1 Processor -- start 2023-07-06T21:59:59.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af7896640 1 -- start start 2023-07-06T21:59:59.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af7896640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0af00b3db0 0x7f0af0152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:59.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af7896640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0af00ccd30 0x7f0af0156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:59.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af7896640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af015b850 0x7f0af0153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:59.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af7896640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00b7790 con 0x7f0af015b850 2023-07-06T21:59:59.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af7896640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00b71d0 con 0x7f0af00b3db0 2023-07-06T21:59:59.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af7896640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00b74b0 con 0x7f0af00ccd30 2023-07-06T21:59:59.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af5e33640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af015b850 0x7f0af0153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:59.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af5e33640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af015b850 0x7f0af0153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34850/0 (socket says 172.21.15.55:34850) 2023-07-06T21:59:59.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af5e33640 1 -- 172.21.15.55:0/1446631933 learned_addr learned my addr 172.21.15.55:0/1446631933 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T21:59:59.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af5632640 1 --2- 172.21.15.55:0/1446631933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0af00b3db0 0x7f0af0152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:59.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af4e31640 1 --2- 172.21.15.55:0/1446631933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0af00ccd30 0x7f0af0156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T21:59:59.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af5e33640 1 -- 172.21.15.55:0/1446631933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0af00ccd30 msgr2=0x7f0af0156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:59.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af5e33640 1 --2- 172.21.15.55:0/1446631933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0af00ccd30 0x7f0af0156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af5e33640 1 -- 172.21.15.55:0/1446631933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0af00b3db0 msgr2=0x7f0af0152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:59.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af5e33640 1 --2- 172.21.15.55:0/1446631933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0af00b3db0 0x7f0af0152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af5e33640 1 -- 172.21.15.55:0/1446631933 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec0094d0 con 0x7f0af015b850 2023-07-06T21:59:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af5e33640 1 --2- 172.21.15.55:0/1446631933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af015b850 0x7f0af0153320 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800efc0 tx=0x7f0ae800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T21:59:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0ae5ffb640 1 -- 172.21.15.55:0/1446631933 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8014480 con 0x7f0af015b850 2023-07-06T21:59:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0ae5ffb640 1 -- 172.21.15.55:0/1446631933 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae800f040 con 0x7f0af015b850 2023-07-06T21:59:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af7896640 1 -- 172.21.15.55:0/1446631933 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af015bda0 con 0x7f0af015b850 2023-07-06T21:59:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0ae5ffb640 1 -- 172.21.15.55:0/1446631933 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8014820 con 0x7f0af015b850 2023-07-06T21:59:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.662+0000 7f0af7896640 1 -- 172.21.15.55:0/1446631933 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af0155ff0 con 0x7f0af015b850 2023-07-06T21:59:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.666+0000 7f0af7896640 1 -- 172.21.15.55:0/1446631933 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af0156210 con 0x7f0af015b850 2023-07-06T21:59:59.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.666+0000 7f0ae5ffb640 1 -- 172.21.15.55:0/1446631933 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f0ae8014980 con 0x7f0af015b850 2023-07-06T21:59:59.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.666+0000 7f0ae5ffb640 1 --2- 172.21.15.55:0/1446631933 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f0ad40664c0 0x7f0ad4068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T21:59:59.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.666+0000 7f0af5632640 1 -- 172.21.15.55:0/1446631933 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f0ad40664c0 msgr2=0x7f0ad4068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3474707671 2023-07-06T21:59:59.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.666+0000 7f0ae5ffb640 1 -- 172.21.15.55:0/1446631933 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f0ae8084f90 con 0x7f0af015b850 2023-07-06T21:59:59.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.666+0000 7f0af5632640 1 --2- 172.21.15.55:0/1446631933 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f0ad40664c0 0x7f0ad4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T21:59:59.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.670+0000 7f0ae5ffb640 1 -- 172.21.15.55:0/1446631933 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ae8051da0 con 0x7f0af015b850 2023-07-06T21:59:59.726 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T21:59:59.726+0000 7f678ba49180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T21:59:59.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.830+0000 7f0af7896640 1 -- 172.21.15.55:0/1446631933 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0af0066d60 con 0x7f0af015b850 2023-07-06T21:59:59.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.830+0000 7f0ae5ffb640 1 -- 172.21.15.55:0/1446631933 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ae80180a0 con 0x7f0af015b850 2023-07-06T21:59:59.831 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T21:59:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.834+0000 7f0af7896640 1 -- 172.21.15.55:0/1446631933 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f0ad40664c0 msgr2=0x7f0ad4068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T21:59:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.834+0000 7f0af7896640 1 --2- 172.21.15.55:0/1446631933 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f0ad40664c0 0x7f0ad4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.834+0000 7f0af7896640 1 -- 172.21.15.55:0/1446631933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af015b850 msgr2=0x7f0af0153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T21:59:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.834+0000 7f0af7896640 1 --2- 172.21.15.55:0/1446631933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af015b850 0x7f0af0153320 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800efc0 tx=0x7f0ae800c490 comp rx=0 tx=0).stop 2023-07-06T21:59:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.834+0000 7f0af7896640 1 -- 172.21.15.55:0/1446631933 shutdown_connections 2023-07-06T21:59:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.834+0000 7f0af7896640 1 --2- 172.21.15.55:0/1446631933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af015b850 0x7f0af0153320 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.834+0000 7f0af7896640 1 --2- 172.21.15.55:0/1446631933 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f0ad40664c0 0x7f0ad4068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.834+0000 7f0af7896640 1 --2- 172.21.15.55:0/1446631933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0af00ccd30 0x7f0af0156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.834+0000 7f0af7896640 1 --2- 172.21.15.55:0/1446631933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0af00b3db0 0x7f0af0152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T21:59:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.834+0000 7f0af7896640 1 -- 172.21.15.55:0/1446631933 >> 172.21.15.55:0/1446631933 conn(0x7f0af00cec20 msgr2=0x7f0af00ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T21:59:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.834+0000 7f0af7896640 1 -- 172.21.15.55:0/1446631933 shutdown_connections 2023-07-06T21:59:59.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.834+0000 7f0af7896640 1 -- 172.21.15.55:0/1446631933 wait complete. 2023-07-06T21:59:59.853 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T21:59:59.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.998+0000 7f1a5b219640 1 Processor -- start 2023-07-06T21:59:59.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T21:59:59.998+0000 7f1a5b219640 1 -- start start 2023-07-06T22:00:00.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.002+0000 7f1a5b219640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a541646a0 0x7f1a54166a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.002+0000 7f1a5b219640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a540cc740 con 0x7f1a540b1250 2023-07-06T22:00:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.002+0000 7f1a5b219640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a541601a0 con 0x7f1a540d0630 2023-07-06T22:00:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.002+0000 7f1a5b219640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540ccc90 con 0x7f1a541646a0 2023-07-06T22:00:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.002+0000 7f1a5a217640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1a540b1250 0x7f1a5415f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60072/0 (socket says 172.21.15.55:60072) 2023-07-06T22:00:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.002+0000 7f1a5a217640 1 -- 172.21.15.55:0/1179183482 learned_addr learned my addr 172.21.15.55:0/1179183482 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.002+0000 7f1a5aa18640 1 --2- 172.21.15.55:0/1179183482 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a541646a0 0x7f1a54166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.002+0000 7f1a59215640 1 -- 172.21.15.55:0/1179183482 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119252403 0 0) 0x7f1a540cc740 con 0x7f1a540b1250 2023-07-06T22:00:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.002+0000 7f1a59215640 1 -- 172.21.15.55:0/1179183482 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a40003530 con 0x7f1a540b1250 2023-07-06T22:00:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.002+0000 7f1a59215640 1 -- 172.21.15.55:0/1179183482 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133189478 0 0) 0x7f1a541601a0 con 0x7f1a540d0630 2023-07-06T22:00:00.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.002+0000 7f1a59215640 1 -- 172.21.15.55:0/1179183482 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a540cc740 con 0x7f1a540d0630 2023-07-06T22:00:00.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.002+0000 7f1a5aa18640 1 -- 172.21.15.55:0/1179183482 >> v1:172.21.15.138:6789/0 conn(0x7f1a540d0630 legacy=0x7f1a5415fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.002+0000 7f1a5aa18640 1 -- 172.21.15.55:0/1179183482 >> v1:172.21.15.55:6789/0 conn(0x7f1a540b1250 legacy=0x7f1a5415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.002+0000 7f1a5aa18640 1 -- 172.21.15.55:0/1179183482 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a540b29c0 con 0x7f1a541646a0 2023-07-06T22:00:00.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.006+0000 7f1a5aa18640 1 --2- 172.21.15.55:0/1179183482 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a541646a0 0x7f1a54166a80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009dc0 tx=0x7f1a4c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f596e8d336e7a57 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:00.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.006+0000 7f1a59215640 1 -- 172.21.15.55:0/1179183482 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0a5920 con 0x7f1a541646a0 2023-07-06T22:00:00.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.006+0000 7f1a59215640 1 -- 172.21.15.55:0/1179183482 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c0a5a80 con 0x7f1a541646a0 2023-07-06T22:00:00.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.006+0000 7f1a59215640 1 -- 172.21.15.55:0/1179183482 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0a5e10 con 0x7f1a541646a0 2023-07-06T22:00:00.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.006+0000 7f1a5b219640 1 -- 172.21.15.55:0/1179183482 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a541646a0 msgr2=0x7f1a54166a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.006+0000 7f1a5b219640 1 --2- 172.21.15.55:0/1179183482 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a541646a0 0x7f1a54166a80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009dc0 tx=0x7f1a4c01c970 comp rx=0 tx=0).stop 2023-07-06T22:00:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.006+0000 7f1a5b219640 1 -- 172.21.15.55:0/1179183482 shutdown_connections 2023-07-06T22:00:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.006+0000 7f1a5b219640 1 --2- 172.21.15.55:0/1179183482 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a541646a0 0x7f1a54166a80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.006+0000 7f1a5b219640 1 -- 172.21.15.55:0/1179183482 >> 172.21.15.55:0/1179183482 conn(0x7f1a540b3b60 msgr2=0x7f1a540b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.006+0000 7f1a5b219640 1 -- 172.21.15.55:0/1179183482 shutdown_connections 2023-07-06T22:00:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.006+0000 7f1a5b219640 1 -- 172.21.15.55:0/1179183482 wait complete. 2023-07-06T22:00:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.006+0000 7f1a5b219640 1 Processor -- start 2023-07-06T22:00:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.006+0000 7f1a5b219640 1 -- start start 2023-07-06T22:00:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5b219640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a540b1250 0x7f1a5414c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5b219640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a540d0630 0x7f1a5414a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5b219640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a541646a0 0x7f1a54149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5b219640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a541546d0 con 0x7f1a541646a0 2023-07-06T22:00:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5b219640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54154930 con 0x7f1a540b1250 2023-07-06T22:00:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5b219640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540c8a30 con 0x7f1a540d0630 2023-07-06T22:00:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5aa18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a541646a0 0x7f1a54149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5aa18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a541646a0 0x7f1a54149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34862/0 (socket says 172.21.15.55:34862) 2023-07-06T22:00:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5aa18640 1 -- 172.21.15.55:0/2236964783 learned_addr learned my addr 172.21.15.55:0/2236964783 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a59a16640 1 --2- 172.21.15.55:0/2236964783 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a540d0630 0x7f1a5414a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:00.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5a217640 1 --2- 172.21.15.55:0/2236964783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a540b1250 0x7f1a5414c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:00.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5aa18640 1 -- 172.21.15.55:0/2236964783 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a540d0630 msgr2=0x7f1a5414a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5aa18640 1 --2- 172.21.15.55:0/2236964783 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a540d0630 0x7f1a5414a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5aa18640 1 -- 172.21.15.55:0/2236964783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a540b1250 msgr2=0x7f1a5414c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5aa18640 1 --2- 172.21.15.55:0/2236964783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a540b1250 0x7f1a5414c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5aa18640 1 -- 172.21.15.55:0/2236964783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c009a70 con 0x7f1a541646a0 2023-07-06T22:00:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5aa18640 1 --2- 172.21.15.55:0/2236964783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a541646a0 0x7f1a54149b80 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c019580 tx=0x7f1a4c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a4affd640 1 -- 172.21.15.55:0/2236964783 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0adcc0 con 0x7f1a541646a0 2023-07-06T22:00:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a4affd640 1 -- 172.21.15.55:0/2236964783 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c0ade20 con 0x7f1a541646a0 2023-07-06T22:00:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a4affd640 1 -- 172.21.15.55:0/2236964783 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0b9690 con 0x7f1a541646a0 2023-07-06T22:00:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5b219640 1 -- 172.21.15.55:0/2236964783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a541543f0 con 0x7f1a541646a0 2023-07-06T22:00:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5b219640 1 -- 172.21.15.55:0/2236964783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a54158640 con 0x7f1a541646a0 2023-07-06T22:00:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a5b219640 1 -- 172.21.15.55:0/2236964783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a54154ae0 con 0x7f1a541646a0 2023-07-06T22:00:00.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.010+0000 7f1a4affd640 1 -- 172.21.15.55:0/2236964783 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f1a4c0b97f0 con 0x7f1a541646a0 2023-07-06T22:00:00.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.014+0000 7f1a4affd640 1 --2- 172.21.15.55:0/2236964783 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f1a380664f0 0x7f1a380689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.014+0000 7f1a4affd640 1 -- 172.21.15.55:0/2236964783 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f1a4c11f340 con 0x7f1a541646a0 2023-07-06T22:00:00.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.014+0000 7f1a5a217640 1 -- 172.21.15.55:0/2236964783 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f1a380664f0 msgr2=0x7f1a380689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3474707671 2023-07-06T22:00:00.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.014+0000 7f1a5a217640 1 --2- 172.21.15.55:0/2236964783 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f1a380664f0 0x7f1a380689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:00:00.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.018+0000 7f1a4affd640 1 -- 172.21.15.55:0/2236964783 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a54154ae0 con 0x7f1a541646a0 2023-07-06T22:00:00.140 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:00.140+0000 7fa051e0a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:00:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.174+0000 7f1a5b219640 1 -- 172.21.15.55:0/2236964783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1a54154aa0 con 0x7f1a541646a0 2023-07-06T22:00:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.174+0000 7f1a4affd640 1 -- 172.21.15.55:0/2236964783 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1a4c0ec320 con 0x7f1a541646a0 2023-07-06T22:00:00.173 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:00:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.174+0000 7f1a5b219640 1 -- 172.21.15.55:0/2236964783 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f1a380664f0 msgr2=0x7f1a380689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:00:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.174+0000 7f1a5b219640 1 --2- 172.21.15.55:0/2236964783 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f1a380664f0 0x7f1a380689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.174+0000 7f1a5b219640 1 -- 172.21.15.55:0/2236964783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a541646a0 msgr2=0x7f1a54149b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.174+0000 7f1a5b219640 1 --2- 172.21.15.55:0/2236964783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a541646a0 0x7f1a54149b80 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c019580 tx=0x7f1a4c019710 comp rx=0 tx=0).stop 2023-07-06T22:00:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.174+0000 7f1a5b219640 1 -- 172.21.15.55:0/2236964783 shutdown_connections 2023-07-06T22:00:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.174+0000 7f1a5b219640 1 --2- 172.21.15.55:0/2236964783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a541646a0 0x7f1a54149b80 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.174+0000 7f1a5b219640 1 --2- 172.21.15.55:0/2236964783 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f1a380664f0 0x7f1a380689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.174+0000 7f1a5b219640 1 --2- 172.21.15.55:0/2236964783 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a540d0630 0x7f1a5414a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.174+0000 7f1a5b219640 1 --2- 172.21.15.55:0/2236964783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a540b1250 0x7f1a5414c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.174+0000 7f1a5b219640 1 -- 172.21.15.55:0/2236964783 >> 172.21.15.55:0/2236964783 conn(0x7f1a540b3b60 msgr2=0x7f1a540ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.174+0000 7f1a5b219640 1 -- 172.21.15.55:0/2236964783 shutdown_connections 2023-07-06T22:00:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.174+0000 7f1a5b219640 1 -- 172.21.15.55:0/2236964783 wait complete. 2023-07-06T22:00:00.195 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T22:00:00.197 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:00.200+0000 7fa051e0a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:00:00.245 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:00.246+0000 7f678ba49180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:00:00.253 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:00.256+0000 7fa051e0a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:00:00.308 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:00.310+0000 7f678ba49180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:00:00.339 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:00.340+0000 7fa051e0a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:00:00.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.346+0000 7f0447e34640 1 Processor -- start 2023-07-06T22:00:00.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.346+0000 7f0447e34640 1 -- start start 2023-07-06T22:00:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.346+0000 7f0447e34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04400b3cd0 0x7f04400d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.346+0000 7f0447e34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04400b2b80 con 0x7f044015b850 2023-07-06T22:00:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.346+0000 7f0447e34640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04400cff30 con 0x7f04400b3870 2023-07-06T22:00:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.346+0000 7f0447e34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04400b22e0 con 0x7f04400b3cd0 2023-07-06T22:00:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.346+0000 7f0445bd0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f044015b850 0x7f04400cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60074/0 (socket says 172.21.15.55:60074) 2023-07-06T22:00:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.346+0000 7f0445bd0640 1 -- 172.21.15.55:0/2435763864 learned_addr learned my addr 172.21.15.55:0/2435763864 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.346+0000 7f04463d1640 1 --2- 172.21.15.55:0/2435763864 >> v2:172.21.15.55:3300/0 conn(0x7f04400b3cd0 0x7f04400d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.346+0000 7f0444bce640 1 -- 172.21.15.55:0/2435763864 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401098418 0 0) 0x7f04400b2b80 con 0x7f044015b850 2023-07-06T22:00:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.346+0000 7f0444bce640 1 -- 172.21.15.55:0/2435763864 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f042c003530 con 0x7f044015b850 2023-07-06T22:00:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.346+0000 7f04463d1640 1 -- 172.21.15.55:0/2435763864 >> v1:172.21.15.138:6789/0 conn(0x7f04400b3870 legacy=0x7f04400d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.346+0000 7f04463d1640 1 -- 172.21.15.55:0/2435763864 >> v1:172.21.15.55:6789/0 conn(0x7f044015b850 legacy=0x7f04400cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.346+0000 7f04463d1640 1 -- 172.21.15.55:0/2435763864 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04400b25c0 con 0x7f04400b3cd0 2023-07-06T22:00:00.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.350+0000 7f04463d1640 1 --2- 172.21.15.55:0/2435763864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04400b3cd0 0x7f04400d0ad0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f0438009d90 tx=0x7f043801c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ae8dc177004c82 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:00.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.350+0000 7f0444bce640 1 -- 172.21.15.55:0/2435763864 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04380a5880 con 0x7f04400b3cd0 2023-07-06T22:00:00.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.350+0000 7f0444bce640 1 -- 172.21.15.55:0/2435763864 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04380a59e0 con 0x7f04400b3cd0 2023-07-06T22:00:00.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.350+0000 7f0444bce640 1 -- 172.21.15.55:0/2435763864 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04380a5d70 con 0x7f04400b3cd0 2023-07-06T22:00:00.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.350+0000 7f0447e34640 1 -- 172.21.15.55:0/2435763864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04400b3cd0 msgr2=0x7f04400d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.350+0000 7f0447e34640 1 --2- 172.21.15.55:0/2435763864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04400b3cd0 0x7f04400d0ad0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f0438009d90 tx=0x7f043801c800 comp rx=0 tx=0).stop 2023-07-06T22:00:00.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.350+0000 7f0447e34640 1 -- 172.21.15.55:0/2435763864 shutdown_connections 2023-07-06T22:00:00.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.350+0000 7f0447e34640 1 --2- 172.21.15.55:0/2435763864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04400b3cd0 0x7f04400d0ad0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.350+0000 7f0447e34640 1 -- 172.21.15.55:0/2435763864 >> 172.21.15.55:0/2435763864 conn(0x7f04400cec20 msgr2=0x7f04400cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:00.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.350+0000 7f0447e34640 1 -- 172.21.15.55:0/2435763864 shutdown_connections 2023-07-06T22:00:00.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.350+0000 7f0447e34640 1 -- 172.21.15.55:0/2435763864 wait complete. 2023-07-06T22:00:00.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f0447e34640 1 Processor -- start 2023-07-06T22:00:00.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f0447e34640 1 -- start start 2023-07-06T22:00:00.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f0447e34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04400b3870 0x7f0440153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f0447e34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04400b3cd0 0x7f04400cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f0447e34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f044015b850 0x7f0440147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f0447e34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044014b350 con 0x7f04400b3cd0 2023-07-06T22:00:00.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f0447e34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0440151280 con 0x7f04400b3870 2023-07-06T22:00:00.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f0447e34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0440151520 con 0x7f044015b850 2023-07-06T22:00:00.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f04453cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04400b3cd0 0x7f04400cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:00.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f04453cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04400b3cd0 0x7f04400cbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34882/0 (socket says 172.21.15.55:34882) 2023-07-06T22:00:00.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f04453cf640 1 -- 172.21.15.55:0/458206335 learned_addr learned my addr 172.21.15.55:0/458206335 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:00.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f0445bd0640 1 --2- 172.21.15.55:0/458206335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04400b3870 0x7f0440153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:00.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f04463d1640 1 --2- 172.21.15.55:0/458206335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f044015b850 0x7f0440147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:00.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f04453cf640 1 -- 172.21.15.55:0/458206335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f044015b850 msgr2=0x7f0440147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f04453cf640 1 --2- 172.21.15.55:0/458206335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f044015b850 0x7f0440147cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f04453cf640 1 -- 172.21.15.55:0/458206335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04400b3870 msgr2=0x7f0440153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f04453cf640 1 --2- 172.21.15.55:0/458206335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04400b3870 0x7f0440153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f04453cf640 1 -- 172.21.15.55:0/458206335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0438009a70 con 0x7f04400b3cd0 2023-07-06T22:00:00.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f04463d1640 1 --2- 172.21.15.55:0/458206335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f044015b850 0x7f0440147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:00.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f04453cf640 1 --2- 172.21.15.55:0/458206335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04400b3cd0 0x7f04400cbbb0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f043000c3c0 tx=0x7f043000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:00.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f04367fc640 1 -- 172.21.15.55:0/458206335 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04300052d0 con 0x7f04400b3cd0 2023-07-06T22:00:00.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f04367fc640 1 -- 172.21.15.55:0/458206335 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0430005430 con 0x7f04400b3cd0 2023-07-06T22:00:00.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f04367fc640 1 -- 172.21.15.55:0/458206335 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430003840 con 0x7f04400b3cd0 2023-07-06T22:00:00.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f0447e34640 1 -- 172.21.15.55:0/458206335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0440151800 con 0x7f04400b3cd0 2023-07-06T22:00:00.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f0447e34640 1 -- 172.21.15.55:0/458206335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0440151dc0 con 0x7f04400b3cd0 2023-07-06T22:00:00.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.354+0000 7f0447e34640 1 -- 172.21.15.55:0/458206335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0440066d60 con 0x7f04400b3cd0 2023-07-06T22:00:00.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.358+0000 7f04367fc640 1 -- 172.21.15.55:0/458206335 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f04300039a0 con 0x7f04400b3cd0 2023-07-06T22:00:00.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.358+0000 7f04367fc640 1 --2- 172.21.15.55:0/458206335 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f04240664c0 0x7f0424068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.358+0000 7f04367fc640 1 -- 172.21.15.55:0/458206335 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f04300837e0 con 0x7f04400b3cd0 2023-07-06T22:00:00.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.358+0000 7f0445bd0640 1 -- 172.21.15.55:0/458206335 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f04240664c0 msgr2=0x7f0424068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3474707671 2023-07-06T22:00:00.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.358+0000 7f0445bd0640 1 --2- 172.21.15.55:0/458206335 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f04240664c0 0x7f0424068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:00:00.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.362+0000 7f04367fc640 1 -- 172.21.15.55:0/458206335 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04300507c0 con 0x7f04400b3cd0 2023-07-06T22:00:00.377 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:00.378+0000 7f678ba49180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:00:00.398 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:00.400+0000 7fa051e0a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:00:00.474 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:00.474+0000 7f678ba49180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:00:00.482 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:00.484+0000 7fa051e0a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:00:00.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f0447e34640 1 -- 172.21.15.55:0/458206335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04400b7f70 con 0x7f04400b3cd0 2023-07-06T22:00:00.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f04367fc640 1 -- 172.21.15.55:0/458206335 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0430053de0 con 0x7f04400b3cd0 2023-07-06T22:00:00.533 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T22:00:00.534 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f678ba49180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:00:00.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f0447e34640 1 -- 172.21.15.55:0/458206335 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f04240664c0 msgr2=0x7f0424068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:00:00.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f0447e34640 1 --2- 172.21.15.55:0/458206335 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f04240664c0 0x7f0424068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f0447e34640 1 -- 172.21.15.55:0/458206335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04400b3cd0 msgr2=0x7f04400cbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f0447e34640 1 --2- 172.21.15.55:0/458206335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04400b3cd0 0x7f04400cbbb0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f043000c3c0 tx=0x7f043000c880 comp rx=0 tx=0).stop 2023-07-06T22:00:00.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f0447e34640 1 -- 172.21.15.55:0/458206335 shutdown_connections 2023-07-06T22:00:00.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f0447e34640 1 --2- 172.21.15.55:0/458206335 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f04240664c0 0x7f0424068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f0447e34640 1 --2- 172.21.15.55:0/458206335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f044015b850 0x7f0440147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f0447e34640 1 --2- 172.21.15.55:0/458206335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04400b3cd0 0x7f04400cbbb0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f0447e34640 1 --2- 172.21.15.55:0/458206335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04400b3870 0x7f0440153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f0447e34640 1 -- 172.21.15.55:0/458206335 >> 172.21.15.55:0/458206335 conn(0x7f04400cec20 msgr2=0x7f04400b77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:00.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f0447e34640 1 -- 172.21.15.55:0/458206335 shutdown_connections 2023-07-06T22:00:00.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.534+0000 7f0447e34640 1 -- 172.21.15.55:0/458206335 wait complete. 2023-07-06T22:00:00.537 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:00.540+0000 7fa051e0a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:00:00.555 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T22:00:00.626 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:00.626+0000 7f678ba49180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:00:00.678 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:00.680+0000 7fa051e0a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:00:00.687 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:00.686+0000 7f678ba49180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:00:00.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.702+0000 7f32f272c640 1 Processor -- start 2023-07-06T22:00:00.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.702+0000 7f32f272c640 1 -- start start 2023-07-06T22:00:00.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.706+0000 7f32f272c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f32ec0b3cd0 0x7f32ec0d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.706+0000 7f32f272c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ec0b2b80 con 0x7f32ec0b3870 2023-07-06T22:00:00.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.706+0000 7f32f272c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ec0cff30 con 0x7f32ec15b850 2023-07-06T22:00:00.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.706+0000 7f32f272c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ec0b22e0 con 0x7f32ec0b3cd0 2023-07-06T22:00:00.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.706+0000 7f32eb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f32ec0b3870 0x7f32ec0d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60080/0 (socket says 172.21.15.55:60080) 2023-07-06T22:00:00.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.706+0000 7f32eb7fe640 1 -- 172.21.15.55:0/3605419681 learned_addr learned my addr 172.21.15.55:0/3605419681 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:00.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.706+0000 7f32f0cc9640 1 --2- 172.21.15.55:0/3605419681 >> v2:172.21.15.138:3300/0 conn(0x7f32ec0b3cd0 0x7f32ec0d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:00.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.706+0000 7f32eaffd640 1 -- 172.21.15.55:0/3605419681 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968714562 0 0) 0x7f32ec0b2b80 con 0x7f32ec0b3870 2023-07-06T22:00:00.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.706+0000 7f32eaffd640 1 -- 172.21.15.55:0/3605419681 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32d4003530 con 0x7f32ec0b3870 2023-07-06T22:00:00.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.706+0000 7f32eaffd640 1 -- 172.21.15.55:0/3605419681 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444738667 0 0) 0x7f32ec0cff30 con 0x7f32ec15b850 2023-07-06T22:00:00.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.706+0000 7f32eaffd640 1 -- 172.21.15.55:0/3605419681 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32ec0b2b80 con 0x7f32ec15b850 2023-07-06T22:00:00.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.706+0000 7f32f0cc9640 1 -- 172.21.15.55:0/3605419681 >> v1:172.21.15.138:6789/0 conn(0x7f32ec15b850 legacy=0x7f32ec0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.706+0000 7f32f0cc9640 1 -- 172.21.15.55:0/3605419681 >> v1:172.21.15.55:6789/0 conn(0x7f32ec0b3870 legacy=0x7f32ec0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.706+0000 7f32f0cc9640 1 -- 172.21.15.55:0/3605419681 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec0b25c0 con 0x7f32ec0b3cd0 2023-07-06T22:00:00.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.710+0000 7f32f0cc9640 1 --2- 172.21.15.55:0/3605419681 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32ec0b3cd0 0x7f32ec0d0ad0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009d90 tx=0x7f32e401c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acc7717a00baf9af server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:00.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.710+0000 7f32eaffd640 1 -- 172.21.15.55:0/3605419681 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e40a5880 con 0x7f32ec0b3cd0 2023-07-06T22:00:00.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.710+0000 7f32eaffd640 1 -- 172.21.15.55:0/3605419681 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e40a59e0 con 0x7f32ec0b3cd0 2023-07-06T22:00:00.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.710+0000 7f32eaffd640 1 -- 172.21.15.55:0/3605419681 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e40a5d70 con 0x7f32ec0b3cd0 2023-07-06T22:00:00.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.710+0000 7f32f272c640 1 -- 172.21.15.55:0/3605419681 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32ec0b3cd0 msgr2=0x7f32ec0d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.710+0000 7f32f272c640 1 --2- 172.21.15.55:0/3605419681 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32ec0b3cd0 0x7f32ec0d0ad0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009d90 tx=0x7f32e401c800 comp rx=0 tx=0).stop 2023-07-06T22:00:00.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.710+0000 7f32f272c640 1 -- 172.21.15.55:0/3605419681 shutdown_connections 2023-07-06T22:00:00.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.710+0000 7f32f272c640 1 --2- 172.21.15.55:0/3605419681 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32ec0b3cd0 0x7f32ec0d0ad0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.710+0000 7f32f272c640 1 -- 172.21.15.55:0/3605419681 >> 172.21.15.55:0/3605419681 conn(0x7f32ec0cec20 msgr2=0x7f32ec0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.710+0000 7f32f272c640 1 -- 172.21.15.55:0/3605419681 shutdown_connections 2023-07-06T22:00:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.710+0000 7f32f272c640 1 -- 172.21.15.55:0/3605419681 wait complete. 2023-07-06T22:00:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f272c640 1 Processor -- start 2023-07-06T22:00:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f272c640 1 -- start start 2023-07-06T22:00:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f272c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32ec0b3870 0x7f32ec0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f272c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32ec0b3cd0 0x7f32ec14f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f272c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32ec15b850 0x7f32ec1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f272c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec14f780 con 0x7f32ec15b850 2023-07-06T22:00:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f272c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec15ab50 con 0x7f32ec0b3cd0 2023-07-06T22:00:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f272c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec159830 con 0x7f32ec0b3870 2023-07-06T22:00:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f0cc9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32ec15b850 0x7f32ec1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f0cc9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32ec15b850 0x7f32ec1580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34888/0 (socket says 172.21.15.55:34888) 2023-07-06T22:00:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f0cc9640 1 -- 172.21.15.55:0/856116644 learned_addr learned my addr 172.21.15.55:0/856116644 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32ebfff640 1 --2- 172.21.15.55:0/856116644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32ec0b3870 0x7f32ec0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32eb7fe640 1 --2- 172.21.15.55:0/856116644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32ec0b3cd0 0x7f32ec14f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f0cc9640 1 -- 172.21.15.55:0/856116644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32ec0b3870 msgr2=0x7f32ec0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f0cc9640 1 --2- 172.21.15.55:0/856116644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32ec0b3870 0x7f32ec0ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f0cc9640 1 -- 172.21.15.55:0/856116644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32ec0b3cd0 msgr2=0x7f32ec14f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f0cc9640 1 --2- 172.21.15.55:0/856116644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32ec0b3cd0 0x7f32ec14f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f0cc9640 1 -- 172.21.15.55:0/856116644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e4009a70 con 0x7f32ec15b850 2023-07-06T22:00:00.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f0cc9640 1 --2- 172.21.15.55:0/856116644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32ec15b850 0x7f32ec1580a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f32e4019410 tx=0x7f32ec0d1820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:00.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32e8ff9640 1 -- 172.21.15.55:0/856116644 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e40ad640 con 0x7f32ec15b850 2023-07-06T22:00:00.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32e8ff9640 1 -- 172.21.15.55:0/856116644 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e40ad7a0 con 0x7f32ec15b850 2023-07-06T22:00:00.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32e8ff9640 1 -- 172.21.15.55:0/856116644 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e40adb30 con 0x7f32ec15b850 2023-07-06T22:00:00.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f272c640 1 -- 172.21.15.55:0/856116644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ec15a2b0 con 0x7f32ec15b850 2023-07-06T22:00:00.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.714+0000 7f32f272c640 1 -- 172.21.15.55:0/856116644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ec15a870 con 0x7f32ec15b850 2023-07-06T22:00:00.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.718+0000 7f32f272c640 1 -- 172.21.15.55:0/856116644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ec066d60 con 0x7f32ec15b850 2023-07-06T22:00:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.718+0000 7f32e8ff9640 1 -- 172.21.15.55:0/856116644 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f32e40b4040 con 0x7f32ec15b850 2023-07-06T22:00:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.718+0000 7f32e8ff9640 1 --2- 172.21.15.55:0/856116644 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f32d80664c0 0x7f32d8068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.718+0000 7f32e8ff9640 1 -- 172.21.15.55:0/856116644 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f32e411eca0 con 0x7f32ec15b850 2023-07-06T22:00:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.718+0000 7f32ebfff640 1 -- 172.21.15.55:0/856116644 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f32d80664c0 msgr2=0x7f32d8068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3474707671 2023-07-06T22:00:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.718+0000 7f32ebfff640 1 --2- 172.21.15.55:0/856116644 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f32d80664c0 0x7f32d8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:00:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.722+0000 7f32e8ff9640 1 -- 172.21.15.55:0/856116644 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f32e40ebbd0 con 0x7f32ec15b850 2023-07-06T22:00:00.737 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:00.740+0000 7fa051e0a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:00:00.842 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:00.842+0000 7f678ba49180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:00:00.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.878+0000 7f32f272c640 1 -- 172.21.15.55:0/856116644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32ec0b3420 con 0x7f32ec15b850 2023-07-06T22:00:00.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.878+0000 7f32e8ff9640 1 -- 172.21.15.55:0/856116644 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) v1 ==== 100+0+11 (secure 0 0 0) 0x7f32e40ef1f0 con 0x7f32ec15b850 2023-07-06T22:00:00.879 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T22:00:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.882+0000 7f32f272c640 1 -- 172.21.15.55:0/856116644 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f32d80664c0 msgr2=0x7f32d8068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:00:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.882+0000 7f32f272c640 1 --2- 172.21.15.55:0/856116644 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f32d80664c0 0x7f32d8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.882+0000 7f32f272c640 1 -- 172.21.15.55:0/856116644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32ec15b850 msgr2=0x7f32ec1580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.882+0000 7f32f272c640 1 --2- 172.21.15.55:0/856116644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32ec15b850 0x7f32ec1580a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f32e4019410 tx=0x7f32ec0d1820 comp rx=0 tx=0).stop 2023-07-06T22:00:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.882+0000 7f32f272c640 1 -- 172.21.15.55:0/856116644 shutdown_connections 2023-07-06T22:00:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.882+0000 7f32f272c640 1 --2- 172.21.15.55:0/856116644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32ec15b850 0x7f32ec1580a0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.882+0000 7f32f272c640 1 --2- 172.21.15.55:0/856116644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32ec0b3cd0 0x7f32ec14f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.882+0000 7f32f272c640 1 --2- 172.21.15.55:0/856116644 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f32d80664c0 0x7f32d8068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.882+0000 7f32f272c640 1 --2- 172.21.15.55:0/856116644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32ec0b3870 0x7f32ec0ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.882+0000 7f32f272c640 1 -- 172.21.15.55:0/856116644 >> 172.21.15.55:0/856116644 conn(0x7f32ec0cec20 msgr2=0x7f32ec156680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.882+0000 7f32f272c640 1 -- 172.21.15.55:0/856116644 shutdown_connections 2023-07-06T22:00:00.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:00.882+0000 7f32f272c640 1 -- 172.21.15.55:0/856116644 wait complete. 2023-07-06T22:00:00.901 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T22:00:00.907 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:00.906+0000 7f678ba49180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:00:00.977 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:00:00.977 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:00:00.977 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:00:00.985 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:00.988+0000 7fa051e0a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:00:01.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ae7303640 1 Processor -- start 2023-07-06T22:00:01.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ae7303640 1 -- start start 2023-07-06T22:00:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ae7303640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6ae006f0e0 0x7f6ae00ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ae7303640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6ae00cb7a0 0x7f6ae00cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ae7303640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae015f5d0 con 0x7f6ae0156180 2023-07-06T22:00:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ae7303640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae0160250 con 0x7f6ae00cb7a0 2023-07-06T22:00:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ae7303640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae015f8b0 con 0x7f6ae006f0e0 2023-07-06T22:00:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ae509f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6ae0156180 0x7f6ae006e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60084/0 (socket says 172.21.15.55:60084) 2023-07-06T22:00:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ae509f640 1 -- 172.21.15.55:0/2078896389 learned_addr learned my addr 172.21.15.55:0/2078896389 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ae58a0640 1 --2- 172.21.15.55:0/2078896389 >> v2:172.21.15.138:3300/0 conn(0x7f6ae00cb7a0 0x7f6ae00cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ae489e640 1 --2- 172.21.15.55:0/2078896389 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6ae006f0e0 0x7f6ae00ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 -- 172.21.15.55:0/2078896389 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156457147 0 0) 0x7f6ae015f5d0 con 0x7f6ae0156180 2023-07-06T22:00:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 -- 172.21.15.55:0/2078896389 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6acc003530 con 0x7f6ae0156180 2023-07-06T22:00:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 -- 172.21.15.55:0/2078896389 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2834979146 0 0) 0x7f6acc003530 con 0x7f6ae0156180 2023-07-06T22:00:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 -- 172.21.15.55:0/2078896389 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6ae006f0e0 msgr2=0x7f6ae00ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 --2- 172.21.15.55:0/2078896389 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6ae006f0e0 0x7f6ae00ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 -- 172.21.15.55:0/2078896389 >> v2:172.21.15.138:3300/0 conn(0x7f6ae00cb7a0 msgr2=0x7f6ae00cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 --2- 172.21.15.55:0/2078896389 >> v2:172.21.15.138:3300/0 conn(0x7f6ae00cb7a0 0x7f6ae00cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 -- 172.21.15.55:0/2078896389 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae015fb90 con 0x7f6ae0156180 2023-07-06T22:00:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 -- 172.21.15.55:0/2078896389 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f6adc001680 con 0x7f6ae0156180 2023-07-06T22:00:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 -- 172.21.15.55:0/2078896389 >> v1:172.21.15.55:6789/0 conn(0x7f6ae0156180 legacy=0x7f6ae006e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 --2- 172.21.15.55:0/2078896389 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6ae006f0e0 0x7f6acc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 --2- 172.21.15.55:0/2078896389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6acc003f00 0x7f6acc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 --2- 172.21.15.55:0/2078896389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6acc004d10 0x7f6acc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 -- 172.21.15.55:0/2078896389 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae0160250 con 0x7f6acc004d10 2023-07-06T22:00:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 -- 172.21.15.55:0/2078896389 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae015f8b0 con 0x7f6acc003f00 2023-07-06T22:00:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ad7fff640 1 -- 172.21.15.55:0/2078896389 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc00b9c0 con 0x7f6ae006f0e0 2023-07-06T22:00:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.050+0000 7f6ae58a0640 1 --2- 172.21.15.55:0/2078896389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6acc004d10 0x7f6acc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.054+0000 7f6ae489e640 1 --2- 172.21.15.55:0/2078896389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6acc003f00 0x7f6acc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.054+0000 7f6ae58a0640 1 -- 172.21.15.55:0/2078896389 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6ae006f0e0 msgr2=0x7f6acc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.054+0000 7f6ae58a0640 1 --2- 172.21.15.55:0/2078896389 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6ae006f0e0 0x7f6acc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.054+0000 7f6ae58a0640 1 -- 172.21.15.55:0/2078896389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6acc003f00 msgr2=0x7f6acc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.054+0000 7f6ae58a0640 1 --2- 172.21.15.55:0/2078896389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6acc003f00 0x7f6acc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.054+0000 7f6ae58a0640 1 -- 172.21.15.55:0/2078896389 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc003530 con 0x7f6acc004d10 2023-07-06T22:00:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.054+0000 7f6ae58a0640 1 --2- 172.21.15.55:0/2078896389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6acc004d10 0x7f6acc005180 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009fc0 tx=0x7f6ad801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8aaf4183c78716 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.058+0000 7f6ad7fff640 1 -- 172.21.15.55:0/2078896389 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80a5cb0 con 0x7f6acc004d10 2023-07-06T22:00:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.058+0000 7f6ad7fff640 1 -- 172.21.15.55:0/2078896389 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad800f040 con 0x7f6acc004d10 2023-07-06T22:00:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.058+0000 7f6ad7fff640 1 -- 172.21.15.55:0/2078896389 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80ad680 con 0x7f6acc004d10 2023-07-06T22:00:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.058+0000 7f6ae7303640 1 -- 172.21.15.55:0/2078896389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6acc004d10 msgr2=0x7f6acc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.058+0000 7f6ae7303640 1 --2- 172.21.15.55:0/2078896389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6acc004d10 0x7f6acc005180 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009fc0 tx=0x7f6ad801cc40 comp rx=0 tx=0).stop 2023-07-06T22:00:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.058+0000 7f6ae58a0640 1 -- 172.21.15.55:0/2078896389 reap_dead start 2023-07-06T22:00:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.058+0000 7f6ae7303640 1 -- 172.21.15.55:0/2078896389 shutdown_connections 2023-07-06T22:00:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.058+0000 7f6ae7303640 1 -- 172.21.15.55:0/2078896389 >> 172.21.15.55:0/2078896389 conn(0x7f6ae00d0c50 msgr2=0x7f6ae00cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.058+0000 7f6ae7303640 1 -- 172.21.15.55:0/2078896389 shutdown_connections 2023-07-06T22:00:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.058+0000 7f6ae7303640 1 -- 172.21.15.55:0/2078896389 wait complete. 2023-07-06T22:00:01.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae7303640 1 Processor -- start 2023-07-06T22:00:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae7303640 1 -- start start 2023-07-06T22:00:01.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae7303640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6acc004d10 0x7f6ae00c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae7303640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ae014a6d0 0x7f6ae0149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae7303640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae01f4500 0x7f6ae01f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae7303640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00b2970 con 0x7f6ae01f4500 2023-07-06T22:00:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae7303640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae01f0e80 con 0x7f6ae014a6d0 2023-07-06T22:00:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae7303640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00afa00 con 0x7f6acc004d10 2023-07-06T22:00:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae58a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae01f4500 0x7f6ae01f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae58a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae01f4500 0x7f6ae01f4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34906/0 (socket says 172.21.15.55:34906) 2023-07-06T22:00:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae58a0640 1 -- 172.21.15.55:0/2763390983 learned_addr learned my addr 172.21.15.55:0/2763390983 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae509f640 1 --2- 172.21.15.55:0/2763390983 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6acc004d10 0x7f6ae00c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae489e640 1 --2- 172.21.15.55:0/2763390983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ae014a6d0 0x7f6ae0149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae58a0640 1 -- 172.21.15.55:0/2763390983 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6acc004d10 msgr2=0x7f6ae00c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae58a0640 1 --2- 172.21.15.55:0/2763390983 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6acc004d10 0x7f6ae00c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae58a0640 1 -- 172.21.15.55:0/2763390983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ae014a6d0 msgr2=0x7f6ae0149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae58a0640 1 --2- 172.21.15.55:0/2763390983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ae014a6d0 0x7f6ae0149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.062+0000 7f6ae58a0640 1 -- 172.21.15.55:0/2763390983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae00afce0 con 0x7f6ae01f4500 2023-07-06T22:00:01.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.066+0000 7f6ae58a0640 1 --2- 172.21.15.55:0/2763390983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae01f4500 0x7f6ae01f4970 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f6ad801c6b0 tx=0x7f6ad8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:01.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.066+0000 7f6ad5ffb640 1 -- 172.21.15.55:0/2763390983 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80039a0 con 0x7f6ae01f4500 2023-07-06T22:00:01.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.066+0000 7f6ad5ffb640 1 -- 172.21.15.55:0/2763390983 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad8003b20 con 0x7f6ae01f4500 2023-07-06T22:00:01.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.066+0000 7f6ae7303640 1 -- 172.21.15.55:0/2763390983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae014a4e0 con 0x7f6ae01f4500 2023-07-06T22:00:01.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.066+0000 7f6ad5ffb640 1 -- 172.21.15.55:0/2763390983 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80ad650 con 0x7f6ae01f4500 2023-07-06T22:00:01.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.066+0000 7f6ae7303640 1 -- 172.21.15.55:0/2763390983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae00c9420 con 0x7f6ae01f4500 2023-07-06T22:00:01.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.070+0000 7f6ad5ffb640 1 -- 172.21.15.55:0/2763390983 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f6ad80b4040 con 0x7f6ae01f4500 2023-07-06T22:00:01.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.070+0000 7f6ad5ffb640 1 --2- 172.21.15.55:0/2763390983 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f6ac4066510 0x7f6ac40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.070+0000 7f6ad5ffb640 1 -- 172.21.15.55:0/2763390983 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f6ad811e0e0 con 0x7f6ae01f4500 2023-07-06T22:00:01.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.070+0000 7f6ae509f640 1 -- 172.21.15.55:0/2763390983 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f6ac4066510 msgr2=0x7f6ac40689c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3474707671 2023-07-06T22:00:01.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.070+0000 7f6ae509f640 1 --2- 172.21.15.55:0/2763390983 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f6ac4066510 0x7f6ac40689c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:00:01.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.070+0000 7f6ae7303640 1 -- 172.21.15.55:0/2763390983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae0066d60 con 0x7f6ae01f4500 2023-07-06T22:00:01.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.082+0000 7f6ad5ffb640 1 -- 172.21.15.55:0/2763390983 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ad80eb070 con 0x7f6ae01f4500 2023-07-06T22:00:01.120 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:01.120+0000 7fa051e0a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:00:01.164 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:00:01.165 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:00:01.165 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:00:01.173 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:01.174+0000 7f678ba49180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:00:01.243 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:01.244+0000 7fa051e0a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:00:01.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.274+0000 7f6ae509f640 1 -- 172.21.15.55:0/2763390983 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f6ac4066510 msgr2=0x7f6ac40689c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3474707671 2023-07-06T22:00:01.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.274+0000 7f6ae509f640 1 --2- 172.21.15.55:0/2763390983 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f6ac4066510 0x7f6ac40689c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-06T22:00:01.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.282+0000 7f6ae7303640 1 -- 172.21.15.55:0/2763390983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6ae00cd930 con 0x7f6ae01f4500 2023-07-06T22:00:01.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.282+0000 7f6ad5ffb640 1 -- 172.21.15.55:0/2763390983 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v118) v1 ==== 80+0+466 (secure 0 0 0) 0x7f6ad80b2030 con 0x7f6ae01f4500 2023-07-06T22:00:01.282 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2589708229 2023-07-07T21:58:55.799288+0000 2023-07-06T22:00:01.283 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/782998468 2023-07-07T21:58:55.799288+0000 2023-07-06T22:00:01.283 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/4121483447 2023-07-07T21:58:55.799288+0000 2023-07-06T22:00:01.283 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1183916649 2023-07-07T21:58:55.799288+0000 2023-07-06T22:00:01.283 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/11434186 2023-07-07T21:58:55.799288+0000 2023-07-06T22:00:01.283 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/494913604 2023-07-07T21:58:55.799288+0000 2023-07-06T22:00:01.283 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/1408736549 2023-07-07T21:58:55.799288+0000 2023-07-06T22:00:01.283 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/1408736549 2023-07-07T21:58:55.799288+0000 2023-07-06T22:00:01.284 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-07-06T22:00:01.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.286+0000 7f6ae7303640 1 -- 172.21.15.55:0/2763390983 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f6ac4066510 msgr2=0x7f6ac40689c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:00:01.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.286+0000 7f6ae7303640 1 --2- 172.21.15.55:0/2763390983 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f6ac4066510 0x7f6ac40689c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.286+0000 7f6ae7303640 1 -- 172.21.15.55:0/2763390983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae01f4500 msgr2=0x7f6ae01f4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.286+0000 7f6ae7303640 1 --2- 172.21.15.55:0/2763390983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae01f4500 0x7f6ae01f4970 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f6ad801c6b0 tx=0x7f6ad8009750 comp rx=0 tx=0).stop 2023-07-06T22:00:01.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.286+0000 7f6ae7303640 1 -- 172.21.15.55:0/2763390983 shutdown_connections 2023-07-06T22:00:01.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.286+0000 7f6ae7303640 1 --2- 172.21.15.55:0/2763390983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae01f4500 0x7f6ae01f4970 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.286+0000 7f6ae7303640 1 --2- 172.21.15.55:0/2763390983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ae014a6d0 0x7f6ae0149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.286+0000 7f6ae7303640 1 --2- 172.21.15.55:0/2763390983 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f6ac4066510 0x7f6ac40689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.286+0000 7f6ae7303640 1 --2- 172.21.15.55:0/2763390983 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6acc004d10 0x7f6ae00c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.286+0000 7f6ae7303640 1 -- 172.21.15.55:0/2763390983 >> 172.21.15.55:0/2763390983 conn(0x7f6ae00d0c50 msgr2=0x7f6ae00b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.286+0000 7f6ae7303640 1 -- 172.21.15.55:0/2763390983 shutdown_connections 2023-07-06T22:00:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.286+0000 7f6ae7303640 1 -- 172.21.15.55:0/2763390983 wait complete. 2023-07-06T22:00:01.303 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T22:00:01.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:01.304 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-06T22:00:01.312 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:01.316+0000 7fa051e0a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:00:01.317 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:01.318+0000 7f678ba49180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:00:01.372 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T22:00:01.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:01.373 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T22:00:01.384 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:00:01.384 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:00:01.393 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:00:01.393 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:00:01.394 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:00:01.437 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:00:01.437 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:00:01.438 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:00:01.446 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:00:01.447 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:00:01.449 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:01.452+0000 7fa051e0a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:00:01.458 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:01.458+0000 7f678ba49180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:00:01.535 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:01.534+0000 7f678ba49180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:00:01.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.602+0000 7f50a467b640 1 Processor -- start 2023-07-06T22:00:01.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.602+0000 7f50a467b640 1 -- start start 2023-07-06T22:00:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.606+0000 7f50a467b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f509c0b7cd0 0x7f509c0ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.606+0000 7f50a467b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f509c0b1fe0 0x7f509c15f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.606+0000 7f50a467b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c0cecf0 con 0x7f509c0ccab0 2023-07-06T22:00:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.606+0000 7f50a467b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509c0d2310 con 0x7f509c0b1fe0 2023-07-06T22:00:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.606+0000 7f50a467b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c0b80a0 con 0x7f509c0b7cd0 2023-07-06T22:00:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.606+0000 7f50a1c16640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f509c0ccab0 0x7f509c0b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:37248/0 (socket says 172.21.15.55:37248) 2023-07-06T22:00:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.606+0000 7f50a2417640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f509c0b7cd0 0x7f509c0ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.606+0000 7f50a1c16640 1 -- 172.21.15.55:0/1855121481 learned_addr learned my addr 172.21.15.55:0/1855121481 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.606+0000 7f50a2c18640 1 --2- 172.21.15.55:0/1855121481 >> v2:172.21.15.138:3300/0 conn(0x7f509c0b1fe0 0x7f509c15f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.606+0000 7f50a2417640 1 -- 172.21.15.55:0/1855121481 >> v2:172.21.15.138:3300/0 conn(0x7f509c0b1fe0 msgr2=0x7f509c15f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:01.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.606+0000 7f50a2417640 1 --2- 172.21.15.55:0/1855121481 >> v2:172.21.15.138:3300/0 conn(0x7f509c0b1fe0 0x7f509c15f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.606+0000 7f50a2417640 1 -- 172.21.15.55:0/1855121481 >> v1:172.21.15.138:6789/0 conn(0x7f509c0ccab0 legacy=0x7f509c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.606+0000 7f50a1415640 1 -- 172.21.15.55:0/1855121481 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195383619 0 0) 0x7f509c0cecf0 con 0x7f509c0ccab0 2023-07-06T22:00:01.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.606+0000 7f50a2417640 1 -- 172.21.15.55:0/1855121481 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c0d1d90 con 0x7f509c0b7cd0 2023-07-06T22:00:01.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.610+0000 7f50a2417640 1 --2- 172.21.15.55:0/1855121481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f509c0b7cd0 0x7f509c0ce610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f50980097c0 tx=0x7f509801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49d09d6916db8daa server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:01.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.610+0000 7f50a1415640 1 -- 172.21.15.55:0/1855121481 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50980ab600 con 0x7f509c0b7cd0 2023-07-06T22:00:01.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.610+0000 7f50a1415640 1 -- 172.21.15.55:0/1855121481 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50980a7050 con 0x7f509c0b7cd0 2023-07-06T22:00:01.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.610+0000 7f50a1415640 1 -- 172.21.15.55:0/1855121481 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50980ab980 con 0x7f509c0b7cd0 2023-07-06T22:00:01.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.610+0000 7f50a467b640 1 -- 172.21.15.55:0/1855121481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f509c0b7cd0 msgr2=0x7f509c0ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.610+0000 7f50a467b640 1 --2- 172.21.15.55:0/1855121481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f509c0b7cd0 0x7f509c0ce610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f50980097c0 tx=0x7f509801c3f0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.610+0000 7f50a467b640 1 -- 172.21.15.55:0/1855121481 shutdown_connections 2023-07-06T22:00:01.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.610+0000 7f50a467b640 1 --2- 172.21.15.55:0/1855121481 >> v2:172.21.15.138:3300/0 conn(0x7f509c0b1fe0 0x7f509c15f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.610+0000 7f50a467b640 1 --2- 172.21.15.55:0/1855121481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f509c0b7cd0 0x7f509c0ce610 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.610+0000 7f50a467b640 1 -- 172.21.15.55:0/1855121481 >> 172.21.15.55:0/1855121481 conn(0x7f509c0ceee0 msgr2=0x7f509c0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.610+0000 7f50a467b640 1 -- 172.21.15.55:0/1855121481 shutdown_connections 2023-07-06T22:00:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.610+0000 7f50a467b640 1 -- 172.21.15.55:0/1855121481 wait complete. 2023-07-06T22:00:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.610+0000 7f50a467b640 1 Processor -- start 2023-07-06T22:00:01.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.610+0000 7f50a467b640 1 -- start start 2023-07-06T22:00:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a467b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f509c0b1fe0 0x7f509c0c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a467b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c0b7cd0 0x7f509c1520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a467b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f509c0ccab0 0x7f509c15e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a467b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c15e090 con 0x7f509c0b1fe0 2023-07-06T22:00:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a467b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c159b50 con 0x7f509c0b7cd0 2023-07-06T22:00:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a467b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c0c6ba0 con 0x7f509c0ccab0 2023-07-06T22:00:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a2417640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f509c0b1fe0 0x7f509c0c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a2417640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f509c0b1fe0 0x7f509c0c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34916/0 (socket says 172.21.15.55:34916) 2023-07-06T22:00:01.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a2417640 1 -- 172.21.15.55:0/1682462607 learned_addr learned my addr 172.21.15.55:0/1682462607 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:01.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a2c18640 1 --2- 172.21.15.55:0/1682462607 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f509c0ccab0 0x7f509c15e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a1c16640 1 --2- 172.21.15.55:0/1682462607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c0b7cd0 0x7f509c1520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a2417640 1 -- 172.21.15.55:0/1682462607 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f509c0ccab0 msgr2=0x7f509c15e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a2417640 1 --2- 172.21.15.55:0/1682462607 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f509c0ccab0 0x7f509c15e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a2417640 1 -- 172.21.15.55:0/1682462607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c0b7cd0 msgr2=0x7f509c1520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a2417640 1 --2- 172.21.15.55:0/1682462607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c0b7cd0 0x7f509c1520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a2417640 1 -- 172.21.15.55:0/1682462607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5098009420 con 0x7f509c0b1fe0 2023-07-06T22:00:01.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a1c16640 1 --2- 172.21.15.55:0/1682462607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c0b7cd0 0x7f509c1520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:01.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a2417640 1 --2- 172.21.15.55:0/1682462607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f509c0b1fe0 0x7f509c0c9530 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f50980ae040 tx=0x7f5098019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:01.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f5092ffd640 1 -- 172.21.15.55:0/1682462607 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50980b4430 con 0x7f509c0b1fe0 2023-07-06T22:00:01.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f5092ffd640 1 -- 172.21.15.55:0/1682462607 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50980b4590 con 0x7f509c0b1fe0 2023-07-06T22:00:01.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a467b640 1 -- 172.21.15.55:0/1682462607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509c159da0 con 0x7f509c0b1fe0 2023-07-06T22:00:01.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f5092ffd640 1 -- 172.21.15.55:0/1682462607 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50980b4940 con 0x7f509c0b1fe0 2023-07-06T22:00:01.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a467b640 1 -- 172.21.15.55:0/1682462607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c15a360 con 0x7f509c0b1fe0 2023-07-06T22:00:01.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.614+0000 7f50a467b640 1 -- 172.21.15.55:0/1682462607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509c15a550 con 0x7f509c0b1fe0 2023-07-06T22:00:01.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.618+0000 7f5092ffd640 1 -- 172.21.15.55:0/1682462607 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f50980b2040 con 0x7f509c0b1fe0 2023-07-06T22:00:01.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.618+0000 7f5092ffd640 1 --2- 172.21.15.55:0/1682462607 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f50800664c0 0x7f5080068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.618+0000 7f5092ffd640 1 -- 172.21.15.55:0/1682462607 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f509811ed00 con 0x7f509c0b1fe0 2023-07-06T22:00:01.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.618+0000 7f50a1c16640 1 -- 172.21.15.55:0/1682462607 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f50800664c0 msgr2=0x7f5080068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3474707671 2023-07-06T22:00:01.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.618+0000 7f50a1c16640 1 --2- 172.21.15.55:0/1682462607 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f50800664c0 0x7f5080068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:00:01.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.618+0000 7f5092ffd640 1 -- 172.21.15.55:0/1682462607 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50980ebdd0 con 0x7f509c0b1fe0 2023-07-06T22:00:01.681 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:01.682+0000 7f678ba49180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:00:01.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.806+0000 7f50a467b640 1 -- 172.21.15.55:0/1682462607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f509c066d60 con 0x7f509c0b1fe0 2023-07-06T22:00:01.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.810+0000 7f5092ffd640 1 -- 172.21.15.55:0/1682462607 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f50980ef3f0 con 0x7f509c0b1fe0 2023-07-06T22:00:01.808 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:01.808 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4122510097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4122510097},{"type":"v1","addr":"172.21.15.138:6835","nonce":4122510097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/154452928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":154452928},{"type":"v1","addr":"172.21.15.55:6836","nonce":154452928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8037,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/414200688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":414200688},{"type":"v1","addr":"172.21.15.55:6837","nonce":414200688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:58:39.245889+0000","modified":"2023-07-06T21:58:42.261872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8049},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8049":{"gid":8049,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6833/1552399486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1552399486},{"type":"v1","addr":"172.21.15.138:6833","nonce":1552399486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-06T22:00:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 47 2023-07-06T22:00:01.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.810+0000 7f50a467b640 1 -- 172.21.15.55:0/1682462607 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f50800664c0 msgr2=0x7f5080068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:00:01.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.810+0000 7f50a467b640 1 --2- 172.21.15.55:0/1682462607 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f50800664c0 0x7f5080068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.810+0000 7f50a467b640 1 -- 172.21.15.55:0/1682462607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f509c0b1fe0 msgr2=0x7f509c0c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.810+0000 7f50a467b640 1 --2- 172.21.15.55:0/1682462607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f509c0b1fe0 0x7f509c0c9530 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f50980ae040 tx=0x7f5098019190 comp rx=0 tx=0).stop 2023-07-06T22:00:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.810+0000 7f50a467b640 1 -- 172.21.15.55:0/1682462607 shutdown_connections 2023-07-06T22:00:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.810+0000 7f50a467b640 1 --2- 172.21.15.55:0/1682462607 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f50800664c0 0x7f5080068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.810+0000 7f50a467b640 1 --2- 172.21.15.55:0/1682462607 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f509c0ccab0 0x7f509c15e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.810+0000 7f50a467b640 1 --2- 172.21.15.55:0/1682462607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509c0b7cd0 0x7f509c1520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.810+0000 7f50a467b640 1 --2- 172.21.15.55:0/1682462607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f509c0b1fe0 0x7f509c0c9530 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.810+0000 7f50a467b640 1 -- 172.21.15.55:0/1682462607 >> 172.21.15.55:0/1682462607 conn(0x7f509c0ceee0 msgr2=0x7f509c0cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.810+0000 7f50a467b640 1 -- 172.21.15.55:0/1682462607 shutdown_connections 2023-07-06T22:00:01.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.810+0000 7f50a467b640 1 -- 172.21.15.55:0/1682462607 wait complete. 2023-07-06T22:00:01.831 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:00:01.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.974+0000 7f35bdde9640 1 Processor -- start 2023-07-06T22:00:01.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.974+0000 7f35bdde9640 1 -- start start 2023-07-06T22:00:01.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.978+0000 7f35bdde9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b80b1fe0 0x7f35b8166ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.978+0000 7f35bdde9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b80cd1c0 con 0x7f35b80b7cd0 2023-07-06T22:00:01.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.978+0000 7f35bdde9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b80cecf0 con 0x7f35b80ce610 2023-07-06T22:00:01.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.978+0000 7f35bdde9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80d2310 con 0x7f35b80b1fe0 2023-07-06T22:00:01.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.978+0000 7f35b77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f35b80b7cd0 0x7f35b80ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60096/0 (socket says 172.21.15.55:60096) 2023-07-06T22:00:01.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.978+0000 7f35b77fe640 1 -- 172.21.15.55:0/2780136756 learned_addr learned my addr 172.21.15.55:0/2780136756 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:01.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.978+0000 7f35b7fff640 1 --2- 172.21.15.55:0/2780136756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b80b1fe0 0x7f35b8166ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.978+0000 7f35b67fc640 1 -- 172.21.15.55:0/2780136756 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771524991 0 0) 0x7f35b80cd1c0 con 0x7f35b80b7cd0 2023-07-06T22:00:01.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.978+0000 7f35b67fc640 1 -- 172.21.15.55:0/2780136756 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a0003530 con 0x7f35b80b7cd0 2023-07-06T22:00:01.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.978+0000 7f35b67fc640 1 -- 172.21.15.55:0/2780136756 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989591554 0 0) 0x7f35b80cecf0 con 0x7f35b80ce610 2023-07-06T22:00:01.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.978+0000 7f35b67fc640 1 -- 172.21.15.55:0/2780136756 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35b80cd1c0 con 0x7f35b80ce610 2023-07-06T22:00:01.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.978+0000 7f35b7fff640 1 -- 172.21.15.55:0/2780136756 >> v1:172.21.15.138:6789/0 conn(0x7f35b80ce610 legacy=0x7f35b80b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.978+0000 7f35b7fff640 1 -- 172.21.15.55:0/2780136756 >> v1:172.21.15.55:6789/0 conn(0x7f35b80b7cd0 legacy=0x7f35b80ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.978+0000 7f35b7fff640 1 -- 172.21.15.55:0/2780136756 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b80cea60 con 0x7f35b80b1fe0 2023-07-06T22:00:01.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.982+0000 7f35b7fff640 1 --2- 172.21.15.55:0/2780136756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b80b1fe0 0x7f35b8166ba0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009dc0 tx=0x7f35b001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6ad986a232f1536 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:01.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.982+0000 7f35b67fc640 1 -- 172.21.15.55:0/2780136756 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00a57a0 con 0x7f35b80b1fe0 2023-07-06T22:00:01.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.982+0000 7f35b67fc640 1 -- 172.21.15.55:0/2780136756 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b00a5900 con 0x7f35b80b1fe0 2023-07-06T22:00:01.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.982+0000 7f35b67fc640 1 -- 172.21.15.55:0/2780136756 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00a5c90 con 0x7f35b80b1fe0 2023-07-06T22:00:01.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.982+0000 7f35bdde9640 1 -- 172.21.15.55:0/2780136756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b80b1fe0 msgr2=0x7f35b8166ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.982+0000 7f35bdde9640 1 --2- 172.21.15.55:0/2780136756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b80b1fe0 0x7f35b8166ba0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009dc0 tx=0x7f35b001c8e0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.982+0000 7f35bdde9640 1 -- 172.21.15.55:0/2780136756 shutdown_connections 2023-07-06T22:00:01.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.982+0000 7f35bdde9640 1 --2- 172.21.15.55:0/2780136756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b80b1fe0 0x7f35b8166ba0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.982+0000 7f35bdde9640 1 -- 172.21.15.55:0/2780136756 >> 172.21.15.55:0/2780136756 conn(0x7f35b80ceee0 msgr2=0x7f35b80cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:01.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.982+0000 7f35bdde9640 1 -- 172.21.15.55:0/2780136756 shutdown_connections 2023-07-06T22:00:01.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.982+0000 7f35bdde9640 1 -- 172.21.15.55:0/2780136756 wait complete. 2023-07-06T22:00:01.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.982+0000 7f35bdde9640 1 Processor -- start 2023-07-06T22:00:01.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35bdde9640 1 -- start start 2023-07-06T22:00:01.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35bdde9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35b80b1fe0 0x7f35b80c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35bdde9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b80b7cd0 0x7f35b8156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35bdde9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b80ce610 0x7f35b80cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35bdde9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b8156ff0 con 0x7f35b80b7cd0 2023-07-06T22:00:01.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35bdde9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80c9c30 con 0x7f35b80b1fe0 2023-07-06T22:00:01.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35bdde9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80c9f10 con 0x7f35b80ce610 2023-07-06T22:00:01.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35b6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b80b7cd0 0x7f35b8156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35b6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b80b7cd0 0x7f35b8156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34932/0 (socket says 172.21.15.55:34932) 2023-07-06T22:00:01.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35b6ffd640 1 -- 172.21.15.55:0/373553335 learned_addr learned my addr 172.21.15.55:0/373553335 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:01.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35b77fe640 1 --2- 172.21.15.55:0/373553335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35b80b1fe0 0x7f35b80c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35b7fff640 1 --2- 172.21.15.55:0/373553335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b80ce610 0x7f35b80cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:01.987 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:01.988+0000 7fa051e0a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:00:01.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35b6ffd640 1 -- 172.21.15.55:0/373553335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b80ce610 msgr2=0x7f35b80cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35b6ffd640 1 --2- 172.21.15.55:0/373553335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b80ce610 0x7f35b80cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35b6ffd640 1 -- 172.21.15.55:0/373553335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35b80b1fe0 msgr2=0x7f35b80c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:01.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35b6ffd640 1 --2- 172.21.15.55:0/373553335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35b80b1fe0 0x7f35b80c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:01.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35b6ffd640 1 -- 172.21.15.55:0/373553335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b0009a70 con 0x7f35b80b7cd0 2023-07-06T22:00:01.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35b6ffd640 1 --2- 172.21.15.55:0/373553335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b80b7cd0 0x7f35b8156ab0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00c490 tx=0x7f35ac00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f359ffff640 1 -- 172.21.15.55:0/373553335 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac0052d0 con 0x7f35b80b7cd0 2023-07-06T22:00:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f359ffff640 1 -- 172.21.15.55:0/373553335 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac005430 con 0x7f35b80b7cd0 2023-07-06T22:00:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35bdde9640 1 -- 172.21.15.55:0/373553335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b8154b20 con 0x7f35b80b7cd0 2023-07-06T22:00:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f359ffff640 1 -- 172.21.15.55:0/373553335 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac012870 con 0x7f35b80b7cd0 2023-07-06T22:00:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35bdde9640 1 -- 172.21.15.55:0/373553335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b80cc350 con 0x7f35b80b7cd0 2023-07-06T22:00:01.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.986+0000 7f35bdde9640 1 -- 172.21.15.55:0/373553335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b8066d60 con 0x7f35b80b7cd0 2023-07-06T22:00:01.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.990+0000 7f359ffff640 1 -- 172.21.15.55:0/373553335 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f35ac0129d0 con 0x7f35b80b7cd0 2023-07-06T22:00:01.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.990+0000 7f359ffff640 1 --2- 172.21.15.55:0/373553335 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f35a40664c0 0x7f35a4068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:01.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.990+0000 7f35b77fe640 1 -- 172.21.15.55:0/373553335 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f35a40664c0 msgr2=0x7f35a4068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3474707671 2023-07-06T22:00:01.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.990+0000 7f359ffff640 1 -- 172.21.15.55:0/373553335 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f35ac083fa0 con 0x7f35b80b7cd0 2023-07-06T22:00:01.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.990+0000 7f35b77fe640 1 --2- 172.21.15.55:0/373553335 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f35a40664c0 0x7f35a4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:00:01.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:01.994+0000 7f359ffff640 1 -- 172.21.15.55:0/373553335 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35ac050db0 con 0x7f35b80b7cd0 2023-07-06T22:00:02.071 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:02.072+0000 7fa051e0a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:00:02.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.154+0000 7f35bdde9640 1 -- 172.21.15.55:0/373553335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35b80c5970 con 0x7f35b80b7cd0 2023-07-06T22:00:02.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.154+0000 7f359ffff640 1 -- 172.21.15.55:0/373553335 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+18991 (secure 0 0 0) 0x7f35ac0543d0 con 0x7f35b80b7cd0 2023-07-06T22:00:02.154 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:02.154 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":118,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T21:58:55.799319+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:58:37.143680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-07-06T21:58:38.234438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/2589708229":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/782998468":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/4121483447":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/1183916649":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/11434186":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/494913604":"2023-07-07T21:58:55.799288+0000","172.21.15.55:6833/1408736549":"2023-07-07T21:58:55.799288+0000","172.21.15.55:6832/1408736549":"2023-07-07T21:58:55.799288+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:00:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.154+0000 7f35bdde9640 1 -- 172.21.15.55:0/373553335 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f35a40664c0 msgr2=0x7f35a4068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:00:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.154+0000 7f35bdde9640 1 --2- 172.21.15.55:0/373553335 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f35a40664c0 0x7f35a4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.154+0000 7f35bdde9640 1 -- 172.21.15.55:0/373553335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b80b7cd0 msgr2=0x7f35b8156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.154+0000 7f35bdde9640 1 --2- 172.21.15.55:0/373553335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b80b7cd0 0x7f35b8156ab0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00c490 tx=0x7f35ac00c950 comp rx=0 tx=0).stop 2023-07-06T22:00:02.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.154+0000 7f35bdde9640 1 -- 172.21.15.55:0/373553335 shutdown_connections 2023-07-06T22:00:02.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.158+0000 7f35bdde9640 1 --2- 172.21.15.55:0/373553335 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f35a40664c0 0x7f35a4068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.158+0000 7f35bdde9640 1 --2- 172.21.15.55:0/373553335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35b80ce610 0x7f35b80cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.158+0000 7f35bdde9640 1 --2- 172.21.15.55:0/373553335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b80b7cd0 0x7f35b8156ab0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.158+0000 7f35bdde9640 1 --2- 172.21.15.55:0/373553335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35b80b1fe0 0x7f35b80c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.158+0000 7f35bdde9640 1 -- 172.21.15.55:0/373553335 >> 172.21.15.55:0/373553335 conn(0x7f35b80ceee0 msgr2=0x7f35b80d2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:02.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.158+0000 7f35bdde9640 1 -- 172.21.15.55:0/373553335 shutdown_connections 2023-07-06T22:00:02.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.158+0000 7f35bdde9640 1 -- 172.21.15.55:0/373553335 wait complete. 2023-07-06T22:00:02.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T21:58:37.143680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T21:58:38.234438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:00:02.177 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:00:02.217 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:02.220+0000 7fa051e0a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:00:02.266 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:02.266+0000 7f678ba49180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:00:02.299 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:02.300+0000 7fa051e0a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:00:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0537b74640 1 Processor -- start 2023-07-06T22:00:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0537b74640 1 -- start start 2023-07-06T22:00:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0537b74640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f05301597d0 0x7f05300ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0537b74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0530070700 0x7f05300b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0537b74640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05300cd490 con 0x7f05300cac10 2023-07-06T22:00:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0537b74640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05300cb040 con 0x7f05301597d0 2023-07-06T22:00:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0537b74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053015cf60 con 0x7f0530070700 2023-07-06T22:00:02.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0536111640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0530070700 0x7f05300b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:02.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0535910640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f05301597d0 0x7f05300ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:02.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0536111640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0530070700 0x7f05300b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:53342/0 (socket says 172.21.15.55:53342) 2023-07-06T22:00:02.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0536111640 1 -- 172.21.15.55:0/1425474051 learned_addr learned my addr 172.21.15.55:0/1425474051 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:02.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0535910640 1 -- 172.21.15.55:0/1425474051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0530070700 msgr2=0x7f05300b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:02.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0535910640 1 --2- 172.21.15.55:0/1425474051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0530070700 0x7f05300b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0535910640 1 -- 172.21.15.55:0/1425474051 >> v1:172.21.15.138:6789/0 conn(0x7f05300cac10 legacy=0x7f053006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:02.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.326+0000 7f0535910640 1 -- 172.21.15.55:0/1425474051 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05300ccb60 con 0x7f05301597d0 2023-07-06T22:00:02.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.330+0000 7f0536111640 1 --2- 172.21.15.55:0/1425474051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0530070700 0x7f05300b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:00:02.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.330+0000 7f0535910640 1 --2- 172.21.15.55:0/1425474051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05301597d0 0x7f05300ca6d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f052c0097c0 tx=0x7f052c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=519ad2b0509292d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:02.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.330+0000 7f053490e640 1 -- 172.21.15.55:0/1425474051 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c0ac620 con 0x7f05301597d0 2023-07-06T22:00:02.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.330+0000 7f053490e640 1 -- 172.21.15.55:0/1425474051 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c0ac780 con 0x7f05301597d0 2023-07-06T22:00:02.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.330+0000 7f053490e640 1 -- 172.21.15.55:0/1425474051 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c0acb10 con 0x7f05301597d0 2023-07-06T22:00:02.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.330+0000 7f0537b74640 1 -- 172.21.15.55:0/1425474051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05301597d0 msgr2=0x7f05300ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:02.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.330+0000 7f0537b74640 1 --2- 172.21.15.55:0/1425474051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05301597d0 0x7f05300ca6d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f052c0097c0 tx=0x7f052c01c3c0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.330+0000 7f0537b74640 1 -- 172.21.15.55:0/1425474051 shutdown_connections 2023-07-06T22:00:02.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.330+0000 7f0537b74640 1 --2- 172.21.15.55:0/1425474051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0530070700 0x7f05300b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.330+0000 7f0537b74640 1 --2- 172.21.15.55:0/1425474051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05301597d0 0x7f05300ca6d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.330+0000 7f0537b74640 1 -- 172.21.15.55:0/1425474051 >> 172.21.15.55:0/1425474051 conn(0x7f05300cb970 msgr2=0x7f05300cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:02.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0537b74640 1 -- 172.21.15.55:0/1425474051 shutdown_connections 2023-07-06T22:00:02.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0537b74640 1 -- 172.21.15.55:0/1425474051 wait complete. 2023-07-06T22:00:02.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0537b74640 1 Processor -- start 2023-07-06T22:00:02.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0537b74640 1 -- start start 2023-07-06T22:00:02.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0537b74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0530070700 0x7f05301501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:02.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0537b74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05300cac10 0x7f05300c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:02.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0537b74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05300c99a0 0x7f05301562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:02.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0537b74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05300c9e40 con 0x7f05300c99a0 2023-07-06T22:00:02.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0537b74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05301506e0 con 0x7f05300cac10 2023-07-06T22:00:02.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0537b74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0530157c00 con 0x7f0530070700 2023-07-06T22:00:02.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0536111640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05300c99a0 0x7f05301562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:02.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0536111640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05300c99a0 0x7f05301562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34934/0 (socket says 172.21.15.55:34934) 2023-07-06T22:00:02.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0536111640 1 -- 172.21.15.55:0/2785881088 learned_addr learned my addr 172.21.15.55:0/2785881088 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:02.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0536111640 1 -- 172.21.15.55:0/2785881088 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0530070700 msgr2=0x7f05301501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:02.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0536111640 1 --2- 172.21.15.55:0/2785881088 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0530070700 0x7f05301501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0536111640 1 -- 172.21.15.55:0/2785881088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05300cac10 msgr2=0x7f05300c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0536111640 1 --2- 172.21.15.55:0/2785881088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05300cac10 0x7f05300c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.334+0000 7f0536111640 1 -- 172.21.15.55:0/2785881088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528009b30 con 0x7f05300c99a0 2023-07-06T22:00:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.338+0000 7f0536111640 1 --2- 172.21.15.55:0/2785881088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05300c99a0 0x7f05301562c0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f052800ef90 tx=0x7f052800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.338+0000 7f05267fc640 1 -- 172.21.15.55:0/2785881088 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528018070 con 0x7f05300c99a0 2023-07-06T22:00:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.338+0000 7f05267fc640 1 -- 172.21.15.55:0/2785881088 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052800f040 con 0x7f05300c99a0 2023-07-06T22:00:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.338+0000 7f05267fc640 1 -- 172.21.15.55:0/2785881088 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052800ce20 con 0x7f05300c99a0 2023-07-06T22:00:02.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.338+0000 7f0537b74640 1 -- 172.21.15.55:0/2785881088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c009420 con 0x7f05300c99a0 2023-07-06T22:00:02.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.338+0000 7f0537b74640 1 -- 172.21.15.55:0/2785881088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0530156ff0 con 0x7f05300c99a0 2023-07-06T22:00:02.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.338+0000 7f0537b74640 1 -- 172.21.15.55:0/2785881088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05300cd900 con 0x7f05300c99a0 2023-07-06T22:00:02.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.338+0000 7f05267fc640 1 -- 172.21.15.55:0/2785881088 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f0528014480 con 0x7f05300c99a0 2023-07-06T22:00:02.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.338+0000 7f05267fc640 1 --2- 172.21.15.55:0/2785881088 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f05140664c0 0x7f0514068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:02.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.342+0000 7f0535910640 1 -- 172.21.15.55:0/2785881088 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f05140664c0 msgr2=0x7f0514068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3474707671 2023-07-06T22:00:02.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.342+0000 7f05267fc640 1 -- 172.21.15.55:0/2785881088 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f0528084870 con 0x7f05300c99a0 2023-07-06T22:00:02.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.342+0000 7f0535910640 1 --2- 172.21.15.55:0/2785881088 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f05140664c0 0x7f0514068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:00:02.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.342+0000 7f05267fc640 1 -- 172.21.15.55:0/2785881088 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05300cd900 con 0x7f05300c99a0 2023-07-06T22:00:02.358 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:02.358+0000 7f678ba49180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:00:02.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.498+0000 7f0537b74640 1 -- 172.21.15.55:0/2785881088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05300cd900 con 0x7f05300c99a0 2023-07-06T22:00:02.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.502+0000 7f05267fc640 1 -- 172.21.15.55:0/2785881088 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05300cd900 con 0x7f05300c99a0 2023-07-06T22:00:02.500 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:00:02.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.502+0000 7f0537b74640 1 -- 172.21.15.55:0/2785881088 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f05140664c0 msgr2=0x7f0514068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:00:02.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.502+0000 7f0537b74640 1 --2- 172.21.15.55:0/2785881088 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f05140664c0 0x7f0514068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.502+0000 7f0537b74640 1 -- 172.21.15.55:0/2785881088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05300c99a0 msgr2=0x7f05301562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:02.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.502+0000 7f0537b74640 1 --2- 172.21.15.55:0/2785881088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05300c99a0 0x7f05301562c0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f052800ef90 tx=0x7f052800c490 comp rx=0 tx=0).stop 2023-07-06T22:00:02.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.502+0000 7f0537b74640 1 -- 172.21.15.55:0/2785881088 shutdown_connections 2023-07-06T22:00:02.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.502+0000 7f0537b74640 1 --2- 172.21.15.55:0/2785881088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05300c99a0 0x7f05301562c0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.502+0000 7f0537b74640 1 --2- 172.21.15.55:0/2785881088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05300cac10 0x7f05300c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.502+0000 7f0537b74640 1 --2- 172.21.15.55:0/2785881088 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f05140664c0 0x7f0514068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.502+0000 7f0537b74640 1 --2- 172.21.15.55:0/2785881088 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0530070700 0x7f05301501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.502+0000 7f0537b74640 1 -- 172.21.15.55:0/2785881088 >> 172.21.15.55:0/2785881088 conn(0x7f05300cb970 msgr2=0x7f053015e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.502+0000 7f0537b74640 1 -- 172.21.15.55:0/2785881088 shutdown_connections 2023-07-06T22:00:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.502+0000 7f0537b74640 1 -- 172.21.15.55:0/2785881088 wait complete. 2023-07-06T22:00:02.516 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:02.514+0000 7f678ba49180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:00:02.522 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:00:02.567 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:02.568+0000 7fa051e0a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:00:02.607 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:02.606+0000 7f678ba49180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:00:02.627 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:02.628+0000 7fa051e0a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:00:02.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.670+0000 7f698a111640 1 Processor -- start 2023-07-06T22:00:02.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.670+0000 7f698a111640 1 -- start start 2023-07-06T22:00:02.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.670+0000 7f698a111640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f69840b4300 0x7f69841666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.670+0000 7f698a111640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69840b5070 con 0x7f69840b7b90 2023-07-06T22:00:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.670+0000 7f698a111640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6984160020 con 0x7f69840d1c40 2023-07-06T22:00:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.670+0000 7f698a111640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69840d20c0 con 0x7f69840b4300 2023-07-06T22:00:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.670+0000 7f69837fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f69840b7b90 0x7f69840cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60104/0 (socket says 172.21.15.55:60104) 2023-07-06T22:00:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.670+0000 7f69837fe640 1 -- 172.21.15.55:0/2604305183 learned_addr learned my addr 172.21.15.55:0/2604305183 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.674+0000 7f6983fff640 1 --2- 172.21.15.55:0/2604305183 >> v2:172.21.15.138:3300/0 conn(0x7f69840b4300 0x7f69841666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.674+0000 7f69827fc640 1 -- 172.21.15.55:0/2604305183 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129998588 0 0) 0x7f69840b5070 con 0x7f69840b7b90 2023-07-06T22:00:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.674+0000 7f69827fc640 1 -- 172.21.15.55:0/2604305183 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f696c003530 con 0x7f69840b7b90 2023-07-06T22:00:02.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.674+0000 7f69827fc640 1 -- 172.21.15.55:0/2604305183 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726507048 0 0) 0x7f6984160020 con 0x7f69840d1c40 2023-07-06T22:00:02.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.674+0000 7f69827fc640 1 -- 172.21.15.55:0/2604305183 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69840b5070 con 0x7f69840d1c40 2023-07-06T22:00:02.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.674+0000 7f6983fff640 1 -- 172.21.15.55:0/2604305183 >> v1:172.21.15.138:6789/0 conn(0x7f69840d1c40 legacy=0x7f69840b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:02.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.674+0000 7f6983fff640 1 -- 172.21.15.55:0/2604305183 >> v1:172.21.15.55:6789/0 conn(0x7f69840b7b90 legacy=0x7f69840cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:02.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.674+0000 7f6983fff640 1 -- 172.21.15.55:0/2604305183 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69841604b0 con 0x7f69840b4300 2023-07-06T22:00:02.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.678+0000 7f6983fff640 1 --2- 172.21.15.55:0/2604305183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840b4300 0x7f69841666d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f697c009d90 tx=0x7f697c01c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f96754e97855d9f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:02.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.678+0000 7f69827fc640 1 -- 172.21.15.55:0/2604305183 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c0a59f0 con 0x7f69840b4300 2023-07-06T22:00:02.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.678+0000 7f69827fc640 1 -- 172.21.15.55:0/2604305183 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c0a5b50 con 0x7f69840b4300 2023-07-06T22:00:02.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.678+0000 7f69827fc640 1 -- 172.21.15.55:0/2604305183 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c0ad440 con 0x7f69840b4300 2023-07-06T22:00:02.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.678+0000 7f698a111640 1 -- 172.21.15.55:0/2604305183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840b4300 msgr2=0x7f69841666d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:02.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.678+0000 7f698a111640 1 --2- 172.21.15.55:0/2604305183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840b4300 0x7f69841666d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f697c009d90 tx=0x7f697c01c930 comp rx=0 tx=0).stop 2023-07-06T22:00:02.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.678+0000 7f698a111640 1 -- 172.21.15.55:0/2604305183 shutdown_connections 2023-07-06T22:00:02.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.678+0000 7f698a111640 1 --2- 172.21.15.55:0/2604305183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840b4300 0x7f69841666d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.678+0000 7f698a111640 1 -- 172.21.15.55:0/2604305183 >> 172.21.15.55:0/2604305183 conn(0x7f69840ceca0 msgr2=0x7f69840cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:02.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.678+0000 7f698a111640 1 -- 172.21.15.55:0/2604305183 shutdown_connections 2023-07-06T22:00:02.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.678+0000 7f698a111640 1 -- 172.21.15.55:0/2604305183 wait complete. 2023-07-06T22:00:02.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f698a111640 1 Processor -- start 2023-07-06T22:00:02.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f698a111640 1 -- start start 2023-07-06T22:00:02.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f698a111640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840b4300 0x7f69840c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:02.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f698a111640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7b90 0x7f6984154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:02.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f698a111640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840d1c40 0x7f6984157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:02.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f698a111640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69841536a0 con 0x7f69840b7b90 2023-07-06T22:00:02.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f698a111640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6984153980 con 0x7f69840b4300 2023-07-06T22:00:02.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f698a111640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6984153c60 con 0x7f69840d1c40 2023-07-06T22:00:02.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f6982ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7b90 0x7f6984154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:02.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f6982ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7b90 0x7f6984154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34946/0 (socket says 172.21.15.55:34946) 2023-07-06T22:00:02.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f6982ffd640 1 -- 172.21.15.55:0/775838687 learned_addr learned my addr 172.21.15.55:0/775838687 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:02.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f69837fe640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840b4300 0x7f69840c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:02.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f6983fff640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840d1c40 0x7f6984157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:02.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f6982ffd640 1 -- 172.21.15.55:0/775838687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840d1c40 msgr2=0x7f6984157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:02.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f6982ffd640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840d1c40 0x7f6984157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f6982ffd640 1 -- 172.21.15.55:0/775838687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840b4300 msgr2=0x7f69840c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:02.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f6982ffd640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840b4300 0x7f69840c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f6982ffd640 1 -- 172.21.15.55:0/775838687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c009a70 con 0x7f69840b7b90 2023-07-06T22:00:02.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f69837fe640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840b4300 0x7f69840c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:02.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f6983fff640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840d1c40 0x7f6984157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:02.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f6982ffd640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7b90 0x7f6984154740 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f697800c430 tx=0x7f697800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:02.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f696bfff640 1 -- 172.21.15.55:0/775838687 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69780052d0 con 0x7f69840b7b90 2023-07-06T22:00:02.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f696bfff640 1 -- 172.21.15.55:0/775838687 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6978005450 con 0x7f69840b7b90 2023-07-06T22:00:02.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f698a111640 1 -- 172.21.15.55:0/775838687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6984153f40 con 0x7f69840b7b90 2023-07-06T22:00:02.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f696bfff640 1 -- 172.21.15.55:0/775838687 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978003840 con 0x7f69840b7b90 2023-07-06T22:00:02.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.682+0000 7f698a111640 1 -- 172.21.15.55:0/775838687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6984150cd0 con 0x7f69840b7b90 2023-07-06T22:00:02.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.686+0000 7f698a111640 1 -- 172.21.15.55:0/775838687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6984066d60 con 0x7f69840b7b90 2023-07-06T22:00:02.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.686+0000 7f696bfff640 1 -- 172.21.15.55:0/775838687 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f69780039a0 con 0x7f69840b7b90 2023-07-06T22:00:02.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.686+0000 7f696bfff640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f69700664f0 0x7f69700689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:02.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.686+0000 7f69837fe640 1 -- 172.21.15.55:0/775838687 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f69700664f0 msgr2=0x7f69700689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3474707671 2023-07-06T22:00:02.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.686+0000 7f696bfff640 1 -- 172.21.15.55:0/775838687 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f6978083990 con 0x7f69840b7b90 2023-07-06T22:00:02.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.686+0000 7f69837fe640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f69700664f0 0x7f69700689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:00:02.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.690+0000 7f696bfff640 1 -- 172.21.15.55:0/775838687 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6978050850 con 0x7f69840b7b90 2023-07-06T22:00:02.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.846+0000 7f698a111640 1 -- 172.21.15.55:0/775838687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f69841543f0 con 0x7f69840b7b90 2023-07-06T22:00:02.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.846+0000 7f696bfff640 1 -- 172.21.15.55:0/775838687 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6978053e70 con 0x7f69840b7b90 2023-07-06T22:00:02.848 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:00:02.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.850+0000 7f698a111640 1 -- 172.21.15.55:0/775838687 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f69700664f0 msgr2=0x7f69700689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:00:02.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.850+0000 7f698a111640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f69700664f0 0x7f69700689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.850+0000 7f698a111640 1 -- 172.21.15.55:0/775838687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7b90 msgr2=0x7f6984154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:02.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.850+0000 7f698a111640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7b90 0x7f6984154740 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f697800c430 tx=0x7f697800c8f0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.850+0000 7f698a111640 1 -- 172.21.15.55:0/775838687 shutdown_connections 2023-07-06T22:00:02.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.850+0000 7f698a111640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.55:6832/3474707671,v1:172.21.15.55:6833/3474707671] conn(0x7f69700664f0 0x7f69700689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.850+0000 7f698a111640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69840d1c40 0x7f6984157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.850+0000 7f698a111640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69840b7b90 0x7f6984154740 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.850+0000 7f698a111640 1 --2- 172.21.15.55:0/775838687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69840b4300 0x7f69840c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:02.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.850+0000 7f698a111640 1 -- 172.21.15.55:0/775838687 >> 172.21.15.55:0/775838687 conn(0x7f69840ceca0 msgr2=0x7f69840b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:02.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.850+0000 7f698a111640 1 -- 172.21.15.55:0/775838687 shutdown_connections 2023-07-06T22:00:02.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:02.850+0000 7f698a111640 1 -- 172.21.15.55:0/775838687 wait complete. 2023-07-06T22:00:02.870 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T22:00:02.903 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:02.902+0000 7f678ba49180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:00:02.971 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:02.970+0000 7f678ba49180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:00:03.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.030+0000 7efdd0103640 1 Processor -- start 2023-07-06T22:00:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.030+0000 7efdd0103640 1 -- start start 2023-07-06T22:00:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdd0103640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efdc806f470 0x7efdc80c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdd0103640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efdc806ff50 0x7efdc80cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdd0103640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc8070370 con 0x7efdc80c9360 2023-07-06T22:00:03.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdd0103640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc8158550 con 0x7efdc806f470 2023-07-06T22:00:03.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdcd69e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efdc80c9360 0x7efdc806f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60110/0 (socket says 172.21.15.55:60110) 2023-07-06T22:00:03.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdcd69e640 1 -- 172.21.15.55:0/3509090896 learned_addr learned my addr 172.21.15.55:0/3509090896 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:03.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdd0103640 1 -- 172.21.15.55:0/3509090896 --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc80c9800 con 0x7efdc806ff50 2023-07-06T22:00:03.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdce6a0640 1 --2- 172.21.15.55:0/3509090896 >> v2:172.21.15.138:3300/0 conn(0x7efdc806ff50 0x7efdc80cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:03.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdcde9f640 1 --2- 172.21.15.55:0/3509090896 >> v2:172.21.15.55:3300/0 conn(0x7efdc806f470 0x7efdc80c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:03.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdcce9d640 1 -- 172.21.15.55:0/3509090896 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1295318176 0 0) 0x7efdc8070370 con 0x7efdc80c9360 2023-07-06T22:00:03.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdcce9d640 1 -- 172.21.15.55:0/3509090896 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdb4003450 con 0x7efdc80c9360 2023-07-06T22:00:03.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdcde9f640 1 -- 172.21.15.55:0/3509090896 >> v2:172.21.15.138:3300/0 conn(0x7efdc806ff50 msgr2=0x7efdc80cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:03.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdcde9f640 1 --2- 172.21.15.55:0/3509090896 >> v2:172.21.15.138:3300/0 conn(0x7efdc806ff50 0x7efdc80cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdcde9f640 1 -- 172.21.15.55:0/3509090896 >> v1:172.21.15.55:6789/0 conn(0x7efdc80c9360 legacy=0x7efdc806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:03.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdcce9d640 1 -- 172.21.15.55:0/3509090896 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 922805661 0 0) 0x7efdb4003450 con 0x7efdc80c9360 2023-07-06T22:00:03.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.034+0000 7efdcde9f640 1 -- 172.21.15.55:0/3509090896 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc80c9ae0 con 0x7efdc806f470 2023-07-06T22:00:03.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.038+0000 7efdcde9f640 1 --2- 172.21.15.55:0/3509090896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc806f470 0x7efdc80c8e20 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7efdc80cb8a0 tx=0x7efdc401c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd16ce2e141cd837 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:03.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.038+0000 7efdcce9d640 1 -- 172.21.15.55:0/3509090896 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb8001680 con 0x7efdc806f470 2023-07-06T22:00:03.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.038+0000 7efdcce9d640 1 -- 172.21.15.55:0/3509090896 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc40a7050 con 0x7efdc806f470 2023-07-06T22:00:03.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.038+0000 7efdcce9d640 1 -- 172.21.15.55:0/3509090896 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40ab620 con 0x7efdc806f470 2023-07-06T22:00:03.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.038+0000 7efdd0103640 1 -- 172.21.15.55:0/3509090896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc806f470 msgr2=0x7efdc80c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:03.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.038+0000 7efdd0103640 1 --2- 172.21.15.55:0/3509090896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc806f470 0x7efdc80c8e20 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7efdc80cb8a0 tx=0x7efdc401c350 comp rx=0 tx=0).stop 2023-07-06T22:00:03.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.038+0000 7efdd0103640 1 -- 172.21.15.55:0/3509090896 shutdown_connections 2023-07-06T22:00:03.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.038+0000 7efdd0103640 1 --2- 172.21.15.55:0/3509090896 >> v2:172.21.15.138:3300/0 conn(0x7efdc806ff50 0x7efdc80cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.038+0000 7efdd0103640 1 --2- 172.21.15.55:0/3509090896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc806f470 0x7efdc80c8e20 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.038+0000 7efdd0103640 1 -- 172.21.15.55:0/3509090896 >> 172.21.15.55:0/3509090896 conn(0x7efdc80cea70 msgr2=0x7efdc80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:03.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.042+0000 7efdd0103640 1 -- 172.21.15.55:0/3509090896 shutdown_connections 2023-07-06T22:00:03.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.042+0000 7efdd0103640 1 -- 172.21.15.55:0/3509090896 wait complete. 2023-07-06T22:00:03.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.042+0000 7efdd0103640 1 Processor -- start 2023-07-06T22:00:03.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.042+0000 7efdd0103640 1 -- start start 2023-07-06T22:00:03.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.042+0000 7efdd0103640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdc806f470 0x7efdc80693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.042+0000 7efdd0103640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc806ff50 0x7efdc80ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.042+0000 7efdd0103640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc80c9360 0x7efdc80c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdd0103640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc8159b40 con 0x7efdc806ff50 2023-07-06T22:00:03.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdd0103640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80c75f0 con 0x7efdc806f470 2023-07-06T22:00:03.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdd0103640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80c78d0 con 0x7efdc80c9360 2023-07-06T22:00:03.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdcd69e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc806ff50 0x7efdc80ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:03.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdce6a0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc80c9360 0x7efdc80c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:03.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdce6a0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc80c9360 0x7efdc80c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:53438/0 (socket says 172.21.15.55:53438) 2023-07-06T22:00:03.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdce6a0640 1 -- 172.21.15.55:0/2840977855 learned_addr learned my addr 172.21.15.55:0/2840977855 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:03.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdcd69e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc806ff50 0x7efdc80ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35036/0 (socket says 172.21.15.55:35036) 2023-07-06T22:00:03.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdcde9f640 1 --2- 172.21.15.55:0/2840977855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdc806f470 0x7efdc80693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:03.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdce6a0640 1 -- 172.21.15.55:0/2840977855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdc806f470 msgr2=0x7efdc80693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:03.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdce6a0640 1 --2- 172.21.15.55:0/2840977855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdc806f470 0x7efdc80693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdce6a0640 1 -- 172.21.15.55:0/2840977855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc806ff50 msgr2=0x7efdc80ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:03.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdce6a0640 1 --2- 172.21.15.55:0/2840977855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc806ff50 0x7efdc80ac640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdce6a0640 1 -- 172.21.15.55:0/2840977855 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc4009420 con 0x7efdc80c9360 2023-07-06T22:00:03.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdce6a0640 1 --2- 172.21.15.55:0/2840977855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc80c9360 0x7efdc80c6d30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efdc000efc0 tx=0x7efdc000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:03.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdbe7fc640 1 -- 172.21.15.55:0/2840977855 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc0014480 con 0x7efdc80c9360 2023-07-06T22:00:03.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdd0103640 1 -- 172.21.15.55:0/2840977855 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc80c7bb0 con 0x7efdc80c9360 2023-07-06T22:00:03.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdd0103640 1 -- 172.21.15.55:0/2840977855 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc80acb80 con 0x7efdc80c9360 2023-07-06T22:00:03.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdbe7fc640 1 -- 172.21.15.55:0/2840977855 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc000f040 con 0x7efdc80c9360 2023-07-06T22:00:03.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.046+0000 7efdbe7fc640 1 -- 172.21.15.55:0/2840977855 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc0014820 con 0x7efdc80c9360 2023-07-06T22:00:03.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.050+0000 7efdd0103640 1 -- 172.21.15.55:0/2840977855 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb0005260 con 0x7efdc80c9360 2023-07-06T22:00:03.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.050+0000 7efdbe7fc640 1 -- 172.21.15.55:0/2840977855 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 56) v1 ==== 85369+0+0 (secure 0 0 0) 0x7efdc0014980 con 0x7efdc80c9360 2023-07-06T22:00:03.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.050+0000 7efdbe7fc640 1 -- 172.21.15.55:0/2840977855 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 7156+0+0 (secure 0 0 0) 0x7efdc0084720 con 0x7efdc80c9360 2023-07-06T22:00:03.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.054+0000 7efdbe7fc640 1 -- 172.21.15.55:0/2840977855 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efdc0051ba0 con 0x7efdc80c9360 2023-07-06T22:00:03.058 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:03.058+0000 7f6713f37640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:03.058 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:03.058+0000 7f6713f37640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:03.058 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:03.058+0000 7f6713f37640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:03.058 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:03.058+0000 7f6713f37640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:03.058 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:03.058+0000 7f6713f37640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:03.059 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:03.058+0000 7f6715f3b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:03.059 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:03.058+0000 7f6715f3b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:03.059 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:03.058+0000 7f6715f3b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:03.059 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:03.058+0000 7f6715f3b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:03.059 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:03.058+0000 7f6715f3b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:03.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.214+0000 7efdd0103640 1 -- 172.21.15.55:0/2840977855 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efdb0005a90 con 0x7efdc80c9360 2023-07-06T22:00:03.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.214+0000 7efdbe7fc640 1 -- 172.21.15.55:0/2840977855 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v119) v1 ==== 104+0+11 (secure 0 0 0) 0x7efdc00551c0 con 0x7efdc80c9360 2023-07-06T22:00:03.214 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T22:00:03.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.214+0000 7efdd0103640 1 -- 172.21.15.55:0/2840977855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc80c9360 msgr2=0x7efdc80c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:03.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.214+0000 7efdd0103640 1 --2- 172.21.15.55:0/2840977855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc80c9360 0x7efdc80c6d30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efdc000efc0 tx=0x7efdc000c490 comp rx=0 tx=0).stop 2023-07-06T22:00:03.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.214+0000 7efdd0103640 1 -- 172.21.15.55:0/2840977855 shutdown_connections 2023-07-06T22:00:03.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.214+0000 7efdd0103640 1 --2- 172.21.15.55:0/2840977855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc80c9360 0x7efdc80c6d30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.214+0000 7efdd0103640 1 --2- 172.21.15.55:0/2840977855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc806ff50 0x7efdc80ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.214+0000 7efdd0103640 1 --2- 172.21.15.55:0/2840977855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdc806f470 0x7efdc80693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.214+0000 7efdd0103640 1 -- 172.21.15.55:0/2840977855 >> 172.21.15.55:0/2840977855 conn(0x7efdc80cea70 msgr2=0x7efdc80ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:03.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.214+0000 7efdd0103640 1 -- 172.21.15.55:0/2840977855 shutdown_connections 2023-07-06T22:00:03.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.214+0000 7efdd0103640 1 -- 172.21.15.55:0/2840977855 wait complete. 2023-07-06T22:00:03.234 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T22:00:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.418+0000 7f8642a7b640 1 Processor -- start 2023-07-06T22:00:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.418+0000 7f8642a7b640 1 -- start start 2023-07-06T22:00:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.422+0000 7f8642a7b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f863c0709a0 0x7f863c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.422+0000 7f8642a7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f863c0cbe60 0x7f863c0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.422+0000 7f8642a7b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f863c070d70 0x7f863c0b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.422+0000 7f8642a7b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863c0cc300 con 0x7f863c0709a0 2023-07-06T22:00:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.422+0000 7f8642a7b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863c0cc5e0 con 0x7f863c070d70 2023-07-06T22:00:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.422+0000 7f8642a7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c0cc8c0 con 0x7f863c0cbe60 2023-07-06T22:00:03.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.422+0000 7f8640817640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f863c0709a0 0x7f863c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:03.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.422+0000 7f8640817640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f863c0709a0 0x7f863c0cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56310/0 (socket says 172.21.15.55:56310) 2023-07-06T22:00:03.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.422+0000 7f8640817640 1 -- 172.21.15.55:0/1757117287 learned_addr learned my addr 172.21.15.55:0/1757117287 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:03.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.422+0000 7f8640817640 1 -- 172.21.15.55:0/1757117287 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f863c0cbe60 msgr2=0x7f863c0b0c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T22:00:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.422+0000 7f8640817640 1 --2- 172.21.15.55:0/1757117287 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f863c0cbe60 0x7f863c0b0c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.422+0000 7f8640817640 1 -- 172.21.15.55:0/1757117287 >> v2:172.21.15.138:3300/0 conn(0x7f863c070d70 msgr2=0x7f863c0b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.422+0000 7f8640817640 1 --2- 172.21.15.55:0/1757117287 >> v2:172.21.15.138:3300/0 conn(0x7f863c070d70 0x7f863c0b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.422+0000 7f8640817640 1 -- 172.21.15.55:0/1757117287 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c0ccba0 con 0x7f863c0709a0 2023-07-06T22:00:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f8640817640 1 --2- 172.21.15.55:0/1757117287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863c0709a0 0x7f863c0cb920 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f863c06cc70 tx=0x7f863001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbce9925823eb3e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f863b7fe640 1 -- 172.21.15.55:0/1757117287 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86300ab5f0 con 0x7f863c0709a0 2023-07-06T22:00:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f863b7fe640 1 -- 172.21.15.55:0/1757117287 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86300ab750 con 0x7f863c0709a0 2023-07-06T22:00:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f863b7fe640 1 -- 172.21.15.55:0/1757117287 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86300abae0 con 0x7f863c0709a0 2023-07-06T22:00:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f8642a7b640 1 -- 172.21.15.55:0/1757117287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863c0709a0 msgr2=0x7f863c0cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f8642a7b640 1 --2- 172.21.15.55:0/1757117287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863c0709a0 0x7f863c0cb920 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f863c06cc70 tx=0x7f863001c520 comp rx=0 tx=0).stop 2023-07-06T22:00:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f8642a7b640 1 -- 172.21.15.55:0/1757117287 shutdown_connections 2023-07-06T22:00:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f8642a7b640 1 --2- 172.21.15.55:0/1757117287 >> v2:172.21.15.138:3300/0 conn(0x7f863c070d70 0x7f863c0b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f8642a7b640 1 --2- 172.21.15.55:0/1757117287 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f863c0cbe60 0x7f863c0b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f8642a7b640 1 --2- 172.21.15.55:0/1757117287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863c0709a0 0x7f863c0cb920 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f8642a7b640 1 -- 172.21.15.55:0/1757117287 >> 172.21.15.55:0/1757117287 conn(0x7f863c0cea70 msgr2=0x7f863c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:03.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f8642a7b640 1 -- 172.21.15.55:0/1757117287 shutdown_connections 2023-07-06T22:00:03.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f8642a7b640 1 -- 172.21.15.55:0/1757117287 wait complete. 2023-07-06T22:00:03.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f8642a7b640 1 Processor -- start 2023-07-06T22:00:03.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.426+0000 7f8642a7b640 1 -- start start 2023-07-06T22:00:03.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8642a7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863c0709a0 0x7f863c06b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8642a7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f863c070d70 0x7f863c0c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8642a7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863c0cbe60 0x7f863c0c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8642a7b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c1f7d80 con 0x7f863c0709a0 2023-07-06T22:00:03.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8642a7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c0c26b0 con 0x7f863c0cbe60 2023-07-06T22:00:03.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8642a7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c06bac0 con 0x7f863c070d70 2023-07-06T22:00:03.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8640817640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863c0709a0 0x7f863c06b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:03.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8640817640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863c0709a0 0x7f863c06b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56316/0 (socket says 172.21.15.55:56316) 2023-07-06T22:00:03.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8640817640 1 -- 172.21.15.55:0/3197303402 learned_addr learned my addr 172.21.15.55:0/3197303402 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:03.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f863bfff640 1 --2- 172.21.15.55:0/3197303402 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f863c070d70 0x7f863c0c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:03.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8640817640 1 -- 172.21.15.55:0/3197303402 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f863c070d70 msgr2=0x7f863c0c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:03.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8640817640 1 --2- 172.21.15.55:0/3197303402 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f863c070d70 0x7f863c0c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8640817640 1 -- 172.21.15.55:0/3197303402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863c0cbe60 msgr2=0x7f863c0c1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:03.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8640817640 1 --2- 172.21.15.55:0/3197303402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863c0cbe60 0x7f863c0c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8640817640 1 -- 172.21.15.55:0/3197303402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86300094d0 con 0x7f863c0709a0 2023-07-06T22:00:03.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8640817640 1 --2- 172.21.15.55:0/3197303402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863c0709a0 0x7f863c06b580 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f863001abd0 tx=0x7f863001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:03.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f86397fa640 1 -- 172.21.15.55:0/3197303402 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86300b4800 con 0x7f863c0709a0 2023-07-06T22:00:03.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f86397fa640 1 -- 172.21.15.55:0/3197303402 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86300b4960 con 0x7f863c0709a0 2023-07-06T22:00:03.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f86397fa640 1 -- 172.21.15.55:0/3197303402 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86300b4d10 con 0x7f863c0709a0 2023-07-06T22:00:03.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8642a7b640 1 -- 172.21.15.55:0/3197303402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c1f7750 con 0x7f863c0709a0 2023-07-06T22:00:03.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8642a7b640 1 -- 172.21.15.55:0/3197303402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863c1f7a10 con 0x7f863c0709a0 2023-07-06T22:00:03.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f8642a7b640 1 -- 172.21.15.55:0/3197303402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863c066d60 con 0x7f863c0709a0 2023-07-06T22:00:03.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.430+0000 7f86397fa640 1 -- 172.21.15.55:0/3197303402 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f86300b3380 con 0x7f863c0709a0 2023-07-06T22:00:03.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.434+0000 7f86397fa640 1 -- 172.21.15.55:0/3197303402 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 7156+0+0 (secure 0 0 0) 0x7f86300a8050 con 0x7f863c0709a0 2023-07-06T22:00:03.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.438+0000 7f86397fa640 1 -- 172.21.15.55:0/3197303402 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f86300eb6b0 con 0x7f863c0709a0 2023-07-06T22:00:03.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.590+0000 7f8642a7b640 1 -- 172.21.15.55:0/3197303402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f863c06c730 con 0x7f863c0709a0 2023-07-06T22:00:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.590+0000 7f86397fa640 1 -- 172.21.15.55:0/3197303402 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v119) v1 ==== 100+0+11 (secure 0 0 0) 0x7f86300eecd0 con 0x7f863c0709a0 2023-07-06T22:00:03.591 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T22:00:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.594+0000 7f8642a7b640 1 -- 172.21.15.55:0/3197303402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863c0709a0 msgr2=0x7f863c06b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.594+0000 7f8642a7b640 1 --2- 172.21.15.55:0/3197303402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863c0709a0 0x7f863c06b580 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f863001abd0 tx=0x7f863001ad60 comp rx=0 tx=0).stop 2023-07-06T22:00:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.594+0000 7f8642a7b640 1 -- 172.21.15.55:0/3197303402 shutdown_connections 2023-07-06T22:00:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.594+0000 7f8642a7b640 1 --2- 172.21.15.55:0/3197303402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f863c0cbe60 0x7f863c0c1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.594+0000 7f8642a7b640 1 --2- 172.21.15.55:0/3197303402 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f863c070d70 0x7f863c0c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.594+0000 7f8642a7b640 1 --2- 172.21.15.55:0/3197303402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863c0709a0 0x7f863c06b580 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.594+0000 7f8642a7b640 1 -- 172.21.15.55:0/3197303402 >> 172.21.15.55:0/3197303402 conn(0x7f863c0cea70 msgr2=0x7f863c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:03.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.594+0000 7f8642a7b640 1 -- 172.21.15.55:0/3197303402 shutdown_connections 2023-07-06T22:00:03.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.594+0000 7f8642a7b640 1 -- 172.21.15.55:0/3197303402 wait complete. 2023-07-06T22:00:03.612 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:00:03.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.754+0000 7f9391a7b640 1 Processor -- start 2023-07-06T22:00:03.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.754+0000 7f9391a7b640 1 -- start start 2023-07-06T22:00:03.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f9391a7b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f938c0b7cd0 0x7f938c0ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f9391a7b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c0cecf0 con 0x7f938c0ccab0 2023-07-06T22:00:03.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f9391a7b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c0d1d90 con 0x7f938c0b1fe0 2023-07-06T22:00:03.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f9391a7b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938c0d2310 con 0x7f938c0b7cd0 2023-07-06T22:00:03.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f938b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f938c0b7cd0 0x7f938c0ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:03.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f9383fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f938c0ccab0 0x7f938c0b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46106/0 (socket says 172.21.15.55:46106) 2023-07-06T22:00:03.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f9383fff640 1 -- 172.21.15.55:0/561412405 learned_addr learned my addr 172.21.15.55:0/561412405 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:03.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f938affd640 1 -- 172.21.15.55:0/561412405 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412533032 0 0) 0x7f938c0cecf0 con 0x7f938c0ccab0 2023-07-06T22:00:03.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f938affd640 1 -- 172.21.15.55:0/561412405 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9378003530 con 0x7f938c0ccab0 2023-07-06T22:00:03.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f938affd640 1 -- 172.21.15.55:0/561412405 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099074100 0 0) 0x7f938c0d1d90 con 0x7f938c0b1fe0 2023-07-06T22:00:03.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f938affd640 1 -- 172.21.15.55:0/561412405 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f938c0cecf0 con 0x7f938c0b1fe0 2023-07-06T22:00:03.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f938b7fe640 1 -- 172.21.15.55:0/561412405 >> v1:172.21.15.138:6789/0 conn(0x7f938c0b1fe0 legacy=0x7f938c15f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:03.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f938b7fe640 1 -- 172.21.15.55:0/561412405 >> v1:172.21.15.55:6789/0 conn(0x7f938c0ccab0 legacy=0x7f938c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:03.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f938affd640 1 -- 172.21.15.55:0/561412405 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2049669054 0 0) 0x7f9378003530 con 0x7f938c0ccab0 2023-07-06T22:00:03.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.758+0000 7f938b7fe640 1 -- 172.21.15.55:0/561412405 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c0d2030 con 0x7f938c0b7cd0 2023-07-06T22:00:03.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.762+0000 7f938b7fe640 1 --2- 172.21.15.55:0/561412405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f938c0b7cd0 0x7f938c0ce610 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f937c0097c0 tx=0x7f937c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b975866ebfeadea server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:03.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.762+0000 7f938affd640 1 -- 172.21.15.55:0/561412405 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c0ab600 con 0x7f938c0b7cd0 2023-07-06T22:00:03.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.762+0000 7f938affd640 1 -- 172.21.15.55:0/561412405 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c0a7050 con 0x7f938c0b7cd0 2023-07-06T22:00:03.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.762+0000 7f938affd640 1 -- 172.21.15.55:0/561412405 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c0ab980 con 0x7f938c0b7cd0 2023-07-06T22:00:03.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.762+0000 7f9391a7b640 1 -- 172.21.15.55:0/561412405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f938c0b7cd0 msgr2=0x7f938c0ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:03.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.762+0000 7f9391a7b640 1 --2- 172.21.15.55:0/561412405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f938c0b7cd0 0x7f938c0ce610 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f937c0097c0 tx=0x7f937c01c3f0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.762+0000 7f9391a7b640 1 -- 172.21.15.55:0/561412405 shutdown_connections 2023-07-06T22:00:03.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.762+0000 7f9391a7b640 1 --2- 172.21.15.55:0/561412405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f938c0b7cd0 0x7f938c0ce610 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.762+0000 7f9391a7b640 1 -- 172.21.15.55:0/561412405 >> 172.21.15.55:0/561412405 conn(0x7f938c0ceee0 msgr2=0x7f938c0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:03.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.762+0000 7f9391a7b640 1 -- 172.21.15.55:0/561412405 shutdown_connections 2023-07-06T22:00:03.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.762+0000 7f9391a7b640 1 -- 172.21.15.55:0/561412405 wait complete. 2023-07-06T22:00:03.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.762+0000 7f9391a7b640 1 Processor -- start 2023-07-06T22:00:03.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.762+0000 7f9391a7b640 1 -- start start 2023-07-06T22:00:03.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9391a7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f938c0b1fe0 0x7f938c152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9391a7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f938c0b7cd0 0x7f938c14d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9391a7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f938c0ccab0 0x7f938c15cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:03.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9391a7b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c15e080 con 0x7f938c0b7cd0 2023-07-06T22:00:03.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9391a7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c15d2c0 con 0x7f938c0b1fe0 2023-07-06T22:00:03.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9391a7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c15d750 con 0x7f938c0ccab0 2023-07-06T22:00:03.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9383fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f938c0b7cd0 0x7f938c14d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:03.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9383fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f938c0b7cd0 0x7f938c14d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56328/0 (socket says 172.21.15.55:56328) 2023-07-06T22:00:03.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9383fff640 1 -- 172.21.15.55:0/1133881385 learned_addr learned my addr 172.21.15.55:0/1133881385 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:03.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f938b7fe640 1 --2- 172.21.15.55:0/1133881385 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f938c0b1fe0 0x7f938c152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:03.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9383fff640 1 -- 172.21.15.55:0/1133881385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f938c0ccab0 msgr2=0x7f938c15cd80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T22:00:03.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9383fff640 1 --2- 172.21.15.55:0/1133881385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f938c0ccab0 0x7f938c15cd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9383fff640 1 -- 172.21.15.55:0/1133881385 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f938c0b1fe0 msgr2=0x7f938c152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:03.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9383fff640 1 --2- 172.21.15.55:0/1133881385 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f938c0b1fe0 0x7f938c152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9383fff640 1 -- 172.21.15.55:0/1133881385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c009420 con 0x7f938c0b7cd0 2023-07-06T22:00:03.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9383fff640 1 --2- 172.21.15.55:0/1133881385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f938c0b7cd0 0x7f938c14d000 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f937400c430 tx=0x7f937400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:03.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9388ff9640 1 -- 172.21.15.55:0/1133881385 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374005cf0 con 0x7f938c0b7cd0 2023-07-06T22:00:03.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9388ff9640 1 -- 172.21.15.55:0/1133881385 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9374005e50 con 0x7f938c0b7cd0 2023-07-06T22:00:03.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9388ff9640 1 -- 172.21.15.55:0/1133881385 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93740072d0 con 0x7f938c0b7cd0 2023-07-06T22:00:03.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9391a7b640 1 -- 172.21.15.55:0/1133881385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c15da30 con 0x7f938c0b7cd0 2023-07-06T22:00:03.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9391a7b640 1 -- 172.21.15.55:0/1133881385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c153070 con 0x7f938c0b7cd0 2023-07-06T22:00:03.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9391a7b640 1 -- 172.21.15.55:0/1133881385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c153260 con 0x7f938c0b7cd0 2023-07-06T22:00:03.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.766+0000 7f9388ff9640 1 -- 172.21.15.55:0/1133881385 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f9374007430 con 0x7f938c0b7cd0 2023-07-06T22:00:03.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.770+0000 7f9388ff9640 1 -- 172.21.15.55:0/1133881385 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 7156+0+0 (secure 0 0 0) 0x7f9374082f70 con 0x7f938c0b7cd0 2023-07-06T22:00:03.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.774+0000 7f9388ff9640 1 -- 172.21.15.55:0/1133881385 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93740501e0 con 0x7f938c0b7cd0 2023-07-06T22:00:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.958+0000 7f9391a7b640 1 -- 172.21.15.55:0/1133881385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f938c066d60 con 0x7f938c0b7cd0 2023-07-06T22:00:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.958+0000 7f9388ff9640 1 -- 172.21.15.55:0/1133881385 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f9374017090 con 0x7f938c0b7cd0 2023-07-06T22:00:03.959 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:03.959 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4122510097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4122510097},{"type":"v1","addr":"172.21.15.138:6835","nonce":4122510097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/154452928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":154452928},{"type":"v1","addr":"172.21.15.55:6836","nonce":154452928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8037,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/414200688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":414200688},{"type":"v1","addr":"172.21.15.55:6837","nonce":414200688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:58:39.245889+0000","modified":"2023-07-06T21:58:42.261872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8049},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8049":{"gid":8049,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6833/1552399486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1552399486},{"type":"v1","addr":"172.21.15.138:6833","nonce":1552399486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-06T22:00:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 47 2023-07-06T22:00:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.962+0000 7f9391a7b640 1 -- 172.21.15.55:0/1133881385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f938c0b7cd0 msgr2=0x7f938c14d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.962+0000 7f9391a7b640 1 --2- 172.21.15.55:0/1133881385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f938c0b7cd0 0x7f938c14d000 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f937400c430 tx=0x7f937400c8f0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.962+0000 7f9391a7b640 1 -- 172.21.15.55:0/1133881385 shutdown_connections 2023-07-06T22:00:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.962+0000 7f9391a7b640 1 --2- 172.21.15.55:0/1133881385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f938c0ccab0 0x7f938c15cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.962+0000 7f9391a7b640 1 --2- 172.21.15.55:0/1133881385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f938c0b7cd0 0x7f938c14d000 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.962+0000 7f9391a7b640 1 --2- 172.21.15.55:0/1133881385 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f938c0b1fe0 0x7f938c152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.962+0000 7f9391a7b640 1 -- 172.21.15.55:0/1133881385 >> 172.21.15.55:0/1133881385 conn(0x7f938c0ceee0 msgr2=0x7f938c0cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.962+0000 7f9391a7b640 1 -- 172.21.15.55:0/1133881385 shutdown_connections 2023-07-06T22:00:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:03.962+0000 7f9391a7b640 1 -- 172.21.15.55:0/1133881385 wait complete. 2023-07-06T22:00:03.980 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:00:04.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff40bef9640 1 Processor -- start 2023-07-06T22:00:04.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff40bef9640 1 -- start start 2023-07-06T22:00:04.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff40bef9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff404160030 0x7ff404070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff40bef9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40406bd00 con 0x7ff4040cda40 2023-07-06T22:00:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff40bef9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4040c9ba0 con 0x7ff404071050 2023-07-06T22:00:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff40bef9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff404160400 con 0x7ff404160030 2023-07-06T22:00:04.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff40a496640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff4040cda40 0x7ff4040cbce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46108/0 (socket says 172.21.15.55:46108) 2023-07-06T22:00:04.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff40a496640 1 -- 172.21.15.55:0/3414385332 learned_addr learned my addr 172.21.15.55:0/3414385332 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:04.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff409c95640 1 --2- 172.21.15.55:0/3414385332 >> v2:172.21.15.138:3300/0 conn(0x7ff404160030 0x7ff404070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff408c93640 1 -- 172.21.15.55:0/3414385332 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936188308 0 0) 0x7ff40406bd00 con 0x7ff4040cda40 2023-07-06T22:00:04.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff408c93640 1 -- 172.21.15.55:0/3414385332 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3f0003530 con 0x7ff4040cda40 2023-07-06T22:00:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff408c93640 1 -- 172.21.15.55:0/3414385332 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717175988 0 0) 0x7ff4040c9ba0 con 0x7ff404071050 2023-07-06T22:00:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff408c93640 1 -- 172.21.15.55:0/3414385332 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff40406bd00 con 0x7ff404071050 2023-07-06T22:00:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff409c95640 1 -- 172.21.15.55:0/3414385332 >> v1:172.21.15.138:6789/0 conn(0x7ff404071050 legacy=0x7ff4040cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff409c95640 1 -- 172.21.15.55:0/3414385332 >> v1:172.21.15.55:6789/0 conn(0x7ff4040cda40 legacy=0x7ff4040cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.130+0000 7ff409c95640 1 -- 172.21.15.55:0/3414385332 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff404071540 con 0x7ff404160030 2023-07-06T22:00:04.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.134+0000 7ff409c95640 1 --2- 172.21.15.55:0/3414385332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff404160030 0x7ff404070b10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff4000097c0 tx=0x7ff40001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4add64eeeea6cd7a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.134+0000 7ff408c93640 1 -- 172.21.15.55:0/3414385332 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4000ab600 con 0x7ff404160030 2023-07-06T22:00:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.134+0000 7ff408c93640 1 -- 172.21.15.55:0/3414385332 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4000a7050 con 0x7ff404160030 2023-07-06T22:00:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.134+0000 7ff408c93640 1 -- 172.21.15.55:0/3414385332 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4000ab980 con 0x7ff404160030 2023-07-06T22:00:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.134+0000 7ff40bef9640 1 -- 172.21.15.55:0/3414385332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff404160030 msgr2=0x7ff404070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.134+0000 7ff40bef9640 1 --2- 172.21.15.55:0/3414385332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff404160030 0x7ff404070b10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff4000097c0 tx=0x7ff40001c480 comp rx=0 tx=0).stop 2023-07-06T22:00:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.134+0000 7ff40bef9640 1 -- 172.21.15.55:0/3414385332 shutdown_connections 2023-07-06T22:00:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.134+0000 7ff40bef9640 1 --2- 172.21.15.55:0/3414385332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff404160030 0x7ff404070b10 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.134+0000 7ff40bef9640 1 -- 172.21.15.55:0/3414385332 >> 172.21.15.55:0/3414385332 conn(0x7ff4040cded0 msgr2=0x7ff4040ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:04.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.134+0000 7ff40bef9640 1 -- 172.21.15.55:0/3414385332 shutdown_connections 2023-07-06T22:00:04.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.134+0000 7ff40bef9640 1 -- 172.21.15.55:0/3414385332 wait complete. 2023-07-06T22:00:04.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff40bef9640 1 Processor -- start 2023-07-06T22:00:04.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff40bef9640 1 -- start start 2023-07-06T22:00:04.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff40bef9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff404071050 0x7ff40415c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff40bef9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4040cda40 0x7ff4040c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff40bef9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff404160030 0x7ff4040c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff40bef9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40415cad0 con 0x7ff4040cda40 2023-07-06T22:00:04.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff40bef9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40415d730 con 0x7ff404160030 2023-07-06T22:00:04.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff40bef9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40415dcf0 con 0x7ff404071050 2023-07-06T22:00:04.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff409494640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4040cda40 0x7ff4040c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff409494640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4040cda40 0x7ff4040c4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56344/0 (socket says 172.21.15.55:56344) 2023-07-06T22:00:04.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff409494640 1 -- 172.21.15.55:0/130785121 learned_addr learned my addr 172.21.15.55:0/130785121 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:04.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff40a496640 1 --2- 172.21.15.55:0/130785121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff404160030 0x7ff4040c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff409c95640 1 --2- 172.21.15.55:0/130785121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff404071050 0x7ff40415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff409494640 1 -- 172.21.15.55:0/130785121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff404071050 msgr2=0x7ff40415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff409494640 1 --2- 172.21.15.55:0/130785121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff404071050 0x7ff40415c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff409494640 1 -- 172.21.15.55:0/130785121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff404160030 msgr2=0x7ff4040c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff409494640 1 --2- 172.21.15.55:0/130785121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff404160030 0x7ff4040c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff409494640 1 -- 172.21.15.55:0/130785121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400009420 con 0x7ff4040cda40 2023-07-06T22:00:04.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff409494640 1 --2- 172.21.15.55:0/130785121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4040cda40 0x7ff4040c4fa0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400c4c0 tx=0x7ff3f400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff3fa7fc640 1 -- 172.21.15.55:0/130785121 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40052d0 con 0x7ff4040cda40 2023-07-06T22:00:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff3fa7fc640 1 -- 172.21.15.55:0/130785121 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f4005430 con 0x7ff4040cda40 2023-07-06T22:00:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff40bef9640 1 -- 172.21.15.55:0/130785121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40415ccc0 con 0x7ff4040cda40 2023-07-06T22:00:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.138+0000 7ff3fa7fc640 1 -- 172.21.15.55:0/130785121 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4012870 con 0x7ff4040cda40 2023-07-06T22:00:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.142+0000 7ff40bef9640 1 -- 172.21.15.55:0/130785121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40415d980 con 0x7ff4040cda40 2023-07-06T22:00:04.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.142+0000 7ff40bef9640 1 -- 172.21.15.55:0/130785121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff404066d60 con 0x7ff4040cda40 2023-07-06T22:00:04.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.142+0000 7ff3fa7fc640 1 -- 172.21.15.55:0/130785121 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 57) v1 ==== 85496+0+0 (secure 0 0 0) 0x7ff3f40129d0 con 0x7ff4040cda40 2023-07-06T22:00:04.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.142+0000 7ff3fa7fc640 1 --2- 172.21.15.55:0/130785121 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff3e80660d0 0x7ff3e8068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.142+0000 7ff3fa7fc640 1 -- 172.21.15.55:0/130785121 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 7156+0+0 (secure 0 0 0) 0x7ff3f40838b0 con 0x7ff4040cda40 2023-07-06T22:00:04.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.142+0000 7ff409c95640 1 --2- 172.21.15.55:0/130785121 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff3e80660d0 0x7ff3e8068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.142+0000 7ff409c95640 1 --2- 172.21.15.55:0/130785121 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff3e80660d0 0x7ff3e8068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff4000ad000 tx=0x7ff400008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:04.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.146+0000 7ff3fa7fc640 1 -- 172.21.15.55:0/130785121 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3f4050c00 con 0x7ff4040cda40 2023-07-06T22:00:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.302+0000 7ff40bef9640 1 -- 172.21.15.55:0/130785121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4040b3e50 con 0x7ff4040cda40 2023-07-06T22:00:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.302+0000 7ff3fa7fc640 1 -- 172.21.15.55:0/130785121 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+19615 (secure 0 0 0) 0x7ff3f4054220 con 0x7ff4040cda40 2023-07-06T22:00:04.303 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:04.303 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":119,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:00:02.978319+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:58:37.143680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-07-06T21:58:38.234438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3099491809":"2023-07-07T22:00:02.978277+0000","172.21.15.55:6833/3474707671":"2023-07-07T22:00:02.978277+0000","172.21.15.55:6832/3474707671":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/2279917696":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/339003487":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/3514720666":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/1287872080":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/3568077879":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/4046135553":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/2589708229":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/782998468":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/4121483447":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/1183916649":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/11434186":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/494913604":"2023-07-07T21:58:55.799288+0000","172.21.15.55:6833/1408736549":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/106272164":"2023-07-07T22:00:02.978277+0000","172.21.15.55:6832/1408736549":"2023-07-07T21:58:55.799288+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:00:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.306+0000 7ff40bef9640 1 -- 172.21.15.55:0/130785121 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff3e80660d0 msgr2=0x7ff3e8068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.306+0000 7ff40bef9640 1 --2- 172.21.15.55:0/130785121 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff3e80660d0 0x7ff3e8068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff4000ad000 tx=0x7ff400008040 comp rx=0 tx=0).stop 2023-07-06T22:00:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.306+0000 7ff40bef9640 1 -- 172.21.15.55:0/130785121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4040cda40 msgr2=0x7ff4040c4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.306+0000 7ff40bef9640 1 --2- 172.21.15.55:0/130785121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4040cda40 0x7ff4040c4fa0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400c4c0 tx=0x7ff3f400c980 comp rx=0 tx=0).stop 2023-07-06T22:00:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.306+0000 7ff40bef9640 1 -- 172.21.15.55:0/130785121 shutdown_connections 2023-07-06T22:00:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.306+0000 7ff40bef9640 1 --2- 172.21.15.55:0/130785121 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff3e80660d0 0x7ff3e8068580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.306+0000 7ff40bef9640 1 --2- 172.21.15.55:0/130785121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff404160030 0x7ff4040c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.306+0000 7ff40bef9640 1 --2- 172.21.15.55:0/130785121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4040cda40 0x7ff4040c4fa0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.306+0000 7ff40bef9640 1 --2- 172.21.15.55:0/130785121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff404071050 0x7ff40415c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.306+0000 7ff40bef9640 1 -- 172.21.15.55:0/130785121 >> 172.21.15.55:0/130785121 conn(0x7ff4040cded0 msgr2=0x7ff4040ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:04.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.306+0000 7ff40bef9640 1 -- 172.21.15.55:0/130785121 shutdown_connections 2023-07-06T22:00:04.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.306+0000 7ff40bef9640 1 -- 172.21.15.55:0/130785121 wait complete. 2023-07-06T22:00:04.324 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T22:00:04.324 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:00:04.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.466+0000 7fd9b8ff6640 1 Processor -- start 2023-07-06T22:00:04.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.466+0000 7fd9b8ff6640 1 -- start start 2023-07-06T22:00:04.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.470+0000 7fd9b8ff6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd9b40b7cd0 0x7fd9b40ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.470+0000 7fd9b8ff6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9b40b1fe0 0x7fd9b415f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.470+0000 7fd9b8ff6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b40cecf0 con 0x7fd9b40ccab0 2023-07-06T22:00:04.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.470+0000 7fd9b8ff6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b40d2310 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.470+0000 7fd9b8ff6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b40b80a0 con 0x7fd9b40b7cd0 2023-07-06T22:00:04.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.470+0000 7fd9abfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd9b40ccab0 0x7fd9b40b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46114/0 (socket says 172.21.15.55:46114) 2023-07-06T22:00:04.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.470+0000 7fd9abfff640 1 -- 172.21.15.55:0/210032010 learned_addr learned my addr 172.21.15.55:0/210032010 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:04.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.470+0000 7fd9b2d9d640 1 --2- 172.21.15.55:0/210032010 >> v2:172.21.15.55:3300/0 conn(0x7fd9b40b1fe0 0x7fd9b415f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.470+0000 7fd9b2d9d640 1 -- 172.21.15.55:0/210032010 >> v2:172.21.15.138:3300/0 conn(0x7fd9b40b7cd0 msgr2=0x7fd9b40ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:04.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.470+0000 7fd9b1d9b640 1 -- 172.21.15.55:0/210032010 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793837468 0 0) 0x7fd9b40cecf0 con 0x7fd9b40ccab0 2023-07-06T22:00:04.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.470+0000 7fd9b2d9d640 1 --2- 172.21.15.55:0/210032010 >> v2:172.21.15.138:3300/0 conn(0x7fd9b40b7cd0 0x7fd9b40ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.470+0000 7fd9b2d9d640 1 -- 172.21.15.55:0/210032010 >> v1:172.21.15.55:6789/0 conn(0x7fd9b40ccab0 legacy=0x7fd9b40b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.470+0000 7fd9b2d9d640 1 -- 172.21.15.55:0/210032010 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b40d1d90 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.470+0000 7fd9b2d9d640 1 --2- 172.21.15.55:0/210032010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9b40b1fe0 0x7fd9b415f870 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fd9b408b5d0 tx=0x7fd9ac01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ae9c715c8a6a00 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:04.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b1d9b640 1 -- 172.21.15.55:0/210032010 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac0a5740 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b1d9b640 1 -- 172.21.15.55:0/210032010 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac0a58a0 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b1d9b640 1 -- 172.21.15.55:0/210032010 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac0a5c30 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/210032010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9b40b1fe0 msgr2=0x7fd9b415f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 --2- 172.21.15.55:0/210032010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9b40b1fe0 0x7fd9b415f870 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fd9b408b5d0 tx=0x7fd9ac01c880 comp rx=0 tx=0).stop 2023-07-06T22:00:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/210032010 shutdown_connections 2023-07-06T22:00:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 --2- 172.21.15.55:0/210032010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9b40b1fe0 0x7fd9b415f870 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 --2- 172.21.15.55:0/210032010 >> v2:172.21.15.138:3300/0 conn(0x7fd9b40b7cd0 0x7fd9b40ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/210032010 >> 172.21.15.55:0/210032010 conn(0x7fd9b40ceee0 msgr2=0x7fd9b40cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:04.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/210032010 shutdown_connections 2023-07-06T22:00:04.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/210032010 wait complete. 2023-07-06T22:00:04.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 Processor -- start 2023-07-06T22:00:04.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 -- start start 2023-07-06T22:00:04.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9b40b1fe0 0x7fd9b414c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9b40b7cd0 0x7fd9b4156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd9b40ccab0 0x7fd9b4156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b415acd0 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b4156ab0 con 0x7fd9b40b7cd0 2023-07-06T22:00:04.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.474+0000 7fd9b8ff6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b414f310 con 0x7fd9b40ccab0 2023-07-06T22:00:04.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9b259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9b40b1fe0 0x7fd9b414c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9b259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9b40b1fe0 0x7fd9b414c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56362/0 (socket says 172.21.15.55:56362) 2023-07-06T22:00:04.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9b259c640 1 -- 172.21.15.55:0/67145846 learned_addr learned my addr 172.21.15.55:0/67145846 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:04.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9abfff640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9b40b7cd0 0x7fd9b4156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9b2d9d640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd9b40ccab0 0x7fd9b4156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9b259c640 1 -- 172.21.15.55:0/67145846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd9b40ccab0 msgr2=0x7fd9b4156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9b259c640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd9b40ccab0 0x7fd9b4156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9b259c640 1 -- 172.21.15.55:0/67145846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9b40b7cd0 msgr2=0x7fd9b4156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9b259c640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9b40b7cd0 0x7fd9b4156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9b259c640 1 -- 172.21.15.55:0/67145846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac009a70 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9abfff640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9b40b7cd0 0x7fd9b4156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:04.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9b259c640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9b40b1fe0 0x7fd9b414c6f0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400b580 tx=0x7fd9a400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:04.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9aaffd640 1 -- 172.21.15.55:0/67145846 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4010870 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9aaffd640 1 -- 172.21.15.55:0/67145846 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a40109f0 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9aaffd640 1 -- 172.21.15.55:0/67145846 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4010da0 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/67145846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b415b4e0 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/67145846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b415af20 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/67145846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b4066d60 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.478+0000 7fd9aaffd640 1 -- 172.21.15.55:0/67145846 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 57) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fd9a400f3c0 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.482+0000 7fd9aaffd640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fd9940660d0 0x7fd994068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.482+0000 7fd9aaffd640 1 -- 172.21.15.55:0/67145846 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 7156+0+0 (secure 0 0 0) 0x7fd9a4083f80 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.482+0000 7fd9abfff640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fd9940660d0 0x7fd994068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.482+0000 7fd9abfff640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fd9940660d0 0x7fd994068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd99c000f70 tx=0x7fd99c007cb0 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:04.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.486+0000 7fd9aaffd640 1 -- 172.21.15.55:0/67145846 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9a40511a0 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.674+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/67145846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9b414d940 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.678+0000 7fd9aaffd640 1 -- 172.21.15.55:0/67145846 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4673 (secure 0 0 0) 0x7fd9a40547c0 con 0x7fd9b40b1fe0 2023-07-06T22:00:04.676 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:04.677 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4122510097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4122510097},{"type":"v1","addr":"172.21.15.138:6835","nonce":4122510097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/154452928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":154452928},{"type":"v1","addr":"172.21.15.55:6836","nonce":154452928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8037,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/414200688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":414200688},{"type":"v1","addr":"172.21.15.55:6837","nonce":414200688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:58:39.245889+0000","modified":"2023-07-06T21:58:42.261872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8049},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8049":{"gid":8049,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6833/1552399486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1552399486},{"type":"v1","addr":"172.21.15.138:6833","nonce":1552399486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-06T22:00:04.677 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 47 2023-07-06T22:00:04.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.678+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/67145846 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fd9940660d0 msgr2=0x7fd994068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.678+0000 7fd9b8ff6640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fd9940660d0 0x7fd994068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd99c000f70 tx=0x7fd99c007cb0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.678+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/67145846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9b40b1fe0 msgr2=0x7fd9b414c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.678+0000 7fd9b8ff6640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9b40b1fe0 0x7fd9b414c6f0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400b580 tx=0x7fd9a400ba40 comp rx=0 tx=0).stop 2023-07-06T22:00:04.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.678+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/67145846 shutdown_connections 2023-07-06T22:00:04.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.678+0000 7fd9b8ff6640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fd9940660d0 0x7fd994068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.678+0000 7fd9b8ff6640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd9b40ccab0 0x7fd9b4156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.678+0000 7fd9b8ff6640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9b40b7cd0 0x7fd9b4156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.678+0000 7fd9b8ff6640 1 --2- 172.21.15.55:0/67145846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9b40b1fe0 0x7fd9b414c6f0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.678+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/67145846 >> 172.21.15.55:0/67145846 conn(0x7fd9b40ceee0 msgr2=0x7fd9b40cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:04.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.678+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/67145846 shutdown_connections 2023-07-06T22:00:04.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.678+0000 7fd9b8ff6640 1 -- 172.21.15.55:0/67145846 wait complete. 2023-07-06T22:00:04.697 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:00:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.838+0000 7f8d3f40b640 1 Processor -- start 2023-07-06T22:00:04.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3f40b640 1 -- start start 2023-07-06T22:00:04.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3f40b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8d380b12e0 0x7f8d380d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3f40b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d380d00f0 0x7f8d380d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3f40b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d380d0a80 con 0x7f8d380b1a40 2023-07-06T22:00:04.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3f40b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d380b3be0 con 0x7f8d380b12e0 2023-07-06T22:00:04.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3f40b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380b4590 con 0x7f8d380d00f0 2023-07-06T22:00:04.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3ec0a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8d380b1a40 0x7f8d380b1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46124/0 (socket says 172.21.15.55:46124) 2023-07-06T22:00:04.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3ec0a640 1 -- 172.21.15.55:0/3243993046 learned_addr learned my addr 172.21.15.55:0/3243993046 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:04.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 -- 172.21.15.55:0/3243993046 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838829022 0 0) 0x7f8d300014a0 con 0x7f8d380b1a40 2023-07-06T22:00:04.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 -- 172.21.15.55:0/3243993046 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d24003530 con 0x7f8d380b1a40 2023-07-06T22:00:04.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 -- 172.21.15.55:0/3243993046 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 956124133 0 0) 0x7f8d24003530 con 0x7f8d380b1a40 2023-07-06T22:00:04.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 -- 172.21.15.55:0/3243993046 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d380d00f0 msgr2=0x7f8d380d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:04.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 --2- 172.21.15.55:0/3243993046 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d380d00f0 0x7f8d380d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 -- 172.21.15.55:0/3243993046 >> v2:172.21.15.138:3300/0 conn(0x7f8d380b12e0 msgr2=0x7f8d380d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:04.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 --2- 172.21.15.55:0/3243993046 >> v2:172.21.15.138:3300/0 conn(0x7f8d380b12e0 0x7f8d380d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 -- 172.21.15.55:0/3243993046 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d380b16b0 con 0x7f8d380b1a40 2023-07-06T22:00:04.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 -- 172.21.15.55:0/3243993046 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f8d30001b90 con 0x7f8d380b1a40 2023-07-06T22:00:04.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 -- 172.21.15.55:0/3243993046 >> v1:172.21.15.55:6789/0 conn(0x7f8d380b1a40 legacy=0x7f8d380b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 --2- 172.21.15.55:0/3243993046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d24003980 0x7f8d24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 --2- 172.21.15.55:0/3243993046 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d380d00f0 0x7f8d240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 --2- 172.21.15.55:0/3243993046 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d24004d60 0x7f8d240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 -- 172.21.15.55:0/3243993046 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380b4590 con 0x7f8d24003980 2023-07-06T22:00:04.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 -- 172.21.15.55:0/3243993046 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2400bb70 con 0x7f8d24004d60 2023-07-06T22:00:04.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3d407640 1 -- 172.21.15.55:0/3243993046 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2400bd30 con 0x7f8d380d00f0 2023-07-06T22:00:04.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3e409640 1 --2- 172.21.15.55:0/3243993046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d24003980 0x7f8d24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3ec0a640 1 --2- 172.21.15.55:0/3243993046 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d24004d60 0x7f8d240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3e409640 1 -- 172.21.15.55:0/3243993046 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d380d00f0 msgr2=0x7f8d240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:04.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3e409640 1 --2- 172.21.15.55:0/3243993046 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d380d00f0 0x7f8d240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3e409640 1 -- 172.21.15.55:0/3243993046 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d24004d60 msgr2=0x7f8d240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:04.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3e409640 1 --2- 172.21.15.55:0/3243993046 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d24004d60 0x7f8d240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.842+0000 7f8d3e409640 1 -- 172.21.15.55:0/3243993046 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d24003530 con 0x7f8d24003980 2023-07-06T22:00:04.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.846+0000 7f8d3e409640 1 --2- 172.21.15.55:0/3243993046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d24003980 0x7f8d24003d90 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009860 tx=0x7f8d3401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fcf2178d03bc43 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:04.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.846+0000 7f8d3d407640 1 -- 172.21.15.55:0/3243993046 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340ab600 con 0x7f8d24003980 2023-07-06T22:00:04.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.846+0000 7f8d3d407640 1 -- 172.21.15.55:0/3243993046 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d340a7050 con 0x7f8d24003980 2023-07-06T22:00:04.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.846+0000 7f8d3d407640 1 -- 172.21.15.55:0/3243993046 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340ab9c0 con 0x7f8d24003980 2023-07-06T22:00:04.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.846+0000 7f8d3f40b640 1 -- 172.21.15.55:0/3243993046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d24003980 msgr2=0x7f8d24003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.846+0000 7f8d3f40b640 1 --2- 172.21.15.55:0/3243993046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d24003980 0x7f8d24003d90 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009860 tx=0x7f8d3401c340 comp rx=0 tx=0).stop 2023-07-06T22:00:04.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.846+0000 7f8d3ec0a640 1 -- 172.21.15.55:0/3243993046 reap_dead start 2023-07-06T22:00:04.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.846+0000 7f8d3f40b640 1 -- 172.21.15.55:0/3243993046 shutdown_connections 2023-07-06T22:00:04.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.846+0000 7f8d3f40b640 1 -- 172.21.15.55:0/3243993046 >> 172.21.15.55:0/3243993046 conn(0x7f8d380d20e0 msgr2=0x7f8d380d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:04.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.846+0000 7f8d3f40b640 1 -- 172.21.15.55:0/3243993046 shutdown_connections 2023-07-06T22:00:04.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.846+0000 7f8d3f40b640 1 -- 172.21.15.55:0/3243993046 wait complete. 2023-07-06T22:00:04.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3f40b640 1 Processor -- start 2023-07-06T22:00:04.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3f40b640 1 -- start start 2023-07-06T22:00:04.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3f40b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d24003980 0x7f8d3815f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3f40b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d38161820 0x7f8d38147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3f40b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d38147ac0 0x7f8d3815e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3f40b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380c6ed0 con 0x7f8d24003980 2023-07-06T22:00:04.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3f40b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d381484c0 con 0x7f8d38147ac0 2023-07-06T22:00:04.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3f40b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d38162270 con 0x7f8d38161820 2023-07-06T22:00:04.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3e409640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d24003980 0x7f8d3815f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3e409640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d24003980 0x7f8d3815f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56386/0 (socket says 172.21.15.55:56386) 2023-07-06T22:00:04.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3e409640 1 -- 172.21.15.55:0/2598598239 learned_addr learned my addr 172.21.15.55:0/2598598239 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:04.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3ec0a640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d38147ac0 0x7f8d3815e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3dc08640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d38161820 0x7f8d38147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3e409640 1 -- 172.21.15.55:0/2598598239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d38161820 msgr2=0x7f8d38147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3e409640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d38161820 0x7f8d38147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3e409640 1 -- 172.21.15.55:0/2598598239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d38147ac0 msgr2=0x7f8d3815e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:04.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3e409640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d38147ac0 0x7f8d3815e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:04.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3e409640 1 -- 172.21.15.55:0/2598598239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38147f60 con 0x7f8d24003980 2023-07-06T22:00:04.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3ec0a640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d38147ac0 0x7f8d3815e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:04.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3e409640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d24003980 0x7f8d3815f220 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f8d3401c170 tx=0x7f8d24005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:04.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d2effd640 1 -- 172.21.15.55:0/2598598239 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34003b10 con 0x7f8d24003980 2023-07-06T22:00:04.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d2effd640 1 -- 172.21.15.55:0/2598598239 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d34003c70 con 0x7f8d24003980 2023-07-06T22:00:04.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3f40b640 1 -- 172.21.15.55:0/2598598239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d380c6b30 con 0x7f8d24003980 2023-07-06T22:00:04.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d2effd640 1 -- 172.21.15.55:0/2598598239 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340b4400 con 0x7f8d24003980 2023-07-06T22:00:04.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.850+0000 7f8d3f40b640 1 -- 172.21.15.55:0/2598598239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d38161f90 con 0x7f8d24003980 2023-07-06T22:00:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.854+0000 7f8d3f40b640 1 -- 172.21.15.55:0/2598598239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d380c6990 con 0x7f8d24003980 2023-07-06T22:00:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.854+0000 7f8d2effd640 1 -- 172.21.15.55:0/2598598239 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 57) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f8d340b2040 con 0x7f8d24003980 2023-07-06T22:00:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.854+0000 7f8d2effd640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f8d1c066100 0x7f8d1c0685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.854+0000 7f8d2effd640 1 -- 172.21.15.55:0/2598598239 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 7156+0+0 (secure 0 0 0) 0x7f8d3411db60 con 0x7f8d24003980 2023-07-06T22:00:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.854+0000 7f8d3dc08640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f8d1c066100 0x7f8d1c0685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.854+0000 7f8d3dc08640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f8d1c066100 0x7f8d1c0685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8d28006fd0 tx=0x7f8d28008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:04.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:04.858+0000 7f8d2effd640 1 -- 172.21.15.55:0/2598598239 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8d380c6990 con 0x7f8d24003980 2023-07-06T22:00:05.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.050+0000 7f8d3f40b640 1 -- 172.21.15.55:0/2598598239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d380c6990 con 0x7f8d24003980 2023-07-06T22:00:05.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.050+0000 7f8d2effd640 1 -- 172.21.15.55:0/2598598239 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f8d380c6990 con 0x7f8d24003980 2023-07-06T22:00:05.050 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:05.050 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4122510097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4122510097},{"type":"v1","addr":"172.21.15.138:6835","nonce":4122510097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/154452928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":154452928},{"type":"v1","addr":"172.21.15.55:6836","nonce":154452928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8037,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/414200688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":414200688},{"type":"v1","addr":"172.21.15.55:6837","nonce":414200688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T21:58:39.245889+0000","modified":"2023-07-06T21:58:42.261872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8049},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8049":{"gid":8049,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6833/1552399486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1552399486},{"type":"v1","addr":"172.21.15.138:6833","nonce":1552399486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-06T22:00:05.051 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 47 2023-07-06T22:00:05.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.050+0000 7f8d3f40b640 1 -- 172.21.15.55:0/2598598239 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f8d1c066100 msgr2=0x7f8d1c0685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:05.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.050+0000 7f8d3f40b640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f8d1c066100 0x7f8d1c0685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8d28006fd0 tx=0x7f8d28008040 comp rx=0 tx=0).stop 2023-07-06T22:00:05.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.050+0000 7f8d3f40b640 1 -- 172.21.15.55:0/2598598239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d24003980 msgr2=0x7f8d3815f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:05.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.050+0000 7f8d3f40b640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d24003980 0x7f8d3815f220 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f8d3401c170 tx=0x7f8d24005800 comp rx=0 tx=0).stop 2023-07-06T22:00:05.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.050+0000 7f8d3f40b640 1 -- 172.21.15.55:0/2598598239 shutdown_connections 2023-07-06T22:00:05.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.050+0000 7f8d3f40b640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f8d1c066100 0x7f8d1c0685b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.050+0000 7f8d3f40b640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d38147ac0 0x7f8d3815e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.050+0000 7f8d3f40b640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d38161820 0x7f8d38147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.050+0000 7f8d3f40b640 1 --2- 172.21.15.55:0/2598598239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d24003980 0x7f8d3815f220 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.050+0000 7f8d3f40b640 1 -- 172.21.15.55:0/2598598239 >> 172.21.15.55:0/2598598239 conn(0x7f8d380d20e0 msgr2=0x7f8d38165b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:05.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.054+0000 7f8d3f40b640 1 -- 172.21.15.55:0/2598598239 shutdown_connections 2023-07-06T22:00:05.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.054+0000 7f8d3f40b640 1 -- 172.21.15.55:0/2598598239 wait complete. 2023-07-06T22:00:05.071 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:00:05.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.214+0000 7f596786d640 1 Processor -- start 2023-07-06T22:00:05.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.214+0000 7f596786d640 1 -- start start 2023-07-06T22:00:05.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.218+0000 7f596786d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59600cd330 0x7f59600cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:05.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.218+0000 7f596786d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f59600cbce0 0x7f59600cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:05.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.218+0000 7f596786d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596006bd00 con 0x7f5960160030 2023-07-06T22:00:05.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.218+0000 7f596786d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5960160400 con 0x7f59600cd330 2023-07-06T22:00:05.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.218+0000 7f596786d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59600cdce0 con 0x7f59600cbce0 2023-07-06T22:00:05.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.218+0000 7f5964e08640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59600cd330 0x7f59600cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:05.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.218+0000 7f5964e08640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59600cd330 0x7f59600cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56396/0 (socket says 172.21.15.55:56396) 2023-07-06T22:00:05.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.218+0000 7f5964e08640 1 -- 172.21.15.55:0/3458648890 learned_addr learned my addr 172.21.15.55:0/3458648890 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:05.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.218+0000 7f5965e0a640 1 --2- 172.21.15.55:0/3458648890 >> v2:172.21.15.138:3300/0 conn(0x7f59600cbce0 0x7f59600cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:05.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.218+0000 7f5964e08640 1 -- 172.21.15.55:0/3458648890 >> v2:172.21.15.138:3300/0 conn(0x7f59600cbce0 msgr2=0x7f59600cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:05.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.218+0000 7f5964e08640 1 --2- 172.21.15.55:0/3458648890 >> v2:172.21.15.138:3300/0 conn(0x7f59600cbce0 0x7f59600cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.218+0000 7f5964e08640 1 -- 172.21.15.55:0/3458648890 >> v1:172.21.15.138:6789/0 conn(0x7f5960160030 legacy=0x7f5960070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:05.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.218+0000 7f5964e08640 1 -- 172.21.15.55:0/3458648890 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600c9ba0 con 0x7f59600cd330 2023-07-06T22:00:05.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f5964e08640 1 --2- 172.21.15.55:0/3458648890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59600cd330 0x7f59600cd7a0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f59600ad900 tx=0x7f595001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7acee81760bef1e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:05.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f5957fff640 1 -- 172.21.15.55:0/3458648890 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59500ab600 con 0x7f59600cd330 2023-07-06T22:00:05.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f5957fff640 1 -- 172.21.15.55:0/3458648890 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59500a7050 con 0x7f59600cd330 2023-07-06T22:00:05.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f5957fff640 1 -- 172.21.15.55:0/3458648890 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59500ab980 con 0x7f59600cd330 2023-07-06T22:00:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f596786d640 1 -- 172.21.15.55:0/3458648890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59600cd330 msgr2=0x7f59600cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f596786d640 1 --2- 172.21.15.55:0/3458648890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59600cd330 0x7f59600cd7a0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f59600ad900 tx=0x7f595001c4c0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f596786d640 1 -- 172.21.15.55:0/3458648890 shutdown_connections 2023-07-06T22:00:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f596786d640 1 --2- 172.21.15.55:0/3458648890 >> v2:172.21.15.138:3300/0 conn(0x7f59600cbce0 0x7f59600cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f596786d640 1 --2- 172.21.15.55:0/3458648890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59600cd330 0x7f59600cd7a0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f596786d640 1 -- 172.21.15.55:0/3458648890 >> 172.21.15.55:0/3458648890 conn(0x7f59600cded0 msgr2=0x7f59600ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f596786d640 1 -- 172.21.15.55:0/3458648890 shutdown_connections 2023-07-06T22:00:05.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f596786d640 1 -- 172.21.15.55:0/3458648890 wait complete. 2023-07-06T22:00:05.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f596786d640 1 Processor -- start 2023-07-06T22:00:05.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f596786d640 1 -- start start 2023-07-06T22:00:05.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.222+0000 7f596786d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59600cbce0 0x7f5960159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:05.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f596786d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59600cd330 0x7f5960159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:05.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f596786d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5960160030 0x7f59600c3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:05.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f596786d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596015f660 con 0x7f5960160030 2023-07-06T22:00:05.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f596786d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596015f8b0 con 0x7f59600cbce0 2023-07-06T22:00:05.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f596786d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596015fb90 con 0x7f59600cd330 2023-07-06T22:00:05.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5965e0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5960160030 0x7f59600c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5965e0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5960160030 0x7f59600c3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56408/0 (socket says 172.21.15.55:56408) 2023-07-06T22:00:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5965e0a640 1 -- 172.21.15.55:0/3861731544 learned_addr learned my addr 172.21.15.55:0/3861731544 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5964e08640 1 --2- 172.21.15.55:0/3861731544 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59600cd330 0x7f5960159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5965609640 1 --2- 172.21.15.55:0/3861731544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59600cbce0 0x7f5960159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5965e0a640 1 -- 172.21.15.55:0/3861731544 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59600cd330 msgr2=0x7f5960159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5965e0a640 1 --2- 172.21.15.55:0/3861731544 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59600cd330 0x7f5960159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5965e0a640 1 -- 172.21.15.55:0/3861731544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59600cbce0 msgr2=0x7f5960159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:05.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5965e0a640 1 --2- 172.21.15.55:0/3861731544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59600cbce0 0x7f5960159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5965e0a640 1 -- 172.21.15.55:0/3861731544 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59500094d0 con 0x7f5960160030 2023-07-06T22:00:05.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5965e0a640 1 --2- 172.21.15.55:0/3861731544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5960160030 0x7f59600c3330 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f5958007e60 tx=0x7f595800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:05.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5955ffb640 1 -- 172.21.15.55:0/3861731544 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958014420 con 0x7f5960160030 2023-07-06T22:00:05.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5955ffb640 1 -- 172.21.15.55:0/3861731544 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59580145a0 con 0x7f5960160030 2023-07-06T22:00:05.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5955ffb640 1 -- 172.21.15.55:0/3861731544 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958014950 con 0x7f5960160030 2023-07-06T22:00:05.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f596786d640 1 -- 172.21.15.55:0/3861731544 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59600c1aa0 con 0x7f5960160030 2023-07-06T22:00:05.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f596786d640 1 -- 172.21.15.55:0/3861731544 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5960159c70 con 0x7f5960160030 2023-07-06T22:00:05.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f596786d640 1 -- 172.21.15.55:0/3861731544 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5960066d60 con 0x7f5960160030 2023-07-06T22:00:05.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.226+0000 7f5955ffb640 1 -- 172.21.15.55:0/3861731544 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 57) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f5958014ab0 con 0x7f5960160030 2023-07-06T22:00:05.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.230+0000 7f5955ffb640 1 --2- 172.21.15.55:0/3861731544 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f59440660d0 0x7f5944068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.230+0000 7f5955ffb640 1 -- 172.21.15.55:0/3861731544 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 7156+0+0 (secure 0 0 0) 0x7f5958084570 con 0x7f5960160030 2023-07-06T22:00:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.230+0000 7f5965609640 1 --2- 172.21.15.55:0/3861731544 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f59440660d0 0x7f5944068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.230+0000 7f5965609640 1 --2- 172.21.15.55:0/3861731544 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f59440660d0 0x7f5944068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f59601fbfd0 tx=0x7f595c007e40 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:05.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.234+0000 7f5955ffb640 1 -- 172.21.15.55:0/3861731544 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5958055420 con 0x7f5960160030 2023-07-06T22:00:05.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.390+0000 7f596786d640 1 -- 172.21.15.55:0/3861731544 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59600b3e50 con 0x7f5960160030 2023-07-06T22:00:05.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.394+0000 7f5955ffb640 1 -- 172.21.15.55:0/3861731544 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+19615 (secure 0 0 0) 0x7f5958054fb0 con 0x7f5960160030 2023-07-06T22:00:05.393 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:05.393 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":119,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:00:02.978319+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-07-06T21:58:37.143680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-07-06T21:58:38.234438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3099491809":"2023-07-07T22:00:02.978277+0000","172.21.15.55:6833/3474707671":"2023-07-07T22:00:02.978277+0000","172.21.15.55:6832/3474707671":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/2279917696":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/339003487":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/3514720666":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/1287872080":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/3568077879":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/4046135553":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/2589708229":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/782998468":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/4121483447":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/1183916649":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/11434186":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/494913604":"2023-07-07T21:58:55.799288+0000","172.21.15.55:6833/1408736549":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/106272164":"2023-07-07T22:00:02.978277+0000","172.21.15.55:6832/1408736549":"2023-07-07T21:58:55.799288+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:00:05.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.394+0000 7f596786d640 1 -- 172.21.15.55:0/3861731544 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f59440660d0 msgr2=0x7f5944068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:05.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.394+0000 7f596786d640 1 --2- 172.21.15.55:0/3861731544 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f59440660d0 0x7f5944068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f59601fbfd0 tx=0x7f595c007e40 comp rx=0 tx=0).stop 2023-07-06T22:00:05.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.394+0000 7f596786d640 1 -- 172.21.15.55:0/3861731544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5960160030 msgr2=0x7f59600c3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:05.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.394+0000 7f596786d640 1 --2- 172.21.15.55:0/3861731544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5960160030 0x7f59600c3330 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f5958007e60 tx=0x7f595800e4b0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.394+0000 7f596786d640 1 -- 172.21.15.55:0/3861731544 shutdown_connections 2023-07-06T22:00:05.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.394+0000 7f596786d640 1 --2- 172.21.15.55:0/3861731544 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f59440660d0 0x7f5944068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.394+0000 7f596786d640 1 --2- 172.21.15.55:0/3861731544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5960160030 0x7f59600c3330 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.394+0000 7f596786d640 1 --2- 172.21.15.55:0/3861731544 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59600cd330 0x7f5960159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.394+0000 7f596786d640 1 --2- 172.21.15.55:0/3861731544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59600cbce0 0x7f5960159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.394+0000 7f596786d640 1 -- 172.21.15.55:0/3861731544 >> 172.21.15.55:0/3861731544 conn(0x7f59600cded0 msgr2=0x7f59600706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:05.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.394+0000 7f596786d640 1 -- 172.21.15.55:0/3861731544 shutdown_connections 2023-07-06T22:00:05.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.394+0000 7f596786d640 1 -- 172.21.15.55:0/3861731544 wait complete. 2023-07-06T22:00:05.414 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T22:00:05.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.558+0000 7fbd27a0b640 1 Processor -- start 2023-07-06T22:00:05.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.558+0000 7fbd27a0b640 1 -- start start 2023-07-06T22:00:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.562+0000 7fbd27a0b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbd200c11a0 0x7fbd200cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.562+0000 7fbd27a0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd200c84a0 0x7fbd200c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.562+0000 7fbd27a0b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd200ccd70 con 0x7fbd2006eee0 2023-07-06T22:00:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.562+0000 7fbd27a0b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd201605f0 con 0x7fbd200c11a0 2023-07-06T22:00:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.562+0000 7fbd27a0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2006ce00 con 0x7fbd200c84a0 2023-07-06T22:00:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.562+0000 7fbd25fa8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd200c84a0 0x7fbd200c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.562+0000 7fbd25fa8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd200c84a0 0x7fbd200c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44520/0 (socket says 172.21.15.55:44520) 2023-07-06T22:00:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.562+0000 7fbd25fa8640 1 -- 172.21.15.55:0/3243105307 learned_addr learned my addr 172.21.15.55:0/3243105307 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.562+0000 7fbd257a7640 1 --2- 172.21.15.55:0/3243105307 >> v2:172.21.15.138:3300/0 conn(0x7fbd200c11a0 0x7fbd200cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.562+0000 7fbd25fa8640 1 -- 172.21.15.55:0/3243105307 >> v2:172.21.15.138:3300/0 conn(0x7fbd200c11a0 msgr2=0x7fbd200cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.562+0000 7fbd25fa8640 1 --2- 172.21.15.55:0/3243105307 >> v2:172.21.15.138:3300/0 conn(0x7fbd200c11a0 0x7fbd200cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.562+0000 7fbd25fa8640 1 -- 172.21.15.55:0/3243105307 >> v1:172.21.15.138:6789/0 conn(0x7fbd2006eee0 legacy=0x7fbd2006f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:05.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.562+0000 7fbd25fa8640 1 -- 172.21.15.55:0/3243105307 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd200cd9f0 con 0x7fbd200c84a0 2023-07-06T22:00:05.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.566+0000 7fbd25fa8640 1 --2- 172.21.15.55:0/3243105307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd200c84a0 0x7fbd200c8920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009e50 tx=0x7fbd1801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f3d065ea1e89149 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:05.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.566+0000 7fbd17fff640 1 -- 172.21.15.55:0/3243105307 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180a56b0 con 0x7fbd200c84a0 2023-07-06T22:00:05.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.566+0000 7fbd17fff640 1 -- 172.21.15.55:0/3243105307 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd180a5810 con 0x7fbd200c84a0 2023-07-06T22:00:05.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.566+0000 7fbd17fff640 1 -- 172.21.15.55:0/3243105307 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180a5ba0 con 0x7fbd200c84a0 2023-07-06T22:00:05.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.566+0000 7fbd27a0b640 1 -- 172.21.15.55:0/3243105307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd200c84a0 msgr2=0x7fbd200c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:05.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.566+0000 7fbd27a0b640 1 --2- 172.21.15.55:0/3243105307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd200c84a0 0x7fbd200c8920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009e50 tx=0x7fbd1801c940 comp rx=0 tx=0).stop 2023-07-06T22:00:05.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.566+0000 7fbd27a0b640 1 -- 172.21.15.55:0/3243105307 shutdown_connections 2023-07-06T22:00:05.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.566+0000 7fbd27a0b640 1 --2- 172.21.15.55:0/3243105307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd200c84a0 0x7fbd200c8920 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.566+0000 7fbd27a0b640 1 --2- 172.21.15.55:0/3243105307 >> v2:172.21.15.138:3300/0 conn(0x7fbd200c11a0 0x7fbd200cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.566+0000 7fbd27a0b640 1 -- 172.21.15.55:0/3243105307 >> 172.21.15.55:0/3243105307 conn(0x7fbd200cea70 msgr2=0x7fbd200ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.566+0000 7fbd27a0b640 1 -- 172.21.15.55:0/3243105307 shutdown_connections 2023-07-06T22:00:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.566+0000 7fbd27a0b640 1 -- 172.21.15.55:0/3243105307 wait complete. 2023-07-06T22:00:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.566+0000 7fbd27a0b640 1 Processor -- start 2023-07-06T22:00:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.566+0000 7fbd27a0b640 1 -- start start 2023-07-06T22:00:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd27a0b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd2006eee0 0x7fbd201563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd27a0b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd200c11a0 0x7fbd2006ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd27a0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd200c84a0 0x7fbd2006b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd27a0b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2006a350 con 0x7fbd2006eee0 2023-07-06T22:00:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd27a0b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd201568e0 con 0x7fbd200c11a0 2023-07-06T22:00:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd27a0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20160860 con 0x7fbd200c84a0 2023-07-06T22:00:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd257a7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd2006eee0 0x7fbd201563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd257a7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd2006eee0 0x7fbd201563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56412/0 (socket says 172.21.15.55:56412) 2023-07-06T22:00:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd257a7640 1 -- 172.21.15.55:0/732062750 learned_addr learned my addr 172.21.15.55:0/732062750 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd257a7640 1 -- 172.21.15.55:0/732062750 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd200c84a0 msgr2=0x7fbd2006b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd257a7640 1 --2- 172.21.15.55:0/732062750 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd200c84a0 0x7fbd2006b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd257a7640 1 -- 172.21.15.55:0/732062750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd200c11a0 msgr2=0x7fbd2006ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:05.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd257a7640 1 --2- 172.21.15.55:0/732062750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd200c11a0 0x7fbd2006ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd257a7640 1 -- 172.21.15.55:0/732062750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18009b30 con 0x7fbd2006eee0 2023-07-06T22:00:05.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd257a7640 1 --2- 172.21.15.55:0/732062750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd2006eee0 0x7fbd201563a0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00d800 tx=0x7fbd1c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:05.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd15ffb640 1 -- 172.21.15.55:0/732062750 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c00b6c0 con 0x7fbd2006eee0 2023-07-06T22:00:05.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd15ffb640 1 -- 172.21.15.55:0/732062750 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c00b820 con 0x7fbd2006eee0 2023-07-06T22:00:05.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd27a0b640 1 -- 172.21.15.55:0/732062750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd200c16f0 con 0x7fbd2006eee0 2023-07-06T22:00:05.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd15ffb640 1 -- 172.21.15.55:0/732062750 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c00bbb0 con 0x7fbd2006eee0 2023-07-06T22:00:05.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd27a0b640 1 -- 172.21.15.55:0/732062750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd20160e20 con 0x7fbd2006eee0 2023-07-06T22:00:05.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd27a0b640 1 -- 172.21.15.55:0/732062750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd20066d60 con 0x7fbd2006eee0 2023-07-06T22:00:05.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.570+0000 7fbd15ffb640 1 -- 172.21.15.55:0/732062750 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 57) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fbd1c00bd10 con 0x7fbd2006eee0 2023-07-06T22:00:05.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.574+0000 7fbd15ffb640 1 --2- 172.21.15.55:0/732062750 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fbd040660d0 0x7fbd04068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:05.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.574+0000 7fbd15ffb640 1 -- 172.21.15.55:0/732062750 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 7156+0+0 (secure 0 0 0) 0x7fbd1c084440 con 0x7fbd2006eee0 2023-07-06T22:00:05.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.574+0000 7fbd24fa6640 1 --2- 172.21.15.55:0/732062750 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fbd040660d0 0x7fbd04068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:05.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.574+0000 7fbd24fa6640 1 --2- 172.21.15.55:0/732062750 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fbd040660d0 0x7fbd04068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd200c7a10 tx=0x7fbd100079c0 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:05.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.578+0000 7fbd15ffb640 1 -- 172.21.15.55:0/732062750 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbd1c055170 con 0x7fbd2006eee0 2023-07-06T22:00:05.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.762+0000 7fbd27a0b640 1 -- 172.21.15.55:0/732062750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbd200cb6c0 con 0x7fbd2006eee0 2023-07-06T22:00:05.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.954+0000 7fbd15ffb640 1 -- 172.21.15.55:0/732062750 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbd1c051ab0 con 0x7fbd2006eee0 2023-07-06T22:00:05.985 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-07-06T22:00:05.986+0000 7f5b6d80c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T22:00:05.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.994+0000 7fbd15ffb640 1 -- 172.21.15.55:0/732062750 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbd1c06d560 con 0x7fbd2006eee0 2023-07-06T22:00:05.994 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T22:00:05.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.994+0000 7fbd27a0b640 1 -- 172.21.15.55:0/732062750 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fbd040660d0 msgr2=0x7fbd04068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:05.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.994+0000 7fbd27a0b640 1 --2- 172.21.15.55:0/732062750 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fbd040660d0 0x7fbd04068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd200c7a10 tx=0x7fbd100079c0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.994+0000 7fbd27a0b640 1 -- 172.21.15.55:0/732062750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd2006eee0 msgr2=0x7fbd201563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:05.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.994+0000 7fbd27a0b640 1 --2- 172.21.15.55:0/732062750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd2006eee0 0x7fbd201563a0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00d800 tx=0x7fbd1c00dcc0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.998+0000 7fbd27a0b640 1 -- 172.21.15.55:0/732062750 shutdown_connections 2023-07-06T22:00:05.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.998+0000 7fbd27a0b640 1 --2- 172.21.15.55:0/732062750 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fbd040660d0 0x7fbd04068580 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.998+0000 7fbd27a0b640 1 --2- 172.21.15.55:0/732062750 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd200c84a0 0x7fbd2006b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.998+0000 7fbd27a0b640 1 --2- 172.21.15.55:0/732062750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd200c11a0 0x7fbd2006ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.998+0000 7fbd27a0b640 1 --2- 172.21.15.55:0/732062750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd2006eee0 0x7fbd201563a0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:05.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.998+0000 7fbd27a0b640 1 -- 172.21.15.55:0/732062750 >> 172.21.15.55:0/732062750 conn(0x7fbd200cea70 msgr2=0x7fbd200b1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:05.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.998+0000 7fbd27a0b640 1 -- 172.21.15.55:0/732062750 shutdown_connections 2023-07-06T22:00:05.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:05.998+0000 7fbd27a0b640 1 -- 172.21.15.55:0/732062750 wait complete. 2023-07-06T22:00:06.005 INFO:tasks.ceph.mds.b.smithi138.stderr: -7664> 2023-07-06T21:58:39.809+0000 7f48d74fd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T22:00:06.015 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T22:00:06.055 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-07-06T22:00:06.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62b1a48640 1 Processor -- start 2023-07-06T22:00:06.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62b1a48640 1 -- start start 2023-07-06T22:00:06.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62b1a48640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f62ac158850 0x7f62ac0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:06.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62b1a48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62ac0ca130 0x7f62ac0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:06.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62b1a48640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62ac0703e0 0x7f62ac070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:06.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62b1a48640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac070dc0 con 0x7f62ac0703e0 2023-07-06T22:00:06.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62b1a48640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac158c20 con 0x7f62ac158850 2023-07-06T22:00:06.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62b1a48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac0c8db0 con 0x7f62ac0ca130 2023-07-06T22:00:06.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62ab7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62ac0703e0 0x7f62ac070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:06.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62aaffd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f62ac158850 0x7f62ac0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:06.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62a3fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62ac0ca130 0x7f62ac0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:06.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62ab7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62ac0703e0 0x7f62ac070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56414/0 (socket says 172.21.15.55:56414) 2023-07-06T22:00:06.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62ab7fe640 1 -- 172.21.15.55:0/460711561 learned_addr learned my addr 172.21.15.55:0/460711561 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:06.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62ab7fe640 1 -- 172.21.15.55:0/460711561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62ac0ca130 msgr2=0x7f62ac0ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:06.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62ab7fe640 1 --2- 172.21.15.55:0/460711561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62ac0ca130 0x7f62ac0ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:06.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62ab7fe640 1 -- 172.21.15.55:0/460711561 >> v2:172.21.15.138:3300/0 conn(0x7f62ac158850 msgr2=0x7f62ac0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:06.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62ab7fe640 1 --2- 172.21.15.55:0/460711561 >> v2:172.21.15.138:3300/0 conn(0x7f62ac158850 0x7f62ac0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:06.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.162+0000 7f62ab7fe640 1 -- 172.21.15.55:0/460711561 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac0c9090 con 0x7f62ac0703e0 2023-07-06T22:00:06.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.166+0000 7f62ab7fe640 1 --2- 172.21.15.55:0/460711561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac0703e0 0x7f62ac070880 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f62ac06eaf0 tx=0x7f62a401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5974582264bc83d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:06.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.166+0000 7f62aa7fc640 1 -- 172.21.15.55:0/460711561 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40af400 con 0x7f62ac0703e0 2023-07-06T22:00:06.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.166+0000 7f62aa7fc640 1 -- 172.21.15.55:0/460711561 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a40ab050 con 0x7f62ac0703e0 2023-07-06T22:00:06.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.166+0000 7f62aa7fc640 1 -- 172.21.15.55:0/460711561 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40af780 con 0x7f62ac0703e0 2023-07-06T22:00:06.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.166+0000 7f62b1a48640 1 -- 172.21.15.55:0/460711561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac0703e0 msgr2=0x7f62ac070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:06.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.166+0000 7f62b1a48640 1 --2- 172.21.15.55:0/460711561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac0703e0 0x7f62ac070880 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f62ac06eaf0 tx=0x7f62a401f1c0 comp rx=0 tx=0).stop 2023-07-06T22:00:06.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.166+0000 7f62b1a48640 1 -- 172.21.15.55:0/460711561 shutdown_connections 2023-07-06T22:00:06.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.166+0000 7f62b1a48640 1 --2- 172.21.15.55:0/460711561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac0703e0 0x7f62ac070880 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:06.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.166+0000 7f62b1a48640 1 --2- 172.21.15.55:0/460711561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62ac0ca130 0x7f62ac0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:06.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.166+0000 7f62b1a48640 1 --2- 172.21.15.55:0/460711561 >> v2:172.21.15.138:3300/0 conn(0x7f62ac158850 0x7f62ac0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:06.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.166+0000 7f62b1a48640 1 -- 172.21.15.55:0/460711561 >> 172.21.15.55:0/460711561 conn(0x7f62ac0cea70 msgr2=0x7f62ac0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:06.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.166+0000 7f62b1a48640 1 -- 172.21.15.55:0/460711561 shutdown_connections 2023-07-06T22:00:06.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62b1a48640 1 -- 172.21.15.55:0/460711561 wait complete. 2023-07-06T22:00:06.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62b1a48640 1 Processor -- start 2023-07-06T22:00:06.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62b1a48640 1 -- start start 2023-07-06T22:00:06.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62b1a48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62ac0703e0 0x7f62ac0989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:06.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62b1a48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62ac0ca130 0x7f62ac1eee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62b1a48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac158850 0x7f62ac155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62b1a48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac098f30 con 0x7f62ac158850 2023-07-06T22:00:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62b1a48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac156840 con 0x7f62ac0ca130 2023-07-06T22:00:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62b1a48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac154c90 con 0x7f62ac0703e0 2023-07-06T22:00:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62ab7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac158850 0x7f62ac155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62ab7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac158850 0x7f62ac155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56430/0 (socket says 172.21.15.55:56430) 2023-07-06T22:00:06.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62ab7fe640 1 -- 172.21.15.55:0/1143070349 learned_addr learned my addr 172.21.15.55:0/1143070349 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:06.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62aaffd640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62ac0703e0 0x7f62ac0989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:06.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62a3fff640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62ac0ca130 0x7f62ac1eee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:06.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62ab7fe640 1 -- 172.21.15.55:0/1143070349 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62ac0703e0 msgr2=0x7f62ac0989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:06.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62ab7fe640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62ac0703e0 0x7f62ac0989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:06.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62ab7fe640 1 -- 172.21.15.55:0/1143070349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62ac0ca130 msgr2=0x7f62ac1eee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:06.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62ab7fe640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62ac0ca130 0x7f62ac1eee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:06.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62ab7fe640 1 -- 172.21.15.55:0/1143070349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a4009b30 con 0x7f62ac158850 2023-07-06T22:00:06.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62a3fff640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62ac0ca130 0x7f62ac1eee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:06.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62ab7fe640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac158850 0x7f62ac155400 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f62a40b2040 tx=0x7f62a401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:06.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62a8ff9640 1 -- 172.21.15.55:0/1143070349 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40afc80 con 0x7f62ac158850 2023-07-06T22:00:06.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62a8ff9640 1 -- 172.21.15.55:0/1143070349 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a40afe00 con 0x7f62ac158850 2023-07-06T22:00:06.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62a8ff9640 1 -- 172.21.15.55:0/1143070349 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40ba660 con 0x7f62ac158850 2023-07-06T22:00:06.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.170+0000 7f62b1a48640 1 -- 172.21.15.55:0/1143070349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac154f70 con 0x7f62ac158850 2023-07-06T22:00:06.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.174+0000 7f62b1a48640 1 -- 172.21.15.55:0/1143070349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac153a20 con 0x7f62ac158850 2023-07-06T22:00:06.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.174+0000 7f62b1a48640 1 -- 172.21.15.55:0/1143070349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ac155100 con 0x7f62ac158850 2023-07-06T22:00:06.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.174+0000 7f62a8ff9640 1 -- 172.21.15.55:0/1143070349 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f62a40b6040 con 0x7f62ac158850 2023-07-06T22:00:06.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.174+0000 7f62a8ff9640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f628c0663a0 0x7f628c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:06.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.174+0000 7f62a8ff9640 1 -- 172.21.15.55:0/1143070349 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 7242+0+0 (secure 0 0 0) 0x7f62a41225f0 con 0x7f62ac158850 2023-07-06T22:00:06.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.174+0000 7f62aaffd640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f628c0663a0 0x7f628c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:06.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.174+0000 7f62aaffd640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f628c0663a0 0x7f628c068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f629c0099d0 tx=0x7f629c008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:06.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.178+0000 7f62a8ff9640 1 -- 172.21.15.55:0/1143070349 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f62a40ef3d0 con 0x7f62ac158850 2023-07-06T22:00:06.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.370+0000 7f62b1a48640 1 -- 172.21.15.55:0/1143070349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f62ac066d60 con 0x7f62ac158850 2023-07-06T22:00:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.998+0000 7f62a8ff9640 1 -- 172.21.15.55:0/1143070349 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7f62a4009510 con 0x7f62ac158850 2023-07-06T22:00:06.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.998+0000 7f62b1a48640 1 -- 172.21.15.55:0/1143070349 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f628c0663a0 msgr2=0x7f628c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.998+0000 7f62b1a48640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f628c0663a0 0x7f628c068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f629c0099d0 tx=0x7f629c008040 comp rx=0 tx=0).stop 2023-07-06T22:00:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.998+0000 7f62b1a48640 1 -- 172.21.15.55:0/1143070349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac158850 msgr2=0x7f62ac155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.998+0000 7f62b1a48640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac158850 0x7f62ac155400 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f62a40b2040 tx=0x7f62a401bf60 comp rx=0 tx=0).stop 2023-07-06T22:00:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.998+0000 7f62b1a48640 1 -- 172.21.15.55:0/1143070349 shutdown_connections 2023-07-06T22:00:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.998+0000 7f62b1a48640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f628c0663a0 0x7f628c068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.998+0000 7f62b1a48640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac158850 0x7f62ac155400 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.998+0000 7f62b1a48640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62ac0ca130 0x7f62ac1eee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.998+0000 7f62b1a48640 1 --2- 172.21.15.55:0/1143070349 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62ac0703e0 0x7f62ac0989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.998+0000 7f62b1a48640 1 -- 172.21.15.55:0/1143070349 >> 172.21.15.55:0/1143070349 conn(0x7f62ac0cea70 msgr2=0x7f62ac0b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.998+0000 7f62b1a48640 1 -- 172.21.15.55:0/1143070349 shutdown_connections 2023-07-06T22:00:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:06.998+0000 7f62b1a48640 1 -- 172.21.15.55:0/1143070349 wait complete. 2023-07-06T22:00:07.022 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T22:00:07.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.170+0000 7ff84292c640 1 Processor -- start 2023-07-06T22:00:07.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.170+0000 7ff84292c640 1 -- start start 2023-07-06T22:00:07.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.174+0000 7ff84292c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff83c0c9b90 0x7ff83c15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:07.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.174+0000 7ff84292c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff83c0693f0 0x7ff83c069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:07.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.174+0000 7ff84292c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83c0b3e70 con 0x7ff83c0ccb70 2023-07-06T22:00:07.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.174+0000 7ff84292c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83c159c30 con 0x7ff83c0693f0 2023-07-06T22:00:07.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.174+0000 7ff84292c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83c0c9070 con 0x7ff83c0c9b90 2023-07-06T22:00:07.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.174+0000 7ff840ec9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff83c0693f0 0x7ff83c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:07.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.174+0000 7ff840ec9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff83c0693f0 0x7ff83c069810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56438/0 (socket says 172.21.15.55:56438) 2023-07-06T22:00:07.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.174+0000 7ff840ec9640 1 -- 172.21.15.55:0/1965089945 learned_addr learned my addr 172.21.15.55:0/1965089945 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:07.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.174+0000 7ff83bfff640 1 --2- 172.21.15.55:0/1965089945 >> v2:172.21.15.138:3300/0 conn(0x7ff83c0c9b90 0x7ff83c15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:07.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.174+0000 7ff840ec9640 1 -- 172.21.15.55:0/1965089945 >> v2:172.21.15.138:3300/0 conn(0x7ff83c0c9b90 msgr2=0x7ff83c15dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:07.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.174+0000 7ff840ec9640 1 --2- 172.21.15.55:0/1965089945 >> v2:172.21.15.138:3300/0 conn(0x7ff83c0c9b90 0x7ff83c15dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:07.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.174+0000 7ff840ec9640 1 -- 172.21.15.55:0/1965089945 >> v1:172.21.15.55:6789/0 conn(0x7ff83c0ccb70 legacy=0x7ff83c0c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:07.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.174+0000 7ff840ec9640 1 -- 172.21.15.55:0/1965089945 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c0c8480 con 0x7ff83c0693f0 2023-07-06T22:00:07.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.174+0000 7ff83bfff640 1 --2- 172.21.15.55:0/1965089945 >> v2:172.21.15.138:3300/0 conn(0x7ff83c0c9b90 0x7ff83c15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:07.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.178+0000 7ff840ec9640 1 --2- 172.21.15.55:0/1965089945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff83c0693f0 0x7ff83c069810 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0cb980 tx=0x7ff83401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a41b5c93719894 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:07.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.178+0000 7ff83affd640 1 -- 172.21.15.55:0/1965089945 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340a5720 con 0x7ff83c0693f0 2023-07-06T22:00:07.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.178+0000 7ff83affd640 1 -- 172.21.15.55:0/1965089945 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8340a5880 con 0x7ff83c0693f0 2023-07-06T22:00:07.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.178+0000 7ff83affd640 1 -- 172.21.15.55:0/1965089945 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340a5c10 con 0x7ff83c0693f0 2023-07-06T22:00:07.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.178+0000 7ff84292c640 1 -- 172.21.15.55:0/1965089945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff83c0693f0 msgr2=0x7ff83c069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:07.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.178+0000 7ff84292c640 1 --2- 172.21.15.55:0/1965089945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff83c0693f0 0x7ff83c069810 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0cb980 tx=0x7ff83401c9d0 comp rx=0 tx=0).stop 2023-07-06T22:00:07.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.178+0000 7ff84292c640 1 -- 172.21.15.55:0/1965089945 shutdown_connections 2023-07-06T22:00:07.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.178+0000 7ff84292c640 1 --2- 172.21.15.55:0/1965089945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff83c0693f0 0x7ff83c069810 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:07.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.178+0000 7ff84292c640 1 --2- 172.21.15.55:0/1965089945 >> v2:172.21.15.138:3300/0 conn(0x7ff83c0c9b90 0x7ff83c15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:07.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.178+0000 7ff84292c640 1 -- 172.21.15.55:0/1965089945 >> 172.21.15.55:0/1965089945 conn(0x7ff83c0cde30 msgr2=0x7ff83c0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:07.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.178+0000 7ff84292c640 1 -- 172.21.15.55:0/1965089945 shutdown_connections 2023-07-06T22:00:07.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.178+0000 7ff84292c640 1 -- 172.21.15.55:0/1965089945 wait complete. 2023-07-06T22:00:07.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.178+0000 7ff84292c640 1 Processor -- start 2023-07-06T22:00:07.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.178+0000 7ff84292c640 1 -- start start 2023-07-06T22:00:07.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff84292c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff83c0693f0 0x7ff83c0c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff84292c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff83c0c9b90 0x7ff83c157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff84292c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff83c0ccb70 0x7ff83c0c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff84292c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c15acb0 con 0x7ff83c0693f0 2023-07-06T22:00:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff84292c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c15a0a0 con 0x7ff83c0c9b90 2023-07-06T22:00:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff84292c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c15a380 con 0x7ff83c0ccb70 2023-07-06T22:00:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff83bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff83c0693f0 0x7ff83c0c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:07.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff83bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff83c0693f0 0x7ff83c0c25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56452/0 (socket says 172.21.15.55:56452) 2023-07-06T22:00:07.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff83bfff640 1 -- 172.21.15.55:0/2745213826 learned_addr learned my addr 172.21.15.55:0/2745213826 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:07.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff840ec9640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff83c0ccb70 0x7ff83c0c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:07.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff83b7fe640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff83c0c9b90 0x7ff83c157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:07.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff83bfff640 1 -- 172.21.15.55:0/2745213826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff83c0ccb70 msgr2=0x7ff83c0c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:07.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff83bfff640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff83c0ccb70 0x7ff83c0c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:07.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff83bfff640 1 -- 172.21.15.55:0/2745213826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff83c0c9b90 msgr2=0x7ff83c157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:07.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff83bfff640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff83c0c9b90 0x7ff83c157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:07.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff83bfff640 1 -- 172.21.15.55:0/2745213826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834009b30 con 0x7ff83c0693f0 2023-07-06T22:00:07.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff840ec9640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff83c0ccb70 0x7ff83c0c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:07.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff83b7fe640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff83c0c9b90 0x7ff83c157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:07.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff83bfff640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff83c0693f0 0x7ff83c0c25a0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00c7c0 tx=0x7ff82c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:07.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff838ff9640 1 -- 172.21.15.55:0/2745213826 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c007a30 con 0x7ff83c0693f0 2023-07-06T22:00:07.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff838ff9640 1 -- 172.21.15.55:0/2745213826 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c007b90 con 0x7ff83c0693f0 2023-07-06T22:00:07.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff84292c640 1 -- 172.21.15.55:0/2745213826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c15a660 con 0x7ff83c0693f0 2023-07-06T22:00:07.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff838ff9640 1 -- 172.21.15.55:0/2745213826 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c00ce70 con 0x7ff83c0693f0 2023-07-06T22:00:07.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff84292c640 1 -- 172.21.15.55:0/2745213826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83c159d70 con 0x7ff83c0693f0 2023-07-06T22:00:07.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff84292c640 1 -- 172.21.15.55:0/2745213826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83c15ae60 con 0x7ff83c0693f0 2023-07-06T22:00:07.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.182+0000 7ff838ff9640 1 -- 172.21.15.55:0/2745213826 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff82c0113f0 con 0x7ff83c0693f0 2023-07-06T22:00:07.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.186+0000 7ff838ff9640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff8280663a0 0x7ff828068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:07.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.186+0000 7ff838ff9640 1 -- 172.21.15.55:0/2745213826 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 7242+0+0 (secure 0 0 0) 0x7ff82c0848f0 con 0x7ff83c0693f0 2023-07-06T22:00:07.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.186+0000 7ff83b7fe640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff8280663a0 0x7ff828068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:07.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.186+0000 7ff83b7fe640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff8280663a0 0x7ff828068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0b3010 tx=0x7ff830009040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:07.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.190+0000 7ff838ff9640 1 -- 172.21.15.55:0/2745213826 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff83c15ae60 con 0x7ff83c0693f0 2023-07-06T22:00:07.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:07.350+0000 7ff84292c640 1 -- 172.21.15.55:0/2745213826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff83c066d60 con 0x7ff83c0693f0 2023-07-06T22:00:07.428 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:00:07.431 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:00:08.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.014+0000 7ff838ff9640 1 -- 172.21.15.55:0/2745213826 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v121) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff82c055140 con 0x7ff83c0693f0 2023-07-06T22:00:08.014 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-07-06T22:00:08.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.018+0000 7ff84292c640 1 -- 172.21.15.55:0/2745213826 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff8280663a0 msgr2=0x7ff828068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:08.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.018+0000 7ff84292c640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff8280663a0 0x7ff828068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0b3010 tx=0x7ff830009040 comp rx=0 tx=0).stop 2023-07-06T22:00:08.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.018+0000 7ff84292c640 1 -- 172.21.15.55:0/2745213826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff83c0693f0 msgr2=0x7ff83c0c25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:08.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.018+0000 7ff84292c640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff83c0693f0 0x7ff83c0c25a0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00c7c0 tx=0x7ff82c00cc80 comp rx=0 tx=0).stop 2023-07-06T22:00:08.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.018+0000 7ff84292c640 1 -- 172.21.15.55:0/2745213826 shutdown_connections 2023-07-06T22:00:08.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.018+0000 7ff84292c640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff8280663a0 0x7ff828068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:08.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.018+0000 7ff84292c640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff83c0ccb70 0x7ff83c0c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:08.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.018+0000 7ff84292c640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff83c0c9b90 0x7ff83c157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:08.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.018+0000 7ff84292c640 1 --2- 172.21.15.55:0/2745213826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff83c0693f0 0x7ff83c0c25a0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:08.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.018+0000 7ff84292c640 1 -- 172.21.15.55:0/2745213826 >> 172.21.15.55:0/2745213826 conn(0x7ff83c0cde30 msgr2=0x7ff83c15d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:08.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.018+0000 7ff84292c640 1 -- 172.21.15.55:0/2745213826 shutdown_connections 2023-07-06T22:00:08.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.018+0000 7ff84292c640 1 -- 172.21.15.55:0/2745213826 wait complete. 2023-07-06T22:00:08.039 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T22:00:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.186+0000 7f6614f96640 1 Processor -- start 2023-07-06T22:00:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.186+0000 7f6614f96640 1 -- start start 2023-07-06T22:00:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f6614f96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66100c89b0 0x7f66100c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f6614f96640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6610158b50 con 0x7f66100cbfa0 2023-07-06T22:00:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f6614f96640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661006fb00 con 0x7f6610158780 2023-07-06T22:00:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f6614f96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66100c9370 con 0x7f66100c89b0 2023-07-06T22:00:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f6607fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f66100cbfa0 0x7f661006f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46128/0 (socket says 172.21.15.55:46128) 2023-07-06T22:00:08.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f6607fff640 1 -- 172.21.15.55:0/1649279255 learned_addr learned my addr 172.21.15.55:0/1649279255 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 -- 172.21.15.55:0/1649279255 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608414995 0 0) 0x7f6610158b50 con 0x7f66100cbfa0 2023-07-06T22:00:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 -- 172.21.15.55:0/1649279255 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65fc003530 con 0x7f66100cbfa0 2023-07-06T22:00:08.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 -- 172.21.15.55:0/1649279255 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 11979960 0 0) 0x7f65fc003530 con 0x7f66100cbfa0 2023-07-06T22:00:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 -- 172.21.15.55:0/1649279255 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66100c89b0 msgr2=0x7f66100c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 --2- 172.21.15.55:0/1649279255 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66100c89b0 0x7f66100c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 -- 172.21.15.55:0/1649279255 >> v1:172.21.15.138:6789/0 conn(0x7f6610158780 legacy=0x7f66100cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 -- 172.21.15.55:0/1649279255 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661006b390 con 0x7f66100cbfa0 2023-07-06T22:00:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 -- 172.21.15.55:0/1649279255 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f65f8001680 con 0x7f66100cbfa0 2023-07-06T22:00:08.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 -- 172.21.15.55:0/1649279255 >> v1:172.21.15.55:6789/0 conn(0x7f66100cbfa0 legacy=0x7f661006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:08.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 --2- 172.21.15.55:0/1649279255 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66100c89b0 0x7f65fc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:08.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 --2- 172.21.15.55:0/1649279255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65fc0040a0 0x7f65fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:08.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 --2- 172.21.15.55:0/1649279255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65fc004d60 0x7f65fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:08.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 -- 172.21.15.55:0/1649279255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100c9370 con 0x7f65fc004d60 2023-07-06T22:00:08.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 -- 172.21.15.55:0/1649279255 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc00de80 con 0x7f65fc0040a0 2023-07-06T22:00:08.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660dd9b640 1 -- 172.21.15.55:0/1649279255 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc00e040 con 0x7f66100c89b0 2023-07-06T22:00:08.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660ed9d640 1 --2- 172.21.15.55:0/1649279255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65fc004d60 0x7f65fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:08.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f6607fff640 1 --2- 172.21.15.55:0/1649279255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65fc0040a0 0x7f65fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:08.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660ed9d640 1 -- 172.21.15.55:0/1649279255 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66100c89b0 msgr2=0x7f65fc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:08.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660ed9d640 1 --2- 172.21.15.55:0/1649279255 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66100c89b0 0x7f65fc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:08.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660ed9d640 1 -- 172.21.15.55:0/1649279255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65fc0040a0 msgr2=0x7f65fc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:08.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660ed9d640 1 --2- 172.21.15.55:0/1649279255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65fc0040a0 0x7f65fc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:08.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.190+0000 7f660ed9d640 1 -- 172.21.15.55:0/1649279255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc003530 con 0x7f65fc004d60 2023-07-06T22:00:08.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.194+0000 7f660ed9d640 1 --2- 172.21.15.55:0/1649279255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65fc004d60 0x7f65fc0051d0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f6608009ca0 tx=0x7f660801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f13e3ade958edc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:08.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.194+0000 7f660dd9b640 1 -- 172.21.15.55:0/1649279255 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080a5b50 con 0x7f65fc004d60 2023-07-06T22:00:08.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.194+0000 7f660dd9b640 1 -- 172.21.15.55:0/1649279255 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66080a5cd0 con 0x7f65fc004d60 2023-07-06T22:00:08.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.194+0000 7f660dd9b640 1 -- 172.21.15.55:0/1649279255 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080ad680 con 0x7f65fc004d60 2023-07-06T22:00:08.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.194+0000 7f6614f96640 1 -- 172.21.15.55:0/1649279255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65fc004d60 msgr2=0x7f65fc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:08.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.194+0000 7f6614f96640 1 --2- 172.21.15.55:0/1649279255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65fc004d60 0x7f65fc0051d0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f6608009ca0 tx=0x7f660801cc50 comp rx=0 tx=0).stop 2023-07-06T22:00:08.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.194+0000 7f660ed9d640 1 -- 172.21.15.55:0/1649279255 reap_dead start 2023-07-06T22:00:08.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.194+0000 7f6614f96640 1 -- 172.21.15.55:0/1649279255 shutdown_connections 2023-07-06T22:00:08.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.194+0000 7f6614f96640 1 -- 172.21.15.55:0/1649279255 >> 172.21.15.55:0/1649279255 conn(0x7f66100cde30 msgr2=0x7f66100ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:08.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.194+0000 7f6614f96640 1 -- 172.21.15.55:0/1649279255 shutdown_connections 2023-07-06T22:00:08.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.194+0000 7f6614f96640 1 -- 172.21.15.55:0/1649279255 wait complete. 2023-07-06T22:00:08.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6614f96640 1 Processor -- start 2023-07-06T22:00:08.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6614f96640 1 -- start start 2023-07-06T22:00:08.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6614f96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65fc004d60 0x7f66100c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:08.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6614f96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100c2510 0x7f6610150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:08.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6614f96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6610151040 0x7f66100ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:08.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6614f96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66101514e0 con 0x7f66100c2510 2023-07-06T22:00:08.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6614f96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661014fa60 con 0x7f6610151040 2023-07-06T22:00:08.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6614f96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661014fd40 con 0x7f65fc004d60 2023-07-06T22:00:08.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6607fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100c2510 0x7f6610150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:08.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6607fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100c2510 0x7f6610150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56476/0 (socket says 172.21.15.55:56476) 2023-07-06T22:00:08.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6607fff640 1 -- 172.21.15.55:0/612859311 learned_addr learned my addr 172.21.15.55:0/612859311 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:08.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f660e59c640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65fc004d60 0x7f66100c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:08.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f660ed9d640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6610151040 0x7f66100ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:08.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6607fff640 1 -- 172.21.15.55:0/612859311 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65fc004d60 msgr2=0x7f66100c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:08.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6607fff640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65fc004d60 0x7f66100c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:08.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6607fff640 1 -- 172.21.15.55:0/612859311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6610151040 msgr2=0x7f66100ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:08.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6607fff640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6610151040 0x7f66100ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:08.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6607fff640 1 -- 172.21.15.55:0/612859311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6610150020 con 0x7f66100c2510 2023-07-06T22:00:08.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f660ed9d640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6610151040 0x7f66100ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:08.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6607fff640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100c2510 0x7f6610150b00 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f65f8011900 tx=0x7f65f8011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:08.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6606ffd640 1 -- 172.21.15.55:0/612859311 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f801a030 con 0x7f66100c2510 2023-07-06T22:00:08.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6606ffd640 1 -- 172.21.15.55:0/612859311 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f800fb80 con 0x7f66100c2510 2023-07-06T22:00:08.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6606ffd640 1 -- 172.21.15.55:0/612859311 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8015410 con 0x7f66100c2510 2023-07-06T22:00:08.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6614f96640 1 -- 172.21.15.55:0/612859311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6610150300 con 0x7f66100c2510 2023-07-06T22:00:08.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6614f96640 1 -- 172.21.15.55:0/612859311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66100acc10 con 0x7f66100c2510 2023-07-06T22:00:08.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.198+0000 7f6614f96640 1 -- 172.21.15.55:0/612859311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6610066d60 con 0x7f66100c2510 2023-07-06T22:00:08.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.202+0000 7f6606ffd640 1 -- 172.21.15.55:0/612859311 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f65f801d070 con 0x7f66100c2510 2023-07-06T22:00:08.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.202+0000 7f6606ffd640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f65f00663d0 0x7f65f0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:08.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.202+0000 7f6606ffd640 1 -- 172.21.15.55:0/612859311 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6804+0+0 (secure 0 0 0) 0x7f65f801b070 con 0x7f66100c2510 2023-07-06T22:00:08.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.202+0000 7f660e59c640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f65f00663d0 0x7f65f0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:08.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.202+0000 7f660e59c640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f65f00663d0 0x7f65f0068880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6600007fd0 tx=0x7f6600009040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:08.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.206+0000 7f6606ffd640 1 -- 172.21.15.55:0/612859311 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65f8054170 con 0x7f66100c2510 2023-07-06T22:00:08.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:08.358+0000 7f6614f96640 1 -- 172.21.15.55:0/612859311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f66101507b0 con 0x7f66100c2510 2023-07-06T22:00:09.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.030+0000 7f6606ffd640 1 -- 172.21.15.55:0/612859311 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v122) v1 ==== 169+0+0 (secure 0 0 0) 0x7f65f8057790 con 0x7f66100c2510 2023-07-06T22:00:09.030 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-07-06T22:00:09.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.034+0000 7f6614f96640 1 -- 172.21.15.55:0/612859311 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f65f00663d0 msgr2=0x7f65f0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.034+0000 7f6614f96640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f65f00663d0 0x7f65f0068880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6600007fd0 tx=0x7f6600009040 comp rx=0 tx=0).stop 2023-07-06T22:00:09.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.034+0000 7f6614f96640 1 -- 172.21.15.55:0/612859311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100c2510 msgr2=0x7f6610150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.034+0000 7f6614f96640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100c2510 0x7f6610150b00 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f65f8011900 tx=0x7f65f8011dc0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.034+0000 7f6614f96640 1 -- 172.21.15.55:0/612859311 shutdown_connections 2023-07-06T22:00:09.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.034+0000 7f6614f96640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f65f00663d0 0x7f65f0068880 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.034+0000 7f6614f96640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6610151040 0x7f66100ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.034+0000 7f6614f96640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100c2510 0x7f6610150b00 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.034+0000 7f6614f96640 1 --2- 172.21.15.55:0/612859311 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65fc004d60 0x7f66100c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.034+0000 7f6614f96640 1 -- 172.21.15.55:0/612859311 >> 172.21.15.55:0/612859311 conn(0x7f66100cde30 msgr2=0x7f6610069c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.038+0000 7f6614f96640 1 -- 172.21.15.55:0/612859311 shutdown_connections 2023-07-06T22:00:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.038+0000 7f6614f96640 1 -- 172.21.15.55:0/612859311 wait complete. 2023-07-06T22:00:09.061 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-06T22:00:09.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.210+0000 7f25d2e96640 1 Processor -- start 2023-07-06T22:00:09.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.210+0000 7f25d2e96640 1 -- start start 2023-07-06T22:00:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.210+0000 7f25d2e96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f25cc158850 0x7f25cc0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.210+0000 7f25d2e96640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f25cc0ca130 0x7f25cc0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.210+0000 7f25d2e96640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25cc0b2aa0 con 0x7f25cc0703e0 2023-07-06T22:00:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.210+0000 7f25d2e96640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25cc158c20 con 0x7f25cc0ca130 2023-07-06T22:00:09.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.210+0000 7f25d2e96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0c8db0 con 0x7f25cc158850 2023-07-06T22:00:09.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.210+0000 7f25d1433640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f25cc0703e0 0x7f25cc06eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46130/0 (socket says 172.21.15.55:46130) 2023-07-06T22:00:09.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.210+0000 7f25d1433640 1 -- 172.21.15.55:0/3747239188 learned_addr learned my addr 172.21.15.55:0/3747239188 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:09.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.210+0000 7f25cb7fe640 1 -- 172.21.15.55:0/3747239188 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879440711 0 0) 0x7f25cc0b2aa0 con 0x7f25cc0703e0 2023-07-06T22:00:09.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.210+0000 7f25d0c32640 1 --2- 172.21.15.55:0/3747239188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f25cc158850 0x7f25cc0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.210+0000 7f25cb7fe640 1 -- 172.21.15.55:0/3747239188 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25bc005740 con 0x7f25cc0703e0 2023-07-06T22:00:09.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.210+0000 7f25cbfff640 1 --2- 172.21.15.55:0/3747239188 >> v2:172.21.15.138:3300/0 conn(0x7f25cc0ca130 0x7f25cc0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 -- 172.21.15.55:0/3747239188 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3033607196 0 0) 0x7f25bc005740 con 0x7f25cc0703e0 2023-07-06T22:00:09.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 -- 172.21.15.55:0/3747239188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f25cc158850 msgr2=0x7f25cc0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:09.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 --2- 172.21.15.55:0/3747239188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f25cc158850 0x7f25cc0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 -- 172.21.15.55:0/3747239188 >> v2:172.21.15.138:3300/0 conn(0x7f25cc0ca130 msgr2=0x7f25cc0ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:09.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 --2- 172.21.15.55:0/3747239188 >> v2:172.21.15.138:3300/0 conn(0x7f25cc0ca130 0x7f25cc0ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 -- 172.21.15.55:0/3747239188 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc0c9090 con 0x7f25cc0703e0 2023-07-06T22:00:09.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 -- 172.21.15.55:0/3747239188 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f25c4001a00 con 0x7f25cc0703e0 2023-07-06T22:00:09.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 -- 172.21.15.55:0/3747239188 >> v1:172.21.15.55:6789/0 conn(0x7f25cc0703e0 legacy=0x7f25cc06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 --2- 172.21.15.55:0/3747239188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25bc005b90 0x7f25bc005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 --2- 172.21.15.55:0/3747239188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25bc0065c0 0x7f25bc006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 --2- 172.21.15.55:0/3747239188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f25cc158850 0x7f25bc007150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 -- 172.21.15.55:0/3747239188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc158c20 con 0x7f25bc005b90 2023-07-06T22:00:09.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 -- 172.21.15.55:0/3747239188 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0c8db0 con 0x7f25bc0065c0 2023-07-06T22:00:09.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 -- 172.21.15.55:0/3747239188 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc003530 con 0x7f25cc158850 2023-07-06T22:00:09.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25d0c32640 1 --2- 172.21.15.55:0/3747239188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25bc005b90 0x7f25bc005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cbfff640 1 --2- 172.21.15.55:0/3747239188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25bc0065c0 0x7f25bc006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25d1433640 1 --2- 172.21.15.55:0/3747239188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f25cc158850 0x7f25bc007150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25d0c32640 1 -- 172.21.15.55:0/3747239188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f25cc158850 msgr2=0x7f25bc007150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:09.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25d0c32640 1 --2- 172.21.15.55:0/3747239188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f25cc158850 0x7f25bc007150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25d0c32640 1 -- 172.21.15.55:0/3747239188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25bc0065c0 msgr2=0x7f25bc006a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:09.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25d0c32640 1 --2- 172.21.15.55:0/3747239188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25bc0065c0 0x7f25bc006a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25d0c32640 1 -- 172.21.15.55:0/3747239188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc005740 con 0x7f25bc005b90 2023-07-06T22:00:09.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25d0c32640 1 --2- 172.21.15.55:0/3747239188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25bc005b90 0x7f25bc005fa0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009ae0 tx=0x7f25c001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5415b9eb6f35c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:09.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 -- 172.21.15.55:0/3747239188 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c00a5530 con 0x7f25bc005b90 2023-07-06T22:00:09.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 -- 172.21.15.55:0/3747239188 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c00a5690 con 0x7f25bc005b90 2023-07-06T22:00:09.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.214+0000 7f25cb7fe640 1 -- 172.21.15.55:0/3747239188 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c00a5a40 con 0x7f25bc005b90 2023-07-06T22:00:09.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d2e96640 1 -- 172.21.15.55:0/3747239188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25bc005b90 msgr2=0x7f25bc005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d2e96640 1 --2- 172.21.15.55:0/3747239188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25bc005b90 0x7f25bc005fa0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009ae0 tx=0x7f25c001ca50 comp rx=0 tx=0).stop 2023-07-06T22:00:09.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d1433640 1 -- 172.21.15.55:0/3747239188 reap_dead start 2023-07-06T22:00:09.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d2e96640 1 -- 172.21.15.55:0/3747239188 shutdown_connections 2023-07-06T22:00:09.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d2e96640 1 -- 172.21.15.55:0/3747239188 >> 172.21.15.55:0/3747239188 conn(0x7f25cc0cea70 msgr2=0x7f25cc0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:09.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d2e96640 1 -- 172.21.15.55:0/3747239188 shutdown_connections 2023-07-06T22:00:09.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d2e96640 1 -- 172.21.15.55:0/3747239188 wait complete. 2023-07-06T22:00:09.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d2e96640 1 Processor -- start 2023-07-06T22:00:09.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d2e96640 1 -- start start 2023-07-06T22:00:09.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d2e96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25bc005b90 0x7f25cc06b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d2e96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f25cc09d460 0x7f25cc153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d2e96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc09d8d0 0x7f25cc153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d2e96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc09b340 con 0x7f25cc09d8d0 2023-07-06T22:00:09.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d2e96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0989f0 con 0x7f25bc005b90 2023-07-06T22:00:09.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d2e96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1544c0 con 0x7f25cc09d460 2023-07-06T22:00:09.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d1433640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc09d8d0 0x7f25cc153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d1433640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc09d8d0 0x7f25cc153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56498/0 (socket says 172.21.15.55:56498) 2023-07-06T22:00:09.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d1433640 1 -- 172.21.15.55:0/2030987201 learned_addr learned my addr 172.21.15.55:0/2030987201 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:09.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25cbfff640 1 --2- 172.21.15.55:0/2030987201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f25cc09d460 0x7f25cc153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.218+0000 7f25d0c32640 1 --2- 172.21.15.55:0/2030987201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25bc005b90 0x7f25cc06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.222+0000 7f25d1433640 1 -- 172.21.15.55:0/2030987201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f25cc09d460 msgr2=0x7f25cc153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.222+0000 7f25d1433640 1 --2- 172.21.15.55:0/2030987201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f25cc09d460 0x7f25cc153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.222+0000 7f25d1433640 1 -- 172.21.15.55:0/2030987201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25bc005b90 msgr2=0x7f25cc06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.222+0000 7f25d1433640 1 --2- 172.21.15.55:0/2030987201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25bc005b90 0x7f25cc06b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.222+0000 7f25d1433640 1 -- 172.21.15.55:0/2030987201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc09aaa0 con 0x7f25cc09d8d0 2023-07-06T22:00:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.222+0000 7f25d1433640 1 --2- 172.21.15.55:0/2030987201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc09d8d0 0x7f25cc153f80 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f25c4002050 tx=0x7f25c4011790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.222+0000 7f25c97fa640 1 -- 172.21.15.55:0/2030987201 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4011e90 con 0x7f25cc09d8d0 2023-07-06T22:00:09.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.222+0000 7f25c97fa640 1 -- 172.21.15.55:0/2030987201 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c4014370 con 0x7f25cc09d8d0 2023-07-06T22:00:09.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.222+0000 7f25c97fa640 1 -- 172.21.15.55:0/2030987201 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4014720 con 0x7f25cc09d8d0 2023-07-06T22:00:09.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.222+0000 7f25d2e96640 1 -- 172.21.15.55:0/2030987201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc09ad80 con 0x7f25cc09d8d0 2023-07-06T22:00:09.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.222+0000 7f25d2e96640 1 -- 172.21.15.55:0/2030987201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc098c00 con 0x7f25cc09d8d0 2023-07-06T22:00:09.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.222+0000 7f25d2e96640 1 -- 172.21.15.55:0/2030987201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc098e20 con 0x7f25cc09d8d0 2023-07-06T22:00:09.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.222+0000 7f25c97fa640 1 -- 172.21.15.55:0/2030987201 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f25c4014880 con 0x7f25cc09d8d0 2023-07-06T22:00:09.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.226+0000 7f25c97fa640 1 --2- 172.21.15.55:0/2030987201 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f25b00663a0 0x7f25b0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.226+0000 7f25c97fa640 1 -- 172.21.15.55:0/2030987201 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6390+0+0 (secure 0 0 0) 0x7f25c4086090 con 0x7f25cc09d8d0 2023-07-06T22:00:09.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.226+0000 7f25d0c32640 1 --2- 172.21.15.55:0/2030987201 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f25b00663a0 0x7f25b0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.226+0000 7f25d0c32640 1 --2- 172.21.15.55:0/2030987201 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f25b00663a0 0x7f25b0068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f25c00af000 tx=0x7f25c00046d0 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:09.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.230+0000 7f25c97fa640 1 -- 172.21.15.55:0/2030987201 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f25c40532c0 con 0x7f25cc09d8d0 2023-07-06T22:00:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.382+0000 7f25d2e96640 1 -- 172.21.15.55:0/2030987201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f25cc066d60 con 0x7f25cc09d8d0 2023-07-06T22:00:09.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.390+0000 7f25c97fa640 1 -- 172.21.15.55:0/2030987201 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v37) v1 ==== 120+0+0 (secure 0 0 0) 0x7f25c401c0b0 con 0x7f25cc09d8d0 2023-07-06T22:00:09.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.390+0000 7f25d2e96640 1 -- 172.21.15.55:0/2030987201 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f25b00663a0 msgr2=0x7f25b0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.390+0000 7f25d2e96640 1 --2- 172.21.15.55:0/2030987201 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f25b00663a0 0x7f25b0068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f25c00af000 tx=0x7f25c00046d0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.390+0000 7f25d2e96640 1 -- 172.21.15.55:0/2030987201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc09d8d0 msgr2=0x7f25cc153f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.390+0000 7f25d2e96640 1 --2- 172.21.15.55:0/2030987201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc09d8d0 0x7f25cc153f80 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f25c4002050 tx=0x7f25c4011790 comp rx=0 tx=0).stop 2023-07-06T22:00:09.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.390+0000 7f25d2e96640 1 -- 172.21.15.55:0/2030987201 shutdown_connections 2023-07-06T22:00:09.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.390+0000 7f25d2e96640 1 --2- 172.21.15.55:0/2030987201 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f25b00663a0 0x7f25b0068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.390+0000 7f25d2e96640 1 --2- 172.21.15.55:0/2030987201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc09d8d0 0x7f25cc153f80 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.390+0000 7f25d2e96640 1 --2- 172.21.15.55:0/2030987201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f25cc09d460 0x7f25cc153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.390+0000 7f25d2e96640 1 --2- 172.21.15.55:0/2030987201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25bc005b90 0x7f25cc06b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.390+0000 7f25d2e96640 1 -- 172.21.15.55:0/2030987201 >> 172.21.15.55:0/2030987201 conn(0x7f25cc0cea70 msgr2=0x7f25cc0c6140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:09.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.390+0000 7f25d2e96640 1 -- 172.21.15.55:0/2030987201 shutdown_connections 2023-07-06T22:00:09.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.390+0000 7f25d2e96640 1 -- 172.21.15.55:0/2030987201 wait complete. 2023-07-06T22:00:09.410 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-06T22:00:09.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.570+0000 7f50581fa640 1 Processor -- start 2023-07-06T22:00:09.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.570+0000 7f50581fa640 1 -- start start 2023-07-06T22:00:09.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.570+0000 7f50581fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500ca130 0x7f50500703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.570+0000 7f50581fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f50500cd140 0x7f5050070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.570+0000 7f50581fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5050158c20 con 0x7f5050158850 2023-07-06T22:00:09.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.570+0000 7f50581fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50500b2aa0 con 0x7f50500cd140 2023-07-06T22:00:09.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.570+0000 7f50581fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50500c8db0 con 0x7f50500ca130 2023-07-06T22:00:09.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.574+0000 7f5056797640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f50500cd140 0x7f5050070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.574+0000 7f5056797640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f50500cd140 0x7f5050070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56508/0 (socket says 172.21.15.55:56508) 2023-07-06T22:00:09.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.574+0000 7f5056797640 1 -- 172.21.15.55:0/1244903155 learned_addr learned my addr 172.21.15.55:0/1244903155 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:09.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.574+0000 7f5056797640 1 -- 172.21.15.55:0/1244903155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500ca130 msgr2=0x7f50500703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:09.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.574+0000 7f5056797640 1 --2- 172.21.15.55:0/1244903155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500ca130 0x7f50500703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.574+0000 7f5056797640 1 -- 172.21.15.55:0/1244903155 >> v1:172.21.15.138:6789/0 conn(0x7f5050158850 legacy=0x7f50500cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:09.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.574+0000 7f5056797640 1 -- 172.21.15.55:0/1244903155 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50500c9090 con 0x7f50500cd140 2023-07-06T22:00:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.574+0000 7f5056797640 1 --2- 172.21.15.55:0/1244903155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500cd140 0x7f5050070920 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f5048009e50 tx=0x7f504801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197d94ee2183743e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.574+0000 7f5054f94640 1 -- 172.21.15.55:0/1244903155 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480a8840 con 0x7f50500cd140 2023-07-06T22:00:09.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.574+0000 7f5054f94640 1 -- 172.21.15.55:0/1244903155 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50480a89a0 con 0x7f50500cd140 2023-07-06T22:00:09.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.574+0000 7f5054f94640 1 -- 172.21.15.55:0/1244903155 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480a8d30 con 0x7f50500cd140 2023-07-06T22:00:09.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 -- 172.21.15.55:0/1244903155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500cd140 msgr2=0x7f5050070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 --2- 172.21.15.55:0/1244903155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500cd140 0x7f5050070920 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f5048009e50 tx=0x7f504801ec70 comp rx=0 tx=0).stop 2023-07-06T22:00:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 -- 172.21.15.55:0/1244903155 shutdown_connections 2023-07-06T22:00:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 --2- 172.21.15.55:0/1244903155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500cd140 0x7f5050070920 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 --2- 172.21.15.55:0/1244903155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500ca130 0x7f50500703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 -- 172.21.15.55:0/1244903155 >> 172.21.15.55:0/1244903155 conn(0x7f50500cea70 msgr2=0x7f50500ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 -- 172.21.15.55:0/1244903155 shutdown_connections 2023-07-06T22:00:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 -- 172.21.15.55:0/1244903155 wait complete. 2023-07-06T22:00:09.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 Processor -- start 2023-07-06T22:00:09.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 -- start start 2023-07-06T22:00:09.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500ca130 0x7f50500c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500cd140 0x7f50500c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5050158850 0x7f50500b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50500c68a0 con 0x7f50500cd140 2023-07-06T22:00:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50500c6b80 con 0x7f5050158850 2023-07-06T22:00:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f50581fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50500c6e60 con 0x7f50500ca130 2023-07-06T22:00:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f5055795640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500cd140 0x7f50500c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f5055795640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500cd140 0x7f50500c5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56520/0 (socket says 172.21.15.55:56520) 2023-07-06T22:00:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f5055795640 1 -- 172.21.15.55:0/2300400198 learned_addr learned my addr 172.21.15.55:0/2300400198 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f5055f96640 1 --2- 172.21.15.55:0/2300400198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500ca130 0x7f50500c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f5056797640 1 --2- 172.21.15.55:0/2300400198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5050158850 0x7f50500b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f5055795640 1 -- 172.21.15.55:0/2300400198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500ca130 msgr2=0x7f50500c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f5055795640 1 --2- 172.21.15.55:0/2300400198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500ca130 0x7f50500c3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f5055795640 1 -- 172.21.15.55:0/2300400198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5050158850 msgr2=0x7f50500b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f5055795640 1 --2- 172.21.15.55:0/2300400198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5050158850 0x7f50500b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.578+0000 7f5055795640 1 -- 172.21.15.55:0/2300400198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5048009b30 con 0x7f50500cd140 2023-07-06T22:00:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.582+0000 7f5055795640 1 --2- 172.21.15.55:0/2300400198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500cd140 0x7f50500c5fa0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f504000b550 tx=0x7f504000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.582+0000 7f50467fc640 1 -- 172.21.15.55:0/2300400198 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040010870 con 0x7f50500cd140 2023-07-06T22:00:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.582+0000 7f50467fc640 1 -- 172.21.15.55:0/2300400198 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50400109f0 con 0x7f50500cd140 2023-07-06T22:00:09.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.582+0000 7f50581fa640 1 -- 172.21.15.55:0/2300400198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50500c7140 con 0x7f50500cd140 2023-07-06T22:00:09.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.582+0000 7f50467fc640 1 -- 172.21.15.55:0/2300400198 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040010da0 con 0x7f50500cd140 2023-07-06T22:00:09.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.582+0000 7f50581fa640 1 -- 172.21.15.55:0/2300400198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50500c3cc0 con 0x7f50500cd140 2023-07-06T22:00:09.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.582+0000 7f50581fa640 1 -- 172.21.15.55:0/2300400198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5050066d60 con 0x7f50500cd140 2023-07-06T22:00:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.582+0000 7f50467fc640 1 -- 172.21.15.55:0/2300400198 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f504000f3c0 con 0x7f50500cd140 2023-07-06T22:00:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.582+0000 7f50467fc640 1 --2- 172.21.15.55:0/2300400198 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f50340663a0 0x7f5034068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.582+0000 7f50467fc640 1 -- 172.21.15.55:0/2300400198 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6390+0+0 (secure 0 0 0) 0x7f5040083f80 con 0x7f50500cd140 2023-07-06T22:00:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.582+0000 7f5055f96640 1 --2- 172.21.15.55:0/2300400198 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f50340663a0 0x7f5034068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.586+0000 7f5055f96640 1 --2- 172.21.15.55:0/2300400198 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f50340663a0 0x7f5034068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f504c0098e0 tx=0x7f504c009060 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:09.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.586+0000 7f50467fc640 1 -- 172.21.15.55:0/2300400198 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50400511b0 con 0x7f50500cd140 2023-07-06T22:00:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.742+0000 7f50581fa640 1 -- 172.21.15.55:0/2300400198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f50500c9620 con 0x7f50500cd140 2023-07-06T22:00:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.750+0000 7f50467fc640 1 -- 172.21.15.55:0/2300400198 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7f50400547d0 con 0x7f50500cd140 2023-07-06T22:00:09.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.750+0000 7f50581fa640 1 -- 172.21.15.55:0/2300400198 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f50340663a0 msgr2=0x7f5034068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.750+0000 7f50581fa640 1 --2- 172.21.15.55:0/2300400198 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f50340663a0 0x7f5034068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f504c0098e0 tx=0x7f504c009060 comp rx=0 tx=0).stop 2023-07-06T22:00:09.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.750+0000 7f50581fa640 1 -- 172.21.15.55:0/2300400198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500cd140 msgr2=0x7f50500c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.750+0000 7f50581fa640 1 --2- 172.21.15.55:0/2300400198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500cd140 0x7f50500c5fa0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f504000b550 tx=0x7f504000ba10 comp rx=0 tx=0).stop 2023-07-06T22:00:09.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.750+0000 7f50581fa640 1 -- 172.21.15.55:0/2300400198 shutdown_connections 2023-07-06T22:00:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.750+0000 7f50581fa640 1 --2- 172.21.15.55:0/2300400198 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f50340663a0 0x7f5034068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.750+0000 7f50581fa640 1 --2- 172.21.15.55:0/2300400198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5050158850 0x7f50500b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.750+0000 7f50581fa640 1 --2- 172.21.15.55:0/2300400198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50500cd140 0x7f50500c5fa0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.750+0000 7f50581fa640 1 --2- 172.21.15.55:0/2300400198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50500ca130 0x7f50500c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.750+0000 7f50581fa640 1 -- 172.21.15.55:0/2300400198 >> 172.21.15.55:0/2300400198 conn(0x7f50500cea70 msgr2=0x7f50500cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.750+0000 7f50581fa640 1 -- 172.21.15.55:0/2300400198 shutdown_connections 2023-07-06T22:00:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.750+0000 7f50581fa640 1 -- 172.21.15.55:0/2300400198 wait complete. 2023-07-06T22:00:09.769 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-06T22:00:09.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cf896640 1 Processor -- start 2023-07-06T22:00:09.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cf896640 1 -- start start 2023-07-06T22:00:09.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cf896640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47c80c11a0 0x7f47c80cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cf896640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47c806eee0 0x7f47c806f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cf896640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f47c806f890 0x7f47c8163c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cf896640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c81605f0 con 0x7f47c806eee0 2023-07-06T22:00:09.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cf896640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c806ce00 con 0x7f47c806f890 2023-07-06T22:00:09.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cf896640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c80c4ca0 con 0x7f47c80c11a0 2023-07-06T22:00:09.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cce31640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47c806eee0 0x7f47c806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cce31640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47c806eee0 0x7f47c806f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56524/0 (socket says 172.21.15.55:56524) 2023-07-06T22:00:09.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cce31640 1 -- 172.21.15.55:0/3699874862 learned_addr learned my addr 172.21.15.55:0/3699874862 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:09.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cde33640 1 --2- 172.21.15.55:0/3699874862 >> v2:172.21.15.138:3300/0 conn(0x7f47c806f890 0x7f47c8163c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cd632640 1 --2- 172.21.15.55:0/3699874862 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47c80c11a0 0x7f47c80cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cce31640 1 -- 172.21.15.55:0/3699874862 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47c80c11a0 msgr2=0x7f47c80cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:09.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cce31640 1 --2- 172.21.15.55:0/3699874862 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47c80c11a0 0x7f47c80cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cce31640 1 -- 172.21.15.55:0/3699874862 >> v2:172.21.15.138:3300/0 conn(0x7f47c806f890 msgr2=0x7f47c8163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:09.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cce31640 1 --2- 172.21.15.55:0/3699874862 >> v2:172.21.15.138:3300/0 conn(0x7f47c806f890 0x7f47c8163c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.914+0000 7f47cce31640 1 -- 172.21.15.55:0/3699874862 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c80ccd70 con 0x7f47c806eee0 2023-07-06T22:00:09.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.918+0000 7f47cce31640 1 --2- 172.21.15.55:0/3699874862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c806eee0 0x7f47c806f350 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f47c80ca740 tx=0x7f47b801c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a45be98a8b37af5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:09.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.918+0000 7f47bffff640 1 -- 172.21.15.55:0/3699874862 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80ab600 con 0x7f47c806eee0 2023-07-06T22:00:09.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.918+0000 7f47bffff640 1 -- 172.21.15.55:0/3699874862 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b80a7050 con 0x7f47c806eee0 2023-07-06T22:00:09.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.918+0000 7f47bffff640 1 -- 172.21.15.55:0/3699874862 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80ab980 con 0x7f47c806eee0 2023-07-06T22:00:09.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.918+0000 7f47cf896640 1 -- 172.21.15.55:0/3699874862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c806eee0 msgr2=0x7f47c806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.918+0000 7f47cf896640 1 --2- 172.21.15.55:0/3699874862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c806eee0 0x7f47c806f350 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f47c80ca740 tx=0x7f47b801c1b0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.918+0000 7f47cf896640 1 -- 172.21.15.55:0/3699874862 shutdown_connections 2023-07-06T22:00:09.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.918+0000 7f47cf896640 1 --2- 172.21.15.55:0/3699874862 >> v2:172.21.15.138:3300/0 conn(0x7f47c806f890 0x7f47c8163c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.918+0000 7f47cf896640 1 --2- 172.21.15.55:0/3699874862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c806eee0 0x7f47c806f350 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.918+0000 7f47cf896640 1 --2- 172.21.15.55:0/3699874862 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47c80c11a0 0x7f47c80cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.918+0000 7f47cf896640 1 -- 172.21.15.55:0/3699874862 >> 172.21.15.55:0/3699874862 conn(0x7f47c80cea70 msgr2=0x7f47c80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:09.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cf896640 1 -- 172.21.15.55:0/3699874862 shutdown_connections 2023-07-06T22:00:09.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cf896640 1 -- 172.21.15.55:0/3699874862 wait complete. 2023-07-06T22:00:09.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cf896640 1 Processor -- start 2023-07-06T22:00:09.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cf896640 1 -- start start 2023-07-06T22:00:09.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cf896640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47c806eee0 0x7f47c8159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cf896640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c806f890 0x7f47c80c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cf896640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47c80c11a0 0x7f47c80c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cf896640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c80c2750 con 0x7f47c806f890 2023-07-06T22:00:09.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cf896640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c80c1880 con 0x7f47c80c11a0 2023-07-06T22:00:09.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cf896640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c80c2b70 con 0x7f47c806eee0 2023-07-06T22:00:09.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cce31640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c806f890 0x7f47c80c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cce31640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c806f890 0x7f47c80c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56538/0 (socket says 172.21.15.55:56538) 2023-07-06T22:00:09.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cce31640 1 -- 172.21.15.55:0/1822642957 learned_addr learned my addr 172.21.15.55:0/1822642957 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:09.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cd632640 1 --2- 172.21.15.55:0/1822642957 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47c806eee0 0x7f47c8159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cde33640 1 --2- 172.21.15.55:0/1822642957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47c80c11a0 0x7f47c80c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cce31640 1 -- 172.21.15.55:0/1822642957 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47c806eee0 msgr2=0x7f47c8159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cce31640 1 --2- 172.21.15.55:0/1822642957 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47c806eee0 0x7f47c8159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cce31640 1 -- 172.21.15.55:0/1822642957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47c80c11a0 msgr2=0x7f47c80c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:09.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cce31640 1 --2- 172.21.15.55:0/1822642957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47c80c11a0 0x7f47c80c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cce31640 1 -- 172.21.15.55:0/1822642957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b80094d0 con 0x7f47c806f890 2023-07-06T22:00:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47cce31640 1 --2- 172.21.15.55:0/1822642957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c806f890 0x7f47c80c92d0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f47b801a860 tx=0x7f47b8018f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47bdffb640 1 -- 172.21.15.55:0/1822642957 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80b4420 con 0x7f47c806f890 2023-07-06T22:00:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47bdffb640 1 -- 172.21.15.55:0/1822642957 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b80b4580 con 0x7f47c806f890 2023-07-06T22:00:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.922+0000 7f47bdffb640 1 -- 172.21.15.55:0/1822642957 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80b48f0 con 0x7f47c806f890 2023-07-06T22:00:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.926+0000 7f47cf896640 1 -- 172.21.15.55:0/1822642957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c80c1ad0 con 0x7f47c806f890 2023-07-06T22:00:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.926+0000 7f47cf896640 1 -- 172.21.15.55:0/1822642957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c80c2090 con 0x7f47c806f890 2023-07-06T22:00:09.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.926+0000 7f47cf896640 1 -- 172.21.15.55:0/1822642957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c8066d60 con 0x7f47c806f890 2023-07-06T22:00:09.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.926+0000 7f47bdffb640 1 -- 172.21.15.55:0/1822642957 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f47b80b2070 con 0x7f47c806f890 2023-07-06T22:00:09.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.926+0000 7f47bdffb640 1 --2- 172.21.15.55:0/1822642957 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f47ac0663a0 0x7f47ac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:09.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.926+0000 7f47bdffb640 1 -- 172.21.15.55:0/1822642957 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6390+0+0 (secure 0 0 0) 0x7f47b811d380 con 0x7f47c806f890 2023-07-06T22:00:09.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.926+0000 7f47cd632640 1 --2- 172.21.15.55:0/1822642957 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f47ac0663a0 0x7f47ac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:09.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.930+0000 7f47cd632640 1 --2- 172.21.15.55:0/1822642957 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f47ac0663a0 0x7f47ac068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f47c40079c0 tx=0x7f47c4008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:09.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:09.930+0000 7f47bdffb640 1 -- 172.21.15.55:0/1822642957 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f47b80ea4a0 con 0x7f47c806f890 2023-07-06T22:00:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.086+0000 7f47cf896640 1 -- 172.21.15.55:0/1822642957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f47c80cb6c0 con 0x7f47c806f890 2023-07-06T22:00:10.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.094+0000 7f47bdffb640 1 -- 172.21.15.55:0/1822642957 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v39) v1 ==== 115+0+0 (secure 0 0 0) 0x7f47b80edac0 con 0x7f47c806f890 2023-07-06T22:00:10.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.094+0000 7f47cf896640 1 -- 172.21.15.55:0/1822642957 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f47ac0663a0 msgr2=0x7f47ac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:10.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.094+0000 7f47cf896640 1 --2- 172.21.15.55:0/1822642957 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f47ac0663a0 0x7f47ac068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f47c40079c0 tx=0x7f47c4008040 comp rx=0 tx=0).stop 2023-07-06T22:00:10.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.094+0000 7f47cf896640 1 -- 172.21.15.55:0/1822642957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c806f890 msgr2=0x7f47c80c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:10.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.094+0000 7f47cf896640 1 --2- 172.21.15.55:0/1822642957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c806f890 0x7f47c80c92d0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f47b801a860 tx=0x7f47b8018f50 comp rx=0 tx=0).stop 2023-07-06T22:00:10.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.094+0000 7f47cf896640 1 -- 172.21.15.55:0/1822642957 shutdown_connections 2023-07-06T22:00:10.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.094+0000 7f47cf896640 1 --2- 172.21.15.55:0/1822642957 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f47ac0663a0 0x7f47ac068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:10.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.094+0000 7f47cf896640 1 --2- 172.21.15.55:0/1822642957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47c80c11a0 0x7f47c80c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:10.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.094+0000 7f47cf896640 1 --2- 172.21.15.55:0/1822642957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c806f890 0x7f47c80c92d0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:10.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.094+0000 7f47cf896640 1 --2- 172.21.15.55:0/1822642957 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47c806eee0 0x7f47c8159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:10.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.094+0000 7f47cf896640 1 -- 172.21.15.55:0/1822642957 >> 172.21.15.55:0/1822642957 conn(0x7f47c80cea70 msgr2=0x7f47c815fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:10.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.094+0000 7f47cf896640 1 -- 172.21.15.55:0/1822642957 shutdown_connections 2023-07-06T22:00:10.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.094+0000 7f47cf896640 1 -- 172.21.15.55:0/1822642957 wait complete. 2023-07-06T22:00:10.114 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-07-06T22:00:10.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.258+0000 7ff54989c640 1 Processor -- start 2023-07-06T22:00:10.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.258+0000 7ff54989c640 1 -- start start 2023-07-06T22:00:10.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.258+0000 7ff54989c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5440712f0 0x7ff54406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:10.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.258+0000 7ff54989c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff5440b3730 0x7ff5440c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:10.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.258+0000 7ff54989c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5440ca280 0x7ff5440c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:10.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.258+0000 7ff54989c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5440ca700 con 0x7ff5440ca280 2023-07-06T22:00:10.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.258+0000 7ff54989c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff544159cd0 con 0x7ff5440b3730 2023-07-06T22:00:10.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.258+0000 7ff54989c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440693f0 con 0x7ff5440712f0 2023-07-06T22:00:10.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.258+0000 7ff5437fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5440ca280 0x7ff5440c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:10.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.258+0000 7ff5437fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5440ca280 0x7ff5440c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56542/0 (socket says 172.21.15.55:56542) 2023-07-06T22:00:10.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.258+0000 7ff5437fe640 1 -- 172.21.15.55:0/350956265 learned_addr learned my addr 172.21.15.55:0/350956265 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:10.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.258+0000 7ff542ffd640 1 --2- 172.21.15.55:0/350956265 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5440712f0 0x7ff54406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:10.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.258+0000 7ff53bfff640 1 --2- 172.21.15.55:0/350956265 >> v2:172.21.15.138:3300/0 conn(0x7ff5440b3730 0x7ff5440c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:10.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.262+0000 7ff5437fe640 1 -- 172.21.15.55:0/350956265 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5440712f0 msgr2=0x7ff54406a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:10.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.262+0000 7ff5437fe640 1 --2- 172.21.15.55:0/350956265 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5440712f0 0x7ff54406a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:10.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.262+0000 7ff5437fe640 1 -- 172.21.15.55:0/350956265 >> v2:172.21.15.138:3300/0 conn(0x7ff5440b3730 msgr2=0x7ff5440c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:10.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.262+0000 7ff5437fe640 1 --2- 172.21.15.55:0/350956265 >> v2:172.21.15.138:3300/0 conn(0x7ff5440b3730 0x7ff5440c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:10.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.262+0000 7ff5437fe640 1 -- 172.21.15.55:0/350956265 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54406aca0 con 0x7ff5440ca280 2023-07-06T22:00:10.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.262+0000 7ff5437fe640 1 --2- 172.21.15.55:0/350956265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5440ca280 0x7ff5440c8520 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7ff544071980 tx=0x7ff53c01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6893f68e71f1e435 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:10.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.262+0000 7ff5427fc640 1 -- 172.21.15.55:0/350956265 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0a6480 con 0x7ff5440ca280 2023-07-06T22:00:10.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.262+0000 7ff5427fc640 1 -- 172.21.15.55:0/350956265 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c0a65e0 con 0x7ff5440ca280 2023-07-06T22:00:10.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.262+0000 7ff5427fc640 1 -- 172.21.15.55:0/350956265 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0a6970 con 0x7ff5440ca280 2023-07-06T22:00:10.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 -- 172.21.15.55:0/350956265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5440ca280 msgr2=0x7ff5440c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:10.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 --2- 172.21.15.55:0/350956265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5440ca280 0x7ff5440c8520 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7ff544071980 tx=0x7ff53c01c6e0 comp rx=0 tx=0).stop 2023-07-06T22:00:10.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 -- 172.21.15.55:0/350956265 shutdown_connections 2023-07-06T22:00:10.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 --2- 172.21.15.55:0/350956265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5440ca280 0x7ff5440c8520 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:10.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 --2- 172.21.15.55:0/350956265 >> v2:172.21.15.138:3300/0 conn(0x7ff5440b3730 0x7ff5440c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:10.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 --2- 172.21.15.55:0/350956265 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5440712f0 0x7ff54406a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:10.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 -- 172.21.15.55:0/350956265 >> 172.21.15.55:0/350956265 conn(0x7ff5440cded0 msgr2=0x7ff5440ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:10.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 -- 172.21.15.55:0/350956265 shutdown_connections 2023-07-06T22:00:10.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 -- 172.21.15.55:0/350956265 wait complete. 2023-07-06T22:00:10.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 Processor -- start 2023-07-06T22:00:10.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 -- start start 2023-07-06T22:00:10.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5440712f0 0x7ff5441517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:10.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5440b3730 0x7ff5440aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:10.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5440ca280 0x7ff5440af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:10.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54415a470 con 0x7ff5440ca280 2023-07-06T22:00:10.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440c7d20 con 0x7ff5440b3730 2023-07-06T22:00:10.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff54989c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54415a680 con 0x7ff5440712f0 2023-07-06T22:00:10.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff5437fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5440ca280 0x7ff5440af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:10.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff5437fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5440ca280 0x7ff5440af1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56556/0 (socket says 172.21.15.55:56556) 2023-07-06T22:00:10.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff5437fe640 1 -- 172.21.15.55:0/1962078183 learned_addr learned my addr 172.21.15.55:0/1962078183 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:10.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff542ffd640 1 --2- 172.21.15.55:0/1962078183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5440712f0 0x7ff5441517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:10.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff53bfff640 1 --2- 172.21.15.55:0/1962078183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5440b3730 0x7ff5440aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:10.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff5437fe640 1 -- 172.21.15.55:0/1962078183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5440712f0 msgr2=0x7ff5441517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:10.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff5437fe640 1 --2- 172.21.15.55:0/1962078183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5440712f0 0x7ff5441517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:10.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff5437fe640 1 -- 172.21.15.55:0/1962078183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5440b3730 msgr2=0x7ff5440aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:10.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff5437fe640 1 --2- 172.21.15.55:0/1962078183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5440b3730 0x7ff5440aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:10.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.266+0000 7ff5437fe640 1 -- 172.21.15.55:0/1962078183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c009b30 con 0x7ff5440ca280 2023-07-06T22:00:10.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.270+0000 7ff5437fe640 1 --2- 172.21.15.55:0/1962078183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5440ca280 0x7ff5440af1c0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0ab040 tx=0x7ff53c019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:10.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.270+0000 7ff540ff9640 1 -- 172.21.15.55:0/1962078183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0a6480 con 0x7ff5440ca280 2023-07-06T22:00:10.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.270+0000 7ff540ff9640 1 -- 172.21.15.55:0/1962078183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c0b5070 con 0x7ff5440ca280 2023-07-06T22:00:10.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.270+0000 7ff540ff9640 1 -- 172.21.15.55:0/1962078183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0a78c0 con 0x7ff5440ca280 2023-07-06T22:00:10.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.270+0000 7ff54989c640 1 -- 172.21.15.55:0/1962078183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54415a960 con 0x7ff5440ca280 2023-07-06T22:00:10.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.270+0000 7ff54989c640 1 -- 172.21.15.55:0/1962078183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff544151ce0 con 0x7ff5440ca280 2023-07-06T22:00:10.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.270+0000 7ff54989c640 1 -- 172.21.15.55:0/1962078183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff544066d60 con 0x7ff5440ca280 2023-07-06T22:00:10.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.270+0000 7ff540ff9640 1 -- 172.21.15.55:0/1962078183 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff53c0a7a20 con 0x7ff5440ca280 2023-07-06T22:00:10.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.270+0000 7ff540ff9640 1 --2- 172.21.15.55:0/1962078183 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff5240663d0 0x7ff524068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:10.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.270+0000 7ff540ff9640 1 -- 172.21.15.55:0/1962078183 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6390+0+0 (secure 0 0 0) 0x7ff53c11e050 con 0x7ff5440ca280 2023-07-06T22:00:10.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.270+0000 7ff542ffd640 1 --2- 172.21.15.55:0/1962078183 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff5240663d0 0x7ff524068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:10.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.274+0000 7ff542ffd640 1 --2- 172.21.15.55:0/1962078183 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff5240663d0 0x7ff524068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff534004610 tx=0x7ff534008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:10.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.274+0000 7ff540ff9640 1 -- 172.21.15.55:0/1962078183 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff53c0eb280 con 0x7ff5440ca280 2023-07-06T22:00:10.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:10.486+0000 7ff54989c640 1 -- 172.21.15.55:0/1962078183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7ff54415ae10 con 0x7ff5440ca280 2023-07-06T22:00:11.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.030+0000 7ff540ff9640 1 -- 172.21.15.55:0/1962078183 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v691) v1 ==== 183+0+0 (secure 0 0 0) 0x7ff53c0b70f0 con 0x7ff5440ca280 2023-07-06T22:00:11.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.030+0000 7ff54989c640 1 -- 172.21.15.55:0/1962078183 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff5240663d0 msgr2=0x7ff524068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:11.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.030+0000 7ff54989c640 1 --2- 172.21.15.55:0/1962078183 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff5240663d0 0x7ff524068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff534004610 tx=0x7ff534008040 comp rx=0 tx=0).stop 2023-07-06T22:00:11.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.030+0000 7ff54989c640 1 -- 172.21.15.55:0/1962078183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5440ca280 msgr2=0x7ff5440af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:11.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.030+0000 7ff54989c640 1 --2- 172.21.15.55:0/1962078183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5440ca280 0x7ff5440af1c0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0ab040 tx=0x7ff53c019480 comp rx=0 tx=0).stop 2023-07-06T22:00:11.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.030+0000 7ff54989c640 1 -- 172.21.15.55:0/1962078183 shutdown_connections 2023-07-06T22:00:11.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.030+0000 7ff54989c640 1 --2- 172.21.15.55:0/1962078183 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff5240663d0 0x7ff524068880 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:11.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.030+0000 7ff54989c640 1 --2- 172.21.15.55:0/1962078183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5440ca280 0x7ff5440af1c0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:11.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.030+0000 7ff54989c640 1 --2- 172.21.15.55:0/1962078183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5440b3730 0x7ff5440aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:11.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.030+0000 7ff54989c640 1 --2- 172.21.15.55:0/1962078183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5440712f0 0x7ff5441517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:11.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.030+0000 7ff54989c640 1 -- 172.21.15.55:0/1962078183 >> 172.21.15.55:0/1962078183 conn(0x7ff5440cded0 msgr2=0x7ff5440b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:11.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.030+0000 7ff54989c640 1 -- 172.21.15.55:0/1962078183 shutdown_connections 2023-07-06T22:00:11.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.030+0000 7ff54989c640 1 -- 172.21.15.55:0/1962078183 wait complete. 2023-07-06T22:00:11.054 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) ... ok 2023-07-06T22:00:11.055 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-07-06T22:00:11.055 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-06T22:00:11.055 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-07-06T22:00:11.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5989ed8640 1 Processor -- start 2023-07-06T22:00:11.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5989ed8640 1 -- start start 2023-07-06T22:00:11.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5989ed8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59840ca450 0x7f598406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:11.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5989ed8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5984159cd0 con 0x7f59840b3730 2023-07-06T22:00:11.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5989ed8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59840693f0 con 0x7f59840712f0 2023-07-06T22:00:11.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5989ed8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598406aca0 con 0x7f59840ca450 2023-07-06T22:00:11.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5983fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f59840b3730 0x7f598415d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46140/0 (socket says 172.21.15.55:46140) 2023-07-06T22:00:11.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5983fff640 1 -- 172.21.15.55:0/4121792366 learned_addr learned my addr 172.21.15.55:0/4121792366 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:11.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5982ffd640 1 --2- 172.21.15.55:0/4121792366 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59840ca450 0x7f598406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:11.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 -- 172.21.15.55:0/4121792366 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457646224 0 0) 0x7f5984159cd0 con 0x7f59840b3730 2023-07-06T22:00:11.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 -- 172.21.15.55:0/4121792366 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f596c003530 con 0x7f59840b3730 2023-07-06T22:00:11.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 -- 172.21.15.55:0/4121792366 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3394477963 0 0) 0x7f596c003530 con 0x7f59840b3730 2023-07-06T22:00:11.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 -- 172.21.15.55:0/4121792366 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59840ca450 msgr2=0x7f598406a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:11.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 --2- 172.21.15.55:0/4121792366 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59840ca450 0x7f598406a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:11.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 -- 172.21.15.55:0/4121792366 >> v1:172.21.15.138:6789/0 conn(0x7f59840712f0 legacy=0x7f59840c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:11.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 -- 172.21.15.55:0/4121792366 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59840696b0 con 0x7f59840b3730 2023-07-06T22:00:11.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 -- 172.21.15.55:0/4121792366 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f597c001a00 con 0x7f59840b3730 2023-07-06T22:00:11.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 -- 172.21.15.55:0/4121792366 >> v1:172.21.15.55:6789/0 conn(0x7f59840b3730 legacy=0x7f598415d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:11.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 --2- 172.21.15.55:0/4121792366 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59840ca450 0x7f596c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:11.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 --2- 172.21.15.55:0/4121792366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f596c003ef0 0x7f596c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:11.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 --2- 172.21.15.55:0/4121792366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f596c004d10 0x7f596c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:11.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 -- 172.21.15.55:0/4121792366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598406aca0 con 0x7f596c004d10 2023-07-06T22:00:11.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 -- 172.21.15.55:0/4121792366 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c00b9c0 con 0x7f596c003ef0 2023-07-06T22:00:11.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59827fc640 1 -- 172.21.15.55:0/4121792366 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596c00bb80 con 0x7f59840ca450 2023-07-06T22:00:11.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5983fff640 1 --2- 172.21.15.55:0/4121792366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f596c004d10 0x7f596c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:11.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f59837fe640 1 --2- 172.21.15.55:0/4121792366 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59840ca450 0x7f596c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:11.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5982ffd640 1 --2- 172.21.15.55:0/4121792366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f596c003ef0 0x7f596c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:11.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5983fff640 1 -- 172.21.15.55:0/4121792366 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59840ca450 msgr2=0x7f596c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:11.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5983fff640 1 --2- 172.21.15.55:0/4121792366 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59840ca450 0x7f596c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:11.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5983fff640 1 -- 172.21.15.55:0/4121792366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f596c003ef0 msgr2=0x7f596c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:11.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5983fff640 1 --2- 172.21.15.55:0/4121792366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f596c003ef0 0x7f596c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:11.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.206+0000 7f5983fff640 1 -- 172.21.15.55:0/4121792366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c003530 con 0x7f596c004d10 2023-07-06T22:00:11.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.210+0000 7f5983fff640 1 --2- 172.21.15.55:0/4121792366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f596c004d10 0x7f596c005180 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f597c005b00 tx=0x7f597c01d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf31020d5b453 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:11.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.210+0000 7f59827fc640 1 -- 172.21.15.55:0/4121792366 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c0aa030 con 0x7f596c004d10 2023-07-06T22:00:11.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.210+0000 7f59827fc640 1 -- 172.21.15.55:0/4121792366 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c0a6860 con 0x7f596c004d10 2023-07-06T22:00:11.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.210+0000 7f59827fc640 1 -- 172.21.15.55:0/4121792366 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c0a6c50 con 0x7f596c004d10 2023-07-06T22:00:11.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.210+0000 7f5989ed8640 1 -- 172.21.15.55:0/4121792366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f596c004d10 msgr2=0x7f596c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:11.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.210+0000 7f5989ed8640 1 --2- 172.21.15.55:0/4121792366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f596c004d10 0x7f596c005180 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f597c005b00 tx=0x7f597c01d940 comp rx=0 tx=0).stop 2023-07-06T22:00:11.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.210+0000 7f5983fff640 1 -- 172.21.15.55:0/4121792366 reap_dead start 2023-07-06T22:00:11.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.210+0000 7f5989ed8640 1 -- 172.21.15.55:0/4121792366 shutdown_connections 2023-07-06T22:00:11.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.210+0000 7f5989ed8640 1 -- 172.21.15.55:0/4121792366 >> 172.21.15.55:0/4121792366 conn(0x7f59840cded0 msgr2=0x7f59840ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:11.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.210+0000 7f5989ed8640 1 -- 172.21.15.55:0/4121792366 shutdown_connections 2023-07-06T22:00:11.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.210+0000 7f5989ed8640 1 -- 172.21.15.55:0/4121792366 wait complete. 2023-07-06T22:00:11.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5989ed8640 1 Processor -- start 2023-07-06T22:00:11.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5989ed8640 1 -- start start 2023-07-06T22:00:11.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5989ed8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f596c004d10 0x7f59840cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:11.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5989ed8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59840cbae0 0x7f59841e64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:11.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5989ed8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59840cbf50 0x7f5984148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:11.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5989ed8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59840cc450 con 0x7f59840cbae0 2023-07-06T22:00:11.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5989ed8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59840cc730 con 0x7f596c004d10 2023-07-06T22:00:11.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5989ed8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59840cca10 con 0x7f59840cbf50 2023-07-06T22:00:11.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5982ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59840cbae0 0x7f59841e64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:11.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5982ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59840cbae0 0x7f59841e64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56568/0 (socket says 172.21.15.55:56568) 2023-07-06T22:00:11.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5982ffd640 1 -- 172.21.15.55:0/3527828508 learned_addr learned my addr 172.21.15.55:0/3527828508 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:11.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5983fff640 1 --2- 172.21.15.55:0/3527828508 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59840cbf50 0x7f5984148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:11.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f59837fe640 1 --2- 172.21.15.55:0/3527828508 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f596c004d10 0x7f59840cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:11.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5982ffd640 1 -- 172.21.15.55:0/3527828508 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59840cbf50 msgr2=0x7f5984148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:11.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5982ffd640 1 --2- 172.21.15.55:0/3527828508 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59840cbf50 0x7f5984148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:11.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5982ffd640 1 -- 172.21.15.55:0/3527828508 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f596c004d10 msgr2=0x7f59840cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:11.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5982ffd640 1 --2- 172.21.15.55:0/3527828508 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f596c004d10 0x7f59840cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:11.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5982ffd640 1 -- 172.21.15.55:0/3527828508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59840cccf0 con 0x7f59840cbae0 2023-07-06T22:00:11.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5982ffd640 1 --2- 172.21.15.55:0/3527828508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59840cbae0 0x7f59841e64a0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f5978011960 tx=0x7f5978011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:11.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f596bfff640 1 -- 172.21.15.55:0/3527828508 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978004240 con 0x7f59840cbae0 2023-07-06T22:00:11.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f596bfff640 1 -- 172.21.15.55:0/3527828508 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59780043a0 con 0x7f59840cbae0 2023-07-06T22:00:11.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f596bfff640 1 -- 172.21.15.55:0/3527828508 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597800fb00 con 0x7f59840cbae0 2023-07-06T22:00:11.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.214+0000 7f5989ed8640 1 -- 172.21.15.55:0/3527828508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59840ccfd0 con 0x7f59840cbae0 2023-07-06T22:00:11.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.218+0000 7f5989ed8640 1 -- 172.21.15.55:0/3527828508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59841e69e0 con 0x7f59840cbae0 2023-07-06T22:00:11.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.218+0000 7f5989ed8640 1 -- 172.21.15.55:0/3527828508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5984066d60 con 0x7f59840cbae0 2023-07-06T22:00:11.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.218+0000 7f596bfff640 1 -- 172.21.15.55:0/3527828508 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f597800fc60 con 0x7f59840cbae0 2023-07-06T22:00:11.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.218+0000 7f596bfff640 1 --2- 172.21.15.55:0/3527828508 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f59700663d0 0x7f5970068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:11.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.218+0000 7f596bfff640 1 -- 172.21.15.55:0/3527828508 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6390+0+0 (secure 0 0 0) 0x7f5978084650 con 0x7f59840cbae0 2023-07-06T22:00:11.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.218+0000 7f59837fe640 1 --2- 172.21.15.55:0/3527828508 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f59700663d0 0x7f5970068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:11.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.218+0000 7f59837fe640 1 --2- 172.21.15.55:0/3527828508 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f59700663d0 0x7f5970068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5974007fd0 tx=0x7f5974009040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:11.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.222+0000 7f596bfff640 1 -- 172.21.15.55:0/3527828508 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5978051860 con 0x7f59840cbae0 2023-07-06T22:00:11.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:11.430+0000 7f5989ed8640 1 -- 172.21.15.55:0/3527828508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f598406a1e0 con 0x7f59840cbae0 2023-07-06T22:00:12.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.030+0000 7f596bfff640 1 -- 172.21.15.55:0/3527828508 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v692) v1 ==== 151+0+0 (secure 0 0 0) 0x7f5978054e80 con 0x7f59840cbae0 2023-07-06T22:00:12.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.034+0000 7f5989ed8640 1 -- 172.21.15.55:0/3527828508 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f59700663d0 msgr2=0x7f5970068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.034+0000 7f5989ed8640 1 --2- 172.21.15.55:0/3527828508 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f59700663d0 0x7f5970068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5974007fd0 tx=0x7f5974009040 comp rx=0 tx=0).stop 2023-07-06T22:00:12.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.034+0000 7f5989ed8640 1 -- 172.21.15.55:0/3527828508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59840cbae0 msgr2=0x7f59841e64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.034+0000 7f5989ed8640 1 --2- 172.21.15.55:0/3527828508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59840cbae0 0x7f59841e64a0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f5978011960 tx=0x7f5978011e20 comp rx=0 tx=0).stop 2023-07-06T22:00:12.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.034+0000 7f5989ed8640 1 -- 172.21.15.55:0/3527828508 shutdown_connections 2023-07-06T22:00:12.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.034+0000 7f5989ed8640 1 --2- 172.21.15.55:0/3527828508 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f59700663d0 0x7f5970068880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.034+0000 7f5989ed8640 1 --2- 172.21.15.55:0/3527828508 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59840cbf50 0x7f5984148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.034+0000 7f5989ed8640 1 --2- 172.21.15.55:0/3527828508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59840cbae0 0x7f59841e64a0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.034+0000 7f5989ed8640 1 --2- 172.21.15.55:0/3527828508 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f596c004d10 0x7f59840cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.034+0000 7f5989ed8640 1 -- 172.21.15.55:0/3527828508 >> 172.21.15.55:0/3527828508 conn(0x7f59840cded0 msgr2=0x7f5984159440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:12.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.034+0000 7f5989ed8640 1 -- 172.21.15.55:0/3527828508 shutdown_connections 2023-07-06T22:00:12.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.034+0000 7f5989ed8640 1 -- 172.21.15.55:0/3527828508 wait complete. 2023-07-06T22:00:12.057 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:00:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de55e6640 1 Processor -- start 2023-07-06T22:00:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de55e6640 1 -- start start 2023-07-06T22:00:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de55e6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7de00b12e0 0x7f7de00d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de55e6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7de00d00f0 0x7f7de00d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de55e6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7de00b1a40 0x7f7de00b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de55e6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de00b3be0 con 0x7f7de00b1a40 2023-07-06T22:00:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de55e6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de00b4590 con 0x7f7de00d00f0 2023-07-06T22:00:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de55e6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00cc6a0 con 0x7f7de00b12e0 2023-07-06T22:00:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de4de5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7de00b1a40 0x7f7de00b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de4de5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7de00b1a40 0x7f7de00b1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56574/0 (socket says 172.21.15.55:56574) 2023-07-06T22:00:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de4de5640 1 -- 172.21.15.55:0/3909108243 learned_addr learned my addr 172.21.15.55:0/3909108243 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7ddffff640 1 --2- 172.21.15.55:0/3909108243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7de00b12e0 0x7f7de00d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de4de5640 1 -- 172.21.15.55:0/3909108243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7de00b12e0 msgr2=0x7f7de00d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:12.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de4de5640 1 --2- 172.21.15.55:0/3909108243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7de00b12e0 0x7f7de00d1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de4de5640 1 -- 172.21.15.55:0/3909108243 >> v2:172.21.15.138:3300/0 conn(0x7f7de00d00f0 msgr2=0x7f7de00d0540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T22:00:12.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de4de5640 1 --2- 172.21.15.55:0/3909108243 >> v2:172.21.15.138:3300/0 conn(0x7f7de00d00f0 0x7f7de00d0540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.206+0000 7f7de4de5640 1 -- 172.21.15.55:0/3909108243 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de00d0a80 con 0x7f7de00b1a40 2023-07-06T22:00:12.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.210+0000 7f7de4de5640 1 --2- 172.21.15.55:0/3909108243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de00b1a40 0x7f7de00b1ec0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f7de00725c0 tx=0x7f7dd801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65af0100f21b7dd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:12.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.210+0000 7f7ddeffd640 1 -- 172.21.15.55:0/3909108243 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80a5670 con 0x7f7de00b1a40 2023-07-06T22:00:12.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.210+0000 7f7ddeffd640 1 -- 172.21.15.55:0/3909108243 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd80a57d0 con 0x7f7de00b1a40 2023-07-06T22:00:12.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.210+0000 7f7ddeffd640 1 -- 172.21.15.55:0/3909108243 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80a5b60 con 0x7f7de00b1a40 2023-07-06T22:00:12.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.210+0000 7f7de55e6640 1 -- 172.21.15.55:0/3909108243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de00b1a40 msgr2=0x7f7de00b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.210+0000 7f7de55e6640 1 --2- 172.21.15.55:0/3909108243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de00b1a40 0x7f7de00b1ec0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f7de00725c0 tx=0x7f7dd801c9f0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.210+0000 7f7de55e6640 1 -- 172.21.15.55:0/3909108243 shutdown_connections 2023-07-06T22:00:12.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.210+0000 7f7de55e6640 1 --2- 172.21.15.55:0/3909108243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de00b1a40 0x7f7de00b1ec0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.210+0000 7f7de55e6640 1 --2- 172.21.15.55:0/3909108243 >> v2:172.21.15.138:3300/0 conn(0x7f7de00d00f0 0x7f7de00d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.210+0000 7f7de55e6640 1 --2- 172.21.15.55:0/3909108243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7de00b12e0 0x7f7de00d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.210+0000 7f7de55e6640 1 -- 172.21.15.55:0/3909108243 >> 172.21.15.55:0/3909108243 conn(0x7f7de00d20e0 msgr2=0x7f7de00d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:12.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.210+0000 7f7de55e6640 1 -- 172.21.15.55:0/3909108243 shutdown_connections 2023-07-06T22:00:12.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.210+0000 7f7de55e6640 1 -- 172.21.15.55:0/3909108243 wait complete. 2023-07-06T22:00:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.210+0000 7f7de55e6640 1 Processor -- start 2023-07-06T22:00:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de55e6640 1 -- start start 2023-07-06T22:00:12.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de55e6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7de00b12e0 0x7f7de0150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de55e6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7de00b1a40 0x7f7de0151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de55e6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de00d00f0 0x7f7de0152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de55e6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de015a750 con 0x7f7de00d00f0 2023-07-06T22:00:12.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de55e6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de0150740 con 0x7f7de00b12e0 2023-07-06T22:00:12.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de55e6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de0156f00 con 0x7f7de00b1a40 2023-07-06T22:00:12.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de4de5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de00d00f0 0x7f7de0152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de4de5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de00d00f0 0x7f7de0152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56586/0 (socket says 172.21.15.55:56586) 2023-07-06T22:00:12.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de4de5640 1 -- 172.21.15.55:0/3959901642 learned_addr learned my addr 172.21.15.55:0/3959901642 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:12.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de4de5640 1 -- 172.21.15.55:0/3959901642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7de00b1a40 msgr2=0x7f7de0151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7ddffff640 1 --2- 172.21.15.55:0/3959901642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7de00b12e0 0x7f7de0150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de4de5640 1 --2- 172.21.15.55:0/3959901642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7de00b1a40 0x7f7de0151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de4de5640 1 -- 172.21.15.55:0/3959901642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7de00b12e0 msgr2=0x7f7de0150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de4de5640 1 --2- 172.21.15.55:0/3959901642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7de00b12e0 0x7f7de0150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de4de5640 1 -- 172.21.15.55:0/3959901642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd8009b30 con 0x7f7de00d00f0 2023-07-06T22:00:12.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7ddffff640 1 --2- 172.21.15.55:0/3959901642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7de00b12e0 0x7f7de0150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:12.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de4de5640 1 --2- 172.21.15.55:0/3959901642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de00d00f0 0x7f7de0152370 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f7dd801b0a0 tx=0x7f7dd8019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:12.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7ddcff9640 1 -- 172.21.15.55:0/3959901642 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80a5dd0 con 0x7f7de00d00f0 2023-07-06T22:00:12.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7ddcff9640 1 -- 172.21.15.55:0/3959901642 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd80b8470 con 0x7f7de00d00f0 2023-07-06T22:00:12.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7ddcff9640 1 -- 172.21.15.55:0/3959901642 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80b8820 con 0x7f7de00d00f0 2023-07-06T22:00:12.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de55e6640 1 -- 172.21.15.55:0/3959901642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de01571e0 con 0x7f7de00d00f0 2023-07-06T22:00:12.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de55e6640 1 -- 172.21.15.55:0/3959901642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de015a370 con 0x7f7de00d00f0 2023-07-06T22:00:12.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.214+0000 7f7de55e6640 1 -- 172.21.15.55:0/3959901642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de015a890 con 0x7f7de00d00f0 2023-07-06T22:00:12.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.218+0000 7f7ddcff9640 1 -- 172.21.15.55:0/3959901642 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7dd80b8980 con 0x7f7de00d00f0 2023-07-06T22:00:12.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.218+0000 7f7ddcff9640 1 --2- 172.21.15.55:0/3959901642 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f7dcc0663a0 0x7f7dcc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.218+0000 7f7ddcff9640 1 -- 172.21.15.55:0/3959901642 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6390+0+0 (secure 0 0 0) 0x7f7dd811f2e0 con 0x7f7de00d00f0 2023-07-06T22:00:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.218+0000 7f7ddffff640 1 --2- 172.21.15.55:0/3959901642 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f7dcc0663a0 0x7f7dcc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.218+0000 7f7ddffff640 1 --2- 172.21.15.55:0/3959901642 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f7dcc0663a0 0x7f7dcc068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7de01f78f0 tx=0x7f7dd0008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:12.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.222+0000 7f7ddcff9640 1 -- 172.21.15.55:0/3959901642 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7dd80ec470 con 0x7f7de00d00f0 2023-07-06T22:00:12.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.374+0000 7f7de55e6640 1 -- 172.21.15.55:0/3959901642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7de00d0a80 con 0x7f7de00d00f0 2023-07-06T22:00:12.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.378+0000 7f7ddcff9640 1 -- 172.21.15.55:0/3959901642 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16095 (secure 0 0 0) 0x7f7de00d0a80 con 0x7f7de00d00f0 2023-07-06T22:00:12.377 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:12.377 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":122,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:00:09.016209+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.138:6833/1552399486":"2023-07-07T22:00:05.767884+0000","172.21.15.138:6832/1552399486":"2023-07-07T22:00:05.767884+0000","172.21.15.55:0/3099491809":"2023-07-07T22:00:02.978277+0000","172.21.15.55:6833/3474707671":"2023-07-07T22:00:02.978277+0000","172.21.15.55:6832/3474707671":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/2279917696":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/339003487":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/3514720666":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/1287872080":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/3568077879":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/4046135553":"2023-07-07T22:00:02.978277+0000","172.21.15.55:0/2589708229":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/782998468":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/4121483447":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/1183916649":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/11434186":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/494913604":"2023-07-07T21:58:55.799288+0000","172.21.15.55:6833/1408736549":"2023-07-07T21:58:55.799288+0000","172.21.15.55:0/106272164":"2023-07-07T22:00:02.978277+0000","172.21.15.55:6832/1408736549":"2023-07-07T21:58:55.799288+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:00:12.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.378+0000 7f7de55e6640 1 -- 172.21.15.55:0/3959901642 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f7dcc0663a0 msgr2=0x7f7dcc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.378+0000 7f7de55e6640 1 --2- 172.21.15.55:0/3959901642 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f7dcc0663a0 0x7f7dcc068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7de01f78f0 tx=0x7f7dd0008040 comp rx=0 tx=0).stop 2023-07-06T22:00:12.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.378+0000 7f7de55e6640 1 -- 172.21.15.55:0/3959901642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de00d00f0 msgr2=0x7f7de0152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.378+0000 7f7de55e6640 1 --2- 172.21.15.55:0/3959901642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de00d00f0 0x7f7de0152370 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f7dd801b0a0 tx=0x7f7dd8019790 comp rx=0 tx=0).stop 2023-07-06T22:00:12.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.378+0000 7f7de55e6640 1 -- 172.21.15.55:0/3959901642 shutdown_connections 2023-07-06T22:00:12.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.378+0000 7f7de55e6640 1 --2- 172.21.15.55:0/3959901642 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f7dcc0663a0 0x7f7dcc068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.378+0000 7f7de55e6640 1 --2- 172.21.15.55:0/3959901642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de00d00f0 0x7f7de0152370 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.378+0000 7f7de55e6640 1 --2- 172.21.15.55:0/3959901642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7de00b1a40 0x7f7de0151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.378+0000 7f7de55e6640 1 --2- 172.21.15.55:0/3959901642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7de00b12e0 0x7f7de0150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.378+0000 7f7de55e6640 1 -- 172.21.15.55:0/3959901642 >> 172.21.15.55:0/3959901642 conn(0x7f7de00d20e0 msgr2=0x7f7de0069a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:12.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.378+0000 7f7de55e6640 1 -- 172.21.15.55:0/3959901642 shutdown_connections 2023-07-06T22:00:12.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.378+0000 7f7de55e6640 1 -- 172.21.15.55:0/3959901642 wait complete. 2023-07-06T22:00:12.398 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:00:12.399 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:00:12.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.542+0000 7f5b70740640 1 Processor -- start 2023-07-06T22:00:12.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.542+0000 7f5b70740640 1 -- start start 2023-07-06T22:00:12.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.546+0000 7f5b70740640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b68158850 0x7f5b680cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.546+0000 7f5b70740640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b68070af0 0x7f5b680ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.546+0000 7f5b70740640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b68158c20 con 0x7f5b680ca130 2023-07-06T22:00:12.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.546+0000 7f5b70740640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b680b2aa0 con 0x7f5b68158850 2023-07-06T22:00:12.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.546+0000 7f5b70740640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680c8db0 con 0x7f5b68070af0 2023-07-06T22:00:12.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.546+0000 7f5b6e4dc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b68158850 0x7f5b680cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.546+0000 7f5b6e4dc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b68158850 0x7f5b680cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56596/0 (socket says 172.21.15.55:56596) 2023-07-06T22:00:12.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.546+0000 7f5b6e4dc640 1 -- 172.21.15.55:0/1789153333 learned_addr learned my addr 172.21.15.55:0/1789153333 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:12.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.546+0000 7f5b6ecdd640 1 --2- 172.21.15.55:0/1789153333 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b68070af0 0x7f5b680ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.546+0000 7f5b6e4dc640 1 -- 172.21.15.55:0/1789153333 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b68070af0 msgr2=0x7f5b680ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:12.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.546+0000 7f5b6e4dc640 1 --2- 172.21.15.55:0/1789153333 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b68070af0 0x7f5b680ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.546+0000 7f5b6e4dc640 1 -- 172.21.15.55:0/1789153333 >> v1:172.21.15.138:6789/0 conn(0x7f5b680ca130 legacy=0x7f5b680703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.546+0000 7f5b6e4dc640 1 -- 172.21.15.55:0/1789153333 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680c9090 con 0x7f5b68158850 2023-07-06T22:00:12.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.550+0000 7f5b6e4dc640 1 --2- 172.21.15.55:0/1789153333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b68158850 0x7f5b680cca30 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f5b64009870 tx=0x7f5b6401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3665d9c5d7e283b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:12.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.550+0000 7f5b6d4da640 1 -- 172.21.15.55:0/1789153333 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b640a8a30 con 0x7f5b68158850 2023-07-06T22:00:12.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.550+0000 7f5b6d4da640 1 -- 172.21.15.55:0/1789153333 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b640a8b90 con 0x7f5b68158850 2023-07-06T22:00:12.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.550+0000 7f5b6d4da640 1 -- 172.21.15.55:0/1789153333 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b640b0440 con 0x7f5b68158850 2023-07-06T22:00:12.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.550+0000 7f5b70740640 1 -- 172.21.15.55:0/1789153333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b68158850 msgr2=0x7f5b680cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.550+0000 7f5b70740640 1 --2- 172.21.15.55:0/1789153333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b68158850 0x7f5b680cca30 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f5b64009870 tx=0x7f5b6401ed30 comp rx=0 tx=0).stop 2023-07-06T22:00:12.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.550+0000 7f5b70740640 1 -- 172.21.15.55:0/1789153333 shutdown_connections 2023-07-06T22:00:12.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.550+0000 7f5b70740640 1 --2- 172.21.15.55:0/1789153333 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b68070af0 0x7f5b680ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.550+0000 7f5b70740640 1 --2- 172.21.15.55:0/1789153333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b68158850 0x7f5b680cca30 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.550+0000 7f5b70740640 1 -- 172.21.15.55:0/1789153333 >> 172.21.15.55:0/1789153333 conn(0x7f5b680cea70 msgr2=0x7f5b680ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:12.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.550+0000 7f5b70740640 1 -- 172.21.15.55:0/1789153333 shutdown_connections 2023-07-06T22:00:12.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.550+0000 7f5b70740640 1 -- 172.21.15.55:0/1789153333 wait complete. 2023-07-06T22:00:12.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.550+0000 7f5b70740640 1 Processor -- start 2023-07-06T22:00:12.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.550+0000 7f5b70740640 1 -- start start 2023-07-06T22:00:12.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b70740640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b68070af0 0x7f5b6806a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b70740640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b680ca130 0x7f5b681f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b70740640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b68158850 0x7f5b680693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b70740640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6806b4d0 con 0x7f5b680ca130 2023-07-06T22:00:12.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b70740640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6806aa60 con 0x7f5b68070af0 2023-07-06T22:00:12.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b70740640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b681f2d50 con 0x7f5b68158850 2023-07-06T22:00:12.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b6dcdb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b680ca130 0x7f5b681f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b6dcdb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b680ca130 0x7f5b681f2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56606/0 (socket says 172.21.15.55:56606) 2023-07-06T22:00:12.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b6dcdb640 1 -- 172.21.15.55:0/652196677 learned_addr learned my addr 172.21.15.55:0/652196677 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:12.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b6dcdb640 1 -- 172.21.15.55:0/652196677 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b68158850 msgr2=0x7f5b680693f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T22:00:12.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b6dcdb640 1 --2- 172.21.15.55:0/652196677 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b68158850 0x7f5b680693f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b6dcdb640 1 -- 172.21.15.55:0/652196677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b68070af0 msgr2=0x7f5b6806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b6dcdb640 1 --2- 172.21.15.55:0/652196677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b68070af0 0x7f5b6806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b6dcdb640 1 -- 172.21.15.55:0/652196677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b640094d0 con 0x7f5b680ca130 2023-07-06T22:00:12.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b6dcdb640 1 --2- 172.21.15.55:0/652196677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b680ca130 0x7f5b681f2500 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800c500 tx=0x7f5b5800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:12.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b5effd640 1 -- 172.21.15.55:0/652196677 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58005220 con 0x7f5b680ca130 2023-07-06T22:00:12.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b5effd640 1 -- 172.21.15.55:0/652196677 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b58005380 con 0x7f5b680ca130 2023-07-06T22:00:12.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b5effd640 1 -- 172.21.15.55:0/652196677 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58007270 con 0x7f5b680ca130 2023-07-06T22:00:12.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b70740640 1 -- 172.21.15.55:0/652196677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b681f3030 con 0x7f5b680ca130 2023-07-06T22:00:12.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b70740640 1 -- 172.21.15.55:0/652196677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b681f2a40 con 0x7f5b680ca130 2023-07-06T22:00:12.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b70740640 1 -- 172.21.15.55:0/652196677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b68066d60 con 0x7f5b680ca130 2023-07-06T22:00:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.554+0000 7f5b5effd640 1 -- 172.21.15.55:0/652196677 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5b580073d0 con 0x7f5b680ca130 2023-07-06T22:00:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.558+0000 7f5b5effd640 1 --2- 172.21.15.55:0/652196677 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5b4c0663a0 0x7f5b4c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.558+0000 7f5b5effd640 1 -- 172.21.15.55:0/652196677 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6390+0+0 (secure 0 0 0) 0x7f5b58083660 con 0x7f5b680ca130 2023-07-06T22:00:12.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.558+0000 7f5b6e4dc640 1 --2- 172.21.15.55:0/652196677 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5b4c0663a0 0x7f5b4c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.558+0000 7f5b6e4dc640 1 --2- 172.21.15.55:0/652196677 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5b4c0663a0 0x7f5b4c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5b640b2000 tx=0x7f5b64004740 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:12.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.562+0000 7f5b5effd640 1 -- 172.21.15.55:0/652196677 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5b580507f0 con 0x7f5b680ca130 2023-07-06T22:00:12.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.714+0000 7f5b70740640 1 -- 172.21.15.55:0/652196677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b6806cd30 con 0x7f5b680ca130 2023-07-06T22:00:12.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.714+0000 7f5b5effd640 1 -- 172.21.15.55:0/652196677 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v122) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b58053e10 con 0x7f5b680ca130 2023-07-06T22:00:12.714 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:00:12.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.714+0000 7f5b70740640 1 -- 172.21.15.55:0/652196677 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5b4c0663a0 msgr2=0x7f5b4c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.714+0000 7f5b70740640 1 --2- 172.21.15.55:0/652196677 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5b4c0663a0 0x7f5b4c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5b640b2000 tx=0x7f5b64004740 comp rx=0 tx=0).stop 2023-07-06T22:00:12.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.714+0000 7f5b70740640 1 -- 172.21.15.55:0/652196677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b680ca130 msgr2=0x7f5b681f2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.714+0000 7f5b70740640 1 --2- 172.21.15.55:0/652196677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b680ca130 0x7f5b681f2500 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800c500 tx=0x7f5b5800c9c0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.718+0000 7f5b70740640 1 -- 172.21.15.55:0/652196677 shutdown_connections 2023-07-06T22:00:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.718+0000 7f5b70740640 1 --2- 172.21.15.55:0/652196677 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5b4c0663a0 0x7f5b4c068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.718+0000 7f5b70740640 1 --2- 172.21.15.55:0/652196677 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b68158850 0x7f5b680693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.718+0000 7f5b70740640 1 --2- 172.21.15.55:0/652196677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b680ca130 0x7f5b681f2500 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.718+0000 7f5b70740640 1 --2- 172.21.15.55:0/652196677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b68070af0 0x7f5b6806a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.718+0000 7f5b70740640 1 -- 172.21.15.55:0/652196677 >> 172.21.15.55:0/652196677 conn(0x7f5b680cea70 msgr2=0x7f5b680c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.718+0000 7f5b70740640 1 -- 172.21.15.55:0/652196677 shutdown_connections 2023-07-06T22:00:12.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.718+0000 7f5b70740640 1 -- 172.21.15.55:0/652196677 wait complete. 2023-07-06T22:00:12.735 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:00:12.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512f7fa640 1 Processor -- start 2023-07-06T22:00:12.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512f7fa640 1 -- start start 2023-07-06T22:00:12.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512f7fa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5128158850 0x7f51280cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512f7fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51280ca130 0x7f51280ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512f7fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51280703e0 0x7f5128070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512f7fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5128070dc0 con 0x7f51280703e0 2023-07-06T22:00:12.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512f7fa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5128158c20 con 0x7f5128158850 2023-07-06T22:00:12.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512f7fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51280c8db0 con 0x7f51280ca130 2023-07-06T22:00:12.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512dd97640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51280703e0 0x7f5128070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512dd97640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51280703e0 0x7f5128070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56612/0 (socket says 172.21.15.55:56612) 2023-07-06T22:00:12.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512dd97640 1 -- 172.21.15.55:0/3467616392 learned_addr learned my addr 172.21.15.55:0/3467616392 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:12.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512d596640 1 --2- 172.21.15.55:0/3467616392 >> v2:172.21.15.138:3300/0 conn(0x7f5128158850 0x7f51280cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512cd95640 1 --2- 172.21.15.55:0/3467616392 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51280ca130 0x7f51280ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512dd97640 1 -- 172.21.15.55:0/3467616392 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51280ca130 msgr2=0x7f51280ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:12.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512dd97640 1 --2- 172.21.15.55:0/3467616392 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51280ca130 0x7f51280ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512dd97640 1 -- 172.21.15.55:0/3467616392 >> v2:172.21.15.138:3300/0 conn(0x7f5128158850 msgr2=0x7f51280cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:12.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512dd97640 1 --2- 172.21.15.55:0/3467616392 >> v2:172.21.15.138:3300/0 conn(0x7f5128158850 0x7f51280cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512dd97640 1 -- 172.21.15.55:0/3467616392 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51280c9090 con 0x7f51280703e0 2023-07-06T22:00:12.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.882+0000 7f512cd95640 1 --2- 172.21.15.55:0/3467616392 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51280ca130 0x7f51280ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:12.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.886+0000 7f512dd97640 1 --2- 172.21.15.55:0/3467616392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51280703e0 0x7f5128070880 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f512806eaf0 tx=0x7f512001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6453f5d5fa9ab1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:12.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.886+0000 7f511ffff640 1 -- 172.21.15.55:0/3467616392 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51200af400 con 0x7f51280703e0 2023-07-06T22:00:12.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.886+0000 7f511ffff640 1 -- 172.21.15.55:0/3467616392 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51200ab050 con 0x7f51280703e0 2023-07-06T22:00:12.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.886+0000 7f511ffff640 1 -- 172.21.15.55:0/3467616392 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51200af780 con 0x7f51280703e0 2023-07-06T22:00:12.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.886+0000 7f512f7fa640 1 -- 172.21.15.55:0/3467616392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51280703e0 msgr2=0x7f5128070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.886+0000 7f512f7fa640 1 --2- 172.21.15.55:0/3467616392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51280703e0 0x7f5128070880 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f512806eaf0 tx=0x7f512001f1c0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.886+0000 7f512f7fa640 1 -- 172.21.15.55:0/3467616392 shutdown_connections 2023-07-06T22:00:12.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.886+0000 7f512f7fa640 1 --2- 172.21.15.55:0/3467616392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51280703e0 0x7f5128070880 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.886+0000 7f512f7fa640 1 --2- 172.21.15.55:0/3467616392 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51280ca130 0x7f51280ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.886+0000 7f512f7fa640 1 --2- 172.21.15.55:0/3467616392 >> v2:172.21.15.138:3300/0 conn(0x7f5128158850 0x7f51280cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.886+0000 7f512f7fa640 1 -- 172.21.15.55:0/3467616392 >> 172.21.15.55:0/3467616392 conn(0x7f51280cea70 msgr2=0x7f51280ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:12.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.886+0000 7f512f7fa640 1 -- 172.21.15.55:0/3467616392 shutdown_connections 2023-07-06T22:00:12.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.886+0000 7f512f7fa640 1 -- 172.21.15.55:0/3467616392 wait complete. 2023-07-06T22:00:12.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512f7fa640 1 Processor -- start 2023-07-06T22:00:12.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512f7fa640 1 -- start start 2023-07-06T22:00:12.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512f7fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51280703e0 0x7f51280c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512f7fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51280ca130 0x7f5128155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512f7fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5128158850 0x7f51281564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512f7fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51280c7b60 con 0x7f5128158850 2023-07-06T22:00:12.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512f7fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512806a5d0 con 0x7f51280703e0 2023-07-06T22:00:12.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512f7fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5128069d30 con 0x7f51280ca130 2023-07-06T22:00:12.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512dd97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5128158850 0x7f51281564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512dd97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5128158850 0x7f51281564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56626/0 (socket says 172.21.15.55:56626) 2023-07-06T22:00:12.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512dd97640 1 -- 172.21.15.55:0/2273486774 learned_addr learned my addr 172.21.15.55:0/2273486774 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:12.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512cd95640 1 --2- 172.21.15.55:0/2273486774 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51280ca130 0x7f5128155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512dd97640 1 -- 172.21.15.55:0/2273486774 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51280ca130 msgr2=0x7f5128155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512dd97640 1 --2- 172.21.15.55:0/2273486774 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51280ca130 0x7f5128155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512dd97640 1 -- 172.21.15.55:0/2273486774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51280703e0 msgr2=0x7f51280c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:12.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512dd97640 1 --2- 172.21.15.55:0/2273486774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51280703e0 0x7f51280c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:12.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512dd97640 1 -- 172.21.15.55:0/2273486774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5120009b30 con 0x7f5128158850 2023-07-06T22:00:12.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512cd95640 1 --2- 172.21.15.55:0/2273486774 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51280ca130 0x7f5128155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:12.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512dd97640 1 --2- 172.21.15.55:0/2273486774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5128158850 0x7f51281564c0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f512001fa60 tx=0x7f512001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:12.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f511dffb640 1 -- 172.21.15.55:0/2273486774 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51200afde0 con 0x7f5128158850 2023-07-06T22:00:12.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f511dffb640 1 -- 172.21.15.55:0/2273486774 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5120009510 con 0x7f5128158850 2023-07-06T22:00:12.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f511dffb640 1 -- 172.21.15.55:0/2273486774 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51200ba680 con 0x7f5128158850 2023-07-06T22:00:12.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512f7fa640 1 -- 172.21.15.55:0/2273486774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512806a010 con 0x7f5128158850 2023-07-06T22:00:12.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512f7fa640 1 -- 172.21.15.55:0/2273486774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51281558d0 con 0x7f5128158850 2023-07-06T22:00:12.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.890+0000 7f512f7fa640 1 -- 172.21.15.55:0/2273486774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5128066d60 con 0x7f5128158850 2023-07-06T22:00:12.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.894+0000 7f511dffb640 1 -- 172.21.15.55:0/2273486774 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f51200b6040 con 0x7f5128158850 2023-07-06T22:00:12.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.894+0000 7f511dffb640 1 --2- 172.21.15.55:0/2273486774 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f510c0663a0 0x7f510c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:12.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.894+0000 7f511dffb640 1 -- 172.21.15.55:0/2273486774 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6390+0+0 (secure 0 0 0) 0x7f5120122410 con 0x7f5128158850 2023-07-06T22:00:12.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.894+0000 7f512d596640 1 --2- 172.21.15.55:0/2273486774 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f510c0663a0 0x7f510c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:12.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.894+0000 7f512d596640 1 --2- 172.21.15.55:0/2273486774 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f510c0663a0 0x7f510c068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f51280c4550 tx=0x7f5124008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:12.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:12.898+0000 7f511dffb640 1 -- 172.21.15.55:0/2273486774 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f51200ef540 con 0x7f5128158850 2023-07-06T22:00:13.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.054+0000 7f512f7fa640 1 -- 172.21.15.55:0/2273486774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f51280c7ca0 con 0x7f5128158850 2023-07-06T22:00:13.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.054+0000 7f511dffb640 1 -- 172.21.15.55:0/2273486774 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v122) v1 ==== 92+0+10 (secure 0 0 0) 0x7f51280c7ca0 con 0x7f5128158850 2023-07-06T22:00:13.054 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:00:13.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.054+0000 7f512f7fa640 1 -- 172.21.15.55:0/2273486774 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f510c0663a0 msgr2=0x7f510c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:13.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.054+0000 7f512f7fa640 1 --2- 172.21.15.55:0/2273486774 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f510c0663a0 0x7f510c068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f51280c4550 tx=0x7f5124008040 comp rx=0 tx=0).stop 2023-07-06T22:00:13.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.054+0000 7f512f7fa640 1 -- 172.21.15.55:0/2273486774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5128158850 msgr2=0x7f51281564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.054+0000 7f512f7fa640 1 --2- 172.21.15.55:0/2273486774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5128158850 0x7f51281564c0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f512001fa60 tx=0x7f512001bf60 comp rx=0 tx=0).stop 2023-07-06T22:00:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.058+0000 7f512f7fa640 1 -- 172.21.15.55:0/2273486774 shutdown_connections 2023-07-06T22:00:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.058+0000 7f512f7fa640 1 --2- 172.21.15.55:0/2273486774 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f510c0663a0 0x7f510c068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.058+0000 7f512f7fa640 1 --2- 172.21.15.55:0/2273486774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5128158850 0x7f51281564c0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.058+0000 7f512f7fa640 1 --2- 172.21.15.55:0/2273486774 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51280ca130 0x7f5128155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.058+0000 7f512f7fa640 1 --2- 172.21.15.55:0/2273486774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51280703e0 0x7f51280c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.058+0000 7f512f7fa640 1 -- 172.21.15.55:0/2273486774 >> 172.21.15.55:0/2273486774 conn(0x7f51280cea70 msgr2=0x7f5128157a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:13.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.058+0000 7f512f7fa640 1 -- 172.21.15.55:0/2273486774 shutdown_connections 2023-07-06T22:00:13.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.058+0000 7f512f7fa640 1 -- 172.21.15.55:0/2273486774 wait complete. 2023-07-06T22:00:13.075 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-06T22:00:13.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95f287b640 1 Processor -- start 2023-07-06T22:00:13.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95f287b640 1 -- start start 2023-07-06T22:00:13.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95f287b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f95ec0709a0 0x7f95ec0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:13.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95f287b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ec0cc300 con 0x7f95ec0cbe60 2023-07-06T22:00:13.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95f287b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ec0cc5e0 con 0x7f95ec0b1340 2023-07-06T22:00:13.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95f287b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ec0cc8c0 con 0x7f95ec0709a0 2023-07-06T22:00:13.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f95ec0cbe60 0x7f95ec0b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46148/0 (socket says 172.21.15.55:46148) 2023-07-06T22:00:13.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eb7fe640 1 -- 172.21.15.55:0/3693458603 learned_addr learned my addr 172.21.15.55:0/3693458603 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:13.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95ebfff640 1 --2- 172.21.15.55:0/3693458603 >> v2:172.21.15.138:3300/0 conn(0x7f95ec0709a0 0x7f95ec0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:13.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 -- 172.21.15.55:0/3693458603 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123699623 0 0) 0x7f95ec0cc300 con 0x7f95ec0cbe60 2023-07-06T22:00:13.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 -- 172.21.15.55:0/3693458603 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95d4003530 con 0x7f95ec0cbe60 2023-07-06T22:00:13.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 -- 172.21.15.55:0/3693458603 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1449927872 0 0) 0x7f95d4003530 con 0x7f95ec0cbe60 2023-07-06T22:00:13.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 -- 172.21.15.55:0/3693458603 >> v2:172.21.15.138:3300/0 conn(0x7f95ec0709a0 msgr2=0x7f95ec0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:13.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 --2- 172.21.15.55:0/3693458603 >> v2:172.21.15.138:3300/0 conn(0x7f95ec0709a0 0x7f95ec0cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 -- 172.21.15.55:0/3693458603 >> v1:172.21.15.138:6789/0 conn(0x7f95ec0b1340 legacy=0x7f95ec06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:13.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 -- 172.21.15.55:0/3693458603 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec0ccba0 con 0x7f95ec0cbe60 2023-07-06T22:00:13.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 -- 172.21.15.55:0/3693458603 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f95e0001680 con 0x7f95ec0cbe60 2023-07-06T22:00:13.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 -- 172.21.15.55:0/3693458603 >> v1:172.21.15.55:6789/0 conn(0x7f95ec0cbe60 legacy=0x7f95ec0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:13.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 --2- 172.21.15.55:0/3693458603 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d4003980 0x7f95d4003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:13.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 --2- 172.21.15.55:0/3693458603 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95d40047d0 0x7f95d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:13.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 --2- 172.21.15.55:0/3693458603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95d4005180 0x7f95d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:13.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 -- 172.21.15.55:0/3693458603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0cc8c0 con 0x7f95d4005180 2023-07-06T22:00:13.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 -- 172.21.15.55:0/3693458603 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d400bfe0 con 0x7f95d4003980 2023-07-06T22:00:13.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eaffd640 1 -- 172.21.15.55:0/3693458603 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d400c1a0 con 0x7f95d40047d0 2023-07-06T22:00:13.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95f0e18640 1 --2- 172.21.15.55:0/3693458603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95d4005180 0x7f95d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:13.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eb7fe640 1 --2- 172.21.15.55:0/3693458603 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95d40047d0 0x7f95d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:13.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95ebfff640 1 --2- 172.21.15.55:0/3693458603 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d4003980 0x7f95d4003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:13.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95f0e18640 1 -- 172.21.15.55:0/3693458603 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95d40047d0 msgr2=0x7f95d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:13.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95f0e18640 1 --2- 172.21.15.55:0/3693458603 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95d40047d0 0x7f95d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95f0e18640 1 -- 172.21.15.55:0/3693458603 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d4003980 msgr2=0x7f95d4003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:13.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95f0e18640 1 --2- 172.21.15.55:0/3693458603 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d4003980 0x7f95d4003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95f0e18640 1 -- 172.21.15.55:0/3693458603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d4003530 con 0x7f95d4005180 2023-07-06T22:00:13.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95eb7fe640 1 --2- 172.21.15.55:0/3693458603 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95d40047d0 0x7f95d4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:13.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.222+0000 7f95ebfff640 1 --2- 172.21.15.55:0/3693458603 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d4003980 0x7f95d4003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:13.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.226+0000 7f95f0e18640 1 -- 172.21.15.55:0/3693458603 reap_dead start 2023-07-06T22:00:13.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.226+0000 7f95f0e18640 1 --2- 172.21.15.55:0/3693458603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95d4005180 0x7f95d400b990 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0b1730 tx=0x7f95e401c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b623a182e23ccc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:13.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.226+0000 7f95eaffd640 1 -- 172.21.15.55:0/3693458603 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40a9660 con 0x7f95d4005180 2023-07-06T22:00:13.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.226+0000 7f95eaffd640 1 -- 172.21.15.55:0/3693458603 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e40a97e0 con 0x7f95d4005180 2023-07-06T22:00:13.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.226+0000 7f95eaffd640 1 -- 172.21.15.55:0/3693458603 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40a9b90 con 0x7f95d4005180 2023-07-06T22:00:13.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.226+0000 7f95f287b640 1 -- 172.21.15.55:0/3693458603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95d4005180 msgr2=0x7f95d400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:13.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.226+0000 7f95f287b640 1 --2- 172.21.15.55:0/3693458603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95d4005180 0x7f95d400b990 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0b1730 tx=0x7f95e401c660 comp rx=0 tx=0).stop 2023-07-06T22:00:13.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.226+0000 7f95f287b640 1 -- 172.21.15.55:0/3693458603 shutdown_connections 2023-07-06T22:00:13.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.226+0000 7f95f287b640 1 --2- 172.21.15.55:0/3693458603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95d4005180 0x7f95d400b990 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.226+0000 7f95f287b640 1 -- 172.21.15.55:0/3693458603 >> 172.21.15.55:0/3693458603 conn(0x7f95ec0cea70 msgr2=0x7f95ec0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:13.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.226+0000 7f95f287b640 1 -- 172.21.15.55:0/3693458603 shutdown_connections 2023-07-06T22:00:13.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.226+0000 7f95f287b640 1 -- 172.21.15.55:0/3693458603 wait complete. 2023-07-06T22:00:13.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f287b640 1 Processor -- start 2023-07-06T22:00:13.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f287b640 1 -- start start 2023-07-06T22:00:13.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f287b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95d4005180 0x7f95ec0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:13.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f287b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95ec15b210 0x7f95ec153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:13.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f287b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95ec06eee0 0x7f95ec06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:13.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f287b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0c34a0 con 0x7f95ec06eee0 2023-07-06T22:00:13.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f287b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0c38c0 con 0x7f95ec15b210 2023-07-06T22:00:13.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f287b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0c48b0 con 0x7f95d4005180 2023-07-06T22:00:13.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f0e18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95ec06eee0 0x7f95ec06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:13.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f0e18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95ec06eee0 0x7f95ec06f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58278/0 (socket says 172.21.15.55:58278) 2023-07-06T22:00:13.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f0e18640 1 -- 172.21.15.55:0/906611286 learned_addr learned my addr 172.21.15.55:0/906611286 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:13.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f0e18640 1 -- 172.21.15.55:0/906611286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95d4005180 msgr2=0x7f95ec0c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:13.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f0e18640 1 --2- 172.21.15.55:0/906611286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95d4005180 0x7f95ec0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f0e18640 1 -- 172.21.15.55:0/906611286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95ec15b210 msgr2=0x7f95ec153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:13.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f0e18640 1 --2- 172.21.15.55:0/906611286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95ec15b210 0x7f95ec153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f0e18640 1 -- 172.21.15.55:0/906611286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec0c28b0 con 0x7f95ec06eee0 2023-07-06T22:00:13.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f0e18640 1 --2- 172.21.15.55:0/906611286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95ec06eee0 0x7f95ec06f350 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f95e401c490 tx=0x7f95d4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:13.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95e8ff9640 1 -- 172.21.15.55:0/906611286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40a9d60 con 0x7f95ec06eee0 2023-07-06T22:00:13.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95e8ff9640 1 -- 172.21.15.55:0/906611286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e40b2480 con 0x7f95ec06eee0 2023-07-06T22:00:13.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f287b640 1 -- 172.21.15.55:0/906611286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ec154190 con 0x7f95ec06eee0 2023-07-06T22:00:13.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95e8ff9640 1 -- 172.21.15.55:0/906611286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40b2810 con 0x7f95ec06eee0 2023-07-06T22:00:13.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.230+0000 7f95f287b640 1 -- 172.21.15.55:0/906611286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ec0c2de0 con 0x7f95ec06eee0 2023-07-06T22:00:13.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.234+0000 7f95f287b640 1 -- 172.21.15.55:0/906611286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ec0c35e0 con 0x7f95ec06eee0 2023-07-06T22:00:13.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.234+0000 7f95e8ff9640 1 -- 172.21.15.55:0/906611286 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f95e40b2970 con 0x7f95ec06eee0 2023-07-06T22:00:13.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.234+0000 7f95e8ff9640 1 --2- 172.21.15.55:0/906611286 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f95d80663a0 0x7f95d8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:13.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.234+0000 7f95e8ff9640 1 -- 172.21.15.55:0/906611286 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6390+0+0 (secure 0 0 0) 0x7f95e411e980 con 0x7f95ec06eee0 2023-07-06T22:00:13.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.234+0000 7f95ebfff640 1 --2- 172.21.15.55:0/906611286 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f95d80663a0 0x7f95d8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:13.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.234+0000 7f95ebfff640 1 --2- 172.21.15.55:0/906611286 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f95d80663a0 0x7f95d8068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009960 tx=0x7f95dc008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:13.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.238+0000 7f95e8ff9640 1 -- 172.21.15.55:0/906611286 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95ec0c35e0 con 0x7f95ec06eee0 2023-07-06T22:00:13.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.390+0000 7f95f287b640 1 -- 172.21.15.55:0/906611286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f95ec0c35e0 con 0x7f95ec06eee0 2023-07-06T22:00:13.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.398+0000 7f95e8ff9640 1 -- 172.21.15.55:0/906611286 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f95ec0c35e0 con 0x7f95ec06eee0 2023-07-06T22:00:13.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.398+0000 7f95f287b640 1 -- 172.21.15.55:0/906611286 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f95d80663a0 msgr2=0x7f95d8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.398+0000 7f95f287b640 1 --2- 172.21.15.55:0/906611286 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f95d80663a0 0x7f95d8068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009960 tx=0x7f95dc008040 comp rx=0 tx=0).stop 2023-07-06T22:00:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.398+0000 7f95f287b640 1 -- 172.21.15.55:0/906611286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95ec06eee0 msgr2=0x7f95ec06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.398+0000 7f95f287b640 1 --2- 172.21.15.55:0/906611286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95ec06eee0 0x7f95ec06f350 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f95e401c490 tx=0x7f95d4005800 comp rx=0 tx=0).stop 2023-07-06T22:00:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.398+0000 7f95f287b640 1 -- 172.21.15.55:0/906611286 shutdown_connections 2023-07-06T22:00:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.398+0000 7f95f287b640 1 --2- 172.21.15.55:0/906611286 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f95d80663a0 0x7f95d8068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.398+0000 7f95f287b640 1 --2- 172.21.15.55:0/906611286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95ec06eee0 0x7f95ec06f350 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.398+0000 7f95f287b640 1 --2- 172.21.15.55:0/906611286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95ec15b210 0x7f95ec153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.398+0000 7f95f287b640 1 --2- 172.21.15.55:0/906611286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f95d4005180 0x7f95ec0c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.398+0000 7f95f287b640 1 -- 172.21.15.55:0/906611286 >> 172.21.15.55:0/906611286 conn(0x7f95ec0cea70 msgr2=0x7f95ec0c9830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:13.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.398+0000 7f95f287b640 1 -- 172.21.15.55:0/906611286 shutdown_connections 2023-07-06T22:00:13.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.398+0000 7f95f287b640 1 -- 172.21.15.55:0/906611286 wait complete. 2023-07-06T22:00:13.417 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T22:00:13.418 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:00:13.510 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:00:13.566 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T22:00:13.567 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:00:13.567 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:00:13.576 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:00:13.576 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:00:13.576 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:00:13.585 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:00:13.586 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:00:13.586 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:00:13.627 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:00:13.628 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:00:13.628 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:00:13.637 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:00:13.637 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-06T22:00:13.638 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:00:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b8d74640 1 Processor -- start 2023-07-06T22:00:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b8d74640 1 -- start start 2023-07-06T22:00:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b8d74640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc6b40b7cd0 0x7fc6b40ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b8d74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6b40b1fe0 0x7fc6b415f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b8d74640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b40cecf0 con 0x7fc6b40ccab0 2023-07-06T22:00:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b8d74640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b40d2310 con 0x7fc6b40b7cd0 2023-07-06T22:00:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b8d74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40b80a0 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b1d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc6b40ccab0 0x7fc6b40b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44534/0 (socket says 172.21.15.55:44534) 2023-07-06T22:00:13.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b1d9b640 1 -- 172.21.15.55:0/2952324601 learned_addr learned my addr 172.21.15.55:0/2952324601 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:13.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b259c640 1 --2- 172.21.15.55:0/2952324601 >> v2:172.21.15.138:3300/0 conn(0x7fc6b40b7cd0 0x7fc6b40ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:13.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b2d9d640 1 --2- 172.21.15.55:0/2952324601 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6b40b1fe0 0x7fc6b415f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:13.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b159a640 1 -- 172.21.15.55:0/2952324601 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138563315 0 0) 0x7fc6b40cecf0 con 0x7fc6b40ccab0 2023-07-06T22:00:13.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b159a640 1 -- 172.21.15.55:0/2952324601 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc69c003530 con 0x7fc6b40ccab0 2023-07-06T22:00:13.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b2d9d640 1 -- 172.21.15.55:0/2952324601 >> v2:172.21.15.138:3300/0 conn(0x7fc6b40b7cd0 msgr2=0x7fc6b40ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:13.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b2d9d640 1 --2- 172.21.15.55:0/2952324601 >> v2:172.21.15.138:3300/0 conn(0x7fc6b40b7cd0 0x7fc6b40ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b2d9d640 1 -- 172.21.15.55:0/2952324601 >> v1:172.21.15.55:6789/0 conn(0x7fc6b40ccab0 legacy=0x7fc6b40b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b159a640 1 -- 172.21.15.55:0/2952324601 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2771142529 0 0) 0x7fc69c003530 con 0x7fc6b40ccab0 2023-07-06T22:00:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b2d9d640 1 -- 172.21.15.55:0/2952324601 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b40d1d90 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.818+0000 7fc6b259c640 1 --2- 172.21.15.55:0/2952324601 >> v2:172.21.15.138:3300/0 conn(0x7fc6b40b7cd0 0x7fc6b40ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:00:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.822+0000 7fc6b2d9d640 1 --2- 172.21.15.55:0/2952324601 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6b40b1fe0 0x7fc6b415f870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009d90 tx=0x7fc6ac01c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc7dccb01c1eef2e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.822+0000 7fc6b159a640 1 -- 172.21.15.55:0/2952324601 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8001680 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.822+0000 7fc6b159a640 1 -- 172.21.15.55:0/2952324601 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ac0a8450 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.822+0000 7fc6b159a640 1 -- 172.21.15.55:0/2952324601 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0a87e0 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.822+0000 7fc6b8d74640 1 -- 172.21.15.55:0/2952324601 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6b40b1fe0 msgr2=0x7fc6b415f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:13.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.822+0000 7fc6b8d74640 1 --2- 172.21.15.55:0/2952324601 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6b40b1fe0 0x7fc6b415f870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009d90 tx=0x7fc6ac01c7e0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.822+0000 7fc6b8d74640 1 -- 172.21.15.55:0/2952324601 shutdown_connections 2023-07-06T22:00:13.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.822+0000 7fc6b8d74640 1 --2- 172.21.15.55:0/2952324601 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6b40b1fe0 0x7fc6b415f870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.822+0000 7fc6b8d74640 1 --2- 172.21.15.55:0/2952324601 >> v2:172.21.15.138:3300/0 conn(0x7fc6b40b7cd0 0x7fc6b40ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.822+0000 7fc6b8d74640 1 -- 172.21.15.55:0/2952324601 >> 172.21.15.55:0/2952324601 conn(0x7fc6b40ceee0 msgr2=0x7fc6b40cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.822+0000 7fc6b8d74640 1 -- 172.21.15.55:0/2952324601 shutdown_connections 2023-07-06T22:00:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b8d74640 1 -- 172.21.15.55:0/2952324601 wait complete. 2023-07-06T22:00:13.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b8d74640 1 Processor -- start 2023-07-06T22:00:13.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b8d74640 1 -- start start 2023-07-06T22:00:13.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b8d74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6b40b1fe0 0x7fc6b414c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:13.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b8d74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6b40b7cd0 0x7fc6b414ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:13.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b8d74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6b40ccab0 0x7fc6b4069d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:13.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b8d74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b414c750 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b8d74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4153f80 con 0x7fc6b40ccab0 2023-07-06T22:00:13.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b8d74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4154260 con 0x7fc6b40b7cd0 2023-07-06T22:00:13.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6b40b1fe0 0x7fc6b414c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:13.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6b40b1fe0 0x7fc6b414c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58294/0 (socket says 172.21.15.55:58294) 2023-07-06T22:00:13.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b259c640 1 -- 172.21.15.55:0/1628469406 learned_addr learned my addr 172.21.15.55:0/1628469406 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:13.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b259c640 1 -- 172.21.15.55:0/1628469406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6b40b7cd0 msgr2=0x7fc6b414ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:13.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b259c640 1 --2- 172.21.15.55:0/1628469406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6b40b7cd0 0x7fc6b414ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b259c640 1 -- 172.21.15.55:0/1628469406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6b40ccab0 msgr2=0x7fc6b4069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:13.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b259c640 1 --2- 172.21.15.55:0/1628469406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6b40ccab0 0x7fc6b4069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b259c640 1 -- 172.21.15.55:0/1628469406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a4009420 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b259c640 1 --2- 172.21.15.55:0/1628469406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6b40b1fe0 0x7fc6b414c210 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400e980 tx=0x7fc6a400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6a2ffd640 1 -- 172.21.15.55:0/1628469406 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a400ca00 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6a2ffd640 1 -- 172.21.15.55:0/1628469406 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a400cb60 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6a2ffd640 1 -- 172.21.15.55:0/1628469406 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4013470 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.826+0000 7fc6b8d74640 1 -- 172.21.15.55:0/1628469406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac009a70 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.830+0000 7fc6b8d74640 1 -- 172.21.15.55:0/1628469406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b4154820 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.830+0000 7fc6b8d74640 1 -- 172.21.15.55:0/1628469406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b4066d60 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.830+0000 7fc6a2ffd640 1 -- 172.21.15.55:0/1628469406 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc6a40135d0 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.830+0000 7fc6a2ffd640 1 --2- 172.21.15.55:0/1628469406 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fc6940663a0 0x7fc694068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:13.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.830+0000 7fc6a2ffd640 1 -- 172.21.15.55:0/1628469406 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6390+0+0 (secure 0 0 0) 0x7fc6a40842e0 con 0x7fc6b40b1fe0 2023-07-06T22:00:13.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.830+0000 7fc6b1d9b640 1 --2- 172.21.15.55:0/1628469406 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fc6940663a0 0x7fc694068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:13.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.830+0000 7fc6b1d9b640 1 --2- 172.21.15.55:0/1628469406 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fc6940663a0 0x7fc694068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8001ec0 tx=0x7fc6a8001a30 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:13.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:13.834+0000 7fc6a2ffd640 1 -- 172.21.15.55:0/1628469406 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6a4051460 con 0x7fc6b40b1fe0 2023-07-06T22:00:14.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.022+0000 7fc6b8d74640 1 -- 172.21.15.55:0/1628469406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6b40653a0 con 0x7fc6b40b1fe0 2023-07-06T22:00:14.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.022+0000 7fc6a2ffd640 1 -- 172.21.15.55:0/1628469406 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fc6a4017de0 con 0x7fc6b40b1fe0 2023-07-06T22:00:14.024 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:14.024 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6839,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4122510097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4122510097},{"type":"v1","addr":"172.21.15.138:6835","nonce":4122510097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7981,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/1957213322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1957213322},{"type":"v1","addr":"172.21.15.138:6833","nonce":1957213322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":8034,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/154452928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":154452928},{"type":"v1","addr":"172.21.15.55:6836","nonce":154452928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8037,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/414200688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":414200688},{"type":"v1","addr":"172.21.15.55:6837","nonce":414200688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[]} 2023-07-06T22:00:14.024 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 49 2023-07-06T22:00:14.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.026+0000 7fc6b8d74640 1 -- 172.21.15.55:0/1628469406 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fc6940663a0 msgr2=0x7fc694068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:14.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.026+0000 7fc6b8d74640 1 --2- 172.21.15.55:0/1628469406 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fc6940663a0 0x7fc694068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8001ec0 tx=0x7fc6a8001a30 comp rx=0 tx=0).stop 2023-07-06T22:00:14.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.026+0000 7fc6b8d74640 1 -- 172.21.15.55:0/1628469406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6b40b1fe0 msgr2=0x7fc6b414c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:14.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.026+0000 7fc6b8d74640 1 --2- 172.21.15.55:0/1628469406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6b40b1fe0 0x7fc6b414c210 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400e980 tx=0x7fc6a400ee40 comp rx=0 tx=0).stop 2023-07-06T22:00:14.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.026+0000 7fc6b8d74640 1 -- 172.21.15.55:0/1628469406 shutdown_connections 2023-07-06T22:00:14.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.026+0000 7fc6b8d74640 1 --2- 172.21.15.55:0/1628469406 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fc6940663a0 0x7fc694068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:14.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.026+0000 7fc6b8d74640 1 --2- 172.21.15.55:0/1628469406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6b40ccab0 0x7fc6b4069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:14.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.026+0000 7fc6b8d74640 1 --2- 172.21.15.55:0/1628469406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6b40b7cd0 0x7fc6b414ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:14.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.026+0000 7fc6b8d74640 1 --2- 172.21.15.55:0/1628469406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6b40b1fe0 0x7fc6b414c210 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:14.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.026+0000 7fc6b8d74640 1 -- 172.21.15.55:0/1628469406 >> 172.21.15.55:0/1628469406 conn(0x7fc6b40ceee0 msgr2=0x7fc6b40cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:14.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.026+0000 7fc6b8d74640 1 -- 172.21.15.55:0/1628469406 shutdown_connections 2023-07-06T22:00:14.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.026+0000 7fc6b8d74640 1 -- 172.21.15.55:0/1628469406 wait complete. 2023-07-06T22:00:14.044 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T22:00:14.045 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-06T22:00:14.045 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T22:00:14.045 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:00:14.045 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T22:00:14.046 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-06T22:00:14.046 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T22:00:14.046 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:00:14.046 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T22:00:14.047 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-06T22:00:14.047 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T22:00:14.047 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:00:14.047 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T22:00:14.048 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-06T22:00:14.048 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T22:00:14.048 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:00:14.058 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T22:00:14.058 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T22:00:14.059 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T22:00:14.059 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T22:00:14.061 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T22:00:14.061 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T22:00:14.062 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T22:00:14.063 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T22:00:14.106 INFO:tasks.ceph.mds.a:Started 2023-07-06T22:00:14.107 DEBUG:teuthology.parallel:result is None 2023-07-06T22:00:14.108 INFO:tasks.ceph.mds.c:Started 2023-07-06T22:00:14.109 DEBUG:teuthology.parallel:result is None 2023-07-06T22:00:14.110 INFO:tasks.ceph.mds.b:Started 2023-07-06T22:00:14.110 DEBUG:teuthology.parallel:result is None 2023-07-06T22:00:14.112 INFO:tasks.ceph.mds.d:Started 2023-07-06T22:00:14.113 DEBUG:teuthology.parallel:result is None 2023-07-06T22:00:14.113 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-06T22:00:14.195 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-07-06T22:00:14.196 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T22:00:14.203 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-07-06T22:00:14.203 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-07-06T22:00:14.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.274+0000 7fab69311640 1 Processor -- start 2023-07-06T22:00:14.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.274+0000 7fab69311640 1 -- start start 2023-07-06T22:00:14.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.274+0000 7fab69311640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab64156180 0x7fab640ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:14.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.274+0000 7fab69311640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fab640cbeb0 0x7fab6406ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:14.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab69311640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6406f360 con 0x7fab6406e9d0 2023-07-06T22:00:14.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab69311640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab64160250 con 0x7fab640cbeb0 2023-07-06T22:00:14.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab69311640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab640cc310 con 0x7fab64156180 2023-07-06T22:00:14.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab5bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fab6406e9d0 0x7fab640cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44552/0 (socket says 172.21.15.55:44552) 2023-07-06T22:00:14.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab5bfff640 1 -- 172.21.15.55:0/2597624583 learned_addr learned my addr 172.21.15.55:0/2597624583 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab62ffd640 1 --2- 172.21.15.55:0/2597624583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab64156180 0x7fab640ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 -- 172.21.15.55:0/2597624583 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784687201 0 0) 0x7fab4c001120 con 0x7fab6406e9d0 2023-07-06T22:00:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 -- 172.21.15.55:0/2597624583 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab50003530 con 0x7fab6406e9d0 2023-07-06T22:00:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 -- 172.21.15.55:0/2597624583 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2180278874 0 0) 0x7fab50003530 con 0x7fab6406e9d0 2023-07-06T22:00:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 -- 172.21.15.55:0/2597624583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab64156180 msgr2=0x7fab640ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 --2- 172.21.15.55:0/2597624583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab64156180 0x7fab640ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 -- 172.21.15.55:0/2597624583 >> v2:172.21.15.138:3300/0 conn(0x7fab640cbeb0 msgr2=0x7fab6406ee20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T22:00:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 --2- 172.21.15.55:0/2597624583 >> v2:172.21.15.138:3300/0 conn(0x7fab640cbeb0 0x7fab6406ee20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 -- 172.21.15.55:0/2597624583 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6415f5d0 con 0x7fab6406e9d0 2023-07-06T22:00:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 -- 172.21.15.55:0/2597624583 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fab4c001810 con 0x7fab6406e9d0 2023-07-06T22:00:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 -- 172.21.15.55:0/2597624583 >> v1:172.21.15.55:6789/0 conn(0x7fab6406e9d0 legacy=0x7fab640cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 --2- 172.21.15.55:0/2597624583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab50003980 0x7fab50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 --2- 172.21.15.55:0/2597624583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab500043b0 0x7fab50004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 --2- 172.21.15.55:0/2597624583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab64156180 0x7fab50005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 -- 172.21.15.55:0/2597624583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab64160250 con 0x7fab50003980 2023-07-06T22:00:14.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 -- 172.21.15.55:0/2597624583 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab640cc310 con 0x7fab500043b0 2023-07-06T22:00:14.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab627fc640 1 -- 172.21.15.55:0/2597624583 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5000baf0 con 0x7fab64156180 2023-07-06T22:00:14.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab62ffd640 1 --2- 172.21.15.55:0/2597624583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab50003980 0x7fab50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:14.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab62ffd640 1 -- 172.21.15.55:0/2597624583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab64156180 msgr2=0x7fab50005170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T22:00:14.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab62ffd640 1 --2- 172.21.15.55:0/2597624583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab64156180 0x7fab50005170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:14.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab62ffd640 1 -- 172.21.15.55:0/2597624583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab500043b0 msgr2=0x7fab50004870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T22:00:14.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab62ffd640 1 --2- 172.21.15.55:0/2597624583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab500043b0 0x7fab50004870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:14.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.278+0000 7fab62ffd640 1 -- 172.21.15.55:0/2597624583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab50003530 con 0x7fab50003980 2023-07-06T22:00:14.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.282+0000 7fab62ffd640 1 --2- 172.21.15.55:0/2597624583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab50003980 0x7fab50003d90 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fab54009ab0 tx=0x7fab5401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ea0739955b3d93 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:14.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.282+0000 7fab627fc640 1 -- 172.21.15.55:0/2597624583 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540a64f0 con 0x7fab50003980 2023-07-06T22:00:14.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.282+0000 7fab627fc640 1 -- 172.21.15.55:0/2597624583 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab540a6650 con 0x7fab50003980 2023-07-06T22:00:14.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.282+0000 7fab627fc640 1 -- 172.21.15.55:0/2597624583 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540a6a00 con 0x7fab50003980 2023-07-06T22:00:14.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.282+0000 7fab69311640 1 -- 172.21.15.55:0/2597624583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab50003980 msgr2=0x7fab50003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:14.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.282+0000 7fab69311640 1 --2- 172.21.15.55:0/2597624583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab50003980 0x7fab50003d90 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fab54009ab0 tx=0x7fab5401ca00 comp rx=0 tx=0).stop 2023-07-06T22:00:14.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.282+0000 7fab637fe640 1 -- 172.21.15.55:0/2597624583 reap_dead start 2023-07-06T22:00:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.282+0000 7fab69311640 1 -- 172.21.15.55:0/2597624583 shutdown_connections 2023-07-06T22:00:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.282+0000 7fab69311640 1 -- 172.21.15.55:0/2597624583 >> 172.21.15.55:0/2597624583 conn(0x7fab640d0c50 msgr2=0x7fab640cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.282+0000 7fab69311640 1 -- 172.21.15.55:0/2597624583 shutdown_connections 2023-07-06T22:00:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.282+0000 7fab69311640 1 -- 172.21.15.55:0/2597624583 wait complete. 2023-07-06T22:00:14.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.282+0000 7fab69311640 1 Processor -- start 2023-07-06T22:00:14.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.282+0000 7fab69311640 1 -- start start 2023-07-06T22:00:14.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab69311640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab50003980 0x7fab64153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:14.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab69311640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64154cc0 0x7fab641e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:14.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab69311640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab640c76d0 0x7fab641f78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:14.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab69311640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab641540f0 con 0x7fab64154cc0 2023-07-06T22:00:14.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab69311640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab64155150 con 0x7fab50003980 2023-07-06T22:00:14.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab69311640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab64155430 con 0x7fab640c76d0 2023-07-06T22:00:14.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab5bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64154cc0 0x7fab641e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:14.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab5bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64154cc0 0x7fab641e85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58338/0 (socket says 172.21.15.55:58338) 2023-07-06T22:00:14.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab5bfff640 1 -- 172.21.15.55:0/4154546039 learned_addr learned my addr 172.21.15.55:0/4154546039 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:14.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab5bfff640 1 -- 172.21.15.55:0/4154546039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab640c76d0 msgr2=0x7fab641f78f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T22:00:14.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab5bfff640 1 --2- 172.21.15.55:0/4154546039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab640c76d0 0x7fab641f78f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab5bfff640 1 -- 172.21.15.55:0/4154546039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab50003980 msgr2=0x7fab64153bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T22:00:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab5bfff640 1 --2- 172.21.15.55:0/4154546039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab50003980 0x7fab64153bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab5bfff640 1 -- 172.21.15.55:0/4154546039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab640c4be0 con 0x7fab64154cc0 2023-07-06T22:00:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab5bfff640 1 --2- 172.21.15.55:0/4154546039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64154cc0 0x7fab641e85c0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c720 tx=0x7fab4c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab5b7fe640 1 -- 172.21.15.55:0/4154546039 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0074e0 con 0x7fab64154cc0 2023-07-06T22:00:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab5b7fe640 1 -- 172.21.15.55:0/4154546039 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c007640 con 0x7fab64154cc0 2023-07-06T22:00:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab5b7fe640 1 -- 172.21.15.55:0/4154546039 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c004a10 con 0x7fab64154cc0 2023-07-06T22:00:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab69311640 1 -- 172.21.15.55:0/4154546039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab640c4ec0 con 0x7fab64154cc0 2023-07-06T22:00:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab69311640 1 -- 172.21.15.55:0/4154546039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab641e8b00 con 0x7fab64154cc0 2023-07-06T22:00:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab69311640 1 -- 172.21.15.55:0/4154546039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab64066d60 con 0x7fab64154cc0 2023-07-06T22:00:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.286+0000 7fab5b7fe640 1 -- 172.21.15.55:0/4154546039 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fab4c004b70 con 0x7fab64154cc0 2023-07-06T22:00:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.290+0000 7fab5b7fe640 1 --2- 172.21.15.55:0/4154546039 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fab440663a0 0x7fab44068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.290+0000 7fab5b7fe640 1 -- 172.21.15.55:0/4154546039 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6390+0+0 (secure 0 0 0) 0x7fab4c083410 con 0x7fab64154cc0 2023-07-06T22:00:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.290+0000 7fab62ffd640 1 --2- 172.21.15.55:0/4154546039 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fab440663a0 0x7fab44068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.290+0000 7fab62ffd640 1 --2- 172.21.15.55:0/4154546039 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fab440663a0 0x7fab44068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fab540af000 tx=0x7fab540046d0 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:14.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.294+0000 7fab5b7fe640 1 -- 172.21.15.55:0/4154546039 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab4c054020 con 0x7fab64154cc0 2023-07-06T22:00:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:14.458+0000 7fab69311640 1 -- 172.21.15.55:0/4154546039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fab6406f360 con 0x7fab64154cc0 2023-07-06T22:00:15.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.254+0000 7fab5b7fe640 1 -- 172.21.15.55:0/4154546039 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v127) v1 ==== 97+0+0 (secure 0 0 0) 0x7fab6406f360 con 0x7fab64154cc0 2023-07-06T22:00:15.253 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-07-06T22:00:15.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.254+0000 7fab69311640 1 -- 172.21.15.55:0/4154546039 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fab440663a0 msgr2=0x7fab44068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:15.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.254+0000 7fab69311640 1 --2- 172.21.15.55:0/4154546039 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fab440663a0 0x7fab44068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fab540af000 tx=0x7fab540046d0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.254+0000 7fab69311640 1 -- 172.21.15.55:0/4154546039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64154cc0 msgr2=0x7fab641e85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:15.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.254+0000 7fab69311640 1 --2- 172.21.15.55:0/4154546039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64154cc0 0x7fab641e85c0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c720 tx=0x7fab4c00cbe0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.254+0000 7fab69311640 1 -- 172.21.15.55:0/4154546039 shutdown_connections 2023-07-06T22:00:15.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.254+0000 7fab69311640 1 --2- 172.21.15.55:0/4154546039 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fab440663a0 0x7fab44068850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.254+0000 7fab69311640 1 --2- 172.21.15.55:0/4154546039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab640c76d0 0x7fab641f78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.254+0000 7fab69311640 1 --2- 172.21.15.55:0/4154546039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64154cc0 0x7fab641e85c0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.254+0000 7fab69311640 1 --2- 172.21.15.55:0/4154546039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab50003980 0x7fab64153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.254+0000 7fab69311640 1 -- 172.21.15.55:0/4154546039 >> 172.21.15.55:0/4154546039 conn(0x7fab640d0c50 msgr2=0x7fab640b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:15.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.258+0000 7fab69311640 1 -- 172.21.15.55:0/4154546039 shutdown_connections 2023-07-06T22:00:15.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.258+0000 7fab69311640 1 -- 172.21.15.55:0/4154546039 wait complete. 2023-07-06T22:00:15.280 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-06T22:00:15.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.426+0000 7fea7546d640 1 Processor -- start 2023-07-06T22:00:15.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.426+0000 7fea7546d640 1 -- start start 2023-07-06T22:00:15.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea7546d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea7006d670 0x7fea700d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:15.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea7546d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea700ce9e0 con 0x7fea700cf940 2023-07-06T22:00:15.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea7546d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea70159eb0 con 0x7fea700b58e0 2023-07-06T22:00:15.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea7546d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea700d0960 con 0x7fea7006d670 2023-07-06T22:00:15.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6effd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fea700cf940 0x7fea700cfd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44556/0 (socket says 172.21.15.55:44556) 2023-07-06T22:00:15.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6effd640 1 -- 172.21.15.55:0/1728578290 learned_addr learned my addr 172.21.15.55:0/1728578290 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:15.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 -- 172.21.15.55:0/1728578290 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180197250 0 0) 0x7fea700ce9e0 con 0x7fea700cf940 2023-07-06T22:00:15.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 -- 172.21.15.55:0/1728578290 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea5c003530 con 0x7fea700cf940 2023-07-06T22:00:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 -- 172.21.15.55:0/1728578290 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1267252693 0 0) 0x7fea5c003530 con 0x7fea700cf940 2023-07-06T22:00:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 -- 172.21.15.55:0/1728578290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea7006d670 msgr2=0x7fea700d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 --2- 172.21.15.55:0/1728578290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea7006d670 0x7fea700d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 -- 172.21.15.55:0/1728578290 >> v1:172.21.15.138:6789/0 conn(0x7fea700b58e0 legacy=0x7fea700cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 -- 172.21.15.55:0/1728578290 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea700cddd0 con 0x7fea700cf940 2023-07-06T22:00:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 -- 172.21.15.55:0/1728578290 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fea60001680 con 0x7fea700cf940 2023-07-06T22:00:15.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 -- 172.21.15.55:0/1728578290 >> v1:172.21.15.55:6789/0 conn(0x7fea700cf940 legacy=0x7fea700cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:15.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 --2- 172.21.15.55:0/1728578290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea7006d670 0x7fea5c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:15.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 --2- 172.21.15.55:0/1728578290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5c0040c0 0x7fea5c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:15.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 --2- 172.21.15.55:0/1728578290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c004d80 0x7fea5c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:15.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 -- 172.21.15.55:0/1728578290 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea700d0960 con 0x7fea5c0040c0 2023-07-06T22:00:15.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 -- 172.21.15.55:0/1728578290 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c00bc90 con 0x7fea5c004d80 2023-07-06T22:00:15.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6e7fc640 1 -- 172.21.15.55:0/1728578290 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c00be50 con 0x7fea7006d670 2023-07-06T22:00:15.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea67fff640 1 --2- 172.21.15.55:0/1728578290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5c0040c0 0x7fea5c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:15.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6f7fe640 1 --2- 172.21.15.55:0/1728578290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c004d80 0x7fea5c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:15.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea67fff640 1 -- 172.21.15.55:0/1728578290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea7006d670 msgr2=0x7fea5c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:15.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea67fff640 1 --2- 172.21.15.55:0/1728578290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea7006d670 0x7fea5c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea67fff640 1 -- 172.21.15.55:0/1728578290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c004d80 msgr2=0x7fea5c0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:15.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea67fff640 1 --2- 172.21.15.55:0/1728578290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c004d80 0x7fea5c0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea67fff640 1 -- 172.21.15.55:0/1728578290 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c003530 con 0x7fea5c0040c0 2023-07-06T22:00:15.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.430+0000 7fea6f7fe640 1 --2- 172.21.15.55:0/1728578290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea5c004d80 0x7fea5c0051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:15.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.434+0000 7fea67fff640 1 --2- 172.21.15.55:0/1728578290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5c0040c0 0x7fea5c0047d0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fea58009890 tx=0x7fea5801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a74c907e8dd0f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:15.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.434+0000 7fea6e7fc640 1 -- 172.21.15.55:0/1728578290 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea580ab600 con 0x7fea5c0040c0 2023-07-06T22:00:15.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.434+0000 7fea6e7fc640 1 -- 172.21.15.55:0/1728578290 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea580a7050 con 0x7fea5c0040c0 2023-07-06T22:00:15.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.434+0000 7fea6e7fc640 1 -- 172.21.15.55:0/1728578290 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea580ab9c0 con 0x7fea5c0040c0 2023-07-06T22:00:15.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.434+0000 7fea7546d640 1 -- 172.21.15.55:0/1728578290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5c0040c0 msgr2=0x7fea5c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:15.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.434+0000 7fea7546d640 1 --2- 172.21.15.55:0/1728578290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5c0040c0 0x7fea5c0047d0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fea58009890 tx=0x7fea5801c370 comp rx=0 tx=0).stop 2023-07-06T22:00:15.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.434+0000 7fea6f7fe640 1 -- 172.21.15.55:0/1728578290 reap_dead start 2023-07-06T22:00:15.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.434+0000 7fea7546d640 1 -- 172.21.15.55:0/1728578290 shutdown_connections 2023-07-06T22:00:15.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.434+0000 7fea7546d640 1 -- 172.21.15.55:0/1728578290 >> 172.21.15.55:0/1728578290 conn(0x7fea7006ee80 msgr2=0x7fea7006f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:15.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.434+0000 7fea7546d640 1 -- 172.21.15.55:0/1728578290 shutdown_connections 2023-07-06T22:00:15.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.434+0000 7fea7546d640 1 -- 172.21.15.55:0/1728578290 wait complete. 2023-07-06T22:00:15.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea7546d640 1 Processor -- start 2023-07-06T22:00:15.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea7546d640 1 -- start start 2023-07-06T22:00:15.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea7546d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5c0040c0 0x7fea7015cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:15.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea7546d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea7015ed70 0x7fea7014d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea7546d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea7014d700 0x7fea701551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea7546d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7014db70 con 0x7fea5c0040c0 2023-07-06T22:00:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea7546d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7015c730 con 0x7fea7015ed70 2023-07-06T22:00:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea7546d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7014c590 con 0x7fea7014d700 2023-07-06T22:00:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea6effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5c0040c0 0x7fea7015cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea6effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5c0040c0 0x7fea7015cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58358/0 (socket says 172.21.15.55:58358) 2023-07-06T22:00:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea6effd640 1 -- 172.21.15.55:0/2184738350 learned_addr learned my addr 172.21.15.55:0/2184738350 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:15.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea6effd640 1 -- 172.21.15.55:0/2184738350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea7014d700 msgr2=0x7fea701551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:15.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea6effd640 1 --2- 172.21.15.55:0/2184738350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea7014d700 0x7fea701551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea6effd640 1 -- 172.21.15.55:0/2184738350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea7015ed70 msgr2=0x7fea7014d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:15.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea6effd640 1 --2- 172.21.15.55:0/2184738350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea7015ed70 0x7fea7014d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea6effd640 1 -- 172.21.15.55:0/2184738350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7015bb20 con 0x7fea5c0040c0 2023-07-06T22:00:15.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea6effd640 1 --2- 172.21.15.55:0/2184738350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5c0040c0 0x7fea7015cbc0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fea6000c760 tx=0x7fea6000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:15.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea677fe640 1 -- 172.21.15.55:0/2184738350 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea600074e0 con 0x7fea5c0040c0 2023-07-06T22:00:15.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea677fe640 1 -- 172.21.15.55:0/2184738350 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea60007660 con 0x7fea5c0040c0 2023-07-06T22:00:15.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea677fe640 1 -- 172.21.15.55:0/2184738350 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60004a30 con 0x7fea5c0040c0 2023-07-06T22:00:15.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea7546d640 1 -- 172.21.15.55:0/2184738350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7015be00 con 0x7fea5c0040c0 2023-07-06T22:00:15.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.438+0000 7fea7546d640 1 -- 172.21.15.55:0/2184738350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7015c3c0 con 0x7fea5c0040c0 2023-07-06T22:00:15.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.442+0000 7fea7546d640 1 -- 172.21.15.55:0/2184738350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea70066d60 con 0x7fea5c0040c0 2023-07-06T22:00:15.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.442+0000 7fea677fe640 1 -- 172.21.15.55:0/2184738350 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fea60004b90 con 0x7fea5c0040c0 2023-07-06T22:00:15.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.442+0000 7fea677fe640 1 --2- 172.21.15.55:0/2184738350 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fea500663a0 0x7fea50068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:15.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.442+0000 7fea677fe640 1 -- 172.21.15.55:0/2184738350 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fea60082ff0 con 0x7fea5c0040c0 2023-07-06T22:00:15.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.442+0000 7fea67fff640 1 --2- 172.21.15.55:0/2184738350 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fea500663a0 0x7fea50068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:15.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.442+0000 7fea67fff640 1 --2- 172.21.15.55:0/2184738350 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fea500663a0 0x7fea50068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fea580ad000 tx=0x7fea580047e0 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:15.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.446+0000 7fea677fe640 1 -- 172.21.15.55:0/2184738350 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea600b3700 con 0x7fea5c0040c0 2023-07-06T22:00:15.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.654+0000 7fea7546d640 1 -- 172.21.15.55:0/2184738350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fea700d0fe0 con 0x7fea5c0040c0 2023-07-06T22:00:15.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.654+0000 7fea677fe640 1 -- 172.21.15.55:0/2184738350 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fea60018090 con 0x7fea5c0040c0 2023-07-06T22:00:15.655 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:15.655 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:00:15.655 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-07-06T22:00:15.655 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.655 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-07-06T22:00:15.656 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkWjb1JxAAMmLy+dPO5qyorBnuzazx6A==", 2023-07-06T22:00:15.656 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.656 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:00:15.656 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:00:15.656 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:00:15.656 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.656 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.657 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.657 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.657 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-07-06T22:00:15.657 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkpLLENBAAxMASh3qbELQMJ3XbPEX0Zw==", 2023-07-06T22:00:15.657 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.657 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:00:15.657 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:00:15.658 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:00:15.658 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.658 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.658 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.658 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.658 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-07-06T22:00:15.658 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkvOSfLxAAMEoqAPg1pb47e5a1G1QtAw==", 2023-07-06T22:00:15.659 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.659 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:00:15.659 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:00:15.659 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:00:15.659 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.659 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.659 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.660 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.660 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-07-06T22:00:15.660 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkeQIBARAApXT5zWLUqqMSdwYygZeatw==", 2023-07-06T22:00:15.660 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.660 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:00:15.660 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:00:15.660 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:00:15.661 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.661 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.661 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.661 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.661 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-07-06T22:00:15.661 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD5NKdkSIfzJxAAlXiG8PWFXQqIeugbdp7Eiw==", 2023-07-06T22:00:15.661 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.661 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:00:15.662 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:00:15.662 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.662 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.662 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.662 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.662 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-07-06T22:00:15.663 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD8NKdkv2iwLxAAxjFucMwaaH66wPQpoYSTGw==", 2023-07-06T22:00:15.663 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.663 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:00:15.663 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:00:15.663 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.663 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.663 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.663 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.664 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-07-06T22:00:15.664 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD/NKdk5w7XOBAAuiup4mcC02ZMCPHCU1Cl3A==", 2023-07-06T22:00:15.664 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.664 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:00:15.664 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:00:15.664 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.665 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.665 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.665 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.665 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-07-06T22:00:15.665 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQADNadksvRLBBAAE1YX9VgA8pWARIEZL8tbsQ==", 2023-07-06T22:00:15.665 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.665 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:00:15.666 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:00:15.666 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.666 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.666 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.666 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.666 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-07-06T22:00:15.666 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAJNadkn2HsChAAgwb7B9lHOMq2h0BNuhB/AQ==", 2023-07-06T22:00:15.666 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.667 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:00:15.667 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:00:15.667 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.667 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.667 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.667 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.667 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-07-06T22:00:15.668 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMNadkbonPERAA2PLg4NMr+4eW+FDAfPig1A==", 2023-07-06T22:00:15.668 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.668 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:00:15.668 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:00:15.668 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.668 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.668 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.669 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.669 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-07-06T22:00:15.669 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAPNadkQw76GBAAY9SIgsTUHqvThwjdpjuwpw==", 2023-07-06T22:00:15.669 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.669 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:00:15.669 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:00:15.669 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.670 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.670 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.670 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.670 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-07-06T22:00:15.670 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQASNadkr3gRHxAALbPUtIgImIK1UUoe6vcyjg==", 2023-07-06T22:00:15.670 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.670 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:00:15.671 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:00:15.671 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.671 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.671 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.671 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.671 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-07-06T22:00:15.671 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkaZgiBRAAvyBUd+qHLh/wwhgoE1MsVA==", 2023-07-06T22:00:15.672 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.672 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:00:15.672 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-07-06T22:00:15.672 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-06T22:00:15.672 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.672 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.672 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.673 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-07-06T22:00:15.673 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkOBqoDBAASIhzvCqkSAFLX2oc99MYqw==", 2023-07-06T22:00:15.673 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.673 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:00:15.673 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:00:15.673 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:00:15.673 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:00:15.673 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.674 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.674 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.674 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-07-06T22:00:15.674 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkgt/fCBAAlQY94DrR/nFTIVwSFCEToQ==", 2023-07-06T22:00:15.674 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.674 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:00:15.674 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:00:15.675 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:00:15.675 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:00:15.675 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.675 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.675 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.675 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-07-06T22:00:15.676 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkd5zAEhAAU0Qo6NROIKRSlOncFUoTxQ==", 2023-07-06T22:00:15.676 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.676 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:00:15.676 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:00:15.676 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:00:15.676 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:00:15.676 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.677 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.677 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.677 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-07-06T22:00:15.677 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkjvG8ChAA5rpuV6+YETQS9UjMRUynxA==", 2023-07-06T22:00:15.677 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.677 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:00:15.677 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:00:15.678 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:00:15.678 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.678 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.678 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.678 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.678 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-07-06T22:00:15.678 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdk+RUVIxAAyQpmGAeL8K+Cy+fgK5BmCQ==", 2023-07-06T22:00:15.679 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.679 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:00:15.679 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T22:00:15.679 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.679 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.679 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:15.679 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:15.679 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-07-06T22:00:15.680 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkLH8aHxAAzzX5YxumCYWYqo0rQfFA9g==", 2023-07-06T22:00:15.680 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:00:15.680 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:00:15.680 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T22:00:15.680 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:00:15.680 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.681 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:15.681 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-07-06T22:00:15.681 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:00:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.658+0000 7fea7546d640 1 -- 172.21.15.55:0/2184738350 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fea500663a0 msgr2=0x7fea50068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.658+0000 7fea7546d640 1 --2- 172.21.15.55:0/2184738350 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fea500663a0 0x7fea50068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fea580ad000 tx=0x7fea580047e0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.658+0000 7fea7546d640 1 -- 172.21.15.55:0/2184738350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5c0040c0 msgr2=0x7fea7015cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.658+0000 7fea7546d640 1 --2- 172.21.15.55:0/2184738350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5c0040c0 0x7fea7015cbc0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fea6000c760 tx=0x7fea6000cc20 comp rx=0 tx=0).stop 2023-07-06T22:00:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.658+0000 7fea7546d640 1 -- 172.21.15.55:0/2184738350 shutdown_connections 2023-07-06T22:00:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.658+0000 7fea7546d640 1 --2- 172.21.15.55:0/2184738350 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fea500663a0 0x7fea50068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.658+0000 7fea7546d640 1 --2- 172.21.15.55:0/2184738350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea7014d700 0x7fea701551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.658+0000 7fea7546d640 1 --2- 172.21.15.55:0/2184738350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea7015ed70 0x7fea7014d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.658+0000 7fea7546d640 1 --2- 172.21.15.55:0/2184738350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5c0040c0 0x7fea7015cbc0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.658+0000 7fea7546d640 1 -- 172.21.15.55:0/2184738350 >> 172.21.15.55:0/2184738350 conn(0x7fea7006ee80 msgr2=0x7fea700cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:15.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.658+0000 7fea7546d640 1 -- 172.21.15.55:0/2184738350 shutdown_connections 2023-07-06T22:00:15.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.658+0000 7fea7546d640 1 -- 172.21.15.55:0/2184738350 wait complete. 2023-07-06T22:00:15.684 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:00:15.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f29aa1640 1 Processor -- start 2023-07-06T22:00:15.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f29aa1640 1 -- start start 2023-07-06T22:00:15.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f29aa1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f2415b9d0 0x7f3f240b2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:15.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f29aa1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3f240ce5e0 0x7f3f240b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:15.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f29aa1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f240cc770 con 0x7f3f240b40e0 2023-07-06T22:00:15.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f29aa1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f240b4560 con 0x7f3f240ce5e0 2023-07-06T22:00:15.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f29aa1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f240cc9c0 con 0x7f3f2415b9d0 2023-07-06T22:00:15.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f28a9f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f2415b9d0 0x7f3f240b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:15.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f23fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3f240ce5e0 0x7f3f240b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:15.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f28a9f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f2415b9d0 0x7f3f240b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:53798/0 (socket says 172.21.15.55:53798) 2023-07-06T22:00:15.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f292a0640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f3f240b40e0 0x7f3f2415f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:41998/0 (socket says 172.21.15.55:41998) 2023-07-06T22:00:15.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f23fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3f240ce5e0 0x7f3f240b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:49570/0 (socket says 172.21.15.55:49570) 2023-07-06T22:00:15.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f28a9f640 1 -- 172.21.15.55:0/639505855 learned_addr learned my addr 172.21.15.55:0/639505855 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:15.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f237fe640 1 -- 172.21.15.55:0/639505855 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532329566 0 0) 0x7f3f240cc770 con 0x7f3f240b40e0 2023-07-06T22:00:15.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f28a9f640 1 -- 172.21.15.55:0/639505855 >> v2:172.21.15.138:3300/0 conn(0x7f3f240ce5e0 msgr2=0x7f3f240b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:15.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f28a9f640 1 --2- 172.21.15.55:0/639505855 >> v2:172.21.15.138:3300/0 conn(0x7f3f240ce5e0 0x7f3f240b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f28a9f640 1 -- 172.21.15.55:0/639505855 >> v1:172.21.15.138:6789/0 conn(0x7f3f240b40e0 legacy=0x7f3f2415f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:15.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f28a9f640 1 -- 172.21.15.55:0/639505855 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f240ccca0 con 0x7f3f2415b9d0 2023-07-06T22:00:15.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.830+0000 7f3f23fff640 1 --2- 172.21.15.55:0/639505855 >> v2:172.21.15.138:3300/0 conn(0x7f3f240ce5e0 0x7f3f240b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:15.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.834+0000 7f3f28a9f640 1 --2- 172.21.15.55:0/639505855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f2415b9d0 0x7f3f240b2440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009870 tx=0x7f3f1801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e7f0ee8b55c9fd2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:15.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f237fe640 1 -- 172.21.15.55:0/639505855 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180aa680 con 0x7f3f2415b9d0 2023-07-06T22:00:15.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f237fe640 1 -- 172.21.15.55:0/639505855 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f180aa7e0 con 0x7f3f2415b9d0 2023-07-06T22:00:15.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f237fe640 1 -- 172.21.15.55:0/639505855 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180aab70 con 0x7f3f2415b9d0 2023-07-06T22:00:15.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 -- 172.21.15.55:0/639505855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f2415b9d0 msgr2=0x7f3f240b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:15.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 --2- 172.21.15.55:0/639505855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f2415b9d0 0x7f3f240b2440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009870 tx=0x7f3f1801c540 comp rx=0 tx=0).stop 2023-07-06T22:00:15.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 -- 172.21.15.55:0/639505855 shutdown_connections 2023-07-06T22:00:15.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 --2- 172.21.15.55:0/639505855 >> v2:172.21.15.138:3300/0 conn(0x7f3f240ce5e0 0x7f3f240b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 --2- 172.21.15.55:0/639505855 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f2415b9d0 0x7f3f240b2440 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 -- 172.21.15.55:0/639505855 >> 172.21.15.55:0/639505855 conn(0x7f3f2406c2b0 msgr2=0x7f3f240ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:15.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 -- 172.21.15.55:0/639505855 shutdown_connections 2023-07-06T22:00:15.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 -- 172.21.15.55:0/639505855 wait complete. 2023-07-06T22:00:15.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 Processor -- start 2023-07-06T22:00:15.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 -- start start 2023-07-06T22:00:15.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f240b40e0 0x7f3f2406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:15.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f240ce5e0 0x7f3f240b7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:15.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f2415b9d0 0x7f3f24146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:15.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2415cdf0 con 0x7f3f240ce5e0 2023-07-06T22:00:15.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2415c1e0 con 0x7f3f2415b9d0 2023-07-06T22:00:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f29aa1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2415c4c0 con 0x7f3f240b40e0 2023-07-06T22:00:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f23fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f240ce5e0 0x7f3f240b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f23fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f240ce5e0 0x7f3f240b7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58370/0 (socket says 172.21.15.55:58370) 2023-07-06T22:00:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f23fff640 1 -- 172.21.15.55:0/1313664694 learned_addr learned my addr 172.21.15.55:0/1313664694 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.838+0000 7f3f28a9f640 1 --2- 172.21.15.55:0/1313664694 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f240b40e0 0x7f3f2406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f23fff640 1 -- 172.21.15.55:0/1313664694 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f240b40e0 msgr2=0x7f3f2406a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f23fff640 1 --2- 172.21.15.55:0/1313664694 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f240b40e0 0x7f3f2406a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f23fff640 1 -- 172.21.15.55:0/1313664694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f2415b9d0 msgr2=0x7f3f24146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f23fff640 1 --2- 172.21.15.55:0/1313664694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f2415b9d0 0x7f3f24146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f23fff640 1 -- 172.21.15.55:0/1313664694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f180094d0 con 0x7f3f240ce5e0 2023-07-06T22:00:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f23fff640 1 --2- 172.21.15.55:0/1313664694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f240ce5e0 0x7f3f240b7590 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000e810 tx=0x7f3f1000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f217fa640 1 -- 172.21.15.55:0/1313664694 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1000c8d0 con 0x7f3f240ce5e0 2023-07-06T22:00:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f217fa640 1 -- 172.21.15.55:0/1313664694 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1000ca30 con 0x7f3f240ce5e0 2023-07-06T22:00:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f217fa640 1 -- 172.21.15.55:0/1313664694 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1000cdc0 con 0x7f3f240ce5e0 2023-07-06T22:00:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f29aa1640 1 -- 172.21.15.55:0/1313664694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2415c7a0 con 0x7f3f240ce5e0 2023-07-06T22:00:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f29aa1640 1 -- 172.21.15.55:0/1313664694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f240b68c0 con 0x7f3f240ce5e0 2023-07-06T22:00:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f29aa1640 1 -- 172.21.15.55:0/1313664694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2415cfa0 con 0x7f3f240ce5e0 2023-07-06T22:00:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f217fa640 1 -- 172.21.15.55:0/1313664694 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3f10013410 con 0x7f3f240ce5e0 2023-07-06T22:00:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f217fa640 1 --2- 172.21.15.55:0/1313664694 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f3f080663a0 0x7f3f08068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.842+0000 7f3f217fa640 1 -- 172.21.15.55:0/1313664694 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3f10083af0 con 0x7f3f240ce5e0 2023-07-06T22:00:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.846+0000 7f3f28a9f640 1 --2- 172.21.15.55:0/1313664694 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f3f080663a0 0x7f3f08068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.846+0000 7f3f28a9f640 1 --2- 172.21.15.55:0/1313664694 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f3f080663a0 0x7f3f08068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3f180ae000 tx=0x7f3f180a7000 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:15.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:15.846+0000 7f3f217fa640 1 -- 172.21.15.55:0/1313664694 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f2415cfa0 con 0x7f3f240ce5e0 2023-07-06T22:00:16.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.002+0000 7f3f29aa1640 1 -- 172.21.15.55:0/1313664694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f2404d790 con 0x7f3f240ce5e0 2023-07-06T22:00:16.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.002+0000 7f3f217fa640 1 -- 172.21.15.55:0/1313664694 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+14842 (secure 0 0 0) 0x7f3f10051000 con 0x7f3f240ce5e0 2023-07-06T22:00:16.003 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:16.003 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":127,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:00:15.251578+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:00:16.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.006+0000 7f3f29aa1640 1 -- 172.21.15.55:0/1313664694 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f3f080663a0 msgr2=0x7f3f08068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.006+0000 7f3f29aa1640 1 --2- 172.21.15.55:0/1313664694 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f3f080663a0 0x7f3f08068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3f180ae000 tx=0x7f3f180a7000 comp rx=0 tx=0).stop 2023-07-06T22:00:16.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.006+0000 7f3f29aa1640 1 -- 172.21.15.55:0/1313664694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f240ce5e0 msgr2=0x7f3f240b7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.006+0000 7f3f29aa1640 1 --2- 172.21.15.55:0/1313664694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f240ce5e0 0x7f3f240b7590 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000e810 tx=0x7f3f1000ecd0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.006+0000 7f3f29aa1640 1 -- 172.21.15.55:0/1313664694 shutdown_connections 2023-07-06T22:00:16.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.006+0000 7f3f29aa1640 1 --2- 172.21.15.55:0/1313664694 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f3f080663a0 0x7f3f08068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.006+0000 7f3f29aa1640 1 --2- 172.21.15.55:0/1313664694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f2415b9d0 0x7f3f24146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.006+0000 7f3f29aa1640 1 --2- 172.21.15.55:0/1313664694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f240ce5e0 0x7f3f240b7590 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.006+0000 7f3f29aa1640 1 --2- 172.21.15.55:0/1313664694 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f240b40e0 0x7f3f2406a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.006+0000 7f3f29aa1640 1 -- 172.21.15.55:0/1313664694 >> 172.21.15.55:0/1313664694 conn(0x7f3f2406c2b0 msgr2=0x7f3f240c6380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:16.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.006+0000 7f3f29aa1640 1 -- 172.21.15.55:0/1313664694 shutdown_connections 2023-07-06T22:00:16.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.006+0000 7f3f29aa1640 1 -- 172.21.15.55:0/1313664694 wait complete. 2023-07-06T22:00:16.024 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:00:16.024 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:00:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.170+0000 7fb7a426d640 1 Processor -- start 2023-07-06T22:00:16.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.170+0000 7fb7a426d640 1 -- start start 2023-07-06T22:00:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.174+0000 7fb7a426d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb79c158850 0x7fb79c0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.174+0000 7fb7a426d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb79c070af0 0x7fb79c0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.174+0000 7fb7a426d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79c158c20 con 0x7fb79c0ca130 2023-07-06T22:00:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.174+0000 7fb7a426d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79c0b2aa0 con 0x7fb79c070af0 2023-07-06T22:00:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.174+0000 7fb7a426d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79c0c8db0 con 0x7fb79c158850 2023-07-06T22:00:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.174+0000 7fb7a280a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb79c070af0 0x7fb79c0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.174+0000 7fb7a280a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb79c070af0 0x7fb79c0ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58376/0 (socket says 172.21.15.55:58376) 2023-07-06T22:00:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.174+0000 7fb7a280a640 1 -- 172.21.15.55:0/3801048816 learned_addr learned my addr 172.21.15.55:0/3801048816 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.174+0000 7fb7a2009640 1 --2- 172.21.15.55:0/3801048816 >> v2:172.21.15.138:3300/0 conn(0x7fb79c158850 0x7fb79c0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.174+0000 7fb7a280a640 1 -- 172.21.15.55:0/3801048816 >> v2:172.21.15.138:3300/0 conn(0x7fb79c158850 msgr2=0x7fb79c0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:16.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.174+0000 7fb7a280a640 1 --2- 172.21.15.55:0/3801048816 >> v2:172.21.15.138:3300/0 conn(0x7fb79c158850 0x7fb79c0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.174+0000 7fb7a280a640 1 -- 172.21.15.55:0/3801048816 >> v1:172.21.15.55:6789/0 conn(0x7fb79c0ca130 legacy=0x7fb79c0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.174+0000 7fb7a280a640 1 -- 172.21.15.55:0/3801048816 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c0c9090 con 0x7fb79c070af0 2023-07-06T22:00:16.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.178+0000 7fb7a280a640 1 --2- 172.21.15.55:0/3801048816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb79c070af0 0x7fb79c0ccf70 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fb79c06eaf0 tx=0x7fb79401ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fda89f669eb4ab server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:16.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.178+0000 7fb7a1007640 1 -- 172.21.15.55:0/3801048816 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7940a7a80 con 0x7fb79c070af0 2023-07-06T22:00:16.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.178+0000 7fb7a1007640 1 -- 172.21.15.55:0/3801048816 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7940a7be0 con 0x7fb79c070af0 2023-07-06T22:00:16.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.178+0000 7fb7a1007640 1 -- 172.21.15.55:0/3801048816 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7940af3f0 con 0x7fb79c070af0 2023-07-06T22:00:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.178+0000 7fb7a426d640 1 -- 172.21.15.55:0/3801048816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb79c070af0 msgr2=0x7fb79c0ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.178+0000 7fb7a426d640 1 --2- 172.21.15.55:0/3801048816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb79c070af0 0x7fb79c0ccf70 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fb79c06eaf0 tx=0x7fb79401ebb0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.178+0000 7fb7a426d640 1 -- 172.21.15.55:0/3801048816 shutdown_connections 2023-07-06T22:00:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.178+0000 7fb7a426d640 1 --2- 172.21.15.55:0/3801048816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb79c070af0 0x7fb79c0ccf70 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.178+0000 7fb7a426d640 1 --2- 172.21.15.55:0/3801048816 >> v2:172.21.15.138:3300/0 conn(0x7fb79c158850 0x7fb79c0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.178+0000 7fb7a426d640 1 -- 172.21.15.55:0/3801048816 >> 172.21.15.55:0/3801048816 conn(0x7fb79c0cea70 msgr2=0x7fb79c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.178+0000 7fb7a426d640 1 -- 172.21.15.55:0/3801048816 shutdown_connections 2023-07-06T22:00:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.178+0000 7fb7a426d640 1 -- 172.21.15.55:0/3801048816 wait complete. 2023-07-06T22:00:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.178+0000 7fb7a426d640 1 Processor -- start 2023-07-06T22:00:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.178+0000 7fb7a426d640 1 -- start start 2023-07-06T22:00:16.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a426d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb79c070af0 0x7fb79c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a426d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb79c0ca130 0x7fb79c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a426d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb79c158850 0x7fb79c0b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a426d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c0aef60 con 0x7fb79c070af0 2023-07-06T22:00:16.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a426d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c0c6ae0 con 0x7fb79c158850 2023-07-06T22:00:16.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a426d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c0afd60 con 0x7fb79c0ca130 2023-07-06T22:00:16.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a2009640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb79c070af0 0x7fb79c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a2009640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb79c070af0 0x7fb79c0aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58390/0 (socket says 172.21.15.55:58390) 2023-07-06T22:00:16.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a2009640 1 -- 172.21.15.55:0/2106833990 learned_addr learned my addr 172.21.15.55:0/2106833990 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:16.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a1808640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb79c0ca130 0x7fb79c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a280a640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb79c158850 0x7fb79c0b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a2009640 1 -- 172.21.15.55:0/2106833990 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb79c0ca130 msgr2=0x7fb79c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a2009640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb79c0ca130 0x7fb79c0c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a2009640 1 -- 172.21.15.55:0/2106833990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb79c158850 msgr2=0x7fb79c0b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a2009640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb79c158850 0x7fb79c0b6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a2009640 1 -- 172.21.15.55:0/2106833990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb794009b30 con 0x7fb79c070af0 2023-07-06T22:00:16.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a1808640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb79c0ca130 0x7fb79c0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:16.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a2009640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb79c070af0 0x7fb79c0aea20 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fb79800d5f0 tx=0x7fb79800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:16.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb792ffd640 1 -- 172.21.15.55:0/2106833990 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7980125f0 con 0x7fb79c070af0 2023-07-06T22:00:16.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb792ffd640 1 -- 172.21.15.55:0/2106833990 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb798012750 con 0x7fb79c070af0 2023-07-06T22:00:16.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb792ffd640 1 -- 172.21.15.55:0/2106833990 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb798012ae0 con 0x7fb79c070af0 2023-07-06T22:00:16.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a426d640 1 -- 172.21.15.55:0/2106833990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79c0af150 con 0x7fb79c070af0 2023-07-06T22:00:16.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a426d640 1 -- 172.21.15.55:0/2106833990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79c0af710 con 0x7fb79c070af0 2023-07-06T22:00:16.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb7a426d640 1 -- 172.21.15.55:0/2106833990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb79c066d60 con 0x7fb79c070af0 2023-07-06T22:00:16.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.182+0000 7fb792ffd640 1 -- 172.21.15.55:0/2106833990 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb798012c40 con 0x7fb79c070af0 2023-07-06T22:00:16.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.186+0000 7fb792ffd640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb7800663d0 0x7fb780068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.186+0000 7fb792ffd640 1 -- 172.21.15.55:0/2106833990 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb798084150 con 0x7fb79c070af0 2023-07-06T22:00:16.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.186+0000 7fb7a1808640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb7800663d0 0x7fb780068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.186+0000 7fb7a1808640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb7800663d0 0x7fb780068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0c5ea0 tx=0x7fb78c009040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:16.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.190+0000 7fb792ffd640 1 -- 172.21.15.55:0/2106833990 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb7980516b0 con 0x7fb79c070af0 2023-07-06T22:00:16.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.342+0000 7fb7a426d640 1 -- 172.21.15.55:0/2106833990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb79c06cd30 con 0x7fb79c070af0 2023-07-06T22:00:16.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.342+0000 7fb792ffd640 1 -- 172.21.15.55:0/2106833990 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v127) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb798007380 con 0x7fb79c070af0 2023-07-06T22:00:16.344 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:00:16.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.346+0000 7fb7a426d640 1 -- 172.21.15.55:0/2106833990 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb7800663d0 msgr2=0x7fb780068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.346+0000 7fb7a426d640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb7800663d0 0x7fb780068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0c5ea0 tx=0x7fb78c009040 comp rx=0 tx=0).stop 2023-07-06T22:00:16.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.346+0000 7fb7a426d640 1 -- 172.21.15.55:0/2106833990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb79c070af0 msgr2=0x7fb79c0aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.346+0000 7fb7a426d640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb79c070af0 0x7fb79c0aea20 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fb79800d5f0 tx=0x7fb79800dab0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.346+0000 7fb7a426d640 1 -- 172.21.15.55:0/2106833990 shutdown_connections 2023-07-06T22:00:16.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.346+0000 7fb7a426d640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb7800663d0 0x7fb780068880 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.346+0000 7fb7a426d640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb79c158850 0x7fb79c0b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.346+0000 7fb7a426d640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb79c0ca130 0x7fb79c0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.346+0000 7fb7a426d640 1 --2- 172.21.15.55:0/2106833990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb79c070af0 0x7fb79c0aea20 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.346+0000 7fb7a426d640 1 -- 172.21.15.55:0/2106833990 >> 172.21.15.55:0/2106833990 conn(0x7fb79c0cea70 msgr2=0x7fb79c0b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:16.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.346+0000 7fb7a426d640 1 -- 172.21.15.55:0/2106833990 shutdown_connections 2023-07-06T22:00:16.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.346+0000 7fb7a426d640 1 -- 172.21.15.55:0/2106833990 wait complete. 2023-07-06T22:00:16.364 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:00:16.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.510+0000 7f9a5f1c5640 1 Processor -- start 2023-07-06T22:00:16.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.510+0000 7f9a5f1c5640 1 -- start start 2023-07-06T22:00:16.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.510+0000 7f9a5f1c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9a58158850 0x7f9a580cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.510+0000 7f9a5f1c5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a58158cb0 con 0x7f9a58070af0 2023-07-06T22:00:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.510+0000 7f9a5f1c5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a580c8db0 con 0x7f9a580ca130 2023-07-06T22:00:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.510+0000 7f9a5f1c5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a580c9090 con 0x7f9a58158850 2023-07-06T22:00:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.510+0000 7f9a5cf61640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9a58158850 0x7f9a580cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.510+0000 7f9a5d762640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9a58070af0 0x7f9a580b1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44580/0 (socket says 172.21.15.55:44580) 2023-07-06T22:00:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.510+0000 7f9a5d762640 1 -- 172.21.15.55:0/2915502494 learned_addr learned my addr 172.21.15.55:0/2915502494 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:16.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.510+0000 7f9a5cf61640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9a58158850 0x7f9a580cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58392/0 (socket says 172.21.15.55:58392) 2023-07-06T22:00:16.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.514+0000 7f9a5cf61640 1 -- 172.21.15.55:0/2915502494 >> v1:172.21.15.138:6789/0 conn(0x7f9a580ca130 legacy=0x7f9a580703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.514+0000 7f9a5cf61640 1 -- 172.21.15.55:0/2915502494 >> v1:172.21.15.55:6789/0 conn(0x7f9a58070af0 legacy=0x7f9a580b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.514+0000 7f9a5cf61640 1 -- 172.21.15.55:0/2915502494 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a580c9370 con 0x7f9a58158850 2023-07-06T22:00:16.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.514+0000 7f9a577fe640 1 -- 172.21.15.55:0/2915502494 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477708245 0 0) 0x7f9a58158cb0 con 0x7f9a58070af0 2023-07-06T22:00:16.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.514+0000 7f9a5cf61640 1 --2- 172.21.15.55:0/2915502494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a58158850 0x7f9a580cca30 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00ba60 tx=0x7f9a4c01eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90628394a5d16612 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:16.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.514+0000 7f9a577fe640 1 -- 172.21.15.55:0/2915502494 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0a7b00 con 0x7f9a58158850 2023-07-06T22:00:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.514+0000 7f9a577fe640 1 -- 172.21.15.55:0/2915502494 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c0a7c60 con 0x7f9a58158850 2023-07-06T22:00:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.514+0000 7f9a577fe640 1 -- 172.21.15.55:0/2915502494 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0af440 con 0x7f9a58158850 2023-07-06T22:00:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.514+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/2915502494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a58158850 msgr2=0x7f9a580cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.514+0000 7f9a5f1c5640 1 --2- 172.21.15.55:0/2915502494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a58158850 0x7f9a580cca30 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00ba60 tx=0x7f9a4c01eb20 comp rx=0 tx=0).stop 2023-07-06T22:00:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/2915502494 shutdown_connections 2023-07-06T22:00:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5f1c5640 1 --2- 172.21.15.55:0/2915502494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a58158850 0x7f9a580cca30 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/2915502494 >> 172.21.15.55:0/2915502494 conn(0x7f9a580cea70 msgr2=0x7f9a580ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/2915502494 shutdown_connections 2023-07-06T22:00:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/2915502494 wait complete. 2023-07-06T22:00:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5f1c5640 1 Processor -- start 2023-07-06T22:00:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5f1c5640 1 -- start start 2023-07-06T22:00:16.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5f1c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a58070af0 0x7f9a5809de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5f1c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a580ca130 0x7f9a580c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5f1c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a58158850 0x7f9a58069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5f1c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a580c5000 con 0x7f9a580ca130 2023-07-06T22:00:16.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5f1c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a580c4110 con 0x7f9a58158850 2023-07-06T22:00:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5f1c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5806a5f0 con 0x7f9a58070af0 2023-07-06T22:00:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a57fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a580ca130 0x7f9a580c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a57fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a580ca130 0x7f9a580c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58394/0 (socket says 172.21.15.55:58394) 2023-07-06T22:00:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a57fff640 1 -- 172.21.15.55:0/7435929 learned_addr learned my addr 172.21.15.55:0/7435929 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5cf61640 1 --2- 172.21.15.55:0/7435929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a58070af0 0x7f9a5809de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a5d762640 1 --2- 172.21.15.55:0/7435929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a58158850 0x7f9a58069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a57fff640 1 -- 172.21.15.55:0/7435929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a58070af0 msgr2=0x7f9a5809de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a57fff640 1 --2- 172.21.15.55:0/7435929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a58070af0 0x7f9a5809de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a57fff640 1 -- 172.21.15.55:0/7435929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a58158850 msgr2=0x7f9a58069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a57fff640 1 --2- 172.21.15.55:0/7435929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a58158850 0x7f9a58069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a57fff640 1 -- 172.21.15.55:0/7435929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c00b6c0 con 0x7f9a580ca130 2023-07-06T22:00:16.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.518+0000 7f9a57fff640 1 --2- 172.21.15.55:0/7435929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a580ca130 0x7f9a580c3bd0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f9a4400c500 tx=0x7f9a4400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:16.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.522+0000 7f9a557fa640 1 -- 172.21.15.55:0/7435929 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a44005220 con 0x7f9a580ca130 2023-07-06T22:00:16.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.522+0000 7f9a557fa640 1 -- 172.21.15.55:0/7435929 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a44005380 con 0x7f9a580ca130 2023-07-06T22:00:16.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.522+0000 7f9a557fa640 1 -- 172.21.15.55:0/7435929 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a44007270 con 0x7f9a580ca130 2023-07-06T22:00:16.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.522+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/7435929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5806a8d0 con 0x7f9a580ca130 2023-07-06T22:00:16.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.522+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/7435929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5806ae90 con 0x7f9a580ca130 2023-07-06T22:00:16.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.522+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/7435929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5806a3b0 con 0x7f9a580ca130 2023-07-06T22:00:16.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.522+0000 7f9a557fa640 1 -- 172.21.15.55:0/7435929 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9a440073d0 con 0x7f9a580ca130 2023-07-06T22:00:16.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.522+0000 7f9a557fa640 1 --2- 172.21.15.55:0/7435929 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9a3c0663a0 0x7f9a3c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.522+0000 7f9a557fa640 1 -- 172.21.15.55:0/7435929 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9a44083650 con 0x7f9a580ca130 2023-07-06T22:00:16.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.522+0000 7f9a5cf61640 1 --2- 172.21.15.55:0/7435929 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9a3c0663a0 0x7f9a3c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.522+0000 7f9a5cf61640 1 --2- 172.21.15.55:0/7435929 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9a3c0663a0 0x7f9a3c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0b1000 tx=0x7f9a4c008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:16.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.526+0000 7f9a557fa640 1 -- 172.21.15.55:0/7435929 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a5806a3b0 con 0x7f9a580ca130 2023-07-06T22:00:16.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.682+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/7435929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9a5806a3b0 con 0x7f9a580ca130 2023-07-06T22:00:16.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.682+0000 7f9a557fa640 1 -- 172.21.15.55:0/7435929 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v127) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9a5806a3b0 con 0x7f9a580ca130 2023-07-06T22:00:16.681 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:00:16.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.682+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/7435929 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9a3c0663a0 msgr2=0x7f9a3c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.682+0000 7f9a5f1c5640 1 --2- 172.21.15.55:0/7435929 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9a3c0663a0 0x7f9a3c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0b1000 tx=0x7f9a4c008040 comp rx=0 tx=0).stop 2023-07-06T22:00:16.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.682+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/7435929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a580ca130 msgr2=0x7f9a580c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.682+0000 7f9a5f1c5640 1 --2- 172.21.15.55:0/7435929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a580ca130 0x7f9a580c3bd0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f9a4400c500 tx=0x7f9a4400c9c0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.682+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/7435929 shutdown_connections 2023-07-06T22:00:16.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.682+0000 7f9a5f1c5640 1 --2- 172.21.15.55:0/7435929 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9a3c0663a0 0x7f9a3c068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.682+0000 7f9a5f1c5640 1 --2- 172.21.15.55:0/7435929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a58158850 0x7f9a58069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.682+0000 7f9a5f1c5640 1 --2- 172.21.15.55:0/7435929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a580ca130 0x7f9a580c3bd0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.682+0000 7f9a5f1c5640 1 --2- 172.21.15.55:0/7435929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a58070af0 0x7f9a5809de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.682+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/7435929 >> 172.21.15.55:0/7435929 conn(0x7f9a580cea70 msgr2=0x7f9a5809ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:16.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.682+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/7435929 shutdown_connections 2023-07-06T22:00:16.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.682+0000 7f9a5f1c5640 1 -- 172.21.15.55:0/7435929 wait complete. 2023-07-06T22:00:16.702 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T22:00:16.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.846+0000 7ff1da248640 1 Processor -- start 2023-07-06T22:00:16.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.846+0000 7ff1da248640 1 -- start start 2023-07-06T22:00:16.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.846+0000 7ff1da248640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff1d4158400 0x7ff1d40c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.846+0000 7ff1da248640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1d40c9680 0x7ff1d4070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.846+0000 7ff1da248640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d406fae0 con 0x7ff1d40710c0 2023-07-06T22:00:16.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.846+0000 7ff1da248640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d406fdc0 con 0x7ff1d40c9680 2023-07-06T22:00:16.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.846+0000 7ff1da248640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d40700a0 con 0x7ff1d4158400 2023-07-06T22:00:16.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.846+0000 7ff1d2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1d40c9680 0x7ff1d4070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.846+0000 7ff1d2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1d40c9680 0x7ff1d4070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58404/0 (socket says 172.21.15.55:58404) 2023-07-06T22:00:16.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.846+0000 7ff1d2ffd640 1 -- 172.21.15.55:0/4271603413 learned_addr learned my addr 172.21.15.55:0/4271603413 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.846+0000 7ff1d37fe640 1 --2- 172.21.15.55:0/4271603413 >> v2:172.21.15.138:3300/0 conn(0x7ff1d4158400 0x7ff1d40c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1d2ffd640 1 -- 172.21.15.55:0/4271603413 >> v2:172.21.15.138:3300/0 conn(0x7ff1d4158400 msgr2=0x7ff1d40c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1d2ffd640 1 --2- 172.21.15.55:0/4271603413 >> v2:172.21.15.138:3300/0 conn(0x7ff1d4158400 0x7ff1d40c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1d2ffd640 1 -- 172.21.15.55:0/4271603413 >> v1:172.21.15.138:6789/0 conn(0x7ff1d40710c0 legacy=0x7ff1d40cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1d2ffd640 1 -- 172.21.15.55:0/4271603413 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d4070380 con 0x7ff1d40c9680 2023-07-06T22:00:16.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1d2ffd640 1 --2- 172.21.15.55:0/4271603413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1d40c9680 0x7ff1d4070b80 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7ff1d406ed50 tx=0x7ff1c801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e751f081cbc58958 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:16.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1d27fc640 1 -- 172.21.15.55:0/4271603413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c80ab660 con 0x7ff1d40c9680 2023-07-06T22:00:16.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1d27fc640 1 -- 172.21.15.55:0/4271603413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c80ab7c0 con 0x7ff1d40c9680 2023-07-06T22:00:16.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1d27fc640 1 -- 172.21.15.55:0/4271603413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c80abb50 con 0x7ff1d40c9680 2023-07-06T22:00:16.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1da248640 1 -- 172.21.15.55:0/4271603413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1d40c9680 msgr2=0x7ff1d4070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1da248640 1 --2- 172.21.15.55:0/4271603413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1d40c9680 0x7ff1d4070b80 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7ff1d406ed50 tx=0x7ff1c801c440 comp rx=0 tx=0).stop 2023-07-06T22:00:16.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1da248640 1 -- 172.21.15.55:0/4271603413 shutdown_connections 2023-07-06T22:00:16.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1da248640 1 --2- 172.21.15.55:0/4271603413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1d40c9680 0x7ff1d4070b80 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1da248640 1 --2- 172.21.15.55:0/4271603413 >> v2:172.21.15.138:3300/0 conn(0x7ff1d4158400 0x7ff1d40c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1da248640 1 -- 172.21.15.55:0/4271603413 >> 172.21.15.55:0/4271603413 conn(0x7ff1d40cded0 msgr2=0x7ff1d40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:16.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.850+0000 7ff1da248640 1 -- 172.21.15.55:0/4271603413 shutdown_connections 2023-07-06T22:00:16.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1da248640 1 -- 172.21.15.55:0/4271603413 wait complete. 2023-07-06T22:00:16.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1da248640 1 Processor -- start 2023-07-06T22:00:16.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1da248640 1 -- start start 2023-07-06T22:00:16.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1da248640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1d40710c0 0x7ff1d40b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1da248640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1d40c9680 0x7ff1d4159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1da248640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1d4158400 0x7ff1d40adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1da248640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d415a240 con 0x7ff1d40710c0 2023-07-06T22:00:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1da248640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d415a4a0 con 0x7ff1d4158400 2023-07-06T22:00:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1da248640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d415b900 con 0x7ff1d40c9680 2023-07-06T22:00:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1d37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1d40710c0 0x7ff1d40b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1d37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1d40710c0 0x7ff1d40b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58416/0 (socket says 172.21.15.55:58416) 2023-07-06T22:00:16.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1d37fe640 1 -- 172.21.15.55:0/170904127 learned_addr learned my addr 172.21.15.55:0/170904127 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:16.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1d3fff640 1 --2- 172.21.15.55:0/170904127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1d4158400 0x7ff1d40adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1d37fe640 1 -- 172.21.15.55:0/170904127 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1d40c9680 msgr2=0x7ff1d4159d00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T22:00:16.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1d37fe640 1 --2- 172.21.15.55:0/170904127 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1d40c9680 0x7ff1d4159d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1d37fe640 1 -- 172.21.15.55:0/170904127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1d4158400 msgr2=0x7ff1d40adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:16.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1d37fe640 1 --2- 172.21.15.55:0/170904127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1d4158400 0x7ff1d40adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:16.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1d37fe640 1 -- 172.21.15.55:0/170904127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c80094d0 con 0x7ff1d40710c0 2023-07-06T22:00:16.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1d3fff640 1 --2- 172.21.15.55:0/170904127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1d4158400 0x7ff1d40adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:16.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.854+0000 7ff1d37fe640 1 --2- 172.21.15.55:0/170904127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1d40710c0 0x7ff1d40b2e70 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400d800 tx=0x7ff1c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.858+0000 7ff1bbfff640 1 -- 172.21.15.55:0/170904127 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400b6c0 con 0x7ff1d40710c0 2023-07-06T22:00:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.858+0000 7ff1bbfff640 1 -- 172.21.15.55:0/170904127 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c400b860 con 0x7ff1d40710c0 2023-07-06T22:00:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.858+0000 7ff1bbfff640 1 -- 172.21.15.55:0/170904127 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400bc10 con 0x7ff1d40710c0 2023-07-06T22:00:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.858+0000 7ff1da248640 1 -- 172.21.15.55:0/170904127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d415bba0 con 0x7ff1d40710c0 2023-07-06T22:00:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.858+0000 7ff1da248640 1 -- 172.21.15.55:0/170904127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d415c160 con 0x7ff1d40710c0 2023-07-06T22:00:16.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.858+0000 7ff1da248640 1 -- 172.21.15.55:0/170904127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d406c580 con 0x7ff1d40710c0 2023-07-06T22:00:16.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.858+0000 7ff1bbfff640 1 -- 172.21.15.55:0/170904127 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff1c401e460 con 0x7ff1d40710c0 2023-07-06T22:00:16.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.858+0000 7ff1bbfff640 1 --2- 172.21.15.55:0/170904127 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff1c00663d0 0x7ff1c0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:16.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.858+0000 7ff1bbfff640 1 -- 172.21.15.55:0/170904127 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff1c40842a0 con 0x7ff1d40710c0 2023-07-06T22:00:16.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.858+0000 7ff1d2ffd640 1 --2- 172.21.15.55:0/170904127 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff1c00663d0 0x7ff1c0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:16.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.862+0000 7ff1d2ffd640 1 --2- 172.21.15.55:0/170904127 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff1c00663d0 0x7ff1c0068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80af000 tx=0x7ff1c8008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:16.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:16.862+0000 7ff1bbfff640 1 -- 172.21.15.55:0/170904127 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1c4051810 con 0x7ff1d40710c0 2023-07-06T22:00:17.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.018+0000 7ff1da248640 1 -- 172.21.15.55:0/170904127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff1d4066d60 con 0x7ff1d40710c0 2023-07-06T22:00:17.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.018+0000 7ff1bbfff640 1 -- 172.21.15.55:0/170904127 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v127) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff1c4054e30 con 0x7ff1d40710c0 2023-07-06T22:00:17.019 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:17.019 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T22:00:17.019 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:17.019 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-07-06T22:00:17.019 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-07-06T22:00:17.020 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:00:17.020 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:17.020 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-07-06T22:00:17.020 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-07-06T22:00:17.020 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:17.020 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T22:00:17.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.022+0000 7ff1da248640 1 -- 172.21.15.55:0/170904127 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff1c00663d0 msgr2=0x7ff1c0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:17.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.022+0000 7ff1da248640 1 --2- 172.21.15.55:0/170904127 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff1c00663d0 0x7ff1c0068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80af000 tx=0x7ff1c8008040 comp rx=0 tx=0).stop 2023-07-06T22:00:17.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.022+0000 7ff1da248640 1 -- 172.21.15.55:0/170904127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1d40710c0 msgr2=0x7ff1d40b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.022+0000 7ff1da248640 1 --2- 172.21.15.55:0/170904127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1d40710c0 0x7ff1d40b2e70 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400d800 tx=0x7ff1c400dcc0 comp rx=0 tx=0).stop 2023-07-06T22:00:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.022+0000 7ff1da248640 1 -- 172.21.15.55:0/170904127 shutdown_connections 2023-07-06T22:00:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.022+0000 7ff1da248640 1 --2- 172.21.15.55:0/170904127 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff1c00663d0 0x7ff1c0068880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.022+0000 7ff1da248640 1 --2- 172.21.15.55:0/170904127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1d4158400 0x7ff1d40adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.022+0000 7ff1da248640 1 --2- 172.21.15.55:0/170904127 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1d40c9680 0x7ff1d4159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.022+0000 7ff1da248640 1 --2- 172.21.15.55:0/170904127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1d40710c0 0x7ff1d40b2e70 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.022+0000 7ff1da248640 1 -- 172.21.15.55:0/170904127 >> 172.21.15.55:0/170904127 conn(0x7ff1d40cded0 msgr2=0x7ff1d40af040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.022+0000 7ff1da248640 1 -- 172.21.15.55:0/170904127 shutdown_connections 2023-07-06T22:00:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.022+0000 7ff1da248640 1 -- 172.21.15.55:0/170904127 wait complete. 2023-07-06T22:00:17.039 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T22:00:17.040 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T22:00:17.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.190+0000 7f5147b74640 1 Processor -- start 2023-07-06T22:00:17.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.190+0000 7f5147b74640 1 -- start start 2023-07-06T22:00:17.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.190+0000 7f5147b74640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51400cbfa0 0x7f514006f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:17.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.190+0000 7f5147b74640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5140158b50 con 0x7f51400c89b0 2023-07-06T22:00:17.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.190+0000 7f5147b74640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514006b390 con 0x7f5140158780 2023-07-06T22:00:17.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.190+0000 7f5147b74640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514006b630 con 0x7f51400cbfa0 2023-07-06T22:00:17.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.190+0000 7f514510f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51400cbfa0 0x7f514006f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:17.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.190+0000 7f5146111640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f51400c89b0 0x7f514006c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44588/0 (socket says 172.21.15.55:44588) 2023-07-06T22:00:17.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.190+0000 7f5146111640 1 -- 172.21.15.55:0/4247708944 learned_addr learned my addr 172.21.15.55:0/4247708944 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:17.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.190+0000 7f514510f640 1 -- 172.21.15.55:0/4247708944 >> v1:172.21.15.138:6789/0 conn(0x7f5140158780 legacy=0x7f51400cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:17.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.190+0000 7f514510f640 1 -- 172.21.15.55:0/4247708944 >> v1:172.21.15.55:6789/0 conn(0x7f51400c89b0 legacy=0x7f514006c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:17.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.190+0000 7f514510f640 1 -- 172.21.15.55:0/4247708944 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514006b910 con 0x7f51400cbfa0 2023-07-06T22:00:17.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.190+0000 7f514490e640 1 -- 172.21.15.55:0/4247708944 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077088186 0 0) 0x7f5140158b50 con 0x7f51400c89b0 2023-07-06T22:00:17.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.194+0000 7f514510f640 1 --2- 172.21.15.55:0/4247708944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51400cbfa0 0x7f514006f3f0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f51300097c0 tx=0x7f513001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef2bd73291e45e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:17.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.194+0000 7f514490e640 1 -- 172.21.15.55:0/4247708944 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51300ab600 con 0x7f51400cbfa0 2023-07-06T22:00:17.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.194+0000 7f514490e640 1 -- 172.21.15.55:0/4247708944 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51300a7050 con 0x7f51400cbfa0 2023-07-06T22:00:17.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.194+0000 7f514490e640 1 -- 172.21.15.55:0/4247708944 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51300ab980 con 0x7f51400cbfa0 2023-07-06T22:00:17.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.194+0000 7f5147b74640 1 -- 172.21.15.55:0/4247708944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51400cbfa0 msgr2=0x7f514006f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:17.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.194+0000 7f5147b74640 1 --2- 172.21.15.55:0/4247708944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51400cbfa0 0x7f514006f3f0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f51300097c0 tx=0x7f513001c3f0 comp rx=0 tx=0).stop 2023-07-06T22:00:17.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.194+0000 7f5147b74640 1 -- 172.21.15.55:0/4247708944 shutdown_connections 2023-07-06T22:00:17.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.194+0000 7f5147b74640 1 --2- 172.21.15.55:0/4247708944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51400cbfa0 0x7f514006f3f0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:17.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.194+0000 7f5147b74640 1 -- 172.21.15.55:0/4247708944 >> 172.21.15.55:0/4247708944 conn(0x7f51400cde30 msgr2=0x7f51400ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:17.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.194+0000 7f5147b74640 1 -- 172.21.15.55:0/4247708944 shutdown_connections 2023-07-06T22:00:17.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.194+0000 7f5147b74640 1 -- 172.21.15.55:0/4247708944 wait complete. 2023-07-06T22:00:17.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f5147b74640 1 Processor -- start 2023-07-06T22:00:17.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f5147b74640 1 -- start start 2023-07-06T22:00:17.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f5147b74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51400c89b0 0x7f5140153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:17.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f5147b74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51400cbfa0 0x7f51400b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:17.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f5147b74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5140158780 0x7f514015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:17.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f5147b74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5140158bf0 con 0x7f51400cbfa0 2023-07-06T22:00:17.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f5147b74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514015b340 con 0x7f51400c89b0 2023-07-06T22:00:17.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f5147b74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514015b620 con 0x7f5140158780 2023-07-06T22:00:17.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f514510f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51400cbfa0 0x7f51400b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:17.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f514510f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51400cbfa0 0x7f51400b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58428/0 (socket says 172.21.15.55:58428) 2023-07-06T22:00:17.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f514510f640 1 -- 172.21.15.55:0/2575741417 learned_addr learned my addr 172.21.15.55:0/2575741417 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:17.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f5145910640 1 --2- 172.21.15.55:0/2575741417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51400c89b0 0x7f5140153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:17.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f5146111640 1 --2- 172.21.15.55:0/2575741417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5140158780 0x7f514015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:17.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f514510f640 1 -- 172.21.15.55:0/2575741417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5140158780 msgr2=0x7f514015a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:17.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f514510f640 1 --2- 172.21.15.55:0/2575741417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5140158780 0x7f514015a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:17.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f514510f640 1 -- 172.21.15.55:0/2575741417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51400c89b0 msgr2=0x7f5140153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:17.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f514510f640 1 --2- 172.21.15.55:0/2575741417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51400c89b0 0x7f5140153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:17.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f514510f640 1 -- 172.21.15.55:0/2575741417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5130009420 con 0x7f51400cbfa0 2023-07-06T22:00:17.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f514510f640 1 --2- 172.21.15.55:0/2575741417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51400cbfa0 0x7f51400b2000 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f5130019000 tx=0x7f513001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:17.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f51367fc640 1 -- 172.21.15.55:0/2575741417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51300b7650 con 0x7f51400cbfa0 2023-07-06T22:00:17.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f51367fc640 1 -- 172.21.15.55:0/2575741417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51300abe90 con 0x7f51400cbfa0 2023-07-06T22:00:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f51367fc640 1 -- 172.21.15.55:0/2575741417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51300b7a10 con 0x7f51400cbfa0 2023-07-06T22:00:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f5147b74640 1 -- 172.21.15.55:0/2575741417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5140158e90 con 0x7f51400cbfa0 2023-07-06T22:00:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.198+0000 7f5147b74640 1 -- 172.21.15.55:0/2575741417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514015b900 con 0x7f51400cbfa0 2023-07-06T22:00:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.202+0000 7f5147b74640 1 -- 172.21.15.55:0/2575741417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514015c780 con 0x7f51400cbfa0 2023-07-06T22:00:17.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.202+0000 7f51367fc640 1 -- 172.21.15.55:0/2575741417 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f51300b7b70 con 0x7f51400cbfa0 2023-07-06T22:00:17.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.202+0000 7f51367fc640 1 --2- 172.21.15.55:0/2575741417 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f51240663a0 0x7f5124068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:17.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.202+0000 7f51367fc640 1 -- 172.21.15.55:0/2575741417 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f513011e6e0 con 0x7f51400cbfa0 2023-07-06T22:00:17.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.202+0000 7f5145910640 1 --2- 172.21.15.55:0/2575741417 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f51240663a0 0x7f5124068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:17.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.202+0000 7f5145910640 1 --2- 172.21.15.55:0/2575741417 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f51240663a0 0x7f5124068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f513c007fd0 tx=0x7f513c009040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:17.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.206+0000 7f51367fc640 1 -- 172.21.15.55:0/2575741417 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f51300ebc80 con 0x7f51400cbfa0 2023-07-06T22:00:17.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:17.358+0000 7f5147b74640 1 -- 172.21.15.55:0/2575741417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5140066d60 con 0x7f51400cbfa0 2023-07-06T22:00:18.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.078+0000 7f51367fc640 1 -- 172.21.15.55:0/2575741417 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v128) v1 ==== 138+0+0 (secure 0 0 0) 0x7f51300ef2a0 con 0x7f51400cbfa0 2023-07-06T22:00:18.079 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-07-06T22:00:18.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.086+0000 7f5147b74640 1 -- 172.21.15.55:0/2575741417 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f51240663a0 msgr2=0x7f5124068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.086+0000 7f5147b74640 1 --2- 172.21.15.55:0/2575741417 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f51240663a0 0x7f5124068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f513c007fd0 tx=0x7f513c009040 comp rx=0 tx=0).stop 2023-07-06T22:00:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.086+0000 7f5147b74640 1 -- 172.21.15.55:0/2575741417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51400cbfa0 msgr2=0x7f51400b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.086+0000 7f5147b74640 1 --2- 172.21.15.55:0/2575741417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51400cbfa0 0x7f51400b2000 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f5130019000 tx=0x7f513001ac30 comp rx=0 tx=0).stop 2023-07-06T22:00:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.086+0000 7f5147b74640 1 -- 172.21.15.55:0/2575741417 shutdown_connections 2023-07-06T22:00:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.086+0000 7f5147b74640 1 --2- 172.21.15.55:0/2575741417 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f51240663a0 0x7f5124068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.086+0000 7f5147b74640 1 --2- 172.21.15.55:0/2575741417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5140158780 0x7f514015a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.086+0000 7f5147b74640 1 --2- 172.21.15.55:0/2575741417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51400cbfa0 0x7f51400b2000 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.086+0000 7f5147b74640 1 --2- 172.21.15.55:0/2575741417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51400c89b0 0x7f5140153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.086+0000 7f5147b74640 1 -- 172.21.15.55:0/2575741417 >> 172.21.15.55:0/2575741417 conn(0x7f51400cde30 msgr2=0x7f514006fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:18.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.086+0000 7f5147b74640 1 -- 172.21.15.55:0/2575741417 shutdown_connections 2023-07-06T22:00:18.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.086+0000 7f5147b74640 1 -- 172.21.15.55:0/2575741417 wait complete. 2023-07-06T22:00:18.109 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T22:00:18.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.262+0000 7f9ed7bad640 1 Processor -- start 2023-07-06T22:00:18.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.262+0000 7f9ed7bad640 1 -- start start 2023-07-06T22:00:18.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.262+0000 7f9ed7bad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed0159ad0 0x7f9ed006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:18.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.262+0000 7f9ed7bad640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9ed006c380 0x7f9ed006b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:18.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.262+0000 7f9ed7bad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ed0070770 0x7f9ed00693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:18.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.262+0000 7f9ed7bad640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed00c8620 con 0x7f9ed0070770 2023-07-06T22:00:18.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.262+0000 7f9ed7bad640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed00b0d90 con 0x7f9ed006c380 2023-07-06T22:00:18.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.262+0000 7f9ed7bad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed0070c50 con 0x7f9ed0159ad0 2023-07-06T22:00:18.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed614a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ed0070770 0x7f9ed00693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:18.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed614a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ed0070770 0x7f9ed00693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58434/0 (socket says 172.21.15.55:58434) 2023-07-06T22:00:18.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed614a640 1 -- 172.21.15.55:0/1660232122 learned_addr learned my addr 172.21.15.55:0/1660232122 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:18.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed5148640 1 --2- 172.21.15.55:0/1660232122 >> v2:172.21.15.138:3300/0 conn(0x7f9ed006c380 0x7f9ed006b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:18.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed5949640 1 --2- 172.21.15.55:0/1660232122 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed0159ad0 0x7f9ed006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:18.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed614a640 1 -- 172.21.15.55:0/1660232122 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed0159ad0 msgr2=0x7f9ed006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:18.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed614a640 1 --2- 172.21.15.55:0/1660232122 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed0159ad0 0x7f9ed006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:18.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed614a640 1 -- 172.21.15.55:0/1660232122 >> v2:172.21.15.138:3300/0 conn(0x7f9ed006c380 msgr2=0x7f9ed006b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:18.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed614a640 1 --2- 172.21.15.55:0/1660232122 >> v2:172.21.15.138:3300/0 conn(0x7f9ed006c380 0x7f9ed006b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:18.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed614a640 1 -- 172.21.15.55:0/1660232122 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed0070f30 con 0x7f9ed0070770 2023-07-06T22:00:18.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed5949640 1 --2- 172.21.15.55:0/1660232122 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed0159ad0 0x7f9ed006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:18.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed5148640 1 --2- 172.21.15.55:0/1660232122 >> v2:172.21.15.138:3300/0 conn(0x7f9ed006c380 0x7f9ed006b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:18.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed614a640 1 --2- 172.21.15.55:0/1660232122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed0070770 0x7f9ed00693f0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0071c10 tx=0x7f9ec801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df438cff1ab0f5dc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:18.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed4947640 1 -- 172.21.15.55:0/1660232122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec80a5790 con 0x7f9ed0070770 2023-07-06T22:00:18.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed4947640 1 -- 172.21.15.55:0/1660232122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec80a58f0 con 0x7f9ed0070770 2023-07-06T22:00:18.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.266+0000 7f9ed4947640 1 -- 172.21.15.55:0/1660232122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec80a5c80 con 0x7f9ed0070770 2023-07-06T22:00:18.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 -- 172.21.15.55:0/1660232122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed0070770 msgr2=0x7f9ed00693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:18.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 --2- 172.21.15.55:0/1660232122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed0070770 0x7f9ed00693f0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0071c10 tx=0x7f9ec801c910 comp rx=0 tx=0).stop 2023-07-06T22:00:18.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 -- 172.21.15.55:0/1660232122 shutdown_connections 2023-07-06T22:00:18.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 --2- 172.21.15.55:0/1660232122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed0070770 0x7f9ed00693f0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:18.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 --2- 172.21.15.55:0/1660232122 >> v2:172.21.15.138:3300/0 conn(0x7f9ed006c380 0x7f9ed006b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:18.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 --2- 172.21.15.55:0/1660232122 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed0159ad0 0x7f9ed006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:18.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 -- 172.21.15.55:0/1660232122 >> 172.21.15.55:0/1660232122 conn(0x7f9ed00cdf40 msgr2=0x7f9ed00ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:18.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 -- 172.21.15.55:0/1660232122 shutdown_connections 2023-07-06T22:00:18.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 -- 172.21.15.55:0/1660232122 wait complete. 2023-07-06T22:00:18.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 Processor -- start 2023-07-06T22:00:18.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 -- start start 2023-07-06T22:00:18.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed006c380 0x7f9ed0152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:18.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ed0070770 0x7f9ed0149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:18.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed0159ad0 0x7f9ed015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:18.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed015b1b0 con 0x7f9ed006c380 2023-07-06T22:00:18.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed0152570 con 0x7f9ed0070770 2023-07-06T22:00:18.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed7bad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed0151f40 con 0x7f9ed0159ad0 2023-07-06T22:00:18.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed5949640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed006c380 0x7f9ed0152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:18.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed5949640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed006c380 0x7f9ed0152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58448/0 (socket says 172.21.15.55:58448) 2023-07-06T22:00:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed5949640 1 -- 172.21.15.55:0/2663832956 learned_addr learned my addr 172.21.15.55:0/2663832956 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed5148640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ed0070770 0x7f9ed0149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed614a640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed0159ad0 0x7f9ed015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed5949640 1 -- 172.21.15.55:0/2663832956 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed0159ad0 msgr2=0x7f9ed015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed5949640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed0159ad0 0x7f9ed015a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed5949640 1 -- 172.21.15.55:0/2663832956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ed0070770 msgr2=0x7f9ed0149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed5949640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ed0070770 0x7f9ed0149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:18.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed5949640 1 -- 172.21.15.55:0/2663832956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec8009b30 con 0x7f9ed006c380 2023-07-06T22:00:18.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.270+0000 7f9ed5148640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ed0070770 0x7f9ed0149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:18.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.274+0000 7f9ed5949640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed006c380 0x7f9ed0152a00 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00d800 tx=0x7f9ecc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:18.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.274+0000 7f9ec67fc640 1 -- 172.21.15.55:0/2663832956 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00b6c0 con 0x7f9ed006c380 2023-07-06T22:00:18.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.274+0000 7f9ec67fc640 1 -- 172.21.15.55:0/2663832956 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc00b820 con 0x7f9ed006c380 2023-07-06T22:00:18.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.274+0000 7f9ec67fc640 1 -- 172.21.15.55:0/2663832956 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00bbd0 con 0x7f9ed006c380 2023-07-06T22:00:18.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.274+0000 7f9ed7bad640 1 -- 172.21.15.55:0/2663832956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed015c970 con 0x7f9ed006c380 2023-07-06T22:00:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.274+0000 7f9ed7bad640 1 -- 172.21.15.55:0/2663832956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed0152200 con 0x7f9ed006c380 2023-07-06T22:00:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.274+0000 7f9ed7bad640 1 -- 172.21.15.55:0/2663832956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed0066d60 con 0x7f9ed006c380 2023-07-06T22:00:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.274+0000 7f9ec67fc640 1 -- 172.21.15.55:0/2663832956 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9ecc00bd30 con 0x7f9ed006c380 2023-07-06T22:00:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.274+0000 7f9ec67fc640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9eb40663a0 0x7f9eb4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.278+0000 7f9ec67fc640 1 -- 172.21.15.55:0/2663832956 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f9ecc084eb0 con 0x7f9ed006c380 2023-07-06T22:00:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.278+0000 7f9ed5148640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9eb40663a0 0x7f9eb4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.278+0000 7f9ed5148640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9eb40663a0 0x7f9eb4068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9ed014e0d0 tx=0x7f9ec0008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.278+0000 7f9ec67fc640 1 -- 172.21.15.55:0/2663832956 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ecc055cb0 con 0x7f9ed006c380 2023-07-06T22:00:18.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:18.438+0000 7f9ed7bad640 1 -- 172.21.15.55:0/2663832956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9ed006b630 con 0x7f9ed006c380 2023-07-06T22:00:19.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.094+0000 7f9ec67fc640 1 -- 172.21.15.55:0/2663832956 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v129) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9ecc055840 con 0x7f9ed006c380 2023-07-06T22:00:19.096 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-07-06T22:00:19.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.114+0000 7f9ed7bad640 1 -- 172.21.15.55:0/2663832956 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9eb40663a0 msgr2=0x7f9eb4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:19.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.114+0000 7f9ed7bad640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9eb40663a0 0x7f9eb4068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9ed014e0d0 tx=0x7f9ec0008040 comp rx=0 tx=0).stop 2023-07-06T22:00:19.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.114+0000 7f9ed7bad640 1 -- 172.21.15.55:0/2663832956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed006c380 msgr2=0x7f9ed0152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:19.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.114+0000 7f9ed7bad640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed006c380 0x7f9ed0152a00 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00d800 tx=0x7f9ecc00dcc0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.114+0000 7f9ed7bad640 1 -- 172.21.15.55:0/2663832956 shutdown_connections 2023-07-06T22:00:19.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.114+0000 7f9ed7bad640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9eb40663a0 0x7f9eb4068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.114+0000 7f9ed7bad640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed0159ad0 0x7f9ed015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.114+0000 7f9ed7bad640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ed0070770 0x7f9ed0149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.114+0000 7f9ed7bad640 1 --2- 172.21.15.55:0/2663832956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed006c380 0x7f9ed0152a00 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.114+0000 7f9ed7bad640 1 -- 172.21.15.55:0/2663832956 >> 172.21.15.55:0/2663832956 conn(0x7f9ed00cdf40 msgr2=0x7f9ed0150400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:19.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.114+0000 7f9ed7bad640 1 -- 172.21.15.55:0/2663832956 shutdown_connections 2023-07-06T22:00:19.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.114+0000 7f9ed7bad640 1 -- 172.21.15.55:0/2663832956 wait complete. 2023-07-06T22:00:19.137 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T22:00:19.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.286+0000 7f3dd1f2c640 1 Processor -- start 2023-07-06T22:00:19.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.286+0000 7f3dd1f2c640 1 -- start start 2023-07-06T22:00:19.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.286+0000 7f3dd1f2c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3dcc0709a0 0x7f3dcc0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:19.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.286+0000 7f3dd1f2c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3dcc0cbe60 0x7f3dcc0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:19.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.286+0000 7f3dd1f2c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dcc0cc300 con 0x7f3dcc070d70 2023-07-06T22:00:19.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.286+0000 7f3dd1f2c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dcc0cc5e0 con 0x7f3dcc0709a0 2023-07-06T22:00:19.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.286+0000 7f3dd1f2c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dcc0cc8c0 con 0x7f3dcc0cbe60 2023-07-06T22:00:19.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.286+0000 7f3dcb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3dcc0709a0 0x7f3dcc0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:19.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.286+0000 7f3dcb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3dcc0709a0 0x7f3dcc0cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58454/0 (socket says 172.21.15.55:58454) 2023-07-06T22:00:19.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.286+0000 7f3dcb7fe640 1 -- 172.21.15.55:0/1234786004 learned_addr learned my addr 172.21.15.55:0/1234786004 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:19.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.286+0000 7f3dcb7fe640 1 -- 172.21.15.55:0/1234786004 >> v2:172.21.15.138:3300/0 conn(0x7f3dcc0cbe60 msgr2=0x7f3dcc0b0c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T22:00:19.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.286+0000 7f3dcb7fe640 1 --2- 172.21.15.55:0/1234786004 >> v2:172.21.15.138:3300/0 conn(0x7f3dcc0cbe60 0x7f3dcc0b0c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.286+0000 7f3dcb7fe640 1 -- 172.21.15.55:0/1234786004 >> v1:172.21.15.138:6789/0 conn(0x7f3dcc070d70 legacy=0x7f3dcc15d4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T22:00:19.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.286+0000 7f3dcb7fe640 1 -- 172.21.15.55:0/1234786004 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc0ccba0 con 0x7f3dcc0709a0 2023-07-06T22:00:19.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.290+0000 7f3dcb7fe640 1 --2- 172.21.15.55:0/1234786004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dcc0709a0 0x7f3dcc0cb920 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0ca7c0 tx=0x7f3dbc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8924729bcb310baa server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:19.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.290+0000 7f3dca7fc640 1 -- 172.21.15.55:0/1234786004 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0ab600 con 0x7f3dcc0709a0 2023-07-06T22:00:19.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.290+0000 7f3dca7fc640 1 -- 172.21.15.55:0/1234786004 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc0a7050 con 0x7f3dcc0709a0 2023-07-06T22:00:19.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.290+0000 7f3dca7fc640 1 -- 172.21.15.55:0/1234786004 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0ab980 con 0x7f3dcc0709a0 2023-07-06T22:00:19.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.290+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1234786004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dcc0709a0 msgr2=0x7f3dcc0cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:19.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.290+0000 7f3dd1f2c640 1 --2- 172.21.15.55:0/1234786004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dcc0709a0 0x7f3dcc0cb920 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0ca7c0 tx=0x7f3dbc01c4e0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.290+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1234786004 shutdown_connections 2023-07-06T22:00:19.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.290+0000 7f3dd1f2c640 1 --2- 172.21.15.55:0/1234786004 >> v2:172.21.15.138:3300/0 conn(0x7f3dcc0cbe60 0x7f3dcc0b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.290+0000 7f3dd1f2c640 1 --2- 172.21.15.55:0/1234786004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dcc0709a0 0x7f3dcc0cb920 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.290+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1234786004 >> 172.21.15.55:0/1234786004 conn(0x7f3dcc0cea70 msgr2=0x7f3dcc0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:19.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.290+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1234786004 shutdown_connections 2023-07-06T22:00:19.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.290+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1234786004 wait complete. 2023-07-06T22:00:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.290+0000 7f3dd1f2c640 1 Processor -- start 2023-07-06T22:00:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dd1f2c640 1 -- start start 2023-07-06T22:00:19.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dd1f2c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3dcc0709a0 0x7f3dcc1632f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:19.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dd1f2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dcc070d70 0x7f3dcc0c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:19.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dd1f2c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dcc0cbe60 0x7f3dcc15c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:19.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dd1f2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc163be0 con 0x7f3dcc070d70 2023-07-06T22:00:19.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dd1f2c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc0c84d0 con 0x7f3dcc0cbe60 2023-07-06T22:00:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dd1f2c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc0c4790 con 0x7f3dcc0709a0 2023-07-06T22:00:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dcaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dcc070d70 0x7f3dcc0c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dcaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dcc070d70 0x7f3dcc0c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58470/0 (socket says 172.21.15.55:58470) 2023-07-06T22:00:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dcaffd640 1 -- 172.21.15.55:0/1752052624 learned_addr learned my addr 172.21.15.55:0/1752052624 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dcaffd640 1 -- 172.21.15.55:0/1752052624 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3dcc0709a0 msgr2=0x7f3dcc1632f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dcaffd640 1 --2- 172.21.15.55:0/1752052624 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3dcc0709a0 0x7f3dcc1632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dcaffd640 1 -- 172.21.15.55:0/1752052624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dcc0cbe60 msgr2=0x7f3dcc15c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dcaffd640 1 --2- 172.21.15.55:0/1752052624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dcc0cbe60 0x7f3dcc15c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dcaffd640 1 -- 172.21.15.55:0/1752052624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc0094d0 con 0x7f3dcc070d70 2023-07-06T22:00:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dcaffd640 1 --2- 172.21.15.55:0/1752052624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dcc070d70 0x7f3dcc0c4250 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000b3e0 tx=0x7f3dc000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3db3fff640 1 -- 172.21.15.55:0/1752052624 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0011830 con 0x7f3dcc070d70 2023-07-06T22:00:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3db3fff640 1 -- 172.21.15.55:0/1752052624 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc00119b0 con 0x7f3dcc070d70 2023-07-06T22:00:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3db3fff640 1 -- 172.21.15.55:0/1752052624 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0011d60 con 0x7f3dcc070d70 2023-07-06T22:00:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1752052624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dcc163900 con 0x7f3dcc070d70 2023-07-06T22:00:19.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1752052624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dcc0c8a50 con 0x7f3dcc070d70 2023-07-06T22:00:19.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.294+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1752052624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dcc0c8c70 con 0x7f3dcc070d70 2023-07-06T22:00:19.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.298+0000 7f3db3fff640 1 -- 172.21.15.55:0/1752052624 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3dc001a400 con 0x7f3dcc070d70 2023-07-06T22:00:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.298+0000 7f3db3fff640 1 --2- 172.21.15.55:0/1752052624 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f3db80663a0 0x7f3db8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.298+0000 7f3db3fff640 1 -- 172.21.15.55:0/1752052624 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f3dc0084080 con 0x7f3dcc070d70 2023-07-06T22:00:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.298+0000 7f3dcb7fe640 1 --2- 172.21.15.55:0/1752052624 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f3db80663a0 0x7f3db8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.298+0000 7f3dcb7fe640 1 --2- 172.21.15.55:0/1752052624 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f3db80663a0 0x7f3db8068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0ad000 tx=0x7f3dbc008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:19.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.302+0000 7f3db3fff640 1 -- 172.21.15.55:0/1752052624 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3dc00b4700 con 0x7f3dcc070d70 2023-07-06T22:00:19.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.490+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1752052624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3dcc066d60 con 0x7f3dcc070d70 2023-07-06T22:00:19.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.498+0000 7f3db3fff640 1 -- 172.21.15.55:0/1752052624 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v51) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3dc0015020 con 0x7f3dcc070d70 2023-07-06T22:00:19.499 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 16 and data pool 17 2023-07-06T22:00:19.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.506+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1752052624 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f3db80663a0 msgr2=0x7f3db8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:19.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.506+0000 7f3dd1f2c640 1 --2- 172.21.15.55:0/1752052624 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f3db80663a0 0x7f3db8068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0ad000 tx=0x7f3dbc008040 comp rx=0 tx=0).stop 2023-07-06T22:00:19.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.506+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1752052624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dcc070d70 msgr2=0x7f3dcc0c4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:19.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.506+0000 7f3dd1f2c640 1 --2- 172.21.15.55:0/1752052624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dcc070d70 0x7f3dcc0c4250 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000b3e0 tx=0x7f3dc000b8a0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.526+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1752052624 shutdown_connections 2023-07-06T22:00:19.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.526+0000 7f3dd1f2c640 1 --2- 172.21.15.55:0/1752052624 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f3db80663a0 0x7f3db8068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.530+0000 7f3dd1f2c640 1 --2- 172.21.15.55:0/1752052624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dcc0cbe60 0x7f3dcc15c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.530+0000 7f3dd1f2c640 1 --2- 172.21.15.55:0/1752052624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dcc070d70 0x7f3dcc0c4250 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.530+0000 7f3dd1f2c640 1 --2- 172.21.15.55:0/1752052624 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3dcc0709a0 0x7f3dcc1632f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.530+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1752052624 >> 172.21.15.55:0/1752052624 conn(0x7f3dcc0cea70 msgr2=0x7f3dcc069880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:19.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.530+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1752052624 shutdown_connections 2023-07-06T22:00:19.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.530+0000 7f3dd1f2c640 1 -- 172.21.15.55:0/1752052624 wait complete. 2023-07-06T22:00:19.557 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:00:19.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f725d619640 1 Processor -- start 2023-07-06T22:00:19.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f725d619640 1 -- start start 2023-07-06T22:00:19.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f725d619640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f725806f8e0 0x7f725806fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:19.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f725d619640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f725815bc40 0x7f725806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:19.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f725d619640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725815c770 con 0x7f725815cc00 2023-07-06T22:00:19.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f725d619640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725806d4f0 con 0x7f725806f8e0 2023-07-06T22:00:19.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f725d619640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72580701f0 con 0x7f725815bc40 2023-07-06T22:00:19.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f7256ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f725806f8e0 0x7f725806fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:19.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f7256ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f725806f8e0 0x7f725806fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58472/0 (socket says 172.21.15.55:58472) 2023-07-06T22:00:19.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f7256ffd640 1 -- 172.21.15.55:0/1022057791 learned_addr learned my addr 172.21.15.55:0/1022057791 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:19.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f724ffff640 1 --2- 172.21.15.55:0/1022057791 >> v2:172.21.15.138:3300/0 conn(0x7f725815bc40 0x7f725806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:19.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f7256ffd640 1 -- 172.21.15.55:0/1022057791 >> v2:172.21.15.138:3300/0 conn(0x7f725815bc40 msgr2=0x7f725806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:19.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f7256ffd640 1 --2- 172.21.15.55:0/1022057791 >> v2:172.21.15.138:3300/0 conn(0x7f725815bc40 0x7f725806c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f7256ffd640 1 -- 172.21.15.55:0/1022057791 >> v1:172.21.15.55:6789/0 conn(0x7f725815cc00 legacy=0x7f72580693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:19.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.702+0000 7f7256ffd640 1 -- 172.21.15.55:0/1022057791 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725806d210 con 0x7f725806f8e0 2023-07-06T22:00:19.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.706+0000 7f7256ffd640 1 --2- 172.21.15.55:0/1022057791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f725806f8e0 0x7f725806fcb0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f7248009870 tx=0x7f724801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cee65bcfb20cba server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:19.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.706+0000 7f72567fc640 1 -- 172.21.15.55:0/1022057791 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480aa430 con 0x7f725806f8e0 2023-07-06T22:00:19.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.706+0000 7f72567fc640 1 -- 172.21.15.55:0/1022057791 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72480aa590 con 0x7f725806f8e0 2023-07-06T22:00:19.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.706+0000 7f72567fc640 1 -- 172.21.15.55:0/1022057791 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480aa920 con 0x7f725806f8e0 2023-07-06T22:00:19.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.706+0000 7f725d619640 1 -- 172.21.15.55:0/1022057791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f725806f8e0 msgr2=0x7f725806fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:19.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.706+0000 7f725d619640 1 --2- 172.21.15.55:0/1022057791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f725806f8e0 0x7f725806fcb0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f7248009870 tx=0x7f724801c4d0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.706+0000 7f725d619640 1 -- 172.21.15.55:0/1022057791 shutdown_connections 2023-07-06T22:00:19.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.706+0000 7f725d619640 1 --2- 172.21.15.55:0/1022057791 >> v2:172.21.15.138:3300/0 conn(0x7f725815bc40 0x7f725806c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.706+0000 7f725d619640 1 --2- 172.21.15.55:0/1022057791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f725806f8e0 0x7f725806fcb0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.706+0000 7f725d619640 1 -- 172.21.15.55:0/1022057791 >> 172.21.15.55:0/1022057791 conn(0x7f72580cbd80 msgr2=0x7f72580ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:19.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.706+0000 7f725d619640 1 -- 172.21.15.55:0/1022057791 shutdown_connections 2023-07-06T22:00:19.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.706+0000 7f725d619640 1 -- 172.21.15.55:0/1022057791 wait complete. 2023-07-06T22:00:19.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f725d619640 1 Processor -- start 2023-07-06T22:00:19.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f725d619640 1 -- start start 2023-07-06T22:00:19.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f725d619640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f725806f8e0 0x7f72581503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:19.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f725d619640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f725815bc40 0x7f72580ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:19.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f725d619640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f725815cc00 0x7f725814fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:19.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f725d619640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7258151680 con 0x7f725806f8e0 2023-07-06T22:00:19.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f725d619640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7258150a00 con 0x7f725815bc40 2023-07-06T22:00:19.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f725d619640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7258150ce0 con 0x7f725815cc00 2023-07-06T22:00:19.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f7256ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f725806f8e0 0x7f72581503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:19.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f7256ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f725806f8e0 0x7f72581503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58476/0 (socket says 172.21.15.55:58476) 2023-07-06T22:00:19.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f7256ffd640 1 -- 172.21.15.55:0/2060055915 learned_addr learned my addr 172.21.15.55:0/2060055915 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:19.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f7256ffd640 1 -- 172.21.15.55:0/2060055915 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f725815cc00 msgr2=0x7f725814fb80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T22:00:19.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f7256ffd640 1 --2- 172.21.15.55:0/2060055915 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f725815cc00 0x7f725814fb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f7256ffd640 1 -- 172.21.15.55:0/2060055915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f725815bc40 msgr2=0x7f72580ac890 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T22:00:19.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f7256ffd640 1 --2- 172.21.15.55:0/2060055915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f725815bc40 0x7f72580ac890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f7256ffd640 1 -- 172.21.15.55:0/2060055915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72480094d0 con 0x7f725806f8e0 2023-07-06T22:00:19.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f7256ffd640 1 --2- 172.21.15.55:0/2060055915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f725806f8e0 0x7f72581503d0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f72480ac040 tx=0x7f724801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:19.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f724f7fe640 1 -- 172.21.15.55:0/2060055915 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480aa430 con 0x7f725806f8e0 2023-07-06T22:00:19.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f724f7fe640 1 -- 172.21.15.55:0/2060055915 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72480b3820 con 0x7f725806f8e0 2023-07-06T22:00:19.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f724f7fe640 1 -- 172.21.15.55:0/2060055915 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480b3bd0 con 0x7f725806f8e0 2023-07-06T22:00:19.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f725d619640 1 -- 172.21.15.55:0/2060055915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7258150fc0 con 0x7f725806f8e0 2023-07-06T22:00:19.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.710+0000 7f725d619640 1 -- 172.21.15.55:0/2060055915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72580acdd0 con 0x7f725806f8e0 2023-07-06T22:00:19.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.714+0000 7f725d619640 1 -- 172.21.15.55:0/2060055915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725806fcb0 con 0x7f725806f8e0 2023-07-06T22:00:19.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.714+0000 7f724f7fe640 1 -- 172.21.15.55:0/2060055915 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f72480b3d30 con 0x7f725806f8e0 2023-07-06T22:00:19.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.714+0000 7f724f7fe640 1 --2- 172.21.15.55:0/2060055915 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f72380663a0 0x7f7238068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:19.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.714+0000 7f724f7fe640 1 -- 172.21.15.55:0/2060055915 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f724811e5a0 con 0x7f725806f8e0 2023-07-06T22:00:19.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.714+0000 7f724ffff640 1 --2- 172.21.15.55:0/2060055915 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f72380663a0 0x7f7238068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:19.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.714+0000 7f724ffff640 1 --2- 172.21.15.55:0/2060055915 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f72380663a0 0x7f7238068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f72580abb40 tx=0x7f7240009190 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:19.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.718+0000 7f724f7fe640 1 -- 172.21.15.55:0/2060055915 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72480eb790 con 0x7f725806f8e0 2023-07-06T22:00:19.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.874+0000 7f725d619640 1 -- 172.21.15.55:0/2060055915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7258066d60 con 0x7f725806f8e0 2023-07-06T22:00:19.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.874+0000 7f724f7fe640 1 -- 172.21.15.55:0/2060055915 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+18515 (secure 0 0 0) 0x7f72480eedb0 con 0x7f725806f8e0 2023-07-06T22:00:19.876 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:19.876 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":130,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:00:19.496245+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:00:17.410451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-07-06T22:00:18.487297+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:00:19.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.878+0000 7f725d619640 1 -- 172.21.15.55:0/2060055915 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f72380663a0 msgr2=0x7f7238068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:19.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.878+0000 7f725d619640 1 --2- 172.21.15.55:0/2060055915 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f72380663a0 0x7f7238068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f72580abb40 tx=0x7f7240009190 comp rx=0 tx=0).stop 2023-07-06T22:00:19.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.878+0000 7f725d619640 1 -- 172.21.15.55:0/2060055915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f725806f8e0 msgr2=0x7f72581503d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:19.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.878+0000 7f725d619640 1 --2- 172.21.15.55:0/2060055915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f725806f8e0 0x7f72581503d0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f72480ac040 tx=0x7f724801ad10 comp rx=0 tx=0).stop 2023-07-06T22:00:19.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.878+0000 7f725d619640 1 -- 172.21.15.55:0/2060055915 shutdown_connections 2023-07-06T22:00:19.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.878+0000 7f725d619640 1 --2- 172.21.15.55:0/2060055915 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f72380663a0 0x7f7238068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.878+0000 7f725d619640 1 --2- 172.21.15.55:0/2060055915 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f725815cc00 0x7f725814fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.878+0000 7f725d619640 1 --2- 172.21.15.55:0/2060055915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f725815bc40 0x7f72580ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.878+0000 7f725d619640 1 --2- 172.21.15.55:0/2060055915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f725806f8e0 0x7f72581503d0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:19.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.878+0000 7f725d619640 1 -- 172.21.15.55:0/2060055915 >> 172.21.15.55:0/2060055915 conn(0x7f72580cbd80 msgr2=0x7f725815d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:19.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.878+0000 7f725d619640 1 -- 172.21.15.55:0/2060055915 shutdown_connections 2023-07-06T22:00:19.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:19.878+0000 7f725d619640 1 -- 172.21.15.55:0/2060055915 wait complete. 2023-07-06T22:00:19.897 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:00:20.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.038+0000 7ff5e5dfa640 1 Processor -- start 2023-07-06T22:00:20.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.038+0000 7ff5e5dfa640 1 -- start start 2023-07-06T22:00:20.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.042+0000 7ff5e5dfa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5e00cb4a0 0x7ff5e015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:20.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.042+0000 7ff5e5dfa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5e00cbc70 0x7ff5e00cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:20.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.042+0000 7ff5e5dfa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e00b5b50 con 0x7ff5e015f740 2023-07-06T22:00:20.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.042+0000 7ff5e5dfa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e015d130 con 0x7ff5e00cb4a0 2023-07-06T22:00:20.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.042+0000 7ff5e5dfa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e00cc5e0 con 0x7ff5e00cbc70 2023-07-06T22:00:20.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.042+0000 7ff5df7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5e00cb4a0 0x7ff5e015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:20.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.042+0000 7ff5df7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5e00cb4a0 0x7ff5e015cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58492/0 (socket says 172.21.15.55:58492) 2023-07-06T22:00:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.042+0000 7ff5df7fe640 1 -- 172.21.15.55:0/72474741 learned_addr learned my addr 172.21.15.55:0/72474741 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.042+0000 7ff5dffff640 1 --2- 172.21.15.55:0/72474741 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5e00cbc70 0x7ff5e00cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.042+0000 7ff5df7fe640 1 -- 172.21.15.55:0/72474741 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5e00cbc70 msgr2=0x7ff5e00cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.042+0000 7ff5df7fe640 1 --2- 172.21.15.55:0/72474741 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5e00cbc70 0x7ff5e00cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.042+0000 7ff5df7fe640 1 -- 172.21.15.55:0/72474741 >> v1:172.21.15.138:6789/0 conn(0x7ff5e015f740 legacy=0x7ff5e00ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.042+0000 7ff5df7fe640 1 -- 172.21.15.55:0/72474741 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e00cc8e0 con 0x7ff5e00cb4a0 2023-07-06T22:00:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.042+0000 7ff5dffff640 1 --2- 172.21.15.55:0/72474741 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5e00cbc70 0x7ff5e00cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:20.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.046+0000 7ff5df7fe640 1 --2- 172.21.15.55:0/72474741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5e00cb4a0 0x7ff5e015cbf0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009870 tx=0x7ff5d001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2408c6b2e9d40c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:20.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.046+0000 7ff5de7fc640 1 -- 172.21.15.55:0/72474741 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00a7070 con 0x7ff5e00cb4a0 2023-07-06T22:00:20.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.046+0000 7ff5de7fc640 1 -- 172.21.15.55:0/72474741 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d00ab430 con 0x7ff5e00cb4a0 2023-07-06T22:00:20.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.046+0000 7ff5de7fc640 1 -- 172.21.15.55:0/72474741 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00ab7c0 con 0x7ff5e00cb4a0 2023-07-06T22:00:20.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.046+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/72474741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5e00cb4a0 msgr2=0x7ff5e015cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.046+0000 7ff5e5dfa640 1 --2- 172.21.15.55:0/72474741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5e00cb4a0 0x7ff5e015cbf0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009870 tx=0x7ff5d001c540 comp rx=0 tx=0).stop 2023-07-06T22:00:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.046+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/72474741 shutdown_connections 2023-07-06T22:00:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.046+0000 7ff5e5dfa640 1 --2- 172.21.15.55:0/72474741 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5e00cbc70 0x7ff5e00cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.046+0000 7ff5e5dfa640 1 --2- 172.21.15.55:0/72474741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5e00cb4a0 0x7ff5e015cbf0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.046+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/72474741 >> 172.21.15.55:0/72474741 conn(0x7ff5e006ee80 msgr2=0x7ff5e006f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.046+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/72474741 shutdown_connections 2023-07-06T22:00:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.046+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/72474741 wait complete. 2023-07-06T22:00:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.046+0000 7ff5e5dfa640 1 Processor -- start 2023-07-06T22:00:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.046+0000 7ff5e5dfa640 1 -- start start 2023-07-06T22:00:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5e5dfa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5e00cb4a0 0x7ff5e01573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5e5dfa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5e00cbc70 0x7ff5e00c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5e5dfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5e015f740 0x7ff5e00c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5e5dfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e00c8680 con 0x7ff5e015f740 2023-07-06T22:00:20.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5e5dfa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e00ca2c0 con 0x7ff5e00cbc70 2023-07-06T22:00:20.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5e5dfa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e00c7d50 con 0x7ff5e00cb4a0 2023-07-06T22:00:20.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5e015f740 0x7ff5e00c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:20.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5e015f740 0x7ff5e00c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58504/0 (socket says 172.21.15.55:58504) 2023-07-06T22:00:20.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5dffff640 1 -- 172.21.15.55:0/2628216514 learned_addr learned my addr 172.21.15.55:0/2628216514 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:20.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5deffd640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5e00cbc70 0x7ff5e00c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:20.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5df7fe640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5e00cb4a0 0x7ff5e01573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:20.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5dffff640 1 -- 172.21.15.55:0/2628216514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5e00cb4a0 msgr2=0x7ff5e01573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:20.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5dffff640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5e00cb4a0 0x7ff5e01573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5dffff640 1 -- 172.21.15.55:0/2628216514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5e00cbc70 msgr2=0x7ff5e00c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:20.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5dffff640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5e00cbc70 0x7ff5e00c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5dffff640 1 -- 172.21.15.55:0/2628216514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d00094d0 con 0x7ff5e015f740 2023-07-06T22:00:20.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5df7fe640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5e00cb4a0 0x7ff5e01573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:20.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5dffff640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5e015f740 0x7ff5e00c99e0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8007ef0 tx=0x7ff5d800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:20.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5c7fff640 1 -- 172.21.15.55:0/2628216514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8003ba0 con 0x7ff5e015f740 2023-07-06T22:00:20.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5c7fff640 1 -- 172.21.15.55:0/2628216514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d800f040 con 0x7ff5e015f740 2023-07-06T22:00:20.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/2628216514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e00c8030 con 0x7ff5e015f740 2023-07-06T22:00:20.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5c7fff640 1 -- 172.21.15.55:0/2628216514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d800de80 con 0x7ff5e015f740 2023-07-06T22:00:20.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/2628216514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e00c9f20 con 0x7ff5e015f740 2023-07-06T22:00:20.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/2628216514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e00c87f0 con 0x7ff5e015f740 2023-07-06T22:00:20.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.050+0000 7ff5c7fff640 1 -- 172.21.15.55:0/2628216514 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff5d8004030 con 0x7ff5e015f740 2023-07-06T22:00:20.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.054+0000 7ff5c7fff640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff5cc0663a0 0x7ff5cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:20.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.054+0000 7ff5c7fff640 1 -- 172.21.15.55:0/2628216514 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff5d80843e0 con 0x7ff5e015f740 2023-07-06T22:00:20.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.054+0000 7ff5df7fe640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff5cc0663a0 0x7ff5cc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:20.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.054+0000 7ff5df7fe640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff5cc0663a0 0x7ff5cc068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00af000 tx=0x7ff5d0008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:20.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.058+0000 7ff5c7fff640 1 -- 172.21.15.55:0/2628216514 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5d80515b0 con 0x7ff5e015f740 2023-07-06T22:00:20.061 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-07-06T22:00:20.062+0000 7fd26bfa4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T22:00:20.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.214+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/2628216514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5e006e730 con 0x7ff5e015f740 2023-07-06T22:00:20.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.214+0000 7ff5c7fff640 1 -- 172.21.15.55:0/2628216514 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+18515 (secure 0 0 0) 0x7ff5d8054bd0 con 0x7ff5e015f740 2023-07-06T22:00:20.215 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:20.215 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":130,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:00:19.496245+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:00:17.410451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-07-06T22:00:18.487297+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:00:20.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.218+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/2628216514 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff5cc0663a0 msgr2=0x7ff5cc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:20.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.218+0000 7ff5e5dfa640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff5cc0663a0 0x7ff5cc068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00af000 tx=0x7ff5d0008040 comp rx=0 tx=0).stop 2023-07-06T22:00:20.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.218+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/2628216514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5e015f740 msgr2=0x7ff5e00c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:20.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.218+0000 7ff5e5dfa640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5e015f740 0x7ff5e00c99e0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8007ef0 tx=0x7ff5d800d4a0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.218+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/2628216514 shutdown_connections 2023-07-06T22:00:20.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.218+0000 7ff5e5dfa640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff5cc0663a0 0x7ff5cc068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.218+0000 7ff5e5dfa640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5e015f740 0x7ff5e00c99e0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.218+0000 7ff5e5dfa640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5e00cbc70 0x7ff5e00c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.218+0000 7ff5e5dfa640 1 --2- 172.21.15.55:0/2628216514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5e00cb4a0 0x7ff5e01573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.218+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/2628216514 >> 172.21.15.55:0/2628216514 conn(0x7ff5e006ee80 msgr2=0x7ff5e00cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:20.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.218+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/2628216514 shutdown_connections 2023-07-06T22:00:20.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.218+0000 7ff5e5dfa640 1 -- 172.21.15.55:0/2628216514 wait complete. 2023-07-06T22:00:20.237 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T22:00:20.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5be6c0b640 1 Processor -- start 2023-07-06T22:00:20.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5be6c0b640 1 -- start start 2023-07-06T22:00:20.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5be6c0b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5be0158850 0x7f5be00cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:20.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5be6c0b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5be00ca130 0x7f5be00ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:20.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5be6c0b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be00b2aa0 con 0x7f5be00703e0 2023-07-06T22:00:20.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5be6c0b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be0158c20 con 0x7f5be00ca130 2023-07-06T22:00:20.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5be6c0b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be00c8db0 con 0x7f5be0158850 2023-07-06T22:00:20.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5bdffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5be00ca130 0x7f5be00ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:20.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5bdffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5be00ca130 0x7f5be00ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58516/0 (socket says 172.21.15.55:58516) 2023-07-06T22:00:20.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5bdffff640 1 -- 172.21.15.55:0/3223470706 learned_addr learned my addr 172.21.15.55:0/3223470706 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:20.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5bdffff640 1 -- 172.21.15.55:0/3223470706 >> v2:172.21.15.138:3300/0 conn(0x7f5be0158850 msgr2=0x7f5be00cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:20.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5bdffff640 1 --2- 172.21.15.55:0/3223470706 >> v2:172.21.15.138:3300/0 conn(0x7f5be0158850 0x7f5be00cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5bdffff640 1 -- 172.21.15.55:0/3223470706 >> v1:172.21.15.55:6789/0 conn(0x7f5be00703e0 legacy=0x7f5be006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:20.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5bdffff640 1 -- 172.21.15.55:0/3223470706 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be00c9090 con 0x7f5be00ca130 2023-07-06T22:00:20.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.386+0000 7f5bdf7fe640 1 -- 172.21.15.55:0/3223470706 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152039130 0 0) 0x7f5be00b2aa0 con 0x7f5be00703e0 2023-07-06T22:00:20.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.390+0000 7f5bdffff640 1 --2- 172.21.15.55:0/3223470706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5be00ca130 0x7f5be00ccf70 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f5be006eaf0 tx=0x7f5bcc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9a1293f00ef213 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:20.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.390+0000 7f5bdf7fe640 1 -- 172.21.15.55:0/3223470706 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0aa430 con 0x7f5be00ca130 2023-07-06T22:00:20.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.390+0000 7f5bdf7fe640 1 -- 172.21.15.55:0/3223470706 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc0aa590 con 0x7f5be00ca130 2023-07-06T22:00:20.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.390+0000 7f5bdf7fe640 1 -- 172.21.15.55:0/3223470706 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0aa920 con 0x7f5be00ca130 2023-07-06T22:00:20.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.390+0000 7f5be6c0b640 1 -- 172.21.15.55:0/3223470706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5be00ca130 msgr2=0x7f5be00ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:20.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.390+0000 7f5be6c0b640 1 --2- 172.21.15.55:0/3223470706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5be00ca130 0x7f5be00ccf70 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f5be006eaf0 tx=0x7f5bcc01c4d0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.390+0000 7f5be6c0b640 1 -- 172.21.15.55:0/3223470706 shutdown_connections 2023-07-06T22:00:20.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.390+0000 7f5be6c0b640 1 --2- 172.21.15.55:0/3223470706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5be00ca130 0x7f5be00ccf70 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.390+0000 7f5be6c0b640 1 --2- 172.21.15.55:0/3223470706 >> v2:172.21.15.138:3300/0 conn(0x7f5be0158850 0x7f5be00cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.390+0000 7f5be6c0b640 1 -- 172.21.15.55:0/3223470706 >> 172.21.15.55:0/3223470706 conn(0x7f5be00cea70 msgr2=0x7f5be00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:20.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.390+0000 7f5be6c0b640 1 -- 172.21.15.55:0/3223470706 shutdown_connections 2023-07-06T22:00:20.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.390+0000 7f5be6c0b640 1 -- 172.21.15.55:0/3223470706 wait complete. 2023-07-06T22:00:20.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be6c0b640 1 Processor -- start 2023-07-06T22:00:20.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be6c0b640 1 -- start start 2023-07-06T22:00:20.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be6c0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5be00703e0 0x7f5be0154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:20.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be6c0b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5be00ca130 0x7f5be00c3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:20.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be6c0b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5be0158850 0x7f5be01f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:20.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be6c0b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be0153360 con 0x7f5be0158850 2023-07-06T22:00:20.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be6c0b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be0153640 con 0x7f5be00ca130 2023-07-06T22:00:20.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be6c0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be0153920 con 0x7f5be00703e0 2023-07-06T22:00:20.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be51a8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5be0158850 0x7f5be01f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:20.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be51a8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5be0158850 0x7f5be01f4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58530/0 (socket says 172.21.15.55:58530) 2023-07-06T22:00:20.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be51a8640 1 -- 172.21.15.55:0/2419280483 learned_addr learned my addr 172.21.15.55:0/2419280483 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:20.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be49a7640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5be00703e0 0x7f5be0154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:20.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5bdffff640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5be00ca130 0x7f5be00c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:20.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be51a8640 1 -- 172.21.15.55:0/2419280483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5be00703e0 msgr2=0x7f5be0154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:20.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be51a8640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5be00703e0 0x7f5be0154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be51a8640 1 -- 172.21.15.55:0/2419280483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5be00ca130 msgr2=0x7f5be00c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:20.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be51a8640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5be00ca130 0x7f5be00c3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:20.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be51a8640 1 -- 172.21.15.55:0/2419280483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc0094d0 con 0x7f5be0158850 2023-07-06T22:00:20.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5bdffff640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5be00ca130 0x7f5be00c3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:20.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be49a7640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5be00703e0 0x7f5be0154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:20.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be51a8640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5be0158850 0x7f5be01f4350 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800c780 tx=0x7f5bd800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:20.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5bdd7fa640 1 -- 172.21.15.55:0/2419280483 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8003db0 con 0x7f5be0158850 2023-07-06T22:00:20.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5bdd7fa640 1 -- 172.21.15.55:0/2419280483 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd800ce90 con 0x7f5be0158850 2023-07-06T22:00:20.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5bdd7fa640 1 -- 172.21.15.55:0/2419280483 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80052b0 con 0x7f5be0158850 2023-07-06T22:00:20.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be6c0b640 1 -- 172.21.15.55:0/2419280483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be0153c00 con 0x7f5be0158850 2023-07-06T22:00:20.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be6c0b640 1 -- 172.21.15.55:0/2419280483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be0152900 con 0x7f5be0158850 2023-07-06T22:00:20.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.394+0000 7f5be6c0b640 1 -- 172.21.15.55:0/2419280483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be0066d60 con 0x7f5be0158850 2023-07-06T22:00:20.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.398+0000 7f5bdd7fa640 1 -- 172.21.15.55:0/2419280483 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5bd8005410 con 0x7f5be0158850 2023-07-06T22:00:20.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.398+0000 7f5bdd7fa640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5bc40663a0 0x7f5bc4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:20.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.398+0000 7f5bdd7fa640 1 -- 172.21.15.55:0/2419280483 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5bd8083eb0 con 0x7f5be0158850 2023-07-06T22:00:20.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.398+0000 7f5be49a7640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5bc40663a0 0x7f5bc4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:20.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.398+0000 7f5be49a7640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5bc40663a0 0x7f5bc4068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400a870 tx=0x7f5bd4008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:20.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.402+0000 7f5bdd7fa640 1 -- 172.21.15.55:0/2419280483 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5bd8051040 con 0x7f5be0158850 2023-07-06T22:00:20.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:20.594+0000 7f5be6c0b640 1 -- 172.21.15.55:0/2419280483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5be01540b0 con 0x7f5be0158850 2023-07-06T22:00:21.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.514+0000 7f5bdd7fa640 1 -- 172.21.15.55:0/2419280483 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5bd8054660 con 0x7f5be0158850 2023-07-06T22:00:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.518+0000 7f5be6c0b640 1 -- 172.21.15.55:0/2419280483 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5bc40663a0 msgr2=0x7f5bc4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:21.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.518+0000 7f5be6c0b640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5bc40663a0 0x7f5bc4068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400a870 tx=0x7f5bd4008040 comp rx=0 tx=0).stop 2023-07-06T22:00:21.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.518+0000 7f5be6c0b640 1 -- 172.21.15.55:0/2419280483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5be0158850 msgr2=0x7f5be01f4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:21.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.518+0000 7f5be6c0b640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5be0158850 0x7f5be01f4350 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800c780 tx=0x7f5bd800cc40 comp rx=0 tx=0).stop 2023-07-06T22:00:21.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.518+0000 7f5be6c0b640 1 -- 172.21.15.55:0/2419280483 shutdown_connections 2023-07-06T22:00:21.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.518+0000 7f5be6c0b640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5bc40663a0 0x7f5bc4068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:21.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.518+0000 7f5be6c0b640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5be0158850 0x7f5be01f4350 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:21.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.518+0000 7f5be6c0b640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5be00ca130 0x7f5be00c3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:21.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.518+0000 7f5be6c0b640 1 --2- 172.21.15.55:0/2419280483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5be00703e0 0x7f5be0154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:21.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.518+0000 7f5be6c0b640 1 -- 172.21.15.55:0/2419280483 >> 172.21.15.55:0/2419280483 conn(0x7f5be00cea70 msgr2=0x7f5be0151a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:21.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.518+0000 7f5be6c0b640 1 -- 172.21.15.55:0/2419280483 shutdown_connections 2023-07-06T22:00:21.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.518+0000 7f5be6c0b640 1 -- 172.21.15.55:0/2419280483 wait complete. 2023-07-06T22:00:21.540 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-06T22:00:21.540 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T22:00:21.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.690+0000 7f9aa089c640 1 Processor -- start 2023-07-06T22:00:21.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.690+0000 7f9aa089c640 1 -- start start 2023-07-06T22:00:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.690+0000 7f9aa089c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9a9c15ba30 0x7f9a9c0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.690+0000 7f9aa089c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9a9c0ad0c0 0x7f9a9c09ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.690+0000 7f9aa089c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a9c09d780 con 0x7f9a9c09d340 2023-07-06T22:00:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.690+0000 7f9aa089c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a9c0c83a0 con 0x7f9a9c0ad0c0 2023-07-06T22:00:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.690+0000 7f9aa089c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a9c0ccbb0 con 0x7f9a9c15ba30 2023-07-06T22:00:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.690+0000 7f9a93fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9a9c0ad0c0 0x7f9a9c09ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.690+0000 7f9a9ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9a9c09d340 0x7f9a9c15f6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44624/0 (socket says 172.21.15.55:44624) 2023-07-06T22:00:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.690+0000 7f9a9ad9d640 1 -- 172.21.15.55:0/2523053510 learned_addr learned my addr 172.21.15.55:0/2523053510 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.694+0000 7f9a93fff640 1 -- 172.21.15.55:0/2523053510 >> v2:172.21.15.138:3300/0 conn(0x7f9a9c15ba30 msgr2=0x7f9a9c0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.694+0000 7f9a93fff640 1 --2- 172.21.15.55:0/2523053510 >> v2:172.21.15.138:3300/0 conn(0x7f9a9c15ba30 0x7f9a9c0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.694+0000 7f9a93fff640 1 -- 172.21.15.55:0/2523053510 >> v1:172.21.15.55:6789/0 conn(0x7f9a9c09d340 legacy=0x7f9a9c15f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.694+0000 7f9a93fff640 1 -- 172.21.15.55:0/2523053510 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c0cce90 con 0x7f9a9c0ad0c0 2023-07-06T22:00:21.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.694+0000 7f9a99d9b640 1 -- 172.21.15.55:0/2523053510 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373923269 0 0) 0x7f9a9c09d780 con 0x7f9a9c09d340 2023-07-06T22:00:21.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.694+0000 7f9a93fff640 1 --2- 172.21.15.55:0/2523053510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a9c0ad0c0 0x7f9a9c09ce00 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c06eb40 tx=0x7f9a8401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51ce7a6e4e8d65d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:21.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.694+0000 7f9a99d9b640 1 -- 172.21.15.55:0/2523053510 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a840a7070 con 0x7f9a9c0ad0c0 2023-07-06T22:00:21.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.694+0000 7f9a99d9b640 1 -- 172.21.15.55:0/2523053510 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a840ab430 con 0x7f9a9c0ad0c0 2023-07-06T22:00:21.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.694+0000 7f9a99d9b640 1 -- 172.21.15.55:0/2523053510 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a840ab7c0 con 0x7f9a9c0ad0c0 2023-07-06T22:00:21.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.694+0000 7f9aa089c640 1 -- 172.21.15.55:0/2523053510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a9c0ad0c0 msgr2=0x7f9a9c09ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:21.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.694+0000 7f9aa089c640 1 --2- 172.21.15.55:0/2523053510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a9c0ad0c0 0x7f9a9c09ce00 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c06eb40 tx=0x7f9a8401c430 comp rx=0 tx=0).stop 2023-07-06T22:00:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9aa089c640 1 -- 172.21.15.55:0/2523053510 shutdown_connections 2023-07-06T22:00:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9aa089c640 1 --2- 172.21.15.55:0/2523053510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a9c0ad0c0 0x7f9a9c09ce00 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9aa089c640 1 --2- 172.21.15.55:0/2523053510 >> v2:172.21.15.138:3300/0 conn(0x7f9a9c15ba30 0x7f9a9c0cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9aa089c640 1 -- 172.21.15.55:0/2523053510 >> 172.21.15.55:0/2523053510 conn(0x7f9a9c0cea70 msgr2=0x7f9a9c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9aa089c640 1 -- 172.21.15.55:0/2523053510 shutdown_connections 2023-07-06T22:00:21.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9aa089c640 1 -- 172.21.15.55:0/2523053510 wait complete. 2023-07-06T22:00:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9aa089c640 1 Processor -- start 2023-07-06T22:00:21.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9aa089c640 1 -- start start 2023-07-06T22:00:21.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9aa089c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a9c09d340 0x7f9a9c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:21.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9aa089c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a9c0ad0c0 0x7f9a9c152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9aa089c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a9c15ba30 0x7f9a9c0b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9aa089c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c153480 con 0x7f9a9c09d340 2023-07-06T22:00:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9aa089c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c070480 con 0x7f9a9c0ad0c0 2023-07-06T22:00:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9aa089c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c153110 con 0x7f9a9c15ba30 2023-07-06T22:00:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9a9a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a9c09d340 0x7f9a9c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:21.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9a9a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a9c09d340 0x7f9a9c06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58540/0 (socket says 172.21.15.55:58540) 2023-07-06T22:00:21.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9a9a59c640 1 -- 172.21.15.55:0/1632914307 learned_addr learned my addr 172.21.15.55:0/1632914307 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:21.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9a93fff640 1 --2- 172.21.15.55:0/1632914307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a9c0ad0c0 0x7f9a9c152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:21.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9a9ad9d640 1 --2- 172.21.15.55:0/1632914307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a9c15ba30 0x7f9a9c0b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:21.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9a9a59c640 1 -- 172.21.15.55:0/1632914307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a9c15ba30 msgr2=0x7f9a9c0b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:21.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9a9a59c640 1 --2- 172.21.15.55:0/1632914307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a9c15ba30 0x7f9a9c0b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:21.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9a9a59c640 1 -- 172.21.15.55:0/1632914307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a9c0ad0c0 msgr2=0x7f9a9c152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:21.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9a9a59c640 1 --2- 172.21.15.55:0/1632914307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a9c0ad0c0 0x7f9a9c152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:21.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9a9a59c640 1 -- 172.21.15.55:0/1632914307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a84009420 con 0x7f9a9c09d340 2023-07-06T22:00:21.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.698+0000 7f9a9a59c640 1 --2- 172.21.15.55:0/1632914307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a9c09d340 0x7f9a9c06ff40 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00b410 tx=0x7f9a8c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:21.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.702+0000 7f9a92ffd640 1 -- 172.21.15.55:0/1632914307 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c011830 con 0x7f9a9c09d340 2023-07-06T22:00:21.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.702+0000 7f9a92ffd640 1 -- 172.21.15.55:0/1632914307 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c011990 con 0x7f9a9c09d340 2023-07-06T22:00:21.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.702+0000 7f9a92ffd640 1 -- 172.21.15.55:0/1632914307 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c011d40 con 0x7f9a9c09d340 2023-07-06T22:00:21.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.702+0000 7f9aa089c640 1 -- 172.21.15.55:0/1632914307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9c0b1bd0 con 0x7f9a9c09d340 2023-07-06T22:00:21.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.702+0000 7f9aa089c640 1 -- 172.21.15.55:0/1632914307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9c0c7cd0 con 0x7f9a9c09d340 2023-07-06T22:00:21.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.702+0000 7f9aa089c640 1 -- 172.21.15.55:0/1632914307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9c1535c0 con 0x7f9a9c09d340 2023-07-06T22:00:21.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.702+0000 7f9a92ffd640 1 -- 172.21.15.55:0/1632914307 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9a8c01a400 con 0x7f9a9c09d340 2023-07-06T22:00:21.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.702+0000 7f9a92ffd640 1 --2- 172.21.15.55:0/1632914307 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9a7c0663a0 0x7f9a7c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:21.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.702+0000 7f9a92ffd640 1 -- 172.21.15.55:0/1632914307 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9a8c084170 con 0x7f9a9c09d340 2023-07-06T22:00:21.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.702+0000 7f9a93fff640 1 --2- 172.21.15.55:0/1632914307 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9a7c0663a0 0x7f9a7c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.706+0000 7f9a93fff640 1 --2- 172.21.15.55:0/1632914307 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9a7c0663a0 0x7f9a7c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a840af000 tx=0x7f9a840a7000 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:21.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.706+0000 7f9a92ffd640 1 -- 172.21.15.55:0/1632914307 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a9c1535c0 con 0x7f9a9c09d340 2023-07-06T22:00:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:21.894+0000 7f9aa089c640 1 -- 172.21.15.55:0/1632914307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9a9c1535c0 con 0x7f9a9c09d340 2023-07-06T22:00:22.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.529+0000 7f9a92ffd640 1 -- 172.21.15.55:0/1632914307 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v54) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9a8c051390 con 0x7f9a9c09d340 2023-07-06T22:00:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.533+0000 7f9aa089c640 1 -- 172.21.15.55:0/1632914307 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9a7c0663a0 msgr2=0x7f9a7c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.533+0000 7f9aa089c640 1 --2- 172.21.15.55:0/1632914307 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9a7c0663a0 0x7f9a7c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a840af000 tx=0x7f9a840a7000 comp rx=0 tx=0).stop 2023-07-06T22:00:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.533+0000 7f9aa089c640 1 -- 172.21.15.55:0/1632914307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a9c09d340 msgr2=0x7f9a9c06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.533+0000 7f9aa089c640 1 --2- 172.21.15.55:0/1632914307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a9c09d340 0x7f9a9c06ff40 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00b410 tx=0x7f9a8c00b8d0 comp rx=0 tx=0).stop 2023-07-06T22:00:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.533+0000 7f9aa089c640 1 -- 172.21.15.55:0/1632914307 shutdown_connections 2023-07-06T22:00:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.533+0000 7f9aa089c640 1 --2- 172.21.15.55:0/1632914307 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f9a7c0663a0 0x7f9a7c068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.533+0000 7f9aa089c640 1 --2- 172.21.15.55:0/1632914307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a9c15ba30 0x7f9a9c0b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.533+0000 7f9aa089c640 1 --2- 172.21.15.55:0/1632914307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a9c0ad0c0 0x7f9a9c152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.533+0000 7f9aa089c640 1 --2- 172.21.15.55:0/1632914307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a9c09d340 0x7f9a9c06ff40 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.533+0000 7f9aa089c640 1 -- 172.21.15.55:0/1632914307 >> 172.21.15.55:0/1632914307 conn(0x7f9a9c0cea70 msgr2=0x7f9a9c0aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.533+0000 7f9aa089c640 1 -- 172.21.15.55:0/1632914307 shutdown_connections 2023-07-06T22:00:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.533+0000 7f9aa089c640 1 -- 172.21.15.55:0/1632914307 wait complete. 2023-07-06T22:00:22.554 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T22:00:22.555 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:00:22.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.697+0000 7ff74b337640 1 Processor -- start 2023-07-06T22:00:22.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.697+0000 7ff74b337640 1 -- start start 2023-07-06T22:00:22.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.701+0000 7ff74b337640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff74406f520 0x7ff7440cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:22.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.701+0000 7ff74b337640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74406fae0 con 0x7ff7441587d0 2023-07-06T22:00:22.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.701+0000 7ff74b337640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74406fdc0 con 0x7ff744158400 2023-07-06T22:00:22.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.701+0000 7ff74b337640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7440700a0 con 0x7ff74406f520 2023-07-06T22:00:22.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.701+0000 7ff7498d4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff74406f520 0x7ff7440cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:22.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.701+0000 7ff7498d4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff74406f520 0x7ff7440cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58550/0 (socket says 172.21.15.55:58550) 2023-07-06T22:00:22.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.701+0000 7ff7498d4640 1 -- 172.21.15.55:0/4033436122 learned_addr learned my addr 172.21.15.55:0/4033436122 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:22.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.701+0000 7ff7488d2640 1 --1- 172.21.15.55:0/4033436122 >> v1:172.21.15.55:6789/0 conn(0x7ff7441587d0 0x7ff744070b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44640/0 (socket says 172.21.15.55:44640) 2023-07-06T22:00:22.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.701+0000 7ff7498d4640 1 -- 172.21.15.55:0/4033436122 >> v1:172.21.15.138:6789/0 conn(0x7ff744158400 legacy=0x7ff7440c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:22.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.701+0000 7ff7498d4640 1 -- 172.21.15.55:0/4033436122 >> v1:172.21.15.55:6789/0 conn(0x7ff7441587d0 legacy=0x7ff744070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:22.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.701+0000 7ff73bfff640 1 -- 172.21.15.55:0/4033436122 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348793162 0 0) 0x7ff74406fae0 con 0x7ff7441587d0 2023-07-06T22:00:22.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.701+0000 7ff7498d4640 1 -- 172.21.15.55:0/4033436122 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff744070380 con 0x7ff74406f520 2023-07-06T22:00:22.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.701+0000 7ff7498d4640 1 --2- 172.21.15.55:0/4033436122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff74406f520 0x7ff7440cbaa0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009e50 tx=0x7ff73c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6912d933049995c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:22.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff73bfff640 1 -- 172.21.15.55:0/4033436122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c0a57c0 con 0x7ff74406f520 2023-07-06T22:00:22.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff73bfff640 1 -- 172.21.15.55:0/4033436122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c0a5920 con 0x7ff74406f520 2023-07-06T22:00:22.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff73bfff640 1 -- 172.21.15.55:0/4033436122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c0a5cb0 con 0x7ff74406f520 2023-07-06T22:00:22.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 -- 172.21.15.55:0/4033436122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff74406f520 msgr2=0x7ff7440cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:22.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 --2- 172.21.15.55:0/4033436122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff74406f520 0x7ff7440cbaa0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009e50 tx=0x7ff73c01c9e0 comp rx=0 tx=0).stop 2023-07-06T22:00:22.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 -- 172.21.15.55:0/4033436122 shutdown_connections 2023-07-06T22:00:22.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 --2- 172.21.15.55:0/4033436122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff74406f520 0x7ff7440cbaa0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:22.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 -- 172.21.15.55:0/4033436122 >> 172.21.15.55:0/4033436122 conn(0x7ff7440cded0 msgr2=0x7ff7440ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:22.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 -- 172.21.15.55:0/4033436122 shutdown_connections 2023-07-06T22:00:22.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 -- 172.21.15.55:0/4033436122 wait complete. 2023-07-06T22:00:22.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 Processor -- start 2023-07-06T22:00:22.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 -- start start 2023-07-06T22:00:22.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff74406f520 0x7ff7440b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff744158400 0x7ff744149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7441587d0 0x7ff744154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7440c5f70 con 0x7ff7441587d0 2023-07-06T22:00:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7440c6250 con 0x7ff74406f520 2023-07-06T22:00:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff74b337640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7440c6530 con 0x7ff744158400 2023-07-06T22:00:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff7498d4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7441587d0 0x7ff744154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:22.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff7498d4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7441587d0 0x7ff744154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58566/0 (socket says 172.21.15.55:58566) 2023-07-06T22:00:22.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.705+0000 7ff7498d4640 1 -- 172.21.15.55:0/392593329 learned_addr learned my addr 172.21.15.55:0/392593329 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff7490d3640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff74406f520 0x7ff7440b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff7488d2640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff744158400 0x7ff744149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff7498d4640 1 -- 172.21.15.55:0/392593329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff744158400 msgr2=0x7ff744149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff7498d4640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff744158400 0x7ff744149ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff7498d4640 1 -- 172.21.15.55:0/392593329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff74406f520 msgr2=0x7ff7440b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff7498d4640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff74406f520 0x7ff7440b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff7498d4640 1 -- 172.21.15.55:0/392593329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c009b30 con 0x7ff7441587d0 2023-07-06T22:00:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff7490d3640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff74406f520 0x7ff7440b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff7488d2640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff744158400 0x7ff744149ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff7498d4640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7441587d0 0x7ff744154b60 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0af040 tx=0x7ff73c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff739ffb640 1 -- 172.21.15.55:0/392593329 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c0b8670 con 0x7ff7441587d0 2023-07-06T22:00:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff739ffb640 1 -- 172.21.15.55:0/392593329 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c0b87f0 con 0x7ff7441587d0 2023-07-06T22:00:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff74b337640 1 -- 172.21.15.55:0/392593329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7440c6810 con 0x7ff7441587d0 2023-07-06T22:00:22.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff739ffb640 1 -- 172.21.15.55:0/392593329 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c0b8ba0 con 0x7ff7441587d0 2023-07-06T22:00:22.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff74b337640 1 -- 172.21.15.55:0/392593329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7440b2740 con 0x7ff7441587d0 2023-07-06T22:00:22.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff74b337640 1 -- 172.21.15.55:0/392593329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74406c580 con 0x7ff7441587d0 2023-07-06T22:00:22.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.709+0000 7ff739ffb640 1 -- 172.21.15.55:0/392593329 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff73c0b8d00 con 0x7ff7441587d0 2023-07-06T22:00:22.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.713+0000 7ff739ffb640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff7280663a0 0x7ff728068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:22.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.713+0000 7ff739ffb640 1 -- 172.21.15.55:0/392593329 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff73c11f700 con 0x7ff7441587d0 2023-07-06T22:00:22.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.713+0000 7ff7490d3640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff7280663a0 0x7ff728068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:22.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.713+0000 7ff7490d3640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff7280663a0 0x7ff728068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff740000f70 tx=0x7ff740009040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.713+0000 7ff739ffb640 1 -- 172.21.15.55:0/392593329 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff73c0ec9b0 con 0x7ff7441587d0 2023-07-06T22:00:22.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.901+0000 7ff74b337640 1 -- 172.21.15.55:0/392593329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff744066d60 con 0x7ff7441587d0 2023-07-06T22:00:22.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.901+0000 7ff739ffb640 1 -- 172.21.15.55:0/392593329 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4676 (secure 0 0 0) 0x7ff73c0effd0 con 0x7ff7441587d0 2023-07-06T22:00:22.903 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:22.904 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/567276052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":567276052},{"type":"v1","addr":"172.21.15.138:6834","nonce":567276052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2227115466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2227115466},{"type":"v1","addr":"172.21.15.138:6835","nonce":2227115466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2611738616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2611738616},{"type":"v1","addr":"172.21.15.55:6836","nonce":2611738616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:00:19.496559+0000","modified":"2023-07-06T22:00:22.517164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8622":{"gid":8622,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1836658324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1836658324},{"type":"v1","addr":"172.21.15.55:6837","nonce":1836658324}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-06T22:00:22.904 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 54 2023-07-06T22:00:22.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.905+0000 7ff74b337640 1 -- 172.21.15.55:0/392593329 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff7280663a0 msgr2=0x7ff728068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:22.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.905+0000 7ff74b337640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff7280663a0 0x7ff728068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff740000f70 tx=0x7ff740009040 comp rx=0 tx=0).stop 2023-07-06T22:00:22.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.905+0000 7ff74b337640 1 -- 172.21.15.55:0/392593329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7441587d0 msgr2=0x7ff744154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:22.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.905+0000 7ff74b337640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7441587d0 0x7ff744154b60 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0af040 tx=0x7ff73c019780 comp rx=0 tx=0).stop 2023-07-06T22:00:22.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.905+0000 7ff74b337640 1 -- 172.21.15.55:0/392593329 shutdown_connections 2023-07-06T22:00:22.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.905+0000 7ff74b337640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff7280663a0 0x7ff728068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:22.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.905+0000 7ff74b337640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7441587d0 0x7ff744154b60 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:22.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.905+0000 7ff74b337640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff744158400 0x7ff744149ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:22.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.905+0000 7ff74b337640 1 --2- 172.21.15.55:0/392593329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff74406f520 0x7ff7440b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:22.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.905+0000 7ff74b337640 1 -- 172.21.15.55:0/392593329 >> 172.21.15.55:0/392593329 conn(0x7ff7440cded0 msgr2=0x7ff7440ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:22.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.905+0000 7ff74b337640 1 -- 172.21.15.55:0/392593329 shutdown_connections 2023-07-06T22:00:22.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:22.905+0000 7ff74b337640 1 -- 172.21.15.55:0/392593329 wait complete. 2023-07-06T22:00:22.924 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:00:23.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.069+0000 7ff6701fa640 1 Processor -- start 2023-07-06T22:00:23.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.069+0000 7ff6701fa640 1 -- start start 2023-07-06T22:00:23.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.069+0000 7ff6701fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6680ce610 0x7ff6680b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.069+0000 7ff6701fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6680cd1c0 con 0x7ff6680b7cd0 2023-07-06T22:00:23.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.069+0000 7ff6701fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6680b2270 con 0x7ff6680b1e10 2023-07-06T22:00:23.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.069+0000 7ff6701fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6680d2310 con 0x7ff6680ce610 2023-07-06T22:00:23.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.069+0000 7ff66d795640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6680ce610 0x7ff6680b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.069+0000 7ff66d795640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6680ce610 0x7ff6680b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58570/0 (socket says 172.21.15.55:58570) 2023-07-06T22:00:23.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.069+0000 7ff66d795640 1 -- 172.21.15.55:0/176362898 learned_addr learned my addr 172.21.15.55:0/176362898 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:23.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.069+0000 7ff66df96640 1 --1- 172.21.15.55:0/176362898 >> v1:172.21.15.55:6789/0 conn(0x7ff6680b7cd0 0x7ff6680ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44654/0 (socket says 172.21.15.55:44654) 2023-07-06T22:00:23.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.069+0000 7ff66d795640 1 -- 172.21.15.55:0/176362898 >> v1:172.21.15.138:6789/0 conn(0x7ff6680b1e10 legacy=0x7ff66815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:23.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.069+0000 7ff66d795640 1 -- 172.21.15.55:0/176362898 >> v1:172.21.15.55:6789/0 conn(0x7ff6680b7cd0 legacy=0x7ff6680ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.069+0000 7ff66d795640 1 -- 172.21.15.55:0/176362898 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6680cecf0 con 0x7ff6680ce610 2023-07-06T22:00:23.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.069+0000 7ff66cf94640 1 -- 172.21.15.55:0/176362898 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208183583 0 0) 0x7ff6680cd1c0 con 0x7ff6680b7cd0 2023-07-06T22:00:23.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.073+0000 7ff66d795640 1 --2- 172.21.15.55:0/176362898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6680ce610 0x7ff6680b18d0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7ff658009870 tx=0x7ff65801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2fe4cfa9ee9d8d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:23.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.073+0000 7ff66cf94640 1 -- 172.21.15.55:0/176362898 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6580ab600 con 0x7ff6680ce610 2023-07-06T22:00:23.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.073+0000 7ff66cf94640 1 -- 172.21.15.55:0/176362898 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6580a7050 con 0x7ff6680ce610 2023-07-06T22:00:23.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.073+0000 7ff66cf94640 1 -- 172.21.15.55:0/176362898 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6580ab980 con 0x7ff6680ce610 2023-07-06T22:00:23.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.073+0000 7ff6701fa640 1 -- 172.21.15.55:0/176362898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6680ce610 msgr2=0x7ff6680b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.073+0000 7ff6701fa640 1 --2- 172.21.15.55:0/176362898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6680ce610 0x7ff6680b18d0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7ff658009870 tx=0x7ff65801c470 comp rx=0 tx=0).stop 2023-07-06T22:00:23.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.073+0000 7ff6701fa640 1 -- 172.21.15.55:0/176362898 shutdown_connections 2023-07-06T22:00:23.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.073+0000 7ff6701fa640 1 --2- 172.21.15.55:0/176362898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6680ce610 0x7ff6680b18d0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.073+0000 7ff6701fa640 1 -- 172.21.15.55:0/176362898 >> 172.21.15.55:0/176362898 conn(0x7ff6680ceee0 msgr2=0x7ff6680cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:23.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.073+0000 7ff6701fa640 1 -- 172.21.15.55:0/176362898 shutdown_connections 2023-07-06T22:00:23.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.073+0000 7ff6701fa640 1 -- 172.21.15.55:0/176362898 wait complete. 2023-07-06T22:00:23.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff6701fa640 1 Processor -- start 2023-07-06T22:00:23.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff6701fa640 1 -- start start 2023-07-06T22:00:23.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff6701fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6680b1e10 0x7ff668147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff6701fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6680b7cd0 0x7ff668149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff6701fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6680ce610 0x7ff6680b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff6701fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff668155dc0 con 0x7ff6680b7cd0 2023-07-06T22:00:23.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff6701fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66814c1b0 con 0x7ff6680ce610 2023-07-06T22:00:23.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff6701fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66814c490 con 0x7ff6680b1e10 2023-07-06T22:00:23.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff66d795640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6680b7cd0 0x7ff668149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff66d795640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6680b7cd0 0x7ff668149960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58580/0 (socket says 172.21.15.55:58580) 2023-07-06T22:00:23.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff66d795640 1 -- 172.21.15.55:0/3315007361 learned_addr learned my addr 172.21.15.55:0/3315007361 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:23.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff66df96640 1 --2- 172.21.15.55:0/3315007361 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6680b1e10 0x7ff668147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff66d795640 1 -- 172.21.15.55:0/3315007361 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6680b1e10 msgr2=0x7ff668147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff66d795640 1 --2- 172.21.15.55:0/3315007361 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6680b1e10 0x7ff668147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff66d795640 1 -- 172.21.15.55:0/3315007361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6680ce610 msgr2=0x7ff6680b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff66d795640 1 --2- 172.21.15.55:0/3315007361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6680ce610 0x7ff6680b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff66d795640 1 -- 172.21.15.55:0/3315007361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6580094d0 con 0x7ff6680b7cd0 2023-07-06T22:00:23.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff66d795640 1 --2- 172.21.15.55:0/3315007361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6680b7cd0 0x7ff668149960 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff6580ae040 tx=0x7ff65801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:23.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff65e7fc640 1 -- 172.21.15.55:0/3315007361 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6580b6620 con 0x7ff6680b7cd0 2023-07-06T22:00:23.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff65e7fc640 1 -- 172.21.15.55:0/3315007361 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6580b67a0 con 0x7ff6680b7cd0 2023-07-06T22:00:23.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff65e7fc640 1 -- 172.21.15.55:0/3315007361 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6580b6b50 con 0x7ff6680b7cd0 2023-07-06T22:00:23.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff6701fa640 1 -- 172.21.15.55:0/3315007361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff668155520 con 0x7ff6680b7cd0 2023-07-06T22:00:23.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.077+0000 7ff6701fa640 1 -- 172.21.15.55:0/3315007361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff668155ae0 con 0x7ff6680b7cd0 2023-07-06T22:00:23.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.081+0000 7ff6701fa640 1 -- 172.21.15.55:0/3315007361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff668066d60 con 0x7ff6680b7cd0 2023-07-06T22:00:23.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.081+0000 7ff65e7fc640 1 -- 172.21.15.55:0/3315007361 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff6580b2040 con 0x7ff6680b7cd0 2023-07-06T22:00:23.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.081+0000 7ff65e7fc640 1 --2- 172.21.15.55:0/3315007361 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff64c0663a0 0x7ff64c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.081+0000 7ff65e7fc640 1 -- 172.21.15.55:0/3315007361 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff65811e510 con 0x7ff6680b7cd0 2023-07-06T22:00:23.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.081+0000 7ff66df96640 1 --2- 172.21.15.55:0/3315007361 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff64c0663a0 0x7ff64c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.081+0000 7ff66df96640 1 --2- 172.21.15.55:0/3315007361 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff64c0663a0 0x7ff64c068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff664000f70 tx=0x7ff664007b60 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:23.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.085+0000 7ff65e7fc640 1 -- 172.21.15.55:0/3315007361 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff6580eb590 con 0x7ff6680b7cd0 2023-07-06T22:00:23.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.241+0000 7ff6701fa640 1 -- 172.21.15.55:0/3315007361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff668160790 con 0x7ff6680b7cd0 2023-07-06T22:00:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.245+0000 7ff65e7fc640 1 -- 172.21.15.55:0/3315007361 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+18502 (secure 0 0 0) 0x7ff668160790 con 0x7ff6680b7cd0 2023-07-06T22:00:23.245 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:23.245 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":131,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:00:20.498921+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:00:17.410451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-07-06T22:00:18.487297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:00:23.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.245+0000 7ff6701fa640 1 -- 172.21.15.55:0/3315007361 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff64c0663a0 msgr2=0x7ff64c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.245+0000 7ff6701fa640 1 --2- 172.21.15.55:0/3315007361 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff64c0663a0 0x7ff64c068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff664000f70 tx=0x7ff664007b60 comp rx=0 tx=0).stop 2023-07-06T22:00:23.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.245+0000 7ff6701fa640 1 -- 172.21.15.55:0/3315007361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6680b7cd0 msgr2=0x7ff668149960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.245+0000 7ff6701fa640 1 --2- 172.21.15.55:0/3315007361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6680b7cd0 0x7ff668149960 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff6580ae040 tx=0x7ff65801acb0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.245+0000 7ff6701fa640 1 -- 172.21.15.55:0/3315007361 shutdown_connections 2023-07-06T22:00:23.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.245+0000 7ff6701fa640 1 --2- 172.21.15.55:0/3315007361 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7ff64c0663a0 0x7ff64c068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.245+0000 7ff6701fa640 1 --2- 172.21.15.55:0/3315007361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6680ce610 0x7ff6680b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.245+0000 7ff6701fa640 1 --2- 172.21.15.55:0/3315007361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6680b7cd0 0x7ff668149960 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.245+0000 7ff6701fa640 1 --2- 172.21.15.55:0/3315007361 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6680b1e10 0x7ff668147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.245+0000 7ff6701fa640 1 -- 172.21.15.55:0/3315007361 >> 172.21.15.55:0/3315007361 conn(0x7ff6680ceee0 msgr2=0x7ff66806a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:23.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.245+0000 7ff6701fa640 1 -- 172.21.15.55:0/3315007361 shutdown_connections 2023-07-06T22:00:23.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.245+0000 7ff6701fa640 1 -- 172.21.15.55:0/3315007361 wait complete. 2023-07-06T22:00:23.266 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T22:00:23.266 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:00:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.405+0000 7f36a6c18640 1 Processor -- start 2023-07-06T22:00:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f36a6c18640 1 -- start start 2023-07-06T22:00:23.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f36a6c18640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36a00b7cd0 0x7f36a00ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f36a6c18640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f36a00b1fe0 0x7f36a015f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f36a6c18640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a00cecf0 con 0x7f36a00ccab0 2023-07-06T22:00:23.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f36a6c18640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a00d2310 con 0x7f36a00b1fe0 2023-07-06T22:00:23.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f36a6c18640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00b80a0 con 0x7f36a00b7cd0 2023-07-06T22:00:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f369ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f36a00ccab0 0x7f36a00b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48138/0 (socket says 172.21.15.55:48138) 2023-07-06T22:00:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f369ffff640 1 -- 172.21.15.55:0/2204017257 learned_addr learned my addr 172.21.15.55:0/2204017257 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f36a51b5640 1 --2- 172.21.15.55:0/2204017257 >> v2:172.21.15.55:3300/0 conn(0x7f36a00b1fe0 0x7f36a015f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f36a49b4640 1 --2- 172.21.15.55:0/2204017257 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36a00b7cd0 0x7f36a00ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f369f7fe640 1 -- 172.21.15.55:0/2204017257 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091842338 0 0) 0x7f36a00cecf0 con 0x7f36a00ccab0 2023-07-06T22:00:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f369f7fe640 1 -- 172.21.15.55:0/2204017257 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3690003530 con 0x7f36a00ccab0 2023-07-06T22:00:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f36a51b5640 1 -- 172.21.15.55:0/2204017257 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36a00b7cd0 msgr2=0x7f36a00ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f36a51b5640 1 --2- 172.21.15.55:0/2204017257 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36a00b7cd0 0x7f36a00ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f36a51b5640 1 -- 172.21.15.55:0/2204017257 >> v1:172.21.15.55:6789/0 conn(0x7f36a00ccab0 legacy=0x7f36a00b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.409+0000 7f36a51b5640 1 -- 172.21.15.55:0/2204017257 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00d1d90 con 0x7f36a00b1fe0 2023-07-06T22:00:23.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.413+0000 7f36a51b5640 1 --2- 172.21.15.55:0/2204017257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a00b1fe0 0x7f36a015f870 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f3698009d90 tx=0x7f369801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904724ac1c56fd41 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.413+0000 7f369f7fe640 1 -- 172.21.15.55:0/2204017257 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36980a5780 con 0x7f36a00b1fe0 2023-07-06T22:00:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.413+0000 7f369f7fe640 1 -- 172.21.15.55:0/2204017257 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36980a58e0 con 0x7f36a00b1fe0 2023-07-06T22:00:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.413+0000 7f369f7fe640 1 -- 172.21.15.55:0/2204017257 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36980a5c50 con 0x7f36a00b1fe0 2023-07-06T22:00:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.413+0000 7f36a6c18640 1 -- 172.21.15.55:0/2204017257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a00b1fe0 msgr2=0x7f36a015f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.413+0000 7f36a6c18640 1 --2- 172.21.15.55:0/2204017257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a00b1fe0 0x7f36a015f870 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f3698009d90 tx=0x7f369801c8c0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.413+0000 7f36a6c18640 1 -- 172.21.15.55:0/2204017257 shutdown_connections 2023-07-06T22:00:23.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.413+0000 7f36a6c18640 1 --2- 172.21.15.55:0/2204017257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a00b1fe0 0x7f36a015f870 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.413+0000 7f36a6c18640 1 --2- 172.21.15.55:0/2204017257 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36a00b7cd0 0x7f36a00ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.413+0000 7f36a6c18640 1 -- 172.21.15.55:0/2204017257 >> 172.21.15.55:0/2204017257 conn(0x7f36a00ceee0 msgr2=0x7f36a00cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.413+0000 7f36a6c18640 1 -- 172.21.15.55:0/2204017257 shutdown_connections 2023-07-06T22:00:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.413+0000 7f36a6c18640 1 -- 172.21.15.55:0/2204017257 wait complete. 2023-07-06T22:00:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.413+0000 7f36a6c18640 1 Processor -- start 2023-07-06T22:00:23.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.413+0000 7f36a6c18640 1 -- start start 2023-07-06T22:00:23.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a6c18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a00b1fe0 0x7f36a015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a6c18640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36a00b7cd0 0x7f36a00c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a6c18640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36a00ccab0 0x7f36a0152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a6c18640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a0155ea0 con 0x7f36a00b1fe0 2023-07-06T22:00:23.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a6c18640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a0155bc0 con 0x7f36a00b7cd0 2023-07-06T22:00:23.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a6c18640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a014b240 con 0x7f36a00ccab0 2023-07-06T22:00:23.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a49b4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a00b1fe0 0x7f36a015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a49b4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a00b1fe0 0x7f36a015ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58490/0 (socket says 172.21.15.55:58490) 2023-07-06T22:00:23.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a49b4640 1 -- 172.21.15.55:0/2239492878 learned_addr learned my addr 172.21.15.55:0/2239492878 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:23.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f369ffff640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36a00b7cd0 0x7f36a00c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a51b5640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36a00ccab0 0x7f36a0152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a49b4640 1 -- 172.21.15.55:0/2239492878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36a00ccab0 msgr2=0x7f36a0152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a49b4640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36a00ccab0 0x7f36a0152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a49b4640 1 -- 172.21.15.55:0/2239492878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36a00b7cd0 msgr2=0x7f36a00c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a49b4640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36a00b7cd0 0x7f36a00c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a49b4640 1 -- 172.21.15.55:0/2239492878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3698009a70 con 0x7f36a00b1fe0 2023-07-06T22:00:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a51b5640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36a00ccab0 0x7f36a0152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f369ffff640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36a00b7cd0 0x7f36a00c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a49b4640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a00b1fe0 0x7f36a015ba30 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f369400d5f0 tx=0x7f369400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f369d7fa640 1 -- 172.21.15.55:0/2239492878 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36940125f0 con 0x7f36a00b1fe0 2023-07-06T22:00:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f369d7fa640 1 -- 172.21.15.55:0/2239492878 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3694012750 con 0x7f36a00b1fe0 2023-07-06T22:00:23.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a6c18640 1 -- 172.21.15.55:0/2239492878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a014b520 con 0x7f36a00b1fe0 2023-07-06T22:00:23.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f369d7fa640 1 -- 172.21.15.55:0/2239492878 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694012ae0 con 0x7f36a00b1fe0 2023-07-06T22:00:23.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a6c18640 1 -- 172.21.15.55:0/2239492878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a01534a0 con 0x7f36a00b1fe0 2023-07-06T22:00:23.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.417+0000 7f36a6c18640 1 -- 172.21.15.55:0/2239492878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a014b0a0 con 0x7f36a00b1fe0 2023-07-06T22:00:23.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.421+0000 7f369d7fa640 1 -- 172.21.15.55:0/2239492878 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3694012c40 con 0x7f36a00b1fe0 2023-07-06T22:00:23.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.421+0000 7f369d7fa640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f36840663d0 0x7f3684068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.421+0000 7f369d7fa640 1 -- 172.21.15.55:0/2239492878 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3694084550 con 0x7f36a00b1fe0 2023-07-06T22:00:23.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.421+0000 7f369ffff640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f36840663d0 0x7f3684068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.421+0000 7f369ffff640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f36840663d0 0x7f3684068880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f36a0159130 tx=0x7f368c009040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:23.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.425+0000 7f369d7fa640 1 -- 172.21.15.55:0/2239492878 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36a014b0a0 con 0x7f36a00b1fe0 2023-07-06T22:00:23.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.577+0000 7f36a6c18640 1 -- 172.21.15.55:0/2239492878 --> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36a00b1620 con 0x7f36840663d0 2023-07-06T22:00:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.585+0000 7f369d7fa640 1 -- 172.21.15.55:0/2239492878 <== mgr.8376 v2:172.21.15.55:6832/3817107512 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299270 (secure 0 0 0) 0x7f368c001480 con 0x7f36840663d0 2023-07-06T22:00:23.590 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:23.591 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:00:23.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.589+0000 7f36a6c18640 1 -- 172.21.15.55:0/2239492878 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f36840663d0 msgr2=0x7f3684068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.589+0000 7f36a6c18640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f36840663d0 0x7f3684068880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f36a0159130 tx=0x7f368c009040 comp rx=0 tx=0).stop 2023-07-06T22:00:23.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.589+0000 7f36a6c18640 1 -- 172.21.15.55:0/2239492878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a00b1fe0 msgr2=0x7f36a015ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.589+0000 7f36a6c18640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a00b1fe0 0x7f36a015ba30 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f369400d5f0 tx=0x7f369400dab0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.589+0000 7f36a6c18640 1 -- 172.21.15.55:0/2239492878 shutdown_connections 2023-07-06T22:00:23.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.589+0000 7f36a6c18640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f36840663d0 0x7f3684068880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.589+0000 7f36a6c18640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36a00ccab0 0x7f36a0152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.589+0000 7f36a6c18640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36a00b7cd0 0x7f36a00c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.589+0000 7f36a6c18640 1 --2- 172.21.15.55:0/2239492878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a00b1fe0 0x7f36a015ba30 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.589+0000 7f36a6c18640 1 -- 172.21.15.55:0/2239492878 >> 172.21.15.55:0/2239492878 conn(0x7f36a00ceee0 msgr2=0x7f36a006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:23.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.589+0000 7f36a6c18640 1 -- 172.21.15.55:0/2239492878 shutdown_connections 2023-07-06T22:00:23.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.589+0000 7f36a6c18640 1 -- 172.21.15.55:0/2239492878 wait complete. 2023-07-06T22:00:23.610 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T22:00:23.003179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":326676,"kb_used_data":13524,"kb_used_omap":0,"kb_used_meta":313088,"kb_avail":754648044,"statfs":{"total":773094113280,"available":772759597056,"internally_reserved":0,"allocated":13848576,"data_stored":7872208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320602112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.921707"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093164+0000","last_change":"2023-07-06T22:00:18.093164+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093164+0000","last_undegraded":"2023-07-06T22:00:18.093164+0000","last_fullsized":"2023-07-06T22:00:18.093164+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.090571+0000","last_change":"2023-07-06T22:00:18.090571+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.090571+0000","last_undegraded":"2023-07-06T22:00:18.090571+0000","last_fullsized":"2023-07-06T22:00:18.090571+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084942+0000","last_change":"2023-07-06T22:00:18.084942+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084942+0000","last_undegraded":"2023-07-06T22:00:18.084942+0000","last_fullsized":"2023-07-06T22:00:18.084942+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084883+0000","last_change":"2023-07-06T22:00:18.084883+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084883+0000","last_undegraded":"2023-07-06T22:00:18.084883+0000","last_fullsized":"2023-07-06T22:00:18.084883+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093819+0000","last_change":"2023-07-06T22:00:18.093819+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093819+0000","last_undegraded":"2023-07-06T22:00:18.093819+0000","last_fullsized":"2023-07-06T22:00:18.093819+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.090356+0000","last_change":"2023-07-06T22:00:18.090356+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.090356+0000","last_undegraded":"2023-07-06T22:00:18.090356+0000","last_fullsized":"2023-07-06T22:00:18.090356+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.086289+0000","last_change":"2023-07-06T22:00:18.086289+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.086289+0000","last_undegraded":"2023-07-06T22:00:18.086289+0000","last_fullsized":"2023-07-06T22:00:18.086289+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.090709+0000","last_change":"2023-07-06T22:00:18.090709+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.090709+0000","last_undegraded":"2023-07-06T22:00:18.090709+0000","last_fullsized":"2023-07-06T22:00:18.090709+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.088523+0000","last_change":"2023-07-06T22:00:18.088523+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.088523+0000","last_undegraded":"2023-07-06T22:00:18.088523+0000","last_fullsized":"2023-07-06T22:00:18.088523+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084784+0000","last_change":"2023-07-06T22:00:18.084784+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084784+0000","last_undegraded":"2023-07-06T22:00:18.084784+0000","last_fullsized":"2023-07-06T22:00:18.084784+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.091021+0000","last_change":"2023-07-06T22:00:18.091021+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.091021+0000","last_undegraded":"2023-07-06T22:00:18.091021+0000","last_fullsized":"2023-07-06T22:00:18.091021+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093167+0000","last_change":"2023-07-06T22:00:18.093167+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093167+0000","last_undegraded":"2023-07-06T22:00:18.093167+0000","last_fullsized":"2023-07-06T22:00:18.093167+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087660+0000","last_change":"2023-07-06T22:00:18.087660+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087660+0000","last_undegraded":"2023-07-06T22:00:18.087660+0000","last_fullsized":"2023-07-06T22:00:18.087660+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084812+0000","last_change":"2023-07-06T22:00:18.084812+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084812+0000","last_undegraded":"2023-07-06T22:00:18.084812+0000","last_fullsized":"2023-07-06T22:00:18.084812+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087155+0000","last_change":"2023-07-06T22:00:18.087155+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087155+0000","last_undegraded":"2023-07-06T22:00:18.087155+0000","last_fullsized":"2023-07-06T22:00:18.087155+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.088255+0000","last_change":"2023-07-06T22:00:18.088255+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.088255+0000","last_undegraded":"2023-07-06T22:00:18.088255+0000","last_fullsized":"2023-07-06T22:00:18.088255+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.090015+0000","last_change":"2023-07-06T22:00:18.090015+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.090015+0000","last_undegraded":"2023-07-06T22:00:18.090015+0000","last_fullsized":"2023-07-06T22:00:18.090015+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.091028+0000","last_change":"2023-07-06T22:00:18.091028+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.091028+0000","last_undegraded":"2023-07-06T22:00:18.091028+0000","last_fullsized":"2023-07-06T22:00:18.091028+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087843+0000","last_change":"2023-07-06T22:00:18.087843+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087843+0000","last_undegraded":"2023-07-06T22:00:18.087843+0000","last_fullsized":"2023-07-06T22:00:18.087843+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.089401+0000","last_change":"2023-07-06T22:00:18.089401+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.089401+0000","last_undegraded":"2023-07-06T22:00:18.089401+0000","last_fullsized":"2023-07-06T22:00:18.089401+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093080+0000","last_change":"2023-07-06T22:00:18.093080+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093080+0000","last_undegraded":"2023-07-06T22:00:18.093080+0000","last_fullsized":"2023-07-06T22:00:18.093080+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.086280+0000","last_change":"2023-07-06T22:00:18.086280+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.086280+0000","last_undegraded":"2023-07-06T22:00:18.086280+0000","last_fullsized":"2023-07-06T22:00:18.086280+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084708+0000","last_change":"2023-07-06T22:00:18.084708+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084708+0000","last_undegraded":"2023-07-06T22:00:18.084708+0000","last_fullsized":"2023-07-06T22:00:18.084708+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087726+0000","last_change":"2023-07-06T22:00:18.087726+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087726+0000","last_undegraded":"2023-07-06T22:00:18.087726+0000","last_fullsized":"2023-07-06T22:00:18.087726+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093146+0000","last_change":"2023-07-06T22:00:18.093146+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093146+0000","last_undegraded":"2023-07-06T22:00:18.093146+0000","last_fullsized":"2023-07-06T22:00:18.093146+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"119'227","reported_seq":774,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.091187+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:00:18.091187+0000","last_peered":"2023-07-06T22:00:18.091187+0000","last_clean":"2023-07-06T22:00:18.091187+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:00:18.091187+0000","last_undegraded":"2023-07-06T22:00:18.091187+0000","last_fullsized":"2023-07-06T22:00:18.091187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:33:20.720666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.094486+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:00:18.094486+0000","last_peered":"2023-07-06T22:00:18.094486+0000","last_clean":"2023-07-06T22:00:18.094486+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:00:18.094486+0000","last_undegraded":"2023-07-06T22:00:18.094486+0000","last_fullsized":"2023-07-06T22:00:18.094486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:26:09.710631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.091218+0000","last_change":"2023-07-06T22:00:18.091218+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.091218+0000","last_undegraded":"2023-07-06T22:00:18.091218+0000","last_fullsized":"2023-07-06T22:00:18.091218+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.091119+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:00:18.091119+0000","last_peered":"2023-07-06T22:00:18.091119+0000","last_clean":"2023-07-06T22:00:18.091119+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:00:18.091119+0000","last_undegraded":"2023-07-06T22:00:18.091119+0000","last_fullsized":"2023-07-06T22:00:18.091119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:43:56.891335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.088104+0000","last_change":"2023-07-06T22:00:18.088104+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.088104+0000","last_undegraded":"2023-07-06T22:00:18.088104+0000","last_fullsized":"2023-07-06T22:00:18.088104+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":231,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.083538+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:00:18.083538+0000","last_peered":"2023-07-06T22:00:18.083538+0000","last_clean":"2023-07-06T22:00:18.083538+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:00:18.083538+0000","last_undegraded":"2023-07-06T22:00:18.083538+0000","last_fullsized":"2023-07-06T22:00:18.083538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:39:31.797252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084805+0000","last_change":"2023-07-06T22:00:18.084805+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084805+0000","last_undegraded":"2023-07-06T22:00:18.084805+0000","last_fullsized":"2023-07-06T22:00:18.084805+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.094266+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:00:18.094266+0000","last_peered":"2023-07-06T22:00:18.094266+0000","last_clean":"2023-07-06T22:00:18.094266+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:00:18.094266+0000","last_undegraded":"2023-07-06T22:00:18.094266+0000","last_fullsized":"2023-07-06T22:00:18.094266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:32:58.090295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.089476+0000","last_change":"2023-07-06T22:00:18.089476+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.089476+0000","last_undegraded":"2023-07-06T22:00:18.089476+0000","last_fullsized":"2023-07-06T22:00:18.089476+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":203,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.088811+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:00:18.088811+0000","last_peered":"2023-07-06T22:00:18.088811+0000","last_clean":"2023-07-06T22:00:18.088811+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:00:18.088811+0000","last_undegraded":"2023-07-06T22:00:18.088811+0000","last_fullsized":"2023-07-06T22:00:18.088811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:09:42.135640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.085149+0000","last_change":"2023-07-06T22:00:18.085149+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.085149+0000","last_undegraded":"2023-07-06T22:00:18.085149+0000","last_fullsized":"2023-07-06T22:00:18.085149+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.091207+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:00:18.091207+0000","last_peered":"2023-07-06T22:00:18.091207+0000","last_clean":"2023-07-06T22:00:18.091207+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:00:18.091207+0000","last_undegraded":"2023-07-06T22:00:18.091207+0000","last_fullsized":"2023-07-06T22:00:18.091207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:55:50.459937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087998+0000","last_change":"2023-07-06T22:00:18.087998+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087998+0000","last_undegraded":"2023-07-06T22:00:18.087998+0000","last_fullsized":"2023-07-06T22:00:18.087998+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":203,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.088762+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:00:18.088762+0000","last_peered":"2023-07-06T22:00:18.088762+0000","last_clean":"2023-07-06T22:00:18.088762+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:00:18.088762+0000","last_undegraded":"2023-07-06T22:00:18.088762+0000","last_fullsized":"2023-07-06T22:00:18.088762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:37:37.866649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.088313+0000","last_change":"2023-07-06T22:00:18.088313+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.088313+0000","last_undegraded":"2023-07-06T22:00:18.088313+0000","last_fullsized":"2023-07-06T22:00:18.088313+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":199,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.091713+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:00:18.091713+0000","last_peered":"2023-07-06T22:00:18.091713+0000","last_clean":"2023-07-06T22:00:18.091713+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:00:18.091713+0000","last_undegraded":"2023-07-06T22:00:18.091713+0000","last_fullsized":"2023-07-06T22:00:18.091713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:57:19.255279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575067,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":2179072,"data_stored":1427868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.53500000000000003,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.54900000000000004,"5min":0.45800000000000002,"15min":0.45400000000000001},"max":{"1min":0.98399999999999999,"5min":1.048,"15min":1.048},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69899999999999995,"15min":0.71399999999999997},"min":{"1min":0.54000000000000004,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.71899999999999997},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.68700000000000006,"15min":0.70299999999999996},"min":{"1min":0.53800000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.093,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.3480000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71799999999999997,"15min":0.71899999999999997},"min":{"1min":0.54400000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.181,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.73999999999999999},"min":{"1min":0.52400000000000002,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.2829999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.93000000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.97199999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85099999999999998,"5min":1.169,"15min":1.169},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45700000000000002,"5min":0.376,"15min":0.35599999999999998},"max":{"1min":0.876,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.39000000000000001},"max":{"1min":0.90200000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":1.0069999999999999,"5min":1.45,"15min":1.45},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.98599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575067,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36688,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335152,"statfs":{"total":96636764160,"available":96599195648,"internally_reserved":0,"allocated":1581056,"data_stored":836481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68200000000000005,"15min":0.70299999999999996},"min":{"1min":0.52200000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88900000000000001,"5min":0.94699999999999995,"15min":0.97899999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.73499999999999999,"15min":0.73399999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.83999999999999997}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68700000000000006,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.93000000000000005,"5min":0.998,"15min":1.0229999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.75600000000000001,"15min":0.747},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.71499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":0.86499999999999999,"5min":0.90400000000000003,"15min":1.0129999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.995,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.75,"15min":0.753},"min":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.45800000000000002},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70299999999999996,"15min":0.72999999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.874,"5min":0.94799999999999995,"15min":1.0629999999999999},"last":0.87}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.38400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95399999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.44700000000000001,"5min":0.40899999999999997,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.621},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.45200000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97599999999999998,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91700000000000004,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.876,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.57699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575066,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54740,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317100,"statfs":{"total":96636764160,"available":96580710400,"internally_reserved":0,"allocated":1585152,"data_stored":837500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.58499999999999996,"5min":0.40600000000000003,"15min":0.36699999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.35299999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68500000000000005,"15min":0.72099999999999997},"min":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70499999999999996,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.498,"5min":0.47899999999999998,"15min":0.39900000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.72199999999999998,"15min":0.745},"min":{"1min":0.51000000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.70999999999999996,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.622},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.73199999999999998,"15min":0.76000000000000001},"min":{"1min":0.52700000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.315,"15min":0.315},"max":{"1min":0.86399999999999999,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":1.02},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.62},"min":{"1min":0.433,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.45500000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91400000000000003,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.50900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95099999999999996,"5min":0.95299999999999996,"15min":1.0589999999999999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575065,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1572864,"data_stored":831010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.56100000000000005,"5min":0.46200000000000002,"15min":0.39400000000000002},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.079,"5min":1.123,"15min":1.123},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69999999999999996,"15min":0.71899999999999997},"min":{"1min":0.50700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.622},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69699999999999995,"15min":0.72099999999999997},"min":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.55200000000000005,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.745,"15min":0.752},"min":{"1min":0.55800000000000005,"5min":0.50600000000000001,"15min":0.49299999999999999},"max":{"1min":1.0609999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.308},"max":{"1min":0.82799999999999996,"5min":0.90600000000000003,"15min":0.94299999999999995},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.61199999999999999,"15min":0.59599999999999997},"min":{"1min":0.436,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.91800000000000004,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63500000000000001,"15min":0.60399999999999998},"min":{"1min":0.44800000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91000000000000003,"5min":1.036,"15min":1.036},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67400000000000004,"15min":0.65300000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.34799999999999998},"max":{"1min":0.93899999999999995,"5min":1,"15min":1},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68300000000000005,"15min":0.65500000000000003},"min":{"1min":0.53000000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.442,"15min":0.41599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.75}]}]},{"osd":3,"up_from":13,"seq":55834575066,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1585152,"data_stored":837500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.42999999999999999,"15min":0.45000000000000001},"min":{"1min":0.27500000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65600000000000003,"5min":0.78700000000000003,"15min":1.0489999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.53700000000000003},"min":{"1min":0.39700000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76000000000000001,"5min":2.77,"15min":2.77},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.24299999999999999},"max":{"1min":0.747,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56499999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.97799999999999998,"5min":1.351,"15min":1.351},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68799999999999994,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":1.24},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.746,"15min":0.76700000000000002},"min":{"1min":0.52700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.069,"5min":1.1930000000000001,"15min":1.3009999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.75,"15min":0.78200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.024,"5min":1.383,"15min":1.383},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.052,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.79000000000000004},"min":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.05,"5min":1.327,"15min":1.3999999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.79600000000000004},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96599999999999997,"5min":1.3140000000000001,"15min":1.425},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79400000000000004,"15min":0.80900000000000005},"min":{"1min":0.52700000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.085,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.626}]},{"osd":7,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77900000000000003,"15min":0.81100000000000005},"min":{"1min":0.58199999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.034,"5min":3.097,"15min":3.097},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77400000000000002,"15min":0.80600000000000005},"min":{"1min":0.47099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.107,"5min":1.1140000000000001,"15min":1.3480000000000001},"last":0.53100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575066,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36692,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335148,"statfs":{"total":96636764160,"available":96599191552,"internally_reserved":0,"allocated":1585152,"data_stored":837500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67400000000000004,"5min":0.81699999999999995,"15min":0.85999999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.47999999999999998,"15min":0.502},"min":{"1min":0.30599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.82199999999999995,"5min":0.84399999999999997,"15min":0.85999999999999999},"last":0.376}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.378,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79300000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.42299999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67200000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.439}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.50900000000000001},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.40100000000000002,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.85599999999999998,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.52900000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1379999999999999,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.52100000000000002,"5min":0.47499999999999998,"15min":0.41399999999999998},"max":{"1min":1.403,"5min":1.591,"15min":1.591},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.79400000000000004},"min":{"1min":0.58499999999999996,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.1910000000000001,"5min":1.333,"15min":1.333},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77600000000000002,"15min":0.81200000000000006},"min":{"1min":0.56799999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0169999999999999,"5min":1.327,"15min":1.327},"last":1.087}]},{"osd":6,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.81100000000000005,"15min":0.82099999999999995},"min":{"1min":0.58199999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5329999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.022},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.79800000000000004,"15min":0.81799999999999995},"min":{"1min":0.60899999999999999,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.4950000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.93500000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.80800000000000005,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.83699999999999997},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0880000000000001,"5min":1.573,"15min":1.573},"last":1.1180000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575067,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58836,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313004,"statfs":{"total":96636764160,"available":96576516096,"internally_reserved":0,"allocated":1585152,"data_stored":837500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.42999999999999999,"15min":0.443},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.626,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48399999999999999,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.69099999999999995,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69599999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.71399999999999997,"5min":0.79800000000000004,"15min":0.87},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.432,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.54600000000000004},"min":{"1min":0.39200000000000002,"5min":0.36699999999999999,"15min":0.32000000000000001},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.505}]},{"osd":4,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.74399999999999999,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.47599999999999998,"15min":0.38500000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.3140000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.76500000000000001,"15min":0.78700000000000003},"min":{"1min":0.66500000000000004,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.626,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.55100000000000005,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.357},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.68200000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.022},{"interface":"front","average":{"1min":0.878,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.71499999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.456},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.59099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.417},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.78600000000000003,"15min":0.81899999999999995},"min":{"1min":0.71699999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.88100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575066,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37268,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334572,"statfs":{"total":96636764160,"available":96598601728,"internally_reserved":0,"allocated":2174976,"data_stored":1426849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.436},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":0.624,"5min":0.73599999999999999,"15min":0.86399999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.755,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.497},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.70699999999999996,"5min":0.81100000000000005,"15min":0.82399999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.53400000000000003},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68999999999999995,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.49299999999999999,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76600000000000001,"5min":1.151,"15min":1.151},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53500000000000003,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.874},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.72899999999999998,"15min":0.78200000000000003},"min":{"1min":0.52700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73399999999999999,"15min":0.78100000000000003},"min":{"1min":0.54200000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.876}]},{"osd":5,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.754,"15min":0.79500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72199999999999998,"15min":0.78100000000000003},"min":{"1min":0.57199999999999995,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75900000000000001,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.746,"15min":0.78600000000000003},"min":{"1min":0.58499999999999996,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.80600000000000005},"min":{"1min":0.56799999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.78200000000000003,"15min":0.81399999999999995},"min":{"1min":0.60099999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.84399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:00:23.658 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:00:23.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb635512640 1 Processor -- start 2023-07-06T22:00:23.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb635512640 1 -- start start 2023-07-06T22:00:23.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb635512640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6300ce5e0 0x7fb6300b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb635512640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb6300b40e0 0x7fb6300d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb635512640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6300cc770 con 0x7fb63015b9d0 2023-07-06T22:00:23.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb635512640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6300b4560 con 0x7fb6300b40e0 2023-07-06T22:00:23.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb635512640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300cc9c0 con 0x7fb6300ce5e0 2023-07-06T22:00:23.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb62f7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6300ce5e0 0x7fb6300b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb634d11640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb6300b40e0 0x7fb6300d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb634d11640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb6300b40e0 0x7fb6300d0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:37510/0 (socket says 172.21.15.55:37510) 2023-07-06T22:00:23.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb634d11640 1 -- 172.21.15.55:0/2985225985 learned_addr learned my addr 172.21.15.55:0/2985225985 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:23.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb62ffff640 1 --1- 172.21.15.55:0/2985225985 >> v1:172.21.15.138:6789/0 conn(0x7fb63015b9d0 0x7fb6300b2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:43382/0 (socket says 172.21.15.55:43382) 2023-07-06T22:00:23.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb62f7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6300ce5e0 0x7fb6300b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:55342/0 (socket says 172.21.15.55:55342) 2023-07-06T22:00:23.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb62f7fe640 1 -- 172.21.15.55:0/2985225985 >> v2:172.21.15.138:3300/0 conn(0x7fb6300b40e0 msgr2=0x7fb6300d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:23.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb62f7fe640 1 --2- 172.21.15.55:0/2985225985 >> v2:172.21.15.138:3300/0 conn(0x7fb6300b40e0 0x7fb6300d0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb62f7fe640 1 -- 172.21.15.55:0/2985225985 >> v1:172.21.15.138:6789/0 conn(0x7fb63015b9d0 legacy=0x7fb6300b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb62f7fe640 1 -- 172.21.15.55:0/2985225985 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300ccca0 con 0x7fb6300ce5e0 2023-07-06T22:00:23.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb634d11640 1 --2- 172.21.15.55:0/2985225985 >> v2:172.21.15.138:3300/0 conn(0x7fb6300b40e0 0x7fb6300d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:00:23.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.801+0000 7fb62effd640 1 -- 172.21.15.55:0/2985225985 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384860285 0 0) 0x7fb6300cc770 con 0x7fb63015b9d0 2023-07-06T22:00:23.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.805+0000 7fb62f7fe640 1 --2- 172.21.15.55:0/2985225985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6300ce5e0 0x7fb6300b3ba0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb6240097c0 tx=0x7fb62401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8669c3b279b93e84 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:23.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.805+0000 7fb62effd640 1 -- 172.21.15.55:0/2985225985 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6240ab640 con 0x7fb6300ce5e0 2023-07-06T22:00:23.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.805+0000 7fb62effd640 1 -- 172.21.15.55:0/2985225985 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6240a7070 con 0x7fb6300ce5e0 2023-07-06T22:00:23.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.805+0000 7fb62effd640 1 -- 172.21.15.55:0/2985225985 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6240ab9c0 con 0x7fb6300ce5e0 2023-07-06T22:00:23.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 -- 172.21.15.55:0/2985225985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6300ce5e0 msgr2=0x7fb6300b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 --2- 172.21.15.55:0/2985225985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6300ce5e0 0x7fb6300b3ba0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb6240097c0 tx=0x7fb62401c480 comp rx=0 tx=0).stop 2023-07-06T22:00:23.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 -- 172.21.15.55:0/2985225985 shutdown_connections 2023-07-06T22:00:23.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 --2- 172.21.15.55:0/2985225985 >> v2:172.21.15.138:3300/0 conn(0x7fb6300b40e0 0x7fb6300d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 --2- 172.21.15.55:0/2985225985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6300ce5e0 0x7fb6300b3ba0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 -- 172.21.15.55:0/2985225985 >> 172.21.15.55:0/2985225985 conn(0x7fb63006c2b0 msgr2=0x7fb6300ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:23.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 -- 172.21.15.55:0/2985225985 shutdown_connections 2023-07-06T22:00:23.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 -- 172.21.15.55:0/2985225985 wait complete. 2023-07-06T22:00:23.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 Processor -- start 2023-07-06T22:00:23.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 -- start start 2023-07-06T22:00:23.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6300b40e0 0x7fb630156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6300ce5e0 0x7fb63006a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb63015b9d0 0x7fb63006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6301533c0 con 0x7fb6300b40e0 2023-07-06T22:00:23.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6301527b0 con 0x7fb63015b9d0 2023-07-06T22:00:23.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb635512640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb630152a90 con 0x7fb6300ce5e0 2023-07-06T22:00:23.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb62ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6300b40e0 0x7fb630156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb62ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6300b40e0 0x7fb630156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58494/0 (socket says 172.21.15.55:58494) 2023-07-06T22:00:23.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb62ffff640 1 -- 172.21.15.55:0/1904454203 learned_addr learned my addr 172.21.15.55:0/1904454203 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:23.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb62f7fe640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6300ce5e0 0x7fb63006a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.809+0000 7fb634d11640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb63015b9d0 0x7fb63006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb62ffff640 1 -- 172.21.15.55:0/1904454203 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6300ce5e0 msgr2=0x7fb63006a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb62ffff640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6300ce5e0 0x7fb63006a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb62ffff640 1 -- 172.21.15.55:0/1904454203 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb63015b9d0 msgr2=0x7fb63006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb62ffff640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb63015b9d0 0x7fb63006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb62ffff640 1 -- 172.21.15.55:0/1904454203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb628009b30 con 0x7fb6300b40e0 2023-07-06T22:00:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb634d11640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb63015b9d0 0x7fb63006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb62ffff640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6300b40e0 0x7fb630156bb0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fb62000c410 tx=0x7fb62000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb62cff9640 1 -- 172.21.15.55:0/1904454203 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6200074e0 con 0x7fb6300b40e0 2023-07-06T22:00:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb62cff9640 1 -- 172.21.15.55:0/1904454203 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb620007640 con 0x7fb6300b40e0 2023-07-06T22:00:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb62cff9640 1 -- 172.21.15.55:0/1904454203 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620004a30 con 0x7fb6300b40e0 2023-07-06T22:00:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb635512640 1 -- 172.21.15.55:0/1904454203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb624009420 con 0x7fb6300b40e0 2023-07-06T22:00:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb635512640 1 -- 172.21.15.55:0/1904454203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb630153050 con 0x7fb6300b40e0 2023-07-06T22:00:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb635512640 1 -- 172.21.15.55:0/1904454203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63004d790 con 0x7fb6300b40e0 2023-07-06T22:00:23.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb62cff9640 1 -- 172.21.15.55:0/1904454203 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb620004b90 con 0x7fb6300b40e0 2023-07-06T22:00:23.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb62cff9640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb61c0663a0 0x7fb61c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:23.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb62cff9640 1 -- 172.21.15.55:0/1904454203 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb620083e20 con 0x7fb6300b40e0 2023-07-06T22:00:23.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.813+0000 7fb62f7fe640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb61c0663a0 0x7fb61c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:23.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.817+0000 7fb62f7fe640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb61c0663a0 0x7fb61c068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb6240af000 tx=0x7fb6240a7000 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:23.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.817+0000 7fb62cff9640 1 -- 172.21.15.55:0/1904454203 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb620050f20 con 0x7fb6300b40e0 2023-07-06T22:00:23.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.969+0000 7fb635512640 1 -- 172.21.15.55:0/1904454203 --> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6300b67a0 con 0x7fb61c0663a0 2023-07-06T22:00:23.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.977+0000 7fb62cff9640 1 -- 172.21.15.55:0/1904454203 <== mgr.8376 v2:172.21.15.55:6832/3817107512 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299270 (secure 0 0 0) 0x7fb6300b67a0 con 0x7fb61c0663a0 2023-07-06T22:00:23.979 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:23.981 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:00:23.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.981+0000 7fb635512640 1 -- 172.21.15.55:0/1904454203 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb61c0663a0 msgr2=0x7fb61c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.981+0000 7fb635512640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb61c0663a0 0x7fb61c068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb6240af000 tx=0x7fb6240a7000 comp rx=0 tx=0).stop 2023-07-06T22:00:23.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.981+0000 7fb635512640 1 -- 172.21.15.55:0/1904454203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6300b40e0 msgr2=0x7fb630156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:23.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.981+0000 7fb635512640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6300b40e0 0x7fb630156bb0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fb62000c410 tx=0x7fb62000c8d0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.981+0000 7fb635512640 1 -- 172.21.15.55:0/1904454203 shutdown_connections 2023-07-06T22:00:23.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.981+0000 7fb635512640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb61c0663a0 0x7fb61c068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.981+0000 7fb635512640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb63015b9d0 0x7fb63006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.981+0000 7fb635512640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6300ce5e0 0x7fb63006a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.981+0000 7fb635512640 1 --2- 172.21.15.55:0/1904454203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6300b40e0 0x7fb630156bb0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:23.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.981+0000 7fb635512640 1 -- 172.21.15.55:0/1904454203 >> 172.21.15.55:0/1904454203 conn(0x7fb63006c2b0 msgr2=0x7fb630069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:23.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.981+0000 7fb635512640 1 -- 172.21.15.55:0/1904454203 shutdown_connections 2023-07-06T22:00:23.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:23.981+0000 7fb635512640 1 -- 172.21.15.55:0/1904454203 wait complete. 2023-07-06T22:00:24.001 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T22:00:23.003179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":326676,"kb_used_data":13524,"kb_used_omap":0,"kb_used_meta":313088,"kb_avail":754648044,"statfs":{"total":773094113280,"available":772759597056,"internally_reserved":0,"allocated":13848576,"data_stored":7872208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320602112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.921707"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093164+0000","last_change":"2023-07-06T22:00:18.093164+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093164+0000","last_undegraded":"2023-07-06T22:00:18.093164+0000","last_fullsized":"2023-07-06T22:00:18.093164+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.090571+0000","last_change":"2023-07-06T22:00:18.090571+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.090571+0000","last_undegraded":"2023-07-06T22:00:18.090571+0000","last_fullsized":"2023-07-06T22:00:18.090571+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084942+0000","last_change":"2023-07-06T22:00:18.084942+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084942+0000","last_undegraded":"2023-07-06T22:00:18.084942+0000","last_fullsized":"2023-07-06T22:00:18.084942+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084883+0000","last_change":"2023-07-06T22:00:18.084883+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084883+0000","last_undegraded":"2023-07-06T22:00:18.084883+0000","last_fullsized":"2023-07-06T22:00:18.084883+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093819+0000","last_change":"2023-07-06T22:00:18.093819+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093819+0000","last_undegraded":"2023-07-06T22:00:18.093819+0000","last_fullsized":"2023-07-06T22:00:18.093819+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.090356+0000","last_change":"2023-07-06T22:00:18.090356+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.090356+0000","last_undegraded":"2023-07-06T22:00:18.090356+0000","last_fullsized":"2023-07-06T22:00:18.090356+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.086289+0000","last_change":"2023-07-06T22:00:18.086289+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.086289+0000","last_undegraded":"2023-07-06T22:00:18.086289+0000","last_fullsized":"2023-07-06T22:00:18.086289+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.090709+0000","last_change":"2023-07-06T22:00:18.090709+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.090709+0000","last_undegraded":"2023-07-06T22:00:18.090709+0000","last_fullsized":"2023-07-06T22:00:18.090709+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.088523+0000","last_change":"2023-07-06T22:00:18.088523+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.088523+0000","last_undegraded":"2023-07-06T22:00:18.088523+0000","last_fullsized":"2023-07-06T22:00:18.088523+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084784+0000","last_change":"2023-07-06T22:00:18.084784+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084784+0000","last_undegraded":"2023-07-06T22:00:18.084784+0000","last_fullsized":"2023-07-06T22:00:18.084784+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.091021+0000","last_change":"2023-07-06T22:00:18.091021+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.091021+0000","last_undegraded":"2023-07-06T22:00:18.091021+0000","last_fullsized":"2023-07-06T22:00:18.091021+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093167+0000","last_change":"2023-07-06T22:00:18.093167+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093167+0000","last_undegraded":"2023-07-06T22:00:18.093167+0000","last_fullsized":"2023-07-06T22:00:18.093167+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087660+0000","last_change":"2023-07-06T22:00:18.087660+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087660+0000","last_undegraded":"2023-07-06T22:00:18.087660+0000","last_fullsized":"2023-07-06T22:00:18.087660+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084812+0000","last_change":"2023-07-06T22:00:18.084812+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084812+0000","last_undegraded":"2023-07-06T22:00:18.084812+0000","last_fullsized":"2023-07-06T22:00:18.084812+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087155+0000","last_change":"2023-07-06T22:00:18.087155+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087155+0000","last_undegraded":"2023-07-06T22:00:18.087155+0000","last_fullsized":"2023-07-06T22:00:18.087155+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.088255+0000","last_change":"2023-07-06T22:00:18.088255+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.088255+0000","last_undegraded":"2023-07-06T22:00:18.088255+0000","last_fullsized":"2023-07-06T22:00:18.088255+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.090015+0000","last_change":"2023-07-06T22:00:18.090015+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.090015+0000","last_undegraded":"2023-07-06T22:00:18.090015+0000","last_fullsized":"2023-07-06T22:00:18.090015+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.091028+0000","last_change":"2023-07-06T22:00:18.091028+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.091028+0000","last_undegraded":"2023-07-06T22:00:18.091028+0000","last_fullsized":"2023-07-06T22:00:18.091028+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087843+0000","last_change":"2023-07-06T22:00:18.087843+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087843+0000","last_undegraded":"2023-07-06T22:00:18.087843+0000","last_fullsized":"2023-07-06T22:00:18.087843+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.089401+0000","last_change":"2023-07-06T22:00:18.089401+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.089401+0000","last_undegraded":"2023-07-06T22:00:18.089401+0000","last_fullsized":"2023-07-06T22:00:18.089401+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093080+0000","last_change":"2023-07-06T22:00:18.093080+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093080+0000","last_undegraded":"2023-07-06T22:00:18.093080+0000","last_fullsized":"2023-07-06T22:00:18.093080+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.086280+0000","last_change":"2023-07-06T22:00:18.086280+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.086280+0000","last_undegraded":"2023-07-06T22:00:18.086280+0000","last_fullsized":"2023-07-06T22:00:18.086280+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084708+0000","last_change":"2023-07-06T22:00:18.084708+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084708+0000","last_undegraded":"2023-07-06T22:00:18.084708+0000","last_fullsized":"2023-07-06T22:00:18.084708+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087726+0000","last_change":"2023-07-06T22:00:18.087726+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087726+0000","last_undegraded":"2023-07-06T22:00:18.087726+0000","last_fullsized":"2023-07-06T22:00:18.087726+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093146+0000","last_change":"2023-07-06T22:00:18.093146+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093146+0000","last_undegraded":"2023-07-06T22:00:18.093146+0000","last_fullsized":"2023-07-06T22:00:18.093146+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"119'227","reported_seq":774,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.091187+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:00:18.091187+0000","last_peered":"2023-07-06T22:00:18.091187+0000","last_clean":"2023-07-06T22:00:18.091187+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:00:18.091187+0000","last_undegraded":"2023-07-06T22:00:18.091187+0000","last_fullsized":"2023-07-06T22:00:18.091187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:33:20.720666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.094486+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:00:18.094486+0000","last_peered":"2023-07-06T22:00:18.094486+0000","last_clean":"2023-07-06T22:00:18.094486+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:00:18.094486+0000","last_undegraded":"2023-07-06T22:00:18.094486+0000","last_fullsized":"2023-07-06T22:00:18.094486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:26:09.710631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.091218+0000","last_change":"2023-07-06T22:00:18.091218+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.091218+0000","last_undegraded":"2023-07-06T22:00:18.091218+0000","last_fullsized":"2023-07-06T22:00:18.091218+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.091119+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:00:18.091119+0000","last_peered":"2023-07-06T22:00:18.091119+0000","last_clean":"2023-07-06T22:00:18.091119+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:00:18.091119+0000","last_undegraded":"2023-07-06T22:00:18.091119+0000","last_fullsized":"2023-07-06T22:00:18.091119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:43:56.891335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.088104+0000","last_change":"2023-07-06T22:00:18.088104+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.088104+0000","last_undegraded":"2023-07-06T22:00:18.088104+0000","last_fullsized":"2023-07-06T22:00:18.088104+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":231,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.083538+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:00:18.083538+0000","last_peered":"2023-07-06T22:00:18.083538+0000","last_clean":"2023-07-06T22:00:18.083538+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:00:18.083538+0000","last_undegraded":"2023-07-06T22:00:18.083538+0000","last_fullsized":"2023-07-06T22:00:18.083538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:39:31.797252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084805+0000","last_change":"2023-07-06T22:00:18.084805+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084805+0000","last_undegraded":"2023-07-06T22:00:18.084805+0000","last_fullsized":"2023-07-06T22:00:18.084805+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.094266+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:00:18.094266+0000","last_peered":"2023-07-06T22:00:18.094266+0000","last_clean":"2023-07-06T22:00:18.094266+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:00:18.094266+0000","last_undegraded":"2023-07-06T22:00:18.094266+0000","last_fullsized":"2023-07-06T22:00:18.094266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:32:58.090295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.089476+0000","last_change":"2023-07-06T22:00:18.089476+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.089476+0000","last_undegraded":"2023-07-06T22:00:18.089476+0000","last_fullsized":"2023-07-06T22:00:18.089476+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":203,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.088811+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:00:18.088811+0000","last_peered":"2023-07-06T22:00:18.088811+0000","last_clean":"2023-07-06T22:00:18.088811+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:00:18.088811+0000","last_undegraded":"2023-07-06T22:00:18.088811+0000","last_fullsized":"2023-07-06T22:00:18.088811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:09:42.135640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.085149+0000","last_change":"2023-07-06T22:00:18.085149+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.085149+0000","last_undegraded":"2023-07-06T22:00:18.085149+0000","last_fullsized":"2023-07-06T22:00:18.085149+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.091207+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:00:18.091207+0000","last_peered":"2023-07-06T22:00:18.091207+0000","last_clean":"2023-07-06T22:00:18.091207+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:00:18.091207+0000","last_undegraded":"2023-07-06T22:00:18.091207+0000","last_fullsized":"2023-07-06T22:00:18.091207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:55:50.459937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087998+0000","last_change":"2023-07-06T22:00:18.087998+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087998+0000","last_undegraded":"2023-07-06T22:00:18.087998+0000","last_fullsized":"2023-07-06T22:00:18.087998+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":203,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.088762+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:00:18.088762+0000","last_peered":"2023-07-06T22:00:18.088762+0000","last_clean":"2023-07-06T22:00:18.088762+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:00:18.088762+0000","last_undegraded":"2023-07-06T22:00:18.088762+0000","last_fullsized":"2023-07-06T22:00:18.088762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:37:37.866649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.088313+0000","last_change":"2023-07-06T22:00:18.088313+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.088313+0000","last_undegraded":"2023-07-06T22:00:18.088313+0000","last_fullsized":"2023-07-06T22:00:18.088313+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":199,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.091713+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:00:18.091713+0000","last_peered":"2023-07-06T22:00:18.091713+0000","last_clean":"2023-07-06T22:00:18.091713+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:00:18.091713+0000","last_undegraded":"2023-07-06T22:00:18.091713+0000","last_fullsized":"2023-07-06T22:00:18.091713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:57:19.255279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575067,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":2179072,"data_stored":1427868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.53500000000000003,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.54900000000000004,"5min":0.45800000000000002,"15min":0.45400000000000001},"max":{"1min":0.98399999999999999,"5min":1.048,"15min":1.048},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69899999999999995,"15min":0.71399999999999997},"min":{"1min":0.54000000000000004,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.71899999999999997},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.68700000000000006,"15min":0.70299999999999996},"min":{"1min":0.53800000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.093,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.3480000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71799999999999997,"15min":0.71899999999999997},"min":{"1min":0.54400000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.181,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.73999999999999999},"min":{"1min":0.52400000000000002,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.2829999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.93000000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.97199999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85099999999999998,"5min":1.169,"15min":1.169},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45700000000000002,"5min":0.376,"15min":0.35599999999999998},"max":{"1min":0.876,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.39000000000000001},"max":{"1min":0.90200000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":1.0069999999999999,"5min":1.45,"15min":1.45},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.98599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575067,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36688,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335152,"statfs":{"total":96636764160,"available":96599195648,"internally_reserved":0,"allocated":1581056,"data_stored":836481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68200000000000005,"15min":0.70299999999999996},"min":{"1min":0.52200000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88900000000000001,"5min":0.94699999999999995,"15min":0.97899999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.73499999999999999,"15min":0.73399999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.83999999999999997}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68700000000000006,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.93000000000000005,"5min":0.998,"15min":1.0229999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.75600000000000001,"15min":0.747},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.71499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":0.86499999999999999,"5min":0.90400000000000003,"15min":1.0129999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.995,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.75,"15min":0.753},"min":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.45800000000000002},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70299999999999996,"15min":0.72999999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.874,"5min":0.94799999999999995,"15min":1.0629999999999999},"last":0.87}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.38400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95399999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.44700000000000001,"5min":0.40899999999999997,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.621},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.45200000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97599999999999998,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91700000000000004,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.876,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.57699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575066,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54740,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317100,"statfs":{"total":96636764160,"available":96580710400,"internally_reserved":0,"allocated":1585152,"data_stored":837500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.58499999999999996,"5min":0.40600000000000003,"15min":0.36699999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.35299999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68500000000000005,"15min":0.72099999999999997},"min":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70499999999999996,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.498,"5min":0.47899999999999998,"15min":0.39900000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.72199999999999998,"15min":0.745},"min":{"1min":0.51000000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.70999999999999996,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.622},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.73199999999999998,"15min":0.76000000000000001},"min":{"1min":0.52700000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.315,"15min":0.315},"max":{"1min":0.86399999999999999,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":1.02},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.62},"min":{"1min":0.433,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.45500000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91400000000000003,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.50900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95099999999999996,"5min":0.95299999999999996,"15min":1.0589999999999999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575065,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1572864,"data_stored":831010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.56100000000000005,"5min":0.46200000000000002,"15min":0.39400000000000002},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.079,"5min":1.123,"15min":1.123},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69999999999999996,"15min":0.71899999999999997},"min":{"1min":0.50700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.622},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69699999999999995,"15min":0.72099999999999997},"min":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.55200000000000005,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.745,"15min":0.752},"min":{"1min":0.55800000000000005,"5min":0.50600000000000001,"15min":0.49299999999999999},"max":{"1min":1.0609999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.308},"max":{"1min":0.82799999999999996,"5min":0.90600000000000003,"15min":0.94299999999999995},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.61199999999999999,"15min":0.59599999999999997},"min":{"1min":0.436,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.91800000000000004,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63500000000000001,"15min":0.60399999999999998},"min":{"1min":0.44800000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91000000000000003,"5min":1.036,"15min":1.036},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67400000000000004,"15min":0.65300000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.34799999999999998},"max":{"1min":0.93899999999999995,"5min":1,"15min":1},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68300000000000005,"15min":0.65500000000000003},"min":{"1min":0.53000000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.442,"15min":0.41599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.75}]}]},{"osd":3,"up_from":13,"seq":55834575066,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1585152,"data_stored":837500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.42999999999999999,"15min":0.45000000000000001},"min":{"1min":0.27500000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65600000000000003,"5min":0.78700000000000003,"15min":1.0489999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.53700000000000003},"min":{"1min":0.39700000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76000000000000001,"5min":2.77,"15min":2.77},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.24299999999999999},"max":{"1min":0.747,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56499999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.97799999999999998,"5min":1.351,"15min":1.351},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68799999999999994,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":1.24},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.746,"15min":0.76700000000000002},"min":{"1min":0.52700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.069,"5min":1.1930000000000001,"15min":1.3009999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.75,"15min":0.78200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.024,"5min":1.383,"15min":1.383},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.052,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.79000000000000004},"min":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.05,"5min":1.327,"15min":1.3999999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.79600000000000004},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96599999999999997,"5min":1.3140000000000001,"15min":1.425},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79400000000000004,"15min":0.80900000000000005},"min":{"1min":0.52700000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.085,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.626}]},{"osd":7,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77900000000000003,"15min":0.81100000000000005},"min":{"1min":0.58199999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.034,"5min":3.097,"15min":3.097},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77400000000000002,"15min":0.80600000000000005},"min":{"1min":0.47099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.107,"5min":1.1140000000000001,"15min":1.3480000000000001},"last":0.53100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575066,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36692,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335148,"statfs":{"total":96636764160,"available":96599191552,"internally_reserved":0,"allocated":1585152,"data_stored":837500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67400000000000004,"5min":0.81699999999999995,"15min":0.85999999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.47999999999999998,"15min":0.502},"min":{"1min":0.30599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.82199999999999995,"5min":0.84399999999999997,"15min":0.85999999999999999},"last":0.376}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.378,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79300000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.42299999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67200000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.439}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.50900000000000001},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.40100000000000002,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.85599999999999998,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.52900000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1379999999999999,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.52100000000000002,"5min":0.47499999999999998,"15min":0.41399999999999998},"max":{"1min":1.403,"5min":1.591,"15min":1.591},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.79400000000000004},"min":{"1min":0.58499999999999996,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.1910000000000001,"5min":1.333,"15min":1.333},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77600000000000002,"15min":0.81200000000000006},"min":{"1min":0.56799999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0169999999999999,"5min":1.327,"15min":1.327},"last":1.087}]},{"osd":6,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.81100000000000005,"15min":0.82099999999999995},"min":{"1min":0.58199999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5329999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.022},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.79800000000000004,"15min":0.81799999999999995},"min":{"1min":0.60899999999999999,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.4950000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.93500000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.80800000000000005,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.83699999999999997},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0880000000000001,"5min":1.573,"15min":1.573},"last":1.1180000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575067,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58836,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313004,"statfs":{"total":96636764160,"available":96576516096,"internally_reserved":0,"allocated":1585152,"data_stored":837500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.42999999999999999,"15min":0.443},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.626,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48399999999999999,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.69099999999999995,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69599999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.71399999999999997,"5min":0.79800000000000004,"15min":0.87},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.432,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.54600000000000004},"min":{"1min":0.39200000000000002,"5min":0.36699999999999999,"15min":0.32000000000000001},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.505}]},{"osd":4,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.74399999999999999,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.47599999999999998,"15min":0.38500000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.3140000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.76500000000000001,"15min":0.78700000000000003},"min":{"1min":0.66500000000000004,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.626,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.55100000000000005,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.357},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.68200000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.022},{"interface":"front","average":{"1min":0.878,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.71499999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.456},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.59099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.417},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.78600000000000003,"15min":0.81899999999999995},"min":{"1min":0.71699999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.88100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575066,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37268,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334572,"statfs":{"total":96636764160,"available":96598601728,"internally_reserved":0,"allocated":2174976,"data_stored":1426849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.436},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":0.624,"5min":0.73599999999999999,"15min":0.86399999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.755,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.497},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.70699999999999996,"5min":0.81100000000000005,"15min":0.82399999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.53400000000000003},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68999999999999995,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.49299999999999999,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76600000000000001,"5min":1.151,"15min":1.151},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53500000000000003,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.874},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.72899999999999998,"15min":0.78200000000000003},"min":{"1min":0.52700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73399999999999999,"15min":0.78100000000000003},"min":{"1min":0.54200000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.876}]},{"osd":5,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.754,"15min":0.79500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72199999999999998,"15min":0.78100000000000003},"min":{"1min":0.57199999999999995,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75900000000000001,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.746,"15min":0.78600000000000003},"min":{"1min":0.58499999999999996,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.80600000000000005},"min":{"1min":0.56799999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.78200000000000003,"15min":0.81399999999999995},"min":{"1min":0.60099999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.84399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:00:24.008 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.185+0000 7fdfbc9fa640 1 Processor -- start 2023-07-06T22:00:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.185+0000 7fdfbc9fa640 1 -- start start 2023-07-06T22:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfbc9fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfb80b7cd0 0x7fdfb80ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfbc9fa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdfb80ccab0 0x7fdfb80b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfbc9fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb80ccf00 0x7fdfb80b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfbc9fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb80d2310 con 0x7fdfb80b7cd0 2023-07-06T22:00:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfbc9fa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb80b80a0 con 0x7fdfb80ccab0 2023-07-06T22:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfbc9fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb80d1100 con 0x7fdfb80ccf00 2023-07-06T22:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfb659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfb80b7cd0 0x7fdfb80ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfb659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfb80b7cd0 0x7fdfb80ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58506/0 (socket says 172.21.15.55:58506) 2023-07-06T22:00:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfb659c640 1 -- 172.21.15.55:0/1126438180 learned_addr learned my addr 172.21.15.55:0/1126438180 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfb659c640 1 -- 172.21.15.55:0/1126438180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb80ccf00 msgr2=0x7fdfb80b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfb659c640 1 --2- 172.21.15.55:0/1126438180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb80ccf00 0x7fdfb80b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfb659c640 1 -- 172.21.15.55:0/1126438180 >> v2:172.21.15.138:3300/0 conn(0x7fdfb80ccab0 msgr2=0x7fdfb80b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfb659c640 1 --2- 172.21.15.55:0/1126438180 >> v2:172.21.15.138:3300/0 conn(0x7fdfb80ccab0 0x7fdfb80b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfb659c640 1 -- 172.21.15.55:0/1126438180 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb80cecf0 con 0x7fdfb80b7cd0 2023-07-06T22:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfb659c640 1 --2- 172.21.15.55:0/1126438180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b7cd0 0x7fdfb80ce610 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8065af0 tx=0x7fdfa801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f531fae775f5d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.189+0000 7fdfb5d9b640 1 -- 172.21.15.55:0/1126438180 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80ab600 con 0x7fdfb80b7cd0 2023-07-06T22:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfb5d9b640 1 -- 172.21.15.55:0/1126438180 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa80a7050 con 0x7fdfb80b7cd0 2023-07-06T22:00:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfb5d9b640 1 -- 172.21.15.55:0/1126438180 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80ab980 con 0x7fdfb80b7cd0 2023-07-06T22:00:24.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/1126438180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b7cd0 msgr2=0x7fdfb80ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:24.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 --2- 172.21.15.55:0/1126438180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b7cd0 0x7fdfb80ce610 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8065af0 tx=0x7fdfa801c470 comp rx=0 tx=0).stop 2023-07-06T22:00:24.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/1126438180 shutdown_connections 2023-07-06T22:00:24.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 --2- 172.21.15.55:0/1126438180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb80ccf00 0x7fdfb80b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 --2- 172.21.15.55:0/1126438180 >> v2:172.21.15.138:3300/0 conn(0x7fdfb80ccab0 0x7fdfb80b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 --2- 172.21.15.55:0/1126438180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b7cd0 0x7fdfb80ce610 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/1126438180 >> 172.21.15.55:0/1126438180 conn(0x7fdfb80ceee0 msgr2=0x7fdfb80cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/1126438180 shutdown_connections 2023-07-06T22:00:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/1126438180 wait complete. 2023-07-06T22:00:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 Processor -- start 2023-07-06T22:00:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 -- start start 2023-07-06T22:00:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb80b7cd0 0x7fdfb814ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80ccab0 0x7fdfb815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfb80ccf00 0x7fdfb81464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb814f230 con 0x7fdfb80ccab0 2023-07-06T22:00:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb814d3c0 con 0x7fdfb80ccf00 2023-07-06T22:00:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfbc9fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb814df30 con 0x7fdfb80b7cd0 2023-07-06T22:00:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfaffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80ccab0 0x7fdfb815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfaffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80ccab0 0x7fdfb815ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58518/0 (socket says 172.21.15.55:58518) 2023-07-06T22:00:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfaffff640 1 -- 172.21.15.55:0/4180118653 learned_addr learned my addr 172.21.15.55:0/4180118653 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.193+0000 7fdfb659c640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb80b7cd0 0x7fdfb814ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfb6d9d640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfb80ccf00 0x7fdfb81464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfaffff640 1 -- 172.21.15.55:0/4180118653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb80b7cd0 msgr2=0x7fdfb814ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfaffff640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb80b7cd0 0x7fdfb814ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfaffff640 1 -- 172.21.15.55:0/4180118653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfb80ccf00 msgr2=0x7fdfb81464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfaffff640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfb80ccf00 0x7fdfb81464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfaffff640 1 -- 172.21.15.55:0/4180118653 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa80094d0 con 0x7fdfb80ccab0 2023-07-06T22:00:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfb6d9d640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfb80ccf00 0x7fdfb81464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfaffff640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80ccab0 0x7fdfb815ac30 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000b550 tx=0x7fdfa000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfaeffd640 1 -- 172.21.15.55:0/4180118653 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0010870 con 0x7fdfb80ccab0 2023-07-06T22:00:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfaeffd640 1 -- 172.21.15.55:0/4180118653 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa00109f0 con 0x7fdfb80ccab0 2023-07-06T22:00:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfaeffd640 1 -- 172.21.15.55:0/4180118653 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0010da0 con 0x7fdfb80ccab0 2023-07-06T22:00:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/4180118653 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb814e210 con 0x7fdfb80ccab0 2023-07-06T22:00:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/4180118653 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb814e7d0 con 0x7fdfb80ccab0 2023-07-06T22:00:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/4180118653 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb8066d60 con 0x7fdfb80ccab0 2023-07-06T22:00:24.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfaeffd640 1 -- 172.21.15.55:0/4180118653 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdfa000f3c0 con 0x7fdfb80ccab0 2023-07-06T22:00:24.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfaeffd640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fdf980663d0 0x7fdf98068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.197+0000 7fdfaeffd640 1 -- 172.21.15.55:0/4180118653 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdfa0083f10 con 0x7fdfb80ccab0 2023-07-06T22:00:24.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.201+0000 7fdfb659c640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fdf980663d0 0x7fdf98068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:24.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.201+0000 7fdfb659c640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fdf980663d0 0x7fdf98068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80ad000 tx=0x7fdfa80a6000 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:24.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.201+0000 7fdfaeffd640 1 -- 172.21.15.55:0/4180118653 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfa00511f0 con 0x7fdfb80ccab0 2023-07-06T22:00:24.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.357+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/4180118653 --> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdfb80b1620 con 0x7fdf980663d0 2023-07-06T22:00:24.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.365+0000 7fdfaeffd640 1 -- 172.21.15.55:0/4180118653 <== mgr.8376 v2:172.21.15.55:6832/3817107512 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299270 (secure 0 0 0) 0x7fdfa80ab400 con 0x7fdf980663d0 2023-07-06T22:00:24.368 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:24.370 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:00:24.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.369+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/4180118653 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fdf980663d0 msgr2=0x7fdf98068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.369+0000 7fdfbc9fa640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fdf980663d0 0x7fdf98068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80ad000 tx=0x7fdfa80a6000 comp rx=0 tx=0).stop 2023-07-06T22:00:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.369+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/4180118653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80ccab0 msgr2=0x7fdfb815ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.369+0000 7fdfbc9fa640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80ccab0 0x7fdfb815ac30 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000b550 tx=0x7fdfa000ba10 comp rx=0 tx=0).stop 2023-07-06T22:00:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.369+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/4180118653 shutdown_connections 2023-07-06T22:00:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.369+0000 7fdfbc9fa640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fdf980663d0 0x7fdf98068880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.369+0000 7fdfbc9fa640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfb80ccf00 0x7fdfb81464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.369+0000 7fdfbc9fa640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80ccab0 0x7fdfb815ac30 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.369+0000 7fdfbc9fa640 1 --2- 172.21.15.55:0/4180118653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb80b7cd0 0x7fdfb814ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.369+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/4180118653 >> 172.21.15.55:0/4180118653 conn(0x7fdfb80ceee0 msgr2=0x7fdfb80b5290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:24.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.369+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/4180118653 shutdown_connections 2023-07-06T22:00:24.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.369+0000 7fdfbc9fa640 1 -- 172.21.15.55:0/4180118653 wait complete. 2023-07-06T22:00:24.389 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T22:00:23.003179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":326676,"kb_used_data":13524,"kb_used_omap":0,"kb_used_meta":313088,"kb_avail":754648044,"statfs":{"total":773094113280,"available":772759597056,"internally_reserved":0,"allocated":13848576,"data_stored":7872208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320602112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.921707"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093164+0000","last_change":"2023-07-06T22:00:18.093164+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093164+0000","last_undegraded":"2023-07-06T22:00:18.093164+0000","last_fullsized":"2023-07-06T22:00:18.093164+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.090571+0000","last_change":"2023-07-06T22:00:18.090571+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.090571+0000","last_undegraded":"2023-07-06T22:00:18.090571+0000","last_fullsized":"2023-07-06T22:00:18.090571+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084942+0000","last_change":"2023-07-06T22:00:18.084942+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084942+0000","last_undegraded":"2023-07-06T22:00:18.084942+0000","last_fullsized":"2023-07-06T22:00:18.084942+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084883+0000","last_change":"2023-07-06T22:00:18.084883+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084883+0000","last_undegraded":"2023-07-06T22:00:18.084883+0000","last_fullsized":"2023-07-06T22:00:18.084883+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093819+0000","last_change":"2023-07-06T22:00:18.093819+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093819+0000","last_undegraded":"2023-07-06T22:00:18.093819+0000","last_fullsized":"2023-07-06T22:00:18.093819+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.090356+0000","last_change":"2023-07-06T22:00:18.090356+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.090356+0000","last_undegraded":"2023-07-06T22:00:18.090356+0000","last_fullsized":"2023-07-06T22:00:18.090356+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.086289+0000","last_change":"2023-07-06T22:00:18.086289+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.086289+0000","last_undegraded":"2023-07-06T22:00:18.086289+0000","last_fullsized":"2023-07-06T22:00:18.086289+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.090709+0000","last_change":"2023-07-06T22:00:18.090709+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.090709+0000","last_undegraded":"2023-07-06T22:00:18.090709+0000","last_fullsized":"2023-07-06T22:00:18.090709+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.088523+0000","last_change":"2023-07-06T22:00:18.088523+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.088523+0000","last_undegraded":"2023-07-06T22:00:18.088523+0000","last_fullsized":"2023-07-06T22:00:18.088523+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084784+0000","last_change":"2023-07-06T22:00:18.084784+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084784+0000","last_undegraded":"2023-07-06T22:00:18.084784+0000","last_fullsized":"2023-07-06T22:00:18.084784+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.091021+0000","last_change":"2023-07-06T22:00:18.091021+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.091021+0000","last_undegraded":"2023-07-06T22:00:18.091021+0000","last_fullsized":"2023-07-06T22:00:18.091021+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093167+0000","last_change":"2023-07-06T22:00:18.093167+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093167+0000","last_undegraded":"2023-07-06T22:00:18.093167+0000","last_fullsized":"2023-07-06T22:00:18.093167+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087660+0000","last_change":"2023-07-06T22:00:18.087660+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087660+0000","last_undegraded":"2023-07-06T22:00:18.087660+0000","last_fullsized":"2023-07-06T22:00:18.087660+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084812+0000","last_change":"2023-07-06T22:00:18.084812+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084812+0000","last_undegraded":"2023-07-06T22:00:18.084812+0000","last_fullsized":"2023-07-06T22:00:18.084812+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087155+0000","last_change":"2023-07-06T22:00:18.087155+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087155+0000","last_undegraded":"2023-07-06T22:00:18.087155+0000","last_fullsized":"2023-07-06T22:00:18.087155+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.088255+0000","last_change":"2023-07-06T22:00:18.088255+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.088255+0000","last_undegraded":"2023-07-06T22:00:18.088255+0000","last_fullsized":"2023-07-06T22:00:18.088255+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.090015+0000","last_change":"2023-07-06T22:00:18.090015+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.090015+0000","last_undegraded":"2023-07-06T22:00:18.090015+0000","last_fullsized":"2023-07-06T22:00:18.090015+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.091028+0000","last_change":"2023-07-06T22:00:18.091028+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.091028+0000","last_undegraded":"2023-07-06T22:00:18.091028+0000","last_fullsized":"2023-07-06T22:00:18.091028+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087843+0000","last_change":"2023-07-06T22:00:18.087843+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087843+0000","last_undegraded":"2023-07-06T22:00:18.087843+0000","last_fullsized":"2023-07-06T22:00:18.087843+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.089401+0000","last_change":"2023-07-06T22:00:18.089401+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.089401+0000","last_undegraded":"2023-07-06T22:00:18.089401+0000","last_fullsized":"2023-07-06T22:00:18.089401+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093080+0000","last_change":"2023-07-06T22:00:18.093080+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093080+0000","last_undegraded":"2023-07-06T22:00:18.093080+0000","last_fullsized":"2023-07-06T22:00:18.093080+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.086280+0000","last_change":"2023-07-06T22:00:18.086280+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.086280+0000","last_undegraded":"2023-07-06T22:00:18.086280+0000","last_fullsized":"2023-07-06T22:00:18.086280+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084708+0000","last_change":"2023-07-06T22:00:18.084708+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084708+0000","last_undegraded":"2023-07-06T22:00:18.084708+0000","last_fullsized":"2023-07-06T22:00:18.084708+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087726+0000","last_change":"2023-07-06T22:00:18.087726+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087726+0000","last_undegraded":"2023-07-06T22:00:18.087726+0000","last_fullsized":"2023-07-06T22:00:18.087726+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.093146+0000","last_change":"2023-07-06T22:00:18.093146+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.093146+0000","last_undegraded":"2023-07-06T22:00:18.093146+0000","last_fullsized":"2023-07-06T22:00:18.093146+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"119'227","reported_seq":774,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.091187+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:00:18.091187+0000","last_peered":"2023-07-06T22:00:18.091187+0000","last_clean":"2023-07-06T22:00:18.091187+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:00:18.091187+0000","last_undegraded":"2023-07-06T22:00:18.091187+0000","last_fullsized":"2023-07-06T22:00:18.091187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:33:20.720666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.094486+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:00:18.094486+0000","last_peered":"2023-07-06T22:00:18.094486+0000","last_clean":"2023-07-06T22:00:18.094486+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:00:18.094486+0000","last_undegraded":"2023-07-06T22:00:18.094486+0000","last_fullsized":"2023-07-06T22:00:18.094486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:26:09.710631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.091218+0000","last_change":"2023-07-06T22:00:18.091218+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.091218+0000","last_undegraded":"2023-07-06T22:00:18.091218+0000","last_fullsized":"2023-07-06T22:00:18.091218+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.091119+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:00:18.091119+0000","last_peered":"2023-07-06T22:00:18.091119+0000","last_clean":"2023-07-06T22:00:18.091119+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:00:18.091119+0000","last_undegraded":"2023-07-06T22:00:18.091119+0000","last_fullsized":"2023-07-06T22:00:18.091119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:43:56.891335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.088104+0000","last_change":"2023-07-06T22:00:18.088104+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.088104+0000","last_undegraded":"2023-07-06T22:00:18.088104+0000","last_fullsized":"2023-07-06T22:00:18.088104+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":231,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.083538+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:00:18.083538+0000","last_peered":"2023-07-06T22:00:18.083538+0000","last_clean":"2023-07-06T22:00:18.083538+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:00:18.083538+0000","last_undegraded":"2023-07-06T22:00:18.083538+0000","last_fullsized":"2023-07-06T22:00:18.083538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:39:31.797252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.084805+0000","last_change":"2023-07-06T22:00:18.084805+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.084805+0000","last_undegraded":"2023-07-06T22:00:18.084805+0000","last_fullsized":"2023-07-06T22:00:18.084805+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.094266+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:00:18.094266+0000","last_peered":"2023-07-06T22:00:18.094266+0000","last_clean":"2023-07-06T22:00:18.094266+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:00:18.094266+0000","last_undegraded":"2023-07-06T22:00:18.094266+0000","last_fullsized":"2023-07-06T22:00:18.094266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:32:58.090295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.089476+0000","last_change":"2023-07-06T22:00:18.089476+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.089476+0000","last_undegraded":"2023-07-06T22:00:18.089476+0000","last_fullsized":"2023-07-06T22:00:18.089476+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":203,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.088811+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:00:18.088811+0000","last_peered":"2023-07-06T22:00:18.088811+0000","last_clean":"2023-07-06T22:00:18.088811+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:00:18.088811+0000","last_undegraded":"2023-07-06T22:00:18.088811+0000","last_fullsized":"2023-07-06T22:00:18.088811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:09:42.135640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.085149+0000","last_change":"2023-07-06T22:00:18.085149+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.085149+0000","last_undegraded":"2023-07-06T22:00:18.085149+0000","last_fullsized":"2023-07-06T22:00:18.085149+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":227,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.091207+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:00:18.091207+0000","last_peered":"2023-07-06T22:00:18.091207+0000","last_clean":"2023-07-06T22:00:18.091207+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:00:18.091207+0000","last_undegraded":"2023-07-06T22:00:18.091207+0000","last_fullsized":"2023-07-06T22:00:18.091207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:55:50.459937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.087998+0000","last_change":"2023-07-06T22:00:18.087998+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.087998+0000","last_undegraded":"2023-07-06T22:00:18.087998+0000","last_fullsized":"2023-07-06T22:00:18.087998+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":203,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.088762+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:00:18.088762+0000","last_peered":"2023-07-06T22:00:18.088762+0000","last_clean":"2023-07-06T22:00:18.088762+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:00:18.088762+0000","last_undegraded":"2023-07-06T22:00:18.088762+0000","last_fullsized":"2023-07-06T22:00:18.088762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:37:37.866649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:00:19.081465+0000","last_change":"2023-07-06T22:00:19.081465+0000","last_active":"2023-07-06T22:00:19.081465+0000","last_peered":"2023-07-06T22:00:19.081465+0000","last_clean":"2023-07-06T22:00:19.081465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:19.081465+0000","last_undegraded":"2023-07-06T22:00:19.081465+0000","last_fullsized":"2023-07-06T22:00:19.081465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2023-07-06T22:00:18.088313+0000","last_change":"2023-07-06T22:00:18.088313+0000","last_active":"2023-07-06T22:00:18.070448+0000","last_peered":"2023-07-06T22:00:18.070448+0000","last_clean":"2023-07-06T22:00:18.070448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:00:18.088313+0000","last_undegraded":"2023-07-06T22:00:18.088313+0000","last_fullsized":"2023-07-06T22:00:18.088313+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":199,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-06T22:00:18.091713+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:00:18.091713+0000","last_peered":"2023-07-06T22:00:18.091713+0000","last_clean":"2023-07-06T22:00:18.091713+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:00:18.091713+0000","last_undegraded":"2023-07-06T22:00:18.091713+0000","last_fullsized":"2023-07-06T22:00:18.091713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:57:19.255279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575067,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":2179072,"data_stored":1427868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.53500000000000003,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.54900000000000004,"5min":0.45800000000000002,"15min":0.45400000000000001},"max":{"1min":0.98399999999999999,"5min":1.048,"15min":1.048},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69899999999999995,"15min":0.71399999999999997},"min":{"1min":0.54000000000000004,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.71899999999999997},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.68700000000000006,"15min":0.70299999999999996},"min":{"1min":0.53800000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.093,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.3480000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71799999999999997,"15min":0.71899999999999997},"min":{"1min":0.54400000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.181,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.73999999999999999},"min":{"1min":0.52400000000000002,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.2829999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.93000000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.97199999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85099999999999998,"5min":1.169,"15min":1.169},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45700000000000002,"5min":0.376,"15min":0.35599999999999998},"max":{"1min":0.876,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.39000000000000001},"max":{"1min":0.90200000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":1.0069999999999999,"5min":1.45,"15min":1.45},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.98599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575067,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36688,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335152,"statfs":{"total":96636764160,"available":96599195648,"internally_reserved":0,"allocated":1581056,"data_stored":836481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68200000000000005,"15min":0.70299999999999996},"min":{"1min":0.52200000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88900000000000001,"5min":0.94699999999999995,"15min":0.97899999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.73499999999999999,"15min":0.73399999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.83999999999999997}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68700000000000006,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.93000000000000005,"5min":0.998,"15min":1.0229999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.75600000000000001,"15min":0.747},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.71499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":0.86499999999999999,"5min":0.90400000000000003,"15min":1.0129999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.995,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.75,"15min":0.753},"min":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.45800000000000002},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70299999999999996,"15min":0.72999999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.874,"5min":0.94799999999999995,"15min":1.0629999999999999},"last":0.87}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.38400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95399999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.44700000000000001,"5min":0.40899999999999997,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.621},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.45200000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97599999999999998,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91700000000000004,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.876,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.57699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575066,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54740,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317100,"statfs":{"total":96636764160,"available":96580710400,"internally_reserved":0,"allocated":1585152,"data_stored":837500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.58499999999999996,"5min":0.40600000000000003,"15min":0.36699999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.35299999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68500000000000005,"15min":0.72099999999999997},"min":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70499999999999996,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.498,"5min":0.47899999999999998,"15min":0.39900000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.72199999999999998,"15min":0.745},"min":{"1min":0.51000000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.70999999999999996,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.622},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.73199999999999998,"15min":0.76000000000000001},"min":{"1min":0.52700000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.315,"15min":0.315},"max":{"1min":0.86399999999999999,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":1.02},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.62},"min":{"1min":0.433,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.45500000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91400000000000003,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.50900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95099999999999996,"5min":0.95299999999999996,"15min":1.0589999999999999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575065,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1572864,"data_stored":831010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.56100000000000005,"5min":0.46200000000000002,"15min":0.39400000000000002},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.079,"5min":1.123,"15min":1.123},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69999999999999996,"15min":0.71899999999999997},"min":{"1min":0.50700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.622},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69699999999999995,"15min":0.72099999999999997},"min":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.55200000000000005,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.745,"15min":0.752},"min":{"1min":0.55800000000000005,"5min":0.50600000000000001,"15min":0.49299999999999999},"max":{"1min":1.0609999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.308},"max":{"1min":0.82799999999999996,"5min":0.90600000000000003,"15min":0.94299999999999995},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.61199999999999999,"15min":0.59599999999999997},"min":{"1min":0.436,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.91800000000000004,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63500000000000001,"15min":0.60399999999999998},"min":{"1min":0.44800000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91000000000000003,"5min":1.036,"15min":1.036},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67400000000000004,"15min":0.65300000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.34799999999999998},"max":{"1min":0.93899999999999995,"5min":1,"15min":1},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68300000000000005,"15min":0.65500000000000003},"min":{"1min":0.53000000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.442,"15min":0.41599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.75}]}]},{"osd":3,"up_from":13,"seq":55834575066,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1585152,"data_stored":837500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.42999999999999999,"15min":0.45000000000000001},"min":{"1min":0.27500000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65600000000000003,"5min":0.78700000000000003,"15min":1.0489999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.53700000000000003},"min":{"1min":0.39700000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76000000000000001,"5min":2.77,"15min":2.77},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.24299999999999999},"max":{"1min":0.747,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56499999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.97799999999999998,"5min":1.351,"15min":1.351},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68799999999999994,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":1.24},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.746,"15min":0.76700000000000002},"min":{"1min":0.52700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.069,"5min":1.1930000000000001,"15min":1.3009999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.75,"15min":0.78200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.024,"5min":1.383,"15min":1.383},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.052,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.79000000000000004},"min":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.05,"5min":1.327,"15min":1.3999999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.79600000000000004},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96599999999999997,"5min":1.3140000000000001,"15min":1.425},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79400000000000004,"15min":0.80900000000000005},"min":{"1min":0.52700000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.085,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.626}]},{"osd":7,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77900000000000003,"15min":0.81100000000000005},"min":{"1min":0.58199999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.034,"5min":3.097,"15min":3.097},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77400000000000002,"15min":0.80600000000000005},"min":{"1min":0.47099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.107,"5min":1.1140000000000001,"15min":1.3480000000000001},"last":0.53100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575066,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36692,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335148,"statfs":{"total":96636764160,"available":96599191552,"internally_reserved":0,"allocated":1585152,"data_stored":837500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67400000000000004,"5min":0.81699999999999995,"15min":0.85999999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.47999999999999998,"15min":0.502},"min":{"1min":0.30599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.82199999999999995,"5min":0.84399999999999997,"15min":0.85999999999999999},"last":0.376}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.378,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79300000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.42299999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67200000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.439}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.50900000000000001},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.40100000000000002,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.85599999999999998,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.52900000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1379999999999999,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.52100000000000002,"5min":0.47499999999999998,"15min":0.41399999999999998},"max":{"1min":1.403,"5min":1.591,"15min":1.591},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.79400000000000004},"min":{"1min":0.58499999999999996,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.1910000000000001,"5min":1.333,"15min":1.333},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77600000000000002,"15min":0.81200000000000006},"min":{"1min":0.56799999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0169999999999999,"5min":1.327,"15min":1.327},"last":1.087}]},{"osd":6,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.81100000000000005,"15min":0.82099999999999995},"min":{"1min":0.58199999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5329999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.022},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.79800000000000004,"15min":0.81799999999999995},"min":{"1min":0.60899999999999999,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.4950000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.93500000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.80800000000000005,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.83699999999999997},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0880000000000001,"5min":1.573,"15min":1.573},"last":1.1180000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575067,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58836,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313004,"statfs":{"total":96636764160,"available":96576516096,"internally_reserved":0,"allocated":1585152,"data_stored":837500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.42999999999999999,"15min":0.443},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.626,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48399999999999999,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.69099999999999995,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69599999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.71399999999999997,"5min":0.79800000000000004,"15min":0.87},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.432,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.54600000000000004},"min":{"1min":0.39200000000000002,"5min":0.36699999999999999,"15min":0.32000000000000001},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.505}]},{"osd":4,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.74399999999999999,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.47599999999999998,"15min":0.38500000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.3140000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.76500000000000001,"15min":0.78700000000000003},"min":{"1min":0.66500000000000004,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.626,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.55100000000000005,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.357},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.68200000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.022},{"interface":"front","average":{"1min":0.878,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.71499999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.456},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.59099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.417},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.78600000000000003,"15min":0.81899999999999995},"min":{"1min":0.71699999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.88100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575066,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37268,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334572,"statfs":{"total":96636764160,"available":96598601728,"internally_reserved":0,"allocated":2174976,"data_stored":1426849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.436},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":0.624,"5min":0.73599999999999999,"15min":0.86399999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.755,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.497},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.70699999999999996,"5min":0.81100000000000005,"15min":0.82399999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.53400000000000003},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68999999999999995,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.49299999999999999,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76600000000000001,"5min":1.151,"15min":1.151},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53500000000000003,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.874},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.72899999999999998,"15min":0.78200000000000003},"min":{"1min":0.52700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73399999999999999,"15min":0.78100000000000003},"min":{"1min":0.54200000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.876}]},{"osd":5,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.754,"15min":0.79500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72199999999999998,"15min":0.78100000000000003},"min":{"1min":0.57199999999999995,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75900000000000001,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.746,"15min":0.78600000000000003},"min":{"1min":0.58499999999999996,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.80600000000000005},"min":{"1min":0.56799999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.78200000000000003,"15min":0.81399999999999995},"min":{"1min":0.60099999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.84399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:00:24.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3f is not active+clean 2023-07-06T22:00:24.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3e is not active+clean 2023-07-06T22:00:24.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3d is not active+clean 2023-07-06T22:00:24.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3c is not active+clean 2023-07-06T22:00:24.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3b is not active+clean 2023-07-06T22:00:24.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3a is not active+clean 2023-07-06T22:00:24.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.39 is not active+clean 2023-07-06T22:00:24.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.38 is not active+clean 2023-07-06T22:00:24.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.37 is not active+clean 2023-07-06T22:00:24.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.36 is not active+clean 2023-07-06T22:00:24.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.402 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.35 is not active+clean 2023-07-06T22:00:24.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.34 is not active+clean 2023-07-06T22:00:24.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.33 is not active+clean 2023-07-06T22:00:24.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.32 is not active+clean 2023-07-06T22:00:24.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.31 is not active+clean 2023-07-06T22:00:24.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.30 is not active+clean 2023-07-06T22:00:24.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2f is not active+clean 2023-07-06T22:00:24.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2e is not active+clean 2023-07-06T22:00:24.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2d is not active+clean 2023-07-06T22:00:24.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2c is not active+clean 2023-07-06T22:00:24.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2b is not active+clean 2023-07-06T22:00:24.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2a is not active+clean 2023-07-06T22:00:24.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.29 is not active+clean 2023-07-06T22:00:24.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.28 is not active+clean 2023-07-06T22:00:24.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.27 is not active+clean 2023-07-06T22:00:24.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.26 is not active+clean 2023-07-06T22:00:24.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.25 is not active+clean 2023-07-06T22:00:24.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.24 is not active+clean 2023-07-06T22:00:24.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.23 is not active+clean 2023-07-06T22:00:24.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.22 is not active+clean 2023-07-06T22:00:24.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.21 is not active+clean 2023-07-06T22:00:24.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.20 is not active+clean 2023-07-06T22:00:24.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1e is not active+clean 2023-07-06T22:00:24.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2023-07-06T22:00:24.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.093164+0000', 'last_change': '2023-07-06T22:00:18.093164+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.093164+0000', 'last_undegraded': '2023-07-06T22:00:18.093164+0000', 'last_fullsized': '2023-07-06T22:00:18.093164+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:00:24.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1f is not active+clean 2023-07-06T22:00:24.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-07-06T22:00:24.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.090571+0000', 'last_change': '2023-07-06T22:00:18.090571+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.090571+0000', 'last_undegraded': '2023-07-06T22:00:18.090571+0000', 'last_fullsized': '2023-07-06T22:00:18.090571+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:00:24.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1c is not active+clean 2023-07-06T22:00:24.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2023-07-06T22:00:24.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.084942+0000', 'last_change': '2023-07-06T22:00:18.084942+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.084942+0000', 'last_undegraded': '2023-07-06T22:00:18.084942+0000', 'last_fullsized': '2023-07-06T22:00:18.084942+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:00:24.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1d is not active+clean 2023-07-06T22:00:24.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2023-07-06T22:00:24.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.084883+0000', 'last_change': '2023-07-06T22:00:18.084883+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.084883+0000', 'last_undegraded': '2023-07-06T22:00:18.084883+0000', 'last_fullsized': '2023-07-06T22:00:18.084883+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:00:24.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1a is not active+clean 2023-07-06T22:00:24.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2023-07-06T22:00:24.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.093819+0000', 'last_change': '2023-07-06T22:00:18.093819+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.093819+0000', 'last_undegraded': '2023-07-06T22:00:18.093819+0000', 'last_fullsized': '2023-07-06T22:00:18.093819+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:00:24.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1b is not active+clean 2023-07-06T22:00:24.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2023-07-06T22:00:24.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.090356+0000', 'last_change': '2023-07-06T22:00:18.090356+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.090356+0000', 'last_undegraded': '2023-07-06T22:00:18.090356+0000', 'last_fullsized': '2023-07-06T22:00:18.090356+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:00:24.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.18 is not active+clean 2023-07-06T22:00:24.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2023-07-06T22:00:24.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.086289+0000', 'last_change': '2023-07-06T22:00:18.086289+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.086289+0000', 'last_undegraded': '2023-07-06T22:00:18.086289+0000', 'last_fullsized': '2023-07-06T22:00:18.086289+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T22:00:24.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.19 is not active+clean 2023-07-06T22:00:24.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2023-07-06T22:00:24.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.090709+0000', 'last_change': '2023-07-06T22:00:18.090709+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.090709+0000', 'last_undegraded': '2023-07-06T22:00:18.090709+0000', 'last_fullsized': '2023-07-06T22:00:18.090709+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T22:00:24.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.e is not active+clean 2023-07-06T22:00:24.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2023-07-06T22:00:24.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.088523+0000', 'last_change': '2023-07-06T22:00:18.088523+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.088523+0000', 'last_undegraded': '2023-07-06T22:00:18.088523+0000', 'last_fullsized': '2023-07-06T22:00:18.088523+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T22:00:24.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.f is not active+clean 2023-07-06T22:00:24.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2023-07-06T22:00:24.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.084784+0000', 'last_change': '2023-07-06T22:00:18.084784+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.084784+0000', 'last_undegraded': '2023-07-06T22:00:18.084784+0000', 'last_fullsized': '2023-07-06T22:00:18.084784+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:00:24.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.c is not active+clean 2023-07-06T22:00:24.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2023-07-06T22:00:24.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.091021+0000', 'last_change': '2023-07-06T22:00:18.091021+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.091021+0000', 'last_undegraded': '2023-07-06T22:00:18.091021+0000', 'last_fullsized': '2023-07-06T22:00:18.091021+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T22:00:24.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.d is not active+clean 2023-07-06T22:00:24.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2023-07-06T22:00:24.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.093167+0000', 'last_change': '2023-07-06T22:00:18.093167+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.093167+0000', 'last_undegraded': '2023-07-06T22:00:18.093167+0000', 'last_fullsized': '2023-07-06T22:00:18.093167+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:00:24.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.a is not active+clean 2023-07-06T22:00:24.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2023-07-06T22:00:24.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.087660+0000', 'last_change': '2023-07-06T22:00:18.087660+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.087660+0000', 'last_undegraded': '2023-07-06T22:00:18.087660+0000', 'last_fullsized': '2023-07-06T22:00:18.087660+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:00:24.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.b is not active+clean 2023-07-06T22:00:24.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2023-07-06T22:00:24.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.084812+0000', 'last_change': '2023-07-06T22:00:18.084812+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.084812+0000', 'last_undegraded': '2023-07-06T22:00:18.084812+0000', 'last_fullsized': '2023-07-06T22:00:18.084812+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:00:24.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.8 is not active+clean 2023-07-06T22:00:24.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2023-07-06T22:00:24.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.087155+0000', 'last_change': '2023-07-06T22:00:18.087155+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.087155+0000', 'last_undegraded': '2023-07-06T22:00:18.087155+0000', 'last_fullsized': '2023-07-06T22:00:18.087155+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:00:24.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.9 is not active+clean 2023-07-06T22:00:24.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2023-07-06T22:00:24.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.088255+0000', 'last_change': '2023-07-06T22:00:18.088255+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.088255+0000', 'last_undegraded': '2023-07-06T22:00:18.088255+0000', 'last_fullsized': '2023-07-06T22:00:18.088255+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T22:00:24.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.6 is not active+clean 2023-07-06T22:00:24.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2023-07-06T22:00:24.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.090015+0000', 'last_change': '2023-07-06T22:00:18.090015+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.090015+0000', 'last_undegraded': '2023-07-06T22:00:18.090015+0000', 'last_fullsized': '2023-07-06T22:00:18.090015+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:00:24.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.7 is not active+clean 2023-07-06T22:00:24.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2023-07-06T22:00:24.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.091028+0000', 'last_change': '2023-07-06T22:00:18.091028+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.091028+0000', 'last_undegraded': '2023-07-06T22:00:18.091028+0000', 'last_fullsized': '2023-07-06T22:00:18.091028+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T22:00:24.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.4 is not active+clean 2023-07-06T22:00:24.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2023-07-06T22:00:24.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.087843+0000', 'last_change': '2023-07-06T22:00:18.087843+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.087843+0000', 'last_undegraded': '2023-07-06T22:00:18.087843+0000', 'last_fullsized': '2023-07-06T22:00:18.087843+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T22:00:24.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.5 is not active+clean 2023-07-06T22:00:24.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2023-07-06T22:00:24.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.089401+0000', 'last_change': '2023-07-06T22:00:18.089401+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.089401+0000', 'last_undegraded': '2023-07-06T22:00:18.089401+0000', 'last_fullsized': '2023-07-06T22:00:18.089401+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:00:24.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2 is not active+clean 2023-07-06T22:00:24.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2023-07-06T22:00:24.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.093080+0000', 'last_change': '2023-07-06T22:00:18.093080+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.093080+0000', 'last_undegraded': '2023-07-06T22:00:18.093080+0000', 'last_fullsized': '2023-07-06T22:00:18.093080+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:00:24.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3 is not active+clean 2023-07-06T22:00:24.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2023-07-06T22:00:24.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.086280+0000', 'last_change': '2023-07-06T22:00:18.086280+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.086280+0000', 'last_undegraded': '2023-07-06T22:00:18.086280+0000', 'last_fullsized': '2023-07-06T22:00:18.086280+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T22:00:24.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.0 is not active+clean 2023-07-06T22:00:24.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2023-07-06T22:00:24.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.084708+0000', 'last_change': '2023-07-06T22:00:18.084708+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.084708+0000', 'last_undegraded': '2023-07-06T22:00:18.084708+0000', 'last_fullsized': '2023-07-06T22:00:18.084708+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:00:24.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1 is not active+clean 2023-07-06T22:00:24.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2023-07-06T22:00:24.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.087726+0000', 'last_change': '2023-07-06T22:00:18.087726+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.087726+0000', 'last_undegraded': '2023-07-06T22:00:18.087726+0000', 'last_fullsized': '2023-07-06T22:00:18.087726+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T22:00:24.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.10 is not active+clean 2023-07-06T22:00:24.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2023-07-06T22:00:24.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.093146+0000', 'last_change': '2023-07-06T22:00:18.093146+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.093146+0000', 'last_undegraded': '2023-07-06T22:00:18.093146+0000', 'last_fullsized': '2023-07-06T22:00:18.093146+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:00:24.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.13 is not active+clean 2023-07-06T22:00:24.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2023-07-06T22:00:24.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.091218+0000', 'last_change': '2023-07-06T22:00:18.091218+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.091218+0000', 'last_undegraded': '2023-07-06T22:00:18.091218+0000', 'last_fullsized': '2023-07-06T22:00:18.091218+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T22:00:24.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.12 is not active+clean 2023-07-06T22:00:24.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2023-07-06T22:00:24.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.088104+0000', 'last_change': '2023-07-06T22:00:18.088104+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.088104+0000', 'last_undegraded': '2023-07-06T22:00:18.088104+0000', 'last_fullsized': '2023-07-06T22:00:18.088104+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:00:24.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.11 is not active+clean 2023-07-06T22:00:24.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2023-07-06T22:00:24.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.084805+0000', 'last_change': '2023-07-06T22:00:18.084805+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.084805+0000', 'last_undegraded': '2023-07-06T22:00:18.084805+0000', 'last_fullsized': '2023-07-06T22:00:18.084805+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:00:24.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.17 is not active+clean 2023-07-06T22:00:24.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2023-07-06T22:00:24.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.089476+0000', 'last_change': '2023-07-06T22:00:18.089476+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.089476+0000', 'last_undegraded': '2023-07-06T22:00:18.089476+0000', 'last_fullsized': '2023-07-06T22:00:18.089476+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:00:24.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.16 is not active+clean 2023-07-06T22:00:24.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2023-07-06T22:00:24.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.085149+0000', 'last_change': '2023-07-06T22:00:18.085149+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.085149+0000', 'last_undegraded': '2023-07-06T22:00:18.085149+0000', 'last_fullsized': '2023-07-06T22:00:18.085149+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:00:24.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.15 is not active+clean 2023-07-06T22:00:24.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2023-07-06T22:00:24.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.087998+0000', 'last_change': '2023-07-06T22:00:18.087998+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.087998+0000', 'last_undegraded': '2023-07-06T22:00:18.087998+0000', 'last_fullsized': '2023-07-06T22:00:18.087998+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T22:00:24.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.14 is not active+clean 2023-07-06T22:00:24.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:00:19.081465+0000', 'last_change': '2023-07-06T22:00:19.081465+0000', 'last_active': '2023-07-06T22:00:19.081465+0000', 'last_peered': '2023-07-06T22:00:19.081465+0000', 'last_clean': '2023-07-06T22:00:19.081465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:19.081465+0000', 'last_undegraded': '2023-07-06T22:00:19.081465+0000', 'last_fullsized': '2023-07-06T22:00:19.081465+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:19.081465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:00:24.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2023-07-06T22:00:24.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:00:18.088313+0000', 'last_change': '2023-07-06T22:00:18.088313+0000', 'last_active': '2023-07-06T22:00:18.070448+0000', 'last_peered': '2023-07-06T22:00:18.070448+0000', 'last_clean': '2023-07-06T22:00:18.070448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:00:18.088313+0000', 'last_undegraded': '2023-07-06T22:00:18.088313+0000', 'last_fullsized': '2023-07-06T22:00:18.088313+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'last_clean_scrub_stamp': '2023-07-06T22:00:18.070448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T22:00:24.457 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-06T22:00:24.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.597+0000 7fe889974640 1 Processor -- start 2023-07-06T22:00:24.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe889974640 1 -- start start 2023-07-06T22:00:24.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe889974640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe884158400 0x7fe8840c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe889974640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe8841587d0 0x7fe8840cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe889974640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88406fae0 con 0x7fe8840c9680 2023-07-06T22:00:24.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe889974640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88406fdc0 con 0x7fe884158400 2023-07-06T22:00:24.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe889974640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8840700a0 con 0x7fe8841587d0 2023-07-06T22:00:24.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe882ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe884158400 0x7fe8840c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:24.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe882ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe884158400 0x7fe8840c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58520/0 (socket says 172.21.15.55:58520) 2023-07-06T22:00:24.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe882ffd640 1 -- 172.21.15.55:0/316338804 learned_addr learned my addr 172.21.15.55:0/316338804 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:24.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe87bfff640 1 --1- 172.21.15.55:0/316338804 >> v1:172.21.15.55:6789/0 conn(0x7fe8840c9680 0x7fe884070b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48148/0 (socket says 172.21.15.55:48148) 2023-07-06T22:00:24.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe8837fe640 1 --2- 172.21.15.55:0/316338804 >> v2:172.21.15.138:3300/0 conn(0x7fe8841587d0 0x7fe8840cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:24.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe882ffd640 1 -- 172.21.15.55:0/316338804 >> v2:172.21.15.138:3300/0 conn(0x7fe8841587d0 msgr2=0x7fe8840cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:24.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe882ffd640 1 --2- 172.21.15.55:0/316338804 >> v2:172.21.15.138:3300/0 conn(0x7fe8841587d0 0x7fe8840cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe882ffd640 1 -- 172.21.15.55:0/316338804 >> v1:172.21.15.55:6789/0 conn(0x7fe8840c9680 legacy=0x7fe884070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:24.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe882ffd640 1 -- 172.21.15.55:0/316338804 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe884070380 con 0x7fe884158400 2023-07-06T22:00:24.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.601+0000 7fe8827fc640 1 -- 172.21.15.55:0/316338804 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53918328 0 0) 0x7fe88406fae0 con 0x7fe8840c9680 2023-07-06T22:00:24.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.605+0000 7fe882ffd640 1 --2- 172.21.15.55:0/316338804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884158400 0x7fe8840c9140 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fe8840ca290 tx=0x7fe87401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fcf7192f91efd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:24.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.605+0000 7fe8827fc640 1 -- 172.21.15.55:0/316338804 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe874004230 con 0x7fe884158400 2023-07-06T22:00:24.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.605+0000 7fe8827fc640 1 -- 172.21.15.55:0/316338804 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8740a7050 con 0x7fe884158400 2023-07-06T22:00:24.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.605+0000 7fe8827fc640 1 -- 172.21.15.55:0/316338804 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe874003620 con 0x7fe884158400 2023-07-06T22:00:24.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.605+0000 7fe889974640 1 -- 172.21.15.55:0/316338804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884158400 msgr2=0x7fe8840c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:24.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.605+0000 7fe889974640 1 --2- 172.21.15.55:0/316338804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884158400 0x7fe8840c9140 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fe8840ca290 tx=0x7fe87401c440 comp rx=0 tx=0).stop 2023-07-06T22:00:24.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.605+0000 7fe889974640 1 -- 172.21.15.55:0/316338804 shutdown_connections 2023-07-06T22:00:24.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.605+0000 7fe889974640 1 --2- 172.21.15.55:0/316338804 >> v2:172.21.15.138:3300/0 conn(0x7fe8841587d0 0x7fe8840cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.605+0000 7fe889974640 1 --2- 172.21.15.55:0/316338804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884158400 0x7fe8840c9140 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.605+0000 7fe889974640 1 -- 172.21.15.55:0/316338804 >> 172.21.15.55:0/316338804 conn(0x7fe8840cded0 msgr2=0x7fe8840ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:24.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.605+0000 7fe889974640 1 -- 172.21.15.55:0/316338804 shutdown_connections 2023-07-06T22:00:24.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.605+0000 7fe889974640 1 -- 172.21.15.55:0/316338804 wait complete. 2023-07-06T22:00:24.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.605+0000 7fe889974640 1 Processor -- start 2023-07-06T22:00:24.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.605+0000 7fe889974640 1 -- start start 2023-07-06T22:00:24.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe889974640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8840c9680 0x7fe8840ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe889974640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe884158400 0x7fe8841f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe889974640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8841587d0 0x7fe8840caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe889974640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840abe30 con 0x7fe8840c9680 2023-07-06T22:00:24.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe889974640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840ac110 con 0x7fe8841587d0 2023-07-06T22:00:24.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe889974640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840ac3f0 con 0x7fe884158400 2023-07-06T22:00:24.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe882ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8840c9680 0x7fe8840ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:24.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe882ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8840c9680 0x7fe8840ace30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58534/0 (socket says 172.21.15.55:58534) 2023-07-06T22:00:24.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe882ffd640 1 -- 172.21.15.55:0/731727050 learned_addr learned my addr 172.21.15.55:0/731727050 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:24.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe8837fe640 1 --2- 172.21.15.55:0/731727050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8841587d0 0x7fe8840caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:24.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe87bfff640 1 --2- 172.21.15.55:0/731727050 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe884158400 0x7fe8841f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:24.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe882ffd640 1 -- 172.21.15.55:0/731727050 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe884158400 msgr2=0x7fe8841f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:24.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe882ffd640 1 --2- 172.21.15.55:0/731727050 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe884158400 0x7fe8841f3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe882ffd640 1 -- 172.21.15.55:0/731727050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8841587d0 msgr2=0x7fe8840caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:24.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe882ffd640 1 --2- 172.21.15.55:0/731727050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8841587d0 0x7fe8840caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe882ffd640 1 -- 172.21.15.55:0/731727050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8740094d0 con 0x7fe8840c9680 2023-07-06T22:00:24.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe882ffd640 1 --2- 172.21.15.55:0/731727050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8840c9680 0x7fe8840ace30 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe87401a070 tx=0x7fe8740191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:24.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe880ff9640 1 -- 172.21.15.55:0/731727050 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe874003bb0 con 0x7fe8840c9680 2023-07-06T22:00:24.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe880ff9640 1 -- 172.21.15.55:0/731727050 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe874003d10 con 0x7fe8840c9680 2023-07-06T22:00:24.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe880ff9640 1 -- 172.21.15.55:0/731727050 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8740ab640 con 0x7fe8840c9680 2023-07-06T22:00:24.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe889974640 1 -- 172.21.15.55:0/731727050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8840ac6d0 con 0x7fe8840c9680 2023-07-06T22:00:24.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe889974640 1 -- 172.21.15.55:0/731727050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8840ac9b0 con 0x7fe8840c9680 2023-07-06T22:00:24.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.609+0000 7fe889974640 1 -- 172.21.15.55:0/731727050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88406c580 con 0x7fe8840c9680 2023-07-06T22:00:24.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.613+0000 7fe880ff9640 1 -- 172.21.15.55:0/731727050 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe8740b2050 con 0x7fe8840c9680 2023-07-06T22:00:24.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.613+0000 7fe880ff9640 1 --2- 172.21.15.55:0/731727050 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe8640663a0 0x7fe864068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.613+0000 7fe880ff9640 1 -- 172.21.15.55:0/731727050 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe87411e610 con 0x7fe8840c9680 2023-07-06T22:00:24.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.613+0000 7fe87bfff640 1 --2- 172.21.15.55:0/731727050 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe8640663a0 0x7fe864068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:24.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.613+0000 7fe87bfff640 1 --2- 172.21.15.55:0/731727050 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe8640663a0 0x7fe864068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe8840cbdc0 tx=0x7fe86c007b60 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:24.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.617+0000 7fe880ff9640 1 -- 172.21.15.55:0/731727050 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe8740eb720 con 0x7fe8840c9680 2023-07-06T22:00:24.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.829+0000 7fe889974640 1 -- 172.21.15.55:0/731727050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe884066d60 con 0x7fe8840c9680 2023-07-06T22:00:24.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.829+0000 7fe880ff9640 1 -- 172.21.15.55:0/731727050 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3307 (secure 0 0 0) 0x7fe8740eed40 con 0x7fe8840c9680 2023-07-06T22:00:24.829 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:24.830 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1120,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":131,"num_osds":8,"num_up_osds":8,"osd_up_since":1688679717,"num_in_osds":8,"osd_in_since":1688679707,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":334516224,"bytes_avail":772759597056,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":54,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8622}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2023-07-06T22:00:06.999816+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-06T22:00:24.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.829+0000 7fe889974640 1 -- 172.21.15.55:0/731727050 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe8640663a0 msgr2=0x7fe864068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:24.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.829+0000 7fe889974640 1 --2- 172.21.15.55:0/731727050 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe8640663a0 0x7fe864068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe8840cbdc0 tx=0x7fe86c007b60 comp rx=0 tx=0).stop 2023-07-06T22:00:24.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.829+0000 7fe889974640 1 -- 172.21.15.55:0/731727050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8840c9680 msgr2=0x7fe8840ace30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:24.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.829+0000 7fe889974640 1 --2- 172.21.15.55:0/731727050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8840c9680 0x7fe8840ace30 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe87401a070 tx=0x7fe8740191e0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.829+0000 7fe889974640 1 -- 172.21.15.55:0/731727050 shutdown_connections 2023-07-06T22:00:24.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.829+0000 7fe889974640 1 --2- 172.21.15.55:0/731727050 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe8640663a0 0x7fe864068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.829+0000 7fe889974640 1 --2- 172.21.15.55:0/731727050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8841587d0 0x7fe8840caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.829+0000 7fe889974640 1 --2- 172.21.15.55:0/731727050 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe884158400 0x7fe8841f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.829+0000 7fe889974640 1 --2- 172.21.15.55:0/731727050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8840c9680 0x7fe8840ace30 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.829+0000 7fe889974640 1 -- 172.21.15.55:0/731727050 >> 172.21.15.55:0/731727050 conn(0x7fe8840cded0 msgr2=0x7fe8840aead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:24.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.829+0000 7fe889974640 1 -- 172.21.15.55:0/731727050 shutdown_connections 2023-07-06T22:00:24.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.829+0000 7fe889974640 1 -- 172.21.15.55:0/731727050 wait complete. 2023-07-06T22:00:24.850 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-06T22:00:24.851 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:00:24.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.993+0000 7f5a4f5a3640 1 Processor -- start 2023-07-06T22:00:24.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.993+0000 7f5a4f5a3640 1 -- start start 2023-07-06T22:00:24.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.993+0000 7f5a4f5a3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5a480d19a0 0x7f5a480d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.993+0000 7f5a4f5a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a480b4440 0x7f5a4806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:24.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.993+0000 7f5a4f5a3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a480d1e30 con 0x7f5a4815bcb0 2023-07-06T22:00:24.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.993+0000 7f5a4f5a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4815c080 con 0x7f5a480b4440 2023-07-06T22:00:24.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.993+0000 7f5a4f5a3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a480ccaa0 con 0x7f5a480d19a0 2023-07-06T22:00:24.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.993+0000 7f5a4db40640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a480b4440 0x7f5a4806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:24.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.993+0000 7f5a4db40640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a480b4440 0x7f5a4806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58552/0 (socket says 172.21.15.55:58552) 2023-07-06T22:00:24.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.993+0000 7f5a4db40640 1 -- 172.21.15.55:0/3685603450 learned_addr learned my addr 172.21.15.55:0/3685603450 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:24.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.993+0000 7f5a4db40640 1 -- 172.21.15.55:0/3685603450 >> v2:172.21.15.138:3300/0 conn(0x7f5a480d19a0 msgr2=0x7f5a480d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:24.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.993+0000 7f5a4db40640 1 --2- 172.21.15.55:0/3685603450 >> v2:172.21.15.138:3300/0 conn(0x7f5a480d19a0 0x7f5a480d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:24.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.993+0000 7f5a4db40640 1 -- 172.21.15.55:0/3685603450 >> v1:172.21.15.138:6789/0 conn(0x7f5a4815bcb0 legacy=0x7f5a480b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:24.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.993+0000 7f5a4db40640 1 -- 172.21.15.55:0/3685603450 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a480ccd80 con 0x7f5a480b4440 2023-07-06T22:00:24.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.997+0000 7f5a4db40640 1 --2- 172.21.15.55:0/3685603450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a480b4440 0x7f5a4806ab40 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f5a480c9310 tx=0x7f5a4001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf9fd13c2c5249a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:24.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.997+0000 7f5a3ffff640 1 -- 172.21.15.55:0/3685603450 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400a5620 con 0x7f5a480b4440 2023-07-06T22:00:24.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.997+0000 7f5a3ffff640 1 -- 172.21.15.55:0/3685603450 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a400a5780 con 0x7f5a480b4440 2023-07-06T22:00:24.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.997+0000 7f5a3ffff640 1 -- 172.21.15.55:0/3685603450 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400a5b10 con 0x7f5a480b4440 2023-07-06T22:00:24.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.997+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/3685603450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a480b4440 msgr2=0x7f5a4806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:24.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.997+0000 7f5a4f5a3640 1 --2- 172.21.15.55:0/3685603450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a480b4440 0x7f5a4806ab40 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f5a480c9310 tx=0x7f5a4001c850 comp rx=0 tx=0).stop 2023-07-06T22:00:24.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.997+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/3685603450 shutdown_connections 2023-07-06T22:00:24.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.997+0000 7f5a4f5a3640 1 --2- 172.21.15.55:0/3685603450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a480b4440 0x7f5a4806ab40 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:25.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.997+0000 7f5a4f5a3640 1 --2- 172.21.15.55:0/3685603450 >> v2:172.21.15.138:3300/0 conn(0x7f5a480d19a0 0x7f5a480d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:25.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.997+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/3685603450 >> 172.21.15.55:0/3685603450 conn(0x7f5a480ced30 msgr2=0x7f5a480cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:25.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.997+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/3685603450 shutdown_connections 2023-07-06T22:00:25.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:24.997+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/3685603450 wait complete. 2023-07-06T22:00:25.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4f5a3640 1 Processor -- start 2023-07-06T22:00:25.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4f5a3640 1 -- start start 2023-07-06T22:00:25.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4f5a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a480b4440 0x7f5a481518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:25.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4f5a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a480d19a0 0x7f5a48151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:25.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4f5a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4815bcb0 0x7f5a480c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:25.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4f5a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48151e00 con 0x7f5a4815bcb0 2023-07-06T22:00:25.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4f5a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480c71b0 con 0x7f5a480b4440 2023-07-06T22:00:25.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4f5a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480c6ed0 con 0x7f5a480d19a0 2023-07-06T22:00:25.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4db40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4815bcb0 0x7f5a480c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:25.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4db40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4815bcb0 0x7f5a480c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58558/0 (socket says 172.21.15.55:58558) 2023-07-06T22:00:25.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4db40640 1 -- 172.21.15.55:0/1125043696 learned_addr learned my addr 172.21.15.55:0/1125043696 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:25.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4d33f640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a480b4440 0x7f5a481518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:25.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4cb3e640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a480d19a0 0x7f5a48151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:25.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4db40640 1 -- 172.21.15.55:0/1125043696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a480d19a0 msgr2=0x7f5a48151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:25.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4db40640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a480d19a0 0x7f5a48151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:25.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4db40640 1 -- 172.21.15.55:0/1125043696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a480b4440 msgr2=0x7f5a481518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:25.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4db40640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a480b4440 0x7f5a481518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:25.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4db40640 1 -- 172.21.15.55:0/1125043696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a40009b30 con 0x7f5a4815bcb0 2023-07-06T22:00:25.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4d33f640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a480b4440 0x7f5a481518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:25.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4cb3e640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a480d19a0 0x7f5a48151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:25.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4db40640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4815bcb0 0x7f5a480c6560 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f5a4001a480 tx=0x7f5a400195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:25.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a3dffb640 1 -- 172.21.15.55:0/1125043696 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400b8670 con 0x7f5a4815bcb0 2023-07-06T22:00:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a3dffb640 1 -- 172.21.15.55:0/1125043696 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a400b87d0 con 0x7f5a4815bcb0 2023-07-06T22:00:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/1125043696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a480ca530 con 0x7f5a4815bcb0 2023-07-06T22:00:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a3dffb640 1 -- 172.21.15.55:0/1125043696 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400b8b80 con 0x7f5a4815bcb0 2023-07-06T22:00:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.001+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/1125043696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a480caaf0 con 0x7f5a4815bcb0 2023-07-06T22:00:25.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.005+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/1125043696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a480cace0 con 0x7f5a4815bcb0 2023-07-06T22:00:25.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.005+0000 7f5a3dffb640 1 -- 172.21.15.55:0/1125043696 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5a400b8ce0 con 0x7f5a4815bcb0 2023-07-06T22:00:25.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.005+0000 7f5a3dffb640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5a2c0663a0 0x7f5a2c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:25.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.005+0000 7f5a3dffb640 1 -- 172.21.15.55:0/1125043696 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5a4011f4d0 con 0x7f5a4815bcb0 2023-07-06T22:00:25.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.005+0000 7f5a4d33f640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5a2c0663a0 0x7f5a2c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:25.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.005+0000 7f5a4d33f640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5a2c0663a0 0x7f5a2c068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5a440098b0 tx=0x7f5a44008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:25.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.009+0000 7f5a3dffb640 1 -- 172.21.15.55:0/1125043696 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a400ec6f0 con 0x7f5a4815bcb0 2023-07-06T22:00:25.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.161+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/1125043696 --> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a48066d60 con 0x7f5a2c0663a0 2023-07-06T22:00:25.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.169+0000 7f5a3dffb640 1 -- 172.21.15.55:0/1125043696 <== mgr.8376 v2:172.21.15.55:6832/3817107512 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311405 (secure 0 0 0) 0x7f5a48066d60 con 0x7f5a2c0663a0 2023-07-06T22:00:25.172 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:25.173 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:00:25.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.173+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/1125043696 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5a2c0663a0 msgr2=0x7f5a2c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:25.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.173+0000 7f5a4f5a3640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5a2c0663a0 0x7f5a2c068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5a440098b0 tx=0x7f5a44008040 comp rx=0 tx=0).stop 2023-07-06T22:00:25.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.173+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/1125043696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4815bcb0 msgr2=0x7f5a480c6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:25.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.173+0000 7f5a4f5a3640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4815bcb0 0x7f5a480c6560 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f5a4001a480 tx=0x7f5a400195f0 comp rx=0 tx=0).stop 2023-07-06T22:00:25.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.173+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/1125043696 shutdown_connections 2023-07-06T22:00:25.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.173+0000 7f5a4f5a3640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f5a2c0663a0 0x7f5a2c068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:25.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.173+0000 7f5a4f5a3640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4815bcb0 0x7f5a480c6560 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:25.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.173+0000 7f5a4f5a3640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a480d19a0 0x7f5a48151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:25.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.173+0000 7f5a4f5a3640 1 --2- 172.21.15.55:0/1125043696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a480b4440 0x7f5a481518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:25.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.173+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/1125043696 >> 172.21.15.55:0/1125043696 conn(0x7f5a480ced30 msgr2=0x7f5a4815a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:25.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.173+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/1125043696 shutdown_connections 2023-07-06T22:00:25.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:25.173+0000 7f5a4f5a3640 1 -- 172.21.15.55:0/1125043696 wait complete. 2023-07-06T22:00:25.193 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-06T22:00:25.003538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":403,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":327040,"kb_used_data":13888,"kb_used_omap":0,"kb_used_meta":313088,"kb_avail":754647680,"statfs":{"total":773094113280,"available":772759224320,"internally_reserved":0,"allocated":14221312,"data_stored":8054374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320602112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001399"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298472+0000","last_change":"2023-07-06T22:00:19.536895+0000","last_active":"2023-07-06T22:00:22.298472+0000","last_peered":"2023-07-06T22:00:22.298472+0000","last_clean":"2023-07-06T22:00:22.298472+0000","last_became_active":"2023-07-06T22:00:19.536582+0000","last_became_peered":"2023-07-06T22:00:19.536582+0000","last_unstale":"2023-07-06T22:00:22.298472+0000","last_undegraded":"2023-07-06T22:00:22.298472+0000","last_fullsized":"2023-07-06T22:00:22.298472+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:45:31.421864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509506+0000","last_change":"2023-07-06T22:00:19.523797+0000","last_active":"2023-07-06T22:00:20.509506+0000","last_peered":"2023-07-06T22:00:20.509506+0000","last_clean":"2023-07-06T22:00:20.509506+0000","last_became_active":"2023-07-06T22:00:19.523118+0000","last_became_peered":"2023-07-06T22:00:19.523118+0000","last_unstale":"2023-07-06T22:00:20.509506+0000","last_undegraded":"2023-07-06T22:00:20.509506+0000","last_fullsized":"2023-07-06T22:00:20.509506+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:48:34.248551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509773+0000","last_change":"2023-07-06T22:00:19.521875+0000","last_active":"2023-07-06T22:00:20.509773+0000","last_peered":"2023-07-06T22:00:20.509773+0000","last_clean":"2023-07-06T22:00:20.509773+0000","last_became_active":"2023-07-06T22:00:19.521585+0000","last_became_peered":"2023-07-06T22:00:19.521585+0000","last_unstale":"2023-07-06T22:00:20.509773+0000","last_undegraded":"2023-07-06T22:00:20.509773+0000","last_fullsized":"2023-07-06T22:00:20.509773+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:52:08.948226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298223+0000","last_change":"2023-07-06T22:00:19.538600+0000","last_active":"2023-07-06T22:00:22.298223+0000","last_peered":"2023-07-06T22:00:22.298223+0000","last_clean":"2023-07-06T22:00:22.298223+0000","last_became_active":"2023-07-06T22:00:19.538014+0000","last_became_peered":"2023-07-06T22:00:19.538014+0000","last_unstale":"2023-07-06T22:00:22.298223+0000","last_undegraded":"2023-07-06T22:00:22.298223+0000","last_fullsized":"2023-07-06T22:00:22.298223+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:37:46.185880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496205+0000","last_change":"2023-07-06T22:00:19.518402+0000","last_active":"2023-07-06T22:00:21.496205+0000","last_peered":"2023-07-06T22:00:21.496205+0000","last_clean":"2023-07-06T22:00:21.496205+0000","last_became_active":"2023-07-06T22:00:19.517424+0000","last_became_peered":"2023-07-06T22:00:19.517424+0000","last_unstale":"2023-07-06T22:00:21.496205+0000","last_undegraded":"2023-07-06T22:00:21.496205+0000","last_fullsized":"2023-07-06T22:00:21.496205+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:19:40.149896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296840+0000","last_change":"2023-07-06T22:00:19.524280+0000","last_active":"2023-07-06T22:00:22.296840+0000","last_peered":"2023-07-06T22:00:22.296840+0000","last_clean":"2023-07-06T22:00:22.296840+0000","last_became_active":"2023-07-06T22:00:19.524001+0000","last_became_peered":"2023-07-06T22:00:19.524001+0000","last_unstale":"2023-07-06T22:00:22.296840+0000","last_undegraded":"2023-07-06T22:00:22.296840+0000","last_fullsized":"2023-07-06T22:00:22.296840+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:00:51.223389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709756+0000","last_change":"2023-07-06T22:00:19.526814+0000","last_active":"2023-07-06T22:00:20.709756+0000","last_peered":"2023-07-06T22:00:20.709756+0000","last_clean":"2023-07-06T22:00:20.709756+0000","last_became_active":"2023-07-06T22:00:19.526524+0000","last_became_peered":"2023-07-06T22:00:19.526524+0000","last_unstale":"2023-07-06T22:00:20.709756+0000","last_undegraded":"2023-07-06T22:00:20.709756+0000","last_fullsized":"2023-07-06T22:00:20.709756+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:10:09.688325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.508832+0000","last_change":"2023-07-06T22:00:19.518033+0000","last_active":"2023-07-06T22:00:20.508832+0000","last_peered":"2023-07-06T22:00:20.508832+0000","last_clean":"2023-07-06T22:00:20.508832+0000","last_became_active":"2023-07-06T22:00:19.517742+0000","last_became_peered":"2023-07-06T22:00:19.517742+0000","last_unstale":"2023-07-06T22:00:20.508832+0000","last_undegraded":"2023-07-06T22:00:20.508832+0000","last_fullsized":"2023-07-06T22:00:20.508832+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:58:27.689911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298597+0000","last_change":"2023-07-06T22:00:19.532828+0000","last_active":"2023-07-06T22:00:22.298597+0000","last_peered":"2023-07-06T22:00:22.298597+0000","last_clean":"2023-07-06T22:00:22.298597+0000","last_became_active":"2023-07-06T22:00:19.532572+0000","last_became_peered":"2023-07-06T22:00:19.532572+0000","last_unstale":"2023-07-06T22:00:22.298597+0000","last_undegraded":"2023-07-06T22:00:22.298597+0000","last_fullsized":"2023-07-06T22:00:22.298597+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:42:58.471684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298169+0000","last_change":"2023-07-06T22:00:19.528705+0000","last_active":"2023-07-06T22:00:22.298169+0000","last_peered":"2023-07-06T22:00:22.298169+0000","last_clean":"2023-07-06T22:00:22.298169+0000","last_became_active":"2023-07-06T22:00:19.528368+0000","last_became_peered":"2023-07-06T22:00:19.528368+0000","last_unstale":"2023-07-06T22:00:22.298169+0000","last_undegraded":"2023-07-06T22:00:22.298169+0000","last_fullsized":"2023-07-06T22:00:22.298169+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:55:24.220338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509483+0000","last_change":"2023-07-06T22:00:19.523753+0000","last_active":"2023-07-06T22:00:20.509483+0000","last_peered":"2023-07-06T22:00:20.509483+0000","last_clean":"2023-07-06T22:00:20.509483+0000","last_became_active":"2023-07-06T22:00:19.523225+0000","last_became_peered":"2023-07-06T22:00:19.523225+0000","last_unstale":"2023-07-06T22:00:20.509483+0000","last_undegraded":"2023-07-06T22:00:20.509483+0000","last_fullsized":"2023-07-06T22:00:20.509483+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:53:06.917841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298055+0000","last_change":"2023-07-06T22:00:19.539667+0000","last_active":"2023-07-06T22:00:22.298055+0000","last_peered":"2023-07-06T22:00:22.298055+0000","last_clean":"2023-07-06T22:00:22.298055+0000","last_became_active":"2023-07-06T22:00:19.539080+0000","last_became_peered":"2023-07-06T22:00:19.539080+0000","last_unstale":"2023-07-06T22:00:22.298055+0000","last_undegraded":"2023-07-06T22:00:22.298055+0000","last_fullsized":"2023-07-06T22:00:22.298055+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:09:38.241241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509775+0000","last_change":"2023-07-06T22:00:19.512918+0000","last_active":"2023-07-06T22:00:20.509775+0000","last_peered":"2023-07-06T22:00:20.509775+0000","last_clean":"2023-07-06T22:00:20.509775+0000","last_became_active":"2023-07-06T22:00:19.512639+0000","last_became_peered":"2023-07-06T22:00:19.512639+0000","last_unstale":"2023-07-06T22:00:20.509775+0000","last_undegraded":"2023-07-06T22:00:20.509775+0000","last_fullsized":"2023-07-06T22:00:20.509775+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:00:20.193632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.508761+0000","last_change":"2023-07-06T22:00:19.512117+0000","last_active":"2023-07-06T22:00:20.508761+0000","last_peered":"2023-07-06T22:00:20.508761+0000","last_clean":"2023-07-06T22:00:20.508761+0000","last_became_active":"2023-07-06T22:00:19.511838+0000","last_became_peered":"2023-07-06T22:00:19.511838+0000","last_unstale":"2023-07-06T22:00:20.508761+0000","last_undegraded":"2023-07-06T22:00:20.508761+0000","last_fullsized":"2023-07-06T22:00:20.508761+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:45:06.777538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296693+0000","last_change":"2023-07-06T22:00:19.523145+0000","last_active":"2023-07-06T22:00:22.296693+0000","last_peered":"2023-07-06T22:00:22.296693+0000","last_clean":"2023-07-06T22:00:22.296693+0000","last_became_active":"2023-07-06T22:00:19.522840+0000","last_became_peered":"2023-07-06T22:00:19.522840+0000","last_unstale":"2023-07-06T22:00:22.296693+0000","last_undegraded":"2023-07-06T22:00:22.296693+0000","last_fullsized":"2023-07-06T22:00:22.296693+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:35:57.208353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297417+0000","last_change":"2023-07-06T22:00:19.536147+0000","last_active":"2023-07-06T22:00:22.297417+0000","last_peered":"2023-07-06T22:00:22.297417+0000","last_clean":"2023-07-06T22:00:22.297417+0000","last_became_active":"2023-07-06T22:00:19.535895+0000","last_became_peered":"2023-07-06T22:00:19.535895+0000","last_unstale":"2023-07-06T22:00:22.297417+0000","last_undegraded":"2023-07-06T22:00:22.297417+0000","last_fullsized":"2023-07-06T22:00:22.297417+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:57:34.532925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509840+0000","last_change":"2023-07-06T22:00:19.523523+0000","last_active":"2023-07-06T22:00:20.509840+0000","last_peered":"2023-07-06T22:00:20.509840+0000","last_clean":"2023-07-06T22:00:20.509840+0000","last_became_active":"2023-07-06T22:00:19.523241+0000","last_became_peered":"2023-07-06T22:00:19.523241+0000","last_unstale":"2023-07-06T22:00:20.509840+0000","last_undegraded":"2023-07-06T22:00:20.509840+0000","last_fullsized":"2023-07-06T22:00:20.509840+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:30:40.081281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297245+0000","last_change":"2023-07-06T22:00:19.520320+0000","last_active":"2023-07-06T22:00:22.297245+0000","last_peered":"2023-07-06T22:00:22.297245+0000","last_clean":"2023-07-06T22:00:22.297245+0000","last_became_active":"2023-07-06T22:00:19.520057+0000","last_became_peered":"2023-07-06T22:00:19.520057+0000","last_unstale":"2023-07-06T22:00:22.297245+0000","last_undegraded":"2023-07-06T22:00:22.297245+0000","last_fullsized":"2023-07-06T22:00:22.297245+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:37:00.232430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509911+0000","last_change":"2023-07-06T22:00:19.513000+0000","last_active":"2023-07-06T22:00:20.509911+0000","last_peered":"2023-07-06T22:00:20.509911+0000","last_clean":"2023-07-06T22:00:20.509911+0000","last_became_active":"2023-07-06T22:00:19.512701+0000","last_became_peered":"2023-07-06T22:00:19.512701+0000","last_unstale":"2023-07-06T22:00:20.509911+0000","last_undegraded":"2023-07-06T22:00:20.509911+0000","last_fullsized":"2023-07-06T22:00:20.509911+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:08:50.860554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509563+0000","last_change":"2023-07-06T22:00:19.518730+0000","last_active":"2023-07-06T22:00:20.509563+0000","last_peered":"2023-07-06T22:00:20.509563+0000","last_clean":"2023-07-06T22:00:20.509563+0000","last_became_active":"2023-07-06T22:00:19.518445+0000","last_became_peered":"2023-07-06T22:00:19.518445+0000","last_unstale":"2023-07-06T22:00:20.509563+0000","last_undegraded":"2023-07-06T22:00:20.509563+0000","last_fullsized":"2023-07-06T22:00:20.509563+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:00:13.462971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509631+0000","last_change":"2023-07-06T22:00:19.528051+0000","last_active":"2023-07-06T22:00:20.509631+0000","last_peered":"2023-07-06T22:00:20.509631+0000","last_clean":"2023-07-06T22:00:20.509631+0000","last_became_active":"2023-07-06T22:00:19.527678+0000","last_became_peered":"2023-07-06T22:00:19.527678+0000","last_unstale":"2023-07-06T22:00:20.509631+0000","last_undegraded":"2023-07-06T22:00:20.509631+0000","last_fullsized":"2023-07-06T22:00:20.509631+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:54:47.207565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507974+0000","last_change":"2023-07-06T22:00:19.523653+0000","last_active":"2023-07-06T22:00:20.507974+0000","last_peered":"2023-07-06T22:00:20.507974+0000","last_clean":"2023-07-06T22:00:20.507974+0000","last_became_active":"2023-07-06T22:00:19.523128+0000","last_became_peered":"2023-07-06T22:00:19.523128+0000","last_unstale":"2023-07-06T22:00:20.507974+0000","last_undegraded":"2023-07-06T22:00:20.507974+0000","last_fullsized":"2023-07-06T22:00:20.507974+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:07:07.457552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509054+0000","last_change":"2023-07-06T22:00:19.518489+0000","last_active":"2023-07-06T22:00:20.509054+0000","last_peered":"2023-07-06T22:00:20.509054+0000","last_clean":"2023-07-06T22:00:20.509054+0000","last_became_active":"2023-07-06T22:00:19.518155+0000","last_became_peered":"2023-07-06T22:00:19.518155+0000","last_unstale":"2023-07-06T22:00:20.509054+0000","last_undegraded":"2023-07-06T22:00:20.509054+0000","last_fullsized":"2023-07-06T22:00:20.509054+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:11:31.093974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507412+0000","last_change":"2023-07-06T22:00:19.515968+0000","last_active":"2023-07-06T22:00:20.507412+0000","last_peered":"2023-07-06T22:00:20.507412+0000","last_clean":"2023-07-06T22:00:20.507412+0000","last_became_active":"2023-07-06T22:00:19.515549+0000","last_became_peered":"2023-07-06T22:00:19.515549+0000","last_unstale":"2023-07-06T22:00:20.507412+0000","last_undegraded":"2023-07-06T22:00:20.507412+0000","last_fullsized":"2023-07-06T22:00:20.507412+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:06:32.040479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509980+0000","last_change":"2023-07-06T22:00:19.519624+0000","last_active":"2023-07-06T22:00:20.509980+0000","last_peered":"2023-07-06T22:00:20.509980+0000","last_clean":"2023-07-06T22:00:20.509980+0000","last_became_active":"2023-07-06T22:00:19.518789+0000","last_became_peered":"2023-07-06T22:00:19.518789+0000","last_unstale":"2023-07-06T22:00:20.509980+0000","last_undegraded":"2023-07-06T22:00:20.509980+0000","last_fullsized":"2023-07-06T22:00:20.509980+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:24:23.655840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298236+0000","last_change":"2023-07-06T22:00:19.530103+0000","last_active":"2023-07-06T22:00:22.298236+0000","last_peered":"2023-07-06T22:00:22.298236+0000","last_clean":"2023-07-06T22:00:22.298236+0000","last_became_active":"2023-07-06T22:00:19.529785+0000","last_became_peered":"2023-07-06T22:00:19.529785+0000","last_unstale":"2023-07-06T22:00:22.298236+0000","last_undegraded":"2023-07-06T22:00:22.298236+0000","last_fullsized":"2023-07-06T22:00:22.298236+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:51:25.209474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297088+0000","last_change":"2023-07-06T22:00:19.538130+0000","last_active":"2023-07-06T22:00:22.297088+0000","last_peered":"2023-07-06T22:00:22.297088+0000","last_clean":"2023-07-06T22:00:22.297088+0000","last_became_active":"2023-07-06T22:00:19.537828+0000","last_became_peered":"2023-07-06T22:00:19.537828+0000","last_unstale":"2023-07-06T22:00:22.297088+0000","last_undegraded":"2023-07-06T22:00:22.297088+0000","last_fullsized":"2023-07-06T22:00:22.297088+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:05:09.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507718+0000","last_change":"2023-07-06T22:00:19.541707+0000","last_active":"2023-07-06T22:00:20.507718+0000","last_peered":"2023-07-06T22:00:20.507718+0000","last_clean":"2023-07-06T22:00:20.507718+0000","last_became_active":"2023-07-06T22:00:19.541418+0000","last_became_peered":"2023-07-06T22:00:19.541418+0000","last_unstale":"2023-07-06T22:00:20.507718+0000","last_undegraded":"2023-07-06T22:00:20.507718+0000","last_fullsized":"2023-07-06T22:00:20.507718+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:46:47.916892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509246+0000","last_change":"2023-07-06T22:00:19.519543+0000","last_active":"2023-07-06T22:00:20.509246+0000","last_peered":"2023-07-06T22:00:20.509246+0000","last_clean":"2023-07-06T22:00:20.509246+0000","last_became_active":"2023-07-06T22:00:19.519265+0000","last_became_peered":"2023-07-06T22:00:19.519265+0000","last_unstale":"2023-07-06T22:00:20.509246+0000","last_undegraded":"2023-07-06T22:00:20.509246+0000","last_fullsized":"2023-07-06T22:00:20.509246+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:29:39.993399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709891+0000","last_change":"2023-07-06T22:00:19.530857+0000","last_active":"2023-07-06T22:00:20.709891+0000","last_peered":"2023-07-06T22:00:20.709891+0000","last_clean":"2023-07-06T22:00:20.709891+0000","last_became_active":"2023-07-06T22:00:19.530568+0000","last_became_peered":"2023-07-06T22:00:19.530568+0000","last_unstale":"2023-07-06T22:00:20.709891+0000","last_undegraded":"2023-07-06T22:00:20.709891+0000","last_fullsized":"2023-07-06T22:00:20.709891+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:34:59.776755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297524+0000","last_change":"2023-07-06T22:00:19.530028+0000","last_active":"2023-07-06T22:00:22.297524+0000","last_peered":"2023-07-06T22:00:22.297524+0000","last_clean":"2023-07-06T22:00:22.297524+0000","last_became_active":"2023-07-06T22:00:19.529752+0000","last_became_peered":"2023-07-06T22:00:19.529752+0000","last_unstale":"2023-07-06T22:00:22.297524+0000","last_undegraded":"2023-07-06T22:00:22.297524+0000","last_fullsized":"2023-07-06T22:00:22.297524+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:24:58.134036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296725+0000","last_change":"2023-07-06T22:00:19.528008+0000","last_active":"2023-07-06T22:00:22.296725+0000","last_peered":"2023-07-06T22:00:22.296725+0000","last_clean":"2023-07-06T22:00:22.296725+0000","last_became_active":"2023-07-06T22:00:19.527721+0000","last_became_peered":"2023-07-06T22:00:19.527721+0000","last_unstale":"2023-07-06T22:00:22.296725+0000","last_undegraded":"2023-07-06T22:00:22.296725+0000","last_fullsized":"2023-07-06T22:00:22.296725+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:22:35.093106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297049+0000","last_change":"2023-07-06T22:00:19.522037+0000","last_active":"2023-07-06T22:00:22.297049+0000","last_peered":"2023-07-06T22:00:22.297049+0000","last_clean":"2023-07-06T22:00:22.297049+0000","last_became_active":"2023-07-06T22:00:19.521724+0000","last_became_peered":"2023-07-06T22:00:19.521724+0000","last_unstale":"2023-07-06T22:00:22.297049+0000","last_undegraded":"2023-07-06T22:00:22.297049+0000","last_fullsized":"2023-07-06T22:00:22.297049+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:37:31.957732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"130'4","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.710026+0000","last_change":"2023-07-06T22:00:19.113848+0000","last_active":"2023-07-06T22:00:20.710026+0000","last_peered":"2023-07-06T22:00:20.710026+0000","last_clean":"2023-07-06T22:00:20.710026+0000","last_became_active":"2023-07-06T22:00:19.113533+0000","last_became_peered":"2023-07-06T22:00:19.113533+0000","last_unstale":"2023-07-06T22:00:20.710026+0000","last_undegraded":"2023-07-06T22:00:20.710026+0000","last_fullsized":"2023-07-06T22:00:20.710026+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:58:41.970832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297398+0000","last_change":"2023-07-06T22:00:19.512349+0000","last_active":"2023-07-06T22:00:22.297398+0000","last_peered":"2023-07-06T22:00:22.297398+0000","last_clean":"2023-07-06T22:00:22.297398+0000","last_became_active":"2023-07-06T22:00:19.511991+0000","last_became_peered":"2023-07-06T22:00:19.511991+0000","last_unstale":"2023-07-06T22:00:22.297398+0000","last_undegraded":"2023-07-06T22:00:22.297398+0000","last_fullsized":"2023-07-06T22:00:22.297398+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:21:20.300533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"130'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.510052+0000","last_change":"2023-07-06T22:00:19.111966+0000","last_active":"2023-07-06T22:00:20.510052+0000","last_peered":"2023-07-06T22:00:20.510052+0000","last_clean":"2023-07-06T22:00:20.510052+0000","last_became_active":"2023-07-06T22:00:19.111606+0000","last_became_peered":"2023-07-06T22:00:19.111606+0000","last_unstale":"2023-07-06T22:00:20.510052+0000","last_undegraded":"2023-07-06T22:00:20.510052+0000","last_fullsized":"2023-07-06T22:00:20.510052+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:09:03.373691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297112+0000","last_change":"2023-07-06T22:00:19.526360+0000","last_active":"2023-07-06T22:00:22.297112+0000","last_peered":"2023-07-06T22:00:22.297112+0000","last_clean":"2023-07-06T22:00:22.297112+0000","last_became_active":"2023-07-06T22:00:19.526045+0000","last_became_peered":"2023-07-06T22:00:19.526045+0000","last_unstale":"2023-07-06T22:00:22.297112+0000","last_undegraded":"2023-07-06T22:00:22.297112+0000","last_fullsized":"2023-07-06T22:00:22.297112+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:40:37.683760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"130'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496340+0000","last_change":"2023-07-06T22:00:19.110718+0000","last_active":"2023-07-06T22:00:21.496340+0000","last_peered":"2023-07-06T22:00:21.496340+0000","last_clean":"2023-07-06T22:00:21.496340+0000","last_became_active":"2023-07-06T22:00:19.110436+0000","last_became_peered":"2023-07-06T22:00:19.110436+0000","last_unstale":"2023-07-06T22:00:21.496340+0000","last_undegraded":"2023-07-06T22:00:21.496340+0000","last_fullsized":"2023-07-06T22:00:21.496340+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:36:17.138132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509942+0000","last_change":"2023-07-06T22:00:19.524058+0000","last_active":"2023-07-06T22:00:20.509942+0000","last_peered":"2023-07-06T22:00:20.509942+0000","last_clean":"2023-07-06T22:00:20.509942+0000","last_became_active":"2023-07-06T22:00:19.523537+0000","last_became_peered":"2023-07-06T22:00:19.523537+0000","last_unstale":"2023-07-06T22:00:20.509942+0000","last_undegraded":"2023-07-06T22:00:20.509942+0000","last_fullsized":"2023-07-06T22:00:20.509942+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:48:49.809987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"130'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496081+0000","last_change":"2023-07-06T22:00:19.110487+0000","last_active":"2023-07-06T22:00:21.496081+0000","last_peered":"2023-07-06T22:00:21.496081+0000","last_clean":"2023-07-06T22:00:21.496081+0000","last_became_active":"2023-07-06T22:00:19.110133+0000","last_became_peered":"2023-07-06T22:00:19.110133+0000","last_unstale":"2023-07-06T22:00:21.496081+0000","last_undegraded":"2023-07-06T22:00:21.496081+0000","last_fullsized":"2023-07-06T22:00:21.496081+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:55:01.720182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297506+0000","last_change":"2023-07-06T22:00:19.537726+0000","last_active":"2023-07-06T22:00:22.297506+0000","last_peered":"2023-07-06T22:00:22.297506+0000","last_clean":"2023-07-06T22:00:22.297506+0000","last_became_active":"2023-07-06T22:00:19.537443+0000","last_became_peered":"2023-07-06T22:00:19.537443+0000","last_unstale":"2023-07-06T22:00:22.297506+0000","last_undegraded":"2023-07-06T22:00:22.297506+0000","last_fullsized":"2023-07-06T22:00:22.297506+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:15:10.905515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"130'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709564+0000","last_change":"2023-07-06T22:00:19.112201+0000","last_active":"2023-07-06T22:00:20.709564+0000","last_peered":"2023-07-06T22:00:20.709564+0000","last_clean":"2023-07-06T22:00:20.709564+0000","last_became_active":"2023-07-06T22:00:19.111847+0000","last_became_peered":"2023-07-06T22:00:19.111847+0000","last_unstale":"2023-07-06T22:00:20.709564+0000","last_undegraded":"2023-07-06T22:00:20.709564+0000","last_fullsized":"2023-07-06T22:00:20.709564+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:43:56.303490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509421+0000","last_change":"2023-07-06T22:00:19.522759+0000","last_active":"2023-07-06T22:00:20.509421+0000","last_peered":"2023-07-06T22:00:20.509421+0000","last_clean":"2023-07-06T22:00:20.509421+0000","last_became_active":"2023-07-06T22:00:19.522504+0000","last_became_peered":"2023-07-06T22:00:19.522504+0000","last_unstale":"2023-07-06T22:00:20.509421+0000","last_undegraded":"2023-07-06T22:00:20.509421+0000","last_fullsized":"2023-07-06T22:00:20.509421+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:43:29.995596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"130'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507984+0000","last_change":"2023-07-06T22:00:19.116593+0000","last_active":"2023-07-06T22:00:20.507984+0000","last_peered":"2023-07-06T22:00:20.507984+0000","last_clean":"2023-07-06T22:00:20.507984+0000","last_became_active":"2023-07-06T22:00:19.116291+0000","last_became_peered":"2023-07-06T22:00:19.116291+0000","last_unstale":"2023-07-06T22:00:20.507984+0000","last_undegraded":"2023-07-06T22:00:20.507984+0000","last_fullsized":"2023-07-06T22:00:20.507984+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:29.411141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297400+0000","last_change":"2023-07-06T22:00:19.539232+0000","last_active":"2023-07-06T22:00:22.297400+0000","last_peered":"2023-07-06T22:00:22.297400+0000","last_clean":"2023-07-06T22:00:22.297400+0000","last_became_active":"2023-07-06T22:00:19.537001+0000","last_became_peered":"2023-07-06T22:00:19.537001+0000","last_unstale":"2023-07-06T22:00:22.297400+0000","last_undegraded":"2023-07-06T22:00:22.297400+0000","last_fullsized":"2023-07-06T22:00:22.297400+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:46:10.505795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509003+0000","last_change":"2023-07-06T22:00:19.117137+0000","last_active":"2023-07-06T22:00:20.509003+0000","last_peered":"2023-07-06T22:00:20.509003+0000","last_clean":"2023-07-06T22:00:20.509003+0000","last_became_active":"2023-07-06T22:00:19.116815+0000","last_became_peered":"2023-07-06T22:00:19.116815+0000","last_unstale":"2023-07-06T22:00:20.509003+0000","last_undegraded":"2023-07-06T22:00:20.509003+0000","last_fullsized":"2023-07-06T22:00:20.509003+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:23:50.167440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709591+0000","last_change":"2023-07-06T22:00:19.526880+0000","last_active":"2023-07-06T22:00:20.709591+0000","last_peered":"2023-07-06T22:00:20.709591+0000","last_clean":"2023-07-06T22:00:20.709591+0000","last_became_active":"2023-07-06T22:00:19.526602+0000","last_became_peered":"2023-07-06T22:00:19.526602+0000","last_unstale":"2023-07-06T22:00:20.709591+0000","last_undegraded":"2023-07-06T22:00:20.709591+0000","last_fullsized":"2023-07-06T22:00:20.709591+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:47:20.419579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297602+0000","last_change":"2023-07-06T22:00:19.122728+0000","last_active":"2023-07-06T22:00:22.297602+0000","last_peered":"2023-07-06T22:00:22.297602+0000","last_clean":"2023-07-06T22:00:22.297602+0000","last_became_active":"2023-07-06T22:00:19.122394+0000","last_became_peered":"2023-07-06T22:00:19.122394+0000","last_unstale":"2023-07-06T22:00:22.297602+0000","last_undegraded":"2023-07-06T22:00:22.297602+0000","last_fullsized":"2023-07-06T22:00:22.297602+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:36:11.594573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496476+0000","last_change":"2023-07-06T22:00:19.535100+0000","last_active":"2023-07-06T22:00:21.496476+0000","last_peered":"2023-07-06T22:00:21.496476+0000","last_clean":"2023-07-06T22:00:21.496476+0000","last_became_active":"2023-07-06T22:00:19.534813+0000","last_became_peered":"2023-07-06T22:00:19.534813+0000","last_unstale":"2023-07-06T22:00:21.496476+0000","last_undegraded":"2023-07-06T22:00:21.496476+0000","last_fullsized":"2023-07-06T22:00:21.496476+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:08:00.498775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"130'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298708+0000","last_change":"2023-07-06T22:00:19.115430+0000","last_active":"2023-07-06T22:00:22.298708+0000","last_peered":"2023-07-06T22:00:22.298708+0000","last_clean":"2023-07-06T22:00:22.298708+0000","last_became_active":"2023-07-06T22:00:19.115153+0000","last_became_peered":"2023-07-06T22:00:19.115153+0000","last_unstale":"2023-07-06T22:00:22.298708+0000","last_undegraded":"2023-07-06T22:00:22.298708+0000","last_fullsized":"2023-07-06T22:00:22.298708+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:44:50.744950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297293+0000","last_change":"2023-07-06T22:00:19.530079+0000","last_active":"2023-07-06T22:00:22.297293+0000","last_peered":"2023-07-06T22:00:22.297293+0000","last_clean":"2023-07-06T22:00:22.297293+0000","last_became_active":"2023-07-06T22:00:19.529809+0000","last_became_peered":"2023-07-06T22:00:19.529809+0000","last_unstale":"2023-07-06T22:00:22.297293+0000","last_undegraded":"2023-07-06T22:00:22.297293+0000","last_fullsized":"2023-07-06T22:00:22.297293+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:17:21.295134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"130'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496499+0000","last_change":"2023-07-06T22:00:19.108939+0000","last_active":"2023-07-06T22:00:21.496499+0000","last_peered":"2023-07-06T22:00:21.496499+0000","last_clean":"2023-07-06T22:00:21.496499+0000","last_became_active":"2023-07-06T22:00:19.108657+0000","last_became_peered":"2023-07-06T22:00:19.108657+0000","last_unstale":"2023-07-06T22:00:21.496499+0000","last_undegraded":"2023-07-06T22:00:21.496499+0000","last_fullsized":"2023-07-06T22:00:21.496499+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:01:45.287912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.510186+0000","last_change":"2023-07-06T22:00:19.540836+0000","last_active":"2023-07-06T22:00:20.510186+0000","last_peered":"2023-07-06T22:00:20.510186+0000","last_clean":"2023-07-06T22:00:20.510186+0000","last_became_active":"2023-07-06T22:00:19.540576+0000","last_became_peered":"2023-07-06T22:00:19.540576+0000","last_unstale":"2023-07-06T22:00:20.510186+0000","last_undegraded":"2023-07-06T22:00:20.510186+0000","last_fullsized":"2023-07-06T22:00:20.510186+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:44:30.532524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"130'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296861+0000","last_change":"2023-07-06T22:00:19.117296+0000","last_active":"2023-07-06T22:00:22.296861+0000","last_peered":"2023-07-06T22:00:22.296861+0000","last_clean":"2023-07-06T22:00:22.296861+0000","last_became_active":"2023-07-06T22:00:19.116942+0000","last_became_peered":"2023-07-06T22:00:19.116942+0000","last_unstale":"2023-07-06T22:00:22.296861+0000","last_undegraded":"2023-07-06T22:00:22.296861+0000","last_fullsized":"2023-07-06T22:00:22.296861+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:23:38.143648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.510086+0000","last_change":"2023-07-06T22:00:19.517651+0000","last_active":"2023-07-06T22:00:20.510086+0000","last_peered":"2023-07-06T22:00:20.510086+0000","last_clean":"2023-07-06T22:00:20.510086+0000","last_became_active":"2023-07-06T22:00:19.517313+0000","last_became_peered":"2023-07-06T22:00:19.517313+0000","last_unstale":"2023-07-06T22:00:20.510086+0000","last_undegraded":"2023-07-06T22:00:20.510086+0000","last_fullsized":"2023-07-06T22:00:20.510086+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:14:03.324414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709696+0000","last_change":"2023-07-06T22:00:19.127449+0000","last_active":"2023-07-06T22:00:20.709696+0000","last_peered":"2023-07-06T22:00:20.709696+0000","last_clean":"2023-07-06T22:00:20.709696+0000","last_became_active":"2023-07-06T22:00:19.127202+0000","last_became_peered":"2023-07-06T22:00:19.127202+0000","last_unstale":"2023-07-06T22:00:20.709696+0000","last_undegraded":"2023-07-06T22:00:20.709696+0000","last_fullsized":"2023-07-06T22:00:20.709696+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:36:41.111223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.508713+0000","last_change":"2023-07-06T22:00:19.520998+0000","last_active":"2023-07-06T22:00:20.508713+0000","last_peered":"2023-07-06T22:00:20.508713+0000","last_clean":"2023-07-06T22:00:20.508713+0000","last_became_active":"2023-07-06T22:00:19.520722+0000","last_became_peered":"2023-07-06T22:00:19.520722+0000","last_unstale":"2023-07-06T22:00:20.508713+0000","last_undegraded":"2023-07-06T22:00:20.508713+0000","last_fullsized":"2023-07-06T22:00:20.508713+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:52.134403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"130'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297042+0000","last_change":"2023-07-06T22:00:19.107428+0000","last_active":"2023-07-06T22:00:22.297042+0000","last_peered":"2023-07-06T22:00:22.297042+0000","last_clean":"2023-07-06T22:00:22.297042+0000","last_became_active":"2023-07-06T22:00:19.107149+0000","last_became_peered":"2023-07-06T22:00:19.107149+0000","last_unstale":"2023-07-06T22:00:22.297042+0000","last_undegraded":"2023-07-06T22:00:22.297042+0000","last_fullsized":"2023-07-06T22:00:22.297042+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:58:00.224116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297539+0000","last_change":"2023-07-06T22:00:19.535632+0000","last_active":"2023-07-06T22:00:22.297539+0000","last_peered":"2023-07-06T22:00:22.297539+0000","last_clean":"2023-07-06T22:00:22.297539+0000","last_became_active":"2023-07-06T22:00:19.535386+0000","last_became_peered":"2023-07-06T22:00:19.535386+0000","last_unstale":"2023-07-06T22:00:22.297539+0000","last_undegraded":"2023-07-06T22:00:22.297539+0000","last_fullsized":"2023-07-06T22:00:22.297539+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:11:39.089221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.495873+0000","last_change":"2023-07-06T22:00:19.110768+0000","last_active":"2023-07-06T22:00:21.495873+0000","last_peered":"2023-07-06T22:00:21.495873+0000","last_clean":"2023-07-06T22:00:21.495873+0000","last_became_active":"2023-07-06T22:00:19.110476+0000","last_became_peered":"2023-07-06T22:00:19.110476+0000","last_unstale":"2023-07-06T22:00:21.495873+0000","last_undegraded":"2023-07-06T22:00:21.495873+0000","last_fullsized":"2023-07-06T22:00:21.495873+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:18:51.750249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.508686+0000","last_change":"2023-07-06T22:00:19.513469+0000","last_active":"2023-07-06T22:00:20.508686+0000","last_peered":"2023-07-06T22:00:20.508686+0000","last_clean":"2023-07-06T22:00:20.508686+0000","last_became_active":"2023-07-06T22:00:19.513179+0000","last_became_peered":"2023-07-06T22:00:19.513179+0000","last_unstale":"2023-07-06T22:00:20.508686+0000","last_undegraded":"2023-07-06T22:00:20.508686+0000","last_fullsized":"2023-07-06T22:00:20.508686+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:57:59.958463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296764+0000","last_change":"2023-07-06T22:00:19.110185+0000","last_active":"2023-07-06T22:00:22.296764+0000","last_peered":"2023-07-06T22:00:22.296764+0000","last_clean":"2023-07-06T22:00:22.296764+0000","last_became_active":"2023-07-06T22:00:19.109899+0000","last_became_peered":"2023-07-06T22:00:19.109899+0000","last_unstale":"2023-07-06T22:00:22.296764+0000","last_undegraded":"2023-07-06T22:00:22.296764+0000","last_fullsized":"2023-07-06T22:00:22.296764+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:49:49.507690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507540+0000","last_change":"2023-07-06T22:00:19.528905+0000","last_active":"2023-07-06T22:00:20.507540+0000","last_peered":"2023-07-06T22:00:20.507540+0000","last_clean":"2023-07-06T22:00:20.507540+0000","last_became_active":"2023-07-06T22:00:19.528638+0000","last_became_peered":"2023-07-06T22:00:19.528638+0000","last_unstale":"2023-07-06T22:00:20.507540+0000","last_undegraded":"2023-07-06T22:00:20.507540+0000","last_fullsized":"2023-07-06T22:00:20.507540+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:29:55.529759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297653+0000","last_change":"2023-07-06T22:00:19.116489+0000","last_active":"2023-07-06T22:00:22.297653+0000","last_peered":"2023-07-06T22:00:22.297653+0000","last_clean":"2023-07-06T22:00:22.297653+0000","last_became_active":"2023-07-06T22:00:19.116218+0000","last_became_peered":"2023-07-06T22:00:19.116218+0000","last_unstale":"2023-07-06T22:00:22.297653+0000","last_undegraded":"2023-07-06T22:00:22.297653+0000","last_fullsized":"2023-07-06T22:00:22.297653+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:45:31.923105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297112+0000","last_change":"2023-07-06T22:00:19.531367+0000","last_active":"2023-07-06T22:00:22.297112+0000","last_peered":"2023-07-06T22:00:22.297112+0000","last_clean":"2023-07-06T22:00:22.297112+0000","last_became_active":"2023-07-06T22:00:19.531092+0000","last_became_peered":"2023-07-06T22:00:19.531092+0000","last_unstale":"2023-07-06T22:00:22.297112+0000","last_undegraded":"2023-07-06T22:00:22.297112+0000","last_fullsized":"2023-07-06T22:00:22.297112+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:03:48.683895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"130'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507738+0000","last_change":"2023-07-06T22:00:19.123298+0000","last_active":"2023-07-06T22:00:20.507738+0000","last_peered":"2023-07-06T22:00:20.507738+0000","last_clean":"2023-07-06T22:00:20.507738+0000","last_became_active":"2023-07-06T22:00:19.123017+0000","last_became_peered":"2023-07-06T22:00:19.123017+0000","last_unstale":"2023-07-06T22:00:20.507738+0000","last_undegraded":"2023-07-06T22:00:20.507738+0000","last_fullsized":"2023-07-06T22:00:20.507738+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:27:37.446228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298726+0000","last_change":"2023-07-06T22:00:19.531661+0000","last_active":"2023-07-06T22:00:22.298726+0000","last_peered":"2023-07-06T22:00:22.298726+0000","last_clean":"2023-07-06T22:00:22.298726+0000","last_became_active":"2023-07-06T22:00:19.530593+0000","last_became_peered":"2023-07-06T22:00:19.530593+0000","last_unstale":"2023-07-06T22:00:22.298726+0000","last_undegraded":"2023-07-06T22:00:22.298726+0000","last_fullsized":"2023-07-06T22:00:22.298726+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:20:53.075055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297201+0000","last_change":"2023-07-06T22:00:19.109521+0000","last_active":"2023-07-06T22:00:22.297201+0000","last_peered":"2023-07-06T22:00:22.297201+0000","last_clean":"2023-07-06T22:00:22.297201+0000","last_became_active":"2023-07-06T22:00:19.109085+0000","last_became_peered":"2023-07-06T22:00:19.109085+0000","last_unstale":"2023-07-06T22:00:22.297201+0000","last_undegraded":"2023-07-06T22:00:22.297201+0000","last_fullsized":"2023-07-06T22:00:22.297201+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:16:20.287566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298067+0000","last_change":"2023-07-06T22:00:19.538789+0000","last_active":"2023-07-06T22:00:22.298067+0000","last_peered":"2023-07-06T22:00:22.298067+0000","last_clean":"2023-07-06T22:00:22.298067+0000","last_became_active":"2023-07-06T22:00:19.538295+0000","last_became_peered":"2023-07-06T22:00:19.538295+0000","last_unstale":"2023-07-06T22:00:22.298067+0000","last_undegraded":"2023-07-06T22:00:22.298067+0000","last_fullsized":"2023-07-06T22:00:22.298067+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:48.749603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298092+0000","last_change":"2023-07-06T22:00:19.114035+0000","last_active":"2023-07-06T22:00:22.298092+0000","last_peered":"2023-07-06T22:00:22.298092+0000","last_clean":"2023-07-06T22:00:22.298092+0000","last_became_active":"2023-07-06T22:00:19.113744+0000","last_became_peered":"2023-07-06T22:00:19.113744+0000","last_unstale":"2023-07-06T22:00:22.298092+0000","last_undegraded":"2023-07-06T22:00:22.298092+0000","last_fullsized":"2023-07-06T22:00:22.298092+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:36:15.758843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296903+0000","last_change":"2023-07-06T22:00:19.534797+0000","last_active":"2023-07-06T22:00:22.296903+0000","last_peered":"2023-07-06T22:00:22.296903+0000","last_clean":"2023-07-06T22:00:22.296903+0000","last_became_active":"2023-07-06T22:00:19.534527+0000","last_became_peered":"2023-07-06T22:00:19.534527+0000","last_unstale":"2023-07-06T22:00:22.296903+0000","last_undegraded":"2023-07-06T22:00:22.296903+0000","last_fullsized":"2023-07-06T22:00:22.296903+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:22:46.452966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507898+0000","last_change":"2023-07-06T22:00:19.116160+0000","last_active":"2023-07-06T22:00:20.507898+0000","last_peered":"2023-07-06T22:00:20.507898+0000","last_clean":"2023-07-06T22:00:20.507898+0000","last_became_active":"2023-07-06T22:00:19.115877+0000","last_became_peered":"2023-07-06T22:00:19.115877+0000","last_unstale":"2023-07-06T22:00:20.507898+0000","last_undegraded":"2023-07-06T22:00:20.507898+0000","last_fullsized":"2023-07-06T22:00:20.507898+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:01:25.106591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509198+0000","last_change":"2023-07-06T22:00:19.521952+0000","last_active":"2023-07-06T22:00:20.509198+0000","last_peered":"2023-07-06T22:00:20.509198+0000","last_clean":"2023-07-06T22:00:20.509198+0000","last_became_active":"2023-07-06T22:00:19.521678+0000","last_became_peered":"2023-07-06T22:00:19.521678+0000","last_unstale":"2023-07-06T22:00:20.509198+0000","last_undegraded":"2023-07-06T22:00:20.509198+0000","last_fullsized":"2023-07-06T22:00:20.509198+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:45:06.095232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709627+0000","last_change":"2023-07-06T22:00:19.111105+0000","last_active":"2023-07-06T22:00:20.709627+0000","last_peered":"2023-07-06T22:00:20.709627+0000","last_clean":"2023-07-06T22:00:20.709627+0000","last_became_active":"2023-07-06T22:00:19.110803+0000","last_became_peered":"2023-07-06T22:00:19.110803+0000","last_unstale":"2023-07-06T22:00:20.709627+0000","last_undegraded":"2023-07-06T22:00:20.709627+0000","last_fullsized":"2023-07-06T22:00:20.709627+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:37:46.460557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509682+0000","last_change":"2023-07-06T22:00:19.526365+0000","last_active":"2023-07-06T22:00:20.509682+0000","last_peered":"2023-07-06T22:00:20.509682+0000","last_clean":"2023-07-06T22:00:20.509682+0000","last_became_active":"2023-07-06T22:00:19.526088+0000","last_became_peered":"2023-07-06T22:00:19.526088+0000","last_unstale":"2023-07-06T22:00:20.509682+0000","last_undegraded":"2023-07-06T22:00:20.509682+0000","last_fullsized":"2023-07-06T22:00:20.509682+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:39.732757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509166+0000","last_change":"2023-07-06T22:00:19.109264+0000","last_active":"2023-07-06T22:00:20.509166+0000","last_peered":"2023-07-06T22:00:20.509166+0000","last_clean":"2023-07-06T22:00:20.509166+0000","last_became_active":"2023-07-06T22:00:19.108874+0000","last_became_peered":"2023-07-06T22:00:19.108874+0000","last_unstale":"2023-07-06T22:00:20.509166+0000","last_undegraded":"2023-07-06T22:00:20.509166+0000","last_fullsized":"2023-07-06T22:00:20.509166+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:18:45.965630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.508685+0000","last_change":"2023-07-06T22:00:19.512337+0000","last_active":"2023-07-06T22:00:20.508685+0000","last_peered":"2023-07-06T22:00:20.508685+0000","last_clean":"2023-07-06T22:00:20.508685+0000","last_became_active":"2023-07-06T22:00:19.511984+0000","last_became_peered":"2023-07-06T22:00:19.511984+0000","last_unstale":"2023-07-06T22:00:20.508685+0000","last_undegraded":"2023-07-06T22:00:20.508685+0000","last_fullsized":"2023-07-06T22:00:20.508685+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:47:50.700447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496060+0000","last_change":"2023-07-06T22:00:19.110783+0000","last_active":"2023-07-06T22:00:21.496060+0000","last_peered":"2023-07-06T22:00:21.496060+0000","last_clean":"2023-07-06T22:00:21.496060+0000","last_became_active":"2023-07-06T22:00:19.110460+0000","last_became_peered":"2023-07-06T22:00:19.110460+0000","last_unstale":"2023-07-06T22:00:21.496060+0000","last_undegraded":"2023-07-06T22:00:21.496060+0000","last_fullsized":"2023-07-06T22:00:21.496060+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:30:28.929751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297636+0000","last_change":"2023-07-06T22:00:19.532426+0000","last_active":"2023-07-06T22:00:22.297636+0000","last_peered":"2023-07-06T22:00:22.297636+0000","last_clean":"2023-07-06T22:00:22.297636+0000","last_became_active":"2023-07-06T22:00:19.532161+0000","last_became_peered":"2023-07-06T22:00:19.532161+0000","last_unstale":"2023-07-06T22:00:22.297636+0000","last_undegraded":"2023-07-06T22:00:22.297636+0000","last_fullsized":"2023-07-06T22:00:22.297636+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:19:34.700115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297720+0000","last_change":"2023-07-06T22:00:19.116401+0000","last_active":"2023-07-06T22:00:22.297720+0000","last_peered":"2023-07-06T22:00:22.297720+0000","last_clean":"2023-07-06T22:00:22.297720+0000","last_became_active":"2023-07-06T22:00:19.116074+0000","last_became_peered":"2023-07-06T22:00:19.116074+0000","last_unstale":"2023-07-06T22:00:22.297720+0000","last_undegraded":"2023-07-06T22:00:22.297720+0000","last_fullsized":"2023-07-06T22:00:22.297720+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:27:06.909193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507528+0000","last_change":"2023-07-06T22:00:19.515795+0000","last_active":"2023-07-06T22:00:20.507528+0000","last_peered":"2023-07-06T22:00:20.507528+0000","last_clean":"2023-07-06T22:00:20.507528+0000","last_became_active":"2023-07-06T22:00:19.515219+0000","last_became_peered":"2023-07-06T22:00:19.515219+0000","last_unstale":"2023-07-06T22:00:20.507528+0000","last_undegraded":"2023-07-06T22:00:20.507528+0000","last_fullsized":"2023-07-06T22:00:20.507528+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:30:45.699795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709718+0000","last_change":"2023-07-06T22:00:19.123129+0000","last_active":"2023-07-06T22:00:20.709718+0000","last_peered":"2023-07-06T22:00:20.709718+0000","last_clean":"2023-07-06T22:00:20.709718+0000","last_became_active":"2023-07-06T22:00:19.122885+0000","last_became_peered":"2023-07-06T22:00:19.122885+0000","last_unstale":"2023-07-06T22:00:20.709718+0000","last_undegraded":"2023-07-06T22:00:20.709718+0000","last_fullsized":"2023-07-06T22:00:20.709718+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:28:40.163238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"119'227","reported_seq":780,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509155+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:00:20.509155+0000","last_peered":"2023-07-06T22:00:20.509155+0000","last_clean":"2023-07-06T22:00:20.509155+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:00:20.509155+0000","last_undegraded":"2023-07-06T22:00:20.509155+0000","last_fullsized":"2023-07-06T22:00:20.509155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:36:43.856066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":203,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709848+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:00:20.709848+0000","last_peered":"2023-07-06T22:00:20.709848+0000","last_clean":"2023-07-06T22:00:20.709848+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:00:20.709848+0000","last_undegraded":"2023-07-06T22:00:20.709848+0000","last_fullsized":"2023-07-06T22:00:20.709848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:59:01.795574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507782+0000","last_change":"2023-07-06T22:00:19.514460+0000","last_active":"2023-07-06T22:00:20.507782+0000","last_peered":"2023-07-06T22:00:20.507782+0000","last_clean":"2023-07-06T22:00:20.507782+0000","last_became_active":"2023-07-06T22:00:19.514203+0000","last_became_peered":"2023-07-06T22:00:19.514203+0000","last_unstale":"2023-07-06T22:00:20.507782+0000","last_undegraded":"2023-07-06T22:00:20.507782+0000","last_fullsized":"2023-07-06T22:00:20.507782+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:06:36.680704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297065+0000","last_change":"2023-07-06T22:00:19.116267+0000","last_active":"2023-07-06T22:00:22.297065+0000","last_peered":"2023-07-06T22:00:22.297065+0000","last_clean":"2023-07-06T22:00:22.297065+0000","last_became_active":"2023-07-06T22:00:19.115944+0000","last_became_peered":"2023-07-06T22:00:19.115944+0000","last_unstale":"2023-07-06T22:00:22.297065+0000","last_undegraded":"2023-07-06T22:00:22.297065+0000","last_fullsized":"2023-07-06T22:00:22.297065+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:41.559728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":234,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.508908+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:00:20.508908+0000","last_peered":"2023-07-06T22:00:20.508908+0000","last_clean":"2023-07-06T22:00:20.508908+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:00:20.508908+0000","last_undegraded":"2023-07-06T22:00:20.508908+0000","last_fullsized":"2023-07-06T22:00:20.508908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:42:31.682989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507934+0000","last_change":"2023-07-06T22:00:19.523475+0000","last_active":"2023-07-06T22:00:20.507934+0000","last_peered":"2023-07-06T22:00:20.507934+0000","last_clean":"2023-07-06T22:00:20.507934+0000","last_became_active":"2023-07-06T22:00:19.522850+0000","last_became_peered":"2023-07-06T22:00:19.522850+0000","last_unstale":"2023-07-06T22:00:20.507934+0000","last_undegraded":"2023-07-06T22:00:20.507934+0000","last_fullsized":"2023-07-06T22:00:20.507934+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:46:29.895225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"130'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296950+0000","last_change":"2023-07-06T22:00:19.112721+0000","last_active":"2023-07-06T22:00:22.296950+0000","last_peered":"2023-07-06T22:00:22.296950+0000","last_clean":"2023-07-06T22:00:22.296950+0000","last_became_active":"2023-07-06T22:00:19.112446+0000","last_became_peered":"2023-07-06T22:00:19.112446+0000","last_unstale":"2023-07-06T22:00:22.296950+0000","last_undegraded":"2023-07-06T22:00:22.296950+0000","last_fullsized":"2023-07-06T22:00:22.296950+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:02:26.745101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496112+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:00:21.496112+0000","last_peered":"2023-07-06T22:00:21.496112+0000","last_clean":"2023-07-06T22:00:21.496112+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:00:21.496112+0000","last_undegraded":"2023-07-06T22:00:21.496112+0000","last_fullsized":"2023-07-06T22:00:21.496112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:26:46.288040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507454+0000","last_change":"2023-07-06T22:00:19.521593+0000","last_active":"2023-07-06T22:00:20.507454+0000","last_peered":"2023-07-06T22:00:20.507454+0000","last_clean":"2023-07-06T22:00:20.507454+0000","last_became_active":"2023-07-06T22:00:19.521296+0000","last_became_peered":"2023-07-06T22:00:19.521296+0000","last_unstale":"2023-07-06T22:00:20.507454+0000","last_undegraded":"2023-07-06T22:00:20.507454+0000","last_fullsized":"2023-07-06T22:00:20.507454+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:03:07.635786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"130'8","reported_seq":21,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.495876+0000","last_change":"2023-07-06T22:00:19.117788+0000","last_active":"2023-07-06T22:00:21.495876+0000","last_peered":"2023-07-06T22:00:21.495876+0000","last_clean":"2023-07-06T22:00:21.495876+0000","last_became_active":"2023-07-06T22:00:19.117120+0000","last_became_peered":"2023-07-06T22:00:19.117120+0000","last_unstale":"2023-07-06T22:00:21.495876+0000","last_undegraded":"2023-07-06T22:00:21.495876+0000","last_fullsized":"2023-07-06T22:00:21.495876+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:55:04.893772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":203,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709730+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:00:20.709730+0000","last_peered":"2023-07-06T22:00:20.709730+0000","last_clean":"2023-07-06T22:00:20.709730+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:00:20.709730+0000","last_undegraded":"2023-07-06T22:00:20.709730+0000","last_fullsized":"2023-07-06T22:00:20.709730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:36:00.317491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297463+0000","last_change":"2023-07-06T22:00:19.532486+0000","last_active":"2023-07-06T22:00:22.297463+0000","last_peered":"2023-07-06T22:00:22.297463+0000","last_clean":"2023-07-06T22:00:22.297463+0000","last_became_active":"2023-07-06T22:00:19.532209+0000","last_became_peered":"2023-07-06T22:00:19.532209+0000","last_unstale":"2023-07-06T22:00:22.297463+0000","last_undegraded":"2023-07-06T22:00:22.297463+0000","last_fullsized":"2023-07-06T22:00:22.297463+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:06:45.596167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507665+0000","last_change":"2023-07-06T22:00:19.116048+0000","last_active":"2023-07-06T22:00:20.507665+0000","last_peered":"2023-07-06T22:00:20.507665+0000","last_clean":"2023-07-06T22:00:20.507665+0000","last_became_active":"2023-07-06T22:00:19.115732+0000","last_became_peered":"2023-07-06T22:00:19.115732+0000","last_unstale":"2023-07-06T22:00:20.507665+0000","last_undegraded":"2023-07-06T22:00:20.507665+0000","last_fullsized":"2023-07-06T22:00:20.507665+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:06:36.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":209,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297276+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:00:22.297276+0000","last_peered":"2023-07-06T22:00:22.297276+0000","last_clean":"2023-07-06T22:00:22.297276+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:00:22.297276+0000","last_undegraded":"2023-07-06T22:00:22.297276+0000","last_fullsized":"2023-07-06T22:00:22.297276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:39:10.969341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709954+0000","last_change":"2023-07-06T22:00:19.522607+0000","last_active":"2023-07-06T22:00:20.709954+0000","last_peered":"2023-07-06T22:00:20.709954+0000","last_clean":"2023-07-06T22:00:20.709954+0000","last_became_active":"2023-07-06T22:00:19.521669+0000","last_became_peered":"2023-07-06T22:00:19.521669+0000","last_unstale":"2023-07-06T22:00:20.709954+0000","last_undegraded":"2023-07-06T22:00:20.709954+0000","last_fullsized":"2023-07-06T22:00:20.709954+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:16:47.761100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496450+0000","last_change":"2023-07-06T22:00:19.111139+0000","last_active":"2023-07-06T22:00:21.496450+0000","last_peered":"2023-07-06T22:00:21.496450+0000","last_clean":"2023-07-06T22:00:21.496450+0000","last_became_active":"2023-07-06T22:00:19.110163+0000","last_became_peered":"2023-07-06T22:00:19.110163+0000","last_unstale":"2023-07-06T22:00:21.496450+0000","last_undegraded":"2023-07-06T22:00:21.496450+0000","last_fullsized":"2023-07-06T22:00:21.496450+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:17:06.548498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":233,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.510163+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:00:20.510163+0000","last_peered":"2023-07-06T22:00:20.510163+0000","last_clean":"2023-07-06T22:00:20.510163+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:00:20.510163+0000","last_undegraded":"2023-07-06T22:00:20.510163+0000","last_fullsized":"2023-07-06T22:00:20.510163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:32:47.486056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709989+0000","last_change":"2023-07-06T22:00:19.519415+0000","last_active":"2023-07-06T22:00:20.709989+0000","last_peered":"2023-07-06T22:00:20.709989+0000","last_clean":"2023-07-06T22:00:20.709989+0000","last_became_active":"2023-07-06T22:00:19.519157+0000","last_became_peered":"2023-07-06T22:00:19.519157+0000","last_unstale":"2023-07-06T22:00:20.709989+0000","last_undegraded":"2023-07-06T22:00:20.709989+0000","last_fullsized":"2023-07-06T22:00:20.709989+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:18:27.980890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"130'6","reported_seq":19,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298551+0000","last_change":"2023-07-06T22:00:19.122521+0000","last_active":"2023-07-06T22:00:22.298551+0000","last_peered":"2023-07-06T22:00:22.298551+0000","last_clean":"2023-07-06T22:00:22.298551+0000","last_became_active":"2023-07-06T22:00:19.122216+0000","last_became_peered":"2023-07-06T22:00:19.122216+0000","last_unstale":"2023-07-06T22:00:22.298551+0000","last_undegraded":"2023-07-06T22:00:22.298551+0000","last_fullsized":"2023-07-06T22:00:22.298551+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:47:21.546302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":209,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297031+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:00:22.297031+0000","last_peered":"2023-07-06T22:00:22.297031+0000","last_clean":"2023-07-06T22:00:22.297031+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:00:22.297031+0000","last_undegraded":"2023-07-06T22:00:22.297031+0000","last_fullsized":"2023-07-06T22:00:22.297031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:18:33.773322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507854+0000","last_change":"2023-07-06T22:00:19.521643+0000","last_active":"2023-07-06T22:00:20.507854+0000","last_peered":"2023-07-06T22:00:20.507854+0000","last_clean":"2023-07-06T22:00:20.507854+0000","last_became_active":"2023-07-06T22:00:19.521358+0000","last_became_peered":"2023-07-06T22:00:19.521358+0000","last_unstale":"2023-07-06T22:00:20.507854+0000","last_undegraded":"2023-07-06T22:00:20.507854+0000","last_fullsized":"2023-07-06T22:00:20.507854+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:53:14.431615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"130'3","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298010+0000","last_change":"2023-07-06T22:00:19.117430+0000","last_active":"2023-07-06T22:00:22.298010+0000","last_peered":"2023-07-06T22:00:22.298010+0000","last_clean":"2023-07-06T22:00:22.298010+0000","last_became_active":"2023-07-06T22:00:19.117112+0000","last_became_peered":"2023-07-06T22:00:19.117112+0000","last_unstale":"2023-07-06T22:00:22.298010+0000","last_undegraded":"2023-07-06T22:00:22.298010+0000","last_fullsized":"2023-07-06T22:00:22.298010+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:36:42.744722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296595+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:00:22.296595+0000","last_peered":"2023-07-06T22:00:22.296595+0000","last_clean":"2023-07-06T22:00:22.296595+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:00:22.296595+0000","last_undegraded":"2023-07-06T22:00:22.296595+0000","last_fullsized":"2023-07-06T22:00:22.296595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:29:23.091496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575068,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":2224128,"data_stored":1449853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.53500000000000003,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.54900000000000004,"5min":0.45800000000000002,"15min":0.45400000000000001},"max":{"1min":0.98399999999999999,"5min":1.048,"15min":1.048},"last":0.745}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69899999999999995,"15min":0.71399999999999997},"min":{"1min":0.54000000000000004,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.71899999999999997},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.68700000000000006,"15min":0.70299999999999996},"min":{"1min":0.53800000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.093,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.3480000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71799999999999997,"15min":0.71899999999999997},"min":{"1min":0.54400000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.181,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.73999999999999999},"min":{"1min":0.52400000000000002,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.2829999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.97199999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.621},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85099999999999998,"5min":1.169,"15min":1.169},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45700000000000002,"5min":0.376,"15min":0.35599999999999998},"max":{"1min":0.876,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.39000000000000001},"max":{"1min":0.90200000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":1.0069999999999999,"5min":1.45,"15min":1.45},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575068,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36728,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335112,"statfs":{"total":96636764160,"available":96599154688,"internally_reserved":0,"allocated":1622016,"data_stored":857920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68200000000000005,"15min":0.70299999999999996},"min":{"1min":0.52200000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88900000000000001,"5min":0.94699999999999995,"15min":0.97899999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.73499999999999999,"15min":0.73399999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.83999999999999997}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68700000000000006,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.93000000000000005,"5min":0.998,"15min":1.0229999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.75600000000000001,"15min":0.747},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.71499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":0.86499999999999999,"5min":0.90400000000000003,"15min":1.0129999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.995,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.75,"15min":0.753},"min":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.45800000000000002},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70299999999999996,"15min":0.72999999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.874,"5min":0.94799999999999995,"15min":1.0629999999999999},"last":0.87}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.38400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95399999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.44700000000000001,"5min":0.40899999999999997,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.621},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.45200000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97599999999999998,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91700000000000004,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.876,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.57699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575067,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54784,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317056,"statfs":{"total":96636764160,"available":96580665344,"internally_reserved":0,"allocated":1630208,"data_stored":859473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.58499999999999996,"5min":0.40600000000000003,"15min":0.36699999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.35299999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":1.0900000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68500000000000005,"15min":0.72099999999999997},"min":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70499999999999996,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.96899999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.498,"5min":0.47899999999999998,"15min":0.39900000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.72199999999999998,"15min":0.745},"min":{"1min":0.51000000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.95099999999999996}]},{"osd":3,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.70999999999999996,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.127},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.73199999999999998,"15min":0.76000000000000001},"min":{"1min":0.52700000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.92500000000000004}]},{"osd":4,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.315,"15min":0.315},"max":{"1min":0.86399999999999999,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":1.012},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":1.02},"last":0.871}]},{"osd":6,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.004},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.62},"min":{"1min":0.433,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.748}]},{"osd":7,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.45500000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91400000000000003,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.50900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95099999999999996,"5min":0.95299999999999996,"15min":1.0589999999999999},"last":0.89800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575066,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1622016,"data_stored":858869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.56100000000000005,"5min":0.46200000000000002,"15min":0.39400000000000002},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.079,"5min":1.123,"15min":1.123},"last":0.89000000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69999999999999996,"15min":0.71899999999999997},"min":{"1min":0.50700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":1.0029999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69699999999999995,"15min":0.72099999999999997},"min":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.55200000000000005,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.94099999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.745,"15min":0.752},"min":{"1min":0.55800000000000005,"5min":0.50600000000000001,"15min":0.49299999999999999},"max":{"1min":1.0609999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.308},"max":{"1min":0.82799999999999996,"5min":0.90600000000000003,"15min":0.94299999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.61199999999999999,"15min":0.59599999999999997},"min":{"1min":0.436,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.91800000000000004,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63500000000000001,"15min":0.60399999999999998},"min":{"1min":0.44800000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91000000000000003,"5min":1.036,"15min":1.036},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67400000000000004,"15min":0.65300000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.34799999999999998},"max":{"1min":0.93899999999999995,"5min":1,"15min":1},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68300000000000005,"15min":0.65500000000000003},"min":{"1min":0.53000000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.442,"15min":0.41599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.98399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575067,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1638400,"data_stored":860503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.42999999999999999,"15min":0.45000000000000001},"min":{"1min":0.27500000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65600000000000003,"5min":0.78700000000000003,"15min":1.0489999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.53700000000000003},"min":{"1min":0.39700000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76000000000000001,"5min":2.77,"15min":2.77},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.24299999999999999},"max":{"1min":0.747,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56499999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.97799999999999998,"5min":1.351,"15min":1.351},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68799999999999994,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":1.24},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.746,"15min":0.76700000000000002},"min":{"1min":0.52700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.069,"5min":1.1930000000000001,"15min":1.3009999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.75,"15min":0.78200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.024,"5min":1.383,"15min":1.383},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.052,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.79000000000000004},"min":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.05,"5min":1.327,"15min":1.3999999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.79600000000000004},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96599999999999997,"5min":1.3140000000000001,"15min":1.425},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79400000000000004,"15min":0.80900000000000005},"min":{"1min":0.52700000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.085,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.626}]},{"osd":7,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77900000000000003,"15min":0.81100000000000005},"min":{"1min":0.58199999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.034,"5min":3.097,"15min":3.097},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77400000000000002,"15min":0.80600000000000005},"min":{"1min":0.47099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.107,"5min":1.1140000000000001,"15min":1.3480000000000001},"last":0.53100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575067,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36728,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335112,"statfs":{"total":96636764160,"available":96599154688,"internally_reserved":0,"allocated":1622016,"data_stored":858869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67400000000000004,"5min":0.81699999999999995,"15min":0.85999999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.47999999999999998,"15min":0.502},"min":{"1min":0.30599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.82199999999999995,"5min":0.84399999999999997,"15min":0.85999999999999999},"last":0.432}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.378,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79300000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.42299999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67200000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.50900000000000001},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.40100000000000002,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.85599999999999998,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.52900000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1379999999999999,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.52100000000000002,"5min":0.47499999999999998,"15min":0.41399999999999998},"max":{"1min":1.403,"5min":1.591,"15min":1.591},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.79400000000000004},"min":{"1min":0.58499999999999996,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.1910000000000001,"5min":1.333,"15min":1.333},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77600000000000002,"15min":0.81200000000000006},"min":{"1min":0.56799999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0169999999999999,"5min":1.327,"15min":1.327},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.81100000000000005,"15min":0.82099999999999995},"min":{"1min":0.58199999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5329999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.79800000000000004,"15min":0.81799999999999995},"min":{"1min":0.60899999999999999,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.4950000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.80800000000000005,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.83699999999999997},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0880000000000001,"5min":1.573,"15min":1.573},"last":0.75600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575068,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58880,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312960,"statfs":{"total":96636764160,"available":96576471040,"internally_reserved":0,"allocated":1630208,"data_stored":858993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.42999999999999999,"15min":0.443},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.626,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48399999999999999,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.69099999999999995,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.433}]},{"osd":2,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69599999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.315},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.71399999999999997,"5min":0.79800000000000004,"15min":0.87},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.432,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.54600000000000004},"min":{"1min":0.39200000000000002,"5min":0.36699999999999999,"15min":0.32000000000000001},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.74399999999999999,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.47599999999999998,"15min":0.38500000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.3140000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.76500000000000001,"15min":0.78700000000000003},"min":{"1min":0.66500000000000004,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.626,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.55100000000000005,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.357},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.68200000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.878,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.71499999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.456},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.59099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.417},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.78600000000000003,"15min":0.81899999999999995},"min":{"1min":0.71699999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.88100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575067,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37324,"kb_used_data":2180,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334516,"statfs":{"total":96636764160,"available":96598544384,"internally_reserved":0,"allocated":2232320,"data_stored":1449894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.436},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":0.624,"5min":0.73599999999999999,"15min":0.86399999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.755,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.497},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.70699999999999996,"5min":0.81100000000000005,"15min":0.82399999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.53400000000000003},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68999999999999995,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.62}]},{"osd":3,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.49299999999999999,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76600000000000001,"5min":1.151,"15min":1.151},"last":0.502},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53500000000000003,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.874},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.72899999999999998,"15min":0.78200000000000003},"min":{"1min":0.52700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.8180000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73399999999999999,"15min":0.78100000000000003},"min":{"1min":0.54200000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.9550000000000001}]},{"osd":5,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.754,"15min":0.79500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72199999999999998,"15min":0.78100000000000003},"min":{"1min":0.57199999999999995,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.776}]},{"osd":6,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75900000000000001,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.851},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.746,"15min":0.78600000000000003},"min":{"1min":0.58499999999999996,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.9390000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.80600000000000005},"min":{"1min":0.56799999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.9099999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.78200000000000003,"15min":0.81399999999999995},"min":{"1min":0.60099999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.8859999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:00:28.201 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:00:28.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.353+0000 7fb8fd207640 1 Processor -- start 2023-07-06T22:00:28.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.353+0000 7fb8fd207640 1 -- start start 2023-07-06T22:00:28.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8fd207640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb8f80712f0 0x7fb8f806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:28.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8fd207640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8f80ca450 0x7fb8f815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:28.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8fd207640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f8159cd0 con 0x7fb8f80b3730 2023-07-06T22:00:28.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8fd207640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f80693f0 con 0x7fb8f80ca450 2023-07-06T22:00:28.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8fd207640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f806aca0 con 0x7fb8f80712f0 2023-07-06T22:00:28.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8f759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8f80ca450 0x7fb8f815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:28.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8f759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8f80ca450 0x7fb8f815d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58572/0 (socket says 172.21.15.55:58572) 2023-07-06T22:00:28.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8f759e640 1 -- 172.21.15.55:0/1097160890 learned_addr learned my addr 172.21.15.55:0/1097160890 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:28.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8f6d9d640 1 --2- 172.21.15.55:0/1097160890 >> v2:172.21.15.138:3300/0 conn(0x7fb8f80712f0 0x7fb8f806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:28.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8f759e640 1 -- 172.21.15.55:0/1097160890 >> v2:172.21.15.138:3300/0 conn(0x7fb8f80712f0 msgr2=0x7fb8f806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:28.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8f759e640 1 --2- 172.21.15.55:0/1097160890 >> v2:172.21.15.138:3300/0 conn(0x7fb8f80712f0 0x7fb8f806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8f759e640 1 -- 172.21.15.55:0/1097160890 >> v1:172.21.15.138:6789/0 conn(0x7fb8f80b3730 legacy=0x7fb8f80c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:28.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8f759e640 1 -- 172.21.15.55:0/1097160890 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f80696b0 con 0x7fb8f80ca450 2023-07-06T22:00:28.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8f6d9d640 1 --2- 172.21.15.55:0/1097160890 >> v2:172.21.15.138:3300/0 conn(0x7fb8f80712f0 0x7fb8f806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:28.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.357+0000 7fb8f759e640 1 --2- 172.21.15.55:0/1097160890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f80ca450 0x7fb8f815d3e0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8071950 tx=0x7fb8f001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcc738d683c96b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:28.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8f659c640 1 -- 172.21.15.55:0/1097160890 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f00a5820 con 0x7fb8f80ca450 2023-07-06T22:00:28.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8f659c640 1 -- 172.21.15.55:0/1097160890 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f00a5980 con 0x7fb8f80ca450 2023-07-06T22:00:28.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8f659c640 1 -- 172.21.15.55:0/1097160890 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f00a5d10 con 0x7fb8f80ca450 2023-07-06T22:00:28.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 -- 172.21.15.55:0/1097160890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f80ca450 msgr2=0x7fb8f815d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:28.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 --2- 172.21.15.55:0/1097160890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f80ca450 0x7fb8f815d3e0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8071950 tx=0x7fb8f001c960 comp rx=0 tx=0).stop 2023-07-06T22:00:28.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 -- 172.21.15.55:0/1097160890 shutdown_connections 2023-07-06T22:00:28.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 --2- 172.21.15.55:0/1097160890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f80ca450 0x7fb8f815d3e0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 --2- 172.21.15.55:0/1097160890 >> v2:172.21.15.138:3300/0 conn(0x7fb8f80712f0 0x7fb8f806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 -- 172.21.15.55:0/1097160890 >> 172.21.15.55:0/1097160890 conn(0x7fb8f80cded0 msgr2=0x7fb8f80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:28.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 -- 172.21.15.55:0/1097160890 shutdown_connections 2023-07-06T22:00:28.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 -- 172.21.15.55:0/1097160890 wait complete. 2023-07-06T22:00:28.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 Processor -- start 2023-07-06T22:00:28.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 -- start start 2023-07-06T22:00:28.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8f80712f0 0x7fb8f8157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:28.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f80b3730 0x7fb8f80c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:28.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f80ca450 0x7fb8f8155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:28.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f8158480 con 0x7fb8f80b3730 2023-07-06T22:00:28.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f8147e40 con 0x7fb8f80ca450 2023-07-06T22:00:28.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.361+0000 7fb8fd207640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80c4730 con 0x7fb8f80712f0 2023-07-06T22:00:28.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8effff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f80b3730 0x7fb8f80c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:28.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8effff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f80b3730 0x7fb8f80c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58582/0 (socket says 172.21.15.55:58582) 2023-07-06T22:00:28.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8effff640 1 -- 172.21.15.55:0/795574663 learned_addr learned my addr 172.21.15.55:0/795574663 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:28.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8f6d9d640 1 --2- 172.21.15.55:0/795574663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8f80712f0 0x7fb8f8157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:28.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8effff640 1 -- 172.21.15.55:0/795574663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8f80712f0 msgr2=0x7fb8f8157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:28.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8effff640 1 --2- 172.21.15.55:0/795574663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8f80712f0 0x7fb8f8157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8effff640 1 -- 172.21.15.55:0/795574663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f80ca450 msgr2=0x7fb8f8155420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T22:00:28.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8effff640 1 --2- 172.21.15.55:0/795574663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f80ca450 0x7fb8f8155420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8effff640 1 -- 172.21.15.55:0/795574663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f0009b30 con 0x7fb8f80b3730 2023-07-06T22:00:28.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8effff640 1 --2- 172.21.15.55:0/795574663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f80b3730 0x7fb8f80c41f0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000c490 tx=0x7fb8e0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:28.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8ef7fe640 1 -- 172.21.15.55:0/795574663 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0003600 con 0x7fb8f80b3730 2023-07-06T22:00:28.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8ef7fe640 1 -- 172.21.15.55:0/795574663 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e0003780 con 0x7fb8f80b3730 2023-07-06T22:00:28.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8ef7fe640 1 -- 172.21.15.55:0/795574663 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0003b30 con 0x7fb8f80b3730 2023-07-06T22:00:28.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8fd207640 1 -- 172.21.15.55:0/795574663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f8155960 con 0x7fb8f80b3730 2023-07-06T22:00:28.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8fd207640 1 -- 172.21.15.55:0/795574663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f8158130 con 0x7fb8f80b3730 2023-07-06T22:00:28.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8fd207640 1 -- 172.21.15.55:0/795574663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f8066d60 con 0x7fb8f80b3730 2023-07-06T22:00:28.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8ef7fe640 1 -- 172.21.15.55:0/795574663 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb8e0003c90 con 0x7fb8f80b3730 2023-07-06T22:00:28.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8ef7fe640 1 --2- 172.21.15.55:0/795574663 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb8d80663a0 0x7fb8d8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:28.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.365+0000 7fb8ef7fe640 1 -- 172.21.15.55:0/795574663 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb8e00831d0 con 0x7fb8f80b3730 2023-07-06T22:00:28.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.369+0000 7fb8f6d9d640 1 --2- 172.21.15.55:0/795574663 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb8d80663a0 0x7fb8d8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:28.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.369+0000 7fb8f6d9d640 1 --2- 172.21.15.55:0/795574663 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb8d80663a0 0x7fb8d8068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8006fd0 tx=0x7fb8e8008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:28.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.369+0000 7fb8ef7fe640 1 -- 172.21.15.55:0/795574663 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb8e0050360 con 0x7fb8f80b3730 2023-07-06T22:00:28.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.525+0000 7fb8fd207640 1 -- 172.21.15.55:0/795574663 --> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8f80b3e30 con 0x7fb8d80663a0 2023-07-06T22:00:28.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.533+0000 7fb8ef7fe640 1 -- 172.21.15.55:0/795574663 <== mgr.8376 v2:172.21.15.55:6832/3817107512 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311405 (secure 0 0 0) 0x7fb8e800c050 con 0x7fb8d80663a0 2023-07-06T22:00:28.535 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:28.537 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:00:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.537+0000 7fb8fd207640 1 -- 172.21.15.55:0/795574663 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb8d80663a0 msgr2=0x7fb8d8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.537+0000 7fb8fd207640 1 --2- 172.21.15.55:0/795574663 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb8d80663a0 0x7fb8d8068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8006fd0 tx=0x7fb8e8008040 comp rx=0 tx=0).stop 2023-07-06T22:00:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.537+0000 7fb8fd207640 1 -- 172.21.15.55:0/795574663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f80b3730 msgr2=0x7fb8f80c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.537+0000 7fb8fd207640 1 --2- 172.21.15.55:0/795574663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f80b3730 0x7fb8f80c41f0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000c490 tx=0x7fb8e0001e80 comp rx=0 tx=0).stop 2023-07-06T22:00:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.537+0000 7fb8fd207640 1 -- 172.21.15.55:0/795574663 shutdown_connections 2023-07-06T22:00:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.537+0000 7fb8fd207640 1 --2- 172.21.15.55:0/795574663 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fb8d80663a0 0x7fb8d8068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.537+0000 7fb8fd207640 1 --2- 172.21.15.55:0/795574663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f80ca450 0x7fb8f8155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.537+0000 7fb8fd207640 1 --2- 172.21.15.55:0/795574663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f80b3730 0x7fb8f80c41f0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.537+0000 7fb8fd207640 1 --2- 172.21.15.55:0/795574663 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8f80712f0 0x7fb8f8157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.537+0000 7fb8fd207640 1 -- 172.21.15.55:0/795574663 >> 172.21.15.55:0/795574663 conn(0x7fb8f80cded0 msgr2=0x7fb8f80c93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:28.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.537+0000 7fb8fd207640 1 -- 172.21.15.55:0/795574663 shutdown_connections 2023-07-06T22:00:28.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.537+0000 7fb8fd207640 1 -- 172.21.15.55:0/795574663 wait complete. 2023-07-06T22:00:28.556 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-06T22:00:27.004130+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":403,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":327040,"kb_used_data":13888,"kb_used_omap":0,"kb_used_meta":313088,"kb_avail":754647680,"statfs":{"total":773094113280,"available":772759224320,"internally_reserved":0,"allocated":14221312,"data_stored":8054374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320602112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.912060"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298472+0000","last_change":"2023-07-06T22:00:19.536895+0000","last_active":"2023-07-06T22:00:22.298472+0000","last_peered":"2023-07-06T22:00:22.298472+0000","last_clean":"2023-07-06T22:00:22.298472+0000","last_became_active":"2023-07-06T22:00:19.536582+0000","last_became_peered":"2023-07-06T22:00:19.536582+0000","last_unstale":"2023-07-06T22:00:22.298472+0000","last_undegraded":"2023-07-06T22:00:22.298472+0000","last_fullsized":"2023-07-06T22:00:22.298472+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:45:31.421864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509506+0000","last_change":"2023-07-06T22:00:19.523797+0000","last_active":"2023-07-06T22:00:20.509506+0000","last_peered":"2023-07-06T22:00:20.509506+0000","last_clean":"2023-07-06T22:00:20.509506+0000","last_became_active":"2023-07-06T22:00:19.523118+0000","last_became_peered":"2023-07-06T22:00:19.523118+0000","last_unstale":"2023-07-06T22:00:20.509506+0000","last_undegraded":"2023-07-06T22:00:20.509506+0000","last_fullsized":"2023-07-06T22:00:20.509506+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:48:34.248551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509773+0000","last_change":"2023-07-06T22:00:19.521875+0000","last_active":"2023-07-06T22:00:20.509773+0000","last_peered":"2023-07-06T22:00:20.509773+0000","last_clean":"2023-07-06T22:00:20.509773+0000","last_became_active":"2023-07-06T22:00:19.521585+0000","last_became_peered":"2023-07-06T22:00:19.521585+0000","last_unstale":"2023-07-06T22:00:20.509773+0000","last_undegraded":"2023-07-06T22:00:20.509773+0000","last_fullsized":"2023-07-06T22:00:20.509773+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:52:08.948226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298223+0000","last_change":"2023-07-06T22:00:19.538600+0000","last_active":"2023-07-06T22:00:22.298223+0000","last_peered":"2023-07-06T22:00:22.298223+0000","last_clean":"2023-07-06T22:00:22.298223+0000","last_became_active":"2023-07-06T22:00:19.538014+0000","last_became_peered":"2023-07-06T22:00:19.538014+0000","last_unstale":"2023-07-06T22:00:22.298223+0000","last_undegraded":"2023-07-06T22:00:22.298223+0000","last_fullsized":"2023-07-06T22:00:22.298223+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:37:46.185880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496205+0000","last_change":"2023-07-06T22:00:19.518402+0000","last_active":"2023-07-06T22:00:21.496205+0000","last_peered":"2023-07-06T22:00:21.496205+0000","last_clean":"2023-07-06T22:00:21.496205+0000","last_became_active":"2023-07-06T22:00:19.517424+0000","last_became_peered":"2023-07-06T22:00:19.517424+0000","last_unstale":"2023-07-06T22:00:21.496205+0000","last_undegraded":"2023-07-06T22:00:21.496205+0000","last_fullsized":"2023-07-06T22:00:21.496205+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:19:40.149896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296840+0000","last_change":"2023-07-06T22:00:19.524280+0000","last_active":"2023-07-06T22:00:22.296840+0000","last_peered":"2023-07-06T22:00:22.296840+0000","last_clean":"2023-07-06T22:00:22.296840+0000","last_became_active":"2023-07-06T22:00:19.524001+0000","last_became_peered":"2023-07-06T22:00:19.524001+0000","last_unstale":"2023-07-06T22:00:22.296840+0000","last_undegraded":"2023-07-06T22:00:22.296840+0000","last_fullsized":"2023-07-06T22:00:22.296840+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:00:51.223389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709756+0000","last_change":"2023-07-06T22:00:19.526814+0000","last_active":"2023-07-06T22:00:20.709756+0000","last_peered":"2023-07-06T22:00:20.709756+0000","last_clean":"2023-07-06T22:00:20.709756+0000","last_became_active":"2023-07-06T22:00:19.526524+0000","last_became_peered":"2023-07-06T22:00:19.526524+0000","last_unstale":"2023-07-06T22:00:20.709756+0000","last_undegraded":"2023-07-06T22:00:20.709756+0000","last_fullsized":"2023-07-06T22:00:20.709756+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:10:09.688325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.508832+0000","last_change":"2023-07-06T22:00:19.518033+0000","last_active":"2023-07-06T22:00:20.508832+0000","last_peered":"2023-07-06T22:00:20.508832+0000","last_clean":"2023-07-06T22:00:20.508832+0000","last_became_active":"2023-07-06T22:00:19.517742+0000","last_became_peered":"2023-07-06T22:00:19.517742+0000","last_unstale":"2023-07-06T22:00:20.508832+0000","last_undegraded":"2023-07-06T22:00:20.508832+0000","last_fullsized":"2023-07-06T22:00:20.508832+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:58:27.689911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298597+0000","last_change":"2023-07-06T22:00:19.532828+0000","last_active":"2023-07-06T22:00:22.298597+0000","last_peered":"2023-07-06T22:00:22.298597+0000","last_clean":"2023-07-06T22:00:22.298597+0000","last_became_active":"2023-07-06T22:00:19.532572+0000","last_became_peered":"2023-07-06T22:00:19.532572+0000","last_unstale":"2023-07-06T22:00:22.298597+0000","last_undegraded":"2023-07-06T22:00:22.298597+0000","last_fullsized":"2023-07-06T22:00:22.298597+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:42:58.471684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298169+0000","last_change":"2023-07-06T22:00:19.528705+0000","last_active":"2023-07-06T22:00:22.298169+0000","last_peered":"2023-07-06T22:00:22.298169+0000","last_clean":"2023-07-06T22:00:22.298169+0000","last_became_active":"2023-07-06T22:00:19.528368+0000","last_became_peered":"2023-07-06T22:00:19.528368+0000","last_unstale":"2023-07-06T22:00:22.298169+0000","last_undegraded":"2023-07-06T22:00:22.298169+0000","last_fullsized":"2023-07-06T22:00:22.298169+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:55:24.220338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509483+0000","last_change":"2023-07-06T22:00:19.523753+0000","last_active":"2023-07-06T22:00:20.509483+0000","last_peered":"2023-07-06T22:00:20.509483+0000","last_clean":"2023-07-06T22:00:20.509483+0000","last_became_active":"2023-07-06T22:00:19.523225+0000","last_became_peered":"2023-07-06T22:00:19.523225+0000","last_unstale":"2023-07-06T22:00:20.509483+0000","last_undegraded":"2023-07-06T22:00:20.509483+0000","last_fullsized":"2023-07-06T22:00:20.509483+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:53:06.917841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298055+0000","last_change":"2023-07-06T22:00:19.539667+0000","last_active":"2023-07-06T22:00:22.298055+0000","last_peered":"2023-07-06T22:00:22.298055+0000","last_clean":"2023-07-06T22:00:22.298055+0000","last_became_active":"2023-07-06T22:00:19.539080+0000","last_became_peered":"2023-07-06T22:00:19.539080+0000","last_unstale":"2023-07-06T22:00:22.298055+0000","last_undegraded":"2023-07-06T22:00:22.298055+0000","last_fullsized":"2023-07-06T22:00:22.298055+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:09:38.241241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509775+0000","last_change":"2023-07-06T22:00:19.512918+0000","last_active":"2023-07-06T22:00:20.509775+0000","last_peered":"2023-07-06T22:00:20.509775+0000","last_clean":"2023-07-06T22:00:20.509775+0000","last_became_active":"2023-07-06T22:00:19.512639+0000","last_became_peered":"2023-07-06T22:00:19.512639+0000","last_unstale":"2023-07-06T22:00:20.509775+0000","last_undegraded":"2023-07-06T22:00:20.509775+0000","last_fullsized":"2023-07-06T22:00:20.509775+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:00:20.193632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.508761+0000","last_change":"2023-07-06T22:00:19.512117+0000","last_active":"2023-07-06T22:00:20.508761+0000","last_peered":"2023-07-06T22:00:20.508761+0000","last_clean":"2023-07-06T22:00:20.508761+0000","last_became_active":"2023-07-06T22:00:19.511838+0000","last_became_peered":"2023-07-06T22:00:19.511838+0000","last_unstale":"2023-07-06T22:00:20.508761+0000","last_undegraded":"2023-07-06T22:00:20.508761+0000","last_fullsized":"2023-07-06T22:00:20.508761+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:45:06.777538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296693+0000","last_change":"2023-07-06T22:00:19.523145+0000","last_active":"2023-07-06T22:00:22.296693+0000","last_peered":"2023-07-06T22:00:22.296693+0000","last_clean":"2023-07-06T22:00:22.296693+0000","last_became_active":"2023-07-06T22:00:19.522840+0000","last_became_peered":"2023-07-06T22:00:19.522840+0000","last_unstale":"2023-07-06T22:00:22.296693+0000","last_undegraded":"2023-07-06T22:00:22.296693+0000","last_fullsized":"2023-07-06T22:00:22.296693+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:35:57.208353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297417+0000","last_change":"2023-07-06T22:00:19.536147+0000","last_active":"2023-07-06T22:00:22.297417+0000","last_peered":"2023-07-06T22:00:22.297417+0000","last_clean":"2023-07-06T22:00:22.297417+0000","last_became_active":"2023-07-06T22:00:19.535895+0000","last_became_peered":"2023-07-06T22:00:19.535895+0000","last_unstale":"2023-07-06T22:00:22.297417+0000","last_undegraded":"2023-07-06T22:00:22.297417+0000","last_fullsized":"2023-07-06T22:00:22.297417+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:57:34.532925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509840+0000","last_change":"2023-07-06T22:00:19.523523+0000","last_active":"2023-07-06T22:00:20.509840+0000","last_peered":"2023-07-06T22:00:20.509840+0000","last_clean":"2023-07-06T22:00:20.509840+0000","last_became_active":"2023-07-06T22:00:19.523241+0000","last_became_peered":"2023-07-06T22:00:19.523241+0000","last_unstale":"2023-07-06T22:00:20.509840+0000","last_undegraded":"2023-07-06T22:00:20.509840+0000","last_fullsized":"2023-07-06T22:00:20.509840+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:30:40.081281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297245+0000","last_change":"2023-07-06T22:00:19.520320+0000","last_active":"2023-07-06T22:00:22.297245+0000","last_peered":"2023-07-06T22:00:22.297245+0000","last_clean":"2023-07-06T22:00:22.297245+0000","last_became_active":"2023-07-06T22:00:19.520057+0000","last_became_peered":"2023-07-06T22:00:19.520057+0000","last_unstale":"2023-07-06T22:00:22.297245+0000","last_undegraded":"2023-07-06T22:00:22.297245+0000","last_fullsized":"2023-07-06T22:00:22.297245+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:37:00.232430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509911+0000","last_change":"2023-07-06T22:00:19.513000+0000","last_active":"2023-07-06T22:00:20.509911+0000","last_peered":"2023-07-06T22:00:20.509911+0000","last_clean":"2023-07-06T22:00:20.509911+0000","last_became_active":"2023-07-06T22:00:19.512701+0000","last_became_peered":"2023-07-06T22:00:19.512701+0000","last_unstale":"2023-07-06T22:00:20.509911+0000","last_undegraded":"2023-07-06T22:00:20.509911+0000","last_fullsized":"2023-07-06T22:00:20.509911+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:08:50.860554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509563+0000","last_change":"2023-07-06T22:00:19.518730+0000","last_active":"2023-07-06T22:00:20.509563+0000","last_peered":"2023-07-06T22:00:20.509563+0000","last_clean":"2023-07-06T22:00:20.509563+0000","last_became_active":"2023-07-06T22:00:19.518445+0000","last_became_peered":"2023-07-06T22:00:19.518445+0000","last_unstale":"2023-07-06T22:00:20.509563+0000","last_undegraded":"2023-07-06T22:00:20.509563+0000","last_fullsized":"2023-07-06T22:00:20.509563+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:00:13.462971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509631+0000","last_change":"2023-07-06T22:00:19.528051+0000","last_active":"2023-07-06T22:00:20.509631+0000","last_peered":"2023-07-06T22:00:20.509631+0000","last_clean":"2023-07-06T22:00:20.509631+0000","last_became_active":"2023-07-06T22:00:19.527678+0000","last_became_peered":"2023-07-06T22:00:19.527678+0000","last_unstale":"2023-07-06T22:00:20.509631+0000","last_undegraded":"2023-07-06T22:00:20.509631+0000","last_fullsized":"2023-07-06T22:00:20.509631+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:54:47.207565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507974+0000","last_change":"2023-07-06T22:00:19.523653+0000","last_active":"2023-07-06T22:00:20.507974+0000","last_peered":"2023-07-06T22:00:20.507974+0000","last_clean":"2023-07-06T22:00:20.507974+0000","last_became_active":"2023-07-06T22:00:19.523128+0000","last_became_peered":"2023-07-06T22:00:19.523128+0000","last_unstale":"2023-07-06T22:00:20.507974+0000","last_undegraded":"2023-07-06T22:00:20.507974+0000","last_fullsized":"2023-07-06T22:00:20.507974+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:07:07.457552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509054+0000","last_change":"2023-07-06T22:00:19.518489+0000","last_active":"2023-07-06T22:00:20.509054+0000","last_peered":"2023-07-06T22:00:20.509054+0000","last_clean":"2023-07-06T22:00:20.509054+0000","last_became_active":"2023-07-06T22:00:19.518155+0000","last_became_peered":"2023-07-06T22:00:19.518155+0000","last_unstale":"2023-07-06T22:00:20.509054+0000","last_undegraded":"2023-07-06T22:00:20.509054+0000","last_fullsized":"2023-07-06T22:00:20.509054+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:11:31.093974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507412+0000","last_change":"2023-07-06T22:00:19.515968+0000","last_active":"2023-07-06T22:00:20.507412+0000","last_peered":"2023-07-06T22:00:20.507412+0000","last_clean":"2023-07-06T22:00:20.507412+0000","last_became_active":"2023-07-06T22:00:19.515549+0000","last_became_peered":"2023-07-06T22:00:19.515549+0000","last_unstale":"2023-07-06T22:00:20.507412+0000","last_undegraded":"2023-07-06T22:00:20.507412+0000","last_fullsized":"2023-07-06T22:00:20.507412+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:06:32.040479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509980+0000","last_change":"2023-07-06T22:00:19.519624+0000","last_active":"2023-07-06T22:00:20.509980+0000","last_peered":"2023-07-06T22:00:20.509980+0000","last_clean":"2023-07-06T22:00:20.509980+0000","last_became_active":"2023-07-06T22:00:19.518789+0000","last_became_peered":"2023-07-06T22:00:19.518789+0000","last_unstale":"2023-07-06T22:00:20.509980+0000","last_undegraded":"2023-07-06T22:00:20.509980+0000","last_fullsized":"2023-07-06T22:00:20.509980+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:24:23.655840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298236+0000","last_change":"2023-07-06T22:00:19.530103+0000","last_active":"2023-07-06T22:00:22.298236+0000","last_peered":"2023-07-06T22:00:22.298236+0000","last_clean":"2023-07-06T22:00:22.298236+0000","last_became_active":"2023-07-06T22:00:19.529785+0000","last_became_peered":"2023-07-06T22:00:19.529785+0000","last_unstale":"2023-07-06T22:00:22.298236+0000","last_undegraded":"2023-07-06T22:00:22.298236+0000","last_fullsized":"2023-07-06T22:00:22.298236+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:51:25.209474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297088+0000","last_change":"2023-07-06T22:00:19.538130+0000","last_active":"2023-07-06T22:00:22.297088+0000","last_peered":"2023-07-06T22:00:22.297088+0000","last_clean":"2023-07-06T22:00:22.297088+0000","last_became_active":"2023-07-06T22:00:19.537828+0000","last_became_peered":"2023-07-06T22:00:19.537828+0000","last_unstale":"2023-07-06T22:00:22.297088+0000","last_undegraded":"2023-07-06T22:00:22.297088+0000","last_fullsized":"2023-07-06T22:00:22.297088+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:05:09.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507718+0000","last_change":"2023-07-06T22:00:19.541707+0000","last_active":"2023-07-06T22:00:20.507718+0000","last_peered":"2023-07-06T22:00:20.507718+0000","last_clean":"2023-07-06T22:00:20.507718+0000","last_became_active":"2023-07-06T22:00:19.541418+0000","last_became_peered":"2023-07-06T22:00:19.541418+0000","last_unstale":"2023-07-06T22:00:20.507718+0000","last_undegraded":"2023-07-06T22:00:20.507718+0000","last_fullsized":"2023-07-06T22:00:20.507718+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:46:47.916892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509246+0000","last_change":"2023-07-06T22:00:19.519543+0000","last_active":"2023-07-06T22:00:20.509246+0000","last_peered":"2023-07-06T22:00:20.509246+0000","last_clean":"2023-07-06T22:00:20.509246+0000","last_became_active":"2023-07-06T22:00:19.519265+0000","last_became_peered":"2023-07-06T22:00:19.519265+0000","last_unstale":"2023-07-06T22:00:20.509246+0000","last_undegraded":"2023-07-06T22:00:20.509246+0000","last_fullsized":"2023-07-06T22:00:20.509246+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:29:39.993399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709891+0000","last_change":"2023-07-06T22:00:19.530857+0000","last_active":"2023-07-06T22:00:20.709891+0000","last_peered":"2023-07-06T22:00:20.709891+0000","last_clean":"2023-07-06T22:00:20.709891+0000","last_became_active":"2023-07-06T22:00:19.530568+0000","last_became_peered":"2023-07-06T22:00:19.530568+0000","last_unstale":"2023-07-06T22:00:20.709891+0000","last_undegraded":"2023-07-06T22:00:20.709891+0000","last_fullsized":"2023-07-06T22:00:20.709891+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:34:59.776755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297524+0000","last_change":"2023-07-06T22:00:19.530028+0000","last_active":"2023-07-06T22:00:22.297524+0000","last_peered":"2023-07-06T22:00:22.297524+0000","last_clean":"2023-07-06T22:00:22.297524+0000","last_became_active":"2023-07-06T22:00:19.529752+0000","last_became_peered":"2023-07-06T22:00:19.529752+0000","last_unstale":"2023-07-06T22:00:22.297524+0000","last_undegraded":"2023-07-06T22:00:22.297524+0000","last_fullsized":"2023-07-06T22:00:22.297524+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:24:58.134036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296725+0000","last_change":"2023-07-06T22:00:19.528008+0000","last_active":"2023-07-06T22:00:22.296725+0000","last_peered":"2023-07-06T22:00:22.296725+0000","last_clean":"2023-07-06T22:00:22.296725+0000","last_became_active":"2023-07-06T22:00:19.527721+0000","last_became_peered":"2023-07-06T22:00:19.527721+0000","last_unstale":"2023-07-06T22:00:22.296725+0000","last_undegraded":"2023-07-06T22:00:22.296725+0000","last_fullsized":"2023-07-06T22:00:22.296725+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:22:35.093106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297049+0000","last_change":"2023-07-06T22:00:19.522037+0000","last_active":"2023-07-06T22:00:22.297049+0000","last_peered":"2023-07-06T22:00:22.297049+0000","last_clean":"2023-07-06T22:00:22.297049+0000","last_became_active":"2023-07-06T22:00:19.521724+0000","last_became_peered":"2023-07-06T22:00:19.521724+0000","last_unstale":"2023-07-06T22:00:22.297049+0000","last_undegraded":"2023-07-06T22:00:22.297049+0000","last_fullsized":"2023-07-06T22:00:22.297049+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:37:31.957732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"130'4","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.710026+0000","last_change":"2023-07-06T22:00:19.113848+0000","last_active":"2023-07-06T22:00:20.710026+0000","last_peered":"2023-07-06T22:00:20.710026+0000","last_clean":"2023-07-06T22:00:20.710026+0000","last_became_active":"2023-07-06T22:00:19.113533+0000","last_became_peered":"2023-07-06T22:00:19.113533+0000","last_unstale":"2023-07-06T22:00:20.710026+0000","last_undegraded":"2023-07-06T22:00:20.710026+0000","last_fullsized":"2023-07-06T22:00:20.710026+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:58:41.970832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297398+0000","last_change":"2023-07-06T22:00:19.512349+0000","last_active":"2023-07-06T22:00:22.297398+0000","last_peered":"2023-07-06T22:00:22.297398+0000","last_clean":"2023-07-06T22:00:22.297398+0000","last_became_active":"2023-07-06T22:00:19.511991+0000","last_became_peered":"2023-07-06T22:00:19.511991+0000","last_unstale":"2023-07-06T22:00:22.297398+0000","last_undegraded":"2023-07-06T22:00:22.297398+0000","last_fullsized":"2023-07-06T22:00:22.297398+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:21:20.300533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"130'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.510052+0000","last_change":"2023-07-06T22:00:19.111966+0000","last_active":"2023-07-06T22:00:20.510052+0000","last_peered":"2023-07-06T22:00:20.510052+0000","last_clean":"2023-07-06T22:00:20.510052+0000","last_became_active":"2023-07-06T22:00:19.111606+0000","last_became_peered":"2023-07-06T22:00:19.111606+0000","last_unstale":"2023-07-06T22:00:20.510052+0000","last_undegraded":"2023-07-06T22:00:20.510052+0000","last_fullsized":"2023-07-06T22:00:20.510052+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:09:03.373691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297112+0000","last_change":"2023-07-06T22:00:19.526360+0000","last_active":"2023-07-06T22:00:22.297112+0000","last_peered":"2023-07-06T22:00:22.297112+0000","last_clean":"2023-07-06T22:00:22.297112+0000","last_became_active":"2023-07-06T22:00:19.526045+0000","last_became_peered":"2023-07-06T22:00:19.526045+0000","last_unstale":"2023-07-06T22:00:22.297112+0000","last_undegraded":"2023-07-06T22:00:22.297112+0000","last_fullsized":"2023-07-06T22:00:22.297112+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:40:37.683760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"130'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496340+0000","last_change":"2023-07-06T22:00:19.110718+0000","last_active":"2023-07-06T22:00:21.496340+0000","last_peered":"2023-07-06T22:00:21.496340+0000","last_clean":"2023-07-06T22:00:21.496340+0000","last_became_active":"2023-07-06T22:00:19.110436+0000","last_became_peered":"2023-07-06T22:00:19.110436+0000","last_unstale":"2023-07-06T22:00:21.496340+0000","last_undegraded":"2023-07-06T22:00:21.496340+0000","last_fullsized":"2023-07-06T22:00:21.496340+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:36:17.138132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509942+0000","last_change":"2023-07-06T22:00:19.524058+0000","last_active":"2023-07-06T22:00:20.509942+0000","last_peered":"2023-07-06T22:00:20.509942+0000","last_clean":"2023-07-06T22:00:20.509942+0000","last_became_active":"2023-07-06T22:00:19.523537+0000","last_became_peered":"2023-07-06T22:00:19.523537+0000","last_unstale":"2023-07-06T22:00:20.509942+0000","last_undegraded":"2023-07-06T22:00:20.509942+0000","last_fullsized":"2023-07-06T22:00:20.509942+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:48:49.809987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"130'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496081+0000","last_change":"2023-07-06T22:00:19.110487+0000","last_active":"2023-07-06T22:00:21.496081+0000","last_peered":"2023-07-06T22:00:21.496081+0000","last_clean":"2023-07-06T22:00:21.496081+0000","last_became_active":"2023-07-06T22:00:19.110133+0000","last_became_peered":"2023-07-06T22:00:19.110133+0000","last_unstale":"2023-07-06T22:00:21.496081+0000","last_undegraded":"2023-07-06T22:00:21.496081+0000","last_fullsized":"2023-07-06T22:00:21.496081+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:55:01.720182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297506+0000","last_change":"2023-07-06T22:00:19.537726+0000","last_active":"2023-07-06T22:00:22.297506+0000","last_peered":"2023-07-06T22:00:22.297506+0000","last_clean":"2023-07-06T22:00:22.297506+0000","last_became_active":"2023-07-06T22:00:19.537443+0000","last_became_peered":"2023-07-06T22:00:19.537443+0000","last_unstale":"2023-07-06T22:00:22.297506+0000","last_undegraded":"2023-07-06T22:00:22.297506+0000","last_fullsized":"2023-07-06T22:00:22.297506+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:15:10.905515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"130'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709564+0000","last_change":"2023-07-06T22:00:19.112201+0000","last_active":"2023-07-06T22:00:20.709564+0000","last_peered":"2023-07-06T22:00:20.709564+0000","last_clean":"2023-07-06T22:00:20.709564+0000","last_became_active":"2023-07-06T22:00:19.111847+0000","last_became_peered":"2023-07-06T22:00:19.111847+0000","last_unstale":"2023-07-06T22:00:20.709564+0000","last_undegraded":"2023-07-06T22:00:20.709564+0000","last_fullsized":"2023-07-06T22:00:20.709564+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:43:56.303490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509421+0000","last_change":"2023-07-06T22:00:19.522759+0000","last_active":"2023-07-06T22:00:20.509421+0000","last_peered":"2023-07-06T22:00:20.509421+0000","last_clean":"2023-07-06T22:00:20.509421+0000","last_became_active":"2023-07-06T22:00:19.522504+0000","last_became_peered":"2023-07-06T22:00:19.522504+0000","last_unstale":"2023-07-06T22:00:20.509421+0000","last_undegraded":"2023-07-06T22:00:20.509421+0000","last_fullsized":"2023-07-06T22:00:20.509421+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:43:29.995596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"130'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507984+0000","last_change":"2023-07-06T22:00:19.116593+0000","last_active":"2023-07-06T22:00:20.507984+0000","last_peered":"2023-07-06T22:00:20.507984+0000","last_clean":"2023-07-06T22:00:20.507984+0000","last_became_active":"2023-07-06T22:00:19.116291+0000","last_became_peered":"2023-07-06T22:00:19.116291+0000","last_unstale":"2023-07-06T22:00:20.507984+0000","last_undegraded":"2023-07-06T22:00:20.507984+0000","last_fullsized":"2023-07-06T22:00:20.507984+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:29.411141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297400+0000","last_change":"2023-07-06T22:00:19.539232+0000","last_active":"2023-07-06T22:00:22.297400+0000","last_peered":"2023-07-06T22:00:22.297400+0000","last_clean":"2023-07-06T22:00:22.297400+0000","last_became_active":"2023-07-06T22:00:19.537001+0000","last_became_peered":"2023-07-06T22:00:19.537001+0000","last_unstale":"2023-07-06T22:00:22.297400+0000","last_undegraded":"2023-07-06T22:00:22.297400+0000","last_fullsized":"2023-07-06T22:00:22.297400+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:46:10.505795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509003+0000","last_change":"2023-07-06T22:00:19.117137+0000","last_active":"2023-07-06T22:00:20.509003+0000","last_peered":"2023-07-06T22:00:20.509003+0000","last_clean":"2023-07-06T22:00:20.509003+0000","last_became_active":"2023-07-06T22:00:19.116815+0000","last_became_peered":"2023-07-06T22:00:19.116815+0000","last_unstale":"2023-07-06T22:00:20.509003+0000","last_undegraded":"2023-07-06T22:00:20.509003+0000","last_fullsized":"2023-07-06T22:00:20.509003+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:23:50.167440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709591+0000","last_change":"2023-07-06T22:00:19.526880+0000","last_active":"2023-07-06T22:00:20.709591+0000","last_peered":"2023-07-06T22:00:20.709591+0000","last_clean":"2023-07-06T22:00:20.709591+0000","last_became_active":"2023-07-06T22:00:19.526602+0000","last_became_peered":"2023-07-06T22:00:19.526602+0000","last_unstale":"2023-07-06T22:00:20.709591+0000","last_undegraded":"2023-07-06T22:00:20.709591+0000","last_fullsized":"2023-07-06T22:00:20.709591+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:47:20.419579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297602+0000","last_change":"2023-07-06T22:00:19.122728+0000","last_active":"2023-07-06T22:00:22.297602+0000","last_peered":"2023-07-06T22:00:22.297602+0000","last_clean":"2023-07-06T22:00:22.297602+0000","last_became_active":"2023-07-06T22:00:19.122394+0000","last_became_peered":"2023-07-06T22:00:19.122394+0000","last_unstale":"2023-07-06T22:00:22.297602+0000","last_undegraded":"2023-07-06T22:00:22.297602+0000","last_fullsized":"2023-07-06T22:00:22.297602+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:36:11.594573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496476+0000","last_change":"2023-07-06T22:00:19.535100+0000","last_active":"2023-07-06T22:00:21.496476+0000","last_peered":"2023-07-06T22:00:21.496476+0000","last_clean":"2023-07-06T22:00:21.496476+0000","last_became_active":"2023-07-06T22:00:19.534813+0000","last_became_peered":"2023-07-06T22:00:19.534813+0000","last_unstale":"2023-07-06T22:00:21.496476+0000","last_undegraded":"2023-07-06T22:00:21.496476+0000","last_fullsized":"2023-07-06T22:00:21.496476+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:08:00.498775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"130'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298708+0000","last_change":"2023-07-06T22:00:19.115430+0000","last_active":"2023-07-06T22:00:22.298708+0000","last_peered":"2023-07-06T22:00:22.298708+0000","last_clean":"2023-07-06T22:00:22.298708+0000","last_became_active":"2023-07-06T22:00:19.115153+0000","last_became_peered":"2023-07-06T22:00:19.115153+0000","last_unstale":"2023-07-06T22:00:22.298708+0000","last_undegraded":"2023-07-06T22:00:22.298708+0000","last_fullsized":"2023-07-06T22:00:22.298708+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:44:50.744950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297293+0000","last_change":"2023-07-06T22:00:19.530079+0000","last_active":"2023-07-06T22:00:22.297293+0000","last_peered":"2023-07-06T22:00:22.297293+0000","last_clean":"2023-07-06T22:00:22.297293+0000","last_became_active":"2023-07-06T22:00:19.529809+0000","last_became_peered":"2023-07-06T22:00:19.529809+0000","last_unstale":"2023-07-06T22:00:22.297293+0000","last_undegraded":"2023-07-06T22:00:22.297293+0000","last_fullsized":"2023-07-06T22:00:22.297293+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:17:21.295134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"130'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496499+0000","last_change":"2023-07-06T22:00:19.108939+0000","last_active":"2023-07-06T22:00:21.496499+0000","last_peered":"2023-07-06T22:00:21.496499+0000","last_clean":"2023-07-06T22:00:21.496499+0000","last_became_active":"2023-07-06T22:00:19.108657+0000","last_became_peered":"2023-07-06T22:00:19.108657+0000","last_unstale":"2023-07-06T22:00:21.496499+0000","last_undegraded":"2023-07-06T22:00:21.496499+0000","last_fullsized":"2023-07-06T22:00:21.496499+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:01:45.287912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.510186+0000","last_change":"2023-07-06T22:00:19.540836+0000","last_active":"2023-07-06T22:00:20.510186+0000","last_peered":"2023-07-06T22:00:20.510186+0000","last_clean":"2023-07-06T22:00:20.510186+0000","last_became_active":"2023-07-06T22:00:19.540576+0000","last_became_peered":"2023-07-06T22:00:19.540576+0000","last_unstale":"2023-07-06T22:00:20.510186+0000","last_undegraded":"2023-07-06T22:00:20.510186+0000","last_fullsized":"2023-07-06T22:00:20.510186+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:44:30.532524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"130'1","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296861+0000","last_change":"2023-07-06T22:00:19.117296+0000","last_active":"2023-07-06T22:00:22.296861+0000","last_peered":"2023-07-06T22:00:22.296861+0000","last_clean":"2023-07-06T22:00:22.296861+0000","last_became_active":"2023-07-06T22:00:19.116942+0000","last_became_peered":"2023-07-06T22:00:19.116942+0000","last_unstale":"2023-07-06T22:00:22.296861+0000","last_undegraded":"2023-07-06T22:00:22.296861+0000","last_fullsized":"2023-07-06T22:00:22.296861+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:23:38.143648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.510086+0000","last_change":"2023-07-06T22:00:19.517651+0000","last_active":"2023-07-06T22:00:20.510086+0000","last_peered":"2023-07-06T22:00:20.510086+0000","last_clean":"2023-07-06T22:00:20.510086+0000","last_became_active":"2023-07-06T22:00:19.517313+0000","last_became_peered":"2023-07-06T22:00:19.517313+0000","last_unstale":"2023-07-06T22:00:20.510086+0000","last_undegraded":"2023-07-06T22:00:20.510086+0000","last_fullsized":"2023-07-06T22:00:20.510086+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:14:03.324414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709696+0000","last_change":"2023-07-06T22:00:19.127449+0000","last_active":"2023-07-06T22:00:20.709696+0000","last_peered":"2023-07-06T22:00:20.709696+0000","last_clean":"2023-07-06T22:00:20.709696+0000","last_became_active":"2023-07-06T22:00:19.127202+0000","last_became_peered":"2023-07-06T22:00:19.127202+0000","last_unstale":"2023-07-06T22:00:20.709696+0000","last_undegraded":"2023-07-06T22:00:20.709696+0000","last_fullsized":"2023-07-06T22:00:20.709696+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:36:41.111223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.508713+0000","last_change":"2023-07-06T22:00:19.520998+0000","last_active":"2023-07-06T22:00:20.508713+0000","last_peered":"2023-07-06T22:00:20.508713+0000","last_clean":"2023-07-06T22:00:20.508713+0000","last_became_active":"2023-07-06T22:00:19.520722+0000","last_became_peered":"2023-07-06T22:00:19.520722+0000","last_unstale":"2023-07-06T22:00:20.508713+0000","last_undegraded":"2023-07-06T22:00:20.508713+0000","last_fullsized":"2023-07-06T22:00:20.508713+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:52.134403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"130'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297042+0000","last_change":"2023-07-06T22:00:19.107428+0000","last_active":"2023-07-06T22:00:22.297042+0000","last_peered":"2023-07-06T22:00:22.297042+0000","last_clean":"2023-07-06T22:00:22.297042+0000","last_became_active":"2023-07-06T22:00:19.107149+0000","last_became_peered":"2023-07-06T22:00:19.107149+0000","last_unstale":"2023-07-06T22:00:22.297042+0000","last_undegraded":"2023-07-06T22:00:22.297042+0000","last_fullsized":"2023-07-06T22:00:22.297042+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:58:00.224116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297539+0000","last_change":"2023-07-06T22:00:19.535632+0000","last_active":"2023-07-06T22:00:22.297539+0000","last_peered":"2023-07-06T22:00:22.297539+0000","last_clean":"2023-07-06T22:00:22.297539+0000","last_became_active":"2023-07-06T22:00:19.535386+0000","last_became_peered":"2023-07-06T22:00:19.535386+0000","last_unstale":"2023-07-06T22:00:22.297539+0000","last_undegraded":"2023-07-06T22:00:22.297539+0000","last_fullsized":"2023-07-06T22:00:22.297539+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:11:39.089221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.495873+0000","last_change":"2023-07-06T22:00:19.110768+0000","last_active":"2023-07-06T22:00:21.495873+0000","last_peered":"2023-07-06T22:00:21.495873+0000","last_clean":"2023-07-06T22:00:21.495873+0000","last_became_active":"2023-07-06T22:00:19.110476+0000","last_became_peered":"2023-07-06T22:00:19.110476+0000","last_unstale":"2023-07-06T22:00:21.495873+0000","last_undegraded":"2023-07-06T22:00:21.495873+0000","last_fullsized":"2023-07-06T22:00:21.495873+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:18:51.750249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.508686+0000","last_change":"2023-07-06T22:00:19.513469+0000","last_active":"2023-07-06T22:00:20.508686+0000","last_peered":"2023-07-06T22:00:20.508686+0000","last_clean":"2023-07-06T22:00:20.508686+0000","last_became_active":"2023-07-06T22:00:19.513179+0000","last_became_peered":"2023-07-06T22:00:19.513179+0000","last_unstale":"2023-07-06T22:00:20.508686+0000","last_undegraded":"2023-07-06T22:00:20.508686+0000","last_fullsized":"2023-07-06T22:00:20.508686+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:57:59.958463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296764+0000","last_change":"2023-07-06T22:00:19.110185+0000","last_active":"2023-07-06T22:00:22.296764+0000","last_peered":"2023-07-06T22:00:22.296764+0000","last_clean":"2023-07-06T22:00:22.296764+0000","last_became_active":"2023-07-06T22:00:19.109899+0000","last_became_peered":"2023-07-06T22:00:19.109899+0000","last_unstale":"2023-07-06T22:00:22.296764+0000","last_undegraded":"2023-07-06T22:00:22.296764+0000","last_fullsized":"2023-07-06T22:00:22.296764+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:49:49.507690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507540+0000","last_change":"2023-07-06T22:00:19.528905+0000","last_active":"2023-07-06T22:00:20.507540+0000","last_peered":"2023-07-06T22:00:20.507540+0000","last_clean":"2023-07-06T22:00:20.507540+0000","last_became_active":"2023-07-06T22:00:19.528638+0000","last_became_peered":"2023-07-06T22:00:19.528638+0000","last_unstale":"2023-07-06T22:00:20.507540+0000","last_undegraded":"2023-07-06T22:00:20.507540+0000","last_fullsized":"2023-07-06T22:00:20.507540+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:29:55.529759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297653+0000","last_change":"2023-07-06T22:00:19.116489+0000","last_active":"2023-07-06T22:00:22.297653+0000","last_peered":"2023-07-06T22:00:22.297653+0000","last_clean":"2023-07-06T22:00:22.297653+0000","last_became_active":"2023-07-06T22:00:19.116218+0000","last_became_peered":"2023-07-06T22:00:19.116218+0000","last_unstale":"2023-07-06T22:00:22.297653+0000","last_undegraded":"2023-07-06T22:00:22.297653+0000","last_fullsized":"2023-07-06T22:00:22.297653+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:45:31.923105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297112+0000","last_change":"2023-07-06T22:00:19.531367+0000","last_active":"2023-07-06T22:00:22.297112+0000","last_peered":"2023-07-06T22:00:22.297112+0000","last_clean":"2023-07-06T22:00:22.297112+0000","last_became_active":"2023-07-06T22:00:19.531092+0000","last_became_peered":"2023-07-06T22:00:19.531092+0000","last_unstale":"2023-07-06T22:00:22.297112+0000","last_undegraded":"2023-07-06T22:00:22.297112+0000","last_fullsized":"2023-07-06T22:00:22.297112+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:03:48.683895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"130'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507738+0000","last_change":"2023-07-06T22:00:19.123298+0000","last_active":"2023-07-06T22:00:20.507738+0000","last_peered":"2023-07-06T22:00:20.507738+0000","last_clean":"2023-07-06T22:00:20.507738+0000","last_became_active":"2023-07-06T22:00:19.123017+0000","last_became_peered":"2023-07-06T22:00:19.123017+0000","last_unstale":"2023-07-06T22:00:20.507738+0000","last_undegraded":"2023-07-06T22:00:20.507738+0000","last_fullsized":"2023-07-06T22:00:20.507738+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:27:37.446228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298726+0000","last_change":"2023-07-06T22:00:19.531661+0000","last_active":"2023-07-06T22:00:22.298726+0000","last_peered":"2023-07-06T22:00:22.298726+0000","last_clean":"2023-07-06T22:00:22.298726+0000","last_became_active":"2023-07-06T22:00:19.530593+0000","last_became_peered":"2023-07-06T22:00:19.530593+0000","last_unstale":"2023-07-06T22:00:22.298726+0000","last_undegraded":"2023-07-06T22:00:22.298726+0000","last_fullsized":"2023-07-06T22:00:22.298726+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:20:53.075055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297201+0000","last_change":"2023-07-06T22:00:19.109521+0000","last_active":"2023-07-06T22:00:22.297201+0000","last_peered":"2023-07-06T22:00:22.297201+0000","last_clean":"2023-07-06T22:00:22.297201+0000","last_became_active":"2023-07-06T22:00:19.109085+0000","last_became_peered":"2023-07-06T22:00:19.109085+0000","last_unstale":"2023-07-06T22:00:22.297201+0000","last_undegraded":"2023-07-06T22:00:22.297201+0000","last_fullsized":"2023-07-06T22:00:22.297201+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:16:20.287566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298067+0000","last_change":"2023-07-06T22:00:19.538789+0000","last_active":"2023-07-06T22:00:22.298067+0000","last_peered":"2023-07-06T22:00:22.298067+0000","last_clean":"2023-07-06T22:00:22.298067+0000","last_became_active":"2023-07-06T22:00:19.538295+0000","last_became_peered":"2023-07-06T22:00:19.538295+0000","last_unstale":"2023-07-06T22:00:22.298067+0000","last_undegraded":"2023-07-06T22:00:22.298067+0000","last_fullsized":"2023-07-06T22:00:22.298067+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:48.749603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298092+0000","last_change":"2023-07-06T22:00:19.114035+0000","last_active":"2023-07-06T22:00:22.298092+0000","last_peered":"2023-07-06T22:00:22.298092+0000","last_clean":"2023-07-06T22:00:22.298092+0000","last_became_active":"2023-07-06T22:00:19.113744+0000","last_became_peered":"2023-07-06T22:00:19.113744+0000","last_unstale":"2023-07-06T22:00:22.298092+0000","last_undegraded":"2023-07-06T22:00:22.298092+0000","last_fullsized":"2023-07-06T22:00:22.298092+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:36:15.758843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296903+0000","last_change":"2023-07-06T22:00:19.534797+0000","last_active":"2023-07-06T22:00:22.296903+0000","last_peered":"2023-07-06T22:00:22.296903+0000","last_clean":"2023-07-06T22:00:22.296903+0000","last_became_active":"2023-07-06T22:00:19.534527+0000","last_became_peered":"2023-07-06T22:00:19.534527+0000","last_unstale":"2023-07-06T22:00:22.296903+0000","last_undegraded":"2023-07-06T22:00:22.296903+0000","last_fullsized":"2023-07-06T22:00:22.296903+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:22:46.452966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507898+0000","last_change":"2023-07-06T22:00:19.116160+0000","last_active":"2023-07-06T22:00:20.507898+0000","last_peered":"2023-07-06T22:00:20.507898+0000","last_clean":"2023-07-06T22:00:20.507898+0000","last_became_active":"2023-07-06T22:00:19.115877+0000","last_became_peered":"2023-07-06T22:00:19.115877+0000","last_unstale":"2023-07-06T22:00:20.507898+0000","last_undegraded":"2023-07-06T22:00:20.507898+0000","last_fullsized":"2023-07-06T22:00:20.507898+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:01:25.106591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509198+0000","last_change":"2023-07-06T22:00:19.521952+0000","last_active":"2023-07-06T22:00:20.509198+0000","last_peered":"2023-07-06T22:00:20.509198+0000","last_clean":"2023-07-06T22:00:20.509198+0000","last_became_active":"2023-07-06T22:00:19.521678+0000","last_became_peered":"2023-07-06T22:00:19.521678+0000","last_unstale":"2023-07-06T22:00:20.509198+0000","last_undegraded":"2023-07-06T22:00:20.509198+0000","last_fullsized":"2023-07-06T22:00:20.509198+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:45:06.095232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709627+0000","last_change":"2023-07-06T22:00:19.111105+0000","last_active":"2023-07-06T22:00:20.709627+0000","last_peered":"2023-07-06T22:00:20.709627+0000","last_clean":"2023-07-06T22:00:20.709627+0000","last_became_active":"2023-07-06T22:00:19.110803+0000","last_became_peered":"2023-07-06T22:00:19.110803+0000","last_unstale":"2023-07-06T22:00:20.709627+0000","last_undegraded":"2023-07-06T22:00:20.709627+0000","last_fullsized":"2023-07-06T22:00:20.709627+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:37:46.460557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509682+0000","last_change":"2023-07-06T22:00:19.526365+0000","last_active":"2023-07-06T22:00:20.509682+0000","last_peered":"2023-07-06T22:00:20.509682+0000","last_clean":"2023-07-06T22:00:20.509682+0000","last_became_active":"2023-07-06T22:00:19.526088+0000","last_became_peered":"2023-07-06T22:00:19.526088+0000","last_unstale":"2023-07-06T22:00:20.509682+0000","last_undegraded":"2023-07-06T22:00:20.509682+0000","last_fullsized":"2023-07-06T22:00:20.509682+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:39.732757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509166+0000","last_change":"2023-07-06T22:00:19.109264+0000","last_active":"2023-07-06T22:00:20.509166+0000","last_peered":"2023-07-06T22:00:20.509166+0000","last_clean":"2023-07-06T22:00:20.509166+0000","last_became_active":"2023-07-06T22:00:19.108874+0000","last_became_peered":"2023-07-06T22:00:19.108874+0000","last_unstale":"2023-07-06T22:00:20.509166+0000","last_undegraded":"2023-07-06T22:00:20.509166+0000","last_fullsized":"2023-07-06T22:00:20.509166+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:18:45.965630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.508685+0000","last_change":"2023-07-06T22:00:19.512337+0000","last_active":"2023-07-06T22:00:20.508685+0000","last_peered":"2023-07-06T22:00:20.508685+0000","last_clean":"2023-07-06T22:00:20.508685+0000","last_became_active":"2023-07-06T22:00:19.511984+0000","last_became_peered":"2023-07-06T22:00:19.511984+0000","last_unstale":"2023-07-06T22:00:20.508685+0000","last_undegraded":"2023-07-06T22:00:20.508685+0000","last_fullsized":"2023-07-06T22:00:20.508685+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:47:50.700447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496060+0000","last_change":"2023-07-06T22:00:19.110783+0000","last_active":"2023-07-06T22:00:21.496060+0000","last_peered":"2023-07-06T22:00:21.496060+0000","last_clean":"2023-07-06T22:00:21.496060+0000","last_became_active":"2023-07-06T22:00:19.110460+0000","last_became_peered":"2023-07-06T22:00:19.110460+0000","last_unstale":"2023-07-06T22:00:21.496060+0000","last_undegraded":"2023-07-06T22:00:21.496060+0000","last_fullsized":"2023-07-06T22:00:21.496060+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:30:28.929751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297636+0000","last_change":"2023-07-06T22:00:19.532426+0000","last_active":"2023-07-06T22:00:22.297636+0000","last_peered":"2023-07-06T22:00:22.297636+0000","last_clean":"2023-07-06T22:00:22.297636+0000","last_became_active":"2023-07-06T22:00:19.532161+0000","last_became_peered":"2023-07-06T22:00:19.532161+0000","last_unstale":"2023-07-06T22:00:22.297636+0000","last_undegraded":"2023-07-06T22:00:22.297636+0000","last_fullsized":"2023-07-06T22:00:22.297636+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:19:34.700115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297720+0000","last_change":"2023-07-06T22:00:19.116401+0000","last_active":"2023-07-06T22:00:22.297720+0000","last_peered":"2023-07-06T22:00:22.297720+0000","last_clean":"2023-07-06T22:00:22.297720+0000","last_became_active":"2023-07-06T22:00:19.116074+0000","last_became_peered":"2023-07-06T22:00:19.116074+0000","last_unstale":"2023-07-06T22:00:22.297720+0000","last_undegraded":"2023-07-06T22:00:22.297720+0000","last_fullsized":"2023-07-06T22:00:22.297720+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:27:06.909193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507528+0000","last_change":"2023-07-06T22:00:19.515795+0000","last_active":"2023-07-06T22:00:20.507528+0000","last_peered":"2023-07-06T22:00:20.507528+0000","last_clean":"2023-07-06T22:00:20.507528+0000","last_became_active":"2023-07-06T22:00:19.515219+0000","last_became_peered":"2023-07-06T22:00:19.515219+0000","last_unstale":"2023-07-06T22:00:20.507528+0000","last_undegraded":"2023-07-06T22:00:20.507528+0000","last_fullsized":"2023-07-06T22:00:20.507528+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:30:45.699795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709718+0000","last_change":"2023-07-06T22:00:19.123129+0000","last_active":"2023-07-06T22:00:20.709718+0000","last_peered":"2023-07-06T22:00:20.709718+0000","last_clean":"2023-07-06T22:00:20.709718+0000","last_became_active":"2023-07-06T22:00:19.122885+0000","last_became_peered":"2023-07-06T22:00:19.122885+0000","last_unstale":"2023-07-06T22:00:20.709718+0000","last_undegraded":"2023-07-06T22:00:20.709718+0000","last_fullsized":"2023-07-06T22:00:20.709718+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:28:40.163238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"119'227","reported_seq":780,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.509155+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:00:20.509155+0000","last_peered":"2023-07-06T22:00:20.509155+0000","last_clean":"2023-07-06T22:00:20.509155+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:00:20.509155+0000","last_undegraded":"2023-07-06T22:00:20.509155+0000","last_fullsized":"2023-07-06T22:00:20.509155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:36:43.856066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":203,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709848+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:00:20.709848+0000","last_peered":"2023-07-06T22:00:20.709848+0000","last_clean":"2023-07-06T22:00:20.709848+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:00:20.709848+0000","last_undegraded":"2023-07-06T22:00:20.709848+0000","last_fullsized":"2023-07-06T22:00:20.709848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:59:01.795574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507782+0000","last_change":"2023-07-06T22:00:19.514460+0000","last_active":"2023-07-06T22:00:20.507782+0000","last_peered":"2023-07-06T22:00:20.507782+0000","last_clean":"2023-07-06T22:00:20.507782+0000","last_became_active":"2023-07-06T22:00:19.514203+0000","last_became_peered":"2023-07-06T22:00:19.514203+0000","last_unstale":"2023-07-06T22:00:20.507782+0000","last_undegraded":"2023-07-06T22:00:20.507782+0000","last_fullsized":"2023-07-06T22:00:20.507782+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:06:36.680704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297065+0000","last_change":"2023-07-06T22:00:19.116267+0000","last_active":"2023-07-06T22:00:22.297065+0000","last_peered":"2023-07-06T22:00:22.297065+0000","last_clean":"2023-07-06T22:00:22.297065+0000","last_became_active":"2023-07-06T22:00:19.115944+0000","last_became_peered":"2023-07-06T22:00:19.115944+0000","last_unstale":"2023-07-06T22:00:22.297065+0000","last_undegraded":"2023-07-06T22:00:22.297065+0000","last_fullsized":"2023-07-06T22:00:22.297065+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:41.559728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":234,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.508908+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:00:20.508908+0000","last_peered":"2023-07-06T22:00:20.508908+0000","last_clean":"2023-07-06T22:00:20.508908+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:00:20.508908+0000","last_undegraded":"2023-07-06T22:00:20.508908+0000","last_fullsized":"2023-07-06T22:00:20.508908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:42:31.682989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507934+0000","last_change":"2023-07-06T22:00:19.523475+0000","last_active":"2023-07-06T22:00:20.507934+0000","last_peered":"2023-07-06T22:00:20.507934+0000","last_clean":"2023-07-06T22:00:20.507934+0000","last_became_active":"2023-07-06T22:00:19.522850+0000","last_became_peered":"2023-07-06T22:00:19.522850+0000","last_unstale":"2023-07-06T22:00:20.507934+0000","last_undegraded":"2023-07-06T22:00:20.507934+0000","last_fullsized":"2023-07-06T22:00:20.507934+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:46:29.895225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"130'2","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296950+0000","last_change":"2023-07-06T22:00:19.112721+0000","last_active":"2023-07-06T22:00:22.296950+0000","last_peered":"2023-07-06T22:00:22.296950+0000","last_clean":"2023-07-06T22:00:22.296950+0000","last_became_active":"2023-07-06T22:00:19.112446+0000","last_became_peered":"2023-07-06T22:00:19.112446+0000","last_unstale":"2023-07-06T22:00:22.296950+0000","last_undegraded":"2023-07-06T22:00:22.296950+0000","last_fullsized":"2023-07-06T22:00:22.296950+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:02:26.745101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496112+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:00:21.496112+0000","last_peered":"2023-07-06T22:00:21.496112+0000","last_clean":"2023-07-06T22:00:21.496112+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:00:21.496112+0000","last_undegraded":"2023-07-06T22:00:21.496112+0000","last_fullsized":"2023-07-06T22:00:21.496112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:26:46.288040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507454+0000","last_change":"2023-07-06T22:00:19.521593+0000","last_active":"2023-07-06T22:00:20.507454+0000","last_peered":"2023-07-06T22:00:20.507454+0000","last_clean":"2023-07-06T22:00:20.507454+0000","last_became_active":"2023-07-06T22:00:19.521296+0000","last_became_peered":"2023-07-06T22:00:19.521296+0000","last_unstale":"2023-07-06T22:00:20.507454+0000","last_undegraded":"2023-07-06T22:00:20.507454+0000","last_fullsized":"2023-07-06T22:00:20.507454+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:03:07.635786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"130'8","reported_seq":21,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.495876+0000","last_change":"2023-07-06T22:00:19.117788+0000","last_active":"2023-07-06T22:00:21.495876+0000","last_peered":"2023-07-06T22:00:21.495876+0000","last_clean":"2023-07-06T22:00:21.495876+0000","last_became_active":"2023-07-06T22:00:19.117120+0000","last_became_peered":"2023-07-06T22:00:19.117120+0000","last_unstale":"2023-07-06T22:00:21.495876+0000","last_undegraded":"2023-07-06T22:00:21.495876+0000","last_fullsized":"2023-07-06T22:00:21.495876+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:55:04.893772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":203,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709730+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:00:20.709730+0000","last_peered":"2023-07-06T22:00:20.709730+0000","last_clean":"2023-07-06T22:00:20.709730+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:00:20.709730+0000","last_undegraded":"2023-07-06T22:00:20.709730+0000","last_fullsized":"2023-07-06T22:00:20.709730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:36:00.317491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297463+0000","last_change":"2023-07-06T22:00:19.532486+0000","last_active":"2023-07-06T22:00:22.297463+0000","last_peered":"2023-07-06T22:00:22.297463+0000","last_clean":"2023-07-06T22:00:22.297463+0000","last_became_active":"2023-07-06T22:00:19.532209+0000","last_became_peered":"2023-07-06T22:00:19.532209+0000","last_unstale":"2023-07-06T22:00:22.297463+0000","last_undegraded":"2023-07-06T22:00:22.297463+0000","last_fullsized":"2023-07-06T22:00:22.297463+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:06:45.596167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507665+0000","last_change":"2023-07-06T22:00:19.116048+0000","last_active":"2023-07-06T22:00:20.507665+0000","last_peered":"2023-07-06T22:00:20.507665+0000","last_clean":"2023-07-06T22:00:20.507665+0000","last_became_active":"2023-07-06T22:00:19.115732+0000","last_became_peered":"2023-07-06T22:00:19.115732+0000","last_unstale":"2023-07-06T22:00:20.507665+0000","last_undegraded":"2023-07-06T22:00:20.507665+0000","last_fullsized":"2023-07-06T22:00:20.507665+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:06:36.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":209,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297276+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:00:22.297276+0000","last_peered":"2023-07-06T22:00:22.297276+0000","last_clean":"2023-07-06T22:00:22.297276+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:00:22.297276+0000","last_undegraded":"2023-07-06T22:00:22.297276+0000","last_fullsized":"2023-07-06T22:00:22.297276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:39:10.969341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709954+0000","last_change":"2023-07-06T22:00:19.522607+0000","last_active":"2023-07-06T22:00:20.709954+0000","last_peered":"2023-07-06T22:00:20.709954+0000","last_clean":"2023-07-06T22:00:20.709954+0000","last_became_active":"2023-07-06T22:00:19.521669+0000","last_became_peered":"2023-07-06T22:00:19.521669+0000","last_unstale":"2023-07-06T22:00:20.709954+0000","last_undegraded":"2023-07-06T22:00:20.709954+0000","last_fullsized":"2023-07-06T22:00:20.709954+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:16:47.761100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:21.496450+0000","last_change":"2023-07-06T22:00:19.111139+0000","last_active":"2023-07-06T22:00:21.496450+0000","last_peered":"2023-07-06T22:00:21.496450+0000","last_clean":"2023-07-06T22:00:21.496450+0000","last_became_active":"2023-07-06T22:00:19.110163+0000","last_became_peered":"2023-07-06T22:00:19.110163+0000","last_unstale":"2023-07-06T22:00:21.496450+0000","last_undegraded":"2023-07-06T22:00:21.496450+0000","last_fullsized":"2023-07-06T22:00:21.496450+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:17:06.548498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":233,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.510163+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:00:20.510163+0000","last_peered":"2023-07-06T22:00:20.510163+0000","last_clean":"2023-07-06T22:00:20.510163+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:00:20.510163+0000","last_undegraded":"2023-07-06T22:00:20.510163+0000","last_fullsized":"2023-07-06T22:00:20.510163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:32:47.486056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.709989+0000","last_change":"2023-07-06T22:00:19.519415+0000","last_active":"2023-07-06T22:00:20.709989+0000","last_peered":"2023-07-06T22:00:20.709989+0000","last_clean":"2023-07-06T22:00:20.709989+0000","last_became_active":"2023-07-06T22:00:19.519157+0000","last_became_peered":"2023-07-06T22:00:19.519157+0000","last_unstale":"2023-07-06T22:00:20.709989+0000","last_undegraded":"2023-07-06T22:00:20.709989+0000","last_fullsized":"2023-07-06T22:00:20.709989+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:18:27.980890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"130'6","reported_seq":19,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298551+0000","last_change":"2023-07-06T22:00:19.122521+0000","last_active":"2023-07-06T22:00:22.298551+0000","last_peered":"2023-07-06T22:00:22.298551+0000","last_clean":"2023-07-06T22:00:22.298551+0000","last_became_active":"2023-07-06T22:00:19.122216+0000","last_became_peered":"2023-07-06T22:00:19.122216+0000","last_unstale":"2023-07-06T22:00:22.298551+0000","last_undegraded":"2023-07-06T22:00:22.298551+0000","last_fullsized":"2023-07-06T22:00:22.298551+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:47:21.546302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":209,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.297031+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:00:22.297031+0000","last_peered":"2023-07-06T22:00:22.297031+0000","last_clean":"2023-07-06T22:00:22.297031+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:00:22.297031+0000","last_undegraded":"2023-07-06T22:00:22.297031+0000","last_fullsized":"2023-07-06T22:00:22.297031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:18:33.773322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":11,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:20.507854+0000","last_change":"2023-07-06T22:00:19.521643+0000","last_active":"2023-07-06T22:00:20.507854+0000","last_peered":"2023-07-06T22:00:20.507854+0000","last_clean":"2023-07-06T22:00:20.507854+0000","last_became_active":"2023-07-06T22:00:19.521358+0000","last_became_peered":"2023-07-06T22:00:19.521358+0000","last_unstale":"2023-07-06T22:00:20.507854+0000","last_undegraded":"2023-07-06T22:00:20.507854+0000","last_fullsized":"2023-07-06T22:00:20.507854+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:19.081465+0000","last_clean_scrub_stamp":"2023-07-06T22:00:19.081465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:53:14.431615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"130'3","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.298010+0000","last_change":"2023-07-06T22:00:19.117430+0000","last_active":"2023-07-06T22:00:22.298010+0000","last_peered":"2023-07-06T22:00:22.298010+0000","last_clean":"2023-07-06T22:00:22.298010+0000","last_became_active":"2023-07-06T22:00:19.117112+0000","last_became_peered":"2023-07-06T22:00:19.117112+0000","last_unstale":"2023-07-06T22:00:22.298010+0000","last_undegraded":"2023-07-06T22:00:22.298010+0000","last_fullsized":"2023-07-06T22:00:22.298010+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:00:18.070448+0000","last_clean_scrub_stamp":"2023-07-06T22:00:18.070448+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:36:42.744722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":131,"state":"active+clean","last_fresh":"2023-07-06T22:00:22.296595+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:00:22.296595+0000","last_peered":"2023-07-06T22:00:22.296595+0000","last_clean":"2023-07-06T22:00:22.296595+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:00:22.296595+0000","last_undegraded":"2023-07-06T22:00:22.296595+0000","last_fullsized":"2023-07-06T22:00:22.296595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:29:23.091496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575068,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":2224128,"data_stored":1449853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.53500000000000003,"5min":0.40999999999999998,"15min":0.30599999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.54900000000000004,"5min":0.45800000000000002,"15min":0.45400000000000001},"max":{"1min":0.98399999999999999,"5min":1.048,"15min":1.048},"last":0.745}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69899999999999995,"15min":0.71399999999999997},"min":{"1min":0.54000000000000004,"5min":0.42899999999999999,"15min":0.34799999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.71899999999999997},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.68700000000000006,"15min":0.70299999999999996},"min":{"1min":0.53800000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.093,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.3480000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71799999999999997,"15min":0.71899999999999997},"min":{"1min":0.54400000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.181,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.73999999999999999},"min":{"1min":0.52400000000000002,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.2829999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.97199999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.621},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85099999999999998,"5min":1.169,"15min":1.169},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.45700000000000002,"5min":0.376,"15min":0.35599999999999998},"max":{"1min":0.876,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.39000000000000001},"max":{"1min":0.90200000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.40200000000000002},"max":{"1min":1.0069999999999999,"5min":1.45,"15min":1.45},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575068,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36728,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335112,"statfs":{"total":96636764160,"available":96599154688,"internally_reserved":0,"allocated":1622016,"data_stored":857920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68200000000000005,"15min":0.70299999999999996},"min":{"1min":0.52200000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88900000000000001,"5min":0.94699999999999995,"15min":0.97899999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.73499999999999999,"15min":0.73399999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.83999999999999997}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68700000000000006,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.93000000000000005,"5min":0.998,"15min":1.0229999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.75600000000000001,"15min":0.747},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.71499999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":0.86499999999999999,"5min":0.90400000000000003,"15min":1.0129999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.995,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.75,"15min":0.753},"min":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.45800000000000002},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70299999999999996,"15min":0.72999999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.874,"5min":0.94799999999999995,"15min":1.0629999999999999},"last":0.87}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.38400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95399999999999996,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94099999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.44700000000000001,"5min":0.40899999999999997,"15min":0.38600000000000001},"max":{"1min":0.90300000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.621},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.45200000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97599999999999998,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91700000000000004,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.46000000000000002,"5min":0.435,"15min":0.40899999999999997},"max":{"1min":0.876,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.57699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575067,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54784,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317056,"statfs":{"total":96636764160,"available":96580665344,"internally_reserved":0,"allocated":1630208,"data_stored":859473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.58499999999999996,"5min":0.40600000000000003,"15min":0.36699999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.35299999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":1.0900000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68500000000000005,"15min":0.72099999999999997},"min":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70499999999999996,"15min":0.72999999999999998},"min":{"1min":0.47299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.96899999999999997}]},{"osd":2,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.498,"5min":0.47899999999999998,"15min":0.39900000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.72199999999999998,"15min":0.745},"min":{"1min":0.51000000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.95099999999999996}]},{"osd":3,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.70999999999999996,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.127},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.73199999999999998,"15min":0.76000000000000001},"min":{"1min":0.52700000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.92500000000000004}]},{"osd":4,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.315,"15min":0.315},"max":{"1min":0.86399999999999999,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":1.012},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":1.02},"last":0.871}]},{"osd":6,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.004},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.62},"min":{"1min":0.433,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.748}]},{"osd":7,"last update":"Thu Jul 6 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.45500000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91400000000000003,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.50900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95099999999999996,"5min":0.95299999999999996,"15min":1.0589999999999999},"last":0.89800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575066,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1622016,"data_stored":858869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.56100000000000005,"5min":0.46200000000000002,"15min":0.39400000000000002},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.52200000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.079,"5min":1.123,"15min":1.123},"last":0.89000000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69999999999999996,"15min":0.71899999999999997},"min":{"1min":0.50700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":1.0029999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69699999999999995,"15min":0.72099999999999997},"min":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.40899999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.55200000000000005,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.94099999999999995}]},{"osd":3,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.745,"15min":0.752},"min":{"1min":0.55800000000000005,"5min":0.50600000000000001,"15min":0.49299999999999999},"max":{"1min":1.0609999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.308},"max":{"1min":0.82799999999999996,"5min":0.90600000000000003,"15min":0.94299999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.61199999999999999,"15min":0.59599999999999997},"min":{"1min":0.436,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.91800000000000004,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63500000000000001,"15min":0.60399999999999998},"min":{"1min":0.44800000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91000000000000003,"5min":1.036,"15min":1.036},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67400000000000004,"15min":0.65300000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.34799999999999998},"max":{"1min":0.93899999999999995,"5min":1,"15min":1},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jul 6 21:59:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68300000000000005,"15min":0.65500000000000003},"min":{"1min":0.53000000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69299999999999995,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.442,"15min":0.41599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.98399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575067,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1638400,"data_stored":860503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.42999999999999999,"15min":0.45000000000000001},"min":{"1min":0.27500000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65600000000000003,"5min":0.78700000000000003,"15min":1.0489999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.53700000000000003},"min":{"1min":0.39700000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76000000000000001,"5min":2.77,"15min":2.77},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.24299999999999999},"max":{"1min":0.747,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56499999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.97799999999999998,"5min":1.351,"15min":1.351},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68799999999999994,"5min":0.86499999999999999,"15min":0.90100000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":1.24},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.746,"15min":0.76700000000000002},"min":{"1min":0.52700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.069,"5min":1.1930000000000001,"15min":1.3009999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.75,"15min":0.78200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.024,"5min":1.383,"15min":1.383},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56799999999999995,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.052,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.79000000000000004},"min":{"1min":0.54300000000000004,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.05,"5min":1.327,"15min":1.3999999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.79600000000000004},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96599999999999997,"5min":1.3140000000000001,"15min":1.425},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79400000000000004,"15min":0.80900000000000005},"min":{"1min":0.52700000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.085,"5min":3.1739999999999999,"15min":3.1739999999999999},"last":0.626}]},{"osd":7,"last update":"Thu Jul 6 21:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77900000000000003,"15min":0.81100000000000005},"min":{"1min":0.58199999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.034,"5min":3.097,"15min":3.097},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77400000000000002,"15min":0.80600000000000005},"min":{"1min":0.47099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.107,"5min":1.1140000000000001,"15min":1.3480000000000001},"last":0.53100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575067,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36728,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335112,"statfs":{"total":96636764160,"available":96599154688,"internally_reserved":0,"allocated":1622016,"data_stored":858869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.317,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.67400000000000004,"5min":0.81699999999999995,"15min":0.85999999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.47999999999999998,"15min":0.502},"min":{"1min":0.30599999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.82199999999999995,"5min":0.84399999999999997,"15min":0.85999999999999999},"last":0.432}]},{"osd":1,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.378,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79300000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.42299999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67200000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.50900000000000001},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.40100000000000002,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.85599999999999998,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.52900000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1379999999999999,"5min":1.1930000000000001,"15min":1.2430000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.52100000000000002,"5min":0.47499999999999998,"15min":0.41399999999999998},"max":{"1min":1.403,"5min":1.591,"15min":1.591},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.79400000000000004},"min":{"1min":0.58499999999999996,"5min":0.51100000000000001,"15min":0.42899999999999999},"max":{"1min":1.1910000000000001,"5min":1.333,"15min":1.333},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77600000000000002,"15min":0.81200000000000006},"min":{"1min":0.56799999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0169999999999999,"5min":1.327,"15min":1.327},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.81100000000000005,"15min":0.82099999999999995},"min":{"1min":0.58199999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5329999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.79800000000000004,"15min":0.81799999999999995},"min":{"1min":0.60899999999999999,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.4950000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jul 6 21:59:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.80800000000000005,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.83699999999999997},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0880000000000001,"5min":1.573,"15min":1.573},"last":0.75600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575068,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58880,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312960,"statfs":{"total":96636764160,"available":96576471040,"internally_reserved":0,"allocated":1630208,"data_stored":858993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.42999999999999999,"15min":0.443},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.626,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48399999999999999,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.69099999999999995,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.433}]},{"osd":2,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69599999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.315},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.71399999999999997,"5min":0.79800000000000004,"15min":0.87},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.432,"5min":0.371,"15min":0.371},"max":{"1min":0.68000000000000005,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.54600000000000004},"min":{"1min":0.39200000000000002,"5min":0.36699999999999999,"15min":0.32000000000000001},"max":{"1min":0.749,"5min":0.83099999999999996,"15min":0.91200000000000003},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.74399999999999999,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.47599999999999998,"15min":0.38500000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.3140000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.76500000000000001,"15min":0.78700000000000003},"min":{"1min":0.66500000000000004,"5min":0.53700000000000003,"15min":0.44},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.626,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.55100000000000005,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.357},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.68200000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.878,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.71499999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.456},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jul 6 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.59099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.417},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.78600000000000003,"15min":0.81899999999999995},"min":{"1min":0.71699999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.88100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575067,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37324,"kb_used_data":2180,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334516,"statfs":{"total":96636764160,"available":96598544384,"internally_reserved":0,"allocated":2232320,"data_stored":1449894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.436},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":0.624,"5min":0.73599999999999999,"15min":0.86399999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.755,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.497},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.70699999999999996,"5min":0.81100000000000005,"15min":0.82399999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.53400000000000003},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68999999999999995,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.62}]},{"osd":3,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.49299999999999999,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76600000000000001,"5min":1.151,"15min":1.151},"last":0.502},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53500000000000003,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.874},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.72899999999999998,"15min":0.78200000000000003},"min":{"1min":0.52700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.8180000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73399999999999999,"15min":0.78100000000000003},"min":{"1min":0.54200000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.9550000000000001}]},{"osd":5,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.754,"15min":0.79500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72199999999999998,"15min":0.78100000000000003},"min":{"1min":0.57199999999999995,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.776}]},{"osd":6,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75900000000000001,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.851},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.746,"15min":0.78600000000000003},"min":{"1min":0.58499999999999996,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.9390000000000001}]},{"osd":7,"last update":"Thu Jul 6 21:59:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76400000000000001,"15min":0.80600000000000005},"min":{"1min":0.56799999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.9099999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.78200000000000003,"15min":0.81399999999999995},"min":{"1min":0.60099999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.8859999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:00:28.563 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T22:00:28.563 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-06T22:00:28.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b8834640 1 Processor -- start 2023-07-06T22:00:28.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b8834640 1 -- start start 2023-07-06T22:00:28.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b8834640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f60b415b990 0x7f60b406dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:28.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b8834640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60b415fd80 0x7f60b406c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:28.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b8834640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b406e2d0 con 0x7f60b415bd60 2023-07-06T22:00:28.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b8834640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b406bb00 con 0x7f60b415b990 2023-07-06T22:00:28.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b8834640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b40c9510 con 0x7f60b415fd80 2023-07-06T22:00:28.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60abfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f60b415bd60 0x7f60b415f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48152/0 (socket says 172.21.15.55:48152) 2023-07-06T22:00:28.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60abfff640 1 -- 172.21.15.55:0/3282828106 learned_addr learned my addr 172.21.15.55:0/3282828106 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:28.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b2d9d640 1 --2- 172.21.15.55:0/3282828106 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60b415fd80 0x7f60b406c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:28.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b259c640 1 --2- 172.21.15.55:0/3282828106 >> v2:172.21.15.138:3300/0 conn(0x7f60b415b990 0x7f60b406dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:28.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b1d9b640 1 -- 172.21.15.55:0/3282828106 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019627637 0 0) 0x7f60b406e2d0 con 0x7f60b415bd60 2023-07-06T22:00:28.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b1d9b640 1 -- 172.21.15.55:0/3282828106 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a0003530 con 0x7f60b415bd60 2023-07-06T22:00:28.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b2d9d640 1 -- 172.21.15.55:0/3282828106 >> v2:172.21.15.138:3300/0 conn(0x7f60b415b990 msgr2=0x7f60b406dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:28.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b2d9d640 1 --2- 172.21.15.55:0/3282828106 >> v2:172.21.15.138:3300/0 conn(0x7f60b415b990 0x7f60b406dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b2d9d640 1 -- 172.21.15.55:0/3282828106 >> v1:172.21.15.55:6789/0 conn(0x7f60b415bd60 legacy=0x7f60b415f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:28.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b1d9b640 1 -- 172.21.15.55:0/3282828106 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 697578599 0 0) 0x7f60a0003530 con 0x7f60b415bd60 2023-07-06T22:00:28.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b2d9d640 1 -- 172.21.15.55:0/3282828106 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b40c8f50 con 0x7f60b415fd80 2023-07-06T22:00:28.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.753+0000 7f60b259c640 1 --2- 172.21.15.55:0/3282828106 >> v2:172.21.15.138:3300/0 conn(0x7f60b415b990 0x7f60b406dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:00:28.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.757+0000 7f60b2d9d640 1 --2- 172.21.15.55:0/3282828106 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60b415fd80 0x7f60b406c2c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009d90 tx=0x7f60ac01c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=291e3ab75ac94b5f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:28.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.757+0000 7f60b1d9b640 1 -- 172.21.15.55:0/3282828106 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c001680 con 0x7f60b415fd80 2023-07-06T22:00:28.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.757+0000 7f60b1d9b640 1 -- 172.21.15.55:0/3282828106 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac0a55b0 con 0x7f60b415fd80 2023-07-06T22:00:28.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.757+0000 7f60b1d9b640 1 -- 172.21.15.55:0/3282828106 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0a5940 con 0x7f60b415fd80 2023-07-06T22:00:28.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.757+0000 7f60b8834640 1 -- 172.21.15.55:0/3282828106 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60b415fd80 msgr2=0x7f60b406c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:28.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.757+0000 7f60b8834640 1 --2- 172.21.15.55:0/3282828106 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60b415fd80 0x7f60b406c2c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009d90 tx=0x7f60ac01c7b0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.757+0000 7f60b8834640 1 -- 172.21.15.55:0/3282828106 shutdown_connections 2023-07-06T22:00:28.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.757+0000 7f60b8834640 1 --2- 172.21.15.55:0/3282828106 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60b415fd80 0x7f60b406c2c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.757+0000 7f60b8834640 1 --2- 172.21.15.55:0/3282828106 >> v2:172.21.15.138:3300/0 conn(0x7f60b415b990 0x7f60b406dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.757+0000 7f60b8834640 1 -- 172.21.15.55:0/3282828106 >> 172.21.15.55:0/3282828106 conn(0x7f60b40cf3c0 msgr2=0x7f60b40cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:28.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.757+0000 7f60b8834640 1 -- 172.21.15.55:0/3282828106 shutdown_connections 2023-07-06T22:00:28.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.757+0000 7f60b8834640 1 -- 172.21.15.55:0/3282828106 wait complete. 2023-07-06T22:00:28.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b8834640 1 Processor -- start 2023-07-06T22:00:28.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b8834640 1 -- start start 2023-07-06T22:00:28.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b8834640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60b415b990 0x7f60b40acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:28.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b8834640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60b415bd60 0x7f60b4153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:28.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b8834640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60b415fd80 0x7f60b40b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:28.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b8834640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4153400 con 0x7f60b415fd80 2023-07-06T22:00:28.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b8834640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4152d80 con 0x7f60b415b990 2023-07-06T22:00:28.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b8834640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b40b41d0 con 0x7f60b415bd60 2023-07-06T22:00:28.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60b415fd80 0x7f60b40b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:28.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60b415fd80 0x7f60b40b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58586/0 (socket says 172.21.15.55:58586) 2023-07-06T22:00:28.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b2d9d640 1 -- 172.21.15.55:0/2302541019 learned_addr learned my addr 172.21.15.55:0/2302541019 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b2d9d640 1 -- 172.21.15.55:0/2302541019 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60b415bd60 msgr2=0x7f60b4153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b2d9d640 1 --2- 172.21.15.55:0/2302541019 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60b415bd60 0x7f60b4153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b259c640 1 --2- 172.21.15.55:0/2302541019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60b415b990 0x7f60b40acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b2d9d640 1 -- 172.21.15.55:0/2302541019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60b415b990 msgr2=0x7f60b40acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b2d9d640 1 --2- 172.21.15.55:0/2302541019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60b415b990 0x7f60b40acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b2d9d640 1 -- 172.21.15.55:0/2302541019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a4009420 con 0x7f60b415fd80 2023-07-06T22:00:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b259c640 1 --2- 172.21.15.55:0/2302541019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60b415b990 0x7f60b40acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b2d9d640 1 --2- 172.21.15.55:0/2302541019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60b415fd80 0x7f60b40b3680 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0b0040 tx=0x7f60ac019550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:28.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60aaffd640 1 -- 172.21.15.55:0/2302541019 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0b9650 con 0x7f60b415fd80 2023-07-06T22:00:28.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60aaffd640 1 -- 172.21.15.55:0/2302541019 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac0b97b0 con 0x7f60b415fd80 2023-07-06T22:00:28.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b8834640 1 -- 172.21.15.55:0/2302541019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ac009a70 con 0x7f60b415fd80 2023-07-06T22:00:28.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60aaffd640 1 -- 172.21.15.55:0/2302541019 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0b9b60 con 0x7f60b415fd80 2023-07-06T22:00:28.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.761+0000 7f60b8834640 1 -- 172.21.15.55:0/2302541019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b40b44b0 con 0x7f60b415fd80 2023-07-06T22:00:28.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.765+0000 7f60b8834640 1 -- 172.21.15.55:0/2302541019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b4153540 con 0x7f60b415fd80 2023-07-06T22:00:28.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.765+0000 7f60aaffd640 1 -- 172.21.15.55:0/2302541019 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f60ac0b9cc0 con 0x7f60b415fd80 2023-07-06T22:00:28.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.765+0000 7f60aaffd640 1 --2- 172.21.15.55:0/2302541019 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f60940663a0 0x7f6094068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:28.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.765+0000 7f60aaffd640 1 -- 172.21.15.55:0/2302541019 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f60ac11f1f0 con 0x7f60b415fd80 2023-07-06T22:00:28.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.765+0000 7f60b259c640 1 --2- 172.21.15.55:0/2302541019 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f60940663a0 0x7f6094068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:28.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.765+0000 7f60b259c640 1 --2- 172.21.15.55:0/2302541019 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f60940663a0 0x7f6094068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009c70 tx=0x7f60a4008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:28.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.769+0000 7f60aaffd640 1 -- 172.21.15.55:0/2302541019 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60b4153540 con 0x7f60b415fd80 2023-07-06T22:00:28.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.977+0000 7f60b8834640 1 -- 172.21.15.55:0/2302541019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f60b4153540 con 0x7f60b415fd80 2023-07-06T22:00:28.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.985+0000 7f60aaffd640 1 -- 172.21.15.55:0/2302541019 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f60b4153540 con 0x7f60b415fd80 2023-07-06T22:00:28.984 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-07-06T22:00:28.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.985+0000 7f60b8834640 1 -- 172.21.15.55:0/2302541019 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f60940663a0 msgr2=0x7f6094068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:28.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.985+0000 7f60b8834640 1 --2- 172.21.15.55:0/2302541019 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f60940663a0 0x7f6094068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009c70 tx=0x7f60a4008040 comp rx=0 tx=0).stop 2023-07-06T22:00:28.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.985+0000 7f60b8834640 1 -- 172.21.15.55:0/2302541019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60b415fd80 msgr2=0x7f60b40b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:28.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.985+0000 7f60b8834640 1 --2- 172.21.15.55:0/2302541019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60b415fd80 0x7f60b40b3680 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0b0040 tx=0x7f60ac019550 comp rx=0 tx=0).stop 2023-07-06T22:00:28.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.985+0000 7f60b8834640 1 -- 172.21.15.55:0/2302541019 shutdown_connections 2023-07-06T22:00:28.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.985+0000 7f60b8834640 1 --2- 172.21.15.55:0/2302541019 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f60940663a0 0x7f6094068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.985+0000 7f60b8834640 1 --2- 172.21.15.55:0/2302541019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60b415fd80 0x7f60b40b3680 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.985+0000 7f60b8834640 1 --2- 172.21.15.55:0/2302541019 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60b415bd60 0x7f60b4153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.985+0000 7f60b8834640 1 --2- 172.21.15.55:0/2302541019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60b415b990 0x7f60b40acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:28.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.985+0000 7f60b8834640 1 -- 172.21.15.55:0/2302541019 >> 172.21.15.55:0/2302541019 conn(0x7f60b40cf3c0 msgr2=0x7f60b40cc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:28.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.985+0000 7f60b8834640 1 -- 172.21.15.55:0/2302541019 shutdown_connections 2023-07-06T22:00:28.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:28.985+0000 7f60b8834640 1 -- 172.21.15.55:0/2302541019 wait complete. 2023-07-06T22:00:29.006 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:00:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.149+0000 7fa3715fa640 1 Processor -- start 2023-07-06T22:00:29.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.149+0000 7fa3715fa640 1 -- start start 2023-07-06T22:00:29.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.149+0000 7fa3715fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36c1587d0 0x7fa36c070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.149+0000 7fa3715fa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa36c0710c0 0x7fa36c0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.149+0000 7fa3715fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36c06fae0 con 0x7fa36c158400 2023-07-06T22:00:29.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.149+0000 7fa3715fa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36c06fdc0 con 0x7fa36c0710c0 2023-07-06T22:00:29.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.149+0000 7fa3715fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c0700a0 con 0x7fa36c1587d0 2023-07-06T22:00:29.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.149+0000 7fa363fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36c1587d0 0x7fa36c070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.149+0000 7fa36b7fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa36c0710c0 0x7fa36c0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.149+0000 7fa363fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36c1587d0 0x7fa36c070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:55412/0 (socket says 172.21.15.55:55412) 2023-07-06T22:00:29.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.149+0000 7fa363fff640 1 -- 172.21.15.55:0/1973250334 learned_addr learned my addr 172.21.15.55:0/1973250334 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:29.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.149+0000 7fa36affd640 1 --1- 172.21.15.55:0/1973250334 >> v1:172.21.15.138:6789/0 conn(0x7fa36c158400 0x7fa36c0c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:43414/0 (socket says 172.21.15.55:43414) 2023-07-06T22:00:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.153+0000 7fa363fff640 1 -- 172.21.15.55:0/1973250334 >> v2:172.21.15.138:3300/0 conn(0x7fa36c0710c0 msgr2=0x7fa36c0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.153+0000 7fa363fff640 1 --2- 172.21.15.55:0/1973250334 >> v2:172.21.15.138:3300/0 conn(0x7fa36c0710c0 0x7fa36c0cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.153+0000 7fa363fff640 1 -- 172.21.15.55:0/1973250334 >> v1:172.21.15.138:6789/0 conn(0x7fa36c158400 legacy=0x7fa36c0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.153+0000 7fa363fff640 1 -- 172.21.15.55:0/1973250334 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c070380 con 0x7fa36c1587d0 2023-07-06T22:00:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.153+0000 7fa363fff640 1 --2- 172.21.15.55:0/1973250334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36c1587d0 0x7fa36c070b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa35400bb10 tx=0x7fa35401ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=406321e8d7030f59 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:29.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.153+0000 7fa36a7fc640 1 -- 172.21.15.55:0/1973250334 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3540a7bc0 con 0x7fa36c1587d0 2023-07-06T22:00:29.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.153+0000 7fa36a7fc640 1 -- 172.21.15.55:0/1973250334 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3540a7d20 con 0x7fa36c1587d0 2023-07-06T22:00:29.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.153+0000 7fa36a7fc640 1 -- 172.21.15.55:0/1973250334 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3540af660 con 0x7fa36c1587d0 2023-07-06T22:00:29.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 -- 172.21.15.55:0/1973250334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36c1587d0 msgr2=0x7fa36c070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 --2- 172.21.15.55:0/1973250334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36c1587d0 0x7fa36c070b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa35400bb10 tx=0x7fa35401ebe0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 -- 172.21.15.55:0/1973250334 shutdown_connections 2023-07-06T22:00:29.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 --2- 172.21.15.55:0/1973250334 >> v2:172.21.15.138:3300/0 conn(0x7fa36c0710c0 0x7fa36c0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 --2- 172.21.15.55:0/1973250334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36c1587d0 0x7fa36c070b80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 -- 172.21.15.55:0/1973250334 >> 172.21.15.55:0/1973250334 conn(0x7fa36c0cded0 msgr2=0x7fa36c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:29.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 -- 172.21.15.55:0/1973250334 shutdown_connections 2023-07-06T22:00:29.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 -- 172.21.15.55:0/1973250334 wait complete. 2023-07-06T22:00:29.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 Processor -- start 2023-07-06T22:00:29.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 -- start start 2023-07-06T22:00:29.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36c0710c0 0x7fa36c14c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa36c158400 0x7fa36c0b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa36c1587d0 0x7fa36c140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c14c730 con 0x7fa36c158400 2023-07-06T22:00:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c0b2430 con 0x7fa36c1587d0 2023-07-06T22:00:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa3715fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c0b2710 con 0x7fa36c0710c0 2023-07-06T22:00:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa363fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa36c158400 0x7fa36c0b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa363fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa36c158400 0x7fa36c0b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58600/0 (socket says 172.21.15.55:58600) 2023-07-06T22:00:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa363fff640 1 -- 172.21.15.55:0/1804203745 learned_addr learned my addr 172.21.15.55:0/1804203745 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa36b7fe640 1 --2- 172.21.15.55:0/1804203745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa36c1587d0 0x7fa36c140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa36affd640 1 --2- 172.21.15.55:0/1804203745 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36c0710c0 0x7fa36c14c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa363fff640 1 -- 172.21.15.55:0/1804203745 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36c0710c0 msgr2=0x7fa36c14c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa363fff640 1 --2- 172.21.15.55:0/1804203745 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36c0710c0 0x7fa36c14c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa363fff640 1 -- 172.21.15.55:0/1804203745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa36c1587d0 msgr2=0x7fa36c140150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa363fff640 1 --2- 172.21.15.55:0/1804203745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa36c1587d0 0x7fa36c140150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa363fff640 1 -- 172.21.15.55:0/1804203745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35400b770 con 0x7fa36c158400 2023-07-06T22:00:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.157+0000 7fa363fff640 1 --2- 172.21.15.55:0/1804203745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa36c158400 0x7fa36c0b1d30 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fa35400b2c0 tx=0x7fa35401b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.161+0000 7fa3637fe640 1 -- 172.21.15.55:0/1804203745 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3540afd70 con 0x7fa36c158400 2023-07-06T22:00:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.161+0000 7fa3637fe640 1 -- 172.21.15.55:0/1804203745 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3540a7e90 con 0x7fa36c158400 2023-07-06T22:00:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.161+0000 7fa3637fe640 1 -- 172.21.15.55:0/1804203745 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3540ba650 con 0x7fa36c158400 2023-07-06T22:00:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.161+0000 7fa3715fa640 1 -- 172.21.15.55:0/1804203745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36c0b29f0 con 0x7fa36c158400 2023-07-06T22:00:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.161+0000 7fa3715fa640 1 -- 172.21.15.55:0/1804203745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36c0b2cd0 con 0x7fa36c158400 2023-07-06T22:00:29.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.161+0000 7fa3715fa640 1 -- 172.21.15.55:0/1804203745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36c06c580 con 0x7fa36c158400 2023-07-06T22:00:29.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.161+0000 7fa3637fe640 1 -- 172.21.15.55:0/1804203745 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa3540c3450 con 0x7fa36c158400 2023-07-06T22:00:29.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.161+0000 7fa3637fe640 1 --2- 172.21.15.55:0/1804203745 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fa34c0663a0 0x7fa34c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.161+0000 7fa3637fe640 1 -- 172.21.15.55:0/1804203745 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa35411e6e0 con 0x7fa36c158400 2023-07-06T22:00:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.161+0000 7fa36affd640 1 --2- 172.21.15.55:0/1804203745 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fa34c0663a0 0x7fa34c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.165+0000 7fa36affd640 1 --2- 172.21.15.55:0/1804203745 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fa34c0663a0 0x7fa34c068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa35c000f70 tx=0x7fa35c007c90 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:29.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.165+0000 7fa3637fe640 1 -- 172.21.15.55:0/1804203745 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3540eb980 con 0x7fa36c158400 2023-07-06T22:00:29.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.353+0000 7fa3715fa640 1 -- 172.21.15.55:0/1804203745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa36c066d60 con 0x7fa36c158400 2023-07-06T22:00:29.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.353+0000 7fa3637fe640 1 -- 172.21.15.55:0/1804203745 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fa3540eefa0 con 0x7fa36c158400 2023-07-06T22:00:29.355 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:29.355 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/567276052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":567276052},{"type":"v1","addr":"172.21.15.138:6834","nonce":567276052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2227115466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2227115466},{"type":"v1","addr":"172.21.15.138:6835","nonce":2227115466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2611738616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2611738616},{"type":"v1","addr":"172.21.15.55:6836","nonce":2611738616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:00:19.496559+0000","modified":"2023-07-06T22:00:22.517164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8622":{"gid":8622,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1836658324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1836658324},{"type":"v1","addr":"172.21.15.55:6837","nonce":1836658324}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-06T22:00:29.355 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 54 2023-07-06T22:00:29.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.357+0000 7fa3715fa640 1 -- 172.21.15.55:0/1804203745 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fa34c0663a0 msgr2=0x7fa34c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.357+0000 7fa3715fa640 1 --2- 172.21.15.55:0/1804203745 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fa34c0663a0 0x7fa34c068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa35c000f70 tx=0x7fa35c007c90 comp rx=0 tx=0).stop 2023-07-06T22:00:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.357+0000 7fa3715fa640 1 -- 172.21.15.55:0/1804203745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa36c158400 msgr2=0x7fa36c0b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.357+0000 7fa3715fa640 1 --2- 172.21.15.55:0/1804203745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa36c158400 0x7fa36c0b1d30 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fa35400b2c0 tx=0x7fa35401b980 comp rx=0 tx=0).stop 2023-07-06T22:00:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.357+0000 7fa3715fa640 1 -- 172.21.15.55:0/1804203745 shutdown_connections 2023-07-06T22:00:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.357+0000 7fa3715fa640 1 --2- 172.21.15.55:0/1804203745 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fa34c0663a0 0x7fa34c068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.357+0000 7fa3715fa640 1 --2- 172.21.15.55:0/1804203745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa36c1587d0 0x7fa36c140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.357+0000 7fa3715fa640 1 --2- 172.21.15.55:0/1804203745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa36c158400 0x7fa36c0b1d30 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.357+0000 7fa3715fa640 1 --2- 172.21.15.55:0/1804203745 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa36c0710c0 0x7fa36c14c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.357+0000 7fa3715fa640 1 -- 172.21.15.55:0/1804203745 >> 172.21.15.55:0/1804203745 conn(0x7fa36c0cded0 msgr2=0x7fa36c157400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.357+0000 7fa3715fa640 1 -- 172.21.15.55:0/1804203745 shutdown_connections 2023-07-06T22:00:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.357+0000 7fa3715fa640 1 -- 172.21.15.55:0/1804203745 wait complete. 2023-07-06T22:00:29.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T22:00:19.496559+0000', 'modified': '2023-07-06T22:00:22.517164+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8622}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8622': {'gid': 8622, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6837/1836658324', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6835', 'nonce': 1836658324}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 1836658324}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T22:00:29.778 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T22:00:29.778 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-06T22:00:29.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.925+0000 7feecd86d640 1 Processor -- start 2023-07-06T22:00:29.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.925+0000 7feecd86d640 1 -- start start 2023-07-06T22:00:29.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feecd86d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feec806f0e0 0x7feec80ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feecd86d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feec80cb7a0 0x7feec80cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feecd86d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec815f5d0 con 0x7feec8156180 2023-07-06T22:00:29.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feecd86d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec8160250 con 0x7feec80cb7a0 2023-07-06T22:00:29.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feecd86d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec815f8b0 con 0x7feec806f0e0 2023-07-06T22:00:29.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feec6ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feec8156180 0x7feec806e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48156/0 (socket says 172.21.15.55:48156) 2023-07-06T22:00:29.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feec6ffd640 1 -- 172.21.15.55:0/2148353763 learned_addr learned my addr 172.21.15.55:0/2148353763 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:29.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feec77fe640 1 --2- 172.21.15.55:0/2148353763 >> v2:172.21.15.55:3300/0 conn(0x7feec80cb7a0 0x7feec80cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feebffff640 1 --2- 172.21.15.55:0/2148353763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feec806f0e0 0x7feec80ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feec67fc640 1 -- 172.21.15.55:0/2148353763 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368058841 0 0) 0x7feec815f5d0 con 0x7feec8156180 2023-07-06T22:00:29.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feec67fc640 1 -- 172.21.15.55:0/2148353763 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb4003530 con 0x7feec8156180 2023-07-06T22:00:29.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feec77fe640 1 -- 172.21.15.55:0/2148353763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feec806f0e0 msgr2=0x7feec80ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:29.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feec77fe640 1 --2- 172.21.15.55:0/2148353763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feec806f0e0 0x7feec80ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feec77fe640 1 -- 172.21.15.55:0/2148353763 >> v1:172.21.15.55:6789/0 conn(0x7feec8156180 legacy=0x7feec806e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feec77fe640 1 -- 172.21.15.55:0/2148353763 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec815fb90 con 0x7feec80cb7a0 2023-07-06T22:00:29.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.929+0000 7feec77fe640 1 --2- 172.21.15.55:0/2148353763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80cb7a0 0x7feec80cbbe0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7feec0009d90 tx=0x7feec001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e33ab2e6b894bc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:29.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feec67fc640 1 -- 172.21.15.55:0/2148353763 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00a5970 con 0x7feec80cb7a0 2023-07-06T22:00:29.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feec67fc640 1 -- 172.21.15.55:0/2148353763 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec00a5ad0 con 0x7feec80cb7a0 2023-07-06T22:00:29.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feec67fc640 1 -- 172.21.15.55:0/2148353763 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00a5e60 con 0x7feec80cb7a0 2023-07-06T22:00:29.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 -- 172.21.15.55:0/2148353763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80cb7a0 msgr2=0x7feec80cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 --2- 172.21.15.55:0/2148353763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80cb7a0 0x7feec80cbbe0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7feec0009d90 tx=0x7feec001c890 comp rx=0 tx=0).stop 2023-07-06T22:00:29.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 -- 172.21.15.55:0/2148353763 shutdown_connections 2023-07-06T22:00:29.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 --2- 172.21.15.55:0/2148353763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feec806f0e0 0x7feec80ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 --2- 172.21.15.55:0/2148353763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80cb7a0 0x7feec80cbbe0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 -- 172.21.15.55:0/2148353763 >> 172.21.15.55:0/2148353763 conn(0x7feec80d0c50 msgr2=0x7feec80cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:29.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 -- 172.21.15.55:0/2148353763 shutdown_connections 2023-07-06T22:00:29.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 -- 172.21.15.55:0/2148353763 wait complete. 2023-07-06T22:00:29.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 Processor -- start 2023-07-06T22:00:29.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 -- start start 2023-07-06T22:00:29.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feec806f0e0 0x7feec8154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80cb7a0 0x7feec81f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feec8156180 0x7feec81f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec80b4ed0 con 0x7feec80cb7a0 2023-07-06T22:00:29.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec81f5300 con 0x7feec806f0e0 2023-07-06T22:00:29.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feecd86d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec81f4bd0 con 0x7feec8156180 2023-07-06T22:00:29.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.933+0000 7feebffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80cb7a0 0x7feec81f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feebffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80cb7a0 0x7feec81f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58628/0 (socket says 172.21.15.55:58628) 2023-07-06T22:00:29.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feebffff640 1 -- 172.21.15.55:0/4276262281 learned_addr learned my addr 172.21.15.55:0/4276262281 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:29.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feec6ffd640 1 --2- 172.21.15.55:0/4276262281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feec806f0e0 0x7feec8154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feec77fe640 1 --2- 172.21.15.55:0/4276262281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feec8156180 0x7feec81f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feebffff640 1 -- 172.21.15.55:0/4276262281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feec8156180 msgr2=0x7feec81f4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feebffff640 1 --2- 172.21.15.55:0/4276262281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feec8156180 0x7feec81f4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feebffff640 1 -- 172.21.15.55:0/4276262281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feec806f0e0 msgr2=0x7feec8154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feebffff640 1 --2- 172.21.15.55:0/4276262281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feec806f0e0 0x7feec8154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feebffff640 1 -- 172.21.15.55:0/4276262281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0009a70 con 0x7feec80cb7a0 2023-07-06T22:00:29.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feebffff640 1 --2- 172.21.15.55:0/4276262281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80cb7a0 0x7feec81f3e50 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7feeb000e900 tx=0x7feeb000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:29.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feec4ff9640 1 -- 172.21.15.55:0/4276262281 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0009690 con 0x7feec80cb7a0 2023-07-06T22:00:29.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feec4ff9640 1 -- 172.21.15.55:0/4276262281 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb000ca00 con 0x7feec80cb7a0 2023-07-06T22:00:29.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feec4ff9640 1 -- 172.21.15.55:0/4276262281 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000cdb0 con 0x7feec80cb7a0 2023-07-06T22:00:29.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feecd86d640 1 -- 172.21.15.55:0/4276262281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec81f4eb0 con 0x7feec80cb7a0 2023-07-06T22:00:29.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feecd86d640 1 -- 172.21.15.55:0/4276262281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec81f5830 con 0x7feec80cb7a0 2023-07-06T22:00:29.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.937+0000 7feec4ff9640 1 -- 172.21.15.55:0/4276262281 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feeb0013470 con 0x7feec80cb7a0 2023-07-06T22:00:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feec4ff9640 1 --2- 172.21.15.55:0/4276262281 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7feea80663a0 0x7feea8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 Processor -- start 2023-07-06T22:00:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feec4ff9640 1 -- 172.21.15.55:0/4276262281 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7feeb0084220 con 0x7feec80cb7a0 2023-07-06T22:00:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 -- start start 2023-07-06T22:00:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feec6ffd640 1 --2- 172.21.15.55:0/4276262281 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7feea80663a0 0x7feea8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feec6ffd640 1 --2- 172.21.15.55:0/4276262281 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7feea80663a0 0x7feea8068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feeb80011f0 tx=0x7feeb8009040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb171e740 0x561cb171eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb171f050 0x561cb16d4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb16d4d80 0x561cb16d5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cb159cac0 con 0x561cb171f050 2023-07-06T22:00:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cb14d6840 con 0x561cb171e740 2023-07-06T22:00:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x561cb152a2e0 con 0x561cb16d4d80 2023-07-06T22:00:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feebffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb171f050 0x561cb16d4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feebffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb171f050 0x561cb16d4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58634/0 (socket says 172.21.15.55:58634) 2023-07-06T22:00:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feebffff640 1 -- 172.21.15.55:0/2784846423 learned_addr learned my addr 172.21.15.55:0/2784846423 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feebffff640 1 -- 172.21.15.55:0/2784846423 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb16d4d80 msgr2=0x561cb16d5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feebffff640 1 --2- 172.21.15.55:0/2784846423 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb16d4d80 0x561cb16d5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feebffff640 1 -- 172.21.15.55:0/2784846423 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb171e740 msgr2=0x561cb171eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:29.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feebffff640 1 --2- 172.21.15.55:0/2784846423 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb171e740 0x561cb171eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feebffff640 1 -- 172.21.15.55:0/2784846423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cb121f890 con 0x561cb171f050 2023-07-06T22:00:29.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feebffff640 1 --2- 172.21.15.55:0/2784846423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb171f050 0x561cb16d4840 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7feeb005ce90 tx=0x7feeb0059030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4be64f24d08ff server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:29.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feebd7fa640 1 -- 172.21.15.55:0/2784846423 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0082400 con 0x561cb171f050 2023-07-06T22:00:29.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feebd7fa640 1 -- 172.21.15.55:0/2784846423 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb0082580 con 0x561cb171f050 2023-07-06T22:00:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feebd7fa640 1 -- 172.21.15.55:0/2784846423 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0050e60 con 0x561cb171f050 2023-07-06T22:00:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 -- 172.21.15.55:0/2784846423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb171f050 msgr2=0x561cb16d4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 --2- 172.21.15.55:0/2784846423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb171f050 0x561cb16d4840 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7feeb005ce90 tx=0x7feeb0059030 comp rx=0 tx=0).stop 2023-07-06T22:00:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 -- 172.21.15.55:0/2784846423 shutdown_connections 2023-07-06T22:00:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 --2- 172.21.15.55:0/2784846423 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb16d4d80 0x561cb16d5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 --2- 172.21.15.55:0/2784846423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb171f050 0x561cb16d4840 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 --2- 172.21.15.55:0/2784846423 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb171e740 0x561cb171eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 -- 172.21.15.55:0/2784846423 >> 172.21.15.55:0/2784846423 conn(0x561cb16cc800 msgr2=0x561cb16db800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 -- 172.21.15.55:0/2784846423 shutdown_connections 2023-07-06T22:00:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.941+0000 7feed0bba000 1 -- 172.21.15.55:0/2784846423 wait complete. 2023-07-06T22:00:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 1 -- start start 2023-07-06T22:00:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 1 Processor -- start 2023-07-06T22:00:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb16d4d80 0x561cb16da6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb171e740 0x561cb16e00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb171f050 0x561cb16e0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cb1523380 con 0x561cb171e740 2023-07-06T22:00:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cb14dfae0 con 0x561cb16d4d80 2023-07-06T22:00:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x561cb14df780 con 0x561cb171f050 2023-07-06T22:00:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 10 client.0 _ll_register_callbacks cb 0x561cb16c0e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T22:00:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feebffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb171e740 0x561cb16e00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feebffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb171e740 0x561cb16e00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58636/0 (socket says 172.21.15.55:58636) 2023-07-06T22:00:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feebffff640 1 -- 172.21.15.55:0/961610590 learned_addr learned my addr 172.21.15.55:0/961610590 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:29.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feebffff640 1 -- 172.21.15.55:0/961610590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb171f050 msgr2=0x561cb16e0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:29.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feebffff640 1 --2- 172.21.15.55:0/961610590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb171f050 0x561cb16e0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feebffff640 1 -- 172.21.15.55:0/961610590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb16d4d80 msgr2=0x561cb16da6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:29.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feebffff640 1 --2- 172.21.15.55:0/961610590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb16d4d80 0x561cb16da6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feebffff640 1 -- 172.21.15.55:0/961610590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec81f5830 con 0x561cb171e740 2023-07-06T22:00:29.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feebffff640 1 --2- 172.21.15.55:0/961610590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb171e740 0x561cb16e00e0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7feeb000f010 tx=0x7feeb0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b8973e9cc40ede server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:29.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feea67fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T22:00:29.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feea67fc640 1 -- 172.21.15.55:0/961610590 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0050e60 con 0x561cb171e740 2023-07-06T22:00:29.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 1 -- 172.21.15.55:0/961610590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561cb14eaa20 con 0x561cb171e740 2023-07-06T22:00:29.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feea67fc640 1 -- 172.21.15.55:0/961610590 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7feeb0050fc0 con 0x561cb171e740 2023-07-06T22:00:29.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feea67fc640 1 -- 172.21.15.55:0/961610590 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7feeb0051180 con 0x561cb171e740 2023-07-06T22:00:29.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 10 client.8799 fetch_fsmap learned FSMap version 54 2023-07-06T22:00:29.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 1 -- 172.21.15.55:0/961610590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x561cb14e7d10 con 0x561cb171e740 2023-07-06T22:00:29.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feea67fc640 1 -- 172.21.15.55:0/961610590 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561cb14eaa20 con 0x561cb171e740 2023-07-06T22:00:29.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feea67fc640 1 -- 172.21.15.55:0/961610590 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 54) v1 ==== 3114+0+0 (secure 0 0 0) 0x7feeb0011070 con 0x561cb171e740 2023-07-06T22:00:29.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 10 client.8799 fetch_fsmap finished waiting for FSMap version 54 2023-07-06T22:00:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 10 client.8799 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T22:00:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 20 client.8799 populate_metadata read hostname 'smithi055' 2023-07-06T22:00:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 1 --2- 172.21.15.55:0/961610590 >> [v2:172.21.15.55:6835/1836658324,v1:172.21.15.55:6837/1836658324] conn(0x561cb172d7b0 0x561cb172fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 4 client.8799 mds_command: new command op to 8622 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T22:00:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feed0bba000 1 -- 172.21.15.55:0/961610590 --> [v2:172.21.15.55:6835/1836658324,v1:172.21.15.55:6837/1836658324] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561cb1552710 con 0x561cb172d7b0 2023-07-06T22:00:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.945+0000 7feec6ffd640 1 --2- 172.21.15.55:0/961610590 >> [v2:172.21.15.55:6835/1836658324,v1:172.21.15.55:6837/1836658324] conn(0x561cb172d7b0 0x561cb172fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feec6ffd640 1 --2- 172.21.15.55:0/961610590 >> [v2:172.21.15.55:6835/1836658324,v1:172.21.15.55:6837/1836658324] conn(0x561cb172d7b0 0x561cb172fb90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe054582a01bf791 server_cookie=c2f180cd6ebb7ab5 in_seq=0 out_seq=0 2023-07-06T22:00:29.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feea67fc640 10 client.8799 ms_handle_connect on v2:172.21.15.55:6835/1836658324 2023-07-06T22:00:29.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feea67fc640 1 -- 172.21.15.55:0/961610590 <== mds.0 v2:172.21.15.55:6835/1836658324 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561cb1552710 con 0x561cb172d7b0 2023-07-06T22:00:29.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feea67fc640 10 client.8799 handle_command_reply: tid=0 2023-07-06T22:00:29.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feed0bba000 1 client.8799 shutdown 2023-07-06T22:00:29.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feed0bba000 1 -- 172.21.15.55:0/961610590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb171e740 msgr2=0x561cb16e00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feed0bba000 1 --2- 172.21.15.55:0/961610590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb171e740 0x561cb16e00e0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7feeb000f010 tx=0x7feeb0021000 comp rx=0 tx=0).stop 2023-07-06T22:00:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feed0bba000 1 -- 172.21.15.55:0/961610590 shutdown_connections 2023-07-06T22:00:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feed0bba000 1 --2- 172.21.15.55:0/961610590 >> [v2:172.21.15.55:6835/1836658324,v1:172.21.15.55:6837/1836658324] conn(0x561cb172d7b0 0x561cb172fb90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feed0bba000 1 --2- 172.21.15.55:0/961610590 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb171f050 0x561cb16e0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feed0bba000 1 --2- 172.21.15.55:0/961610590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb171e740 0x561cb16e00e0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feed0bba000 1 --2- 172.21.15.55:0/961610590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb16d4d80 0x561cb16da6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feea67fc640 0 client.8799 ms_handle_reset on v2:172.21.15.55:6835/1836658324 2023-07-06T22:00:29.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feed0bba000 1 -- 172.21.15.55:0/961610590 >> 172.21.15.55:0/961610590 conn(0x561cb16cc800 msgr2=0x561cb16d3830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:29.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feed0bba000 1 -- 172.21.15.55:0/961610590 shutdown_connections 2023-07-06T22:00:29.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feed0bba000 1 -- 172.21.15.55:0/961610590 wait complete. 2023-07-06T22:00:29.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.949+0000 7feed0bba000 20 client.8799 trim_cache size 0 max 16384 2023-07-06T22:00:29.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feed0bba000 1 Processor -- start 2023-07-06T22:00:29.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feed0bba000 1 -- start start 2023-07-06T22:00:29.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feed0bba000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb16d4d80 0x561cb1731b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feed0bba000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb171e740 0x561cb172db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feed0bba000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb171f050 0x561cb172e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feed0bba000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cb11e0940 con 0x561cb16d4d80 2023-07-06T22:00:29.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feed0bba000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cb1520780 con 0x561cb171f050 2023-07-06T22:00:29.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feed0bba000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x561cb151ecf0 con 0x561cb171e740 2023-07-06T22:00:29.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feec6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb16d4d80 0x561cb1731b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feec6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb16d4d80 0x561cb1731b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58642/0 (socket says 172.21.15.55:58642) 2023-07-06T22:00:29.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feec6ffd640 1 -- 172.21.15.55:0/369142471 learned_addr learned my addr 172.21.15.55:0/369142471 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:29.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feebffff640 1 --2- 172.21.15.55:0/369142471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb171e740 0x561cb172db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feec6ffd640 1 -- 172.21.15.55:0/369142471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb171e740 msgr2=0x561cb172db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:29.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feec6ffd640 1 --2- 172.21.15.55:0/369142471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb171e740 0x561cb172db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feec6ffd640 1 -- 172.21.15.55:0/369142471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb171f050 msgr2=0x561cb172e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:29.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feec6ffd640 1 --2- 172.21.15.55:0/369142471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb171f050 0x561cb172e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feec6ffd640 1 -- 172.21.15.55:0/369142471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cb16d7450 con 0x561cb16d4d80 2023-07-06T22:00:29.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feec6ffd640 1 --2- 172.21.15.55:0/369142471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb16d4d80 0x561cb1731b00 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7feeb8007040 tx=0x7feeb8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8265141d6ab0d29 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:29.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feebdffb640 1 -- 172.21.15.55:0/369142471 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb80213c0 con 0x561cb16d4d80 2023-07-06T22:00:29.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feebdffb640 1 -- 172.21.15.55:0/369142471 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb8021520 con 0x561cb16d4d80 2023-07-06T22:00:29.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feebdffb640 1 -- 172.21.15.55:0/369142471 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8021b90 con 0x561cb16d4d80 2023-07-06T22:00:29.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feed0bba000 1 -- 172.21.15.55:0/369142471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb16d4d80 msgr2=0x561cb1731b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.965+0000 7feed0bba000 1 --2- 172.21.15.55:0/369142471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb16d4d80 0x561cb1731b00 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7feeb8007040 tx=0x7feeb8000ee0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 -- 172.21.15.55:0/369142471 shutdown_connections 2023-07-06T22:00:29.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 --2- 172.21.15.55:0/369142471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb171f050 0x561cb172e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 --2- 172.21.15.55:0/369142471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb171e740 0x561cb172db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 --2- 172.21.15.55:0/369142471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb16d4d80 0x561cb1731b00 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 -- 172.21.15.55:0/369142471 >> 172.21.15.55:0/369142471 conn(0x561cb16cc800 msgr2=0x561cb16d3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:29.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 -- 172.21.15.55:0/369142471 shutdown_connections 2023-07-06T22:00:29.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 -- 172.21.15.55:0/369142471 wait complete. 2023-07-06T22:00:29.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 -- start start 2023-07-06T22:00:29.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 Processor -- start 2023-07-06T22:00:29.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb16d4d80 0x561cb1731240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb171e740 0x561cb1738ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb171f050 0x561cb1739530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cb16d9710 con 0x561cb16d4d80 2023-07-06T22:00:29.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cb16dba30 con 0x561cb171f050 2023-07-06T22:00:29.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x561cb14c2930 con 0x561cb171e740 2023-07-06T22:00:29.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 10 client.0 _ll_register_callbacks cb 0x561cb14e77f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T22:00:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feec6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb16d4d80 0x561cb1731240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feec6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb16d4d80 0x561cb1731240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58656/0 (socket says 172.21.15.55:58656) 2023-07-06T22:00:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feec6ffd640 1 -- 172.21.15.55:0/3350499065 learned_addr learned my addr 172.21.15.55:0/3350499065 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feec6ffd640 1 -- 172.21.15.55:0/3350499065 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb171e740 msgr2=0x561cb1738ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feec6ffd640 1 --2- 172.21.15.55:0/3350499065 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb171e740 0x561cb1738ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feec6ffd640 1 -- 172.21.15.55:0/3350499065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb171f050 msgr2=0x561cb1739530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feec6ffd640 1 --2- 172.21.15.55:0/3350499065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb171f050 0x561cb1739530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feec6ffd640 1 -- 172.21.15.55:0/3350499065 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb800f040 con 0x561cb16d4d80 2023-07-06T22:00:29.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feec6ffd640 1 --2- 172.21.15.55:0/3350499065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb16d4d80 0x561cb1731240 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7feeb8007040 tx=0x7feeb0057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83815af934f40969 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:29.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feea67fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T22:00:29.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feea67fc640 1 -- 172.21.15.55:0/3350499065 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb80047f0 con 0x561cb16d4d80 2023-07-06T22:00:29.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feea67fc640 1 -- 172.21.15.55:0/3350499065 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7feeb8035d90 con 0x561cb16d4d80 2023-07-06T22:00:29.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 -- 172.21.15.55:0/3350499065 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561cb16d86e0 con 0x561cb16d4d80 2023-07-06T22:00:29.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feea67fc640 1 -- 172.21.15.55:0/3350499065 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7feeb8004950 con 0x561cb16d4d80 2023-07-06T22:00:29.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 10 client.8805 fetch_fsmap learned FSMap version 54 2023-07-06T22:00:29.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 -- 172.21.15.55:0/3350499065 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x561cb14cdfa0 con 0x561cb16d4d80 2023-07-06T22:00:29.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feea67fc640 1 -- 172.21.15.55:0/3350499065 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561cb16d86e0 con 0x561cb16d4d80 2023-07-06T22:00:29.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feea67fc640 1 -- 172.21.15.55:0/3350499065 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 54) v1 ==== 3114+0+0 (secure 0 0 0) 0x7feeb8020040 con 0x561cb16d4d80 2023-07-06T22:00:29.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 10 client.8805 fetch_fsmap finished waiting for FSMap version 54 2023-07-06T22:00:29.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 10 client.8805 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T22:00:29.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 20 client.8805 populate_metadata read hostname 'smithi055' 2023-07-06T22:00:29.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 --2- 172.21.15.55:0/3350499065 >> [v2:172.21.15.55:6835/1836658324,v1:172.21.15.55:6837/1836658324] conn(0x561cb1739a70 0x561cb177c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:29.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 4 client.8805 mds_command: new command op to 8622 tid=0[{"prefix": "status"}] 2023-07-06T22:00:29.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.969+0000 7feed0bba000 1 -- 172.21.15.55:0/3350499065 --> [v2:172.21.15.55:6835/1836658324,v1:172.21.15.55:6837/1836658324] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561cb1521cd0 con 0x561cb1739a70 2023-07-06T22:00:29.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feebffff640 1 --2- 172.21.15.55:0/3350499065 >> [v2:172.21.15.55:6835/1836658324,v1:172.21.15.55:6837/1836658324] conn(0x561cb1739a70 0x561cb177c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:29.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feebffff640 1 --2- 172.21.15.55:0/3350499065 >> [v2:172.21.15.55:6835/1836658324,v1:172.21.15.55:6837/1836658324] conn(0x561cb1739a70 0x561cb177c840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7206d3ce74989d9 server_cookie=aaae2720745fad29 in_seq=0 out_seq=0 2023-07-06T22:00:29.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feea67fc640 10 client.8805 ms_handle_connect on v2:172.21.15.55:6835/1836658324 2023-07-06T22:00:29.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feea67fc640 1 -- 172.21.15.55:0/3350499065 <== mds.0 v2:172.21.15.55:6835/1836658324 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x561cb1521cd0 con 0x561cb1739a70 2023-07-06T22:00:29.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feea67fc640 10 client.8805 handle_command_reply: tid=0 2023-07-06T22:00:29.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feed0bba000 1 client.8805 shutdown 2023-07-06T22:00:29.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feed0bba000 1 -- 172.21.15.55:0/3350499065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb16d4d80 msgr2=0x561cb1731240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feed0bba000 1 --2- 172.21.15.55:0/3350499065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb16d4d80 0x561cb1731240 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7feeb8007040 tx=0x7feeb0057000 comp rx=0 tx=0).stop 2023-07-06T22:00:29.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feed0bba000 1 -- 172.21.15.55:0/3350499065 shutdown_connections 2023-07-06T22:00:29.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feed0bba000 1 --2- 172.21.15.55:0/3350499065 >> [v2:172.21.15.55:6835/1836658324,v1:172.21.15.55:6837/1836658324] conn(0x561cb1739a70 0x561cb177c840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feed0bba000 1 --2- 172.21.15.55:0/3350499065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561cb171f050 0x561cb1739530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feed0bba000 1 --2- 172.21.15.55:0/3350499065 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x561cb171e740 0x561cb1738ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feea67fc640 0 client.8805 ms_handle_reset on v2:172.21.15.55:6835/1836658324 2023-07-06T22:00:29.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feed0bba000 1 --2- 172.21.15.55:0/3350499065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561cb16d4d80 0x561cb1731240 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feed0bba000 1 -- 172.21.15.55:0/3350499065 >> 172.21.15.55:0/3350499065 conn(0x561cb16cc800 msgr2=0x561cb171d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:29.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feed0bba000 1 -- 172.21.15.55:0/3350499065 shutdown_connections 2023-07-06T22:00:29.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feed0bba000 1 -- 172.21.15.55:0/3350499065 wait complete. 2023-07-06T22:00:29.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feed0bba000 20 client.8805 trim_cache size 0 max 16384 2023-07-06T22:00:29.980 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:00:29.980 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c64f3ef1-e769-47b3-ae15-a714e4e7c4f7", 2023-07-06T22:00:29.981 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-07-06T22:00:29.981 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 8622, 2023-07-06T22:00:29.981 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-07-06T22:00:29.981 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-07-06T22:00:29.981 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-07-06T22:00:29.981 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.478064034999999, 2023-07-06T22:00:29.982 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 54, 2023-07-06T22:00:29.982 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 131, 2023-07-06T22:00:29.982 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 131, 2023-07-06T22:00:29.982 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 15.772170046999999 2023-07-06T22:00:29.982 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:00:29.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feecd86d640 1 -- 172.21.15.55:0/4276262281 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7feea80663a0 msgr2=0x7feea8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feecd86d640 1 --2- 172.21.15.55:0/4276262281 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7feea80663a0 0x7feea8068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feeb80011f0 tx=0x7feeb8009040 comp rx=0 tx=0).stop 2023-07-06T22:00:29.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feecd86d640 1 -- 172.21.15.55:0/4276262281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80cb7a0 msgr2=0x7feec81f3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:29.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feecd86d640 1 --2- 172.21.15.55:0/4276262281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80cb7a0 0x7feec81f3e50 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7feeb000e900 tx=0x7feeb000edc0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feecd86d640 1 -- 172.21.15.55:0/4276262281 shutdown_connections 2023-07-06T22:00:29.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feecd86d640 1 --2- 172.21.15.55:0/4276262281 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7feea80663a0 0x7feea8068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feecd86d640 1 --2- 172.21.15.55:0/4276262281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feec8156180 0x7feec81f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feecd86d640 1 --2- 172.21.15.55:0/4276262281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80cb7a0 0x7feec81f3e50 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feecd86d640 1 --2- 172.21.15.55:0/4276262281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feec806f0e0 0x7feec8154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:29.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feecd86d640 1 -- 172.21.15.55:0/4276262281 >> 172.21.15.55:0/4276262281 conn(0x7feec80d0c50 msgr2=0x7feec815dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:29.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feecd86d640 1 -- 172.21.15.55:0/4276262281 shutdown_connections 2023-07-06T22:00:29.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:29.973+0000 7feecd86d640 1 -- 172.21.15.55:0/4276262281 wait complete. 2023-07-06T22:00:29.992 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T22:00:30.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd68326d640 1 Processor -- start 2023-07-06T22:00:30.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd68326d640 1 -- start start 2023-07-06T22:00:30.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd68326d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd67c15b9d0 0x7fd67c15f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:30.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd68326d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd67c0ce340 0x7fd67c0ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd68326d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67c06a160 con 0x7fd67c0b3d10 2023-07-06T22:00:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd68326d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c15bda0 con 0x7fd67c15b9d0 2023-07-06T22:00:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd68326d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c069590 con 0x7fd67c0ce340 2023-07-06T22:00:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd68180a640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fd67c0b3d10 0x7fd67c15c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:43416/0 (socket says 172.21.15.55:43416) 2023-07-06T22:00:30.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd68180a640 1 -- 172.21.15.55:0/4015586419 learned_addr learned my addr 172.21.15.55:0/4015586419 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:30.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 -- 172.21.15.55:0/4015586419 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193447809 0 0) 0x7fd67c06a160 con 0x7fd67c0b3d10 2023-07-06T22:00:30.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 -- 172.21.15.55:0/4015586419 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd668003530 con 0x7fd67c0b3d10 2023-07-06T22:00:30.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 -- 172.21.15.55:0/4015586419 <== mon.1 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2201995095 0 0) 0x7fd668003530 con 0x7fd67c0b3d10 2023-07-06T22:00:30.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 -- 172.21.15.55:0/4015586419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd67c0ce340 msgr2=0x7fd67c0ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:30.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 --2- 172.21.15.55:0/4015586419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd67c0ce340 0x7fd67c0ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:30.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 -- 172.21.15.55:0/4015586419 >> v2:172.21.15.138:3300/0 conn(0x7fd67c15b9d0 msgr2=0x7fd67c15f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:30.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd681009640 1 --2- 172.21.15.55:0/4015586419 >> v2:172.21.15.138:3300/0 conn(0x7fd67c15b9d0 0x7fd67c15f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:30.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 --2- 172.21.15.55:0/4015586419 >> v2:172.21.15.138:3300/0 conn(0x7fd67c15b9d0 0x7fd67c15f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:30.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 -- 172.21.15.55:0/4015586419 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c069830 con 0x7fd67c0b3d10 2023-07-06T22:00:30.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 -- 172.21.15.55:0/4015586419 <== mon.1 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fd674001a00 con 0x7fd67c0b3d10 2023-07-06T22:00:30.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 -- 172.21.15.55:0/4015586419 >> v1:172.21.15.138:6789/0 conn(0x7fd67c0b3d10 legacy=0x7fd67c15c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:30.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 --2- 172.21.15.55:0/4015586419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd67c0ce340 0x7fd668003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:30.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 --2- 172.21.15.55:0/4015586419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd668004090 0x7fd6680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:30.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 --2- 172.21.15.55:0/4015586419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd668004d60 0x7fd6680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:30.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 -- 172.21.15.55:0/4015586419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c15bda0 con 0x7fd668004d60 2023-07-06T22:00:30.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 -- 172.21.15.55:0/4015586419 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c069590 con 0x7fd668004090 2023-07-06T22:00:30.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd673fff640 1 -- 172.21.15.55:0/4015586419 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66800bc50 con 0x7fd67c0ce340 2023-07-06T22:00:30.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd681009640 1 --2- 172.21.15.55:0/4015586419 >> v2:172.21.15.138:3300/0 conn(0x7fd67c15b9d0 0x7fd67c15f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:30.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd68180a640 1 --2- 172.21.15.55:0/4015586419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd668004d60 0x7fd6680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:30.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.137+0000 7fd681009640 1 --2- 172.21.15.55:0/4015586419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd67c0ce340 0x7fd668003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:30.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.141+0000 7fd68180a640 1 -- 172.21.15.55:0/4015586419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd67c0ce340 msgr2=0x7fd668003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:30.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.141+0000 7fd68180a640 1 --2- 172.21.15.55:0/4015586419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd67c0ce340 0x7fd668003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:30.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.141+0000 7fd68180a640 1 -- 172.21.15.55:0/4015586419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd668004090 msgr2=0x7fd6680047d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T22:00:30.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.141+0000 7fd68180a640 1 --2- 172.21.15.55:0/4015586419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd668004090 0x7fd6680047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:30.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.141+0000 7fd68180a640 1 -- 172.21.15.55:0/4015586419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd668003530 con 0x7fd668004d60 2023-07-06T22:00:30.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.141+0000 7fd68180a640 1 --2- 172.21.15.55:0/4015586419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd668004d60 0x7fd6680051d0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd6680057b0 tx=0x7fd67401d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b82d8cd08fbe7f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:30.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.141+0000 7fd673fff640 1 -- 172.21.15.55:0/4015586419 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6740ad630 con 0x7fd668004d60 2023-07-06T22:00:30.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.141+0000 7fd673fff640 1 -- 172.21.15.55:0/4015586419 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6740a8070 con 0x7fd668004d60 2023-07-06T22:00:30.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.141+0000 7fd673fff640 1 -- 172.21.15.55:0/4015586419 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6740ad9d0 con 0x7fd668004d60 2023-07-06T22:00:30.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.141+0000 7fd68326d640 1 -- 172.21.15.55:0/4015586419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd668004d60 msgr2=0x7fd6680051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:30.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.141+0000 7fd68326d640 1 --2- 172.21.15.55:0/4015586419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd668004d60 0x7fd6680051d0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd6680057b0 tx=0x7fd67401d380 comp rx=0 tx=0).stop 2023-07-06T22:00:30.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.141+0000 7fd68180a640 1 -- 172.21.15.55:0/4015586419 reap_dead start 2023-07-06T22:00:30.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.141+0000 7fd68326d640 1 -- 172.21.15.55:0/4015586419 shutdown_connections 2023-07-06T22:00:30.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.141+0000 7fd68326d640 1 -- 172.21.15.55:0/4015586419 >> 172.21.15.55:0/4015586419 conn(0x7fd67c0ced10 msgr2=0x7fd67c0cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:30.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68326d640 1 -- 172.21.15.55:0/4015586419 shutdown_connections 2023-07-06T22:00:30.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68326d640 1 -- 172.21.15.55:0/4015586419 wait complete. 2023-07-06T22:00:30.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68326d640 1 Processor -- start 2023-07-06T22:00:30.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68326d640 1 -- start start 2023-07-06T22:00:30.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68326d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd668004d60 0x7fd67c15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:30.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68326d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd67c153030 0x7fd67c15c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:30.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68326d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd67c15cc40 0x7fd67c15d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:30.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68326d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c150ea0 con 0x7fd67c15cc40 2023-07-06T22:00:30.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68326d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c151d00 con 0x7fd67c153030 2023-07-06T22:00:30.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68326d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c1510f0 con 0x7fd668004d60 2023-07-06T22:00:30.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68180a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd67c15cc40 0x7fd67c15d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:30.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68180a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd67c15cc40 0x7fd67c15d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58664/0 (socket says 172.21.15.55:58664) 2023-07-06T22:00:30.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68180a640 1 -- 172.21.15.55:0/3572722869 learned_addr learned my addr 172.21.15.55:0/3572722869 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:30.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd680808640 1 --2- 172.21.15.55:0/3572722869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd67c153030 0x7fd67c15c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:30.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd681009640 1 --2- 172.21.15.55:0/3572722869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd668004d60 0x7fd67c15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:30.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68180a640 1 -- 172.21.15.55:0/3572722869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd668004d60 msgr2=0x7fd67c15c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:30.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68180a640 1 --2- 172.21.15.55:0/3572722869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd668004d60 0x7fd67c15c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:30.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68180a640 1 -- 172.21.15.55:0/3572722869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd67c153030 msgr2=0x7fd67c15c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:30.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68180a640 1 --2- 172.21.15.55:0/3572722869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd67c153030 0x7fd67c15c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:30.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68180a640 1 -- 172.21.15.55:0/3572722869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c1513d0 con 0x7fd67c15cc40 2023-07-06T22:00:30.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.145+0000 7fd68180a640 1 --2- 172.21.15.55:0/3572722869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd67c15cc40 0x7fd67c15d0b0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fd674098d10 tx=0x7fd668005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:30.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.149+0000 7fd671ffb640 1 -- 172.21.15.55:0/3572722869 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674004d70 con 0x7fd67c15cc40 2023-07-06T22:00:30.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.149+0000 7fd671ffb640 1 -- 172.21.15.55:0/3572722869 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6740019d0 con 0x7fd67c15cc40 2023-07-06T22:00:30.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.149+0000 7fd671ffb640 1 -- 172.21.15.55:0/3572722869 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6740ad630 con 0x7fd67c15cc40 2023-07-06T22:00:30.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.149+0000 7fd68326d640 1 -- 172.21.15.55:0/3572722869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67c1516b0 con 0x7fd67c15cc40 2023-07-06T22:00:30.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.149+0000 7fd68326d640 1 -- 172.21.15.55:0/3572722869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c1f1180 con 0x7fd67c15cc40 2023-07-06T22:00:30.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.149+0000 7fd68326d640 1 -- 172.21.15.55:0/3572722869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67c066d60 con 0x7fd67c15cc40 2023-07-06T22:00:30.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.149+0000 7fd671ffb640 1 -- 172.21.15.55:0/3572722869 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd6740aa030 con 0x7fd67c15cc40 2023-07-06T22:00:30.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.149+0000 7fd671ffb640 1 --2- 172.21.15.55:0/3572722869 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fd6600663a0 0x7fd660068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:30.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.149+0000 7fd671ffb640 1 -- 172.21.15.55:0/3572722869 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd67411deb0 con 0x7fd67c15cc40 2023-07-06T22:00:30.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.149+0000 7fd681009640 1 --2- 172.21.15.55:0/3572722869 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fd6600663a0 0x7fd660068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:30.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.153+0000 7fd681009640 1 --2- 172.21.15.55:0/3572722869 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fd6600663a0 0x7fd660068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd67800aae0 tx=0x7fd678008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.153+0000 7fd671ffb640 1 -- 172.21.15.55:0/3572722869 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6740eaff0 con 0x7fd67c15cc40 2023-07-06T22:00:30.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.341+0000 7fd68326d640 1 -- 172.21.15.55:0/3572722869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd67c06ac10 con 0x7fd67c15cc40 2023-07-06T22:00:30.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.341+0000 7fd671ffb640 1 -- 172.21.15.55:0/3572722869 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd674002010 con 0x7fd67c15cc40 2023-07-06T22:00:30.343 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T22:00:30.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.345+0000 7fd68326d640 1 -- 172.21.15.55:0/3572722869 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fd6600663a0 msgr2=0x7fd660068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:30.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.345+0000 7fd68326d640 1 --2- 172.21.15.55:0/3572722869 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fd6600663a0 0x7fd660068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd67800aae0 tx=0x7fd678008040 comp rx=0 tx=0).stop 2023-07-06T22:00:30.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.345+0000 7fd68326d640 1 -- 172.21.15.55:0/3572722869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd67c15cc40 msgr2=0x7fd67c15d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:30.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.345+0000 7fd68326d640 1 --2- 172.21.15.55:0/3572722869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd67c15cc40 0x7fd67c15d0b0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fd674098d10 tx=0x7fd668005800 comp rx=0 tx=0).stop 2023-07-06T22:00:30.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.345+0000 7fd68326d640 1 -- 172.21.15.55:0/3572722869 shutdown_connections 2023-07-06T22:00:30.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.345+0000 7fd68326d640 1 --2- 172.21.15.55:0/3572722869 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fd6600663a0 0x7fd660068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:30.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.345+0000 7fd68326d640 1 --2- 172.21.15.55:0/3572722869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd67c15cc40 0x7fd67c15d0b0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:30.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.345+0000 7fd68326d640 1 --2- 172.21.15.55:0/3572722869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd67c153030 0x7fd67c15c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:30.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.345+0000 7fd68326d640 1 --2- 172.21.15.55:0/3572722869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd668004d60 0x7fd67c15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:30.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.345+0000 7fd68326d640 1 -- 172.21.15.55:0/3572722869 >> 172.21.15.55:0/3572722869 conn(0x7fd67c0ced10 msgr2=0x7fd67c15aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:30.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.345+0000 7fd68326d640 1 -- 172.21.15.55:0/3572722869 shutdown_connections 2023-07-06T22:00:30.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:30.345+0000 7fd68326d640 1 -- 172.21.15.55:0/3572722869 wait complete. 2023-07-06T22:00:30.363 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T22:00:30.364 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T22:00:30.364 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-07-06T22:00:30.364 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T22:00:30.365 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T22:00:30.365 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T22:00:30.365 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-06T22:00:30.365 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T22:00:30.366 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:00:30.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:30.366 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-07-06T22:00:30.376 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T22:00:30.376 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T22:00:30.376 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T22:00:30.376 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:00:30.377 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T22:00:30.377 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:00:30.377 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:00:30.377 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:00:30.377 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-07-06T22:00:30.377 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:00:30.377 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:00:30.377 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-07-06T22:00:30.378 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T22:00:30.378 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:00:30.378 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-07-06T22:00:30.378 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-06T22:00:30.378 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41326sec preferred_lft 41326sec 2023-07-06T22:00:30.378 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-07-06T22:00:30.378 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:00:30.379 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:00:30.379 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:00:30.379 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-07-06T22:00:30.379 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T22:00:30.379 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:84:fe:b8:21 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:00:30.379 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T22:00:30.379 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:00:30.379 INFO:teuthology.orchestra.run.smithi055.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T22:00:30.380 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-06T22:00:30.380 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T22:00:30.380 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:00:30.380 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-06T22:00:30.380 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:00:30.380 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T22:00:30.380 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T22:00:30.381 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-06T22:00:30.381 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:00:30.381 INFO:teuthology.orchestra.run.smithi055.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T22:00:30.381 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T22:00:30.381 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-06T22:00:30.381 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:00:30.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:30.382 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T22:00:30.442 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-07-06T22:00:30.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:30.445 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-07-06T22:00:30.497 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-07-06T22:00:30.497 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T22:00:30.497 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-06T22:00:30.497 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T22:00:30.497 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-06T22:00:30.497 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T22:00:30.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:30.498 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T22:00:30.498 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T22:00:30.499 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T22:00:30.499 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T22:00:30.499 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T22:00:30.500 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T22:00:30.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:30.592 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T22:00:30.601 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T22:00:30.602 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T22:00:30.602 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:00:30.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:30.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-07-06T22:00:30.664 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T22:00:30.664 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T22:00:30.715 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:00:30.716 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T22:00:30.716 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T22:00:30.767 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-06T22:00:30.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:30.767 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:00:30.858 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:00:30.858 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T22:00:30.870 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:00:30.870 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T22:00:30.870 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-07-06T22:00:30.870 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.cephfs=/ 2023-07-06T22:00:30.870 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-07-06T22:00:30.873 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T22:00:30.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:30.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T22:00:30.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:30.895 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T22:00:30.951 INFO:teuthology.orchestra.run.smithi055.stdout:client8811 2023-07-06T22:00:30.951 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:00:30.951 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:00:30.999 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-06T22:00:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.185+0000 7f7fd19a3640 1 Processor -- start 2023-07-06T22:00:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.185+0000 7f7fd19a3640 1 -- start start 2023-07-06T22:00:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.185+0000 7f7fd19a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7fcc06f0e0 0x7f7fcc0ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.185+0000 7f7fd19a3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7fcc0cb7a0 0x7f7fcc0cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.185+0000 7f7fd19a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc15f5d0 con 0x7f7fcc156180 2023-07-06T22:00:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.185+0000 7f7fd19a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc160250 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.185+0000 7f7fd19a3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc15f8b0 con 0x7f7fcc0cb7a0 2023-07-06T22:00:31.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.185+0000 7f7fcaffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7fcc156180 0x7f7fcc06e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48172/0 (socket says 172.21.15.55:48172) 2023-07-06T22:00:31.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.185+0000 7f7fcaffd640 1 -- 172.21.15.55:0/3383307809 learned_addr learned my addr 172.21.15.55:0/3383307809 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:31.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.185+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/3383307809 >> v2:172.21.15.55:3300/0 conn(0x7f7fcc06f0e0 0x7f7fcc0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:31.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.185+0000 7f7fca7fc640 1 -- 172.21.15.55:0/3383307809 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236882146 0 0) 0x7f7fcc15f5d0 con 0x7f7fcc156180 2023-07-06T22:00:31.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.185+0000 7f7fc3fff640 1 -- 172.21.15.55:0/3383307809 >> v2:172.21.15.138:3300/0 conn(0x7f7fcc0cb7a0 msgr2=0x7f7fcc0cbba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T22:00:31.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.185+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/3383307809 >> v2:172.21.15.138:3300/0 conn(0x7f7fcc0cb7a0 0x7f7fcc0cbba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.185+0000 7f7fc3fff640 1 -- 172.21.15.55:0/3383307809 >> v1:172.21.15.55:6789/0 conn(0x7f7fcc156180 legacy=0x7f7fcc06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:31.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.189+0000 7f7fc3fff640 1 -- 172.21.15.55:0/3383307809 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc15fb90 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.189+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/3383307809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fcc06f0e0 0x7f7fcc0ca610 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0af9d0 tx=0x7f7fb401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3793e448be95284 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:31.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.189+0000 7f7fca7fc640 1 -- 172.21.15.55:0/3383307809 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb40ac640 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.189+0000 7f7fca7fc640 1 -- 172.21.15.55:0/3383307809 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb40ac7a0 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.189+0000 7f7fca7fc640 1 -- 172.21.15.55:0/3383307809 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb40acb30 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.189+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3383307809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fcc06f0e0 msgr2=0x7f7fcc0ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:31.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.189+0000 7f7fd19a3640 1 --2- 172.21.15.55:0/3383307809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fcc06f0e0 0x7f7fcc0ca610 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0af9d0 tx=0x7f7fb401c3c0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.189+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3383307809 shutdown_connections 2023-07-06T22:00:31.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.189+0000 7f7fd19a3640 1 --2- 172.21.15.55:0/3383307809 >> v2:172.21.15.138:3300/0 conn(0x7f7fcc0cb7a0 0x7f7fcc0cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.189+0000 7f7fd19a3640 1 --2- 172.21.15.55:0/3383307809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fcc06f0e0 0x7f7fcc0ca610 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.189+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3383307809 >> 172.21.15.55:0/3383307809 conn(0x7f7fcc0d0c50 msgr2=0x7f7fcc0cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:31.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.189+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3383307809 shutdown_connections 2023-07-06T22:00:31.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.189+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3383307809 wait complete. 2023-07-06T22:00:31.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fd19a3640 1 Processor -- start 2023-07-06T22:00:31.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fd19a3640 1 -- start start 2023-07-06T22:00:31.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fd19a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fcc06f0e0 0x7f7fcc14ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:31.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fd19a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fcc0cb7a0 0x7f7fcc0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:31.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fd19a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fcc156180 0x7f7fcc0afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:31.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fd19a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc14a320 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fd19a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1499f0 con 0x7f7fcc156180 2023-07-06T22:00:31.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fd19a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc149cd0 con 0x7f7fcc0cb7a0 2023-07-06T22:00:31.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fcaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fcc06f0e0 0x7f7fcc14ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:31.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fcaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fcc06f0e0 0x7f7fcc14ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58688/0 (socket says 172.21.15.55:58688) 2023-07-06T22:00:31.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fcaffd640 1 -- 172.21.15.55:0/3801769996 learned_addr learned my addr 172.21.15.55:0/3801769996 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:31.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/3801769996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fcc0cb7a0 0x7f7fcc0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:31.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fcaffd640 1 -- 172.21.15.55:0/3801769996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fcc0cb7a0 msgr2=0x7f7fcc0c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:31.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fcaffd640 1 --2- 172.21.15.55:0/3801769996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fcc0cb7a0 0x7f7fcc0c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fcaffd640 1 -- 172.21.15.55:0/3801769996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fcc156180 msgr2=0x7f7fcc0afa20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T22:00:31.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fcaffd640 1 --2- 172.21.15.55:0/3801769996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fcc156180 0x7f7fcc0afa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fcaffd640 1 -- 172.21.15.55:0/3801769996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4009420 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fcaffd640 1 --2- 172.21.15.55:0/3801769996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fcc06f0e0 0x7f7fcc14ad00 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00c480 tx=0x7f7fbc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:31.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fc8ff9640 1 -- 172.21.15.55:0/3801769996 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0074e0 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.193+0000 7f7fc8ff9640 1 -- 172.21.15.55:0/3801769996 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc007660 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.197+0000 7f7fc8ff9640 1 -- 172.21.15.55:0/3801769996 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc004a30 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.197+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3801769996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fcc149fb0 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.197+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3801769996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc0c7d90 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.197+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3801769996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc0b4ec0 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.197+0000 7f7fc8ff9640 1 -- 172.21.15.55:0/3801769996 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7fbc004b90 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.197+0000 7f7fc8ff9640 1 --2- 172.21.15.55:0/3801769996 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f7fac0663a0 0x7f7fac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:31.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.197+0000 7f7fc8ff9640 1 -- 172.21.15.55:0/3801769996 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7fbc083190 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.197+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/3801769996 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f7fac0663a0 0x7f7fac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:31.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.197+0000 7f7fc3fff640 1 --2- 172.21.15.55:0/3801769996 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f7fac0663a0 0x7f7fac068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40ae000 tx=0x7f7fb4008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:31.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.201+0000 7f7fc8ff9640 1 -- 172.21.15.55:0/3801769996 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fbc053e40 con 0x7f7fcc06f0e0 2023-07-06T22:00:31.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.381+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3801769996 --> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fcc14a460 con 0x7f7fac0663a0 2023-07-06T22:00:31.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.381+0000 7f7fc8ff9640 1 -- 172.21.15.55:0/3801769996 <== mgr.8376 v2:172.21.15.55:6832/3817107512 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7fb40aca10 con 0x7f7fac0663a0 2023-07-06T22:00:31.382 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T22:00:31.382 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:00:31.382 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-07-06T22:00:31.383 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:00:31.383 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T22:00:31.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.385+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3801769996 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f7fac0663a0 msgr2=0x7f7fac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:31.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.385+0000 7f7fd19a3640 1 --2- 172.21.15.55:0/3801769996 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f7fac0663a0 0x7f7fac068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40ae000 tx=0x7f7fb4008040 comp rx=0 tx=0).stop 2023-07-06T22:00:31.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.385+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3801769996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fcc06f0e0 msgr2=0x7f7fcc14ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:31.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.385+0000 7f7fd19a3640 1 --2- 172.21.15.55:0/3801769996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fcc06f0e0 0x7f7fcc14ad00 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00c480 tx=0x7f7fbc00c940 comp rx=0 tx=0).stop 2023-07-06T22:00:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.385+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3801769996 shutdown_connections 2023-07-06T22:00:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.385+0000 7f7fd19a3640 1 --2- 172.21.15.55:0/3801769996 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f7fac0663a0 0x7f7fac068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.385+0000 7f7fd19a3640 1 --2- 172.21.15.55:0/3801769996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7fcc156180 0x7f7fcc0afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.385+0000 7f7fd19a3640 1 --2- 172.21.15.55:0/3801769996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7fcc0cb7a0 0x7f7fcc0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.385+0000 7f7fd19a3640 1 --2- 172.21.15.55:0/3801769996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7fcc06f0e0 0x7f7fcc14ad00 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.385+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3801769996 >> 172.21.15.55:0/3801769996 conn(0x7f7fcc0d0c50 msgr2=0x7f7fcc0b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.385+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3801769996 shutdown_connections 2023-07-06T22:00:31.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.385+0000 7f7fd19a3640 1 -- 172.21.15.55:0/3801769996 wait complete. 2023-07-06T22:00:31.403 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-06T22:00:31.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e3ecb640 1 Processor -- start 2023-07-06T22:00:31.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e3ecb640 1 -- start start 2023-07-06T22:00:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e3ecb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44dc0709a0 0x7f44dc0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e3ecb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44dc0cbe60 0x7f44dc0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e3ecb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44dc0cc300 con 0x7f44dc070d70 2023-07-06T22:00:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e3ecb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44dc0cc5e0 con 0x7f44dc0cbe60 2023-07-06T22:00:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e3ecb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc0cc8c0 con 0x7f44dc0709a0 2023-07-06T22:00:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e1466640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44dc0cbe60 0x7f44dc0b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e2468640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f44dc070d70 0x7f44dc15d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48180/0 (socket says 172.21.15.55:48180) 2023-07-06T22:00:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e2468640 1 -- 172.21.15.55:0/2601949082 learned_addr learned my addr 172.21.15.55:0/2601949082 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e1466640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44dc0cbe60 0x7f44dc0b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58696/0 (socket says 172.21.15.55:58696) 2023-07-06T22:00:31.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e1466640 1 -- 172.21.15.55:0/2601949082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44dc0709a0 msgr2=0x7f44dc0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:31.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e1466640 1 --2- 172.21.15.55:0/2601949082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44dc0709a0 0x7f44dc0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e1466640 1 -- 172.21.15.55:0/2601949082 >> v1:172.21.15.55:6789/0 conn(0x7f44dc070d70 legacy=0x7f44dc15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:31.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e1466640 1 -- 172.21.15.55:0/2601949082 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc0ccba0 con 0x7f44dc0cbe60 2023-07-06T22:00:31.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.549+0000 7f44e0c65640 1 -- 172.21.15.55:0/2601949082 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873365984 0 0) 0x7f44dc0cc300 con 0x7f44dc070d70 2023-07-06T22:00:31.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.553+0000 7f44e1466640 1 --2- 172.21.15.55:0/2601949082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44dc0cbe60 0x7f44dc0b0c30 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0097c0 tx=0x7f44cc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93671408db0ec858 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:31.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.553+0000 7f44e0c65640 1 -- 172.21.15.55:0/2601949082 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0ab600 con 0x7f44dc0cbe60 2023-07-06T22:00:31.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.553+0000 7f44e0c65640 1 -- 172.21.15.55:0/2601949082 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc0a7050 con 0x7f44dc0cbe60 2023-07-06T22:00:31.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.553+0000 7f44e0c65640 1 -- 172.21.15.55:0/2601949082 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0ab980 con 0x7f44dc0cbe60 2023-07-06T22:00:31.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.553+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2601949082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44dc0cbe60 msgr2=0x7f44dc0b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:31.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.553+0000 7f44e3ecb640 1 --2- 172.21.15.55:0/2601949082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44dc0cbe60 0x7f44dc0b0c30 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0097c0 tx=0x7f44cc01c480 comp rx=0 tx=0).stop 2023-07-06T22:00:31.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.553+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2601949082 shutdown_connections 2023-07-06T22:00:31.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.553+0000 7f44e3ecb640 1 --2- 172.21.15.55:0/2601949082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44dc0cbe60 0x7f44dc0b0c30 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.553+0000 7f44e3ecb640 1 --2- 172.21.15.55:0/2601949082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44dc0709a0 0x7f44dc0cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.553+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2601949082 >> 172.21.15.55:0/2601949082 conn(0x7f44dc0cea70 msgr2=0x7f44dc0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:31.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.553+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2601949082 shutdown_connections 2023-07-06T22:00:31.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.553+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2601949082 wait complete. 2023-07-06T22:00:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.553+0000 7f44e3ecb640 1 Processor -- start 2023-07-06T22:00:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e3ecb640 1 -- start start 2023-07-06T22:00:31.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e3ecb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44dc0709a0 0x7f44dc15b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:31.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e3ecb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44dc070d70 0x7f44dc1f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:31.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e3ecb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44dc0cbe60 0x7f44dc06b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:31.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e3ecb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc15cdd0 con 0x7f44dc0cbe60 2023-07-06T22:00:31.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e3ecb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc06a2a0 con 0x7f44dc070d70 2023-07-06T22:00:31.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e3ecb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc15d2c0 con 0x7f44dc0709a0 2023-07-06T22:00:31.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e2468640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44dc0cbe60 0x7f44dc06b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:31.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e2468640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44dc0cbe60 0x7f44dc06b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58698/0 (socket says 172.21.15.55:58698) 2023-07-06T22:00:31.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e2468640 1 -- 172.21.15.55:0/2470558989 learned_addr learned my addr 172.21.15.55:0/2470558989 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:31.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e1c67640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44dc0709a0 0x7f44dc15b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:31.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e2468640 1 -- 172.21.15.55:0/2470558989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44dc0709a0 msgr2=0x7f44dc15b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:31.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e1466640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44dc070d70 0x7f44dc1f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:31.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e2468640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44dc0709a0 0x7f44dc15b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e2468640 1 -- 172.21.15.55:0/2470558989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44dc070d70 msgr2=0x7f44dc1f4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e2468640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44dc070d70 0x7f44dc1f4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e2468640 1 -- 172.21.15.55:0/2470558989 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc009420 con 0x7f44dc0cbe60 2023-07-06T22:00:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e1c67640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44dc0709a0 0x7f44dc15b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e1466640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44dc070d70 0x7f44dc1f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:00:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e2468640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44dc0cbe60 0x7f44dc06b650 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f44d400c810 tx=0x7f44d400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44d27fc640 1 -- 172.21.15.55:0/2470558989 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400a640 con 0x7f44dc0cbe60 2023-07-06T22:00:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44d27fc640 1 -- 172.21.15.55:0/2470558989 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d400a7c0 con 0x7f44dc0cbe60 2023-07-06T22:00:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44d27fc640 1 -- 172.21.15.55:0/2470558989 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400ab70 con 0x7f44dc0cbe60 2023-07-06T22:00:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2470558989 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44dc15cfe0 con 0x7f44dc0cbe60 2023-07-06T22:00:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2470558989 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44dc15b850 con 0x7f44dc0cbe60 2023-07-06T22:00:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.557+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2470558989 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44dc1641f0 con 0x7f44dc0cbe60 2023-07-06T22:00:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.561+0000 7f44d27fc640 1 -- 172.21.15.55:0/2470558989 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f44d400acd0 con 0x7f44dc0cbe60 2023-07-06T22:00:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.561+0000 7f44d27fc640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f44c00663a0 0x7f44c0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.561+0000 7f44d27fc640 1 -- 172.21.15.55:0/2470558989 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f44d4083520 con 0x7f44dc0cbe60 2023-07-06T22:00:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.561+0000 7f44e1c67640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f44c00663a0 0x7f44c0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.561+0000 7f44e1c67640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f44c00663a0 0x7f44c0068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f44dc1f7db0 tx=0x7f44d8008040 comp rx=0 tx=0).ready entity=mgr.8376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:31.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.565+0000 7f44d27fc640 1 -- 172.21.15.55:0/2470558989 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44d4050740 con 0x7f44dc0cbe60 2023-07-06T22:00:31.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:31.753+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2470558989 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f44dc163f80 con 0x7f44dc0cbe60 2023-07-06T22:00:32.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.065+0000 7f44d27fc640 1 -- 172.21.15.55:0/2470558989 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f44d4050b10 con 0x7f44dc0cbe60 2023-07-06T22:00:32.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.065+0000 7f44d27fc640 1 -- 172.21.15.55:0/2470558989 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v59) v1 ==== 92+0+0 (secure 0 0 0) 0x7f44d4071700 con 0x7f44dc0cbe60 2023-07-06T22:00:32.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.069+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2470558989 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f44c00663a0 msgr2=0x7f44c0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:32.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.069+0000 7f44e3ecb640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f44c00663a0 0x7f44c0068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f44dc1f7db0 tx=0x7f44d8008040 comp rx=0 tx=0).stop 2023-07-06T22:00:32.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.069+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2470558989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44dc0cbe60 msgr2=0x7f44dc06b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:32.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.069+0000 7f44e3ecb640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44dc0cbe60 0x7f44dc06b650 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f44d400c810 tx=0x7f44d400ccd0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.069+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2470558989 shutdown_connections 2023-07-06T22:00:32.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.069+0000 7f44e3ecb640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f44c00663a0 0x7f44c0068850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.069+0000 7f44e3ecb640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44dc0cbe60 0x7f44dc06b650 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.069+0000 7f44e3ecb640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44dc070d70 0x7f44dc1f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.069+0000 7f44e3ecb640 1 --2- 172.21.15.55:0/2470558989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44dc0709a0 0x7f44dc15b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.069+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2470558989 >> 172.21.15.55:0/2470558989 conn(0x7f44dc0cea70 msgr2=0x7f44dc0c83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:32.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.069+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2470558989 shutdown_connections 2023-07-06T22:00:32.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.069+0000 7f44e3ecb640 1 -- 172.21.15.55:0/2470558989 wait complete. 2023-07-06T22:00:32.090 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-06T22:00:32.235 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:32.236+0000 7fa3a4a2c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:00:32.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.241+0000 7f20b8007640 1 Processor -- start 2023-07-06T22:00:32.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.241+0000 7f20b8007640 1 -- start start 2023-07-06T22:00:32.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.241+0000 7f20b8007640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f20b00b3870 0x7f20b00b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:32.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.241+0000 7f20b8007640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20b00d03c0 0x7f20b00d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:32.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.241+0000 7f20b8007640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b00b4210 con 0x7f20b015b850 2023-07-06T22:00:32.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.241+0000 7f20b8007640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b00b2b80 con 0x7f20b00d03c0 2023-07-06T22:00:32.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.241+0000 7f20b8007640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b00cff30 con 0x7f20b00b3870 2023-07-06T22:00:32.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.241+0000 7f20b65a4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20b00d03c0 0x7f20b00d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:32.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.241+0000 7f20b65a4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20b00d03c0 0x7f20b00d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58722/0 (socket says 172.21.15.55:58722) 2023-07-06T22:00:32.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.241+0000 7f20b65a4640 1 -- 172.21.15.55:0/3075991110 learned_addr learned my addr 172.21.15.55:0/3075991110 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:32.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.241+0000 7f20b55a2640 1 --2- 172.21.15.55:0/3075991110 >> v2:172.21.15.138:3300/0 conn(0x7f20b00b3870 0x7f20b00b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:32.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.245+0000 7f20b65a4640 1 -- 172.21.15.55:0/3075991110 >> v2:172.21.15.138:3300/0 conn(0x7f20b00b3870 msgr2=0x7f20b00b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:32.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.245+0000 7f20b65a4640 1 --2- 172.21.15.55:0/3075991110 >> v2:172.21.15.138:3300/0 conn(0x7f20b00b3870 0x7f20b00b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.245+0000 7f20b65a4640 1 -- 172.21.15.55:0/3075991110 >> v1:172.21.15.138:6789/0 conn(0x7f20b015b850 legacy=0x7f20b00cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:32.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.245+0000 7f20b65a4640 1 -- 172.21.15.55:0/3075991110 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b00b22e0 con 0x7f20b00d03c0 2023-07-06T22:00:32.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.245+0000 7f20b65a4640 1 --2- 172.21.15.55:0/3075991110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b00d03c0 0x7f20b00d07c0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f20b00cebd0 tx=0x7f20a801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bd62691e1d9708 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:32.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.245+0000 7f20b4da1640 1 -- 172.21.15.55:0/3075991110 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a80a5740 con 0x7f20b00d03c0 2023-07-06T22:00:32.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.245+0000 7f20b4da1640 1 -- 172.21.15.55:0/3075991110 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a80a58a0 con 0x7f20b00d03c0 2023-07-06T22:00:32.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.245+0000 7f20b4da1640 1 -- 172.21.15.55:0/3075991110 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a80a5c30 con 0x7f20b00d03c0 2023-07-06T22:00:32.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 -- 172.21.15.55:0/3075991110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b00d03c0 msgr2=0x7f20b00d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:32.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 --2- 172.21.15.55:0/3075991110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b00d03c0 0x7f20b00d07c0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f20b00cebd0 tx=0x7f20a801c880 comp rx=0 tx=0).stop 2023-07-06T22:00:32.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 -- 172.21.15.55:0/3075991110 shutdown_connections 2023-07-06T22:00:32.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 --2- 172.21.15.55:0/3075991110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b00d03c0 0x7f20b00d07c0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 --2- 172.21.15.55:0/3075991110 >> v2:172.21.15.138:3300/0 conn(0x7f20b00b3870 0x7f20b00b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 -- 172.21.15.55:0/3075991110 >> 172.21.15.55:0/3075991110 conn(0x7f20b00cec20 msgr2=0x7f20b00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:32.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 -- 172.21.15.55:0/3075991110 shutdown_connections 2023-07-06T22:00:32.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 -- 172.21.15.55:0/3075991110 wait complete. 2023-07-06T22:00:32.251 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f2dfa262180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:00:32.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 Processor -- start 2023-07-06T22:00:32.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 -- start start 2023-07-06T22:00:32.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20b00b3870 0x7f20b01532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:32.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b00d03c0 0x7f20b015a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:32.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20b015b850 0x7f20b0069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:32.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00c8840 con 0x7f20b00d03c0 2023-07-06T22:00:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0159510 con 0x7f20b015b850 2023-07-06T22:00:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b8007640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0159760 con 0x7f20b00b3870 2023-07-06T22:00:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b55a2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b00d03c0 0x7f20b015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b55a2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b00d03c0 0x7f20b015a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58728/0 (socket says 172.21.15.55:58728) 2023-07-06T22:00:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b55a2640 1 -- 172.21.15.55:0/969311074 learned_addr learned my addr 172.21.15.55:0/969311074 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b55a2640 1 -- 172.21.15.55:0/969311074 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20b00b3870 msgr2=0x7f20b01532b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T22:00:32.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b55a2640 1 --2- 172.21.15.55:0/969311074 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20b00b3870 0x7f20b01532b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b55a2640 1 -- 172.21.15.55:0/969311074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20b015b850 msgr2=0x7f20b0069fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T22:00:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b55a2640 1 --2- 172.21.15.55:0/969311074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20b015b850 0x7f20b0069fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.249+0000 7f20b55a2640 1 -- 172.21.15.55:0/969311074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a8009b30 con 0x7f20b00d03c0 2023-07-06T22:00:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.253+0000 7f20b55a2640 1 --2- 172.21.15.55:0/969311074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b00d03c0 0x7f20b015a800 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f20a000e870 tx=0x7f20a000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.253+0000 7f20a67fc640 1 -- 172.21.15.55:0/969311074 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a0009510 con 0x7f20b00d03c0 2023-07-06T22:00:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.253+0000 7f20a67fc640 1 -- 172.21.15.55:0/969311074 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a000eec0 con 0x7f20b00d03c0 2023-07-06T22:00:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.253+0000 7f20a67fc640 1 -- 172.21.15.55:0/969311074 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000cb40 con 0x7f20b00d03c0 2023-07-06T22:00:32.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.253+0000 7f20b8007640 1 -- 172.21.15.55:0/969311074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b0159a40 con 0x7f20b00d03c0 2023-07-06T22:00:32.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.253+0000 7f20b8007640 1 -- 172.21.15.55:0/969311074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b015a2e0 con 0x7f20b00d03c0 2023-07-06T22:00:32.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.253+0000 7f20b8007640 1 -- 172.21.15.55:0/969311074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b0066d60 con 0x7f20b00d03c0 2023-07-06T22:00:32.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.253+0000 7f20a67fc640 1 -- 172.21.15.55:0/969311074 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f20a000cca0 con 0x7f20b00d03c0 2023-07-06T22:00:32.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.253+0000 7f20a67fc640 1 --2- 172.21.15.55:0/969311074 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f20940663f0 0x7f20940688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:32.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.253+0000 7f20a67fc640 1 -- 172.21.15.55:0/969311074 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f20a0084200 con 0x7f20b00d03c0 2023-07-06T22:00:32.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.253+0000 7f20b5da3640 1 -- 172.21.15.55:0/969311074 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f20940663f0 msgr2=0x7f20940688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3817107512 2023-07-06T22:00:32.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.253+0000 7f20b5da3640 1 --2- 172.21.15.55:0/969311074 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f20940663f0 0x7f20940688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:00:32.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.257+0000 7f20a67fc640 1 -- 172.21.15.55:0/969311074 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f20a0051390 con 0x7f20b00d03c0 2023-07-06T22:00:32.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.417+0000 7f20b8007640 1 -- 172.21.15.55:0/969311074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f20b00b3420 con 0x7f20b00d03c0 2023-07-06T22:00:32.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.421+0000 7f20a67fc640 1 -- 172.21.15.55:0/969311074 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v41)=0 v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7f20a00549b0 con 0x7f20b00d03c0 2023-07-06T22:00:32.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.425+0000 7f20b8007640 1 -- 172.21.15.55:0/969311074 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f20940663f0 msgr2=0x7f20940688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:00:32.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.425+0000 7f20b8007640 1 --2- 172.21.15.55:0/969311074 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f20940663f0 0x7f20940688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.425+0000 7f20b8007640 1 -- 172.21.15.55:0/969311074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b00d03c0 msgr2=0x7f20b015a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:32.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.425+0000 7f20b8007640 1 --2- 172.21.15.55:0/969311074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b00d03c0 0x7f20b015a800 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f20a000e870 tx=0x7f20a000ec70 comp rx=0 tx=0).stop 2023-07-06T22:00:32.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.425+0000 7f20b8007640 1 -- 172.21.15.55:0/969311074 shutdown_connections 2023-07-06T22:00:32.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.425+0000 7f20b8007640 1 --2- 172.21.15.55:0/969311074 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f20940663f0 0x7f20940688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.425+0000 7f20b8007640 1 --2- 172.21.15.55:0/969311074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20b015b850 0x7f20b0069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.425+0000 7f20b8007640 1 --2- 172.21.15.55:0/969311074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b00d03c0 0x7f20b015a800 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.425+0000 7f20b8007640 1 --2- 172.21.15.55:0/969311074 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20b00b3870 0x7f20b01532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.425+0000 7f20b8007640 1 -- 172.21.15.55:0/969311074 >> 172.21.15.55:0/969311074 conn(0x7f20b00cec20 msgr2=0x7f20b01579d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:32.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.425+0000 7f20b8007640 1 -- 172.21.15.55:0/969311074 shutdown_connections 2023-07-06T22:00:32.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.425+0000 7f20b8007640 1 -- 172.21.15.55:0/969311074 wait complete. 2023-07-06T22:00:32.444 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-06T22:00:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.589+0000 7f01e07fa640 1 Processor -- start 2023-07-06T22:00:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.589+0000 7f01e07fa640 1 -- start start 2023-07-06T22:00:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.589+0000 7f01e07fa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f01d815b850 0x7f01d80cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01e07fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01d80ccd30 0x7f01d80b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01e07fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d80b4210 con 0x7f01d80b3db0 2023-07-06T22:00:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01e07fa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d80b2b80 con 0x7f01d815b850 2023-07-06T22:00:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01e07fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80cff30 con 0x7f01d80ccd30 2023-07-06T22:00:32.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01ddd95640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01d80ccd30 0x7f01d80b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:32.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01ddd95640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01d80ccd30 0x7f01d80b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:55576/0 (socket says 172.21.15.55:55576) 2023-07-06T22:00:32.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01ddd95640 1 -- 172.21.15.55:0/1596410740 learned_addr learned my addr 172.21.15.55:0/1596410740 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:32.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01ded97640 1 --1- 172.21.15.55:0/1596410740 >> v1:172.21.15.138:6789/0 conn(0x7f01d80b3db0 0x7f01d815f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:43430/0 (socket says 172.21.15.55:43430) 2023-07-06T22:00:32.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01de596640 1 --2- 172.21.15.55:0/1596410740 >> v2:172.21.15.138:3300/0 conn(0x7f01d815b850 0x7f01d80cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:32.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01ddd95640 1 -- 172.21.15.55:0/1596410740 >> v2:172.21.15.138:3300/0 conn(0x7f01d815b850 msgr2=0x7f01d80cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:32.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01ddd95640 1 --2- 172.21.15.55:0/1596410740 >> v2:172.21.15.138:3300/0 conn(0x7f01d815b850 0x7f01d80cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01dd594640 1 -- 172.21.15.55:0/1596410740 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037968332 0 0) 0x7f01d80b4210 con 0x7f01d80b3db0 2023-07-06T22:00:32.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01ddd95640 1 -- 172.21.15.55:0/1596410740 >> v1:172.21.15.138:6789/0 conn(0x7f01d80b3db0 legacy=0x7f01d815f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:32.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01ddd95640 1 -- 172.21.15.55:0/1596410740 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d80b22e0 con 0x7f01d80ccd30 2023-07-06T22:00:32.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.593+0000 7f01ddd95640 1 --2- 172.21.15.55:0/1596410740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01d80ccd30 0x7f01d80b3870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009870 tx=0x7f01c801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d352c5aff1199e21 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.597+0000 7f01dd594640 1 -- 172.21.15.55:0/1596410740 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80ab5f0 con 0x7f01d80ccd30 2023-07-06T22:00:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.597+0000 7f01dd594640 1 -- 172.21.15.55:0/1596410740 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c80ab750 con 0x7f01d80ccd30 2023-07-06T22:00:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.597+0000 7f01dd594640 1 -- 172.21.15.55:0/1596410740 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80abae0 con 0x7f01d80ccd30 2023-07-06T22:00:32.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.597+0000 7f01e07fa640 1 -- 172.21.15.55:0/1596410740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01d80ccd30 msgr2=0x7f01d80b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:32.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.597+0000 7f01e07fa640 1 --2- 172.21.15.55:0/1596410740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01d80ccd30 0x7f01d80b3870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009870 tx=0x7f01c801c3f0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.597+0000 7f01e07fa640 1 -- 172.21.15.55:0/1596410740 shutdown_connections 2023-07-06T22:00:32.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.597+0000 7f01e07fa640 1 --2- 172.21.15.55:0/1596410740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01d80ccd30 0x7f01d80b3870 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.597+0000 7f01e07fa640 1 --2- 172.21.15.55:0/1596410740 >> v2:172.21.15.138:3300/0 conn(0x7f01d815b850 0x7f01d80cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.597+0000 7f01e07fa640 1 -- 172.21.15.55:0/1596410740 >> 172.21.15.55:0/1596410740 conn(0x7f01d80cec20 msgr2=0x7f01d80cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:32.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.597+0000 7f01e07fa640 1 -- 172.21.15.55:0/1596410740 shutdown_connections 2023-07-06T22:00:32.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.597+0000 7f01e07fa640 1 -- 172.21.15.55:0/1596410740 wait complete. 2023-07-06T22:00:32.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.597+0000 7f01e07fa640 1 Processor -- start 2023-07-06T22:00:32.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.597+0000 7f01e07fa640 1 -- start start 2023-07-06T22:00:32.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01e07fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01d80b3db0 0x7f01d80c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:32.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01e07fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d80ccd30 0x7f01d8155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:32.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01e07fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01d815b850 0x7f01d8155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:32.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01e07fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80cbb90 con 0x7f01d80ccd30 2023-07-06T22:00:32.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01e07fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80caf80 con 0x7f01d815b850 2023-07-06T22:00:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01e07fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80cb260 con 0x7f01d80b3db0 2023-07-06T22:00:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01ddd95640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d80ccd30 0x7f01d8155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01de596640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01d80b3db0 0x7f01d80c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01ddd95640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d80ccd30 0x7f01d8155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58736/0 (socket says 172.21.15.55:58736) 2023-07-06T22:00:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01ddd95640 1 -- 172.21.15.55:0/2719091038 learned_addr learned my addr 172.21.15.55:0/2719091038 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01ded97640 1 --2- 172.21.15.55:0/2719091038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01d815b850 0x7f01d8155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01ddd95640 1 -- 172.21.15.55:0/2719091038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01d80b3db0 msgr2=0x7f01d80c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01ddd95640 1 --2- 172.21.15.55:0/2719091038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01d80b3db0 0x7f01d80c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01ddd95640 1 -- 172.21.15.55:0/2719091038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01d815b850 msgr2=0x7f01d8155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01ddd95640 1 --2- 172.21.15.55:0/2719091038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01d815b850 0x7f01d8155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01ddd95640 1 -- 172.21.15.55:0/2719091038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c80094d0 con 0x7f01d80ccd30 2023-07-06T22:00:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01ded97640 1 --2- 172.21.15.55:0/2719091038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01d815b850 0x7f01d8155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01ddd95640 1 --2- 172.21.15.55:0/2719091038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d80ccd30 0x7f01d8155660 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f01c80ad040 tx=0x7f01c801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01ceffd640 1 -- 172.21.15.55:0/2719091038 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80be5f0 con 0x7f01d80ccd30 2023-07-06T22:00:32.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01ceffd640 1 -- 172.21.15.55:0/2719091038 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c80be770 con 0x7f01d80ccd30 2023-07-06T22:00:32.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01ceffd640 1 -- 172.21.15.55:0/2719091038 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80beb20 con 0x7f01d80ccd30 2023-07-06T22:00:32.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01e07fa640 1 -- 172.21.15.55:0/2719091038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d815bda0 con 0x7f01d80ccd30 2023-07-06T22:00:32.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01e07fa640 1 -- 172.21.15.55:0/2719091038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d80cb820 con 0x7f01d80ccd30 2023-07-06T22:00:32.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.601+0000 7f01e07fa640 1 -- 172.21.15.55:0/2719091038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d8066d60 con 0x7f01d80ccd30 2023-07-06T22:00:32.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.605+0000 7f01ceffd640 1 -- 172.21.15.55:0/2719091038 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f01c80b43f0 con 0x7f01d80ccd30 2023-07-06T22:00:32.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.605+0000 7f01ceffd640 1 --2- 172.21.15.55:0/2719091038 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f01bc0663f0 0x7f01bc0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:32.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.605+0000 7f01de596640 1 -- 172.21.15.55:0/2719091038 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f01bc0663f0 msgr2=0x7f01bc0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3817107512 2023-07-06T22:00:32.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.605+0000 7f01ceffd640 1 -- 172.21.15.55:0/2719091038 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f01c80a8050 con 0x7f01d80ccd30 2023-07-06T22:00:32.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.605+0000 7f01de596640 1 --2- 172.21.15.55:0/2719091038 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f01bc0663f0 0x7f01bc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:00:32.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.609+0000 7f01ceffd640 1 -- 172.21.15.55:0/2719091038 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01c80ec030 con 0x7f01d80ccd30 2023-07-06T22:00:32.651 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:32.652+0000 7fa3a4a2c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:00:32.695 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:32.693+0000 7f2dfa262180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:00:32.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.765+0000 7f01e07fa640 1 -- 172.21.15.55:0/2719091038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f01d80b3420 con 0x7f01d80ccd30 2023-07-06T22:00:32.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.773+0000 7f01ceffd640 1 -- 172.21.15.55:0/2719091038 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v42)=0 v42) v1 ==== 133+0+0 (secure 0 0 0) 0x7f01c80f3e60 con 0x7f01d80ccd30 2023-07-06T22:00:32.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.773+0000 7f01e07fa640 1 -- 172.21.15.55:0/2719091038 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f01bc0663f0 msgr2=0x7f01bc0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:00:32.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.773+0000 7f01e07fa640 1 --2- 172.21.15.55:0/2719091038 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f01bc0663f0 0x7f01bc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.773+0000 7f01e07fa640 1 -- 172.21.15.55:0/2719091038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d80ccd30 msgr2=0x7f01d8155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:32.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.773+0000 7f01e07fa640 1 --2- 172.21.15.55:0/2719091038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d80ccd30 0x7f01d8155660 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f01c80ad040 tx=0x7f01c801ac30 comp rx=0 tx=0).stop 2023-07-06T22:00:32.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.773+0000 7f01e07fa640 1 -- 172.21.15.55:0/2719091038 shutdown_connections 2023-07-06T22:00:32.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.773+0000 7f01e07fa640 1 --2- 172.21.15.55:0/2719091038 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7f01bc0663f0 0x7f01bc0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.773+0000 7f01e07fa640 1 --2- 172.21.15.55:0/2719091038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01d815b850 0x7f01d8155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.773+0000 7f01e07fa640 1 --2- 172.21.15.55:0/2719091038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d80ccd30 0x7f01d8155660 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.773+0000 7f01e07fa640 1 --2- 172.21.15.55:0/2719091038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01d80b3db0 0x7f01d80c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:32.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.773+0000 7f01e07fa640 1 -- 172.21.15.55:0/2719091038 >> 172.21.15.55:0/2719091038 conn(0x7f01d80cec20 msgr2=0x7f01d80b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:32.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.773+0000 7f01e07fa640 1 -- 172.21.15.55:0/2719091038 shutdown_connections 2023-07-06T22:00:32.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.773+0000 7f01e07fa640 1 -- 172.21.15.55:0/2719091038 wait complete. 2023-07-06T22:00:32.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:32.795 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-06T22:00:32.802 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:32.804+0000 7fa3a4a2c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:00:32.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-06T22:00:32.856 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:32.857+0000 7f2dfa262180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:00:32.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.997+0000 7fe9fa59f640 1 Processor -- start 2023-07-06T22:00:32.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:32.997+0000 7fe9fa59f640 1 -- start start 2023-07-06T22:00:33.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.001+0000 7fe9fa59f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9f40d1d30 0x7fe9f40ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:33.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.001+0000 7fe9fa59f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f40ccd50 con 0x7fe9f40b3c90 2023-07-06T22:00:33.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.001+0000 7fe9fa59f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f4069ea0 con 0x7fe9f40b18a0 2023-07-06T22:00:33.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.001+0000 7fe9fa59f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f40cd0a0 con 0x7fe9f40d1d30 2023-07-06T22:00:33.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.001+0000 7fe9f3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe9f40b3c90 0x7fe9f40b4060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48196/0 (socket says 172.21.15.55:48196) 2023-07-06T22:00:33.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.001+0000 7fe9f3fff640 1 -- 172.21.15.55:0/3793548171 learned_addr learned my addr 172.21.15.55:0/3793548171 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:33.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.001+0000 7fe9f8b3c640 1 --2- 172.21.15.55:0/3793548171 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9f40d1d30 0x7fe9f40ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:33.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.001+0000 7fe9f2ffd640 1 -- 172.21.15.55:0/3793548171 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060519627 0 0) 0x7fe9f40ccd50 con 0x7fe9f40b3c90 2023-07-06T22:00:33.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.001+0000 7fe9f2ffd640 1 -- 172.21.15.55:0/3793548171 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9dc003530 con 0x7fe9f40b3c90 2023-07-06T22:00:33.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.001+0000 7fe9f2ffd640 1 -- 172.21.15.55:0/3793548171 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741575358 0 0) 0x7fe9f4069ea0 con 0x7fe9f40b18a0 2023-07-06T22:00:33.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.001+0000 7fe9f2ffd640 1 -- 172.21.15.55:0/3793548171 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f40ccd50 con 0x7fe9f40b18a0 2023-07-06T22:00:33.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.001+0000 7fe9f8b3c640 1 -- 172.21.15.55:0/3793548171 >> v1:172.21.15.138:6789/0 conn(0x7fe9f40b18a0 legacy=0x7fe9f40cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:33.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.001+0000 7fe9f8b3c640 1 -- 172.21.15.55:0/3793548171 >> v1:172.21.15.55:6789/0 conn(0x7fe9f40b3c90 legacy=0x7fe9f40b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:33.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.001+0000 7fe9f8b3c640 1 -- 172.21.15.55:0/3793548171 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f406a140 con 0x7fe9f40d1d30 2023-07-06T22:00:33.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.005+0000 7fe9f8b3c640 1 --2- 172.21.15.55:0/3793548171 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9f40d1d30 0x7fe9f40ce460 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009dc0 tx=0x7fe9ec01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c73afc48462921a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:33.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.005+0000 7fe9f2ffd640 1 -- 172.21.15.55:0/3793548171 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec0a5a20 con 0x7fe9f40d1d30 2023-07-06T22:00:33.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.005+0000 7fe9f2ffd640 1 -- 172.21.15.55:0/3793548171 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec0a5b80 con 0x7fe9f40d1d30 2023-07-06T22:00:33.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.005+0000 7fe9f2ffd640 1 -- 172.21.15.55:0/3793548171 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec0ad440 con 0x7fe9f40d1d30 2023-07-06T22:00:33.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.005+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3793548171 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9f40d1d30 msgr2=0x7fe9f40ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:33.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.005+0000 7fe9fa59f640 1 --2- 172.21.15.55:0/3793548171 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9f40d1d30 0x7fe9f40ce460 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009dc0 tx=0x7fe9ec01c940 comp rx=0 tx=0).stop 2023-07-06T22:00:33.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.005+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3793548171 shutdown_connections 2023-07-06T22:00:33.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.005+0000 7fe9fa59f640 1 --2- 172.21.15.55:0/3793548171 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9f40d1d30 0x7fe9f40ce460 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:33.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.005+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3793548171 >> 172.21.15.55:0/3793548171 conn(0x7fe9f406bf40 msgr2=0x7fe9f40cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:33.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.005+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3793548171 shutdown_connections 2023-07-06T22:00:33.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.005+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3793548171 wait complete. 2023-07-06T22:00:33.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.005+0000 7fe9fa59f640 1 Processor -- start 2023-07-06T22:00:33.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.005+0000 7fe9fa59f640 1 -- start start 2023-07-06T22:00:33.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9fa59f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9f40b18a0 0x7fe9f406f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:33.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9fa59f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f40b3c90 0x7fe9f406d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:33.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9fa59f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9f40d1d30 0x7fe9f40b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:33.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9fa59f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f406f8c0 con 0x7fe9f40b3c90 2023-07-06T22:00:33.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9fa59f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f41f8170 con 0x7fe9f40b18a0 2023-07-06T22:00:33.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9fa59f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f406faf0 con 0x7fe9f40d1d30 2023-07-06T22:00:33.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9f37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f40b3c90 0x7fe9f406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:33.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9f37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f40b3c90 0x7fe9f406d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58752/0 (socket says 172.21.15.55:58752) 2023-07-06T22:00:33.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9f37fe640 1 -- 172.21.15.55:0/3648951522 learned_addr learned my addr 172.21.15.55:0/3648951522 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:33.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9f3fff640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9f40b18a0 0x7fe9f406f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:33.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9f8b3c640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9f40d1d30 0x7fe9f40b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:33.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9f37fe640 1 -- 172.21.15.55:0/3648951522 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9f40d1d30 msgr2=0x7fe9f40b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:33.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9f37fe640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9f40d1d30 0x7fe9f40b5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:33.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9f37fe640 1 -- 172.21.15.55:0/3648951522 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9f40b18a0 msgr2=0x7fe9f406f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:33.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9f37fe640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9f40b18a0 0x7fe9f406f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:33.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9f37fe640 1 -- 172.21.15.55:0/3648951522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec009a70 con 0x7fe9f40b3c90 2023-07-06T22:00:33.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9f37fe640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f40b3c90 0x7fe9f406d910 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800c410 tx=0x7fe9e800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:33.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9f0ff9640 1 -- 172.21.15.55:0/3648951522 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80052d0 con 0x7fe9f40b3c90 2023-07-06T22:00:33.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9f0ff9640 1 -- 172.21.15.55:0/3648951522 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e8005450 con 0x7fe9f40b3c90 2023-07-06T22:00:33.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3648951522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f406fdd0 con 0x7fe9f40b3c90 2023-07-06T22:00:33.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9f0ff9640 1 -- 172.21.15.55:0/3648951522 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8003840 con 0x7fe9f40b3c90 2023-07-06T22:00:33.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3648951522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f4070390 con 0x7fe9f40b3c90 2023-07-06T22:00:33.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.009+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3648951522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f4066d60 con 0x7fe9f40b3c90 2023-07-06T22:00:33.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.013+0000 7fe9f0ff9640 1 -- 172.21.15.55:0/3648951522 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fe9e80039a0 con 0x7fe9f40b3c90 2023-07-06T22:00:33.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.013+0000 7fe9f0ff9640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe9e00663f0 0x7fe9e00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:33.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.013+0000 7fe9f0ff9640 1 -- 172.21.15.55:0/3648951522 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe9e80836e0 con 0x7fe9f40b3c90 2023-07-06T22:00:33.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.013+0000 7fe9f3fff640 1 -- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe9e00663f0 msgr2=0x7fe9e00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3817107512 2023-07-06T22:00:33.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.013+0000 7fe9f3fff640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe9e00663f0 0x7fe9e00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:00:33.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.017+0000 7fe9f0ff9640 1 -- 172.21.15.55:0/3648951522 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe9e8050920 con 0x7fe9f40b3c90 2023-07-06T22:00:33.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.193+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3648951522 --> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9f40b0eb0 con 0x7fe9e00663f0 2023-07-06T22:00:33.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.217+0000 7fe9f3fff640 1 -- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe9e00663f0 msgr2=0x7fe9e00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3817107512 2023-07-06T22:00:33.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.217+0000 7fe9f3fff640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe9e00663f0 0x7fe9e00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-06T22:00:33.279 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:33.280+0000 7fa3a4a2c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:00:33.337 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:33.340+0000 7fa3a4a2c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:00:33.367 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:33.365+0000 7f2dfa262180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:00:33.392 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:33.396+0000 7fa3a4a2c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:00:33.428 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:33.429+0000 7f2dfa262180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:00:33.477 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:33.480+0000 7fa3a4a2c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:00:33.486 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:33.485+0000 7f2dfa262180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:00:33.535 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:33.536+0000 7fa3a4a2c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:00:33.576 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:33.577+0000 7f2dfa262180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:00:33.618 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:33.620+0000 7fa3a4a2c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:00:33.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.621+0000 7fe9f3fff640 1 -- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe9e00663f0 msgr2=0x7fe9e00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3817107512 2023-07-06T22:00:33.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:33.621+0000 7fe9f3fff640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe9e00663f0 0x7fe9e00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-06T22:00:33.635 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:33.633+0000 7f2dfa262180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:00:33.674 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:33.676+0000 7fa3a4a2c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:00:33.723 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:33.721+0000 7f2dfa262180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:00:33.782 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:33.781+0000 7f2dfa262180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:00:33.815 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:33.816+0000 7fa3a4a2c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:00:33.872 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:33.876+0000 7fa3a4a2c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:00:33.931 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:33.929+0000 7f2dfa262180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:00:33.992 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:33.989+0000 7f2dfa262180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:00:34.111 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:00:34.111 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:00:34.111 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:00:34.119 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:34.120+0000 7fa3a4a2c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:00:34.241 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:00:34.242 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:00:34.242 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:00:34.250 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:34.249+0000 7f2dfa262180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:00:34.252 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:34.256+0000 7fa3a4a2c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:00:34.375 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:34.376+0000 7fa3a4a2c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:00:34.389 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:34.389+0000 7f2dfa262180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:00:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:34.425+0000 7fe9f3fff640 1 -- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe9e00663f0 msgr2=0x7fe9e00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3817107512 2023-07-06T22:00:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:34.425+0000 7fe9f3fff640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe9e00663f0 0x7fe9e00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-06T22:00:34.445 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:34.448+0000 7fa3a4a2c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:00:34.520 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:34.521+0000 7f2dfa262180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:00:34.580 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:34.584+0000 7fa3a4a2c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:00:34.594 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:34.593+0000 7f2dfa262180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:00:34.735 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:34.733+0000 7f2dfa262180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:00:35.115 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:35.116+0000 7fa3a4a2c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:00:35.200 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:35.204+0000 7fa3a4a2c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:00:35.302 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:35.301+0000 7f2dfa262180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:00:35.345 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:35.348+0000 7fa3a4a2c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:00:35.391 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:35.389+0000 7f2dfa262180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:00:35.429 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:35.432+0000 7fa3a4a2c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:00:35.549 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:35.549+0000 7f2dfa262180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:00:35.636 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:35.637+0000 7f2dfa262180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:00:35.699 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:35.700+0000 7fa3a4a2c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:00:35.758 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:00:35.760+0000 7fa3a4a2c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:00:35.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:35.817+0000 7fe9f0ff9640 1 -- 172.21.15.55:0/3648951522 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 60) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fe9e8050cf0 con 0x7fe9f40b3c90 2023-07-06T22:00:35.924 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:35.925+0000 7f2dfa262180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:00:35.986 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:35.985+0000 7f2dfa262180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:00:36.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:36.001+0000 7fe9f0ff9640 1 -- 172.21.15.55:0/3648951522 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 61) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fe9e8053ad0 con 0x7fe9f40b3c90 2023-07-06T22:00:36.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:36.001+0000 7fe9f0ff9640 1 -- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe9e00663f0 msgr2=0x7fe9e00688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:00:36.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:36.001+0000 7fe9f0ff9640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/3817107512,v1:172.21.15.55:6833/3817107512] conn(0x7fe9e00663f0 0x7fe9e00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:36.126 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:36.125+0000 7f2d78cb8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:36.126 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:36.125+0000 7f2d78cb8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:36.126 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:36.125+0000 7f2d78cb8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:36.127 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:36.125+0000 7f2d78cb8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:36.127 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:36.125+0000 7f2d78cb8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:36.127 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:36.125+0000 7f2d7c4bf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:36.127 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:36.125+0000 7f2d7c4bf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:36.128 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:36.125+0000 7f2d7c4bf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:36.128 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:36.125+0000 7f2d7c4bf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:36.128 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:00:36.125+0000 7f2d7c4bf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:00:37.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.001+0000 7fe9f0ff9640 1 -- 172.21.15.55:0/3648951522 <== mon.0 v2:172.21.15.55:3300/0 9 ==== mgrmap(e 62) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fe9e80515c0 con 0x7fe9f40b3c90 2023-07-06T22:00:37.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.005+0000 7fe9f0ff9640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fe9e006ee40 0x7fe9e0071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:37.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.005+0000 7fe9f0ff9640 1 -- 172.21.15.55:0/3648951522 --> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9f40b0eb0 con 0x7fe9e006ee40 2023-07-06T22:00:37.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.005+0000 7fe9f3fff640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fe9e006ee40 0x7fe9e0071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:37.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.009+0000 7fe9f3fff640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fe9e006ee40 0x7fe9e0071220 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4000f70 tx=0x7fe9e4007d40 comp rx=0 tx=0).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:37.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.077+0000 7fe9f0ff9640 1 -- 172.21.15.55:0/3648951522 <== mgr.8844 v2:172.21.15.55:6832/1146764448 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe9f40b0eb0 con 0x7fe9e006ee40 2023-07-06T22:00:37.078 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path snap_test_dir1 2023-07-06T22:00:37.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.081+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fe9e006ee40 msgr2=0x7fe9e0071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:37.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.081+0000 7fe9fa59f640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fe9e006ee40 0x7fe9e0071220 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4000f70 tx=0x7fe9e4007d40 comp rx=0 tx=0).stop 2023-07-06T22:00:37.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.081+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f40b3c90 msgr2=0x7fe9f406d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:37.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.081+0000 7fe9fa59f640 1 --2- 172.21.15.55:0/3648951522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f40b3c90 0x7fe9f406d910 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800c410 tx=0x7fe9e800c8d0 comp rx=0 tx=0).stop 2023-07-06T22:00:37.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.081+0000 7fe9f8b3c640 1 -- 172.21.15.55:0/3648951522 reap_dead start 2023-07-06T22:00:37.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.081+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3648951522 shutdown_connections 2023-07-06T22:00:37.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.081+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3648951522 >> 172.21.15.55:0/3648951522 conn(0x7fe9f406bf40 msgr2=0x7fe9f40cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:37.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.081+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3648951522 shutdown_connections 2023-07-06T22:00:37.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.081+0000 7fe9fa59f640 1 -- 172.21.15.55:0/3648951522 wait complete. 2023-07-06T22:00:37.102 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-06T22:00:37.103 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-06-22_01_00 in ~23s... 2023-07-06T22:00:37.103 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-07-06T22:00:37.103 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-06T22:00:37.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b2bf96640 1 Processor -- start 2023-07-06T22:00:37.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b2bf96640 1 -- start start 2023-07-06T22:00:37.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b2bf96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b240c8910 0x7f8b24158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:37.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b2bf96640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8b240cd3e0 0x7f8b240cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:37.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b2bf96640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b24159350 con 0x7f8b241588a0 2023-07-06T22:00:37.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b2bf96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b240ccf50 con 0x7f8b240c8910 2023-07-06T22:00:37.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b2bf96640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b24158d90 con 0x7f8b240cd3e0 2023-07-06T22:00:37.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b29d32640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b240c8910 0x7f8b24158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:37.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b2a533640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8b241588a0 0x7f8b2406bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59032/0 (socket says 172.21.15.55:59032) 2023-07-06T22:00:37.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b2a533640 1 -- 172.21.15.55:0/2320762834 learned_addr learned my addr 172.21.15.55:0/2320762834 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:00:37.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b29531640 1 --2- 172.21.15.55:0/2320762834 >> v2:172.21.15.138:3300/0 conn(0x7f8b240cd3e0 0x7f8b240cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:37.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b29d32640 1 -- 172.21.15.55:0/2320762834 >> v2:172.21.15.138:3300/0 conn(0x7f8b240cd3e0 msgr2=0x7f8b240cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:00:37.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b29d32640 1 --2- 172.21.15.55:0/2320762834 >> v2:172.21.15.138:3300/0 conn(0x7f8b240cd3e0 0x7f8b240cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:37.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b29d32640 1 -- 172.21.15.55:0/2320762834 >> v1:172.21.15.55:6789/0 conn(0x7f8b241588a0 legacy=0x7f8b2406bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:37.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b29d32640 1 -- 172.21.15.55:0/2320762834 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b24159070 con 0x7f8b240c8910 2023-07-06T22:00:37.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.297+0000 7f8b28d30640 1 -- 172.21.15.55:0/2320762834 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968954224 0 0) 0x7f8b24159350 con 0x7f8b241588a0 2023-07-06T22:00:37.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.301+0000 7f8b29d32640 1 --2- 172.21.15.55:0/2320762834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b240c8910 0x7f8b24158360 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f8b240ca7e0 tx=0x7f8b2001d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3653fec8b18e6b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.301+0000 7f8b28d30640 1 -- 172.21.15.55:0/2320762834 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b200a6860 con 0x7f8b240c8910 2023-07-06T22:00:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.301+0000 7f8b28d30640 1 -- 172.21.15.55:0/2320762834 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b200a69c0 con 0x7f8b240c8910 2023-07-06T22:00:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.301+0000 7f8b28d30640 1 -- 172.21.15.55:0/2320762834 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b200a6d50 con 0x7f8b240c8910 2023-07-06T22:00:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.301+0000 7f8b2bf96640 1 -- 172.21.15.55:0/2320762834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b240c8910 msgr2=0x7f8b24158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.301+0000 7f8b2bf96640 1 --2- 172.21.15.55:0/2320762834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b240c8910 0x7f8b24158360 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f8b240ca7e0 tx=0x7f8b2001d770 comp rx=0 tx=0).stop 2023-07-06T22:00:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.301+0000 7f8b2bf96640 1 -- 172.21.15.55:0/2320762834 shutdown_connections 2023-07-06T22:00:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.301+0000 7f8b2bf96640 1 --2- 172.21.15.55:0/2320762834 >> v2:172.21.15.138:3300/0 conn(0x7f8b240cd3e0 0x7f8b240cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.301+0000 7f8b2bf96640 1 --2- 172.21.15.55:0/2320762834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b240c8910 0x7f8b24158360 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:37.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.301+0000 7f8b2bf96640 1 -- 172.21.15.55:0/2320762834 >> 172.21.15.55:0/2320762834 conn(0x7f8b240cde30 msgr2=0x7f8b240ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:37.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.301+0000 7f8b2bf96640 1 -- 172.21.15.55:0/2320762834 shutdown_connections 2023-07-06T22:00:37.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.301+0000 7f8b2bf96640 1 -- 172.21.15.55:0/2320762834 wait complete. 2023-07-06T22:00:37.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b2bf96640 1 Processor -- start 2023-07-06T22:00:37.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b2bf96640 1 -- start start 2023-07-06T22:00:37.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b2bf96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b240c8910 0x7f8b2414c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:37.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b2bf96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b241588a0 0x7f8b240c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:37.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b2bf96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b24157640 0x7f8b2414b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:37.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b2bf96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240c6490 con 0x7f8b241588a0 2023-07-06T22:00:37.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b2bf96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240c6730 con 0x7f8b240c8910 2023-07-06T22:00:37.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b2bf96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240c6a10 con 0x7f8b24157640 2023-07-06T22:00:37.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b29531640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b241588a0 0x7f8b240c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:37.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b29531640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b241588a0 0x7f8b240c5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34138/0 (socket says 172.21.15.55:34138) 2023-07-06T22:00:37.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b29531640 1 -- 172.21.15.55:0/1360626656 learned_addr learned my addr 172.21.15.55:0/1360626656 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:00:37.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b29d32640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b240c8910 0x7f8b2414c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:37.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b2a533640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b24157640 0x7f8b2414b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:37.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b29531640 1 -- 172.21.15.55:0/1360626656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b24157640 msgr2=0x7f8b2414b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:37.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b29531640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b24157640 0x7f8b2414b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:37.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b29531640 1 -- 172.21.15.55:0/1360626656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b240c8910 msgr2=0x7f8b2414c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:37.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b29531640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b240c8910 0x7f8b2414c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:37.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b29531640 1 -- 172.21.15.55:0/1360626656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2000a5c0 con 0x7f8b241588a0 2023-07-06T22:00:37.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b29d32640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b240c8910 0x7f8b2414c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:00:37.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b29531640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b241588a0 0x7f8b240c5f50 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400d800 tx=0x7f8b1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:37.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b1a7fc640 1 -- 172.21.15.55:0/1360626656 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1400b6c0 con 0x7f8b241588a0 2023-07-06T22:00:37.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b1a7fc640 1 -- 172.21.15.55:0/1360626656 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1400b860 con 0x7f8b241588a0 2023-07-06T22:00:37.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b1a7fc640 1 -- 172.21.15.55:0/1360626656 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1400bc10 con 0x7f8b241588a0 2023-07-06T22:00:37.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b2bf96640 1 -- 172.21.15.55:0/1360626656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b240c6cf0 con 0x7f8b241588a0 2023-07-06T22:00:37.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.305+0000 7f8b2bf96640 1 -- 172.21.15.55:0/1360626656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b240c72b0 con 0x7f8b241588a0 2023-07-06T22:00:37.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.309+0000 7f8b2bf96640 1 -- 172.21.15.55:0/1360626656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b24066d60 con 0x7f8b241588a0 2023-07-06T22:00:37.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.309+0000 7f8b1a7fc640 1 -- 172.21.15.55:0/1360626656 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 62) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f8b1401e460 con 0x7f8b241588a0 2023-07-06T22:00:37.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.309+0000 7f8b1a7fc640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f8b08066120 0x7f8b080685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:00:37.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.309+0000 7f8b1a7fc640 1 -- 172.21.15.55:0/1360626656 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f8b140843a0 con 0x7f8b241588a0 2023-07-06T22:00:37.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.309+0000 7f8b29d32640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f8b08066120 0x7f8b080685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:00:37.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.309+0000 7f8b29d32640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f8b08066120 0x7f8b080685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b200b0000 tx=0x7f8b20008040 comp rx=0 tx=0).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:00:37.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.313+0000 7f8b1a7fc640 1 -- 172.21.15.55:0/1360626656 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8b14051760 con 0x7f8b241588a0 2023-07-06T22:00:37.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.489+0000 7f8b2bf96640 1 -- 172.21.15.55:0/1360626656 --> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b240c8ce0 con 0x7f8b08066120 2023-07-06T22:00:37.492 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:00:37.495 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:00:37.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.493+0000 7f8b1a7fc640 1 -- 172.21.15.55:0/1360626656 <== mgr.8844 v2:172.21.15.55:6832/1146764448 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7f8b200be0d0 con 0x7f8b08066120 2023-07-06T22:00:37.496 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:00:37.497 INFO:teuthology.orchestra.run.smithi055.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-07-06T22:00:37.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.497+0000 7f8b2bf96640 1 -- 172.21.15.55:0/1360626656 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f8b08066120 msgr2=0x7f8b080685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:37.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.497+0000 7f8b2bf96640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f8b08066120 0x7f8b080685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b200b0000 tx=0x7f8b20008040 comp rx=0 tx=0).stop 2023-07-06T22:00:37.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.497+0000 7f8b2bf96640 1 -- 172.21.15.55:0/1360626656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b241588a0 msgr2=0x7f8b240c5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:00:37.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.497+0000 7f8b2bf96640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b241588a0 0x7f8b240c5f50 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400d800 tx=0x7f8b1400dcc0 comp rx=0 tx=0).stop 2023-07-06T22:00:37.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.497+0000 7f8b2bf96640 1 -- 172.21.15.55:0/1360626656 shutdown_connections 2023-07-06T22:00:37.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.497+0000 7f8b2bf96640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b24157640 0x7f8b2414b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:37.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.497+0000 7f8b2bf96640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b241588a0 0x7f8b240c5f50 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:37.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.497+0000 7f8b2bf96640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f8b08066120 0x7f8b080685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:37.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.497+0000 7f8b2bf96640 1 --2- 172.21.15.55:0/1360626656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b240c8910 0x7f8b2414c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:00:37.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.497+0000 7f8b2bf96640 1 -- 172.21.15.55:0/1360626656 >> 172.21.15.55:0/1360626656 conn(0x7f8b240cde30 msgr2=0x7f8b240ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:00:37.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.497+0000 7f8b2bf96640 1 -- 172.21.15.55:0/1360626656 shutdown_connections 2023-07-06T22:00:37.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:00:37.497+0000 7f8b2bf96640 1 -- 172.21.15.55:0/1360626656 wait complete. 2023-07-06T22:00:37.517 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-07-06T22:00:37.518 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-07-06T22:00:37.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:37.518 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:37.569 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:37.569 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:37.570 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:38.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:38.571 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:38.583 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:38.584 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:38.584 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:39.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:39.585 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:39.597 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:39.597 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:39.597 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:40.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:40.598 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:40.610 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:40.610 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:40.611 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:41.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:41.612 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:41.624 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:41.625 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:41.625 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:42.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:42.626 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:42.638 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:42.638 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:42.638 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:43.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:43.640 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:43.652 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:43.652 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:43.653 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:44.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:44.654 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:44.666 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:44.666 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:44.667 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:45.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:45.669 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:45.680 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:45.681 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:45.681 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:46.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:46.682 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:46.694 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:46.694 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:46.694 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:47.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:47.696 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:47.708 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:47.708 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:47.708 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:48.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:48.710 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:48.722 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:48.722 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:48.723 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:49.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:49.724 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:49.736 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:49.736 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:49.737 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:50.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:50.738 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:50.750 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:50.750 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:50.750 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:51.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:51.752 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:51.764 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:51.764 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:51.765 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:52.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:52.766 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:52.778 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:52.779 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:52.779 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:53.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:53.780 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:53.792 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:53.792 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:53.792 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:54.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:54.794 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:54.806 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:54.806 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:54.806 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:55.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:55.808 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:55.820 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:55.821 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:55.821 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:56.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:56.823 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:56.835 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:56.835 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:56.836 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:57.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:57.837 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:57.848 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:57.849 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:57.849 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:58.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:58.851 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:58.863 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:58.864 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:58.864 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:00:59.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:00:59.865 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:00:59.877 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:00:59.877 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:00:59.878 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:01:00.092 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:00.093+0000 7f2d6bc9e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:00.092 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:00.093+0000 7f2d6bc9e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:00.092 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:00.093+0000 7f2d6bc9e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:00.092 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:00.093+0000 7f2d6bc9e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:00.093 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:00.093+0000 7f2d6bc9e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:00.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:00.880 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:01:00.891 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_01_00_UTC 2023-07-06T22:01:00.892 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_01_00_UTC'} 2023-07-06T22:01:00.892 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-06-22_01_00_UTC'} 2023-07-06T22:01:00.892 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:01:00.893 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-06-22_01_00_UTC'] 2023-07-06T22:01:00.893 DEBUG:tasks.cephfs.test_snap_schedules:exec=1688680837.1030085, now = 1688680860.8934853, timo = 23 2023-07-06T22:01:01.894 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-06T22:01:02.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.053+0000 7f7f5accb640 1 Processor -- start 2023-07-06T22:01:02.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.053+0000 7f7f5accb640 1 -- start start 2023-07-06T22:01:02.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.053+0000 7f7f5accb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7f540b3c90 0x7f7f540ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:02.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.053+0000 7f7f5accb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f540b18a0 0x7f7f540b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:02.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.053+0000 7f7f5accb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f540ccd50 con 0x7f7f540d1d30 2023-07-06T22:01:02.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.053+0000 7f7f5accb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f540cd0a0 con 0x7f7f540b18a0 2023-07-06T22:01:02.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.053+0000 7f7f5accb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f54069ea0 con 0x7f7f540b3c90 2023-07-06T22:01:02.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.053+0000 7f7f58a67640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7f540b3c90 0x7f7f540ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:02.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.053+0000 7f7f58a67640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7f540b3c90 0x7f7f540ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:59180/0 (socket says 172.21.15.55:59180) 2023-07-06T22:01:02.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.057+0000 7f7f58a67640 1 -- 172.21.15.55:0/3580261828 learned_addr learned my addr 172.21.15.55:0/3580261828 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:02.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.057+0000 7f7f53fff640 1 --2- 172.21.15.55:0/3580261828 >> v2:172.21.15.55:3300/0 conn(0x7f7f540b18a0 0x7f7f540b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:02.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.057+0000 7f7f53fff640 1 -- 172.21.15.55:0/3580261828 >> v2:172.21.15.138:3300/0 conn(0x7f7f540b3c90 msgr2=0x7f7f540ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:02.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.057+0000 7f7f53fff640 1 --2- 172.21.15.55:0/3580261828 >> v2:172.21.15.138:3300/0 conn(0x7f7f540b3c90 0x7f7f540ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.057+0000 7f7f53fff640 1 -- 172.21.15.55:0/3580261828 >> v1:172.21.15.138:6789/0 conn(0x7f7f540d1d30 legacy=0x7f7f5415f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:02.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.057+0000 7f7f53fff640 1 -- 172.21.15.55:0/3580261828 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f540b45a0 con 0x7f7f540b18a0 2023-07-06T22:01:02.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.061+0000 7f7f53fff640 1 --2- 172.21.15.55:0/3580261828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f540b18a0 0x7f7f540b4060 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f7f5408b300 tx=0x7f7f4001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e659c036858350 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:02.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.061+0000 7f7f537fe640 1 -- 172.21.15.55:0/3580261828 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400a7070 con 0x7f7f540b18a0 2023-07-06T22:01:02.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.061+0000 7f7f537fe640 1 -- 172.21.15.55:0/3580261828 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f400ab430 con 0x7f7f540b18a0 2023-07-06T22:01:02.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.061+0000 7f7f537fe640 1 -- 172.21.15.55:0/3580261828 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400ab7c0 con 0x7f7f540b18a0 2023-07-06T22:01:02.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.061+0000 7f7f5accb640 1 -- 172.21.15.55:0/3580261828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f540b18a0 msgr2=0x7f7f540b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:02.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.061+0000 7f7f5accb640 1 --2- 172.21.15.55:0/3580261828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f540b18a0 0x7f7f540b4060 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f7f5408b300 tx=0x7f7f4001c430 comp rx=0 tx=0).stop 2023-07-06T22:01:02.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.061+0000 7f7f5accb640 1 -- 172.21.15.55:0/3580261828 shutdown_connections 2023-07-06T22:01:02.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.061+0000 7f7f5accb640 1 --2- 172.21.15.55:0/3580261828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f540b18a0 0x7f7f540b4060 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.061+0000 7f7f5accb640 1 --2- 172.21.15.55:0/3580261828 >> v2:172.21.15.138:3300/0 conn(0x7f7f540b3c90 0x7f7f540ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.061+0000 7f7f5accb640 1 -- 172.21.15.55:0/3580261828 >> 172.21.15.55:0/3580261828 conn(0x7f7f5406bf40 msgr2=0x7f7f540cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:02.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.061+0000 7f7f5accb640 1 -- 172.21.15.55:0/3580261828 shutdown_connections 2023-07-06T22:01:02.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.061+0000 7f7f5accb640 1 -- 172.21.15.55:0/3580261828 wait complete. 2023-07-06T22:01:02.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.061+0000 7f7f5accb640 1 Processor -- start 2023-07-06T22:01:02.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f5accb640 1 -- start start 2023-07-06T22:01:02.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f5accb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f540b18a0 0x7f7f5415e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:02.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f5accb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f540b3c90 0x7f7f541587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:02.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f5accb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f540d1d30 0x7f7f54151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:02.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f5accb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540c92e0 con 0x7f7f540d1d30 2023-07-06T22:01:02.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f5accb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540cba70 con 0x7f7f540b18a0 2023-07-06T22:01:02.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f5accb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5415ed10 con 0x7f7f540b3c90 2023-07-06T22:01:02.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f59268640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f540d1d30 0x7f7f54151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:02.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f59268640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f540d1d30 0x7f7f54151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35322/0 (socket says 172.21.15.55:35322) 2023-07-06T22:01:02.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f59268640 1 -- 172.21.15.55:0/2144978565 learned_addr learned my addr 172.21.15.55:0/2144978565 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:02.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f58a67640 1 --2- 172.21.15.55:0/2144978565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f540b18a0 0x7f7f5415e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:02.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f53fff640 1 --2- 172.21.15.55:0/2144978565 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f540b3c90 0x7f7f541587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:02.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f59268640 1 -- 172.21.15.55:0/2144978565 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f540b3c90 msgr2=0x7f7f541587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:02.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f59268640 1 --2- 172.21.15.55:0/2144978565 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f540b3c90 0x7f7f541587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f59268640 1 -- 172.21.15.55:0/2144978565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f540b18a0 msgr2=0x7f7f5415e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:02.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f59268640 1 --2- 172.21.15.55:0/2144978565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f540b18a0 0x7f7f5415e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f59268640 1 -- 172.21.15.55:0/2144978565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40009420 con 0x7f7f540d1d30 2023-07-06T22:01:02.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f59268640 1 --2- 172.21.15.55:0/2144978565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f540d1d30 0x7f7f54151fd0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00c760 tx=0x7f7f4c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:02.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f517fa640 1 -- 172.21.15.55:0/2144978565 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c003b80 con 0x7f7f540d1d30 2023-07-06T22:01:02.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f517fa640 1 -- 172.21.15.55:0/2144978565 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c003ce0 con 0x7f7f540d1d30 2023-07-06T22:01:02.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f5accb640 1 -- 172.21.15.55:0/2144978565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f540cb140 con 0x7f7f540d1d30 2023-07-06T22:01:02.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f517fa640 1 -- 172.21.15.55:0/2144978565 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c00aa90 con 0x7f7f540d1d30 2023-07-06T22:01:02.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f5accb640 1 -- 172.21.15.55:0/2144978565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f540cb700 con 0x7f7f540d1d30 2023-07-06T22:01:02.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.065+0000 7f7f5accb640 1 -- 172.21.15.55:0/2144978565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f54066d60 con 0x7f7f540d1d30 2023-07-06T22:01:02.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.069+0000 7f7f517fa640 1 -- 172.21.15.55:0/2144978565 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 64) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f7f4c00abf0 con 0x7f7f540d1d30 2023-07-06T22:01:02.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.069+0000 7f7f517fa640 1 --2- 172.21.15.55:0/2144978565 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f7f38066540 0x7f7f380689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:02.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.069+0000 7f7f517fa640 1 -- 172.21.15.55:0/2144978565 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f7f4c084150 con 0x7f7f540d1d30 2023-07-06T22:01:02.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.069+0000 7f7f58a67640 1 --2- 172.21.15.55:0/2144978565 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f7f38066540 0x7f7f380689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:02.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.069+0000 7f7f58a67640 1 --2- 172.21.15.55:0/2144978565 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f7f38066540 0x7f7f380689f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009b50 tx=0x7f7f48009240 comp rx=0 tx=0).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:02.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.073+0000 7f7f517fa640 1 -- 172.21.15.55:0/2144978565 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f4c050fe0 con 0x7f7f540d1d30 2023-07-06T22:01:02.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.245+0000 7f7f5accb640 1 -- 172.21.15.55:0/2144978565 --> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f54168880 con 0x7f7f38066540 2023-07-06T22:01:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.325+0000 7f7f517fa640 1 -- 172.21.15.55:0/2144978565 <== mgr.8844 v2:172.21.15.55:6832/1146764448 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7f48009880 con 0x7f7f38066540 2023-07-06T22:01:02.325 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path snap_test_dir1 2023-07-06T22:01:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.325+0000 7f7f5accb640 1 -- 172.21.15.55:0/2144978565 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f7f38066540 msgr2=0x7f7f380689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.325+0000 7f7f5accb640 1 --2- 172.21.15.55:0/2144978565 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f7f38066540 0x7f7f380689f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009b50 tx=0x7f7f48009240 comp rx=0 tx=0).stop 2023-07-06T22:01:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.325+0000 7f7f5accb640 1 -- 172.21.15.55:0/2144978565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f540d1d30 msgr2=0x7f7f54151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.325+0000 7f7f5accb640 1 --2- 172.21.15.55:0/2144978565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f540d1d30 0x7f7f54151fd0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00c760 tx=0x7f7f4c00cc20 comp rx=0 tx=0).stop 2023-07-06T22:01:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.325+0000 7f7f5accb640 1 -- 172.21.15.55:0/2144978565 shutdown_connections 2023-07-06T22:01:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.325+0000 7f7f5accb640 1 --2- 172.21.15.55:0/2144978565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f540d1d30 0x7f7f54151fd0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.325+0000 7f7f5accb640 1 --2- 172.21.15.55:0/2144978565 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f540b3c90 0x7f7f541587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.325+0000 7f7f5accb640 1 --2- 172.21.15.55:0/2144978565 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f7f38066540 0x7f7f380689f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.325+0000 7f7f5accb640 1 --2- 172.21.15.55:0/2144978565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f540b18a0 0x7f7f5415e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.325+0000 7f7f5accb640 1 -- 172.21.15.55:0/2144978565 >> 172.21.15.55:0/2144978565 conn(0x7f7f5406bf40 msgr2=0x7f7f540d2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:02.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.325+0000 7f7f5accb640 1 -- 172.21.15.55:0/2144978565 shutdown_connections 2023-07-06T22:01:02.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.325+0000 7f7f5accb640 1 -- 172.21.15.55:0/2144978565 wait complete. 2023-07-06T22:01:02.346 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-06T22:01:02.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:02.347 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:01:02.357 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_01_00_UTC 2023-07-06T22:01:02.357 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-06-22_01_00_UTC 2023-07-06T22:01:02.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:02.358 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-06-22_01_00_UTC) 2023-07-06T22:01:02.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:02.419 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-06T22:01:02.470 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-06T22:01:02.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.653+0000 7f5ba24d8640 1 Processor -- start 2023-07-06T22:01:02.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.653+0000 7f5ba24d8640 1 -- start start 2023-07-06T22:01:02.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.657+0000 7f5ba24d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b9c158850 0x7f5b9c0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:02.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.657+0000 7f5ba24d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b9c0ca130 0x7f5b9c0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:02.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.657+0000 7f5ba24d8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9c0b2aa0 con 0x7f5b9c0703e0 2023-07-06T22:01:02.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.657+0000 7f5ba24d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9c158c20 con 0x7f5b9c0ca130 2023-07-06T22:01:02.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.657+0000 7f5ba24d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c0c8db0 con 0x7f5b9c158850 2023-07-06T22:01:02.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.657+0000 7f5b9b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b9c0ca130 0x7f5b9c0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:02.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.657+0000 7f5b9b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b9c0ca130 0x7f5b9c0ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35332/0 (socket says 172.21.15.55:35332) 2023-07-06T22:01:02.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.657+0000 7f5b9b7fe640 1 -- 172.21.15.55:0/1948721401 learned_addr learned my addr 172.21.15.55:0/1948721401 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:02.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.657+0000 7f5b9bfff640 1 --2- 172.21.15.55:0/1948721401 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b9c158850 0x7f5b9c0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:02.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.657+0000 7f5b9b7fe640 1 -- 172.21.15.55:0/1948721401 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b9c158850 msgr2=0x7f5b9c0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:02.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.657+0000 7f5b9b7fe640 1 --2- 172.21.15.55:0/1948721401 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b9c158850 0x7f5b9c0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.657+0000 7f5b9b7fe640 1 -- 172.21.15.55:0/1948721401 >> v1:172.21.15.138:6789/0 conn(0x7f5b9c0703e0 legacy=0x7f5b9c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:02.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.657+0000 7f5b9b7fe640 1 -- 172.21.15.55:0/1948721401 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c0c9090 con 0x7f5b9c0ca130 2023-07-06T22:01:02.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5b9b7fe640 1 --2- 172.21.15.55:0/1948721401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9c0ca130 0x7f5b9c0ccf70 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009870 tx=0x7f5b9001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a268b6328a1cac server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:02.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5b9affd640 1 -- 172.21.15.55:0/1948721401 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b900a89b0 con 0x7f5b9c0ca130 2023-07-06T22:01:02.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5b9affd640 1 -- 172.21.15.55:0/1948721401 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b900a8b10 con 0x7f5b9c0ca130 2023-07-06T22:01:02.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5b9affd640 1 -- 172.21.15.55:0/1948721401 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b900a8ea0 con 0x7f5b9c0ca130 2023-07-06T22:01:02.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1948721401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9c0ca130 msgr2=0x7f5b9c0ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:02.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5ba24d8640 1 --2- 172.21.15.55:0/1948721401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9c0ca130 0x7f5b9c0ccf70 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009870 tx=0x7f5b9001ecf0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1948721401 shutdown_connections 2023-07-06T22:01:02.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5ba24d8640 1 --2- 172.21.15.55:0/1948721401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9c0ca130 0x7f5b9c0ccf70 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5ba24d8640 1 --2- 172.21.15.55:0/1948721401 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b9c158850 0x7f5b9c0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1948721401 >> 172.21.15.55:0/1948721401 conn(0x7f5b9c0cea70 msgr2=0x7f5b9c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:02.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1948721401 shutdown_connections 2023-07-06T22:01:02.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1948721401 wait complete. 2023-07-06T22:01:02.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5ba24d8640 1 Processor -- start 2023-07-06T22:01:02.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5ba24d8640 1 -- start start 2023-07-06T22:01:02.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5ba24d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b9c0703e0 0x7f5b9c1f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.661+0000 7f5ba24d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b9c0ca130 0x7f5b9c0cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5ba24d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9c158850 0x7f5b9c155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5ba24d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c1f24c0 con 0x7f5b9c158850 2023-07-06T22:01:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5ba24d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c0c6120 con 0x7f5b9c0ca130 2023-07-06T22:01:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5ba24d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c0c6400 con 0x7f5b9c0703e0 2023-07-06T22:01:02.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5ba0a75640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9c158850 0x7f5b9c155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:02.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5b9bfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b9c0703e0 0x7f5b9c1f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:02.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5b9b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b9c0ca130 0x7f5b9c0cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:02.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5b9bfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b9c0703e0 0x7f5b9c1f1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:33650/0 (socket says 172.21.15.55:33650) 2023-07-06T22:01:02.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5b9b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b9c0ca130 0x7f5b9c0cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:59202/0 (socket says 172.21.15.55:59202) 2023-07-06T22:01:02.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5b9bfff640 1 -- 172.21.15.55:0/1153906567 learned_addr learned my addr 172.21.15.55:0/1153906567 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:02.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5ba0a75640 1 -- 172.21.15.55:0/1153906567 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b9c0703e0 msgr2=0x7f5b9c1f1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:02.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5ba0a75640 1 --2- 172.21.15.55:0/1153906567 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b9c0703e0 0x7f5b9c1f1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5ba0a75640 1 -- 172.21.15.55:0/1153906567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b9c0ca130 msgr2=0x7f5b9c0cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5ba0a75640 1 --2- 172.21.15.55:0/1153906567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b9c0ca130 0x7f5b9c0cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5ba0a75640 1 -- 172.21.15.55:0/1153906567 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b900094d0 con 0x7f5b9c158850 2023-07-06T22:01:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5b9b7fe640 1 --2- 172.21.15.55:0/1153906567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b9c0ca130 0x7f5b9c0cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5ba0a75640 1 --2- 172.21.15.55:0/1153906567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9c158850 0x7f5b9c155770 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400c780 tx=0x7f5b9400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5b98ff9640 1 -- 172.21.15.55:0/1153906567 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9400aa50 con 0x7f5b9c158850 2023-07-06T22:01:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5b98ff9640 1 -- 172.21.15.55:0/1153906567 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9400abd0 con 0x7f5b9c158850 2023-07-06T22:01:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5b98ff9640 1 -- 172.21.15.55:0/1153906567 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9400ce30 con 0x7f5b9c158850 2023-07-06T22:01:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1153906567 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9c0c66e0 con 0x7f5b9c158850 2023-07-06T22:01:02.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1153906567 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9c0c6ca0 con 0x7f5b9c158850 2023-07-06T22:01:02.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1153906567 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9c0c6e90 con 0x7f5b9c158850 2023-07-06T22:01:02.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.665+0000 7f5b98ff9640 1 -- 172.21.15.55:0/1153906567 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 64) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f5b94012420 con 0x7f5b9c158850 2023-07-06T22:01:02.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.669+0000 7f5b98ff9640 1 --2- 172.21.15.55:0/1153906567 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f5b88066510 0x7f5b880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:02.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.669+0000 7f5b98ff9640 1 -- 172.21.15.55:0/1153906567 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f5b94084840 con 0x7f5b9c158850 2023-07-06T22:01:02.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.669+0000 7f5b9bfff640 1 --2- 172.21.15.55:0/1153906567 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f5b88066510 0x7f5b880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:02.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.669+0000 7f5b9bfff640 1 --2- 172.21.15.55:0/1153906567 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f5b88066510 0x7f5b880689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c007a70 tx=0x7f5b8c008040 comp rx=0 tx=0).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.673+0000 7f5b98ff9640 1 -- 172.21.15.55:0/1153906567 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5b940516d0 con 0x7f5b9c158850 2023-07-06T22:01:02.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:02.865+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1153906567 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f5b9c066d60 con 0x7f5b9c158850 2023-07-06T22:01:03.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.085+0000 7f5b98ff9640 1 -- 172.21.15.55:0/1153906567 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f5b94051aa0 con 0x7f5b9c158850 2023-07-06T22:01:03.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.085+0000 7f5b98ff9640 1 -- 172.21.15.55:0/1153906567 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v65) v1 ==== 93+0+0 (secure 0 0 0) 0x7f5b9406e410 con 0x7f5b9c158850 2023-07-06T22:01:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.089+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1153906567 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f5b88066510 msgr2=0x7f5b880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.089+0000 7f5ba24d8640 1 --2- 172.21.15.55:0/1153906567 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f5b88066510 0x7f5b880689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c007a70 tx=0x7f5b8c008040 comp rx=0 tx=0).stop 2023-07-06T22:01:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.089+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1153906567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9c158850 msgr2=0x7f5b9c155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.089+0000 7f5ba24d8640 1 --2- 172.21.15.55:0/1153906567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9c158850 0x7f5b9c155770 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400c780 tx=0x7f5b9400cc40 comp rx=0 tx=0).stop 2023-07-06T22:01:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.089+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1153906567 shutdown_connections 2023-07-06T22:01:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.089+0000 7f5ba24d8640 1 --2- 172.21.15.55:0/1153906567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9c158850 0x7f5b9c155770 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.089+0000 7f5ba24d8640 1 --2- 172.21.15.55:0/1153906567 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f5b88066510 0x7f5b880689c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.089+0000 7f5ba24d8640 1 --2- 172.21.15.55:0/1153906567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b9c0ca130 0x7f5b9c0cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.089+0000 7f5ba24d8640 1 --2- 172.21.15.55:0/1153906567 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b9c0703e0 0x7f5b9c1f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.089+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1153906567 >> 172.21.15.55:0/1153906567 conn(0x7f5b9c0cea70 msgr2=0x7f5b9c157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:03.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.089+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1153906567 shutdown_connections 2023-07-06T22:01:03.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.089+0000 7f5ba24d8640 1 -- 172.21.15.55:0/1153906567 wait complete. 2023-07-06T22:01:03.109 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T22:01:03.110 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:01:03.186 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:01:03.242 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T22:01:03.242 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:01:03.243 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:03.253 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:01:03.253 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:03.254 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:03.255+0000 7fcb91446180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:01:03.268 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:03.269+0000 7f213a432180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:01:03.278 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:01:03.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a9dd2640 1 Processor -- start 2023-07-06T22:01:03.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a9dd2640 1 -- start start 2023-07-06T22:01:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a9dd2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe0a40b7cd0 0x7fe0a40ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a9dd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a40cecf0 con 0x7fe0a40b1fe0 2023-07-06T22:01:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a9dd2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a40d1d90 con 0x7fe0a40ccab0 2023-07-06T22:01:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a9dd2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a40d2310 con 0x7fe0a40b7cd0 2023-07-06T22:01:03.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe0a40b1fe0 0x7fe0a415f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34276/0 (socket says 172.21.15.55:34276) 2023-07-06T22:01:03.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a3fff640 1 -- 172.21.15.55:0/509802132 learned_addr learned my addr 172.21.15.55:0/509802132 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:03.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a37fe640 1 --2- 172.21.15.55:0/509802132 >> v2:172.21.15.138:3300/0 conn(0x7fe0a40b7cd0 0x7fe0a40ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:03.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856988795 0 0) 0x7fe0a40cecf0 con 0x7fe0a40b1fe0 2023-07-06T22:01:03.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe08c003530 con 0x7fe0a40b1fe0 2023-07-06T22:01:03.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337745513 0 0) 0x7fe0a40d1d90 con 0x7fe0a40ccab0 2023-07-06T22:01:03.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0a40cecf0 con 0x7fe0a40ccab0 2023-07-06T22:01:03.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3216834617 0 0) 0x7fe08c003530 con 0x7fe0a40b1fe0 2023-07-06T22:01:03.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 >> v2:172.21.15.138:3300/0 conn(0x7fe0a40b7cd0 msgr2=0x7fe0a40ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:03.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 --2- 172.21.15.55:0/509802132 >> v2:172.21.15.138:3300/0 conn(0x7fe0a40b7cd0 0x7fe0a40ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 >> v1:172.21.15.138:6789/0 conn(0x7fe0a40ccab0 legacy=0x7fe0a40b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:03.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a40d2030 con 0x7fe0a40b1fe0 2023-07-06T22:01:03.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fe09c001a00 con 0x7fe0a40b1fe0 2023-07-06T22:01:03.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 >> v1:172.21.15.55:6789/0 conn(0x7fe0a40b1fe0 legacy=0x7fe0a415f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:03.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 --2- 172.21.15.55:0/509802132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe08c003b10 0x7fe08c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:03.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 --2- 172.21.15.55:0/509802132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe08c0047d0 0x7fe08c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:03.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 --2- 172.21.15.55:0/509802132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe08c005180 0x7fe08c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:03.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c00c060 con 0x7fe08c003b10 2023-07-06T22:01:03.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c00c1d0 con 0x7fe08c005180 2023-07-06T22:01:03.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c00c390 con 0x7fe08c0047d0 2023-07-06T22:01:03.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.465+0000 7fe0a37fe640 1 --2- 172.21.15.55:0/509802132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe08c003b10 0x7fe08c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:03.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.469+0000 7fe0a3fff640 1 --2- 172.21.15.55:0/509802132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe08c005180 0x7fe08c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:03.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.469+0000 7fe0a2ffd640 1 --2- 172.21.15.55:0/509802132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe08c0047d0 0x7fe08c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:03.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.469+0000 7fe0a37fe640 1 -- 172.21.15.55:0/509802132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe08c0047d0 msgr2=0x7fe08c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:03.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.469+0000 7fe0a37fe640 1 --2- 172.21.15.55:0/509802132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe08c0047d0 0x7fe08c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.469+0000 7fe0a37fe640 1 -- 172.21.15.55:0/509802132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe08c005180 msgr2=0x7fe08c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:03.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.469+0000 7fe0a37fe640 1 --2- 172.21.15.55:0/509802132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe08c005180 0x7fe08c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.469+0000 7fe0a37fe640 1 -- 172.21.15.55:0/509802132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c003530 con 0x7fe08c003b10 2023-07-06T22:01:03.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.469+0000 7fe0a3fff640 1 -- 172.21.15.55:0/509802132 reap_dead start 2023-07-06T22:01:03.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.469+0000 7fe0a2ffd640 1 --2- 172.21.15.55:0/509802132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe08c0047d0 0x7fe08c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:03.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.469+0000 7fe0a37fe640 1 --2- 172.21.15.55:0/509802132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe08c003b10 0x7fe08c003f00 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fe094009ab0 tx=0x7fe09401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe560e618e45880 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:03.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.469+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0940a6410 con 0x7fe08c003b10 2023-07-06T22:01:03.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.469+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0940a6570 con 0x7fe08c003b10 2023-07-06T22:01:03.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.469+0000 7fe0a27fc640 1 -- 172.21.15.55:0/509802132 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0940a6920 con 0x7fe08c003b10 2023-07-06T22:01:03.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/509802132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe08c003b10 msgr2=0x7fe08c003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:03.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 --2- 172.21.15.55:0/509802132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe08c003b10 0x7fe08c003f00 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fe094009ab0 tx=0x7fe09401ca30 comp rx=0 tx=0).stop 2023-07-06T22:01:03.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/509802132 shutdown_connections 2023-07-06T22:01:03.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 --2- 172.21.15.55:0/509802132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe08c003b10 0x7fe08c003f00 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/509802132 >> 172.21.15.55:0/509802132 conn(0x7fe0a40ceee0 msgr2=0x7fe0a40cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:03.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/509802132 shutdown_connections 2023-07-06T22:01:03.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/509802132 wait complete. 2023-07-06T22:01:03.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 Processor -- start 2023-07-06T22:01:03.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 -- start start 2023-07-06T22:01:03.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe08c003b10 0x7fe0a4155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:03.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a40c5350 0x7fe0a41fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:03.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0a40b5a90 0x7fe0a40b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:03.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40b6470 con 0x7fe0a40c5350 2023-07-06T22:01:03.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a4156080 con 0x7fe08c003b10 2023-07-06T22:01:03.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a9dd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a41fd230 con 0x7fe0a40b5a90 2023-07-06T22:01:03.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a40c5350 0x7fe0a41fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:03.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a40c5350 0x7fe0a41fccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57974/0 (socket says 172.21.15.55:57974) 2023-07-06T22:01:03.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a2ffd640 1 -- 172.21.15.55:0/821854178 learned_addr learned my addr 172.21.15.55:0/821854178 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a37fe640 1 --2- 172.21.15.55:0/821854178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe08c003b10 0x7fe0a4155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.473+0000 7fe0a3fff640 1 --2- 172.21.15.55:0/821854178 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0a40b5a90 0x7fe0a40b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe0a2ffd640 1 -- 172.21.15.55:0/821854178 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0a40b5a90 msgr2=0x7fe0a40b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe0a2ffd640 1 --2- 172.21.15.55:0/821854178 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0a40b5a90 0x7fe0a40b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe0a2ffd640 1 -- 172.21.15.55:0/821854178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe08c003b10 msgr2=0x7fe0a4155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe0a2ffd640 1 --2- 172.21.15.55:0/821854178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe08c003b10 0x7fe0a4155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe0a2ffd640 1 -- 172.21.15.55:0/821854178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a40c60a0 con 0x7fe0a40c5350 2023-07-06T22:01:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe0a37fe640 1 --2- 172.21.15.55:0/821854178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe08c003b10 0x7fe0a4155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:03.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe0a2ffd640 1 --2- 172.21.15.55:0/821854178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a40c5350 0x7fe0a41fccf0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fe09800d590 tx=0x7fe09800d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:03.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe08bfff640 1 -- 172.21.15.55:0/821854178 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098007020 con 0x7fe0a40c5350 2023-07-06T22:01:03.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe08bfff640 1 -- 172.21.15.55:0/821854178 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe098007180 con 0x7fe0a40c5350 2023-07-06T22:01:03.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe08bfff640 1 -- 172.21.15.55:0/821854178 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980074f0 con 0x7fe0a40c5350 2023-07-06T22:01:03.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/821854178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a40c6380 con 0x7fe0a40c5350 2023-07-06T22:01:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/821854178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a40c6940 con 0x7fe0a40c5350 2023-07-06T22:01:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/821854178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a4066d60 con 0x7fe0a40c5350 2023-07-06T22:01:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe08bfff640 1 -- 172.21.15.55:0/821854178 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fe0980067e0 con 0x7fe0a40c5350 2023-07-06T22:01:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe08bfff640 1 --2- 172.21.15.55:0/821854178 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fe0900664f0 0x7fe0900689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe08bfff640 1 -- 172.21.15.55:0/821854178 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fe098083f50 con 0x7fe0a40c5350 2023-07-06T22:01:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe0a37fe640 1 -- 172.21.15.55:0/821854178 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fe0900664f0 msgr2=0x7fe0900689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1146764448 2023-07-06T22:01:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.477+0000 7fe0a37fe640 1 --2- 172.21.15.55:0/821854178 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fe0900664f0 0x7fe0900689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:03.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.481+0000 7fe08bfff640 1 -- 172.21.15.55:0/821854178 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe098050d60 con 0x7fe0a40c5350 2023-07-06T22:01:03.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.641+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/821854178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0a40b3690 con 0x7fe0a40c5350 2023-07-06T22:01:03.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.641+0000 7fe08bfff640 1 -- 172.21.15.55:0/821854178 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+19002 (secure 0 0 0) 0x7fe098054380 con 0x7fe0a40c5350 2023-07-06T22:01:03.643 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:03.643 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":132,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:00:35.993710+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:00:17.410451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-07-06T22:00:18.487297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/1438757296":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/3754412972":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/1384648608":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/2671638221":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/604485969":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/2811517165":"2023-07-07T22:00:35.993679+0000","172.21.15.55:6833/3817107512":"2023-07-07T22:00:35.993679+0000","172.21.15.55:6832/3817107512":"2023-07-07T22:00:35.993679+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:01:03.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.645+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/821854178 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fe0900664f0 msgr2=0x7fe0900689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:03.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.645+0000 7fe0a9dd2640 1 --2- 172.21.15.55:0/821854178 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fe0900664f0 0x7fe0900689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.645+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/821854178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a40c5350 msgr2=0x7fe0a41fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:03.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.645+0000 7fe0a9dd2640 1 --2- 172.21.15.55:0/821854178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a40c5350 0x7fe0a41fccf0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fe09800d590 tx=0x7fe09800d680 comp rx=0 tx=0).stop 2023-07-06T22:01:03.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.645+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/821854178 shutdown_connections 2023-07-06T22:01:03.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.645+0000 7fe0a9dd2640 1 --2- 172.21.15.55:0/821854178 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0a40b5a90 0x7fe0a40b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.645+0000 7fe0a9dd2640 1 --2- 172.21.15.55:0/821854178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0a40c5350 0x7fe0a41fccf0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.645+0000 7fe0a9dd2640 1 --2- 172.21.15.55:0/821854178 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fe0900664f0 0x7fe0900689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.645+0000 7fe0a9dd2640 1 --2- 172.21.15.55:0/821854178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe08c003b10 0x7fe0a4155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.645+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/821854178 >> 172.21.15.55:0/821854178 conn(0x7fe0a40ceee0 msgr2=0x7fe0a40b5290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:03.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.645+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/821854178 shutdown_connections 2023-07-06T22:01:03.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.645+0000 7fe0a9dd2640 1 -- 172.21.15.55:0/821854178 wait complete. 2023-07-06T22:01:03.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T22:00:17.410451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T22:00:18.487297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:01:03.666 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:01:03.671 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:03.675+0000 7fcb91446180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:01:03.718 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:03.717+0000 7f213a432180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:01:03.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.813+0000 7fdf96398640 1 Processor -- start 2023-07-06T22:01:03.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.813+0000 7fdf96398640 1 -- start start 2023-07-06T22:01:03.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.817+0000 7fdf96398640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdf900d0630 0x7fdf9015fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:03.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.817+0000 7fdf96398640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf900cc740 con 0x7fdf900ce200 2023-07-06T22:01:03.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.817+0000 7fdf96398640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf900ccc90 con 0x7fdf900b1250 2023-07-06T22:01:03.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.817+0000 7fdf96398640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf900b29c0 con 0x7fdf900d0630 2023-07-06T22:01:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.817+0000 7fdf95b97640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdf900ce200 0x7fdf900ce640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34290/0 (socket says 172.21.15.55:34290) 2023-07-06T22:01:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.817+0000 7fdf95b97640 1 -- 172.21.15.55:0/3906974572 learned_addr learned my addr 172.21.15.55:0/3906974572 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.817+0000 7fdf94b95640 1 --2- 172.21.15.55:0/3906974572 >> v2:172.21.15.138:3300/0 conn(0x7fdf900d0630 0x7fdf9015fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.817+0000 7fdf87fff640 1 -- 172.21.15.55:0/3906974572 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874357642 0 0) 0x7fdf900cc740 con 0x7fdf900ce200 2023-07-06T22:01:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.817+0000 7fdf87fff640 1 -- 172.21.15.55:0/3906974572 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf7c003530 con 0x7fdf900ce200 2023-07-06T22:01:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.817+0000 7fdf87fff640 1 -- 172.21.15.55:0/3906974572 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533775545 0 0) 0x7fdf900ccc90 con 0x7fdf900b1250 2023-07-06T22:01:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.817+0000 7fdf87fff640 1 -- 172.21.15.55:0/3906974572 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf900cc740 con 0x7fdf900b1250 2023-07-06T22:01:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.817+0000 7fdf94b95640 1 -- 172.21.15.55:0/3906974572 >> v1:172.21.15.138:6789/0 conn(0x7fdf900b1250 legacy=0x7fdf9015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.817+0000 7fdf94b95640 1 -- 172.21.15.55:0/3906974572 >> v1:172.21.15.55:6789/0 conn(0x7fdf900ce200 legacy=0x7fdf900ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:03.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.817+0000 7fdf94b95640 1 -- 172.21.15.55:0/3906974572 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf900d1d10 con 0x7fdf900d0630 2023-07-06T22:01:03.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.821+0000 7fdf94b95640 1 --2- 172.21.15.55:0/3906974572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf900d0630 0x7fdf9015fa90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fdf800097c0 tx=0x7fdf8001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42d1baa72324b469 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:03.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.821+0000 7fdf87fff640 1 -- 172.21.15.55:0/3906974572 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800ab600 con 0x7fdf900d0630 2023-07-06T22:01:03.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.821+0000 7fdf87fff640 1 -- 172.21.15.55:0/3906974572 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf800a7050 con 0x7fdf900d0630 2023-07-06T22:01:03.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.821+0000 7fdf87fff640 1 -- 172.21.15.55:0/3906974572 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800ab980 con 0x7fdf900d0630 2023-07-06T22:01:03.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.821+0000 7fdf96398640 1 -- 172.21.15.55:0/3906974572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf900d0630 msgr2=0x7fdf9015fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:03.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.821+0000 7fdf96398640 1 --2- 172.21.15.55:0/3906974572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf900d0630 0x7fdf9015fa90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fdf800097c0 tx=0x7fdf8001c450 comp rx=0 tx=0).stop 2023-07-06T22:01:03.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.821+0000 7fdf96398640 1 -- 172.21.15.55:0/3906974572 shutdown_connections 2023-07-06T22:01:03.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.821+0000 7fdf96398640 1 --2- 172.21.15.55:0/3906974572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf900d0630 0x7fdf9015fa90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.821+0000 7fdf96398640 1 -- 172.21.15.55:0/3906974572 >> 172.21.15.55:0/3906974572 conn(0x7fdf900b3b60 msgr2=0x7fdf900b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:03.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.821+0000 7fdf96398640 1 -- 172.21.15.55:0/3906974572 shutdown_connections 2023-07-06T22:01:03.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.821+0000 7fdf96398640 1 -- 172.21.15.55:0/3906974572 wait complete. 2023-07-06T22:01:03.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.821+0000 7fdf96398640 1 Processor -- start 2023-07-06T22:01:03.823 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:03.823+0000 7fcb91446180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:01:03.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.821+0000 7fdf96398640 1 -- start start 2023-07-06T22:01:03.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf96398640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf900b1250 0x7fdf900c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:03.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf96398640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf900ce200 0x7fdf901506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:03.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf96398640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf900d0630 0x7fdf9006a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:03.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf96398640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900c7970 con 0x7fdf900b1250 2023-07-06T22:01:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf96398640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900c7c50 con 0x7fdf900d0630 2023-07-06T22:01:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf96398640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900c7f30 con 0x7fdf900ce200 2023-07-06T22:01:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf95396640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf900b1250 0x7fdf900c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf95396640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf900b1250 0x7fdf900c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57980/0 (socket says 172.21.15.55:57980) 2023-07-06T22:01:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf95396640 1 -- 172.21.15.55:0/3510408984 learned_addr learned my addr 172.21.15.55:0/3510408984 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf94b95640 1 --2- 172.21.15.55:0/3510408984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf900ce200 0x7fdf901506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf95b97640 1 --2- 172.21.15.55:0/3510408984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf900d0630 0x7fdf9006a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf95396640 1 -- 172.21.15.55:0/3510408984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf900ce200 msgr2=0x7fdf901506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf95396640 1 --2- 172.21.15.55:0/3510408984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf900ce200 0x7fdf901506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf95396640 1 -- 172.21.15.55:0/3510408984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf900d0630 msgr2=0x7fdf9006a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf95396640 1 --2- 172.21.15.55:0/3510408984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf900d0630 0x7fdf9006a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf95396640 1 -- 172.21.15.55:0/3510408984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80009420 con 0x7fdf900b1250 2023-07-06T22:01:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf95396640 1 --2- 172.21.15.55:0/3510408984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf900b1250 0x7fdf900c6a30 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00c430 tx=0x7fdf8c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf85ffb640 1 -- 172.21.15.55:0/3510408984 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0052d0 con 0x7fdf900b1250 2023-07-06T22:01:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf85ffb640 1 -- 172.21.15.55:0/3510408984 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c005450 con 0x7fdf900b1250 2023-07-06T22:01:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf96398640 1 -- 172.21.15.55:0/3510408984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf900c8210 con 0x7fdf900b1250 2023-07-06T22:01:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf85ffb640 1 -- 172.21.15.55:0/3510408984 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c003840 con 0x7fdf900b1250 2023-07-06T22:01:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf96398640 1 -- 172.21.15.55:0/3510408984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf90150c20 con 0x7fdf900b1250 2023-07-06T22:01:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf96398640 1 -- 172.21.15.55:0/3510408984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9004d790 con 0x7fdf900b1250 2023-07-06T22:01:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.825+0000 7fdf85ffb640 1 -- 172.21.15.55:0/3510408984 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fdf8c0039a0 con 0x7fdf900b1250 2023-07-06T22:01:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.829+0000 7fdf85ffb640 1 --2- 172.21.15.55:0/3510408984 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fdf740664c0 0x7fdf74068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.829+0000 7fdf85ffb640 1 -- 172.21.15.55:0/3510408984 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fdf8c0838d0 con 0x7fdf900b1250 2023-07-06T22:01:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.829+0000 7fdf94b95640 1 -- 172.21.15.55:0/3510408984 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fdf740664c0 msgr2=0x7fdf74068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1146764448 2023-07-06T22:01:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.829+0000 7fdf94b95640 1 --2- 172.21.15.55:0/3510408984 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fdf740664c0 0x7fdf74068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:03.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.833+0000 7fdf85ffb640 1 -- 172.21.15.55:0/3510408984 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf8c0508c0 con 0x7fdf900b1250 2023-07-06T22:01:03.881 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:03.881+0000 7f213a432180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:01:03.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.989+0000 7fdf96398640 1 -- 172.21.15.55:0/3510408984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf900b3240 con 0x7fdf900b1250 2023-07-06T22:01:03.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.989+0000 7fdf85ffb640 1 -- 172.21.15.55:0/3510408984 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf8c053ee0 con 0x7fdf900b1250 2023-07-06T22:01:03.989 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:01:03.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.989+0000 7fdf96398640 1 -- 172.21.15.55:0/3510408984 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fdf740664c0 msgr2=0x7fdf74068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:03.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.989+0000 7fdf96398640 1 --2- 172.21.15.55:0/3510408984 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fdf740664c0 0x7fdf74068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.989+0000 7fdf96398640 1 -- 172.21.15.55:0/3510408984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf900b1250 msgr2=0x7fdf900c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:03.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.989+0000 7fdf96398640 1 --2- 172.21.15.55:0/3510408984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf900b1250 0x7fdf900c6a30 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00c430 tx=0x7fdf8c00c8f0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.989+0000 7fdf96398640 1 -- 172.21.15.55:0/3510408984 shutdown_connections 2023-07-06T22:01:03.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.989+0000 7fdf96398640 1 --2- 172.21.15.55:0/3510408984 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fdf740664c0 0x7fdf74068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.989+0000 7fdf96398640 1 --2- 172.21.15.55:0/3510408984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf900d0630 0x7fdf9006a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.989+0000 7fdf96398640 1 --2- 172.21.15.55:0/3510408984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf900ce200 0x7fdf901506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.989+0000 7fdf96398640 1 --2- 172.21.15.55:0/3510408984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf900b1250 0x7fdf900c6a30 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:03.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.989+0000 7fdf96398640 1 -- 172.21.15.55:0/3510408984 >> 172.21.15.55:0/3510408984 conn(0x7fdf900b3b60 msgr2=0x7fdf900b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:03.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.989+0000 7fdf96398640 1 -- 172.21.15.55:0/3510408984 shutdown_connections 2023-07-06T22:01:03.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:03.989+0000 7fdf96398640 1 -- 172.21.15.55:0/3510408984 wait complete. 2023-07-06T22:01:04.010 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:01:04.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1e5093640 1 Processor -- start 2023-07-06T22:01:04.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1e5093640 1 -- start start 2023-07-06T22:01:04.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1e5093640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb1e00b3870 0x7fb1e00b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1e5093640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1e00d03c0 0x7fb1e00d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1e5093640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e00b4210 con 0x7fb1e015b850 2023-07-06T22:01:04.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1e5093640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e00b2b80 con 0x7fb1e00d03c0 2023-07-06T22:01:04.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1e5093640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e00cff30 con 0x7fb1e00b3870 2023-07-06T22:01:04.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1df59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1e00d03c0 0x7fb1e00d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:04.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1df59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1e00d03c0 0x7fb1e00d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57984/0 (socket says 172.21.15.55:57984) 2023-07-06T22:01:04.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1df59e640 1 -- 172.21.15.55:0/1159406930 learned_addr learned my addr 172.21.15.55:0/1159406930 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:04.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1d7fff640 1 --2- 172.21.15.55:0/1159406930 >> v2:172.21.15.138:3300/0 conn(0x7fb1e00b3870 0x7fb1e00b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:04.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1df59e640 1 -- 172.21.15.55:0/1159406930 >> v2:172.21.15.138:3300/0 conn(0x7fb1e00b3870 msgr2=0x7fb1e00b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:04.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1df59e640 1 --2- 172.21.15.55:0/1159406930 >> v2:172.21.15.138:3300/0 conn(0x7fb1e00b3870 0x7fb1e00b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1df59e640 1 -- 172.21.15.55:0/1159406930 >> v1:172.21.15.138:6789/0 conn(0x7fb1e015b850 legacy=0x7fb1e00cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:04.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.157+0000 7fb1df59e640 1 -- 172.21.15.55:0/1159406930 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e00b22e0 con 0x7fb1e00d03c0 2023-07-06T22:01:04.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.161+0000 7fb1df59e640 1 --2- 172.21.15.55:0/1159406930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00d03c0 0x7fb1e00d07c0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00cebd0 tx=0x7fb1d801c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7c2048146a45a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:04.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.161+0000 7fb1de59c640 1 -- 172.21.15.55:0/1159406930 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80a5700 con 0x7fb1e00d03c0 2023-07-06T22:01:04.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.161+0000 7fb1de59c640 1 -- 172.21.15.55:0/1159406930 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d80a5860 con 0x7fb1e00d03c0 2023-07-06T22:01:04.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.161+0000 7fb1de59c640 1 -- 172.21.15.55:0/1159406930 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80a5bf0 con 0x7fb1e00d03c0 2023-07-06T22:01:04.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.161+0000 7fb1e5093640 1 -- 172.21.15.55:0/1159406930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00d03c0 msgr2=0x7fb1e00d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:04.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.161+0000 7fb1e5093640 1 --2- 172.21.15.55:0/1159406930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00d03c0 0x7fb1e00d07c0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00cebd0 tx=0x7fb1d801c840 comp rx=0 tx=0).stop 2023-07-06T22:01:04.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.161+0000 7fb1e5093640 1 -- 172.21.15.55:0/1159406930 shutdown_connections 2023-07-06T22:01:04.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.161+0000 7fb1e5093640 1 --2- 172.21.15.55:0/1159406930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00d03c0 0x7fb1e00d07c0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.161+0000 7fb1e5093640 1 --2- 172.21.15.55:0/1159406930 >> v2:172.21.15.138:3300/0 conn(0x7fb1e00b3870 0x7fb1e00b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.161+0000 7fb1e5093640 1 -- 172.21.15.55:0/1159406930 >> 172.21.15.55:0/1159406930 conn(0x7fb1e00cec20 msgr2=0x7fb1e00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:04.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.161+0000 7fb1e5093640 1 -- 172.21.15.55:0/1159406930 shutdown_connections 2023-07-06T22:01:04.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.161+0000 7fb1e5093640 1 -- 172.21.15.55:0/1159406930 wait complete. 2023-07-06T22:01:04.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1e5093640 1 Processor -- start 2023-07-06T22:01:04.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1e5093640 1 -- start start 2023-07-06T22:01:04.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1e5093640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00b3870 0x7fb1e0153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1e5093640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1e00d03c0 0x7fb1e01589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1e5093640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1e015b850 0x7fb1e0151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1e5093640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e01540c0 con 0x7fb1e00b3870 2023-07-06T22:01:04.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1e5093640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e015a890 con 0x7fb1e00d03c0 2023-07-06T22:01:04.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1e5093640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e015ab70 con 0x7fb1e015b850 2023-07-06T22:01:04.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1ded9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00b3870 0x7fb1e0153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:04.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1ded9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00b3870 0x7fb1e0153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57998/0 (socket says 172.21.15.55:57998) 2023-07-06T22:01:04.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1ded9d640 1 -- 172.21.15.55:0/3454371502 learned_addr learned my addr 172.21.15.55:0/3454371502 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:04.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1d7fff640 1 --2- 172.21.15.55:0/3454371502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1e00d03c0 0x7fb1e01589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:04.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1ded9d640 1 -- 172.21.15.55:0/3454371502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1e015b850 msgr2=0x7fb1e0151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:04.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1ded9d640 1 --2- 172.21.15.55:0/3454371502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1e015b850 0x7fb1e0151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1ded9d640 1 -- 172.21.15.55:0/3454371502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1e00d03c0 msgr2=0x7fb1e01589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:04.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1ded9d640 1 --2- 172.21.15.55:0/3454371502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1e00d03c0 0x7fb1e01589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1ded9d640 1 -- 172.21.15.55:0/3454371502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d8009b30 con 0x7fb1e00b3870 2023-07-06T22:01:04.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1ded9d640 1 --2- 172.21.15.55:0/3454371502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00b3870 0x7fb1e0153b80 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000b410 tx=0x7fb1d000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:04.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1d77fe640 1 -- 172.21.15.55:0/3454371502 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0004020 con 0x7fb1e00b3870 2023-07-06T22:01:04.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1d77fe640 1 -- 172.21.15.55:0/3454371502 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d0004180 con 0x7fb1e00b3870 2023-07-06T22:01:04.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1e5093640 1 -- 172.21.15.55:0/3454371502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e015ae50 con 0x7fb1e00b3870 2023-07-06T22:01:04.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1d77fe640 1 -- 172.21.15.55:0/3454371502 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0011630 con 0x7fb1e00b3870 2023-07-06T22:01:04.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.165+0000 7fb1e5093640 1 -- 172.21.15.55:0/3454371502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e0158f20 con 0x7fb1e00b3870 2023-07-06T22:01:04.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.169+0000 7fb1e5093640 1 -- 172.21.15.55:0/3454371502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e015b090 con 0x7fb1e00b3870 2023-07-06T22:01:04.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.169+0000 7fb1d77fe640 1 -- 172.21.15.55:0/3454371502 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fb1d0011790 con 0x7fb1e00b3870 2023-07-06T22:01:04.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.169+0000 7fb1d77fe640 1 --2- 172.21.15.55:0/3454371502 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fb1c00664c0 0x7fb1c0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.169+0000 7fb1d77fe640 1 -- 172.21.15.55:0/3454371502 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fb1d0084020 con 0x7fb1e00b3870 2023-07-06T22:01:04.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.169+0000 7fb1d7fff640 1 -- 172.21.15.55:0/3454371502 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fb1c00664c0 msgr2=0x7fb1c0068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1146764448 2023-07-06T22:01:04.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.169+0000 7fb1d7fff640 1 --2- 172.21.15.55:0/3454371502 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fb1c00664c0 0x7fb1c0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:04.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.173+0000 7fb1d77fe640 1 -- 172.21.15.55:0/3454371502 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1e015b090 con 0x7fb1e00b3870 2023-07-06T22:01:04.305 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:04.307+0000 7fcb91446180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:01:04.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.329+0000 7fb1e5093640 1 -- 172.21.15.55:0/3454371502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb1e01534c0 con 0x7fb1e00b3870 2023-07-06T22:01:04.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.333+0000 7fb1d77fe640 1 -- 172.21.15.55:0/3454371502 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v132) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb1e01534c0 con 0x7fb1e00b3870 2023-07-06T22:01:04.332 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:01:04.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.333+0000 7fb1e5093640 1 -- 172.21.15.55:0/3454371502 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fb1c00664c0 msgr2=0x7fb1c0068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:04.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.333+0000 7fb1e5093640 1 --2- 172.21.15.55:0/3454371502 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fb1c00664c0 0x7fb1c0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.333+0000 7fb1e5093640 1 -- 172.21.15.55:0/3454371502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00b3870 msgr2=0x7fb1e0153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:04.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.333+0000 7fb1e5093640 1 --2- 172.21.15.55:0/3454371502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00b3870 0x7fb1e0153b80 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000b410 tx=0x7fb1d000b8d0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.333+0000 7fb1e5093640 1 -- 172.21.15.55:0/3454371502 shutdown_connections 2023-07-06T22:01:04.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.333+0000 7fb1e5093640 1 --2- 172.21.15.55:0/3454371502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1e015b850 0x7fb1e0151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.333+0000 7fb1e5093640 1 --2- 172.21.15.55:0/3454371502 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fb1c00664c0 0x7fb1c0068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.333+0000 7fb1e5093640 1 --2- 172.21.15.55:0/3454371502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1e00d03c0 0x7fb1e01589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.333+0000 7fb1e5093640 1 --2- 172.21.15.55:0/3454371502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00b3870 0x7fb1e0153b80 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.333+0000 7fb1e5093640 1 -- 172.21.15.55:0/3454371502 >> 172.21.15.55:0/3454371502 conn(0x7fb1e00cec20 msgr2=0x7fb1e00b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:04.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.333+0000 7fb1e5093640 1 -- 172.21.15.55:0/3454371502 shutdown_connections 2023-07-06T22:01:04.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.333+0000 7fb1e5093640 1 -- 172.21.15.55:0/3454371502 wait complete. 2023-07-06T22:01:04.353 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T22:01:04.363 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:04.363+0000 7fcb91446180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:01:04.398 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:04.397+0000 7f213a432180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:01:04.418 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:04.419+0000 7fcb91446180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:01:04.461 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:04.461+0000 7f213a432180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:01:04.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f876e434640 1 Processor -- start 2023-07-06T22:01:04.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f876e434640 1 -- start start 2023-07-06T22:01:04.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f876e434640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f876815b850 0x7f87680cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f876e434640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87680b3f80 0x7f87680d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f876e434640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87680b2b80 con 0x7f87680ccd30 2023-07-06T22:01:04.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f876e434640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87680cff30 con 0x7f876815b850 2023-07-06T22:01:04.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f876e434640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87680b22e0 con 0x7f87680b3f80 2023-07-06T22:01:04.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f875ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f87680ccd30 0x7f87680b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34302/0 (socket says 172.21.15.55:34302) 2023-07-06T22:01:04.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f875ffff640 1 -- 172.21.15.55:0/2413876061 learned_addr learned my addr 172.21.15.55:0/2413876061 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f876c9d1640 1 --2- 172.21.15.55:0/2413876061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87680b3f80 0x7f87680d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f8767fff640 1 --2- 172.21.15.55:0/2413876061 >> v2:172.21.15.138:3300/0 conn(0x7f876815b850 0x7f87680cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f87677fe640 1 -- 172.21.15.55:0/2413876061 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800896622 0 0) 0x7f87680b2b80 con 0x7f87680ccd30 2023-07-06T22:01:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f87677fe640 1 -- 172.21.15.55:0/2413876061 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8754003530 con 0x7f87680ccd30 2023-07-06T22:01:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f876c9d1640 1 -- 172.21.15.55:0/2413876061 >> v2:172.21.15.138:3300/0 conn(0x7f876815b850 msgr2=0x7f87680cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f876c9d1640 1 --2- 172.21.15.55:0/2413876061 >> v2:172.21.15.138:3300/0 conn(0x7f876815b850 0x7f87680cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f876c9d1640 1 -- 172.21.15.55:0/2413876061 >> v1:172.21.15.55:6789/0 conn(0x7f87680ccd30 legacy=0x7f87680b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f876c9d1640 1 -- 172.21.15.55:0/2413876061 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87680b25c0 con 0x7f87680b3f80 2023-07-06T22:01:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.501+0000 7f8767fff640 1 --2- 172.21.15.55:0/2413876061 >> v2:172.21.15.138:3300/0 conn(0x7f876815b850 0x7f87680cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:04.505 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:04.507+0000 7fcb91446180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:01:04.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.505+0000 7f876c9d1640 1 --2- 172.21.15.55:0/2413876061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87680b3f80 0x7f87680d03c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8760009d90 tx=0x7f876001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab04320894d38c91 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:04.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.505+0000 7f87677fe640 1 -- 172.21.15.55:0/2413876061 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87600a5850 con 0x7f87680b3f80 2023-07-06T22:01:04.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.505+0000 7f87677fe640 1 -- 172.21.15.55:0/2413876061 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87600a59b0 con 0x7f87680b3f80 2023-07-06T22:01:04.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.505+0000 7f87677fe640 1 -- 172.21.15.55:0/2413876061 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87600a5d40 con 0x7f87680b3f80 2023-07-06T22:01:04.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.505+0000 7f876e434640 1 -- 172.21.15.55:0/2413876061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87680b3f80 msgr2=0x7f87680d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.505+0000 7f876e434640 1 --2- 172.21.15.55:0/2413876061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87680b3f80 0x7f87680d03c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8760009d90 tx=0x7f876001c800 comp rx=0 tx=0).stop 2023-07-06T22:01:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.505+0000 7f876e434640 1 -- 172.21.15.55:0/2413876061 shutdown_connections 2023-07-06T22:01:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.505+0000 7f876e434640 1 --2- 172.21.15.55:0/2413876061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87680b3f80 0x7f87680d03c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.505+0000 7f876e434640 1 --2- 172.21.15.55:0/2413876061 >> v2:172.21.15.138:3300/0 conn(0x7f876815b850 0x7f87680cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.505+0000 7f876e434640 1 -- 172.21.15.55:0/2413876061 >> 172.21.15.55:0/2413876061 conn(0x7f87680cec20 msgr2=0x7f87680cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.505+0000 7f876e434640 1 -- 172.21.15.55:0/2413876061 shutdown_connections 2023-07-06T22:01:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f876e434640 1 -- 172.21.15.55:0/2413876061 wait complete. 2023-07-06T22:01:04.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f876e434640 1 Processor -- start 2023-07-06T22:01:04.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f876e434640 1 -- start start 2023-07-06T22:01:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f876e434640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87680b3f80 0x7f87680c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f876e434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87680ccd30 0x7f87680cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f876e434640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f876815b850 0x7f87680b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f876e434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87680b6230 con 0x7f87680ccd30 2023-07-06T22:01:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f876e434640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87680c9900 con 0x7f876815b850 2023-07-06T22:01:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f876e434640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87680c9be0 con 0x7f87680b3f80 2023-07-06T22:01:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f875ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87680ccd30 0x7f87680cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f875ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87680ccd30 0x7f87680cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58004/0 (socket says 172.21.15.55:58004) 2023-07-06T22:01:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f875ffff640 1 -- 172.21.15.55:0/2462447555 learned_addr learned my addr 172.21.15.55:0/2462447555 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:04.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f875ffff640 1 -- 172.21.15.55:0/2462447555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87680b3f80 msgr2=0x7f87680c9270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T22:01:04.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f875ffff640 1 --2- 172.21.15.55:0/2462447555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87680b3f80 0x7f87680c9270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f875ffff640 1 -- 172.21.15.55:0/2462447555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f876815b850 msgr2=0x7f87680b5cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T22:01:04.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f875ffff640 1 --2- 172.21.15.55:0/2462447555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f876815b850 0x7f87680b5cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f875ffff640 1 -- 172.21.15.55:0/2462447555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8758009420 con 0x7f87680ccd30 2023-07-06T22:01:04.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f875ffff640 1 --2- 172.21.15.55:0/2462447555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87680ccd30 0x7f87680cbab0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f875000c4d0 tx=0x7f875000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:04.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f87657fa640 1 -- 172.21.15.55:0/2462447555 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750005cf0 con 0x7f87680ccd30 2023-07-06T22:01:04.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f87657fa640 1 -- 172.21.15.55:0/2462447555 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8750005e50 con 0x7f87680ccd30 2023-07-06T22:01:04.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f87657fa640 1 -- 172.21.15.55:0/2462447555 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750007270 con 0x7f87680ccd30 2023-07-06T22:01:04.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.509+0000 7f876e434640 1 -- 172.21.15.55:0/2462447555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8760009a70 con 0x7f87680ccd30 2023-07-06T22:01:04.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.513+0000 7f876e434640 1 -- 172.21.15.55:0/2462447555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876815bda0 con 0x7f87680ccd30 2023-07-06T22:01:04.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.513+0000 7f876e434640 1 -- 172.21.15.55:0/2462447555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8768066d60 con 0x7f87680ccd30 2023-07-06T22:01:04.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.513+0000 7f87657fa640 1 -- 172.21.15.55:0/2462447555 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f87500073d0 con 0x7f87680ccd30 2023-07-06T22:01:04.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.513+0000 7f87657fa640 1 --2- 172.21.15.55:0/2462447555 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f87480664c0 0x7f8748068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.513+0000 7f8767fff640 1 -- 172.21.15.55:0/2462447555 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f87480664c0 msgr2=0x7f8748068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1146764448 2023-07-06T22:01:04.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.513+0000 7f87657fa640 1 -- 172.21.15.55:0/2462447555 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f8750083a80 con 0x7f87680ccd30 2023-07-06T22:01:04.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.513+0000 7f8767fff640 1 --2- 172.21.15.55:0/2462447555 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f87480664c0 0x7f8748068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.517+0000 7f87657fa640 1 -- 172.21.15.55:0/2462447555 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8750050800 con 0x7f87680ccd30 2023-07-06T22:01:04.522 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:04.521+0000 7f213a432180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:01:04.562 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:04.563+0000 7fcb91446180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:01:04.615 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:04.613+0000 7f213a432180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:01:04.647 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:04.647+0000 7fcb91446180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:01:04.674 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:04.673+0000 7f213a432180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:01:04.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.681+0000 7f876e434640 1 -- 172.21.15.55:0/2462447555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8768160330 con 0x7f87680ccd30 2023-07-06T22:01:04.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.681+0000 7f87657fa640 1 -- 172.21.15.55:0/2462447555 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v132) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8750017020 con 0x7f87680ccd30 2023-07-06T22:01:04.680 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T22:01:04.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.681+0000 7f876e434640 1 -- 172.21.15.55:0/2462447555 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f87480664c0 msgr2=0x7f8748068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:04.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.681+0000 7f876e434640 1 --2- 172.21.15.55:0/2462447555 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f87480664c0 0x7f8748068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.681+0000 7f876e434640 1 -- 172.21.15.55:0/2462447555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87680ccd30 msgr2=0x7f87680cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:04.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.681+0000 7f876e434640 1 --2- 172.21.15.55:0/2462447555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87680ccd30 0x7f87680cbab0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f875000c4d0 tx=0x7f875000c990 comp rx=0 tx=0).stop 2023-07-06T22:01:04.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.681+0000 7f876e434640 1 -- 172.21.15.55:0/2462447555 shutdown_connections 2023-07-06T22:01:04.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.681+0000 7f876e434640 1 --2- 172.21.15.55:0/2462447555 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f87480664c0 0x7f8748068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.681+0000 7f876e434640 1 --2- 172.21.15.55:0/2462447555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f876815b850 0x7f87680b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.681+0000 7f876e434640 1 --2- 172.21.15.55:0/2462447555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87680ccd30 0x7f87680cbab0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.681+0000 7f876e434640 1 --2- 172.21.15.55:0/2462447555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87680b3f80 0x7f87680c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.681+0000 7f876e434640 1 -- 172.21.15.55:0/2462447555 >> 172.21.15.55:0/2462447555 conn(0x7f87680cec20 msgr2=0x7f87680b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:04.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.681+0000 7f876e434640 1 -- 172.21.15.55:0/2462447555 shutdown_connections 2023-07-06T22:01:04.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.681+0000 7f876e434640 1 -- 172.21.15.55:0/2462447555 wait complete. 2023-07-06T22:01:04.702 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T22:01:04.703 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:04.703+0000 7fcb91446180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:01:04.767 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:04.765+0000 7f213a432180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:01:04.828 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:04.829+0000 7f213a432180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:01:04.847 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:04.851+0000 7fcb91446180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:01:04.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.889+0000 7f965b367640 1 Processor -- start 2023-07-06T22:01:04.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.889+0000 7f965b367640 1 -- start start 2023-07-06T22:01:04.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.889+0000 7f965b367640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96540b3870 0x7f96540b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.889+0000 7f965b367640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96540b4210 con 0x7f96540d03c0 2023-07-06T22:01:04.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.889+0000 7f965b367640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96540b2b80 con 0x7f965415b850 2023-07-06T22:01:04.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.889+0000 7f965b367640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96540cff30 con 0x7f96540b3870 2023-07-06T22:01:04.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.889+0000 7f9658902640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96540b3870 0x7f96540b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:04.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.889+0000 7f9659904640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f96540d03c0 0x7f96540d07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34310/0 (socket says 172.21.15.55:34310) 2023-07-06T22:01:04.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.889+0000 7f9659904640 1 -- 172.21.15.55:0/1782987518 learned_addr learned my addr 172.21.15.55:0/1782987518 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:04.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.889+0000 7f9658902640 1 -- 172.21.15.55:0/1782987518 >> v1:172.21.15.138:6789/0 conn(0x7f965415b850 legacy=0x7f96540cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:04.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.889+0000 7f9658902640 1 -- 172.21.15.55:0/1782987518 >> v1:172.21.15.55:6789/0 conn(0x7f96540d03c0 legacy=0x7f96540d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:04.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.889+0000 7f964bfff640 1 -- 172.21.15.55:0/1782987518 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040998815 0 0) 0x7f96540b4210 con 0x7f96540d03c0 2023-07-06T22:01:04.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.889+0000 7f9658902640 1 -- 172.21.15.55:0/1782987518 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96540b22e0 con 0x7f96540b3870 2023-07-06T22:01:04.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.893+0000 7f9658902640 1 --2- 172.21.15.55:0/1782987518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540b3870 0x7f96540b3cd0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f9644009740 tx=0x7f964401bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38abfb646394825 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:04.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.893+0000 7f964bfff640 1 -- 172.21.15.55:0/1782987518 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96440a5620 con 0x7f96540b3870 2023-07-06T22:01:04.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.893+0000 7f964bfff640 1 -- 172.21.15.55:0/1782987518 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96440a5780 con 0x7f96540b3870 2023-07-06T22:01:04.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.893+0000 7f964bfff640 1 -- 172.21.15.55:0/1782987518 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96440a5b10 con 0x7f96540b3870 2023-07-06T22:01:04.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.893+0000 7f965b367640 1 -- 172.21.15.55:0/1782987518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540b3870 msgr2=0x7f96540b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.893+0000 7f965b367640 1 --2- 172.21.15.55:0/1782987518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540b3870 0x7f96540b3cd0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f9644009740 tx=0x7f964401bea0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.893+0000 7f965b367640 1 -- 172.21.15.55:0/1782987518 shutdown_connections 2023-07-06T22:01:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.893+0000 7f965b367640 1 --2- 172.21.15.55:0/1782987518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540b3870 0x7f96540b3cd0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.893+0000 7f965b367640 1 -- 172.21.15.55:0/1782987518 >> 172.21.15.55:0/1782987518 conn(0x7f96540cec20 msgr2=0x7f96540cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.893+0000 7f965b367640 1 -- 172.21.15.55:0/1782987518 shutdown_connections 2023-07-06T22:01:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f965b367640 1 -- 172.21.15.55:0/1782987518 wait complete. 2023-07-06T22:01:04.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f965b367640 1 Processor -- start 2023-07-06T22:01:04.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f965b367640 1 -- start start 2023-07-06T22:01:04.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f965b367640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540b3870 0x7f9654159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f965b367640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96540d03c0 0x7f965414d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f965b367640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f965415b850 0x7f96540b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f965b367640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96541599a0 con 0x7f96540b3870 2023-07-06T22:01:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f965b367640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96541590d0 con 0x7f96540d03c0 2023-07-06T22:01:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f965b367640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96540b6780 con 0x7f965415b850 2023-07-06T22:01:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f9659103640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540b3870 0x7f9654159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f9659103640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540b3870 0x7f9654159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58026/0 (socket says 172.21.15.55:58026) 2023-07-06T22:01:04.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f9659103640 1 -- 172.21.15.55:0/3118273788 learned_addr learned my addr 172.21.15.55:0/3118273788 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:04.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f9658902640 1 --2- 172.21.15.55:0/3118273788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96540d03c0 0x7f965414d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:04.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f9659904640 1 --2- 172.21.15.55:0/3118273788 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f965415b850 0x7f96540b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:04.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f9659103640 1 -- 172.21.15.55:0/3118273788 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f965415b850 msgr2=0x7f96540b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:04.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f9659103640 1 --2- 172.21.15.55:0/3118273788 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f965415b850 0x7f96540b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f9659103640 1 -- 172.21.15.55:0/3118273788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96540d03c0 msgr2=0x7f965414d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:04.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f9659103640 1 --2- 172.21.15.55:0/3118273788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96540d03c0 0x7f965414d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:04.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f9659103640 1 -- 172.21.15.55:0/3118273788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9644009420 con 0x7f96540b3870 2023-07-06T22:01:04.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f9658902640 1 --2- 172.21.15.55:0/3118273788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96540d03c0 0x7f965414d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.897+0000 7f9659103640 1 --2- 172.21.15.55:0/3118273788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540b3870 0x7f9654159dc0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f965000c750 tx=0x7f965000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.901+0000 7f9649ffb640 1 -- 172.21.15.55:0/3118273788 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9650005280 con 0x7f96540b3870 2023-07-06T22:01:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.901+0000 7f9649ffb640 1 -- 172.21.15.55:0/3118273788 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96500053e0 con 0x7f96540b3870 2023-07-06T22:01:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.901+0000 7f9649ffb640 1 -- 172.21.15.55:0/3118273788 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965000a880 con 0x7f96540b3870 2023-07-06T22:01:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.901+0000 7f965b367640 1 -- 172.21.15.55:0/3118273788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965415bda0 con 0x7f96540b3870 2023-07-06T22:01:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.901+0000 7f965b367640 1 -- 172.21.15.55:0/3118273788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96541592e0 con 0x7f96540b3870 2023-07-06T22:01:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.901+0000 7f965b367640 1 -- 172.21.15.55:0/3118273788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9654066d60 con 0x7f96540b3870 2023-07-06T22:01:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.901+0000 7f9649ffb640 1 -- 172.21.15.55:0/3118273788 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f965000a9e0 con 0x7f96540b3870 2023-07-06T22:01:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.901+0000 7f9649ffb640 1 --2- 172.21.15.55:0/3118273788 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f96380664c0 0x7f9638068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.901+0000 7f9649ffb640 1 -- 172.21.15.55:0/3118273788 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f9650083b10 con 0x7f96540b3870 2023-07-06T22:01:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.901+0000 7f9658902640 1 -- 172.21.15.55:0/3118273788 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f96380664c0 msgr2=0x7f9638068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1146764448 2023-07-06T22:01:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.901+0000 7f9658902640 1 --2- 172.21.15.55:0/3118273788 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f96380664c0 0x7f9638068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:04.905 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:04.907+0000 7fcb91446180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:01:04.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:04.905+0000 7f9649ffb640 1 -- 172.21.15.55:0/3118273788 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9650050a30 con 0x7f96540b3870 2023-07-06T22:01:04.980 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:04.981+0000 7f213a432180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:01:05.042 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:05.041+0000 7f213a432180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:01:05.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.061+0000 7f965b367640 1 -- 172.21.15.55:0/3118273788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9654153ac0 con 0x7f96540b3870 2023-07-06T22:01:05.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.065+0000 7f9649ffb640 1 -- 172.21.15.55:0/3118273788 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96500170a0 con 0x7f96540b3870 2023-07-06T22:01:05.064 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T22:01:05.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.065+0000 7f965b367640 1 -- 172.21.15.55:0/3118273788 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f96380664c0 msgr2=0x7f9638068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:05.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.065+0000 7f965b367640 1 --2- 172.21.15.55:0/3118273788 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f96380664c0 0x7f9638068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.065+0000 7f965b367640 1 -- 172.21.15.55:0/3118273788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540b3870 msgr2=0x7f9654159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:05.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.065+0000 7f965b367640 1 --2- 172.21.15.55:0/3118273788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540b3870 0x7f9654159dc0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f965000c750 tx=0x7f965000cc10 comp rx=0 tx=0).stop 2023-07-06T22:01:05.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.065+0000 7f965b367640 1 -- 172.21.15.55:0/3118273788 shutdown_connections 2023-07-06T22:01:05.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.065+0000 7f965b367640 1 --2- 172.21.15.55:0/3118273788 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f965415b850 0x7f96540b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.065+0000 7f965b367640 1 --2- 172.21.15.55:0/3118273788 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f96380664c0 0x7f9638068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.065+0000 7f965b367640 1 --2- 172.21.15.55:0/3118273788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96540d03c0 0x7f965414d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.065+0000 7f965b367640 1 --2- 172.21.15.55:0/3118273788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96540b3870 0x7f9654159dc0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.065+0000 7f965b367640 1 -- 172.21.15.55:0/3118273788 >> 172.21.15.55:0/3118273788 conn(0x7f96540cec20 msgr2=0x7f96540b7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:05.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.065+0000 7f965b367640 1 -- 172.21.15.55:0/3118273788 shutdown_connections 2023-07-06T22:01:05.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.065+0000 7f965b367640 1 -- 172.21.15.55:0/3118273788 wait complete. 2023-07-06T22:01:05.085 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T22:01:05.149 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:01:05.149 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:01:05.150 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:01:05.158 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:05.159+0000 7fcb91446180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:01:05.291 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:05.291+0000 7fcb91446180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:01:05.300 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:01:05.300 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:01:05.301 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:01:05.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.305+0000 7fd328e0b640 1 Processor -- start 2023-07-06T22:01:05.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.305+0000 7fd328e0b640 1 -- start start 2023-07-06T22:01:05.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.305+0000 7fd328e0b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd3240b7b90 0x7fd3240d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:05.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.305+0000 7fd328e0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3240cc870 0x7fd3240b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:05.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.305+0000 7fd328e0b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3240b4130 0x7fd3240d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:05.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.305+0000 7fd328e0b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3240b45b0 con 0x7fd3240b4130 2023-07-06T22:01:05.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.305+0000 7fd328e0b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3240b5070 con 0x7fd3240b7b90 2023-07-06T22:01:05.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.305+0000 7fd328e0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd324160020 con 0x7fd3240cc870 2023-07-06T22:01:05.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.309+0000 7fd322d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3240b4130 0x7fd3240d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:05.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.309+0000 7fd31bfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3240cc870 0x7fd3240b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:05.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.309+0000 7fd32259c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd3240b7b90 0x7fd3240d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:05.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.309+0000 7fd322d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3240b4130 0x7fd3240d0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58028/0 (socket says 172.21.15.55:58028) 2023-07-06T22:01:05.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.309+0000 7fd31bfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3240cc870 0x7fd3240b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:54228/0 (socket says 172.21.15.55:54228) 2023-07-06T22:01:05.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.309+0000 7fd322d9d640 1 -- 172.21.15.55:0/3866534526 learned_addr learned my addr 172.21.15.55:0/3866534526 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:05.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.309+0000 7fd322d9d640 1 -- 172.21.15.55:0/3866534526 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3240cc870 msgr2=0x7fd3240b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:05.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.309+0000 7fd322d9d640 1 --2- 172.21.15.55:0/3866534526 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3240cc870 0x7fd3240b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.309+0000 7fd322d9d640 1 -- 172.21.15.55:0/3866534526 >> v2:172.21.15.138:3300/0 conn(0x7fd3240b7b90 msgr2=0x7fd3240d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:05.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.309+0000 7fd322d9d640 1 --2- 172.21.15.55:0/3866534526 >> v2:172.21.15.138:3300/0 conn(0x7fd3240b7b90 0x7fd3240d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.309+0000 7fd322d9d640 1 -- 172.21.15.55:0/3866534526 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3241604b0 con 0x7fd3240b4130 2023-07-06T22:01:05.311 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:05.309+0000 7f213a432180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:01:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.313+0000 7fd322d9d640 1 --2- 172.21.15.55:0/3866534526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3240b4130 0x7fd3240d0120 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fd3240b2e80 tx=0x7fd31c01c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362ec78799a0be8b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:05.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.313+0000 7fd321d9b640 1 -- 172.21.15.55:0/3866534526 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c0a5570 con 0x7fd3240b4130 2023-07-06T22:01:05.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.313+0000 7fd321d9b640 1 -- 172.21.15.55:0/3866534526 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c0a56d0 con 0x7fd3240b4130 2023-07-06T22:01:05.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.313+0000 7fd321d9b640 1 -- 172.21.15.55:0/3866534526 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c0a5a60 con 0x7fd3240b4130 2023-07-06T22:01:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.313+0000 7fd328e0b640 1 -- 172.21.15.55:0/3866534526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3240b4130 msgr2=0x7fd3240d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.313+0000 7fd328e0b640 1 --2- 172.21.15.55:0/3866534526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3240b4130 0x7fd3240d0120 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fd3240b2e80 tx=0x7fd31c01c6f0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.313+0000 7fd328e0b640 1 -- 172.21.15.55:0/3866534526 shutdown_connections 2023-07-06T22:01:05.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.313+0000 7fd328e0b640 1 --2- 172.21.15.55:0/3866534526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3240b4130 0x7fd3240d0120 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.313+0000 7fd328e0b640 1 --2- 172.21.15.55:0/3866534526 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3240cc870 0x7fd3240b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.313+0000 7fd328e0b640 1 --2- 172.21.15.55:0/3866534526 >> v2:172.21.15.138:3300/0 conn(0x7fd3240b7b90 0x7fd3240d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.313+0000 7fd328e0b640 1 -- 172.21.15.55:0/3866534526 >> 172.21.15.55:0/3866534526 conn(0x7fd3240ceca0 msgr2=0x7fd3240cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:05.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.313+0000 7fd328e0b640 1 -- 172.21.15.55:0/3866534526 shutdown_connections 2023-07-06T22:01:05.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.313+0000 7fd328e0b640 1 -- 172.21.15.55:0/3866534526 wait complete. 2023-07-06T22:01:05.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd328e0b640 1 Processor -- start 2023-07-06T22:01:05.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd328e0b640 1 -- start start 2023-07-06T22:01:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd328e0b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3240b4130 0x7fd324155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd328e0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3240b7b90 0x7fd3240c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:05.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd328e0b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3240cc870 0x7fd324159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd328e0b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324143210 con 0x7fd3240b4130 2023-07-06T22:01:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd328e0b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324154440 con 0x7fd3240cc870 2023-07-06T22:01:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd328e0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd324154720 con 0x7fd3240b7b90 2023-07-06T22:01:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd32259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3240b4130 0x7fd324155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd32259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3240b4130 0x7fd324155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58030/0 (socket says 172.21.15.55:58030) 2023-07-06T22:01:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd32259c640 1 -- 172.21.15.55:0/2735956003 learned_addr learned my addr 172.21.15.55:0/2735956003 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:05.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd31bfff640 1 --2- 172.21.15.55:0/2735956003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3240b7b90 0x7fd3240c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:05.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd322d9d640 1 --2- 172.21.15.55:0/2735956003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3240cc870 0x7fd324159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:05.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd32259c640 1 -- 172.21.15.55:0/2735956003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3240b7b90 msgr2=0x7fd3240c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:05.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd32259c640 1 --2- 172.21.15.55:0/2735956003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3240b7b90 0x7fd3240c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd32259c640 1 -- 172.21.15.55:0/2735956003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3240cc870 msgr2=0x7fd324159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:05.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd32259c640 1 --2- 172.21.15.55:0/2735956003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3240cc870 0x7fd324159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd32259c640 1 -- 172.21.15.55:0/2735956003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c009b30 con 0x7fd3240b4130 2023-07-06T22:01:05.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd32259c640 1 --2- 172.21.15.55:0/2735956003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3240b4130 0x7fd324155200 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fd31400e930 tx=0x7fd31400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:05.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd31affd640 1 -- 172.21.15.55:0/2735956003 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314009690 con 0x7fd3240b4130 2023-07-06T22:01:05.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd31affd640 1 -- 172.21.15.55:0/2735956003 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31400ca00 con 0x7fd3240b4130 2023-07-06T22:01:05.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd31affd640 1 -- 172.21.15.55:0/2735956003 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31400cd70 con 0x7fd3240b4130 2023-07-06T22:01:05.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd328e0b640 1 -- 172.21.15.55:0/2735956003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd324154a00 con 0x7fd3240b4130 2023-07-06T22:01:05.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.317+0000 7fd328e0b640 1 -- 172.21.15.55:0/2735956003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3240c8c10 con 0x7fd3240b4130 2023-07-06T22:01:05.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.321+0000 7fd328e0b640 1 -- 172.21.15.55:0/2735956003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd324066d60 con 0x7fd3240b4130 2023-07-06T22:01:05.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.321+0000 7fd31affd640 1 -- 172.21.15.55:0/2735956003 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fd314013470 con 0x7fd3240b4130 2023-07-06T22:01:05.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.321+0000 7fd31affd640 1 --2- 172.21.15.55:0/2735956003 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fd3040664f0 0x7fd3040689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:05.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.321+0000 7fd31affd640 1 -- 172.21.15.55:0/2735956003 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6726+0+0 (secure 0 0 0) 0x7fd314084680 con 0x7fd3240b4130 2023-07-06T22:01:05.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.321+0000 7fd31bfff640 1 -- 172.21.15.55:0/2735956003 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fd3040664f0 msgr2=0x7fd3040689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1146764448 2023-07-06T22:01:05.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.321+0000 7fd31bfff640 1 --2- 172.21.15.55:0/2735956003 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fd3040664f0 0x7fd3040689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:05.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.325+0000 7fd31affd640 1 -- 172.21.15.55:0/2735956003 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd3140515d0 con 0x7fd3240b4130 2023-07-06T22:01:05.416 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:05.419+0000 7fcb91446180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:01:05.455 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:05.453+0000 7f213a432180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:01:05.486 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:05.487+0000 7fcb91446180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:01:05.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.493+0000 7fd328e0b640 1 -- 172.21.15.55:0/2735956003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd32415f9a0 con 0x7fd3240b4130 2023-07-06T22:01:05.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.493+0000 7fd31affd640 1 -- 172.21.15.55:0/2735956003 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v132) v1 ==== 80+0+469 (secure 0 0 0) 0x7fd314054bf0 con 0x7fd3240b4130 2023-07-06T22:01:05.494 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1438757296 2023-07-07T22:00:35.993679+0000 2023-07-06T22:01:05.494 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3754412972 2023-07-07T22:00:35.993679+0000 2023-07-06T22:01:05.494 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1384648608 2023-07-07T22:00:35.993679+0000 2023-07-06T22:01:05.494 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2671638221 2023-07-07T22:00:35.993679+0000 2023-07-06T22:01:05.495 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/604485969 2023-07-07T22:00:35.993679+0000 2023-07-06T22:01:05.495 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2811517165 2023-07-07T22:00:35.993679+0000 2023-07-06T22:01:05.495 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/3817107512 2023-07-07T22:00:35.993679+0000 2023-07-06T22:01:05.495 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/3817107512 2023-07-07T22:00:35.993679+0000 2023-07-06T22:01:05.496 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-07-06T22:01:05.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.497+0000 7fd328e0b640 1 -- 172.21.15.55:0/2735956003 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fd3040664f0 msgr2=0x7fd3040689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:05.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.497+0000 7fd328e0b640 1 --2- 172.21.15.55:0/2735956003 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fd3040664f0 0x7fd3040689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.497+0000 7fd328e0b640 1 -- 172.21.15.55:0/2735956003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3240b4130 msgr2=0x7fd324155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:05.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.497+0000 7fd328e0b640 1 --2- 172.21.15.55:0/2735956003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3240b4130 0x7fd324155200 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fd31400e930 tx=0x7fd31400edf0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.497+0000 7fd328e0b640 1 -- 172.21.15.55:0/2735956003 shutdown_connections 2023-07-06T22:01:05.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.497+0000 7fd328e0b640 1 --2- 172.21.15.55:0/2735956003 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7fd3040664f0 0x7fd3040689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.497+0000 7fd328e0b640 1 --2- 172.21.15.55:0/2735956003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3240cc870 0x7fd324159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.497+0000 7fd328e0b640 1 --2- 172.21.15.55:0/2735956003 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3240b7b90 0x7fd3240c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.497+0000 7fd328e0b640 1 --2- 172.21.15.55:0/2735956003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3240b4130 0x7fd324155200 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.497+0000 7fd328e0b640 1 -- 172.21.15.55:0/2735956003 >> 172.21.15.55:0/2735956003 conn(0x7fd3240ceca0 msgr2=0x7fd3240b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:05.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.497+0000 7fd328e0b640 1 -- 172.21.15.55:0/2735956003 shutdown_connections 2023-07-06T22:01:05.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.497+0000 7fd328e0b640 1 -- 172.21.15.55:0/2735956003 wait complete. 2023-07-06T22:01:05.515 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T22:01:05.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:05.516 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-06T22:01:05.588 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T22:01:05.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:05.589 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T22:01:05.592 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:05.589+0000 7f213a432180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:01:05.598 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:01:05.598 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:05.607 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:01:05.607 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:01:05.608 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:05.636 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:05.639+0000 7fcb91446180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:01:05.647 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:01:05.648 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:01:05.648 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:05.656 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:01:05.657 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:01:05.666 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:05.665+0000 7f213a432180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:01:05.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.809+0000 7f8026493640 1 Processor -- start 2023-07-06T22:01:05.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.809+0000 7f8026493640 1 -- start start 2023-07-06T22:01:05.810 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:05.809+0000 7f213a432180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:01:05.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.809+0000 7f8026493640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200ce610 0x7f80200b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:05.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.809+0000 7f8026493640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80200b2290 con 0x7f80200b7cd0 2023-07-06T22:01:05.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.809+0000 7f8026493640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80200cd1c0 con 0x7f80200b1e10 2023-07-06T22:01:05.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.809+0000 7f8026493640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80200d2310 con 0x7f80200ce610 2023-07-06T22:01:05.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.813+0000 7f801ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f80200b7cd0 0x7f80200ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34316/0 (socket says 172.21.15.55:34316) 2023-07-06T22:01:05.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.813+0000 7f801ffff640 1 -- 172.21.15.55:0/1027283297 learned_addr learned my addr 172.21.15.55:0/1027283297 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:05.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.813+0000 7f801f7fe640 1 --2- 172.21.15.55:0/1027283297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200ce610 0x7f80200b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:05.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.813+0000 7f801f7fe640 1 -- 172.21.15.55:0/1027283297 >> v1:172.21.15.138:6789/0 conn(0x7f80200b1e10 legacy=0x7f802015f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:05.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.813+0000 7f801f7fe640 1 -- 172.21.15.55:0/1027283297 >> v1:172.21.15.55:6789/0 conn(0x7f80200b7cd0 legacy=0x7f80200ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:05.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.813+0000 7f801effd640 1 -- 172.21.15.55:0/1027283297 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469397585 0 0) 0x7f80200b2290 con 0x7f80200b7cd0 2023-07-06T22:01:05.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.813+0000 7f801f7fe640 1 -- 172.21.15.55:0/1027283297 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80200cecf0 con 0x7f80200ce610 2023-07-06T22:01:05.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.813+0000 7f801f7fe640 1 --2- 172.21.15.55:0/1027283297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200ce610 0x7f80200b18d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f80140097f0 tx=0x7f801401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47297a03cb6e5f1a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:05.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.813+0000 7f801effd640 1 -- 172.21.15.55:0/1027283297 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80140ab600 con 0x7f80200ce610 2023-07-06T22:01:05.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.813+0000 7f801effd640 1 -- 172.21.15.55:0/1027283297 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80140a7050 con 0x7f80200ce610 2023-07-06T22:01:05.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.813+0000 7f801effd640 1 -- 172.21.15.55:0/1027283297 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80140ab980 con 0x7f80200ce610 2023-07-06T22:01:05.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 -- 172.21.15.55:0/1027283297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200ce610 msgr2=0x7f80200b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:05.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 --2- 172.21.15.55:0/1027283297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200ce610 0x7f80200b18d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f80140097f0 tx=0x7f801401c430 comp rx=0 tx=0).stop 2023-07-06T22:01:05.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 -- 172.21.15.55:0/1027283297 shutdown_connections 2023-07-06T22:01:05.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 --2- 172.21.15.55:0/1027283297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200ce610 0x7f80200b18d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 -- 172.21.15.55:0/1027283297 >> 172.21.15.55:0/1027283297 conn(0x7f80200ceee0 msgr2=0x7f80200cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:05.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 -- 172.21.15.55:0/1027283297 shutdown_connections 2023-07-06T22:01:05.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 -- 172.21.15.55:0/1027283297 wait complete. 2023-07-06T22:01:05.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 Processor -- start 2023-07-06T22:01:05.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 -- start start 2023-07-06T22:01:05.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200b1e10 0x7f802014a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:05.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200b7cd0 0x7f80200cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:05.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80200ce610 0x7f80200cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80201538e0 con 0x7f80200b1e10 2023-07-06T22:01:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802015c480 con 0x7f80200ce610 2023-07-06T22:01:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8026493640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80200c85c0 con 0x7f80200b7cd0 2023-07-06T22:01:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f801ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200b1e10 0x7f802014a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f801f7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200b7cd0 0x7f80200cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f801ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200b1e10 0x7f802014a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58040/0 (socket says 172.21.15.55:58040) 2023-07-06T22:01:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f801ffff640 1 -- 172.21.15.55:0/2557323149 learned_addr learned my addr 172.21.15.55:0/2557323149 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:05.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.817+0000 7f8024a30640 1 --2- 172.21.15.55:0/2557323149 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80200ce610 0x7f80200cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:05.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f801ffff640 1 -- 172.21.15.55:0/2557323149 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200b7cd0 msgr2=0x7f80200cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:05.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f801ffff640 1 --2- 172.21.15.55:0/2557323149 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200b7cd0 0x7f80200cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f801ffff640 1 -- 172.21.15.55:0/2557323149 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80200ce610 msgr2=0x7f80200cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:05.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f801ffff640 1 --2- 172.21.15.55:0/2557323149 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80200ce610 0x7f80200cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:05.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f801ffff640 1 -- 172.21.15.55:0/2557323149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8014009420 con 0x7f80200b1e10 2023-07-06T22:01:05.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f801ffff640 1 --2- 172.21.15.55:0/2557323149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200b1e10 0x7f802014a800 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f801000c4d0 tx=0x7f801000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:05.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f801cff9640 1 -- 172.21.15.55:0/2557323149 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80100074e0 con 0x7f80200b1e10 2023-07-06T22:01:05.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f801cff9640 1 -- 172.21.15.55:0/2557323149 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8010007640 con 0x7f80200b1e10 2023-07-06T22:01:05.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f8026493640 1 -- 172.21.15.55:0/2557323149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80200c88a0 con 0x7f80200b1e10 2023-07-06T22:01:05.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f801cff9640 1 -- 172.21.15.55:0/2557323149 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010004a30 con 0x7f80200b1e10 2023-07-06T22:01:05.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f8026493640 1 -- 172.21.15.55:0/2557323149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80200c8e60 con 0x7f80200b1e10 2023-07-06T22:01:05.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f8026493640 1 -- 172.21.15.55:0/2557323149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8020066d60 con 0x7f80200b1e10 2023-07-06T22:01:05.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f801cff9640 1 -- 172.21.15.55:0/2557323149 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f8010004b90 con 0x7f80200b1e10 2023-07-06T22:01:05.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f801cff9640 1 --2- 172.21.15.55:0/2557323149 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f800c0664c0 0x7f800c068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:05.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f801cff9640 1 -- 172.21.15.55:0/2557323149 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f8010083880 con 0x7f80200b1e10 2023-07-06T22:01:05.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f801f7fe640 1 -- 172.21.15.55:0/2557323149 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f800c0664c0 msgr2=0x7f800c068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1146764448 2023-07-06T22:01:05.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.821+0000 7f801f7fe640 1 --2- 172.21.15.55:0/2557323149 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f800c0664c0 0x7f800c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:05.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:05.825+0000 7f801cff9640 1 -- 172.21.15.55:0/2557323149 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f80100507a0 con 0x7f80200b1e10 2023-07-06T22:01:06.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.013+0000 7f8026493640 1 -- 172.21.15.55:0/2557323149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80200b2e80 con 0x7f80200b1e10 2023-07-06T22:01:06.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.017+0000 7f801cff9640 1 -- 172.21.15.55:0/2557323149 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f8010053dc0 con 0x7f80200b1e10 2023-07-06T22:01:06.016 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:06.016 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/567276052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":567276052},{"type":"v1","addr":"172.21.15.138:6834","nonce":567276052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2227115466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2227115466},{"type":"v1","addr":"172.21.15.138:6835","nonce":2227115466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2611738616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2611738616},{"type":"v1","addr":"172.21.15.55:6836","nonce":2611738616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:00:19.496559+0000","modified":"2023-07-06T22:00:22.517164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8622":{"gid":8622,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1836658324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1836658324},{"type":"v1","addr":"172.21.15.55:6837","nonce":1836658324}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-06T22:01:06.017 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 54 2023-07-06T22:01:06.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.017+0000 7f8026493640 1 -- 172.21.15.55:0/2557323149 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f800c0664c0 msgr2=0x7f800c068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:06.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.017+0000 7f8026493640 1 --2- 172.21.15.55:0/2557323149 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f800c0664c0 0x7f800c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.017+0000 7f8026493640 1 -- 172.21.15.55:0/2557323149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200b1e10 msgr2=0x7f802014a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.017+0000 7f8026493640 1 --2- 172.21.15.55:0/2557323149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200b1e10 0x7f802014a800 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f801000c4d0 tx=0x7f801000c990 comp rx=0 tx=0).stop 2023-07-06T22:01:06.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.017+0000 7f8026493640 1 -- 172.21.15.55:0/2557323149 shutdown_connections 2023-07-06T22:01:06.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.017+0000 7f8026493640 1 --2- 172.21.15.55:0/2557323149 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f800c0664c0 0x7f800c068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.017+0000 7f8026493640 1 --2- 172.21.15.55:0/2557323149 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80200ce610 0x7f80200cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.017+0000 7f8026493640 1 --2- 172.21.15.55:0/2557323149 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f80200b7cd0 0x7f80200cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.017+0000 7f8026493640 1 --2- 172.21.15.55:0/2557323149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80200b1e10 0x7f802014a800 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.017+0000 7f8026493640 1 -- 172.21.15.55:0/2557323149 >> 172.21.15.55:0/2557323149 conn(0x7f80200ceee0 msgr2=0x7f80200d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:06.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.017+0000 7f8026493640 1 -- 172.21.15.55:0/2557323149 shutdown_connections 2023-07-06T22:01:06.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.017+0000 7f8026493640 1 -- 172.21.15.55:0/2557323149 wait complete. 2023-07-06T22:01:06.038 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:01:06.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f694759e640 1 Processor -- start 2023-07-06T22:01:06.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f694759e640 1 -- start start 2023-07-06T22:01:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f694759e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6948150b10 0x7f69480693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f694759e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6948071240 con 0x7f6948070490 2023-07-06T22:01:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f694759e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694815a770 con 0x7f69480c9b40 2023-07-06T22:01:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f694759e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694815aa50 con 0x7f6948150b10 2023-07-06T22:01:06.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f693ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6948070490 0x7f6948159ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34322/0 (socket says 172.21.15.55:34322) 2023-07-06T22:01:06.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f693ffff640 1 -- 172.21.15.55:0/4140164873 learned_addr learned my addr 172.21.15.55:0/4140164873 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:06.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f694659c640 1 --2- 172.21.15.55:0/4140164873 >> v2:172.21.15.138:3300/0 conn(0x7f6948150b10 0x7f69480693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:06.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f6945d9b640 1 -- 172.21.15.55:0/4140164873 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547362227 0 0) 0x7f6948071240 con 0x7f6948070490 2023-07-06T22:01:06.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f6945d9b640 1 -- 172.21.15.55:0/4140164873 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6934003530 con 0x7f6948070490 2023-07-06T22:01:06.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f6945d9b640 1 -- 172.21.15.55:0/4140164873 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321637539 0 0) 0x7f694815a770 con 0x7f69480c9b40 2023-07-06T22:01:06.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f6945d9b640 1 -- 172.21.15.55:0/4140164873 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6948071240 con 0x7f69480c9b40 2023-07-06T22:01:06.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f694659c640 1 -- 172.21.15.55:0/4140164873 >> v1:172.21.15.138:6789/0 conn(0x7f69480c9b40 legacy=0x7f69480c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f694659c640 1 -- 172.21.15.55:0/4140164873 >> v1:172.21.15.55:6789/0 conn(0x7f6948070490 legacy=0x7f6948159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.185+0000 7f694659c640 1 -- 172.21.15.55:0/4140164873 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69480c83c0 con 0x7f6948150b10 2023-07-06T22:01:06.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.189+0000 7f694659c640 1 --2- 172.21.15.55:0/4140164873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6948150b10 0x7f69480693f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f69380097c0 tx=0x7f693801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=650611914ebff6c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:06.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.189+0000 7f6945d9b640 1 -- 172.21.15.55:0/4140164873 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69380a8050 con 0x7f6948150b10 2023-07-06T22:01:06.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.189+0000 7f6945d9b640 1 -- 172.21.15.55:0/4140164873 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69380ac5f0 con 0x7f6948150b10 2023-07-06T22:01:06.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.189+0000 7f6945d9b640 1 -- 172.21.15.55:0/4140164873 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69380ac980 con 0x7f6948150b10 2023-07-06T22:01:06.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.189+0000 7f694759e640 1 -- 172.21.15.55:0/4140164873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6948150b10 msgr2=0x7f69480693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.189+0000 7f694759e640 1 --2- 172.21.15.55:0/4140164873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6948150b10 0x7f69480693f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f69380097c0 tx=0x7f693801c480 comp rx=0 tx=0).stop 2023-07-06T22:01:06.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.189+0000 7f694759e640 1 -- 172.21.15.55:0/4140164873 shutdown_connections 2023-07-06T22:01:06.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.189+0000 7f694759e640 1 --2- 172.21.15.55:0/4140164873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6948150b10 0x7f69480693f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.189+0000 7f694759e640 1 -- 172.21.15.55:0/4140164873 >> 172.21.15.55:0/4140164873 conn(0x7f69480cdcd0 msgr2=0x7f69480ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:06.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.189+0000 7f694759e640 1 -- 172.21.15.55:0/4140164873 shutdown_connections 2023-07-06T22:01:06.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.189+0000 7f694759e640 1 -- 172.21.15.55:0/4140164873 wait complete. 2023-07-06T22:01:06.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f694759e640 1 Processor -- start 2023-07-06T22:01:06.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f694759e640 1 -- start start 2023-07-06T22:01:06.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f694759e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6948070490 0x7f69480c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f694759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69480c9b40 0x7f69480c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f694759e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6948150b10 0x7f694806b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f694759e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69480b3b70 con 0x7f69480c9b40 2023-07-06T22:01:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f694759e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69480b2ca0 con 0x7f6948150b10 2023-07-06T22:01:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f694759e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69480b2ef0 con 0x7f6948070490 2023-07-06T22:01:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f693ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69480c9b40 0x7f69480c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f693ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69480c9b40 0x7f69480c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58054/0 (socket says 172.21.15.55:58054) 2023-07-06T22:01:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f693ffff640 1 -- 172.21.15.55:0/1477566424 learned_addr learned my addr 172.21.15.55:0/1477566424 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f694659c640 1 --2- 172.21.15.55:0/1477566424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6948070490 0x7f69480c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:06.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f6946d9d640 1 --2- 172.21.15.55:0/1477566424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6948150b10 0x7f694806b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:06.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f693ffff640 1 -- 172.21.15.55:0/1477566424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6948070490 msgr2=0x7f69480c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f693ffff640 1 --2- 172.21.15.55:0/1477566424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6948070490 0x7f69480c31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f693ffff640 1 -- 172.21.15.55:0/1477566424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6948150b10 msgr2=0x7f694806b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f693ffff640 1 --2- 172.21.15.55:0/1477566424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6948150b10 0x7f694806b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f693ffff640 1 -- 172.21.15.55:0/1477566424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6938009420 con 0x7f69480c9b40 2023-07-06T22:01:06.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f693ffff640 1 --2- 172.21.15.55:0/1477566424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69480c9b40 0x7f69480c39e0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f693000c420 tx=0x7f693000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f693effd640 1 -- 172.21.15.55:0/1477566424 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930005cf0 con 0x7f69480c9b40 2023-07-06T22:01:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f693effd640 1 -- 172.21.15.55:0/1477566424 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6930005e70 con 0x7f69480c9b40 2023-07-06T22:01:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f693effd640 1 -- 172.21.15.55:0/1477566424 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69300072d0 con 0x7f69480c9b40 2023-07-06T22:01:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f694759e640 1 -- 172.21.15.55:0/1477566424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69480b31d0 con 0x7f69480c9b40 2023-07-06T22:01:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.193+0000 7f694759e640 1 -- 172.21.15.55:0/1477566424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69480b3790 con 0x7f69480c9b40 2023-07-06T22:01:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.197+0000 7f694759e640 1 -- 172.21.15.55:0/1477566424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694814cca0 con 0x7f69480c9b40 2023-07-06T22:01:06.198 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:06.199+0000 7fcb91446180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:01:06.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.197+0000 7f693effd640 1 -- 172.21.15.55:0/1477566424 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f6930007430 con 0x7f69480c9b40 2023-07-06T22:01:06.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.197+0000 7f693effd640 1 --2- 172.21.15.55:0/1477566424 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f69280664c0 0x7f6928068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.197+0000 7f693effd640 1 -- 172.21.15.55:0/1477566424 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6726+0+0 (secure 0 0 0) 0x7f6930083a30 con 0x7f69480c9b40 2023-07-06T22:01:06.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.197+0000 7f694659c640 1 -- 172.21.15.55:0/1477566424 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f69280664c0 msgr2=0x7f6928068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1146764448 2023-07-06T22:01:06.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.197+0000 7f694659c640 1 --2- 172.21.15.55:0/1477566424 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f69280664c0 0x7f6928068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:06.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.201+0000 7f693effd640 1 -- 172.21.15.55:0/1477566424 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f694814cca0 con 0x7f69480c9b40 2023-07-06T22:01:06.282 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:06.283+0000 7fcb91446180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:01:06.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.357+0000 7f694759e640 1 -- 172.21.15.55:0/1477566424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f694814cca0 con 0x7f69480c9b40 2023-07-06T22:01:06.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.361+0000 7f693effd640 1 -- 172.21.15.55:0/1477566424 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+19002 (secure 0 0 0) 0x7f694814cca0 con 0x7f69480c9b40 2023-07-06T22:01:06.360 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:06.360 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":132,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:00:35.993710+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:00:17.410451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-07-06T22:00:18.487297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/1438757296":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/3754412972":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/1384648608":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/2671638221":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/604485969":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/2811517165":"2023-07-07T22:00:35.993679+0000","172.21.15.55:6833/3817107512":"2023-07-07T22:00:35.993679+0000","172.21.15.55:6832/3817107512":"2023-07-07T22:00:35.993679+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:01:06.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.361+0000 7f694759e640 1 -- 172.21.15.55:0/1477566424 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f69280664c0 msgr2=0x7f6928068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:06.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.361+0000 7f694759e640 1 --2- 172.21.15.55:0/1477566424 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f69280664c0 0x7f6928068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.361+0000 7f694759e640 1 -- 172.21.15.55:0/1477566424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69480c9b40 msgr2=0x7f69480c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.361+0000 7f694759e640 1 --2- 172.21.15.55:0/1477566424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69480c9b40 0x7f69480c39e0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f693000c420 tx=0x7f693000c8e0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.361+0000 7f694759e640 1 -- 172.21.15.55:0/1477566424 shutdown_connections 2023-07-06T22:01:06.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.361+0000 7f694759e640 1 --2- 172.21.15.55:0/1477566424 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7f69280664c0 0x7f6928068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.361+0000 7f694759e640 1 --2- 172.21.15.55:0/1477566424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6948150b10 0x7f694806b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.361+0000 7f694759e640 1 --2- 172.21.15.55:0/1477566424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69480c9b40 0x7f69480c39e0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.361+0000 7f694759e640 1 --2- 172.21.15.55:0/1477566424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6948070490 0x7f69480c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.361+0000 7f694759e640 1 -- 172.21.15.55:0/1477566424 >> 172.21.15.55:0/1477566424 conn(0x7f69480cdcd0 msgr2=0x7f69480aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:06.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.361+0000 7f694759e640 1 -- 172.21.15.55:0/1477566424 shutdown_connections 2023-07-06T22:01:06.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.361+0000 7f694759e640 1 -- 172.21.15.55:0/1477566424 wait complete. 2023-07-06T22:01:06.382 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T22:00:17.410451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T22:00:18.487297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:01:06.383 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:01:06.390 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:06.389+0000 7f213a432180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:01:06.428 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:06.431+0000 7fcb91446180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:01:06.481 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:06.481+0000 7f213a432180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:01:06.511 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:06.511+0000 7fcb91446180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:01:06.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.529+0000 7ffb1db82640 1 Processor -- start 2023-07-06T22:01:06.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.529+0000 7ffb1db82640 1 -- start start 2023-07-06T22:01:06.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.529+0000 7ffb1db82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb180b3870 0x7ffb180b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.529+0000 7ffb1db82640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb180b4210 con 0x7ffb1815b850 2023-07-06T22:01:06.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.529+0000 7ffb1db82640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb180b2b80 con 0x7ffb180d03c0 2023-07-06T22:01:06.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.529+0000 7ffb1db82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb180cff30 con 0x7ffb180b3870 2023-07-06T22:01:06.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.529+0000 7ffb16ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb180b3870 0x7ffb180b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.529+0000 7ffb177fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ffb1815b850 0x7ffb180cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34334/0 (socket says 172.21.15.55:34334) 2023-07-06T22:01:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.529+0000 7ffb177fe640 1 -- 172.21.15.55:0/2212767743 learned_addr learned my addr 172.21.15.55:0/2212767743 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.529+0000 7ffb16ffd640 1 -- 172.21.15.55:0/2212767743 >> v1:172.21.15.138:6789/0 conn(0x7ffb180d03c0 legacy=0x7ffb180d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.529+0000 7ffb16ffd640 1 -- 172.21.15.55:0/2212767743 >> v1:172.21.15.55:6789/0 conn(0x7ffb1815b850 legacy=0x7ffb180cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.529+0000 7ffb16ffd640 1 -- 172.21.15.55:0/2212767743 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb180b22e0 con 0x7ffb180b3870 2023-07-06T22:01:06.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.533+0000 7ffb16ffd640 1 --2- 172.21.15.55:0/2212767743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb180b3870 0x7ffb180b3cd0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0097c0 tx=0x7ffb0c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b245c83d3dca46d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:06.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.533+0000 7ffb167fc640 1 -- 172.21.15.55:0/2212767743 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0ab600 con 0x7ffb180b3870 2023-07-06T22:01:06.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.533+0000 7ffb167fc640 1 -- 172.21.15.55:0/2212767743 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0c0a7050 con 0x7ffb180b3870 2023-07-06T22:01:06.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.533+0000 7ffb167fc640 1 -- 172.21.15.55:0/2212767743 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0ab980 con 0x7ffb180b3870 2023-07-06T22:01:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.533+0000 7ffb1db82640 1 -- 172.21.15.55:0/2212767743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb180b3870 msgr2=0x7ffb180b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.533+0000 7ffb1db82640 1 --2- 172.21.15.55:0/2212767743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb180b3870 0x7ffb180b3cd0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0097c0 tx=0x7ffb0c01c330 comp rx=0 tx=0).stop 2023-07-06T22:01:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.533+0000 7ffb1db82640 1 -- 172.21.15.55:0/2212767743 shutdown_connections 2023-07-06T22:01:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.533+0000 7ffb1db82640 1 --2- 172.21.15.55:0/2212767743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb180b3870 0x7ffb180b3cd0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.533+0000 7ffb1db82640 1 -- 172.21.15.55:0/2212767743 >> 172.21.15.55:0/2212767743 conn(0x7ffb180cec20 msgr2=0x7ffb180cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.533+0000 7ffb1db82640 1 -- 172.21.15.55:0/2212767743 shutdown_connections 2023-07-06T22:01:06.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.533+0000 7ffb1db82640 1 -- 172.21.15.55:0/2212767743 wait complete. 2023-07-06T22:01:06.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb1db82640 1 Processor -- start 2023-07-06T22:01:06.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb1db82640 1 -- start start 2023-07-06T22:01:06.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb1db82640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb180b3870 0x7ffb180cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb1db82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb180d03c0 0x7ffb181f78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb1db82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb1815b850 0x7ffb181f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb1db82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1815be90 con 0x7ffb180d03c0 2023-07-06T22:01:06.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb1db82640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb180b74a0 con 0x7ffb180b3870 2023-07-06T22:01:06.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb1db82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1815f1a0 con 0x7ffb1815b850 2023-07-06T22:01:06.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb16ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb180d03c0 0x7ffb181f78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:06.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb177fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb180b3870 0x7ffb180cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:06.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb16ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb180d03c0 0x7ffb181f78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58078/0 (socket says 172.21.15.55:58078) 2023-07-06T22:01:06.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb16ffd640 1 -- 172.21.15.55:0/1843957349 learned_addr learned my addr 172.21.15.55:0/1843957349 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:06.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb17fff640 1 --2- 172.21.15.55:0/1843957349 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb1815b850 0x7ffb181f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:06.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb16ffd640 1 -- 172.21.15.55:0/1843957349 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb1815b850 msgr2=0x7ffb181f7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb16ffd640 1 --2- 172.21.15.55:0/1843957349 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb1815b850 0x7ffb181f7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb16ffd640 1 -- 172.21.15.55:0/1843957349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb180b3870 msgr2=0x7ffb180cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb16ffd640 1 --2- 172.21.15.55:0/1843957349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb180b3870 0x7ffb180cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.537+0000 7ffb16ffd640 1 -- 172.21.15.55:0/1843957349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c009420 con 0x7ffb180d03c0 2023-07-06T22:01:06.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.541+0000 7ffb16ffd640 1 --2- 172.21.15.55:0/1843957349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb180d03c0 0x7ffb181f78f0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0ae040 tx=0x7ffb0c0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:06.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.541+0000 7ffafffff640 1 -- 172.21.15.55:0/1843957349 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0b4610 con 0x7ffb180d03c0 2023-07-06T22:01:06.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.541+0000 7ffafffff640 1 -- 172.21.15.55:0/1843957349 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0c0abe90 con 0x7ffb180d03c0 2023-07-06T22:01:06.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.541+0000 7ffb1db82640 1 -- 172.21.15.55:0/1843957349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb180b6bb0 con 0x7ffb180d03c0 2023-07-06T22:01:06.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.541+0000 7ffafffff640 1 -- 172.21.15.55:0/1843957349 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0b49d0 con 0x7ffb180d03c0 2023-07-06T22:01:06.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.541+0000 7ffb1db82640 1 -- 172.21.15.55:0/1843957349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb180b7130 con 0x7ffb180d03c0 2023-07-06T22:01:06.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.541+0000 7ffb1db82640 1 -- 172.21.15.55:0/1843957349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb18066d60 con 0x7ffb180d03c0 2023-07-06T22:01:06.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.541+0000 7ffafffff640 1 -- 172.21.15.55:0/1843957349 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7ffb0c0b2040 con 0x7ffb180d03c0 2023-07-06T22:01:06.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.541+0000 7ffafffff640 1 --2- 172.21.15.55:0/1843957349 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7ffb040664c0 0x7ffb04068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.541+0000 7ffb177fe640 1 -- 172.21.15.55:0/1843957349 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7ffb040664c0 msgr2=0x7ffb04068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1146764448 2023-07-06T22:01:06.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.541+0000 7ffafffff640 1 -- 172.21.15.55:0/1843957349 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6726+0+0 (secure 0 0 0) 0x7ffb0c11e4d0 con 0x7ffb180d03c0 2023-07-06T22:01:06.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.541+0000 7ffb177fe640 1 --2- 172.21.15.55:0/1843957349 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7ffb040664c0 0x7ffb04068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:06.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.549+0000 7ffafffff640 1 -- 172.21.15.55:0/1843957349 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffb0c0eb3b0 con 0x7ffb180d03c0 2023-07-06T22:01:06.650 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:06.649+0000 7f213a432180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:01:06.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.713+0000 7ffb1db82640 1 -- 172.21.15.55:0/1843957349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb180b3420 con 0x7ffb180d03c0 2023-07-06T22:01:06.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.713+0000 7ffafffff640 1 -- 172.21.15.55:0/1843957349 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb0c0ee9d0 con 0x7ffb180d03c0 2023-07-06T22:01:06.715 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:01:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.717+0000 7ffb1db82640 1 -- 172.21.15.55:0/1843957349 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7ffb040664c0 msgr2=0x7ffb04068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:06.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.717+0000 7ffb1db82640 1 --2- 172.21.15.55:0/1843957349 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7ffb040664c0 0x7ffb04068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.717+0000 7ffb1db82640 1 -- 172.21.15.55:0/1843957349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb180d03c0 msgr2=0x7ffb181f78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.717+0000 7ffb1db82640 1 --2- 172.21.15.55:0/1843957349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb180d03c0 0x7ffb181f78f0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0ae040 tx=0x7ffb0c0190d0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.717+0000 7ffb1db82640 1 -- 172.21.15.55:0/1843957349 shutdown_connections 2023-07-06T22:01:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.717+0000 7ffb1db82640 1 --2- 172.21.15.55:0/1843957349 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffb1815b850 0x7ffb181f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.717+0000 7ffb1db82640 1 --2- 172.21.15.55:0/1843957349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb180d03c0 0x7ffb181f78f0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.717+0000 7ffb1db82640 1 --2- 172.21.15.55:0/1843957349 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7ffb040664c0 0x7ffb04068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.717+0000 7ffb1db82640 1 --2- 172.21.15.55:0/1843957349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb180b3870 0x7ffb180cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.717+0000 7ffb1db82640 1 -- 172.21.15.55:0/1843957349 >> 172.21.15.55:0/1843957349 conn(0x7ffb180cec20 msgr2=0x7ffb18156f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.717+0000 7ffb1db82640 1 -- 172.21.15.55:0/1843957349 shutdown_connections 2023-07-06T22:01:06.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.717+0000 7ffb1db82640 1 -- 172.21.15.55:0/1843957349 wait complete. 2023-07-06T22:01:06.737 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:01:06.740 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:06.741+0000 7f213a432180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:01:06.781 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:06.783+0000 7fcb91446180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:01:06.841 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:06.843+0000 7fcb91446180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:01:06.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.885+0000 7efd53e26640 1 Processor -- start 2023-07-06T22:01:06.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.885+0000 7efd53e26640 1 -- start start 2023-07-06T22:01:06.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.885+0000 7efd53e26640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efd4c15b850 0x7efd4c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.885+0000 7efd53e26640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd4c0ccd30 0x7efd4c0b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd53e26640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4c0b4210 con 0x7efd4c0b3db0 2023-07-06T22:01:06.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd53e26640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd4c0b2b80 con 0x7efd4c15b850 2023-07-06T22:01:06.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd53e26640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0cff30 con 0x7efd4c0ccd30 2023-07-06T22:01:06.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd51bc2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efd4c15b850 0x7efd4c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:06.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd523c3640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7efd4c0b3db0 0x7efd4c15f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:42062/0 (socket says 172.21.15.55:42062) 2023-07-06T22:01:06.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd513c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd4c0ccd30 0x7efd4c0b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:06.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd523c3640 1 -- 172.21.15.55:0/1174248931 learned_addr learned my addr 172.21.15.55:0/1174248931 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:06.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd51bc2640 1 -- 172.21.15.55:0/1174248931 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd4c0ccd30 msgr2=0x7efd4c0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:06.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd51bc2640 1 --2- 172.21.15.55:0/1174248931 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd4c0ccd30 0x7efd4c0b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd51bc2640 1 -- 172.21.15.55:0/1174248931 >> v1:172.21.15.138:6789/0 conn(0x7efd4c0b3db0 legacy=0x7efd4c15f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd51bc2640 1 -- 172.21.15.55:0/1174248931 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c0b22e0 con 0x7efd4c15b850 2023-07-06T22:01:06.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd50bc0640 1 -- 172.21.15.55:0/1174248931 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603420696 0 0) 0x7efd4c0b4210 con 0x7efd4c0b3db0 2023-07-06T22:01:06.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd51bc2640 1 --2- 172.21.15.55:0/1174248931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd4c15b850 0x7efd4c0cc7f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efd480097c0 tx=0x7efd4801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eee494c58637d8c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:06.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd50bc0640 1 -- 172.21.15.55:0/1174248931 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd480ab600 con 0x7efd4c15b850 2023-07-06T22:01:06.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd50bc0640 1 -- 172.21.15.55:0/1174248931 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd480a7050 con 0x7efd4c15b850 2023-07-06T22:01:06.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.889+0000 7efd50bc0640 1 -- 172.21.15.55:0/1174248931 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd480ab980 con 0x7efd4c15b850 2023-07-06T22:01:06.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 -- 172.21.15.55:0/1174248931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd4c15b850 msgr2=0x7efd4c0cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 --2- 172.21.15.55:0/1174248931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd4c15b850 0x7efd4c0cc7f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efd480097c0 tx=0x7efd4801c330 comp rx=0 tx=0).stop 2023-07-06T22:01:06.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 -- 172.21.15.55:0/1174248931 shutdown_connections 2023-07-06T22:01:06.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 --2- 172.21.15.55:0/1174248931 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd4c0ccd30 0x7efd4c0b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 --2- 172.21.15.55:0/1174248931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd4c15b850 0x7efd4c0cc7f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 -- 172.21.15.55:0/1174248931 >> 172.21.15.55:0/1174248931 conn(0x7efd4c0cec20 msgr2=0x7efd4c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:06.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 -- 172.21.15.55:0/1174248931 shutdown_connections 2023-07-06T22:01:06.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 -- 172.21.15.55:0/1174248931 wait complete. 2023-07-06T22:01:06.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 Processor -- start 2023-07-06T22:01:06.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 -- start start 2023-07-06T22:01:06.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd4c0b3db0 0x7efd4c151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd4c0ccd30 0x7efd4c15e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd4c15b850 0x7efd4c1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c15ea80 con 0x7efd4c0ccd30 2023-07-06T22:01:06.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c152580 con 0x7efd4c0b3db0 2023-07-06T22:01:06.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.893+0000 7efd53e26640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c152860 con 0x7efd4c15b850 2023-07-06T22:01:06.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd513c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd4c0ccd30 0x7efd4c15e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:06.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd513c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd4c0ccd30 0x7efd4c15e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58086/0 (socket says 172.21.15.55:58086) 2023-07-06T22:01:06.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd513c1640 1 -- 172.21.15.55:0/2768911993 learned_addr learned my addr 172.21.15.55:0/2768911993 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:06.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd51bc2640 1 --2- 172.21.15.55:0/2768911993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd4c0b3db0 0x7efd4c151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:06.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd523c3640 1 --2- 172.21.15.55:0/2768911993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd4c15b850 0x7efd4c1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:06.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd513c1640 1 -- 172.21.15.55:0/2768911993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd4c15b850 msgr2=0x7efd4c1516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd513c1640 1 --2- 172.21.15.55:0/2768911993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd4c15b850 0x7efd4c1516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd513c1640 1 -- 172.21.15.55:0/2768911993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd4c0b3db0 msgr2=0x7efd4c151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:06.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd513c1640 1 --2- 172.21.15.55:0/2768911993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd4c0b3db0 0x7efd4c151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:06.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd513c1640 1 -- 172.21.15.55:0/2768911993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48009420 con 0x7efd4c0ccd30 2023-07-06T22:01:06.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd523c3640 1 --2- 172.21.15.55:0/2768911993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd4c15b850 0x7efd4c1516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:06.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd513c1640 1 --2- 172.21.15.55:0/2768911993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd4c0ccd30 0x7efd4c15e540 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00e900 tx=0x7efd3c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:06.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd427fc640 1 -- 172.21.15.55:0/2768911993 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c009690 con 0x7efd4c0ccd30 2023-07-06T22:01:06.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd427fc640 1 -- 172.21.15.55:0/2768911993 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3c00ca00 con 0x7efd4c0ccd30 2023-07-06T22:01:06.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd427fc640 1 -- 172.21.15.55:0/2768911993 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c00cdb0 con 0x7efd4c0ccd30 2023-07-06T22:01:06.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd53e26640 1 -- 172.21.15.55:0/2768911993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4c15bda0 con 0x7efd4c0ccd30 2023-07-06T22:01:06.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd53e26640 1 -- 172.21.15.55:0/2768911993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4c152e20 con 0x7efd4c0ccd30 2023-07-06T22:01:06.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd53e26640 1 -- 172.21.15.55:0/2768911993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4c0c9250 con 0x7efd4c0ccd30 2023-07-06T22:01:06.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.897+0000 7efd427fc640 1 -- 172.21.15.55:0/2768911993 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7efd3c013470 con 0x7efd4c0ccd30 2023-07-06T22:01:06.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.901+0000 7efd427fc640 1 --2- 172.21.15.55:0/2768911993 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7efd300664c0 0x7efd30068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:06.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.901+0000 7efd51bc2640 1 -- 172.21.15.55:0/2768911993 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7efd300664c0 msgr2=0x7efd30068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/1146764448 2023-07-06T22:01:06.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.901+0000 7efd427fc640 1 -- 172.21.15.55:0/2768911993 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6726+0+0 (secure 0 0 0) 0x7efd3c084620 con 0x7efd4c0ccd30 2023-07-06T22:01:06.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.901+0000 7efd51bc2640 1 --2- 172.21.15.55:0/2768911993 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7efd300664c0 0x7efd30068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:06.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:06.901+0000 7efd427fc640 1 -- 172.21.15.55:0/2768911993 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efd3c0514b0 con 0x7efd4c0ccd30 2023-07-06T22:01:07.032 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:07.033+0000 7f213a432180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:01:07.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.061+0000 7efd53e26640 1 -- 172.21.15.55:0/2768911993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efd4c066d60 con 0x7efd4c0ccd30 2023-07-06T22:01:07.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.061+0000 7efd427fc640 1 -- 172.21.15.55:0/2768911993 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v132) v1 ==== 92+0+10 (secure 0 0 0) 0x7efd3c054ad0 con 0x7efd4c0ccd30 2023-07-06T22:01:07.062 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:01:07.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.065+0000 7efd53e26640 1 -- 172.21.15.55:0/2768911993 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7efd300664c0 msgr2=0x7efd30068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:07.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.065+0000 7efd53e26640 1 --2- 172.21.15.55:0/2768911993 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7efd300664c0 0x7efd30068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.065+0000 7efd53e26640 1 -- 172.21.15.55:0/2768911993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd4c0ccd30 msgr2=0x7efd4c15e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:07.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.065+0000 7efd53e26640 1 --2- 172.21.15.55:0/2768911993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd4c0ccd30 0x7efd4c15e540 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00e900 tx=0x7efd3c00edc0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.065+0000 7efd53e26640 1 -- 172.21.15.55:0/2768911993 shutdown_connections 2023-07-06T22:01:07.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.065+0000 7efd53e26640 1 --2- 172.21.15.55:0/2768911993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd4c15b850 0x7efd4c1516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.065+0000 7efd53e26640 1 --2- 172.21.15.55:0/2768911993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd4c0ccd30 0x7efd4c15e540 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.065+0000 7efd53e26640 1 --2- 172.21.15.55:0/2768911993 >> [v2:172.21.15.55:6832/1146764448,v1:172.21.15.55:6833/1146764448] conn(0x7efd300664c0 0x7efd30068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.065+0000 7efd53e26640 1 --2- 172.21.15.55:0/2768911993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd4c0b3db0 0x7efd4c151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.065+0000 7efd53e26640 1 -- 172.21.15.55:0/2768911993 >> 172.21.15.55:0/2768911993 conn(0x7efd4c0cec20 msgr2=0x7efd4c0b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:07.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.065+0000 7efd53e26640 1 -- 172.21.15.55:0/2768911993 shutdown_connections 2023-07-06T22:01:07.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.065+0000 7efd53e26640 1 -- 172.21.15.55:0/2768911993 wait complete. 2023-07-06T22:01:07.084 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T22:01:07.097 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:07.097+0000 7f213a432180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:01:07.188 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:07.189+0000 7f20c3130640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:07.189 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:07.189+0000 7f20c3130640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:07.189 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:07.189+0000 7f20c3130640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:07.189 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:07.189+0000 7f20c3130640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:07.189 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:07.189+0000 7f20c3130640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:07.189 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:07.189+0000 7f20c192d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:07.190 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:07.189+0000 7f20c192d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:07.190 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:07.189+0000 7f20c192d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:07.190 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:07.189+0000 7f20c192d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:07.190 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:07.189+0000 7f20c192d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:07.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.257+0000 7f08f4b37640 1 Processor -- start 2023-07-06T22:01:07.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.257+0000 7f08f4b37640 1 -- start start 2023-07-06T22:01:07.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.257+0000 7f08f4b37640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f08f00ca130 0x7f08f00703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:07.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.257+0000 7f08f4b37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f00c8db0 con 0x7f08f0158850 2023-07-06T22:01:07.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.257+0000 7f08f4b37640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f00c9090 con 0x7f08f00cd140 2023-07-06T22:01:07.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.257+0000 7f08f4b37640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f0158ce0 con 0x7f08f00ca130 2023-07-06T22:01:07.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.257+0000 7f08ee59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f08f0158850 0x7f08f00cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34346/0 (socket says 172.21.15.55:34346) 2023-07-06T22:01:07.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.257+0000 7f08ee59c640 1 -- 172.21.15.55:0/651285303 learned_addr learned my addr 172.21.15.55:0/651285303 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:07.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.257+0000 7f08e7fff640 1 --2- 172.21.15.55:0/651285303 >> v2:172.21.15.138:3300/0 conn(0x7f08f00ca130 0x7f08f00703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:07.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.257+0000 7f08edd9b640 1 -- 172.21.15.55:0/651285303 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712972025 0 0) 0x7f08f00c8db0 con 0x7f08f0158850 2023-07-06T22:01:07.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.257+0000 7f08edd9b640 1 -- 172.21.15.55:0/651285303 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08dc003530 con 0x7f08f0158850 2023-07-06T22:01:07.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08edd9b640 1 -- 172.21.15.55:0/651285303 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494644913 0 0) 0x7f08f00c9090 con 0x7f08f00cd140 2023-07-06T22:01:07.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08edd9b640 1 -- 172.21.15.55:0/651285303 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08f00c8db0 con 0x7f08f00cd140 2023-07-06T22:01:07.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08edd9b640 1 -- 172.21.15.55:0/651285303 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 914426726 0 0) 0x7f08dc003530 con 0x7f08f0158850 2023-07-06T22:01:07.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08e7fff640 1 -- 172.21.15.55:0/651285303 >> v1:172.21.15.138:6789/0 conn(0x7f08f00cd140 legacy=0x7f08f00b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:07.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08e7fff640 1 -- 172.21.15.55:0/651285303 >> v1:172.21.15.55:6789/0 conn(0x7f08f0158850 legacy=0x7f08f00cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:07.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08e7fff640 1 -- 172.21.15.55:0/651285303 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00c9370 con 0x7f08f00ca130 2023-07-06T22:01:07.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08e7fff640 1 --2- 172.21.15.55:0/651285303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08f00ca130 0x7f08f00703e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f08d80097c0 tx=0x7f08d801e580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=819b8b2e8f31576e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:07.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08edd9b640 1 -- 172.21.15.55:0/651285303 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0001680 con 0x7f08f00ca130 2023-07-06T22:01:07.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08edd9b640 1 -- 172.21.15.55:0/651285303 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d80ac470 con 0x7f08f00ca130 2023-07-06T22:01:07.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08edd9b640 1 -- 172.21.15.55:0/651285303 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80ac800 con 0x7f08f00ca130 2023-07-06T22:01:07.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08f4b37640 1 -- 172.21.15.55:0/651285303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08f00ca130 msgr2=0x7f08f00703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:07.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08f4b37640 1 --2- 172.21.15.55:0/651285303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08f00ca130 0x7f08f00703e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f08d80097c0 tx=0x7f08d801e580 comp rx=0 tx=0).stop 2023-07-06T22:01:07.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08f4b37640 1 -- 172.21.15.55:0/651285303 shutdown_connections 2023-07-06T22:01:07.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08f4b37640 1 --2- 172.21.15.55:0/651285303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08f00ca130 0x7f08f00703e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.261+0000 7f08f4b37640 1 -- 172.21.15.55:0/651285303 >> 172.21.15.55:0/651285303 conn(0x7f08f00cea70 msgr2=0x7f08f00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:07.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08f4b37640 1 -- 172.21.15.55:0/651285303 shutdown_connections 2023-07-06T22:01:07.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08f4b37640 1 -- 172.21.15.55:0/651285303 wait complete. 2023-07-06T22:01:07.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08f4b37640 1 Processor -- start 2023-07-06T22:01:07.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08f4b37640 1 -- start start 2023-07-06T22:01:07.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08f4b37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08f00ca130 0x7f08f009d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:07.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08f4b37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08f00cd140 0x7f08f01510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:07.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08f4b37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08f0158850 0x7f08f00c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:07.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08f4b37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f009e8c0 con 0x7f08f00ca130 2023-07-06T22:01:07.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08f4b37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f009dcb0 con 0x7f08f0158850 2023-07-06T22:01:07.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08f4b37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f009df90 con 0x7f08f00cd140 2023-07-06T22:01:07.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08ee59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08f00ca130 0x7f08f009d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:07.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08ee59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08f00ca130 0x7f08f009d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58212/0 (socket says 172.21.15.55:58212) 2023-07-06T22:01:07.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08ee59c640 1 -- 172.21.15.55:0/1461519191 learned_addr learned my addr 172.21.15.55:0/1461519191 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:07.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08eed9d640 1 --2- 172.21.15.55:0/1461519191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08f0158850 0x7f08f00c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:07.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08e7fff640 1 --2- 172.21.15.55:0/1461519191 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08f00cd140 0x7f08f01510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:07.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08ee59c640 1 -- 172.21.15.55:0/1461519191 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08f00cd140 msgr2=0x7f08f01510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:07.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08ee59c640 1 --2- 172.21.15.55:0/1461519191 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08f00cd140 0x7f08f01510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08ee59c640 1 -- 172.21.15.55:0/1461519191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08f0158850 msgr2=0x7f08f00c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:07.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08ee59c640 1 --2- 172.21.15.55:0/1461519191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08f0158850 0x7f08f00c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08ee59c640 1 -- 172.21.15.55:0/1461519191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8009420 con 0x7f08f00ca130 2023-07-06T22:01:07.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08e7fff640 1 --2- 172.21.15.55:0/1461519191 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08f00cd140 0x7f08f01510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:07.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.265+0000 7f08ee59c640 1 --2- 172.21.15.55:0/1461519191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08f00ca130 0x7f08f009d660 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f08e000c750 tx=0x7f08e000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:07.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.269+0000 7f08e6ffd640 1 -- 172.21.15.55:0/1461519191 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0005ae0 con 0x7f08f00ca130 2023-07-06T22:01:07.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.269+0000 7f08e6ffd640 1 -- 172.21.15.55:0/1461519191 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e0005c40 con 0x7f08f00ca130 2023-07-06T22:01:07.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.269+0000 7f08e6ffd640 1 -- 172.21.15.55:0/1461519191 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0007070 con 0x7f08f00ca130 2023-07-06T22:01:07.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.269+0000 7f08f4b37640 1 -- 172.21.15.55:0/1461519191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f009e270 con 0x7f08f00ca130 2023-07-06T22:01:07.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.269+0000 7f08f4b37640 1 -- 172.21.15.55:0/1461519191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f00c6900 con 0x7f08f00ca130 2023-07-06T22:01:07.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.269+0000 7f08f4b37640 1 -- 172.21.15.55:0/1461519191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f0066d60 con 0x7f08f00ca130 2023-07-06T22:01:07.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.269+0000 7f08e6ffd640 1 -- 172.21.15.55:0/1461519191 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f08e00071d0 con 0x7f08f00ca130 2023-07-06T22:01:07.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.269+0000 7f08e6ffd640 1 -- 172.21.15.55:0/1461519191 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 7156+0+0 (secure 0 0 0) 0x7f08e00839b0 con 0x7f08f00ca130 2023-07-06T22:01:07.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.273+0000 7f08e6ffd640 1 -- 172.21.15.55:0/1461519191 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08e0050e30 con 0x7f08f00ca130 2023-07-06T22:01:07.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.429+0000 7f08f4b37640 1 -- 172.21.15.55:0/1461519191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08f006ebf0 con 0x7f08f00ca130 2023-07-06T22:01:07.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.429+0000 7f08e6ffd640 1 -- 172.21.15.55:0/1461519191 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v133) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08e0054450 con 0x7f08f00ca130 2023-07-06T22:01:07.429 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T22:01:07.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.429+0000 7f08f4b37640 1 -- 172.21.15.55:0/1461519191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08f00ca130 msgr2=0x7f08f009d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:07.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.429+0000 7f08f4b37640 1 --2- 172.21.15.55:0/1461519191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08f00ca130 0x7f08f009d660 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f08e000c750 tx=0x7f08e000cc10 comp rx=0 tx=0).stop 2023-07-06T22:01:07.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.429+0000 7f08f4b37640 1 -- 172.21.15.55:0/1461519191 shutdown_connections 2023-07-06T22:01:07.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.429+0000 7f08f4b37640 1 --2- 172.21.15.55:0/1461519191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08f0158850 0x7f08f00c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.429+0000 7f08f4b37640 1 --2- 172.21.15.55:0/1461519191 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08f00cd140 0x7f08f01510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.429+0000 7f08f4b37640 1 --2- 172.21.15.55:0/1461519191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08f00ca130 0x7f08f009d660 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.429+0000 7f08f4b37640 1 -- 172.21.15.55:0/1461519191 >> 172.21.15.55:0/1461519191 conn(0x7f08f00cea70 msgr2=0x7f08f00b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:07.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.429+0000 7f08f4b37640 1 -- 172.21.15.55:0/1461519191 shutdown_connections 2023-07-06T22:01:07.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.429+0000 7f08f4b37640 1 -- 172.21.15.55:0/1461519191 wait complete. 2023-07-06T22:01:07.450 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T22:01:07.590 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:01:07.594 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:01:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.637+0000 7fdfc1848640 1 Processor -- start 2023-07-06T22:01:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.637+0000 7fdfc1848640 1 -- start start 2023-07-06T22:01:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.641+0000 7fdfc1848640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdfbc15b8a0 0x7fdfbc0d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.641+0000 7fdfc1848640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfbc0b4040 0x7fdfbc0b5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.641+0000 7fdfc1848640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfbc0ccca0 con 0x7fdfbc0ce1a0 2023-07-06T22:01:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.641+0000 7fdfc1848640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfbc0b5000 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.641+0000 7fdfc1848640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc15bc70 con 0x7fdfbc0b4040 2023-07-06T22:01:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.641+0000 7fdfbaffd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdfbc15b8a0 0x7fdfbc0d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.641+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfbc0b4040 0x7fdfbc0b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.641+0000 7fdfb3fff640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fdfbc0ce1a0 0x7fdfbc0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:42076/0 (socket says 172.21.15.55:42076) 2023-07-06T22:01:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.641+0000 7fdfb3fff640 1 -- 172.21.15.55:0/706003024 learned_addr learned my addr 172.21.15.55:0/706003024 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.641+0000 7fdfbaffd640 1 -- 172.21.15.55:0/706003024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfbc0b4040 msgr2=0x7fdfbc0b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.641+0000 7fdfbaffd640 1 --2- 172.21.15.55:0/706003024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfbc0b4040 0x7fdfbc0b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.641+0000 7fdfbaffd640 1 -- 172.21.15.55:0/706003024 >> v1:172.21.15.138:6789/0 conn(0x7fdfbc0ce1a0 legacy=0x7fdfbc0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.641+0000 7fdfbaffd640 1 -- 172.21.15.55:0/706003024 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc0d0bb0 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.645+0000 7fdfbaffd640 1 --2- 172.21.15.55:0/706003024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfbc15b8a0 0x7fdfbc0d0580 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0d0da0 tx=0x7fdfac01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4acc61f6356ce3f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.645+0000 7fdfba7fc640 1 -- 172.21.15.55:0/706003024 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0ab600 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.645+0000 7fdfba7fc640 1 -- 172.21.15.55:0/706003024 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac0a7050 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.645+0000 7fdfba7fc640 1 -- 172.21.15.55:0/706003024 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0ab980 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.645+0000 7fdfc1848640 1 -- 172.21.15.55:0/706003024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfbc15b8a0 msgr2=0x7fdfbc0d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.645+0000 7fdfc1848640 1 --2- 172.21.15.55:0/706003024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfbc15b8a0 0x7fdfbc0d0580 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0d0da0 tx=0x7fdfac01c3f0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.645+0000 7fdfc1848640 1 -- 172.21.15.55:0/706003024 shutdown_connections 2023-07-06T22:01:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.645+0000 7fdfc1848640 1 --2- 172.21.15.55:0/706003024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfbc0b4040 0x7fdfbc0b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.645+0000 7fdfc1848640 1 --2- 172.21.15.55:0/706003024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfbc15b8a0 0x7fdfbc0d0580 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.645+0000 7fdfc1848640 1 -- 172.21.15.55:0/706003024 >> 172.21.15.55:0/706003024 conn(0x7fdfbc06b620 msgr2=0x7fdfbc06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.645+0000 7fdfc1848640 1 -- 172.21.15.55:0/706003024 shutdown_connections 2023-07-06T22:01:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.645+0000 7fdfc1848640 1 -- 172.21.15.55:0/706003024 wait complete. 2023-07-06T22:01:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.645+0000 7fdfc1848640 1 Processor -- start 2023-07-06T22:01:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.645+0000 7fdfc1848640 1 -- start start 2023-07-06T22:01:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfc1848640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfbc0b4040 0x7fdfbc0c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfc1848640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfbc0ce1a0 0x7fdfbc15db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfc1848640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc15b8a0 0x7fdfbc14b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfc1848640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc15e0b0 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfc1848640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc14d7c0 con 0x7fdfbc0ce1a0 2023-07-06T22:01:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfc1848640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc0c7f70 con 0x7fdfbc0b4040 2023-07-06T22:01:07.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc15b8a0 0x7fdfbc14b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:07.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc15b8a0 0x7fdfbc14b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58214/0 (socket says 172.21.15.55:58214) 2023-07-06T22:01:07.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfbb7fe640 1 -- 172.21.15.55:0/4099497188 learned_addr learned my addr 172.21.15.55:0/4099497188 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:07.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfbaffd640 1 --2- 172.21.15.55:0/4099497188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfbc0b4040 0x7fdfbc0c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:07.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfb3fff640 1 --2- 172.21.15.55:0/4099497188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfbc0ce1a0 0x7fdfbc15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:07.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfbb7fe640 1 -- 172.21.15.55:0/4099497188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfbc0b4040 msgr2=0x7fdfbc0c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:07.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfbb7fe640 1 --2- 172.21.15.55:0/4099497188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfbc0b4040 0x7fdfbc0c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfbb7fe640 1 -- 172.21.15.55:0/4099497188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfbc0ce1a0 msgr2=0x7fdfbc15db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:07.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfbb7fe640 1 --2- 172.21.15.55:0/4099497188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfbc0ce1a0 0x7fdfbc15db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfbb7fe640 1 -- 172.21.15.55:0/4099497188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac009420 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfbb7fe640 1 --2- 172.21.15.55:0/4099497188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc15b8a0 0x7fdfbc14b830 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400ef90 tx=0x7fdfb400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:07.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfb8ff9640 1 -- 172.21.15.55:0/4099497188 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4009ca0 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfb8ff9640 1 -- 172.21.15.55:0/4099497188 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb400f040 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfb8ff9640 1 -- 172.21.15.55:0/4099497188 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40146c0 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfc1848640 1 -- 172.21.15.55:0/4099497188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfbc0c8250 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfc1848640 1 -- 172.21.15.55:0/4099497188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfbc0c8810 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfc1848640 1 -- 172.21.15.55:0/4099497188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfbc04d790 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.649+0000 7fdfb8ff9640 1 -- 172.21.15.55:0/4099497188 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fdfb4014820 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.653+0000 7fdfb8ff9640 1 -- 172.21.15.55:0/4099497188 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 7156+0+0 (secure 0 0 0) 0x7fdfb4084980 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.657+0000 7fdfb8ff9640 1 -- 172.21.15.55:0/4099497188 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfb4051eb0 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.813+0000 7fdfc1848640 1 -- 172.21.15.55:0/4099497188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdfbc06c340 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.813+0000 7fdfb8ff9640 1 -- 172.21.15.55:0/4099497188 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v133) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdfb40554d0 con 0x7fdfbc15b8a0 2023-07-06T22:01:07.813 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T22:01:07.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.813+0000 7fdfc1848640 1 -- 172.21.15.55:0/4099497188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc15b8a0 msgr2=0x7fdfbc14b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:07.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.813+0000 7fdfc1848640 1 --2- 172.21.15.55:0/4099497188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc15b8a0 0x7fdfbc14b830 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400ef90 tx=0x7fdfb400c490 comp rx=0 tx=0).stop 2023-07-06T22:01:07.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.813+0000 7fdfc1848640 1 -- 172.21.15.55:0/4099497188 shutdown_connections 2023-07-06T22:01:07.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.813+0000 7fdfc1848640 1 --2- 172.21.15.55:0/4099497188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc15b8a0 0x7fdfbc14b830 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.813+0000 7fdfc1848640 1 --2- 172.21.15.55:0/4099497188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfbc0ce1a0 0x7fdfbc15db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.813+0000 7fdfc1848640 1 --2- 172.21.15.55:0/4099497188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfbc0b4040 0x7fdfbc0c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:07.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.813+0000 7fdfc1848640 1 -- 172.21.15.55:0/4099497188 >> 172.21.15.55:0/4099497188 conn(0x7fdfbc06b620 msgr2=0x7fdfbc06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:07.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.813+0000 7fdfc1848640 1 -- 172.21.15.55:0/4099497188 shutdown_connections 2023-07-06T22:01:07.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:07.813+0000 7fdfc1848640 1 -- 172.21.15.55:0/4099497188 wait complete. 2023-07-06T22:01:07.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:01:08.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f964c47b640 1 Processor -- start 2023-07-06T22:01:08.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f964c47b640 1 -- start start 2023-07-06T22:01:08.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f964c47b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f96440b7cd0 0x7f96440ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f964c47b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96440ccab0 0x7f96440b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f964c47b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96440cecf0 con 0x7f96440ccf00 2023-07-06T22:01:08.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f964c47b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96440d2310 con 0x7f96440b7cd0 2023-07-06T22:01:08.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f964c47b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96440b80a0 con 0x7f96440ccab0 2023-07-06T22:01:08.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f964a217640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f96440b7cd0 0x7f96440ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f964aa18640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f96440ccf00 0x7f96440b38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:42092/0 (socket says 172.21.15.55:42092) 2023-07-06T22:01:08.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f964aa18640 1 -- 172.21.15.55:0/3512036904 learned_addr learned my addr 172.21.15.55:0/3512036904 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:08.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f9649a16640 1 --2- 172.21.15.55:0/3512036904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96440ccab0 0x7f96440b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f964a217640 1 -- 172.21.15.55:0/3512036904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96440ccab0 msgr2=0x7f96440b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:08.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f964a217640 1 --2- 172.21.15.55:0/3512036904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96440ccab0 0x7f96440b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f964a217640 1 -- 172.21.15.55:0/3512036904 >> v1:172.21.15.138:6789/0 conn(0x7f96440ccf00 legacy=0x7f96440b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f964a217640 1 -- 172.21.15.55:0/3512036904 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96440d1d90 con 0x7f96440b7cd0 2023-07-06T22:01:08.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.017+0000 7f9649215640 1 -- 172.21.15.55:0/3512036904 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524693739 0 0) 0x7f96440cecf0 con 0x7f96440ccf00 2023-07-06T22:01:08.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.021+0000 7f964a217640 1 --2- 172.21.15.55:0/3512036904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96440b7cd0 0x7f96440ce610 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f96400097c0 tx=0x7f964001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c68ac16a651882c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:08.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.021+0000 7f9649215640 1 -- 172.21.15.55:0/3512036904 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96400ab600 con 0x7f96440b7cd0 2023-07-06T22:01:08.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.021+0000 7f9649215640 1 -- 172.21.15.55:0/3512036904 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96400a7050 con 0x7f96440b7cd0 2023-07-06T22:01:08.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.021+0000 7f9649215640 1 -- 172.21.15.55:0/3512036904 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96400ab980 con 0x7f96440b7cd0 2023-07-06T22:01:08.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.021+0000 7f964c47b640 1 -- 172.21.15.55:0/3512036904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96440b7cd0 msgr2=0x7f96440ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.021+0000 7f964c47b640 1 --2- 172.21.15.55:0/3512036904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96440b7cd0 0x7f96440ce610 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f96400097c0 tx=0x7f964001c3f0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.021+0000 7f964c47b640 1 -- 172.21.15.55:0/3512036904 shutdown_connections 2023-07-06T22:01:08.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.021+0000 7f964c47b640 1 --2- 172.21.15.55:0/3512036904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96440ccab0 0x7f96440b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.021+0000 7f964c47b640 1 --2- 172.21.15.55:0/3512036904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96440b7cd0 0x7f96440ce610 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.021+0000 7f964c47b640 1 -- 172.21.15.55:0/3512036904 >> 172.21.15.55:0/3512036904 conn(0x7f96440ceee0 msgr2=0x7f96440cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:08.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.021+0000 7f964c47b640 1 -- 172.21.15.55:0/3512036904 shutdown_connections 2023-07-06T22:01:08.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.021+0000 7f964c47b640 1 -- 172.21.15.55:0/3512036904 wait complete. 2023-07-06T22:01:08.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.021+0000 7f964c47b640 1 Processor -- start 2023-07-06T22:01:08.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f964c47b640 1 -- start start 2023-07-06T22:01:08.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f964c47b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96440b7cd0 0x7f964414f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f964c47b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96440ccab0 0x7f964414f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f964c47b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96440ccf00 0x7f9644159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f964c47b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96441529b0 con 0x7f96440ccab0 2023-07-06T22:01:08.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f964c47b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9644153430 con 0x7f96440b7cd0 2023-07-06T22:01:08.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f964c47b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9644150700 con 0x7f96440ccf00 2023-07-06T22:01:08.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f9649a16640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96440ccab0 0x7f964414f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f9649a16640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96440ccab0 0x7f964414f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58222/0 (socket says 172.21.15.55:58222) 2023-07-06T22:01:08.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f9649a16640 1 -- 172.21.15.55:0/2878708521 learned_addr learned my addr 172.21.15.55:0/2878708521 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:08.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f964aa18640 1 --2- 172.21.15.55:0/2878708521 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96440ccf00 0x7f9644159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f964a217640 1 --2- 172.21.15.55:0/2878708521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96440b7cd0 0x7f964414f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f9649a16640 1 -- 172.21.15.55:0/2878708521 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96440ccf00 msgr2=0x7f9644159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f9649a16640 1 --2- 172.21.15.55:0/2878708521 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96440ccf00 0x7f9644159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f9649a16640 1 -- 172.21.15.55:0/2878708521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96440b7cd0 msgr2=0x7f964414f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f9649a16640 1 --2- 172.21.15.55:0/2878708521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96440b7cd0 0x7f964414f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f9649a16640 1 -- 172.21.15.55:0/2878708521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9640009420 con 0x7f96440ccab0 2023-07-06T22:01:08.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f9649a16640 1 --2- 172.21.15.55:0/2878708521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96440ccab0 0x7f964414f9c0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f963400e930 tx=0x7f963400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:08.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f963affd640 1 -- 172.21.15.55:0/2878708521 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634009690 con 0x7f96440ccab0 2023-07-06T22:01:08.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f963affd640 1 -- 172.21.15.55:0/2878708521 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963400c9a0 con 0x7f96440ccab0 2023-07-06T22:01:08.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f963affd640 1 -- 172.21.15.55:0/2878708521 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963400cd10 con 0x7f96440ccab0 2023-07-06T22:01:08.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f964c47b640 1 -- 172.21.15.55:0/2878708521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9644152b90 con 0x7f96440ccab0 2023-07-06T22:01:08.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f964c47b640 1 -- 172.21.15.55:0/2878708521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9644153150 con 0x7f96440ccab0 2023-07-06T22:01:08.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.025+0000 7f964c47b640 1 -- 172.21.15.55:0/2878708521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96441504d0 con 0x7f96440ccab0 2023-07-06T22:01:08.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.029+0000 7f963affd640 1 -- 172.21.15.55:0/2878708521 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f9634013470 con 0x7f96440ccab0 2023-07-06T22:01:08.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.029+0000 7f963affd640 1 -- 172.21.15.55:0/2878708521 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 7156+0+0 (secure 0 0 0) 0x7f9634083df0 con 0x7f96440ccab0 2023-07-06T22:01:08.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.033+0000 7f963affd640 1 -- 172.21.15.55:0/2878708521 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f96441504d0 con 0x7f96440ccab0 2023-07-06T22:01:08.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.137+0000 7f963affd640 1 -- 172.21.15.55:0/2878708521 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 68) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f9634050da0 con 0x7f96440ccab0 2023-07-06T22:01:08.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.137+0000 7f963affd640 1 --2- 172.21.15.55:0/2878708521 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f962806c670 0x7f962806ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.137+0000 7f964a217640 1 --2- 172.21.15.55:0/2878708521 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f962806c670 0x7f962806ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.141+0000 7f964a217640 1 --2- 172.21.15.55:0/2878708521 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f962806c670 0x7f962806ea50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f96400ad000 tx=0x7f9640008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:08.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.233+0000 7f964c47b640 1 -- 172.21.15.55:0/2878708521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96441504d0 con 0x7f96440ccab0 2023-07-06T22:01:08.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.233+0000 7f963affd640 1 -- 172.21.15.55:0/2878708521 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f96441504d0 con 0x7f96440ccab0 2023-07-06T22:01:08.234 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:08.234 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/567276052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":567276052},{"type":"v1","addr":"172.21.15.138:6834","nonce":567276052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2227115466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2227115466},{"type":"v1","addr":"172.21.15.138:6835","nonce":2227115466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2611738616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2611738616},{"type":"v1","addr":"172.21.15.55:6836","nonce":2611738616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:00:19.496559+0000","modified":"2023-07-06T22:00:22.517164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8622":{"gid":8622,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1836658324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1836658324},{"type":"v1","addr":"172.21.15.55:6837","nonce":1836658324}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-06T22:01:08.234 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 54 2023-07-06T22:01:08.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.233+0000 7f964c47b640 1 -- 172.21.15.55:0/2878708521 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f962806c670 msgr2=0x7f962806ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.233+0000 7f964c47b640 1 --2- 172.21.15.55:0/2878708521 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f962806c670 0x7f962806ea50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f96400ad000 tx=0x7f9640008040 comp rx=0 tx=0).stop 2023-07-06T22:01:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.233+0000 7f964c47b640 1 -- 172.21.15.55:0/2878708521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96440ccab0 msgr2=0x7f964414f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.233+0000 7f964c47b640 1 --2- 172.21.15.55:0/2878708521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96440ccab0 0x7f964414f9c0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f963400e930 tx=0x7f963400edf0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.233+0000 7f964c47b640 1 -- 172.21.15.55:0/2878708521 shutdown_connections 2023-07-06T22:01:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.233+0000 7f964c47b640 1 --2- 172.21.15.55:0/2878708521 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f962806c670 0x7f962806ea50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.233+0000 7f964c47b640 1 --2- 172.21.15.55:0/2878708521 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96440ccf00 0x7f9644159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.233+0000 7f964c47b640 1 --2- 172.21.15.55:0/2878708521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96440ccab0 0x7f964414f9c0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.233+0000 7f964c47b640 1 --2- 172.21.15.55:0/2878708521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96440b7cd0 0x7f964414f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.233+0000 7f964c47b640 1 -- 172.21.15.55:0/2878708521 >> 172.21.15.55:0/2878708521 conn(0x7f96440ceee0 msgr2=0x7f96440cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:08.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.237+0000 7f964c47b640 1 -- 172.21.15.55:0/2878708521 shutdown_connections 2023-07-06T22:01:08.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.237+0000 7f964c47b640 1 -- 172.21.15.55:0/2878708521 wait complete. 2023-07-06T22:01:08.254 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:01:08.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f9688bf6640 1 Processor -- start 2023-07-06T22:01:08.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f9688bf6640 1 -- start start 2023-07-06T22:01:08.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f9688bf6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f96840b7cd0 0x7f96840ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f9688bf6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96840ccab0 0x7f96840b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f9688bf6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96840cecf0 con 0x7f96840ccf00 2023-07-06T22:01:08.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f9688bf6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96840d2310 con 0x7f96840b7cd0 2023-07-06T22:01:08.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f9688bf6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96840b80a0 con 0x7f96840ccab0 2023-07-06T22:01:08.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f9682d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f96840ccf00 0x7f96840b38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34354/0 (socket says 172.21.15.55:34354) 2023-07-06T22:01:08.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f9682d9d640 1 -- 172.21.15.55:0/2442661395 learned_addr learned my addr 172.21.15.55:0/2442661395 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:08.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f968259c640 1 --2- 172.21.15.55:0/2442661395 >> v2:172.21.15.138:3300/0 conn(0x7f96840b7cd0 0x7f96840ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f9681d9b640 1 --2- 172.21.15.55:0/2442661395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96840ccab0 0x7f96840b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f968159a640 1 -- 172.21.15.55:0/2442661395 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166862270 0 0) 0x7f96840cecf0 con 0x7f96840ccf00 2023-07-06T22:01:08.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f968159a640 1 -- 172.21.15.55:0/2442661395 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f966c003530 con 0x7f96840ccf00 2023-07-06T22:01:08.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f968259c640 1 -- 172.21.15.55:0/2442661395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96840ccab0 msgr2=0x7f96840b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:08.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f968259c640 1 --2- 172.21.15.55:0/2442661395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96840ccab0 0x7f96840b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f968259c640 1 -- 172.21.15.55:0/2442661395 >> v1:172.21.15.55:6789/0 conn(0x7f96840ccf00 legacy=0x7f96840b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.401+0000 7f968259c640 1 -- 172.21.15.55:0/2442661395 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96840d1d90 con 0x7f96840b7cd0 2023-07-06T22:01:08.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.405+0000 7f968259c640 1 --2- 172.21.15.55:0/2442661395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96840b7cd0 0x7f96840ce610 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f96740097c0 tx=0x7f967401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=888d6cb9d786b1bb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:08.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.405+0000 7f968159a640 1 -- 172.21.15.55:0/2442661395 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96740ab600 con 0x7f96840b7cd0 2023-07-06T22:01:08.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.405+0000 7f968159a640 1 -- 172.21.15.55:0/2442661395 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96740a7050 con 0x7f96840b7cd0 2023-07-06T22:01:08.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.405+0000 7f968159a640 1 -- 172.21.15.55:0/2442661395 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96740ab980 con 0x7f96840b7cd0 2023-07-06T22:01:08.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.405+0000 7f9688bf6640 1 -- 172.21.15.55:0/2442661395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96840b7cd0 msgr2=0x7f96840ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.405+0000 7f9688bf6640 1 --2- 172.21.15.55:0/2442661395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96840b7cd0 0x7f96840ce610 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f96740097c0 tx=0x7f967401c3f0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.405+0000 7f9688bf6640 1 -- 172.21.15.55:0/2442661395 shutdown_connections 2023-07-06T22:01:08.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.405+0000 7f9688bf6640 1 --2- 172.21.15.55:0/2442661395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96840ccab0 0x7f96840b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.405+0000 7f9688bf6640 1 --2- 172.21.15.55:0/2442661395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96840b7cd0 0x7f96840ce610 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.405+0000 7f9688bf6640 1 -- 172.21.15.55:0/2442661395 >> 172.21.15.55:0/2442661395 conn(0x7f96840ceee0 msgr2=0x7f96840cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:08.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.405+0000 7f9688bf6640 1 -- 172.21.15.55:0/2442661395 shutdown_connections 2023-07-06T22:01:08.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.405+0000 7f9688bf6640 1 -- 172.21.15.55:0/2442661395 wait complete. 2023-07-06T22:01:08.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9688bf6640 1 Processor -- start 2023-07-06T22:01:08.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9688bf6640 1 -- start start 2023-07-06T22:01:08.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9688bf6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96840b7cd0 0x7f96840b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9688bf6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96840ccab0 0x7f968414b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9688bf6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96840ccf00 0x7f9684157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9688bf6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968414d360 con 0x7f96840b7cd0 2023-07-06T22:01:08.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9688bf6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96841583c0 con 0x7f96840ccab0 2023-07-06T22:01:08.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9688bf6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968414e1f0 con 0x7f96840ccf00 2023-07-06T22:01:08.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f968259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96840b7cd0 0x7f96840b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f968259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96840b7cd0 0x7f96840b5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58232/0 (socket says 172.21.15.55:58232) 2023-07-06T22:01:08.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f968259c640 1 -- 172.21.15.55:0/2251130861 learned_addr learned my addr 172.21.15.55:0/2251130861 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:08.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9681d9b640 1 --2- 172.21.15.55:0/2251130861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96840ccab0 0x7f968414b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9682d9d640 1 --2- 172.21.15.55:0/2251130861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96840ccf00 0x7f9684157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f968259c640 1 -- 172.21.15.55:0/2251130861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96840ccf00 msgr2=0x7f9684157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f968259c640 1 --2- 172.21.15.55:0/2251130861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96840ccf00 0x7f9684157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f968259c640 1 -- 172.21.15.55:0/2251130861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96840ccab0 msgr2=0x7f968414b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f968259c640 1 --2- 172.21.15.55:0/2251130861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96840ccab0 0x7f968414b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f968259c640 1 -- 172.21.15.55:0/2251130861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9674009420 con 0x7f96840b7cd0 2023-07-06T22:01:08.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f968259c640 1 --2- 172.21.15.55:0/2251130861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96840b7cd0 0x7f96840b5290 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f96740ae040 tx=0x7f9674019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:08.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9672ffd640 1 -- 172.21.15.55:0/2251130861 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96740b4430 con 0x7f96840b7cd0 2023-07-06T22:01:08.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9672ffd640 1 -- 172.21.15.55:0/2251130861 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96740b45b0 con 0x7f96840b7cd0 2023-07-06T22:01:08.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9672ffd640 1 -- 172.21.15.55:0/2251130861 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96740b4960 con 0x7f96840b7cd0 2023-07-06T22:01:08.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9688bf6640 1 -- 172.21.15.55:0/2251130861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96840b5ff0 con 0x7f96840b7cd0 2023-07-06T22:01:08.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.409+0000 7f9688bf6640 1 -- 172.21.15.55:0/2251130861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96840b6540 con 0x7f96840b7cd0 2023-07-06T22:01:08.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.413+0000 7f9688bf6640 1 -- 172.21.15.55:0/2251130861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9684066d60 con 0x7f96840b7cd0 2023-07-06T22:01:08.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.413+0000 7f9672ffd640 1 -- 172.21.15.55:0/2251130861 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 68) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f96740b2040 con 0x7f96840b7cd0 2023-07-06T22:01:08.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.413+0000 7f9672ffd640 1 --2- 172.21.15.55:0/2251130861 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f96640660d0 0x7f9664068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.413+0000 7f9672ffd640 1 -- 172.21.15.55:0/2251130861 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 7212+0+0 (secure 0 0 0) 0x7f967411dc30 con 0x7f96840b7cd0 2023-07-06T22:01:08.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.413+0000 7f9681d9b640 1 --2- 172.21.15.55:0/2251130861 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f96640660d0 0x7f9664068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.413+0000 7f9681d9b640 1 --2- 172.21.15.55:0/2251130861 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f96640660d0 0x7f9664068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9684157b00 tx=0x7f9678009190 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:08.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.417+0000 7f9672ffd640 1 -- 172.21.15.55:0/2251130861 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f96740eaea0 con 0x7f96840b7cd0 2023-07-06T22:01:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.577+0000 7f9688bf6640 1 -- 172.21.15.55:0/2251130861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96840d0bb0 con 0x7f96840b7cd0 2023-07-06T22:01:08.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.577+0000 7f9672ffd640 1 -- 172.21.15.55:0/2251130861 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+19736 (secure 0 0 0) 0x7f96740ee4c0 con 0x7f96840b7cd0 2023-07-06T22:01:08.578 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:08.578 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":134,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:01:08.117075+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:00:17.410451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-07-06T22:00:18.487297+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":134,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3688307648":"2023-07-07T22:01:07.113539+0000","172.21.15.55:6832/1146764448":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/4179834000":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/3903150954":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/386400094":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/3430803253":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/345640234":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/954036155":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/1438757296":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/3754412972":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/1384648608":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/2671638221":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/604485969":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/3447905990":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/2811517165":"2023-07-07T22:00:35.993679+0000","172.21.15.55:6833/3817107512":"2023-07-07T22:00:35.993679+0000","172.21.15.55:6833/1146764448":"2023-07-07T22:01:07.113539+0000","172.21.15.55:6832/3817107512":"2023-07-07T22:00:35.993679+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:01:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.581+0000 7f9688bf6640 1 -- 172.21.15.55:0/2251130861 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f96640660d0 msgr2=0x7f9664068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.581+0000 7f9688bf6640 1 --2- 172.21.15.55:0/2251130861 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f96640660d0 0x7f9664068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9684157b00 tx=0x7f9678009190 comp rx=0 tx=0).stop 2023-07-06T22:01:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.581+0000 7f9688bf6640 1 -- 172.21.15.55:0/2251130861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96840b7cd0 msgr2=0x7f96840b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.581+0000 7f9688bf6640 1 --2- 172.21.15.55:0/2251130861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96840b7cd0 0x7f96840b5290 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f96740ae040 tx=0x7f9674019190 comp rx=0 tx=0).stop 2023-07-06T22:01:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.581+0000 7f9688bf6640 1 -- 172.21.15.55:0/2251130861 shutdown_connections 2023-07-06T22:01:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.581+0000 7f9688bf6640 1 --2- 172.21.15.55:0/2251130861 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f96640660d0 0x7f9664068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.581+0000 7f9688bf6640 1 --2- 172.21.15.55:0/2251130861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f96840ccf00 0x7f9684157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.581+0000 7f9688bf6640 1 --2- 172.21.15.55:0/2251130861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96840ccab0 0x7f968414b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.581+0000 7f9688bf6640 1 --2- 172.21.15.55:0/2251130861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96840b7cd0 0x7f96840b5290 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.581+0000 7f9688bf6640 1 -- 172.21.15.55:0/2251130861 >> 172.21.15.55:0/2251130861 conn(0x7f96840ceee0 msgr2=0x7f9684069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:08.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.581+0000 7f9688bf6640 1 -- 172.21.15.55:0/2251130861 shutdown_connections 2023-07-06T22:01:08.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.581+0000 7f9688bf6640 1 -- 172.21.15.55:0/2251130861 wait complete. 2023-07-06T22:01:08.599 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T22:01:08.600 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:01:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.741+0000 7fc261e96640 1 Processor -- start 2023-07-06T22:01:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.741+0000 7fc261e96640 1 -- start start 2023-07-06T22:01:08.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.741+0000 7fc261e96640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc25c158400 0x7fc25c0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.741+0000 7fc261e96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc25c1587d0 0x7fc25c0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.741+0000 7fc261e96640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25c06fae0 con 0x7fc25c0c9680 2023-07-06T22:01:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.741+0000 7fc261e96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc25c06fdc0 con 0x7fc25c1587d0 2023-07-06T22:01:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.741+0000 7fc261e96640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc25c0700a0 con 0x7fc25c158400 2023-07-06T22:01:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.745+0000 7fc25bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc25c1587d0 0x7fc25c0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.745+0000 7fc25bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc25c1587d0 0x7fc25c0cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58244/0 (socket says 172.21.15.55:58244) 2023-07-06T22:01:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.745+0000 7fc25bfff640 1 -- 172.21.15.55:0/79427896 learned_addr learned my addr 172.21.15.55:0/79427896 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:08.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.745+0000 7fc25b7fe640 1 --2- 172.21.15.55:0/79427896 >> v2:172.21.15.138:3300/0 conn(0x7fc25c158400 0x7fc25c0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.745+0000 7fc25bfff640 1 -- 172.21.15.55:0/79427896 >> v2:172.21.15.138:3300/0 conn(0x7fc25c158400 msgr2=0x7fc25c0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:08.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.745+0000 7fc25bfff640 1 --2- 172.21.15.55:0/79427896 >> v2:172.21.15.138:3300/0 conn(0x7fc25c158400 0x7fc25c0c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.745+0000 7fc25bfff640 1 -- 172.21.15.55:0/79427896 >> v1:172.21.15.55:6789/0 conn(0x7fc25c0c9680 legacy=0x7fc25c070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.745+0000 7fc25bfff640 1 -- 172.21.15.55:0/79427896 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c070380 con 0x7fc25c1587d0 2023-07-06T22:01:08.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.745+0000 7fc25bfff640 1 --2- 172.21.15.55:0/79427896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc25c1587d0 0x7fc25c0cbaa0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fc25c06ed50 tx=0x7fc25401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722cf0bc802fc959 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:08.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.745+0000 7fc25a7fc640 1 -- 172.21.15.55:0/79427896 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2540a56e0 con 0x7fc25c1587d0 2023-07-06T22:01:08.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.745+0000 7fc25a7fc640 1 -- 172.21.15.55:0/79427896 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2540a5840 con 0x7fc25c1587d0 2023-07-06T22:01:08.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.745+0000 7fc25a7fc640 1 -- 172.21.15.55:0/79427896 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2540a5bd0 con 0x7fc25c1587d0 2023-07-06T22:01:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 -- 172.21.15.55:0/79427896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc25c1587d0 msgr2=0x7fc25c0cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 --2- 172.21.15.55:0/79427896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc25c1587d0 0x7fc25c0cbaa0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fc25c06ed50 tx=0x7fc25401c910 comp rx=0 tx=0).stop 2023-07-06T22:01:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 -- 172.21.15.55:0/79427896 shutdown_connections 2023-07-06T22:01:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 --2- 172.21.15.55:0/79427896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc25c1587d0 0x7fc25c0cbaa0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 --2- 172.21.15.55:0/79427896 >> v2:172.21.15.138:3300/0 conn(0x7fc25c158400 0x7fc25c0c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 -- 172.21.15.55:0/79427896 >> 172.21.15.55:0/79427896 conn(0x7fc25c0cded0 msgr2=0x7fc25c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:08.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 -- 172.21.15.55:0/79427896 shutdown_connections 2023-07-06T22:01:08.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 -- 172.21.15.55:0/79427896 wait complete. 2023-07-06T22:01:08.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 Processor -- start 2023-07-06T22:01:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 -- start start 2023-07-06T22:01:08.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc25c0c9680 0x7fc25c0b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc25c158400 0x7fc25c0c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc25c1587d0 0x7fc25c14c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c0b2300 con 0x7fc25c1587d0 2023-07-06T22:01:08.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c0c57d0 con 0x7fc25c158400 2023-07-06T22:01:08.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc261e96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c0b16f0 con 0x7fc25c0c9680 2023-07-06T22:01:08.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc25bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc25c1587d0 0x7fc25c14c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc25bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc25c1587d0 0x7fc25c14c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58254/0 (socket says 172.21.15.55:58254) 2023-07-06T22:01:08.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc25bfff640 1 -- 172.21.15.55:0/888194860 learned_addr learned my addr 172.21.15.55:0/888194860 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:08.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc25b7fe640 1 --2- 172.21.15.55:0/888194860 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc25c0c9680 0x7fc25c0b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc25affd640 1 --2- 172.21.15.55:0/888194860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc25c158400 0x7fc25c0c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc25bfff640 1 -- 172.21.15.55:0/888194860 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc25c0c9680 msgr2=0x7fc25c0b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc25bfff640 1 --2- 172.21.15.55:0/888194860 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc25c0c9680 0x7fc25c0b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc25bfff640 1 -- 172.21.15.55:0/888194860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc25c158400 msgr2=0x7fc25c0c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc25bfff640 1 --2- 172.21.15.55:0/888194860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc25c158400 0x7fc25c0c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.749+0000 7fc25bfff640 1 -- 172.21.15.55:0/888194860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254009b30 con 0x7fc25c1587d0 2023-07-06T22:01:08.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.753+0000 7fc25bfff640 1 --2- 172.21.15.55:0/888194860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc25c1587d0 0x7fc25c14c5d0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fc2540af040 tx=0x7fc2540196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:08.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.753+0000 7fc243fff640 1 -- 172.21.15.55:0/888194860 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2540b8670 con 0x7fc25c1587d0 2023-07-06T22:01:08.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.753+0000 7fc243fff640 1 -- 172.21.15.55:0/888194860 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2540b87d0 con 0x7fc25c1587d0 2023-07-06T22:01:08.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.753+0000 7fc243fff640 1 -- 172.21.15.55:0/888194860 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2540b8b80 con 0x7fc25c1587d0 2023-07-06T22:01:08.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.753+0000 7fc261e96640 1 -- 172.21.15.55:0/888194860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc25c0b19d0 con 0x7fc25c1587d0 2023-07-06T22:01:08.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.753+0000 7fc261e96640 1 -- 172.21.15.55:0/888194860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc25c0b1f90 con 0x7fc25c1587d0 2023-07-06T22:01:08.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.753+0000 7fc261e96640 1 -- 172.21.15.55:0/888194860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc25c06c580 con 0x7fc25c1587d0 2023-07-06T22:01:08.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.753+0000 7fc243fff640 1 -- 172.21.15.55:0/888194860 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 68) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fc2540b8ce0 con 0x7fc25c1587d0 2023-07-06T22:01:08.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.753+0000 7fc243fff640 1 --2- 172.21.15.55:0/888194860 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fc2480660d0 0x7fc248068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:08.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.753+0000 7fc243fff640 1 -- 172.21.15.55:0/888194860 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 7212+0+0 (secure 0 0 0) 0x7fc25411f180 con 0x7fc25c1587d0 2023-07-06T22:01:08.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.753+0000 7fc25b7fe640 1 --2- 172.21.15.55:0/888194860 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fc2480660d0 0x7fc248068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:08.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.757+0000 7fc25b7fe640 1 --2- 172.21.15.55:0/888194860 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fc2480660d0 0x7fc248068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009b60 tx=0x7fc24c009190 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:08.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.757+0000 7fc243fff640 1 -- 172.21.15.55:0/888194860 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2540ec680 con 0x7fc25c1587d0 2023-07-06T22:01:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.945+0000 7fc261e96640 1 -- 172.21.15.55:0/888194860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc25c066d60 con 0x7fc25c1587d0 2023-07-06T22:01:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.945+0000 7fc243fff640 1 -- 172.21.15.55:0/888194860 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fc254009510 con 0x7fc25c1587d0 2023-07-06T22:01:08.947 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:08.947 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/567276052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":567276052},{"type":"v1","addr":"172.21.15.138:6834","nonce":567276052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2227115466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2227115466},{"type":"v1","addr":"172.21.15.138:6835","nonce":2227115466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2611738616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2611738616},{"type":"v1","addr":"172.21.15.55:6836","nonce":2611738616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:00:19.496559+0000","modified":"2023-07-06T22:00:22.517164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8622":{"gid":8622,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1836658324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1836658324},{"type":"v1","addr":"172.21.15.55:6837","nonce":1836658324}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-06T22:01:08.947 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 54 2023-07-06T22:01:08.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.949+0000 7fc261e96640 1 -- 172.21.15.55:0/888194860 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fc2480660d0 msgr2=0x7fc248068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.949+0000 7fc261e96640 1 --2- 172.21.15.55:0/888194860 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fc2480660d0 0x7fc248068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009b60 tx=0x7fc24c009190 comp rx=0 tx=0).stop 2023-07-06T22:01:08.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.949+0000 7fc261e96640 1 -- 172.21.15.55:0/888194860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc25c1587d0 msgr2=0x7fc25c14c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:08.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.949+0000 7fc261e96640 1 --2- 172.21.15.55:0/888194860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc25c1587d0 0x7fc25c14c5d0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fc2540af040 tx=0x7fc2540196b0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.949+0000 7fc261e96640 1 -- 172.21.15.55:0/888194860 shutdown_connections 2023-07-06T22:01:08.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.949+0000 7fc261e96640 1 --2- 172.21.15.55:0/888194860 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fc2480660d0 0x7fc248068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.949+0000 7fc261e96640 1 --2- 172.21.15.55:0/888194860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc25c1587d0 0x7fc25c14c5d0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.949+0000 7fc261e96640 1 --2- 172.21.15.55:0/888194860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc25c158400 0x7fc25c0c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.949+0000 7fc261e96640 1 --2- 172.21.15.55:0/888194860 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc25c0c9680 0x7fc25c0b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:08.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.949+0000 7fc261e96640 1 -- 172.21.15.55:0/888194860 >> 172.21.15.55:0/888194860 conn(0x7fc25c0cded0 msgr2=0x7fc25c0aef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:08.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.949+0000 7fc261e96640 1 -- 172.21.15.55:0/888194860 shutdown_connections 2023-07-06T22:01:08.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:08.949+0000 7fc261e96640 1 -- 172.21.15.55:0/888194860 wait complete. 2023-07-06T22:01:08.968 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:01:09.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fde0160b640 1 Processor -- start 2023-07-06T22:01:09.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fde0160b640 1 -- start start 2023-07-06T22:01:09.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fde0160b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fddfc0b12e0 0x7fddfc0d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fde0160b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddfc0d00f0 0x7fddfc0d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fde0160b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddfc0d0a80 con 0x7fddfc0b1a40 2023-07-06T22:01:09.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fde0160b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc0b3be0 con 0x7fddfc0b12e0 2023-07-06T22:01:09.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fde0160b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc0b4590 con 0x7fddfc0d00f0 2023-07-06T22:01:09.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fddfbfff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fddfc0b12e0 0x7fddfc0d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fddfb7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddfc0d00f0 0x7fddfc0d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fde00e0a640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fddfc0b1a40 0x7fddfc0b1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:42094/0 (socket says 172.21.15.55:42094) 2023-07-06T22:01:09.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fde00e0a640 1 -- 172.21.15.55:0/2667053417 learned_addr learned my addr 172.21.15.55:0/2667053417 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:09.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fddfaffd640 1 -- 172.21.15.55:0/2667053417 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436945027 0 0) 0x7fddf40014a0 con 0x7fddfc0b1a40 2023-07-06T22:01:09.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fddfaffd640 1 -- 172.21.15.55:0/2667053417 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdde4003530 con 0x7fddfc0b1a40 2023-07-06T22:01:09.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fddfb7fe640 1 -- 172.21.15.55:0/2667053417 >> v2:172.21.15.138:3300/0 conn(0x7fddfc0b12e0 msgr2=0x7fddfc0d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:09.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fddfb7fe640 1 --2- 172.21.15.55:0/2667053417 >> v2:172.21.15.138:3300/0 conn(0x7fddfc0b12e0 0x7fddfc0d1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fddfb7fe640 1 -- 172.21.15.55:0/2667053417 >> v1:172.21.15.138:6789/0 conn(0x7fddfc0b1a40 legacy=0x7fddfc0b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fddfb7fe640 1 -- 172.21.15.55:0/2667053417 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc0b16b0 con 0x7fddfc0d00f0 2023-07-06T22:01:09.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.113+0000 7fddfbfff640 1 --2- 172.21.15.55:0/2667053417 >> v2:172.21.15.138:3300/0 conn(0x7fddfc0b12e0 0x7fddfc0d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:09.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.117+0000 7fddfb7fe640 1 --2- 172.21.15.55:0/2667053417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddfc0d00f0 0x7fddfc0d0540 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fddf00097c0 tx=0x7fddf001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14c279e0049531b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:09.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.117+0000 7fddfaffd640 1 -- 172.21.15.55:0/2667053417 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf00ab600 con 0x7fddfc0d00f0 2023-07-06T22:01:09.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.117+0000 7fddfaffd640 1 -- 172.21.15.55:0/2667053417 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf00a7050 con 0x7fddfc0d00f0 2023-07-06T22:01:09.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.117+0000 7fddfaffd640 1 -- 172.21.15.55:0/2667053417 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf00ab980 con 0x7fddfc0d00f0 2023-07-06T22:01:09.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.117+0000 7fde0160b640 1 -- 172.21.15.55:0/2667053417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddfc0d00f0 msgr2=0x7fddfc0d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.117+0000 7fde0160b640 1 --2- 172.21.15.55:0/2667053417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddfc0d00f0 0x7fddfc0d0540 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fddf00097c0 tx=0x7fddf001c480 comp rx=0 tx=0).stop 2023-07-06T22:01:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.117+0000 7fde0160b640 1 -- 172.21.15.55:0/2667053417 shutdown_connections 2023-07-06T22:01:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.117+0000 7fde0160b640 1 --2- 172.21.15.55:0/2667053417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddfc0d00f0 0x7fddfc0d0540 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.117+0000 7fde0160b640 1 --2- 172.21.15.55:0/2667053417 >> v2:172.21.15.138:3300/0 conn(0x7fddfc0b12e0 0x7fddfc0d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.117+0000 7fde0160b640 1 -- 172.21.15.55:0/2667053417 >> 172.21.15.55:0/2667053417 conn(0x7fddfc0d20e0 msgr2=0x7fddfc0d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.117+0000 7fde0160b640 1 -- 172.21.15.55:0/2667053417 shutdown_connections 2023-07-06T22:01:09.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.117+0000 7fde0160b640 1 -- 172.21.15.55:0/2667053417 wait complete. 2023-07-06T22:01:09.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde0160b640 1 Processor -- start 2023-07-06T22:01:09.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde0160b640 1 -- start start 2023-07-06T22:01:09.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde0160b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddfc0b12e0 0x7fddfc06ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde0160b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddfc0b1a40 0x7fddfc1484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde0160b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddfc0d00f0 0x7fddfc14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde0160b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc13a900 con 0x7fddfc0d00f0 2023-07-06T22:01:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde0160b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc153490 con 0x7fddfc0b1a40 2023-07-06T22:01:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde0160b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc06b260 con 0x7fddfc0b12e0 2023-07-06T22:01:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde00e0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddfc0d00f0 0x7fddfc14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde00e0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddfc0d00f0 0x7fddfc14acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58270/0 (socket says 172.21.15.55:58270) 2023-07-06T22:01:09.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde00e0a640 1 -- 172.21.15.55:0/326397692 learned_addr learned my addr 172.21.15.55:0/326397692 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:09.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fddfbfff640 1 --2- 172.21.15.55:0/326397692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddfc0b12e0 0x7fddfc06ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fddfb7fe640 1 --2- 172.21.15.55:0/326397692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddfc0b1a40 0x7fddfc1484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde00e0a640 1 -- 172.21.15.55:0/326397692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddfc0b12e0 msgr2=0x7fddfc06ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde00e0a640 1 --2- 172.21.15.55:0/326397692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddfc0b12e0 0x7fddfc06ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde00e0a640 1 -- 172.21.15.55:0/326397692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddfc0b1a40 msgr2=0x7fddfc1484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde00e0a640 1 --2- 172.21.15.55:0/326397692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddfc0b1a40 0x7fddfc1484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde00e0a640 1 -- 172.21.15.55:0/326397692 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec009420 con 0x7fddfc0d00f0 2023-07-06T22:01:09.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.121+0000 7fde00e0a640 1 --2- 172.21.15.55:0/326397692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddfc0d00f0 0x7fddfc14acb0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fddf400cb70 tx=0x7fddf400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:09.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.125+0000 7fddf8ff9640 1 -- 172.21.15.55:0/326397692 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf400ad40 con 0x7fddfc0d00f0 2023-07-06T22:01:09.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.125+0000 7fddf8ff9640 1 -- 172.21.15.55:0/326397692 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4012400 con 0x7fddfc0d00f0 2023-07-06T22:01:09.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.125+0000 7fde0160b640 1 -- 172.21.15.55:0/326397692 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf0009420 con 0x7fddfc0d00f0 2023-07-06T22:01:09.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.125+0000 7fddf8ff9640 1 -- 172.21.15.55:0/326397692 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf400aea0 con 0x7fddfc0d00f0 2023-07-06T22:01:09.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.125+0000 7fde0160b640 1 -- 172.21.15.55:0/326397692 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc1592c0 con 0x7fddfc0d00f0 2023-07-06T22:01:09.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.129+0000 7fde0160b640 1 -- 172.21.15.55:0/326397692 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddfc04d790 con 0x7fddfc0d00f0 2023-07-06T22:01:09.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.129+0000 7fddf8ff9640 1 -- 172.21.15.55:0/326397692 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 68) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fddf4007070 con 0x7fddfc0d00f0 2023-07-06T22:01:09.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.129+0000 7fddf8ff9640 1 --2- 172.21.15.55:0/326397692 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fdde80660d0 0x7fdde8068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.129+0000 7fddf8ff9640 1 -- 172.21.15.55:0/326397692 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 7212+0+0 (secure 0 0 0) 0x7fddf4083be0 con 0x7fddfc0d00f0 2023-07-06T22:01:09.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.129+0000 7fddfbfff640 1 --2- 172.21.15.55:0/326397692 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fdde80660d0 0x7fdde8068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.129+0000 7fddfbfff640 1 --2- 172.21.15.55:0/326397692 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fdde80660d0 0x7fdde8068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fddec009cf0 tx=0x7fddec009190 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:09.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.133+0000 7fddf8ff9640 1 -- 172.21.15.55:0/326397692 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fddf4050f50 con 0x7fddfc0d00f0 2023-07-06T22:01:09.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.149+0000 7fddf8ff9640 1 -- 172.21.15.55:0/326397692 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fddf4051320 con 0x7fddfc0d00f0 2023-07-06T22:01:09.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.325+0000 7fde0160b640 1 -- 172.21.15.55:0/326397692 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddfc0d0a80 con 0x7fddfc0d00f0 2023-07-06T22:01:09.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.329+0000 7fddf8ff9640 1 -- 172.21.15.55:0/326397692 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fddfc0d0a80 con 0x7fddfc0d00f0 2023-07-06T22:01:09.328 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:09.328 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/567276052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":567276052},{"type":"v1","addr":"172.21.15.138:6834","nonce":567276052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2227115466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2227115466},{"type":"v1","addr":"172.21.15.138:6835","nonce":2227115466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2611738616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2611738616},{"type":"v1","addr":"172.21.15.55:6836","nonce":2611738616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:00:19.496559+0000","modified":"2023-07-06T22:00:22.517164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8622":{"gid":8622,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/1836658324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1836658324},{"type":"v1","addr":"172.21.15.55:6837","nonce":1836658324}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-06T22:01:09.329 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 54 2023-07-06T22:01:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.329+0000 7fde0160b640 1 -- 172.21.15.55:0/326397692 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fdde80660d0 msgr2=0x7fdde8068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.329+0000 7fde0160b640 1 --2- 172.21.15.55:0/326397692 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fdde80660d0 0x7fdde8068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fddec009cf0 tx=0x7fddec009190 comp rx=0 tx=0).stop 2023-07-06T22:01:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.329+0000 7fde0160b640 1 -- 172.21.15.55:0/326397692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddfc0d00f0 msgr2=0x7fddfc14acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.329+0000 7fde0160b640 1 --2- 172.21.15.55:0/326397692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddfc0d00f0 0x7fddfc14acb0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fddf400cb70 tx=0x7fddf400a430 comp rx=0 tx=0).stop 2023-07-06T22:01:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.329+0000 7fde0160b640 1 -- 172.21.15.55:0/326397692 shutdown_connections 2023-07-06T22:01:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.329+0000 7fde0160b640 1 --2- 172.21.15.55:0/326397692 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fdde80660d0 0x7fdde8068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.329+0000 7fde0160b640 1 --2- 172.21.15.55:0/326397692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddfc0d00f0 0x7fddfc14acb0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.329+0000 7fde0160b640 1 --2- 172.21.15.55:0/326397692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddfc0b1a40 0x7fddfc1484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.329+0000 7fde0160b640 1 --2- 172.21.15.55:0/326397692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddfc0b12e0 0x7fddfc06ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.329+0000 7fde0160b640 1 -- 172.21.15.55:0/326397692 >> 172.21.15.55:0/326397692 conn(0x7fddfc0d20e0 msgr2=0x7fddfc0b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.329+0000 7fde0160b640 1 -- 172.21.15.55:0/326397692 shutdown_connections 2023-07-06T22:01:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.329+0000 7fde0160b640 1 -- 172.21.15.55:0/326397692 wait complete. 2023-07-06T22:01:09.349 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:01:09.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc70b59e640 1 Processor -- start 2023-07-06T22:01:09.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc70b59e640 1 -- start start 2023-07-06T22:01:09.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc70b59e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc70c15b9d0 0x7fc70c0b2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc70b59e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70c0cc770 con 0x7fc70c0ce5e0 2023-07-06T22:01:09.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc70b59e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70c0cc9c0 con 0x7fc70c0b42b0 2023-07-06T22:01:09.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc70b59e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70c0ccca0 con 0x7fc70c15b9d0 2023-07-06T22:01:09.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc709d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc70c0ce5e0 0x7fc70c0b3ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34368/0 (socket says 172.21.15.55:34368) 2023-07-06T22:01:09.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc709d9b640 1 -- 172.21.15.55:0/51484520 learned_addr learned my addr 172.21.15.55:0/51484520 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:09.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc70a59c640 1 --2- 172.21.15.55:0/51484520 >> v2:172.21.15.138:3300/0 conn(0x7fc70c15b9d0 0x7fc70c0b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc70959a640 1 -- 172.21.15.55:0/51484520 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831678875 0 0) 0x7fc70c0cc770 con 0x7fc70c0ce5e0 2023-07-06T22:01:09.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc70959a640 1 -- 172.21.15.55:0/51484520 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6f4003530 con 0x7fc70c0ce5e0 2023-07-06T22:01:09.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc70959a640 1 -- 172.21.15.55:0/51484520 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955794139 0 0) 0x7fc70c0cc9c0 con 0x7fc70c0b42b0 2023-07-06T22:01:09.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc70959a640 1 -- 172.21.15.55:0/51484520 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc70c0cc770 con 0x7fc70c0b42b0 2023-07-06T22:01:09.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc70a59c640 1 -- 172.21.15.55:0/51484520 >> v1:172.21.15.138:6789/0 conn(0x7fc70c0b42b0 legacy=0x7fc70c0d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc70a59c640 1 -- 172.21.15.55:0/51484520 >> v1:172.21.15.55:6789/0 conn(0x7fc70c0ce5e0 legacy=0x7fc70c0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.493+0000 7fc70a59c640 1 -- 172.21.15.55:0/51484520 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c0d0130 con 0x7fc70c15b9d0 2023-07-06T22:01:09.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.497+0000 7fc70a59c640 1 --2- 172.21.15.55:0/51484520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc70c15b9d0 0x7fc70c0b2440 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0097c0 tx=0x7fc6fc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=683d62d18b51783a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:09.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.497+0000 7fc70959a640 1 -- 172.21.15.55:0/51484520 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0ab640 con 0x7fc70c15b9d0 2023-07-06T22:01:09.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.497+0000 7fc70959a640 1 -- 172.21.15.55:0/51484520 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc0a7070 con 0x7fc70c15b9d0 2023-07-06T22:01:09.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.497+0000 7fc70959a640 1 -- 172.21.15.55:0/51484520 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0ab9c0 con 0x7fc70c15b9d0 2023-07-06T22:01:09.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.497+0000 7fc70b59e640 1 -- 172.21.15.55:0/51484520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc70c15b9d0 msgr2=0x7fc70c0b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.497+0000 7fc70b59e640 1 --2- 172.21.15.55:0/51484520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc70c15b9d0 0x7fc70c0b2440 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0097c0 tx=0x7fc6fc01c480 comp rx=0 tx=0).stop 2023-07-06T22:01:09.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.497+0000 7fc70b59e640 1 -- 172.21.15.55:0/51484520 shutdown_connections 2023-07-06T22:01:09.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.497+0000 7fc70b59e640 1 --2- 172.21.15.55:0/51484520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc70c15b9d0 0x7fc70c0b2440 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.497+0000 7fc70b59e640 1 -- 172.21.15.55:0/51484520 >> 172.21.15.55:0/51484520 conn(0x7fc70c06c2b0 msgr2=0x7fc70c0ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:09.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.497+0000 7fc70b59e640 1 -- 172.21.15.55:0/51484520 shutdown_connections 2023-07-06T22:01:09.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.497+0000 7fc70b59e640 1 -- 172.21.15.55:0/51484520 wait complete. 2023-07-06T22:01:09.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70b59e640 1 Processor -- start 2023-07-06T22:01:09.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70b59e640 1 -- start start 2023-07-06T22:01:09.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c0b42b0 0x7fc70c0ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70b59e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc70c0ce5e0 0x7fc70c0ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70b59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc70c15b9d0 0x7fc70c152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70b59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c151450 con 0x7fc70c0b42b0 2023-07-06T22:01:09.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70b59e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0cb8b0 con 0x7fc70c0ce5e0 2023-07-06T22:01:09.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70b59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c06a190 con 0x7fc70c15b9d0 2023-07-06T22:01:09.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c0b42b0 0x7fc70c0ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c0b42b0 0x7fc70c0ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58282/0 (socket says 172.21.15.55:58282) 2023-07-06T22:01:09.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70a59c640 1 -- 172.21.15.55:0/3317067726 learned_addr learned my addr 172.21.15.55:0/3317067726 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:09.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc709d9b640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc70c0ce5e0 0x7fc70c0ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70ad9d640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc70c15b9d0 0x7fc70c152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70a59c640 1 -- 172.21.15.55:0/3317067726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc70c15b9d0 msgr2=0x7fc70c152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70a59c640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc70c15b9d0 0x7fc70c152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70a59c640 1 -- 172.21.15.55:0/3317067726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc70c0ce5e0 msgr2=0x7fc70c0ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70a59c640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc70c0ce5e0 0x7fc70c0ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70a59c640 1 -- 172.21.15.55:0/3317067726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc009420 con 0x7fc70c0b42b0 2023-07-06T22:01:09.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc709d9b640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc70c0ce5e0 0x7fc70c0ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:09.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70a59c640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c0b42b0 0x7fc70c0ca3f0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0ad040 tx=0x7fc6fc01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:09.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc6faffd640 1 -- 172.21.15.55:0/3317067726 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0abe10 con 0x7fc70c0b42b0 2023-07-06T22:01:09.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc6faffd640 1 -- 172.21.15.55:0/3317067726 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc0bf410 con 0x7fc70c0b42b0 2023-07-06T22:01:09.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc6faffd640 1 -- 172.21.15.55:0/3317067726 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0bf7c0 con 0x7fc70c0b42b0 2023-07-06T22:01:09.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70b59e640 1 -- 172.21.15.55:0/3317067726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70c1507d0 con 0x7fc70c0b42b0 2023-07-06T22:01:09.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.501+0000 7fc70b59e640 1 -- 172.21.15.55:0/3317067726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70c150d90 con 0x7fc70c0b42b0 2023-07-06T22:01:09.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.505+0000 7fc70b59e640 1 -- 172.21.15.55:0/3317067726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70c04d790 con 0x7fc70c0b42b0 2023-07-06T22:01:09.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.505+0000 7fc6faffd640 1 -- 172.21.15.55:0/3317067726 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc6fc0b5400 con 0x7fc70c0b42b0 2023-07-06T22:01:09.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.505+0000 7fc6faffd640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fc6ec0663d0 0x7fc6ec068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.505+0000 7fc6faffd640 1 -- 172.21.15.55:0/3317067726 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 7212+0+0 (secure 0 0 0) 0x7fc6fc11e960 con 0x7fc70c0b42b0 2023-07-06T22:01:09.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.505+0000 7fc709d9b640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fc6ec0663d0 0x7fc6ec068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.505+0000 7fc709d9b640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fc6ec0663d0 0x7fc6ec068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0c5bc0 tx=0x7fc700009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:09.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.509+0000 7fc6faffd640 1 -- 172.21.15.55:0/3317067726 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6fc0eb750 con 0x7fc70c0b42b0 2023-07-06T22:01:09.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.665+0000 7fc70b59e640 1 -- 172.21.15.55:0/3317067726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc70c0b31e0 con 0x7fc70c0b42b0 2023-07-06T22:01:09.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.669+0000 7fc6faffd640 1 -- 172.21.15.55:0/3317067726 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+19736 (secure 0 0 0) 0x7fc6fc0eed70 con 0x7fc70c0b42b0 2023-07-06T22:01:09.669 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:09.669 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":134,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:01:08.117075+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:00:17.410451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-07-06T22:00:18.487297+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":134,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3688307648":"2023-07-07T22:01:07.113539+0000","172.21.15.55:6832/1146764448":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/4179834000":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/3903150954":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/386400094":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/3430803253":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/345640234":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/954036155":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/1438757296":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/3754412972":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/1384648608":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/2671638221":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/604485969":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/3447905990":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/2811517165":"2023-07-07T22:00:35.993679+0000","172.21.15.55:6833/3817107512":"2023-07-07T22:00:35.993679+0000","172.21.15.55:6833/1146764448":"2023-07-07T22:01:07.113539+0000","172.21.15.55:6832/3817107512":"2023-07-07T22:00:35.993679+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:01:09.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.669+0000 7fc70b59e640 1 -- 172.21.15.55:0/3317067726 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fc6ec0663d0 msgr2=0x7fc6ec068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.669+0000 7fc70b59e640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fc6ec0663d0 0x7fc6ec068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0c5bc0 tx=0x7fc700009040 comp rx=0 tx=0).stop 2023-07-06T22:01:09.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.669+0000 7fc70b59e640 1 -- 172.21.15.55:0/3317067726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c0b42b0 msgr2=0x7fc70c0ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.669+0000 7fc70b59e640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c0b42b0 0x7fc70c0ca3f0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0ad040 tx=0x7fc6fc01acc0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.669+0000 7fc70b59e640 1 -- 172.21.15.55:0/3317067726 shutdown_connections 2023-07-06T22:01:09.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.669+0000 7fc70b59e640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fc6ec0663d0 0x7fc6ec068880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.669+0000 7fc70b59e640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc70c15b9d0 0x7fc70c152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.669+0000 7fc70b59e640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc70c0ce5e0 0x7fc70c0ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.669+0000 7fc70b59e640 1 --2- 172.21.15.55:0/3317067726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c0b42b0 0x7fc70c0ca3f0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.669+0000 7fc70b59e640 1 -- 172.21.15.55:0/3317067726 >> 172.21.15.55:0/3317067726 conn(0x7fc70c06c2b0 msgr2=0x7fc70c0d29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:09.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.669+0000 7fc70b59e640 1 -- 172.21.15.55:0/3317067726 shutdown_connections 2023-07-06T22:01:09.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.669+0000 7fc70b59e640 1 -- 172.21.15.55:0/3317067726 wait complete. 2023-07-06T22:01:09.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T22:01:09.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.833+0000 7fa8997a3640 1 Processor -- start 2023-07-06T22:01:09.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.833+0000 7fa8997a3640 1 -- start start 2023-07-06T22:01:09.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.837+0000 7fa8997a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8940b3f40 0x7fa89415f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.837+0000 7fa8997a3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa8940cfc20 0x7fa8940b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.837+0000 7fa8997a3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8940b4420 con 0x7fa89415f520 2023-07-06T22:01:09.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.837+0000 7fa8997a3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8940b1ab0 con 0x7fa8940cfc20 2023-07-06T22:01:09.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.837+0000 7fa8997a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89415fe30 con 0x7fa8940b3f40 2023-07-06T22:01:09.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.837+0000 7fa8937fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa8940cfc20 0x7fa8940b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.837+0000 7fa88bfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8940b3f40 0x7fa89415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.837+0000 7fa892ffd640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fa89415f520 0x7fa8940ce310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:42112/0 (socket says 172.21.15.55:42112) 2023-07-06T22:01:09.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.837+0000 7fa892ffd640 1 -- 172.21.15.55:0/1092071903 learned_addr learned my addr 172.21.15.55:0/1092071903 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:09.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.837+0000 7fa88bfff640 1 -- 172.21.15.55:0/1092071903 >> v2:172.21.15.138:3300/0 conn(0x7fa8940cfc20 msgr2=0x7fa8940b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:09.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.837+0000 7fa88bfff640 1 --2- 172.21.15.55:0/1092071903 >> v2:172.21.15.138:3300/0 conn(0x7fa8940cfc20 0x7fa8940b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.837+0000 7fa88bfff640 1 -- 172.21.15.55:0/1092071903 >> v1:172.21.15.138:6789/0 conn(0x7fa89415f520 legacy=0x7fa8940ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.837+0000 7fa8927fc640 1 -- 172.21.15.55:0/1092071903 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868050879 0 0) 0x7fa8940b4420 con 0x7fa89415f520 2023-07-06T22:01:09.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.837+0000 7fa88bfff640 1 -- 172.21.15.55:0/1092071903 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8940cc740 con 0x7fa8940b3f40 2023-07-06T22:01:09.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.841+0000 7fa88bfff640 1 --2- 172.21.15.55:0/1092071903 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8940b3f40 0x7fa89415f8f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0097c0 tx=0x7fa87c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23ef4979d5c511c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:09.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.841+0000 7fa8927fc640 1 -- 172.21.15.55:0/1092071903 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c0ac620 con 0x7fa8940b3f40 2023-07-06T22:01:09.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.841+0000 7fa8927fc640 1 -- 172.21.15.55:0/1092071903 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c0ac780 con 0x7fa8940b3f40 2023-07-06T22:01:09.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.841+0000 7fa8927fc640 1 -- 172.21.15.55:0/1092071903 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c0acb10 con 0x7fa8940b3f40 2023-07-06T22:01:09.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.841+0000 7fa8997a3640 1 -- 172.21.15.55:0/1092071903 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8940b3f40 msgr2=0x7fa89415f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.841+0000 7fa8997a3640 1 --2- 172.21.15.55:0/1092071903 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8940b3f40 0x7fa89415f8f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0097c0 tx=0x7fa87c01c3c0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.841+0000 7fa8997a3640 1 -- 172.21.15.55:0/1092071903 shutdown_connections 2023-07-06T22:01:09.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.841+0000 7fa8997a3640 1 --2- 172.21.15.55:0/1092071903 >> v2:172.21.15.138:3300/0 conn(0x7fa8940cfc20 0x7fa8940b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.841+0000 7fa8997a3640 1 --2- 172.21.15.55:0/1092071903 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8940b3f40 0x7fa89415f8f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.841+0000 7fa8997a3640 1 -- 172.21.15.55:0/1092071903 >> 172.21.15.55:0/1092071903 conn(0x7fa8940cead0 msgr2=0x7fa8940ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:09.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.841+0000 7fa8997a3640 1 -- 172.21.15.55:0/1092071903 shutdown_connections 2023-07-06T22:01:09.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.841+0000 7fa8997a3640 1 -- 172.21.15.55:0/1092071903 wait complete. 2023-07-06T22:01:09.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.841+0000 7fa8997a3640 1 Processor -- start 2023-07-06T22:01:09.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.841+0000 7fa8997a3640 1 -- start start 2023-07-06T22:01:09.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa8997a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8940b3f40 0x7fa8941f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa8997a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8940cfc20 0x7fa894150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa8997a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa89415f520 0x7fa89415a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa8997a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa894150560 con 0x7fa8940cfc20 2023-07-06T22:01:09.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa8997a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8940b5b10 con 0x7fa89415f520 2023-07-06T22:01:09.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa8997a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8941f44a0 con 0x7fa8940b3f40 2023-07-06T22:01:09.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa88bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8940cfc20 0x7fa894150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa88bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8940cfc20 0x7fa894150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58290/0 (socket says 172.21.15.55:58290) 2023-07-06T22:01:09.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa88bfff640 1 -- 172.21.15.55:0/1321233800 learned_addr learned my addr 172.21.15.55:0/1321233800 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:09.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa892ffd640 1 --2- 172.21.15.55:0/1321233800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8940b3f40 0x7fa8941f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa8937fe640 1 --2- 172.21.15.55:0/1321233800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa89415f520 0x7fa89415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa88bfff640 1 -- 172.21.15.55:0/1321233800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8940b3f40 msgr2=0x7fa8941f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa88bfff640 1 --2- 172.21.15.55:0/1321233800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8940b3f40 0x7fa8941f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa88bfff640 1 -- 172.21.15.55:0/1321233800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa89415f520 msgr2=0x7fa89415a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa88bfff640 1 --2- 172.21.15.55:0/1321233800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa89415f520 0x7fa89415a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa88bfff640 1 -- 172.21.15.55:0/1321233800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c009420 con 0x7fa8940cfc20 2023-07-06T22:01:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa88bfff640 1 --2- 172.21.15.55:0/1321233800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8940cfc20 0x7fa894150020 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fa87c019ff0 tx=0x7fa87c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:09.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa88b7fe640 1 -- 172.21.15.55:0/1321233800 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c0b5400 con 0x7fa8940cfc20 2023-07-06T22:01:09.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa88b7fe640 1 -- 172.21.15.55:0/1321233800 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c0b5560 con 0x7fa8940cfc20 2023-07-06T22:01:09.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa88b7fe640 1 -- 172.21.15.55:0/1321233800 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c0b58d0 con 0x7fa8940cfc20 2023-07-06T22:01:09.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa8997a3640 1 -- 172.21.15.55:0/1321233800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89415ae20 con 0x7fa8940cfc20 2023-07-06T22:01:09.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa8997a3640 1 -- 172.21.15.55:0/1321233800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8941f4760 con 0x7fa8940cfc20 2023-07-06T22:01:09.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.845+0000 7fa8997a3640 1 -- 172.21.15.55:0/1321233800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89415b2d0 con 0x7fa8940cfc20 2023-07-06T22:01:09.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.849+0000 7fa88b7fe640 1 -- 172.21.15.55:0/1321233800 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa87c0b3040 con 0x7fa8940cfc20 2023-07-06T22:01:09.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.849+0000 7fa88b7fe640 1 --2- 172.21.15.55:0/1321233800 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa8740663a0 0x7fa874068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:09.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.849+0000 7fa88b7fe640 1 -- 172.21.15.55:0/1321233800 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 7212+0+0 (secure 0 0 0) 0x7fa87c11e460 con 0x7fa8940cfc20 2023-07-06T22:01:09.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.849+0000 7fa892ffd640 1 --2- 172.21.15.55:0/1321233800 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa8740663a0 0x7fa874068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:09.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.849+0000 7fa892ffd640 1 --2- 172.21.15.55:0/1321233800 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa8740663a0 0x7fa874068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa884007fd0 tx=0x7fa884007d60 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:09.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:09.853+0000 7fa88b7fe640 1 -- 172.21.15.55:0/1321233800 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa87c0eb2e0 con 0x7fa8940cfc20 2023-07-06T22:01:10.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.041+0000 7fa8997a3640 1 -- 172.21.15.55:0/1321233800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa89404d790 con 0x7fa8940cfc20 2023-07-06T22:01:10.715 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-07-06T22:01:10.717+0000 7f5b6d80c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T22:01:10.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.725+0000 7fa88b7fe640 1 -- 172.21.15.55:0/1321233800 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa87c0ba020 con 0x7fa8940cfc20 2023-07-06T22:01:10.724 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T22:01:10.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.725+0000 7fa8997a3640 1 -- 172.21.15.55:0/1321233800 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa8740663a0 msgr2=0x7fa874068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:10.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.725+0000 7fa8997a3640 1 --2- 172.21.15.55:0/1321233800 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa8740663a0 0x7fa874068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa884007fd0 tx=0x7fa884007d60 comp rx=0 tx=0).stop 2023-07-06T22:01:10.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.725+0000 7fa8997a3640 1 -- 172.21.15.55:0/1321233800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8940cfc20 msgr2=0x7fa894150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:10.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.725+0000 7fa8997a3640 1 --2- 172.21.15.55:0/1321233800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8940cfc20 0x7fa894150020 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fa87c019ff0 tx=0x7fa87c019160 comp rx=0 tx=0).stop 2023-07-06T22:01:10.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.725+0000 7fa8997a3640 1 -- 172.21.15.55:0/1321233800 shutdown_connections 2023-07-06T22:01:10.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.725+0000 7fa8997a3640 1 --2- 172.21.15.55:0/1321233800 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa8740663a0 0x7fa874068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:10.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.725+0000 7fa8997a3640 1 --2- 172.21.15.55:0/1321233800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa89415f520 0x7fa89415a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:10.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.725+0000 7fa8997a3640 1 --2- 172.21.15.55:0/1321233800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8940cfc20 0x7fa894150020 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:10.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.725+0000 7fa8997a3640 1 --2- 172.21.15.55:0/1321233800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8940b3f40 0x7fa8941f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:10.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.725+0000 7fa8997a3640 1 -- 172.21.15.55:0/1321233800 >> 172.21.15.55:0/1321233800 conn(0x7fa8940cead0 msgr2=0x7fa894157ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:10.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.725+0000 7fa8997a3640 1 -- 172.21.15.55:0/1321233800 shutdown_connections 2023-07-06T22:01:10.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.725+0000 7fa8997a3640 1 -- 172.21.15.55:0/1321233800 wait complete. 2023-07-06T22:01:10.734 INFO:tasks.ceph.mds.c.smithi055.stderr: -7712> 2023-07-06T22:00:20.062+0000 7fd26bfa4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T22:01:10.747 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T22:01:10.790 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T22:01:10.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.897+0000 7fbf05fd3640 1 Processor -- start 2023-07-06T22:01:10.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.897+0000 7fbf05fd3640 1 -- start start 2023-07-06T22:01:10.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.897+0000 7fbf05fd3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf00156180 0x7fbf000ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:10.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.897+0000 7fbf05fd3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbf000cbeb0 0x7fbf0006ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:10.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.897+0000 7fbf05fd3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0006f360 con 0x7fbf0006e9d0 2023-07-06T22:01:10.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.897+0000 7fbf05fd3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf00160250 con 0x7fbf000cbeb0 2023-07-06T22:01:10.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.897+0000 7fbf05fd3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000cc310 con 0x7fbf00156180 2023-07-06T22:01:10.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.897+0000 7fbefeffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbf0006e9d0 0x7fbf000cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34398/0 (socket says 172.21.15.55:34398) 2023-07-06T22:01:10.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.897+0000 7fbefeffd640 1 -- 172.21.15.55:0/1746350503 learned_addr learned my addr 172.21.15.55:0/1746350503 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.901+0000 7fbeff7fe640 1 --2- 172.21.15.55:0/1746350503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf00156180 0x7fbf000ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.897+0000 7fbefffff640 1 --2- 172.21.15.55:0/1746350503 >> v2:172.21.15.138:3300/0 conn(0x7fbf000cbeb0 0x7fbf0006ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.901+0000 7fbefe7fc640 1 -- 172.21.15.55:0/1746350503 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193661937 0 0) 0x7fbef4001120 con 0x7fbf0006e9d0 2023-07-06T22:01:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.901+0000 7fbefe7fc640 1 -- 172.21.15.55:0/1746350503 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbee8003530 con 0x7fbf0006e9d0 2023-07-06T22:01:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.901+0000 7fbeff7fe640 1 -- 172.21.15.55:0/1746350503 >> v2:172.21.15.138:3300/0 conn(0x7fbf000cbeb0 msgr2=0x7fbf0006ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.901+0000 7fbeff7fe640 1 --2- 172.21.15.55:0/1746350503 >> v2:172.21.15.138:3300/0 conn(0x7fbf000cbeb0 0x7fbf0006ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:10.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.901+0000 7fbeff7fe640 1 -- 172.21.15.55:0/1746350503 >> v1:172.21.15.55:6789/0 conn(0x7fbf0006e9d0 legacy=0x7fbf000cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:10.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.901+0000 7fbeff7fe640 1 -- 172.21.15.55:0/1746350503 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0015f5d0 con 0x7fbf00156180 2023-07-06T22:01:10.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.901+0000 7fbeff7fe640 1 --2- 172.21.15.55:0/1746350503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf00156180 0x7fbf000ca610 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbef00097c0 tx=0x7fbef001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cf82c995e90d6d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:10.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbefe7fc640 1 -- 172.21.15.55:0/1746350503 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00ac620 con 0x7fbf00156180 2023-07-06T22:01:10.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbefe7fc640 1 -- 172.21.15.55:0/1746350503 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef00ac780 con 0x7fbf00156180 2023-07-06T22:01:10.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbefe7fc640 1 -- 172.21.15.55:0/1746350503 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00acb10 con 0x7fbf00156180 2023-07-06T22:01:10.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 -- 172.21.15.55:0/1746350503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf00156180 msgr2=0x7fbf000ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:10.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 --2- 172.21.15.55:0/1746350503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf00156180 0x7fbf000ca610 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbef00097c0 tx=0x7fbef001c3c0 comp rx=0 tx=0).stop 2023-07-06T22:01:10.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 -- 172.21.15.55:0/1746350503 shutdown_connections 2023-07-06T22:01:10.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 --2- 172.21.15.55:0/1746350503 >> v2:172.21.15.138:3300/0 conn(0x7fbf000cbeb0 0x7fbf0006ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:10.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 --2- 172.21.15.55:0/1746350503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf00156180 0x7fbf000ca610 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:10.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 -- 172.21.15.55:0/1746350503 >> 172.21.15.55:0/1746350503 conn(0x7fbf000d0c50 msgr2=0x7fbf000cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:10.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 -- 172.21.15.55:0/1746350503 shutdown_connections 2023-07-06T22:01:10.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 -- 172.21.15.55:0/1746350503 wait complete. 2023-07-06T22:01:10.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 Processor -- start 2023-07-06T22:01:10.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 -- start start 2023-07-06T22:01:10.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0006e9d0 0x7fbf00158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:10.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf000cbeb0 0x7fbf0014f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:10.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf00156180 0x7fbf001fc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:10.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000b2530 con 0x7fbf0006e9d0 2023-07-06T22:01:10.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf00156760 con 0x7fbf000cbeb0 2023-07-06T22:01:10.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbf05fd3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000b2710 con 0x7fbf00156180 2023-07-06T22:01:10.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbeff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0006e9d0 0x7fbf00158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:10.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbeff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0006e9d0 0x7fbf00158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58334/0 (socket says 172.21.15.55:58334) 2023-07-06T22:01:10.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbeff7fe640 1 -- 172.21.15.55:0/4238193632 learned_addr learned my addr 172.21.15.55:0/4238193632 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:10.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbefeffd640 1 --2- 172.21.15.55:0/4238193632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf000cbeb0 0x7fbf0014f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:10.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.905+0000 7fbefffff640 1 --2- 172.21.15.55:0/4238193632 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf00156180 0x7fbf001fc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:10.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbeff7fe640 1 -- 172.21.15.55:0/4238193632 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf00156180 msgr2=0x7fbf001fc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:10.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbeff7fe640 1 --2- 172.21.15.55:0/4238193632 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf00156180 0x7fbf001fc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:10.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbeff7fe640 1 -- 172.21.15.55:0/4238193632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf000cbeb0 msgr2=0x7fbf0014f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:10.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbeff7fe640 1 --2- 172.21.15.55:0/4238193632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf000cbeb0 0x7fbf0014f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:10.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbeff7fe640 1 -- 172.21.15.55:0/4238193632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef0009420 con 0x7fbf0006e9d0 2023-07-06T22:01:10.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbeff7fe640 1 --2- 172.21.15.55:0/4238193632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0006e9d0 0x7fbf00158d20 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fbef0019ff0 tx=0x7fbef0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:10.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbee7fff640 1 -- 172.21.15.55:0/4238193632 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00b7480 con 0x7fbf0006e9d0 2023-07-06T22:01:10.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbee7fff640 1 -- 172.21.15.55:0/4238193632 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef00b75e0 con 0x7fbf0006e9d0 2023-07-06T22:01:10.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbee7fff640 1 -- 172.21.15.55:0/4238193632 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00b7990 con 0x7fbf0006e9d0 2023-07-06T22:01:10.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbf05fd3640 1 -- 172.21.15.55:0/4238193632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf00156970 con 0x7fbf0006e9d0 2023-07-06T22:01:10.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbf05fd3640 1 -- 172.21.15.55:0/4238193632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf00156f30 con 0x7fbf0006e9d0 2023-07-06T22:01:10.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbf05fd3640 1 -- 172.21.15.55:0/4238193632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf00066d60 con 0x7fbf0006e9d0 2023-07-06T22:01:10.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbee7fff640 1 -- 172.21.15.55:0/4238193632 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbef00b3040 con 0x7fbf0006e9d0 2023-07-06T22:01:10.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbee7fff640 1 --2- 172.21.15.55:0/4238193632 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fbeec0663a0 0x7fbeec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:10.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.909+0000 7fbee7fff640 1 -- 172.21.15.55:0/4238193632 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 7270+0+0 (secure 0 0 0) 0x7fbef011ed70 con 0x7fbf0006e9d0 2023-07-06T22:01:10.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.913+0000 7fbefeffd640 1 --2- 172.21.15.55:0/4238193632 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fbeec0663a0 0x7fbeec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:10.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.913+0000 7fbefeffd640 1 --2- 172.21.15.55:0/4238193632 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fbeec0663a0 0x7fbeec068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbf00154b00 tx=0x7fbef4009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:10.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:10.913+0000 7fbee7fff640 1 -- 172.21.15.55:0/4238193632 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbef00ebaa0 con 0x7fbf0006e9d0 2023-07-06T22:01:11.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.105+0000 7fbf05fd3640 1 -- 172.21.15.55:0/4238193632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbf000b2310 con 0x7fbf0006e9d0 2023-07-06T22:01:11.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.733+0000 7fbee7fff640 1 -- 172.21.15.55:0/4238193632 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbef00ef0c0 con 0x7fbf0006e9d0 2023-07-06T22:01:11.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.737+0000 7fbf05fd3640 1 -- 172.21.15.55:0/4238193632 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fbeec0663a0 msgr2=0x7fbeec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:11.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.737+0000 7fbf05fd3640 1 --2- 172.21.15.55:0/4238193632 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fbeec0663a0 0x7fbeec068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbf00154b00 tx=0x7fbef4009040 comp rx=0 tx=0).stop 2023-07-06T22:01:11.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.737+0000 7fbf05fd3640 1 -- 172.21.15.55:0/4238193632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0006e9d0 msgr2=0x7fbf00158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:11.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.737+0000 7fbf05fd3640 1 --2- 172.21.15.55:0/4238193632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0006e9d0 0x7fbf00158d20 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fbef0019ff0 tx=0x7fbef0019160 comp rx=0 tx=0).stop 2023-07-06T22:01:11.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.737+0000 7fbf05fd3640 1 -- 172.21.15.55:0/4238193632 shutdown_connections 2023-07-06T22:01:11.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.737+0000 7fbf05fd3640 1 --2- 172.21.15.55:0/4238193632 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fbeec0663a0 0x7fbeec068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:11.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.737+0000 7fbf05fd3640 1 --2- 172.21.15.55:0/4238193632 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf00156180 0x7fbf001fc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:11.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.737+0000 7fbf05fd3640 1 --2- 172.21.15.55:0/4238193632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf000cbeb0 0x7fbf0014f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:11.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.737+0000 7fbf05fd3640 1 --2- 172.21.15.55:0/4238193632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0006e9d0 0x7fbf00158d20 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:11.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.737+0000 7fbf05fd3640 1 -- 172.21.15.55:0/4238193632 >> 172.21.15.55:0/4238193632 conn(0x7fbf000d0c50 msgr2=0x7fbf000ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:11.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.737+0000 7fbf05fd3640 1 -- 172.21.15.55:0/4238193632 shutdown_connections 2023-07-06T22:01:11.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.737+0000 7fbf05fd3640 1 -- 172.21.15.55:0/4238193632 wait complete. 2023-07-06T22:01:11.758 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T22:01:11.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.945+0000 7fba64ecb640 1 Processor -- start 2023-07-06T22:01:11.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.945+0000 7fba64ecb640 1 -- start start 2023-07-06T22:01:11.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba64ecb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba60158780 0x7fba600cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:11.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba64ecb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba600cbfa0 0x7fba6006f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:11.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba64ecb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba60158b50 con 0x7fba600c89b0 2023-07-06T22:01:11.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba64ecb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba6006b390 con 0x7fba600cbfa0 2023-07-06T22:01:11.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba64ecb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba600cd3d0 con 0x7fba60158780 2023-07-06T22:01:11.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba5ed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fba600c89b0 0x7fba6006c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34406/0 (socket says 172.21.15.55:34406) 2023-07-06T22:01:11.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba57fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba600cbfa0 0x7fba6006f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:11.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba5ed9d640 1 -- 172.21.15.55:0/2470658678 learned_addr learned my addr 172.21.15.55:0/2470658678 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:11.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba5e59c640 1 --2- 172.21.15.55:0/2470658678 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba60158780 0x7fba600cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:11.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba5dd9b640 1 -- 172.21.15.55:0/2470658678 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737238807 0 0) 0x7fba60158b50 con 0x7fba600c89b0 2023-07-06T22:01:11.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba5dd9b640 1 -- 172.21.15.55:0/2470658678 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba4c003530 con 0x7fba600c89b0 2023-07-06T22:01:11.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba57fff640 1 -- 172.21.15.55:0/2470658678 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba60158780 msgr2=0x7fba600cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:11.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba57fff640 1 --2- 172.21.15.55:0/2470658678 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba60158780 0x7fba600cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:11.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba57fff640 1 -- 172.21.15.55:0/2470658678 >> v1:172.21.15.55:6789/0 conn(0x7fba600c89b0 legacy=0x7fba6006c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:11.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba57fff640 1 -- 172.21.15.55:0/2470658678 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6006b630 con 0x7fba600cbfa0 2023-07-06T22:01:11.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.949+0000 7fba5e59c640 1 --2- 172.21.15.55:0/2470658678 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba60158780 0x7fba600cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:11.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba57fff640 1 --2- 172.21.15.55:0/2470658678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba600cbfa0 0x7fba6006f3f0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fba480097c0 tx=0x7fba4801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf8a24866ed6325 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba5dd9b640 1 -- 172.21.15.55:0/2470658678 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480ab600 con 0x7fba600cbfa0 2023-07-06T22:01:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba5dd9b640 1 -- 172.21.15.55:0/2470658678 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba480a7050 con 0x7fba600cbfa0 2023-07-06T22:01:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba5dd9b640 1 -- 172.21.15.55:0/2470658678 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480ab980 con 0x7fba600cbfa0 2023-07-06T22:01:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba64ecb640 1 -- 172.21.15.55:0/2470658678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba600cbfa0 msgr2=0x7fba6006f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba64ecb640 1 --2- 172.21.15.55:0/2470658678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba600cbfa0 0x7fba6006f3f0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fba480097c0 tx=0x7fba4801c3f0 comp rx=0 tx=0).stop 2023-07-06T22:01:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba64ecb640 1 -- 172.21.15.55:0/2470658678 shutdown_connections 2023-07-06T22:01:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba64ecb640 1 --2- 172.21.15.55:0/2470658678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba600cbfa0 0x7fba6006f3f0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba64ecb640 1 --2- 172.21.15.55:0/2470658678 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba60158780 0x7fba600cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:11.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba64ecb640 1 -- 172.21.15.55:0/2470658678 >> 172.21.15.55:0/2470658678 conn(0x7fba600cde30 msgr2=0x7fba600ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:11.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba64ecb640 1 -- 172.21.15.55:0/2470658678 shutdown_connections 2023-07-06T22:01:11.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba64ecb640 1 -- 172.21.15.55:0/2470658678 wait complete. 2023-07-06T22:01:11.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba64ecb640 1 Processor -- start 2023-07-06T22:01:11.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba64ecb640 1 -- start start 2023-07-06T22:01:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba64ecb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba600c89b0 0x7fba601f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.953+0000 7fba64ecb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba600cbfa0 0x7fba60152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba64ecb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba60158780 0x7fba600b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba64ecb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba60159c40 con 0x7fba600cbfa0 2023-07-06T22:01:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba64ecb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba60159910 con 0x7fba600c89b0 2023-07-06T22:01:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba64ecb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba60153cf0 con 0x7fba60158780 2023-07-06T22:01:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba57fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba600cbfa0 0x7fba60152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba57fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba600cbfa0 0x7fba60152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58356/0 (socket says 172.21.15.55:58356) 2023-07-06T22:01:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba57fff640 1 -- 172.21.15.55:0/289711869 learned_addr learned my addr 172.21.15.55:0/289711869 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba5ed9d640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba60158780 0x7fba600b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba5e59c640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba600c89b0 0x7fba601f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba57fff640 1 -- 172.21.15.55:0/289711869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba60158780 msgr2=0x7fba600b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba57fff640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba60158780 0x7fba600b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba57fff640 1 -- 172.21.15.55:0/289711869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba600c89b0 msgr2=0x7fba601f40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba57fff640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba600c89b0 0x7fba601f40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba57fff640 1 -- 172.21.15.55:0/289711869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba48009420 con 0x7fba600cbfa0 2023-07-06T22:01:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba5e59c640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba600c89b0 0x7fba601f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba5ed9d640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba60158780 0x7fba600b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba57fff640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba600cbfa0 0x7fba60152c80 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fba480ae040 tx=0x7fba4801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba56ffd640 1 -- 172.21.15.55:0/289711869 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480b7450 con 0x7fba600cbfa0 2023-07-06T22:01:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba56ffd640 1 -- 172.21.15.55:0/289711869 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba480b75b0 con 0x7fba600cbfa0 2023-07-06T22:01:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba56ffd640 1 -- 172.21.15.55:0/289711869 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480b7960 con 0x7fba600cbfa0 2023-07-06T22:01:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba64ecb640 1 -- 172.21.15.55:0/289711869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba60153730 con 0x7fba600cbfa0 2023-07-06T22:01:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba64ecb640 1 -- 172.21.15.55:0/289711869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba600b3770 con 0x7fba600cbfa0 2023-07-06T22:01:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba64ecb640 1 -- 172.21.15.55:0/289711869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba60066d60 con 0x7fba600cbfa0 2023-07-06T22:01:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.957+0000 7fba56ffd640 1 -- 172.21.15.55:0/289711869 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fba480b7ac0 con 0x7fba600cbfa0 2023-07-06T22:01:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.961+0000 7fba56ffd640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fba400663a0 0x7fba40068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.961+0000 7fba56ffd640 1 -- 172.21.15.55:0/289711869 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 7270+0+0 (secure 0 0 0) 0x7fba4811ede0 con 0x7fba600cbfa0 2023-07-06T22:01:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.961+0000 7fba5e59c640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fba400663a0 0x7fba40068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.961+0000 7fba5e59c640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fba400663a0 0x7fba40068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba500079d0 tx=0x7fba50008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:11.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:11.965+0000 7fba56ffd640 1 -- 172.21.15.55:0/289711869 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fba480ebc00 con 0x7fba600cbfa0 2023-07-06T22:01:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.117+0000 7fba64ecb640 1 -- 172.21.15.55:0/289711869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fba60163330 con 0x7fba600cbfa0 2023-07-06T22:01:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.741+0000 7fba56ffd640 1 -- 172.21.15.55:0/289711869 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v136) v1 ==== 181+0+0 (secure 0 0 0) 0x7fba480bb0d0 con 0x7fba600cbfa0 2023-07-06T22:01:12.742 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-07-06T22:01:12.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.745+0000 7fba64ecb640 1 -- 172.21.15.55:0/289711869 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fba400663a0 msgr2=0x7fba40068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:12.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.745+0000 7fba64ecb640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fba400663a0 0x7fba40068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba500079d0 tx=0x7fba50008040 comp rx=0 tx=0).stop 2023-07-06T22:01:12.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.745+0000 7fba64ecb640 1 -- 172.21.15.55:0/289711869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba600cbfa0 msgr2=0x7fba60152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:12.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.745+0000 7fba64ecb640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba600cbfa0 0x7fba60152c80 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fba480ae040 tx=0x7fba4801ac30 comp rx=0 tx=0).stop 2023-07-06T22:01:12.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.745+0000 7fba64ecb640 1 -- 172.21.15.55:0/289711869 shutdown_connections 2023-07-06T22:01:12.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.745+0000 7fba64ecb640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fba400663a0 0x7fba40068850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:12.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.745+0000 7fba64ecb640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba60158780 0x7fba600b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:12.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.745+0000 7fba64ecb640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba600cbfa0 0x7fba60152c80 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:12.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.745+0000 7fba64ecb640 1 --2- 172.21.15.55:0/289711869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba600c89b0 0x7fba601f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:12.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.749+0000 7fba64ecb640 1 -- 172.21.15.55:0/289711869 >> 172.21.15.55:0/289711869 conn(0x7fba600cde30 msgr2=0x7fba600acc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:12.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.749+0000 7fba64ecb640 1 -- 172.21.15.55:0/289711869 shutdown_connections 2023-07-06T22:01:12.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.749+0000 7fba64ecb640 1 -- 172.21.15.55:0/289711869 wait complete. 2023-07-06T22:01:12.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T22:01:12.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.929+0000 7f6707018640 1 Processor -- start 2023-07-06T22:01:12.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.929+0000 7f6707018640 1 -- start start 2023-07-06T22:01:12.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.929+0000 7f6707018640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f67000c89b0 0x7f67000c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:12.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.929+0000 7f6707018640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6700158b50 con 0x7f67000cbfa0 2023-07-06T22:01:12.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.933+0000 7f6707018640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67000c9350 con 0x7f6700158780 2023-07-06T22:01:12.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.933+0000 7f6707018640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670006fb00 con 0x7f67000c89b0 2023-07-06T22:01:12.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.933+0000 7f67055b5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f67000c89b0 0x7f67000c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:12.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.933+0000 7f67055b5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f67000c89b0 0x7f67000c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58372/0 (socket says 172.21.15.55:58372) 2023-07-06T22:01:12.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.933+0000 7f66fffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f67000cbfa0 0x7f670006f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34410/0 (socket says 172.21.15.55:34410) 2023-07-06T22:01:12.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.933+0000 7f67055b5640 1 -- 172.21.15.55:0/3813244379 learned_addr learned my addr 172.21.15.55:0/3813244379 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:12.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.933+0000 7f67055b5640 1 -- 172.21.15.55:0/3813244379 >> v1:172.21.15.138:6789/0 conn(0x7f6700158780 legacy=0x7f67000cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:12.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.933+0000 7f67055b5640 1 -- 172.21.15.55:0/3813244379 >> v1:172.21.15.55:6789/0 conn(0x7f67000cbfa0 legacy=0x7f670006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:12.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.933+0000 7f67055b5640 1 -- 172.21.15.55:0/3813244379 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670006b390 con 0x7f67000c89b0 2023-07-06T22:01:12.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.933+0000 7f66ff7fe640 1 -- 172.21.15.55:0/3813244379 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712938446 0 0) 0x7f6700158b50 con 0x7f67000cbfa0 2023-07-06T22:01:12.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.933+0000 7f67055b5640 1 --2- 172.21.15.55:0/3813244379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67000c89b0 0x7f67000c8e10 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f66f800d150 tx=0x7f66f801eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14f20cdbeacaf35 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:12.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.933+0000 7f66ff7fe640 1 -- 172.21.15.55:0/3813244379 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f800b2d0 con 0x7f67000c89b0 2023-07-06T22:01:12.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.933+0000 7f66ff7fe640 1 -- 172.21.15.55:0/3813244379 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f800b430 con 0x7f67000c89b0 2023-07-06T22:01:12.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.933+0000 7f66ff7fe640 1 -- 172.21.15.55:0/3813244379 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f80a7b20 con 0x7f67000c89b0 2023-07-06T22:01:12.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 -- 172.21.15.55:0/3813244379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67000c89b0 msgr2=0x7f67000c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:12.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 --2- 172.21.15.55:0/3813244379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67000c89b0 0x7f67000c8e10 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f66f800d150 tx=0x7f66f801eb40 comp rx=0 tx=0).stop 2023-07-06T22:01:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 -- 172.21.15.55:0/3813244379 shutdown_connections 2023-07-06T22:01:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 --2- 172.21.15.55:0/3813244379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67000c89b0 0x7f67000c8e10 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 -- 172.21.15.55:0/3813244379 >> 172.21.15.55:0/3813244379 conn(0x7f67000cde30 msgr2=0x7f67000ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 -- 172.21.15.55:0/3813244379 shutdown_connections 2023-07-06T22:01:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 -- 172.21.15.55:0/3813244379 wait complete. 2023-07-06T22:01:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 Processor -- start 2023-07-06T22:01:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 -- start start 2023-07-06T22:01:12.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67000c89b0 0x7f67001474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:12.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67000cbfa0 0x7f6700159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:12.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6700158780 0x7f6700154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:12.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67001486d0 con 0x7f67000cbfa0 2023-07-06T22:01:12.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670015a020 con 0x7f6700158780 2023-07-06T22:01:12.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6707018640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670015a300 con 0x7f67000c89b0 2023-07-06T22:01:12.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f66fffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67000cbfa0 0x7f6700159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:12.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f66fffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67000cbfa0 0x7f6700159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58374/0 (socket says 172.21.15.55:58374) 2023-07-06T22:01:12.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f66fffff640 1 -- 172.21.15.55:0/1197977666 learned_addr learned my addr 172.21.15.55:0/1197977666 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:12.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f6704db4640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67000c89b0 0x7f67001474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:12.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.937+0000 7f67055b5640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6700158780 0x7f6700154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:12.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f66fffff640 1 -- 172.21.15.55:0/1197977666 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67000c89b0 msgr2=0x7f67001474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:12.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f66fffff640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67000c89b0 0x7f67001474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:12.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f66fffff640 1 -- 172.21.15.55:0/1197977666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6700158780 msgr2=0x7f6700154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:12.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f66fffff640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6700158780 0x7f6700154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:12.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f66fffff640 1 -- 172.21.15.55:0/1197977666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f800bd40 con 0x7f67000cbfa0 2023-07-06T22:01:12.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f67055b5640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6700158780 0x7f6700154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:12.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f6704db4640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67000c89b0 0x7f67001474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f66fffff640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67000cbfa0 0x7f6700159710 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0011f0 tx=0x7f66ec00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f66fd7fa640 1 -- 172.21.15.55:0/1197977666 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0074e0 con 0x7f67000cbfa0 2023-07-06T22:01:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f66fd7fa640 1 -- 172.21.15.55:0/1197977666 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec007640 con 0x7f67000cbfa0 2023-07-06T22:01:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f66fd7fa640 1 -- 172.21.15.55:0/1197977666 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec004a10 con 0x7f67000cbfa0 2023-07-06T22:01:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f6707018640 1 -- 172.21.15.55:0/1197977666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6700148920 con 0x7f67000cbfa0 2023-07-06T22:01:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f6707018640 1 -- 172.21.15.55:0/1197977666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6700147a20 con 0x7f67000cbfa0 2023-07-06T22:01:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f6707018640 1 -- 172.21.15.55:0/1197977666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6700157fd0 con 0x7f67000cbfa0 2023-07-06T22:01:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f66fd7fa640 1 -- 172.21.15.55:0/1197977666 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f66ec004b70 con 0x7f67000cbfa0 2023-07-06T22:01:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f66fd7fa640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f66e40663a0 0x7f66e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f66fd7fa640 1 -- 172.21.15.55:0/1197977666 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6832+0+0 (secure 0 0 0) 0x7f66ec083440 con 0x7f67000cbfa0 2023-07-06T22:01:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.941+0000 7f6704db4640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f66e40663a0 0x7f66e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:12.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.945+0000 7f6704db4640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f66e40663a0 0x7f66e4068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f67000c4440 tx=0x7f66f4008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:12.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:12.945+0000 7f66fd7fa640 1 -- 172.21.15.55:0/1197977666 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f66ec0504c0 con 0x7f67000cbfa0 2023-07-06T22:01:13.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.101+0000 7f6707018640 1 -- 172.21.15.55:0/1197977666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6700066d60 con 0x7f67000cbfa0 2023-07-06T22:01:13.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.749+0000 7f66fd7fa640 1 -- 172.21.15.55:0/1197977666 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v137) v1 ==== 169+0+0 (secure 0 0 0) 0x7f66ec0180d0 con 0x7f67000cbfa0 2023-07-06T22:01:13.750 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-07-06T22:01:13.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.753+0000 7f6707018640 1 -- 172.21.15.55:0/1197977666 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f66e40663a0 msgr2=0x7f66e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:13.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.753+0000 7f6707018640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f66e40663a0 0x7f66e4068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f67000c4440 tx=0x7f66f4008040 comp rx=0 tx=0).stop 2023-07-06T22:01:13.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.753+0000 7f6707018640 1 -- 172.21.15.55:0/1197977666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67000cbfa0 msgr2=0x7f6700159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:13.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.753+0000 7f6707018640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67000cbfa0 0x7f6700159710 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0011f0 tx=0x7f66ec00c9b0 comp rx=0 tx=0).stop 2023-07-06T22:01:13.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.753+0000 7f6707018640 1 -- 172.21.15.55:0/1197977666 shutdown_connections 2023-07-06T22:01:13.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.753+0000 7f6707018640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f66e40663a0 0x7f66e4068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:13.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.753+0000 7f6707018640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6700158780 0x7f6700154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:13.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.753+0000 7f6707018640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67000cbfa0 0x7f6700159710 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:13.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.753+0000 7f6707018640 1 --2- 172.21.15.55:0/1197977666 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67000c89b0 0x7f67001474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:13.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.753+0000 7f6707018640 1 -- 172.21.15.55:0/1197977666 >> 172.21.15.55:0/1197977666 conn(0x7f67000cde30 msgr2=0x7f670006a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:13.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.753+0000 7f6707018640 1 -- 172.21.15.55:0/1197977666 shutdown_connections 2023-07-06T22:01:13.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.753+0000 7f6707018640 1 -- 172.21.15.55:0/1197977666 wait complete. 2023-07-06T22:01:13.776 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-06T22:01:13.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.921+0000 7fbe69607640 1 Processor -- start 2023-07-06T22:01:13.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.921+0000 7fbe69607640 1 -- start start 2023-07-06T22:01:13.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.921+0000 7fbe69607640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe640b3cd0 0x7fbe640d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.921+0000 7fbe69607640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe640b2b80 con 0x7fbe640b3870 2023-07-06T22:01:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.921+0000 7fbe69607640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe640cff30 con 0x7fbe6415b850 2023-07-06T22:01:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.921+0000 7fbe69607640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640b22e0 con 0x7fbe640b3cd0 2023-07-06T22:01:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.921+0000 7fbe5bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbe640b3870 0x7fbe640d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48560/0 (socket says 172.21.15.55:48560) 2023-07-06T22:01:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.921+0000 7fbe5bfff640 1 -- 172.21.15.55:0/2200209889 learned_addr learned my addr 172.21.15.55:0/2200209889 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:13.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.921+0000 7fbe637fe640 1 --2- 172.21.15.55:0/2200209889 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe640b3cd0 0x7fbe640d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:13.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.921+0000 7fbe627fc640 1 -- 172.21.15.55:0/2200209889 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956385124 0 0) 0x7fbe640b2b80 con 0x7fbe640b3870 2023-07-06T22:01:13.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.921+0000 7fbe627fc640 1 -- 172.21.15.55:0/2200209889 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe50003530 con 0x7fbe640b3870 2023-07-06T22:01:13.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.921+0000 7fbe627fc640 1 -- 172.21.15.55:0/2200209889 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518735838 0 0) 0x7fbe640cff30 con 0x7fbe6415b850 2023-07-06T22:01:13.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.921+0000 7fbe627fc640 1 -- 172.21.15.55:0/2200209889 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe640b2b80 con 0x7fbe6415b850 2023-07-06T22:01:13.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe637fe640 1 -- 172.21.15.55:0/2200209889 >> v1:172.21.15.138:6789/0 conn(0x7fbe6415b850 legacy=0x7fbe640cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:13.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe627fc640 1 -- 172.21.15.55:0/2200209889 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1771574729 0 0) 0x7fbe50003530 con 0x7fbe640b3870 2023-07-06T22:01:13.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe637fe640 1 -- 172.21.15.55:0/2200209889 >> v1:172.21.15.55:6789/0 conn(0x7fbe640b3870 legacy=0x7fbe640d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:13.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe637fe640 1 -- 172.21.15.55:0/2200209889 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe640b25c0 con 0x7fbe640b3cd0 2023-07-06T22:01:13.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe637fe640 1 --2- 172.21.15.55:0/2200209889 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe640b3cd0 0x7fbe640d0ad0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009dc0 tx=0x7fbe5c01c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12f08e7e92744125 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:13.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe627fc640 1 -- 172.21.15.55:0/2200209889 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c001680 con 0x7fbe640b3cd0 2023-07-06T22:01:13.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe627fc640 1 -- 172.21.15.55:0/2200209889 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c0a5540 con 0x7fbe640b3cd0 2023-07-06T22:01:13.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe627fc640 1 -- 172.21.15.55:0/2200209889 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c0a58d0 con 0x7fbe640b3cd0 2023-07-06T22:01:13.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe69607640 1 -- 172.21.15.55:0/2200209889 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe640b3cd0 msgr2=0x7fbe640d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe69607640 1 --2- 172.21.15.55:0/2200209889 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe640b3cd0 0x7fbe640d0ad0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009dc0 tx=0x7fbe5c01c740 comp rx=0 tx=0).stop 2023-07-06T22:01:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe69607640 1 -- 172.21.15.55:0/2200209889 shutdown_connections 2023-07-06T22:01:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe69607640 1 --2- 172.21.15.55:0/2200209889 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe640b3cd0 0x7fbe640d0ad0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe69607640 1 -- 172.21.15.55:0/2200209889 >> 172.21.15.55:0/2200209889 conn(0x7fbe640cec20 msgr2=0x7fbe640cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe69607640 1 -- 172.21.15.55:0/2200209889 shutdown_connections 2023-07-06T22:01:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.925+0000 7fbe69607640 1 -- 172.21.15.55:0/2200209889 wait complete. 2023-07-06T22:01:13.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe69607640 1 Processor -- start 2023-07-06T22:01:13.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe69607640 1 -- start start 2023-07-06T22:01:13.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe69607640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe640b3870 0x7fbe64141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:13.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe69607640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640b3cd0 0x7fbe6414f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:13.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe69607640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe6415b850 0x7fbe6413f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:13.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe69607640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6414f790 con 0x7fbe640b3cd0 2023-07-06T22:01:13.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe69607640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe64140eb0 con 0x7fbe6415b850 2023-07-06T22:01:13.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe69607640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe641402a0 con 0x7fbe640b3870 2023-07-06T22:01:13.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe5bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640b3cd0 0x7fbe6414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:13.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe5bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640b3cd0 0x7fbe6414f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54098/0 (socket says 172.21.15.55:54098) 2023-07-06T22:01:13.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe5bfff640 1 -- 172.21.15.55:0/1686431881 learned_addr learned my addr 172.21.15.55:0/1686431881 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:13.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe62ffd640 1 --2- 172.21.15.55:0/1686431881 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe640b3870 0x7fbe64141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:13.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe637fe640 1 --2- 172.21.15.55:0/1686431881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe6415b850 0x7fbe6413f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:13.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe5bfff640 1 -- 172.21.15.55:0/1686431881 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe640b3870 msgr2=0x7fbe64141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:13.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe5bfff640 1 --2- 172.21.15.55:0/1686431881 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe640b3870 0x7fbe64141340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:13.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe5bfff640 1 -- 172.21.15.55:0/1686431881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe6415b850 msgr2=0x7fbe6413f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:13.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe5bfff640 1 --2- 172.21.15.55:0/1686431881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe6415b850 0x7fbe6413f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:13.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe5bfff640 1 -- 172.21.15.55:0/1686431881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c009a70 con 0x7fbe640b3cd0 2023-07-06T22:01:13.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.929+0000 7fbe5bfff640 1 --2- 172.21.15.55:0/1686431881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640b3cd0 0x7fbe6414f250 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00c780 tx=0x7fbe4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:13.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.933+0000 7fbe5b7fe640 1 -- 172.21.15.55:0/1686431881 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c005cf0 con 0x7fbe640b3cd0 2023-07-06T22:01:13.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.933+0000 7fbe5b7fe640 1 -- 172.21.15.55:0/1686431881 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c005e50 con 0x7fbe640b3cd0 2023-07-06T22:01:13.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.933+0000 7fbe5b7fe640 1 -- 172.21.15.55:0/1686431881 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c0072b0 con 0x7fbe640b3cd0 2023-07-06T22:01:13.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.933+0000 7fbe69607640 1 -- 172.21.15.55:0/1686431881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe64140580 con 0x7fbe640b3cd0 2023-07-06T22:01:13.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.933+0000 7fbe69607640 1 -- 172.21.15.55:0/1686431881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe64140b40 con 0x7fbe640b3cd0 2023-07-06T22:01:13.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.933+0000 7fbe69607640 1 -- 172.21.15.55:0/1686431881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe64141060 con 0x7fbe640b3cd0 2023-07-06T22:01:13.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.933+0000 7fbe5b7fe640 1 -- 172.21.15.55:0/1686431881 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbe4c007410 con 0x7fbe640b3cd0 2023-07-06T22:01:13.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.933+0000 7fbe5b7fe640 1 --2- 172.21.15.55:0/1686431881 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fbe440663a0 0x7fbe44068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:13.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.933+0000 7fbe5b7fe640 1 -- 172.21.15.55:0/1686431881 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6418+0+0 (secure 0 0 0) 0x7fbe4c0837c0 con 0x7fbe640b3cd0 2023-07-06T22:01:13.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.933+0000 7fbe62ffd640 1 --2- 172.21.15.55:0/1686431881 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fbe440663a0 0x7fbe44068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:13.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.937+0000 7fbe62ffd640 1 --2- 172.21.15.55:0/1686431881 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fbe440663a0 0x7fbe44068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbe540011f0 tx=0x7fbe54009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:13.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:13.937+0000 7fbe5b7fe640 1 -- 172.21.15.55:0/1686431881 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbe64141060 con 0x7fbe640b3cd0 2023-07-06T22:01:14.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.093+0000 7fbe69607640 1 -- 172.21.15.55:0/1686431881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fbe64141020 con 0x7fbe640b3cd0 2023-07-06T22:01:14.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.097+0000 7fbe5b7fe640 1 -- 172.21.15.55:0/1686431881 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v43) v1 ==== 120+0+0 (secure 0 0 0) 0x7fbe4c0509d0 con 0x7fbe640b3cd0 2023-07-06T22:01:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.101+0000 7fbe69607640 1 -- 172.21.15.55:0/1686431881 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fbe440663a0 msgr2=0x7fbe44068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.101+0000 7fbe69607640 1 --2- 172.21.15.55:0/1686431881 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fbe440663a0 0x7fbe44068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbe540011f0 tx=0x7fbe54009040 comp rx=0 tx=0).stop 2023-07-06T22:01:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.101+0000 7fbe69607640 1 -- 172.21.15.55:0/1686431881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640b3cd0 msgr2=0x7fbe6414f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.101+0000 7fbe69607640 1 --2- 172.21.15.55:0/1686431881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640b3cd0 0x7fbe6414f250 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00c780 tx=0x7fbe4c00cc40 comp rx=0 tx=0).stop 2023-07-06T22:01:14.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.101+0000 7fbe69607640 1 -- 172.21.15.55:0/1686431881 shutdown_connections 2023-07-06T22:01:14.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.101+0000 7fbe69607640 1 --2- 172.21.15.55:0/1686431881 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fbe440663a0 0x7fbe44068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.101+0000 7fbe69607640 1 --2- 172.21.15.55:0/1686431881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe6415b850 0x7fbe6413f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.101+0000 7fbe69607640 1 --2- 172.21.15.55:0/1686431881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640b3cd0 0x7fbe6414f250 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.101+0000 7fbe69607640 1 --2- 172.21.15.55:0/1686431881 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbe640b3870 0x7fbe64141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.101+0000 7fbe69607640 1 -- 172.21.15.55:0/1686431881 >> 172.21.15.55:0/1686431881 conn(0x7fbe640cec20 msgr2=0x7fbe6406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:14.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.101+0000 7fbe69607640 1 -- 172.21.15.55:0/1686431881 shutdown_connections 2023-07-06T22:01:14.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.101+0000 7fbe69607640 1 -- 172.21.15.55:0/1686431881 wait complete. 2023-07-06T22:01:14.120 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-06T22:01:14.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.265+0000 7fd65872c640 1 Processor -- start 2023-07-06T22:01:14.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.265+0000 7fd65872c640 1 -- start start 2023-07-06T22:01:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.265+0000 7fd65872c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd6500709a0 0x7fd6500cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.265+0000 7fd65872c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6500cbe60 0x7fd6500b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.265+0000 7fd65872c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6500cc300 con 0x7fd650070d70 2023-07-06T22:01:14.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.265+0000 7fd65872c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6500cc5e0 con 0x7fd6500cbe60 2023-07-06T22:01:14.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.265+0000 7fd65872c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6500cc8c0 con 0x7fd6500709a0 2023-07-06T22:01:14.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.269+0000 7fd655cc7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6500cbe60 0x7fd6500b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.269+0000 7fd656cc9640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd650070d70 0x7fd65015d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48572/0 (socket says 172.21.15.55:48572) 2023-07-06T22:01:14.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.269+0000 7fd656cc9640 1 -- 172.21.15.55:0/1595116513 learned_addr learned my addr 172.21.15.55:0/1595116513 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:14.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.269+0000 7fd6564c8640 1 --2- 172.21.15.55:0/1595116513 >> v2:172.21.15.138:3300/0 conn(0x7fd6500709a0 0x7fd6500cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.269+0000 7fd655cc7640 1 -- 172.21.15.55:0/1595116513 >> v2:172.21.15.138:3300/0 conn(0x7fd6500709a0 msgr2=0x7fd6500cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:14.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.269+0000 7fd655cc7640 1 --2- 172.21.15.55:0/1595116513 >> v2:172.21.15.138:3300/0 conn(0x7fd6500709a0 0x7fd6500cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.269+0000 7fd655cc7640 1 -- 172.21.15.55:0/1595116513 >> v1:172.21.15.55:6789/0 conn(0x7fd650070d70 legacy=0x7fd65015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.269+0000 7fd655cc7640 1 -- 172.21.15.55:0/1595116513 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6500ccba0 con 0x7fd6500cbe60 2023-07-06T22:01:14.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.269+0000 7fd6554c6640 1 -- 172.21.15.55:0/1595116513 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490741855 0 0) 0x7fd6500cc300 con 0x7fd650070d70 2023-07-06T22:01:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.269+0000 7fd655cc7640 1 --2- 172.21.15.55:0/1595116513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6500cbe60 0x7fd6500b0c30 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fd65006ec60 tx=0x7fd64001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4d5636c1796f95 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.269+0000 7fd6554c6640 1 -- 172.21.15.55:0/1595116513 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400ab600 con 0x7fd6500cbe60 2023-07-06T22:01:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.269+0000 7fd6554c6640 1 -- 172.21.15.55:0/1595116513 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6400a7050 con 0x7fd6500cbe60 2023-07-06T22:01:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.269+0000 7fd6554c6640 1 -- 172.21.15.55:0/1595116513 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400ab980 con 0x7fd6500cbe60 2023-07-06T22:01:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 -- 172.21.15.55:0/1595116513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6500cbe60 msgr2=0x7fd6500b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 --2- 172.21.15.55:0/1595116513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6500cbe60 0x7fd6500b0c30 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fd65006ec60 tx=0x7fd64001c460 comp rx=0 tx=0).stop 2023-07-06T22:01:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 -- 172.21.15.55:0/1595116513 shutdown_connections 2023-07-06T22:01:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 --2- 172.21.15.55:0/1595116513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6500cbe60 0x7fd6500b0c30 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 --2- 172.21.15.55:0/1595116513 >> v2:172.21.15.138:3300/0 conn(0x7fd6500709a0 0x7fd6500cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 -- 172.21.15.55:0/1595116513 >> 172.21.15.55:0/1595116513 conn(0x7fd6500cea70 msgr2=0x7fd6500ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 -- 172.21.15.55:0/1595116513 shutdown_connections 2023-07-06T22:01:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 -- 172.21.15.55:0/1595116513 wait complete. 2023-07-06T22:01:14.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 Processor -- start 2023-07-06T22:01:14.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 -- start start 2023-07-06T22:01:14.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd6500709a0 0x7fd6500c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd650070d70 0x7fd650157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6500cbe60 0x7fd6500c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6500c63c0 con 0x7fd6500cbe60 2023-07-06T22:01:14.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65006c290 con 0x7fd650070d70 2023-07-06T22:01:14.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd65872c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6500c28e0 con 0x7fd6500709a0 2023-07-06T22:01:14.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd656cc9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6500cbe60 0x7fd6500c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd656cc9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6500cbe60 0x7fd6500c4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54110/0 (socket says 172.21.15.55:54110) 2023-07-06T22:01:14.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd656cc9640 1 -- 172.21.15.55:0/2647358289 learned_addr learned my addr 172.21.15.55:0/2647358289 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:14.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd6564c8640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd6500709a0 0x7fd6500c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.273+0000 7fd655cc7640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd650070d70 0x7fd650157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd656cc9640 1 -- 172.21.15.55:0/2647358289 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd6500709a0 msgr2=0x7fd6500c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd656cc9640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd6500709a0 0x7fd6500c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd656cc9640 1 -- 172.21.15.55:0/2647358289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd650070d70 msgr2=0x7fd650157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd656cc9640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd650070d70 0x7fd650157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd656cc9640 1 -- 172.21.15.55:0/2647358289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd640009420 con 0x7fd6500cbe60 2023-07-06T22:01:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd655cc7640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd650070d70 0x7fd650157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd656cc9640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6500cbe60 0x7fd6500c4e20 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fd648001570 tx=0x7fd64800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd646ffd640 1 -- 172.21.15.55:0/2647358289 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64800a640 con 0x7fd6500cbe60 2023-07-06T22:01:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd646ffd640 1 -- 172.21.15.55:0/2647358289 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64800a7c0 con 0x7fd6500cbe60 2023-07-06T22:01:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd65872c640 1 -- 172.21.15.55:0/2647358289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6500c2bc0 con 0x7fd6500cbe60 2023-07-06T22:01:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd646ffd640 1 -- 172.21.15.55:0/2647358289 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64800ab70 con 0x7fd6500cbe60 2023-07-06T22:01:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd65872c640 1 -- 172.21.15.55:0/2647358289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6500c3180 con 0x7fd6500cbe60 2023-07-06T22:01:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd65872c640 1 -- 172.21.15.55:0/2647358289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd650066d60 con 0x7fd6500cbe60 2023-07-06T22:01:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd646ffd640 1 -- 172.21.15.55:0/2647358289 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd64800acd0 con 0x7fd6500cbe60 2023-07-06T22:01:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd646ffd640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd6340663a0 0x7fd634068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd646ffd640 1 -- 172.21.15.55:0/2647358289 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6418+0+0 (secure 0 0 0) 0x7fd6480835d0 con 0x7fd6500cbe60 2023-07-06T22:01:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.277+0000 7fd6564c8640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd6340663a0 0x7fd634068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.281+0000 7fd6564c8640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd6340663a0 0x7fd634068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009af0 tx=0x7fd64c008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:14.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.281+0000 7fd646ffd640 1 -- 172.21.15.55:0/2647358289 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6480507c0 con 0x7fd6500cbe60 2023-07-06T22:01:14.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.437+0000 7fd65872c640 1 -- 172.21.15.55:0/2647358289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd6500c7e50 con 0x7fd6500cbe60 2023-07-06T22:01:14.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.441+0000 7fd646ffd640 1 -- 172.21.15.55:0/2647358289 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd648053de0 con 0x7fd6500cbe60 2023-07-06T22:01:14.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.445+0000 7fd65872c640 1 -- 172.21.15.55:0/2647358289 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd6340663a0 msgr2=0x7fd634068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.445+0000 7fd65872c640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd6340663a0 0x7fd634068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009af0 tx=0x7fd64c008040 comp rx=0 tx=0).stop 2023-07-06T22:01:14.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.445+0000 7fd65872c640 1 -- 172.21.15.55:0/2647358289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6500cbe60 msgr2=0x7fd6500c4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.445+0000 7fd65872c640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6500cbe60 0x7fd6500c4e20 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fd648001570 tx=0x7fd64800cca0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.445+0000 7fd65872c640 1 -- 172.21.15.55:0/2647358289 shutdown_connections 2023-07-06T22:01:14.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.445+0000 7fd65872c640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd6340663a0 0x7fd634068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.445+0000 7fd65872c640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6500cbe60 0x7fd6500c4e20 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.445+0000 7fd65872c640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd650070d70 0x7fd650157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.445+0000 7fd65872c640 1 --2- 172.21.15.55:0/2647358289 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd6500709a0 0x7fd6500c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.445+0000 7fd65872c640 1 -- 172.21.15.55:0/2647358289 >> 172.21.15.55:0/2647358289 conn(0x7fd6500cea70 msgr2=0x7fd6500ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:14.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.445+0000 7fd65872c640 1 -- 172.21.15.55:0/2647358289 shutdown_connections 2023-07-06T22:01:14.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.445+0000 7fd65872c640 1 -- 172.21.15.55:0/2647358289 wait complete. 2023-07-06T22:01:14.464 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-06T22:01:14.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4bcf00640 1 Processor -- start 2023-07-06T22:01:14.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4bcf00640 1 -- start start 2023-07-06T22:01:14.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4bcf00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa4b80ca130 0x7fa4b80703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4bcf00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4b80cd140 0x7fa4b8070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4bcf00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b8158c20 con 0x7fa4b8158850 2023-07-06T22:01:14.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4bcf00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b80b2aa0 con 0x7fa4b80cd140 2023-07-06T22:01:14.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4bcf00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b80c8db0 con 0x7fa4b80ca130 2023-07-06T22:01:14.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4b6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4b80cd140 0x7fa4b8070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4b6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4b80cd140 0x7fa4b8070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54116/0 (socket says 172.21.15.55:54116) 2023-07-06T22:01:14.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4b6d9d640 1 -- 172.21.15.55:0/4065063634 learned_addr learned my addr 172.21.15.55:0/4065063634 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:14.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4affff640 1 --2- 172.21.15.55:0/4065063634 >> v2:172.21.15.138:3300/0 conn(0x7fa4b80ca130 0x7fa4b80703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4b6d9d640 1 -- 172.21.15.55:0/4065063634 >> v2:172.21.15.138:3300/0 conn(0x7fa4b80ca130 msgr2=0x7fa4b80703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:14.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4b6d9d640 1 --2- 172.21.15.55:0/4065063634 >> v2:172.21.15.138:3300/0 conn(0x7fa4b80ca130 0x7fa4b80703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4b6d9d640 1 -- 172.21.15.55:0/4065063634 >> v1:172.21.15.138:6789/0 conn(0x7fa4b8158850 legacy=0x7fa4b80cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.609+0000 7fa4b6d9d640 1 -- 172.21.15.55:0/4065063634 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b80c9090 con 0x7fa4b80cd140 2023-07-06T22:01:14.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.613+0000 7fa4b6d9d640 1 --2- 172.21.15.55:0/4065063634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b80cd140 0x7fa4b8070920 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8071490 tx=0x7fa4b001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a23ab6ccf0a7c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:14.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.613+0000 7fa4b5d9b640 1 -- 172.21.15.55:0/4065063634 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00a5860 con 0x7fa4b80cd140 2023-07-06T22:01:14.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.613+0000 7fa4b5d9b640 1 -- 172.21.15.55:0/4065063634 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b00a59c0 con 0x7fa4b80cd140 2023-07-06T22:01:14.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.613+0000 7fa4b5d9b640 1 -- 172.21.15.55:0/4065063634 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00a5d50 con 0x7fa4b80cd140 2023-07-06T22:01:14.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.613+0000 7fa4bcf00640 1 -- 172.21.15.55:0/4065063634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b80cd140 msgr2=0x7fa4b8070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.613+0000 7fa4bcf00640 1 --2- 172.21.15.55:0/4065063634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b80cd140 0x7fa4b8070920 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8071490 tx=0x7fa4b001c9a0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.613+0000 7fa4bcf00640 1 -- 172.21.15.55:0/4065063634 shutdown_connections 2023-07-06T22:01:14.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.613+0000 7fa4bcf00640 1 --2- 172.21.15.55:0/4065063634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b80cd140 0x7fa4b8070920 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.613+0000 7fa4bcf00640 1 --2- 172.21.15.55:0/4065063634 >> v2:172.21.15.138:3300/0 conn(0x7fa4b80ca130 0x7fa4b80703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.613+0000 7fa4bcf00640 1 -- 172.21.15.55:0/4065063634 >> 172.21.15.55:0/4065063634 conn(0x7fa4b80cea70 msgr2=0x7fa4b80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:14.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.613+0000 7fa4bcf00640 1 -- 172.21.15.55:0/4065063634 shutdown_connections 2023-07-06T22:01:14.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.613+0000 7fa4bcf00640 1 -- 172.21.15.55:0/4065063634 wait complete. 2023-07-06T22:01:14.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4bcf00640 1 Processor -- start 2023-07-06T22:01:14.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4bcf00640 1 -- start start 2023-07-06T22:01:14.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4bcf00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b80ca130 0x7fa4b80c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4bcf00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b80cd140 0x7fa4b80c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4bcf00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b8158850 0x7fa4b8152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4bcf00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81f5e40 con 0x7fa4b80cd140 2023-07-06T22:01:14.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4bcf00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81f52c0 con 0x7fa4b80ca130 2023-07-06T22:01:14.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4bcf00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81f55a0 con 0x7fa4b8158850 2023-07-06T22:01:14.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4affff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b80cd140 0x7fa4b80c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4affff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b80cd140 0x7fa4b80c7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54120/0 (socket says 172.21.15.55:54120) 2023-07-06T22:01:14.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4affff640 1 -- 172.21.15.55:0/3961288640 learned_addr learned my addr 172.21.15.55:0/3961288640 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:14.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4b6d9d640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b8158850 0x7fa4b8152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4b659c640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b80ca130 0x7fa4b80c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4affff640 1 -- 172.21.15.55:0/3961288640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b8158850 msgr2=0x7fa4b8152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4affff640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b8158850 0x7fa4b8152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4affff640 1 -- 172.21.15.55:0/3961288640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b80ca130 msgr2=0x7fa4b80c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4affff640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b80ca130 0x7fa4b80c6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4affff640 1 -- 172.21.15.55:0/3961288640 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b0009b30 con 0x7fa4b80cd140 2023-07-06T22:01:14.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4b659c640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b80ca130 0x7fa4b80c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:14.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4affff640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b80cd140 0x7fa4b80c7ab0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000d800 tx=0x7fa4a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:14.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4aeffd640 1 -- 172.21.15.55:0/3961288640 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a000b6c0 con 0x7fa4b80cd140 2023-07-06T22:01:14.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4aeffd640 1 -- 172.21.15.55:0/3961288640 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a000b820 con 0x7fa4b80cd140 2023-07-06T22:01:14.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4aeffd640 1 -- 172.21.15.55:0/3961288640 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a000bb90 con 0x7fa4b80cd140 2023-07-06T22:01:14.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4bcf00640 1 -- 172.21.15.55:0/3961288640 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b81f5880 con 0x7fa4b80cd140 2023-07-06T22:01:14.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4bcf00640 1 -- 172.21.15.55:0/3961288640 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b80c7230 con 0x7fa4b80cd140 2023-07-06T22:01:14.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.617+0000 7fa4bcf00640 1 -- 172.21.15.55:0/3961288640 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b8066d60 con 0x7fa4b80cd140 2023-07-06T22:01:14.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.621+0000 7fa4aeffd640 1 -- 172.21.15.55:0/3961288640 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa4a000bcf0 con 0x7fa4b80cd140 2023-07-06T22:01:14.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.621+0000 7fa4aeffd640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa4980663a0 0x7fa498068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.621+0000 7fa4aeffd640 1 -- 172.21.15.55:0/3961288640 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6418+0+0 (secure 0 0 0) 0x7fa4a00844d0 con 0x7fa4b80cd140 2023-07-06T22:01:14.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.621+0000 7fa4b659c640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa4980663a0 0x7fa498068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.621+0000 7fa4b659c640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa4980663a0 0x7fa498068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8000f70 tx=0x7fa4a8009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:14.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.625+0000 7fa4aeffd640 1 -- 172.21.15.55:0/3961288640 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa4a0055150 con 0x7fa4b80cd140 2023-07-06T22:01:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.785+0000 7fa4bcf00640 1 -- 172.21.15.55:0/3961288640 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fa4b81548d0 con 0x7fa4b80cd140 2023-07-06T22:01:14.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.793+0000 7fa4aeffd640 1 -- 172.21.15.55:0/3961288640 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v45) v1 ==== 115+0+0 (secure 0 0 0) 0x7fa4a0054ce0 con 0x7fa4b80cd140 2023-07-06T22:01:14.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.793+0000 7fa4bcf00640 1 -- 172.21.15.55:0/3961288640 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa4980663a0 msgr2=0x7fa498068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.793+0000 7fa4bcf00640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa4980663a0 0x7fa498068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8000f70 tx=0x7fa4a8009040 comp rx=0 tx=0).stop 2023-07-06T22:01:14.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.793+0000 7fa4bcf00640 1 -- 172.21.15.55:0/3961288640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b80cd140 msgr2=0x7fa4b80c7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.793+0000 7fa4bcf00640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b80cd140 0x7fa4b80c7ab0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000d800 tx=0x7fa4a000dcc0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.793+0000 7fa4bcf00640 1 -- 172.21.15.55:0/3961288640 shutdown_connections 2023-07-06T22:01:14.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.793+0000 7fa4bcf00640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa4980663a0 0x7fa498068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.793+0000 7fa4bcf00640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b8158850 0x7fa4b8152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.793+0000 7fa4bcf00640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b80cd140 0x7fa4b80c7ab0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.793+0000 7fa4bcf00640 1 --2- 172.21.15.55:0/3961288640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b80ca130 0x7fa4b80c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.793+0000 7fa4bcf00640 1 -- 172.21.15.55:0/3961288640 >> 172.21.15.55:0/3961288640 conn(0x7fa4b80cea70 msgr2=0x7fa4b81537a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:14.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.793+0000 7fa4bcf00640 1 -- 172.21.15.55:0/3961288640 shutdown_connections 2023-07-06T22:01:14.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.793+0000 7fa4bcf00640 1 -- 172.21.15.55:0/3961288640 wait complete. 2023-07-06T22:01:14.821 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-07-06T22:01:14.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8ccb80b640 1 Processor -- start 2023-07-06T22:01:14.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8ccb80b640 1 -- start start 2023-07-06T22:01:14.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8ccb80b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8cc40b1fe0 0x7f8cc4166ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8ccb80b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc40cd1c0 con 0x7f8cc40b7cd0 2023-07-06T22:01:14.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8ccb80b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc40cecf0 con 0x7f8cc40ce610 2023-07-06T22:01:14.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8ccb80b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40d2310 con 0x7f8cc40b1fe0 2023-07-06T22:01:14.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cc95a7640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8cc40b7cd0 0x7f8cc40ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48578/0 (socket says 172.21.15.55:48578) 2023-07-06T22:01:14.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cc95a7640 1 -- 172.21.15.55:0/630762119 learned_addr learned my addr 172.21.15.55:0/630762119 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cc9da8640 1 --2- 172.21.15.55:0/630762119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8cc40b1fe0 0x7f8cc4166ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 -- 172.21.15.55:0/630762119 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910674028 0 0) 0x7f8cc40cd1c0 con 0x7f8cc40b7cd0 2023-07-06T22:01:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 -- 172.21.15.55:0/630762119 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cb0003530 con 0x7f8cc40b7cd0 2023-07-06T22:01:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 -- 172.21.15.55:0/630762119 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3645167255 0 0) 0x7f8cb0003530 con 0x7f8cc40b7cd0 2023-07-06T22:01:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 -- 172.21.15.55:0/630762119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8cc40b1fe0 msgr2=0x7f8cc4166ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 --2- 172.21.15.55:0/630762119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8cc40b1fe0 0x7f8cc4166ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 -- 172.21.15.55:0/630762119 >> v1:172.21.15.138:6789/0 conn(0x7f8cc40ce610 legacy=0x7f8cc40b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 -- 172.21.15.55:0/630762119 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc40cea60 con 0x7f8cc40b7cd0 2023-07-06T22:01:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 -- 172.21.15.55:0/630762119 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f8cc0001680 con 0x7f8cc40b7cd0 2023-07-06T22:01:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 -- 172.21.15.55:0/630762119 >> v1:172.21.15.55:6789/0 conn(0x7f8cc40b7cd0 legacy=0x7f8cc40ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 --2- 172.21.15.55:0/630762119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cb00039b0 0x7f8cb0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 --2- 172.21.15.55:0/630762119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8cc40b1fe0 0x7f8cb00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 --2- 172.21.15.55:0/630762119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb0004d10 0x7f8cb0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 -- 172.21.15.55:0/630762119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb000ba70 con 0x7f8cb00039b0 2023-07-06T22:01:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 -- 172.21.15.55:0/630762119 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb000bbe0 con 0x7f8cb0004d10 2023-07-06T22:01:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 -- 172.21.15.55:0/630762119 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb000bda0 con 0x7f8cc40b1fe0 2023-07-06T22:01:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cc95a7640 1 --2- 172.21.15.55:0/630762119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cb00039b0 0x7f8cb0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cc8da6640 1 --2- 172.21.15.55:0/630762119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8cc40b1fe0 0x7f8cb00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cc9da8640 1 --2- 172.21.15.55:0/630762119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb0004d10 0x7f8cb0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cc95a7640 1 -- 172.21.15.55:0/630762119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8cc40b1fe0 msgr2=0x7f8cb00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cc95a7640 1 --2- 172.21.15.55:0/630762119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8cc40b1fe0 0x7f8cb00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cc95a7640 1 -- 172.21.15.55:0/630762119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb0004d10 msgr2=0x7f8cb0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cc95a7640 1 --2- 172.21.15.55:0/630762119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb0004d10 0x7f8cb0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cc95a7640 1 -- 172.21.15.55:0/630762119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb0003530 con 0x7f8cb00039b0 2023-07-06T22:01:14.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cc95a7640 1 --2- 172.21.15.55:0/630762119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cb00039b0 0x7f8cb0003dc0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000c240 tx=0x7f8cc001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc9a743e2e4c35 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:14.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 -- 172.21.15.55:0/630762119 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0005ae0 con 0x7f8cb00039b0 2023-07-06T22:01:14.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 -- 172.21.15.55:0/630762119 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc0005c40 con 0x7f8cb00039b0 2023-07-06T22:01:14.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.969+0000 7f8cbbfff640 1 -- 172.21.15.55:0/630762119 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0007070 con 0x7f8cb00039b0 2023-07-06T22:01:14.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8ccb80b640 1 -- 172.21.15.55:0/630762119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cb00039b0 msgr2=0x7f8cb0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8ccb80b640 1 --2- 172.21.15.55:0/630762119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cb00039b0 0x7f8cb0003dc0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000c240 tx=0x7f8cc001cc40 comp rx=0 tx=0).stop 2023-07-06T22:01:14.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8cc9da8640 1 -- 172.21.15.55:0/630762119 reap_dead start 2023-07-06T22:01:14.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8ccb80b640 1 -- 172.21.15.55:0/630762119 shutdown_connections 2023-07-06T22:01:14.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8ccb80b640 1 -- 172.21.15.55:0/630762119 >> 172.21.15.55:0/630762119 conn(0x7f8cc40ceee0 msgr2=0x7f8cc40cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:14.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8ccb80b640 1 -- 172.21.15.55:0/630762119 shutdown_connections 2023-07-06T22:01:14.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8ccb80b640 1 -- 172.21.15.55:0/630762119 wait complete. 2023-07-06T22:01:14.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8ccb80b640 1 Processor -- start 2023-07-06T22:01:14.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8ccb80b640 1 -- start start 2023-07-06T22:01:14.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8ccb80b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb00039b0 0x7f8cc41560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8ccb80b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cc4156670 0x7f8cc415c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8ccb80b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8cc4156ae0 0x7f8cc415c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8ccb80b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4145000 con 0x7f8cc4156670 2023-07-06T22:01:14.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8ccb80b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4144480 con 0x7f8cb00039b0 2023-07-06T22:01:14.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8ccb80b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4144760 con 0x7f8cc4156ae0 2023-07-06T22:01:14.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8cc8da6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cc4156670 0x7f8cc415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8cc8da6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cc4156670 0x7f8cc415c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54130/0 (socket says 172.21.15.55:54130) 2023-07-06T22:01:14.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8cc8da6640 1 -- 172.21.15.55:0/3386457974 learned_addr learned my addr 172.21.15.55:0/3386457974 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:14.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8cc95a7640 1 --2- 172.21.15.55:0/3386457974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb00039b0 0x7f8cc41560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.973+0000 7f8cc9da8640 1 --2- 172.21.15.55:0/3386457974 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8cc4156ae0 0x7f8cc415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8cc8da6640 1 -- 172.21.15.55:0/3386457974 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8cc4156ae0 msgr2=0x7f8cc415c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8cc8da6640 1 --2- 172.21.15.55:0/3386457974 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8cc4156ae0 0x7f8cc415c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8cc8da6640 1 -- 172.21.15.55:0/3386457974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb00039b0 msgr2=0x7f8cc41560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:14.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8cc8da6640 1 --2- 172.21.15.55:0/3386457974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb00039b0 0x7f8cc41560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:14.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8cc8da6640 1 -- 172.21.15.55:0/3386457974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc4144a40 con 0x7f8cc4156670 2023-07-06T22:01:14.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8cc8da6640 1 --2- 172.21.15.55:0/3386457974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cc4156670 0x7f8cc415c350 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400f7f0 tx=0x7f8cb400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:14.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8cb9ffb640 1 -- 172.21.15.55:0/3386457974 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb40050d0 con 0x7f8cc4156670 2023-07-06T22:01:14.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8cb9ffb640 1 -- 172.21.15.55:0/3386457974 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb4005230 con 0x7f8cc4156670 2023-07-06T22:01:14.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8cb9ffb640 1 -- 172.21.15.55:0/3386457974 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb400d730 con 0x7f8cc4156670 2023-07-06T22:01:14.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8ccb80b640 1 -- 172.21.15.55:0/3386457974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc4144d20 con 0x7f8cc4156670 2023-07-06T22:01:14.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8ccb80b640 1 -- 172.21.15.55:0/3386457974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc415e260 con 0x7f8cc4156670 2023-07-06T22:01:14.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8ccb80b640 1 -- 172.21.15.55:0/3386457974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc4066d60 con 0x7f8cc4156670 2023-07-06T22:01:14.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8cb9ffb640 1 -- 172.21.15.55:0/3386457974 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8cb400d890 con 0x7f8cc4156670 2023-07-06T22:01:14.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8cb9ffb640 1 --2- 172.21.15.55:0/3386457974 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f8ca80663a0 0x7f8ca8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8cb9ffb640 1 -- 172.21.15.55:0/3386457974 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f8cb4083ed0 con 0x7f8cc4156670 2023-07-06T22:01:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.977+0000 7f8cc95a7640 1 --2- 172.21.15.55:0/3386457974 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f8ca80663a0 0x7f8ca8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.981+0000 7f8cc95a7640 1 --2- 172.21.15.55:0/3386457974 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f8ca80663a0 0x7f8ca8068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00ab000 tx=0x7f8cc00a7070 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:14.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:14.989+0000 7f8cb9ffb640 1 -- 172.21.15.55:0/3386457974 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8cb40510e0 con 0x7f8cc4156670 2023-07-06T22:01:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.197+0000 7f8ccb80b640 1 -- 172.21.15.55:0/3386457974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f8cc40b3690 con 0x7f8cc4156670 2023-07-06T22:01:15.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.761+0000 7f8cb9ffb640 1 -- 172.21.15.55:0/3386457974 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v740) v1 ==== 148+0+0 (secure 0 0 0) 0x7f8cb4054700 con 0x7f8cc4156670 2023-07-06T22:01:15.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.761+0000 7f8ccb80b640 1 -- 172.21.15.55:0/3386457974 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f8ca80663a0 msgr2=0x7f8ca8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:15.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.761+0000 7f8ccb80b640 1 --2- 172.21.15.55:0/3386457974 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f8ca80663a0 0x7f8ca8068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00ab000 tx=0x7f8cc00a7070 comp rx=0 tx=0).stop 2023-07-06T22:01:15.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.761+0000 7f8ccb80b640 1 -- 172.21.15.55:0/3386457974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cc4156670 msgr2=0x7f8cc415c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:15.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.761+0000 7f8ccb80b640 1 --2- 172.21.15.55:0/3386457974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cc4156670 0x7f8cc415c350 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400f7f0 tx=0x7f8cb400fcb0 comp rx=0 tx=0).stop 2023-07-06T22:01:15.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.761+0000 7f8ccb80b640 1 -- 172.21.15.55:0/3386457974 shutdown_connections 2023-07-06T22:01:15.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.761+0000 7f8ccb80b640 1 --2- 172.21.15.55:0/3386457974 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f8ca80663a0 0x7f8ca8068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:15.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.761+0000 7f8ccb80b640 1 --2- 172.21.15.55:0/3386457974 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8cc4156ae0 0x7f8cc415c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:15.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.761+0000 7f8ccb80b640 1 --2- 172.21.15.55:0/3386457974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cc4156670 0x7f8cc415c350 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:15.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.761+0000 7f8ccb80b640 1 --2- 172.21.15.55:0/3386457974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb00039b0 0x7f8cc41560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:15.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.761+0000 7f8ccb80b640 1 -- 172.21.15.55:0/3386457974 >> 172.21.15.55:0/3386457974 conn(0x7f8cc40ceee0 msgr2=0x7f8cc40693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:15.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.761+0000 7f8ccb80b640 1 -- 172.21.15.55:0/3386457974 shutdown_connections 2023-07-06T22:01:15.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.761+0000 7f8ccb80b640 1 -- 172.21.15.55:0/3386457974 wait complete. 2023-07-06T22:01:15.780 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-07-06T22:01:15.780 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-07-06T22:01:15.781 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-06T22:01:15.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-07-06T22:01:15.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f69363a5640 1 Processor -- start 2023-07-06T22:01:15.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f69363a5640 1 -- start start 2023-07-06T22:01:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f69363a5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69300ce5e0 0x7f69300b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:15.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f69363a5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69300cc770 con 0x7f69300b40e0 2023-07-06T22:01:15.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f69363a5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69300cc9c0 con 0x7f693015b9d0 2023-07-06T22:01:15.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f69363a5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69300b4560 con 0x7f69300ce5e0 2023-07-06T22:01:15.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f6935ba4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f69300b40e0 0x7f69300d0650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48584/0 (socket says 172.21.15.55:48584) 2023-07-06T22:01:15.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f6935ba4640 1 -- 172.21.15.55:0/307064180 learned_addr learned my addr 172.21.15.55:0/307064180 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:15.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f6934ba2640 1 --2- 172.21.15.55:0/307064180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69300ce5e0 0x7f69300b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:15.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f6927fff640 1 -- 172.21.15.55:0/307064180 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036503749 0 0) 0x7f69300cc770 con 0x7f69300b40e0 2023-07-06T22:01:15.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f6927fff640 1 -- 172.21.15.55:0/307064180 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f691c003530 con 0x7f69300b40e0 2023-07-06T22:01:15.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f6927fff640 1 -- 172.21.15.55:0/307064180 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530037731 0 0) 0x7f69300cc9c0 con 0x7f693015b9d0 2023-07-06T22:01:15.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f6927fff640 1 -- 172.21.15.55:0/307064180 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69300cc770 con 0x7f693015b9d0 2023-07-06T22:01:15.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f6934ba2640 1 -- 172.21.15.55:0/307064180 >> v1:172.21.15.138:6789/0 conn(0x7f693015b9d0 legacy=0x7f69300b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:15.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f6934ba2640 1 -- 172.21.15.55:0/307064180 >> v1:172.21.15.55:6789/0 conn(0x7f69300b40e0 legacy=0x7f69300d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:15.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.933+0000 7f6934ba2640 1 -- 172.21.15.55:0/307064180 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69300ccca0 con 0x7f69300ce5e0 2023-07-06T22:01:15.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.937+0000 7f6934ba2640 1 --2- 172.21.15.55:0/307064180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69300ce5e0 0x7f69300b3ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f69200097f0 tx=0x7f692001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ea79dfde24e6f95 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:15.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.937+0000 7f6927fff640 1 -- 172.21.15.55:0/307064180 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200ab680 con 0x7f69300ce5e0 2023-07-06T22:01:15.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.937+0000 7f6927fff640 1 -- 172.21.15.55:0/307064180 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69200ab7e0 con 0x7f69300ce5e0 2023-07-06T22:01:15.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.937+0000 7f6927fff640 1 -- 172.21.15.55:0/307064180 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200abb70 con 0x7f69300ce5e0 2023-07-06T22:01:15.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.937+0000 7f69363a5640 1 -- 172.21.15.55:0/307064180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69300ce5e0 msgr2=0x7f69300b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:15.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.937+0000 7f69363a5640 1 --2- 172.21.15.55:0/307064180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69300ce5e0 0x7f69300b3ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f69200097f0 tx=0x7f692001c4c0 comp rx=0 tx=0).stop 2023-07-06T22:01:15.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.937+0000 7f69363a5640 1 -- 172.21.15.55:0/307064180 shutdown_connections 2023-07-06T22:01:15.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.937+0000 7f69363a5640 1 --2- 172.21.15.55:0/307064180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69300ce5e0 0x7f69300b3ba0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:15.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.937+0000 7f69363a5640 1 -- 172.21.15.55:0/307064180 >> 172.21.15.55:0/307064180 conn(0x7f693006c2b0 msgr2=0x7f69300ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:15.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.937+0000 7f69363a5640 1 -- 172.21.15.55:0/307064180 shutdown_connections 2023-07-06T22:01:15.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.937+0000 7f69363a5640 1 -- 172.21.15.55:0/307064180 wait complete. 2023-07-06T22:01:15.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f69363a5640 1 Processor -- start 2023-07-06T22:01:15.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f69363a5640 1 -- start start 2023-07-06T22:01:15.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f69363a5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69300b40e0 0x7f693014c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:15.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f69363a5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69300ce5e0 0x7f69300b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:15.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f69363a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f693015b9d0 0x7f69300ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:15.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f69363a5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69300b6610 con 0x7f693015b9d0 2023-07-06T22:01:15.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f69363a5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69300b5a00 con 0x7f69300b40e0 2023-07-06T22:01:15.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f69363a5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69300b5ce0 con 0x7f69300ce5e0 2023-07-06T22:01:15.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f6935ba4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f693015b9d0 0x7f69300ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:15.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f6935ba4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f693015b9d0 0x7f69300ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54138/0 (socket says 172.21.15.55:54138) 2023-07-06T22:01:15.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f6935ba4640 1 -- 172.21.15.55:0/1853290807 learned_addr learned my addr 172.21.15.55:0/1853290807 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:15.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f69353a3640 1 --2- 172.21.15.55:0/1853290807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69300b40e0 0x7f693014c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:15.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f6934ba2640 1 --2- 172.21.15.55:0/1853290807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69300ce5e0 0x7f69300b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:15.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f6935ba4640 1 -- 172.21.15.55:0/1853290807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69300ce5e0 msgr2=0x7f69300b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:15.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f6935ba4640 1 --2- 172.21.15.55:0/1853290807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69300ce5e0 0x7f69300b6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:15.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f6935ba4640 1 -- 172.21.15.55:0/1853290807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69300b40e0 msgr2=0x7f693014c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:15.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f6935ba4640 1 --2- 172.21.15.55:0/1853290807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69300b40e0 0x7f693014c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:15.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f6935ba4640 1 -- 172.21.15.55:0/1853290807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920009420 con 0x7f693015b9d0 2023-07-06T22:01:15.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f6935ba4640 1 --2- 172.21.15.55:0/1853290807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f693015b9d0 0x7f69300ca750 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f692800cb40 tx=0x7f692800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:15.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f6925ffb640 1 -- 172.21.15.55:0/1853290807 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692800aca0 con 0x7f693015b9d0 2023-07-06T22:01:15.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f6925ffb640 1 -- 172.21.15.55:0/1853290807 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692800ae20 con 0x7f693015b9d0 2023-07-06T22:01:15.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f6925ffb640 1 -- 172.21.15.55:0/1853290807 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6928012640 con 0x7f693015b9d0 2023-07-06T22:01:15.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f69363a5640 1 -- 172.21.15.55:0/1853290807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69300b5fc0 con 0x7f693015b9d0 2023-07-06T22:01:15.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.941+0000 7f69363a5640 1 -- 172.21.15.55:0/1853290807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693014ceb0 con 0x7f693015b9d0 2023-07-06T22:01:15.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.945+0000 7f69363a5640 1 -- 172.21.15.55:0/1853290807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69300b1070 con 0x7f693015b9d0 2023-07-06T22:01:15.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.945+0000 7f6925ffb640 1 -- 172.21.15.55:0/1853290807 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6928007070 con 0x7f693015b9d0 2023-07-06T22:01:15.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.945+0000 7f6925ffb640 1 --2- 172.21.15.55:0/1853290807 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69140663a0 0x7f6914068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:15.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.945+0000 7f6925ffb640 1 -- 172.21.15.55:0/1853290807 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f6928083f90 con 0x7f693015b9d0 2023-07-06T22:01:15.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.945+0000 7f69353a3640 1 --2- 172.21.15.55:0/1853290807 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69140663a0 0x7f6914068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:15.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.945+0000 7f69353a3640 1 --2- 172.21.15.55:0/1853290807 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69140663a0 0x7f6914068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f692c0011f0 tx=0x7f692c009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:15.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:15.949+0000 7f6925ffb640 1 -- 172.21.15.55:0/1853290807 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6928051230 con 0x7f693015b9d0 2023-07-06T22:01:16.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.157+0000 7f69363a5640 1 -- 172.21.15.55:0/1853290807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f693004d790 con 0x7f693015b9d0 2023-07-06T22:01:16.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.765+0000 7f6925ffb640 1 -- 172.21.15.55:0/1853290807 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v741) v1 ==== 177+0+0 (secure 0 0 0) 0x7f6928017020 con 0x7f693015b9d0 2023-07-06T22:01:16.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.769+0000 7f69363a5640 1 -- 172.21.15.55:0/1853290807 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69140663a0 msgr2=0x7f6914068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:16.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.769+0000 7f69363a5640 1 --2- 172.21.15.55:0/1853290807 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69140663a0 0x7f6914068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f692c0011f0 tx=0x7f692c009040 comp rx=0 tx=0).stop 2023-07-06T22:01:16.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.769+0000 7f69363a5640 1 -- 172.21.15.55:0/1853290807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f693015b9d0 msgr2=0x7f69300ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:16.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.769+0000 7f69363a5640 1 --2- 172.21.15.55:0/1853290807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f693015b9d0 0x7f69300ca750 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f692800cb40 tx=0x7f692800a060 comp rx=0 tx=0).stop 2023-07-06T22:01:16.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.769+0000 7f69363a5640 1 -- 172.21.15.55:0/1853290807 shutdown_connections 2023-07-06T22:01:16.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.769+0000 7f69363a5640 1 --2- 172.21.15.55:0/1853290807 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69140663a0 0x7f6914068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:16.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.769+0000 7f69363a5640 1 --2- 172.21.15.55:0/1853290807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f693015b9d0 0x7f69300ca750 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:16.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.769+0000 7f69363a5640 1 --2- 172.21.15.55:0/1853290807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69300ce5e0 0x7f69300b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:16.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.769+0000 7f69363a5640 1 --2- 172.21.15.55:0/1853290807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69300b40e0 0x7f693014c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:16.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.769+0000 7f69363a5640 1 -- 172.21.15.55:0/1853290807 >> 172.21.15.55:0/1853290807 conn(0x7f693006c2b0 msgr2=0x7f69300d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:16.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.769+0000 7f69363a5640 1 -- 172.21.15.55:0/1853290807 shutdown_connections 2023-07-06T22:01:16.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.769+0000 7f69363a5640 1 -- 172.21.15.55:0/1853290807 wait complete. 2023-07-06T22:01:16.785 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:01:16.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.933+0000 7f6675103640 1 Processor -- start 2023-07-06T22:01:16.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.933+0000 7f6675103640 1 -- start start 2023-07-06T22:01:16.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.933+0000 7f6675103640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f66700712f0 0x7f667006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:16.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.933+0000 7f6675103640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66700b3730 0x7f66700c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:16.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.933+0000 7f6675103640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66700ca280 0x7f66700c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:16.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.933+0000 7f6675103640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66700ca700 con 0x7f66700ca280 2023-07-06T22:01:16.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.933+0000 7f6675103640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6670159cd0 con 0x7f66700712f0 2023-07-06T22:01:16.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.933+0000 7f6675103640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66700693f0 con 0x7f66700b3730 2023-07-06T22:01:16.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.937+0000 7f666f59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66700ca280 0x7f66700c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:16.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.937+0000 7f666f59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66700ca280 0x7f66700c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54144/0 (socket says 172.21.15.55:54144) 2023-07-06T22:01:16.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.937+0000 7f666f59e640 1 -- 172.21.15.55:0/3251244727 learned_addr learned my addr 172.21.15.55:0/3251244727 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:16.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.937+0000 7f666ed9d640 1 --2- 172.21.15.55:0/3251244727 >> v2:172.21.15.138:3300/0 conn(0x7f66700712f0 0x7f667006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:16.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.937+0000 7f6667fff640 1 --2- 172.21.15.55:0/3251244727 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66700b3730 0x7f66700c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:16.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.937+0000 7f666f59e640 1 -- 172.21.15.55:0/3251244727 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66700b3730 msgr2=0x7f66700c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:16.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.937+0000 7f666f59e640 1 --2- 172.21.15.55:0/3251244727 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66700b3730 0x7f66700c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:16.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.937+0000 7f666f59e640 1 -- 172.21.15.55:0/3251244727 >> v2:172.21.15.138:3300/0 conn(0x7f66700712f0 msgr2=0x7f667006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:16.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.937+0000 7f666f59e640 1 --2- 172.21.15.55:0/3251244727 >> v2:172.21.15.138:3300/0 conn(0x7f66700712f0 0x7f667006a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:16.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.937+0000 7f666f59e640 1 -- 172.21.15.55:0/3251244727 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667006aca0 con 0x7f66700ca280 2023-07-06T22:01:16.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.937+0000 7f666f59e640 1 --2- 172.21.15.55:0/3251244727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66700ca280 0x7f66700c8520 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f6670071950 tx=0x7f666801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316d2713a48cfc22 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:16.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.937+0000 7f666e59c640 1 -- 172.21.15.55:0/3251244727 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66680a6480 con 0x7f66700ca280 2023-07-06T22:01:16.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.937+0000 7f666e59c640 1 -- 172.21.15.55:0/3251244727 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66680a65e0 con 0x7f66700ca280 2023-07-06T22:01:16.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.937+0000 7f666e59c640 1 -- 172.21.15.55:0/3251244727 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66680a6970 con 0x7f66700ca280 2023-07-06T22:01:16.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 -- 172.21.15.55:0/3251244727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66700ca280 msgr2=0x7f66700c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:16.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 --2- 172.21.15.55:0/3251244727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66700ca280 0x7f66700c8520 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f6670071950 tx=0x7f666801c6e0 comp rx=0 tx=0).stop 2023-07-06T22:01:16.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 -- 172.21.15.55:0/3251244727 shutdown_connections 2023-07-06T22:01:16.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 --2- 172.21.15.55:0/3251244727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66700ca280 0x7f66700c8520 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:16.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 --2- 172.21.15.55:0/3251244727 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66700b3730 0x7f66700c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:16.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 --2- 172.21.15.55:0/3251244727 >> v2:172.21.15.138:3300/0 conn(0x7f66700712f0 0x7f667006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:16.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 -- 172.21.15.55:0/3251244727 >> 172.21.15.55:0/3251244727 conn(0x7f66700cded0 msgr2=0x7f66700ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:16.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 -- 172.21.15.55:0/3251244727 shutdown_connections 2023-07-06T22:01:16.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 -- 172.21.15.55:0/3251244727 wait complete. 2023-07-06T22:01:16.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 Processor -- start 2023-07-06T22:01:16.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 -- start start 2023-07-06T22:01:16.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66700712f0 0x7f6670152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:16.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66700b3730 0x7f66700ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:16.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66700ca280 0x7f667015bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:16.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66700af250 con 0x7f66700b3730 2023-07-06T22:01:16.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66700aca20 con 0x7f66700ca280 2023-07-06T22:01:16.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6675103640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66700accc0 con 0x7f66700712f0 2023-07-06T22:01:16.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6667fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66700b3730 0x7f66700ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:16.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6667fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66700b3730 0x7f66700ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54146/0 (socket says 172.21.15.55:54146) 2023-07-06T22:01:16.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6667fff640 1 -- 172.21.15.55:0/2079896340 learned_addr learned my addr 172.21.15.55:0/2079896340 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:16.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f666ed9d640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66700712f0 0x7f6670152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:16.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f666f59e640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66700ca280 0x7f667015bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:16.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6667fff640 1 -- 172.21.15.55:0/2079896340 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66700712f0 msgr2=0x7f6670152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:16.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6667fff640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66700712f0 0x7f6670152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:16.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6667fff640 1 -- 172.21.15.55:0/2079896340 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66700ca280 msgr2=0x7f667015bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:16.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6667fff640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66700ca280 0x7f667015bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:16.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f6667fff640 1 -- 172.21.15.55:0/2079896340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6668009b30 con 0x7f66700b3730 2023-07-06T22:01:16.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f666f59e640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66700ca280 0x7f667015bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:16.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.941+0000 7f666ed9d640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66700712f0 0x7f6670152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:16.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.945+0000 7f6667fff640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66700b3730 0x7f66700ae8e0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f665800d5f0 tx=0x7f665800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:16.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.945+0000 7f66677fe640 1 -- 172.21.15.55:0/2079896340 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66580125f0 con 0x7f66700b3730 2023-07-06T22:01:16.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.945+0000 7f66677fe640 1 -- 172.21.15.55:0/2079896340 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6658012750 con 0x7f66700b3730 2023-07-06T22:01:16.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.945+0000 7f6675103640 1 -- 172.21.15.55:0/2079896340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66700acfa0 con 0x7f66700b3730 2023-07-06T22:01:16.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.945+0000 7f66677fe640 1 -- 172.21.15.55:0/2079896340 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6658012ae0 con 0x7f66700b3730 2023-07-06T22:01:16.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.945+0000 7f6675103640 1 -- 172.21.15.55:0/2079896340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66700aee20 con 0x7f66700b3730 2023-07-06T22:01:16.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.945+0000 7f6675103640 1 -- 172.21.15.55:0/2079896340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66700ad1e0 con 0x7f66700b3730 2023-07-06T22:01:16.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.945+0000 7f66677fe640 1 -- 172.21.15.55:0/2079896340 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6658012c40 con 0x7f66700b3730 2023-07-06T22:01:16.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.945+0000 7f66677fe640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f66500663a0 0x7f6650068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:16.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.945+0000 7f66677fe640 1 -- 172.21.15.55:0/2079896340 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f6658084550 con 0x7f66700b3730 2023-07-06T22:01:16.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.945+0000 7f666ed9d640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f66500663a0 0x7f6650068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:16.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.949+0000 7f666ed9d640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f66500663a0 0x7f6650068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f666000ba50 tx=0x7f6660008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:16.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:16.949+0000 7f66677fe640 1 -- 172.21.15.55:0/2079896340 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f66700ad1e0 con 0x7f66700b3730 2023-07-06T22:01:17.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.105+0000 7f6675103640 1 -- 172.21.15.55:0/2079896340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66700cbaf0 con 0x7f66700b3730 2023-07-06T22:01:17.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.105+0000 7f66677fe640 1 -- 172.21.15.55:0/2079896340 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16139 (secure 0 0 0) 0x7f66700cbaf0 con 0x7f66700b3730 2023-07-06T22:01:17.103 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:17.103 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":137,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:01:13.742163+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/1836658324":"2023-07-07T22:01:10.046646+0000","172.21.15.55:0/3688307648":"2023-07-07T22:01:07.113539+0000","172.21.15.55:6832/1146764448":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/4179834000":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/3903150954":"2023-07-07T22:01:07.113539+0000","172.21.15.55:6835/1836658324":"2023-07-07T22:01:10.046646+0000","172.21.15.55:0/386400094":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/3430803253":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/345640234":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/954036155":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/1438757296":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/3754412972":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/1384648608":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/2671638221":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/604485969":"2023-07-07T22:00:35.993679+0000","172.21.15.55:0/3447905990":"2023-07-07T22:01:07.113539+0000","172.21.15.55:0/2811517165":"2023-07-07T22:00:35.993679+0000","172.21.15.55:6833/3817107512":"2023-07-07T22:00:35.993679+0000","172.21.15.55:6833/1146764448":"2023-07-07T22:01:07.113539+0000","172.21.15.55:6832/3817107512":"2023-07-07T22:00:35.993679+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:01:17.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.109+0000 7f6675103640 1 -- 172.21.15.55:0/2079896340 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f66500663a0 msgr2=0x7f6650068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.109+0000 7f6675103640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f66500663a0 0x7f6650068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f666000ba50 tx=0x7f6660008040 comp rx=0 tx=0).stop 2023-07-06T22:01:17.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.109+0000 7f6675103640 1 -- 172.21.15.55:0/2079896340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66700b3730 msgr2=0x7f66700ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.109+0000 7f6675103640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66700b3730 0x7f66700ae8e0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f665800d5f0 tx=0x7f665800dab0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.109+0000 7f6675103640 1 -- 172.21.15.55:0/2079896340 shutdown_connections 2023-07-06T22:01:17.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.109+0000 7f6675103640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f66500663a0 0x7f6650068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.109+0000 7f6675103640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66700ca280 0x7f667015bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.109+0000 7f6675103640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66700b3730 0x7f66700ae8e0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.109+0000 7f6675103640 1 --2- 172.21.15.55:0/2079896340 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66700712f0 0x7f6670152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.109+0000 7f6675103640 1 -- 172.21.15.55:0/2079896340 >> 172.21.15.55:0/2079896340 conn(0x7f66700cded0 msgr2=0x7f66700b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:17.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.109+0000 7f6675103640 1 -- 172.21.15.55:0/2079896340 shutdown_connections 2023-07-06T22:01:17.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.109+0000 7f6675103640 1 -- 172.21.15.55:0/2079896340 wait complete. 2023-07-06T22:01:17.124 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:01:17.125 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:01:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.273+0000 7f821bd2c640 1 Processor -- start 2023-07-06T22:01:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.277+0000 7f821bd2c640 1 -- start start 2023-07-06T22:01:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.277+0000 7f821bd2c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f82140709a0 0x7f82140cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.277+0000 7f821bd2c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82140b1340 0x7f821406eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.277+0000 7f821bd2c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82140cc300 con 0x7f82140cbe60 2023-07-06T22:01:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.277+0000 7f821bd2c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82140cc5e0 con 0x7f82140b1340 2023-07-06T22:01:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.277+0000 7f821bd2c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82140cc8c0 con 0x7f82140709a0 2023-07-06T22:01:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.277+0000 7f821a2c9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82140b1340 0x7f821406eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.277+0000 7f8219ac8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f82140709a0 0x7f82140cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.277+0000 7f821a2c9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82140b1340 0x7f821406eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54162/0 (socket says 172.21.15.55:54162) 2023-07-06T22:01:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.277+0000 7f821a2c9640 1 -- 172.21.15.55:0/1342126853 learned_addr learned my addr 172.21.15.55:0/1342126853 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.277+0000 7f821a2c9640 1 -- 172.21.15.55:0/1342126853 >> v2:172.21.15.138:3300/0 conn(0x7f82140709a0 msgr2=0x7f82140cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:17.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.277+0000 7f821a2c9640 1 --2- 172.21.15.55:0/1342126853 >> v2:172.21.15.138:3300/0 conn(0x7f82140709a0 0x7f82140cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.277+0000 7f821a2c9640 1 -- 172.21.15.55:0/1342126853 >> v1:172.21.15.138:6789/0 conn(0x7f82140cbe60 legacy=0x7f82140b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.277+0000 7f821a2c9640 1 -- 172.21.15.55:0/1342126853 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82140ccba0 con 0x7f82140b1340 2023-07-06T22:01:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.281+0000 7f821a2c9640 1 --2- 172.21.15.55:0/1342126853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82140b1340 0x7f821406eee0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f821406ec60 tx=0x7f820c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713986f92ab42b5c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.281+0000 7f8218ac6640 1 -- 172.21.15.55:0/1342126853 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0a57a0 con 0x7f82140b1340 2023-07-06T22:01:17.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.281+0000 7f8218ac6640 1 -- 172.21.15.55:0/1342126853 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c0a5900 con 0x7f82140b1340 2023-07-06T22:01:17.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.281+0000 7f8218ac6640 1 -- 172.21.15.55:0/1342126853 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0a5c90 con 0x7f82140b1340 2023-07-06T22:01:17.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.281+0000 7f821bd2c640 1 -- 172.21.15.55:0/1342126853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82140b1340 msgr2=0x7f821406eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.281+0000 7f821bd2c640 1 --2- 172.21.15.55:0/1342126853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82140b1340 0x7f821406eee0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f821406ec60 tx=0x7f820c01c9d0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.281+0000 7f821bd2c640 1 -- 172.21.15.55:0/1342126853 shutdown_connections 2023-07-06T22:01:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.281+0000 7f821bd2c640 1 --2- 172.21.15.55:0/1342126853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82140b1340 0x7f821406eee0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.281+0000 7f821bd2c640 1 --2- 172.21.15.55:0/1342126853 >> v2:172.21.15.138:3300/0 conn(0x7f82140709a0 0x7f82140cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.281+0000 7f821bd2c640 1 -- 172.21.15.55:0/1342126853 >> 172.21.15.55:0/1342126853 conn(0x7f82140cea70 msgr2=0x7f82140ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.281+0000 7f821bd2c640 1 -- 172.21.15.55:0/1342126853 shutdown_connections 2023-07-06T22:01:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.281+0000 7f821bd2c640 1 -- 172.21.15.55:0/1342126853 wait complete. 2023-07-06T22:01:17.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.281+0000 7f821bd2c640 1 Processor -- start 2023-07-06T22:01:17.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.281+0000 7f821bd2c640 1 -- start start 2023-07-06T22:01:17.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821bd2c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82140709a0 0x7f82141578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821bd2c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82140b1340 0x7f8214155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821bd2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82140cbe60 0x7f82141556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821bd2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82140adca0 con 0x7f82140cbe60 2023-07-06T22:01:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821bd2c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82140c7150 con 0x7f82140b1340 2023-07-06T22:01:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821bd2c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82140ad370 con 0x7f82140709a0 2023-07-06T22:01:17.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821a2c9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82140cbe60 0x7f82141556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821a2c9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82140cbe60 0x7f82141556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54164/0 (socket says 172.21.15.55:54164) 2023-07-06T22:01:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821a2c9640 1 -- 172.21.15.55:0/3455723147 learned_addr learned my addr 172.21.15.55:0/3455723147 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f8219ac8640 1 --2- 172.21.15.55:0/3455723147 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82140709a0 0x7f82141578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f82192c7640 1 --2- 172.21.15.55:0/3455723147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82140b1340 0x7f8214155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821a2c9640 1 -- 172.21.15.55:0/3455723147 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82140709a0 msgr2=0x7f82141578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821a2c9640 1 --2- 172.21.15.55:0/3455723147 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82140709a0 0x7f82141578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821a2c9640 1 -- 172.21.15.55:0/3455723147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82140b1340 msgr2=0x7f8214155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821a2c9640 1 --2- 172.21.15.55:0/3455723147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82140b1340 0x7f8214155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821a2c9640 1 -- 172.21.15.55:0/3455723147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c009b30 con 0x7f82140cbe60 2023-07-06T22:01:17.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821a2c9640 1 --2- 172.21.15.55:0/3455723147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82140cbe60 0x7f82141556b0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f820c0af040 tx=0x7f820c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:17.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f820a7fc640 1 -- 172.21.15.55:0/3455723147 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0b8670 con 0x7f82140cbe60 2023-07-06T22:01:17.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f820a7fc640 1 -- 172.21.15.55:0/3455723147 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c0b87d0 con 0x7f82140cbe60 2023-07-06T22:01:17.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f820a7fc640 1 -- 172.21.15.55:0/3455723147 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0b8b80 con 0x7f82140cbe60 2023-07-06T22:01:17.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821bd2c640 1 -- 172.21.15.55:0/3455723147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82140ad650 con 0x7f82140cbe60 2023-07-06T22:01:17.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821bd2c640 1 -- 172.21.15.55:0/3455723147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8214157e10 con 0x7f82140cbe60 2023-07-06T22:01:17.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f821bd2c640 1 -- 172.21.15.55:0/3455723147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8214157fa0 con 0x7f82140cbe60 2023-07-06T22:01:17.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.285+0000 7f820a7fc640 1 -- 172.21.15.55:0/3455723147 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f820c0b8ce0 con 0x7f82140cbe60 2023-07-06T22:01:17.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.289+0000 7f820a7fc640 1 --2- 172.21.15.55:0/3455723147 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f81f80663a0 0x7f81f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.289+0000 7f820a7fc640 1 -- 172.21.15.55:0/3455723147 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f820c11f930 con 0x7f82140cbe60 2023-07-06T22:01:17.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.289+0000 7f8219ac8640 1 --2- 172.21.15.55:0/3455723147 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f81f80663a0 0x7f81f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.289+0000 7f8219ac8640 1 --2- 172.21.15.55:0/3455723147 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f81f80663a0 0x7f81f8068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f82141f7c10 tx=0x7f8210008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:17.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.293+0000 7f820a7fc640 1 -- 172.21.15.55:0/3455723147 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8214157fa0 con 0x7f82140cbe60 2023-07-06T22:01:17.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.445+0000 7f821bd2c640 1 -- 172.21.15.55:0/3455723147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8214157fa0 con 0x7f82140cbe60 2023-07-06T22:01:17.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.445+0000 7f820a7fc640 1 -- 172.21.15.55:0/3455723147 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8214157fa0 con 0x7f82140cbe60 2023-07-06T22:01:17.443 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:01:17.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.449+0000 7f821bd2c640 1 -- 172.21.15.55:0/3455723147 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f81f80663a0 msgr2=0x7f81f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.449+0000 7f821bd2c640 1 --2- 172.21.15.55:0/3455723147 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f81f80663a0 0x7f81f8068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f82141f7c10 tx=0x7f8210008040 comp rx=0 tx=0).stop 2023-07-06T22:01:17.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.449+0000 7f821bd2c640 1 -- 172.21.15.55:0/3455723147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82140cbe60 msgr2=0x7f82141556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.449+0000 7f821bd2c640 1 --2- 172.21.15.55:0/3455723147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82140cbe60 0x7f82141556b0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f820c0af040 tx=0x7f820c019770 comp rx=0 tx=0).stop 2023-07-06T22:01:17.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.449+0000 7f821bd2c640 1 -- 172.21.15.55:0/3455723147 shutdown_connections 2023-07-06T22:01:17.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.449+0000 7f821bd2c640 1 --2- 172.21.15.55:0/3455723147 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f81f80663a0 0x7f81f8068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.449+0000 7f821bd2c640 1 --2- 172.21.15.55:0/3455723147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82140cbe60 0x7f82141556b0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.449+0000 7f821bd2c640 1 --2- 172.21.15.55:0/3455723147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82140b1340 0x7f8214155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.449+0000 7f821bd2c640 1 --2- 172.21.15.55:0/3455723147 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82140709a0 0x7f82141578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.449+0000 7f821bd2c640 1 -- 172.21.15.55:0/3455723147 >> 172.21.15.55:0/3455723147 conn(0x7f82140cea70 msgr2=0x7f821415bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:17.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.449+0000 7f821bd2c640 1 -- 172.21.15.55:0/3455723147 shutdown_connections 2023-07-06T22:01:17.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.449+0000 7f821bd2c640 1 -- 172.21.15.55:0/3455723147 wait complete. 2023-07-06T22:01:17.464 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:01:17.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0187737640 1 Processor -- start 2023-07-06T22:01:17.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0187737640 1 -- start start 2023-07-06T22:01:17.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0187737640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0180158e70 0x7f0180159240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0187737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0180159780 0x7f018006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0187737640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0180070530 0x7f01800ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0187737640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01800709b0 con 0x7f0180070530 2023-07-06T22:01:17.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0187737640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0180159bf0 con 0x7f0180158e70 2023-07-06T22:01:17.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0187737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018015d0c0 con 0x7f0180159780 2023-07-06T22:01:17.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0185cd4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0180070530 0x7f01800ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0185cd4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0180070530 0x7f01800ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54168/0 (socket says 172.21.15.55:54168) 2023-07-06T22:01:17.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0185cd4640 1 -- 172.21.15.55:0/1033381460 learned_addr learned my addr 172.21.15.55:0/1033381460 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:17.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0184cd2640 1 --2- 172.21.15.55:0/1033381460 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0180159780 0x7f018006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f01854d3640 1 --2- 172.21.15.55:0/1033381460 >> v2:172.21.15.138:3300/0 conn(0x7f0180158e70 0x7f0180159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0185cd4640 1 -- 172.21.15.55:0/1033381460 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0180159780 msgr2=0x7f018006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:17.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0185cd4640 1 --2- 172.21.15.55:0/1033381460 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0180159780 0x7f018006fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0185cd4640 1 -- 172.21.15.55:0/1033381460 >> v2:172.21.15.138:3300/0 conn(0x7f0180158e70 msgr2=0x7f0180159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:17.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0185cd4640 1 --2- 172.21.15.55:0/1033381460 >> v2:172.21.15.138:3300/0 conn(0x7f0180158e70 0x7f0180159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.613+0000 7f0185cd4640 1 -- 172.21.15.55:0/1033381460 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018015c540 con 0x7f0180070530 2023-07-06T22:01:17.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.617+0000 7f0185cd4640 1 --2- 172.21.15.55:0/1033381460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0180070530 0x7f01800ccd10 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f0180071420 tx=0x7f017801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d6ab541dbbd929 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:17.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.617+0000 7f0177fff640 1 -- 172.21.15.55:0/1033381460 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01780a5820 con 0x7f0180070530 2023-07-06T22:01:17.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.617+0000 7f0177fff640 1 -- 172.21.15.55:0/1033381460 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01780a5980 con 0x7f0180070530 2023-07-06T22:01:17.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.617+0000 7f0177fff640 1 -- 172.21.15.55:0/1033381460 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01780a5d10 con 0x7f0180070530 2023-07-06T22:01:17.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.617+0000 7f0187737640 1 -- 172.21.15.55:0/1033381460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0180070530 msgr2=0x7f01800ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.617+0000 7f0187737640 1 --2- 172.21.15.55:0/1033381460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0180070530 0x7f01800ccd10 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f0180071420 tx=0x7f017801c9a0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.617+0000 7f0187737640 1 -- 172.21.15.55:0/1033381460 shutdown_connections 2023-07-06T22:01:17.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.617+0000 7f0187737640 1 --2- 172.21.15.55:0/1033381460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0180070530 0x7f01800ccd10 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.617+0000 7f0187737640 1 --2- 172.21.15.55:0/1033381460 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0180159780 0x7f018006fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.617+0000 7f0187737640 1 --2- 172.21.15.55:0/1033381460 >> v2:172.21.15.138:3300/0 conn(0x7f0180158e70 0x7f0180159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.617+0000 7f0187737640 1 -- 172.21.15.55:0/1033381460 >> 172.21.15.55:0/1033381460 conn(0x7f01800cb970 msgr2=0x7f01800cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:17.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0187737640 1 -- 172.21.15.55:0/1033381460 shutdown_connections 2023-07-06T22:01:17.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0187737640 1 -- 172.21.15.55:0/1033381460 wait complete. 2023-07-06T22:01:17.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0187737640 1 Processor -- start 2023-07-06T22:01:17.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0187737640 1 -- start start 2023-07-06T22:01:17.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0187737640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0180070530 0x7f0180152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0187737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0180158e70 0x7f018006bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0187737640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0180159780 0x7f018006c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0187737640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01800a7790 con 0x7f0180070530 2023-07-06T22:01:17.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0187737640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01800c92a0 con 0x7f0180159780 2023-07-06T22:01:17.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0187737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01800c9580 con 0x7f0180158e70 2023-07-06T22:01:17.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f01854d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0180070530 0x7f0180152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f01854d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0180070530 0x7f0180152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54172/0 (socket says 172.21.15.55:54172) 2023-07-06T22:01:17.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f01854d3640 1 -- 172.21.15.55:0/3173166127 learned_addr learned my addr 172.21.15.55:0/3173166127 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:17.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0185cd4640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0180159780 0x7f018006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0184cd2640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0180158e70 0x7f018006bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f01854d3640 1 -- 172.21.15.55:0/3173166127 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0180158e70 msgr2=0x7f018006bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f01854d3640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0180158e70 0x7f018006bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f01854d3640 1 -- 172.21.15.55:0/3173166127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0180159780 msgr2=0x7f018006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f01854d3640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0180159780 0x7f018006c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f01854d3640 1 -- 172.21.15.55:0/3173166127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0178009b30 con 0x7f0180070530 2023-07-06T22:01:17.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0185cd4640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0180159780 0x7f018006c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:17.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f01854d3640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0180070530 0x7f0180152390 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f017c00d800 tx=0x7f017c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:17.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0175ffb640 1 -- 172.21.15.55:0/3173166127 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c0096a0 con 0x7f0180070530 2023-07-06T22:01:17.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0175ffb640 1 -- 172.21.15.55:0/3173166127 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c009800 con 0x7f0180070530 2023-07-06T22:01:17.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0175ffb640 1 -- 172.21.15.55:0/3173166127 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c009990 con 0x7f0180070530 2023-07-06T22:01:17.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.621+0000 7f0187737640 1 -- 172.21.15.55:0/3173166127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01800c9860 con 0x7f0180070530 2023-07-06T22:01:17.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.625+0000 7f0187737640 1 -- 172.21.15.55:0/3173166127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01801528d0 con 0x7f0180070530 2023-07-06T22:01:17.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.625+0000 7f0187737640 1 -- 172.21.15.55:0/3173166127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01800a8e30 con 0x7f0180070530 2023-07-06T22:01:17.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.625+0000 7f0175ffb640 1 -- 172.21.15.55:0/3173166127 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f017c009af0 con 0x7f0180070530 2023-07-06T22:01:17.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.625+0000 7f0175ffb640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f01640663d0 0x7f0164068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.625+0000 7f0175ffb640 1 -- 172.21.15.55:0/3173166127 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f017c084400 con 0x7f0180070530 2023-07-06T22:01:17.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.625+0000 7f0184cd2640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f01640663d0 0x7f0164068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.629+0000 7f0184cd2640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f01640663d0 0x7f0164068880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f01700079c0 tx=0x7f0170008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:17.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.629+0000 7f0175ffb640 1 -- 172.21.15.55:0/3173166127 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f017c0515f0 con 0x7f0180070530 2023-07-06T22:01:17.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.785+0000 7f0187737640 1 -- 172.21.15.55:0/3173166127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0180066d60 con 0x7f0180070530 2023-07-06T22:01:17.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.785+0000 7f0175ffb640 1 -- 172.21.15.55:0/3173166127 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v137) v1 ==== 92+0+10 (secure 0 0 0) 0x7f017c054c10 con 0x7f0180070530 2023-07-06T22:01:17.782 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:01:17.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.785+0000 7f0187737640 1 -- 172.21.15.55:0/3173166127 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f01640663d0 msgr2=0x7f0164068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.785+0000 7f0187737640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f01640663d0 0x7f0164068880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f01700079c0 tx=0x7f0170008040 comp rx=0 tx=0).stop 2023-07-06T22:01:17.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.785+0000 7f0187737640 1 -- 172.21.15.55:0/3173166127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0180070530 msgr2=0x7f0180152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.785+0000 7f0187737640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0180070530 0x7f0180152390 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f017c00d800 tx=0x7f017c00dcc0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.785+0000 7f0187737640 1 -- 172.21.15.55:0/3173166127 shutdown_connections 2023-07-06T22:01:17.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.785+0000 7f0187737640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f01640663d0 0x7f0164068880 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.785+0000 7f0187737640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0180159780 0x7f018006c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.789+0000 7f0187737640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0180158e70 0x7f018006bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.789+0000 7f0187737640 1 --2- 172.21.15.55:0/3173166127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0180070530 0x7f0180152390 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.789+0000 7f0187737640 1 -- 172.21.15.55:0/3173166127 >> 172.21.15.55:0/3173166127 conn(0x7f01800cb970 msgr2=0x7f01800ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:17.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.789+0000 7f0187737640 1 -- 172.21.15.55:0/3173166127 shutdown_connections 2023-07-06T22:01:17.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.789+0000 7f0187737640 1 -- 172.21.15.55:0/3173166127 wait complete. 2023-07-06T22:01:17.802 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-06T22:01:17.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.949+0000 7f93f3693640 1 Processor -- start 2023-07-06T22:01:17.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f3693640 1 -- start start 2023-07-06T22:01:17.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f3693640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93ec158850 0x7f93ec0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f3693640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f93ec0ca130 0x7f93ec0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f3693640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93ec0703e0 0x7f93ec070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f3693640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ec070dc0 con 0x7f93ec0703e0 2023-07-06T22:01:17.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f3693640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ec158c20 con 0x7f93ec0ca130 2023-07-06T22:01:17.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f3693640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0c8db0 con 0x7f93ec158850 2023-07-06T22:01:17.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f1c30640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93ec0703e0 0x7f93ec070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f1c30640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93ec0703e0 0x7f93ec070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54176/0 (socket says 172.21.15.55:54176) 2023-07-06T22:01:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f1c30640 1 -- 172.21.15.55:0/2845937627 learned_addr learned my addr 172.21.15.55:0/2845937627 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f142f640 1 --2- 172.21.15.55:0/2845937627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93ec158850 0x7f93ec0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f0c2e640 1 --2- 172.21.15.55:0/2845937627 >> v2:172.21.15.138:3300/0 conn(0x7f93ec0ca130 0x7f93ec0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f1c30640 1 -- 172.21.15.55:0/2845937627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93ec158850 msgr2=0x7f93ec0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f1c30640 1 --2- 172.21.15.55:0/2845937627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93ec158850 0x7f93ec0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f1c30640 1 -- 172.21.15.55:0/2845937627 >> v2:172.21.15.138:3300/0 conn(0x7f93ec0ca130 msgr2=0x7f93ec0ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f1c30640 1 --2- 172.21.15.55:0/2845937627 >> v2:172.21.15.138:3300/0 conn(0x7f93ec0ca130 0x7f93ec0ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.953+0000 7f93f1c30640 1 -- 172.21.15.55:0/2845937627 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec0c9090 con 0x7f93ec0703e0 2023-07-06T22:01:17.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93f1c30640 1 --2- 172.21.15.55:0/2845937627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93ec0703e0 0x7f93ec070880 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f93ec06eb70 tx=0x7f93e401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bcb16db9574b24 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:17.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93e3fff640 1 -- 172.21.15.55:0/2845937627 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e40af400 con 0x7f93ec0703e0 2023-07-06T22:01:17.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93e3fff640 1 -- 172.21.15.55:0/2845937627 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e40ab050 con 0x7f93ec0703e0 2023-07-06T22:01:17.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93e3fff640 1 -- 172.21.15.55:0/2845937627 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e40af780 con 0x7f93ec0703e0 2023-07-06T22:01:17.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93f3693640 1 -- 172.21.15.55:0/2845937627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93ec0703e0 msgr2=0x7f93ec070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93f3693640 1 --2- 172.21.15.55:0/2845937627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93ec0703e0 0x7f93ec070880 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f93ec06eb70 tx=0x7f93e401f1c0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93f3693640 1 -- 172.21.15.55:0/2845937627 shutdown_connections 2023-07-06T22:01:17.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93f3693640 1 --2- 172.21.15.55:0/2845937627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93ec0703e0 0x7f93ec070880 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93f3693640 1 --2- 172.21.15.55:0/2845937627 >> v2:172.21.15.138:3300/0 conn(0x7f93ec0ca130 0x7f93ec0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93f3693640 1 --2- 172.21.15.55:0/2845937627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93ec158850 0x7f93ec0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93f3693640 1 -- 172.21.15.55:0/2845937627 >> 172.21.15.55:0/2845937627 conn(0x7f93ec0cea70 msgr2=0x7f93ec0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:17.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93f3693640 1 -- 172.21.15.55:0/2845937627 shutdown_connections 2023-07-06T22:01:17.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93f3693640 1 -- 172.21.15.55:0/2845937627 wait complete. 2023-07-06T22:01:17.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93f3693640 1 Processor -- start 2023-07-06T22:01:17.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.957+0000 7f93f3693640 1 -- start start 2023-07-06T22:01:17.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f3693640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93ec0703e0 0x7f93ec0ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f3693640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93ec0ca130 0x7f93ec069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f3693640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93ec158850 0x7f93ec0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f3693640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0c2bd0 con 0x7f93ec0ca130 2023-07-06T22:01:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f3693640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0c1fc0 con 0x7f93ec0703e0 2023-07-06T22:01:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f3693640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0c22a0 con 0x7f93ec158850 2023-07-06T22:01:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f0c2e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93ec0ca130 0x7f93ec069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f0c2e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93ec0ca130 0x7f93ec069cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54186/0 (socket says 172.21.15.55:54186) 2023-07-06T22:01:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f0c2e640 1 -- 172.21.15.55:0/611269959 learned_addr learned my addr 172.21.15.55:0/611269959 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f142f640 1 --2- 172.21.15.55:0/611269959 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93ec0703e0 0x7f93ec0ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f1c30640 1 --2- 172.21.15.55:0/611269959 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93ec158850 0x7f93ec0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f0c2e640 1 -- 172.21.15.55:0/611269959 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93ec158850 msgr2=0x7f93ec0afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f0c2e640 1 --2- 172.21.15.55:0/611269959 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93ec158850 0x7f93ec0afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f0c2e640 1 -- 172.21.15.55:0/611269959 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93ec0703e0 msgr2=0x7f93ec0ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:17.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f0c2e640 1 --2- 172.21.15.55:0/611269959 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93ec0703e0 0x7f93ec0ac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:17.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f0c2e640 1 -- 172.21.15.55:0/611269959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e4009b30 con 0x7f93ec0ca130 2023-07-06T22:01:17.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f0c2e640 1 --2- 172.21.15.55:0/611269959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93ec0ca130 0x7f93ec069cc0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00d800 tx=0x7f93dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:17.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93e1ffb640 1 -- 172.21.15.55:0/611269959 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc00b6c0 con 0x7f93ec0ca130 2023-07-06T22:01:17.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93e1ffb640 1 -- 172.21.15.55:0/611269959 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93dc00b820 con 0x7f93ec0ca130 2023-07-06T22:01:17.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93e1ffb640 1 -- 172.21.15.55:0/611269959 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc00bb90 con 0x7f93ec0ca130 2023-07-06T22:01:17.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f3693640 1 -- 172.21.15.55:0/611269959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ec0c2580 con 0x7f93ec0ca130 2023-07-06T22:01:17.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f3693640 1 -- 172.21.15.55:0/611269959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ec0c3060 con 0x7f93ec0ca130 2023-07-06T22:01:17.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.961+0000 7f93f3693640 1 -- 172.21.15.55:0/611269959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ec066d60 con 0x7f93ec0ca130 2023-07-06T22:01:17.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.965+0000 7f93e1ffb640 1 -- 172.21.15.55:0/611269959 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f93dc00bcf0 con 0x7f93ec0ca130 2023-07-06T22:01:17.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.965+0000 7f93e1ffb640 1 --2- 172.21.15.55:0/611269959 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f93d00663a0 0x7f93d0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:17.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.965+0000 7f93e1ffb640 1 -- 172.21.15.55:0/611269959 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f93dc0844b0 con 0x7f93ec0ca130 2023-07-06T22:01:17.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.965+0000 7f93f142f640 1 --2- 172.21.15.55:0/611269959 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f93d00663a0 0x7f93d0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:17.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.965+0000 7f93f142f640 1 --2- 172.21.15.55:0/611269959 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f93d00663a0 0x7f93d0068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0adc00 tx=0x7f93e8008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:17.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:17.969+0000 7f93e1ffb640 1 -- 172.21.15.55:0/611269959 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93dc055150 con 0x7f93ec0ca130 2023-07-06T22:01:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.125+0000 7f93f3693640 1 -- 172.21.15.55:0/611269959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f93ec06cd30 con 0x7f93ec0ca130 2023-07-06T22:01:18.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.129+0000 7f93e1ffb640 1 -- 172.21.15.55:0/611269959 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f93dc054ce0 con 0x7f93ec0ca130 2023-07-06T22:01:18.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.129+0000 7f93f3693640 1 -- 172.21.15.55:0/611269959 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f93d00663a0 msgr2=0x7f93d0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:18.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.129+0000 7f93f3693640 1 --2- 172.21.15.55:0/611269959 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f93d00663a0 0x7f93d0068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0adc00 tx=0x7f93e8008040 comp rx=0 tx=0).stop 2023-07-06T22:01:18.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.129+0000 7f93f3693640 1 -- 172.21.15.55:0/611269959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93ec0ca130 msgr2=0x7f93ec069cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:18.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.129+0000 7f93f3693640 1 --2- 172.21.15.55:0/611269959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93ec0ca130 0x7f93ec069cc0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00d800 tx=0x7f93dc00dcc0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.133+0000 7f93f3693640 1 -- 172.21.15.55:0/611269959 shutdown_connections 2023-07-06T22:01:18.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.133+0000 7f93f3693640 1 --2- 172.21.15.55:0/611269959 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f93d00663a0 0x7f93d0068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.133+0000 7f93f3693640 1 --2- 172.21.15.55:0/611269959 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93ec158850 0x7f93ec0afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.133+0000 7f93f3693640 1 --2- 172.21.15.55:0/611269959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93ec0ca130 0x7f93ec069cc0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.133+0000 7f93f3693640 1 --2- 172.21.15.55:0/611269959 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93ec0703e0 0x7f93ec0ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.133+0000 7f93f3693640 1 -- 172.21.15.55:0/611269959 >> 172.21.15.55:0/611269959 conn(0x7f93ec0cea70 msgr2=0x7f93ec14d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:18.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.133+0000 7f93f3693640 1 -- 172.21.15.55:0/611269959 shutdown_connections 2023-07-06T22:01:18.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.133+0000 7f93f3693640 1 -- 172.21.15.55:0/611269959 wait complete. 2023-07-06T22:01:18.146 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T22:01:18.147 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:01:18.190 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:01:18.250 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T22:01:18.250 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:01:18.250 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:18.259 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:01:18.259 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:01:18.260 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:18.268 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:01:18.269 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:01:18.269 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:18.311 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:01:18.312 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:01:18.312 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:18.321 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:01:18.321 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-06T22:01:18.321 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:01:18.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44dddfa640 1 Processor -- start 2023-07-06T22:01:18.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44dddfa640 1 -- start start 2023-07-06T22:01:18.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44dddfa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44d815fd40 0x7f44d806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:18.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44dddfa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f44d8160110 0x7f44d806c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:18.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44dddfa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d806cd80 con 0x7f44d806c920 2023-07-06T22:01:18.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44dddfa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d80ca880 con 0x7f44d815fd40 2023-07-06T22:01:18.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44dddfa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d80c9c90 con 0x7f44d8160110 2023-07-06T22:01:18.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44d77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44d815fd40 0x7f44d806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:18.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44d77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44d815fd40 0x7f44d806e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54196/0 (socket says 172.21.15.55:54196) 2023-07-06T22:01:18.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44d77fe640 1 -- 172.21.15.55:0/3834797027 learned_addr learned my addr 172.21.15.55:0/3834797027 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:18.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44d6ffd640 1 --2- 172.21.15.55:0/3834797027 >> v2:172.21.15.138:3300/0 conn(0x7f44d8160110 0x7f44d806c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:18.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44d77fe640 1 -- 172.21.15.55:0/3834797027 >> v2:172.21.15.138:3300/0 conn(0x7f44d8160110 msgr2=0x7f44d806c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:18.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44d77fe640 1 --2- 172.21.15.55:0/3834797027 >> v2:172.21.15.138:3300/0 conn(0x7f44d8160110 0x7f44d806c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44d77fe640 1 -- 172.21.15.55:0/3834797027 >> v1:172.21.15.138:6789/0 conn(0x7f44d806c920 legacy=0x7f44d815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:18.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44d77fe640 1 -- 172.21.15.55:0/3834797027 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d80c9f50 con 0x7f44d815fd40 2023-07-06T22:01:18.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.501+0000 7f44d6ffd640 1 --2- 172.21.15.55:0/3834797027 >> v2:172.21.15.138:3300/0 conn(0x7f44d8160110 0x7f44d806c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:18.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.505+0000 7f44d77fe640 1 --2- 172.21.15.55:0/3834797027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d815fd40 0x7f44d806e590 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f44d80713b0 tx=0x7f44c801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7044c4a624838563 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:18.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.505+0000 7f44d67fc640 1 -- 172.21.15.55:0/3834797027 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80aa5f0 con 0x7f44d815fd40 2023-07-06T22:01:18.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.505+0000 7f44d67fc640 1 -- 172.21.15.55:0/3834797027 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c80aa750 con 0x7f44d815fd40 2023-07-06T22:01:18.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.505+0000 7f44d67fc640 1 -- 172.21.15.55:0/3834797027 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80aaae0 con 0x7f44d815fd40 2023-07-06T22:01:18.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.505+0000 7f44dddfa640 1 -- 172.21.15.55:0/3834797027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d815fd40 msgr2=0x7f44d806e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:18.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.505+0000 7f44dddfa640 1 --2- 172.21.15.55:0/3834797027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d815fd40 0x7f44d806e590 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f44d80713b0 tx=0x7f44c801c490 comp rx=0 tx=0).stop 2023-07-06T22:01:18.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.505+0000 7f44dddfa640 1 -- 172.21.15.55:0/3834797027 shutdown_connections 2023-07-06T22:01:18.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.505+0000 7f44dddfa640 1 --2- 172.21.15.55:0/3834797027 >> v2:172.21.15.138:3300/0 conn(0x7f44d8160110 0x7f44d806c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.505+0000 7f44dddfa640 1 --2- 172.21.15.55:0/3834797027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d815fd40 0x7f44d806e590 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.505+0000 7f44dddfa640 1 -- 172.21.15.55:0/3834797027 >> 172.21.15.55:0/3834797027 conn(0x7f44d80b1730 msgr2=0x7f44d80cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:18.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.505+0000 7f44dddfa640 1 -- 172.21.15.55:0/3834797027 shutdown_connections 2023-07-06T22:01:18.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.505+0000 7f44dddfa640 1 -- 172.21.15.55:0/3834797027 wait complete. 2023-07-06T22:01:18.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44dddfa640 1 Processor -- start 2023-07-06T22:01:18.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44dddfa640 1 -- start start 2023-07-06T22:01:18.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44dddfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d806c920 0x7f44d8156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:18.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44dddfa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44d815fd40 0x7f44d80b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:18.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44dddfa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44d8160110 0x7f44d80b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:18.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44dddfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d814c310 con 0x7f44d806c920 2023-07-06T22:01:18.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44dddfa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d814b140 con 0x7f44d815fd40 2023-07-06T22:01:18.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44dddfa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d81568d0 con 0x7f44d8160110 2023-07-06T22:01:18.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44d77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d806c920 0x7f44d8156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:18.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44d77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d806c920 0x7f44d8156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54200/0 (socket says 172.21.15.55:54200) 2023-07-06T22:01:18.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44d77fe640 1 -- 172.21.15.55:0/1101418582 learned_addr learned my addr 172.21.15.55:0/1101418582 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:18.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44d6ffd640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44d815fd40 0x7f44d80b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:18.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44d7fff640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44d8160110 0x7f44d80b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:18.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44d77fe640 1 -- 172.21.15.55:0/1101418582 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44d8160110 msgr2=0x7f44d80b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:18.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44d77fe640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44d8160110 0x7f44d80b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44d77fe640 1 -- 172.21.15.55:0/1101418582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44d815fd40 msgr2=0x7f44d80b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44d77fe640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44d815fd40 0x7f44d80b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44d77fe640 1 -- 172.21.15.55:0/1101418582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c80094d0 con 0x7f44d806c920 2023-07-06T22:01:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44d7fff640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44d8160110 0x7f44d80b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44d77fe640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d806c920 0x7f44d8156390 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f44c801a0c0 tx=0x7f44c801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44bffff640 1 -- 172.21.15.55:0/1101418582 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80b3800 con 0x7f44d806c920 2023-07-06T22:01:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44bffff640 1 -- 172.21.15.55:0/1101418582 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c80b3960 con 0x7f44d806c920 2023-07-06T22:01:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44bffff640 1 -- 172.21.15.55:0/1101418582 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80b3d10 con 0x7f44d806c920 2023-07-06T22:01:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44dddfa640 1 -- 172.21.15.55:0/1101418582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d806ec50 con 0x7f44d806c920 2023-07-06T22:01:18.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.509+0000 7f44dddfa640 1 -- 172.21.15.55:0/1101418582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d814b970 con 0x7f44d806c920 2023-07-06T22:01:18.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.513+0000 7f44dddfa640 1 -- 172.21.15.55:0/1101418582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d8066d60 con 0x7f44d806c920 2023-07-06T22:01:18.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.513+0000 7f44bffff640 1 -- 172.21.15.55:0/1101418582 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f44c80c73a0 con 0x7f44d806c920 2023-07-06T22:01:18.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.513+0000 7f44bffff640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f44c40663a0 0x7f44c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:18.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.513+0000 7f44bffff640 1 -- 172.21.15.55:0/1101418582 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f44c80a7070 con 0x7f44d806c920 2023-07-06T22:01:18.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.513+0000 7f44d6ffd640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f44c40663a0 0x7f44c4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:18.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.513+0000 7f44d6ffd640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f44c40663a0 0x7f44c4068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f44d80c5e90 tx=0x7f44cc008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:18.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.517+0000 7f44bffff640 1 -- 172.21.15.55:0/1101418582 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44c80ebd60 con 0x7f44d806c920 2023-07-06T22:01:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.701+0000 7f44dddfa640 1 -- 172.21.15.55:0/1101418582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44d80c2820 con 0x7f44d806c920 2023-07-06T22:01:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.701+0000 7f44bffff640 1 -- 172.21.15.55:0/1101418582 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f44c80c3de0 con 0x7f44d806c920 2023-07-06T22:01:18.700 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:18.700 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":56,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/567276052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":567276052},{"type":"v1","addr":"172.21.15.138:6834","nonce":567276052}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2227115466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2227115466},{"type":"v1","addr":"172.21.15.138:6835","nonce":2227115466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2611738616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2611738616},{"type":"v1","addr":"172.21.15.55:6836","nonce":2611738616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":9081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1206771121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1206771121},{"type":"v1","addr":"172.21.15.55:6837","nonce":1206771121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[]} 2023-07-06T22:01:18.700 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 56 2023-07-06T22:01:18.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.705+0000 7f44dddfa640 1 -- 172.21.15.55:0/1101418582 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f44c40663a0 msgr2=0x7f44c4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:18.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.705+0000 7f44dddfa640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f44c40663a0 0x7f44c4068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f44d80c5e90 tx=0x7f44cc008040 comp rx=0 tx=0).stop 2023-07-06T22:01:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.705+0000 7f44dddfa640 1 -- 172.21.15.55:0/1101418582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d806c920 msgr2=0x7f44d8156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.705+0000 7f44dddfa640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d806c920 0x7f44d8156390 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f44c801a0c0 tx=0x7f44c801acd0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.705+0000 7f44dddfa640 1 -- 172.21.15.55:0/1101418582 shutdown_connections 2023-07-06T22:01:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.705+0000 7f44dddfa640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f44c40663a0 0x7f44c4068850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.705+0000 7f44dddfa640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44d8160110 0x7f44d80b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.705+0000 7f44dddfa640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44d815fd40 0x7f44d80b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.705+0000 7f44dddfa640 1 --2- 172.21.15.55:0/1101418582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d806c920 0x7f44d8156390 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.705+0000 7f44dddfa640 1 -- 172.21.15.55:0/1101418582 >> 172.21.15.55:0/1101418582 conn(0x7f44d80b1730 msgr2=0x7f44d8069580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.705+0000 7f44dddfa640 1 -- 172.21.15.55:0/1101418582 shutdown_connections 2023-07-06T22:01:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:18.705+0000 7f44dddfa640 1 -- 172.21.15.55:0/1101418582 wait complete. 2023-07-06T22:01:18.721 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T22:01:18.721 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-06T22:01:18.721 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T22:01:18.721 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:01:18.722 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T22:01:18.722 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-06T22:01:18.722 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T22:01:18.722 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:01:18.722 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T22:01:18.723 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-06T22:01:18.723 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T22:01:18.723 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:01:18.723 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T22:01:18.723 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-06T22:01:18.724 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T22:01:18.724 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:01:18.733 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T22:01:18.734 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T22:01:18.737 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T22:01:18.737 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T22:01:18.738 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T22:01:18.739 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T22:01:18.778 INFO:tasks.ceph.mds.c:Started 2023-07-06T22:01:18.778 DEBUG:teuthology.parallel:result is None 2023-07-06T22:01:18.785 INFO:tasks.ceph.mds.b:Started 2023-07-06T22:01:18.786 DEBUG:teuthology.parallel:result is None 2023-07-06T22:01:18.788 INFO:tasks.ceph.mds.d:Started 2023-07-06T22:01:18.788 DEBUG:teuthology.parallel:result is None 2023-07-06T22:01:18.865 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T22:01:18.878 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-07-06T22:01:18.879 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-07-06T22:01:19.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-07-06T22:01:24.734 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T22:01:24.734 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T22:01:24.738 INFO:tasks.ceph.mds.a:Started 2023-07-06T22:01:24.738 DEBUG:teuthology.parallel:result is None 2023-07-06T22:01:24.739 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-06T22:01:24.835 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-07-06T22:01:24.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.900+0000 7f464920b640 1 Processor -- start 2023-07-06T22:01:24.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.900+0000 7f464920b640 1 -- start start 2023-07-06T22:01:24.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.900+0000 7f464920b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f464406fef0 0x7f4644164820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:24.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.900+0000 7f464920b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46440cc030 con 0x7f46440709a0 2023-07-06T22:01:24.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.900+0000 7f464920b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46440cc300 con 0x7f4644070d70 2023-07-06T22:01:24.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.900+0000 7f464920b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46440cc5e0 con 0x7f464406fef0 2023-07-06T22:01:24.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.900+0000 7f4642d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f46440709a0 0x7f46440cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50018/0 (socket says 172.21.15.55:50018) 2023-07-06T22:01:24.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.900+0000 7f4642d9d640 1 -- 172.21.15.55:0/2499627239 learned_addr learned my addr 172.21.15.55:0/2499627239 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:24.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.900+0000 7f464359e640 1 --2- 172.21.15.55:0/2499627239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f464406fef0 0x7f4644164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:24.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.900+0000 7f464259c640 1 -- 172.21.15.55:0/2499627239 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024158298 0 0) 0x7f46440cc030 con 0x7f46440709a0 2023-07-06T22:01:24.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.900+0000 7f464259c640 1 -- 172.21.15.55:0/2499627239 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4630003530 con 0x7f46440709a0 2023-07-06T22:01:24.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.900+0000 7f464259c640 1 -- 172.21.15.55:0/2499627239 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486876166 0 0) 0x7f46440cc300 con 0x7f4644070d70 2023-07-06T22:01:24.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.904+0000 7f464259c640 1 -- 172.21.15.55:0/2499627239 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46440cc030 con 0x7f4644070d70 2023-07-06T22:01:24.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.904+0000 7f464359e640 1 -- 172.21.15.55:0/2499627239 >> v1:172.21.15.138:6789/0 conn(0x7f4644070d70 legacy=0x7f46440b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:24.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.904+0000 7f464359e640 1 -- 172.21.15.55:0/2499627239 >> v1:172.21.15.55:6789/0 conn(0x7f46440709a0 legacy=0x7f46440cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:24.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.904+0000 7f464359e640 1 -- 172.21.15.55:0/2499627239 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46440cc8c0 con 0x7f464406fef0 2023-07-06T22:01:24.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.904+0000 7f464359e640 1 --2- 172.21.15.55:0/2499627239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f464406fef0 0x7f4644164820 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f463c009dc0 tx=0x7f463c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5471fdd4be15c42 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:24.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.904+0000 7f464259c640 1 -- 172.21.15.55:0/2499627239 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c0a5920 con 0x7f464406fef0 2023-07-06T22:01:24.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.904+0000 7f464259c640 1 -- 172.21.15.55:0/2499627239 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c0a5a80 con 0x7f464406fef0 2023-07-06T22:01:24.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.904+0000 7f464259c640 1 -- 172.21.15.55:0/2499627239 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c0a5df0 con 0x7f464406fef0 2023-07-06T22:01:24.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.904+0000 7f464920b640 1 -- 172.21.15.55:0/2499627239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f464406fef0 msgr2=0x7f4644164820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:24.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.904+0000 7f464920b640 1 --2- 172.21.15.55:0/2499627239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f464406fef0 0x7f4644164820 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f463c009dc0 tx=0x7f463c01c970 comp rx=0 tx=0).stop 2023-07-06T22:01:24.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.904+0000 7f464920b640 1 -- 172.21.15.55:0/2499627239 shutdown_connections 2023-07-06T22:01:24.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.904+0000 7f464920b640 1 --2- 172.21.15.55:0/2499627239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f464406fef0 0x7f4644164820 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:24.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f464920b640 1 -- 172.21.15.55:0/2499627239 >> 172.21.15.55:0/2499627239 conn(0x7f46440cea70 msgr2=0x7f46440ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f464920b640 1 -- 172.21.15.55:0/2499627239 shutdown_connections 2023-07-06T22:01:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f464920b640 1 -- 172.21.15.55:0/2499627239 wait complete. 2023-07-06T22:01:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f464920b640 1 Processor -- start 2023-07-06T22:01:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f464920b640 1 -- start start 2023-07-06T22:01:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f464920b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f464406fef0 0x7f464415eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f464920b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46440709a0 0x7f464415e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f464920b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4644070d70 0x7f464415b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f464920b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464415f400 con 0x7f46440709a0 2023-07-06T22:01:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f464920b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464415f6a0 con 0x7f4644070d70 2023-07-06T22:01:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f464920b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464415f980 con 0x7f464406fef0 2023-07-06T22:01:24.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f463bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46440709a0 0x7f464415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:24.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f463bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46440709a0 0x7f464415e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41604/0 (socket says 172.21.15.55:41604) 2023-07-06T22:01:24.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f463bfff640 1 -- 172.21.15.55:0/3471844510 learned_addr learned my addr 172.21.15.55:0/3471844510 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:24.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f464359e640 1 --2- 172.21.15.55:0/3471844510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4644070d70 0x7f464415b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:24.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f4642d9d640 1 --2- 172.21.15.55:0/3471844510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f464406fef0 0x7f464415eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:24.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f463bfff640 1 -- 172.21.15.55:0/3471844510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f464406fef0 msgr2=0x7f464415eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:24.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f463bfff640 1 --2- 172.21.15.55:0/3471844510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f464406fef0 0x7f464415eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f463bfff640 1 -- 172.21.15.55:0/3471844510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4644070d70 msgr2=0x7f464415b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f463bfff640 1 --2- 172.21.15.55:0/3471844510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4644070d70 0x7f464415b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f463bfff640 1 -- 172.21.15.55:0/3471844510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c009a70 con 0x7f46440709a0 2023-07-06T22:01:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.908+0000 7f463bfff640 1 --2- 172.21.15.55:0/3471844510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46440709a0 0x7f464415e500 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f462c00c430 tx=0x7f462c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.912+0000 7f463b7fe640 1 -- 172.21.15.55:0/3471844510 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c0052d0 con 0x7f46440709a0 2023-07-06T22:01:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.912+0000 7f463b7fe640 1 -- 172.21.15.55:0/3471844510 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c005450 con 0x7f46440709a0 2023-07-06T22:01:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.912+0000 7f464920b640 1 -- 172.21.15.55:0/3471844510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464415fc60 con 0x7f46440709a0 2023-07-06T22:01:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.912+0000 7f463b7fe640 1 -- 172.21.15.55:0/3471844510 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c003840 con 0x7f46440709a0 2023-07-06T22:01:24.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.912+0000 7f464920b640 1 -- 172.21.15.55:0/3471844510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4644160220 con 0x7f46440709a0 2023-07-06T22:01:24.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.912+0000 7f464920b640 1 -- 172.21.15.55:0/3471844510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4644160410 con 0x7f46440709a0 2023-07-06T22:01:24.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.912+0000 7f463b7fe640 1 -- 172.21.15.55:0/3471844510 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f462c0039a0 con 0x7f46440709a0 2023-07-06T22:01:24.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.912+0000 7f463b7fe640 1 --2- 172.21.15.55:0/3471844510 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f46240663a0 0x7f4624068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:24.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.912+0000 7f463b7fe640 1 -- 172.21.15.55:0/3471844510 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f462c083530 con 0x7f46440709a0 2023-07-06T22:01:24.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.912+0000 7f4642d9d640 1 --2- 172.21.15.55:0/3471844510 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f46240663a0 0x7f4624068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:24.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.916+0000 7f4642d9d640 1 --2- 172.21.15.55:0/3471844510 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f46240663a0 0x7f4624068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f46340011f0 tx=0x7f4634007d40 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:24.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:24.916+0000 7f463b7fe640 1 -- 172.21.15.55:0/3471844510 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f462c0507d0 con 0x7f46440709a0 2023-07-06T22:01:25.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:25.088+0000 7f464920b640 1 -- 172.21.15.55:0/3471844510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4644066d60 con 0x7f46440709a0 2023-07-06T22:01:25.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:25.868+0000 7f463b7fe640 1 -- 172.21.15.55:0/3471844510 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v142) v1 ==== 97+0+0 (secure 0 0 0) 0x7f462c053df0 con 0x7f46440709a0 2023-07-06T22:01:25.866 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-07-06T22:01:25.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:25.872+0000 7f464920b640 1 -- 172.21.15.55:0/3471844510 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f46240663a0 msgr2=0x7f4624068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:25.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:25.872+0000 7f464920b640 1 --2- 172.21.15.55:0/3471844510 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f46240663a0 0x7f4624068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f46340011f0 tx=0x7f4634007d40 comp rx=0 tx=0).stop 2023-07-06T22:01:25.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:25.872+0000 7f464920b640 1 -- 172.21.15.55:0/3471844510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46440709a0 msgr2=0x7f464415e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:25.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:25.872+0000 7f464920b640 1 --2- 172.21.15.55:0/3471844510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46440709a0 0x7f464415e500 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f462c00c430 tx=0x7f462c00c8f0 comp rx=0 tx=0).stop 2023-07-06T22:01:25.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:25.872+0000 7f464920b640 1 -- 172.21.15.55:0/3471844510 shutdown_connections 2023-07-06T22:01:25.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:25.872+0000 7f464920b640 1 --2- 172.21.15.55:0/3471844510 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f46240663a0 0x7f4624068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:25.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:25.872+0000 7f464920b640 1 --2- 172.21.15.55:0/3471844510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4644070d70 0x7f464415b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:25.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:25.872+0000 7f464920b640 1 --2- 172.21.15.55:0/3471844510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46440709a0 0x7f464415e500 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:25.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:25.872+0000 7f464920b640 1 --2- 172.21.15.55:0/3471844510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f464406fef0 0x7f464415eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:25.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:25.872+0000 7f464920b640 1 -- 172.21.15.55:0/3471844510 >> 172.21.15.55:0/3471844510 conn(0x7f46440cea70 msgr2=0x7f46440ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:25.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:25.872+0000 7f464920b640 1 -- 172.21.15.55:0/3471844510 shutdown_connections 2023-07-06T22:01:25.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:25.872+0000 7f464920b640 1 -- 172.21.15.55:0/3471844510 wait complete. 2023-07-06T22:01:25.892 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-06T22:01:26.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.040+0000 7fe186618640 1 Processor -- start 2023-07-06T22:01:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.040+0000 7fe186618640 1 -- start start 2023-07-06T22:01:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.044+0000 7fe186618640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1800ca450 0x7fe18006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.044+0000 7fe186618640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe1800b3730 0x7fe18015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.044+0000 7fe186618640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe180159cd0 con 0x7fe1800712f0 2023-07-06T22:01:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.044+0000 7fe186618640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1800693f0 con 0x7fe1800b3730 2023-07-06T22:01:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.044+0000 7fe186618640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18006aca0 con 0x7fe1800ca450 2023-07-06T22:01:26.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.044+0000 7fe184bb5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe1800b3730 0x7fe18015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.044+0000 7fe184bb5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe1800b3730 0x7fe18015d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41606/0 (socket says 172.21.15.55:41606) 2023-07-06T22:01:26.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.044+0000 7fe184bb5640 1 -- 172.21.15.55:0/3334244379 learned_addr learned my addr 172.21.15.55:0/3334244379 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:26.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.044+0000 7fe17f7fe640 1 --2- 172.21.15.55:0/3334244379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1800ca450 0x7fe18006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.044+0000 7fe184bb5640 1 -- 172.21.15.55:0/3334244379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1800ca450 msgr2=0x7fe18006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:26.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.044+0000 7fe184bb5640 1 --2- 172.21.15.55:0/3334244379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1800ca450 0x7fe18006a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.044+0000 7fe184bb5640 1 -- 172.21.15.55:0/3334244379 >> v1:172.21.15.138:6789/0 conn(0x7fe1800712f0 legacy=0x7fe1800c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.044+0000 7fe184bb5640 1 -- 172.21.15.55:0/3334244379 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1800696b0 con 0x7fe1800b3730 2023-07-06T22:01:26.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.048+0000 7fe184bb5640 1 --2- 172.21.15.55:0/3334244379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1800b3730 0x7fe18015d3e0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fe178009e50 tx=0x7fe17801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcded8d4a1627b7f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:26.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.048+0000 7fe17effd640 1 -- 172.21.15.55:0/3334244379 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780a58a0 con 0x7fe1800b3730 2023-07-06T22:01:26.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.048+0000 7fe17effd640 1 -- 172.21.15.55:0/3334244379 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1780a5a00 con 0x7fe1800b3730 2023-07-06T22:01:26.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.048+0000 7fe17effd640 1 -- 172.21.15.55:0/3334244379 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780a5d90 con 0x7fe1800b3730 2023-07-06T22:01:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.048+0000 7fe186618640 1 -- 172.21.15.55:0/3334244379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1800b3730 msgr2=0x7fe18015d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.048+0000 7fe186618640 1 --2- 172.21.15.55:0/3334244379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1800b3730 0x7fe18015d3e0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fe178009e50 tx=0x7fe17801c9e0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.048+0000 7fe186618640 1 -- 172.21.15.55:0/3334244379 shutdown_connections 2023-07-06T22:01:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.048+0000 7fe186618640 1 --2- 172.21.15.55:0/3334244379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1800b3730 0x7fe18015d3e0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.048+0000 7fe186618640 1 --2- 172.21.15.55:0/3334244379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1800ca450 0x7fe18006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.048+0000 7fe186618640 1 -- 172.21.15.55:0/3334244379 >> 172.21.15.55:0/3334244379 conn(0x7fe1800cded0 msgr2=0x7fe1800ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.048+0000 7fe186618640 1 -- 172.21.15.55:0/3334244379 shutdown_connections 2023-07-06T22:01:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.048+0000 7fe186618640 1 -- 172.21.15.55:0/3334244379 wait complete. 2023-07-06T22:01:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.048+0000 7fe186618640 1 Processor -- start 2023-07-06T22:01:26.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.048+0000 7fe186618640 1 -- start start 2023-07-06T22:01:26.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe186618640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1800712f0 0x7fe180153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe186618640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1800b3730 0x7fe18013ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe186618640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1800ca450 0x7fe1800c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe186618640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801531a0 con 0x7fe1800712f0 2023-07-06T22:01:26.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe186618640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18013fad0 con 0x7fe1800ca450 2023-07-06T22:01:26.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe186618640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18013ea30 con 0x7fe1800b3730 2023-07-06T22:01:26.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe17ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1800712f0 0x7fe180153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe17ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1800712f0 0x7fe180153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41620/0 (socket says 172.21.15.55:41620) 2023-07-06T22:01:26.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe17ffff640 1 -- 172.21.15.55:0/3576365944 learned_addr learned my addr 172.21.15.55:0/3576365944 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:26.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe184bb5640 1 --2- 172.21.15.55:0/3576365944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1800ca450 0x7fe1800c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe17f7fe640 1 --2- 172.21.15.55:0/3576365944 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1800b3730 0x7fe18013ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe17ffff640 1 -- 172.21.15.55:0/3576365944 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1800b3730 msgr2=0x7fe18013ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe17ffff640 1 --2- 172.21.15.55:0/3576365944 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1800b3730 0x7fe18013ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe17ffff640 1 -- 172.21.15.55:0/3576365944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1800ca450 msgr2=0x7fe1800c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe17ffff640 1 --2- 172.21.15.55:0/3576365944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1800ca450 0x7fe1800c18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe17ffff640 1 -- 172.21.15.55:0/3576365944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178009b30 con 0x7fe1800712f0 2023-07-06T22:01:26.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe17ffff640 1 --2- 172.21.15.55:0/3576365944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1800712f0 0x7fe180153340 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe17000c3c0 tx=0x7fe17000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:26.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe17cff9640 1 -- 172.21.15.55:0/3576365944 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1700052d0 con 0x7fe1800712f0 2023-07-06T22:01:26.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe17cff9640 1 -- 172.21.15.55:0/3576365944 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe170005430 con 0x7fe1800712f0 2023-07-06T22:01:26.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe186618640 1 -- 172.21.15.55:0/3576365944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18013ed10 con 0x7fe1800712f0 2023-07-06T22:01:26.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe17cff9640 1 -- 172.21.15.55:0/3576365944 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170003840 con 0x7fe1800712f0 2023-07-06T22:01:26.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe186618640 1 -- 172.21.15.55:0/3576365944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18013f2d0 con 0x7fe1800712f0 2023-07-06T22:01:26.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe186618640 1 -- 172.21.15.55:0/3576365944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe180066d60 con 0x7fe1800712f0 2023-07-06T22:01:26.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.052+0000 7fe17cff9640 1 -- 172.21.15.55:0/3576365944 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe1700039a0 con 0x7fe1800712f0 2023-07-06T22:01:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.056+0000 7fe17cff9640 1 --2- 172.21.15.55:0/3576365944 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fe16c0663a0 0x7fe16c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.056+0000 7fe17cff9640 1 -- 172.21.15.55:0/3576365944 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5558+0+0 (secure 0 0 0) 0x7fe170083220 con 0x7fe1800712f0 2023-07-06T22:01:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.056+0000 7fe17f7fe640 1 --2- 172.21.15.55:0/3576365944 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fe16c0663a0 0x7fe16c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.056+0000 7fe17f7fe640 1 --2- 172.21.15.55:0/3576365944 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fe16c0663a0 0x7fe16c068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe1800c4e80 tx=0x7fe174009190 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:26.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.060+0000 7fe17cff9640 1 -- 172.21.15.55:0/3576365944 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe170050700 con 0x7fe1800712f0 2023-07-06T22:01:26.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.264+0000 7fe186618640 1 -- 172.21.15.55:0/3576365944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe18006f840 con 0x7fe1800712f0 2023-07-06T22:01:26.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.264+0000 7fe17cff9640 1 -- 172.21.15.55:0/3576365944 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe170053d20 con 0x7fe1800712f0 2023-07-06T22:01:26.263 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:26.263 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:01:26.263 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-07-06T22:01:26.263 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.264 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-07-06T22:01:26.264 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkWjb1JxAAMmLy+dPO5qyorBnuzazx6A==", 2023-07-06T22:01:26.264 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.264 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:01:26.264 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:01:26.264 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:01:26.264 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.265 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.265 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.265 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.265 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-07-06T22:01:26.265 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkpLLENBAAxMASh3qbELQMJ3XbPEX0Zw==", 2023-07-06T22:01:26.265 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.265 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:01:26.266 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:01:26.266 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:01:26.266 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.266 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.266 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.266 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.266 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-07-06T22:01:26.267 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkvOSfLxAAMEoqAPg1pb47e5a1G1QtAw==", 2023-07-06T22:01:26.267 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.267 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:01:26.267 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:01:26.267 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:01:26.267 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.267 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.268 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.268 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.268 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-07-06T22:01:26.268 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkeQIBARAApXT5zWLUqqMSdwYygZeatw==", 2023-07-06T22:01:26.268 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.268 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:01:26.268 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:01:26.269 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:01:26.269 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.269 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.269 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.269 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.269 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-07-06T22:01:26.269 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD5NKdkSIfzJxAAlXiG8PWFXQqIeugbdp7Eiw==", 2023-07-06T22:01:26.270 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.270 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:01:26.270 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:01:26.270 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.270 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.270 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.270 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.271 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-07-06T22:01:26.271 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD8NKdkv2iwLxAAxjFucMwaaH66wPQpoYSTGw==", 2023-07-06T22:01:26.271 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.271 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:01:26.271 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:01:26.271 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.271 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.271 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.272 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.272 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-07-06T22:01:26.272 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD/NKdk5w7XOBAAuiup4mcC02ZMCPHCU1Cl3A==", 2023-07-06T22:01:26.272 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.272 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:01:26.272 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:01:26.272 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.273 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.273 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.273 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.273 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-07-06T22:01:26.273 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQADNadksvRLBBAAE1YX9VgA8pWARIEZL8tbsQ==", 2023-07-06T22:01:26.273 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.273 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:01:26.274 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:01:26.274 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.274 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.274 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.274 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.274 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-07-06T22:01:26.275 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAJNadkn2HsChAAgwb7B9lHOMq2h0BNuhB/AQ==", 2023-07-06T22:01:26.275 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.275 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:01:26.275 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:01:26.275 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.275 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.275 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.276 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.276 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-07-06T22:01:26.276 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMNadkbonPERAA2PLg4NMr+4eW+FDAfPig1A==", 2023-07-06T22:01:26.276 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.276 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:01:26.276 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:01:26.276 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.277 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.277 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.277 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.277 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-07-06T22:01:26.277 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAPNadkQw76GBAAY9SIgsTUHqvThwjdpjuwpw==", 2023-07-06T22:01:26.277 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.277 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:01:26.278 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:01:26.278 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.278 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.278 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.278 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.278 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-07-06T22:01:26.278 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQASNadkr3gRHxAALbPUtIgImIK1UUoe6vcyjg==", 2023-07-06T22:01:26.279 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.279 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:01:26.279 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:01:26.279 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.279 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.279 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.279 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.280 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-07-06T22:01:26.280 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkaZgiBRAAvyBUd+qHLh/wwhgoE1MsVA==", 2023-07-06T22:01:26.280 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.280 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:01:26.280 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-07-06T22:01:26.280 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-06T22:01:26.281 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.281 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.281 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.281 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-07-06T22:01:26.281 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkOBqoDBAASIhzvCqkSAFLX2oc99MYqw==", 2023-07-06T22:01:26.281 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.281 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:01:26.282 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:01:26.282 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:01:26.282 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:01:26.282 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.282 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.282 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.282 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-07-06T22:01:26.283 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkgt/fCBAAlQY94DrR/nFTIVwSFCEToQ==", 2023-07-06T22:01:26.283 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.283 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:01:26.283 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:01:26.283 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:01:26.283 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:01:26.283 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.284 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.284 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.284 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-07-06T22:01:26.284 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkd5zAEhAAU0Qo6NROIKRSlOncFUoTxQ==", 2023-07-06T22:01:26.284 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.284 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:01:26.284 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:01:26.285 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:01:26.285 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:01:26.285 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.285 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.285 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.285 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-07-06T22:01:26.285 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkjvG8ChAA5rpuV6+YETQS9UjMRUynxA==", 2023-07-06T22:01:26.286 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.286 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:01:26.286 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:01:26.286 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:01:26.286 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.286 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.286 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.286 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.287 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-07-06T22:01:26.287 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdk+RUVIxAAyQpmGAeL8K+Cy+fgK5BmCQ==", 2023-07-06T22:01:26.287 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.287 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:01:26.287 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T22:01:26.287 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.287 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.288 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:26.288 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:26.288 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-07-06T22:01:26.288 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkLH8aHxAAzzX5YxumCYWYqo0rQfFA9g==", 2023-07-06T22:01:26.288 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:01:26.288 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:01:26.289 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T22:01:26.289 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:01:26.289 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.289 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:26.289 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-07-06T22:01:26.289 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:01:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.268+0000 7fe186618640 1 -- 172.21.15.55:0/3576365944 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fe16c0663a0 msgr2=0x7fe16c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.268+0000 7fe186618640 1 --2- 172.21.15.55:0/3576365944 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fe16c0663a0 0x7fe16c068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe1800c4e80 tx=0x7fe174009190 comp rx=0 tx=0).stop 2023-07-06T22:01:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.268+0000 7fe186618640 1 -- 172.21.15.55:0/3576365944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1800712f0 msgr2=0x7fe180153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.268+0000 7fe186618640 1 --2- 172.21.15.55:0/3576365944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1800712f0 0x7fe180153340 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe17000c3c0 tx=0x7fe17000c880 comp rx=0 tx=0).stop 2023-07-06T22:01:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.268+0000 7fe186618640 1 -- 172.21.15.55:0/3576365944 shutdown_connections 2023-07-06T22:01:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.268+0000 7fe186618640 1 --2- 172.21.15.55:0/3576365944 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fe16c0663a0 0x7fe16c068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.268+0000 7fe186618640 1 --2- 172.21.15.55:0/3576365944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1800ca450 0x7fe1800c18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.268+0000 7fe186618640 1 --2- 172.21.15.55:0/3576365944 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1800b3730 0x7fe18013ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.268+0000 7fe186618640 1 --2- 172.21.15.55:0/3576365944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1800712f0 0x7fe180153340 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.268+0000 7fe186618640 1 -- 172.21.15.55:0/3576365944 >> 172.21.15.55:0/3576365944 conn(0x7fe1800cded0 msgr2=0x7fe180159190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.268+0000 7fe186618640 1 -- 172.21.15.55:0/3576365944 shutdown_connections 2023-07-06T22:01:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.268+0000 7fe186618640 1 -- 172.21.15.55:0/3576365944 wait complete. 2023-07-06T22:01:26.293 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:01:26.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.436+0000 7f7dc2b74640 1 Processor -- start 2023-07-06T22:01:26.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.436+0000 7f7dc2b74640 1 -- start start 2023-07-06T22:01:26.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.440+0000 7f7dc2b74640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7dbc0cb4a0 0x7f7dbc15cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.440+0000 7f7dc2b74640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7dbc15f740 0x7f7dbc0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.440+0000 7f7dc2b74640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dbc0b5b50 con 0x7f7dbc0cbc70 2023-07-06T22:01:26.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.440+0000 7f7dc2b74640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dbc15d130 con 0x7f7dbc15f740 2023-07-06T22:01:26.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.440+0000 7f7dc2b74640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dbc0cc8e0 con 0x7f7dbc0cb4a0 2023-07-06T22:01:26.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.440+0000 7f7dbbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7dbc15f740 0x7f7dbc0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.440+0000 7f7dc1111640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7dbc0cbc70 0x7f7dbc0ccdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50026/0 (socket says 172.21.15.55:50026) 2023-07-06T22:01:26.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.440+0000 7f7dc1111640 1 -- 172.21.15.55:0/1521913292 learned_addr learned my addr 172.21.15.55:0/1521913292 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:26.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.440+0000 7f7dc0910640 1 --2- 172.21.15.55:0/1521913292 >> v2:172.21.15.138:3300/0 conn(0x7f7dbc0cb4a0 0x7f7dbc15cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.440+0000 7f7dbbfff640 1 -- 172.21.15.55:0/1521913292 >> v2:172.21.15.138:3300/0 conn(0x7f7dbc0cb4a0 msgr2=0x7f7dbc15cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:26.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.440+0000 7f7dbbfff640 1 --2- 172.21.15.55:0/1521913292 >> v2:172.21.15.138:3300/0 conn(0x7f7dbc0cb4a0 0x7f7dbc15cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.440+0000 7f7dbbfff640 1 -- 172.21.15.55:0/1521913292 >> v1:172.21.15.55:6789/0 conn(0x7f7dbc0cbc70 legacy=0x7f7dbc0ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.440+0000 7f7dbbfff640 1 -- 172.21.15.55:0/1521913292 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc15fc00 con 0x7f7dbc15f740 2023-07-06T22:01:26.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.440+0000 7f7dbb7fe640 1 -- 172.21.15.55:0/1521913292 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171045500 0 0) 0x7f7dbc0b5b50 con 0x7f7dbc0cbc70 2023-07-06T22:01:26.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dbbfff640 1 --2- 172.21.15.55:0/1521913292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dbc15f740 0x7f7dbc0ca720 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0cdb90 tx=0x7f7da801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5b1aed9b1df290 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:26.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dbb7fe640 1 -- 172.21.15.55:0/1521913292 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da8004230 con 0x7f7dbc15f740 2023-07-06T22:01:26.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dbb7fe640 1 -- 172.21.15.55:0/1521913292 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da80a7050 con 0x7f7dbc15f740 2023-07-06T22:01:26.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dbb7fe640 1 -- 172.21.15.55:0/1521913292 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da8003620 con 0x7f7dbc15f740 2023-07-06T22:01:26.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dc2b74640 1 -- 172.21.15.55:0/1521913292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dbc15f740 msgr2=0x7f7dbc0ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dc2b74640 1 --2- 172.21.15.55:0/1521913292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dbc15f740 0x7f7dbc0ca720 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0cdb90 tx=0x7f7da801c460 comp rx=0 tx=0).stop 2023-07-06T22:01:26.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dc2b74640 1 -- 172.21.15.55:0/1521913292 shutdown_connections 2023-07-06T22:01:26.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dc2b74640 1 --2- 172.21.15.55:0/1521913292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dbc15f740 0x7f7dbc0ca720 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dc2b74640 1 --2- 172.21.15.55:0/1521913292 >> v2:172.21.15.138:3300/0 conn(0x7f7dbc0cb4a0 0x7f7dbc15cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dc2b74640 1 -- 172.21.15.55:0/1521913292 >> 172.21.15.55:0/1521913292 conn(0x7f7dbc06ee80 msgr2=0x7f7dbc06f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:26.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dc2b74640 1 -- 172.21.15.55:0/1521913292 shutdown_connections 2023-07-06T22:01:26.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dc2b74640 1 -- 172.21.15.55:0/1521913292 wait complete. 2023-07-06T22:01:26.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dc2b74640 1 Processor -- start 2023-07-06T22:01:26.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dc2b74640 1 -- start start 2023-07-06T22:01:26.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.444+0000 7f7dc2b74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dbc0cb4a0 0x7f7dbc151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc2b74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dbc0cbc70 0x7f7dbc1580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc2b74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dbc15f740 0x7f7dbc1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc2b74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc1521e0 con 0x7f7dbc0cb4a0 2023-07-06T22:01:26.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc2b74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0c8190 con 0x7f7dbc0cbc70 2023-07-06T22:01:26.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc2b74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0c8470 con 0x7f7dbc15f740 2023-07-06T22:01:26.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc0910640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dbc0cb4a0 0x7f7dbc151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc0910640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dbc0cb4a0 0x7f7dbc151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41632/0 (socket says 172.21.15.55:41632) 2023-07-06T22:01:26.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc0910640 1 -- 172.21.15.55:0/2191472391 learned_addr learned my addr 172.21.15.55:0/2191472391 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:26.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dbbfff640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dbc0cbc70 0x7f7dbc1580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc1111640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dbc15f740 0x7f7dbc1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc0910640 1 -- 172.21.15.55:0/2191472391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dbc15f740 msgr2=0x7f7dbc1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc0910640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dbc15f740 0x7f7dbc1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc0910640 1 -- 172.21.15.55:0/2191472391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dbc0cbc70 msgr2=0x7f7dbc1580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc0910640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dbc0cbc70 0x7f7dbc1580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc0910640 1 -- 172.21.15.55:0/2191472391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da8009420 con 0x7f7dbc0cb4a0 2023-07-06T22:01:26.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc1111640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dbc15f740 0x7f7dbc1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:26.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc0910640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dbc0cb4a0 0x7f7dbc151ca0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f7db000d800 tx=0x7f7db000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:26.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7db97fa640 1 -- 172.21.15.55:0/2191472391 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db000b6c0 con 0x7f7dbc0cb4a0 2023-07-06T22:01:26.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7db97fa640 1 -- 172.21.15.55:0/2191472391 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db000b820 con 0x7f7dbc0cb4a0 2023-07-06T22:01:26.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7db97fa640 1 -- 172.21.15.55:0/2191472391 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db000bb90 con 0x7f7dbc0cb4a0 2023-07-06T22:01:26.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc2b74640 1 -- 172.21.15.55:0/2191472391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dbc0c8750 con 0x7f7dbc0cb4a0 2023-07-06T22:01:26.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc2b74640 1 -- 172.21.15.55:0/2191472391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dbc0c8d10 con 0x7f7dbc0cb4a0 2023-07-06T22:01:26.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7dc2b74640 1 -- 172.21.15.55:0/2191472391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dbc066d60 con 0x7f7dbc0cb4a0 2023-07-06T22:01:26.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.448+0000 7f7db97fa640 1 -- 172.21.15.55:0/2191472391 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7db000bcf0 con 0x7f7dbc0cb4a0 2023-07-06T22:01:26.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.452+0000 7f7db97fa640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f7da00663a0 0x7f7da0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.452+0000 7f7db97fa640 1 -- 172.21.15.55:0/2191472391 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f7db00842e0 con 0x7f7dbc0cb4a0 2023-07-06T22:01:26.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.452+0000 7f7dbbfff640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f7da00663a0 0x7f7da0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.452+0000 7f7dbbfff640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f7da00663a0 0x7f7da0068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7da80ad000 tx=0x7f7da80a6000 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:26.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.456+0000 7f7db97fa640 1 -- 172.21.15.55:0/2191472391 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7db0055230 con 0x7f7dbc0cb4a0 2023-07-06T22:01:26.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.612+0000 7f7dc2b74640 1 -- 172.21.15.55:0/2191472391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7dbc06e730 con 0x7f7dbc0cb4a0 2023-07-06T22:01:26.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.612+0000 7f7db97fa640 1 -- 172.21.15.55:0/2191472391 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+14886 (secure 0 0 0) 0x7f7db0054dc0 con 0x7f7dbc0cb4a0 2023-07-06T22:01:26.611 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:26.612 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":142,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:01:25.856431+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:01:26.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.616+0000 7f7dc2b74640 1 -- 172.21.15.55:0/2191472391 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f7da00663a0 msgr2=0x7f7da0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.616+0000 7f7dc2b74640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f7da00663a0 0x7f7da0068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7da80ad000 tx=0x7f7da80a6000 comp rx=0 tx=0).stop 2023-07-06T22:01:26.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.616+0000 7f7dc2b74640 1 -- 172.21.15.55:0/2191472391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dbc0cb4a0 msgr2=0x7f7dbc151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.616+0000 7f7dc2b74640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dbc0cb4a0 0x7f7dbc151ca0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f7db000d800 tx=0x7f7db000dcc0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.616+0000 7f7dc2b74640 1 -- 172.21.15.55:0/2191472391 shutdown_connections 2023-07-06T22:01:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.616+0000 7f7dc2b74640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f7da00663a0 0x7f7da0068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.616+0000 7f7dc2b74640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7dbc15f740 0x7f7dbc1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.616+0000 7f7dc2b74640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7dbc0cbc70 0x7f7dbc1580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.616+0000 7f7dc2b74640 1 --2- 172.21.15.55:0/2191472391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dbc0cb4a0 0x7f7dbc151ca0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.616+0000 7f7dc2b74640 1 -- 172.21.15.55:0/2191472391 >> 172.21.15.55:0/2191472391 conn(0x7f7dbc06ee80 msgr2=0x7f7dbc15b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.616+0000 7f7dc2b74640 1 -- 172.21.15.55:0/2191472391 shutdown_connections 2023-07-06T22:01:26.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.616+0000 7f7dc2b74640 1 -- 172.21.15.55:0/2191472391 wait complete. 2023-07-06T22:01:26.632 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:01:26.633 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:01:26.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-07-06T22:01:26.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.780+0000 7f0176af9640 1 Processor -- start 2023-07-06T22:01:26.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.780+0000 7f0176af9640 1 -- start start 2023-07-06T22:01:26.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.784+0000 7f0176af9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0170158850 0x7f01700cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.784+0000 7f0176af9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0170158c20 con 0x7f01700ca130 2023-07-06T22:01:26.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.784+0000 7f0176af9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01700c8db0 con 0x7f0170070af0 2023-07-06T22:01:26.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.784+0000 7f0176af9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01700c9090 con 0x7f0170158850 2023-07-06T22:01:26.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.784+0000 7f016ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f01700ca130 0x7f01700703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50042/0 (socket says 172.21.15.55:50042) 2023-07-06T22:01:26.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.784+0000 7f016ffff640 1 -- 172.21.15.55:0/2551489455 learned_addr learned my addr 172.21.15.55:0/2551489455 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:26.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.784+0000 7f0174895640 1 --2- 172.21.15.55:0/2551489455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0170158850 0x7f01700cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.784+0000 7f016f7fe640 1 -- 172.21.15.55:0/2551489455 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537414109 0 0) 0x7f0170158c20 con 0x7f01700ca130 2023-07-06T22:01:26.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.784+0000 7f016f7fe640 1 -- 172.21.15.55:0/2551489455 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0160003530 con 0x7f01700ca130 2023-07-06T22:01:26.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.784+0000 7f0174895640 1 -- 172.21.15.55:0/2551489455 >> v1:172.21.15.138:6789/0 conn(0x7f0170070af0 legacy=0x7f01700b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.784+0000 7f0174895640 1 -- 172.21.15.55:0/2551489455 >> v1:172.21.15.55:6789/0 conn(0x7f01700ca130 legacy=0x7f01700703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.784+0000 7f0174895640 1 -- 172.21.15.55:0/2551489455 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01700c9370 con 0x7f0170158850 2023-07-06T22:01:26.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.788+0000 7f0174895640 1 --2- 172.21.15.55:0/2551489455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0170158850 0x7f01700cca30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f01640097f0 tx=0x7f016401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8ba5015bcd93309 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:26.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.788+0000 7f016f7fe640 1 -- 172.21.15.55:0/2551489455 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640a89b0 con 0x7f0170158850 2023-07-06T22:01:26.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.788+0000 7f016f7fe640 1 -- 172.21.15.55:0/2551489455 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01640a8b10 con 0x7f0170158850 2023-07-06T22:01:26.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.788+0000 7f016f7fe640 1 -- 172.21.15.55:0/2551489455 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640a8ea0 con 0x7f0170158850 2023-07-06T22:01:26.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.788+0000 7f0176af9640 1 -- 172.21.15.55:0/2551489455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0170158850 msgr2=0x7f01700cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.788+0000 7f0176af9640 1 --2- 172.21.15.55:0/2551489455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0170158850 0x7f01700cca30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f01640097f0 tx=0x7f016401ecb0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.788+0000 7f0176af9640 1 -- 172.21.15.55:0/2551489455 shutdown_connections 2023-07-06T22:01:26.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.788+0000 7f0176af9640 1 --2- 172.21.15.55:0/2551489455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0170158850 0x7f01700cca30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.788+0000 7f0176af9640 1 -- 172.21.15.55:0/2551489455 >> 172.21.15.55:0/2551489455 conn(0x7f01700cea70 msgr2=0x7f01700ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:26.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.788+0000 7f0176af9640 1 -- 172.21.15.55:0/2551489455 shutdown_connections 2023-07-06T22:01:26.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.788+0000 7f0176af9640 1 -- 172.21.15.55:0/2551489455 wait complete. 2023-07-06T22:01:26.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.788+0000 7f0176af9640 1 Processor -- start 2023-07-06T22:01:26.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.788+0000 7f0176af9640 1 -- start start 2023-07-06T22:01:26.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0176af9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0170070af0 0x7f017014f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0176af9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01700ca130 0x7f017014c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0176af9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0170158850 0x7f01701ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0176af9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017006ab60 con 0x7f0170070af0 2023-07-06T22:01:26.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0176af9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017014d520 con 0x7f01700ca130 2023-07-06T22:01:26.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0176af9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017014d800 con 0x7f0170158850 2023-07-06T22:01:26.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0174895640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0170070af0 0x7f017014f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0174895640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0170070af0 0x7f017014f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41646/0 (socket says 172.21.15.55:41646) 2023-07-06T22:01:26.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0174895640 1 -- 172.21.15.55:0/786390572 learned_addr learned my addr 172.21.15.55:0/786390572 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:26.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0175096640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0170158850 0x7f01701ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f016ffff640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01700ca130 0x7f017014c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0174895640 1 -- 172.21.15.55:0/786390572 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0170158850 msgr2=0x7f01701ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0174895640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0170158850 0x7f01701ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0174895640 1 -- 172.21.15.55:0/786390572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01700ca130 msgr2=0x7f017014c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0174895640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01700ca130 0x7f017014c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0174895640 1 -- 172.21.15.55:0/786390572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0164009420 con 0x7f0170070af0 2023-07-06T22:01:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f016ffff640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01700ca130 0x7f017014c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0174895640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0170070af0 0x7f017014f0f0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f016401b8c0 tx=0x7f016401ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:26.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f016d7fa640 1 -- 172.21.15.55:0/786390572 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640bb640 con 0x7f0170070af0 2023-07-06T22:01:26.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f016d7fa640 1 -- 172.21.15.55:0/786390572 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01640bb7c0 con 0x7f0170070af0 2023-07-06T22:01:26.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f016d7fa640 1 -- 172.21.15.55:0/786390572 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640bbb70 con 0x7f0170070af0 2023-07-06T22:01:26.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0176af9640 1 -- 172.21.15.55:0/786390572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017006a4a0 con 0x7f0170070af0 2023-07-06T22:01:26.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0176af9640 1 -- 172.21.15.55:0/786390572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017014f630 con 0x7f0170070af0 2023-07-06T22:01:26.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f0176af9640 1 -- 172.21.15.55:0/786390572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017014f820 con 0x7f0170070af0 2023-07-06T22:01:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.792+0000 7f016d7fa640 1 -- 172.21.15.55:0/786390572 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f01640b7040 con 0x7f0170070af0 2023-07-06T22:01:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.796+0000 7f016d7fa640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f01540663a0 0x7f0154068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.796+0000 7f016d7fa640 1 -- 172.21.15.55:0/786390572 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f0164121f40 con 0x7f0170070af0 2023-07-06T22:01:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.796+0000 7f016ffff640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f01540663a0 0x7f0154068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:26.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.796+0000 7f016ffff640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f01540663a0 0x7f0154068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f01700ad1d0 tx=0x7f015c009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:26.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.800+0000 7f016d7fa640 1 -- 172.21.15.55:0/786390572 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f017014f820 con 0x7f0170070af0 2023-07-06T22:01:26.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.952+0000 7f0176af9640 1 -- 172.21.15.55:0/786390572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f017014f820 con 0x7f0170070af0 2023-07-06T22:01:26.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.952+0000 7f016d7fa640 1 -- 172.21.15.55:0/786390572 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v142) v1 ==== 93+0+10 (secure 0 0 0) 0x7f017014f820 con 0x7f0170070af0 2023-07-06T22:01:26.952 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:01:26.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.956+0000 7f0176af9640 1 -- 172.21.15.55:0/786390572 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f01540663a0 msgr2=0x7f0154068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.956+0000 7f0176af9640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f01540663a0 0x7f0154068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f01700ad1d0 tx=0x7f015c009040 comp rx=0 tx=0).stop 2023-07-06T22:01:26.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.956+0000 7f0176af9640 1 -- 172.21.15.55:0/786390572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0170070af0 msgr2=0x7f017014f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:26.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.956+0000 7f0176af9640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0170070af0 0x7f017014f0f0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f016401b8c0 tx=0x7f016401ba50 comp rx=0 tx=0).stop 2023-07-06T22:01:26.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.956+0000 7f0176af9640 1 -- 172.21.15.55:0/786390572 shutdown_connections 2023-07-06T22:01:26.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.956+0000 7f0176af9640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f01540663a0 0x7f0154068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.956+0000 7f0176af9640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0170158850 0x7f01701ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.956+0000 7f0176af9640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01700ca130 0x7f017014c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.956+0000 7f0176af9640 1 --2- 172.21.15.55:0/786390572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0170070af0 0x7f017014f0f0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:26.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.956+0000 7f0176af9640 1 -- 172.21.15.55:0/786390572 >> 172.21.15.55:0/786390572 conn(0x7f01700cea70 msgr2=0x7f01700b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:26.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.956+0000 7f0176af9640 1 -- 172.21.15.55:0/786390572 shutdown_connections 2023-07-06T22:01:26.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:26.956+0000 7f0176af9640 1 -- 172.21.15.55:0/786390572 wait complete. 2023-07-06T22:01:26.973 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:01:27.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.120+0000 7f692af11640 1 Processor -- start 2023-07-06T22:01:27.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.120+0000 7f692af11640 1 -- start start 2023-07-06T22:01:27.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f692af11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6924158850 0x7f69240cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f692af11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69240ca130 0x7f69240ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f692af11640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f69240703e0 0x7f6924070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f692af11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6924070dc0 con 0x7f6924158850 2023-07-06T22:01:27.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f692af11640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6924158c20 con 0x7f69240703e0 2023-07-06T22:01:27.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f692af11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69240c8db0 con 0x7f69240ca130 2023-07-06T22:01:27.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f6928cad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6924158850 0x7f69240cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f6928cad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6924158850 0x7f69240cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41660/0 (socket says 172.21.15.55:41660) 2023-07-06T22:01:27.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f6928cad640 1 -- 172.21.15.55:0/2131545579 learned_addr learned my addr 172.21.15.55:0/2131545579 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:27.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f6928cad640 1 -- 172.21.15.55:0/2131545579 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69240ca130 msgr2=0x7f69240ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:27.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f6928cad640 1 --2- 172.21.15.55:0/2131545579 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69240ca130 0x7f69240ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f6928cad640 1 -- 172.21.15.55:0/2131545579 >> v2:172.21.15.138:3300/0 conn(0x7f69240703e0 msgr2=0x7f6924070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:27.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f6928cad640 1 --2- 172.21.15.55:0/2131545579 >> v2:172.21.15.138:3300/0 conn(0x7f69240703e0 0x7f6924070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f6928cad640 1 -- 172.21.15.55:0/2131545579 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240c9090 con 0x7f6924158850 2023-07-06T22:01:27.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.124+0000 7f6928cad640 1 --2- 172.21.15.55:0/2131545579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6924158850 0x7f69240cca30 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f69240b0d60 tx=0x7f691801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d303c8d56ee0b727 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:27.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f69237fe640 1 -- 172.21.15.55:0/2131545579 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69180a89b0 con 0x7f6924158850 2023-07-06T22:01:27.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f69237fe640 1 -- 172.21.15.55:0/2131545579 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69180a8b10 con 0x7f6924158850 2023-07-06T22:01:27.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f69237fe640 1 -- 172.21.15.55:0/2131545579 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69180a8ea0 con 0x7f6924158850 2023-07-06T22:01:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f692af11640 1 -- 172.21.15.55:0/2131545579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6924158850 msgr2=0x7f69240cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f692af11640 1 --2- 172.21.15.55:0/2131545579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6924158850 0x7f69240cca30 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f69240b0d60 tx=0x7f691801ecf0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f692af11640 1 -- 172.21.15.55:0/2131545579 shutdown_connections 2023-07-06T22:01:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f692af11640 1 --2- 172.21.15.55:0/2131545579 >> v2:172.21.15.138:3300/0 conn(0x7f69240703e0 0x7f6924070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f692af11640 1 --2- 172.21.15.55:0/2131545579 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69240ca130 0x7f69240ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f692af11640 1 --2- 172.21.15.55:0/2131545579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6924158850 0x7f69240cca30 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f692af11640 1 -- 172.21.15.55:0/2131545579 >> 172.21.15.55:0/2131545579 conn(0x7f69240cea70 msgr2=0x7f69240ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:27.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f692af11640 1 -- 172.21.15.55:0/2131545579 shutdown_connections 2023-07-06T22:01:27.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f692af11640 1 -- 172.21.15.55:0/2131545579 wait complete. 2023-07-06T22:01:27.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f692af11640 1 Processor -- start 2023-07-06T22:01:27.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f692af11640 1 -- start start 2023-07-06T22:01:27.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.128+0000 7f692af11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69240703e0 0x7f69240b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f692af11640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69240ca130 0x7f69241f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f692af11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6924158850 0x7f692406b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f692af11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240b3af0 con 0x7f69240703e0 2023-07-06T22:01:27.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f692af11640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240b2c10 con 0x7f69240ca130 2023-07-06T22:01:27.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f692af11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69240b2240 con 0x7f6924158850 2023-07-06T22:01:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f6928cad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69240703e0 0x7f69240b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f6928cad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69240703e0 0x7f69240b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41672/0 (socket says 172.21.15.55:41672) 2023-07-06T22:01:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f6928cad640 1 -- 172.21.15.55:0/3660292239 learned_addr learned my addr 172.21.15.55:0/3660292239 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f6928cad640 1 -- 172.21.15.55:0/3660292239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6924158850 msgr2=0x7f692406b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f6928cad640 1 --2- 172.21.15.55:0/3660292239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6924158850 0x7f692406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f6928cad640 1 -- 172.21.15.55:0/3660292239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69240ca130 msgr2=0x7f69241f5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f6928cad640 1 --2- 172.21.15.55:0/3660292239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69240ca130 0x7f69241f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f6928cad640 1 -- 172.21.15.55:0/3660292239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69180094d0 con 0x7f69240703e0 2023-07-06T22:01:27.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f6928cad640 1 --2- 172.21.15.55:0/3660292239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69240703e0 0x7f69240b26d0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f69180b3040 tx=0x7f691801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:27.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f69217fa640 1 -- 172.21.15.55:0/3660292239 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69180b0e00 con 0x7f69240703e0 2023-07-06T22:01:27.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f69217fa640 1 -- 172.21.15.55:0/3660292239 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69180b9440 con 0x7f69240703e0 2023-07-06T22:01:27.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f69217fa640 1 -- 172.21.15.55:0/3660292239 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69180b97f0 con 0x7f69240703e0 2023-07-06T22:01:27.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f692af11640 1 -- 172.21.15.55:0/3660292239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69241f59a0 con 0x7f69240703e0 2023-07-06T22:01:27.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f692af11640 1 -- 172.21.15.55:0/3660292239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69240b1bf0 con 0x7f69240703e0 2023-07-06T22:01:27.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f692af11640 1 -- 172.21.15.55:0/3660292239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69240b1a50 con 0x7f69240703e0 2023-07-06T22:01:27.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.132+0000 7f69217fa640 1 -- 172.21.15.55:0/3660292239 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f69180b7070 con 0x7f69240703e0 2023-07-06T22:01:27.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.136+0000 7f69217fa640 1 --2- 172.21.15.55:0/3660292239 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69080663a0 0x7f6908068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.136+0000 7f69217fa640 1 -- 172.21.15.55:0/3660292239 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f6918121910 con 0x7f69240703e0 2023-07-06T22:01:27.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.136+0000 7f6923fff640 1 --2- 172.21.15.55:0/3660292239 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69080663a0 0x7f6908068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.136+0000 7f6923fff640 1 --2- 172.21.15.55:0/3660292239 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69080663a0 0x7f6908068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69240af990 tx=0x7f6910006ca0 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:27.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.140+0000 7f69217fa640 1 -- 172.21.15.55:0/3660292239 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69240b1a50 con 0x7f69240703e0 2023-07-06T22:01:27.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.292+0000 7f692af11640 1 -- 172.21.15.55:0/3660292239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f69240b1a50 con 0x7f69240703e0 2023-07-06T22:01:27.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.296+0000 7f69217fa640 1 -- 172.21.15.55:0/3660292239 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v142) v1 ==== 92+0+10 (secure 0 0 0) 0x7f69240b1a50 con 0x7f69240703e0 2023-07-06T22:01:27.292 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:01:27.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.296+0000 7f692af11640 1 -- 172.21.15.55:0/3660292239 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69080663a0 msgr2=0x7f6908068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.296+0000 7f692af11640 1 --2- 172.21.15.55:0/3660292239 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69080663a0 0x7f6908068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69240af990 tx=0x7f6910006ca0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.296+0000 7f692af11640 1 -- 172.21.15.55:0/3660292239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69240703e0 msgr2=0x7f69240b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.296+0000 7f692af11640 1 --2- 172.21.15.55:0/3660292239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69240703e0 0x7f69240b26d0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f69180b3040 tx=0x7f691801ba90 comp rx=0 tx=0).stop 2023-07-06T22:01:27.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.296+0000 7f692af11640 1 -- 172.21.15.55:0/3660292239 shutdown_connections 2023-07-06T22:01:27.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.296+0000 7f692af11640 1 --2- 172.21.15.55:0/3660292239 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69080663a0 0x7f6908068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.296+0000 7f692af11640 1 --2- 172.21.15.55:0/3660292239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6924158850 0x7f692406b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.296+0000 7f692af11640 1 --2- 172.21.15.55:0/3660292239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69240ca130 0x7f69241f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.296+0000 7f692af11640 1 --2- 172.21.15.55:0/3660292239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69240703e0 0x7f69240b26d0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.296+0000 7f692af11640 1 -- 172.21.15.55:0/3660292239 >> 172.21.15.55:0/3660292239 conn(0x7f69240cea70 msgr2=0x7f69240cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:27.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.296+0000 7f692af11640 1 -- 172.21.15.55:0/3660292239 shutdown_connections 2023-07-06T22:01:27.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.296+0000 7f692af11640 1 -- 172.21.15.55:0/3660292239 wait complete. 2023-07-06T22:01:27.313 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T22:01:27.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.456+0000 7f89aa496640 1 Processor -- start 2023-07-06T22:01:27.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89aa496640 1 -- start start 2023-07-06T22:01:27.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89aa496640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89a40b3730 0x7f89a406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89aa496640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a4159cd0 con 0x7f89a40ca450 2023-07-06T22:01:27.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89aa496640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a40693f0 con 0x7f89a40712f0 2023-07-06T22:01:27.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89aa496640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a406aca0 con 0x7f89a40b3730 2023-07-06T22:01:27.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f89a40ca450 0x7f89a415d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50046/0 (socket says 172.21.15.55:50046) 2023-07-06T22:01:27.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a37fe640 1 -- 172.21.15.55:0/1003158800 learned_addr learned my addr 172.21.15.55:0/1003158800 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:27.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a8a33640 1 --2- 172.21.15.55:0/1003158800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89a40b3730 0x7f89a406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 -- 172.21.15.55:0/1003158800 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833471761 0 0) 0x7f89a4159cd0 con 0x7f89a40ca450 2023-07-06T22:01:27.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 -- 172.21.15.55:0/1003158800 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f898c003530 con 0x7f89a40ca450 2023-07-06T22:01:27.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 -- 172.21.15.55:0/1003158800 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 71620691 0 0) 0x7f898c003530 con 0x7f89a40ca450 2023-07-06T22:01:27.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 -- 172.21.15.55:0/1003158800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89a40b3730 msgr2=0x7f89a406a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:27.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 --2- 172.21.15.55:0/1003158800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89a40b3730 0x7f89a406a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 -- 172.21.15.55:0/1003158800 >> v1:172.21.15.138:6789/0 conn(0x7f89a40712f0 legacy=0x7f89a40c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 -- 172.21.15.55:0/1003158800 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a40696b0 con 0x7f89a40ca450 2023-07-06T22:01:27.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 -- 172.21.15.55:0/1003158800 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f8998001680 con 0x7f89a40ca450 2023-07-06T22:01:27.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 -- 172.21.15.55:0/1003158800 >> v1:172.21.15.55:6789/0 conn(0x7f89a40ca450 legacy=0x7f89a415d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 --2- 172.21.15.55:0/1003158800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898c0039b0 0x7f898c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 --2- 172.21.15.55:0/1003158800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89a40b3730 0x7f898c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 --2- 172.21.15.55:0/1003158800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f898c004d10 0x7f898c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 -- 172.21.15.55:0/1003158800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a406aca0 con 0x7f898c0039b0 2023-07-06T22:01:27.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 -- 172.21.15.55:0/1003158800 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c00b990 con 0x7f898c004d10 2023-07-06T22:01:27.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a2ffd640 1 -- 172.21.15.55:0/1003158800 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c00bb20 con 0x7f89a40b3730 2023-07-06T22:01:27.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a3fff640 1 --2- 172.21.15.55:0/1003158800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898c0039b0 0x7f898c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a37fe640 1 --2- 172.21.15.55:0/1003158800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89a40b3730 0x7f898c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a8a33640 1 --2- 172.21.15.55:0/1003158800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f898c004d10 0x7f898c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a3fff640 1 -- 172.21.15.55:0/1003158800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89a40b3730 msgr2=0x7f898c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:27.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a3fff640 1 --2- 172.21.15.55:0/1003158800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89a40b3730 0x7f898c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a3fff640 1 -- 172.21.15.55:0/1003158800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f898c004d10 msgr2=0x7f898c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:27.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a3fff640 1 --2- 172.21.15.55:0/1003158800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f898c004d10 0x7f898c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.460+0000 7f89a3fff640 1 -- 172.21.15.55:0/1003158800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c003530 con 0x7f898c0039b0 2023-07-06T22:01:27.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.464+0000 7f89a3fff640 1 --2- 172.21.15.55:0/1003158800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898c0039b0 0x7f898c003d80 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f8994001860 tx=0x7f899401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ef1ce560eb420e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:27.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.464+0000 7f89a2ffd640 1 -- 172.21.15.55:0/1003158800 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940ab400 con 0x7f898c0039b0 2023-07-06T22:01:27.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.464+0000 7f89a2ffd640 1 -- 172.21.15.55:0/1003158800 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89940a7050 con 0x7f898c0039b0 2023-07-06T22:01:27.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.464+0000 7f89a2ffd640 1 -- 172.21.15.55:0/1003158800 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940ab7a0 con 0x7f898c0039b0 2023-07-06T22:01:27.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.464+0000 7f89aa496640 1 -- 172.21.15.55:0/1003158800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898c0039b0 msgr2=0x7f898c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.464+0000 7f89aa496640 1 --2- 172.21.15.55:0/1003158800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898c0039b0 0x7f898c003d80 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f8994001860 tx=0x7f899401c4d0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.464+0000 7f89a8a33640 1 -- 172.21.15.55:0/1003158800 reap_dead start 2023-07-06T22:01:27.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.464+0000 7f89aa496640 1 -- 172.21.15.55:0/1003158800 shutdown_connections 2023-07-06T22:01:27.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.464+0000 7f89aa496640 1 -- 172.21.15.55:0/1003158800 >> 172.21.15.55:0/1003158800 conn(0x7f89a40cded0 msgr2=0x7f89a40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:27.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.464+0000 7f89aa496640 1 -- 172.21.15.55:0/1003158800 shutdown_connections 2023-07-06T22:01:27.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.464+0000 7f89aa496640 1 -- 172.21.15.55:0/1003158800 wait complete. 2023-07-06T22:01:27.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89aa496640 1 Processor -- start 2023-07-06T22:01:27.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89aa496640 1 -- start start 2023-07-06T22:01:27.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89aa496640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f898c0039b0 0x7f89a40b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89aa496640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89a41f01c0 0x7f89a40c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89aa496640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89a41f0630 0x7f89a40c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89aa496640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a41f1160 con 0x7f89a41f01c0 2023-07-06T22:01:27.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89aa496640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a41f1820 con 0x7f898c0039b0 2023-07-06T22:01:27.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89aa496640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40c5e00 con 0x7f89a41f0630 2023-07-06T22:01:27.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89a37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89a41f01c0 0x7f89a40c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89a37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89a41f01c0 0x7f89a40c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41690/0 (socket says 172.21.15.55:41690) 2023-07-06T22:01:27.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89a37fe640 1 -- 172.21.15.55:0/3240029462 learned_addr learned my addr 172.21.15.55:0/3240029462 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:27.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89a37fe640 1 -- 172.21.15.55:0/3240029462 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89a41f0630 msgr2=0x7f89a40c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89a37fe640 1 --2- 172.21.15.55:0/3240029462 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89a41f0630 0x7f89a40c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89a37fe640 1 -- 172.21.15.55:0/3240029462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f898c0039b0 msgr2=0x7f89a40b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89a37fe640 1 --2- 172.21.15.55:0/3240029462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f898c0039b0 0x7f89a40b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89a37fe640 1 -- 172.21.15.55:0/3240029462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a41f0ba0 con 0x7f89a41f01c0 2023-07-06T22:01:27.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89a37fe640 1 --2- 172.21.15.55:0/3240029462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89a41f01c0 0x7f89a40c5380 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f89980072c0 tx=0x7f8998007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:27.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89a0ff9640 1 -- 172.21.15.55:0/3240029462 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899800f940 con 0x7f89a41f01c0 2023-07-06T22:01:27.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89a0ff9640 1 -- 172.21.15.55:0/3240029462 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899800fac0 con 0x7f89a41f01c0 2023-07-06T22:01:27.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89aa496640 1 -- 172.21.15.55:0/3240029462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a41f0e80 con 0x7f89a41f01c0 2023-07-06T22:01:27.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89a0ff9640 1 -- 172.21.15.55:0/3240029462 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899800fe70 con 0x7f89a41f01c0 2023-07-06T22:01:27.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.468+0000 7f89aa496640 1 -- 172.21.15.55:0/3240029462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a40b3230 con 0x7f89a41f01c0 2023-07-06T22:01:27.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.472+0000 7f89aa496640 1 -- 172.21.15.55:0/3240029462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a40b3df0 con 0x7f89a41f01c0 2023-07-06T22:01:27.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.472+0000 7f89a0ff9640 1 -- 172.21.15.55:0/3240029462 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f899801e3b0 con 0x7f89a41f01c0 2023-07-06T22:01:27.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.472+0000 7f89a0ff9640 1 --2- 172.21.15.55:0/3240029462 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f89900663d0 0x7f8990068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.472+0000 7f89a0ff9640 1 -- 172.21.15.55:0/3240029462 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f89980837c0 con 0x7f89a41f01c0 2023-07-06T22:01:27.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.472+0000 7f89a3fff640 1 --2- 172.21.15.55:0/3240029462 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f89900663d0 0x7f8990068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.472+0000 7f89a3fff640 1 --2- 172.21.15.55:0/3240029462 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f89900663d0 0x7f8990068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f89940ad000 tx=0x7f8994001240 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:27.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.476+0000 7f89a0ff9640 1 -- 172.21.15.55:0/3240029462 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8998050d10 con 0x7f89a41f01c0 2023-07-06T22:01:27.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.632+0000 7f89aa496640 1 -- 172.21.15.55:0/3240029462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f89a4070980 con 0x7f89a41f01c0 2023-07-06T22:01:27.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.632+0000 7f89a0ff9640 1 -- 172.21.15.55:0/3240029462 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v142) v1 ==== 84+0+126 (secure 0 0 0) 0x7f899801a090 con 0x7f89a41f01c0 2023-07-06T22:01:27.631 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:27.631 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T22:01:27.631 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:27.631 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-07-06T22:01:27.632 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-07-06T22:01:27.632 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:01:27.632 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:27.632 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-07-06T22:01:27.632 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-07-06T22:01:27.632 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:27.632 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T22:01:27.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.636+0000 7f89aa496640 1 -- 172.21.15.55:0/3240029462 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f89900663d0 msgr2=0x7f8990068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.636+0000 7f89aa496640 1 --2- 172.21.15.55:0/3240029462 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f89900663d0 0x7f8990068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f89940ad000 tx=0x7f8994001240 comp rx=0 tx=0).stop 2023-07-06T22:01:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.636+0000 7f89aa496640 1 -- 172.21.15.55:0/3240029462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89a41f01c0 msgr2=0x7f89a40c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.636+0000 7f89aa496640 1 --2- 172.21.15.55:0/3240029462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89a41f01c0 0x7f89a40c5380 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f89980072c0 tx=0x7f8998007780 comp rx=0 tx=0).stop 2023-07-06T22:01:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.636+0000 7f89aa496640 1 -- 172.21.15.55:0/3240029462 shutdown_connections 2023-07-06T22:01:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.636+0000 7f89aa496640 1 --2- 172.21.15.55:0/3240029462 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f89900663d0 0x7f8990068880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.636+0000 7f89aa496640 1 --2- 172.21.15.55:0/3240029462 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89a41f0630 0x7f89a40c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.636+0000 7f89aa496640 1 --2- 172.21.15.55:0/3240029462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89a41f01c0 0x7f89a40c5380 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.636+0000 7f89aa496640 1 --2- 172.21.15.55:0/3240029462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f898c0039b0 0x7f89a40b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.636+0000 7f89aa496640 1 -- 172.21.15.55:0/3240029462 >> 172.21.15.55:0/3240029462 conn(0x7f89a40cded0 msgr2=0x7f89a41592a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.636+0000 7f89aa496640 1 -- 172.21.15.55:0/3240029462 shutdown_connections 2023-07-06T22:01:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.636+0000 7f89aa496640 1 -- 172.21.15.55:0/3240029462 wait complete. 2023-07-06T22:01:27.651 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T22:01:27.652 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T22:01:27.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.800+0000 7f931a582640 1 Processor -- start 2023-07-06T22:01:27.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.800+0000 7f931a582640 1 -- start start 2023-07-06T22:01:27.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f931a582640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93140cbfa0 0x7f931406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f931a582640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f93140c89b0 0x7f93140c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f931a582640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9314158b50 con 0x7f9314158780 2023-07-06T22:01:27.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f931a582640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93140c9370 con 0x7f93140c89b0 2023-07-06T22:01:27.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f931a582640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931406b390 con 0x7f93140cbfa0 2023-07-06T22:01:27.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9313fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9314158780 0x7f93140cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50048/0 (socket says 172.21.15.55:50048) 2023-07-06T22:01:27.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9313fff640 1 -- 172.21.15.55:0/3891051904 learned_addr learned my addr 172.21.15.55:0/3891051904 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:27.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9318b1f640 1 --2- 172.21.15.55:0/3891051904 >> v2:172.21.15.138:3300/0 conn(0x7f93140c89b0 0x7f93140c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f93137fe640 1 --2- 172.21.15.55:0/3891051904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93140cbfa0 0x7f931406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 -- 172.21.15.55:0/3891051904 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340630147 0 0) 0x7f9314158b50 con 0x7f9314158780 2023-07-06T22:01:27.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 -- 172.21.15.55:0/3891051904 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92fc003530 con 0x7f9314158780 2023-07-06T22:01:27.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 -- 172.21.15.55:0/3891051904 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1273161136 0 0) 0x7f92fc003530 con 0x7f9314158780 2023-07-06T22:01:27.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 -- 172.21.15.55:0/3891051904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93140cbfa0 msgr2=0x7f931406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:27.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 --2- 172.21.15.55:0/3891051904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93140cbfa0 0x7f931406f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 -- 172.21.15.55:0/3891051904 >> v2:172.21.15.138:3300/0 conn(0x7f93140c89b0 msgr2=0x7f93140c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:27.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 --2- 172.21.15.55:0/3891051904 >> v2:172.21.15.138:3300/0 conn(0x7f93140c89b0 0x7f93140c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 -- 172.21.15.55:0/3891051904 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931406b630 con 0x7f9314158780 2023-07-06T22:01:27.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 -- 172.21.15.55:0/3891051904 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f9304001680 con 0x7f9314158780 2023-07-06T22:01:27.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 -- 172.21.15.55:0/3891051904 >> v1:172.21.15.55:6789/0 conn(0x7f9314158780 legacy=0x7f93140cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 --2- 172.21.15.55:0/3891051904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92fc003980 0x7f92fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 --2- 172.21.15.55:0/3891051904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93140cbfa0 0x7f92fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 --2- 172.21.15.55:0/3891051904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92fc004d10 0x7f92fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 -- 172.21.15.55:0/3891051904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93140c9370 con 0x7f92fc003980 2023-07-06T22:01:27.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 -- 172.21.15.55:0/3891051904 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931406b390 con 0x7f92fc004d10 2023-07-06T22:01:27.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9312ffd640 1 -- 172.21.15.55:0/3891051904 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc00fda0 con 0x7f93140cbfa0 2023-07-06T22:01:27.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9313fff640 1 --2- 172.21.15.55:0/3891051904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92fc003980 0x7f92fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f93137fe640 1 --2- 172.21.15.55:0/3891051904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93140cbfa0 0x7f92fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9318b1f640 1 --2- 172.21.15.55:0/3891051904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92fc004d10 0x7f92fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9313fff640 1 -- 172.21.15.55:0/3891051904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93140cbfa0 msgr2=0x7f92fc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:27.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9313fff640 1 --2- 172.21.15.55:0/3891051904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93140cbfa0 0x7f92fc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9313fff640 1 -- 172.21.15.55:0/3891051904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92fc004d10 msgr2=0x7f92fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:27.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9313fff640 1 --2- 172.21.15.55:0/3891051904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92fc004d10 0x7f92fc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.804+0000 7f9313fff640 1 -- 172.21.15.55:0/3891051904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc003530 con 0x7f92fc003980 2023-07-06T22:01:27.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.808+0000 7f9313fff640 1 --2- 172.21.15.55:0/3891051904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92fc003980 0x7f92fc003d90 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f930400c240 tx=0x7f930401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c130e68c5e1f9f1f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:27.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.808+0000 7f9312ffd640 1 -- 172.21.15.55:0/3891051904 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93040058e0 con 0x7f92fc003980 2023-07-06T22:01:27.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.808+0000 7f9312ffd640 1 -- 172.21.15.55:0/3891051904 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9304005a40 con 0x7f92fc003980 2023-07-06T22:01:27.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.808+0000 7f9312ffd640 1 -- 172.21.15.55:0/3891051904 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304005e10 con 0x7f92fc003980 2023-07-06T22:01:27.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.808+0000 7f931a582640 1 -- 172.21.15.55:0/3891051904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92fc003980 msgr2=0x7f92fc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.808+0000 7f931a582640 1 --2- 172.21.15.55:0/3891051904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92fc003980 0x7f92fc003d90 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f930400c240 tx=0x7f930401cc60 comp rx=0 tx=0).stop 2023-07-06T22:01:27.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.808+0000 7f9318b1f640 1 -- 172.21.15.55:0/3891051904 reap_dead start 2023-07-06T22:01:27.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.808+0000 7f931a582640 1 -- 172.21.15.55:0/3891051904 shutdown_connections 2023-07-06T22:01:27.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.808+0000 7f931a582640 1 -- 172.21.15.55:0/3891051904 >> 172.21.15.55:0/3891051904 conn(0x7f93140cde30 msgr2=0x7f93140ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:27.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.808+0000 7f931a582640 1 -- 172.21.15.55:0/3891051904 shutdown_connections 2023-07-06T22:01:27.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.808+0000 7f931a582640 1 -- 172.21.15.55:0/3891051904 wait complete. 2023-07-06T22:01:27.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.808+0000 7f931a582640 1 Processor -- start 2023-07-06T22:01:27.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f931a582640 1 -- start start 2023-07-06T22:01:27.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f931a582640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc003980 0x7f931414fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f931a582640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93140b2870 0x7f931414a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f931a582640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f931415db00 0x7f931415df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f931a582640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931414e150 con 0x7f931415db00 2023-07-06T22:01:27.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f931a582640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931415e4b0 con 0x7f93140b2870 2023-07-06T22:01:27.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f931a582640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931414e360 con 0x7f92fc003980 2023-07-06T22:01:27.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f9318b1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f931415db00 0x7f931415df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f9318b1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f931415db00 0x7f931415df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41698/0 (socket says 172.21.15.55:41698) 2023-07-06T22:01:27.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f9318b1f640 1 -- 172.21.15.55:0/93338832 learned_addr learned my addr 172.21.15.55:0/93338832 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:27.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f9313fff640 1 --2- 172.21.15.55:0/93338832 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc003980 0x7f931414fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f93137fe640 1 --2- 172.21.15.55:0/93338832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93140b2870 0x7f931414a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f9318b1f640 1 -- 172.21.15.55:0/93338832 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc003980 msgr2=0x7f931414fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f9318b1f640 1 --2- 172.21.15.55:0/93338832 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc003980 0x7f931414fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f9318b1f640 1 -- 172.21.15.55:0/93338832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93140b2870 msgr2=0x7f931414a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:27.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f9318b1f640 1 --2- 172.21.15.55:0/93338832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93140b2870 0x7f931414a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:27.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f9318b1f640 1 -- 172.21.15.55:0/93338832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931414e640 con 0x7f931415db00 2023-07-06T22:01:27.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f9318b1f640 1 --2- 172.21.15.55:0/93338832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f931415db00 0x7f931415df70 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f931406efa0 tx=0x7f930c011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:27.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f9310ff9640 1 -- 172.21.15.55:0/93338832 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c00e040 con 0x7f931415db00 2023-07-06T22:01:27.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f9310ff9640 1 -- 172.21.15.55:0/93338832 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c00f040 con 0x7f931415db00 2023-07-06T22:01:27.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f931a582640 1 -- 172.21.15.55:0/93338832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931414e920 con 0x7f931415db00 2023-07-06T22:01:27.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f9310ff9640 1 -- 172.21.15.55:0/93338832 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c015a80 con 0x7f931415db00 2023-07-06T22:01:27.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f931a582640 1 -- 172.21.15.55:0/93338832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93141500c0 con 0x7f931415db00 2023-07-06T22:01:27.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.812+0000 7f931a582640 1 -- 172.21.15.55:0/93338832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9314066d60 con 0x7f931415db00 2023-07-06T22:01:27.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.816+0000 7f9310ff9640 1 -- 172.21.15.55:0/93338832 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f930c015be0 con 0x7f931415db00 2023-07-06T22:01:27.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.816+0000 7f9310ff9640 1 --2- 172.21.15.55:0/93338832 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f93000663d0 0x7f9300068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:27.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.816+0000 7f9310ff9640 1 -- 172.21.15.55:0/93338832 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f930c083ad0 con 0x7f931415db00 2023-07-06T22:01:27.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.816+0000 7f9313fff640 1 --2- 172.21.15.55:0/93338832 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f93000663d0 0x7f9300068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:27.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.816+0000 7f9313fff640 1 --2- 172.21.15.55:0/93338832 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f93000663d0 0x7f9300068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f93040aa000 tx=0x7f9304001a80 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:27.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.820+0000 7f9310ff9640 1 -- 172.21.15.55:0/93338832 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f930c050f10 con 0x7f931415db00 2023-07-06T22:01:27.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:27.976+0000 7f931a582640 1 -- 172.21.15.55:0/93338832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f93140cbd80 con 0x7f931415db00 2023-07-06T22:01:28.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.760+0000 7f9310ff9640 1 -- 172.21.15.55:0/93338832 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v143) v1 ==== 138+0+0 (secure 0 0 0) 0x7f930c054530 con 0x7f931415db00 2023-07-06T22:01:28.758 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-07-06T22:01:28.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.768+0000 7f931a582640 1 -- 172.21.15.55:0/93338832 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f93000663d0 msgr2=0x7f9300068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:28.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.768+0000 7f931a582640 1 --2- 172.21.15.55:0/93338832 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f93000663d0 0x7f9300068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f93040aa000 tx=0x7f9304001a80 comp rx=0 tx=0).stop 2023-07-06T22:01:28.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.768+0000 7f931a582640 1 -- 172.21.15.55:0/93338832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f931415db00 msgr2=0x7f931415df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:28.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.768+0000 7f931a582640 1 --2- 172.21.15.55:0/93338832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f931415db00 0x7f931415df70 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f931406efa0 tx=0x7f930c011bf0 comp rx=0 tx=0).stop 2023-07-06T22:01:28.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.768+0000 7f931a582640 1 -- 172.21.15.55:0/93338832 shutdown_connections 2023-07-06T22:01:28.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.768+0000 7f931a582640 1 --2- 172.21.15.55:0/93338832 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f93000663d0 0x7f9300068880 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:28.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.768+0000 7f931a582640 1 --2- 172.21.15.55:0/93338832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f931415db00 0x7f931415df70 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:28.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.768+0000 7f931a582640 1 --2- 172.21.15.55:0/93338832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93140b2870 0x7f931414a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:28.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.768+0000 7f931a582640 1 --2- 172.21.15.55:0/93338832 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc003980 0x7f931414fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:28.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.768+0000 7f931a582640 1 -- 172.21.15.55:0/93338832 >> 172.21.15.55:0/93338832 conn(0x7f93140cde30 msgr2=0x7f93140c9810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:28.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.768+0000 7f931a582640 1 -- 172.21.15.55:0/93338832 shutdown_connections 2023-07-06T22:01:28.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.768+0000 7f931a582640 1 -- 172.21.15.55:0/93338832 wait complete. 2023-07-06T22:01:28.787 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T22:01:28.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd882c26640 1 Processor -- start 2023-07-06T22:01:28.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd882c26640 1 -- start start 2023-07-06T22:01:28.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd882c26640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87c06ba00 0x7fd87c0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:28.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd882c26640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd87c0c8a30 0x7fd87c0cc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:28.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd882c26640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c071660 con 0x7fd87c158770 2023-07-06T22:01:28.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd882c26640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c06a500 con 0x7fd87c0c8a30 2023-07-06T22:01:28.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd882c26640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c06a750 con 0x7fd87c06ba00 2023-07-06T22:01:28.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd8809c2640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd87c158770 0x7fd87c06b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50054/0 (socket says 172.21.15.55:50054) 2023-07-06T22:01:28.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd8809c2640 1 -- 172.21.15.55:0/205381857 learned_addr learned my addr 172.21.15.55:0/205381857 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd8811c3640 1 --2- 172.21.15.55:0/205381857 >> v2:172.21.15.138:3300/0 conn(0x7fd87c0c8a30 0x7fd87c0cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd87bfff640 1 --2- 172.21.15.55:0/205381857 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87c06ba00 0x7fd87c0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd87b7fe640 1 -- 172.21.15.55:0/205381857 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277590999 0 0) 0x7fd87c071660 con 0x7fd87c158770 2023-07-06T22:01:28.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd87b7fe640 1 -- 172.21.15.55:0/205381857 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd86c003530 con 0x7fd87c158770 2023-07-06T22:01:28.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd87b7fe640 1 -- 172.21.15.55:0/205381857 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 592340016 0 0) 0x7fd86c003530 con 0x7fd87c158770 2023-07-06T22:01:28.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd87b7fe640 1 -- 172.21.15.55:0/205381857 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87c06ba00 msgr2=0x7fd87c0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:28.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd87b7fe640 1 --2- 172.21.15.55:0/205381857 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87c06ba00 0x7fd87c0cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:28.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd87b7fe640 1 -- 172.21.15.55:0/205381857 >> v2:172.21.15.138:3300/0 conn(0x7fd87c0c8a30 msgr2=0x7fd87c0cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:28.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd87b7fe640 1 --2- 172.21.15.55:0/205381857 >> v2:172.21.15.138:3300/0 conn(0x7fd87c0c8a30 0x7fd87c0cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:28.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd87b7fe640 1 -- 172.21.15.55:0/205381857 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c06f9c0 con 0x7fd87c158770 2023-07-06T22:01:28.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd87b7fe640 1 -- 172.21.15.55:0/205381857 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fd870001680 con 0x7fd87c158770 2023-07-06T22:01:28.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.944+0000 7fd87b7fe640 1 -- 172.21.15.55:0/205381857 >> v1:172.21.15.55:6789/0 conn(0x7fd87c158770 legacy=0x7fd87c06b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:28.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd87b7fe640 1 --2- 172.21.15.55:0/205381857 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87c06ba00 0x7fd86c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:28.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd87b7fe640 1 --2- 172.21.15.55:0/205381857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd86c003f00 0x7fd86c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:28.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd87b7fe640 1 --2- 172.21.15.55:0/205381857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd86c004d10 0x7fd86c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:28.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd87b7fe640 1 -- 172.21.15.55:0/205381857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c06a500 con 0x7fd86c004d10 2023-07-06T22:01:28.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd87b7fe640 1 -- 172.21.15.55:0/205381857 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c06a750 con 0x7fd86c003f00 2023-07-06T22:01:28.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd87b7fe640 1 -- 172.21.15.55:0/205381857 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c00b990 con 0x7fd87c06ba00 2023-07-06T22:01:28.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd8811c3640 1 --2- 172.21.15.55:0/205381857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd86c004d10 0x7fd86c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:28.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd8809c2640 1 --2- 172.21.15.55:0/205381857 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87c06ba00 0x7fd86c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:28.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd87bfff640 1 --2- 172.21.15.55:0/205381857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd86c003f00 0x7fd86c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:28.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd8811c3640 1 -- 172.21.15.55:0/205381857 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87c06ba00 msgr2=0x7fd86c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:28.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd8811c3640 1 --2- 172.21.15.55:0/205381857 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87c06ba00 0x7fd86c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:28.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd8811c3640 1 -- 172.21.15.55:0/205381857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd86c003f00 msgr2=0x7fd86c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:28.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd8811c3640 1 --2- 172.21.15.55:0/205381857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd86c003f00 0x7fd86c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:28.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd8811c3640 1 -- 172.21.15.55:0/205381857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86c003530 con 0x7fd86c004d10 2023-07-06T22:01:28.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd8811c3640 1 --2- 172.21.15.55:0/205381857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd86c004d10 0x7fd86c005180 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fd874009f90 tx=0x7fd87401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e150a8876848e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:28.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd87b7fe640 1 -- 172.21.15.55:0/205381857 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740a5c70 con 0x7fd86c004d10 2023-07-06T22:01:28.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd87b7fe640 1 -- 172.21.15.55:0/205381857 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87400f040 con 0x7fd86c004d10 2023-07-06T22:01:28.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.948+0000 7fd87b7fe640 1 -- 172.21.15.55:0/205381857 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740ad440 con 0x7fd86c004d10 2023-07-06T22:01:28.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd882c26640 1 -- 172.21.15.55:0/205381857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd86c004d10 msgr2=0x7fd86c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd882c26640 1 --2- 172.21.15.55:0/205381857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd86c004d10 0x7fd86c005180 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fd874009f90 tx=0x7fd87401cc60 comp rx=0 tx=0).stop 2023-07-06T22:01:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd8811c3640 1 -- 172.21.15.55:0/205381857 reap_dead start 2023-07-06T22:01:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd882c26640 1 -- 172.21.15.55:0/205381857 shutdown_connections 2023-07-06T22:01:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd882c26640 1 -- 172.21.15.55:0/205381857 >> 172.21.15.55:0/205381857 conn(0x7fd87c0cdf40 msgr2=0x7fd87c0ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd882c26640 1 -- 172.21.15.55:0/205381857 shutdown_connections 2023-07-06T22:01:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd882c26640 1 -- 172.21.15.55:0/205381857 wait complete. 2023-07-06T22:01:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd882c26640 1 Processor -- start 2023-07-06T22:01:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd882c26640 1 -- start start 2023-07-06T22:01:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd882c26640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd86c004d10 0x7fd87c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd882c26640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87c0cb380 0x7fd87c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd882c26640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd87c14e840 0x7fd87c0c0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd882c26640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0cc2d0 con 0x7fd86c004d10 2023-07-06T22:01:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd882c26640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0cba00 con 0x7fd87c14e840 2023-07-06T22:01:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd882c26640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c145c80 con 0x7fd87c0cb380 2023-07-06T22:01:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd8809c2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd86c004d10 0x7fd87c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd8809c2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd86c004d10 0x7fd87c0cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41710/0 (socket says 172.21.15.55:41710) 2023-07-06T22:01:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd8809c2640 1 -- 172.21.15.55:0/3169458064 learned_addr learned my addr 172.21.15.55:0/3169458064 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd87bfff640 1 --2- 172.21.15.55:0/3169458064 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87c0cb380 0x7fd87c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.952+0000 7fd8811c3640 1 --2- 172.21.15.55:0/3169458064 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd87c14e840 0x7fd87c0c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.956+0000 7fd8809c2640 1 -- 172.21.15.55:0/3169458064 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87c0cb380 msgr2=0x7fd87c0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.956+0000 7fd8809c2640 1 --2- 172.21.15.55:0/3169458064 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87c0cb380 0x7fd87c0caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.956+0000 7fd8809c2640 1 -- 172.21.15.55:0/3169458064 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd87c14e840 msgr2=0x7fd87c0c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.956+0000 7fd8809c2640 1 --2- 172.21.15.55:0/3169458064 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd87c14e840 0x7fd87c0c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.956+0000 7fd8809c2640 1 -- 172.21.15.55:0/3169458064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c0cbc10 con 0x7fd86c004d10 2023-07-06T22:01:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.956+0000 7fd8809c2640 1 --2- 172.21.15.55:0/3169458064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd86c004d10 0x7fd87c0cc6f0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fd870007340 tx=0x7fd870007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.956+0000 7fd8797fa640 1 -- 172.21.15.55:0/3169458064 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87000f960 con 0x7fd86c004d10 2023-07-06T22:01:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.956+0000 7fd8797fa640 1 -- 172.21.15.55:0/3169458064 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87000fae0 con 0x7fd86c004d10 2023-07-06T22:01:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.956+0000 7fd8797fa640 1 -- 172.21.15.55:0/3169458064 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87000fe90 con 0x7fd86c004d10 2023-07-06T22:01:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.956+0000 7fd882c26640 1 -- 172.21.15.55:0/3169458064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87c0cbef0 con 0x7fd86c004d10 2023-07-06T22:01:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.956+0000 7fd882c26640 1 -- 172.21.15.55:0/3169458064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87c145a20 con 0x7fd86c004d10 2023-07-06T22:01:28.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.956+0000 7fd882c26640 1 -- 172.21.15.55:0/3169458064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87c066d60 con 0x7fd86c004d10 2023-07-06T22:01:28.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.960+0000 7fd8797fa640 1 -- 172.21.15.55:0/3169458064 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd870026430 con 0x7fd86c004d10 2023-07-06T22:01:28.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.960+0000 7fd8797fa640 1 --2- 172.21.15.55:0/3169458064 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd8600663d0 0x7fd860068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:28.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.960+0000 7fd8797fa640 1 -- 172.21.15.55:0/3169458064 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5928+0+0 (secure 0 0 0) 0x7fd870084590 con 0x7fd86c004d10 2023-07-06T22:01:28.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.960+0000 7fd87bfff640 1 --2- 172.21.15.55:0/3169458064 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd8600663d0 0x7fd860068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:28.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.960+0000 7fd87bfff640 1 --2- 172.21.15.55:0/3169458064 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd8600663d0 0x7fd860068880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0cecb0 tx=0x7fd868009190 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:28.964+0000 7fd8797fa640 1 -- 172.21.15.55:0/3169458064 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd870051960 con 0x7fd86c004d10 2023-07-06T22:01:29.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.120+0000 7fd882c26640 1 -- 172.21.15.55:0/3169458064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd87c155bc0 con 0x7fd86c004d10 2023-07-06T22:01:29.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.780+0000 7fd8797fa640 1 -- 172.21.15.55:0/3169458064 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v144) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd870054f80 con 0x7fd86c004d10 2023-07-06T22:01:29.780 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-07-06T22:01:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.792+0000 7fd882c26640 1 -- 172.21.15.55:0/3169458064 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd8600663d0 msgr2=0x7fd860068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.792+0000 7fd882c26640 1 --2- 172.21.15.55:0/3169458064 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd8600663d0 0x7fd860068880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0cecb0 tx=0x7fd868009190 comp rx=0 tx=0).stop 2023-07-06T22:01:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.792+0000 7fd882c26640 1 -- 172.21.15.55:0/3169458064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd86c004d10 msgr2=0x7fd87c0cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.792+0000 7fd882c26640 1 --2- 172.21.15.55:0/3169458064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd86c004d10 0x7fd87c0cc6f0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fd870007340 tx=0x7fd870007740 comp rx=0 tx=0).stop 2023-07-06T22:01:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.796+0000 7fd882c26640 1 -- 172.21.15.55:0/3169458064 shutdown_connections 2023-07-06T22:01:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.796+0000 7fd882c26640 1 --2- 172.21.15.55:0/3169458064 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd8600663d0 0x7fd860068880 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.796+0000 7fd882c26640 1 --2- 172.21.15.55:0/3169458064 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd87c14e840 0x7fd87c0c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:29.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.796+0000 7fd882c26640 1 --2- 172.21.15.55:0/3169458064 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87c0cb380 0x7fd87c0caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:29.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.796+0000 7fd882c26640 1 --2- 172.21.15.55:0/3169458064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd86c004d10 0x7fd87c0cc6f0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:29.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.796+0000 7fd882c26640 1 -- 172.21.15.55:0/3169458064 >> 172.21.15.55:0/3169458064 conn(0x7fd87c0cdf40 msgr2=0x7fd87c156320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:29.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.796+0000 7fd882c26640 1 -- 172.21.15.55:0/3169458064 shutdown_connections 2023-07-06T22:01:29.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.796+0000 7fd882c26640 1 -- 172.21.15.55:0/3169458064 wait complete. 2023-07-06T22:01:29.817 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T22:01:29.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.964+0000 7f02706cb640 1 Processor -- start 2023-07-06T22:01:29.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.964+0000 7f02706cb640 1 -- start start 2023-07-06T22:01:29.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.968+0000 7f02706cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0268070d70 0x7f02680b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:29.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.968+0000 7f02706cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02680cc030 con 0x7f02680709a0 2023-07-06T22:01:29.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.968+0000 7f02706cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02680cc300 con 0x7f02680b1170 2023-07-06T22:01:29.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.968+0000 7f02706cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02680b15f0 con 0x7f0268070d70 2023-07-06T22:01:29.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.968+0000 7f026e467640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f02680709a0 0x7f02680cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50066/0 (socket says 172.21.15.55:50066) 2023-07-06T22:01:29.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.968+0000 7f026e467640 1 -- 172.21.15.55:0/2912282409 learned_addr learned my addr 172.21.15.55:0/2912282409 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:29.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.968+0000 7f026dc66640 1 --2- 172.21.15.55:0/2912282409 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0268070d70 0x7f02680b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:29.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.968+0000 7f026d465640 1 -- 172.21.15.55:0/2912282409 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342204337 0 0) 0x7f02680cc030 con 0x7f02680709a0 2023-07-06T22:01:29.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.968+0000 7f026d465640 1 -- 172.21.15.55:0/2912282409 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0254003530 con 0x7f02680709a0 2023-07-06T22:01:29.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.968+0000 7f026d465640 1 -- 172.21.15.55:0/2912282409 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728798448 0 0) 0x7f02680cc300 con 0x7f02680b1170 2023-07-06T22:01:29.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.968+0000 7f026d465640 1 -- 172.21.15.55:0/2912282409 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02680cc030 con 0x7f02680b1170 2023-07-06T22:01:29.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.968+0000 7f026dc66640 1 -- 172.21.15.55:0/2912282409 >> v1:172.21.15.138:6789/0 conn(0x7f02680b1170 legacy=0x7f026806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:29.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.968+0000 7f026dc66640 1 -- 172.21.15.55:0/2912282409 >> v1:172.21.15.55:6789/0 conn(0x7f02680709a0 legacy=0x7f02680cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:29.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.968+0000 7f026dc66640 1 -- 172.21.15.55:0/2912282409 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02680cc5e0 con 0x7f0268070d70 2023-07-06T22:01:29.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.972+0000 7f026dc66640 1 --2- 172.21.15.55:0/2912282409 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0268070d70 0x7f02680b0c30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f02680b1730 tx=0x7f025801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c376e99ad9ecef25 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:29.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.972+0000 7f026d465640 1 -- 172.21.15.55:0/2912282409 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02580ab600 con 0x7f0268070d70 2023-07-06T22:01:29.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.972+0000 7f026d465640 1 -- 172.21.15.55:0/2912282409 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02580a7050 con 0x7f0268070d70 2023-07-06T22:01:29.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.972+0000 7f026d465640 1 -- 172.21.15.55:0/2912282409 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02580ab980 con 0x7f0268070d70 2023-07-06T22:01:29.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.972+0000 7f02706cb640 1 -- 172.21.15.55:0/2912282409 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0268070d70 msgr2=0x7f02680b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:29.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.972+0000 7f02706cb640 1 --2- 172.21.15.55:0/2912282409 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0268070d70 0x7f02680b0c30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f02680b1730 tx=0x7f025801c410 comp rx=0 tx=0).stop 2023-07-06T22:01:29.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.972+0000 7f02706cb640 1 -- 172.21.15.55:0/2912282409 shutdown_connections 2023-07-06T22:01:29.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.972+0000 7f02706cb640 1 --2- 172.21.15.55:0/2912282409 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0268070d70 0x7f02680b0c30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:29.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.972+0000 7f02706cb640 1 -- 172.21.15.55:0/2912282409 >> 172.21.15.55:0/2912282409 conn(0x7f02680cea70 msgr2=0x7f02680ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:29.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.972+0000 7f02706cb640 1 -- 172.21.15.55:0/2912282409 shutdown_connections 2023-07-06T22:01:29.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.972+0000 7f02706cb640 1 -- 172.21.15.55:0/2912282409 wait complete. 2023-07-06T22:01:29.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.972+0000 7f02706cb640 1 Processor -- start 2023-07-06T22:01:29.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.972+0000 7f02706cb640 1 -- start start 2023-07-06T22:01:29.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f02706cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02680709a0 0x7f0268156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:29.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f02706cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0268070d70 0x7f02680c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:29.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f02706cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02680b1170 0x7f02680c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:29.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f02706cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02681566a0 con 0x7f02680709a0 2023-07-06T22:01:29.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f02706cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02680c49a0 con 0x7f0268070d70 2023-07-06T22:01:29.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f02706cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02680c46c0 con 0x7f02680b1170 2023-07-06T22:01:29.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f026e467640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02680709a0 0x7f0268156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:29.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f026e467640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02680709a0 0x7f0268156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41722/0 (socket says 172.21.15.55:41722) 2023-07-06T22:01:29.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f026e467640 1 -- 172.21.15.55:0/3750682186 learned_addr learned my addr 172.21.15.55:0/3750682186 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:29.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f026dc66640 1 --2- 172.21.15.55:0/3750682186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0268070d70 0x7f02680c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:29.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f026ec68640 1 --2- 172.21.15.55:0/3750682186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02680b1170 0x7f02680c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f026e467640 1 -- 172.21.15.55:0/3750682186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02680b1170 msgr2=0x7f02680c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f026e467640 1 --2- 172.21.15.55:0/3750682186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02680b1170 0x7f02680c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f026e467640 1 -- 172.21.15.55:0/3750682186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0268070d70 msgr2=0x7f02680c1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f026e467640 1 --2- 172.21.15.55:0/3750682186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0268070d70 0x7f02680c1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f026e467640 1 -- 172.21.15.55:0/3750682186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0258009420 con 0x7f02680709a0 2023-07-06T22:01:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f026e467640 1 --2- 172.21.15.55:0/3750682186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02680709a0 0x7f0268156b30 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f026400c420 tx=0x7f026400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:29.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f025effd640 1 -- 172.21.15.55:0/3750682186 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0264005cf0 con 0x7f02680709a0 2023-07-06T22:01:29.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f025effd640 1 -- 172.21.15.55:0/3750682186 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0264005e50 con 0x7f02680709a0 2023-07-06T22:01:29.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f02706cb640 1 -- 172.21.15.55:0/3750682186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0268156050 con 0x7f02680709a0 2023-07-06T22:01:29.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f025effd640 1 -- 172.21.15.55:0/3750682186 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0264007310 con 0x7f02680709a0 2023-07-06T22:01:29.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f02706cb640 1 -- 172.21.15.55:0/3750682186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0268157070 con 0x7f02680709a0 2023-07-06T22:01:29.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.976+0000 7f02706cb640 1 -- 172.21.15.55:0/3750682186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02681572c0 con 0x7f02680709a0 2023-07-06T22:01:29.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.980+0000 7f025effd640 1 -- 172.21.15.55:0/3750682186 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0264007470 con 0x7f02680709a0 2023-07-06T22:01:29.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.980+0000 7f025effd640 1 --2- 172.21.15.55:0/3750682186 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f024c0663a0 0x7f024c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:29.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.980+0000 7f025effd640 1 -- 172.21.15.55:0/3750682186 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6310+0+0 (secure 0 0 0) 0x7f0264083840 con 0x7f02680709a0 2023-07-06T22:01:29.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.980+0000 7f026dc66640 1 --2- 172.21.15.55:0/3750682186 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f024c0663a0 0x7f024c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:29.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.980+0000 7f026dc66640 1 --2- 172.21.15.55:0/3750682186 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f024c0663a0 0x7f024c068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f02580ad000 tx=0x7f0258008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:29.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:29.984+0000 7f025effd640 1 -- 172.21.15.55:0/3750682186 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0264050b40 con 0x7f02680709a0 2023-07-06T22:01:30.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.176+0000 7f02706cb640 1 -- 172.21.15.55:0/3750682186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f02681572c0 con 0x7f02680709a0 2023-07-06T22:01:30.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.184+0000 7f025effd640 1 -- 172.21.15.55:0/3750682186 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v59) v1 ==== 174+0+0 (secure 0 0 0) 0x7f02681572c0 con 0x7f02680709a0 2023-07-06T22:01:30.184 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 18 and data pool 19 2023-07-06T22:01:30.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.192+0000 7f02706cb640 1 -- 172.21.15.55:0/3750682186 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f024c0663a0 msgr2=0x7f024c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:30.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.192+0000 7f02706cb640 1 --2- 172.21.15.55:0/3750682186 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f024c0663a0 0x7f024c068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f02580ad000 tx=0x7f0258008040 comp rx=0 tx=0).stop 2023-07-06T22:01:30.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.192+0000 7f02706cb640 1 -- 172.21.15.55:0/3750682186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02680709a0 msgr2=0x7f0268156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.192+0000 7f02706cb640 1 --2- 172.21.15.55:0/3750682186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02680709a0 0x7f0268156b30 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f026400c420 tx=0x7f026400c8e0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.192+0000 7f02706cb640 1 -- 172.21.15.55:0/3750682186 shutdown_connections 2023-07-06T22:01:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.192+0000 7f02706cb640 1 --2- 172.21.15.55:0/3750682186 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f024c0663a0 0x7f024c068850 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f02580ad000 tx=0x7f0258008040 comp rx=0 tx=0).stop 2023-07-06T22:01:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.192+0000 7f02706cb640 1 --2- 172.21.15.55:0/3750682186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02680b1170 0x7f02680c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.192+0000 7f02706cb640 1 --2- 172.21.15.55:0/3750682186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0268070d70 0x7f02680c1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.192+0000 7f02706cb640 1 --2- 172.21.15.55:0/3750682186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02680709a0 0x7f0268156b30 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.192+0000 7f02706cb640 1 -- 172.21.15.55:0/3750682186 >> 172.21.15.55:0/3750682186 conn(0x7f02680cea70 msgr2=0x7f02680cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:30.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.196+0000 7f02706cb640 1 -- 172.21.15.55:0/3750682186 shutdown_connections 2023-07-06T22:01:30.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.196+0000 7f02706cb640 1 -- 172.21.15.55:0/3750682186 wait complete. 2023-07-06T22:01:30.233 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:01:30.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.376+0000 7fa4b8f74640 1 Processor -- start 2023-07-06T22:01:30.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.376+0000 7fa4b8f74640 1 -- start start 2023-07-06T22:01:30.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4b8f74640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa4b415bc40 0x7fa4b406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:30.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4b8f74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b415cc00 0x7fa4b415f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:30.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4b8f74640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b415c770 con 0x7fa4b406f8e0 2023-07-06T22:01:30.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4b8f74640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b406d4f0 con 0x7fa4b415bc40 2023-07-06T22:01:30.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4b8f74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b406d210 con 0x7fa4b415cc00 2023-07-06T22:01:30.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4abfff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa4b415bc40 0x7fa4b406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:30.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4b2d9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b415cc00 0x7fa4b415f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:30.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4b259c640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fa4b406f8e0 0x7fa4b406fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:42966/0 (socket says 172.21.15.55:42966) 2023-07-06T22:01:30.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4abfff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa4b415bc40 0x7fa4b406c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:41674/0 (socket says 172.21.15.55:41674) 2023-07-06T22:01:30.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4b259c640 1 -- 172.21.15.55:0/3219590326 learned_addr learned my addr 172.21.15.55:0/3219590326 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:30.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4abfff640 1 -- 172.21.15.55:0/3219590326 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b415cc00 msgr2=0x7fa4b415f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:30.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4abfff640 1 --2- 172.21.15.55:0/3219590326 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b415cc00 0x7fa4b415f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4abfff640 1 -- 172.21.15.55:0/3219590326 >> v1:172.21.15.138:6789/0 conn(0x7fa4b406f8e0 legacy=0x7fa4b406fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:30.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4abfff640 1 -- 172.21.15.55:0/3219590326 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b415c120 con 0x7fa4b415bc40 2023-07-06T22:01:30.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4b2d9d640 1 --2- 172.21.15.55:0/3219590326 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b415cc00 0x7fa4b415f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:30.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.380+0000 7fa4b1d9b640 1 -- 172.21.15.55:0/3219590326 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029143370 0 0) 0x7fa4b415c770 con 0x7fa4b406f8e0 2023-07-06T22:01:30.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.384+0000 7fa4abfff640 1 --2- 172.21.15.55:0/3219590326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b415bc40 0x7fa4b406c930 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0097f0 tx=0x7fa49c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90efff33b4f97f99 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:30.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.384+0000 7fa4b1d9b640 1 -- 172.21.15.55:0/3219590326 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0ad680 con 0x7fa4b415bc40 2023-07-06T22:01:30.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.384+0000 7fa4b1d9b640 1 -- 172.21.15.55:0/3219590326 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c0ad7e0 con 0x7fa4b415bc40 2023-07-06T22:01:30.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.384+0000 7fa4b1d9b640 1 -- 172.21.15.55:0/3219590326 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0adb70 con 0x7fa4b415bc40 2023-07-06T22:01:30.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.384+0000 7fa4b8f74640 1 -- 172.21.15.55:0/3219590326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b415bc40 msgr2=0x7fa4b406c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:30.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.384+0000 7fa4b8f74640 1 --2- 172.21.15.55:0/3219590326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b415bc40 0x7fa4b406c930 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0097f0 tx=0x7fa49c01c450 comp rx=0 tx=0).stop 2023-07-06T22:01:30.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.384+0000 7fa4b8f74640 1 -- 172.21.15.55:0/3219590326 shutdown_connections 2023-07-06T22:01:30.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.384+0000 7fa4b8f74640 1 --2- 172.21.15.55:0/3219590326 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b415cc00 0x7fa4b415f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.384+0000 7fa4b8f74640 1 --2- 172.21.15.55:0/3219590326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b415bc40 0x7fa4b406c930 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.384+0000 7fa4b8f74640 1 -- 172.21.15.55:0/3219590326 >> 172.21.15.55:0/3219590326 conn(0x7fa4b40cbd80 msgr2=0x7fa4b40ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:30.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.384+0000 7fa4b8f74640 1 -- 172.21.15.55:0/3219590326 shutdown_connections 2023-07-06T22:01:30.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.384+0000 7fa4b8f74640 1 -- 172.21.15.55:0/3219590326 wait complete. 2023-07-06T22:01:30.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.384+0000 7fa4b8f74640 1 Processor -- start 2023-07-06T22:01:30.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.384+0000 7fa4b8f74640 1 -- start start 2023-07-06T22:01:30.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b8f74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b406f8e0 0x7fa4b415d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:30.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b8f74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b415bc40 0x7fa4b41574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:30.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b8f74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b415cc00 0x7fa4b4157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:30.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b8f74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b40acea0 con 0x7fa4b406f8e0 2023-07-06T22:01:30.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b8f74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b40ad180 con 0x7fa4b415bc40 2023-07-06T22:01:30.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b8f74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b40ad460 con 0x7fa4b415cc00 2023-07-06T22:01:30.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b406f8e0 0x7fa4b415d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:30.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b406f8e0 0x7fa4b415d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41734/0 (socket says 172.21.15.55:41734) 2023-07-06T22:01:30.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b259c640 1 -- 172.21.15.55:0/2746979979 learned_addr learned my addr 172.21.15.55:0/2746979979 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:30.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b2d9d640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b415cc00 0x7fa4b4157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:30.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4abfff640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b415bc40 0x7fa4b41574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:30.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b259c640 1 -- 172.21.15.55:0/2746979979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b415cc00 msgr2=0x7fa4b4157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:30.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b259c640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b415cc00 0x7fa4b4157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b259c640 1 -- 172.21.15.55:0/2746979979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b415bc40 msgr2=0x7fa4b41574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:30.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b259c640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b415bc40 0x7fa4b41574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b259c640 1 -- 172.21.15.55:0/2746979979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac009a70 con 0x7fa4b406f8e0 2023-07-06T22:01:30.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b2d9d640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b415cc00 0x7fa4b4157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:30.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b259c640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b406f8e0 0x7fa4b415d2d0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400c4a0 tx=0x7fa4a400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:30.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4aaffd640 1 -- 172.21.15.55:0/2746979979 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a40074e0 con 0x7fa4b406f8e0 2023-07-06T22:01:30.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4aaffd640 1 -- 172.21.15.55:0/2746979979 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a4007640 con 0x7fa4b406f8e0 2023-07-06T22:01:30.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4aaffd640 1 -- 172.21.15.55:0/2746979979 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4004a30 con 0x7fa4b406f8e0 2023-07-06T22:01:30.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b8f74640 1 -- 172.21.15.55:0/2746979979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c009420 con 0x7fa4b406f8e0 2023-07-06T22:01:30.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b8f74640 1 -- 172.21.15.55:0/2746979979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b41547e0 con 0x7fa4b406f8e0 2023-07-06T22:01:30.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.388+0000 7fa4b8f74640 1 -- 172.21.15.55:0/2746979979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b4154360 con 0x7fa4b406f8e0 2023-07-06T22:01:30.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.392+0000 7fa4aaffd640 1 -- 172.21.15.55:0/2746979979 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa4a4004b90 con 0x7fa4b406f8e0 2023-07-06T22:01:30.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.392+0000 7fa4aaffd640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa4940663a0 0x7fa494068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:30.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.392+0000 7fa4aaffd640 1 -- 172.21.15.55:0/2746979979 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa4a4083250 con 0x7fa4b406f8e0 2023-07-06T22:01:30.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.392+0000 7fa4abfff640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa4940663a0 0x7fa494068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:30.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.392+0000 7fa4abfff640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa4940663a0 0x7fa494068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0af000 tx=0x7fa49c008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:30.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.396+0000 7fa4aaffd640 1 -- 172.21.15.55:0/2746979979 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa4b4154360 con 0x7fa4b406f8e0 2023-07-06T22:01:30.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.552+0000 7fa4b8f74640 1 -- 172.21.15.55:0/2746979979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4b4154a20 con 0x7fa4b406f8e0 2023-07-06T22:01:30.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.556+0000 7fa4aaffd640 1 -- 172.21.15.55:0/2746979979 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+18611 (secure 0 0 0) 0x7fa4b4154a20 con 0x7fa4b406f8e0 2023-07-06T22:01:30.553 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:30.553 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":145,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:01:30.177742+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:01:28.023569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-07-06T22:01:29.170296+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:01:30.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.556+0000 7fa4b8f74640 1 -- 172.21.15.55:0/2746979979 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa4940663a0 msgr2=0x7fa494068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:30.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.556+0000 7fa4b8f74640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa4940663a0 0x7fa494068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0af000 tx=0x7fa49c008040 comp rx=0 tx=0).stop 2023-07-06T22:01:30.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.556+0000 7fa4b8f74640 1 -- 172.21.15.55:0/2746979979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b406f8e0 msgr2=0x7fa4b415d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:30.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.556+0000 7fa4b8f74640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b406f8e0 0x7fa4b415d2d0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400c4a0 tx=0x7fa4a400c960 comp rx=0 tx=0).stop 2023-07-06T22:01:30.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.556+0000 7fa4b8f74640 1 -- 172.21.15.55:0/2746979979 shutdown_connections 2023-07-06T22:01:30.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.556+0000 7fa4b8f74640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa4940663a0 0x7fa494068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.556+0000 7fa4b8f74640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4b415cc00 0x7fa4b4157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.556+0000 7fa4b8f74640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4b415bc40 0x7fa4b41574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.556+0000 7fa4b8f74640 1 --2- 172.21.15.55:0/2746979979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b406f8e0 0x7fa4b415d2d0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.556+0000 7fa4b8f74640 1 -- 172.21.15.55:0/2746979979 >> 172.21.15.55:0/2746979979 conn(0x7fa4b40cbd80 msgr2=0x7fa4b40b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:30.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.556+0000 7fa4b8f74640 1 -- 172.21.15.55:0/2746979979 shutdown_connections 2023-07-06T22:01:30.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.556+0000 7fa4b8f74640 1 -- 172.21.15.55:0/2746979979 wait complete. 2023-07-06T22:01:30.574 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:01:30.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffdb12640 1 Processor -- start 2023-07-06T22:01:30.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffdb12640 1 -- start start 2023-07-06T22:01:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffdb12640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ff80b12e0 0x7f0ff80d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffdb12640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0ff80d00f0 0x7f0ff80d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffdb12640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff80d0a80 con 0x7f0ff80b1a40 2023-07-06T22:01:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffdb12640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80b3be0 con 0x7f0ff80d00f0 2023-07-06T22:01:30.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffdb12640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80b4590 con 0x7f0ff80b12e0 2023-07-06T22:01:30.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffcb10640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ff80b12e0 0x7f0ff80d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:30.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ff7fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0ff80d00f0 0x7f0ff80d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffd311640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f0ff80b1a40 0x7f0ff80b1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:42982/0 (socket says 172.21.15.55:42982) 2023-07-06T22:01:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffcb10640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ff80b12e0 0x7f0ff80d1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:46666/0 (socket says 172.21.15.55:46666) 2023-07-06T22:01:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffd311640 1 -- 172.21.15.55:0/4009280741 learned_addr learned my addr 172.21.15.55:0/4009280741 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffcb10640 1 -- 172.21.15.55:0/4009280741 >> v2:172.21.15.138:3300/0 conn(0x7f0ff80d00f0 msgr2=0x7f0ff80d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffcb10640 1 --2- 172.21.15.55:0/4009280741 >> v2:172.21.15.138:3300/0 conn(0x7f0ff80d00f0 0x7f0ff80d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffcb10640 1 -- 172.21.15.55:0/4009280741 >> v1:172.21.15.138:6789/0 conn(0x7f0ff80b1a40 legacy=0x7f0ff80b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ffcb10640 1 -- 172.21.15.55:0/4009280741 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80b16b0 con 0x7f0ff80b12e0 2023-07-06T22:01:30.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.720+0000 7f0ff7fff640 1 --2- 172.21.15.55:0/4009280741 >> v2:172.21.15.138:3300/0 conn(0x7f0ff80d00f0 0x7f0ff80d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.724+0000 7f0ffcb10640 1 --2- 172.21.15.55:0/4009280741 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ff80b12e0 0x7f0ff80d1930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0097c0 tx=0x7f0fec01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5640a33c8238840f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.724+0000 7f0ff77fe640 1 -- 172.21.15.55:0/4009280741 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0ab600 con 0x7f0ff80b12e0 2023-07-06T22:01:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.724+0000 7f0ff77fe640 1 -- 172.21.15.55:0/4009280741 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec0a7050 con 0x7f0ff80b12e0 2023-07-06T22:01:30.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.724+0000 7f0ff77fe640 1 -- 172.21.15.55:0/4009280741 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0ab980 con 0x7f0ff80b12e0 2023-07-06T22:01:30.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.724+0000 7f0ffdb12640 1 -- 172.21.15.55:0/4009280741 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ff80b12e0 msgr2=0x7f0ff80d1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:30.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.724+0000 7f0ffdb12640 1 --2- 172.21.15.55:0/4009280741 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ff80b12e0 0x7f0ff80d1930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0097c0 tx=0x7f0fec01c480 comp rx=0 tx=0).stop 2023-07-06T22:01:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.724+0000 7f0ffdb12640 1 -- 172.21.15.55:0/4009280741 shutdown_connections 2023-07-06T22:01:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.724+0000 7f0ffdb12640 1 --2- 172.21.15.55:0/4009280741 >> v2:172.21.15.138:3300/0 conn(0x7f0ff80d00f0 0x7f0ff80d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.724+0000 7f0ffdb12640 1 --2- 172.21.15.55:0/4009280741 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ff80b12e0 0x7f0ff80d1930 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.724+0000 7f0ffdb12640 1 -- 172.21.15.55:0/4009280741 >> 172.21.15.55:0/4009280741 conn(0x7f0ff80d20e0 msgr2=0x7f0ff80d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.724+0000 7f0ffdb12640 1 -- 172.21.15.55:0/4009280741 shutdown_connections 2023-07-06T22:01:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.724+0000 7f0ffdb12640 1 -- 172.21.15.55:0/4009280741 wait complete. 2023-07-06T22:01:30.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ffdb12640 1 Processor -- start 2023-07-06T22:01:30.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ffdb12640 1 -- start start 2023-07-06T22:01:30.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ffdb12640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ff80b12e0 0x7f0ff8155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:30.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ffdb12640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ff80b1a40 0x7f0ff8153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:30.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ffdb12640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff80d00f0 0x7f0ff8151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:30.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ffdb12640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8156f80 con 0x7f0ff80d00f0 2023-07-06T22:01:30.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ffdb12640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8156370 con 0x7f0ff80b1a40 2023-07-06T22:01:30.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ffdb12640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8156650 con 0x7f0ff80b12e0 2023-07-06T22:01:30.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ffd311640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff80d00f0 0x7f0ff8151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:30.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ff7fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ff80b1a40 0x7f0ff8153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:30.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ffcb10640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ff80b12e0 0x7f0ff8155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:30.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ff7fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ff80b1a40 0x7f0ff8153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:41706/0 (socket says 172.21.15.55:41706) 2023-07-06T22:01:30.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ff7fff640 1 -- 172.21.15.55:0/2257489090 learned_addr learned my addr 172.21.15.55:0/2257489090 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:30.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ff7fff640 1 -- 172.21.15.55:0/2257489090 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ff80b12e0 msgr2=0x7f0ff8155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ff7fff640 1 --2- 172.21.15.55:0/2257489090 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ff80b12e0 0x7f0ff8155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ff7fff640 1 -- 172.21.15.55:0/2257489090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff80d00f0 msgr2=0x7f0ff8151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ff7fff640 1 --2- 172.21.15.55:0/2257489090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff80d00f0 0x7f0ff8151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ff7fff640 1 -- 172.21.15.55:0/2257489090 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe4009420 con 0x7f0ff80b1a40 2023-07-06T22:01:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ff7fff640 1 --2- 172.21.15.55:0/2257489090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ff80b1a40 0x7f0ff8153970 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400ebe0 tx=0x7f0fe400c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ff57fa640 1 -- 172.21.15.55:0/2257489090 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe400eee0 con 0x7f0ff80b1a40 2023-07-06T22:01:30.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ff57fa640 1 -- 172.21.15.55:0/2257489090 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe400cc30 con 0x7f0ff80b1a40 2023-07-06T22:01:30.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ff57fa640 1 -- 172.21.15.55:0/2257489090 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4013470 con 0x7f0ff80b1a40 2023-07-06T22:01:30.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ffdb12640 1 -- 172.21.15.55:0/2257489090 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec009420 con 0x7f0ff80b1a40 2023-07-06T22:01:30.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ffdb12640 1 -- 172.21.15.55:0/2257489090 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff8156c10 con 0x7f0ff80b1a40 2023-07-06T22:01:30.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.728+0000 7f0ffdb12640 1 -- 172.21.15.55:0/2257489090 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff80b4050 con 0x7f0ff80b1a40 2023-07-06T22:01:30.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.732+0000 7f0ff57fa640 1 -- 172.21.15.55:0/2257489090 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0fe40135d0 con 0x7f0ff80b1a40 2023-07-06T22:01:30.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.732+0000 7f0ff57fa640 1 --2- 172.21.15.55:0/2257489090 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f0fdc0663a0 0x7f0fdc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:30.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.732+0000 7f0ff57fa640 1 -- 172.21.15.55:0/2257489090 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0fe40842c0 con 0x7f0ff80b1a40 2023-07-06T22:01:30.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.732+0000 7f0ffcb10640 1 --2- 172.21.15.55:0/2257489090 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f0fdc0663a0 0x7f0fdc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:30.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.732+0000 7f0ffcb10640 1 --2- 172.21.15.55:0/2257489090 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f0fdc0663a0 0x7f0fdc068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0ad000 tx=0x7f0fec0a6000 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:30.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.736+0000 7f0ff57fa640 1 -- 172.21.15.55:0/2257489090 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ff80b4050 con 0x7f0ff80b1a40 2023-07-06T22:01:30.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.892+0000 7f0ffdb12640 1 -- 172.21.15.55:0/2257489090 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ff80b4050 con 0x7f0ff80b1a40 2023-07-06T22:01:30.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.896+0000 7f0ff57fa640 1 -- 172.21.15.55:0/2257489090 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+18611 (secure 0 0 0) 0x7f0ff80b4050 con 0x7f0ff80b1a40 2023-07-06T22:01:30.892 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:30.892 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":145,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:01:30.177742+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:01:28.023569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-07-06T22:01:29.170296+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:01:30.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.896+0000 7f0ffdb12640 1 -- 172.21.15.55:0/2257489090 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f0fdc0663a0 msgr2=0x7f0fdc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:30.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.896+0000 7f0ffdb12640 1 --2- 172.21.15.55:0/2257489090 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f0fdc0663a0 0x7f0fdc068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0ad000 tx=0x7f0fec0a6000 comp rx=0 tx=0).stop 2023-07-06T22:01:30.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.896+0000 7f0ffdb12640 1 -- 172.21.15.55:0/2257489090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ff80b1a40 msgr2=0x7f0ff8153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:30.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.896+0000 7f0ffdb12640 1 --2- 172.21.15.55:0/2257489090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ff80b1a40 0x7f0ff8153970 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400ebe0 tx=0x7f0fe400c520 comp rx=0 tx=0).stop 2023-07-06T22:01:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.896+0000 7f0ffdb12640 1 -- 172.21.15.55:0/2257489090 shutdown_connections 2023-07-06T22:01:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.896+0000 7f0ffdb12640 1 --2- 172.21.15.55:0/2257489090 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f0fdc0663a0 0x7f0fdc068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.896+0000 7f0ffdb12640 1 --2- 172.21.15.55:0/2257489090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff80d00f0 0x7f0ff8151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.896+0000 7f0ffdb12640 1 --2- 172.21.15.55:0/2257489090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ff80b1a40 0x7f0ff8153970 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.896+0000 7f0ffdb12640 1 --2- 172.21.15.55:0/2257489090 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ff80b12e0 0x7f0ff8155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.896+0000 7f0ffdb12640 1 -- 172.21.15.55:0/2257489090 >> 172.21.15.55:0/2257489090 conn(0x7f0ff80d20e0 msgr2=0x7f0ff80b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.896+0000 7f0ffdb12640 1 -- 172.21.15.55:0/2257489090 shutdown_connections 2023-07-06T22:01:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:30.896+0000 7f0ffdb12640 1 -- 172.21.15.55:0/2257489090 wait complete. 2023-07-06T22:01:30.913 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T22:01:31.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.064+0000 7fa9dd06d640 1 Processor -- start 2023-07-06T22:01:31.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.064+0000 7fa9dd06d640 1 -- start start 2023-07-06T22:01:31.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.064+0000 7fa9dd06d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa9d806f470 0x7fa9d80c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:31.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.064+0000 7fa9dd06d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d8070370 con 0x7fa9d806ff50 2023-07-06T22:01:31.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.064+0000 7fa9dd06d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d8158550 con 0x7fa9d80c9360 2023-07-06T22:01:31.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.064+0000 7fa9dd06d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d80c9800 con 0x7fa9d806f470 2023-07-06T22:01:31.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.064+0000 7fa9d759e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa9d806ff50 0x7fa9d80cb9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50072/0 (socket says 172.21.15.55:50072) 2023-07-06T22:01:31.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.064+0000 7fa9d759e640 1 -- 172.21.15.55:0/3242775613 learned_addr learned my addr 172.21.15.55:0/3242775613 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:31.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.064+0000 7fa9d6d9d640 1 --2- 172.21.15.55:0/3242775613 >> v2:172.21.15.138:3300/0 conn(0x7fa9d806f470 0x7fa9d80c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:31.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.064+0000 7fa9d659c640 1 -- 172.21.15.55:0/3242775613 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552010394 0 0) 0x7fa9d8070370 con 0x7fa9d806ff50 2023-07-06T22:01:31.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.064+0000 7fa9d659c640 1 -- 172.21.15.55:0/3242775613 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9c4003530 con 0x7fa9d806ff50 2023-07-06T22:01:31.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.064+0000 7fa9d6d9d640 1 -- 172.21.15.55:0/3242775613 >> v1:172.21.15.138:6789/0 conn(0x7fa9d80c9360 legacy=0x7fa9d806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:31.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.064+0000 7fa9d6d9d640 1 -- 172.21.15.55:0/3242775613 >> v1:172.21.15.55:6789/0 conn(0x7fa9d806ff50 legacy=0x7fa9d80cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:31.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.064+0000 7fa9d6d9d640 1 -- 172.21.15.55:0/3242775613 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d80c9ae0 con 0x7fa9d806f470 2023-07-06T22:01:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.068+0000 7fa9d6d9d640 1 --2- 172.21.15.55:0/3242775613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d806f470 0x7fa9d80c8e20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800a960 tx=0x7fa9c801d820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b1e7dc9d159dac server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.068+0000 7fa9d659c640 1 -- 172.21.15.55:0/3242775613 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c80a6850 con 0x7fa9d806f470 2023-07-06T22:01:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.068+0000 7fa9d659c640 1 -- 172.21.15.55:0/3242775613 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c80a69b0 con 0x7fa9d806f470 2023-07-06T22:01:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.068+0000 7fa9d659c640 1 -- 172.21.15.55:0/3242775613 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c80a6d40 con 0x7fa9d806f470 2023-07-06T22:01:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.068+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3242775613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d806f470 msgr2=0x7fa9d80c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.068+0000 7fa9dd06d640 1 --2- 172.21.15.55:0/3242775613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d806f470 0x7fa9d80c8e20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800a960 tx=0x7fa9c801d820 comp rx=0 tx=0).stop 2023-07-06T22:01:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.068+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3242775613 shutdown_connections 2023-07-06T22:01:31.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.068+0000 7fa9dd06d640 1 --2- 172.21.15.55:0/3242775613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d806f470 0x7fa9d80c8e20 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:31.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.068+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3242775613 >> 172.21.15.55:0/3242775613 conn(0x7fa9d80cea70 msgr2=0x7fa9d80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:31.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.068+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3242775613 shutdown_connections 2023-07-06T22:01:31.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.068+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3242775613 wait complete. 2023-07-06T22:01:31.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.068+0000 7fa9dd06d640 1 Processor -- start 2023-07-06T22:01:31.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.068+0000 7fa9dd06d640 1 -- start start 2023-07-06T22:01:31.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9dd06d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d806f470 0x7fa9d80ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:31.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9dd06d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9d806ff50 0x7fa9d815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:31.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9dd06d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d80c9360 0x7fa9d815a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:31.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9dd06d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d80cc620 con 0x7fa9d806f470 2023-07-06T22:01:31.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9dd06d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d80cba50 con 0x7fa9d80c9360 2023-07-06T22:01:31.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9dd06d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d80cbcf0 con 0x7fa9d806ff50 2023-07-06T22:01:31.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9d6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d806f470 0x7fa9d80ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:31.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9d6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d806f470 0x7fa9d80ac810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41756/0 (socket says 172.21.15.55:41756) 2023-07-06T22:01:31.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9d6d9d640 1 -- 172.21.15.55:0/3961334443 learned_addr learned my addr 172.21.15.55:0/3961334443 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:31.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9d759e640 1 --2- 172.21.15.55:0/3961334443 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d80c9360 0x7fa9d815a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:31.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9cffff640 1 --2- 172.21.15.55:0/3961334443 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9d806ff50 0x7fa9d815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:31.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9d6d9d640 1 -- 172.21.15.55:0/3961334443 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9d806ff50 msgr2=0x7fa9d815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:31.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9d6d9d640 1 --2- 172.21.15.55:0/3961334443 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9d806ff50 0x7fa9d815a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:31.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9d6d9d640 1 -- 172.21.15.55:0/3961334443 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d80c9360 msgr2=0x7fa9d815a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9d6d9d640 1 --2- 172.21.15.55:0/3961334443 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d80c9360 0x7fa9d815a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9d6d9d640 1 -- 172.21.15.55:0/3961334443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c800a5c0 con 0x7fa9d806f470 2023-07-06T22:01:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9d6d9d640 1 --2- 172.21.15.55:0/3961334443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d806f470 0x7fa9d80ac810 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fa9c801a430 tx=0x7fa9c801a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9cf7fe640 1 -- 172.21.15.55:0/3961334443 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c80ae850 con 0x7fa9d806f470 2023-07-06T22:01:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9cf7fe640 1 -- 172.21.15.55:0/3961334443 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c80ae9b0 con 0x7fa9d806f470 2023-07-06T22:01:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9cf7fe640 1 -- 172.21.15.55:0/3961334443 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c80aed60 con 0x7fa9d806f470 2023-07-06T22:01:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3961334443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d80cbfd0 con 0x7fa9d806f470 2023-07-06T22:01:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3961334443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d80ccab0 con 0x7fa9d806f470 2023-07-06T22:01:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.072+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3961334443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d8066d60 con 0x7fa9d806f470 2023-07-06T22:01:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.076+0000 7fa9cf7fe640 1 -- 172.21.15.55:0/3961334443 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa9c80b5040 con 0x7fa9d806f470 2023-07-06T22:01:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.076+0000 7fa9cf7fe640 1 --2- 172.21.15.55:0/3961334443 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa9b80663a0 0x7fa9b8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:31.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.076+0000 7fa9cf7fe640 1 -- 172.21.15.55:0/3961334443 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa9c811e520 con 0x7fa9d806f470 2023-07-06T22:01:31.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.076+0000 7fa9cffff640 1 --2- 172.21.15.55:0/3961334443 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa9b80663a0 0x7fa9b8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:31.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.076+0000 7fa9cffff640 1 --2- 172.21.15.55:0/3961334443 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa9b80663a0 0x7fa9b8068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80b38a0 tx=0x7fa9c0009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:31.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.080+0000 7fa9cf7fe640 1 -- 172.21.15.55:0/3961334443 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9c80eb740 con 0x7fa9d806f470 2023-07-06T22:01:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:31.268+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3961334443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa9d80cd240 con 0x7fa9d806f470 2023-07-06T22:01:32.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.204+0000 7fa9cf7fe640 1 -- 172.21.15.55:0/3961334443 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v62) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa9c80eed60 con 0x7fa9d806f470 2023-07-06T22:01:32.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.208+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3961334443 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa9b80663a0 msgr2=0x7fa9b8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:32.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.208+0000 7fa9dd06d640 1 --2- 172.21.15.55:0/3961334443 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa9b80663a0 0x7fa9b8068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80b38a0 tx=0x7fa9c0009040 comp rx=0 tx=0).stop 2023-07-06T22:01:32.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.208+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3961334443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d806f470 msgr2=0x7fa9d80ac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.208+0000 7fa9dd06d640 1 --2- 172.21.15.55:0/3961334443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d806f470 0x7fa9d80ac810 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fa9c801a430 tx=0x7fa9c801a5c0 comp rx=0 tx=0).stop 2023-07-06T22:01:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.208+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3961334443 shutdown_connections 2023-07-06T22:01:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.208+0000 7fa9dd06d640 1 --2- 172.21.15.55:0/3961334443 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fa9b80663a0 0x7fa9b8068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.208+0000 7fa9dd06d640 1 --2- 172.21.15.55:0/3961334443 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d80c9360 0x7fa9d815a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.208+0000 7fa9dd06d640 1 --2- 172.21.15.55:0/3961334443 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9d806ff50 0x7fa9d815a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.208+0000 7fa9dd06d640 1 --2- 172.21.15.55:0/3961334443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d806f470 0x7fa9d80ac810 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.208+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3961334443 >> 172.21.15.55:0/3961334443 conn(0x7fa9d80cea70 msgr2=0x7fa9d80ad050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:32.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.208+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3961334443 shutdown_connections 2023-07-06T22:01:32.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.208+0000 7fa9dd06d640 1 -- 172.21.15.55:0/3961334443 wait complete. 2023-07-06T22:01:32.230 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-06T22:01:32.230 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T22:01:32.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.384+0000 7f97d5ffa640 1 Processor -- start 2023-07-06T22:01:32.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.384+0000 7f97d5ffa640 1 -- start start 2023-07-06T22:01:32.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.384+0000 7f97d5ffa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f97d006fef0 0x7f97d0164820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:32.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.384+0000 7f97d5ffa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d00cc030 con 0x7f97d00709a0 2023-07-06T22:01:32.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.384+0000 7f97d5ffa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d00cc300 con 0x7f97d0070d70 2023-07-06T22:01:32.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.384+0000 7f97d5ffa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d00cc5e0 con 0x7f97d006fef0 2023-07-06T22:01:32.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.388+0000 7f97cf7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f97d00709a0 0x7f97d00cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50082/0 (socket says 172.21.15.55:50082) 2023-07-06T22:01:32.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.388+0000 7f97cf7fe640 1 -- 172.21.15.55:0/2618068180 learned_addr learned my addr 172.21.15.55:0/2618068180 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:32.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.388+0000 7f97cffff640 1 --2- 172.21.15.55:0/2618068180 >> v2:172.21.15.55:3300/0 conn(0x7f97d006fef0 0x7f97d0164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:32.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.388+0000 7f97ce7fc640 1 -- 172.21.15.55:0/2618068180 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986710672 0 0) 0x7f97d00cc030 con 0x7f97d00709a0 2023-07-06T22:01:32.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.388+0000 7f97ce7fc640 1 -- 172.21.15.55:0/2618068180 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b8003530 con 0x7f97d00709a0 2023-07-06T22:01:32.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.388+0000 7f97cffff640 1 -- 172.21.15.55:0/2618068180 >> v1:172.21.15.138:6789/0 conn(0x7f97d0070d70 legacy=0x7f97d00b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:32.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.388+0000 7f97cffff640 1 -- 172.21.15.55:0/2618068180 >> v1:172.21.15.55:6789/0 conn(0x7f97d00709a0 legacy=0x7f97d00cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:32.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.388+0000 7f97cffff640 1 -- 172.21.15.55:0/2618068180 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d00cc8c0 con 0x7f97d006fef0 2023-07-06T22:01:32.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.388+0000 7f97cffff640 1 --2- 172.21.15.55:0/2618068180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97d006fef0 0x7f97d0164820 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009d90 tx=0x7f97c801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857c8ec45311e51f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:32.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.388+0000 7f97ce7fc640 1 -- 172.21.15.55:0/2618068180 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c80a5900 con 0x7f97d006fef0 2023-07-06T22:01:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.388+0000 7f97ce7fc640 1 -- 172.21.15.55:0/2618068180 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c80a5a60 con 0x7f97d006fef0 2023-07-06T22:01:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.388+0000 7f97ce7fc640 1 -- 172.21.15.55:0/2618068180 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c80a5dd0 con 0x7f97d006fef0 2023-07-06T22:01:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 -- 172.21.15.55:0/2618068180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97d006fef0 msgr2=0x7f97d0164820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:32.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 --2- 172.21.15.55:0/2618068180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97d006fef0 0x7f97d0164820 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009d90 tx=0x7f97c801c950 comp rx=0 tx=0).stop 2023-07-06T22:01:32.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 -- 172.21.15.55:0/2618068180 shutdown_connections 2023-07-06T22:01:32.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 --2- 172.21.15.55:0/2618068180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97d006fef0 0x7f97d0164820 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:32.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 -- 172.21.15.55:0/2618068180 >> 172.21.15.55:0/2618068180 conn(0x7f97d00cea70 msgr2=0x7f97d00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:32.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 -- 172.21.15.55:0/2618068180 shutdown_connections 2023-07-06T22:01:32.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 -- 172.21.15.55:0/2618068180 wait complete. 2023-07-06T22:01:32.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 Processor -- start 2023-07-06T22:01:32.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 -- start start 2023-07-06T22:01:32.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97d006fef0 0x7f97d00c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:32.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97d00709a0 0x7f97d0162310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:32.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97d0070d70 0x7f97d015dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:32.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00c9080 con 0x7f97d0070d70 2023-07-06T22:01:32.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00c8440 con 0x7f97d00709a0 2023-07-06T22:01:32.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97d5ffa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00c94a0 con 0x7f97d006fef0 2023-07-06T22:01:32.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97cffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97d0070d70 0x7f97d015dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:32.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97cffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97d0070d70 0x7f97d015dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41776/0 (socket says 172.21.15.55:41776) 2023-07-06T22:01:32.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97cffff640 1 -- 172.21.15.55:0/357026901 learned_addr learned my addr 172.21.15.55:0/357026901 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:32.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97ceffd640 1 --2- 172.21.15.55:0/357026901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97d00709a0 0x7f97d0162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:32.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.392+0000 7f97cf7fe640 1 --2- 172.21.15.55:0/357026901 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97d006fef0 0x7f97d00c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:32.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97cffff640 1 -- 172.21.15.55:0/357026901 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97d006fef0 msgr2=0x7f97d00c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:32.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97cffff640 1 --2- 172.21.15.55:0/357026901 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97d006fef0 0x7f97d00c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:32.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97cffff640 1 -- 172.21.15.55:0/357026901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97d00709a0 msgr2=0x7f97d0162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:32.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97cffff640 1 --2- 172.21.15.55:0/357026901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97d00709a0 0x7f97d0162310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:32.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97cffff640 1 -- 172.21.15.55:0/357026901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c8009a70 con 0x7f97d0070d70 2023-07-06T22:01:32.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97cffff640 1 --2- 172.21.15.55:0/357026901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97d0070d70 0x7f97d015dac0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009d90 tx=0x7f97c80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:32.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97b7fff640 1 -- 172.21.15.55:0/357026901 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c8003db0 con 0x7f97d0070d70 2023-07-06T22:01:32.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97b7fff640 1 -- 172.21.15.55:0/357026901 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c8004040 con 0x7f97d0070d70 2023-07-06T22:01:32.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97d5ffa640 1 -- 172.21.15.55:0/357026901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d00c86e0 con 0x7f97d0070d70 2023-07-06T22:01:32.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97b7fff640 1 -- 172.21.15.55:0/357026901 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c80043f0 con 0x7f97d0070d70 2023-07-06T22:01:32.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97d5ffa640 1 -- 172.21.15.55:0/357026901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d00c8ca0 con 0x7f97d0070d70 2023-07-06T22:01:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97d5ffa640 1 -- 172.21.15.55:0/357026901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d00c91c0 con 0x7f97d0070d70 2023-07-06T22:01:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97b7fff640 1 -- 172.21.15.55:0/357026901 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f97c80b4070 con 0x7f97d0070d70 2023-07-06T22:01:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97b7fff640 1 --2- 172.21.15.55:0/357026901 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f97bc0663a0 0x7f97bc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.396+0000 7f97b7fff640 1 -- 172.21.15.55:0/357026901 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f97c811ee80 con 0x7f97d0070d70 2023-07-06T22:01:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.400+0000 7f97cf7fe640 1 --2- 172.21.15.55:0/357026901 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f97bc0663a0 0x7f97bc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:32.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.400+0000 7f97cf7fe640 1 --2- 172.21.15.55:0/357026901 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f97bc0663a0 0x7f97bc068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f97c00011f0 tx=0x7f97c0009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:32.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.400+0000 7f97b7fff640 1 -- 172.21.15.55:0/357026901 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f97c80ec130 con 0x7f97d0070d70 2023-07-06T22:01:32.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:32.592+0000 7f97d5ffa640 1 -- 172.21.15.55:0/357026901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f97d0066d60 con 0x7f97d0070d70 2023-07-06T22:01:33.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.212+0000 7f97b7fff640 1 -- 172.21.15.55:0/357026901 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v63) v1 ==== 122+0+0 (secure 0 0 0) 0x7f97c80ef750 con 0x7f97d0070d70 2023-07-06T22:01:33.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.216+0000 7f97d5ffa640 1 -- 172.21.15.55:0/357026901 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f97bc0663a0 msgr2=0x7f97bc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:33.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.216+0000 7f97d5ffa640 1 --2- 172.21.15.55:0/357026901 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f97bc0663a0 0x7f97bc068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f97c00011f0 tx=0x7f97c0009040 comp rx=0 tx=0).stop 2023-07-06T22:01:33.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.216+0000 7f97d5ffa640 1 -- 172.21.15.55:0/357026901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97d0070d70 msgr2=0x7f97d015dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:33.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.216+0000 7f97d5ffa640 1 --2- 172.21.15.55:0/357026901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97d0070d70 0x7f97d015dac0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009d90 tx=0x7f97c80196f0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.216+0000 7f97d5ffa640 1 -- 172.21.15.55:0/357026901 shutdown_connections 2023-07-06T22:01:33.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.216+0000 7f97d5ffa640 1 --2- 172.21.15.55:0/357026901 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f97bc0663a0 0x7f97bc068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.216+0000 7f97d5ffa640 1 --2- 172.21.15.55:0/357026901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97d0070d70 0x7f97d015dac0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.216+0000 7f97d5ffa640 1 --2- 172.21.15.55:0/357026901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97d00709a0 0x7f97d0162310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.216+0000 7f97d5ffa640 1 --2- 172.21.15.55:0/357026901 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97d006fef0 0x7f97d00c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.216+0000 7f97d5ffa640 1 -- 172.21.15.55:0/357026901 >> 172.21.15.55:0/357026901 conn(0x7f97d00cea70 msgr2=0x7f97d00ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:33.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.216+0000 7f97d5ffa640 1 -- 172.21.15.55:0/357026901 shutdown_connections 2023-07-06T22:01:33.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.216+0000 7f97d5ffa640 1 -- 172.21.15.55:0/357026901 wait complete. 2023-07-06T22:01:33.236 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T22:01:33.236 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:01:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe67b51f640 1 Processor -- start 2023-07-06T22:01:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe67b51f640 1 -- start start 2023-07-06T22:01:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe67b51f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe67415fd40 0x7fe67406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe67b51f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe674160110 0x7fe67406c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe67b51f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6740ca880 con 0x7fe67406c920 2023-07-06T22:01:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe67b51f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67406cda0 con 0x7fe67415fd40 2023-07-06T22:01:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe67b51f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740c9c90 con 0x7fe674160110 2023-07-06T22:01:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe679abc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe67406c920 0x7fe67415bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40796/0 (socket says 172.21.15.55:40796) 2023-07-06T22:01:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe679abc640 1 -- 172.21.15.55:0/96288101 learned_addr learned my addr 172.21.15.55:0/96288101 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe678aba640 1 --2- 172.21.15.55:0/96288101 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe674160110 0x7fe67406c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe6792bb640 1 --2- 172.21.15.55:0/96288101 >> v2:172.21.15.138:3300/0 conn(0x7fe67415fd40 0x7fe67406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe66bfff640 1 -- 172.21.15.55:0/96288101 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082842839 0 0) 0x7fe6740ca880 con 0x7fe67406c920 2023-07-06T22:01:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe66bfff640 1 -- 172.21.15.55:0/96288101 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe660003530 con 0x7fe67406c920 2023-07-06T22:01:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe66bfff640 1 -- 172.21.15.55:0/96288101 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3131889660 0 0) 0x7fe660003530 con 0x7fe67406c920 2023-07-06T22:01:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe66bfff640 1 -- 172.21.15.55:0/96288101 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe674160110 msgr2=0x7fe67406c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe66bfff640 1 --2- 172.21.15.55:0/96288101 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe674160110 0x7fe67406c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe66bfff640 1 -- 172.21.15.55:0/96288101 >> v2:172.21.15.138:3300/0 conn(0x7fe67415fd40 msgr2=0x7fe67406e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe66bfff640 1 --2- 172.21.15.55:0/96288101 >> v2:172.21.15.138:3300/0 conn(0x7fe67415fd40 0x7fe67406e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe66bfff640 1 -- 172.21.15.55:0/96288101 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6740c9f50 con 0x7fe67406c920 2023-07-06T22:01:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe66bfff640 1 -- 172.21.15.55:0/96288101 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fe66c001a00 con 0x7fe67406c920 2023-07-06T22:01:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.384+0000 7fe66bfff640 1 -- 172.21.15.55:0/96288101 >> v1:172.21.15.55:6789/0 conn(0x7fe67406c920 legacy=0x7fe67415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe66bfff640 1 --2- 172.21.15.55:0/96288101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe660003980 0x7fe660003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe66bfff640 1 --2- 172.21.15.55:0/96288101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6600043b0 0x7fe660004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe66bfff640 1 --2- 172.21.15.55:0/96288101 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe674160110 0x7fe660004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe66bfff640 1 -- 172.21.15.55:0/96288101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67406cda0 con 0x7fe660003980 2023-07-06T22:01:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe66bfff640 1 -- 172.21.15.55:0/96288101 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740c9c90 con 0x7fe6600043b0 2023-07-06T22:01:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe66bfff640 1 -- 172.21.15.55:0/96288101 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66000b990 con 0x7fe674160110 2023-07-06T22:01:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe6792bb640 1 --2- 172.21.15.55:0/96288101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe660003980 0x7fe660003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe679abc640 1 --2- 172.21.15.55:0/96288101 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe674160110 0x7fe660004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe678aba640 1 --2- 172.21.15.55:0/96288101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6600043b0 0x7fe660004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe6792bb640 1 -- 172.21.15.55:0/96288101 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe674160110 msgr2=0x7fe660004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe6792bb640 1 --2- 172.21.15.55:0/96288101 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe674160110 0x7fe660004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe6792bb640 1 -- 172.21.15.55:0/96288101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6600043b0 msgr2=0x7fe660004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe6792bb640 1 --2- 172.21.15.55:0/96288101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6600043b0 0x7fe660004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe6792bb640 1 -- 172.21.15.55:0/96288101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe660003530 con 0x7fe660003980 2023-07-06T22:01:33.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe6792bb640 1 --2- 172.21.15.55:0/96288101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe660003980 0x7fe660003d90 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fe670009ae0 tx=0x7fe67001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c264cce045fd30a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:33.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe66bfff640 1 -- 172.21.15.55:0/96288101 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6700a5630 con 0x7fe660003980 2023-07-06T22:01:33.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe66bfff640 1 -- 172.21.15.55:0/96288101 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6700a5790 con 0x7fe660003980 2023-07-06T22:01:33.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.388+0000 7fe66bfff640 1 -- 172.21.15.55:0/96288101 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6700a5b40 con 0x7fe660003980 2023-07-06T22:01:33.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe67b51f640 1 -- 172.21.15.55:0/96288101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe660003980 msgr2=0x7fe660003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:33.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe67b51f640 1 --2- 172.21.15.55:0/96288101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe660003980 0x7fe660003d90 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fe670009ae0 tx=0x7fe67001ca60 comp rx=0 tx=0).stop 2023-07-06T22:01:33.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe679abc640 1 -- 172.21.15.55:0/96288101 reap_dead start 2023-07-06T22:01:33.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe67b51f640 1 -- 172.21.15.55:0/96288101 shutdown_connections 2023-07-06T22:01:33.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe67b51f640 1 -- 172.21.15.55:0/96288101 >> 172.21.15.55:0/96288101 conn(0x7fe6740b1730 msgr2=0x7fe6740cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:33.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe67b51f640 1 -- 172.21.15.55:0/96288101 shutdown_connections 2023-07-06T22:01:33.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe67b51f640 1 -- 172.21.15.55:0/96288101 wait complete. 2023-07-06T22:01:33.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe67b51f640 1 Processor -- start 2023-07-06T22:01:33.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe67b51f640 1 -- start start 2023-07-06T22:01:33.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe67b51f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe660003980 0x7fe6740c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe67b51f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6740c2fe0 0x7fe674144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe67b51f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe674144fc0 0x7fe6741476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe67b51f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67406aed0 con 0x7fe660003980 2023-07-06T22:01:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe67b51f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67406a250 con 0x7fe674144fc0 2023-07-06T22:01:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe67b51f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67406a530 con 0x7fe6740c2fe0 2023-07-06T22:01:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe6792bb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe660003980 0x7fe6740c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe6792bb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe660003980 0x7fe6740c2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42518/0 (socket says 172.21.15.55:42518) 2023-07-06T22:01:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe6792bb640 1 -- 172.21.15.55:0/792057489 learned_addr learned my addr 172.21.15.55:0/792057489 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe679abc640 1 --2- 172.21.15.55:0/792057489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe674144fc0 0x7fe6741476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.392+0000 7fe678aba640 1 --2- 172.21.15.55:0/792057489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6740c2fe0 0x7fe674144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:33.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.396+0000 7fe6792bb640 1 -- 172.21.15.55:0/792057489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6740c2fe0 msgr2=0x7fe674144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:33.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.396+0000 7fe6792bb640 1 --2- 172.21.15.55:0/792057489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6740c2fe0 0x7fe674144a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.396+0000 7fe6792bb640 1 -- 172.21.15.55:0/792057489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe674144fc0 msgr2=0x7fe6741476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:33.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.396+0000 7fe6792bb640 1 --2- 172.21.15.55:0/792057489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe674144fc0 0x7fe6741476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.396+0000 7fe6792bb640 1 -- 172.21.15.55:0/792057489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67406a810 con 0x7fe660003980 2023-07-06T22:01:33.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.396+0000 7fe6792bb640 1 --2- 172.21.15.55:0/792057489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe660003980 0x7fe6740c2aa0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fe6700b0040 tx=0x7fe660005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:33.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.396+0000 7fe669ffb640 1 -- 172.21.15.55:0/792057489 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6700be070 con 0x7fe660003980 2023-07-06T22:01:33.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.396+0000 7fe669ffb640 1 -- 172.21.15.55:0/792057489 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6700a5900 con 0x7fe660003980 2023-07-06T22:01:33.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.396+0000 7fe669ffb640 1 -- 172.21.15.55:0/792057489 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe670004020 con 0x7fe660003980 2023-07-06T22:01:33.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.396+0000 7fe67b51f640 1 -- 172.21.15.55:0/792057489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67406aaf0 con 0x7fe660003980 2023-07-06T22:01:33.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.396+0000 7fe67b51f640 1 -- 172.21.15.55:0/792057489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe674069fd0 con 0x7fe660003980 2023-07-06T22:01:33.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.396+0000 7fe67b51f640 1 -- 172.21.15.55:0/792057489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe674145390 con 0x7fe660003980 2023-07-06T22:01:33.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.396+0000 7fe669ffb640 1 -- 172.21.15.55:0/792057489 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe6700b4040 con 0x7fe660003980 2023-07-06T22:01:33.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.400+0000 7fe669ffb640 1 --2- 172.21.15.55:0/792057489 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fe6580663d0 0x7fe658068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.400+0000 7fe669ffb640 1 -- 172.21.15.55:0/792057489 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe67011d810 con 0x7fe660003980 2023-07-06T22:01:33.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.400+0000 7fe678aba640 1 --2- 172.21.15.55:0/792057489 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fe6580663d0 0x7fe658068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:33.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.400+0000 7fe678aba640 1 --2- 172.21.15.55:0/792057489 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fe6580663d0 0x7fe658068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6740c4430 tx=0x7fe664009190 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:33.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.404+0000 7fe669ffb640 1 -- 172.21.15.55:0/792057489 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe6700eaa30 con 0x7fe660003980 2023-07-06T22:01:33.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.588+0000 7fe67b51f640 1 -- 172.21.15.55:0/792057489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe674066d60 con 0x7fe660003980 2023-07-06T22:01:33.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.592+0000 7fe669ffb640 1 -- 172.21.15.55:0/792057489 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4670 (secure 0 0 0) 0x7fe6700ee050 con 0x7fe660003980 2023-07-06T22:01:33.588 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:33.589 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/457440874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":457440874},{"type":"v1","addr":"172.21.15.138:6834","nonce":457440874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/446729940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":446729940},{"type":"v1","addr":"172.21.15.55:6835","nonce":446729940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9189,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/742646154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":742646154},{"type":"v1","addr":"172.21.15.138:6835","nonce":742646154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:01:30.178097+0000","modified":"2023-07-06T22:01:33.205176+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9198":{"gid":9198,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/4072042723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":4072042723},{"type":"v1","addr":"172.21.15.55:6837","nonce":4072042723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-06T22:01:33.589 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 63 2023-07-06T22:01:33.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.592+0000 7fe67b51f640 1 -- 172.21.15.55:0/792057489 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fe6580663d0 msgr2=0x7fe658068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:33.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.592+0000 7fe67b51f640 1 --2- 172.21.15.55:0/792057489 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fe6580663d0 0x7fe658068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6740c4430 tx=0x7fe664009190 comp rx=0 tx=0).stop 2023-07-06T22:01:33.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.592+0000 7fe67b51f640 1 -- 172.21.15.55:0/792057489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe660003980 msgr2=0x7fe6740c2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:33.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.592+0000 7fe67b51f640 1 --2- 172.21.15.55:0/792057489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe660003980 0x7fe6740c2aa0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fe6700b0040 tx=0x7fe660005800 comp rx=0 tx=0).stop 2023-07-06T22:01:33.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.592+0000 7fe67b51f640 1 -- 172.21.15.55:0/792057489 shutdown_connections 2023-07-06T22:01:33.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.592+0000 7fe67b51f640 1 --2- 172.21.15.55:0/792057489 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fe6580663d0 0x7fe658068880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.592+0000 7fe67b51f640 1 --2- 172.21.15.55:0/792057489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe674144fc0 0x7fe6741476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.592+0000 7fe67b51f640 1 --2- 172.21.15.55:0/792057489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe6740c2fe0 0x7fe674144a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.592+0000 7fe67b51f640 1 --2- 172.21.15.55:0/792057489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe660003980 0x7fe6740c2aa0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.592+0000 7fe67b51f640 1 -- 172.21.15.55:0/792057489 >> 172.21.15.55:0/792057489 conn(0x7fe6740b1730 msgr2=0x7fe67415d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:33.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.592+0000 7fe67b51f640 1 -- 172.21.15.55:0/792057489 shutdown_connections 2023-07-06T22:01:33.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.592+0000 7fe67b51f640 1 -- 172.21.15.55:0/792057489 wait complete. 2023-07-06T22:01:33.609 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:01:33.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fd6e5c640 1 Processor -- start 2023-07-06T22:01:33.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fd6e5c640 1 -- start start 2023-07-06T22:01:33.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fd6e5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fd00ca450 0x7f0fd006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fd6e5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0fd00b3730 0x7f0fd015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fd6e5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd0159cd0 con 0x7f0fd00712f0 2023-07-06T22:01:33.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fd6e5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd00693f0 con 0x7f0fd00b3730 2023-07-06T22:01:33.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fd6e5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd006aca0 con 0x7f0fd00ca450 2023-07-06T22:01:33.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fd4bf8640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0fd00712f0 0x7f0fd00c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40804/0 (socket says 172.21.15.55:40804) 2023-07-06T22:01:33.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fd4bf8640 1 -- 172.21.15.55:0/3747117094 learned_addr learned my addr 172.21.15.55:0/3747117094 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:33.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fd53f9640 1 --2- 172.21.15.55:0/3747117094 >> v2:172.21.15.55:3300/0 conn(0x7f0fd00b3730 0x7f0fd015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:33.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fcffff640 1 --2- 172.21.15.55:0/3747117094 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fd00ca450 0x7f0fd006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:33.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fcf7fe640 1 -- 172.21.15.55:0/3747117094 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292769931 0 0) 0x7f0fd0159cd0 con 0x7f0fd00712f0 2023-07-06T22:01:33.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fcf7fe640 1 -- 172.21.15.55:0/3747117094 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc0003530 con 0x7f0fd00712f0 2023-07-06T22:01:33.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fd53f9640 1 -- 172.21.15.55:0/3747117094 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fd00ca450 msgr2=0x7f0fd006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:33.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fd53f9640 1 --2- 172.21.15.55:0/3747117094 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fd00ca450 0x7f0fd006a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fd53f9640 1 -- 172.21.15.55:0/3747117094 >> v1:172.21.15.55:6789/0 conn(0x7f0fd00712f0 legacy=0x7f0fd00c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:33.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.756+0000 7f0fd53f9640 1 -- 172.21.15.55:0/3747117094 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd00696b0 con 0x7f0fd00b3730 2023-07-06T22:01:33.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.760+0000 7f0fd53f9640 1 --2- 172.21.15.55:0/3747117094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fd00b3730 0x7f0fd015d3e0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009d90 tx=0x7f0fc801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8179c70ebe1559e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:33.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.760+0000 7f0fcf7fe640 1 -- 172.21.15.55:0/3747117094 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80a59e0 con 0x7f0fd00b3730 2023-07-06T22:01:33.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.760+0000 7f0fcf7fe640 1 -- 172.21.15.55:0/3747117094 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc80a5b40 con 0x7f0fd00b3730 2023-07-06T22:01:33.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.760+0000 7f0fcf7fe640 1 -- 172.21.15.55:0/3747117094 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80ad440 con 0x7f0fd00b3730 2023-07-06T22:01:33.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.760+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/3747117094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fd00b3730 msgr2=0x7f0fd015d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:33.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.760+0000 7f0fd6e5c640 1 --2- 172.21.15.55:0/3747117094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fd00b3730 0x7f0fd015d3e0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009d90 tx=0x7f0fc801c920 comp rx=0 tx=0).stop 2023-07-06T22:01:33.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.760+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/3747117094 shutdown_connections 2023-07-06T22:01:33.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.760+0000 7f0fd6e5c640 1 --2- 172.21.15.55:0/3747117094 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fd00ca450 0x7f0fd006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.760+0000 7f0fd6e5c640 1 --2- 172.21.15.55:0/3747117094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fd00b3730 0x7f0fd015d3e0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.760+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/3747117094 >> 172.21.15.55:0/3747117094 conn(0x7f0fd00cded0 msgr2=0x7f0fd00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:33.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.760+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/3747117094 shutdown_connections 2023-07-06T22:01:33.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.760+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/3747117094 wait complete. 2023-07-06T22:01:33.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fd6e5c640 1 Processor -- start 2023-07-06T22:01:33.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fd6e5c640 1 -- start start 2023-07-06T22:01:33.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fd6e5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fd00712f0 0x7f0fd0158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fd6e5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fd00b3730 0x7f0fd0158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fd6e5c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fd00ca450 0x7f0fd00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fd6e5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0157b80 con 0x7f0fd00b3730 2023-07-06T22:01:33.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fd6e5c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0156f70 con 0x7f0fd00ca450 2023-07-06T22:01:33.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fd6e5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0157250 con 0x7f0fd00712f0 2023-07-06T22:01:33.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fcffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fd00b3730 0x7f0fd0158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:33.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fcffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fd00b3730 0x7f0fd0158010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42546/0 (socket says 172.21.15.55:42546) 2023-07-06T22:01:33.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fcffff640 1 -- 172.21.15.55:0/1820144098 learned_addr learned my addr 172.21.15.55:0/1820144098 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:33.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fcffff640 1 -- 172.21.15.55:0/1820144098 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fd00712f0 msgr2=0x7f0fd0158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:33.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fcffff640 1 --2- 172.21.15.55:0/1820144098 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fd00712f0 0x7f0fd0158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fcffff640 1 -- 172.21.15.55:0/1820144098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fd00ca450 msgr2=0x7f0fd00ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:33.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fcffff640 1 --2- 172.21.15.55:0/1820144098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fd00ca450 0x7f0fd00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fcffff640 1 -- 172.21.15.55:0/1820144098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc8009a70 con 0x7f0fd00b3730 2023-07-06T22:01:33.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fcffff640 1 --2- 172.21.15.55:0/1820144098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fd00b3730 0x7f0fd0158010 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00d7d0 tx=0x7f0fbc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:33.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fcd7fa640 1 -- 172.21.15.55:0/1820144098 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc00b6c0 con 0x7f0fd00b3730 2023-07-06T22:01:33.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fcd7fa640 1 -- 172.21.15.55:0/1820144098 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc00b820 con 0x7f0fd00b3730 2023-07-06T22:01:33.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fcd7fa640 1 -- 172.21.15.55:0/1820144098 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc00bbb0 con 0x7f0fd00b3730 2023-07-06T22:01:33.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/1820144098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd0157530 con 0x7f0fd00b3730 2023-07-06T22:01:33.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/1820144098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd0159460 con 0x7f0fd00b3730 2023-07-06T22:01:33.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.764+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/1820144098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd0066d60 con 0x7f0fd00b3730 2023-07-06T22:01:33.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.768+0000 7f0fcd7fa640 1 -- 172.21.15.55:0/1820144098 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0fbc00bd10 con 0x7f0fd00b3730 2023-07-06T22:01:33.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.768+0000 7f0fcd7fa640 1 --2- 172.21.15.55:0/1820144098 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f0fb40663a0 0x7f0fb4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:33.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.768+0000 7f0fcd7fa640 1 -- 172.21.15.55:0/1820144098 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0fbc084580 con 0x7f0fd00b3730 2023-07-06T22:01:33.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.768+0000 7f0fd4bf8640 1 --2- 172.21.15.55:0/1820144098 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f0fb40663a0 0x7f0fb4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:33.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.768+0000 7f0fd4bf8640 1 --2- 172.21.15.55:0/1820144098 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f0fb40663a0 0x7f0fb4068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4007fd0 tx=0x7f0fc4007940 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:33.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.772+0000 7f0fcd7fa640 1 -- 172.21.15.55:0/1820144098 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0fbc0516f0 con 0x7f0fd00b3730 2023-07-06T22:01:33.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.928+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/1820144098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fd0157cc0 con 0x7f0fd00b3730 2023-07-06T22:01:33.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.928+0000 7f0fcd7fa640 1 -- 172.21.15.55:0/1820144098 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+18598 (secure 0 0 0) 0x7f0fd0157cc0 con 0x7f0fd00b3730 2023-07-06T22:01:33.928 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:33.928 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":146,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:01:31.180264+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:01:28.023569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-07-06T22:01:29.170296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:01:33.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.932+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/1820144098 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f0fb40663a0 msgr2=0x7f0fb4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:33.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.932+0000 7f0fd6e5c640 1 --2- 172.21.15.55:0/1820144098 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f0fb40663a0 0x7f0fb4068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4007fd0 tx=0x7f0fc4007940 comp rx=0 tx=0).stop 2023-07-06T22:01:33.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.932+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/1820144098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fd00b3730 msgr2=0x7f0fd0158010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:33.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.932+0000 7f0fd6e5c640 1 --2- 172.21.15.55:0/1820144098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fd00b3730 0x7f0fd0158010 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00d7d0 tx=0x7f0fbc00dc90 comp rx=0 tx=0).stop 2023-07-06T22:01:33.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.932+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/1820144098 shutdown_connections 2023-07-06T22:01:33.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.932+0000 7f0fd6e5c640 1 --2- 172.21.15.55:0/1820144098 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f0fb40663a0 0x7f0fb4068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.932+0000 7f0fd6e5c640 1 --2- 172.21.15.55:0/1820144098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fd00ca450 0x7f0fd00ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.932+0000 7f0fd6e5c640 1 --2- 172.21.15.55:0/1820144098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fd00b3730 0x7f0fd0158010 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.932+0000 7f0fd6e5c640 1 --2- 172.21.15.55:0/1820144098 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fd00712f0 0x7f0fd0158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.932+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/1820144098 >> 172.21.15.55:0/1820144098 conn(0x7f0fd00cded0 msgr2=0x7f0fd00c9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.932+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/1820144098 shutdown_connections 2023-07-06T22:01:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:33.932+0000 7f0fd6e5c640 1 -- 172.21.15.55:0/1820144098 wait complete. 2023-07-06T22:01:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T22:01:33.949 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:01:34.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.092+0000 7f314719f640 1 Processor -- start 2023-07-06T22:01:34.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.092+0000 7f314719f640 1 -- start start 2023-07-06T22:01:34.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f314719f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3140160030 0x7f3140070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f314719f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31400cda40 0x7f31400cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f314719f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314006bd00 con 0x7f3140071050 2023-07-06T22:01:34.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f314719f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3140160400 con 0x7f3140160030 2023-07-06T22:01:34.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f314719f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3140071540 con 0x7f31400cda40 2023-07-06T22:01:34.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3140071050 0x7f31400cd330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40814/0 (socket says 172.21.15.55:40814) 2023-07-06T22:01:34.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313ffff640 1 -- 172.21.15.55:0/2240815775 learned_addr learned my addr 172.21.15.55:0/2240815775 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:34.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f314573c640 1 --2- 172.21.15.55:0/2240815775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31400cda40 0x7f31400cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f3144f3b640 1 --2- 172.21.15.55:0/2240815775 >> v2:172.21.15.138:3300/0 conn(0x7f3140160030 0x7f3140070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 -- 172.21.15.55:0/2240815775 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435484508 0 0) 0x7f314006bd00 con 0x7f3140071050 2023-07-06T22:01:34.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 -- 172.21.15.55:0/2240815775 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3130003530 con 0x7f3140071050 2023-07-06T22:01:34.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 -- 172.21.15.55:0/2240815775 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3089826243 0 0) 0x7f3130003530 con 0x7f3140071050 2023-07-06T22:01:34.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 -- 172.21.15.55:0/2240815775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31400cda40 msgr2=0x7f31400cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:34.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 --2- 172.21.15.55:0/2240815775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31400cda40 0x7f31400cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 -- 172.21.15.55:0/2240815775 >> v2:172.21.15.138:3300/0 conn(0x7f3140160030 msgr2=0x7f3140070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:34.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 --2- 172.21.15.55:0/2240815775 >> v2:172.21.15.138:3300/0 conn(0x7f3140160030 0x7f3140070b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 -- 172.21.15.55:0/2240815775 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31400c9ba0 con 0x7f3140071050 2023-07-06T22:01:34.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 -- 172.21.15.55:0/2240815775 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f312c001680 con 0x7f3140071050 2023-07-06T22:01:34.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 -- 172.21.15.55:0/2240815775 >> v1:172.21.15.55:6789/0 conn(0x7f3140071050 legacy=0x7f31400cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 --2- 172.21.15.55:0/2240815775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31400cda40 0x7f3130003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 --2- 172.21.15.55:0/2240815775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3130003f00 0x7f31300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 --2- 172.21.15.55:0/2240815775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3130004d10 0x7f3130005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 -- 172.21.15.55:0/2240815775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3140160400 con 0x7f3130004d10 2023-07-06T22:01:34.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 -- 172.21.15.55:0/2240815775 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3140071540 con 0x7f3130003f00 2023-07-06T22:01:34.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313f7fe640 1 -- 172.21.15.55:0/2240815775 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313000b990 con 0x7f31400cda40 2023-07-06T22:01:34.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f314573c640 1 --2- 172.21.15.55:0/2240815775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3130004d10 0x7f3130005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f3144f3b640 1 --2- 172.21.15.55:0/2240815775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31400cda40 0x7f3130003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313ffff640 1 --2- 172.21.15.55:0/2240815775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3130003f00 0x7f31300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f314573c640 1 -- 172.21.15.55:0/2240815775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31400cda40 msgr2=0x7f3130003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:34.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f314573c640 1 --2- 172.21.15.55:0/2240815775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31400cda40 0x7f3130003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f314573c640 1 -- 172.21.15.55:0/2240815775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3130003f00 msgr2=0x7f31300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:34.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f314573c640 1 --2- 172.21.15.55:0/2240815775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3130003f00 0x7f31300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f314573c640 1 -- 172.21.15.55:0/2240815775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3130003530 con 0x7f3130004d10 2023-07-06T22:01:34.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.096+0000 7f313ffff640 1 --2- 172.21.15.55:0/2240815775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3130003f00 0x7f31300047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:34.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.100+0000 7f314573c640 1 --2- 172.21.15.55:0/2240815775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3130004d10 0x7f3130005180 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f31400ad920 tx=0x7f313801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1645f6323d7055c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:34.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.100+0000 7f313f7fe640 1 -- 172.21.15.55:0/2240815775 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31380a5c10 con 0x7f3130004d10 2023-07-06T22:01:34.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.100+0000 7f313f7fe640 1 -- 172.21.15.55:0/2240815775 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313800f040 con 0x7f3130004d10 2023-07-06T22:01:34.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.100+0000 7f313f7fe640 1 -- 172.21.15.55:0/2240815775 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31380ad440 con 0x7f3130004d10 2023-07-06T22:01:34.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.100+0000 7f314719f640 1 -- 172.21.15.55:0/2240815775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3130004d10 msgr2=0x7f3130005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.100+0000 7f314719f640 1 --2- 172.21.15.55:0/2240815775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3130004d10 0x7f3130005180 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f31400ad920 tx=0x7f313801cc00 comp rx=0 tx=0).stop 2023-07-06T22:01:34.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.100+0000 7f314573c640 1 -- 172.21.15.55:0/2240815775 reap_dead start 2023-07-06T22:01:34.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.100+0000 7f314719f640 1 -- 172.21.15.55:0/2240815775 shutdown_connections 2023-07-06T22:01:34.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.100+0000 7f314719f640 1 -- 172.21.15.55:0/2240815775 >> 172.21.15.55:0/2240815775 conn(0x7f31400cded0 msgr2=0x7f31400ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:34.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.100+0000 7f314719f640 1 -- 172.21.15.55:0/2240815775 shutdown_connections 2023-07-06T22:01:34.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.100+0000 7f314719f640 1 -- 172.21.15.55:0/2240815775 wait complete. 2023-07-06T22:01:34.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f314719f640 1 Processor -- start 2023-07-06T22:01:34.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f314719f640 1 -- start start 2023-07-06T22:01:34.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f314719f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3130004d10 0x7f3140160d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f314719f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3140163120 0x7f314015ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f314719f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31400c58d0 0x7f31400693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f314719f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314015d3b0 con 0x7f3140163120 2023-07-06T22:01:34.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f314719f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3140163590 con 0x7f3130004d10 2023-07-06T22:01:34.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f314719f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3140161430 con 0x7f31400c58d0 2023-07-06T22:01:34.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f313ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3140163120 0x7f314015ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f313ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3140163120 0x7f314015ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42554/0 (socket says 172.21.15.55:42554) 2023-07-06T22:01:34.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f313ffff640 1 -- 172.21.15.55:0/2919183686 learned_addr learned my addr 172.21.15.55:0/2919183686 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:34.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f3144f3b640 1 --2- 172.21.15.55:0/2919183686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3130004d10 0x7f3140160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f314573c640 1 --2- 172.21.15.55:0/2919183686 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31400c58d0 0x7f31400693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f313ffff640 1 -- 172.21.15.55:0/2919183686 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31400c58d0 msgr2=0x7f31400693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f313ffff640 1 --2- 172.21.15.55:0/2919183686 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31400c58d0 0x7f31400693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f313ffff640 1 -- 172.21.15.55:0/2919183686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3130004d10 msgr2=0x7f3140160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f313ffff640 1 --2- 172.21.15.55:0/2919183686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3130004d10 0x7f3140160d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f313ffff640 1 -- 172.21.15.55:0/2919183686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3140161710 con 0x7f3140163120 2023-07-06T22:01:34.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f313ffff640 1 --2- 172.21.15.55:0/2919183686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3140163120 0x7f314015ce70 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f312c00e880 tx=0x7f312c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:34.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f313d7fa640 1 -- 172.21.15.55:0/2919183686 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c00ee70 con 0x7f3140163120 2023-07-06T22:01:34.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f313d7fa640 1 -- 172.21.15.55:0/2919183686 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312c00c8d0 con 0x7f3140163120 2023-07-06T22:01:34.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f314719f640 1 -- 172.21.15.55:0/2919183686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31400c50d0 con 0x7f3140163120 2023-07-06T22:01:34.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f313d7fa640 1 -- 172.21.15.55:0/2919183686 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c00cc40 con 0x7f3140163120 2023-07-06T22:01:34.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.104+0000 7f314719f640 1 -- 172.21.15.55:0/2919183686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31401619f0 con 0x7f3140163120 2023-07-06T22:01:34.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.108+0000 7f314719f640 1 -- 172.21.15.55:0/2919183686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3140066d60 con 0x7f3140163120 2023-07-06T22:01:34.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.108+0000 7f313d7fa640 1 -- 172.21.15.55:0/2919183686 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f312c01d460 con 0x7f3140163120 2023-07-06T22:01:34.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.108+0000 7f313d7fa640 1 --2- 172.21.15.55:0/2919183686 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f31240663d0 0x7f3124068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.108+0000 7f313d7fa640 1 -- 172.21.15.55:0/2919183686 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f312c083f40 con 0x7f3140163120 2023-07-06T22:01:34.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.108+0000 7f3144f3b640 1 --2- 172.21.15.55:0/2919183686 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f31240663d0 0x7f3124068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.108+0000 7f3144f3b640 1 --2- 172.21.15.55:0/2919183686 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f31240663d0 0x7f3124068880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3140160740 tx=0x7f3134009190 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:34.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.112+0000 7f313d7fa640 1 -- 172.21.15.55:0/2919183686 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f312c054bd0 con 0x7f3140163120 2023-07-06T22:01:34.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.264+0000 7f314719f640 1 -- 172.21.15.55:0/2919183686 --> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31400c9dd0 con 0x7f31240663d0 2023-07-06T22:01:34.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.276+0000 7f313d7fa640 1 -- 172.21.15.55:0/2919183686 <== mgr.8940 v2:172.21.15.55:6832/206120108 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296329 (secure 0 0 0) 0x7f3134019070 con 0x7f31240663d0 2023-07-06T22:01:34.275 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:34.276 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:01:34.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.280+0000 7f314719f640 1 -- 172.21.15.55:0/2919183686 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f31240663d0 msgr2=0x7f3124068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.280+0000 7f314719f640 1 --2- 172.21.15.55:0/2919183686 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f31240663d0 0x7f3124068880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3140160740 tx=0x7f3134009190 comp rx=0 tx=0).stop 2023-07-06T22:01:34.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.280+0000 7f314719f640 1 -- 172.21.15.55:0/2919183686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3140163120 msgr2=0x7f314015ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.280+0000 7f314719f640 1 --2- 172.21.15.55:0/2919183686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3140163120 0x7f314015ce70 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f312c00e880 tx=0x7f312c00ec80 comp rx=0 tx=0).stop 2023-07-06T22:01:34.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.280+0000 7f314719f640 1 -- 172.21.15.55:0/2919183686 shutdown_connections 2023-07-06T22:01:34.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.280+0000 7f314719f640 1 --2- 172.21.15.55:0/2919183686 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f31240663d0 0x7f3124068880 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.280+0000 7f314719f640 1 --2- 172.21.15.55:0/2919183686 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31400c58d0 0x7f31400693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.280+0000 7f314719f640 1 --2- 172.21.15.55:0/2919183686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3140163120 0x7f314015ce70 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.280+0000 7f314719f640 1 --2- 172.21.15.55:0/2919183686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3130004d10 0x7f3140160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.280+0000 7f314719f640 1 -- 172.21.15.55:0/2919183686 >> 172.21.15.55:0/2919183686 conn(0x7f31400cded0 msgr2=0x7f31401639a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.280+0000 7f314719f640 1 -- 172.21.15.55:0/2919183686 shutdown_connections 2023-07-06T22:01:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.280+0000 7f314719f640 1 -- 172.21.15.55:0/2919183686 wait complete. 2023-07-06T22:01:34.295 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-06T22:01:33.141664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":346144,"kb_used_data":14944,"kb_used_omap":0,"kb_used_meta":331136,"kb_avail":754628576,"statfs":{"total":773094113280,"available":772739661824,"internally_reserved":0,"allocated":15302656,"data_stored":8672778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339083264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.383270"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"133'249","reported_seq":878,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:25.867506+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:01:25.867506+0000","last_peered":"2023-07-06T22:01:25.867506+0000","last_clean":"2023-07-06T22:01:25.867506+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:01:25.867506+0000","last_undegraded":"2023-07-06T22:01:25.867506+0000","last_fullsized":"2023-07-06T22:01:25.867506+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:19:41.822283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":224,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.505555+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:01:26.505555+0000","last_peered":"2023-07-06T22:01:26.505555+0000","last_clean":"2023-07-06T22:01:26.505555+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:01:26.505555+0000","last_undegraded":"2023-07-06T22:01:26.505555+0000","last_fullsized":"2023-07-06T22:01:26.505555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:02:38.381204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":254,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:25.867495+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:01:25.867495+0000","last_peered":"2023-07-06T22:01:25.867495+0000","last_clean":"2023-07-06T22:01:25.867495+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:01:25.867495+0000","last_undegraded":"2023-07-06T22:01:25.867495+0000","last_fullsized":"2023-07-06T22:01:25.867495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:13:57.758766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":258,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.481793+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:01:26.481793+0000","last_peered":"2023-07-06T22:01:26.481793+0000","last_clean":"2023-07-06T22:01:26.481793+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:01:26.481793+0000","last_undegraded":"2023-07-06T22:01:26.481793+0000","last_fullsized":"2023-07-06T22:01:26.481793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:14:50.991549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":224,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.505560+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:01:26.505560+0000","last_peered":"2023-07-06T22:01:26.505560+0000","last_clean":"2023-07-06T22:01:26.505560+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:01:26.505560+0000","last_undegraded":"2023-07-06T22:01:26.505560+0000","last_fullsized":"2023-07-06T22:01:26.505560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:26:37.062116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.505329+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:01:26.505329+0000","last_peered":"2023-07-06T22:01:26.505329+0000","last_clean":"2023-07-06T22:01:26.505329+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:01:26.505329+0000","last_undegraded":"2023-07-06T22:01:26.505329+0000","last_fullsized":"2023-07-06T22:01:26.505329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:31:20.994498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":254,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:25.867504+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:01:25.867504+0000","last_peered":"2023-07-06T22:01:25.867504+0000","last_clean":"2023-07-06T22:01:25.867504+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:01:25.867504+0000","last_undegraded":"2023-07-06T22:01:25.867504+0000","last_fullsized":"2023-07-06T22:01:25.867504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:45:57.358902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.505331+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:01:26.505331+0000","last_peered":"2023-07-06T22:01:26.505331+0000","last_clean":"2023-07-06T22:01:26.505331+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:01:26.505331+0000","last_undegraded":"2023-07-06T22:01:26.505331+0000","last_fullsized":"2023-07-06T22:01:26.505331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:57:39.813107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":223,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.215792+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:01:26.215792+0000","last_peered":"2023-07-06T22:01:26.215792+0000","last_clean":"2023-07-06T22:01:26.215792+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:01:26.215792+0000","last_undegraded":"2023-07-06T22:01:26.215792+0000","last_fullsized":"2023-07-06T22:01:26.215792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:33:37.649803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575080,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37448,"kb_used_data":2304,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334392,"statfs":{"total":96636764160,"available":96598417408,"internally_reserved":0,"allocated":2359296,"data_stored":1527128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71299999999999997,"15min":0.70399999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.70699999999999996},"min":{"1min":0.48399999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.90400000000000003}]},{"osd":1,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73099999999999998,"15min":0.71699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.42799999999999999,"15min":0.377},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74099999999999999,"15min":0.73199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.42599999999999999},"max":{"1min":1.3360000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.85999999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73899999999999999,"15min":0.72099999999999997},"min":{"1min":0.52500000000000002,"5min":0.52100000000000002,"15min":0.42199999999999999},"max":{"1min":1.2749999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.228,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56799999999999995,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.32700000000000001},"max":{"1min":0.76100000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.40899999999999997,"5min":0.39400000000000002,"15min":0.35699999999999998},"max":{"1min":0.95599999999999996,"5min":1.169,"15min":1.169},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.503},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.61299999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.51300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.95799999999999996,"5min":1.45,"15min":1.45},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.41699999999999998},"max":{"1min":0.98599999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.56200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834575080,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36864,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334976,"statfs":{"total":96636764160,"available":96599015424,"internally_reserved":0,"allocated":1761280,"data_stored":935741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.47,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.38500000000000001},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.749},"min":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.5349999999999999,"5min":1.778,"15min":1.778},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.503,"5min":0.46200000000000002,"15min":0.45800000000000002},"max":{"1min":1.506,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.442},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72099999999999997,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65500000000000003,"5min":0.95399999999999996,"15min":1.4390000000000001},"last":0.629},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.77500000000000002,"5min":0.94099999999999995,"15min":1.0509999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60799999999999998,"15min":0.622},"min":{"1min":0.442,"5min":0.42099999999999999,"15min":0.38600000000000001},"max":{"1min":0.69799999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77500000000000002,"5min":1.0009999999999999,"15min":1.3089999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.74299999999999999,"5min":1.0029999999999999,"15min":1.2549999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76900000000000002,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.85399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54916,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316924,"statfs":{"total":96636764160,"available":96580530176,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.747,"15min":0.72399999999999998},"min":{"1min":0.52200000000000002,"5min":0.44800000000000001,"15min":0.36699999999999999},"max":{"1min":1.282,"5min":1.49,"15min":1.49},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.45400000000000001,"15min":0.35299999999999998},"max":{"1min":1.0900000000000001,"5min":1.21,"15min":1.21},"last":0.93899999999999995}]},{"osd":1,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.40200000000000002},"max":{"1min":0.98799999999999999,"5min":1.143,"15min":1.143},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.38600000000000001},"max":{"1min":0.96899999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76800000000000002,"15min":0.753},"min":{"1min":0.56699999999999995,"5min":0.498,"15min":0.39900000000000002},"max":{"1min":1.264,"5min":1.5,"15min":1.5},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":1.163,"15min":1.163},"last":0.85699999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.505,"5min":0.48399999999999999,"15min":0.443},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.52600000000000002,"5min":0.51200000000000001,"15min":0.48599999999999999},"max":{"1min":1.0169999999999999,"5min":1.109,"15min":1.109},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.59299999999999997},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.371},"max":{"1min":0.871,"5min":0.88400000000000001,"15min":1.02},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60699999999999998,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.40100000000000002,"15min":0.34999999999999998},"max":{"1min":0.83699999999999997,"5min":0.90200000000000002,"15min":1.004},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63300000000000001,"15min":0.61899999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.34100000000000003},"max":{"1min":0.93799999999999994,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.95299999999999996,"15min":1.0589999999999999},"last":0.98499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32772,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.752,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.46200000000000002,"15min":0.45000000000000001},"max":{"1min":1.2250000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.72699999999999998,"15min":0.72399999999999998},"min":{"1min":0.56899999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.74199999999999999,"15min":0.72199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":1.258,"5min":1.996,"15min":1.996},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.748,"15min":0.748},"min":{"1min":0.47499999999999998,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.75,"15min":0.73499999999999999},"min":{"1min":0.49099999999999999,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":1.1890000000000001,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.74299999999999999,"15min":0.755},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":3.2269999999999999},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.308},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.94299999999999995},"last":0.75},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.80800000000000005,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.627}]},{"osd":6,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.60899999999999999},"min":{"1min":0.36699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86499999999999999,"5min":1.036,"15min":1.036},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.34799999999999998},"max":{"1min":0.89500000000000002,"5min":1,"15min":1},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68000000000000005,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.877,"5min":1.0149999999999999,"15min":1.0720000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70299999999999996,"15min":0.67000000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.41599999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.01},"last":0.73399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575079,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50820,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321020,"statfs":{"total":96636764160,"available":96584724480,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42899999999999999,"15min":0.44800000000000001},"min":{"1min":0.316,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57299999999999995,"5min":0.65600000000000003,"15min":1.0489999999999999},"last":0.375},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.49299999999999999,"15min":0.53100000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68899999999999995,"5min":0.76000000000000001,"15min":2.77},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45600000000000002,"15min":0.48699999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.24299999999999999},"max":{"1min":0.71799999999999997,"5min":0.88800000000000001,"15min":2.4359999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54500000000000004,"15min":0.57799999999999996},"min":{"1min":0.40300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.64500000000000002,"5min":0.97799999999999998,"15min":1.351},"last":0.433}]},{"osd":2,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.53000000000000003},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72299999999999998,"5min":0.79900000000000004,"15min":0.90100000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74099999999999999,"5min":0.86799999999999999,"15min":1.24},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.72599999999999998,"15min":0.75600000000000001},"min":{"1min":0.46000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94099999999999995,"5min":1.1930000000000001,"15min":1.3009999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.73399999999999999,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.383,"15min":1.383},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.79900000000000004},"min":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.4199999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.395,"5min":1.395,"15min":1.3999999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.751,"15min":0.79100000000000004},"min":{"1min":0.50600000000000001,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.371,"5min":1.371,"15min":1.425},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76400000000000001,"15min":0.80200000000000005},"min":{"1min":0.54900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.091,"5min":1.419,"15min":3.1739999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.745,"15min":0.79900000000000004},"min":{"1min":0.54200000000000004,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":0.996,"5min":1.2150000000000001,"15min":3.097},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.47099999999999997,"15min":0.45900000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.66800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.68600000000000005,"5min":0.79200000000000004,"15min":0.85999999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.47399999999999998,"15min":0.497},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.67800000000000005,"5min":0.82199999999999995,"15min":0.85999999999999999},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.61199999999999999,"5min":0.878,"15min":0.88200000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.83499999999999996,"15min":0.94399999999999995},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71199999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55900000000000005,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.71799999999999997,"5min":0.85599999999999998,"15min":0.95399999999999996},"last":0.504}]},{"osd":4,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.42899999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.79000000000000004,"15min":0.80400000000000005},"min":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.41399999999999998},"max":{"1min":1.1459999999999999,"5min":1.591,"15min":1.591},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.54800000000000004,"5min":0.52200000000000002,"15min":0.42899999999999999},"max":{"1min":1.26,"5min":1.333,"15min":1.333},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78900000000000003,"15min":0.81100000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":1.28,"5min":1.327,"15min":1.327},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.82799999999999996,"15min":0.82199999999999995},"min":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.48299999999999998},"max":{"1min":1.1679999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.58699999999999997,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.256,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.54300000000000004,"5min":0.54100000000000004,"15min":0.496},"max":{"1min":1.2430000000000001,"5min":1.458,"15min":1.458},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81200000000000006,"15min":0.83899999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.50700000000000001},"max":{"1min":1.2829999999999999,"5min":1.573,"15min":1.573},"last":0.65200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575080,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59012,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312828,"statfs":{"total":96636764160,"available":96576335872,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42799999999999999,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53900000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.48199999999999998,"15min":0.501},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65300000000000002,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71099999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.33500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.65300000000000002,"5min":0.79800000000000004,"15min":0.87},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55500000000000005,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.70499999999999996,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.50900000000000001,"15min":0.53800000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32000000000000001},"max":{"1min":0.63800000000000001,"5min":0.749,"15min":0.91200000000000003},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.755,"15min":0.77200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":1.016,"5min":1.204,"15min":1.3140000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.77000000000000002,"15min":0.78100000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.44},"max":{"1min":1.028,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77400000000000002,"15min":0.78100000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.41899999999999998},"max":{"1min":1.0569999999999999,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":0.89600000000000002,"5min":1.3260000000000001,"15min":1.357},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.60199999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.071,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":0.95399999999999996,"5min":1.4379999999999999,"15min":1.456},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98499999999999999,"5min":1.3540000000000001,"15min":1.417},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.79500000000000004,"15min":0.81499999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.5},"max":{"1min":1.044,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.80600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575079,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37444,"kb_used_data":2300,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334396,"statfs":{"total":96636764160,"available":96598421504,"internally_reserved":0,"allocated":2355200,"data_stored":1526109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":0.622,"5min":0.72399999999999998,"15min":0.86399999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.504},"min":{"1min":0.36699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64000000000000001,"5min":0.86799999999999999,"15min":0.98099999999999998},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.66000000000000003,"5min":0.70699999999999996,"15min":0.82399999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.33800000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":1.2050000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48299999999999998,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.75,"5min":0.76600000000000001,"15min":1.151},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.56599999999999995},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69299999999999995,"5min":0.78800000000000003,"15min":0.874},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.63300000000000001,"5min":0.46400000000000002,"15min":0.45000000000000001},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.877,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.40999999999999998},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.66900000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3939999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.56699999999999995,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.0309999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.64800000000000002,"5min":0.52200000000000002,"15min":0.48899999999999999},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.875}]},{"osd":7,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.54500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.82499999999999996,"15min":0.81799999999999995},"min":{"1min":0.58999999999999997,"5min":0.56499999999999995,"15min":0.50900000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:01:34.302 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:01:34.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d9f87b640 1 Processor -- start 2023-07-06T22:01:34.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d9f87b640 1 -- start start 2023-07-06T22:01:34.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d9f87b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8d9815b9d0 0x7f8d9815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d9f87b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9806a160 con 0x7f8d980ce340 2023-07-06T22:01:34.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d9f87b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9815bda0 con 0x7f8d980b4420 2023-07-06T22:01:34.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d9f87b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d98069590 con 0x7f8d9815b9d0 2023-07-06T22:01:34.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d9ce16640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8d980ce340 0x7f8d980b3d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40816/0 (socket says 172.21.15.55:40816) 2023-07-06T22:01:34.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d9ce16640 1 -- 172.21.15.55:0/2547173035 learned_addr learned my addr 172.21.15.55:0/2547173035 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:34.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d9d617640 1 --2- 172.21.15.55:0/2547173035 >> v2:172.21.15.138:3300/0 conn(0x7f8d9815b9d0 0x7f8d9815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d8ffff640 1 -- 172.21.15.55:0/2547173035 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952760781 0 0) 0x7f8d9806a160 con 0x7f8d980ce340 2023-07-06T22:01:34.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d8ffff640 1 -- 172.21.15.55:0/2547173035 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d84003530 con 0x7f8d980ce340 2023-07-06T22:01:34.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d8ffff640 1 -- 172.21.15.55:0/2547173035 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200378049 0 0) 0x7f8d9815bda0 con 0x7f8d980b4420 2023-07-06T22:01:34.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d8ffff640 1 -- 172.21.15.55:0/2547173035 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d9806a160 con 0x7f8d980b4420 2023-07-06T22:01:34.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d9d617640 1 -- 172.21.15.55:0/2547173035 >> v1:172.21.15.138:6789/0 conn(0x7f8d980b4420 legacy=0x7f8d9815c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d9d617640 1 -- 172.21.15.55:0/2547173035 >> v1:172.21.15.55:6789/0 conn(0x7f8d980ce340 legacy=0x7f8d980b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.480+0000 7f8d9d617640 1 -- 172.21.15.55:0/2547173035 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d98069830 con 0x7f8d9815b9d0 2023-07-06T22:01:34.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.484+0000 7f8d9d617640 1 --2- 172.21.15.55:0/2547173035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d9815b9d0 0x7f8d9815f4e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8d940097c0 tx=0x7f8d9401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99f6667117a7d922 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:34.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.484+0000 7f8d8ffff640 1 -- 172.21.15.55:0/2547173035 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d940ab600 con 0x7f8d9815b9d0 2023-07-06T22:01:34.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.484+0000 7f8d8ffff640 1 -- 172.21.15.55:0/2547173035 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d940a7050 con 0x7f8d9815b9d0 2023-07-06T22:01:34.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.484+0000 7f8d8ffff640 1 -- 172.21.15.55:0/2547173035 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d940ab980 con 0x7f8d9815b9d0 2023-07-06T22:01:34.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.484+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2547173035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d9815b9d0 msgr2=0x7f8d9815f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.484+0000 7f8d9f87b640 1 --2- 172.21.15.55:0/2547173035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d9815b9d0 0x7f8d9815f4e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8d940097c0 tx=0x7f8d9401c450 comp rx=0 tx=0).stop 2023-07-06T22:01:34.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.484+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2547173035 shutdown_connections 2023-07-06T22:01:34.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.484+0000 7f8d9f87b640 1 --2- 172.21.15.55:0/2547173035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d9815b9d0 0x7f8d9815f4e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.484+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2547173035 >> 172.21.15.55:0/2547173035 conn(0x7f8d980ced10 msgr2=0x7f8d980cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:34.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.484+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2547173035 shutdown_connections 2023-07-06T22:01:34.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.484+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2547173035 wait complete. 2023-07-06T22:01:34.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9f87b640 1 Processor -- start 2023-07-06T22:01:34.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9f87b640 1 -- start start 2023-07-06T22:01:34.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9f87b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d980b4420 0x7f8d9814f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9f87b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d980ce340 0x7f8d980b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9f87b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d9815b9d0 0x7f8d980b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9f87b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98152ae0 con 0x7f8d9815b9d0 2023-07-06T22:01:34.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9f87b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980b7530 con 0x7f8d980b4420 2023-07-06T22:01:34.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9f87b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d981501b0 con 0x7f8d980ce340 2023-07-06T22:01:34.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9de18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d9815b9d0 0x7f8d980b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9de18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d9815b9d0 0x7f8d980b6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42570/0 (socket says 172.21.15.55:42570) 2023-07-06T22:01:34.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9de18640 1 -- 172.21.15.55:0/2714513215 learned_addr learned my addr 172.21.15.55:0/2714513215 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:34.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9de18640 1 -- 172.21.15.55:0/2714513215 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d980ce340 msgr2=0x7f8d980b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9ce16640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d980ce340 0x7f8d980b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9d617640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d980b4420 0x7f8d9814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9de18640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d980ce340 0x7f8d980b6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9de18640 1 -- 172.21.15.55:0/2714513215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d980b4420 msgr2=0x7f8d9814f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9de18640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d980b4420 0x7f8d9814f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9de18640 1 -- 172.21.15.55:0/2714513215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d94009420 con 0x7f8d9815b9d0 2023-07-06T22:01:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9d617640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d980b4420 0x7f8d9814f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9ce16640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d980ce340 0x7f8d980b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9de18640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d9815b9d0 0x7f8d980b6ff0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000c7d0 tx=0x7f8d9000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d8dffb640 1 -- 172.21.15.55:0/2714513215 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90003b80 con 0x7f8d9815b9d0 2023-07-06T22:01:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d8dffb640 1 -- 172.21.15.55:0/2714513215 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d90003ce0 con 0x7f8d9815b9d0 2023-07-06T22:01:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d8dffb640 1 -- 172.21.15.55:0/2714513215 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9000aa90 con 0x7f8d9815b9d0 2023-07-06T22:01:34.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.488+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2714513215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d98159530 con 0x7f8d9815b9d0 2023-07-06T22:01:34.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.492+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2714513215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d98158ee0 con 0x7f8d9815b9d0 2023-07-06T22:01:34.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.492+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2714513215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d981596c0 con 0x7f8d9815b9d0 2023-07-06T22:01:34.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.492+0000 7f8d8dffb640 1 -- 172.21.15.55:0/2714513215 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8d9000abf0 con 0x7f8d9815b9d0 2023-07-06T22:01:34.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.492+0000 7f8d8dffb640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f8d7c0663d0 0x7f8d7c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.492+0000 7f8d8dffb640 1 -- 172.21.15.55:0/2714513215 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8d90083f30 con 0x7f8d9815b9d0 2023-07-06T22:01:34.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.492+0000 7f8d9d617640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f8d7c0663d0 0x7f8d7c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.492+0000 7f8d9d617640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f8d7c0663d0 0x7f8d7c068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8d940ad000 tx=0x7f8d94008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:34.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.496+0000 7f8d8dffb640 1 -- 172.21.15.55:0/2714513215 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8d900510a0 con 0x7f8d9815b9d0 2023-07-06T22:01:34.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.648+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2714513215 --> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d98169890 con 0x7f8d7c0663d0 2023-07-06T22:01:34.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.656+0000 7f8d8dffb640 1 -- 172.21.15.55:0/2714513215 <== mgr.8940 v2:172.21.15.55:6832/206120108 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296329 (secure 0 0 0) 0x7f8d940ab680 con 0x7f8d7c0663d0 2023-07-06T22:01:34.657 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:34.658 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:01:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.660+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2714513215 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f8d7c0663d0 msgr2=0x7f8d7c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.660+0000 7f8d9f87b640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f8d7c0663d0 0x7f8d7c068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8d940ad000 tx=0x7f8d94008040 comp rx=0 tx=0).stop 2023-07-06T22:01:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.660+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2714513215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d9815b9d0 msgr2=0x7f8d980b6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.660+0000 7f8d9f87b640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d9815b9d0 0x7f8d980b6ff0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000c7d0 tx=0x7f8d9000cc90 comp rx=0 tx=0).stop 2023-07-06T22:01:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.660+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2714513215 shutdown_connections 2023-07-06T22:01:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.660+0000 7f8d9f87b640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f8d7c0663d0 0x7f8d7c068880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.660+0000 7f8d9f87b640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d9815b9d0 0x7f8d980b6ff0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.660+0000 7f8d9f87b640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d980ce340 0x7f8d980b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.660+0000 7f8d9f87b640 1 --2- 172.21.15.55:0/2714513215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d980b4420 0x7f8d9814f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.660+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2714513215 >> 172.21.15.55:0/2714513215 conn(0x7f8d980ced10 msgr2=0x7f8d9815fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.660+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2714513215 shutdown_connections 2023-07-06T22:01:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.660+0000 7f8d9f87b640 1 -- 172.21.15.55:0/2714513215 wait complete. 2023-07-06T22:01:34.676 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-06T22:01:33.141664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":346144,"kb_used_data":14944,"kb_used_omap":0,"kb_used_meta":331136,"kb_avail":754628576,"statfs":{"total":773094113280,"available":772739661824,"internally_reserved":0,"allocated":15302656,"data_stored":8672778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339083264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.383270"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"133'249","reported_seq":878,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:25.867506+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:01:25.867506+0000","last_peered":"2023-07-06T22:01:25.867506+0000","last_clean":"2023-07-06T22:01:25.867506+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:01:25.867506+0000","last_undegraded":"2023-07-06T22:01:25.867506+0000","last_fullsized":"2023-07-06T22:01:25.867506+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:19:41.822283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":224,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.505555+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:01:26.505555+0000","last_peered":"2023-07-06T22:01:26.505555+0000","last_clean":"2023-07-06T22:01:26.505555+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:01:26.505555+0000","last_undegraded":"2023-07-06T22:01:26.505555+0000","last_fullsized":"2023-07-06T22:01:26.505555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:02:38.381204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":254,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:25.867495+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:01:25.867495+0000","last_peered":"2023-07-06T22:01:25.867495+0000","last_clean":"2023-07-06T22:01:25.867495+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:01:25.867495+0000","last_undegraded":"2023-07-06T22:01:25.867495+0000","last_fullsized":"2023-07-06T22:01:25.867495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:13:57.758766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":258,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.481793+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:01:26.481793+0000","last_peered":"2023-07-06T22:01:26.481793+0000","last_clean":"2023-07-06T22:01:26.481793+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:01:26.481793+0000","last_undegraded":"2023-07-06T22:01:26.481793+0000","last_fullsized":"2023-07-06T22:01:26.481793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:14:50.991549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":224,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.505560+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:01:26.505560+0000","last_peered":"2023-07-06T22:01:26.505560+0000","last_clean":"2023-07-06T22:01:26.505560+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:01:26.505560+0000","last_undegraded":"2023-07-06T22:01:26.505560+0000","last_fullsized":"2023-07-06T22:01:26.505560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:26:37.062116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.505329+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:01:26.505329+0000","last_peered":"2023-07-06T22:01:26.505329+0000","last_clean":"2023-07-06T22:01:26.505329+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:01:26.505329+0000","last_undegraded":"2023-07-06T22:01:26.505329+0000","last_fullsized":"2023-07-06T22:01:26.505329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:31:20.994498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":254,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:25.867504+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:01:25.867504+0000","last_peered":"2023-07-06T22:01:25.867504+0000","last_clean":"2023-07-06T22:01:25.867504+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:01:25.867504+0000","last_undegraded":"2023-07-06T22:01:25.867504+0000","last_fullsized":"2023-07-06T22:01:25.867504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:45:57.358902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.505331+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:01:26.505331+0000","last_peered":"2023-07-06T22:01:26.505331+0000","last_clean":"2023-07-06T22:01:26.505331+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:01:26.505331+0000","last_undegraded":"2023-07-06T22:01:26.505331+0000","last_fullsized":"2023-07-06T22:01:26.505331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:57:39.813107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":223,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.215792+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:01:26.215792+0000","last_peered":"2023-07-06T22:01:26.215792+0000","last_clean":"2023-07-06T22:01:26.215792+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:01:26.215792+0000","last_undegraded":"2023-07-06T22:01:26.215792+0000","last_fullsized":"2023-07-06T22:01:26.215792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:33:37.649803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575080,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37448,"kb_used_data":2304,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334392,"statfs":{"total":96636764160,"available":96598417408,"internally_reserved":0,"allocated":2359296,"data_stored":1527128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71299999999999997,"15min":0.70399999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.70699999999999996},"min":{"1min":0.48399999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.90400000000000003}]},{"osd":1,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73099999999999998,"15min":0.71699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.42799999999999999,"15min":0.377},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74099999999999999,"15min":0.73199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.42599999999999999},"max":{"1min":1.3360000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.85999999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73899999999999999,"15min":0.72099999999999997},"min":{"1min":0.52500000000000002,"5min":0.52100000000000002,"15min":0.42199999999999999},"max":{"1min":1.2749999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.228,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56799999999999995,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.32700000000000001},"max":{"1min":0.76100000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.40899999999999997,"5min":0.39400000000000002,"15min":0.35699999999999998},"max":{"1min":0.95599999999999996,"5min":1.169,"15min":1.169},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.503},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.61299999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.51300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.95799999999999996,"5min":1.45,"15min":1.45},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.41699999999999998},"max":{"1min":0.98599999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.56200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834575080,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36864,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334976,"statfs":{"total":96636764160,"available":96599015424,"internally_reserved":0,"allocated":1761280,"data_stored":935741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.47,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.38500000000000001},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.749},"min":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.5349999999999999,"5min":1.778,"15min":1.778},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.503,"5min":0.46200000000000002,"15min":0.45800000000000002},"max":{"1min":1.506,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.442},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72099999999999997,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65500000000000003,"5min":0.95399999999999996,"15min":1.4390000000000001},"last":0.629},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.77500000000000002,"5min":0.94099999999999995,"15min":1.0509999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60799999999999998,"15min":0.622},"min":{"1min":0.442,"5min":0.42099999999999999,"15min":0.38600000000000001},"max":{"1min":0.69799999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77500000000000002,"5min":1.0009999999999999,"15min":1.3089999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.74299999999999999,"5min":1.0029999999999999,"15min":1.2549999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76900000000000002,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.85399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54916,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316924,"statfs":{"total":96636764160,"available":96580530176,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.747,"15min":0.72399999999999998},"min":{"1min":0.52200000000000002,"5min":0.44800000000000001,"15min":0.36699999999999999},"max":{"1min":1.282,"5min":1.49,"15min":1.49},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.45400000000000001,"15min":0.35299999999999998},"max":{"1min":1.0900000000000001,"5min":1.21,"15min":1.21},"last":0.93899999999999995}]},{"osd":1,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.40200000000000002},"max":{"1min":0.98799999999999999,"5min":1.143,"15min":1.143},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.38600000000000001},"max":{"1min":0.96899999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76800000000000002,"15min":0.753},"min":{"1min":0.56699999999999995,"5min":0.498,"15min":0.39900000000000002},"max":{"1min":1.264,"5min":1.5,"15min":1.5},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":1.163,"15min":1.163},"last":0.85699999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.505,"5min":0.48399999999999999,"15min":0.443},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.52600000000000002,"5min":0.51200000000000001,"15min":0.48599999999999999},"max":{"1min":1.0169999999999999,"5min":1.109,"15min":1.109},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.59299999999999997},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.371},"max":{"1min":0.871,"5min":0.88400000000000001,"15min":1.02},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60699999999999998,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.40100000000000002,"15min":0.34999999999999998},"max":{"1min":0.83699999999999997,"5min":0.90200000000000002,"15min":1.004},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63300000000000001,"15min":0.61899999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.34100000000000003},"max":{"1min":0.93799999999999994,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.95299999999999996,"15min":1.0589999999999999},"last":0.98499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32772,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.752,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.46200000000000002,"15min":0.45000000000000001},"max":{"1min":1.2250000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.72699999999999998,"15min":0.72399999999999998},"min":{"1min":0.56899999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.74199999999999999,"15min":0.72199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":1.258,"5min":1.996,"15min":1.996},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.748,"15min":0.748},"min":{"1min":0.47499999999999998,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.75,"15min":0.73499999999999999},"min":{"1min":0.49099999999999999,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":1.1890000000000001,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.74299999999999999,"15min":0.755},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":3.2269999999999999},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.308},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.94299999999999995},"last":0.75},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.80800000000000005,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.627}]},{"osd":6,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.60899999999999999},"min":{"1min":0.36699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86499999999999999,"5min":1.036,"15min":1.036},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.34799999999999998},"max":{"1min":0.89500000000000002,"5min":1,"15min":1},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68000000000000005,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.877,"5min":1.0149999999999999,"15min":1.0720000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70299999999999996,"15min":0.67000000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.41599999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.01},"last":0.73399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575079,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50820,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321020,"statfs":{"total":96636764160,"available":96584724480,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42899999999999999,"15min":0.44800000000000001},"min":{"1min":0.316,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57299999999999995,"5min":0.65600000000000003,"15min":1.0489999999999999},"last":0.375},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.49299999999999999,"15min":0.53100000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68899999999999995,"5min":0.76000000000000001,"15min":2.77},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45600000000000002,"15min":0.48699999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.24299999999999999},"max":{"1min":0.71799999999999997,"5min":0.88800000000000001,"15min":2.4359999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54500000000000004,"15min":0.57799999999999996},"min":{"1min":0.40300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.64500000000000002,"5min":0.97799999999999998,"15min":1.351},"last":0.433}]},{"osd":2,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.53000000000000003},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72299999999999998,"5min":0.79900000000000004,"15min":0.90100000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74099999999999999,"5min":0.86799999999999999,"15min":1.24},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.72599999999999998,"15min":0.75600000000000001},"min":{"1min":0.46000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94099999999999995,"5min":1.1930000000000001,"15min":1.3009999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.73399999999999999,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.383,"15min":1.383},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.79900000000000004},"min":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.4199999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.395,"5min":1.395,"15min":1.3999999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.751,"15min":0.79100000000000004},"min":{"1min":0.50600000000000001,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.371,"5min":1.371,"15min":1.425},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76400000000000001,"15min":0.80200000000000005},"min":{"1min":0.54900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.091,"5min":1.419,"15min":3.1739999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.745,"15min":0.79900000000000004},"min":{"1min":0.54200000000000004,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":0.996,"5min":1.2150000000000001,"15min":3.097},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.47099999999999997,"15min":0.45900000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.66800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.68600000000000005,"5min":0.79200000000000004,"15min":0.85999999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.47399999999999998,"15min":0.497},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.67800000000000005,"5min":0.82199999999999995,"15min":0.85999999999999999},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.61199999999999999,"5min":0.878,"15min":0.88200000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.83499999999999996,"15min":0.94399999999999995},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71199999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55900000000000005,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.71799999999999997,"5min":0.85599999999999998,"15min":0.95399999999999996},"last":0.504}]},{"osd":4,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.42899999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.79000000000000004,"15min":0.80400000000000005},"min":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.41399999999999998},"max":{"1min":1.1459999999999999,"5min":1.591,"15min":1.591},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.54800000000000004,"5min":0.52200000000000002,"15min":0.42899999999999999},"max":{"1min":1.26,"5min":1.333,"15min":1.333},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78900000000000003,"15min":0.81100000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":1.28,"5min":1.327,"15min":1.327},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.82799999999999996,"15min":0.82199999999999995},"min":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.48299999999999998},"max":{"1min":1.1679999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.58699999999999997,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.256,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.54300000000000004,"5min":0.54100000000000004,"15min":0.496},"max":{"1min":1.2430000000000001,"5min":1.458,"15min":1.458},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81200000000000006,"15min":0.83899999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.50700000000000001},"max":{"1min":1.2829999999999999,"5min":1.573,"15min":1.573},"last":0.65200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575080,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59012,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312828,"statfs":{"total":96636764160,"available":96576335872,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42799999999999999,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53900000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.48199999999999998,"15min":0.501},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65300000000000002,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71099999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.33500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.65300000000000002,"5min":0.79800000000000004,"15min":0.87},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55500000000000005,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.70499999999999996,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.50900000000000001,"15min":0.53800000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32000000000000001},"max":{"1min":0.63800000000000001,"5min":0.749,"15min":0.91200000000000003},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.755,"15min":0.77200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":1.016,"5min":1.204,"15min":1.3140000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.77000000000000002,"15min":0.78100000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.44},"max":{"1min":1.028,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77400000000000002,"15min":0.78100000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.41899999999999998},"max":{"1min":1.0569999999999999,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":0.89600000000000002,"5min":1.3260000000000001,"15min":1.357},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.60199999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.071,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":0.95399999999999996,"5min":1.4379999999999999,"15min":1.456},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98499999999999999,"5min":1.3540000000000001,"15min":1.417},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.79500000000000004,"15min":0.81499999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.5},"max":{"1min":1.044,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.80600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575079,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37444,"kb_used_data":2300,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334396,"statfs":{"total":96636764160,"available":96598421504,"internally_reserved":0,"allocated":2355200,"data_stored":1526109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":0.622,"5min":0.72399999999999998,"15min":0.86399999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.504},"min":{"1min":0.36699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64000000000000001,"5min":0.86799999999999999,"15min":0.98099999999999998},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.66000000000000003,"5min":0.70699999999999996,"15min":0.82399999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.33800000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":1.2050000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48299999999999998,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.75,"5min":0.76600000000000001,"15min":1.151},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.56599999999999995},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69299999999999995,"5min":0.78800000000000003,"15min":0.874},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.63300000000000001,"5min":0.46400000000000002,"15min":0.45000000000000001},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.877,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.40999999999999998},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.66900000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3939999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.56699999999999995,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.0309999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.64800000000000002,"5min":0.52200000000000002,"15min":0.48899999999999999},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.875}]},{"osd":7,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.54500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.82499999999999996,"15min":0.81799999999999995},"min":{"1min":0.58999999999999997,"5min":0.56499999999999995,"15min":0.50900000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:01:34.683 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:01:34.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.868+0000 7fb731137640 1 Processor -- start 2023-07-06T22:01:34.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.868+0000 7fb731137640 1 -- start start 2023-07-06T22:01:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.872+0000 7fb731137640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb72c15bc30 0x7fb72c06ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.872+0000 7fb731137640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb72c0cfb90 0x7fb72c0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.872+0000 7fb731137640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72c15f750 con 0x7fb72c06f110 2023-07-06T22:01:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.872+0000 7fb731137640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72c0cc800 con 0x7fb72c0cfb90 2023-07-06T22:01:34.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.872+0000 7fb731137640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72c06f580 con 0x7fb72c15bc30 2023-07-06T22:01:34.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.872+0000 7fb72b59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb72c0cfb90 0x7fb72c0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.872+0000 7fb72b59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb72c0cfb90 0x7fb72c0ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42574/0 (socket says 172.21.15.55:42574) 2023-07-06T22:01:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.872+0000 7fb72b59e640 1 -- 172.21.15.55:0/2340782978 learned_addr learned my addr 172.21.15.55:0/2340782978 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.872+0000 7fb72ad9d640 1 --2- 172.21.15.55:0/2340782978 >> v2:172.21.15.138:3300/0 conn(0x7fb72c15bc30 0x7fb72c06ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.872+0000 7fb72b59e640 1 -- 172.21.15.55:0/2340782978 >> v2:172.21.15.138:3300/0 conn(0x7fb72c15bc30 msgr2=0x7fb72c06ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.872+0000 7fb72b59e640 1 --2- 172.21.15.55:0/2340782978 >> v2:172.21.15.138:3300/0 conn(0x7fb72c15bc30 0x7fb72c06ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.872+0000 7fb72b59e640 1 -- 172.21.15.55:0/2340782978 >> v1:172.21.15.138:6789/0 conn(0x7fb72c06f110 legacy=0x7fb72c0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.872+0000 7fb72b59e640 1 -- 172.21.15.55:0/2340782978 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c15fa30 con 0x7fb72c0cfb90 2023-07-06T22:01:34.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb72b59e640 1 --2- 172.21.15.55:0/2340782978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb72c0cfb90 0x7fb72c0ce0a0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fb72c070da0 tx=0x7fb72401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772b0468f5b2c3d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:34.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb72a59c640 1 -- 172.21.15.55:0/2340782978 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240a5860 con 0x7fb72c0cfb90 2023-07-06T22:01:34.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb72a59c640 1 -- 172.21.15.55:0/2340782978 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7240a59c0 con 0x7fb72c0cfb90 2023-07-06T22:01:34.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb72a59c640 1 -- 172.21.15.55:0/2340782978 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240a5d50 con 0x7fb72c0cfb90 2023-07-06T22:01:34.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 -- 172.21.15.55:0/2340782978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb72c0cfb90 msgr2=0x7fb72c0ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 --2- 172.21.15.55:0/2340782978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb72c0cfb90 0x7fb72c0ce0a0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fb72c070da0 tx=0x7fb72401c9a0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 -- 172.21.15.55:0/2340782978 shutdown_connections 2023-07-06T22:01:34.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 --2- 172.21.15.55:0/2340782978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb72c0cfb90 0x7fb72c0ce0a0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 --2- 172.21.15.55:0/2340782978 >> v2:172.21.15.138:3300/0 conn(0x7fb72c15bc30 0x7fb72c06ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 -- 172.21.15.55:0/2340782978 >> 172.21.15.55:0/2340782978 conn(0x7fb72c0b2840 msgr2=0x7fb72c0d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:34.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 -- 172.21.15.55:0/2340782978 shutdown_connections 2023-07-06T22:01:34.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 -- 172.21.15.55:0/2340782978 wait complete. 2023-07-06T22:01:34.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 Processor -- start 2023-07-06T22:01:34.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 -- start start 2023-07-06T22:01:34.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb72c06f110 0x7fb72c0c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72c0cfb90 0x7fb72c14ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb72c15bc30 0x7fb72c1490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c0c58d0 con 0x7fb72c06f110 2023-07-06T22:01:34.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c0c5160 con 0x7fb72c0cfb90 2023-07-06T22:01:34.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.876+0000 7fb731137640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c14f240 con 0x7fb72c15bc30 2023-07-06T22:01:34.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb72ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb72c06f110 0x7fb72c0c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb72ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb72c06f110 0x7fb72c0c45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42576/0 (socket says 172.21.15.55:42576) 2023-07-06T22:01:34.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb72ad9d640 1 -- 172.21.15.55:0/3751025673 learned_addr learned my addr 172.21.15.55:0/3751025673 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:34.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb723fff640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72c0cfb90 0x7fb72c14ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb72b59e640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb72c15bc30 0x7fb72c1490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb72ad9d640 1 -- 172.21.15.55:0/3751025673 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb72c15bc30 msgr2=0x7fb72c1490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb72ad9d640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb72c15bc30 0x7fb72c1490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb72ad9d640 1 -- 172.21.15.55:0/3751025673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72c0cfb90 msgr2=0x7fb72c14ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb72ad9d640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72c0cfb90 0x7fb72c14ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb72ad9d640 1 -- 172.21.15.55:0/3751025673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb724009b30 con 0x7fb72c06f110 2023-07-06T22:01:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb723fff640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72c0cfb90 0x7fb72c14ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb72ad9d640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb72c06f110 0x7fb72c0c45c0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00d5f0 tx=0x7fb71c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb7237fe640 1 -- 172.21.15.55:0/3751025673 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c0125f0 con 0x7fb72c06f110 2023-07-06T22:01:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb7237fe640 1 -- 172.21.15.55:0/3751025673 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c012750 con 0x7fb72c06f110 2023-07-06T22:01:34.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb7237fe640 1 -- 172.21.15.55:0/3751025673 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c012b00 con 0x7fb72c06f110 2023-07-06T22:01:34.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb731137640 1 -- 172.21.15.55:0/3751025673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72c0c4ba0 con 0x7fb72c06f110 2023-07-06T22:01:34.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb731137640 1 -- 172.21.15.55:0/3751025673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72c0c5560 con 0x7fb72c06f110 2023-07-06T22:01:34.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb731137640 1 -- 172.21.15.55:0/3751025673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72c066d60 con 0x7fb72c06f110 2023-07-06T22:01:34.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb7237fe640 1 -- 172.21.15.55:0/3751025673 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb71c012c60 con 0x7fb72c06f110 2023-07-06T22:01:34.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.880+0000 7fb7237fe640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb70c0663a0 0x7fb70c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:34.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.884+0000 7fb7237fe640 1 -- 172.21.15.55:0/3751025673 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb71c084570 con 0x7fb72c06f110 2023-07-06T22:01:34.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.884+0000 7fb723fff640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb70c0663a0 0x7fb70c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:34.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.884+0000 7fb723fff640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb70c0663a0 0x7fb70c068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0cfb60 tx=0x7fb714009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:34.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:34.888+0000 7fb7237fe640 1 -- 172.21.15.55:0/3751025673 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb71c051770 con 0x7fb72c06f110 2023-07-06T22:01:35.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.040+0000 7fb731137640 1 -- 172.21.15.55:0/3751025673 --> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb72c0b4130 con 0x7fb70c0663a0 2023-07-06T22:01:35.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.048+0000 7fb7237fe640 1 -- 172.21.15.55:0/3751025673 <== mgr.8940 v2:172.21.15.55:6832/206120108 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296329 (secure 0 0 0) 0x7fb7140013f0 con 0x7fb70c0663a0 2023-07-06T22:01:35.048 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:35.049 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:01:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.052+0000 7fb731137640 1 -- 172.21.15.55:0/3751025673 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb70c0663a0 msgr2=0x7fb70c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.052+0000 7fb731137640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb70c0663a0 0x7fb70c068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0cfb60 tx=0x7fb714009040 comp rx=0 tx=0).stop 2023-07-06T22:01:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.052+0000 7fb731137640 1 -- 172.21.15.55:0/3751025673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb72c06f110 msgr2=0x7fb72c0c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:35.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.052+0000 7fb731137640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb72c06f110 0x7fb72c0c45c0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00d5f0 tx=0x7fb71c00dab0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.052+0000 7fb731137640 1 -- 172.21.15.55:0/3751025673 shutdown_connections 2023-07-06T22:01:35.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.052+0000 7fb731137640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb70c0663a0 0x7fb70c068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.052+0000 7fb731137640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb72c15bc30 0x7fb72c1490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.052+0000 7fb731137640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb72c0cfb90 0x7fb72c14ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.052+0000 7fb731137640 1 --2- 172.21.15.55:0/3751025673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb72c06f110 0x7fb72c0c45c0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.052+0000 7fb731137640 1 -- 172.21.15.55:0/3751025673 >> 172.21.15.55:0/3751025673 conn(0x7fb72c0b2840 msgr2=0x7fb72c065070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:35.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.052+0000 7fb731137640 1 -- 172.21.15.55:0/3751025673 shutdown_connections 2023-07-06T22:01:35.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.052+0000 7fb731137640 1 -- 172.21.15.55:0/3751025673 wait complete. 2023-07-06T22:01:35.068 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-06T22:01:33.141664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":346144,"kb_used_data":14944,"kb_used_omap":0,"kb_used_meta":331136,"kb_avail":754628576,"statfs":{"total":773094113280,"available":772739661824,"internally_reserved":0,"allocated":15302656,"data_stored":8672778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339083264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.383270"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"133'249","reported_seq":878,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:25.867506+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:01:25.867506+0000","last_peered":"2023-07-06T22:01:25.867506+0000","last_clean":"2023-07-06T22:01:25.867506+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:01:25.867506+0000","last_undegraded":"2023-07-06T22:01:25.867506+0000","last_fullsized":"2023-07-06T22:01:25.867506+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:19:41.822283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":224,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.505555+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:01:26.505555+0000","last_peered":"2023-07-06T22:01:26.505555+0000","last_clean":"2023-07-06T22:01:26.505555+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:01:26.505555+0000","last_undegraded":"2023-07-06T22:01:26.505555+0000","last_fullsized":"2023-07-06T22:01:26.505555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:02:38.381204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":254,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:25.867495+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:01:25.867495+0000","last_peered":"2023-07-06T22:01:25.867495+0000","last_clean":"2023-07-06T22:01:25.867495+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:01:25.867495+0000","last_undegraded":"2023-07-06T22:01:25.867495+0000","last_fullsized":"2023-07-06T22:01:25.867495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:13:57.758766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":258,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.481793+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:01:26.481793+0000","last_peered":"2023-07-06T22:01:26.481793+0000","last_clean":"2023-07-06T22:01:26.481793+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:01:26.481793+0000","last_undegraded":"2023-07-06T22:01:26.481793+0000","last_fullsized":"2023-07-06T22:01:26.481793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:14:50.991549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":224,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.505560+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:01:26.505560+0000","last_peered":"2023-07-06T22:01:26.505560+0000","last_clean":"2023-07-06T22:01:26.505560+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:01:26.505560+0000","last_undegraded":"2023-07-06T22:01:26.505560+0000","last_fullsized":"2023-07-06T22:01:26.505560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:26:37.062116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.505329+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:01:26.505329+0000","last_peered":"2023-07-06T22:01:26.505329+0000","last_clean":"2023-07-06T22:01:26.505329+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:01:26.505329+0000","last_undegraded":"2023-07-06T22:01:26.505329+0000","last_fullsized":"2023-07-06T22:01:26.505329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:31:20.994498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":254,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:25.867504+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:01:25.867504+0000","last_peered":"2023-07-06T22:01:25.867504+0000","last_clean":"2023-07-06T22:01:25.867504+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:01:25.867504+0000","last_undegraded":"2023-07-06T22:01:25.867504+0000","last_fullsized":"2023-07-06T22:01:25.867504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:45:57.358902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.505331+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:01:26.505331+0000","last_peered":"2023-07-06T22:01:26.505331+0000","last_clean":"2023-07-06T22:01:26.505331+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:01:26.505331+0000","last_undegraded":"2023-07-06T22:01:26.505331+0000","last_fullsized":"2023-07-06T22:01:26.505331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:57:39.813107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:29.756868+0000","last_change":"2023-07-06T22:01:29.756868+0000","last_active":"2023-07-06T22:01:29.756868+0000","last_peered":"2023-07-06T22:01:29.756868+0000","last_clean":"2023-07-06T22:01:29.756868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:29.756868+0000","last_undegraded":"2023-07-06T22:01:29.756868+0000","last_fullsized":"2023-07-06T22:01:29.756868+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:01:28.745372+0000","last_change":"2023-07-06T22:01:28.745372+0000","last_active":"2023-07-06T22:01:28.745372+0000","last_peered":"2023-07-06T22:01:28.745372+0000","last_clean":"2023-07-06T22:01:28.745372+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:01:28.745372+0000","last_undegraded":"2023-07-06T22:01:28.745372+0000","last_fullsized":"2023-07-06T22:01:28.745372+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":223,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-06T22:01:26.215792+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:01:26.215792+0000","last_peered":"2023-07-06T22:01:26.215792+0000","last_clean":"2023-07-06T22:01:26.215792+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:01:26.215792+0000","last_undegraded":"2023-07-06T22:01:26.215792+0000","last_fullsized":"2023-07-06T22:01:26.215792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:33:37.649803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575080,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37448,"kb_used_data":2304,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334392,"statfs":{"total":96636764160,"available":96598417408,"internally_reserved":0,"allocated":2359296,"data_stored":1527128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71299999999999997,"15min":0.70399999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.70699999999999996},"min":{"1min":0.48399999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.90400000000000003}]},{"osd":1,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73099999999999998,"15min":0.71699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.42799999999999999,"15min":0.377},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74099999999999999,"15min":0.73199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.42599999999999999},"max":{"1min":1.3360000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.85999999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73899999999999999,"15min":0.72099999999999997},"min":{"1min":0.52500000000000002,"5min":0.52100000000000002,"15min":0.42199999999999999},"max":{"1min":1.2749999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.228,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56799999999999995,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.32700000000000001},"max":{"1min":0.76100000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.40899999999999997,"5min":0.39400000000000002,"15min":0.35699999999999998},"max":{"1min":0.95599999999999996,"5min":1.169,"15min":1.169},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.503},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.61299999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.51300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.95799999999999996,"5min":1.45,"15min":1.45},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.41699999999999998},"max":{"1min":0.98599999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.56200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834575080,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36864,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334976,"statfs":{"total":96636764160,"available":96599015424,"internally_reserved":0,"allocated":1761280,"data_stored":935741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.47,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.38500000000000001},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.749},"min":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.5349999999999999,"5min":1.778,"15min":1.778},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.503,"5min":0.46200000000000002,"15min":0.45800000000000002},"max":{"1min":1.506,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.442},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72099999999999997,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65500000000000003,"5min":0.95399999999999996,"15min":1.4390000000000001},"last":0.629},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.77500000000000002,"5min":0.94099999999999995,"15min":1.0509999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60799999999999998,"15min":0.622},"min":{"1min":0.442,"5min":0.42099999999999999,"15min":0.38600000000000001},"max":{"1min":0.69799999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77500000000000002,"5min":1.0009999999999999,"15min":1.3089999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.74299999999999999,"5min":1.0029999999999999,"15min":1.2549999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76900000000000002,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.85399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54916,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316924,"statfs":{"total":96636764160,"available":96580530176,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.747,"15min":0.72399999999999998},"min":{"1min":0.52200000000000002,"5min":0.44800000000000001,"15min":0.36699999999999999},"max":{"1min":1.282,"5min":1.49,"15min":1.49},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.45400000000000001,"15min":0.35299999999999998},"max":{"1min":1.0900000000000001,"5min":1.21,"15min":1.21},"last":0.93899999999999995}]},{"osd":1,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.40200000000000002},"max":{"1min":0.98799999999999999,"5min":1.143,"15min":1.143},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.38600000000000001},"max":{"1min":0.96899999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76800000000000002,"15min":0.753},"min":{"1min":0.56699999999999995,"5min":0.498,"15min":0.39900000000000002},"max":{"1min":1.264,"5min":1.5,"15min":1.5},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":1.163,"15min":1.163},"last":0.85699999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.505,"5min":0.48399999999999999,"15min":0.443},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.52600000000000002,"5min":0.51200000000000001,"15min":0.48599999999999999},"max":{"1min":1.0169999999999999,"5min":1.109,"15min":1.109},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.59299999999999997},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.371},"max":{"1min":0.871,"5min":0.88400000000000001,"15min":1.02},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60699999999999998,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.40100000000000002,"15min":0.34999999999999998},"max":{"1min":0.83699999999999997,"5min":0.90200000000000002,"15min":1.004},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63300000000000001,"15min":0.61899999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.34100000000000003},"max":{"1min":0.93799999999999994,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.95299999999999996,"15min":1.0589999999999999},"last":0.98499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32772,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.752,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.46200000000000002,"15min":0.45000000000000001},"max":{"1min":1.2250000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.72699999999999998,"15min":0.72399999999999998},"min":{"1min":0.56899999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.74199999999999999,"15min":0.72199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":1.258,"5min":1.996,"15min":1.996},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.748,"15min":0.748},"min":{"1min":0.47499999999999998,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.75,"15min":0.73499999999999999},"min":{"1min":0.49099999999999999,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":1.1890000000000001,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.74299999999999999,"15min":0.755},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":3.2269999999999999},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.308},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.94299999999999995},"last":0.75},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.80800000000000005,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.627}]},{"osd":6,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.60899999999999999},"min":{"1min":0.36699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86499999999999999,"5min":1.036,"15min":1.036},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.34799999999999998},"max":{"1min":0.89500000000000002,"5min":1,"15min":1},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jul 6 22:00:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68000000000000005,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.877,"5min":1.0149999999999999,"15min":1.0720000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70299999999999996,"15min":0.67000000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.41599999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.01},"last":0.73399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575079,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50820,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321020,"statfs":{"total":96636764160,"available":96584724480,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42899999999999999,"15min":0.44800000000000001},"min":{"1min":0.316,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57299999999999995,"5min":0.65600000000000003,"15min":1.0489999999999999},"last":0.375},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.49299999999999999,"15min":0.53100000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68899999999999995,"5min":0.76000000000000001,"15min":2.77},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45600000000000002,"15min":0.48699999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.24299999999999999},"max":{"1min":0.71799999999999997,"5min":0.88800000000000001,"15min":2.4359999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54500000000000004,"15min":0.57799999999999996},"min":{"1min":0.40300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.64500000000000002,"5min":0.97799999999999998,"15min":1.351},"last":0.433}]},{"osd":2,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.53000000000000003},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72299999999999998,"5min":0.79900000000000004,"15min":0.90100000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74099999999999999,"5min":0.86799999999999999,"15min":1.24},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.72599999999999998,"15min":0.75600000000000001},"min":{"1min":0.46000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94099999999999995,"5min":1.1930000000000001,"15min":1.3009999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.73399999999999999,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.383,"15min":1.383},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.79900000000000004},"min":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.4199999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.395,"5min":1.395,"15min":1.3999999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.751,"15min":0.79100000000000004},"min":{"1min":0.50600000000000001,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.371,"5min":1.371,"15min":1.425},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76400000000000001,"15min":0.80200000000000005},"min":{"1min":0.54900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.091,"5min":1.419,"15min":3.1739999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.745,"15min":0.79900000000000004},"min":{"1min":0.54200000000000004,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":0.996,"5min":1.2150000000000001,"15min":3.097},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.47099999999999997,"15min":0.45900000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.66800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.68600000000000005,"5min":0.79200000000000004,"15min":0.85999999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.47399999999999998,"15min":0.497},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.67800000000000005,"5min":0.82199999999999995,"15min":0.85999999999999999},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.61199999999999999,"5min":0.878,"15min":0.88200000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.83499999999999996,"15min":0.94399999999999995},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71199999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55900000000000005,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.71799999999999997,"5min":0.85599999999999998,"15min":0.95399999999999996},"last":0.504}]},{"osd":4,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.42899999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.79000000000000004,"15min":0.80400000000000005},"min":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.41399999999999998},"max":{"1min":1.1459999999999999,"5min":1.591,"15min":1.591},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.54800000000000004,"5min":0.52200000000000002,"15min":0.42899999999999999},"max":{"1min":1.26,"5min":1.333,"15min":1.333},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78900000000000003,"15min":0.81100000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":1.28,"5min":1.327,"15min":1.327},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.82799999999999996,"15min":0.82199999999999995},"min":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.48299999999999998},"max":{"1min":1.1679999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.58699999999999997,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.256,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.54300000000000004,"5min":0.54100000000000004,"15min":0.496},"max":{"1min":1.2430000000000001,"5min":1.458,"15min":1.458},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81200000000000006,"15min":0.83899999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.50700000000000001},"max":{"1min":1.2829999999999999,"5min":1.573,"15min":1.573},"last":0.65200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575080,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59012,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312828,"statfs":{"total":96636764160,"available":96576335872,"internally_reserved":0,"allocated":1765376,"data_stored":936760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42799999999999999,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53900000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.48199999999999998,"15min":0.501},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65300000000000002,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71099999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.33500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.65300000000000002,"5min":0.79800000000000004,"15min":0.87},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55500000000000005,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.70499999999999996,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.50900000000000001,"15min":0.53800000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32000000000000001},"max":{"1min":0.63800000000000001,"5min":0.749,"15min":0.91200000000000003},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.755,"15min":0.77200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":1.016,"5min":1.204,"15min":1.3140000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.77000000000000002,"15min":0.78100000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.44},"max":{"1min":1.028,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77400000000000002,"15min":0.78100000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.41899999999999998},"max":{"1min":1.0569999999999999,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":0.89600000000000002,"5min":1.3260000000000001,"15min":1.357},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.60199999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.071,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":0.95399999999999996,"5min":1.4379999999999999,"15min":1.456},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98499999999999999,"5min":1.3540000000000001,"15min":1.417},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.79500000000000004,"15min":0.81499999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.5},"max":{"1min":1.044,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.80600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575079,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37444,"kb_used_data":2300,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334396,"statfs":{"total":96636764160,"available":96598421504,"internally_reserved":0,"allocated":2355200,"data_stored":1526109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":0.622,"5min":0.72399999999999998,"15min":0.86399999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.504},"min":{"1min":0.36699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64000000000000001,"5min":0.86799999999999999,"15min":0.98099999999999998},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.66000000000000003,"5min":0.70699999999999996,"15min":0.82399999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.33800000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":1.2050000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48299999999999998,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.75,"5min":0.76600000000000001,"15min":1.151},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.56599999999999995},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69299999999999995,"5min":0.78800000000000003,"15min":0.874},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.63300000000000001,"5min":0.46400000000000002,"15min":0.45000000000000001},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.877,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.40999999999999998},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.66900000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3939999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.56699999999999995,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.0309999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.64800000000000002,"5min":0.52200000000000002,"15min":0.48899999999999999},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.875}]},{"osd":7,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.54500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.82499999999999996,"15min":0.81799999999999995},"min":{"1min":0.58999999999999997,"5min":0.56499999999999995,"15min":0.50900000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:01:35.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3f is not active+clean 2023-07-06T22:01:35.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3e is not active+clean 2023-07-06T22:01:35.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3d is not active+clean 2023-07-06T22:01:35.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3c is not active+clean 2023-07-06T22:01:35.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3b is not active+clean 2023-07-06T22:01:35.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3a is not active+clean 2023-07-06T22:01:35.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.39 is not active+clean 2023-07-06T22:01:35.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.38 is not active+clean 2023-07-06T22:01:35.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.37 is not active+clean 2023-07-06T22:01:35.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.36 is not active+clean 2023-07-06T22:01:35.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.35 is not active+clean 2023-07-06T22:01:35.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.34 is not active+clean 2023-07-06T22:01:35.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.33 is not active+clean 2023-07-06T22:01:35.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.32 is not active+clean 2023-07-06T22:01:35.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.31 is not active+clean 2023-07-06T22:01:35.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.30 is not active+clean 2023-07-06T22:01:35.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2f is not active+clean 2023-07-06T22:01:35.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2e is not active+clean 2023-07-06T22:01:35.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2d is not active+clean 2023-07-06T22:01:35.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2c is not active+clean 2023-07-06T22:01:35.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2b is not active+clean 2023-07-06T22:01:35.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2a is not active+clean 2023-07-06T22:01:35.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.29 is not active+clean 2023-07-06T22:01:35.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.28 is not active+clean 2023-07-06T22:01:35.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.27 is not active+clean 2023-07-06T22:01:35.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.26 is not active+clean 2023-07-06T22:01:35.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.25 is not active+clean 2023-07-06T22:01:35.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.24 is not active+clean 2023-07-06T22:01:35.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.23 is not active+clean 2023-07-06T22:01:35.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.22 is not active+clean 2023-07-06T22:01:35.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.21 is not active+clean 2023-07-06T22:01:35.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.20 is not active+clean 2023-07-06T22:01:35.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1e is not active+clean 2023-07-06T22:01:35.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1f is not active+clean 2023-07-06T22:01:35.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1f is not active+clean 2023-07-06T22:01:35.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1e is not active+clean 2023-07-06T22:01:35.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1c is not active+clean 2023-07-06T22:01:35.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1d is not active+clean 2023-07-06T22:01:35.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1d is not active+clean 2023-07-06T22:01:35.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1c is not active+clean 2023-07-06T22:01:35.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1a is not active+clean 2023-07-06T22:01:35.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1b is not active+clean 2023-07-06T22:01:35.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1b is not active+clean 2023-07-06T22:01:35.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1a is not active+clean 2023-07-06T22:01:35.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.18 is not active+clean 2023-07-06T22:01:35.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.19 is not active+clean 2023-07-06T22:01:35.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.19 is not active+clean 2023-07-06T22:01:35.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.18 is not active+clean 2023-07-06T22:01:35.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.e is not active+clean 2023-07-06T22:01:35.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.f is not active+clean 2023-07-06T22:01:35.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.f is not active+clean 2023-07-06T22:01:35.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.e is not active+clean 2023-07-06T22:01:35.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.c is not active+clean 2023-07-06T22:01:35.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.d is not active+clean 2023-07-06T22:01:35.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.d is not active+clean 2023-07-06T22:01:35.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.c is not active+clean 2023-07-06T22:01:35.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.a is not active+clean 2023-07-06T22:01:35.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.b is not active+clean 2023-07-06T22:01:35.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.b is not active+clean 2023-07-06T22:01:35.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2023-07-06T22:01:35.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.8 is not active+clean 2023-07-06T22:01:35.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2023-07-06T22:01:35.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.9 is not active+clean 2023-07-06T22:01:35.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.8 is not active+clean 2023-07-06T22:01:35.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.6 is not active+clean 2023-07-06T22:01:35.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.7 is not active+clean 2023-07-06T22:01:35.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.7 is not active+clean 2023-07-06T22:01:35.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.6 is not active+clean 2023-07-06T22:01:35.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.4 is not active+clean 2023-07-06T22:01:35.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.5 is not active+clean 2023-07-06T22:01:35.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.5 is not active+clean 2023-07-06T22:01:35.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.4 is not active+clean 2023-07-06T22:01:35.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2 is not active+clean 2023-07-06T22:01:35.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3 is not active+clean 2023-07-06T22:01:35.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3 is not active+clean 2023-07-06T22:01:35.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2 is not active+clean 2023-07-06T22:01:35.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.0 is not active+clean 2023-07-06T22:01:35.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2023-07-06T22:01:35.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1 is not active+clean 2023-07-06T22:01:35.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.0 is not active+clean 2023-07-06T22:01:35.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.12 is not active+clean 2023-07-06T22:01:35.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.13 is not active+clean 2023-07-06T22:01:35.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.11 is not active+clean 2023-07-06T22:01:35.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.10 is not active+clean 2023-07-06T22:01:35.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.10 is not active+clean 2023-07-06T22:01:35.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.11 is not active+clean 2023-07-06T22:01:35.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.13 is not active+clean 2023-07-06T22:01:35.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.12 is not active+clean 2023-07-06T22:01:35.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.15 is not active+clean 2023-07-06T22:01:35.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.14 is not active+clean 2023-07-06T22:01:35.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.14 is not active+clean 2023-07-06T22:01:35.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.15 is not active+clean 2023-07-06T22:01:35.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.17 is not active+clean 2023-07-06T22:01:35.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2023-07-06T22:01:35.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.16 is not active+clean 2023-07-06T22:01:35.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:29.756868+0000', 'last_change': '2023-07-06T22:01:29.756868+0000', 'last_active': '2023-07-06T22:01:29.756868+0000', 'last_peered': '2023-07-06T22:01:29.756868+0000', 'last_clean': '2023-07-06T22:01:29.756868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:29.756868+0000', 'last_undegraded': '2023-07-06T22:01:29.756868+0000', 'last_fullsized': '2023-07-06T22:01:29.756868+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:29.756868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.17 is not active+clean 2023-07-06T22:01:35.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:01:28.745372+0000', 'last_change': '2023-07-06T22:01:28.745372+0000', 'last_active': '2023-07-06T22:01:28.745372+0000', 'last_peered': '2023-07-06T22:01:28.745372+0000', 'last_clean': '2023-07-06T22:01:28.745372+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:01:28.745372+0000', 'last_undegraded': '2023-07-06T22:01:28.745372+0000', 'last_fullsized': '2023-07-06T22:01:28.745372+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'last_clean_scrub_stamp': '2023-07-06T22:01:28.745372+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:01:35.139 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-06T22:01:35.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.284+0000 7fb451f74640 1 Processor -- start 2023-07-06T22:01:35.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.284+0000 7fb451f74640 1 -- start start 2023-07-06T22:01:35.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb451f74640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb44c0cf940 0x7fb44c0cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:35.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb451f74640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb44c06d670 0x7fb44c0d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:35.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb451f74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb44c0d0790 0x7fb44c15d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:35.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb451f74640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44c0ce9e0 con 0x7fb44c0cf940 2023-07-06T22:01:35.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb451f74640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44c159eb0 con 0x7fb44c06d670 2023-07-06T22:01:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb451f74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0cddd0 con 0x7fb44c0d0790 2023-07-06T22:01:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb44b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb44c0cf940 0x7fb44c0cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb44b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb44c0cf940 0x7fb44c0cfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42582/0 (socket says 172.21.15.55:42582) 2023-07-06T22:01:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb44b7fe640 1 -- 172.21.15.55:0/3652864476 learned_addr learned my addr 172.21.15.55:0/3652864476 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb44bfff640 1 --2- 172.21.15.55:0/3652864476 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb44c0d0790 0x7fb44c15d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb44affd640 1 --2- 172.21.15.55:0/3652864476 >> v2:172.21.15.138:3300/0 conn(0x7fb44c06d670 0x7fb44c0d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb44b7fe640 1 -- 172.21.15.55:0/3652864476 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb44c0d0790 msgr2=0x7fb44c15d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb44b7fe640 1 --2- 172.21.15.55:0/3652864476 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb44c0d0790 0x7fb44c15d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb44b7fe640 1 -- 172.21.15.55:0/3652864476 >> v2:172.21.15.138:3300/0 conn(0x7fb44c06d670 msgr2=0x7fb44c0d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:35.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb44b7fe640 1 --2- 172.21.15.55:0/3652864476 >> v2:172.21.15.138:3300/0 conn(0x7fb44c06d670 0x7fb44c0d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb44b7fe640 1 -- 172.21.15.55:0/3652864476 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c0ce0b0 con 0x7fb44c0cf940 2023-07-06T22:01:35.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb44b7fe640 1 --2- 172.21.15.55:0/3652864476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb44c0cf940 0x7fb44c0cfd10 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0cf000 tx=0x7fb43c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483df45c15f5074b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.288+0000 7fb44a7fc640 1 -- 172.21.15.55:0/3652864476 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0ab600 con 0x7fb44c0cf940 2023-07-06T22:01:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb44a7fc640 1 -- 172.21.15.55:0/3652864476 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c0ab760 con 0x7fb44c0cf940 2023-07-06T22:01:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb44a7fc640 1 -- 172.21.15.55:0/3652864476 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0abaf0 con 0x7fb44c0cf940 2023-07-06T22:01:35.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 -- 172.21.15.55:0/3652864476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb44c0cf940 msgr2=0x7fb44c0cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:35.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 --2- 172.21.15.55:0/3652864476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb44c0cf940 0x7fb44c0cfd10 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0cf000 tx=0x7fb43c01c440 comp rx=0 tx=0).stop 2023-07-06T22:01:35.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 -- 172.21.15.55:0/3652864476 shutdown_connections 2023-07-06T22:01:35.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 --2- 172.21.15.55:0/3652864476 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb44c0d0790 0x7fb44c15d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 --2- 172.21.15.55:0/3652864476 >> v2:172.21.15.138:3300/0 conn(0x7fb44c06d670 0x7fb44c0d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 --2- 172.21.15.55:0/3652864476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb44c0cf940 0x7fb44c0cfd10 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 -- 172.21.15.55:0/3652864476 >> 172.21.15.55:0/3652864476 conn(0x7fb44c06ee80 msgr2=0x7fb44c06f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:35.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 -- 172.21.15.55:0/3652864476 shutdown_connections 2023-07-06T22:01:35.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 -- 172.21.15.55:0/3652864476 wait complete. 2023-07-06T22:01:35.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 Processor -- start 2023-07-06T22:01:35.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 -- start start 2023-07-06T22:01:35.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb44c06d670 0x7fb44c1584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:35.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb44c0cf940 0x7fb44c06bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:35.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb44c0d0790 0x7fb44c150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:35.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c1518a0 con 0x7fb44c06d670 2023-07-06T22:01:35.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c06c0a0 con 0x7fb44c0cf940 2023-07-06T22:01:35.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb451f74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c159ba0 con 0x7fb44c0d0790 2023-07-06T22:01:35.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb44b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb44c06d670 0x7fb44c1584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:35.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb44b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb44c06d670 0x7fb44c1584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42588/0 (socket says 172.21.15.55:42588) 2023-07-06T22:01:35.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.292+0000 7fb44b7fe640 1 -- 172.21.15.55:0/2171347949 learned_addr learned my addr 172.21.15.55:0/2171347949 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:35.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb44affd640 1 --2- 172.21.15.55:0/2171347949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb44c0cf940 0x7fb44c06bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:35.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb44bfff640 1 --2- 172.21.15.55:0/2171347949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb44c0d0790 0x7fb44c150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:35.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb44b7fe640 1 -- 172.21.15.55:0/2171347949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb44c0d0790 msgr2=0x7fb44c150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:35.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb44b7fe640 1 --2- 172.21.15.55:0/2171347949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb44c0d0790 0x7fb44c150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb44b7fe640 1 -- 172.21.15.55:0/2171347949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb44c0cf940 msgr2=0x7fb44c06bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:35.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb44b7fe640 1 --2- 172.21.15.55:0/2171347949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb44c0cf940 0x7fb44c06bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb44b7fe640 1 -- 172.21.15.55:0/2171347949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0094d0 con 0x7fb44c06d670 2023-07-06T22:01:35.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb44b7fe640 1 --2- 172.21.15.55:0/2171347949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb44c06d670 0x7fb44c1584d0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fb43c01cce0 tx=0x7fb43c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:35.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb433fff640 1 -- 172.21.15.55:0/2171347949 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0b4800 con 0x7fb44c06d670 2023-07-06T22:01:35.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb433fff640 1 -- 172.21.15.55:0/2171347949 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c0b4960 con 0x7fb44c06d670 2023-07-06T22:01:35.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb451f74640 1 -- 172.21.15.55:0/2171347949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c1512a0 con 0x7fb44c06d670 2023-07-06T22:01:35.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb433fff640 1 -- 172.21.15.55:0/2171347949 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0b4cf0 con 0x7fb44c06d670 2023-07-06T22:01:35.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb451f74640 1 -- 172.21.15.55:0/2171347949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c158de0 con 0x7fb44c06d670 2023-07-06T22:01:35.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb451f74640 1 -- 172.21.15.55:0/2171347949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c066d60 con 0x7fb44c06d670 2023-07-06T22:01:35.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.296+0000 7fb433fff640 1 -- 172.21.15.55:0/2171347949 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb43c0c7440 con 0x7fb44c06d670 2023-07-06T22:01:35.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.300+0000 7fb433fff640 1 --2- 172.21.15.55:0/2171347949 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb4380663d0 0x7fb438068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:35.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.300+0000 7fb433fff640 1 -- 172.21.15.55:0/2171347949 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb43c11ec90 con 0x7fb44c06d670 2023-07-06T22:01:35.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.300+0000 7fb44affd640 1 --2- 172.21.15.55:0/2171347949 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb4380663d0 0x7fb438068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:35.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.300+0000 7fb44affd640 1 --2- 172.21.15.55:0/2171347949 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb4380663d0 0x7fb438068880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb44c153fb0 tx=0x7fb440008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:35.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.304+0000 7fb433fff640 1 -- 172.21.15.55:0/2171347949 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb43c0ebd80 con 0x7fb44c06d670 2023-07-06T22:01:35.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.516+0000 7fb451f74640 1 -- 172.21.15.55:0/2171347949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb44c0d0fe0 con 0x7fb44c06d670 2023-07-06T22:01:35.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.516+0000 7fb433fff640 1 -- 172.21.15.55:0/2171347949 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3221 (secure 0 0 0) 0x7fb43c0ef3a0 con 0x7fb44c06d670 2023-07-06T22:01:35.514 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:35.515 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1190,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":146,"num_osds":8,"num_up_osds":8,"osd_up_since":1688679717,"num_in_osds":8,"osd_in_since":1688679707,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":354451456,"bytes_avail":772739661824,"bytes_total":773094113280,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":63,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":9198}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-07-06T22:01:11.137639+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-06T22:01:35.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.520+0000 7fb451f74640 1 -- 172.21.15.55:0/2171347949 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb4380663d0 msgr2=0x7fb438068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.520+0000 7fb451f74640 1 --2- 172.21.15.55:0/2171347949 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb4380663d0 0x7fb438068880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb44c153fb0 tx=0x7fb440008040 comp rx=0 tx=0).stop 2023-07-06T22:01:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.520+0000 7fb451f74640 1 -- 172.21.15.55:0/2171347949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb44c06d670 msgr2=0x7fb44c1584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.520+0000 7fb451f74640 1 --2- 172.21.15.55:0/2171347949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb44c06d670 0x7fb44c1584d0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fb43c01cce0 tx=0x7fb43c01ac80 comp rx=0 tx=0).stop 2023-07-06T22:01:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.520+0000 7fb451f74640 1 -- 172.21.15.55:0/2171347949 shutdown_connections 2023-07-06T22:01:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.520+0000 7fb451f74640 1 --2- 172.21.15.55:0/2171347949 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb4380663d0 0x7fb438068880 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.520+0000 7fb451f74640 1 --2- 172.21.15.55:0/2171347949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb44c0d0790 0x7fb44c150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.520+0000 7fb451f74640 1 --2- 172.21.15.55:0/2171347949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb44c0cf940 0x7fb44c06bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.520+0000 7fb451f74640 1 --2- 172.21.15.55:0/2171347949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb44c06d670 0x7fb44c1584d0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.520+0000 7fb451f74640 1 -- 172.21.15.55:0/2171347949 >> 172.21.15.55:0/2171347949 conn(0x7fb44c06ee80 msgr2=0x7fb44c156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:35.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.520+0000 7fb451f74640 1 -- 172.21.15.55:0/2171347949 shutdown_connections 2023-07-06T22:01:35.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.520+0000 7fb451f74640 1 -- 172.21.15.55:0/2171347949 wait complete. 2023-07-06T22:01:35.536 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-06T22:01:35.536 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:01:35.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.680+0000 7f2f386cb640 1 Processor -- start 2023-07-06T22:01:35.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.680+0000 7f2f386cb640 1 -- start start 2023-07-06T22:01:35.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.684+0000 7f2f386cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f300712f0 0x7f2f3006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.684+0000 7f2f386cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f300ca450 0x7f2f3015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.684+0000 7f2f386cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f30159cd0 con 0x7f2f300b3730 2023-07-06T22:01:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.684+0000 7f2f386cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f300693f0 con 0x7f2f300ca450 2023-07-06T22:01:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.684+0000 7f2f386cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3006aca0 con 0x7f2f300712f0 2023-07-06T22:01:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.684+0000 7f2f36c68640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f300ca450 0x7f2f3015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.684+0000 7f2f36c68640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f300ca450 0x7f2f3015d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42602/0 (socket says 172.21.15.55:42602) 2023-07-06T22:01:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.684+0000 7f2f36c68640 1 -- 172.21.15.55:0/2502156140 learned_addr learned my addr 172.21.15.55:0/2502156140 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.684+0000 7f2f36467640 1 --2- 172.21.15.55:0/2502156140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f300712f0 0x7f2f3006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.684+0000 7f2f36c68640 1 -- 172.21.15.55:0/2502156140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f300712f0 msgr2=0x7f2f3006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.684+0000 7f2f36c68640 1 --2- 172.21.15.55:0/2502156140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f300712f0 0x7f2f3006a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.684+0000 7f2f36c68640 1 -- 172.21.15.55:0/2502156140 >> v1:172.21.15.138:6789/0 conn(0x7f2f300b3730 legacy=0x7f2f300c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.684+0000 7f2f36c68640 1 -- 172.21.15.55:0/2502156140 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f300696b0 con 0x7f2f300ca450 2023-07-06T22:01:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.684+0000 7f2f36467640 1 --2- 172.21.15.55:0/2502156140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f300712f0 0x7f2f3006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:35.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.688+0000 7f2f36c68640 1 --2- 172.21.15.55:0/2502156140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f300ca450 0x7f2f3015d3e0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009e50 tx=0x7f2f2801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86403868ab701cf5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:35.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.688+0000 7f2f35465640 1 -- 172.21.15.55:0/2502156140 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f280a5820 con 0x7f2f300ca450 2023-07-06T22:01:35.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.688+0000 7f2f35465640 1 -- 172.21.15.55:0/2502156140 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f280a5980 con 0x7f2f300ca450 2023-07-06T22:01:35.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.688+0000 7f2f35465640 1 -- 172.21.15.55:0/2502156140 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f280a5d10 con 0x7f2f300ca450 2023-07-06T22:01:35.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.688+0000 7f2f386cb640 1 -- 172.21.15.55:0/2502156140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f300ca450 msgr2=0x7f2f3015d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:35.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.688+0000 7f2f386cb640 1 --2- 172.21.15.55:0/2502156140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f300ca450 0x7f2f3015d3e0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009e50 tx=0x7f2f2801c9a0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.688+0000 7f2f386cb640 1 -- 172.21.15.55:0/2502156140 shutdown_connections 2023-07-06T22:01:35.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.688+0000 7f2f386cb640 1 --2- 172.21.15.55:0/2502156140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f300ca450 0x7f2f3015d3e0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.688+0000 7f2f386cb640 1 --2- 172.21.15.55:0/2502156140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f300712f0 0x7f2f3006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.688+0000 7f2f386cb640 1 -- 172.21.15.55:0/2502156140 >> 172.21.15.55:0/2502156140 conn(0x7f2f300cded0 msgr2=0x7f2f300ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:35.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.688+0000 7f2f386cb640 1 -- 172.21.15.55:0/2502156140 shutdown_connections 2023-07-06T22:01:35.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.688+0000 7f2f386cb640 1 -- 172.21.15.55:0/2502156140 wait complete. 2023-07-06T22:01:35.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.688+0000 7f2f386cb640 1 Processor -- start 2023-07-06T22:01:35.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.688+0000 7f2f386cb640 1 -- start start 2023-07-06T22:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f386cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f300712f0 0x7f2f3014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f386cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f300b3730 0x7f2f30150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f386cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f300ca450 0x7f2f30151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f386cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3015b870 con 0x7f2f300b3730 2023-07-06T22:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f386cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3014b1f0 con 0x7f2f300712f0 2023-07-06T22:01:35.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f386cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f300c18a0 con 0x7f2f300ca450 2023-07-06T22:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f35c66640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f300b3730 0x7f2f30150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f35c66640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f300b3730 0x7f2f30150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42616/0 (socket says 172.21.15.55:42616) 2023-07-06T22:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f35c66640 1 -- 172.21.15.55:0/2223337334 learned_addr learned my addr 172.21.15.55:0/2223337334 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f36c68640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f300ca450 0x7f2f30151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f36467640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f300712f0 0x7f2f3014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:35.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f35c66640 1 -- 172.21.15.55:0/2223337334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f300ca450 msgr2=0x7f2f30151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f35c66640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f300ca450 0x7f2f30151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f35c66640 1 -- 172.21.15.55:0/2223337334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f300712f0 msgr2=0x7f2f3014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f35c66640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f300712f0 0x7f2f3014acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f35c66640 1 -- 172.21.15.55:0/2223337334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f28009b30 con 0x7f2f300b3730 2023-07-06T22:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f36467640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f300712f0 0x7f2f3014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f36c68640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f300ca450 0x7f2f30151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f35c66640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f300b3730 0x7f2f30150be0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000b410 tx=0x7f2f2000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:35.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f26ffd640 1 -- 172.21.15.55:0/2223337334 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20004020 con 0x7f2f300b3730 2023-07-06T22:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f26ffd640 1 -- 172.21.15.55:0/2223337334 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f20004180 con 0x7f2f300b3730 2023-07-06T22:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f26ffd640 1 -- 172.21.15.55:0/2223337334 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20011630 con 0x7f2f300b3730 2023-07-06T22:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f386cb640 1 -- 172.21.15.55:0/2223337334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3015acf0 con 0x7f2f300b3730 2023-07-06T22:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f386cb640 1 -- 172.21.15.55:0/2223337334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3015b2b0 con 0x7f2f300b3730 2023-07-06T22:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f386cb640 1 -- 172.21.15.55:0/2223337334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f300ad700 con 0x7f2f300b3730 2023-07-06T22:01:35.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.692+0000 7f2f26ffd640 1 -- 172.21.15.55:0/2223337334 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2f20011790 con 0x7f2f300b3730 2023-07-06T22:01:35.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.696+0000 7f2f26ffd640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f2f140663a0 0x7f2f14068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:35.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.696+0000 7f2f26ffd640 1 -- 172.21.15.55:0/2223337334 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2f20083de0 con 0x7f2f300b3730 2023-07-06T22:01:35.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.696+0000 7f2f36467640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f2f140663a0 0x7f2f14068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:35.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.696+0000 7f2f36467640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f2f140663a0 0x7f2f14068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00a9b0 tx=0x7f2f2c008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:35.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.700+0000 7f2f26ffd640 1 -- 172.21.15.55:0/2223337334 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f20050f50 con 0x7f2f300b3730 2023-07-06T22:01:35.737 INFO:tasks.ceph.mds.a.smithi055.stderr:2023-07-06T22:01:35.740+0000 7f70fb8c5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T22:01:35.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.852+0000 7f2f386cb640 1 -- 172.21.15.55:0/2223337334 --> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f300c4950 con 0x7f2f140663a0 2023-07-06T22:01:35.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.860+0000 7f2f26ffd640 1 -- 172.21.15.55:0/2223337334 <== mgr.8940 v2:172.21.15.55:6832/206120108 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311447 (secure 0 0 0) 0x7f2f2c00a1d0 con 0x7f2f140663a0 2023-07-06T22:01:35.861 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:35.862 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:01:35.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.864+0000 7f2f386cb640 1 -- 172.21.15.55:0/2223337334 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f2f140663a0 msgr2=0x7f2f14068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:35.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.864+0000 7f2f386cb640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f2f140663a0 0x7f2f14068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00a9b0 tx=0x7f2f2c008040 comp rx=0 tx=0).stop 2023-07-06T22:01:35.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.864+0000 7f2f386cb640 1 -- 172.21.15.55:0/2223337334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f300b3730 msgr2=0x7f2f30150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:35.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.864+0000 7f2f386cb640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f300b3730 0x7f2f30150be0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000b410 tx=0x7f2f2000b8d0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.864+0000 7f2f386cb640 1 -- 172.21.15.55:0/2223337334 shutdown_connections 2023-07-06T22:01:35.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.864+0000 7f2f386cb640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f2f140663a0 0x7f2f14068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.864+0000 7f2f386cb640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2f300ca450 0x7f2f30151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.864+0000 7f2f386cb640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f300b3730 0x7f2f30150be0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.864+0000 7f2f386cb640 1 --2- 172.21.15.55:0/2223337334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f300712f0 0x7f2f3014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:35.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.864+0000 7f2f386cb640 1 -- 172.21.15.55:0/2223337334 >> 172.21.15.55:0/2223337334 conn(0x7f2f300cded0 msgr2=0x7f2f30152bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:35.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.864+0000 7f2f386cb640 1 -- 172.21.15.55:0/2223337334 shutdown_connections 2023-07-06T22:01:35.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:35.864+0000 7f2f386cb640 1 -- 172.21.15.55:0/2223337334 wait complete. 2023-07-06T22:01:35.881 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-07-06T22:01:35.142006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":443,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287,"ondisk_log_size":287,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":191,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":346592,"kb_used_data":15392,"kb_used_omap":0,"kb_used_meta":331136,"kb_avail":754628128,"statfs":{"total":773094113280,"available":772739203072,"internally_reserved":0,"allocated":15761408,"data_stored":8901270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339083264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000965"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.189294+0000","last_change":"2023-07-06T22:01:30.202139+0000","last_active":"2023-07-06T22:01:31.189294+0000","last_peered":"2023-07-06T22:01:31.189294+0000","last_clean":"2023-07-06T22:01:31.189294+0000","last_became_active":"2023-07-06T22:01:30.201791+0000","last_became_peered":"2023-07-06T22:01:30.201791+0000","last_unstale":"2023-07-06T22:01:31.189294+0000","last_undegraded":"2023-07-06T22:01:31.189294+0000","last_fullsized":"2023-07-06T22:01:31.189294+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:58.592296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806397+0000","last_change":"2023-07-06T22:01:30.203970+0000","last_active":"2023-07-06T22:01:31.806397+0000","last_peered":"2023-07-06T22:01:31.806397+0000","last_clean":"2023-07-06T22:01:31.806397+0000","last_became_active":"2023-07-06T22:01:30.203687+0000","last_became_peered":"2023-07-06T22:01:30.203687+0000","last_unstale":"2023-07-06T22:01:31.806397+0000","last_undegraded":"2023-07-06T22:01:31.806397+0000","last_fullsized":"2023-07-06T22:01:31.806397+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:36:09.073776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806785+0000","last_change":"2023-07-06T22:01:30.212727+0000","last_active":"2023-07-06T22:01:31.806785+0000","last_peered":"2023-07-06T22:01:31.806785+0000","last_clean":"2023-07-06T22:01:31.806785+0000","last_became_active":"2023-07-06T22:01:30.212464+0000","last_became_peered":"2023-07-06T22:01:30.212464+0000","last_unstale":"2023-07-06T22:01:31.806785+0000","last_undegraded":"2023-07-06T22:01:31.806785+0000","last_fullsized":"2023-07-06T22:01:31.806785+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:38:56.861284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188988+0000","last_change":"2023-07-06T22:01:30.201607+0000","last_active":"2023-07-06T22:01:31.188988+0000","last_peered":"2023-07-06T22:01:31.188988+0000","last_clean":"2023-07-06T22:01:31.188988+0000","last_became_active":"2023-07-06T22:01:30.201158+0000","last_became_peered":"2023-07-06T22:01:30.201158+0000","last_unstale":"2023-07-06T22:01:31.188988+0000","last_undegraded":"2023-07-06T22:01:31.188988+0000","last_fullsized":"2023-07-06T22:01:31.188988+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:08:36.301998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186774+0000","last_change":"2023-07-06T22:01:30.214327+0000","last_active":"2023-07-06T22:01:31.186774+0000","last_peered":"2023-07-06T22:01:31.186774+0000","last_clean":"2023-07-06T22:01:31.186774+0000","last_became_active":"2023-07-06T22:01:30.214046+0000","last_became_peered":"2023-07-06T22:01:30.214046+0000","last_unstale":"2023-07-06T22:01:31.186774+0000","last_undegraded":"2023-07-06T22:01:31.186774+0000","last_fullsized":"2023-07-06T22:01:31.186774+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:44:44.746304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186278+0000","last_change":"2023-07-06T22:01:30.212605+0000","last_active":"2023-07-06T22:01:31.186278+0000","last_peered":"2023-07-06T22:01:31.186278+0000","last_clean":"2023-07-06T22:01:31.186278+0000","last_became_active":"2023-07-06T22:01:30.212356+0000","last_became_peered":"2023-07-06T22:01:30.212356+0000","last_unstale":"2023-07-06T22:01:31.186278+0000","last_undegraded":"2023-07-06T22:01:31.186278+0000","last_fullsized":"2023-07-06T22:01:31.186278+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:57:10.479425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186663+0000","last_change":"2023-07-06T22:01:30.204625+0000","last_active":"2023-07-06T22:01:31.186663+0000","last_peered":"2023-07-06T22:01:31.186663+0000","last_clean":"2023-07-06T22:01:31.186663+0000","last_became_active":"2023-07-06T22:01:30.204307+0000","last_became_peered":"2023-07-06T22:01:30.204307+0000","last_unstale":"2023-07-06T22:01:31.186663+0000","last_undegraded":"2023-07-06T22:01:31.186663+0000","last_fullsized":"2023-07-06T22:01:31.186663+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:36:21.572347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806391+0000","last_change":"2023-07-06T22:01:30.212554+0000","last_active":"2023-07-06T22:01:31.806391+0000","last_peered":"2023-07-06T22:01:31.806391+0000","last_clean":"2023-07-06T22:01:31.806391+0000","last_became_active":"2023-07-06T22:01:30.212316+0000","last_became_peered":"2023-07-06T22:01:30.212316+0000","last_unstale":"2023-07-06T22:01:31.806391+0000","last_undegraded":"2023-07-06T22:01:31.806391+0000","last_fullsized":"2023-07-06T22:01:31.806391+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:10:48.916645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807367+0000","last_change":"2023-07-06T22:01:30.210106+0000","last_active":"2023-07-06T22:01:31.807367+0000","last_peered":"2023-07-06T22:01:31.807367+0000","last_clean":"2023-07-06T22:01:31.807367+0000","last_became_active":"2023-07-06T22:01:30.209851+0000","last_became_peered":"2023-07-06T22:01:30.209851+0000","last_unstale":"2023-07-06T22:01:31.807367+0000","last_undegraded":"2023-07-06T22:01:31.807367+0000","last_fullsized":"2023-07-06T22:01:31.807367+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:22:03.750459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806569+0000","last_change":"2023-07-06T22:01:30.201099+0000","last_active":"2023-07-06T22:01:31.806569+0000","last_peered":"2023-07-06T22:01:31.806569+0000","last_clean":"2023-07-06T22:01:31.806569+0000","last_became_active":"2023-07-06T22:01:30.200819+0000","last_became_peered":"2023-07-06T22:01:30.200819+0000","last_unstale":"2023-07-06T22:01:31.806569+0000","last_undegraded":"2023-07-06T22:01:31.806569+0000","last_fullsized":"2023-07-06T22:01:31.806569+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:40:25.366222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734237+0000","last_change":"2023-07-06T22:01:30.212053+0000","last_active":"2023-07-06T22:01:31.734237+0000","last_peered":"2023-07-06T22:01:31.734237+0000","last_clean":"2023-07-06T22:01:31.734237+0000","last_became_active":"2023-07-06T22:01:30.211724+0000","last_became_peered":"2023-07-06T22:01:30.211724+0000","last_unstale":"2023-07-06T22:01:31.734237+0000","last_undegraded":"2023-07-06T22:01:31.734237+0000","last_fullsized":"2023-07-06T22:01:31.734237+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:42:38.158199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806665+0000","last_change":"2023-07-06T22:01:30.209904+0000","last_active":"2023-07-06T22:01:31.806665+0000","last_peered":"2023-07-06T22:01:31.806665+0000","last_clean":"2023-07-06T22:01:31.806665+0000","last_became_active":"2023-07-06T22:01:30.209659+0000","last_became_peered":"2023-07-06T22:01:30.209659+0000","last_unstale":"2023-07-06T22:01:31.806665+0000","last_undegraded":"2023-07-06T22:01:31.806665+0000","last_fullsized":"2023-07-06T22:01:31.806665+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:37:27.445263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188732+0000","last_change":"2023-07-06T22:01:30.205544+0000","last_active":"2023-07-06T22:01:31.188732+0000","last_peered":"2023-07-06T22:01:31.188732+0000","last_clean":"2023-07-06T22:01:31.188732+0000","last_became_active":"2023-07-06T22:01:30.205232+0000","last_became_peered":"2023-07-06T22:01:30.205232+0000","last_unstale":"2023-07-06T22:01:31.188732+0000","last_undegraded":"2023-07-06T22:01:31.188732+0000","last_fullsized":"2023-07-06T22:01:31.188732+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:59:53.657252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806925+0000","last_change":"2023-07-06T22:01:30.198750+0000","last_active":"2023-07-06T22:01:31.806925+0000","last_peered":"2023-07-06T22:01:31.806925+0000","last_clean":"2023-07-06T22:01:31.806925+0000","last_became_active":"2023-07-06T22:01:30.198504+0000","last_became_peered":"2023-07-06T22:01:30.198504+0000","last_unstale":"2023-07-06T22:01:31.806925+0000","last_undegraded":"2023-07-06T22:01:31.806925+0000","last_fullsized":"2023-07-06T22:01:31.806925+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:12:49.764625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188726+0000","last_change":"2023-07-06T22:01:30.204041+0000","last_active":"2023-07-06T22:01:31.188726+0000","last_peered":"2023-07-06T22:01:31.188726+0000","last_clean":"2023-07-06T22:01:31.188726+0000","last_became_active":"2023-07-06T22:01:30.203760+0000","last_became_peered":"2023-07-06T22:01:30.203760+0000","last_unstale":"2023-07-06T22:01:31.188726+0000","last_undegraded":"2023-07-06T22:01:31.188726+0000","last_fullsized":"2023-07-06T22:01:31.188726+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:19:38.656293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805826+0000","last_change":"2023-07-06T22:01:30.211282+0000","last_active":"2023-07-06T22:01:31.805826+0000","last_peered":"2023-07-06T22:01:31.805826+0000","last_clean":"2023-07-06T22:01:31.805826+0000","last_became_active":"2023-07-06T22:01:30.210955+0000","last_became_peered":"2023-07-06T22:01:30.210955+0000","last_unstale":"2023-07-06T22:01:31.805826+0000","last_undegraded":"2023-07-06T22:01:31.805826+0000","last_fullsized":"2023-07-06T22:01:31.805826+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:21:42.017820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186672+0000","last_change":"2023-07-06T22:01:30.216192+0000","last_active":"2023-07-06T22:01:31.186672+0000","last_peered":"2023-07-06T22:01:31.186672+0000","last_clean":"2023-07-06T22:01:31.186672+0000","last_became_active":"2023-07-06T22:01:30.215957+0000","last_became_peered":"2023-07-06T22:01:30.215957+0000","last_unstale":"2023-07-06T22:01:31.186672+0000","last_undegraded":"2023-07-06T22:01:31.186672+0000","last_fullsized":"2023-07-06T22:01:31.186672+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:16:31.849023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806120+0000","last_change":"2023-07-06T22:01:30.210005+0000","last_active":"2023-07-06T22:01:31.806120+0000","last_peered":"2023-07-06T22:01:31.806120+0000","last_clean":"2023-07-06T22:01:31.806120+0000","last_became_active":"2023-07-06T22:01:30.209746+0000","last_became_peered":"2023-07-06T22:01:30.209746+0000","last_unstale":"2023-07-06T22:01:31.806120+0000","last_undegraded":"2023-07-06T22:01:31.806120+0000","last_fullsized":"2023-07-06T22:01:31.806120+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:55:37.854956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734305+0000","last_change":"2023-07-06T22:01:30.207865+0000","last_active":"2023-07-06T22:01:31.734305+0000","last_peered":"2023-07-06T22:01:31.734305+0000","last_clean":"2023-07-06T22:01:31.734305+0000","last_became_active":"2023-07-06T22:01:30.207485+0000","last_became_peered":"2023-07-06T22:01:30.207485+0000","last_unstale":"2023-07-06T22:01:31.734305+0000","last_undegraded":"2023-07-06T22:01:31.734305+0000","last_fullsized":"2023-07-06T22:01:31.734305+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:07:43.866882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806189+0000","last_change":"2023-07-06T22:01:30.217387+0000","last_active":"2023-07-06T22:01:31.806189+0000","last_peered":"2023-07-06T22:01:31.806189+0000","last_clean":"2023-07-06T22:01:31.806189+0000","last_became_active":"2023-07-06T22:01:30.217124+0000","last_became_peered":"2023-07-06T22:01:30.217124+0000","last_unstale":"2023-07-06T22:01:31.806189+0000","last_undegraded":"2023-07-06T22:01:31.806189+0000","last_fullsized":"2023-07-06T22:01:31.806189+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:58:45.833979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186508+0000","last_change":"2023-07-06T22:01:30.201925+0000","last_active":"2023-07-06T22:01:31.186508+0000","last_peered":"2023-07-06T22:01:31.186508+0000","last_clean":"2023-07-06T22:01:31.186508+0000","last_became_active":"2023-07-06T22:01:30.201652+0000","last_became_peered":"2023-07-06T22:01:30.201652+0000","last_unstale":"2023-07-06T22:01:31.186508+0000","last_undegraded":"2023-07-06T22:01:31.186508+0000","last_fullsized":"2023-07-06T22:01:31.186508+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:27:20.105941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734165+0000","last_change":"2023-07-06T22:01:30.207879+0000","last_active":"2023-07-06T22:01:31.734165+0000","last_peered":"2023-07-06T22:01:31.734165+0000","last_clean":"2023-07-06T22:01:31.734165+0000","last_became_active":"2023-07-06T22:01:30.207597+0000","last_became_peered":"2023-07-06T22:01:30.207597+0000","last_unstale":"2023-07-06T22:01:31.734165+0000","last_undegraded":"2023-07-06T22:01:31.734165+0000","last_fullsized":"2023-07-06T22:01:31.734165+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:59.745490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807065+0000","last_change":"2023-07-06T22:01:30.209406+0000","last_active":"2023-07-06T22:01:31.807065+0000","last_peered":"2023-07-06T22:01:31.807065+0000","last_clean":"2023-07-06T22:01:31.807065+0000","last_became_active":"2023-07-06T22:01:30.208808+0000","last_became_peered":"2023-07-06T22:01:30.208808+0000","last_unstale":"2023-07-06T22:01:31.807065+0000","last_undegraded":"2023-07-06T22:01:31.807065+0000","last_fullsized":"2023-07-06T22:01:31.807065+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:48:33.232722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734163+0000","last_change":"2023-07-06T22:01:30.211299+0000","last_active":"2023-07-06T22:01:31.734163+0000","last_peered":"2023-07-06T22:01:31.734163+0000","last_clean":"2023-07-06T22:01:31.734163+0000","last_became_active":"2023-07-06T22:01:30.211053+0000","last_became_peered":"2023-07-06T22:01:30.211053+0000","last_unstale":"2023-07-06T22:01:31.734163+0000","last_undegraded":"2023-07-06T22:01:31.734163+0000","last_fullsized":"2023-07-06T22:01:31.734163+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:46:29.517113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805997+0000","last_change":"2023-07-06T22:01:30.198896+0000","last_active":"2023-07-06T22:01:31.805997+0000","last_peered":"2023-07-06T22:01:31.805997+0000","last_clean":"2023-07-06T22:01:31.805997+0000","last_became_active":"2023-07-06T22:01:30.198648+0000","last_became_peered":"2023-07-06T22:01:30.198648+0000","last_unstale":"2023-07-06T22:01:31.805997+0000","last_undegraded":"2023-07-06T22:01:31.805997+0000","last_fullsized":"2023-07-06T22:01:31.805997+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:02.376692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806280+0000","last_change":"2023-07-06T22:01:30.215411+0000","last_active":"2023-07-06T22:01:31.806280+0000","last_peered":"2023-07-06T22:01:31.806280+0000","last_clean":"2023-07-06T22:01:31.806280+0000","last_became_active":"2023-07-06T22:01:30.215149+0000","last_became_peered":"2023-07-06T22:01:30.215149+0000","last_unstale":"2023-07-06T22:01:31.806280+0000","last_undegraded":"2023-07-06T22:01:31.806280+0000","last_fullsized":"2023-07-06T22:01:31.806280+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:01:57.488336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188995+0000","last_change":"2023-07-06T22:01:30.205965+0000","last_active":"2023-07-06T22:01:31.188995+0000","last_peered":"2023-07-06T22:01:31.188995+0000","last_clean":"2023-07-06T22:01:31.188995+0000","last_became_active":"2023-07-06T22:01:30.205693+0000","last_became_peered":"2023-07-06T22:01:30.205693+0000","last_unstale":"2023-07-06T22:01:31.188995+0000","last_undegraded":"2023-07-06T22:01:31.188995+0000","last_fullsized":"2023-07-06T22:01:31.188995+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:07:42.715883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807117+0000","last_change":"2023-07-06T22:01:30.219656+0000","last_active":"2023-07-06T22:01:31.807117+0000","last_peered":"2023-07-06T22:01:31.807117+0000","last_clean":"2023-07-06T22:01:31.807117+0000","last_became_active":"2023-07-06T22:01:30.219354+0000","last_became_peered":"2023-07-06T22:01:30.219354+0000","last_unstale":"2023-07-06T22:01:31.807117+0000","last_undegraded":"2023-07-06T22:01:31.807117+0000","last_fullsized":"2023-07-06T22:01:31.807117+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:57:15.970992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188904+0000","last_change":"2023-07-06T22:01:30.207943+0000","last_active":"2023-07-06T22:01:31.188904+0000","last_peered":"2023-07-06T22:01:31.188904+0000","last_clean":"2023-07-06T22:01:31.188904+0000","last_became_active":"2023-07-06T22:01:30.207677+0000","last_became_peered":"2023-07-06T22:01:30.207677+0000","last_unstale":"2023-07-06T22:01:31.188904+0000","last_undegraded":"2023-07-06T22:01:31.188904+0000","last_fullsized":"2023-07-06T22:01:31.188904+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:20:24.012000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188817+0000","last_change":"2023-07-06T22:01:30.208229+0000","last_active":"2023-07-06T22:01:31.188817+0000","last_peered":"2023-07-06T22:01:31.188817+0000","last_clean":"2023-07-06T22:01:31.188817+0000","last_became_active":"2023-07-06T22:01:30.207357+0000","last_became_peered":"2023-07-06T22:01:30.207357+0000","last_unstale":"2023-07-06T22:01:31.188817+0000","last_undegraded":"2023-07-06T22:01:31.188817+0000","last_fullsized":"2023-07-06T22:01:31.188817+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:35:49.698083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186606+0000","last_change":"2023-07-06T22:01:30.206434+0000","last_active":"2023-07-06T22:01:31.186606+0000","last_peered":"2023-07-06T22:01:31.186606+0000","last_clean":"2023-07-06T22:01:31.186606+0000","last_became_active":"2023-07-06T22:01:30.206129+0000","last_became_peered":"2023-07-06T22:01:30.206129+0000","last_unstale":"2023-07-06T22:01:31.186606+0000","last_undegraded":"2023-07-06T22:01:31.186606+0000","last_fullsized":"2023-07-06T22:01:31.186606+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:15.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186039+0000","last_change":"2023-07-06T22:01:30.209952+0000","last_active":"2023-07-06T22:01:31.186039+0000","last_peered":"2023-07-06T22:01:31.186039+0000","last_clean":"2023-07-06T22:01:31.186039+0000","last_became_active":"2023-07-06T22:01:30.209625+0000","last_became_peered":"2023-07-06T22:01:30.209625+0000","last_unstale":"2023-07-06T22:01:31.186039+0000","last_undegraded":"2023-07-06T22:01:31.186039+0000","last_fullsized":"2023-07-06T22:01:31.186039+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:01:43.281042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806433+0000","last_change":"2023-07-06T22:01:30.212341+0000","last_active":"2023-07-06T22:01:31.806433+0000","last_peered":"2023-07-06T22:01:31.806433+0000","last_clean":"2023-07-06T22:01:31.806433+0000","last_became_active":"2023-07-06T22:01:30.212076+0000","last_became_peered":"2023-07-06T22:01:30.212076+0000","last_unstale":"2023-07-06T22:01:31.806433+0000","last_undegraded":"2023-07-06T22:01:31.806433+0000","last_fullsized":"2023-07-06T22:01:31.806433+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:11:27.767581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"145'4","reported_seq":17,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.187106+0000","last_change":"2023-07-06T22:01:29.804235+0000","last_active":"2023-07-06T22:01:31.187106+0000","last_peered":"2023-07-06T22:01:31.187106+0000","last_clean":"2023-07-06T22:01:31.187106+0000","last_became_active":"2023-07-06T22:01:29.803918+0000","last_became_peered":"2023-07-06T22:01:29.803918+0000","last_unstale":"2023-07-06T22:01:31.187106+0000","last_undegraded":"2023-07-06T22:01:31.187106+0000","last_fullsized":"2023-07-06T22:01:31.187106+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:43:48.235109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807417+0000","last_change":"2023-07-06T22:01:30.217215+0000","last_active":"2023-07-06T22:01:31.807417+0000","last_peered":"2023-07-06T22:01:31.807417+0000","last_clean":"2023-07-06T22:01:31.807417+0000","last_became_active":"2023-07-06T22:01:30.216914+0000","last_became_peered":"2023-07-06T22:01:30.216914+0000","last_unstale":"2023-07-06T22:01:31.807417+0000","last_undegraded":"2023-07-06T22:01:31.807417+0000","last_fullsized":"2023-07-06T22:01:31.807417+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:46:02.431370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806745+0000","last_change":"2023-07-06T22:01:29.791090+0000","last_active":"2023-07-06T22:01:31.806745+0000","last_peered":"2023-07-06T22:01:31.806745+0000","last_clean":"2023-07-06T22:01:31.806745+0000","last_became_active":"2023-07-06T22:01:29.790816+0000","last_became_peered":"2023-07-06T22:01:29.790816+0000","last_unstale":"2023-07-06T22:01:31.806745+0000","last_undegraded":"2023-07-06T22:01:31.806745+0000","last_fullsized":"2023-07-06T22:01:31.806745+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:43:32.395332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186979+0000","last_change":"2023-07-06T22:01:30.211788+0000","last_active":"2023-07-06T22:01:31.186979+0000","last_peered":"2023-07-06T22:01:31.186979+0000","last_clean":"2023-07-06T22:01:31.186979+0000","last_became_active":"2023-07-06T22:01:30.210519+0000","last_became_peered":"2023-07-06T22:01:30.210519+0000","last_unstale":"2023-07-06T22:01:31.186979+0000","last_undegraded":"2023-07-06T22:01:31.186979+0000","last_fullsized":"2023-07-06T22:01:31.186979+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:15:12.582649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734382+0000","last_change":"2023-07-06T22:01:29.796870+0000","last_active":"2023-07-06T22:01:31.734382+0000","last_peered":"2023-07-06T22:01:31.734382+0000","last_clean":"2023-07-06T22:01:31.734382+0000","last_became_active":"2023-07-06T22:01:29.796610+0000","last_became_peered":"2023-07-06T22:01:29.796610+0000","last_unstale":"2023-07-06T22:01:31.734382+0000","last_undegraded":"2023-07-06T22:01:31.734382+0000","last_fullsized":"2023-07-06T22:01:31.734382+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:59:33.038650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.187062+0000","last_change":"2023-07-06T22:01:30.212093+0000","last_active":"2023-07-06T22:01:31.187062+0000","last_peered":"2023-07-06T22:01:31.187062+0000","last_clean":"2023-07-06T22:01:31.187062+0000","last_became_active":"2023-07-06T22:01:30.211863+0000","last_became_peered":"2023-07-06T22:01:30.211863+0000","last_unstale":"2023-07-06T22:01:31.187062+0000","last_undegraded":"2023-07-06T22:01:31.187062+0000","last_fullsized":"2023-07-06T22:01:31.187062+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:42:21.830272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806725+0000","last_change":"2023-07-06T22:01:29.798688+0000","last_active":"2023-07-06T22:01:31.806725+0000","last_peered":"2023-07-06T22:01:31.806725+0000","last_clean":"2023-07-06T22:01:31.806725+0000","last_became_active":"2023-07-06T22:01:29.798417+0000","last_became_peered":"2023-07-06T22:01:29.798417+0000","last_unstale":"2023-07-06T22:01:31.806725+0000","last_undegraded":"2023-07-06T22:01:31.806725+0000","last_fullsized":"2023-07-06T22:01:31.806725+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:58:44.196833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805856+0000","last_change":"2023-07-06T22:01:30.206169+0000","last_active":"2023-07-06T22:01:31.805856+0000","last_peered":"2023-07-06T22:01:31.805856+0000","last_clean":"2023-07-06T22:01:31.805856+0000","last_became_active":"2023-07-06T22:01:30.205905+0000","last_became_peered":"2023-07-06T22:01:30.205905+0000","last_unstale":"2023-07-06T22:01:31.805856+0000","last_undegraded":"2023-07-06T22:01:31.805856+0000","last_fullsized":"2023-07-06T22:01:31.805856+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:58:37.381373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806682+0000","last_change":"2023-07-06T22:01:29.794711+0000","last_active":"2023-07-06T22:01:31.806682+0000","last_peered":"2023-07-06T22:01:31.806682+0000","last_clean":"2023-07-06T22:01:31.806682+0000","last_became_active":"2023-07-06T22:01:29.794443+0000","last_became_peered":"2023-07-06T22:01:29.794443+0000","last_unstale":"2023-07-06T22:01:31.806682+0000","last_undegraded":"2023-07-06T22:01:31.806682+0000","last_fullsized":"2023-07-06T22:01:31.806682+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:42:27.392314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186717+0000","last_change":"2023-07-06T22:01:30.215700+0000","last_active":"2023-07-06T22:01:31.186717+0000","last_peered":"2023-07-06T22:01:31.186717+0000","last_clean":"2023-07-06T22:01:31.186717+0000","last_became_active":"2023-07-06T22:01:30.215455+0000","last_became_peered":"2023-07-06T22:01:30.215455+0000","last_unstale":"2023-07-06T22:01:31.186717+0000","last_undegraded":"2023-07-06T22:01:31.186717+0000","last_fullsized":"2023-07-06T22:01:31.186717+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:37:39.517326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805987+0000","last_change":"2023-07-06T22:01:29.793005+0000","last_active":"2023-07-06T22:01:31.805987+0000","last_peered":"2023-07-06T22:01:31.805987+0000","last_clean":"2023-07-06T22:01:31.805987+0000","last_became_active":"2023-07-06T22:01:29.792720+0000","last_became_peered":"2023-07-06T22:01:29.792720+0000","last_unstale":"2023-07-06T22:01:31.805987+0000","last_undegraded":"2023-07-06T22:01:31.805987+0000","last_fullsized":"2023-07-06T22:01:31.805987+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:34:50.206801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806527+0000","last_change":"2023-07-06T22:01:30.212071+0000","last_active":"2023-07-06T22:01:31.806527+0000","last_peered":"2023-07-06T22:01:31.806527+0000","last_clean":"2023-07-06T22:01:31.806527+0000","last_became_active":"2023-07-06T22:01:30.211831+0000","last_became_peered":"2023-07-06T22:01:30.211831+0000","last_unstale":"2023-07-06T22:01:31.806527+0000","last_undegraded":"2023-07-06T22:01:31.806527+0000","last_fullsized":"2023-07-06T22:01:31.806527+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:38:59.425006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186028+0000","last_change":"2023-07-06T22:01:29.801494+0000","last_active":"2023-07-06T22:01:31.186028+0000","last_peered":"2023-07-06T22:01:31.186028+0000","last_clean":"2023-07-06T22:01:31.186028+0000","last_became_active":"2023-07-06T22:01:29.801223+0000","last_became_peered":"2023-07-06T22:01:29.801223+0000","last_unstale":"2023-07-06T22:01:31.186028+0000","last_undegraded":"2023-07-06T22:01:31.186028+0000","last_fullsized":"2023-07-06T22:01:31.186028+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:23:23.121560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806292+0000","last_change":"2023-07-06T22:01:30.205372+0000","last_active":"2023-07-06T22:01:31.806292+0000","last_peered":"2023-07-06T22:01:31.806292+0000","last_clean":"2023-07-06T22:01:31.806292+0000","last_became_active":"2023-07-06T22:01:30.205111+0000","last_became_peered":"2023-07-06T22:01:30.205111+0000","last_unstale":"2023-07-06T22:01:31.806292+0000","last_undegraded":"2023-07-06T22:01:31.806292+0000","last_fullsized":"2023-07-06T22:01:31.806292+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:39.851133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806088+0000","last_change":"2023-07-06T22:01:29.796326+0000","last_active":"2023-07-06T22:01:31.806088+0000","last_peered":"2023-07-06T22:01:31.806088+0000","last_clean":"2023-07-06T22:01:31.806088+0000","last_became_active":"2023-07-06T22:01:29.796073+0000","last_became_peered":"2023-07-06T22:01:29.796073+0000","last_unstale":"2023-07-06T22:01:31.806088+0000","last_undegraded":"2023-07-06T22:01:31.806088+0000","last_fullsized":"2023-07-06T22:01:31.806088+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:19:19.267850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807314+0000","last_change":"2023-07-06T22:01:30.215326+0000","last_active":"2023-07-06T22:01:31.807314+0000","last_peered":"2023-07-06T22:01:31.807314+0000","last_clean":"2023-07-06T22:01:31.807314+0000","last_became_active":"2023-07-06T22:01:30.215072+0000","last_became_peered":"2023-07-06T22:01:30.215072+0000","last_unstale":"2023-07-06T22:01:31.807314+0000","last_undegraded":"2023-07-06T22:01:31.807314+0000","last_fullsized":"2023-07-06T22:01:31.807314+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:44:09.147087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807115+0000","last_change":"2023-07-06T22:01:29.792802+0000","last_active":"2023-07-06T22:01:31.807115+0000","last_peered":"2023-07-06T22:01:31.807115+0000","last_clean":"2023-07-06T22:01:31.807115+0000","last_became_active":"2023-07-06T22:01:29.792538+0000","last_became_peered":"2023-07-06T22:01:29.792538+0000","last_unstale":"2023-07-06T22:01:31.807115+0000","last_undegraded":"2023-07-06T22:01:31.807115+0000","last_fullsized":"2023-07-06T22:01:31.807115+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:50:40.390091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806984+0000","last_change":"2023-07-06T22:01:30.208707+0000","last_active":"2023-07-06T22:01:31.806984+0000","last_peered":"2023-07-06T22:01:31.806984+0000","last_clean":"2023-07-06T22:01:31.806984+0000","last_became_active":"2023-07-06T22:01:30.208402+0000","last_became_peered":"2023-07-06T22:01:30.208402+0000","last_unstale":"2023-07-06T22:01:31.806984+0000","last_undegraded":"2023-07-06T22:01:31.806984+0000","last_fullsized":"2023-07-06T22:01:31.806984+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:57:28.976735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734475+0000","last_change":"2023-07-06T22:01:29.793575+0000","last_active":"2023-07-06T22:01:31.734475+0000","last_peered":"2023-07-06T22:01:31.734475+0000","last_clean":"2023-07-06T22:01:31.734475+0000","last_became_active":"2023-07-06T22:01:29.793341+0000","last_became_peered":"2023-07-06T22:01:29.793341+0000","last_unstale":"2023-07-06T22:01:31.734475+0000","last_undegraded":"2023-07-06T22:01:31.734475+0000","last_fullsized":"2023-07-06T22:01:31.734475+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:59:47.919232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806354+0000","last_change":"2023-07-06T22:01:30.221626+0000","last_active":"2023-07-06T22:01:31.806354+0000","last_peered":"2023-07-06T22:01:31.806354+0000","last_clean":"2023-07-06T22:01:31.806354+0000","last_became_active":"2023-07-06T22:01:30.221343+0000","last_became_peered":"2023-07-06T22:01:30.221343+0000","last_unstale":"2023-07-06T22:01:31.806354+0000","last_undegraded":"2023-07-06T22:01:31.806354+0000","last_fullsized":"2023-07-06T22:01:31.806354+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:09:23.999285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186470+0000","last_change":"2023-07-06T22:01:29.797214+0000","last_active":"2023-07-06T22:01:31.186470+0000","last_peered":"2023-07-06T22:01:31.186470+0000","last_clean":"2023-07-06T22:01:31.186470+0000","last_became_active":"2023-07-06T22:01:29.796834+0000","last_became_peered":"2023-07-06T22:01:29.796834+0000","last_unstale":"2023-07-06T22:01:31.186470+0000","last_undegraded":"2023-07-06T22:01:31.186470+0000","last_fullsized":"2023-07-06T22:01:31.186470+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:34:27.187587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806943+0000","last_change":"2023-07-06T22:01:30.206181+0000","last_active":"2023-07-06T22:01:31.806943+0000","last_peered":"2023-07-06T22:01:31.806943+0000","last_clean":"2023-07-06T22:01:31.806943+0000","last_became_active":"2023-07-06T22:01:30.205926+0000","last_became_peered":"2023-07-06T22:01:30.205926+0000","last_unstale":"2023-07-06T22:01:31.806943+0000","last_undegraded":"2023-07-06T22:01:31.806943+0000","last_fullsized":"2023-07-06T22:01:31.806943+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:20:45.375518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806546+0000","last_change":"2023-07-06T22:01:29.799293+0000","last_active":"2023-07-06T22:01:31.806546+0000","last_peered":"2023-07-06T22:01:31.806546+0000","last_clean":"2023-07-06T22:01:31.806546+0000","last_became_active":"2023-07-06T22:01:29.799023+0000","last_became_peered":"2023-07-06T22:01:29.799023+0000","last_unstale":"2023-07-06T22:01:31.806546+0000","last_undegraded":"2023-07-06T22:01:31.806546+0000","last_fullsized":"2023-07-06T22:01:31.806546+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:36:28.487053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.189292+0000","last_change":"2023-07-06T22:01:30.202900+0000","last_active":"2023-07-06T22:01:31.189292+0000","last_peered":"2023-07-06T22:01:31.189292+0000","last_clean":"2023-07-06T22:01:31.189292+0000","last_became_active":"2023-07-06T22:01:30.202618+0000","last_became_peered":"2023-07-06T22:01:30.202618+0000","last_unstale":"2023-07-06T22:01:31.189292+0000","last_undegraded":"2023-07-06T22:01:31.189292+0000","last_fullsized":"2023-07-06T22:01:31.189292+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:07:47.913600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806412+0000","last_change":"2023-07-06T22:01:29.787038+0000","last_active":"2023-07-06T22:01:31.806412+0000","last_peered":"2023-07-06T22:01:31.806412+0000","last_clean":"2023-07-06T22:01:31.806412+0000","last_became_active":"2023-07-06T22:01:29.786673+0000","last_became_peered":"2023-07-06T22:01:29.786673+0000","last_unstale":"2023-07-06T22:01:31.806412+0000","last_undegraded":"2023-07-06T22:01:31.806412+0000","last_fullsized":"2023-07-06T22:01:31.806412+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:01:07.295016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186429+0000","last_change":"2023-07-06T22:01:30.215219+0000","last_active":"2023-07-06T22:01:31.186429+0000","last_peered":"2023-07-06T22:01:31.186429+0000","last_clean":"2023-07-06T22:01:31.186429+0000","last_became_active":"2023-07-06T22:01:30.214960+0000","last_became_peered":"2023-07-06T22:01:30.214960+0000","last_unstale":"2023-07-06T22:01:31.186429+0000","last_undegraded":"2023-07-06T22:01:31.186429+0000","last_fullsized":"2023-07-06T22:01:31.186429+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:01:21.830665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806482+0000","last_change":"2023-07-06T22:01:29.793095+0000","last_active":"2023-07-06T22:01:31.806482+0000","last_peered":"2023-07-06T22:01:31.806482+0000","last_clean":"2023-07-06T22:01:31.806482+0000","last_became_active":"2023-07-06T22:01:29.792783+0000","last_became_peered":"2023-07-06T22:01:29.792783+0000","last_unstale":"2023-07-06T22:01:31.806482+0000","last_undegraded":"2023-07-06T22:01:31.806482+0000","last_fullsized":"2023-07-06T22:01:31.806482+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:03:21.249094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805974+0000","last_change":"2023-07-06T22:01:30.212113+0000","last_active":"2023-07-06T22:01:31.805974+0000","last_peered":"2023-07-06T22:01:31.805974+0000","last_clean":"2023-07-06T22:01:31.805974+0000","last_became_active":"2023-07-06T22:01:30.211833+0000","last_became_peered":"2023-07-06T22:01:30.211833+0000","last_unstale":"2023-07-06T22:01:31.805974+0000","last_undegraded":"2023-07-06T22:01:31.805974+0000","last_fullsized":"2023-07-06T22:01:31.805974+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:32:01.464462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805802+0000","last_change":"2023-07-06T22:01:29.791630+0000","last_active":"2023-07-06T22:01:31.805802+0000","last_peered":"2023-07-06T22:01:31.805802+0000","last_clean":"2023-07-06T22:01:31.805802+0000","last_became_active":"2023-07-06T22:01:29.791097+0000","last_became_peered":"2023-07-06T22:01:29.791097+0000","last_unstale":"2023-07-06T22:01:31.805802+0000","last_undegraded":"2023-07-06T22:01:31.805802+0000","last_fullsized":"2023-07-06T22:01:31.805802+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:33:07.489131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186346+0000","last_change":"2023-07-06T22:01:30.206085+0000","last_active":"2023-07-06T22:01:31.186346+0000","last_peered":"2023-07-06T22:01:31.186346+0000","last_clean":"2023-07-06T22:01:31.186346+0000","last_became_active":"2023-07-06T22:01:30.205817+0000","last_became_peered":"2023-07-06T22:01:30.205817+0000","last_unstale":"2023-07-06T22:01:31.186346+0000","last_undegraded":"2023-07-06T22:01:31.186346+0000","last_fullsized":"2023-07-06T22:01:31.186346+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:04:04.328763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734226+0000","last_change":"2023-07-06T22:01:29.790365+0000","last_active":"2023-07-06T22:01:31.734226+0000","last_peered":"2023-07-06T22:01:31.734226+0000","last_clean":"2023-07-06T22:01:31.734226+0000","last_became_active":"2023-07-06T22:01:29.790087+0000","last_became_peered":"2023-07-06T22:01:29.790087+0000","last_unstale":"2023-07-06T22:01:31.734226+0000","last_undegraded":"2023-07-06T22:01:31.734226+0000","last_fullsized":"2023-07-06T22:01:31.734226+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:47:40.398875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186480+0000","last_change":"2023-07-06T22:01:30.201126+0000","last_active":"2023-07-06T22:01:31.186480+0000","last_peered":"2023-07-06T22:01:31.186480+0000","last_clean":"2023-07-06T22:01:31.186480+0000","last_became_active":"2023-07-06T22:01:30.200857+0000","last_became_peered":"2023-07-06T22:01:30.200857+0000","last_unstale":"2023-07-06T22:01:31.186480+0000","last_undegraded":"2023-07-06T22:01:31.186480+0000","last_fullsized":"2023-07-06T22:01:31.186480+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:55:56.288665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.189408+0000","last_change":"2023-07-06T22:01:29.793383+0000","last_active":"2023-07-06T22:01:31.189408+0000","last_peered":"2023-07-06T22:01:31.189408+0000","last_clean":"2023-07-06T22:01:31.189408+0000","last_became_active":"2023-07-06T22:01:29.793112+0000","last_became_peered":"2023-07-06T22:01:29.793112+0000","last_unstale":"2023-07-06T22:01:31.189408+0000","last_undegraded":"2023-07-06T22:01:31.189408+0000","last_fullsized":"2023-07-06T22:01:31.189408+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:07:46.344611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.189250+0000","last_change":"2023-07-06T22:01:30.210018+0000","last_active":"2023-07-06T22:01:31.189250+0000","last_peered":"2023-07-06T22:01:31.189250+0000","last_clean":"2023-07-06T22:01:31.189250+0000","last_became_active":"2023-07-06T22:01:30.208965+0000","last_became_peered":"2023-07-06T22:01:30.208965+0000","last_unstale":"2023-07-06T22:01:31.189250+0000","last_undegraded":"2023-07-06T22:01:31.189250+0000","last_fullsized":"2023-07-06T22:01:31.189250+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:31:06.205163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186849+0000","last_change":"2023-07-06T22:01:29.801455+0000","last_active":"2023-07-06T22:01:31.186849+0000","last_peered":"2023-07-06T22:01:31.186849+0000","last_clean":"2023-07-06T22:01:31.186849+0000","last_became_active":"2023-07-06T22:01:29.801044+0000","last_became_peered":"2023-07-06T22:01:29.801044+0000","last_unstale":"2023-07-06T22:01:31.186849+0000","last_undegraded":"2023-07-06T22:01:31.186849+0000","last_fullsized":"2023-07-06T22:01:31.186849+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:33:29.943379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806565+0000","last_change":"2023-07-06T22:01:30.198241+0000","last_active":"2023-07-06T22:01:31.806565+0000","last_peered":"2023-07-06T22:01:31.806565+0000","last_clean":"2023-07-06T22:01:31.806565+0000","last_became_active":"2023-07-06T22:01:30.197940+0000","last_became_peered":"2023-07-06T22:01:30.197940+0000","last_unstale":"2023-07-06T22:01:31.806565+0000","last_undegraded":"2023-07-06T22:01:31.806565+0000","last_fullsized":"2023-07-06T22:01:31.806565+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:10:39.396492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806951+0000","last_change":"2023-07-06T22:01:29.793466+0000","last_active":"2023-07-06T22:01:31.806951+0000","last_peered":"2023-07-06T22:01:31.806951+0000","last_clean":"2023-07-06T22:01:31.806951+0000","last_became_active":"2023-07-06T22:01:29.792937+0000","last_became_peered":"2023-07-06T22:01:29.792937+0000","last_unstale":"2023-07-06T22:01:31.806951+0000","last_undegraded":"2023-07-06T22:01:31.806951+0000","last_fullsized":"2023-07-06T22:01:31.806951+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:37:22.269496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186329+0000","last_change":"2023-07-06T22:01:30.211478+0000","last_active":"2023-07-06T22:01:31.186329+0000","last_peered":"2023-07-06T22:01:31.186329+0000","last_clean":"2023-07-06T22:01:31.186329+0000","last_became_active":"2023-07-06T22:01:30.211180+0000","last_became_peered":"2023-07-06T22:01:30.211180+0000","last_unstale":"2023-07-06T22:01:31.186329+0000","last_undegraded":"2023-07-06T22:01:31.186329+0000","last_fullsized":"2023-07-06T22:01:31.186329+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:28.612381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734257+0000","last_change":"2023-07-06T22:01:29.791323+0000","last_active":"2023-07-06T22:01:31.734257+0000","last_peered":"2023-07-06T22:01:31.734257+0000","last_clean":"2023-07-06T22:01:31.734257+0000","last_became_active":"2023-07-06T22:01:29.791013+0000","last_became_peered":"2023-07-06T22:01:29.791013+0000","last_unstale":"2023-07-06T22:01:31.734257+0000","last_undegraded":"2023-07-06T22:01:31.734257+0000","last_fullsized":"2023-07-06T22:01:31.734257+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:25:42.013444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186300+0000","last_change":"2023-07-06T22:01:30.205091+0000","last_active":"2023-07-06T22:01:31.186300+0000","last_peered":"2023-07-06T22:01:31.186300+0000","last_clean":"2023-07-06T22:01:31.186300+0000","last_became_active":"2023-07-06T22:01:30.204816+0000","last_became_peered":"2023-07-06T22:01:30.204816+0000","last_unstale":"2023-07-06T22:01:31.186300+0000","last_undegraded":"2023-07-06T22:01:31.186300+0000","last_fullsized":"2023-07-06T22:01:31.186300+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:10:52.189176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806806+0000","last_change":"2023-07-06T22:01:29.797395+0000","last_active":"2023-07-06T22:01:31.806806+0000","last_peered":"2023-07-06T22:01:31.806806+0000","last_clean":"2023-07-06T22:01:31.806806+0000","last_became_active":"2023-07-06T22:01:29.796968+0000","last_became_peered":"2023-07-06T22:01:29.796968+0000","last_unstale":"2023-07-06T22:01:31.806806+0000","last_undegraded":"2023-07-06T22:01:31.806806+0000","last_fullsized":"2023-07-06T22:01:31.806806+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:16:20.569423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806414+0000","last_change":"2023-07-06T22:01:30.200033+0000","last_active":"2023-07-06T22:01:31.806414+0000","last_peered":"2023-07-06T22:01:31.806414+0000","last_clean":"2023-07-06T22:01:31.806414+0000","last_became_active":"2023-07-06T22:01:30.199791+0000","last_became_peered":"2023-07-06T22:01:30.199791+0000","last_unstale":"2023-07-06T22:01:31.806414+0000","last_undegraded":"2023-07-06T22:01:31.806414+0000","last_fullsized":"2023-07-06T22:01:31.806414+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:38:47.476506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186486+0000","last_change":"2023-07-06T22:01:29.800720+0000","last_active":"2023-07-06T22:01:31.186486+0000","last_peered":"2023-07-06T22:01:31.186486+0000","last_clean":"2023-07-06T22:01:31.186486+0000","last_became_active":"2023-07-06T22:01:29.800464+0000","last_became_peered":"2023-07-06T22:01:29.800464+0000","last_unstale":"2023-07-06T22:01:31.186486+0000","last_undegraded":"2023-07-06T22:01:31.186486+0000","last_fullsized":"2023-07-06T22:01:31.186486+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:36:20.746287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805994+0000","last_change":"2023-07-06T22:01:30.214819+0000","last_active":"2023-07-06T22:01:31.805994+0000","last_peered":"2023-07-06T22:01:31.805994+0000","last_clean":"2023-07-06T22:01:31.805994+0000","last_became_active":"2023-07-06T22:01:30.211541+0000","last_became_peered":"2023-07-06T22:01:30.211541+0000","last_unstale":"2023-07-06T22:01:31.805994+0000","last_undegraded":"2023-07-06T22:01:31.805994+0000","last_fullsized":"2023-07-06T22:01:31.805994+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:22:01.588752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806135+0000","last_change":"2023-07-06T22:01:29.791804+0000","last_active":"2023-07-06T22:01:31.806135+0000","last_peered":"2023-07-06T22:01:31.806135+0000","last_clean":"2023-07-06T22:01:31.806135+0000","last_became_active":"2023-07-06T22:01:29.791382+0000","last_became_peered":"2023-07-06T22:01:29.791382+0000","last_unstale":"2023-07-06T22:01:31.806135+0000","last_undegraded":"2023-07-06T22:01:31.806135+0000","last_fullsized":"2023-07-06T22:01:31.806135+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:03:21.763236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806428+0000","last_change":"2023-07-06T22:01:30.198503+0000","last_active":"2023-07-06T22:01:31.806428+0000","last_peered":"2023-07-06T22:01:31.806428+0000","last_clean":"2023-07-06T22:01:31.806428+0000","last_became_active":"2023-07-06T22:01:30.198228+0000","last_became_peered":"2023-07-06T22:01:30.198228+0000","last_unstale":"2023-07-06T22:01:31.806428+0000","last_undegraded":"2023-07-06T22:01:31.806428+0000","last_fullsized":"2023-07-06T22:01:31.806428+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:22.112263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734338+0000","last_change":"2023-07-06T22:01:29.793534+0000","last_active":"2023-07-06T22:01:31.734338+0000","last_peered":"2023-07-06T22:01:31.734338+0000","last_clean":"2023-07-06T22:01:31.734338+0000","last_became_active":"2023-07-06T22:01:29.793238+0000","last_became_peered":"2023-07-06T22:01:29.793238+0000","last_unstale":"2023-07-06T22:01:31.734338+0000","last_undegraded":"2023-07-06T22:01:31.734338+0000","last_fullsized":"2023-07-06T22:01:31.734338+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:05:32.320481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186159+0000","last_change":"2023-07-06T22:01:30.206748+0000","last_active":"2023-07-06T22:01:31.186159+0000","last_peered":"2023-07-06T22:01:31.186159+0000","last_clean":"2023-07-06T22:01:31.186159+0000","last_became_active":"2023-07-06T22:01:30.206415+0000","last_became_peered":"2023-07-06T22:01:30.206415+0000","last_unstale":"2023-07-06T22:01:31.186159+0000","last_undegraded":"2023-07-06T22:01:31.186159+0000","last_fullsized":"2023-07-06T22:01:31.186159+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:50.557208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186911+0000","last_change":"2023-07-06T22:01:29.800164+0000","last_active":"2023-07-06T22:01:31.186911+0000","last_peered":"2023-07-06T22:01:31.186911+0000","last_clean":"2023-07-06T22:01:31.186911+0000","last_became_active":"2023-07-06T22:01:29.799897+0000","last_became_peered":"2023-07-06T22:01:29.799897+0000","last_unstale":"2023-07-06T22:01:31.186911+0000","last_undegraded":"2023-07-06T22:01:31.186911+0000","last_fullsized":"2023-07-06T22:01:31.186911+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:15:01.357009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"133'249","reported_seq":886,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186044+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:01:31.186044+0000","last_peered":"2023-07-06T22:01:31.186044+0000","last_clean":"2023-07-06T22:01:31.186044+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:01:31.186044+0000","last_undegraded":"2023-07-06T22:01:31.186044+0000","last_fullsized":"2023-07-06T22:01:31.186044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:58:26.665806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":232,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806850+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:01:31.806850+0000","last_peered":"2023-07-06T22:01:31.806850+0000","last_clean":"2023-07-06T22:01:31.806850+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:01:31.806850+0000","last_undegraded":"2023-07-06T22:01:31.806850+0000","last_fullsized":"2023-07-06T22:01:31.806850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:23:47.616294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806933+0000","last_change":"2023-07-06T22:01:30.209573+0000","last_active":"2023-07-06T22:01:31.806933+0000","last_peered":"2023-07-06T22:01:31.806933+0000","last_clean":"2023-07-06T22:01:31.806933+0000","last_became_active":"2023-07-06T22:01:30.209156+0000","last_became_peered":"2023-07-06T22:01:30.209156+0000","last_unstale":"2023-07-06T22:01:31.806933+0000","last_undegraded":"2023-07-06T22:01:31.806933+0000","last_fullsized":"2023-07-06T22:01:31.806933+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:35.884877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"145'8","reported_seq":21,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806966+0000","last_change":"2023-07-06T22:01:29.798291+0000","last_active":"2023-07-06T22:01:31.806966+0000","last_peered":"2023-07-06T22:01:31.806966+0000","last_clean":"2023-07-06T22:01:31.806966+0000","last_became_active":"2023-07-06T22:01:29.798029+0000","last_became_peered":"2023-07-06T22:01:29.798029+0000","last_unstale":"2023-07-06T22:01:31.806966+0000","last_undegraded":"2023-07-06T22:01:31.806966+0000","last_fullsized":"2023-07-06T22:01:31.806966+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:46:41.085771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.185993+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:01:31.185993+0000","last_peered":"2023-07-06T22:01:31.185993+0000","last_clean":"2023-07-06T22:01:31.185993+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:01:31.185993+0000","last_undegraded":"2023-07-06T22:01:31.185993+0000","last_fullsized":"2023-07-06T22:01:31.185993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:55:30.753590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805839+0000","last_change":"2023-07-06T22:01:30.202853+0000","last_active":"2023-07-06T22:01:31.805839+0000","last_peered":"2023-07-06T22:01:31.805839+0000","last_clean":"2023-07-06T22:01:31.805839+0000","last_became_active":"2023-07-06T22:01:30.202590+0000","last_became_peered":"2023-07-06T22:01:30.202590+0000","last_unstale":"2023-07-06T22:01:31.805839+0000","last_undegraded":"2023-07-06T22:01:31.805839+0000","last_fullsized":"2023-07-06T22:01:31.805839+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:58:58.955537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806556+0000","last_change":"2023-07-06T22:01:29.796985+0000","last_active":"2023-07-06T22:01:31.806556+0000","last_peered":"2023-07-06T22:01:31.806556+0000","last_clean":"2023-07-06T22:01:31.806556+0000","last_became_active":"2023-07-06T22:01:29.796680+0000","last_became_peered":"2023-07-06T22:01:29.796680+0000","last_unstale":"2023-07-06T22:01:31.806556+0000","last_undegraded":"2023-07-06T22:01:31.806556+0000","last_fullsized":"2023-07-06T22:01:31.806556+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:12:44.181382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":266,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188678+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:01:31.188678+0000","last_peered":"2023-07-06T22:01:31.188678+0000","last_clean":"2023-07-06T22:01:31.188678+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:01:31.188678+0000","last_undegraded":"2023-07-06T22:01:31.188678+0000","last_fullsized":"2023-07-06T22:01:31.188678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:58:33.067249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.189143+0000","last_change":"2023-07-06T22:01:30.209117+0000","last_active":"2023-07-06T22:01:31.189143+0000","last_peered":"2023-07-06T22:01:31.189143+0000","last_clean":"2023-07-06T22:01:31.189143+0000","last_became_active":"2023-07-06T22:01:30.208856+0000","last_became_peered":"2023-07-06T22:01:30.208856+0000","last_unstale":"2023-07-06T22:01:31.189143+0000","last_undegraded":"2023-07-06T22:01:31.189143+0000","last_fullsized":"2023-07-06T22:01:31.189143+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:04:18.311189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188976+0000","last_change":"2023-07-06T22:01:29.795673+0000","last_active":"2023-07-06T22:01:31.188976+0000","last_peered":"2023-07-06T22:01:31.188976+0000","last_clean":"2023-07-06T22:01:31.188976+0000","last_became_active":"2023-07-06T22:01:29.795063+0000","last_became_peered":"2023-07-06T22:01:29.795063+0000","last_unstale":"2023-07-06T22:01:31.188976+0000","last_undegraded":"2023-07-06T22:01:31.188976+0000","last_fullsized":"2023-07-06T22:01:31.188976+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:41:49.928212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":232,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806134+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:01:31.806134+0000","last_peered":"2023-07-06T22:01:31.806134+0000","last_clean":"2023-07-06T22:01:31.806134+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:01:31.806134+0000","last_undegraded":"2023-07-06T22:01:31.806134+0000","last_fullsized":"2023-07-06T22:01:31.806134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:57:08.866918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.187128+0000","last_change":"2023-07-06T22:01:30.210739+0000","last_active":"2023-07-06T22:01:31.187128+0000","last_peered":"2023-07-06T22:01:31.187128+0000","last_clean":"2023-07-06T22:01:31.187128+0000","last_became_active":"2023-07-06T22:01:30.210462+0000","last_became_peered":"2023-07-06T22:01:30.210462+0000","last_unstale":"2023-07-06T22:01:31.187128+0000","last_undegraded":"2023-07-06T22:01:31.187128+0000","last_fullsized":"2023-07-06T22:01:31.187128+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:55:00.498713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"145'6","reported_seq":19,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806727+0000","last_change":"2023-07-06T22:01:29.801730+0000","last_active":"2023-07-06T22:01:31.806727+0000","last_peered":"2023-07-06T22:01:31.806727+0000","last_clean":"2023-07-06T22:01:31.806727+0000","last_became_active":"2023-07-06T22:01:29.801468+0000","last_became_peered":"2023-07-06T22:01:29.801468+0000","last_unstale":"2023-07-06T22:01:31.806727+0000","last_undegraded":"2023-07-06T22:01:31.806727+0000","last_fullsized":"2023-07-06T22:01:31.806727+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:56:33.884246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806817+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:01:31.806817+0000","last_peered":"2023-07-06T22:01:31.806817+0000","last_clean":"2023-07-06T22:01:31.806817+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:01:31.806817+0000","last_undegraded":"2023-07-06T22:01:31.806817+0000","last_fullsized":"2023-07-06T22:01:31.806817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:06:43.440185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.187058+0000","last_change":"2023-07-06T22:01:30.219057+0000","last_active":"2023-07-06T22:01:31.187058+0000","last_peered":"2023-07-06T22:01:31.187058+0000","last_clean":"2023-07-06T22:01:31.187058+0000","last_became_active":"2023-07-06T22:01:30.218835+0000","last_became_peered":"2023-07-06T22:01:30.218835+0000","last_unstale":"2023-07-06T22:01:31.187058+0000","last_undegraded":"2023-07-06T22:01:31.187058+0000","last_fullsized":"2023-07-06T22:01:31.187058+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:41:21.799183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"145'3","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806437+0000","last_change":"2023-07-06T22:01:29.794938+0000","last_active":"2023-07-06T22:01:31.806437+0000","last_peered":"2023-07-06T22:01:31.806437+0000","last_clean":"2023-07-06T22:01:31.806437+0000","last_became_active":"2023-07-06T22:01:29.794683+0000","last_became_peered":"2023-07-06T22:01:29.794683+0000","last_unstale":"2023-07-06T22:01:31.806437+0000","last_undegraded":"2023-07-06T22:01:31.806437+0000","last_fullsized":"2023-07-06T22:01:31.806437+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:18:56.421677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.187138+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:01:31.187138+0000","last_peered":"2023-07-06T22:01:31.187138+0000","last_clean":"2023-07-06T22:01:31.187138+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:01:31.187138+0000","last_undegraded":"2023-07-06T22:01:31.187138+0000","last_fullsized":"2023-07-06T22:01:31.187138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:50:59.377294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806901+0000","last_change":"2023-07-06T22:01:30.211530+0000","last_active":"2023-07-06T22:01:31.806901+0000","last_peered":"2023-07-06T22:01:31.806901+0000","last_clean":"2023-07-06T22:01:31.806901+0000","last_became_active":"2023-07-06T22:01:30.211278+0000","last_became_peered":"2023-07-06T22:01:30.211278+0000","last_unstale":"2023-07-06T22:01:31.806901+0000","last_undegraded":"2023-07-06T22:01:31.806901+0000","last_fullsized":"2023-07-06T22:01:31.806901+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:23:06.126597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806526+0000","last_change":"2023-07-06T22:01:29.794058+0000","last_active":"2023-07-06T22:01:31.806526+0000","last_peered":"2023-07-06T22:01:31.806526+0000","last_clean":"2023-07-06T22:01:31.806526+0000","last_became_active":"2023-07-06T22:01:29.793784+0000","last_became_peered":"2023-07-06T22:01:29.793784+0000","last_unstale":"2023-07-06T22:01:31.806526+0000","last_undegraded":"2023-07-06T22:01:31.806526+0000","last_fullsized":"2023-07-06T22:01:31.806526+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:51.316758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806659+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:01:31.806659+0000","last_peered":"2023-07-06T22:01:31.806659+0000","last_clean":"2023-07-06T22:01:31.806659+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:01:31.806659+0000","last_undegraded":"2023-07-06T22:01:31.806659+0000","last_fullsized":"2023-07-06T22:01:31.806659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:27:55.811943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.189168+0000","last_change":"2023-07-06T22:01:30.213752+0000","last_active":"2023-07-06T22:01:31.189168+0000","last_peered":"2023-07-06T22:01:31.189168+0000","last_clean":"2023-07-06T22:01:31.189168+0000","last_became_active":"2023-07-06T22:01:30.213491+0000","last_became_peered":"2023-07-06T22:01:30.213491+0000","last_unstale":"2023-07-06T22:01:31.189168+0000","last_undegraded":"2023-07-06T22:01:31.189168+0000","last_fullsized":"2023-07-06T22:01:31.189168+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:31:56.375198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807013+0000","last_change":"2023-07-06T22:01:29.787232+0000","last_active":"2023-07-06T22:01:31.807013+0000","last_peered":"2023-07-06T22:01:31.807013+0000","last_clean":"2023-07-06T22:01:31.807013+0000","last_became_active":"2023-07-06T22:01:29.786634+0000","last_became_peered":"2023-07-06T22:01:29.786634+0000","last_unstale":"2023-07-06T22:01:31.807013+0000","last_undegraded":"2023-07-06T22:01:31.807013+0000","last_fullsized":"2023-07-06T22:01:31.807013+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:46:23.135761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":231,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807427+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:01:31.807427+0000","last_peered":"2023-07-06T22:01:31.807427+0000","last_clean":"2023-07-06T22:01:31.807427+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:01:31.807427+0000","last_undegraded":"2023-07-06T22:01:31.807427+0000","last_fullsized":"2023-07-06T22:01:31.807427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:55:15.485427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575081,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37520,"kb_used_data":2376,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334320,"statfs":{"total":96636764160,"available":96598343680,"internally_reserved":0,"allocated":2433024,"data_stored":1557301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71299999999999997,"15min":0.70399999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.70699999999999996},"min":{"1min":0.48399999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73099999999999998,"15min":0.71699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.627}]},{"osd":2,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.42799999999999999,"15min":0.377},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74099999999999999,"15min":0.73199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.42599999999999999},"max":{"1min":1.3360000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73899999999999999,"15min":0.72099999999999997},"min":{"1min":0.52500000000000002,"5min":0.52100000000000002,"15min":0.42199999999999999},"max":{"1min":1.2749999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.228,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56799999999999995,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.32700000000000001},"max":{"1min":0.76100000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.40899999999999997,"5min":0.39400000000000002,"15min":0.35699999999999998},"max":{"1min":0.95599999999999996,"5min":1.169,"15min":1.169},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.373},"max":{"1min":0.91800000000000004,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.61299999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.53000000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.51300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.95799999999999996,"5min":1.45,"15min":1.45},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.41699999999999998},"max":{"1min":0.98599999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.61599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575081,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36924,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334916,"statfs":{"total":96636764160,"available":96598953984,"internally_reserved":0,"allocated":1822720,"data_stored":965276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.47,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.46800000000000003,"5min":0.44700000000000001,"15min":0.38500000000000001},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.749},"min":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.5349999999999999,"5min":1.778,"15min":1.778},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.80600000000000005}]},{"osd":3,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.503,"5min":0.46200000000000002,"15min":0.45800000000000002},"max":{"1min":1.506,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72099999999999997,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.749}]},{"osd":4,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65500000000000003,"5min":0.95399999999999996,"15min":1.4390000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.77500000000000002,"5min":0.94099999999999995,"15min":1.0509999999999999},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60799999999999998,"15min":0.622},"min":{"1min":0.442,"5min":0.42099999999999999,"15min":0.38600000000000001},"max":{"1min":0.69799999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77500000000000002,"5min":1.0009999999999999,"15min":1.3089999999999999},"last":0.83899999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.74299999999999999,"5min":1.0029999999999999,"15min":1.2549999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76900000000000002,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.69999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575080,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54972,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316868,"statfs":{"total":96636764160,"available":96580472832,"internally_reserved":0,"allocated":1822720,"data_stored":964843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.747,"15min":0.72399999999999998},"min":{"1min":0.52200000000000002,"5min":0.44800000000000001,"15min":0.36699999999999999},"max":{"1min":1.282,"5min":1.49,"15min":1.49},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.72599999999999998},"min":{"1min":0.54800000000000004,"5min":0.45400000000000001,"15min":0.35299999999999998},"max":{"1min":1.0900000000000001,"5min":1.21,"15min":1.21},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.40200000000000002},"max":{"1min":0.98799999999999999,"5min":1.143,"15min":1.143},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.72599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.38600000000000001},"max":{"1min":0.96899999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76800000000000002,"15min":0.753},"min":{"1min":0.56699999999999995,"5min":0.498,"15min":0.39900000000000002},"max":{"1min":1.264,"5min":1.5,"15min":1.5},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.95099999999999996,"5min":1.163,"15min":1.163},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.505,"5min":0.48399999999999999,"15min":0.443},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.52600000000000002,"5min":0.51200000000000001,"15min":0.48599999999999999},"max":{"1min":1.0169999999999999,"5min":1.109,"15min":1.109},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.59299999999999997},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.371},"max":{"1min":0.871,"5min":0.88400000000000001,"15min":1.02},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60699999999999998,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.40100000000000002,"15min":0.34999999999999998},"max":{"1min":0.83699999999999997,"5min":0.90200000000000002,"15min":1.004},"last":0.375},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63300000000000001,"15min":0.61899999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.34100000000000003},"max":{"1min":0.93799999999999994,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.95299999999999996,"15min":1.0589999999999999},"last":0.432}]}]},{"osd":4,"up_from":13,"seq":55834575079,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1818624,"data_stored":964801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.72099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":0.89400000000000002,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98799999999999999,"5min":1.208,"15min":1.208},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.55000000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1200000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.72099999999999997},"min":{"1min":0.47499999999999998,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":1.996,"15min":1.996},"last":0.80100000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.54000000000000004,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.60199999999999998,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.0509999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.84599999999999997}]},{"osd":3,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.745},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.746,"15min":0.754},"min":{"1min":0.58499999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2370000000000001,"5min":1.3640000000000001,"15min":3.2269999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.46000000000000002,"5min":0.35499999999999998,"15min":0.308},"max":{"1min":0.75,"5min":0.93899999999999995,"15min":0.94299999999999995},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.60099999999999998},"min":{"1min":0.503,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.71899999999999997,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.47399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76800000000000002,"5min":1.036,"15min":1.036},"last":0.505},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.65600000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":1,"15min":1},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93000000000000005,"5min":1.0149999999999999,"15min":1.0720000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.42299999999999999,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":1.01},"last":0.873}]}]},{"osd":3,"up_from":13,"seq":55834575080,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50876,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320964,"statfs":{"total":96636764160,"available":96584667136,"internally_reserved":0,"allocated":1822720,"data_stored":964891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42899999999999999,"15min":0.44800000000000001},"min":{"1min":0.316,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57299999999999995,"5min":0.65600000000000003,"15min":1.0489999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.49299999999999999,"15min":0.53100000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68899999999999995,"5min":0.76000000000000001,"15min":2.77},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45600000000000002,"15min":0.48699999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.24299999999999999},"max":{"1min":0.71799999999999997,"5min":0.88800000000000001,"15min":2.4359999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54500000000000004,"15min":0.57799999999999996},"min":{"1min":0.40300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.64500000000000002,"5min":0.97799999999999998,"15min":1.351},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.53000000000000003},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72299999999999998,"5min":0.79900000000000004,"15min":0.90100000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74099999999999999,"5min":0.86799999999999999,"15min":1.24},"last":0.443}]},{"osd":4,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.72599999999999998,"15min":0.75600000000000001},"min":{"1min":0.46000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94099999999999995,"5min":1.1930000000000001,"15min":1.3009999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.73399999999999999,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.383,"15min":1.383},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.79900000000000004},"min":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.4199999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.395,"5min":1.395,"15min":1.3999999999999999},"last":0.754}]},{"osd":6,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.751,"15min":0.79100000000000004},"min":{"1min":0.50600000000000001,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.371,"5min":1.371,"15min":1.425},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76400000000000001,"15min":0.80200000000000005},"min":{"1min":0.54900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.091,"5min":1.419,"15min":3.1739999999999999},"last":0.86899999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.745,"15min":0.79900000000000004},"min":{"1min":0.54200000000000004,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":0.996,"5min":1.2150000000000001,"15min":3.097},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.47099999999999997,"15min":0.45900000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575080,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36924,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334916,"statfs":{"total":96636764160,"available":96598953984,"internally_reserved":0,"allocated":1822720,"data_stored":965347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.68600000000000005,"5min":0.79200000000000004,"15min":0.85999999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.47399999999999998,"15min":0.497},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.67800000000000005,"5min":0.82199999999999995,"15min":0.85999999999999999},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.61199999999999999,"5min":0.878,"15min":0.88200000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.83499999999999996,"15min":0.94399999999999995},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71199999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55900000000000005,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.71799999999999997,"5min":0.85599999999999998,"15min":0.95399999999999996},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.42899999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.2},{"interface":"front","average":{"1min":0.75,"5min":0.79000000000000004,"15min":0.80400000000000005},"min":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.41399999999999998},"max":{"1min":1.1459999999999999,"5min":1.591,"15min":1.591},"last":1.1819999999999999}]},{"osd":5,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.54800000000000004,"5min":0.52200000000000002,"15min":0.42899999999999999},"max":{"1min":1.26,"5min":1.333,"15min":1.333},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78900000000000003,"15min":0.81100000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":1.28,"5min":1.327,"15min":1.327},"last":0.996}]},{"osd":6,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.82799999999999996,"15min":0.82199999999999995},"min":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.48299999999999998},"max":{"1min":1.1679999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.58699999999999997,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.256,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.036}]},{"osd":7,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.54300000000000004,"5min":0.54100000000000004,"15min":0.496},"max":{"1min":1.2430000000000001,"5min":1.458,"15min":1.458},"last":1.127},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81200000000000006,"15min":0.83899999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.50700000000000001},"max":{"1min":1.2829999999999999,"5min":1.573,"15min":1.573},"last":0.95899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575081,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59060,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312780,"statfs":{"total":96636764160,"available":96576286720,"internally_reserved":0,"allocated":1814528,"data_stored":964731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42799999999999999,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53900000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.48199999999999998,"15min":0.501},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65300000000000002,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71099999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.33500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.65300000000000002,"5min":0.79800000000000004,"15min":0.87},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55500000000000005,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.70499999999999996,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.50900000000000001,"15min":0.53800000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32000000000000001},"max":{"1min":0.63800000000000001,"5min":0.749,"15min":0.91200000000000003},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.755,"15min":0.77200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":1.016,"5min":1.204,"15min":1.3140000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.77000000000000002,"15min":0.78100000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.44},"max":{"1min":1.028,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77400000000000002,"15min":0.78100000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.41899999999999998},"max":{"1min":1.0569999999999999,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":0.89600000000000002,"5min":1.3260000000000001,"15min":1.357},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.60199999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.071,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":0.95399999999999996,"5min":1.4379999999999999,"15min":1.456},"last":0.753}]},{"osd":7,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98499999999999999,"5min":1.3540000000000001,"15min":1.417},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.79500000000000004,"15min":0.81499999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.5},"max":{"1min":1.044,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.68300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575080,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37492,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334348,"statfs":{"total":96636764160,"available":96598372352,"internally_reserved":0,"allocated":2404352,"data_stored":1554080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":0.622,"5min":0.72399999999999998,"15min":0.86399999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.504},"min":{"1min":0.36699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64000000000000001,"5min":0.86799999999999999,"15min":0.98099999999999998},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.66000000000000003,"5min":0.70699999999999996,"15min":0.82399999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.33800000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":1.2050000000000001},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48299999999999998,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.75,"5min":0.76600000000000001,"15min":1.151},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.56599999999999995},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69299999999999995,"5min":0.78800000000000003,"15min":0.874},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.63300000000000001,"5min":0.46400000000000002,"15min":0.45000000000000001},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.877,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.40999999999999998},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.66900000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3939999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.56699999999999995,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.627}]},{"osd":6,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.64800000000000002,"5min":0.52200000000000002,"15min":0.48899999999999999},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.54500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.746},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.82499999999999996,"15min":0.81799999999999995},"min":{"1min":0.58999999999999997,"5min":0.56499999999999995,"15min":0.50900000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":0.83599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:01:37.656 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:01:37.660 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:01:38.889 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:01:39.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.044+0000 7f3c2cbf6640 1 Processor -- start 2023-07-06T22:01:39.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.044+0000 7f3c2cbf6640 1 -- start start 2023-07-06T22:01:39.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.048+0000 7f3c2cbf6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c280ca450 0x7f3c2806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.048+0000 7f3c2cbf6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c28159cd0 con 0x7f3c280712f0 2023-07-06T22:01:39.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.048+0000 7f3c2cbf6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c280693f0 con 0x7f3c280b3730 2023-07-06T22:01:39.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.048+0000 7f3c2cbf6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2806aca0 con 0x7f3c280ca450 2023-07-06T22:01:39.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.048+0000 7f3c2659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3c280712f0 0x7f3c280c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40828/0 (socket says 172.21.15.55:40828) 2023-07-06T22:01:39.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.048+0000 7f3c2659c640 1 -- 172.21.15.55:0/531895165 learned_addr learned my addr 172.21.15.55:0/531895165 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:39.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.048+0000 7f3c1ffff640 1 --2- 172.21.15.55:0/531895165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c280ca450 0x7f3c2806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.048+0000 7f3c25d9b640 1 -- 172.21.15.55:0/531895165 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464618601 0 0) 0x7f3c28159cd0 con 0x7f3c280712f0 2023-07-06T22:01:39.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.048+0000 7f3c25d9b640 1 -- 172.21.15.55:0/531895165 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c14003530 con 0x7f3c280712f0 2023-07-06T22:01:39.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.048+0000 7f3c25d9b640 1 -- 172.21.15.55:0/531895165 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146822131 0 0) 0x7f3c280693f0 con 0x7f3c280b3730 2023-07-06T22:01:39.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.048+0000 7f3c25d9b640 1 -- 172.21.15.55:0/531895165 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c28159cd0 con 0x7f3c280b3730 2023-07-06T22:01:39.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.048+0000 7f3c1ffff640 1 -- 172.21.15.55:0/531895165 >> v1:172.21.15.138:6789/0 conn(0x7f3c280b3730 legacy=0x7f3c2815d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.048+0000 7f3c1ffff640 1 -- 172.21.15.55:0/531895165 >> v1:172.21.15.55:6789/0 conn(0x7f3c280712f0 legacy=0x7f3c280c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.048+0000 7f3c1ffff640 1 -- 172.21.15.55:0/531895165 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c280696b0 con 0x7f3c280ca450 2023-07-06T22:01:39.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.052+0000 7f3c1ffff640 1 --2- 172.21.15.55:0/531895165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c280ca450 0x7f3c2806a610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3c100097f0 tx=0x7f3c1001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d24af55da53d2db9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:39.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.052+0000 7f3c25d9b640 1 -- 172.21.15.55:0/531895165 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c100aa5f0 con 0x7f3c280ca450 2023-07-06T22:01:39.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.052+0000 7f3c25d9b640 1 -- 172.21.15.55:0/531895165 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c100aa750 con 0x7f3c280ca450 2023-07-06T22:01:39.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.052+0000 7f3c25d9b640 1 -- 172.21.15.55:0/531895165 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c100aaae0 con 0x7f3c280ca450 2023-07-06T22:01:39.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.052+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/531895165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c280ca450 msgr2=0x7f3c2806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.052+0000 7f3c2cbf6640 1 --2- 172.21.15.55:0/531895165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c280ca450 0x7f3c2806a610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3c100097f0 tx=0x7f3c1001c490 comp rx=0 tx=0).stop 2023-07-06T22:01:39.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.052+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/531895165 shutdown_connections 2023-07-06T22:01:39.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.052+0000 7f3c2cbf6640 1 --2- 172.21.15.55:0/531895165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c280ca450 0x7f3c2806a610 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.052+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/531895165 >> 172.21.15.55:0/531895165 conn(0x7f3c280cded0 msgr2=0x7f3c280ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:39.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.052+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/531895165 shutdown_connections 2023-07-06T22:01:39.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.052+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/531895165 wait complete. 2023-07-06T22:01:39.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.052+0000 7f3c2cbf6640 1 Processor -- start 2023-07-06T22:01:39.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.052+0000 7f3c2cbf6640 1 -- start start 2023-07-06T22:01:39.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2cbf6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c280712f0 0x7f3c281f7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2cbf6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c280b3730 0x7f3c281f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2cbf6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c280ca450 0x7f3c2814a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2cbf6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c28151730 con 0x7f3c280712f0 2023-07-06T22:01:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2cbf6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281f4e30 con 0x7f3c280b3730 2023-07-06T22:01:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2cbf6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281f7a70 con 0x7f3c280ca450 2023-07-06T22:01:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c280712f0 0x7f3c281f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c280712f0 0x7f3c281f7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42626/0 (socket says 172.21.15.55:42626) 2023-07-06T22:01:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2659c640 1 -- 172.21.15.55:0/2030082555 learned_addr learned my addr 172.21.15.55:0/2030082555 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:39.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c1ffff640 1 --2- 172.21.15.55:0/2030082555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c280b3730 0x7f3c281f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c26d9d640 1 --2- 172.21.15.55:0/2030082555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c280ca450 0x7f3c2814a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2659c640 1 -- 172.21.15.55:0/2030082555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c280ca450 msgr2=0x7f3c2814a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2659c640 1 --2- 172.21.15.55:0/2030082555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c280ca450 0x7f3c2814a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2659c640 1 -- 172.21.15.55:0/2030082555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c280b3730 msgr2=0x7f3c281f48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2659c640 1 --2- 172.21.15.55:0/2030082555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c280b3730 0x7f3c281f48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2659c640 1 -- 172.21.15.55:0/2030082555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c10009420 con 0x7f3c280712f0 2023-07-06T22:01:39.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2659c640 1 --2- 172.21.15.55:0/2030082555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c280712f0 0x7f3c281f7490 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800c420 tx=0x7f3c1800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:39.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c1effd640 1 -- 172.21.15.55:0/2030082555 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18005cf0 con 0x7f3c280712f0 2023-07-06T22:01:39.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c1effd640 1 -- 172.21.15.55:0/2030082555 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c18005e50 con 0x7f3c280712f0 2023-07-06T22:01:39.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c1effd640 1 -- 172.21.15.55:0/2030082555 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18007310 con 0x7f3c280712f0 2023-07-06T22:01:39.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/2030082555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c281f7d50 con 0x7f3c280712f0 2023-07-06T22:01:39.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/2030082555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c281f8310 con 0x7f3c280712f0 2023-07-06T22:01:39.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/2030082555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c28066d60 con 0x7f3c280712f0 2023-07-06T22:01:39.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.056+0000 7f3c1effd640 1 -- 172.21.15.55:0/2030082555 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3c18007470 con 0x7f3c280712f0 2023-07-06T22:01:39.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.060+0000 7f3c1effd640 1 --2- 172.21.15.55:0/2030082555 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f3c080663a0 0x7f3c08068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.060+0000 7f3c1effd640 1 -- 172.21.15.55:0/2030082555 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f3c18083540 con 0x7f3c280712f0 2023-07-06T22:01:39.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.060+0000 7f3c1ffff640 1 --2- 172.21.15.55:0/2030082555 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f3c080663a0 0x7f3c08068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.060+0000 7f3c1ffff640 1 --2- 172.21.15.55:0/2030082555 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f3c080663a0 0x7f3c08068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c100ae000 tx=0x7f3c100a7000 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:39.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.064+0000 7f3c1effd640 1 -- 172.21.15.55:0/2030082555 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3c180507f0 con 0x7f3c280712f0 2023-07-06T22:01:39.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.216+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/2030082555 --> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c28070530 con 0x7f3c080663a0 2023-07-06T22:01:39.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.224+0000 7f3c1effd640 1 -- 172.21.15.55:0/2030082555 <== mgr.8940 v2:172.21.15.55:6832/206120108 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311481 (secure 0 0 0) 0x7f3c100aa570 con 0x7f3c080663a0 2023-07-06T22:01:39.224 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:39.225 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:01:39.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.228+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/2030082555 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f3c080663a0 msgr2=0x7f3c08068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.228+0000 7f3c2cbf6640 1 --2- 172.21.15.55:0/2030082555 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f3c080663a0 0x7f3c08068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c100ae000 tx=0x7f3c100a7000 comp rx=0 tx=0).stop 2023-07-06T22:01:39.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.228+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/2030082555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c280712f0 msgr2=0x7f3c281f7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.228+0000 7f3c2cbf6640 1 --2- 172.21.15.55:0/2030082555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c280712f0 0x7f3c281f7490 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800c420 tx=0x7f3c1800c8e0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.228+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/2030082555 shutdown_connections 2023-07-06T22:01:39.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.228+0000 7f3c2cbf6640 1 --2- 172.21.15.55:0/2030082555 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f3c080663a0 0x7f3c08068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.228+0000 7f3c2cbf6640 1 --2- 172.21.15.55:0/2030082555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3c280ca450 0x7f3c2814a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.228+0000 7f3c2cbf6640 1 --2- 172.21.15.55:0/2030082555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3c280b3730 0x7f3c281f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.228+0000 7f3c2cbf6640 1 --2- 172.21.15.55:0/2030082555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c280712f0 0x7f3c281f7490 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.228+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/2030082555 >> 172.21.15.55:0/2030082555 conn(0x7f3c280cded0 msgr2=0x7f3c2815d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:39.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.228+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/2030082555 shutdown_connections 2023-07-06T22:01:39.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.228+0000 7f3c2cbf6640 1 -- 172.21.15.55:0/2030082555 wait complete. 2023-07-06T22:01:39.244 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-07-06T22:01:39.143070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":444,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":346592,"kb_used_data":15392,"kb_used_omap":0,"kb_used_meta":331136,"kb_avail":754628128,"statfs":{"total":773094113280,"available":772739203072,"internally_reserved":0,"allocated":15761408,"data_stored":8901270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339083264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.959258"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.189294+0000","last_change":"2023-07-06T22:01:30.202139+0000","last_active":"2023-07-06T22:01:31.189294+0000","last_peered":"2023-07-06T22:01:31.189294+0000","last_clean":"2023-07-06T22:01:31.189294+0000","last_became_active":"2023-07-06T22:01:30.201791+0000","last_became_peered":"2023-07-06T22:01:30.201791+0000","last_unstale":"2023-07-06T22:01:31.189294+0000","last_undegraded":"2023-07-06T22:01:31.189294+0000","last_fullsized":"2023-07-06T22:01:31.189294+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:58.592296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806397+0000","last_change":"2023-07-06T22:01:30.203970+0000","last_active":"2023-07-06T22:01:31.806397+0000","last_peered":"2023-07-06T22:01:31.806397+0000","last_clean":"2023-07-06T22:01:31.806397+0000","last_became_active":"2023-07-06T22:01:30.203687+0000","last_became_peered":"2023-07-06T22:01:30.203687+0000","last_unstale":"2023-07-06T22:01:31.806397+0000","last_undegraded":"2023-07-06T22:01:31.806397+0000","last_fullsized":"2023-07-06T22:01:31.806397+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:36:09.073776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806785+0000","last_change":"2023-07-06T22:01:30.212727+0000","last_active":"2023-07-06T22:01:31.806785+0000","last_peered":"2023-07-06T22:01:31.806785+0000","last_clean":"2023-07-06T22:01:31.806785+0000","last_became_active":"2023-07-06T22:01:30.212464+0000","last_became_peered":"2023-07-06T22:01:30.212464+0000","last_unstale":"2023-07-06T22:01:31.806785+0000","last_undegraded":"2023-07-06T22:01:31.806785+0000","last_fullsized":"2023-07-06T22:01:31.806785+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:38:56.861284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188988+0000","last_change":"2023-07-06T22:01:30.201607+0000","last_active":"2023-07-06T22:01:31.188988+0000","last_peered":"2023-07-06T22:01:31.188988+0000","last_clean":"2023-07-06T22:01:31.188988+0000","last_became_active":"2023-07-06T22:01:30.201158+0000","last_became_peered":"2023-07-06T22:01:30.201158+0000","last_unstale":"2023-07-06T22:01:31.188988+0000","last_undegraded":"2023-07-06T22:01:31.188988+0000","last_fullsized":"2023-07-06T22:01:31.188988+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:08:36.301998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186774+0000","last_change":"2023-07-06T22:01:30.214327+0000","last_active":"2023-07-06T22:01:31.186774+0000","last_peered":"2023-07-06T22:01:31.186774+0000","last_clean":"2023-07-06T22:01:31.186774+0000","last_became_active":"2023-07-06T22:01:30.214046+0000","last_became_peered":"2023-07-06T22:01:30.214046+0000","last_unstale":"2023-07-06T22:01:31.186774+0000","last_undegraded":"2023-07-06T22:01:31.186774+0000","last_fullsized":"2023-07-06T22:01:31.186774+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:44:44.746304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186278+0000","last_change":"2023-07-06T22:01:30.212605+0000","last_active":"2023-07-06T22:01:31.186278+0000","last_peered":"2023-07-06T22:01:31.186278+0000","last_clean":"2023-07-06T22:01:31.186278+0000","last_became_active":"2023-07-06T22:01:30.212356+0000","last_became_peered":"2023-07-06T22:01:30.212356+0000","last_unstale":"2023-07-06T22:01:31.186278+0000","last_undegraded":"2023-07-06T22:01:31.186278+0000","last_fullsized":"2023-07-06T22:01:31.186278+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:57:10.479425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186663+0000","last_change":"2023-07-06T22:01:30.204625+0000","last_active":"2023-07-06T22:01:31.186663+0000","last_peered":"2023-07-06T22:01:31.186663+0000","last_clean":"2023-07-06T22:01:31.186663+0000","last_became_active":"2023-07-06T22:01:30.204307+0000","last_became_peered":"2023-07-06T22:01:30.204307+0000","last_unstale":"2023-07-06T22:01:31.186663+0000","last_undegraded":"2023-07-06T22:01:31.186663+0000","last_fullsized":"2023-07-06T22:01:31.186663+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:36:21.572347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806391+0000","last_change":"2023-07-06T22:01:30.212554+0000","last_active":"2023-07-06T22:01:31.806391+0000","last_peered":"2023-07-06T22:01:31.806391+0000","last_clean":"2023-07-06T22:01:31.806391+0000","last_became_active":"2023-07-06T22:01:30.212316+0000","last_became_peered":"2023-07-06T22:01:30.212316+0000","last_unstale":"2023-07-06T22:01:31.806391+0000","last_undegraded":"2023-07-06T22:01:31.806391+0000","last_fullsized":"2023-07-06T22:01:31.806391+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:10:48.916645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807367+0000","last_change":"2023-07-06T22:01:30.210106+0000","last_active":"2023-07-06T22:01:31.807367+0000","last_peered":"2023-07-06T22:01:31.807367+0000","last_clean":"2023-07-06T22:01:31.807367+0000","last_became_active":"2023-07-06T22:01:30.209851+0000","last_became_peered":"2023-07-06T22:01:30.209851+0000","last_unstale":"2023-07-06T22:01:31.807367+0000","last_undegraded":"2023-07-06T22:01:31.807367+0000","last_fullsized":"2023-07-06T22:01:31.807367+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:22:03.750459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806569+0000","last_change":"2023-07-06T22:01:30.201099+0000","last_active":"2023-07-06T22:01:31.806569+0000","last_peered":"2023-07-06T22:01:31.806569+0000","last_clean":"2023-07-06T22:01:31.806569+0000","last_became_active":"2023-07-06T22:01:30.200819+0000","last_became_peered":"2023-07-06T22:01:30.200819+0000","last_unstale":"2023-07-06T22:01:31.806569+0000","last_undegraded":"2023-07-06T22:01:31.806569+0000","last_fullsized":"2023-07-06T22:01:31.806569+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:40:25.366222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734237+0000","last_change":"2023-07-06T22:01:30.212053+0000","last_active":"2023-07-06T22:01:31.734237+0000","last_peered":"2023-07-06T22:01:31.734237+0000","last_clean":"2023-07-06T22:01:31.734237+0000","last_became_active":"2023-07-06T22:01:30.211724+0000","last_became_peered":"2023-07-06T22:01:30.211724+0000","last_unstale":"2023-07-06T22:01:31.734237+0000","last_undegraded":"2023-07-06T22:01:31.734237+0000","last_fullsized":"2023-07-06T22:01:31.734237+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:42:38.158199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806665+0000","last_change":"2023-07-06T22:01:30.209904+0000","last_active":"2023-07-06T22:01:31.806665+0000","last_peered":"2023-07-06T22:01:31.806665+0000","last_clean":"2023-07-06T22:01:31.806665+0000","last_became_active":"2023-07-06T22:01:30.209659+0000","last_became_peered":"2023-07-06T22:01:30.209659+0000","last_unstale":"2023-07-06T22:01:31.806665+0000","last_undegraded":"2023-07-06T22:01:31.806665+0000","last_fullsized":"2023-07-06T22:01:31.806665+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:37:27.445263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188732+0000","last_change":"2023-07-06T22:01:30.205544+0000","last_active":"2023-07-06T22:01:31.188732+0000","last_peered":"2023-07-06T22:01:31.188732+0000","last_clean":"2023-07-06T22:01:31.188732+0000","last_became_active":"2023-07-06T22:01:30.205232+0000","last_became_peered":"2023-07-06T22:01:30.205232+0000","last_unstale":"2023-07-06T22:01:31.188732+0000","last_undegraded":"2023-07-06T22:01:31.188732+0000","last_fullsized":"2023-07-06T22:01:31.188732+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:59:53.657252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806925+0000","last_change":"2023-07-06T22:01:30.198750+0000","last_active":"2023-07-06T22:01:31.806925+0000","last_peered":"2023-07-06T22:01:31.806925+0000","last_clean":"2023-07-06T22:01:31.806925+0000","last_became_active":"2023-07-06T22:01:30.198504+0000","last_became_peered":"2023-07-06T22:01:30.198504+0000","last_unstale":"2023-07-06T22:01:31.806925+0000","last_undegraded":"2023-07-06T22:01:31.806925+0000","last_fullsized":"2023-07-06T22:01:31.806925+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:12:49.764625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188726+0000","last_change":"2023-07-06T22:01:30.204041+0000","last_active":"2023-07-06T22:01:31.188726+0000","last_peered":"2023-07-06T22:01:31.188726+0000","last_clean":"2023-07-06T22:01:31.188726+0000","last_became_active":"2023-07-06T22:01:30.203760+0000","last_became_peered":"2023-07-06T22:01:30.203760+0000","last_unstale":"2023-07-06T22:01:31.188726+0000","last_undegraded":"2023-07-06T22:01:31.188726+0000","last_fullsized":"2023-07-06T22:01:31.188726+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:19:38.656293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805826+0000","last_change":"2023-07-06T22:01:30.211282+0000","last_active":"2023-07-06T22:01:31.805826+0000","last_peered":"2023-07-06T22:01:31.805826+0000","last_clean":"2023-07-06T22:01:31.805826+0000","last_became_active":"2023-07-06T22:01:30.210955+0000","last_became_peered":"2023-07-06T22:01:30.210955+0000","last_unstale":"2023-07-06T22:01:31.805826+0000","last_undegraded":"2023-07-06T22:01:31.805826+0000","last_fullsized":"2023-07-06T22:01:31.805826+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:21:42.017820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186672+0000","last_change":"2023-07-06T22:01:30.216192+0000","last_active":"2023-07-06T22:01:31.186672+0000","last_peered":"2023-07-06T22:01:31.186672+0000","last_clean":"2023-07-06T22:01:31.186672+0000","last_became_active":"2023-07-06T22:01:30.215957+0000","last_became_peered":"2023-07-06T22:01:30.215957+0000","last_unstale":"2023-07-06T22:01:31.186672+0000","last_undegraded":"2023-07-06T22:01:31.186672+0000","last_fullsized":"2023-07-06T22:01:31.186672+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:16:31.849023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806120+0000","last_change":"2023-07-06T22:01:30.210005+0000","last_active":"2023-07-06T22:01:31.806120+0000","last_peered":"2023-07-06T22:01:31.806120+0000","last_clean":"2023-07-06T22:01:31.806120+0000","last_became_active":"2023-07-06T22:01:30.209746+0000","last_became_peered":"2023-07-06T22:01:30.209746+0000","last_unstale":"2023-07-06T22:01:31.806120+0000","last_undegraded":"2023-07-06T22:01:31.806120+0000","last_fullsized":"2023-07-06T22:01:31.806120+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:55:37.854956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734305+0000","last_change":"2023-07-06T22:01:30.207865+0000","last_active":"2023-07-06T22:01:31.734305+0000","last_peered":"2023-07-06T22:01:31.734305+0000","last_clean":"2023-07-06T22:01:31.734305+0000","last_became_active":"2023-07-06T22:01:30.207485+0000","last_became_peered":"2023-07-06T22:01:30.207485+0000","last_unstale":"2023-07-06T22:01:31.734305+0000","last_undegraded":"2023-07-06T22:01:31.734305+0000","last_fullsized":"2023-07-06T22:01:31.734305+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:07:43.866882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806189+0000","last_change":"2023-07-06T22:01:30.217387+0000","last_active":"2023-07-06T22:01:31.806189+0000","last_peered":"2023-07-06T22:01:31.806189+0000","last_clean":"2023-07-06T22:01:31.806189+0000","last_became_active":"2023-07-06T22:01:30.217124+0000","last_became_peered":"2023-07-06T22:01:30.217124+0000","last_unstale":"2023-07-06T22:01:31.806189+0000","last_undegraded":"2023-07-06T22:01:31.806189+0000","last_fullsized":"2023-07-06T22:01:31.806189+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:58:45.833979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186508+0000","last_change":"2023-07-06T22:01:30.201925+0000","last_active":"2023-07-06T22:01:31.186508+0000","last_peered":"2023-07-06T22:01:31.186508+0000","last_clean":"2023-07-06T22:01:31.186508+0000","last_became_active":"2023-07-06T22:01:30.201652+0000","last_became_peered":"2023-07-06T22:01:30.201652+0000","last_unstale":"2023-07-06T22:01:31.186508+0000","last_undegraded":"2023-07-06T22:01:31.186508+0000","last_fullsized":"2023-07-06T22:01:31.186508+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:27:20.105941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734165+0000","last_change":"2023-07-06T22:01:30.207879+0000","last_active":"2023-07-06T22:01:31.734165+0000","last_peered":"2023-07-06T22:01:31.734165+0000","last_clean":"2023-07-06T22:01:31.734165+0000","last_became_active":"2023-07-06T22:01:30.207597+0000","last_became_peered":"2023-07-06T22:01:30.207597+0000","last_unstale":"2023-07-06T22:01:31.734165+0000","last_undegraded":"2023-07-06T22:01:31.734165+0000","last_fullsized":"2023-07-06T22:01:31.734165+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:59.745490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807065+0000","last_change":"2023-07-06T22:01:30.209406+0000","last_active":"2023-07-06T22:01:31.807065+0000","last_peered":"2023-07-06T22:01:31.807065+0000","last_clean":"2023-07-06T22:01:31.807065+0000","last_became_active":"2023-07-06T22:01:30.208808+0000","last_became_peered":"2023-07-06T22:01:30.208808+0000","last_unstale":"2023-07-06T22:01:31.807065+0000","last_undegraded":"2023-07-06T22:01:31.807065+0000","last_fullsized":"2023-07-06T22:01:31.807065+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:48:33.232722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734163+0000","last_change":"2023-07-06T22:01:30.211299+0000","last_active":"2023-07-06T22:01:31.734163+0000","last_peered":"2023-07-06T22:01:31.734163+0000","last_clean":"2023-07-06T22:01:31.734163+0000","last_became_active":"2023-07-06T22:01:30.211053+0000","last_became_peered":"2023-07-06T22:01:30.211053+0000","last_unstale":"2023-07-06T22:01:31.734163+0000","last_undegraded":"2023-07-06T22:01:31.734163+0000","last_fullsized":"2023-07-06T22:01:31.734163+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:46:29.517113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805997+0000","last_change":"2023-07-06T22:01:30.198896+0000","last_active":"2023-07-06T22:01:31.805997+0000","last_peered":"2023-07-06T22:01:31.805997+0000","last_clean":"2023-07-06T22:01:31.805997+0000","last_became_active":"2023-07-06T22:01:30.198648+0000","last_became_peered":"2023-07-06T22:01:30.198648+0000","last_unstale":"2023-07-06T22:01:31.805997+0000","last_undegraded":"2023-07-06T22:01:31.805997+0000","last_fullsized":"2023-07-06T22:01:31.805997+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:02.376692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806280+0000","last_change":"2023-07-06T22:01:30.215411+0000","last_active":"2023-07-06T22:01:31.806280+0000","last_peered":"2023-07-06T22:01:31.806280+0000","last_clean":"2023-07-06T22:01:31.806280+0000","last_became_active":"2023-07-06T22:01:30.215149+0000","last_became_peered":"2023-07-06T22:01:30.215149+0000","last_unstale":"2023-07-06T22:01:31.806280+0000","last_undegraded":"2023-07-06T22:01:31.806280+0000","last_fullsized":"2023-07-06T22:01:31.806280+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:01:57.488336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188995+0000","last_change":"2023-07-06T22:01:30.205965+0000","last_active":"2023-07-06T22:01:31.188995+0000","last_peered":"2023-07-06T22:01:31.188995+0000","last_clean":"2023-07-06T22:01:31.188995+0000","last_became_active":"2023-07-06T22:01:30.205693+0000","last_became_peered":"2023-07-06T22:01:30.205693+0000","last_unstale":"2023-07-06T22:01:31.188995+0000","last_undegraded":"2023-07-06T22:01:31.188995+0000","last_fullsized":"2023-07-06T22:01:31.188995+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:07:42.715883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807117+0000","last_change":"2023-07-06T22:01:30.219656+0000","last_active":"2023-07-06T22:01:31.807117+0000","last_peered":"2023-07-06T22:01:31.807117+0000","last_clean":"2023-07-06T22:01:31.807117+0000","last_became_active":"2023-07-06T22:01:30.219354+0000","last_became_peered":"2023-07-06T22:01:30.219354+0000","last_unstale":"2023-07-06T22:01:31.807117+0000","last_undegraded":"2023-07-06T22:01:31.807117+0000","last_fullsized":"2023-07-06T22:01:31.807117+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:57:15.970992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188904+0000","last_change":"2023-07-06T22:01:30.207943+0000","last_active":"2023-07-06T22:01:31.188904+0000","last_peered":"2023-07-06T22:01:31.188904+0000","last_clean":"2023-07-06T22:01:31.188904+0000","last_became_active":"2023-07-06T22:01:30.207677+0000","last_became_peered":"2023-07-06T22:01:30.207677+0000","last_unstale":"2023-07-06T22:01:31.188904+0000","last_undegraded":"2023-07-06T22:01:31.188904+0000","last_fullsized":"2023-07-06T22:01:31.188904+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:20:24.012000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188817+0000","last_change":"2023-07-06T22:01:30.208229+0000","last_active":"2023-07-06T22:01:31.188817+0000","last_peered":"2023-07-06T22:01:31.188817+0000","last_clean":"2023-07-06T22:01:31.188817+0000","last_became_active":"2023-07-06T22:01:30.207357+0000","last_became_peered":"2023-07-06T22:01:30.207357+0000","last_unstale":"2023-07-06T22:01:31.188817+0000","last_undegraded":"2023-07-06T22:01:31.188817+0000","last_fullsized":"2023-07-06T22:01:31.188817+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:35:49.698083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186606+0000","last_change":"2023-07-06T22:01:30.206434+0000","last_active":"2023-07-06T22:01:31.186606+0000","last_peered":"2023-07-06T22:01:31.186606+0000","last_clean":"2023-07-06T22:01:31.186606+0000","last_became_active":"2023-07-06T22:01:30.206129+0000","last_became_peered":"2023-07-06T22:01:30.206129+0000","last_unstale":"2023-07-06T22:01:31.186606+0000","last_undegraded":"2023-07-06T22:01:31.186606+0000","last_fullsized":"2023-07-06T22:01:31.186606+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:15.440312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186039+0000","last_change":"2023-07-06T22:01:30.209952+0000","last_active":"2023-07-06T22:01:31.186039+0000","last_peered":"2023-07-06T22:01:31.186039+0000","last_clean":"2023-07-06T22:01:31.186039+0000","last_became_active":"2023-07-06T22:01:30.209625+0000","last_became_peered":"2023-07-06T22:01:30.209625+0000","last_unstale":"2023-07-06T22:01:31.186039+0000","last_undegraded":"2023-07-06T22:01:31.186039+0000","last_fullsized":"2023-07-06T22:01:31.186039+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:01:43.281042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806433+0000","last_change":"2023-07-06T22:01:30.212341+0000","last_active":"2023-07-06T22:01:31.806433+0000","last_peered":"2023-07-06T22:01:31.806433+0000","last_clean":"2023-07-06T22:01:31.806433+0000","last_became_active":"2023-07-06T22:01:30.212076+0000","last_became_peered":"2023-07-06T22:01:30.212076+0000","last_unstale":"2023-07-06T22:01:31.806433+0000","last_undegraded":"2023-07-06T22:01:31.806433+0000","last_fullsized":"2023-07-06T22:01:31.806433+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:11:27.767581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"145'4","reported_seq":17,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.187106+0000","last_change":"2023-07-06T22:01:29.804235+0000","last_active":"2023-07-06T22:01:31.187106+0000","last_peered":"2023-07-06T22:01:31.187106+0000","last_clean":"2023-07-06T22:01:31.187106+0000","last_became_active":"2023-07-06T22:01:29.803918+0000","last_became_peered":"2023-07-06T22:01:29.803918+0000","last_unstale":"2023-07-06T22:01:31.187106+0000","last_undegraded":"2023-07-06T22:01:31.187106+0000","last_fullsized":"2023-07-06T22:01:31.187106+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:43:48.235109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807417+0000","last_change":"2023-07-06T22:01:30.217215+0000","last_active":"2023-07-06T22:01:31.807417+0000","last_peered":"2023-07-06T22:01:31.807417+0000","last_clean":"2023-07-06T22:01:31.807417+0000","last_became_active":"2023-07-06T22:01:30.216914+0000","last_became_peered":"2023-07-06T22:01:30.216914+0000","last_unstale":"2023-07-06T22:01:31.807417+0000","last_undegraded":"2023-07-06T22:01:31.807417+0000","last_fullsized":"2023-07-06T22:01:31.807417+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:46:02.431370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806745+0000","last_change":"2023-07-06T22:01:29.791090+0000","last_active":"2023-07-06T22:01:31.806745+0000","last_peered":"2023-07-06T22:01:31.806745+0000","last_clean":"2023-07-06T22:01:31.806745+0000","last_became_active":"2023-07-06T22:01:29.790816+0000","last_became_peered":"2023-07-06T22:01:29.790816+0000","last_unstale":"2023-07-06T22:01:31.806745+0000","last_undegraded":"2023-07-06T22:01:31.806745+0000","last_fullsized":"2023-07-06T22:01:31.806745+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:43:32.395332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186979+0000","last_change":"2023-07-06T22:01:30.211788+0000","last_active":"2023-07-06T22:01:31.186979+0000","last_peered":"2023-07-06T22:01:31.186979+0000","last_clean":"2023-07-06T22:01:31.186979+0000","last_became_active":"2023-07-06T22:01:30.210519+0000","last_became_peered":"2023-07-06T22:01:30.210519+0000","last_unstale":"2023-07-06T22:01:31.186979+0000","last_undegraded":"2023-07-06T22:01:31.186979+0000","last_fullsized":"2023-07-06T22:01:31.186979+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:15:12.582649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734382+0000","last_change":"2023-07-06T22:01:29.796870+0000","last_active":"2023-07-06T22:01:31.734382+0000","last_peered":"2023-07-06T22:01:31.734382+0000","last_clean":"2023-07-06T22:01:31.734382+0000","last_became_active":"2023-07-06T22:01:29.796610+0000","last_became_peered":"2023-07-06T22:01:29.796610+0000","last_unstale":"2023-07-06T22:01:31.734382+0000","last_undegraded":"2023-07-06T22:01:31.734382+0000","last_fullsized":"2023-07-06T22:01:31.734382+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:59:33.038650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.187062+0000","last_change":"2023-07-06T22:01:30.212093+0000","last_active":"2023-07-06T22:01:31.187062+0000","last_peered":"2023-07-06T22:01:31.187062+0000","last_clean":"2023-07-06T22:01:31.187062+0000","last_became_active":"2023-07-06T22:01:30.211863+0000","last_became_peered":"2023-07-06T22:01:30.211863+0000","last_unstale":"2023-07-06T22:01:31.187062+0000","last_undegraded":"2023-07-06T22:01:31.187062+0000","last_fullsized":"2023-07-06T22:01:31.187062+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:42:21.830272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806725+0000","last_change":"2023-07-06T22:01:29.798688+0000","last_active":"2023-07-06T22:01:31.806725+0000","last_peered":"2023-07-06T22:01:31.806725+0000","last_clean":"2023-07-06T22:01:31.806725+0000","last_became_active":"2023-07-06T22:01:29.798417+0000","last_became_peered":"2023-07-06T22:01:29.798417+0000","last_unstale":"2023-07-06T22:01:31.806725+0000","last_undegraded":"2023-07-06T22:01:31.806725+0000","last_fullsized":"2023-07-06T22:01:31.806725+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:58:44.196833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805856+0000","last_change":"2023-07-06T22:01:30.206169+0000","last_active":"2023-07-06T22:01:31.805856+0000","last_peered":"2023-07-06T22:01:31.805856+0000","last_clean":"2023-07-06T22:01:31.805856+0000","last_became_active":"2023-07-06T22:01:30.205905+0000","last_became_peered":"2023-07-06T22:01:30.205905+0000","last_unstale":"2023-07-06T22:01:31.805856+0000","last_undegraded":"2023-07-06T22:01:31.805856+0000","last_fullsized":"2023-07-06T22:01:31.805856+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:58:37.381373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806682+0000","last_change":"2023-07-06T22:01:29.794711+0000","last_active":"2023-07-06T22:01:31.806682+0000","last_peered":"2023-07-06T22:01:31.806682+0000","last_clean":"2023-07-06T22:01:31.806682+0000","last_became_active":"2023-07-06T22:01:29.794443+0000","last_became_peered":"2023-07-06T22:01:29.794443+0000","last_unstale":"2023-07-06T22:01:31.806682+0000","last_undegraded":"2023-07-06T22:01:31.806682+0000","last_fullsized":"2023-07-06T22:01:31.806682+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:42:27.392314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186717+0000","last_change":"2023-07-06T22:01:30.215700+0000","last_active":"2023-07-06T22:01:31.186717+0000","last_peered":"2023-07-06T22:01:31.186717+0000","last_clean":"2023-07-06T22:01:31.186717+0000","last_became_active":"2023-07-06T22:01:30.215455+0000","last_became_peered":"2023-07-06T22:01:30.215455+0000","last_unstale":"2023-07-06T22:01:31.186717+0000","last_undegraded":"2023-07-06T22:01:31.186717+0000","last_fullsized":"2023-07-06T22:01:31.186717+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:37:39.517326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805987+0000","last_change":"2023-07-06T22:01:29.793005+0000","last_active":"2023-07-06T22:01:31.805987+0000","last_peered":"2023-07-06T22:01:31.805987+0000","last_clean":"2023-07-06T22:01:31.805987+0000","last_became_active":"2023-07-06T22:01:29.792720+0000","last_became_peered":"2023-07-06T22:01:29.792720+0000","last_unstale":"2023-07-06T22:01:31.805987+0000","last_undegraded":"2023-07-06T22:01:31.805987+0000","last_fullsized":"2023-07-06T22:01:31.805987+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:34:50.206801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806527+0000","last_change":"2023-07-06T22:01:30.212071+0000","last_active":"2023-07-06T22:01:31.806527+0000","last_peered":"2023-07-06T22:01:31.806527+0000","last_clean":"2023-07-06T22:01:31.806527+0000","last_became_active":"2023-07-06T22:01:30.211831+0000","last_became_peered":"2023-07-06T22:01:30.211831+0000","last_unstale":"2023-07-06T22:01:31.806527+0000","last_undegraded":"2023-07-06T22:01:31.806527+0000","last_fullsized":"2023-07-06T22:01:31.806527+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:38:59.425006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186028+0000","last_change":"2023-07-06T22:01:29.801494+0000","last_active":"2023-07-06T22:01:31.186028+0000","last_peered":"2023-07-06T22:01:31.186028+0000","last_clean":"2023-07-06T22:01:31.186028+0000","last_became_active":"2023-07-06T22:01:29.801223+0000","last_became_peered":"2023-07-06T22:01:29.801223+0000","last_unstale":"2023-07-06T22:01:31.186028+0000","last_undegraded":"2023-07-06T22:01:31.186028+0000","last_fullsized":"2023-07-06T22:01:31.186028+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:23:23.121560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806292+0000","last_change":"2023-07-06T22:01:30.205372+0000","last_active":"2023-07-06T22:01:31.806292+0000","last_peered":"2023-07-06T22:01:31.806292+0000","last_clean":"2023-07-06T22:01:31.806292+0000","last_became_active":"2023-07-06T22:01:30.205111+0000","last_became_peered":"2023-07-06T22:01:30.205111+0000","last_unstale":"2023-07-06T22:01:31.806292+0000","last_undegraded":"2023-07-06T22:01:31.806292+0000","last_fullsized":"2023-07-06T22:01:31.806292+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:39.851133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806088+0000","last_change":"2023-07-06T22:01:29.796326+0000","last_active":"2023-07-06T22:01:31.806088+0000","last_peered":"2023-07-06T22:01:31.806088+0000","last_clean":"2023-07-06T22:01:31.806088+0000","last_became_active":"2023-07-06T22:01:29.796073+0000","last_became_peered":"2023-07-06T22:01:29.796073+0000","last_unstale":"2023-07-06T22:01:31.806088+0000","last_undegraded":"2023-07-06T22:01:31.806088+0000","last_fullsized":"2023-07-06T22:01:31.806088+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:19:19.267850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807314+0000","last_change":"2023-07-06T22:01:30.215326+0000","last_active":"2023-07-06T22:01:31.807314+0000","last_peered":"2023-07-06T22:01:31.807314+0000","last_clean":"2023-07-06T22:01:31.807314+0000","last_became_active":"2023-07-06T22:01:30.215072+0000","last_became_peered":"2023-07-06T22:01:30.215072+0000","last_unstale":"2023-07-06T22:01:31.807314+0000","last_undegraded":"2023-07-06T22:01:31.807314+0000","last_fullsized":"2023-07-06T22:01:31.807314+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:44:09.147087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807115+0000","last_change":"2023-07-06T22:01:29.792802+0000","last_active":"2023-07-06T22:01:31.807115+0000","last_peered":"2023-07-06T22:01:31.807115+0000","last_clean":"2023-07-06T22:01:31.807115+0000","last_became_active":"2023-07-06T22:01:29.792538+0000","last_became_peered":"2023-07-06T22:01:29.792538+0000","last_unstale":"2023-07-06T22:01:31.807115+0000","last_undegraded":"2023-07-06T22:01:31.807115+0000","last_fullsized":"2023-07-06T22:01:31.807115+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:50:40.390091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806984+0000","last_change":"2023-07-06T22:01:30.208707+0000","last_active":"2023-07-06T22:01:31.806984+0000","last_peered":"2023-07-06T22:01:31.806984+0000","last_clean":"2023-07-06T22:01:31.806984+0000","last_became_active":"2023-07-06T22:01:30.208402+0000","last_became_peered":"2023-07-06T22:01:30.208402+0000","last_unstale":"2023-07-06T22:01:31.806984+0000","last_undegraded":"2023-07-06T22:01:31.806984+0000","last_fullsized":"2023-07-06T22:01:31.806984+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:57:28.976735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734475+0000","last_change":"2023-07-06T22:01:29.793575+0000","last_active":"2023-07-06T22:01:31.734475+0000","last_peered":"2023-07-06T22:01:31.734475+0000","last_clean":"2023-07-06T22:01:31.734475+0000","last_became_active":"2023-07-06T22:01:29.793341+0000","last_became_peered":"2023-07-06T22:01:29.793341+0000","last_unstale":"2023-07-06T22:01:31.734475+0000","last_undegraded":"2023-07-06T22:01:31.734475+0000","last_fullsized":"2023-07-06T22:01:31.734475+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:59:47.919232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806354+0000","last_change":"2023-07-06T22:01:30.221626+0000","last_active":"2023-07-06T22:01:31.806354+0000","last_peered":"2023-07-06T22:01:31.806354+0000","last_clean":"2023-07-06T22:01:31.806354+0000","last_became_active":"2023-07-06T22:01:30.221343+0000","last_became_peered":"2023-07-06T22:01:30.221343+0000","last_unstale":"2023-07-06T22:01:31.806354+0000","last_undegraded":"2023-07-06T22:01:31.806354+0000","last_fullsized":"2023-07-06T22:01:31.806354+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:09:23.999285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"145'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186470+0000","last_change":"2023-07-06T22:01:29.797214+0000","last_active":"2023-07-06T22:01:31.186470+0000","last_peered":"2023-07-06T22:01:31.186470+0000","last_clean":"2023-07-06T22:01:31.186470+0000","last_became_active":"2023-07-06T22:01:29.796834+0000","last_became_peered":"2023-07-06T22:01:29.796834+0000","last_unstale":"2023-07-06T22:01:31.186470+0000","last_undegraded":"2023-07-06T22:01:31.186470+0000","last_fullsized":"2023-07-06T22:01:31.186470+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:34:27.187587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806943+0000","last_change":"2023-07-06T22:01:30.206181+0000","last_active":"2023-07-06T22:01:31.806943+0000","last_peered":"2023-07-06T22:01:31.806943+0000","last_clean":"2023-07-06T22:01:31.806943+0000","last_became_active":"2023-07-06T22:01:30.205926+0000","last_became_peered":"2023-07-06T22:01:30.205926+0000","last_unstale":"2023-07-06T22:01:31.806943+0000","last_undegraded":"2023-07-06T22:01:31.806943+0000","last_fullsized":"2023-07-06T22:01:31.806943+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:20:45.375518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806546+0000","last_change":"2023-07-06T22:01:29.799293+0000","last_active":"2023-07-06T22:01:31.806546+0000","last_peered":"2023-07-06T22:01:31.806546+0000","last_clean":"2023-07-06T22:01:31.806546+0000","last_became_active":"2023-07-06T22:01:29.799023+0000","last_became_peered":"2023-07-06T22:01:29.799023+0000","last_unstale":"2023-07-06T22:01:31.806546+0000","last_undegraded":"2023-07-06T22:01:31.806546+0000","last_fullsized":"2023-07-06T22:01:31.806546+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:36:28.487053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.189292+0000","last_change":"2023-07-06T22:01:30.202900+0000","last_active":"2023-07-06T22:01:31.189292+0000","last_peered":"2023-07-06T22:01:31.189292+0000","last_clean":"2023-07-06T22:01:31.189292+0000","last_became_active":"2023-07-06T22:01:30.202618+0000","last_became_peered":"2023-07-06T22:01:30.202618+0000","last_unstale":"2023-07-06T22:01:31.189292+0000","last_undegraded":"2023-07-06T22:01:31.189292+0000","last_fullsized":"2023-07-06T22:01:31.189292+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:07:47.913600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806412+0000","last_change":"2023-07-06T22:01:29.787038+0000","last_active":"2023-07-06T22:01:31.806412+0000","last_peered":"2023-07-06T22:01:31.806412+0000","last_clean":"2023-07-06T22:01:31.806412+0000","last_became_active":"2023-07-06T22:01:29.786673+0000","last_became_peered":"2023-07-06T22:01:29.786673+0000","last_unstale":"2023-07-06T22:01:31.806412+0000","last_undegraded":"2023-07-06T22:01:31.806412+0000","last_fullsized":"2023-07-06T22:01:31.806412+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:01:07.295016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186429+0000","last_change":"2023-07-06T22:01:30.215219+0000","last_active":"2023-07-06T22:01:31.186429+0000","last_peered":"2023-07-06T22:01:31.186429+0000","last_clean":"2023-07-06T22:01:31.186429+0000","last_became_active":"2023-07-06T22:01:30.214960+0000","last_became_peered":"2023-07-06T22:01:30.214960+0000","last_unstale":"2023-07-06T22:01:31.186429+0000","last_undegraded":"2023-07-06T22:01:31.186429+0000","last_fullsized":"2023-07-06T22:01:31.186429+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:01:21.830665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806482+0000","last_change":"2023-07-06T22:01:29.793095+0000","last_active":"2023-07-06T22:01:31.806482+0000","last_peered":"2023-07-06T22:01:31.806482+0000","last_clean":"2023-07-06T22:01:31.806482+0000","last_became_active":"2023-07-06T22:01:29.792783+0000","last_became_peered":"2023-07-06T22:01:29.792783+0000","last_unstale":"2023-07-06T22:01:31.806482+0000","last_undegraded":"2023-07-06T22:01:31.806482+0000","last_fullsized":"2023-07-06T22:01:31.806482+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:03:21.249094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805974+0000","last_change":"2023-07-06T22:01:30.212113+0000","last_active":"2023-07-06T22:01:31.805974+0000","last_peered":"2023-07-06T22:01:31.805974+0000","last_clean":"2023-07-06T22:01:31.805974+0000","last_became_active":"2023-07-06T22:01:30.211833+0000","last_became_peered":"2023-07-06T22:01:30.211833+0000","last_unstale":"2023-07-06T22:01:31.805974+0000","last_undegraded":"2023-07-06T22:01:31.805974+0000","last_fullsized":"2023-07-06T22:01:31.805974+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:32:01.464462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805802+0000","last_change":"2023-07-06T22:01:29.791630+0000","last_active":"2023-07-06T22:01:31.805802+0000","last_peered":"2023-07-06T22:01:31.805802+0000","last_clean":"2023-07-06T22:01:31.805802+0000","last_became_active":"2023-07-06T22:01:29.791097+0000","last_became_peered":"2023-07-06T22:01:29.791097+0000","last_unstale":"2023-07-06T22:01:31.805802+0000","last_undegraded":"2023-07-06T22:01:31.805802+0000","last_fullsized":"2023-07-06T22:01:31.805802+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:33:07.489131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186346+0000","last_change":"2023-07-06T22:01:30.206085+0000","last_active":"2023-07-06T22:01:31.186346+0000","last_peered":"2023-07-06T22:01:31.186346+0000","last_clean":"2023-07-06T22:01:31.186346+0000","last_became_active":"2023-07-06T22:01:30.205817+0000","last_became_peered":"2023-07-06T22:01:30.205817+0000","last_unstale":"2023-07-06T22:01:31.186346+0000","last_undegraded":"2023-07-06T22:01:31.186346+0000","last_fullsized":"2023-07-06T22:01:31.186346+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:04:04.328763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734226+0000","last_change":"2023-07-06T22:01:29.790365+0000","last_active":"2023-07-06T22:01:31.734226+0000","last_peered":"2023-07-06T22:01:31.734226+0000","last_clean":"2023-07-06T22:01:31.734226+0000","last_became_active":"2023-07-06T22:01:29.790087+0000","last_became_peered":"2023-07-06T22:01:29.790087+0000","last_unstale":"2023-07-06T22:01:31.734226+0000","last_undegraded":"2023-07-06T22:01:31.734226+0000","last_fullsized":"2023-07-06T22:01:31.734226+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:47:40.398875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186480+0000","last_change":"2023-07-06T22:01:30.201126+0000","last_active":"2023-07-06T22:01:31.186480+0000","last_peered":"2023-07-06T22:01:31.186480+0000","last_clean":"2023-07-06T22:01:31.186480+0000","last_became_active":"2023-07-06T22:01:30.200857+0000","last_became_peered":"2023-07-06T22:01:30.200857+0000","last_unstale":"2023-07-06T22:01:31.186480+0000","last_undegraded":"2023-07-06T22:01:31.186480+0000","last_fullsized":"2023-07-06T22:01:31.186480+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:55:56.288665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.189408+0000","last_change":"2023-07-06T22:01:29.793383+0000","last_active":"2023-07-06T22:01:31.189408+0000","last_peered":"2023-07-06T22:01:31.189408+0000","last_clean":"2023-07-06T22:01:31.189408+0000","last_became_active":"2023-07-06T22:01:29.793112+0000","last_became_peered":"2023-07-06T22:01:29.793112+0000","last_unstale":"2023-07-06T22:01:31.189408+0000","last_undegraded":"2023-07-06T22:01:31.189408+0000","last_fullsized":"2023-07-06T22:01:31.189408+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:07:46.344611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.189250+0000","last_change":"2023-07-06T22:01:30.210018+0000","last_active":"2023-07-06T22:01:31.189250+0000","last_peered":"2023-07-06T22:01:31.189250+0000","last_clean":"2023-07-06T22:01:31.189250+0000","last_became_active":"2023-07-06T22:01:30.208965+0000","last_became_peered":"2023-07-06T22:01:30.208965+0000","last_unstale":"2023-07-06T22:01:31.189250+0000","last_undegraded":"2023-07-06T22:01:31.189250+0000","last_fullsized":"2023-07-06T22:01:31.189250+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:31:06.205163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"146'1","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:33.154863+0000","last_change":"2023-07-06T22:01:29.801455+0000","last_active":"2023-07-06T22:01:33.154863+0000","last_peered":"2023-07-06T22:01:33.154863+0000","last_clean":"2023-07-06T22:01:33.154863+0000","last_became_active":"2023-07-06T22:01:29.801044+0000","last_became_peered":"2023-07-06T22:01:29.801044+0000","last_unstale":"2023-07-06T22:01:33.154863+0000","last_undegraded":"2023-07-06T22:01:33.154863+0000","last_fullsized":"2023-07-06T22:01:33.154863+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:33:29.943379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806565+0000","last_change":"2023-07-06T22:01:30.198241+0000","last_active":"2023-07-06T22:01:31.806565+0000","last_peered":"2023-07-06T22:01:31.806565+0000","last_clean":"2023-07-06T22:01:31.806565+0000","last_became_active":"2023-07-06T22:01:30.197940+0000","last_became_peered":"2023-07-06T22:01:30.197940+0000","last_unstale":"2023-07-06T22:01:31.806565+0000","last_undegraded":"2023-07-06T22:01:31.806565+0000","last_fullsized":"2023-07-06T22:01:31.806565+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:10:39.396492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806951+0000","last_change":"2023-07-06T22:01:29.793466+0000","last_active":"2023-07-06T22:01:31.806951+0000","last_peered":"2023-07-06T22:01:31.806951+0000","last_clean":"2023-07-06T22:01:31.806951+0000","last_became_active":"2023-07-06T22:01:29.792937+0000","last_became_peered":"2023-07-06T22:01:29.792937+0000","last_unstale":"2023-07-06T22:01:31.806951+0000","last_undegraded":"2023-07-06T22:01:31.806951+0000","last_fullsized":"2023-07-06T22:01:31.806951+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:37:22.269496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186329+0000","last_change":"2023-07-06T22:01:30.211478+0000","last_active":"2023-07-06T22:01:31.186329+0000","last_peered":"2023-07-06T22:01:31.186329+0000","last_clean":"2023-07-06T22:01:31.186329+0000","last_became_active":"2023-07-06T22:01:30.211180+0000","last_became_peered":"2023-07-06T22:01:30.211180+0000","last_unstale":"2023-07-06T22:01:31.186329+0000","last_undegraded":"2023-07-06T22:01:31.186329+0000","last_fullsized":"2023-07-06T22:01:31.186329+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:28.612381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734257+0000","last_change":"2023-07-06T22:01:29.791323+0000","last_active":"2023-07-06T22:01:31.734257+0000","last_peered":"2023-07-06T22:01:31.734257+0000","last_clean":"2023-07-06T22:01:31.734257+0000","last_became_active":"2023-07-06T22:01:29.791013+0000","last_became_peered":"2023-07-06T22:01:29.791013+0000","last_unstale":"2023-07-06T22:01:31.734257+0000","last_undegraded":"2023-07-06T22:01:31.734257+0000","last_fullsized":"2023-07-06T22:01:31.734257+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:25:42.013444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186300+0000","last_change":"2023-07-06T22:01:30.205091+0000","last_active":"2023-07-06T22:01:31.186300+0000","last_peered":"2023-07-06T22:01:31.186300+0000","last_clean":"2023-07-06T22:01:31.186300+0000","last_became_active":"2023-07-06T22:01:30.204816+0000","last_became_peered":"2023-07-06T22:01:30.204816+0000","last_unstale":"2023-07-06T22:01:31.186300+0000","last_undegraded":"2023-07-06T22:01:31.186300+0000","last_fullsized":"2023-07-06T22:01:31.186300+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:10:52.189176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806806+0000","last_change":"2023-07-06T22:01:29.797395+0000","last_active":"2023-07-06T22:01:31.806806+0000","last_peered":"2023-07-06T22:01:31.806806+0000","last_clean":"2023-07-06T22:01:31.806806+0000","last_became_active":"2023-07-06T22:01:29.796968+0000","last_became_peered":"2023-07-06T22:01:29.796968+0000","last_unstale":"2023-07-06T22:01:31.806806+0000","last_undegraded":"2023-07-06T22:01:31.806806+0000","last_fullsized":"2023-07-06T22:01:31.806806+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:16:20.569423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806414+0000","last_change":"2023-07-06T22:01:30.200033+0000","last_active":"2023-07-06T22:01:31.806414+0000","last_peered":"2023-07-06T22:01:31.806414+0000","last_clean":"2023-07-06T22:01:31.806414+0000","last_became_active":"2023-07-06T22:01:30.199791+0000","last_became_peered":"2023-07-06T22:01:30.199791+0000","last_unstale":"2023-07-06T22:01:31.806414+0000","last_undegraded":"2023-07-06T22:01:31.806414+0000","last_fullsized":"2023-07-06T22:01:31.806414+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:38:47.476506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186486+0000","last_change":"2023-07-06T22:01:29.800720+0000","last_active":"2023-07-06T22:01:31.186486+0000","last_peered":"2023-07-06T22:01:31.186486+0000","last_clean":"2023-07-06T22:01:31.186486+0000","last_became_active":"2023-07-06T22:01:29.800464+0000","last_became_peered":"2023-07-06T22:01:29.800464+0000","last_unstale":"2023-07-06T22:01:31.186486+0000","last_undegraded":"2023-07-06T22:01:31.186486+0000","last_fullsized":"2023-07-06T22:01:31.186486+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:36:20.746287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805994+0000","last_change":"2023-07-06T22:01:30.214819+0000","last_active":"2023-07-06T22:01:31.805994+0000","last_peered":"2023-07-06T22:01:31.805994+0000","last_clean":"2023-07-06T22:01:31.805994+0000","last_became_active":"2023-07-06T22:01:30.211541+0000","last_became_peered":"2023-07-06T22:01:30.211541+0000","last_unstale":"2023-07-06T22:01:31.805994+0000","last_undegraded":"2023-07-06T22:01:31.805994+0000","last_fullsized":"2023-07-06T22:01:31.805994+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:22:01.588752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806135+0000","last_change":"2023-07-06T22:01:29.791804+0000","last_active":"2023-07-06T22:01:31.806135+0000","last_peered":"2023-07-06T22:01:31.806135+0000","last_clean":"2023-07-06T22:01:31.806135+0000","last_became_active":"2023-07-06T22:01:29.791382+0000","last_became_peered":"2023-07-06T22:01:29.791382+0000","last_unstale":"2023-07-06T22:01:31.806135+0000","last_undegraded":"2023-07-06T22:01:31.806135+0000","last_fullsized":"2023-07-06T22:01:31.806135+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:03:21.763236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806428+0000","last_change":"2023-07-06T22:01:30.198503+0000","last_active":"2023-07-06T22:01:31.806428+0000","last_peered":"2023-07-06T22:01:31.806428+0000","last_clean":"2023-07-06T22:01:31.806428+0000","last_became_active":"2023-07-06T22:01:30.198228+0000","last_became_peered":"2023-07-06T22:01:30.198228+0000","last_unstale":"2023-07-06T22:01:31.806428+0000","last_undegraded":"2023-07-06T22:01:31.806428+0000","last_fullsized":"2023-07-06T22:01:31.806428+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:23:22.112263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.734338+0000","last_change":"2023-07-06T22:01:29.793534+0000","last_active":"2023-07-06T22:01:31.734338+0000","last_peered":"2023-07-06T22:01:31.734338+0000","last_clean":"2023-07-06T22:01:31.734338+0000","last_became_active":"2023-07-06T22:01:29.793238+0000","last_became_peered":"2023-07-06T22:01:29.793238+0000","last_unstale":"2023-07-06T22:01:31.734338+0000","last_undegraded":"2023-07-06T22:01:31.734338+0000","last_fullsized":"2023-07-06T22:01:31.734338+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:05:32.320481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186159+0000","last_change":"2023-07-06T22:01:30.206748+0000","last_active":"2023-07-06T22:01:31.186159+0000","last_peered":"2023-07-06T22:01:31.186159+0000","last_clean":"2023-07-06T22:01:31.186159+0000","last_became_active":"2023-07-06T22:01:30.206415+0000","last_became_peered":"2023-07-06T22:01:30.206415+0000","last_unstale":"2023-07-06T22:01:31.186159+0000","last_undegraded":"2023-07-06T22:01:31.186159+0000","last_fullsized":"2023-07-06T22:01:31.186159+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:50.557208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"145'2","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186911+0000","last_change":"2023-07-06T22:01:29.800164+0000","last_active":"2023-07-06T22:01:31.186911+0000","last_peered":"2023-07-06T22:01:31.186911+0000","last_clean":"2023-07-06T22:01:31.186911+0000","last_became_active":"2023-07-06T22:01:29.799897+0000","last_became_peered":"2023-07-06T22:01:29.799897+0000","last_unstale":"2023-07-06T22:01:31.186911+0000","last_undegraded":"2023-07-06T22:01:31.186911+0000","last_fullsized":"2023-07-06T22:01:31.186911+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:15:01.357009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"133'249","reported_seq":886,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.186044+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:01:31.186044+0000","last_peered":"2023-07-06T22:01:31.186044+0000","last_clean":"2023-07-06T22:01:31.186044+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:01:31.186044+0000","last_undegraded":"2023-07-06T22:01:31.186044+0000","last_fullsized":"2023-07-06T22:01:31.186044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:58:26.665806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":232,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806850+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:01:31.806850+0000","last_peered":"2023-07-06T22:01:31.806850+0000","last_clean":"2023-07-06T22:01:31.806850+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:01:31.806850+0000","last_undegraded":"2023-07-06T22:01:31.806850+0000","last_fullsized":"2023-07-06T22:01:31.806850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:23:47.616294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806933+0000","last_change":"2023-07-06T22:01:30.209573+0000","last_active":"2023-07-06T22:01:31.806933+0000","last_peered":"2023-07-06T22:01:31.806933+0000","last_clean":"2023-07-06T22:01:31.806933+0000","last_became_active":"2023-07-06T22:01:30.209156+0000","last_became_peered":"2023-07-06T22:01:30.209156+0000","last_unstale":"2023-07-06T22:01:31.806933+0000","last_undegraded":"2023-07-06T22:01:31.806933+0000","last_fullsized":"2023-07-06T22:01:31.806933+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:52:35.884877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"145'8","reported_seq":21,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806966+0000","last_change":"2023-07-06T22:01:29.798291+0000","last_active":"2023-07-06T22:01:31.806966+0000","last_peered":"2023-07-06T22:01:31.806966+0000","last_clean":"2023-07-06T22:01:31.806966+0000","last_became_active":"2023-07-06T22:01:29.798029+0000","last_became_peered":"2023-07-06T22:01:29.798029+0000","last_unstale":"2023-07-06T22:01:31.806966+0000","last_undegraded":"2023-07-06T22:01:31.806966+0000","last_fullsized":"2023-07-06T22:01:31.806966+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:46:41.085771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.185993+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:01:31.185993+0000","last_peered":"2023-07-06T22:01:31.185993+0000","last_clean":"2023-07-06T22:01:31.185993+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:01:31.185993+0000","last_undegraded":"2023-07-06T22:01:31.185993+0000","last_fullsized":"2023-07-06T22:01:31.185993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:55:30.753590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.805839+0000","last_change":"2023-07-06T22:01:30.202853+0000","last_active":"2023-07-06T22:01:31.805839+0000","last_peered":"2023-07-06T22:01:31.805839+0000","last_clean":"2023-07-06T22:01:31.805839+0000","last_became_active":"2023-07-06T22:01:30.202590+0000","last_became_peered":"2023-07-06T22:01:30.202590+0000","last_unstale":"2023-07-06T22:01:31.805839+0000","last_undegraded":"2023-07-06T22:01:31.805839+0000","last_fullsized":"2023-07-06T22:01:31.805839+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:58:58.955537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806556+0000","last_change":"2023-07-06T22:01:29.796985+0000","last_active":"2023-07-06T22:01:31.806556+0000","last_peered":"2023-07-06T22:01:31.806556+0000","last_clean":"2023-07-06T22:01:31.806556+0000","last_became_active":"2023-07-06T22:01:29.796680+0000","last_became_peered":"2023-07-06T22:01:29.796680+0000","last_unstale":"2023-07-06T22:01:31.806556+0000","last_undegraded":"2023-07-06T22:01:31.806556+0000","last_fullsized":"2023-07-06T22:01:31.806556+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:12:44.181382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":266,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188678+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:01:31.188678+0000","last_peered":"2023-07-06T22:01:31.188678+0000","last_clean":"2023-07-06T22:01:31.188678+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:01:31.188678+0000","last_undegraded":"2023-07-06T22:01:31.188678+0000","last_fullsized":"2023-07-06T22:01:31.188678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:58:33.067249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.189143+0000","last_change":"2023-07-06T22:01:30.209117+0000","last_active":"2023-07-06T22:01:31.189143+0000","last_peered":"2023-07-06T22:01:31.189143+0000","last_clean":"2023-07-06T22:01:31.189143+0000","last_became_active":"2023-07-06T22:01:30.208856+0000","last_became_peered":"2023-07-06T22:01:30.208856+0000","last_unstale":"2023-07-06T22:01:31.189143+0000","last_undegraded":"2023-07-06T22:01:31.189143+0000","last_fullsized":"2023-07-06T22:01:31.189143+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:04:18.311189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.188976+0000","last_change":"2023-07-06T22:01:29.795673+0000","last_active":"2023-07-06T22:01:31.188976+0000","last_peered":"2023-07-06T22:01:31.188976+0000","last_clean":"2023-07-06T22:01:31.188976+0000","last_became_active":"2023-07-06T22:01:29.795063+0000","last_became_peered":"2023-07-06T22:01:29.795063+0000","last_unstale":"2023-07-06T22:01:31.188976+0000","last_undegraded":"2023-07-06T22:01:31.188976+0000","last_fullsized":"2023-07-06T22:01:31.188976+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:41:49.928212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":232,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806134+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:01:31.806134+0000","last_peered":"2023-07-06T22:01:31.806134+0000","last_clean":"2023-07-06T22:01:31.806134+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:01:31.806134+0000","last_undegraded":"2023-07-06T22:01:31.806134+0000","last_fullsized":"2023-07-06T22:01:31.806134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:57:08.866918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.187128+0000","last_change":"2023-07-06T22:01:30.210739+0000","last_active":"2023-07-06T22:01:31.187128+0000","last_peered":"2023-07-06T22:01:31.187128+0000","last_clean":"2023-07-06T22:01:31.187128+0000","last_became_active":"2023-07-06T22:01:30.210462+0000","last_became_peered":"2023-07-06T22:01:30.210462+0000","last_unstale":"2023-07-06T22:01:31.187128+0000","last_undegraded":"2023-07-06T22:01:31.187128+0000","last_fullsized":"2023-07-06T22:01:31.187128+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:55:00.498713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"145'6","reported_seq":19,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806727+0000","last_change":"2023-07-06T22:01:29.801730+0000","last_active":"2023-07-06T22:01:31.806727+0000","last_peered":"2023-07-06T22:01:31.806727+0000","last_clean":"2023-07-06T22:01:31.806727+0000","last_became_active":"2023-07-06T22:01:29.801468+0000","last_became_peered":"2023-07-06T22:01:29.801468+0000","last_unstale":"2023-07-06T22:01:31.806727+0000","last_undegraded":"2023-07-06T22:01:31.806727+0000","last_fullsized":"2023-07-06T22:01:31.806727+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:56:33.884246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806817+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:01:31.806817+0000","last_peered":"2023-07-06T22:01:31.806817+0000","last_clean":"2023-07-06T22:01:31.806817+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:01:31.806817+0000","last_undegraded":"2023-07-06T22:01:31.806817+0000","last_fullsized":"2023-07-06T22:01:31.806817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:06:43.440185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.187058+0000","last_change":"2023-07-06T22:01:30.219057+0000","last_active":"2023-07-06T22:01:31.187058+0000","last_peered":"2023-07-06T22:01:31.187058+0000","last_clean":"2023-07-06T22:01:31.187058+0000","last_became_active":"2023-07-06T22:01:30.218835+0000","last_became_peered":"2023-07-06T22:01:30.218835+0000","last_unstale":"2023-07-06T22:01:31.187058+0000","last_undegraded":"2023-07-06T22:01:31.187058+0000","last_fullsized":"2023-07-06T22:01:31.187058+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:41:21.799183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"145'3","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806437+0000","last_change":"2023-07-06T22:01:29.794938+0000","last_active":"2023-07-06T22:01:31.806437+0000","last_peered":"2023-07-06T22:01:31.806437+0000","last_clean":"2023-07-06T22:01:31.806437+0000","last_became_active":"2023-07-06T22:01:29.794683+0000","last_became_peered":"2023-07-06T22:01:29.794683+0000","last_unstale":"2023-07-06T22:01:31.806437+0000","last_undegraded":"2023-07-06T22:01:31.806437+0000","last_fullsized":"2023-07-06T22:01:31.806437+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:18:56.421677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.187138+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:01:31.187138+0000","last_peered":"2023-07-06T22:01:31.187138+0000","last_clean":"2023-07-06T22:01:31.187138+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:01:31.187138+0000","last_undegraded":"2023-07-06T22:01:31.187138+0000","last_fullsized":"2023-07-06T22:01:31.187138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:50:59.377294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806901+0000","last_change":"2023-07-06T22:01:30.211530+0000","last_active":"2023-07-06T22:01:31.806901+0000","last_peered":"2023-07-06T22:01:31.806901+0000","last_clean":"2023-07-06T22:01:31.806901+0000","last_became_active":"2023-07-06T22:01:30.211278+0000","last_became_peered":"2023-07-06T22:01:30.211278+0000","last_unstale":"2023-07-06T22:01:31.806901+0000","last_undegraded":"2023-07-06T22:01:31.806901+0000","last_fullsized":"2023-07-06T22:01:31.806901+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:23:06.126597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806526+0000","last_change":"2023-07-06T22:01:29.794058+0000","last_active":"2023-07-06T22:01:31.806526+0000","last_peered":"2023-07-06T22:01:31.806526+0000","last_clean":"2023-07-06T22:01:31.806526+0000","last_became_active":"2023-07-06T22:01:29.793784+0000","last_became_peered":"2023-07-06T22:01:29.793784+0000","last_unstale":"2023-07-06T22:01:31.806526+0000","last_undegraded":"2023-07-06T22:01:31.806526+0000","last_fullsized":"2023-07-06T22:01:31.806526+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:51.316758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.806659+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:01:31.806659+0000","last_peered":"2023-07-06T22:01:31.806659+0000","last_clean":"2023-07-06T22:01:31.806659+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:01:31.806659+0000","last_undegraded":"2023-07-06T22:01:31.806659+0000","last_fullsized":"2023-07-06T22:01:31.806659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:27:55.811943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":11,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.189168+0000","last_change":"2023-07-06T22:01:30.213752+0000","last_active":"2023-07-06T22:01:31.189168+0000","last_peered":"2023-07-06T22:01:31.189168+0000","last_clean":"2023-07-06T22:01:31.189168+0000","last_became_active":"2023-07-06T22:01:30.213491+0000","last_became_peered":"2023-07-06T22:01:30.213491+0000","last_unstale":"2023-07-06T22:01:31.189168+0000","last_undegraded":"2023-07-06T22:01:31.189168+0000","last_fullsized":"2023-07-06T22:01:31.189168+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:29.756868+0000","last_clean_scrub_stamp":"2023-07-06T22:01:29.756868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:31:56.375198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":13,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807013+0000","last_change":"2023-07-06T22:01:29.787232+0000","last_active":"2023-07-06T22:01:31.807013+0000","last_peered":"2023-07-06T22:01:31.807013+0000","last_clean":"2023-07-06T22:01:31.807013+0000","last_became_active":"2023-07-06T22:01:29.786634+0000","last_became_peered":"2023-07-06T22:01:29.786634+0000","last_unstale":"2023-07-06T22:01:31.807013+0000","last_undegraded":"2023-07-06T22:01:31.807013+0000","last_fullsized":"2023-07-06T22:01:31.807013+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:01:28.745372+0000","last_clean_scrub_stamp":"2023-07-06T22:01:28.745372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:46:23.135761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":232,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-07-06T22:01:31.807450+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:01:31.807450+0000","last_peered":"2023-07-06T22:01:31.807450+0000","last_clean":"2023-07-06T22:01:31.807450+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:01:31.807450+0000","last_undegraded":"2023-07-06T22:01:31.807450+0000","last_fullsized":"2023-07-06T22:01:31.807450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:55:15.485427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575082,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37520,"kb_used_data":2376,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334320,"statfs":{"total":96636764160,"available":96598343680,"internally_reserved":0,"allocated":2433024,"data_stored":1557301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.70899999999999996},"min":{"1min":0.46899999999999997,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":1.0229999999999999,"5min":1.526,"15min":1.526},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0409999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":1.0580000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.47499999999999998,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":1.1100000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.47399999999999998,"5min":0.42799999999999999,"15min":0.377},"max":{"1min":1,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.626},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.42599999999999999},"max":{"1min":1.1339999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.42199999999999999},"max":{"1min":1.075,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.74199999999999999,"15min":0.74399999999999999},"min":{"1min":0.59699999999999998,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.0980000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.39400000000000002,"5min":0.377,"15min":0.32700000000000001},"max":{"1min":0.78700000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.35699999999999998},"max":{"1min":0.749,"5min":1.169,"15min":1.169},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71899999999999997,"15min":0.70599999999999996},"min":{"1min":0.58999999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":1.45,"15min":1.45},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.44400000000000001,"15min":0.41699999999999998},"max":{"1min":0.85799999999999998,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.65100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575082,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36924,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334916,"statfs":{"total":96636764160,"available":96598953984,"internally_reserved":0,"allocated":1822720,"data_stored":965276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41399999999999998},"max":{"1min":1.089,"5min":1.607,"15min":1.607},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.751,"15min":0.74099999999999999},"min":{"1min":0.48399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1990000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.38500000000000001},"max":{"1min":0.85699999999999998,"5min":1.857,"15min":1.857},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.48899999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2270000000000001,"5min":1.778,"15min":1.778},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69399999999999995,"15min":0.71599999999999997},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":0.92700000000000005,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71299999999999997,"15min":0.73799999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0529999999999999,"5min":1.752,"15min":1.752},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.165,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.499,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1020000000000001,"5min":1.794,"15min":1.794},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81699999999999995,"5min":0.95399999999999996,"15min":1.4390000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.80100000000000005,"5min":0.94099999999999995,"15min":1.0509999999999999},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.62},"min":{"1min":0.442,"5min":0.42099999999999999,"15min":0.38600000000000001},"max":{"1min":0.82599999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.501},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.39000000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.3089999999999999},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.0029999999999999,"15min":1.2549999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85399999999999998,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.56000000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575081,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54972,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316868,"statfs":{"total":96636764160,"available":96580472832,"internally_reserved":0,"allocated":1822720,"data_stored":964843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98099999999999998,"5min":1.49,"15min":1.49},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.55500000000000005,"5min":0.45400000000000001,"15min":0.35299999999999998},"max":{"1min":1.0209999999999999,"5min":1.21,"15min":1.21},"last":0.70099999999999996}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.54400000000000004,"5min":0.45600000000000002,"15min":0.40200000000000002},"max":{"1min":1.0369999999999999,"5min":1.143,"15min":1.143},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.39900000000000002},"max":{"1min":0.99199999999999999,"5min":1.5,"15min":1.5},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44400000000000001},"max":{"1min":1.044,"5min":1.163,"15min":1.163},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.443},"max":{"1min":0.97999999999999998,"5min":1.127,"15min":1.127},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.008,"5min":1.109,"15min":1.109},"last":0.626}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":0.85399999999999998,"5min":1.012,"15min":1.012},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.371},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.02},"last":0.46700000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.004},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.44400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.441}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.34100000000000003},"max":{"1min":0.91400000000000003,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0589999999999999},"last":0.67200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575080,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1776,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1818624,"data_stored":964801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.72099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":0.89400000000000002,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98799999999999999,"5min":1.208,"15min":1.208},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.55000000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1200000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.72099999999999997},"min":{"1min":0.47499999999999998,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":1.996,"15min":1.996},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.54000000000000004,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.60199999999999998,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.0509999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.746,"15min":0.754},"min":{"1min":0.58499999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2370000000000001,"5min":1.3640000000000001,"15min":3.2269999999999999},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.46000000000000002,"5min":0.35499999999999998,"15min":0.308},"max":{"1min":0.75,"5min":0.93899999999999995,"15min":0.94299999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.60099999999999998},"min":{"1min":0.503,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.71899999999999997,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.47399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76800000000000002,"5min":1.036,"15min":1.036},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.65600000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":1,"15min":1},"last":0.745}]},{"osd":7,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93000000000000005,"5min":1.0149999999999999,"15min":1.0720000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.42299999999999999,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":1.01},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575081,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50876,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320964,"statfs":{"total":96636764160,"available":96584667136,"internally_reserved":0,"allocated":1822720,"data_stored":964891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42899999999999999,"15min":0.44800000000000001},"min":{"1min":0.316,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57299999999999995,"5min":0.65600000000000003,"15min":1.0489999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.49299999999999999,"15min":0.53100000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68899999999999995,"5min":0.76000000000000001,"15min":2.77},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45600000000000002,"15min":0.48699999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.24299999999999999},"max":{"1min":0.71799999999999997,"5min":0.88800000000000001,"15min":2.4359999999999999},"last":0.432},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54500000000000004,"15min":0.57799999999999996},"min":{"1min":0.40300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.64500000000000002,"5min":0.97799999999999998,"15min":1.351},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.496,"15min":0.53000000000000003},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72299999999999998,"5min":0.79900000000000004,"15min":0.90100000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52800000000000002,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74099999999999999,"5min":0.86799999999999999,"15min":1.24},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.72599999999999998,"15min":0.75600000000000001},"min":{"1min":0.46000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94099999999999995,"5min":1.1930000000000001,"15min":1.3009999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.73399999999999999,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.383,"15min":1.383},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.79900000000000004},"min":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.4199999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.395,"5min":1.395,"15min":1.3999999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.751,"15min":0.79100000000000004},"min":{"1min":0.50600000000000001,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.371,"5min":1.371,"15min":1.425},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76400000000000001,"15min":0.80200000000000005},"min":{"1min":0.54900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.091,"5min":1.419,"15min":3.1739999999999999},"last":0.879}]},{"osd":7,"last update":"Thu Jul 6 22:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.745,"15min":0.79900000000000004},"min":{"1min":0.54200000000000004,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":0.996,"5min":1.2150000000000001,"15min":3.097},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.47099999999999997,"15min":0.45900000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.751}]}]},{"osd":2,"up_from":13,"seq":55834575081,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36924,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334916,"statfs":{"total":96636764160,"available":96598953984,"internally_reserved":0,"allocated":1822720,"data_stored":965347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.42799999999999999,"15min":0.45100000000000001},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.623,"5min":0.68600000000000005,"15min":0.85999999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48499999999999999,"15min":0.5},"min":{"1min":0.38200000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.73399999999999999,"5min":0.82199999999999995,"15min":0.85999999999999999},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.496,"15min":0.50900000000000001},"min":{"1min":0.39100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67900000000000005,"5min":0.878,"15min":0.88200000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.54400000000000004},"min":{"1min":0.38200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72799999999999998,"5min":0.83499999999999996,"15min":0.94399999999999995},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55600000000000005,"15min":0.57699999999999996},"min":{"1min":0.44,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.95399999999999996},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.47999999999999998,"15min":0.42899999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.57099999999999995,"5min":0.52100000000000002,"15min":0.41399999999999998},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.52200000000000002,"15min":0.42899999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77800000000000002,"15min":0.80900000000000005},"min":{"1min":0.51500000000000001,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.622}]},{"osd":6,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.48299999999999998},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.63900000000000001,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80700000000000005,"15min":0.82499999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.496},"max":{"1min":1.127,"5min":1.458,"15min":1.458},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.81399999999999995,"15min":0.83899999999999997},"min":{"1min":0.60199999999999998,"5min":0.54200000000000004,"15min":0.50700000000000001},"max":{"1min":1.415,"5min":1.573,"15min":1.573},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575082,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59060,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312780,"statfs":{"total":96636764160,"available":96576286720,"internally_reserved":0,"allocated":1814528,"data_stored":964731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42799999999999999,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53900000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.48199999999999998,"15min":0.501},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65300000000000002,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71099999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.33500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.65300000000000002,"5min":0.79800000000000004,"15min":0.87},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55500000000000005,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.70499999999999996,"5min":0.82099999999999995,"15min":0.96299999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.50900000000000001,"15min":0.53800000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32000000000000001},"max":{"1min":0.63800000000000001,"5min":0.749,"15min":0.91200000000000003},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.755,"15min":0.77200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":1.016,"5min":1.204,"15min":1.3140000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.77000000000000002,"15min":0.78100000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.44},"max":{"1min":1.028,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77400000000000002,"15min":0.78100000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.41899999999999998},"max":{"1min":1.0569999999999999,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":0.89600000000000002,"5min":1.3260000000000001,"15min":1.357},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.60199999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.071,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":0.95399999999999996,"5min":1.4379999999999999,"15min":1.456},"last":0.753}]},{"osd":7,"last update":"Thu Jul 6 22:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98499999999999999,"5min":1.3540000000000001,"15min":1.417},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.79500000000000004,"15min":0.81499999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.5},"max":{"1min":1.044,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.68300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575081,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37492,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334348,"statfs":{"total":96636764160,"available":96598372352,"internally_reserved":0,"allocated":2404352,"data_stored":1554080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":0.622,"5min":0.72399999999999998,"15min":0.86399999999999999},"last":0.438},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.504},"min":{"1min":0.36699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64000000000000001,"5min":0.86799999999999999,"15min":0.98099999999999998},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.66000000000000003,"5min":0.70699999999999996,"15min":0.82399999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50700000000000001,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.33800000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":1.2050000000000001},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48299999999999998,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.75,"5min":0.76600000000000001,"15min":1.151},"last":0.38},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.56599999999999995},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69299999999999995,"5min":0.78800000000000003,"15min":0.874},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.63300000000000001,"5min":0.46400000000000002,"15min":0.45000000000000001},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.877,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.55300000000000005,"5min":0.44600000000000001,"15min":0.40999999999999998},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.66900000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3939999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.56699999999999995,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.64800000000000002,"5min":0.52200000000000002,"15min":0.48899999999999999},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.58799999999999997,"5min":0.47899999999999998,"15min":0.47199999999999998},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jul 6 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.54500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.751},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.82499999999999996,"15min":0.81799999999999995},"min":{"1min":0.58999999999999997,"5min":0.56499999999999995,"15min":0.50900000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":0.73299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:01:39.251 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T22:01:39.252 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-06T22:01:39.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.444+0000 7f794b967640 1 Processor -- start 2023-07-06T22:01:39.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.444+0000 7f794b967640 1 -- start start 2023-07-06T22:01:39.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.444+0000 7f794b967640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f794406ba00 0x7f79440c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.444+0000 7f794b967640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79440b0d90 con 0x7f7944159ad0 2023-07-06T22:01:39.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.444+0000 7f794b967640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7944070c50 con 0x7f794406c380 2023-07-06T22:01:39.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.444+0000 7f794b967640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79440c8620 con 0x7f794406ba00 2023-07-06T22:01:39.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.444+0000 7f7949703640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7944159ad0 0x7f794406b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40834/0 (socket says 172.21.15.55:40834) 2023-07-06T22:01:39.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.444+0000 7f7949703640 1 -- 172.21.15.55:0/111771954 learned_addr learned my addr 172.21.15.55:0/111771954 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:39.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.444+0000 7f7949f04640 1 --2- 172.21.15.55:0/111771954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f794406ba00 0x7f79440c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.444+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531105803 0 0) 0x7f79440b0d90 con 0x7f7944159ad0 2023-07-06T22:01:39.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.444+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7930003530 con 0x7f7944159ad0 2023-07-06T22:01:39.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145606787 0 0) 0x7f7944070c50 con 0x7f794406c380 2023-07-06T22:01:39.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79440b0d90 con 0x7f794406c380 2023-07-06T22:01:39.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3983272425 0 0) 0x7f7930003530 con 0x7f7944159ad0 2023-07-06T22:01:39.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f794406ba00 msgr2=0x7f79440c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:39.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 --2- 172.21.15.55:0/111771954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f794406ba00 0x7f79440c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 >> v1:172.21.15.138:6789/0 conn(0x7f794406c380 legacy=0x7f79440c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7944070f30 con 0x7f7944159ad0 2023-07-06T22:01:39.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f7940001680 con 0x7f7944159ad0 2023-07-06T22:01:39.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 >> v1:172.21.15.55:6789/0 conn(0x7f7944159ad0 legacy=0x7f794406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 --2- 172.21.15.55:0/111771954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7930003b40 0x7f7930003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 --2- 172.21.15.55:0/111771954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79300047d0 0x7f7930004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 --2- 172.21.15.55:0/111771954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f794406ba00 0x7f7930005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79440c8620 con 0x7f79300047d0 2023-07-06T22:01:39.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793000ba70 con 0x7f7930003b40 2023-07-06T22:01:39.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793000bc30 con 0x7f794406ba00 2023-07-06T22:01:39.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f7948f02640 1 --2- 172.21.15.55:0/111771954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79300047d0 0x7f7930004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f7949703640 1 --2- 172.21.15.55:0/111771954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7930003b40 0x7f7930003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f7949f04640 1 --2- 172.21.15.55:0/111771954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f794406ba00 0x7f7930005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f7948f02640 1 -- 172.21.15.55:0/111771954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f794406ba00 msgr2=0x7f7930005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:39.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f7948f02640 1 --2- 172.21.15.55:0/111771954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f794406ba00 0x7f7930005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f7948f02640 1 -- 172.21.15.55:0/111771954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7930003b40 msgr2=0x7f7930003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:39.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f7948f02640 1 --2- 172.21.15.55:0/111771954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7930003b40 0x7f7930003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f7948f02640 1 -- 172.21.15.55:0/111771954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7930003530 con 0x7f79300047d0 2023-07-06T22:01:39.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.448+0000 7f7948f02640 1 --2- 172.21.15.55:0/111771954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79300047d0 0x7f7930004c40 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f794406c750 tx=0x7f793401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98a4ffc68ec1fff server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:39.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340a7070 con 0x7f79300047d0 2023-07-06T22:01:39.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79340050d0 con 0x7f79300047d0 2023-07-06T22:01:39.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f793bfff640 1 -- 172.21.15.55:0/111771954 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934005460 con 0x7f79300047d0 2023-07-06T22:01:39.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f794b967640 1 -- 172.21.15.55:0/111771954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79300047d0 msgr2=0x7f7930004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f794b967640 1 --2- 172.21.15.55:0/111771954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79300047d0 0x7f7930004c40 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f794406c750 tx=0x7f793401c510 comp rx=0 tx=0).stop 2023-07-06T22:01:39.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f7949f04640 1 -- 172.21.15.55:0/111771954 reap_dead start 2023-07-06T22:01:39.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f794b967640 1 -- 172.21.15.55:0/111771954 shutdown_connections 2023-07-06T22:01:39.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f794b967640 1 -- 172.21.15.55:0/111771954 >> 172.21.15.55:0/111771954 conn(0x7f79440cdf40 msgr2=0x7f79440ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:39.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f794b967640 1 -- 172.21.15.55:0/111771954 shutdown_connections 2023-07-06T22:01:39.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f794b967640 1 -- 172.21.15.55:0/111771954 wait complete. 2023-07-06T22:01:39.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f794b967640 1 Processor -- start 2023-07-06T22:01:39.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f794b967640 1 -- start start 2023-07-06T22:01:39.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f794b967640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79300047d0 0x7f79441506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f794b967640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79440c7e60 0x7f794415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f794b967640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79440c3180 0x7f7944152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f794b967640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7944150be0 con 0x7f79440c7e60 2023-07-06T22:01:39.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f794b967640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794415c1d0 con 0x7f79440c3180 2023-07-06T22:01:39.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.452+0000 7f794b967640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79440c23c0 con 0x7f79300047d0 2023-07-06T22:01:39.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7948f02640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79440c7e60 0x7f794415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7948f02640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79440c7e60 0x7f794415b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42638/0 (socket says 172.21.15.55:42638) 2023-07-06T22:01:39.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7948f02640 1 -- 172.21.15.55:0/1676983949 learned_addr learned my addr 172.21.15.55:0/1676983949 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:39.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7949f04640 1 --2- 172.21.15.55:0/1676983949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79440c3180 0x7f7944152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7949703640 1 --2- 172.21.15.55:0/1676983949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79300047d0 0x7f79441506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7948f02640 1 -- 172.21.15.55:0/1676983949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79300047d0 msgr2=0x7f79441506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7948f02640 1 --2- 172.21.15.55:0/1676983949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79300047d0 0x7f79441506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7948f02640 1 -- 172.21.15.55:0/1676983949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79440c3180 msgr2=0x7f7944152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7948f02640 1 --2- 172.21.15.55:0/1676983949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79440c3180 0x7f7944152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7948f02640 1 -- 172.21.15.55:0/1676983949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79440c26a0 con 0x7f79440c7e60 2023-07-06T22:01:39.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7948f02640 1 --2- 172.21.15.55:0/1676983949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79440c7e60 0x7f794415b9a0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f79340ae040 tx=0x7f7930005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:39.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7939ffb640 1 -- 172.21.15.55:0/1676983949 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340bd070 con 0x7f79440c7e60 2023-07-06T22:01:39.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7939ffb640 1 -- 172.21.15.55:0/1676983949 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7934003840 con 0x7f79440c7e60 2023-07-06T22:01:39.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f794b967640 1 -- 172.21.15.55:0/1676983949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79440c2980 con 0x7f79440c7e60 2023-07-06T22:01:39.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7939ffb640 1 -- 172.21.15.55:0/1676983949 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934003bf0 con 0x7f79440c7e60 2023-07-06T22:01:39.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f794b967640 1 -- 172.21.15.55:0/1676983949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794415bee0 con 0x7f79440c7e60 2023-07-06T22:01:39.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f794b967640 1 -- 172.21.15.55:0/1676983949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79440b3610 con 0x7f79440c7e60 2023-07-06T22:01:39.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.456+0000 7f7939ffb640 1 -- 172.21.15.55:0/1676983949 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f79340b2050 con 0x7f79440c7e60 2023-07-06T22:01:39.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.460+0000 7f7939ffb640 1 --2- 172.21.15.55:0/1676983949 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f79280663a0 0x7f7928068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.460+0000 7f7939ffb640 1 -- 172.21.15.55:0/1676983949 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f793411d0a0 con 0x7f79440c7e60 2023-07-06T22:01:39.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.460+0000 7f7949703640 1 --2- 172.21.15.55:0/1676983949 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f79280663a0 0x7f7928068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.460+0000 7f7949703640 1 --2- 172.21.15.55:0/1676983949 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f79280663a0 0x7f7928068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7940001ec0 tx=0x7f7940009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:39.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.464+0000 7f7939ffb640 1 -- 172.21.15.55:0/1676983949 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79340edb00 con 0x7f79440c7e60 2023-07-06T22:01:39.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.676+0000 7f794b967640 1 -- 172.21.15.55:0/1676983949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7944066d60 con 0x7f79440c7e60 2023-07-06T22:01:39.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.680+0000 7f7939ffb640 1 -- 172.21.15.55:0/1676983949 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f79340b00e0 con 0x7f79440c7e60 2023-07-06T22:01:39.677 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-07-06T22:01:39.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.680+0000 7f794b967640 1 -- 172.21.15.55:0/1676983949 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f79280663a0 msgr2=0x7f7928068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.680+0000 7f794b967640 1 --2- 172.21.15.55:0/1676983949 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f79280663a0 0x7f7928068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7940001ec0 tx=0x7f7940009040 comp rx=0 tx=0).stop 2023-07-06T22:01:39.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.680+0000 7f794b967640 1 -- 172.21.15.55:0/1676983949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79440c7e60 msgr2=0x7f794415b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.680+0000 7f794b967640 1 --2- 172.21.15.55:0/1676983949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79440c7e60 0x7f794415b9a0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f79340ae040 tx=0x7f7930005800 comp rx=0 tx=0).stop 2023-07-06T22:01:39.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.680+0000 7f794b967640 1 -- 172.21.15.55:0/1676983949 shutdown_connections 2023-07-06T22:01:39.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.680+0000 7f794b967640 1 --2- 172.21.15.55:0/1676983949 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f79280663a0 0x7f7928068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.680+0000 7f794b967640 1 --2- 172.21.15.55:0/1676983949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79440c3180 0x7f7944152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.680+0000 7f794b967640 1 --2- 172.21.15.55:0/1676983949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79440c7e60 0x7f794415b9a0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.680+0000 7f794b967640 1 --2- 172.21.15.55:0/1676983949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79300047d0 0x7f79441506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.680+0000 7f794b967640 1 -- 172.21.15.55:0/1676983949 >> 172.21.15.55:0/1676983949 conn(0x7f79440cdf40 msgr2=0x7f79441575e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:39.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.680+0000 7f794b967640 1 -- 172.21.15.55:0/1676983949 shutdown_connections 2023-07-06T22:01:39.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.680+0000 7f794b967640 1 -- 172.21.15.55:0/1676983949 wait complete. 2023-07-06T22:01:39.698 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:01:39.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd6725fa640 1 Processor -- start 2023-07-06T22:01:39.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd6725fa640 1 -- start start 2023-07-06T22:01:39.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd6725fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd66c0712f0 0x7fd66c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd6725fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd66c0ca450 0x7fd66c15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd6725fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66c159cd0 con 0x7fd66c0b3730 2023-07-06T22:01:39.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd6725fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd66c0693f0 con 0x7fd66c0ca450 2023-07-06T22:01:39.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd6725fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c06aca0 con 0x7fd66c0712f0 2023-07-06T22:01:39.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd670b97640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd66c0ca450 0x7fd66c15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd66b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd66c0b3730 0x7fd66c0c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40836/0 (socket says 172.21.15.55:40836) 2023-07-06T22:01:39.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd66b7fe640 1 -- 172.21.15.55:0/1351278196 learned_addr learned my addr 172.21.15.55:0/1351278196 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:39.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd66bfff640 1 --2- 172.21.15.55:0/1351278196 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd66c0712f0 0x7fd66c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd670b97640 1 -- 172.21.15.55:0/1351278196 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd66c0712f0 msgr2=0x7fd66c06a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:39.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd670b97640 1 --2- 172.21.15.55:0/1351278196 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd66c0712f0 0x7fd66c06a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd670b97640 1 -- 172.21.15.55:0/1351278196 >> v1:172.21.15.55:6789/0 conn(0x7fd66c0b3730 legacy=0x7fd66c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.844+0000 7fd670b97640 1 -- 172.21.15.55:0/1351278196 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c0696b0 con 0x7fd66c0ca450 2023-07-06T22:01:39.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.848+0000 7fd670b97640 1 --2- 172.21.15.55:0/1351278196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66c0ca450 0x7fd66c15d3e0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fd664009d90 tx=0x7fd66401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5239d9a0df17a67b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:39.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.848+0000 7fd66affd640 1 -- 172.21.15.55:0/1351278196 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6640a58f0 con 0x7fd66c0ca450 2023-07-06T22:01:39.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.848+0000 7fd66affd640 1 -- 172.21.15.55:0/1351278196 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6640a5a50 con 0x7fd66c0ca450 2023-07-06T22:01:39.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.848+0000 7fd66affd640 1 -- 172.21.15.55:0/1351278196 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6640a5de0 con 0x7fd66c0ca450 2023-07-06T22:01:39.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.848+0000 7fd6725fa640 1 -- 172.21.15.55:0/1351278196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66c0ca450 msgr2=0x7fd66c15d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.848+0000 7fd6725fa640 1 --2- 172.21.15.55:0/1351278196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66c0ca450 0x7fd66c15d3e0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fd664009d90 tx=0x7fd66401c920 comp rx=0 tx=0).stop 2023-07-06T22:01:39.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.848+0000 7fd6725fa640 1 -- 172.21.15.55:0/1351278196 shutdown_connections 2023-07-06T22:01:39.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.848+0000 7fd6725fa640 1 --2- 172.21.15.55:0/1351278196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66c0ca450 0x7fd66c15d3e0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.848+0000 7fd6725fa640 1 --2- 172.21.15.55:0/1351278196 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd66c0712f0 0x7fd66c06a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.848+0000 7fd6725fa640 1 -- 172.21.15.55:0/1351278196 >> 172.21.15.55:0/1351278196 conn(0x7fd66c0cded0 msgr2=0x7fd66c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:39.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.848+0000 7fd6725fa640 1 -- 172.21.15.55:0/1351278196 shutdown_connections 2023-07-06T22:01:39.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.848+0000 7fd6725fa640 1 -- 172.21.15.55:0/1351278196 wait complete. 2023-07-06T22:01:39.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd6725fa640 1 Processor -- start 2023-07-06T22:01:39.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd6725fa640 1 -- start start 2023-07-06T22:01:39.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd6725fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd66c0712f0 0x7fd66c14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd6725fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd66c0b3730 0x7fd66c14bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd6725fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66c0ca450 0x7fd66c14c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd6725fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c15a9f0 con 0x7fd66c0ca450 2023-07-06T22:01:39.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd6725fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c15cd50 con 0x7fd66c0712f0 2023-07-06T22:01:39.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd6725fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c15c1d0 con 0x7fd66c0b3730 2023-07-06T22:01:39.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd670b97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66c0ca450 0x7fd66c14c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd670b97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66c0ca450 0x7fd66c14c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42656/0 (socket says 172.21.15.55:42656) 2023-07-06T22:01:39.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd670b97640 1 -- 172.21.15.55:0/183027358 learned_addr learned my addr 172.21.15.55:0/183027358 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:39.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd66bfff640 1 --2- 172.21.15.55:0/183027358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd66c0712f0 0x7fd66c14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd66b7fe640 1 --2- 172.21.15.55:0/183027358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd66c0b3730 0x7fd66c14bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd670b97640 1 -- 172.21.15.55:0/183027358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd66c0b3730 msgr2=0x7fd66c14bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd670b97640 1 --2- 172.21.15.55:0/183027358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd66c0b3730 0x7fd66c14bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd670b97640 1 -- 172.21.15.55:0/183027358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd66c0712f0 msgr2=0x7fd66c14d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:39.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd670b97640 1 --2- 172.21.15.55:0/183027358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd66c0712f0 0x7fd66c14d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:39.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd670b97640 1 -- 172.21.15.55:0/183027358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd664009a70 con 0x7fd66c0ca450 2023-07-06T22:01:39.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd670b97640 1 --2- 172.21.15.55:0/183027358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66c0ca450 0x7fd66c14c260 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fd6640b0040 tx=0x7fd6640196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:39.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd668ff9640 1 -- 172.21.15.55:0/183027358 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6640b9860 con 0x7fd66c0ca450 2023-07-06T22:01:39.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd668ff9640 1 -- 172.21.15.55:0/183027358 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6640b99c0 con 0x7fd66c0ca450 2023-07-06T22:01:39.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd668ff9640 1 -- 172.21.15.55:0/183027358 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6640b9d70 con 0x7fd66c0ca450 2023-07-06T22:01:39.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd6725fa640 1 -- 172.21.15.55:0/183027358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66c15c4b0 con 0x7fd66c0ca450 2023-07-06T22:01:39.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd6725fa640 1 -- 172.21.15.55:0/183027358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66c15ca70 con 0x7fd66c0ca450 2023-07-06T22:01:39.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.852+0000 7fd6725fa640 1 -- 172.21.15.55:0/183027358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66c066d60 con 0x7fd66c0ca450 2023-07-06T22:01:39.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.856+0000 7fd668ff9640 1 -- 172.21.15.55:0/183027358 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd6640ad440 con 0x7fd66c0ca450 2023-07-06T22:01:39.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.856+0000 7fd668ff9640 1 --2- 172.21.15.55:0/183027358 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd6580663a0 0x7fd658068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:39.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.856+0000 7fd668ff9640 1 -- 172.21.15.55:0/183027358 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd66411fd30 con 0x7fd66c0ca450 2023-07-06T22:01:39.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.856+0000 7fd66bfff640 1 --2- 172.21.15.55:0/183027358 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd6580663a0 0x7fd658068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:39.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.856+0000 7fd66bfff640 1 --2- 172.21.15.55:0/183027358 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd6580663a0 0x7fd658068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0079c0 tx=0x7fd65c008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:39.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:39.860+0000 7fd668ff9640 1 -- 172.21.15.55:0/183027358 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6640ed1c0 con 0x7fd66c0ca450 2023-07-06T22:01:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.048+0000 7fd6725fa640 1 -- 172.21.15.55:0/183027358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd66c0c4960 con 0x7fd66c0ca450 2023-07-06T22:01:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.048+0000 7fd668ff9640 1 -- 172.21.15.55:0/183027358 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4670 (secure 0 0 0) 0x7fd6640f07a0 con 0x7fd66c0ca450 2023-07-06T22:01:40.045 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:40.045 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/457440874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":457440874},{"type":"v1","addr":"172.21.15.138:6834","nonce":457440874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/446729940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":446729940},{"type":"v1","addr":"172.21.15.55:6835","nonce":446729940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9189,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/742646154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":742646154},{"type":"v1","addr":"172.21.15.138:6835","nonce":742646154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:01:30.178097+0000","modified":"2023-07-06T22:01:33.205176+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9198":{"gid":9198,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/4072042723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":4072042723},{"type":"v1","addr":"172.21.15.55:6837","nonce":4072042723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-06T22:01:40.045 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 63 2023-07-06T22:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.048+0000 7fd6725fa640 1 -- 172.21.15.55:0/183027358 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd6580663a0 msgr2=0x7fd658068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.048+0000 7fd6725fa640 1 --2- 172.21.15.55:0/183027358 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd6580663a0 0x7fd658068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0079c0 tx=0x7fd65c008040 comp rx=0 tx=0).stop 2023-07-06T22:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.048+0000 7fd6725fa640 1 -- 172.21.15.55:0/183027358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66c0ca450 msgr2=0x7fd66c14c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.048+0000 7fd6725fa640 1 --2- 172.21.15.55:0/183027358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66c0ca450 0x7fd66c14c260 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fd6640b0040 tx=0x7fd6640196c0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.048+0000 7fd6725fa640 1 -- 172.21.15.55:0/183027358 shutdown_connections 2023-07-06T22:01:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.048+0000 7fd6725fa640 1 --2- 172.21.15.55:0/183027358 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fd6580663a0 0x7fd658068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.048+0000 7fd6725fa640 1 --2- 172.21.15.55:0/183027358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66c0ca450 0x7fd66c14c260 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.048+0000 7fd6725fa640 1 --2- 172.21.15.55:0/183027358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd66c0b3730 0x7fd66c14bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.048+0000 7fd6725fa640 1 --2- 172.21.15.55:0/183027358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd66c0712f0 0x7fd66c14d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.048+0000 7fd6725fa640 1 -- 172.21.15.55:0/183027358 >> 172.21.15.55:0/183027358 conn(0x7fd66c0cded0 msgr2=0x7fd66c0b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.048+0000 7fd6725fa640 1 -- 172.21.15.55:0/183027358 shutdown_connections 2023-07-06T22:01:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.048+0000 7fd6725fa640 1 -- 172.21.15.55:0/183027358 wait complete. 2023-07-06T22:01:40.467 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T22:01:30.178097+0000', 'modified': '2023-07-06T22:01:33.205176+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9198': {'gid': 9198, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6837/4072042723', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6836', 'nonce': 4072042723}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 4072042723}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T22:01:40.468 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T22:01:40.468 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-06T22:01:40.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.616+0000 7f62425fa640 1 Processor -- start 2023-07-06T22:01:40.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.616+0000 7f62425fa640 1 -- start start 2023-07-06T22:01:40.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.616+0000 7f62425fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f623c158850 0x7f623c0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.616+0000 7f62425fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f623c0ca130 0x7f623c0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.616+0000 7f62425fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623c0b2aa0 con 0x7f623c0703e0 2023-07-06T22:01:40.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.616+0000 7f62425fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623c158c20 con 0x7f623c158850 2023-07-06T22:01:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.616+0000 7f62425fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c0c8db0 con 0x7f623c0ca130 2023-07-06T22:01:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.620+0000 7f623bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f623c158850 0x7f623c0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.620+0000 7f6240b97640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f623c0703e0 0x7f623c06eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40848/0 (socket says 172.21.15.55:40848) 2023-07-06T22:01:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.620+0000 7f6240b97640 1 -- 172.21.15.55:0/2644940946 learned_addr learned my addr 172.21.15.55:0/2644940946 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.620+0000 7f623b7fe640 1 --2- 172.21.15.55:0/2644940946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f623c0ca130 0x7f623c0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.620+0000 7f623bfff640 1 -- 172.21.15.55:0/2644940946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f623c0ca130 msgr2=0x7f623c0ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:40.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.620+0000 7f623bfff640 1 --2- 172.21.15.55:0/2644940946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f623c0ca130 0x7f623c0ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.620+0000 7f623bfff640 1 -- 172.21.15.55:0/2644940946 >> v1:172.21.15.55:6789/0 conn(0x7f623c0703e0 legacy=0x7f623c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.620+0000 7f623bfff640 1 -- 172.21.15.55:0/2644940946 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c0c9090 con 0x7f623c158850 2023-07-06T22:01:40.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.620+0000 7f623b7fe640 1 --2- 172.21.15.55:0/2644940946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f623c0ca130 0x7f623c0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:40.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.620+0000 7f623affd640 1 -- 172.21.15.55:0/2644940946 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553498410 0 0) 0x7f623c0b2aa0 con 0x7f623c0703e0 2023-07-06T22:01:40.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.620+0000 7f623bfff640 1 --2- 172.21.15.55:0/2644940946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f623c158850 0x7f623c0cca30 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f622c0097c0 tx=0x7f622c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb864fe9eff830d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:40.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f623affd640 1 -- 172.21.15.55:0/2644940946 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c0a8970 con 0x7f623c158850 2023-07-06T22:01:40.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f623affd640 1 -- 172.21.15.55:0/2644940946 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c0a8ad0 con 0x7f623c158850 2023-07-06T22:01:40.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f623affd640 1 -- 172.21.15.55:0/2644940946 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c0a8e60 con 0x7f623c158850 2023-07-06T22:01:40.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 -- 172.21.15.55:0/2644940946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f623c158850 msgr2=0x7f623c0cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 --2- 172.21.15.55:0/2644940946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f623c158850 0x7f623c0cca30 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f622c0097c0 tx=0x7f622c01ec70 comp rx=0 tx=0).stop 2023-07-06T22:01:40.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 -- 172.21.15.55:0/2644940946 shutdown_connections 2023-07-06T22:01:40.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 --2- 172.21.15.55:0/2644940946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f623c0ca130 0x7f623c0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 --2- 172.21.15.55:0/2644940946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f623c158850 0x7f623c0cca30 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 -- 172.21.15.55:0/2644940946 >> 172.21.15.55:0/2644940946 conn(0x7f623c0cea70 msgr2=0x7f623c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 -- 172.21.15.55:0/2644940946 shutdown_connections 2023-07-06T22:01:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 -- 172.21.15.55:0/2644940946 wait complete. 2023-07-06T22:01:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 Processor -- start 2023-07-06T22:01:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 -- start start 2023-07-06T22:01:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f623c0703e0 0x7f623c155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f623c0ca130 0x7f623c06bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f623c158850 0x7f623c0b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c09a1f0 con 0x7f623c0703e0 2023-07-06T22:01:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c06af00 con 0x7f623c0ca130 2023-07-06T22:01:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f62425fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c06b1e0 con 0x7f623c158850 2023-07-06T22:01:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.624+0000 7f623bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f623c0703e0 0x7f623c155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f623bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f623c0703e0 0x7f623c155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42682/0 (socket says 172.21.15.55:42682) 2023-07-06T22:01:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f623bfff640 1 -- 172.21.15.55:0/125219430 learned_addr learned my addr 172.21.15.55:0/125219430 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f6240b97640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f623c158850 0x7f623c0b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f623b7fe640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f623c0ca130 0x7f623c06bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f623bfff640 1 -- 172.21.15.55:0/125219430 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f623c158850 msgr2=0x7f623c0b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f623bfff640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f623c158850 0x7f623c0b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f623bfff640 1 -- 172.21.15.55:0/125219430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f623c0ca130 msgr2=0x7f623c06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f623bfff640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f623c0ca130 0x7f623c06bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f623bfff640 1 -- 172.21.15.55:0/125219430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c009420 con 0x7f623c0703e0 2023-07-06T22:01:40.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f6240b97640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f623c158850 0x7f623c0b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:40.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f623bfff640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f623c0703e0 0x7f623c155c70 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f622c0b3040 tx=0x7f622c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:40.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f6238ff9640 1 -- 172.21.15.55:0/125219430 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c0b9630 con 0x7f623c0703e0 2023-07-06T22:01:40.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f6238ff9640 1 -- 172.21.15.55:0/125219430 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c0b97b0 con 0x7f623c0703e0 2023-07-06T22:01:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f6238ff9640 1 -- 172.21.15.55:0/125219430 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c0b9b60 con 0x7f623c0703e0 2023-07-06T22:01:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f62425fa640 1 -- 172.21.15.55:0/125219430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623c06b4c0 con 0x7f623c0703e0 2023-07-06T22:01:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f62425fa640 1 -- 172.21.15.55:0/125219430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623c1561b0 con 0x7f623c0703e0 2023-07-06T22:01:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.628+0000 7f6238ff9640 1 -- 172.21.15.55:0/125219430 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f622c0b7040 con 0x7f623c0703e0 2023-07-06T22:01:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6238ff9640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f62280663a0 0x7f6228068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6238ff9640 1 -- 172.21.15.55:0/125219430 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f622c1220c0 con 0x7f623c0703e0 2023-07-06T22:01:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f623b7fe640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f62280663a0 0x7f6228068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 Processor -- start 2023-07-06T22:01:40.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 -- start start 2023-07-06T22:01:40.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f623b7fe640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f62280663a0 0x7f6228068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f623c06f4c0 tx=0x7f6230008040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:40.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2704a8d40 0x55c2704a9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c27045f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c27045f8a0 0x55c27045fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c270322ac0 con 0x55c2704a9650 2023-07-06T22:01:40.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c27025c840 con 0x55c2704a8d40 2023-07-06T22:01:40.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2702b02e0 con 0x55c27045f8a0 2023-07-06T22:01:40.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f623b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c27045f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f623b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c27045f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42690/0 (socket says 172.21.15.55:42690) 2023-07-06T22:01:40.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f623b7fe640 1 -- 172.21.15.55:0/1259324012 learned_addr learned my addr 172.21.15.55:0/1259324012 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:40.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6240b97640 1 --2- 172.21.15.55:0/1259324012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c27045f8a0 0x55c27045fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f623bfff640 1 --2- 172.21.15.55:0/1259324012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2704a8d40 0x55c2704a9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f623b7fe640 1 -- 172.21.15.55:0/1259324012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c27045f8a0 msgr2=0x55c27045fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:40.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f623b7fe640 1 --2- 172.21.15.55:0/1259324012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c27045f8a0 0x55c27045fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f623b7fe640 1 -- 172.21.15.55:0/1259324012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2704a8d40 msgr2=0x55c2704a9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:40.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f623b7fe640 1 --2- 172.21.15.55:0/1259324012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2704a8d40 0x55c2704a9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f623b7fe640 1 -- 172.21.15.55:0/1259324012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c26ffa5890 con 0x55c2704a9650 2023-07-06T22:01:40.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f623b7fe640 1 --2- 172.21.15.55:0/1259324012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c27045f360 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f623000fa00 tx=0x7f6230012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735465bb0675d799 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:40.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6221ffb640 1 -- 172.21.15.55:0/1259324012 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230014be0 con 0x55c2704a9650 2023-07-06T22:01:40.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6221ffb640 1 -- 172.21.15.55:0/1259324012 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6230019070 con 0x55c2704a9650 2023-07-06T22:01:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6221ffb640 1 -- 172.21.15.55:0/1259324012 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230020440 con 0x55c2704a9650 2023-07-06T22:01:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 -- 172.21.15.55:0/1259324012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 msgr2=0x55c27045f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 --2- 172.21.15.55:0/1259324012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c27045f360 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f623000fa00 tx=0x7f6230012000 comp rx=0 tx=0).stop 2023-07-06T22:01:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 -- 172.21.15.55:0/1259324012 shutdown_connections 2023-07-06T22:01:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 --2- 172.21.15.55:0/1259324012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c27045f8a0 0x55c27045fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 --2- 172.21.15.55:0/1259324012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c27045f360 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 --2- 172.21.15.55:0/1259324012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2704a8d40 0x55c2704a9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 -- 172.21.15.55:0/1259324012 >> 172.21.15.55:0/1259324012 conn(0x55c270452800 msgr2=0x55c27045dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.632+0000 7f6245956000 1 -- 172.21.15.55:0/1259324012 shutdown_connections 2023-07-06T22:01:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f6245956000 1 -- 172.21.15.55:0/1259324012 wait complete. 2023-07-06T22:01:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f6245956000 1 -- start start 2023-07-06T22:01:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f6245956000 1 Processor -- start 2023-07-06T22:01:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f6245956000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c27045f8a0 0x55c2704a8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f6245956000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2704a8d40 0x55c27046a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f6245956000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a9650 0x55c27046a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f6245956000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2702a9380 con 0x55c27045f8a0 2023-07-06T22:01:40.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f6245956000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c270265ae0 con 0x55c2704a8d40 2023-07-06T22:01:40.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f6245956000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c270265780 con 0x55c2704a9650 2023-07-06T22:01:40.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f6245956000 10 client.0 _ll_register_callbacks cb 0x55c270446e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T22:01:40.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f623bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c27045f8a0 0x55c2704a8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f623bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c27045f8a0 0x55c2704a8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42692/0 (socket says 172.21.15.55:42692) 2023-07-06T22:01:40.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f623bfff640 1 -- 172.21.15.55:0/1220599489 learned_addr learned my addr 172.21.15.55:0/1220599489 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:40.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f623b7fe640 1 --2- 172.21.15.55:0/1220599489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2704a8d40 0x55c27046a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f6240b97640 1 --2- 172.21.15.55:0/1220599489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a9650 0x55c27046a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f623bfff640 1 -- 172.21.15.55:0/1220599489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a9650 msgr2=0x55c27046a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:40.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f623bfff640 1 --2- 172.21.15.55:0/1220599489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a9650 0x55c27046a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f623bfff640 1 -- 172.21.15.55:0/1220599489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2704a8d40 msgr2=0x55c27046a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:40.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f623bfff640 1 --2- 172.21.15.55:0/1220599489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2704a8d40 0x55c27046a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f623bfff640 1 -- 172.21.15.55:0/1220599489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623000e040 con 0x55c27045f8a0 2023-07-06T22:01:40.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f623bfff640 1 --2- 172.21.15.55:0/1220599489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c27045f8a0 0x55c2704a8800 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f622c0f2e80 tx=0x7f622c0fb300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d3fdd7ea2f9fba server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:40.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f621affd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T22:01:40.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f621affd640 1 -- 172.21.15.55:0/1220599489 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c0fafb0 con 0x55c27045f8a0 2023-07-06T22:01:40.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f621affd640 1 -- 172.21.15.55:0/1220599489 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f622c1203c0 con 0x55c27045f8a0 2023-07-06T22:01:40.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f6245956000 1 -- 172.21.15.55:0/1220599489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c270270a20 con 0x55c27045f8a0 2023-07-06T22:01:40.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f621affd640 1 -- 172.21.15.55:0/1220599489 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f622c106af0 con 0x55c27045f8a0 2023-07-06T22:01:40.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f6245956000 10 client.9357 fetch_fsmap learned FSMap version 63 2023-07-06T22:01:40.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.636+0000 7f6245956000 1 -- 172.21.15.55:0/1220599489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55c27026dd10 con 0x55c27045f8a0 2023-07-06T22:01:40.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f621affd640 1 -- 172.21.15.55:0/1220599489 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c270270a20 con 0x55c27045f8a0 2023-07-06T22:01:40.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f621affd640 1 -- 172.21.15.55:0/1220599489 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 63) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f622c106c50 con 0x55c27045f8a0 2023-07-06T22:01:40.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 10 client.9357 fetch_fsmap finished waiting for FSMap version 63 2023-07-06T22:01:40.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 10 client.9357 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-06T22:01:40.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 20 client.9357 populate_metadata read hostname 'smithi055' 2023-07-06T22:01:40.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 1 --2- 172.21.15.55:0/1220599489 >> [v2:172.21.15.55:6836/4072042723,v1:172.21.15.55:6837/4072042723] conn(0x55c27046b540 0x55c2704badd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 4 client.9357 mds_command: new command op to 9198 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T22:01:40.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 1 -- 172.21.15.55:0/1220599489 --> [v2:172.21.15.55:6836/4072042723,v1:172.21.15.55:6837/4072042723] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c2702d8710 con 0x55c27046b540 2023-07-06T22:01:40.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f623b7fe640 1 --2- 172.21.15.55:0/1220599489 >> [v2:172.21.15.55:6836/4072042723,v1:172.21.15.55:6837/4072042723] conn(0x55c27046b540 0x55c2704badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f623b7fe640 1 --2- 172.21.15.55:0/1220599489 >> [v2:172.21.15.55:6836/4072042723,v1:172.21.15.55:6837/4072042723] conn(0x55c27046b540 0x55c2704badd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee447e5aec78ddd8 server_cookie=465d2dea856f940f in_seq=0 out_seq=0 2023-07-06T22:01:40.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f621affd640 10 client.9357 ms_handle_connect on v2:172.21.15.55:6836/4072042723 2023-07-06T22:01:40.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f621affd640 1 -- 172.21.15.55:0/1220599489 <== mds.0 v2:172.21.15.55:6836/4072042723 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c2702d8710 con 0x55c27046b540 2023-07-06T22:01:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f621affd640 10 client.9357 handle_command_reply: tid=0 2023-07-06T22:01:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 1 client.9357 shutdown 2023-07-06T22:01:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 1 -- 172.21.15.55:0/1220599489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c27045f8a0 msgr2=0x55c2704a8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 1 --2- 172.21.15.55:0/1220599489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c27045f8a0 0x55c2704a8800 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f622c0f2e80 tx=0x7f622c0fb300 comp rx=0 tx=0).stop 2023-07-06T22:01:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 1 -- 172.21.15.55:0/1220599489 shutdown_connections 2023-07-06T22:01:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 1 --2- 172.21.15.55:0/1220599489 >> [v2:172.21.15.55:6836/4072042723,v1:172.21.15.55:6837/4072042723] conn(0x55c27046b540 0x55c2704badd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 1 --2- 172.21.15.55:0/1220599489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a9650 0x55c27046a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 1 --2- 172.21.15.55:0/1220599489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2704a8d40 0x55c27046a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 1 --2- 172.21.15.55:0/1220599489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c27045f8a0 0x55c2704a8800 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f621affd640 0 client.9357 ms_handle_reset on v2:172.21.15.55:6836/4072042723 2023-07-06T22:01:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 1 -- 172.21.15.55:0/1220599489 >> 172.21.15.55:0/1220599489 conn(0x55c270452800 msgr2=0x55c270460710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 1 -- 172.21.15.55:0/1220599489 shutdown_connections 2023-07-06T22:01:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 1 -- 172.21.15.55:0/1220599489 wait complete. 2023-07-06T22:01:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.640+0000 7f6245956000 20 client.9357 trim_cache size 0 max 16384 2023-07-06T22:01:40.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6245956000 1 Processor -- start 2023-07-06T22:01:40.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6245956000 1 -- start start 2023-07-06T22:01:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6245956000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c27045f8a0 0x55c27046a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6245956000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a8d40 0x55c27046a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6245956000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c27045fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6245956000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c26ff66940 con 0x55c2704a9650 2023-07-06T22:01:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6245956000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2702a9380 con 0x55c27045f8a0 2023-07-06T22:01:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6245956000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2702a3680 con 0x55c2704a8d40 2023-07-06T22:01:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6240b97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c27045fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6240b97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c27045fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42696/0 (socket says 172.21.15.55:42696) 2023-07-06T22:01:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6240b97640 1 -- 172.21.15.55:0/717407129 learned_addr learned my addr 172.21.15.55:0/717407129 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f623b7fe640 1 --2- 172.21.15.55:0/717407129 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a8d40 0x55c27046a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f623bfff640 1 --2- 172.21.15.55:0/717407129 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c27045f8a0 0x55c27046a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6240b97640 1 -- 172.21.15.55:0/717407129 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a8d40 msgr2=0x55c27046a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:40.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6240b97640 1 --2- 172.21.15.55:0/717407129 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a8d40 0x55c27046a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6240b97640 1 -- 172.21.15.55:0/717407129 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c27045f8a0 msgr2=0x55c27046a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6240b97640 1 --2- 172.21.15.55:0/717407129 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c27045f8a0 0x55c27046a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6240b97640 1 -- 172.21.15.55:0/717407129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c270253fa0 con 0x55c2704a9650 2023-07-06T22:01:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f6240b97640 1 --2- 172.21.15.55:0/717407129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c27045fc70 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f62340075d0 tx=0x7f6234005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fef96bab56c4d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f62227fc640 1 -- 172.21.15.55:0/717407129 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6234001ed0 con 0x55c2704a9650 2023-07-06T22:01:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f62227fc640 1 -- 172.21.15.55:0/717407129 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6234002030 con 0x55c2704a9650 2023-07-06T22:01:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.656+0000 7f62227fc640 1 -- 172.21.15.55:0/717407129 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6234016620 con 0x55c2704a9650 2023-07-06T22:01:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 -- 172.21.15.55:0/717407129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 msgr2=0x55c27045fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 --2- 172.21.15.55:0/717407129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c27045fc70 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f62340075d0 tx=0x7f6234005e60 comp rx=0 tx=0).stop 2023-07-06T22:01:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 -- 172.21.15.55:0/717407129 shutdown_connections 2023-07-06T22:01:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 --2- 172.21.15.55:0/717407129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c27045fc70 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 --2- 172.21.15.55:0/717407129 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a8d40 0x55c27046a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 --2- 172.21.15.55:0/717407129 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c27045f8a0 0x55c27046a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 -- 172.21.15.55:0/717407129 >> 172.21.15.55:0/717407129 conn(0x55c270452800 msgr2=0x55c27045dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 -- 172.21.15.55:0/717407129 shutdown_connections 2023-07-06T22:01:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 -- 172.21.15.55:0/717407129 wait complete. 2023-07-06T22:01:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 -- start start 2023-07-06T22:01:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 Processor -- start 2023-07-06T22:01:40.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c27045f8a0 0x55c2704696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a8d40 0x55c2704bbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c2704bc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2702a4cf0 con 0x55c2704a9650 2023-07-06T22:01:40.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2702ad380 con 0x55c27045f8a0 2023-07-06T22:01:40.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2704bf7b0 con 0x55c2704a8d40 2023-07-06T22:01:40.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 10 client.0 _ll_register_callbacks cb 0x55c27026d7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T22:01:40.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6240b97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c2704bc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6240b97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c2704bc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42700/0 (socket says 172.21.15.55:42700) 2023-07-06T22:01:40.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6240b97640 1 -- 172.21.15.55:0/2356763334 learned_addr learned my addr 172.21.15.55:0/2356763334 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:40.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f623bfff640 1 --2- 172.21.15.55:0/2356763334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c27045f8a0 0x55c2704696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f623b7fe640 1 --2- 172.21.15.55:0/2356763334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a8d40 0x55c2704bbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6240b97640 1 -- 172.21.15.55:0/2356763334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a8d40 msgr2=0x55c2704bbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:40.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6240b97640 1 --2- 172.21.15.55:0/2356763334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a8d40 0x55c2704bbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6240b97640 1 -- 172.21.15.55:0/2356763334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c27045f8a0 msgr2=0x55c2704696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:40.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6240b97640 1 --2- 172.21.15.55:0/2356763334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c27045f8a0 0x55c2704696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6240b97640 1 -- 172.21.15.55:0/2356763334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623400f040 con 0x55c2704a9650 2023-07-06T22:01:40.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6240b97640 1 --2- 172.21.15.55:0/2356763334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c2704bc360 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f6234001570 tx=0x7f6234005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63e037d09b954f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:40.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f621affd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T22:01:40.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f621affd640 1 -- 172.21.15.55:0/2356763334 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6234001ed0 con 0x55c2704a9650 2023-07-06T22:01:40.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 -- 172.21.15.55:0/2356763334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2702a7cd0 con 0x55c2704a9650 2023-07-06T22:01:40.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f621affd640 1 -- 172.21.15.55:0/2356763334 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f623401fda0 con 0x55c2704a9650 2023-07-06T22:01:40.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f621affd640 1 -- 172.21.15.55:0/2356763334 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62340071a0 con 0x55c2704a9650 2023-07-06T22:01:40.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 10 client.9363 fetch_fsmap learned FSMap version 63 2023-07-06T22:01:40.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.660+0000 7f6245956000 1 -- 172.21.15.55:0/2356763334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55c26ffa5cc0 con 0x55c2704a9650 2023-07-06T22:01:40.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f621affd640 1 -- 172.21.15.55:0/2356763334 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c2702a7cd0 con 0x55c2704a9650 2023-07-06T22:01:40.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f621affd640 1 -- 172.21.15.55:0/2356763334 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 63) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f623402b480 con 0x55c2704a9650 2023-07-06T22:01:40.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 10 client.9363 fetch_fsmap finished waiting for FSMap version 63 2023-07-06T22:01:40.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 10 client.9363 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-06T22:01:40.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 20 client.9363 populate_metadata read hostname 'smithi055' 2023-07-06T22:01:40.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 1 --2- 172.21.15.55:0/2356763334 >> [v2:172.21.15.55:6836/4072042723,v1:172.21.15.55:6837/4072042723] conn(0x55c270506650 0x55c270506a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 4 client.9363 mds_command: new command op to 9198 tid=0[{"prefix": "status"}] 2023-07-06T22:01:40.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 1 -- 172.21.15.55:0/2356763334 --> [v2:172.21.15.55:6836/4072042723,v1:172.21.15.55:6837/4072042723] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c2702a2360 con 0x55c270506650 2023-07-06T22:01:40.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f623bfff640 1 --2- 172.21.15.55:0/2356763334 >> [v2:172.21.15.55:6836/4072042723,v1:172.21.15.55:6837/4072042723] conn(0x55c270506650 0x55c270506a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f621affd640 10 client.9363 ms_handle_connect on v2:172.21.15.55:6836/4072042723 2023-07-06T22:01:40.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f623bfff640 1 --2- 172.21.15.55:0/2356763334 >> [v2:172.21.15.55:6836/4072042723,v1:172.21.15.55:6837/4072042723] conn(0x55c270506650 0x55c270506a20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e29050cc57137980 server_cookie=79112e22c995038c in_seq=0 out_seq=0 2023-07-06T22:01:40.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f621affd640 1 -- 172.21.15.55:0/2356763334 <== mds.0 v2:172.21.15.55:6836/4072042723 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55c2702a2360 con 0x55c270506650 2023-07-06T22:01:40.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f621affd640 10 client.9363 handle_command_reply: tid=0 2023-07-06T22:01:40.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 1 client.9363 shutdown 2023-07-06T22:01:40.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 1 -- 172.21.15.55:0/2356763334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 msgr2=0x55c2704bc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 1 --2- 172.21.15.55:0/2356763334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c2704bc360 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f6234001570 tx=0x7f6234005f90 comp rx=0 tx=0).stop 2023-07-06T22:01:40.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 1 -- 172.21.15.55:0/2356763334 shutdown_connections 2023-07-06T22:01:40.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 1 --2- 172.21.15.55:0/2356763334 >> [v2:172.21.15.55:6836/4072042723,v1:172.21.15.55:6837/4072042723] conn(0x55c270506650 0x55c270506a20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 1 --2- 172.21.15.55:0/2356763334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c2704a9650 0x55c2704bc360 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 1 --2- 172.21.15.55:0/2356763334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55c2704a8d40 0x55c2704bbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 1 --2- 172.21.15.55:0/2356763334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c27045f8a0 0x55c2704696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 1 -- 172.21.15.55:0/2356763334 >> 172.21.15.55:0/2356763334 conn(0x55c270452800 msgr2=0x55c27045dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:40.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f621affd640 0 client.9363 ms_handle_reset on v2:172.21.15.55:6836/4072042723 2023-07-06T22:01:40.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 1 -- 172.21.15.55:0/2356763334 shutdown_connections 2023-07-06T22:01:40.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 1 -- 172.21.15.55:0/2356763334 wait complete. 2023-07-06T22:01:40.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f6245956000 20 client.9363 trim_cache size 0 max 16384 2023-07-06T22:01:40.670 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:01:40.671 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c64f3ef1-e769-47b3-ae15-a714e4e7c4f7", 2023-07-06T22:01:40.671 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-07-06T22:01:40.671 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 9198, 2023-07-06T22:01:40.671 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-07-06T22:01:40.671 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-07-06T22:01:40.671 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-07-06T22:01:40.671 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.485266320999999, 2023-07-06T22:01:40.672 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 63, 2023-07-06T22:01:40.672 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 146, 2023-07-06T22:01:40.672 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 146, 2023-07-06T22:01:40.672 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 15.822114837999999 2023-07-06T22:01:40.672 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:01:40.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f62425fa640 1 -- 172.21.15.55:0/125219430 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f62280663a0 msgr2=0x7f6228068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f62425fa640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f62280663a0 0x7f6228068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f623c06f4c0 tx=0x7f6230008040 comp rx=0 tx=0).stop 2023-07-06T22:01:40.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f62425fa640 1 -- 172.21.15.55:0/125219430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f623c0703e0 msgr2=0x7f623c155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f62425fa640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f623c0703e0 0x7f623c155c70 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f622c0b3040 tx=0x7f622c01ba10 comp rx=0 tx=0).stop 2023-07-06T22:01:40.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f62425fa640 1 -- 172.21.15.55:0/125219430 shutdown_connections 2023-07-06T22:01:40.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f62425fa640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f62280663a0 0x7f6228068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f62425fa640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f623c158850 0x7f623c0b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f62425fa640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f623c0ca130 0x7f623c06bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f62425fa640 1 --2- 172.21.15.55:0/125219430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f623c0703e0 0x7f623c155c70 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f62425fa640 1 -- 172.21.15.55:0/125219430 >> 172.21.15.55:0/125219430 conn(0x7f623c0cea70 msgr2=0x7f623c1e45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:40.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f62425fa640 1 -- 172.21.15.55:0/125219430 shutdown_connections 2023-07-06T22:01:40.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.664+0000 7f62425fa640 1 -- 172.21.15.55:0/125219430 wait complete. 2023-07-06T22:01:40.681 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T22:01:40.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.824+0000 7f69d3774640 1 Processor -- start 2023-07-06T22:01:40.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.824+0000 7f69d3774640 1 -- start start 2023-07-06T22:01:40.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.828+0000 7f69d3774640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f69cc06a400 0x7f69cc0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.828+0000 7f69d3774640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69cc06bd00 con 0x7f69cc160030 2023-07-06T22:01:40.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.828+0000 7f69d3774640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69cc0c9ba0 con 0x7f69cc0cd330 2023-07-06T22:01:40.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.828+0000 7f69d3774640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69cc160400 con 0x7f69cc06a400 2023-07-06T22:01:40.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.828+0000 7f69d1510640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f69cc160030 0x7f69cc070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40850/0 (socket says 172.21.15.55:40850) 2023-07-06T22:01:40.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.828+0000 7f69d1510640 1 -- 172.21.15.55:0/4059191079 learned_addr learned my addr 172.21.15.55:0/4059191079 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:40.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.828+0000 7f69d1d11640 1 --2- 172.21.15.55:0/4059191079 >> v2:172.21.15.138:3300/0 conn(0x7f69cc06a400 0x7f69cc0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.828+0000 7f69c3fff640 1 -- 172.21.15.55:0/4059191079 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326299564 0 0) 0x7f69cc06bd00 con 0x7f69cc160030 2023-07-06T22:01:40.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.828+0000 7f69c3fff640 1 -- 172.21.15.55:0/4059191079 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69b8003530 con 0x7f69cc160030 2023-07-06T22:01:40.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.828+0000 7f69d1d11640 1 -- 172.21.15.55:0/4059191079 >> v1:172.21.15.138:6789/0 conn(0x7f69cc0cd330 legacy=0x7f69cc0cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.828+0000 7f69d1d11640 1 -- 172.21.15.55:0/4059191079 >> v1:172.21.15.55:6789/0 conn(0x7f69cc160030 legacy=0x7f69cc070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.828+0000 7f69d1d11640 1 -- 172.21.15.55:0/4059191079 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc071540 con 0x7f69cc06a400 2023-07-06T22:01:40.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.832+0000 7f69d1d11640 1 --2- 172.21.15.55:0/4059191079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69cc06a400 0x7f69cc0cd7a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009d90 tx=0x7f69c401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b589258827dc38b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:40.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.832+0000 7f69c3fff640 1 -- 172.21.15.55:0/4059191079 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c40a5810 con 0x7f69cc06a400 2023-07-06T22:01:40.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.832+0000 7f69c3fff640 1 -- 172.21.15.55:0/4059191079 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c40a5970 con 0x7f69cc06a400 2023-07-06T22:01:40.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.832+0000 7f69c3fff640 1 -- 172.21.15.55:0/4059191079 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c40a5d00 con 0x7f69cc06a400 2023-07-06T22:01:40.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.832+0000 7f69d3774640 1 -- 172.21.15.55:0/4059191079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69cc06a400 msgr2=0x7f69cc0cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.832+0000 7f69d3774640 1 --2- 172.21.15.55:0/4059191079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69cc06a400 0x7f69cc0cd7a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009d90 tx=0x7f69c401c950 comp rx=0 tx=0).stop 2023-07-06T22:01:40.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.832+0000 7f69d3774640 1 -- 172.21.15.55:0/4059191079 shutdown_connections 2023-07-06T22:01:40.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.832+0000 7f69d3774640 1 --2- 172.21.15.55:0/4059191079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69cc06a400 0x7f69cc0cd7a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.832+0000 7f69d3774640 1 -- 172.21.15.55:0/4059191079 >> 172.21.15.55:0/4059191079 conn(0x7f69cc0cded0 msgr2=0x7f69cc0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:40.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.832+0000 7f69d3774640 1 -- 172.21.15.55:0/4059191079 shutdown_connections 2023-07-06T22:01:40.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.832+0000 7f69d3774640 1 -- 172.21.15.55:0/4059191079 wait complete. 2023-07-06T22:01:40.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.832+0000 7f69d3774640 1 Processor -- start 2023-07-06T22:01:40.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.832+0000 7f69d3774640 1 -- start start 2023-07-06T22:01:40.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d3774640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69cc06a400 0x7f69cc0b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d3774640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc0cd330 0x7f69cc1618d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d3774640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69cc160030 0x7f69cc0c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d3774640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc1614b0 con 0x7f69cc0cd330 2023-07-06T22:01:40.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d3774640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0c61d0 con 0x7f69cc06a400 2023-07-06T22:01:40.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d3774640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc15ace0 con 0x7f69cc160030 2023-07-06T22:01:40.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d0d0f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc0cd330 0x7f69cc1618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d0d0f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc0cd330 0x7f69cc1618d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42702/0 (socket says 172.21.15.55:42702) 2023-07-06T22:01:40.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d0d0f640 1 -- 172.21.15.55:0/20002563 learned_addr learned my addr 172.21.15.55:0/20002563 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:40.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d1510640 1 --2- 172.21.15.55:0/20002563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69cc06a400 0x7f69cc0b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d1d11640 1 --2- 172.21.15.55:0/20002563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69cc160030 0x7f69cc0c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d0d0f640 1 -- 172.21.15.55:0/20002563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69cc160030 msgr2=0x7f69cc0c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d0d0f640 1 --2- 172.21.15.55:0/20002563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69cc160030 0x7f69cc0c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d0d0f640 1 -- 172.21.15.55:0/20002563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69cc06a400 msgr2=0x7f69cc0b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:40.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d0d0f640 1 --2- 172.21.15.55:0/20002563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69cc06a400 0x7f69cc0b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:40.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d0d0f640 1 -- 172.21.15.55:0/20002563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c4009a70 con 0x7f69cc0cd330 2023-07-06T22:01:40.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d0d0f640 1 --2- 172.21.15.55:0/20002563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc0cd330 0x7f69cc1618d0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00c530 tx=0x7f69bc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:40.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69c1ffb640 1 -- 172.21.15.55:0/20002563 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc005220 con 0x7f69cc0cd330 2023-07-06T22:01:40.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69c1ffb640 1 -- 172.21.15.55:0/20002563 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc005380 con 0x7f69cc0cd330 2023-07-06T22:01:40.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d3774640 1 -- 172.21.15.55:0/20002563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69cc160b30 con 0x7f69cc0cd330 2023-07-06T22:01:40.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69c1ffb640 1 -- 172.21.15.55:0/20002563 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc007270 con 0x7f69cc0cd330 2023-07-06T22:01:40.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d3774640 1 -- 172.21.15.55:0/20002563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69cc1610d0 con 0x7f69cc0cd330 2023-07-06T22:01:40.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.836+0000 7f69d3774640 1 -- 172.21.15.55:0/20002563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69cc1615f0 con 0x7f69cc0cd330 2023-07-06T22:01:40.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.840+0000 7f69c1ffb640 1 -- 172.21.15.55:0/20002563 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f69bc0073d0 con 0x7f69cc0cd330 2023-07-06T22:01:40.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.840+0000 7f69c1ffb640 1 --2- 172.21.15.55:0/20002563 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69b00663a0 0x7f69b0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:40.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.840+0000 7f69c1ffb640 1 -- 172.21.15.55:0/20002563 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f69bc0838e0 con 0x7f69cc0cd330 2023-07-06T22:01:40.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.840+0000 7f69d1510640 1 --2- 172.21.15.55:0/20002563 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69b00663a0 0x7f69b0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:40.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.840+0000 7f69d1510640 1 --2- 172.21.15.55:0/20002563 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69b00663a0 0x7f69b0068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f69c80011f0 tx=0x7f69c8009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:40.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:40.844+0000 7f69c1ffb640 1 -- 172.21.15.55:0/20002563 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69cc1615f0 con 0x7f69cc0cd330 2023-07-06T22:01:41.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.036+0000 7f69d3774640 1 -- 172.21.15.55:0/20002563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f69cc1615f0 con 0x7f69cc0cd330 2023-07-06T22:01:41.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.036+0000 7f69c1ffb640 1 -- 172.21.15.55:0/20002563 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v63) v1 ==== 53+0+73 (secure 0 0 0) 0x7f69cc1615f0 con 0x7f69cc0cd330 2023-07-06T22:01:41.033 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T22:01:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.036+0000 7f69d3774640 1 -- 172.21.15.55:0/20002563 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69b00663a0 msgr2=0x7f69b0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.036+0000 7f69d3774640 1 --2- 172.21.15.55:0/20002563 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69b00663a0 0x7f69b0068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f69c80011f0 tx=0x7f69c8009040 comp rx=0 tx=0).stop 2023-07-06T22:01:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.036+0000 7f69d3774640 1 -- 172.21.15.55:0/20002563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc0cd330 msgr2=0x7f69cc1618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.036+0000 7f69d3774640 1 --2- 172.21.15.55:0/20002563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc0cd330 0x7f69cc1618d0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00c530 tx=0x7f69bc00c9f0 comp rx=0 tx=0).stop 2023-07-06T22:01:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.036+0000 7f69d3774640 1 -- 172.21.15.55:0/20002563 shutdown_connections 2023-07-06T22:01:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.036+0000 7f69d3774640 1 --2- 172.21.15.55:0/20002563 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f69b00663a0 0x7f69b0068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.036+0000 7f69d3774640 1 --2- 172.21.15.55:0/20002563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69cc160030 0x7f69cc0c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.036+0000 7f69d3774640 1 --2- 172.21.15.55:0/20002563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc0cd330 0x7f69cc1618d0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.036+0000 7f69d3774640 1 --2- 172.21.15.55:0/20002563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69cc06a400 0x7f69cc0b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.036+0000 7f69d3774640 1 -- 172.21.15.55:0/20002563 >> 172.21.15.55:0/20002563 conn(0x7f69cc0cded0 msgr2=0x7f69cc070200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.036+0000 7f69d3774640 1 -- 172.21.15.55:0/20002563 shutdown_connections 2023-07-06T22:01:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.036+0000 7f69d3774640 1 -- 172.21.15.55:0/20002563 wait complete. 2023-07-06T22:01:41.054 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T22:01:41.054 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T22:01:41.054 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-07-06T22:01:41.055 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T22:01:41.055 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T22:01:41.055 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T22:01:41.055 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-06T22:01:41.056 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T22:01:41.056 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:01:41.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:41.057 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-07-06T22:01:41.066 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T22:01:41.066 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T22:01:41.067 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T22:01:41.067 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:01:41.067 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T22:01:41.067 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:01:41.067 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:01:41.067 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:01:41.067 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-07-06T22:01:41.067 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:01:41.068 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:01:41.068 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-07-06T22:01:41.068 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T22:01:41.068 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:01:41.068 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-07-06T22:01:41.068 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-06T22:01:41.068 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41256sec preferred_lft 41256sec 2023-07-06T22:01:41.069 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-07-06T22:01:41.069 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:01:41.069 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:01:41.069 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:01:41.069 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-07-06T22:01:41.069 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T22:01:41.069 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:84:fe:b8:21 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:01:41.069 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T22:01:41.070 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:01:41.070 INFO:teuthology.orchestra.run.smithi055.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T22:01:41.070 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-06T22:01:41.070 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T22:01:41.070 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:01:41.070 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-06T22:01:41.070 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:01:41.071 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T22:01:41.071 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T22:01:41.071 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-06T22:01:41.071 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:01:41.071 INFO:teuthology.orchestra.run.smithi055.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T22:01:41.071 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T22:01:41.071 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-06T22:01:41.071 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:01:41.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:41.073 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T22:01:41.134 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-07-06T22:01:41.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:41.137 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-07-06T22:01:41.189 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-07-06T22:01:41.189 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T22:01:41.189 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-06T22:01:41.190 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T22:01:41.190 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-06T22:01:41.190 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T22:01:41.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:41.191 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T22:01:41.191 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T22:01:41.191 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T22:01:41.191 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T22:01:41.192 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T22:01:41.192 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T22:01:41.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:41.285 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T22:01:41.294 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T22:01:41.294 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T22:01:41.295 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:01:41.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:41.296 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-07-06T22:01:41.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T22:01:41.357 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T22:01:41.407 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:01:41.408 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T22:01:41.408 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T22:01:41.455 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-06T22:01:41.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:41.456 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:01:41.546 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:01:41.580 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T22:01:41.581 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:01:41.581 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T22:01:41.581 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-07-06T22:01:41.581 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.cephfs=/ 2023-07-06T22:01:41.582 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-07-06T22:01:41.582 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T22:01:41.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:41.582 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T22:01:41.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:41.604 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T22:01:41.659 INFO:teuthology.orchestra.run.smithi055.stdout:client9372 2023-07-06T22:01:41.660 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:01:41.660 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:41.711 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-06T22:01:41.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.900+0000 7f22ff703640 1 Processor -- start 2023-07-06T22:01:41.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.900+0000 7f22ff703640 1 -- start start 2023-07-06T22:01:41.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.904+0000 7f22ff703640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f8158ab0 0x7f22f806c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:41.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.904+0000 7f22ff703640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f80cc0a0 con 0x7f22f806cf20 2023-07-06T22:01:41.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.904+0000 7f22ff703640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f8158620 con 0x7f22f814ea70 2023-07-06T22:01:41.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.904+0000 7f22ff703640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f806d3a0 con 0x7f22f8158ab0 2023-07-06T22:01:41.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.904+0000 7f22fdca0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f22f806cf20 0x7f22f80c43f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40856/0 (socket says 172.21.15.55:40856) 2023-07-06T22:01:41.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.904+0000 7f22fdca0640 1 -- 172.21.15.55:0/1990982052 learned_addr learned my addr 172.21.15.55:0/1990982052 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:41.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.904+0000 7f22fcc9e640 1 --2- 172.21.15.55:0/1990982052 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f8158ab0 0x7f22f806c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:41.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.904+0000 7f22effff640 1 -- 172.21.15.55:0/1990982052 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888946946 0 0) 0x7f22f80cc0a0 con 0x7f22f806cf20 2023-07-06T22:01:41.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.904+0000 7f22effff640 1 -- 172.21.15.55:0/1990982052 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e4003530 con 0x7f22f806cf20 2023-07-06T22:01:41.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.904+0000 7f22effff640 1 -- 172.21.15.55:0/1990982052 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974455798 0 0) 0x7f22f8158620 con 0x7f22f814ea70 2023-07-06T22:01:41.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.904+0000 7f22fcc9e640 1 -- 172.21.15.55:0/1990982052 >> v1:172.21.15.138:6789/0 conn(0x7f22f814ea70 legacy=0x7f22f80cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:41.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.904+0000 7f22fcc9e640 1 -- 172.21.15.55:0/1990982052 >> v1:172.21.15.55:6789/0 conn(0x7f22f806cf20 legacy=0x7f22f80c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:41.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.904+0000 7f22fcc9e640 1 -- 172.21.15.55:0/1990982052 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f814ee40 con 0x7f22f8158ab0 2023-07-06T22:01:41.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.908+0000 7f22fcc9e640 1 --2- 172.21.15.55:0/1990982052 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f8158ab0 0x7f22f806c9e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f22e8007200 tx=0x7f22e801d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b94586e8a2250596 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:41.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.908+0000 7f22effff640 1 -- 172.21.15.55:0/1990982052 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8008be0 con 0x7f22f8158ab0 2023-07-06T22:01:41.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.908+0000 7f22effff640 1 -- 172.21.15.55:0/1990982052 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e8008d40 con 0x7f22f8158ab0 2023-07-06T22:01:41.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.908+0000 7f22effff640 1 -- 172.21.15.55:0/1990982052 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e800a2f0 con 0x7f22f8158ab0 2023-07-06T22:01:41.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.908+0000 7f22ff703640 1 -- 172.21.15.55:0/1990982052 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f8158ab0 msgr2=0x7f22f806c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:41.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.908+0000 7f22ff703640 1 --2- 172.21.15.55:0/1990982052 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f8158ab0 0x7f22f806c9e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f22e8007200 tx=0x7f22e801d4a0 comp rx=0 tx=0).stop 2023-07-06T22:01:41.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.908+0000 7f22ff703640 1 -- 172.21.15.55:0/1990982052 shutdown_connections 2023-07-06T22:01:41.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.908+0000 7f22ff703640 1 --2- 172.21.15.55:0/1990982052 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f8158ab0 0x7f22f806c9e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:41.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.908+0000 7f22ff703640 1 -- 172.21.15.55:0/1990982052 >> 172.21.15.55:0/1990982052 conn(0x7f22f80afe60 msgr2=0x7f22f80b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.908+0000 7f22ff703640 1 -- 172.21.15.55:0/1990982052 shutdown_connections 2023-07-06T22:01:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.908+0000 7f22ff703640 1 -- 172.21.15.55:0/1990982052 wait complete. 2023-07-06T22:01:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.908+0000 7f22ff703640 1 Processor -- start 2023-07-06T22:01:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.908+0000 7f22ff703640 1 -- start start 2023-07-06T22:01:41.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22ff703640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f806cf20 0x7f22f814a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:41.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22ff703640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22f814ea70 0x7f22f80b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:41.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22ff703640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22f8158ab0 0x7f22f8150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:41.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22ff703640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f81f41a0 con 0x7f22f814ea70 2023-07-06T22:01:41.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22ff703640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80b2550 con 0x7f22f8158ab0 2023-07-06T22:01:41.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22ff703640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80b2830 con 0x7f22f806cf20 2023-07-06T22:01:41.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22fcc9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22f814ea70 0x7f22f80b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:41.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22fcc9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22f814ea70 0x7f22f80b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42708/0 (socket says 172.21.15.55:42708) 2023-07-06T22:01:41.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22fcc9e640 1 -- 172.21.15.55:0/2952312753 learned_addr learned my addr 172.21.15.55:0/2952312753 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:41.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22fd49f640 1 --2- 172.21.15.55:0/2952312753 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f806cf20 0x7f22f814a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:41.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22fdca0640 1 --2- 172.21.15.55:0/2952312753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22f8158ab0 0x7f22f8150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:41.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22fcc9e640 1 -- 172.21.15.55:0/2952312753 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f806cf20 msgr2=0x7f22f814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:41.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22fcc9e640 1 --2- 172.21.15.55:0/2952312753 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f806cf20 0x7f22f814a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:41.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22fcc9e640 1 -- 172.21.15.55:0/2952312753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22f8158ab0 msgr2=0x7f22f8150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22fcc9e640 1 --2- 172.21.15.55:0/2952312753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22f8158ab0 0x7f22f8150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22fcc9e640 1 -- 172.21.15.55:0/2952312753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e800ae50 con 0x7f22f814ea70 2023-07-06T22:01:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22fcc9e640 1 --2- 172.21.15.55:0/2952312753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22f814ea70 0x7f22f80b1b70 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f22e80ac040 tx=0x7f22e801a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22edffb640 1 -- 172.21.15.55:0/2952312753 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e800a0d0 con 0x7f22f814ea70 2023-07-06T22:01:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22edffb640 1 -- 172.21.15.55:0/2952312753 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e80b7070 con 0x7f22f814ea70 2023-07-06T22:01:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22edffb640 1 -- 172.21.15.55:0/2952312753 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e800a470 con 0x7f22f814ea70 2023-07-06T22:01:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22ff703640 1 -- 172.21.15.55:0/2952312753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f80b2b10 con 0x7f22f814ea70 2023-07-06T22:01:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22ff703640 1 -- 172.21.15.55:0/2952312753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f814b950 con 0x7f22f814ea70 2023-07-06T22:01:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.912+0000 7f22ff703640 1 -- 172.21.15.55:0/2952312753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f8066d60 con 0x7f22f814ea70 2023-07-06T22:01:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.916+0000 7f22edffb640 1 -- 172.21.15.55:0/2952312753 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f22e800a5d0 con 0x7f22f814ea70 2023-07-06T22:01:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.916+0000 7f22edffb640 1 --2- 172.21.15.55:0/2952312753 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f22dc0663a0 0x7f22dc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.916+0000 7f22edffb640 1 -- 172.21.15.55:0/2952312753 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f22e811e3f0 con 0x7f22f814ea70 2023-07-06T22:01:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.916+0000 7f22fd49f640 1 --2- 172.21.15.55:0/2952312753 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f22dc0663a0 0x7f22dc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.916+0000 7f22fd49f640 1 --2- 172.21.15.55:0/2952312753 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f22dc0663a0 0x7f22dc068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22f4000f70 tx=0x7f22f4009040 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:41.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:41.920+0000 7f22edffb640 1 -- 172.21.15.55:0/2952312753 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22e80eb6a0 con 0x7f22f814ea70 2023-07-06T22:01:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.096+0000 7f22ff703640 1 -- 172.21.15.55:0/2952312753 --> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f22f80cdee0 con 0x7f22dc0663a0 2023-07-06T22:01:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.096+0000 7f22edffb640 1 -- 172.21.15.55:0/2952312753 <== mgr.8940 v2:172.21.15.55:6832/206120108 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f22f40014a0 con 0x7f22dc0663a0 2023-07-06T22:01:42.095 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T22:01:42.095 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:01:42.095 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-07-06T22:01:42.095 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:01:42.095 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T22:01:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.100+0000 7f22ff703640 1 -- 172.21.15.55:0/2952312753 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f22dc0663a0 msgr2=0x7f22dc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.100+0000 7f22ff703640 1 --2- 172.21.15.55:0/2952312753 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f22dc0663a0 0x7f22dc068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22f4000f70 tx=0x7f22f4009040 comp rx=0 tx=0).stop 2023-07-06T22:01:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.100+0000 7f22ff703640 1 -- 172.21.15.55:0/2952312753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22f814ea70 msgr2=0x7f22f80b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.100+0000 7f22ff703640 1 --2- 172.21.15.55:0/2952312753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22f814ea70 0x7f22f80b1b70 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f22e80ac040 tx=0x7f22e801a240 comp rx=0 tx=0).stop 2023-07-06T22:01:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.100+0000 7f22ff703640 1 -- 172.21.15.55:0/2952312753 shutdown_connections 2023-07-06T22:01:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.100+0000 7f22ff703640 1 --2- 172.21.15.55:0/2952312753 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f22dc0663a0 0x7f22dc068850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:42.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.100+0000 7f22ff703640 1 --2- 172.21.15.55:0/2952312753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22f8158ab0 0x7f22f8150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:42.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.100+0000 7f22ff703640 1 --2- 172.21.15.55:0/2952312753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22f814ea70 0x7f22f80b1b70 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:42.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.100+0000 7f22ff703640 1 --2- 172.21.15.55:0/2952312753 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22f806cf20 0x7f22f814a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:42.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.100+0000 7f22ff703640 1 -- 172.21.15.55:0/2952312753 >> 172.21.15.55:0/2952312753 conn(0x7f22f80afe60 msgr2=0x7f22f80aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:42.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.100+0000 7f22ff703640 1 -- 172.21.15.55:0/2952312753 shutdown_connections 2023-07-06T22:01:42.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.100+0000 7f22ff703640 1 -- 172.21.15.55:0/2952312753 wait complete. 2023-07-06T22:01:42.115 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-06T22:01:42.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.264+0000 7f333b59e640 1 Processor -- start 2023-07-06T22:01:42.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.264+0000 7f333b59e640 1 -- start start 2023-07-06T22:01:42.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.264+0000 7f333b59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f333c0d0630 0x7f333c15fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:42.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.264+0000 7f333b59e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f333c0ce200 0x7f333c0ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:42.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.264+0000 7f333b59e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333c0cc740 con 0x7f333c0b1250 2023-07-06T22:01:42.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.264+0000 7f333b59e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c0ccc90 con 0x7f333c0d0630 2023-07-06T22:01:42.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.264+0000 7f333b59e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c0b29c0 con 0x7f333c0ce200 2023-07-06T22:01:42.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.264+0000 7f3333fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f333c0d0630 0x7f333c15fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:42.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.264+0000 7f3333fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f333c0d0630 0x7f333c15fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42720/0 (socket says 172.21.15.55:42720) 2023-07-06T22:01:42.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.264+0000 7f3333fff640 1 -- 172.21.15.55:0/1082397118 learned_addr learned my addr 172.21.15.55:0/1082397118 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:42.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.264+0000 7f333ad9d640 1 --2- 172.21.15.55:0/1082397118 >> v2:172.21.15.138:3300/0 conn(0x7f333c0ce200 0x7f333c0ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:42.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.268+0000 7f3333fff640 1 -- 172.21.15.55:0/1082397118 >> v2:172.21.15.138:3300/0 conn(0x7f333c0ce200 msgr2=0x7f333c0ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:42.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.268+0000 7f3333fff640 1 --2- 172.21.15.55:0/1082397118 >> v2:172.21.15.138:3300/0 conn(0x7f333c0ce200 0x7f333c0ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:42.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.268+0000 7f3333fff640 1 -- 172.21.15.55:0/1082397118 >> v1:172.21.15.138:6789/0 conn(0x7f333c0b1250 legacy=0x7f333c15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:42.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.268+0000 7f3333fff640 1 -- 172.21.15.55:0/1082397118 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c0d1d10 con 0x7f333c0d0630 2023-07-06T22:01:42.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.268+0000 7f3333fff640 1 --2- 172.21.15.55:0/1082397118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f333c0d0630 0x7f333c15fa90 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f333c0cdc70 tx=0x7f332401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632e1b5d4366da server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:42.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.268+0000 7f3339d9b640 1 -- 172.21.15.55:0/1082397118 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33240ab3f0 con 0x7f333c0d0630 2023-07-06T22:01:42.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.268+0000 7f3339d9b640 1 -- 172.21.15.55:0/1082397118 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33240ab550 con 0x7f333c0d0630 2023-07-06T22:01:42.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.268+0000 7f3339d9b640 1 -- 172.21.15.55:0/1082397118 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33240ab8e0 con 0x7f333c0d0630 2023-07-06T22:01:42.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 -- 172.21.15.55:0/1082397118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f333c0d0630 msgr2=0x7f333c15fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:42.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 --2- 172.21.15.55:0/1082397118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f333c0d0630 0x7f333c15fa90 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f333c0cdc70 tx=0x7f332401c500 comp rx=0 tx=0).stop 2023-07-06T22:01:42.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 -- 172.21.15.55:0/1082397118 shutdown_connections 2023-07-06T22:01:42.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 --2- 172.21.15.55:0/1082397118 >> v2:172.21.15.138:3300/0 conn(0x7f333c0ce200 0x7f333c0ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:42.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 --2- 172.21.15.55:0/1082397118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f333c0d0630 0x7f333c15fa90 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:42.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 -- 172.21.15.55:0/1082397118 >> 172.21.15.55:0/1082397118 conn(0x7f333c0b3b60 msgr2=0x7f333c0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:42.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 -- 172.21.15.55:0/1082397118 shutdown_connections 2023-07-06T22:01:42.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 -- 172.21.15.55:0/1082397118 wait complete. 2023-07-06T22:01:42.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 Processor -- start 2023-07-06T22:01:42.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 -- start start 2023-07-06T22:01:42.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f333c0b1250 0x7f333c0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:42.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f333c0ce200 0x7f333c152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:42.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f333c0d0630 0x7f333c155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:42.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0cc240 con 0x7f333c0b1250 2023-07-06T22:01:42.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c152e80 con 0x7f333c0d0630 2023-07-06T22:01:42.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333b59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c153160 con 0x7f333c0ce200 2023-07-06T22:01:42.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f333c0b1250 0x7f333c0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:42.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f333c0b1250 0x7f333c0cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42730/0 (socket says 172.21.15.55:42730) 2023-07-06T22:01:42.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333a59c640 1 -- 172.21.15.55:0/3389061536 learned_addr learned my addr 172.21.15.55:0/3389061536 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:42.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333ad9d640 1 --2- 172.21.15.55:0/3389061536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f333c0d0630 0x7f333c155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:42.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f3333fff640 1 --2- 172.21.15.55:0/3389061536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f333c0ce200 0x7f333c152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:42.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333a59c640 1 -- 172.21.15.55:0/3389061536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f333c0ce200 msgr2=0x7f333c152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:42.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333a59c640 1 --2- 172.21.15.55:0/3389061536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f333c0ce200 0x7f333c152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:42.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333a59c640 1 -- 172.21.15.55:0/3389061536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f333c0d0630 msgr2=0x7f333c155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:42.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333a59c640 1 --2- 172.21.15.55:0/3389061536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f333c0d0630 0x7f333c155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:42.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.272+0000 7f333a59c640 1 -- 172.21.15.55:0/3389061536 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33240094d0 con 0x7f333c0b1250 2023-07-06T22:01:42.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.276+0000 7f333a59c640 1 --2- 172.21.15.55:0/3389061536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f333c0b1250 0x7f333c0cbd00 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f332c00c3c0 tx=0x7f332c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:42.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.276+0000 7f3332ffd640 1 -- 172.21.15.55:0/3389061536 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c0052d0 con 0x7f333c0b1250 2023-07-06T22:01:42.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.276+0000 7f3332ffd640 1 -- 172.21.15.55:0/3389061536 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c005430 con 0x7f333c0b1250 2023-07-06T22:01:42.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.276+0000 7f3332ffd640 1 -- 172.21.15.55:0/3389061536 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c003840 con 0x7f333c0b1250 2023-07-06T22:01:42.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.276+0000 7f333b59e640 1 -- 172.21.15.55:0/3389061536 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333c153440 con 0x7f333c0b1250 2023-07-06T22:01:42.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.276+0000 7f333b59e640 1 -- 172.21.15.55:0/3389061536 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333c153a00 con 0x7f333c0b1250 2023-07-06T22:01:42.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.276+0000 7f333b59e640 1 -- 172.21.15.55:0/3389061536 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333c04d790 con 0x7f333c0b1250 2023-07-06T22:01:42.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.276+0000 7f3332ffd640 1 -- 172.21.15.55:0/3389061536 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f332c0039a0 con 0x7f333c0b1250 2023-07-06T22:01:42.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.276+0000 7f3332ffd640 1 --2- 172.21.15.55:0/3389061536 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f331c0663d0 0x7f331c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:42.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.276+0000 7f3332ffd640 1 -- 172.21.15.55:0/3389061536 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f332c083560 con 0x7f333c0b1250 2023-07-06T22:01:42.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.276+0000 7f3333fff640 1 --2- 172.21.15.55:0/3389061536 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f331c0663d0 0x7f331c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:42.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.280+0000 7f3333fff640 1 --2- 172.21.15.55:0/3389061536 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f331c0663d0 0x7f331c068880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f33240af000 tx=0x7f33240a7000 comp rx=0 tx=0).ready entity=mgr.8940 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:42.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.280+0000 7f3332ffd640 1 -- 172.21.15.55:0/3389061536 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f332c050700 con 0x7f333c0b1250 2023-07-06T22:01:42.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:42.476+0000 7f333b59e640 1 -- 172.21.15.55:0/3389061536 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f333c0b3240 con 0x7f333c0b1250 2023-07-06T22:01:43.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.264+0000 7f3332ffd640 1 -- 172.21.15.55:0/3389061536 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 70) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f332c050ad0 con 0x7f333c0b1250 2023-07-06T22:01:43.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.268+0000 7f3332ffd640 1 -- 172.21.15.55:0/3389061536 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v70) v1 ==== 92+0+0 (secure 0 0 0) 0x7f332c07b760 con 0x7f333c0b1250 2023-07-06T22:01:43.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.272+0000 7f333b59e640 1 -- 172.21.15.55:0/3389061536 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f331c0663d0 msgr2=0x7f331c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:43.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.272+0000 7f333b59e640 1 --2- 172.21.15.55:0/3389061536 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f331c0663d0 0x7f331c068880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f33240af000 tx=0x7f33240a7000 comp rx=0 tx=0).stop 2023-07-06T22:01:43.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.272+0000 7f333b59e640 1 -- 172.21.15.55:0/3389061536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f333c0b1250 msgr2=0x7f333c0cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:43.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.272+0000 7f333b59e640 1 --2- 172.21.15.55:0/3389061536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f333c0b1250 0x7f333c0cbd00 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f332c00c3c0 tx=0x7f332c00c880 comp rx=0 tx=0).stop 2023-07-06T22:01:43.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.272+0000 7f333b59e640 1 -- 172.21.15.55:0/3389061536 shutdown_connections 2023-07-06T22:01:43.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.272+0000 7f333b59e640 1 --2- 172.21.15.55:0/3389061536 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f331c0663d0 0x7f331c068880 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.272+0000 7f333b59e640 1 --2- 172.21.15.55:0/3389061536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f333c0d0630 0x7f333c155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.272+0000 7f333b59e640 1 --2- 172.21.15.55:0/3389061536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f333c0ce200 0x7f333c152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.272+0000 7f333b59e640 1 --2- 172.21.15.55:0/3389061536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f333c0b1250 0x7f333c0cbd00 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.272+0000 7f333b59e640 1 -- 172.21.15.55:0/3389061536 >> 172.21.15.55:0/3389061536 conn(0x7f333c0b3b60 msgr2=0x7f333c0b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:43.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.272+0000 7f333b59e640 1 -- 172.21.15.55:0/3389061536 shutdown_connections 2023-07-06T22:01:43.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.272+0000 7f333b59e640 1 -- 172.21.15.55:0/3389061536 wait complete. 2023-07-06T22:01:43.293 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-06T22:01:43.431 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:43.435+0000 7f2655284180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:01:43.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.448+0000 7f3580e19640 1 Processor -- start 2023-07-06T22:01:43.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.448+0000 7f3580e19640 1 -- start start 2023-07-06T22:01:43.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.452+0000 7f3580e19640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f357c15b850 0x7f357c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:43.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.452+0000 7f3580e19640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f357c0b3f80 0x7f357c0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:43.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.452+0000 7f3580e19640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c0b2b80 con 0x7f357c0ccd30 2023-07-06T22:01:43.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.452+0000 7f3580e19640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c0cff30 con 0x7f357c15b850 2023-07-06T22:01:43.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.452+0000 7f3580e19640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c0b22e0 con 0x7f357c0b3f80 2023-07-06T22:01:43.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.452+0000 7f357a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f357c15b850 0x7f357c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:43.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.452+0000 7f357a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f357c15b850 0x7f357c0cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51706/0 (socket says 172.21.15.55:51706) 2023-07-06T22:01:43.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.452+0000 7f357a59c640 1 -- 172.21.15.55:0/994979877 learned_addr learned my addr 172.21.15.55:0/994979877 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:43.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.452+0000 7f357ad9d640 1 --2- 172.21.15.55:0/994979877 >> v2:172.21.15.138:3300/0 conn(0x7f357c0b3f80 0x7f357c0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:43.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.452+0000 7f357a59c640 1 -- 172.21.15.55:0/994979877 >> v2:172.21.15.138:3300/0 conn(0x7f357c0b3f80 msgr2=0x7f357c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:43.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.452+0000 7f357a59c640 1 --2- 172.21.15.55:0/994979877 >> v2:172.21.15.138:3300/0 conn(0x7f357c0b3f80 0x7f357c0d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.452+0000 7f357a59c640 1 -- 172.21.15.55:0/994979877 >> v1:172.21.15.138:6789/0 conn(0x7f357c0ccd30 legacy=0x7f357c0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:43.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.452+0000 7f357a59c640 1 -- 172.21.15.55:0/994979877 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c0b25c0 con 0x7f357c15b850 2023-07-06T22:01:43.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.456+0000 7f357a59c640 1 --2- 172.21.15.55:0/994979877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f357c15b850 0x7f357c0cc7f0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f357c0cc780 tx=0x7f356c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7749c3393a3a9dba server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:43.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.456+0000 7f3579d9b640 1 -- 172.21.15.55:0/994979877 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0ab600 con 0x7f357c15b850 2023-07-06T22:01:43.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.456+0000 7f3579d9b640 1 -- 172.21.15.55:0/994979877 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c0a7050 con 0x7f357c15b850 2023-07-06T22:01:43.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.456+0000 7f3579d9b640 1 -- 172.21.15.55:0/994979877 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0ab980 con 0x7f357c15b850 2023-07-06T22:01:43.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.456+0000 7f3580e19640 1 -- 172.21.15.55:0/994979877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f357c15b850 msgr2=0x7f357c0cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:43.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.456+0000 7f3580e19640 1 --2- 172.21.15.55:0/994979877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f357c15b850 0x7f357c0cc7f0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f357c0cc780 tx=0x7f356c01c3b0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.456+0000 7f3580e19640 1 -- 172.21.15.55:0/994979877 shutdown_connections 2023-07-06T22:01:43.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.456+0000 7f3580e19640 1 --2- 172.21.15.55:0/994979877 >> v2:172.21.15.138:3300/0 conn(0x7f357c0b3f80 0x7f357c0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.456+0000 7f3580e19640 1 --2- 172.21.15.55:0/994979877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f357c15b850 0x7f357c0cc7f0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.456+0000 7f3580e19640 1 -- 172.21.15.55:0/994979877 >> 172.21.15.55:0/994979877 conn(0x7f357c0cec20 msgr2=0x7f357c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:43.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.456+0000 7f3580e19640 1 -- 172.21.15.55:0/994979877 shutdown_connections 2023-07-06T22:01:43.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.456+0000 7f3580e19640 1 -- 172.21.15.55:0/994979877 wait complete. 2023-07-06T22:01:43.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.456+0000 7f3580e19640 1 Processor -- start 2023-07-06T22:01:43.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.456+0000 7f3580e19640 1 -- start start 2023-07-06T22:01:43.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3580e19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f357c0b3f80 0x7f357c0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:43.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3580e19640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f357c0ccd30 0x7f357c0c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:43.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3580e19640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f357c15b850 0x7f357c0c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:43.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3580e19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c152890 con 0x7f357c0b3f80 2023-07-06T22:01:43.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3580e19640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c0c5090 con 0x7f357c15b850 2023-07-06T22:01:43.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3580e19640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c159d60 con 0x7f357c0ccd30 2023-07-06T22:01:43.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f357a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f357c0b3f80 0x7f357c0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:43.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f357a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f357c0b3f80 0x7f357c0c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51714/0 (socket says 172.21.15.55:51714) 2023-07-06T22:01:43.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f357a59c640 1 -- 172.21.15.55:0/3058050751 learned_addr learned my addr 172.21.15.55:0/3058050751 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:43.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3573fff640 1 --2- 172.21.15.55:0/3058050751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f357c0ccd30 0x7f357c0c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:43.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f357ad9d640 1 --2- 172.21.15.55:0/3058050751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f357c15b850 0x7f357c0c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:43.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f357a59c640 1 -- 172.21.15.55:0/3058050751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f357c0ccd30 msgr2=0x7f357c0c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:43.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f357a59c640 1 --2- 172.21.15.55:0/3058050751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f357c0ccd30 0x7f357c0c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f357a59c640 1 -- 172.21.15.55:0/3058050751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f357c15b850 msgr2=0x7f357c0c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:43.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f357a59c640 1 --2- 172.21.15.55:0/3058050751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f357c15b850 0x7f357c0c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f357a59c640 1 -- 172.21.15.55:0/3058050751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c0094d0 con 0x7f357c0b3f80 2023-07-06T22:01:43.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3573fff640 1 --2- 172.21.15.55:0/3058050751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f357c0ccd30 0x7f357c0c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:43.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f357a59c640 1 --2- 172.21.15.55:0/3058050751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f357c0b3f80 0x7f357c0c94d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f356c018fc0 tx=0x7f356c019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:43.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3572ffd640 1 -- 172.21.15.55:0/3058050751 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0b4420 con 0x7f357c0b3f80 2023-07-06T22:01:43.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3572ffd640 1 -- 172.21.15.55:0/3058050751 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c0b4580 con 0x7f357c0b3f80 2023-07-06T22:01:43.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3580e19640 1 -- 172.21.15.55:0/3058050751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357c15bda0 con 0x7f357c0b3f80 2023-07-06T22:01:43.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3572ffd640 1 -- 172.21.15.55:0/3058050751 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0b4930 con 0x7f357c0b3f80 2023-07-06T22:01:43.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3580e19640 1 -- 172.21.15.55:0/3058050751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c152e40 con 0x7f357c0b3f80 2023-07-06T22:01:43.461 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:43.460+0000 7ff67413a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:01:43.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3580e19640 1 -- 172.21.15.55:0/3058050751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357c066d60 con 0x7f357c0b3f80 2023-07-06T22:01:43.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.460+0000 7f3572ffd640 1 -- 172.21.15.55:0/3058050751 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 70) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f356c0b2070 con 0x7f357c0b3f80 2023-07-06T22:01:43.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.464+0000 7f3572ffd640 1 --2- 172.21.15.55:0/3058050751 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f355c0663f0 0x7f355c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:43.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.464+0000 7f3573fff640 1 -- 172.21.15.55:0/3058050751 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f355c0663f0 msgr2=0x7f355c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/206120108 2023-07-06T22:01:43.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.464+0000 7f3572ffd640 1 -- 172.21.15.55:0/3058050751 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f356c11dcc0 con 0x7f357c0b3f80 2023-07-06T22:01:43.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.464+0000 7f3573fff640 1 --2- 172.21.15.55:0/3058050751 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f355c0663f0 0x7f355c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:43.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.468+0000 7f3572ffd640 1 -- 172.21.15.55:0/3058050751 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f356c124080 con 0x7f357c0b3f80 2023-07-06T22:01:43.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.624+0000 7f3580e19640 1 -- 172.21.15.55:0/3058050751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f357c0b3420 con 0x7f357c0b3f80 2023-07-06T22:01:43.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.628+0000 7f3572ffd640 1 -- 172.21.15.55:0/3058050751 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v47)=0 v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7f356c0ead20 con 0x7f357c0b3f80 2023-07-06T22:01:43.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.632+0000 7f3580e19640 1 -- 172.21.15.55:0/3058050751 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f355c0663f0 msgr2=0x7f355c0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:43.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.632+0000 7f3580e19640 1 --2- 172.21.15.55:0/3058050751 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f355c0663f0 0x7f355c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.632+0000 7f3580e19640 1 -- 172.21.15.55:0/3058050751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f357c0b3f80 msgr2=0x7f357c0c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:43.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.632+0000 7f3580e19640 1 --2- 172.21.15.55:0/3058050751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f357c0b3f80 0x7f357c0c94d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f356c018fc0 tx=0x7f356c019150 comp rx=0 tx=0).stop 2023-07-06T22:01:43.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.632+0000 7f3580e19640 1 -- 172.21.15.55:0/3058050751 shutdown_connections 2023-07-06T22:01:43.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.632+0000 7f3580e19640 1 --2- 172.21.15.55:0/3058050751 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7f355c0663f0 0x7f355c0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.632+0000 7f3580e19640 1 --2- 172.21.15.55:0/3058050751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f357c15b850 0x7f357c0c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.632+0000 7f3580e19640 1 --2- 172.21.15.55:0/3058050751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f357c0ccd30 0x7f357c0c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.632+0000 7f3580e19640 1 --2- 172.21.15.55:0/3058050751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f357c0b3f80 0x7f357c0c94d0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.632+0000 7f3580e19640 1 -- 172.21.15.55:0/3058050751 >> 172.21.15.55:0/3058050751 conn(0x7f357c0cec20 msgr2=0x7f357c0b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:43.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.632+0000 7f3580e19640 1 -- 172.21.15.55:0/3058050751 shutdown_connections 2023-07-06T22:01:43.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.632+0000 7f3580e19640 1 -- 172.21.15.55:0/3058050751 wait complete. 2023-07-06T22:01:43.649 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-06T22:01:43.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb035dd2640 1 Processor -- start 2023-07-06T22:01:43.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb035dd2640 1 -- start start 2023-07-06T22:01:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb035dd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0300ad0c0 0x7fb0300cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb035dd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0300ccbb0 con 0x7fb03015ba30 2023-07-06T22:01:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb035dd2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0300cce90 con 0x7fb03009d510 2023-07-06T22:01:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb035dd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300c83a0 con 0x7fb0300ad0c0 2023-07-06T22:01:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb02f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb03015ba30 0x7fb03009ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56226/0 (socket says 172.21.15.55:56226) 2023-07-06T22:01:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb02f7fe640 1 -- 172.21.15.55:0/2709227078 learned_addr learned my addr 172.21.15.55:0/2709227078 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb02ffff640 1 --2- 172.21.15.55:0/2709227078 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0300ad0c0 0x7fb0300cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb02e7fc640 1 -- 172.21.15.55:0/2709227078 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932859203 0 0) 0x7fb0300ccbb0 con 0x7fb03015ba30 2023-07-06T22:01:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb02e7fc640 1 -- 172.21.15.55:0/2709227078 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb018003530 con 0x7fb03015ba30 2023-07-06T22:01:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb02e7fc640 1 -- 172.21.15.55:0/2709227078 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133105344 0 0) 0x7fb0300cce90 con 0x7fb03009d510 2023-07-06T22:01:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb02e7fc640 1 -- 172.21.15.55:0/2709227078 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0300ccbb0 con 0x7fb03009d510 2023-07-06T22:01:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb02ffff640 1 -- 172.21.15.55:0/2709227078 >> v1:172.21.15.138:6789/0 conn(0x7fb03009d510 legacy=0x7fb0300c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb02ffff640 1 -- 172.21.15.55:0/2709227078 >> v1:172.21.15.55:6789/0 conn(0x7fb03015ba30 legacy=0x7fb03009ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.800+0000 7fb02ffff640 1 -- 172.21.15.55:0/2709227078 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0300cd170 con 0x7fb0300ad0c0 2023-07-06T22:01:43.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.804+0000 7fb02ffff640 1 --2- 172.21.15.55:0/2709227078 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0300ad0c0 0x7fb0300cd800 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb028009dc0 tx=0x7fb02801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf89c7f65f29c26a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:43.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.804+0000 7fb02e7fc640 1 -- 172.21.15.55:0/2709227078 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0280a5a20 con 0x7fb0300ad0c0 2023-07-06T22:01:43.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.804+0000 7fb02e7fc640 1 -- 172.21.15.55:0/2709227078 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0280a5b80 con 0x7fb0300ad0c0 2023-07-06T22:01:43.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.804+0000 7fb02e7fc640 1 -- 172.21.15.55:0/2709227078 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0280ad440 con 0x7fb0300ad0c0 2023-07-06T22:01:43.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.804+0000 7fb035dd2640 1 -- 172.21.15.55:0/2709227078 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0300ad0c0 msgr2=0x7fb0300cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:43.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.804+0000 7fb035dd2640 1 --2- 172.21.15.55:0/2709227078 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0300ad0c0 0x7fb0300cd800 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb028009dc0 tx=0x7fb02801c940 comp rx=0 tx=0).stop 2023-07-06T22:01:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.804+0000 7fb035dd2640 1 -- 172.21.15.55:0/2709227078 shutdown_connections 2023-07-06T22:01:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.804+0000 7fb035dd2640 1 --2- 172.21.15.55:0/2709227078 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0300ad0c0 0x7fb0300cd800 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.804+0000 7fb035dd2640 1 -- 172.21.15.55:0/2709227078 >> 172.21.15.55:0/2709227078 conn(0x7fb0300cea70 msgr2=0x7fb0300ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.804+0000 7fb035dd2640 1 -- 172.21.15.55:0/2709227078 shutdown_connections 2023-07-06T22:01:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.804+0000 7fb035dd2640 1 -- 172.21.15.55:0/2709227078 wait complete. 2023-07-06T22:01:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb035dd2640 1 Processor -- start 2023-07-06T22:01:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb035dd2640 1 -- start start 2023-07-06T22:01:43.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb035dd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03009d510 0x7fb03015ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:43.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb035dd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0300ad0c0 0x7fb0300c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:43.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb035dd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb03015ba30 0x7fb0300c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:43.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb035dd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03015b320 con 0x7fb03009d510 2023-07-06T22:01:43.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb035dd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300c7b30 con 0x7fb03015ba30 2023-07-06T22:01:43.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb035dd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300c4f40 con 0x7fb0300ad0c0 2023-07-06T22:01:43.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb02f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03009d510 0x7fb03015ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:43.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb02f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03009d510 0x7fb03015ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51722/0 (socket says 172.21.15.55:51722) 2023-07-06T22:01:43.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb02f7fe640 1 -- 172.21.15.55:0/272420848 learned_addr learned my addr 172.21.15.55:0/272420848 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:43.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb02effd640 1 --2- 172.21.15.55:0/272420848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0300ad0c0 0x7fb0300c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:43.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb02ffff640 1 --2- 172.21.15.55:0/272420848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb03015ba30 0x7fb0300c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:43.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb02f7fe640 1 -- 172.21.15.55:0/272420848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0300ad0c0 msgr2=0x7fb0300c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:43.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb02f7fe640 1 --2- 172.21.15.55:0/272420848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0300ad0c0 0x7fb0300c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb02f7fe640 1 -- 172.21.15.55:0/272420848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb03015ba30 msgr2=0x7fb0300c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:43.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb02f7fe640 1 --2- 172.21.15.55:0/272420848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb03015ba30 0x7fb0300c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb02f7fe640 1 -- 172.21.15.55:0/272420848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb028009a70 con 0x7fb03009d510 2023-07-06T22:01:43.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb02effd640 1 --2- 172.21.15.55:0/272420848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0300ad0c0 0x7fb0300c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:43.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb02f7fe640 1 --2- 172.21.15.55:0/272420848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03009d510 0x7fb03015ade0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c420 tx=0x7fb02000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:43.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb017fff640 1 -- 172.21.15.55:0/272420848 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020005cf0 con 0x7fb03009d510 2023-07-06T22:01:43.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb017fff640 1 -- 172.21.15.55:0/272420848 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb020005e50 con 0x7fb03009d510 2023-07-06T22:01:43.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb017fff640 1 -- 172.21.15.55:0/272420848 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200072d0 con 0x7fb03009d510 2023-07-06T22:01:43.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb035dd2640 1 -- 172.21.15.55:0/272420848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0300c5220 con 0x7fb03009d510 2023-07-06T22:01:43.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.808+0000 7fb035dd2640 1 -- 172.21.15.55:0/272420848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0300c57e0 con 0x7fb03009d510 2023-07-06T22:01:43.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.812+0000 7fb035dd2640 1 -- 172.21.15.55:0/272420848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb030066d60 con 0x7fb03009d510 2023-07-06T22:01:43.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.812+0000 7fb017fff640 1 -- 172.21.15.55:0/272420848 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 70) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fb020007430 con 0x7fb03009d510 2023-07-06T22:01:43.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.812+0000 7fb017fff640 1 --2- 172.21.15.55:0/272420848 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb01c0663f0 0x7fb01c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:43.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.812+0000 7fb02effd640 1 -- 172.21.15.55:0/272420848 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb01c0663f0 msgr2=0x7fb01c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/206120108 2023-07-06T22:01:43.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.812+0000 7fb017fff640 1 -- 172.21.15.55:0/272420848 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb0200836b0 con 0x7fb03009d510 2023-07-06T22:01:43.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.812+0000 7fb02effd640 1 --2- 172.21.15.55:0/272420848 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb01c0663f0 0x7fb01c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:43.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.816+0000 7fb017fff640 1 -- 172.21.15.55:0/272420848 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb020050840 con 0x7fb03009d510 2023-07-06T22:01:43.846 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:43.847+0000 7f2655284180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:01:43.908 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:43.908+0000 7ff67413a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:01:43.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.976+0000 7fb035dd2640 1 -- 172.21.15.55:0/272420848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fb0300cb6c0 con 0x7fb03009d510 2023-07-06T22:01:43.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.980+0000 7fb017fff640 1 -- 172.21.15.55:0/272420848 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v48)=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb0200170c0 con 0x7fb03009d510 2023-07-06T22:01:43.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.984+0000 7fb035dd2640 1 -- 172.21.15.55:0/272420848 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb01c0663f0 msgr2=0x7fb01c0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:43.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.984+0000 7fb035dd2640 1 --2- 172.21.15.55:0/272420848 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb01c0663f0 0x7fb01c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.984+0000 7fb035dd2640 1 -- 172.21.15.55:0/272420848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03009d510 msgr2=0x7fb03015ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:43.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.984+0000 7fb035dd2640 1 --2- 172.21.15.55:0/272420848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03009d510 0x7fb03015ade0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c420 tx=0x7fb02000c8e0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.984+0000 7fb035dd2640 1 -- 172.21.15.55:0/272420848 shutdown_connections 2023-07-06T22:01:43.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.984+0000 7fb035dd2640 1 --2- 172.21.15.55:0/272420848 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7fb01c0663f0 0x7fb01c0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.984+0000 7fb035dd2640 1 --2- 172.21.15.55:0/272420848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb03015ba30 0x7fb0300c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.984+0000 7fb035dd2640 1 --2- 172.21.15.55:0/272420848 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0300ad0c0 0x7fb0300c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.984+0000 7fb035dd2640 1 --2- 172.21.15.55:0/272420848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb03009d510 0x7fb03015ade0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:43.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.984+0000 7fb035dd2640 1 -- 172.21.15.55:0/272420848 >> 172.21.15.55:0/272420848 conn(0x7fb0300cea70 msgr2=0x7fb0300adcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:43.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.984+0000 7fb035dd2640 1 -- 172.21.15.55:0/272420848 shutdown_connections 2023-07-06T22:01:43.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:43.984+0000 7fb035dd2640 1 -- 172.21.15.55:0/272420848 wait complete. 2023-07-06T22:01:43.997 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:43.999+0000 7f2655284180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:01:44.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:44.002 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-06T22:01:44.017 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-07-06T22:01:44.071 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:44.072+0000 7ff67413a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:01:44.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb33d2640 1 Processor -- start 2023-07-06T22:01:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb33d2640 1 -- start start 2023-07-06T22:01:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb33d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcac0b3c90 0x7efcac0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb33d2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efcac0d1d30 0x7efcac0cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb33d2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcac0ccd50 con 0x7efcac0b18a0 2023-07-06T22:01:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb33d2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcac0cd0a0 con 0x7efcac0d1d30 2023-07-06T22:01:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb33d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcac069ea0 con 0x7efcac0b3c90 2023-07-06T22:01:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb116e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcac0b3c90 0x7efcac0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb196f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efcac0d1d30 0x7efcac0cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb196f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efcac0d1d30 0x7efcac0cfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:45280/0 (socket says 172.21.15.55:45280) 2023-07-06T22:01:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb196f640 1 -- 172.21.15.55:0/3520932372 learned_addr learned my addr 172.21.15.55:0/3520932372 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb116e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcac0b3c90 0x7efcac0ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:41758/0 (socket says 172.21.15.55:41758) 2023-07-06T22:01:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb196f640 1 -- 172.21.15.55:0/3520932372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcac0b3c90 msgr2=0x7efcac0ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb196f640 1 --2- 172.21.15.55:0/3520932372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcac0b3c90 0x7efcac0ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb196f640 1 -- 172.21.15.55:0/3520932372 >> v1:172.21.15.138:6789/0 conn(0x7efcac0b18a0 legacy=0x7efcac0b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efca3fff640 1 -- 172.21.15.55:0/3520932372 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964623281 0 0) 0x7efcac0ccd50 con 0x7efcac0b18a0 2023-07-06T22:01:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb196f640 1 -- 172.21.15.55:0/3520932372 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac06a140 con 0x7efcac0d1d30 2023-07-06T22:01:44.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.212+0000 7efcb116e640 1 --2- 172.21.15.55:0/3520932372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcac0b3c90 0x7efcac0ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:44.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.216+0000 7efcb196f640 1 --2- 172.21.15.55:0/3520932372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcac0d1d30 0x7efcac0cfee0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efca4009e50 tx=0x7efca401c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b67668c755e39ef server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.216+0000 7efca3fff640 1 -- 172.21.15.55:0/3520932372 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca40a58d0 con 0x7efcac0d1d30 2023-07-06T22:01:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.216+0000 7efca3fff640 1 -- 172.21.15.55:0/3520932372 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca40a5a30 con 0x7efcac0d1d30 2023-07-06T22:01:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.216+0000 7efca3fff640 1 -- 172.21.15.55:0/3520932372 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca40a5dc0 con 0x7efcac0d1d30 2023-07-06T22:01:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.216+0000 7efcb33d2640 1 -- 172.21.15.55:0/3520932372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcac0d1d30 msgr2=0x7efcac0cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.216+0000 7efcb33d2640 1 --2- 172.21.15.55:0/3520932372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcac0d1d30 0x7efcac0cfee0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efca4009e50 tx=0x7efca401c9e0 comp rx=0 tx=0).stop 2023-07-06T22:01:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.216+0000 7efcb33d2640 1 -- 172.21.15.55:0/3520932372 shutdown_connections 2023-07-06T22:01:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.216+0000 7efcb33d2640 1 --2- 172.21.15.55:0/3520932372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcac0d1d30 0x7efcac0cfee0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.216+0000 7efcb33d2640 1 --2- 172.21.15.55:0/3520932372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcac0b3c90 0x7efcac0ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.216+0000 7efcb33d2640 1 -- 172.21.15.55:0/3520932372 >> 172.21.15.55:0/3520932372 conn(0x7efcac06bf40 msgr2=0x7efcac0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.216+0000 7efcb33d2640 1 -- 172.21.15.55:0/3520932372 shutdown_connections 2023-07-06T22:01:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.216+0000 7efcb33d2640 1 -- 172.21.15.55:0/3520932372 wait complete. 2023-07-06T22:01:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb33d2640 1 Processor -- start 2023-07-06T22:01:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb33d2640 1 -- start start 2023-07-06T22:01:44.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb33d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcac0b18a0 0x7efcac158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:44.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb33d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcac0b3c90 0x7efcac0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:44.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb33d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcac0d1d30 0x7efcac156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:44.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb33d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcac158580 con 0x7efcac0d1d30 2023-07-06T22:01:44.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb33d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcac0ca460 con 0x7efcac0b18a0 2023-07-06T22:01:44.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb33d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcac1577a0 con 0x7efcac0b3c90 2023-07-06T22:01:44.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb116e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcac0b18a0 0x7efcac158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:44.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb196f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcac0d1d30 0x7efcac156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:44.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb096d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcac0b3c90 0x7efcac0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:44.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb116e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcac0b18a0 0x7efcac158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:45294/0 (socket says 172.21.15.55:45294) 2023-07-06T22:01:44.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb196f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcac0d1d30 0x7efcac156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51730/0 (socket says 172.21.15.55:51730) 2023-07-06T22:01:44.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb116e640 1 -- 172.21.15.55:0/2373327256 learned_addr learned my addr 172.21.15.55:0/2373327256 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:44.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb116e640 1 -- 172.21.15.55:0/2373327256 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcac0b3c90 msgr2=0x7efcac0cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:44.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb116e640 1 --2- 172.21.15.55:0/2373327256 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcac0b3c90 0x7efcac0cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:44.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb116e640 1 -- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcac0d1d30 msgr2=0x7efcac156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:44.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb116e640 1 --2- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcac0d1d30 0x7efcac156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:44.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb116e640 1 -- 172.21.15.55:0/2373327256 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca8009420 con 0x7efcac0b18a0 2023-07-06T22:01:44.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb116e640 1 --2- 172.21.15.55:0/2373327256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcac0b18a0 0x7efcac158040 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efca800ebe0 tx=0x7efca800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:44.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efca1ffb640 1 -- 172.21.15.55:0/2373327256 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca800eee0 con 0x7efcac0b18a0 2023-07-06T22:01:44.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efca1ffb640 1 -- 172.21.15.55:0/2373327256 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca800cc30 con 0x7efcac0b18a0 2023-07-06T22:01:44.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb33d2640 1 -- 172.21.15.55:0/2373327256 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca4009b30 con 0x7efcac0b18a0 2023-07-06T22:01:44.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efca1ffb640 1 -- 172.21.15.55:0/2373327256 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca8013470 con 0x7efcac0b18a0 2023-07-06T22:01:44.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.220+0000 7efcb33d2640 1 -- 172.21.15.55:0/2373327256 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcac157d60 con 0x7efcac0b18a0 2023-07-06T22:01:44.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.224+0000 7efcb33d2640 1 -- 172.21.15.55:0/2373327256 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcac066d60 con 0x7efcac0b18a0 2023-07-06T22:01:44.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.224+0000 7efca1ffb640 1 -- 172.21.15.55:0/2373327256 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 70) v1 ==== 85777+0+0 (secure 0 0 0) 0x7efca80135d0 con 0x7efcac0b18a0 2023-07-06T22:01:44.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.224+0000 7efca1ffb640 1 --2- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7efc900663f0 0x7efc900688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:44.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.224+0000 7efcb096d640 1 -- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7efc900663f0 msgr2=0x7efc900688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/206120108 2023-07-06T22:01:44.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.224+0000 7efca1ffb640 1 -- 172.21.15.55:0/2373327256 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6410+0+0 (secure 0 0 0) 0x7efca80842c0 con 0x7efcac0b18a0 2023-07-06T22:01:44.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.224+0000 7efcb096d640 1 --2- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7efc900663f0 0x7efc900688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:44.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.228+0000 7efca1ffb640 1 -- 172.21.15.55:0/2373327256 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efca8051570 con 0x7efcac0b18a0 2023-07-06T22:01:44.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.400+0000 7efcb33d2640 1 -- 172.21.15.55:0/2373327256 --> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7efcac0ca5a0 con 0x7efc900663f0 2023-07-06T22:01:44.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.428+0000 7efcb096d640 1 -- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7efc900663f0 msgr2=0x7efc900688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/206120108 2023-07-06T22:01:44.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.428+0000 7efcb096d640 1 --2- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7efc900663f0 0x7efc900688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-06T22:01:44.477 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:44.479+0000 7f2655284180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:01:44.535 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:44.539+0000 7f2655284180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:01:44.584 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:44.588+0000 7ff67413a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:01:44.590 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:44.591+0000 7f2655284180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:01:44.645 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:44.648+0000 7ff67413a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:01:44.675 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:44.679+0000 7f2655284180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:01:44.704 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:44.708+0000 7ff67413a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:01:44.731 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:44.731+0000 7f2655284180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:01:44.796 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:44.800+0000 7ff67413a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:01:44.817 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:44.819+0000 7f2655284180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:01:44.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.832+0000 7efcb096d640 1 -- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7efc900663f0 msgr2=0x7efc900688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/206120108 2023-07-06T22:01:44.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:44.832+0000 7efcb096d640 1 --2- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7efc900663f0 0x7efc900688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-06T22:01:44.856 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:44.856+0000 7ff67413a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:01:44.874 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:44.875+0000 7f2655284180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:01:44.944 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:44.948+0000 7ff67413a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:01:45.003 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:45.004+0000 7ff67413a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:01:45.015 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:45.019+0000 7f2655284180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:01:45.072 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:45.075+0000 7f2655284180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:01:45.153 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:45.156+0000 7ff67413a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:01:45.214 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:45.216+0000 7ff67413a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:01:45.312 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:01:45.312 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:01:45.312 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:01:45.320 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:45.323+0000 7f2655284180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:01:45.452 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:45.455+0000 7f2655284180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:01:45.464 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:01:45.464 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:01:45.464 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:01:45.472 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:45.476+0000 7ff67413a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:01:45.576 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:45.579+0000 7f2655284180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:01:45.614 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:45.616+0000 7ff67413a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:01:45.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:45.636+0000 7efcb096d640 1 -- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7efc900663f0 msgr2=0x7efc900688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/206120108 2023-07-06T22:01:45.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:45.636+0000 7efcb096d640 1 --2- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7efc900663f0 0x7efc900688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-06T22:01:45.646 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:45.647+0000 7f2655284180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:01:45.746 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:45.748+0000 7ff67413a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:01:45.780 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:45.783+0000 7f2655284180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:01:45.821 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:45.824+0000 7ff67413a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:01:45.962 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:45.964+0000 7ff67413a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:01:46.321 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:46.323+0000 7f2655284180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:01:46.406 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:46.407+0000 7f2655284180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:01:46.529 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:46.532+0000 7ff67413a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:01:46.552 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:46.555+0000 7f2655284180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:01:46.617 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:46.620+0000 7ff67413a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:01:46.634 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:46.635+0000 7f2655284180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:01:46.771 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:46.772+0000 7ff67413a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:01:46.859 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:46.860+0000 7ff67413a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:01:46.904 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:46.907+0000 7f2655284180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:01:46.963 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:46.967+0000 7f2655284180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:01:47.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:47.028+0000 7efca1ffb640 1 -- 172.21.15.55:0/2373327256 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mgrmap(e 71) v1 ==== 85777+0+0 (secure 0 0 0) 0x7efca8051940 con 0x7efcac0b18a0 2023-07-06T22:01:47.147 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:47.148+0000 7ff67413a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:01:47.210 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:47.212+0000 7ff67413a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:01:47.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:47.228+0000 7efca1ffb640 1 -- 172.21.15.55:0/2373327256 <== mon.1 v2:172.21.15.138:3300/0 8 ==== mgrmap(e 72) v1 ==== 85386+0+0 (secure 0 0 0) 0x7efca8021210 con 0x7efcac0b18a0 2023-07-06T22:01:47.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:47.228+0000 7efca1ffb640 1 -- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7efc900663f0 msgr2=0x7efc900688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:47.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:47.228+0000 7efca1ffb640 1 --2- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/206120108,v1:172.21.15.55:6833/206120108] conn(0x7efc900663f0 0x7efc900688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:47.345 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:47.348+0000 7ff5f319b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:47.345 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:47.348+0000 7ff5f319b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:47.345 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:47.348+0000 7ff5f319b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:47.346 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:47.348+0000 7ff5f319b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:47.346 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:47.348+0000 7ff5f319b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:47.346 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:47.348+0000 7ff5f61a1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:47.346 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:47.348+0000 7ff5f61a1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:47.346 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:47.348+0000 7ff5f61a1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:47.346 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:47.348+0000 7ff5f61a1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:47.346 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:47.348+0000 7ff5f61a1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:48.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.232+0000 7efca1ffb640 1 -- 172.21.15.55:0/2373327256 <== mon.1 v2:172.21.15.138:3300/0 9 ==== mgrmap(e 73) v1 ==== 85513+0+0 (secure 0 0 0) 0x7efca8052210 con 0x7efcac0b18a0 2023-07-06T22:01:48.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.232+0000 7efca1ffb640 1 --2- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7efc9006eea0 0x7efc90071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:48.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.232+0000 7efca1ffb640 1 -- 172.21.15.55:0/2373327256 --> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7efcac0ca5a0 con 0x7efc9006eea0 2023-07-06T22:01:48.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.236+0000 7efcb096d640 1 --2- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7efc9006eea0 0x7efc90071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:48.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.236+0000 7efcb096d640 1 --2- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7efc9006eea0 0x7efc90071280 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efcac0b5e20 tx=0x7efc9c007d40 comp rx=0 tx=0).ready entity=mgr.9396 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:48.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.304+0000 7efca1ffb640 1 -- 172.21.15.55:0/2373327256 <== mgr.9396 v2:172.21.15.55:6832/462110382 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efcac0ca5a0 con 0x7efc9006eea0 2023-07-06T22:01:48.301 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path snap_test_dir1 2023-07-06T22:01:48.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.304+0000 7efcb33d2640 1 -- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7efc9006eea0 msgr2=0x7efc90071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:48.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.304+0000 7efcb33d2640 1 --2- 172.21.15.55:0/2373327256 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7efc9006eea0 0x7efc90071280 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efcac0b5e20 tx=0x7efc9c007d40 comp rx=0 tx=0).stop 2023-07-06T22:01:48.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.304+0000 7efcb33d2640 1 -- 172.21.15.55:0/2373327256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcac0b18a0 msgr2=0x7efcac158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:48.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.304+0000 7efcb33d2640 1 --2- 172.21.15.55:0/2373327256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcac0b18a0 0x7efcac158040 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efca800ebe0 tx=0x7efca800c520 comp rx=0 tx=0).stop 2023-07-06T22:01:48.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.304+0000 7efcb196f640 1 -- 172.21.15.55:0/2373327256 reap_dead start 2023-07-06T22:01:48.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.304+0000 7efcb33d2640 1 -- 172.21.15.55:0/2373327256 shutdown_connections 2023-07-06T22:01:48.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.304+0000 7efcb33d2640 1 -- 172.21.15.55:0/2373327256 >> 172.21.15.55:0/2373327256 conn(0x7efcac06bf40 msgr2=0x7efcac0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:48.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.304+0000 7efcb33d2640 1 -- 172.21.15.55:0/2373327256 shutdown_connections 2023-07-06T22:01:48.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.304+0000 7efcb33d2640 1 -- 172.21.15.55:0/2373327256 wait complete. 2023-07-06T22:01:48.325 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-06T22:01:48.325 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-06T22:01:48.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b421fa640 1 Processor -- start 2023-07-06T22:01:48.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b421fa640 1 -- start start 2023-07-06T22:01:48.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b421fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b3c158780 0x7f3b3c0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:48.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b421fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3c158b50 con 0x7f3b3c0c89b0 2023-07-06T22:01:48.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b421fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3c06fb00 con 0x7f3b3c0cbfa0 2023-07-06T22:01:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b421fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c06b390 con 0x7f3b3c158780 2023-07-06T22:01:48.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3b3c0c89b0 0x7f3b3c06c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56230/0 (socket says 172.21.15.55:56230) 2023-07-06T22:01:48.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3bfff640 1 -- 172.21.15.55:0/2182595561 learned_addr learned my addr 172.21.15.55:0/2182595561 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:48.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3b7fe640 1 --2- 172.21.15.55:0/2182595561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b3c158780 0x7f3b3c0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:48.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 -- 172.21.15.55:0/2182595561 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034064820 0 0) 0x7f3b3c158b50 con 0x7f3b3c0c89b0 2023-07-06T22:01:48.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 -- 172.21.15.55:0/2182595561 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b24003530 con 0x7f3b3c0c89b0 2023-07-06T22:01:48.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 -- 172.21.15.55:0/2182595561 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1822856790 0 0) 0x7f3b24003530 con 0x7f3b3c0c89b0 2023-07-06T22:01:48.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 -- 172.21.15.55:0/2182595561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b3c158780 msgr2=0x7f3b3c0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:48.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 --2- 172.21.15.55:0/2182595561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b3c158780 0x7f3b3c0cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:48.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 -- 172.21.15.55:0/2182595561 >> v1:172.21.15.138:6789/0 conn(0x7f3b3c0cbfa0 legacy=0x7f3b3c06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:48.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 -- 172.21.15.55:0/2182595561 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c0cd3d0 con 0x7f3b3c0c89b0 2023-07-06T22:01:48.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 -- 172.21.15.55:0/2182595561 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f3b34001a00 con 0x7f3b3c0c89b0 2023-07-06T22:01:48.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 -- 172.21.15.55:0/2182595561 >> v1:172.21.15.55:6789/0 conn(0x7f3b3c0c89b0 legacy=0x7f3b3c06c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:48.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 --2- 172.21.15.55:0/2182595561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b240039b0 0x7f3b24003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:48.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 --2- 172.21.15.55:0/2182595561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b3c158780 0x7f3b240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:48.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 --2- 172.21.15.55:0/2182595561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b24004d10 0x7f3b24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:48.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 -- 172.21.15.55:0/2182595561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c06b390 con 0x7f3b240039b0 2023-07-06T22:01:48.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 -- 172.21.15.55:0/2182595561 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2400baa0 con 0x7f3b24004d10 2023-07-06T22:01:48.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3a7fc640 1 -- 172.21.15.55:0/2182595561 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2400de70 con 0x7f3b3c158780 2023-07-06T22:01:48.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3b7fe640 1 --2- 172.21.15.55:0/2182595561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b240039b0 0x7f3b24003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:48.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3affd640 1 --2- 172.21.15.55:0/2182595561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b3c158780 0x7f3b240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:48.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.520+0000 7f3b3bfff640 1 --2- 172.21.15.55:0/2182595561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b24004d10 0x7f3b24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:48.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b3b7fe640 1 -- 172.21.15.55:0/2182595561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b3c158780 msgr2=0x7f3b240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:48.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b3b7fe640 1 --2- 172.21.15.55:0/2182595561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b3c158780 0x7f3b240047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:48.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b3b7fe640 1 -- 172.21.15.55:0/2182595561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b24004d10 msgr2=0x7f3b24005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:48.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b3b7fe640 1 --2- 172.21.15.55:0/2182595561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b24004d10 0x7f3b24005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:48.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b3b7fe640 1 -- 172.21.15.55:0/2182595561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b24003530 con 0x7f3b240039b0 2023-07-06T22:01:48.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b3bfff640 1 --2- 172.21.15.55:0/2182595561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b24004d10 0x7f3b24005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:48.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b3affd640 1 --2- 172.21.15.55:0/2182595561 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b3c158780 0x7f3b240047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:48.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b3b7fe640 1 --2- 172.21.15.55:0/2182595561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b240039b0 0x7f3b24003dc0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009ae0 tx=0x7f3b2c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5bbab91713020b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:48.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b3a7fc640 1 -- 172.21.15.55:0/2182595561 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c0a9430 con 0x7f3b240039b0 2023-07-06T22:01:48.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b3a7fc640 1 -- 172.21.15.55:0/2182595561 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c0a9590 con 0x7f3b240039b0 2023-07-06T22:01:48.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b3a7fc640 1 -- 172.21.15.55:0/2182595561 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c0a9940 con 0x7f3b240039b0 2023-07-06T22:01:48.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b421fa640 1 -- 172.21.15.55:0/2182595561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b240039b0 msgr2=0x7f3b24003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:48.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b421fa640 1 --2- 172.21.15.55:0/2182595561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b240039b0 0x7f3b24003dc0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009ae0 tx=0x7f3b2c01ca50 comp rx=0 tx=0).stop 2023-07-06T22:01:48.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b3bfff640 1 -- 172.21.15.55:0/2182595561 reap_dead start 2023-07-06T22:01:48.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b421fa640 1 -- 172.21.15.55:0/2182595561 shutdown_connections 2023-07-06T22:01:48.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b421fa640 1 -- 172.21.15.55:0/2182595561 >> 172.21.15.55:0/2182595561 conn(0x7f3b3c0cde30 msgr2=0x7f3b3c0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:48.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.524+0000 7f3b421fa640 1 -- 172.21.15.55:0/2182595561 shutdown_connections 2023-07-06T22:01:48.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b421fa640 1 -- 172.21.15.55:0/2182595561 wait complete. 2023-07-06T22:01:48.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b421fa640 1 Processor -- start 2023-07-06T22:01:48.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b421fa640 1 -- start start 2023-07-06T22:01:48.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b421fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b240039b0 0x7f3b3c0c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:48.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b421fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b3c163cd0 0x7f3b3c0c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:48.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b421fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b3c155090 0x7f3b3c152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:48.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b421fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0c3c20 con 0x7f3b3c155090 2023-07-06T22:01:48.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b421fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0c3330 con 0x7f3b3c163cd0 2023-07-06T22:01:48.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b421fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c164140 con 0x7f3b240039b0 2023-07-06T22:01:48.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b3bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b3c155090 0x7f3b3c152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:48.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b3b7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b240039b0 0x7f3b3c0c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:48.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b3b7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b240039b0 0x7f3b3c0c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:41898/0 (socket says 172.21.15.55:41898) 2023-07-06T22:01:48.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b3b7fe640 1 -- 172.21.15.55:0/3634966137 learned_addr learned my addr 172.21.15.55:0/3634966137 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:48.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b3bfff640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b3c155090 0x7f3b3c152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51912/0 (socket says 172.21.15.55:51912) 2023-07-06T22:01:48.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b3affd640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b3c163cd0 0x7f3b3c0c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:48.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b3bfff640 1 -- 172.21.15.55:0/3634966137 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b240039b0 msgr2=0x7f3b3c0c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:48.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b3bfff640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b240039b0 0x7f3b3c0c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:48.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b3bfff640 1 -- 172.21.15.55:0/3634966137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b3c163cd0 msgr2=0x7f3b3c0c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:48.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b3bfff640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b3c163cd0 0x7f3b3c0c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:48.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b3bfff640 1 -- 172.21.15.55:0/3634966137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c1534d0 con 0x7f3b3c155090 2023-07-06T22:01:48.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b3b7fe640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b240039b0 0x7f3b3c0c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:48.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.528+0000 7f3b3bfff640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b3c155090 0x7f3b3c152580 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0cb8e0 tx=0x7f3b34007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.532+0000 7f3b23fff640 1 -- 172.21.15.55:0/3634966137 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b34010450 con 0x7f3b3c155090 2023-07-06T22:01:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.532+0000 7f3b23fff640 1 -- 172.21.15.55:0/3634966137 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b340105d0 con 0x7f3b3c155090 2023-07-06T22:01:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.532+0000 7f3b421fa640 1 -- 172.21.15.55:0/3634966137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3c0c4580 con 0x7f3b3c155090 2023-07-06T22:01:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.532+0000 7f3b23fff640 1 -- 172.21.15.55:0/3634966137 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b34010980 con 0x7f3b3c155090 2023-07-06T22:01:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.532+0000 7f3b421fa640 1 -- 172.21.15.55:0/3634966137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3c0c3560 con 0x7f3b3c155090 2023-07-06T22:01:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.532+0000 7f3b421fa640 1 -- 172.21.15.55:0/3634966137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3c0c3d60 con 0x7f3b3c155090 2023-07-06T22:01:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.532+0000 7f3b23fff640 1 -- 172.21.15.55:0/3634966137 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 73) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f3b34010ae0 con 0x7f3b3c155090 2023-07-06T22:01:48.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.532+0000 7f3b23fff640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f3b28066150 0x7f3b28068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:48.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.532+0000 7f3b23fff640 1 -- 172.21.15.55:0/3634966137 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f3b340832c0 con 0x7f3b3c155090 2023-07-06T22:01:48.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.532+0000 7f3b3b7fe640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f3b28066150 0x7f3b28068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:48.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.532+0000 7f3b3b7fe640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f3b28066150 0x7f3b28068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c01ca90 tx=0x7f3b2c0b3040 comp rx=0 tx=0).ready entity=mgr.9396 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:48.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.536+0000 7f3b23fff640 1 -- 172.21.15.55:0/3634966137 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b3c0c3d60 con 0x7f3b3c155090 2023-07-06T22:01:48.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:48.712+0000 7f3b421fa640 1 -- 172.21.15.55:0/3634966137 --> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b3c06bbf0 con 0x7f3b28066150 2023-07-06T22:01:48.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.000+0000 7f3b23fff640 1 -- 172.21.15.55:0/3634966137 <== mgr.9396 v2:172.21.15.55:6832/462110382 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3b2c0b7040 con 0x7f3b28066150 2023-07-06T22:01:49.000 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path snap_test_dir1 2023-07-06T22:01:49.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.004+0000 7f3b421fa640 1 -- 172.21.15.55:0/3634966137 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f3b28066150 msgr2=0x7f3b28068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:49.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.004+0000 7f3b421fa640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f3b28066150 0x7f3b28068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c01ca90 tx=0x7f3b2c0b3040 comp rx=0 tx=0).stop 2023-07-06T22:01:49.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.004+0000 7f3b421fa640 1 -- 172.21.15.55:0/3634966137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b3c155090 msgr2=0x7f3b3c152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:49.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.004+0000 7f3b421fa640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b3c155090 0x7f3b3c152580 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0cb8e0 tx=0x7f3b34007a20 comp rx=0 tx=0).stop 2023-07-06T22:01:49.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.004+0000 7f3b421fa640 1 -- 172.21.15.55:0/3634966137 shutdown_connections 2023-07-06T22:01:49.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.004+0000 7f3b421fa640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f3b28066150 0x7f3b28068600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:49.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.004+0000 7f3b421fa640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b3c155090 0x7f3b3c152580 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:49.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.004+0000 7f3b421fa640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b3c163cd0 0x7f3b3c0c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:49.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.004+0000 7f3b421fa640 1 --2- 172.21.15.55:0/3634966137 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b240039b0 0x7f3b3c0c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:49.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.004+0000 7f3b421fa640 1 -- 172.21.15.55:0/3634966137 >> 172.21.15.55:0/3634966137 conn(0x7f3b3c0cde30 msgr2=0x7f3b3c065120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:49.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.004+0000 7f3b421fa640 1 -- 172.21.15.55:0/3634966137 shutdown_connections 2023-07-06T22:01:49.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.004+0000 7f3b421fa640 1 -- 172.21.15.55:0/3634966137 wait complete. 2023-07-06T22:01:49.022 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-06T22:01:49.022 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-06T22:01:49.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.172+0000 7fa429100640 1 Processor -- start 2023-07-06T22:01:49.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.172+0000 7fa429100640 1 -- start start 2023-07-06T22:01:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.172+0000 7fa429100640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa42415dd50 0x7fa424069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.172+0000 7fa429100640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4240b3e70 con 0x7fa4240ccb70 2023-07-06T22:01:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.172+0000 7fa429100640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa424159c30 con 0x7fa4240c9b90 2023-07-06T22:01:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.172+0000 7fa429100640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4240c9070 con 0x7fa42415dd50 2023-07-06T22:01:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.176+0000 7fa42359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa42415dd50 0x7fa424069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.176+0000 7fa41bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa4240ccb70 0x7fa4240693f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56232/0 (socket says 172.21.15.55:56232) 2023-07-06T22:01:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.176+0000 7fa41bfff640 1 -- 172.21.15.55:0/2431388100 learned_addr learned my addr 172.21.15.55:0/2431388100 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.176+0000 7fa42359e640 1 -- 172.21.15.55:0/2431388100 >> v1:172.21.15.138:6789/0 conn(0x7fa4240c9b90 legacy=0x7fa4240c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.176+0000 7fa42359e640 1 -- 172.21.15.55:0/2431388100 >> v1:172.21.15.55:6789/0 conn(0x7fa4240ccb70 legacy=0x7fa4240693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:49.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.176+0000 7fa42359e640 1 -- 172.21.15.55:0/2431388100 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4240c8480 con 0x7fa42415dd50 2023-07-06T22:01:49.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.176+0000 7fa42259c640 1 -- 172.21.15.55:0/2431388100 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547579196 0 0) 0x7fa40c001120 con 0x7fa4240ccb70 2023-07-06T22:01:49.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.176+0000 7fa42359e640 1 --2- 172.21.15.55:0/2431388100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42415dd50 0x7fa424069b00 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009d90 tx=0x7fa41c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed2a154d173e216 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:49.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.176+0000 7fa42259c640 1 -- 172.21.15.55:0/2431388100 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c0a58f0 con 0x7fa42415dd50 2023-07-06T22:01:49.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.176+0000 7fa42259c640 1 -- 172.21.15.55:0/2431388100 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c0a5a50 con 0x7fa42415dd50 2023-07-06T22:01:49.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.176+0000 7fa42259c640 1 -- 172.21.15.55:0/2431388100 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c0a5de0 con 0x7fa42415dd50 2023-07-06T22:01:49.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 -- 172.21.15.55:0/2431388100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42415dd50 msgr2=0x7fa424069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 --2- 172.21.15.55:0/2431388100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42415dd50 0x7fa424069b00 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009d90 tx=0x7fa41c01c920 comp rx=0 tx=0).stop 2023-07-06T22:01:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 -- 172.21.15.55:0/2431388100 shutdown_connections 2023-07-06T22:01:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 --2- 172.21.15.55:0/2431388100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42415dd50 0x7fa424069b00 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 -- 172.21.15.55:0/2431388100 >> 172.21.15.55:0/2431388100 conn(0x7fa4240cde30 msgr2=0x7fa4240ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 -- 172.21.15.55:0/2431388100 shutdown_connections 2023-07-06T22:01:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 -- 172.21.15.55:0/2431388100 wait complete. 2023-07-06T22:01:49.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 Processor -- start 2023-07-06T22:01:49.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 -- start start 2023-07-06T22:01:49.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4240c9b90 0x7fa42415c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:49.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4240ccb70 0x7fa424152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:49.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa42415dd50 0x7fa4240aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:49.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42406d350 con 0x7fa4240c9b90 2023-07-06T22:01:49.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42406b720 con 0x7fa42415dd50 2023-07-06T22:01:49.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa429100640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42406c580 con 0x7fa4240ccb70 2023-07-06T22:01:49.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa422d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4240c9b90 0x7fa42415c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:49.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa422d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4240c9b90 0x7fa42415c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51926/0 (socket says 172.21.15.55:51926) 2023-07-06T22:01:49.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa422d9d640 1 -- 172.21.15.55:0/2513541627 learned_addr learned my addr 172.21.15.55:0/2513541627 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:49.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa41bfff640 1 --2- 172.21.15.55:0/2513541627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4240ccb70 0x7fa424152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:49.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa42359e640 1 --2- 172.21.15.55:0/2513541627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa42415dd50 0x7fa4240aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:49.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa422d9d640 1 -- 172.21.15.55:0/2513541627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4240ccb70 msgr2=0x7fa424152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:49.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa422d9d640 1 --2- 172.21.15.55:0/2513541627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4240ccb70 0x7fa424152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:49.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa422d9d640 1 -- 172.21.15.55:0/2513541627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa42415dd50 msgr2=0x7fa4240aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:49.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa422d9d640 1 --2- 172.21.15.55:0/2513541627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa42415dd50 0x7fa4240aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:49.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa422d9d640 1 -- 172.21.15.55:0/2513541627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c009a70 con 0x7fa4240c9b90 2023-07-06T22:01:49.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa41bfff640 1 --2- 172.21.15.55:0/2513541627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4240ccb70 0x7fa424152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:49.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.180+0000 7fa42359e640 1 --2- 172.21.15.55:0/2513541627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa42415dd50 0x7fa4240aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:49.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.184+0000 7fa422d9d640 1 --2- 172.21.15.55:0/2513541627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4240c9b90 0x7fa42415c820 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fa41400c3f0 tx=0x7fa41400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:49.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.184+0000 7fa41b7fe640 1 -- 172.21.15.55:0/2513541627 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4140052d0 con 0x7fa4240c9b90 2023-07-06T22:01:49.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.184+0000 7fa41b7fe640 1 -- 172.21.15.55:0/2513541627 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa414005430 con 0x7fa4240c9b90 2023-07-06T22:01:49.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.184+0000 7fa429100640 1 -- 172.21.15.55:0/2513541627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42406b970 con 0x7fa4240c9b90 2023-07-06T22:01:49.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.184+0000 7fa41b7fe640 1 -- 172.21.15.55:0/2513541627 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414003840 con 0x7fa4240c9b90 2023-07-06T22:01:49.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.184+0000 7fa429100640 1 -- 172.21.15.55:0/2513541627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42406bf30 con 0x7fa4240c9b90 2023-07-06T22:01:49.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.184+0000 7fa429100640 1 -- 172.21.15.55:0/2513541627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa424066d60 con 0x7fa4240c9b90 2023-07-06T22:01:49.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.184+0000 7fa41b7fe640 1 -- 172.21.15.55:0/2513541627 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 73) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fa4140039a0 con 0x7fa4240c9b90 2023-07-06T22:01:49.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.184+0000 7fa41b7fe640 1 --2- 172.21.15.55:0/2513541627 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fa404066150 0x7fa404068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:49.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.184+0000 7fa41b7fe640 1 -- 172.21.15.55:0/2513541627 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fa4140832f0 con 0x7fa4240c9b90 2023-07-06T22:01:49.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.184+0000 7fa41bfff640 1 --2- 172.21.15.55:0/2513541627 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fa404066150 0x7fa404068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:49.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.188+0000 7fa41bfff640 1 --2- 172.21.15.55:0/2513541627 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fa404066150 0x7fa404068600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa424163900 tx=0x7fa40c009040 comp rx=0 tx=0).ready entity=mgr.9396 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:49.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.188+0000 7fa41b7fe640 1 -- 172.21.15.55:0/2513541627 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa414050720 con 0x7fa4240c9b90 2023-07-06T22:01:49.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.236+0000 7fa41b7fe640 1 -- 172.21.15.55:0/2513541627 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 74) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fa414050af0 con 0x7fa4240c9b90 2023-07-06T22:01:49.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.368+0000 7fa429100640 1 -- 172.21.15.55:0/2513541627 --> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa42415e170 con 0x7fa404066150 2023-07-06T22:01:49.372 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:49.376+0000 7ff5fd1af640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-06T22:01:49.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.376+0000 7fa41b7fe640 1 -- 172.21.15.55:0/2513541627 <== mgr.9396 v2:172.21.15.55:6832/462110382 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fa40c001d30 con 0x7fa404066150 2023-07-06T22:01:49.373 INFO:teuthology.orchestra.run.smithi055.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-06T22:01:49.381 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-06T22:01:49.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:49.382 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-06T22:01:49.393 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-06T22:01:49.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.580+0000 7f3af066d640 1 Processor -- start 2023-07-06T22:01:49.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.580+0000 7f3af066d640 1 -- start start 2023-07-06T22:01:49.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.584+0000 7f3af066d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ae815bb90 0x7f3ae80ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:49.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.584+0000 7f3af066d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3ae80cef40 0x7f3ae806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:49.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.584+0000 7f3af066d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae815fe80 con 0x7f3ae806fe50 2023-07-06T22:01:49.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.584+0000 7f3af066d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae815f620 con 0x7f3ae815bb90 2023-07-06T22:01:49.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.584+0000 7f3af066d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae80702d0 con 0x7f3ae80cef40 2023-07-06T22:01:49.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.584+0000 7f3aee409640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ae815bb90 0x7f3ae80ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:49.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.584+0000 7f3aee409640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ae815bb90 0x7f3ae80ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51932/0 (socket says 172.21.15.55:51932) 2023-07-06T22:01:49.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.584+0000 7f3aee409640 1 -- 172.21.15.55:0/411899231 learned_addr learned my addr 172.21.15.55:0/411899231 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:49.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.584+0000 7f3aedc08640 1 --2- 172.21.15.55:0/411899231 >> v2:172.21.15.138:3300/0 conn(0x7f3ae80cef40 0x7f3ae806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:49.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.584+0000 7f3aee409640 1 -- 172.21.15.55:0/411899231 >> v2:172.21.15.138:3300/0 conn(0x7f3ae80cef40 msgr2=0x7f3ae806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:49.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.584+0000 7f3aee409640 1 --2- 172.21.15.55:0/411899231 >> v2:172.21.15.138:3300/0 conn(0x7f3ae80cef40 0x7f3ae806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:49.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.584+0000 7f3aee409640 1 -- 172.21.15.55:0/411899231 >> v1:172.21.15.55:6789/0 conn(0x7f3ae806fe50 legacy=0x7f3ae80693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:49.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.584+0000 7f3aee409640 1 -- 172.21.15.55:0/411899231 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae815bf60 con 0x7f3ae815bb90 2023-07-06T22:01:49.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.588+0000 7f3aee409640 1 --2- 172.21.15.55:0/411899231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae815bb90 0x7f3ae80ce030 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f3ae806aef0 tx=0x7f3ae401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b21f89d7a111bf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:49.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.588+0000 7f3aed407640 1 -- 172.21.15.55:0/411899231 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40ab600 con 0x7f3ae815bb90 2023-07-06T22:01:49.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.588+0000 7f3aed407640 1 -- 172.21.15.55:0/411899231 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae40a7050 con 0x7f3ae815bb90 2023-07-06T22:01:49.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.588+0000 7f3aed407640 1 -- 172.21.15.55:0/411899231 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40ab980 con 0x7f3ae815bb90 2023-07-06T22:01:49.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.588+0000 7f3af066d640 1 -- 172.21.15.55:0/411899231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae815bb90 msgr2=0x7f3ae80ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:49.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.588+0000 7f3af066d640 1 --2- 172.21.15.55:0/411899231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae815bb90 0x7f3ae80ce030 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f3ae806aef0 tx=0x7f3ae401c500 comp rx=0 tx=0).stop 2023-07-06T22:01:49.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.588+0000 7f3af066d640 1 -- 172.21.15.55:0/411899231 shutdown_connections 2023-07-06T22:01:49.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.588+0000 7f3af066d640 1 --2- 172.21.15.55:0/411899231 >> v2:172.21.15.138:3300/0 conn(0x7f3ae80cef40 0x7f3ae806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:49.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.588+0000 7f3af066d640 1 --2- 172.21.15.55:0/411899231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae815bb90 0x7f3ae80ce030 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:49.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.588+0000 7f3af066d640 1 -- 172.21.15.55:0/411899231 >> 172.21.15.55:0/411899231 conn(0x7f3ae80cbd70 msgr2=0x7f3ae80ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:49.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.588+0000 7f3af066d640 1 -- 172.21.15.55:0/411899231 shutdown_connections 2023-07-06T22:01:49.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.588+0000 7f3af066d640 1 -- 172.21.15.55:0/411899231 wait complete. 2023-07-06T22:01:49.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.588+0000 7f3af066d640 1 Processor -- start 2023-07-06T22:01:49.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.588+0000 7f3af066d640 1 -- start start 2023-07-06T22:01:49.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3af066d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae806fe50 0x7f3ae8159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:49.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3af066d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3ae80cef40 0x7f3ae80c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:49.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3af066d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ae815bb90 0x7f3ae80c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:49.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3af066d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae80c7860 con 0x7f3ae806fe50 2023-07-06T22:01:49.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3af066d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae80c6be0 con 0x7f3ae815bb90 2023-07-06T22:01:49.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3af066d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae80c6ec0 con 0x7f3ae80cef40 2023-07-06T22:01:49.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3aee409640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae806fe50 0x7f3ae8159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:49.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3aee409640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae806fe50 0x7f3ae8159b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51948/0 (socket says 172.21.15.55:51948) 2023-07-06T22:01:49.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3aee409640 1 -- 172.21.15.55:0/3522798272 learned_addr learned my addr 172.21.15.55:0/3522798272 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:49.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3aeec0a640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ae815bb90 0x7f3ae80c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:49.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3aedc08640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3ae80cef40 0x7f3ae80c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:49.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3aee409640 1 -- 172.21.15.55:0/3522798272 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3ae80cef40 msgr2=0x7f3ae80c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:49.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3aee409640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3ae80cef40 0x7f3ae80c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:49.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3aee409640 1 -- 172.21.15.55:0/3522798272 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ae815bb90 msgr2=0x7f3ae80c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:49.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3aee409640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ae815bb90 0x7f3ae80c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:49.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3aee409640 1 -- 172.21.15.55:0/3522798272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae40094d0 con 0x7f3ae806fe50 2023-07-06T22:01:49.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3aedc08640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3ae80cef40 0x7f3ae80c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:49.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3aee409640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae806fe50 0x7f3ae8159b80 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40ae040 tx=0x7f3ae401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:49.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3adeffd640 1 -- 172.21.15.55:0/3522798272 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40b6620 con 0x7f3ae806fe50 2023-07-06T22:01:49.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3adeffd640 1 -- 172.21.15.55:0/3522798272 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae40abe90 con 0x7f3ae806fe50 2023-07-06T22:01:49.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3adeffd640 1 -- 172.21.15.55:0/3522798272 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40b69e0 con 0x7f3ae806fe50 2023-07-06T22:01:49.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3af066d640 1 -- 172.21.15.55:0/3522798272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae80c71a0 con 0x7f3ae806fe50 2023-07-06T22:01:49.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3af066d640 1 -- 172.21.15.55:0/3522798272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae80c4d80 con 0x7f3ae806fe50 2023-07-06T22:01:49.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3af066d640 1 -- 172.21.15.55:0/3522798272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae806aa80 con 0x7f3ae806fe50 2023-07-06T22:01:49.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.592+0000 7f3adeffd640 1 -- 172.21.15.55:0/3522798272 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 74) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f3ae40b2040 con 0x7f3ae806fe50 2023-07-06T22:01:49.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.596+0000 7f3adeffd640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f3acc066480 0x7f3acc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:49.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.596+0000 7f3adeffd640 1 -- 172.21.15.55:0/3522798272 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f3ae411e8d0 con 0x7f3ae806fe50 2023-07-06T22:01:49.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.596+0000 7f3aedc08640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f3acc066480 0x7f3acc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:49.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.596+0000 7f3aedc08640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f3acc066480 0x7f3acc068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3ae815ac90 tx=0x7f3ad8008040 comp rx=0 tx=0).ready entity=mgr.9396 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:49.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.600+0000 7f3adeffd640 1 -- 172.21.15.55:0/3522798272 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3ae40eb7a0 con 0x7f3ae806fe50 2023-07-06T22:01:49.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:49.792+0000 7f3af066d640 1 -- 172.21.15.55:0/3522798272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f3ae8066d60 con 0x7f3ae806fe50 2023-07-06T22:01:50.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:50.760+0000 7f3adeffd640 1 -- 172.21.15.55:0/3522798272 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 75) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f3ae40ebb70 con 0x7f3ae806fe50 2023-07-06T22:01:50.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:50.760+0000 7f3adeffd640 1 -- 172.21.15.55:0/3522798272 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v75) v1 ==== 93+0+0 (secure 0 0 0) 0x7f3ae4104700 con 0x7f3ae806fe50 2023-07-06T22:01:50.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:50.764+0000 7f3af066d640 1 -- 172.21.15.55:0/3522798272 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f3acc066480 msgr2=0x7f3acc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:50.764+0000 7f3af066d640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f3acc066480 0x7f3acc068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3ae815ac90 tx=0x7f3ad8008040 comp rx=0 tx=0).stop 2023-07-06T22:01:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:50.764+0000 7f3af066d640 1 -- 172.21.15.55:0/3522798272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae806fe50 msgr2=0x7f3ae8159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:50.764+0000 7f3af066d640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae806fe50 0x7f3ae8159b80 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40ae040 tx=0x7f3ae401ad40 comp rx=0 tx=0).stop 2023-07-06T22:01:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:50.764+0000 7f3af066d640 1 -- 172.21.15.55:0/3522798272 shutdown_connections 2023-07-06T22:01:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:50.764+0000 7f3af066d640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f3acc066480 0x7f3acc068930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:50.764+0000 7f3af066d640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ae815bb90 0x7f3ae80c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:50.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:50.764+0000 7f3af066d640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3ae80cef40 0x7f3ae80c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:50.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:50.764+0000 7f3af066d640 1 --2- 172.21.15.55:0/3522798272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae806fe50 0x7f3ae8159b80 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:50.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:50.764+0000 7f3af066d640 1 -- 172.21.15.55:0/3522798272 >> 172.21.15.55:0/3522798272 conn(0x7f3ae80cbd70 msgr2=0x7f3ae80ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:50.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:50.764+0000 7f3af066d640 1 -- 172.21.15.55:0/3522798272 shutdown_connections 2023-07-06T22:01:50.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:50.764+0000 7f3af066d640 1 -- 172.21.15.55:0/3522798272 wait complete. 2023-07-06T22:01:50.787 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T22:01:50.787 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:01:50.843 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:01:50.914 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T22:01:50.915 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:01:50.915 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:50.925 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:01:50.926 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:50.927 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:50.931+0000 7f0af03db180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:01:50.947 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:50.948+0000 7f86d0163180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:01:50.957 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:01:51.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.148+0000 7f9466218640 1 Processor -- start 2023-07-06T22:01:51.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.148+0000 7f9466218640 1 -- start start 2023-07-06T22:01:51.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.152+0000 7f9466218640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600b7cd0 0x7f94600ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.152+0000 7f9466218640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94600b1fe0 0x7f946015f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.152+0000 7f9466218640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94600cecf0 con 0x7f94600ccab0 2023-07-06T22:01:51.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.152+0000 7f9466218640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94600d2310 con 0x7f94600b1fe0 2023-07-06T22:01:51.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.152+0000 7f9466218640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94600b80a0 con 0x7f94600b7cd0 2023-07-06T22:01:51.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.152+0000 7f945ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94600b1fe0 0x7f946015f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:51.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.152+0000 7f945ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94600b1fe0 0x7f946015f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51986/0 (socket says 172.21.15.55:51986) 2023-07-06T22:01:51.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.152+0000 7f945ffff640 1 -- 172.21.15.55:0/3866228592 learned_addr learned my addr 172.21.15.55:0/3866228592 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:51.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.152+0000 7f945f7fe640 1 --2- 172.21.15.55:0/3866228592 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600b7cd0 0x7f94600ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:51.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.152+0000 7f945ffff640 1 -- 172.21.15.55:0/3866228592 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600b7cd0 msgr2=0x7f94600ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:51.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.152+0000 7f945ffff640 1 --2- 172.21.15.55:0/3866228592 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600b7cd0 0x7f94600ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.152+0000 7f945ffff640 1 -- 172.21.15.55:0/3866228592 >> v1:172.21.15.138:6789/0 conn(0x7f94600ccab0 legacy=0x7f94600b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:51.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.152+0000 7f945ffff640 1 -- 172.21.15.55:0/3866228592 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94600d1d90 con 0x7f94600b1fe0 2023-07-06T22:01:51.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.156+0000 7f945ffff640 1 --2- 172.21.15.55:0/3866228592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600b1fe0 0x7f946015f870 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f9458009e50 tx=0x7f945801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b07f16d6104935 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:51.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.156+0000 7f945e7fc640 1 -- 172.21.15.55:0/3866228592 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580a55c0 con 0x7f94600b1fe0 2023-07-06T22:01:51.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.156+0000 7f945e7fc640 1 -- 172.21.15.55:0/3866228592 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94580a5720 con 0x7f94600b1fe0 2023-07-06T22:01:51.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.156+0000 7f945e7fc640 1 -- 172.21.15.55:0/3866228592 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580a5ab0 con 0x7f94600b1fe0 2023-07-06T22:01:51.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.156+0000 7f9466218640 1 -- 172.21.15.55:0/3866228592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600b1fe0 msgr2=0x7f946015f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:51.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.156+0000 7f9466218640 1 --2- 172.21.15.55:0/3866228592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600b1fe0 0x7f946015f870 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f9458009e50 tx=0x7f945801c940 comp rx=0 tx=0).stop 2023-07-06T22:01:51.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.156+0000 7f9466218640 1 -- 172.21.15.55:0/3866228592 shutdown_connections 2023-07-06T22:01:51.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.156+0000 7f9466218640 1 --2- 172.21.15.55:0/3866228592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600b1fe0 0x7f946015f870 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.156+0000 7f9466218640 1 --2- 172.21.15.55:0/3866228592 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600b7cd0 0x7f94600ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.156+0000 7f9466218640 1 -- 172.21.15.55:0/3866228592 >> 172.21.15.55:0/3866228592 conn(0x7f94600ceee0 msgr2=0x7f94600cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:51.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.156+0000 7f9466218640 1 -- 172.21.15.55:0/3866228592 shutdown_connections 2023-07-06T22:01:51.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.156+0000 7f9466218640 1 -- 172.21.15.55:0/3866228592 wait complete. 2023-07-06T22:01:51.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.156+0000 7f9466218640 1 Processor -- start 2023-07-06T22:01:51.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.156+0000 7f9466218640 1 -- start start 2023-07-06T22:01:51.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f9466218640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94600b1fe0 0x7f946015b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f9466218640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600b7cd0 0x7f946014c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f9466218640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600ccab0 0x7f946014c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f9466218640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946015bf80 con 0x7f94600ccab0 2023-07-06T22:01:51.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f9466218640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946015b6f0 con 0x7f94600b1fe0 2023-07-06T22:01:51.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f9466218640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946015b9c0 con 0x7f94600b7cd0 2023-07-06T22:01:51.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f945ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600ccab0 0x7f946014c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:51.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f945ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600ccab0 0x7f946014c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51996/0 (socket says 172.21.15.55:51996) 2023-07-06T22:01:51.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f945ffff640 1 -- 172.21.15.55:0/1392798650 learned_addr learned my addr 172.21.15.55:0/1392798650 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:51.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f945f7fe640 1 --2- 172.21.15.55:0/1392798650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94600b1fe0 0x7f946015b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:51.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f945effd640 1 --2- 172.21.15.55:0/1392798650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600b7cd0 0x7f946014c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:51.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f945ffff640 1 -- 172.21.15.55:0/1392798650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600b7cd0 msgr2=0x7f946014c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:51.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f945ffff640 1 --2- 172.21.15.55:0/1392798650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600b7cd0 0x7f946014c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f945ffff640 1 -- 172.21.15.55:0/1392798650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94600b1fe0 msgr2=0x7f946015b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:51.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f945ffff640 1 --2- 172.21.15.55:0/1392798650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94600b1fe0 0x7f946015b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f945ffff640 1 -- 172.21.15.55:0/1392798650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9458009b30 con 0x7f94600ccab0 2023-07-06T22:01:51.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f945ffff640 1 --2- 172.21.15.55:0/1392798650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600ccab0 0x7f946014c7f0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f945801aff0 tx=0x7f94580196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:51.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f9447fff640 1 -- 172.21.15.55:0/1392798650 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580b8670 con 0x7f94600ccab0 2023-07-06T22:01:51.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f9447fff640 1 -- 172.21.15.55:0/1392798650 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94580b87d0 con 0x7f94600ccab0 2023-07-06T22:01:51.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f9447fff640 1 -- 172.21.15.55:0/1392798650 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580b8b40 con 0x7f94600ccab0 2023-07-06T22:01:51.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f9466218640 1 -- 172.21.15.55:0/1392798650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946015bca0 con 0x7f94600ccab0 2023-07-06T22:01:51.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f9466218640 1 -- 172.21.15.55:0/1392798650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94600b5710 con 0x7f94600ccab0 2023-07-06T22:01:51.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.160+0000 7f9466218640 1 -- 172.21.15.55:0/1392798650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94600b5290 con 0x7f94600ccab0 2023-07-06T22:01:51.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.164+0000 7f9447fff640 1 -- 172.21.15.55:0/1392798650 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f94580b8ca0 con 0x7f94600ccab0 2023-07-06T22:01:51.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.164+0000 7f9447fff640 1 --2- 172.21.15.55:0/1392798650 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f944c066460 0x7f944c068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.164+0000 7f9447fff640 1 -- 172.21.15.55:0/1392798650 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f945811f740 con 0x7f94600ccab0 2023-07-06T22:01:51.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.164+0000 7f945f7fe640 1 -- 172.21.15.55:0/1392798650 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f944c066460 msgr2=0x7f944c068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/462110382 2023-07-06T22:01:51.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.164+0000 7f945f7fe640 1 --2- 172.21.15.55:0/1392798650 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f944c066460 0x7f944c068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:51.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.168+0000 7f9447fff640 1 -- 172.21.15.55:0/1392798650 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94600b5290 con 0x7f94600ccab0 2023-07-06T22:01:51.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.324+0000 7f9466218640 1 -- 172.21.15.55:0/1392798650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94600b5290 con 0x7f94600ccab0 2023-07-06T22:01:51.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.324+0000 7f9447fff640 1 -- 172.21.15.55:0/1392798650 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+19097 (secure 0 0 0) 0x7f94600b5290 con 0x7f94600ccab0 2023-07-06T22:01:51.324 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:51.325 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":147,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:01:47.217257+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:01:28.023569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-07-06T22:01:29.170296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3374210555":"2023-07-07T22:01:47.217185+0000","172.21.15.55:6833/206120108":"2023-07-07T22:01:47.217185+0000","172.21.15.55:6832/206120108":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/1122193584":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/2036406408":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/1372487043":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/3843098755":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/3618722598":"2023-07-07T22:01:47.217185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:01:51.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.328+0000 7f9466218640 1 -- 172.21.15.55:0/1392798650 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f944c066460 msgr2=0x7f944c068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:51.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.328+0000 7f9466218640 1 --2- 172.21.15.55:0/1392798650 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f944c066460 0x7f944c068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.328+0000 7f9466218640 1 -- 172.21.15.55:0/1392798650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600ccab0 msgr2=0x7f946014c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:51.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.328+0000 7f9466218640 1 --2- 172.21.15.55:0/1392798650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600ccab0 0x7f946014c7f0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f945801aff0 tx=0x7f94580196e0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.328+0000 7f9466218640 1 -- 172.21.15.55:0/1392798650 shutdown_connections 2023-07-06T22:01:51.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.328+0000 7f9466218640 1 --2- 172.21.15.55:0/1392798650 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f944c066460 0x7f944c068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.328+0000 7f9466218640 1 --2- 172.21.15.55:0/1392798650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94600ccab0 0x7f946014c7f0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.328+0000 7f9466218640 1 --2- 172.21.15.55:0/1392798650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94600b7cd0 0x7f946014c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.328+0000 7f9466218640 1 --2- 172.21.15.55:0/1392798650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94600b1fe0 0x7f946015b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.328+0000 7f9466218640 1 -- 172.21.15.55:0/1392798650 >> 172.21.15.55:0/1392798650 conn(0x7f94600ceee0 msgr2=0x7f94601590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:51.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.328+0000 7f9466218640 1 -- 172.21.15.55:0/1392798650 shutdown_connections 2023-07-06T22:01:51.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.328+0000 7f9466218640 1 -- 172.21.15.55:0/1392798650 wait complete. 2023-07-06T22:01:51.342 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:51.343+0000 7f0af03db180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:01:51.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T22:01:28.023569+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T22:01:29.170296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:01:51.349 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:01:51.402 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:51.404+0000 7f86d0163180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:01:51.491 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:51.495+0000 7f0af03db180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:01:51.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.499+0000 7f8f4bd00640 1 Processor -- start 2023-07-06T22:01:51.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.499+0000 7f8f4bd00640 1 -- start start 2023-07-06T22:01:51.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.503+0000 7f8f4bd00640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8f440b3870 0x7f8f440b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.503+0000 7f8f4bd00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f440b4210 con 0x7f8f440d03c0 2023-07-06T22:01:51.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.503+0000 7f8f4bd00640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f440b2b80 con 0x7f8f4415b850 2023-07-06T22:01:51.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.503+0000 7f8f4bd00640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f440cff30 con 0x7f8f440b3870 2023-07-06T22:01:51.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.503+0000 7f8f4a29d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8f440d03c0 0x7f8f440d07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56254/0 (socket says 172.21.15.55:56254) 2023-07-06T22:01:51.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.503+0000 7f8f4a29d640 1 -- 172.21.15.55:0/2862389670 learned_addr learned my addr 172.21.15.55:0/2862389670 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:51.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.503+0000 7f8f4929b640 1 --2- 172.21.15.55:0/2862389670 >> v2:172.21.15.138:3300/0 conn(0x7f8f440b3870 0x7f8f440b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:51.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.503+0000 7f8f48a9a640 1 -- 172.21.15.55:0/2862389670 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310594484 0 0) 0x7f8f440b4210 con 0x7f8f440d03c0 2023-07-06T22:01:51.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.503+0000 7f8f48a9a640 1 -- 172.21.15.55:0/2862389670 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f30003530 con 0x7f8f440d03c0 2023-07-06T22:01:51.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.503+0000 7f8f4929b640 1 -- 172.21.15.55:0/2862389670 >> v1:172.21.15.138:6789/0 conn(0x7f8f4415b850 legacy=0x7f8f440cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:51.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.503+0000 7f8f4929b640 1 -- 172.21.15.55:0/2862389670 >> v1:172.21.15.55:6789/0 conn(0x7f8f440d03c0 legacy=0x7f8f440d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:51.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.503+0000 7f8f4929b640 1 -- 172.21.15.55:0/2862389670 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f440b22e0 con 0x7f8f440b3870 2023-07-06T22:01:51.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.507+0000 7f8f4929b640 1 --2- 172.21.15.55:0/2862389670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f440b3870 0x7f8f440b3cd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8f340097c0 tx=0x7f8f3401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a45d280e2e6f73d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:51.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.507+0000 7f8f48a9a640 1 -- 172.21.15.55:0/2862389670 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340ab600 con 0x7f8f440b3870 2023-07-06T22:01:51.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.507+0000 7f8f48a9a640 1 -- 172.21.15.55:0/2862389670 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f340a7050 con 0x7f8f440b3870 2023-07-06T22:01:51.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.507+0000 7f8f48a9a640 1 -- 172.21.15.55:0/2862389670 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340ab980 con 0x7f8f440b3870 2023-07-06T22:01:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.507+0000 7f8f4bd00640 1 -- 172.21.15.55:0/2862389670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f440b3870 msgr2=0x7f8f440b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.507+0000 7f8f4bd00640 1 --2- 172.21.15.55:0/2862389670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f440b3870 0x7f8f440b3cd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8f340097c0 tx=0x7f8f3401c330 comp rx=0 tx=0).stop 2023-07-06T22:01:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.507+0000 7f8f4bd00640 1 -- 172.21.15.55:0/2862389670 shutdown_connections 2023-07-06T22:01:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.507+0000 7f8f4bd00640 1 --2- 172.21.15.55:0/2862389670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f440b3870 0x7f8f440b3cd0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.507+0000 7f8f4bd00640 1 -- 172.21.15.55:0/2862389670 >> 172.21.15.55:0/2862389670 conn(0x7f8f440cec20 msgr2=0x7f8f440cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:51.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.507+0000 7f8f4bd00640 1 -- 172.21.15.55:0/2862389670 shutdown_connections 2023-07-06T22:01:51.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.507+0000 7f8f4bd00640 1 -- 172.21.15.55:0/2862389670 wait complete. 2023-07-06T22:01:51.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.507+0000 7f8f4bd00640 1 Processor -- start 2023-07-06T22:01:51.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.507+0000 7f8f4bd00640 1 -- start start 2023-07-06T22:01:51.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4bd00640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f440b3870 0x7f8f440caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4bd00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f440d03c0 0x7f8f4414d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4bd00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f4415b850 0x7f8f440b6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4bd00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44154250 con 0x7f8f440d03c0 2023-07-06T22:01:51.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4bd00640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44154af0 con 0x7f8f4415b850 2023-07-06T22:01:51.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4bd00640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440cb420 con 0x7f8f440b3870 2023-07-06T22:01:51.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4929b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f440d03c0 0x7f8f4414d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:51.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4929b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f440d03c0 0x7f8f4414d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52000/0 (socket says 172.21.15.55:52000) 2023-07-06T22:01:51.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4929b640 1 -- 172.21.15.55:0/675282465 learned_addr learned my addr 172.21.15.55:0/675282465 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:51.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f49a9c640 1 --2- 172.21.15.55:0/675282465 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f440b3870 0x7f8f440caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:51.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4a29d640 1 --2- 172.21.15.55:0/675282465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f4415b850 0x7f8f440b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:51.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4929b640 1 -- 172.21.15.55:0/675282465 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f440b3870 msgr2=0x7f8f440caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:51.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4929b640 1 --2- 172.21.15.55:0/675282465 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f440b3870 0x7f8f440caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4929b640 1 -- 172.21.15.55:0/675282465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f4415b850 msgr2=0x7f8f440b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:51.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4929b640 1 --2- 172.21.15.55:0/675282465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f4415b850 0x7f8f440b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4929b640 1 -- 172.21.15.55:0/675282465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f34009420 con 0x7f8f440d03c0 2023-07-06T22:01:51.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4929b640 1 --2- 172.21.15.55:0/675282465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f440d03c0 0x7f8f4414d7e0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f8f34019f60 tx=0x7f8f340190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:51.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f3a7fc640 1 -- 172.21.15.55:0/675282465 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340b4400 con 0x7f8f440d03c0 2023-07-06T22:01:51.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f3a7fc640 1 -- 172.21.15.55:0/675282465 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f340b4560 con 0x7f8f440d03c0 2023-07-06T22:01:51.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4bd00640 1 -- 172.21.15.55:0/675282465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f441544a0 con 0x7f8f440d03c0 2023-07-06T22:01:51.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f3a7fc640 1 -- 172.21.15.55:0/675282465 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340b4910 con 0x7f8f440d03c0 2023-07-06T22:01:51.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4bd00640 1 -- 172.21.15.55:0/675282465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f44154f80 con 0x7f8f440d03c0 2023-07-06T22:01:51.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.511+0000 7f8f4bd00640 1 -- 172.21.15.55:0/675282465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f44066d60 con 0x7f8f440d03c0 2023-07-06T22:01:51.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.515+0000 7f8f3a7fc640 1 -- 172.21.15.55:0/675282465 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f8f340b2040 con 0x7f8f440d03c0 2023-07-06T22:01:51.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.515+0000 7f8f3a7fc640 1 --2- 172.21.15.55:0/675282465 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f8f28066460 0x7f8f28068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.515+0000 7f8f3a7fc640 1 -- 172.21.15.55:0/675282465 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f8f3411e230 con 0x7f8f440d03c0 2023-07-06T22:01:51.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.515+0000 7f8f49a9c640 1 -- 172.21.15.55:0/675282465 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f8f28066460 msgr2=0x7f8f28068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/462110382 2023-07-06T22:01:51.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.515+0000 7f8f49a9c640 1 --2- 172.21.15.55:0/675282465 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f8f28066460 0x7f8f28068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:51.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.519+0000 7f8f3a7fc640 1 -- 172.21.15.55:0/675282465 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8f340eb050 con 0x7f8f440d03c0 2023-07-06T22:01:51.564 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:51.567+0000 7f86d0163180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:01:51.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.671+0000 7f8f4bd00640 1 -- 172.21.15.55:0/675282465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f440b3420 con 0x7f8f440d03c0 2023-07-06T22:01:51.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.675+0000 7f8f3a7fc640 1 -- 172.21.15.55:0/675282465 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v147) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f340ee670 con 0x7f8f440d03c0 2023-07-06T22:01:51.673 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:01:51.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.675+0000 7f8f4bd00640 1 -- 172.21.15.55:0/675282465 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f8f28066460 msgr2=0x7f8f28068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:51.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.675+0000 7f8f4bd00640 1 --2- 172.21.15.55:0/675282465 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f8f28066460 0x7f8f28068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.675+0000 7f8f4bd00640 1 -- 172.21.15.55:0/675282465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f440d03c0 msgr2=0x7f8f4414d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:51.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.675+0000 7f8f4bd00640 1 --2- 172.21.15.55:0/675282465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f440d03c0 0x7f8f4414d7e0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f8f34019f60 tx=0x7f8f340190d0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.675+0000 7f8f4bd00640 1 -- 172.21.15.55:0/675282465 shutdown_connections 2023-07-06T22:01:51.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.675+0000 7f8f4bd00640 1 --2- 172.21.15.55:0/675282465 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f8f28066460 0x7f8f28068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.675+0000 7f8f4bd00640 1 --2- 172.21.15.55:0/675282465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f4415b850 0x7f8f440b6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.675+0000 7f8f4bd00640 1 --2- 172.21.15.55:0/675282465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f440d03c0 0x7f8f4414d7e0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.675+0000 7f8f4bd00640 1 --2- 172.21.15.55:0/675282465 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f440b3870 0x7f8f440caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.675+0000 7f8f4bd00640 1 -- 172.21.15.55:0/675282465 >> 172.21.15.55:0/675282465 conn(0x7f8f440cec20 msgr2=0x7f8f440693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:51.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.675+0000 7f8f4bd00640 1 -- 172.21.15.55:0/675282465 shutdown_connections 2023-07-06T22:01:51.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.675+0000 7f8f4bd00640 1 -- 172.21.15.55:0/675282465 wait complete. 2023-07-06T22:01:51.694 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:01:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.847+0000 7fbdc5834640 1 Processor -- start 2023-07-06T22:01:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.847+0000 7fbdc5834640 1 -- start start 2023-07-06T22:01:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdc5834640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbdc00709a0 0x7fbdc00cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdc5834640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbdc00b1340 0x7fbdc006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdc5834640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc00cc300 con 0x7fbdc00cbe60 2023-07-06T22:01:51.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdc5834640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc00cc5e0 con 0x7fbdc00709a0 2023-07-06T22:01:51.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdc5834640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00cc8c0 con 0x7fbdc00b1340 2023-07-06T22:01:51.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdbe7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbdc00cbe60 0x7fbdc00b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56260/0 (socket says 172.21.15.55:56260) 2023-07-06T22:01:51.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdbe7fc640 1 -- 172.21.15.55:0/2415108896 learned_addr learned my addr 172.21.15.55:0/2415108896 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdbf7fe640 1 --2- 172.21.15.55:0/2415108896 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbdc00b1340 0x7fbdc006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdbeffd640 1 --2- 172.21.15.55:0/2415108896 >> v2:172.21.15.138:3300/0 conn(0x7fbdc00709a0 0x7fbdc00cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdbdffb640 1 -- 172.21.15.55:0/2415108896 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572644771 0 0) 0x7fbdc00cc300 con 0x7fbdc00cbe60 2023-07-06T22:01:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdbdffb640 1 -- 172.21.15.55:0/2415108896 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbda8003530 con 0x7fbdc00cbe60 2023-07-06T22:01:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdbeffd640 1 -- 172.21.15.55:0/2415108896 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbdc00b1340 msgr2=0x7fbdc006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdbeffd640 1 --2- 172.21.15.55:0/2415108896 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbdc00b1340 0x7fbdc006eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdbeffd640 1 -- 172.21.15.55:0/2415108896 >> v1:172.21.15.55:6789/0 conn(0x7fbdc00cbe60 legacy=0x7fbdc00b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.851+0000 7fbdbeffd640 1 -- 172.21.15.55:0/2415108896 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc00ccba0 con 0x7fbdc00709a0 2023-07-06T22:01:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.855+0000 7fbdbeffd640 1 --2- 172.21.15.55:0/2415108896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbdc00709a0 0x7fbdc00cb920 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbdb00097c0 tx=0x7fbdb001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=953e8464a1d4172e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.855+0000 7fbdbdffb640 1 -- 172.21.15.55:0/2415108896 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00ad640 con 0x7fbdc00709a0 2023-07-06T22:01:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.855+0000 7fbdbdffb640 1 -- 172.21.15.55:0/2415108896 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb00ad7a0 con 0x7fbdc00709a0 2023-07-06T22:01:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.855+0000 7fbdbdffb640 1 -- 172.21.15.55:0/2415108896 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00adb30 con 0x7fbdc00709a0 2023-07-06T22:01:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.855+0000 7fbdc5834640 1 -- 172.21.15.55:0/2415108896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbdc00709a0 msgr2=0x7fbdc00cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.855+0000 7fbdc5834640 1 --2- 172.21.15.55:0/2415108896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbdc00709a0 0x7fbdc00cb920 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbdb00097c0 tx=0x7fbdb001c480 comp rx=0 tx=0).stop 2023-07-06T22:01:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.855+0000 7fbdc5834640 1 -- 172.21.15.55:0/2415108896 shutdown_connections 2023-07-06T22:01:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.855+0000 7fbdc5834640 1 --2- 172.21.15.55:0/2415108896 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbdc00b1340 0x7fbdc006eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.855+0000 7fbdc5834640 1 --2- 172.21.15.55:0/2415108896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbdc00709a0 0x7fbdc00cb920 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.855+0000 7fbdc5834640 1 -- 172.21.15.55:0/2415108896 >> 172.21.15.55:0/2415108896 conn(0x7fbdc00cea70 msgr2=0x7fbdc00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.855+0000 7fbdc5834640 1 -- 172.21.15.55:0/2415108896 shutdown_connections 2023-07-06T22:01:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.855+0000 7fbdc5834640 1 -- 172.21.15.55:0/2415108896 wait complete. 2023-07-06T22:01:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.855+0000 7fbdc5834640 1 Processor -- start 2023-07-06T22:01:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdc5834640 1 -- start start 2023-07-06T22:01:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdc5834640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc00709a0 0x7fbdc015edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdc5834640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbdc00b1340 0x7fbdc0154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdc5834640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbdc00cbe60 0x7fbdc006ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdc5834640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc0161070 con 0x7fbdc00709a0 2023-07-06T22:01:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdc5834640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc01630a0 con 0x7fbdc00b1340 2023-07-06T22:01:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdc5834640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00c35f0 con 0x7fbdc00cbe60 2023-07-06T22:01:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdbeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc00709a0 0x7fbdc015edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdbeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc00709a0 0x7fbdc015edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52014/0 (socket says 172.21.15.55:52014) 2023-07-06T22:01:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdbeffd640 1 -- 172.21.15.55:0/2548016095 learned_addr learned my addr 172.21.15.55:0/2548016095 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdbf7fe640 1 --2- 172.21.15.55:0/2548016095 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbdc00cbe60 0x7fbdc006ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdbe7fc640 1 --2- 172.21.15.55:0/2548016095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbdc00b1340 0x7fbdc0154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdbeffd640 1 -- 172.21.15.55:0/2548016095 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbdc00cbe60 msgr2=0x7fbdc006ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdbeffd640 1 --2- 172.21.15.55:0/2548016095 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbdc00cbe60 0x7fbdc006ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdbeffd640 1 -- 172.21.15.55:0/2548016095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbdc00b1340 msgr2=0x7fbdc0154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdbeffd640 1 --2- 172.21.15.55:0/2548016095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbdc00b1340 0x7fbdc0154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdbeffd640 1 -- 172.21.15.55:0/2548016095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb0009420 con 0x7fbdc00709a0 2023-07-06T22:01:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdbeffd640 1 --2- 172.21.15.55:0/2548016095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc00709a0 0x7fbdc015edc0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fbdb00097c0 tx=0x7fbdb0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbda7fff640 1 -- 172.21.15.55:0/2548016095 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00b6610 con 0x7fbdc00709a0 2023-07-06T22:01:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbda7fff640 1 -- 172.21.15.55:0/2548016095 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb00a6040 con 0x7fbdc00709a0 2023-07-06T22:01:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdc5834640 1 -- 172.21.15.55:0/2548016095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc00c38d0 con 0x7fbdc00709a0 2023-07-06T22:01:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbda7fff640 1 -- 172.21.15.55:0/2548016095 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00b69d0 con 0x7fbdc00709a0 2023-07-06T22:01:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdc5834640 1 -- 172.21.15.55:0/2548016095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc00c3bb0 con 0x7fbdc00709a0 2023-07-06T22:01:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.859+0000 7fbdc5834640 1 -- 172.21.15.55:0/2548016095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc0066d60 con 0x7fbdc00709a0 2023-07-06T22:01:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.863+0000 7fbda7fff640 1 -- 172.21.15.55:0/2548016095 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fbdb00b4040 con 0x7fbdc00709a0 2023-07-06T22:01:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.863+0000 7fbda7fff640 1 --2- 172.21.15.55:0/2548016095 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fbdac066430 0x7fbdac0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.863+0000 7fbda7fff640 1 -- 172.21.15.55:0/2548016095 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fbdb011e410 con 0x7fbdc00709a0 2023-07-06T22:01:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.863+0000 7fbdbe7fc640 1 -- 172.21.15.55:0/2548016095 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fbdac066430 msgr2=0x7fbdac0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/462110382 2023-07-06T22:01:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.863+0000 7fbdbe7fc640 1 --2- 172.21.15.55:0/2548016095 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fbdac066430 0x7fbdac0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:51.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:51.871+0000 7fbda7fff640 1 -- 172.21.15.55:0/2548016095 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbdb00eb400 con 0x7fbdc00709a0 2023-07-06T22:01:51.968 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:51.971+0000 7f0af03db180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:01:52.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.027+0000 7fbdc5834640 1 -- 172.21.15.55:0/2548016095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbdc01634e0 con 0x7fbdc00709a0 2023-07-06T22:01:52.026 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:52.027+0000 7f0af03db180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:01:52.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.027+0000 7fbda7fff640 1 -- 172.21.15.55:0/2548016095 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v147) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbdb00b20a0 con 0x7fbdc00709a0 2023-07-06T22:01:52.027 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:01:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.031+0000 7fbdc5834640 1 -- 172.21.15.55:0/2548016095 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fbdac066430 msgr2=0x7fbdac0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.031+0000 7fbdc5834640 1 --2- 172.21.15.55:0/2548016095 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fbdac066430 0x7fbdac0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.031+0000 7fbdc5834640 1 -- 172.21.15.55:0/2548016095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc00709a0 msgr2=0x7fbdc015edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.031+0000 7fbdc5834640 1 --2- 172.21.15.55:0/2548016095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc00709a0 0x7fbdc015edc0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fbdb00097c0 tx=0x7fbdb0019220 comp rx=0 tx=0).stop 2023-07-06T22:01:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.031+0000 7fbdc5834640 1 -- 172.21.15.55:0/2548016095 shutdown_connections 2023-07-06T22:01:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.031+0000 7fbdc5834640 1 --2- 172.21.15.55:0/2548016095 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fbdac066430 0x7fbdac0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.031+0000 7fbdc5834640 1 --2- 172.21.15.55:0/2548016095 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbdc00cbe60 0x7fbdc006ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.031+0000 7fbdc5834640 1 --2- 172.21.15.55:0/2548016095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbdc00b1340 0x7fbdc0154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.031+0000 7fbdc5834640 1 --2- 172.21.15.55:0/2548016095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc00709a0 0x7fbdc015edc0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.031+0000 7fbdc5834640 1 -- 172.21.15.55:0/2548016095 >> 172.21.15.55:0/2548016095 conn(0x7fbdc00cea70 msgr2=0x7fbdc0069480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.031+0000 7fbdc5834640 1 -- 172.21.15.55:0/2548016095 shutdown_connections 2023-07-06T22:01:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.031+0000 7fbdc5834640 1 -- 172.21.15.55:0/2548016095 wait complete. 2023-07-06T22:01:52.049 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T22:01:52.081 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:52.083+0000 7f0af03db180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:01:52.086 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:52.087+0000 7f86d0163180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:01:52.150 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:52.151+0000 7f86d0163180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:01:52.165 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:52.167+0000 7f0af03db180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:01:52.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.195+0000 7fa605a7b640 1 Processor -- start 2023-07-06T22:01:52.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.199+0000 7fa605a7b640 1 -- start start 2023-07-06T22:01:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.199+0000 7fa605a7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa60015b850 0x7fa6000cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.199+0000 7fa605a7b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6000b2b80 con 0x7fa6000b3f80 2023-07-06T22:01:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.199+0000 7fa605a7b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6000cff30 con 0x7fa6000ccd30 2023-07-06T22:01:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.199+0000 7fa605a7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000b22e0 con 0x7fa60015b850 2023-07-06T22:01:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.199+0000 7fa5fffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa6000b3f80 0x7fa6000d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56266/0 (socket says 172.21.15.55:56266) 2023-07-06T22:01:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.199+0000 7fa5fffff640 1 -- 172.21.15.55:0/2125381815 learned_addr learned my addr 172.21.15.55:0/2125381815 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.199+0000 7fa5ff7fe640 1 --2- 172.21.15.55:0/2125381815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa60015b850 0x7fa6000cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.199+0000 7fa5fe7fc640 1 -- 172.21.15.55:0/2125381815 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668686737 0 0) 0x7fa6000cff30 con 0x7fa6000ccd30 2023-07-06T22:01:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.199+0000 7fa5fe7fc640 1 -- 172.21.15.55:0/2125381815 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5e8003530 con 0x7fa6000ccd30 2023-07-06T22:01:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.199+0000 7fa5ff7fe640 1 -- 172.21.15.55:0/2125381815 >> v1:172.21.15.138:6789/0 conn(0x7fa6000ccd30 legacy=0x7fa6000b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.199+0000 7fa5ff7fe640 1 -- 172.21.15.55:0/2125381815 >> v1:172.21.15.55:6789/0 conn(0x7fa6000b3f80 legacy=0x7fa6000d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.199+0000 7fa5fe7fc640 1 -- 172.21.15.55:0/2125381815 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222028946 0 0) 0x7fa6000b2b80 con 0x7fa6000b3f80 2023-07-06T22:01:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.199+0000 7fa5ff7fe640 1 -- 172.21.15.55:0/2125381815 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6000b25c0 con 0x7fa60015b850 2023-07-06T22:01:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.203+0000 7fa5ff7fe640 1 --2- 172.21.15.55:0/2125381815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa60015b850 0x7fa6000cc7f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00097f0 tx=0x7fa5f001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b069aefb931a0958 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.203+0000 7fa5fe7fc640 1 -- 172.21.15.55:0/2125381815 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00ab600 con 0x7fa60015b850 2023-07-06T22:01:52.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.203+0000 7fa5fe7fc640 1 -- 172.21.15.55:0/2125381815 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f00a7050 con 0x7fa60015b850 2023-07-06T22:01:52.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.203+0000 7fa5fe7fc640 1 -- 172.21.15.55:0/2125381815 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00ab980 con 0x7fa60015b850 2023-07-06T22:01:52.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.203+0000 7fa605a7b640 1 -- 172.21.15.55:0/2125381815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa60015b850 msgr2=0x7fa6000cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:52.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.203+0000 7fa605a7b640 1 --2- 172.21.15.55:0/2125381815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa60015b850 0x7fa6000cc7f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00097f0 tx=0x7fa5f001c370 comp rx=0 tx=0).stop 2023-07-06T22:01:52.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.203+0000 7fa605a7b640 1 -- 172.21.15.55:0/2125381815 shutdown_connections 2023-07-06T22:01:52.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.203+0000 7fa605a7b640 1 --2- 172.21.15.55:0/2125381815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa60015b850 0x7fa6000cc7f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.203+0000 7fa605a7b640 1 -- 172.21.15.55:0/2125381815 >> 172.21.15.55:0/2125381815 conn(0x7fa6000cec20 msgr2=0x7fa6000cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:52.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.203+0000 7fa605a7b640 1 -- 172.21.15.55:0/2125381815 shutdown_connections 2023-07-06T22:01:52.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.203+0000 7fa605a7b640 1 -- 172.21.15.55:0/2125381815 wait complete. 2023-07-06T22:01:52.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.203+0000 7fa605a7b640 1 Processor -- start 2023-07-06T22:01:52.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa605a7b640 1 -- start start 2023-07-06T22:01:52.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa605a7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6000b3f80 0x7fa6001501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:52.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa605a7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6000ccd30 0x7fa6000b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:52.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa605a7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa60015b850 0x7fa6000b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:52.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa605a7b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa600150700 con 0x7fa6000b3f80 2023-07-06T22:01:52.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa605a7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6001f3ea0 con 0x7fa6000ccd30 2023-07-06T22:01:52.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa605a7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60015ca90 con 0x7fa60015b850 2023-07-06T22:01:52.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa5ff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6000b3f80 0x7fa6001501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:52.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa5ff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6000b3f80 0x7fa6001501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52016/0 (socket says 172.21.15.55:52016) 2023-07-06T22:01:52.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa5ff7fe640 1 -- 172.21.15.55:0/3814918097 learned_addr learned my addr 172.21.15.55:0/3814918097 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:52.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa5feffd640 1 --2- 172.21.15.55:0/3814918097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6000ccd30 0x7fa6000b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:52.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa5fffff640 1 --2- 172.21.15.55:0/3814918097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa60015b850 0x7fa6000b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:52.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa5ff7fe640 1 -- 172.21.15.55:0/3814918097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa60015b850 msgr2=0x7fa6000b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:52.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa5ff7fe640 1 --2- 172.21.15.55:0/3814918097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa60015b850 0x7fa6000b7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa5ff7fe640 1 -- 172.21.15.55:0/3814918097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6000ccd30 msgr2=0x7fa6000b6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:52.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa5ff7fe640 1 --2- 172.21.15.55:0/3814918097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6000ccd30 0x7fa6000b6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa5ff7fe640 1 -- 172.21.15.55:0/3814918097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0009420 con 0x7fa6000b3f80 2023-07-06T22:01:52.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa5ff7fe640 1 --2- 172.21.15.55:0/3814918097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6000b3f80 0x7fa6001501c0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00097f0 tx=0x7fa5f0019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:52.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa5e7fff640 1 -- 172.21.15.55:0/3814918097 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00abdc0 con 0x7fa6000b3f80 2023-07-06T22:01:52.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa5e7fff640 1 -- 172.21.15.55:0/3814918097 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f0004020 con 0x7fa6000b3f80 2023-07-06T22:01:52.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa5e7fff640 1 -- 172.21.15.55:0/3814918097 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00043b0 con 0x7fa6000b3f80 2023-07-06T22:01:52.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa605a7b640 1 -- 172.21.15.55:0/3814918097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60015bda0 con 0x7fa6000b3f80 2023-07-06T22:01:52.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa605a7b640 1 -- 172.21.15.55:0/3814918097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6001595b0 con 0x7fa6000b3f80 2023-07-06T22:01:52.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.207+0000 7fa605a7b640 1 -- 172.21.15.55:0/3814918097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa600066d60 con 0x7fa6000b3f80 2023-07-06T22:01:52.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.211+0000 7fa5e7fff640 1 -- 172.21.15.55:0/3814918097 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fa5f00b2040 con 0x7fa6000b3f80 2023-07-06T22:01:52.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.211+0000 7fa5e7fff640 1 --2- 172.21.15.55:0/3814918097 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fa5ec066460 0x7fa5ec068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:52.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.211+0000 7fa5e7fff640 1 -- 172.21.15.55:0/3814918097 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fa5f011e130 con 0x7fa6000b3f80 2023-07-06T22:01:52.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.211+0000 7fa5feffd640 1 -- 172.21.15.55:0/3814918097 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fa5ec066460 msgr2=0x7fa5ec068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/462110382 2023-07-06T22:01:52.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.211+0000 7fa5feffd640 1 --2- 172.21.15.55:0/3814918097 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fa5ec066460 0x7fa5ec068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:52.213 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:52.215+0000 7f86d0163180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:01:52.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.219+0000 7fa5e7fff640 1 -- 172.21.15.55:0/3814918097 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa5f00eaee0 con 0x7fa6000b3f80 2023-07-06T22:01:52.222 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:52.223+0000 7f0af03db180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:01:52.307 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:52.307+0000 7f86d0163180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:01:52.309 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:52.311+0000 7f0af03db180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:01:52.364 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:52.367+0000 7f0af03db180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:01:52.367 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:52.367+0000 7f86d0163180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:01:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.379+0000 7fa605a7b640 1 -- 172.21.15.55:0/3814918097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa60006b1f0 con 0x7fa6000b3f80 2023-07-06T22:01:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.379+0000 7fa5e7fff640 1 -- 172.21.15.55:0/3814918097 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v147) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5f00ee500 con 0x7fa6000b3f80 2023-07-06T22:01:52.378 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T22:01:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.379+0000 7fa605a7b640 1 -- 172.21.15.55:0/3814918097 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fa5ec066460 msgr2=0x7fa5ec068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.379+0000 7fa605a7b640 1 --2- 172.21.15.55:0/3814918097 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fa5ec066460 0x7fa5ec068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.379+0000 7fa605a7b640 1 -- 172.21.15.55:0/3814918097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6000b3f80 msgr2=0x7fa6001501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.379+0000 7fa605a7b640 1 --2- 172.21.15.55:0/3814918097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6000b3f80 0x7fa6001501c0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00097f0 tx=0x7fa5f0019110 comp rx=0 tx=0).stop 2023-07-06T22:01:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.379+0000 7fa605a7b640 1 -- 172.21.15.55:0/3814918097 shutdown_connections 2023-07-06T22:01:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.379+0000 7fa605a7b640 1 --2- 172.21.15.55:0/3814918097 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fa5ec066460 0x7fa5ec068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.379+0000 7fa605a7b640 1 --2- 172.21.15.55:0/3814918097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa60015b850 0x7fa6000b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.379+0000 7fa605a7b640 1 --2- 172.21.15.55:0/3814918097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6000ccd30 0x7fa6000b6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.379+0000 7fa605a7b640 1 --2- 172.21.15.55:0/3814918097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6000b3f80 0x7fa6001501c0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.379+0000 7fa605a7b640 1 -- 172.21.15.55:0/3814918097 >> 172.21.15.55:0/3814918097 conn(0x7fa6000cec20 msgr2=0x7fa6000b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.383+0000 7fa605a7b640 1 -- 172.21.15.55:0/3814918097 shutdown_connections 2023-07-06T22:01:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.383+0000 7fa605a7b640 1 -- 172.21.15.55:0/3814918097 wait complete. 2023-07-06T22:01:52.400 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T22:01:52.458 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:52.459+0000 7f86d0163180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:01:52.504 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:52.507+0000 7f0af03db180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:01:52.519 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:52.519+0000 7f86d0163180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:01:52.561 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:52.563+0000 7f0af03db180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:01:52.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85f1dd2640 1 Processor -- start 2023-07-06T22:01:52.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85f1dd2640 1 -- start start 2023-07-06T22:01:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85f1dd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85ec0b7b90 0x7f85ec0d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85f1dd2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f85ec0b4300 0x7f85ec0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85f1dd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ec0b5070 con 0x7f85ec0cc870 2023-07-06T22:01:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85f1dd2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ec160020 con 0x7f85ec0b7b90 2023-07-06T22:01:52.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85f1dd2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ec1604b0 con 0x7f85ec0b4300 2023-07-06T22:01:52.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85eb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85ec0b7b90 0x7f85ec0d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85eaffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f85ec0cc870 0x7f85ec0b3bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56270/0 (socket says 172.21.15.55:56270) 2023-07-06T22:01:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85eaffd640 1 -- 172.21.15.55:0/3033813074 learned_addr learned my addr 172.21.15.55:0/3033813074 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85ebfff640 1 --2- 172.21.15.55:0/3033813074 >> v2:172.21.15.138:3300/0 conn(0x7f85ec0b4300 0x7f85ec0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85eb7fe640 1 -- 172.21.15.55:0/3033813074 >> v2:172.21.15.138:3300/0 conn(0x7f85ec0b4300 msgr2=0x7f85ec0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85eb7fe640 1 --2- 172.21.15.55:0/3033813074 >> v2:172.21.15.138:3300/0 conn(0x7f85ec0b4300 0x7f85ec0b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85eb7fe640 1 -- 172.21.15.55:0/3033813074 >> v1:172.21.15.55:6789/0 conn(0x7f85ec0cc870 legacy=0x7f85ec0b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.591+0000 7f85eb7fe640 1 -- 172.21.15.55:0/3033813074 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec0cd030 con 0x7f85ec0b7b90 2023-07-06T22:01:52.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.595+0000 7f85eb7fe640 1 --2- 172.21.15.55:0/3033813074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85ec0b7b90 0x7f85ec0d1c40 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f85ec06c6a0 tx=0x7f85dc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a841526d10125449 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:52.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.595+0000 7f85ea7fc640 1 -- 172.21.15.55:0/3033813074 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0a7070 con 0x7f85ec0b7b90 2023-07-06T22:01:52.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.595+0000 7f85ea7fc640 1 -- 172.21.15.55:0/3033813074 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc0ab430 con 0x7f85ec0b7b90 2023-07-06T22:01:52.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.595+0000 7f85ea7fc640 1 -- 172.21.15.55:0/3033813074 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0ab7c0 con 0x7f85ec0b7b90 2023-07-06T22:01:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.595+0000 7f85f1dd2640 1 -- 172.21.15.55:0/3033813074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85ec0b7b90 msgr2=0x7f85ec0d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.595+0000 7f85f1dd2640 1 --2- 172.21.15.55:0/3033813074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85ec0b7b90 0x7f85ec0d1c40 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f85ec06c6a0 tx=0x7f85dc01c430 comp rx=0 tx=0).stop 2023-07-06T22:01:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85f1dd2640 1 -- 172.21.15.55:0/3033813074 shutdown_connections 2023-07-06T22:01:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85f1dd2640 1 --2- 172.21.15.55:0/3033813074 >> v2:172.21.15.138:3300/0 conn(0x7f85ec0b4300 0x7f85ec0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85f1dd2640 1 --2- 172.21.15.55:0/3033813074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85ec0b7b90 0x7f85ec0d1c40 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85f1dd2640 1 -- 172.21.15.55:0/3033813074 >> 172.21.15.55:0/3033813074 conn(0x7f85ec0ceca0 msgr2=0x7f85ec0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85f1dd2640 1 -- 172.21.15.55:0/3033813074 shutdown_connections 2023-07-06T22:01:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85f1dd2640 1 -- 172.21.15.55:0/3033813074 wait complete. 2023-07-06T22:01:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85f1dd2640 1 Processor -- start 2023-07-06T22:01:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85f1dd2640 1 -- start start 2023-07-06T22:01:52.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85f1dd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85ec0b4300 0x7f85ec14f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:52.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85f1dd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85ec0b7b90 0x7f85ec1532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:52.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85f1dd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85ec0cc870 0x7f85ec153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:52.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85f1dd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0d15b0 con 0x7f85ec0b4300 2023-07-06T22:01:52.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85f1dd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec151f50 con 0x7f85ec0b7b90 2023-07-06T22:01:52.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85f1dd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0d1800 con 0x7f85ec0cc870 2023-07-06T22:01:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85eb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85ec0b4300 0x7f85ec14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85eb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85ec0b4300 0x7f85ec14f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52022/0 (socket says 172.21.15.55:52022) 2023-07-06T22:01:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85eb7fe640 1 -- 172.21.15.55:0/2083138444 learned_addr learned my addr 172.21.15.55:0/2083138444 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85eaffd640 1 --2- 172.21.15.55:0/2083138444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85ec0b7b90 0x7f85ec1532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85ebfff640 1 --2- 172.21.15.55:0/2083138444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85ec0cc870 0x7f85ec153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85eb7fe640 1 -- 172.21.15.55:0/2083138444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85ec0cc870 msgr2=0x7f85ec153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85eb7fe640 1 --2- 172.21.15.55:0/2083138444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85ec0cc870 0x7f85ec153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85eb7fe640 1 -- 172.21.15.55:0/2083138444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85ec0b7b90 msgr2=0x7f85ec1532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85eb7fe640 1 --2- 172.21.15.55:0/2083138444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85ec0b7b90 0x7f85ec1532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85eb7fe640 1 -- 172.21.15.55:0/2083138444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc009420 con 0x7f85ec0b4300 2023-07-06T22:01:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.599+0000 7f85eaffd640 1 --2- 172.21.15.55:0/2083138444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85ec0b7b90 0x7f85ec1532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.603+0000 7f85eb7fe640 1 --2- 172.21.15.55:0/2083138444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85ec0b4300 0x7f85ec14f530 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0ad040 tx=0x7f85dc01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.603+0000 7f85d3fff640 1 -- 172.21.15.55:0/2083138444 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0bf610 con 0x7f85ec0b4300 2023-07-06T22:01:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.603+0000 7f85d3fff640 1 -- 172.21.15.55:0/2083138444 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc0bf790 con 0x7f85ec0b4300 2023-07-06T22:01:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.603+0000 7f85d3fff640 1 -- 172.21.15.55:0/2083138444 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0bfb40 con 0x7f85ec0b4300 2023-07-06T22:01:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.603+0000 7f85f1dd2640 1 -- 172.21.15.55:0/2083138444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ec0b6fa0 con 0x7f85ec0b4300 2023-07-06T22:01:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.603+0000 7f85f1dd2640 1 -- 172.21.15.55:0/2083138444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ec1507a0 con 0x7f85ec0b4300 2023-07-06T22:01:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.603+0000 7f85f1dd2640 1 -- 172.21.15.55:0/2083138444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ec150990 con 0x7f85ec0b4300 2023-07-06T22:01:52.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.603+0000 7f85d3fff640 1 -- 172.21.15.55:0/2083138444 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f85dc0b5400 con 0x7f85ec0b4300 2023-07-06T22:01:52.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.607+0000 7f85d3fff640 1 --2- 172.21.15.55:0/2083138444 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f85d8066430 0x7f85d80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:52.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.607+0000 7f85eaffd640 1 -- 172.21.15.55:0/2083138444 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f85d8066430 msgr2=0x7f85d80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/462110382 2023-07-06T22:01:52.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.607+0000 7f85d3fff640 1 -- 172.21.15.55:0/2083138444 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f85dc11eda0 con 0x7f85ec0b4300 2023-07-06T22:01:52.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.607+0000 7f85eaffd640 1 --2- 172.21.15.55:0/2083138444 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f85d8066430 0x7f85d80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:52.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.611+0000 7f85d3fff640 1 -- 172.21.15.55:0/2083138444 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85dc0ebc90 con 0x7f85ec0b4300 2023-07-06T22:01:52.681 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:52.683+0000 7f86d0163180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:01:52.744 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:52.743+0000 7f86d0163180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:01:52.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.771+0000 7f85f1dd2640 1 -- 172.21.15.55:0/2083138444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f85ec066d60 con 0x7f85ec0b4300 2023-07-06T22:01:52.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.771+0000 7f85d3fff640 1 -- 172.21.15.55:0/2083138444 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v147) v1 ==== 100+0+11 (secure 0 0 0) 0x7f85dc0ef2b0 con 0x7f85ec0b4300 2023-07-06T22:01:52.772 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T22:01:52.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.775+0000 7f85f1dd2640 1 -- 172.21.15.55:0/2083138444 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f85d8066430 msgr2=0x7f85d80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:52.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.775+0000 7f85f1dd2640 1 --2- 172.21.15.55:0/2083138444 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f85d8066430 0x7f85d80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.775+0000 7f85f1dd2640 1 -- 172.21.15.55:0/2083138444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85ec0b4300 msgr2=0x7f85ec14f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:52.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.775+0000 7f85f1dd2640 1 --2- 172.21.15.55:0/2083138444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85ec0b4300 0x7f85ec14f530 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0ad040 tx=0x7f85dc01ac70 comp rx=0 tx=0).stop 2023-07-06T22:01:52.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.775+0000 7f85f1dd2640 1 -- 172.21.15.55:0/2083138444 shutdown_connections 2023-07-06T22:01:52.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.775+0000 7f85f1dd2640 1 --2- 172.21.15.55:0/2083138444 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f85d8066430 0x7f85d80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.775+0000 7f85f1dd2640 1 --2- 172.21.15.55:0/2083138444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f85ec0cc870 0x7f85ec153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.775+0000 7f85f1dd2640 1 --2- 172.21.15.55:0/2083138444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85ec0b7b90 0x7f85ec1532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.775+0000 7f85f1dd2640 1 --2- 172.21.15.55:0/2083138444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85ec0b4300 0x7f85ec14f530 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:52.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.775+0000 7f85f1dd2640 1 -- 172.21.15.55:0/2083138444 >> 172.21.15.55:0/2083138444 conn(0x7f85ec0ceca0 msgr2=0x7f85ec0b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:52.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.775+0000 7f85f1dd2640 1 -- 172.21.15.55:0/2083138444 shutdown_connections 2023-07-06T22:01:52.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:52.775+0000 7f85f1dd2640 1 -- 172.21.15.55:0/2083138444 wait complete. 2023-07-06T22:01:52.794 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T22:01:52.801 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:01:52.801 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:01:52.801 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:01:52.809 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:52.811+0000 7f0af03db180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:01:52.942 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:52.943+0000 7f0af03db180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:01:53.003 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:01:53.003 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:01:53.003 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:01:53.012 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:53.011+0000 7f86d0163180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:01:53.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.019+0000 7f42d9ecb640 1 Processor -- start 2023-07-06T22:01:53.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.019+0000 7f42d9ecb640 1 -- start start 2023-07-06T22:01:53.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d9ecb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d40b3870 0x7f42d40b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d9ecb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f42d40d03c0 0x7f42d40d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d9ecb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d40b2b80 con 0x7f42d415b850 2023-07-06T22:01:53.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d9ecb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d40cff30 con 0x7f42d40d03c0 2023-07-06T22:01:53.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d9ecb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40b41e0 con 0x7f42d40b3870 2023-07-06T22:01:53.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d2ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d40b3870 0x7f42d40b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:53.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d3fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f42d40d03c0 0x7f42d40d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:53.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d37fe640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f42d415b850 0x7f42d40cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:40688/0 (socket says 172.21.15.55:40688) 2023-07-06T22:01:53.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d37fe640 1 -- 172.21.15.55:0/1048222832 learned_addr learned my addr 172.21.15.55:0/1048222832 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:53.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d27fc640 1 -- 172.21.15.55:0/1048222832 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431540390 0 0) 0x7f42d40b2b80 con 0x7f42d415b850 2023-07-06T22:01:53.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d27fc640 1 -- 172.21.15.55:0/1048222832 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42bc003530 con 0x7f42d415b850 2023-07-06T22:01:53.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d3fff640 1 -- 172.21.15.55:0/1048222832 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d40b3870 msgr2=0x7f42d40b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:53.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d3fff640 1 --2- 172.21.15.55:0/1048222832 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d40b3870 0x7f42d40b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d3fff640 1 -- 172.21.15.55:0/1048222832 >> v1:172.21.15.138:6789/0 conn(0x7f42d415b850 legacy=0x7f42d40cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.023+0000 7f42d3fff640 1 -- 172.21.15.55:0/1048222832 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d40b22e0 con 0x7f42d40d03c0 2023-07-06T22:01:53.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.027+0000 7f42d3fff640 1 --2- 172.21.15.55:0/1048222832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40d03c0 0x7f42d40d0820 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009d90 tx=0x7f42cc01c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29b912f744348e7e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:53.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.027+0000 7f42d27fc640 1 -- 172.21.15.55:0/1048222832 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0a58c0 con 0x7f42d40d03c0 2023-07-06T22:01:53.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.027+0000 7f42d27fc640 1 -- 172.21.15.55:0/1048222832 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc0a5a20 con 0x7f42d40d03c0 2023-07-06T22:01:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.027+0000 7f42d27fc640 1 -- 172.21.15.55:0/1048222832 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0a5db0 con 0x7f42d40d03c0 2023-07-06T22:01:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.027+0000 7f42d9ecb640 1 -- 172.21.15.55:0/1048222832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40d03c0 msgr2=0x7f42d40d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.027+0000 7f42d9ecb640 1 --2- 172.21.15.55:0/1048222832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40d03c0 0x7f42d40d0820 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009d90 tx=0x7f42cc01c800 comp rx=0 tx=0).stop 2023-07-06T22:01:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.027+0000 7f42d9ecb640 1 -- 172.21.15.55:0/1048222832 shutdown_connections 2023-07-06T22:01:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.027+0000 7f42d9ecb640 1 --2- 172.21.15.55:0/1048222832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40d03c0 0x7f42d40d0820 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.027+0000 7f42d9ecb640 1 --2- 172.21.15.55:0/1048222832 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d40b3870 0x7f42d40b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.027+0000 7f42d9ecb640 1 -- 172.21.15.55:0/1048222832 >> 172.21.15.55:0/1048222832 conn(0x7f42d40cec20 msgr2=0x7f42d40cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:53.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.027+0000 7f42d9ecb640 1 -- 172.21.15.55:0/1048222832 shutdown_connections 2023-07-06T22:01:53.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.027+0000 7f42d9ecb640 1 -- 172.21.15.55:0/1048222832 wait complete. 2023-07-06T22:01:53.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d9ecb640 1 Processor -- start 2023-07-06T22:01:53.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d9ecb640 1 -- start start 2023-07-06T22:01:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d9ecb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40b3870 0x7f42d415c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d9ecb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42d40d03c0 0x7f42d40b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d9ecb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d415b850 0x7f42d41597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d9ecb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40c9a90 con 0x7f42d40d03c0 2023-07-06T22:01:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d9ecb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40b7040 con 0x7f42d40b3870 2023-07-06T22:01:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d9ecb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40c9410 con 0x7f42d415b850 2023-07-06T22:01:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42d40d03c0 0x7f42d40b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d37fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40b3870 0x7f42d415c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42d40d03c0 0x7f42d40b62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52024/0 (socket says 172.21.15.55:52024) 2023-07-06T22:01:53.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d2ffd640 1 -- 172.21.15.55:0/2564824638 learned_addr learned my addr 172.21.15.55:0/2564824638 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:53.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d3fff640 1 --2- 172.21.15.55:0/2564824638 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d415b850 0x7f42d41597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:53.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d2ffd640 1 -- 172.21.15.55:0/2564824638 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d415b850 msgr2=0x7f42d41597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d2ffd640 1 --2- 172.21.15.55:0/2564824638 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d415b850 0x7f42d41597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d2ffd640 1 -- 172.21.15.55:0/2564824638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40b3870 msgr2=0x7f42d415c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d2ffd640 1 --2- 172.21.15.55:0/2564824638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40b3870 0x7f42d415c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d2ffd640 1 -- 172.21.15.55:0/2564824638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc009a70 con 0x7f42d40d03c0 2023-07-06T22:01:53.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d37fe640 1 --2- 172.21.15.55:0/2564824638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40b3870 0x7f42d415c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:53.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d2ffd640 1 --2- 172.21.15.55:0/2564824638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42d40d03c0 0x7f42d40b62e0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f42c800e8a0 tx=0x7f42c800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:53.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42bbfff640 1 -- 172.21.15.55:0/2564824638 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8009510 con 0x7f42d40d03c0 2023-07-06T22:01:53.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42bbfff640 1 -- 172.21.15.55:0/2564824638 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c800c940 con 0x7f42d40d03c0 2023-07-06T22:01:53.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d9ecb640 1 -- 172.21.15.55:0/2564824638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d40b6d60 con 0x7f42d40d03c0 2023-07-06T22:01:53.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42bbfff640 1 -- 172.21.15.55:0/2564824638 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c800ccb0 con 0x7f42d40d03c0 2023-07-06T22:01:53.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.031+0000 7f42d9ecb640 1 -- 172.21.15.55:0/2564824638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d40b7c10 con 0x7f42d40d03c0 2023-07-06T22:01:53.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.035+0000 7f42d9ecb640 1 -- 172.21.15.55:0/2564824638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d40c9250 con 0x7f42d40d03c0 2023-07-06T22:01:53.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.035+0000 7f42bbfff640 1 -- 172.21.15.55:0/2564824638 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f42c8013470 con 0x7f42d40d03c0 2023-07-06T22:01:53.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.035+0000 7f42bbfff640 1 --2- 172.21.15.55:0/2564824638 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f42c0066430 0x7f42c00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.035+0000 7f42d37fe640 1 -- 172.21.15.55:0/2564824638 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f42c0066430 msgr2=0x7f42c00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/462110382 2023-07-06T22:01:53.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.035+0000 7f42bbfff640 1 -- 172.21.15.55:0/2564824638 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f42c80842e0 con 0x7f42d40d03c0 2023-07-06T22:01:53.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.035+0000 7f42d37fe640 1 --2- 172.21.15.55:0/2564824638 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f42c0066430 0x7f42c00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:53.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.039+0000 7f42bbfff640 1 -- 172.21.15.55:0/2564824638 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42c8051370 con 0x7f42d40d03c0 2023-07-06T22:01:53.066 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:53.067+0000 7f0af03db180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:01:53.136 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:53.139+0000 7f0af03db180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:01:53.170 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:53.171+0000 7f86d0163180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:01:53.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.223+0000 7f42d9ecb640 1 -- 172.21.15.55:0/2564824638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f42d4066d60 con 0x7f42d40d03c0 2023-07-06T22:01:53.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.223+0000 7f42bbfff640 1 -- 172.21.15.55:0/2564824638 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v147) v1 ==== 80+0+468 (secure 0 0 0) 0x7f42c8054990 con 0x7f42d40d03c0 2023-07-06T22:01:53.224 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3374210555 2023-07-07T22:01:47.217185+0000 2023-07-06T22:01:53.224 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/206120108 2023-07-07T22:01:47.217185+0000 2023-07-06T22:01:53.224 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/206120108 2023-07-07T22:01:47.217185+0000 2023-07-06T22:01:53.224 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1122193584 2023-07-07T22:01:47.217185+0000 2023-07-06T22:01:53.224 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2036406408 2023-07-07T22:01:47.217185+0000 2023-07-06T22:01:53.224 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1372487043 2023-07-07T22:01:47.217185+0000 2023-07-06T22:01:53.225 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3843098755 2023-07-07T22:01:47.217185+0000 2023-07-06T22:01:53.225 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3618722598 2023-07-07T22:01:47.217185+0000 2023-07-06T22:01:53.225 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-07-06T22:01:53.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.227+0000 7f42d9ecb640 1 -- 172.21.15.55:0/2564824638 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f42c0066430 msgr2=0x7f42c00688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:53.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.227+0000 7f42d9ecb640 1 --2- 172.21.15.55:0/2564824638 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f42c0066430 0x7f42c00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.227+0000 7f42d9ecb640 1 -- 172.21.15.55:0/2564824638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42d40d03c0 msgr2=0x7f42d40b62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.227+0000 7f42d9ecb640 1 --2- 172.21.15.55:0/2564824638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42d40d03c0 0x7f42d40b62e0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f42c800e8a0 tx=0x7f42c800eca0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.227+0000 7f42d9ecb640 1 -- 172.21.15.55:0/2564824638 shutdown_connections 2023-07-06T22:01:53.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.227+0000 7f42d9ecb640 1 --2- 172.21.15.55:0/2564824638 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f42c0066430 0x7f42c00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.227+0000 7f42d9ecb640 1 --2- 172.21.15.55:0/2564824638 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d415b850 0x7f42d41597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.227+0000 7f42d9ecb640 1 --2- 172.21.15.55:0/2564824638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42d40d03c0 0x7f42d40b62e0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.227+0000 7f42d9ecb640 1 --2- 172.21.15.55:0/2564824638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40b3870 0x7f42d415c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.227+0000 7f42d9ecb640 1 -- 172.21.15.55:0/2564824638 >> 172.21.15.55:0/2564824638 conn(0x7f42d40cec20 msgr2=0x7f42d406aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:53.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.227+0000 7f42d9ecb640 1 -- 172.21.15.55:0/2564824638 shutdown_connections 2023-07-06T22:01:53.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.227+0000 7f42d9ecb640 1 -- 172.21.15.55:0/2564824638 wait complete. 2023-07-06T22:01:53.245 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T22:01:53.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:53.246 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-06T22:01:53.274 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:53.275+0000 7f0af03db180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:01:53.308 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T22:01:53.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:01:53.309 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T22:01:53.310 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:53.311+0000 7f86d0163180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:01:53.319 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:01:53.319 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:53.328 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:01:53.329 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:01:53.329 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:53.368 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:01:53.369 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:01:53.369 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:01:53.379 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:01:53.379 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:01:53.383 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:53.383+0000 7f86d0163180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:01:53.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.527+0000 7fecf65c5640 1 Processor -- start 2023-07-06T22:01:53.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.527+0000 7fecf65c5640 1 -- start start 2023-07-06T22:01:53.527 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:53.527+0000 7f86d0163180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:01:53.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.527+0000 7fecf65c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00712f0 0x7fecf006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.527+0000 7fecf65c5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fecf00b3730 0x7fecf00c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.527+0000 7fecf65c5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf0159cd0 con 0x7fecf00ca280 2023-07-06T22:01:53.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.527+0000 7fecf65c5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf00ca700 con 0x7fecf00b3730 2023-07-06T22:01:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.527+0000 7fecf65c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf00693f0 con 0x7fecf00712f0 2023-07-06T22:01:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.531+0000 7fecf4b62640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fecf00ca280 0x7fecf00c8520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53778/0 (socket says 172.21.15.55:53778) 2023-07-06T22:01:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.531+0000 7fecf4b62640 1 -- 172.21.15.55:0/2984716215 learned_addr learned my addr 172.21.15.55:0/2984716215 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.531+0000 7feceffff640 1 --2- 172.21.15.55:0/2984716215 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00712f0 0x7fecf006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.531+0000 7fecef7fe640 1 --2- 172.21.15.55:0/2984716215 >> v2:172.21.15.138:3300/0 conn(0x7fecf00b3730 0x7fecf00c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.531+0000 7feceeffd640 1 -- 172.21.15.55:0/2984716215 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429996509 0 0) 0x7fecf0159cd0 con 0x7fecf00ca280 2023-07-06T22:01:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.531+0000 7feceffff640 1 -- 172.21.15.55:0/2984716215 >> v2:172.21.15.138:3300/0 conn(0x7fecf00b3730 msgr2=0x7fecf00c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.531+0000 7feceffff640 1 --2- 172.21.15.55:0/2984716215 >> v2:172.21.15.138:3300/0 conn(0x7fecf00b3730 0x7fecf00c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.531+0000 7feceffff640 1 -- 172.21.15.55:0/2984716215 >> v1:172.21.15.55:6789/0 conn(0x7fecf00ca280 legacy=0x7fecf00c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.531+0000 7feceffff640 1 -- 172.21.15.55:0/2984716215 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf006aca0 con 0x7fecf00712f0 2023-07-06T22:01:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.531+0000 7fecef7fe640 1 --2- 172.21.15.55:0/2984716215 >> v2:172.21.15.138:3300/0 conn(0x7fecf00b3730 0x7fecf00c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.531+0000 7feceffff640 1 --2- 172.21.15.55:0/2984716215 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00712f0 0x7fecf006a610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fece00097c0 tx=0x7fece001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d264bebddebdc539 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7feceeffd640 1 -- 172.21.15.55:0/2984716215 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00ab600 con 0x7fecf00712f0 2023-07-06T22:01:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7feceeffd640 1 -- 172.21.15.55:0/2984716215 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece00a7050 con 0x7fecf00712f0 2023-07-06T22:01:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7feceeffd640 1 -- 172.21.15.55:0/2984716215 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00ab980 con 0x7fecf00712f0 2023-07-06T22:01:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 -- 172.21.15.55:0/2984716215 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00712f0 msgr2=0x7fecf006a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 --2- 172.21.15.55:0/2984716215 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00712f0 0x7fecf006a610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fece00097c0 tx=0x7fece001c450 comp rx=0 tx=0).stop 2023-07-06T22:01:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 -- 172.21.15.55:0/2984716215 shutdown_connections 2023-07-06T22:01:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 --2- 172.21.15.55:0/2984716215 >> v2:172.21.15.138:3300/0 conn(0x7fecf00b3730 0x7fecf00c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 --2- 172.21.15.55:0/2984716215 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00712f0 0x7fecf006a610 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 -- 172.21.15.55:0/2984716215 >> 172.21.15.55:0/2984716215 conn(0x7fecf00cded0 msgr2=0x7fecf00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 -- 172.21.15.55:0/2984716215 shutdown_connections 2023-07-06T22:01:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 -- 172.21.15.55:0/2984716215 wait complete. 2023-07-06T22:01:53.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 Processor -- start 2023-07-06T22:01:53.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 -- start start 2023-07-06T22:01:53.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecf00712f0 0x7fecf00c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf00b3730 0x7fecf0156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00ca280 0x7fecf0141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf00c6a20 con 0x7fecf00b3730 2023-07-06T22:01:53.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf00c6c30 con 0x7fecf00712f0 2023-07-06T22:01:53.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.535+0000 7fecf65c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf00c6f10 con 0x7fecf00ca280 2023-07-06T22:01:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fecef7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf00b3730 0x7fecf0156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:53.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fecef7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf00b3730 0x7fecf0156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57822/0 (socket says 172.21.15.55:57822) 2023-07-06T22:01:53.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fecef7fe640 1 -- 172.21.15.55:0/2209758752 learned_addr learned my addr 172.21.15.55:0/2209758752 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:53.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7feceffff640 1 --2- 172.21.15.55:0/2209758752 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecf00712f0 0x7fecf00c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:53.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fecf4b62640 1 --2- 172.21.15.55:0/2209758752 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00ca280 0x7fecf0141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:53.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fecef7fe640 1 -- 172.21.15.55:0/2209758752 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00ca280 msgr2=0x7fecf0141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fecef7fe640 1 --2- 172.21.15.55:0/2209758752 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00ca280 0x7fecf0141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fecef7fe640 1 -- 172.21.15.55:0/2209758752 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecf00712f0 msgr2=0x7fecf00c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fecef7fe640 1 --2- 172.21.15.55:0/2209758752 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecf00712f0 0x7fecf00c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fecef7fe640 1 -- 172.21.15.55:0/2209758752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece4009420 con 0x7fecf00b3730 2023-07-06T22:01:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fecef7fe640 1 --2- 172.21.15.55:0/2209758752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf00b3730 0x7fecf0156000 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fece400e980 tx=0x7fece400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fececff9640 1 -- 172.21.15.55:0/2209758752 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400ca00 con 0x7fecf00b3730 2023-07-06T22:01:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fececff9640 1 -- 172.21.15.55:0/2209758752 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece400cb60 con 0x7fecf00b3730 2023-07-06T22:01:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fececff9640 1 -- 172.21.15.55:0/2209758752 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece4013470 con 0x7fecf00b3730 2023-07-06T22:01:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fecf65c5640 1 -- 172.21.15.55:0/2209758752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece0009420 con 0x7fecf00b3730 2023-07-06T22:01:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fecf65c5640 1 -- 172.21.15.55:0/2209758752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf00c77b0 con 0x7fecf00b3730 2023-07-06T22:01:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fecf65c5640 1 -- 172.21.15.55:0/2209758752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf0066d60 con 0x7fecf00b3730 2023-07-06T22:01:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.539+0000 7fececff9640 1 -- 172.21.15.55:0/2209758752 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fece40135d0 con 0x7fecf00b3730 2023-07-06T22:01:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.543+0000 7fececff9640 1 --2- 172.21.15.55:0/2209758752 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fecdc06a840 0x7fecdc06ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.543+0000 7fececff9640 1 -- 172.21.15.55:0/2209758752 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fece40843a0 con 0x7fecf00b3730 2023-07-06T22:01:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.543+0000 7feceffff640 1 -- 172.21.15.55:0/2209758752 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fecdc06a840 msgr2=0x7fecdc06ccf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/462110382 2023-07-06T22:01:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.543+0000 7feceffff640 1 --2- 172.21.15.55:0/2209758752 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fecdc06a840 0x7fecdc06ccf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:53.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.547+0000 7fececff9640 1 -- 172.21.15.55:0/2209758752 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fece4051440 con 0x7fecf00b3730 2023-07-06T22:01:53.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.739+0000 7fecf65c5640 1 -- 172.21.15.55:0/2209758752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecf00c48d0 con 0x7fecf00b3730 2023-07-06T22:01:53.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.739+0000 7fececff9640 1 -- 172.21.15.55:0/2209758752 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4670 (secure 0 0 0) 0x7fece4054a60 con 0x7fecf00b3730 2023-07-06T22:01:53.737 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:53.737 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/457440874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":457440874},{"type":"v1","addr":"172.21.15.138:6834","nonce":457440874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/446729940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":446729940},{"type":"v1","addr":"172.21.15.55:6835","nonce":446729940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9189,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/742646154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":742646154},{"type":"v1","addr":"172.21.15.138:6835","nonce":742646154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:01:30.178097+0000","modified":"2023-07-06T22:01:33.205176+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9198":{"gid":9198,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/4072042723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":4072042723},{"type":"v1","addr":"172.21.15.55:6837","nonce":4072042723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-06T22:01:53.738 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 63 2023-07-06T22:01:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.739+0000 7fecf65c5640 1 -- 172.21.15.55:0/2209758752 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fecdc06a840 msgr2=0x7fecdc06ccf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.739+0000 7fecf65c5640 1 --2- 172.21.15.55:0/2209758752 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fecdc06a840 0x7fecdc06ccf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.739+0000 7fecf65c5640 1 -- 172.21.15.55:0/2209758752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf00b3730 msgr2=0x7fecf0156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.739+0000 7fecf65c5640 1 --2- 172.21.15.55:0/2209758752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf00b3730 0x7fecf0156000 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fece400e980 tx=0x7fece400ee40 comp rx=0 tx=0).stop 2023-07-06T22:01:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.739+0000 7fecf65c5640 1 -- 172.21.15.55:0/2209758752 shutdown_connections 2023-07-06T22:01:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.739+0000 7fecf65c5640 1 --2- 172.21.15.55:0/2209758752 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7fecdc06a840 0x7fecdc06ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.739+0000 7fecf65c5640 1 --2- 172.21.15.55:0/2209758752 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecf00ca280 0x7fecf0141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.739+0000 7fecf65c5640 1 --2- 172.21.15.55:0/2209758752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecf00b3730 0x7fecf0156000 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.739+0000 7fecf65c5640 1 --2- 172.21.15.55:0/2209758752 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecf00712f0 0x7fecf00c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.739+0000 7fecf65c5640 1 -- 172.21.15.55:0/2209758752 >> 172.21.15.55:0/2209758752 conn(0x7fecf00cded0 msgr2=0x7fecf00c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.739+0000 7fecf65c5640 1 -- 172.21.15.55:0/2209758752 shutdown_connections 2023-07-06T22:01:53.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.739+0000 7fecf65c5640 1 -- 172.21.15.55:0/2209758752 wait complete. 2023-07-06T22:01:53.759 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:01:53.809 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:53.811+0000 7f0af03db180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:01:53.895 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:53.899+0000 7f0af03db180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:01:53.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f06161a3640 1 Processor -- start 2023-07-06T22:01:53.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f06161a3640 1 -- start start 2023-07-06T22:01:53.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f06161a3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f06100712f0 0x7f061006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f06161a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0610159cd0 con 0x7f06100ca450 2023-07-06T22:01:53.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f06161a3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06100693f0 con 0x7f06100b3730 2023-07-06T22:01:53.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f06161a3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061006aca0 con 0x7f06100712f0 2023-07-06T22:01:53.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f060ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f06100ca450 0x7f061015d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53790/0 (socket says 172.21.15.55:53790) 2023-07-06T22:01:53.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f060ffff640 1 -- 172.21.15.55:0/3206641344 learned_addr learned my addr 172.21.15.55:0/3206641344 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:53.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f060f7fe640 1 --2- 172.21.15.55:0/3206641344 >> v2:172.21.15.138:3300/0 conn(0x7f06100712f0 0x7f061006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:53.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f060e7fc640 1 -- 172.21.15.55:0/3206641344 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830436012 0 0) 0x7f0610159cd0 con 0x7f06100ca450 2023-07-06T22:01:53.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f060e7fc640 1 -- 172.21.15.55:0/3206641344 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05f8003530 con 0x7f06100ca450 2023-07-06T22:01:53.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f060e7fc640 1 -- 172.21.15.55:0/3206641344 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734491714 0 0) 0x7f06100693f0 con 0x7f06100b3730 2023-07-06T22:01:53.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f060e7fc640 1 -- 172.21.15.55:0/3206641344 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0610159cd0 con 0x7f06100b3730 2023-07-06T22:01:53.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f060f7fe640 1 -- 172.21.15.55:0/3206641344 >> v1:172.21.15.138:6789/0 conn(0x7f06100b3730 legacy=0x7f06100c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f060f7fe640 1 -- 172.21.15.55:0/3206641344 >> v1:172.21.15.55:6789/0 conn(0x7f06100ca450 legacy=0x7f061015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f060e7fc640 1 -- 172.21.15.55:0/3206641344 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3126057698 0 0) 0x7f05f8003530 con 0x7f06100ca450 2023-07-06T22:01:53.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.911+0000 7f060f7fe640 1 -- 172.21.15.55:0/3206641344 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06100696b0 con 0x7f06100712f0 2023-07-06T22:01:53.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.915+0000 7f060f7fe640 1 --2- 172.21.15.55:0/3206641344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06100712f0 0x7f061006a610 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f06000097c0 tx=0x7f060001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3041b58312e135aa server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:53.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.915+0000 7f060e7fc640 1 -- 172.21.15.55:0/3206641344 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0608001a00 con 0x7f06100712f0 2023-07-06T22:01:53.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.915+0000 7f060e7fc640 1 -- 172.21.15.55:0/3206641344 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06000a7050 con 0x7f06100712f0 2023-07-06T22:01:53.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.915+0000 7f060e7fc640 1 -- 172.21.15.55:0/3206641344 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000ab620 con 0x7f06100712f0 2023-07-06T22:01:53.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.915+0000 7f06161a3640 1 -- 172.21.15.55:0/3206641344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06100712f0 msgr2=0x7f061006a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.915+0000 7f06161a3640 1 --2- 172.21.15.55:0/3206641344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06100712f0 0x7f061006a610 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f06000097c0 tx=0x7f060001c370 comp rx=0 tx=0).stop 2023-07-06T22:01:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.915+0000 7f06161a3640 1 -- 172.21.15.55:0/3206641344 shutdown_connections 2023-07-06T22:01:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.915+0000 7f06161a3640 1 --2- 172.21.15.55:0/3206641344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06100712f0 0x7f061006a610 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.915+0000 7f06161a3640 1 -- 172.21.15.55:0/3206641344 >> 172.21.15.55:0/3206641344 conn(0x7f06100cded0 msgr2=0x7f06100ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.915+0000 7f06161a3640 1 -- 172.21.15.55:0/3206641344 shutdown_connections 2023-07-06T22:01:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.915+0000 7f06161a3640 1 -- 172.21.15.55:0/3206641344 wait complete. 2023-07-06T22:01:53.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f06161a3640 1 Processor -- start 2023-07-06T22:01:53.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f06161a3640 1 -- start start 2023-07-06T22:01:53.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f06161a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06100712f0 0x7f0610153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f06161a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06100b3730 0x7f0610156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f06161a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06100ca450 0x7f06101573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f06161a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0610153650 con 0x7f06100712f0 2023-07-06T22:01:53.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f06161a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06101f7450 con 0x7f06100ca450 2023-07-06T22:01:53.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f06161a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06101f82b0 con 0x7f06100b3730 2023-07-06T22:01:53.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f060f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06100712f0 0x7f0610153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:53.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f060f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06100712f0 0x7f0610153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57832/0 (socket says 172.21.15.55:57832) 2023-07-06T22:01:53.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f060f7fe640 1 -- 172.21.15.55:0/1323330276 learned_addr learned my addr 172.21.15.55:0/1323330276 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:53.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f060ffff640 1 --2- 172.21.15.55:0/1323330276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06100ca450 0x7f06101573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:53.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f060effd640 1 --2- 172.21.15.55:0/1323330276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06100b3730 0x7f0610156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:53.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f060f7fe640 1 -- 172.21.15.55:0/1323330276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06100b3730 msgr2=0x7f0610156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f060f7fe640 1 --2- 172.21.15.55:0/1323330276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06100b3730 0x7f0610156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f060f7fe640 1 -- 172.21.15.55:0/1323330276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06100ca450 msgr2=0x7f06101573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:53.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f060f7fe640 1 --2- 172.21.15.55:0/1323330276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06100ca450 0x7f06101573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:53.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f060f7fe640 1 -- 172.21.15.55:0/1323330276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600009420 con 0x7f06100712f0 2023-07-06T22:01:53.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f060effd640 1 --2- 172.21.15.55:0/1323330276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06100b3730 0x7f0610156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:53.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f060f7fe640 1 --2- 172.21.15.55:0/1323330276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06100712f0 0x7f0610153110 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f06000097c0 tx=0x7f0600019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:53.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f05f7fff640 1 -- 172.21.15.55:0/1323330276 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000bb070 con 0x7f06100712f0 2023-07-06T22:01:53.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f05f7fff640 1 -- 172.21.15.55:0/1323330276 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06000a4e90 con 0x7f06100712f0 2023-07-06T22:01:53.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f06161a3640 1 -- 172.21.15.55:0/1323330276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06101f76a0 con 0x7f06100712f0 2023-07-06T22:01:53.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f05f7fff640 1 -- 172.21.15.55:0/1323330276 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600004020 con 0x7f06100712f0 2023-07-06T22:01:53.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.919+0000 7f06161a3640 1 -- 172.21.15.55:0/1323330276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06101f7c60 con 0x7f06100712f0 2023-07-06T22:01:53.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.923+0000 7f06161a3640 1 -- 172.21.15.55:0/1323330276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0610066d60 con 0x7f06100712f0 2023-07-06T22:01:53.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.923+0000 7f05f7fff640 1 -- 172.21.15.55:0/1323330276 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f06000b2040 con 0x7f06100712f0 2023-07-06T22:01:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.923+0000 7f05f7fff640 1 --2- 172.21.15.55:0/1323330276 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f05fc066430 0x7f05fc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.923+0000 7f05f7fff640 1 -- 172.21.15.55:0/1323330276 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f060011d930 con 0x7f06100712f0 2023-07-06T22:01:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.923+0000 7f060effd640 1 -- 172.21.15.55:0/1323330276 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f05fc066430 msgr2=0x7f05fc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/462110382 2023-07-06T22:01:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.923+0000 7f060effd640 1 --2- 172.21.15.55:0/1323330276 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f05fc066430 0x7f05fc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:53.927+0000 7f05f7fff640 1 -- 172.21.15.55:0/1323330276 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06000ea7e0 con 0x7f06100712f0 2023-07-06T22:01:54.043 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:54.047+0000 7f0af03db180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:01:54.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.083+0000 7f06161a3640 1 -- 172.21.15.55:0/1323330276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06100c9f30 con 0x7f06100712f0 2023-07-06T22:01:54.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.087+0000 7f05f7fff640 1 -- 172.21.15.55:0/1323330276 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+19097 (secure 0 0 0) 0x7f06000ede00 con 0x7f06100712f0 2023-07-06T22:01:54.086 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:54.086 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":147,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:01:47.217257+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:01:28.023569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-07-06T22:01:29.170296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3374210555":"2023-07-07T22:01:47.217185+0000","172.21.15.55:6833/206120108":"2023-07-07T22:01:47.217185+0000","172.21.15.55:6832/206120108":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/1122193584":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/2036406408":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/1372487043":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/3843098755":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/3618722598":"2023-07-07T22:01:47.217185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:01:54.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.087+0000 7f06161a3640 1 -- 172.21.15.55:0/1323330276 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f05fc066430 msgr2=0x7f05fc0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:54.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.087+0000 7f06161a3640 1 --2- 172.21.15.55:0/1323330276 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f05fc066430 0x7f05fc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.087+0000 7f06161a3640 1 -- 172.21.15.55:0/1323330276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06100712f0 msgr2=0x7f0610153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.087+0000 7f06161a3640 1 --2- 172.21.15.55:0/1323330276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06100712f0 0x7f0610153110 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f06000097c0 tx=0x7f0600019110 comp rx=0 tx=0).stop 2023-07-06T22:01:54.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.087+0000 7f06161a3640 1 -- 172.21.15.55:0/1323330276 shutdown_connections 2023-07-06T22:01:54.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.087+0000 7f06161a3640 1 --2- 172.21.15.55:0/1323330276 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f05fc066430 0x7f05fc0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.087+0000 7f06161a3640 1 --2- 172.21.15.55:0/1323330276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06100ca450 0x7f06101573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.087+0000 7f06161a3640 1 --2- 172.21.15.55:0/1323330276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06100b3730 0x7f0610156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.087+0000 7f06161a3640 1 --2- 172.21.15.55:0/1323330276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06100712f0 0x7f0610153110 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.087+0000 7f06161a3640 1 -- 172.21.15.55:0/1323330276 >> 172.21.15.55:0/1323330276 conn(0x7f06100cded0 msgr2=0x7f061015d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:54.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.087+0000 7f06161a3640 1 -- 172.21.15.55:0/1323330276 shutdown_connections 2023-07-06T22:01:54.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.087+0000 7f06161a3640 1 -- 172.21.15.55:0/1323330276 wait complete. 2023-07-06T22:01:54.108 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T22:01:28.023569+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T22:01:29.170296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:01:54.109 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:01:54.115 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.115+0000 7f86d0163180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:01:54.125 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:54.127+0000 7f0af03db180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:01:54.209 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.211+0000 7f86d0163180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:01:54.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.259+0000 7f9fb3f96640 1 Processor -- start 2023-07-06T22:01:54.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.259+0000 7f9fb3f96640 1 -- start start 2023-07-06T22:01:54.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.263+0000 7f9fb3f96640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9fac15b850 0x7f9fac0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.263+0000 7f9fb3f96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9fac0ccd30 0x7f9fac0b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.263+0000 7f9fb3f96640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fac0b2b80 con 0x7f9fac0b3db0 2023-07-06T22:01:54.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.263+0000 7f9fb3f96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac0cff30 con 0x7f9fac0ccd30 2023-07-06T22:01:54.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.263+0000 7f9fb3f96640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac0b41d0 con 0x7f9fac15b850 2023-07-06T22:01:54.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.263+0000 7f9fb1531640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9fac0ccd30 0x7f9fac0b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.263+0000 7f9fb2533640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9fac0b3db0 0x7f9fac15f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53804/0 (socket says 172.21.15.55:53804) 2023-07-06T22:01:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.263+0000 7f9fb2533640 1 -- 172.21.15.55:0/947084653 learned_addr learned my addr 172.21.15.55:0/947084653 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.263+0000 7f9fb1d32640 1 --2- 172.21.15.55:0/947084653 >> v2:172.21.15.138:3300/0 conn(0x7f9fac15b850 0x7f9fac0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.263+0000 7f9fb1531640 1 -- 172.21.15.55:0/947084653 >> v2:172.21.15.138:3300/0 conn(0x7f9fac15b850 msgr2=0x7f9fac0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.263+0000 7f9fb1531640 1 --2- 172.21.15.55:0/947084653 >> v2:172.21.15.138:3300/0 conn(0x7f9fac15b850 0x7f9fac0cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.263+0000 7f9fb1531640 1 -- 172.21.15.55:0/947084653 >> v1:172.21.15.55:6789/0 conn(0x7f9fac0b3db0 legacy=0x7f9fac15f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.263+0000 7f9fb1531640 1 -- 172.21.15.55:0/947084653 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac0b22e0 con 0x7f9fac0ccd30 2023-07-06T22:01:54.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.263+0000 7f9fb0d30640 1 -- 172.21.15.55:0/947084653 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851436634 0 0) 0x7f9fac0b2b80 con 0x7f9fac0b3db0 2023-07-06T22:01:54.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.267+0000 7f9fb1531640 1 --2- 172.21.15.55:0/947084653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fac0ccd30 0x7f9fac0b3870 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0b48d0 tx=0x7f9f9c01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8974bd207979b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:54.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.267+0000 7f9fb0d30640 1 -- 172.21.15.55:0/947084653 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c0ac640 con 0x7f9fac0ccd30 2023-07-06T22:01:54.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.267+0000 7f9fb0d30640 1 -- 172.21.15.55:0/947084653 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c0ac7a0 con 0x7f9fac0ccd30 2023-07-06T22:01:54.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.267+0000 7f9fb0d30640 1 -- 172.21.15.55:0/947084653 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c0acb30 con 0x7f9fac0ccd30 2023-07-06T22:01:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.267+0000 7f9fb3f96640 1 -- 172.21.15.55:0/947084653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fac0ccd30 msgr2=0x7f9fac0b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.267+0000 7f9fb3f96640 1 --2- 172.21.15.55:0/947084653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fac0ccd30 0x7f9fac0b3870 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0b48d0 tx=0x7f9f9c01c310 comp rx=0 tx=0).stop 2023-07-06T22:01:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.267+0000 7f9fb3f96640 1 -- 172.21.15.55:0/947084653 shutdown_connections 2023-07-06T22:01:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.267+0000 7f9fb3f96640 1 --2- 172.21.15.55:0/947084653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fac0ccd30 0x7f9fac0b3870 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.267+0000 7f9fb3f96640 1 --2- 172.21.15.55:0/947084653 >> v2:172.21.15.138:3300/0 conn(0x7f9fac15b850 0x7f9fac0cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.267+0000 7f9fb3f96640 1 -- 172.21.15.55:0/947084653 >> 172.21.15.55:0/947084653 conn(0x7f9fac0cec20 msgr2=0x7f9fac0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.267+0000 7f9fb3f96640 1 -- 172.21.15.55:0/947084653 shutdown_connections 2023-07-06T22:01:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.267+0000 7f9fb3f96640 1 -- 172.21.15.55:0/947084653 wait complete. 2023-07-06T22:01:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.267+0000 7f9fb3f96640 1 Processor -- start 2023-07-06T22:01:54.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.267+0000 7f9fb3f96640 1 -- start start 2023-07-06T22:01:54.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb3f96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fac0b3db0 0x7f9fac0c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb3f96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9fac0ccd30 0x7f9fac1f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb3f96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fac15b850 0x7f9fac1f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb3f96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1f49d0 con 0x7f9fac15b850 2023-07-06T22:01:54.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb3f96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1f4cb0 con 0x7f9fac0b3db0 2023-07-06T22:01:54.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb3f96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac13eea0 con 0x7f9fac0ccd30 2023-07-06T22:01:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb2533640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fac15b850 0x7f9fac1f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb2533640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fac15b850 0x7f9fac1f43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57848/0 (socket says 172.21.15.55:57848) 2023-07-06T22:01:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb2533640 1 -- 172.21.15.55:0/1236066563 learned_addr learned my addr 172.21.15.55:0/1236066563 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb1d32640 1 --2- 172.21.15.55:0/1236066563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fac0b3db0 0x7f9fac0c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb1531640 1 --2- 172.21.15.55:0/1236066563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9fac0ccd30 0x7f9fac1f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb2533640 1 -- 172.21.15.55:0/1236066563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9fac0ccd30 msgr2=0x7f9fac1f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb2533640 1 --2- 172.21.15.55:0/1236066563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9fac0ccd30 0x7f9fac1f3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb2533640 1 -- 172.21.15.55:0/1236066563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fac0b3db0 msgr2=0x7f9fac0c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb2533640 1 --2- 172.21.15.55:0/1236066563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fac0b3db0 0x7f9fac0c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb2533640 1 -- 172.21.15.55:0/1236066563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c009420 con 0x7f9fac15b850 2023-07-06T22:01:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb2533640 1 --2- 172.21.15.55:0/1236066563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fac15b850 0x7f9fac1f43f0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400cbf0 tx=0x7f9fa400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fa27fc640 1 -- 172.21.15.55:0/1236066563 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4004dd0 con 0x7f9fac15b850 2023-07-06T22:01:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fa27fc640 1 -- 172.21.15.55:0/1236066563 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa400ab40 con 0x7f9fac15b850 2023-07-06T22:01:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fa27fc640 1 -- 172.21.15.55:0/1236066563 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40070d0 con 0x7f9fac15b850 2023-07-06T22:01:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb3f96640 1 -- 172.21.15.55:0/1236066563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac15bda0 con 0x7f9fac15b850 2023-07-06T22:01:54.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb3f96640 1 -- 172.21.15.55:0/1236066563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac15ac40 con 0x7f9fac15b850 2023-07-06T22:01:54.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.271+0000 7f9fb3f96640 1 -- 172.21.15.55:0/1236066563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fac066d60 con 0x7f9fac15b850 2023-07-06T22:01:54.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.275+0000 7f9fa27fc640 1 -- 172.21.15.55:0/1236066563 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f9fa4007230 con 0x7f9fac15b850 2023-07-06T22:01:54.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.275+0000 7f9fa27fc640 1 --2- 172.21.15.55:0/1236066563 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f9f90066430 0x7f9f900688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.275+0000 7f9fb1d32640 1 -- 172.21.15.55:0/1236066563 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f9f90066430 msgr2=0x7f9f900688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/462110382 2023-07-06T22:01:54.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.275+0000 7f9fa27fc640 1 -- 172.21.15.55:0/1236066563 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f9fa4083b30 con 0x7f9fac15b850 2023-07-06T22:01:54.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.275+0000 7f9fb1d32640 1 --2- 172.21.15.55:0/1236066563 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f9f90066430 0x7f9f900688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:54.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.279+0000 7f9fa27fc640 1 -- 172.21.15.55:0/1236066563 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9fa4050c60 con 0x7f9fac15b850 2023-07-06T22:01:54.372 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.371+0000 7f86d0163180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:01:54.397 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:54.399+0000 7f0af03db180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:01:54.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.435+0000 7f9fb3f96640 1 -- 172.21.15.55:0/1236066563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9fac13f350 con 0x7f9fac15b850 2023-07-06T22:01:54.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.435+0000 7f9fa27fc640 1 -- 172.21.15.55:0/1236066563 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v147) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9fa4018020 con 0x7f9fac15b850 2023-07-06T22:01:54.434 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:01:54.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.435+0000 7f9fb3f96640 1 -- 172.21.15.55:0/1236066563 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f9f90066430 msgr2=0x7f9f900688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:54.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.435+0000 7f9fb3f96640 1 --2- 172.21.15.55:0/1236066563 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f9f90066430 0x7f9f900688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.435+0000 7f9fb3f96640 1 -- 172.21.15.55:0/1236066563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fac15b850 msgr2=0x7f9fac1f43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.435+0000 7f9fb3f96640 1 --2- 172.21.15.55:0/1236066563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fac15b850 0x7f9fac1f43f0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400cbf0 tx=0x7f9fa400a430 comp rx=0 tx=0).stop 2023-07-06T22:01:54.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.435+0000 7f9fb3f96640 1 -- 172.21.15.55:0/1236066563 shutdown_connections 2023-07-06T22:01:54.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.435+0000 7f9fb3f96640 1 --2- 172.21.15.55:0/1236066563 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f9f90066430 0x7f9f900688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.435+0000 7f9fb3f96640 1 --2- 172.21.15.55:0/1236066563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fac15b850 0x7f9fac1f43f0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.435+0000 7f9fb3f96640 1 --2- 172.21.15.55:0/1236066563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9fac0ccd30 0x7f9fac1f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.435+0000 7f9fb3f96640 1 --2- 172.21.15.55:0/1236066563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fac0b3db0 0x7f9fac0c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.435+0000 7f9fb3f96640 1 -- 172.21.15.55:0/1236066563 >> 172.21.15.55:0/1236066563 conn(0x7f9fac0cec20 msgr2=0x7f9fac06abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:54.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.435+0000 7f9fb3f96640 1 -- 172.21.15.55:0/1236066563 shutdown_connections 2023-07-06T22:01:54.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.435+0000 7f9fb3f96640 1 -- 172.21.15.55:0/1236066563 wait complete. 2023-07-06T22:01:54.455 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:01:54.456 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:01:54.459+0000 7f0af03db180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:01:54.462 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.463+0000 7f86d0163180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:01:54.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c2ecf9640 1 Processor -- start 2023-07-06T22:01:54.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c2ecf9640 1 -- start start 2023-07-06T22:01:54.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c2ecf9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c2815b850 0x7f2c280cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c2ecf9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2c280ccd30 0x7f2c280b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c2ecf9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c280b2b80 con 0x7f2c280b3db0 2023-07-06T22:01:54.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c2ecf9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c280cff30 con 0x7f2c2815b850 2023-07-06T22:01:54.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c2ecf9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c280b41d0 con 0x7f2c280ccd30 2023-07-06T22:01:54.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c2ca95640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c2815b850 0x7f2c280cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c2ca95640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c2815b850 0x7f2c280cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57864/0 (socket says 172.21.15.55:57864) 2023-07-06T22:01:54.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c2ca95640 1 -- 172.21.15.55:0/1748410632 learned_addr learned my addr 172.21.15.55:0/1748410632 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:54.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c27fff640 1 --2- 172.21.15.55:0/1748410632 >> v2:172.21.15.138:3300/0 conn(0x7f2c280ccd30 0x7f2c280b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c2ca95640 1 -- 172.21.15.55:0/1748410632 >> v2:172.21.15.138:3300/0 conn(0x7f2c280ccd30 msgr2=0x7f2c280b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:54.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c2ca95640 1 --2- 172.21.15.55:0/1748410632 >> v2:172.21.15.138:3300/0 conn(0x7f2c280ccd30 0x7f2c280b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c2ca95640 1 -- 172.21.15.55:0/1748410632 >> v1:172.21.15.55:6789/0 conn(0x7f2c280b3db0 legacy=0x7f2c2815f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.611+0000 7f2c2ca95640 1 -- 172.21.15.55:0/1748410632 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c280b22e0 con 0x7f2c2815b850 2023-07-06T22:01:54.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.615+0000 7f2c2ca95640 1 --2- 172.21.15.55:0/1748410632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c2815b850 0x7f2c280cc7f0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f2c280cebd0 tx=0x7f2c1c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4fd8b968fe0114 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:54.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.615+0000 7f2c277fe640 1 -- 172.21.15.55:0/1748410632 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c0ac410 con 0x7f2c2815b850 2023-07-06T22:01:54.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.615+0000 7f2c277fe640 1 -- 172.21.15.55:0/1748410632 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c0ac570 con 0x7f2c2815b850 2023-07-06T22:01:54.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.615+0000 7f2c277fe640 1 -- 172.21.15.55:0/1748410632 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c0ac900 con 0x7f2c2815b850 2023-07-06T22:01:54.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.615+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/1748410632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c2815b850 msgr2=0x7f2c280cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.615+0000 7f2c2ecf9640 1 --2- 172.21.15.55:0/1748410632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c2815b850 0x7f2c280cc7f0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f2c280cebd0 tx=0x7f2c1c01c3b0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.615+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/1748410632 shutdown_connections 2023-07-06T22:01:54.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.615+0000 7f2c2ecf9640 1 --2- 172.21.15.55:0/1748410632 >> v2:172.21.15.138:3300/0 conn(0x7f2c280ccd30 0x7f2c280b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.615+0000 7f2c2ecf9640 1 --2- 172.21.15.55:0/1748410632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c2815b850 0x7f2c280cc7f0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.615+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/1748410632 >> 172.21.15.55:0/1748410632 conn(0x7f2c280cec20 msgr2=0x7f2c280cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:54.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.615+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/1748410632 shutdown_connections 2023-07-06T22:01:54.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.615+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/1748410632 wait complete. 2023-07-06T22:01:54.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c2ecf9640 1 Processor -- start 2023-07-06T22:01:54.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c2ecf9640 1 -- start start 2023-07-06T22:01:54.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c2ecf9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2c280b3db0 0x7f2c281566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c2ecf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c280ccd30 0x7f2c28151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c2ecf9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c2815b850 0x7f2c281523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c2ecf9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2815e430 con 0x7f2c280ccd30 2023-07-06T22:01:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c2ecf9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2815ebb0 con 0x7f2c2815b850 2023-07-06T22:01:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c2ecf9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2815ee90 con 0x7f2c280b3db0 2023-07-06T22:01:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c27fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c280ccd30 0x7f2c28151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c27fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c280ccd30 0x7f2c28151e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57876/0 (socket says 172.21.15.55:57876) 2023-07-06T22:01:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c27fff640 1 -- 172.21.15.55:0/2980599382 learned_addr learned my addr 172.21.15.55:0/2980599382 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:54.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c2ca95640 1 --2- 172.21.15.55:0/2980599382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2c280b3db0 0x7f2c281566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c2d296640 1 --2- 172.21.15.55:0/2980599382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c2815b850 0x7f2c281523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c27fff640 1 -- 172.21.15.55:0/2980599382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2c280b3db0 msgr2=0x7f2c281566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c27fff640 1 --2- 172.21.15.55:0/2980599382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2c280b3db0 0x7f2c281566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c27fff640 1 -- 172.21.15.55:0/2980599382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c2815b850 msgr2=0x7f2c281523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c27fff640 1 --2- 172.21.15.55:0/2980599382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c2815b850 0x7f2c281523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c27fff640 1 -- 172.21.15.55:0/2980599382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c0094d0 con 0x7f2c280ccd30 2023-07-06T22:01:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c2d296640 1 --2- 172.21.15.55:0/2980599382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c2815b850 0x7f2c281523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.619+0000 7f2c27fff640 1 --2- 172.21.15.55:0/2980599382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c280ccd30 0x7f2c28151e70 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400d800 tx=0x7f2c1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.623+0000 7f2c257fa640 1 -- 172.21.15.55:0/2980599382 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1400b6c0 con 0x7f2c280ccd30 2023-07-06T22:01:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.623+0000 7f2c257fa640 1 -- 172.21.15.55:0/2980599382 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1400b820 con 0x7f2c280ccd30 2023-07-06T22:01:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.623+0000 7f2c257fa640 1 -- 172.21.15.55:0/2980599382 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1400bb90 con 0x7f2c280ccd30 2023-07-06T22:01:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.623+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/2980599382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2815bda0 con 0x7f2c280ccd30 2023-07-06T22:01:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.623+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/2980599382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2815dc30 con 0x7f2c280ccd30 2023-07-06T22:01:54.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.623+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/2980599382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c28066d60 con 0x7f2c280ccd30 2023-07-06T22:01:54.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.623+0000 7f2c257fa640 1 -- 172.21.15.55:0/2980599382 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f2c1400bcf0 con 0x7f2c280ccd30 2023-07-06T22:01:54.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.627+0000 7f2c257fa640 1 --2- 172.21.15.55:0/2980599382 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f2c0c066430 0x7f2c0c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.627+0000 7f2c2ca95640 1 -- 172.21.15.55:0/2980599382 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f2c0c066430 msgr2=0x7f2c0c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/462110382 2023-07-06T22:01:54.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.627+0000 7f2c257fa640 1 -- 172.21.15.55:0/2980599382 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f2c14084920 con 0x7f2c280ccd30 2023-07-06T22:01:54.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.627+0000 7f2c2ca95640 1 --2- 172.21.15.55:0/2980599382 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f2c0c066430 0x7f2c0c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:01:54.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.631+0000 7f2c257fa640 1 -- 172.21.15.55:0/2980599382 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2c140517c0 con 0x7f2c280ccd30 2023-07-06T22:01:54.759 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.759+0000 7f86d0163180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:01:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.787+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/2980599382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2c280b3420 con 0x7f2c280ccd30 2023-07-06T22:01:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.791+0000 7f2c257fa640 1 -- 172.21.15.55:0/2980599382 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v147) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2c14054de0 con 0x7f2c280ccd30 2023-07-06T22:01:54.789 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:01:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.791+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/2980599382 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f2c0c066430 msgr2=0x7f2c0c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:01:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.791+0000 7f2c2ecf9640 1 --2- 172.21.15.55:0/2980599382 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f2c0c066430 0x7f2c0c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.791+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/2980599382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c280ccd30 msgr2=0x7f2c28151e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.791+0000 7f2c2ecf9640 1 --2- 172.21.15.55:0/2980599382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c280ccd30 0x7f2c28151e70 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400d800 tx=0x7f2c1400dcc0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.791+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/2980599382 shutdown_connections 2023-07-06T22:01:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.791+0000 7f2c2ecf9640 1 --2- 172.21.15.55:0/2980599382 >> [v2:172.21.15.55:6832/462110382,v1:172.21.15.55:6833/462110382] conn(0x7f2c0c066430 0x7f2c0c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.791+0000 7f2c2ecf9640 1 --2- 172.21.15.55:0/2980599382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c2815b850 0x7f2c281523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.791+0000 7f2c2ecf9640 1 --2- 172.21.15.55:0/2980599382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c280ccd30 0x7f2c28151e70 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.791+0000 7f2c2ecf9640 1 --2- 172.21.15.55:0/2980599382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2c280b3db0 0x7f2c281566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.791+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/2980599382 >> 172.21.15.55:0/2980599382 conn(0x7f2c280cec20 msgr2=0x7f2c280b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.791+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/2980599382 shutdown_connections 2023-07-06T22:01:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.791+0000 7f2c2ecf9640 1 -- 172.21.15.55:0/2980599382 wait complete. 2023-07-06T22:01:54.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T22:01:54.825 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.827+0000 7f86d0163180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:01:54.907 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.907+0000 7f865c2e4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:54.907 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.907+0000 7f865c2e4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:54.907 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.907+0000 7f865c2e4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:54.907 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.907+0000 7f865c2e4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:54.907 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.907+0000 7f865c2e4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:54.908 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.907+0000 7f8658add640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:54.908 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.907+0000 7f8658add640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:54.908 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.907+0000 7f8658add640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:54.908 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.907+0000 7f8658add640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:54.909 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:01:54.907+0000 7f8658add640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:01:54.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.983+0000 7f8504048640 1 Processor -- start 2023-07-06T22:01:54.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.983+0000 7f8504048640 1 -- start start 2023-07-06T22:01:54.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.983+0000 7f8504048640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84fc158850 0x7f84fc0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.983+0000 7f8504048640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84fc070af0 0x7f84fc0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.983+0000 7f8504048640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84fc158c20 con 0x7f84fc0ca130 2023-07-06T22:01:54.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.983+0000 7f8504048640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84fc0b2aa0 con 0x7f84fc070af0 2023-07-06T22:01:54.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.983+0000 7f8504048640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc0c8db0 con 0x7f84fc158850 2023-07-06T22:01:54.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.983+0000 7f85025e5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84fc070af0 0x7f84fc0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.983+0000 7f85015e3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f84fc0ca130 0x7f84fc0703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53832/0 (socket says 172.21.15.55:53832) 2023-07-06T22:01:54.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.983+0000 7f85015e3640 1 -- 172.21.15.55:0/1027022488 learned_addr learned my addr 172.21.15.55:0/1027022488 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:54.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.983+0000 7f8501de4640 1 --2- 172.21.15.55:0/1027022488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84fc158850 0x7f84fc0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.987+0000 7f8501de4640 1 -- 172.21.15.55:0/1027022488 >> v2:172.21.15.55:3300/0 conn(0x7f84fc070af0 msgr2=0x7f84fc0ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:54.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.987+0000 7f8501de4640 1 --2- 172.21.15.55:0/1027022488 >> v2:172.21.15.55:3300/0 conn(0x7f84fc070af0 0x7f84fc0ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.987+0000 7f8501de4640 1 -- 172.21.15.55:0/1027022488 >> v1:172.21.15.55:6789/0 conn(0x7f84fc0ca130 legacy=0x7f84fc0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.987+0000 7f8501de4640 1 -- 172.21.15.55:0/1027022488 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc0c9090 con 0x7f84fc158850 2023-07-06T22:01:54.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.987+0000 7f85025e5640 1 --2- 172.21.15.55:0/1027022488 >> v2:172.21.15.55:3300/0 conn(0x7f84fc070af0 0x7f84fc0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:01:54.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.987+0000 7f8501de4640 1 --2- 172.21.15.55:0/1027022488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84fc158850 0x7f84fc0cca30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f84f80097c0 tx=0x7f84f801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=322380d0292e62da server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:54.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.987+0000 7f8500de2640 1 -- 172.21.15.55:0/1027022488 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80a8970 con 0x7f84fc158850 2023-07-06T22:01:54.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.987+0000 7f8500de2640 1 -- 172.21.15.55:0/1027022488 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f80a8ad0 con 0x7f84fc158850 2023-07-06T22:01:54.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.987+0000 7f8500de2640 1 -- 172.21.15.55:0/1027022488 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80a8e60 con 0x7f84fc158850 2023-07-06T22:01:54.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 -- 172.21.15.55:0/1027022488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84fc158850 msgr2=0x7f84fc0cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 --2- 172.21.15.55:0/1027022488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84fc158850 0x7f84fc0cca30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f84f80097c0 tx=0x7f84f801ec70 comp rx=0 tx=0).stop 2023-07-06T22:01:54.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 -- 172.21.15.55:0/1027022488 shutdown_connections 2023-07-06T22:01:54.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 --2- 172.21.15.55:0/1027022488 >> v2:172.21.15.55:3300/0 conn(0x7f84fc070af0 0x7f84fc0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 --2- 172.21.15.55:0/1027022488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84fc158850 0x7f84fc0cca30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 -- 172.21.15.55:0/1027022488 >> 172.21.15.55:0/1027022488 conn(0x7f84fc0cea70 msgr2=0x7f84fc0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:54.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 -- 172.21.15.55:0/1027022488 shutdown_connections 2023-07-06T22:01:54.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 -- 172.21.15.55:0/1027022488 wait complete. 2023-07-06T22:01:54.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 Processor -- start 2023-07-06T22:01:54.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 -- start start 2023-07-06T22:01:54.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84fc070af0 0x7f84fc0cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84fc0ca130 0x7f84fc06ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84fc158850 0x7f84fc1ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:54.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc06a440 con 0x7f84fc158850 2023-07-06T22:01:54.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc1ed750 con 0x7f84fc070af0 2023-07-06T22:01:54.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8504048640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc1eda30 con 0x7f84fc0ca130 2023-07-06T22:01:54.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f85025e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84fc158850 0x7f84fc1ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f85025e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84fc158850 0x7f84fc1ecc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57990/0 (socket says 172.21.15.55:57990) 2023-07-06T22:01:54.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f85025e5640 1 -- 172.21.15.55:0/935388052 learned_addr learned my addr 172.21.15.55:0/935388052 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:54.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f8501de4640 1 --2- 172.21.15.55:0/935388052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84fc070af0 0x7f84fc0cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.991+0000 7f85015e3640 1 --2- 172.21.15.55:0/935388052 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84fc0ca130 0x7f84fc06ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:54.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.995+0000 7f85025e5640 1 -- 172.21.15.55:0/935388052 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84fc0ca130 msgr2=0x7f84fc06ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.995+0000 7f85025e5640 1 --2- 172.21.15.55:0/935388052 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84fc0ca130 0x7f84fc06ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.995+0000 7f85025e5640 1 -- 172.21.15.55:0/935388052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84fc070af0 msgr2=0x7f84fc0cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.995+0000 7f85025e5640 1 --2- 172.21.15.55:0/935388052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84fc070af0 0x7f84fc0cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.995+0000 7f85025e5640 1 -- 172.21.15.55:0/935388052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f4009a70 con 0x7f84fc158850 2023-07-06T22:01:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.995+0000 7f85025e5640 1 --2- 172.21.15.55:0/935388052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84fc158850 0x7f84fc1ecc60 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f84f400efc0 tx=0x7f84f4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.995+0000 7f84f27fc640 1 -- 172.21.15.55:0/935388052 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4009d70 con 0x7f84fc158850 2023-07-06T22:01:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.995+0000 7f84f27fc640 1 -- 172.21.15.55:0/935388052 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f400f040 con 0x7f84fc158850 2023-07-06T22:01:54.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.995+0000 7f84f27fc640 1 -- 172.21.15.55:0/935388052 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40039a0 con 0x7f84fc158850 2023-07-06T22:01:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.995+0000 7f8504048640 1 -- 172.21.15.55:0/935388052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f8009420 con 0x7f84fc158850 2023-07-06T22:01:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.995+0000 7f8504048640 1 -- 172.21.15.55:0/935388052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc06a970 con 0x7f84fc158850 2023-07-06T22:01:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.995+0000 7f8504048640 1 -- 172.21.15.55:0/935388052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84fc066d60 con 0x7f84fc158850 2023-07-06T22:01:54.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.995+0000 7f84f27fc640 1 -- 172.21.15.55:0/935388052 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 76) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f84f40144a0 con 0x7f84fc158850 2023-07-06T22:01:54.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.995+0000 7f84f27fc640 1 -- 172.21.15.55:0/935388052 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 7141+0+0 (secure 0 0 0) 0x7f84f4084800 con 0x7f84fc158850 2023-07-06T22:01:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:54.999+0000 7f84f27fc640 1 -- 172.21.15.55:0/935388052 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84f4051a80 con 0x7f84fc158850 2023-07-06T22:01:55.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.155+0000 7f8504048640 1 -- 172.21.15.55:0/935388052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f84fc0c8240 con 0x7f84fc158850 2023-07-06T22:01:55.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.155+0000 7f84f27fc640 1 -- 172.21.15.55:0/935388052 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v148) v1 ==== 104+0+11 (secure 0 0 0) 0x7f84f4055270 con 0x7f84fc158850 2023-07-06T22:01:55.154 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T22:01:55.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.155+0000 7f8504048640 1 -- 172.21.15.55:0/935388052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84fc158850 msgr2=0x7f84fc1ecc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:55.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.155+0000 7f8504048640 1 --2- 172.21.15.55:0/935388052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84fc158850 0x7f84fc1ecc60 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f84f400efc0 tx=0x7f84f4009f90 comp rx=0 tx=0).stop 2023-07-06T22:01:55.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.155+0000 7f8504048640 1 -- 172.21.15.55:0/935388052 shutdown_connections 2023-07-06T22:01:55.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.155+0000 7f8504048640 1 --2- 172.21.15.55:0/935388052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84fc158850 0x7f84fc1ecc60 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.155+0000 7f8504048640 1 --2- 172.21.15.55:0/935388052 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84fc0ca130 0x7f84fc06ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.155+0000 7f8504048640 1 --2- 172.21.15.55:0/935388052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84fc070af0 0x7f84fc0cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.155+0000 7f8504048640 1 -- 172.21.15.55:0/935388052 >> 172.21.15.55:0/935388052 conn(0x7f84fc0cea70 msgr2=0x7f84fc06eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:55.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.155+0000 7f8504048640 1 -- 172.21.15.55:0/935388052 shutdown_connections 2023-07-06T22:01:55.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.155+0000 7f8504048640 1 -- 172.21.15.55:0/935388052 wait complete. 2023-07-06T22:01:55.174 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T22:01:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.363+0000 7f3202711640 1 Processor -- start 2023-07-06T22:01:55.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.363+0000 7f3202711640 1 -- start start 2023-07-06T22:01:55.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.363+0000 7f3202711640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f31fc06f0e0 0x7f31fc0ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:55.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.363+0000 7f3202711640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31fc15f5d0 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.363+0000 7f3202711640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31fc15f8b0 con 0x7f31fc156180 2023-07-06T22:01:55.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.363+0000 7f3202711640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31fc160250 con 0x7f31fc06f0e0 2023-07-06T22:01:55.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.363+0000 7f3200cae640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f31fc0cb7a0 0x7f31fc0cbba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53838/0 (socket says 172.21.15.55:53838) 2023-07-06T22:01:55.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.363+0000 7f3200cae640 1 -- 172.21.15.55:0/2831433922 learned_addr learned my addr 172.21.15.55:0/2831433922 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:55.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.363+0000 7f31fb7fe640 1 --2- 172.21.15.55:0/2831433922 >> v2:172.21.15.138:3300/0 conn(0x7f31fc06f0e0 0x7f31fc0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:55.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.363+0000 7f31faffd640 1 -- 172.21.15.55:0/2831433922 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041488739 0 0) 0x7f31fc15f5d0 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.363+0000 7f31faffd640 1 -- 172.21.15.55:0/2831433922 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e4003530 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.363+0000 7f31fb7fe640 1 -- 172.21.15.55:0/2831433922 >> v1:172.21.15.138:6789/0 conn(0x7f31fc156180 legacy=0x7f31fc06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:55.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.363+0000 7f31fb7fe640 1 -- 172.21.15.55:0/2831433922 >> v1:172.21.15.55:6789/0 conn(0x7f31fc0cb7a0 legacy=0x7f31fc0cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:55.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.363+0000 7f31fb7fe640 1 -- 172.21.15.55:0/2831433922 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc15fb90 con 0x7f31fc06f0e0 2023-07-06T22:01:55.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.367+0000 7f31fb7fe640 1 --2- 172.21.15.55:0/2831433922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31fc06f0e0 0x7f31fc0ca610 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f31f00097c0 tx=0x7f31f001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb4c34aca2ff94ea server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.367+0000 7f31faffd640 1 -- 172.21.15.55:0/2831433922 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00ac640 con 0x7f31fc06f0e0 2023-07-06T22:01:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.367+0000 7f31faffd640 1 -- 172.21.15.55:0/2831433922 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f00ac7a0 con 0x7f31fc06f0e0 2023-07-06T22:01:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.367+0000 7f31faffd640 1 -- 172.21.15.55:0/2831433922 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00acb30 con 0x7f31fc06f0e0 2023-07-06T22:01:55.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.367+0000 7f3202711640 1 -- 172.21.15.55:0/2831433922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31fc06f0e0 msgr2=0x7f31fc0ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:55.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.367+0000 7f3202711640 1 --2- 172.21.15.55:0/2831433922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31fc06f0e0 0x7f31fc0ca610 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f31f00097c0 tx=0x7f31f001c3c0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.367+0000 7f3202711640 1 -- 172.21.15.55:0/2831433922 shutdown_connections 2023-07-06T22:01:55.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.367+0000 7f3202711640 1 --2- 172.21.15.55:0/2831433922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31fc06f0e0 0x7f31fc0ca610 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.367+0000 7f3202711640 1 -- 172.21.15.55:0/2831433922 >> 172.21.15.55:0/2831433922 conn(0x7f31fc0d0c50 msgr2=0x7f31fc0cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.367+0000 7f3202711640 1 -- 172.21.15.55:0/2831433922 shutdown_connections 2023-07-06T22:01:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.367+0000 7f3202711640 1 -- 172.21.15.55:0/2831433922 wait complete. 2023-07-06T22:01:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f3202711640 1 Processor -- start 2023-07-06T22:01:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f3202711640 1 -- start start 2023-07-06T22:01:55.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f3202711640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31fc06f0e0 0x7f31fc158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:55.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f3202711640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31fc0cb7a0 0x7f31fc14e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:55.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f3202711640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31fc156180 0x7f31fc150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:55.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f3202711640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc14fb80 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f3202711640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc14ef70 con 0x7f31fc06f0e0 2023-07-06T22:01:55.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f3202711640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc14f250 con 0x7f31fc156180 2023-07-06T22:01:55.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f31fb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31fc0cb7a0 0x7f31fc14e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:55.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f31fb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31fc0cb7a0 0x7f31fc14e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58000/0 (socket says 172.21.15.55:58000) 2023-07-06T22:01:55.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f31fb7fe640 1 -- 172.21.15.55:0/849428428 learned_addr learned my addr 172.21.15.55:0/849428428 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:55.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f31fbfff640 1 --2- 172.21.15.55:0/849428428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31fc06f0e0 0x7f31fc158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:55.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f3200cae640 1 --2- 172.21.15.55:0/849428428 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31fc156180 0x7f31fc150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:55.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f31fb7fe640 1 -- 172.21.15.55:0/849428428 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31fc156180 msgr2=0x7f31fc150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:55.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f31fb7fe640 1 --2- 172.21.15.55:0/849428428 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31fc156180 0x7f31fc150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f31fb7fe640 1 -- 172.21.15.55:0/849428428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31fc06f0e0 msgr2=0x7f31fc158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:55.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f31fb7fe640 1 --2- 172.21.15.55:0/849428428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31fc06f0e0 0x7f31fc158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f31fb7fe640 1 -- 172.21.15.55:0/849428428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f0009420 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f3200cae640 1 --2- 172.21.15.55:0/849428428 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31fc156180 0x7f31fc150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:55.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f31fb7fe640 1 --2- 172.21.15.55:0/849428428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31fc0cb7a0 0x7f31fc14e4a0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f31f0018fd0 tx=0x7f31f0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:55.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f31f8ff9640 1 -- 172.21.15.55:0/849428428 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00b5610 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f31f8ff9640 1 -- 172.21.15.55:0/849428428 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f00b5790 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f31f8ff9640 1 -- 172.21.15.55:0/849428428 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00b5b40 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f3202711640 1 -- 172.21.15.55:0/849428428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31fc14f530 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.371+0000 7f3202711640 1 -- 172.21.15.55:0/849428428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31fc158950 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.375+0000 7f3202711640 1 -- 172.21.15.55:0/849428428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31fc158b40 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.375+0000 7f31f8ff9640 1 -- 172.21.15.55:0/849428428 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 76) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f31f00b3040 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.375+0000 7f31f8ff9640 1 -- 172.21.15.55:0/849428428 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 7141+0+0 (secure 0 0 0) 0x7f31f011dff0 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.379+0000 7f31f8ff9640 1 -- 172.21.15.55:0/849428428 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f31f00eb390 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.539+0000 7f3202711640 1 -- 172.21.15.55:0/849428428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31fc066d60 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.539+0000 7f31f8ff9640 1 -- 172.21.15.55:0/849428428 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v148) v1 ==== 100+0+11 (secure 0 0 0) 0x7f31f00b10a0 con 0x7f31fc0cb7a0 2023-07-06T22:01:55.537 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T22:01:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.539+0000 7f3202711640 1 -- 172.21.15.55:0/849428428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31fc0cb7a0 msgr2=0x7f31fc14e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.539+0000 7f3202711640 1 --2- 172.21.15.55:0/849428428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31fc0cb7a0 0x7f31fc14e4a0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f31f0018fd0 tx=0x7f31f0019160 comp rx=0 tx=0).stop 2023-07-06T22:01:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.539+0000 7f3202711640 1 -- 172.21.15.55:0/849428428 shutdown_connections 2023-07-06T22:01:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.539+0000 7f3202711640 1 --2- 172.21.15.55:0/849428428 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31fc156180 0x7f31fc150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.539+0000 7f3202711640 1 --2- 172.21.15.55:0/849428428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31fc0cb7a0 0x7f31fc14e4a0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.539+0000 7f3202711640 1 --2- 172.21.15.55:0/849428428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31fc06f0e0 0x7f31fc158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.539+0000 7f3202711640 1 -- 172.21.15.55:0/849428428 >> 172.21.15.55:0/849428428 conn(0x7f31fc0d0c50 msgr2=0x7f31fc15e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:55.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.539+0000 7f3202711640 1 -- 172.21.15.55:0/849428428 shutdown_connections 2023-07-06T22:01:55.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.539+0000 7f3202711640 1 -- 172.21.15.55:0/849428428 wait complete. 2023-07-06T22:01:55.558 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:01:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.703+0000 7fa225fc5640 1 Processor -- start 2023-07-06T22:01:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.703+0000 7fa225fc5640 1 -- start start 2023-07-06T22:01:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.703+0000 7fa225fc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2200cb4a0 0x7fa22015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.703+0000 7fa225fc5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa22015f740 0x7fa2200ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.703+0000 7fa225fc5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa2200cbc70 0x7fa2200cc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.703+0000 7fa225fc5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2200b5b50 con 0x7fa2200cbc70 2023-07-06T22:01:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.703+0000 7fa225fc5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22015d130 con 0x7fa22015f740 2023-07-06T22:01:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.703+0000 7fa225fc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2200cc5b0 con 0x7fa2200cb4a0 2023-07-06T22:01:55.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.703+0000 7fa21ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa2200cbc70 0x7fa2200cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:55.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.703+0000 7fa21ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa2200cbc70 0x7fa2200cc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58006/0 (socket says 172.21.15.55:58006) 2023-07-06T22:01:55.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.703+0000 7fa21ffff640 1 -- 172.21.15.55:0/73993689 learned_addr learned my addr 172.21.15.55:0/73993689 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:55.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa21effd640 1 --2- 172.21.15.55:0/73993689 >> v2:172.21.15.138:3300/0 conn(0x7fa22015f740 0x7fa2200ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:55.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa21f7fe640 1 --2- 172.21.15.55:0/73993689 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2200cb4a0 0x7fa22015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:55.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa21ffff640 1 -- 172.21.15.55:0/73993689 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2200cb4a0 msgr2=0x7fa22015cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:55.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa21ffff640 1 --2- 172.21.15.55:0/73993689 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2200cb4a0 0x7fa22015cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa21ffff640 1 -- 172.21.15.55:0/73993689 >> v2:172.21.15.138:3300/0 conn(0x7fa22015f740 msgr2=0x7fa2200ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:55.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa21ffff640 1 --2- 172.21.15.55:0/73993689 >> v2:172.21.15.138:3300/0 conn(0x7fa22015f740 0x7fa2200ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa21ffff640 1 -- 172.21.15.55:0/73993689 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2200cc8e0 con 0x7fa2200cbc70 2023-07-06T22:01:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa21ffff640 1 --2- 172.21.15.55:0/73993689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2200cbc70 0x7fa2200cc070 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fa2200cdbc0 tx=0x7fa21801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a99035d5d006d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa21e7fc640 1 -- 172.21.15.55:0/73993689 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180a5740 con 0x7fa2200cbc70 2023-07-06T22:01:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa21e7fc640 1 -- 172.21.15.55:0/73993689 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2180a58a0 con 0x7fa2200cbc70 2023-07-06T22:01:55.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa21e7fc640 1 -- 172.21.15.55:0/73993689 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180a5c30 con 0x7fa2200cbc70 2023-07-06T22:01:55.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa225fc5640 1 -- 172.21.15.55:0/73993689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2200cbc70 msgr2=0x7fa2200cc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:55.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa225fc5640 1 --2- 172.21.15.55:0/73993689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2200cbc70 0x7fa2200cc070 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fa2200cdbc0 tx=0x7fa21801c9d0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa225fc5640 1 -- 172.21.15.55:0/73993689 shutdown_connections 2023-07-06T22:01:55.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa225fc5640 1 --2- 172.21.15.55:0/73993689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2200cbc70 0x7fa2200cc070 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa225fc5640 1 --2- 172.21.15.55:0/73993689 >> v2:172.21.15.138:3300/0 conn(0x7fa22015f740 0x7fa2200ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa225fc5640 1 --2- 172.21.15.55:0/73993689 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2200cb4a0 0x7fa22015cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa225fc5640 1 -- 172.21.15.55:0/73993689 >> 172.21.15.55:0/73993689 conn(0x7fa22006ee80 msgr2=0x7fa22006f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:55.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa225fc5640 1 -- 172.21.15.55:0/73993689 shutdown_connections 2023-07-06T22:01:55.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.707+0000 7fa225fc5640 1 -- 172.21.15.55:0/73993689 wait complete. 2023-07-06T22:01:55.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa225fc5640 1 Processor -- start 2023-07-06T22:01:55.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa225fc5640 1 -- start start 2023-07-06T22:01:55.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa225fc5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2200cb4a0 0x7fa2200c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:55.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa225fc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2200cbc70 0x7fa22015ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:55.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa225fc5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa22015f740 0x7fa2200af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:55.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa225fc5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2200c3fc0 con 0x7fa22015f740 2023-07-06T22:01:55.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa225fc5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2200c42a0 con 0x7fa2200cb4a0 2023-07-06T22:01:55.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa225fc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2200c4580 con 0x7fa2200cbc70 2023-07-06T22:01:55.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa21ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa22015f740 0x7fa2200af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:55.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa21ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa22015f740 0x7fa2200af100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58008/0 (socket says 172.21.15.55:58008) 2023-07-06T22:01:55.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa21ffff640 1 -- 172.21.15.55:0/3663678924 learned_addr learned my addr 172.21.15.55:0/3663678924 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:55.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa21f7fe640 1 --2- 172.21.15.55:0/3663678924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2200cb4a0 0x7fa2200c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:55.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa21effd640 1 --2- 172.21.15.55:0/3663678924 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2200cbc70 0x7fa22015ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:55.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa21ffff640 1 -- 172.21.15.55:0/3663678924 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2200cbc70 msgr2=0x7fa22015ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:55.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa21ffff640 1 --2- 172.21.15.55:0/3663678924 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2200cbc70 0x7fa22015ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa21ffff640 1 -- 172.21.15.55:0/3663678924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2200cb4a0 msgr2=0x7fa2200c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:55.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa21ffff640 1 --2- 172.21.15.55:0/3663678924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2200cb4a0 0x7fa2200c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa21ffff640 1 -- 172.21.15.55:0/3663678924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218009b30 con 0x7fa22015f740 2023-07-06T22:01:55.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.711+0000 7fa21ffff640 1 --2- 172.21.15.55:0/3663678924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa22015f740 0x7fa2200af100 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fa2180af040 tx=0x7fa218019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:55.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.715+0000 7fa207fff640 1 -- 172.21.15.55:0/3663678924 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180b8670 con 0x7fa22015f740 2023-07-06T22:01:55.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.715+0000 7fa207fff640 1 -- 172.21.15.55:0/3663678924 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2180b87d0 con 0x7fa22015f740 2023-07-06T22:01:55.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.715+0000 7fa207fff640 1 -- 172.21.15.55:0/3663678924 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180b8b80 con 0x7fa22015f740 2023-07-06T22:01:55.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.715+0000 7fa225fc5640 1 -- 172.21.15.55:0/3663678924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2200c4860 con 0x7fa22015f740 2023-07-06T22:01:55.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.715+0000 7fa225fc5640 1 -- 172.21.15.55:0/3663678924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2200c3be0 con 0x7fa22015f740 2023-07-06T22:01:55.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.715+0000 7fa225fc5640 1 -- 172.21.15.55:0/3663678924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa220066d60 con 0x7fa22015f740 2023-07-06T22:01:55.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.715+0000 7fa207fff640 1 -- 172.21.15.55:0/3663678924 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 76) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fa2180b8ce0 con 0x7fa22015f740 2023-07-06T22:01:55.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.715+0000 7fa207fff640 1 -- 172.21.15.55:0/3663678924 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 7141+0+0 (secure 0 0 0) 0x7fa21811f190 con 0x7fa22015f740 2023-07-06T22:01:55.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.719+0000 7fa207fff640 1 -- 172.21.15.55:0/3663678924 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa2180ec7c0 con 0x7fa22015f740 2023-07-06T22:01:55.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.847+0000 7fa207fff640 1 -- 172.21.15.55:0/3663678924 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 77) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fa2180ec270 con 0x7fa22015f740 2023-07-06T22:01:55.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.847+0000 7fa207fff640 1 --2- 172.21.15.55:0/3663678924 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fa20c06c680 0x7fa20c06ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:55.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.847+0000 7fa21f7fe640 1 --2- 172.21.15.55:0/3663678924 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fa20c06c680 0x7fa20c06ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:55.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.851+0000 7fa21f7fe640 1 --2- 172.21.15.55:0/3663678924 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fa20c06c680 0x7fa20c06ea60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa2201f7570 tx=0x7fa210008040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:55.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.915+0000 7fa225fc5640 1 -- 172.21.15.55:0/3663678924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2200c4d10 con 0x7fa22015f740 2023-07-06T22:01:55.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.915+0000 7fa207fff640 1 -- 172.21.15.55:0/3663678924 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4670 (secure 0 0 0) 0x7fa2181175c0 con 0x7fa22015f740 2023-07-06T22:01:55.915 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:55.915 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/457440874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":457440874},{"type":"v1","addr":"172.21.15.138:6834","nonce":457440874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/446729940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":446729940},{"type":"v1","addr":"172.21.15.55:6835","nonce":446729940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9189,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/742646154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":742646154},{"type":"v1","addr":"172.21.15.138:6835","nonce":742646154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:01:30.178097+0000","modified":"2023-07-06T22:01:33.205176+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9198":{"gid":9198,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/4072042723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":4072042723},{"type":"v1","addr":"172.21.15.55:6837","nonce":4072042723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-06T22:01:55.915 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 63 2023-07-06T22:01:55.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.919+0000 7fa225fc5640 1 -- 172.21.15.55:0/3663678924 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fa20c06c680 msgr2=0x7fa20c06ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:55.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.919+0000 7fa225fc5640 1 --2- 172.21.15.55:0/3663678924 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fa20c06c680 0x7fa20c06ea60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa2201f7570 tx=0x7fa210008040 comp rx=0 tx=0).stop 2023-07-06T22:01:55.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.919+0000 7fa225fc5640 1 -- 172.21.15.55:0/3663678924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa22015f740 msgr2=0x7fa2200af100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:55.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.919+0000 7fa225fc5640 1 --2- 172.21.15.55:0/3663678924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa22015f740 0x7fa2200af100 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fa2180af040 tx=0x7fa218019770 comp rx=0 tx=0).stop 2023-07-06T22:01:55.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.919+0000 7fa225fc5640 1 -- 172.21.15.55:0/3663678924 shutdown_connections 2023-07-06T22:01:55.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.919+0000 7fa225fc5640 1 --2- 172.21.15.55:0/3663678924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa22015f740 0x7fa2200af100 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.919+0000 7fa225fc5640 1 --2- 172.21.15.55:0/3663678924 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2200cbc70 0x7fa22015ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.919+0000 7fa225fc5640 1 --2- 172.21.15.55:0/3663678924 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fa20c06c680 0x7fa20c06ea60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.919+0000 7fa225fc5640 1 --2- 172.21.15.55:0/3663678924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2200cb4a0 0x7fa2200c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.919+0000 7fa225fc5640 1 -- 172.21.15.55:0/3663678924 >> 172.21.15.55:0/3663678924 conn(0x7fa22006ee80 msgr2=0x7fa22015b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.919+0000 7fa225fc5640 1 -- 172.21.15.55:0/3663678924 shutdown_connections 2023-07-06T22:01:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:55.919+0000 7fa225fc5640 1 -- 172.21.15.55:0/3663678924 wait complete. 2023-07-06T22:01:55.936 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:01:56.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.079+0000 7efdeb893640 1 Processor -- start 2023-07-06T22:01:56.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.079+0000 7efdeb893640 1 -- start start 2023-07-06T22:01:56.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.083+0000 7efdeb893640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efde40cde40 0x7efde415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.083+0000 7efdeb893640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efde406f8e0 0x7efde406fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.083+0000 7efdeb893640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40ce290 con 0x7efde4157e40 2023-07-06T22:01:56.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.083+0000 7efdeb893640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde4158210 con 0x7efde406f8e0 2023-07-06T22:01:56.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.083+0000 7efdeb893640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde415bd10 con 0x7efde40cde40 2023-07-06T22:01:56.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.083+0000 7efde9e30640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efde406f8e0 0x7efde406fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.083+0000 7efde9e30640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efde406f8e0 0x7efde406fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58020/0 (socket says 172.21.15.55:58020) 2023-07-06T22:01:56.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.083+0000 7efde9e30640 1 -- 172.21.15.55:0/1638209941 learned_addr learned my addr 172.21.15.55:0/1638209941 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:56.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.083+0000 7efde8e2e640 1 --2- 172.21.15.55:0/1638209941 >> v2:172.21.15.138:3300/0 conn(0x7efde40cde40 0x7efde415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.083+0000 7efde9e30640 1 -- 172.21.15.55:0/1638209941 >> v2:172.21.15.138:3300/0 conn(0x7efde40cde40 msgr2=0x7efde415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:56.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.083+0000 7efde9e30640 1 --2- 172.21.15.55:0/1638209941 >> v2:172.21.15.138:3300/0 conn(0x7efde40cde40 0x7efde415c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.083+0000 7efde9e30640 1 -- 172.21.15.55:0/1638209941 >> v1:172.21.15.138:6789/0 conn(0x7efde4157e40 legacy=0x7efde4158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.083+0000 7efde9e30640 1 -- 172.21.15.55:0/1638209941 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde4070280 con 0x7efde406f8e0 2023-07-06T22:01:56.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.083+0000 7efde9e30640 1 --2- 172.21.15.55:0/1638209941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde406f8e0 0x7efde406fd40 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7efde406a640 tx=0x7efddc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43de5394630a30fe server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:56.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efddbfff640 1 -- 172.21.15.55:0/1638209941 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc0a5610 con 0x7efde406f8e0 2023-07-06T22:01:56.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efddbfff640 1 -- 172.21.15.55:0/1638209941 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc0a5770 con 0x7efde406f8e0 2023-07-06T22:01:56.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efddbfff640 1 -- 172.21.15.55:0/1638209941 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc0a5b00 con 0x7efde406f8e0 2023-07-06T22:01:56.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 -- 172.21.15.55:0/1638209941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde406f8e0 msgr2=0x7efde406fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 --2- 172.21.15.55:0/1638209941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde406f8e0 0x7efde406fd40 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7efde406a640 tx=0x7efddc01c9d0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 -- 172.21.15.55:0/1638209941 shutdown_connections 2023-07-06T22:01:56.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 --2- 172.21.15.55:0/1638209941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde406f8e0 0x7efde406fd40 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 --2- 172.21.15.55:0/1638209941 >> v2:172.21.15.138:3300/0 conn(0x7efde40cde40 0x7efde415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 -- 172.21.15.55:0/1638209941 >> 172.21.15.55:0/1638209941 conn(0x7efde40cbd80 msgr2=0x7efde40ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:56.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 -- 172.21.15.55:0/1638209941 shutdown_connections 2023-07-06T22:01:56.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 -- 172.21.15.55:0/1638209941 wait complete. 2023-07-06T22:01:56.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 Processor -- start 2023-07-06T22:01:56.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 -- start start 2023-07-06T22:01:56.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde406f8e0 0x7efde414a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efde40cde40 0x7efde40adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efde4157e40 0x7efde40ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde414b3d0 con 0x7efde406f8e0 2023-07-06T22:01:56.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde40cac50 con 0x7efde4157e40 2023-07-06T22:01:56.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efdeb893640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde414a750 con 0x7efde40cde40 2023-07-06T22:01:56.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efde962f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde406f8e0 0x7efde414a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efde962f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde406f8e0 0x7efde414a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58032/0 (socket says 172.21.15.55:58032) 2023-07-06T22:01:56.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efde962f640 1 -- 172.21.15.55:0/1844713647 learned_addr learned my addr 172.21.15.55:0/1844713647 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:56.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efde8e2e640 1 --2- 172.21.15.55:0/1844713647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efde40cde40 0x7efde40adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.087+0000 7efde9e30640 1 --2- 172.21.15.55:0/1844713647 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efde4157e40 0x7efde40ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.091+0000 7efde962f640 1 -- 172.21.15.55:0/1844713647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efde40cde40 msgr2=0x7efde40adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.091+0000 7efde962f640 1 --2- 172.21.15.55:0/1844713647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efde40cde40 0x7efde40adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.091+0000 7efde962f640 1 -- 172.21.15.55:0/1844713647 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efde4157e40 msgr2=0x7efde40ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.091+0000 7efde962f640 1 --2- 172.21.15.55:0/1844713647 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efde4157e40 0x7efde40ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.091+0000 7efde962f640 1 -- 172.21.15.55:0/1844713647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc009b30 con 0x7efde406f8e0 2023-07-06T22:01:56.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.091+0000 7efde962f640 1 --2- 172.21.15.55:0/1844713647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde406f8e0 0x7efde414a090 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7efde000c500 tx=0x7efde000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:56.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.091+0000 7efdd9ffb640 1 -- 172.21.15.55:0/1844713647 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0005220 con 0x7efde406f8e0 2023-07-06T22:01:56.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.091+0000 7efdd9ffb640 1 -- 172.21.15.55:0/1844713647 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde0005380 con 0x7efde406f8e0 2023-07-06T22:01:56.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.091+0000 7efdd9ffb640 1 -- 172.21.15.55:0/1844713647 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0007270 con 0x7efde406f8e0 2023-07-06T22:01:56.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.091+0000 7efdeb893640 1 -- 172.21.15.55:0/1844713647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde414aa30 con 0x7efde406f8e0 2023-07-06T22:01:56.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.091+0000 7efdeb893640 1 -- 172.21.15.55:0/1844713647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde414aff0 con 0x7efde406f8e0 2023-07-06T22:01:56.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.091+0000 7efdeb893640 1 -- 172.21.15.55:0/1844713647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde414b510 con 0x7efde406f8e0 2023-07-06T22:01:56.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.091+0000 7efdd9ffb640 1 -- 172.21.15.55:0/1844713647 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 77) v1 ==== 85496+0+0 (secure 0 0 0) 0x7efde00073d0 con 0x7efde406f8e0 2023-07-06T22:01:56.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.095+0000 7efdd9ffb640 1 --2- 172.21.15.55:0/1844713647 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7efdc8066100 0x7efdc80685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.095+0000 7efdd9ffb640 1 -- 172.21.15.55:0/1844713647 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 7141+0+0 (secure 0 0 0) 0x7efde0083640 con 0x7efde406f8e0 2023-07-06T22:01:56.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.095+0000 7efde8e2e640 1 --2- 172.21.15.55:0/1844713647 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7efdc8066100 0x7efdc80685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.095+0000 7efde8e2e640 1 --2- 172.21.15.55:0/1844713647 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7efdc8066100 0x7efdc80685b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efde414c130 tx=0x7efdd4009190 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:56.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.099+0000 7efdd9ffb640 1 -- 172.21.15.55:0/1844713647 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efde0050920 con 0x7efde406f8e0 2023-07-06T22:01:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.255+0000 7efdeb893640 1 -- 172.21.15.55:0/1844713647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efde4066d60 con 0x7efde406f8e0 2023-07-06T22:01:56.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.255+0000 7efdd9ffb640 1 -- 172.21.15.55:0/1844713647 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+19659 (secure 0 0 0) 0x7efde0053f40 con 0x7efde406f8e0 2023-07-06T22:01:56.255 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:56.255 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":148,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:01:54.831917+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:01:28.023569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-07-06T22:01:29.170296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/1150117832":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/2778588340":"2023-07-07T22:01:54.831883+0000","172.21.15.55:6833/462110382":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/2978696860":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3247819093":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3847009850":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/4284141340":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3374210555":"2023-07-07T22:01:47.217185+0000","172.21.15.55:6833/206120108":"2023-07-07T22:01:47.217185+0000","172.21.15.55:6832/206120108":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/1122193584":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/2036406408":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/1372487043":"2023-07-07T22:01:47.217185+0000","172.21.15.55:6832/462110382":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3843098755":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/1981543070":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3618722598":"2023-07-07T22:01:47.217185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:01:56.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.259+0000 7efdeb893640 1 -- 172.21.15.55:0/1844713647 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7efdc8066100 msgr2=0x7efdc80685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.259+0000 7efdeb893640 1 --2- 172.21.15.55:0/1844713647 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7efdc8066100 0x7efdc80685b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efde414c130 tx=0x7efdd4009190 comp rx=0 tx=0).stop 2023-07-06T22:01:56.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.259+0000 7efdeb893640 1 -- 172.21.15.55:0/1844713647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde406f8e0 msgr2=0x7efde414a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.259+0000 7efdeb893640 1 --2- 172.21.15.55:0/1844713647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde406f8e0 0x7efde414a090 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7efde000c500 tx=0x7efde000c9c0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.259+0000 7efdeb893640 1 -- 172.21.15.55:0/1844713647 shutdown_connections 2023-07-06T22:01:56.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.259+0000 7efdeb893640 1 --2- 172.21.15.55:0/1844713647 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7efdc8066100 0x7efdc80685b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.259+0000 7efdeb893640 1 --2- 172.21.15.55:0/1844713647 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efde4157e40 0x7efde40ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.259+0000 7efdeb893640 1 --2- 172.21.15.55:0/1844713647 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efde40cde40 0x7efde40adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.259+0000 7efdeb893640 1 --2- 172.21.15.55:0/1844713647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde406f8e0 0x7efde414a090 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.259+0000 7efdeb893640 1 -- 172.21.15.55:0/1844713647 >> 172.21.15.55:0/1844713647 conn(0x7efde40cbd80 msgr2=0x7efde414c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:56.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.259+0000 7efdeb893640 1 -- 172.21.15.55:0/1844713647 shutdown_connections 2023-07-06T22:01:56.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.259+0000 7efdeb893640 1 -- 172.21.15.55:0/1844713647 wait complete. 2023-07-06T22:01:56.276 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T22:01:56.277 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:01:56.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.419+0000 7f1e9d3a3640 1 Processor -- start 2023-07-06T22:01:56.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.419+0000 7f1e9d3a3640 1 -- start start 2023-07-06T22:01:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.423+0000 7f1e9d3a3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1e9806a400 0x7f1e980cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.423+0000 7f1e9d3a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9806bd00 con 0x7f1e98160030 2023-07-06T22:01:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.423+0000 7f1e9d3a3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e980c9ba0 con 0x7f1e980cd330 2023-07-06T22:01:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.423+0000 7f1e9d3a3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e98160400 con 0x7f1e9806a400 2023-07-06T22:01:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.423+0000 7f1e96ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1e98160030 0x7f1e98070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53844/0 (socket says 172.21.15.55:53844) 2023-07-06T22:01:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.423+0000 7f1e96ffd640 1 -- 172.21.15.55:0/3977331661 learned_addr learned my addr 172.21.15.55:0/3977331661 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:01:56.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.423+0000 7f1e977fe640 1 --2- 172.21.15.55:0/3977331661 >> v2:172.21.15.138:3300/0 conn(0x7f1e9806a400 0x7f1e980cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.423+0000 7f1e967fc640 1 -- 172.21.15.55:0/3977331661 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171346245 0 0) 0x7f1e9806bd00 con 0x7f1e98160030 2023-07-06T22:01:56.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.423+0000 7f1e967fc640 1 -- 172.21.15.55:0/3977331661 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e84003530 con 0x7f1e98160030 2023-07-06T22:01:56.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.423+0000 7f1e977fe640 1 -- 172.21.15.55:0/3977331661 >> v1:172.21.15.138:6789/0 conn(0x7f1e980cd330 legacy=0x7f1e980cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.423+0000 7f1e967fc640 1 -- 172.21.15.55:0/3977331661 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250732014 0 0) 0x7f1e980c9ba0 con 0x7f1e980cd330 2023-07-06T22:01:56.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.423+0000 7f1e977fe640 1 -- 172.21.15.55:0/3977331661 >> v1:172.21.15.55:6789/0 conn(0x7f1e98160030 legacy=0x7f1e98070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.423+0000 7f1e977fe640 1 -- 172.21.15.55:0/3977331661 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e98071540 con 0x7f1e9806a400 2023-07-06T22:01:56.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.427+0000 7f1e977fe640 1 --2- 172.21.15.55:0/3977331661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e9806a400 0x7f1e980cd7a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009d90 tx=0x7f1e9001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=538a4d3eeb82ed80 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:56.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.427+0000 7f1e967fc640 1 -- 172.21.15.55:0/3977331661 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e900a5810 con 0x7f1e9806a400 2023-07-06T22:01:56.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.427+0000 7f1e967fc640 1 -- 172.21.15.55:0/3977331661 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e900a5970 con 0x7f1e9806a400 2023-07-06T22:01:56.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.427+0000 7f1e967fc640 1 -- 172.21.15.55:0/3977331661 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e900a5d00 con 0x7f1e9806a400 2023-07-06T22:01:56.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.427+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/3977331661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e9806a400 msgr2=0x7f1e980cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.427+0000 7f1e9d3a3640 1 --2- 172.21.15.55:0/3977331661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e9806a400 0x7f1e980cd7a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009d90 tx=0x7f1e9001c950 comp rx=0 tx=0).stop 2023-07-06T22:01:56.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.427+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/3977331661 shutdown_connections 2023-07-06T22:01:56.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.427+0000 7f1e9d3a3640 1 --2- 172.21.15.55:0/3977331661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e9806a400 0x7f1e980cd7a0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.427+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/3977331661 >> 172.21.15.55:0/3977331661 conn(0x7f1e980cded0 msgr2=0x7f1e980ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:56.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.427+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/3977331661 shutdown_connections 2023-07-06T22:01:56.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.427+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/3977331661 wait complete. 2023-07-06T22:01:56.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.427+0000 7f1e9d3a3640 1 Processor -- start 2023-07-06T22:01:56.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.427+0000 7f1e9d3a3640 1 -- start start 2023-07-06T22:01:56.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e9d3a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e9806a400 0x7f1e98162e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e9d3a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e980cd330 0x7f1e981596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e9d3a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1e98160030 0x7f1e980c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e9d3a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e98163390 con 0x7f1e9806a400 2023-07-06T22:01:56.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e9d3a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9815e560 con 0x7f1e980cd330 2023-07-06T22:01:56.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e9d3a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9815e800 con 0x7f1e98160030 2023-07-06T22:01:56.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e96ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e9806a400 0x7f1e98162e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e96ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e9806a400 0x7f1e98162e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58042/0 (socket says 172.21.15.55:58042) 2023-07-06T22:01:56.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e96ffd640 1 -- 172.21.15.55:0/2451500971 learned_addr learned my addr 172.21.15.55:0/2451500971 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:56.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e96ffd640 1 -- 172.21.15.55:0/2451500971 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1e98160030 msgr2=0x7f1e980c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e96ffd640 1 --2- 172.21.15.55:0/2451500971 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1e98160030 0x7f1e980c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e96ffd640 1 -- 172.21.15.55:0/2451500971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e980cd330 msgr2=0x7f1e981596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e96ffd640 1 --2- 172.21.15.55:0/2451500971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e980cd330 0x7f1e981596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e96ffd640 1 -- 172.21.15.55:0/2451500971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90009a70 con 0x7f1e9806a400 2023-07-06T22:01:56.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e96ffd640 1 --2- 172.21.15.55:0/2451500971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e9806a400 0x7f1e98162e50 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c420 tx=0x7f1e8800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:56.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e8f7fe640 1 -- 172.21.15.55:0/2451500971 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88005cf0 con 0x7f1e9806a400 2023-07-06T22:01:56.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e8f7fe640 1 -- 172.21.15.55:0/2451500971 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e88005e50 con 0x7f1e9806a400 2023-07-06T22:01:56.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e8f7fe640 1 -- 172.21.15.55:0/2451500971 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880072d0 con 0x7f1e9806a400 2023-07-06T22:01:56.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/2451500971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9815eae0 con 0x7f1e9806a400 2023-07-06T22:01:56.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/2451500971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9815c3a0 con 0x7f1e9806a400 2023-07-06T22:01:56.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/2451500971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e98066d60 con 0x7f1e9806a400 2023-07-06T22:01:56.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.431+0000 7f1e8f7fe640 1 -- 172.21.15.55:0/2451500971 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 77) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f1e88007430 con 0x7f1e9806a400 2023-07-06T22:01:56.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.435+0000 7f1e8f7fe640 1 --2- 172.21.15.55:0/2451500971 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f1e78066100 0x7f1e780685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.435+0000 7f1e8f7fe640 1 -- 172.21.15.55:0/2451500971 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 7141+0+0 (secure 0 0 0) 0x7f1e880832e0 con 0x7f1e9806a400 2023-07-06T22:01:56.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.435+0000 7f1e8ffff640 1 --2- 172.21.15.55:0/2451500971 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f1e78066100 0x7f1e780685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.435+0000 7f1e8ffff640 1 --2- 172.21.15.55:0/2451500971 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f1e78066100 0x7f1e780685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1e80007fd0 tx=0x7f1e80007900 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:56.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.439+0000 7f1e8f7fe640 1 -- 172.21.15.55:0/2451500971 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e88050640 con 0x7f1e9806a400 2023-07-06T22:01:56.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.623+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/2451500971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e9815c590 con 0x7f1e9806a400 2023-07-06T22:01:56.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.623+0000 7f1e8f7fe640 1 -- 172.21.15.55:0/2451500971 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4670 (secure 0 0 0) 0x7f1e88053c60 con 0x7f1e9806a400 2023-07-06T22:01:56.621 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:56.621 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/457440874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":457440874},{"type":"v1","addr":"172.21.15.138:6834","nonce":457440874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/446729940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":446729940},{"type":"v1","addr":"172.21.15.55:6835","nonce":446729940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9189,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/742646154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":742646154},{"type":"v1","addr":"172.21.15.138:6835","nonce":742646154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:01:30.178097+0000","modified":"2023-07-06T22:01:33.205176+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9198":{"gid":9198,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/4072042723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":4072042723},{"type":"v1","addr":"172.21.15.55:6837","nonce":4072042723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-06T22:01:56.622 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 63 2023-07-06T22:01:56.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.623+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/2451500971 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f1e78066100 msgr2=0x7f1e780685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.623+0000 7f1e9d3a3640 1 --2- 172.21.15.55:0/2451500971 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f1e78066100 0x7f1e780685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1e80007fd0 tx=0x7f1e80007900 comp rx=0 tx=0).stop 2023-07-06T22:01:56.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.623+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/2451500971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e9806a400 msgr2=0x7f1e98162e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.623+0000 7f1e9d3a3640 1 --2- 172.21.15.55:0/2451500971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e9806a400 0x7f1e98162e50 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c420 tx=0x7f1e8800c8e0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.623+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/2451500971 shutdown_connections 2023-07-06T22:01:56.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.623+0000 7f1e9d3a3640 1 --2- 172.21.15.55:0/2451500971 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1e98160030 0x7f1e980c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.623+0000 7f1e9d3a3640 1 --2- 172.21.15.55:0/2451500971 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f1e78066100 0x7f1e780685b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.623+0000 7f1e9d3a3640 1 --2- 172.21.15.55:0/2451500971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e980cd330 0x7f1e981596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.623+0000 7f1e9d3a3640 1 --2- 172.21.15.55:0/2451500971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e9806a400 0x7f1e98162e50 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.623+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/2451500971 >> 172.21.15.55:0/2451500971 conn(0x7f1e980cded0 msgr2=0x7f1e980ca8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:56.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.623+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/2451500971 shutdown_connections 2023-07-06T22:01:56.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.623+0000 7f1e9d3a3640 1 -- 172.21.15.55:0/2451500971 wait complete. 2023-07-06T22:01:56.642 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:01:56.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dffd67640 1 Processor -- start 2023-07-06T22:01:56.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dffd67640 1 -- start start 2023-07-06T22:01:56.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dffd67640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3df80b7cd0 0x7f3df80ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dffd67640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3df80b1fe0 0x7f3df815f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dffd67640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df80cecf0 con 0x7f3df80ccab0 2023-07-06T22:01:56.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dffd67640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df80d2310 con 0x7f3df80b1fe0 2023-07-06T22:01:56.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dffd67640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80b80a0 con 0x7f3df80b7cd0 2023-07-06T22:01:56.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dfe304640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3df80b1fe0 0x7f3df815f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dfe304640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3df80b1fe0 0x7f3df815f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58048/0 (socket says 172.21.15.55:58048) 2023-07-06T22:01:56.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dfe304640 1 -- 172.21.15.55:0/1388908542 learned_addr learned my addr 172.21.15.55:0/1388908542 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:56.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dfdb03640 1 --2- 172.21.15.55:0/1388908542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3df80b7cd0 0x7f3df80ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dfe304640 1 -- 172.21.15.55:0/1388908542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3df80b7cd0 msgr2=0x7f3df80ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:56.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dfe304640 1 --2- 172.21.15.55:0/1388908542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3df80b7cd0 0x7f3df80ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dfe304640 1 -- 172.21.15.55:0/1388908542 >> v1:172.21.15.138:6789/0 conn(0x7f3df80ccab0 legacy=0x7f3df80b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:56.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.787+0000 7f3dfe304640 1 -- 172.21.15.55:0/1388908542 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80d1d90 con 0x7f3df80b1fe0 2023-07-06T22:01:56.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.791+0000 7f3dfe304640 1 --2- 172.21.15.55:0/1388908542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3df80b1fe0 0x7f3df815f870 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009e50 tx=0x7f3df001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce9f2bc72d7f57b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:56.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.791+0000 7f3dfcb01640 1 -- 172.21.15.55:0/1388908542 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00a55c0 con 0x7f3df80b1fe0 2023-07-06T22:01:56.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.791+0000 7f3dfcb01640 1 -- 172.21.15.55:0/1388908542 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df00a5720 con 0x7f3df80b1fe0 2023-07-06T22:01:56.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.791+0000 7f3dfcb01640 1 -- 172.21.15.55:0/1388908542 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00a5ab0 con 0x7f3df80b1fe0 2023-07-06T22:01:56.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.791+0000 7f3dffd67640 1 -- 172.21.15.55:0/1388908542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3df80b1fe0 msgr2=0x7f3df815f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.791+0000 7f3dffd67640 1 --2- 172.21.15.55:0/1388908542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3df80b1fe0 0x7f3df815f870 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009e50 tx=0x7f3df001c940 comp rx=0 tx=0).stop 2023-07-06T22:01:56.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.791+0000 7f3dffd67640 1 -- 172.21.15.55:0/1388908542 shutdown_connections 2023-07-06T22:01:56.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.791+0000 7f3dffd67640 1 --2- 172.21.15.55:0/1388908542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3df80b1fe0 0x7f3df815f870 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.791+0000 7f3dffd67640 1 --2- 172.21.15.55:0/1388908542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3df80b7cd0 0x7f3df80ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.791+0000 7f3dffd67640 1 -- 172.21.15.55:0/1388908542 >> 172.21.15.55:0/1388908542 conn(0x7f3df80ceee0 msgr2=0x7f3df80cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:56.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.791+0000 7f3dffd67640 1 -- 172.21.15.55:0/1388908542 shutdown_connections 2023-07-06T22:01:56.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.791+0000 7f3dffd67640 1 -- 172.21.15.55:0/1388908542 wait complete. 2023-07-06T22:01:56.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dffd67640 1 Processor -- start 2023-07-06T22:01:56.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dffd67640 1 -- start start 2023-07-06T22:01:56.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dffd67640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3df80b1fe0 0x7f3df8152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dffd67640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3df80b7cd0 0x7f3df80c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dffd67640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3df80ccab0 0x7f3df8150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dffd67640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df815a7f0 con 0x7f3df80ccab0 2023-07-06T22:01:56.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dffd67640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80c6f60 con 0x7f3df80b7cd0 2023-07-06T22:01:56.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dffd67640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8159ec0 con 0x7f3df80b1fe0 2023-07-06T22:01:56.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dfe304640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3df80ccab0 0x7f3df8150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dfe304640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3df80ccab0 0x7f3df8150610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58062/0 (socket says 172.21.15.55:58062) 2023-07-06T22:01:56.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dfe304640 1 -- 172.21.15.55:0/4007490535 learned_addr learned my addr 172.21.15.55:0/4007490535 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:56.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dfd302640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3df80b7cd0 0x7f3df80c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dfdb03640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3df80b1fe0 0x7f3df8152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dfe304640 1 -- 172.21.15.55:0/4007490535 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3df80b1fe0 msgr2=0x7f3df8152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dfe304640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3df80b1fe0 0x7f3df8152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dfe304640 1 -- 172.21.15.55:0/4007490535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3df80b7cd0 msgr2=0x7f3df80c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dfe304640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3df80b7cd0 0x7f3df80c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dfe304640 1 -- 172.21.15.55:0/4007490535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df0009b30 con 0x7f3df80ccab0 2023-07-06T22:01:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dfdb03640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3df80b1fe0 0x7f3df8152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dfe304640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3df80ccab0 0x7f3df8150610 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f3df001aff0 tx=0x7f3df00196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dee7fc640 1 -- 172.21.15.55:0/4007490535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00b8670 con 0x7f3df80ccab0 2023-07-06T22:01:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dee7fc640 1 -- 172.21.15.55:0/4007490535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df00b87d0 con 0x7f3df80ccab0 2023-07-06T22:01:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dee7fc640 1 -- 172.21.15.55:0/4007490535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00b8b40 con 0x7f3df80ccab0 2023-07-06T22:01:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dffd67640 1 -- 172.21.15.55:0/4007490535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df815a1a0 con 0x7f3df80ccab0 2023-07-06T22:01:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dffd67640 1 -- 172.21.15.55:0/4007490535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df8152130 con 0x7f3df80ccab0 2023-07-06T22:01:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.795+0000 7f3dffd67640 1 -- 172.21.15.55:0/4007490535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df8066d60 con 0x7f3df80ccab0 2023-07-06T22:01:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.799+0000 7f3dee7fc640 1 -- 172.21.15.55:0/4007490535 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 77) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f3df00b8ca0 con 0x7f3df80ccab0 2023-07-06T22:01:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.799+0000 7f3dee7fc640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f3ddc0660d0 0x7f3ddc068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:56.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.799+0000 7f3dee7fc640 1 -- 172.21.15.55:0/4007490535 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 7141+0+0 (secure 0 0 0) 0x7f3df011f1d0 con 0x7f3df80ccab0 2023-07-06T22:01:56.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.799+0000 7f3dfdb03640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f3ddc0660d0 0x7f3ddc068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:56.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.799+0000 7f3dfdb03640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f3ddc0660d0 0x7f3ddc068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3df80c69b0 tx=0x7f3df4008040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:56.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.803+0000 7f3dee7fc640 1 -- 172.21.15.55:0/4007490535 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3df00ec480 con 0x7f3df80ccab0 2023-07-06T22:01:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.991+0000 7f3dffd67640 1 -- 172.21.15.55:0/4007490535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3df815a930 con 0x7f3df80ccab0 2023-07-06T22:01:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.991+0000 7f3dee7fc640 1 -- 172.21.15.55:0/4007490535 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4670 (secure 0 0 0) 0x7f3df0009510 con 0x7f3df80ccab0 2023-07-06T22:01:56.992 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:56.992 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/457440874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":457440874},{"type":"v1","addr":"172.21.15.138:6834","nonce":457440874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/446729940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":446729940},{"type":"v1","addr":"172.21.15.55:6835","nonce":446729940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9189,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/742646154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":742646154},{"type":"v1","addr":"172.21.15.138:6835","nonce":742646154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:01:30.178097+0000","modified":"2023-07-06T22:01:33.205176+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9198":{"gid":9198,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/4072042723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":4072042723},{"type":"v1","addr":"172.21.15.55:6837","nonce":4072042723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-06T22:01:56.993 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 63 2023-07-06T22:01:56.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.995+0000 7f3dffd67640 1 -- 172.21.15.55:0/4007490535 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f3ddc0660d0 msgr2=0x7f3ddc068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.995+0000 7f3dffd67640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f3ddc0660d0 0x7f3ddc068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3df80c69b0 tx=0x7f3df4008040 comp rx=0 tx=0).stop 2023-07-06T22:01:56.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.995+0000 7f3dffd67640 1 -- 172.21.15.55:0/4007490535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3df80ccab0 msgr2=0x7f3df8150610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:56.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.995+0000 7f3dffd67640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3df80ccab0 0x7f3df8150610 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f3df001aff0 tx=0x7f3df00196e0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.995+0000 7f3dffd67640 1 -- 172.21.15.55:0/4007490535 shutdown_connections 2023-07-06T22:01:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.995+0000 7f3dffd67640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3df80ccab0 0x7f3df8150610 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.995+0000 7f3dffd67640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f3ddc0660d0 0x7f3ddc068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.995+0000 7f3dffd67640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3df80b7cd0 0x7f3df80c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.995+0000 7f3dffd67640 1 --2- 172.21.15.55:0/4007490535 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3df80b1fe0 0x7f3df8152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.995+0000 7f3dffd67640 1 -- 172.21.15.55:0/4007490535 >> 172.21.15.55:0/4007490535 conn(0x7f3df80ceee0 msgr2=0x7f3df806a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.995+0000 7f3dffd67640 1 -- 172.21.15.55:0/4007490535 shutdown_connections 2023-07-06T22:01:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:56.995+0000 7f3dffd67640 1 -- 172.21.15.55:0/4007490535 wait complete. 2023-07-06T22:01:57.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:01:57.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.155+0000 7f66d5e93640 1 Processor -- start 2023-07-06T22:01:57.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.155+0000 7f66d5e93640 1 -- start start 2023-07-06T22:01:57.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.155+0000 7f66d5e93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66d015b7e0 0x7f66d00cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:57.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.155+0000 7f66d5e93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66d0160300 0x7f66d00c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:57.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.155+0000 7f66d5e93640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d00cdc80 con 0x7f66d00c8a60 2023-07-06T22:01:57.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.155+0000 7f66d5e93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d00cd6c0 con 0x7f66d0160300 2023-07-06T22:01:57.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.155+0000 7f66d5e93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00cd9a0 con 0x7f66d015b7e0 2023-07-06T22:01:57.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.159+0000 7f66ceffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66d0160300 0x7f66d00c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:57.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.159+0000 7f66ceffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66d0160300 0x7f66d00c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58076/0 (socket says 172.21.15.55:58076) 2023-07-06T22:01:57.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.159+0000 7f66ceffd640 1 -- 172.21.15.55:0/1368051731 learned_addr learned my addr 172.21.15.55:0/1368051731 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:57.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.159+0000 7f66cf7fe640 1 --2- 172.21.15.55:0/1368051731 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66d015b7e0 0x7f66d00cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:57.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.159+0000 7f66ceffd640 1 -- 172.21.15.55:0/1368051731 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66d015b7e0 msgr2=0x7f66d00cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:57.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.159+0000 7f66ceffd640 1 --2- 172.21.15.55:0/1368051731 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66d015b7e0 0x7f66d00cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.159+0000 7f66ceffd640 1 -- 172.21.15.55:0/1368051731 >> v1:172.21.15.138:6789/0 conn(0x7f66d00c8a60 legacy=0x7f66d006b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:57.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.159+0000 7f66ceffd640 1 -- 172.21.15.55:0/1368051731 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d0069490 con 0x7f66d0160300 2023-07-06T22:01:57.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.159+0000 7f66ceffd640 1 --2- 172.21.15.55:0/1368051731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d0160300 0x7f66d00c8520 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f66c4009870 tx=0x7f66c401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f92fcf7f805c30 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:57.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.159+0000 7f66ce7fc640 1 -- 172.21.15.55:0/1368051731 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c40a95f0 con 0x7f66d0160300 2023-07-06T22:01:57.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.159+0000 7f66ce7fc640 1 -- 172.21.15.55:0/1368051731 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c40a9750 con 0x7f66d0160300 2023-07-06T22:01:57.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.159+0000 7f66ce7fc640 1 -- 172.21.15.55:0/1368051731 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c40a9ae0 con 0x7f66d0160300 2023-07-06T22:01:57.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 -- 172.21.15.55:0/1368051731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d0160300 msgr2=0x7f66d00c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:57.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 --2- 172.21.15.55:0/1368051731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d0160300 0x7f66d00c8520 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f66c4009870 tx=0x7f66c401c510 comp rx=0 tx=0).stop 2023-07-06T22:01:57.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 -- 172.21.15.55:0/1368051731 shutdown_connections 2023-07-06T22:01:57.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 --2- 172.21.15.55:0/1368051731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d0160300 0x7f66d00c8520 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 --2- 172.21.15.55:0/1368051731 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66d015b7e0 0x7f66d00cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 -- 172.21.15.55:0/1368051731 >> 172.21.15.55:0/1368051731 conn(0x7f66d00cded0 msgr2=0x7f66d00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:57.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 -- 172.21.15.55:0/1368051731 shutdown_connections 2023-07-06T22:01:57.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 -- 172.21.15.55:0/1368051731 wait complete. 2023-07-06T22:01:57.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 Processor -- start 2023-07-06T22:01:57.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 -- start start 2023-07-06T22:01:57.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66d00c8a60 0x7f66d01500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:57.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66d015b7e0 0x7f66d00c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:57.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d0160300 0x7f66d00c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:57.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00b2260 con 0x7f66d0160300 2023-07-06T22:01:57.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00c63b0 con 0x7f66d015b7e0 2023-07-06T22:01:57.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66d5e93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00c6f80 con 0x7f66d00c8a60 2023-07-06T22:01:57.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66cffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d0160300 0x7f66d00c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:57.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66cffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d0160300 0x7f66d00c54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58080/0 (socket says 172.21.15.55:58080) 2023-07-06T22:01:57.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66cffff640 1 -- 172.21.15.55:0/3157911818 learned_addr learned my addr 172.21.15.55:0/3157911818 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:57.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66ceffd640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66d015b7e0 0x7f66d00c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:57.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.163+0000 7f66cf7fe640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66d00c8a60 0x7f66d01500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:57.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66cffff640 1 -- 172.21.15.55:0/3157911818 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66d00c8a60 msgr2=0x7f66d01500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:57.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66cffff640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66d00c8a60 0x7f66d01500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66cffff640 1 -- 172.21.15.55:0/3157911818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66d015b7e0 msgr2=0x7f66d00c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:57.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66cffff640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66d015b7e0 0x7f66d00c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66cffff640 1 -- 172.21.15.55:0/3157911818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c40094d0 con 0x7f66d0160300 2023-07-06T22:01:57.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66cf7fe640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66d00c8a60 0x7f66d01500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:01:57.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66cffff640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d0160300 0x7f66d00c54e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f66c800c700 tx=0x7f66c800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:57.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66b7fff640 1 -- 172.21.15.55:0/3157911818 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8003b80 con 0x7f66d0160300 2023-07-06T22:01:57.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66b7fff640 1 -- 172.21.15.55:0/3157911818 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c8003ce0 con 0x7f66d0160300 2023-07-06T22:01:57.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66b7fff640 1 -- 172.21.15.55:0/3157911818 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c800aa90 con 0x7f66d0160300 2023-07-06T22:01:57.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66d5e93640 1 -- 172.21.15.55:0/3157911818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d0150620 con 0x7f66d0160300 2023-07-06T22:01:57.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66d5e93640 1 -- 172.21.15.55:0/3157911818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d00c60d0 con 0x7f66d0160300 2023-07-06T22:01:57.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66d5e93640 1 -- 172.21.15.55:0/3157911818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d0066d60 con 0x7f66d0160300 2023-07-06T22:01:57.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66b7fff640 1 -- 172.21.15.55:0/3157911818 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 77) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f66c800abf0 con 0x7f66d0160300 2023-07-06T22:01:57.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.167+0000 7f66b7fff640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f66bc0660d0 0x7f66bc068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:57.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.171+0000 7f66b7fff640 1 -- 172.21.15.55:0/3157911818 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 7141+0+0 (secure 0 0 0) 0x7f66c8083c50 con 0x7f66d0160300 2023-07-06T22:01:57.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.171+0000 7f66cf7fe640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f66bc0660d0 0x7f66bc068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:57.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.171+0000 7f66cf7fe640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f66bc0660d0 0x7f66bc068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009ae0 tx=0x7f66c0008040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:57.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.175+0000 7f66b7fff640 1 -- 172.21.15.55:0/3157911818 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f66c8050f00 con 0x7f66d0160300 2023-07-06T22:01:57.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.263+0000 7f66b7fff640 1 -- 172.21.15.55:0/3157911818 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f66c80512d0 con 0x7f66d0160300 2023-07-06T22:01:57.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.331+0000 7f66d5e93640 1 -- 172.21.15.55:0/3157911818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66d00c7360 con 0x7f66d0160300 2023-07-06T22:01:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.335+0000 7f66b7fff640 1 -- 172.21.15.55:0/3157911818 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+19659 (secure 0 0 0) 0x7f66c8070690 con 0x7f66d0160300 2023-07-06T22:01:57.333 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:01:57.333 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":148,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:01:54.831917+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:01:28.023569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-07-06T22:01:29.170296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/1150117832":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/2778588340":"2023-07-07T22:01:54.831883+0000","172.21.15.55:6833/462110382":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/2978696860":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3247819093":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3847009850":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/4284141340":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3374210555":"2023-07-07T22:01:47.217185+0000","172.21.15.55:6833/206120108":"2023-07-07T22:01:47.217185+0000","172.21.15.55:6832/206120108":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/1122193584":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/2036406408":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/1372487043":"2023-07-07T22:01:47.217185+0000","172.21.15.55:6832/462110382":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3843098755":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/1981543070":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3618722598":"2023-07-07T22:01:47.217185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.335+0000 7f66d5e93640 1 -- 172.21.15.55:0/3157911818 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f66bc0660d0 msgr2=0x7f66bc068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.335+0000 7f66d5e93640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f66bc0660d0 0x7f66bc068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009ae0 tx=0x7f66c0008040 comp rx=0 tx=0).stop 2023-07-06T22:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.335+0000 7f66d5e93640 1 -- 172.21.15.55:0/3157911818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d0160300 msgr2=0x7f66d00c54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.335+0000 7f66d5e93640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d0160300 0x7f66d00c54e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f66c800c700 tx=0x7f66c800cbc0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.335+0000 7f66d5e93640 1 -- 172.21.15.55:0/3157911818 shutdown_connections 2023-07-06T22:01:57.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.335+0000 7f66d5e93640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d0160300 0x7f66d00c54e0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.335+0000 7f66d5e93640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f66bc0660d0 0x7f66bc068580 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.335+0000 7f66d5e93640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66d015b7e0 0x7f66d00c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.335+0000 7f66d5e93640 1 --2- 172.21.15.55:0/3157911818 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66d00c8a60 0x7f66d01500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.335+0000 7f66d5e93640 1 -- 172.21.15.55:0/3157911818 >> 172.21.15.55:0/3157911818 conn(0x7f66d00cded0 msgr2=0x7f66d006b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:57.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.335+0000 7f66d5e93640 1 -- 172.21.15.55:0/3157911818 shutdown_connections 2023-07-06T22:01:57.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.335+0000 7f66d5e93640 1 -- 172.21.15.55:0/3157911818 wait complete. 2023-07-06T22:01:57.354 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T22:01:57.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.499+0000 7f780c448640 1 Processor -- start 2023-07-06T22:01:57.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.499+0000 7f780c448640 1 -- start start 2023-07-06T22:01:57.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.499+0000 7f780c448640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f780406fff0 0x7f7804070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.499+0000 7f780c448640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f78040b2ca0 0x7f78040b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.499+0000 7f780c448640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78040cd490 con 0x7f78041597d0 2023-07-06T22:01:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.499+0000 7f780c448640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7804070960 con 0x7f78040b2ca0 2023-07-06T22:01:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.499+0000 7f780c448640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780415cf60 con 0x7f780406fff0 2023-07-06T22:01:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.499+0000 7f780a9e5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f78040b2ca0 0x7f78040b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.499+0000 7f780a9e5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f78040b2ca0 0x7f78040b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58088/0 (socket says 172.21.15.55:58088) 2023-07-06T22:01:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.499+0000 7f780a9e5640 1 -- 172.21.15.55:0/4078231794 learned_addr learned my addr 172.21.15.55:0/4078231794 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:57.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.499+0000 7f78099e3640 1 --2- 172.21.15.55:0/4078231794 >> v2:172.21.15.138:3300/0 conn(0x7f780406fff0 0x7f7804070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:57.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.503+0000 7f780a9e5640 1 -- 172.21.15.55:0/4078231794 >> v2:172.21.15.138:3300/0 conn(0x7f780406fff0 msgr2=0x7f7804070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:57.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.503+0000 7f780a9e5640 1 --2- 172.21.15.55:0/4078231794 >> v2:172.21.15.138:3300/0 conn(0x7f780406fff0 0x7f7804070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.503+0000 7f780a9e5640 1 -- 172.21.15.55:0/4078231794 >> v1:172.21.15.138:6789/0 conn(0x7f78041597d0 legacy=0x7f78040ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:57.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.503+0000 7f780a9e5640 1 -- 172.21.15.55:0/4078231794 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78040ccb60 con 0x7f78040b2ca0 2023-07-06T22:01:57.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.503+0000 7f780a9e5640 1 --2- 172.21.15.55:0/4078231794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78040b2ca0 0x7f78040b3120 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f78040cc560 tx=0x7f77fc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1b867d93cacfc4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:57.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.503+0000 7f78091e2640 1 -- 172.21.15.55:0/4078231794 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78040b3e70 con 0x7f78040b2ca0 2023-07-06T22:01:57.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.503+0000 7f78091e2640 1 -- 172.21.15.55:0/4078231794 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc0a57d0 con 0x7f78040b2ca0 2023-07-06T22:01:57.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.503+0000 7f78091e2640 1 -- 172.21.15.55:0/4078231794 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0a5b60 con 0x7f78040b2ca0 2023-07-06T22:01:57.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.503+0000 7f780c448640 1 -- 172.21.15.55:0/4078231794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78040b2ca0 msgr2=0x7f78040b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:57.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.503+0000 7f780c448640 1 --2- 172.21.15.55:0/4078231794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78040b2ca0 0x7f78040b3120 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f78040cc560 tx=0x7f77fc01c910 comp rx=0 tx=0).stop 2023-07-06T22:01:57.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.503+0000 7f780c448640 1 -- 172.21.15.55:0/4078231794 shutdown_connections 2023-07-06T22:01:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.503+0000 7f780c448640 1 --2- 172.21.15.55:0/4078231794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78040b2ca0 0x7f78040b3120 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.503+0000 7f780c448640 1 --2- 172.21.15.55:0/4078231794 >> v2:172.21.15.138:3300/0 conn(0x7f780406fff0 0x7f7804070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.503+0000 7f780c448640 1 -- 172.21.15.55:0/4078231794 >> 172.21.15.55:0/4078231794 conn(0x7f78040cb970 msgr2=0x7f78040cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f780c448640 1 -- 172.21.15.55:0/4078231794 shutdown_connections 2023-07-06T22:01:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f780c448640 1 -- 172.21.15.55:0/4078231794 wait complete. 2023-07-06T22:01:57.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f780c448640 1 Processor -- start 2023-07-06T22:01:57.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f780c448640 1 -- start start 2023-07-06T22:01:57.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f780c448640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f780406fff0 0x7f7804148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:57.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f780c448640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78040b2ca0 0x7f78041588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:57.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f780c448640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78040ca740 0x7f78040c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:57.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f780c448640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7804148480 con 0x7f78040b2ca0 2023-07-06T22:01:57.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f780c448640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780414cce0 con 0x7f78040ca740 2023-07-06T22:01:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f780c448640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7804148670 con 0x7f780406fff0 2023-07-06T22:01:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f78099e3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78040b2ca0 0x7f78041588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f78099e3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78040b2ca0 0x7f78041588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58098/0 (socket says 172.21.15.55:58098) 2023-07-06T22:01:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f78099e3640 1 -- 172.21.15.55:0/3011118092 learned_addr learned my addr 172.21.15.55:0/3011118092 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f780a9e5640 1 --2- 172.21.15.55:0/3011118092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78040ca740 0x7f78040c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f780a1e4640 1 --2- 172.21.15.55:0/3011118092 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f780406fff0 0x7f7804148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:57.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f78099e3640 1 -- 172.21.15.55:0/3011118092 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f780406fff0 msgr2=0x7f7804148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:57.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f78099e3640 1 --2- 172.21.15.55:0/3011118092 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f780406fff0 0x7f7804148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f78099e3640 1 -- 172.21.15.55:0/3011118092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78040ca740 msgr2=0x7f78040c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:57.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f78099e3640 1 --2- 172.21.15.55:0/3011118092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78040ca740 0x7f78040c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:57.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f78099e3640 1 -- 172.21.15.55:0/3011118092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc009b30 con 0x7f78040b2ca0 2023-07-06T22:01:57.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f78099e3640 1 --2- 172.21.15.55:0/3011118092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78040b2ca0 0x7f78041588b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f77f400e930 tx=0x7f77f400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:57.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f77faffd640 1 -- 172.21.15.55:0/3011118092 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4009690 con 0x7f78040b2ca0 2023-07-06T22:01:57.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f77faffd640 1 -- 172.21.15.55:0/3011118092 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f400ca00 con 0x7f78040b2ca0 2023-07-06T22:01:57.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f77faffd640 1 -- 172.21.15.55:0/3011118092 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f400cd70 con 0x7f78040b2ca0 2023-07-06T22:01:57.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.507+0000 7f780c448640 1 -- 172.21.15.55:0/3011118092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7804148950 con 0x7f78040b2ca0 2023-07-06T22:01:57.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.511+0000 7f780c448640 1 -- 172.21.15.55:0/3011118092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780414c900 con 0x7f78040b2ca0 2023-07-06T22:01:57.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.511+0000 7f780c448640 1 -- 172.21.15.55:0/3011118092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7804066d60 con 0x7f78040b2ca0 2023-07-06T22:01:57.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.511+0000 7f77faffd640 1 -- 172.21.15.55:0/3011118092 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f77f4013470 con 0x7f78040b2ca0 2023-07-06T22:01:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.511+0000 7f77faffd640 1 --2- 172.21.15.55:0/3011118092 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f77e80663a0 0x7f77e8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.511+0000 7f77faffd640 1 -- 172.21.15.55:0/3011118092 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 7141+0+0 (secure 0 0 0) 0x7f77f4084860 con 0x7f78040b2ca0 2023-07-06T22:01:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.511+0000 7f780a1e4640 1 --2- 172.21.15.55:0/3011118092 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f77e80663a0 0x7f77e8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.511+0000 7f780a1e4640 1 --2- 172.21.15.55:0/3011118092 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f77e80663a0 0x7f77e8068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7800007fd0 tx=0x7f7800009040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:57.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.515+0000 7f77faffd640 1 -- 172.21.15.55:0/3011118092 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f77f40518f0 con 0x7f78040b2ca0 2023-07-06T22:01:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:57.703+0000 7f780c448640 1 -- 172.21.15.55:0/3011118092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f78040c5cf0 con 0x7f78040b2ca0 2023-07-06T22:01:58.258 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-07-06T22:01:58.259+0000 7f5b6d80c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T22:01:58.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.267+0000 7f77faffd640 1 -- 172.21.15.55:0/3011118092 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) v1 ==== 161+0+0 (secure 0 0 0) 0x7f77f4054f10 con 0x7f78040b2ca0 2023-07-06T22:01:58.265 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T22:01:58.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.267+0000 7f780c448640 1 -- 172.21.15.55:0/3011118092 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f77e80663a0 msgr2=0x7f77e8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:58.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.267+0000 7f780c448640 1 --2- 172.21.15.55:0/3011118092 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f77e80663a0 0x7f77e8068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7800007fd0 tx=0x7f7800009040 comp rx=0 tx=0).stop 2023-07-06T22:01:58.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.267+0000 7f780c448640 1 -- 172.21.15.55:0/3011118092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78040b2ca0 msgr2=0x7f78041588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:58.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.267+0000 7f780c448640 1 --2- 172.21.15.55:0/3011118092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78040b2ca0 0x7f78041588b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f77f400e930 tx=0x7f77f400edf0 comp rx=0 tx=0).stop 2023-07-06T22:01:58.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.267+0000 7f780c448640 1 -- 172.21.15.55:0/3011118092 shutdown_connections 2023-07-06T22:01:58.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.267+0000 7f780c448640 1 --2- 172.21.15.55:0/3011118092 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f77e80663a0 0x7f77e8068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:58.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.267+0000 7f780c448640 1 --2- 172.21.15.55:0/3011118092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78040ca740 0x7f78040c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:58.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.267+0000 7f780c448640 1 --2- 172.21.15.55:0/3011118092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78040b2ca0 0x7f78041588b0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:58.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.267+0000 7f780c448640 1 --2- 172.21.15.55:0/3011118092 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f780406fff0 0x7f7804148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:58.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.267+0000 7f780c448640 1 -- 172.21.15.55:0/3011118092 >> 172.21.15.55:0/3011118092 conn(0x7f78040cb970 msgr2=0x7f780415d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:58.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.271+0000 7f780c448640 1 -- 172.21.15.55:0/3011118092 shutdown_connections 2023-07-06T22:01:58.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.271+0000 7f780c448640 1 -- 172.21.15.55:0/3011118092 wait complete. 2023-07-06T22:01:58.275 INFO:tasks.ceph.mds.a.smithi055.stderr: -4075> 2023-07-06T22:01:35.740+0000 7f70fb8c5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T22:01:58.293 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T22:01:58.330 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-07-06T22:01:58.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.447+0000 7f6f51607640 1 Processor -- start 2023-07-06T22:01:58.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f51607640 1 -- start start 2023-07-06T22:01:58.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f51607640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f4c1597d0 0x7f6f4c0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:58.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f51607640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f4c0cac10 0x7f6f4c06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:58.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f51607640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4c0cd490 con 0x7f6f4c070530 2023-07-06T22:01:58.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f51607640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4c0cb040 con 0x7f6f4c0cac10 2023-07-06T22:01:58.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f51607640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c0709b0 con 0x7f6f4c1597d0 2023-07-06T22:01:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f4a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f4c0cac10 0x7f6f4c06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f4a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f4c0cac10 0x7f6f4c06fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58126/0 (socket says 172.21.15.55:58126) 2023-07-06T22:01:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f4a7fc640 1 -- 172.21.15.55:0/322902625 learned_addr learned my addr 172.21.15.55:0/322902625 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f4b7fe640 1 --1- 172.21.15.55:0/322902625 >> v1:172.21.15.55:6789/0 conn(0x7f6f4c070530 0x7f6f4c0c94b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53862/0 (socket says 172.21.15.55:53862) 2023-07-06T22:01:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f4affd640 1 --2- 172.21.15.55:0/322902625 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f4c1597d0 0x7f6f4c0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:58.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f4a7fc640 1 -- 172.21.15.55:0/322902625 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f4c1597d0 msgr2=0x7f6f4c0ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:58.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f4a7fc640 1 --2- 172.21.15.55:0/322902625 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f4c1597d0 0x7f6f4c0ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:58.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f4a7fc640 1 -- 172.21.15.55:0/322902625 >> v1:172.21.15.55:6789/0 conn(0x7f6f4c070530 legacy=0x7f6f4c0c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:58.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f4a7fc640 1 -- 172.21.15.55:0/322902625 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c15cf60 con 0x7f6f4c0cac10 2023-07-06T22:01:58.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f4affd640 1 --2- 172.21.15.55:0/322902625 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f4c1597d0 0x7f6f4c0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:58.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.451+0000 7f6f49ffb640 1 -- 172.21.15.55:0/322902625 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789014790 0 0) 0x7f6f4c0cd490 con 0x7f6f4c070530 2023-07-06T22:01:58.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.455+0000 7f6f4a7fc640 1 --2- 172.21.15.55:0/322902625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c0cac10 0x7f6f4c06fff0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009870 tx=0x7f6f4001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491ae31ae3fdc864 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:58.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.455+0000 7f6f49ffb640 1 -- 172.21.15.55:0/322902625 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400ac600 con 0x7f6f4c0cac10 2023-07-06T22:01:58.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.455+0000 7f6f49ffb640 1 -- 172.21.15.55:0/322902625 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f400a8050 con 0x7f6f4c0cac10 2023-07-06T22:01:58.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.455+0000 7f6f49ffb640 1 -- 172.21.15.55:0/322902625 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400ac980 con 0x7f6f4c0cac10 2023-07-06T22:01:58.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.455+0000 7f6f51607640 1 -- 172.21.15.55:0/322902625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c0cac10 msgr2=0x7f6f4c06fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:58.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.455+0000 7f6f51607640 1 --2- 172.21.15.55:0/322902625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c0cac10 0x7f6f4c06fff0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009870 tx=0x7f6f4001c480 comp rx=0 tx=0).stop 2023-07-06T22:01:58.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.455+0000 7f6f51607640 1 -- 172.21.15.55:0/322902625 shutdown_connections 2023-07-06T22:01:58.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.455+0000 7f6f51607640 1 --2- 172.21.15.55:0/322902625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c0cac10 0x7f6f4c06fff0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:58.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.455+0000 7f6f51607640 1 --2- 172.21.15.55:0/322902625 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f4c1597d0 0x7f6f4c0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:58.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.455+0000 7f6f51607640 1 -- 172.21.15.55:0/322902625 >> 172.21.15.55:0/322902625 conn(0x7f6f4c0cb970 msgr2=0x7f6f4c0cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:58.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.455+0000 7f6f51607640 1 -- 172.21.15.55:0/322902625 shutdown_connections 2023-07-06T22:01:58.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.455+0000 7f6f51607640 1 -- 172.21.15.55:0/322902625 wait complete. 2023-07-06T22:01:58.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.455+0000 7f6f51607640 1 Processor -- start 2023-07-06T22:01:58.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.455+0000 7f6f51607640 1 -- start start 2023-07-06T22:01:58.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f51607640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c070530 0x7f6f4c14dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:58.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f51607640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f4c0cac10 0x7f6f4c15e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:58.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f51607640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f4c14e8b0 0x7f6f4c0c3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:58.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f51607640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c14e240 con 0x7f6f4c070530 2023-07-06T22:01:58.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f51607640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c149350 con 0x7f6f4c0cac10 2023-07-06T22:01:58.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f51607640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c149630 con 0x7f6f4c14e8b0 2023-07-06T22:01:58.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f4affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c070530 0x7f6f4c14dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:58.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f4affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c070530 0x7f6f4c14dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58142/0 (socket says 172.21.15.55:58142) 2023-07-06T22:01:58.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f4affd640 1 -- 172.21.15.55:0/2090974559 learned_addr learned my addr 172.21.15.55:0/2090974559 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:58.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f4a7fc640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f4c0cac10 0x7f6f4c15e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:58.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f4b7fe640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f4c14e8b0 0x7f6f4c0c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:58.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f4affd640 1 -- 172.21.15.55:0/2090974559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f4c14e8b0 msgr2=0x7f6f4c0c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:58.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f4affd640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f4c14e8b0 0x7f6f4c0c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:58.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f4affd640 1 -- 172.21.15.55:0/2090974559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f4c0cac10 msgr2=0x7f6f4c15e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:58.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f4affd640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f4c0cac10 0x7f6f4c15e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:58.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f4affd640 1 -- 172.21.15.55:0/2090974559 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f400094d0 con 0x7f6f4c070530 2023-07-06T22:01:58.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f4a7fc640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f4c0cac10 0x7f6f4c15e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:58.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f4affd640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c070530 0x7f6f4c14dd00 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00d800 tx=0x7f6f3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:58.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f337fe640 1 -- 172.21.15.55:0/2090974559 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0096c0 con 0x7f6f4c070530 2023-07-06T22:01:58.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f337fe640 1 -- 172.21.15.55:0/2090974559 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c009820 con 0x7f6f4c070530 2023-07-06T22:01:58.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f51607640 1 -- 172.21.15.55:0/2090974559 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f4c0c2a30 con 0x7f6f4c070530 2023-07-06T22:01:58.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f337fe640 1 -- 172.21.15.55:0/2090974559 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c009bd0 con 0x7f6f4c070530 2023-07-06T22:01:58.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f51607640 1 -- 172.21.15.55:0/2090974559 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4c149910 con 0x7f6f4c070530 2023-07-06T22:01:58.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.459+0000 7f6f51607640 1 -- 172.21.15.55:0/2090974559 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4c066d60 con 0x7f6f4c070530 2023-07-06T22:01:58.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.463+0000 7f6f337fe640 1 -- 172.21.15.55:0/2090974559 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6f3c009d30 con 0x7f6f4c070530 2023-07-06T22:01:58.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.463+0000 7f6f337fe640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f6f380663a0 0x7f6f38068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:58.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.463+0000 7f6f337fe640 1 -- 172.21.15.55:0/2090974559 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 7227+0+0 (secure 0 0 0) 0x7f6f3c084ad0 con 0x7f6f4c070530 2023-07-06T22:01:58.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.463+0000 7f6f4a7fc640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f6f380663a0 0x7f6f38068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:58.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.463+0000 7f6f4a7fc640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f6f380663a0 0x7f6f38068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6f400ae000 tx=0x7f6f400a7000 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.467+0000 7f6f337fe640 1 -- 172.21.15.55:0/2090974559 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f3c0519a0 con 0x7f6f4c070530 2023-07-06T22:01:58.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:58.651+0000 7f6f51607640 1 -- 172.21.15.55:0/2090974559 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6f4c0b4e50 con 0x7f6f4c070530 2023-07-06T22:01:59.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.279+0000 7f6f337fe640 1 -- 172.21.15.55:0/2090974559 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6f3c054fc0 con 0x7f6f4c070530 2023-07-06T22:01:59.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.283+0000 7f6f51607640 1 -- 172.21.15.55:0/2090974559 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f6f380663a0 msgr2=0x7f6f38068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:59.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.283+0000 7f6f51607640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f6f380663a0 0x7f6f38068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6f400ae000 tx=0x7f6f400a7000 comp rx=0 tx=0).stop 2023-07-06T22:01:59.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.283+0000 7f6f51607640 1 -- 172.21.15.55:0/2090974559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c070530 msgr2=0x7f6f4c14dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:59.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.283+0000 7f6f51607640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c070530 0x7f6f4c14dd00 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00d800 tx=0x7f6f3c00dcc0 comp rx=0 tx=0).stop 2023-07-06T22:01:59.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.283+0000 7f6f51607640 1 -- 172.21.15.55:0/2090974559 shutdown_connections 2023-07-06T22:01:59.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.283+0000 7f6f51607640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f4c14e8b0 0x7f6f4c0c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:59.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.283+0000 7f6f51607640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f6f380663a0 0x7f6f38068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:59.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.283+0000 7f6f51607640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f4c0cac10 0x7f6f4c15e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:59.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.283+0000 7f6f51607640 1 --2- 172.21.15.55:0/2090974559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c070530 0x7f6f4c14dd00 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:59.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.283+0000 7f6f51607640 1 -- 172.21.15.55:0/2090974559 >> 172.21.15.55:0/2090974559 conn(0x7f6f4c0cb970 msgr2=0x7f6f4c0b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:59.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.283+0000 7f6f51607640 1 -- 172.21.15.55:0/2090974559 shutdown_connections 2023-07-06T22:01:59.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.283+0000 7f6f51607640 1 -- 172.21.15.55:0/2090974559 wait complete. 2023-07-06T22:01:59.305 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T22:01:59.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.503+0000 7f6716782640 1 Processor -- start 2023-07-06T22:01:59.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.503+0000 7f6716782640 1 -- start start 2023-07-06T22:01:59.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.503+0000 7f6716782640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f67100cc2e0 0x7f671015f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:59.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.503+0000 7f6716782640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f67100cd0f0 0x7f671015fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:59.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.503+0000 7f6716782640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67100b5880 con 0x7f671015b930 2023-07-06T22:01:59.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.503+0000 7f6716782640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67100b5b60 con 0x7f67100cc2e0 2023-07-06T22:01:59.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.503+0000 7f6716782640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67100cdcb0 con 0x7f67100cd0f0 2023-07-06T22:01:59.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.503+0000 7f670f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f67100cc2e0 0x7f671015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:59.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.503+0000 7f670f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f67100cc2e0 0x7f671015f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58144/0 (socket says 172.21.15.55:58144) 2023-07-06T22:01:59.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.503+0000 7f670f7fe640 1 -- 172.21.15.55:0/3131188585 learned_addr learned my addr 172.21.15.55:0/3131188585 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:59.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.503+0000 7f6714d1f640 1 --2- 172.21.15.55:0/3131188585 >> v2:172.21.15.138:3300/0 conn(0x7f67100cd0f0 0x7f671015fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:59.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.507+0000 7f670f7fe640 1 -- 172.21.15.55:0/3131188585 >> v2:172.21.15.138:3300/0 conn(0x7f67100cd0f0 msgr2=0x7f671015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:01:59.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.507+0000 7f670f7fe640 1 --2- 172.21.15.55:0/3131188585 >> v2:172.21.15.138:3300/0 conn(0x7f67100cd0f0 0x7f671015fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:59.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.507+0000 7f670f7fe640 1 -- 172.21.15.55:0/3131188585 >> v1:172.21.15.138:6789/0 conn(0x7f671015b930 legacy=0x7f67100cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:59.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.507+0000 7f670f7fe640 1 -- 172.21.15.55:0/3131188585 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67100cdf90 con 0x7f67100cc2e0 2023-07-06T22:01:59.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.507+0000 7f6714d1f640 1 --2- 172.21.15.55:0/3131188585 >> v2:172.21.15.138:3300/0 conn(0x7f67100cd0f0 0x7f671015fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:01:59.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.507+0000 7f670f7fe640 1 --2- 172.21.15.55:0/3131188585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67100cc2e0 0x7f671015f520 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f671015f480 tx=0x7f670401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc2fb1a40dc39e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.507+0000 7f670effd640 1 -- 172.21.15.55:0/3131188585 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040aa650 con 0x7f67100cc2e0 2023-07-06T22:01:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.507+0000 7f670effd640 1 -- 172.21.15.55:0/3131188585 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67040aa7b0 con 0x7f67100cc2e0 2023-07-06T22:01:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.507+0000 7f670effd640 1 -- 172.21.15.55:0/3131188585 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040aab40 con 0x7f67100cc2e0 2023-07-06T22:01:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.507+0000 7f6716782640 1 -- 172.21.15.55:0/3131188585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67100cc2e0 msgr2=0x7f671015f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.507+0000 7f6716782640 1 --2- 172.21.15.55:0/3131188585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67100cc2e0 0x7f671015f520 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f671015f480 tx=0x7f670401c4d0 comp rx=0 tx=0).stop 2023-07-06T22:01:59.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6716782640 1 -- 172.21.15.55:0/3131188585 shutdown_connections 2023-07-06T22:01:59.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6716782640 1 --2- 172.21.15.55:0/3131188585 >> v2:172.21.15.138:3300/0 conn(0x7f67100cd0f0 0x7f671015fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:59.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6716782640 1 --2- 172.21.15.55:0/3131188585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67100cc2e0 0x7f671015f520 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:59.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6716782640 1 -- 172.21.15.55:0/3131188585 >> 172.21.15.55:0/3131188585 conn(0x7f67100d0c60 msgr2=0x7f67100b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:01:59.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6716782640 1 -- 172.21.15.55:0/3131188585 shutdown_connections 2023-07-06T22:01:59.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6716782640 1 -- 172.21.15.55:0/3131188585 wait complete. 2023-07-06T22:01:59.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6716782640 1 Processor -- start 2023-07-06T22:01:59.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6716782640 1 -- start start 2023-07-06T22:01:59.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6716782640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67100cd0f0 0x7f67100c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:59.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6716782640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f671015b930 0x7f6710155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:59.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6716782640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f671014e860 0x7f6710156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:59.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6716782640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67100c3850 con 0x7f671014e860 2023-07-06T22:01:59.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6716782640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6710155f30 con 0x7f67100cd0f0 2023-07-06T22:01:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6716782640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6710156210 con 0x7f671015b930 2023-07-06T22:01:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6714d1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f671014e860 0x7f6710156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6714d1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f671014e860 0x7f6710156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58154/0 (socket says 172.21.15.55:58154) 2023-07-06T22:01:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6714d1f640 1 -- 172.21.15.55:0/1192006588 learned_addr learned my addr 172.21.15.55:0/1192006588 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:01:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f670f7fe640 1 --2- 172.21.15.55:0/1192006588 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f671015b930 0x7f6710155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f670ffff640 1 --2- 172.21.15.55:0/1192006588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67100cd0f0 0x7f67100c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6714d1f640 1 -- 172.21.15.55:0/1192006588 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f671015b930 msgr2=0x7f6710155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6714d1f640 1 --2- 172.21.15.55:0/1192006588 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f671015b930 0x7f6710155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6714d1f640 1 -- 172.21.15.55:0/1192006588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67100cd0f0 msgr2=0x7f67100c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:01:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6714d1f640 1 --2- 172.21.15.55:0/1192006588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67100cd0f0 0x7f67100c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:01:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.511+0000 7f6714d1f640 1 -- 172.21.15.55:0/1192006588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67040094d0 con 0x7f671014e860 2023-07-06T22:01:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.515+0000 7f6714d1f640 1 --2- 172.21.15.55:0/1192006588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f671014e860 0x7f6710156cc0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f6708007ec0 tx=0x7f670800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.515+0000 7f670cff9640 1 -- 172.21.15.55:0/1192006588 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708003ba0 con 0x7f671014e860 2023-07-06T22:01:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.515+0000 7f670cff9640 1 -- 172.21.15.55:0/1192006588 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670800f040 con 0x7f671014e860 2023-07-06T22:01:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.515+0000 7f670cff9640 1 -- 172.21.15.55:0/1192006588 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670800de80 con 0x7f671014e860 2023-07-06T22:01:59.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.515+0000 7f6716782640 1 -- 172.21.15.55:0/1192006588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67100c3aa0 con 0x7f671014e860 2023-07-06T22:01:59.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.515+0000 7f6716782640 1 -- 172.21.15.55:0/1192006588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6710155c40 con 0x7f671014e860 2023-07-06T22:01:59.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.515+0000 7f6716782640 1 -- 172.21.15.55:0/1192006588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6710066d60 con 0x7f671014e860 2023-07-06T22:01:59.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.515+0000 7f670cff9640 1 -- 172.21.15.55:0/1192006588 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6708004030 con 0x7f671014e860 2023-07-06T22:01:59.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.515+0000 7f670cff9640 1 --2- 172.21.15.55:0/1192006588 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f66fc0663a0 0x7f66fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:01:59.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.515+0000 7f670cff9640 1 -- 172.21.15.55:0/1192006588 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 7227+0+0 (secure 0 0 0) 0x7f6708084770 con 0x7f671014e860 2023-07-06T22:01:59.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.515+0000 7f670ffff640 1 --2- 172.21.15.55:0/1192006588 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f66fc0663a0 0x7f66fc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:01:59.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.519+0000 7f670ffff640 1 --2- 172.21.15.55:0/1192006588 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f66fc0663a0 0x7f66fc068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6700007fd0 tx=0x7f6700009040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:01:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.519+0000 7f670cff9640 1 -- 172.21.15.55:0/1192006588 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6708051550 con 0x7f671014e860 2023-07-06T22:01:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:01:59.679+0000 7f6716782640 1 -- 172.21.15.55:0/1192006588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f67100b2060 con 0x7f671014e860 2023-07-06T22:02:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.283+0000 7f670cff9640 1 -- 172.21.15.55:0/1192006588 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v150) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6708054b70 con 0x7f671014e860 2023-07-06T22:02:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-07-06T22:02:00.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.287+0000 7f6716782640 1 -- 172.21.15.55:0/1192006588 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f66fc0663a0 msgr2=0x7f66fc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:00.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.287+0000 7f6716782640 1 --2- 172.21.15.55:0/1192006588 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f66fc0663a0 0x7f66fc068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6700007fd0 tx=0x7f6700009040 comp rx=0 tx=0).stop 2023-07-06T22:02:00.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.287+0000 7f6716782640 1 -- 172.21.15.55:0/1192006588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f671014e860 msgr2=0x7f6710156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:00.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.287+0000 7f6716782640 1 --2- 172.21.15.55:0/1192006588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f671014e860 0x7f6710156cc0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f6708007ec0 tx=0x7f670800d4a0 comp rx=0 tx=0).stop 2023-07-06T22:02:00.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.287+0000 7f6716782640 1 -- 172.21.15.55:0/1192006588 shutdown_connections 2023-07-06T22:02:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.287+0000 7f6716782640 1 --2- 172.21.15.55:0/1192006588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f671014e860 0x7f6710156cc0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.287+0000 7f6716782640 1 --2- 172.21.15.55:0/1192006588 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f671015b930 0x7f6710155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.287+0000 7f6716782640 1 --2- 172.21.15.55:0/1192006588 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f66fc0663a0 0x7f66fc068850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.287+0000 7f6716782640 1 --2- 172.21.15.55:0/1192006588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67100cd0f0 0x7f67100c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.287+0000 7f6716782640 1 -- 172.21.15.55:0/1192006588 >> 172.21.15.55:0/1192006588 conn(0x7f67100d0c60 msgr2=0x7f671015e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.287+0000 7f6716782640 1 -- 172.21.15.55:0/1192006588 shutdown_connections 2023-07-06T22:02:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.287+0000 7f6716782640 1 -- 172.21.15.55:0/1192006588 wait complete. 2023-07-06T22:02:00.308 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T22:02:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.459+0000 7f73e92cb640 1 Processor -- start 2023-07-06T22:02:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.459+0000 7f73e92cb640 1 -- start start 2023-07-06T22:02:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.463+0000 7f73e92cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73e406bc00 0x7f73e406c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:00.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.463+0000 7f73e92cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e4159350 con 0x7f73e40cd3e0 2023-07-06T22:02:00.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.463+0000 7f73e92cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e4158d90 con 0x7f73e40c8910 2023-07-06T22:02:00.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.463+0000 7f73e92cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40ccf50 con 0x7f73e406bc00 2023-07-06T22:02:00.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.463+0000 7f73e2ffd640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f73e40c8910 0x7f73e4158360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:39026/0 (socket says 172.21.15.55:39026) 2023-07-06T22:02:00.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.463+0000 7f73e2ffd640 1 -- 172.21.15.55:0/3336066614 learned_addr learned my addr 172.21.15.55:0/3336066614 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:00.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.463+0000 7f73e37fe640 1 --2- 172.21.15.55:0/3336066614 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73e406bc00 0x7f73e406c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.463+0000 7f73e27fc640 1 -- 172.21.15.55:0/3336066614 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841889815 0 0) 0x7f73e4158d90 con 0x7f73e40c8910 2023-07-06T22:02:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.463+0000 7f73e27fc640 1 -- 172.21.15.55:0/3336066614 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73d0003450 con 0x7f73e40c8910 2023-07-06T22:02:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.463+0000 7f73e37fe640 1 -- 172.21.15.55:0/3336066614 >> v1:172.21.15.138:6789/0 conn(0x7f73e40c8910 legacy=0x7f73e4158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:00.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.463+0000 7f73e37fe640 1 -- 172.21.15.55:0/3336066614 >> v1:172.21.15.55:6789/0 conn(0x7f73e40cd3e0 legacy=0x7f73e40cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:00.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.463+0000 7f73e27fc640 1 -- 172.21.15.55:0/3336066614 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436859997 0 0) 0x7f73e4159350 con 0x7f73e40cd3e0 2023-07-06T22:02:00.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.463+0000 7f73e37fe640 1 -- 172.21.15.55:0/3336066614 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e4159070 con 0x7f73e406bc00 2023-07-06T22:02:00.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.467+0000 7f73e37fe640 1 --2- 172.21.15.55:0/3336066614 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73e406bc00 0x7f73e406c080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009dc0 tx=0x7f73dc01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21d9c5f7b9418610 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:00.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.467+0000 7f73e27fc640 1 -- 172.21.15.55:0/3336066614 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0a5970 con 0x7f73e406bc00 2023-07-06T22:02:00.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.467+0000 7f73e27fc640 1 -- 172.21.15.55:0/3336066614 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc0a5ad0 con 0x7f73e406bc00 2023-07-06T22:02:00.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.467+0000 7f73e27fc640 1 -- 172.21.15.55:0/3336066614 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0a5e40 con 0x7f73e406bc00 2023-07-06T22:02:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.467+0000 7f73e92cb640 1 -- 172.21.15.55:0/3336066614 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73e406bc00 msgr2=0x7f73e406c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.467+0000 7f73e92cb640 1 --2- 172.21.15.55:0/3336066614 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73e406bc00 0x7f73e406c080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009dc0 tx=0x7f73dc01c8b0 comp rx=0 tx=0).stop 2023-07-06T22:02:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.467+0000 7f73e92cb640 1 -- 172.21.15.55:0/3336066614 shutdown_connections 2023-07-06T22:02:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.467+0000 7f73e92cb640 1 --2- 172.21.15.55:0/3336066614 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73e406bc00 0x7f73e406c080 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.467+0000 7f73e92cb640 1 -- 172.21.15.55:0/3336066614 >> 172.21.15.55:0/3336066614 conn(0x7f73e40cde30 msgr2=0x7f73e40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.467+0000 7f73e92cb640 1 -- 172.21.15.55:0/3336066614 shutdown_connections 2023-07-06T22:02:00.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.467+0000 7f73e92cb640 1 -- 172.21.15.55:0/3336066614 wait complete. 2023-07-06T22:02:00.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.467+0000 7f73e92cb640 1 Processor -- start 2023-07-06T22:02:00.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.467+0000 7f73e92cb640 1 -- start start 2023-07-06T22:02:00.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73e92cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73e406bc00 0x7f73e4146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:00.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73e92cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73e40c8910 0x7f73e40c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:00.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73e92cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73e41511c0 0x7f73e4156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:00.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73e92cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40c3000 con 0x7f73e40c8910 2023-07-06T22:02:00.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73e92cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e4070d30 con 0x7f73e406bc00 2023-07-06T22:02:00.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73e92cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40c6960 con 0x7f73e41511c0 2023-07-06T22:02:00.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73e40c8910 0x7f73e40c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:00.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73e40c8910 0x7f73e40c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58166/0 (socket says 172.21.15.55:58166) 2023-07-06T22:02:00.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73dbfff640 1 -- 172.21.15.55:0/862179710 learned_addr learned my addr 172.21.15.55:0/862179710 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:00.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73e2ffd640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73e406bc00 0x7f73e4146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:00.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73e37fe640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73e41511c0 0x7f73e4156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:00.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73dbfff640 1 -- 172.21.15.55:0/862179710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73e41511c0 msgr2=0x7f73e4156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:00.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73dbfff640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73e41511c0 0x7f73e4156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:00.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73dbfff640 1 -- 172.21.15.55:0/862179710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73e406bc00 msgr2=0x7f73e4146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:00.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73dbfff640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73e406bc00 0x7f73e4146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:00.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73dbfff640 1 -- 172.21.15.55:0/862179710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc009a70 con 0x7f73e40c8910 2023-07-06T22:02:00.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73e2ffd640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73e406bc00 0x7f73e4146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:00.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73dbfff640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73e40c8910 0x7f73e40c43d0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00c450 tx=0x7f73cc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:00.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73db7fe640 1 -- 172.21.15.55:0/862179710 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0054e0 con 0x7f73e40c8910 2023-07-06T22:02:00.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73db7fe640 1 -- 172.21.15.55:0/862179710 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc003600 con 0x7f73e40c8910 2023-07-06T22:02:00.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73db7fe640 1 -- 172.21.15.55:0/862179710 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0039b0 con 0x7f73e40c8910 2023-07-06T22:02:00.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73e92cb640 1 -- 172.21.15.55:0/862179710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e40c6c40 con 0x7f73e40c8910 2023-07-06T22:02:00.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73e92cb640 1 -- 172.21.15.55:0/862179710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e4070f40 con 0x7f73e40c8910 2023-07-06T22:02:00.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73e92cb640 1 -- 172.21.15.55:0/862179710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e40c6dd0 con 0x7f73e40c8910 2023-07-06T22:02:00.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.471+0000 7f73db7fe640 1 -- 172.21.15.55:0/862179710 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f73cc003b10 con 0x7f73e40c8910 2023-07-06T22:02:00.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.475+0000 7f73db7fe640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f73c40663d0 0x7f73c4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:00.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.475+0000 7f73db7fe640 1 -- 172.21.15.55:0/862179710 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6789+0+0 (secure 0 0 0) 0x7f73cc083750 con 0x7f73e40c8910 2023-07-06T22:02:00.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.475+0000 7f73e2ffd640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f73c40663d0 0x7f73c4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:00.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.475+0000 7f73e2ffd640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f73c40663d0 0x7f73c4068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f73d4005890 tx=0x7f73d4009040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.479+0000 7f73db7fe640 1 -- 172.21.15.55:0/862179710 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73cc054260 con 0x7f73e40c8910 2023-07-06T22:02:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:00.635+0000 7f73e92cb640 1 -- 172.21.15.55:0/862179710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f73e4066d60 con 0x7f73e40c8910 2023-07-06T22:02:01.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.307+0000 7f73db7fe640 1 -- 172.21.15.55:0/862179710 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v151) v1 ==== 169+0+0 (secure 0 0 0) 0x7f73cc001130 con 0x7f73e40c8910 2023-07-06T22:02:01.307 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-07-06T22:02:01.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.311+0000 7f73e92cb640 1 -- 172.21.15.55:0/862179710 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f73c40663d0 msgr2=0x7f73c4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:01.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.311+0000 7f73e92cb640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f73c40663d0 0x7f73c4068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f73d4005890 tx=0x7f73d4009040 comp rx=0 tx=0).stop 2023-07-06T22:02:01.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.311+0000 7f73e92cb640 1 -- 172.21.15.55:0/862179710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73e40c8910 msgr2=0x7f73e40c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:01.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.311+0000 7f73e92cb640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73e40c8910 0x7f73e40c43d0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00c450 tx=0x7f73cc00c910 comp rx=0 tx=0).stop 2023-07-06T22:02:01.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.311+0000 7f73e92cb640 1 -- 172.21.15.55:0/862179710 shutdown_connections 2023-07-06T22:02:01.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.311+0000 7f73e92cb640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73e41511c0 0x7f73e4156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.311+0000 7f73e92cb640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73e40c8910 0x7f73e40c43d0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.311+0000 7f73e92cb640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f73c40663d0 0x7f73c4068880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.311+0000 7f73e92cb640 1 --2- 172.21.15.55:0/862179710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73e406bc00 0x7f73e4146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.311+0000 7f73e92cb640 1 -- 172.21.15.55:0/862179710 >> 172.21.15.55:0/862179710 conn(0x7f73e40cde30 msgr2=0x7f73e415a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:01.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.315+0000 7f73e92cb640 1 -- 172.21.15.55:0/862179710 shutdown_connections 2023-07-06T22:02:01.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.315+0000 7f73e92cb640 1 -- 172.21.15.55:0/862179710 wait complete. 2023-07-06T22:02:01.336 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-06T22:02:01.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.483+0000 7ffa1bc0b640 1 Processor -- start 2023-07-06T22:02:01.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.483+0000 7ffa1bc0b640 1 -- start start 2023-07-06T22:02:01.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.487+0000 7ffa1bc0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa1406fff0 0x7ffa14070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:01.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.487+0000 7ffa1bc0b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa140b2ca0 0x7ffa140b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:01.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.487+0000 7ffa1bc0b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa140cd490 con 0x7ffa141597d0 2023-07-06T22:02:01.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.487+0000 7ffa1bc0b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa14070960 con 0x7ffa140b2ca0 2023-07-06T22:02:01.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.487+0000 7ffa1bc0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1415cf60 con 0x7ffa1406fff0 2023-07-06T22:02:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.487+0000 7ffa1a1a8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa140b2ca0 0x7ffa140b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.487+0000 7ffa1a1a8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa140b2ca0 0x7ffa140b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58170/0 (socket says 172.21.15.55:58170) 2023-07-06T22:02:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.487+0000 7ffa1a1a8640 1 -- 172.21.15.55:0/861042628 learned_addr learned my addr 172.21.15.55:0/861042628 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:01.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.487+0000 7ffa191a6640 1 --2- 172.21.15.55:0/861042628 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa1406fff0 0x7ffa14070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.487+0000 7ffa1a1a8640 1 -- 172.21.15.55:0/861042628 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa1406fff0 msgr2=0x7ffa14070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.487+0000 7ffa1a1a8640 1 --2- 172.21.15.55:0/861042628 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa1406fff0 0x7ffa14070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.487+0000 7ffa1a1a8640 1 -- 172.21.15.55:0/861042628 >> v1:172.21.15.138:6789/0 conn(0x7ffa141597d0 legacy=0x7ffa140ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:01.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.487+0000 7ffa1a1a8640 1 -- 172.21.15.55:0/861042628 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa140ccb60 con 0x7ffa140b2ca0 2023-07-06T22:02:01.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1a1a8640 1 --2- 172.21.15.55:0/861042628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa140b2ca0 0x7ffa140b3120 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009e50 tx=0x7ffa0c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea20adfa667d3c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:01.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa189a5640 1 -- 172.21.15.55:0/861042628 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa140b3e70 con 0x7ffa140b2ca0 2023-07-06T22:02:01.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa189a5640 1 -- 172.21.15.55:0/861042628 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0a5810 con 0x7ffa140b2ca0 2023-07-06T22:02:01.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa189a5640 1 -- 172.21.15.55:0/861042628 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0a5ba0 con 0x7ffa140b2ca0 2023-07-06T22:02:01.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/861042628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa140b2ca0 msgr2=0x7ffa140b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:01.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 --2- 172.21.15.55:0/861042628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa140b2ca0 0x7ffa140b3120 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009e50 tx=0x7ffa0c01c950 comp rx=0 tx=0).stop 2023-07-06T22:02:01.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/861042628 shutdown_connections 2023-07-06T22:02:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 --2- 172.21.15.55:0/861042628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa140b2ca0 0x7ffa140b3120 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 --2- 172.21.15.55:0/861042628 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa1406fff0 0x7ffa14070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/861042628 >> 172.21.15.55:0/861042628 conn(0x7ffa140cb970 msgr2=0x7ffa140cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/861042628 shutdown_connections 2023-07-06T22:02:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/861042628 wait complete. 2023-07-06T22:02:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 Processor -- start 2023-07-06T22:02:01.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 -- start start 2023-07-06T22:02:01.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa1406fff0 0x7ffa14149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:01.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa140b2ca0 0x7ffa140c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:01.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa140c3a10 0x7ffa140c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:01.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1414be60 con 0x7ffa140b2ca0 2023-07-06T22:02:01.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1414c970 con 0x7ffa140c3a10 2023-07-06T22:02:01.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.491+0000 7ffa1bc0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1414c040 con 0x7ffa1406fff0 2023-07-06T22:02:01.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa191a6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa140b2ca0 0x7ffa140c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:01.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa191a6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa140b2ca0 0x7ffa140c2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58184/0 (socket says 172.21.15.55:58184) 2023-07-06T22:02:01.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa191a6640 1 -- 172.21.15.55:0/1284179800 learned_addr learned my addr 172.21.15.55:0/1284179800 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:01.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa199a7640 1 --2- 172.21.15.55:0/1284179800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa1406fff0 0x7ffa14149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:01.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa1a1a8640 1 --2- 172.21.15.55:0/1284179800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa140c3a10 0x7ffa140c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:01.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa191a6640 1 -- 172.21.15.55:0/1284179800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa1406fff0 msgr2=0x7ffa14149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:01.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa191a6640 1 --2- 172.21.15.55:0/1284179800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa1406fff0 0x7ffa14149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa191a6640 1 -- 172.21.15.55:0/1284179800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa140c3a10 msgr2=0x7ffa140c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:01.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa191a6640 1 --2- 172.21.15.55:0/1284179800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa140c3a10 0x7ffa140c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa191a6640 1 -- 172.21.15.55:0/1284179800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c009b30 con 0x7ffa140b2ca0 2023-07-06T22:02:01.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa191a6640 1 --2- 172.21.15.55:0/1284179800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa140b2ca0 0x7ffa140c2990 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400d800 tx=0x7ffa0400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:01.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa0a7fc640 1 -- 172.21.15.55:0/1284179800 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0400b660 con 0x7ffa140b2ca0 2023-07-06T22:02:01.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa0a7fc640 1 -- 172.21.15.55:0/1284179800 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0400b7c0 con 0x7ffa140b2ca0 2023-07-06T22:02:01.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/1284179800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1414c320 con 0x7ffa140b2ca0 2023-07-06T22:02:01.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa0a7fc640 1 -- 172.21.15.55:0/1284179800 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0400bb30 con 0x7ffa140b2ca0 2023-07-06T22:02:01.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/1284179800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa14149860 con 0x7ffa140b2ca0 2023-07-06T22:02:01.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/1284179800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa14066d60 con 0x7ffa140b2ca0 2023-07-06T22:02:01.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.495+0000 7ffa0a7fc640 1 -- 172.21.15.55:0/1284179800 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ffa0400bc90 con 0x7ffa140b2ca0 2023-07-06T22:02:01.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.499+0000 7ffa0a7fc640 1 --2- 172.21.15.55:0/1284179800 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff9f80663d0 0x7ff9f8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:01.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.499+0000 7ffa0a7fc640 1 -- 172.21.15.55:0/1284179800 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6375+0+0 (secure 0 0 0) 0x7ffa040843d0 con 0x7ffa140b2ca0 2023-07-06T22:02:01.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.499+0000 7ffa199a7640 1 --2- 172.21.15.55:0/1284179800 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff9f80663d0 0x7ff9f8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:01.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.499+0000 7ffa199a7640 1 --2- 172.21.15.55:0/1284179800 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff9f80663d0 0x7ff9f8068880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffa14152ff0 tx=0x7ffa10009040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:01.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.499+0000 7ffa0a7fc640 1 -- 172.21.15.55:0/1284179800 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa04051610 con 0x7ffa140b2ca0 2023-07-06T22:02:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.663+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/1284179800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ffa1414cab0 con 0x7ffa140b2ca0 2023-07-06T22:02:01.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.667+0000 7ffa0a7fc640 1 -- 172.21.15.55:0/1284179800 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v49) v1 ==== 120+0+0 (secure 0 0 0) 0x7ffa04054c30 con 0x7ffa140b2ca0 2023-07-06T22:02:01.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.667+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/1284179800 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff9f80663d0 msgr2=0x7ff9f8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:01.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.667+0000 7ffa1bc0b640 1 --2- 172.21.15.55:0/1284179800 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff9f80663d0 0x7ff9f8068880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffa14152ff0 tx=0x7ffa10009040 comp rx=0 tx=0).stop 2023-07-06T22:02:01.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.667+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/1284179800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa140b2ca0 msgr2=0x7ffa140c2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:01.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.667+0000 7ffa1bc0b640 1 --2- 172.21.15.55:0/1284179800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa140b2ca0 0x7ffa140c2990 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400d800 tx=0x7ffa0400dcc0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.671+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/1284179800 shutdown_connections 2023-07-06T22:02:01.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.671+0000 7ffa1bc0b640 1 --2- 172.21.15.55:0/1284179800 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff9f80663d0 0x7ff9f8068880 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.671+0000 7ffa1bc0b640 1 --2- 172.21.15.55:0/1284179800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa140c3a10 0x7ffa140c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.671+0000 7ffa1bc0b640 1 --2- 172.21.15.55:0/1284179800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa140b2ca0 0x7ffa140c2990 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.671+0000 7ffa1bc0b640 1 --2- 172.21.15.55:0/1284179800 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ffa1406fff0 0x7ffa14149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.671+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/1284179800 >> 172.21.15.55:0/1284179800 conn(0x7ffa140cb970 msgr2=0x7ffa14153130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:01.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.671+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/1284179800 shutdown_connections 2023-07-06T22:02:01.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.671+0000 7ffa1bc0b640 1 -- 172.21.15.55:0/1284179800 wait complete. 2023-07-06T22:02:01.688 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-06T22:02:01.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe32c8cb640 1 Processor -- start 2023-07-06T22:02:01.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe32c8cb640 1 -- start start 2023-07-06T22:02:01.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe32c8cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe328158850 0x7fe3280cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:01.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe32c8cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3280ca130 0x7fe3280ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:01.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe32c8cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3280b2aa0 con 0x7fe3280703e0 2023-07-06T22:02:01.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe32c8cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe328158c20 con 0x7fe3280ca130 2023-07-06T22:02:01.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe32c8cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280c8db0 con 0x7fe328158850 2023-07-06T22:02:01.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe31ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3280ca130 0x7fe3280ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:01.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe31ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3280ca130 0x7fe3280ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58192/0 (socket says 172.21.15.55:58192) 2023-07-06T22:02:01.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe31ffff640 1 -- 172.21.15.55:0/2622188656 learned_addr learned my addr 172.21.15.55:0/2622188656 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:01.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe32659c640 1 --2- 172.21.15.55:0/2622188656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe328158850 0x7fe3280cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:01.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe31ffff640 1 -- 172.21.15.55:0/2622188656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe328158850 msgr2=0x7fe3280cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:01.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe31ffff640 1 --2- 172.21.15.55:0/2622188656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe328158850 0x7fe3280cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe31ffff640 1 -- 172.21.15.55:0/2622188656 >> v1:172.21.15.138:6789/0 conn(0x7fe3280703e0 legacy=0x7fe32806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:01.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe31ffff640 1 -- 172.21.15.55:0/2622188656 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3280c9090 con 0x7fe3280ca130 2023-07-06T22:02:01.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.835+0000 7fe32659c640 1 --2- 172.21.15.55:0/2622188656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe328158850 0x7fe3280cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:01.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.839+0000 7fe31ffff640 1 --2- 172.21.15.55:0/2622188656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3280ca130 0x7fe3280ccf70 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fe310009870 tx=0x7fe31001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36535004560829d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:01.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.839+0000 7fe325d9b640 1 -- 172.21.15.55:0/2622188656 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100a89b0 con 0x7fe3280ca130 2023-07-06T22:02:01.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.839+0000 7fe325d9b640 1 -- 172.21.15.55:0/2622188656 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3100a8b10 con 0x7fe3280ca130 2023-07-06T22:02:01.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.839+0000 7fe325d9b640 1 -- 172.21.15.55:0/2622188656 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100a8ea0 con 0x7fe3280ca130 2023-07-06T22:02:01.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.839+0000 7fe32c8cb640 1 -- 172.21.15.55:0/2622188656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3280ca130 msgr2=0x7fe3280ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:01.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.839+0000 7fe32c8cb640 1 --2- 172.21.15.55:0/2622188656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3280ca130 0x7fe3280ccf70 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fe310009870 tx=0x7fe31001ecf0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.839+0000 7fe32c8cb640 1 -- 172.21.15.55:0/2622188656 shutdown_connections 2023-07-06T22:02:01.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.839+0000 7fe32c8cb640 1 --2- 172.21.15.55:0/2622188656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3280ca130 0x7fe3280ccf70 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.839+0000 7fe32c8cb640 1 --2- 172.21.15.55:0/2622188656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe328158850 0x7fe3280cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.839+0000 7fe32c8cb640 1 -- 172.21.15.55:0/2622188656 >> 172.21.15.55:0/2622188656 conn(0x7fe3280cea70 msgr2=0x7fe3280ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:01.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.839+0000 7fe32c8cb640 1 -- 172.21.15.55:0/2622188656 shutdown_connections 2023-07-06T22:02:01.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.839+0000 7fe32c8cb640 1 -- 172.21.15.55:0/2622188656 wait complete. 2023-07-06T22:02:01.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe32c8cb640 1 Processor -- start 2023-07-06T22:02:01.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe32c8cb640 1 -- start start 2023-07-06T22:02:01.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe32c8cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3280703e0 0x7fe3280c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:01.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe32c8cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3280ca130 0x7fe32806a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:01.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe32c8cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe328158850 0x7fe32806aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:01.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe32c8cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280990e0 con 0x7fe3280ca130 2023-07-06T22:02:01.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe32c8cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32809d7a0 con 0x7fe328158850 2023-07-06T22:02:01.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe32c8cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32809da80 con 0x7fe3280703e0 2023-07-06T22:02:01.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe31ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3280ca130 0x7fe32806a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:01.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe31ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3280ca130 0x7fe32806a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58204/0 (socket says 172.21.15.55:58204) 2023-07-06T22:02:01.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe31ffff640 1 -- 172.21.15.55:0/3639054157 learned_addr learned my addr 172.21.15.55:0/3639054157 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:01.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe32659c640 1 --2- 172.21.15.55:0/3639054157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3280703e0 0x7fe3280c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:01.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe326d9d640 1 --2- 172.21.15.55:0/3639054157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe328158850 0x7fe32806aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:01.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe31ffff640 1 -- 172.21.15.55:0/3639054157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3280703e0 msgr2=0x7fe3280c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:01.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe31ffff640 1 --2- 172.21.15.55:0/3639054157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3280703e0 0x7fe3280c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe31ffff640 1 -- 172.21.15.55:0/3639054157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe328158850 msgr2=0x7fe32806aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:01.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe31ffff640 1 --2- 172.21.15.55:0/3639054157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe328158850 0x7fe32806aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:01.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe31ffff640 1 -- 172.21.15.55:0/3639054157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3100094d0 con 0x7fe3280ca130 2023-07-06T22:02:01.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe31ffff640 1 --2- 172.21.15.55:0/3639054157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3280ca130 0x7fe32806a570 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fe3100b3040 tx=0x7fe31001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:01.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe31effd640 1 -- 172.21.15.55:0/3639054157 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100a89b0 con 0x7fe3280ca130 2023-07-06T22:02:01.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe31effd640 1 -- 172.21.15.55:0/3639054157 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3100bb480 con 0x7fe3280ca130 2023-07-06T22:02:01.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe32c8cb640 1 -- 172.21.15.55:0/3639054157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe328098a90 con 0x7fe3280ca130 2023-07-06T22:02:01.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe31effd640 1 -- 172.21.15.55:0/3639054157 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100bb850 con 0x7fe3280ca130 2023-07-06T22:02:01.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.843+0000 7fe32c8cb640 1 -- 172.21.15.55:0/3639054157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32809e7e0 con 0x7fe3280ca130 2023-07-06T22:02:01.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.847+0000 7fe32c8cb640 1 -- 172.21.15.55:0/3639054157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe328099250 con 0x7fe3280ca130 2023-07-06T22:02:01.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.847+0000 7fe31effd640 1 -- 172.21.15.55:0/3639054157 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe3100bb9b0 con 0x7fe3280ca130 2023-07-06T22:02:01.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.847+0000 7fe31effd640 1 --2- 172.21.15.55:0/3639054157 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fe3080663a0 0x7fe308068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:01.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.847+0000 7fe31effd640 1 -- 172.21.15.55:0/3639054157 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6375+0+0 (secure 0 0 0) 0x7fe310122930 con 0x7fe3280ca130 2023-07-06T22:02:01.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.847+0000 7fe32659c640 1 --2- 172.21.15.55:0/3639054157 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fe3080663a0 0x7fe308068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:01.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.847+0000 7fe32659c640 1 --2- 172.21.15.55:0/3639054157 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fe3080663a0 0x7fe308068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe318006fd0 tx=0x7fe318008040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:01.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:01.851+0000 7fe31effd640 1 -- 172.21.15.55:0/3639054157 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3100efc00 con 0x7fe3280ca130 2023-07-06T22:02:02.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.007+0000 7fe32c8cb640 1 -- 172.21.15.55:0/3639054157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe328099220 con 0x7fe3280ca130 2023-07-06T22:02:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.015+0000 7fe31effd640 1 -- 172.21.15.55:0/3639054157 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v50) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe3100b50a0 con 0x7fe3280ca130 2023-07-06T22:02:02.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.015+0000 7fe32c8cb640 1 -- 172.21.15.55:0/3639054157 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fe3080663a0 msgr2=0x7fe308068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:02.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.015+0000 7fe32c8cb640 1 --2- 172.21.15.55:0/3639054157 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fe3080663a0 0x7fe308068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe318006fd0 tx=0x7fe318008040 comp rx=0 tx=0).stop 2023-07-06T22:02:02.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.015+0000 7fe32c8cb640 1 -- 172.21.15.55:0/3639054157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3280ca130 msgr2=0x7fe32806a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.015+0000 7fe32c8cb640 1 --2- 172.21.15.55:0/3639054157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3280ca130 0x7fe32806a570 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fe3100b3040 tx=0x7fe31001ba90 comp rx=0 tx=0).stop 2023-07-06T22:02:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.015+0000 7fe32c8cb640 1 -- 172.21.15.55:0/3639054157 shutdown_connections 2023-07-06T22:02:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.015+0000 7fe32c8cb640 1 --2- 172.21.15.55:0/3639054157 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fe3080663a0 0x7fe308068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.015+0000 7fe32c8cb640 1 --2- 172.21.15.55:0/3639054157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe328158850 0x7fe32806aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.015+0000 7fe32c8cb640 1 --2- 172.21.15.55:0/3639054157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3280ca130 0x7fe32806a570 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.015+0000 7fe32c8cb640 1 --2- 172.21.15.55:0/3639054157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe3280703e0 0x7fe3280c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.015+0000 7fe32c8cb640 1 -- 172.21.15.55:0/3639054157 >> 172.21.15.55:0/3639054157 conn(0x7fe3280cea70 msgr2=0x7fe3280c4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:02.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.015+0000 7fe32c8cb640 1 -- 172.21.15.55:0/3639054157 shutdown_connections 2023-07-06T22:02:02.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.015+0000 7fe32c8cb640 1 -- 172.21.15.55:0/3639054157 wait complete. 2023-07-06T22:02:02.034 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-06T22:02:02.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.179+0000 7f55cce0b640 1 Processor -- start 2023-07-06T22:02:02.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.179+0000 7f55cce0b640 1 -- start start 2023-07-06T22:02:02.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.179+0000 7f55cce0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55c80709a0 0x7f55c80cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:02.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.179+0000 7f55cce0b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c80cc300 con 0x7f55c80b1340 2023-07-06T22:02:02.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.179+0000 7f55cce0b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c80cc5e0 con 0x7f55c80cbe60 2023-07-06T22:02:02.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.179+0000 7f55cce0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80cc8c0 con 0x7f55c80709a0 2023-07-06T22:02:02.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.183+0000 7f55c6d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f55c80b1340 0x7f55c806eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53880/0 (socket says 172.21.15.55:53880) 2023-07-06T22:02:02.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.183+0000 7f55c6d9d640 1 -- 172.21.15.55:0/1077967664 learned_addr learned my addr 172.21.15.55:0/1077967664 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:02.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.183+0000 7f55c659c640 1 --2- 172.21.15.55:0/1077967664 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55c80709a0 0x7f55c80cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:02.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.183+0000 7f55c5d9b640 1 -- 172.21.15.55:0/1077967664 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69598491 0 0) 0x7f55c80cc300 con 0x7f55c80b1340 2023-07-06T22:02:02.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.183+0000 7f55c5d9b640 1 -- 172.21.15.55:0/1077967664 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b4003530 con 0x7f55c80b1340 2023-07-06T22:02:02.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.183+0000 7f55c5d9b640 1 -- 172.21.15.55:0/1077967664 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777062272 0 0) 0x7f55c80cc5e0 con 0x7f55c80cbe60 2023-07-06T22:02:02.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.183+0000 7f55c5d9b640 1 -- 172.21.15.55:0/1077967664 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c80cc300 con 0x7f55c80cbe60 2023-07-06T22:02:02.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.183+0000 7f55c659c640 1 -- 172.21.15.55:0/1077967664 >> v1:172.21.15.138:6789/0 conn(0x7f55c80cbe60 legacy=0x7f55c80b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:02.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.183+0000 7f55c659c640 1 -- 172.21.15.55:0/1077967664 >> v1:172.21.15.55:6789/0 conn(0x7f55c80b1340 legacy=0x7f55c806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:02.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.183+0000 7f55c659c640 1 -- 172.21.15.55:0/1077967664 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c80ccba0 con 0x7f55c80709a0 2023-07-06T22:02:02.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.183+0000 7f55c659c640 1 --2- 172.21.15.55:0/1077967664 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55c80709a0 0x7f55c80cb920 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f55b80097f0 tx=0x7f55b801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72b36241f323eafa server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:02.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55c5d9b640 1 -- 172.21.15.55:0/1077967664 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b80ac630 con 0x7f55c80709a0 2023-07-06T22:02:02.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55c5d9b640 1 -- 172.21.15.55:0/1077967664 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b80ac790 con 0x7f55c80709a0 2023-07-06T22:02:02.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55c5d9b640 1 -- 172.21.15.55:0/1077967664 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b80acb20 con 0x7f55c80709a0 2023-07-06T22:02:02.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 -- 172.21.15.55:0/1077967664 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55c80709a0 msgr2=0x7f55c80cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:02.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 --2- 172.21.15.55:0/1077967664 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55c80709a0 0x7f55c80cb920 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f55b80097f0 tx=0x7f55b801c4c0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 -- 172.21.15.55:0/1077967664 shutdown_connections 2023-07-06T22:02:02.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 --2- 172.21.15.55:0/1077967664 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55c80709a0 0x7f55c80cb920 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 -- 172.21.15.55:0/1077967664 >> 172.21.15.55:0/1077967664 conn(0x7f55c80cea70 msgr2=0x7f55c80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:02.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 -- 172.21.15.55:0/1077967664 shutdown_connections 2023-07-06T22:02:02.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 -- 172.21.15.55:0/1077967664 wait complete. 2023-07-06T22:02:02.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 Processor -- start 2023-07-06T22:02:02.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 -- start start 2023-07-06T22:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55c80709a0 0x7f55c815fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55c80b1340 0x7f55c80aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c80cbe60 0x7f55c80c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:02.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c815f170 con 0x7f55c80709a0 2023-07-06T22:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80c7540 con 0x7f55c80cbe60 2023-07-06T22:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55cce0b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80c6f80 con 0x7f55c80b1340 2023-07-06T22:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55c659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55c80709a0 0x7f55c815fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55c659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55c80709a0 0x7f55c815fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58220/0 (socket says 172.21.15.55:58220) 2023-07-06T22:02:02.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.187+0000 7f55c659c640 1 -- 172.21.15.55:0/1205461345 learned_addr learned my addr 172.21.15.55:0/1205461345 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:02.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55c659c640 1 -- 172.21.15.55:0/1205461345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55c80b1340 msgr2=0x7f55c80aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:02.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55c659c640 1 --2- 172.21.15.55:0/1205461345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55c80b1340 0x7f55c80aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55c659c640 1 -- 172.21.15.55:0/1205461345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c80cbe60 msgr2=0x7f55c80c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:02.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55c659c640 1 --2- 172.21.15.55:0/1205461345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c80cbe60 0x7f55c80c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55c659c640 1 -- 172.21.15.55:0/1205461345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b8009420 con 0x7f55c80709a0 2023-07-06T22:02:02.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55c659c640 1 --2- 172.21.15.55:0/1205461345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55c80709a0 0x7f55c815fb30 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f55b80190d0 tx=0x7f55b801ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:02.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55beffd640 1 -- 172.21.15.55:0/1205461345 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b80b8650 con 0x7f55c80709a0 2023-07-06T22:02:02.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55beffd640 1 -- 172.21.15.55:0/1205461345 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b80b87d0 con 0x7f55c80709a0 2023-07-06T22:02:02.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55cce0b640 1 -- 172.21.15.55:0/1205461345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c80c7260 con 0x7f55c80709a0 2023-07-06T22:02:02.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55beffd640 1 -- 172.21.15.55:0/1205461345 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b80b8b80 con 0x7f55c80709a0 2023-07-06T22:02:02.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55cce0b640 1 -- 172.21.15.55:0/1205461345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c815f630 con 0x7f55c80709a0 2023-07-06T22:02:02.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55cce0b640 1 -- 172.21.15.55:0/1205461345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c8066d60 con 0x7f55c80709a0 2023-07-06T22:02:02.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55beffd640 1 -- 172.21.15.55:0/1205461345 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f55b80b8ce0 con 0x7f55c80709a0 2023-07-06T22:02:02.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55beffd640 1 --2- 172.21.15.55:0/1205461345 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f55a80663a0 0x7f55a8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:02.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.191+0000 7f55beffd640 1 -- 172.21.15.55:0/1205461345 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f55b811e9a0 con 0x7f55c80709a0 2023-07-06T22:02:02.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.195+0000 7f55bffff640 1 --2- 172.21.15.55:0/1205461345 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f55a80663a0 0x7f55a8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:02.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.195+0000 7f55bffff640 1 --2- 172.21.15.55:0/1205461345 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f55a80663a0 0x7f55a8068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f55b0007fd0 tx=0x7f55b0007960 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:02.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.195+0000 7f55beffd640 1 -- 172.21.15.55:0/1205461345 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55b80ebac0 con 0x7f55c80709a0 2023-07-06T22:02:02.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.351+0000 7f55cce0b640 1 -- 172.21.15.55:0/1205461345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f55c80c7e50 con 0x7f55c80709a0 2023-07-06T22:02:02.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.359+0000 7f55beffd640 1 -- 172.21.15.55:0/1205461345 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v51) v1 ==== 115+0+0 (secure 0 0 0) 0x7f55b80a80b0 con 0x7f55c80709a0 2023-07-06T22:02:02.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.359+0000 7f55cce0b640 1 -- 172.21.15.55:0/1205461345 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f55a80663a0 msgr2=0x7f55a8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:02.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.359+0000 7f55cce0b640 1 --2- 172.21.15.55:0/1205461345 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f55a80663a0 0x7f55a8068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f55b0007fd0 tx=0x7f55b0007960 comp rx=0 tx=0).stop 2023-07-06T22:02:02.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.359+0000 7f55cce0b640 1 -- 172.21.15.55:0/1205461345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55c80709a0 msgr2=0x7f55c815fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:02.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.359+0000 7f55cce0b640 1 --2- 172.21.15.55:0/1205461345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55c80709a0 0x7f55c815fb30 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f55b80190d0 tx=0x7f55b801ad00 comp rx=0 tx=0).stop 2023-07-06T22:02:02.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.359+0000 7f55cce0b640 1 -- 172.21.15.55:0/1205461345 shutdown_connections 2023-07-06T22:02:02.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.359+0000 7f55cce0b640 1 --2- 172.21.15.55:0/1205461345 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f55a80663a0 0x7f55a8068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.359+0000 7f55cce0b640 1 --2- 172.21.15.55:0/1205461345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c80cbe60 0x7f55c80c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.359+0000 7f55cce0b640 1 --2- 172.21.15.55:0/1205461345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55c80b1340 0x7f55c80aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.359+0000 7f55cce0b640 1 --2- 172.21.15.55:0/1205461345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55c80709a0 0x7f55c815fb30 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.359+0000 7f55cce0b640 1 -- 172.21.15.55:0/1205461345 >> 172.21.15.55:0/1205461345 conn(0x7f55c80cea70 msgr2=0x7f55c80b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:02.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.359+0000 7f55cce0b640 1 -- 172.21.15.55:0/1205461345 shutdown_connections 2023-07-06T22:02:02.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.359+0000 7f55cce0b640 1 -- 172.21.15.55:0/1205461345 wait complete. 2023-07-06T22:02:02.379 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-07-06T22:02:02.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04b5a7b640 1 Processor -- start 2023-07-06T22:02:02.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04b5a7b640 1 -- start start 2023-07-06T22:02:02.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04b5a7b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04b01587d0 0x7f04b0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:02.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04b5a7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04b00710c0 0x7f04b00cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:02.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04b5a7b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b006fae0 con 0x7f04b0158400 2023-07-06T22:02:02.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04b5a7b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b006fdc0 con 0x7f04b01587d0 2023-07-06T22:02:02.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04b5a7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00700a0 con 0x7f04b00710c0 2023-07-06T22:02:02.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04aeffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04b01587d0 0x7f04b0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:02.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04aeffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04b01587d0 0x7f04b0070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58228/0 (socket says 172.21.15.55:58228) 2023-07-06T22:02:02.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04af7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f04b0158400 0x7f04b00c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53886/0 (socket says 172.21.15.55:53886) 2023-07-06T22:02:02.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04aeffd640 1 -- 172.21.15.55:0/1971407217 learned_addr learned my addr 172.21.15.55:0/1971407217 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:02.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04affff640 1 --2- 172.21.15.55:0/1971407217 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04b00710c0 0x7f04b00cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:02.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04aeffd640 1 -- 172.21.15.55:0/1971407217 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04b00710c0 msgr2=0x7f04b00cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:02.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04aeffd640 1 --2- 172.21.15.55:0/1971407217 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04b00710c0 0x7f04b00cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04aeffd640 1 -- 172.21.15.55:0/1971407217 >> v1:172.21.15.55:6789/0 conn(0x7f04b0158400 legacy=0x7f04b00c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:02.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.523+0000 7f04aeffd640 1 -- 172.21.15.55:0/1971407217 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b0070380 con 0x7f04b01587d0 2023-07-06T22:02:02.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.527+0000 7f04aeffd640 1 --2- 172.21.15.55:0/1971407217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b01587d0 0x7f04b0070b80 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009870 tx=0x7f04a401e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d3bb30dc00a6db server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:02.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.527+0000 7f04ae7fc640 1 -- 172.21.15.55:0/1971407217 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a40aa660 con 0x7f04b01587d0 2023-07-06T22:02:02.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.527+0000 7f04ae7fc640 1 -- 172.21.15.55:0/1971407217 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a40aa7c0 con 0x7f04b01587d0 2023-07-06T22:02:02.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.527+0000 7f04ae7fc640 1 -- 172.21.15.55:0/1971407217 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a40aab50 con 0x7f04b01587d0 2023-07-06T22:02:02.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.527+0000 7f04b5a7b640 1 -- 172.21.15.55:0/1971407217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b01587d0 msgr2=0x7f04b0070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:02.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.527+0000 7f04b5a7b640 1 --2- 172.21.15.55:0/1971407217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b01587d0 0x7f04b0070b80 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009870 tx=0x7f04a401e720 comp rx=0 tx=0).stop 2023-07-06T22:02:02.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.527+0000 7f04b5a7b640 1 -- 172.21.15.55:0/1971407217 shutdown_connections 2023-07-06T22:02:02.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.527+0000 7f04b5a7b640 1 --2- 172.21.15.55:0/1971407217 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04b00710c0 0x7f04b00cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.527+0000 7f04b5a7b640 1 --2- 172.21.15.55:0/1971407217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b01587d0 0x7f04b0070b80 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.527+0000 7f04b5a7b640 1 -- 172.21.15.55:0/1971407217 >> 172.21.15.55:0/1971407217 conn(0x7f04b00cded0 msgr2=0x7f04b00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:02.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.527+0000 7f04b5a7b640 1 -- 172.21.15.55:0/1971407217 shutdown_connections 2023-07-06T22:02:02.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.527+0000 7f04b5a7b640 1 -- 172.21.15.55:0/1971407217 wait complete. 2023-07-06T22:02:02.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04b5a7b640 1 Processor -- start 2023-07-06T22:02:02.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04b5a7b640 1 -- start start 2023-07-06T22:02:02.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04b5a7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04b00710c0 0x7f04b0154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:02.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04b5a7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b0158400 0x7f04b00c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:02.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04b5a7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04b01587d0 0x7f04b015d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:02.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04b5a7b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b015f4b0 con 0x7f04b0158400 2023-07-06T22:02:02.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04b5a7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b015f790 con 0x7f04b00710c0 2023-07-06T22:02:02.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04b5a7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b015fa70 con 0x7f04b01587d0 2023-07-06T22:02:02.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04aeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b0158400 0x7f04b00c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:02.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04aeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b0158400 0x7f04b00c7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58238/0 (socket says 172.21.15.55:58238) 2023-07-06T22:02:02.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04aeffd640 1 -- 172.21.15.55:0/2291880969 learned_addr learned my addr 172.21.15.55:0/2291880969 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:02.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04af7fe640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04b00710c0 0x7f04b0154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:02.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04affff640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04b01587d0 0x7f04b015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04aeffd640 1 -- 172.21.15.55:0/2291880969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04b01587d0 msgr2=0x7f04b015d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04aeffd640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04b01587d0 0x7f04b015d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04aeffd640 1 -- 172.21.15.55:0/2291880969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04b00710c0 msgr2=0x7f04b0154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04aeffd640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04b00710c0 0x7f04b0154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04aeffd640 1 -- 172.21.15.55:0/2291880969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a40094d0 con 0x7f04b0158400 2023-07-06T22:02:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04affff640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04b01587d0 0x7f04b015d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:02.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04aeffd640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b0158400 0x7f04b00c7950 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f04a401cdd0 tx=0x7f04a401b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f0497fff640 1 -- 172.21.15.55:0/2291880969 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a40aa660 con 0x7f04b0158400 2023-07-06T22:02:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f0497fff640 1 -- 172.21.15.55:0/2291880969 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a40b2810 con 0x7f04b0158400 2023-07-06T22:02:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f0497fff640 1 -- 172.21.15.55:0/2291880969 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a40b2bc0 con 0x7f04b0158400 2023-07-06T22:02:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04b5a7b640 1 -- 172.21.15.55:0/2291880969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b0161460 con 0x7f04b0158400 2023-07-06T22:02:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.531+0000 7f04b5a7b640 1 -- 172.21.15.55:0/2291880969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b015d8a0 con 0x7f04b0158400 2023-07-06T22:02:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.535+0000 7f04b5a7b640 1 -- 172.21.15.55:0/2291880969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b006c580 con 0x7f04b0158400 2023-07-06T22:02:02.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.535+0000 7f0497fff640 1 -- 172.21.15.55:0/2291880969 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f04a40b2d20 con 0x7f04b0158400 2023-07-06T22:02:02.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.535+0000 7f0497fff640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f049c0663a0 0x7f049c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:02.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.535+0000 7f0497fff640 1 -- 172.21.15.55:0/2291880969 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f04a411e2a0 con 0x7f04b0158400 2023-07-06T22:02:02.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.535+0000 7f04af7fe640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f049c0663a0 0x7f049c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:02.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.535+0000 7f04af7fe640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f049c0663a0 0x7f049c068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f04a0000f70 tx=0x7f04a0007e50 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:02.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.539+0000 7f0497fff640 1 -- 172.21.15.55:0/2291880969 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04a40eb570 con 0x7f04b0158400 2023-07-06T22:02:02.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:02.751+0000 7f04b5a7b640 1 -- 172.21.15.55:0/2291880969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f04b015f5f0 con 0x7f04b0158400 2023-07-06T22:02:03.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.307+0000 7f0497fff640 1 -- 172.21.15.55:0/2291880969 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v782) v1 ==== 174+0+0 (secure 0 0 0) 0x7f04b015f5f0 con 0x7f04b0158400 2023-07-06T22:02:03.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.307+0000 7f04b5a7b640 1 -- 172.21.15.55:0/2291880969 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f049c0663a0 msgr2=0x7f049c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:03.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.307+0000 7f04b5a7b640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f049c0663a0 0x7f049c068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f04a0000f70 tx=0x7f04a0007e50 comp rx=0 tx=0).stop 2023-07-06T22:02:03.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.307+0000 7f04b5a7b640 1 -- 172.21.15.55:0/2291880969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b0158400 msgr2=0x7f04b00c7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:03.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.307+0000 7f04b5a7b640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b0158400 0x7f04b00c7950 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f04a401cdd0 tx=0x7f04a401b4c0 comp rx=0 tx=0).stop 2023-07-06T22:02:03.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.307+0000 7f04b5a7b640 1 -- 172.21.15.55:0/2291880969 shutdown_connections 2023-07-06T22:02:03.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.307+0000 7f04b5a7b640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04b01587d0 0x7f04b015d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:03.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.307+0000 7f04b5a7b640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b0158400 0x7f04b00c7950 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:03.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.307+0000 7f04b5a7b640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f049c0663a0 0x7f049c068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:03.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.307+0000 7f04b5a7b640 1 --2- 172.21.15.55:0/2291880969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04b00710c0 0x7f04b0154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:03.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.307+0000 7f04b5a7b640 1 -- 172.21.15.55:0/2291880969 >> 172.21.15.55:0/2291880969 conn(0x7f04b00cded0 msgr2=0x7f04b01565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:03.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.311+0000 7f04b5a7b640 1 -- 172.21.15.55:0/2291880969 shutdown_connections 2023-07-06T22:02:03.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.311+0000 7f04b5a7b640 1 -- 172.21.15.55:0/2291880969 wait complete. 2023-07-06T22:02:03.330 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-07-06T22:02:03.331 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-07-06T22:02:03.331 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-06T22:02:03.331 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-07-06T22:02:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cfde5c640 1 Processor -- start 2023-07-06T22:02:03.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cfde5c640 1 -- start start 2023-07-06T22:02:03.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cfde5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1cf8158400 0x7f1cf80c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:03.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cfde5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1cf80c9680 0x7f1cf8070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cfde5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf806fae0 con 0x7f1cf80710c0 2023-07-06T22:02:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cfde5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf806fdc0 con 0x7f1cf8158400 2023-07-06T22:02:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cfde5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80700a0 con 0x7f1cf80c9680 2023-07-06T22:02:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cf77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1cf8158400 0x7f1cf80c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cf77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1cf8158400 0x7f1cf80c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51528/0 (socket says 172.21.15.55:51528) 2023-07-06T22:02:03.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cf77fe640 1 -- 172.21.15.55:0/3332135884 learned_addr learned my addr 172.21.15.55:0/3332135884 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cf6ffd640 1 --2- 172.21.15.55:0/3332135884 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1cf80c9680 0x7f1cf8070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cf77fe640 1 -- 172.21.15.55:0/3332135884 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1cf80c9680 msgr2=0x7f1cf8070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:03.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cf77fe640 1 --2- 172.21.15.55:0/3332135884 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1cf80c9680 0x7f1cf8070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cf77fe640 1 -- 172.21.15.55:0/3332135884 >> v1:172.21.15.55:6789/0 conn(0x7f1cf80710c0 legacy=0x7f1cf80cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cf77fe640 1 -- 172.21.15.55:0/3332135884 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf8070380 con 0x7f1cf8158400 2023-07-06T22:02:03.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.479+0000 7f1cf67fc640 1 -- 172.21.15.55:0/3332135884 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097645126 0 0) 0x7f1cf806fae0 con 0x7f1cf80710c0 2023-07-06T22:02:03.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.483+0000 7f1cf77fe640 1 --2- 172.21.15.55:0/3332135884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf8158400 0x7f1cf80c9140 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009870 tx=0x7f1ce801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11af1e4db948bfe server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:03.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.483+0000 7f1cf67fc640 1 -- 172.21.15.55:0/3332135884 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce80a95f0 con 0x7f1cf8158400 2023-07-06T22:02:03.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.483+0000 7f1cf67fc640 1 -- 172.21.15.55:0/3332135884 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce80a9750 con 0x7f1cf8158400 2023-07-06T22:02:03.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.483+0000 7f1cf67fc640 1 -- 172.21.15.55:0/3332135884 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce80a9ae0 con 0x7f1cf8158400 2023-07-06T22:02:03.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.483+0000 7f1cfde5c640 1 -- 172.21.15.55:0/3332135884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf8158400 msgr2=0x7f1cf80c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:03.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.483+0000 7f1cfde5c640 1 --2- 172.21.15.55:0/3332135884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf8158400 0x7f1cf80c9140 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009870 tx=0x7f1ce801c510 comp rx=0 tx=0).stop 2023-07-06T22:02:03.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.483+0000 7f1cfde5c640 1 -- 172.21.15.55:0/3332135884 shutdown_connections 2023-07-06T22:02:03.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.483+0000 7f1cfde5c640 1 --2- 172.21.15.55:0/3332135884 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1cf80c9680 0x7f1cf8070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:03.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.483+0000 7f1cfde5c640 1 --2- 172.21.15.55:0/3332135884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf8158400 0x7f1cf80c9140 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:03.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.483+0000 7f1cfde5c640 1 -- 172.21.15.55:0/3332135884 >> 172.21.15.55:0/3332135884 conn(0x7f1cf80cded0 msgr2=0x7f1cf80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:03.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.483+0000 7f1cfde5c640 1 -- 172.21.15.55:0/3332135884 shutdown_connections 2023-07-06T22:02:03.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.483+0000 7f1cfde5c640 1 -- 172.21.15.55:0/3332135884 wait complete. 2023-07-06T22:02:03.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cfde5c640 1 Processor -- start 2023-07-06T22:02:03.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cfde5c640 1 -- start start 2023-07-06T22:02:03.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cfde5c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cf80710c0 0x7f1cf814fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:03.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cfde5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf80c9680 0x7f1cf80c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:03.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cfde5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1cf8158400 0x7f1cf8158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:03.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cfde5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8150240 con 0x7f1cf80c9680 2023-07-06T22:02:03.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cfde5c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8159ac0 con 0x7f1cf80710c0 2023-07-06T22:02:03.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cfde5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8156710 con 0x7f1cf8158400 2023-07-06T22:02:03.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cf6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf80c9680 0x7f1cf80c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:03.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cf6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf80c9680 0x7f1cf80c5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51542/0 (socket says 172.21.15.55:51542) 2023-07-06T22:02:03.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cf6ffd640 1 -- 172.21.15.55:0/1393668260 learned_addr learned my addr 172.21.15.55:0/1393668260 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:03.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cf77fe640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cf80710c0 0x7f1cf814fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:03.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cf7fff640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1cf8158400 0x7f1cf8158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:03.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cf6ffd640 1 -- 172.21.15.55:0/1393668260 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1cf8158400 msgr2=0x7f1cf8158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:03.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cf6ffd640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1cf8158400 0x7f1cf8158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:03.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cf6ffd640 1 -- 172.21.15.55:0/1393668260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cf80710c0 msgr2=0x7f1cf814fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:03.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cf6ffd640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cf80710c0 0x7f1cf814fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:03.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cf6ffd640 1 -- 172.21.15.55:0/1393668260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce80094d0 con 0x7f1cf80c9680 2023-07-06T22:02:03.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cf77fe640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cf80710c0 0x7f1cf814fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:03.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cf7fff640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1cf8158400 0x7f1cf8158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:03.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cf6ffd640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf80c9680 0x7f1cf80c5a00 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00d800 tx=0x7f1cec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:03.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cdffff640 1 -- 172.21.15.55:0/1393668260 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00b660 con 0x7f1cf80c9680 2023-07-06T22:02:03.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cdffff640 1 -- 172.21.15.55:0/1393668260 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec00b7c0 con 0x7f1cf80c9680 2023-07-06T22:02:03.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.487+0000 7f1cdffff640 1 -- 172.21.15.55:0/1393668260 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00bb30 con 0x7f1cf80c9680 2023-07-06T22:02:03.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.491+0000 7f1cfde5c640 1 -- 172.21.15.55:0/1393668260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf81569f0 con 0x7f1cf80c9680 2023-07-06T22:02:03.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.491+0000 7f1cfde5c640 1 -- 172.21.15.55:0/1393668260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf8156fb0 con 0x7f1cf80c9680 2023-07-06T22:02:03.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.491+0000 7f1cfde5c640 1 -- 172.21.15.55:0/1393668260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf806c580 con 0x7f1cf80c9680 2023-07-06T22:02:03.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.491+0000 7f1cdffff640 1 -- 172.21.15.55:0/1393668260 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1cec00bc90 con 0x7f1cf80c9680 2023-07-06T22:02:03.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.491+0000 7f1cdffff640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f1ce40663d0 0x7f1ce4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:03.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.491+0000 7f1cdffff640 1 -- 172.21.15.55:0/1393668260 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f1cec0844c0 con 0x7f1cf80c9680 2023-07-06T22:02:03.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.491+0000 7f1cf77fe640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f1ce40663d0 0x7f1ce4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:03.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.491+0000 7f1cf77fe640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f1ce40663d0 0x7f1ce4068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80ae000 tx=0x7f1ce8008040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:03.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.495+0000 7f1cdffff640 1 -- 172.21.15.55:0/1393668260 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1cec0516e0 con 0x7f1cf80c9680 2023-07-06T22:02:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:03.703+0000 7f1cfde5c640 1 -- 172.21.15.55:0/1393668260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f1cf8066d60 con 0x7f1cf80c9680 2023-07-06T22:02:04.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.311+0000 7f1cdffff640 1 -- 172.21.15.55:0/1393668260 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v783) v1 ==== 168+0+0 (secure 0 0 0) 0x7f1cec054d00 con 0x7f1cf80c9680 2023-07-06T22:02:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.315+0000 7f1cfde5c640 1 -- 172.21.15.55:0/1393668260 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f1ce40663d0 msgr2=0x7f1ce4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.315+0000 7f1cfde5c640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f1ce40663d0 0x7f1ce4068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80ae000 tx=0x7f1ce8008040 comp rx=0 tx=0).stop 2023-07-06T22:02:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.315+0000 7f1cfde5c640 1 -- 172.21.15.55:0/1393668260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf80c9680 msgr2=0x7f1cf80c5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.315+0000 7f1cfde5c640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf80c9680 0x7f1cf80c5a00 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00d800 tx=0x7f1cec00dcc0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.315+0000 7f1cfde5c640 1 -- 172.21.15.55:0/1393668260 shutdown_connections 2023-07-06T22:02:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.315+0000 7f1cfde5c640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1cf8158400 0x7f1cf8158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.315+0000 7f1cfde5c640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cf80c9680 0x7f1cf80c5a00 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.315+0000 7f1cfde5c640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f1ce40663d0 0x7f1ce4068880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.315+0000 7f1cfde5c640 1 --2- 172.21.15.55:0/1393668260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cf80710c0 0x7f1cf814fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.315+0000 7f1cfde5c640 1 -- 172.21.15.55:0/1393668260 >> 172.21.15.55:0/1393668260 conn(0x7f1cf80cded0 msgr2=0x7f1cf80b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.315+0000 7f1cfde5c640 1 -- 172.21.15.55:0/1393668260 shutdown_connections 2023-07-06T22:02:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.315+0000 7f1cfde5c640 1 -- 172.21.15.55:0/1393668260 wait complete. 2023-07-06T22:02:04.336 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:02:04.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d369c640 1 Processor -- start 2023-07-06T22:02:04.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d369c640 1 -- start start 2023-07-06T22:02:04.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d369c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd0cc1587d0 0x7fd0cc070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d369c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0cc0710c0 0x7fd0cc0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d369c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0cc06fae0 con 0x7fd0cc158400 2023-07-06T22:02:04.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d369c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0cc06fdc0 con 0x7fd0cc1587d0 2023-07-06T22:02:04.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d369c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc0700a0 con 0x7fd0cc0710c0 2023-07-06T22:02:04.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d1438640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd0cc158400 0x7fd0cc0c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58710/0 (socket says 172.21.15.55:58710) 2023-07-06T22:02:04.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d1438640 1 -- 172.21.15.55:0/2593985994 learned_addr learned my addr 172.21.15.55:0/2593985994 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:04.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d0c37640 1 --2- 172.21.15.55:0/2593985994 >> v2:172.21.15.55:3300/0 conn(0x7fd0cc1587d0 0x7fd0cc070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:04.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0c3fff640 1 -- 172.21.15.55:0/2593985994 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536250583 0 0) 0x7fd0cc06fae0 con 0x7fd0cc158400 2023-07-06T22:02:04.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d1c39640 1 --2- 172.21.15.55:0/2593985994 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0cc0710c0 0x7fd0cc0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:04.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0c3fff640 1 -- 172.21.15.55:0/2593985994 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0b8005740 con 0x7fd0cc158400 2023-07-06T22:02:04.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d0c37640 1 -- 172.21.15.55:0/2593985994 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0cc0710c0 msgr2=0x7fd0cc0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:04.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d0c37640 1 --2- 172.21.15.55:0/2593985994 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0cc0710c0 0x7fd0cc0cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d0c37640 1 -- 172.21.15.55:0/2593985994 >> v1:172.21.15.55:6789/0 conn(0x7fd0cc158400 legacy=0x7fd0cc0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:04.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d0c37640 1 -- 172.21.15.55:0/2593985994 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0cc070380 con 0x7fd0cc1587d0 2023-07-06T22:02:04.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.483+0000 7fd0d1c39640 1 --2- 172.21.15.55:0/2593985994 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0cc0710c0 0x7fd0cc0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:04.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.487+0000 7fd0d0c37640 1 --2- 172.21.15.55:0/2593985994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0cc1587d0 0x7fd0cc070b80 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0097c0 tx=0x7fd0bc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80c7415b303ec67 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.487+0000 7fd0c3fff640 1 -- 172.21.15.55:0/2593985994 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc0ad660 con 0x7fd0cc1587d0 2023-07-06T22:02:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.487+0000 7fd0c3fff640 1 -- 172.21.15.55:0/2593985994 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0bc0ad7c0 con 0x7fd0cc1587d0 2023-07-06T22:02:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.487+0000 7fd0c3fff640 1 -- 172.21.15.55:0/2593985994 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc0adb50 con 0x7fd0cc1587d0 2023-07-06T22:02:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.487+0000 7fd0d369c640 1 -- 172.21.15.55:0/2593985994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0cc1587d0 msgr2=0x7fd0cc070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.487+0000 7fd0d369c640 1 --2- 172.21.15.55:0/2593985994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0cc1587d0 0x7fd0cc070b80 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0097c0 tx=0x7fd0bc01c450 comp rx=0 tx=0).stop 2023-07-06T22:02:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.487+0000 7fd0d369c640 1 -- 172.21.15.55:0/2593985994 shutdown_connections 2023-07-06T22:02:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.487+0000 7fd0d369c640 1 --2- 172.21.15.55:0/2593985994 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0cc0710c0 0x7fd0cc0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.487+0000 7fd0d369c640 1 --2- 172.21.15.55:0/2593985994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0cc1587d0 0x7fd0cc070b80 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.487+0000 7fd0d369c640 1 -- 172.21.15.55:0/2593985994 >> 172.21.15.55:0/2593985994 conn(0x7fd0cc0cded0 msgr2=0x7fd0cc0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:04.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.487+0000 7fd0d369c640 1 -- 172.21.15.55:0/2593985994 shutdown_connections 2023-07-06T22:02:04.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.487+0000 7fd0d369c640 1 -- 172.21.15.55:0/2593985994 wait complete. 2023-07-06T22:02:04.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d369c640 1 Processor -- start 2023-07-06T22:02:04.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d369c640 1 -- start start 2023-07-06T22:02:04.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d369c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0cc0710c0 0x7fd0cc14f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d369c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0cc158400 0x7fd0cc14ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d369c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0cc1587d0 0x7fd0cc150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d369c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc152920 con 0x7fd0cc1587d0 2023-07-06T22:02:04.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d369c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc150110 con 0x7fd0cc158400 2023-07-06T22:02:04.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d369c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc153630 con 0x7fd0cc0710c0 2023-07-06T22:02:04.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d1c39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0cc1587d0 0x7fd0cc150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:04.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d1c39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0cc1587d0 0x7fd0cc150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51558/0 (socket says 172.21.15.55:51558) 2023-07-06T22:02:04.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d1c39640 1 -- 172.21.15.55:0/2549705238 learned_addr learned my addr 172.21.15.55:0/2549705238 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:04.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d1438640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0cc0710c0 0x7fd0cc14f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:04.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d0c37640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0cc158400 0x7fd0cc14ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:04.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d1c39640 1 -- 172.21.15.55:0/2549705238 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0cc0710c0 msgr2=0x7fd0cc14f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:04.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d1c39640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0cc0710c0 0x7fd0cc14f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d1c39640 1 -- 172.21.15.55:0/2549705238 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0cc158400 msgr2=0x7fd0cc14ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:04.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d1c39640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0cc158400 0x7fd0cc14ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d1c39640 1 -- 172.21.15.55:0/2549705238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc009420 con 0x7fd0cc1587d0 2023-07-06T22:02:04.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d0c37640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0cc158400 0x7fd0cc14ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:04.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d1c39640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0cc1587d0 0x7fd0cc150a00 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400cef0 tx=0x7fd0c400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:04.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0c1ffb640 1 -- 172.21.15.55:0/2549705238 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c400d840 con 0x7fd0cc1587d0 2023-07-06T22:02:04.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0c1ffb640 1 -- 172.21.15.55:0/2549705238 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c400d9c0 con 0x7fd0cc1587d0 2023-07-06T22:02:04.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0c1ffb640 1 -- 172.21.15.55:0/2549705238 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c400dd70 con 0x7fd0cc1587d0 2023-07-06T22:02:04.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d369c640 1 -- 172.21.15.55:0/2549705238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0cc14fe30 con 0x7fd0cc1587d0 2023-07-06T22:02:04.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.491+0000 7fd0d369c640 1 -- 172.21.15.55:0/2549705238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0cc152e30 con 0x7fd0cc1587d0 2023-07-06T22:02:04.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.495+0000 7fd0d369c640 1 -- 172.21.15.55:0/2549705238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0cc06c580 con 0x7fd0cc1587d0 2023-07-06T22:02:04.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.495+0000 7fd0c1ffb640 1 -- 172.21.15.55:0/2549705238 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd0c401e3b0 con 0x7fd0cc1587d0 2023-07-06T22:02:04.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.495+0000 7fd0c1ffb640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fd0b00663a0 0x7fd0b0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.495+0000 7fd0c1ffb640 1 -- 172.21.15.55:0/2549705238 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6375+0+0 (secure 0 0 0) 0x7fd0c4084a70 con 0x7fd0cc1587d0 2023-07-06T22:02:04.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.495+0000 7fd0d1438640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fd0b00663a0 0x7fd0b0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:04.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.495+0000 7fd0d1438640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fd0b00663a0 0x7fd0b0068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80011f0 tx=0x7fd0c8009040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:04.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.499+0000 7fd0c1ffb640 1 -- 172.21.15.55:0/2549705238 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0c4051d50 con 0x7fd0cc1587d0 2023-07-06T22:02:04.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.655+0000 7fd0d369c640 1 -- 172.21.15.55:0/2549705238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0cc066d60 con 0x7fd0cc1587d0 2023-07-06T22:02:04.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.655+0000 7fd0c1ffb640 1 -- 172.21.15.55:0/2549705238 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16077 (secure 0 0 0) 0x7fd0c401a090 con 0x7fd0cc1587d0 2023-07-06T22:02:04.655 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:04.655 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":151,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:02:01.290928+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6836/4072042723":"2023-07-07T22:01:57.705947+0000","172.21.15.55:0/1150117832":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/2778588340":"2023-07-07T22:01:54.831883+0000","172.21.15.55:6833/462110382":"2023-07-07T22:01:54.831883+0000","172.21.15.55:6837/4072042723":"2023-07-07T22:01:57.705947+0000","172.21.15.55:0/2978696860":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3247819093":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3847009850":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/4284141340":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3374210555":"2023-07-07T22:01:47.217185+0000","172.21.15.55:6833/206120108":"2023-07-07T22:01:47.217185+0000","172.21.15.55:6832/206120108":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/1122193584":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/2036406408":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/1372487043":"2023-07-07T22:01:47.217185+0000","172.21.15.55:6832/462110382":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3843098755":"2023-07-07T22:01:47.217185+0000","172.21.15.55:0/1981543070":"2023-07-07T22:01:54.831883+0000","172.21.15.55:0/3618722598":"2023-07-07T22:01:47.217185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:02:04.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.659+0000 7fd0d369c640 1 -- 172.21.15.55:0/2549705238 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fd0b00663a0 msgr2=0x7fd0b0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.659+0000 7fd0d369c640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fd0b00663a0 0x7fd0b0068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80011f0 tx=0x7fd0c8009040 comp rx=0 tx=0).stop 2023-07-06T22:02:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.659+0000 7fd0d369c640 1 -- 172.21.15.55:0/2549705238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0cc1587d0 msgr2=0x7fd0cc150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.659+0000 7fd0d369c640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0cc1587d0 0x7fd0cc150a00 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400cef0 tx=0x7fd0c400a710 comp rx=0 tx=0).stop 2023-07-06T22:02:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.659+0000 7fd0d369c640 1 -- 172.21.15.55:0/2549705238 shutdown_connections 2023-07-06T22:02:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.659+0000 7fd0d369c640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0cc1587d0 0x7fd0cc150a00 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.659+0000 7fd0d369c640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fd0b00663a0 0x7fd0b0068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.659+0000 7fd0d369c640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0cc158400 0x7fd0cc14ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.659+0000 7fd0d369c640 1 --2- 172.21.15.55:0/2549705238 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0cc0710c0 0x7fd0cc14f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.659+0000 7fd0d369c640 1 -- 172.21.15.55:0/2549705238 >> 172.21.15.55:0/2549705238 conn(0x7fd0cc0cded0 msgr2=0x7fd0cc157360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.659+0000 7fd0d369c640 1 -- 172.21.15.55:0/2549705238 shutdown_connections 2023-07-06T22:02:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.659+0000 7fd0d369c640 1 -- 172.21.15.55:0/2549705238 wait complete. 2023-07-06T22:02:04.676 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:02:04.677 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:02:04.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.823+0000 7fa9f6607640 1 Processor -- start 2023-07-06T22:02:04.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.823+0000 7fa9f6607640 1 -- start start 2023-07-06T22:02:04.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.823+0000 7fa9f6607640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9f0158850 0x7fa9f00cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.823+0000 7fa9f6607640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa9f0070af0 0x7fa9f00ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.823+0000 7fa9f6607640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f0158c20 con 0x7fa9f00ca130 2023-07-06T22:02:04.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.823+0000 7fa9f6607640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f00b2aa0 con 0x7fa9f0070af0 2023-07-06T22:02:04.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.823+0000 7fa9f6607640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00c8db0 con 0x7fa9f0158850 2023-07-06T22:02:04.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.823+0000 7fa9ef7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa9f00ca130 0x7fa9f00703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58722/0 (socket says 172.21.15.55:58722) 2023-07-06T22:02:04.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.823+0000 7fa9ef7fe640 1 -- 172.21.15.55:0/357767248 learned_addr learned my addr 172.21.15.55:0/357767248 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:04.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 -- 172.21.15.55:0/357767248 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293971908 0 0) 0x7fa9f0158c20 con 0x7fa9f00ca130 2023-07-06T22:02:04.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 -- 172.21.15.55:0/357767248 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9d8005740 con 0x7fa9f00ca130 2023-07-06T22:02:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 -- 172.21.15.55:0/357767248 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1422504998 0 0) 0x7fa9d8005740 con 0x7fa9f00ca130 2023-07-06T22:02:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 -- 172.21.15.55:0/357767248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9f0158850 msgr2=0x7fa9f00cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 --2- 172.21.15.55:0/357767248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9f0158850 0x7fa9f00cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 -- 172.21.15.55:0/357767248 >> v2:172.21.15.138:3300/0 conn(0x7fa9f0070af0 msgr2=0x7fa9f00ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 --2- 172.21.15.55:0/357767248 >> v2:172.21.15.138:3300/0 conn(0x7fa9f0070af0 0x7fa9f00ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 -- 172.21.15.55:0/357767248 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00c9090 con 0x7fa9f00ca130 2023-07-06T22:02:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 -- 172.21.15.55:0/357767248 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fa9e4001680 con 0x7fa9f00ca130 2023-07-06T22:02:04.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 -- 172.21.15.55:0/357767248 >> v1:172.21.15.55:6789/0 conn(0x7fa9f00ca130 legacy=0x7fa9f00703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:04.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 --2- 172.21.15.55:0/357767248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d8005b90 0x7fa9d8005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 --2- 172.21.15.55:0/357767248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d80069e0 0x7fa9d8006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 --2- 172.21.15.55:0/357767248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9f0158850 0x7fa9d800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 -- 172.21.15.55:0/357767248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00b2aa0 con 0x7fa9d8005b90 2023-07-06T22:02:04.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 -- 172.21.15.55:0/357767248 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00c8db0 con 0x7fa9d80069e0 2023-07-06T22:02:04.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9eeffd640 1 -- 172.21.15.55:0/357767248 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d8007800 con 0x7fa9f0158850 2023-07-06T22:02:04.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9effff640 1 --2- 172.21.15.55:0/357767248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d8005b90 0x7fa9d8005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:04.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9f4ba4640 1 --2- 172.21.15.55:0/357767248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9f0158850 0x7fa9d800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:04.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9ef7fe640 1 --2- 172.21.15.55:0/357767248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d80069e0 0x7fa9d8006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:04.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9effff640 1 -- 172.21.15.55:0/357767248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9f0158850 msgr2=0x7fa9d800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:04.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9effff640 1 --2- 172.21.15.55:0/357767248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9f0158850 0x7fa9d800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9effff640 1 -- 172.21.15.55:0/357767248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d80069e0 msgr2=0x7fa9d8006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:04.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9effff640 1 --2- 172.21.15.55:0/357767248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d80069e0 0x7fa9d8006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9effff640 1 -- 172.21.15.55:0/357767248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d8005740 con 0x7fa9d8005b90 2023-07-06T22:02:04.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.827+0000 7fa9ef7fe640 1 --2- 172.21.15.55:0/357767248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d80069e0 0x7fa9d8006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.831+0000 7fa9effff640 1 --2- 172.21.15.55:0/357767248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d8005b90 0x7fa9d8005fa0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009890 tx=0x7fa9e001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4224fee28d20df6b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.831+0000 7fa9eeffd640 1 -- 172.21.15.55:0/357767248 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00ab600 con 0x7fa9d8005b90 2023-07-06T22:02:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.831+0000 7fa9eeffd640 1 -- 172.21.15.55:0/357767248 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e00a7050 con 0x7fa9d8005b90 2023-07-06T22:02:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.831+0000 7fa9eeffd640 1 -- 172.21.15.55:0/357767248 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00ab9c0 con 0x7fa9d8005b90 2023-07-06T22:02:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.831+0000 7fa9f6607640 1 -- 172.21.15.55:0/357767248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d8005b90 msgr2=0x7fa9d8005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:04.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.831+0000 7fa9f6607640 1 --2- 172.21.15.55:0/357767248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d8005b90 0x7fa9d8005fa0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009890 tx=0x7fa9e001c360 comp rx=0 tx=0).stop 2023-07-06T22:02:04.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.831+0000 7fa9f4ba4640 1 -- 172.21.15.55:0/357767248 reap_dead start 2023-07-06T22:02:04.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.831+0000 7fa9f6607640 1 -- 172.21.15.55:0/357767248 shutdown_connections 2023-07-06T22:02:04.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.831+0000 7fa9f6607640 1 -- 172.21.15.55:0/357767248 >> 172.21.15.55:0/357767248 conn(0x7fa9f00cea70 msgr2=0x7fa9f00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:04.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.831+0000 7fa9f6607640 1 -- 172.21.15.55:0/357767248 shutdown_connections 2023-07-06T22:02:04.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.831+0000 7fa9f6607640 1 -- 172.21.15.55:0/357767248 wait complete. 2023-07-06T22:02:04.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.831+0000 7fa9f6607640 1 Processor -- start 2023-07-06T22:02:04.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.831+0000 7fa9f6607640 1 -- start start 2023-07-06T22:02:04.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f6607640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d8005b90 0x7fa9f0099860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f6607640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9f01ed790 0x7fa9f0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f6607640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9f00ca500 0x7fa9f00ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f6607640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00caeb0 con 0x7fa9f00ca500 2023-07-06T22:02:04.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f6607640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f009a090 con 0x7fa9d8005b90 2023-07-06T22:02:04.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f6607640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f01eddc0 con 0x7fa9f01ed790 2023-07-06T22:02:04.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f4ba4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9f00ca500 0x7fa9f00ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:04.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f4ba4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9f00ca500 0x7fa9f00ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51574/0 (socket says 172.21.15.55:51574) 2023-07-06T22:02:04.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f4ba4640 1 -- 172.21.15.55:0/2495888015 learned_addr learned my addr 172.21.15.55:0/2495888015 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:04.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9ef7fe640 1 --2- 172.21.15.55:0/2495888015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9f01ed790 0x7fa9f0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:04.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9effff640 1 --2- 172.21.15.55:0/2495888015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d8005b90 0x7fa9f0099860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:04.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f4ba4640 1 -- 172.21.15.55:0/2495888015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9f01ed790 msgr2=0x7fa9f0156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:04.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f4ba4640 1 --2- 172.21.15.55:0/2495888015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9f01ed790 0x7fa9f0156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f4ba4640 1 -- 172.21.15.55:0/2495888015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d8005b90 msgr2=0x7fa9f0099860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:04.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f4ba4640 1 --2- 172.21.15.55:0/2495888015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d8005b90 0x7fa9f0099860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:04.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f4ba4640 1 -- 172.21.15.55:0/2495888015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f01ee0a0 con 0x7fa9f00ca500 2023-07-06T22:02:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f4ba4640 1 --2- 172.21.15.55:0/2495888015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9f00ca500 0x7fa9f00ca970 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fa9f006eaf0 tx=0x7fa9e800ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9ecff9640 1 -- 172.21.15.55:0/2495888015 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e800c750 con 0x7fa9f00ca500 2023-07-06T22:02:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9ecff9640 1 -- 172.21.15.55:0/2495888015 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e800c8b0 con 0x7fa9f00ca500 2023-07-06T22:02:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f6607640 1 -- 172.21.15.55:0/2495888015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f01ee380 con 0x7fa9f00ca500 2023-07-06T22:02:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9ecff9640 1 -- 172.21.15.55:0/2495888015 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e800cc40 con 0x7fa9f00ca500 2023-07-06T22:02:04.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f6607640 1 -- 172.21.15.55:0/2495888015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f01572c0 con 0x7fa9f00ca500 2023-07-06T22:02:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9f6607640 1 -- 172.21.15.55:0/2495888015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f00c8960 con 0x7fa9f00ca500 2023-07-06T22:02:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.835+0000 7fa9ecff9640 1 -- 172.21.15.55:0/2495888015 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa9e8016450 con 0x7fa9f00ca500 2023-07-06T22:02:04.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.839+0000 7fa9ecff9640 1 --2- 172.21.15.55:0/2495888015 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fa9dc0663d0 0x7fa9dc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.839+0000 7fa9ecff9640 1 -- 172.21.15.55:0/2495888015 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6375+0+0 (secure 0 0 0) 0x7fa9e8008030 con 0x7fa9f00ca500 2023-07-06T22:02:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.839+0000 7fa9effff640 1 --2- 172.21.15.55:0/2495888015 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fa9dc0663d0 0x7fa9dc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.839+0000 7fa9effff640 1 --2- 172.21.15.55:0/2495888015 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fa9dc0663d0 0x7fa9dc068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00ad000 tx=0x7fa9e0004850 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:04.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.843+0000 7fa9ecff9640 1 -- 172.21.15.55:0/2495888015 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9e8054b70 con 0x7fa9f00ca500 2023-07-06T22:02:04.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.999+0000 7fa9f6607640 1 -- 172.21.15.55:0/2495888015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9f0066d60 con 0x7fa9f00ca500 2023-07-06T22:02:04.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.999+0000 7fa9ecff9640 1 -- 172.21.15.55:0/2495888015 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v151) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9e8054700 con 0x7fa9f00ca500 2023-07-06T22:02:04.998 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:02:05.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.999+0000 7fa9f6607640 1 -- 172.21.15.55:0/2495888015 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fa9dc0663d0 msgr2=0x7fa9dc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.999+0000 7fa9f6607640 1 --2- 172.21.15.55:0/2495888015 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fa9dc0663d0 0x7fa9dc068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00ad000 tx=0x7fa9e0004850 comp rx=0 tx=0).stop 2023-07-06T22:02:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.999+0000 7fa9f6607640 1 -- 172.21.15.55:0/2495888015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9f00ca500 msgr2=0x7fa9f00ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:04.999+0000 7fa9f6607640 1 --2- 172.21.15.55:0/2495888015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9f00ca500 0x7fa9f00ca970 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fa9f006eaf0 tx=0x7fa9e800ede0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.003+0000 7fa9f6607640 1 -- 172.21.15.55:0/2495888015 shutdown_connections 2023-07-06T22:02:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.003+0000 7fa9f6607640 1 --2- 172.21.15.55:0/2495888015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9f00ca500 0x7fa9f00ca970 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.003+0000 7fa9f6607640 1 --2- 172.21.15.55:0/2495888015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9f01ed790 0x7fa9f0156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.003+0000 7fa9f6607640 1 --2- 172.21.15.55:0/2495888015 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fa9dc0663d0 0x7fa9dc068880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.003+0000 7fa9f6607640 1 --2- 172.21.15.55:0/2495888015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9d8005b90 0x7fa9f0099860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.003+0000 7fa9f6607640 1 -- 172.21.15.55:0/2495888015 >> 172.21.15.55:0/2495888015 conn(0x7fa9f00cea70 msgr2=0x7fa9f00cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:05.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.003+0000 7fa9f6607640 1 -- 172.21.15.55:0/2495888015 shutdown_connections 2023-07-06T22:02:05.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.003+0000 7fa9f6607640 1 -- 172.21.15.55:0/2495888015 wait complete. 2023-07-06T22:02:05.020 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:02:05.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad6e07b640 1 Processor -- start 2023-07-06T22:02:05.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad6e07b640 1 -- start start 2023-07-06T22:02:05.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad6e07b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fad68158850 0x7fad680cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:05.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad6e07b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad680ca130 0x7fad680ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:05.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad6e07b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad680703e0 0x7fad68070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:05.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad6e07b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad68070dc0 con 0x7fad680703e0 2023-07-06T22:02:05.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad6e07b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad68158c20 con 0x7fad68158850 2023-07-06T22:02:05.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad6e07b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad680c8db0 con 0x7fad680ca130 2023-07-06T22:02:05.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad67fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad680703e0 0x7fad68070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:05.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad67fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad680703e0 0x7fad68070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51576/0 (socket says 172.21.15.55:51576) 2023-07-06T22:02:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad67fff640 1 -- 172.21.15.55:0/3201875535 learned_addr learned my addr 172.21.15.55:0/3201875535 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad66ffd640 1 --2- 172.21.15.55:0/3201875535 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad680ca130 0x7fad680ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad677fe640 1 --2- 172.21.15.55:0/3201875535 >> v2:172.21.15.138:3300/0 conn(0x7fad68158850 0x7fad680cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad67fff640 1 -- 172.21.15.55:0/3201875535 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad680ca130 msgr2=0x7fad680ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:05.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad67fff640 1 --2- 172.21.15.55:0/3201875535 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad680ca130 0x7fad680ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad67fff640 1 -- 172.21.15.55:0/3201875535 >> v2:172.21.15.138:3300/0 conn(0x7fad68158850 msgr2=0x7fad680cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:05.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad67fff640 1 --2- 172.21.15.55:0/3201875535 >> v2:172.21.15.138:3300/0 conn(0x7fad68158850 0x7fad680cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.167+0000 7fad67fff640 1 -- 172.21.15.55:0/3201875535 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad680c9090 con 0x7fad680703e0 2023-07-06T22:02:05.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.171+0000 7fad67fff640 1 --2- 172.21.15.55:0/3201875535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad680703e0 0x7fad68070880 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fad6806eaf0 tx=0x7fad600213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de1d987959a8e27 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:05.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.171+0000 7fad667fc640 1 -- 172.21.15.55:0/3201875535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6000b2d0 con 0x7fad680703e0 2023-07-06T22:02:05.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.171+0000 7fad667fc640 1 -- 172.21.15.55:0/3201875535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad600ad050 con 0x7fad680703e0 2023-07-06T22:02:05.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.171+0000 7fad667fc640 1 -- 172.21.15.55:0/3201875535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60009820 con 0x7fad680703e0 2023-07-06T22:02:05.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.171+0000 7fad6e07b640 1 -- 172.21.15.55:0/3201875535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad680703e0 msgr2=0x7fad68070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:05.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.171+0000 7fad6e07b640 1 --2- 172.21.15.55:0/3201875535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad680703e0 0x7fad68070880 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fad6806eaf0 tx=0x7fad600213c0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.171+0000 7fad6e07b640 1 -- 172.21.15.55:0/3201875535 shutdown_connections 2023-07-06T22:02:05.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.171+0000 7fad6e07b640 1 --2- 172.21.15.55:0/3201875535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad680703e0 0x7fad68070880 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.171+0000 7fad6e07b640 1 --2- 172.21.15.55:0/3201875535 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad680ca130 0x7fad680ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.171+0000 7fad6e07b640 1 --2- 172.21.15.55:0/3201875535 >> v2:172.21.15.138:3300/0 conn(0x7fad68158850 0x7fad680cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.171+0000 7fad6e07b640 1 -- 172.21.15.55:0/3201875535 >> 172.21.15.55:0/3201875535 conn(0x7fad680cea70 msgr2=0x7fad680ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:05.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.171+0000 7fad6e07b640 1 -- 172.21.15.55:0/3201875535 shutdown_connections 2023-07-06T22:02:05.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.171+0000 7fad6e07b640 1 -- 172.21.15.55:0/3201875535 wait complete. 2023-07-06T22:02:05.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad6e07b640 1 Processor -- start 2023-07-06T22:02:05.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad6e07b640 1 -- start start 2023-07-06T22:02:05.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad6e07b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad680703e0 0x7fad681edc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:05.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad6e07b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad680ca130 0x7fad680c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:05.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad6e07b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad68158850 0x7fad681ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:05.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad6e07b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad681edaf0 con 0x7fad68158850 2023-07-06T22:02:05.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad6e07b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad680c4e20 con 0x7fad680703e0 2023-07-06T22:02:05.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad6e07b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad68099bf0 con 0x7fad680ca130 2023-07-06T22:02:05.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad67fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad68158850 0x7fad681ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad67fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad68158850 0x7fad681ed5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51588/0 (socket says 172.21.15.55:51588) 2023-07-06T22:02:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad67fff640 1 -- 172.21.15.55:0/348717491 learned_addr learned my addr 172.21.15.55:0/348717491 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad66ffd640 1 --2- 172.21.15.55:0/348717491 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad680ca130 0x7fad680c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad677fe640 1 --2- 172.21.15.55:0/348717491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad680703e0 0x7fad681edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad67fff640 1 -- 172.21.15.55:0/348717491 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad680ca130 msgr2=0x7fad680c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad67fff640 1 --2- 172.21.15.55:0/348717491 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad680ca130 0x7fad680c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad67fff640 1 -- 172.21.15.55:0/348717491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad680703e0 msgr2=0x7fad681edc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:05.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad67fff640 1 --2- 172.21.15.55:0/348717491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad680703e0 0x7fad681edc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad67fff640 1 -- 172.21.15.55:0/348717491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6000bd40 con 0x7fad68158850 2023-07-06T22:02:05.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad67fff640 1 --2- 172.21.15.55:0/348717491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad68158850 0x7fad681ed5b0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fad6001fa70 tx=0x7fad6001e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:05.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad4ffff640 1 -- 172.21.15.55:0/348717491 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600c0070 con 0x7fad68158850 2023-07-06T22:02:05.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad4ffff640 1 -- 172.21.15.55:0/348717491 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad60009810 con 0x7fad68158850 2023-07-06T22:02:05.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad4ffff640 1 -- 172.21.15.55:0/348717491 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60009bc0 con 0x7fad68158850 2023-07-06T22:02:05.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.175+0000 7fad6e07b640 1 -- 172.21.15.55:0/348717491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad680c5070 con 0x7fad68158850 2023-07-06T22:02:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.179+0000 7fad6e07b640 1 -- 172.21.15.55:0/348717491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad680c5630 con 0x7fad68158850 2023-07-06T22:02:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.179+0000 7fad6e07b640 1 -- 172.21.15.55:0/348717491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad680c5820 con 0x7fad68158850 2023-07-06T22:02:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.179+0000 7fad4ffff640 1 -- 172.21.15.55:0/348717491 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fad60009d20 con 0x7fad68158850 2023-07-06T22:02:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.179+0000 7fad4ffff640 1 --2- 172.21.15.55:0/348717491 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fad540663a0 0x7fad54068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.179+0000 7fad4ffff640 1 -- 172.21.15.55:0/348717491 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6375+0+0 (secure 0 0 0) 0x7fad60122290 con 0x7fad68158850 2023-07-06T22:02:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.179+0000 7fad677fe640 1 --2- 172.21.15.55:0/348717491 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fad540663a0 0x7fad54068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.179+0000 7fad677fe640 1 --2- 172.21.15.55:0/348717491 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fad540663a0 0x7fad54068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fad58009a40 tx=0x7fad58009190 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:05.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.183+0000 7fad4ffff640 1 -- 172.21.15.55:0/348717491 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fad600f2ee0 con 0x7fad68158850 2023-07-06T22:02:05.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.339+0000 7fad6e07b640 1 -- 172.21.15.55:0/348717491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fad68066d60 con 0x7fad68158850 2023-07-06T22:02:05.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.339+0000 7fad4ffff640 1 -- 172.21.15.55:0/348717491 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v151) v1 ==== 92+0+10 (secure 0 0 0) 0x7fad600f2a70 con 0x7fad68158850 2023-07-06T22:02:05.339 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:02:05.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.343+0000 7fad6e07b640 1 -- 172.21.15.55:0/348717491 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fad540663a0 msgr2=0x7fad54068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:05.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.343+0000 7fad6e07b640 1 --2- 172.21.15.55:0/348717491 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fad540663a0 0x7fad54068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fad58009a40 tx=0x7fad58009190 comp rx=0 tx=0).stop 2023-07-06T22:02:05.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.343+0000 7fad6e07b640 1 -- 172.21.15.55:0/348717491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad68158850 msgr2=0x7fad681ed5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:05.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.343+0000 7fad6e07b640 1 --2- 172.21.15.55:0/348717491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad68158850 0x7fad681ed5b0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fad6001fa70 tx=0x7fad6001e160 comp rx=0 tx=0).stop 2023-07-06T22:02:05.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.343+0000 7fad6e07b640 1 -- 172.21.15.55:0/348717491 shutdown_connections 2023-07-06T22:02:05.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.343+0000 7fad6e07b640 1 --2- 172.21.15.55:0/348717491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad68158850 0x7fad681ed5b0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.343+0000 7fad6e07b640 1 --2- 172.21.15.55:0/348717491 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad680ca130 0x7fad680c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.343+0000 7fad6e07b640 1 --2- 172.21.15.55:0/348717491 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fad540663a0 0x7fad54068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.343+0000 7fad6e07b640 1 --2- 172.21.15.55:0/348717491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad680703e0 0x7fad681edc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.343+0000 7fad6e07b640 1 -- 172.21.15.55:0/348717491 >> 172.21.15.55:0/348717491 conn(0x7fad680cea70 msgr2=0x7fad680af6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:05.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.343+0000 7fad6e07b640 1 -- 172.21.15.55:0/348717491 shutdown_connections 2023-07-06T22:02:05.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.343+0000 7fad6e07b640 1 -- 172.21.15.55:0/348717491 wait complete. 2023-07-06T22:02:05.361 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-06T22:02:05.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.507+0000 7f9320382640 1 Processor -- start 2023-07-06T22:02:05.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.507+0000 7f9320382640 1 -- start start 2023-07-06T22:02:05.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.511+0000 7f9320382640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93180cd140 0x7f9318163380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:05.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.511+0000 7f9320382640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9318158c20 con 0x7f9318158850 2023-07-06T22:02:05.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.511+0000 7f9320382640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93180c8db0 con 0x7f93180ca130 2023-07-06T22:02:05.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.511+0000 7f9320382640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93180c9090 con 0x7f93180cd140 2023-07-06T22:02:05.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.511+0000 7f931e11e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9318158850 0x7f93180cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58738/0 (socket says 172.21.15.55:58738) 2023-07-06T22:02:05.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.511+0000 7f931e11e640 1 -- 172.21.15.55:0/3139230391 learned_addr learned my addr 172.21.15.55:0/3139230391 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:05.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.511+0000 7f931e91f640 1 --2- 172.21.15.55:0/3139230391 >> v2:172.21.15.55:3300/0 conn(0x7f93180cd140 0x7f9318163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:05.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.511+0000 7f931d11c640 1 -- 172.21.15.55:0/3139230391 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099235868 0 0) 0x7f9318158c20 con 0x7f9318158850 2023-07-06T22:02:05.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.511+0000 7f931d11c640 1 -- 172.21.15.55:0/3139230391 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9304003530 con 0x7f9318158850 2023-07-06T22:02:05.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.511+0000 7f931e91f640 1 -- 172.21.15.55:0/3139230391 >> v1:172.21.15.138:6789/0 conn(0x7f93180ca130 legacy=0x7f93180703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:05.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.511+0000 7f931e91f640 1 -- 172.21.15.55:0/3139230391 >> v1:172.21.15.55:6789/0 conn(0x7f9318158850 legacy=0x7f93180cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:05.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.511+0000 7f931e91f640 1 -- 172.21.15.55:0/3139230391 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93180c9370 con 0x7f93180cd140 2023-07-06T22:02:05.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.515+0000 7f931e91f640 1 --2- 172.21.15.55:0/3139230391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93180cd140 0x7f9318163380 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f9310009d90 tx=0x7f931001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d498a3f49008ecbc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:05.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.515+0000 7f931d11c640 1 -- 172.21.15.55:0/3139230391 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93100a6800 con 0x7f93180cd140 2023-07-06T22:02:05.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.515+0000 7f931d11c640 1 -- 172.21.15.55:0/3139230391 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93100a6960 con 0x7f93180cd140 2023-07-06T22:02:05.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.515+0000 7f931d11c640 1 -- 172.21.15.55:0/3139230391 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93100a6cf0 con 0x7f93180cd140 2023-07-06T22:02:05.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.515+0000 7f9320382640 1 -- 172.21.15.55:0/3139230391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93180cd140 msgr2=0x7f9318163380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:05.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.515+0000 7f9320382640 1 --2- 172.21.15.55:0/3139230391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93180cd140 0x7f9318163380 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f9310009d90 tx=0x7f931001c9e0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.515+0000 7f9320382640 1 -- 172.21.15.55:0/3139230391 shutdown_connections 2023-07-06T22:02:05.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.515+0000 7f9320382640 1 --2- 172.21.15.55:0/3139230391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93180cd140 0x7f9318163380 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.515+0000 7f9320382640 1 -- 172.21.15.55:0/3139230391 >> 172.21.15.55:0/3139230391 conn(0x7f93180cea70 msgr2=0x7f93180ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:05.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.515+0000 7f9320382640 1 -- 172.21.15.55:0/3139230391 shutdown_connections 2023-07-06T22:02:05.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.515+0000 7f9320382640 1 -- 172.21.15.55:0/3139230391 wait complete. 2023-07-06T22:02:05.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.515+0000 7f9320382640 1 Processor -- start 2023-07-06T22:02:05.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.515+0000 7f9320382640 1 -- start start 2023-07-06T22:02:05.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f9320382640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93180ca130 0x7f9318162d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:05.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f9320382640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93180cd140 0x7f93180693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:05.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f9320382640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9318158850 0x7f931806c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:05.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f9320382640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93181632d0 con 0x7f9318158850 2023-07-06T22:02:05.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f9320382640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93181567c0 con 0x7f93180ca130 2023-07-06T22:02:05.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f9320382640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93181577a0 con 0x7f93180cd140 2023-07-06T22:02:05.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f931e91f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9318158850 0x7f931806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:05.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f931e91f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9318158850 0x7f931806c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51610/0 (socket says 172.21.15.55:51610) 2023-07-06T22:02:05.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f931e91f640 1 -- 172.21.15.55:0/1651799694 learned_addr learned my addr 172.21.15.55:0/1651799694 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:05.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f931e91f640 1 -- 172.21.15.55:0/1651799694 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93180cd140 msgr2=0x7f93180693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:05.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f931e91f640 1 --2- 172.21.15.55:0/1651799694 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93180cd140 0x7f93180693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f931e91f640 1 -- 172.21.15.55:0/1651799694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93180ca130 msgr2=0x7f9318162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:05.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f931e91f640 1 --2- 172.21.15.55:0/1651799694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93180ca130 0x7f9318162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f931e91f640 1 -- 172.21.15.55:0/1651799694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9310009a70 con 0x7f9318158850 2023-07-06T22:02:05.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f931e91f640 1 --2- 172.21.15.55:0/1651799694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9318158850 0x7f931806c290 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f93100b1040 tx=0x7f9310019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:05.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f930effd640 1 -- 172.21.15.55:0/1651799694 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93100ba650 con 0x7f9318158850 2023-07-06T22:02:05.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f930effd640 1 -- 172.21.15.55:0/1651799694 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93100ba7b0 con 0x7f9318158850 2023-07-06T22:02:05.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f9320382640 1 -- 172.21.15.55:0/1651799694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9318157a40 con 0x7f9318158850 2023-07-06T22:02:05.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f930effd640 1 -- 172.21.15.55:0/1651799694 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93100bab20 con 0x7f9318158850 2023-07-06T22:02:05.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f9320382640 1 -- 172.21.15.55:0/1651799694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9318155190 con 0x7f9318158850 2023-07-06T22:02:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f9320382640 1 -- 172.21.15.55:0/1651799694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9318155380 con 0x7f9318158850 2023-07-06T22:02:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.519+0000 7f930effd640 1 -- 172.21.15.55:0/1651799694 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f93100bac80 con 0x7f9318158850 2023-07-06T22:02:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.523+0000 7f930effd640 1 --2- 172.21.15.55:0/1651799694 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f92fc0663a0 0x7f92fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:05.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.523+0000 7f930effd640 1 -- 172.21.15.55:0/1651799694 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f9310120220 con 0x7f9318158850 2023-07-06T22:02:05.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.523+0000 7f931e11e640 1 --2- 172.21.15.55:0/1651799694 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f92fc0663a0 0x7f92fc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:05.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.523+0000 7f931e11e640 1 --2- 172.21.15.55:0/1651799694 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f92fc0663a0 0x7f92fc068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9314007fd0 tx=0x7f9314007940 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:05.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.527+0000 7f930effd640 1 -- 172.21.15.55:0/1651799694 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93100ed4d0 con 0x7f9318158850 2023-07-06T22:02:05.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.683+0000 7f9320382640 1 -- 172.21.15.55:0/1651799694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f93180c9900 con 0x7f9318158850 2023-07-06T22:02:05.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.691+0000 7f930effd640 1 -- 172.21.15.55:0/1651799694 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7f93100f0af0 con 0x7f9318158850 2023-07-06T22:02:05.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.691+0000 7f9320382640 1 -- 172.21.15.55:0/1651799694 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f92fc0663a0 msgr2=0x7f92fc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:05.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.691+0000 7f9320382640 1 --2- 172.21.15.55:0/1651799694 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f92fc0663a0 0x7f92fc068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9314007fd0 tx=0x7f9314007940 comp rx=0 tx=0).stop 2023-07-06T22:02:05.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.691+0000 7f9320382640 1 -- 172.21.15.55:0/1651799694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9318158850 msgr2=0x7f931806c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.691+0000 7f9320382640 1 --2- 172.21.15.55:0/1651799694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9318158850 0x7f931806c290 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f93100b1040 tx=0x7f9310019780 comp rx=0 tx=0).stop 2023-07-06T22:02:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.691+0000 7f9320382640 1 -- 172.21.15.55:0/1651799694 shutdown_connections 2023-07-06T22:02:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.691+0000 7f9320382640 1 --2- 172.21.15.55:0/1651799694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9318158850 0x7f931806c290 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.691+0000 7f9320382640 1 --2- 172.21.15.55:0/1651799694 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93180cd140 0x7f93180693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.691+0000 7f9320382640 1 --2- 172.21.15.55:0/1651799694 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f92fc0663a0 0x7f92fc068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.691+0000 7f9320382640 1 --2- 172.21.15.55:0/1651799694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93180ca130 0x7f9318162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.691+0000 7f9320382640 1 -- 172.21.15.55:0/1651799694 >> 172.21.15.55:0/1651799694 conn(0x7f93180cea70 msgr2=0x7f931806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:05.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.691+0000 7f9320382640 1 -- 172.21.15.55:0/1651799694 shutdown_connections 2023-07-06T22:02:05.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:05.691+0000 7f9320382640 1 -- 172.21.15.55:0/1651799694 wait complete. 2023-07-06T22:02:05.710 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T22:02:05.710 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:02:05.755 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:02:05.806 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T22:02:05.806 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:02:05.806 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:02:05.815 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:02:05.816 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:02:05.816 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:02:05.826 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:02:05.826 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:02:05.826 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:02:05.864 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:02:05.864 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:02:05.865 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:02:05.874 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:02:05.875 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-06T22:02:05.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:02:06.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44c0848640 1 Processor -- start 2023-07-06T22:02:06.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44c0848640 1 -- start start 2023-07-06T22:02:06.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44c0848640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44bc0b7cd0 0x7f44bc0ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:06.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44c0848640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f44bc0ccab0 0x7f44bc0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:06.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44c0848640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44bc0ccf00 0x7f44bc0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:06.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44c0848640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44bc0d2310 con 0x7f44bc0ccf00 2023-07-06T22:02:06.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44c0848640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44bc0b80a0 con 0x7f44bc0ccab0 2023-07-06T22:02:06.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44c0848640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0d1100 con 0x7f44bc0b7cd0 2023-07-06T22:02:06.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44bad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44bc0ccf00 0x7f44bc0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:06.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44bad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44bc0ccf00 0x7f44bc0b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51626/0 (socket says 172.21.15.55:51626) 2023-07-06T22:02:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44bad9d640 1 -- 172.21.15.55:0/1326942905 learned_addr learned my addr 172.21.15.55:0/1326942905 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44ba59c640 1 --2- 172.21.15.55:0/1326942905 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44bc0b7cd0 0x7f44bc0ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44b3fff640 1 --2- 172.21.15.55:0/1326942905 >> v2:172.21.15.138:3300/0 conn(0x7f44bc0ccab0 0x7f44bc0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44bad9d640 1 -- 172.21.15.55:0/1326942905 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44bc0b7cd0 msgr2=0x7f44bc0ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44bad9d640 1 --2- 172.21.15.55:0/1326942905 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44bc0b7cd0 0x7f44bc0ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44bad9d640 1 -- 172.21.15.55:0/1326942905 >> v2:172.21.15.138:3300/0 conn(0x7f44bc0ccab0 msgr2=0x7f44bc0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44bad9d640 1 --2- 172.21.15.55:0/1326942905 >> v2:172.21.15.138:3300/0 conn(0x7f44bc0ccab0 0x7f44bc0b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.055+0000 7f44bad9d640 1 -- 172.21.15.55:0/1326942905 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc0cecf0 con 0x7f44bc0ccf00 2023-07-06T22:02:06.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.059+0000 7f44bad9d640 1 --2- 172.21.15.55:0/1326942905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44bc0ccf00 0x7f44bc0b1e10 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f44bc065a00 tx=0x7f44b401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e961fe769b972ea server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:06.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.059+0000 7f44b9d9b640 1 -- 172.21.15.55:0/1326942905 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40a55c0 con 0x7f44bc0ccf00 2023-07-06T22:02:06.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.059+0000 7f44b9d9b640 1 -- 172.21.15.55:0/1326942905 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b40a5720 con 0x7f44bc0ccf00 2023-07-06T22:02:06.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.059+0000 7f44b9d9b640 1 -- 172.21.15.55:0/1326942905 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40a5ab0 con 0x7f44bc0ccf00 2023-07-06T22:02:06.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.059+0000 7f44c0848640 1 -- 172.21.15.55:0/1326942905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44bc0ccf00 msgr2=0x7f44bc0b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:06.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.059+0000 7f44c0848640 1 --2- 172.21.15.55:0/1326942905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44bc0ccf00 0x7f44bc0b1e10 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f44bc065a00 tx=0x7f44b401c940 comp rx=0 tx=0).stop 2023-07-06T22:02:06.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.059+0000 7f44c0848640 1 -- 172.21.15.55:0/1326942905 shutdown_connections 2023-07-06T22:02:06.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.059+0000 7f44c0848640 1 --2- 172.21.15.55:0/1326942905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44bc0ccf00 0x7f44bc0b1e10 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.059+0000 7f44c0848640 1 --2- 172.21.15.55:0/1326942905 >> v2:172.21.15.138:3300/0 conn(0x7f44bc0ccab0 0x7f44bc0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.059+0000 7f44c0848640 1 --2- 172.21.15.55:0/1326942905 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44bc0b7cd0 0x7f44bc0ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.059+0000 7f44c0848640 1 -- 172.21.15.55:0/1326942905 >> 172.21.15.55:0/1326942905 conn(0x7f44bc0ceee0 msgr2=0x7f44bc0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:06.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.059+0000 7f44c0848640 1 -- 172.21.15.55:0/1326942905 shutdown_connections 2023-07-06T22:02:06.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.059+0000 7f44c0848640 1 -- 172.21.15.55:0/1326942905 wait complete. 2023-07-06T22:02:06.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44c0848640 1 Processor -- start 2023-07-06T22:02:06.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44c0848640 1 -- start start 2023-07-06T22:02:06.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44c0848640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44bc0b7cd0 0x7f44bc15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:06.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44c0848640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44bc0ccab0 0x7f44bc14c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:06.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44c0848640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44bc0ccf00 0x7f44bc14dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:06.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44c0848640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc15d850 con 0x7f44bc0ccf00 2023-07-06T22:02:06.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44c0848640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc15f220 con 0x7f44bc0ccab0 2023-07-06T22:02:06.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44c0848640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc15d570 con 0x7f44bc0b7cd0 2023-07-06T22:02:06.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44bad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44bc0ccf00 0x7f44bc14dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:06.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44bad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44bc0ccf00 0x7f44bc14dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51638/0 (socket says 172.21.15.55:51638) 2023-07-06T22:02:06.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44bad9d640 1 -- 172.21.15.55:0/1526614239 learned_addr learned my addr 172.21.15.55:0/1526614239 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44b3fff640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44bc0ccab0 0x7f44bc14c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44ba59c640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44bc0b7cd0 0x7f44bc15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44bad9d640 1 -- 172.21.15.55:0/1526614239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44bc0b7cd0 msgr2=0x7f44bc15ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44bad9d640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44bc0b7cd0 0x7f44bc15ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44bad9d640 1 -- 172.21.15.55:0/1526614239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44bc0ccab0 msgr2=0x7f44bc14c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44bad9d640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44bc0ccab0 0x7f44bc14c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44bad9d640 1 -- 172.21.15.55:0/1526614239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4009b30 con 0x7f44bc0ccf00 2023-07-06T22:02:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44b3fff640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44bc0ccab0 0x7f44bc14c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:06.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44ba59c640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44bc0b7cd0 0x7f44bc15ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:06.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44bad9d640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44bc0ccf00 0x7f44bc14dc20 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f44b401aff0 tx=0x7f44b40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:06.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44b2ffd640 1 -- 172.21.15.55:0/1526614239 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40a55c0 con 0x7f44bc0ccf00 2023-07-06T22:02:06.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44b2ffd640 1 -- 172.21.15.55:0/1526614239 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b40b8670 con 0x7f44bc0ccf00 2023-07-06T22:02:06.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44b2ffd640 1 -- 172.21.15.55:0/1526614239 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40b8a20 con 0x7f44bc0ccf00 2023-07-06T22:02:06.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44c0848640 1 -- 172.21.15.55:0/1526614239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44bc14d140 con 0x7f44bc0ccf00 2023-07-06T22:02:06.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.063+0000 7f44c0848640 1 -- 172.21.15.55:0/1526614239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc14d700 con 0x7f44bc0ccf00 2023-07-06T22:02:06.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.067+0000 7f44c0848640 1 -- 172.21.15.55:0/1526614239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc14cfa0 con 0x7f44bc0ccf00 2023-07-06T22:02:06.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.067+0000 7f44b2ffd640 1 -- 172.21.15.55:0/1526614239 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f44b40b8b80 con 0x7f44bc0ccf00 2023-07-06T22:02:06.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.067+0000 7f44b2ffd640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f449c0663a0 0x7f449c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:06.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.067+0000 7f44b2ffd640 1 -- 172.21.15.55:0/1526614239 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f44b411f330 con 0x7f44bc0ccf00 2023-07-06T22:02:06.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.067+0000 7f44ba59c640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f449c0663a0 0x7f449c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:06.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.067+0000 7f44ba59c640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f449c0663a0 0x7f449c068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f44bc166b70 tx=0x7f44ac008040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:06.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.071+0000 7f44b2ffd640 1 -- 172.21.15.55:0/1526614239 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44bc14cfa0 con 0x7f44bc0ccf00 2023-07-06T22:02:06.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.259+0000 7f44c0848640 1 -- 172.21.15.55:0/1526614239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44bc14cfa0 con 0x7f44bc0ccf00 2023-07-06T22:02:06.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.259+0000 7f44b2ffd640 1 -- 172.21.15.55:0/1526614239 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f44bc14cfa0 con 0x7f44bc0ccf00 2023-07-06T22:02:06.258 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:06.258 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":65,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/457440874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":457440874},{"type":"v1","addr":"172.21.15.138:6834","nonce":457440874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/446729940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":446729940},{"type":"v1","addr":"172.21.15.55:6835","nonce":446729940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9189,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/742646154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":742646154},{"type":"v1","addr":"172.21.15.138:6835","nonce":742646154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":9651,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/274650838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":274650838},{"type":"v1","addr":"172.21.15.55:6837","nonce":274650838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[]} 2023-07-06T22:02:06.259 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 65 2023-07-06T22:02:06.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.259+0000 7f44c0848640 1 -- 172.21.15.55:0/1526614239 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f449c0663a0 msgr2=0x7f449c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:06.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.259+0000 7f44c0848640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f449c0663a0 0x7f449c068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f44bc166b70 tx=0x7f44ac008040 comp rx=0 tx=0).stop 2023-07-06T22:02:06.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.259+0000 7f44c0848640 1 -- 172.21.15.55:0/1526614239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44bc0ccf00 msgr2=0x7f44bc14dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:06.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.259+0000 7f44c0848640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44bc0ccf00 0x7f44bc14dc20 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f44b401aff0 tx=0x7f44b40196e0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.259+0000 7f44c0848640 1 -- 172.21.15.55:0/1526614239 shutdown_connections 2023-07-06T22:02:06.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.259+0000 7f44c0848640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44bc0ccf00 0x7f44bc14dc20 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.263+0000 7f44c0848640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f449c0663a0 0x7f449c068850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.263+0000 7f44c0848640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44bc0ccab0 0x7f44bc14c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.263+0000 7f44c0848640 1 --2- 172.21.15.55:0/1526614239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44bc0b7cd0 0x7f44bc15ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.263+0000 7f44c0848640 1 -- 172.21.15.55:0/1526614239 >> 172.21.15.55:0/1526614239 conn(0x7f44bc0ceee0 msgr2=0x7f44bc15b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:06.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.263+0000 7f44c0848640 1 -- 172.21.15.55:0/1526614239 shutdown_connections 2023-07-06T22:02:06.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.263+0000 7f44c0848640 1 -- 172.21.15.55:0/1526614239 wait complete. 2023-07-06T22:02:06.279 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T22:02:06.280 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-06T22:02:06.280 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T22:02:06.280 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:02:06.280 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T22:02:06.281 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-06T22:02:06.281 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T22:02:06.281 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:02:06.281 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T22:02:06.281 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-06T22:02:06.282 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T22:02:06.282 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:02:06.282 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T22:02:06.282 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-06T22:02:06.283 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T22:02:06.283 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:02:06.294 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T22:02:06.294 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T22:02:06.295 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T22:02:06.295 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T22:02:06.299 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T22:02:06.299 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T22:02:06.300 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T22:02:06.300 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T22:02:06.339 INFO:tasks.ceph.mds.c:Started 2023-07-06T22:02:06.339 DEBUG:teuthology.parallel:result is None 2023-07-06T22:02:06.341 INFO:tasks.ceph.mds.a:Started 2023-07-06T22:02:06.341 DEBUG:teuthology.parallel:result is None 2023-07-06T22:02:06.345 INFO:tasks.ceph.mds.b:Started 2023-07-06T22:02:06.346 DEBUG:teuthology.parallel:result is None 2023-07-06T22:02:06.347 INFO:tasks.ceph.mds.d:Started 2023-07-06T22:02:06.348 DEBUG:teuthology.parallel:result is None 2023-07-06T22:02:06.348 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-06T22:02:06.428 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T22:02:06.428 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-07-06T22:02:06.438 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-07-06T22:02:06.438 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-07-06T22:02:06.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.503+0000 7f047d6af640 1 Processor -- start 2023-07-06T22:02:06.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.503+0000 7f047d6af640 1 -- start start 2023-07-06T22:02:06.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.507+0000 7f047d6af640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04780b1250 0x7f047815f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:06.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.507+0000 7f047d6af640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04780cc740 con 0x7f04780d0630 2023-07-06T22:02:06.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.507+0000 7f047d6af640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04780ccc90 con 0x7f04780ce200 2023-07-06T22:02:06.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.507+0000 7f047d6af640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04780b29c0 con 0x7f04780b1250 2023-07-06T22:02:06.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.507+0000 7f0477fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04780b1250 0x7f047815f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:06.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.507+0000 7f04777fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f04780d0630 0x7f047815f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58758/0 (socket says 172.21.15.55:58758) 2023-07-06T22:02:06.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.507+0000 7f04777fe640 1 -- 172.21.15.55:0/3598471413 learned_addr learned my addr 172.21.15.55:0/3598471413 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:06.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.507+0000 7f0477fff640 1 -- 172.21.15.55:0/3598471413 >> v1:172.21.15.138:6789/0 conn(0x7f04780ce200 legacy=0x7f04780ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:06.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.507+0000 7f0477fff640 1 -- 172.21.15.55:0/3598471413 >> v1:172.21.15.55:6789/0 conn(0x7f04780d0630 legacy=0x7f047815f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:06.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.507+0000 7f0477fff640 1 -- 172.21.15.55:0/3598471413 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04780d1d10 con 0x7f04780b1250 2023-07-06T22:02:06.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.507+0000 7f0476ffd640 1 -- 172.21.15.55:0/3598471413 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067097203 0 0) 0x7f04780cc740 con 0x7f04780d0630 2023-07-06T22:02:06.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.511+0000 7f0477fff640 1 --2- 172.21.15.55:0/3598471413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04780b1250 0x7f047815f380 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f04680097c0 tx=0x7f046801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a17c27c53645a51 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:06.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.511+0000 7f0476ffd640 1 -- 172.21.15.55:0/3598471413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04680ab600 con 0x7f04780b1250 2023-07-06T22:02:06.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.511+0000 7f0476ffd640 1 -- 172.21.15.55:0/3598471413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04680a7050 con 0x7f04780b1250 2023-07-06T22:02:06.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.511+0000 7f0476ffd640 1 -- 172.21.15.55:0/3598471413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04680ab980 con 0x7f04780b1250 2023-07-06T22:02:06.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.511+0000 7f047d6af640 1 -- 172.21.15.55:0/3598471413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04780b1250 msgr2=0x7f047815f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:06.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.511+0000 7f047d6af640 1 --2- 172.21.15.55:0/3598471413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04780b1250 0x7f047815f380 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f04680097c0 tx=0x7f046801c410 comp rx=0 tx=0).stop 2023-07-06T22:02:06.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.511+0000 7f047d6af640 1 -- 172.21.15.55:0/3598471413 shutdown_connections 2023-07-06T22:02:06.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.511+0000 7f047d6af640 1 --2- 172.21.15.55:0/3598471413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04780b1250 0x7f047815f380 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.511+0000 7f047d6af640 1 -- 172.21.15.55:0/3598471413 >> 172.21.15.55:0/3598471413 conn(0x7f04780b3b60 msgr2=0x7f04780b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:06.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.511+0000 7f047d6af640 1 -- 172.21.15.55:0/3598471413 shutdown_connections 2023-07-06T22:02:06.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.511+0000 7f047d6af640 1 -- 172.21.15.55:0/3598471413 wait complete. 2023-07-06T22:02:06.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.511+0000 7f047d6af640 1 Processor -- start 2023-07-06T22:02:06.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.511+0000 7f047d6af640 1 -- start start 2023-07-06T22:02:06.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f047d6af640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04780b1250 0x7f04781f9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:06.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f047d6af640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04780ce200 0x7f04781f8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:06.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f047d6af640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04780d0630 0x7f047815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:06.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f047d6af640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047815b140 con 0x7f04780ce200 2023-07-06T22:02:06.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f047d6af640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047815b390 con 0x7f04780b1250 2023-07-06T22:02:06.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f047d6af640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047815b670 con 0x7f04780d0630 2023-07-06T22:02:06.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f04777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04780ce200 0x7f04781f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:06.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f04777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04780ce200 0x7f04781f8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51678/0 (socket says 172.21.15.55:51678) 2023-07-06T22:02:06.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f04777fe640 1 -- 172.21.15.55:0/2925340048 learned_addr learned my addr 172.21.15.55:0/2925340048 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:06.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f047ceae640 1 --2- 172.21.15.55:0/2925340048 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04780d0630 0x7f047815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:06.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f0477fff640 1 --2- 172.21.15.55:0/2925340048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04780b1250 0x7f04781f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:06.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f04777fe640 1 -- 172.21.15.55:0/2925340048 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04780d0630 msgr2=0x7f047815d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:06.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f04777fe640 1 --2- 172.21.15.55:0/2925340048 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04780d0630 0x7f047815d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f04777fe640 1 -- 172.21.15.55:0/2925340048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04780b1250 msgr2=0x7f04781f9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:06.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f04777fe640 1 --2- 172.21.15.55:0/2925340048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04780b1250 0x7f04781f9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:06.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f04777fe640 1 -- 172.21.15.55:0/2925340048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0468009420 con 0x7f04780ce200 2023-07-06T22:02:06.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f04777fe640 1 --2- 172.21.15.55:0/2925340048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04780ce200 0x7f04781f8630 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f046c0011f0 tx=0x7f046c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:06.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f0474ff9640 1 -- 172.21.15.55:0/2925340048 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c0074e0 con 0x7f04780ce200 2023-07-06T22:02:06.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f0474ff9640 1 -- 172.21.15.55:0/2925340048 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c007640 con 0x7f04780ce200 2023-07-06T22:02:06.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f047d6af640 1 -- 172.21.15.55:0/2925340048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047815b950 con 0x7f04780ce200 2023-07-06T22:02:06.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f0474ff9640 1 -- 172.21.15.55:0/2925340048 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c004a10 con 0x7f04780ce200 2023-07-06T22:02:06.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f047d6af640 1 -- 172.21.15.55:0/2925340048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04781f9560 con 0x7f04780ce200 2023-07-06T22:02:06.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f047d6af640 1 -- 172.21.15.55:0/2925340048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047804d790 con 0x7f04780ce200 2023-07-06T22:02:06.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.515+0000 7f0474ff9640 1 -- 172.21.15.55:0/2925340048 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f046c004b70 con 0x7f04780ce200 2023-07-06T22:02:06.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.519+0000 7f0474ff9640 1 --2- 172.21.15.55:0/2925340048 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f04640663a0 0x7f0464068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:06.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.519+0000 7f0474ff9640 1 -- 172.21.15.55:0/2925340048 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f046c083410 con 0x7f04780ce200 2023-07-06T22:02:06.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.519+0000 7f0477fff640 1 --2- 172.21.15.55:0/2925340048 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f04640663a0 0x7f0464068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:06.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.519+0000 7f0477fff640 1 --2- 172.21.15.55:0/2925340048 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f04640663a0 0x7f0464068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f04680ad000 tx=0x7f04680a4f90 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:06.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.523+0000 7f0474ff9640 1 -- 172.21.15.55:0/2925340048 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f046c050760 con 0x7f04780ce200 2023-07-06T22:02:06.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:06.687+0000 7f047d6af640 1 -- 172.21.15.55:0/2925340048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f04780b7f00 con 0x7f04780ce200 2023-07-06T22:02:07.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.479+0000 7f0474ff9640 1 -- 172.21.15.55:0/2925340048 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v156) v1 ==== 97+0+0 (secure 0 0 0) 0x7f046c053d80 con 0x7f04780ce200 2023-07-06T22:02:07.479 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-07-06T22:02:07.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.483+0000 7f047d6af640 1 -- 172.21.15.55:0/2925340048 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f04640663a0 msgr2=0x7f0464068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:07.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.483+0000 7f047d6af640 1 --2- 172.21.15.55:0/2925340048 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f04640663a0 0x7f0464068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f04680ad000 tx=0x7f04680a4f90 comp rx=0 tx=0).stop 2023-07-06T22:02:07.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.483+0000 7f047d6af640 1 -- 172.21.15.55:0/2925340048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04780ce200 msgr2=0x7f04781f8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:07.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.483+0000 7f047d6af640 1 --2- 172.21.15.55:0/2925340048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04780ce200 0x7f04781f8630 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f046c0011f0 tx=0x7f046c00c9b0 comp rx=0 tx=0).stop 2023-07-06T22:02:07.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.483+0000 7f047d6af640 1 -- 172.21.15.55:0/2925340048 shutdown_connections 2023-07-06T22:02:07.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.483+0000 7f047d6af640 1 --2- 172.21.15.55:0/2925340048 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04780d0630 0x7f047815d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:07.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.483+0000 7f047d6af640 1 --2- 172.21.15.55:0/2925340048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04780ce200 0x7f04781f8630 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:07.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.483+0000 7f047d6af640 1 --2- 172.21.15.55:0/2925340048 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f04640663a0 0x7f0464068850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:07.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.483+0000 7f047d6af640 1 --2- 172.21.15.55:0/2925340048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04780b1250 0x7f04781f9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:07.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.483+0000 7f047d6af640 1 -- 172.21.15.55:0/2925340048 >> 172.21.15.55:0/2925340048 conn(0x7f04780b3b60 msgr2=0x7f04780b4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:07.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.483+0000 7f047d6af640 1 -- 172.21.15.55:0/2925340048 shutdown_connections 2023-07-06T22:02:07.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.483+0000 7f047d6af640 1 -- 172.21.15.55:0/2925340048 wait complete. 2023-07-06T22:02:07.506 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-06T22:02:07.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.655+0000 7f36f2248640 1 Processor -- start 2023-07-06T22:02:07.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.659+0000 7f36f2248640 1 -- start start 2023-07-06T22:02:07.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.659+0000 7f36f2248640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36ec0712f0 0x7f36ec06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:07.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.659+0000 7f36f2248640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ec159cd0 con 0x7f36ec0ca450 2023-07-06T22:02:07.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.659+0000 7f36f2248640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ec0693f0 con 0x7f36ec0b3730 2023-07-06T22:02:07.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.659+0000 7f36f2248640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec06aca0 con 0x7f36ec0712f0 2023-07-06T22:02:07.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.659+0000 7f36ebfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f36ec0ca450 0x7f36ec15d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58766/0 (socket says 172.21.15.55:58766) 2023-07-06T22:02:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.659+0000 7f36ebfff640 1 -- 172.21.15.55:0/434246278 learned_addr learned my addr 172.21.15.55:0/434246278 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.659+0000 7f36eb7fe640 1 --2- 172.21.15.55:0/434246278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36ec0712f0 0x7f36ec06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.659+0000 7f36ea7fc640 1 -- 172.21.15.55:0/434246278 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117146674 0 0) 0x7f36ec159cd0 con 0x7f36ec0ca450 2023-07-06T22:02:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.659+0000 7f36ea7fc640 1 -- 172.21.15.55:0/434246278 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36d4003530 con 0x7f36ec0ca450 2023-07-06T22:02:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.659+0000 7f36ea7fc640 1 -- 172.21.15.55:0/434246278 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919053148 0 0) 0x7f36ec0693f0 con 0x7f36ec0b3730 2023-07-06T22:02:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.659+0000 7f36eb7fe640 1 -- 172.21.15.55:0/434246278 >> v1:172.21.15.138:6789/0 conn(0x7f36ec0b3730 legacy=0x7f36ec0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:07.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.659+0000 7f36eb7fe640 1 -- 172.21.15.55:0/434246278 >> v1:172.21.15.55:6789/0 conn(0x7f36ec0ca450 legacy=0x7f36ec15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:07.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.659+0000 7f36eb7fe640 1 -- 172.21.15.55:0/434246278 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec0696b0 con 0x7f36ec0712f0 2023-07-06T22:02:07.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.663+0000 7f36eb7fe640 1 --2- 172.21.15.55:0/434246278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36ec0712f0 0x7f36ec06a610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0097f0 tx=0x7f36dc01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c885f2a081e3a212 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:07.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.663+0000 7f36ea7fc640 1 -- 172.21.15.55:0/434246278 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc0aa5f0 con 0x7f36ec0712f0 2023-07-06T22:02:07.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.663+0000 7f36ea7fc640 1 -- 172.21.15.55:0/434246278 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc0aa750 con 0x7f36ec0712f0 2023-07-06T22:02:07.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.663+0000 7f36ea7fc640 1 -- 172.21.15.55:0/434246278 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc0aaae0 con 0x7f36ec0712f0 2023-07-06T22:02:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.663+0000 7f36f2248640 1 -- 172.21.15.55:0/434246278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36ec0712f0 msgr2=0x7f36ec06a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.663+0000 7f36f2248640 1 --2- 172.21.15.55:0/434246278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36ec0712f0 0x7f36ec06a610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0097f0 tx=0x7f36dc01c490 comp rx=0 tx=0).stop 2023-07-06T22:02:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.663+0000 7f36f2248640 1 -- 172.21.15.55:0/434246278 shutdown_connections 2023-07-06T22:02:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.663+0000 7f36f2248640 1 --2- 172.21.15.55:0/434246278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36ec0712f0 0x7f36ec06a610 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.663+0000 7f36f2248640 1 -- 172.21.15.55:0/434246278 >> 172.21.15.55:0/434246278 conn(0x7f36ec0cded0 msgr2=0x7f36ec0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.663+0000 7f36f2248640 1 -- 172.21.15.55:0/434246278 shutdown_connections 2023-07-06T22:02:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.663+0000 7f36f2248640 1 -- 172.21.15.55:0/434246278 wait complete. 2023-07-06T22:02:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36f2248640 1 Processor -- start 2023-07-06T22:02:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36f2248640 1 -- start start 2023-07-06T22:02:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36f2248640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36ec0712f0 0x7f36ec151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36f2248640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36ec0b3730 0x7f36ec0af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36f2248640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36ec0ca450 0x7f36ec0b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36f2248640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0af660 con 0x7f36ec0b3730 2023-07-06T22:02:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36f2248640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec14dd90 con 0x7f36ec0712f0 2023-07-06T22:02:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36f2248640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec14d7d0 con 0x7f36ec0ca450 2023-07-06T22:02:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36eaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36ec0b3730 0x7f36ec0af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:07.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36eaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36ec0b3730 0x7f36ec0af120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51692/0 (socket says 172.21.15.55:51692) 2023-07-06T22:02:07.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36eaffd640 1 -- 172.21.15.55:0/2098767511 learned_addr learned my addr 172.21.15.55:0/2098767511 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:07.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36eb7fe640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36ec0712f0 0x7f36ec151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:07.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36ebfff640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36ec0ca450 0x7f36ec0b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:07.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36eaffd640 1 -- 172.21.15.55:0/2098767511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36ec0ca450 msgr2=0x7f36ec0b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:07.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36eaffd640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36ec0ca450 0x7f36ec0b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:07.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36eaffd640 1 -- 172.21.15.55:0/2098767511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36ec0712f0 msgr2=0x7f36ec151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36eaffd640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36ec0712f0 0x7f36ec151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36eaffd640 1 -- 172.21.15.55:0/2098767511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc009420 con 0x7f36ec0b3730 2023-07-06T22:02:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36ebfff640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36ec0ca450 0x7f36ec0b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36eaffd640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36ec0b3730 0x7f36ec0af120 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f36e0001ec0 tx=0x7f36e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36d3fff640 1 -- 172.21.15.55:0/2098767511 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e00054e0 con 0x7f36ec0b3730 2023-07-06T22:02:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36d3fff640 1 -- 172.21.15.55:0/2098767511 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e0003600 con 0x7f36ec0b3730 2023-07-06T22:02:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36d3fff640 1 -- 172.21.15.55:0/2098767511 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e00039b0 con 0x7f36ec0b3730 2023-07-06T22:02:07.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36f2248640 1 -- 172.21.15.55:0/2098767511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ec14dab0 con 0x7f36ec0b3730 2023-07-06T22:02:07.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36f2248640 1 -- 172.21.15.55:0/2098767511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ec15b430 con 0x7f36ec0b3730 2023-07-06T22:02:07.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.667+0000 7f36f2248640 1 -- 172.21.15.55:0/2098767511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ec15afb0 con 0x7f36ec0b3730 2023-07-06T22:02:07.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.671+0000 7f36d3fff640 1 -- 172.21.15.55:0/2098767511 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f36e0003b10 con 0x7f36ec0b3730 2023-07-06T22:02:07.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.671+0000 7f36d3fff640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f36d80663d0 0x7f36d8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:07.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.671+0000 7f36d3fff640 1 -- 172.21.15.55:0/2098767511 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f36e00831b0 con 0x7f36ec0b3730 2023-07-06T22:02:07.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.671+0000 7f36eb7fe640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f36d80663d0 0x7f36d8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:07.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.671+0000 7f36eb7fe640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f36d80663d0 0x7f36d8068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0ae000 tx=0x7f36dc0a7000 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:07.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.675+0000 7f36d3fff640 1 -- 172.21.15.55:0/2098767511 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36ec15afb0 con 0x7f36ec0b3730 2023-07-06T22:02:07.758 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:02:07.761 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:02:07.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.883+0000 7f36f2248640 1 -- 172.21.15.55:0/2098767511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f36ec15afb0 con 0x7f36ec0b3730 2023-07-06T22:02:07.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.883+0000 7f36d3fff640 1 -- 172.21.15.55:0/2098767511 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f36ec15afb0 con 0x7f36ec0b3730 2023-07-06T22:02:07.882 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:07.882 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:02:07.882 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-07-06T22:02:07.882 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.882 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-07-06T22:02:07.882 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkWjb1JxAAMmLy+dPO5qyorBnuzazx6A==", 2023-07-06T22:02:07.882 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.883 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:02:07.883 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:02:07.883 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:02:07.883 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.883 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.883 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.883 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.884 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-07-06T22:02:07.884 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkpLLENBAAxMASh3qbELQMJ3XbPEX0Zw==", 2023-07-06T22:02:07.884 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.884 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:02:07.884 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:02:07.884 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:02:07.885 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.885 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.885 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.885 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.885 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-07-06T22:02:07.885 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkvOSfLxAAMEoqAPg1pb47e5a1G1QtAw==", 2023-07-06T22:02:07.885 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.886 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:02:07.886 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:02:07.886 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:02:07.886 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.886 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.886 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.886 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.886 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-07-06T22:02:07.887 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkeQIBARAApXT5zWLUqqMSdwYygZeatw==", 2023-07-06T22:02:07.887 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.887 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:02:07.887 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:02:07.887 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:02:07.887 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.887 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.888 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.888 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.888 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-07-06T22:02:07.888 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD5NKdkSIfzJxAAlXiG8PWFXQqIeugbdp7Eiw==", 2023-07-06T22:02:07.888 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.888 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:02:07.888 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:02:07.889 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.889 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.889 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.889 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.889 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-07-06T22:02:07.889 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD8NKdkv2iwLxAAxjFucMwaaH66wPQpoYSTGw==", 2023-07-06T22:02:07.889 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.890 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:02:07.890 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:02:07.890 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.890 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.890 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.890 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.890 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-07-06T22:02:07.891 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD/NKdk5w7XOBAAuiup4mcC02ZMCPHCU1Cl3A==", 2023-07-06T22:02:07.891 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.891 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:02:07.891 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:02:07.891 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.891 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.891 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.892 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.892 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-07-06T22:02:07.892 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQADNadksvRLBBAAE1YX9VgA8pWARIEZL8tbsQ==", 2023-07-06T22:02:07.892 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.892 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:02:07.892 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:02:07.892 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.893 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.893 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.893 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.893 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-07-06T22:02:07.893 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAJNadkn2HsChAAgwb7B9lHOMq2h0BNuhB/AQ==", 2023-07-06T22:02:07.893 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.893 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:02:07.894 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:02:07.894 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.894 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.894 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.894 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.894 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-07-06T22:02:07.894 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMNadkbonPERAA2PLg4NMr+4eW+FDAfPig1A==", 2023-07-06T22:02:07.895 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.895 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:02:07.895 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:02:07.895 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.895 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.895 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.895 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.896 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-07-06T22:02:07.896 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAPNadkQw76GBAAY9SIgsTUHqvThwjdpjuwpw==", 2023-07-06T22:02:07.896 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.896 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:02:07.896 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:02:07.896 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.896 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.897 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.897 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.897 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-07-06T22:02:07.897 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQASNadkr3gRHxAALbPUtIgImIK1UUoe6vcyjg==", 2023-07-06T22:02:07.897 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.897 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:02:07.897 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:02:07.898 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.898 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.898 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.898 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.898 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-07-06T22:02:07.898 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkaZgiBRAAvyBUd+qHLh/wwhgoE1MsVA==", 2023-07-06T22:02:07.898 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.899 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:02:07.899 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-07-06T22:02:07.899 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-06T22:02:07.899 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.899 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.899 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.899 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-07-06T22:02:07.899 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkOBqoDBAASIhzvCqkSAFLX2oc99MYqw==", 2023-07-06T22:02:07.900 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.900 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:02:07.900 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:02:07.900 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:02:07.900 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:02:07.900 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.900 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.901 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.901 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-07-06T22:02:07.901 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkgt/fCBAAlQY94DrR/nFTIVwSFCEToQ==", 2023-07-06T22:02:07.901 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.901 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:02:07.901 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:02:07.901 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:02:07.902 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:02:07.902 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.902 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.902 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.902 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-07-06T22:02:07.902 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkd5zAEhAAU0Qo6NROIKRSlOncFUoTxQ==", 2023-07-06T22:02:07.902 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.903 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:02:07.903 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:02:07.903 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:02:07.903 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:02:07.903 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.903 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.903 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.904 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-07-06T22:02:07.904 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkjvG8ChAA5rpuV6+YETQS9UjMRUynxA==", 2023-07-06T22:02:07.904 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.904 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:02:07.904 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:02:07.904 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:02:07.904 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.905 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.905 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.905 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.905 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-07-06T22:02:07.905 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdk+RUVIxAAyQpmGAeL8K+Cy+fgK5BmCQ==", 2023-07-06T22:02:07.905 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.905 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:02:07.906 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T22:02:07.906 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.906 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.906 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:07.906 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:07.906 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-07-06T22:02:07.906 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkLH8aHxAAzzX5YxumCYWYqo0rQfFA9g==", 2023-07-06T22:02:07.907 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:02:07.907 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:02:07.907 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T22:02:07.907 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:02:07.907 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.907 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:07.907 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-07-06T22:02:07.907 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:02:07.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.883+0000 7f36f2248640 1 -- 172.21.15.55:0/2098767511 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f36d80663d0 msgr2=0x7f36d8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:07.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.883+0000 7f36f2248640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f36d80663d0 0x7f36d8068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0ae000 tx=0x7f36dc0a7000 comp rx=0 tx=0).stop 2023-07-06T22:02:07.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.883+0000 7f36f2248640 1 -- 172.21.15.55:0/2098767511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36ec0b3730 msgr2=0x7f36ec0af120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:07.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.883+0000 7f36f2248640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36ec0b3730 0x7f36ec0af120 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f36e0001ec0 tx=0x7f36e000c8e0 comp rx=0 tx=0).stop 2023-07-06T22:02:07.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.883+0000 7f36f2248640 1 -- 172.21.15.55:0/2098767511 shutdown_connections 2023-07-06T22:02:07.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.883+0000 7f36f2248640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f36ec0ca450 0x7f36ec0b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:07.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.883+0000 7f36f2248640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36ec0b3730 0x7f36ec0af120 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:07.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.883+0000 7f36f2248640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f36d80663d0 0x7f36d8068880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:07.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.883+0000 7f36f2248640 1 --2- 172.21.15.55:0/2098767511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36ec0712f0 0x7f36ec151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:07.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.883+0000 7f36f2248640 1 -- 172.21.15.55:0/2098767511 >> 172.21.15.55:0/2098767511 conn(0x7f36ec0cded0 msgr2=0x7f36ec15d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:07.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.883+0000 7f36f2248640 1 -- 172.21.15.55:0/2098767511 shutdown_connections 2023-07-06T22:02:07.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:07.883+0000 7f36f2248640 1 -- 172.21.15.55:0/2098767511 wait complete. 2023-07-06T22:02:07.911 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:02:08.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d87fa3640 1 Processor -- start 2023-07-06T22:02:08.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d87fa3640 1 -- start start 2023-07-06T22:02:08.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d87fa3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d8006f2e0 0x7f4d800cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d87fa3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4d800cf9c0 0x7f4d800ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d87fa3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d800cfe40 con 0x7f4d8015bc30 2023-07-06T22:02:08.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d87fa3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d800cc800 con 0x7f4d8006f2e0 2023-07-06T22:02:08.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d87fa3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8015f750 con 0x7f4d800cf9c0 2023-07-06T22:02:08.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d85d3f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4d8015bc30 0x7f4d8006ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58782/0 (socket says 172.21.15.55:58782) 2023-07-06T22:02:08.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d85d3f640 1 -- 172.21.15.55:0/763548558 learned_addr learned my addr 172.21.15.55:0/763548558 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:08.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d8553e640 1 --2- 172.21.15.55:0/763548558 >> v2:172.21.15.55:3300/0 conn(0x7f4d8006f2e0 0x7f4d800cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d84d3d640 1 -- 172.21.15.55:0/763548558 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923629977 0 0) 0x7f4d800cfe40 con 0x7f4d8015bc30 2023-07-06T22:02:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d84d3d640 1 -- 172.21.15.55:0/763548558 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d6c003530 con 0x7f4d8015bc30 2023-07-06T22:02:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d86540640 1 --2- 172.21.15.55:0/763548558 >> v2:172.21.15.138:3300/0 conn(0x7f4d800cf9c0 0x7f4d800ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d8553e640 1 -- 172.21.15.55:0/763548558 >> v2:172.21.15.138:3300/0 conn(0x7f4d800cf9c0 msgr2=0x7f4d800ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:08.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d8553e640 1 --2- 172.21.15.55:0/763548558 >> v2:172.21.15.138:3300/0 conn(0x7f4d800cf9c0 0x7f4d800ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d8553e640 1 -- 172.21.15.55:0/763548558 >> v1:172.21.15.55:6789/0 conn(0x7f4d8015bc30 legacy=0x7f4d8006ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d8553e640 1 -- 172.21.15.55:0/763548558 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8015fa30 con 0x7f4d8006f2e0 2023-07-06T22:02:08.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.055+0000 7f4d86540640 1 --2- 172.21.15.55:0/763548558 >> v2:172.21.15.138:3300/0 conn(0x7f4d800cf9c0 0x7f4d800ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:08.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.059+0000 7f4d8553e640 1 --2- 172.21.15.55:0/763548558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d8006f2e0 0x7f4d800cf480 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f4d801606b0 tx=0x7f4d7001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b49470782be6be server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:08.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.059+0000 7f4d84d3d640 1 -- 172.21.15.55:0/763548558 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d700a7070 con 0x7f4d8006f2e0 2023-07-06T22:02:08.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.059+0000 7f4d84d3d640 1 -- 172.21.15.55:0/763548558 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d700ab430 con 0x7f4d8006f2e0 2023-07-06T22:02:08.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.059+0000 7f4d84d3d640 1 -- 172.21.15.55:0/763548558 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d700ab7c0 con 0x7f4d8006f2e0 2023-07-06T22:02:08.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.059+0000 7f4d87fa3640 1 -- 172.21.15.55:0/763548558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d8006f2e0 msgr2=0x7f4d800cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.059+0000 7f4d87fa3640 1 --2- 172.21.15.55:0/763548558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d8006f2e0 0x7f4d800cf480 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f4d801606b0 tx=0x7f4d7001c430 comp rx=0 tx=0).stop 2023-07-06T22:02:08.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.059+0000 7f4d87fa3640 1 -- 172.21.15.55:0/763548558 shutdown_connections 2023-07-06T22:02:08.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.059+0000 7f4d87fa3640 1 --2- 172.21.15.55:0/763548558 >> v2:172.21.15.138:3300/0 conn(0x7f4d800cf9c0 0x7f4d800ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.059+0000 7f4d87fa3640 1 --2- 172.21.15.55:0/763548558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d8006f2e0 0x7f4d800cf480 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.059+0000 7f4d87fa3640 1 -- 172.21.15.55:0/763548558 >> 172.21.15.55:0/763548558 conn(0x7f4d800b2840 msgr2=0x7f4d800d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:08.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.059+0000 7f4d87fa3640 1 -- 172.21.15.55:0/763548558 shutdown_connections 2023-07-06T22:02:08.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.059+0000 7f4d87fa3640 1 -- 172.21.15.55:0/763548558 wait complete. 2023-07-06T22:02:08.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d87fa3640 1 Processor -- start 2023-07-06T22:02:08.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d87fa3640 1 -- start start 2023-07-06T22:02:08.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d87fa3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d8006f2e0 0x7f4d80159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d87fa3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d800cf9c0 0x7f4d8013cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d87fa3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d8015bc30 0x7f4d80151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d87fa3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8015a520 con 0x7f4d8015bc30 2023-07-06T22:02:08.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d87fa3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8015a800 con 0x7f4d800cf9c0 2023-07-06T22:02:08.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d87fa3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8015aae0 con 0x7f4d8006f2e0 2023-07-06T22:02:08.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d86540640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d8015bc30 0x7f4d80151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d86540640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d8015bc30 0x7f4d80151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51708/0 (socket says 172.21.15.55:51708) 2023-07-06T22:02:08.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d86540640 1 -- 172.21.15.55:0/1338075156 learned_addr learned my addr 172.21.15.55:0/1338075156 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:08.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d8553e640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d800cf9c0 0x7f4d8013cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d85d3f640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d8006f2e0 0x7f4d80159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d86540640 1 -- 172.21.15.55:0/1338075156 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d8006f2e0 msgr2=0x7f4d80159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d86540640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d8006f2e0 0x7f4d80159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d86540640 1 -- 172.21.15.55:0/1338075156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d800cf9c0 msgr2=0x7f4d8013cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d86540640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d800cf9c0 0x7f4d8013cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d86540640 1 -- 172.21.15.55:0/1338075156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d70009420 con 0x7f4d8015bc30 2023-07-06T22:02:08.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d85d3f640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d8006f2e0 0x7f4d80159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:08.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d86540640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d8015bc30 0x7f4d80151340 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800cef0 tx=0x7f4d7800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:08.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d767fc640 1 -- 172.21.15.55:0/1338075156 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800d840 con 0x7f4d8015bc30 2023-07-06T22:02:08.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d767fc640 1 -- 172.21.15.55:0/1338075156 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7800d9c0 con 0x7f4d8015bc30 2023-07-06T22:02:08.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d767fc640 1 -- 172.21.15.55:0/1338075156 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800dd70 con 0x7f4d8015bc30 2023-07-06T22:02:08.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d87fa3640 1 -- 172.21.15.55:0/1338075156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8015adc0 con 0x7f4d8015bc30 2023-07-06T22:02:08.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.063+0000 7f4d87fa3640 1 -- 172.21.15.55:0/1338075156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8015a160 con 0x7f4d8015bc30 2023-07-06T22:02:08.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.067+0000 7f4d87fa3640 1 -- 172.21.15.55:0/1338075156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d80066d60 con 0x7f4d8015bc30 2023-07-06T22:02:08.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.067+0000 7f4d767fc640 1 -- 172.21.15.55:0/1338075156 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4d7801e3b0 con 0x7f4d8015bc30 2023-07-06T22:02:08.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.067+0000 7f4d767fc640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f4d640663a0 0x7f4d64068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.067+0000 7f4d767fc640 1 -- 172.21.15.55:0/1338075156 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f4d780847d0 con 0x7f4d8015bc30 2023-07-06T22:02:08.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.067+0000 7f4d85d3f640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f4d640663a0 0x7f4d64068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.067+0000 7f4d85d3f640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f4d640663a0 0x7f4d64068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0011f0 tx=0x7f4d7c009040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.071+0000 7f4d767fc640 1 -- 172.21.15.55:0/1338075156 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4d78051d50 con 0x7f4d8015bc30 2023-07-06T22:02:08.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.227+0000 7f4d87fa3640 1 -- 172.21.15.55:0/1338075156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d800d0f40 con 0x7f4d8015bc30 2023-07-06T22:02:08.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.227+0000 7f4d767fc640 1 -- 172.21.15.55:0/1338075156 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+14886 (secure 0 0 0) 0x7f4d78055370 con 0x7f4d8015bc30 2023-07-06T22:02:08.227 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:08.227 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":156,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:02:07.474002+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:02:08.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.231+0000 7f4d87fa3640 1 -- 172.21.15.55:0/1338075156 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f4d640663a0 msgr2=0x7f4d64068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.231+0000 7f4d87fa3640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f4d640663a0 0x7f4d64068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0011f0 tx=0x7f4d7c009040 comp rx=0 tx=0).stop 2023-07-06T22:02:08.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.231+0000 7f4d87fa3640 1 -- 172.21.15.55:0/1338075156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d8015bc30 msgr2=0x7f4d80151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.231+0000 7f4d87fa3640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d8015bc30 0x7f4d80151340 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800cef0 tx=0x7f4d7800a710 comp rx=0 tx=0).stop 2023-07-06T22:02:08.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.231+0000 7f4d87fa3640 1 -- 172.21.15.55:0/1338075156 shutdown_connections 2023-07-06T22:02:08.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.231+0000 7f4d87fa3640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d8015bc30 0x7f4d80151340 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.231+0000 7f4d87fa3640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f4d640663a0 0x7f4d64068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.231+0000 7f4d87fa3640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d800cf9c0 0x7f4d8013cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.231+0000 7f4d87fa3640 1 --2- 172.21.15.55:0/1338075156 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d8006f2e0 0x7f4d80159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.231+0000 7f4d87fa3640 1 -- 172.21.15.55:0/1338075156 >> 172.21.15.55:0/1338075156 conn(0x7f4d800b2840 msgr2=0x7f4d800b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:08.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.231+0000 7f4d87fa3640 1 -- 172.21.15.55:0/1338075156 shutdown_connections 2023-07-06T22:02:08.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.231+0000 7f4d87fa3640 1 -- 172.21.15.55:0/1338075156 wait complete. 2023-07-06T22:02:08.248 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:02:08.249 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:02:08.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.395+0000 7fcedf974640 1 Processor -- start 2023-07-06T22:02:08.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.399+0000 7fcedf974640 1 -- start start 2023-07-06T22:02:08.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.399+0000 7fcedf974640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fced80709a0 0x7fced80cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.399+0000 7fcedf974640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fced80cbe60 0x7fced80b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.399+0000 7fcedf974640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced80cc300 con 0x7fced8070d70 2023-07-06T22:02:08.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.399+0000 7fcedf974640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced80cc5e0 con 0x7fced80709a0 2023-07-06T22:02:08.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.399+0000 7fcedf974640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced80cc8c0 con 0x7fced80cbe60 2023-07-06T22:02:08.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.399+0000 7fcedd710640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fced80709a0 0x7fced80cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.399+0000 7fcedd710640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fced80709a0 0x7fced80cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51720/0 (socket says 172.21.15.55:51720) 2023-07-06T22:02:08.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.399+0000 7fcedd710640 1 -- 172.21.15.55:0/1304397034 learned_addr learned my addr 172.21.15.55:0/1304397034 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:08.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.399+0000 7fcedd710640 1 -- 172.21.15.55:0/1304397034 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fced80cbe60 msgr2=0x7fced80b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:08.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.399+0000 7fcedd710640 1 --2- 172.21.15.55:0/1304397034 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fced80cbe60 0x7fced80b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.399+0000 7fcedd710640 1 -- 172.21.15.55:0/1304397034 >> v1:172.21.15.138:6789/0 conn(0x7fced8070d70 legacy=0x7fced815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:08.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.399+0000 7fcedd710640 1 -- 172.21.15.55:0/1304397034 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced80ccba0 con 0x7fced80709a0 2023-07-06T22:02:08.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.403+0000 7fcedd710640 1 --2- 172.21.15.55:0/1304397034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80709a0 0x7fced80cb920 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fced4009870 tx=0x7fced401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67162c322530d49 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:08.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.403+0000 7fcecffff640 1 -- 172.21.15.55:0/1304397034 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced40ab600 con 0x7fced80709a0 2023-07-06T22:02:08.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.403+0000 7fcecffff640 1 -- 172.21.15.55:0/1304397034 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced40a7050 con 0x7fced80709a0 2023-07-06T22:02:08.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.403+0000 7fcecffff640 1 -- 172.21.15.55:0/1304397034 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced40ab980 con 0x7fced80709a0 2023-07-06T22:02:08.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.403+0000 7fcedf974640 1 -- 172.21.15.55:0/1304397034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80709a0 msgr2=0x7fced80cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.403+0000 7fcedf974640 1 --2- 172.21.15.55:0/1304397034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80709a0 0x7fced80cb920 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fced4009870 tx=0x7fced401c500 comp rx=0 tx=0).stop 2023-07-06T22:02:08.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.403+0000 7fcedf974640 1 -- 172.21.15.55:0/1304397034 shutdown_connections 2023-07-06T22:02:08.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.403+0000 7fcedf974640 1 --2- 172.21.15.55:0/1304397034 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fced80cbe60 0x7fced80b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.403+0000 7fcedf974640 1 --2- 172.21.15.55:0/1304397034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced80709a0 0x7fced80cb920 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.403+0000 7fcedf974640 1 -- 172.21.15.55:0/1304397034 >> 172.21.15.55:0/1304397034 conn(0x7fced80cea70 msgr2=0x7fced80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:08.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.403+0000 7fcedf974640 1 -- 172.21.15.55:0/1304397034 shutdown_connections 2023-07-06T22:02:08.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.403+0000 7fcedf974640 1 -- 172.21.15.55:0/1304397034 wait complete. 2023-07-06T22:02:08.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.403+0000 7fcedf974640 1 Processor -- start 2023-07-06T22:02:08.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.403+0000 7fcedf974640 1 -- start start 2023-07-06T22:02:08.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedf974640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fced80709a0 0x7fced815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedf974640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced8070d70 0x7fced8151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedf974640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fced80cbe60 0x7fced81520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedf974640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced80c8db0 con 0x7fced8070d70 2023-07-06T22:02:08.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedf974640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced8153e60 con 0x7fced80709a0 2023-07-06T22:02:08.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedf974640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced81525e0 con 0x7fced80cbe60 2023-07-06T22:02:08.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedcf0f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced8070d70 0x7fced8151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedcf0f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced8070d70 0x7fced8151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51730/0 (socket says 172.21.15.55:51730) 2023-07-06T22:02:08.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedcf0f640 1 -- 172.21.15.55:0/3365839608 learned_addr learned my addr 172.21.15.55:0/3365839608 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:08.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedd710640 1 --2- 172.21.15.55:0/3365839608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fced80709a0 0x7fced815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fceddf11640 1 --2- 172.21.15.55:0/3365839608 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fced80cbe60 0x7fced81520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedcf0f640 1 -- 172.21.15.55:0/3365839608 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fced80cbe60 msgr2=0x7fced81520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedcf0f640 1 --2- 172.21.15.55:0/3365839608 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fced80cbe60 0x7fced81520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedcf0f640 1 -- 172.21.15.55:0/3365839608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fced80709a0 msgr2=0x7fced815c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedcf0f640 1 --2- 172.21.15.55:0/3365839608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fced80709a0 0x7fced815c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedcf0f640 1 -- 172.21.15.55:0/3365839608 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced40094d0 con 0x7fced8070d70 2023-07-06T22:02:08.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedcf0f640 1 --2- 172.21.15.55:0/3365839608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced8070d70 0x7fced8151b60 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fcec800b420 tx=0x7fcec800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:08.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcecdffb640 1 -- 172.21.15.55:0/3365839608 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8011830 con 0x7fced8070d70 2023-07-06T22:02:08.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcecdffb640 1 -- 172.21.15.55:0/3365839608 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec8011990 con 0x7fced8070d70 2023-07-06T22:02:08.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcecdffb640 1 -- 172.21.15.55:0/3365839608 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8011d40 con 0x7fced8070d70 2023-07-06T22:02:08.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedf974640 1 -- 172.21.15.55:0/3365839608 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced809e6b0 con 0x7fced8070d70 2023-07-06T22:02:08.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedf974640 1 -- 172.21.15.55:0/3365839608 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced8154390 con 0x7fced8070d70 2023-07-06T22:02:08.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcedf974640 1 -- 172.21.15.55:0/3365839608 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced80c8f20 con 0x7fced8070d70 2023-07-06T22:02:08.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.407+0000 7fcecdffb640 1 -- 172.21.15.55:0/3365839608 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcec801b460 con 0x7fced8070d70 2023-07-06T22:02:08.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.411+0000 7fcecdffb640 1 --2- 172.21.15.55:0/3365839608 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fcebc0663a0 0x7fcebc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.411+0000 7fcecdffb640 1 -- 172.21.15.55:0/3365839608 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5558+0+0 (secure 0 0 0) 0x7fcec80838b0 con 0x7fced8070d70 2023-07-06T22:02:08.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.411+0000 7fcedd710640 1 --2- 172.21.15.55:0/3365839608 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fcebc0663a0 0x7fcebc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.411+0000 7fcedd710640 1 --2- 172.21.15.55:0/3365839608 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fcebc0663a0 0x7fcebc068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fced40ad000 tx=0x7fced40a6000 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:08.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.415+0000 7fcecdffb640 1 -- 172.21.15.55:0/3365839608 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fced80c8f20 con 0x7fced8070d70 2023-07-06T22:02:08.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.571+0000 7fcedf974640 1 -- 172.21.15.55:0/3365839608 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fced80c8ef0 con 0x7fced8070d70 2023-07-06T22:02:08.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.571+0000 7fcecdffb640 1 -- 172.21.15.55:0/3365839608 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v156) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcec8050eb0 con 0x7fced8070d70 2023-07-06T22:02:08.570 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:02:08.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.571+0000 7fcedf974640 1 -- 172.21.15.55:0/3365839608 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fcebc0663a0 msgr2=0x7fcebc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.571+0000 7fcedf974640 1 --2- 172.21.15.55:0/3365839608 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fcebc0663a0 0x7fcebc068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fced40ad000 tx=0x7fced40a6000 comp rx=0 tx=0).stop 2023-07-06T22:02:08.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.571+0000 7fcedf974640 1 -- 172.21.15.55:0/3365839608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced8070d70 msgr2=0x7fced8151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.571+0000 7fcedf974640 1 --2- 172.21.15.55:0/3365839608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced8070d70 0x7fced8151b60 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fcec800b420 tx=0x7fcec800b8e0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.571+0000 7fcedf974640 1 -- 172.21.15.55:0/3365839608 shutdown_connections 2023-07-06T22:02:08.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.571+0000 7fcedf974640 1 --2- 172.21.15.55:0/3365839608 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fced80cbe60 0x7fced81520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.571+0000 7fcedf974640 1 --2- 172.21.15.55:0/3365839608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced8070d70 0x7fced8151b60 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.571+0000 7fcedf974640 1 --2- 172.21.15.55:0/3365839608 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fcebc0663a0 0x7fcebc068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.571+0000 7fcedf974640 1 --2- 172.21.15.55:0/3365839608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fced80709a0 0x7fced815c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.571+0000 7fcedf974640 1 -- 172.21.15.55:0/3365839608 >> 172.21.15.55:0/3365839608 conn(0x7fced80cea70 msgr2=0x7fced80b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:08.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.571+0000 7fcedf974640 1 -- 172.21.15.55:0/3365839608 shutdown_connections 2023-07-06T22:02:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.571+0000 7fcedf974640 1 -- 172.21.15.55:0/3365839608 wait complete. 2023-07-06T22:02:08.591 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:02:08.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceb4fdb640 1 Processor -- start 2023-07-06T22:02:08.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceb4fdb640 1 -- start start 2023-07-06T22:02:08.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceb4fdb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fceb015b850 0x7fceb00cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceb4fdb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fceb00ccd30 0x7fceb00b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceb4fdb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fceb00b3db0 0x7fceb015f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceb4fdb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb00b4210 con 0x7fceb015b850 2023-07-06T22:02:08.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceb4fdb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb00b2b80 con 0x7fceb00ccd30 2023-07-06T22:02:08.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceb4fdb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00cff30 con 0x7fceb00b3db0 2023-07-06T22:02:08.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceae59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fceb015b850 0x7fceb00cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceae59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fceb015b850 0x7fceb00cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51744/0 (socket says 172.21.15.55:51744) 2023-07-06T22:02:08.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceae59c640 1 -- 172.21.15.55:0/117205483 learned_addr learned my addr 172.21.15.55:0/117205483 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:08.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceaed9d640 1 --2- 172.21.15.55:0/117205483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fceb00b3db0 0x7fceb015f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fcea7fff640 1 --2- 172.21.15.55:0/117205483 >> v2:172.21.15.138:3300/0 conn(0x7fceb00ccd30 0x7fceb00b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceae59c640 1 -- 172.21.15.55:0/117205483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fceb00b3db0 msgr2=0x7fceb015f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:08.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceae59c640 1 --2- 172.21.15.55:0/117205483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fceb00b3db0 0x7fceb015f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceae59c640 1 -- 172.21.15.55:0/117205483 >> v2:172.21.15.138:3300/0 conn(0x7fceb00ccd30 msgr2=0x7fceb00b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceae59c640 1 --2- 172.21.15.55:0/117205483 >> v2:172.21.15.138:3300/0 conn(0x7fceb00ccd30 0x7fceb00b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fceae59c640 1 -- 172.21.15.55:0/117205483 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb00b22e0 con 0x7fceb015b850 2023-07-06T22:02:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.739+0000 7fcea7fff640 1 --2- 172.21.15.55:0/117205483 >> v2:172.21.15.138:3300/0 conn(0x7fceb00ccd30 0x7fceb00b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.743+0000 7fceae59c640 1 --2- 172.21.15.55:0/117205483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb015b850 0x7fceb00cc7f0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fceb00cebd0 tx=0x7fcea001c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c67bf4aace1c001 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:08.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.743+0000 7fceadd9b640 1 -- 172.21.15.55:0/117205483 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea00ab600 con 0x7fceb015b850 2023-07-06T22:02:08.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.743+0000 7fceadd9b640 1 -- 172.21.15.55:0/117205483 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea00a7050 con 0x7fceb015b850 2023-07-06T22:02:08.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.743+0000 7fceadd9b640 1 -- 172.21.15.55:0/117205483 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea00ab980 con 0x7fceb015b850 2023-07-06T22:02:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.743+0000 7fceb4fdb640 1 -- 172.21.15.55:0/117205483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb015b850 msgr2=0x7fceb00cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.743+0000 7fceb4fdb640 1 --2- 172.21.15.55:0/117205483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb015b850 0x7fceb00cc7f0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fceb00cebd0 tx=0x7fcea001c0f0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.743+0000 7fceb4fdb640 1 -- 172.21.15.55:0/117205483 shutdown_connections 2023-07-06T22:02:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.743+0000 7fceb4fdb640 1 --2- 172.21.15.55:0/117205483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fceb00b3db0 0x7fceb015f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.743+0000 7fceb4fdb640 1 --2- 172.21.15.55:0/117205483 >> v2:172.21.15.138:3300/0 conn(0x7fceb00ccd30 0x7fceb00b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.743+0000 7fceb4fdb640 1 --2- 172.21.15.55:0/117205483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb015b850 0x7fceb00cc7f0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.743+0000 7fceb4fdb640 1 -- 172.21.15.55:0/117205483 >> 172.21.15.55:0/117205483 conn(0x7fceb00cec20 msgr2=0x7fceb00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:08.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.743+0000 7fceb4fdb640 1 -- 172.21.15.55:0/117205483 shutdown_connections 2023-07-06T22:02:08.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.743+0000 7fceb4fdb640 1 -- 172.21.15.55:0/117205483 wait complete. 2023-07-06T22:02:08.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceb4fdb640 1 Processor -- start 2023-07-06T22:02:08.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceb4fdb640 1 -- start start 2023-07-06T22:02:08.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceb4fdb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb00b3db0 0x7fceb0153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceb4fdb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fceb00ccd30 0x7fceb00c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceb4fdb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fceb015b850 0x7fceb0157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceb4fdb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb0153c80 con 0x7fceb00b3db0 2023-07-06T22:02:08.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceb4fdb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00cb200 con 0x7fceb00ccd30 2023-07-06T22:02:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceb4fdb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00cb690 con 0x7fceb015b850 2023-07-06T22:02:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceae59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb00b3db0 0x7fceb0153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceae59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb00b3db0 0x7fceb0153740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51746/0 (socket says 172.21.15.55:51746) 2023-07-06T22:02:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceae59c640 1 -- 172.21.15.55:0/991052708 learned_addr learned my addr 172.21.15.55:0/991052708 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fcea7fff640 1 --2- 172.21.15.55:0/991052708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fceb00ccd30 0x7fceb00c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceae59c640 1 -- 172.21.15.55:0/991052708 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fceb015b850 msgr2=0x7fceb0157620 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T22:02:08.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceae59c640 1 --2- 172.21.15.55:0/991052708 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fceb015b850 0x7fceb0157620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceae59c640 1 -- 172.21.15.55:0/991052708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fceb00ccd30 msgr2=0x7fceb00c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceae59c640 1 --2- 172.21.15.55:0/991052708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fceb00ccd30 0x7fceb00c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceae59c640 1 -- 172.21.15.55:0/991052708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea00094d0 con 0x7fceb00b3db0 2023-07-06T22:02:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceae59c640 1 --2- 172.21.15.55:0/991052708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb00b3db0 0x7fceb0153740 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fcea001c990 tx=0x7fcea0018e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fcea6ffd640 1 -- 172.21.15.55:0/991052708 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea00b4420 con 0x7fceb00b3db0 2023-07-06T22:02:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fcea6ffd640 1 -- 172.21.15.55:0/991052708 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea00b45a0 con 0x7fceb00b3db0 2023-07-06T22:02:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fcea6ffd640 1 -- 172.21.15.55:0/991052708 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea00b4950 con 0x7fceb00b3db0 2023-07-06T22:02:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceb4fdb640 1 -- 172.21.15.55:0/991052708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb015bda0 con 0x7fceb00b3db0 2023-07-06T22:02:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.747+0000 7fceb4fdb640 1 -- 172.21.15.55:0/991052708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb00ca8d0 con 0x7fceb00b3db0 2023-07-06T22:02:08.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.751+0000 7fceb4fdb640 1 -- 172.21.15.55:0/991052708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb0066d60 con 0x7fceb00b3db0 2023-07-06T22:02:08.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.751+0000 7fcea6ffd640 1 -- 172.21.15.55:0/991052708 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcea00b2070 con 0x7fceb00b3db0 2023-07-06T22:02:08.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.751+0000 7fcea6ffd640 1 --2- 172.21.15.55:0/991052708 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fce900663d0 0x7fce90068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:08.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.751+0000 7fcea6ffd640 1 -- 172.21.15.55:0/991052708 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5558+0+0 (secure 0 0 0) 0x7fcea011d840 con 0x7fceb00b3db0 2023-07-06T22:02:08.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.751+0000 7fcea7fff640 1 --2- 172.21.15.55:0/991052708 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fce900663d0 0x7fce90068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:08.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.751+0000 7fcea7fff640 1 --2- 172.21.15.55:0/991052708 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fce900663d0 0x7fce90068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fceb00c8a70 tx=0x7fce98008040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:08.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.755+0000 7fcea6ffd640 1 -- 172.21.15.55:0/991052708 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcea00eabf0 con 0x7fceb00b3db0 2023-07-06T22:02:08.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.911+0000 7fceb4fdb640 1 -- 172.21.15.55:0/991052708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fceb00b3420 con 0x7fceb00b3db0 2023-07-06T22:02:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.911+0000 7fcea6ffd640 1 -- 172.21.15.55:0/991052708 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v156) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcea00ee210 con 0x7fceb00b3db0 2023-07-06T22:02:08.910 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:02:08.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.911+0000 7fceb4fdb640 1 -- 172.21.15.55:0/991052708 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fce900663d0 msgr2=0x7fce90068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.911+0000 7fceb4fdb640 1 --2- 172.21.15.55:0/991052708 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fce900663d0 0x7fce90068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fceb00c8a70 tx=0x7fce98008040 comp rx=0 tx=0).stop 2023-07-06T22:02:08.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.911+0000 7fceb4fdb640 1 -- 172.21.15.55:0/991052708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb00b3db0 msgr2=0x7fceb0153740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:08.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.911+0000 7fceb4fdb640 1 --2- 172.21.15.55:0/991052708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb00b3db0 0x7fceb0153740 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fcea001c990 tx=0x7fcea0018e90 comp rx=0 tx=0).stop 2023-07-06T22:02:08.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.911+0000 7fceb4fdb640 1 -- 172.21.15.55:0/991052708 shutdown_connections 2023-07-06T22:02:08.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.911+0000 7fceb4fdb640 1 --2- 172.21.15.55:0/991052708 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fceb015b850 0x7fceb0157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.911+0000 7fceb4fdb640 1 --2- 172.21.15.55:0/991052708 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fce900663d0 0x7fce90068880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.911+0000 7fceb4fdb640 1 --2- 172.21.15.55:0/991052708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fceb00ccd30 0x7fceb00c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.911+0000 7fceb4fdb640 1 --2- 172.21.15.55:0/991052708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb00b3db0 0x7fceb0153740 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.911+0000 7fceb4fdb640 1 -- 172.21.15.55:0/991052708 >> 172.21.15.55:0/991052708 conn(0x7fceb00cec20 msgr2=0x7fceb00d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.911+0000 7fceb4fdb640 1 -- 172.21.15.55:0/991052708 shutdown_connections 2023-07-06T22:02:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:08.911+0000 7fceb4fdb640 1 -- 172.21.15.55:0/991052708 wait complete. 2023-07-06T22:02:08.932 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T22:02:09.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.075+0000 7fd06479f640 1 Processor -- start 2023-07-06T22:02:09.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.075+0000 7fd06479f640 1 -- start start 2023-07-06T22:02:09.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.075+0000 7fd06479f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd05c0712f0 0x7fd05c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:09.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.075+0000 7fd06479f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd05c0b3730 0x7fd05c0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:09.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.075+0000 7fd06479f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd05c0ca280 0x7fd05c0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:09.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.075+0000 7fd06479f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd05c0ca6e0 con 0x7fd05c0b3730 2023-07-06T22:02:09.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd06479f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd05c159cd0 con 0x7fd05c0712f0 2023-07-06T22:02:09.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd06479f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c0693f0 con 0x7fd05c0ca280 2023-07-06T22:02:09.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd061d3a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd05c0b3730 0x7fd05c0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:09.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd061d3a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd05c0b3730 0x7fd05c0c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51754/0 (socket says 172.21.15.55:51754) 2023-07-06T22:02:09.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd061d3a640 1 -- 172.21.15.55:0/4059149001 learned_addr learned my addr 172.21.15.55:0/4059149001 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:09.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd06253b640 1 --2- 172.21.15.55:0/4059149001 >> v2:172.21.15.138:3300/0 conn(0x7fd05c0712f0 0x7fd05c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:09.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd062d3c640 1 --2- 172.21.15.55:0/4059149001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd05c0ca280 0x7fd05c0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:09.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd061d3a640 1 -- 172.21.15.55:0/4059149001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd05c0ca280 msgr2=0x7fd05c0c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:09.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd061d3a640 1 --2- 172.21.15.55:0/4059149001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd05c0ca280 0x7fd05c0c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd061d3a640 1 -- 172.21.15.55:0/4059149001 >> v2:172.21.15.138:3300/0 conn(0x7fd05c0712f0 msgr2=0x7fd05c06a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:09.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd061d3a640 1 --2- 172.21.15.55:0/4059149001 >> v2:172.21.15.138:3300/0 conn(0x7fd05c0712f0 0x7fd05c06a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd061d3a640 1 -- 172.21.15.55:0/4059149001 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c06aca0 con 0x7fd05c0b3730 2023-07-06T22:02:09.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd06253b640 1 --2- 172.21.15.55:0/4059149001 >> v2:172.21.15.138:3300/0 conn(0x7fd05c0712f0 0x7fd05c06a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:09.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd062d3c640 1 --2- 172.21.15.55:0/4059149001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd05c0ca280 0x7fd05c0c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:09.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd061d3a640 1 --2- 172.21.15.55:0/4059149001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd05c0b3730 0x7fd05c0c9d40 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fd05c071950 tx=0x7fd04c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d004a7728311cdb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:09.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd061539640 1 -- 172.21.15.55:0/4059149001 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0ab600 con 0x7fd05c0b3730 2023-07-06T22:02:09.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd061539640 1 -- 172.21.15.55:0/4059149001 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c0a7050 con 0x7fd05c0b3730 2023-07-06T22:02:09.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.079+0000 7fd061539640 1 -- 172.21.15.55:0/4059149001 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0ab980 con 0x7fd05c0b3730 2023-07-06T22:02:09.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 -- 172.21.15.55:0/4059149001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd05c0b3730 msgr2=0x7fd05c0c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:09.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 --2- 172.21.15.55:0/4059149001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd05c0b3730 0x7fd05c0c9d40 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fd05c071950 tx=0x7fd04c01c210 comp rx=0 tx=0).stop 2023-07-06T22:02:09.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 -- 172.21.15.55:0/4059149001 shutdown_connections 2023-07-06T22:02:09.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 --2- 172.21.15.55:0/4059149001 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd05c0ca280 0x7fd05c0c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 --2- 172.21.15.55:0/4059149001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd05c0b3730 0x7fd05c0c9d40 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 --2- 172.21.15.55:0/4059149001 >> v2:172.21.15.138:3300/0 conn(0x7fd05c0712f0 0x7fd05c06a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 -- 172.21.15.55:0/4059149001 >> 172.21.15.55:0/4059149001 conn(0x7fd05c0cded0 msgr2=0x7fd05c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:09.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 -- 172.21.15.55:0/4059149001 shutdown_connections 2023-07-06T22:02:09.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 -- 172.21.15.55:0/4059149001 wait complete. 2023-07-06T22:02:09.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 Processor -- start 2023-07-06T22:02:09.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 -- start start 2023-07-06T22:02:09.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd05c0712f0 0x7fd05c1552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:09.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd05c0b3730 0x7fd05c15c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:09.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd05c0ca280 0x7fd05c15c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:09.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c15adb0 con 0x7fd05c0712f0 2023-07-06T22:02:09.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c1557f0 con 0x7fd05c0b3730 2023-07-06T22:02:09.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06479f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c159ee0 con 0x7fd05c0ca280 2023-07-06T22:02:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06253b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd05c0712f0 0x7fd05c1552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06253b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd05c0712f0 0x7fd05c1552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51770/0 (socket says 172.21.15.55:51770) 2023-07-06T22:02:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06253b640 1 -- 172.21.15.55:0/1440936598 learned_addr learned my addr 172.21.15.55:0/1440936598 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd061d3a640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd05c0b3730 0x7fd05c15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06253b640 1 -- 172.21.15.55:0/1440936598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd05c0ca280 msgr2=0x7fd05c15c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd062d3c640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd05c0ca280 0x7fd05c15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06253b640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd05c0ca280 0x7fd05c15c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06253b640 1 -- 172.21.15.55:0/1440936598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd05c0b3730 msgr2=0x7fd05c15c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06253b640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd05c0b3730 0x7fd05c15c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd06253b640 1 -- 172.21.15.55:0/1440936598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c0094d0 con 0x7fd05c0712f0 2023-07-06T22:02:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd061d3a640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd05c0b3730 0x7fd05c15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.083+0000 7fd062d3c640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd05c0ca280 0x7fd05c15c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.087+0000 7fd06253b640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd05c0712f0 0x7fd05c1552b0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fd05800c820 tx=0x7fd05800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.087+0000 7fd052ffd640 1 -- 172.21.15.55:0/1440936598 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058007a30 con 0x7fd05c0712f0 2023-07-06T22:02:09.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.087+0000 7fd052ffd640 1 -- 172.21.15.55:0/1440936598 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd058007b90 con 0x7fd05c0712f0 2023-07-06T22:02:09.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.087+0000 7fd052ffd640 1 -- 172.21.15.55:0/1440936598 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05800ce10 con 0x7fd05c0712f0 2023-07-06T22:02:09.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.087+0000 7fd06479f640 1 -- 172.21.15.55:0/1440936598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05c15a1a0 con 0x7fd05c0712f0 2023-07-06T22:02:09.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.087+0000 7fd06479f640 1 -- 172.21.15.55:0/1440936598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05c15a760 con 0x7fd05c0712f0 2023-07-06T22:02:09.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.087+0000 7fd06479f640 1 -- 172.21.15.55:0/1440936598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05c066d60 con 0x7fd05c0712f0 2023-07-06T22:02:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.087+0000 7fd052ffd640 1 -- 172.21.15.55:0/1440936598 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd0580113f0 con 0x7fd05c0712f0 2023-07-06T22:02:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.087+0000 7fd052ffd640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fd0400663a0 0x7fd040068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.087+0000 7fd052ffd640 1 -- 172.21.15.55:0/1440936598 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5558+0+0 (secure 0 0 0) 0x7fd058083e60 con 0x7fd05c0712f0 2023-07-06T22:02:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.087+0000 7fd061d3a640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fd0400663a0 0x7fd040068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.091+0000 7fd061d3a640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fd0400663a0 0x7fd040068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0ad000 tx=0x7fd04c008040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.091+0000 7fd052ffd640 1 -- 172.21.15.55:0/1440936598 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0580512a0 con 0x7fd05c0712f0 2023-07-06T22:02:09.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.247+0000 7fd06479f640 1 -- 172.21.15.55:0/1440936598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd05c06c380 con 0x7fd05c0712f0 2023-07-06T22:02:09.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.251+0000 7fd052ffd640 1 -- 172.21.15.55:0/1440936598 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v156) v1 ==== 84+0+126 (secure 0 0 0) 0x7fd0580548c0 con 0x7fd05c0712f0 2023-07-06T22:02:09.249 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:09.249 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T22:02:09.249 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:09.249 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-07-06T22:02:09.249 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-07-06T22:02:09.250 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:02:09.250 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:09.250 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-07-06T22:02:09.250 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-07-06T22:02:09.250 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:09.250 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T22:02:09.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.251+0000 7fd06479f640 1 -- 172.21.15.55:0/1440936598 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fd0400663a0 msgr2=0x7fd040068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:09.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.251+0000 7fd06479f640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fd0400663a0 0x7fd040068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0ad000 tx=0x7fd04c008040 comp rx=0 tx=0).stop 2023-07-06T22:02:09.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.251+0000 7fd06479f640 1 -- 172.21.15.55:0/1440936598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd05c0712f0 msgr2=0x7fd05c1552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:09.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.251+0000 7fd06479f640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd05c0712f0 0x7fd05c1552b0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fd05800c820 tx=0x7fd05800cce0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.251+0000 7fd06479f640 1 -- 172.21.15.55:0/1440936598 shutdown_connections 2023-07-06T22:02:09.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.251+0000 7fd06479f640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd05c0ca280 0x7fd05c15c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.251+0000 7fd06479f640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fd0400663a0 0x7fd040068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.251+0000 7fd06479f640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd05c0b3730 0x7fd05c15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.251+0000 7fd06479f640 1 --2- 172.21.15.55:0/1440936598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd05c0712f0 0x7fd05c1552b0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.251+0000 7fd06479f640 1 -- 172.21.15.55:0/1440936598 >> 172.21.15.55:0/1440936598 conn(0x7fd05c0cded0 msgr2=0x7fd05c0b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:09.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.251+0000 7fd06479f640 1 -- 172.21.15.55:0/1440936598 shutdown_connections 2023-07-06T22:02:09.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.251+0000 7fd06479f640 1 -- 172.21.15.55:0/1440936598 wait complete. 2023-07-06T22:02:09.269 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T22:02:09.269 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T22:02:09.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff32d648640 1 Processor -- start 2023-07-06T22:02:09.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff32d648640 1 -- start start 2023-07-06T22:02:09.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff32d648640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff328153fb0 0x7ff3280cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:09.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff32d648640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff32806f420 0x7ff3280cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:09.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff32d648640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32815dce0 con 0x7ff32815ab00 2023-07-06T22:02:09.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff32d648640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3280cf9c0 con 0x7ff328153fb0 2023-07-06T22:02:09.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff32d648640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32815d3b0 con 0x7ff32806f420 2023-07-06T22:02:09.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff326ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff328153fb0 0x7ff3280cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:09.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff31ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff32815ab00 0x7ff32806ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58786/0 (socket says 172.21.15.55:58786) 2023-07-06T22:02:09.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff31ffff640 1 -- 172.21.15.55:0/1774209400 learned_addr learned my addr 172.21.15.55:0/1774209400 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:09.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff3277fe640 1 --2- 172.21.15.55:0/1774209400 >> v2:172.21.15.138:3300/0 conn(0x7ff32806f420 0x7ff3280cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:09.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff326ffd640 1 -- 172.21.15.55:0/1774209400 >> v2:172.21.15.138:3300/0 conn(0x7ff32806f420 msgr2=0x7ff3280cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:09.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff326ffd640 1 --2- 172.21.15.55:0/1774209400 >> v2:172.21.15.138:3300/0 conn(0x7ff32806f420 0x7ff3280cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff326ffd640 1 -- 172.21.15.55:0/1774209400 >> v1:172.21.15.55:6789/0 conn(0x7ff32815ab00 legacy=0x7ff32806ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:09.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.419+0000 7ff326ffd640 1 -- 172.21.15.55:0/1774209400 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32815d690 con 0x7ff328153fb0 2023-07-06T22:02:09.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.423+0000 7ff326ffd640 1 --2- 172.21.15.55:0/1774209400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff328153fb0 0x7ff3280cf020 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7ff32806fb50 tx=0x7ff31801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea41327b93b18c9f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:09.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.423+0000 7ff3267fc640 1 -- 172.21.15.55:0/1774209400 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3180ad660 con 0x7ff328153fb0 2023-07-06T22:02:09.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.423+0000 7ff3267fc640 1 -- 172.21.15.55:0/1774209400 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3180ad7c0 con 0x7ff328153fb0 2023-07-06T22:02:09.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.423+0000 7ff3267fc640 1 -- 172.21.15.55:0/1774209400 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3180adb50 con 0x7ff328153fb0 2023-07-06T22:02:09.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.423+0000 7ff32d648640 1 -- 172.21.15.55:0/1774209400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff328153fb0 msgr2=0x7ff3280cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:09.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.423+0000 7ff32d648640 1 --2- 172.21.15.55:0/1774209400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff328153fb0 0x7ff3280cf020 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7ff32806fb50 tx=0x7ff31801c430 comp rx=0 tx=0).stop 2023-07-06T22:02:09.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.423+0000 7ff32d648640 1 -- 172.21.15.55:0/1774209400 shutdown_connections 2023-07-06T22:02:09.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.423+0000 7ff32d648640 1 --2- 172.21.15.55:0/1774209400 >> v2:172.21.15.138:3300/0 conn(0x7ff32806f420 0x7ff3280cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.423+0000 7ff32d648640 1 --2- 172.21.15.55:0/1774209400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff328153fb0 0x7ff3280cf020 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.423+0000 7ff32d648640 1 -- 172.21.15.55:0/1774209400 >> 172.21.15.55:0/1774209400 conn(0x7ff3280d0c20 msgr2=0x7ff3280cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:09.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.423+0000 7ff32d648640 1 -- 172.21.15.55:0/1774209400 shutdown_connections 2023-07-06T22:02:09.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.423+0000 7ff32d648640 1 -- 172.21.15.55:0/1774209400 wait complete. 2023-07-06T22:02:09.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.423+0000 7ff32d648640 1 Processor -- start 2023-07-06T22:02:09.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff32d648640 1 -- start start 2023-07-06T22:02:09.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff32d648640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff32806f420 0x7ff3281596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:09.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff32d648640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff328153fb0 0x7ff3280b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:09.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff32d648640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff32815ab00 0x7ff32814e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:09.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff32d648640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3280b0570 con 0x7ff328153fb0 2023-07-06T22:02:09.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff32d648640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3280b01b0 con 0x7ff32815ab00 2023-07-06T22:02:09.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff32d648640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32815a150 con 0x7ff32806f420 2023-07-06T22:02:09.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff31ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff328153fb0 0x7ff3280b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:09.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff31ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff328153fb0 0x7ff3280b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51780/0 (socket says 172.21.15.55:51780) 2023-07-06T22:02:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff31ffff640 1 -- 172.21.15.55:0/3319480903 learned_addr learned my addr 172.21.15.55:0/3319480903 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff3277fe640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff32815ab00 0x7ff32814e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff326ffd640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff32806f420 0x7ff3281596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff31ffff640 1 -- 172.21.15.55:0/3319480903 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff32806f420 msgr2=0x7ff3281596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff31ffff640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff32806f420 0x7ff3281596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff31ffff640 1 -- 172.21.15.55:0/3319480903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff32815ab00 msgr2=0x7ff32814e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff31ffff640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff32815ab00 0x7ff32814e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff31ffff640 1 -- 172.21.15.55:0/3319480903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff318009420 con 0x7ff328153fb0 2023-07-06T22:02:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff3277fe640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff32815ab00 0x7ff32814e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff31ffff640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff328153fb0 0x7ff3280b0990 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7ff31000c400 tx=0x7ff31000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff31f7fe640 1 -- 172.21.15.55:0/3319480903 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310005cf0 con 0x7ff328153fb0 2023-07-06T22:02:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff31f7fe640 1 -- 172.21.15.55:0/3319480903 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff310005e50 con 0x7ff328153fb0 2023-07-06T22:02:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff31f7fe640 1 -- 172.21.15.55:0/3319480903 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3100072d0 con 0x7ff328153fb0 2023-07-06T22:02:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff32d648640 1 -- 172.21.15.55:0/3319480903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32815a430 con 0x7ff328153fb0 2023-07-06T22:02:09.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff32d648640 1 -- 172.21.15.55:0/3319480903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3281640d0 con 0x7ff328153fb0 2023-07-06T22:02:09.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.427+0000 7ff32d648640 1 -- 172.21.15.55:0/3319480903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3281642c0 con 0x7ff328153fb0 2023-07-06T22:02:09.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.431+0000 7ff31f7fe640 1 -- 172.21.15.55:0/3319480903 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff310007430 con 0x7ff328153fb0 2023-07-06T22:02:09.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.431+0000 7ff31f7fe640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff3080663a0 0x7ff308068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:09.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.431+0000 7ff31f7fe640 1 -- 172.21.15.55:0/3319480903 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5558+0+0 (secure 0 0 0) 0x7ff310083170 con 0x7ff328153fb0 2023-07-06T22:02:09.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.431+0000 7ff326ffd640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff3080663a0 0x7ff308068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:09.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.431+0000 7ff326ffd640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff3080663a0 0x7ff308068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3180af000 tx=0x7ff318008040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.435+0000 7ff31f7fe640 1 -- 172.21.15.55:0/3319480903 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3100506e0 con 0x7ff328153fb0 2023-07-06T22:02:09.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:09.587+0000 7ff32d648640 1 -- 172.21.15.55:0/3319480903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff328066d60 con 0x7ff328153fb0 2023-07-06T22:02:10.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.343+0000 7ff31f7fe640 1 -- 172.21.15.55:0/3319480903 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v157) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff310053d00 con 0x7ff328153fb0 2023-07-06T22:02:10.343 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-07-06T22:02:10.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.351+0000 7ff32d648640 1 -- 172.21.15.55:0/3319480903 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff3080663a0 msgr2=0x7ff308068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:10.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.351+0000 7ff32d648640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff3080663a0 0x7ff308068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3180af000 tx=0x7ff318008040 comp rx=0 tx=0).stop 2023-07-06T22:02:10.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.351+0000 7ff32d648640 1 -- 172.21.15.55:0/3319480903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff328153fb0 msgr2=0x7ff3280b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:10.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.351+0000 7ff32d648640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff328153fb0 0x7ff3280b0990 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7ff31000c400 tx=0x7ff31000c8c0 comp rx=0 tx=0).stop 2023-07-06T22:02:10.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.351+0000 7ff32d648640 1 -- 172.21.15.55:0/3319480903 shutdown_connections 2023-07-06T22:02:10.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.351+0000 7ff32d648640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff3080663a0 0x7ff308068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:10.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.351+0000 7ff32d648640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff32815ab00 0x7ff32814e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:10.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.351+0000 7ff32d648640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff328153fb0 0x7ff3280b0990 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:10.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.351+0000 7ff32d648640 1 --2- 172.21.15.55:0/3319480903 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff32806f420 0x7ff3281596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:10.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.351+0000 7ff32d648640 1 -- 172.21.15.55:0/3319480903 >> 172.21.15.55:0/3319480903 conn(0x7ff3280d0c20 msgr2=0x7ff3280b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:10.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.351+0000 7ff32d648640 1 -- 172.21.15.55:0/3319480903 shutdown_connections 2023-07-06T22:02:10.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.351+0000 7ff32d648640 1 -- 172.21.15.55:0/3319480903 wait complete. 2023-07-06T22:02:10.375 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T22:02:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcbbddb640 1 Processor -- start 2023-07-06T22:02:10.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcbbddb640 1 -- start start 2023-07-06T22:02:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcbbddb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdcb4159ad0 0x7fdcb406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcbbddb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdcb4070770 0x7fdcb406b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcbbddb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb40b0d90 con 0x7fdcb406c380 2023-07-06T22:02:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcbbddb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb40c8620 con 0x7fdcb4159ad0 2023-07-06T22:02:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcbbddb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb4070c50 con 0x7fdcb4070770 2023-07-06T22:02:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcb9b77640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdcb4159ad0 0x7fdcb406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcb9b77640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdcb4159ad0 0x7fdcb406b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51794/0 (socket says 172.21.15.55:51794) 2023-07-06T22:02:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcb9b77640 1 -- 172.21.15.55:0/1199703367 learned_addr learned my addr 172.21.15.55:0/1199703367 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcba378640 1 --2- 172.21.15.55:0/1199703367 >> v2:172.21.15.138:3300/0 conn(0x7fdcb4070770 0x7fdcb406b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:10.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcb9b77640 1 -- 172.21.15.55:0/1199703367 >> v2:172.21.15.138:3300/0 conn(0x7fdcb4070770 msgr2=0x7fdcb406b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:10.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcb9b77640 1 --2- 172.21.15.55:0/1199703367 >> v2:172.21.15.138:3300/0 conn(0x7fdcb4070770 0x7fdcb406b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:10.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcb9b77640 1 -- 172.21.15.55:0/1199703367 >> v1:172.21.15.138:6789/0 conn(0x7fdcb406c380 legacy=0x7fdcb40693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:10.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.531+0000 7fdcb9b77640 1 -- 172.21.15.55:0/1199703367 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb4070f30 con 0x7fdcb4159ad0 2023-07-06T22:02:10.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.535+0000 7fdcb9b77640 1 --2- 172.21.15.55:0/1199703367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb4159ad0 0x7fdcb406b2f0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fdcb406eea0 tx=0x7fdcb001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72360487a7f06310 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:10.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.535+0000 7fdcb8b75640 1 -- 172.21.15.55:0/1199703367 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00ab640 con 0x7fdcb4159ad0 2023-07-06T22:02:10.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.535+0000 7fdcb8b75640 1 -- 172.21.15.55:0/1199703367 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb00a7070 con 0x7fdcb4159ad0 2023-07-06T22:02:10.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.535+0000 7fdcb8b75640 1 -- 172.21.15.55:0/1199703367 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00ab9c0 con 0x7fdcb4159ad0 2023-07-06T22:02:10.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.535+0000 7fdcbbddb640 1 -- 172.21.15.55:0/1199703367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb4159ad0 msgr2=0x7fdcb406b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:10.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.535+0000 7fdcbbddb640 1 --2- 172.21.15.55:0/1199703367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb4159ad0 0x7fdcb406b2f0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fdcb406eea0 tx=0x7fdcb001c440 comp rx=0 tx=0).stop 2023-07-06T22:02:10.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.535+0000 7fdcbbddb640 1 -- 172.21.15.55:0/1199703367 shutdown_connections 2023-07-06T22:02:10.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.535+0000 7fdcbbddb640 1 --2- 172.21.15.55:0/1199703367 >> v2:172.21.15.138:3300/0 conn(0x7fdcb4070770 0x7fdcb406b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:10.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.535+0000 7fdcbbddb640 1 --2- 172.21.15.55:0/1199703367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb4159ad0 0x7fdcb406b2f0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:10.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.535+0000 7fdcbbddb640 1 -- 172.21.15.55:0/1199703367 >> 172.21.15.55:0/1199703367 conn(0x7fdcb40cdf40 msgr2=0x7fdcb40ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:10.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.535+0000 7fdcbbddb640 1 -- 172.21.15.55:0/1199703367 shutdown_connections 2023-07-06T22:02:10.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.535+0000 7fdcbbddb640 1 -- 172.21.15.55:0/1199703367 wait complete. 2023-07-06T22:02:10.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcbbddb640 1 Processor -- start 2023-07-06T22:02:10.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcbbddb640 1 -- start start 2023-07-06T22:02:10.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcbbddb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcb406c380 0x7fdcb40aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:10.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcbbddb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcb4070770 0x7fdcb41525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:10.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcbbddb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb4159ad0 0x7fdcb40cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:10.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcbbddb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb40cbbb0 con 0x7fdcb4159ad0 2023-07-06T22:02:10.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcbbddb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb4152f30 con 0x7fdcb4070770 2023-07-06T22:02:10.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcbbddb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb40cbe20 con 0x7fdcb406c380 2023-07-06T22:02:10.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcba378640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb4159ad0 0x7fdcb40cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:10.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcba378640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb4159ad0 0x7fdcb40cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51810/0 (socket says 172.21.15.55:51810) 2023-07-06T22:02:10.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcba378640 1 -- 172.21.15.55:0/3397376441 learned_addr learned my addr 172.21.15.55:0/3397376441 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:10.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcb9376640 1 --2- 172.21.15.55:0/3397376441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcb4070770 0x7fdcb41525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:10.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcb9b77640 1 --2- 172.21.15.55:0/3397376441 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcb406c380 0x7fdcb40aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:10.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcba378640 1 -- 172.21.15.55:0/3397376441 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcb406c380 msgr2=0x7fdcb40aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:10.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcba378640 1 --2- 172.21.15.55:0/3397376441 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcb406c380 0x7fdcb40aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:10.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcba378640 1 -- 172.21.15.55:0/3397376441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcb4070770 msgr2=0x7fdcb41525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:10.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcba378640 1 --2- 172.21.15.55:0/3397376441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcb4070770 0x7fdcb41525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:10.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcba378640 1 -- 172.21.15.55:0/3397376441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb00094d0 con 0x7fdcb4159ad0 2023-07-06T22:02:10.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcba378640 1 --2- 172.21.15.55:0/3397376441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb4159ad0 0x7fdcb40cc620 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00efc0 tx=0x7fdcac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:10.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcaa7fc640 1 -- 172.21.15.55:0/3397376441 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac009ca0 con 0x7fdcb4159ad0 2023-07-06T22:02:10.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcaa7fc640 1 -- 172.21.15.55:0/3397376441 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac00f040 con 0x7fdcb4159ad0 2023-07-06T22:02:10.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcaa7fc640 1 -- 172.21.15.55:0/3397376441 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0146c0 con 0x7fdcb4159ad0 2023-07-06T22:02:10.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcbbddb640 1 -- 172.21.15.55:0/3397376441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb40cc100 con 0x7fdcb4159ad0 2023-07-06T22:02:10.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcbbddb640 1 -- 172.21.15.55:0/3397376441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb40af320 con 0x7fdcb4159ad0 2023-07-06T22:02:10.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.539+0000 7fdcbbddb640 1 -- 172.21.15.55:0/3397376441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb40cc2f0 con 0x7fdcb4159ad0 2023-07-06T22:02:10.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.543+0000 7fdcaa7fc640 1 -- 172.21.15.55:0/3397376441 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdcac014820 con 0x7fdcb4159ad0 2023-07-06T22:02:10.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.543+0000 7fdcaa7fc640 1 --2- 172.21.15.55:0/3397376441 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fdc980663a0 0x7fdc98068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:10.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.543+0000 7fdcaa7fc640 1 -- 172.21.15.55:0/3397376441 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5928+0+0 (secure 0 0 0) 0x7fdcac085310 con 0x7fdcb4159ad0 2023-07-06T22:02:10.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.543+0000 7fdcb9b77640 1 --2- 172.21.15.55:0/3397376441 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fdc980663a0 0x7fdc98068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:10.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.543+0000 7fdcb9b77640 1 --2- 172.21.15.55:0/3397376441 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fdc980663a0 0x7fdc98068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00af000 tx=0x7fdcb00b6040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:10.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.547+0000 7fdcaa7fc640 1 -- 172.21.15.55:0/3397376441 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdcac052680 con 0x7fdcb4159ad0 2023-07-06T22:02:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:10.703+0000 7fdcbbddb640 1 -- 172.21.15.55:0/3397376441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdcb4066d60 con 0x7fdcb4159ad0 2023-07-06T22:02:11.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.355+0000 7fdcaa7fc640 1 -- 172.21.15.55:0/3397376441 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v158) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdcac055ca0 con 0x7fdcb4159ad0 2023-07-06T22:02:11.355 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-07-06T22:02:11.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.359+0000 7fdcbbddb640 1 -- 172.21.15.55:0/3397376441 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fdc980663a0 msgr2=0x7fdc98068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:11.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.359+0000 7fdcbbddb640 1 --2- 172.21.15.55:0/3397376441 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fdc980663a0 0x7fdc98068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00af000 tx=0x7fdcb00b6040 comp rx=0 tx=0).stop 2023-07-06T22:02:11.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.359+0000 7fdcbbddb640 1 -- 172.21.15.55:0/3397376441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb4159ad0 msgr2=0x7fdcb40cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:11.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.359+0000 7fdcbbddb640 1 --2- 172.21.15.55:0/3397376441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb4159ad0 0x7fdcb40cc620 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00efc0 tx=0x7fdcac00c490 comp rx=0 tx=0).stop 2023-07-06T22:02:11.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.363+0000 7fdcbbddb640 1 -- 172.21.15.55:0/3397376441 shutdown_connections 2023-07-06T22:02:11.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.363+0000 7fdcbbddb640 1 --2- 172.21.15.55:0/3397376441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcb4159ad0 0x7fdcb40cc620 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.363+0000 7fdcbbddb640 1 --2- 172.21.15.55:0/3397376441 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fdc980663a0 0x7fdc98068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.363+0000 7fdcbbddb640 1 --2- 172.21.15.55:0/3397376441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcb4070770 0x7fdcb41525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.363+0000 7fdcbbddb640 1 --2- 172.21.15.55:0/3397376441 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdcb406c380 0x7fdcb40aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.363+0000 7fdcbbddb640 1 -- 172.21.15.55:0/3397376441 >> 172.21.15.55:0/3397376441 conn(0x7fdcb40cdf40 msgr2=0x7fdcb4157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:11.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.371+0000 7fdcbbddb640 1 -- 172.21.15.55:0/3397376441 shutdown_connections 2023-07-06T22:02:11.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.375+0000 7fdcbbddb640 1 -- 172.21.15.55:0/3397376441 wait complete. 2023-07-06T22:02:11.398 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T22:02:11.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaf2f96640 1 Processor -- start 2023-07-06T22:02:11.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaf2f96640 1 -- start start 2023-07-06T22:02:11.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaf2f96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcaec0709a0 0x7fcaec0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:11.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaf2f96640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcaec0b1340 0x7fcaec06eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:11.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaf2f96640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaec0cc300 con 0x7fcaec0cbe60 2023-07-06T22:02:11.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaf2f96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec0cc5e0 con 0x7fcaec0709a0 2023-07-06T22:02:11.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaf2f96640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec0cc8c0 con 0x7fcaec0b1340 2023-07-06T22:02:11.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaf0d32640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcaec0709a0 0x7fcaec0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:11.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaebfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcaec0cbe60 0x7fcaec0b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58794/0 (socket says 172.21.15.55:58794) 2023-07-06T22:02:11.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaebfff640 1 -- 172.21.15.55:0/4244997762 learned_addr learned my addr 172.21.15.55:0/4244997762 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:11.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaf1533640 1 --2- 172.21.15.55:0/4244997762 >> v2:172.21.15.138:3300/0 conn(0x7fcaec0b1340 0x7fcaec06eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:11.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaf0d32640 1 -- 172.21.15.55:0/4244997762 >> v2:172.21.15.138:3300/0 conn(0x7fcaec0b1340 msgr2=0x7fcaec06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:11.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaf0d32640 1 --2- 172.21.15.55:0/4244997762 >> v2:172.21.15.138:3300/0 conn(0x7fcaec0b1340 0x7fcaec06eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaf0d32640 1 -- 172.21.15.55:0/4244997762 >> v1:172.21.15.55:6789/0 conn(0x7fcaec0cbe60 legacy=0x7fcaec0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:11.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaf0d32640 1 -- 172.21.15.55:0/4244997762 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec0ccba0 con 0x7fcaec0709a0 2023-07-06T22:02:11.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.547+0000 7fcaeb7fe640 1 -- 172.21.15.55:0/4244997762 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048160501 0 0) 0x7fcaec0cc300 con 0x7fcaec0cbe60 2023-07-06T22:02:11.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.551+0000 7fcaf0d32640 1 --2- 172.21.15.55:0/4244997762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaec0709a0 0x7fcaec0cb920 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0b18b0 tx=0x7fcae001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55bfef34011b83b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:11.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.551+0000 7fcaeb7fe640 1 -- 172.21.15.55:0/4244997762 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00ab600 con 0x7fcaec0709a0 2023-07-06T22:02:11.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.551+0000 7fcaeb7fe640 1 -- 172.21.15.55:0/4244997762 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae00a7050 con 0x7fcaec0709a0 2023-07-06T22:02:11.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.551+0000 7fcaeb7fe640 1 -- 172.21.15.55:0/4244997762 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00ab980 con 0x7fcaec0709a0 2023-07-06T22:02:11.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.551+0000 7fcaf2f96640 1 -- 172.21.15.55:0/4244997762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaec0709a0 msgr2=0x7fcaec0cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:11.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.551+0000 7fcaf2f96640 1 --2- 172.21.15.55:0/4244997762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaec0709a0 0x7fcaec0cb920 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0b18b0 tx=0x7fcae001c460 comp rx=0 tx=0).stop 2023-07-06T22:02:11.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.551+0000 7fcaf2f96640 1 -- 172.21.15.55:0/4244997762 shutdown_connections 2023-07-06T22:02:11.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.551+0000 7fcaf2f96640 1 --2- 172.21.15.55:0/4244997762 >> v2:172.21.15.138:3300/0 conn(0x7fcaec0b1340 0x7fcaec06eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.551+0000 7fcaf2f96640 1 --2- 172.21.15.55:0/4244997762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaec0709a0 0x7fcaec0cb920 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.551+0000 7fcaf2f96640 1 -- 172.21.15.55:0/4244997762 >> 172.21.15.55:0/4244997762 conn(0x7fcaec0cea70 msgr2=0x7fcaec0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:11.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.551+0000 7fcaf2f96640 1 -- 172.21.15.55:0/4244997762 shutdown_connections 2023-07-06T22:02:11.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.551+0000 7fcaf2f96640 1 -- 172.21.15.55:0/4244997762 wait complete. 2023-07-06T22:02:11.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf2f96640 1 Processor -- start 2023-07-06T22:02:11.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf2f96640 1 -- start start 2023-07-06T22:02:11.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf2f96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaec0709a0 0x7fcaec06c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:11.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf2f96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcaec0b1340 0x7fcaec069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:11.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf2f96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcaec0cbe60 0x7fcaec1f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:11.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf2f96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec06cac0 con 0x7fcaec0709a0 2023-07-06T22:02:11.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf2f96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec1517b0 con 0x7fcaec0b1340 2023-07-06T22:02:11.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf2f96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec151a90 con 0x7fcaec0cbe60 2023-07-06T22:02:11.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf0d32640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaec0709a0 0x7fcaec06c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:11.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf0d32640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaec0709a0 0x7fcaec06c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51832/0 (socket says 172.21.15.55:51832) 2023-07-06T22:02:11.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf0d32640 1 -- 172.21.15.55:0/2104764020 learned_addr learned my addr 172.21.15.55:0/2104764020 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:11.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf1533640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcaec0cbe60 0x7fcaec1f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:11.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaebfff640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcaec0b1340 0x7fcaec069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:11.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf0d32640 1 -- 172.21.15.55:0/2104764020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcaec0cbe60 msgr2=0x7fcaec1f7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:11.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf0d32640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcaec0cbe60 0x7fcaec1f7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf0d32640 1 -- 172.21.15.55:0/2104764020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcaec0b1340 msgr2=0x7fcaec069650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:11.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf0d32640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcaec0b1340 0x7fcaec069650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf0d32640 1 -- 172.21.15.55:0/2104764020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae0009420 con 0x7fcaec0709a0 2023-07-06T22:02:11.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf1533640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcaec0cbe60 0x7fcaec1f7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:11.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaebfff640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcaec0b1340 0x7fcaec069650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:11.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf0d32640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaec0709a0 0x7fcaec06c3e0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fcae00ae040 tx=0x7fcae001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:11.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcae97fa640 1 -- 172.21.15.55:0/2104764020 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00b7450 con 0x7fcaec0709a0 2023-07-06T22:02:11.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcae97fa640 1 -- 172.21.15.55:0/2104764020 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae00b75b0 con 0x7fcaec0709a0 2023-07-06T22:02:11.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcae97fa640 1 -- 172.21.15.55:0/2104764020 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00b7960 con 0x7fcaec0709a0 2023-07-06T22:02:11.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf2f96640 1 -- 172.21.15.55:0/2104764020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaec151d70 con 0x7fcaec0709a0 2023-07-06T22:02:11.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.555+0000 7fcaf2f96640 1 -- 172.21.15.55:0/2104764020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec1609d0 con 0x7fcaec0709a0 2023-07-06T22:02:11.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.559+0000 7fcaf2f96640 1 -- 172.21.15.55:0/2104764020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaec0cdbe0 con 0x7fcaec0709a0 2023-07-06T22:02:11.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.559+0000 7fcae97fa640 1 -- 172.21.15.55:0/2104764020 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcae00b7ac0 con 0x7fcaec0709a0 2023-07-06T22:02:11.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.559+0000 7fcae97fa640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fcad00663a0 0x7fcad0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:11.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.559+0000 7fcae97fa640 1 -- 172.21.15.55:0/2104764020 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6310+0+0 (secure 0 0 0) 0x7fcae011f400 con 0x7fcaec0709a0 2023-07-06T22:02:11.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.559+0000 7fcaebfff640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fcad00663a0 0x7fcad0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:11.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.559+0000 7fcaebfff640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fcad00663a0 0x7fcad0068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcad8007fd0 tx=0x7fcad8009040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:11.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.563+0000 7fcae97fa640 1 -- 172.21.15.55:0/2104764020 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcae00ec660 con 0x7fcaec0709a0 2023-07-06T22:02:11.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.751+0000 7fcaf2f96640 1 -- 172.21.15.55:0/2104764020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcaec066d60 con 0x7fcaec0709a0 2023-07-06T22:02:11.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.759+0000 7fcae97fa640 1 -- 172.21.15.55:0/2104764020 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v67) v1 ==== 174+0+0 (secure 0 0 0) 0x7fcae00efc80 con 0x7fcaec0709a0 2023-07-06T22:02:11.760 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 20 and data pool 21 2023-07-06T22:02:11.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.767+0000 7fcaf2f96640 1 -- 172.21.15.55:0/2104764020 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fcad00663a0 msgr2=0x7fcad0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:11.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.767+0000 7fcaf2f96640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fcad00663a0 0x7fcad0068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcad8007fd0 tx=0x7fcad8009040 comp rx=0 tx=0).stop 2023-07-06T22:02:11.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.767+0000 7fcaf2f96640 1 -- 172.21.15.55:0/2104764020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaec0709a0 msgr2=0x7fcaec06c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:11.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.767+0000 7fcaf2f96640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaec0709a0 0x7fcaec06c3e0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fcae00ae040 tx=0x7fcae001aca0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.771+0000 7fcaf2f96640 1 -- 172.21.15.55:0/2104764020 shutdown_connections 2023-07-06T22:02:11.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.771+0000 7fcaf2f96640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcaec0cbe60 0x7fcaec1f7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.771+0000 7fcaf2f96640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fcad00663a0 0x7fcad0068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.771+0000 7fcaf2f96640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcaec0b1340 0x7fcaec069650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.771+0000 7fcaf2f96640 1 --2- 172.21.15.55:0/2104764020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaec0709a0 0x7fcaec06c3e0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.771+0000 7fcaf2f96640 1 -- 172.21.15.55:0/2104764020 >> 172.21.15.55:0/2104764020 conn(0x7fcaec0cea70 msgr2=0x7fcaec0b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:11.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.775+0000 7fcaf2f96640 1 -- 172.21.15.55:0/2104764020 shutdown_connections 2023-07-06T22:02:11.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.775+0000 7fcaf2f96640 1 -- 172.21.15.55:0/2104764020 wait complete. 2023-07-06T22:02:11.807 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:02:11.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.951+0000 7ff5a7f74640 1 Processor -- start 2023-07-06T22:02:11.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.951+0000 7ff5a7f74640 1 -- start start 2023-07-06T22:02:11.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.951+0000 7ff5a7f74640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5a01587d0 0x7ff5a0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:11.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.951+0000 7ff5a7f74640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a006fae0 con 0x7ff5a0158400 2023-07-06T22:02:11.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.951+0000 7ff5a7f74640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a006fdc0 con 0x7ff5a00710c0 2023-07-06T22:02:11.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.951+0000 7ff5a7f74640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a00700a0 con 0x7ff5a01587d0 2023-07-06T22:02:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.951+0000 7ff5a550f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5a01587d0 0x7ff5a0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.951+0000 7ff5a5d10640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff5a0158400 0x7ff5a00c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58806/0 (socket says 172.21.15.55:58806) 2023-07-06T22:02:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.951+0000 7ff5a5d10640 1 -- 172.21.15.55:0/1076053126 learned_addr learned my addr 172.21.15.55:0/1076053126 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:11.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.951+0000 7ff5a550f640 1 -- 172.21.15.55:0/1076053126 >> v1:172.21.15.138:6789/0 conn(0x7ff5a00710c0 legacy=0x7ff5a00cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.951+0000 7ff5a550f640 1 -- 172.21.15.55:0/1076053126 >> v1:172.21.15.55:6789/0 conn(0x7ff5a0158400 legacy=0x7ff5a00c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.951+0000 7ff5a550f640 1 -- 172.21.15.55:0/1076053126 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0070380 con 0x7ff5a01587d0 2023-07-06T22:02:11.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.951+0000 7ff5a4d0e640 1 -- 172.21.15.55:0/1076053126 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880035252 0 0) 0x7ff5a006fae0 con 0x7ff5a0158400 2023-07-06T22:02:11.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.955+0000 7ff5a550f640 1 --2- 172.21.15.55:0/1076053126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a01587d0 0x7ff5a0070b80 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7ff5900097c0 tx=0x7ff59001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df5555a33985c0b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.955+0000 7ff5a4d0e640 1 -- 172.21.15.55:0/1076053126 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5900ab600 con 0x7ff5a01587d0 2023-07-06T22:02:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.955+0000 7ff5a4d0e640 1 -- 172.21.15.55:0/1076053126 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5900a7050 con 0x7ff5a01587d0 2023-07-06T22:02:11.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.955+0000 7ff5a4d0e640 1 -- 172.21.15.55:0/1076053126 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5900ab980 con 0x7ff5a01587d0 2023-07-06T22:02:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.955+0000 7ff5a7f74640 1 -- 172.21.15.55:0/1076053126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a01587d0 msgr2=0x7ff5a0070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.955+0000 7ff5a7f74640 1 --2- 172.21.15.55:0/1076053126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a01587d0 0x7ff5a0070b80 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7ff5900097c0 tx=0x7ff59001c410 comp rx=0 tx=0).stop 2023-07-06T22:02:11.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.955+0000 7ff5a7f74640 1 -- 172.21.15.55:0/1076053126 shutdown_connections 2023-07-06T22:02:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.955+0000 7ff5a7f74640 1 --2- 172.21.15.55:0/1076053126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a01587d0 0x7ff5a0070b80 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.955+0000 7ff5a7f74640 1 -- 172.21.15.55:0/1076053126 >> 172.21.15.55:0/1076053126 conn(0x7ff5a00cded0 msgr2=0x7ff5a00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.955+0000 7ff5a7f74640 1 -- 172.21.15.55:0/1076053126 shutdown_connections 2023-07-06T22:02:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.955+0000 7ff5a7f74640 1 -- 172.21.15.55:0/1076053126 wait complete. 2023-07-06T22:02:11.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a7f74640 1 Processor -- start 2023-07-06T22:02:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a7f74640 1 -- start start 2023-07-06T22:02:11.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a7f74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5a00710c0 0x7ff5a00b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a7f74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0158400 0x7ff5a00b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a7f74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5a01587d0 0x7ff5a00c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a7f74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00b3b20 con 0x7ff5a0158400 2023-07-06T22:02:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a7f74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00b1730 con 0x7ff5a00710c0 2023-07-06T22:02:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a7f74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00b1a10 con 0x7ff5a01587d0 2023-07-06T22:02:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a550f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0158400 0x7ff5a00b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a550f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0158400 0x7ff5a00b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51852/0 (socket says 172.21.15.55:51852) 2023-07-06T22:02:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a550f640 1 -- 172.21.15.55:0/2463879929 learned_addr learned my addr 172.21.15.55:0/2463879929 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a5d10640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5a00710c0 0x7ff5a00b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a6511640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5a01587d0 0x7ff5a00c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a550f640 1 -- 172.21.15.55:0/2463879929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5a01587d0 msgr2=0x7ff5a00c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a550f640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5a01587d0 0x7ff5a00c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a550f640 1 -- 172.21.15.55:0/2463879929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5a00710c0 msgr2=0x7ff5a00b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a550f640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5a00710c0 0x7ff5a00b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a550f640 1 -- 172.21.15.55:0/2463879929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590009420 con 0x7ff5a0158400 2023-07-06T22:02:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a6511640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5a01587d0 0x7ff5a00c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a550f640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0158400 0x7ff5a00b2950 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7ff590000c10 tx=0x7ff59001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5967fc640 1 -- 172.21.15.55:0/2463879929 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590004220 con 0x7ff5a0158400 2023-07-06T22:02:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5967fc640 1 -- 172.21.15.55:0/2463879929 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff590004380 con 0x7ff5a0158400 2023-07-06T22:02:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a7f74640 1 -- 172.21.15.55:0/2463879929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a00b1cf0 con 0x7ff5a0158400 2023-07-06T22:02:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5967fc640 1 -- 172.21.15.55:0/2463879929 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590003840 con 0x7ff5a0158400 2023-07-06T22:02:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.959+0000 7ff5a7f74640 1 -- 172.21.15.55:0/2463879929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a014a440 con 0x7ff5a0158400 2023-07-06T22:02:11.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.963+0000 7ff5a7f74640 1 -- 172.21.15.55:0/2463879929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a006c580 con 0x7ff5a0158400 2023-07-06T22:02:11.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.963+0000 7ff5967fc640 1 -- 172.21.15.55:0/2463879929 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff5900039a0 con 0x7ff5a0158400 2023-07-06T22:02:11.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.963+0000 7ff5967fc640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff5840663a0 0x7ff584068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:11.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.963+0000 7ff5967fc640 1 -- 172.21.15.55:0/2463879929 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff59011e6b0 con 0x7ff5a0158400 2023-07-06T22:02:11.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.963+0000 7ff5a5d10640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff5840663a0 0x7ff584068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:11.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.963+0000 7ff5a5d10640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff5840663a0 0x7ff584068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff59c007fd0 tx=0x7ff59c007d60 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:11.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:11.967+0000 7ff5967fc640 1 -- 172.21.15.55:0/2463879929 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5900eb730 con 0x7ff5a0158400 2023-07-06T22:02:12.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.127+0000 7ff5a7f74640 1 -- 172.21.15.55:0/2463879929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5a0066d60 con 0x7ff5a0158400 2023-07-06T22:02:12.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.127+0000 7ff5967fc640 1 -- 172.21.15.55:0/2463879929 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+18611 (secure 0 0 0) 0x7ff5900c3090 con 0x7ff5a0158400 2023-07-06T22:02:12.126 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:12.126 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":159,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:02:11.753733+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:02:09.638482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-07-06T22:02:10.753761+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:02:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.127+0000 7ff5a7f74640 1 -- 172.21.15.55:0/2463879929 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff5840663a0 msgr2=0x7ff584068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.127+0000 7ff5a7f74640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff5840663a0 0x7ff584068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff59c007fd0 tx=0x7ff59c007d60 comp rx=0 tx=0).stop 2023-07-06T22:02:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.127+0000 7ff5a7f74640 1 -- 172.21.15.55:0/2463879929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0158400 msgr2=0x7ff5a00b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:12.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.127+0000 7ff5a7f74640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0158400 0x7ff5a00b2950 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7ff590000c10 tx=0x7ff59001ac50 comp rx=0 tx=0).stop 2023-07-06T22:02:12.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.127+0000 7ff5a7f74640 1 -- 172.21.15.55:0/2463879929 shutdown_connections 2023-07-06T22:02:12.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.127+0000 7ff5a7f74640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5a01587d0 0x7ff5a00c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.127+0000 7ff5a7f74640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0158400 0x7ff5a00b2950 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.127+0000 7ff5a7f74640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7ff5840663a0 0x7ff584068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.127+0000 7ff5a7f74640 1 --2- 172.21.15.55:0/2463879929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5a00710c0 0x7ff5a00b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.127+0000 7ff5a7f74640 1 -- 172.21.15.55:0/2463879929 >> 172.21.15.55:0/2463879929 conn(0x7ff5a00cded0 msgr2=0x7ff5a00ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:12.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.131+0000 7ff5a7f74640 1 -- 172.21.15.55:0/2463879929 shutdown_connections 2023-07-06T22:02:12.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.131+0000 7ff5a7f74640 1 -- 172.21.15.55:0/2463879929 wait complete. 2023-07-06T22:02:12.148 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:02:12.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.299+0000 7f9021a48640 1 Processor -- start 2023-07-06T22:02:12.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.299+0000 7f9021a48640 1 -- start start 2023-07-06T22:02:12.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f9021a48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901c0712f0 0x7f901c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:12.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f9021a48640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f901c0ca450 0x7f901c15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:12.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f9021a48640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901c159cd0 con 0x7f901c0b3730 2023-07-06T22:02:12.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f9021a48640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f901c0693f0 con 0x7f901c0ca450 2023-07-06T22:02:12.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f9021a48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c06aca0 con 0x7f901c0712f0 2023-07-06T22:02:12.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f901affd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901c0712f0 0x7f901c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:12.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f901b7fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f901c0ca450 0x7f901c15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:12.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f901affd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901c0712f0 0x7f901c06a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:46472/0 (socket says 172.21.15.55:46472) 2023-07-06T22:02:12.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f9013fff640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f901c0b3730 0x7f901c0c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:46274/0 (socket says 172.21.15.55:46274) 2023-07-06T22:02:12.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f901affd640 1 -- 172.21.15.55:0/4276934952 learned_addr learned my addr 172.21.15.55:0/4276934952 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:12.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f901affd640 1 -- 172.21.15.55:0/4276934952 >> v2:172.21.15.138:3300/0 conn(0x7f901c0ca450 msgr2=0x7f901c15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:12.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f901a7fc640 1 -- 172.21.15.55:0/4276934952 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358574001 0 0) 0x7f901c159cd0 con 0x7f901c0b3730 2023-07-06T22:02:12.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f901affd640 1 --2- 172.21.15.55:0/4276934952 >> v2:172.21.15.138:3300/0 conn(0x7f901c0ca450 0x7f901c15d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f901affd640 1 -- 172.21.15.55:0/4276934952 >> v1:172.21.15.138:6789/0 conn(0x7f901c0b3730 legacy=0x7f901c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:12.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.303+0000 7f901affd640 1 -- 172.21.15.55:0/4276934952 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c0696b0 con 0x7f901c0712f0 2023-07-06T22:02:12.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.307+0000 7f901affd640 1 --2- 172.21.15.55:0/4276934952 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901c0712f0 0x7f901c06a610 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f900c009870 tx=0x7f900c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6f39475e764048d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:12.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.307+0000 7f901a7fc640 1 -- 172.21.15.55:0/4276934952 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c0aa670 con 0x7f901c0712f0 2023-07-06T22:02:12.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.307+0000 7f901a7fc640 1 -- 172.21.15.55:0/4276934952 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c0aa7d0 con 0x7f901c0712f0 2023-07-06T22:02:12.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.307+0000 7f901a7fc640 1 -- 172.21.15.55:0/4276934952 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c0aab60 con 0x7f901c0712f0 2023-07-06T22:02:12.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.307+0000 7f9021a48640 1 -- 172.21.15.55:0/4276934952 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901c0712f0 msgr2=0x7f901c06a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:12.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.307+0000 7f9021a48640 1 --2- 172.21.15.55:0/4276934952 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901c0712f0 0x7f901c06a610 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f900c009870 tx=0x7f900c01c510 comp rx=0 tx=0).stop 2023-07-06T22:02:12.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.307+0000 7f9021a48640 1 -- 172.21.15.55:0/4276934952 shutdown_connections 2023-07-06T22:02:12.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.307+0000 7f9021a48640 1 --2- 172.21.15.55:0/4276934952 >> v2:172.21.15.138:3300/0 conn(0x7f901c0ca450 0x7f901c15d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.307+0000 7f9021a48640 1 --2- 172.21.15.55:0/4276934952 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901c0712f0 0x7f901c06a610 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.307+0000 7f9021a48640 1 -- 172.21.15.55:0/4276934952 >> 172.21.15.55:0/4276934952 conn(0x7f901c0cded0 msgr2=0x7f901c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:12.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.307+0000 7f9021a48640 1 -- 172.21.15.55:0/4276934952 shutdown_connections 2023-07-06T22:02:12.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.307+0000 7f9021a48640 1 -- 172.21.15.55:0/4276934952 wait complete. 2023-07-06T22:02:12.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.307+0000 7f9021a48640 1 Processor -- start 2023-07-06T22:02:12.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.307+0000 7f9021a48640 1 -- start start 2023-07-06T22:02:12.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f9021a48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901c0712f0 0x7f901c151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:12.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f9021a48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f901c0b3730 0x7f901c0c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:12.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f9021a48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f901c0ca450 0x7f901c1587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:12.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f9021a48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c152490 con 0x7f901c0ca450 2023-07-06T22:02:12.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f9021a48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c1f3ee0 con 0x7f901c0b3730 2023-07-06T22:02:12.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f9021a48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c157340 con 0x7f901c0712f0 2023-07-06T22:02:12.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f901b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f901c0ca450 0x7f901c1587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:12.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f901b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f901c0ca450 0x7f901c1587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51856/0 (socket says 172.21.15.55:51856) 2023-07-06T22:02:12.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f901b7fe640 1 -- 172.21.15.55:0/2938437081 learned_addr learned my addr 172.21.15.55:0/2938437081 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:12.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f901affd640 1 --2- 172.21.15.55:0/2938437081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901c0712f0 0x7f901c151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:12.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f9013fff640 1 --2- 172.21.15.55:0/2938437081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f901c0b3730 0x7f901c0c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:12.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f901b7fe640 1 -- 172.21.15.55:0/2938437081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901c0712f0 msgr2=0x7f901c151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:12.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f901b7fe640 1 --2- 172.21.15.55:0/2938437081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901c0712f0 0x7f901c151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f901b7fe640 1 -- 172.21.15.55:0/2938437081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f901c0b3730 msgr2=0x7f901c0c31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:12.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f901b7fe640 1 --2- 172.21.15.55:0/2938437081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f901c0b3730 0x7f901c0c31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f901b7fe640 1 -- 172.21.15.55:0/2938437081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c0094d0 con 0x7f901c0ca450 2023-07-06T22:02:12.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f901b7fe640 1 --2- 172.21.15.55:0/2938437081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f901c0ca450 0x7f901c1587f0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f901400ef90 tx=0x7f901400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:12.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f9018ff9640 1 -- 172.21.15.55:0/2938437081 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9014009ca0 con 0x7f901c0ca450 2023-07-06T22:02:12.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f9018ff9640 1 -- 172.21.15.55:0/2938437081 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901400f040 con 0x7f901c0ca450 2023-07-06T22:02:12.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f9018ff9640 1 -- 172.21.15.55:0/2938437081 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90140146c0 con 0x7f901c0ca450 2023-07-06T22:02:12.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f9021a48640 1 -- 172.21.15.55:0/2938437081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901c157620 con 0x7f901c0ca450 2023-07-06T22:02:12.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f9021a48640 1 -- 172.21.15.55:0/2938437081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901c157be0 con 0x7f901c0ca450 2023-07-06T22:02:12.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.311+0000 7f9021a48640 1 -- 172.21.15.55:0/2938437081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901c066d60 con 0x7f901c0ca450 2023-07-06T22:02:12.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.315+0000 7f9018ff9640 1 -- 172.21.15.55:0/2938437081 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9014014820 con 0x7f901c0ca450 2023-07-06T22:02:12.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.315+0000 7f9018ff9640 1 --2- 172.21.15.55:0/2938437081 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f8ffc0663a0 0x7f8ffc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:12.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.315+0000 7f9018ff9640 1 -- 172.21.15.55:0/2938437081 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9014084f70 con 0x7f901c0ca450 2023-07-06T22:02:12.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.315+0000 7f901affd640 1 --2- 172.21.15.55:0/2938437081 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f8ffc0663a0 0x7f8ffc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:12.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.315+0000 7f901affd640 1 --2- 172.21.15.55:0/2938437081 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f8ffc0663a0 0x7f8ffc068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f900c0ae000 tx=0x7f900c0b5040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:12.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.319+0000 7f9018ff9640 1 -- 172.21.15.55:0/2938437081 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9014052080 con 0x7f901c0ca450 2023-07-06T22:02:12.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.475+0000 7f9021a48640 1 -- 172.21.15.55:0/2938437081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f901c06c380 con 0x7f901c0ca450 2023-07-06T22:02:12.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.475+0000 7f9018ff9640 1 -- 172.21.15.55:0/2938437081 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+18611 (secure 0 0 0) 0x7f9014018090 con 0x7f901c0ca450 2023-07-06T22:02:12.477 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:12.477 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":159,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:02:11.753733+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:02:09.638482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-07-06T22:02:10.753761+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:02:12.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.479+0000 7f9021a48640 1 -- 172.21.15.55:0/2938437081 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f8ffc0663a0 msgr2=0x7f8ffc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:12.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.479+0000 7f9021a48640 1 --2- 172.21.15.55:0/2938437081 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f8ffc0663a0 0x7f8ffc068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f900c0ae000 tx=0x7f900c0b5040 comp rx=0 tx=0).stop 2023-07-06T22:02:12.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.479+0000 7f9021a48640 1 -- 172.21.15.55:0/2938437081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f901c0ca450 msgr2=0x7f901c1587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:12.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.479+0000 7f9021a48640 1 --2- 172.21.15.55:0/2938437081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f901c0ca450 0x7f901c1587f0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f901400ef90 tx=0x7f901400c490 comp rx=0 tx=0).stop 2023-07-06T22:02:12.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.479+0000 7f9021a48640 1 -- 172.21.15.55:0/2938437081 shutdown_connections 2023-07-06T22:02:12.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.479+0000 7f9021a48640 1 --2- 172.21.15.55:0/2938437081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f901c0ca450 0x7f901c1587f0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.479+0000 7f9021a48640 1 --2- 172.21.15.55:0/2938437081 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f8ffc0663a0 0x7f8ffc068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.479+0000 7f9021a48640 1 --2- 172.21.15.55:0/2938437081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f901c0b3730 0x7f901c0c31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.479+0000 7f9021a48640 1 --2- 172.21.15.55:0/2938437081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901c0712f0 0x7f901c151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.479+0000 7f9021a48640 1 -- 172.21.15.55:0/2938437081 >> 172.21.15.55:0/2938437081 conn(0x7f901c0cded0 msgr2=0x7f901c0ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:12.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.479+0000 7f9021a48640 1 -- 172.21.15.55:0/2938437081 shutdown_connections 2023-07-06T22:02:12.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.479+0000 7f9021a48640 1 -- 172.21.15.55:0/2938437081 wait complete. 2023-07-06T22:02:12.498 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T22:02:12.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.643+0000 7f30dd92c640 1 Processor -- start 2023-07-06T22:02:12.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.643+0000 7f30dd92c640 1 -- start start 2023-07-06T22:02:12.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30dd92c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f30d8156180 0x7f30d80ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:12.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30dd92c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f30d806e9d0 0x7f30d806ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:12.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30dd92c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d815f5d0 con 0x7f30d80cb7a0 2023-07-06T22:02:12.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30dd92c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d8160250 con 0x7f30d8156180 2023-07-06T22:02:12.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30dd92c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d806f390 con 0x7f30d806e9d0 2023-07-06T22:02:12.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30d6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f30d8156180 0x7f30d80ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:12.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30d77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f30d80cb7a0 0x7f30d80cbbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58812/0 (socket says 172.21.15.55:58812) 2023-07-06T22:02:12.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30d77fe640 1 -- 172.21.15.55:0/1824954399 learned_addr learned my addr 172.21.15.55:0/1824954399 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:12.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30d67fc640 1 --2- 172.21.15.55:0/1824954399 >> v2:172.21.15.138:3300/0 conn(0x7f30d806e9d0 0x7f30d806ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:12.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30d5ffb640 1 -- 172.21.15.55:0/1824954399 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434899507 0 0) 0x7f30d815f5d0 con 0x7f30d80cb7a0 2023-07-06T22:02:12.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30d5ffb640 1 -- 172.21.15.55:0/1824954399 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30c0003530 con 0x7f30d80cb7a0 2023-07-06T22:02:12.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30d6ffd640 1 -- 172.21.15.55:0/1824954399 >> v2:172.21.15.138:3300/0 conn(0x7f30d806e9d0 msgr2=0x7f30d806ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:12.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30d6ffd640 1 --2- 172.21.15.55:0/1824954399 >> v2:172.21.15.138:3300/0 conn(0x7f30d806e9d0 0x7f30d806ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30d6ffd640 1 -- 172.21.15.55:0/1824954399 >> v1:172.21.15.55:6789/0 conn(0x7f30d80cb7a0 legacy=0x7f30d80cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:12.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30d6ffd640 1 -- 172.21.15.55:0/1824954399 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d815f8b0 con 0x7f30d8156180 2023-07-06T22:02:12.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.647+0000 7f30d67fc640 1 --2- 172.21.15.55:0/1824954399 >> v2:172.21.15.138:3300/0 conn(0x7f30d806e9d0 0x7f30d806ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:12.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.651+0000 7f30d6ffd640 1 --2- 172.21.15.55:0/1824954399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30d8156180 0x7f30d80ca610 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f30d80cef40 tx=0x7f30c801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e9ba3cb1e085e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:12.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.651+0000 7f30d5ffb640 1 -- 172.21.15.55:0/1824954399 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c80ac600 con 0x7f30d8156180 2023-07-06T22:02:12.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.651+0000 7f30d5ffb640 1 -- 172.21.15.55:0/1824954399 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c80a8050 con 0x7f30d8156180 2023-07-06T22:02:12.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.651+0000 7f30d5ffb640 1 -- 172.21.15.55:0/1824954399 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c80ac980 con 0x7f30d8156180 2023-07-06T22:02:12.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.651+0000 7f30dd92c640 1 -- 172.21.15.55:0/1824954399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30d8156180 msgr2=0x7f30d80ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:12.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.651+0000 7f30dd92c640 1 --2- 172.21.15.55:0/1824954399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30d8156180 0x7f30d80ca610 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f30d80cef40 tx=0x7f30c801c3a0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.651+0000 7f30dd92c640 1 -- 172.21.15.55:0/1824954399 shutdown_connections 2023-07-06T22:02:12.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.651+0000 7f30dd92c640 1 --2- 172.21.15.55:0/1824954399 >> v2:172.21.15.138:3300/0 conn(0x7f30d806e9d0 0x7f30d806ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.651+0000 7f30dd92c640 1 --2- 172.21.15.55:0/1824954399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30d8156180 0x7f30d80ca610 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.651+0000 7f30dd92c640 1 -- 172.21.15.55:0/1824954399 >> 172.21.15.55:0/1824954399 conn(0x7f30d80d0c50 msgr2=0x7f30d80cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:12.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.651+0000 7f30dd92c640 1 -- 172.21.15.55:0/1824954399 shutdown_connections 2023-07-06T22:02:12.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.651+0000 7f30dd92c640 1 -- 172.21.15.55:0/1824954399 wait complete. 2023-07-06T22:02:12.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.651+0000 7f30dd92c640 1 Processor -- start 2023-07-06T22:02:12.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.651+0000 7f30dd92c640 1 -- start start 2023-07-06T22:02:12.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30dd92c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30d806e9d0 0x7f30d80c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:12.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30dd92c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30d80cb7a0 0x7f30d80c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:12.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30dd92c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30d8156180 0x7f30d80c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:12.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30dd92c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d80b0fe0 con 0x7f30d80cb7a0 2023-07-06T22:02:12.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30dd92c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d80c80f0 con 0x7f30d8156180 2023-07-06T22:02:12.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30dd92c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d80b06d0 con 0x7f30d806e9d0 2023-07-06T22:02:12.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30d67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30d80cb7a0 0x7f30d80c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:12.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30d67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30d80cb7a0 0x7f30d80c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51884/0 (socket says 172.21.15.55:51884) 2023-07-06T22:02:12.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30d67fc640 1 -- 172.21.15.55:0/2061828878 learned_addr learned my addr 172.21.15.55:0/2061828878 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:12.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30d67fc640 1 -- 172.21.15.55:0/2061828878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30d806e9d0 msgr2=0x7f30d80c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:12.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30d67fc640 1 --2- 172.21.15.55:0/2061828878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30d806e9d0 0x7f30d80c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30d67fc640 1 -- 172.21.15.55:0/2061828878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30d8156180 msgr2=0x7f30d80c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:12.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30d67fc640 1 --2- 172.21.15.55:0/2061828878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30d8156180 0x7f30d80c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:12.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30d67fc640 1 -- 172.21.15.55:0/2061828878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c8009420 con 0x7f30d80cb7a0 2023-07-06T22:02:12.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30d67fc640 1 --2- 172.21.15.55:0/2061828878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30d80cb7a0 0x7f30d80c6510 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00e810 tx=0x7f30cc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:12.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30bffff640 1 -- 172.21.15.55:0/2061828878 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc00c8d0 con 0x7f30d80cb7a0 2023-07-06T22:02:12.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30bffff640 1 -- 172.21.15.55:0/2061828878 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30cc00ca30 con 0x7f30d80cb7a0 2023-07-06T22:02:12.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30dd92c640 1 -- 172.21.15.55:0/2061828878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d80c9f00 con 0x7f30d80cb7a0 2023-07-06T22:02:12.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30bffff640 1 -- 172.21.15.55:0/2061828878 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc00cdc0 con 0x7f30d80cb7a0 2023-07-06T22:02:12.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30dd92c640 1 -- 172.21.15.55:0/2061828878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d80b0c00 con 0x7f30d80cb7a0 2023-07-06T22:02:12.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30dd92c640 1 -- 172.21.15.55:0/2061828878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d8066d60 con 0x7f30d80cb7a0 2023-07-06T22:02:12.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.655+0000 7f30bffff640 1 -- 172.21.15.55:0/2061828878 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f30cc013410 con 0x7f30d80cb7a0 2023-07-06T22:02:12.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.659+0000 7f30bffff640 1 --2- 172.21.15.55:0/2061828878 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f30c40663a0 0x7f30c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:12.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.659+0000 7f30bffff640 1 -- 172.21.15.55:0/2061828878 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f30cc083f10 con 0x7f30d80cb7a0 2023-07-06T22:02:12.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.659+0000 7f30d6ffd640 1 --2- 172.21.15.55:0/2061828878 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f30c40663a0 0x7f30c4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:12.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.659+0000 7f30d6ffd640 1 --2- 172.21.15.55:0/2061828878 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f30c40663a0 0x7f30c4068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f30c80ae000 tx=0x7f30c8008040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:12.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.663+0000 7f30bffff640 1 -- 172.21.15.55:0/2061828878 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30cc051000 con 0x7f30d80cb7a0 2023-07-06T22:02:12.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:12.855+0000 7f30dd92c640 1 -- 172.21.15.55:0/2061828878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f30d80cc2a0 con 0x7f30d80cb7a0 2023-07-06T22:02:13.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.779+0000 7f30bffff640 1 -- 172.21.15.55:0/2061828878 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v70) v1 ==== 118+0+0 (secure 0 0 0) 0x7f30cc054620 con 0x7f30d80cb7a0 2023-07-06T22:02:13.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.783+0000 7f30dd92c640 1 -- 172.21.15.55:0/2061828878 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f30c40663a0 msgr2=0x7f30c4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:13.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.783+0000 7f30dd92c640 1 --2- 172.21.15.55:0/2061828878 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f30c40663a0 0x7f30c4068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f30c80ae000 tx=0x7f30c8008040 comp rx=0 tx=0).stop 2023-07-06T22:02:13.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.783+0000 7f30dd92c640 1 -- 172.21.15.55:0/2061828878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30d80cb7a0 msgr2=0x7f30d80c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:13.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.783+0000 7f30dd92c640 1 --2- 172.21.15.55:0/2061828878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30d80cb7a0 0x7f30d80c6510 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00e810 tx=0x7f30cc00ecd0 comp rx=0 tx=0).stop 2023-07-06T22:02:13.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.783+0000 7f30dd92c640 1 -- 172.21.15.55:0/2061828878 shutdown_connections 2023-07-06T22:02:13.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.783+0000 7f30dd92c640 1 --2- 172.21.15.55:0/2061828878 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f30c40663a0 0x7f30c4068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:13.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.783+0000 7f30dd92c640 1 --2- 172.21.15.55:0/2061828878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30d8156180 0x7f30d80c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:13.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.783+0000 7f30dd92c640 1 --2- 172.21.15.55:0/2061828878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30d80cb7a0 0x7f30d80c6510 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:13.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.783+0000 7f30dd92c640 1 --2- 172.21.15.55:0/2061828878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30d806e9d0 0x7f30d80c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:13.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.783+0000 7f30dd92c640 1 -- 172.21.15.55:0/2061828878 >> 172.21.15.55:0/2061828878 conn(0x7f30d80d0c50 msgr2=0x7f30d81554c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:13.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.783+0000 7f30dd92c640 1 -- 172.21.15.55:0/2061828878 shutdown_connections 2023-07-06T22:02:13.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.783+0000 7f30dd92c640 1 -- 172.21.15.55:0/2061828878 wait complete. 2023-07-06T22:02:13.805 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-06T22:02:13.805 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T22:02:13.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92c9737640 1 Processor -- start 2023-07-06T22:02:13.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92c9737640 1 -- start start 2023-07-06T22:02:13.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92c9737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c4070d70 0x7f92c40b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:13.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92c9737640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92c40b1170 0x7f92c406eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:13.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92c9737640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c40cc030 con 0x7f92c40709a0 2023-07-06T22:02:13.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92c9737640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c40b15f0 con 0x7f92c40b1170 2023-07-06T22:02:13.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92c9737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40cc300 con 0x7f92c4070d70 2023-07-06T22:02:13.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92c37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92c40b1170 0x7f92c406eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:13.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92c37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92c40b1170 0x7f92c406eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43982/0 (socket says 172.21.15.55:43982) 2023-07-06T22:02:13.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92c37fe640 1 -- 172.21.15.55:0/321326435 learned_addr learned my addr 172.21.15.55:0/321326435 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:13.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92bbfff640 1 --2- 172.21.15.55:0/321326435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c4070d70 0x7f92c40b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:13.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92c37fe640 1 -- 172.21.15.55:0/321326435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c4070d70 msgr2=0x7f92c40b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:13.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92c37fe640 1 --2- 172.21.15.55:0/321326435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c4070d70 0x7f92c40b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:13.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92c37fe640 1 -- 172.21.15.55:0/321326435 >> v1:172.21.15.138:6789/0 conn(0x7f92c40709a0 legacy=0x7f92c40cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:13.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92c37fe640 1 -- 172.21.15.55:0/321326435 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c40cc5e0 con 0x7f92c40b1170 2023-07-06T22:02:13.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.959+0000 7f92bbfff640 1 --2- 172.21.15.55:0/321326435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c4070d70 0x7f92c40b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:13.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.963+0000 7f92c37fe640 1 --2- 172.21.15.55:0/321326435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40b1170 0x7f92c406eee0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009e80 tx=0x7f92bc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324fc2bedbb6bf1e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:13.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.963+0000 7f92c27fc640 1 -- 172.21.15.55:0/321326435 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0a5690 con 0x7f92c40b1170 2023-07-06T22:02:13.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.963+0000 7f92c27fc640 1 -- 172.21.15.55:0/321326435 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc0a57f0 con 0x7f92c40b1170 2023-07-06T22:02:13.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.963+0000 7f92c27fc640 1 -- 172.21.15.55:0/321326435 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0a5b80 con 0x7f92c40b1170 2023-07-06T22:02:13.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.963+0000 7f92c9737640 1 -- 172.21.15.55:0/321326435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40b1170 msgr2=0x7f92c406eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.963+0000 7f92c9737640 1 --2- 172.21.15.55:0/321326435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40b1170 0x7f92c406eee0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009e80 tx=0x7f92bc01c920 comp rx=0 tx=0).stop 2023-07-06T22:02:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.963+0000 7f92c9737640 1 -- 172.21.15.55:0/321326435 shutdown_connections 2023-07-06T22:02:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.963+0000 7f92c9737640 1 --2- 172.21.15.55:0/321326435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40b1170 0x7f92c406eee0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.963+0000 7f92c9737640 1 --2- 172.21.15.55:0/321326435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c4070d70 0x7f92c40b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.963+0000 7f92c9737640 1 -- 172.21.15.55:0/321326435 >> 172.21.15.55:0/321326435 conn(0x7f92c40cea70 msgr2=0x7f92c40ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.963+0000 7f92c9737640 1 -- 172.21.15.55:0/321326435 shutdown_connections 2023-07-06T22:02:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.963+0000 7f92c9737640 1 -- 172.21.15.55:0/321326435 wait complete. 2023-07-06T22:02:13.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.963+0000 7f92c9737640 1 Processor -- start 2023-07-06T22:02:13.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.963+0000 7f92c9737640 1 -- start start 2023-07-06T22:02:13.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c9737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c40709a0 0x7f92c4146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:13.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c9737640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c4070d70 0x7f92c415ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:13.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c9737640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40b1170 0x7f92c406a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:13.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c9737640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4144280 con 0x7f92c40b1170 2023-07-06T22:02:13.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c9737640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c415b350 con 0x7f92c4070d70 2023-07-06T22:02:13.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c9737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c406a640 con 0x7f92c40709a0 2023-07-06T22:02:13.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40b1170 0x7f92c406a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:13.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40b1170 0x7f92c406a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43984/0 (socket says 172.21.15.55:43984) 2023-07-06T22:02:13.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c37fe640 1 -- 172.21.15.55:0/2488330421 learned_addr learned my addr 172.21.15.55:0/2488330421 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92bbfff640 1 --2- 172.21.15.55:0/2488330421 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c4070d70 0x7f92c415ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/2488330421 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c40709a0 0x7f92c4146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c37fe640 1 -- 172.21.15.55:0/2488330421 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c40709a0 msgr2=0x7f92c4146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c37fe640 1 --2- 172.21.15.55:0/2488330421 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c40709a0 0x7f92c4146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c37fe640 1 -- 172.21.15.55:0/2488330421 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c4070d70 msgr2=0x7f92c415ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c37fe640 1 --2- 172.21.15.55:0/2488330421 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c4070d70 0x7f92c415ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c37fe640 1 -- 172.21.15.55:0/2488330421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc009b30 con 0x7f92c40b1170 2023-07-06T22:02:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c37fe640 1 --2- 172.21.15.55:0/2488330421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40b1170 0x7f92c406a100 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f92bc01afd0 tx=0x7f92bc0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92bb7fe640 1 -- 172.21.15.55:0/2488330421 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0b8670 con 0x7f92c40b1170 2023-07-06T22:02:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92bb7fe640 1 -- 172.21.15.55:0/2488330421 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc0b87d0 con 0x7f92c40b1170 2023-07-06T22:02:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c9737640 1 -- 172.21.15.55:0/2488330421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c415b5a0 con 0x7f92c40b1170 2023-07-06T22:02:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92bb7fe640 1 -- 172.21.15.55:0/2488330421 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0b8b80 con 0x7f92c40b1170 2023-07-06T22:02:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c9737640 1 -- 172.21.15.55:0/2488330421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c406aa00 con 0x7f92c40b1170 2023-07-06T22:02:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.967+0000 7f92c9737640 1 -- 172.21.15.55:0/2488330421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c406a860 con 0x7f92c40b1170 2023-07-06T22:02:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.971+0000 7f92bb7fe640 1 -- 172.21.15.55:0/2488330421 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f92bc0b8ce0 con 0x7f92c40b1170 2023-07-06T22:02:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.971+0000 7f92bb7fe640 1 --2- 172.21.15.55:0/2488330421 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f92a40663a0 0x7f92a4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.971+0000 7f92bb7fe640 1 -- 172.21.15.55:0/2488330421 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f92bc11f440 con 0x7f92c40b1170 2023-07-06T22:02:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.971+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/2488330421 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f92a40663a0 0x7f92a4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.971+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/2488330421 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f92a40663a0 0x7f92a4068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f92b40098e0 tx=0x7f92b4009060 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:13.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:13.975+0000 7f92bb7fe640 1 -- 172.21.15.55:0/2488330421 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92c406a860 con 0x7f92c40b1170 2023-07-06T22:02:14.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.163+0000 7f92c9737640 1 -- 172.21.15.55:0/2488330421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f92c406a860 con 0x7f92c40b1170 2023-07-06T22:02:14.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.783+0000 7f92bb7fe640 1 -- 172.21.15.55:0/2488330421 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v71) v1 ==== 122+0+0 (secure 0 0 0) 0x7f92c406a860 con 0x7f92c40b1170 2023-07-06T22:02:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.787+0000 7f92c9737640 1 -- 172.21.15.55:0/2488330421 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f92a40663a0 msgr2=0x7f92a4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.787+0000 7f92c9737640 1 --2- 172.21.15.55:0/2488330421 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f92a40663a0 0x7f92a4068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f92b40098e0 tx=0x7f92b4009060 comp rx=0 tx=0).stop 2023-07-06T22:02:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.787+0000 7f92c9737640 1 -- 172.21.15.55:0/2488330421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40b1170 msgr2=0x7f92c406a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.787+0000 7f92c9737640 1 --2- 172.21.15.55:0/2488330421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40b1170 0x7f92c406a100 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f92bc01afd0 tx=0x7f92bc0196c0 comp rx=0 tx=0).stop 2023-07-06T22:02:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.787+0000 7f92c9737640 1 -- 172.21.15.55:0/2488330421 shutdown_connections 2023-07-06T22:02:14.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.787+0000 7f92c9737640 1 --2- 172.21.15.55:0/2488330421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40b1170 0x7f92c406a100 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:14.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.787+0000 7f92c9737640 1 --2- 172.21.15.55:0/2488330421 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f92a40663a0 0x7f92a4068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:14.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.787+0000 7f92c9737640 1 --2- 172.21.15.55:0/2488330421 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c4070d70 0x7f92c415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:14.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.787+0000 7f92c9737640 1 --2- 172.21.15.55:0/2488330421 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c40709a0 0x7f92c4146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:14.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.787+0000 7f92c9737640 1 -- 172.21.15.55:0/2488330421 >> 172.21.15.55:0/2488330421 conn(0x7f92c40cea70 msgr2=0x7f92c40c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:14.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.787+0000 7f92c9737640 1 -- 172.21.15.55:0/2488330421 shutdown_connections 2023-07-06T22:02:14.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.787+0000 7f92c9737640 1 -- 172.21.15.55:0/2488330421 wait complete. 2023-07-06T22:02:14.810 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T22:02:14.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:02:14.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cf61fa640 1 Processor -- start 2023-07-06T22:02:14.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cf61fa640 1 -- start start 2023-07-06T22:02:14.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cf61fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0cf00b7cd0 0x7f0cf00ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:14.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cf61fa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0cf00ccab0 0x7f0cf00b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:14.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cf61fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf00ccf00 0x7f0cf00b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:14.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cf61fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf00d2310 con 0x7f0cf00b7cd0 2023-07-06T22:02:14.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cf61fa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf00b80a0 con 0x7f0cf00ccab0 2023-07-06T22:02:14.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cf61fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf00d1100 con 0x7f0cf00ccf00 2023-07-06T22:02:14.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cef7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0cf00b7cd0 0x7f0cf00ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:14.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cef7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0cf00b7cd0 0x7f0cf00ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43986/0 (socket says 172.21.15.55:43986) 2023-07-06T22:02:14.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cef7fe640 1 -- 172.21.15.55:0/310537119 learned_addr learned my addr 172.21.15.55:0/310537119 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:14.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0ce7fff640 1 --2- 172.21.15.55:0/310537119 >> v2:172.21.15.138:3300/0 conn(0x7f0cf00ccab0 0x7f0cf00b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:14.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0ceffff640 1 --2- 172.21.15.55:0/310537119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf00ccf00 0x7f0cf00b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:14.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cef7fe640 1 -- 172.21.15.55:0/310537119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf00ccf00 msgr2=0x7f0cf00b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:14.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cef7fe640 1 --2- 172.21.15.55:0/310537119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf00ccf00 0x7f0cf00b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:14.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cef7fe640 1 -- 172.21.15.55:0/310537119 >> v2:172.21.15.138:3300/0 conn(0x7f0cf00ccab0 msgr2=0x7f0cf00b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:14.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cef7fe640 1 --2- 172.21.15.55:0/310537119 >> v2:172.21.15.138:3300/0 conn(0x7f0cf00ccab0 0x7f0cf00b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:14.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.959+0000 7f0cef7fe640 1 -- 172.21.15.55:0/310537119 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf00cecf0 con 0x7f0cf00b7cd0 2023-07-06T22:02:14.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.963+0000 7f0cef7fe640 1 --2- 172.21.15.55:0/310537119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00b7cd0 0x7f0cf00ce610 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0065af0 tx=0x7f0ce001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b37983e30fc1644 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:14.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.963+0000 7f0ceeffd640 1 -- 172.21.15.55:0/310537119 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00ab600 con 0x7f0cf00b7cd0 2023-07-06T22:02:14.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.963+0000 7f0ceeffd640 1 -- 172.21.15.55:0/310537119 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce00a7050 con 0x7f0cf00b7cd0 2023-07-06T22:02:14.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.963+0000 7f0ceeffd640 1 -- 172.21.15.55:0/310537119 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00ab980 con 0x7f0cf00b7cd0 2023-07-06T22:02:14.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.963+0000 7f0cf61fa640 1 -- 172.21.15.55:0/310537119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00b7cd0 msgr2=0x7f0cf00ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:14.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.963+0000 7f0cf61fa640 1 --2- 172.21.15.55:0/310537119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00b7cd0 0x7f0cf00ce610 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0065af0 tx=0x7f0ce001c470 comp rx=0 tx=0).stop 2023-07-06T22:02:14.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.963+0000 7f0cf61fa640 1 -- 172.21.15.55:0/310537119 shutdown_connections 2023-07-06T22:02:14.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.963+0000 7f0cf61fa640 1 --2- 172.21.15.55:0/310537119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf00ccf00 0x7f0cf00b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:14.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.963+0000 7f0cf61fa640 1 --2- 172.21.15.55:0/310537119 >> v2:172.21.15.138:3300/0 conn(0x7f0cf00ccab0 0x7f0cf00b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:14.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.963+0000 7f0cf61fa640 1 --2- 172.21.15.55:0/310537119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00b7cd0 0x7f0cf00ce610 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:14.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.963+0000 7f0cf61fa640 1 -- 172.21.15.55:0/310537119 >> 172.21.15.55:0/310537119 conn(0x7f0cf00ceee0 msgr2=0x7f0cf00cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:14.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.963+0000 7f0cf61fa640 1 -- 172.21.15.55:0/310537119 shutdown_connections 2023-07-06T22:02:14.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.963+0000 7f0cf61fa640 1 -- 172.21.15.55:0/310537119 wait complete. 2023-07-06T22:02:14.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0cf61fa640 1 Processor -- start 2023-07-06T22:02:14.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0cf61fa640 1 -- start start 2023-07-06T22:02:14.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0cf61fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cf00b7cd0 0x7f0cf014e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:14.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0cf61fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf00ccab0 0x7f0cf014df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:14.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0cf61fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00ccf00 0x7f0cf015d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:14.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0cf61fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf015d9e0 con 0x7f0cf00ccf00 2023-07-06T22:02:14.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0cf61fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf014d1d0 con 0x7f0cf00b7cd0 2023-07-06T22:02:14.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0cf61fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf014d4b0 con 0x7f0cf00ccab0 2023-07-06T22:02:14.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0ceffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00ccf00 0x7f0cf015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:14.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0ceffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00ccf00 0x7f0cf015d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43988/0 (socket says 172.21.15.55:43988) 2023-07-06T22:02:14.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0ceffff640 1 -- 172.21.15.55:0/2313883071 learned_addr learned my addr 172.21.15.55:0/2313883071 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:14.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0cef7fe640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cf00b7cd0 0x7f0cf014e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:14.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0ce7fff640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf00ccab0 0x7f0cf014df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0ceffff640 1 -- 172.21.15.55:0/2313883071 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf00ccab0 msgr2=0x7f0cf014df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0ceffff640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf00ccab0 0x7f0cf014df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0ceffff640 1 -- 172.21.15.55:0/2313883071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cf00b7cd0 msgr2=0x7f0cf014e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0ceffff640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cf00b7cd0 0x7f0cf014e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0ceffff640 1 -- 172.21.15.55:0/2313883071 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00094d0 con 0x7f0cf00ccf00 2023-07-06T22:02:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0ce7fff640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf00ccab0 0x7f0cf014df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0ceffff640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00ccf00 0x7f0cf015d190 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800efc0 tx=0x7f0ce800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0cecff9640 1 -- 172.21.15.55:0/2313883071 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8009b20 con 0x7f0cf00ccf00 2023-07-06T22:02:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0cecff9640 1 -- 172.21.15.55:0/2313883071 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce800f040 con 0x7f0cf00ccf00 2023-07-06T22:02:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0cecff9640 1 -- 172.21.15.55:0/2313883071 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce80146c0 con 0x7f0cf00ccf00 2023-07-06T22:02:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0cf61fa640 1 -- 172.21.15.55:0/2313883071 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf014d790 con 0x7f0cf00ccf00 2023-07-06T22:02:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.967+0000 7f0cf61fa640 1 -- 172.21.15.55:0/2313883071 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf015d6d0 con 0x7f0cf00ccf00 2023-07-06T22:02:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.971+0000 7f0cf61fa640 1 -- 172.21.15.55:0/2313883071 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf0066d60 con 0x7f0cf00ccf00 2023-07-06T22:02:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.971+0000 7f0cecff9640 1 -- 172.21.15.55:0/2313883071 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0ce8014820 con 0x7f0cf00ccf00 2023-07-06T22:02:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.971+0000 7f0cecff9640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f0cd00663a0 0x7f0cd0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.971+0000 7f0cecff9640 1 -- 172.21.15.55:0/2313883071 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0ce8084ee0 con 0x7f0cf00ccf00 2023-07-06T22:02:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.971+0000 7f0cef7fe640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f0cd00663a0 0x7f0cd0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.971+0000 7f0cef7fe640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f0cd00663a0 0x7f0cd0068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00ad000 tx=0x7f0ce00a6000 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:14.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:14.975+0000 7f0cecff9640 1 -- 172.21.15.55:0/2313883071 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ce8051f40 con 0x7f0cf00ccf00 2023-07-06T22:02:15.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.163+0000 7f0cf61fa640 1 -- 172.21.15.55:0/2313883071 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cf014dc40 con 0x7f0cf00ccf00 2023-07-06T22:02:15.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.163+0000 7f0cecff9640 1 -- 172.21.15.55:0/2313883071 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f0ce8018090 con 0x7f0cf00ccf00 2023-07-06T22:02:15.163 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:15.163 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7958,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2209436909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2209436909},{"type":"v1","addr":"172.21.15.55:6837","nonce":2209436909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1799743845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":1799743845},{"type":"v1","addr":"172.21.15.138:6835","nonce":1799743845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8992,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3922834764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3922834764},{"type":"v1","addr":"172.21.15.138:6834","nonce":3922834764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:02:11.754063+0000","modified":"2023-07-06T22:02:14.781049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9759":{"gid":9759,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/4021237791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4021237791},{"type":"v1","addr":"172.21.15.55:6836","nonce":4021237791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-06T22:02:15.163 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 71 2023-07-06T22:02:15.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.167+0000 7f0cf61fa640 1 -- 172.21.15.55:0/2313883071 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f0cd00663a0 msgr2=0x7f0cd0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:15.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.167+0000 7f0cf61fa640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f0cd00663a0 0x7f0cd0068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00ad000 tx=0x7f0ce00a6000 comp rx=0 tx=0).stop 2023-07-06T22:02:15.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.167+0000 7f0cf61fa640 1 -- 172.21.15.55:0/2313883071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00ccf00 msgr2=0x7f0cf015d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:15.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.167+0000 7f0cf61fa640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00ccf00 0x7f0cf015d190 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800efc0 tx=0x7f0ce800c490 comp rx=0 tx=0).stop 2023-07-06T22:02:15.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.167+0000 7f0cf61fa640 1 -- 172.21.15.55:0/2313883071 shutdown_connections 2023-07-06T22:02:15.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.167+0000 7f0cf61fa640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00ccf00 0x7f0cf015d190 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.167+0000 7f0cf61fa640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf00ccab0 0x7f0cf014df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.167+0000 7f0cf61fa640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f0cd00663a0 0x7f0cd0068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.167+0000 7f0cf61fa640 1 --2- 172.21.15.55:0/2313883071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cf00b7cd0 0x7f0cf014e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.167+0000 7f0cf61fa640 1 -- 172.21.15.55:0/2313883071 >> 172.21.15.55:0/2313883071 conn(0x7f0cf00ceee0 msgr2=0x7f0cf01581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.167+0000 7f0cf61fa640 1 -- 172.21.15.55:0/2313883071 shutdown_connections 2023-07-06T22:02:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.167+0000 7f0cf61fa640 1 -- 172.21.15.55:0/2313883071 wait complete. 2023-07-06T22:02:15.184 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:02:15.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47fa1fa640 1 Processor -- start 2023-07-06T22:02:15.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47fa1fa640 1 -- start start 2023-07-06T22:02:15.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47fa1fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f406f8e0 0x7f47f406fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:15.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47fa1fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47f415cc00 0x7f47f415f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:15.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47fa1fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f415c770 con 0x7f47f415bc40 2023-07-06T22:02:15.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47fa1fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f406d4f0 con 0x7f47f415cc00 2023-07-06T22:02:15.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47fa1fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40701f0 con 0x7f47f406f8e0 2023-07-06T22:02:15.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47f3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47f415cc00 0x7f47f415f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47f3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47f415cc00 0x7f47f415f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43992/0 (socket says 172.21.15.55:43992) 2023-07-06T22:02:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47f3fff640 1 -- 172.21.15.55:0/2477643033 learned_addr learned my addr 172.21.15.55:0/2477643033 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47f37fe640 1 --2- 172.21.15.55:0/2477643033 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f406f8e0 0x7f47f406fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47f3fff640 1 -- 172.21.15.55:0/2477643033 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f406f8e0 msgr2=0x7f47f406fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47f3fff640 1 --2- 172.21.15.55:0/2477643033 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f406f8e0 0x7f47f406fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47f3fff640 1 -- 172.21.15.55:0/2477643033 >> v1:172.21.15.138:6789/0 conn(0x7f47f415bc40 legacy=0x7f47f406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.327+0000 7f47f3fff640 1 -- 172.21.15.55:0/2477643033 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f406d210 con 0x7f47f415cc00 2023-07-06T22:02:15.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.331+0000 7f47f3fff640 1 --2- 172.21.15.55:0/2477643033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f415cc00 0x7f47f415f4c0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009e50 tx=0x7f47ec01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3d43a93956afaf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:15.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.331+0000 7f47f27fc640 1 -- 172.21.15.55:0/2477643033 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0a57d0 con 0x7f47f415cc00 2023-07-06T22:02:15.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.331+0000 7f47f27fc640 1 -- 172.21.15.55:0/2477643033 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec0a5930 con 0x7f47f415cc00 2023-07-06T22:02:15.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.331+0000 7f47f27fc640 1 -- 172.21.15.55:0/2477643033 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0a5cc0 con 0x7f47f415cc00 2023-07-06T22:02:15.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.331+0000 7f47fa1fa640 1 -- 172.21.15.55:0/2477643033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f415cc00 msgr2=0x7f47f415f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:15.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.331+0000 7f47fa1fa640 1 --2- 172.21.15.55:0/2477643033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f415cc00 0x7f47f415f4c0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009e50 tx=0x7f47ec01ca10 comp rx=0 tx=0).stop 2023-07-06T22:02:15.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.331+0000 7f47fa1fa640 1 -- 172.21.15.55:0/2477643033 shutdown_connections 2023-07-06T22:02:15.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.331+0000 7f47fa1fa640 1 --2- 172.21.15.55:0/2477643033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f415cc00 0x7f47f415f4c0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.331+0000 7f47fa1fa640 1 --2- 172.21.15.55:0/2477643033 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f406f8e0 0x7f47f406fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.331+0000 7f47fa1fa640 1 -- 172.21.15.55:0/2477643033 >> 172.21.15.55:0/2477643033 conn(0x7f47f40cbd80 msgr2=0x7f47f40ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:15.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.331+0000 7f47fa1fa640 1 -- 172.21.15.55:0/2477643033 shutdown_connections 2023-07-06T22:02:15.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.331+0000 7f47fa1fa640 1 -- 172.21.15.55:0/2477643033 wait complete. 2023-07-06T22:02:15.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47fa1fa640 1 Processor -- start 2023-07-06T22:02:15.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47fa1fa640 1 -- start start 2023-07-06T22:02:15.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47fa1fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f406f8e0 0x7f47f4151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:15.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47fa1fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f415bc40 0x7f47f41581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:15.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47fa1fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f415cc00 0x7f47f41586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:15.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47fa1fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f41520e0 con 0x7f47f415cc00 2023-07-06T22:02:15.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47fa1fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f41590f0 con 0x7f47f406f8e0 2023-07-06T22:02:15.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47fa1fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f41593d0 con 0x7f47f415bc40 2023-07-06T22:02:15.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47f3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f415cc00 0x7f47f41586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:15.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47f37fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f406f8e0 0x7f47f4151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:15.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47f37fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f406f8e0 0x7f47f4151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:50488/0 (socket says 172.21.15.55:50488) 2023-07-06T22:02:15.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47f37fe640 1 -- 172.21.15.55:0/3652037350 learned_addr learned my addr 172.21.15.55:0/3652037350 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:15.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47f2ffd640 1 --2- 172.21.15.55:0/3652037350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f415bc40 0x7f47f41581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:15.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47f3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f415cc00 0x7f47f41586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44006/0 (socket says 172.21.15.55:44006) 2023-07-06T22:02:15.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47f37fe640 1 -- 172.21.15.55:0/3652037350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f415bc40 msgr2=0x7f47f41581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:15.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47f37fe640 1 --2- 172.21.15.55:0/3652037350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f415bc40 0x7f47f41581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47f37fe640 1 -- 172.21.15.55:0/3652037350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f415cc00 msgr2=0x7f47f41586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:15.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47f37fe640 1 --2- 172.21.15.55:0/3652037350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f415cc00 0x7f47f41586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47f37fe640 1 -- 172.21.15.55:0/3652037350 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec009b30 con 0x7f47f406f8e0 2023-07-06T22:02:15.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47f37fe640 1 --2- 172.21.15.55:0/3652037350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f406f8e0 0x7f47f4151ba0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f47e400e930 tx=0x7f47e400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:15.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47dbfff640 1 -- 172.21.15.55:0/3652037350 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4009690 con 0x7f47f406f8e0 2023-07-06T22:02:15.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47dbfff640 1 -- 172.21.15.55:0/3652037350 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e400ca00 con 0x7f47f406f8e0 2023-07-06T22:02:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47dbfff640 1 -- 172.21.15.55:0/3652037350 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e400cd70 con 0x7f47f406f8e0 2023-07-06T22:02:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.335+0000 7f47fa1fa640 1 -- 172.21.15.55:0/3652037350 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f41596b0 con 0x7f47f406f8e0 2023-07-06T22:02:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.339+0000 7f47fa1fa640 1 -- 172.21.15.55:0/3652037350 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f4159c70 con 0x7f47f406f8e0 2023-07-06T22:02:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.339+0000 7f47fa1fa640 1 -- 172.21.15.55:0/3652037350 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f4066d60 con 0x7f47f406f8e0 2023-07-06T22:02:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.339+0000 7f47dbfff640 1 -- 172.21.15.55:0/3652037350 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f47e4013470 con 0x7f47f406f8e0 2023-07-06T22:02:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.339+0000 7f47dbfff640 1 --2- 172.21.15.55:0/3652037350 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f47e00663a0 0x7f47e0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.339+0000 7f47dbfff640 1 -- 172.21.15.55:0/3652037350 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f47e40840d0 con 0x7f47f406f8e0 2023-07-06T22:02:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.339+0000 7f47f2ffd640 1 --2- 172.21.15.55:0/3652037350 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f47e00663a0 0x7f47e0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.339+0000 7f47f2ffd640 1 --2- 172.21.15.55:0/3652037350 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f47e00663a0 0x7f47e0068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f47f40c8f50 tx=0x7f47e8009040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:15.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.343+0000 7f47dbfff640 1 -- 172.21.15.55:0/3652037350 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f47e40514e0 con 0x7f47f406f8e0 2023-07-06T22:02:15.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.499+0000 7f47fa1fa640 1 -- 172.21.15.55:0/3652037350 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47f40b0cf0 con 0x7f47f406f8e0 2023-07-06T22:02:15.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.503+0000 7f47dbfff640 1 -- 172.21.15.55:0/3652037350 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+18598 (secure 0 0 0) 0x7f47e4054b00 con 0x7f47f406f8e0 2023-07-06T22:02:15.501 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:15.502 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":160,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:02:12.757176+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:02:09.638482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-07-06T22:02:10.753761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:02:15.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.503+0000 7f47fa1fa640 1 -- 172.21.15.55:0/3652037350 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f47e00663a0 msgr2=0x7f47e0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:15.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.503+0000 7f47fa1fa640 1 --2- 172.21.15.55:0/3652037350 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f47e00663a0 0x7f47e0068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f47f40c8f50 tx=0x7f47e8009040 comp rx=0 tx=0).stop 2023-07-06T22:02:15.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.503+0000 7f47fa1fa640 1 -- 172.21.15.55:0/3652037350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f406f8e0 msgr2=0x7f47f4151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:15.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.503+0000 7f47fa1fa640 1 --2- 172.21.15.55:0/3652037350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f406f8e0 0x7f47f4151ba0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f47e400e930 tx=0x7f47e400edf0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.503+0000 7f47fa1fa640 1 -- 172.21.15.55:0/3652037350 shutdown_connections 2023-07-06T22:02:15.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.503+0000 7f47fa1fa640 1 --2- 172.21.15.55:0/3652037350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f415cc00 0x7f47f41586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.503+0000 7f47fa1fa640 1 --2- 172.21.15.55:0/3652037350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f415bc40 0x7f47f41581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.503+0000 7f47fa1fa640 1 --2- 172.21.15.55:0/3652037350 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f47e00663a0 0x7f47e0068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.503+0000 7f47fa1fa640 1 --2- 172.21.15.55:0/3652037350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f406f8e0 0x7f47f4151ba0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.503+0000 7f47fa1fa640 1 -- 172.21.15.55:0/3652037350 >> 172.21.15.55:0/3652037350 conn(0x7f47f40cbd80 msgr2=0x7f47f40ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.503+0000 7f47fa1fa640 1 -- 172.21.15.55:0/3652037350 shutdown_connections 2023-07-06T22:02:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.503+0000 7f47fa1fa640 1 -- 172.21.15.55:0/3652037350 wait complete. 2023-07-06T22:02:15.523 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T22:02:15.523 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:02:15.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.667+0000 7fe15480b640 1 Processor -- start 2023-07-06T22:02:15.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.667+0000 7fe15480b640 1 -- start start 2023-07-06T22:02:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.667+0000 7fe15480b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe1501587d0 0x7fe150070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.667+0000 7fe15480b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1500710c0 0x7fe1500cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.667+0000 7fe15480b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15006fae0 con 0x7fe150158400 2023-07-06T22:02:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.667+0000 7fe15480b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15006fdc0 con 0x7fe1501587d0 2023-07-06T22:02:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.667+0000 7fe15480b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1500700a0 con 0x7fe1500710c0 2023-07-06T22:02:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.671+0000 7fe147fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe1501587d0 0x7fe150070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.671+0000 7fe14ed9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1500710c0 0x7fe1500cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.671+0000 7fe147fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe1501587d0 0x7fe150070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:50490/0 (socket says 172.21.15.55:50490) 2023-07-06T22:02:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.671+0000 7fe14ed9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1500710c0 0x7fe1500cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:50270/0 (socket says 172.21.15.55:50270) 2023-07-06T22:02:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.671+0000 7fe147fff640 1 -- 172.21.15.55:0/3538450036 learned_addr learned my addr 172.21.15.55:0/3538450036 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.671+0000 7fe147fff640 1 -- 172.21.15.55:0/3538450036 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1500710c0 msgr2=0x7fe1500cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.671+0000 7fe147fff640 1 --2- 172.21.15.55:0/3538450036 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1500710c0 0x7fe1500cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.671+0000 7fe147fff640 1 -- 172.21.15.55:0/3538450036 >> v1:172.21.15.138:6789/0 conn(0x7fe150158400 legacy=0x7fe1500c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.671+0000 7fe147fff640 1 -- 172.21.15.55:0/3538450036 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150070380 con 0x7fe1501587d0 2023-07-06T22:02:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.671+0000 7fe14ed9d640 1 --2- 172.21.15.55:0/3538450036 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1500710c0 0x7fe1500cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:02:15.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.671+0000 7fe147fff640 1 --2- 172.21.15.55:0/3538450036 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1501587d0 0x7fe150070b80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe13800bb10 tx=0x7fe13801ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=411af65e9ddedc32 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:15.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.671+0000 7fe14dd9b640 1 -- 172.21.15.55:0/3538450036 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1380a7bc0 con 0x7fe1501587d0 2023-07-06T22:02:15.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe14dd9b640 1 -- 172.21.15.55:0/3538450036 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1380a7d20 con 0x7fe1501587d0 2023-07-06T22:02:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe14dd9b640 1 -- 172.21.15.55:0/3538450036 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1380af660 con 0x7fe1501587d0 2023-07-06T22:02:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 -- 172.21.15.55:0/3538450036 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1501587d0 msgr2=0x7fe150070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 --2- 172.21.15.55:0/3538450036 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1501587d0 0x7fe150070b80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe13800bb10 tx=0x7fe13801ebe0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 -- 172.21.15.55:0/3538450036 shutdown_connections 2023-07-06T22:02:15.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 --2- 172.21.15.55:0/3538450036 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1500710c0 0x7fe1500cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 --2- 172.21.15.55:0/3538450036 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1501587d0 0x7fe150070b80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 -- 172.21.15.55:0/3538450036 >> 172.21.15.55:0/3538450036 conn(0x7fe1500cded0 msgr2=0x7fe1500ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:15.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 -- 172.21.15.55:0/3538450036 shutdown_connections 2023-07-06T22:02:15.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 -- 172.21.15.55:0/3538450036 wait complete. 2023-07-06T22:02:15.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 Processor -- start 2023-07-06T22:02:15.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 -- start start 2023-07-06T22:02:15.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1500710c0 0x7fe1500c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:15.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe150158400 0x7fe15014f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:15.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1501587d0 0x7fe1500c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:15.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1500c7f80 con 0x7fe1501587d0 2023-07-06T22:02:15.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe150152590 con 0x7fe150158400 2023-07-06T22:02:15.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe15480b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15014b900 con 0x7fe1500710c0 2023-07-06T22:02:15.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe14ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1501587d0 0x7fe1500c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:15.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe14ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1501587d0 0x7fe1500c3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44014/0 (socket says 172.21.15.55:44014) 2023-07-06T22:02:15.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe14ed9d640 1 -- 172.21.15.55:0/3026238613 learned_addr learned my addr 172.21.15.55:0/3026238613 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:15.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe14e59c640 1 --2- 172.21.15.55:0/3026238613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1500710c0 0x7fe1500c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:15.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.675+0000 7fe147fff640 1 --2- 172.21.15.55:0/3026238613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe150158400 0x7fe15014f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:15.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.679+0000 7fe14ed9d640 1 -- 172.21.15.55:0/3026238613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1500710c0 msgr2=0x7fe1500c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:15.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.679+0000 7fe14ed9d640 1 --2- 172.21.15.55:0/3026238613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1500710c0 0x7fe1500c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.679+0000 7fe14ed9d640 1 -- 172.21.15.55:0/3026238613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe150158400 msgr2=0x7fe15014f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:15.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.679+0000 7fe14ed9d640 1 --2- 172.21.15.55:0/3026238613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe150158400 0x7fe15014f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.679+0000 7fe14ed9d640 1 -- 172.21.15.55:0/3026238613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe148009a70 con 0x7fe1501587d0 2023-07-06T22:02:15.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.679+0000 7fe14ed9d640 1 --2- 172.21.15.55:0/3026238613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1501587d0 0x7fe1500c3ee0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fe14800efc0 tx=0x7fe148009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:15.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.679+0000 7fe146ffd640 1 -- 172.21.15.55:0/3026238613 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148009d70 con 0x7fe1501587d0 2023-07-06T22:02:15.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.679+0000 7fe146ffd640 1 -- 172.21.15.55:0/3026238613 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14800f040 con 0x7fe1501587d0 2023-07-06T22:02:15.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.679+0000 7fe15480b640 1 -- 172.21.15.55:0/3026238613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13800b770 con 0x7fe1501587d0 2023-07-06T22:02:15.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.679+0000 7fe146ffd640 1 -- 172.21.15.55:0/3026238613 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1480039a0 con 0x7fe1501587d0 2023-07-06T22:02:15.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.679+0000 7fe15480b640 1 -- 172.21.15.55:0/3026238613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe150151ed0 con 0x7fe1501587d0 2023-07-06T22:02:15.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.679+0000 7fe15480b640 1 -- 172.21.15.55:0/3026238613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15006c580 con 0x7fe1501587d0 2023-07-06T22:02:15.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.679+0000 7fe146ffd640 1 -- 172.21.15.55:0/3026238613 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe1480144a0 con 0x7fe1501587d0 2023-07-06T22:02:15.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.683+0000 7fe146ffd640 1 --2- 172.21.15.55:0/3026238613 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fe1300663a0 0x7fe130068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:15.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.683+0000 7fe146ffd640 1 -- 172.21.15.55:0/3026238613 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe148084c70 con 0x7fe1501587d0 2023-07-06T22:02:15.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.683+0000 7fe14e59c640 1 --2- 172.21.15.55:0/3026238613 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fe1300663a0 0x7fe130068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:15.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.683+0000 7fe14e59c640 1 --2- 172.21.15.55:0/3026238613 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fe1300663a0 0x7fe130068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe140007fd0 tx=0x7fe140009040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:15.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.687+0000 7fe146ffd640 1 -- 172.21.15.55:0/3026238613 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe148055810 con 0x7fe1501587d0 2023-07-06T22:02:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.843+0000 7fe15480b640 1 -- 172.21.15.55:0/3026238613 --> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1501526d0 con 0x7fe1300663a0 2023-07-06T22:02:15.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.855+0000 7fe146ffd640 1 -- 172.21.15.55:0/3026238613 <== mgr.9489 v2:172.21.15.55:6832/433956277 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299265 (secure 0 0 0) 0x7fe1501526d0 con 0x7fe1300663a0 2023-07-06T22:02:15.856 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:02:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.859+0000 7fe15480b640 1 -- 172.21.15.55:0/3026238613 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fe1300663a0 msgr2=0x7fe130068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.859+0000 7fe15480b640 1 --2- 172.21.15.55:0/3026238613 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fe1300663a0 0x7fe130068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe140007fd0 tx=0x7fe140009040 comp rx=0 tx=0).stop 2023-07-06T22:02:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.859+0000 7fe15480b640 1 -- 172.21.15.55:0/3026238613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1501587d0 msgr2=0x7fe1500c3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.859+0000 7fe15480b640 1 --2- 172.21.15.55:0/3026238613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1501587d0 0x7fe1500c3ee0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fe14800efc0 tx=0x7fe148009f90 comp rx=0 tx=0).stop 2023-07-06T22:02:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.859+0000 7fe15480b640 1 -- 172.21.15.55:0/3026238613 shutdown_connections 2023-07-06T22:02:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.859+0000 7fe15480b640 1 --2- 172.21.15.55:0/3026238613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1501587d0 0x7fe1500c3ee0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.859+0000 7fe15480b640 1 --2- 172.21.15.55:0/3026238613 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fe1300663a0 0x7fe130068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.859+0000 7fe15480b640 1 --2- 172.21.15.55:0/3026238613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe150158400 0x7fe15014f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.859+0000 7fe15480b640 1 --2- 172.21.15.55:0/3026238613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe1500710c0 0x7fe1500c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.859+0000 7fe15480b640 1 -- 172.21.15.55:0/3026238613 >> 172.21.15.55:0/3026238613 conn(0x7fe1500cded0 msgr2=0x7fe150156580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.859+0000 7fe15480b640 1 -- 172.21.15.55:0/3026238613 shutdown_connections 2023-07-06T22:02:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:15.859+0000 7fe15480b640 1 -- 172.21.15.55:0/3026238613 wait complete. 2023-07-06T22:02:15.876 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T22:02:14.857760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":369756,"kb_used_data":16412,"kb_used_omap":0,"kb_used_meta":353280,"kb_avail":754604964,"statfs":{"total":773094113280,"available":772715483136,"internally_reserved":0,"allocated":16805888,"data_stored":9486688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":361758720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.513636"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348458+0000","last_change":"2023-07-06T22:02:10.348458+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348458+0000","last_undegraded":"2023-07-06T22:02:10.348458+0000","last_fullsized":"2023-07-06T22:02:10.348458+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.351311+0000","last_change":"2023-07-06T22:02:10.351311+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.351311+0000","last_undegraded":"2023-07-06T22:02:10.351311+0000","last_fullsized":"2023-07-06T22:02:10.351311+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.346907+0000","last_change":"2023-07-06T22:02:10.346907+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.346907+0000","last_undegraded":"2023-07-06T22:02:10.346907+0000","last_fullsized":"2023-07-06T22:02:10.346907+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.346919+0000","last_change":"2023-07-06T22:02:10.346919+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.346919+0000","last_undegraded":"2023-07-06T22:02:10.346919+0000","last_fullsized":"2023-07-06T22:02:10.346919+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.355250+0000","last_change":"2023-07-06T22:02:10.355250+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.355250+0000","last_undegraded":"2023-07-06T22:02:10.355250+0000","last_fullsized":"2023-07-06T22:02:10.355250+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.351468+0000","last_change":"2023-07-06T22:02:10.351468+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.351468+0000","last_undegraded":"2023-07-06T22:02:10.351468+0000","last_fullsized":"2023-07-06T22:02:10.351468+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.353420+0000","last_change":"2023-07-06T22:02:10.353420+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.353420+0000","last_undegraded":"2023-07-06T22:02:10.353420+0000","last_fullsized":"2023-07-06T22:02:10.353420+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.346907+0000","last_change":"2023-07-06T22:02:10.346907+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.346907+0000","last_undegraded":"2023-07-06T22:02:10.346907+0000","last_fullsized":"2023-07-06T22:02:10.346907+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.351943+0000","last_change":"2023-07-06T22:02:10.351943+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.351943+0000","last_undegraded":"2023-07-06T22:02:10.351943+0000","last_fullsized":"2023-07-06T22:02:10.351943+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348373+0000","last_change":"2023-07-06T22:02:10.348373+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348373+0000","last_undegraded":"2023-07-06T22:02:10.348373+0000","last_fullsized":"2023-07-06T22:02:10.348373+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.353108+0000","last_change":"2023-07-06T22:02:10.353108+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.353108+0000","last_undegraded":"2023-07-06T22:02:10.353108+0000","last_fullsized":"2023-07-06T22:02:10.353108+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348296+0000","last_change":"2023-07-06T22:02:10.348296+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348296+0000","last_undegraded":"2023-07-06T22:02:10.348296+0000","last_fullsized":"2023-07-06T22:02:10.348296+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350256+0000","last_change":"2023-07-06T22:02:10.350256+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350256+0000","last_undegraded":"2023-07-06T22:02:10.350256+0000","last_fullsized":"2023-07-06T22:02:10.350256+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348791+0000","last_change":"2023-07-06T22:02:10.348791+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348791+0000","last_undegraded":"2023-07-06T22:02:10.348791+0000","last_fullsized":"2023-07-06T22:02:10.348791+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.347297+0000","last_change":"2023-07-06T22:02:10.347297+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.347297+0000","last_undegraded":"2023-07-06T22:02:10.347297+0000","last_fullsized":"2023-07-06T22:02:10.347297+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350778+0000","last_change":"2023-07-06T22:02:10.350778+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350778+0000","last_undegraded":"2023-07-06T22:02:10.350778+0000","last_fullsized":"2023-07-06T22:02:10.350778+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.347830+0000","last_change":"2023-07-06T22:02:10.347830+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.347830+0000","last_undegraded":"2023-07-06T22:02:10.347830+0000","last_fullsized":"2023-07-06T22:02:10.347830+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350357+0000","last_change":"2023-07-06T22:02:10.350357+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350357+0000","last_undegraded":"2023-07-06T22:02:10.350357+0000","last_fullsized":"2023-07-06T22:02:10.350357+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350486+0000","last_change":"2023-07-06T22:02:10.350486+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350486+0000","last_undegraded":"2023-07-06T22:02:10.350486+0000","last_fullsized":"2023-07-06T22:02:10.350486+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.349922+0000","last_change":"2023-07-06T22:02:10.349922+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.349922+0000","last_undegraded":"2023-07-06T22:02:10.349922+0000","last_fullsized":"2023-07-06T22:02:10.349922+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.349650+0000","last_change":"2023-07-06T22:02:10.349650+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.349650+0000","last_undegraded":"2023-07-06T22:02:10.349650+0000","last_fullsized":"2023-07-06T22:02:10.349650+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.347304+0000","last_change":"2023-07-06T22:02:10.347304+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.347304+0000","last_undegraded":"2023-07-06T22:02:10.347304+0000","last_fullsized":"2023-07-06T22:02:10.347304+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350928+0000","last_change":"2023-07-06T22:02:10.350928+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350928+0000","last_undegraded":"2023-07-06T22:02:10.350928+0000","last_fullsized":"2023-07-06T22:02:10.350928+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348432+0000","last_change":"2023-07-06T22:02:10.348432+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348432+0000","last_undegraded":"2023-07-06T22:02:10.348432+0000","last_fullsized":"2023-07-06T22:02:10.348432+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350941+0000","last_change":"2023-07-06T22:02:10.350941+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350941+0000","last_undegraded":"2023-07-06T22:02:10.350941+0000","last_fullsized":"2023-07-06T22:02:10.350941+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"148'271","reported_seq":984,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.349369+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:02:10.349369+0000","last_peered":"2023-07-06T22:02:10.349369+0000","last_clean":"2023-07-06T22:02:10.349369+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:02:10.349369+0000","last_undegraded":"2023-07-06T22:02:10.349369+0000","last_fullsized":"2023-07-06T22:02:10.349369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:56:11.170083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":246,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.352328+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:02:10.352328+0000","last_peered":"2023-07-06T22:02:10.352328+0000","last_clean":"2023-07-06T22:02:10.352328+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:02:10.352328+0000","last_undegraded":"2023-07-06T22:02:10.352328+0000","last_fullsized":"2023-07-06T22:02:10.352328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:42:39.018705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.347304+0000","last_change":"2023-07-06T22:02:10.347304+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.347304+0000","last_undegraded":"2023-07-06T22:02:10.347304+0000","last_fullsized":"2023-07-06T22:02:10.347304+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":282,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.349250+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:02:10.349250+0000","last_peered":"2023-07-06T22:02:10.349250+0000","last_clean":"2023-07-06T22:02:10.349250+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:02:10.349250+0000","last_undegraded":"2023-07-06T22:02:10.349250+0000","last_fullsized":"2023-07-06T22:02:10.349250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:51:59.485841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348269+0000","last_change":"2023-07-06T22:02:10.348269+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348269+0000","last_undegraded":"2023-07-06T22:02:10.348269+0000","last_fullsized":"2023-07-06T22:02:10.348269+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.355863+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:02:10.355863+0000","last_peered":"2023-07-06T22:02:10.355863+0000","last_clean":"2023-07-06T22:02:10.355863+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:02:10.355863+0000","last_undegraded":"2023-07-06T22:02:10.355863+0000","last_fullsized":"2023-07-06T22:02:10.355863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:20:59.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.349660+0000","last_change":"2023-07-06T22:02:10.349660+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.349660+0000","last_undegraded":"2023-07-06T22:02:10.349660+0000","last_fullsized":"2023-07-06T22:02:10.349660+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":246,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.352465+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:02:10.352465+0000","last_peered":"2023-07-06T22:02:10.352465+0000","last_clean":"2023-07-06T22:02:10.352465+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:02:10.352465+0000","last_undegraded":"2023-07-06T22:02:10.352465+0000","last_fullsized":"2023-07-06T22:02:10.352465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:24:04.038621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.351329+0000","last_change":"2023-07-06T22:02:10.351329+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.351329+0000","last_undegraded":"2023-07-06T22:02:10.351329+0000","last_fullsized":"2023-07-06T22:02:10.351329+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":254,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.351128+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:02:10.351128+0000","last_peered":"2023-07-06T22:02:10.351128+0000","last_clean":"2023-07-06T22:02:10.351128+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:02:10.351128+0000","last_undegraded":"2023-07-06T22:02:10.351128+0000","last_fullsized":"2023-07-06T22:02:10.351128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:59:04.998289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350852+0000","last_change":"2023-07-06T22:02:10.350852+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350852+0000","last_undegraded":"2023-07-06T22:02:10.350852+0000","last_fullsized":"2023-07-06T22:02:10.350852+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":282,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.349357+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:02:10.349357+0000","last_peered":"2023-07-06T22:02:10.349357+0000","last_clean":"2023-07-06T22:02:10.349357+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:02:10.349357+0000","last_undegraded":"2023-07-06T22:02:10.349357+0000","last_fullsized":"2023-07-06T22:02:10.349357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:58.861974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.353110+0000","last_change":"2023-07-06T22:02:10.353110+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.353110+0000","last_undegraded":"2023-07-06T22:02:10.353110+0000","last_fullsized":"2023-07-06T22:02:10.353110+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":254,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.351627+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:02:10.351627+0000","last_peered":"2023-07-06T22:02:10.351627+0000","last_clean":"2023-07-06T22:02:10.351627+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:02:10.351627+0000","last_undegraded":"2023-07-06T22:02:10.351627+0000","last_fullsized":"2023-07-06T22:02:10.351627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:34:25.862413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350018+0000","last_change":"2023-07-06T22:02:10.350018+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350018+0000","last_undegraded":"2023-07-06T22:02:10.350018+0000","last_fullsized":"2023-07-06T22:02:10.350018+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":246,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.352760+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:02:10.352760+0000","last_peered":"2023-07-06T22:02:10.352760+0000","last_clean":"2023-07-06T22:02:10.352760+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:02:10.352760+0000","last_undegraded":"2023-07-06T22:02:10.352760+0000","last_fullsized":"2023-07-06T22:02:10.352760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:22:01.765341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575088,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37636,"kb_used_data":2492,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334204,"statfs":{"total":96636764160,"available":96598224896,"internally_reserved":0,"allocated":2551808,"data_stored":1631311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.70899999999999996},"min":{"1min":0.46899999999999997,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":1.0229999999999999,"5min":1.526,"15min":1.526},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0409999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.95299999999999996}]},{"osd":1,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":1.0580000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.47499999999999998,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":1.1100000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.47399999999999998,"5min":0.42799999999999999,"15min":0.377},"max":{"1min":1,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.42599999999999999},"max":{"1min":1.1339999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.78900000000000003}]},{"osd":3,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.42199999999999999},"max":{"1min":1.075,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.74199999999999999,"15min":0.74399999999999999},"min":{"1min":0.59699999999999998,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.0980000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.39400000000000002,"5min":0.377,"15min":0.32700000000000001},"max":{"1min":0.78700000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.35699999999999998},"max":{"1min":0.749,"5min":1.169,"15min":1.169},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71899999999999997,"15min":0.70599999999999996},"min":{"1min":0.58999999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":1.45,"15min":1.45},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.44400000000000001,"15min":0.41699999999999998},"max":{"1min":0.85799999999999998,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.88200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575088,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1941504,"data_stored":1033406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41399999999999998},"max":{"1min":1.089,"5min":1.607,"15min":1.607},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.751,"15min":0.74099999999999999},"min":{"1min":0.48399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1990000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.38500000000000001},"max":{"1min":0.85699999999999998,"5min":1.857,"15min":1.857},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.48899999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2270000000000001,"5min":1.778,"15min":1.778},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69399999999999995,"15min":0.71599999999999997},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":0.92700000000000005,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71299999999999997,"15min":0.73799999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0529999999999999,"5min":1.752,"15min":1.752},"last":0.752}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.165,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.499,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1020000000000001,"5min":1.794,"15min":1.794},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81699999999999995,"5min":0.95399999999999996,"15min":1.4390000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.80100000000000005,"5min":0.94099999999999995,"15min":1.0509999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.62},"min":{"1min":0.442,"5min":0.42099999999999999,"15min":0.38600000000000001},"max":{"1min":0.82599999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.39000000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.3089999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.0029999999999999,"15min":1.2549999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85399999999999998,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.76800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575087,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55092,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316748,"statfs":{"total":96636764160,"available":96580349952,"internally_reserved":0,"allocated":1945600,"data_stored":1034425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98099999999999998,"5min":1.49,"15min":1.49},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.55500000000000005,"5min":0.45400000000000001,"15min":0.35299999999999998},"max":{"1min":1.0209999999999999,"5min":1.21,"15min":1.21},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.54400000000000004,"5min":0.45600000000000002,"15min":0.40200000000000002},"max":{"1min":1.0369999999999999,"5min":1.143,"15min":1.143},"last":0.496},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.39900000000000002},"max":{"1min":0.99199999999999999,"5min":1.5,"15min":1.5},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44400000000000001},"max":{"1min":1.044,"5min":1.163,"15min":1.163},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.443},"max":{"1min":0.97999999999999998,"5min":1.127,"15min":1.127},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.008,"5min":1.109,"15min":1.109},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":0.85399999999999998,"5min":1.012,"15min":1.012},"last":0.434},{"interface":"front","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.371},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.02},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.44400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.34100000000000003},"max":{"1min":0.91400000000000003,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.628},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0589999999999999},"last":0.64700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51008,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320832,"statfs":{"total":96636764160,"available":96584531968,"internally_reserved":0,"allocated":1957888,"data_stored":1040943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.72099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":0.89400000000000002,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98799999999999999,"5min":1.208,"15min":1.208},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.55000000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1200000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.72099999999999997},"min":{"1min":0.47499999999999998,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":1.996,"15min":1.996},"last":0.71299999999999997}]},{"osd":2,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.54000000000000004,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.60199999999999998,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.0509999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.107}]},{"osd":3,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.746,"15min":0.754},"min":{"1min":0.58499999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2370000000000001,"5min":1.3640000000000001,"15min":3.2269999999999999},"last":0.85699999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.46000000000000002,"5min":0.35499999999999998,"15min":0.308},"max":{"1min":0.75,"5min":0.93899999999999995,"15min":0.94299999999999995},"last":1.022},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.60099999999999998},"min":{"1min":0.503,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.71899999999999997,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.47399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76800000000000002,"5min":1.036,"15min":1.036},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.65600000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":1,"15min":1},"last":1.1559999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93000000000000005,"5min":1.0149999999999999,"15min":1.0720000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.42299999999999999,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":1.01},"last":0.99099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575087,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51008,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320832,"statfs":{"total":96636764160,"available":96584531968,"internally_reserved":0,"allocated":1957888,"data_stored":1040943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.433,"15min":0.45200000000000001},"min":{"1min":0.25800000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.314},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48199999999999998,"15min":0.52900000000000003},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":2.77},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.442,"15min":0.48499999999999999},"min":{"1min":0.315,"5min":0.27500000000000002,"15min":0.24299999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":2.4359999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53800000000000003,"15min":0.57899999999999996},"min":{"1min":0.40400000000000003,"5min":0.313,"15min":0.313},"max":{"1min":1.107,"5min":1.107,"15min":1.351},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52400000000000002,"15min":0.54500000000000004},"min":{"1min":0.41199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.24},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.755},"min":{"1min":0.502,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.022,"5min":1.1020000000000001,"15min":1.3009999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.71099999999999997,"15min":0.77100000000000002},"min":{"1min":0.55000000000000004,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.383},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.75600000000000001,"15min":0.80300000000000005},"min":{"1min":0.63600000000000001,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.1259999999999999,"5min":1.349,"15min":1.4199999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.754,"15min":0.78900000000000003},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.0509999999999999,"5min":1.395,"15min":1.3999999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73999999999999999,"15min":0.79200000000000004},"min":{"1min":0.56100000000000005,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.093,"5min":1.371,"15min":1.425},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.748,"15min":0.80200000000000005},"min":{"1min":0.54400000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0920000000000001,"5min":1.097,"15min":3.1739999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.73499999999999999,"15min":0.80100000000000005},"min":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":3.097},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.75600000000000001,"15min":0.79900000000000004},"min":{"1min":0.59299999999999997,"5min":0.47099999999999997,"15min":0.45900000000000002},"max":{"1min":1.0740000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.63400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575087,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41140,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330700,"statfs":{"total":96636764160,"available":96594636800,"internally_reserved":0,"allocated":1945600,"data_stored":1034425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.42799999999999999,"15min":0.45100000000000001},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.623,"5min":0.68600000000000005,"15min":0.85999999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48499999999999999,"15min":0.5},"min":{"1min":0.38200000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.73399999999999999,"5min":0.82199999999999995,"15min":0.85999999999999999},"last":0.442}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.496,"15min":0.50900000000000001},"min":{"1min":0.39100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67900000000000005,"5min":0.878,"15min":0.88200000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.54400000000000004},"min":{"1min":0.38200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72799999999999998,"5min":0.83499999999999996,"15min":0.94399999999999995},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55600000000000005,"15min":0.57699999999999996},"min":{"1min":0.44,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.95399999999999996},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.47999999999999998,"15min":0.42899999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.57099999999999995,"5min":0.52100000000000002,"15min":0.41399999999999998},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.504}]},{"osd":5,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.52200000000000002,"15min":0.42899999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77800000000000002,"15min":0.80900000000000005},"min":{"1min":0.51500000000000001,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.48299999999999998},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.63900000000000001,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80700000000000005,"15min":0.82499999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.496},"max":{"1min":1.127,"5min":1.458,"15min":1.458},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.81399999999999995,"15min":0.83899999999999997},"min":{"1min":0.60199999999999998,"5min":0.54200000000000004,"15min":0.50700000000000001},"max":{"1min":1.415,"5min":1.573,"15min":1.573},"last":0.65400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575088,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59200,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312640,"statfs":{"total":96636764160,"available":96576143360,"internally_reserved":0,"allocated":1957888,"data_stored":1040943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.30199999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73599999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47799999999999998,"15min":0.501},"min":{"1min":0.36299999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68400000000000005,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.35299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71399999999999997,"5min":0.83999999999999997,"15min":0.88900000000000001},"last":0.437},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.52300000000000002},"min":{"1min":0.38200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.71399999999999997,"15min":0.87},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.57699999999999996},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.84599999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.53900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32000000000000001},"max":{"1min":0.74299999999999999,"5min":0.749,"15min":0.91200000000000003},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.54300000000000004,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.3140000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77100000000000002,"15min":0.78400000000000003},"min":{"1min":0.64400000000000002,"5min":0.48899999999999999,"15min":0.44},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.64300000000000002,"5min":0.48699999999999999,"15min":0.41899999999999998},"max":{"1min":1.129,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.77400000000000002,"15min":0.79100000000000004},"min":{"1min":0.57999999999999996,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":1.1859999999999999,"5min":1.3260000000000001,"15min":1.357},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.624,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1859999999999999,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.3029999999999999,"5min":1.4379999999999999,"15min":1.456},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.80100000000000005,"15min":0.81000000000000005},"min":{"1min":0.58499999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.67900000000000005,"5min":0.51900000000000002,"15min":0.5},"max":{"1min":1.2250000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.625}]}]},{"osd":0,"up_from":13,"seq":55834575087,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37632,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334208,"statfs":{"total":96636764160,"available":96598228992,"internally_reserved":0,"allocated":2547712,"data_stored":1630292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.42199999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.86399999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.374,"5min":0.28299999999999997,"15min":0.27600000000000002},"max":{"1min":0.67400000000000004,"5min":0.86799999999999999,"15min":0.98099999999999998},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47399999999999998,"15min":0.495},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.82399999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.496,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.33800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":1.2050000000000001},"last":0.443}]},{"osd":3,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47899999999999998,"15min":0.50600000000000001},"min":{"1min":0.35699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63,"5min":0.76600000000000001,"15min":1.151},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65900000000000003,"5min":0.78800000000000003,"15min":0.874},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.78400000000000003},"min":{"1min":0.55800000000000005,"5min":0.46400000000000002,"15min":0.45000000000000001},"max":{"1min":1.2190000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.48099999999999998,"5min":0.44600000000000001,"15min":0.40999999999999998},"max":{"1min":1.143,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57899999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96599999999999997,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.745,"15min":0.77600000000000002},"min":{"1min":0.52900000000000003,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.284,"5min":1.776,"15min":1.776},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.52200000000000002,"15min":0.48899999999999999},"max":{"1min":1.232,"5min":1.851,"15min":1.851},"last":0.873},{"interface":"front","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1739999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78600000000000003,"15min":0.80500000000000005},"min":{"1min":0.51200000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.252,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.81499999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.50900000000000001},"max":{"1min":1.1879999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":0.82799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:02:15.883 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:02:16.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.067+0000 7f3656703640 1 Processor -- start 2023-07-06T22:02:16.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.067+0000 7f3656703640 1 -- start start 2023-07-06T22:02:16.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.067+0000 7f3656703640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f365006af90 0x7f365015ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.067+0000 7f3656703640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3650070fd0 con 0x7f36500c9620 2023-07-06T22:02:16.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.067+0000 7f3656703640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36500c9e00 con 0x7f365006caf0 2023-07-06T22:02:16.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.067+0000 7f3656703640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3650070bb0 con 0x7f365006af90 2023-07-06T22:02:16.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.067+0000 7f364f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f36500c9620 0x7f365006c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50158/0 (socket says 172.21.15.55:50158) 2023-07-06T22:02:16.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.067+0000 7f364f7fe640 1 -- 172.21.15.55:0/93215494 learned_addr learned my addr 172.21.15.55:0/93215494 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:16.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.067+0000 7f364ffff640 1 --2- 172.21.15.55:0/93215494 >> v2:172.21.15.55:3300/0 conn(0x7f365006af90 0x7f365015ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.071+0000 7f364ffff640 1 -- 172.21.15.55:0/93215494 >> v1:172.21.15.138:6789/0 conn(0x7f365006caf0 legacy=0x7f3650158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.071+0000 7f364ffff640 1 -- 172.21.15.55:0/93215494 >> v1:172.21.15.55:6789/0 conn(0x7f36500c9620 legacy=0x7f365006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.071+0000 7f364ffff640 1 -- 172.21.15.55:0/93215494 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365006b360 con 0x7f365006af90 2023-07-06T22:02:16.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.071+0000 7f364effd640 1 -- 172.21.15.55:0/93215494 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261738277 0 0) 0x7f3650070fd0 con 0x7f36500c9620 2023-07-06T22:02:16.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.071+0000 7f364ffff640 1 --2- 172.21.15.55:0/93215494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f365006af90 0x7f365015ca30 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f36400097c0 tx=0x7f364001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac744163574a2e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:16.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.071+0000 7f364effd640 1 -- 172.21.15.55:0/93215494 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400ac620 con 0x7f365006af90 2023-07-06T22:02:16.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.071+0000 7f364effd640 1 -- 172.21.15.55:0/93215494 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36400ac780 con 0x7f365006af90 2023-07-06T22:02:16.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.071+0000 7f364effd640 1 -- 172.21.15.55:0/93215494 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400acb10 con 0x7f365006af90 2023-07-06T22:02:16.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 -- 172.21.15.55:0/93215494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f365006af90 msgr2=0x7f365015ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 --2- 172.21.15.55:0/93215494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f365006af90 0x7f365015ca30 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f36400097c0 tx=0x7f364001c3c0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 -- 172.21.15.55:0/93215494 shutdown_connections 2023-07-06T22:02:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 --2- 172.21.15.55:0/93215494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f365006af90 0x7f365015ca30 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 -- 172.21.15.55:0/93215494 >> 172.21.15.55:0/93215494 conn(0x7f36500cfc60 msgr2=0x7f36500cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:16.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 -- 172.21.15.55:0/93215494 shutdown_connections 2023-07-06T22:02:16.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 -- 172.21.15.55:0/93215494 wait complete. 2023-07-06T22:02:16.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 Processor -- start 2023-07-06T22:02:16.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 -- start start 2023-07-06T22:02:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f365006af90 0x7f36500c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f365006caf0 0x7f365015dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36500c9620 0x7f365015e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365015d880 con 0x7f365006af90 2023-07-06T22:02:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365014f220 con 0x7f36500c9620 2023-07-06T22:02:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3656703640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365014f4c0 con 0x7f365006caf0 2023-07-06T22:02:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f364ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f365006af90 0x7f36500c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f364ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f365006af90 0x7f36500c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44032/0 (socket says 172.21.15.55:44032) 2023-07-06T22:02:16.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f364ffff640 1 -- 172.21.15.55:0/1763912932 learned_addr learned my addr 172.21.15.55:0/1763912932 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:16.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f364f7fe640 1 --2- 172.21.15.55:0/1763912932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f365006caf0 0x7f365015dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f3654ca0640 1 --2- 172.21.15.55:0/1763912932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36500c9620 0x7f365015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f364ffff640 1 -- 172.21.15.55:0/1763912932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f365006caf0 msgr2=0x7f365015dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f364ffff640 1 --2- 172.21.15.55:0/1763912932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f365006caf0 0x7f365015dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f364ffff640 1 -- 172.21.15.55:0/1763912932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36500c9620 msgr2=0x7f365015e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f364ffff640 1 --2- 172.21.15.55:0/1763912932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36500c9620 0x7f365015e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.075+0000 7f364ffff640 1 -- 172.21.15.55:0/1763912932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640009420 con 0x7f365006af90 2023-07-06T22:02:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.079+0000 7f364ffff640 1 --2- 172.21.15.55:0/1763912932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f365006af90 0x7f36500c60a0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f3640018fd0 tx=0x7f3640019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.079+0000 7f364cff9640 1 -- 172.21.15.55:0/1763912932 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400b5610 con 0x7f365006af90 2023-07-06T22:02:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.079+0000 7f364cff9640 1 -- 172.21.15.55:0/1763912932 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36400b5790 con 0x7f365006af90 2023-07-06T22:02:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.079+0000 7f364cff9640 1 -- 172.21.15.55:0/1763912932 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400b5b40 con 0x7f365006af90 2023-07-06T22:02:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.079+0000 7f3656703640 1 -- 172.21.15.55:0/1763912932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365014f7a0 con 0x7f365006af90 2023-07-06T22:02:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.079+0000 7f3656703640 1 -- 172.21.15.55:0/1763912932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3650150b10 con 0x7f365006af90 2023-07-06T22:02:16.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.079+0000 7f3656703640 1 -- 172.21.15.55:0/1763912932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36500b1a60 con 0x7f365006af90 2023-07-06T22:02:16.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.079+0000 7f364cff9640 1 -- 172.21.15.55:0/1763912932 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f36400b3040 con 0x7f365006af90 2023-07-06T22:02:16.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.079+0000 7f364cff9640 1 --2- 172.21.15.55:0/1763912932 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f363c0663d0 0x7f363c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.079+0000 7f364cff9640 1 -- 172.21.15.55:0/1763912932 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f364011de50 con 0x7f365006af90 2023-07-06T22:02:16.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.079+0000 7f364f7fe640 1 --2- 172.21.15.55:0/1763912932 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f363c0663d0 0x7f363c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.083+0000 7f364f7fe640 1 --2- 172.21.15.55:0/1763912932 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f363c0663d0 0x7f363c068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3644007fd0 tx=0x7f3644007ba0 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:16.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.083+0000 7f364cff9640 1 -- 172.21.15.55:0/1763912932 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36400eaeb0 con 0x7f365006af90 2023-07-06T22:02:16.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.235+0000 7f3656703640 1 -- 172.21.15.55:0/1763912932 --> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f365014f630 con 0x7f363c0663d0 2023-07-06T22:02:16.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.243+0000 7f364cff9640 1 -- 172.21.15.55:0/1763912932 <== mgr.9489 v2:172.21.15.55:6832/433956277 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299265 (secure 0 0 0) 0x7f365014f630 con 0x7f363c0663d0 2023-07-06T22:02:16.244 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:16.245 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:02:16.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.247+0000 7f3656703640 1 -- 172.21.15.55:0/1763912932 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f363c0663d0 msgr2=0x7f363c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.247+0000 7f3656703640 1 --2- 172.21.15.55:0/1763912932 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f363c0663d0 0x7f363c068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3644007fd0 tx=0x7f3644007ba0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.247+0000 7f3656703640 1 -- 172.21.15.55:0/1763912932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f365006af90 msgr2=0x7f36500c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.247+0000 7f3656703640 1 --2- 172.21.15.55:0/1763912932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f365006af90 0x7f36500c60a0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f3640018fd0 tx=0x7f3640019160 comp rx=0 tx=0).stop 2023-07-06T22:02:16.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.247+0000 7f3656703640 1 -- 172.21.15.55:0/1763912932 shutdown_connections 2023-07-06T22:02:16.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.247+0000 7f3656703640 1 --2- 172.21.15.55:0/1763912932 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f363c0663d0 0x7f363c068880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.247+0000 7f3656703640 1 --2- 172.21.15.55:0/1763912932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36500c9620 0x7f365015e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.247+0000 7f3656703640 1 --2- 172.21.15.55:0/1763912932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f365006caf0 0x7f365015dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.247+0000 7f3656703640 1 --2- 172.21.15.55:0/1763912932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f365006af90 0x7f36500c60a0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.247+0000 7f3656703640 1 -- 172.21.15.55:0/1763912932 >> 172.21.15.55:0/1763912932 conn(0x7f36500cfc60 msgr2=0x7f36500ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:16.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.247+0000 7f3656703640 1 -- 172.21.15.55:0/1763912932 shutdown_connections 2023-07-06T22:02:16.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.247+0000 7f3656703640 1 -- 172.21.15.55:0/1763912932 wait complete. 2023-07-06T22:02:16.264 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T22:02:14.857760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":369756,"kb_used_data":16412,"kb_used_omap":0,"kb_used_meta":353280,"kb_avail":754604964,"statfs":{"total":773094113280,"available":772715483136,"internally_reserved":0,"allocated":16805888,"data_stored":9486688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":361758720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.513636"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348458+0000","last_change":"2023-07-06T22:02:10.348458+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348458+0000","last_undegraded":"2023-07-06T22:02:10.348458+0000","last_fullsized":"2023-07-06T22:02:10.348458+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.351311+0000","last_change":"2023-07-06T22:02:10.351311+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.351311+0000","last_undegraded":"2023-07-06T22:02:10.351311+0000","last_fullsized":"2023-07-06T22:02:10.351311+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.346907+0000","last_change":"2023-07-06T22:02:10.346907+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.346907+0000","last_undegraded":"2023-07-06T22:02:10.346907+0000","last_fullsized":"2023-07-06T22:02:10.346907+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.346919+0000","last_change":"2023-07-06T22:02:10.346919+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.346919+0000","last_undegraded":"2023-07-06T22:02:10.346919+0000","last_fullsized":"2023-07-06T22:02:10.346919+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.355250+0000","last_change":"2023-07-06T22:02:10.355250+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.355250+0000","last_undegraded":"2023-07-06T22:02:10.355250+0000","last_fullsized":"2023-07-06T22:02:10.355250+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.351468+0000","last_change":"2023-07-06T22:02:10.351468+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.351468+0000","last_undegraded":"2023-07-06T22:02:10.351468+0000","last_fullsized":"2023-07-06T22:02:10.351468+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.353420+0000","last_change":"2023-07-06T22:02:10.353420+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.353420+0000","last_undegraded":"2023-07-06T22:02:10.353420+0000","last_fullsized":"2023-07-06T22:02:10.353420+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.346907+0000","last_change":"2023-07-06T22:02:10.346907+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.346907+0000","last_undegraded":"2023-07-06T22:02:10.346907+0000","last_fullsized":"2023-07-06T22:02:10.346907+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.351943+0000","last_change":"2023-07-06T22:02:10.351943+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.351943+0000","last_undegraded":"2023-07-06T22:02:10.351943+0000","last_fullsized":"2023-07-06T22:02:10.351943+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348373+0000","last_change":"2023-07-06T22:02:10.348373+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348373+0000","last_undegraded":"2023-07-06T22:02:10.348373+0000","last_fullsized":"2023-07-06T22:02:10.348373+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.353108+0000","last_change":"2023-07-06T22:02:10.353108+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.353108+0000","last_undegraded":"2023-07-06T22:02:10.353108+0000","last_fullsized":"2023-07-06T22:02:10.353108+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348296+0000","last_change":"2023-07-06T22:02:10.348296+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348296+0000","last_undegraded":"2023-07-06T22:02:10.348296+0000","last_fullsized":"2023-07-06T22:02:10.348296+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350256+0000","last_change":"2023-07-06T22:02:10.350256+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350256+0000","last_undegraded":"2023-07-06T22:02:10.350256+0000","last_fullsized":"2023-07-06T22:02:10.350256+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348791+0000","last_change":"2023-07-06T22:02:10.348791+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348791+0000","last_undegraded":"2023-07-06T22:02:10.348791+0000","last_fullsized":"2023-07-06T22:02:10.348791+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.347297+0000","last_change":"2023-07-06T22:02:10.347297+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.347297+0000","last_undegraded":"2023-07-06T22:02:10.347297+0000","last_fullsized":"2023-07-06T22:02:10.347297+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350778+0000","last_change":"2023-07-06T22:02:10.350778+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350778+0000","last_undegraded":"2023-07-06T22:02:10.350778+0000","last_fullsized":"2023-07-06T22:02:10.350778+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.347830+0000","last_change":"2023-07-06T22:02:10.347830+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.347830+0000","last_undegraded":"2023-07-06T22:02:10.347830+0000","last_fullsized":"2023-07-06T22:02:10.347830+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350357+0000","last_change":"2023-07-06T22:02:10.350357+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350357+0000","last_undegraded":"2023-07-06T22:02:10.350357+0000","last_fullsized":"2023-07-06T22:02:10.350357+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350486+0000","last_change":"2023-07-06T22:02:10.350486+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350486+0000","last_undegraded":"2023-07-06T22:02:10.350486+0000","last_fullsized":"2023-07-06T22:02:10.350486+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.349922+0000","last_change":"2023-07-06T22:02:10.349922+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.349922+0000","last_undegraded":"2023-07-06T22:02:10.349922+0000","last_fullsized":"2023-07-06T22:02:10.349922+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.349650+0000","last_change":"2023-07-06T22:02:10.349650+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.349650+0000","last_undegraded":"2023-07-06T22:02:10.349650+0000","last_fullsized":"2023-07-06T22:02:10.349650+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.347304+0000","last_change":"2023-07-06T22:02:10.347304+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.347304+0000","last_undegraded":"2023-07-06T22:02:10.347304+0000","last_fullsized":"2023-07-06T22:02:10.347304+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350928+0000","last_change":"2023-07-06T22:02:10.350928+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350928+0000","last_undegraded":"2023-07-06T22:02:10.350928+0000","last_fullsized":"2023-07-06T22:02:10.350928+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348432+0000","last_change":"2023-07-06T22:02:10.348432+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348432+0000","last_undegraded":"2023-07-06T22:02:10.348432+0000","last_fullsized":"2023-07-06T22:02:10.348432+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350941+0000","last_change":"2023-07-06T22:02:10.350941+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350941+0000","last_undegraded":"2023-07-06T22:02:10.350941+0000","last_fullsized":"2023-07-06T22:02:10.350941+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"148'271","reported_seq":984,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.349369+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:02:10.349369+0000","last_peered":"2023-07-06T22:02:10.349369+0000","last_clean":"2023-07-06T22:02:10.349369+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:02:10.349369+0000","last_undegraded":"2023-07-06T22:02:10.349369+0000","last_fullsized":"2023-07-06T22:02:10.349369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:56:11.170083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":246,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.352328+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:02:10.352328+0000","last_peered":"2023-07-06T22:02:10.352328+0000","last_clean":"2023-07-06T22:02:10.352328+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:02:10.352328+0000","last_undegraded":"2023-07-06T22:02:10.352328+0000","last_fullsized":"2023-07-06T22:02:10.352328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:42:39.018705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.347304+0000","last_change":"2023-07-06T22:02:10.347304+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.347304+0000","last_undegraded":"2023-07-06T22:02:10.347304+0000","last_fullsized":"2023-07-06T22:02:10.347304+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":282,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.349250+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:02:10.349250+0000","last_peered":"2023-07-06T22:02:10.349250+0000","last_clean":"2023-07-06T22:02:10.349250+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:02:10.349250+0000","last_undegraded":"2023-07-06T22:02:10.349250+0000","last_fullsized":"2023-07-06T22:02:10.349250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:51:59.485841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348269+0000","last_change":"2023-07-06T22:02:10.348269+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348269+0000","last_undegraded":"2023-07-06T22:02:10.348269+0000","last_fullsized":"2023-07-06T22:02:10.348269+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.355863+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:02:10.355863+0000","last_peered":"2023-07-06T22:02:10.355863+0000","last_clean":"2023-07-06T22:02:10.355863+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:02:10.355863+0000","last_undegraded":"2023-07-06T22:02:10.355863+0000","last_fullsized":"2023-07-06T22:02:10.355863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:20:59.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.349660+0000","last_change":"2023-07-06T22:02:10.349660+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.349660+0000","last_undegraded":"2023-07-06T22:02:10.349660+0000","last_fullsized":"2023-07-06T22:02:10.349660+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":246,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.352465+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:02:10.352465+0000","last_peered":"2023-07-06T22:02:10.352465+0000","last_clean":"2023-07-06T22:02:10.352465+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:02:10.352465+0000","last_undegraded":"2023-07-06T22:02:10.352465+0000","last_fullsized":"2023-07-06T22:02:10.352465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:24:04.038621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.351329+0000","last_change":"2023-07-06T22:02:10.351329+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.351329+0000","last_undegraded":"2023-07-06T22:02:10.351329+0000","last_fullsized":"2023-07-06T22:02:10.351329+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":254,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.351128+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:02:10.351128+0000","last_peered":"2023-07-06T22:02:10.351128+0000","last_clean":"2023-07-06T22:02:10.351128+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:02:10.351128+0000","last_undegraded":"2023-07-06T22:02:10.351128+0000","last_fullsized":"2023-07-06T22:02:10.351128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:59:04.998289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350852+0000","last_change":"2023-07-06T22:02:10.350852+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350852+0000","last_undegraded":"2023-07-06T22:02:10.350852+0000","last_fullsized":"2023-07-06T22:02:10.350852+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":282,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.349357+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:02:10.349357+0000","last_peered":"2023-07-06T22:02:10.349357+0000","last_clean":"2023-07-06T22:02:10.349357+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:02:10.349357+0000","last_undegraded":"2023-07-06T22:02:10.349357+0000","last_fullsized":"2023-07-06T22:02:10.349357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:58.861974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.353110+0000","last_change":"2023-07-06T22:02:10.353110+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.353110+0000","last_undegraded":"2023-07-06T22:02:10.353110+0000","last_fullsized":"2023-07-06T22:02:10.353110+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":254,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.351627+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:02:10.351627+0000","last_peered":"2023-07-06T22:02:10.351627+0000","last_clean":"2023-07-06T22:02:10.351627+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:02:10.351627+0000","last_undegraded":"2023-07-06T22:02:10.351627+0000","last_fullsized":"2023-07-06T22:02:10.351627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:34:25.862413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350018+0000","last_change":"2023-07-06T22:02:10.350018+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350018+0000","last_undegraded":"2023-07-06T22:02:10.350018+0000","last_fullsized":"2023-07-06T22:02:10.350018+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":246,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.352760+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:02:10.352760+0000","last_peered":"2023-07-06T22:02:10.352760+0000","last_clean":"2023-07-06T22:02:10.352760+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:02:10.352760+0000","last_undegraded":"2023-07-06T22:02:10.352760+0000","last_fullsized":"2023-07-06T22:02:10.352760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:22:01.765341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575088,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37636,"kb_used_data":2492,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334204,"statfs":{"total":96636764160,"available":96598224896,"internally_reserved":0,"allocated":2551808,"data_stored":1631311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.70899999999999996},"min":{"1min":0.46899999999999997,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":1.0229999999999999,"5min":1.526,"15min":1.526},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0409999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.95299999999999996}]},{"osd":1,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":1.0580000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.47499999999999998,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":1.1100000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.47399999999999998,"5min":0.42799999999999999,"15min":0.377},"max":{"1min":1,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.42599999999999999},"max":{"1min":1.1339999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.78900000000000003}]},{"osd":3,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.42199999999999999},"max":{"1min":1.075,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.74199999999999999,"15min":0.74399999999999999},"min":{"1min":0.59699999999999998,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.0980000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.39400000000000002,"5min":0.377,"15min":0.32700000000000001},"max":{"1min":0.78700000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.35699999999999998},"max":{"1min":0.749,"5min":1.169,"15min":1.169},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71899999999999997,"15min":0.70599999999999996},"min":{"1min":0.58999999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":1.45,"15min":1.45},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.44400000000000001,"15min":0.41699999999999998},"max":{"1min":0.85799999999999998,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.88200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575088,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1941504,"data_stored":1033406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41399999999999998},"max":{"1min":1.089,"5min":1.607,"15min":1.607},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.751,"15min":0.74099999999999999},"min":{"1min":0.48399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1990000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.38500000000000001},"max":{"1min":0.85699999999999998,"5min":1.857,"15min":1.857},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.48899999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2270000000000001,"5min":1.778,"15min":1.778},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69399999999999995,"15min":0.71599999999999997},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":0.92700000000000005,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71299999999999997,"15min":0.73799999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0529999999999999,"5min":1.752,"15min":1.752},"last":0.752}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.165,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.499,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1020000000000001,"5min":1.794,"15min":1.794},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81699999999999995,"5min":0.95399999999999996,"15min":1.4390000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.80100000000000005,"5min":0.94099999999999995,"15min":1.0509999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.62},"min":{"1min":0.442,"5min":0.42099999999999999,"15min":0.38600000000000001},"max":{"1min":0.82599999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.39000000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.3089999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.0029999999999999,"15min":1.2549999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85399999999999998,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.76800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575087,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55092,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316748,"statfs":{"total":96636764160,"available":96580349952,"internally_reserved":0,"allocated":1945600,"data_stored":1034425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98099999999999998,"5min":1.49,"15min":1.49},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.55500000000000005,"5min":0.45400000000000001,"15min":0.35299999999999998},"max":{"1min":1.0209999999999999,"5min":1.21,"15min":1.21},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.54400000000000004,"5min":0.45600000000000002,"15min":0.40200000000000002},"max":{"1min":1.0369999999999999,"5min":1.143,"15min":1.143},"last":0.496},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.39900000000000002},"max":{"1min":0.99199999999999999,"5min":1.5,"15min":1.5},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44400000000000001},"max":{"1min":1.044,"5min":1.163,"15min":1.163},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.443},"max":{"1min":0.97999999999999998,"5min":1.127,"15min":1.127},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.008,"5min":1.109,"15min":1.109},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":0.85399999999999998,"5min":1.012,"15min":1.012},"last":0.434},{"interface":"front","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.371},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.02},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.44400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.34100000000000003},"max":{"1min":0.91400000000000003,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.628},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0589999999999999},"last":0.64700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51008,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320832,"statfs":{"total":96636764160,"available":96584531968,"internally_reserved":0,"allocated":1957888,"data_stored":1040943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.72099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":0.89400000000000002,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98799999999999999,"5min":1.208,"15min":1.208},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.55000000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1200000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.72099999999999997},"min":{"1min":0.47499999999999998,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":1.996,"15min":1.996},"last":0.71299999999999997}]},{"osd":2,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.54000000000000004,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.60199999999999998,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.0509999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.107}]},{"osd":3,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.746,"15min":0.754},"min":{"1min":0.58499999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2370000000000001,"5min":1.3640000000000001,"15min":3.2269999999999999},"last":0.85699999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.46000000000000002,"5min":0.35499999999999998,"15min":0.308},"max":{"1min":0.75,"5min":0.93899999999999995,"15min":0.94299999999999995},"last":1.022},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.60099999999999998},"min":{"1min":0.503,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.71899999999999997,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.47399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76800000000000002,"5min":1.036,"15min":1.036},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.65600000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":1,"15min":1},"last":1.1559999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93000000000000005,"5min":1.0149999999999999,"15min":1.0720000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.42299999999999999,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":1.01},"last":0.99099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575087,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51008,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320832,"statfs":{"total":96636764160,"available":96584531968,"internally_reserved":0,"allocated":1957888,"data_stored":1040943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.433,"15min":0.45200000000000001},"min":{"1min":0.25800000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.314},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48199999999999998,"15min":0.52900000000000003},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":2.77},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.442,"15min":0.48499999999999999},"min":{"1min":0.315,"5min":0.27500000000000002,"15min":0.24299999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":2.4359999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53800000000000003,"15min":0.57899999999999996},"min":{"1min":0.40400000000000003,"5min":0.313,"15min":0.313},"max":{"1min":1.107,"5min":1.107,"15min":1.351},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52400000000000002,"15min":0.54500000000000004},"min":{"1min":0.41199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.24},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.755},"min":{"1min":0.502,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.022,"5min":1.1020000000000001,"15min":1.3009999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.71099999999999997,"15min":0.77100000000000002},"min":{"1min":0.55000000000000004,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.383},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.75600000000000001,"15min":0.80300000000000005},"min":{"1min":0.63600000000000001,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.1259999999999999,"5min":1.349,"15min":1.4199999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.754,"15min":0.78900000000000003},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.0509999999999999,"5min":1.395,"15min":1.3999999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73999999999999999,"15min":0.79200000000000004},"min":{"1min":0.56100000000000005,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.093,"5min":1.371,"15min":1.425},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.748,"15min":0.80200000000000005},"min":{"1min":0.54400000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0920000000000001,"5min":1.097,"15min":3.1739999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.73499999999999999,"15min":0.80100000000000005},"min":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":3.097},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.75600000000000001,"15min":0.79900000000000004},"min":{"1min":0.59299999999999997,"5min":0.47099999999999997,"15min":0.45900000000000002},"max":{"1min":1.0740000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.63400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575087,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41140,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330700,"statfs":{"total":96636764160,"available":96594636800,"internally_reserved":0,"allocated":1945600,"data_stored":1034425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.42799999999999999,"15min":0.45100000000000001},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.623,"5min":0.68600000000000005,"15min":0.85999999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48499999999999999,"15min":0.5},"min":{"1min":0.38200000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.73399999999999999,"5min":0.82199999999999995,"15min":0.85999999999999999},"last":0.442}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.496,"15min":0.50900000000000001},"min":{"1min":0.39100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67900000000000005,"5min":0.878,"15min":0.88200000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.54400000000000004},"min":{"1min":0.38200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72799999999999998,"5min":0.83499999999999996,"15min":0.94399999999999995},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55600000000000005,"15min":0.57699999999999996},"min":{"1min":0.44,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.95399999999999996},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.47999999999999998,"15min":0.42899999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.57099999999999995,"5min":0.52100000000000002,"15min":0.41399999999999998},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.504}]},{"osd":5,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.52200000000000002,"15min":0.42899999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77800000000000002,"15min":0.80900000000000005},"min":{"1min":0.51500000000000001,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.48299999999999998},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.63900000000000001,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80700000000000005,"15min":0.82499999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.496},"max":{"1min":1.127,"5min":1.458,"15min":1.458},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.81399999999999995,"15min":0.83899999999999997},"min":{"1min":0.60199999999999998,"5min":0.54200000000000004,"15min":0.50700000000000001},"max":{"1min":1.415,"5min":1.573,"15min":1.573},"last":0.65400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575088,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59200,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312640,"statfs":{"total":96636764160,"available":96576143360,"internally_reserved":0,"allocated":1957888,"data_stored":1040943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.30199999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73599999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47799999999999998,"15min":0.501},"min":{"1min":0.36299999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68400000000000005,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.35299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71399999999999997,"5min":0.83999999999999997,"15min":0.88900000000000001},"last":0.437},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.52300000000000002},"min":{"1min":0.38200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.71399999999999997,"15min":0.87},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.57699999999999996},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.84599999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.53900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32000000000000001},"max":{"1min":0.74299999999999999,"5min":0.749,"15min":0.91200000000000003},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.54300000000000004,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.3140000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77100000000000002,"15min":0.78400000000000003},"min":{"1min":0.64400000000000002,"5min":0.48899999999999999,"15min":0.44},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.64300000000000002,"5min":0.48699999999999999,"15min":0.41899999999999998},"max":{"1min":1.129,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.77400000000000002,"15min":0.79100000000000004},"min":{"1min":0.57999999999999996,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":1.1859999999999999,"5min":1.3260000000000001,"15min":1.357},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.624,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1859999999999999,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.3029999999999999,"5min":1.4379999999999999,"15min":1.456},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.80100000000000005,"15min":0.81000000000000005},"min":{"1min":0.58499999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.67900000000000005,"5min":0.51900000000000002,"15min":0.5},"max":{"1min":1.2250000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.625}]}]},{"osd":0,"up_from":13,"seq":55834575087,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37632,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334208,"statfs":{"total":96636764160,"available":96598228992,"internally_reserved":0,"allocated":2547712,"data_stored":1630292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.42199999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.86399999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.374,"5min":0.28299999999999997,"15min":0.27600000000000002},"max":{"1min":0.67400000000000004,"5min":0.86799999999999999,"15min":0.98099999999999998},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47399999999999998,"15min":0.495},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.82399999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.496,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.33800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":1.2050000000000001},"last":0.443}]},{"osd":3,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47899999999999998,"15min":0.50600000000000001},"min":{"1min":0.35699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63,"5min":0.76600000000000001,"15min":1.151},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65900000000000003,"5min":0.78800000000000003,"15min":0.874},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.78400000000000003},"min":{"1min":0.55800000000000005,"5min":0.46400000000000002,"15min":0.45000000000000001},"max":{"1min":1.2190000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.48099999999999998,"5min":0.44600000000000001,"15min":0.40999999999999998},"max":{"1min":1.143,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57899999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96599999999999997,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.745,"15min":0.77600000000000002},"min":{"1min":0.52900000000000003,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.284,"5min":1.776,"15min":1.776},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.52200000000000002,"15min":0.48899999999999999},"max":{"1min":1.232,"5min":1.851,"15min":1.851},"last":0.873},{"interface":"front","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1739999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78600000000000003,"15min":0.80500000000000005},"min":{"1min":0.51200000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.252,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.81499999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.50900000000000001},"max":{"1min":1.1879999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":0.82799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:02:16.271 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:02:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.455+0000 7f53df740640 1 Processor -- start 2023-07-06T22:02:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.455+0000 7f53df740640 1 -- start start 2023-07-06T22:02:16.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.455+0000 7f53df740640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53d815ca30 0x7f53d806c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.455+0000 7f53df740640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d8070fd0 con 0x7f53d806c920 2023-07-06T22:02:16.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.455+0000 7f53df740640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d80c9e00 con 0x7f53d806af90 2023-07-06T22:02:16.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.455+0000 7f53df740640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d8070bb0 con 0x7f53d815ca30 2023-07-06T22:02:16.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.455+0000 7f53ddcdd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f53d806c920 0x7f53d8158c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50168/0 (socket says 172.21.15.55:50168) 2023-07-06T22:02:16.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.455+0000 7f53ddcdd640 1 -- 172.21.15.55:0/974520056 learned_addr learned my addr 172.21.15.55:0/974520056 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:16.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.455+0000 7f53dccdb640 1 --2- 172.21.15.55:0/974520056 >> v2:172.21.15.55:3300/0 conn(0x7f53d815ca30 0x7f53d806c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.455+0000 7f53dccdb640 1 -- 172.21.15.55:0/974520056 >> v1:172.21.15.138:6789/0 conn(0x7f53d806af90 legacy=0x7f53d80c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.455+0000 7f53dccdb640 1 -- 172.21.15.55:0/974520056 >> v1:172.21.15.55:6789/0 conn(0x7f53d806c920 legacy=0x7f53d8158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.455+0000 7f53dccdb640 1 -- 172.21.15.55:0/974520056 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d815ceb0 con 0x7f53d815ca30 2023-07-06T22:02:16.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.455+0000 7f53cffff640 1 -- 172.21.15.55:0/974520056 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216252241 0 0) 0x7f53d4001120 con 0x7f53d806af90 2023-07-06T22:02:16.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.459+0000 7f53dccdb640 1 --2- 172.21.15.55:0/974520056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d815ca30 0x7f53d806c3e0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f53c80097c0 tx=0x7f53c801c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f743be0f23daaec0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:16.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.459+0000 7f53cffff640 1 -- 172.21.15.55:0/974520056 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c80ab600 con 0x7f53d815ca30 2023-07-06T22:02:16.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.459+0000 7f53cffff640 1 -- 172.21.15.55:0/974520056 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c80a7050 con 0x7f53d815ca30 2023-07-06T22:02:16.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.459+0000 7f53cffff640 1 -- 172.21.15.55:0/974520056 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c80ab980 con 0x7f53d815ca30 2023-07-06T22:02:16.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.459+0000 7f53df740640 1 -- 172.21.15.55:0/974520056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d815ca30 msgr2=0x7f53d806c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.459+0000 7f53df740640 1 --2- 172.21.15.55:0/974520056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d815ca30 0x7f53d806c3e0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f53c80097c0 tx=0x7f53c801c280 comp rx=0 tx=0).stop 2023-07-06T22:02:16.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.459+0000 7f53df740640 1 -- 172.21.15.55:0/974520056 shutdown_connections 2023-07-06T22:02:16.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.459+0000 7f53df740640 1 --2- 172.21.15.55:0/974520056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d815ca30 0x7f53d806c3e0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.459+0000 7f53df740640 1 -- 172.21.15.55:0/974520056 >> 172.21.15.55:0/974520056 conn(0x7f53d80cfc60 msgr2=0x7f53d80cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:16.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.459+0000 7f53df740640 1 -- 172.21.15.55:0/974520056 shutdown_connections 2023-07-06T22:02:16.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.459+0000 7f53df740640 1 -- 172.21.15.55:0/974520056 wait complete. 2023-07-06T22:02:16.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53df740640 1 Processor -- start 2023-07-06T22:02:16.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53df740640 1 -- start start 2023-07-06T22:02:16.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53df740640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d806af90 0x7f53d80c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53df740640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53d806c920 0x7f53d8157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53df740640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53d815ca30 0x7f53d80c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53df740640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80c79e0 con 0x7f53d806af90 2023-07-06T22:02:16.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53df740640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d8157550 con 0x7f53d806c920 2023-07-06T22:02:16.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53df740640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80c7140 con 0x7f53d815ca30 2023-07-06T22:02:16.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53dd4dc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d806af90 0x7f53d80c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53dd4dc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d806af90 0x7f53d80c6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44046/0 (socket says 172.21.15.55:44046) 2023-07-06T22:02:16.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53dd4dc640 1 -- 172.21.15.55:0/2981117867 learned_addr learned my addr 172.21.15.55:0/2981117867 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:16.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53dccdb640 1 --2- 172.21.15.55:0/2981117867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53d806c920 0x7f53d8157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53ddcdd640 1 --2- 172.21.15.55:0/2981117867 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53d815ca30 0x7f53d80c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53dd4dc640 1 -- 172.21.15.55:0/2981117867 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53d815ca30 msgr2=0x7f53d80c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53dd4dc640 1 --2- 172.21.15.55:0/2981117867 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53d815ca30 0x7f53d80c4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53dd4dc640 1 -- 172.21.15.55:0/2981117867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53d806c920 msgr2=0x7f53d8157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53dd4dc640 1 --2- 172.21.15.55:0/2981117867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53d806c920 0x7f53d8157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53dd4dc640 1 -- 172.21.15.55:0/2981117867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c8009420 con 0x7f53d806af90 2023-07-06T22:02:16.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53dd4dc640 1 --2- 172.21.15.55:0/2981117867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d806af90 0x7f53d80c6a80 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c4a0 tx=0x7f53d400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:16.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53cdffb640 1 -- 172.21.15.55:0/2981117867 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4005480 con 0x7f53d806af90 2023-07-06T22:02:16.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53cdffb640 1 -- 172.21.15.55:0/2981117867 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d4003600 con 0x7f53d806af90 2023-07-06T22:02:16.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53cdffb640 1 -- 172.21.15.55:0/2981117867 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d40039f0 con 0x7f53d806af90 2023-07-06T22:02:16.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.463+0000 7f53df740640 1 -- 172.21.15.55:0/2981117867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d80c7420 con 0x7f53d806af90 2023-07-06T22:02:16.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.467+0000 7f53df740640 1 -- 172.21.15.55:0/2981117867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d80c2bf0 con 0x7f53d806af90 2023-07-06T22:02:16.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.467+0000 7f53df740640 1 -- 172.21.15.55:0/2981117867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d8066d60 con 0x7f53d806af90 2023-07-06T22:02:16.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.467+0000 7f53cdffb640 1 -- 172.21.15.55:0/2981117867 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f53d4003b50 con 0x7f53d806af90 2023-07-06T22:02:16.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.467+0000 7f53cdffb640 1 --2- 172.21.15.55:0/2981117867 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f53bc0663a0 0x7f53bc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.467+0000 7f53cdffb640 1 -- 172.21.15.55:0/2981117867 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f53d4083400 con 0x7f53d806af90 2023-07-06T22:02:16.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.467+0000 7f53dccdb640 1 --2- 172.21.15.55:0/2981117867 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f53bc0663a0 0x7f53bc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.467+0000 7f53dccdb640 1 --2- 172.21.15.55:0/2981117867 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f53bc0663a0 0x7f53bc068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f53c80ad000 tx=0x7f53c80a6000 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:16.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.471+0000 7f53cdffb640 1 -- 172.21.15.55:0/2981117867 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f53d4054090 con 0x7f53d806af90 2023-07-06T22:02:16.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.623+0000 7f53df740640 1 -- 172.21.15.55:0/2981117867 --> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53d806ccf0 con 0x7f53bc0663a0 2023-07-06T22:02:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.631+0000 7f53cdffb640 1 -- 172.21.15.55:0/2981117867 <== mgr.9489 v2:172.21.15.55:6832/433956277 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299265 (secure 0 0 0) 0x7f53c80bc090 con 0x7f53bc0663a0 2023-07-06T22:02:16.634 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:16.635 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:02:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.635+0000 7f53df740640 1 -- 172.21.15.55:0/2981117867 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f53bc0663a0 msgr2=0x7f53bc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.635+0000 7f53df740640 1 --2- 172.21.15.55:0/2981117867 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f53bc0663a0 0x7f53bc068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f53c80ad000 tx=0x7f53c80a6000 comp rx=0 tx=0).stop 2023-07-06T22:02:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.635+0000 7f53df740640 1 -- 172.21.15.55:0/2981117867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d806af90 msgr2=0x7f53d80c6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.635+0000 7f53df740640 1 --2- 172.21.15.55:0/2981117867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d806af90 0x7f53d80c6a80 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c4a0 tx=0x7f53d400c960 comp rx=0 tx=0).stop 2023-07-06T22:02:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.635+0000 7f53df740640 1 -- 172.21.15.55:0/2981117867 shutdown_connections 2023-07-06T22:02:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.635+0000 7f53df740640 1 --2- 172.21.15.55:0/2981117867 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53d815ca30 0x7f53d80c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.635+0000 7f53df740640 1 --2- 172.21.15.55:0/2981117867 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f53bc0663a0 0x7f53bc068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.635+0000 7f53df740640 1 --2- 172.21.15.55:0/2981117867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53d806c920 0x7f53d8157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.635+0000 7f53df740640 1 --2- 172.21.15.55:0/2981117867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d806af90 0x7f53d80c6a80 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.635+0000 7f53df740640 1 -- 172.21.15.55:0/2981117867 >> 172.21.15.55:0/2981117867 conn(0x7f53d80cfc60 msgr2=0x7f53d806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.635+0000 7f53df740640 1 -- 172.21.15.55:0/2981117867 shutdown_connections 2023-07-06T22:02:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.635+0000 7f53df740640 1 -- 172.21.15.55:0/2981117867 wait complete. 2023-07-06T22:02:16.654 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T22:02:14.857760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":369756,"kb_used_data":16412,"kb_used_omap":0,"kb_used_meta":353280,"kb_avail":754604964,"statfs":{"total":773094113280,"available":772715483136,"internally_reserved":0,"allocated":16805888,"data_stored":9486688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":361758720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.513636"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348458+0000","last_change":"2023-07-06T22:02:10.348458+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348458+0000","last_undegraded":"2023-07-06T22:02:10.348458+0000","last_fullsized":"2023-07-06T22:02:10.348458+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.351311+0000","last_change":"2023-07-06T22:02:10.351311+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.351311+0000","last_undegraded":"2023-07-06T22:02:10.351311+0000","last_fullsized":"2023-07-06T22:02:10.351311+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.346907+0000","last_change":"2023-07-06T22:02:10.346907+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.346907+0000","last_undegraded":"2023-07-06T22:02:10.346907+0000","last_fullsized":"2023-07-06T22:02:10.346907+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.346919+0000","last_change":"2023-07-06T22:02:10.346919+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.346919+0000","last_undegraded":"2023-07-06T22:02:10.346919+0000","last_fullsized":"2023-07-06T22:02:10.346919+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.355250+0000","last_change":"2023-07-06T22:02:10.355250+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.355250+0000","last_undegraded":"2023-07-06T22:02:10.355250+0000","last_fullsized":"2023-07-06T22:02:10.355250+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.351468+0000","last_change":"2023-07-06T22:02:10.351468+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.351468+0000","last_undegraded":"2023-07-06T22:02:10.351468+0000","last_fullsized":"2023-07-06T22:02:10.351468+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.353420+0000","last_change":"2023-07-06T22:02:10.353420+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.353420+0000","last_undegraded":"2023-07-06T22:02:10.353420+0000","last_fullsized":"2023-07-06T22:02:10.353420+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.346907+0000","last_change":"2023-07-06T22:02:10.346907+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.346907+0000","last_undegraded":"2023-07-06T22:02:10.346907+0000","last_fullsized":"2023-07-06T22:02:10.346907+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.351943+0000","last_change":"2023-07-06T22:02:10.351943+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.351943+0000","last_undegraded":"2023-07-06T22:02:10.351943+0000","last_fullsized":"2023-07-06T22:02:10.351943+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348373+0000","last_change":"2023-07-06T22:02:10.348373+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348373+0000","last_undegraded":"2023-07-06T22:02:10.348373+0000","last_fullsized":"2023-07-06T22:02:10.348373+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.353108+0000","last_change":"2023-07-06T22:02:10.353108+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.353108+0000","last_undegraded":"2023-07-06T22:02:10.353108+0000","last_fullsized":"2023-07-06T22:02:10.353108+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348296+0000","last_change":"2023-07-06T22:02:10.348296+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348296+0000","last_undegraded":"2023-07-06T22:02:10.348296+0000","last_fullsized":"2023-07-06T22:02:10.348296+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350256+0000","last_change":"2023-07-06T22:02:10.350256+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350256+0000","last_undegraded":"2023-07-06T22:02:10.350256+0000","last_fullsized":"2023-07-06T22:02:10.350256+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348791+0000","last_change":"2023-07-06T22:02:10.348791+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348791+0000","last_undegraded":"2023-07-06T22:02:10.348791+0000","last_fullsized":"2023-07-06T22:02:10.348791+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.347297+0000","last_change":"2023-07-06T22:02:10.347297+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.347297+0000","last_undegraded":"2023-07-06T22:02:10.347297+0000","last_fullsized":"2023-07-06T22:02:10.347297+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350778+0000","last_change":"2023-07-06T22:02:10.350778+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350778+0000","last_undegraded":"2023-07-06T22:02:10.350778+0000","last_fullsized":"2023-07-06T22:02:10.350778+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.347830+0000","last_change":"2023-07-06T22:02:10.347830+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.347830+0000","last_undegraded":"2023-07-06T22:02:10.347830+0000","last_fullsized":"2023-07-06T22:02:10.347830+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350357+0000","last_change":"2023-07-06T22:02:10.350357+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350357+0000","last_undegraded":"2023-07-06T22:02:10.350357+0000","last_fullsized":"2023-07-06T22:02:10.350357+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350486+0000","last_change":"2023-07-06T22:02:10.350486+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350486+0000","last_undegraded":"2023-07-06T22:02:10.350486+0000","last_fullsized":"2023-07-06T22:02:10.350486+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.349922+0000","last_change":"2023-07-06T22:02:10.349922+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.349922+0000","last_undegraded":"2023-07-06T22:02:10.349922+0000","last_fullsized":"2023-07-06T22:02:10.349922+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.349650+0000","last_change":"2023-07-06T22:02:10.349650+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.349650+0000","last_undegraded":"2023-07-06T22:02:10.349650+0000","last_fullsized":"2023-07-06T22:02:10.349650+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.347304+0000","last_change":"2023-07-06T22:02:10.347304+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.347304+0000","last_undegraded":"2023-07-06T22:02:10.347304+0000","last_fullsized":"2023-07-06T22:02:10.347304+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350928+0000","last_change":"2023-07-06T22:02:10.350928+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350928+0000","last_undegraded":"2023-07-06T22:02:10.350928+0000","last_fullsized":"2023-07-06T22:02:10.350928+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348432+0000","last_change":"2023-07-06T22:02:10.348432+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348432+0000","last_undegraded":"2023-07-06T22:02:10.348432+0000","last_fullsized":"2023-07-06T22:02:10.348432+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350941+0000","last_change":"2023-07-06T22:02:10.350941+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350941+0000","last_undegraded":"2023-07-06T22:02:10.350941+0000","last_fullsized":"2023-07-06T22:02:10.350941+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"148'271","reported_seq":984,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.349369+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:02:10.349369+0000","last_peered":"2023-07-06T22:02:10.349369+0000","last_clean":"2023-07-06T22:02:10.349369+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:02:10.349369+0000","last_undegraded":"2023-07-06T22:02:10.349369+0000","last_fullsized":"2023-07-06T22:02:10.349369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:56:11.170083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":246,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.352328+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:02:10.352328+0000","last_peered":"2023-07-06T22:02:10.352328+0000","last_clean":"2023-07-06T22:02:10.352328+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:02:10.352328+0000","last_undegraded":"2023-07-06T22:02:10.352328+0000","last_fullsized":"2023-07-06T22:02:10.352328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:42:39.018705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.347304+0000","last_change":"2023-07-06T22:02:10.347304+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.347304+0000","last_undegraded":"2023-07-06T22:02:10.347304+0000","last_fullsized":"2023-07-06T22:02:10.347304+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":282,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.349250+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:02:10.349250+0000","last_peered":"2023-07-06T22:02:10.349250+0000","last_clean":"2023-07-06T22:02:10.349250+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:02:10.349250+0000","last_undegraded":"2023-07-06T22:02:10.349250+0000","last_fullsized":"2023-07-06T22:02:10.349250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:51:59.485841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.348269+0000","last_change":"2023-07-06T22:02:10.348269+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.348269+0000","last_undegraded":"2023-07-06T22:02:10.348269+0000","last_fullsized":"2023-07-06T22:02:10.348269+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.355863+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:02:10.355863+0000","last_peered":"2023-07-06T22:02:10.355863+0000","last_clean":"2023-07-06T22:02:10.355863+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:02:10.355863+0000","last_undegraded":"2023-07-06T22:02:10.355863+0000","last_fullsized":"2023-07-06T22:02:10.355863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:20:59.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.349660+0000","last_change":"2023-07-06T22:02:10.349660+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.349660+0000","last_undegraded":"2023-07-06T22:02:10.349660+0000","last_fullsized":"2023-07-06T22:02:10.349660+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":246,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.352465+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:02:10.352465+0000","last_peered":"2023-07-06T22:02:10.352465+0000","last_clean":"2023-07-06T22:02:10.352465+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:02:10.352465+0000","last_undegraded":"2023-07-06T22:02:10.352465+0000","last_fullsized":"2023-07-06T22:02:10.352465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:24:04.038621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.351329+0000","last_change":"2023-07-06T22:02:10.351329+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.351329+0000","last_undegraded":"2023-07-06T22:02:10.351329+0000","last_fullsized":"2023-07-06T22:02:10.351329+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":254,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.351128+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:02:10.351128+0000","last_peered":"2023-07-06T22:02:10.351128+0000","last_clean":"2023-07-06T22:02:10.351128+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:02:10.351128+0000","last_undegraded":"2023-07-06T22:02:10.351128+0000","last_fullsized":"2023-07-06T22:02:10.351128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:59:04.998289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350852+0000","last_change":"2023-07-06T22:02:10.350852+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350852+0000","last_undegraded":"2023-07-06T22:02:10.350852+0000","last_fullsized":"2023-07-06T22:02:10.350852+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":282,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.349357+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:02:10.349357+0000","last_peered":"2023-07-06T22:02:10.349357+0000","last_clean":"2023-07-06T22:02:10.349357+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:02:10.349357+0000","last_undegraded":"2023-07-06T22:02:10.349357+0000","last_fullsized":"2023-07-06T22:02:10.349357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:58.861974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.353110+0000","last_change":"2023-07-06T22:02:10.353110+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.353110+0000","last_undegraded":"2023-07-06T22:02:10.353110+0000","last_fullsized":"2023-07-06T22:02:10.353110+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":254,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.351627+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:02:10.351627+0000","last_peered":"2023-07-06T22:02:10.351627+0000","last_clean":"2023-07-06T22:02:10.351627+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:02:10.351627+0000","last_undegraded":"2023-07-06T22:02:10.351627+0000","last_fullsized":"2023-07-06T22:02:10.351627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:34:25.862413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:02:11.342846+0000","last_change":"2023-07-06T22:02:11.342846+0000","last_active":"2023-07-06T22:02:11.342846+0000","last_peered":"2023-07-06T22:02:11.342846+0000","last_clean":"2023-07-06T22:02:11.342846+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:11.342846+0000","last_undegraded":"2023-07-06T22:02:11.342846+0000","last_fullsized":"2023-07-06T22:02:11.342846+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":157,"state":"creating+peering","last_fresh":"2023-07-06T22:02:10.350018+0000","last_change":"2023-07-06T22:02:10.350018+0000","last_active":"2023-07-06T22:02:10.334070+0000","last_peered":"2023-07-06T22:02:10.334070+0000","last_clean":"2023-07-06T22:02:10.334070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:02:10.350018+0000","last_undegraded":"2023-07-06T22:02:10.350018+0000","last_fullsized":"2023-07-06T22:02:10.350018+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":246,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-06T22:02:10.352760+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:02:10.352760+0000","last_peered":"2023-07-06T22:02:10.352760+0000","last_clean":"2023-07-06T22:02:10.352760+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:02:10.352760+0000","last_undegraded":"2023-07-06T22:02:10.352760+0000","last_fullsized":"2023-07-06T22:02:10.352760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:22:01.765341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575088,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37636,"kb_used_data":2492,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334204,"statfs":{"total":96636764160,"available":96598224896,"internally_reserved":0,"allocated":2551808,"data_stored":1631311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.70899999999999996},"min":{"1min":0.46899999999999997,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":1.0229999999999999,"5min":1.526,"15min":1.526},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0409999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.95299999999999996}]},{"osd":1,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":1.0580000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.47499999999999998,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":1.1100000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.47399999999999998,"5min":0.42799999999999999,"15min":0.377},"max":{"1min":1,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.42599999999999999},"max":{"1min":1.1339999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.78900000000000003}]},{"osd":3,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.42199999999999999},"max":{"1min":1.075,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.74199999999999999,"15min":0.74399999999999999},"min":{"1min":0.59699999999999998,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.0980000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.39400000000000002,"5min":0.377,"15min":0.32700000000000001},"max":{"1min":0.78700000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.35699999999999998},"max":{"1min":0.749,"5min":1.169,"15min":1.169},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71899999999999997,"15min":0.70599999999999996},"min":{"1min":0.58999999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":1.45,"15min":1.45},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.44400000000000001,"15min":0.41699999999999998},"max":{"1min":0.85799999999999998,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.88200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575088,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1941504,"data_stored":1033406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41399999999999998},"max":{"1min":1.089,"5min":1.607,"15min":1.607},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.751,"15min":0.74099999999999999},"min":{"1min":0.48399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1990000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.38500000000000001},"max":{"1min":0.85699999999999998,"5min":1.857,"15min":1.857},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.48899999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2270000000000001,"5min":1.778,"15min":1.778},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69399999999999995,"15min":0.71599999999999997},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":0.92700000000000005,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71299999999999997,"15min":0.73799999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0529999999999999,"5min":1.752,"15min":1.752},"last":0.752}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.165,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.499,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1020000000000001,"5min":1.794,"15min":1.794},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81699999999999995,"5min":0.95399999999999996,"15min":1.4390000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.80100000000000005,"5min":0.94099999999999995,"15min":1.0509999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.62},"min":{"1min":0.442,"5min":0.42099999999999999,"15min":0.38600000000000001},"max":{"1min":0.82599999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.39000000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.3089999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.0029999999999999,"15min":1.2549999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85399999999999998,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.76800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575087,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55092,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316748,"statfs":{"total":96636764160,"available":96580349952,"internally_reserved":0,"allocated":1945600,"data_stored":1034425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98099999999999998,"5min":1.49,"15min":1.49},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.55500000000000005,"5min":0.45400000000000001,"15min":0.35299999999999998},"max":{"1min":1.0209999999999999,"5min":1.21,"15min":1.21},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.54400000000000004,"5min":0.45600000000000002,"15min":0.40200000000000002},"max":{"1min":1.0369999999999999,"5min":1.143,"15min":1.143},"last":0.496},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.39900000000000002},"max":{"1min":0.99199999999999999,"5min":1.5,"15min":1.5},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44400000000000001},"max":{"1min":1.044,"5min":1.163,"15min":1.163},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.443},"max":{"1min":0.97999999999999998,"5min":1.127,"15min":1.127},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.008,"5min":1.109,"15min":1.109},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":0.85399999999999998,"5min":1.012,"15min":1.012},"last":0.434},{"interface":"front","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.371},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.02},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.44400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.34100000000000003},"max":{"1min":0.91400000000000003,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":0.628},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0589999999999999},"last":0.64700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51008,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320832,"statfs":{"total":96636764160,"available":96584531968,"internally_reserved":0,"allocated":1957888,"data_stored":1040943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.72099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":0.89400000000000002,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98799999999999999,"5min":1.208,"15min":1.208},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.55000000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1200000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.72099999999999997},"min":{"1min":0.47499999999999998,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":1.996,"15min":1.996},"last":0.71299999999999997}]},{"osd":2,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.54000000000000004,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.60199999999999998,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.0509999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.107}]},{"osd":3,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.746,"15min":0.754},"min":{"1min":0.58499999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2370000000000001,"5min":1.3640000000000001,"15min":3.2269999999999999},"last":0.85699999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.46000000000000002,"5min":0.35499999999999998,"15min":0.308},"max":{"1min":0.75,"5min":0.93899999999999995,"15min":0.94299999999999995},"last":1.022},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.60099999999999998},"min":{"1min":0.503,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.71899999999999997,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.47399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76800000000000002,"5min":1.036,"15min":1.036},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.65600000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":1,"15min":1},"last":1.1559999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93000000000000005,"5min":1.0149999999999999,"15min":1.0720000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.42299999999999999,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":1.01},"last":0.99099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575087,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51008,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320832,"statfs":{"total":96636764160,"available":96584531968,"internally_reserved":0,"allocated":1957888,"data_stored":1040943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.433,"15min":0.45200000000000001},"min":{"1min":0.25800000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.314},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48199999999999998,"15min":0.52900000000000003},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":2.77},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.442,"15min":0.48499999999999999},"min":{"1min":0.315,"5min":0.27500000000000002,"15min":0.24299999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":2.4359999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53800000000000003,"15min":0.57899999999999996},"min":{"1min":0.40400000000000003,"5min":0.313,"15min":0.313},"max":{"1min":1.107,"5min":1.107,"15min":1.351},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52400000000000002,"15min":0.54500000000000004},"min":{"1min":0.41199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.24},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.755},"min":{"1min":0.502,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.022,"5min":1.1020000000000001,"15min":1.3009999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.71099999999999997,"15min":0.77100000000000002},"min":{"1min":0.55000000000000004,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.383},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.75600000000000001,"15min":0.80300000000000005},"min":{"1min":0.63600000000000001,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.1259999999999999,"5min":1.349,"15min":1.4199999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.754,"15min":0.78900000000000003},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.0509999999999999,"5min":1.395,"15min":1.3999999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73999999999999999,"15min":0.79200000000000004},"min":{"1min":0.56100000000000005,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.093,"5min":1.371,"15min":1.425},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.748,"15min":0.80200000000000005},"min":{"1min":0.54400000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0920000000000001,"5min":1.097,"15min":3.1739999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.73499999999999999,"15min":0.80100000000000005},"min":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":3.097},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.75600000000000001,"15min":0.79900000000000004},"min":{"1min":0.59299999999999997,"5min":0.47099999999999997,"15min":0.45900000000000002},"max":{"1min":1.0740000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.63400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575087,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41140,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330700,"statfs":{"total":96636764160,"available":96594636800,"internally_reserved":0,"allocated":1945600,"data_stored":1034425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.42799999999999999,"15min":0.45100000000000001},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.623,"5min":0.68600000000000005,"15min":0.85999999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48499999999999999,"15min":0.5},"min":{"1min":0.38200000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.73399999999999999,"5min":0.82199999999999995,"15min":0.85999999999999999},"last":0.442}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.496,"15min":0.50900000000000001},"min":{"1min":0.39100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67900000000000005,"5min":0.878,"15min":0.88200000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.54400000000000004},"min":{"1min":0.38200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72799999999999998,"5min":0.83499999999999996,"15min":0.94399999999999995},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55600000000000005,"15min":0.57699999999999996},"min":{"1min":0.44,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.95399999999999996},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.47999999999999998,"15min":0.42899999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.57099999999999995,"5min":0.52100000000000002,"15min":0.41399999999999998},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.504}]},{"osd":5,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.52200000000000002,"15min":0.42899999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77800000000000002,"15min":0.80900000000000005},"min":{"1min":0.51500000000000001,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.48299999999999998},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.63900000000000001,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80700000000000005,"15min":0.82499999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.496},"max":{"1min":1.127,"5min":1.458,"15min":1.458},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.81399999999999995,"15min":0.83899999999999997},"min":{"1min":0.60199999999999998,"5min":0.54200000000000004,"15min":0.50700000000000001},"max":{"1min":1.415,"5min":1.573,"15min":1.573},"last":0.65400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575088,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59200,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312640,"statfs":{"total":96636764160,"available":96576143360,"internally_reserved":0,"allocated":1957888,"data_stored":1040943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.30199999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73599999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47799999999999998,"15min":0.501},"min":{"1min":0.36299999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68400000000000005,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.35299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71399999999999997,"5min":0.83999999999999997,"15min":0.88900000000000001},"last":0.437},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.52300000000000002},"min":{"1min":0.38200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.71399999999999997,"15min":0.87},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.57699999999999996},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.84599999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.53900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32000000000000001},"max":{"1min":0.74299999999999999,"5min":0.749,"15min":0.91200000000000003},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.54300000000000004,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.3140000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77100000000000002,"15min":0.78400000000000003},"min":{"1min":0.64400000000000002,"5min":0.48899999999999999,"15min":0.44},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.64300000000000002,"5min":0.48699999999999999,"15min":0.41899999999999998},"max":{"1min":1.129,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.77400000000000002,"15min":0.79100000000000004},"min":{"1min":0.57999999999999996,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":1.1859999999999999,"5min":1.3260000000000001,"15min":1.357},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.624,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1859999999999999,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.3029999999999999,"5min":1.4379999999999999,"15min":1.456},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.80100000000000005,"15min":0.81000000000000005},"min":{"1min":0.58499999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.67900000000000005,"5min":0.51900000000000002,"15min":0.5},"max":{"1min":1.2250000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.625}]}]},{"osd":0,"up_from":13,"seq":55834575087,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37632,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334208,"statfs":{"total":96636764160,"available":96598228992,"internally_reserved":0,"allocated":2547712,"data_stored":1630292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.42199999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.86399999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.374,"5min":0.28299999999999997,"15min":0.27600000000000002},"max":{"1min":0.67400000000000004,"5min":0.86799999999999999,"15min":0.98099999999999998},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47399999999999998,"15min":0.495},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.82399999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.496,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.33800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":1.2050000000000001},"last":0.443}]},{"osd":3,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47899999999999998,"15min":0.50600000000000001},"min":{"1min":0.35699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63,"5min":0.76600000000000001,"15min":1.151},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65900000000000003,"5min":0.78800000000000003,"15min":0.874},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.78400000000000003},"min":{"1min":0.55800000000000005,"5min":0.46400000000000002,"15min":0.45000000000000001},"max":{"1min":1.2190000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.48099999999999998,"5min":0.44600000000000001,"15min":0.40999999999999998},"max":{"1min":1.143,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57899999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96599999999999997,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.745,"15min":0.77600000000000002},"min":{"1min":0.52900000000000003,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.284,"5min":1.776,"15min":1.776},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.52200000000000002,"15min":0.48899999999999999},"max":{"1min":1.232,"5min":1.851,"15min":1.851},"last":0.873},{"interface":"front","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1739999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78600000000000003,"15min":0.80500000000000005},"min":{"1min":0.51200000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.252,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.81499999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.50900000000000001},"max":{"1min":1.1879999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":0.82799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:02:16.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3f is not active+clean 2023-07-06T22:02:16.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3e is not active+clean 2023-07-06T22:02:16.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3d is not active+clean 2023-07-06T22:02:16.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3c is not active+clean 2023-07-06T22:02:16.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3b is not active+clean 2023-07-06T22:02:16.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3a is not active+clean 2023-07-06T22:02:16.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.39 is not active+clean 2023-07-06T22:02:16.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.38 is not active+clean 2023-07-06T22:02:16.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.37 is not active+clean 2023-07-06T22:02:16.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.36 is not active+clean 2023-07-06T22:02:16.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.35 is not active+clean 2023-07-06T22:02:16.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.34 is not active+clean 2023-07-06T22:02:16.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.33 is not active+clean 2023-07-06T22:02:16.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.32 is not active+clean 2023-07-06T22:02:16.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.31 is not active+clean 2023-07-06T22:02:16.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.30 is not active+clean 2023-07-06T22:02:16.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2f is not active+clean 2023-07-06T22:02:16.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2e is not active+clean 2023-07-06T22:02:16.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2d is not active+clean 2023-07-06T22:02:16.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2c is not active+clean 2023-07-06T22:02:16.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2b is not active+clean 2023-07-06T22:02:16.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2a is not active+clean 2023-07-06T22:02:16.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.29 is not active+clean 2023-07-06T22:02:16.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.28 is not active+clean 2023-07-06T22:02:16.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.27 is not active+clean 2023-07-06T22:02:16.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.26 is not active+clean 2023-07-06T22:02:16.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.25 is not active+clean 2023-07-06T22:02:16.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.24 is not active+clean 2023-07-06T22:02:16.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.23 is not active+clean 2023-07-06T22:02:16.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.22 is not active+clean 2023-07-06T22:02:16.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.21 is not active+clean 2023-07-06T22:02:16.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.20 is not active+clean 2023-07-06T22:02:16.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1e is not active+clean 2023-07-06T22:02:16.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1f is not active+clean 2023-07-06T22:02:16.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.348458+0000', 'last_change': '2023-07-06T22:02:10.348458+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.348458+0000', 'last_undegraded': '2023-07-06T22:02:10.348458+0000', 'last_fullsized': '2023-07-06T22:02:10.348458+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:02:16.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1f is not active+clean 2023-07-06T22:02:16.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1e is not active+clean 2023-07-06T22:02:16.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.351311+0000', 'last_change': '2023-07-06T22:02:10.351311+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.351311+0000', 'last_undegraded': '2023-07-06T22:02:10.351311+0000', 'last_fullsized': '2023-07-06T22:02:10.351311+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:02:16.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1c is not active+clean 2023-07-06T22:02:16.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2023-07-06T22:02:16.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.346907+0000', 'last_change': '2023-07-06T22:02:10.346907+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.346907+0000', 'last_undegraded': '2023-07-06T22:02:10.346907+0000', 'last_fullsized': '2023-07-06T22:02:10.346907+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T22:02:16.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1d is not active+clean 2023-07-06T22:02:16.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2023-07-06T22:02:16.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.346919+0000', 'last_change': '2023-07-06T22:02:10.346919+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.346919+0000', 'last_undegraded': '2023-07-06T22:02:10.346919+0000', 'last_fullsized': '2023-07-06T22:02:10.346919+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T22:02:16.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1a is not active+clean 2023-07-06T22:02:16.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1b is not active+clean 2023-07-06T22:02:16.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.355250+0000', 'last_change': '2023-07-06T22:02:10.355250+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.355250+0000', 'last_undegraded': '2023-07-06T22:02:10.355250+0000', 'last_fullsized': '2023-07-06T22:02:10.355250+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:02:16.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1b is not active+clean 2023-07-06T22:02:16.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1a is not active+clean 2023-07-06T22:02:16.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.351468+0000', 'last_change': '2023-07-06T22:02:10.351468+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.351468+0000', 'last_undegraded': '2023-07-06T22:02:10.351468+0000', 'last_fullsized': '2023-07-06T22:02:10.351468+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:02:16.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.18 is not active+clean 2023-07-06T22:02:16.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.19 is not active+clean 2023-07-06T22:02:16.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.353420+0000', 'last_change': '2023-07-06T22:02:10.353420+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.353420+0000', 'last_undegraded': '2023-07-06T22:02:10.353420+0000', 'last_fullsized': '2023-07-06T22:02:10.353420+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:02:16.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.19 is not active+clean 2023-07-06T22:02:16.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2023-07-06T22:02:16.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.346907+0000', 'last_change': '2023-07-06T22:02:10.346907+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.346907+0000', 'last_undegraded': '2023-07-06T22:02:10.346907+0000', 'last_fullsized': '2023-07-06T22:02:10.346907+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T22:02:16.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.e is not active+clean 2023-07-06T22:02:16.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.f is not active+clean 2023-07-06T22:02:16.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.351943+0000', 'last_change': '2023-07-06T22:02:10.351943+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.351943+0000', 'last_undegraded': '2023-07-06T22:02:10.351943+0000', 'last_fullsized': '2023-07-06T22:02:10.351943+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:02:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.f is not active+clean 2023-07-06T22:02:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.e is not active+clean 2023-07-06T22:02:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.348373+0000', 'last_change': '2023-07-06T22:02:10.348373+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.348373+0000', 'last_undegraded': '2023-07-06T22:02:10.348373+0000', 'last_fullsized': '2023-07-06T22:02:10.348373+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:02:16.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.c is not active+clean 2023-07-06T22:02:16.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.d is not active+clean 2023-07-06T22:02:16.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.353108+0000', 'last_change': '2023-07-06T22:02:10.353108+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.353108+0000', 'last_undegraded': '2023-07-06T22:02:10.353108+0000', 'last_fullsized': '2023-07-06T22:02:10.353108+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:02:16.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.d is not active+clean 2023-07-06T22:02:16.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.c is not active+clean 2023-07-06T22:02:16.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.348296+0000', 'last_change': '2023-07-06T22:02:10.348296+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.348296+0000', 'last_undegraded': '2023-07-06T22:02:10.348296+0000', 'last_fullsized': '2023-07-06T22:02:10.348296+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:02:16.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.a is not active+clean 2023-07-06T22:02:16.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.b is not active+clean 2023-07-06T22:02:16.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.350256+0000', 'last_change': '2023-07-06T22:02:10.350256+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.350256+0000', 'last_undegraded': '2023-07-06T22:02:10.350256+0000', 'last_fullsized': '2023-07-06T22:02:10.350256+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T22:02:16.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.b is not active+clean 2023-07-06T22:02:16.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.a is not active+clean 2023-07-06T22:02:16.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.348791+0000', 'last_change': '2023-07-06T22:02:10.348791+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.348791+0000', 'last_undegraded': '2023-07-06T22:02:10.348791+0000', 'last_fullsized': '2023-07-06T22:02:10.348791+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:02:16.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.8 is not active+clean 2023-07-06T22:02:16.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.9 is not active+clean 2023-07-06T22:02:16.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.347297+0000', 'last_change': '2023-07-06T22:02:10.347297+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.347297+0000', 'last_undegraded': '2023-07-06T22:02:10.347297+0000', 'last_fullsized': '2023-07-06T22:02:10.347297+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:02:16.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.9 is not active+clean 2023-07-06T22:02:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2023-07-06T22:02:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.350778+0000', 'last_change': '2023-07-06T22:02:10.350778+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.350778+0000', 'last_undegraded': '2023-07-06T22:02:10.350778+0000', 'last_fullsized': '2023-07-06T22:02:10.350778+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T22:02:16.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.6 is not active+clean 2023-07-06T22:02:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.7 is not active+clean 2023-07-06T22:02:16.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.347830+0000', 'last_change': '2023-07-06T22:02:10.347830+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.347830+0000', 'last_undegraded': '2023-07-06T22:02:10.347830+0000', 'last_fullsized': '2023-07-06T22:02:10.347830+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:02:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.7 is not active+clean 2023-07-06T22:02:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.6 is not active+clean 2023-07-06T22:02:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.350357+0000', 'last_change': '2023-07-06T22:02:10.350357+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.350357+0000', 'last_undegraded': '2023-07-06T22:02:10.350357+0000', 'last_fullsized': '2023-07-06T22:02:10.350357+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:02:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.4 is not active+clean 2023-07-06T22:02:16.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.5 is not active+clean 2023-07-06T22:02:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.350486+0000', 'last_change': '2023-07-06T22:02:10.350486+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.350486+0000', 'last_undegraded': '2023-07-06T22:02:10.350486+0000', 'last_fullsized': '2023-07-06T22:02:10.350486+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:02:16.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.5 is not active+clean 2023-07-06T22:02:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.4 is not active+clean 2023-07-06T22:02:16.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.349922+0000', 'last_change': '2023-07-06T22:02:10.349922+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.349922+0000', 'last_undegraded': '2023-07-06T22:02:10.349922+0000', 'last_fullsized': '2023-07-06T22:02:10.349922+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:02:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2 is not active+clean 2023-07-06T22:02:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3 is not active+clean 2023-07-06T22:02:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.349650+0000', 'last_change': '2023-07-06T22:02:10.349650+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.349650+0000', 'last_undegraded': '2023-07-06T22:02:10.349650+0000', 'last_fullsized': '2023-07-06T22:02:10.349650+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T22:02:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3 is not active+clean 2023-07-06T22:02:16.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2 is not active+clean 2023-07-06T22:02:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.347304+0000', 'last_change': '2023-07-06T22:02:10.347304+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.347304+0000', 'last_undegraded': '2023-07-06T22:02:10.347304+0000', 'last_fullsized': '2023-07-06T22:02:10.347304+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:02:16.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.0 is not active+clean 2023-07-06T22:02:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2023-07-06T22:02:16.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.350928+0000', 'last_change': '2023-07-06T22:02:10.350928+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.350928+0000', 'last_undegraded': '2023-07-06T22:02:10.350928+0000', 'last_fullsized': '2023-07-06T22:02:10.350928+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T22:02:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1 is not active+clean 2023-07-06T22:02:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.0 is not active+clean 2023-07-06T22:02:16.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.348432+0000', 'last_change': '2023-07-06T22:02:10.348432+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.348432+0000', 'last_undegraded': '2023-07-06T22:02:10.348432+0000', 'last_fullsized': '2023-07-06T22:02:10.348432+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:02:16.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.14 is not active+clean 2023-07-06T22:02:16.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2023-07-06T22:02:16.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.350941+0000', 'last_change': '2023-07-06T22:02:10.350941+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.350941+0000', 'last_undegraded': '2023-07-06T22:02:10.350941+0000', 'last_fullsized': '2023-07-06T22:02:10.350941+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T22:02:16.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.17 is not active+clean 2023-07-06T22:02:16.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.16 is not active+clean 2023-07-06T22:02:16.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.347304+0000', 'last_change': '2023-07-06T22:02:10.347304+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.347304+0000', 'last_undegraded': '2023-07-06T22:02:10.347304+0000', 'last_fullsized': '2023-07-06T22:02:10.347304+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:02:16.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.16 is not active+clean 2023-07-06T22:02:16.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.17 is not active+clean 2023-07-06T22:02:16.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.348269+0000', 'last_change': '2023-07-06T22:02:10.348269+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.348269+0000', 'last_undegraded': '2023-07-06T22:02:10.348269+0000', 'last_fullsized': '2023-07-06T22:02:10.348269+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:02:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.15 is not active+clean 2023-07-06T22:02:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.14 is not active+clean 2023-07-06T22:02:16.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.349660+0000', 'last_change': '2023-07-06T22:02:10.349660+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.349660+0000', 'last_undegraded': '2023-07-06T22:02:10.349660+0000', 'last_fullsized': '2023-07-06T22:02:10.349660+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T22:02:16.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.13 is not active+clean 2023-07-06T22:02:16.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2023-07-06T22:02:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.351329+0000', 'last_change': '2023-07-06T22:02:10.351329+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.351329+0000', 'last_undegraded': '2023-07-06T22:02:10.351329+0000', 'last_fullsized': '2023-07-06T22:02:10.351329+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T22:02:16.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.12 is not active+clean 2023-07-06T22:02:16.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2023-07-06T22:02:16.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.350852+0000', 'last_change': '2023-07-06T22:02:10.350852+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.350852+0000', 'last_undegraded': '2023-07-06T22:02:10.350852+0000', 'last_fullsized': '2023-07-06T22:02:10.350852+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T22:02:16.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.11 is not active+clean 2023-07-06T22:02:16.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.10 is not active+clean 2023-07-06T22:02:16.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.353110+0000', 'last_change': '2023-07-06T22:02:10.353110+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.353110+0000', 'last_undegraded': '2023-07-06T22:02:10.353110+0000', 'last_fullsized': '2023-07-06T22:02:10.353110+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:02:16.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.10 is not active+clean 2023-07-06T22:02:16.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:02:11.342846+0000', 'last_change': '2023-07-06T22:02:11.342846+0000', 'last_active': '2023-07-06T22:02:11.342846+0000', 'last_peered': '2023-07-06T22:02:11.342846+0000', 'last_clean': '2023-07-06T22:02:11.342846+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:11.342846+0000', 'last_undegraded': '2023-07-06T22:02:11.342846+0000', 'last_fullsized': '2023-07-06T22:02:11.342846+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:11.342846+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:02:16.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.11 is not active+clean 2023-07-06T22:02:16.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 157, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:02:10.350018+0000', 'last_change': '2023-07-06T22:02:10.350018+0000', 'last_active': '2023-07-06T22:02:10.334070+0000', 'last_peered': '2023-07-06T22:02:10.334070+0000', 'last_clean': '2023-07-06T22:02:10.334070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:02:10.350018+0000', 'last_undegraded': '2023-07-06T22:02:10.350018+0000', 'last_fullsized': '2023-07-06T22:02:10.350018+0000', 'mapping_epoch': 157, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 157, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'last_clean_scrub_stamp': '2023-07-06T22:02:10.334070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:02:16.723 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-06T22:02:16.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.867+0000 7f0046819640 1 Processor -- start 2023-07-06T22:02:16.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.867+0000 7f0046819640 1 -- start start 2023-07-06T22:02:16.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.871+0000 7f0046819640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00400cc380 0x7f004015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.871+0000 7f0046819640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00400b5b50 con 0x7f004015f740 2023-07-06T22:02:16.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.871+0000 7f0046819640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004015d130 con 0x7f00400cb4a0 2023-07-06T22:02:16.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.871+0000 7f0046819640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00400cc8e0 con 0x7f00400cc380 2023-07-06T22:02:16.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.871+0000 7f003f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f004015f740 0x7f00400cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50172/0 (socket says 172.21.15.55:50172) 2023-07-06T22:02:16.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.871+0000 7f003f7fe640 1 -- 172.21.15.55:0/3175764461 learned_addr learned my addr 172.21.15.55:0/3175764461 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:16.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.871+0000 7f0044db6640 1 --2- 172.21.15.55:0/3175764461 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00400cc380 0x7f004015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.871+0000 7f003effd640 1 -- 172.21.15.55:0/3175764461 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211682472 0 0) 0x7f00400b5b50 con 0x7f004015f740 2023-07-06T22:02:16.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.871+0000 7f003effd640 1 -- 172.21.15.55:0/3175764461 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0028003530 con 0x7f004015f740 2023-07-06T22:02:16.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.871+0000 7f003effd640 1 -- 172.21.15.55:0/3175764461 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393784612 0 0) 0x7f004015d130 con 0x7f00400cb4a0 2023-07-06T22:02:16.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.871+0000 7f003effd640 1 -- 172.21.15.55:0/3175764461 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00400b5b50 con 0x7f00400cb4a0 2023-07-06T22:02:16.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.871+0000 7f0044db6640 1 -- 172.21.15.55:0/3175764461 >> v1:172.21.15.138:6789/0 conn(0x7f00400cb4a0 legacy=0x7f00400ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.871+0000 7f0044db6640 1 -- 172.21.15.55:0/3175764461 >> v1:172.21.15.55:6789/0 conn(0x7f004015f740 legacy=0x7f00400cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.871+0000 7f0044db6640 1 -- 172.21.15.55:0/3175764461 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004015fc00 con 0x7f00400cc380 2023-07-06T22:02:16.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0044db6640 1 --2- 172.21.15.55:0/3175764461 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00400cc380 0x7f004015cbf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f004015d2c0 tx=0x7f003801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3358897b261c74e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:16.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f003effd640 1 -- 172.21.15.55:0/3175764461 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380a5920 con 0x7f00400cc380 2023-07-06T22:02:16.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f003effd640 1 -- 172.21.15.55:0/3175764461 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00380a5a80 con 0x7f00400cc380 2023-07-06T22:02:16.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f003effd640 1 -- 172.21.15.55:0/3175764461 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380a5e10 con 0x7f00400cc380 2023-07-06T22:02:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 -- 172.21.15.55:0/3175764461 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00400cc380 msgr2=0x7f004015cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 --2- 172.21.15.55:0/3175764461 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00400cc380 0x7f004015cbf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f004015d2c0 tx=0x7f003801c970 comp rx=0 tx=0).stop 2023-07-06T22:02:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 -- 172.21.15.55:0/3175764461 shutdown_connections 2023-07-06T22:02:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 --2- 172.21.15.55:0/3175764461 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f00400cc380 0x7f004015cbf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 -- 172.21.15.55:0/3175764461 >> 172.21.15.55:0/3175764461 conn(0x7f004006ee80 msgr2=0x7f004006f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 -- 172.21.15.55:0/3175764461 shutdown_connections 2023-07-06T22:02:16.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 -- 172.21.15.55:0/3175764461 wait complete. 2023-07-06T22:02:16.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 Processor -- start 2023-07-06T22:02:16.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 -- start start 2023-07-06T22:02:16.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00400cb4a0 0x7f00400c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00400cc380 0x7f004015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f004015f740 0x7f004014ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004014d3f0 con 0x7f00400cc380 2023-07-06T22:02:16.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004014dcd0 con 0x7f00400cb4a0 2023-07-06T22:02:16.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.875+0000 7f0046819640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004014f1f0 con 0x7f004015f740 2023-07-06T22:02:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f003f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00400cc380 0x7f004015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f003f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00400cc380 0x7f004015ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44054/0 (socket says 172.21.15.55:44054) 2023-07-06T22:02:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f003f7fe640 1 -- 172.21.15.55:0/554545548 learned_addr learned my addr 172.21.15.55:0/554545548 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f003ffff640 1 --2- 172.21.15.55:0/554545548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00400cb4a0 0x7f00400c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f0044db6640 1 --2- 172.21.15.55:0/554545548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f004015f740 0x7f004014ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f003f7fe640 1 -- 172.21.15.55:0/554545548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f004015f740 msgr2=0x7f004014ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f003f7fe640 1 --2- 172.21.15.55:0/554545548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f004015f740 0x7f004014ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f003f7fe640 1 -- 172.21.15.55:0/554545548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00400cb4a0 msgr2=0x7f00400c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f003f7fe640 1 --2- 172.21.15.55:0/554545548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00400cb4a0 0x7f00400c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f003f7fe640 1 -- 172.21.15.55:0/554545548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0038009a70 con 0x7f00400cc380 2023-07-06T22:02:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f003f7fe640 1 --2- 172.21.15.55:0/554545548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00400cc380 0x7f004015ca40 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f003400c430 tx=0x7f003400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f003cff9640 1 -- 172.21.15.55:0/554545548 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034005cf0 con 0x7f00400cc380 2023-07-06T22:02:16.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f003cff9640 1 -- 172.21.15.55:0/554545548 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0034005e50 con 0x7f00400cc380 2023-07-06T22:02:16.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f003cff9640 1 -- 172.21.15.55:0/554545548 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034007310 con 0x7f00400cc380 2023-07-06T22:02:16.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f0046819640 1 -- 172.21.15.55:0/554545548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004014f4d0 con 0x7f00400cc380 2023-07-06T22:02:16.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f0046819640 1 -- 172.21.15.55:0/554545548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004014fa90 con 0x7f00400cc380 2023-07-06T22:02:16.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f0046819640 1 -- 172.21.15.55:0/554545548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0040066d60 con 0x7f00400cc380 2023-07-06T22:02:16.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.879+0000 7f003cff9640 1 -- 172.21.15.55:0/554545548 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0034007470 con 0x7f00400cc380 2023-07-06T22:02:16.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.883+0000 7f003cff9640 1 --2- 172.21.15.55:0/554545548 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f002c0663a0 0x7f002c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:16.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.883+0000 7f003cff9640 1 -- 172.21.15.55:0/554545548 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f00340834b0 con 0x7f00400cc380 2023-07-06T22:02:16.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.883+0000 7f003ffff640 1 --2- 172.21.15.55:0/554545548 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f002c0663a0 0x7f002c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:16.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.883+0000 7f003ffff640 1 --2- 172.21.15.55:0/554545548 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f002c0663a0 0x7f002c068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f00300011f0 tx=0x7f0030009040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:16.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:16.887+0000 7f003cff9640 1 -- 172.21.15.55:0/554545548 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0034050800 con 0x7f00400cc380 2023-07-06T22:02:17.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.095+0000 7f0046819640 1 -- 172.21.15.55:0/554545548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f00400cee60 con 0x7f00400cc380 2023-07-06T22:02:17.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.095+0000 7f003cff9640 1 -- 172.21.15.55:0/554545548 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3307 (secure 0 0 0) 0x7f0034053e20 con 0x7f00400cc380 2023-07-06T22:02:17.094 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:17.094 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1232,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":160,"num_osds":8,"num_up_osds":8,"osd_up_since":1688679717,"num_in_osds":8,"osd_in_since":1688679707,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":378630144,"bytes_avail":772715483136,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":71,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":9759}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2023-07-06T22:01:58.854972+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-06T22:02:17.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.095+0000 7f0046819640 1 -- 172.21.15.55:0/554545548 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f002c0663a0 msgr2=0x7f002c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:17.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.095+0000 7f0046819640 1 --2- 172.21.15.55:0/554545548 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f002c0663a0 0x7f002c068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f00300011f0 tx=0x7f0030009040 comp rx=0 tx=0).stop 2023-07-06T22:02:17.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.095+0000 7f0046819640 1 -- 172.21.15.55:0/554545548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00400cc380 msgr2=0x7f004015ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:17.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.095+0000 7f0046819640 1 --2- 172.21.15.55:0/554545548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00400cc380 0x7f004015ca40 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f003400c430 tx=0x7f003400c8f0 comp rx=0 tx=0).stop 2023-07-06T22:02:17.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.095+0000 7f0046819640 1 -- 172.21.15.55:0/554545548 shutdown_connections 2023-07-06T22:02:17.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.095+0000 7f0046819640 1 --2- 172.21.15.55:0/554545548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f004015f740 0x7f004014ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:17.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.095+0000 7f0046819640 1 --2- 172.21.15.55:0/554545548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00400cc380 0x7f004015ca40 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:17.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.095+0000 7f0046819640 1 --2- 172.21.15.55:0/554545548 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f002c0663a0 0x7f002c068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:17.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.095+0000 7f0046819640 1 --2- 172.21.15.55:0/554545548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00400cb4a0 0x7f00400c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:17.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.095+0000 7f0046819640 1 -- 172.21.15.55:0/554545548 >> 172.21.15.55:0/554545548 conn(0x7f004006ee80 msgr2=0x7f00400b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:17.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.099+0000 7f0046819640 1 -- 172.21.15.55:0/554545548 shutdown_connections 2023-07-06T22:02:17.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.099+0000 7f0046819640 1 -- 172.21.15.55:0/554545548 wait complete. 2023-07-06T22:02:17.116 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-06T22:02:17.117 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:02:17.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.259+0000 7f52498cb640 1 Processor -- start 2023-07-06T22:02:17.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.259+0000 7f52498cb640 1 -- start start 2023-07-06T22:02:17.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.263+0000 7f52498cb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f52440c8d80 0x7f52440cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:17.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.263+0000 7f52498cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524415c8a0 con 0x7f52440c89b0 2023-07-06T22:02:17.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.263+0000 7f52498cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52440cdb70 con 0x7f524406bb60 2023-07-06T22:02:17.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.263+0000 7f52498cb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52440cce70 con 0x7f52440c8d80 2023-07-06T22:02:17.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.263+0000 7f5242ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f52440c89b0 0x7f52440cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50180/0 (socket says 172.21.15.55:50180) 2023-07-06T22:02:17.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.263+0000 7f5242ffd640 1 -- 172.21.15.55:0/197414915 learned_addr learned my addr 172.21.15.55:0/197414915 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:17.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.263+0000 7f523bfff640 1 --2- 172.21.15.55:0/197414915 >> v2:172.21.15.138:3300/0 conn(0x7f52440c8d80 0x7f52440cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:17.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.263+0000 7f52427fc640 1 -- 172.21.15.55:0/197414915 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867206476 0 0) 0x7f524415c8a0 con 0x7f52440c89b0 2023-07-06T22:02:17.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.263+0000 7f52427fc640 1 -- 172.21.15.55:0/197414915 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5230003530 con 0x7f52440c89b0 2023-07-06T22:02:17.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.263+0000 7f52427fc640 1 -- 172.21.15.55:0/197414915 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3147918709 0 0) 0x7f5230003530 con 0x7f52440c89b0 2023-07-06T22:02:17.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.263+0000 7f523bfff640 1 -- 172.21.15.55:0/197414915 >> v1:172.21.15.138:6789/0 conn(0x7f524406bb60 legacy=0x7f5244158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:17.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.263+0000 7f523bfff640 1 -- 172.21.15.55:0/197414915 >> v1:172.21.15.55:6789/0 conn(0x7f52440c89b0 legacy=0x7f52440cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:17.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.263+0000 7f523bfff640 1 -- 172.21.15.55:0/197414915 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524415bc90 con 0x7f52440c8d80 2023-07-06T22:02:17.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.267+0000 7f523bfff640 1 --2- 172.21.15.55:0/197414915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52440c8d80 0x7f52440cbe50 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f522c00a960 tx=0x7f522c01d740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50a5698d74d544b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:17.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.267+0000 7f52427fc640 1 -- 172.21.15.55:0/197414915 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234001680 con 0x7f52440c8d80 2023-07-06T22:02:17.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.267+0000 7f52427fc640 1 -- 172.21.15.55:0/197414915 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c0a6570 con 0x7f52440c8d80 2023-07-06T22:02:17.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.267+0000 7f52427fc640 1 -- 172.21.15.55:0/197414915 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c0a6900 con 0x7f52440c8d80 2023-07-06T22:02:17.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.267+0000 7f52498cb640 1 -- 172.21.15.55:0/197414915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52440c8d80 msgr2=0x7f52440cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:17.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.267+0000 7f52498cb640 1 --2- 172.21.15.55:0/197414915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52440c8d80 0x7f52440cbe50 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f522c00a960 tx=0x7f522c01d740 comp rx=0 tx=0).stop 2023-07-06T22:02:17.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.267+0000 7f52498cb640 1 -- 172.21.15.55:0/197414915 shutdown_connections 2023-07-06T22:02:17.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.267+0000 7f52498cb640 1 --2- 172.21.15.55:0/197414915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52440c8d80 0x7f52440cbe50 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:17.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.267+0000 7f52498cb640 1 -- 172.21.15.55:0/197414915 >> 172.21.15.55:0/197414915 conn(0x7f52440cded0 msgr2=0x7f52440ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:17.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.267+0000 7f52498cb640 1 -- 172.21.15.55:0/197414915 shutdown_connections 2023-07-06T22:02:17.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.267+0000 7f52498cb640 1 -- 172.21.15.55:0/197414915 wait complete. 2023-07-06T22:02:17.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.267+0000 7f52498cb640 1 Processor -- start 2023-07-06T22:02:17.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.267+0000 7f52498cb640 1 -- start start 2023-07-06T22:02:17.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52498cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f524406bb60 0x7f52440c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:17.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52498cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52440c89b0 0x7f524414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:17.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52498cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52440c8d80 0x7f5244149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52498cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524414a1e0 con 0x7f52440c8d80 2023-07-06T22:02:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52498cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52441505c0 con 0x7f52440c89b0 2023-07-06T22:02:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52498cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52441508a0 con 0x7f524406bb60 2023-07-06T22:02:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52437fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52440c8d80 0x7f5244149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52437fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52440c8d80 0x7f5244149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44064/0 (socket says 172.21.15.55:44064) 2023-07-06T22:02:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52437fe640 1 -- 172.21.15.55:0/1453102309 learned_addr learned my addr 172.21.15.55:0/1453102309 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f523bfff640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52440c89b0 0x7f524414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f5242ffd640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f524406bb60 0x7f52440c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52437fe640 1 -- 172.21.15.55:0/1453102309 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f524406bb60 msgr2=0x7f52440c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52437fe640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f524406bb60 0x7f52440c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52437fe640 1 -- 172.21.15.55:0/1453102309 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52440c89b0 msgr2=0x7f524414ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52437fe640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52440c89b0 0x7f524414ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52437fe640 1 -- 172.21.15.55:0/1453102309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c00a5c0 con 0x7f52440c8d80 2023-07-06T22:02:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f523bfff640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52440c89b0 0x7f524414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52437fe640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52440c8d80 0x7f5244149ca0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f523c00c730 tx=0x7f523c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f5240ff9640 1 -- 172.21.15.55:0/1453102309 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c003b80 con 0x7f52440c8d80 2023-07-06T22:02:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f5240ff9640 1 -- 172.21.15.55:0/1453102309 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c003ce0 con 0x7f52440c8d80 2023-07-06T22:02:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52498cb640 1 -- 172.21.15.55:0/1453102309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5244150b80 con 0x7f52440c8d80 2023-07-06T22:02:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f5240ff9640 1 -- 172.21.15.55:0/1453102309 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c00aa30 con 0x7f52440c8d80 2023-07-06T22:02:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52498cb640 1 -- 172.21.15.55:0/1453102309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5244151140 con 0x7f52440c8d80 2023-07-06T22:02:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.271+0000 7f52498cb640 1 -- 172.21.15.55:0/1453102309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5244151330 con 0x7f52440c8d80 2023-07-06T22:02:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.275+0000 7f5240ff9640 1 -- 172.21.15.55:0/1453102309 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f523c00ab90 con 0x7f52440c8d80 2023-07-06T22:02:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.275+0000 7f5240ff9640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f52240663d0 0x7f5224068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.275+0000 7f5240ff9640 1 -- 172.21.15.55:0/1453102309 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f523c083d10 con 0x7f52440c8d80 2023-07-06T22:02:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.275+0000 7f5242ffd640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f52240663d0 0x7f5224068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.275+0000 7f5242ffd640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f52240663d0 0x7f5224068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5234000f70 tx=0x7f5234009040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:17.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.279+0000 7f5240ff9640 1 -- 172.21.15.55:0/1453102309 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f523c050fb0 con 0x7f52440c8d80 2023-07-06T22:02:17.327 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-07-06T22:02:17.327+0000 7f61781fc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T22:02:17.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.431+0000 7f52498cb640 1 -- 172.21.15.55:0/1453102309 --> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f524406aaf0 con 0x7f52240663d0 2023-07-06T22:02:17.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.443+0000 7f5240ff9640 1 -- 172.21.15.55:0/1453102309 <== mgr.9489 v2:172.21.15.55:6832/433956277 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311425 (secure 0 0 0) 0x7f52340014f0 con 0x7f52240663d0 2023-07-06T22:02:17.443 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:17.444 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:02:17.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.443+0000 7f52498cb640 1 -- 172.21.15.55:0/1453102309 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f52240663d0 msgr2=0x7f5224068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:17.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.447+0000 7f52498cb640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f52240663d0 0x7f5224068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5234000f70 tx=0x7f5234009040 comp rx=0 tx=0).stop 2023-07-06T22:02:17.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.447+0000 7f52498cb640 1 -- 172.21.15.55:0/1453102309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52440c8d80 msgr2=0x7f5244149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:17.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.447+0000 7f52498cb640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52440c8d80 0x7f5244149ca0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f523c00c730 tx=0x7f523c00cbf0 comp rx=0 tx=0).stop 2023-07-06T22:02:17.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.447+0000 7f52498cb640 1 -- 172.21.15.55:0/1453102309 shutdown_connections 2023-07-06T22:02:17.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.447+0000 7f52498cb640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52440c8d80 0x7f5244149ca0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:17.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.447+0000 7f52498cb640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f52240663d0 0x7f5224068880 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:17.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.447+0000 7f52498cb640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52440c89b0 0x7f524414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:17.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.447+0000 7f52498cb640 1 --2- 172.21.15.55:0/1453102309 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f524406bb60 0x7f52440c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:17.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.447+0000 7f52498cb640 1 -- 172.21.15.55:0/1453102309 >> 172.21.15.55:0/1453102309 conn(0x7f52440cded0 msgr2=0x7f52440ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:17.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.447+0000 7f52498cb640 1 -- 172.21.15.55:0/1453102309 shutdown_connections 2023-07-06T22:02:17.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:17.447+0000 7f52498cb640 1 -- 172.21.15.55:0/1453102309 wait complete. 2023-07-06T22:02:17.464 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-06T22:02:16.858105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":483,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":309,"ondisk_log_size":309,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":374240,"kb_used_data":16800,"kb_used_omap":0,"kb_used_meta":357376,"kb_avail":754600480,"statfs":{"total":773094113280,"available":772710891520,"internally_reserved":0,"allocated":17203200,"data_stored":9682590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":365953024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001130"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913059+0000","last_change":"2023-07-06T22:02:11.786795+0000","last_active":"2023-07-06T22:02:12.913059+0000","last_peered":"2023-07-06T22:02:12.913059+0000","last_clean":"2023-07-06T22:02:12.913059+0000","last_became_active":"2023-07-06T22:02:11.786532+0000","last_became_peered":"2023-07-06T22:02:11.786532+0000","last_unstale":"2023-07-06T22:02:12.913059+0000","last_undegraded":"2023-07-06T22:02:12.913059+0000","last_fullsized":"2023-07-06T22:02:12.913059+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:43:55.679480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913359+0000","last_change":"2023-07-06T22:02:11.784925+0000","last_active":"2023-07-06T22:02:12.913359+0000","last_peered":"2023-07-06T22:02:12.913359+0000","last_clean":"2023-07-06T22:02:12.913359+0000","last_became_active":"2023-07-06T22:02:11.784668+0000","last_became_peered":"2023-07-06T22:02:11.784668+0000","last_unstale":"2023-07-06T22:02:12.913359+0000","last_undegraded":"2023-07-06T22:02:12.913359+0000","last_fullsized":"2023-07-06T22:02:12.913359+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:17.248655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914529+0000","last_change":"2023-07-06T22:02:11.790362+0000","last_active":"2023-07-06T22:02:12.914529+0000","last_peered":"2023-07-06T22:02:12.914529+0000","last_clean":"2023-07-06T22:02:12.914529+0000","last_became_active":"2023-07-06T22:02:11.790075+0000","last_became_peered":"2023-07-06T22:02:11.790075+0000","last_unstale":"2023-07-06T22:02:12.914529+0000","last_undegraded":"2023-07-06T22:02:12.914529+0000","last_fullsized":"2023-07-06T22:02:12.914529+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:12:27.473524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774341+0000","last_change":"2023-07-06T22:02:11.786929+0000","last_active":"2023-07-06T22:02:12.774341+0000","last_peered":"2023-07-06T22:02:12.774341+0000","last_clean":"2023-07-06T22:02:12.774341+0000","last_became_active":"2023-07-06T22:02:11.786631+0000","last_became_peered":"2023-07-06T22:02:11.786631+0000","last_unstale":"2023-07-06T22:02:12.774341+0000","last_undegraded":"2023-07-06T22:02:12.774341+0000","last_fullsized":"2023-07-06T22:02:12.774341+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:08:59.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913716+0000","last_change":"2023-07-06T22:02:11.788783+0000","last_active":"2023-07-06T22:02:12.913716+0000","last_peered":"2023-07-06T22:02:12.913716+0000","last_clean":"2023-07-06T22:02:12.913716+0000","last_became_active":"2023-07-06T22:02:11.788514+0000","last_became_peered":"2023-07-06T22:02:11.788514+0000","last_unstale":"2023-07-06T22:02:12.913716+0000","last_undegraded":"2023-07-06T22:02:12.913716+0000","last_fullsized":"2023-07-06T22:02:12.913716+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:52:39.678695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912948+0000","last_change":"2023-07-06T22:02:11.797597+0000","last_active":"2023-07-06T22:02:12.912948+0000","last_peered":"2023-07-06T22:02:12.912948+0000","last_clean":"2023-07-06T22:02:12.912948+0000","last_became_active":"2023-07-06T22:02:11.797281+0000","last_became_peered":"2023-07-06T22:02:11.797281+0000","last_unstale":"2023-07-06T22:02:12.912948+0000","last_undegraded":"2023-07-06T22:02:12.912948+0000","last_fullsized":"2023-07-06T22:02:12.912948+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:45:09.800536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913048+0000","last_change":"2023-07-06T22:02:11.772421+0000","last_active":"2023-07-06T22:02:12.913048+0000","last_peered":"2023-07-06T22:02:12.913048+0000","last_clean":"2023-07-06T22:02:12.913048+0000","last_became_active":"2023-07-06T22:02:11.772104+0000","last_became_peered":"2023-07-06T22:02:11.772104+0000","last_unstale":"2023-07-06T22:02:12.913048+0000","last_undegraded":"2023-07-06T22:02:12.913048+0000","last_fullsized":"2023-07-06T22:02:12.913048+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:15:43.954484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912378+0000","last_change":"2023-07-06T22:02:11.781083+0000","last_active":"2023-07-06T22:02:12.912378+0000","last_peered":"2023-07-06T22:02:12.912378+0000","last_clean":"2023-07-06T22:02:12.912378+0000","last_became_active":"2023-07-06T22:02:11.780821+0000","last_became_peered":"2023-07-06T22:02:11.780821+0000","last_unstale":"2023-07-06T22:02:12.912378+0000","last_undegraded":"2023-07-06T22:02:12.912378+0000","last_fullsized":"2023-07-06T22:02:12.912378+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:02:45.973938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913424+0000","last_change":"2023-07-06T22:02:11.785262+0000","last_active":"2023-07-06T22:02:12.913424+0000","last_peered":"2023-07-06T22:02:12.913424+0000","last_clean":"2023-07-06T22:02:12.913424+0000","last_became_active":"2023-07-06T22:02:11.784986+0000","last_became_peered":"2023-07-06T22:02:11.784986+0000","last_unstale":"2023-07-06T22:02:12.913424+0000","last_undegraded":"2023-07-06T22:02:12.913424+0000","last_fullsized":"2023-07-06T22:02:12.913424+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:24:03.323635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775167+0000","last_change":"2023-07-06T22:02:11.797330+0000","last_active":"2023-07-06T22:02:12.775167+0000","last_peered":"2023-07-06T22:02:12.775167+0000","last_clean":"2023-07-06T22:02:12.775167+0000","last_became_active":"2023-07-06T22:02:11.797050+0000","last_became_peered":"2023-07-06T22:02:11.797050+0000","last_unstale":"2023-07-06T22:02:12.775167+0000","last_undegraded":"2023-07-06T22:02:12.775167+0000","last_fullsized":"2023-07-06T22:02:12.775167+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:25:15.317109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913241+0000","last_change":"2023-07-06T22:02:11.783907+0000","last_active":"2023-07-06T22:02:12.913241+0000","last_peered":"2023-07-06T22:02:12.913241+0000","last_clean":"2023-07-06T22:02:12.913241+0000","last_became_active":"2023-07-06T22:02:11.783649+0000","last_became_peered":"2023-07-06T22:02:11.783649+0000","last_unstale":"2023-07-06T22:02:12.913241+0000","last_undegraded":"2023-07-06T22:02:12.913241+0000","last_fullsized":"2023-07-06T22:02:12.913241+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:56:34.360616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774847+0000","last_change":"2023-07-06T22:02:11.788575+0000","last_active":"2023-07-06T22:02:12.774847+0000","last_peered":"2023-07-06T22:02:12.774847+0000","last_clean":"2023-07-06T22:02:12.774847+0000","last_became_active":"2023-07-06T22:02:11.788083+0000","last_became_peered":"2023-07-06T22:02:11.788083+0000","last_unstale":"2023-07-06T22:02:12.774847+0000","last_undegraded":"2023-07-06T22:02:12.774847+0000","last_fullsized":"2023-07-06T22:02:12.774847+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:56:34.062449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913501+0000","last_change":"2023-07-06T22:02:11.791957+0000","last_active":"2023-07-06T22:02:12.913501+0000","last_peered":"2023-07-06T22:02:12.913501+0000","last_clean":"2023-07-06T22:02:12.913501+0000","last_became_active":"2023-07-06T22:02:11.789579+0000","last_became_peered":"2023-07-06T22:02:11.789579+0000","last_unstale":"2023-07-06T22:02:12.913501+0000","last_undegraded":"2023-07-06T22:02:12.913501+0000","last_fullsized":"2023-07-06T22:02:12.913501+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:07:30.161985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.773776+0000","last_change":"2023-07-06T22:02:11.786828+0000","last_active":"2023-07-06T22:02:12.773776+0000","last_peered":"2023-07-06T22:02:12.773776+0000","last_clean":"2023-07-06T22:02:12.773776+0000","last_became_active":"2023-07-06T22:02:11.786010+0000","last_became_peered":"2023-07-06T22:02:11.786010+0000","last_unstale":"2023-07-06T22:02:12.773776+0000","last_undegraded":"2023-07-06T22:02:12.773776+0000","last_fullsized":"2023-07-06T22:02:12.773776+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:54:01.526110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774647+0000","last_change":"2023-07-06T22:02:11.784311+0000","last_active":"2023-07-06T22:02:12.774647+0000","last_peered":"2023-07-06T22:02:12.774647+0000","last_clean":"2023-07-06T22:02:12.774647+0000","last_became_active":"2023-07-06T22:02:11.783258+0000","last_became_peered":"2023-07-06T22:02:11.783258+0000","last_unstale":"2023-07-06T22:02:12.774647+0000","last_undegraded":"2023-07-06T22:02:12.774647+0000","last_fullsized":"2023-07-06T22:02:12.774647+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:20:41.837754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.770923+0000","last_change":"2023-07-06T22:02:11.777916+0000","last_active":"2023-07-06T22:02:12.770923+0000","last_peered":"2023-07-06T22:02:12.770923+0000","last_clean":"2023-07-06T22:02:12.770923+0000","last_became_active":"2023-07-06T22:02:11.775905+0000","last_became_peered":"2023-07-06T22:02:11.775905+0000","last_unstale":"2023-07-06T22:02:12.770923+0000","last_undegraded":"2023-07-06T22:02:12.770923+0000","last_fullsized":"2023-07-06T22:02:12.770923+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:46:44.017349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775315+0000","last_change":"2023-07-06T22:02:11.796833+0000","last_active":"2023-07-06T22:02:12.775315+0000","last_peered":"2023-07-06T22:02:12.775315+0000","last_clean":"2023-07-06T22:02:12.775315+0000","last_became_active":"2023-07-06T22:02:11.796476+0000","last_became_peered":"2023-07-06T22:02:11.796476+0000","last_unstale":"2023-07-06T22:02:12.775315+0000","last_undegraded":"2023-07-06T22:02:12.775315+0000","last_fullsized":"2023-07-06T22:02:12.775315+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:22:39.336929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914556+0000","last_change":"2023-07-06T22:02:11.790419+0000","last_active":"2023-07-06T22:02:12.914556+0000","last_peered":"2023-07-06T22:02:12.914556+0000","last_clean":"2023-07-06T22:02:12.914556+0000","last_became_active":"2023-07-06T22:02:11.790134+0000","last_became_peered":"2023-07-06T22:02:11.790134+0000","last_unstale":"2023-07-06T22:02:12.914556+0000","last_undegraded":"2023-07-06T22:02:12.914556+0000","last_fullsized":"2023-07-06T22:02:12.914556+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:35:38.004981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913609+0000","last_change":"2023-07-06T22:02:11.782701+0000","last_active":"2023-07-06T22:02:12.913609+0000","last_peered":"2023-07-06T22:02:12.913609+0000","last_clean":"2023-07-06T22:02:12.913609+0000","last_became_active":"2023-07-06T22:02:11.782243+0000","last_became_peered":"2023-07-06T22:02:11.782243+0000","last_unstale":"2023-07-06T22:02:12.913609+0000","last_undegraded":"2023-07-06T22:02:12.913609+0000","last_fullsized":"2023-07-06T22:02:12.913609+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:33:17.404718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771392+0000","last_change":"2023-07-06T22:02:11.778315+0000","last_active":"2023-07-06T22:02:12.771392+0000","last_peered":"2023-07-06T22:02:12.771392+0000","last_clean":"2023-07-06T22:02:12.771392+0000","last_became_active":"2023-07-06T22:02:11.777947+0000","last_became_peered":"2023-07-06T22:02:11.777947+0000","last_unstale":"2023-07-06T22:02:12.771392+0000","last_undegraded":"2023-07-06T22:02:12.771392+0000","last_fullsized":"2023-07-06T22:02:12.771392+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:48:47.970894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775090+0000","last_change":"2023-07-06T22:02:11.787853+0000","last_active":"2023-07-06T22:02:12.775090+0000","last_peered":"2023-07-06T22:02:12.775090+0000","last_clean":"2023-07-06T22:02:12.775090+0000","last_became_active":"2023-07-06T22:02:11.787520+0000","last_became_peered":"2023-07-06T22:02:11.787520+0000","last_unstale":"2023-07-06T22:02:12.775090+0000","last_undegraded":"2023-07-06T22:02:12.775090+0000","last_fullsized":"2023-07-06T22:02:12.775090+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:26:47.373495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.773781+0000","last_change":"2023-07-06T22:02:11.782495+0000","last_active":"2023-07-06T22:02:12.773781+0000","last_peered":"2023-07-06T22:02:12.773781+0000","last_clean":"2023-07-06T22:02:12.773781+0000","last_became_active":"2023-07-06T22:02:11.781992+0000","last_became_peered":"2023-07-06T22:02:11.781992+0000","last_unstale":"2023-07-06T22:02:12.773781+0000","last_undegraded":"2023-07-06T22:02:12.773781+0000","last_fullsized":"2023-07-06T22:02:12.773781+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:17.248655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.773758+0000","last_change":"2023-07-06T22:02:11.776839+0000","last_active":"2023-07-06T22:02:12.773758+0000","last_peered":"2023-07-06T22:02:12.773758+0000","last_clean":"2023-07-06T22:02:12.773758+0000","last_became_active":"2023-07-06T22:02:11.776259+0000","last_became_peered":"2023-07-06T22:02:11.776259+0000","last_unstale":"2023-07-06T22:02:12.773758+0000","last_undegraded":"2023-07-06T22:02:12.773758+0000","last_fullsized":"2023-07-06T22:02:12.773758+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:25:06.516604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774551+0000","last_change":"2023-07-06T22:02:11.788178+0000","last_active":"2023-07-06T22:02:12.774551+0000","last_peered":"2023-07-06T22:02:12.774551+0000","last_clean":"2023-07-06T22:02:12.774551+0000","last_became_active":"2023-07-06T22:02:11.787455+0000","last_became_peered":"2023-07-06T22:02:11.787455+0000","last_unstale":"2023-07-06T22:02:12.774551+0000","last_undegraded":"2023-07-06T22:02:12.774551+0000","last_fullsized":"2023-07-06T22:02:12.774551+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:52:12.098249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771561+0000","last_change":"2023-07-06T22:02:11.784396+0000","last_active":"2023-07-06T22:02:12.771561+0000","last_peered":"2023-07-06T22:02:12.771561+0000","last_clean":"2023-07-06T22:02:12.771561+0000","last_became_active":"2023-07-06T22:02:11.784124+0000","last_became_peered":"2023-07-06T22:02:11.784124+0000","last_unstale":"2023-07-06T22:02:12.771561+0000","last_undegraded":"2023-07-06T22:02:12.771561+0000","last_fullsized":"2023-07-06T22:02:12.771561+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:01:58.337123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913300+0000","last_change":"2023-07-06T22:02:11.782486+0000","last_active":"2023-07-06T22:02:12.913300+0000","last_peered":"2023-07-06T22:02:12.913300+0000","last_clean":"2023-07-06T22:02:12.913300+0000","last_became_active":"2023-07-06T22:02:11.782167+0000","last_became_peered":"2023-07-06T22:02:11.782167+0000","last_unstale":"2023-07-06T22:02:12.913300+0000","last_undegraded":"2023-07-06T22:02:12.913300+0000","last_fullsized":"2023-07-06T22:02:12.913300+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:33:20.760780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771428+0000","last_change":"2023-07-06T22:02:11.789904+0000","last_active":"2023-07-06T22:02:12.771428+0000","last_peered":"2023-07-06T22:02:12.771428+0000","last_clean":"2023-07-06T22:02:12.771428+0000","last_became_active":"2023-07-06T22:02:11.789591+0000","last_became_peered":"2023-07-06T22:02:11.789591+0000","last_unstale":"2023-07-06T22:02:12.771428+0000","last_undegraded":"2023-07-06T22:02:12.771428+0000","last_fullsized":"2023-07-06T22:02:12.771428+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:05:22.504575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913676+0000","last_change":"2023-07-06T22:02:11.791351+0000","last_active":"2023-07-06T22:02:12.913676+0000","last_peered":"2023-07-06T22:02:12.913676+0000","last_clean":"2023-07-06T22:02:12.913676+0000","last_became_active":"2023-07-06T22:02:11.791076+0000","last_became_peered":"2023-07-06T22:02:11.791076+0000","last_unstale":"2023-07-06T22:02:12.913676+0000","last_undegraded":"2023-07-06T22:02:12.913676+0000","last_fullsized":"2023-07-06T22:02:12.913676+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:43:03.416250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912744+0000","last_change":"2023-07-06T22:02:11.792208+0000","last_active":"2023-07-06T22:02:12.912744+0000","last_peered":"2023-07-06T22:02:12.912744+0000","last_clean":"2023-07-06T22:02:12.912744+0000","last_became_active":"2023-07-06T22:02:11.791943+0000","last_became_peered":"2023-07-06T22:02:11.791943+0000","last_unstale":"2023-07-06T22:02:12.912744+0000","last_undegraded":"2023-07-06T22:02:12.912744+0000","last_fullsized":"2023-07-06T22:02:12.912744+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:17:46.810208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.773950+0000","last_change":"2023-07-06T22:02:11.787052+0000","last_active":"2023-07-06T22:02:12.773950+0000","last_peered":"2023-07-06T22:02:12.773950+0000","last_clean":"2023-07-06T22:02:12.773950+0000","last_became_active":"2023-07-06T22:02:11.786540+0000","last_became_peered":"2023-07-06T22:02:11.786540+0000","last_unstale":"2023-07-06T22:02:12.773950+0000","last_undegraded":"2023-07-06T22:02:12.773950+0000","last_fullsized":"2023-07-06T22:02:12.773950+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:26:30.302810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912535+0000","last_change":"2023-07-06T22:02:11.797696+0000","last_active":"2023-07-06T22:02:12.912535+0000","last_peered":"2023-07-06T22:02:12.912535+0000","last_clean":"2023-07-06T22:02:12.912535+0000","last_became_active":"2023-07-06T22:02:11.797408+0000","last_became_peered":"2023-07-06T22:02:11.797408+0000","last_unstale":"2023-07-06T22:02:12.912535+0000","last_undegraded":"2023-07-06T22:02:12.912535+0000","last_fullsized":"2023-07-06T22:02:12.912535+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:20:51.467089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.770993+0000","last_change":"2023-07-06T22:02:11.773540+0000","last_active":"2023-07-06T22:02:12.770993+0000","last_peered":"2023-07-06T22:02:12.770993+0000","last_clean":"2023-07-06T22:02:12.770993+0000","last_became_active":"2023-07-06T22:02:11.773265+0000","last_became_peered":"2023-07-06T22:02:11.773265+0000","last_unstale":"2023-07-06T22:02:12.770993+0000","last_undegraded":"2023-07-06T22:02:12.770993+0000","last_fullsized":"2023-07-06T22:02:12.770993+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:15:22.440659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775321+0000","last_change":"2023-07-06T22:02:11.795411+0000","last_active":"2023-07-06T22:02:12.775321+0000","last_peered":"2023-07-06T22:02:12.775321+0000","last_clean":"2023-07-06T22:02:12.775321+0000","last_became_active":"2023-07-06T22:02:11.795110+0000","last_became_peered":"2023-07-06T22:02:11.795110+0000","last_unstale":"2023-07-06T22:02:12.775321+0000","last_undegraded":"2023-07-06T22:02:12.775321+0000","last_fullsized":"2023-07-06T22:02:12.775321+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:39:55.066350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"159'4","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775255+0000","last_change":"2023-07-06T22:02:11.380028+0000","last_active":"2023-07-06T22:02:12.775255+0000","last_peered":"2023-07-06T22:02:12.775255+0000","last_clean":"2023-07-06T22:02:12.775255+0000","last_became_active":"2023-07-06T22:02:11.379766+0000","last_became_peered":"2023-07-06T22:02:11.379766+0000","last_unstale":"2023-07-06T22:02:12.775255+0000","last_undegraded":"2023-07-06T22:02:12.775255+0000","last_fullsized":"2023-07-06T22:02:12.775255+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:22:36.702866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913545+0000","last_change":"2023-07-06T22:02:11.783030+0000","last_active":"2023-07-06T22:02:12.913545+0000","last_peered":"2023-07-06T22:02:12.913545+0000","last_clean":"2023-07-06T22:02:12.913545+0000","last_became_active":"2023-07-06T22:02:11.782748+0000","last_became_peered":"2023-07-06T22:02:11.782748+0000","last_unstale":"2023-07-06T22:02:12.913545+0000","last_undegraded":"2023-07-06T22:02:12.913545+0000","last_fullsized":"2023-07-06T22:02:12.913545+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:53:15.791868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"159'1","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913446+0000","last_change":"2023-07-06T22:02:11.376158+0000","last_active":"2023-07-06T22:02:12.913446+0000","last_peered":"2023-07-06T22:02:12.913446+0000","last_clean":"2023-07-06T22:02:12.913446+0000","last_became_active":"2023-07-06T22:02:11.375841+0000","last_became_peered":"2023-07-06T22:02:11.375841+0000","last_unstale":"2023-07-06T22:02:12.913446+0000","last_undegraded":"2023-07-06T22:02:12.913446+0000","last_fullsized":"2023-07-06T22:02:12.913446+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:26:29.294034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912519+0000","last_change":"2023-07-06T22:02:11.783134+0000","last_active":"2023-07-06T22:02:12.912519+0000","last_peered":"2023-07-06T22:02:12.912519+0000","last_clean":"2023-07-06T22:02:12.912519+0000","last_became_active":"2023-07-06T22:02:11.782862+0000","last_became_peered":"2023-07-06T22:02:11.782862+0000","last_unstale":"2023-07-06T22:02:12.912519+0000","last_undegraded":"2023-07-06T22:02:12.912519+0000","last_fullsized":"2023-07-06T22:02:12.912519+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:44:10.993854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"159'2","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774205+0000","last_change":"2023-07-06T22:02:11.369377+0000","last_active":"2023-07-06T22:02:12.774205+0000","last_peered":"2023-07-06T22:02:12.774205+0000","last_clean":"2023-07-06T22:02:12.774205+0000","last_became_active":"2023-07-06T22:02:11.369043+0000","last_became_peered":"2023-07-06T22:02:11.369043+0000","last_unstale":"2023-07-06T22:02:12.774205+0000","last_undegraded":"2023-07-06T22:02:12.774205+0000","last_fullsized":"2023-07-06T22:02:12.774205+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:45:52.494673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774850+0000","last_change":"2023-07-06T22:02:11.794818+0000","last_active":"2023-07-06T22:02:12.774850+0000","last_peered":"2023-07-06T22:02:12.774850+0000","last_clean":"2023-07-06T22:02:12.774850+0000","last_became_active":"2023-07-06T22:02:11.794556+0000","last_became_peered":"2023-07-06T22:02:11.794556+0000","last_unstale":"2023-07-06T22:02:12.774850+0000","last_undegraded":"2023-07-06T22:02:12.774850+0000","last_fullsized":"2023-07-06T22:02:12.774850+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:51:17.850741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"159'2","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774385+0000","last_change":"2023-07-06T22:02:11.380318+0000","last_active":"2023-07-06T22:02:12.774385+0000","last_peered":"2023-07-06T22:02:12.774385+0000","last_clean":"2023-07-06T22:02:12.774385+0000","last_became_active":"2023-07-06T22:02:11.380039+0000","last_became_peered":"2023-07-06T22:02:11.380039+0000","last_unstale":"2023-07-06T22:02:12.774385+0000","last_undegraded":"2023-07-06T22:02:12.774385+0000","last_fullsized":"2023-07-06T22:02:12.774385+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:48:17.471574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912905+0000","last_change":"2023-07-06T22:02:11.797721+0000","last_active":"2023-07-06T22:02:12.912905+0000","last_peered":"2023-07-06T22:02:12.912905+0000","last_clean":"2023-07-06T22:02:12.912905+0000","last_became_active":"2023-07-06T22:02:11.797439+0000","last_became_peered":"2023-07-06T22:02:11.797439+0000","last_unstale":"2023-07-06T22:02:12.912905+0000","last_undegraded":"2023-07-06T22:02:12.912905+0000","last_fullsized":"2023-07-06T22:02:12.912905+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:40:12.957415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"159'1","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771145+0000","last_change":"2023-07-06T22:02:11.373559+0000","last_active":"2023-07-06T22:02:12.771145+0000","last_peered":"2023-07-06T22:02:12.771145+0000","last_clean":"2023-07-06T22:02:12.771145+0000","last_became_active":"2023-07-06T22:02:11.373219+0000","last_became_peered":"2023-07-06T22:02:11.373219+0000","last_unstale":"2023-07-06T22:02:12.771145+0000","last_undegraded":"2023-07-06T22:02:12.771145+0000","last_fullsized":"2023-07-06T22:02:12.771145+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:26:25.886445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.773951+0000","last_change":"2023-07-06T22:02:11.793878+0000","last_active":"2023-07-06T22:02:12.773951+0000","last_peered":"2023-07-06T22:02:12.773951+0000","last_clean":"2023-07-06T22:02:12.773951+0000","last_became_active":"2023-07-06T22:02:11.793593+0000","last_became_peered":"2023-07-06T22:02:11.793593+0000","last_unstale":"2023-07-06T22:02:12.773951+0000","last_undegraded":"2023-07-06T22:02:12.773951+0000","last_fullsized":"2023-07-06T22:02:12.773951+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:24:03.323635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"159'1","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913277+0000","last_change":"2023-07-06T22:02:11.376053+0000","last_active":"2023-07-06T22:02:12.913277+0000","last_peered":"2023-07-06T22:02:12.913277+0000","last_clean":"2023-07-06T22:02:12.913277+0000","last_became_active":"2023-07-06T22:02:11.375793+0000","last_became_peered":"2023-07-06T22:02:11.375793+0000","last_unstale":"2023-07-06T22:02:12.913277+0000","last_undegraded":"2023-07-06T22:02:12.913277+0000","last_fullsized":"2023-07-06T22:02:12.913277+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:38:08.487047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912656+0000","last_change":"2023-07-06T22:02:11.781081+0000","last_active":"2023-07-06T22:02:12.912656+0000","last_peered":"2023-07-06T22:02:12.912656+0000","last_clean":"2023-07-06T22:02:12.912656+0000","last_became_active":"2023-07-06T22:02:11.780820+0000","last_became_peered":"2023-07-06T22:02:11.780820+0000","last_unstale":"2023-07-06T22:02:12.912656+0000","last_undegraded":"2023-07-06T22:02:12.912656+0000","last_fullsized":"2023-07-06T22:02:12.912656+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:58:19.983952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.770988+0000","last_change":"2023-07-06T22:02:11.371822+0000","last_active":"2023-07-06T22:02:12.770988+0000","last_peered":"2023-07-06T22:02:12.770988+0000","last_clean":"2023-07-06T22:02:12.770988+0000","last_became_active":"2023-07-06T22:02:11.371547+0000","last_became_peered":"2023-07-06T22:02:11.371547+0000","last_unstale":"2023-07-06T22:02:12.770988+0000","last_undegraded":"2023-07-06T22:02:12.770988+0000","last_fullsized":"2023-07-06T22:02:12.770988+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:32:16.947485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913500+0000","last_change":"2023-07-06T22:02:11.776953+0000","last_active":"2023-07-06T22:02:12.913500+0000","last_peered":"2023-07-06T22:02:12.913500+0000","last_clean":"2023-07-06T22:02:12.913500+0000","last_became_active":"2023-07-06T22:02:11.776655+0000","last_became_peered":"2023-07-06T22:02:11.776655+0000","last_unstale":"2023-07-06T22:02:12.913500+0000","last_undegraded":"2023-07-06T22:02:12.913500+0000","last_fullsized":"2023-07-06T22:02:12.913500+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:01:26.919339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.773489+0000","last_change":"2023-07-06T22:02:11.375332+0000","last_active":"2023-07-06T22:02:12.773489+0000","last_peered":"2023-07-06T22:02:12.773489+0000","last_clean":"2023-07-06T22:02:12.773489+0000","last_became_active":"2023-07-06T22:02:11.375059+0000","last_became_peered":"2023-07-06T22:02:11.375059+0000","last_unstale":"2023-07-06T22:02:12.773489+0000","last_undegraded":"2023-07-06T22:02:12.773489+0000","last_fullsized":"2023-07-06T22:02:12.773489+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:40:11.948639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775430+0000","last_change":"2023-07-06T22:02:11.794778+0000","last_active":"2023-07-06T22:02:12.775430+0000","last_peered":"2023-07-06T22:02:12.775430+0000","last_clean":"2023-07-06T22:02:12.775430+0000","last_became_active":"2023-07-06T22:02:11.794464+0000","last_became_peered":"2023-07-06T22:02:11.794464+0000","last_unstale":"2023-07-06T22:02:12.775430+0000","last_undegraded":"2023-07-06T22:02:12.775430+0000","last_fullsized":"2023-07-06T22:02:12.775430+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:57:13.109788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"159'1","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913505+0000","last_change":"2023-07-06T22:02:11.374658+0000","last_active":"2023-07-06T22:02:12.913505+0000","last_peered":"2023-07-06T22:02:12.913505+0000","last_clean":"2023-07-06T22:02:12.913505+0000","last_became_active":"2023-07-06T22:02:11.374402+0000","last_became_peered":"2023-07-06T22:02:11.374402+0000","last_unstale":"2023-07-06T22:02:12.913505+0000","last_undegraded":"2023-07-06T22:02:12.913505+0000","last_fullsized":"2023-07-06T22:02:12.913505+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:11:35.149162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771573+0000","last_change":"2023-07-06T22:02:11.786347+0000","last_active":"2023-07-06T22:02:12.771573+0000","last_peered":"2023-07-06T22:02:12.771573+0000","last_clean":"2023-07-06T22:02:12.771573+0000","last_became_active":"2023-07-06T22:02:11.786063+0000","last_became_peered":"2023-07-06T22:02:11.786063+0000","last_unstale":"2023-07-06T22:02:12.771573+0000","last_undegraded":"2023-07-06T22:02:12.771573+0000","last_fullsized":"2023-07-06T22:02:12.771573+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:02:37.956016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"159'2","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913571+0000","last_change":"2023-07-06T22:02:11.374366+0000","last_active":"2023-07-06T22:02:12.913571+0000","last_peered":"2023-07-06T22:02:12.913571+0000","last_clean":"2023-07-06T22:02:12.913571+0000","last_became_active":"2023-07-06T22:02:11.374100+0000","last_became_peered":"2023-07-06T22:02:11.374100+0000","last_unstale":"2023-07-06T22:02:12.913571+0000","last_undegraded":"2023-07-06T22:02:12.913571+0000","last_fullsized":"2023-07-06T22:02:12.913571+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:45:52.494673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914526+0000","last_change":"2023-07-06T22:02:11.784838+0000","last_active":"2023-07-06T22:02:12.914526+0000","last_peered":"2023-07-06T22:02:12.914526+0000","last_clean":"2023-07-06T22:02:12.914526+0000","last_became_active":"2023-07-06T22:02:11.784565+0000","last_became_peered":"2023-07-06T22:02:11.784565+0000","last_unstale":"2023-07-06T22:02:12.914526+0000","last_undegraded":"2023-07-06T22:02:12.914526+0000","last_fullsized":"2023-07-06T22:02:12.914526+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:55:40.627254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"159'1","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771503+0000","last_change":"2023-07-06T22:02:11.374389+0000","last_active":"2023-07-06T22:02:12.771503+0000","last_peered":"2023-07-06T22:02:12.771503+0000","last_clean":"2023-07-06T22:02:12.771503+0000","last_became_active":"2023-07-06T22:02:11.373445+0000","last_became_peered":"2023-07-06T22:02:11.373445+0000","last_unstale":"2023-07-06T22:02:12.771503+0000","last_undegraded":"2023-07-06T22:02:12.771503+0000","last_fullsized":"2023-07-06T22:02:12.771503+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:29:45.609039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913363+0000","last_change":"2023-07-06T22:02:11.797817+0000","last_active":"2023-07-06T22:02:12.913363+0000","last_peered":"2023-07-06T22:02:12.913363+0000","last_clean":"2023-07-06T22:02:12.913363+0000","last_became_active":"2023-07-06T22:02:11.797043+0000","last_became_peered":"2023-07-06T22:02:11.797043+0000","last_unstale":"2023-07-06T22:02:12.913363+0000","last_undegraded":"2023-07-06T22:02:12.913363+0000","last_fullsized":"2023-07-06T22:02:12.913363+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:10:31.844128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913044+0000","last_change":"2023-07-06T22:02:11.373798+0000","last_active":"2023-07-06T22:02:12.913044+0000","last_peered":"2023-07-06T22:02:12.913044+0000","last_clean":"2023-07-06T22:02:12.913044+0000","last_became_active":"2023-07-06T22:02:11.373534+0000","last_became_peered":"2023-07-06T22:02:11.373534+0000","last_unstale":"2023-07-06T22:02:12.913044+0000","last_undegraded":"2023-07-06T22:02:12.913044+0000","last_fullsized":"2023-07-06T22:02:12.913044+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:54:00.517334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774117+0000","last_change":"2023-07-06T22:02:11.778049+0000","last_active":"2023-07-06T22:02:12.774117+0000","last_peered":"2023-07-06T22:02:12.774117+0000","last_clean":"2023-07-06T22:02:12.774117+0000","last_became_active":"2023-07-06T22:02:11.777709+0000","last_became_peered":"2023-07-06T22:02:11.777709+0000","last_unstale":"2023-07-06T22:02:12.774117+0000","last_undegraded":"2023-07-06T22:02:12.774117+0000","last_fullsized":"2023-07-06T22:02:12.774117+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:53:15.791868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"159'2","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913550+0000","last_change":"2023-07-06T22:02:11.375392+0000","last_active":"2023-07-06T22:02:12.913550+0000","last_peered":"2023-07-06T22:02:12.913550+0000","last_clean":"2023-07-06T22:02:12.913550+0000","last_became_active":"2023-07-06T22:02:11.375122+0000","last_became_peered":"2023-07-06T22:02:11.375122+0000","last_unstale":"2023-07-06T22:02:12.913550+0000","last_undegraded":"2023-07-06T22:02:12.913550+0000","last_fullsized":"2023-07-06T22:02:12.913550+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:42:02.376386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913464+0000","last_change":"2023-07-06T22:02:11.774253+0000","last_active":"2023-07-06T22:02:12.913464+0000","last_peered":"2023-07-06T22:02:12.913464+0000","last_clean":"2023-07-06T22:02:12.913464+0000","last_became_active":"2023-07-06T22:02:11.773990+0000","last_became_peered":"2023-07-06T22:02:11.773990+0000","last_unstale":"2023-07-06T22:02:12.913464+0000","last_undegraded":"2023-07-06T22:02:12.913464+0000","last_fullsized":"2023-07-06T22:02:12.913464+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:15:54.168627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774645+0000","last_change":"2023-07-06T22:02:11.379524+0000","last_active":"2023-07-06T22:02:12.774645+0000","last_peered":"2023-07-06T22:02:12.774645+0000","last_clean":"2023-07-06T22:02:12.774645+0000","last_became_active":"2023-07-06T22:02:11.379197+0000","last_became_peered":"2023-07-06T22:02:11.379197+0000","last_unstale":"2023-07-06T22:02:12.774645+0000","last_undegraded":"2023-07-06T22:02:12.774645+0000","last_fullsized":"2023-07-06T22:02:12.774645+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:32:03.915897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.773470+0000","last_change":"2023-07-06T22:02:11.776430+0000","last_active":"2023-07-06T22:02:12.773470+0000","last_peered":"2023-07-06T22:02:12.773470+0000","last_clean":"2023-07-06T22:02:12.773470+0000","last_became_active":"2023-07-06T22:02:11.776091+0000","last_became_peered":"2023-07-06T22:02:11.776091+0000","last_unstale":"2023-07-06T22:02:12.773470+0000","last_undegraded":"2023-07-06T22:02:12.773470+0000","last_fullsized":"2023-07-06T22:02:12.773470+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:22:55.464238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774627+0000","last_change":"2023-07-06T22:02:11.374438+0000","last_active":"2023-07-06T22:02:12.774627+0000","last_peered":"2023-07-06T22:02:12.774627+0000","last_clean":"2023-07-06T22:02:12.774627+0000","last_became_active":"2023-07-06T22:02:11.374160+0000","last_became_peered":"2023-07-06T22:02:11.374160+0000","last_unstale":"2023-07-06T22:02:12.774627+0000","last_undegraded":"2023-07-06T22:02:12.774627+0000","last_fullsized":"2023-07-06T22:02:12.774627+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:58:52.702380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912868+0000","last_change":"2023-07-06T22:02:11.773767+0000","last_active":"2023-07-06T22:02:12.912868+0000","last_peered":"2023-07-06T22:02:12.912868+0000","last_clean":"2023-07-06T22:02:12.912868+0000","last_became_active":"2023-07-06T22:02:11.773448+0000","last_became_peered":"2023-07-06T22:02:11.773448+0000","last_unstale":"2023-07-06T22:02:12.912868+0000","last_undegraded":"2023-07-06T22:02:12.912868+0000","last_fullsized":"2023-07-06T22:02:12.912868+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:34:12.540854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913970+0000","last_change":"2023-07-06T22:02:11.380476+0000","last_active":"2023-07-06T22:02:12.913970+0000","last_peered":"2023-07-06T22:02:12.913970+0000","last_clean":"2023-07-06T22:02:12.913970+0000","last_became_active":"2023-07-06T22:02:11.380189+0000","last_became_peered":"2023-07-06T22:02:11.380189+0000","last_unstale":"2023-07-06T22:02:12.913970+0000","last_undegraded":"2023-07-06T22:02:12.913970+0000","last_fullsized":"2023-07-06T22:02:12.913970+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:25:03.706852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913635+0000","last_change":"2023-07-06T22:02:11.788194+0000","last_active":"2023-07-06T22:02:12.913635+0000","last_peered":"2023-07-06T22:02:12.913635+0000","last_clean":"2023-07-06T22:02:12.913635+0000","last_became_active":"2023-07-06T22:02:11.787905+0000","last_became_peered":"2023-07-06T22:02:11.787905+0000","last_unstale":"2023-07-06T22:02:12.913635+0000","last_undegraded":"2023-07-06T22:02:12.913635+0000","last_fullsized":"2023-07-06T22:02:12.913635+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:13:12.854522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"159'2","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775404+0000","last_change":"2023-07-06T22:02:11.374844+0000","last_active":"2023-07-06T22:02:12.775404+0000","last_peered":"2023-07-06T22:02:12.775404+0000","last_clean":"2023-07-06T22:02:12.775404+0000","last_became_active":"2023-07-06T22:02:11.374499+0000","last_became_peered":"2023-07-06T22:02:11.374499+0000","last_unstale":"2023-07-06T22:02:12.775404+0000","last_undegraded":"2023-07-06T22:02:12.775404+0000","last_fullsized":"2023-07-06T22:02:12.775404+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:07:43.842534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914729+0000","last_change":"2023-07-06T22:02:11.784151+0000","last_active":"2023-07-06T22:02:12.914729+0000","last_peered":"2023-07-06T22:02:12.914729+0000","last_clean":"2023-07-06T22:02:12.914729+0000","last_became_active":"2023-07-06T22:02:11.783839+0000","last_became_peered":"2023-07-06T22:02:11.783839+0000","last_unstale":"2023-07-06T22:02:12.914729+0000","last_undegraded":"2023-07-06T22:02:12.914729+0000","last_fullsized":"2023-07-06T22:02:12.914729+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:13:57.278029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913379+0000","last_change":"2023-07-06T22:02:11.378170+0000","last_active":"2023-07-06T22:02:12.913379+0000","last_peered":"2023-07-06T22:02:12.913379+0000","last_clean":"2023-07-06T22:02:12.913379+0000","last_became_active":"2023-07-06T22:02:11.377890+0000","last_became_peered":"2023-07-06T22:02:11.377890+0000","last_unstale":"2023-07-06T22:02:12.913379+0000","last_undegraded":"2023-07-06T22:02:12.913379+0000","last_fullsized":"2023-07-06T22:02:12.913379+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:40:38.984357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912964+0000","last_change":"2023-07-06T22:02:11.780651+0000","last_active":"2023-07-06T22:02:12.912964+0000","last_peered":"2023-07-06T22:02:12.912964+0000","last_clean":"2023-07-06T22:02:12.912964+0000","last_became_active":"2023-07-06T22:02:11.780385+0000","last_became_peered":"2023-07-06T22:02:11.780385+0000","last_unstale":"2023-07-06T22:02:12.912964+0000","last_undegraded":"2023-07-06T22:02:12.912964+0000","last_fullsized":"2023-07-06T22:02:12.912964+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:25:06.516604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913686+0000","last_change":"2023-07-06T22:02:11.382098+0000","last_active":"2023-07-06T22:02:12.913686+0000","last_peered":"2023-07-06T22:02:12.913686+0000","last_clean":"2023-07-06T22:02:12.913686+0000","last_became_active":"2023-07-06T22:02:11.381817+0000","last_became_peered":"2023-07-06T22:02:11.381817+0000","last_unstale":"2023-07-06T22:02:12.913686+0000","last_undegraded":"2023-07-06T22:02:12.913686+0000","last_fullsized":"2023-07-06T22:02:12.913686+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:58:14.625330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913489+0000","last_change":"2023-07-06T22:02:11.779166+0000","last_active":"2023-07-06T22:02:12.913489+0000","last_peered":"2023-07-06T22:02:12.913489+0000","last_clean":"2023-07-06T22:02:12.913489+0000","last_became_active":"2023-07-06T22:02:11.778917+0000","last_became_peered":"2023-07-06T22:02:11.778917+0000","last_unstale":"2023-07-06T22:02:12.913489+0000","last_undegraded":"2023-07-06T22:02:12.913489+0000","last_fullsized":"2023-07-06T22:02:12.913489+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:21:32.833172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912696+0000","last_change":"2023-07-06T22:02:11.382376+0000","last_active":"2023-07-06T22:02:12.912696+0000","last_peered":"2023-07-06T22:02:12.912696+0000","last_clean":"2023-07-06T22:02:12.912696+0000","last_became_active":"2023-07-06T22:02:11.382078+0000","last_became_peered":"2023-07-06T22:02:11.382078+0000","last_unstale":"2023-07-06T22:02:12.912696+0000","last_undegraded":"2023-07-06T22:02:12.912696+0000","last_fullsized":"2023-07-06T22:02:12.912696+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:55:06.439962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771135+0000","last_change":"2023-07-06T22:02:11.766148+0000","last_active":"2023-07-06T22:02:12.771135+0000","last_peered":"2023-07-06T22:02:12.771135+0000","last_clean":"2023-07-06T22:02:12.771135+0000","last_became_active":"2023-07-06T22:02:11.765855+0000","last_became_peered":"2023-07-06T22:02:11.765855+0000","last_unstale":"2023-07-06T22:02:12.771135+0000","last_undegraded":"2023-07-06T22:02:12.771135+0000","last_fullsized":"2023-07-06T22:02:12.771135+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:06:57.273149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913669+0000","last_change":"2023-07-06T22:02:11.368843+0000","last_active":"2023-07-06T22:02:12.913669+0000","last_peered":"2023-07-06T22:02:12.913669+0000","last_clean":"2023-07-06T22:02:12.913669+0000","last_became_active":"2023-07-06T22:02:11.368548+0000","last_became_peered":"2023-07-06T22:02:11.368548+0000","last_unstale":"2023-07-06T22:02:12.913669+0000","last_undegraded":"2023-07-06T22:02:12.913669+0000","last_fullsized":"2023-07-06T22:02:12.913669+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:44:29.823807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913664+0000","last_change":"2023-07-06T22:02:11.802828+0000","last_active":"2023-07-06T22:02:12.913664+0000","last_peered":"2023-07-06T22:02:12.913664+0000","last_clean":"2023-07-06T22:02:12.913664+0000","last_became_active":"2023-07-06T22:02:11.802487+0000","last_became_peered":"2023-07-06T22:02:11.802487+0000","last_unstale":"2023-07-06T22:02:12.913664+0000","last_undegraded":"2023-07-06T22:02:12.913664+0000","last_fullsized":"2023-07-06T22:02:12.913664+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:44:29.841780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774769+0000","last_change":"2023-07-06T22:02:11.373991+0000","last_active":"2023-07-06T22:02:12.774769+0000","last_peered":"2023-07-06T22:02:12.774769+0000","last_clean":"2023-07-06T22:02:12.774769+0000","last_became_active":"2023-07-06T22:02:11.373607+0000","last_became_peered":"2023-07-06T22:02:11.373607+0000","last_unstale":"2023-07-06T22:02:12.774769+0000","last_undegraded":"2023-07-06T22:02:12.774769+0000","last_fullsized":"2023-07-06T22:02:12.774769+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:09:06.618187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774552+0000","last_change":"2023-07-06T22:02:11.794130+0000","last_active":"2023-07-06T22:02:12.774552+0000","last_peered":"2023-07-06T22:02:12.774552+0000","last_clean":"2023-07-06T22:02:12.774552+0000","last_became_active":"2023-07-06T22:02:11.792310+0000","last_became_peered":"2023-07-06T22:02:11.792310+0000","last_unstale":"2023-07-06T22:02:12.774552+0000","last_undegraded":"2023-07-06T22:02:12.774552+0000","last_fullsized":"2023-07-06T22:02:12.774552+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:26:41.969171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913950+0000","last_change":"2023-07-06T22:02:11.382010+0000","last_active":"2023-07-06T22:02:12.913950+0000","last_peered":"2023-07-06T22:02:12.913950+0000","last_clean":"2023-07-06T22:02:12.913950+0000","last_became_active":"2023-07-06T22:02:11.381701+0000","last_became_peered":"2023-07-06T22:02:11.381701+0000","last_unstale":"2023-07-06T22:02:12.913950+0000","last_undegraded":"2023-07-06T22:02:12.913950+0000","last_fullsized":"2023-07-06T22:02:12.913950+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:23:04.586064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913595+0000","last_change":"2023-07-06T22:02:11.772567+0000","last_active":"2023-07-06T22:02:12.913595+0000","last_peered":"2023-07-06T22:02:12.913595+0000","last_clean":"2023-07-06T22:02:12.913595+0000","last_became_active":"2023-07-06T22:02:11.772184+0000","last_became_peered":"2023-07-06T22:02:11.772184+0000","last_unstale":"2023-07-06T22:02:12.913595+0000","last_undegraded":"2023-07-06T22:02:12.913595+0000","last_fullsized":"2023-07-06T22:02:12.913595+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:32:04.525681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912736+0000","last_change":"2023-07-06T22:02:11.376363+0000","last_active":"2023-07-06T22:02:12.912736+0000","last_peered":"2023-07-06T22:02:12.912736+0000","last_clean":"2023-07-06T22:02:12.912736+0000","last_became_active":"2023-07-06T22:02:11.375556+0000","last_became_peered":"2023-07-06T22:02:11.375556+0000","last_unstale":"2023-07-06T22:02:12.912736+0000","last_undegraded":"2023-07-06T22:02:12.912736+0000","last_fullsized":"2023-07-06T22:02:12.912736+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:22:54.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913817+0000","last_change":"2023-07-06T22:02:11.766773+0000","last_active":"2023-07-06T22:02:12.913817+0000","last_peered":"2023-07-06T22:02:12.913817+0000","last_clean":"2023-07-06T22:02:12.913817+0000","last_became_active":"2023-07-06T22:02:11.766493+0000","last_became_peered":"2023-07-06T22:02:11.766493+0000","last_unstale":"2023-07-06T22:02:12.913817+0000","last_undegraded":"2023-07-06T22:02:12.913817+0000","last_fullsized":"2023-07-06T22:02:12.913817+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:55:42.084691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"159'3","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914484+0000","last_change":"2023-07-06T22:02:11.380202+0000","last_active":"2023-07-06T22:02:12.914484+0000","last_peered":"2023-07-06T22:02:12.914484+0000","last_clean":"2023-07-06T22:02:12.914484+0000","last_became_active":"2023-07-06T22:02:11.379908+0000","last_became_peered":"2023-07-06T22:02:11.379908+0000","last_unstale":"2023-07-06T22:02:12.914484+0000","last_undegraded":"2023-07-06T22:02:12.914484+0000","last_fullsized":"2023-07-06T22:02:12.914484+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:31:32.727749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"148'271","reported_seq":991,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775123+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:02:12.775123+0000","last_peered":"2023-07-06T22:02:12.775123+0000","last_clean":"2023-07-06T22:02:12.775123+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:02:12.775123+0000","last_undegraded":"2023-07-06T22:02:12.775123+0000","last_fullsized":"2023-07-06T22:02:12.775123+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:07:16.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":252,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913794+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:02:12.913794+0000","last_peered":"2023-07-06T22:02:12.913794+0000","last_clean":"2023-07-06T22:02:12.913794+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:02:12.913794+0000","last_undegraded":"2023-07-06T22:02:12.913794+0000","last_fullsized":"2023-07-06T22:02:12.913794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:24:53.748950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775196+0000","last_change":"2023-07-06T22:02:11.796671+0000","last_active":"2023-07-06T22:02:12.775196+0000","last_peered":"2023-07-06T22:02:12.775196+0000","last_clean":"2023-07-06T22:02:12.775196+0000","last_became_active":"2023-07-06T22:02:11.795517+0000","last_became_peered":"2023-07-06T22:02:11.795517+0000","last_unstale":"2023-07-06T22:02:12.775196+0000","last_undegraded":"2023-07-06T22:02:12.775196+0000","last_fullsized":"2023-07-06T22:02:12.775196+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:03.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775386+0000","last_change":"2023-07-06T22:02:11.375923+0000","last_active":"2023-07-06T22:02:12.775386+0000","last_peered":"2023-07-06T22:02:12.775386+0000","last_clean":"2023-07-06T22:02:12.775386+0000","last_became_active":"2023-07-06T22:02:11.375643+0000","last_became_peered":"2023-07-06T22:02:11.375643+0000","last_unstale":"2023-07-06T22:02:12.775386+0000","last_undegraded":"2023-07-06T22:02:12.775386+0000","last_fullsized":"2023-07-06T22:02:12.775386+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:53:36.842275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774668+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:02:12.774668+0000","last_peered":"2023-07-06T22:02:12.774668+0000","last_clean":"2023-07-06T22:02:12.774668+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:02:12.774668+0000","last_undegraded":"2023-07-06T22:02:12.774668+0000","last_fullsized":"2023-07-06T22:02:12.774668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:29:53.792407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913718+0000","last_change":"2023-07-06T22:02:11.773553+0000","last_active":"2023-07-06T22:02:12.913718+0000","last_peered":"2023-07-06T22:02:12.913718+0000","last_clean":"2023-07-06T22:02:12.913718+0000","last_became_active":"2023-07-06T22:02:11.773174+0000","last_became_peered":"2023-07-06T22:02:11.773174+0000","last_unstale":"2023-07-06T22:02:12.913718+0000","last_undegraded":"2023-07-06T22:02:12.913718+0000","last_fullsized":"2023-07-06T22:02:12.913718+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:13:47.485594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913626+0000","last_change":"2023-07-06T22:02:11.379041+0000","last_active":"2023-07-06T22:02:12.913626+0000","last_peered":"2023-07-06T22:02:12.913626+0000","last_clean":"2023-07-06T22:02:12.913626+0000","last_became_active":"2023-07-06T22:02:11.378763+0000","last_became_peered":"2023-07-06T22:02:11.378763+0000","last_unstale":"2023-07-06T22:02:12.913626+0000","last_undegraded":"2023-07-06T22:02:12.913626+0000","last_fullsized":"2023-07-06T22:02:12.913626+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:08:58.162603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771031+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:02:12.771031+0000","last_peered":"2023-07-06T22:02:12.771031+0000","last_clean":"2023-07-06T22:02:12.771031+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:02:12.771031+0000","last_undegraded":"2023-07-06T22:02:12.771031+0000","last_fullsized":"2023-07-06T22:02:12.771031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:44:27.584594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771415+0000","last_change":"2023-07-06T22:02:11.777121+0000","last_active":"2023-07-06T22:02:12.771415+0000","last_peered":"2023-07-06T22:02:12.771415+0000","last_clean":"2023-07-06T22:02:12.771415+0000","last_became_active":"2023-07-06T22:02:11.776809+0000","last_became_peered":"2023-07-06T22:02:11.776809+0000","last_unstale":"2023-07-06T22:02:12.771415+0000","last_undegraded":"2023-07-06T22:02:12.771415+0000","last_fullsized":"2023-07-06T22:02:12.771415+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:16:06.912773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"159'6","reported_seq":19,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913802+0000","last_change":"2023-07-06T22:02:11.369905+0000","last_active":"2023-07-06T22:02:12.913802+0000","last_peered":"2023-07-06T22:02:12.913802+0000","last_clean":"2023-07-06T22:02:12.913802+0000","last_became_active":"2023-07-06T22:02:11.369528+0000","last_became_peered":"2023-07-06T22:02:11.369528+0000","last_unstale":"2023-07-06T22:02:12.913802+0000","last_undegraded":"2023-07-06T22:02:12.913802+0000","last_fullsized":"2023-07-06T22:02:12.913802+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:11:05.323751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":252,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913306+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:02:12.913306+0000","last_peered":"2023-07-06T22:02:12.913306+0000","last_clean":"2023-07-06T22:02:12.913306+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:02:12.913306+0000","last_undegraded":"2023-07-06T22:02:12.913306+0000","last_fullsized":"2023-07-06T22:02:12.913306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:40:52.634861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914027+0000","last_change":"2023-07-06T22:02:11.784361+0000","last_active":"2023-07-06T22:02:12.914027+0000","last_peered":"2023-07-06T22:02:12.914027+0000","last_clean":"2023-07-06T22:02:12.914027+0000","last_became_active":"2023-07-06T22:02:11.784107+0000","last_became_peered":"2023-07-06T22:02:11.784107+0000","last_unstale":"2023-07-06T22:02:12.914027+0000","last_undegraded":"2023-07-06T22:02:12.914027+0000","last_fullsized":"2023-07-06T22:02:12.914027+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:48:18.480350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914218+0000","last_change":"2023-07-06T22:02:11.378337+0000","last_active":"2023-07-06T22:02:12.914218+0000","last_peered":"2023-07-06T22:02:12.914218+0000","last_clean":"2023-07-06T22:02:12.914218+0000","last_became_active":"2023-07-06T22:02:11.377962+0000","last_became_peered":"2023-07-06T22:02:11.377962+0000","last_unstale":"2023-07-06T22:02:12.914218+0000","last_undegraded":"2023-07-06T22:02:12.914218+0000","last_fullsized":"2023-07-06T22:02:12.914218+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:40:14.479318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":260,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912811+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:02:12.912811+0000","last_peered":"2023-07-06T22:02:12.912811+0000","last_clean":"2023-07-06T22:02:12.912811+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:02:12.912811+0000","last_undegraded":"2023-07-06T22:02:12.912811+0000","last_fullsized":"2023-07-06T22:02:12.912811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:47:07.479653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914167+0000","last_change":"2023-07-06T22:02:11.783832+0000","last_active":"2023-07-06T22:02:12.914167+0000","last_peered":"2023-07-06T22:02:12.914167+0000","last_clean":"2023-07-06T22:02:12.914167+0000","last_became_active":"2023-07-06T22:02:11.781102+0000","last_became_peered":"2023-07-06T22:02:11.781102+0000","last_unstale":"2023-07-06T22:02:12.914167+0000","last_undegraded":"2023-07-06T22:02:12.914167+0000","last_fullsized":"2023-07-06T22:02:12.914167+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:12:11.434735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"159'2","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914279+0000","last_change":"2023-07-06T22:02:11.383128+0000","last_active":"2023-07-06T22:02:12.914279+0000","last_peered":"2023-07-06T22:02:12.914279+0000","last_clean":"2023-07-06T22:02:12.914279+0000","last_became_active":"2023-07-06T22:02:11.382759+0000","last_became_peered":"2023-07-06T22:02:11.382759+0000","last_unstale":"2023-07-06T22:02:12.914279+0000","last_undegraded":"2023-07-06T22:02:12.914279+0000","last_fullsized":"2023-07-06T22:02:12.914279+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:10:13.337071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775077+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:02:12.775077+0000","last_peered":"2023-07-06T22:02:12.775077+0000","last_clean":"2023-07-06T22:02:12.775077+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:02:12.775077+0000","last_undegraded":"2023-07-06T22:02:12.775077+0000","last_fullsized":"2023-07-06T22:02:12.775077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:18:24.736396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913952+0000","last_change":"2023-07-06T22:02:11.785959+0000","last_active":"2023-07-06T22:02:12.913952+0000","last_peered":"2023-07-06T22:02:12.913952+0000","last_clean":"2023-07-06T22:02:12.913952+0000","last_became_active":"2023-07-06T22:02:11.785675+0000","last_became_peered":"2023-07-06T22:02:11.785675+0000","last_unstale":"2023-07-06T22:02:12.913952+0000","last_undegraded":"2023-07-06T22:02:12.913952+0000","last_fullsized":"2023-07-06T22:02:12.913952+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:03:34.057675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"159'8","reported_seq":21,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771046+0000","last_change":"2023-07-06T22:02:11.372311+0000","last_active":"2023-07-06T22:02:12.771046+0000","last_peered":"2023-07-06T22:02:12.771046+0000","last_clean":"2023-07-06T22:02:12.771046+0000","last_became_active":"2023-07-06T22:02:11.371110+0000","last_became_peered":"2023-07-06T22:02:11.371110+0000","last_unstale":"2023-07-06T22:02:12.771046+0000","last_undegraded":"2023-07-06T22:02:12.771046+0000","last_fullsized":"2023-07-06T22:02:12.771046+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:37:31.526128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":260,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913477+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:02:12.913477+0000","last_peered":"2023-07-06T22:02:12.913477+0000","last_clean":"2023-07-06T22:02:12.913477+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:02:12.913477+0000","last_undegraded":"2023-07-06T22:02:12.913477+0000","last_fullsized":"2023-07-06T22:02:12.913477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:08:50.920285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913653+0000","last_change":"2023-07-06T22:02:11.775329+0000","last_active":"2023-07-06T22:02:12.913653+0000","last_peered":"2023-07-06T22:02:12.913653+0000","last_clean":"2023-07-06T22:02:12.913653+0000","last_became_active":"2023-07-06T22:02:11.774979+0000","last_became_peered":"2023-07-06T22:02:11.774979+0000","last_unstale":"2023-07-06T22:02:12.913653+0000","last_undegraded":"2023-07-06T22:02:12.913653+0000","last_fullsized":"2023-07-06T22:02:12.913653+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:10:40.027687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912617+0000","last_change":"2023-07-06T22:02:11.377834+0000","last_active":"2023-07-06T22:02:12.912617+0000","last_peered":"2023-07-06T22:02:12.912617+0000","last_clean":"2023-07-06T22:02:12.912617+0000","last_became_active":"2023-07-06T22:02:11.377527+0000","last_became_peered":"2023-07-06T22:02:11.377527+0000","last_unstale":"2023-07-06T22:02:12.912617+0000","last_undegraded":"2023-07-06T22:02:12.912617+0000","last_fullsized":"2023-07-06T22:02:12.912617+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:02:41.196452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":252,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914653+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:02:12.914653+0000","last_peered":"2023-07-06T22:02:12.914653+0000","last_clean":"2023-07-06T22:02:12.914653+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:02:12.914653+0000","last_undegraded":"2023-07-06T22:02:12.914653+0000","last_fullsized":"2023-07-06T22:02:12.914653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:35:33.815743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575089,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37680,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334160,"statfs":{"total":96636764160,"available":96598179840,"internally_reserved":0,"allocated":2596864,"data_stored":1653416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.70899999999999996},"min":{"1min":0.46899999999999997,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":1.0229999999999999,"5min":1.526,"15min":1.526},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0409999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":1.0580000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.47499999999999998,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":1.1100000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.47399999999999998,"5min":0.42799999999999999,"15min":0.377},"max":{"1min":1,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.42599999999999999},"max":{"1min":1.1339999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.627}]},{"osd":3,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.42199999999999999},"max":{"1min":1.075,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.74199999999999999,"15min":0.74399999999999999},"min":{"1min":0.59699999999999998,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.0980000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.39400000000000002,"5min":0.377,"15min":0.32700000000000001},"max":{"1min":0.78700000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.35699999999999998},"max":{"1min":0.749,"5min":1.169,"15min":1.169},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71899999999999997,"15min":0.70599999999999996},"min":{"1min":0.58999999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":1.45,"15min":1.45},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.44400000000000001,"15min":0.41699999999999998},"max":{"1min":0.85799999999999998,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.59799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575089,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37100,"kb_used_data":1956,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334740,"statfs":{"total":96636764160,"available":96598773760,"internally_reserved":0,"allocated":2002944,"data_stored":1061523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41399999999999998},"max":{"1min":1.089,"5min":1.607,"15min":1.607},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.751,"15min":0.74099999999999999},"min":{"1min":0.48399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1990000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.38500000000000001},"max":{"1min":0.85699999999999998,"5min":1.857,"15min":1.857},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.48899999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2270000000000001,"5min":1.778,"15min":1.778},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69399999999999995,"15min":0.71599999999999997},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":0.92700000000000005,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.62},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71299999999999997,"15min":0.73799999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0529999999999999,"5min":1.752,"15min":1.752},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.165,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.499,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1020000000000001,"5min":1.794,"15min":1.794},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81699999999999995,"5min":0.95399999999999996,"15min":1.4390000000000001},"last":0.496},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.80100000000000005,"5min":0.94099999999999995,"15min":1.0509999999999999},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.62},"min":{"1min":0.442,"5min":0.42099999999999999,"15min":0.38600000000000001},"max":{"1min":0.82599999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.39000000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.3089999999999999},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.0029999999999999,"15min":1.2549999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85399999999999998,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.56899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575088,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55144,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316696,"statfs":{"total":96636764160,"available":96580296704,"internally_reserved":0,"allocated":1998848,"data_stored":1062418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98099999999999998,"5min":1.49,"15min":1.49},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.55500000000000005,"5min":0.45400000000000001,"15min":0.35299999999999998},"max":{"1min":1.0209999999999999,"5min":1.21,"15min":1.21},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.54400000000000004,"5min":0.45600000000000002,"15min":0.40200000000000002},"max":{"1min":1.0369999999999999,"5min":1.143,"15min":1.143},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.39900000000000002},"max":{"1min":0.99199999999999999,"5min":1.5,"15min":1.5},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44400000000000001},"max":{"1min":1.044,"5min":1.163,"15min":1.163},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.443},"max":{"1min":0.97999999999999998,"5min":1.127,"15min":1.127},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.008,"5min":1.109,"15min":1.109},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":0.85399999999999998,"5min":1.012,"15min":1.012},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.371},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.02},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.004},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.44400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.34100000000000003},"max":{"1min":0.91400000000000003,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0589999999999999},"last":0.78700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575087,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55140,"kb_used_data":1948,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316700,"statfs":{"total":96636764160,"available":96580300800,"internally_reserved":0,"allocated":1994752,"data_stored":1062396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.72099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":0.89400000000000002,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.622},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98799999999999999,"5min":1.208,"15min":1.208},"last":0.495}]},{"osd":1,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.55000000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1200000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.439},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.72099999999999997},"min":{"1min":0.47499999999999998,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":1.996,"15min":1.996},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.54000000000000004,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.60199999999999998,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.0509999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.746,"15min":0.754},"min":{"1min":0.58499999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2370000000000001,"5min":1.3640000000000001,"15min":3.2269999999999999},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.46000000000000002,"5min":0.35499999999999998,"15min":0.308},"max":{"1min":0.75,"5min":0.93899999999999995,"15min":0.94299999999999995},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.60099999999999998},"min":{"1min":0.503,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.71899999999999997,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.47399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76800000000000002,"5min":1.036,"15min":1.036},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.65600000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":1,"15min":1},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93000000000000005,"5min":1.0149999999999999,"15min":1.0720000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.42299999999999999,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":1.01},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575088,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51048,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320792,"statfs":{"total":96636764160,"available":96584491008,"internally_reserved":0,"allocated":1998848,"data_stored":1062486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.433,"15min":0.45200000000000001},"min":{"1min":0.25800000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48199999999999998,"15min":0.52900000000000003},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":2.77},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.442,"15min":0.48499999999999999},"min":{"1min":0.315,"5min":0.27500000000000002,"15min":0.24299999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":2.4359999999999999},"last":0.315},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53800000000000003,"15min":0.57899999999999996},"min":{"1min":0.40400000000000003,"5min":0.313,"15min":0.313},"max":{"1min":1.107,"5min":1.107,"15min":1.351},"last":0.442}]},{"osd":2,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52400000000000002,"15min":0.54500000000000004},"min":{"1min":0.41199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.24},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.755},"min":{"1min":0.502,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.022,"5min":1.1020000000000001,"15min":1.3009999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.71099999999999997,"15min":0.77100000000000002},"min":{"1min":0.55000000000000004,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.383},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.75600000000000001,"15min":0.80300000000000005},"min":{"1min":0.63600000000000001,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.1259999999999999,"5min":1.349,"15min":1.4199999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.754,"15min":0.78900000000000003},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.0509999999999999,"5min":1.395,"15min":1.3999999999999999},"last":0.748}]},{"osd":6,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73999999999999999,"15min":0.79200000000000004},"min":{"1min":0.56100000000000005,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.093,"5min":1.371,"15min":1.425},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.748,"15min":0.80200000000000005},"min":{"1min":0.54400000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0920000000000001,"5min":1.097,"15min":3.1739999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.73499999999999999,"15min":0.80100000000000005},"min":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":3.097},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.75600000000000001,"15min":0.79900000000000004},"min":{"1min":0.59299999999999997,"5min":0.47099999999999997,"15min":0.45900000000000002},"max":{"1min":1.0740000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.72499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575088,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41204,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330636,"statfs":{"total":96636764160,"available":96594571264,"internally_reserved":0,"allocated":2011136,"data_stored":1064030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.42799999999999999,"15min":0.45100000000000001},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.623,"5min":0.68600000000000005,"15min":0.85999999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48499999999999999,"15min":0.5},"min":{"1min":0.38200000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.73399999999999999,"5min":0.82199999999999995,"15min":0.85999999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.496,"15min":0.50900000000000001},"min":{"1min":0.39100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67900000000000005,"5min":0.878,"15min":0.88200000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.54400000000000004},"min":{"1min":0.38200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72799999999999998,"5min":0.83499999999999996,"15min":0.94399999999999995},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.374},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55600000000000005,"15min":0.57699999999999996},"min":{"1min":0.44,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.95399999999999996},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.47999999999999998,"15min":0.42899999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.57099999999999995,"5min":0.52100000000000002,"15min":0.41399999999999998},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.52200000000000002,"15min":0.42899999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77800000000000002,"15min":0.80900000000000005},"min":{"1min":0.51500000000000001,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.48299999999999998},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.63900000000000001,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80700000000000005,"15min":0.82499999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.496},"max":{"1min":1.127,"5min":1.458,"15min":1.458},"last":0.63},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.81399999999999995,"15min":0.83899999999999997},"min":{"1min":0.60199999999999998,"5min":0.54200000000000004,"15min":0.50700000000000001},"max":{"1min":1.415,"5min":1.573,"15min":1.573},"last":0.76000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575089,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59240,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312600,"statfs":{"total":96636764160,"available":96576102400,"internally_reserved":0,"allocated":1998848,"data_stored":1062978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.30199999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73599999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47799999999999998,"15min":0.501},"min":{"1min":0.36299999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68400000000000005,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.35299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71399999999999997,"5min":0.83999999999999997,"15min":0.88900000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.52300000000000002},"min":{"1min":0.38200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.71399999999999997,"15min":0.87},"last":0.442}]},{"osd":3,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.57699999999999996},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.84599999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.53900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32000000000000001},"max":{"1min":0.74299999999999999,"5min":0.749,"15min":0.91200000000000003},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.54300000000000004,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.3140000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77100000000000002,"15min":0.78400000000000003},"min":{"1min":0.64400000000000002,"5min":0.48899999999999999,"15min":0.44},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.64300000000000002,"5min":0.48699999999999999,"15min":0.41899999999999998},"max":{"1min":1.129,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.77400000000000002,"15min":0.79100000000000004},"min":{"1min":0.57999999999999996,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":1.1859999999999999,"5min":1.3260000000000001,"15min":1.357},"last":0.872}]},{"osd":6,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.624,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1859999999999999,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.3029999999999999,"5min":1.4379999999999999,"15min":1.456},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.80100000000000005,"15min":0.81000000000000005},"min":{"1min":0.58499999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.745},{"interface":"front","average":{"1min":0.873,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.67900000000000005,"5min":0.51900000000000002,"15min":0.5},"max":{"1min":1.2250000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.77900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575088,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37684,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334156,"statfs":{"total":96636764160,"available":96598175744,"internally_reserved":0,"allocated":2600960,"data_stored":1653343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.42199999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.86399999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.374,"5min":0.28299999999999997,"15min":0.27600000000000002},"max":{"1min":0.67400000000000004,"5min":0.86799999999999999,"15min":0.98099999999999998},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47399999999999998,"15min":0.495},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.82399999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.496,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.33800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":1.2050000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47899999999999998,"15min":0.50600000000000001},"min":{"1min":0.35699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63,"5min":0.76600000000000001,"15min":1.151},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65900000000000003,"5min":0.78800000000000003,"15min":0.874},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.78400000000000003},"min":{"1min":0.55800000000000005,"5min":0.46400000000000002,"15min":0.45000000000000001},"max":{"1min":1.2190000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.48099999999999998,"5min":0.44600000000000001,"15min":0.40999999999999998},"max":{"1min":1.143,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.754}]},{"osd":5,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57899999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96599999999999997,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.745,"15min":0.77600000000000002},"min":{"1min":0.52900000000000003,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.284,"5min":1.776,"15min":1.776},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.52200000000000002,"15min":0.48899999999999999},"max":{"1min":1.232,"5min":1.851,"15min":1.851},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1739999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78600000000000003,"15min":0.80500000000000005},"min":{"1min":0.51200000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.252,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.81499999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.50900000000000001},"max":{"1min":1.1879999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:02:20.471 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:02:20.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f33065fa640 1 Processor -- start 2023-07-06T22:02:20.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f33065fa640 1 -- start start 2023-07-06T22:02:20.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f33065fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33000b1560 0x7f33000b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:20.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f33065fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f330015fc10 0x7f33000ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:20.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f33065fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3300160090 con 0x7f33000b7c60 2023-07-06T22:02:20.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f33065fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3300160310 con 0x7f33000b1560 2023-07-06T22:02:20.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f33065fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33000b1b30 con 0x7f330015fc10 2023-07-06T22:02:20.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f32ff7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33000b1560 0x7f33000b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:20.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f32ff7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33000b1560 0x7f33000b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44066/0 (socket says 172.21.15.55:44066) 2023-07-06T22:02:20.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f32ff7fe640 1 -- 172.21.15.55:0/2564881105 learned_addr learned my addr 172.21.15.55:0/2564881105 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:20.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f3304b97640 1 --2- 172.21.15.55:0/2564881105 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f330015fc10 0x7f33000ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:20.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f32ff7fe640 1 -- 172.21.15.55:0/2564881105 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f330015fc10 msgr2=0x7f33000ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:20.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f32ff7fe640 1 --2- 172.21.15.55:0/2564881105 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f330015fc10 0x7f33000ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:20.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f32ff7fe640 1 -- 172.21.15.55:0/2564881105 >> v1:172.21.15.138:6789/0 conn(0x7f33000b7c60 legacy=0x7f330015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:20.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f32ff7fe640 1 -- 172.21.15.55:0/2564881105 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000b1e10 con 0x7f33000b1560 2023-07-06T22:02:20.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.627+0000 7f3304b97640 1 --2- 172.21.15.55:0/2564881105 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f330015fc10 0x7f33000ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:20.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.631+0000 7f32ff7fe640 1 --2- 172.21.15.55:0/2564881105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33000b1560 0x7f33000b5000 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f32f40098a0 tx=0x7f32f401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e06e931575575ea server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:20.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.631+0000 7f32feffd640 1 -- 172.21.15.55:0/2564881105 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40ab610 con 0x7f33000b1560 2023-07-06T22:02:20.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.631+0000 7f32feffd640 1 -- 172.21.15.55:0/2564881105 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f40ab770 con 0x7f33000b1560 2023-07-06T22:02:20.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.631+0000 7f32feffd640 1 -- 172.21.15.55:0/2564881105 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40abb00 con 0x7f33000b1560 2023-07-06T22:02:20.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.631+0000 7f33065fa640 1 -- 172.21.15.55:0/2564881105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33000b1560 msgr2=0x7f33000b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:20.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.631+0000 7f33065fa640 1 --2- 172.21.15.55:0/2564881105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33000b1560 0x7f33000b5000 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f32f40098a0 tx=0x7f32f401c520 comp rx=0 tx=0).stop 2023-07-06T22:02:20.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.631+0000 7f33065fa640 1 -- 172.21.15.55:0/2564881105 shutdown_connections 2023-07-06T22:02:20.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.631+0000 7f33065fa640 1 --2- 172.21.15.55:0/2564881105 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f330015fc10 0x7f33000ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:20.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.631+0000 7f33065fa640 1 --2- 172.21.15.55:0/2564881105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33000b1560 0x7f33000b5000 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:20.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.631+0000 7f33065fa640 1 -- 172.21.15.55:0/2564881105 >> 172.21.15.55:0/2564881105 conn(0x7f33000cf8d0 msgr2=0x7f33000d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:20.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.631+0000 7f33065fa640 1 -- 172.21.15.55:0/2564881105 shutdown_connections 2023-07-06T22:02:20.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.631+0000 7f33065fa640 1 -- 172.21.15.55:0/2564881105 wait complete. 2023-07-06T22:02:20.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f33065fa640 1 Processor -- start 2023-07-06T22:02:20.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f33065fa640 1 -- start start 2023-07-06T22:02:20.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f33065fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33000b1560 0x7f330014f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:20.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f33065fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33000b7c60 0x7f3300069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:20.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f33065fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f330015fc10 0x7f330006a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:20.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f33065fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33001f4f40 con 0x7f33000b1560 2023-07-06T22:02:20.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f33065fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33000cbff0 con 0x7f33000b7c60 2023-07-06T22:02:20.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f33065fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33001593d0 con 0x7f330015fc10 2023-07-06T22:02:20.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f32fffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33000b1560 0x7f330014f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:20.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f32fffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33000b1560 0x7f330014f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44070/0 (socket says 172.21.15.55:44070) 2023-07-06T22:02:20.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33000b7c60 0x7f3300069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:20.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f32fffff640 1 -- 172.21.15.55:0/481610157 learned_addr learned my addr 172.21.15.55:0/481610157 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:20.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f3304b97640 1 --2- 172.21.15.55:0/481610157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f330015fc10 0x7f330006a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:20.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f32fffff640 1 -- 172.21.15.55:0/481610157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f330015fc10 msgr2=0x7f330006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:20.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f32fffff640 1 --2- 172.21.15.55:0/481610157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f330015fc10 0x7f330006a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:20.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f32fffff640 1 -- 172.21.15.55:0/481610157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33000b7c60 msgr2=0x7f3300069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:20.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f32fffff640 1 --2- 172.21.15.55:0/481610157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33000b7c60 0x7f3300069f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:20.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f32fffff640 1 -- 172.21.15.55:0/481610157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f40094d0 con 0x7f33000b1560 2023-07-06T22:02:20.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f32fffff640 1 --2- 172.21.15.55:0/481610157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33000b1560 0x7f330014f710 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f32f000c500 tx=0x7f32f000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:20.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f32fcff9640 1 -- 172.21.15.55:0/481610157 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0005220 con 0x7f33000b1560 2023-07-06T22:02:20.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f32fcff9640 1 -- 172.21.15.55:0/481610157 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f0005380 con 0x7f33000b1560 2023-07-06T22:02:20.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f33065fa640 1 -- 172.21.15.55:0/481610157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33001596b0 con 0x7f33000b1560 2023-07-06T22:02:20.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.635+0000 7f32fcff9640 1 -- 172.21.15.55:0/481610157 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0007270 con 0x7f33000b1560 2023-07-06T22:02:20.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.639+0000 7f33065fa640 1 -- 172.21.15.55:0/481610157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3300159c70 con 0x7f33000b1560 2023-07-06T22:02:20.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.639+0000 7f33065fa640 1 -- 172.21.15.55:0/481610157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3300159e60 con 0x7f33000b1560 2023-07-06T22:02:20.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.639+0000 7f32fcff9640 1 -- 172.21.15.55:0/481610157 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f32f00073d0 con 0x7f33000b1560 2023-07-06T22:02:20.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.639+0000 7f32fcff9640 1 --2- 172.21.15.55:0/481610157 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f32ec0663a0 0x7f32ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:20.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.639+0000 7f32fcff9640 1 -- 172.21.15.55:0/481610157 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f32f0083850 con 0x7f33000b1560 2023-07-06T22:02:20.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.639+0000 7f32ff7fe640 1 --2- 172.21.15.55:0/481610157 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f32ec0663a0 0x7f32ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:20.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.639+0000 7f32ff7fe640 1 --2- 172.21.15.55:0/481610157 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f32ec0663a0 0x7f32ec068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f32f40af000 tx=0x7f32f40b6040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:20.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.643+0000 7f32fcff9640 1 -- 172.21.15.55:0/481610157 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f32f0050a80 con 0x7f33000b1560 2023-07-06T22:02:20.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.795+0000 7f33065fa640 1 -- 172.21.15.55:0/481610157 --> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33000b8030 con 0x7f32ec0663a0 2023-07-06T22:02:20.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.803+0000 7f32fcff9640 1 -- 172.21.15.55:0/481610157 <== mgr.9489 v2:172.21.15.55:6832/433956277 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311425 (secure 0 0 0) 0x7f32f40ab8e0 con 0x7f32ec0663a0 2023-07-06T22:02:20.805 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:20.807 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:02:20.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.807+0000 7f33065fa640 1 -- 172.21.15.55:0/481610157 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f32ec0663a0 msgr2=0x7f32ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:20.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.807+0000 7f33065fa640 1 --2- 172.21.15.55:0/481610157 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f32ec0663a0 0x7f32ec068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f32f40af000 tx=0x7f32f40b6040 comp rx=0 tx=0).stop 2023-07-06T22:02:20.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.807+0000 7f33065fa640 1 -- 172.21.15.55:0/481610157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33000b1560 msgr2=0x7f330014f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:20.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.807+0000 7f33065fa640 1 --2- 172.21.15.55:0/481610157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33000b1560 0x7f330014f710 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f32f000c500 tx=0x7f32f000c9c0 comp rx=0 tx=0).stop 2023-07-06T22:02:20.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.807+0000 7f33065fa640 1 -- 172.21.15.55:0/481610157 shutdown_connections 2023-07-06T22:02:20.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.807+0000 7f33065fa640 1 --2- 172.21.15.55:0/481610157 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f330015fc10 0x7f330006a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.807+0000 7f33065fa640 1 --2- 172.21.15.55:0/481610157 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f32ec0663a0 0x7f32ec068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.807+0000 7f33065fa640 1 --2- 172.21.15.55:0/481610157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33000b7c60 0x7f3300069f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.807+0000 7f33065fa640 1 --2- 172.21.15.55:0/481610157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33000b1560 0x7f330014f710 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.807+0000 7f33065fa640 1 -- 172.21.15.55:0/481610157 >> 172.21.15.55:0/481610157 conn(0x7f33000cf8d0 msgr2=0x7f330006aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.807+0000 7f33065fa640 1 -- 172.21.15.55:0/481610157 shutdown_connections 2023-07-06T22:02:20.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:20.807+0000 7f33065fa640 1 -- 172.21.15.55:0/481610157 wait complete. 2023-07-06T22:02:20.826 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-06T22:02:18.858637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":483,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":309,"ondisk_log_size":309,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":374240,"kb_used_data":16800,"kb_used_omap":0,"kb_used_meta":357376,"kb_avail":754600480,"statfs":{"total":773094113280,"available":772710891520,"internally_reserved":0,"allocated":17203200,"data_stored":9682590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":365953024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.505569"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913059+0000","last_change":"2023-07-06T22:02:11.786795+0000","last_active":"2023-07-06T22:02:12.913059+0000","last_peered":"2023-07-06T22:02:12.913059+0000","last_clean":"2023-07-06T22:02:12.913059+0000","last_became_active":"2023-07-06T22:02:11.786532+0000","last_became_peered":"2023-07-06T22:02:11.786532+0000","last_unstale":"2023-07-06T22:02:12.913059+0000","last_undegraded":"2023-07-06T22:02:12.913059+0000","last_fullsized":"2023-07-06T22:02:12.913059+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:43:55.679480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913359+0000","last_change":"2023-07-06T22:02:11.784925+0000","last_active":"2023-07-06T22:02:12.913359+0000","last_peered":"2023-07-06T22:02:12.913359+0000","last_clean":"2023-07-06T22:02:12.913359+0000","last_became_active":"2023-07-06T22:02:11.784668+0000","last_became_peered":"2023-07-06T22:02:11.784668+0000","last_unstale":"2023-07-06T22:02:12.913359+0000","last_undegraded":"2023-07-06T22:02:12.913359+0000","last_fullsized":"2023-07-06T22:02:12.913359+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:17.248655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914529+0000","last_change":"2023-07-06T22:02:11.790362+0000","last_active":"2023-07-06T22:02:12.914529+0000","last_peered":"2023-07-06T22:02:12.914529+0000","last_clean":"2023-07-06T22:02:12.914529+0000","last_became_active":"2023-07-06T22:02:11.790075+0000","last_became_peered":"2023-07-06T22:02:11.790075+0000","last_unstale":"2023-07-06T22:02:12.914529+0000","last_undegraded":"2023-07-06T22:02:12.914529+0000","last_fullsized":"2023-07-06T22:02:12.914529+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:12:27.473524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774341+0000","last_change":"2023-07-06T22:02:11.786929+0000","last_active":"2023-07-06T22:02:12.774341+0000","last_peered":"2023-07-06T22:02:12.774341+0000","last_clean":"2023-07-06T22:02:12.774341+0000","last_became_active":"2023-07-06T22:02:11.786631+0000","last_became_peered":"2023-07-06T22:02:11.786631+0000","last_unstale":"2023-07-06T22:02:12.774341+0000","last_undegraded":"2023-07-06T22:02:12.774341+0000","last_fullsized":"2023-07-06T22:02:12.774341+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:08:59.171379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913716+0000","last_change":"2023-07-06T22:02:11.788783+0000","last_active":"2023-07-06T22:02:12.913716+0000","last_peered":"2023-07-06T22:02:12.913716+0000","last_clean":"2023-07-06T22:02:12.913716+0000","last_became_active":"2023-07-06T22:02:11.788514+0000","last_became_peered":"2023-07-06T22:02:11.788514+0000","last_unstale":"2023-07-06T22:02:12.913716+0000","last_undegraded":"2023-07-06T22:02:12.913716+0000","last_fullsized":"2023-07-06T22:02:12.913716+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:52:39.678695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912948+0000","last_change":"2023-07-06T22:02:11.797597+0000","last_active":"2023-07-06T22:02:12.912948+0000","last_peered":"2023-07-06T22:02:12.912948+0000","last_clean":"2023-07-06T22:02:12.912948+0000","last_became_active":"2023-07-06T22:02:11.797281+0000","last_became_peered":"2023-07-06T22:02:11.797281+0000","last_unstale":"2023-07-06T22:02:12.912948+0000","last_undegraded":"2023-07-06T22:02:12.912948+0000","last_fullsized":"2023-07-06T22:02:12.912948+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:45:09.800536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913048+0000","last_change":"2023-07-06T22:02:11.772421+0000","last_active":"2023-07-06T22:02:12.913048+0000","last_peered":"2023-07-06T22:02:12.913048+0000","last_clean":"2023-07-06T22:02:12.913048+0000","last_became_active":"2023-07-06T22:02:11.772104+0000","last_became_peered":"2023-07-06T22:02:11.772104+0000","last_unstale":"2023-07-06T22:02:12.913048+0000","last_undegraded":"2023-07-06T22:02:12.913048+0000","last_fullsized":"2023-07-06T22:02:12.913048+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:15:43.954484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912378+0000","last_change":"2023-07-06T22:02:11.781083+0000","last_active":"2023-07-06T22:02:12.912378+0000","last_peered":"2023-07-06T22:02:12.912378+0000","last_clean":"2023-07-06T22:02:12.912378+0000","last_became_active":"2023-07-06T22:02:11.780821+0000","last_became_peered":"2023-07-06T22:02:11.780821+0000","last_unstale":"2023-07-06T22:02:12.912378+0000","last_undegraded":"2023-07-06T22:02:12.912378+0000","last_fullsized":"2023-07-06T22:02:12.912378+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:02:45.973938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913424+0000","last_change":"2023-07-06T22:02:11.785262+0000","last_active":"2023-07-06T22:02:12.913424+0000","last_peered":"2023-07-06T22:02:12.913424+0000","last_clean":"2023-07-06T22:02:12.913424+0000","last_became_active":"2023-07-06T22:02:11.784986+0000","last_became_peered":"2023-07-06T22:02:11.784986+0000","last_unstale":"2023-07-06T22:02:12.913424+0000","last_undegraded":"2023-07-06T22:02:12.913424+0000","last_fullsized":"2023-07-06T22:02:12.913424+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:24:03.323635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775167+0000","last_change":"2023-07-06T22:02:11.797330+0000","last_active":"2023-07-06T22:02:12.775167+0000","last_peered":"2023-07-06T22:02:12.775167+0000","last_clean":"2023-07-06T22:02:12.775167+0000","last_became_active":"2023-07-06T22:02:11.797050+0000","last_became_peered":"2023-07-06T22:02:11.797050+0000","last_unstale":"2023-07-06T22:02:12.775167+0000","last_undegraded":"2023-07-06T22:02:12.775167+0000","last_fullsized":"2023-07-06T22:02:12.775167+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:25:15.317109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913241+0000","last_change":"2023-07-06T22:02:11.783907+0000","last_active":"2023-07-06T22:02:12.913241+0000","last_peered":"2023-07-06T22:02:12.913241+0000","last_clean":"2023-07-06T22:02:12.913241+0000","last_became_active":"2023-07-06T22:02:11.783649+0000","last_became_peered":"2023-07-06T22:02:11.783649+0000","last_unstale":"2023-07-06T22:02:12.913241+0000","last_undegraded":"2023-07-06T22:02:12.913241+0000","last_fullsized":"2023-07-06T22:02:12.913241+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:56:34.360616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774847+0000","last_change":"2023-07-06T22:02:11.788575+0000","last_active":"2023-07-06T22:02:12.774847+0000","last_peered":"2023-07-06T22:02:12.774847+0000","last_clean":"2023-07-06T22:02:12.774847+0000","last_became_active":"2023-07-06T22:02:11.788083+0000","last_became_peered":"2023-07-06T22:02:11.788083+0000","last_unstale":"2023-07-06T22:02:12.774847+0000","last_undegraded":"2023-07-06T22:02:12.774847+0000","last_fullsized":"2023-07-06T22:02:12.774847+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:56:34.062449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913501+0000","last_change":"2023-07-06T22:02:11.791957+0000","last_active":"2023-07-06T22:02:12.913501+0000","last_peered":"2023-07-06T22:02:12.913501+0000","last_clean":"2023-07-06T22:02:12.913501+0000","last_became_active":"2023-07-06T22:02:11.789579+0000","last_became_peered":"2023-07-06T22:02:11.789579+0000","last_unstale":"2023-07-06T22:02:12.913501+0000","last_undegraded":"2023-07-06T22:02:12.913501+0000","last_fullsized":"2023-07-06T22:02:12.913501+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:07:30.161985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.773776+0000","last_change":"2023-07-06T22:02:11.786828+0000","last_active":"2023-07-06T22:02:12.773776+0000","last_peered":"2023-07-06T22:02:12.773776+0000","last_clean":"2023-07-06T22:02:12.773776+0000","last_became_active":"2023-07-06T22:02:11.786010+0000","last_became_peered":"2023-07-06T22:02:11.786010+0000","last_unstale":"2023-07-06T22:02:12.773776+0000","last_undegraded":"2023-07-06T22:02:12.773776+0000","last_fullsized":"2023-07-06T22:02:12.773776+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:54:01.526110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774647+0000","last_change":"2023-07-06T22:02:11.784311+0000","last_active":"2023-07-06T22:02:12.774647+0000","last_peered":"2023-07-06T22:02:12.774647+0000","last_clean":"2023-07-06T22:02:12.774647+0000","last_became_active":"2023-07-06T22:02:11.783258+0000","last_became_peered":"2023-07-06T22:02:11.783258+0000","last_unstale":"2023-07-06T22:02:12.774647+0000","last_undegraded":"2023-07-06T22:02:12.774647+0000","last_fullsized":"2023-07-06T22:02:12.774647+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:20:41.837754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.770923+0000","last_change":"2023-07-06T22:02:11.777916+0000","last_active":"2023-07-06T22:02:12.770923+0000","last_peered":"2023-07-06T22:02:12.770923+0000","last_clean":"2023-07-06T22:02:12.770923+0000","last_became_active":"2023-07-06T22:02:11.775905+0000","last_became_peered":"2023-07-06T22:02:11.775905+0000","last_unstale":"2023-07-06T22:02:12.770923+0000","last_undegraded":"2023-07-06T22:02:12.770923+0000","last_fullsized":"2023-07-06T22:02:12.770923+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:46:44.017349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775315+0000","last_change":"2023-07-06T22:02:11.796833+0000","last_active":"2023-07-06T22:02:12.775315+0000","last_peered":"2023-07-06T22:02:12.775315+0000","last_clean":"2023-07-06T22:02:12.775315+0000","last_became_active":"2023-07-06T22:02:11.796476+0000","last_became_peered":"2023-07-06T22:02:11.796476+0000","last_unstale":"2023-07-06T22:02:12.775315+0000","last_undegraded":"2023-07-06T22:02:12.775315+0000","last_fullsized":"2023-07-06T22:02:12.775315+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:22:39.336929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914556+0000","last_change":"2023-07-06T22:02:11.790419+0000","last_active":"2023-07-06T22:02:12.914556+0000","last_peered":"2023-07-06T22:02:12.914556+0000","last_clean":"2023-07-06T22:02:12.914556+0000","last_became_active":"2023-07-06T22:02:11.790134+0000","last_became_peered":"2023-07-06T22:02:11.790134+0000","last_unstale":"2023-07-06T22:02:12.914556+0000","last_undegraded":"2023-07-06T22:02:12.914556+0000","last_fullsized":"2023-07-06T22:02:12.914556+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:35:38.004981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913609+0000","last_change":"2023-07-06T22:02:11.782701+0000","last_active":"2023-07-06T22:02:12.913609+0000","last_peered":"2023-07-06T22:02:12.913609+0000","last_clean":"2023-07-06T22:02:12.913609+0000","last_became_active":"2023-07-06T22:02:11.782243+0000","last_became_peered":"2023-07-06T22:02:11.782243+0000","last_unstale":"2023-07-06T22:02:12.913609+0000","last_undegraded":"2023-07-06T22:02:12.913609+0000","last_fullsized":"2023-07-06T22:02:12.913609+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:33:17.404718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771392+0000","last_change":"2023-07-06T22:02:11.778315+0000","last_active":"2023-07-06T22:02:12.771392+0000","last_peered":"2023-07-06T22:02:12.771392+0000","last_clean":"2023-07-06T22:02:12.771392+0000","last_became_active":"2023-07-06T22:02:11.777947+0000","last_became_peered":"2023-07-06T22:02:11.777947+0000","last_unstale":"2023-07-06T22:02:12.771392+0000","last_undegraded":"2023-07-06T22:02:12.771392+0000","last_fullsized":"2023-07-06T22:02:12.771392+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:48:47.970894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775090+0000","last_change":"2023-07-06T22:02:11.787853+0000","last_active":"2023-07-06T22:02:12.775090+0000","last_peered":"2023-07-06T22:02:12.775090+0000","last_clean":"2023-07-06T22:02:12.775090+0000","last_became_active":"2023-07-06T22:02:11.787520+0000","last_became_peered":"2023-07-06T22:02:11.787520+0000","last_unstale":"2023-07-06T22:02:12.775090+0000","last_undegraded":"2023-07-06T22:02:12.775090+0000","last_fullsized":"2023-07-06T22:02:12.775090+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:26:47.373495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.773781+0000","last_change":"2023-07-06T22:02:11.782495+0000","last_active":"2023-07-06T22:02:12.773781+0000","last_peered":"2023-07-06T22:02:12.773781+0000","last_clean":"2023-07-06T22:02:12.773781+0000","last_became_active":"2023-07-06T22:02:11.781992+0000","last_became_peered":"2023-07-06T22:02:11.781992+0000","last_unstale":"2023-07-06T22:02:12.773781+0000","last_undegraded":"2023-07-06T22:02:12.773781+0000","last_fullsized":"2023-07-06T22:02:12.773781+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:17.248655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.773758+0000","last_change":"2023-07-06T22:02:11.776839+0000","last_active":"2023-07-06T22:02:12.773758+0000","last_peered":"2023-07-06T22:02:12.773758+0000","last_clean":"2023-07-06T22:02:12.773758+0000","last_became_active":"2023-07-06T22:02:11.776259+0000","last_became_peered":"2023-07-06T22:02:11.776259+0000","last_unstale":"2023-07-06T22:02:12.773758+0000","last_undegraded":"2023-07-06T22:02:12.773758+0000","last_fullsized":"2023-07-06T22:02:12.773758+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:25:06.516604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774551+0000","last_change":"2023-07-06T22:02:11.788178+0000","last_active":"2023-07-06T22:02:12.774551+0000","last_peered":"2023-07-06T22:02:12.774551+0000","last_clean":"2023-07-06T22:02:12.774551+0000","last_became_active":"2023-07-06T22:02:11.787455+0000","last_became_peered":"2023-07-06T22:02:11.787455+0000","last_unstale":"2023-07-06T22:02:12.774551+0000","last_undegraded":"2023-07-06T22:02:12.774551+0000","last_fullsized":"2023-07-06T22:02:12.774551+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:52:12.098249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771561+0000","last_change":"2023-07-06T22:02:11.784396+0000","last_active":"2023-07-06T22:02:12.771561+0000","last_peered":"2023-07-06T22:02:12.771561+0000","last_clean":"2023-07-06T22:02:12.771561+0000","last_became_active":"2023-07-06T22:02:11.784124+0000","last_became_peered":"2023-07-06T22:02:11.784124+0000","last_unstale":"2023-07-06T22:02:12.771561+0000","last_undegraded":"2023-07-06T22:02:12.771561+0000","last_fullsized":"2023-07-06T22:02:12.771561+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:01:58.337123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913300+0000","last_change":"2023-07-06T22:02:11.782486+0000","last_active":"2023-07-06T22:02:12.913300+0000","last_peered":"2023-07-06T22:02:12.913300+0000","last_clean":"2023-07-06T22:02:12.913300+0000","last_became_active":"2023-07-06T22:02:11.782167+0000","last_became_peered":"2023-07-06T22:02:11.782167+0000","last_unstale":"2023-07-06T22:02:12.913300+0000","last_undegraded":"2023-07-06T22:02:12.913300+0000","last_fullsized":"2023-07-06T22:02:12.913300+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:33:20.760780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771428+0000","last_change":"2023-07-06T22:02:11.789904+0000","last_active":"2023-07-06T22:02:12.771428+0000","last_peered":"2023-07-06T22:02:12.771428+0000","last_clean":"2023-07-06T22:02:12.771428+0000","last_became_active":"2023-07-06T22:02:11.789591+0000","last_became_peered":"2023-07-06T22:02:11.789591+0000","last_unstale":"2023-07-06T22:02:12.771428+0000","last_undegraded":"2023-07-06T22:02:12.771428+0000","last_fullsized":"2023-07-06T22:02:12.771428+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:05:22.504575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913676+0000","last_change":"2023-07-06T22:02:11.791351+0000","last_active":"2023-07-06T22:02:12.913676+0000","last_peered":"2023-07-06T22:02:12.913676+0000","last_clean":"2023-07-06T22:02:12.913676+0000","last_became_active":"2023-07-06T22:02:11.791076+0000","last_became_peered":"2023-07-06T22:02:11.791076+0000","last_unstale":"2023-07-06T22:02:12.913676+0000","last_undegraded":"2023-07-06T22:02:12.913676+0000","last_fullsized":"2023-07-06T22:02:12.913676+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:43:03.416250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912744+0000","last_change":"2023-07-06T22:02:11.792208+0000","last_active":"2023-07-06T22:02:12.912744+0000","last_peered":"2023-07-06T22:02:12.912744+0000","last_clean":"2023-07-06T22:02:12.912744+0000","last_became_active":"2023-07-06T22:02:11.791943+0000","last_became_peered":"2023-07-06T22:02:11.791943+0000","last_unstale":"2023-07-06T22:02:12.912744+0000","last_undegraded":"2023-07-06T22:02:12.912744+0000","last_fullsized":"2023-07-06T22:02:12.912744+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:17:46.810208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.773950+0000","last_change":"2023-07-06T22:02:11.787052+0000","last_active":"2023-07-06T22:02:12.773950+0000","last_peered":"2023-07-06T22:02:12.773950+0000","last_clean":"2023-07-06T22:02:12.773950+0000","last_became_active":"2023-07-06T22:02:11.786540+0000","last_became_peered":"2023-07-06T22:02:11.786540+0000","last_unstale":"2023-07-06T22:02:12.773950+0000","last_undegraded":"2023-07-06T22:02:12.773950+0000","last_fullsized":"2023-07-06T22:02:12.773950+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:26:30.302810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912535+0000","last_change":"2023-07-06T22:02:11.797696+0000","last_active":"2023-07-06T22:02:12.912535+0000","last_peered":"2023-07-06T22:02:12.912535+0000","last_clean":"2023-07-06T22:02:12.912535+0000","last_became_active":"2023-07-06T22:02:11.797408+0000","last_became_peered":"2023-07-06T22:02:11.797408+0000","last_unstale":"2023-07-06T22:02:12.912535+0000","last_undegraded":"2023-07-06T22:02:12.912535+0000","last_fullsized":"2023-07-06T22:02:12.912535+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:20:51.467089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.770993+0000","last_change":"2023-07-06T22:02:11.773540+0000","last_active":"2023-07-06T22:02:12.770993+0000","last_peered":"2023-07-06T22:02:12.770993+0000","last_clean":"2023-07-06T22:02:12.770993+0000","last_became_active":"2023-07-06T22:02:11.773265+0000","last_became_peered":"2023-07-06T22:02:11.773265+0000","last_unstale":"2023-07-06T22:02:12.770993+0000","last_undegraded":"2023-07-06T22:02:12.770993+0000","last_fullsized":"2023-07-06T22:02:12.770993+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:15:22.440659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775321+0000","last_change":"2023-07-06T22:02:11.795411+0000","last_active":"2023-07-06T22:02:12.775321+0000","last_peered":"2023-07-06T22:02:12.775321+0000","last_clean":"2023-07-06T22:02:12.775321+0000","last_became_active":"2023-07-06T22:02:11.795110+0000","last_became_peered":"2023-07-06T22:02:11.795110+0000","last_unstale":"2023-07-06T22:02:12.775321+0000","last_undegraded":"2023-07-06T22:02:12.775321+0000","last_fullsized":"2023-07-06T22:02:12.775321+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:39:55.066350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"159'4","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775255+0000","last_change":"2023-07-06T22:02:11.380028+0000","last_active":"2023-07-06T22:02:12.775255+0000","last_peered":"2023-07-06T22:02:12.775255+0000","last_clean":"2023-07-06T22:02:12.775255+0000","last_became_active":"2023-07-06T22:02:11.379766+0000","last_became_peered":"2023-07-06T22:02:11.379766+0000","last_unstale":"2023-07-06T22:02:12.775255+0000","last_undegraded":"2023-07-06T22:02:12.775255+0000","last_fullsized":"2023-07-06T22:02:12.775255+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:22:36.702866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913545+0000","last_change":"2023-07-06T22:02:11.783030+0000","last_active":"2023-07-06T22:02:12.913545+0000","last_peered":"2023-07-06T22:02:12.913545+0000","last_clean":"2023-07-06T22:02:12.913545+0000","last_became_active":"2023-07-06T22:02:11.782748+0000","last_became_peered":"2023-07-06T22:02:11.782748+0000","last_unstale":"2023-07-06T22:02:12.913545+0000","last_undegraded":"2023-07-06T22:02:12.913545+0000","last_fullsized":"2023-07-06T22:02:12.913545+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:53:15.791868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"159'1","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913446+0000","last_change":"2023-07-06T22:02:11.376158+0000","last_active":"2023-07-06T22:02:12.913446+0000","last_peered":"2023-07-06T22:02:12.913446+0000","last_clean":"2023-07-06T22:02:12.913446+0000","last_became_active":"2023-07-06T22:02:11.375841+0000","last_became_peered":"2023-07-06T22:02:11.375841+0000","last_unstale":"2023-07-06T22:02:12.913446+0000","last_undegraded":"2023-07-06T22:02:12.913446+0000","last_fullsized":"2023-07-06T22:02:12.913446+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:26:29.294034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912519+0000","last_change":"2023-07-06T22:02:11.783134+0000","last_active":"2023-07-06T22:02:12.912519+0000","last_peered":"2023-07-06T22:02:12.912519+0000","last_clean":"2023-07-06T22:02:12.912519+0000","last_became_active":"2023-07-06T22:02:11.782862+0000","last_became_peered":"2023-07-06T22:02:11.782862+0000","last_unstale":"2023-07-06T22:02:12.912519+0000","last_undegraded":"2023-07-06T22:02:12.912519+0000","last_fullsized":"2023-07-06T22:02:12.912519+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:44:10.993854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"159'2","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774205+0000","last_change":"2023-07-06T22:02:11.369377+0000","last_active":"2023-07-06T22:02:12.774205+0000","last_peered":"2023-07-06T22:02:12.774205+0000","last_clean":"2023-07-06T22:02:12.774205+0000","last_became_active":"2023-07-06T22:02:11.369043+0000","last_became_peered":"2023-07-06T22:02:11.369043+0000","last_unstale":"2023-07-06T22:02:12.774205+0000","last_undegraded":"2023-07-06T22:02:12.774205+0000","last_fullsized":"2023-07-06T22:02:12.774205+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:45:52.494673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774850+0000","last_change":"2023-07-06T22:02:11.794818+0000","last_active":"2023-07-06T22:02:12.774850+0000","last_peered":"2023-07-06T22:02:12.774850+0000","last_clean":"2023-07-06T22:02:12.774850+0000","last_became_active":"2023-07-06T22:02:11.794556+0000","last_became_peered":"2023-07-06T22:02:11.794556+0000","last_unstale":"2023-07-06T22:02:12.774850+0000","last_undegraded":"2023-07-06T22:02:12.774850+0000","last_fullsized":"2023-07-06T22:02:12.774850+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:51:17.850741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"159'2","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774385+0000","last_change":"2023-07-06T22:02:11.380318+0000","last_active":"2023-07-06T22:02:12.774385+0000","last_peered":"2023-07-06T22:02:12.774385+0000","last_clean":"2023-07-06T22:02:12.774385+0000","last_became_active":"2023-07-06T22:02:11.380039+0000","last_became_peered":"2023-07-06T22:02:11.380039+0000","last_unstale":"2023-07-06T22:02:12.774385+0000","last_undegraded":"2023-07-06T22:02:12.774385+0000","last_fullsized":"2023-07-06T22:02:12.774385+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:48:17.471574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912905+0000","last_change":"2023-07-06T22:02:11.797721+0000","last_active":"2023-07-06T22:02:12.912905+0000","last_peered":"2023-07-06T22:02:12.912905+0000","last_clean":"2023-07-06T22:02:12.912905+0000","last_became_active":"2023-07-06T22:02:11.797439+0000","last_became_peered":"2023-07-06T22:02:11.797439+0000","last_unstale":"2023-07-06T22:02:12.912905+0000","last_undegraded":"2023-07-06T22:02:12.912905+0000","last_fullsized":"2023-07-06T22:02:12.912905+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:40:12.957415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"159'1","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771145+0000","last_change":"2023-07-06T22:02:11.373559+0000","last_active":"2023-07-06T22:02:12.771145+0000","last_peered":"2023-07-06T22:02:12.771145+0000","last_clean":"2023-07-06T22:02:12.771145+0000","last_became_active":"2023-07-06T22:02:11.373219+0000","last_became_peered":"2023-07-06T22:02:11.373219+0000","last_unstale":"2023-07-06T22:02:12.771145+0000","last_undegraded":"2023-07-06T22:02:12.771145+0000","last_fullsized":"2023-07-06T22:02:12.771145+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:26:25.886445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.773951+0000","last_change":"2023-07-06T22:02:11.793878+0000","last_active":"2023-07-06T22:02:12.773951+0000","last_peered":"2023-07-06T22:02:12.773951+0000","last_clean":"2023-07-06T22:02:12.773951+0000","last_became_active":"2023-07-06T22:02:11.793593+0000","last_became_peered":"2023-07-06T22:02:11.793593+0000","last_unstale":"2023-07-06T22:02:12.773951+0000","last_undegraded":"2023-07-06T22:02:12.773951+0000","last_fullsized":"2023-07-06T22:02:12.773951+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:24:03.323635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"159'1","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913277+0000","last_change":"2023-07-06T22:02:11.376053+0000","last_active":"2023-07-06T22:02:12.913277+0000","last_peered":"2023-07-06T22:02:12.913277+0000","last_clean":"2023-07-06T22:02:12.913277+0000","last_became_active":"2023-07-06T22:02:11.375793+0000","last_became_peered":"2023-07-06T22:02:11.375793+0000","last_unstale":"2023-07-06T22:02:12.913277+0000","last_undegraded":"2023-07-06T22:02:12.913277+0000","last_fullsized":"2023-07-06T22:02:12.913277+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:38:08.487047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912656+0000","last_change":"2023-07-06T22:02:11.781081+0000","last_active":"2023-07-06T22:02:12.912656+0000","last_peered":"2023-07-06T22:02:12.912656+0000","last_clean":"2023-07-06T22:02:12.912656+0000","last_became_active":"2023-07-06T22:02:11.780820+0000","last_became_peered":"2023-07-06T22:02:11.780820+0000","last_unstale":"2023-07-06T22:02:12.912656+0000","last_undegraded":"2023-07-06T22:02:12.912656+0000","last_fullsized":"2023-07-06T22:02:12.912656+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:58:19.983952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.770988+0000","last_change":"2023-07-06T22:02:11.371822+0000","last_active":"2023-07-06T22:02:12.770988+0000","last_peered":"2023-07-06T22:02:12.770988+0000","last_clean":"2023-07-06T22:02:12.770988+0000","last_became_active":"2023-07-06T22:02:11.371547+0000","last_became_peered":"2023-07-06T22:02:11.371547+0000","last_unstale":"2023-07-06T22:02:12.770988+0000","last_undegraded":"2023-07-06T22:02:12.770988+0000","last_fullsized":"2023-07-06T22:02:12.770988+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:32:16.947485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913500+0000","last_change":"2023-07-06T22:02:11.776953+0000","last_active":"2023-07-06T22:02:12.913500+0000","last_peered":"2023-07-06T22:02:12.913500+0000","last_clean":"2023-07-06T22:02:12.913500+0000","last_became_active":"2023-07-06T22:02:11.776655+0000","last_became_peered":"2023-07-06T22:02:11.776655+0000","last_unstale":"2023-07-06T22:02:12.913500+0000","last_undegraded":"2023-07-06T22:02:12.913500+0000","last_fullsized":"2023-07-06T22:02:12.913500+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:01:26.919339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.773489+0000","last_change":"2023-07-06T22:02:11.375332+0000","last_active":"2023-07-06T22:02:12.773489+0000","last_peered":"2023-07-06T22:02:12.773489+0000","last_clean":"2023-07-06T22:02:12.773489+0000","last_became_active":"2023-07-06T22:02:11.375059+0000","last_became_peered":"2023-07-06T22:02:11.375059+0000","last_unstale":"2023-07-06T22:02:12.773489+0000","last_undegraded":"2023-07-06T22:02:12.773489+0000","last_fullsized":"2023-07-06T22:02:12.773489+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:40:11.948639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775430+0000","last_change":"2023-07-06T22:02:11.794778+0000","last_active":"2023-07-06T22:02:12.775430+0000","last_peered":"2023-07-06T22:02:12.775430+0000","last_clean":"2023-07-06T22:02:12.775430+0000","last_became_active":"2023-07-06T22:02:11.794464+0000","last_became_peered":"2023-07-06T22:02:11.794464+0000","last_unstale":"2023-07-06T22:02:12.775430+0000","last_undegraded":"2023-07-06T22:02:12.775430+0000","last_fullsized":"2023-07-06T22:02:12.775430+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:57:13.109788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"159'1","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913505+0000","last_change":"2023-07-06T22:02:11.374658+0000","last_active":"2023-07-06T22:02:12.913505+0000","last_peered":"2023-07-06T22:02:12.913505+0000","last_clean":"2023-07-06T22:02:12.913505+0000","last_became_active":"2023-07-06T22:02:11.374402+0000","last_became_peered":"2023-07-06T22:02:11.374402+0000","last_unstale":"2023-07-06T22:02:12.913505+0000","last_undegraded":"2023-07-06T22:02:12.913505+0000","last_fullsized":"2023-07-06T22:02:12.913505+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:11:35.149162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771573+0000","last_change":"2023-07-06T22:02:11.786347+0000","last_active":"2023-07-06T22:02:12.771573+0000","last_peered":"2023-07-06T22:02:12.771573+0000","last_clean":"2023-07-06T22:02:12.771573+0000","last_became_active":"2023-07-06T22:02:11.786063+0000","last_became_peered":"2023-07-06T22:02:11.786063+0000","last_unstale":"2023-07-06T22:02:12.771573+0000","last_undegraded":"2023-07-06T22:02:12.771573+0000","last_fullsized":"2023-07-06T22:02:12.771573+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:02:37.956016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"159'2","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913571+0000","last_change":"2023-07-06T22:02:11.374366+0000","last_active":"2023-07-06T22:02:12.913571+0000","last_peered":"2023-07-06T22:02:12.913571+0000","last_clean":"2023-07-06T22:02:12.913571+0000","last_became_active":"2023-07-06T22:02:11.374100+0000","last_became_peered":"2023-07-06T22:02:11.374100+0000","last_unstale":"2023-07-06T22:02:12.913571+0000","last_undegraded":"2023-07-06T22:02:12.913571+0000","last_fullsized":"2023-07-06T22:02:12.913571+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:45:52.494673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914526+0000","last_change":"2023-07-06T22:02:11.784838+0000","last_active":"2023-07-06T22:02:12.914526+0000","last_peered":"2023-07-06T22:02:12.914526+0000","last_clean":"2023-07-06T22:02:12.914526+0000","last_became_active":"2023-07-06T22:02:11.784565+0000","last_became_peered":"2023-07-06T22:02:11.784565+0000","last_unstale":"2023-07-06T22:02:12.914526+0000","last_undegraded":"2023-07-06T22:02:12.914526+0000","last_fullsized":"2023-07-06T22:02:12.914526+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:55:40.627254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"159'1","reported_seq":14,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771503+0000","last_change":"2023-07-06T22:02:11.374389+0000","last_active":"2023-07-06T22:02:12.771503+0000","last_peered":"2023-07-06T22:02:12.771503+0000","last_clean":"2023-07-06T22:02:12.771503+0000","last_became_active":"2023-07-06T22:02:11.373445+0000","last_became_peered":"2023-07-06T22:02:11.373445+0000","last_unstale":"2023-07-06T22:02:12.771503+0000","last_undegraded":"2023-07-06T22:02:12.771503+0000","last_fullsized":"2023-07-06T22:02:12.771503+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:29:45.609039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913363+0000","last_change":"2023-07-06T22:02:11.797817+0000","last_active":"2023-07-06T22:02:12.913363+0000","last_peered":"2023-07-06T22:02:12.913363+0000","last_clean":"2023-07-06T22:02:12.913363+0000","last_became_active":"2023-07-06T22:02:11.797043+0000","last_became_peered":"2023-07-06T22:02:11.797043+0000","last_unstale":"2023-07-06T22:02:12.913363+0000","last_undegraded":"2023-07-06T22:02:12.913363+0000","last_fullsized":"2023-07-06T22:02:12.913363+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:10:31.844128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913044+0000","last_change":"2023-07-06T22:02:11.373798+0000","last_active":"2023-07-06T22:02:12.913044+0000","last_peered":"2023-07-06T22:02:12.913044+0000","last_clean":"2023-07-06T22:02:12.913044+0000","last_became_active":"2023-07-06T22:02:11.373534+0000","last_became_peered":"2023-07-06T22:02:11.373534+0000","last_unstale":"2023-07-06T22:02:12.913044+0000","last_undegraded":"2023-07-06T22:02:12.913044+0000","last_fullsized":"2023-07-06T22:02:12.913044+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:54:00.517334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774117+0000","last_change":"2023-07-06T22:02:11.778049+0000","last_active":"2023-07-06T22:02:12.774117+0000","last_peered":"2023-07-06T22:02:12.774117+0000","last_clean":"2023-07-06T22:02:12.774117+0000","last_became_active":"2023-07-06T22:02:11.777709+0000","last_became_peered":"2023-07-06T22:02:11.777709+0000","last_unstale":"2023-07-06T22:02:12.774117+0000","last_undegraded":"2023-07-06T22:02:12.774117+0000","last_fullsized":"2023-07-06T22:02:12.774117+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:53:15.791868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"159'2","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913550+0000","last_change":"2023-07-06T22:02:11.375392+0000","last_active":"2023-07-06T22:02:12.913550+0000","last_peered":"2023-07-06T22:02:12.913550+0000","last_clean":"2023-07-06T22:02:12.913550+0000","last_became_active":"2023-07-06T22:02:11.375122+0000","last_became_peered":"2023-07-06T22:02:11.375122+0000","last_unstale":"2023-07-06T22:02:12.913550+0000","last_undegraded":"2023-07-06T22:02:12.913550+0000","last_fullsized":"2023-07-06T22:02:12.913550+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:42:02.376386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913464+0000","last_change":"2023-07-06T22:02:11.774253+0000","last_active":"2023-07-06T22:02:12.913464+0000","last_peered":"2023-07-06T22:02:12.913464+0000","last_clean":"2023-07-06T22:02:12.913464+0000","last_became_active":"2023-07-06T22:02:11.773990+0000","last_became_peered":"2023-07-06T22:02:11.773990+0000","last_unstale":"2023-07-06T22:02:12.913464+0000","last_undegraded":"2023-07-06T22:02:12.913464+0000","last_fullsized":"2023-07-06T22:02:12.913464+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:15:54.168627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774645+0000","last_change":"2023-07-06T22:02:11.379524+0000","last_active":"2023-07-06T22:02:12.774645+0000","last_peered":"2023-07-06T22:02:12.774645+0000","last_clean":"2023-07-06T22:02:12.774645+0000","last_became_active":"2023-07-06T22:02:11.379197+0000","last_became_peered":"2023-07-06T22:02:11.379197+0000","last_unstale":"2023-07-06T22:02:12.774645+0000","last_undegraded":"2023-07-06T22:02:12.774645+0000","last_fullsized":"2023-07-06T22:02:12.774645+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:32:03.915897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.773470+0000","last_change":"2023-07-06T22:02:11.776430+0000","last_active":"2023-07-06T22:02:12.773470+0000","last_peered":"2023-07-06T22:02:12.773470+0000","last_clean":"2023-07-06T22:02:12.773470+0000","last_became_active":"2023-07-06T22:02:11.776091+0000","last_became_peered":"2023-07-06T22:02:11.776091+0000","last_unstale":"2023-07-06T22:02:12.773470+0000","last_undegraded":"2023-07-06T22:02:12.773470+0000","last_fullsized":"2023-07-06T22:02:12.773470+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:22:55.464238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774627+0000","last_change":"2023-07-06T22:02:11.374438+0000","last_active":"2023-07-06T22:02:12.774627+0000","last_peered":"2023-07-06T22:02:12.774627+0000","last_clean":"2023-07-06T22:02:12.774627+0000","last_became_active":"2023-07-06T22:02:11.374160+0000","last_became_peered":"2023-07-06T22:02:11.374160+0000","last_unstale":"2023-07-06T22:02:12.774627+0000","last_undegraded":"2023-07-06T22:02:12.774627+0000","last_fullsized":"2023-07-06T22:02:12.774627+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:58:52.702380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912868+0000","last_change":"2023-07-06T22:02:11.773767+0000","last_active":"2023-07-06T22:02:12.912868+0000","last_peered":"2023-07-06T22:02:12.912868+0000","last_clean":"2023-07-06T22:02:12.912868+0000","last_became_active":"2023-07-06T22:02:11.773448+0000","last_became_peered":"2023-07-06T22:02:11.773448+0000","last_unstale":"2023-07-06T22:02:12.912868+0000","last_undegraded":"2023-07-06T22:02:12.912868+0000","last_fullsized":"2023-07-06T22:02:12.912868+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:34:12.540854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913970+0000","last_change":"2023-07-06T22:02:11.380476+0000","last_active":"2023-07-06T22:02:12.913970+0000","last_peered":"2023-07-06T22:02:12.913970+0000","last_clean":"2023-07-06T22:02:12.913970+0000","last_became_active":"2023-07-06T22:02:11.380189+0000","last_became_peered":"2023-07-06T22:02:11.380189+0000","last_unstale":"2023-07-06T22:02:12.913970+0000","last_undegraded":"2023-07-06T22:02:12.913970+0000","last_fullsized":"2023-07-06T22:02:12.913970+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:25:03.706852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913635+0000","last_change":"2023-07-06T22:02:11.788194+0000","last_active":"2023-07-06T22:02:12.913635+0000","last_peered":"2023-07-06T22:02:12.913635+0000","last_clean":"2023-07-06T22:02:12.913635+0000","last_became_active":"2023-07-06T22:02:11.787905+0000","last_became_peered":"2023-07-06T22:02:11.787905+0000","last_unstale":"2023-07-06T22:02:12.913635+0000","last_undegraded":"2023-07-06T22:02:12.913635+0000","last_fullsized":"2023-07-06T22:02:12.913635+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:13:12.854522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"159'2","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775404+0000","last_change":"2023-07-06T22:02:11.374844+0000","last_active":"2023-07-06T22:02:12.775404+0000","last_peered":"2023-07-06T22:02:12.775404+0000","last_clean":"2023-07-06T22:02:12.775404+0000","last_became_active":"2023-07-06T22:02:11.374499+0000","last_became_peered":"2023-07-06T22:02:11.374499+0000","last_unstale":"2023-07-06T22:02:12.775404+0000","last_undegraded":"2023-07-06T22:02:12.775404+0000","last_fullsized":"2023-07-06T22:02:12.775404+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:07:43.842534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914729+0000","last_change":"2023-07-06T22:02:11.784151+0000","last_active":"2023-07-06T22:02:12.914729+0000","last_peered":"2023-07-06T22:02:12.914729+0000","last_clean":"2023-07-06T22:02:12.914729+0000","last_became_active":"2023-07-06T22:02:11.783839+0000","last_became_peered":"2023-07-06T22:02:11.783839+0000","last_unstale":"2023-07-06T22:02:12.914729+0000","last_undegraded":"2023-07-06T22:02:12.914729+0000","last_fullsized":"2023-07-06T22:02:12.914729+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:13:57.278029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913379+0000","last_change":"2023-07-06T22:02:11.378170+0000","last_active":"2023-07-06T22:02:12.913379+0000","last_peered":"2023-07-06T22:02:12.913379+0000","last_clean":"2023-07-06T22:02:12.913379+0000","last_became_active":"2023-07-06T22:02:11.377890+0000","last_became_peered":"2023-07-06T22:02:11.377890+0000","last_unstale":"2023-07-06T22:02:12.913379+0000","last_undegraded":"2023-07-06T22:02:12.913379+0000","last_fullsized":"2023-07-06T22:02:12.913379+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:40:38.984357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912964+0000","last_change":"2023-07-06T22:02:11.780651+0000","last_active":"2023-07-06T22:02:12.912964+0000","last_peered":"2023-07-06T22:02:12.912964+0000","last_clean":"2023-07-06T22:02:12.912964+0000","last_became_active":"2023-07-06T22:02:11.780385+0000","last_became_peered":"2023-07-06T22:02:11.780385+0000","last_unstale":"2023-07-06T22:02:12.912964+0000","last_undegraded":"2023-07-06T22:02:12.912964+0000","last_fullsized":"2023-07-06T22:02:12.912964+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:25:06.516604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913686+0000","last_change":"2023-07-06T22:02:11.382098+0000","last_active":"2023-07-06T22:02:12.913686+0000","last_peered":"2023-07-06T22:02:12.913686+0000","last_clean":"2023-07-06T22:02:12.913686+0000","last_became_active":"2023-07-06T22:02:11.381817+0000","last_became_peered":"2023-07-06T22:02:11.381817+0000","last_unstale":"2023-07-06T22:02:12.913686+0000","last_undegraded":"2023-07-06T22:02:12.913686+0000","last_fullsized":"2023-07-06T22:02:12.913686+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:58:14.625330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913489+0000","last_change":"2023-07-06T22:02:11.779166+0000","last_active":"2023-07-06T22:02:12.913489+0000","last_peered":"2023-07-06T22:02:12.913489+0000","last_clean":"2023-07-06T22:02:12.913489+0000","last_became_active":"2023-07-06T22:02:11.778917+0000","last_became_peered":"2023-07-06T22:02:11.778917+0000","last_unstale":"2023-07-06T22:02:12.913489+0000","last_undegraded":"2023-07-06T22:02:12.913489+0000","last_fullsized":"2023-07-06T22:02:12.913489+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:21:32.833172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912696+0000","last_change":"2023-07-06T22:02:11.382376+0000","last_active":"2023-07-06T22:02:12.912696+0000","last_peered":"2023-07-06T22:02:12.912696+0000","last_clean":"2023-07-06T22:02:12.912696+0000","last_became_active":"2023-07-06T22:02:11.382078+0000","last_became_peered":"2023-07-06T22:02:11.382078+0000","last_unstale":"2023-07-06T22:02:12.912696+0000","last_undegraded":"2023-07-06T22:02:12.912696+0000","last_fullsized":"2023-07-06T22:02:12.912696+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:55:06.439962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771135+0000","last_change":"2023-07-06T22:02:11.766148+0000","last_active":"2023-07-06T22:02:12.771135+0000","last_peered":"2023-07-06T22:02:12.771135+0000","last_clean":"2023-07-06T22:02:12.771135+0000","last_became_active":"2023-07-06T22:02:11.765855+0000","last_became_peered":"2023-07-06T22:02:11.765855+0000","last_unstale":"2023-07-06T22:02:12.771135+0000","last_undegraded":"2023-07-06T22:02:12.771135+0000","last_fullsized":"2023-07-06T22:02:12.771135+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:06:57.273149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913669+0000","last_change":"2023-07-06T22:02:11.368843+0000","last_active":"2023-07-06T22:02:12.913669+0000","last_peered":"2023-07-06T22:02:12.913669+0000","last_clean":"2023-07-06T22:02:12.913669+0000","last_became_active":"2023-07-06T22:02:11.368548+0000","last_became_peered":"2023-07-06T22:02:11.368548+0000","last_unstale":"2023-07-06T22:02:12.913669+0000","last_undegraded":"2023-07-06T22:02:12.913669+0000","last_fullsized":"2023-07-06T22:02:12.913669+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:44:29.823807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913664+0000","last_change":"2023-07-06T22:02:11.802828+0000","last_active":"2023-07-06T22:02:12.913664+0000","last_peered":"2023-07-06T22:02:12.913664+0000","last_clean":"2023-07-06T22:02:12.913664+0000","last_became_active":"2023-07-06T22:02:11.802487+0000","last_became_peered":"2023-07-06T22:02:11.802487+0000","last_unstale":"2023-07-06T22:02:12.913664+0000","last_undegraded":"2023-07-06T22:02:12.913664+0000","last_fullsized":"2023-07-06T22:02:12.913664+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:44:29.841780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774769+0000","last_change":"2023-07-06T22:02:11.373991+0000","last_active":"2023-07-06T22:02:12.774769+0000","last_peered":"2023-07-06T22:02:12.774769+0000","last_clean":"2023-07-06T22:02:12.774769+0000","last_became_active":"2023-07-06T22:02:11.373607+0000","last_became_peered":"2023-07-06T22:02:11.373607+0000","last_unstale":"2023-07-06T22:02:12.774769+0000","last_undegraded":"2023-07-06T22:02:12.774769+0000","last_fullsized":"2023-07-06T22:02:12.774769+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:09:06.618187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774552+0000","last_change":"2023-07-06T22:02:11.794130+0000","last_active":"2023-07-06T22:02:12.774552+0000","last_peered":"2023-07-06T22:02:12.774552+0000","last_clean":"2023-07-06T22:02:12.774552+0000","last_became_active":"2023-07-06T22:02:11.792310+0000","last_became_peered":"2023-07-06T22:02:11.792310+0000","last_unstale":"2023-07-06T22:02:12.774552+0000","last_undegraded":"2023-07-06T22:02:12.774552+0000","last_fullsized":"2023-07-06T22:02:12.774552+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:26:41.969171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913950+0000","last_change":"2023-07-06T22:02:11.382010+0000","last_active":"2023-07-06T22:02:12.913950+0000","last_peered":"2023-07-06T22:02:12.913950+0000","last_clean":"2023-07-06T22:02:12.913950+0000","last_became_active":"2023-07-06T22:02:11.381701+0000","last_became_peered":"2023-07-06T22:02:11.381701+0000","last_unstale":"2023-07-06T22:02:12.913950+0000","last_undegraded":"2023-07-06T22:02:12.913950+0000","last_fullsized":"2023-07-06T22:02:12.913950+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:23:04.586064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913595+0000","last_change":"2023-07-06T22:02:11.772567+0000","last_active":"2023-07-06T22:02:12.913595+0000","last_peered":"2023-07-06T22:02:12.913595+0000","last_clean":"2023-07-06T22:02:12.913595+0000","last_became_active":"2023-07-06T22:02:11.772184+0000","last_became_peered":"2023-07-06T22:02:11.772184+0000","last_unstale":"2023-07-06T22:02:12.913595+0000","last_undegraded":"2023-07-06T22:02:12.913595+0000","last_fullsized":"2023-07-06T22:02:12.913595+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:32:04.525681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912736+0000","last_change":"2023-07-06T22:02:11.376363+0000","last_active":"2023-07-06T22:02:12.912736+0000","last_peered":"2023-07-06T22:02:12.912736+0000","last_clean":"2023-07-06T22:02:12.912736+0000","last_became_active":"2023-07-06T22:02:11.375556+0000","last_became_peered":"2023-07-06T22:02:11.375556+0000","last_unstale":"2023-07-06T22:02:12.912736+0000","last_undegraded":"2023-07-06T22:02:12.912736+0000","last_fullsized":"2023-07-06T22:02:12.912736+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:22:54.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913817+0000","last_change":"2023-07-06T22:02:11.766773+0000","last_active":"2023-07-06T22:02:12.913817+0000","last_peered":"2023-07-06T22:02:12.913817+0000","last_clean":"2023-07-06T22:02:12.913817+0000","last_became_active":"2023-07-06T22:02:11.766493+0000","last_became_peered":"2023-07-06T22:02:11.766493+0000","last_unstale":"2023-07-06T22:02:12.913817+0000","last_undegraded":"2023-07-06T22:02:12.913817+0000","last_fullsized":"2023-07-06T22:02:12.913817+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:55:42.084691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"159'3","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914484+0000","last_change":"2023-07-06T22:02:11.380202+0000","last_active":"2023-07-06T22:02:12.914484+0000","last_peered":"2023-07-06T22:02:12.914484+0000","last_clean":"2023-07-06T22:02:12.914484+0000","last_became_active":"2023-07-06T22:02:11.379908+0000","last_became_peered":"2023-07-06T22:02:11.379908+0000","last_unstale":"2023-07-06T22:02:12.914484+0000","last_undegraded":"2023-07-06T22:02:12.914484+0000","last_fullsized":"2023-07-06T22:02:12.914484+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:31:32.727749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"148'271","reported_seq":991,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775123+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:02:12.775123+0000","last_peered":"2023-07-06T22:02:12.775123+0000","last_clean":"2023-07-06T22:02:12.775123+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:02:12.775123+0000","last_undegraded":"2023-07-06T22:02:12.775123+0000","last_fullsized":"2023-07-06T22:02:12.775123+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:07:16.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":252,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913794+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:02:12.913794+0000","last_peered":"2023-07-06T22:02:12.913794+0000","last_clean":"2023-07-06T22:02:12.913794+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:02:12.913794+0000","last_undegraded":"2023-07-06T22:02:12.913794+0000","last_fullsized":"2023-07-06T22:02:12.913794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:24:53.748950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775196+0000","last_change":"2023-07-06T22:02:11.796671+0000","last_active":"2023-07-06T22:02:12.775196+0000","last_peered":"2023-07-06T22:02:12.775196+0000","last_clean":"2023-07-06T22:02:12.775196+0000","last_became_active":"2023-07-06T22:02:11.795517+0000","last_became_peered":"2023-07-06T22:02:11.795517+0000","last_unstale":"2023-07-06T22:02:12.775196+0000","last_undegraded":"2023-07-06T22:02:12.775196+0000","last_fullsized":"2023-07-06T22:02:12.775196+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:03.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775386+0000","last_change":"2023-07-06T22:02:11.375923+0000","last_active":"2023-07-06T22:02:12.775386+0000","last_peered":"2023-07-06T22:02:12.775386+0000","last_clean":"2023-07-06T22:02:12.775386+0000","last_became_active":"2023-07-06T22:02:11.375643+0000","last_became_peered":"2023-07-06T22:02:11.375643+0000","last_unstale":"2023-07-06T22:02:12.775386+0000","last_undegraded":"2023-07-06T22:02:12.775386+0000","last_fullsized":"2023-07-06T22:02:12.775386+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:53:36.842275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.774668+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:02:12.774668+0000","last_peered":"2023-07-06T22:02:12.774668+0000","last_clean":"2023-07-06T22:02:12.774668+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:02:12.774668+0000","last_undegraded":"2023-07-06T22:02:12.774668+0000","last_fullsized":"2023-07-06T22:02:12.774668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:29:53.792407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913718+0000","last_change":"2023-07-06T22:02:11.773553+0000","last_active":"2023-07-06T22:02:12.913718+0000","last_peered":"2023-07-06T22:02:12.913718+0000","last_clean":"2023-07-06T22:02:12.913718+0000","last_became_active":"2023-07-06T22:02:11.773174+0000","last_became_peered":"2023-07-06T22:02:11.773174+0000","last_unstale":"2023-07-06T22:02:12.913718+0000","last_undegraded":"2023-07-06T22:02:12.913718+0000","last_fullsized":"2023-07-06T22:02:12.913718+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:13:47.485594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913626+0000","last_change":"2023-07-06T22:02:11.379041+0000","last_active":"2023-07-06T22:02:12.913626+0000","last_peered":"2023-07-06T22:02:12.913626+0000","last_clean":"2023-07-06T22:02:12.913626+0000","last_became_active":"2023-07-06T22:02:11.378763+0000","last_became_peered":"2023-07-06T22:02:11.378763+0000","last_unstale":"2023-07-06T22:02:12.913626+0000","last_undegraded":"2023-07-06T22:02:12.913626+0000","last_fullsized":"2023-07-06T22:02:12.913626+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:08:58.162603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771031+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:02:12.771031+0000","last_peered":"2023-07-06T22:02:12.771031+0000","last_clean":"2023-07-06T22:02:12.771031+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:02:12.771031+0000","last_undegraded":"2023-07-06T22:02:12.771031+0000","last_fullsized":"2023-07-06T22:02:12.771031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:44:27.584594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771415+0000","last_change":"2023-07-06T22:02:11.777121+0000","last_active":"2023-07-06T22:02:12.771415+0000","last_peered":"2023-07-06T22:02:12.771415+0000","last_clean":"2023-07-06T22:02:12.771415+0000","last_became_active":"2023-07-06T22:02:11.776809+0000","last_became_peered":"2023-07-06T22:02:11.776809+0000","last_unstale":"2023-07-06T22:02:12.771415+0000","last_undegraded":"2023-07-06T22:02:12.771415+0000","last_fullsized":"2023-07-06T22:02:12.771415+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:16:06.912773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"159'6","reported_seq":19,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913802+0000","last_change":"2023-07-06T22:02:11.369905+0000","last_active":"2023-07-06T22:02:12.913802+0000","last_peered":"2023-07-06T22:02:12.913802+0000","last_clean":"2023-07-06T22:02:12.913802+0000","last_became_active":"2023-07-06T22:02:11.369528+0000","last_became_peered":"2023-07-06T22:02:11.369528+0000","last_unstale":"2023-07-06T22:02:12.913802+0000","last_undegraded":"2023-07-06T22:02:12.913802+0000","last_fullsized":"2023-07-06T22:02:12.913802+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:11:05.323751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":252,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913306+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:02:12.913306+0000","last_peered":"2023-07-06T22:02:12.913306+0000","last_clean":"2023-07-06T22:02:12.913306+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:02:12.913306+0000","last_undegraded":"2023-07-06T22:02:12.913306+0000","last_fullsized":"2023-07-06T22:02:12.913306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:40:52.634861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914027+0000","last_change":"2023-07-06T22:02:11.784361+0000","last_active":"2023-07-06T22:02:12.914027+0000","last_peered":"2023-07-06T22:02:12.914027+0000","last_clean":"2023-07-06T22:02:12.914027+0000","last_became_active":"2023-07-06T22:02:11.784107+0000","last_became_peered":"2023-07-06T22:02:11.784107+0000","last_unstale":"2023-07-06T22:02:12.914027+0000","last_undegraded":"2023-07-06T22:02:12.914027+0000","last_fullsized":"2023-07-06T22:02:12.914027+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:48:18.480350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914218+0000","last_change":"2023-07-06T22:02:11.378337+0000","last_active":"2023-07-06T22:02:12.914218+0000","last_peered":"2023-07-06T22:02:12.914218+0000","last_clean":"2023-07-06T22:02:12.914218+0000","last_became_active":"2023-07-06T22:02:11.377962+0000","last_became_peered":"2023-07-06T22:02:11.377962+0000","last_unstale":"2023-07-06T22:02:12.914218+0000","last_undegraded":"2023-07-06T22:02:12.914218+0000","last_fullsized":"2023-07-06T22:02:12.914218+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:40:14.479318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":260,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912811+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:02:12.912811+0000","last_peered":"2023-07-06T22:02:12.912811+0000","last_clean":"2023-07-06T22:02:12.912811+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:02:12.912811+0000","last_undegraded":"2023-07-06T22:02:12.912811+0000","last_fullsized":"2023-07-06T22:02:12.912811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:47:07.479653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914167+0000","last_change":"2023-07-06T22:02:11.783832+0000","last_active":"2023-07-06T22:02:12.914167+0000","last_peered":"2023-07-06T22:02:12.914167+0000","last_clean":"2023-07-06T22:02:12.914167+0000","last_became_active":"2023-07-06T22:02:11.781102+0000","last_became_peered":"2023-07-06T22:02:11.781102+0000","last_unstale":"2023-07-06T22:02:12.914167+0000","last_undegraded":"2023-07-06T22:02:12.914167+0000","last_fullsized":"2023-07-06T22:02:12.914167+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:12:11.434735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"159'2","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914279+0000","last_change":"2023-07-06T22:02:11.383128+0000","last_active":"2023-07-06T22:02:12.914279+0000","last_peered":"2023-07-06T22:02:12.914279+0000","last_clean":"2023-07-06T22:02:12.914279+0000","last_became_active":"2023-07-06T22:02:11.382759+0000","last_became_peered":"2023-07-06T22:02:11.382759+0000","last_unstale":"2023-07-06T22:02:12.914279+0000","last_undegraded":"2023-07-06T22:02:12.914279+0000","last_fullsized":"2023-07-06T22:02:12.914279+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:10:13.337071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.775077+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:02:12.775077+0000","last_peered":"2023-07-06T22:02:12.775077+0000","last_clean":"2023-07-06T22:02:12.775077+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:02:12.775077+0000","last_undegraded":"2023-07-06T22:02:12.775077+0000","last_fullsized":"2023-07-06T22:02:12.775077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:18:24.736396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913952+0000","last_change":"2023-07-06T22:02:11.785959+0000","last_active":"2023-07-06T22:02:12.913952+0000","last_peered":"2023-07-06T22:02:12.913952+0000","last_clean":"2023-07-06T22:02:12.913952+0000","last_became_active":"2023-07-06T22:02:11.785675+0000","last_became_peered":"2023-07-06T22:02:11.785675+0000","last_unstale":"2023-07-06T22:02:12.913952+0000","last_undegraded":"2023-07-06T22:02:12.913952+0000","last_fullsized":"2023-07-06T22:02:12.913952+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:03:34.057675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"159'8","reported_seq":21,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.771046+0000","last_change":"2023-07-06T22:02:11.372311+0000","last_active":"2023-07-06T22:02:12.771046+0000","last_peered":"2023-07-06T22:02:12.771046+0000","last_clean":"2023-07-06T22:02:12.771046+0000","last_became_active":"2023-07-06T22:02:11.371110+0000","last_became_peered":"2023-07-06T22:02:11.371110+0000","last_unstale":"2023-07-06T22:02:12.771046+0000","last_undegraded":"2023-07-06T22:02:12.771046+0000","last_fullsized":"2023-07-06T22:02:12.771046+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:37:31.526128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":260,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913477+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:02:12.913477+0000","last_peered":"2023-07-06T22:02:12.913477+0000","last_clean":"2023-07-06T22:02:12.913477+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:02:12.913477+0000","last_undegraded":"2023-07-06T22:02:12.913477+0000","last_fullsized":"2023-07-06T22:02:12.913477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:08:50.920285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":11,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.913653+0000","last_change":"2023-07-06T22:02:11.775329+0000","last_active":"2023-07-06T22:02:12.913653+0000","last_peered":"2023-07-06T22:02:12.913653+0000","last_clean":"2023-07-06T22:02:12.913653+0000","last_became_active":"2023-07-06T22:02:11.774979+0000","last_became_peered":"2023-07-06T22:02:11.774979+0000","last_unstale":"2023-07-06T22:02:12.913653+0000","last_undegraded":"2023-07-06T22:02:12.913653+0000","last_fullsized":"2023-07-06T22:02:12.913653+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:11.342846+0000","last_clean_scrub_stamp":"2023-07-06T22:02:11.342846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:10:40.027687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.912617+0000","last_change":"2023-07-06T22:02:11.377834+0000","last_active":"2023-07-06T22:02:12.912617+0000","last_peered":"2023-07-06T22:02:12.912617+0000","last_clean":"2023-07-06T22:02:12.912617+0000","last_became_active":"2023-07-06T22:02:11.377527+0000","last_became_peered":"2023-07-06T22:02:11.377527+0000","last_unstale":"2023-07-06T22:02:12.912617+0000","last_undegraded":"2023-07-06T22:02:12.912617+0000","last_fullsized":"2023-07-06T22:02:12.912617+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:02:10.334070+0000","last_clean_scrub_stamp":"2023-07-06T22:02:10.334070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:02:41.196452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":252,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-07-06T22:02:12.914653+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:02:12.914653+0000","last_peered":"2023-07-06T22:02:12.914653+0000","last_clean":"2023-07-06T22:02:12.914653+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:02:12.914653+0000","last_undegraded":"2023-07-06T22:02:12.914653+0000","last_fullsized":"2023-07-06T22:02:12.914653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:35:33.815743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575089,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37680,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334160,"statfs":{"total":96636764160,"available":96598179840,"internally_reserved":0,"allocated":2596864,"data_stored":1653416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.70899999999999996},"min":{"1min":0.46899999999999997,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":1.0229999999999999,"5min":1.526,"15min":1.526},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0409999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.34799999999999998},"max":{"1min":1.0580000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.72699999999999998,"15min":0.72299999999999998},"min":{"1min":0.47499999999999998,"5min":0.44600000000000001,"15min":0.434},"max":{"1min":1.1100000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.47399999999999998,"5min":0.42799999999999999,"15min":0.377},"max":{"1min":1,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":0.73099999999999998},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.42599999999999999},"max":{"1min":1.1339999999999999,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.627}]},{"osd":3,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73199999999999998,"15min":0.72299999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.42199999999999999},"max":{"1min":1.075,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.74199999999999999,"15min":0.74399999999999999},"min":{"1min":0.59699999999999998,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":1.0980000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.39400000000000002,"5min":0.377,"15min":0.32700000000000001},"max":{"1min":0.78700000000000003,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.35699999999999998},"max":{"1min":0.749,"5min":1.169,"15min":1.169},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.373},"max":{"1min":0.77400000000000002,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71899999999999997,"15min":0.70599999999999996},"min":{"1min":0.58999999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":1.45,"15min":1.45},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.44400000000000001,"15min":0.41699999999999998},"max":{"1min":0.85799999999999998,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.59799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575089,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37100,"kb_used_data":1956,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334740,"statfs":{"total":96636764160,"available":96598773760,"internally_reserved":0,"allocated":2002944,"data_stored":1061523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41399999999999998},"max":{"1min":1.089,"5min":1.607,"15min":1.607},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.751,"15min":0.74099999999999999},"min":{"1min":0.48399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1990000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.38500000000000001},"max":{"1min":0.85699999999999998,"5min":1.857,"15min":1.857},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.48899999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2270000000000001,"5min":1.778,"15min":1.778},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69399999999999995,"15min":0.71599999999999997},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41599999999999998},"max":{"1min":0.92700000000000005,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.62},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71299999999999997,"15min":0.73799999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0529999999999999,"5min":1.752,"15min":1.752},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.165,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.499,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1020000000000001,"5min":1.794,"15min":1.794},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.34599999999999997},"max":{"1min":0.81699999999999995,"5min":0.95399999999999996,"15min":1.4390000000000001},"last":0.496},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40100000000000002,"15min":0.35899999999999999},"max":{"1min":0.80100000000000005,"5min":0.94099999999999995,"15min":1.0509999999999999},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.62},"min":{"1min":0.442,"5min":0.42099999999999999,"15min":0.38600000000000001},"max":{"1min":0.82599999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.39000000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.3089999999999999},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.0029999999999999,"15min":1.2549999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85399999999999998,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.56899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575088,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55144,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316696,"statfs":{"total":96636764160,"available":96580296704,"internally_reserved":0,"allocated":1998848,"data_stored":1062418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98099999999999998,"5min":1.49,"15min":1.49},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.55500000000000005,"5min":0.45400000000000001,"15min":0.35299999999999998},"max":{"1min":1.0209999999999999,"5min":1.21,"15min":1.21},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.54400000000000004,"5min":0.45600000000000002,"15min":0.40200000000000002},"max":{"1min":1.0369999999999999,"5min":1.143,"15min":1.143},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.39900000000000002},"max":{"1min":0.99199999999999999,"5min":1.5,"15min":1.5},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44400000000000001},"max":{"1min":1.044,"5min":1.163,"15min":1.163},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.443},"max":{"1min":0.97999999999999998,"5min":1.127,"15min":1.127},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.008,"5min":1.109,"15min":1.109},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.315},"max":{"1min":0.85399999999999998,"5min":1.012,"15min":1.012},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.40899999999999997,"15min":0.371},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.02},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.004},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.44400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.95499999999999996},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67400000000000004,"15min":0.66000000000000003},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.34100000000000003},"max":{"1min":0.91400000000000003,"5min":0.95399999999999996,"15min":1.0529999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0589999999999999},"last":0.78700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575087,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55140,"kb_used_data":1948,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316700,"statfs":{"total":96636764160,"available":96580300800,"internally_reserved":0,"allocated":1994752,"data_stored":1062396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.72099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":0.89400000000000002,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.622},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98799999999999999,"5min":1.208,"15min":1.208},"last":0.495}]},{"osd":1,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.55000000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1200000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.439},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72999999999999998,"15min":0.72099999999999997},"min":{"1min":0.47499999999999998,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":0.86399999999999999,"5min":1.996,"15min":1.996},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.54000000000000004,"5min":0.41299999999999998,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.60199999999999998,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":1.0509999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.45200000000000001,"15min":0.45000000000000001},"max":{"1min":0.92300000000000004,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.746,"15min":0.754},"min":{"1min":0.58499999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2370000000000001,"5min":1.3640000000000001,"15min":3.2269999999999999},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.46000000000000002,"5min":0.35499999999999998,"15min":0.308},"max":{"1min":0.75,"5min":0.93899999999999995,"15min":0.94299999999999995},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.60099999999999998},"min":{"1min":0.503,"5min":0.377,"15min":0.32500000000000001},"max":{"1min":0.71899999999999997,"5min":0.96099999999999997,"15min":0.97299999999999998},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.47399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76800000000000002,"5min":1.036,"15min":1.036},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.65600000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":1,"15min":1},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jul 6 22:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93000000000000005,"5min":1.0149999999999999,"15min":1.0720000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.67600000000000005},"min":{"1min":0.45300000000000001,"5min":0.42299999999999999,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":1.01},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575088,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51048,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320792,"statfs":{"total":96636764160,"available":96584491008,"internally_reserved":0,"allocated":1998848,"data_stored":1062486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.433,"15min":0.45200000000000001},"min":{"1min":0.25800000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.48199999999999998,"15min":0.52900000000000003},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":2.77},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.442,"15min":0.48499999999999999},"min":{"1min":0.315,"5min":0.27500000000000002,"15min":0.24299999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":2.4359999999999999},"last":0.315},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53800000000000003,"15min":0.57899999999999996},"min":{"1min":0.40400000000000003,"5min":0.313,"15min":0.313},"max":{"1min":1.107,"5min":1.107,"15min":1.351},"last":0.442}]},{"osd":2,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52400000000000002,"15min":0.54500000000000004},"min":{"1min":0.41199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.24},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.755},"min":{"1min":0.502,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.022,"5min":1.1020000000000001,"15min":1.3009999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.71099999999999997,"15min":0.77100000000000002},"min":{"1min":0.55000000000000004,"5min":0.48699999999999999,"15min":0.46000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.383},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.75600000000000001,"15min":0.80300000000000005},"min":{"1min":0.63600000000000001,"5min":0.51700000000000002,"15min":0.51500000000000001},"max":{"1min":1.1259999999999999,"5min":1.349,"15min":1.4199999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.754,"15min":0.78900000000000003},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.45400000000000001},"max":{"1min":1.0509999999999999,"5min":1.395,"15min":1.3999999999999999},"last":0.748}]},{"osd":6,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73999999999999999,"15min":0.79200000000000004},"min":{"1min":0.56100000000000005,"5min":0.47499999999999998,"15min":0.46600000000000003},"max":{"1min":1.093,"5min":1.371,"15min":1.425},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.748,"15min":0.80200000000000005},"min":{"1min":0.54400000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0920000000000001,"5min":1.097,"15min":3.1739999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.73499999999999999,"15min":0.80100000000000005},"min":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":3.097},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.75600000000000001,"15min":0.79900000000000004},"min":{"1min":0.59299999999999997,"5min":0.47099999999999997,"15min":0.45900000000000002},"max":{"1min":1.0740000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.72499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575088,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41204,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330636,"statfs":{"total":96636764160,"available":96594571264,"internally_reserved":0,"allocated":2011136,"data_stored":1064030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.42799999999999999,"15min":0.45100000000000001},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.623,"5min":0.68600000000000005,"15min":0.85999999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48499999999999999,"15min":0.5},"min":{"1min":0.38200000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.73399999999999999,"5min":0.82199999999999995,"15min":0.85999999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.496,"15min":0.50900000000000001},"min":{"1min":0.39100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67900000000000005,"5min":0.878,"15min":0.88200000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.54400000000000004},"min":{"1min":0.38200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72799999999999998,"5min":0.83499999999999996,"15min":0.94399999999999995},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.374},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55600000000000005,"15min":0.57699999999999996},"min":{"1min":0.44,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.95399999999999996},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.47999999999999998,"15min":0.42899999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.57099999999999995,"5min":0.52100000000000002,"15min":0.41399999999999998},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.60099999999999998,"5min":0.52200000000000002,"15min":0.42899999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77800000000000002,"15min":0.80900000000000005},"min":{"1min":0.51500000000000001,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.48299999999999998},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.63900000000000001,"5min":0.51800000000000002,"15min":0.497},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80700000000000005,"15min":0.82499999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.496},"max":{"1min":1.127,"5min":1.458,"15min":1.458},"last":0.63},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.81399999999999995,"15min":0.83899999999999997},"min":{"1min":0.60199999999999998,"5min":0.54200000000000004,"15min":0.50700000000000001},"max":{"1min":1.415,"5min":1.573,"15min":1.573},"last":0.76000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575089,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59240,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312600,"statfs":{"total":96636764160,"available":96576102400,"internally_reserved":0,"allocated":1998848,"data_stored":1062978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.30199999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73599999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47799999999999998,"15min":0.501},"min":{"1min":0.36299999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68400000000000005,"5min":0.83399999999999996,"15min":0.92200000000000004},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.35299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71399999999999997,"5min":0.83999999999999997,"15min":0.88900000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.52300000000000002},"min":{"1min":0.38200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.71399999999999997,"15min":0.87},"last":0.442}]},{"osd":3,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.57699999999999996},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.84599999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.53900000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32000000000000001},"max":{"1min":0.74299999999999999,"5min":0.749,"15min":0.91200000000000003},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76800000000000002,"15min":0.77700000000000002},"min":{"1min":0.54300000000000004,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.3140000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77100000000000002,"15min":0.78400000000000003},"min":{"1min":0.64400000000000002,"5min":0.48899999999999999,"15min":0.44},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.64300000000000002,"5min":0.48699999999999999,"15min":0.41899999999999998},"max":{"1min":1.129,"5min":1.2130000000000001,"15min":1.4359999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.77400000000000002,"15min":0.79100000000000004},"min":{"1min":0.57999999999999996,"5min":0.46999999999999997,"15min":0.46899999999999997},"max":{"1min":1.1859999999999999,"5min":1.3260000000000001,"15min":1.357},"last":0.872}]},{"osd":6,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.624,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1859999999999999,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.51500000000000001,"15min":0.47799999999999998},"max":{"1min":1.3029999999999999,"5min":1.4379999999999999,"15min":1.456},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.80100000000000005,"15min":0.81000000000000005},"min":{"1min":0.58499999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.745},{"interface":"front","average":{"1min":0.873,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.67900000000000005,"5min":0.51900000000000002,"15min":0.5},"max":{"1min":1.2250000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.77900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575088,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37684,"kb_used_data":2540,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334156,"statfs":{"total":96636764160,"available":96598175744,"internally_reserved":0,"allocated":2600960,"data_stored":1653343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.42199999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.86399999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.374,"5min":0.28299999999999997,"15min":0.27600000000000002},"max":{"1min":0.67400000000000004,"5min":0.86799999999999999,"15min":0.98099999999999998},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47399999999999998,"15min":0.495},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.82399999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.496,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.33800000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":1.2050000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47899999999999998,"15min":0.50600000000000001},"min":{"1min":0.35699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63,"5min":0.76600000000000001,"15min":1.151},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.56100000000000005},"min":{"1min":0.42399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65900000000000003,"5min":0.78800000000000003,"15min":0.874},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.78400000000000003},"min":{"1min":0.55800000000000005,"5min":0.46400000000000002,"15min":0.45000000000000001},"max":{"1min":1.2190000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.48099999999999998,"5min":0.44600000000000001,"15min":0.40999999999999998},"max":{"1min":1.143,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.754}]},{"osd":5,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57899999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96599999999999997,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.745,"15min":0.77600000000000002},"min":{"1min":0.52900000000000003,"5min":0.48499999999999999,"15min":0.44400000000000001},"max":{"1min":1.284,"5min":1.776,"15min":1.776},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.52200000000000002,"15min":0.48899999999999999},"max":{"1min":1.232,"5min":1.851,"15min":1.851},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1739999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78600000000000003,"15min":0.80500000000000005},"min":{"1min":0.51200000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.252,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.81499999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.50900000000000001},"max":{"1min":1.1879999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:02:20.832 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T22:02:20.833 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-06T22:02:21.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.019+0000 7f34b12cb640 1 Processor -- start 2023-07-06T22:02:21.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.019+0000 7f34b12cb640 1 -- start start 2023-07-06T22:02:21.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.019+0000 7f34b12cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34ac06ba00 0x7f34ac0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:21.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.019+0000 7f34b12cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac071660 con 0x7f34ac0c8a30 2023-07-06T22:02:21.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.019+0000 7f34b12cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac06a500 con 0x7f34ac158770 2023-07-06T22:02:21.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.019+0000 7f34b12cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac06a750 con 0x7f34ac06ba00 2023-07-06T22:02:21.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.019+0000 7f34ab7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f34ac0c8a30 0x7f34ac0704a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50194/0 (socket says 172.21.15.55:50194) 2023-07-06T22:02:21.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.019+0000 7f34ab7fe640 1 -- 172.21.15.55:0/2278556361 learned_addr learned my addr 172.21.15.55:0/2278556361 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:21.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.019+0000 7f34a3fff640 1 --2- 172.21.15.55:0/2278556361 >> v2:172.21.15.55:3300/0 conn(0x7f34ac06ba00 0x7f34ac0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:21.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.023+0000 7f34aa7fc640 1 -- 172.21.15.55:0/2278556361 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496131924 0 0) 0x7f34ac071660 con 0x7f34ac0c8a30 2023-07-06T22:02:21.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.023+0000 7f34aa7fc640 1 -- 172.21.15.55:0/2278556361 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3498003530 con 0x7f34ac0c8a30 2023-07-06T22:02:21.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.023+0000 7f34a3fff640 1 -- 172.21.15.55:0/2278556361 >> v1:172.21.15.138:6789/0 conn(0x7f34ac158770 legacy=0x7f34ac06b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:21.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.023+0000 7f34a3fff640 1 -- 172.21.15.55:0/2278556361 >> v1:172.21.15.55:6789/0 conn(0x7f34ac0c8a30 legacy=0x7f34ac0704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:21.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.023+0000 7f34a3fff640 1 -- 172.21.15.55:0/2278556361 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac06f9c0 con 0x7f34ac06ba00 2023-07-06T22:02:21.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.023+0000 7f34a3fff640 1 --2- 172.21.15.55:0/2278556361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac06ba00 0x7f34ac0cbb10 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f34940097c0 tx=0x7f349401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84553786dc0e33a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:21.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.023+0000 7f34aa7fc640 1 -- 172.21.15.55:0/2278556361 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34940ab670 con 0x7f34ac06ba00 2023-07-06T22:02:21.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.023+0000 7f34aa7fc640 1 -- 172.21.15.55:0/2278556361 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34940ab7d0 con 0x7f34ac06ba00 2023-07-06T22:02:21.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.023+0000 7f34aa7fc640 1 -- 172.21.15.55:0/2278556361 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34940abb40 con 0x7f34ac06ba00 2023-07-06T22:02:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 -- 172.21.15.55:0/2278556361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac06ba00 msgr2=0x7f34ac0cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 --2- 172.21.15.55:0/2278556361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac06ba00 0x7f34ac0cbb10 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f34940097c0 tx=0x7f349401c450 comp rx=0 tx=0).stop 2023-07-06T22:02:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 -- 172.21.15.55:0/2278556361 shutdown_connections 2023-07-06T22:02:21.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 --2- 172.21.15.55:0/2278556361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac06ba00 0x7f34ac0cbb10 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 -- 172.21.15.55:0/2278556361 >> 172.21.15.55:0/2278556361 conn(0x7f34ac0cdf40 msgr2=0x7f34ac0ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:21.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 -- 172.21.15.55:0/2278556361 shutdown_connections 2023-07-06T22:02:21.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 -- 172.21.15.55:0/2278556361 wait complete. 2023-07-06T22:02:21.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 Processor -- start 2023-07-06T22:02:21.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 -- start start 2023-07-06T22:02:21.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac06ba00 0x7f34ac150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:21.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34ac0c8a30 0x7f34ac154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:21.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34ac158770 0x7f34ac0c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:21.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac153130 con 0x7f34ac06ba00 2023-07-06T22:02:21.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac153380 con 0x7f34ac0c8a30 2023-07-06T22:02:21.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34b12cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac153660 con 0x7f34ac158770 2023-07-06T22:02:21.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34aaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac06ba00 0x7f34ac150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:21.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34aaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac06ba00 0x7f34ac150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44074/0 (socket says 172.21.15.55:44074) 2023-07-06T22:02:21.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34aaffd640 1 -- 172.21.15.55:0/4254785516 learned_addr learned my addr 172.21.15.55:0/4254785516 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:21.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34ab7fe640 1 --2- 172.21.15.55:0/4254785516 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34ac158770 0x7f34ac0c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:21.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34a3fff640 1 --2- 172.21.15.55:0/4254785516 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34ac0c8a30 0x7f34ac154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:21.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34aaffd640 1 -- 172.21.15.55:0/4254785516 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34ac158770 msgr2=0x7f34ac0c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:21.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34aaffd640 1 --2- 172.21.15.55:0/4254785516 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34ac158770 0x7f34ac0c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34aaffd640 1 -- 172.21.15.55:0/4254785516 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34ac0c8a30 msgr2=0x7f34ac154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:21.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34aaffd640 1 --2- 172.21.15.55:0/4254785516 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34ac0c8a30 0x7f34ac154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.027+0000 7f34aaffd640 1 -- 172.21.15.55:0/4254785516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494009420 con 0x7f34ac06ba00 2023-07-06T22:02:21.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.031+0000 7f34aaffd640 1 --2- 172.21.15.55:0/4254785516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac06ba00 0x7f34ac150030 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f349c00c3c0 tx=0x7f349c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:21.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.031+0000 7f34a37fe640 1 -- 172.21.15.55:0/4254785516 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0052d0 con 0x7f34ac06ba00 2023-07-06T22:02:21.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.031+0000 7f34a37fe640 1 -- 172.21.15.55:0/4254785516 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c005430 con 0x7f34ac06ba00 2023-07-06T22:02:21.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.031+0000 7f34a37fe640 1 -- 172.21.15.55:0/4254785516 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c003840 con 0x7f34ac06ba00 2023-07-06T22:02:21.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.031+0000 7f34b12cb640 1 -- 172.21.15.55:0/4254785516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac153940 con 0x7f34ac06ba00 2023-07-06T22:02:21.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.031+0000 7f34b12cb640 1 -- 172.21.15.55:0/4254785516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac153f00 con 0x7f34ac06ba00 2023-07-06T22:02:21.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.031+0000 7f34b12cb640 1 -- 172.21.15.55:0/4254785516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac066d60 con 0x7f34ac06ba00 2023-07-06T22:02:21.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.031+0000 7f34a37fe640 1 -- 172.21.15.55:0/4254785516 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f349c0039a0 con 0x7f34ac06ba00 2023-07-06T22:02:21.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.031+0000 7f34a37fe640 1 --2- 172.21.15.55:0/4254785516 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f348c0663a0 0x7f348c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:21.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.031+0000 7f34a37fe640 1 -- 172.21.15.55:0/4254785516 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f349c0835c0 con 0x7f34ac06ba00 2023-07-06T22:02:21.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.031+0000 7f34a3fff640 1 --2- 172.21.15.55:0/4254785516 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f348c0663a0 0x7f348c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:21.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.035+0000 7f34a3fff640 1 --2- 172.21.15.55:0/4254785516 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f348c0663a0 0x7f348c068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34940af000 tx=0x7f3494008040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:21.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.035+0000 7f34a37fe640 1 -- 172.21.15.55:0/4254785516 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f349c050730 con 0x7f34ac06ba00 2023-07-06T22:02:21.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.247+0000 7f34b12cb640 1 -- 172.21.15.55:0/4254785516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f34ac0b3ec0 con 0x7f34ac06ba00 2023-07-06T22:02:21.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.251+0000 7f34a37fe640 1 -- 172.21.15.55:0/4254785516 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7f349c053d50 con 0x7f34ac06ba00 2023-07-06T22:02:21.251 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-07-06T22:02:21.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.255+0000 7f34b12cb640 1 -- 172.21.15.55:0/4254785516 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f348c0663a0 msgr2=0x7f348c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:21.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.255+0000 7f34b12cb640 1 --2- 172.21.15.55:0/4254785516 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f348c0663a0 0x7f348c068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34940af000 tx=0x7f3494008040 comp rx=0 tx=0).stop 2023-07-06T22:02:21.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.255+0000 7f34b12cb640 1 -- 172.21.15.55:0/4254785516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac06ba00 msgr2=0x7f34ac150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:21.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.255+0000 7f34b12cb640 1 --2- 172.21.15.55:0/4254785516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac06ba00 0x7f34ac150030 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f349c00c3c0 tx=0x7f349c00c880 comp rx=0 tx=0).stop 2023-07-06T22:02:21.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.255+0000 7f34b12cb640 1 -- 172.21.15.55:0/4254785516 shutdown_connections 2023-07-06T22:02:21.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.255+0000 7f34b12cb640 1 --2- 172.21.15.55:0/4254785516 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34ac158770 0x7f34ac0c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.255+0000 7f34b12cb640 1 --2- 172.21.15.55:0/4254785516 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f348c0663a0 0x7f348c068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.255+0000 7f34b12cb640 1 --2- 172.21.15.55:0/4254785516 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34ac0c8a30 0x7f34ac154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.255+0000 7f34b12cb640 1 --2- 172.21.15.55:0/4254785516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac06ba00 0x7f34ac150030 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.255+0000 7f34b12cb640 1 -- 172.21.15.55:0/4254785516 >> 172.21.15.55:0/4254785516 conn(0x7f34ac0cdf40 msgr2=0x7f34ac06b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:21.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.255+0000 7f34b12cb640 1 -- 172.21.15.55:0/4254785516 shutdown_connections 2023-07-06T22:02:21.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.255+0000 7f34b12cb640 1 -- 172.21.15.55:0/4254785516 wait complete. 2023-07-06T22:02:21.272 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:02:21.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.415+0000 7f615d3d2640 1 Processor -- start 2023-07-06T22:02:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f615d3d2640 1 -- start start 2023-07-06T22:02:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f615d3d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6158158400 0x7f61580c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f615d3d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f61580c9680 0x7f6158070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f615d3d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615806fae0 con 0x7f61580710c0 2023-07-06T22:02:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f615d3d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615806fdc0 con 0x7f61580c9680 2023-07-06T22:02:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f615d3d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61580700a0 con 0x7f6158158400 2023-07-06T22:02:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f614ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f61580c9680 0x7f6158070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f61577fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f61580710c0 0x7f61580cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50204/0 (socket says 172.21.15.55:50204) 2023-07-06T22:02:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f61577fe640 1 -- 172.21.15.55:0/725962006 learned_addr learned my addr 172.21.15.55:0/725962006 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f6156ffd640 1 --2- 172.21.15.55:0/725962006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6158158400 0x7f61580c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f61567fc640 1 -- 172.21.15.55:0/725962006 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953288873 0 0) 0x7f615806fae0 con 0x7f61580710c0 2023-07-06T22:02:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f61567fc640 1 -- 172.21.15.55:0/725962006 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6144003530 con 0x7f61580710c0 2023-07-06T22:02:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f614ffff640 1 -- 172.21.15.55:0/725962006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6158158400 msgr2=0x7f61580c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f614ffff640 1 --2- 172.21.15.55:0/725962006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6158158400 0x7f61580c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f614ffff640 1 -- 172.21.15.55:0/725962006 >> v1:172.21.15.55:6789/0 conn(0x7f61580710c0 legacy=0x7f61580cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.419+0000 7f614ffff640 1 -- 172.21.15.55:0/725962006 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6158070380 con 0x7f61580c9680 2023-07-06T22:02:21.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.423+0000 7f614ffff640 1 --2- 172.21.15.55:0/725962006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61580c9680 0x7f6158070b80 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f61400097c0 tx=0x7f614001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53f0bacc736002d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.423+0000 7f61567fc640 1 -- 172.21.15.55:0/725962006 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61400ab670 con 0x7f61580c9680 2023-07-06T22:02:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.423+0000 7f61567fc640 1 -- 172.21.15.55:0/725962006 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61400ab7d0 con 0x7f61580c9680 2023-07-06T22:02:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.423+0000 7f61567fc640 1 -- 172.21.15.55:0/725962006 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61400abb60 con 0x7f61580c9680 2023-07-06T22:02:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.423+0000 7f615d3d2640 1 -- 172.21.15.55:0/725962006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61580c9680 msgr2=0x7f6158070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.423+0000 7f615d3d2640 1 --2- 172.21.15.55:0/725962006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61580c9680 0x7f6158070b80 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f61400097c0 tx=0x7f614001c450 comp rx=0 tx=0).stop 2023-07-06T22:02:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.423+0000 7f615d3d2640 1 -- 172.21.15.55:0/725962006 shutdown_connections 2023-07-06T22:02:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.423+0000 7f615d3d2640 1 --2- 172.21.15.55:0/725962006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61580c9680 0x7f6158070b80 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.423+0000 7f615d3d2640 1 --2- 172.21.15.55:0/725962006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6158158400 0x7f61580c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.423+0000 7f615d3d2640 1 -- 172.21.15.55:0/725962006 >> 172.21.15.55:0/725962006 conn(0x7f61580cded0 msgr2=0x7f61580ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.423+0000 7f615d3d2640 1 -- 172.21.15.55:0/725962006 shutdown_connections 2023-07-06T22:02:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.423+0000 7f615d3d2640 1 -- 172.21.15.55:0/725962006 wait complete. 2023-07-06T22:02:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.423+0000 7f615d3d2640 1 Processor -- start 2023-07-06T22:02:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.423+0000 7f615d3d2640 1 -- start start 2023-07-06T22:02:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f615d3d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61580710c0 0x7f61580a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f615d3d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61580c9680 0x7f615815c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f615d3d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6158158400 0x7f6158155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f615d3d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61580aac60 con 0x7f6158158400 2023-07-06T22:02:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f615d3d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6158159cc0 con 0x7f61580710c0 2023-07-06T22:02:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f615d3d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61581f6220 con 0x7f61580c9680 2023-07-06T22:02:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f61577fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6158158400 0x7f6158155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f61577fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6158158400 0x7f6158155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44092/0 (socket says 172.21.15.55:44092) 2023-07-06T22:02:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f614ffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61580c9680 0x7f615815c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f61577fe640 1 -- 172.21.15.55:0/1480426537 learned_addr learned my addr 172.21.15.55:0/1480426537 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f6156ffd640 1 --2- 172.21.15.55:0/1480426537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61580710c0 0x7f61580a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f61577fe640 1 -- 172.21.15.55:0/1480426537 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61580c9680 msgr2=0x7f615815c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f61577fe640 1 --2- 172.21.15.55:0/1480426537 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61580c9680 0x7f615815c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f61577fe640 1 -- 172.21.15.55:0/1480426537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61580710c0 msgr2=0x7f61580a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f61577fe640 1 --2- 172.21.15.55:0/1480426537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61580710c0 0x7f61580a9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f61577fe640 1 -- 172.21.15.55:0/1480426537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6140009420 con 0x7f6158158400 2023-07-06T22:02:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f61577fe640 1 --2- 172.21.15.55:0/1480426537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6158158400 0x7f6158155500 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f615000cb40 tx=0x7f615000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f614f7fe640 1 -- 172.21.15.55:0/1480426537 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000aca0 con 0x7f6158158400 2023-07-06T22:02:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f614f7fe640 1 -- 172.21.15.55:0/1480426537 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615000ae00 con 0x7f6158158400 2023-07-06T22:02:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f615d3d2640 1 -- 172.21.15.55:0/1480426537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61581f6500 con 0x7f6158158400 2023-07-06T22:02:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f614f7fe640 1 -- 172.21.15.55:0/1480426537 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150012620 con 0x7f6158158400 2023-07-06T22:02:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f615d3d2640 1 -- 172.21.15.55:0/1480426537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61581f6ac0 con 0x7f6158158400 2023-07-06T22:02:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.427+0000 7f615d3d2640 1 -- 172.21.15.55:0/1480426537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615806c580 con 0x7f6158158400 2023-07-06T22:02:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.431+0000 7f614f7fe640 1 -- 172.21.15.55:0/1480426537 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6150007070 con 0x7f6158158400 2023-07-06T22:02:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.431+0000 7f614f7fe640 1 --2- 172.21.15.55:0/1480426537 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f61380663a0 0x7f6138068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.431+0000 7f614f7fe640 1 -- 172.21.15.55:0/1480426537 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6150083ff0 con 0x7f6158158400 2023-07-06T22:02:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.431+0000 7f6156ffd640 1 --2- 172.21.15.55:0/1480426537 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f61380663a0 0x7f6138068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.431+0000 7f6156ffd640 1 --2- 172.21.15.55:0/1480426537 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f61380663a0 0x7f6138068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6148009ac0 tx=0x7f6148009190 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:21.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.435+0000 7f614f7fe640 1 -- 172.21.15.55:0/1480426537 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f61500b4700 con 0x7f6158158400 2023-07-06T22:02:21.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.619+0000 7f615d3d2640 1 -- 172.21.15.55:0/1480426537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6158159e80 con 0x7f6158158400 2023-07-06T22:02:21.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.623+0000 7f614f7fe640 1 -- 172.21.15.55:0/1480426537 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f6150017020 con 0x7f6158158400 2023-07-06T22:02:21.621 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:02:21.621 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7958,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2209436909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2209436909},{"type":"v1","addr":"172.21.15.55:6837","nonce":2209436909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1799743845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":1799743845},{"type":"v1","addr":"172.21.15.138:6835","nonce":1799743845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8992,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3922834764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3922834764},{"type":"v1","addr":"172.21.15.138:6834","nonce":3922834764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:02:11.754063+0000","modified":"2023-07-06T22:02:14.781049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9759":{"gid":9759,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/4021237791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4021237791},{"type":"v1","addr":"172.21.15.55:6836","nonce":4021237791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-06T22:02:21.621 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 71 2023-07-06T22:02:21.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.623+0000 7f615d3d2640 1 -- 172.21.15.55:0/1480426537 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f61380663a0 msgr2=0x7f6138068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.623+0000 7f615d3d2640 1 --2- 172.21.15.55:0/1480426537 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f61380663a0 0x7f6138068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6148009ac0 tx=0x7f6148009190 comp rx=0 tx=0).stop 2023-07-06T22:02:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.623+0000 7f615d3d2640 1 -- 172.21.15.55:0/1480426537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6158158400 msgr2=0x7f6158155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.623+0000 7f615d3d2640 1 --2- 172.21.15.55:0/1480426537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6158158400 0x7f6158155500 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f615000cb40 tx=0x7f615000a060 comp rx=0 tx=0).stop 2023-07-06T22:02:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.623+0000 7f615d3d2640 1 -- 172.21.15.55:0/1480426537 shutdown_connections 2023-07-06T22:02:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.623+0000 7f615d3d2640 1 --2- 172.21.15.55:0/1480426537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6158158400 0x7f6158155500 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.623+0000 7f615d3d2640 1 --2- 172.21.15.55:0/1480426537 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61580c9680 0x7f615815c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.623+0000 7f615d3d2640 1 --2- 172.21.15.55:0/1480426537 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f61380663a0 0x7f6138068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.623+0000 7f615d3d2640 1 --2- 172.21.15.55:0/1480426537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61580710c0 0x7f61580a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.623+0000 7f615d3d2640 1 -- 172.21.15.55:0/1480426537 >> 172.21.15.55:0/1480426537 conn(0x7f61580cded0 msgr2=0x7f61580b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.623+0000 7f615d3d2640 1 -- 172.21.15.55:0/1480426537 shutdown_connections 2023-07-06T22:02:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:21.623+0000 7f615d3d2640 1 -- 172.21.15.55:0/1480426537 wait complete. 2023-07-06T22:02:22.043 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T22:02:11.754063+0000', 'modified': '2023-07-06T22:02:14.781049+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9759}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9759': {'gid': 9759, 'name': 'c', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6836/4021237791', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 4021237791}, {'type': 'v1', 'addr': '172.21.15.55:6836', 'nonce': 4021237791}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T22:02:22.043 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T22:02:22.044 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-06T22:02:22.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdebf0cb640 1 Processor -- start 2023-07-06T22:02:22.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdebf0cb640 1 -- start start 2023-07-06T22:02:22.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdebf0cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeb815ba30 0x7fdeb80cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdebf0cb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdeb80ad0c0 0x7fdeb809ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdebf0cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb80ccbb0 con 0x7fdeb809d340 2023-07-06T22:02:22.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdebf0cb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb80c83a0 con 0x7fdeb80ad0c0 2023-07-06T22:02:22.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdebf0cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb809d7c0 con 0x7fdeb815ba30 2023-07-06T22:02:22.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdebd668640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdeb809d340 0x7fdeb815f6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50206/0 (socket says 172.21.15.55:50206) 2023-07-06T22:02:22.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdebd668640 1 -- 172.21.15.55:0/1960437105 learned_addr learned my addr 172.21.15.55:0/1960437105 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:22.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdeb7fff640 1 --2- 172.21.15.55:0/1960437105 >> v2:172.21.15.138:3300/0 conn(0x7fdeb80ad0c0 0x7fdeb809ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdebce67640 1 --2- 172.21.15.55:0/1960437105 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeb815ba30 0x7fdeb80cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdeb77fe640 1 -- 172.21.15.55:0/1960437105 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619908814 0 0) 0x7fdeb80ccbb0 con 0x7fdeb809d340 2023-07-06T22:02:22.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdeb77fe640 1 -- 172.21.15.55:0/1960437105 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdea8003530 con 0x7fdeb809d340 2023-07-06T22:02:22.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdebce67640 1 -- 172.21.15.55:0/1960437105 >> v2:172.21.15.138:3300/0 conn(0x7fdeb80ad0c0 msgr2=0x7fdeb809ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:22.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdebce67640 1 --2- 172.21.15.55:0/1960437105 >> v2:172.21.15.138:3300/0 conn(0x7fdeb80ad0c0 0x7fdeb809ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdebce67640 1 -- 172.21.15.55:0/1960437105 >> v1:172.21.15.55:6789/0 conn(0x7fdeb809d340 legacy=0x7fdeb815f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.191+0000 7fdebce67640 1 -- 172.21.15.55:0/1960437105 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb80cce90 con 0x7fdeb815ba30 2023-07-06T22:02:22.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.195+0000 7fdebce67640 1 --2- 172.21.15.55:0/1960437105 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeb815ba30 0x7fdeb80cd800 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0097c0 tx=0x7fdeac01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16a0f1c6663ecfbe server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:22.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.195+0000 7fdeb77fe640 1 -- 172.21.15.55:0/1960437105 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac0ab650 con 0x7fdeb815ba30 2023-07-06T22:02:22.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.195+0000 7fdeb77fe640 1 -- 172.21.15.55:0/1960437105 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeac0ab7b0 con 0x7fdeb815ba30 2023-07-06T22:02:22.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.195+0000 7fdeb77fe640 1 -- 172.21.15.55:0/1960437105 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac0abb40 con 0x7fdeb815ba30 2023-07-06T22:02:22.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.195+0000 7fdebf0cb640 1 -- 172.21.15.55:0/1960437105 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeb815ba30 msgr2=0x7fdeb80cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.195+0000 7fdebf0cb640 1 --2- 172.21.15.55:0/1960437105 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeb815ba30 0x7fdeb80cd800 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0097c0 tx=0x7fdeac01c450 comp rx=0 tx=0).stop 2023-07-06T22:02:22.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.195+0000 7fdebf0cb640 1 -- 172.21.15.55:0/1960437105 shutdown_connections 2023-07-06T22:02:22.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.195+0000 7fdebf0cb640 1 --2- 172.21.15.55:0/1960437105 >> v2:172.21.15.138:3300/0 conn(0x7fdeb80ad0c0 0x7fdeb809ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.195+0000 7fdebf0cb640 1 --2- 172.21.15.55:0/1960437105 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeb815ba30 0x7fdeb80cd800 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.195+0000 7fdebf0cb640 1 -- 172.21.15.55:0/1960437105 >> 172.21.15.55:0/1960437105 conn(0x7fdeb80cea70 msgr2=0x7fdeb80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:22.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.195+0000 7fdebf0cb640 1 -- 172.21.15.55:0/1960437105 shutdown_connections 2023-07-06T22:02:22.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.195+0000 7fdebf0cb640 1 -- 172.21.15.55:0/1960437105 wait complete. 2023-07-06T22:02:22.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebf0cb640 1 Processor -- start 2023-07-06T22:02:22.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebf0cb640 1 -- start start 2023-07-06T22:02:22.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebf0cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeb809d340 0x7fdeb8154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebf0cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeb80ad0c0 0x7fdeb80c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebf0cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeb815ba30 0x7fdeb80b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebf0cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb8155070 con 0x7fdeb815ba30 2023-07-06T22:02:22.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebf0cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb80b2d50 con 0x7fdeb809d340 2023-07-06T22:02:22.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebf0cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb80c6640 con 0x7fdeb80ad0c0 2023-07-06T22:02:22.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebd668640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeb815ba30 0x7fdeb80b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebd668640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeb815ba30 0x7fdeb80b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44102/0 (socket says 172.21.15.55:44102) 2023-07-06T22:02:22.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebd668640 1 -- 172.21.15.55:0/2908889653 learned_addr learned my addr 172.21.15.55:0/2908889653 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:22.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebce67640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeb809d340 0x7fdeb8154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdeb7fff640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeb80ad0c0 0x7fdeb80c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebd668640 1 -- 172.21.15.55:0/2908889653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeb80ad0c0 msgr2=0x7fdeb80c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebd668640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeb80ad0c0 0x7fdeb80c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebd668640 1 -- 172.21.15.55:0/2908889653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeb809d340 msgr2=0x7fdeb8154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebd668640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeb809d340 0x7fdeb8154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebd668640 1 -- 172.21.15.55:0/2908889653 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac009420 con 0x7fdeb815ba30 2023-07-06T22:02:22.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdeb7fff640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeb80ad0c0 0x7fdeb80c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:22.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebce67640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeb809d340 0x7fdeb8154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:22.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebd668640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeb815ba30 0x7fdeb80b1c60 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000caa0 tx=0x7fdeb000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:22.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdeb57fa640 1 -- 172.21.15.55:0/2908889653 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb000ac00 con 0x7fdeb815ba30 2023-07-06T22:02:22.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdeb57fa640 1 -- 172.21.15.55:0/2908889653 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb000ad60 con 0x7fdeb815ba30 2023-07-06T22:02:22.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdeb57fa640 1 -- 172.21.15.55:0/2908889653 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0012620 con 0x7fdeb815ba30 2023-07-06T22:02:22.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebf0cb640 1 -- 172.21.15.55:0/2908889653 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb80b24b0 con 0x7fdeb815ba30 2023-07-06T22:02:22.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.199+0000 7fdebf0cb640 1 -- 172.21.15.55:0/2908889653 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb80b2a70 con 0x7fdeb815ba30 2023-07-06T22:02:22.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.203+0000 7fdeb57fa640 1 -- 172.21.15.55:0/2908889653 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdeb0007070 con 0x7fdeb815ba30 2023-07-06T22:02:22.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.203+0000 7fdeb57fa640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fde9c0663a0 0x7fde9c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.203+0000 7fdeb57fa640 1 -- 172.21.15.55:0/2908889653 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdeb0083fe0 con 0x7fdeb815ba30 2023-07-06T22:02:22.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.203+0000 7fdebce67640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fde9c0663a0 0x7fde9c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.203+0000 7fdec240e000 1 Processor -- start 2023-07-06T22:02:22.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.203+0000 7fdec240e000 1 -- start start 2023-07-06T22:02:22.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.203+0000 7fdebce67640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fde9c0663a0 0x7fde9c068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0af000 tx=0x7fdeac0a7000 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:22.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 0x559a98198b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a9814e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a9814f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a98016ac0 con 0x559a98199050 2023-07-06T22:02:22.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a97f50840 con 0x559a9814ed80 2023-07-06T22:02:22.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a97fa42e0 con 0x559a98198740 2023-07-06T22:02:22.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdeb7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a9814e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdeb7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a9814e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44108/0 (socket says 172.21.15.55:44108) 2023-07-06T22:02:22.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdeb7fff640 1 -- 172.21.15.55:0/3080787935 learned_addr learned my addr 172.21.15.55:0/3080787935 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:22.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdebce67640 1 --2- 172.21.15.55:0/3080787935 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 0x559a98198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdebd668640 1 --2- 172.21.15.55:0/3080787935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a9814f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdeb7fff640 1 -- 172.21.15.55:0/3080787935 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 msgr2=0x559a98198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:22.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdeb7fff640 1 --2- 172.21.15.55:0/3080787935 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 0x559a98198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdeb7fff640 1 -- 172.21.15.55:0/3080787935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 msgr2=0x559a9814f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:22.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdeb7fff640 1 --2- 172.21.15.55:0/3080787935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a9814f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdeb7fff640 1 -- 172.21.15.55:0/3080787935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a97c99890 con 0x559a98199050 2023-07-06T22:02:22.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdeb7fff640 1 --2- 172.21.15.55:0/3080787935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a9814e840 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009c00 tx=0x7fdea4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbcecb77bbeb2ac server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:22.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdea27fc640 1 -- 172.21.15.55:0/3080787935 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea4011ed0 con 0x559a98199050 2023-07-06T22:02:22.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdea27fc640 1 -- 172.21.15.55:0/3080787935 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea4009e10 con 0x559a98199050 2023-07-06T22:02:22.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdea27fc640 1 -- 172.21.15.55:0/3080787935 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40156a0 con 0x559a98199050 2023-07-06T22:02:22.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 -- 172.21.15.55:0/3080787935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 msgr2=0x559a9814e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 --2- 172.21.15.55:0/3080787935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a9814e840 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009c00 tx=0x7fdea4009190 comp rx=0 tx=0).stop 2023-07-06T22:02:22.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 -- 172.21.15.55:0/3080787935 shutdown_connections 2023-07-06T22:02:22.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 --2- 172.21.15.55:0/3080787935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a9814f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 --2- 172.21.15.55:0/3080787935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a9814e840 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 --2- 172.21.15.55:0/3080787935 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 0x559a98198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 -- 172.21.15.55:0/3080787935 >> 172.21.15.55:0/3080787935 conn(0x559a98146800 msgr2=0x559a98155800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:22.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 -- 172.21.15.55:0/3080787935 shutdown_connections 2023-07-06T22:02:22.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 -- 172.21.15.55:0/3080787935 wait complete. 2023-07-06T22:02:22.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 -- start start 2023-07-06T22:02:22.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.207+0000 7fdec240e000 1 Processor -- start 2023-07-06T22:02:22.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a98154430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 0x559a98154970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a9815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a97f9d380 con 0x559a98199050 2023-07-06T22:02:22.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a97f59ae0 con 0x559a9814ed80 2023-07-06T22:02:22.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a97f59780 con 0x559a98198740 2023-07-06T22:02:22.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 10 client.0 _ll_register_callbacks cb 0x559a9813ae30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T22:02:22.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdebd668640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a9815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdebd668640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a9815a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44114/0 (socket says 172.21.15.55:44114) 2023-07-06T22:02:22.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdebd668640 1 -- 172.21.15.55:0/2117608154 learned_addr learned my addr 172.21.15.55:0/2117608154 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:22.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdebce67640 1 --2- 172.21.15.55:0/2117608154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a98154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdeb7fff640 1 --2- 172.21.15.55:0/2117608154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 0x559a98154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdebd668640 1 -- 172.21.15.55:0/2117608154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 msgr2=0x559a98154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:22.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdebd668640 1 --2- 172.21.15.55:0/2117608154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 0x559a98154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdebd668640 1 -- 172.21.15.55:0/2117608154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 msgr2=0x559a98154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:22.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdebd668640 1 --2- 172.21.15.55:0/2117608154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a98154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdebd668640 1 -- 172.21.15.55:0/2117608154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea4009830 con 0x559a98199050 2023-07-06T22:02:22.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdebd668640 1 --2- 172.21.15.55:0/2117608154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a9815a0e0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000cfd0 tx=0x7fdeb0051710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbae66491efcb83 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:22.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fde977fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T22:02:22.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fde977fe640 1 -- 172.21.15.55:0/2117608154 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0050cb0 con 0x559a98199050 2023-07-06T22:02:22.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fde977fe640 1 -- 172.21.15.55:0/2117608154 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdeb0050e10 con 0x559a98199050 2023-07-06T22:02:22.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 1 -- 172.21.15.55:0/2117608154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a97f64a20 con 0x559a98199050 2023-07-06T22:02:22.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fde977fe640 1 -- 172.21.15.55:0/2117608154 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdeb0050fd0 con 0x559a98199050 2023-07-06T22:02:22.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 10 client.9945 fetch_fsmap learned FSMap version 71 2023-07-06T22:02:22.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 1 -- 172.21.15.55:0/2117608154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x559a97f61d10 con 0x559a98199050 2023-07-06T22:02:22.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fde977fe640 1 -- 172.21.15.55:0/2117608154 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559a97f64a20 con 0x559a98199050 2023-07-06T22:02:22.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fde977fe640 1 -- 172.21.15.55:0/2117608154 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 71) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fdeb0057040 con 0x559a98199050 2023-07-06T22:02:22.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 10 client.9945 fetch_fsmap finished waiting for FSMap version 71 2023-07-06T22:02:22.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 10 client.9945 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T22:02:22.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 20 client.9945 populate_metadata read hostname 'smithi055' 2023-07-06T22:02:22.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 1 --2- 172.21.15.55:0/2117608154 >> [v2:172.21.15.55:6834/4021237791,v1:172.21.15.55:6836/4021237791] conn(0x559a981a77b0 0x559a981a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 4 client.9945 mds_command: new command op to 9759 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T22:02:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 1 -- 172.21.15.55:0/2117608154 --> [v2:172.21.15.55:6834/4021237791,v1:172.21.15.55:6836/4021237791] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a97fcc710 con 0x559a981a77b0 2023-07-06T22:02:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdebce67640 1 --2- 172.21.15.55:0/2117608154 >> [v2:172.21.15.55:6834/4021237791,v1:172.21.15.55:6836/4021237791] conn(0x559a981a77b0 0x559a981a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdebce67640 1 --2- 172.21.15.55:0/2117608154 >> [v2:172.21.15.55:6834/4021237791,v1:172.21.15.55:6836/4021237791] conn(0x559a981a77b0 0x559a981a9b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25e55158ccea7740 server_cookie=b2854dcdd15ebfb in_seq=0 out_seq=0 2023-07-06T22:02:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fde977fe640 10 client.9945 ms_handle_connect on v2:172.21.15.55:6834/4021237791 2023-07-06T22:02:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fde977fe640 1 -- 172.21.15.55:0/2117608154 <== mds.0 v2:172.21.15.55:6834/4021237791 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559a97fcc710 con 0x559a981a77b0 2023-07-06T22:02:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fde977fe640 10 client.9945 handle_command_reply: tid=0 2023-07-06T22:02:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.211+0000 7fdec240e000 1 client.9945 shutdown 2023-07-06T22:02:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.215+0000 7fdec240e000 1 -- 172.21.15.55:0/2117608154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 msgr2=0x559a9815a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.215+0000 7fdec240e000 1 --2- 172.21.15.55:0/2117608154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a9815a0e0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000cfd0 tx=0x7fdeb0051710 comp rx=0 tx=0).stop 2023-07-06T22:02:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.215+0000 7fdec240e000 1 -- 172.21.15.55:0/2117608154 shutdown_connections 2023-07-06T22:02:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.215+0000 7fdec240e000 1 --2- 172.21.15.55:0/2117608154 >> [v2:172.21.15.55:6834/4021237791,v1:172.21.15.55:6836/4021237791] conn(0x559a981a77b0 0x559a981a9b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.215+0000 7fdec240e000 1 --2- 172.21.15.55:0/2117608154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a9815a0e0 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.215+0000 7fdec240e000 1 --2- 172.21.15.55:0/2117608154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 0x559a98154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.215+0000 7fdec240e000 1 --2- 172.21.15.55:0/2117608154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a98154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.215+0000 7fde977fe640 0 client.9945 ms_handle_reset on v2:172.21.15.55:6834/4021237791 2023-07-06T22:02:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.215+0000 7fdec240e000 1 -- 172.21.15.55:0/2117608154 >> 172.21.15.55:0/2117608154 conn(0x559a98146800 msgr2=0x559a9814d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:22.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.215+0000 7fdec240e000 1 -- 172.21.15.55:0/2117608154 shutdown_connections 2023-07-06T22:02:22.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.215+0000 7fdec240e000 1 -- 172.21.15.55:0/2117608154 wait complete. 2023-07-06T22:02:22.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.215+0000 7fdec240e000 20 client.9945 trim_cache size 0 max 16384 2023-07-06T22:02:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.227+0000 7fdec240e000 1 Processor -- start 2023-07-06T22:02:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.227+0000 7fdec240e000 1 -- start start 2023-07-06T22:02:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a9814e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 0x559a98197740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a98197c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a97c5a940 con 0x559a98199050 2023-07-06T22:02:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a98151b20 con 0x559a9814ed80 2023-07-06T22:02:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a9805e510 con 0x559a98198740 2023-07-06T22:02:22.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdebd668640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a98197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdebd668640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a98197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44118/0 (socket says 172.21.15.55:44118) 2023-07-06T22:02:22.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdebd668640 1 -- 172.21.15.55:0/326245097 learned_addr learned my addr 172.21.15.55:0/326245097 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:22.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdebce67640 1 --2- 172.21.15.55:0/326245097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a9814e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdeb7fff640 1 --2- 172.21.15.55:0/326245097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 0x559a98197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdebd668640 1 -- 172.21.15.55:0/326245097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 msgr2=0x559a98197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:22.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdebd668640 1 --2- 172.21.15.55:0/326245097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 0x559a98197740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdebd668640 1 -- 172.21.15.55:0/326245097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 msgr2=0x559a9814e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:22.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdebd668640 1 --2- 172.21.15.55:0/326245097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a9814e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdebd668640 1 -- 172.21.15.55:0/326245097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a97f47fa0 con 0x559a98199050 2023-07-06T22:02:22.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdebce67640 1 --2- 172.21.15.55:0/326245097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a9814e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:22.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdeb7fff640 1 --2- 172.21.15.55:0/326245097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 0x559a98197740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:22.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdebd668640 1 --2- 172.21.15.55:0/326245097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a98197c80 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fdeb005cce0 tx=0x7fdeb0069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8bd6982f3d250d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:22.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdea2ffd640 1 -- 172.21.15.55:0/326245097 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb005d280 con 0x559a98199050 2023-07-06T22:02:22.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdea2ffd640 1 -- 172.21.15.55:0/326245097 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb0051200 con 0x559a98199050 2023-07-06T22:02:22.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdea2ffd640 1 -- 172.21.15.55:0/326245097 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0050eb0 con 0x559a98199050 2023-07-06T22:02:22.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 -- 172.21.15.55:0/326245097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 msgr2=0x559a98197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 --2- 172.21.15.55:0/326245097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a98197c80 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fdeb005cce0 tx=0x7fdeb0069000 comp rx=0 tx=0).stop 2023-07-06T22:02:22.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 -- 172.21.15.55:0/326245097 shutdown_connections 2023-07-06T22:02:22.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 --2- 172.21.15.55:0/326245097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98199050 0x559a98197c80 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 --2- 172.21.15.55:0/326245097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98198740 0x559a98197740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 --2- 172.21.15.55:0/326245097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a9814e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 -- 172.21.15.55:0/326245097 >> 172.21.15.55:0/326245097 conn(0x559a98146800 msgr2=0x559a98197030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:22.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 -- 172.21.15.55:0/326245097 shutdown_connections 2023-07-06T22:02:22.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 -- 172.21.15.55:0/326245097 wait complete. 2023-07-06T22:02:22.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 -- start start 2023-07-06T22:02:22.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.231+0000 7fdec240e000 1 Processor -- start 2023-07-06T22:02:22.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a981f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98198740 0x559a981f6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98199050 0x559a981aa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a97f5f540 con 0x559a98198740 2023-07-06T22:02:22.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a97f5c800 con 0x559a9814ed80 2023-07-06T22:02:22.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a98154d60 con 0x559a98199050 2023-07-06T22:02:22.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 10 client.0 _ll_register_callbacks cb 0x559a97f617f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T22:02:22.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdeb7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98198740 0x559a981f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdeb7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98198740 0x559a981f6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44132/0 (socket says 172.21.15.55:44132) 2023-07-06T22:02:22.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdeb7fff640 1 -- 172.21.15.55:0/2313229972 learned_addr learned my addr 172.21.15.55:0/2313229972 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:22.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdebce67640 1 --2- 172.21.15.55:0/2313229972 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a981f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdebd668640 1 --2- 172.21.15.55:0/2313229972 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98199050 0x559a981aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdeb7fff640 1 -- 172.21.15.55:0/2313229972 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98199050 msgr2=0x559a981aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:22.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdeb7fff640 1 --2- 172.21.15.55:0/2313229972 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98199050 0x559a981aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdeb7fff640 1 -- 172.21.15.55:0/2313229972 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 msgr2=0x559a981f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:22.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdeb7fff640 1 --2- 172.21.15.55:0/2313229972 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a981f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdeb7fff640 1 -- 172.21.15.55:0/2313229972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559a97f61d10 con 0x559a98198740 2023-07-06T22:02:22.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdebce67640 1 --2- 172.21.15.55:0/2313229972 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a981f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:22.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdeb7fff640 1 --2- 172.21.15.55:0/2313229972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98198740 0x559a981f6340 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x559a98005020 tx=0x7fdea4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b154479163002ff server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:22.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fde977fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T22:02:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fde977fe640 1 -- 172.21.15.55:0/2313229972 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea4023040 con 0x559a98198740 2023-07-06T22:02:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fde977fe640 1 -- 172.21.15.55:0/2313229972 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdea4004450 con 0x559a98198740 2023-07-06T22:02:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 -- 172.21.15.55:0/2313229972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a97f9bcd0 con 0x559a98198740 2023-07-06T22:02:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fde977fe640 1 -- 172.21.15.55:0/2313229972 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdea4006ad0 con 0x559a98198740 2023-07-06T22:02:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 10 client.9951 fetch_fsmap learned FSMap version 71 2023-07-06T22:02:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 -- 172.21.15.55:0/2313229972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x559a97c99cc0 con 0x559a98198740 2023-07-06T22:02:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fde977fe640 1 -- 172.21.15.55:0/2313229972 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559a97f9bcd0 con 0x559a98198740 2023-07-06T22:02:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fde977fe640 1 -- 172.21.15.55:0/2313229972 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 71) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fdea40323f0 con 0x559a98198740 2023-07-06T22:02:22.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 10 client.9951 fetch_fsmap finished waiting for FSMap version 71 2023-07-06T22:02:22.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 10 client.9951 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T22:02:22.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 20 client.9951 populate_metadata read hostname 'smithi055' 2023-07-06T22:02:22.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 --2- 172.21.15.55:0/2313229972 >> [v2:172.21.15.55:6834/4021237791,v1:172.21.15.55:6836/4021237791] conn(0x559a981aad10 0x559a981ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 4 client.9951 mds_command: new command op to 9759 tid=0[{"prefix": "status"}] 2023-07-06T22:02:22.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 -- 172.21.15.55:0/2313229972 --> [v2:172.21.15.55:6834/4021237791,v1:172.21.15.55:6836/4021237791] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559a97f96360 con 0x559a981aad10 2023-07-06T22:02:22.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdebce67640 1 --2- 172.21.15.55:0/2313229972 >> [v2:172.21.15.55:6834/4021237791,v1:172.21.15.55:6836/4021237791] conn(0x559a981aad10 0x559a981ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdebce67640 1 --2- 172.21.15.55:0/2313229972 >> [v2:172.21.15.55:6834/4021237791,v1:172.21.15.55:6836/4021237791] conn(0x559a981aad10 0x559a981ab0e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57ec554559f49760 server_cookie=d0f9841b96bda94b in_seq=0 out_seq=0 2023-07-06T22:02:22.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fde977fe640 10 client.9951 ms_handle_connect on v2:172.21.15.55:6834/4021237791 2023-07-06T22:02:22.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fde977fe640 1 -- 172.21.15.55:0/2313229972 <== mds.0 v2:172.21.15.55:6834/4021237791 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x559a97f96360 con 0x559a981aad10 2023-07-06T22:02:22.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fde977fe640 10 client.9951 handle_command_reply: tid=0 2023-07-06T22:02:22.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 client.9951 shutdown 2023-07-06T22:02:22.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 -- 172.21.15.55:0/2313229972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98198740 msgr2=0x559a981f6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 --2- 172.21.15.55:0/2313229972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98198740 0x559a981f6340 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x559a98005020 tx=0x7fdea4004740 comp rx=0 tx=0).stop 2023-07-06T22:02:22.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 -- 172.21.15.55:0/2313229972 shutdown_connections 2023-07-06T22:02:22.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 --2- 172.21.15.55:0/2313229972 >> [v2:172.21.15.55:6834/4021237791,v1:172.21.15.55:6836/4021237791] conn(0x559a981aad10 0x559a981ab0e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 --2- 172.21.15.55:0/2313229972 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x559a98199050 0x559a981aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 --2- 172.21.15.55:0/2313229972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559a98198740 0x559a981f6340 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 --2- 172.21.15.55:0/2313229972 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559a9814ed80 0x559a981f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fde977fe640 0 client.9951 ms_handle_reset on v2:172.21.15.55:6834/4021237791 2023-07-06T22:02:22.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.235+0000 7fdec240e000 1 -- 172.21.15.55:0/2313229972 >> 172.21.15.55:0/2313229972 conn(0x559a98146800 msgr2=0x559a98154650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:22.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdec240e000 1 -- 172.21.15.55:0/2313229972 shutdown_connections 2023-07-06T22:02:22.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdec240e000 1 -- 172.21.15.55:0/2313229972 wait complete. 2023-07-06T22:02:22.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdec240e000 20 client.9951 trim_cache size 0 max 16384 2023-07-06T22:02:22.245 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:02:22.245 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c64f3ef1-e769-47b3-ae15-a714e4e7c4f7", 2023-07-06T22:02:22.245 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-07-06T22:02:22.246 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 9759, 2023-07-06T22:02:22.246 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-07-06T22:02:22.246 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-07-06T22:02:22.246 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-07-06T22:02:22.246 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.483213707999999, 2023-07-06T22:02:22.246 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 71, 2023-07-06T22:02:22.246 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 160, 2023-07-06T22:02:22.246 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 160, 2023-07-06T22:02:22.247 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 15.804153974 2023-07-06T22:02:22.247 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:02:22.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdebf0cb640 1 -- 172.21.15.55:0/2908889653 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fde9c0663a0 msgr2=0x7fde9c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdebf0cb640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fde9c0663a0 0x7fde9c068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0af000 tx=0x7fdeac0a7000 comp rx=0 tx=0).stop 2023-07-06T22:02:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdebf0cb640 1 -- 172.21.15.55:0/2908889653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeb815ba30 msgr2=0x7fdeb80b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdebf0cb640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeb815ba30 0x7fdeb80b1c60 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000caa0 tx=0x7fdeb000cf60 comp rx=0 tx=0).stop 2023-07-06T22:02:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdebf0cb640 1 -- 172.21.15.55:0/2908889653 shutdown_connections 2023-07-06T22:02:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdebf0cb640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdeb815ba30 0x7fdeb80b1c60 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdebf0cb640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdeb80ad0c0 0x7fdeb80c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdebf0cb640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fde9c0663a0 0x7fde9c068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdebf0cb640 1 --2- 172.21.15.55:0/2908889653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdeb809d340 0x7fdeb8154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdebf0cb640 1 -- 172.21.15.55:0/2908889653 >> 172.21.15.55:0/2908889653 conn(0x7fdeb80cea70 msgr2=0x7fdeb80c9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:22.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdebf0cb640 1 -- 172.21.15.55:0/2908889653 shutdown_connections 2023-07-06T22:02:22.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.239+0000 7fdebf0cb640 1 -- 172.21.15.55:0/2908889653 wait complete. 2023-07-06T22:02:22.256 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T22:02:22.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.399+0000 7f648ec93640 1 Processor -- start 2023-07-06T22:02:22.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.399+0000 7f648ec93640 1 -- start start 2023-07-06T22:02:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.399+0000 7f648ec93640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f64880712f0 0x7f648806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.399+0000 7f648ec93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64880b3730 0x7f64880c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.399+0000 7f648ec93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64880ca6a0 con 0x7f64880ca280 2023-07-06T22:02:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.399+0000 7f648ec93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6488159cd0 con 0x7f64880b3730 2023-07-06T22:02:22.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.399+0000 7f648ec93640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64880693f0 con 0x7f64880712f0 2023-07-06T22:02:22.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.403+0000 7f6487fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64880b3730 0x7f64880c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.403+0000 7f648d230640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f64880ca280 0x7f64880c8520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50216/0 (socket says 172.21.15.55:50216) 2023-07-06T22:02:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.403+0000 7f648d230640 1 -- 172.21.15.55:0/3166845810 learned_addr learned my addr 172.21.15.55:0/3166845810 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.403+0000 7f648ca2f640 1 --2- 172.21.15.55:0/3166845810 >> v2:172.21.15.138:3300/0 conn(0x7f64880712f0 0x7f648806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.403+0000 7f6487fff640 1 -- 172.21.15.55:0/3166845810 >> v2:172.21.15.138:3300/0 conn(0x7f64880712f0 msgr2=0x7f648806a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.403+0000 7f6487fff640 1 --2- 172.21.15.55:0/3166845810 >> v2:172.21.15.138:3300/0 conn(0x7f64880712f0 0x7f648806a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.403+0000 7f6487fff640 1 -- 172.21.15.55:0/3166845810 >> v1:172.21.15.55:6789/0 conn(0x7f64880ca280 legacy=0x7f64880c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.403+0000 7f6487fff640 1 -- 172.21.15.55:0/3166845810 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648806aca0 con 0x7f64880b3730 2023-07-06T22:02:22.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.403+0000 7f64877fe640 1 -- 172.21.15.55:0/3166845810 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165727539 0 0) 0x7f64880ca6a0 con 0x7f64880ca280 2023-07-06T22:02:22.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.403+0000 7f6487fff640 1 --2- 172.21.15.55:0/3166845810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64880b3730 0x7f64880c9d40 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f6488071950 tx=0x7f647401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabefee6b7a9b71d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:22.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.403+0000 7f64877fe640 1 -- 172.21.15.55:0/3166845810 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474004230 con 0x7f64880b3730 2023-07-06T22:02:22.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.403+0000 7f64877fe640 1 -- 172.21.15.55:0/3166845810 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64740a7050 con 0x7f64880b3730 2023-07-06T22:02:22.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.403+0000 7f64877fe640 1 -- 172.21.15.55:0/3166845810 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474003620 con 0x7f64880b3730 2023-07-06T22:02:22.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 -- 172.21.15.55:0/3166845810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64880b3730 msgr2=0x7f64880c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 --2- 172.21.15.55:0/3166845810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64880b3730 0x7f64880c9d40 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f6488071950 tx=0x7f647401c430 comp rx=0 tx=0).stop 2023-07-06T22:02:22.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 -- 172.21.15.55:0/3166845810 shutdown_connections 2023-07-06T22:02:22.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 --2- 172.21.15.55:0/3166845810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64880b3730 0x7f64880c9d40 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 --2- 172.21.15.55:0/3166845810 >> v2:172.21.15.138:3300/0 conn(0x7f64880712f0 0x7f648806a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 -- 172.21.15.55:0/3166845810 >> 172.21.15.55:0/3166845810 conn(0x7f64880cded0 msgr2=0x7f64880ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:22.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 -- 172.21.15.55:0/3166845810 shutdown_connections 2023-07-06T22:02:22.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 -- 172.21.15.55:0/3166845810 wait complete. 2023-07-06T22:02:22.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 Processor -- start 2023-07-06T22:02:22.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 -- start start 2023-07-06T22:02:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64880712f0 0x7f6488155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64880b3730 0x7f64880ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64880ca280 0x7f64880aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64880b0e50 con 0x7f64880712f0 2023-07-06T22:02:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64880b10f0 con 0x7f64880b3730 2023-07-06T22:02:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ec93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64880b13d0 con 0x7f64880ca280 2023-07-06T22:02:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ca2f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64880712f0 0x7f6488155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ca2f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64880712f0 0x7f6488155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44140/0 (socket says 172.21.15.55:44140) 2023-07-06T22:02:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ca2f640 1 -- 172.21.15.55:0/205794076 learned_addr learned my addr 172.21.15.55:0/205794076 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:22.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648d230640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64880ca280 0x7f64880aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f6487fff640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64880b3730 0x7f64880ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ca2f640 1 -- 172.21.15.55:0/205794076 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64880ca280 msgr2=0x7f64880aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ca2f640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64880ca280 0x7f64880aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ca2f640 1 -- 172.21.15.55:0/205794076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64880b3730 msgr2=0x7f64880ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ca2f640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64880b3730 0x7f64880ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.407+0000 7f648ca2f640 1 -- 172.21.15.55:0/205794076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474009420 con 0x7f64880712f0 2023-07-06T22:02:22.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.411+0000 7f6487fff640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64880b3730 0x7f64880ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:22.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.411+0000 7f648ca2f640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64880712f0 0x7f6488155560 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f647c00d5f0 tx=0x7f647c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:22.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.411+0000 7f64857fa640 1 -- 172.21.15.55:0/205794076 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c0125f0 con 0x7f64880712f0 2023-07-06T22:02:22.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.411+0000 7f64857fa640 1 -- 172.21.15.55:0/205794076 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647c012750 con 0x7f64880712f0 2023-07-06T22:02:22.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.411+0000 7f64857fa640 1 -- 172.21.15.55:0/205794076 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c012ae0 con 0x7f64880712f0 2023-07-06T22:02:22.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.411+0000 7f648ec93640 1 -- 172.21.15.55:0/205794076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64880b16b0 con 0x7f64880712f0 2023-07-06T22:02:22.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.411+0000 7f648ec93640 1 -- 172.21.15.55:0/205794076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6488155aa0 con 0x7f64880712f0 2023-07-06T22:02:22.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.411+0000 7f648ec93640 1 -- 172.21.15.55:0/205794076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6488066d60 con 0x7f64880712f0 2023-07-06T22:02:22.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.411+0000 7f64857fa640 1 -- 172.21.15.55:0/205794076 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f647c012c40 con 0x7f64880712f0 2023-07-06T22:02:22.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.411+0000 7f64857fa640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f646c0663a0 0x7f646c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:22.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.411+0000 7f64857fa640 1 -- 172.21.15.55:0/205794076 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f647c0844e0 con 0x7f64880712f0 2023-07-06T22:02:22.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.411+0000 7f6487fff640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f646c0663a0 0x7f646c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:22.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.415+0000 7f6487fff640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f646c0663a0 0x7f646c068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f64740ad000 tx=0x7f64740a6000 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.415+0000 7f64857fa640 1 -- 172.21.15.55:0/205794076 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f647c0516e0 con 0x7f64880712f0 2023-07-06T22:02:22.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.607+0000 7f648ec93640 1 -- 172.21.15.55:0/205794076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f64880b1b60 con 0x7f64880712f0 2023-07-06T22:02:22.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.607+0000 7f64857fa640 1 -- 172.21.15.55:0/205794076 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v71) v1 ==== 53+0+73 (secure 0 0 0) 0x7f647c007380 con 0x7f64880712f0 2023-07-06T22:02:22.605 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T22:02:22.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.607+0000 7f648ec93640 1 -- 172.21.15.55:0/205794076 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f646c0663a0 msgr2=0x7f646c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.607+0000 7f648ec93640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f646c0663a0 0x7f646c068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f64740ad000 tx=0x7f64740a6000 comp rx=0 tx=0).stop 2023-07-06T22:02:22.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.607+0000 7f648ec93640 1 -- 172.21.15.55:0/205794076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64880712f0 msgr2=0x7f6488155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:22.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.607+0000 7f648ec93640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64880712f0 0x7f6488155560 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f647c00d5f0 tx=0x7f647c00dab0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.607+0000 7f648ec93640 1 -- 172.21.15.55:0/205794076 shutdown_connections 2023-07-06T22:02:22.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.607+0000 7f648ec93640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64880ca280 0x7f64880aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.607+0000 7f648ec93640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f646c0663a0 0x7f646c068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.607+0000 7f648ec93640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64880b3730 0x7f64880ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.607+0000 7f648ec93640 1 --2- 172.21.15.55:0/205794076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64880712f0 0x7f6488155560 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:22.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.607+0000 7f648ec93640 1 -- 172.21.15.55:0/205794076 >> 172.21.15.55:0/205794076 conn(0x7f64880cded0 msgr2=0x7f6488159440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:22.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.607+0000 7f648ec93640 1 -- 172.21.15.55:0/205794076 shutdown_connections 2023-07-06T22:02:22.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:22.607+0000 7f648ec93640 1 -- 172.21.15.55:0/205794076 wait complete. 2023-07-06T22:02:22.626 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T22:02:22.626 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T22:02:22.626 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-07-06T22:02:22.627 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T22:02:22.627 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T22:02:22.627 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T22:02:22.628 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-06T22:02:22.628 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T22:02:22.628 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:02:22.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:02:22.629 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-07-06T22:02:22.638 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T22:02:22.638 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T22:02:22.638 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T22:02:22.638 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:02:22.639 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T22:02:22.639 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:02:22.639 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:02:22.639 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:02:22.639 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-07-06T22:02:22.639 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:02:22.639 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:02:22.640 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-07-06T22:02:22.640 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T22:02:22.640 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:02:22.640 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-07-06T22:02:22.640 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-06T22:02:22.640 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41214sec preferred_lft 41214sec 2023-07-06T22:02:22.641 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-07-06T22:02:22.641 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:02:22.641 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:02:22.641 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:02:22.641 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-07-06T22:02:22.641 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T22:02:22.641 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:84:fe:b8:21 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:02:22.642 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T22:02:22.642 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:02:22.642 INFO:teuthology.orchestra.run.smithi055.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T22:02:22.642 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-06T22:02:22.642 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T22:02:22.642 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:02:22.642 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-06T22:02:22.643 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:02:22.643 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T22:02:22.643 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T22:02:22.643 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-06T22:02:22.643 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:02:22.643 INFO:teuthology.orchestra.run.smithi055.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T22:02:22.643 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T22:02:22.643 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-06T22:02:22.644 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:02:22.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:02:22.645 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T22:02:22.707 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-07-06T22:02:22.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:02:22.710 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-07-06T22:02:22.765 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-07-06T22:02:22.766 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T22:02:22.766 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-06T22:02:22.766 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T22:02:22.766 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-06T22:02:22.766 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T22:02:22.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:02:22.767 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T22:02:22.767 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T22:02:22.768 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T22:02:22.768 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T22:02:22.768 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T22:02:22.768 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T22:02:22.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:02:22.861 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T22:02:22.870 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T22:02:22.871 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T22:02:22.871 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:02:22.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:02:22.872 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-07-06T22:02:22.938 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T22:02:22.938 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T22:02:22.988 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:02:22.989 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T22:02:22.989 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T22:02:23.039 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-06T22:02:23.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:02:23.040 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:02:23.130 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:02:23.131 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T22:02:23.143 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:02:23.143 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T22:02:23.143 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-07-06T22:02:23.143 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.cephfs=/ 2023-07-06T22:02:23.143 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-07-06T22:02:23.146 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T22:02:23.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:02:23.147 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T22:02:23.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:02:23.168 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T22:02:23.224 INFO:teuthology.orchestra.run.smithi055.stdout:client9963 2023-07-06T22:02:23.224 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:02:23.224 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:02:23.276 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-06T22:02:23.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f5648848640 1 Processor -- start 2023-07-06T22:02:23.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f5648848640 1 -- start start 2023-07-06T22:02:23.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f5648848640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f56440cc6e0 0x7f56440b3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:23.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f5648848640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56440b3e50 0x7f56440d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:23.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f5648848640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56440b2490 con 0x7f56440b76c0 2023-07-06T22:02:23.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f5648848640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56440ce9d0 con 0x7f56440b3e50 2023-07-06T22:02:23.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f5648848640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56440b4240 con 0x7f56440cc6e0 2023-07-06T22:02:23.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f5642d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56440b3e50 0x7f56440d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:23.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f5642d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56440b3e50 0x7f56440d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34046/0 (socket says 172.21.15.55:34046) 2023-07-06T22:02:23.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f5642d9d640 1 -- 172.21.15.55:0/3354239559 learned_addr learned my addr 172.21.15.55:0/3354239559 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:23.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f563bfff640 1 --2- 172.21.15.55:0/3354239559 >> v2:172.21.15.138:3300/0 conn(0x7f56440cc6e0 0x7f56440b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:23.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f5642d9d640 1 -- 172.21.15.55:0/3354239559 >> v2:172.21.15.138:3300/0 conn(0x7f56440cc6e0 msgr2=0x7f56440b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:23.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f5642d9d640 1 --2- 172.21.15.55:0/3354239559 >> v2:172.21.15.138:3300/0 conn(0x7f56440cc6e0 0x7f56440b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f5642d9d640 1 -- 172.21.15.55:0/3354239559 >> v1:172.21.15.138:6789/0 conn(0x7f56440b76c0 legacy=0x7f56440ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:23.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f5642d9d640 1 -- 172.21.15.55:0/3354239559 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440ccbe0 con 0x7f56440b3e50 2023-07-06T22:02:23.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.462+0000 7f563bfff640 1 --2- 172.21.15.55:0/3354239559 >> v2:172.21.15.138:3300/0 conn(0x7f56440cc6e0 0x7f56440b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:23.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.466+0000 7f5642d9d640 1 --2- 172.21.15.55:0/3354239559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56440b3e50 0x7f56440d0020 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f56440b8270 tx=0x7f563c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a457a51d5ad64725 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:23.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.466+0000 7f5641d9b640 1 -- 172.21.15.55:0/3354239559 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c0a5800 con 0x7f56440b3e50 2023-07-06T22:02:23.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.466+0000 7f5641d9b640 1 -- 172.21.15.55:0/3354239559 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c0a5960 con 0x7f56440b3e50 2023-07-06T22:02:23.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.466+0000 7f5641d9b640 1 -- 172.21.15.55:0/3354239559 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c0a5cf0 con 0x7f56440b3e50 2023-07-06T22:02:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.466+0000 7f5648848640 1 -- 172.21.15.55:0/3354239559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56440b3e50 msgr2=0x7f56440d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.466+0000 7f5648848640 1 --2- 172.21.15.55:0/3354239559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56440b3e50 0x7f56440d0020 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f56440b8270 tx=0x7f563c01c940 comp rx=0 tx=0).stop 2023-07-06T22:02:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.466+0000 7f5648848640 1 -- 172.21.15.55:0/3354239559 shutdown_connections 2023-07-06T22:02:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.466+0000 7f5648848640 1 --2- 172.21.15.55:0/3354239559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56440b3e50 0x7f56440d0020 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.466+0000 7f5648848640 1 --2- 172.21.15.55:0/3354239559 >> v2:172.21.15.138:3300/0 conn(0x7f56440cc6e0 0x7f56440b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.466+0000 7f5648848640 1 -- 172.21.15.55:0/3354239559 >> 172.21.15.55:0/3354239559 conn(0x7f56440d2120 msgr2=0x7f56440d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.466+0000 7f5648848640 1 -- 172.21.15.55:0/3354239559 shutdown_connections 2023-07-06T22:02:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.466+0000 7f5648848640 1 -- 172.21.15.55:0/3354239559 wait complete. 2023-07-06T22:02:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f5648848640 1 Processor -- start 2023-07-06T22:02:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f5648848640 1 -- start start 2023-07-06T22:02:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f5648848640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56440b3e50 0x7f56440cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f5648848640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56440b76c0 0x7f564415a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f5648848640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56440cc6e0 0x7f564415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:23.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f5648848640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440b5610 con 0x7f56440b3e50 2023-07-06T22:02:23.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f5648848640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440b5860 con 0x7f56440b76c0 2023-07-06T22:02:23.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f5648848640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56440b5b40 con 0x7f56440cc6e0 2023-07-06T22:02:23.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f564259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56440b3e50 0x7f56440cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:23.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f564259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56440b3e50 0x7f56440cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34056/0 (socket says 172.21.15.55:34056) 2023-07-06T22:02:23.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f564259c640 1 -- 172.21.15.55:0/3168685625 learned_addr learned my addr 172.21.15.55:0/3168685625 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:23.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f563bfff640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56440b76c0 0x7f564415a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:23.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f5642d9d640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56440cc6e0 0x7f564415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:23.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f564259c640 1 -- 172.21.15.55:0/3168685625 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56440cc6e0 msgr2=0x7f564415ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:23.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f564259c640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56440cc6e0 0x7f564415ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f564259c640 1 -- 172.21.15.55:0/3168685625 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56440b76c0 msgr2=0x7f564415a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:23.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f564259c640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56440b76c0 0x7f564415a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f564259c640 1 -- 172.21.15.55:0/3168685625 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c009b30 con 0x7f56440b3e50 2023-07-06T22:02:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f5642d9d640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56440cc6e0 0x7f564415ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:02:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f564259c640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56440b3e50 0x7f56440cb8d0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f563400c500 tx=0x7f563400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f563affd640 1 -- 172.21.15.55:0/3168685625 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634005220 con 0x7f56440b3e50 2023-07-06T22:02:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f563affd640 1 -- 172.21.15.55:0/3168685625 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5634005380 con 0x7f56440b3e50 2023-07-06T22:02:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f5648848640 1 -- 172.21.15.55:0/3168685625 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56440b5e20 con 0x7f56440b3e50 2023-07-06T22:02:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.470+0000 7f563affd640 1 -- 172.21.15.55:0/3168685625 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634007270 con 0x7f56440b3e50 2023-07-06T22:02:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.474+0000 7f5648848640 1 -- 172.21.15.55:0/3168685625 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56440b63e0 con 0x7f56440b3e50 2023-07-06T22:02:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.474+0000 7f5648848640 1 -- 172.21.15.55:0/3168685625 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564404d790 con 0x7f56440b3e50 2023-07-06T22:02:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.474+0000 7f563affd640 1 -- 172.21.15.55:0/3168685625 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f56340073d0 con 0x7f56440b3e50 2023-07-06T22:02:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.474+0000 7f563affd640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f56240663a0 0x7f5624068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:23.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.474+0000 7f563affd640 1 -- 172.21.15.55:0/3168685625 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f5634083960 con 0x7f56440b3e50 2023-07-06T22:02:23.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.474+0000 7f563bfff640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f56240663a0 0x7f5624068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:23.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.474+0000 7f563bfff640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f56240663a0 0x7f5624068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f56441f7150 tx=0x7f562c008040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:23.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.478+0000 7f563affd640 1 -- 172.21.15.55:0/3168685625 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5634050b60 con 0x7f56440b3e50 2023-07-06T22:02:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.654+0000 7f5648848640 1 -- 172.21.15.55:0/3168685625 --> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f56440d0d70 con 0x7f56240663a0 2023-07-06T22:02:23.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.654+0000 7f563affd640 1 -- 172.21.15.55:0/3168685625 <== mgr.9489 v2:172.21.15.55:6832/433956277 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f562c00b520 con 0x7f56240663a0 2023-07-06T22:02:23.656 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T22:02:23.656 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:02:23.656 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-07-06T22:02:23.657 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:02:23.657 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T22:02:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.658+0000 7f5648848640 1 -- 172.21.15.55:0/3168685625 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f56240663a0 msgr2=0x7f5624068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.658+0000 7f5648848640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f56240663a0 0x7f5624068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f56441f7150 tx=0x7f562c008040 comp rx=0 tx=0).stop 2023-07-06T22:02:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.658+0000 7f5648848640 1 -- 172.21.15.55:0/3168685625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56440b3e50 msgr2=0x7f56440cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.658+0000 7f5648848640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56440b3e50 0x7f56440cb8d0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f563400c500 tx=0x7f563400c9c0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.658+0000 7f5648848640 1 -- 172.21.15.55:0/3168685625 shutdown_connections 2023-07-06T22:02:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.658+0000 7f5648848640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56440cc6e0 0x7f564415ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.658+0000 7f5648848640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f56240663a0 0x7f5624068850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.658+0000 7f5648848640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56440b76c0 0x7f564415a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.658+0000 7f5648848640 1 --2- 172.21.15.55:0/3168685625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56440b3e50 0x7f56440cb8d0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.658+0000 7f5648848640 1 -- 172.21.15.55:0/3168685625 >> 172.21.15.55:0/3168685625 conn(0x7f56440d2120 msgr2=0x7f5644165ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.658+0000 7f5648848640 1 -- 172.21.15.55:0/3168685625 shutdown_connections 2023-07-06T22:02:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.658+0000 7f5648848640 1 -- 172.21.15.55:0/3168685625 wait complete. 2023-07-06T22:02:23.677 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-06T22:02:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f504887b640 1 Processor -- start 2023-07-06T22:02:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f504887b640 1 -- start start 2023-07-06T22:02:23.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f504887b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f50440b7b90 0x7f50440d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:23.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f504887b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f50440b4300 0x7f50440b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:23.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f504887b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50440b5070 con 0x7f50440cc870 2023-07-06T22:02:23.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f504887b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5044160020 con 0x7f50440b7b90 2023-07-06T22:02:23.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f504887b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50441604b0 con 0x7f50440b4300 2023-07-06T22:02:23.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f504259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f50440b7b90 0x7f50440d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:23.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f504259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f50440b7b90 0x7f50440d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34070/0 (socket says 172.21.15.55:34070) 2023-07-06T22:02:23.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f504259c640 1 -- 172.21.15.55:0/3346599285 learned_addr learned my addr 172.21.15.55:0/3346599285 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:23.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f5042d9d640 1 --2- 172.21.15.55:0/3346599285 >> v2:172.21.15.138:3300/0 conn(0x7f50440b4300 0x7f50440b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:23.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f504259c640 1 -- 172.21.15.55:0/3346599285 >> v2:172.21.15.138:3300/0 conn(0x7f50440b4300 msgr2=0x7f50440b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:23.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f504259c640 1 --2- 172.21.15.55:0/3346599285 >> v2:172.21.15.138:3300/0 conn(0x7f50440b4300 0x7f50440b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f504259c640 1 -- 172.21.15.55:0/3346599285 >> v1:172.21.15.138:6789/0 conn(0x7f50440cc870 legacy=0x7f50440b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:23.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.822+0000 7f504259c640 1 -- 172.21.15.55:0/3346599285 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50440cd030 con 0x7f50440b7b90 2023-07-06T22:02:23.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.826+0000 7f504259c640 1 --2- 172.21.15.55:0/3346599285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50440b7b90 0x7f50440d1c40 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f504406c6a0 tx=0x7f503401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29b7c8c31b16f75 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:23.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.826+0000 7f504159a640 1 -- 172.21.15.55:0/3346599285 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340aa5f0 con 0x7f50440b7b90 2023-07-06T22:02:23.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.826+0000 7f504159a640 1 -- 172.21.15.55:0/3346599285 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50340aa750 con 0x7f50440b7b90 2023-07-06T22:02:23.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.826+0000 7f504159a640 1 -- 172.21.15.55:0/3346599285 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340aaae0 con 0x7f50440b7b90 2023-07-06T22:02:23.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.826+0000 7f504887b640 1 -- 172.21.15.55:0/3346599285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50440b7b90 msgr2=0x7f50440d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:23.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.826+0000 7f504887b640 1 --2- 172.21.15.55:0/3346599285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50440b7b90 0x7f50440d1c40 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f504406c6a0 tx=0x7f503401c490 comp rx=0 tx=0).stop 2023-07-06T22:02:23.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.826+0000 7f504887b640 1 -- 172.21.15.55:0/3346599285 shutdown_connections 2023-07-06T22:02:23.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.826+0000 7f504887b640 1 --2- 172.21.15.55:0/3346599285 >> v2:172.21.15.138:3300/0 conn(0x7f50440b4300 0x7f50440b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.826+0000 7f504887b640 1 --2- 172.21.15.55:0/3346599285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50440b7b90 0x7f50440d1c40 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.826+0000 7f504887b640 1 -- 172.21.15.55:0/3346599285 >> 172.21.15.55:0/3346599285 conn(0x7f50440ceca0 msgr2=0x7f50440cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:23.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.826+0000 7f504887b640 1 -- 172.21.15.55:0/3346599285 shutdown_connections 2023-07-06T22:02:23.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.826+0000 7f504887b640 1 -- 172.21.15.55:0/3346599285 wait complete. 2023-07-06T22:02:23.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504887b640 1 Processor -- start 2023-07-06T22:02:23.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504887b640 1 -- start start 2023-07-06T22:02:23.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504887b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50440b4300 0x7f50440c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:23.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504887b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50440b7b90 0x7f50441f7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:23.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504887b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50440cc870 0x7f50440d0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:23.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504887b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50440c9870 con 0x7f50440b4300 2023-07-06T22:02:23.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504887b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50441f80a0 con 0x7f50440b7b90 2023-07-06T22:02:23.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504887b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50441f7ae0 con 0x7f50440cc870 2023-07-06T22:02:23.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50440b4300 0x7f50440c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:23.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50440b4300 0x7f50440c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34082/0 (socket says 172.21.15.55:34082) 2023-07-06T22:02:23.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504259c640 1 -- 172.21.15.55:0/1049866511 learned_addr learned my addr 172.21.15.55:0/1049866511 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:23.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f5042d9d640 1 --2- 172.21.15.55:0/1049866511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50440cc870 0x7f50440d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:23.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f5041d9b640 1 --2- 172.21.15.55:0/1049866511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50440b7b90 0x7f50441f7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:23.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504259c640 1 -- 172.21.15.55:0/1049866511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50440cc870 msgr2=0x7f50440d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:23.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504259c640 1 --2- 172.21.15.55:0/1049866511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50440cc870 0x7f50440d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504259c640 1 -- 172.21.15.55:0/1049866511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50440b7b90 msgr2=0x7f50441f7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:23.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504259c640 1 --2- 172.21.15.55:0/1049866511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50440b7b90 0x7f50441f7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:23.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504259c640 1 -- 172.21.15.55:0/1049866511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340094d0 con 0x7f50440b4300 2023-07-06T22:02:23.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.830+0000 7f504259c640 1 --2- 172.21.15.55:0/1049866511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50440b4300 0x7f50440c9c90 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f503401a0c0 tx=0x7f503401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:23.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.834+0000 7f5032ffd640 1 -- 172.21.15.55:0/1049866511 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340aa5f0 con 0x7f50440b4300 2023-07-06T22:02:23.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.834+0000 7f5032ffd640 1 -- 172.21.15.55:0/1049866511 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50340b3800 con 0x7f50440b4300 2023-07-06T22:02:23.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.834+0000 7f5032ffd640 1 -- 172.21.15.55:0/1049866511 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340b3b90 con 0x7f50440b4300 2023-07-06T22:02:23.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.834+0000 7f504887b640 1 -- 172.21.15.55:0/1049866511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50441f7dc0 con 0x7f50440b4300 2023-07-06T22:02:23.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.834+0000 7f504887b640 1 -- 172.21.15.55:0/1049866511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50440ca1d0 con 0x7f50440b4300 2023-07-06T22:02:23.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.834+0000 7f504887b640 1 -- 172.21.15.55:0/1049866511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50440cccd0 con 0x7f50440b4300 2023-07-06T22:02:23.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.834+0000 7f5032ffd640 1 -- 172.21.15.55:0/1049866511 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f50340b3cf0 con 0x7f50440b4300 2023-07-06T22:02:23.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.834+0000 7f5032ffd640 1 --2- 172.21.15.55:0/1049866511 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f50240663a0 0x7f5024068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:23.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.834+0000 7f5032ffd640 1 -- 172.21.15.55:0/1049866511 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f50340a7070 con 0x7f50440b4300 2023-07-06T22:02:23.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.834+0000 7f5041d9b640 1 --2- 172.21.15.55:0/1049866511 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f50240663a0 0x7f5024068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:23.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.838+0000 7f5041d9b640 1 --2- 172.21.15.55:0/1049866511 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f50240663a0 0x7f5024068850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f504415edc0 tx=0x7f5038008040 comp rx=0 tx=0).ready entity=mgr.9489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:23.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:23.838+0000 7f5032ffd640 1 -- 172.21.15.55:0/1049866511 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50440cccd0 con 0x7f50440b4300 2023-07-06T22:02:24.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.038+0000 7f504887b640 1 -- 172.21.15.55:0/1049866511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f50440cccd0 con 0x7f50440b4300 2023-07-06T22:02:24.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.946+0000 7f5032ffd640 1 -- 172.21.15.55:0/1049866511 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 79) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f50340ec0c0 con 0x7f50440b4300 2023-07-06T22:02:24.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.950+0000 7f5032ffd640 1 -- 172.21.15.55:0/1049866511 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v79) v1 ==== 92+0+0 (secure 0 0 0) 0x7f50341035b0 con 0x7f50440b4300 2023-07-06T22:02:24.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.950+0000 7f504887b640 1 -- 172.21.15.55:0/1049866511 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f50240663a0 msgr2=0x7f5024068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:24.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.950+0000 7f504887b640 1 --2- 172.21.15.55:0/1049866511 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f50240663a0 0x7f5024068850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f504415edc0 tx=0x7f5038008040 comp rx=0 tx=0).stop 2023-07-06T22:02:24.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.950+0000 7f504887b640 1 -- 172.21.15.55:0/1049866511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50440b4300 msgr2=0x7f50440c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:24.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.950+0000 7f504887b640 1 --2- 172.21.15.55:0/1049866511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50440b4300 0x7f50440c9c90 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f503401a0c0 tx=0x7f503401acd0 comp rx=0 tx=0).stop 2023-07-06T22:02:24.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.950+0000 7f504887b640 1 -- 172.21.15.55:0/1049866511 shutdown_connections 2023-07-06T22:02:24.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.950+0000 7f504887b640 1 --2- 172.21.15.55:0/1049866511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50440cc870 0x7f50440d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:24.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.950+0000 7f504887b640 1 --2- 172.21.15.55:0/1049866511 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f50240663a0 0x7f5024068850 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:24.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.950+0000 7f504887b640 1 --2- 172.21.15.55:0/1049866511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50440b7b90 0x7f50441f7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:24.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.950+0000 7f504887b640 1 --2- 172.21.15.55:0/1049866511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50440b4300 0x7f50440c9c90 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:24.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.950+0000 7f504887b640 1 -- 172.21.15.55:0/1049866511 >> 172.21.15.55:0/1049866511 conn(0x7f50440ceca0 msgr2=0x7f50440d0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:24.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.950+0000 7f504887b640 1 -- 172.21.15.55:0/1049866511 shutdown_connections 2023-07-06T22:02:24.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:24.950+0000 7f504887b640 1 -- 172.21.15.55:0/1049866511 wait complete. 2023-07-06T22:02:24.976 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-06T22:02:25.118 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:25.118+0000 7fe9e7446180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:02:25.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dcfed8640 1 Processor -- start 2023-07-06T22:02:25.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dcfed8640 1 -- start start 2023-07-06T22:02:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dcfed8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3dc80b3870 0x7f3dc80b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dcfed8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3dc80d03c0 0x7f3dc80d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dcfed8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc80b4210 con 0x7f3dc815b850 2023-07-06T22:02:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dcfed8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc80b2b80 con 0x7f3dc80b3870 2023-07-06T22:02:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dcfed8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc80cff30 con 0x7f3dc80d03c0 2023-07-06T22:02:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dcd473640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3dc80b3870 0x7f3dc80b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dcd473640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3dc80b3870 0x7f3dc80b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34114/0 (socket says 172.21.15.55:34114) 2023-07-06T22:02:25.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dcd473640 1 -- 172.21.15.55:0/716841039 learned_addr learned my addr 172.21.15.55:0/716841039 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:25.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dce475640 1 --2- 172.21.15.55:0/716841039 >> v2:172.21.15.138:3300/0 conn(0x7f3dc80d03c0 0x7f3dc80d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dcd473640 1 -- 172.21.15.55:0/716841039 >> v2:172.21.15.138:3300/0 conn(0x7f3dc80d03c0 msgr2=0x7f3dc80d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dcd473640 1 --2- 172.21.15.55:0/716841039 >> v2:172.21.15.138:3300/0 conn(0x7f3dc80d03c0 0x7f3dc80d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dcd473640 1 -- 172.21.15.55:0/716841039 >> v1:172.21.15.138:6789/0 conn(0x7f3dc815b850 legacy=0x7f3dc80cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dcd473640 1 -- 172.21.15.55:0/716841039 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc80b22e0 con 0x7f3dc80b3870 2023-07-06T22:02:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.130+0000 7f3dccc72640 1 -- 172.21.15.55:0/716841039 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780138225 0 0) 0x7f3dc80b4210 con 0x7f3dc815b850 2023-07-06T22:02:25.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.134+0000 7f3dcd473640 1 --2- 172.21.15.55:0/716841039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc80b3870 0x7f3dc80b3cd0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80cc780 tx=0x7f3db801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7d9c84c3680ecb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:25.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.134+0000 7f3dccc72640 1 -- 172.21.15.55:0/716841039 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db80ac410 con 0x7f3dc80b3870 2023-07-06T22:02:25.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.134+0000 7f3dccc72640 1 -- 172.21.15.55:0/716841039 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db80ac570 con 0x7f3dc80b3870 2023-07-06T22:02:25.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.134+0000 7f3dccc72640 1 -- 172.21.15.55:0/716841039 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db80ac900 con 0x7f3dc80b3870 2023-07-06T22:02:25.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.134+0000 7f3dcfed8640 1 -- 172.21.15.55:0/716841039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc80b3870 msgr2=0x7f3dc80b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.134+0000 7f3dcfed8640 1 --2- 172.21.15.55:0/716841039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc80b3870 0x7f3dc80b3cd0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80cc780 tx=0x7f3db801c3b0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.134+0000 7f3dcfed8640 1 -- 172.21.15.55:0/716841039 shutdown_connections 2023-07-06T22:02:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.134+0000 7f3dcfed8640 1 --2- 172.21.15.55:0/716841039 >> v2:172.21.15.138:3300/0 conn(0x7f3dc80d03c0 0x7f3dc80d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.134+0000 7f3dcfed8640 1 --2- 172.21.15.55:0/716841039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc80b3870 0x7f3dc80b3cd0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.134+0000 7f3dcfed8640 1 -- 172.21.15.55:0/716841039 >> 172.21.15.55:0/716841039 conn(0x7f3dc80cec20 msgr2=0x7f3dc80cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.134+0000 7f3dcfed8640 1 -- 172.21.15.55:0/716841039 shutdown_connections 2023-07-06T22:02:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.134+0000 7f3dcfed8640 1 -- 172.21.15.55:0/716841039 wait complete. 2023-07-06T22:02:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcfed8640 1 Processor -- start 2023-07-06T22:02:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcfed8640 1 -- start start 2023-07-06T22:02:25.138 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f5372aef180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:02:25.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcfed8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dc80b3870 0x7f3dc81f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcfed8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc80d03c0 0x7f3dc8154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcfed8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3dc815b850 0x7f3dc8154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcfed8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc80c9860 con 0x7f3dc80d03c0 2023-07-06T22:02:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcfed8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc80c9270 con 0x7f3dc80b3870 2023-07-06T22:02:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcfed8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc80b78b0 con 0x7f3dc815b850 2023-07-06T22:02:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcd473640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc80d03c0 0x7f3dc8154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcd473640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc80d03c0 0x7f3dc8154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34130/0 (socket says 172.21.15.55:34130) 2023-07-06T22:02:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcd473640 1 -- 172.21.15.55:0/1032106548 learned_addr learned my addr 172.21.15.55:0/1032106548 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcdc74640 1 --2- 172.21.15.55:0/1032106548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dc80b3870 0x7f3dc81f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dce475640 1 --2- 172.21.15.55:0/1032106548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3dc815b850 0x7f3dc8154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcd473640 1 -- 172.21.15.55:0/1032106548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3dc815b850 msgr2=0x7f3dc8154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcd473640 1 --2- 172.21.15.55:0/1032106548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3dc815b850 0x7f3dc8154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcd473640 1 -- 172.21.15.55:0/1032106548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dc80b3870 msgr2=0x7f3dc81f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcd473640 1 --2- 172.21.15.55:0/1032106548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dc80b3870 0x7f3dc81f7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.138+0000 7f3dcd473640 1 -- 172.21.15.55:0/1032106548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db80094d0 con 0x7f3dc80d03c0 2023-07-06T22:02:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.142+0000 7f3dcd473640 1 --2- 172.21.15.55:0/1032106548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc80d03c0 0x7f3dc8154010 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f3db8018fc0 tx=0x7f3db801abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.142+0000 7f3dbe7fc640 1 -- 172.21.15.55:0/1032106548 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db80ac410 con 0x7f3dc80d03c0 2023-07-06T22:02:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.142+0000 7f3dbe7fc640 1 -- 172.21.15.55:0/1032106548 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db80ace90 con 0x7f3dc80d03c0 2023-07-06T22:02:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.142+0000 7f3dbe7fc640 1 -- 172.21.15.55:0/1032106548 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8004230 con 0x7f3dc80d03c0 2023-07-06T22:02:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.142+0000 7f3dcfed8640 1 -- 172.21.15.55:0/1032106548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc80b7b90 con 0x7f3dc80d03c0 2023-07-06T22:02:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.142+0000 7f3dcfed8640 1 -- 172.21.15.55:0/1032106548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc81f8120 con 0x7f3dc80d03c0 2023-07-06T22:02:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.142+0000 7f3dcfed8640 1 -- 172.21.15.55:0/1032106548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc80b7db0 con 0x7f3dc80d03c0 2023-07-06T22:02:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.142+0000 7f3dbe7fc640 1 -- 172.21.15.55:0/1032106548 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f3db80b3040 con 0x7f3dc80d03c0 2023-07-06T22:02:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.142+0000 7f3dbe7fc640 1 --2- 172.21.15.55:0/1032106548 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f3dac0663f0 0x7f3dac0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.142+0000 7f3dcdc74640 1 -- 172.21.15.55:0/1032106548 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f3dac0663f0 msgr2=0x7f3dac0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/433956277 2023-07-06T22:02:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.142+0000 7f3dbe7fc640 1 -- 172.21.15.55:0/1032106548 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f3db811e600 con 0x7f3dc80d03c0 2023-07-06T22:02:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.142+0000 7f3dcdc74640 1 --2- 172.21.15.55:0/1032106548 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f3dac0663f0 0x7f3dac0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:02:25.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.146+0000 7f3dbe7fc640 1 -- 172.21.15.55:0/1032106548 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3db80eb7a0 con 0x7f3dc80d03c0 2023-07-06T22:02:25.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.306+0000 7f3dcfed8640 1 -- 172.21.15.55:0/1032106548 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f3dc81584f0 con 0x7f3dc80d03c0 2023-07-06T22:02:25.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.310+0000 7f3dbe7fc640 1 -- 172.21.15.55:0/1032106548 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v53)=0 v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3db80eedc0 con 0x7f3dc80d03c0 2023-07-06T22:02:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.314+0000 7f3dcfed8640 1 -- 172.21.15.55:0/1032106548 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f3dac0663f0 msgr2=0x7f3dac0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:02:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.314+0000 7f3dcfed8640 1 --2- 172.21.15.55:0/1032106548 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f3dac0663f0 0x7f3dac0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.314+0000 7f3dcfed8640 1 -- 172.21.15.55:0/1032106548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc80d03c0 msgr2=0x7f3dc8154010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:25.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.314+0000 7f3dcfed8640 1 --2- 172.21.15.55:0/1032106548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc80d03c0 0x7f3dc8154010 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f3db8018fc0 tx=0x7f3db801abf0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.314+0000 7f3dcfed8640 1 -- 172.21.15.55:0/1032106548 shutdown_connections 2023-07-06T22:02:25.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.314+0000 7f3dcfed8640 1 --2- 172.21.15.55:0/1032106548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3dc815b850 0x7f3dc8154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.314+0000 7f3dcfed8640 1 --2- 172.21.15.55:0/1032106548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc80d03c0 0x7f3dc8154010 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.314+0000 7f3dcfed8640 1 --2- 172.21.15.55:0/1032106548 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f3dac0663f0 0x7f3dac0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.314+0000 7f3dcfed8640 1 --2- 172.21.15.55:0/1032106548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dc80b3870 0x7f3dc81f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.314+0000 7f3dcfed8640 1 -- 172.21.15.55:0/1032106548 >> 172.21.15.55:0/1032106548 conn(0x7f3dc80cec20 msgr2=0x7f3dc8157de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:25.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.314+0000 7f3dcfed8640 1 -- 172.21.15.55:0/1032106548 shutdown_connections 2023-07-06T22:02:25.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.314+0000 7f3dcfed8640 1 -- 172.21.15.55:0/1032106548 wait complete. 2023-07-06T22:02:25.335 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-06T22:02:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.482+0000 7f9474fc5640 1 Processor -- start 2023-07-06T22:02:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.482+0000 7f9474fc5640 1 -- start start 2023-07-06T22:02:25.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.482+0000 7f9474fc5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f947015b850 0x7f94700cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.482+0000 7f9474fc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94700ccd30 0x7f94700b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.482+0000 7f9474fc5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94700b4210 con 0x7f94700b3db0 2023-07-06T22:02:25.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.482+0000 7f9474fc5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94700b2b80 con 0x7f947015b850 2023-07-06T22:02:25.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.482+0000 7f9474fc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94700cff30 con 0x7f94700ccd30 2023-07-06T22:02:25.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.482+0000 7f946e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f947015b850 0x7f94700cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.482+0000 7f946e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f947015b850 0x7f94700cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34140/0 (socket says 172.21.15.55:34140) 2023-07-06T22:02:25.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.482+0000 7f946e59c640 1 -- 172.21.15.55:0/1056607596 learned_addr learned my addr 172.21.15.55:0/1056607596 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:25.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.482+0000 7f9467fff640 1 --2- 172.21.15.55:0/1056607596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94700ccd30 0x7f94700b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f946e59c640 1 -- 172.21.15.55:0/1056607596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94700ccd30 msgr2=0x7f94700b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:25.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f946e59c640 1 --2- 172.21.15.55:0/1056607596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94700ccd30 0x7f94700b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f946e59c640 1 -- 172.21.15.55:0/1056607596 >> v1:172.21.15.138:6789/0 conn(0x7f94700b3db0 legacy=0x7f947015f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:25.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f946e59c640 1 -- 172.21.15.55:0/1056607596 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94700b22e0 con 0x7f947015b850 2023-07-06T22:02:25.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f9467fff640 1 --2- 172.21.15.55:0/1056607596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94700ccd30 0x7f94700b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:25.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f946e59c640 1 --2- 172.21.15.55:0/1056607596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f947015b850 0x7f94700cc7f0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f9460009870 tx=0x7f946001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab81c546fb8d194 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:25.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f946dd9b640 1 -- 172.21.15.55:0/1056607596 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94600ab5f0 con 0x7f947015b850 2023-07-06T22:02:25.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f946dd9b640 1 -- 172.21.15.55:0/1056607596 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94600ab750 con 0x7f947015b850 2023-07-06T22:02:25.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f946dd9b640 1 -- 172.21.15.55:0/1056607596 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94600abae0 con 0x7f947015b850 2023-07-06T22:02:25.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f9474fc5640 1 -- 172.21.15.55:0/1056607596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f947015b850 msgr2=0x7f94700cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:25.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f9474fc5640 1 --2- 172.21.15.55:0/1056607596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f947015b850 0x7f94700cc7f0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f9460009870 tx=0x7f946001c3f0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f9474fc5640 1 -- 172.21.15.55:0/1056607596 shutdown_connections 2023-07-06T22:02:25.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f9474fc5640 1 --2- 172.21.15.55:0/1056607596 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94700ccd30 0x7f94700b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f9474fc5640 1 --2- 172.21.15.55:0/1056607596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f947015b850 0x7f94700cc7f0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.486+0000 7f9474fc5640 1 -- 172.21.15.55:0/1056607596 >> 172.21.15.55:0/1056607596 conn(0x7f94700cec20 msgr2=0x7f94700cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:25.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f9474fc5640 1 -- 172.21.15.55:0/1056607596 shutdown_connections 2023-07-06T22:02:25.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f9474fc5640 1 -- 172.21.15.55:0/1056607596 wait complete. 2023-07-06T22:02:25.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f9474fc5640 1 Processor -- start 2023-07-06T22:02:25.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f9474fc5640 1 -- start start 2023-07-06T22:02:25.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f9474fc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94700b3db0 0x7f94700b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f9474fc5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94700ccd30 0x7f9470151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f9474fc5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f947015b850 0x7f947014f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f9474fc5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947015cf70 con 0x7f947015b850 2023-07-06T22:02:25.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f9474fc5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947015ee40 con 0x7f94700ccd30 2023-07-06T22:02:25.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f9474fc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9470151a90 con 0x7f94700b3db0 2023-07-06T22:02:25.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f946ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f947015b850 0x7f947014f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f946e59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94700b3db0 0x7f94700b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f946ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f947015b850 0x7f947014f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34154/0 (socket says 172.21.15.55:34154) 2023-07-06T22:02:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f9467fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94700ccd30 0x7f9470151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f946ed9d640 1 -- 172.21.15.55:0/1450023210 learned_addr learned my addr 172.21.15.55:0/1450023210 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f946ed9d640 1 -- 172.21.15.55:0/1450023210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94700b3db0 msgr2=0x7f94700b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f946ed9d640 1 --2- 172.21.15.55:0/1450023210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94700b3db0 0x7f94700b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f946ed9d640 1 -- 172.21.15.55:0/1450023210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94700ccd30 msgr2=0x7f9470151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f946ed9d640 1 --2- 172.21.15.55:0/1450023210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94700ccd30 0x7f9470151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f946ed9d640 1 -- 172.21.15.55:0/1450023210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94600094d0 con 0x7f947015b850 2023-07-06T22:02:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.490+0000 7f946e59c640 1 --2- 172.21.15.55:0/1450023210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94700b3db0 0x7f94700b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:02:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.494+0000 7f946ed9d640 1 --2- 172.21.15.55:0/1450023210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f947015b850 0x7f947014f650 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f946800c7a0 tx=0x7f946800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.494+0000 7f9466ffd640 1 -- 172.21.15.55:0/1450023210 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468003bd0 con 0x7f947015b850 2023-07-06T22:02:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.494+0000 7f9466ffd640 1 -- 172.21.15.55:0/1450023210 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9468003d50 con 0x7f947015b850 2023-07-06T22:02:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.494+0000 7f9474fc5640 1 -- 172.21.15.55:0/1450023210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947015bda0 con 0x7f947015b850 2023-07-06T22:02:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.494+0000 7f9466ffd640 1 -- 172.21.15.55:0/1450023210 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946800aa90 con 0x7f947015b850 2023-07-06T22:02:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.494+0000 7f9474fc5640 1 -- 172.21.15.55:0/1450023210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947015d1a0 con 0x7f947015b850 2023-07-06T22:02:25.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.494+0000 7f9474fc5640 1 -- 172.21.15.55:0/1450023210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9470066d60 con 0x7f947015b850 2023-07-06T22:02:25.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.494+0000 7f9466ffd640 1 -- 172.21.15.55:0/1450023210 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f946800abf0 con 0x7f947015b850 2023-07-06T22:02:25.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.494+0000 7f9466ffd640 1 --2- 172.21.15.55:0/1450023210 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f94500663f0 0x7f94500688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.494+0000 7f9466ffd640 1 -- 172.21.15.55:0/1450023210 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9468083e50 con 0x7f947015b850 2023-07-06T22:02:25.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.494+0000 7f946e59c640 1 -- 172.21.15.55:0/1450023210 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f94500663f0 msgr2=0x7f94500688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/433956277 2023-07-06T22:02:25.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.494+0000 7f946e59c640 1 --2- 172.21.15.55:0/1450023210 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f94500663f0 0x7f94500688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:02:25.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.502+0000 7f9466ffd640 1 -- 172.21.15.55:0/1450023210 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9468051070 con 0x7f947015b850 2023-07-06T22:02:25.536 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:25.538+0000 7fe9e7446180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:02:25.591 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:25.590+0000 7f5372aef180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:02:25.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.662+0000 7f9474fc5640 1 -- 172.21.15.55:0/1450023210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f94700b3420 con 0x7f947015b850 2023-07-06T22:02:25.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.666+0000 7f9466ffd640 1 -- 172.21.15.55:0/1450023210 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v54)=0 v54) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9468054690 con 0x7f947015b850 2023-07-06T22:02:25.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.670+0000 7f9474fc5640 1 -- 172.21.15.55:0/1450023210 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f94500663f0 msgr2=0x7f94500688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:02:25.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.670+0000 7f9474fc5640 1 --2- 172.21.15.55:0/1450023210 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f94500663f0 0x7f94500688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.670+0000 7f9474fc5640 1 -- 172.21.15.55:0/1450023210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f947015b850 msgr2=0x7f947014f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:25.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.670+0000 7f9474fc5640 1 --2- 172.21.15.55:0/1450023210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f947015b850 0x7f947014f650 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f946800c7a0 tx=0x7f946800cc60 comp rx=0 tx=0).stop 2023-07-06T22:02:25.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.670+0000 7f9474fc5640 1 -- 172.21.15.55:0/1450023210 shutdown_connections 2023-07-06T22:02:25.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.670+0000 7f9474fc5640 1 --2- 172.21.15.55:0/1450023210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f947015b850 0x7f947014f650 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.670+0000 7f9474fc5640 1 --2- 172.21.15.55:0/1450023210 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7f94500663f0 0x7f94500688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.670+0000 7f9474fc5640 1 --2- 172.21.15.55:0/1450023210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94700ccd30 0x7f9470151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.670+0000 7f9474fc5640 1 --2- 172.21.15.55:0/1450023210 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94700b3db0 0x7f94700b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.670+0000 7f9474fc5640 1 -- 172.21.15.55:0/1450023210 >> 172.21.15.55:0/1450023210 conn(0x7f94700cec20 msgr2=0x7f94700d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:25.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.670+0000 7f9474fc5640 1 -- 172.21.15.55:0/1450023210 shutdown_connections 2023-07-06T22:02:25.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.670+0000 7f9474fc5640 1 -- 172.21.15.55:0/1450023210 wait complete. 2023-07-06T22:02:25.687 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:25.690+0000 7fe9e7446180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:02:25.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:02:25.690 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-06T22:02:25.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:02:25.706 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-07-06T22:02:25.753 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:25.754+0000 7f5372aef180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:02:25.759 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-06T22:02:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb609234640 1 Processor -- start 2023-07-06T22:02:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb609234640 1 -- start start 2023-07-06T22:02:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb609234640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb6040b3c90 0x7fb6040ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb609234640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6040b18a0 0x7fb6040b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb609234640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6040ccd50 con 0x7fb6040d1d30 2023-07-06T22:02:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb609234640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6040cd0a0 con 0x7fb6040b18a0 2023-07-06T22:02:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb609234640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb604069ea0 con 0x7fb6040b3c90 2023-07-06T22:02:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb60259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6040b18a0 0x7fb6040b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb60259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6040b18a0 0x7fb6040b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34168/0 (socket says 172.21.15.55:34168) 2023-07-06T22:02:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb60259c640 1 -- 172.21.15.55:0/1566149429 learned_addr learned my addr 172.21.15.55:0/1566149429 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb602d9d640 1 --2- 172.21.15.55:0/1566149429 >> v2:172.21.15.138:3300/0 conn(0x7fb6040b3c90 0x7fb6040ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb60259c640 1 -- 172.21.15.55:0/1566149429 >> v2:172.21.15.138:3300/0 conn(0x7fb6040b3c90 msgr2=0x7fb6040ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:02:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb60259c640 1 --2- 172.21.15.55:0/1566149429 >> v2:172.21.15.138:3300/0 conn(0x7fb6040b3c90 0x7fb6040ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb60259c640 1 -- 172.21.15.55:0/1566149429 >> v1:172.21.15.55:6789/0 conn(0x7fb6040d1d30 legacy=0x7fb60415f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.950+0000 7fb60259c640 1 -- 172.21.15.55:0/1566149429 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6040b45a0 con 0x7fb6040b18a0 2023-07-06T22:02:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.954+0000 7fb60259c640 1 --2- 172.21.15.55:0/1566149429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6040b18a0 0x7fb6040b4060 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fb60408b300 tx=0x7fb5f801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde1d955f583ab6a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:25.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.954+0000 7fb601d9b640 1 -- 172.21.15.55:0/1566149429 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80aa430 con 0x7fb6040b18a0 2023-07-06T22:02:25.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.954+0000 7fb601d9b640 1 -- 172.21.15.55:0/1566149429 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f80aa590 con 0x7fb6040b18a0 2023-07-06T22:02:25.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.954+0000 7fb601d9b640 1 -- 172.21.15.55:0/1566149429 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80aa920 con 0x7fb6040b18a0 2023-07-06T22:02:25.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.954+0000 7fb609234640 1 -- 172.21.15.55:0/1566149429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6040b18a0 msgr2=0x7fb6040b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:25.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.954+0000 7fb609234640 1 --2- 172.21.15.55:0/1566149429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6040b18a0 0x7fb6040b4060 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fb60408b300 tx=0x7fb5f801c4d0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.954+0000 7fb609234640 1 -- 172.21.15.55:0/1566149429 shutdown_connections 2023-07-06T22:02:25.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.954+0000 7fb609234640 1 --2- 172.21.15.55:0/1566149429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6040b18a0 0x7fb6040b4060 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.954+0000 7fb609234640 1 --2- 172.21.15.55:0/1566149429 >> v2:172.21.15.138:3300/0 conn(0x7fb6040b3c90 0x7fb6040ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.954+0000 7fb609234640 1 -- 172.21.15.55:0/1566149429 >> 172.21.15.55:0/1566149429 conn(0x7fb60406bf40 msgr2=0x7fb6040cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:25.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.954+0000 7fb609234640 1 -- 172.21.15.55:0/1566149429 shutdown_connections 2023-07-06T22:02:25.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.954+0000 7fb609234640 1 -- 172.21.15.55:0/1566149429 wait complete. 2023-07-06T22:02:25.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb609234640 1 Processor -- start 2023-07-06T22:02:25.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb609234640 1 -- start start 2023-07-06T22:02:25.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb609234640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6040b18a0 0x7fb6040cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb609234640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6040b3c90 0x7fb60415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb609234640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6040d1d30 0x7fb6041579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb609234640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6040cb360 con 0x7fb6040b18a0 2023-07-06T22:02:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb609234640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6040cb640 con 0x7fb6040d1d30 2023-07-06T22:02:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb609234640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6040cb920 con 0x7fb6040b3c90 2023-07-06T22:02:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb602d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6040b18a0 0x7fb6040cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb602d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6040b18a0 0x7fb6040cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34172/0 (socket says 172.21.15.55:34172) 2023-07-06T22:02:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb602d9d640 1 -- 172.21.15.55:0/176615776 learned_addr learned my addr 172.21.15.55:0/176615776 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:25.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb60259c640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6040b3c90 0x7fb60415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb60359e640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6040d1d30 0x7fb6041579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb602d9d640 1 -- 172.21.15.55:0/176615776 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6040b3c90 msgr2=0x7fb60415ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb602d9d640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6040b3c90 0x7fb60415ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb602d9d640 1 -- 172.21.15.55:0/176615776 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6040d1d30 msgr2=0x7fb6041579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb602d9d640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6040d1d30 0x7fb6041579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb602d9d640 1 -- 172.21.15.55:0/176615776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80094d0 con 0x7fb6040b18a0 2023-07-06T22:02:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb602d9d640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6040b18a0 0x7fb6040cad40 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400d800 tx=0x7fb5f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb5eb7fe640 1 -- 172.21.15.55:0/176615776 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f400b6c0 con 0x7fb6040b18a0 2023-07-06T22:02:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb5eb7fe640 1 -- 172.21.15.55:0/176615776 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f400b820 con 0x7fb6040b18a0 2023-07-06T22:02:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb609234640 1 -- 172.21.15.55:0/176615776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6040cbc00 con 0x7fb6040b18a0 2023-07-06T22:02:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb5eb7fe640 1 -- 172.21.15.55:0/176615776 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f400bb90 con 0x7fb6040b18a0 2023-07-06T22:02:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.958+0000 7fb609234640 1 -- 172.21.15.55:0/176615776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60415b0a0 con 0x7fb6040b18a0 2023-07-06T22:02:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.962+0000 7fb609234640 1 -- 172.21.15.55:0/176615776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb604066d60 con 0x7fb6040b18a0 2023-07-06T22:02:25.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.962+0000 7fb5eb7fe640 1 -- 172.21.15.55:0/176615776 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fb5f400bcf0 con 0x7fb6040b18a0 2023-07-06T22:02:25.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.962+0000 7fb5eb7fe640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fb5f0066420 0x7fb5f00688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:25.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.962+0000 7fb5eb7fe640 1 -- 172.21.15.55:0/176615776 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb5f4084480 con 0x7fb6040b18a0 2023-07-06T22:02:25.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.962+0000 7fb60259c640 1 -- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fb5f0066420 msgr2=0x7fb5f00688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/433956277 2023-07-06T22:02:25.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.962+0000 7fb60259c640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fb5f0066420 0x7fb5f00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:02:25.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:25.970+0000 7fb5eb7fe640 1 -- 172.21.15.55:0/176615776 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb5f4051730 con 0x7fb6040b18a0 2023-07-06T22:02:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:26.146+0000 7fb609234640 1 -- 172.21.15.55:0/176615776 --> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb604168880 con 0x7fb5f0066420 2023-07-06T22:02:26.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:26.166+0000 7fb60259c640 1 -- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fb5f0066420 msgr2=0x7fb5f00688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/433956277 2023-07-06T22:02:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:26.166+0000 7fb60259c640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fb5f0066420 0x7fb5f00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-06T22:02:26.169 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:26.170+0000 7fe9e7446180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:02:26.227 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:26.230+0000 7fe9e7446180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:02:26.271 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:26.270+0000 7f5372aef180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:02:26.282 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:26.282+0000 7fe9e7446180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:02:26.333 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:26.334+0000 7f5372aef180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:02:26.367 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:26.370+0000 7fe9e7446180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:02:26.391 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:26.390+0000 7f5372aef180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:02:26.425 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:26.426+0000 7fe9e7446180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:02:26.484 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:26.486+0000 7f5372aef180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:02:26.510 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:26.510+0000 7fe9e7446180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:02:26.544 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:26.542+0000 7f5372aef180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:02:26.566 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:26.566+0000 7fe9e7446180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:02:26.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:26.570+0000 7fb60259c640 1 -- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fb5f0066420 msgr2=0x7fb5f00688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/433956277 2023-07-06T22:02:26.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:26.570+0000 7fb60259c640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fb5f0066420 0x7fb5f00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-06T22:02:26.632 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:26.630+0000 7f5372aef180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:02:26.691 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:26.690+0000 7f5372aef180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:02:26.707 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:26.710+0000 7fe9e7446180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:02:26.766 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:26.766+0000 7fe9e7446180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:02:26.842 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:26.842+0000 7f5372aef180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:02:26.903 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:26.902+0000 7f5372aef180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:02:27.005 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:02:27.005 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:02:27.006 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:02:27.014 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:27.014+0000 7fe9e7446180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:02:27.145 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:27.146+0000 7fe9e7446180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:02:27.153 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:02:27.153 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:02:27.153 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:02:27.161 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:27.162+0000 7f5372aef180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:02:27.269 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:27.270+0000 7fe9e7446180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:02:27.302 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:27.302+0000 7f5372aef180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:02:27.338 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:27.338+0000 7fe9e7446180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:02:27.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:27.374+0000 7fb60259c640 1 -- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fb5f0066420 msgr2=0x7fb5f00688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/433956277 2023-07-06T22:02:27.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:27.374+0000 7fb60259c640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fb5f0066420 0x7fb5f00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-06T22:02:27.434 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:27.434+0000 7f5372aef180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:02:27.474 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:27.474+0000 7fe9e7446180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:02:27.509 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:27.510+0000 7f5372aef180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:02:27.650 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:27.650+0000 7f5372aef180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:02:28.014 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:28.014+0000 7fe9e7446180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:02:28.099 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:28.102+0000 7fe9e7446180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:02:28.222 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:28.222+0000 7f5372aef180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:02:28.244 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:28.246+0000 7fe9e7446180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:02:28.310 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:28.310+0000 7f5372aef180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:02:28.327 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:28.330+0000 7fe9e7446180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:02:28.465 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:28.466+0000 7f5372aef180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:02:28.553 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:28.554+0000 7f5372aef180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:02:28.595 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:28.598+0000 7fe9e7446180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:02:28.655 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:02:28.658+0000 7fe9e7446180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:02:28.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:28.714+0000 7fb5eb7fe640 1 -- 172.21.15.55:0/176615776 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 80) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fb5f4051b00 con 0x7fb6040b18a0 2023-07-06T22:02:28.844 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:28.842+0000 7f5372aef180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:02:28.907 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:28.906+0000 7f5372aef180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:02:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:28.918+0000 7fb5eb7fe640 1 -- 172.21.15.55:0/176615776 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 81) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fb5f404da70 con 0x7fb6040b18a0 2023-07-06T22:02:28.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:28.918+0000 7fb5eb7fe640 1 -- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fb5f0066420 msgr2=0x7fb5f00688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:02:28.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:28.918+0000 7fb5eb7fe640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/433956277,v1:172.21.15.55:6833/433956277] conn(0x7fb5f0066420 0x7fb5f00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:29.043 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:29.042+0000 7f52f1c58640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:02:29.043 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:29.042+0000 7f52f1c58640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:02:29.044 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:29.042+0000 7f52f1c58640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:02:29.044 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:29.042+0000 7f52f1c58640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:02:29.044 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:29.042+0000 7f52f1c58640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:02:29.044 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:29.042+0000 7f52f445d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:02:29.045 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:29.042+0000 7f52f445d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:02:29.045 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:29.042+0000 7f52f445d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:02:29.045 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:29.042+0000 7f52f445d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:02:29.045 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:02:29.042+0000 7f52f445d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:02:29.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.922+0000 7fb5eb7fe640 1 -- 172.21.15.55:0/176615776 <== mon.0 v2:172.21.15.55:3300/0 9 ==== mgrmap(e 82) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fb5f40523d0 con 0x7fb6040b18a0 2023-07-06T22:02:29.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.922+0000 7fb5eb7fe640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7fb5f006eed0 0x7fb5f00712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:29.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.922+0000 7fb5eb7fe640 1 -- 172.21.15.55:0/176615776 --> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5f000c2f0 con 0x7fb5f006eed0 2023-07-06T22:02:29.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.926+0000 7fb60259c640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7fb5f006eed0 0x7fb5f00712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:29.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.930+0000 7fb60259c640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7fb5f006eed0 0x7fb5f00712b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80ae000 tx=0x7fb5f80a7000 comp rx=0 tx=0).ready entity=mgr.9154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:29.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.998+0000 7fb5eb7fe640 1 -- 172.21.15.55:0/176615776 <== mgr.9154 v2:172.21.15.55:6832/3834478672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fb5f80043d0 con 0x7fb5f006eed0 2023-07-06T22:02:29.997 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-07-06T22:02:30.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.998+0000 7fb609234640 1 -- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7fb5f006eed0 msgr2=0x7fb5f00712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:30.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.998+0000 7fb609234640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7fb5f006eed0 0x7fb5f00712b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80ae000 tx=0x7fb5f80a7000 comp rx=0 tx=0).stop 2023-07-06T22:02:30.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.998+0000 7fb609234640 1 -- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6040b18a0 msgr2=0x7fb6040cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:30.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.998+0000 7fb609234640 1 --2- 172.21.15.55:0/176615776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6040b18a0 0x7fb6040cad40 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400d800 tx=0x7fb5f400dcc0 comp rx=0 tx=0).stop 2023-07-06T22:02:30.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.998+0000 7fb60359e640 1 -- 172.21.15.55:0/176615776 reap_dead start 2023-07-06T22:02:30.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.998+0000 7fb609234640 1 -- 172.21.15.55:0/176615776 shutdown_connections 2023-07-06T22:02:30.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.998+0000 7fb609234640 1 -- 172.21.15.55:0/176615776 >> 172.21.15.55:0/176615776 conn(0x7fb60406bf40 msgr2=0x7fb6040d2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:30.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.998+0000 7fb609234640 1 -- 172.21.15.55:0/176615776 shutdown_connections 2023-07-06T22:02:30.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:29.998+0000 7fb609234640 1 -- 172.21.15.55:0/176615776 wait complete. 2023-07-06T22:02:30.021 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-07-06T22:02:30.021 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-06T22:02:30.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.170+0000 7f8b98337640 1 Processor -- start 2023-07-06T22:02:30.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.170+0000 7f8b98337640 1 -- start start 2023-07-06T22:02:30.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.170+0000 7f8b98337640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b900cd0f0 0x7f8b9015fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:30.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.170+0000 7f8b98337640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b900b5880 con 0x7f8b9015b930 2023-07-06T22:02:30.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.170+0000 7f8b98337640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b900cdcb0 con 0x7f8b900cc2e0 2023-07-06T22:02:30.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.170+0000 7f8b98337640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b900b5b60 con 0x7f8b900cd0f0 2023-07-06T22:02:30.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.170+0000 7f8b960d3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8b9015b930 0x7f8b900cc9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60802/0 (socket says 172.21.15.55:60802) 2023-07-06T22:02:30.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.170+0000 7f8b960d3640 1 -- 172.21.15.55:0/1303668067 learned_addr learned my addr 172.21.15.55:0/1303668067 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:02:30.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.170+0000 7f8b968d4640 1 --2- 172.21.15.55:0/1303668067 >> v2:172.21.15.55:3300/0 conn(0x7f8b900cd0f0 0x7f8b9015fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:30.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.170+0000 7f8b950d1640 1 -- 172.21.15.55:0/1303668067 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868926693 0 0) 0x7f8b900b5880 con 0x7f8b9015b930 2023-07-06T22:02:30.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.170+0000 7f8b950d1640 1 -- 172.21.15.55:0/1303668067 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b7c003530 con 0x7f8b9015b930 2023-07-06T22:02:30.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.170+0000 7f8b968d4640 1 -- 172.21.15.55:0/1303668067 >> v1:172.21.15.138:6789/0 conn(0x7f8b900cc2e0 legacy=0x7f8b9015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:30.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.170+0000 7f8b968d4640 1 -- 172.21.15.55:0/1303668067 >> v1:172.21.15.55:6789/0 conn(0x7f8b9015b930 legacy=0x7f8b900cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:30.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.170+0000 7f8b968d4640 1 -- 172.21.15.55:0/1303668067 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b900cdf90 con 0x7f8b900cd0f0 2023-07-06T22:02:30.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.174+0000 7f8b968d4640 1 --2- 172.21.15.55:0/1303668067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b900cd0f0 0x7f8b9015fc30 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009d90 tx=0x7f8b8801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c76e71512a03229 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:30.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.174+0000 7f8b950d1640 1 -- 172.21.15.55:0/1303668067 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b880a5a00 con 0x7f8b900cd0f0 2023-07-06T22:02:30.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.174+0000 7f8b950d1640 1 -- 172.21.15.55:0/1303668067 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b880a5b60 con 0x7f8b900cd0f0 2023-07-06T22:02:30.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.174+0000 7f8b950d1640 1 -- 172.21.15.55:0/1303668067 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b880ad440 con 0x7f8b900cd0f0 2023-07-06T22:02:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.174+0000 7f8b98337640 1 -- 172.21.15.55:0/1303668067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b900cd0f0 msgr2=0x7f8b9015fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.174+0000 7f8b98337640 1 --2- 172.21.15.55:0/1303668067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b900cd0f0 0x7f8b9015fc30 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009d90 tx=0x7f8b8801c920 comp rx=0 tx=0).stop 2023-07-06T22:02:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.174+0000 7f8b98337640 1 -- 172.21.15.55:0/1303668067 shutdown_connections 2023-07-06T22:02:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.174+0000 7f8b98337640 1 --2- 172.21.15.55:0/1303668067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b900cd0f0 0x7f8b9015fc30 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:30.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.174+0000 7f8b98337640 1 -- 172.21.15.55:0/1303668067 >> 172.21.15.55:0/1303668067 conn(0x7f8b900d0c60 msgr2=0x7f8b900b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:30.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.174+0000 7f8b98337640 1 -- 172.21.15.55:0/1303668067 shutdown_connections 2023-07-06T22:02:30.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.174+0000 7f8b98337640 1 -- 172.21.15.55:0/1303668067 wait complete. 2023-07-06T22:02:30.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b98337640 1 Processor -- start 2023-07-06T22:02:30.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b98337640 1 -- start start 2023-07-06T22:02:30.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b98337640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b900cd0f0 0x7f8b9006a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:30.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b98337640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b9015b930 0x7f8b900c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:30.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b98337640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b9006cf80 0x7f8b901591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:30.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b98337640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9006e070 con 0x7f8b9015b930 2023-07-06T22:02:30.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b98337640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9006a700 con 0x7f8b9006cf80 2023-07-06T22:02:30.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b98337640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b900c6400 con 0x7f8b900cd0f0 2023-07-06T22:02:30.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b958d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b9015b930 0x7f8b900c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:30.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b958d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b9015b930 0x7f8b900c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34322/0 (socket says 172.21.15.55:34322) 2023-07-06T22:02:30.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b958d2640 1 -- 172.21.15.55:0/2721461440 learned_addr learned my addr 172.21.15.55:0/2721461440 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:02:30.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b960d3640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b900cd0f0 0x7f8b9006a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:30.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b968d4640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b9006cf80 0x7f8b901591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:30.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b958d2640 1 -- 172.21.15.55:0/2721461440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b900cd0f0 msgr2=0x7f8b9006a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:30.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b958d2640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b900cd0f0 0x7f8b9006a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:30.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b958d2640 1 -- 172.21.15.55:0/2721461440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b9006cf80 msgr2=0x7f8b901591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:30.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b958d2640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b9006cf80 0x7f8b901591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:30.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b958d2640 1 -- 172.21.15.55:0/2721461440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b88009a70 con 0x7f8b9015b930 2023-07-06T22:02:30.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b968d4640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b9006cf80 0x7f8b901591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:02:30.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b958d2640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b9015b930 0x7f8b900c5ec0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000c400 tx=0x7f8b8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:30.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b86ffd640 1 -- 172.21.15.55:0/2721461440 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b800052d0 con 0x7f8b9015b930 2023-07-06T22:02:30.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b86ffd640 1 -- 172.21.15.55:0/2721461440 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b80005430 con 0x7f8b9015b930 2023-07-06T22:02:30.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b86ffd640 1 -- 172.21.15.55:0/2721461440 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80003840 con 0x7f8b9015b930 2023-07-06T22:02:30.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b98337640 1 -- 172.21.15.55:0/2721461440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9006d3f0 con 0x7f8b9015b930 2023-07-06T22:02:30.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.178+0000 7f8b98337640 1 -- 172.21.15.55:0/2721461440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9006d9b0 con 0x7f8b9015b930 2023-07-06T22:02:30.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.182+0000 7f8b98337640 1 -- 172.21.15.55:0/2721461440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b90066d60 con 0x7f8b9015b930 2023-07-06T22:02:30.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.182+0000 7f8b86ffd640 1 -- 172.21.15.55:0/2721461440 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 82) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f8b800039a0 con 0x7f8b9015b930 2023-07-06T22:02:30.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.182+0000 7f8b86ffd640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7f8b74066150 0x7f8b74068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:02:30.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.182+0000 7f8b86ffd640 1 -- 172.21.15.55:0/2721461440 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f8b80083290 con 0x7f8b9015b930 2023-07-06T22:02:30.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.182+0000 7f8b960d3640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7f8b74066150 0x7f8b74068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:02:30.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.182+0000 7f8b960d3640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7f8b74066150 0x7f8b74068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0011f0 tx=0x7f8b8c007d40 comp rx=0 tx=0).ready entity=mgr.9154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:02:30.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.186+0000 7f8b86ffd640 1 -- 172.21.15.55:0/2721461440 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8b800506e0 con 0x7f8b9015b930 2023-07-06T22:02:30.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.362+0000 7f8b98337640 1 -- 172.21.15.55:0/2721461440 --> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b90160170 con 0x7f8b74066150 2023-07-06T22:02:30.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.414+0000 7f8b86ffd640 1 -- 172.21.15.55:0/2721461440 <== mgr.9154 v2:172.21.15.55:6832/3834478672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f8b8c006b50 con 0x7f8b74066150 2023-07-06T22:02:30.416 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-07-06T22:02:30.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.418+0000 7f8b98337640 1 -- 172.21.15.55:0/2721461440 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7f8b74066150 msgr2=0x7f8b74068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:30.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.418+0000 7f8b98337640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7f8b74066150 0x7f8b74068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0011f0 tx=0x7f8b8c007d40 comp rx=0 tx=0).stop 2023-07-06T22:02:30.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.418+0000 7f8b98337640 1 -- 172.21.15.55:0/2721461440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b9015b930 msgr2=0x7f8b900c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:02:30.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.418+0000 7f8b98337640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b9015b930 0x7f8b900c5ec0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000c400 tx=0x7f8b8000c8c0 comp rx=0 tx=0).stop 2023-07-06T22:02:30.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.418+0000 7f8b98337640 1 -- 172.21.15.55:0/2721461440 shutdown_connections 2023-07-06T22:02:30.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.418+0000 7f8b98337640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7f8b74066150 0x7f8b74068600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:30.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.418+0000 7f8b98337640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8b9006cf80 0x7f8b901591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:30.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.418+0000 7f8b98337640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b9015b930 0x7f8b900c5ec0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:30.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.418+0000 7f8b98337640 1 --2- 172.21.15.55:0/2721461440 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8b900cd0f0 0x7f8b9006a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:02:30.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.418+0000 7f8b98337640 1 -- 172.21.15.55:0/2721461440 >> 172.21.15.55:0/2721461440 conn(0x7f8b900d0c60 msgr2=0x7f8b900c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:02:30.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.418+0000 7f8b98337640 1 -- 172.21.15.55:0/2721461440 shutdown_connections 2023-07-06T22:02:30.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:02:30.418+0000 7f8b98337640 1 -- 172.21.15.55:0/2721461440 wait complete. 2023-07-06T22:02:30.437 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-07-06T22:02:37.910 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:02:37.914 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:03:00.429 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:03:00.429+0000 7f52e3c3c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:03:00.430 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:03:00.429+0000 7f52e3c3c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:03:00.430 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:03:00.429+0000 7f52e3c3c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:03:00.430 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:03:00.429+0000 7f52e3c3c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:03:00.430 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:03:00.429+0000 7f52e3c3c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:03:07.963 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:03:07.967 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:03:38.083 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:03:38.087 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:04:08.163 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:04:08.167 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:04:38.293 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:04:38.297 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:05:08.373 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:05:08.392 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:05:38.528 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:05:38.533 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:06:08.601 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:06:08.605 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:06:38.682 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:06:38.686 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:07:08.812 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:07:08.816 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:07:38.934 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:07:38.938 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:08:08.998 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:08:09.002 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:08:39.136 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:08:39.144 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:09:09.200 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:09:09.204 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:09:39.321 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:09:39.325 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:10:09.393 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:10:09.397 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:10:39.516 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:10:39.520 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:11:09.647 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:11:09.651 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:11:39.785 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:11:39.789 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:12:09.898 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:12:09.902 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:12:40.030 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:12:40.034 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:13:10.085 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:13:10.089 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:13:15.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:13:15.439 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-06T22:13:15.451 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_03_00_UTC 2023-07-06T22:13:15.451 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_04_00_UTC 2023-07-06T22:13:15.451 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_05_00_UTC 2023-07-06T22:13:15.451 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_06_00_UTC 2023-07-06T22:13:15.451 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_07_00_UTC 2023-07-06T22:13:15.452 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_08_00_UTC 2023-07-06T22:13:15.452 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_09_00_UTC 2023-07-06T22:13:15.452 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_10_00_UTC 2023-07-06T22:13:15.452 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_11_00_UTC 2023-07-06T22:13:15.452 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_12_00_UTC 2023-07-06T22:13:15.452 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_13_00_UTC 2023-07-06T22:13:15.453 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-06-22_03_00_UTC', 'scheduled-2023-07-06-22_04_00_UTC', 'scheduled-2023-07-06-22_05_00_UTC', 'scheduled-2023-07-06-22_06_00_UTC', 'scheduled-2023-07-06-22_07_00_UTC', 'scheduled-2023-07-06-22_08_00_UTC', 'scheduled-2023-07-06-22_09_00_UTC', 'scheduled-2023-07-06-22_10_00_UTC', 'scheduled-2023-07-06-22_11_00_UTC', 'scheduled-2023-07-06-22_12_00_UTC', 'scheduled-2023-07-06-22_13_00_UTC'] 2023-07-06T22:13:15.454 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-07-06T22:13:15.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.647+0000 7f5df4796640 1 Processor -- start 2023-07-06T22:13:15.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.647+0000 7f5df4796640 1 -- start start 2023-07-06T22:13:15.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df4796640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dec158780 0x7f5dec0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:13:15.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df4796640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5dec0cbfa0 0x7f5dec06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:13:15.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df4796640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5dec0c89b0 0x7f5dec0c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:13:15.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df4796640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dec0c9370 con 0x7f5dec0cbfa0 2023-07-06T22:13:15.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df4796640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dec158b50 con 0x7f5dec0c89b0 2023-07-06T22:13:15.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df4796640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec06b390 con 0x7f5dec158780 2023-07-06T22:13:15.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df1d31640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5dec0cbfa0 0x7f5dec06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:13:15.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df1d31640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5dec0cbfa0 0x7f5dec06f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35244/0 (socket says 172.21.15.55:35244) 2023-07-06T22:13:15.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df1d31640 1 -- 172.21.15.55:0/1283216155 learned_addr learned my addr 172.21.15.55:0/1283216155 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:13:15.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df2532640 1 --2- 172.21.15.55:0/1283216155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dec158780 0x7f5dec0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:13:15.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df2d33640 1 --2- 172.21.15.55:0/1283216155 >> v2:172.21.15.138:3300/0 conn(0x7f5dec0c89b0 0x7f5dec0c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:13:15.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df1d31640 1 -- 172.21.15.55:0/1283216155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dec158780 msgr2=0x7f5dec0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:13:15.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df1d31640 1 --2- 172.21.15.55:0/1283216155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dec158780 0x7f5dec0cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:15.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df1d31640 1 -- 172.21.15.55:0/1283216155 >> v2:172.21.15.138:3300/0 conn(0x7f5dec0c89b0 msgr2=0x7f5dec0c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:13:15.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df1d31640 1 --2- 172.21.15.55:0/1283216155 >> v2:172.21.15.138:3300/0 conn(0x7f5dec0c89b0 0x7f5dec0c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:15.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.651+0000 7f5df1d31640 1 -- 172.21.15.55:0/1283216155 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec0cd3d0 con 0x7f5dec0cbfa0 2023-07-06T22:13:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df1d31640 1 --2- 172.21.15.55:0/1283216155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dec0cbfa0 0x7f5dec06f3f0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f5dec15c120 tx=0x7f5ddc01eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af8f4be313497e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:13:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df1530640 1 -- 172.21.15.55:0/1283216155 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0a7ac0 con 0x7f5dec0cbfa0 2023-07-06T22:13:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df1530640 1 -- 172.21.15.55:0/1283216155 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc0a7c20 con 0x7f5dec0cbfa0 2023-07-06T22:13:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df1530640 1 -- 172.21.15.55:0/1283216155 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0af440 con 0x7f5dec0cbfa0 2023-07-06T22:13:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df4796640 1 -- 172.21.15.55:0/1283216155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dec0cbfa0 msgr2=0x7f5dec06f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:13:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df4796640 1 --2- 172.21.15.55:0/1283216155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dec0cbfa0 0x7f5dec06f3f0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f5dec15c120 tx=0x7f5ddc01eb40 comp rx=0 tx=0).stop 2023-07-06T22:13:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df4796640 1 -- 172.21.15.55:0/1283216155 shutdown_connections 2023-07-06T22:13:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df4796640 1 --2- 172.21.15.55:0/1283216155 >> v2:172.21.15.138:3300/0 conn(0x7f5dec0c89b0 0x7f5dec0c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df4796640 1 --2- 172.21.15.55:0/1283216155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dec0cbfa0 0x7f5dec06f3f0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df4796640 1 --2- 172.21.15.55:0/1283216155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dec158780 0x7f5dec0cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df4796640 1 -- 172.21.15.55:0/1283216155 >> 172.21.15.55:0/1283216155 conn(0x7f5dec0cde30 msgr2=0x7f5dec0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:13:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df4796640 1 -- 172.21.15.55:0/1283216155 shutdown_connections 2023-07-06T22:13:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df4796640 1 -- 172.21.15.55:0/1283216155 wait complete. 2023-07-06T22:13:15.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df4796640 1 Processor -- start 2023-07-06T22:13:15.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.655+0000 7f5df4796640 1 -- start start 2023-07-06T22:13:15.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df4796640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dec0c89b0 0x7f5dec1576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:13:15.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df4796640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dec0cbfa0 0x7f5dec0c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:13:15.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df4796640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dec158780 0x7f5dec1f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:13:15.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df4796640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec1f8210 con 0x7f5dec158780 2023-07-06T22:13:15.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df4796640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec0c2e00 con 0x7f5dec0cbfa0 2023-07-06T22:13:15.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df4796640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec0c30a0 con 0x7f5dec0c89b0 2023-07-06T22:13:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df2d33640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dec158780 0x7f5dec1f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:13:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df2d33640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dec158780 0x7f5dec1f7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35258/0 (socket says 172.21.15.55:35258) 2023-07-06T22:13:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df2d33640 1 -- 172.21.15.55:0/1575041938 learned_addr learned my addr 172.21.15.55:0/1575041938 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:13:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df2532640 1 --2- 172.21.15.55:0/1575041938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dec0c89b0 0x7f5dec1576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:13:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df1d31640 1 --2- 172.21.15.55:0/1575041938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dec0cbfa0 0x7f5dec0c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:13:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df2d33640 1 -- 172.21.15.55:0/1575041938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dec0c89b0 msgr2=0x7f5dec1576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:13:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df2d33640 1 --2- 172.21.15.55:0/1575041938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dec0c89b0 0x7f5dec1576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df2d33640 1 -- 172.21.15.55:0/1575041938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dec0cbfa0 msgr2=0x7f5dec0c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:13:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df2d33640 1 --2- 172.21.15.55:0/1575041938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dec0cbfa0 0x7f5dec0c3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df2d33640 1 -- 172.21.15.55:0/1575041938 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc00b770 con 0x7f5dec158780 2023-07-06T22:13:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df2d33640 1 --2- 172.21.15.55:0/1575041938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dec158780 0x7f5dec1f7cd0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f5de400efc0 tx=0x7f5de400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:13:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5de2ffd640 1 -- 172.21.15.55:0/1575041938 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de4014480 con 0x7f5dec158780 2023-07-06T22:13:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5de2ffd640 1 -- 172.21.15.55:0/1575041938 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de400f040 con 0x7f5dec158780 2023-07-06T22:13:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5de2ffd640 1 -- 172.21.15.55:0/1575041938 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de4014820 con 0x7f5dec158780 2023-07-06T22:13:15.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df4796640 1 -- 172.21.15.55:0/1575041938 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dec0c3380 con 0x7f5dec158780 2023-07-06T22:13:15.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df4796640 1 -- 172.21.15.55:0/1575041938 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dec151bd0 con 0x7f5dec158780 2023-07-06T22:13:15.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5df4796640 1 -- 172.21.15.55:0/1575041938 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dec0c40c0 con 0x7f5dec158780 2023-07-06T22:13:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.659+0000 7f5de2ffd640 1 -- 172.21.15.55:0/1575041938 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 85) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f5de4014980 con 0x7f5dec158780 2023-07-06T22:13:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.663+0000 7f5de2ffd640 1 --2- 172.21.15.55:0/1575041938 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7f5dd00663f0 0x7f5dd00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:13:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.663+0000 7f5de2ffd640 1 -- 172.21.15.55:0/1575041938 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6783+0+0 (secure 0 0 0) 0x7f5de4084d70 con 0x7f5dec158780 2023-07-06T22:13:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.663+0000 7f5df2532640 1 --2- 172.21.15.55:0/1575041938 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7f5dd00663f0 0x7f5dd00688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:13:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.663+0000 7f5df2532640 1 --2- 172.21.15.55:0/1575041938 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7f5dd00663f0 0x7f5dd00688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5dec151640 tx=0x7f5de8009190 comp rx=0 tx=0).ready entity=mgr.9154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:13:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.667+0000 7f5de2ffd640 1 -- 172.21.15.55:0/1575041938 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5de4051db0 con 0x7f5dec158780 2023-07-06T22:13:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.843+0000 7f5df4796640 1 -- 172.21.15.55:0/1575041938 --> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5dec0cd6a0 con 0x7f5dd00663f0 2023-07-06T22:13:15.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.847+0000 7f5de2ffd640 1 -- 172.21.15.55:0/1575041938 <== mgr.9154 v2:172.21.15.55:6832/3834478672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f5de8011940 con 0x7f5dd00663f0 2023-07-06T22:13:15.851 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:13:15.851 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T22:02:29", "first": "2023-07-06T22:03:00", "last": "2023-07-06T22:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-07-06T22:13:15.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.851+0000 7f5df4796640 1 -- 172.21.15.55:0/1575041938 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7f5dd00663f0 msgr2=0x7f5dd00688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:13:15.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.851+0000 7f5df4796640 1 --2- 172.21.15.55:0/1575041938 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7f5dd00663f0 0x7f5dd00688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5dec151640 tx=0x7f5de8009190 comp rx=0 tx=0).stop 2023-07-06T22:13:15.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.851+0000 7f5df4796640 1 -- 172.21.15.55:0/1575041938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dec158780 msgr2=0x7f5dec1f7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:13:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.851+0000 7f5df4796640 1 --2- 172.21.15.55:0/1575041938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dec158780 0x7f5dec1f7cd0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f5de400efc0 tx=0x7f5de400c490 comp rx=0 tx=0).stop 2023-07-06T22:13:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.851+0000 7f5df4796640 1 -- 172.21.15.55:0/1575041938 shutdown_connections 2023-07-06T22:13:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.851+0000 7f5df4796640 1 --2- 172.21.15.55:0/1575041938 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7f5dd00663f0 0x7f5dd00688a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.851+0000 7f5df4796640 1 --2- 172.21.15.55:0/1575041938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dec158780 0x7f5dec1f7cd0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.851+0000 7f5df4796640 1 --2- 172.21.15.55:0/1575041938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dec0cbfa0 0x7f5dec0c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.851+0000 7f5df4796640 1 --2- 172.21.15.55:0/1575041938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5dec0c89b0 0x7f5dec1576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.851+0000 7f5df4796640 1 -- 172.21.15.55:0/1575041938 >> 172.21.15.55:0/1575041938 conn(0x7f5dec0cde30 msgr2=0x7f5dec0ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:13:15.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.851+0000 7f5df4796640 1 -- 172.21.15.55:0/1575041938 shutdown_connections 2023-07-06T22:13:15.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:15.851+0000 7f5df4796640 1 -- 172.21.15.55:0/1575041938 wait complete. 2023-07-06T22:13:15.879 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T22:02:29", "first": "2023-07-06T22:03:00", "last": "2023-07-06T22:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-07-06T22:13:15.880 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-07-06T00:00:00', 'created': '2023-07-06T22:02:29', 'first': '2023-07-06T22:03:00', 'last': '2023-07-06T22:13:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-07-06T22:13:15.880 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-06T22:13:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.019+0000 7fcfe78cb640 1 Processor -- start 2023-07-06T22:13:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.019+0000 7fcfe78cb640 1 -- start start 2023-07-06T22:13:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfe78cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfe015bc40 0x7fcfe006c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:13:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfe78cb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcfe015cc00 0x7fcfe015f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:13:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfe78cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe015c770 con 0x7fcfe006f8e0 2023-07-06T22:13:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfe78cb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe006d4f0 con 0x7fcfe015cc00 2023-07-06T22:13:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfe78cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe006d210 con 0x7fcfe015bc40 2023-07-06T22:13:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfe4e66640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfe015bc40 0x7fcfe006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:13:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfe4e66640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfe015bc40 0x7fcfe006c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:39734/0 (socket says 172.21.15.55:39734) 2023-07-06T22:13:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfe4e66640 1 -- 172.21.15.55:0/1288092885 learned_addr learned my addr 172.21.15.55:0/1288092885 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:13:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfe5e68640 1 --2- 172.21.15.55:0/1288092885 >> v2:172.21.15.138:3300/0 conn(0x7fcfe015cc00 0x7fcfe015f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:13:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfe5667640 1 --1- 172.21.15.55:0/1288092885 >> v1:172.21.15.138:6789/0 conn(0x7fcfe006f8e0 0x7fcfe006fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:60076/0 (socket says 172.21.15.55:60076) 2023-07-06T22:13:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfe4e66640 1 -- 172.21.15.55:0/1288092885 >> v2:172.21.15.138:3300/0 conn(0x7fcfe015cc00 msgr2=0x7fcfe015f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:13:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfe4e66640 1 --2- 172.21.15.55:0/1288092885 >> v2:172.21.15.138:3300/0 conn(0x7fcfe015cc00 0x7fcfe015f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfe4e66640 1 -- 172.21.15.55:0/1288092885 >> v1:172.21.15.138:6789/0 conn(0x7fcfe006f8e0 legacy=0x7fcfe006fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:13:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfd7fff640 1 -- 172.21.15.55:0/1288092885 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084233570 0 0) 0x7fcfe015c770 con 0x7fcfe006f8e0 2023-07-06T22:13:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.023+0000 7fcfe4e66640 1 -- 172.21.15.55:0/1288092885 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe015c120 con 0x7fcfe015bc40 2023-07-06T22:13:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.027+0000 7fcfe4e66640 1 --2- 172.21.15.55:0/1288092885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfe015bc40 0x7fcfe006c930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009870 tx=0x7fcfd001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ddc890c3c1cc2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:13:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.027+0000 7fcfd7fff640 1 -- 172.21.15.55:0/1288092885 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00ab640 con 0x7fcfe015bc40 2023-07-06T22:13:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.027+0000 7fcfd7fff640 1 -- 172.21.15.55:0/1288092885 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd00a7070 con 0x7fcfe015bc40 2023-07-06T22:13:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.027+0000 7fcfd7fff640 1 -- 172.21.15.55:0/1288092885 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00ab9c0 con 0x7fcfe015bc40 2023-07-06T22:13:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.027+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1288092885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfe015bc40 msgr2=0x7fcfe006c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:13:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.027+0000 7fcfe78cb640 1 --2- 172.21.15.55:0/1288092885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfe015bc40 0x7fcfe006c930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009870 tx=0x7fcfd001c510 comp rx=0 tx=0).stop 2023-07-06T22:13:16.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.027+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1288092885 shutdown_connections 2023-07-06T22:13:16.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.027+0000 7fcfe78cb640 1 --2- 172.21.15.55:0/1288092885 >> v2:172.21.15.138:3300/0 conn(0x7fcfe015cc00 0x7fcfe015f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:16.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.027+0000 7fcfe78cb640 1 --2- 172.21.15.55:0/1288092885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfe015bc40 0x7fcfe006c930 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:16.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.027+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1288092885 >> 172.21.15.55:0/1288092885 conn(0x7fcfe00cbd80 msgr2=0x7fcfe00ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:13:16.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.027+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1288092885 shutdown_connections 2023-07-06T22:13:16.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.027+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1288092885 wait complete. 2023-07-06T22:13:16.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.027+0000 7fcfe78cb640 1 Processor -- start 2023-07-06T22:13:16.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.027+0000 7fcfe78cb640 1 -- start start 2023-07-06T22:13:16.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe78cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfe006f8e0 0x7fcfe014f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:13:16.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe78cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe015bc40 0x7fcfe00acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:13:16.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe78cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfe015cc00 0x7fcfe01523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:13:16.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe78cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe0158ef0 con 0x7fcfe015bc40 2023-07-06T22:13:16.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe78cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00ad6c0 con 0x7fcfe006f8e0 2023-07-06T22:13:16.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe78cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe0159100 con 0x7fcfe015cc00 2023-07-06T22:13:16.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe4e66640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe015bc40 0x7fcfe00acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:13:16.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe4e66640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe015bc40 0x7fcfe00acc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35272/0 (socket says 172.21.15.55:35272) 2023-07-06T22:13:16.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe5667640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfe006f8e0 0x7fcfe014f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:13:16.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe4e66640 1 -- 172.21.15.55:0/1357101357 learned_addr learned my addr 172.21.15.55:0/1357101357 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:13:16.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe5e68640 1 --2- 172.21.15.55:0/1357101357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfe015cc00 0x7fcfe01523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:13:16.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe4e66640 1 -- 172.21.15.55:0/1357101357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfe015cc00 msgr2=0x7fcfe01523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:13:16.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe4e66640 1 --2- 172.21.15.55:0/1357101357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfe015cc00 0x7fcfe01523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:16.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe4e66640 1 -- 172.21.15.55:0/1357101357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfe006f8e0 msgr2=0x7fcfe014f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:13:16.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe4e66640 1 --2- 172.21.15.55:0/1357101357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfe006f8e0 0x7fcfe014f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:16.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe4e66640 1 -- 172.21.15.55:0/1357101357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd00094d0 con 0x7fcfe015bc40 2023-07-06T22:13:16.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe4e66640 1 --2- 172.21.15.55:0/1357101357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe015bc40 0x7fcfe00acc50 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00ad040 tx=0x7fcfd001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:13:16.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfd5ffb640 1 -- 172.21.15.55:0/1357101357 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00abe80 con 0x7fcfe015bc40 2023-07-06T22:13:16.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfd5ffb640 1 -- 172.21.15.55:0/1357101357 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd00be3f0 con 0x7fcfe015bc40 2023-07-06T22:13:16.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1357101357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe01593e0 con 0x7fcfe015bc40 2023-07-06T22:13:16.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfd5ffb640 1 -- 172.21.15.55:0/1357101357 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00be780 con 0x7fcfe015bc40 2023-07-06T22:13:16.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1357101357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe00ca240 con 0x7fcfe015bc40 2023-07-06T22:13:16.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.031+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1357101357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe0066d60 con 0x7fcfe015bc40 2023-07-06T22:13:16.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.035+0000 7fcfd5ffb640 1 -- 172.21.15.55:0/1357101357 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 85) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fcfd00b43f0 con 0x7fcfe015bc40 2023-07-06T22:13:16.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.035+0000 7fcfd5ffb640 1 --2- 172.21.15.55:0/1357101357 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7fcfc40663f0 0x7fcfc40688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:13:16.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.035+0000 7fcfd5ffb640 1 -- 172.21.15.55:0/1357101357 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6783+0+0 (secure 0 0 0) 0x7fcfd011e9b0 con 0x7fcfe015bc40 2023-07-06T22:13:16.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.035+0000 7fcfe5667640 1 --2- 172.21.15.55:0/1357101357 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7fcfc40663f0 0x7fcfc40688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:13:16.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.035+0000 7fcfe5667640 1 --2- 172.21.15.55:0/1357101357 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7fcfc40663f0 0x7fcfc40688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc007fd0 tx=0x7fcfdc007d60 comp rx=0 tx=0).ready entity=mgr.9154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:13:16.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.039+0000 7fcfd5ffb640 1 -- 172.21.15.55:0/1357101357 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcfd00eb950 con 0x7fcfe015bc40 2023-07-06T22:13:16.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.227+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1357101357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fcfe0159890 con 0x7fcfe015bc40 2023-07-06T22:13:16.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.231+0000 7fcfd5ffb640 1 -- 172.21.15.55:0/1357101357 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v85) v1 ==== 74+0+164446 (secure 0 0 0) 0x7fcfd00eef70 con 0x7fcfe015bc40 2023-07-06T22:13:16.235 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:13:16.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.235+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1357101357 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7fcfc40663f0 msgr2=0x7fcfc40688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:13:16.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.235+0000 7fcfe78cb640 1 --2- 172.21.15.55:0/1357101357 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7fcfc40663f0 0x7fcfc40688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc007fd0 tx=0x7fcfdc007d60 comp rx=0 tx=0).stop 2023-07-06T22:13:16.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.235+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1357101357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe015bc40 msgr2=0x7fcfe00acc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:13:16.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.235+0000 7fcfe78cb640 1 --2- 172.21.15.55:0/1357101357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe015bc40 0x7fcfe00acc50 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00ad040 tx=0x7fcfd001ad50 comp rx=0 tx=0).stop 2023-07-06T22:13:16.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.235+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1357101357 shutdown_connections 2023-07-06T22:13:16.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.235+0000 7fcfe78cb640 1 --2- 172.21.15.55:0/1357101357 >> [v2:172.21.15.55:6832/3834478672,v1:172.21.15.55:6833/3834478672] conn(0x7fcfc40663f0 0x7fcfc40688a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:16.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.235+0000 7fcfe78cb640 1 --2- 172.21.15.55:0/1357101357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfe015cc00 0x7fcfe01523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:16.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.235+0000 7fcfe78cb640 1 --2- 172.21.15.55:0/1357101357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe015bc40 0x7fcfe00acc50 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:16.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.235+0000 7fcfe78cb640 1 --2- 172.21.15.55:0/1357101357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfe006f8e0 0x7fcfe014f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:13:16.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.235+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1357101357 >> 172.21.15.55:0/1357101357 conn(0x7fcfe00cbd80 msgr2=0x7fcfe00cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:13:16.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.235+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1357101357 shutdown_connections 2023-07-06T22:13:16.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:13:16.235+0000 7fcfe78cb640 1 -- 172.21.15.55:0/1357101357 wait complete. 2023-07-06T22:13:16.255 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":85,"active_gid":9154,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3834478672},{"type":"v1","addr":"172.21.15.55:6833","nonce":3834478672}]},"active_addr":"172.21.15.55:6833/3834478672","active_change":"2023-07-06T22:02:28.914231+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":9151,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":161,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":653926838}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":562346394}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":3064152807}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":1671051159}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":959368203}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":2664561010}]}]} 2023-07-06T22:13:16.260 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: y 2023-07-06T22:13:16.260 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-06T22:13:16.261 INFO:tasks.ceph.mgr.y:Stopping old one... 2023-07-06T22:13:16.261 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-06T22:13:16.261 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:13:16.321 INFO:tasks.ceph.mgr.y:Stopped 2023-07-06T22:13:16.321 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-06T22:13:16.324 INFO:tasks.ceph.mgr.y:Started 2023-07-06T22:13:16.504 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:16.503+0000 7ff2ca5fd180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:13:16.940 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:16.939+0000 7ff2ca5fd180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:13:17.095 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:17.091+0000 7ff2ca5fd180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:13:17.599 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:17.595+0000 7ff2ca5fd180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:13:17.660 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:17.659+0000 7ff2ca5fd180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:13:17.719 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:17.715+0000 7ff2ca5fd180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:13:17.810 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:17.807+0000 7ff2ca5fd180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:13:17.869 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:17.867+0000 7ff2ca5fd180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:13:17.958 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:17.955+0000 7ff2ca5fd180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:13:18.018 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:18.015+0000 7ff2ca5fd180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:13:18.167 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:18.163+0000 7ff2ca5fd180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:13:18.228 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:18.227+0000 7ff2ca5fd180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:13:18.477 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:13:18.477 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:13:18.477 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:13:18.486 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:18.483+0000 7ff2ca5fd180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:13:18.627 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:18.623+0000 7ff2ca5fd180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:13:18.757 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:18.755+0000 7ff2ca5fd180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:13:18.831 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:18.827+0000 7ff2ca5fd180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:13:18.971 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:18.967+0000 7ff2ca5fd180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:13:19.535 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:19.531+0000 7ff2ca5fd180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:13:19.623 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:19.619+0000 7ff2ca5fd180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:13:19.776 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:19.775+0000 7ff2ca5fd180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:13:19.864 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:19.863+0000 7ff2ca5fd180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:13:20.150 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:20.147+0000 7ff2ca5fd180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:13:20.213 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:20.211+0000 7ff2ca5fd180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:13:20.372 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:20.371+0000 7ff24b760640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:13:20.372 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:20.371+0000 7ff24b760640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:13:20.372 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:20.371+0000 7ff24b760640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:13:20.372 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:20.371+0000 7ff24b760640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:13:20.373 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:20.371+0000 7ff24b760640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:13:20.373 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:20.371+0000 7ff248f5b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:13:20.373 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:20.371+0000 7ff248f5b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:13:20.373 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:20.371+0000 7ff248f5b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:13:20.374 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:20.371+0000 7ff248f5b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:13:20.374 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:13:20.371+0000 7ff248f5b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:13:40.198 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:13:40.202 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:14:00.370 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:14:00.366+0000 7ff253f71640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:14:00.370 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:14:00.366+0000 7ff253f71640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:14:00.370 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:14:00.366+0000 7ff253f71640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:14:00.370 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:14:00.366+0000 7ff253f71640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:14:00.370 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:14:00.366+0000 7ff253f71640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:14:10.336 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:14:10.340 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:14:40.475 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:14:40.479 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:15:10.563 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:15:10.567 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:15:40.686 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:15:40.690 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:16:10.817 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:16:10.821 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:16:41.021 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:16:41.025 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:17:11.069 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:17:11.073 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:17:41.191 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:17:41.195 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:18:11.313 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:18:11.317 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:18:16.325 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-06T22:18:16.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.481+0000 7ff3ca207640 1 Processor -- start 2023-07-06T22:18:16.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.481+0000 7ff3ca207640 1 -- start start 2023-07-06T22:18:16.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.481+0000 7ff3ca207640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3c40c9b90 0x7ff3c415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:16.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.481+0000 7ff3ca207640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff3c40ccb70 0x7ff3c40c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:16.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.481+0000 7ff3ca207640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c40b3e70 con 0x7ff3c4070410 2023-07-06T22:18:16.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.481+0000 7ff3ca207640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c4159c30 con 0x7ff3c40ccb70 2023-07-06T22:18:16.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.481+0000 7ff3ca207640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c40c9070 con 0x7ff3c40c9b90 2023-07-06T22:18:16.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.481+0000 7ff3c2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff3c40ccb70 0x7ff3c40c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:16.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.481+0000 7ff3c2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff3c40ccb70 0x7ff3c40c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43742/0 (socket says 172.21.15.55:43742) 2023-07-06T22:18:16.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.481+0000 7ff3c2ffd640 1 -- 172.21.15.55:0/3267305812 learned_addr learned my addr 172.21.15.55:0/3267305812 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:16.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.481+0000 7ff3c2ffd640 1 -- 172.21.15.55:0/3267305812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3c40c9b90 msgr2=0x7ff3c415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:16.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.481+0000 7ff3c2ffd640 1 --2- 172.21.15.55:0/3267305812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3c40c9b90 0x7ff3c415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:16.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.481+0000 7ff3c2ffd640 1 -- 172.21.15.55:0/3267305812 >> v1:172.21.15.138:6789/0 conn(0x7ff3c4070410 legacy=0x7ff3c4070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:16.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.481+0000 7ff3c2ffd640 1 -- 172.21.15.55:0/3267305812 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c406a400 con 0x7ff3c40ccb70 2023-07-06T22:18:16.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.485+0000 7ff3c2ffd640 1 --2- 172.21.15.55:0/3267305812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40ccb70 0x7ff3c40c9f60 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009870 tx=0x7ff3b801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4428828a7244c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:16.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.485+0000 7ff3c27fc640 1 -- 172.21.15.55:0/3267305812 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80ac630 con 0x7ff3c40ccb70 2023-07-06T22:18:16.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.485+0000 7ff3c27fc640 1 -- 172.21.15.55:0/3267305812 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b80ac790 con 0x7ff3c40ccb70 2023-07-06T22:18:16.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.485+0000 7ff3c27fc640 1 -- 172.21.15.55:0/3267305812 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80acb20 con 0x7ff3c40ccb70 2023-07-06T22:18:16.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.485+0000 7ff3ca207640 1 -- 172.21.15.55:0/3267305812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40ccb70 msgr2=0x7ff3c40c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:16.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.485+0000 7ff3ca207640 1 --2- 172.21.15.55:0/3267305812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40ccb70 0x7ff3c40c9f60 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009870 tx=0x7ff3b801c500 comp rx=0 tx=0).stop 2023-07-06T22:18:16.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.485+0000 7ff3ca207640 1 -- 172.21.15.55:0/3267305812 shutdown_connections 2023-07-06T22:18:16.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.485+0000 7ff3ca207640 1 --2- 172.21.15.55:0/3267305812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40ccb70 0x7ff3c40c9f60 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:16.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.485+0000 7ff3ca207640 1 --2- 172.21.15.55:0/3267305812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3c40c9b90 0x7ff3c415dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:16.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.485+0000 7ff3ca207640 1 -- 172.21.15.55:0/3267305812 >> 172.21.15.55:0/3267305812 conn(0x7ff3c40cde30 msgr2=0x7ff3c40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:16.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.485+0000 7ff3ca207640 1 -- 172.21.15.55:0/3267305812 shutdown_connections 2023-07-06T22:18:16.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.485+0000 7ff3ca207640 1 -- 172.21.15.55:0/3267305812 wait complete. 2023-07-06T22:18:16.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3ca207640 1 Processor -- start 2023-07-06T22:18:16.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3ca207640 1 -- start start 2023-07-06T22:18:16.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3ca207640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3c4070410 0x7ff3c4162880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:16.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3ca207640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40c9b90 0x7ff3c4162dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:16.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3ca207640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3c40ccb70 0x7ff3c406c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:16.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3ca207640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c4153cf0 con 0x7ff3c40c9b90 2023-07-06T22:18:16.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3ca207640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c4153a10 con 0x7ff3c4070410 2023-07-06T22:18:16.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3ca207640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c406b420 con 0x7ff3c40ccb70 2023-07-06T22:18:16.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3c2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40c9b90 0x7ff3c4162dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:16.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3c2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40c9b90 0x7ff3c4162dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43748/0 (socket says 172.21.15.55:43748) 2023-07-06T22:18:16.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3c2ffd640 1 -- 172.21.15.55:0/2641214710 learned_addr learned my addr 172.21.15.55:0/2641214710 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:16.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3c3fff640 1 --2- 172.21.15.55:0/2641214710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3c40ccb70 0x7ff3c406c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:16.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3c37fe640 1 --2- 172.21.15.55:0/2641214710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3c4070410 0x7ff3c4162880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:16.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3c2ffd640 1 -- 172.21.15.55:0/2641214710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3c40ccb70 msgr2=0x7ff3c406c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:16.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3c2ffd640 1 --2- 172.21.15.55:0/2641214710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3c40ccb70 0x7ff3c406c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:16.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3c2ffd640 1 -- 172.21.15.55:0/2641214710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3c4070410 msgr2=0x7ff3c4162880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:16.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3c2ffd640 1 --2- 172.21.15.55:0/2641214710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3c4070410 0x7ff3c4162880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:16.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3c2ffd640 1 -- 172.21.15.55:0/2641214710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b80094d0 con 0x7ff3c40c9b90 2023-07-06T22:18:16.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3c2ffd640 1 --2- 172.21.15.55:0/2641214710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40c9b90 0x7ff3c4162dc0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80af040 tx=0x7ff3b801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:16.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3abfff640 1 -- 172.21.15.55:0/2641214710 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80abc10 con 0x7ff3c40c9b90 2023-07-06T22:18:16.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3abfff640 1 -- 172.21.15.55:0/2641214710 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b80abd90 con 0x7ff3c40c9b90 2023-07-06T22:18:16.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3ca207640 1 -- 172.21.15.55:0/2641214710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c406b700 con 0x7ff3c40c9b90 2023-07-06T22:18:16.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.489+0000 7ff3abfff640 1 -- 172.21.15.55:0/2641214710 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80b7660 con 0x7ff3c40c9b90 2023-07-06T22:18:16.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.493+0000 7ff3ca207640 1 -- 172.21.15.55:0/2641214710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c41535a0 con 0x7ff3c40c9b90 2023-07-06T22:18:16.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.493+0000 7ff3ca207640 1 -- 172.21.15.55:0/2641214710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c4066d60 con 0x7ff3c40c9b90 2023-07-06T22:18:16.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.493+0000 7ff3abfff640 1 -- 172.21.15.55:0/2641214710 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 90) v1 ==== 85789+0+0 (secure 0 0 0) 0x7ff3b80b3040 con 0x7ff3c40c9b90 2023-07-06T22:18:16.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.493+0000 7ff3abfff640 1 --2- 172.21.15.55:0/2641214710 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7ff3b00663f0 0x7ff3b00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:16.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.493+0000 7ff3abfff640 1 -- 172.21.15.55:0/2641214710 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff3b811ec60 con 0x7ff3c40c9b90 2023-07-06T22:18:16.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.493+0000 7ff3c37fe640 1 --2- 172.21.15.55:0/2641214710 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7ff3b00663f0 0x7ff3b00688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:16.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.493+0000 7ff3c37fe640 1 --2- 172.21.15.55:0/2641214710 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7ff3b00663f0 0x7ff3b00688a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009990 tx=0x7ff3b4009110 comp rx=0 tx=0).ready entity=mgr.10080 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:16.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.497+0000 7ff3abfff640 1 -- 172.21.15.55:0/2641214710 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3b80ebc50 con 0x7ff3c40c9b90 2023-07-06T22:18:16.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.673+0000 7ff3ca207640 1 -- 172.21.15.55:0/2641214710 --> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3c40c8a20 con 0x7ff3b00663f0 2023-07-06T22:18:16.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.737+0000 7ff3abfff640 1 -- 172.21.15.55:0/2641214710 <== mgr.10080 v2:172.21.15.55:6832/2366924175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7ff3b40095e0 con 0x7ff3b00663f0 2023-07-06T22:18:16.741 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-07-06T22:18:16.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.737+0000 7ff3ca207640 1 -- 172.21.15.55:0/2641214710 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7ff3b00663f0 msgr2=0x7ff3b00688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:16.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.737+0000 7ff3ca207640 1 --2- 172.21.15.55:0/2641214710 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7ff3b00663f0 0x7ff3b00688a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009990 tx=0x7ff3b4009110 comp rx=0 tx=0).stop 2023-07-06T22:18:16.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.737+0000 7ff3ca207640 1 -- 172.21.15.55:0/2641214710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40c9b90 msgr2=0x7ff3c4162dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:16.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.737+0000 7ff3ca207640 1 --2- 172.21.15.55:0/2641214710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40c9b90 0x7ff3c4162dc0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80af040 tx=0x7ff3b801ad40 comp rx=0 tx=0).stop 2023-07-06T22:18:16.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.737+0000 7ff3ca207640 1 -- 172.21.15.55:0/2641214710 shutdown_connections 2023-07-06T22:18:16.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.737+0000 7ff3ca207640 1 --2- 172.21.15.55:0/2641214710 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7ff3b00663f0 0x7ff3b00688a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:16.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.737+0000 7ff3ca207640 1 --2- 172.21.15.55:0/2641214710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3c40ccb70 0x7ff3c406c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:16.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.737+0000 7ff3ca207640 1 --2- 172.21.15.55:0/2641214710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40c9b90 0x7ff3c4162dc0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:16.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.737+0000 7ff3ca207640 1 --2- 172.21.15.55:0/2641214710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3c4070410 0x7ff3c4162880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:16.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.737+0000 7ff3ca207640 1 -- 172.21.15.55:0/2641214710 >> 172.21.15.55:0/2641214710 conn(0x7ff3c40cde30 msgr2=0x7ff3c40aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:16.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.737+0000 7ff3ca207640 1 -- 172.21.15.55:0/2641214710 shutdown_connections 2023-07-06T22:18:16.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.737+0000 7ff3ca207640 1 -- 172.21.15.55:0/2641214710 wait complete. 2023-07-06T22:18:16.761 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-07-06T22:18:16.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:16.762 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-06T22:18:16.771 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_03_00_UTC 2023-07-06T22:18:16.772 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_04_00_UTC 2023-07-06T22:18:16.772 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_05_00_UTC 2023-07-06T22:18:16.772 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_06_00_UTC 2023-07-06T22:18:16.772 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_07_00_UTC 2023-07-06T22:18:16.772 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_08_00_UTC 2023-07-06T22:18:16.772 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_09_00_UTC 2023-07-06T22:18:16.773 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_10_00_UTC 2023-07-06T22:18:16.773 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_11_00_UTC 2023-07-06T22:18:16.773 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_12_00_UTC 2023-07-06T22:18:16.773 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_13_00_UTC 2023-07-06T22:18:16.773 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_14_00_UTC 2023-07-06T22:18:16.773 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_15_00_UTC 2023-07-06T22:18:16.773 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_16_00_UTC 2023-07-06T22:18:16.773 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_17_00_UTC 2023-07-06T22:18:16.774 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_18_00_UTC 2023-07-06T22:18:16.774 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-06-22_03_00_UTC', 'scheduled-2023-07-06-22_04_00_UTC', 'scheduled-2023-07-06-22_05_00_UTC', 'scheduled-2023-07-06-22_06_00_UTC', 'scheduled-2023-07-06-22_07_00_UTC', 'scheduled-2023-07-06-22_08_00_UTC', 'scheduled-2023-07-06-22_09_00_UTC', 'scheduled-2023-07-06-22_10_00_UTC', 'scheduled-2023-07-06-22_11_00_UTC', 'scheduled-2023-07-06-22_12_00_UTC', 'scheduled-2023-07-06-22_13_00_UTC', 'scheduled-2023-07-06-22_14_00_UTC', 'scheduled-2023-07-06-22_15_00_UTC', 'scheduled-2023-07-06-22_16_00_UTC', 'scheduled-2023-07-06-22_17_00_UTC', 'scheduled-2023-07-06-22_18_00_UTC'] 2023-07-06T22:18:16.775 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-07-06T22:18:16.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f535a2d8640 1 Processor -- start 2023-07-06T22:18:16.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f535a2d8640 1 -- start start 2023-07-06T22:18:16.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f535a2d8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f53540cbfa0 0x7f535406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:16.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f535a2d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5354158b50 con 0x7f53540c89b0 2023-07-06T22:18:16.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f535a2d8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535406b390 con 0x7f5354158780 2023-07-06T22:18:16.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f535a2d8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535406b630 con 0x7f53540cbfa0 2023-07-06T22:18:16.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f5358875640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f53540c89b0 0x7f535406c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52788/0 (socket says 172.21.15.55:52788) 2023-07-06T22:18:16.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f5358875640 1 -- 172.21.15.55:0/3683468536 learned_addr learned my addr 172.21.15.55:0/3683468536 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:16.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f53537fe640 1 --2- 172.21.15.55:0/3683468536 >> v2:172.21.15.138:3300/0 conn(0x7f53540cbfa0 0x7f535406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:16.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f5352ffd640 1 -- 172.21.15.55:0/3683468536 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586057150 0 0) 0x7f5354158b50 con 0x7f53540c89b0 2023-07-06T22:18:16.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f5352ffd640 1 -- 172.21.15.55:0/3683468536 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f533c003530 con 0x7f53540c89b0 2023-07-06T22:18:16.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f5352ffd640 1 -- 172.21.15.55:0/3683468536 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075599974 0 0) 0x7f535406b390 con 0x7f5354158780 2023-07-06T22:18:16.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f5352ffd640 1 -- 172.21.15.55:0/3683468536 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5354158b50 con 0x7f5354158780 2023-07-06T22:18:16.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f53537fe640 1 -- 172.21.15.55:0/3683468536 >> v1:172.21.15.138:6789/0 conn(0x7f5354158780 legacy=0x7f53540cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:16.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f53537fe640 1 -- 172.21.15.55:0/3683468536 >> v1:172.21.15.55:6789/0 conn(0x7f53540c89b0 legacy=0x7f535406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:16.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.957+0000 7f53537fe640 1 -- 172.21.15.55:0/3683468536 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535406b910 con 0x7f53540cbfa0 2023-07-06T22:18:16.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.961+0000 7f53537fe640 1 --2- 172.21.15.55:0/3683468536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53540cbfa0 0x7f535406f3f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f53480097c0 tx=0x7f534801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=386d277a2ac1d617 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:16.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.961+0000 7f5352ffd640 1 -- 172.21.15.55:0/3683468536 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53480ab600 con 0x7f53540cbfa0 2023-07-06T22:18:16.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.961+0000 7f5352ffd640 1 -- 172.21.15.55:0/3683468536 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53480a7050 con 0x7f53540cbfa0 2023-07-06T22:18:16.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.961+0000 7f5352ffd640 1 -- 172.21.15.55:0/3683468536 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53480ab980 con 0x7f53540cbfa0 2023-07-06T22:18:16.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.961+0000 7f535a2d8640 1 -- 172.21.15.55:0/3683468536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53540cbfa0 msgr2=0x7f535406f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:16.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.961+0000 7f535a2d8640 1 --2- 172.21.15.55:0/3683468536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53540cbfa0 0x7f535406f3f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f53480097c0 tx=0x7f534801c3f0 comp rx=0 tx=0).stop 2023-07-06T22:18:16.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.961+0000 7f535a2d8640 1 -- 172.21.15.55:0/3683468536 shutdown_connections 2023-07-06T22:18:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.961+0000 7f535a2d8640 1 --2- 172.21.15.55:0/3683468536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53540cbfa0 0x7f535406f3f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.961+0000 7f535a2d8640 1 -- 172.21.15.55:0/3683468536 >> 172.21.15.55:0/3683468536 conn(0x7f53540cde30 msgr2=0x7f53540ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.961+0000 7f535a2d8640 1 -- 172.21.15.55:0/3683468536 shutdown_connections 2023-07-06T22:18:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.961+0000 7f535a2d8640 1 -- 172.21.15.55:0/3683468536 wait complete. 2023-07-06T22:18:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f535a2d8640 1 Processor -- start 2023-07-06T22:18:16.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f535a2d8640 1 -- start start 2023-07-06T22:18:16.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f535a2d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53540c89b0 0x7f53540aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:16.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f535a2d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53540cbfa0 0x7f535414e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:16.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f535a2d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5354158780 0x7f535414fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f535a2d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53540ad2e0 con 0x7f53540c89b0 2023-07-06T22:18:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f535a2d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53540acdb0 con 0x7f5354158780 2023-07-06T22:18:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f535a2d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53540ad000 con 0x7f53540cbfa0 2023-07-06T22:18:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f5353fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53540c89b0 0x7f53540aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f5353fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53540c89b0 0x7f53540aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43756/0 (socket says 172.21.15.55:43756) 2023-07-06T22:18:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f5353fff640 1 -- 172.21.15.55:0/1921363874 learned_addr learned my addr 172.21.15.55:0/1921363874 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f5358875640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5354158780 0x7f535414fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f53537fe640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53540cbfa0 0x7f535414e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f5353fff640 1 -- 172.21.15.55:0/1921363874 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53540cbfa0 msgr2=0x7f535414e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:16.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f5353fff640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53540cbfa0 0x7f535414e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:16.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f5353fff640 1 -- 172.21.15.55:0/1921363874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5354158780 msgr2=0x7f535414fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:16.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f5353fff640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5354158780 0x7f535414fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:16.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f5353fff640 1 -- 172.21.15.55:0/1921363874 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5348009420 con 0x7f53540c89b0 2023-07-06T22:18:16.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f5358875640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5354158780 0x7f535414fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:16.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f53537fe640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53540cbfa0 0x7f535414e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:16.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f5353fff640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53540c89b0 0x7f53540aeb10 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f534400c460 tx=0x7f534400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:16.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f5350ff9640 1 -- 172.21.15.55:0/1921363874 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440052d0 con 0x7f53540c89b0 2023-07-06T22:18:16.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f5350ff9640 1 -- 172.21.15.55:0/1921363874 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5344005450 con 0x7f53540c89b0 2023-07-06T22:18:16.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f5350ff9640 1 -- 172.21.15.55:0/1921363874 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5344012870 con 0x7f53540c89b0 2023-07-06T22:18:16.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f535a2d8640 1 -- 172.21.15.55:0/1921363874 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53540b2730 con 0x7f53540c89b0 2023-07-06T22:18:16.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.965+0000 7f535a2d8640 1 -- 172.21.15.55:0/1921363874 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53540b2cf0 con 0x7f53540c89b0 2023-07-06T22:18:16.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.969+0000 7f535a2d8640 1 -- 172.21.15.55:0/1921363874 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53540b2590 con 0x7f53540c89b0 2023-07-06T22:18:16.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.969+0000 7f5350ff9640 1 -- 172.21.15.55:0/1921363874 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 90) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f53440129d0 con 0x7f53540c89b0 2023-07-06T22:18:16.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.969+0000 7f5350ff9640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f53400663f0 0x7f53400688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:16.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.969+0000 7f5350ff9640 1 -- 172.21.15.55:0/1921363874 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5344083fa0 con 0x7f53540c89b0 2023-07-06T22:18:16.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.969+0000 7f53537fe640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f53400663f0 0x7f53400688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.969+0000 7f53537fe640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f53400663f0 0x7f53400688a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f53480ad000 tx=0x7f5348008040 comp rx=0 tx=0).ready entity=mgr.10080 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:16.973+0000 7f5350ff9640 1 -- 172.21.15.55:0/1921363874 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f53540b2590 con 0x7f53540c89b0 2023-07-06T22:18:17.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.145+0000 7f535a2d8640 1 -- 172.21.15.55:0/1921363874 --> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f535406f930 con 0x7f53400663f0 2023-07-06T22:18:17.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.153+0000 7f5350ff9640 1 -- 172.21.15.55:0/1921363874 <== mgr.10080 v2:172.21.15.55:6832/2366924175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7f53480ab780 con 0x7f53400663f0 2023-07-06T22:18:17.159 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:17.159 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T22:02:29", "first": "2023-07-06T22:03:00", "last": "2023-07-06T22:18:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-07-06T22:18:17.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.157+0000 7f535a2d8640 1 -- 172.21.15.55:0/1921363874 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f53400663f0 msgr2=0x7f53400688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:17.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.157+0000 7f535a2d8640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f53400663f0 0x7f53400688a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f53480ad000 tx=0x7f5348008040 comp rx=0 tx=0).stop 2023-07-06T22:18:17.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.157+0000 7f535a2d8640 1 -- 172.21.15.55:0/1921363874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53540c89b0 msgr2=0x7f53540aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:17.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.157+0000 7f535a2d8640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53540c89b0 0x7f53540aeb10 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f534400c460 tx=0x7f534400c920 comp rx=0 tx=0).stop 2023-07-06T22:18:17.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.157+0000 7f535a2d8640 1 -- 172.21.15.55:0/1921363874 shutdown_connections 2023-07-06T22:18:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.157+0000 7f535a2d8640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f53400663f0 0x7f53400688a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.157+0000 7f535a2d8640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5354158780 0x7f535414fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.157+0000 7f535a2d8640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53540cbfa0 0x7f535414e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.157+0000 7f535a2d8640 1 --2- 172.21.15.55:0/1921363874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53540c89b0 0x7f53540aeb10 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.157+0000 7f535a2d8640 1 -- 172.21.15.55:0/1921363874 >> 172.21.15.55:0/1921363874 conn(0x7f53540cde30 msgr2=0x7f5354151900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.157+0000 7f535a2d8640 1 -- 172.21.15.55:0/1921363874 shutdown_connections 2023-07-06T22:18:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.157+0000 7f535a2d8640 1 -- 172.21.15.55:0/1921363874 wait complete. 2023-07-06T22:18:17.179 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-06T00:00:00", "created": "2023-07-06T22:02:29", "first": "2023-07-06T22:03:00", "last": "2023-07-06T22:18:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-07-06T22:18:17.180 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-07-06T00:00:00', 'created': '2023-07-06T22:02:29', 'first': '2023-07-06T22:03:00', 'last': '2023-07-06T22:18:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-07-06T22:18:17.180 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-06T22:18:17.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.321+0000 7f48ba0ec640 1 Processor -- start 2023-07-06T22:18:17.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.321+0000 7f48ba0ec640 1 -- start start 2023-07-06T22:18:17.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48ba0ec640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f48b40ccb70 0x7f48b415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:17.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48ba0ec640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b40b3e70 con 0x7f48b40c9b90 2023-07-06T22:18:17.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48ba0ec640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b4159c30 con 0x7f48b40693f0 2023-07-06T22:18:17.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48ba0ec640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40c9070 con 0x7f48b40ccb70 2023-07-06T22:18:17.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f48b40c9b90 0x7f48b40c9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52796/0 (socket says 172.21.15.55:52796) 2023-07-06T22:18:17.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b37fe640 1 -- 172.21.15.55:0/2665156586 learned_addr learned my addr 172.21.15.55:0/2665156586 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:17.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b2ffd640 1 --2- 172.21.15.55:0/2665156586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f48b40ccb70 0x7f48b415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:17.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190885756 0 0) 0x7f48a4001120 con 0x7f48b40c9b90 2023-07-06T22:18:17.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f489c003530 con 0x7f48b40c9b90 2023-07-06T22:18:17.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316988833 0 0) 0x7f48b4159c30 con 0x7f48b40693f0 2023-07-06T22:18:17.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a4001120 con 0x7f48b40693f0 2023-07-06T22:18:17.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 173795199 0 0) 0x7f489c003530 con 0x7f48b40c9b90 2023-07-06T22:18:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f48b40ccb70 msgr2=0x7f48b415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 --2- 172.21.15.55:0/2665156586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f48b40ccb70 0x7f48b415dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 >> v1:172.21.15.138:6789/0 conn(0x7f48b40693f0 legacy=0x7f48b4069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b40c8480 con 0x7f48b40c9b90 2023-07-06T22:18:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f48a4001810 con 0x7f48b40c9b90 2023-07-06T22:18:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 >> v1:172.21.15.55:6789/0 conn(0x7f48b40c9b90 legacy=0x7f48b40c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 --2- 172.21.15.55:0/2665156586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f48b40ccb70 0x7f489c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 --2- 172.21.15.55:0/2665156586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f489c0040a0 0x7f489c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 --2- 172.21.15.55:0/2665156586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c004d10 0x7f489c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40c9070 con 0x7f489c004d10 2023-07-06T22:18:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c00ba40 con 0x7f489c0040a0 2023-07-06T22:18:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c00bc00 con 0x7f48b40ccb70 2023-07-06T22:18:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b3fff640 1 --2- 172.21.15.55:0/2665156586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c004d10 0x7f489c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b2ffd640 1 --2- 172.21.15.55:0/2665156586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f489c0040a0 0x7f489c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b37fe640 1 --2- 172.21.15.55:0/2665156586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f48b40ccb70 0x7f489c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:17.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b3fff640 1 -- 172.21.15.55:0/2665156586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f48b40ccb70 msgr2=0x7f489c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:17.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b3fff640 1 --2- 172.21.15.55:0/2665156586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f48b40ccb70 0x7f489c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:17.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b3fff640 1 -- 172.21.15.55:0/2665156586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f489c0040a0 msgr2=0x7f489c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:17.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b3fff640 1 --2- 172.21.15.55:0/2665156586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f489c0040a0 0x7f489c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:17.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.325+0000 7f48b3fff640 1 -- 172.21.15.55:0/2665156586 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c003530 con 0x7f489c004d10 2023-07-06T22:18:17.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.329+0000 7f48b3fff640 1 --2- 172.21.15.55:0/2665156586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c004d10 0x7f489c005180 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f48ac007fd0 tx=0x7f48ac01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c622fcd0ad7f217f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:17.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.329+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac003b80 con 0x7f489c004d10 2023-07-06T22:18:17.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.329+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac003d00 con 0x7f489c004d10 2023-07-06T22:18:17.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.329+0000 7f48b27fc640 1 -- 172.21.15.55:0/2665156586 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac005310 con 0x7f489c004d10 2023-07-06T22:18:17.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.329+0000 7f48ba0ec640 1 -- 172.21.15.55:0/2665156586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c004d10 msgr2=0x7f489c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:17.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.329+0000 7f48ba0ec640 1 --2- 172.21.15.55:0/2665156586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c004d10 0x7f489c005180 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f48ac007fd0 tx=0x7f48ac01c8c0 comp rx=0 tx=0).stop 2023-07-06T22:18:17.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.329+0000 7f48b3fff640 1 -- 172.21.15.55:0/2665156586 reap_dead start 2023-07-06T22:18:17.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.329+0000 7f48ba0ec640 1 -- 172.21.15.55:0/2665156586 shutdown_connections 2023-07-06T22:18:17.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.329+0000 7f48ba0ec640 1 -- 172.21.15.55:0/2665156586 >> 172.21.15.55:0/2665156586 conn(0x7f48b40cde30 msgr2=0x7f48b40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:17.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.329+0000 7f48ba0ec640 1 -- 172.21.15.55:0/2665156586 shutdown_connections 2023-07-06T22:18:17.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.329+0000 7f48ba0ec640 1 -- 172.21.15.55:0/2665156586 wait complete. 2023-07-06T22:18:17.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48ba0ec640 1 Processor -- start 2023-07-06T22:18:17.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48ba0ec640 1 -- start start 2023-07-06T22:18:17.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48ba0ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48b4155170 0x7f48b4159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:17.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48ba0ec640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f48b40c4f00 0x7f48b415c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:17.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48ba0ec640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f48b40c5cd0 0x7f48b40c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:17.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48ba0ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40c6680 con 0x7f48b4155170 2023-07-06T22:18:17.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48ba0ec640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b406b8e0 con 0x7f48b40c5cd0 2023-07-06T22:18:17.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48ba0ec640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b406c180 con 0x7f48b40c4f00 2023-07-06T22:18:17.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48b37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48b4155170 0x7f48b4159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:17.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48b37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48b4155170 0x7f48b4159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43772/0 (socket says 172.21.15.55:43772) 2023-07-06T22:18:17.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48b37fe640 1 -- 172.21.15.55:0/614760731 learned_addr learned my addr 172.21.15.55:0/614760731 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:17.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48b3fff640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f48b40c5cd0 0x7f48b40c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:17.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48b2ffd640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f48b40c4f00 0x7f48b415c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:17.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48b37fe640 1 -- 172.21.15.55:0/614760731 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f48b40c4f00 msgr2=0x7f48b415c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:17.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48b37fe640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f48b40c4f00 0x7f48b415c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:17.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48b37fe640 1 -- 172.21.15.55:0/614760731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f48b40c5cd0 msgr2=0x7f48b40c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:17.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48b37fe640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f48b40c5cd0 0x7f48b40c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:17.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48b37fe640 1 -- 172.21.15.55:0/614760731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b40c5470 con 0x7f48b4155170 2023-07-06T22:18:17.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48b2ffd640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f48b40c4f00 0x7f48b415c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:17.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48b37fe640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48b4155170 0x7f48b4159c30 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f48a40125a0 tx=0x7f48a4012a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:17.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f489bfff640 1 -- 172.21.15.55:0/614760731 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4014810 con 0x7f48b4155170 2023-07-06T22:18:17.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f489bfff640 1 -- 172.21.15.55:0/614760731 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a4014990 con 0x7f48b4155170 2023-07-06T22:18:17.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f489bfff640 1 -- 172.21.15.55:0/614760731 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4014d40 con 0x7f48b4155170 2023-07-06T22:18:17.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48ba0ec640 1 -- 172.21.15.55:0/614760731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b406bb30 con 0x7f48b4155170 2023-07-06T22:18:17.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48ba0ec640 1 -- 172.21.15.55:0/614760731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b4155540 con 0x7f48b4155170 2023-07-06T22:18:17.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.333+0000 7f48ba0ec640 1 -- 172.21.15.55:0/614760731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b4066d60 con 0x7f48b4155170 2023-07-06T22:18:17.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.337+0000 7f489bfff640 1 -- 172.21.15.55:0/614760731 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 90) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f48a4016480 con 0x7f48b4155170 2023-07-06T22:18:17.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.337+0000 7f489bfff640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f48a00663f0 0x7f48a00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.337+0000 7f489bfff640 1 -- 172.21.15.55:0/614760731 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f48a40875d0 con 0x7f48b4155170 2023-07-06T22:18:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.337+0000 7f48b2ffd640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f48a00663f0 0x7f48a00688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.337+0000 7f48b2ffd640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f48a00663f0 0x7f48a00688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f48b40b26c0 tx=0x7f48a8008040 comp rx=0 tx=0).ready entity=mgr.10080 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:17.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.341+0000 7f489bfff640 1 -- 172.21.15.55:0/614760731 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48a4054470 con 0x7f48b4155170 2023-07-06T22:18:17.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.513+0000 7f48ba0ec640 1 -- 172.21.15.55:0/614760731 --> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f48b40c8a20 con 0x7f48a00663f0 2023-07-06T22:18:17.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.577+0000 7f489bfff640 1 -- 172.21.15.55:0/614760731 <== mgr.10080 v2:172.21.15.55:6832/2366924175 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7f48a8009850 con 0x7f48a00663f0 2023-07-06T22:18:17.583 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-07-06T22:18:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.581+0000 7f48ba0ec640 1 -- 172.21.15.55:0/614760731 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f48a00663f0 msgr2=0x7f48a00688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.581+0000 7f48ba0ec640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f48a00663f0 0x7f48a00688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f48b40b26c0 tx=0x7f48a8008040 comp rx=0 tx=0).stop 2023-07-06T22:18:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.581+0000 7f48ba0ec640 1 -- 172.21.15.55:0/614760731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48b4155170 msgr2=0x7f48b4159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.581+0000 7f48ba0ec640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48b4155170 0x7f48b4159c30 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f48a40125a0 tx=0x7f48a4012a60 comp rx=0 tx=0).stop 2023-07-06T22:18:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.581+0000 7f48ba0ec640 1 -- 172.21.15.55:0/614760731 shutdown_connections 2023-07-06T22:18:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.581+0000 7f48ba0ec640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f48a00663f0 0x7f48a00688a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.581+0000 7f48ba0ec640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f48b40c5cd0 0x7f48b40c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.581+0000 7f48ba0ec640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f48b40c4f00 0x7f48b415c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.581+0000 7f48ba0ec640 1 --2- 172.21.15.55:0/614760731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48b4155170 0x7f48b4159c30 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:17.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.581+0000 7f48ba0ec640 1 -- 172.21.15.55:0/614760731 >> 172.21.15.55:0/614760731 conn(0x7f48b40cde30 msgr2=0x7f48b415d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:17.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.581+0000 7f48ba0ec640 1 -- 172.21.15.55:0/614760731 shutdown_connections 2023-07-06T22:18:17.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:17.581+0000 7f48ba0ec640 1 -- 172.21.15.55:0/614760731 wait complete. 2023-07-06T22:18:17.604 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-07-06T22:18:17.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:17.605 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-06T22:18:17.614 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_03_00_UTC 2023-07-06T22:18:17.615 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_04_00_UTC 2023-07-06T22:18:17.615 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_05_00_UTC 2023-07-06T22:18:17.615 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_06_00_UTC 2023-07-06T22:18:17.615 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_07_00_UTC 2023-07-06T22:18:17.615 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_08_00_UTC 2023-07-06T22:18:17.615 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_09_00_UTC 2023-07-06T22:18:17.615 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_10_00_UTC 2023-07-06T22:18:17.616 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_11_00_UTC 2023-07-06T22:18:17.616 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_12_00_UTC 2023-07-06T22:18:17.616 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_13_00_UTC 2023-07-06T22:18:17.616 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_14_00_UTC 2023-07-06T22:18:17.616 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_15_00_UTC 2023-07-06T22:18:17.616 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_16_00_UTC 2023-07-06T22:18:17.616 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_17_00_UTC 2023-07-06T22:18:17.617 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_18_00_UTC 2023-07-06T22:18:17.617 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_03_00_UTC 2023-07-06T22:18:17.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:17.618 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_03_00_UTC) 2023-07-06T22:18:17.674 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_04_00_UTC 2023-07-06T22:18:17.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:17.674 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_04_00_UTC) 2023-07-06T22:18:17.736 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_05_00_UTC 2023-07-06T22:18:17.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:17.737 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_05_00_UTC) 2023-07-06T22:18:17.793 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_06_00_UTC 2023-07-06T22:18:17.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:17.793 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_06_00_UTC) 2023-07-06T22:18:17.849 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_07_00_UTC 2023-07-06T22:18:17.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:17.849 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_07_00_UTC) 2023-07-06T22:18:17.904 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_08_00_UTC 2023-07-06T22:18:17.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:17.905 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_08_00_UTC) 2023-07-06T22:18:17.960 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_09_00_UTC 2023-07-06T22:18:17.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:17.961 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_09_00_UTC) 2023-07-06T22:18:18.017 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_10_00_UTC 2023-07-06T22:18:18.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:18.017 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_10_00_UTC) 2023-07-06T22:18:18.073 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_11_00_UTC 2023-07-06T22:18:18.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:18.074 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_11_00_UTC) 2023-07-06T22:18:18.132 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_12_00_UTC 2023-07-06T22:18:18.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:18.133 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_12_00_UTC) 2023-07-06T22:18:18.196 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_13_00_UTC 2023-07-06T22:18:18.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:18.196 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_13_00_UTC) 2023-07-06T22:18:18.254 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_14_00_UTC 2023-07-06T22:18:18.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:18.255 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_14_00_UTC) 2023-07-06T22:18:18.312 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_15_00_UTC 2023-07-06T22:18:18.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:18.312 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_15_00_UTC) 2023-07-06T22:18:18.369 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_16_00_UTC 2023-07-06T22:18:18.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:18.369 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_16_00_UTC) 2023-07-06T22:18:18.438 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_17_00_UTC 2023-07-06T22:18:18.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:18.439 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_17_00_UTC) 2023-07-06T22:18:18.493 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_18_00_UTC 2023-07-06T22:18:18.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:18.494 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-06-22_18_00_UTC) 2023-07-06T22:18:18.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:18.550 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-07-06T22:18:18.602 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-06T22:18:18.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b82f40640 1 Processor -- start 2023-07-06T22:18:18.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b82f40640 1 -- start start 2023-07-06T22:18:18.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b82f40640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0b7c15ba30 0x7f0b7c0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:18.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b82f40640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b7c0ad0c0 0x7f0b7c09ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:18.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b82f40640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b7c09d340 0x7f0b7c15f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:18.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b82f40640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7c0c83a0 con 0x7f0b7c09d340 2023-07-06T22:18:18.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b82f40640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7c09d7c0 con 0x7f0b7c15ba30 2023-07-06T22:18:18.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b82f40640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0ccbb0 con 0x7f0b7c0ad0c0 2023-07-06T22:18:18.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b814dd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b7c09d340 0x7f0b7c15f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:18.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b814dd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b7c09d340 0x7f0b7c15f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43778/0 (socket says 172.21.15.55:43778) 2023-07-06T22:18:18.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b814dd640 1 -- 172.21.15.55:0/2861841799 learned_addr learned my addr 172.21.15.55:0/2861841799 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:18.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b7bfff640 1 --2- 172.21.15.55:0/2861841799 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b7c0ad0c0 0x7f0b7c09ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:18.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b80cdc640 1 --2- 172.21.15.55:0/2861841799 >> v2:172.21.15.138:3300/0 conn(0x7f0b7c15ba30 0x7f0b7c0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b814dd640 1 -- 172.21.15.55:0/2861841799 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b7c0ad0c0 msgr2=0x7f0b7c09ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b814dd640 1 --2- 172.21.15.55:0/2861841799 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b7c0ad0c0 0x7f0b7c09ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b814dd640 1 -- 172.21.15.55:0/2861841799 >> v2:172.21.15.138:3300/0 conn(0x7f0b7c15ba30 msgr2=0x7f0b7c0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b814dd640 1 --2- 172.21.15.55:0/2861841799 >> v2:172.21.15.138:3300/0 conn(0x7f0b7c15ba30 0x7f0b7c0cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b814dd640 1 -- 172.21.15.55:0/2861841799 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c0cce90 con 0x7f0b7c09d340 2023-07-06T22:18:18.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.785+0000 7f0b80cdc640 1 --2- 172.21.15.55:0/2861841799 >> v2:172.21.15.138:3300/0 conn(0x7f0b7c15ba30 0x7f0b7c0cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.789+0000 7f0b814dd640 1 --2- 172.21.15.55:0/2861841799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b7c09d340 0x7f0b7c15f6a0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c06eb40 tx=0x7f0b7401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3ee6d55a516c9f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:18.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.789+0000 7f0b7b7fe640 1 -- 172.21.15.55:0/2861841799 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740a5560 con 0x7f0b7c09d340 2023-07-06T22:18:18.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.789+0000 7f0b7b7fe640 1 -- 172.21.15.55:0/2861841799 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b740a56c0 con 0x7f0b7c09d340 2023-07-06T22:18:18.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.789+0000 7f0b7b7fe640 1 -- 172.21.15.55:0/2861841799 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740a5a50 con 0x7f0b7c09d340 2023-07-06T22:18:18.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.789+0000 7f0b82f40640 1 -- 172.21.15.55:0/2861841799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b7c09d340 msgr2=0x7f0b7c15f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:18.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.789+0000 7f0b82f40640 1 --2- 172.21.15.55:0/2861841799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b7c09d340 0x7f0b7c15f6a0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c06eb40 tx=0x7f0b7401c6e0 comp rx=0 tx=0).stop 2023-07-06T22:18:18.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.789+0000 7f0b82f40640 1 -- 172.21.15.55:0/2861841799 shutdown_connections 2023-07-06T22:18:18.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.789+0000 7f0b82f40640 1 --2- 172.21.15.55:0/2861841799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b7c09d340 0x7f0b7c15f6a0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:18.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.789+0000 7f0b82f40640 1 --2- 172.21.15.55:0/2861841799 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b7c0ad0c0 0x7f0b7c09ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:18.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.789+0000 7f0b82f40640 1 --2- 172.21.15.55:0/2861841799 >> v2:172.21.15.138:3300/0 conn(0x7f0b7c15ba30 0x7f0b7c0cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:18.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.789+0000 7f0b82f40640 1 -- 172.21.15.55:0/2861841799 >> 172.21.15.55:0/2861841799 conn(0x7f0b7c0cea70 msgr2=0x7f0b7c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:18.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.789+0000 7f0b82f40640 1 -- 172.21.15.55:0/2861841799 shutdown_connections 2023-07-06T22:18:18.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.789+0000 7f0b82f40640 1 -- 172.21.15.55:0/2861841799 wait complete. 2023-07-06T22:18:18.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.789+0000 7f0b82f40640 1 Processor -- start 2023-07-06T22:18:18.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b82f40640 1 -- start start 2023-07-06T22:18:18.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b82f40640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b7c09d340 0x7f0b7c15d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:18.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b82f40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b7c0ad0c0 0x7f0b7c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:18.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b82f40640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b7c15ba30 0x7f0b7c157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:18.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b82f40640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0c7210 con 0x7f0b7c0ad0c0 2023-07-06T22:18:18.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b82f40640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0c58c0 con 0x7f0b7c09d340 2023-07-06T22:18:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b82f40640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0c5ba0 con 0x7f0b7c15ba30 2023-07-06T22:18:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b7bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b7c0ad0c0 0x7f0b7c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b7bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b7c0ad0c0 0x7f0b7c0c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43782/0 (socket says 172.21.15.55:43782) 2023-07-06T22:18:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b7bfff640 1 -- 172.21.15.55:0/933149955 learned_addr learned my addr 172.21.15.55:0/933149955 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b80cdc640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b7c09d340 0x7f0b7c15d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b814dd640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b7c15ba30 0x7f0b7c157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b7bfff640 1 -- 172.21.15.55:0/933149955 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b7c15ba30 msgr2=0x7f0b7c157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b7bfff640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b7c15ba30 0x7f0b7c157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b7bfff640 1 -- 172.21.15.55:0/933149955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b7c09d340 msgr2=0x7f0b7c15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b7bfff640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b7c09d340 0x7f0b7c15d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b7bfff640 1 -- 172.21.15.55:0/933149955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b74009b30 con 0x7f0b7c0ad0c0 2023-07-06T22:18:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b80cdc640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b7c09d340 0x7f0b7c15d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b7bfff640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b7c0ad0c0 0x7f0b7c0c7550 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800e8b0 tx=0x7f0b6800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b797fa640 1 -- 172.21.15.55:0/933149955 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800c940 con 0x7f0b7c0ad0c0 2023-07-06T22:18:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b797fa640 1 -- 172.21.15.55:0/933149955 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6800caa0 con 0x7f0b7c0ad0c0 2023-07-06T22:18:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b82f40640 1 -- 172.21.15.55:0/933149955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7c0c5e80 con 0x7f0b7c0ad0c0 2023-07-06T22:18:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b797fa640 1 -- 172.21.15.55:0/933149955 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800ce30 con 0x7f0b7c0ad0c0 2023-07-06T22:18:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b82f40640 1 -- 172.21.15.55:0/933149955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7c0c6440 con 0x7f0b7c0ad0c0 2023-07-06T22:18:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.793+0000 7f0b82f40640 1 -- 172.21.15.55:0/933149955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7c0cc2d0 con 0x7f0b7c0ad0c0 2023-07-06T22:18:18.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.797+0000 7f0b797fa640 1 -- 172.21.15.55:0/933149955 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 90) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f0b68013470 con 0x7f0b7c0ad0c0 2023-07-06T22:18:18.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.797+0000 7f0b797fa640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f0b600663f0 0x7f0b600688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:18.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.797+0000 7f0b797fa640 1 -- 172.21.15.55:0/933149955 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0b68084530 con 0x7f0b7c0ad0c0 2023-07-06T22:18:18.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.797+0000 7f0b80cdc640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f0b600663f0 0x7f0b600688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:18.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.797+0000 7f0b80cdc640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f0b600663f0 0x7f0b600688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c15d4b0 tx=0x7f0b70008040 comp rx=0 tx=0).ready entity=mgr.10080 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:18.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.801+0000 7f0b797fa640 1 -- 172.21.15.55:0/933149955 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b68054e60 con 0x7f0b7c0ad0c0 2023-07-06T22:18:19.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:18.997+0000 7f0b82f40640 1 -- 172.21.15.55:0/933149955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f0b7c066d60 con 0x7f0b7c0ad0c0 2023-07-06T22:18:19.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.417+0000 7f0b797fa640 1 -- 172.21.15.55:0/933149955 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 91) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f0b680517a0 con 0x7f0b7c0ad0c0 2023-07-06T22:18:19.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.417+0000 7f0b797fa640 1 -- 172.21.15.55:0/933149955 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v91) v1 ==== 93+0+0 (secure 0 0 0) 0x7f0b6806df80 con 0x7f0b7c0ad0c0 2023-07-06T22:18:19.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.421+0000 7f0b82f40640 1 -- 172.21.15.55:0/933149955 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f0b600663f0 msgr2=0x7f0b600688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:19.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.421+0000 7f0b82f40640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f0b600663f0 0x7f0b600688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c15d4b0 tx=0x7f0b70008040 comp rx=0 tx=0).stop 2023-07-06T22:18:19.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.421+0000 7f0b82f40640 1 -- 172.21.15.55:0/933149955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b7c0ad0c0 msgr2=0x7f0b7c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:19.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.421+0000 7f0b82f40640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b7c0ad0c0 0x7f0b7c0c7550 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800e8b0 tx=0x7f0b6800ed70 comp rx=0 tx=0).stop 2023-07-06T22:18:19.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.421+0000 7f0b82f40640 1 -- 172.21.15.55:0/933149955 shutdown_connections 2023-07-06T22:18:19.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.421+0000 7f0b82f40640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f0b600663f0 0x7f0b600688a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:19.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.421+0000 7f0b82f40640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b7c15ba30 0x7f0b7c157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:19.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.421+0000 7f0b82f40640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b7c0ad0c0 0x7f0b7c0c7550 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:19.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.421+0000 7f0b82f40640 1 --2- 172.21.15.55:0/933149955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b7c09d340 0x7f0b7c15d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:19.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.421+0000 7f0b82f40640 1 -- 172.21.15.55:0/933149955 >> 172.21.15.55:0/933149955 conn(0x7f0b7c0cea70 msgr2=0x7f0b7c0c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:19.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.421+0000 7f0b82f40640 1 -- 172.21.15.55:0/933149955 shutdown_connections 2023-07-06T22:18:19.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.421+0000 7f0b82f40640 1 -- 172.21.15.55:0/933149955 wait complete. 2023-07-06T22:18:19.445 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T22:18:19.446 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:18:19.506 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:18:19.554 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T22:18:19.554 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:18:19.554 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:18:19.563 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:18:19.564 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:18:19.592 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:19.590+0000 7fb314076180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:18:19.602 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:19.597+0000 7f1478884180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:18:19.611 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:18:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.789+0000 7fa711434640 1 Processor -- start 2023-07-06T22:18:19.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.789+0000 7fa711434640 1 -- start start 2023-07-06T22:18:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.793+0000 7fa711434640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa70c06f2e0 0x7fa70c0cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.793+0000 7fa711434640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70c0cfe40 con 0x7fa70c0cf9c0 2023-07-06T22:18:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.793+0000 7fa711434640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70c15f750 con 0x7fa70c15bc30 2023-07-06T22:18:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.793+0000 7fa711434640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70c0cc800 con 0x7fa70c06f2e0 2023-07-06T22:18:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.793+0000 7fa70b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa70c0cf9c0 0x7fa70c0ce0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52800/0 (socket says 172.21.15.55:52800) 2023-07-06T22:18:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.793+0000 7fa70b7fe640 1 -- 172.21.15.55:0/3464862564 learned_addr learned my addr 172.21.15.55:0/3464862564 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.793+0000 7fa703fff640 1 --2- 172.21.15.55:0/3464862564 >> v2:172.21.15.138:3300/0 conn(0x7fa70c06f2e0 0x7fa70c0cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.793+0000 7fa70a7fc640 1 -- 172.21.15.55:0/3464862564 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160252567 0 0) 0x7fa70c0cfe40 con 0x7fa70c0cf9c0 2023-07-06T22:18:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.793+0000 7fa70a7fc640 1 -- 172.21.15.55:0/3464862564 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6f8003530 con 0x7fa70c0cf9c0 2023-07-06T22:18:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.793+0000 7fa70a7fc640 1 -- 172.21.15.55:0/3464862564 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211861986 0 0) 0x7fa70c15f750 con 0x7fa70c15bc30 2023-07-06T22:18:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.793+0000 7fa70a7fc640 1 -- 172.21.15.55:0/3464862564 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa70c0cfe40 con 0x7fa70c15bc30 2023-07-06T22:18:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.793+0000 7fa703fff640 1 -- 172.21.15.55:0/3464862564 >> v1:172.21.15.138:6789/0 conn(0x7fa70c15bc30 legacy=0x7fa70c06ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.793+0000 7fa703fff640 1 -- 172.21.15.55:0/3464862564 >> v1:172.21.15.55:6789/0 conn(0x7fa70c0cf9c0 legacy=0x7fa70c0ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.793+0000 7fa703fff640 1 -- 172.21.15.55:0/3464862564 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c15fa30 con 0x7fa70c06f2e0 2023-07-06T22:18:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.797+0000 7fa703fff640 1 --2- 172.21.15.55:0/3464862564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa70c06f2e0 0x7fa70c0cf480 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40097c0 tx=0x7fa6f401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=382e72b882224fc2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.797+0000 7fa70a7fc640 1 -- 172.21.15.55:0/3464862564 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40ab650 con 0x7fa70c06f2e0 2023-07-06T22:18:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.797+0000 7fa70a7fc640 1 -- 172.21.15.55:0/3464862564 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f40ab7b0 con 0x7fa70c06f2e0 2023-07-06T22:18:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.797+0000 7fa70a7fc640 1 -- 172.21.15.55:0/3464862564 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40abb40 con 0x7fa70c06f2e0 2023-07-06T22:18:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.797+0000 7fa711434640 1 -- 172.21.15.55:0/3464862564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa70c06f2e0 msgr2=0x7fa70c0cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.797+0000 7fa711434640 1 --2- 172.21.15.55:0/3464862564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa70c06f2e0 0x7fa70c0cf480 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40097c0 tx=0x7fa6f401c450 comp rx=0 tx=0).stop 2023-07-06T22:18:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.797+0000 7fa711434640 1 -- 172.21.15.55:0/3464862564 shutdown_connections 2023-07-06T22:18:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.797+0000 7fa711434640 1 --2- 172.21.15.55:0/3464862564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa70c06f2e0 0x7fa70c0cf480 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.797+0000 7fa711434640 1 -- 172.21.15.55:0/3464862564 >> 172.21.15.55:0/3464862564 conn(0x7fa70c0b2840 msgr2=0x7fa70c0d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.797+0000 7fa711434640 1 -- 172.21.15.55:0/3464862564 shutdown_connections 2023-07-06T22:18:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.797+0000 7fa711434640 1 -- 172.21.15.55:0/3464862564 wait complete. 2023-07-06T22:18:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.797+0000 7fa711434640 1 Processor -- start 2023-07-06T22:18:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa711434640 1 -- start start 2023-07-06T22:18:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa711434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa70c06f2e0 0x7fa70c14c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa711434640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa70c0cf9c0 0x7fa70c15a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa711434640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa70c15bc30 0x7fa70c15ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa711434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c14f640 con 0x7fa70c06f2e0 2023-07-06T22:18:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa711434640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c14f080 con 0x7fa70c15bc30 2023-07-06T22:18:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa711434640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c14f360 con 0x7fa70c0cf9c0 2023-07-06T22:18:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa70affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa70c06f2e0 0x7fa70c14c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa70affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa70c06f2e0 0x7fa70c14c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43790/0 (socket says 172.21.15.55:43790) 2023-07-06T22:18:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa70affd640 1 -- 172.21.15.55:0/2169619160 learned_addr learned my addr 172.21.15.55:0/2169619160 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa70b7fe640 1 --2- 172.21.15.55:0/2169619160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa70c15bc30 0x7fa70c15ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:19.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa703fff640 1 --2- 172.21.15.55:0/2169619160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa70c0cf9c0 0x7fa70c15a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:19.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa70affd640 1 -- 172.21.15.55:0/2169619160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa70c0cf9c0 msgr2=0x7fa70c15a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:19.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa70affd640 1 --2- 172.21.15.55:0/2169619160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa70c0cf9c0 0x7fa70c15a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa70affd640 1 -- 172.21.15.55:0/2169619160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa70c15bc30 msgr2=0x7fa70c15ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa70affd640 1 --2- 172.21.15.55:0/2169619160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa70c15bc30 0x7fa70c15ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa70affd640 1 -- 172.21.15.55:0/2169619160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f4009420 con 0x7fa70c06f2e0 2023-07-06T22:18:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa70affd640 1 --2- 172.21.15.55:0/2169619160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa70c06f2e0 0x7fa70c14c7d0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00c430 tx=0x7fa6fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa7037fe640 1 -- 172.21.15.55:0/2169619160 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0052d0 con 0x7fa70c06f2e0 2023-07-06T22:18:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa7037fe640 1 -- 172.21.15.55:0/2169619160 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6fc005450 con 0x7fa70c06f2e0 2023-07-06T22:18:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa7037fe640 1 -- 172.21.15.55:0/2169619160 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc003840 con 0x7fa70c06f2e0 2023-07-06T22:18:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.801+0000 7fa711434640 1 -- 172.21.15.55:0/2169619160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70c0c4420 con 0x7fa70c06f2e0 2023-07-06T22:18:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.805+0000 7fa711434640 1 -- 172.21.15.55:0/2169619160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70c14cd10 con 0x7fa70c06f2e0 2023-07-06T22:18:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.805+0000 7fa711434640 1 -- 172.21.15.55:0/2169619160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70c0c4280 con 0x7fa70c06f2e0 2023-07-06T22:18:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.805+0000 7fa7037fe640 1 -- 172.21.15.55:0/2169619160 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 91) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fa6fc0039a0 con 0x7fa70c06f2e0 2023-07-06T22:18:19.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.805+0000 7fa7037fe640 1 --2- 172.21.15.55:0/2169619160 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fa6ec0663f0 0x7fa6ec0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:19.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.805+0000 7fa7037fe640 1 -- 172.21.15.55:0/2169619160 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa6fc083870 con 0x7fa70c06f2e0 2023-07-06T22:18:19.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.805+0000 7fa703fff640 1 -- 172.21.15.55:0/2169619160 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fa6ec0663f0 msgr2=0x7fa6ec0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/2366924175 2023-07-06T22:18:19.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.805+0000 7fa703fff640 1 --2- 172.21.15.55:0/2169619160 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fa6ec0663f0 0x7fa6ec0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:18:19.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.809+0000 7fa7037fe640 1 -- 172.21.15.55:0/2169619160 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa70c0c4280 con 0x7fa70c06f2e0 2023-07-06T22:18:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.973+0000 7fa711434640 1 -- 172.21.15.55:0/2169619160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa70c0c4280 con 0x7fa70c06f2e0 2023-07-06T22:18:19.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.973+0000 7fa7037fe640 1 -- 172.21.15.55:0/2169619160 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+19644 (secure 0 0 0) 0x7fa70c0c4280 con 0x7fa70c06f2e0 2023-07-06T22:18:19.978 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:19.978 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":164,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:13:20.216849+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:02:09.638482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-07-06T22:02:10.753761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3064152807":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/653926838":"2023-07-07T22:13:20.216819+0000","172.21.15.55:6833/3834478672":"2023-07-07T22:13:20.216819+0000","172.21.15.55:6832/3834478672":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/562346394":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/1671051159":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/959368203":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/323970277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6833/433956277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6832/433956277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/2414406270":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/3587598195":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/2664561010":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/1917520432":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/279151651":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/1806662178":"2023-07-07T22:02:28.914064+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:18:19.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.973+0000 7fa711434640 1 -- 172.21.15.55:0/2169619160 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fa6ec0663f0 msgr2=0x7fa6ec0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:18:19.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.973+0000 7fa711434640 1 --2- 172.21.15.55:0/2169619160 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fa6ec0663f0 0x7fa6ec0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:19.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.973+0000 7fa711434640 1 -- 172.21.15.55:0/2169619160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa70c06f2e0 msgr2=0x7fa70c14c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:19.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.973+0000 7fa711434640 1 --2- 172.21.15.55:0/2169619160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa70c06f2e0 0x7fa70c14c7d0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00c430 tx=0x7fa6fc00c8f0 comp rx=0 tx=0).stop 2023-07-06T22:18:19.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.973+0000 7fa711434640 1 -- 172.21.15.55:0/2169619160 shutdown_connections 2023-07-06T22:18:19.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.973+0000 7fa711434640 1 --2- 172.21.15.55:0/2169619160 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fa6ec0663f0 0x7fa6ec0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:19.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.973+0000 7fa711434640 1 --2- 172.21.15.55:0/2169619160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa70c15bc30 0x7fa70c15ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.973+0000 7fa711434640 1 --2- 172.21.15.55:0/2169619160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa70c0cf9c0 0x7fa70c15a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.973+0000 7fa711434640 1 --2- 172.21.15.55:0/2169619160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa70c06f2e0 0x7fa70c14c7d0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.973+0000 7fa711434640 1 -- 172.21.15.55:0/2169619160 >> 172.21.15.55:0/2169619160 conn(0x7fa70c0b2840 msgr2=0x7fa70c06ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.973+0000 7fa711434640 1 -- 172.21.15.55:0/2169619160 shutdown_connections 2023-07-06T22:18:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:19.973+0000 7fa711434640 1 -- 172.21.15.55:0/2169619160 wait complete. 2023-07-06T22:18:20.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T22:02:09.638482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T22:02:10.753761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:18:20.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:18:20.010 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:20.006+0000 7fb314076180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:18:20.051 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:20.045+0000 7f1478884180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:18:20.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.145+0000 7f92c9782640 1 Processor -- start 2023-07-06T22:18:20.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.145+0000 7f92c9782640 1 -- start start 2023-07-06T22:18:20.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.145+0000 7f92c9782640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92c4070020 0x7f92c40ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.145+0000 7f92c9782640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f92c40cef40 0x7f92c40c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.145+0000 7f92c9782640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c415fe80 con 0x7f92c415bb90 2023-07-06T22:18:20.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.145+0000 7f92c9782640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c415f620 con 0x7f92c4070020 2023-07-06T22:18:20.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.145+0000 7f92c9782640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c415bf60 con 0x7f92c40cef40 2023-07-06T22:18:20.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.145+0000 7f92bbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92c4070020 0x7f92c40ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.145+0000 7f92bbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92c4070020 0x7f92c40ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43798/0 (socket says 172.21.15.55:43798) 2023-07-06T22:18:20.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.145+0000 7f92bbfff640 1 -- 172.21.15.55:0/4126933183 learned_addr learned my addr 172.21.15.55:0/4126933183 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:20.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.145+0000 7f92c37fe640 1 --2- 172.21.15.55:0/4126933183 >> v2:172.21.15.138:3300/0 conn(0x7f92c40cef40 0x7f92c40c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.149+0000 7f92bbfff640 1 -- 172.21.15.55:0/4126933183 >> v2:172.21.15.138:3300/0 conn(0x7f92c40cef40 msgr2=0x7f92c40c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:20.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.149+0000 7f92bbfff640 1 --2- 172.21.15.55:0/4126933183 >> v2:172.21.15.138:3300/0 conn(0x7f92c40cef40 0x7f92c40c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.149+0000 7f92bbfff640 1 -- 172.21.15.55:0/4126933183 >> v1:172.21.15.55:6789/0 conn(0x7f92c415bb90 legacy=0x7f92c406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:20.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.149+0000 7f92bbfff640 1 -- 172.21.15.55:0/4126933183 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c40cf440 con 0x7f92c4070020 2023-07-06T22:18:20.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.149+0000 7f92bbfff640 1 --2- 172.21.15.55:0/4126933183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c4070020 0x7f92c40ce030 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f92c406aaf0 tx=0x7f92ac01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a53287f89faa3b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:20.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.149+0000 7f92c27fc640 1 -- 172.21.15.55:0/4126933183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0ab600 con 0x7f92c4070020 2023-07-06T22:18:20.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.149+0000 7f92c27fc640 1 -- 172.21.15.55:0/4126933183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac0a7050 con 0x7f92c4070020 2023-07-06T22:18:20.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.149+0000 7f92c27fc640 1 -- 172.21.15.55:0/4126933183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0ab980 con 0x7f92c4070020 2023-07-06T22:18:20.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.149+0000 7f92c9782640 1 -- 172.21.15.55:0/4126933183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c4070020 msgr2=0x7f92c40ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:20.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.149+0000 7f92c9782640 1 --2- 172.21.15.55:0/4126933183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c4070020 0x7f92c40ce030 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f92c406aaf0 tx=0x7f92ac01c500 comp rx=0 tx=0).stop 2023-07-06T22:18:20.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c9782640 1 -- 172.21.15.55:0/4126933183 shutdown_connections 2023-07-06T22:18:20.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c9782640 1 --2- 172.21.15.55:0/4126933183 >> v2:172.21.15.138:3300/0 conn(0x7f92c40cef40 0x7f92c40c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c9782640 1 --2- 172.21.15.55:0/4126933183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c4070020 0x7f92c40ce030 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c9782640 1 -- 172.21.15.55:0/4126933183 >> 172.21.15.55:0/4126933183 conn(0x7f92c40cbd70 msgr2=0x7f92c40ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:20.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c9782640 1 -- 172.21.15.55:0/4126933183 shutdown_connections 2023-07-06T22:18:20.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c9782640 1 -- 172.21.15.55:0/4126933183 wait complete. 2023-07-06T22:18:20.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c9782640 1 Processor -- start 2023-07-06T22:18:20.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c9782640 1 -- start start 2023-07-06T22:18:20.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c9782640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c4070020 0x7f92c40c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c9782640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cef40 0x7f92c414a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c9782640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c415bb90 0x7f92c40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c9782640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c414a790 con 0x7f92c40cef40 2023-07-06T22:18:20.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c9782640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40ae810 con 0x7f92c415bb90 2023-07-06T22:18:20.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c9782640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40aeaf0 con 0x7f92c4070020 2023-07-06T22:18:20.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cef40 0x7f92c414a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cef40 0x7f92c414a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43806/0 (socket says 172.21.15.55:43806) 2023-07-06T22:18:20.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92bbfff640 1 -- 172.21.15.55:0/276707077 learned_addr learned my addr 172.21.15.55:0/276707077 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:20.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c37fe640 1 --2- 172.21.15.55:0/276707077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c415bb90 0x7f92c40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/276707077 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c4070020 0x7f92c40c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92bbfff640 1 -- 172.21.15.55:0/276707077 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c4070020 msgr2=0x7f92c40c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:20.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92bbfff640 1 --2- 172.21.15.55:0/276707077 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c4070020 0x7f92c40c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92bbfff640 1 -- 172.21.15.55:0/276707077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c415bb90 msgr2=0x7f92c40adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92bbfff640 1 --2- 172.21.15.55:0/276707077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c415bb90 0x7f92c40adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92bbfff640 1 -- 172.21.15.55:0/276707077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac0094d0 con 0x7f92c40cef40 2023-07-06T22:18:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.153+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/276707077 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c4070020 0x7f92c40c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.157+0000 7f92bbfff640 1 --2- 172.21.15.55:0/276707077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cef40 0x7f92c414a250 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0ae040 tx=0x7f92ac01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.157+0000 7f92bb7fe640 1 -- 172.21.15.55:0/276707077 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0b6420 con 0x7f92c40cef40 2023-07-06T22:18:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.157+0000 7f92bb7fe640 1 -- 172.21.15.55:0/276707077 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac0b65a0 con 0x7f92c40cef40 2023-07-06T22:18:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.157+0000 7f92c9782640 1 -- 172.21.15.55:0/276707077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c40aedd0 con 0x7f92c40cef40 2023-07-06T22:18:20.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.157+0000 7f92bb7fe640 1 -- 172.21.15.55:0/276707077 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0b6950 con 0x7f92c40cef40 2023-07-06T22:18:20.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.157+0000 7f92c9782640 1 -- 172.21.15.55:0/276707077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c415a0a0 con 0x7f92c40cef40 2023-07-06T22:18:20.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.157+0000 7f92c9782640 1 -- 172.21.15.55:0/276707077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c4066d60 con 0x7f92c40cef40 2023-07-06T22:18:20.163 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:20.158+0000 7fb314076180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:18:20.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.157+0000 7f92bb7fe640 1 -- 172.21.15.55:0/276707077 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 91) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f92ac0b2040 con 0x7f92c40cef40 2023-07-06T22:18:20.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.161+0000 7f92bb7fe640 1 --2- 172.21.15.55:0/276707077 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f92a40663a0 0x7f92a4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.161+0000 7f92c2ffd640 1 -- 172.21.15.55:0/276707077 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f92a40663a0 msgr2=0x7f92a4068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/2366924175 2023-07-06T22:18:20.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.161+0000 7f92bb7fe640 1 -- 172.21.15.55:0/276707077 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f92ac11e580 con 0x7f92c40cef40 2023-07-06T22:18:20.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.161+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/276707077 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f92a40663a0 0x7f92a4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:18:20.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.161+0000 7f92bb7fe640 1 -- 172.21.15.55:0/276707077 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92ac0eb310 con 0x7f92c40cef40 2023-07-06T22:18:20.214 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:20.209+0000 7f1478884180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:18:20.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.317+0000 7f92c9782640 1 -- 172.21.15.55:0/276707077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92c40b4620 con 0x7f92c40cef40 2023-07-06T22:18:20.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.317+0000 7f92bb7fe640 1 -- 172.21.15.55:0/276707077 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v164) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92ac0ee930 con 0x7f92c40cef40 2023-07-06T22:18:20.323 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:18:20.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.321+0000 7f92c9782640 1 -- 172.21.15.55:0/276707077 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f92a40663a0 msgr2=0x7f92a4068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:18:20.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.321+0000 7f92c9782640 1 --2- 172.21.15.55:0/276707077 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f92a40663a0 0x7f92a4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.321+0000 7f92c9782640 1 -- 172.21.15.55:0/276707077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cef40 msgr2=0x7f92c414a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.321+0000 7f92c9782640 1 --2- 172.21.15.55:0/276707077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cef40 0x7f92c414a250 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0ae040 tx=0x7f92ac01ad40 comp rx=0 tx=0).stop 2023-07-06T22:18:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.321+0000 7f92c9782640 1 -- 172.21.15.55:0/276707077 shutdown_connections 2023-07-06T22:18:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.321+0000 7f92c9782640 1 --2- 172.21.15.55:0/276707077 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f92a40663a0 0x7f92a4068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.321+0000 7f92c9782640 1 --2- 172.21.15.55:0/276707077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c415bb90 0x7f92c40adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.321+0000 7f92c9782640 1 --2- 172.21.15.55:0/276707077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cef40 0x7f92c414a250 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.321+0000 7f92c9782640 1 --2- 172.21.15.55:0/276707077 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c4070020 0x7f92c40c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.321+0000 7f92c9782640 1 -- 172.21.15.55:0/276707077 >> 172.21.15.55:0/276707077 conn(0x7f92c40cbd70 msgr2=0x7f92c40c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.321+0000 7f92c9782640 1 -- 172.21.15.55:0/276707077 shutdown_connections 2023-07-06T22:18:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.321+0000 7f92c9782640 1 -- 172.21.15.55:0/276707077 wait complete. 2023-07-06T22:18:20.345 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:18:20.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.533+0000 7f6998ecb640 1 Processor -- start 2023-07-06T22:18:20.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.533+0000 7f6998ecb640 1 -- start start 2023-07-06T22:18:20.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f6998ecb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f69940b3870 0x7f69940b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f6998ecb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f69940d03c0 0x7f69940d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f6998ecb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69940b4210 con 0x7f699415b850 2023-07-06T22:18:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f6998ecb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69940b2b80 con 0x7f69940b3870 2023-07-06T22:18:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f6998ecb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69940cff30 con 0x7f69940d03c0 2023-07-06T22:18:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f698bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f69940b3870 0x7f69940b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f698bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f69940b3870 0x7f69940b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43814/0 (socket says 172.21.15.55:43814) 2023-07-06T22:18:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f698bfff640 1 -- 172.21.15.55:0/1781633780 learned_addr learned my addr 172.21.15.55:0/1781633780 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f699259c640 1 --1- 172.21.15.55:0/1781633780 >> v1:172.21.15.55:6789/0 conn(0x7f699415b850 0x7f69940cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52810/0 (socket says 172.21.15.55:52810) 2023-07-06T22:18:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f6992d9d640 1 --2- 172.21.15.55:0/1781633780 >> v2:172.21.15.138:3300/0 conn(0x7f69940d03c0 0x7f69940d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f698bfff640 1 -- 172.21.15.55:0/1781633780 >> v2:172.21.15.138:3300/0 conn(0x7f69940d03c0 msgr2=0x7f69940d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:20.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f698bfff640 1 --2- 172.21.15.55:0/1781633780 >> v2:172.21.15.138:3300/0 conn(0x7f69940d03c0 0x7f69940d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f698bfff640 1 -- 172.21.15.55:0/1781633780 >> v1:172.21.15.55:6789/0 conn(0x7f699415b850 legacy=0x7f69940cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f698bfff640 1 -- 172.21.15.55:0/1781633780 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69940b22e0 con 0x7f69940b3870 2023-07-06T22:18:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.537+0000 7f698bfff640 1 --2- 172.21.15.55:0/1781633780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69940b3870 0x7f69940b3cd0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f69940cc780 tx=0x7f697c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42965f49b23b72a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:20.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6991d9b640 1 -- 172.21.15.55:0/1781633780 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c0ac410 con 0x7f69940b3870 2023-07-06T22:18:20.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6991d9b640 1 -- 172.21.15.55:0/1781633780 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c0ac570 con 0x7f69940b3870 2023-07-06T22:18:20.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6991d9b640 1 -- 172.21.15.55:0/1781633780 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c0ac900 con 0x7f69940b3870 2023-07-06T22:18:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 -- 172.21.15.55:0/1781633780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69940b3870 msgr2=0x7f69940b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 --2- 172.21.15.55:0/1781633780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69940b3870 0x7f69940b3cd0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f69940cc780 tx=0x7f697c01c3b0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 -- 172.21.15.55:0/1781633780 shutdown_connections 2023-07-06T22:18:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 --2- 172.21.15.55:0/1781633780 >> v2:172.21.15.138:3300/0 conn(0x7f69940d03c0 0x7f69940d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 --2- 172.21.15.55:0/1781633780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69940b3870 0x7f69940b3cd0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 -- 172.21.15.55:0/1781633780 >> 172.21.15.55:0/1781633780 conn(0x7f69940cec20 msgr2=0x7f69940cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 -- 172.21.15.55:0/1781633780 shutdown_connections 2023-07-06T22:18:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 -- 172.21.15.55:0/1781633780 wait complete. 2023-07-06T22:18:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 Processor -- start 2023-07-06T22:18:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 -- start start 2023-07-06T22:18:20.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69940b3870 0x7f699415cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69940d03c0 0x7f699415e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f699415b850 0x7f6994151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699415ed80 con 0x7f69940d03c0 2023-07-06T22:18:20.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699415de70 con 0x7f69940b3870 2023-07-06T22:18:20.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.541+0000 7f6998ecb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699415d5d0 con 0x7f699415b850 2023-07-06T22:18:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f698bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69940d03c0 0x7f699415e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f699259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69940b3870 0x7f699415cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f698bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69940d03c0 0x7f699415e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43822/0 (socket says 172.21.15.55:43822) 2023-07-06T22:18:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f698bfff640 1 -- 172.21.15.55:0/2370046667 learned_addr learned my addr 172.21.15.55:0/2370046667 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f6992d9d640 1 --2- 172.21.15.55:0/2370046667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f699415b850 0x7f6994151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f698bfff640 1 -- 172.21.15.55:0/2370046667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f699415b850 msgr2=0x7f6994151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:20.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f698bfff640 1 --2- 172.21.15.55:0/2370046667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f699415b850 0x7f6994151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f698bfff640 1 -- 172.21.15.55:0/2370046667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69940b3870 msgr2=0x7f699415cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:20.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f698bfff640 1 --2- 172.21.15.55:0/2370046667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69940b3870 0x7f699415cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f698bfff640 1 -- 172.21.15.55:0/2370046667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c0094d0 con 0x7f69940d03c0 2023-07-06T22:18:20.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f698bfff640 1 --2- 172.21.15.55:0/2370046667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69940d03c0 0x7f699415e840 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f697c018fc0 tx=0x7f697c019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:20.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f698affd640 1 -- 172.21.15.55:0/2370046667 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c0ac410 con 0x7f69940d03c0 2023-07-06T22:18:20.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f698affd640 1 -- 172.21.15.55:0/2370046667 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c0ace90 con 0x7f69940d03c0 2023-07-06T22:18:20.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f698affd640 1 -- 172.21.15.55:0/2370046667 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c0b6830 con 0x7f69940d03c0 2023-07-06T22:18:20.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f6998ecb640 1 -- 172.21.15.55:0/2370046667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699415d8b0 con 0x7f69940d03c0 2023-07-06T22:18:20.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f6998ecb640 1 -- 172.21.15.55:0/2370046667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69940c93a0 con 0x7f69940d03c0 2023-07-06T22:18:20.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f6998ecb640 1 -- 172.21.15.55:0/2370046667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6994066d60 con 0x7f69940d03c0 2023-07-06T22:18:20.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.545+0000 7f698affd640 1 -- 172.21.15.55:0/2370046667 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 91) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f697c0b6990 con 0x7f69940d03c0 2023-07-06T22:18:20.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.549+0000 7f698affd640 1 --2- 172.21.15.55:0/2370046667 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f69740663d0 0x7f6974068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.549+0000 7f699259c640 1 -- 172.21.15.55:0/2370046667 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f69740663d0 msgr2=0x7f6974068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/2366924175 2023-07-06T22:18:20.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.549+0000 7f698affd640 1 -- 172.21.15.55:0/2370046667 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f697c11f4d0 con 0x7f69940d03c0 2023-07-06T22:18:20.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.549+0000 7f699259c640 1 --2- 172.21.15.55:0/2370046667 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f69740663d0 0x7f6974068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:18:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.553+0000 7f698affd640 1 -- 172.21.15.55:0/2370046667 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f697c0ec530 con 0x7f69940d03c0 2023-07-06T22:18:20.641 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:20.638+0000 7fb314076180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:18:20.699 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:20.694+0000 7fb314076180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:18:20.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.709+0000 7f6998ecb640 1 -- 172.21.15.55:0/2370046667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f69940b3420 con 0x7f69940d03c0 2023-07-06T22:18:20.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.709+0000 7f698affd640 1 -- 172.21.15.55:0/2370046667 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v164) v1 ==== 92+0+10 (secure 0 0 0) 0x7f697c0b1020 con 0x7f69940d03c0 2023-07-06T22:18:20.715 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:18:20.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.713+0000 7f6998ecb640 1 -- 172.21.15.55:0/2370046667 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f69740663d0 msgr2=0x7f6974068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:18:20.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.713+0000 7f6998ecb640 1 --2- 172.21.15.55:0/2370046667 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f69740663d0 0x7f6974068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.713+0000 7f6998ecb640 1 -- 172.21.15.55:0/2370046667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69940d03c0 msgr2=0x7f699415e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:20.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.713+0000 7f6998ecb640 1 --2- 172.21.15.55:0/2370046667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69940d03c0 0x7f699415e840 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f697c018fc0 tx=0x7f697c019150 comp rx=0 tx=0).stop 2023-07-06T22:18:20.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.713+0000 7f6998ecb640 1 -- 172.21.15.55:0/2370046667 shutdown_connections 2023-07-06T22:18:20.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.713+0000 7f6998ecb640 1 --2- 172.21.15.55:0/2370046667 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f69740663d0 0x7f6974068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.713+0000 7f6998ecb640 1 --2- 172.21.15.55:0/2370046667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f699415b850 0x7f6994151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.713+0000 7f6998ecb640 1 --2- 172.21.15.55:0/2370046667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69940d03c0 0x7f699415e840 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.713+0000 7f6998ecb640 1 --2- 172.21.15.55:0/2370046667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69940b3870 0x7f699415cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.713+0000 7f6998ecb640 1 -- 172.21.15.55:0/2370046667 >> 172.21.15.55:0/2370046667 conn(0x7f69940cec20 msgr2=0x7f6994157f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:20.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.713+0000 7f6998ecb640 1 -- 172.21.15.55:0/2370046667 shutdown_connections 2023-07-06T22:18:20.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.713+0000 7f6998ecb640 1 -- 172.21.15.55:0/2370046667 wait complete. 2023-07-06T22:18:20.731 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:20.725+0000 7f1478884180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:18:20.738 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T22:18:20.754 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:20.750+0000 7fb314076180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:18:20.794 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:20.789+0000 7f1478884180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:18:20.839 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:20.838+0000 7fb314076180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:18:20.854 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:20.849+0000 7f1478884180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:18:20.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.881+0000 7fd45ca7b640 1 Processor -- start 2023-07-06T22:18:20.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.881+0000 7fd45ca7b640 1 -- start start 2023-07-06T22:18:20.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd45ca7b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4580b3870 0x7fd4580b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd45ca7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4580d03c0 0x7fd4580d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd45ca7b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4580b4210 con 0x7fd45815b850 2023-07-06T22:18:20.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd45ca7b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4580b2b80 con 0x7fd4580b3870 2023-07-06T22:18:20.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd45ca7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580cff30 con 0x7fd4580d03c0 2023-07-06T22:18:20.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd45659c640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fd45815b850 0x7fd4580cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:36792/0 (socket says 172.21.15.55:36792) 2023-07-06T22:18:20.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd45659c640 1 -- 172.21.15.55:0/363763736 learned_addr learned my addr 172.21.15.55:0/363763736 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:20.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd455d9b640 1 --2- 172.21.15.55:0/363763736 >> v2:172.21.15.55:3300/0 conn(0x7fd4580b3870 0x7fd4580b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd456d9d640 1 --2- 172.21.15.55:0/363763736 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4580d03c0 0x7fd4580d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd45559a640 1 -- 172.21.15.55:0/363763736 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485622682 0 0) 0x7fd4580b4210 con 0x7fd45815b850 2023-07-06T22:18:20.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd45559a640 1 -- 172.21.15.55:0/363763736 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd440003530 con 0x7fd45815b850 2023-07-06T22:18:20.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd455d9b640 1 -- 172.21.15.55:0/363763736 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4580d03c0 msgr2=0x7fd4580d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:20.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd455d9b640 1 --2- 172.21.15.55:0/363763736 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4580d03c0 0x7fd4580d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd455d9b640 1 -- 172.21.15.55:0/363763736 >> v1:172.21.15.138:6789/0 conn(0x7fd45815b850 legacy=0x7fd4580cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:20.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd455d9b640 1 -- 172.21.15.55:0/363763736 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4580b22e0 con 0x7fd4580b3870 2023-07-06T22:18:20.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.885+0000 7fd455d9b640 1 --2- 172.21.15.55:0/363763736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4580b3870 0x7fd4580b3cd0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0097c0 tx=0x7fd44c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7835a93b351e2140 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:20.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45559a640 1 -- 172.21.15.55:0/363763736 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0ab600 con 0x7fd4580b3870 2023-07-06T22:18:20.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45559a640 1 -- 172.21.15.55:0/363763736 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c0a7050 con 0x7fd4580b3870 2023-07-06T22:18:20.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45559a640 1 -- 172.21.15.55:0/363763736 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0ab960 con 0x7fd4580b3870 2023-07-06T22:18:20.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 -- 172.21.15.55:0/363763736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4580b3870 msgr2=0x7fd4580b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:20.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 --2- 172.21.15.55:0/363763736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4580b3870 0x7fd4580b3cd0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0097c0 tx=0x7fd44c01c330 comp rx=0 tx=0).stop 2023-07-06T22:18:20.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 -- 172.21.15.55:0/363763736 shutdown_connections 2023-07-06T22:18:20.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 --2- 172.21.15.55:0/363763736 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd4580d03c0 0x7fd4580d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 --2- 172.21.15.55:0/363763736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4580b3870 0x7fd4580b3cd0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 -- 172.21.15.55:0/363763736 >> 172.21.15.55:0/363763736 conn(0x7fd4580cec20 msgr2=0x7fd4580cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:20.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 -- 172.21.15.55:0/363763736 shutdown_connections 2023-07-06T22:18:20.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 -- 172.21.15.55:0/363763736 wait complete. 2023-07-06T22:18:20.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 Processor -- start 2023-07-06T22:18:20.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 -- start start 2023-07-06T22:18:20.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4580b3870 0x7fd458156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4580d03c0 0x7fd4580c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd45815b850 0x7fd4580b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd458069800 con 0x7fd4580b3870 2023-07-06T22:18:20.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd458069a40 con 0x7fd4580d03c0 2023-07-06T22:18:20.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.889+0000 7fd45ca7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd458069d20 con 0x7fd45815b850 2023-07-06T22:18:20.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd45659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4580b3870 0x7fd458156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd45659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4580b3870 0x7fd458156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43838/0 (socket says 172.21.15.55:43838) 2023-07-06T22:18:20.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd45659c640 1 -- 172.21.15.55:0/357947751 learned_addr learned my addr 172.21.15.55:0/357947751 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:20.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd456d9d640 1 --2- 172.21.15.55:0/357947751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd45815b850 0x7fd4580b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd455d9b640 1 --2- 172.21.15.55:0/357947751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4580d03c0 0x7fd4580c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:20.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd45659c640 1 -- 172.21.15.55:0/357947751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd45815b850 msgr2=0x7fd4580b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:20.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd45659c640 1 --2- 172.21.15.55:0/357947751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd45815b850 0x7fd4580b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd45659c640 1 -- 172.21.15.55:0/357947751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4580d03c0 msgr2=0x7fd4580c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:20.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd45659c640 1 --2- 172.21.15.55:0/357947751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4580d03c0 0x7fd4580c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:20.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd45659c640 1 -- 172.21.15.55:0/357947751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c009420 con 0x7fd4580b3870 2023-07-06T22:18:20.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd45659c640 1 --2- 172.21.15.55:0/357947751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4580b3870 0x7fd458156ba0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fd44800c3c0 tx=0x7fd44800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:20.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd446ffd640 1 -- 172.21.15.55:0/357947751 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448005cf0 con 0x7fd4580b3870 2023-07-06T22:18:20.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd446ffd640 1 -- 172.21.15.55:0/357947751 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd448005e50 con 0x7fd4580b3870 2023-07-06T22:18:20.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd45ca7b640 1 -- 172.21.15.55:0/357947751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4580c7530 con 0x7fd4580b3870 2023-07-06T22:18:20.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd446ffd640 1 -- 172.21.15.55:0/357947751 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4480072f0 con 0x7fd4580b3870 2023-07-06T22:18:20.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd45ca7b640 1 -- 172.21.15.55:0/357947751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4580c7af0 con 0x7fd4580b3870 2023-07-06T22:18:20.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd45ca7b640 1 -- 172.21.15.55:0/357947751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd458066d60 con 0x7fd4580b3870 2023-07-06T22:18:20.900 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:20.894+0000 7fb314076180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:18:20.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.893+0000 7fd446ffd640 1 -- 172.21.15.55:0/357947751 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 91) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fd448007450 con 0x7fd4580b3870 2023-07-06T22:18:20.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.897+0000 7fd446ffd640 1 --2- 172.21.15.55:0/357947751 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fd4380663a0 0x7fd438068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:20.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.897+0000 7fd446ffd640 1 -- 172.21.15.55:0/357947751 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd4480838c0 con 0x7fd4580b3870 2023-07-06T22:18:20.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.897+0000 7fd455d9b640 1 -- 172.21.15.55:0/357947751 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fd4380663a0 msgr2=0x7fd438068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/2366924175 2023-07-06T22:18:20.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.897+0000 7fd455d9b640 1 --2- 172.21.15.55:0/357947751 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fd4380663a0 0x7fd438068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:18:20.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:20.905+0000 7fd446ffd640 1 -- 172.21.15.55:0/357947751 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd448050810 con 0x7fd4580b3870 2023-07-06T22:18:20.952 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:20.949+0000 7f1478884180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:18:20.982 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:20.978+0000 7fb314076180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:18:21.013 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:21.009+0000 7f1478884180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:18:21.039 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:21.034+0000 7fb314076180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:18:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.061+0000 7fd45ca7b640 1 -- 172.21.15.55:0/357947751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4580b3420 con 0x7fd4580b3870 2023-07-06T22:18:21.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.061+0000 7fd446ffd640 1 -- 172.21.15.55:0/357947751 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v164) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd448053e30 con 0x7fd4580b3870 2023-07-06T22:18:21.066 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T22:18:21.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.065+0000 7fd45ca7b640 1 -- 172.21.15.55:0/357947751 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fd4380663a0 msgr2=0x7fd438068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:18:21.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.065+0000 7fd45ca7b640 1 --2- 172.21.15.55:0/357947751 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fd4380663a0 0x7fd438068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.065+0000 7fd45ca7b640 1 -- 172.21.15.55:0/357947751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4580b3870 msgr2=0x7fd458156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:21.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.065+0000 7fd45ca7b640 1 --2- 172.21.15.55:0/357947751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4580b3870 0x7fd458156ba0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fd44800c3c0 tx=0x7fd44800c880 comp rx=0 tx=0).stop 2023-07-06T22:18:21.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.065+0000 7fd45ca7b640 1 -- 172.21.15.55:0/357947751 shutdown_connections 2023-07-06T22:18:21.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.065+0000 7fd45ca7b640 1 --2- 172.21.15.55:0/357947751 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fd4380663a0 0x7fd438068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.065+0000 7fd45ca7b640 1 --2- 172.21.15.55:0/357947751 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd45815b850 0x7fd4580b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.065+0000 7fd45ca7b640 1 --2- 172.21.15.55:0/357947751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4580d03c0 0x7fd4580c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.065+0000 7fd45ca7b640 1 --2- 172.21.15.55:0/357947751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4580b3870 0x7fd458156ba0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.065+0000 7fd45ca7b640 1 -- 172.21.15.55:0/357947751 >> 172.21.15.55:0/357947751 conn(0x7fd4580cec20 msgr2=0x7fd458154010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:21.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.065+0000 7fd45ca7b640 1 -- 172.21.15.55:0/357947751 shutdown_connections 2023-07-06T22:18:21.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.065+0000 7fd45ca7b640 1 -- 172.21.15.55:0/357947751 wait complete. 2023-07-06T22:18:21.089 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T22:18:21.104 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:21.101+0000 7f1478884180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:18:21.164 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:21.161+0000 7f1478884180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:18:21.180 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:21.178+0000 7fb314076180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:18:21.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.229+0000 7fde04e6d640 1 Processor -- start 2023-07-06T22:18:21.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.229+0000 7fde04e6d640 1 -- start start 2023-07-06T22:18:21.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.233+0000 7fde04e6d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde000709a0 0x7fde000cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:21.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.233+0000 7fde04e6d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fde000b1340 0x7fde0006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:21.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.233+0000 7fde04e6d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde000cc300 con 0x7fde000cbe60 2023-07-06T22:18:21.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.233+0000 7fde04e6d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde000cc5e0 con 0x7fde000709a0 2023-07-06T22:18:21.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.233+0000 7fde04e6d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde000cc8c0 con 0x7fde000b1340 2023-07-06T22:18:21.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.233+0000 7fddfe59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde000709a0 0x7fde000cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:21.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.233+0000 7fddfe59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde000709a0 0x7fde000cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43854/0 (socket says 172.21.15.55:43854) 2023-07-06T22:18:21.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.233+0000 7fddf7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fde000cbe60 0x7fde000b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52822/0 (socket says 172.21.15.55:52822) 2023-07-06T22:18:21.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.233+0000 7fddfe59c640 1 -- 172.21.15.55:0/4023245563 learned_addr learned my addr 172.21.15.55:0/4023245563 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:21.238 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:21.234+0000 7fb314076180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:18:21.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.233+0000 7fddfed9d640 1 --2- 172.21.15.55:0/4023245563 >> v2:172.21.15.138:3300/0 conn(0x7fde000b1340 0x7fde0006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:21.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.233+0000 7fddfe59c640 1 -- 172.21.15.55:0/4023245563 >> v2:172.21.15.138:3300/0 conn(0x7fde000b1340 msgr2=0x7fde0006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:21.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.233+0000 7fddfe59c640 1 --2- 172.21.15.55:0/4023245563 >> v2:172.21.15.138:3300/0 conn(0x7fde000b1340 0x7fde0006eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.233+0000 7fddfe59c640 1 -- 172.21.15.55:0/4023245563 >> v1:172.21.15.55:6789/0 conn(0x7fde000cbe60 legacy=0x7fde000b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:21.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.233+0000 7fddfe59c640 1 -- 172.21.15.55:0/4023245563 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde000ccba0 con 0x7fde000709a0 2023-07-06T22:18:21.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.237+0000 7fddfe59c640 1 --2- 172.21.15.55:0/4023245563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde000709a0 0x7fde000cb920 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fde000b18b0 tx=0x7fddf001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e738b46e5abc311b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:21.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.237+0000 7fddfdd9b640 1 -- 172.21.15.55:0/4023245563 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf00ab610 con 0x7fde000709a0 2023-07-06T22:18:21.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.237+0000 7fddfdd9b640 1 -- 172.21.15.55:0/4023245563 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf00ab770 con 0x7fde000709a0 2023-07-06T22:18:21.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.237+0000 7fddfdd9b640 1 -- 172.21.15.55:0/4023245563 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf00abb00 con 0x7fde000709a0 2023-07-06T22:18:21.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.237+0000 7fde04e6d640 1 -- 172.21.15.55:0/4023245563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde000709a0 msgr2=0x7fde000cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:21.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.237+0000 7fde04e6d640 1 --2- 172.21.15.55:0/4023245563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde000709a0 0x7fde000cb920 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fde000b18b0 tx=0x7fddf001c500 comp rx=0 tx=0).stop 2023-07-06T22:18:21.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.237+0000 7fde04e6d640 1 -- 172.21.15.55:0/4023245563 shutdown_connections 2023-07-06T22:18:21.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.237+0000 7fde04e6d640 1 --2- 172.21.15.55:0/4023245563 >> v2:172.21.15.138:3300/0 conn(0x7fde000b1340 0x7fde0006eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.237+0000 7fde04e6d640 1 --2- 172.21.15.55:0/4023245563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde000709a0 0x7fde000cb920 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.237+0000 7fde04e6d640 1 -- 172.21.15.55:0/4023245563 >> 172.21.15.55:0/4023245563 conn(0x7fde000cea70 msgr2=0x7fde000ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:21.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.237+0000 7fde04e6d640 1 -- 172.21.15.55:0/4023245563 shutdown_connections 2023-07-06T22:18:21.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.237+0000 7fde04e6d640 1 -- 172.21.15.55:0/4023245563 wait complete. 2023-07-06T22:18:21.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.237+0000 7fde04e6d640 1 Processor -- start 2023-07-06T22:18:21.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.237+0000 7fde04e6d640 1 -- start start 2023-07-06T22:18:21.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fde04e6d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde000709a0 0x7fde001f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:21.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fde04e6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde000b1340 0x7fde001f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:21.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fde04e6d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde000cbe60 0x7fde0009d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:21.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fde04e6d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde000c83a0 con 0x7fde000b1340 2023-07-06T22:18:21.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fde04e6d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde001f74b0 con 0x7fde000709a0 2023-07-06T22:18:21.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fde04e6d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde000c85f0 con 0x7fde000cbe60 2023-07-06T22:18:21.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fddf7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde000b1340 0x7fde001f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:21.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fddfe59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde000709a0 0x7fde001f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:21.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fddf7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde000b1340 0x7fde001f6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43868/0 (socket says 172.21.15.55:43868) 2023-07-06T22:18:21.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fddf7fff640 1 -- 172.21.15.55:0/1885343676 learned_addr learned my addr 172.21.15.55:0/1885343676 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:21.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fddfed9d640 1 --2- 172.21.15.55:0/1885343676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde000cbe60 0x7fde0009d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:21.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fddfe59c640 1 -- 172.21.15.55:0/1885343676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde000cbe60 msgr2=0x7fde0009d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:21.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fddfe59c640 1 --2- 172.21.15.55:0/1885343676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde000cbe60 0x7fde0009d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fddfe59c640 1 -- 172.21.15.55:0/1885343676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde000b1340 msgr2=0x7fde001f6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:21.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fddfe59c640 1 --2- 172.21.15.55:0/1885343676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde000b1340 0x7fde001f6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fddfe59c640 1 -- 172.21.15.55:0/1885343676 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf00094d0 con 0x7fde000709a0 2023-07-06T22:18:21.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fddfe59c640 1 --2- 172.21.15.55:0/1885343676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde000709a0 0x7fde001f4170 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fddf00ac000 tx=0x7fddf001ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:21.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fddf6ffd640 1 -- 172.21.15.55:0/1885343676 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf00b4800 con 0x7fde000709a0 2023-07-06T22:18:21.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fddf6ffd640 1 -- 172.21.15.55:0/1885343676 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf00b4960 con 0x7fde000709a0 2023-07-06T22:18:21.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fddf6ffd640 1 -- 172.21.15.55:0/1885343676 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf00b4d10 con 0x7fde000709a0 2023-07-06T22:18:21.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fde04e6d640 1 -- 172.21.15.55:0/1885343676 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde000c88d0 con 0x7fde000709a0 2023-07-06T22:18:21.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fde04e6d640 1 -- 172.21.15.55:0/1885343676 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde000c8e90 con 0x7fde000709a0 2023-07-06T22:18:21.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.241+0000 7fde04e6d640 1 -- 172.21.15.55:0/1885343676 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde00066d60 con 0x7fde000709a0 2023-07-06T22:18:21.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.245+0000 7fddf6ffd640 1 -- 172.21.15.55:0/1885343676 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 91) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fddf00059a0 con 0x7fde000709a0 2023-07-06T22:18:21.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.245+0000 7fddf6ffd640 1 --2- 172.21.15.55:0/1885343676 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fdde00663a0 0x7fdde0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:21.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.245+0000 7fddf6ffd640 1 -- 172.21.15.55:0/1885343676 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fddf011e940 con 0x7fde000709a0 2023-07-06T22:18:21.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.245+0000 7fddf7fff640 1 -- 172.21.15.55:0/1885343676 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fdde00663a0 msgr2=0x7fdde0068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/2366924175 2023-07-06T22:18:21.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.245+0000 7fddf7fff640 1 --2- 172.21.15.55:0/1885343676 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fdde00663a0 0x7fdde0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:18:21.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.249+0000 7fddf6ffd640 1 -- 172.21.15.55:0/1885343676 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fddf00eb890 con 0x7fde000709a0 2023-07-06T22:18:21.319 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:21.313+0000 7f1478884180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:18:21.380 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:21.377+0000 7f1478884180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:18:21.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.401+0000 7fde04e6d640 1 -- 172.21.15.55:0/1885343676 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde000c7e50 con 0x7fde000709a0 2023-07-06T22:18:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.401+0000 7fddf6ffd640 1 -- 172.21.15.55:0/1885343676 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v164) v1 ==== 100+0+11 (secure 0 0 0) 0x7fddf00c4020 con 0x7fde000709a0 2023-07-06T22:18:21.408 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T22:18:21.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.405+0000 7fde04e6d640 1 -- 172.21.15.55:0/1885343676 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fdde00663a0 msgr2=0x7fdde0068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:18:21.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.405+0000 7fde04e6d640 1 --2- 172.21.15.55:0/1885343676 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fdde00663a0 0x7fdde0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.405+0000 7fde04e6d640 1 -- 172.21.15.55:0/1885343676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde000709a0 msgr2=0x7fde001f4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:21.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.405+0000 7fde04e6d640 1 --2- 172.21.15.55:0/1885343676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde000709a0 0x7fde001f4170 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fddf00ac000 tx=0x7fddf001ad40 comp rx=0 tx=0).stop 2023-07-06T22:18:21.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.405+0000 7fde04e6d640 1 -- 172.21.15.55:0/1885343676 shutdown_connections 2023-07-06T22:18:21.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.405+0000 7fde04e6d640 1 --2- 172.21.15.55:0/1885343676 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fdde00663a0 0x7fdde0068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.405+0000 7fde04e6d640 1 --2- 172.21.15.55:0/1885343676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde000cbe60 0x7fde0009d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.405+0000 7fde04e6d640 1 --2- 172.21.15.55:0/1885343676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde000b1340 0x7fde001f6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.405+0000 7fde04e6d640 1 --2- 172.21.15.55:0/1885343676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde000709a0 0x7fde001f4170 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.405+0000 7fde04e6d640 1 -- 172.21.15.55:0/1885343676 >> 172.21.15.55:0/1885343676 conn(0x7fde000cea70 msgr2=0x7fde0006c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:21.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.405+0000 7fde04e6d640 1 -- 172.21.15.55:0/1885343676 shutdown_connections 2023-07-06T22:18:21.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.405+0000 7fde04e6d640 1 -- 172.21.15.55:0/1885343676 wait complete. 2023-07-06T22:18:21.431 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T22:18:21.480 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:18:21.480 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:18:21.480 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:18:21.488 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:21.486+0000 7fb314076180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:18:21.624 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:21.622+0000 7fb314076180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:18:21.639 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:18:21.639 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:18:21.640 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:18:21.648 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:21.645+0000 7f1478884180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:18:21.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.645+0000 7fc60c3fa640 1 Processor -- start 2023-07-06T22:18:21.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.645+0000 7fc60c3fa640 1 -- start start 2023-07-06T22:18:21.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc60c3fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc6040d1c40 0x7fc6040b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:21.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc60c3fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6040b4130 0x7fc6040b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:21.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc60c3fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6040b5070 con 0x7fc6040b7b90 2023-07-06T22:18:21.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc60c3fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6040d20c0 con 0x7fc6040d1c40 2023-07-06T22:18:21.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc60c3fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040b45b0 con 0x7fc6040b4130 2023-07-06T22:18:21.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc609995640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc6040d1c40 0x7fc6040b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:21.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc60a196640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc6040b7b90 0x7fc6040cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52836/0 (socket says 172.21.15.55:52836) 2023-07-06T22:18:21.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc60a196640 1 -- 172.21.15.55:0/843767769 learned_addr learned my addr 172.21.15.55:0/843767769 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:21.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc60a997640 1 --2- 172.21.15.55:0/843767769 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6040b4130 0x7fc6040b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:21.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc609194640 1 -- 172.21.15.55:0/843767769 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723448571 0 0) 0x7fc6040b5070 con 0x7fc6040b7b90 2023-07-06T22:18:21.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc609194640 1 -- 172.21.15.55:0/843767769 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f0003530 con 0x7fc6040b7b90 2023-07-06T22:18:21.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc609995640 1 -- 172.21.15.55:0/843767769 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6040b4130 msgr2=0x7fc6040b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:21.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc609995640 1 --2- 172.21.15.55:0/843767769 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6040b4130 0x7fc6040b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc609995640 1 -- 172.21.15.55:0/843767769 >> v1:172.21.15.55:6789/0 conn(0x7fc6040b7b90 legacy=0x7fc6040cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:21.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.649+0000 7fc609995640 1 -- 172.21.15.55:0/843767769 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604160020 con 0x7fc6040d1c40 2023-07-06T22:18:21.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.653+0000 7fc609995640 1 --2- 172.21.15.55:0/843767769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040d1c40 0x7fc6040b3bf0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40097c0 tx=0x7fc5f401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c67e543c086be server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:21.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.653+0000 7fc609194640 1 -- 172.21.15.55:0/843767769 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40ab600 con 0x7fc6040d1c40 2023-07-06T22:18:21.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.653+0000 7fc609194640 1 -- 172.21.15.55:0/843767769 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f40a7050 con 0x7fc6040d1c40 2023-07-06T22:18:21.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.653+0000 7fc609194640 1 -- 172.21.15.55:0/843767769 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40ab980 con 0x7fc6040d1c40 2023-07-06T22:18:21.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.653+0000 7fc60c3fa640 1 -- 172.21.15.55:0/843767769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040d1c40 msgr2=0x7fc6040b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:21.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.653+0000 7fc60c3fa640 1 --2- 172.21.15.55:0/843767769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040d1c40 0x7fc6040b3bf0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40097c0 tx=0x7fc5f401c480 comp rx=0 tx=0).stop 2023-07-06T22:18:21.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.653+0000 7fc60c3fa640 1 -- 172.21.15.55:0/843767769 shutdown_connections 2023-07-06T22:18:21.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.653+0000 7fc60c3fa640 1 --2- 172.21.15.55:0/843767769 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6040b4130 0x7fc6040b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.653+0000 7fc60c3fa640 1 --2- 172.21.15.55:0/843767769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040d1c40 0x7fc6040b3bf0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.653+0000 7fc60c3fa640 1 -- 172.21.15.55:0/843767769 >> 172.21.15.55:0/843767769 conn(0x7fc6040ceca0 msgr2=0x7fc6040cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.653+0000 7fc60c3fa640 1 -- 172.21.15.55:0/843767769 shutdown_connections 2023-07-06T22:18:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.653+0000 7fc60c3fa640 1 -- 172.21.15.55:0/843767769 wait complete. 2023-07-06T22:18:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60c3fa640 1 Processor -- start 2023-07-06T22:18:21.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60c3fa640 1 -- start start 2023-07-06T22:18:21.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60c3fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040b4130 0x7fc6040c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:21.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60c3fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6040b7b90 0x7fc6041f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:21.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60c3fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6040d1c40 0x7fc6040cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:21.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60c3fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040c9740 con 0x7fc6040b4130 2023-07-06T22:18:21.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60c3fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040c9a20 con 0x7fc6040d1c40 2023-07-06T22:18:21.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60c3fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6041527e0 con 0x7fc6040b7b90 2023-07-06T22:18:21.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60a196640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040b4130 0x7fc6040c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:21.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60a196640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040b4130 0x7fc6040c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43882/0 (socket says 172.21.15.55:43882) 2023-07-06T22:18:21.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60a196640 1 -- 172.21.15.55:0/3572966372 learned_addr learned my addr 172.21.15.55:0/3572966372 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:21.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc609995640 1 --2- 172.21.15.55:0/3572966372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6040b7b90 0x7fc6041f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:21.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60a997640 1 --2- 172.21.15.55:0/3572966372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6040d1c40 0x7fc6040cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:21.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60a196640 1 -- 172.21.15.55:0/3572966372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6040b7b90 msgr2=0x7fc6041f3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:21.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60a196640 1 --2- 172.21.15.55:0/3572966372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6040b7b90 0x7fc6041f3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60a196640 1 -- 172.21.15.55:0/3572966372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6040d1c40 msgr2=0x7fc6040cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:21.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60a196640 1 --2- 172.21.15.55:0/3572966372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6040d1c40 0x7fc6040cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60a196640 1 -- 172.21.15.55:0/3572966372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f4009420 con 0x7fc6040b4130 2023-07-06T22:18:21.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60a196640 1 --2- 172.21.15.55:0/3572966372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040b4130 0x7fc6040c8930 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c4d0 tx=0x7fc60000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:21.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc5faffd640 1 -- 172.21.15.55:0/3572966372 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600005cf0 con 0x7fc6040b4130 2023-07-06T22:18:21.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc5faffd640 1 -- 172.21.15.55:0/3572966372 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc600005e50 con 0x7fc6040b4130 2023-07-06T22:18:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc5faffd640 1 -- 172.21.15.55:0/3572966372 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600007270 con 0x7fc6040b4130 2023-07-06T22:18:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60c3fa640 1 -- 172.21.15.55:0/3572966372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc604152ac0 con 0x7fc6040b4130 2023-07-06T22:18:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.657+0000 7fc60c3fa640 1 -- 172.21.15.55:0/3572966372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6041f4290 con 0x7fc6040b4130 2023-07-06T22:18:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.661+0000 7fc60c3fa640 1 -- 172.21.15.55:0/3572966372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc604066d60 con 0x7fc6040b4130 2023-07-06T22:18:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.661+0000 7fc5faffd640 1 -- 172.21.15.55:0/3572966372 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 91) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fc6000073d0 con 0x7fc6040b4130 2023-07-06T22:18:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.661+0000 7fc5faffd640 1 --2- 172.21.15.55:0/3572966372 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fc5e80663a0 0x7fc5e8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.661+0000 7fc5faffd640 1 -- 172.21.15.55:0/3572966372 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc600083790 con 0x7fc6040b4130 2023-07-06T22:18:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.661+0000 7fc609995640 1 -- 172.21.15.55:0/3572966372 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fc5e80663a0 msgr2=0x7fc5e8068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/2366924175 2023-07-06T22:18:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.661+0000 7fc609995640 1 --2- 172.21.15.55:0/3572966372 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fc5e80663a0 0x7fc5e8068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:18:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.665+0000 7fc5faffd640 1 -- 172.21.15.55:0/3572966372 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6000507f0 con 0x7fc6040b4130 2023-07-06T22:18:21.748 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:21.746+0000 7fb314076180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:18:21.794 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:21.789+0000 7f1478884180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:18:21.818 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:21.814+0000 7fb314076180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:18:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.833+0000 7fc60c3fa640 1 -- 172.21.15.55:0/3572966372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc60406b1f0 con 0x7fc6040b4130 2023-07-06T22:18:21.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.833+0000 7fc5faffd640 1 -- 172.21.15.55:0/3572966372 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v164) v1 ==== 81+0+933 (secure 0 0 0) 0x7fc6000173c0 con 0x7fc6040b4130 2023-07-06T22:18:21.838 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3064152807 2023-07-07T22:13:20.216819+0000 2023-07-06T22:18:21.838 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/653926838 2023-07-07T22:13:20.216819+0000 2023-07-06T22:18:21.838 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/3834478672 2023-07-07T22:13:20.216819+0000 2023-07-06T22:18:21.838 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/3834478672 2023-07-07T22:13:20.216819+0000 2023-07-06T22:18:21.839 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/562346394 2023-07-07T22:13:20.216819+0000 2023-07-06T22:18:21.839 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1671051159 2023-07-07T22:13:20.216819+0000 2023-07-06T22:18:21.839 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/959368203 2023-07-07T22:13:20.216819+0000 2023-07-06T22:18:21.839 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/323970277 2023-07-07T22:02:28.914064+0000 2023-07-06T22:18:21.839 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/433956277 2023-07-07T22:02:28.914064+0000 2023-07-06T22:18:21.839 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/433956277 2023-07-07T22:02:28.914064+0000 2023-07-06T22:18:21.839 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2414406270 2023-07-07T22:02:28.914064+0000 2023-07-06T22:18:21.839 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3587598195 2023-07-07T22:02:28.914064+0000 2023-07-06T22:18:21.840 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2664561010 2023-07-07T22:13:20.216819+0000 2023-07-06T22:18:21.840 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1917520432 2023-07-07T22:02:28.914064+0000 2023-07-06T22:18:21.840 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/279151651 2023-07-07T22:02:28.914064+0000 2023-07-06T22:18:21.840 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1806662178 2023-07-07T22:02:28.914064+0000 2023-07-06T22:18:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:listed 16 entries 2023-07-06T22:18:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.833+0000 7fc60c3fa640 1 -- 172.21.15.55:0/3572966372 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fc5e80663a0 msgr2=0x7fc5e8068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:18:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.833+0000 7fc60c3fa640 1 --2- 172.21.15.55:0/3572966372 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fc5e80663a0 0x7fc5e8068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.833+0000 7fc60c3fa640 1 -- 172.21.15.55:0/3572966372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040b4130 msgr2=0x7fc6040c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.833+0000 7fc60c3fa640 1 --2- 172.21.15.55:0/3572966372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040b4130 0x7fc6040c8930 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c4d0 tx=0x7fc60000c990 comp rx=0 tx=0).stop 2023-07-06T22:18:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.833+0000 7fc60c3fa640 1 -- 172.21.15.55:0/3572966372 shutdown_connections 2023-07-06T22:18:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.833+0000 7fc60c3fa640 1 --2- 172.21.15.55:0/3572966372 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7fc5e80663a0 0x7fc5e8068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.833+0000 7fc60c3fa640 1 --2- 172.21.15.55:0/3572966372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6040d1c40 0x7fc6040cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.833+0000 7fc60c3fa640 1 --2- 172.21.15.55:0/3572966372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6040b7b90 0x7fc6041f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.833+0000 7fc60c3fa640 1 --2- 172.21.15.55:0/3572966372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040b4130 0x7fc6040c8930 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.833+0000 7fc60c3fa640 1 -- 172.21.15.55:0/3572966372 >> 172.21.15.55:0/3572966372 conn(0x7fc6040ceca0 msgr2=0x7fc60406a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.837+0000 7fc60c3fa640 1 -- 172.21.15.55:0/3572966372 shutdown_connections 2023-07-06T22:18:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:21.837+0000 7fc60c3fa640 1 -- 172.21.15.55:0/3572966372 wait complete. 2023-07-06T22:18:21.859 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T22:18:21.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:21.860 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-06T22:18:21.931 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:21.925+0000 7f1478884180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:18:21.948 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T22:18:21.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:21.949 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T22:18:21.952 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:21.950+0000 7fb314076180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:18:21.960 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:18:21.960 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:18:21.969 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:18:21.969 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:18:21.969 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:18:22.009 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:22.005+0000 7f1478884180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:18:22.013 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:18:22.013 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:18:22.014 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:18:22.022 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:18:22.023 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:18:22.154 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:22.149+0000 7f1478884180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:18:22.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.197+0000 7f49e6a93640 1 Processor -- start 2023-07-06T22:18:22.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.197+0000 7f49e6a93640 1 -- start start 2023-07-06T22:18:22.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.197+0000 7f49e6a93640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f49e00b1fe0 0x7f49e0166ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:22.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.197+0000 7f49e6a93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e00cd1c0 con 0x7f49e00ce610 2023-07-06T22:18:22.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.197+0000 7f49e6a93640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e00cecf0 con 0x7f49e00b7cd0 2023-07-06T22:18:22.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.197+0000 7f49e6a93640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e00d2310 con 0x7f49e00b1fe0 2023-07-06T22:18:22.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.197+0000 7f49dffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f49e00ce610 0x7f49e00b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52852/0 (socket says 172.21.15.55:52852) 2023-07-06T22:18:22.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.197+0000 7f49dffff640 1 -- 172.21.15.55:0/4131031590 learned_addr learned my addr 172.21.15.55:0/4131031590 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:22.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.197+0000 7f49e5030640 1 --2- 172.21.15.55:0/4131031590 >> v2:172.21.15.138:3300/0 conn(0x7f49e00b1fe0 0x7f49e0166ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:22.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.201+0000 7f49df7fe640 1 -- 172.21.15.55:0/4131031590 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153762257 0 0) 0x7f49e00cd1c0 con 0x7f49e00ce610 2023-07-06T22:18:22.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.201+0000 7f49df7fe640 1 -- 172.21.15.55:0/4131031590 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d0003530 con 0x7f49e00ce610 2023-07-06T22:18:22.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.201+0000 7f49df7fe640 1 -- 172.21.15.55:0/4131031590 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248336874 0 0) 0x7f49e00cecf0 con 0x7f49e00b7cd0 2023-07-06T22:18:22.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.201+0000 7f49df7fe640 1 -- 172.21.15.55:0/4131031590 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49e00cd1c0 con 0x7f49e00b7cd0 2023-07-06T22:18:22.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.201+0000 7f49e5030640 1 -- 172.21.15.55:0/4131031590 >> v1:172.21.15.138:6789/0 conn(0x7f49e00b7cd0 legacy=0x7f49e00ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:22.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.201+0000 7f49e5030640 1 -- 172.21.15.55:0/4131031590 >> v1:172.21.15.55:6789/0 conn(0x7f49e00ce610 legacy=0x7f49e00b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:22.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.201+0000 7f49e5030640 1 -- 172.21.15.55:0/4131031590 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e00cea60 con 0x7f49e00b1fe0 2023-07-06T22:18:22.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.205+0000 7f49e5030640 1 --2- 172.21.15.55:0/4131031590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00b1fe0 0x7f49e0166ba0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009d90 tx=0x7f49d801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6df7846cf251c78d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:22.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.205+0000 7f49df7fe640 1 -- 172.21.15.55:0/4131031590 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d80a5780 con 0x7f49e00b1fe0 2023-07-06T22:18:22.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.205+0000 7f49df7fe640 1 -- 172.21.15.55:0/4131031590 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d80a58e0 con 0x7f49e00b1fe0 2023-07-06T22:18:22.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.205+0000 7f49df7fe640 1 -- 172.21.15.55:0/4131031590 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d80a5c70 con 0x7f49e00b1fe0 2023-07-06T22:18:22.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.205+0000 7f49e6a93640 1 -- 172.21.15.55:0/4131031590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00b1fe0 msgr2=0x7f49e0166ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:22.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.205+0000 7f49e6a93640 1 --2- 172.21.15.55:0/4131031590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00b1fe0 0x7f49e0166ba0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009d90 tx=0x7f49d801c8c0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.205+0000 7f49e6a93640 1 -- 172.21.15.55:0/4131031590 shutdown_connections 2023-07-06T22:18:22.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.205+0000 7f49e6a93640 1 --2- 172.21.15.55:0/4131031590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00b1fe0 0x7f49e0166ba0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.205+0000 7f49e6a93640 1 -- 172.21.15.55:0/4131031590 >> 172.21.15.55:0/4131031590 conn(0x7f49e00ceee0 msgr2=0x7f49e00cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:22.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.205+0000 7f49e6a93640 1 -- 172.21.15.55:0/4131031590 shutdown_connections 2023-07-06T22:18:22.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.205+0000 7f49e6a93640 1 -- 172.21.15.55:0/4131031590 wait complete. 2023-07-06T22:18:22.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.205+0000 7f49e6a93640 1 Processor -- start 2023-07-06T22:18:22.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49e6a93640 1 -- start start 2023-07-06T22:18:22.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49e6a93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49e00b1fe0 0x7f49e01569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:22.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49e6a93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49e00b7cd0 0x7f49e00b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:22.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49e6a93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00ce610 0x7f49e00b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:22.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49e6a93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e01f7680 con 0x7f49e00b7cd0 2023-07-06T22:18:22.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49e6a93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e01f78d0 con 0x7f49e00ce610 2023-07-06T22:18:22.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49e6a93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e01f7bb0 con 0x7f49e00b1fe0 2023-07-06T22:18:22.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49e00b7cd0 0x7f49e00b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:22.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49e00b7cd0 0x7f49e00b5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43898/0 (socket says 172.21.15.55:43898) 2023-07-06T22:18:22.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49dffff640 1 -- 172.21.15.55:0/3157069943 learned_addr learned my addr 172.21.15.55:0/3157069943 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:22.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49e5030640 1 --2- 172.21.15.55:0/3157069943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00ce610 0x7f49e00b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:22.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49e482f640 1 --2- 172.21.15.55:0/3157069943 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49e00b1fe0 0x7f49e01569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:22.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49dffff640 1 -- 172.21.15.55:0/3157069943 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49e00b1fe0 msgr2=0x7f49e01569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:22.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49dffff640 1 --2- 172.21.15.55:0/3157069943 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49e00b1fe0 0x7f49e01569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49dffff640 1 -- 172.21.15.55:0/3157069943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00ce610 msgr2=0x7f49e00b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:22.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49dffff640 1 --2- 172.21.15.55:0/3157069943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00ce610 0x7f49e00b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49dffff640 1 -- 172.21.15.55:0/3157069943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d8009a70 con 0x7f49e00b7cd0 2023-07-06T22:18:22.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49e5030640 1 --2- 172.21.15.55:0/3157069943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00ce610 0x7f49e00b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:22.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49dffff640 1 --2- 172.21.15.55:0/3157069943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49e00b7cd0 0x7f49e00b5290 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c4d0 tx=0x7f49cc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:22.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49dd7fa640 1 -- 172.21.15.55:0/3157069943 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc005cf0 con 0x7f49e00b7cd0 2023-07-06T22:18:22.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49dd7fa640 1 -- 172.21.15.55:0/3157069943 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc005e50 con 0x7f49e00b7cd0 2023-07-06T22:18:22.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49dd7fa640 1 -- 172.21.15.55:0/3157069943 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc007270 con 0x7f49e00b7cd0 2023-07-06T22:18:22.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49e6a93640 1 -- 172.21.15.55:0/3157069943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e01f7e90 con 0x7f49e00b7cd0 2023-07-06T22:18:22.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49e6a93640 1 -- 172.21.15.55:0/3157069943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e0156f30 con 0x7f49e00b7cd0 2023-07-06T22:18:22.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.209+0000 7f49e6a93640 1 -- 172.21.15.55:0/3157069943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e01f4100 con 0x7f49e00b7cd0 2023-07-06T22:18:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.213+0000 7f49dd7fa640 1 -- 172.21.15.55:0/3157069943 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 91) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f49cc0073d0 con 0x7f49e00b7cd0 2023-07-06T22:18:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.213+0000 7f49dd7fa640 1 --2- 172.21.15.55:0/3157069943 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f49c40663a0 0x7f49c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.213+0000 7f49e482f640 1 -- 172.21.15.55:0/3157069943 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f49c40663a0 msgr2=0x7f49c4068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/2366924175 2023-07-06T22:18:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.213+0000 7f49dd7fa640 1 -- 172.21.15.55:0/3157069943 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f49cc083740 con 0x7f49e00b7cd0 2023-07-06T22:18:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.213+0000 7f49e482f640 1 --2- 172.21.15.55:0/3157069943 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f49c40663a0 0x7f49c4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:18:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.217+0000 7f49dd7fa640 1 -- 172.21.15.55:0/3157069943 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f49e01f4100 con 0x7f49e00b7cd0 2023-07-06T22:18:22.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.405+0000 7f49e6a93640 1 -- 172.21.15.55:0/3157069943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49e0066d60 con 0x7f49e00b7cd0 2023-07-06T22:18:22.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.405+0000 7f49dd7fa640 1 -- 172.21.15.55:0/3157069943 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f49cc0507c0 con 0x7f49e00b7cd0 2023-07-06T22:18:22.411 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:22.412 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7958,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2209436909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2209436909},{"type":"v1","addr":"172.21.15.55:6837","nonce":2209436909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1799743845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":1799743845},{"type":"v1","addr":"172.21.15.138:6835","nonce":1799743845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8992,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3922834764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3922834764},{"type":"v1","addr":"172.21.15.138:6834","nonce":3922834764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:02:11.754063+0000","modified":"2023-07-06T22:02:14.781049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9759":{"gid":9759,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/4021237791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4021237791},{"type":"v1","addr":"172.21.15.55:6836","nonce":4021237791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-06T22:18:22.412 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 71 2023-07-06T22:18:22.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.409+0000 7f49e6a93640 1 -- 172.21.15.55:0/3157069943 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f49c40663a0 msgr2=0x7f49c4068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:18:22.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.409+0000 7f49e6a93640 1 --2- 172.21.15.55:0/3157069943 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f49c40663a0 0x7f49c4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.409+0000 7f49e6a93640 1 -- 172.21.15.55:0/3157069943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49e00b7cd0 msgr2=0x7f49e00b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:22.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.409+0000 7f49e6a93640 1 --2- 172.21.15.55:0/3157069943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49e00b7cd0 0x7f49e00b5290 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c4d0 tx=0x7f49cc00c990 comp rx=0 tx=0).stop 2023-07-06T22:18:22.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.409+0000 7f49e6a93640 1 -- 172.21.15.55:0/3157069943 shutdown_connections 2023-07-06T22:18:22.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.409+0000 7f49e6a93640 1 --2- 172.21.15.55:0/3157069943 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f49c40663a0 0x7f49c4068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.409+0000 7f49e6a93640 1 --2- 172.21.15.55:0/3157069943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49e00ce610 0x7f49e00b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.409+0000 7f49e6a93640 1 --2- 172.21.15.55:0/3157069943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49e00b7cd0 0x7f49e00b5290 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.409+0000 7f49e6a93640 1 --2- 172.21.15.55:0/3157069943 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49e00b1fe0 0x7f49e01569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.409+0000 7f49e6a93640 1 -- 172.21.15.55:0/3157069943 >> 172.21.15.55:0/3157069943 conn(0x7f49e00ceee0 msgr2=0x7f49e00d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:22.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.409+0000 7f49e6a93640 1 -- 172.21.15.55:0/3157069943 shutdown_connections 2023-07-06T22:18:22.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.409+0000 7f49e6a93640 1 -- 172.21.15.55:0/3157069943 wait complete. 2023-07-06T22:18:22.447 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:18:22.589 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:22.586+0000 7fb314076180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:18:22.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.665+0000 7f99e3537640 1 Processor -- start 2023-07-06T22:18:22.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.669+0000 7f99e3537640 1 -- start start 2023-07-06T22:18:22.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.669+0000 7f99e3537640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99dc15f4e0 0x7f99dc0b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:22.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.669+0000 7f99e3537640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99dc0b4250 0x7f99dc15c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:22.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.669+0000 7f99e3537640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99dc06a160 con 0x7f99dc15b9d0 2023-07-06T22:18:22.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.669+0000 7f99e3537640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99dc15bda0 con 0x7f99dc15f4e0 2023-07-06T22:18:22.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.669+0000 7f99e3537640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0b46b0 con 0x7f99dc0b4250 2023-07-06T22:18:22.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.669+0000 7f99e0ad2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99dc15f4e0 0x7f99dc0b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:22.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.669+0000 7f99e0ad2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99dc15f4e0 0x7f99dc0b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43908/0 (socket says 172.21.15.55:43908) 2023-07-06T22:18:22.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.669+0000 7f99e0ad2640 1 -- 172.21.15.55:0/3607120692 learned_addr learned my addr 172.21.15.55:0/3607120692 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:22.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.669+0000 7f99e1ad4640 1 --2- 172.21.15.55:0/3607120692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99dc0b4250 0x7f99dc15c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:22.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.669+0000 7f99e0ad2640 1 -- 172.21.15.55:0/3607120692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99dc0b4250 msgr2=0x7f99dc15c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:22.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.669+0000 7f99e0ad2640 1 --2- 172.21.15.55:0/3607120692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99dc0b4250 0x7f99dc15c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.669+0000 7f99e0ad2640 1 -- 172.21.15.55:0/3607120692 >> v1:172.21.15.138:6789/0 conn(0x7f99dc15b9d0 legacy=0x7f99dc0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:22.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.669+0000 7f99e0ad2640 1 -- 172.21.15.55:0/3607120692 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc069590 con 0x7f99dc15f4e0 2023-07-06T22:18:22.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.673+0000 7f99e0ad2640 1 --2- 172.21.15.55:0/3607120692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99dc15f4e0 0x7f99dc0b3d10 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009870 tx=0x7f99cc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec1575e139c7445 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:22.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.673+0000 7f99d3fff640 1 -- 172.21.15.55:0/3607120692 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0a9400 con 0x7f99dc15f4e0 2023-07-06T22:18:22.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.673+0000 7f99d3fff640 1 -- 172.21.15.55:0/3607120692 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc0a9560 con 0x7f99dc15f4e0 2023-07-06T22:18:22.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.673+0000 7f99d3fff640 1 -- 172.21.15.55:0/3607120692 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0a96f0 con 0x7f99dc15f4e0 2023-07-06T22:18:22.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.673+0000 7f99e3537640 1 -- 172.21.15.55:0/3607120692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99dc15f4e0 msgr2=0x7f99dc0b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:22.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.673+0000 7f99e3537640 1 --2- 172.21.15.55:0/3607120692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99dc15f4e0 0x7f99dc0b3d10 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009870 tx=0x7f99cc01c540 comp rx=0 tx=0).stop 2023-07-06T22:18:22.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.673+0000 7f99e3537640 1 -- 172.21.15.55:0/3607120692 shutdown_connections 2023-07-06T22:18:22.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.673+0000 7f99e3537640 1 --2- 172.21.15.55:0/3607120692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99dc0b4250 0x7f99dc15c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.673+0000 7f99e3537640 1 --2- 172.21.15.55:0/3607120692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99dc15f4e0 0x7f99dc0b3d10 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.673+0000 7f99e3537640 1 -- 172.21.15.55:0/3607120692 >> 172.21.15.55:0/3607120692 conn(0x7f99dc0ced10 msgr2=0x7f99dc0cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:22.679 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:22.674+0000 7fb314076180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:18:22.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.673+0000 7f99e3537640 1 -- 172.21.15.55:0/3607120692 shutdown_connections 2023-07-06T22:18:22.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.673+0000 7f99e3537640 1 -- 172.21.15.55:0/3607120692 wait complete. 2023-07-06T22:18:22.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e3537640 1 Processor -- start 2023-07-06T22:18:22.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e3537640 1 -- start start 2023-07-06T22:18:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e3537640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99dc0b4250 0x7f99dc153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e3537640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99dc15b9d0 0x7f99dc151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e3537640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99dc15f4e0 0x7f99dc1518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e3537640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0b7ab0 con 0x7f99dc15b9d0 2023-07-06T22:18:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e3537640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc151de0 con 0x7f99dc0b4250 2023-07-06T22:18:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e3537640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0cbe60 con 0x7f99dc15f4e0 2023-07-06T22:18:22.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e0ad2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99dc15b9d0 0x7f99dc151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:22.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e0ad2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99dc15b9d0 0x7f99dc151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43914/0 (socket says 172.21.15.55:43914) 2023-07-06T22:18:22.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e0ad2640 1 -- 172.21.15.55:0/828486230 learned_addr learned my addr 172.21.15.55:0/828486230 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:22.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e12d3640 1 --2- 172.21.15.55:0/828486230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99dc0b4250 0x7f99dc153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:22.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e1ad4640 1 --2- 172.21.15.55:0/828486230 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99dc15f4e0 0x7f99dc1518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:22.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e0ad2640 1 -- 172.21.15.55:0/828486230 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99dc15f4e0 msgr2=0x7f99dc1518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:22.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e0ad2640 1 --2- 172.21.15.55:0/828486230 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99dc15f4e0 0x7f99dc1518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e0ad2640 1 -- 172.21.15.55:0/828486230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99dc0b4250 msgr2=0x7f99dc153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:22.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e0ad2640 1 --2- 172.21.15.55:0/828486230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99dc0b4250 0x7f99dc153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e0ad2640 1 -- 172.21.15.55:0/828486230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc0094d0 con 0x7f99dc15b9d0 2023-07-06T22:18:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.677+0000 7f99e0ad2640 1 --2- 172.21.15.55:0/828486230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99dc15b9d0 0x7f99dc151360 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f99cc01a170 tx=0x7f99cc01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.681+0000 7f99d1ffb640 1 -- 172.21.15.55:0/828486230 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0a9400 con 0x7f99dc15b9d0 2023-07-06T22:18:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.681+0000 7f99d1ffb640 1 -- 172.21.15.55:0/828486230 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc0b1800 con 0x7f99dc15b9d0 2023-07-06T22:18:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.681+0000 7f99d1ffb640 1 -- 172.21.15.55:0/828486230 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0b1b70 con 0x7f99dc15b9d0 2023-07-06T22:18:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.681+0000 7f99e3537640 1 -- 172.21.15.55:0/828486230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99dc0b7150 con 0x7f99dc15b9d0 2023-07-06T22:18:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.681+0000 7f99e3537640 1 -- 172.21.15.55:0/828486230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99dc0b73f0 con 0x7f99dc15b9d0 2023-07-06T22:18:22.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.681+0000 7f99e3537640 1 -- 172.21.15.55:0/828486230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99dc0b7bf0 con 0x7f99dc15b9d0 2023-07-06T22:18:22.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.681+0000 7f99d1ffb640 1 -- 172.21.15.55:0/828486230 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 91) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f99cc0ba3a0 con 0x7f99dc15b9d0 2023-07-06T22:18:22.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.685+0000 7f99d1ffb640 1 --2- 172.21.15.55:0/828486230 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f99c00663a0 0x7f99c0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:22.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.685+0000 7f99d1ffb640 1 -- 172.21.15.55:0/828486230 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 7215+0+0 (secure 0 0 0) 0x7f99cc11e7d0 con 0x7f99dc15b9d0 2023-07-06T22:18:22.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.685+0000 7f99e12d3640 1 -- 172.21.15.55:0/828486230 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f99c00663a0 msgr2=0x7f99c0068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/2366924175 2023-07-06T22:18:22.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.685+0000 7f99e12d3640 1 --2- 172.21.15.55:0/828486230 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f99c00663a0 0x7f99c0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:18:22.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.689+0000 7f99d1ffb640 1 -- 172.21.15.55:0/828486230 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99dc0b7bf0 con 0x7f99dc15b9d0 2023-07-06T22:18:22.825 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:22.822+0000 7fb314076180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:18:22.840 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:22.837+0000 7f1478884180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:18:22.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.845+0000 7f99e3537640 1 -- 172.21.15.55:0/828486230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99dc0b7bf0 con 0x7f99dc15b9d0 2023-07-06T22:18:22.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.849+0000 7f99d1ffb640 1 -- 172.21.15.55:0/828486230 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+19809 (secure 0 0 0) 0x7f99dc0b7bf0 con 0x7f99dc15b9d0 2023-07-06T22:18:22.852 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:22.852 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":165,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:18:22.419481+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:02:09.638482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-07-06T22:02:10.753761+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":32,"snap_epoch":165,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3064152807":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/653926838":"2023-07-07T22:13:20.216819+0000","172.21.15.55:6833/3834478672":"2023-07-07T22:13:20.216819+0000","172.21.15.55:6832/3834478672":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/562346394":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/1671051159":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/959368203":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/323970277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6833/433956277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6832/433956277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/2414406270":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/3587598195":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/2664561010":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/1917520432":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/279151651":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/1806662178":"2023-07-07T22:02:28.914064+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]},{"pool":21,"snaps":[{"begin":2,"length":15},{"begin":18,"length":15}]}],"new_removed_snaps":[{"pool":21,"snaps":[{"begin":2,"length":15},{"begin":18,"length":15}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:18:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.849+0000 7f99e3537640 1 -- 172.21.15.55:0/828486230 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f99c00663a0 msgr2=0x7f99c0068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:18:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.849+0000 7f99e3537640 1 --2- 172.21.15.55:0/828486230 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f99c00663a0 0x7f99c0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.849+0000 7f99e3537640 1 -- 172.21.15.55:0/828486230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99dc15b9d0 msgr2=0x7f99dc151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.849+0000 7f99e3537640 1 --2- 172.21.15.55:0/828486230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99dc15b9d0 0x7f99dc151360 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f99cc01a170 tx=0x7f99cc01ad80 comp rx=0 tx=0).stop 2023-07-06T22:18:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.849+0000 7f99e3537640 1 -- 172.21.15.55:0/828486230 shutdown_connections 2023-07-06T22:18:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.849+0000 7f99e3537640 1 --2- 172.21.15.55:0/828486230 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f99c00663a0 0x7f99c0068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.849+0000 7f99e3537640 1 --2- 172.21.15.55:0/828486230 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99dc15f4e0 0x7f99dc1518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.849+0000 7f99e3537640 1 --2- 172.21.15.55:0/828486230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99dc15b9d0 0x7f99dc151360 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.849+0000 7f99e3537640 1 --2- 172.21.15.55:0/828486230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99dc0b4250 0x7f99dc153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:22.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.849+0000 7f99e3537640 1 -- 172.21.15.55:0/828486230 >> 172.21.15.55:0/828486230 conn(0x7f99dc0ced10 msgr2=0x7f99dc154290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:22.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.849+0000 7f99e3537640 1 -- 172.21.15.55:0/828486230 shutdown_connections 2023-07-06T22:18:22.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:22.849+0000 7f99e3537640 1 -- 172.21.15.55:0/828486230 wait complete. 2023-07-06T22:18:22.875 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T22:02:09.638482+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T22:02:10.753761+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 32, 'snap_epoch': 165, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:18:22.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:18:22.907 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:22.906+0000 7fb314076180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:18:22.931 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:22.925+0000 7f1478884180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:18:23.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.017+0000 7f701a3a3640 1 Processor -- start 2023-07-06T22:18:23.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.017+0000 7f701a3a3640 1 -- start start 2023-07-06T22:18:23.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.021+0000 7f701a3a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f701406f470 0x7f70140c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.021+0000 7f701a3a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f701406ff50 0x7f70140cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.021+0000 7f701a3a3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7014070370 con 0x7f70140c9360 2023-07-06T22:18:23.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.021+0000 7f701a3a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7014158550 con 0x7f701406f470 2023-07-06T22:18:23.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.021+0000 7f701a3a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70140c9800 con 0x7f701406ff50 2023-07-06T22:18:23.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.021+0000 7f7013fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f701406f470 0x7f70140c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.021+0000 7f7013fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f701406f470 0x7f70140c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43924/0 (socket says 172.21.15.55:43924) 2023-07-06T22:18:23.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.021+0000 7f7013fff640 1 -- 172.21.15.55:0/3793506325 learned_addr learned my addr 172.21.15.55:0/3793506325 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:23.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.021+0000 7f7018940640 1 --2- 172.21.15.55:0/3793506325 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f701406ff50 0x7f70140cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.021+0000 7f7013fff640 1 -- 172.21.15.55:0/3793506325 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f701406ff50 msgr2=0x7f70140cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:23.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.021+0000 7f7013fff640 1 --2- 172.21.15.55:0/3793506325 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f701406ff50 0x7f70140cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.021+0000 7f7013fff640 1 -- 172.21.15.55:0/3793506325 >> v1:172.21.15.138:6789/0 conn(0x7f70140c9360 legacy=0x7f701406f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.021+0000 7f7013fff640 1 -- 172.21.15.55:0/3793506325 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140c9ae0 con 0x7f701406f470 2023-07-06T22:18:23.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.025+0000 7f7013fff640 1 --2- 172.21.15.55:0/3793506325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f701406f470 0x7f70140c8e20 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f70040098a0 tx=0x7f700401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99d1c4cace8b2e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:23.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.025+0000 7f7012ffd640 1 -- 172.21.15.55:0/3793506325 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040ad660 con 0x7f701406f470 2023-07-06T22:18:23.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.025+0000 7f7012ffd640 1 -- 172.21.15.55:0/3793506325 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70040ad7c0 con 0x7f701406f470 2023-07-06T22:18:23.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.025+0000 7f7012ffd640 1 -- 172.21.15.55:0/3793506325 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040adb50 con 0x7f701406f470 2023-07-06T22:18:23.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.025+0000 7f701a3a3640 1 -- 172.21.15.55:0/3793506325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f701406f470 msgr2=0x7f70140c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.025+0000 7f701a3a3640 1 --2- 172.21.15.55:0/3793506325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f701406f470 0x7f70140c8e20 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f70040098a0 tx=0x7f700401c4f0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.025+0000 7f701a3a3640 1 -- 172.21.15.55:0/3793506325 shutdown_connections 2023-07-06T22:18:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.025+0000 7f701a3a3640 1 --2- 172.21.15.55:0/3793506325 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f701406ff50 0x7f70140cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.025+0000 7f701a3a3640 1 --2- 172.21.15.55:0/3793506325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f701406f470 0x7f70140c8e20 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.025+0000 7f701a3a3640 1 -- 172.21.15.55:0/3793506325 >> 172.21.15.55:0/3793506325 conn(0x7f70140cea70 msgr2=0x7f70140ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.025+0000 7f701a3a3640 1 -- 172.21.15.55:0/3793506325 shutdown_connections 2023-07-06T22:18:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.025+0000 7f701a3a3640 1 -- 172.21.15.55:0/3793506325 wait complete. 2023-07-06T22:18:23.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f701a3a3640 1 Processor -- start 2023-07-06T22:18:23.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f701a3a3640 1 -- start start 2023-07-06T22:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f701a3a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f701406f470 0x7f70140c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f701a3a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f701406ff50 0x7f70141662b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f701a3a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70140c9360 0x7f70140c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f701a3a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70140c5360 con 0x7f701406f470 2023-07-06T22:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f701a3a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7014153750 con 0x7f70140c9360 2023-07-06T22:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f701a3a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7014153a30 con 0x7f701406ff50 2023-07-06T22:18:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f7013fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f701406f470 0x7f70140c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f70137fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f701406ff50 0x7f70141662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f7013fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f701406f470 0x7f70140c4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43930/0 (socket says 172.21.15.55:43930) 2023-07-06T22:18:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f7018940640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70140c9360 0x7f70140c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f7013fff640 1 -- 172.21.15.55:0/3519431261 learned_addr learned my addr 172.21.15.55:0/3519431261 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:23.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f7013fff640 1 -- 172.21.15.55:0/3519431261 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f701406ff50 msgr2=0x7f70141662b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f7013fff640 1 --2- 172.21.15.55:0/3519431261 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f701406ff50 0x7f70141662b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f7013fff640 1 -- 172.21.15.55:0/3519431261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70140c9360 msgr2=0x7f70140c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f7013fff640 1 --2- 172.21.15.55:0/3519431261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70140c9360 0x7f70140c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f7013fff640 1 -- 172.21.15.55:0/3519431261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70040094d0 con 0x7f701406f470 2023-07-06T22:18:23.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f70137fe640 1 --2- 172.21.15.55:0/3519431261 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f701406ff50 0x7f70141662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:23.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f7013fff640 1 --2- 172.21.15.55:0/3519431261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f701406f470 0x7f70140c4e20 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f70040b0040 tx=0x7f7004019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:23.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f7010ff9640 1 -- 172.21.15.55:0/3519431261 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040bb070 con 0x7f701406f470 2023-07-06T22:18:23.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f7010ff9640 1 -- 172.21.15.55:0/3519431261 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70040b6440 con 0x7f701406f470 2023-07-06T22:18:23.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f701a3a3640 1 -- 172.21.15.55:0/3519431261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7014153d10 con 0x7f701406f470 2023-07-06T22:18:23.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f7010ff9640 1 -- 172.21.15.55:0/3519431261 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040b6810 con 0x7f701406f470 2023-07-06T22:18:23.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.029+0000 7f701a3a3640 1 -- 172.21.15.55:0/3519431261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70141542d0 con 0x7f701406f470 2023-07-06T22:18:23.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.033+0000 7f701a3a3640 1 -- 172.21.15.55:0/3519431261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7014066d60 con 0x7f701406f470 2023-07-06T22:18:23.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.033+0000 7f7010ff9640 1 -- 172.21.15.55:0/3519431261 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 91) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f70040b4070 con 0x7f701406f470 2023-07-06T22:18:23.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.033+0000 7f7010ff9640 1 --2- 172.21.15.55:0/3519431261 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f70000663a0 0x7f7000068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.033+0000 7f70137fe640 1 -- 172.21.15.55:0/3519431261 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f70000663a0 msgr2=0x7f7000068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/2366924175 2023-07-06T22:18:23.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.033+0000 7f7010ff9640 1 -- 172.21.15.55:0/3519431261 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 7215+0+0 (secure 0 0 0) 0x7f700411dca0 con 0x7f701406f470 2023-07-06T22:18:23.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.033+0000 7f70137fe640 1 --2- 172.21.15.55:0/3519431261 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f70000663a0 0x7f7000068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:18:23.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.037+0000 7f7010ff9640 1 -- 172.21.15.55:0/3519431261 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f70040eaa90 con 0x7f701406f470 2023-07-06T22:18:23.092 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:23.089+0000 7f1478884180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:18:23.177 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:23.174+0000 7fb314076180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:18:23.181 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:23.177+0000 7f1478884180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:18:23.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.193+0000 7f701a3a3640 1 -- 172.21.15.55:0/3519431261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70140cd240 con 0x7f701406f470 2023-07-06T22:18:23.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.193+0000 7f7010ff9640 1 -- 172.21.15.55:0/3519431261 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v165) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70040ee0b0 con 0x7f701406f470 2023-07-06T22:18:23.199 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:18:23.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.197+0000 7f701a3a3640 1 -- 172.21.15.55:0/3519431261 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f70000663a0 msgr2=0x7f7000068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:18:23.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.197+0000 7f701a3a3640 1 --2- 172.21.15.55:0/3519431261 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f70000663a0 0x7f7000068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.197+0000 7f701a3a3640 1 -- 172.21.15.55:0/3519431261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f701406f470 msgr2=0x7f70140c4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.197+0000 7f701a3a3640 1 --2- 172.21.15.55:0/3519431261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f701406f470 0x7f70140c4e20 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f70040b0040 tx=0x7f7004019290 comp rx=0 tx=0).stop 2023-07-06T22:18:23.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.197+0000 7f701a3a3640 1 -- 172.21.15.55:0/3519431261 shutdown_connections 2023-07-06T22:18:23.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.197+0000 7f701a3a3640 1 --2- 172.21.15.55:0/3519431261 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f70000663a0 0x7f7000068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.197+0000 7f701a3a3640 1 --2- 172.21.15.55:0/3519431261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70140c9360 0x7f70140c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.197+0000 7f701a3a3640 1 --2- 172.21.15.55:0/3519431261 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f701406ff50 0x7f70141662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.197+0000 7f701a3a3640 1 --2- 172.21.15.55:0/3519431261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f701406f470 0x7f70140c4e20 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.197+0000 7f701a3a3640 1 -- 172.21.15.55:0/3519431261 >> 172.21.15.55:0/3519431261 conn(0x7f70140cea70 msgr2=0x7f70140cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:23.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.197+0000 7f701a3a3640 1 -- 172.21.15.55:0/3519431261 shutdown_connections 2023-07-06T22:18:23.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.197+0000 7f701a3a3640 1 -- 172.21.15.55:0/3519431261 wait complete. 2023-07-06T22:18:23.221 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:18:23.255 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:23.234+0000 7fb314076180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:18:23.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f532bc6d640 1 Processor -- start 2023-07-06T22:18:23.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f532bc6d640 1 -- start start 2023-07-06T22:18:23.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f532bc6d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53240b3870 0x7f53240b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f532bc6d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53240d03c0 0x7f53240d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f532bc6d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53240b2b80 con 0x7f532415b850 2023-07-06T22:18:23.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f532bc6d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53240cff30 con 0x7f53240d03c0 2023-07-06T22:18:23.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f532bc6d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53240b41e0 con 0x7f53240b3870 2023-07-06T22:18:23.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f532a20a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53240d03c0 0x7f53240d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f532a20a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53240d03c0 0x7f53240d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45618/0 (socket says 172.21.15.55:45618) 2023-07-06T22:18:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f532a20a640 1 -- 172.21.15.55:0/357728091 learned_addr learned my addr 172.21.15.55:0/357728091 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f5329208640 1 --2- 172.21.15.55:0/357728091 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53240b3870 0x7f53240b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f532a20a640 1 -- 172.21.15.55:0/357728091 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53240b3870 msgr2=0x7f53240b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f532a20a640 1 --2- 172.21.15.55:0/357728091 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53240b3870 0x7f53240b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f532a20a640 1 -- 172.21.15.55:0/357728091 >> v1:172.21.15.138:6789/0 conn(0x7f532415b850 legacy=0x7f53240cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.397+0000 7f532a20a640 1 -- 172.21.15.55:0/357728091 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53240b22e0 con 0x7f53240d03c0 2023-07-06T22:18:23.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.401+0000 7f532a20a640 1 --2- 172.21.15.55:0/357728091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240d03c0 0x7f53240d0820 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f531c009e50 tx=0x7f531c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8c50d38deec8c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:23.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.401+0000 7f5328a07640 1 -- 172.21.15.55:0/357728091 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0a5780 con 0x7f53240d03c0 2023-07-06T22:18:23.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.401+0000 7f5328a07640 1 -- 172.21.15.55:0/357728091 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c0a58e0 con 0x7f53240d03c0 2023-07-06T22:18:23.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.401+0000 7f5328a07640 1 -- 172.21.15.55:0/357728091 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0a5c70 con 0x7f53240d03c0 2023-07-06T22:18:23.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.401+0000 7f532bc6d640 1 -- 172.21.15.55:0/357728091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240d03c0 msgr2=0x7f53240d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.401+0000 7f532bc6d640 1 --2- 172.21.15.55:0/357728091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240d03c0 0x7f53240d0820 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f531c009e50 tx=0x7f531c01c8c0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.401+0000 7f532bc6d640 1 -- 172.21.15.55:0/357728091 shutdown_connections 2023-07-06T22:18:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.401+0000 7f532bc6d640 1 --2- 172.21.15.55:0/357728091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240d03c0 0x7f53240d0820 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.401+0000 7f532bc6d640 1 --2- 172.21.15.55:0/357728091 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f53240b3870 0x7f53240b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.401+0000 7f532bc6d640 1 -- 172.21.15.55:0/357728091 >> 172.21.15.55:0/357728091 conn(0x7f53240cec20 msgr2=0x7f53240cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.401+0000 7f532bc6d640 1 -- 172.21.15.55:0/357728091 shutdown_connections 2023-07-06T22:18:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.401+0000 7f532bc6d640 1 -- 172.21.15.55:0/357728091 wait complete. 2023-07-06T22:18:23.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f532bc6d640 1 Processor -- start 2023-07-06T22:18:23.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f532bc6d640 1 -- start start 2023-07-06T22:18:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f532bc6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240b3870 0x7f532413a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f532bc6d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53240d03c0 0x7f5324148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f532bc6d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f532415b850 0x7f532414e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f532bc6d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5324148a70 con 0x7f53240b3870 2023-07-06T22:18:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f532bc6d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532413a980 con 0x7f53240d03c0 2023-07-06T22:18:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f532bc6d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532414f450 con 0x7f532415b850 2023-07-06T22:18:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f5329a09640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240b3870 0x7f532413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f5329a09640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240b3870 0x7f532413a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45620/0 (socket says 172.21.15.55:45620) 2023-07-06T22:18:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f5329a09640 1 -- 172.21.15.55:0/1937493992 learned_addr learned my addr 172.21.15.55:0/1937493992 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:23.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f532a20a640 1 --2- 172.21.15.55:0/1937493992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f532415b850 0x7f532414e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f5329208640 1 --2- 172.21.15.55:0/1937493992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53240d03c0 0x7f5324148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f5329a09640 1 -- 172.21.15.55:0/1937493992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f532415b850 msgr2=0x7f532414e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f5329a09640 1 --2- 172.21.15.55:0/1937493992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f532415b850 0x7f532414e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f5329a09640 1 -- 172.21.15.55:0/1937493992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53240d03c0 msgr2=0x7f5324148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f5329a09640 1 --2- 172.21.15.55:0/1937493992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53240d03c0 0x7f5324148e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f5329a09640 1 -- 172.21.15.55:0/1937493992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c009b30 con 0x7f53240b3870 2023-07-06T22:18:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f532a20a640 1 --2- 172.21.15.55:0/1937493992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f532415b850 0x7f532414e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f5329a09640 1 --2- 172.21.15.55:0/1937493992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240b3870 0x7f532413a440 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f532000c500 tx=0x7f532000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f531a7fc640 1 -- 172.21.15.55:0/1937493992 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5320005220 con 0x7f53240b3870 2023-07-06T22:18:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f531a7fc640 1 -- 172.21.15.55:0/1937493992 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5320005380 con 0x7f53240b3870 2023-07-06T22:18:23.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f531a7fc640 1 -- 172.21.15.55:0/1937493992 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5320007270 con 0x7f53240b3870 2023-07-06T22:18:23.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f532bc6d640 1 -- 172.21.15.55:0/1937493992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53241483b0 con 0x7f53240b3870 2023-07-06T22:18:23.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.405+0000 7f532bc6d640 1 -- 172.21.15.55:0/1937493992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5324149b00 con 0x7f53240b3870 2023-07-06T22:18:23.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.409+0000 7f532bc6d640 1 -- 172.21.15.55:0/1937493992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5324148ce0 con 0x7f53240b3870 2023-07-06T22:18:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.409+0000 7f531a7fc640 1 -- 172.21.15.55:0/1937493992 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 91) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f53200073d0 con 0x7f53240b3870 2023-07-06T22:18:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.409+0000 7f531a7fc640 1 --2- 172.21.15.55:0/1937493992 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f53080663a0 0x7f5308068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.409+0000 7f5329208640 1 -- 172.21.15.55:0/1937493992 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f53080663a0 msgr2=0x7f5308068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/2366924175 2023-07-06T22:18:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.409+0000 7f531a7fc640 1 -- 172.21.15.55:0/1937493992 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 7215+0+0 (secure 0 0 0) 0x7f5320083d30 con 0x7f53240b3870 2023-07-06T22:18:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.409+0000 7f5329208640 1 --2- 172.21.15.55:0/1937493992 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f53080663a0 0x7f5308068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:18:23.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.413+0000 7f531a7fc640 1 -- 172.21.15.55:0/1937493992 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5320050b90 con 0x7f53240b3870 2023-07-06T22:18:23.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.441+0000 7f531a7fc640 1 -- 172.21.15.55:0/1937493992 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 92) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f5320050f60 con 0x7f53240b3870 2023-07-06T22:18:23.484 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:23.481+0000 7f1478884180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:18:23.548 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:23.541+0000 7f1478884180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:18:23.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.553+0000 7f531a7fc640 1 -- 172.21.15.55:0/1937493992 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 93) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f53200710b0 con 0x7f53240b3870 2023-07-06T22:18:23.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.553+0000 7f531a7fc640 1 -- 172.21.15.55:0/1937493992 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f53080663a0 msgr2=0x7f5308068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:18:23.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.553+0000 7f531a7fc640 1 --2- 172.21.15.55:0/1937493992 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f53080663a0 0x7f5308068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.589+0000 7f532bc6d640 1 -- 172.21.15.55:0/1937493992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5324066d60 con 0x7f53240b3870 2023-07-06T22:18:23.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.589+0000 7f531a7fc640 1 -- 172.21.15.55:0/1937493992 <== mon.0 v2:172.21.15.55:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v167) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5320051ba0 con 0x7f53240b3870 2023-07-06T22:18:23.593 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:18:23.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.589+0000 7f532bc6d640 1 -- 172.21.15.55:0/1937493992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240b3870 msgr2=0x7f532413a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.589+0000 7f532bc6d640 1 --2- 172.21.15.55:0/1937493992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240b3870 0x7f532413a440 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f532000c500 tx=0x7f532000c9c0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.589+0000 7f532bc6d640 1 -- 172.21.15.55:0/1937493992 shutdown_connections 2023-07-06T22:18:23.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.589+0000 7f532bc6d640 1 --2- 172.21.15.55:0/1937493992 >> [v2:172.21.15.55:6832/2366924175,v1:172.21.15.55:6833/2366924175] conn(0x7f53080663a0 0x7f5308068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.589+0000 7f532bc6d640 1 --2- 172.21.15.55:0/1937493992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f532415b850 0x7f532414e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.589+0000 7f532bc6d640 1 --2- 172.21.15.55:0/1937493992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53240d03c0 0x7f5324148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.589+0000 7f532bc6d640 1 --2- 172.21.15.55:0/1937493992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53240b3870 0x7f532413a440 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.589+0000 7f532bc6d640 1 -- 172.21.15.55:0/1937493992 >> 172.21.15.55:0/1937493992 conn(0x7f53240cec20 msgr2=0x7f53240b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:23.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.589+0000 7f532bc6d640 1 -- 172.21.15.55:0/1937493992 shutdown_connections 2023-07-06T22:18:23.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.589+0000 7f532bc6d640 1 -- 172.21.15.55:0/1937493992 wait complete. 2023-07-06T22:18:23.626 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T22:18:23.637 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:23.633+0000 7f1401204640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:23.637 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:23.633+0000 7f1401204640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:23.637 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:23.633+0000 7f1401204640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:23.637 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:23.633+0000 7f1401204640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:23.637 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:23.633+0000 7f1401204640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:23.637 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:23.633+0000 7f1404a0b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:23.637 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:23.633+0000 7f1404a0b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:23.638 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:23.633+0000 7f1404a0b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:23.638 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:23.633+0000 7f1404a0b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:23.638 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:23.633+0000 7f1404a0b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf7a34640 1 Processor -- start 2023-07-06T22:18:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf7a34640 1 -- start start 2023-07-06T22:18:23.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf7a34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1bf015bb90 0x7f1bf00ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf7a34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bf0070020 0x7f1bf00c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf7a34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf015fe80 con 0x7f1bf00cef40 2023-07-06T22:18:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf7a34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf015f620 con 0x7f1bf015bb90 2023-07-06T22:18:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf7a34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf015bf60 con 0x7f1bf0070020 2023-07-06T22:18:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf57d0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1bf015bb90 0x7f1bf00ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf57d0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1bf015bb90 0x7f1bf00ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45766/0 (socket says 172.21.15.55:45766) 2023-07-06T22:18:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf57d0640 1 -- 172.21.15.55:0/3465488540 learned_addr learned my addr 172.21.15.55:0/3465488540 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf4fcf640 1 --1- 172.21.15.55:0/3465488540 >> v1:172.21.15.55:6789/0 conn(0x7f1bf00cef40 0x7f1bf006f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41656/0 (socket says 172.21.15.55:41656) 2023-07-06T22:18:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf5fd1640 1 --2- 172.21.15.55:0/3465488540 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bf0070020 0x7f1bf00c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf57d0640 1 -- 172.21.15.55:0/3465488540 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bf0070020 msgr2=0x7f1bf00c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf57d0640 1 --2- 172.21.15.55:0/3465488540 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bf0070020 0x7f1bf00c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf57d0640 1 -- 172.21.15.55:0/3465488540 >> v1:172.21.15.55:6789/0 conn(0x7f1bf00cef40 legacy=0x7f1bf006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1be7fff640 1 -- 172.21.15.55:0/3465488540 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387261539 0 0) 0x7f1bf015fe80 con 0x7f1bf00cef40 2023-07-06T22:18:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.773+0000 7f1bf57d0640 1 -- 172.21.15.55:0/3465488540 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf00cf440 con 0x7f1bf015bb90 2023-07-06T22:18:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.777+0000 7f1bf57d0640 1 --2- 172.21.15.55:0/3465488540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf015bb90 0x7f1bf00ce030 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009870 tx=0x7f1bec01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3426cbab6d705ade server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:23.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.777+0000 7f1be7fff640 1 -- 172.21.15.55:0/3465488540 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0ab600 con 0x7f1bf015bb90 2023-07-06T22:18:23.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.777+0000 7f1be7fff640 1 -- 172.21.15.55:0/3465488540 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec0a7050 con 0x7f1bf015bb90 2023-07-06T22:18:23.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.777+0000 7f1be7fff640 1 -- 172.21.15.55:0/3465488540 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0ab980 con 0x7f1bf015bb90 2023-07-06T22:18:23.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.777+0000 7f1bf7a34640 1 -- 172.21.15.55:0/3465488540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf015bb90 msgr2=0x7f1bf00ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.777+0000 7f1bf7a34640 1 --2- 172.21.15.55:0/3465488540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf015bb90 0x7f1bf00ce030 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009870 tx=0x7f1bec01c540 comp rx=0 tx=0).stop 2023-07-06T22:18:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.777+0000 7f1bf7a34640 1 -- 172.21.15.55:0/3465488540 shutdown_connections 2023-07-06T22:18:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.777+0000 7f1bf7a34640 1 --2- 172.21.15.55:0/3465488540 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bf0070020 0x7f1bf00c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.777+0000 7f1bf7a34640 1 --2- 172.21.15.55:0/3465488540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf015bb90 0x7f1bf00ce030 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.777+0000 7f1bf7a34640 1 -- 172.21.15.55:0/3465488540 >> 172.21.15.55:0/3465488540 conn(0x7f1bf00cbd70 msgr2=0x7f1bf00ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.777+0000 7f1bf7a34640 1 -- 172.21.15.55:0/3465488540 shutdown_connections 2023-07-06T22:18:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.777+0000 7f1bf7a34640 1 -- 172.21.15.55:0/3465488540 wait complete. 2023-07-06T22:18:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf7a34640 1 Processor -- start 2023-07-06T22:18:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf7a34640 1 -- start start 2023-07-06T22:18:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf7a34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bf0070020 0x7f1bf00b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf7a34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf00cef40 0x7f1bf00b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf7a34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bf015bb90 0x7f1bf00ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf7a34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf00b23f0 con 0x7f1bf00cef40 2023-07-06T22:18:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf7a34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf0153440 con 0x7f1bf0070020 2023-07-06T22:18:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf7a34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf00c4f00 con 0x7f1bf015bb90 2023-07-06T22:18:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf4fcf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf00cef40 0x7f1bf00b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf4fcf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf00cef40 0x7f1bf00b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45772/0 (socket says 172.21.15.55:45772) 2023-07-06T22:18:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf4fcf640 1 -- 172.21.15.55:0/1209203660 learned_addr learned my addr 172.21.15.55:0/1209203660 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf5fd1640 1 --2- 172.21.15.55:0/1209203660 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bf015bb90 0x7f1bf00ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf57d0640 1 --2- 172.21.15.55:0/1209203660 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bf0070020 0x7f1bf00b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf4fcf640 1 -- 172.21.15.55:0/1209203660 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bf015bb90 msgr2=0x7f1bf00ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf4fcf640 1 --2- 172.21.15.55:0/1209203660 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bf015bb90 0x7f1bf00ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf4fcf640 1 -- 172.21.15.55:0/1209203660 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bf0070020 msgr2=0x7f1bf00b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf4fcf640 1 --2- 172.21.15.55:0/1209203660 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bf0070020 0x7f1bf00b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf4fcf640 1 -- 172.21.15.55:0/1209203660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec0094d0 con 0x7f1bf00cef40 2023-07-06T22:18:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf4fcf640 1 --2- 172.21.15.55:0/1209203660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf00cef40 0x7f1bf00b2880 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f1be000c4e0 tx=0x7f1be000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1be5ffb640 1 -- 172.21.15.55:0/1209203660 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be00074e0 con 0x7f1bf00cef40 2023-07-06T22:18:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1be5ffb640 1 -- 172.21.15.55:0/1209203660 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be0007660 con 0x7f1bf00cef40 2023-07-06T22:18:23.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1be5ffb640 1 -- 172.21.15.55:0/1209203660 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0004a30 con 0x7f1bf00cef40 2023-07-06T22:18:23.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf7a34640 1 -- 172.21.15.55:0/1209203660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf00c51e0 con 0x7f1bf00cef40 2023-07-06T22:18:23.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf7a34640 1 -- 172.21.15.55:0/1209203660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf00b2dc0 con 0x7f1bf00cef40 2023-07-06T22:18:23.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.781+0000 7f1bf7a34640 1 -- 172.21.15.55:0/1209203660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf00b1ee0 con 0x7f1bf00cef40 2023-07-06T22:18:23.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.785+0000 7f1be5ffb640 1 -- 172.21.15.55:0/1209203660 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 93) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f1be0004b90 con 0x7f1bf00cef40 2023-07-06T22:18:23.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.785+0000 7f1be5ffb640 1 -- 172.21.15.55:0/1209203660 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 7499+0+0 (secure 0 0 0) 0x7f1be0082ee0 con 0x7f1bf00cef40 2023-07-06T22:18:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.789+0000 7f1be5ffb640 1 -- 172.21.15.55:0/1209203660 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1bf00b1ee0 con 0x7f1bf00cef40 2023-07-06T22:18:23.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.945+0000 7f1bf7a34640 1 -- 172.21.15.55:0/1209203660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1bf00b25a0 con 0x7f1bf00cef40 2023-07-06T22:18:23.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.945+0000 7f1be5ffb640 1 -- 172.21.15.55:0/1209203660 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v167) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1bf00b25a0 con 0x7f1bf00cef40 2023-07-06T22:18:23.950 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T22:18:23.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.945+0000 7f1bf7a34640 1 -- 172.21.15.55:0/1209203660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf00cef40 msgr2=0x7f1bf00b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:23.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.945+0000 7f1bf7a34640 1 --2- 172.21.15.55:0/1209203660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf00cef40 0x7f1bf00b2880 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f1be000c4e0 tx=0x7f1be000c9a0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.949+0000 7f1bf7a34640 1 -- 172.21.15.55:0/1209203660 shutdown_connections 2023-07-06T22:18:23.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.949+0000 7f1bf7a34640 1 --2- 172.21.15.55:0/1209203660 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1bf015bb90 0x7f1bf00ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.949+0000 7f1bf7a34640 1 --2- 172.21.15.55:0/1209203660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf00cef40 0x7f1bf00b2880 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.949+0000 7f1bf7a34640 1 --2- 172.21.15.55:0/1209203660 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bf0070020 0x7f1bf00b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:23.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.949+0000 7f1bf7a34640 1 -- 172.21.15.55:0/1209203660 >> 172.21.15.55:0/1209203660 conn(0x7f1bf00cbd70 msgr2=0x7f1bf00b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:23.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.949+0000 7f1bf7a34640 1 -- 172.21.15.55:0/1209203660 shutdown_connections 2023-07-06T22:18:23.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:23.949+0000 7f1bf7a34640 1 -- 172.21.15.55:0/1209203660 wait complete. 2023-07-06T22:18:23.971 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T22:18:24.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff9a34640 1 Processor -- start 2023-07-06T22:18:24.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff9a34640 1 -- start start 2023-07-06T22:18:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff9a34640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4ff406fef0 0x7f4ff4164820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff9a34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff40cc030 con 0x7f4ff40709a0 2023-07-06T22:18:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff9a34640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff40cc300 con 0x7f4ff4070d70 2023-07-06T22:18:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff9a34640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff40cc5e0 con 0x7f4ff406fef0 2023-07-06T22:18:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff2ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4ff40709a0 0x7f4ff40cb920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41664/0 (socket says 172.21.15.55:41664) 2023-07-06T22:18:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff2ffd640 1 -- 172.21.15.55:0/3320217043 learned_addr learned my addr 172.21.15.55:0/3320217043 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822209774 0 0) 0x7f4ff40cc030 con 0x7f4ff40709a0 2023-07-06T22:18:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff37fe640 1 --2- 172.21.15.55:0/3320217043 >> v2:172.21.15.138:3300/0 conn(0x7f4ff406fef0 0x7f4ff4164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe0003530 con 0x7f4ff40709a0 2023-07-06T22:18:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804281463 0 0) 0x7f4ff40cc300 con 0x7f4ff4070d70 2023-07-06T22:18:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff40cc030 con 0x7f4ff4070d70 2023-07-06T22:18:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2386045680 0 0) 0x7f4fe0003530 con 0x7f4ff40709a0 2023-07-06T22:18:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 >> v2:172.21.15.138:3300/0 conn(0x7f4ff406fef0 msgr2=0x7f4ff4164820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 --2- 172.21.15.55:0/3320217043 >> v2:172.21.15.138:3300/0 conn(0x7f4ff406fef0 0x7f4ff4164820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 >> v1:172.21.15.138:6789/0 conn(0x7f4ff4070d70 legacy=0x7f4ff40b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff40cc8c0 con 0x7f4ff40709a0 2023-07-06T22:18:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f4fe4001680 con 0x7f4ff40709a0 2023-07-06T22:18:24.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 >> v1:172.21.15.55:6789/0 conn(0x7f4ff40709a0 legacy=0x7f4ff40cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 --2- 172.21.15.55:0/3320217043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fe0003b60 0x7f4fe0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 --2- 172.21.15.55:0/3320217043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fe00047d0 0x7f4fe0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 --2- 172.21.15.55:0/3320217043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4fe0005180 0x7f4fe000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff40cc5e0 con 0x7f4fe0003b60 2023-07-06T22:18:24.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe000c060 con 0x7f4fe00047d0 2023-07-06T22:18:24.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe000c1f0 con 0x7f4fe0005180 2023-07-06T22:18:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff2ffd640 1 --2- 172.21.15.55:0/3320217043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fe0003b60 0x7f4fe0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4febfff640 1 --2- 172.21.15.55:0/3320217043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fe00047d0 0x7f4fe0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.157+0000 7f4ff37fe640 1 --2- 172.21.15.55:0/3320217043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4fe0005180 0x7f4fe000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff2ffd640 1 -- 172.21.15.55:0/3320217043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4fe0005180 msgr2=0x7f4fe000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff2ffd640 1 --2- 172.21.15.55:0/3320217043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4fe0005180 0x7f4fe000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff2ffd640 1 -- 172.21.15.55:0/3320217043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fe00047d0 msgr2=0x7f4fe0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff2ffd640 1 --2- 172.21.15.55:0/3320217043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fe00047d0 0x7f4fe0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff2ffd640 1 -- 172.21.15.55:0/3320217043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe0003530 con 0x7f4fe0003b60 2023-07-06T22:18:24.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff37fe640 1 -- 172.21.15.55:0/3320217043 reap_dead start 2023-07-06T22:18:24.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4febfff640 1 --2- 172.21.15.55:0/3320217043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fe00047d0 0x7f4fe0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff2ffd640 1 --2- 172.21.15.55:0/3320217043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fe0003b60 0x7f4fe0003f50 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4007f80 tx=0x7f4fe401cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbc2d7437a885da server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4005ae0 con 0x7f4fe0003b60 2023-07-06T22:18:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe4005c40 con 0x7f4fe0003b60 2023-07-06T22:18:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff27fc640 1 -- 172.21.15.55:0/3320217043 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe40072b0 con 0x7f4fe0003b60 2023-07-06T22:18:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff9a34640 1 -- 172.21.15.55:0/3320217043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fe0003b60 msgr2=0x7f4fe0003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff9a34640 1 --2- 172.21.15.55:0/3320217043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fe0003b60 0x7f4fe0003f50 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4007f80 tx=0x7f4fe401cae0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff9a34640 1 -- 172.21.15.55:0/3320217043 shutdown_connections 2023-07-06T22:18:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff9a34640 1 --2- 172.21.15.55:0/3320217043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fe0003b60 0x7f4fe0003f50 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.161+0000 7f4ff9a34640 1 -- 172.21.15.55:0/3320217043 >> 172.21.15.55:0/3320217043 conn(0x7f4ff40cea70 msgr2=0x7f4ff40ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4ff9a34640 1 -- 172.21.15.55:0/3320217043 shutdown_connections 2023-07-06T22:18:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4ff9a34640 1 -- 172.21.15.55:0/3320217043 wait complete. 2023-07-06T22:18:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4ff9a34640 1 Processor -- start 2023-07-06T22:18:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4ff9a34640 1 -- start start 2023-07-06T22:18:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4ff9a34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4fe0003b60 0x7f4ff406bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4ff9a34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ff415b210 0x7f4ff41e5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4ff9a34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ff41e6340 0x7f4ff40af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4ff9a34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff406c450 con 0x7f4ff415b210 2023-07-06T22:18:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4ff9a34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff415c210 con 0x7f4ff41e6340 2023-07-06T22:18:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4ff9a34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff406ab90 con 0x7f4fe0003b60 2023-07-06T22:18:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4febfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ff415b210 0x7f4ff41e5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4febfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ff415b210 0x7f4ff41e5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45792/0 (socket says 172.21.15.55:45792) 2023-07-06T22:18:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4febfff640 1 -- 172.21.15.55:0/524454668 learned_addr learned my addr 172.21.15.55:0/524454668 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4ff2ffd640 1 --2- 172.21.15.55:0/524454668 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4fe0003b60 0x7f4ff406bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4ff37fe640 1 --2- 172.21.15.55:0/524454668 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ff41e6340 0x7f4ff40af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4febfff640 1 -- 172.21.15.55:0/524454668 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4fe0003b60 msgr2=0x7f4ff406bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4febfff640 1 --2- 172.21.15.55:0/524454668 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4fe0003b60 0x7f4ff406bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4febfff640 1 -- 172.21.15.55:0/524454668 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ff41e6340 msgr2=0x7f4ff40af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4febfff640 1 --2- 172.21.15.55:0/524454668 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ff41e6340 0x7f4ff40af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4febfff640 1 -- 172.21.15.55:0/524454668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff406ae70 con 0x7f4ff415b210 2023-07-06T22:18:24.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.165+0000 7f4febfff640 1 --2- 172.21.15.55:0/524454668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ff415b210 0x7f4ff41e5e00 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00f930 tx=0x7f4fdc00fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.169+0000 7f4ff0ff9640 1 -- 172.21.15.55:0/524454668 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0052e0 con 0x7f4ff415b210 2023-07-06T22:18:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.169+0000 7f4ff0ff9640 1 -- 172.21.15.55:0/524454668 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fdc005440 con 0x7f4ff415b210 2023-07-06T22:18:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.169+0000 7f4ff0ff9640 1 -- 172.21.15.55:0/524454668 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc003820 con 0x7f4ff415b210 2023-07-06T22:18:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.169+0000 7f4ff9a34640 1 -- 172.21.15.55:0/524454668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff406b150 con 0x7f4ff415b210 2023-07-06T22:18:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.169+0000 7f4ff9a34640 1 -- 172.21.15.55:0/524454668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff406b710 con 0x7f4ff415b210 2023-07-06T22:18:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.169+0000 7f4ff9a34640 1 -- 172.21.15.55:0/524454668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff4066d60 con 0x7f4ff415b210 2023-07-06T22:18:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.169+0000 7f4ff0ff9640 1 -- 172.21.15.55:0/524454668 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 93) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f4fdc003980 con 0x7f4ff415b210 2023-07-06T22:18:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.169+0000 7f4ff0ff9640 1 -- 172.21.15.55:0/524454668 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 7499+0+0 (secure 0 0 0) 0x7f4fdc083920 con 0x7f4ff415b210 2023-07-06T22:18:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.173+0000 7f4ff0ff9640 1 -- 172.21.15.55:0/524454668 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4fdc050c10 con 0x7f4ff415b210 2023-07-06T22:18:24.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.333+0000 7f4ff9a34640 1 -- 172.21.15.55:0/524454668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ff40c7e50 con 0x7f4ff415b210 2023-07-06T22:18:24.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.333+0000 7f4ff0ff9640 1 -- 172.21.15.55:0/524454668 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v167) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4fdc054230 con 0x7f4ff415b210 2023-07-06T22:18:24.338 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T22:18:24.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.337+0000 7f4ff9a34640 1 -- 172.21.15.55:0/524454668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ff415b210 msgr2=0x7f4ff41e5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.337+0000 7f4ff9a34640 1 --2- 172.21.15.55:0/524454668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ff415b210 0x7f4ff41e5e00 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00f930 tx=0x7f4fdc00fa20 comp rx=0 tx=0).stop 2023-07-06T22:18:24.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.337+0000 7f4ff9a34640 1 -- 172.21.15.55:0/524454668 shutdown_connections 2023-07-06T22:18:24.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.337+0000 7f4ff9a34640 1 --2- 172.21.15.55:0/524454668 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ff41e6340 0x7f4ff40af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.337+0000 7f4ff9a34640 1 --2- 172.21.15.55:0/524454668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ff415b210 0x7f4ff41e5e00 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.337+0000 7f4ff9a34640 1 --2- 172.21.15.55:0/524454668 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4fe0003b60 0x7f4ff406bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.337+0000 7f4ff9a34640 1 -- 172.21.15.55:0/524454668 >> 172.21.15.55:0/524454668 conn(0x7f4ff40cea70 msgr2=0x7f4ff40aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:24.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.337+0000 7f4ff9a34640 1 -- 172.21.15.55:0/524454668 shutdown_connections 2023-07-06T22:18:24.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.337+0000 7f4ff9a34640 1 -- 172.21.15.55:0/524454668 wait complete. 2023-07-06T22:18:24.362 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:18:24.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.501+0000 7fab79303640 1 Processor -- start 2023-07-06T22:18:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.501+0000 7fab79303640 1 -- start start 2023-07-06T22:18:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.501+0000 7fab79303640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fab74159980 0x7fab7406e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.501+0000 7fab79303640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab7415d390 0x7fab7415d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.501+0000 7fab79303640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7415dd20 con 0x7fab7406adc0 2023-07-06T22:18:24.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.501+0000 7fab79303640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab74159d50 con 0x7fab74159980 2023-07-06T22:18:24.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.501+0000 7fab79303640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7406eca0 con 0x7fab7415d390 2023-07-06T22:18:24.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.501+0000 7fab72ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fab74159980 0x7fab7406e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.505+0000 7fab72ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fab74159980 0x7fab7406e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45804/0 (socket says 172.21.15.55:45804) 2023-07-06T22:18:24.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.505+0000 7fab72ffd640 1 -- 172.21.15.55:0/3431140329 learned_addr learned my addr 172.21.15.55:0/3431140329 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:24.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.505+0000 7fab6bfff640 1 --2- 172.21.15.55:0/3431140329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab7415d390 0x7fab7415d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.505+0000 7fab72ffd640 1 -- 172.21.15.55:0/3431140329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab7415d390 msgr2=0x7fab7415d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:24.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.505+0000 7fab72ffd640 1 --2- 172.21.15.55:0/3431140329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab7415d390 0x7fab7415d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.505+0000 7fab72ffd640 1 -- 172.21.15.55:0/3431140329 >> v1:172.21.15.55:6789/0 conn(0x7fab7406adc0 legacy=0x7fab7406b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.505+0000 7fab72ffd640 1 -- 172.21.15.55:0/3431140329 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7406d930 con 0x7fab74159980 2023-07-06T22:18:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.505+0000 7fab727fc640 1 -- 172.21.15.55:0/3431140329 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28914308 0 0) 0x7fab6c0014a0 con 0x7fab7406adc0 2023-07-06T22:18:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.505+0000 7fab6bfff640 1 --2- 172.21.15.55:0/3431140329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab7415d390 0x7fab7415d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:24.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.505+0000 7fab72ffd640 1 --2- 172.21.15.55:0/3431140329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab74159980 0x7fab7406e760 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fab64009870 tx=0x7fab6401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c5e13f4376f1d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:24.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.505+0000 7fab727fc640 1 -- 172.21.15.55:0/3431140329 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640a8a30 con 0x7fab74159980 2023-07-06T22:18:24.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.505+0000 7fab727fc640 1 -- 172.21.15.55:0/3431140329 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab640a8b90 con 0x7fab74159980 2023-07-06T22:18:24.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.505+0000 7fab727fc640 1 -- 172.21.15.55:0/3431140329 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640b0440 con 0x7fab74159980 2023-07-06T22:18:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 -- 172.21.15.55:0/3431140329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab74159980 msgr2=0x7fab7406e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 --2- 172.21.15.55:0/3431140329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab74159980 0x7fab7406e760 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fab64009870 tx=0x7fab6401ed30 comp rx=0 tx=0).stop 2023-07-06T22:18:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 -- 172.21.15.55:0/3431140329 shutdown_connections 2023-07-06T22:18:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 --2- 172.21.15.55:0/3431140329 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab7415d390 0x7fab7415d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 --2- 172.21.15.55:0/3431140329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab74159980 0x7fab7406e760 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 -- 172.21.15.55:0/3431140329 >> 172.21.15.55:0/3431140329 conn(0x7fab740b1730 msgr2=0x7fab740cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 -- 172.21.15.55:0/3431140329 shutdown_connections 2023-07-06T22:18:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 -- 172.21.15.55:0/3431140329 wait complete. 2023-07-06T22:18:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 Processor -- start 2023-07-06T22:18:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 -- start start 2023-07-06T22:18:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab7406adc0 0x7fab740acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab74159980 0x7fab741550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab7415d390 0x7fab74155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7415cdb0 con 0x7fab7406adc0 2023-07-06T22:18:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7415c510 con 0x7fab7415d390 2023-07-06T22:18:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab79303640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7415c7f0 con 0x7fab74159980 2023-07-06T22:18:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab72ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab7406adc0 0x7fab740acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab72ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab7406adc0 0x7fab740acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45814/0 (socket says 172.21.15.55:45814) 2023-07-06T22:18:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab72ffd640 1 -- 172.21.15.55:0/125000703 learned_addr learned my addr 172.21.15.55:0/125000703 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab72ffd640 1 -- 172.21.15.55:0/125000703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab74159980 msgr2=0x7fab741550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab72ffd640 1 --2- 172.21.15.55:0/125000703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab74159980 0x7fab741550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab72ffd640 1 -- 172.21.15.55:0/125000703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab7415d390 msgr2=0x7fab74155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab72ffd640 1 --2- 172.21.15.55:0/125000703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab7415d390 0x7fab74155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab72ffd640 1 -- 172.21.15.55:0/125000703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab640094d0 con 0x7fab7406adc0 2023-07-06T22:18:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.509+0000 7fab72ffd640 1 --2- 172.21.15.55:0/125000703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab7406adc0 0x7fab740acb20 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fab640b3040 tx=0x7fab6401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.513+0000 7fab6b7fe640 1 -- 172.21.15.55:0/125000703 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640be070 con 0x7fab7406adc0 2023-07-06T22:18:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.513+0000 7fab6b7fe640 1 -- 172.21.15.55:0/125000703 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab640ba400 con 0x7fab7406adc0 2023-07-06T22:18:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.513+0000 7fab6b7fe640 1 -- 172.21.15.55:0/125000703 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640ba7d0 con 0x7fab7406adc0 2023-07-06T22:18:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.513+0000 7fab79303640 1 -- 172.21.15.55:0/125000703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7415cad0 con 0x7fab7406adc0 2023-07-06T22:18:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.513+0000 7fab79303640 1 -- 172.21.15.55:0/125000703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab740ad060 con 0x7fab7406adc0 2023-07-06T22:18:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.513+0000 7fab79303640 1 -- 172.21.15.55:0/125000703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab740ad250 con 0x7fab7406adc0 2023-07-06T22:18:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.513+0000 7fab6b7fe640 1 -- 172.21.15.55:0/125000703 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 93) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fab640c3410 con 0x7fab7406adc0 2023-07-06T22:18:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.513+0000 7fab6b7fe640 1 -- 172.21.15.55:0/125000703 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 7499+0+0 (secure 0 0 0) 0x7fab64121a50 con 0x7fab7406adc0 2023-07-06T22:18:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.517+0000 7fab6b7fe640 1 -- 172.21.15.55:0/125000703 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab740ad250 con 0x7fab7406adc0 2023-07-06T22:18:24.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.561+0000 7fab6b7fe640 1 -- 172.21.15.55:0/125000703 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 94) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fab640ee740 con 0x7fab7406adc0 2023-07-06T22:18:24.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.561+0000 7fab6b7fe640 1 --2- 172.21.15.55:0/125000703 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fab5406c9b0 0x7fab5406ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.561+0000 7fab6bfff640 1 --2- 172.21.15.55:0/125000703 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fab5406c9b0 0x7fab5406ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.565+0000 7fab6bfff640 1 --2- 172.21.15.55:0/125000703 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fab5406c9b0 0x7fab5406ed90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fab5c006e90 tx=0x7fab5c008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:24.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.713+0000 7fab79303640 1 -- 172.21.15.55:0/125000703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab740c6040 con 0x7fab7406adc0 2023-07-06T22:18:24.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.713+0000 7fab6b7fe640 1 -- 172.21.15.55:0/125000703 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fab740c6040 con 0x7fab7406adc0 2023-07-06T22:18:24.718 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:24.719 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7958,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2209436909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2209436909},{"type":"v1","addr":"172.21.15.55:6837","nonce":2209436909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1799743845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":1799743845},{"type":"v1","addr":"172.21.15.138:6835","nonce":1799743845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8992,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3922834764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3922834764},{"type":"v1","addr":"172.21.15.138:6834","nonce":3922834764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:02:11.754063+0000","modified":"2023-07-06T22:02:14.781049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9759":{"gid":9759,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/4021237791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4021237791},{"type":"v1","addr":"172.21.15.55:6836","nonce":4021237791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-06T22:18:24.719 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 71 2023-07-06T22:18:24.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.713+0000 7fab79303640 1 -- 172.21.15.55:0/125000703 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fab5406c9b0 msgr2=0x7fab5406ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.713+0000 7fab79303640 1 --2- 172.21.15.55:0/125000703 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fab5406c9b0 0x7fab5406ed90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fab5c006e90 tx=0x7fab5c008040 comp rx=0 tx=0).stop 2023-07-06T22:18:24.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.713+0000 7fab79303640 1 -- 172.21.15.55:0/125000703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab7406adc0 msgr2=0x7fab740acb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.713+0000 7fab79303640 1 --2- 172.21.15.55:0/125000703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab7406adc0 0x7fab740acb20 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fab640b3040 tx=0x7fab6401bad0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.713+0000 7fab79303640 1 -- 172.21.15.55:0/125000703 shutdown_connections 2023-07-06T22:18:24.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.713+0000 7fab79303640 1 --2- 172.21.15.55:0/125000703 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fab5406c9b0 0x7fab5406ed90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.713+0000 7fab79303640 1 --2- 172.21.15.55:0/125000703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fab7415d390 0x7fab74155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.713+0000 7fab79303640 1 --2- 172.21.15.55:0/125000703 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fab74159980 0x7fab741550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.713+0000 7fab79303640 1 --2- 172.21.15.55:0/125000703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab7406adc0 0x7fab740acb20 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.713+0000 7fab79303640 1 -- 172.21.15.55:0/125000703 >> 172.21.15.55:0/125000703 conn(0x7fab740b1730 msgr2=0x7fab740adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:24.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.713+0000 7fab79303640 1 -- 172.21.15.55:0/125000703 shutdown_connections 2023-07-06T22:18:24.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.717+0000 7fab79303640 1 -- 172.21.15.55:0/125000703 wait complete. 2023-07-06T22:18:24.739 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:18:24.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.877+0000 7f282472c640 1 Processor -- start 2023-07-06T22:18:24.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.877+0000 7f282472c640 1 -- start start 2023-07-06T22:18:24.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f282472c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f281c1587d0 0x7f281c070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f282472c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f281c0710c0 0x7f281c0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f282472c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281c06fae0 con 0x7f281c158400 2023-07-06T22:18:24.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f282472c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281c06fdc0 con 0x7f281c1587d0 2023-07-06T22:18:24.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f282472c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c0700a0 con 0x7f281c0710c0 2023-07-06T22:18:24.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f2822cc9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f281c0710c0 0x7f281c0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f2821cc7640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f281c1587d0 0x7f281c070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f2821cc7640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f281c1587d0 0x7f281c070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:52074/0 (socket says 172.21.15.55:52074) 2023-07-06T22:18:24.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f2821cc7640 1 -- 172.21.15.55:0/3886985906 learned_addr learned my addr 172.21.15.55:0/3886985906 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:24.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f28224c8640 1 --1- 172.21.15.55:0/3886985906 >> v1:172.21.15.138:6789/0 conn(0x7f281c158400 0x7f281c0c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:51544/0 (socket says 172.21.15.55:51544) 2023-07-06T22:18:24.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f2822cc9640 1 -- 172.21.15.55:0/3886985906 >> v2:172.21.15.138:3300/0 conn(0x7f281c1587d0 msgr2=0x7f281c070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:24.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f2822cc9640 1 --2- 172.21.15.55:0/3886985906 >> v2:172.21.15.138:3300/0 conn(0x7f281c1587d0 0x7f281c070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f2822cc9640 1 -- 172.21.15.55:0/3886985906 >> v1:172.21.15.138:6789/0 conn(0x7f281c158400 legacy=0x7f281c0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f2822cc9640 1 -- 172.21.15.55:0/3886985906 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c070380 con 0x7f281c0710c0 2023-07-06T22:18:24.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f28214c6640 1 -- 172.21.15.55:0/3886985906 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926344343 0 0) 0x7f281c06fae0 con 0x7f281c158400 2023-07-06T22:18:24.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.881+0000 7f2821cc7640 1 --2- 172.21.15.55:0/3886985906 >> v2:172.21.15.138:3300/0 conn(0x7f281c1587d0 0x7f281c070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.885+0000 7f2822cc9640 1 --2- 172.21.15.55:0/3886985906 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f281c0710c0 0x7f281c0cbaa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2814009d90 tx=0x7f281401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5341256067215eb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:24.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.885+0000 7f28214c6640 1 -- 172.21.15.55:0/3886985906 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28140a58f0 con 0x7f281c0710c0 2023-07-06T22:18:24.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.885+0000 7f28214c6640 1 -- 172.21.15.55:0/3886985906 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28140a5a50 con 0x7f281c0710c0 2023-07-06T22:18:24.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.885+0000 7f28214c6640 1 -- 172.21.15.55:0/3886985906 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28140a5de0 con 0x7f281c0710c0 2023-07-06T22:18:24.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.885+0000 7f282472c640 1 -- 172.21.15.55:0/3886985906 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f281c0710c0 msgr2=0x7f281c0cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.885+0000 7f282472c640 1 --2- 172.21.15.55:0/3886985906 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f281c0710c0 0x7f281c0cbaa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2814009d90 tx=0x7f281401c920 comp rx=0 tx=0).stop 2023-07-06T22:18:24.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.885+0000 7f282472c640 1 -- 172.21.15.55:0/3886985906 shutdown_connections 2023-07-06T22:18:24.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.885+0000 7f282472c640 1 --2- 172.21.15.55:0/3886985906 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f281c0710c0 0x7f281c0cbaa0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.885+0000 7f282472c640 1 --2- 172.21.15.55:0/3886985906 >> v2:172.21.15.138:3300/0 conn(0x7f281c1587d0 0x7f281c070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.885+0000 7f282472c640 1 -- 172.21.15.55:0/3886985906 >> 172.21.15.55:0/3886985906 conn(0x7f281c0cded0 msgr2=0x7f281c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:24.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.885+0000 7f282472c640 1 -- 172.21.15.55:0/3886985906 shutdown_connections 2023-07-06T22:18:24.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.885+0000 7f282472c640 1 -- 172.21.15.55:0/3886985906 wait complete. 2023-07-06T22:18:24.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.885+0000 7f282472c640 1 Processor -- start 2023-07-06T22:18:24.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.885+0000 7f282472c640 1 -- start start 2023-07-06T22:18:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f282472c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f281c0710c0 0x7f281c0b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f282472c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c158400 0x7f281c0c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f282472c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f281c1587d0 0x7f281c1f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f282472c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c0c43b0 con 0x7f281c1587d0 2023-07-06T22:18:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f282472c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c1f8780 con 0x7f281c158400 2023-07-06T22:18:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f282472c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c1f8a60 con 0x7f281c0710c0 2023-07-06T22:18:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2822cc9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f281c1587d0 0x7f281c1f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2822cc9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f281c1587d0 0x7f281c1f7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45826/0 (socket says 172.21.15.55:45826) 2023-07-06T22:18:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2821cc7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c158400 0x7f281c0c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2822cc9640 1 -- 172.21.15.55:0/3396129181 learned_addr learned my addr 172.21.15.55:0/3396129181 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:24.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f28224c8640 1 --2- 172.21.15.55:0/3396129181 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f281c0710c0 0x7f281c0b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2821cc7640 1 -- 172.21.15.55:0/3396129181 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f281c0710c0 msgr2=0x7f281c0b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2821cc7640 1 --2- 172.21.15.55:0/3396129181 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f281c0710c0 0x7f281c0b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2821cc7640 1 -- 172.21.15.55:0/3396129181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f281c1587d0 msgr2=0x7f281c1f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2821cc7640 1 --2- 172.21.15.55:0/3396129181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f281c1587d0 0x7f281c1f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2821cc7640 1 -- 172.21.15.55:0/3396129181 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c0094d0 con 0x7f281c158400 2023-07-06T22:18:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2822cc9640 1 --2- 172.21.15.55:0/3396129181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f281c1587d0 0x7f281c1f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2821cc7640 1 --2- 172.21.15.55:0/3396129181 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c158400 0x7f281c0c3e70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f280c00e8b0 tx=0x7f280c00ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2812ffd640 1 -- 172.21.15.55:0/3396129181 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c004030 con 0x7f281c158400 2023-07-06T22:18:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2812ffd640 1 -- 172.21.15.55:0/3396129181 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c004190 con 0x7f281c158400 2023-07-06T22:18:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f282472c640 1 -- 172.21.15.55:0/3396129181 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2814009a70 con 0x7f281c158400 2023-07-06T22:18:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2812ffd640 1 -- 172.21.15.55:0/3396129181 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c004520 con 0x7f281c158400 2023-07-06T22:18:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f282472c640 1 -- 172.21.15.55:0/3396129181 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c0c71b0 con 0x7f281c158400 2023-07-06T22:18:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f282472c640 1 -- 172.21.15.55:0/3396129181 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c06c580 con 0x7f281c158400 2023-07-06T22:18:24.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.889+0000 7f2812ffd640 1 -- 172.21.15.55:0/3396129181 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 94) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f280c00c940 con 0x7f281c158400 2023-07-06T22:18:24.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.893+0000 7f2812ffd640 1 --2- 172.21.15.55:0/3396129181 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f2800066100 0x7f28000685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:24.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.893+0000 7f2812ffd640 1 -- 172.21.15.55:0/3396129181 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 7499+0+0 (secure 0 0 0) 0x7f280c083e40 con 0x7f281c158400 2023-07-06T22:18:24.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.893+0000 7f28224c8640 1 --2- 172.21.15.55:0/3396129181 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f2800066100 0x7f28000685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:24.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.893+0000 7f28224c8640 1 --2- 172.21.15.55:0/3396129181 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f2800066100 0x7f28000685b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2818007fd0 tx=0x7f2818007d60 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:24.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:24.897+0000 7f2812ffd640 1 -- 172.21.15.55:0/3396129181 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f280c051040 con 0x7f281c158400 2023-07-06T22:18:25.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.049+0000 7f282472c640 1 -- 172.21.15.55:0/3396129181 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f281c0c73d0 con 0x7f281c158400 2023-07-06T22:18:25.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.053+0000 7f2812ffd640 1 -- 172.21.15.55:0/3396129181 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f280c054660 con 0x7f281c158400 2023-07-06T22:18:25.058 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:25.058 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":167,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:18:23.550799+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:02:09.638482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-07-06T22:02:10.753761+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":166,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/2497446583":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/3547286691":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/2254289784":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/132885301":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/3064152807":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/3882494277":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/653926838":"2023-07-07T22:13:20.216819+0000","172.21.15.55:6833/3834478672":"2023-07-07T22:13:20.216819+0000","172.21.15.55:6832/3834478672":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/562346394":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/1671051159":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/959368203":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/1415051792":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/323970277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6833/433956277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6832/433956277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6833/2366924175":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/2414406270":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/3587598195":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6832/2366924175":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/2664561010":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/1917520432":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/279151651":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/1806662178":"2023-07-07T22:02:28.914064+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:18:25.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.053+0000 7f282472c640 1 -- 172.21.15.55:0/3396129181 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f2800066100 msgr2=0x7f28000685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.053+0000 7f282472c640 1 --2- 172.21.15.55:0/3396129181 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f2800066100 0x7f28000685b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2818007fd0 tx=0x7f2818007d60 comp rx=0 tx=0).stop 2023-07-06T22:18:25.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.053+0000 7f282472c640 1 -- 172.21.15.55:0/3396129181 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c158400 msgr2=0x7f281c0c3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.053+0000 7f282472c640 1 --2- 172.21.15.55:0/3396129181 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c158400 0x7f281c0c3e70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f280c00e8b0 tx=0x7f280c00ed70 comp rx=0 tx=0).stop 2023-07-06T22:18:25.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.053+0000 7f282472c640 1 -- 172.21.15.55:0/3396129181 shutdown_connections 2023-07-06T22:18:25.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.053+0000 7f282472c640 1 --2- 172.21.15.55:0/3396129181 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f2800066100 0x7f28000685b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.053+0000 7f282472c640 1 --2- 172.21.15.55:0/3396129181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f281c1587d0 0x7f281c1f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.053+0000 7f282472c640 1 --2- 172.21.15.55:0/3396129181 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c158400 0x7f281c0c3e70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.053+0000 7f282472c640 1 --2- 172.21.15.55:0/3396129181 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f281c0710c0 0x7f281c0b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.053+0000 7f282472c640 1 -- 172.21.15.55:0/3396129181 >> 172.21.15.55:0/3396129181 conn(0x7f281c0cded0 msgr2=0x7f281c0693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:25.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.053+0000 7f282472c640 1 -- 172.21.15.55:0/3396129181 shutdown_connections 2023-07-06T22:18:25.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.053+0000 7f282472c640 1 -- 172.21.15.55:0/3396129181 wait complete. 2023-07-06T22:18:25.079 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T22:18:25.079 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:18:25.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.217+0000 7fa3af740640 1 Processor -- start 2023-07-06T22:18:25.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.217+0000 7fa3af740640 1 -- start start 2023-07-06T22:18:25.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.217+0000 7fa3af740640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3a80712f0 0x7fa3a806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.217+0000 7fa3af740640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a8159cd0 con 0x7fa3a80b3730 2023-07-06T22:18:25.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.217+0000 7fa3af740640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a80693f0 con 0x7fa3a80ca450 2023-07-06T22:18:25.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.217+0000 7fa3af740640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a806aca0 con 0x7fa3a80712f0 2023-07-06T22:18:25.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.217+0000 7fa3ad4dc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3a80712f0 0x7fa3a806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.217+0000 7fa3ad4dc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3a80712f0 0x7fa3a806a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45828/0 (socket says 172.21.15.55:45828) 2023-07-06T22:18:25.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.217+0000 7fa3ad4dc640 1 -- 172.21.15.55:0/2347342779 learned_addr learned my addr 172.21.15.55:0/2347342779 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:25.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.221+0000 7fa3ad4dc640 1 -- 172.21.15.55:0/2347342779 >> v1:172.21.15.138:6789/0 conn(0x7fa3a80ca450 legacy=0x7fa3a815d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:25.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.221+0000 7fa3ad4dc640 1 -- 172.21.15.55:0/2347342779 >> v1:172.21.15.55:6789/0 conn(0x7fa3a80b3730 legacy=0x7fa3a80c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.221+0000 7fa3ad4dc640 1 -- 172.21.15.55:0/2347342779 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a80696b0 con 0x7fa3a80712f0 2023-07-06T22:18:25.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.221+0000 7fa3ad4dc640 1 --2- 172.21.15.55:0/2347342779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80712f0 0x7fa3a806a610 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009870 tx=0x7fa3a401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1d6aeb6437c80a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:25.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.221+0000 7fa39ffff640 1 -- 172.21.15.55:0/2347342779 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40ac640 con 0x7fa3a80712f0 2023-07-06T22:18:25.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.221+0000 7fa39ffff640 1 -- 172.21.15.55:0/2347342779 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a40ac7a0 con 0x7fa3a80712f0 2023-07-06T22:18:25.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.221+0000 7fa39ffff640 1 -- 172.21.15.55:0/2347342779 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40acb30 con 0x7fa3a80712f0 2023-07-06T22:18:25.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.221+0000 7fa3af740640 1 -- 172.21.15.55:0/2347342779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80712f0 msgr2=0x7fa3a806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.221+0000 7fa3af740640 1 --2- 172.21.15.55:0/2347342779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80712f0 0x7fa3a806a610 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009870 tx=0x7fa3a401c4d0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.221+0000 7fa3af740640 1 -- 172.21.15.55:0/2347342779 shutdown_connections 2023-07-06T22:18:25.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.221+0000 7fa3af740640 1 --2- 172.21.15.55:0/2347342779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80712f0 0x7fa3a806a610 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.221+0000 7fa3af740640 1 -- 172.21.15.55:0/2347342779 >> 172.21.15.55:0/2347342779 conn(0x7fa3a80cded0 msgr2=0x7fa3a80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:25.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3af740640 1 -- 172.21.15.55:0/2347342779 shutdown_connections 2023-07-06T22:18:25.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3af740640 1 -- 172.21.15.55:0/2347342779 wait complete. 2023-07-06T22:18:25.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3af740640 1 Processor -- start 2023-07-06T22:18:25.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3af740640 1 -- start start 2023-07-06T22:18:25.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3af740640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3a80712f0 0x7fa3a81560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3af740640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3a80b3730 0x7fa3a81515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3af740640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80ca450 0x7fa3a8156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3af740640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80c25e0 con 0x7fa3a80ca450 2023-07-06T22:18:25.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3af740640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a8156620 con 0x7fa3a80712f0 2023-07-06T22:18:25.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3af740640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80c19d0 con 0x7fa3a80b3730 2023-07-06T22:18:25.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3adcdd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80ca450 0x7fa3a8156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3adcdd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80ca450 0x7fa3a8156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45844/0 (socket says 172.21.15.55:45844) 2023-07-06T22:18:25.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3adcdd640 1 -- 172.21.15.55:0/2732515012 learned_addr learned my addr 172.21.15.55:0/2732515012 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:25.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3accdb640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3a80b3730 0x7fa3a81515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3ad4dc640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3a80712f0 0x7fa3a81560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3adcdd640 1 -- 172.21.15.55:0/2732515012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3a80b3730 msgr2=0x7fa3a81515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3adcdd640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3a80b3730 0x7fa3a81515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3adcdd640 1 -- 172.21.15.55:0/2732515012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3a80712f0 msgr2=0x7fa3a81560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3adcdd640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3a80712f0 0x7fa3a81560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3adcdd640 1 -- 172.21.15.55:0/2732515012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a40094d0 con 0x7fa3a80ca450 2023-07-06T22:18:25.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3accdb640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3a80b3730 0x7fa3a81515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:25.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa3adcdd640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80ca450 0x7fa3a8156960 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000c7b0 tx=0x7fa3a000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:25.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.225+0000 7fa39dffb640 1 -- 172.21.15.55:0/2732515012 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0004b70 con 0x7fa3a80ca450 2023-07-06T22:18:25.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.229+0000 7fa39dffb640 1 -- 172.21.15.55:0/2732515012 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a0004cd0 con 0x7fa3a80ca450 2023-07-06T22:18:25.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.229+0000 7fa39dffb640 1 -- 172.21.15.55:0/2732515012 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a000aa90 con 0x7fa3a80ca450 2023-07-06T22:18:25.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.229+0000 7fa3af740640 1 -- 172.21.15.55:0/2732515012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a80c1cb0 con 0x7fa3a80ca450 2023-07-06T22:18:25.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.229+0000 7fa3af740640 1 -- 172.21.15.55:0/2732515012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a80c2270 con 0x7fa3a80ca450 2023-07-06T22:18:25.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.229+0000 7fa3af740640 1 -- 172.21.15.55:0/2732515012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a806fc70 con 0x7fa3a80ca450 2023-07-06T22:18:25.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.229+0000 7fa39dffb640 1 -- 172.21.15.55:0/2732515012 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 94) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fa3a000abf0 con 0x7fa3a80ca450 2023-07-06T22:18:25.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.229+0000 7fa39dffb640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa38c0660d0 0x7fa38c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.229+0000 7fa39dffb640 1 -- 172.21.15.55:0/2732515012 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 7499+0+0 (secure 0 0 0) 0x7fa3a0084100 con 0x7fa3a80ca450 2023-07-06T22:18:25.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.229+0000 7fa3ad4dc640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa38c0660d0 0x7fa38c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.233+0000 7fa3ad4dc640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa38c0660d0 0x7fa38c068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40ae000 tx=0x7fa3a40a7000 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:25.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.233+0000 7fa39dffb640 1 -- 172.21.15.55:0/2732515012 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3a0051250 con 0x7fa3a80ca450 2023-07-06T22:18:25.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.421+0000 7fa3af740640 1 -- 172.21.15.55:0/2732515012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3a8066d60 con 0x7fa3a80ca450 2023-07-06T22:18:25.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.421+0000 7fa39dffb640 1 -- 172.21.15.55:0/2732515012 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fa3a0054870 con 0x7fa3a80ca450 2023-07-06T22:18:25.427 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:25.427 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7958,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2209436909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2209436909},{"type":"v1","addr":"172.21.15.55:6837","nonce":2209436909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1799743845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":1799743845},{"type":"v1","addr":"172.21.15.138:6835","nonce":1799743845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8992,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3922834764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3922834764},{"type":"v1","addr":"172.21.15.138:6834","nonce":3922834764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:02:11.754063+0000","modified":"2023-07-06T22:02:14.781049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9759":{"gid":9759,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/4021237791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4021237791},{"type":"v1","addr":"172.21.15.55:6836","nonce":4021237791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-06T22:18:25.427 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 71 2023-07-06T22:18:25.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.425+0000 7fa3af740640 1 -- 172.21.15.55:0/2732515012 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa38c0660d0 msgr2=0x7fa38c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.425+0000 7fa3af740640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa38c0660d0 0x7fa38c068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40ae000 tx=0x7fa3a40a7000 comp rx=0 tx=0).stop 2023-07-06T22:18:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.425+0000 7fa3af740640 1 -- 172.21.15.55:0/2732515012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80ca450 msgr2=0x7fa3a8156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.425+0000 7fa3af740640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80ca450 0x7fa3a8156960 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000c7b0 tx=0x7fa3a000cc70 comp rx=0 tx=0).stop 2023-07-06T22:18:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.425+0000 7fa3af740640 1 -- 172.21.15.55:0/2732515012 shutdown_connections 2023-07-06T22:18:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.425+0000 7fa3af740640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa38c0660d0 0x7fa38c068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.425+0000 7fa3af740640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3a80ca450 0x7fa3a8156960 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.425+0000 7fa3af740640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3a80b3730 0x7fa3a81515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.425+0000 7fa3af740640 1 --2- 172.21.15.55:0/2732515012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3a80712f0 0x7fa3a81560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.425+0000 7fa3af740640 1 -- 172.21.15.55:0/2732515012 >> 172.21.15.55:0/2732515012 conn(0x7fa3a80cded0 msgr2=0x7fa3a80b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.425+0000 7fa3af740640 1 -- 172.21.15.55:0/2732515012 shutdown_connections 2023-07-06T22:18:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.425+0000 7fa3af740640 1 -- 172.21.15.55:0/2732515012 wait complete. 2023-07-06T22:18:25.448 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:18:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.585+0000 7fa0ab034640 1 Processor -- start 2023-07-06T22:18:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0ab034640 1 -- start start 2023-07-06T22:18:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0ab034640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa0a40b12e0 0x7fa0a40d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0ab034640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0a40d00f0 0x7fa0a40d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0ab034640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a40d0a80 con 0x7fa0a40b1a40 2023-07-06T22:18:25.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0ab034640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a40b3be0 con 0x7fa0a40b12e0 2023-07-06T22:18:25.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0ab034640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40b4590 con 0x7fa0a40d00f0 2023-07-06T22:18:25.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0aa833640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa0a40b1a40 0x7fa0a40b1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41688/0 (socket says 172.21.15.55:41688) 2023-07-06T22:18:25.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0aa833640 1 -- 172.21.15.55:0/3880808137 learned_addr learned my addr 172.21.15.55:0/3880808137 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:25.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0a9831640 1 --2- 172.21.15.55:0/3880808137 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0a40d00f0 0x7fa0a40d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0aa032640 1 --2- 172.21.15.55:0/3880808137 >> v2:172.21.15.138:3300/0 conn(0x7fa0a40b12e0 0x7fa0a40d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0a9030640 1 -- 172.21.15.55:0/3880808137 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772773513 0 0) 0x7fa09c0014a0 con 0x7fa0a40b1a40 2023-07-06T22:18:25.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0a9030640 1 -- 172.21.15.55:0/3880808137 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa090003530 con 0x7fa0a40b1a40 2023-07-06T22:18:25.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0a9831640 1 -- 172.21.15.55:0/3880808137 >> v2:172.21.15.138:3300/0 conn(0x7fa0a40b12e0 msgr2=0x7fa0a40d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:25.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0a9831640 1 --2- 172.21.15.55:0/3880808137 >> v2:172.21.15.138:3300/0 conn(0x7fa0a40b12e0 0x7fa0a40d1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0a9831640 1 -- 172.21.15.55:0/3880808137 >> v1:172.21.15.55:6789/0 conn(0x7fa0a40b1a40 legacy=0x7fa0a40b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0a9831640 1 -- 172.21.15.55:0/3880808137 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a40b16b0 con 0x7fa0a40d00f0 2023-07-06T22:18:25.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.589+0000 7fa0aa032640 1 --2- 172.21.15.55:0/3880808137 >> v2:172.21.15.138:3300/0 conn(0x7fa0a40b12e0 0x7fa0a40d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:25.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.593+0000 7fa0a9831640 1 --2- 172.21.15.55:0/3880808137 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0a40d00f0 0x7fa0a40d0540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa0940097c0 tx=0x7fa09401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bff835a981550be server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:25.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.593+0000 7fa0a9030640 1 -- 172.21.15.55:0/3880808137 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0940ab600 con 0x7fa0a40d00f0 2023-07-06T22:18:25.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.593+0000 7fa0a9030640 1 -- 172.21.15.55:0/3880808137 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0940a7050 con 0x7fa0a40d00f0 2023-07-06T22:18:25.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.593+0000 7fa0a9030640 1 -- 172.21.15.55:0/3880808137 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0940ab980 con 0x7fa0a40d00f0 2023-07-06T22:18:25.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.593+0000 7fa0ab034640 1 -- 172.21.15.55:0/3880808137 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0a40d00f0 msgr2=0x7fa0a40d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.593+0000 7fa0ab034640 1 --2- 172.21.15.55:0/3880808137 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0a40d00f0 0x7fa0a40d0540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa0940097c0 tx=0x7fa09401c480 comp rx=0 tx=0).stop 2023-07-06T22:18:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.593+0000 7fa0ab034640 1 -- 172.21.15.55:0/3880808137 shutdown_connections 2023-07-06T22:18:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.593+0000 7fa0ab034640 1 --2- 172.21.15.55:0/3880808137 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0a40d00f0 0x7fa0a40d0540 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.593+0000 7fa0ab034640 1 --2- 172.21.15.55:0/3880808137 >> v2:172.21.15.138:3300/0 conn(0x7fa0a40b12e0 0x7fa0a40d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.593+0000 7fa0ab034640 1 -- 172.21.15.55:0/3880808137 >> 172.21.15.55:0/3880808137 conn(0x7fa0a40d20e0 msgr2=0x7fa0a40d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.593+0000 7fa0ab034640 1 -- 172.21.15.55:0/3880808137 shutdown_connections 2023-07-06T22:18:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.593+0000 7fa0ab034640 1 -- 172.21.15.55:0/3880808137 wait complete. 2023-07-06T22:18:25.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0ab034640 1 Processor -- start 2023-07-06T22:18:25.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0ab034640 1 -- start start 2023-07-06T22:18:25.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0ab034640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0a40b12e0 0x7fa0a4153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0ab034640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0a40b1a40 0x7fa0a415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0ab034640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0a40d00f0 0x7fa0a4149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0ab034640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4156920 con 0x7fa0a40b1a40 2023-07-06T22:18:25.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0ab034640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4155ca0 con 0x7fa0a40b12e0 2023-07-06T22:18:25.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0ab034640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4155f80 con 0x7fa0a40d00f0 2023-07-06T22:18:25.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0a9831640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0a40b1a40 0x7fa0a415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0a9831640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0a40b1a40 0x7fa0a415b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45848/0 (socket says 172.21.15.55:45848) 2023-07-06T22:18:25.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0a9831640 1 -- 172.21.15.55:0/4177045072 learned_addr learned my addr 172.21.15.55:0/4177045072 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:25.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0aa032640 1 --2- 172.21.15.55:0/4177045072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0a40b12e0 0x7fa0a4153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0aa833640 1 --2- 172.21.15.55:0/4177045072 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0a40d00f0 0x7fa0a4149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0a9831640 1 -- 172.21.15.55:0/4177045072 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0a40d00f0 msgr2=0x7fa0a4149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0a9831640 1 --2- 172.21.15.55:0/4177045072 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0a40d00f0 0x7fa0a4149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0a9831640 1 -- 172.21.15.55:0/4177045072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0a40b12e0 msgr2=0x7fa0a4153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0a9831640 1 --2- 172.21.15.55:0/4177045072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0a40b12e0 0x7fa0a4153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0a9831640 1 -- 172.21.15.55:0/4177045072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a0009420 con 0x7fa0a40b1a40 2023-07-06T22:18:25.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0a9831640 1 --2- 172.21.15.55:0/4177045072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0a40b1a40 0x7fa0a415b210 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fa094019090 tx=0x7fa094019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:25.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa09affd640 1 -- 172.21.15.55:0/4177045072 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0940b48d0 con 0x7fa0a40b1a40 2023-07-06T22:18:25.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa09affd640 1 -- 172.21.15.55:0/4177045072 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0940b4a30 con 0x7fa0a40b1a40 2023-07-06T22:18:25.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa09affd640 1 -- 172.21.15.55:0/4177045072 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0940b4de0 con 0x7fa0a40b1a40 2023-07-06T22:18:25.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0ab034640 1 -- 172.21.15.55:0/4177045072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa094009420 con 0x7fa0a40b1a40 2023-07-06T22:18:25.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0ab034640 1 -- 172.21.15.55:0/4177045072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a4156540 con 0x7fa0a40b1a40 2023-07-06T22:18:25.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.597+0000 7fa0ab034640 1 -- 172.21.15.55:0/4177045072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a41566d0 con 0x7fa0a40b1a40 2023-07-06T22:18:25.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.601+0000 7fa09affd640 1 -- 172.21.15.55:0/4177045072 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 94) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fa0940b2040 con 0x7fa0a40b1a40 2023-07-06T22:18:25.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.601+0000 7fa09affd640 1 --2- 172.21.15.55:0/4177045072 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa0880660d0 0x7fa088068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.601+0000 7fa09affd640 1 -- 172.21.15.55:0/4177045072 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 7499+0+0 (secure 0 0 0) 0x7fa09411e480 con 0x7fa0a40b1a40 2023-07-06T22:18:25.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.601+0000 7fa0aa032640 1 --2- 172.21.15.55:0/4177045072 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa0880660d0 0x7fa088068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.601+0000 7fa0aa032640 1 --2- 172.21.15.55:0/4177045072 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa0880660d0 0x7fa088068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009cf0 tx=0x7fa0a0009190 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:25.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.605+0000 7fa09affd640 1 -- 172.21.15.55:0/4177045072 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0940eb680 con 0x7fa0a40b1a40 2023-07-06T22:18:25.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.793+0000 7fa0ab034640 1 -- 172.21.15.55:0/4177045072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0a404d790 con 0x7fa0a40b1a40 2023-07-06T22:18:25.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.793+0000 7fa09affd640 1 -- 172.21.15.55:0/4177045072 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fa0940eeca0 con 0x7fa0a40b1a40 2023-07-06T22:18:25.798 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:25.798 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7958,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2209436909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2209436909},{"type":"v1","addr":"172.21.15.55:6837","nonce":2209436909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1799743845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":1799743845},{"type":"v1","addr":"172.21.15.138:6835","nonce":1799743845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8992,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3922834764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3922834764},{"type":"v1","addr":"172.21.15.138:6834","nonce":3922834764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:02:11.754063+0000","modified":"2023-07-06T22:02:14.781049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9759":{"gid":9759,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/4021237791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4021237791},{"type":"v1","addr":"172.21.15.55:6836","nonce":4021237791}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-06T22:18:25.799 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 71 2023-07-06T22:18:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.793+0000 7fa0ab034640 1 -- 172.21.15.55:0/4177045072 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa0880660d0 msgr2=0x7fa088068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.793+0000 7fa0ab034640 1 --2- 172.21.15.55:0/4177045072 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa0880660d0 0x7fa088068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009cf0 tx=0x7fa0a0009190 comp rx=0 tx=0).stop 2023-07-06T22:18:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.793+0000 7fa0ab034640 1 -- 172.21.15.55:0/4177045072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0a40b1a40 msgr2=0x7fa0a415b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.793+0000 7fa0ab034640 1 --2- 172.21.15.55:0/4177045072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0a40b1a40 0x7fa0a415b210 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fa094019090 tx=0x7fa094019220 comp rx=0 tx=0).stop 2023-07-06T22:18:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.793+0000 7fa0ab034640 1 -- 172.21.15.55:0/4177045072 shutdown_connections 2023-07-06T22:18:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.793+0000 7fa0ab034640 1 --2- 172.21.15.55:0/4177045072 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa0880660d0 0x7fa088068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.793+0000 7fa0ab034640 1 --2- 172.21.15.55:0/4177045072 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa0a40d00f0 0x7fa0a4149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.793+0000 7fa0ab034640 1 --2- 172.21.15.55:0/4177045072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0a40b1a40 0x7fa0a415b210 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.793+0000 7fa0ab034640 1 --2- 172.21.15.55:0/4177045072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0a40b12e0 0x7fa0a4153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.793+0000 7fa0ab034640 1 -- 172.21.15.55:0/4177045072 >> 172.21.15.55:0/4177045072 conn(0x7fa0a40d20e0 msgr2=0x7fa0a40b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.797+0000 7fa0ab034640 1 -- 172.21.15.55:0/4177045072 shutdown_connections 2023-07-06T22:18:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.797+0000 7fa0ab034640 1 -- 172.21.15.55:0/4177045072 wait complete. 2023-07-06T22:18:25.819 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:18:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.957+0000 7f6362ad8640 1 Processor -- start 2023-07-06T22:18:25.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.957+0000 7f6362ad8640 1 -- start start 2023-07-06T22:18:25.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.957+0000 7f6362ad8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f635c06f520 0x7f635c0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.957+0000 7f6362ad8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f635c06fae0 con 0x7f635c158400 2023-07-06T22:18:25.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.957+0000 7f6362ad8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f635c06fdc0 con 0x7f635c1587d0 2023-07-06T22:18:25.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.957+0000 7f6362ad8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f635c0700a0 con 0x7f635c06f520 2023-07-06T22:18:25.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.961+0000 7f6360874640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f635c158400 0x7f635c0c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41700/0 (socket says 172.21.15.55:41700) 2023-07-06T22:18:25.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.961+0000 7f6360874640 1 -- 172.21.15.55:0/1019841004 learned_addr learned my addr 172.21.15.55:0/1019841004 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:25.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.961+0000 7f6361075640 1 --2- 172.21.15.55:0/1019841004 >> v2:172.21.15.138:3300/0 conn(0x7f635c06f520 0x7f635c0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.961+0000 7f635b7fe640 1 -- 172.21.15.55:0/1019841004 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626782607 0 0) 0x7f635c06fae0 con 0x7f635c158400 2023-07-06T22:18:25.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.961+0000 7f635b7fe640 1 -- 172.21.15.55:0/1019841004 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f634c003530 con 0x7f635c158400 2023-07-06T22:18:25.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.961+0000 7f635b7fe640 1 -- 172.21.15.55:0/1019841004 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157112020 0 0) 0x7f635c06fdc0 con 0x7f635c1587d0 2023-07-06T22:18:25.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.961+0000 7f635b7fe640 1 -- 172.21.15.55:0/1019841004 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f635c06fae0 con 0x7f635c1587d0 2023-07-06T22:18:25.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.961+0000 7f6361075640 1 -- 172.21.15.55:0/1019841004 >> v1:172.21.15.138:6789/0 conn(0x7f635c1587d0 legacy=0x7f635c070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.961+0000 7f6361075640 1 -- 172.21.15.55:0/1019841004 >> v1:172.21.15.55:6789/0 conn(0x7f635c158400 legacy=0x7f635c0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.961+0000 7f6361075640 1 -- 172.21.15.55:0/1019841004 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c070380 con 0x7f635c06f520 2023-07-06T22:18:25.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.961+0000 7f6361075640 1 --2- 172.21.15.55:0/1019841004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f635c06f520 0x7f635c0cbaa0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6354009d90 tx=0x7f635401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d000b6547faa62 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:25.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.961+0000 7f635b7fe640 1 -- 172.21.15.55:0/1019841004 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63540a58f0 con 0x7f635c06f520 2023-07-06T22:18:25.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.961+0000 7f635b7fe640 1 -- 172.21.15.55:0/1019841004 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63540a5a50 con 0x7f635c06f520 2023-07-06T22:18:25.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.961+0000 7f635b7fe640 1 -- 172.21.15.55:0/1019841004 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63540a5de0 con 0x7f635c06f520 2023-07-06T22:18:25.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 -- 172.21.15.55:0/1019841004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f635c06f520 msgr2=0x7f635c0cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 --2- 172.21.15.55:0/1019841004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f635c06f520 0x7f635c0cbaa0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6354009d90 tx=0x7f635401c920 comp rx=0 tx=0).stop 2023-07-06T22:18:25.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 -- 172.21.15.55:0/1019841004 shutdown_connections 2023-07-06T22:18:25.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 --2- 172.21.15.55:0/1019841004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f635c06f520 0x7f635c0cbaa0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 -- 172.21.15.55:0/1019841004 >> 172.21.15.55:0/1019841004 conn(0x7f635c0cded0 msgr2=0x7f635c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:25.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 -- 172.21.15.55:0/1019841004 shutdown_connections 2023-07-06T22:18:25.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 -- 172.21.15.55:0/1019841004 wait complete. 2023-07-06T22:18:25.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 Processor -- start 2023-07-06T22:18:25.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 -- start start 2023-07-06T22:18:25.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f635c06f520 0x7f635c1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f635c158400 0x7f635c15a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f635c1587d0 0x7f635c15b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c1f4950 con 0x7f635c1587d0 2023-07-06T22:18:25.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c0c4fa0 con 0x7f635c158400 2023-07-06T22:18:25.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6362ad8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635c15aed0 con 0x7f635c06f520 2023-07-06T22:18:25.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6361075640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f635c1587d0 0x7f635c15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6361075640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f635c1587d0 0x7f635c15b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45860/0 (socket says 172.21.15.55:45860) 2023-07-06T22:18:25.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6361075640 1 -- 172.21.15.55:0/1941143813 learned_addr learned my addr 172.21.15.55:0/1941143813 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:25.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f635bfff640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f635c158400 0x7f635c15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.965+0000 7f6360874640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f635c06f520 0x7f635c1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f6361075640 1 -- 172.21.15.55:0/1941143813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f635c06f520 msgr2=0x7f635c1562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f6361075640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f635c06f520 0x7f635c1562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f6361075640 1 -- 172.21.15.55:0/1941143813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f635c158400 msgr2=0x7f635c15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:25.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f6361075640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f635c158400 0x7f635c15a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:25.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f6361075640 1 -- 172.21.15.55:0/1941143813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6354009a70 con 0x7f635c1587d0 2023-07-06T22:18:25.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f635bfff640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f635c158400 0x7f635c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:25.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f6361075640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f635c1587d0 0x7f635c15b290 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f635401a550 tx=0x7f63540196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:25.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f63597fa640 1 -- 172.21.15.55:0/1941143813 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63540b9650 con 0x7f635c1587d0 2023-07-06T22:18:25.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f63597fa640 1 -- 172.21.15.55:0/1941143813 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63540b97b0 con 0x7f635c1587d0 2023-07-06T22:18:25.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f6362ad8640 1 -- 172.21.15.55:0/1941143813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635c0c5240 con 0x7f635c1587d0 2023-07-06T22:18:25.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f63597fa640 1 -- 172.21.15.55:0/1941143813 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63540b9b20 con 0x7f635c1587d0 2023-07-06T22:18:25.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f6362ad8640 1 -- 172.21.15.55:0/1941143813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635c159970 con 0x7f635c1587d0 2023-07-06T22:18:25.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f6362ad8640 1 -- 172.21.15.55:0/1941143813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f635c06c580 con 0x7f635c1587d0 2023-07-06T22:18:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f63597fa640 1 -- 172.21.15.55:0/1941143813 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 94) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f63540b9c80 con 0x7f635c1587d0 2023-07-06T22:18:25.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f63597fa640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f63400660d0 0x7f6340068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:25.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f63597fa640 1 -- 172.21.15.55:0/1941143813 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 7499+0+0 (secure 0 0 0) 0x7f635411f190 con 0x7f635c1587d0 2023-07-06T22:18:25.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.969+0000 7f6360874640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f63400660d0 0x7f6340068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:25.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.973+0000 7f6360874640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f63400660d0 0x7f6340068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6350007fd0 tx=0x7f6350007d60 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:25.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:25.973+0000 7f63597fa640 1 -- 172.21.15.55:0/1941143813 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f63540ec390 con 0x7f635c1587d0 2023-07-06T22:18:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.097+0000 7f63597fa640 1 -- 172.21.15.55:0/1941143813 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f63540ec760 con 0x7f635c1587d0 2023-07-06T22:18:26.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.133+0000 7f6362ad8640 1 -- 172.21.15.55:0/1941143813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f635c0c53d0 con 0x7f635c1587d0 2023-07-06T22:18:26.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.133+0000 7f63597fa640 1 -- 172.21.15.55:0/1941143813 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f63540c4a60 con 0x7f635c1587d0 2023-07-06T22:18:26.138 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:26.138 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":167,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:18:23.550799+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:02:09.638482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-07-06T22:02:10.753761+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":166,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/2497446583":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/3547286691":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/2254289784":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/132885301":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/3064152807":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/3882494277":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/653926838":"2023-07-07T22:13:20.216819+0000","172.21.15.55:6833/3834478672":"2023-07-07T22:13:20.216819+0000","172.21.15.55:6832/3834478672":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/562346394":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/1671051159":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/959368203":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/1415051792":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/323970277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6833/433956277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6832/433956277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6833/2366924175":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/2414406270":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/3587598195":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6832/2366924175":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/2664561010":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/1917520432":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/279151651":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/1806662178":"2023-07-07T22:02:28.914064+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:18:26.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.133+0000 7f6362ad8640 1 -- 172.21.15.55:0/1941143813 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f63400660d0 msgr2=0x7f6340068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:26.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.133+0000 7f6362ad8640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f63400660d0 0x7f6340068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6350007fd0 tx=0x7f6350007d60 comp rx=0 tx=0).stop 2023-07-06T22:18:26.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.133+0000 7f6362ad8640 1 -- 172.21.15.55:0/1941143813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f635c1587d0 msgr2=0x7f635c15b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:26.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.133+0000 7f6362ad8640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f635c1587d0 0x7f635c15b290 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f635401a550 tx=0x7f63540196c0 comp rx=0 tx=0).stop 2023-07-06T22:18:26.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.137+0000 7f6362ad8640 1 -- 172.21.15.55:0/1941143813 shutdown_connections 2023-07-06T22:18:26.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.137+0000 7f6362ad8640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f63400660d0 0x7f6340068580 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:26.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.137+0000 7f6362ad8640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f635c1587d0 0x7f635c15b290 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:26.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.137+0000 7f6362ad8640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f635c158400 0x7f635c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:26.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.137+0000 7f6362ad8640 1 --2- 172.21.15.55:0/1941143813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f635c06f520 0x7f635c1562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:26.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.137+0000 7f6362ad8640 1 -- 172.21.15.55:0/1941143813 >> 172.21.15.55:0/1941143813 conn(0x7f635c0cded0 msgr2=0x7f635c0ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:26.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.137+0000 7f6362ad8640 1 -- 172.21.15.55:0/1941143813 shutdown_connections 2023-07-06T22:18:26.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.137+0000 7f6362ad8640 1 -- 172.21.15.55:0/1941143813 wait complete. 2023-07-06T22:18:26.159 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T22:18:26.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.297+0000 7fbf8086d640 1 Processor -- start 2023-07-06T22:18:26.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.301+0000 7fbf8086d640 1 -- start start 2023-07-06T22:18:26.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.301+0000 7fbf8086d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf7c0709a0 0x7fbf7c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:26.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.301+0000 7fbf8086d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c0cc300 con 0x7fbf7c0cbe60 2023-07-06T22:18:26.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.301+0000 7fbf8086d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c0cc5e0 con 0x7fbf7c0b1340 2023-07-06T22:18:26.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.301+0000 7fbf8086d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7c0cc8c0 con 0x7fbf7c0709a0 2023-07-06T22:18:26.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.301+0000 7fbf7a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf7c0709a0 0x7fbf7c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:26.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.301+0000 7fbf7a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf7c0709a0 0x7fbf7c0cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45876/0 (socket says 172.21.15.55:45876) 2023-07-06T22:18:26.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.301+0000 7fbf7a59c640 1 -- 172.21.15.55:0/234712735 learned_addr learned my addr 172.21.15.55:0/234712735 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:26.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.301+0000 7fbf7a59c640 1 -- 172.21.15.55:0/234712735 >> v1:172.21.15.138:6789/0 conn(0x7fbf7c0b1340 legacy=0x7fbf7c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:26.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.301+0000 7fbf7a59c640 1 -- 172.21.15.55:0/234712735 >> v1:172.21.15.55:6789/0 conn(0x7fbf7c0cbe60 legacy=0x7fbf7c0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:26.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.301+0000 7fbf7a59c640 1 -- 172.21.15.55:0/234712735 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c0ccba0 con 0x7fbf7c0709a0 2023-07-06T22:18:26.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.305+0000 7fbf7a59c640 1 --2- 172.21.15.55:0/234712735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf7c0709a0 0x7fbf7c0cb920 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c009870 tx=0x7fbf6c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7452001015bdf42f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:26.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.305+0000 7fbf79d9b640 1 -- 172.21.15.55:0/234712735 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c0ab650 con 0x7fbf7c0709a0 2023-07-06T22:18:26.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.305+0000 7fbf79d9b640 1 -- 172.21.15.55:0/234712735 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6c0ab7b0 con 0x7fbf7c0709a0 2023-07-06T22:18:26.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.305+0000 7fbf79d9b640 1 -- 172.21.15.55:0/234712735 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c0abb40 con 0x7fbf7c0709a0 2023-07-06T22:18:26.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.305+0000 7fbf8086d640 1 -- 172.21.15.55:0/234712735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf7c0709a0 msgr2=0x7fbf7c0cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:26.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.305+0000 7fbf8086d640 1 --2- 172.21.15.55:0/234712735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf7c0709a0 0x7fbf7c0cb920 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c009870 tx=0x7fbf6c01c540 comp rx=0 tx=0).stop 2023-07-06T22:18:26.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.305+0000 7fbf8086d640 1 -- 172.21.15.55:0/234712735 shutdown_connections 2023-07-06T22:18:26.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.305+0000 7fbf8086d640 1 --2- 172.21.15.55:0/234712735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf7c0709a0 0x7fbf7c0cb920 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:26.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.305+0000 7fbf8086d640 1 -- 172.21.15.55:0/234712735 >> 172.21.15.55:0/234712735 conn(0x7fbf7c0cea70 msgr2=0x7fbf7c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:26.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.305+0000 7fbf8086d640 1 -- 172.21.15.55:0/234712735 shutdown_connections 2023-07-06T22:18:26.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.305+0000 7fbf8086d640 1 -- 172.21.15.55:0/234712735 wait complete. 2023-07-06T22:18:26.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.305+0000 7fbf8086d640 1 Processor -- start 2023-07-06T22:18:26.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.305+0000 7fbf8086d640 1 -- start start 2023-07-06T22:18:26.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf8086d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf7c0709a0 0x7fbf7c158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:26.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf8086d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf7c0b1340 0x7fbf7c1596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:26.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf8086d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf7c0cbe60 0x7fbf7c06b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:26.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf8086d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c158e80 con 0x7fbf7c0b1340 2023-07-06T22:18:26.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf8086d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c159370 con 0x7fbf7c0709a0 2023-07-06T22:18:26.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf8086d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c161bf0 con 0x7fbf7c0cbe60 2023-07-06T22:18:26.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf73fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf7c0b1340 0x7fbf7c1596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:26.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf73fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf7c0b1340 0x7fbf7c1596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45878/0 (socket says 172.21.15.55:45878) 2023-07-06T22:18:26.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf73fff640 1 -- 172.21.15.55:0/2570321530 learned_addr learned my addr 172.21.15.55:0/2570321530 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:26.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf7ad9d640 1 --2- 172.21.15.55:0/2570321530 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf7c0cbe60 0x7fbf7c06b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:26.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf7a59c640 1 --2- 172.21.15.55:0/2570321530 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf7c0709a0 0x7fbf7c158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:26.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf73fff640 1 -- 172.21.15.55:0/2570321530 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf7c0cbe60 msgr2=0x7fbf7c06b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:26.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf73fff640 1 --2- 172.21.15.55:0/2570321530 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf7c0cbe60 0x7fbf7c06b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:26.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf73fff640 1 -- 172.21.15.55:0/2570321530 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf7c0709a0 msgr2=0x7fbf7c158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:26.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf73fff640 1 --2- 172.21.15.55:0/2570321530 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf7c0709a0 0x7fbf7c158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:26.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf73fff640 1 -- 172.21.15.55:0/2570321530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c0094d0 con 0x7fbf7c0b1340 2023-07-06T22:18:26.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf73fff640 1 --2- 172.21.15.55:0/2570321530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf7c0b1340 0x7fbf7c1596f0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fbf6400c3c0 tx=0x7fbf6400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:26.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf72ffd640 1 -- 172.21.15.55:0/2570321530 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf640052d0 con 0x7fbf7c0b1340 2023-07-06T22:18:26.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf72ffd640 1 -- 172.21.15.55:0/2570321530 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf64005430 con 0x7fbf7c0b1340 2023-07-06T22:18:26.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf72ffd640 1 -- 172.21.15.55:0/2570321530 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf64003840 con 0x7fbf7c0b1340 2023-07-06T22:18:26.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf8086d640 1 -- 172.21.15.55:0/2570321530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf7c161ed0 con 0x7fbf7c0b1340 2023-07-06T22:18:26.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf8086d640 1 -- 172.21.15.55:0/2570321530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7c15d800 con 0x7fbf7c0b1340 2023-07-06T22:18:26.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf8086d640 1 -- 172.21.15.55:0/2570321530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7c1623f0 con 0x7fbf7c0b1340 2023-07-06T22:18:26.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.309+0000 7fbf72ffd640 1 -- 172.21.15.55:0/2570321530 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbf640039a0 con 0x7fbf7c0b1340 2023-07-06T22:18:26.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.313+0000 7fbf72ffd640 1 --2- 172.21.15.55:0/2570321530 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbf5c0663a0 0x7fbf5c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:26.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.313+0000 7fbf72ffd640 1 -- 172.21.15.55:0/2570321530 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 7499+0+0 (secure 0 0 0) 0x7fbf640838b0 con 0x7fbf7c0b1340 2023-07-06T22:18:26.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.313+0000 7fbf7a59c640 1 --2- 172.21.15.55:0/2570321530 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbf5c0663a0 0x7fbf5c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:26.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.313+0000 7fbf7a59c640 1 --2- 172.21.15.55:0/2570321530 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbf5c0663a0 0x7fbf5c068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0af000 tx=0x7fbf6c0b6040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:26.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.317+0000 7fbf72ffd640 1 -- 172.21.15.55:0/2570321530 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf64050730 con 0x7fbf7c0b1340 2023-07-06T22:18:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:26.505+0000 7fbf8086d640 1 -- 172.21.15.55:0/2570321530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbf7c0b0830 con 0x7fbf7c0b1340 2023-07-06T22:18:27.097 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-07-06T22:18:27.097+0000 7f5b6d80c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T22:18:27.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.101+0000 7fbf72ffd640 1 -- 172.21.15.55:0/2570321530 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v72) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbf64053d50 con 0x7fbf7c0b1340 2023-07-06T22:18:27.106 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T22:18:27.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.101+0000 7fbf8086d640 1 -- 172.21.15.55:0/2570321530 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbf5c0663a0 msgr2=0x7fbf5c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:27.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.105+0000 7fbf8086d640 1 --2- 172.21.15.55:0/2570321530 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbf5c0663a0 0x7fbf5c068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0af000 tx=0x7fbf6c0b6040 comp rx=0 tx=0).stop 2023-07-06T22:18:27.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.105+0000 7fbf8086d640 1 -- 172.21.15.55:0/2570321530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf7c0b1340 msgr2=0x7fbf7c1596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:27.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.105+0000 7fbf8086d640 1 --2- 172.21.15.55:0/2570321530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf7c0b1340 0x7fbf7c1596f0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fbf6400c3c0 tx=0x7fbf6400c880 comp rx=0 tx=0).stop 2023-07-06T22:18:27.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.105+0000 7fbf8086d640 1 -- 172.21.15.55:0/2570321530 shutdown_connections 2023-07-06T22:18:27.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.105+0000 7fbf8086d640 1 --2- 172.21.15.55:0/2570321530 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbf5c0663a0 0x7fbf5c068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:27.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.105+0000 7fbf8086d640 1 --2- 172.21.15.55:0/2570321530 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf7c0cbe60 0x7fbf7c06b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:27.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.105+0000 7fbf8086d640 1 --2- 172.21.15.55:0/2570321530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf7c0b1340 0x7fbf7c1596f0 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:27.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.105+0000 7fbf8086d640 1 --2- 172.21.15.55:0/2570321530 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf7c0709a0 0x7fbf7c158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:27.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.105+0000 7fbf8086d640 1 -- 172.21.15.55:0/2570321530 >> 172.21.15.55:0/2570321530 conn(0x7fbf7c0cea70 msgr2=0x7fbf7c162640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:27.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.105+0000 7fbf8086d640 1 -- 172.21.15.55:0/2570321530 shutdown_connections 2023-07-06T22:18:27.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.105+0000 7fbf8086d640 1 -- 172.21.15.55:0/2570321530 wait complete. 2023-07-06T22:18:27.131 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T22:18:27.172 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T22:18:27.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894fd59640 1 Processor -- start 2023-07-06T22:18:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894fd59640 1 -- start start 2023-07-06T22:18:27.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894fd59640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89480ca130 0x7f89480703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894fd59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89480cd140 0x7f8948070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894fd59640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8948158c20 con 0x7f8948158850 2023-07-06T22:18:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894fd59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89480b2aa0 con 0x7f89480cd140 2023-07-06T22:18:27.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894fd59640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89480c8db0 con 0x7f89480ca130 2023-07-06T22:18:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894daf5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8948158850 0x7f89480cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41724/0 (socket says 172.21.15.55:41724) 2023-07-06T22:18:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894daf5640 1 -- 172.21.15.55:0/2047155993 learned_addr learned my addr 172.21.15.55:0/2047155993 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894e2f6640 1 --2- 172.21.15.55:0/2047155993 >> v2:172.21.15.55:3300/0 conn(0x7f89480cd140 0x7f8948070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894d2f4640 1 --2- 172.21.15.55:0/2047155993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89480ca130 0x7f89480703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:27.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894e2f6640 1 -- 172.21.15.55:0/2047155993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89480ca130 msgr2=0x7f89480703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:27.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894e2f6640 1 --2- 172.21.15.55:0/2047155993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89480ca130 0x7f89480703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:27.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894e2f6640 1 -- 172.21.15.55:0/2047155993 >> v1:172.21.15.55:6789/0 conn(0x7f8948158850 legacy=0x7f89480cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:27.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894caf3640 1 -- 172.21.15.55:0/2047155993 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503078499 0 0) 0x7f8948158c20 con 0x7f8948158850 2023-07-06T22:18:27.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.277+0000 7f894e2f6640 1 -- 172.21.15.55:0/2047155993 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89480c9090 con 0x7f89480cd140 2023-07-06T22:18:27.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.281+0000 7f894e2f6640 1 --2- 172.21.15.55:0/2047155993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89480cd140 0x7f8948070920 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f8940009d90 tx=0x7f894001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d924653264518752 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:27.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.281+0000 7f894caf3640 1 -- 172.21.15.55:0/2047155993 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89400a6800 con 0x7f89480cd140 2023-07-06T22:18:27.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.281+0000 7f894caf3640 1 -- 172.21.15.55:0/2047155993 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89400a6960 con 0x7f89480cd140 2023-07-06T22:18:27.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.281+0000 7f894caf3640 1 -- 172.21.15.55:0/2047155993 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89400a6cf0 con 0x7f89480cd140 2023-07-06T22:18:27.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.281+0000 7f894fd59640 1 -- 172.21.15.55:0/2047155993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89480cd140 msgr2=0x7f8948070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.281+0000 7f894fd59640 1 --2- 172.21.15.55:0/2047155993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89480cd140 0x7f8948070920 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f8940009d90 tx=0x7f894001c9e0 comp rx=0 tx=0).stop 2023-07-06T22:18:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.281+0000 7f894fd59640 1 -- 172.21.15.55:0/2047155993 shutdown_connections 2023-07-06T22:18:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.281+0000 7f894fd59640 1 --2- 172.21.15.55:0/2047155993 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89480ca130 0x7f89480703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.281+0000 7f894fd59640 1 --2- 172.21.15.55:0/2047155993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89480cd140 0x7f8948070920 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.281+0000 7f894fd59640 1 -- 172.21.15.55:0/2047155993 >> 172.21.15.55:0/2047155993 conn(0x7f89480cea70 msgr2=0x7f89480ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.281+0000 7f894fd59640 1 -- 172.21.15.55:0/2047155993 shutdown_connections 2023-07-06T22:18:27.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.281+0000 7f894fd59640 1 -- 172.21.15.55:0/2047155993 wait complete. 2023-07-06T22:18:27.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894fd59640 1 Processor -- start 2023-07-06T22:18:27.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894fd59640 1 -- start start 2023-07-06T22:18:27.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894fd59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89480ca130 0x7f89480c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:27.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894fd59640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89480cd140 0x7f89480ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:27.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894fd59640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8948158850 0x7f89480caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:27.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894fd59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89480c5b50 con 0x7f89480ca130 2023-07-06T22:18:27.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894fd59640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89480ae2c0 con 0x7f8948158850 2023-07-06T22:18:27.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894fd59640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8948154890 con 0x7f89480cd140 2023-07-06T22:18:27.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894daf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89480ca130 0x7f89480c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:27.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894daf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89480ca130 0x7f89480c39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45908/0 (socket says 172.21.15.55:45908) 2023-07-06T22:18:27.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894daf5640 1 -- 172.21.15.55:0/2878011100 learned_addr learned my addr 172.21.15.55:0/2878011100 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:27.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894d2f4640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89480cd140 0x7f89480ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:27.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894e2f6640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8948158850 0x7f89480caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:27.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894daf5640 1 -- 172.21.15.55:0/2878011100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89480cd140 msgr2=0x7f89480ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:27.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894daf5640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89480cd140 0x7f89480ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:27.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894daf5640 1 -- 172.21.15.55:0/2878011100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8948158850 msgr2=0x7f89480caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:27.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894daf5640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8948158850 0x7f89480caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:27.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894daf5640 1 -- 172.21.15.55:0/2878011100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8940009a70 con 0x7f89480ca130 2023-07-06T22:18:27.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894e2f6640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8948158850 0x7f89480caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:27.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894daf5640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89480ca130 0x7f89480c39f0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f894400c480 tx=0x7f894400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:27.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f893e7fc640 1 -- 172.21.15.55:0/2878011100 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89440074e0 con 0x7f89480ca130 2023-07-06T22:18:27.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f893e7fc640 1 -- 172.21.15.55:0/2878011100 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8944007660 con 0x7f89480ca130 2023-07-06T22:18:27.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f893e7fc640 1 -- 172.21.15.55:0/2878011100 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944004a30 con 0x7f89480ca130 2023-07-06T22:18:27.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894fd59640 1 -- 172.21.15.55:0/2878011100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8948153d10 con 0x7f89480ca130 2023-07-06T22:18:27.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894fd59640 1 -- 172.21.15.55:0/2878011100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89481542d0 con 0x7f89480ca130 2023-07-06T22:18:27.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.285+0000 7f894fd59640 1 -- 172.21.15.55:0/2878011100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8948066d60 con 0x7f89480ca130 2023-07-06T22:18:27.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.289+0000 7f893e7fc640 1 -- 172.21.15.55:0/2878011100 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8944004b90 con 0x7f89480ca130 2023-07-06T22:18:27.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.289+0000 7f893e7fc640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f892c0663a0 0x7f892c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:27.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.289+0000 7f893e7fc640 1 -- 172.21.15.55:0/2878011100 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 7585+0+0 (secure 0 0 0) 0x7f8944083500 con 0x7f89480ca130 2023-07-06T22:18:27.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.289+0000 7f894d2f4640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f892c0663a0 0x7f892c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:27.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.289+0000 7f894d2f4640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f892c0663a0 0x7f892c068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f89480b0550 tx=0x7f8938008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:27.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.293+0000 7f893e7fc640 1 -- 172.21.15.55:0/2878011100 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8944053e40 con 0x7f89480ca130 2023-07-06T22:18:27.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:27.481+0000 7f894fd59640 1 -- 172.21.15.55:0/2878011100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f894806cd30 con 0x7f89480ca130 2023-07-06T22:18:28.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.113+0000 7f893e7fc640 1 -- 172.21.15.55:0/2878011100 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v73) v1 ==== 104+0+0 (secure 0 0 0) 0x7f89440539d0 con 0x7f89480ca130 2023-07-06T22:18:28.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.117+0000 7f894fd59640 1 -- 172.21.15.55:0/2878011100 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f892c0663a0 msgr2=0x7f892c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:28.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.117+0000 7f894fd59640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f892c0663a0 0x7f892c068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f89480b0550 tx=0x7f8938008040 comp rx=0 tx=0).stop 2023-07-06T22:18:28.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.117+0000 7f894fd59640 1 -- 172.21.15.55:0/2878011100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89480ca130 msgr2=0x7f89480c39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:28.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.117+0000 7f894fd59640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89480ca130 0x7f89480c39f0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f894400c480 tx=0x7f894400c940 comp rx=0 tx=0).stop 2023-07-06T22:18:28.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.117+0000 7f894fd59640 1 -- 172.21.15.55:0/2878011100 shutdown_connections 2023-07-06T22:18:28.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.117+0000 7f894fd59640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f892c0663a0 0x7f892c068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:28.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.117+0000 7f894fd59640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8948158850 0x7f89480caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:28.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.117+0000 7f894fd59640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89480cd140 0x7f89480ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:28.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.117+0000 7f894fd59640 1 --2- 172.21.15.55:0/2878011100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89480ca130 0x7f89480c39f0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:28.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.117+0000 7f894fd59640 1 -- 172.21.15.55:0/2878011100 >> 172.21.15.55:0/2878011100 conn(0x7f89480cea70 msgr2=0x7f894806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:28.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.117+0000 7f894fd59640 1 -- 172.21.15.55:0/2878011100 shutdown_connections 2023-07-06T22:18:28.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.117+0000 7f894fd59640 1 -- 172.21.15.55:0/2878011100 wait complete. 2023-07-06T22:18:28.143 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T22:18:28.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.329+0000 7fef5e0d8640 1 Processor -- start 2023-07-06T22:18:28.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.329+0000 7fef5e0d8640 1 -- start start 2023-07-06T22:18:28.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.329+0000 7fef5e0d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef580c9b90 0x7fef5815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:28.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.329+0000 7fef5e0d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef580b3e70 con 0x7fef580ccb70 2023-07-06T22:18:28.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.329+0000 7fef5e0d8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef58159c30 con 0x7fef580693f0 2023-07-06T22:18:28.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.329+0000 7fef5e0d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef580c9070 con 0x7fef580c9b90 2023-07-06T22:18:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef56ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fef580ccb70 0x7fef580c9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41732/0 (socket says 172.21.15.55:41732) 2023-07-06T22:18:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef56ffd640 1 -- 172.21.15.55:0/762342024 learned_addr learned my addr 172.21.15.55:0/762342024 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef577fe640 1 --2- 172.21.15.55:0/762342024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef580c9b90 0x7fef5815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254721653 0 0) 0x7fef4c001120 con 0x7fef580ccb70 2023-07-06T22:18:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef40003530 con 0x7fef580ccb70 2023-07-06T22:18:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394871443 0 0) 0x7fef58159c30 con 0x7fef580693f0 2023-07-06T22:18:28.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef4c001120 con 0x7fef580693f0 2023-07-06T22:18:28.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3839069985 0 0) 0x7fef40003530 con 0x7fef580ccb70 2023-07-06T22:18:28.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef580c9b90 msgr2=0x7fef5815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:28.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 --2- 172.21.15.55:0/762342024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef580c9b90 0x7fef5815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:28.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 >> v1:172.21.15.138:6789/0 conn(0x7fef580693f0 legacy=0x7fef58069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:28.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580c8480 con 0x7fef580ccb70 2023-07-06T22:18:28.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fef4c001810 con 0x7fef580ccb70 2023-07-06T22:18:28.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 >> v1:172.21.15.55:6789/0 conn(0x7fef580ccb70 legacy=0x7fef580c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:28.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 --2- 172.21.15.55:0/762342024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef40003b40 0x7fef40003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:28.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 --2- 172.21.15.55:0/762342024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef400047d0 0x7fef40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:28.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 --2- 172.21.15.55:0/762342024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef40005180 0x7fef4000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:28.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580c9070 con 0x7fef40003b40 2023-07-06T22:18:28.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4000bfb0 con 0x7fef40005180 2023-07-06T22:18:28.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4000c170 con 0x7fef400047d0 2023-07-06T22:18:28.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef577fe640 1 --2- 172.21.15.55:0/762342024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef580c9b90 0x7fef5815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef56ffd640 1 --2- 172.21.15.55:0/762342024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef400047d0 0x7fef40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef57fff640 1 --2- 172.21.15.55:0/762342024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef40005180 0x7fef4000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef577fe640 1 --2- 172.21.15.55:0/762342024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef40003b40 0x7fef40003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef577fe640 1 -- 172.21.15.55:0/762342024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef400047d0 msgr2=0x7fef40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef577fe640 1 --2- 172.21.15.55:0/762342024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef400047d0 0x7fef40004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef577fe640 1 -- 172.21.15.55:0/762342024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef40005180 msgr2=0x7fef4000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef577fe640 1 --2- 172.21.15.55:0/762342024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef40005180 0x7fef4000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:28.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.333+0000 7fef577fe640 1 -- 172.21.15.55:0/762342024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef40003530 con 0x7fef40003b40 2023-07-06T22:18:28.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.337+0000 7fef577fe640 1 --2- 172.21.15.55:0/762342024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef40003b40 0x7fef40003f30 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fef5806ee10 tx=0x7fef4801ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07994f9fa646499 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.337+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48004030 con 0x7fef40003b40 2023-07-06T22:18:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.337+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef48004190 con 0x7fef40003b40 2023-07-06T22:18:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.337+0000 7fef567fc640 1 -- 172.21.15.55:0/762342024 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48004520 con 0x7fef40003b40 2023-07-06T22:18:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.337+0000 7fef5e0d8640 1 -- 172.21.15.55:0/762342024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef40003b40 msgr2=0x7fef40003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.337+0000 7fef5e0d8640 1 --2- 172.21.15.55:0/762342024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef40003b40 0x7fef40003f30 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fef5806ee10 tx=0x7fef4801ca60 comp rx=0 tx=0).stop 2023-07-06T22:18:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.337+0000 7fef57fff640 1 -- 172.21.15.55:0/762342024 reap_dead start 2023-07-06T22:18:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.337+0000 7fef5e0d8640 1 -- 172.21.15.55:0/762342024 shutdown_connections 2023-07-06T22:18:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.337+0000 7fef5e0d8640 1 -- 172.21.15.55:0/762342024 >> 172.21.15.55:0/762342024 conn(0x7fef580cde30 msgr2=0x7fef580ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.337+0000 7fef5e0d8640 1 -- 172.21.15.55:0/762342024 shutdown_connections 2023-07-06T22:18:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.337+0000 7fef5e0d8640 1 -- 172.21.15.55:0/762342024 wait complete. 2023-07-06T22:18:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.337+0000 7fef5e0d8640 1 Processor -- start 2023-07-06T22:18:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef5e0d8640 1 -- start start 2023-07-06T22:18:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef5e0d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef40003b40 0x7fef58150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef5e0d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef58151520 0x7fef581505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef5e0d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef580c79e0 0x7fef58151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef5e0d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580c4350 con 0x7fef40003b40 2023-07-06T22:18:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef5e0d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580c4630 con 0x7fef580c79e0 2023-07-06T22:18:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef5e0d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef580c6160 con 0x7fef58151520 2023-07-06T22:18:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef577fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef40003b40 0x7fef58150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef577fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef40003b40 0x7fef58150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45920/0 (socket says 172.21.15.55:45920) 2023-07-06T22:18:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef577fe640 1 -- 172.21.15.55:0/2386456783 learned_addr learned my addr 172.21.15.55:0/2386456783 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef57fff640 1 --2- 172.21.15.55:0/2386456783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef580c79e0 0x7fef58151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef56ffd640 1 --2- 172.21.15.55:0/2386456783 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef58151520 0x7fef581505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef577fe640 1 -- 172.21.15.55:0/2386456783 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef58151520 msgr2=0x7fef581505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef577fe640 1 --2- 172.21.15.55:0/2386456783 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef58151520 0x7fef581505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef577fe640 1 -- 172.21.15.55:0/2386456783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef580c79e0 msgr2=0x7fef58151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef577fe640 1 --2- 172.21.15.55:0/2386456783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef580c79e0 0x7fef58151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef577fe640 1 -- 172.21.15.55:0/2386456783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580c3f70 con 0x7fef40003b40 2023-07-06T22:18:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef577fe640 1 --2- 172.21.15.55:0/2386456783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef40003b40 0x7fef58150eb0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fef480ae040 tx=0x7fef40005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef3ffff640 1 -- 172.21.15.55:0/2386456783 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48004300 con 0x7fef40003b40 2023-07-06T22:18:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef3ffff640 1 -- 172.21.15.55:0/2386456783 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef48004460 con 0x7fef40003b40 2023-07-06T22:18:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef3ffff640 1 -- 172.21.15.55:0/2386456783 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48003840 con 0x7fef40003b40 2023-07-06T22:18:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef5e0d8640 1 -- 172.21.15.55:0/2386456783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef58150b20 con 0x7fef40003b40 2023-07-06T22:18:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef5e0d8640 1 -- 172.21.15.55:0/2386456783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef581f2c40 con 0x7fef40003b40 2023-07-06T22:18:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.341+0000 7fef5e0d8640 1 -- 172.21.15.55:0/2386456783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef580c6320 con 0x7fef40003b40 2023-07-06T22:18:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.345+0000 7fef3ffff640 1 -- 172.21.15.55:0/2386456783 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fef480aa070 con 0x7fef40003b40 2023-07-06T22:18:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.345+0000 7fef3ffff640 1 --2- 172.21.15.55:0/2386456783 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fef440663d0 0x7fef44068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.345+0000 7fef3ffff640 1 -- 172.21.15.55:0/2386456783 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 7585+0+0 (secure 0 0 0) 0x7fef4811e8a0 con 0x7fef40003b40 2023-07-06T22:18:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.345+0000 7fef56ffd640 1 --2- 172.21.15.55:0/2386456783 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fef440663d0 0x7fef44068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.345+0000 7fef56ffd640 1 --2- 172.21.15.55:0/2386456783 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fef440663d0 0x7fef44068880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fef580ce830 tx=0x7fef4c009040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:28.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.349+0000 7fef3ffff640 1 -- 172.21.15.55:0/2386456783 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fef480eb580 con 0x7fef40003b40 2023-07-06T22:18:28.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:28.505+0000 7fef5e0d8640 1 -- 172.21.15.55:0/2386456783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef580c6320 con 0x7fef40003b40 2023-07-06T22:18:29.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.121+0000 7fef3ffff640 1 -- 172.21.15.55:0/2386456783 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v169) v1 ==== 181+0+0 (secure 0 0 0) 0x7fef480eeba0 con 0x7fef40003b40 2023-07-06T22:18:29.126 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-07-06T22:18:29.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.125+0000 7fef5e0d8640 1 -- 172.21.15.55:0/2386456783 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fef440663d0 msgr2=0x7fef44068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:29.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.125+0000 7fef5e0d8640 1 --2- 172.21.15.55:0/2386456783 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fef440663d0 0x7fef44068880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fef580ce830 tx=0x7fef4c009040 comp rx=0 tx=0).stop 2023-07-06T22:18:29.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.125+0000 7fef5e0d8640 1 -- 172.21.15.55:0/2386456783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef40003b40 msgr2=0x7fef58150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.125+0000 7fef5e0d8640 1 --2- 172.21.15.55:0/2386456783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef40003b40 0x7fef58150eb0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fef480ae040 tx=0x7fef40005800 comp rx=0 tx=0).stop 2023-07-06T22:18:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.125+0000 7fef5e0d8640 1 -- 172.21.15.55:0/2386456783 shutdown_connections 2023-07-06T22:18:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.125+0000 7fef5e0d8640 1 --2- 172.21.15.55:0/2386456783 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fef440663d0 0x7fef44068880 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.125+0000 7fef5e0d8640 1 --2- 172.21.15.55:0/2386456783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef580c79e0 0x7fef58151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.125+0000 7fef5e0d8640 1 --2- 172.21.15.55:0/2386456783 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fef58151520 0x7fef581505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.125+0000 7fef5e0d8640 1 --2- 172.21.15.55:0/2386456783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef40003b40 0x7fef58150eb0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.125+0000 7fef5e0d8640 1 -- 172.21.15.55:0/2386456783 >> 172.21.15.55:0/2386456783 conn(0x7fef580cde30 msgr2=0x7fef5806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:29.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.125+0000 7fef5e0d8640 1 -- 172.21.15.55:0/2386456783 shutdown_connections 2023-07-06T22:18:29.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.125+0000 7fef5e0d8640 1 -- 172.21.15.55:0/2386456783 wait complete. 2023-07-06T22:18:29.154 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T22:18:29.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.301+0000 7f358bfd2640 1 Processor -- start 2023-07-06T22:18:29.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.301+0000 7f358bfd2640 1 -- start start 2023-07-06T22:18:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.305+0000 7f358bfd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35840c89b0 0x7f35840c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:29.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.305+0000 7f358bfd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3584158b50 con 0x7f35840cbfa0 2023-07-06T22:18:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.305+0000 7f358bfd2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358406fb00 con 0x7f3584158780 2023-07-06T22:18:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.305+0000 7f358bfd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35840c9370 con 0x7f35840c89b0 2023-07-06T22:18:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.305+0000 7f358956d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f35840cbfa0 0x7f358406f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41734/0 (socket says 172.21.15.55:41734) 2023-07-06T22:18:29.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.305+0000 7f358956d640 1 -- 172.21.15.55:0/3837581339 learned_addr learned my addr 172.21.15.55:0/3837581339 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:29.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.305+0000 7f358a56f640 1 --2- 172.21.15.55:0/3837581339 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35840c89b0 0x7f35840c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:29.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.305+0000 7f3588d6c640 1 -- 172.21.15.55:0/3837581339 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058218863 0 0) 0x7f3584158b50 con 0x7f35840cbfa0 2023-07-06T22:18:29.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.305+0000 7f3588d6c640 1 -- 172.21.15.55:0/3837581339 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3570003530 con 0x7f35840cbfa0 2023-07-06T22:18:29.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.305+0000 7f3588d6c640 1 -- 172.21.15.55:0/3837581339 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830876973 0 0) 0x7f3580001120 con 0x7f3584158780 2023-07-06T22:18:29.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.305+0000 7f3588d6c640 1 -- 172.21.15.55:0/3837581339 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3584158b50 con 0x7f3584158780 2023-07-06T22:18:29.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.305+0000 7f358a56f640 1 -- 172.21.15.55:0/3837581339 >> v1:172.21.15.138:6789/0 conn(0x7f3584158780 legacy=0x7f35840cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:29.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.305+0000 7f358a56f640 1 -- 172.21.15.55:0/3837581339 >> v1:172.21.15.55:6789/0 conn(0x7f35840cbfa0 legacy=0x7f358406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:29.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.305+0000 7f358a56f640 1 -- 172.21.15.55:0/3837581339 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358406b390 con 0x7f35840c89b0 2023-07-06T22:18:29.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.309+0000 7f358a56f640 1 --2- 172.21.15.55:0/3837581339 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35840c89b0 0x7f35840c8e30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f357c009dc0 tx=0x7f357c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a661e0bc2e5e4bc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:29.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.309+0000 7f3588d6c640 1 -- 172.21.15.55:0/3837581339 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c0a5890 con 0x7f35840c89b0 2023-07-06T22:18:29.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.309+0000 7f3588d6c640 1 -- 172.21.15.55:0/3837581339 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c0a59f0 con 0x7f35840c89b0 2023-07-06T22:18:29.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.309+0000 7f3588d6c640 1 -- 172.21.15.55:0/3837581339 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c0a5d80 con 0x7f35840c89b0 2023-07-06T22:18:29.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.309+0000 7f358bfd2640 1 -- 172.21.15.55:0/3837581339 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35840c89b0 msgr2=0x7f35840c8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.309+0000 7f358bfd2640 1 --2- 172.21.15.55:0/3837581339 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35840c89b0 0x7f35840c8e30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f357c009dc0 tx=0x7f357c01c8e0 comp rx=0 tx=0).stop 2023-07-06T22:18:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.309+0000 7f358bfd2640 1 -- 172.21.15.55:0/3837581339 shutdown_connections 2023-07-06T22:18:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.309+0000 7f358bfd2640 1 --2- 172.21.15.55:0/3837581339 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35840c89b0 0x7f35840c8e30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.309+0000 7f358bfd2640 1 -- 172.21.15.55:0/3837581339 >> 172.21.15.55:0/3837581339 conn(0x7f35840cde30 msgr2=0x7f35840ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.309+0000 7f358bfd2640 1 -- 172.21.15.55:0/3837581339 shutdown_connections 2023-07-06T22:18:29.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.309+0000 7f358bfd2640 1 -- 172.21.15.55:0/3837581339 wait complete. 2023-07-06T22:18:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.309+0000 7f358bfd2640 1 Processor -- start 2023-07-06T22:18:29.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.309+0000 7f358bfd2640 1 -- start start 2023-07-06T22:18:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358bfd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35840c89b0 0x7f35840c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358bfd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35840cbfa0 0x7f35841482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358bfd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3584158780 0x7f3584148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:29.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358bfd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3584144b00 con 0x7f35840cbfa0 2023-07-06T22:18:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358bfd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3584144de0 con 0x7f35840c89b0 2023-07-06T22:18:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358bfd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35841493b0 con 0x7f3584158780 2023-07-06T22:18:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358956d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35840cbfa0 0x7f35841482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358956d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35840cbfa0 0x7f35841482e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45926/0 (socket says 172.21.15.55:45926) 2023-07-06T22:18:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358956d640 1 -- 172.21.15.55:0/712996122 learned_addr learned my addr 172.21.15.55:0/712996122 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f3589d6e640 1 --2- 172.21.15.55:0/712996122 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35840c89b0 0x7f35840c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:29.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358a56f640 1 --2- 172.21.15.55:0/712996122 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3584158780 0x7f3584148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:29.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358956d640 1 -- 172.21.15.55:0/712996122 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3584158780 msgr2=0x7f3584148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358956d640 1 --2- 172.21.15.55:0/712996122 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3584158780 0x7f3584148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358956d640 1 -- 172.21.15.55:0/712996122 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35840c89b0 msgr2=0x7f35840c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358956d640 1 --2- 172.21.15.55:0/712996122 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35840c89b0 0x7f35840c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358956d640 1 -- 172.21.15.55:0/712996122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c009a70 con 0x7f35840cbfa0 2023-07-06T22:18:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358956d640 1 --2- 172.21.15.55:0/712996122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35840cbfa0 0x7f35841482e0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f357400c4d0 tx=0x7f357400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f357a7fc640 1 -- 172.21.15.55:0/712996122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574005cf0 con 0x7f35840cbfa0 2023-07-06T22:18:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f357a7fc640 1 -- 172.21.15.55:0/712996122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3574005e50 con 0x7f35840cbfa0 2023-07-06T22:18:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f357a7fc640 1 -- 172.21.15.55:0/712996122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35740072b0 con 0x7f35840cbfa0 2023-07-06T22:18:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358bfd2640 1 -- 172.21.15.55:0/712996122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3584149690 con 0x7f35840cbfa0 2023-07-06T22:18:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358bfd2640 1 -- 172.21.15.55:0/712996122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3584070e70 con 0x7f35840cbfa0 2023-07-06T22:18:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f358bfd2640 1 -- 172.21.15.55:0/712996122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3584066d60 con 0x7f35840cbfa0 2023-07-06T22:18:29.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.313+0000 7f357a7fc640 1 -- 172.21.15.55:0/712996122 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3574007410 con 0x7f35840cbfa0 2023-07-06T22:18:29.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.317+0000 7f357a7fc640 1 --2- 172.21.15.55:0/712996122 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f35680663a0 0x7f3568068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:29.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.317+0000 7f357a7fc640 1 -- 172.21.15.55:0/712996122 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 7147+0+0 (secure 0 0 0) 0x7f35740838e0 con 0x7f35840cbfa0 2023-07-06T22:18:29.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.317+0000 7f3589d6e640 1 --2- 172.21.15.55:0/712996122 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f35680663a0 0x7f3568068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:29.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.317+0000 7f3589d6e640 1 --2- 172.21.15.55:0/712996122 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f35680663a0 0x7f3568068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3580001380 tx=0x7f3580009040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:29.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.321+0000 7f357a7fc640 1 -- 172.21.15.55:0/712996122 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3574050830 con 0x7f35840cbfa0 2023-07-06T22:18:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:29.473+0000 7f358bfd2640 1 -- 172.21.15.55:0/712996122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f35840cbd80 con 0x7f35840cbfa0 2023-07-06T22:18:30.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.089+0000 7f357a7fc640 1 -- 172.21.15.55:0/712996122 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v170) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3574053e50 con 0x7f35840cbfa0 2023-07-06T22:18:30.095 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-07-06T22:18:30.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.093+0000 7f358bfd2640 1 -- 172.21.15.55:0/712996122 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f35680663a0 msgr2=0x7f3568068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.093+0000 7f358bfd2640 1 --2- 172.21.15.55:0/712996122 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f35680663a0 0x7f3568068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3580001380 tx=0x7f3580009040 comp rx=0 tx=0).stop 2023-07-06T22:18:30.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.093+0000 7f358bfd2640 1 -- 172.21.15.55:0/712996122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35840cbfa0 msgr2=0x7f35841482e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.093+0000 7f358bfd2640 1 --2- 172.21.15.55:0/712996122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35840cbfa0 0x7f35841482e0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f357400c4d0 tx=0x7f357400c990 comp rx=0 tx=0).stop 2023-07-06T22:18:30.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.097+0000 7f358bfd2640 1 -- 172.21.15.55:0/712996122 shutdown_connections 2023-07-06T22:18:30.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.097+0000 7f358bfd2640 1 --2- 172.21.15.55:0/712996122 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f35680663a0 0x7f3568068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.097+0000 7f358bfd2640 1 --2- 172.21.15.55:0/712996122 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3584158780 0x7f3584148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.097+0000 7f358bfd2640 1 --2- 172.21.15.55:0/712996122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35840cbfa0 0x7f35841482e0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.097+0000 7f358bfd2640 1 --2- 172.21.15.55:0/712996122 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35840c89b0 0x7f35840c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.097+0000 7f358bfd2640 1 -- 172.21.15.55:0/712996122 >> 172.21.15.55:0/712996122 conn(0x7f35840cde30 msgr2=0x7f358414f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:30.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.097+0000 7f358bfd2640 1 -- 172.21.15.55:0/712996122 shutdown_connections 2023-07-06T22:18:30.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.097+0000 7f358bfd2640 1 -- 172.21.15.55:0/712996122 wait complete. 2023-07-06T22:18:30.125 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-06T22:18:30.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.269+0000 7f38fdc69640 1 Processor -- start 2023-07-06T22:18:30.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.269+0000 7f38fdc69640 1 -- start start 2023-07-06T22:18:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.269+0000 7f38fdc69640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38f80c9b70 0x7f38f806a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.269+0000 7f38fdc69640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f38f80693f0 0x7f38f806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.269+0000 7f38fdc69640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f80698d0 con 0x7f38f8159610 2023-07-06T22:18:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.269+0000 7f38fdc69640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f8069bb0 con 0x7f38f80c9b70 2023-07-06T22:18:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.269+0000 7f38fdc69640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f8069e90 con 0x7f38f80693f0 2023-07-06T22:18:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.269+0000 7f38f7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38f80c9b70 0x7f38f806a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.269+0000 7f38f7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38f80c9b70 0x7f38f806a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45936/0 (socket says 172.21.15.55:45936) 2023-07-06T22:18:30.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.269+0000 7f38f7fff640 1 -- 172.21.15.55:0/2888957685 learned_addr learned my addr 172.21.15.55:0/2888957685 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:30.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.269+0000 7f38fd468640 1 --2- 172.21.15.55:0/2888957685 >> v2:172.21.15.138:3300/0 conn(0x7f38f80693f0 0x7f38f806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.273+0000 7f38f7fff640 1 -- 172.21.15.55:0/2888957685 >> v2:172.21.15.138:3300/0 conn(0x7f38f80693f0 msgr2=0x7f38f806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:30.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.273+0000 7f38f7fff640 1 --2- 172.21.15.55:0/2888957685 >> v2:172.21.15.138:3300/0 conn(0x7f38f80693f0 0x7f38f806feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.273+0000 7f38f7fff640 1 -- 172.21.15.55:0/2888957685 >> v1:172.21.15.138:6789/0 conn(0x7f38f8159610 legacy=0x7f38f80c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.273+0000 7f38f7fff640 1 -- 172.21.15.55:0/2888957685 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f806a170 con 0x7f38f80c9b70 2023-07-06T22:18:30.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.273+0000 7f38f7fff640 1 --2- 172.21.15.55:0/2888957685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38f80c9b70 0x7f38f806a970 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f38f806c670 tx=0x7f38e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20e5fdf333a8d79 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:30.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.273+0000 7f38f77fe640 1 -- 172.21.15.55:0/2888957685 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e40aa5f0 con 0x7f38f80c9b70 2023-07-06T22:18:30.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.273+0000 7f38f77fe640 1 -- 172.21.15.55:0/2888957685 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e40aa750 con 0x7f38f80c9b70 2023-07-06T22:18:30.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.273+0000 7f38f77fe640 1 -- 172.21.15.55:0/2888957685 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e40aaae0 con 0x7f38f80c9b70 2023-07-06T22:18:30.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.277+0000 7f38fdc69640 1 -- 172.21.15.55:0/2888957685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38f80c9b70 msgr2=0x7f38f806a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.277+0000 7f38fdc69640 1 --2- 172.21.15.55:0/2888957685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38f80c9b70 0x7f38f806a970 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f38f806c670 tx=0x7f38e401c4d0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.277+0000 7f38fdc69640 1 -- 172.21.15.55:0/2888957685 shutdown_connections 2023-07-06T22:18:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.277+0000 7f38fdc69640 1 --2- 172.21.15.55:0/2888957685 >> v2:172.21.15.138:3300/0 conn(0x7f38f80693f0 0x7f38f806feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.277+0000 7f38fdc69640 1 --2- 172.21.15.55:0/2888957685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38f80c9b70 0x7f38f806a970 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.277+0000 7f38fdc69640 1 -- 172.21.15.55:0/2888957685 >> 172.21.15.55:0/2888957685 conn(0x7f38f80b0410 msgr2=0x7f38f80cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.277+0000 7f38fdc69640 1 -- 172.21.15.55:0/2888957685 shutdown_connections 2023-07-06T22:18:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.277+0000 7f38fdc69640 1 -- 172.21.15.55:0/2888957685 wait complete. 2023-07-06T22:18:30.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.277+0000 7f38fdc69640 1 Processor -- start 2023-07-06T22:18:30.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.277+0000 7f38fdc69640 1 -- start start 2023-07-06T22:18:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fdc69640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38f80693f0 0x7f38f80c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fdc69640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38f80c9b70 0x7f38f80cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fdc69640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38f8159610 0x7f38f80c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fdc69640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f80c2de0 con 0x7f38f8159610 2023-07-06T22:18:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fdc69640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f80c30c0 con 0x7f38f80c9b70 2023-07-06T22:18:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fdc69640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f80c33a0 con 0x7f38f80693f0 2023-07-06T22:18:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fd468640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38f8159610 0x7f38f80c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fd468640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38f8159610 0x7f38f80c3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45950/0 (socket says 172.21.15.55:45950) 2023-07-06T22:18:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fd468640 1 -- 172.21.15.55:0/1822376923 learned_addr learned my addr 172.21.15.55:0/1822376923 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fcc67640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38f80693f0 0x7f38f80c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38f7fff640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38f80c9b70 0x7f38f80cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fd468640 1 -- 172.21.15.55:0/1822376923 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38f80693f0 msgr2=0x7f38f80c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fd468640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38f80693f0 0x7f38f80c27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fd468640 1 -- 172.21.15.55:0/1822376923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38f80c9b70 msgr2=0x7f38f80cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fd468640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38f80c9b70 0x7f38f80cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fd468640 1 -- 172.21.15.55:0/1822376923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e40094d0 con 0x7f38f8159610 2023-07-06T22:18:30.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fcc67640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38f80693f0 0x7f38f80c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:30.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fd468640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38f8159610 0x7f38f80c3e80 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f38f000efc0 tx=0x7f38f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:30.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38f57fa640 1 -- 172.21.15.55:0/1822376923 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f0009ca0 con 0x7f38f8159610 2023-07-06T22:18:30.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38f57fa640 1 -- 172.21.15.55:0/1822376923 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f000f040 con 0x7f38f8159610 2023-07-06T22:18:30.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38f57fa640 1 -- 172.21.15.55:0/1822376923 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f00146c0 con 0x7f38f8159610 2023-07-06T22:18:30.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fdc69640 1 -- 172.21.15.55:0/1822376923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f80c3680 con 0x7f38f8159610 2023-07-06T22:18:30.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.281+0000 7f38fdc69640 1 -- 172.21.15.55:0/1822376923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f80cc710 con 0x7f38f8159610 2023-07-06T22:18:30.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.285+0000 7f38fdc69640 1 -- 172.21.15.55:0/1822376923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f804d790 con 0x7f38f8159610 2023-07-06T22:18:30.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.285+0000 7f38f57fa640 1 -- 172.21.15.55:0/1822376923 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f38f0014820 con 0x7f38f8159610 2023-07-06T22:18:30.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.285+0000 7f38f57fa640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f38dc0663a0 0x7f38dc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.285+0000 7f38f57fa640 1 -- 172.21.15.55:0/1822376923 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6704+0+0 (secure 0 0 0) 0x7f38f0084fe0 con 0x7f38f8159610 2023-07-06T22:18:30.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.285+0000 7f38fcc67640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f38dc0663a0 0x7f38dc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.289+0000 7f38fcc67640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f38dc0663a0 0x7f38dc068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f38ec007fd0 tx=0x7f38ec009040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:30.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.289+0000 7f38f57fa640 1 -- 172.21.15.55:0/1822376923 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38f00520a0 con 0x7f38f8159610 2023-07-06T22:18:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.445+0000 7f38fdc69640 1 -- 172.21.15.55:0/1822376923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f38f80c3b30 con 0x7f38f8159610 2023-07-06T22:18:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.449+0000 7f38f57fa640 1 -- 172.21.15.55:0/1822376923 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v55) v1 ==== 120+0+0 (secure 0 0 0) 0x7f38f00556c0 con 0x7f38f8159610 2023-07-06T22:18:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.453+0000 7f38fdc69640 1 -- 172.21.15.55:0/1822376923 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f38dc0663a0 msgr2=0x7f38dc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.453+0000 7f38fdc69640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f38dc0663a0 0x7f38dc068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f38ec007fd0 tx=0x7f38ec009040 comp rx=0 tx=0).stop 2023-07-06T22:18:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.453+0000 7f38fdc69640 1 -- 172.21.15.55:0/1822376923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38f8159610 msgr2=0x7f38f80c3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.453+0000 7f38fdc69640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38f8159610 0x7f38f80c3e80 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f38f000efc0 tx=0x7f38f000c490 comp rx=0 tx=0).stop 2023-07-06T22:18:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.453+0000 7f38fdc69640 1 -- 172.21.15.55:0/1822376923 shutdown_connections 2023-07-06T22:18:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.453+0000 7f38fdc69640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f38dc0663a0 0x7f38dc068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.453+0000 7f38fdc69640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38f8159610 0x7f38f80c3e80 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.453+0000 7f38fdc69640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38f80c9b70 0x7f38f80cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.453+0000 7f38fdc69640 1 --2- 172.21.15.55:0/1822376923 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38f80693f0 0x7f38f80c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.453+0000 7f38fdc69640 1 -- 172.21.15.55:0/1822376923 >> 172.21.15.55:0/1822376923 conn(0x7f38f80b0410 msgr2=0x7f38f80adfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.453+0000 7f38fdc69640 1 -- 172.21.15.55:0/1822376923 shutdown_connections 2023-07-06T22:18:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.453+0000 7f38fdc69640 1 -- 172.21.15.55:0/1822376923 wait complete. 2023-07-06T22:18:30.478 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-06T22:18:30.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.617+0000 7f34c960b640 1 Processor -- start 2023-07-06T22:18:30.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.617+0000 7f34c960b640 1 -- start start 2023-07-06T22:18:30.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.621+0000 7f34c960b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34c406fef0 0x7f34c4164820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.621+0000 7f34c960b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c40cc030 con 0x7f34c4070d70 2023-07-06T22:18:30.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.621+0000 7f34c960b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c40cc300 con 0x7f34c40709a0 2023-07-06T22:18:30.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.621+0000 7f34c960b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c40cc5e0 con 0x7f34c406fef0 2023-07-06T22:18:30.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.621+0000 7f34c37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34c406fef0 0x7f34c4164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.621+0000 7f34bbfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f34c4070d70 0x7f34c40b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41740/0 (socket says 172.21.15.55:41740) 2023-07-06T22:18:30.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.621+0000 7f34bbfff640 1 -- 172.21.15.55:0/683137597 learned_addr learned my addr 172.21.15.55:0/683137597 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:30.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.621+0000 7f34c37fe640 1 --2- 172.21.15.55:0/683137597 >> v2:172.21.15.55:3300/0 conn(0x7f34c406fef0 0x7f34c4164820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45964/0 (socket says 172.21.15.55:45964) 2023-07-06T22:18:30.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.621+0000 7f34c37fe640 1 -- 172.21.15.55:0/683137597 >> v1:172.21.15.138:6789/0 conn(0x7f34c40709a0 legacy=0x7f34c40cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:30.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.621+0000 7f34c37fe640 1 -- 172.21.15.55:0/683137597 >> v1:172.21.15.55:6789/0 conn(0x7f34c4070d70 legacy=0x7f34c40b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.621+0000 7f34c37fe640 1 -- 172.21.15.55:0/683137597 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c40cc8c0 con 0x7f34c406fef0 2023-07-06T22:18:30.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.621+0000 7f34c27fc640 1 -- 172.21.15.55:0/683137597 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312148996 0 0) 0x7f34c40cc030 con 0x7f34c4070d70 2023-07-06T22:18:30.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.625+0000 7f34c37fe640 1 --2- 172.21.15.55:0/683137597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c406fef0 0x7f34c4164820 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009d90 tx=0x7f34bc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830e5eb3bc9f8c5c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:30.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.625+0000 7f34c27fc640 1 -- 172.21.15.55:0/683137597 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc0a58c0 con 0x7f34c406fef0 2023-07-06T22:18:30.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.625+0000 7f34c27fc640 1 -- 172.21.15.55:0/683137597 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc0a5a20 con 0x7f34c406fef0 2023-07-06T22:18:30.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.625+0000 7f34c27fc640 1 -- 172.21.15.55:0/683137597 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc0a5db0 con 0x7f34c406fef0 2023-07-06T22:18:30.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.625+0000 7f34c960b640 1 -- 172.21.15.55:0/683137597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c406fef0 msgr2=0x7f34c4164820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.625+0000 7f34c960b640 1 --2- 172.21.15.55:0/683137597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c406fef0 0x7f34c4164820 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009d90 tx=0x7f34bc01c910 comp rx=0 tx=0).stop 2023-07-06T22:18:30.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.625+0000 7f34c960b640 1 -- 172.21.15.55:0/683137597 shutdown_connections 2023-07-06T22:18:30.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.625+0000 7f34c960b640 1 --2- 172.21.15.55:0/683137597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c406fef0 0x7f34c4164820 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.625+0000 7f34c960b640 1 -- 172.21.15.55:0/683137597 >> 172.21.15.55:0/683137597 conn(0x7f34c40cea70 msgr2=0x7f34c40ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:30.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.625+0000 7f34c960b640 1 -- 172.21.15.55:0/683137597 shutdown_connections 2023-07-06T22:18:30.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.625+0000 7f34c960b640 1 -- 172.21.15.55:0/683137597 wait complete. 2023-07-06T22:18:30.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.625+0000 7f34c960b640 1 Processor -- start 2023-07-06T22:18:30.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.625+0000 7f34c960b640 1 -- start start 2023-07-06T22:18:30.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34c960b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c406fef0 0x7f34c40c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34c960b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c40709a0 0x7f34c40c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34c960b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34c4070d70 0x7f34c40c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34c960b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c40c9070 con 0x7f34c40709a0 2023-07-06T22:18:30.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34c960b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c409e380 con 0x7f34c406fef0 2023-07-06T22:18:30.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34c960b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c409e660 con 0x7f34c4070d70 2023-07-06T22:18:30.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c40709a0 0x7f34c40c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c40709a0 0x7f34c40c3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45976/0 (socket says 172.21.15.55:45976) 2023-07-06T22:18:30.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34bbfff640 1 -- 172.21.15.55:0/3330948644 learned_addr learned my addr 172.21.15.55:0/3330948644 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:30.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34c2ffd640 1 --2- 172.21.15.55:0/3330948644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c406fef0 0x7f34c40c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34c37fe640 1 --2- 172.21.15.55:0/3330948644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34c4070d70 0x7f34c40c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34bbfff640 1 -- 172.21.15.55:0/3330948644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34c4070d70 msgr2=0x7f34c40c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34bbfff640 1 --2- 172.21.15.55:0/3330948644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34c4070d70 0x7f34c40c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34bbfff640 1 -- 172.21.15.55:0/3330948644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c406fef0 msgr2=0x7f34c40c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34bbfff640 1 --2- 172.21.15.55:0/3330948644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c406fef0 0x7f34c40c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34bbfff640 1 -- 172.21.15.55:0/3330948644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc009a70 con 0x7f34c40709a0 2023-07-06T22:18:30.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34bbfff640 1 --2- 172.21.15.55:0/3330948644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c40709a0 0x7f34c40c3d80 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00c480 tx=0x7f34ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:30.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34bb7fe640 1 -- 172.21.15.55:0/3330948644 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac0074e0 con 0x7f34c40709a0 2023-07-06T22:18:30.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34bb7fe640 1 -- 172.21.15.55:0/3330948644 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ac007660 con 0x7f34c40709a0 2023-07-06T22:18:30.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34bb7fe640 1 -- 172.21.15.55:0/3330948644 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac004a30 con 0x7f34c40709a0 2023-07-06T22:18:30.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34c960b640 1 -- 172.21.15.55:0/3330948644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c40c92c0 con 0x7f34c40709a0 2023-07-06T22:18:30.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34c960b640 1 -- 172.21.15.55:0/3330948644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c40c8950 con 0x7f34c40709a0 2023-07-06T22:18:30.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34c960b640 1 -- 172.21.15.55:0/3330948644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c409e8a0 con 0x7f34c40709a0 2023-07-06T22:18:30.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.629+0000 7f34bb7fe640 1 -- 172.21.15.55:0/3330948644 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f34ac004b90 con 0x7f34c40709a0 2023-07-06T22:18:30.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.633+0000 7f34bb7fe640 1 --2- 172.21.15.55:0/3330948644 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f34a40663a0 0x7f34a4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.633+0000 7f34bb7fe640 1 -- 172.21.15.55:0/3330948644 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6704+0+0 (secure 0 0 0) 0x7f34ac083160 con 0x7f34c40709a0 2023-07-06T22:18:30.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.633+0000 7f34c2ffd640 1 --2- 172.21.15.55:0/3330948644 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f34a40663a0 0x7f34a4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.633+0000 7f34c2ffd640 1 --2- 172.21.15.55:0/3330948644 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f34a40663a0 0x7f34a4068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f34b4007fd0 tx=0x7f34b4009040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:30.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.637+0000 7f34bb7fe640 1 -- 172.21.15.55:0/3330948644 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f34ac050390 con 0x7f34c40709a0 2023-07-06T22:18:30.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.789+0000 7f34c960b640 1 -- 172.21.15.55:0/3330948644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f34c409ec60 con 0x7f34c40709a0 2023-07-06T22:18:30.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.797+0000 7f34bb7fe640 1 -- 172.21.15.55:0/3330948644 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7f34ac0539b0 con 0x7f34c40709a0 2023-07-06T22:18:30.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.797+0000 7f34c960b640 1 -- 172.21.15.55:0/3330948644 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f34a40663a0 msgr2=0x7f34a4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.797+0000 7f34c960b640 1 --2- 172.21.15.55:0/3330948644 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f34a40663a0 0x7f34a4068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f34b4007fd0 tx=0x7f34b4009040 comp rx=0 tx=0).stop 2023-07-06T22:18:30.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.797+0000 7f34c960b640 1 -- 172.21.15.55:0/3330948644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c40709a0 msgr2=0x7f34c40c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.797+0000 7f34c960b640 1 --2- 172.21.15.55:0/3330948644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c40709a0 0x7f34c40c3d80 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00c480 tx=0x7f34ac00c940 comp rx=0 tx=0).stop 2023-07-06T22:18:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.797+0000 7f34c960b640 1 -- 172.21.15.55:0/3330948644 shutdown_connections 2023-07-06T22:18:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.797+0000 7f34c960b640 1 --2- 172.21.15.55:0/3330948644 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f34a40663a0 0x7f34a4068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.797+0000 7f34c960b640 1 --2- 172.21.15.55:0/3330948644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34c4070d70 0x7f34c40c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.797+0000 7f34c960b640 1 --2- 172.21.15.55:0/3330948644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c40709a0 0x7f34c40c3d80 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.797+0000 7f34c960b640 1 --2- 172.21.15.55:0/3330948644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c406fef0 0x7f34c40c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.797+0000 7f34c960b640 1 -- 172.21.15.55:0/3330948644 >> 172.21.15.55:0/3330948644 conn(0x7f34c40cea70 msgr2=0x7f34c40c4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.797+0000 7f34c960b640 1 -- 172.21.15.55:0/3330948644 shutdown_connections 2023-07-06T22:18:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.797+0000 7f34c960b640 1 -- 172.21.15.55:0/3330948644 wait complete. 2023-07-06T22:18:30.823 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-06T22:18:30.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb47737640 1 Processor -- start 2023-07-06T22:18:30.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb47737640 1 -- start start 2023-07-06T22:18:30.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb47737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb40158e70 0x7feb40159240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb47737640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb400cb770 con 0x7feb40159780 2023-07-06T22:18:30.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb47737640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4015d0c0 con 0x7feb40070700 2023-07-06T22:18:30.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb47737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb40159bf0 con 0x7feb40158e70 2023-07-06T22:18:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb44cd2640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feb40159780 0x7feb4006fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41754/0 (socket says 172.21.15.55:41754) 2023-07-06T22:18:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb44cd2640 1 -- 172.21.15.55:0/2290667132 learned_addr learned my addr 172.21.15.55:0/2290667132 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb454d3640 1 --2- 172.21.15.55:0/2290667132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb40158e70 0x7feb40159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 -- 172.21.15.55:0/2290667132 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567355401 0 0) 0x7feb400cb770 con 0x7feb40159780 2023-07-06T22:18:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 -- 172.21.15.55:0/2290667132 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb2c005740 con 0x7feb40159780 2023-07-06T22:18:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 -- 172.21.15.55:0/2290667132 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2066387347 0 0) 0x7feb2c005740 con 0x7feb40159780 2023-07-06T22:18:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 -- 172.21.15.55:0/2290667132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb40158e70 msgr2=0x7feb40159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 --2- 172.21.15.55:0/2290667132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb40158e70 0x7feb40159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 -- 172.21.15.55:0/2290667132 >> v1:172.21.15.138:6789/0 conn(0x7feb40070700 legacy=0x7feb400ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 -- 172.21.15.55:0/2290667132 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4015c540 con 0x7feb40159780 2023-07-06T22:18:30.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 -- 172.21.15.55:0/2290667132 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7feb30001680 con 0x7feb40159780 2023-07-06T22:18:30.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb454d3640 1 --2- 172.21.15.55:0/2290667132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb40158e70 0x7feb40159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:30.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 -- 172.21.15.55:0/2290667132 >> v1:172.21.15.55:6789/0 conn(0x7feb40159780 legacy=0x7feb4006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 --2- 172.21.15.55:0/2290667132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb40158e70 0x7feb2c005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 --2- 172.21.15.55:0/2290667132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c006100 0x7feb2c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 --2- 172.21.15.55:0/2290667132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb2c006f20 0x7feb2c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 -- 172.21.15.55:0/2290667132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb40159bf0 con 0x7feb2c006100 2023-07-06T22:18:30.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 -- 172.21.15.55:0/2290667132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c00dbd0 con 0x7feb2c006f20 2023-07-06T22:18:30.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.965+0000 7feb37fff640 1 -- 172.21.15.55:0/2290667132 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c00dd90 con 0x7feb40158e70 2023-07-06T22:18:30.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.969+0000 7feb44cd2640 1 --2- 172.21.15.55:0/2290667132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c006100 0x7feb2c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.969+0000 7feb454d3640 1 --2- 172.21.15.55:0/2290667132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb40158e70 0x7feb2c005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.969+0000 7feb45cd4640 1 --2- 172.21.15.55:0/2290667132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb2c006f20 0x7feb2c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.969+0000 7feb44cd2640 1 -- 172.21.15.55:0/2290667132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb40158e70 msgr2=0x7feb2c005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:30.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.969+0000 7feb44cd2640 1 --2- 172.21.15.55:0/2290667132 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb40158e70 0x7feb2c005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.969+0000 7feb44cd2640 1 -- 172.21.15.55:0/2290667132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb2c006f20 msgr2=0x7feb2c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:30.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.969+0000 7feb44cd2640 1 --2- 172.21.15.55:0/2290667132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb2c006f20 0x7feb2c007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.969+0000 7feb44cd2640 1 -- 172.21.15.55:0/2290667132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c009420 con 0x7feb2c006100 2023-07-06T22:18:30.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.969+0000 7feb44cd2640 1 --2- 172.21.15.55:0/2290667132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c006100 0x7feb2c0069e0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7feb3000c160 tx=0x7feb3001cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92410b058faa427 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:30.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.969+0000 7feb37fff640 1 -- 172.21.15.55:0/2290667132 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30005ae0 con 0x7feb2c006100 2023-07-06T22:18:30.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.969+0000 7feb37fff640 1 -- 172.21.15.55:0/2290667132 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb30005c60 con 0x7feb2c006100 2023-07-06T22:18:30.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.969+0000 7feb37fff640 1 -- 172.21.15.55:0/2290667132 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb300072b0 con 0x7feb2c006100 2023-07-06T22:18:30.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb47737640 1 -- 172.21.15.55:0/2290667132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c006100 msgr2=0x7feb2c0069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb47737640 1 --2- 172.21.15.55:0/2290667132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb2c006100 0x7feb2c0069e0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7feb3000c160 tx=0x7feb3001cb70 comp rx=0 tx=0).stop 2023-07-06T22:18:30.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb45cd4640 1 -- 172.21.15.55:0/2290667132 reap_dead start 2023-07-06T22:18:30.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb47737640 1 -- 172.21.15.55:0/2290667132 shutdown_connections 2023-07-06T22:18:30.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb47737640 1 -- 172.21.15.55:0/2290667132 >> 172.21.15.55:0/2290667132 conn(0x7feb400cb970 msgr2=0x7feb400cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:30.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb47737640 1 -- 172.21.15.55:0/2290667132 shutdown_connections 2023-07-06T22:18:30.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb47737640 1 -- 172.21.15.55:0/2290667132 wait complete. 2023-07-06T22:18:30.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb47737640 1 Processor -- start 2023-07-06T22:18:30.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb47737640 1 -- start start 2023-07-06T22:18:30.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb47737640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb2c006100 0x7feb4013fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb47737640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb400c5f30 0x7feb400ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb47737640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb400c4c70 0x7feb400c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb47737640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb400cadd0 con 0x7feb400c5f30 2023-07-06T22:18:30.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb47737640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb400c7040 con 0x7feb400c4c70 2023-07-06T22:18:30.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb47737640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb400c6430 con 0x7feb2c006100 2023-07-06T22:18:30.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb44cd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb400c5f30 0x7feb400ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb44cd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb400c5f30 0x7feb400ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45988/0 (socket says 172.21.15.55:45988) 2023-07-06T22:18:30.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb454d3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb2c006100 0x7feb4013fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb44cd2640 1 -- 172.21.15.55:0/3732236817 learned_addr learned my addr 172.21.15.55:0/3732236817 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:30.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb45cd4640 1 --2- 172.21.15.55:0/3732236817 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb400c4c70 0x7feb400c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb44cd2640 1 -- 172.21.15.55:0/3732236817 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb2c006100 msgr2=0x7feb4013fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb44cd2640 1 --2- 172.21.15.55:0/3732236817 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb2c006100 0x7feb4013fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb44cd2640 1 -- 172.21.15.55:0/3732236817 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb400c4c70 msgr2=0x7feb400c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:30.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb44cd2640 1 --2- 172.21.15.55:0/3732236817 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb400c4c70 0x7feb400c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:30.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.973+0000 7feb44cd2640 1 -- 172.21.15.55:0/3732236817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb400c6710 con 0x7feb400c5f30 2023-07-06T22:18:30.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.977+0000 7feb44cd2640 1 --2- 172.21.15.55:0/3732236817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb400c5f30 0x7feb400ca890 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7feb3000c160 tx=0x7feb2c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:30.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.977+0000 7feb35ffb640 1 -- 172.21.15.55:0/3732236817 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb300b4070 con 0x7feb400c5f30 2023-07-06T22:18:30.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.977+0000 7feb35ffb640 1 -- 172.21.15.55:0/3732236817 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb30007090 con 0x7feb400c5f30 2023-07-06T22:18:30.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.977+0000 7feb35ffb640 1 -- 172.21.15.55:0/3732236817 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30001440 con 0x7feb400c5f30 2023-07-06T22:18:30.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.977+0000 7feb47737640 1 -- 172.21.15.55:0/3732236817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb400c69f0 con 0x7feb400c5f30 2023-07-06T22:18:30.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.977+0000 7feb47737640 1 -- 172.21.15.55:0/3732236817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4014f850 con 0x7feb400c5f30 2023-07-06T22:18:30.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.977+0000 7feb47737640 1 -- 172.21.15.55:0/3732236817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb40066d60 con 0x7feb400c5f30 2023-07-06T22:18:30.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.977+0000 7feb35ffb640 1 -- 172.21.15.55:0/3732236817 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feb300047f0 con 0x7feb400c5f30 2023-07-06T22:18:30.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.977+0000 7feb35ffb640 1 --2- 172.21.15.55:0/3732236817 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7feb240663a0 0x7feb24068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:30.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.977+0000 7feb35ffb640 1 -- 172.21.15.55:0/3732236817 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6704+0+0 (secure 0 0 0) 0x7feb3011d2d0 con 0x7feb400c5f30 2023-07-06T22:18:30.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.977+0000 7feb454d3640 1 --2- 172.21.15.55:0/3732236817 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7feb240663a0 0x7feb24068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:30.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.981+0000 7feb454d3640 1 --2- 172.21.15.55:0/3732236817 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7feb240663a0 0x7feb24068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009d70 tx=0x7feb3c009190 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:30.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:30.981+0000 7feb35ffb640 1 -- 172.21.15.55:0/3732236817 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb300ea3c0 con 0x7feb400c5f30 2023-07-06T22:18:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.141+0000 7feb47737640 1 -- 172.21.15.55:0/3732236817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7feb400ce670 con 0x7feb400c5f30 2023-07-06T22:18:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.145+0000 7feb35ffb640 1 -- 172.21.15.55:0/3732236817 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v57) v1 ==== 115+0+0 (secure 0 0 0) 0x7feb300ed9e0 con 0x7feb400c5f30 2023-07-06T22:18:31.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.149+0000 7feb47737640 1 -- 172.21.15.55:0/3732236817 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7feb240663a0 msgr2=0x7feb24068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:31.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.149+0000 7feb47737640 1 --2- 172.21.15.55:0/3732236817 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7feb240663a0 0x7feb24068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009d70 tx=0x7feb3c009190 comp rx=0 tx=0).stop 2023-07-06T22:18:31.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.149+0000 7feb47737640 1 -- 172.21.15.55:0/3732236817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb400c5f30 msgr2=0x7feb400ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:31.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.149+0000 7feb47737640 1 --2- 172.21.15.55:0/3732236817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb400c5f30 0x7feb400ca890 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7feb3000c160 tx=0x7feb2c007a10 comp rx=0 tx=0).stop 2023-07-06T22:18:31.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.149+0000 7feb47737640 1 -- 172.21.15.55:0/3732236817 shutdown_connections 2023-07-06T22:18:31.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.149+0000 7feb47737640 1 --2- 172.21.15.55:0/3732236817 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7feb240663a0 0x7feb24068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:31.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.149+0000 7feb47737640 1 --2- 172.21.15.55:0/3732236817 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb400c4c70 0x7feb400c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:31.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.149+0000 7feb47737640 1 --2- 172.21.15.55:0/3732236817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb400c5f30 0x7feb400ca890 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:31.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.149+0000 7feb47737640 1 --2- 172.21.15.55:0/3732236817 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb2c006100 0x7feb4013fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:31.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.149+0000 7feb47737640 1 -- 172.21.15.55:0/3732236817 >> 172.21.15.55:0/3732236817 conn(0x7feb400cb970 msgr2=0x7feb400b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:31.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.149+0000 7feb47737640 1 -- 172.21.15.55:0/3732236817 shutdown_connections 2023-07-06T22:18:31.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.149+0000 7feb47737640 1 -- 172.21.15.55:0/3732236817 wait complete. 2023-07-06T22:18:31.172 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-07-06T22:18:31.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc34ce6640 1 Processor -- start 2023-07-06T22:18:31.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc34ce6640 1 -- start start 2023-07-06T22:18:31.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc34ce6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbc300b7cd0 0x7fbc300ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:31.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc34ce6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc300ccab0 0x7fbc300b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:31.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc34ce6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbc300ccf00 0x7fbc300b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:31.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc34ce6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc300d2310 con 0x7fbc300b7cd0 2023-07-06T22:18:31.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc34ce6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc300b80a0 con 0x7fbc300ccf00 2023-07-06T22:18:31.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc34ce6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300d1100 con 0x7fbc300ccab0 2023-07-06T22:18:31.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc2e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbc300b7cd0 0x7fbc300ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:31.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc2e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbc300b7cd0 0x7fbc300ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45996/0 (socket says 172.21.15.55:45996) 2023-07-06T22:18:31.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc2e59c640 1 -- 172.21.15.55:0/1523530165 learned_addr learned my addr 172.21.15.55:0/1523530165 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:31.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc2ed9d640 1 --2- 172.21.15.55:0/1523530165 >> v2:172.21.15.138:3300/0 conn(0x7fbc300ccf00 0x7fbc300b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:31.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc27fff640 1 --2- 172.21.15.55:0/1523530165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc300ccab0 0x7fbc300b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:31.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc2e59c640 1 -- 172.21.15.55:0/1523530165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc300ccab0 msgr2=0x7fbc300b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:31.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc2e59c640 1 --2- 172.21.15.55:0/1523530165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc300ccab0 0x7fbc300b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:31.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc2e59c640 1 -- 172.21.15.55:0/1523530165 >> v2:172.21.15.138:3300/0 conn(0x7fbc300ccf00 msgr2=0x7fbc300b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:31.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc2e59c640 1 --2- 172.21.15.55:0/1523530165 >> v2:172.21.15.138:3300/0 conn(0x7fbc300ccf00 0x7fbc300b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:31.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.313+0000 7fbc2e59c640 1 -- 172.21.15.55:0/1523530165 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc300cecf0 con 0x7fbc300b7cd0 2023-07-06T22:18:31.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.317+0000 7fbc2e59c640 1 --2- 172.21.15.55:0/1523530165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc300b7cd0 0x7fbc300ce610 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fbc300cd800 tx=0x7fbc2001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ab270f6e7adb8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:31.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.317+0000 7fbc2dd9b640 1 -- 172.21.15.55:0/1523530165 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc200ab600 con 0x7fbc300b7cd0 2023-07-06T22:18:31.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.317+0000 7fbc2dd9b640 1 -- 172.21.15.55:0/1523530165 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc200a7050 con 0x7fbc300b7cd0 2023-07-06T22:18:31.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.317+0000 7fbc2dd9b640 1 -- 172.21.15.55:0/1523530165 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc200ab980 con 0x7fbc300b7cd0 2023-07-06T22:18:31.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.317+0000 7fbc34ce6640 1 -- 172.21.15.55:0/1523530165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc300b7cd0 msgr2=0x7fbc300ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:31.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.317+0000 7fbc34ce6640 1 --2- 172.21.15.55:0/1523530165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc300b7cd0 0x7fbc300ce610 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fbc300cd800 tx=0x7fbc2001c470 comp rx=0 tx=0).stop 2023-07-06T22:18:31.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.317+0000 7fbc34ce6640 1 -- 172.21.15.55:0/1523530165 shutdown_connections 2023-07-06T22:18:31.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.317+0000 7fbc34ce6640 1 --2- 172.21.15.55:0/1523530165 >> v2:172.21.15.138:3300/0 conn(0x7fbc300ccf00 0x7fbc300b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:31.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.317+0000 7fbc34ce6640 1 --2- 172.21.15.55:0/1523530165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc300ccab0 0x7fbc300b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.317+0000 7fbc34ce6640 1 --2- 172.21.15.55:0/1523530165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc300b7cd0 0x7fbc300ce610 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.317+0000 7fbc34ce6640 1 -- 172.21.15.55:0/1523530165 >> 172.21.15.55:0/1523530165 conn(0x7fbc300ceee0 msgr2=0x7fbc300cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.317+0000 7fbc34ce6640 1 -- 172.21.15.55:0/1523530165 shutdown_connections 2023-07-06T22:18:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.317+0000 7fbc34ce6640 1 -- 172.21.15.55:0/1523530165 wait complete. 2023-07-06T22:18:31.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc34ce6640 1 Processor -- start 2023-07-06T22:18:31.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc34ce6640 1 -- start start 2023-07-06T22:18:31.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc34ce6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc300b7cd0 0x7fbc3015cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:31.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc34ce6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc300ccab0 0x7fbc30148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:31.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc34ce6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc300ccf00 0x7fbc3006a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:31.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc34ce6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc301f7910 con 0x7fbc300b7cd0 2023-07-06T22:18:31.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc34ce6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc301f7bf0 con 0x7fbc300ccab0 2023-07-06T22:18:31.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc34ce6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc301f7ed0 con 0x7fbc300ccf00 2023-07-06T22:18:31.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc2e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc300b7cd0 0x7fbc3015cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:31.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc2e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc300b7cd0 0x7fbc3015cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46012/0 (socket says 172.21.15.55:46012) 2023-07-06T22:18:31.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc2e59c640 1 -- 172.21.15.55:0/951489481 learned_addr learned my addr 172.21.15.55:0/951489481 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:31.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc2ed9d640 1 --2- 172.21.15.55:0/951489481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc300ccf00 0x7fbc3006a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:31.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc27fff640 1 --2- 172.21.15.55:0/951489481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc300ccab0 0x7fbc30148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:31.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc2e59c640 1 -- 172.21.15.55:0/951489481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc300ccf00 msgr2=0x7fbc3006a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:31.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc2e59c640 1 --2- 172.21.15.55:0/951489481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc300ccf00 0x7fbc3006a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:31.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc2e59c640 1 -- 172.21.15.55:0/951489481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc300ccab0 msgr2=0x7fbc30148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:31.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc2e59c640 1 --2- 172.21.15.55:0/951489481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc300ccab0 0x7fbc30148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:31.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc2e59c640 1 -- 172.21.15.55:0/951489481 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc200094d0 con 0x7fbc300b7cd0 2023-07-06T22:18:31.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc2e59c640 1 --2- 172.21.15.55:0/951489481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc300b7cd0 0x7fbc3015cd60 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fbc200ae040 tx=0x7fbc2001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:31.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc26ffd640 1 -- 172.21.15.55:0/951489481 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc200b6620 con 0x7fbc300b7cd0 2023-07-06T22:18:31.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc26ffd640 1 -- 172.21.15.55:0/951489481 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc200b6780 con 0x7fbc300b7cd0 2023-07-06T22:18:31.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc26ffd640 1 -- 172.21.15.55:0/951489481 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc200b6b10 con 0x7fbc300b7cd0 2023-07-06T22:18:31.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc34ce6640 1 -- 172.21.15.55:0/951489481 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc301f81b0 con 0x7fbc300b7cd0 2023-07-06T22:18:31.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.321+0000 7fbc34ce6640 1 -- 172.21.15.55:0/951489481 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3015d2a0 con 0x7fbc300b7cd0 2023-07-06T22:18:31.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.325+0000 7fbc34ce6640 1 -- 172.21.15.55:0/951489481 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc30066d60 con 0x7fbc300b7cd0 2023-07-06T22:18:31.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.325+0000 7fbc26ffd640 1 -- 172.21.15.55:0/951489481 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbc200b2040 con 0x7fbc300b7cd0 2023-07-06T22:18:31.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.325+0000 7fbc26ffd640 1 --2- 172.21.15.55:0/951489481 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbc100663a0 0x7fbc10068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:31.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.325+0000 7fbc26ffd640 1 -- 172.21.15.55:0/951489481 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6704+0+0 (secure 0 0 0) 0x7fbc2011e680 con 0x7fbc300b7cd0 2023-07-06T22:18:31.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.325+0000 7fbc27fff640 1 --2- 172.21.15.55:0/951489481 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbc100663a0 0x7fbc10068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:31.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.325+0000 7fbc27fff640 1 --2- 172.21.15.55:0/951489481 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbc100663a0 0x7fbc10068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbc300cbfd0 tx=0x7fbc18008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:31.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.329+0000 7fbc26ffd640 1 -- 172.21.15.55:0/951489481 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc200eb720 con 0x7fbc300b7cd0 2023-07-06T22:18:31.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:31.537+0000 7fbc34ce6640 1 -- 172.21.15.55:0/951489481 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7fbc301f8660 con 0x7fbc300b7cd0 2023-07-06T22:18:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.133+0000 7fbc26ffd640 1 -- 172.21.15.55:0/951489481 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v1298) v1 ==== 165+0+0 (secure 0 0 0) 0x7fbc200eed40 con 0x7fbc300b7cd0 2023-07-06T22:18:32.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.137+0000 7fbc34ce6640 1 -- 172.21.15.55:0/951489481 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbc100663a0 msgr2=0x7fbc10068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:32.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.137+0000 7fbc34ce6640 1 --2- 172.21.15.55:0/951489481 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbc100663a0 0x7fbc10068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbc300cbfd0 tx=0x7fbc18008040 comp rx=0 tx=0).stop 2023-07-06T22:18:32.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.137+0000 7fbc34ce6640 1 -- 172.21.15.55:0/951489481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc300b7cd0 msgr2=0x7fbc3015cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:32.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.137+0000 7fbc34ce6640 1 --2- 172.21.15.55:0/951489481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc300b7cd0 0x7fbc3015cd60 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fbc200ae040 tx=0x7fbc2001acb0 comp rx=0 tx=0).stop 2023-07-06T22:18:32.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.137+0000 7fbc34ce6640 1 -- 172.21.15.55:0/951489481 shutdown_connections 2023-07-06T22:18:32.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.137+0000 7fbc34ce6640 1 --2- 172.21.15.55:0/951489481 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbc100663a0 0x7fbc10068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:32.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.137+0000 7fbc34ce6640 1 --2- 172.21.15.55:0/951489481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc300ccf00 0x7fbc3006a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:32.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.137+0000 7fbc34ce6640 1 --2- 172.21.15.55:0/951489481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc300ccab0 0x7fbc30148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:32.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.137+0000 7fbc34ce6640 1 --2- 172.21.15.55:0/951489481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc300b7cd0 0x7fbc3015cd60 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:32.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.137+0000 7fbc34ce6640 1 -- 172.21.15.55:0/951489481 >> 172.21.15.55:0/951489481 conn(0x7fbc300ceee0 msgr2=0x7fbc300cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:32.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.137+0000 7fbc34ce6640 1 -- 172.21.15.55:0/951489481 shutdown_connections 2023-07-06T22:18:32.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.137+0000 7fbc34ce6640 1 -- 172.21.15.55:0/951489481 wait complete. 2023-07-06T22:18:32.165 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-07-06T22:18:32.165 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-07-06T22:18:32.165 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-06T22:18:32.166 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-07-06T22:18:32.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.305+0000 7fdae880b640 1 Processor -- start 2023-07-06T22:18:32.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.305+0000 7fdae880b640 1 -- start start 2023-07-06T22:18:32.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.305+0000 7fdae880b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdae4158400 0x7fdae40c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:32.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.305+0000 7fdae880b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae406fae0 con 0x7fdae40c9680 2023-07-06T22:18:32.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.305+0000 7fdae880b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae406fdc0 con 0x7fdae41587d0 2023-07-06T22:18:32.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.305+0000 7fdae880b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40700a0 con 0x7fdae4158400 2023-07-06T22:18:32.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.305+0000 7fdadbfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdae40c9680 0x7fdae4070b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41764/0 (socket says 172.21.15.55:41764) 2023-07-06T22:18:32.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.305+0000 7fdadbfff640 1 -- 172.21.15.55:0/2115815350 learned_addr learned my addr 172.21.15.55:0/2115815350 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:32.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.305+0000 7fdae259c640 1 --2- 172.21.15.55:0/2115815350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdae4158400 0x7fdae40c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:32.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.309+0000 7fdae1d9b640 1 -- 172.21.15.55:0/2115815350 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777651595 0 0) 0x7fdae406fae0 con 0x7fdae40c9680 2023-07-06T22:18:32.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.309+0000 7fdae1d9b640 1 -- 172.21.15.55:0/2115815350 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdad0003530 con 0x7fdae40c9680 2023-07-06T22:18:32.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.309+0000 7fdae1d9b640 1 -- 172.21.15.55:0/2115815350 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3319754224 0 0) 0x7fdae406fdc0 con 0x7fdae41587d0 2023-07-06T22:18:32.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.309+0000 7fdae1d9b640 1 -- 172.21.15.55:0/2115815350 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdae406fae0 con 0x7fdae41587d0 2023-07-06T22:18:32.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.309+0000 7fdae1d9b640 1 -- 172.21.15.55:0/2115815350 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1657208980 0 0) 0x7fdad0003530 con 0x7fdae40c9680 2023-07-06T22:18:32.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.309+0000 7fdae259c640 1 -- 172.21.15.55:0/2115815350 >> v1:172.21.15.138:6789/0 conn(0x7fdae41587d0 legacy=0x7fdae40cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:32.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.309+0000 7fdae259c640 1 -- 172.21.15.55:0/2115815350 >> v1:172.21.15.55:6789/0 conn(0x7fdae40c9680 legacy=0x7fdae4070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:32.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.309+0000 7fdae259c640 1 -- 172.21.15.55:0/2115815350 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae4070380 con 0x7fdae4158400 2023-07-06T22:18:32.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.309+0000 7fdae259c640 1 --2- 172.21.15.55:0/2115815350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdae4158400 0x7fdae40c9140 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdad40097f0 tx=0x7fdad401c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94784daafa875844 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:32.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.309+0000 7fdae1d9b640 1 -- 172.21.15.55:0/2115815350 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc001600 con 0x7fdae4158400 2023-07-06T22:18:32.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.309+0000 7fdae1d9b640 1 -- 172.21.15.55:0/2115815350 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad40a7050 con 0x7fdae4158400 2023-07-06T22:18:32.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.309+0000 7fdae1d9b640 1 -- 172.21.15.55:0/2115815350 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad40ab620 con 0x7fdae4158400 2023-07-06T22:18:32.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 -- 172.21.15.55:0/2115815350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdae4158400 msgr2=0x7fdae40c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 --2- 172.21.15.55:0/2115815350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdae4158400 0x7fdae40c9140 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdad40097f0 tx=0x7fdad401c3b0 comp rx=0 tx=0).stop 2023-07-06T22:18:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 -- 172.21.15.55:0/2115815350 shutdown_connections 2023-07-06T22:18:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 --2- 172.21.15.55:0/2115815350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdae4158400 0x7fdae40c9140 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 -- 172.21.15.55:0/2115815350 >> 172.21.15.55:0/2115815350 conn(0x7fdae40cded0 msgr2=0x7fdae40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 -- 172.21.15.55:0/2115815350 shutdown_connections 2023-07-06T22:18:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 -- 172.21.15.55:0/2115815350 wait complete. 2023-07-06T22:18:32.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 Processor -- start 2023-07-06T22:18:32.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 -- start start 2023-07-06T22:18:32.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdae40c9680 0x7fdae40c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:32.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdae4158400 0x7fdae40c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:32.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdae41587d0 0x7fdae4153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:32.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae41f8f00 con 0x7fdae4158400 2023-07-06T22:18:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40c5800 con 0x7fdae40c9680 2023-07-06T22:18:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae880b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40c4760 con 0x7fdae41587d0 2023-07-06T22:18:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdadbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdae4158400 0x7fdae40c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdadbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdae4158400 0x7fdae40c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46018/0 (socket says 172.21.15.55:46018) 2023-07-06T22:18:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdadbfff640 1 -- 172.21.15.55:0/2094077945 learned_addr learned my addr 172.21.15.55:0/2094077945 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:32.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae259c640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdae40c9680 0x7fdae40c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae2d9d640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdae41587d0 0x7fdae4153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdadbfff640 1 -- 172.21.15.55:0/2094077945 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdae41587d0 msgr2=0x7fdae4153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdadbfff640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdae41587d0 0x7fdae4153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdadbfff640 1 -- 172.21.15.55:0/2094077945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdae40c9680 msgr2=0x7fdae40c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdadbfff640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdae40c9680 0x7fdae40c5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdadbfff640 1 -- 172.21.15.55:0/2094077945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad4009420 con 0x7fdae4158400 2023-07-06T22:18:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae259c640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdae40c9680 0x7fdae40c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:18:32.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.313+0000 7fdae2d9d640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdae41587d0 0x7fdae4153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:18:32.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.317+0000 7fdadbfff640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdae4158400 0x7fdae40c67e0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00c780 tx=0x7fdacc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:32.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.317+0000 7fdadaffd640 1 -- 172.21.15.55:0/2094077945 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc005ae0 con 0x7fdae4158400 2023-07-06T22:18:32.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.317+0000 7fdadaffd640 1 -- 172.21.15.55:0/2094077945 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc005c40 con 0x7fdae4158400 2023-07-06T22:18:32.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.317+0000 7fdadaffd640 1 -- 172.21.15.55:0/2094077945 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc007070 con 0x7fdae4158400 2023-07-06T22:18:32.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.317+0000 7fdae880b640 1 -- 172.21.15.55:0/2094077945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae41f8c20 con 0x7fdae4158400 2023-07-06T22:18:32.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.317+0000 7fdae880b640 1 -- 172.21.15.55:0/2094077945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae40c5420 con 0x7fdae4158400 2023-07-06T22:18:32.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.317+0000 7fdae880b640 1 -- 172.21.15.55:0/2094077945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae406c580 con 0x7fdae4158400 2023-07-06T22:18:32.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.317+0000 7fdadaffd640 1 -- 172.21.15.55:0/2094077945 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdacc0071d0 con 0x7fdae4158400 2023-07-06T22:18:32.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.317+0000 7fdadaffd640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdac40663a0 0x7fdac4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:32.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.317+0000 7fdadaffd640 1 -- 172.21.15.55:0/2094077945 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6704+0+0 (secure 0 0 0) 0x7fdacc083e50 con 0x7fdae4158400 2023-07-06T22:18:32.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.317+0000 7fdae259c640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdac40663a0 0x7fdac4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:32.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.321+0000 7fdae259c640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdac40663a0 0x7fdac4068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdad40ad000 tx=0x7fdad4008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:32.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.321+0000 7fdadaffd640 1 -- 172.21.15.55:0/2094077945 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdacc050f50 con 0x7fdae4158400 2023-07-06T22:18:32.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:32.529+0000 7fdae880b640 1 -- 172.21.15.55:0/2094077945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7fdae40c5940 con 0x7fdae4158400 2023-07-06T22:18:33.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.141+0000 7fdadaffd640 1 -- 172.21.15.55:0/2094077945 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1299) v1 ==== 166+0+0 (secure 0 0 0) 0x7fdae40c5940 con 0x7fdae4158400 2023-07-06T22:18:33.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.141+0000 7fdae880b640 1 -- 172.21.15.55:0/2094077945 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdac40663a0 msgr2=0x7fdac4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.141+0000 7fdae880b640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdac40663a0 0x7fdac4068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdad40ad000 tx=0x7fdad4008040 comp rx=0 tx=0).stop 2023-07-06T22:18:33.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.141+0000 7fdae880b640 1 -- 172.21.15.55:0/2094077945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdae4158400 msgr2=0x7fdae40c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.141+0000 7fdae880b640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdae4158400 0x7fdae40c67e0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00c780 tx=0x7fdacc00cc40 comp rx=0 tx=0).stop 2023-07-06T22:18:33.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.141+0000 7fdae880b640 1 -- 172.21.15.55:0/2094077945 shutdown_connections 2023-07-06T22:18:33.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.141+0000 7fdae880b640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdac40663a0 0x7fdac4068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.141+0000 7fdae880b640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdae41587d0 0x7fdae4153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.141+0000 7fdae880b640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdae4158400 0x7fdae40c67e0 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.141+0000 7fdae880b640 1 --2- 172.21.15.55:0/2094077945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdae40c9680 0x7fdae40c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.141+0000 7fdae880b640 1 -- 172.21.15.55:0/2094077945 >> 172.21.15.55:0/2094077945 conn(0x7fdae40cded0 msgr2=0x7fdae40ad9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:33.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.141+0000 7fdae880b640 1 -- 172.21.15.55:0/2094077945 shutdown_connections 2023-07-06T22:18:33.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.141+0000 7fdae880b640 1 -- 172.21.15.55:0/2094077945 wait complete. 2023-07-06T22:18:33.170 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:18:33.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.313+0000 7f614b537640 1 Processor -- start 2023-07-06T22:18:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.313+0000 7f614b537640 1 -- start start 2023-07-06T22:18:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.313+0000 7f614b537640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f61440712f0 0x7f614406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.313+0000 7f614b537640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61440ca450 0x7f614415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.313+0000 7f614b537640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6144159cd0 con 0x7f61440b3730 2023-07-06T22:18:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.313+0000 7f614b537640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61440693f0 con 0x7f61440712f0 2023-07-06T22:18:33.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.313+0000 7f614b537640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614406aca0 con 0x7f61440ca450 2023-07-06T22:18:33.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f61492d3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f61440712f0 0x7f614406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f6149ad4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61440ca450 0x7f614415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f61492d3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f61440712f0 0x7f614406a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:35504/0 (socket says 172.21.15.55:35504) 2023-07-06T22:18:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f61492d3640 1 -- 172.21.15.55:0/574290031 learned_addr learned my addr 172.21.15.55:0/574290031 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f6148ad2640 1 --1- 172.21.15.55:0/574290031 >> v1:172.21.15.138:6789/0 conn(0x7f61440b3730 0x7f61440c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:35000/0 (socket says 172.21.15.55:35000) 2023-07-06T22:18:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f613bfff640 1 -- 172.21.15.55:0/574290031 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530372111 0 0) 0x7f6144159cd0 con 0x7f61440b3730 2023-07-06T22:18:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f613bfff640 1 -- 172.21.15.55:0/574290031 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6130003530 con 0x7f61440b3730 2023-07-06T22:18:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f6149ad4640 1 -- 172.21.15.55:0/574290031 >> v2:172.21.15.138:3300/0 conn(0x7f61440712f0 msgr2=0x7f614406a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f6149ad4640 1 --2- 172.21.15.55:0/574290031 >> v2:172.21.15.138:3300/0 conn(0x7f61440712f0 0x7f614406a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f6149ad4640 1 -- 172.21.15.55:0/574290031 >> v1:172.21.15.138:6789/0 conn(0x7f61440b3730 legacy=0x7f61440c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f6149ad4640 1 -- 172.21.15.55:0/574290031 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61440696b0 con 0x7f61440ca450 2023-07-06T22:18:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f61492d3640 1 --2- 172.21.15.55:0/574290031 >> v2:172.21.15.138:3300/0 conn(0x7f61440712f0 0x7f614406a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:33.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f6149ad4640 1 --2- 172.21.15.55:0/574290031 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61440ca450 0x7f614415d3e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f613c009d90 tx=0x7f613c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=711cc6b16c000014 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:33.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f613bfff640 1 -- 172.21.15.55:0/574290031 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c0a58f0 con 0x7f61440ca450 2023-07-06T22:18:33.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f613bfff640 1 -- 172.21.15.55:0/574290031 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c0a5a50 con 0x7f61440ca450 2023-07-06T22:18:33.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.317+0000 7f613bfff640 1 -- 172.21.15.55:0/574290031 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c0a5de0 con 0x7f61440ca450 2023-07-06T22:18:33.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 -- 172.21.15.55:0/574290031 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61440ca450 msgr2=0x7f614415d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 --2- 172.21.15.55:0/574290031 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61440ca450 0x7f614415d3e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f613c009d90 tx=0x7f613c01c920 comp rx=0 tx=0).stop 2023-07-06T22:18:33.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 -- 172.21.15.55:0/574290031 shutdown_connections 2023-07-06T22:18:33.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 --2- 172.21.15.55:0/574290031 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61440ca450 0x7f614415d3e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 --2- 172.21.15.55:0/574290031 >> v2:172.21.15.138:3300/0 conn(0x7f61440712f0 0x7f614406a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 -- 172.21.15.55:0/574290031 >> 172.21.15.55:0/574290031 conn(0x7f61440cded0 msgr2=0x7f61440ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:33.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 -- 172.21.15.55:0/574290031 shutdown_connections 2023-07-06T22:18:33.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 -- 172.21.15.55:0/574290031 wait complete. 2023-07-06T22:18:33.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 Processor -- start 2023-07-06T22:18:33.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 -- start start 2023-07-06T22:18:33.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61440712f0 0x7f61440b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:33.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61440b3730 0x7f61441572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:33.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61440ca450 0x7f614415aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:33.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614415cda0 con 0x7f61440712f0 2023-07-06T22:18:33.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6144156e40 con 0x7f61440b3730 2023-07-06T22:18:33.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f614b537640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614415cac0 con 0x7f61440ca450 2023-07-06T22:18:33.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f61492d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61440712f0 0x7f61440b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:33.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f61492d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61440712f0 0x7f61440b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43534/0 (socket says 172.21.15.55:43534) 2023-07-06T22:18:33.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f61492d3640 1 -- 172.21.15.55:0/705826583 learned_addr learned my addr 172.21.15.55:0/705826583 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:33.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.321+0000 7f6148ad2640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61440b3730 0x7f61441572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:33.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f6149ad4640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61440ca450 0x7f614415aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:33.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f61492d3640 1 -- 172.21.15.55:0/705826583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61440ca450 msgr2=0x7f614415aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f61492d3640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61440ca450 0x7f614415aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f61492d3640 1 -- 172.21.15.55:0/705826583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61440b3730 msgr2=0x7f61441572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f61492d3640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61440b3730 0x7f61441572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f61492d3640 1 -- 172.21.15.55:0/705826583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61400094d0 con 0x7f61440712f0 2023-07-06T22:18:33.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f6148ad2640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61440b3730 0x7f61441572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:18:33.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f6149ad4640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61440ca450 0x7f614415aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:18:33.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f61492d3640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61440712f0 0x7f61440b22a0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f614000e930 tx=0x7f614000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:33.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f6139ffb640 1 -- 172.21.15.55:0/705826583 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614000ca00 con 0x7f61440712f0 2023-07-06T22:18:33.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f6139ffb640 1 -- 172.21.15.55:0/705826583 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614000cb60 con 0x7f61440712f0 2023-07-06T22:18:33.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f614b537640 1 -- 172.21.15.55:0/705826583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613c009a70 con 0x7f61440712f0 2023-07-06T22:18:33.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f6139ffb640 1 -- 172.21.15.55:0/705826583 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140013470 con 0x7f61440712f0 2023-07-06T22:18:33.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f614b537640 1 -- 172.21.15.55:0/705826583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6144156ad0 con 0x7f61440712f0 2023-07-06T22:18:33.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f614b537640 1 -- 172.21.15.55:0/705826583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6144066d60 con 0x7f61440712f0 2023-07-06T22:18:33.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f6139ffb640 1 -- 172.21.15.55:0/705826583 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f61400135d0 con 0x7f61440712f0 2023-07-06T22:18:33.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f6139ffb640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f61280663a0 0x7f6128068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:33.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.325+0000 7f6139ffb640 1 -- 172.21.15.55:0/705826583 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6704+0+0 (secure 0 0 0) 0x7f6140084300 con 0x7f61440712f0 2023-07-06T22:18:33.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.329+0000 7f6148ad2640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f61280663a0 0x7f6128068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:33.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.329+0000 7f6148ad2640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f61280663a0 0x7f6128068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f61440ca020 tx=0x7f6134009040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:33.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.329+0000 7f6139ffb640 1 -- 172.21.15.55:0/705826583 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6140051400 con 0x7f61440712f0 2023-07-06T22:18:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.489+0000 7f614b537640 1 -- 172.21.15.55:0/705826583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f614406c380 con 0x7f61440712f0 2023-07-06T22:18:33.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.489+0000 7f6139ffb640 1 -- 172.21.15.55:0/705826583 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+16558 (secure 0 0 0) 0x7f6140054a20 con 0x7f61440712f0 2023-07-06T22:18:33.518 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:33.518 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":170,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:18:30.086416+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6836/4021237791":"2023-07-07T22:18:26.512241+0000","172.21.15.55:6834/4021237791":"2023-07-07T22:18:26.512241+0000","172.21.15.55:0/2497446583":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/3547286691":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/2254289784":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/132885301":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/3064152807":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/3882494277":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/653926838":"2023-07-07T22:13:20.216819+0000","172.21.15.55:6833/3834478672":"2023-07-07T22:13:20.216819+0000","172.21.15.55:6832/3834478672":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/562346394":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/1671051159":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/959368203":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/1415051792":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/323970277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6833/433956277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6832/433956277":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6833/2366924175":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/2414406270":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/3587598195":"2023-07-07T22:02:28.914064+0000","172.21.15.55:6832/2366924175":"2023-07-07T22:18:23.550767+0000","172.21.15.55:0/2664561010":"2023-07-07T22:13:20.216819+0000","172.21.15.55:0/1917520432":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/279151651":"2023-07-07T22:02:28.914064+0000","172.21.15.55:0/1806662178":"2023-07-07T22:02:28.914064+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":21,"snaps":[{"begin":2,"length":32}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:18:33.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.493+0000 7f614b537640 1 -- 172.21.15.55:0/705826583 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f61280663a0 msgr2=0x7f6128068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.493+0000 7f614b537640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f61280663a0 0x7f6128068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f61440ca020 tx=0x7f6134009040 comp rx=0 tx=0).stop 2023-07-06T22:18:33.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.493+0000 7f614b537640 1 -- 172.21.15.55:0/705826583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61440712f0 msgr2=0x7f61440b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.493+0000 7f614b537640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61440712f0 0x7f61440b22a0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f614000e930 tx=0x7f614000edf0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.493+0000 7f614b537640 1 -- 172.21.15.55:0/705826583 shutdown_connections 2023-07-06T22:18:33.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.493+0000 7f614b537640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f61280663a0 0x7f6128068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.493+0000 7f614b537640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61440ca450 0x7f614415aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.493+0000 7f614b537640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61440b3730 0x7f61441572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.493+0000 7f614b537640 1 --2- 172.21.15.55:0/705826583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61440712f0 0x7f61440b22a0 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.493+0000 7f614b537640 1 -- 172.21.15.55:0/705826583 >> 172.21.15.55:0/705826583 conn(0x7f61440cded0 msgr2=0x7f61440cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:33.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.493+0000 7f614b537640 1 -- 172.21.15.55:0/705826583 shutdown_connections 2023-07-06T22:18:33.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.493+0000 7f614b537640 1 -- 172.21.15.55:0/705826583 wait complete. 2023-07-06T22:18:33.521 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:18:33.522 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:18:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.661+0000 7f9a71911640 1 Processor -- start 2023-07-06T22:18:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.665+0000 7f9a71911640 1 -- start start 2023-07-06T22:18:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.665+0000 7f9a71911640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6c0cd140 0x7f9a6c163380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.665+0000 7f9a71911640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c0b2aa0 con 0x7f9a6c0ca130 2023-07-06T22:18:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.665+0000 7f9a71911640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c158c20 con 0x7f9a6c158850 2023-07-06T22:18:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.665+0000 7f9a71911640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0c8db0 con 0x7f9a6c0cd140 2023-07-06T22:18:33.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.665+0000 7f9a63fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9a6c0ca130 0x7f9a6c0703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55166/0 (socket says 172.21.15.55:55166) 2023-07-06T22:18:33.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.665+0000 7f9a63fff640 1 -- 172.21.15.55:0/1443006039 learned_addr learned my addr 172.21.15.55:0/1443006039 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:33.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.665+0000 7f9a6b7fe640 1 --2- 172.21.15.55:0/1443006039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6c0cd140 0x7f9a6c163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:33.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.665+0000 7f9a6a7fc640 1 -- 172.21.15.55:0/1443006039 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63381824 0 0) 0x7f9a6c0b2aa0 con 0x7f9a6c0ca130 2023-07-06T22:18:33.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.665+0000 7f9a6a7fc640 1 -- 172.21.15.55:0/1443006039 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a58003530 con 0x7f9a6c0ca130 2023-07-06T22:18:33.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.665+0000 7f9a6b7fe640 1 -- 172.21.15.55:0/1443006039 >> v1:172.21.15.138:6789/0 conn(0x7f9a6c158850 legacy=0x7f9a6c0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.665+0000 7f9a6a7fc640 1 -- 172.21.15.55:0/1443006039 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704140215 0 0) 0x7f9a6c158c20 con 0x7f9a6c158850 2023-07-06T22:18:33.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.665+0000 7f9a6b7fe640 1 -- 172.21.15.55:0/1443006039 >> v1:172.21.15.55:6789/0 conn(0x7f9a6c0ca130 legacy=0x7f9a6c0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.665+0000 7f9a6b7fe640 1 -- 172.21.15.55:0/1443006039 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c0c9090 con 0x7f9a6c0cd140 2023-07-06T22:18:33.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.669+0000 7f9a6b7fe640 1 --2- 172.21.15.55:0/1443006039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6c0cd140 0x7f9a6c163380 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009dc0 tx=0x7f9a6401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc9802d6ed683980 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:33.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.669+0000 7f9a6a7fc640 1 -- 172.21.15.55:0/1443006039 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a640af600 con 0x7f9a6c0cd140 2023-07-06T22:18:33.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.669+0000 7f9a6a7fc640 1 -- 172.21.15.55:0/1443006039 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a640ab050 con 0x7f9a6c0cd140 2023-07-06T22:18:33.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.669+0000 7f9a6a7fc640 1 -- 172.21.15.55:0/1443006039 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a640af980 con 0x7f9a6c0cd140 2023-07-06T22:18:33.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.669+0000 7f9a71911640 1 -- 172.21.15.55:0/1443006039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6c0cd140 msgr2=0x7f9a6c163380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.669+0000 7f9a71911640 1 --2- 172.21.15.55:0/1443006039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6c0cd140 0x7f9a6c163380 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009dc0 tx=0x7f9a6401f150 comp rx=0 tx=0).stop 2023-07-06T22:18:33.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.669+0000 7f9a71911640 1 -- 172.21.15.55:0/1443006039 shutdown_connections 2023-07-06T22:18:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.669+0000 7f9a71911640 1 --2- 172.21.15.55:0/1443006039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6c0cd140 0x7f9a6c163380 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.669+0000 7f9a71911640 1 -- 172.21.15.55:0/1443006039 >> 172.21.15.55:0/1443006039 conn(0x7f9a6c0cea70 msgr2=0x7f9a6c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.669+0000 7f9a71911640 1 -- 172.21.15.55:0/1443006039 shutdown_connections 2023-07-06T22:18:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.669+0000 7f9a71911640 1 -- 172.21.15.55:0/1443006039 wait complete. 2023-07-06T22:18:33.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.669+0000 7f9a71911640 1 Processor -- start 2023-07-06T22:18:33.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.669+0000 7f9a71911640 1 -- start start 2023-07-06T22:18:33.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a71911640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6c0ca130 0x7f9a6c153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:33.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a71911640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6c0cd140 0x7f9a6c1ec370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:33.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a71911640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a6c158850 0x7f9a6c06bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:33.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a71911640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c1531e0 con 0x7f9a6c0cd140 2023-07-06T22:18:33.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a71911640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c1528b0 con 0x7f9a6c158850 2023-07-06T22:18:33.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a71911640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c152b90 con 0x7f9a6c0ca130 2023-07-06T22:18:33.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a63fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6c0cd140 0x7f9a6c1ec370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:33.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a63fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6c0cd140 0x7f9a6c1ec370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43542/0 (socket says 172.21.15.55:43542) 2023-07-06T22:18:33.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a63fff640 1 -- 172.21.15.55:0/3827782286 learned_addr learned my addr 172.21.15.55:0/3827782286 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:33.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a6b7fe640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a6c158850 0x7f9a6c06bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:33.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a6affd640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6c0ca130 0x7f9a6c153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:33.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a63fff640 1 -- 172.21.15.55:0/3827782286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6c0ca130 msgr2=0x7f9a6c153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a63fff640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6c0ca130 0x7f9a6c153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a63fff640 1 -- 172.21.15.55:0/3827782286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a6c158850 msgr2=0x7f9a6c06bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a63fff640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a6c158850 0x7f9a6c06bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a63fff640 1 -- 172.21.15.55:0/3827782286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a64009a70 con 0x7f9a6c0cd140 2023-07-06T22:18:33.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a6b7fe640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a6c158850 0x7f9a6c06bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:33.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a63fff640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6c0cd140 0x7f9a6c1ec370 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400c450 tx=0x7f9a5400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:33.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a68ff9640 1 -- 172.21.15.55:0/3827782286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a54005cf0 con 0x7f9a6c0cd140 2023-07-06T22:18:33.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a71911640 1 -- 172.21.15.55:0/3827782286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6c152e70 con 0x7f9a6c0cd140 2023-07-06T22:18:33.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a68ff9640 1 -- 172.21.15.55:0/3827782286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a54005e50 con 0x7f9a6c0cd140 2023-07-06T22:18:33.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a68ff9640 1 -- 172.21.15.55:0/3827782286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a54007290 con 0x7f9a6c0cd140 2023-07-06T22:18:33.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a71911640 1 -- 172.21.15.55:0/3827782286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6c152580 con 0x7f9a6c0cd140 2023-07-06T22:18:33.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.673+0000 7f9a71911640 1 -- 172.21.15.55:0/3827782286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6c153390 con 0x7f9a6c0cd140 2023-07-06T22:18:33.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.677+0000 7f9a68ff9640 1 -- 172.21.15.55:0/3827782286 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9a540073f0 con 0x7f9a6c0cd140 2023-07-06T22:18:33.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.677+0000 7f9a68ff9640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9a4c0663a0 0x7f9a4c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:33.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.677+0000 7f9a68ff9640 1 -- 172.21.15.55:0/3827782286 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6704+0+0 (secure 0 0 0) 0x7f9a54083730 con 0x7f9a6c0cd140 2023-07-06T22:18:33.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.677+0000 7f9a6affd640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9a4c0663a0 0x7f9a4c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:33.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.677+0000 7f9a6affd640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9a4c0663a0 0x7f9a4c068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c000f70 tx=0x7f9a5c009040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:33.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.681+0000 7f9a68ff9640 1 -- 172.21.15.55:0/3827782286 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a6c153390 con 0x7f9a6c0cd140 2023-07-06T22:18:33.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.837+0000 7f9a71911640 1 -- 172.21.15.55:0/3827782286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a6c066d60 con 0x7f9a6c0cd140 2023-07-06T22:18:33.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.837+0000 7f9a68ff9640 1 -- 172.21.15.55:0/3827782286 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v170) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a54054240 con 0x7f9a6c0cd140 2023-07-06T22:18:33.841 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:18:33.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.837+0000 7f9a71911640 1 -- 172.21.15.55:0/3827782286 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9a4c0663a0 msgr2=0x7f9a4c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.837+0000 7f9a71911640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9a4c0663a0 0x7f9a4c068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c000f70 tx=0x7f9a5c009040 comp rx=0 tx=0).stop 2023-07-06T22:18:33.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.837+0000 7f9a71911640 1 -- 172.21.15.55:0/3827782286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6c0cd140 msgr2=0x7f9a6c1ec370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:33.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.837+0000 7f9a71911640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6c0cd140 0x7f9a6c1ec370 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400c450 tx=0x7f9a5400c910 comp rx=0 tx=0).stop 2023-07-06T22:18:33.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.837+0000 7f9a71911640 1 -- 172.21.15.55:0/3827782286 shutdown_connections 2023-07-06T22:18:33.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.837+0000 7f9a71911640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9a4c0663a0 0x7f9a4c068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.837+0000 7f9a71911640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a6c158850 0x7f9a6c06bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.837+0000 7f9a71911640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a6c0cd140 0x7f9a6c1ec370 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.837+0000 7f9a71911640 1 --2- 172.21.15.55:0/3827782286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9a6c0ca130 0x7f9a6c153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:33.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.837+0000 7f9a71911640 1 -- 172.21.15.55:0/3827782286 >> 172.21.15.55:0/3827782286 conn(0x7f9a6c0cea70 msgr2=0x7f9a6c0cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:33.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.837+0000 7f9a71911640 1 -- 172.21.15.55:0/3827782286 shutdown_connections 2023-07-06T22:18:33.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:33.837+0000 7f9a71911640 1 -- 172.21.15.55:0/3827782286 wait complete. 2023-07-06T22:18:33.861 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:18:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.005+0000 7f4aada34640 1 Processor -- start 2023-07-06T22:18:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.005+0000 7f4aada34640 1 -- start start 2023-07-06T22:18:34.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.005+0000 7f4aada34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4aa80cd0f0 0x7f4aa80cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.005+0000 7f4aada34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa80b3ba0 con 0x7f4aa8070450 2023-07-06T22:18:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.005+0000 7f4aada34640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa80b2880 con 0x7f4aa80c8a00 2023-07-06T22:18:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.005+0000 7f4aada34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa80c8270 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.005+0000 7f4aa6ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4aa8070450 0x7f4aa8070820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55170/0 (socket says 172.21.15.55:55170) 2023-07-06T22:18:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.005+0000 7f4aa6ffd640 1 -- 172.21.15.55:0/3972777851 learned_addr learned my addr 172.21.15.55:0/3972777851 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.005+0000 7f4aa67fc640 1 --2- 172.21.15.55:0/3972777851 >> v2:172.21.15.55:3300/0 conn(0x7f4aa80cd0f0 0x7f4aa80cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.005+0000 7f4aa67fc640 1 -- 172.21.15.55:0/3972777851 >> v1:172.21.15.138:6789/0 conn(0x7f4aa80c8a00 legacy=0x7f4aa80c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.005+0000 7f4aa67fc640 1 -- 172.21.15.55:0/3972777851 >> v1:172.21.15.55:6789/0 conn(0x7f4aa8070450 legacy=0x7f4aa8070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.005+0000 7f4aa67fc640 1 -- 172.21.15.55:0/3972777851 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa80b2ad0 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.005+0000 7f4aa5ffb640 1 -- 172.21.15.55:0/3972777851 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706142116 0 0) 0x7f4aa80b3ba0 con 0x7f4aa8070450 2023-07-06T22:18:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.009+0000 7f4aa67fc640 1 --2- 172.21.15.55:0/3972777851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4aa80cd0f0 0x7f4aa80cd540 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0097c0 tx=0x7f4a9c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50e6b273702f6d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.009+0000 7f4aa5ffb640 1 -- 172.21.15.55:0/3972777851 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c0ab610 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.009+0000 7f4aa5ffb640 1 -- 172.21.15.55:0/3972777851 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c0ab770 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.009+0000 7f4aa5ffb640 1 -- 172.21.15.55:0/3972777851 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c0abb00 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.009+0000 7f4aada34640 1 -- 172.21.15.55:0/3972777851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4aa80cd0f0 msgr2=0x7f4aa80cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.009+0000 7f4aada34640 1 --2- 172.21.15.55:0/3972777851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4aa80cd0f0 0x7f4aa80cd540 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0097c0 tx=0x7f4a9c01c410 comp rx=0 tx=0).stop 2023-07-06T22:18:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.009+0000 7f4aada34640 1 -- 172.21.15.55:0/3972777851 shutdown_connections 2023-07-06T22:18:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.009+0000 7f4aada34640 1 --2- 172.21.15.55:0/3972777851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4aa80cd0f0 0x7f4aa80cd540 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.009+0000 7f4aada34640 1 -- 172.21.15.55:0/3972777851 >> 172.21.15.55:0/3972777851 conn(0x7f4aa80ca690 msgr2=0x7f4aa80caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.009+0000 7f4aada34640 1 -- 172.21.15.55:0/3972777851 shutdown_connections 2023-07-06T22:18:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.009+0000 7f4aada34640 1 -- 172.21.15.55:0/3972777851 wait complete. 2023-07-06T22:18:34.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.009+0000 7f4aada34640 1 Processor -- start 2023-07-06T22:18:34.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aada34640 1 -- start start 2023-07-06T22:18:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aada34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4aa8070450 0x7f4aa8147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aada34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4aa80c8a00 0x7f4aa814fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aada34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4aa80cd0f0 0x7f4aa81500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aada34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80acda0 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aada34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80abd00 con 0x7f4aa80c8a00 2023-07-06T22:18:34.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aada34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80abfe0 con 0x7f4aa8070450 2023-07-06T22:18:34.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aa77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4aa80cd0f0 0x7f4aa81500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aa77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4aa80cd0f0 0x7f4aa81500c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43562/0 (socket says 172.21.15.55:43562) 2023-07-06T22:18:34.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aa77fe640 1 -- 172.21.15.55:0/1198496644 learned_addr learned my addr 172.21.15.55:0/1198496644 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:34.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aa6ffd640 1 --2- 172.21.15.55:0/1198496644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4aa8070450 0x7f4aa8147010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aa67fc640 1 --2- 172.21.15.55:0/1198496644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4aa80c8a00 0x7f4aa814fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aa77fe640 1 -- 172.21.15.55:0/1198496644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4aa8070450 msgr2=0x7f4aa8147010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aa77fe640 1 --2- 172.21.15.55:0/1198496644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4aa8070450 0x7f4aa8147010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aa77fe640 1 -- 172.21.15.55:0/1198496644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4aa80c8a00 msgr2=0x7f4aa814fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aa77fe640 1 --2- 172.21.15.55:0/1198496644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4aa80c8a00 0x7f4aa814fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aa77fe640 1 -- 172.21.15.55:0/1198496644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c009420 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aa77fe640 1 --2- 172.21.15.55:0/1198496644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4aa80cd0f0 0x7f4aa81500c0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000c780 tx=0x7f4aa000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4a8ffff640 1 -- 172.21.15.55:0/1198496644 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0004b70 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4a8ffff640 1 -- 172.21.15.55:0/1198496644 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa000ce90 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aada34640 1 -- 172.21.15.55:0/1198496644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa80ac2c0 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4a8ffff640 1 -- 172.21.15.55:0/1198496644 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa000a850 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aada34640 1 -- 172.21.15.55:0/1198496644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa80ac880 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.013+0000 7f4aada34640 1 -- 172.21.15.55:0/1198496644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa80aca70 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.017+0000 7f4a8ffff640 1 -- 172.21.15.55:0/1198496644 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4aa000a9b0 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.017+0000 7f4a8ffff640 1 --2- 172.21.15.55:0/1198496644 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4a940663a0 0x7f4a94068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.017+0000 7f4a8ffff640 1 -- 172.21.15.55:0/1198496644 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6704+0+0 (secure 0 0 0) 0x7f4aa00843e0 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.017+0000 7f4aa6ffd640 1 --2- 172.21.15.55:0/1198496644 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4a940663a0 0x7f4a94068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.017+0000 7f4aa6ffd640 1 --2- 172.21.15.55:0/1198496644 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4a940663a0 0x7f4a94068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4a98000f70 tx=0x7f4a98007c10 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:34.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.021+0000 7f4a8ffff640 1 -- 172.21.15.55:0/1198496644 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4aa0054e60 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.177+0000 7f4aada34640 1 -- 172.21.15.55:0/1198496644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4aa804d790 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.177+0000 7f4a8ffff640 1 -- 172.21.15.55:0/1198496644 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v170) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4aa00549f0 con 0x7f4aa80cd0f0 2023-07-06T22:18:34.182 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:18:34.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.181+0000 7f4aada34640 1 -- 172.21.15.55:0/1198496644 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4a940663a0 msgr2=0x7f4a94068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.181+0000 7f4aada34640 1 --2- 172.21.15.55:0/1198496644 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4a940663a0 0x7f4a94068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4a98000f70 tx=0x7f4a98007c10 comp rx=0 tx=0).stop 2023-07-06T22:18:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.181+0000 7f4aada34640 1 -- 172.21.15.55:0/1198496644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4aa80cd0f0 msgr2=0x7f4aa81500c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.181+0000 7f4aada34640 1 --2- 172.21.15.55:0/1198496644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4aa80cd0f0 0x7f4aa81500c0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000c780 tx=0x7f4aa000cc40 comp rx=0 tx=0).stop 2023-07-06T22:18:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.181+0000 7f4aada34640 1 -- 172.21.15.55:0/1198496644 shutdown_connections 2023-07-06T22:18:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.181+0000 7f4aada34640 1 --2- 172.21.15.55:0/1198496644 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4a940663a0 0x7f4a94068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.181+0000 7f4aada34640 1 --2- 172.21.15.55:0/1198496644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4aa80cd0f0 0x7f4aa81500c0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.181+0000 7f4aada34640 1 --2- 172.21.15.55:0/1198496644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4aa80c8a00 0x7f4aa814fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.181+0000 7f4aada34640 1 --2- 172.21.15.55:0/1198496644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4aa8070450 0x7f4aa8147010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.181+0000 7f4aada34640 1 -- 172.21.15.55:0/1198496644 >> 172.21.15.55:0/1198496644 conn(0x7f4aa80ca690 msgr2=0x7f4aa8070820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:34.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.181+0000 7f4aada34640 1 -- 172.21.15.55:0/1198496644 shutdown_connections 2023-07-06T22:18:34.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.181+0000 7f4aada34640 1 -- 172.21.15.55:0/1198496644 wait complete. 2023-07-06T22:18:34.203 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-06T22:18:34.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.345+0000 7f9ebe52c640 1 Processor -- start 2023-07-06T22:18:34.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.345+0000 7f9ebe52c640 1 -- start start 2023-07-06T22:18:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.345+0000 7f9ebe52c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eb80709a0 0x7f9eb80cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.345+0000 7f9ebe52c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9eb80b1340 0x7f9eb806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.345+0000 7f9ebe52c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb80cc300 con 0x7f9eb80cbe60 2023-07-06T22:18:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.345+0000 7f9ebe52c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb80cc5e0 con 0x7f9eb80b1340 2023-07-06T22:18:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.345+0000 7f9ebe52c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb80cc8c0 con 0x7f9eb80709a0 2023-07-06T22:18:34.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.345+0000 7f9eb7fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eb80709a0 0x7f9eb80cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.345+0000 7f9ebcac9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9eb80b1340 0x7f9eb806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.345+0000 7f9eb7fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eb80709a0 0x7f9eb80cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:43024/0 (socket says 172.21.15.55:43024) 2023-07-06T22:18:34.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.345+0000 7f9eb7fff640 1 -- 172.21.15.55:0/2438971233 learned_addr learned my addr 172.21.15.55:0/2438971233 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:34.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.349+0000 7f9eb7fff640 1 -- 172.21.15.55:0/2438971233 >> v2:172.21.15.138:3300/0 conn(0x7f9eb80b1340 msgr2=0x7f9eb806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:34.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.349+0000 7f9eb7fff640 1 --2- 172.21.15.55:0/2438971233 >> v2:172.21.15.138:3300/0 conn(0x7f9eb80b1340 0x7f9eb806eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.349+0000 7f9eb7fff640 1 -- 172.21.15.55:0/2438971233 >> v1:172.21.15.138:6789/0 conn(0x7f9eb80cbe60 legacy=0x7f9eb80b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.349+0000 7f9eb7fff640 1 -- 172.21.15.55:0/2438971233 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb80ccba0 con 0x7f9eb80709a0 2023-07-06T22:18:34.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.349+0000 7f9ebcac9640 1 --2- 172.21.15.55:0/2438971233 >> v2:172.21.15.138:3300/0 conn(0x7f9eb80b1340 0x7f9eb806eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.349+0000 7f9eb7fff640 1 --2- 172.21.15.55:0/2438971233 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eb80709a0 0x7f9eb80cb920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009870 tx=0x7f9ea801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74f14179c2401b77 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.349+0000 7f9eb6ffd640 1 -- 172.21.15.55:0/2438971233 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80ab650 con 0x7f9eb80709a0 2023-07-06T22:18:34.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9eb6ffd640 1 -- 172.21.15.55:0/2438971233 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea80ab7b0 con 0x7f9eb80709a0 2023-07-06T22:18:34.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9eb6ffd640 1 -- 172.21.15.55:0/2438971233 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80abb40 con 0x7f9eb80709a0 2023-07-06T22:18:34.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 -- 172.21.15.55:0/2438971233 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eb80709a0 msgr2=0x7f9eb80cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 --2- 172.21.15.55:0/2438971233 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eb80709a0 0x7f9eb80cb920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009870 tx=0x7f9ea801c540 comp rx=0 tx=0).stop 2023-07-06T22:18:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 -- 172.21.15.55:0/2438971233 shutdown_connections 2023-07-06T22:18:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 --2- 172.21.15.55:0/2438971233 >> v2:172.21.15.138:3300/0 conn(0x7f9eb80b1340 0x7f9eb806eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 --2- 172.21.15.55:0/2438971233 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eb80709a0 0x7f9eb80cb920 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 -- 172.21.15.55:0/2438971233 >> 172.21.15.55:0/2438971233 conn(0x7f9eb80cea70 msgr2=0x7f9eb80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 -- 172.21.15.55:0/2438971233 shutdown_connections 2023-07-06T22:18:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 -- 172.21.15.55:0/2438971233 wait complete. 2023-07-06T22:18:34.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 Processor -- start 2023-07-06T22:18:34.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 -- start start 2023-07-06T22:18:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eb80709a0 0x7f9eb815e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9eb80b1340 0x7f9eb815d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eb80cbe60 0x7f9eb80ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb815dd40 con 0x7f9eb80709a0 2023-07-06T22:18:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb80af190 con 0x7f9eb80b1340 2023-07-06T22:18:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebe52c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb80ae8f0 con 0x7f9eb80cbe60 2023-07-06T22:18:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9eb7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eb80709a0 0x7f9eb815e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9eb77fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9eb80b1340 0x7f9eb815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9eb7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eb80709a0 0x7f9eb815e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43568/0 (socket says 172.21.15.55:43568) 2023-07-06T22:18:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9eb7fff640 1 -- 172.21.15.55:0/99096071 learned_addr learned my addr 172.21.15.55:0/99096071 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.353+0000 7f9ebcac9640 1 --2- 172.21.15.55:0/99096071 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eb80cbe60 0x7f9eb80ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.357+0000 7f9eb77fe640 1 -- 172.21.15.55:0/99096071 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eb80cbe60 msgr2=0x7f9eb80ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.357+0000 7f9eb77fe640 1 --2- 172.21.15.55:0/99096071 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eb80cbe60 0x7f9eb80ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.357+0000 7f9eb77fe640 1 -- 172.21.15.55:0/99096071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eb80709a0 msgr2=0x7f9eb815e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.357+0000 7f9eb77fe640 1 --2- 172.21.15.55:0/99096071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eb80709a0 0x7f9eb815e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.357+0000 7f9eb77fe640 1 -- 172.21.15.55:0/99096071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb0009a70 con 0x7f9eb80b1340 2023-07-06T22:18:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.357+0000 7f9eb7fff640 1 --2- 172.21.15.55:0/99096071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eb80709a0 0x7f9eb815e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.357+0000 7f9eb77fe640 1 --2- 172.21.15.55:0/99096071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9eb80b1340 0x7f9eb815d800 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9eac000f70 tx=0x7f9eac00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.357+0000 7f9eb4ff9640 1 -- 172.21.15.55:0/99096071 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac0052d0 con 0x7f9eb80b1340 2023-07-06T22:18:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.357+0000 7f9eb4ff9640 1 -- 172.21.15.55:0/99096071 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eac005430 con 0x7f9eb80b1340 2023-07-06T22:18:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.357+0000 7f9eb4ff9640 1 -- 172.21.15.55:0/99096071 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac003840 con 0x7f9eb80b1340 2023-07-06T22:18:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.357+0000 7f9ebe52c640 1 -- 172.21.15.55:0/99096071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea80094d0 con 0x7f9eb80b1340 2023-07-06T22:18:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.357+0000 7f9ebe52c640 1 -- 172.21.15.55:0/99096071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb80aeeb0 con 0x7f9eb80b1340 2023-07-06T22:18:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.357+0000 7f9ebe52c640 1 -- 172.21.15.55:0/99096071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb8066d60 con 0x7f9eb80b1340 2023-07-06T22:18:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.357+0000 7f9eb4ff9640 1 -- 172.21.15.55:0/99096071 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9eac0039a0 con 0x7f9eb80b1340 2023-07-06T22:18:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.361+0000 7f9eb4ff9640 1 --2- 172.21.15.55:0/99096071 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9ea40663a0 0x7f9ea4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.361+0000 7f9eb4ff9640 1 -- 172.21.15.55:0/99096071 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6704+0+0 (secure 0 0 0) 0x7f9eac0836b0 con 0x7f9eb80b1340 2023-07-06T22:18:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.361+0000 7f9eb7fff640 1 --2- 172.21.15.55:0/99096071 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9ea40663a0 0x7f9ea4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.361+0000 7f9eb7fff640 1 --2- 172.21.15.55:0/99096071 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9ea40663a0 0x7f9ea4068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ea801c580 tx=0x7f9ea80b6040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:34.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.361+0000 7f9eb4ff9640 1 -- 172.21.15.55:0/99096071 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9eac0508e0 con 0x7f9eb80b1340 2023-07-06T22:18:34.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.517+0000 7f9ebe52c640 1 -- 172.21.15.55:0/99096071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9eb8069480 con 0x7f9eb80b1340 2023-07-06T22:18:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.529+0000 7f9eb4ff9640 1 -- 172.21.15.55:0/99096071 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9eac053f00 con 0x7f9eb80b1340 2023-07-06T22:18:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.529+0000 7f9ebe52c640 1 -- 172.21.15.55:0/99096071 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9ea40663a0 msgr2=0x7f9ea4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.529+0000 7f9ebe52c640 1 --2- 172.21.15.55:0/99096071 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9ea40663a0 0x7f9ea4068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ea801c580 tx=0x7f9ea80b6040 comp rx=0 tx=0).stop 2023-07-06T22:18:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.529+0000 7f9ebe52c640 1 -- 172.21.15.55:0/99096071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9eb80b1340 msgr2=0x7f9eb815d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.529+0000 7f9ebe52c640 1 --2- 172.21.15.55:0/99096071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9eb80b1340 0x7f9eb815d800 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9eac000f70 tx=0x7f9eac00c760 comp rx=0 tx=0).stop 2023-07-06T22:18:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.529+0000 7f9ebe52c640 1 -- 172.21.15.55:0/99096071 shutdown_connections 2023-07-06T22:18:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.529+0000 7f9ebe52c640 1 --2- 172.21.15.55:0/99096071 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9ea40663a0 0x7f9ea4068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.529+0000 7f9ebe52c640 1 --2- 172.21.15.55:0/99096071 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eb80cbe60 0x7f9eb80ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.529+0000 7f9ebe52c640 1 --2- 172.21.15.55:0/99096071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9eb80b1340 0x7f9eb815d800 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.529+0000 7f9ebe52c640 1 --2- 172.21.15.55:0/99096071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eb80709a0 0x7f9eb815e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.529+0000 7f9ebe52c640 1 -- 172.21.15.55:0/99096071 >> 172.21.15.55:0/99096071 conn(0x7f9eb80cea70 msgr2=0x7f9eb80b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.533+0000 7f9ebe52c640 1 -- 172.21.15.55:0/99096071 shutdown_connections 2023-07-06T22:18:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.533+0000 7f9ebe52c640 1 -- 172.21.15.55:0/99096071 wait complete. 2023-07-06T22:18:34.555 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T22:18:34.555 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:18:34.618 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:18:34.682 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T22:18:34.682 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:18:34.683 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:18:34.691 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:18:34.692 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:18:34.692 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:18:34.701 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:18:34.702 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:18:34.702 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:18:34.747 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:18:34.748 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:18:34.748 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:18:34.758 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:18:34.758 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-06T22:18:34.759 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:18:34.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9c06103640 1 Processor -- start 2023-07-06T22:18:34.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9c06103640 1 -- start start 2023-07-06T22:18:34.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9c06103640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9c00158400 0x7f9c000c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9c06103640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9c000c9680 0x7f9c00070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9c06103640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c000710c0 0x7f9c000cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9c06103640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0006fae0 con 0x7f9c000c9680 2023-07-06T22:18:34.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9c06103640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0006fdc0 con 0x7f9c00158400 2023-07-06T22:18:34.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9c06103640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000700a0 con 0x7f9c000710c0 2023-07-06T22:18:34.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9bfeffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9c000c9680 0x7f9c00070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9bfeffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9c000c9680 0x7f9c00070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43572/0 (socket says 172.21.15.55:43572) 2023-07-06T22:18:34.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9bfeffd640 1 -- 172.21.15.55:0/4010256085 learned_addr learned my addr 172.21.15.55:0/4010256085 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:34.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9bfffff640 1 --2- 172.21.15.55:0/4010256085 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c000710c0 0x7f9c000cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9bff7fe640 1 --2- 172.21.15.55:0/4010256085 >> v2:172.21.15.138:3300/0 conn(0x7f9c00158400 0x7f9c000c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9bfeffd640 1 -- 172.21.15.55:0/4010256085 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c000710c0 msgr2=0x7f9c000cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:34.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9bfeffd640 1 --2- 172.21.15.55:0/4010256085 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c000710c0 0x7f9c000cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9bfeffd640 1 -- 172.21.15.55:0/4010256085 >> v2:172.21.15.138:3300/0 conn(0x7f9c00158400 msgr2=0x7f9c000c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:34.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9bfeffd640 1 --2- 172.21.15.55:0/4010256085 >> v2:172.21.15.138:3300/0 conn(0x7f9c00158400 0x7f9c000c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.933+0000 7f9bfeffd640 1 -- 172.21.15.55:0/4010256085 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c00070380 con 0x7f9c000c9680 2023-07-06T22:18:34.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.937+0000 7f9bfeffd640 1 --2- 172.21.15.55:0/4010256085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c000c9680 0x7f9c00070b80 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f9c0006ed50 tx=0x7f9bf401e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbe3dea06ad4780 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:34.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.937+0000 7f9bfe7fc640 1 -- 172.21.15.55:0/4010256085 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40a8690 con 0x7f9c000c9680 2023-07-06T22:18:34.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.937+0000 7f9bfe7fc640 1 -- 172.21.15.55:0/4010256085 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf40a87f0 con 0x7f9c000c9680 2023-07-06T22:18:34.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.937+0000 7f9bfe7fc640 1 -- 172.21.15.55:0/4010256085 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40a8b80 con 0x7f9c000c9680 2023-07-06T22:18:34.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.937+0000 7f9c06103640 1 -- 172.21.15.55:0/4010256085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c000c9680 msgr2=0x7f9c00070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.937+0000 7f9c06103640 1 --2- 172.21.15.55:0/4010256085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c000c9680 0x7f9c00070b80 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f9c0006ed50 tx=0x7f9bf401e6e0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.937+0000 7f9c06103640 1 -- 172.21.15.55:0/4010256085 shutdown_connections 2023-07-06T22:18:34.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.937+0000 7f9c06103640 1 --2- 172.21.15.55:0/4010256085 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c000710c0 0x7f9c000cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.937+0000 7f9c06103640 1 --2- 172.21.15.55:0/4010256085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c000c9680 0x7f9c00070b80 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.937+0000 7f9c06103640 1 --2- 172.21.15.55:0/4010256085 >> v2:172.21.15.138:3300/0 conn(0x7f9c00158400 0x7f9c000c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.937+0000 7f9c06103640 1 -- 172.21.15.55:0/4010256085 >> 172.21.15.55:0/4010256085 conn(0x7f9c000cded0 msgr2=0x7f9c000ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:34.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.937+0000 7f9c06103640 1 -- 172.21.15.55:0/4010256085 shutdown_connections 2023-07-06T22:18:34.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.937+0000 7f9c06103640 1 -- 172.21.15.55:0/4010256085 wait complete. 2023-07-06T22:18:34.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9c06103640 1 Processor -- start 2023-07-06T22:18:34.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9c06103640 1 -- start start 2023-07-06T22:18:34.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9c06103640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c000710c0 0x7f9c0013f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9c06103640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c000c9680 0x7f9c001f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9c06103640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c00158400 0x7f9c000b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9c06103640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c001f4f70 con 0x7f9c000c9680 2023-07-06T22:18:34.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9c06103640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000b3b50 con 0x7f9c00158400 2023-07-06T22:18:34.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9c06103640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000b2ab0 con 0x7f9c000710c0 2023-07-06T22:18:34.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9bfeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c000c9680 0x7f9c001f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9bfeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c000c9680 0x7f9c001f4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43578/0 (socket says 172.21.15.55:43578) 2023-07-06T22:18:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9bfeffd640 1 -- 172.21.15.55:0/217609680 learned_addr learned my addr 172.21.15.55:0/217609680 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9bff7fe640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c000710c0 0x7f9c0013f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9bfffff640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c00158400 0x7f9c000b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9bfeffd640 1 -- 172.21.15.55:0/217609680 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c000710c0 msgr2=0x7f9c0013f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9bfeffd640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c000710c0 0x7f9c0013f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9bfeffd640 1 -- 172.21.15.55:0/217609680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c00158400 msgr2=0x7f9c000b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9bfeffd640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c00158400 0x7f9c000b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9bfeffd640 1 -- 172.21.15.55:0/217609680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40094d0 con 0x7f9c000c9680 2023-07-06T22:18:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9bfffff640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c00158400 0x7f9c000b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9bff7fe640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c000710c0 0x7f9c0013f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9bfeffd640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c000c9680 0x7f9c001f4a30 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f9bf401cd90 tx=0x7f9bf401b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9be7fff640 1 -- 172.21.15.55:0/217609680 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40a9880 con 0x7f9c000c9680 2023-07-06T22:18:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9be7fff640 1 -- 172.21.15.55:0/217609680 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf40a99e0 con 0x7f9c000c9680 2023-07-06T22:18:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9be7fff640 1 -- 172.21.15.55:0/217609680 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40a9d50 con 0x7f9c000c9680 2023-07-06T22:18:34.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.941+0000 7f9c06103640 1 -- 172.21.15.55:0/217609680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c000b2d90 con 0x7f9c000c9680 2023-07-06T22:18:34.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.945+0000 7f9c06103640 1 -- 172.21.15.55:0/217609680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c000b3350 con 0x7f9c000c9680 2023-07-06T22:18:34.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.945+0000 7f9c06103640 1 -- 172.21.15.55:0/217609680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0006c580 con 0x7f9c000c9680 2023-07-06T22:18:34.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.945+0000 7f9be7fff640 1 -- 172.21.15.55:0/217609680 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9bf40b3450 con 0x7f9c000c9680 2023-07-06T22:18:34.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.945+0000 7f9be7fff640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9bec0663a0 0x7f9bec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:34.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.945+0000 7f9be7fff640 1 -- 172.21.15.55:0/217609680 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6704+0+0 (secure 0 0 0) 0x7f9bf411e870 con 0x7f9c000c9680 2023-07-06T22:18:34.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.945+0000 7f9bff7fe640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9bec0663a0 0x7f9bec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:34.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.945+0000 7f9bff7fe640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9bec0663a0 0x7f9bec068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000b9f0 tx=0x7f9bf0008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:34.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:34.949+0000 7f9be7fff640 1 -- 172.21.15.55:0/217609680 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9bf40eb8e0 con 0x7f9c000c9680 2023-07-06T22:18:35.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.137+0000 7f9c06103640 1 -- 172.21.15.55:0/217609680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c00066d60 con 0x7f9c000c9680 2023-07-06T22:18:35.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.137+0000 7f9be7fff640 1 -- 172.21.15.55:0/217609680 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+3536 (secure 0 0 0) 0x7f9bf40aede0 con 0x7f9c000c9680 2023-07-06T22:18:35.141 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:35.141 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":73,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7958,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2209436909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2209436909},{"type":"v1","addr":"172.21.15.55:6837","nonce":2209436909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1799743845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":1799743845},{"type":"v1","addr":"172.21.15.138:6835","nonce":1799743845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8992,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/3922834764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3922834764},{"type":"v1","addr":"172.21.15.138:6834","nonce":3922834764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":10338,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/1912421165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1912421165},{"type":"v1","addr":"172.21.15.55:6836","nonce":1912421165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[]} 2023-07-06T22:18:35.142 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 73 2023-07-06T22:18:35.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.137+0000 7f9c06103640 1 -- 172.21.15.55:0/217609680 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9bec0663a0 msgr2=0x7f9bec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:35.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.137+0000 7f9c06103640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9bec0663a0 0x7f9bec068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000b9f0 tx=0x7f9bf0008040 comp rx=0 tx=0).stop 2023-07-06T22:18:35.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.137+0000 7f9c06103640 1 -- 172.21.15.55:0/217609680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c000c9680 msgr2=0x7f9c001f4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:35.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.137+0000 7f9c06103640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c000c9680 0x7f9c001f4a30 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f9bf401cd90 tx=0x7f9bf401b480 comp rx=0 tx=0).stop 2023-07-06T22:18:35.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.137+0000 7f9c06103640 1 -- 172.21.15.55:0/217609680 shutdown_connections 2023-07-06T22:18:35.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.137+0000 7f9c06103640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9bec0663a0 0x7f9bec068850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:35.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.137+0000 7f9c06103640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c00158400 0x7f9c000b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:35.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.137+0000 7f9c06103640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c000c9680 0x7f9c001f4a30 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:35.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.137+0000 7f9c06103640 1 --2- 172.21.15.55:0/217609680 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c000710c0 0x7f9c0013f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:35.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.137+0000 7f9c06103640 1 -- 172.21.15.55:0/217609680 >> 172.21.15.55:0/217609680 conn(0x7f9c000cded0 msgr2=0x7f9c00065190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:35.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.137+0000 7f9c06103640 1 -- 172.21.15.55:0/217609680 shutdown_connections 2023-07-06T22:18:35.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.137+0000 7f9c06103640 1 -- 172.21.15.55:0/217609680 wait complete. 2023-07-06T22:18:35.163 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T22:18:35.163 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-06T22:18:35.164 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T22:18:35.164 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:18:35.164 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T22:18:35.164 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-06T22:18:35.164 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T22:18:35.165 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:18:35.165 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T22:18:35.165 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-06T22:18:35.165 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T22:18:35.166 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:18:35.166 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T22:18:35.166 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-06T22:18:35.166 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T22:18:35.166 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:18:35.175 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T22:18:35.175 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T22:18:35.176 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T22:18:35.177 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T22:18:35.184 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T22:18:35.184 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T22:18:35.185 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T22:18:35.185 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T22:18:35.222 INFO:tasks.ceph.mds.a:Started 2023-07-06T22:18:35.222 DEBUG:teuthology.parallel:result is None 2023-07-06T22:18:35.224 INFO:tasks.ceph.mds.c:Started 2023-07-06T22:18:35.225 DEBUG:teuthology.parallel:result is None 2023-07-06T22:18:35.234 INFO:tasks.ceph.mds.d:Started 2023-07-06T22:18:35.234 DEBUG:teuthology.parallel:result is None 2023-07-06T22:18:35.236 INFO:tasks.ceph.mds.b:Started 2023-07-06T22:18:35.236 DEBUG:teuthology.parallel:result is None 2023-07-06T22:18:35.237 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-06T22:18:35.310 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-07-06T22:18:35.312 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T22:18:35.329 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-07-06T22:18:35.330 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-07-06T22:18:35.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.389+0000 7f28d8782640 1 Processor -- start 2023-07-06T22:18:35.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.389+0000 7f28d8782640 1 -- start start 2023-07-06T22:18:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.393+0000 7f28d8782640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f28d0158850 0x7f28d00cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.393+0000 7f28d8782640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28d00ca130 0x7f28d00ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.393+0000 7f28d8782640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d00b2aa0 con 0x7f28d00703e0 2023-07-06T22:18:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.393+0000 7f28d8782640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d0158c20 con 0x7f28d00ca130 2023-07-06T22:18:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.393+0000 7f28d8782640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d00c8db0 con 0x7f28d0158850 2023-07-06T22:18:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.393+0000 7f28d5d1d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28d00ca130 0x7f28d00ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.393+0000 7f28d5d1d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28d00ca130 0x7f28d00ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43602/0 (socket says 172.21.15.55:43602) 2023-07-06T22:18:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.393+0000 7f28d5d1d640 1 -- 172.21.15.55:0/1923855795 learned_addr learned my addr 172.21.15.55:0/1923855795 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.393+0000 7f28d651e640 1 --2- 172.21.15.55:0/1923855795 >> v2:172.21.15.138:3300/0 conn(0x7f28d0158850 0x7f28d00cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.393+0000 7f28d5d1d640 1 -- 172.21.15.55:0/1923855795 >> v2:172.21.15.138:3300/0 conn(0x7f28d0158850 msgr2=0x7f28d00cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:35.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.393+0000 7f28d5d1d640 1 --2- 172.21.15.55:0/1923855795 >> v2:172.21.15.138:3300/0 conn(0x7f28d0158850 0x7f28d00cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:35.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.393+0000 7f28d5d1d640 1 -- 172.21.15.55:0/1923855795 >> v1:172.21.15.55:6789/0 conn(0x7f28d00703e0 legacy=0x7f28d006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:35.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.393+0000 7f28d5d1d640 1 -- 172.21.15.55:0/1923855795 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d00c9090 con 0x7f28d00ca130 2023-07-06T22:18:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.397+0000 7f28d5d1d640 1 --2- 172.21.15.55:0/1923855795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d00ca130 0x7f28d00ccf70 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f28d006eaf0 tx=0x7f28c001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d3a8b99e860a29 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.397+0000 7f28d551c640 1 -- 172.21.15.55:0/1923855795 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00aa430 con 0x7f28d00ca130 2023-07-06T22:18:35.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.397+0000 7f28d551c640 1 -- 172.21.15.55:0/1923855795 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c00aa590 con 0x7f28d00ca130 2023-07-06T22:18:35.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.397+0000 7f28d551c640 1 -- 172.21.15.55:0/1923855795 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00aa920 con 0x7f28d00ca130 2023-07-06T22:18:35.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.397+0000 7f28d8782640 1 -- 172.21.15.55:0/1923855795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d00ca130 msgr2=0x7f28d00ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:35.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.397+0000 7f28d8782640 1 --2- 172.21.15.55:0/1923855795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d00ca130 0x7f28d00ccf70 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f28d006eaf0 tx=0x7f28c001c4d0 comp rx=0 tx=0).stop 2023-07-06T22:18:35.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.397+0000 7f28d8782640 1 -- 172.21.15.55:0/1923855795 shutdown_connections 2023-07-06T22:18:35.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.397+0000 7f28d8782640 1 --2- 172.21.15.55:0/1923855795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d00ca130 0x7f28d00ccf70 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:35.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.397+0000 7f28d8782640 1 --2- 172.21.15.55:0/1923855795 >> v2:172.21.15.138:3300/0 conn(0x7f28d0158850 0x7f28d00cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:35.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.397+0000 7f28d8782640 1 -- 172.21.15.55:0/1923855795 >> 172.21.15.55:0/1923855795 conn(0x7f28d00cea70 msgr2=0x7f28d00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:35.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.397+0000 7f28d8782640 1 -- 172.21.15.55:0/1923855795 shutdown_connections 2023-07-06T22:18:35.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.397+0000 7f28d8782640 1 -- 172.21.15.55:0/1923855795 wait complete. 2023-07-06T22:18:35.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.397+0000 7f28d8782640 1 Processor -- start 2023-07-06T22:18:35.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.397+0000 7f28d8782640 1 -- start start 2023-07-06T22:18:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d8782640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28d00703e0 0x7f28d006b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d8782640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28d00ca130 0x7f28d00cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d8782640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0158850 0x7f28d00c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d8782640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d006ad20 con 0x7f28d0158850 2023-07-06T22:18:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d8782640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d0158320 con 0x7f28d00ca130 2023-07-06T22:18:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d8782640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d006a380 con 0x7f28d00703e0 2023-07-06T22:18:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d6d1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0158850 0x7f28d00c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d6d1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0158850 0x7f28d00c30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43614/0 (socket says 172.21.15.55:43614) 2023-07-06T22:18:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d6d1f640 1 -- 172.21.15.55:0/2800586828 learned_addr learned my addr 172.21.15.55:0/2800586828 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d651e640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28d00703e0 0x7f28d006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d5d1d640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28d00ca130 0x7f28d00cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d6d1f640 1 -- 172.21.15.55:0/2800586828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28d00703e0 msgr2=0x7f28d006b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d6d1f640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28d00703e0 0x7f28d006b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d6d1f640 1 -- 172.21.15.55:0/2800586828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28d00ca130 msgr2=0x7f28d00cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d6d1f640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28d00ca130 0x7f28d00cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d6d1f640 1 -- 172.21.15.55:0/2800586828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c00094d0 con 0x7f28d0158850 2023-07-06T22:18:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d651e640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28d00703e0 0x7f28d006b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d6d1f640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0158850 0x7f28d00c30d0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f28c800c770 tx=0x7f28c800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28c6ffd640 1 -- 172.21.15.55:0/2800586828 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8003b80 con 0x7f28d0158850 2023-07-06T22:18:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28c6ffd640 1 -- 172.21.15.55:0/2800586828 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c8003ce0 con 0x7f28d0158850 2023-07-06T22:18:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d8782640 1 -- 172.21.15.55:0/2800586828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d006a660 con 0x7f28d0158850 2023-07-06T22:18:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28c6ffd640 1 -- 172.21.15.55:0/2800586828 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c800aa90 con 0x7f28d0158850 2023-07-06T22:18:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d8782640 1 -- 172.21.15.55:0/2800586828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d006b680 con 0x7f28d0158850 2023-07-06T22:18:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28d8782640 1 -- 172.21.15.55:0/2800586828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d006ae60 con 0x7f28d0158850 2023-07-06T22:18:35.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.401+0000 7f28c6ffd640 1 -- 172.21.15.55:0/2800586828 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f28c800abf0 con 0x7f28d0158850 2023-07-06T22:18:35.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.405+0000 7f28c6ffd640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f28b40663a0 0x7f28b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:35.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.405+0000 7f28c6ffd640 1 -- 172.21.15.55:0/2800586828 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6676+0+0 (secure 0 0 0) 0x7f28c8083fd0 con 0x7f28d0158850 2023-07-06T22:18:35.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.405+0000 7f28d651e640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f28b40663a0 0x7f28b4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:35.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.405+0000 7f28d651e640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f28b40663a0 0x7f28b4068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009b10 tx=0x7f28cc008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:35.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.409+0000 7f28c6ffd640 1 -- 172.21.15.55:0/2800586828 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28c80b4700 con 0x7f28d0158850 2023-07-06T22:18:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:35.577+0000 7f28d8782640 1 -- 172.21.15.55:0/2800586828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f28d0066d60 con 0x7f28d0158850 2023-07-06T22:18:36.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.361+0000 7f28c6ffd640 1 -- 172.21.15.55:0/2800586828 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v175) v1 ==== 97+0+0 (secure 0 0 0) 0x7f28d006ae60 con 0x7f28d0158850 2023-07-06T22:18:36.368 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-07-06T22:18:36.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.365+0000 7f28d8782640 1 -- 172.21.15.55:0/2800586828 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f28b40663a0 msgr2=0x7f28b4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:36.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.365+0000 7f28d8782640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f28b40663a0 0x7f28b4068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009b10 tx=0x7f28cc008040 comp rx=0 tx=0).stop 2023-07-06T22:18:36.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.365+0000 7f28d8782640 1 -- 172.21.15.55:0/2800586828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0158850 msgr2=0x7f28d00c30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:36.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.365+0000 7f28d8782640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0158850 0x7f28d00c30d0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f28c800c770 tx=0x7f28c800cc30 comp rx=0 tx=0).stop 2023-07-06T22:18:36.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.365+0000 7f28d8782640 1 -- 172.21.15.55:0/2800586828 shutdown_connections 2023-07-06T22:18:36.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.365+0000 7f28d8782640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f28b40663a0 0x7f28b4068850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.365+0000 7f28d8782640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0158850 0x7f28d00c30d0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.365+0000 7f28d8782640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28d00ca130 0x7f28d00cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.365+0000 7f28d8782640 1 --2- 172.21.15.55:0/2800586828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f28d00703e0 0x7f28d006b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.365+0000 7f28d8782640 1 -- 172.21.15.55:0/2800586828 >> 172.21.15.55:0/2800586828 conn(0x7f28d00cea70 msgr2=0x7f28d00c4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:36.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.365+0000 7f28d8782640 1 -- 172.21.15.55:0/2800586828 shutdown_connections 2023-07-06T22:18:36.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.365+0000 7f28d8782640 1 -- 172.21.15.55:0/2800586828 wait complete. 2023-07-06T22:18:36.391 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-06T22:18:36.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e40448640 1 Processor -- start 2023-07-06T22:18:36.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e40448640 1 -- start start 2023-07-06T22:18:36.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e40448640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e3815f740 0x7f9e3815cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:36.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e40448640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e380cbc70 0x7f9e380cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:36.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e40448640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e380b5b50 con 0x7f9e380cb4a0 2023-07-06T22:18:36.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e40448640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3815d130 con 0x7f9e3815f740 2023-07-06T22:18:36.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e40448640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380cc5e0 con 0x7f9e380cbc70 2023-07-06T22:18:36.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e3d9e3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e3815f740 0x7f9e3815cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:36.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e3e1e4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9e380cb4a0 0x7f9e380ca720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55206/0 (socket says 172.21.15.55:55206) 2023-07-06T22:18:36.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e3d9e3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e3815f740 0x7f9e3815cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43626/0 (socket says 172.21.15.55:43626) 2023-07-06T22:18:36.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e3e1e4640 1 -- 172.21.15.55:0/130996321 learned_addr learned my addr 172.21.15.55:0/130996321 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:36.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e3e9e5640 1 --2- 172.21.15.55:0/130996321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e380cbc70 0x7f9e380cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:36.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e3d1e2640 1 -- 172.21.15.55:0/130996321 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673203422 0 0) 0x7f9e380b5b50 con 0x7f9e380cb4a0 2023-07-06T22:18:36.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e3d9e3640 1 -- 172.21.15.55:0/130996321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e380cbc70 msgr2=0x7f9e380cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:36.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e3d9e3640 1 --2- 172.21.15.55:0/130996321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e380cbc70 0x7f9e380cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e3d9e3640 1 -- 172.21.15.55:0/130996321 >> v1:172.21.15.55:6789/0 conn(0x7f9e380cb4a0 legacy=0x7f9e380ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:36.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.533+0000 7f9e3d9e3640 1 -- 172.21.15.55:0/130996321 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e380cc8e0 con 0x7f9e3815f740 2023-07-06T22:18:36.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.537+0000 7f9e3d9e3640 1 --2- 172.21.15.55:0/130996321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e3815f740 0x7f9e3815cbf0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f9e280097c0 tx=0x7f9e2801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108504c057e233be server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:36.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.537+0000 7f9e3d1e2640 1 -- 172.21.15.55:0/130996321 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e280ab600 con 0x7f9e3815f740 2023-07-06T22:18:36.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.537+0000 7f9e3d1e2640 1 -- 172.21.15.55:0/130996321 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e280a7050 con 0x7f9e3815f740 2023-07-06T22:18:36.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.537+0000 7f9e3d1e2640 1 -- 172.21.15.55:0/130996321 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e280ab980 con 0x7f9e3815f740 2023-07-06T22:18:36.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.537+0000 7f9e40448640 1 -- 172.21.15.55:0/130996321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e3815f740 msgr2=0x7f9e3815cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:36.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.537+0000 7f9e40448640 1 --2- 172.21.15.55:0/130996321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e3815f740 0x7f9e3815cbf0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f9e280097c0 tx=0x7f9e2801c480 comp rx=0 tx=0).stop 2023-07-06T22:18:36.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.537+0000 7f9e40448640 1 -- 172.21.15.55:0/130996321 shutdown_connections 2023-07-06T22:18:36.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.537+0000 7f9e40448640 1 --2- 172.21.15.55:0/130996321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e380cbc70 0x7f9e380cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.537+0000 7f9e40448640 1 --2- 172.21.15.55:0/130996321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e3815f740 0x7f9e3815cbf0 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.537+0000 7f9e40448640 1 -- 172.21.15.55:0/130996321 >> 172.21.15.55:0/130996321 conn(0x7f9e3806ee80 msgr2=0x7f9e3806f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:36.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.537+0000 7f9e40448640 1 -- 172.21.15.55:0/130996321 shutdown_connections 2023-07-06T22:18:36.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.537+0000 7f9e40448640 1 -- 172.21.15.55:0/130996321 wait complete. 2023-07-06T22:18:36.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e40448640 1 Processor -- start 2023-07-06T22:18:36.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e40448640 1 -- start start 2023-07-06T22:18:36.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e40448640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e380cb4a0 0x7f9e381506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:36.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e40448640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e380cbc70 0x7f9e38154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:36.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e40448640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e3815f740 0x7f9e381523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:36.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e40448640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e381530c0 con 0x7f9e380cb4a0 2023-07-06T22:18:36.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e40448640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e381533a0 con 0x7f9e380cbc70 2023-07-06T22:18:36.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e40448640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38153680 con 0x7f9e3815f740 2023-07-06T22:18:36.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e3e1e4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e380cb4a0 0x7f9e381506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:36.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e3e1e4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e380cb4a0 0x7f9e381506f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43636/0 (socket says 172.21.15.55:43636) 2023-07-06T22:18:36.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e3e1e4640 1 -- 172.21.15.55:0/3869630382 learned_addr learned my addr 172.21.15.55:0/3869630382 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:36.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e3d9e3640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e380cbc70 0x7f9e38154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:36.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e3e1e4640 1 -- 172.21.15.55:0/3869630382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e3815f740 msgr2=0x7f9e381523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:36.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e3e9e5640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e3815f740 0x7f9e381523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:36.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e3e1e4640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e3815f740 0x7f9e381523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e3e1e4640 1 -- 172.21.15.55:0/3869630382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e380cbc70 msgr2=0x7f9e38154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:36.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e3e1e4640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e380cbc70 0x7f9e38154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e3e1e4640 1 -- 172.21.15.55:0/3869630382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e28009420 con 0x7f9e380cb4a0 2023-07-06T22:18:36.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e3d9e3640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e380cbc70 0x7f9e38154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:18:36.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e3e9e5640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e3815f740 0x7f9e381523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:18:36.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e3e1e4640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e380cb4a0 0x7f9e381506f0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f9e340011f0 tx=0x7f9e3400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:36.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e2effd640 1 -- 172.21.15.55:0/3869630382 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e340074e0 con 0x7f9e380cb4a0 2023-07-06T22:18:36.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e2effd640 1 -- 172.21.15.55:0/3869630382 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e34007640 con 0x7f9e380cb4a0 2023-07-06T22:18:36.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e40448640 1 -- 172.21.15.55:0/3869630382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e38153960 con 0x7f9e380cb4a0 2023-07-06T22:18:36.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e2effd640 1 -- 172.21.15.55:0/3869630382 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34004a10 con 0x7f9e380cb4a0 2023-07-06T22:18:36.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.541+0000 7f9e40448640 1 -- 172.21.15.55:0/3869630382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e38150c30 con 0x7f9e380cb4a0 2023-07-06T22:18:36.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.545+0000 7f9e40448640 1 -- 172.21.15.55:0/3869630382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e38066d60 con 0x7f9e380cb4a0 2023-07-06T22:18:36.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.545+0000 7f9e2effd640 1 -- 172.21.15.55:0/3869630382 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9e34004b70 con 0x7f9e380cb4a0 2023-07-06T22:18:36.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.545+0000 7f9e2effd640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9e1c0663a0 0x7f9e1c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:36.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.545+0000 7f9e2effd640 1 -- 172.21.15.55:0/3869630382 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f9e34083290 con 0x7f9e380cb4a0 2023-07-06T22:18:36.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.545+0000 7f9e3d9e3640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9e1c0663a0 0x7f9e1c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:36.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.545+0000 7f9e3d9e3640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9e1c0663a0 0x7f9e1c068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e280ad000 tx=0x7f9e28008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:36.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.549+0000 7f9e2effd640 1 -- 172.21.15.55:0/3869630382 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e34050750 con 0x7f9e380cb4a0 2023-07-06T22:18:36.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.761+0000 7f9e40448640 1 -- 172.21.15.55:0/3869630382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9e381604a0 con 0x7f9e380cb4a0 2023-07-06T22:18:36.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.761+0000 7f9e2effd640 1 -- 172.21.15.55:0/3869630382 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9e34053d70 con 0x7f9e380cb4a0 2023-07-06T22:18:36.767 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:36.767 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:18:36.767 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-07-06T22:18:36.767 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.767 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-07-06T22:18:36.768 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkWjb1JxAAMmLy+dPO5qyorBnuzazx6A==", 2023-07-06T22:18:36.768 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.768 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:18:36.768 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:18:36.768 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:18:36.768 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.768 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-07-06T22:18:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkpLLENBAAxMASh3qbELQMJ3XbPEX0Zw==", 2023-07-06T22:18:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:18:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:18:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:18:36.770 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.770 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.770 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.770 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.770 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-07-06T22:18:36.770 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkvOSfLxAAMEoqAPg1pb47e5a1G1QtAw==", 2023-07-06T22:18:36.770 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.770 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:18:36.771 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:18:36.771 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:18:36.771 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.771 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.771 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.771 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.771 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-07-06T22:18:36.772 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkeQIBARAApXT5zWLUqqMSdwYygZeatw==", 2023-07-06T22:18:36.772 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.772 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:18:36.772 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:18:36.772 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:18:36.772 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.772 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.772 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.773 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.773 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-07-06T22:18:36.773 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD5NKdkSIfzJxAAlXiG8PWFXQqIeugbdp7Eiw==", 2023-07-06T22:18:36.773 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.773 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:18:36.773 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:18:36.773 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.774 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.774 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.774 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.774 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-07-06T22:18:36.774 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD8NKdkv2iwLxAAxjFucMwaaH66wPQpoYSTGw==", 2023-07-06T22:18:36.774 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.774 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:18:36.774 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:18:36.775 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.775 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.775 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.775 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.775 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-07-06T22:18:36.775 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD/NKdk5w7XOBAAuiup4mcC02ZMCPHCU1Cl3A==", 2023-07-06T22:18:36.775 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.775 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:18:36.776 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:18:36.776 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.776 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.776 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.776 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.776 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-07-06T22:18:36.776 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQADNadksvRLBBAAE1YX9VgA8pWARIEZL8tbsQ==", 2023-07-06T22:18:36.777 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.777 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:18:36.777 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:18:36.777 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.777 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.777 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.777 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.777 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-07-06T22:18:36.778 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAJNadkn2HsChAAgwb7B9lHOMq2h0BNuhB/AQ==", 2023-07-06T22:18:36.778 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.778 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:18:36.778 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:18:36.778 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.778 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.778 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.778 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.779 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-07-06T22:18:36.779 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMNadkbonPERAA2PLg4NMr+4eW+FDAfPig1A==", 2023-07-06T22:18:36.779 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.779 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:18:36.779 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:18:36.779 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.779 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.779 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.780 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.780 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-07-06T22:18:36.780 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAPNadkQw76GBAAY9SIgsTUHqvThwjdpjuwpw==", 2023-07-06T22:18:36.780 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.780 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:18:36.780 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:18:36.780 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.781 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.781 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.781 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.781 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-07-06T22:18:36.781 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQASNadkr3gRHxAALbPUtIgImIK1UUoe6vcyjg==", 2023-07-06T22:18:36.781 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.781 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:18:36.781 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:18:36.782 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.782 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.782 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.782 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.782 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-07-06T22:18:36.782 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkaZgiBRAAvyBUd+qHLh/wwhgoE1MsVA==", 2023-07-06T22:18:36.782 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.782 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:18:36.783 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-07-06T22:18:36.783 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-06T22:18:36.783 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.783 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.783 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.783 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-07-06T22:18:36.783 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkOBqoDBAASIhzvCqkSAFLX2oc99MYqw==", 2023-07-06T22:18:36.783 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.784 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:18:36.784 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:18:36.784 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:18:36.784 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:18:36.784 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.784 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.784 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.784 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-07-06T22:18:36.785 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkgt/fCBAAlQY94DrR/nFTIVwSFCEToQ==", 2023-07-06T22:18:36.785 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.785 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:18:36.785 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:18:36.785 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:18:36.785 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:18:36.785 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.786 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.786 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.786 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-07-06T22:18:36.786 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkd5zAEhAAU0Qo6NROIKRSlOncFUoTxQ==", 2023-07-06T22:18:36.786 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.786 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:18:36.786 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:18:36.786 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:18:36.787 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:18:36.787 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.787 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.787 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.787 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-07-06T22:18:36.787 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkjvG8ChAA5rpuV6+YETQS9UjMRUynxA==", 2023-07-06T22:18:36.787 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.787 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:18:36.788 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:18:36.788 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:18:36.788 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.788 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.788 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.788 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.788 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-07-06T22:18:36.788 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdk+RUVIxAAyQpmGAeL8K+Cy+fgK5BmCQ==", 2023-07-06T22:18:36.789 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.789 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:18:36.789 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T22:18:36.789 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.789 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.789 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:36.789 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:36.790 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-07-06T22:18:36.790 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkLH8aHxAAzzX5YxumCYWYqo0rQfFA9g==", 2023-07-06T22:18:36.790 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:18:36.790 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:18:36.790 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T22:18:36.790 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:18:36.790 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.790 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:36.791 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-07-06T22:18:36.791 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:18:36.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.765+0000 7f9e40448640 1 -- 172.21.15.55:0/3869630382 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9e1c0663a0 msgr2=0x7f9e1c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:36.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.765+0000 7f9e40448640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9e1c0663a0 0x7f9e1c068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e280ad000 tx=0x7f9e28008040 comp rx=0 tx=0).stop 2023-07-06T22:18:36.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.765+0000 7f9e40448640 1 -- 172.21.15.55:0/3869630382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e380cb4a0 msgr2=0x7f9e381506f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:36.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.765+0000 7f9e40448640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e380cb4a0 0x7f9e381506f0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f9e340011f0 tx=0x7f9e3400c9b0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.765+0000 7f9e40448640 1 -- 172.21.15.55:0/3869630382 shutdown_connections 2023-07-06T22:18:36.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.765+0000 7f9e40448640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9e1c0663a0 0x7f9e1c068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.765+0000 7f9e40448640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e3815f740 0x7f9e381523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.765+0000 7f9e40448640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e380cbc70 0x7f9e38154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.765+0000 7f9e40448640 1 --2- 172.21.15.55:0/3869630382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e380cb4a0 0x7f9e381506f0 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.765+0000 7f9e40448640 1 -- 172.21.15.55:0/3869630382 >> 172.21.15.55:0/3869630382 conn(0x7f9e3806ee80 msgr2=0x7f9e3806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:36.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.765+0000 7f9e40448640 1 -- 172.21.15.55:0/3869630382 shutdown_connections 2023-07-06T22:18:36.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.765+0000 7f9e40448640 1 -- 172.21.15.55:0/3869630382 wait complete. 2023-07-06T22:18:36.794 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:18:36.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 Processor -- start 2023-07-06T22:18:36.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 -- start start 2023-07-06T22:18:36.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38c80c89b0 0x7f38c80cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:36.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f38c80c8d80 0x7f38c80cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:36.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c815c8a0 con 0x7f38c80cd9a0 2023-07-06T22:18:36.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c80cce70 con 0x7f38c80c89b0 2023-07-06T22:18:36.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c815bc90 con 0x7f38c80c8d80 2023-07-06T22:18:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cdcd3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38c80c89b0 0x7f38c80cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cdcd3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38c80c89b0 0x7f38c80cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43650/0 (socket says 172.21.15.55:43650) 2023-07-06T22:18:36.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cdcd3640 1 -- 172.21.15.55:0/485484061 learned_addr learned my addr 172.21.15.55:0/485484061 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:36.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cd4d2640 1 --2- 172.21.15.55:0/485484061 >> v2:172.21.15.138:3300/0 conn(0x7f38c80c8d80 0x7f38c80cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:36.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cdcd3640 1 -- 172.21.15.55:0/485484061 >> v2:172.21.15.138:3300/0 conn(0x7f38c80c8d80 msgr2=0x7f38c80cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:36.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cdcd3640 1 --2- 172.21.15.55:0/485484061 >> v2:172.21.15.138:3300/0 conn(0x7f38c80c8d80 0x7f38c80cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cdcd3640 1 -- 172.21.15.55:0/485484061 >> v1:172.21.15.55:6789/0 conn(0x7f38c80cd9a0 legacy=0x7f38c806bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:36.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cdcd3640 1 -- 172.21.15.55:0/485484061 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c815bf70 con 0x7f38c80c89b0 2023-07-06T22:18:36.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cdcd3640 1 --2- 172.21.15.55:0/485484061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c80c89b0 0x7f38c80cbe50 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f38c806d570 tx=0x7f38c401e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2327de8d90a6aec server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:36.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cccd1640 1 -- 172.21.15.55:0/485484061 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c40a86b0 con 0x7f38c80c89b0 2023-07-06T22:18:36.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cccd1640 1 -- 172.21.15.55:0/485484061 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c40a8810 con 0x7f38c80c89b0 2023-07-06T22:18:36.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cccd1640 1 -- 172.21.15.55:0/485484061 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c40a8ba0 con 0x7f38c80c89b0 2023-07-06T22:18:36.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 -- 172.21.15.55:0/485484061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c80c89b0 msgr2=0x7f38c80cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:36.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 --2- 172.21.15.55:0/485484061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c80c89b0 0x7f38c80cbe50 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f38c806d570 tx=0x7f38c401e6e0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 -- 172.21.15.55:0/485484061 shutdown_connections 2023-07-06T22:18:36.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 --2- 172.21.15.55:0/485484061 >> v2:172.21.15.138:3300/0 conn(0x7f38c80c8d80 0x7f38c80cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 --2- 172.21.15.55:0/485484061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c80c89b0 0x7f38c80cbe50 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 -- 172.21.15.55:0/485484061 >> 172.21.15.55:0/485484061 conn(0x7f38c80cded0 msgr2=0x7f38c80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 -- 172.21.15.55:0/485484061 shutdown_connections 2023-07-06T22:18:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.937+0000 7f38cff37640 1 -- 172.21.15.55:0/485484061 wait complete. 2023-07-06T22:18:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cff37640 1 Processor -- start 2023-07-06T22:18:36.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cff37640 1 -- start start 2023-07-06T22:18:36.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cff37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38c80c89b0 0x7f38c8149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:36.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cff37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c80c8d80 0x7f38c81496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:36.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cff37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38c8150180 0x7f38c8157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:36.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cff37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c8149c00 con 0x7f38c80c8d80 2023-07-06T22:18:36.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cff37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c814ec90 con 0x7f38c8150180 2023-07-06T22:18:36.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cff37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c814ef70 con 0x7f38c80c89b0 2023-07-06T22:18:36.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cd4d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c80c8d80 0x7f38c81496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:36.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cd4d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c80c8d80 0x7f38c81496c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43666/0 (socket says 172.21.15.55:43666) 2023-07-06T22:18:36.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cd4d2640 1 -- 172.21.15.55:0/1667316929 learned_addr learned my addr 172.21.15.55:0/1667316929 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:36.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cdcd3640 1 --2- 172.21.15.55:0/1667316929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38c80c89b0 0x7f38c8149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:36.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38ce4d4640 1 --2- 172.21.15.55:0/1667316929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38c8150180 0x7f38c8157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:36.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cd4d2640 1 -- 172.21.15.55:0/1667316929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38c80c89b0 msgr2=0x7f38c8149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:36.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cd4d2640 1 --2- 172.21.15.55:0/1667316929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38c80c89b0 0x7f38c8149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cd4d2640 1 -- 172.21.15.55:0/1667316929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38c8150180 msgr2=0x7f38c8157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:36.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cd4d2640 1 --2- 172.21.15.55:0/1667316929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38c8150180 0x7f38c8157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cd4d2640 1 -- 172.21.15.55:0/1667316929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c40094d0 con 0x7f38c80c8d80 2023-07-06T22:18:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cd4d2640 1 --2- 172.21.15.55:0/1667316929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c80c8d80 0x7f38c81496c0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f38b800d7d0 tx=0x7f38b800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38be7fc640 1 -- 172.21.15.55:0/1667316929 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b800b6c0 con 0x7f38c80c8d80 2023-07-06T22:18:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38be7fc640 1 -- 172.21.15.55:0/1667316929 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b800b820 con 0x7f38c80c8d80 2023-07-06T22:18:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cff37640 1 -- 172.21.15.55:0/1667316929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c814f250 con 0x7f38c80c8d80 2023-07-06T22:18:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38be7fc640 1 -- 172.21.15.55:0/1667316929 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b800bbd0 con 0x7f38c80c8d80 2023-07-06T22:18:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.941+0000 7f38cff37640 1 -- 172.21.15.55:0/1667316929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c80c1a90 con 0x7f38c80c8d80 2023-07-06T22:18:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.945+0000 7f38cff37640 1 -- 172.21.15.55:0/1667316929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c8066d60 con 0x7f38c80c8d80 2023-07-06T22:18:36.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.945+0000 7f38be7fc640 1 -- 172.21.15.55:0/1667316929 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f38b800bd30 con 0x7f38c80c8d80 2023-07-06T22:18:36.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.945+0000 7f38be7fc640 1 --2- 172.21.15.55:0/1667316929 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f38ac0663d0 0x7f38ac068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:36.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.945+0000 7f38be7fc640 1 -- 172.21.15.55:0/1667316929 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f38b8084210 con 0x7f38c80c8d80 2023-07-06T22:18:36.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.945+0000 7f38cdcd3640 1 --2- 172.21.15.55:0/1667316929 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f38ac0663d0 0x7f38ac068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:36.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.945+0000 7f38cdcd3640 1 --2- 172.21.15.55:0/1667316929 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f38ac0663d0 0x7f38ac068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f38c40b1000 tx=0x7f38c40a9000 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:36.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:36.953+0000 7f38be7fc640 1 -- 172.21.15.55:0/1667316929 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38b8055200 con 0x7f38c80c8d80 2023-07-06T22:18:37.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.105+0000 7f38cff37640 1 -- 172.21.15.55:0/1667316929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38c8162c60 con 0x7f38c80c8d80 2023-07-06T22:18:37.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.105+0000 7f38be7fc640 1 -- 172.21.15.55:0/1667316929 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+14886 (secure 0 0 0) 0x7f38b8054d90 con 0x7f38c80c8d80 2023-07-06T22:18:37.112 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:37.112 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":175,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:18:36.357630+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":162,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:18:37.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.109+0000 7f38cff37640 1 -- 172.21.15.55:0/1667316929 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f38ac0663d0 msgr2=0x7f38ac068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.109+0000 7f38cff37640 1 --2- 172.21.15.55:0/1667316929 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f38ac0663d0 0x7f38ac068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f38c40b1000 tx=0x7f38c40a9000 comp rx=0 tx=0).stop 2023-07-06T22:18:37.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.109+0000 7f38cff37640 1 -- 172.21.15.55:0/1667316929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c80c8d80 msgr2=0x7f38c81496c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.109+0000 7f38cff37640 1 --2- 172.21.15.55:0/1667316929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c80c8d80 0x7f38c81496c0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f38b800d7d0 tx=0x7f38b800dc90 comp rx=0 tx=0).stop 2023-07-06T22:18:37.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.109+0000 7f38cff37640 1 -- 172.21.15.55:0/1667316929 shutdown_connections 2023-07-06T22:18:37.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.109+0000 7f38cff37640 1 --2- 172.21.15.55:0/1667316929 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f38ac0663d0 0x7f38ac068880 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.109+0000 7f38cff37640 1 --2- 172.21.15.55:0/1667316929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38c8150180 0x7f38c8157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.109+0000 7f38cff37640 1 --2- 172.21.15.55:0/1667316929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c80c8d80 0x7f38c81496c0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.109+0000 7f38cff37640 1 --2- 172.21.15.55:0/1667316929 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38c80c89b0 0x7f38c8149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.109+0000 7f38cff37640 1 -- 172.21.15.55:0/1667316929 >> 172.21.15.55:0/1667316929 conn(0x7f38c80cded0 msgr2=0x7f38c80ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:37.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.109+0000 7f38cff37640 1 -- 172.21.15.55:0/1667316929 shutdown_connections 2023-07-06T22:18:37.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.109+0000 7f38cff37640 1 -- 172.21.15.55:0/1667316929 wait complete. 2023-07-06T22:18:37.133 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:18:37.133 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:18:37.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.277+0000 7fad8099f640 1 Processor -- start 2023-07-06T22:18:37.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.277+0000 7fad8099f640 1 -- start start 2023-07-06T22:18:37.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.281+0000 7fad8099f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad7c158850 0x7fad7c0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.281+0000 7fad8099f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad7c070af0 0x7fad7c0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.281+0000 7fad8099f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7c158c20 con 0x7fad7c0ca130 2023-07-06T22:18:37.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.281+0000 7fad8099f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7c0b2aa0 con 0x7fad7c070af0 2023-07-06T22:18:37.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.281+0000 7fad8099f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0c8db0 con 0x7fad7c158850 2023-07-06T22:18:37.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.281+0000 7fad7ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad7c070af0 0x7fad7c0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.281+0000 7fad73fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fad7c0ca130 0x7fad7c0703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55234/0 (socket says 172.21.15.55:55234) 2023-07-06T22:18:37.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.281+0000 7fad73fff640 1 -- 172.21.15.55:0/1507326170 learned_addr learned my addr 172.21.15.55:0/1507326170 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:37.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.281+0000 7fad7a59c640 1 --2- 172.21.15.55:0/1507326170 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad7c158850 0x7fad7c0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.281+0000 7fad7ad9d640 1 -- 172.21.15.55:0/1507326170 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad7c158850 msgr2=0x7fad7c0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:37.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.281+0000 7fad7ad9d640 1 --2- 172.21.15.55:0/1507326170 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad7c158850 0x7fad7c0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.281+0000 7fad7ad9d640 1 -- 172.21.15.55:0/1507326170 >> v1:172.21.15.55:6789/0 conn(0x7fad7c0ca130 legacy=0x7fad7c0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.281+0000 7fad7ad9d640 1 -- 172.21.15.55:0/1507326170 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c0c9090 con 0x7fad7c070af0 2023-07-06T22:18:37.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.281+0000 7fad79d9b640 1 -- 172.21.15.55:0/1507326170 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988003331 0 0) 0x7fad7c158c20 con 0x7fad7c0ca130 2023-07-06T22:18:37.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.285+0000 7fad7ad9d640 1 --2- 172.21.15.55:0/1507326170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad7c070af0 0x7fad7c0ccf70 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fad74009d90 tx=0x7fad7401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e9de968282b9ba server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:37.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.285+0000 7fad79d9b640 1 -- 172.21.15.55:0/1507326170 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740af600 con 0x7fad7c070af0 2023-07-06T22:18:37.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.285+0000 7fad79d9b640 1 -- 172.21.15.55:0/1507326170 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad740ab050 con 0x7fad7c070af0 2023-07-06T22:18:37.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.285+0000 7fad79d9b640 1 -- 172.21.15.55:0/1507326170 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740af980 con 0x7fad7c070af0 2023-07-06T22:18:37.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.285+0000 7fad8099f640 1 -- 172.21.15.55:0/1507326170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad7c070af0 msgr2=0x7fad7c0ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.285+0000 7fad8099f640 1 --2- 172.21.15.55:0/1507326170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad7c070af0 0x7fad7c0ccf70 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fad74009d90 tx=0x7fad7401f130 comp rx=0 tx=0).stop 2023-07-06T22:18:37.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.285+0000 7fad8099f640 1 -- 172.21.15.55:0/1507326170 shutdown_connections 2023-07-06T22:18:37.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.285+0000 7fad8099f640 1 --2- 172.21.15.55:0/1507326170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad7c070af0 0x7fad7c0ccf70 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.285+0000 7fad8099f640 1 --2- 172.21.15.55:0/1507326170 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad7c158850 0x7fad7c0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.285+0000 7fad8099f640 1 -- 172.21.15.55:0/1507326170 >> 172.21.15.55:0/1507326170 conn(0x7fad7c0cea70 msgr2=0x7fad7c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:37.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.285+0000 7fad8099f640 1 -- 172.21.15.55:0/1507326170 shutdown_connections 2023-07-06T22:18:37.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.285+0000 7fad8099f640 1 -- 172.21.15.55:0/1507326170 wait complete. 2023-07-06T22:18:37.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.285+0000 7fad8099f640 1 Processor -- start 2023-07-06T22:18:37.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.285+0000 7fad8099f640 1 -- start start 2023-07-06T22:18:37.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad8099f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad7c070af0 0x7fad7c1445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad8099f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad7c0ca130 0x7fad7c1f0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad8099f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad7c158850 0x7fad7c069a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad8099f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c06a300 con 0x7fad7c158850 2023-07-06T22:18:37.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad8099f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c1f0eb0 con 0x7fad7c070af0 2023-07-06T22:18:37.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad8099f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c06a550 con 0x7fad7c0ca130 2023-07-06T22:18:37.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad7ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad7c158850 0x7fad7c069a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad7ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad7c158850 0x7fad7c069a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43692/0 (socket says 172.21.15.55:43692) 2023-07-06T22:18:37.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad7ad9d640 1 -- 172.21.15.55:0/3737899488 learned_addr learned my addr 172.21.15.55:0/3737899488 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:37.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad73fff640 1 --2- 172.21.15.55:0/3737899488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad7c0ca130 0x7fad7c1f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad7a59c640 1 --2- 172.21.15.55:0/3737899488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad7c070af0 0x7fad7c1445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad7ad9d640 1 -- 172.21.15.55:0/3737899488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad7c0ca130 msgr2=0x7fad7c1f0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad7ad9d640 1 --2- 172.21.15.55:0/3737899488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad7c0ca130 0x7fad7c1f0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad7ad9d640 1 -- 172.21.15.55:0/3737899488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad7c070af0 msgr2=0x7fad7c1445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad7ad9d640 1 --2- 172.21.15.55:0/3737899488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad7c070af0 0x7fad7c1445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad7ad9d640 1 -- 172.21.15.55:0/3737899488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad74009a70 con 0x7fad7c158850 2023-07-06T22:18:37.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad7ad9d640 1 --2- 172.21.15.55:0/3737899488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad7c158850 0x7fad7c069a60 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fad740b2040 tx=0x7fad7401bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:37.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad72ffd640 1 -- 172.21.15.55:0/3737899488 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740b9610 con 0x7fad7c158850 2023-07-06T22:18:37.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad72ffd640 1 -- 172.21.15.55:0/3737899488 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad740b9770 con 0x7fad7c158850 2023-07-06T22:18:37.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad72ffd640 1 -- 172.21.15.55:0/3737899488 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740b9b20 con 0x7fad7c158850 2023-07-06T22:18:37.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad8099f640 1 -- 172.21.15.55:0/3737899488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7c06a830 con 0x7fad7c158850 2023-07-06T22:18:37.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad8099f640 1 -- 172.21.15.55:0/3737899488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c06adf0 con 0x7fad7c158850 2023-07-06T22:18:37.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad8099f640 1 -- 172.21.15.55:0/3737899488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7c066d60 con 0x7fad7c158850 2023-07-06T22:18:37.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.289+0000 7fad72ffd640 1 -- 172.21.15.55:0/3737899488 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fad740b6050 con 0x7fad7c158850 2023-07-06T22:18:37.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.293+0000 7fad72ffd640 1 --2- 172.21.15.55:0/3737899488 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fad5c0663a0 0x7fad5c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.293+0000 7fad72ffd640 1 -- 172.21.15.55:0/3737899488 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5558+0+0 (secure 0 0 0) 0x7fad741224f0 con 0x7fad7c158850 2023-07-06T22:18:37.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.293+0000 7fad7a59c640 1 --2- 172.21.15.55:0/3737899488 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fad5c0663a0 0x7fad5c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.293+0000 7fad7a59c640 1 --2- 172.21.15.55:0/3737899488 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fad5c0663a0 0x7fad5c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0cd8e0 tx=0x7fad6c008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:37.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.297+0000 7fad72ffd640 1 -- 172.21.15.55:0/3737899488 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fad740efa50 con 0x7fad7c158850 2023-07-06T22:18:37.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.449+0000 7fad8099f640 1 -- 172.21.15.55:0/3737899488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad7c06cd30 con 0x7fad7c158850 2023-07-06T22:18:37.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.449+0000 7fad72ffd640 1 -- 172.21.15.55:0/3737899488 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v175) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad74009450 con 0x7fad7c158850 2023-07-06T22:18:37.451 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:18:37.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.453+0000 7fad8099f640 1 -- 172.21.15.55:0/3737899488 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fad5c0663a0 msgr2=0x7fad5c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.453+0000 7fad8099f640 1 --2- 172.21.15.55:0/3737899488 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fad5c0663a0 0x7fad5c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0cd8e0 tx=0x7fad6c008040 comp rx=0 tx=0).stop 2023-07-06T22:18:37.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.453+0000 7fad8099f640 1 -- 172.21.15.55:0/3737899488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad7c158850 msgr2=0x7fad7c069a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.453+0000 7fad8099f640 1 --2- 172.21.15.55:0/3737899488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad7c158850 0x7fad7c069a60 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fad740b2040 tx=0x7fad7401bed0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.453+0000 7fad8099f640 1 -- 172.21.15.55:0/3737899488 shutdown_connections 2023-07-06T22:18:37.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.453+0000 7fad8099f640 1 --2- 172.21.15.55:0/3737899488 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fad5c0663a0 0x7fad5c068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.453+0000 7fad8099f640 1 --2- 172.21.15.55:0/3737899488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad7c158850 0x7fad7c069a60 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.453+0000 7fad8099f640 1 --2- 172.21.15.55:0/3737899488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad7c0ca130 0x7fad7c1f0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.453+0000 7fad8099f640 1 --2- 172.21.15.55:0/3737899488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad7c070af0 0x7fad7c1445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.453+0000 7fad8099f640 1 -- 172.21.15.55:0/3737899488 >> 172.21.15.55:0/3737899488 conn(0x7fad7c0cea70 msgr2=0x7fad7c09e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:37.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.453+0000 7fad8099f640 1 -- 172.21.15.55:0/3737899488 shutdown_connections 2023-07-06T22:18:37.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.453+0000 7fad8099f640 1 -- 172.21.15.55:0/3737899488 wait complete. 2023-07-06T22:18:37.472 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:18:37.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.617+0000 7ff7d880b640 1 Processor -- start 2023-07-06T22:18:37.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.617+0000 7ff7d880b640 1 -- start start 2023-07-06T22:18:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.621+0000 7ff7d880b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7d40ca130 0x7ff7d40703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.621+0000 7ff7d880b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7d40cd140 0x7ff7d4070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.621+0000 7ff7d880b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d4158c20 con 0x7ff7d4158850 2023-07-06T22:18:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.621+0000 7ff7d880b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d40b2aa0 con 0x7ff7d40cd140 2023-07-06T22:18:37.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.621+0000 7ff7d880b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40c8db0 con 0x7ff7d40ca130 2023-07-06T22:18:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.621+0000 7ff7d2d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7d40cd140 0x7ff7d4070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.621+0000 7ff7d2d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7d40cd140 0x7ff7d4070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43700/0 (socket says 172.21.15.55:43700) 2023-07-06T22:18:37.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.621+0000 7ff7d2d9d640 1 -- 172.21.15.55:0/2086474487 learned_addr learned my addr 172.21.15.55:0/2086474487 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.621+0000 7ff7d1d9b640 1 --2- 172.21.15.55:0/2086474487 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7d40ca130 0x7ff7d40703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.621+0000 7ff7d2d9d640 1 -- 172.21.15.55:0/2086474487 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7d40ca130 msgr2=0x7ff7d40703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.621+0000 7ff7d2d9d640 1 --2- 172.21.15.55:0/2086474487 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7d40ca130 0x7ff7d40703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.621+0000 7ff7d2d9d640 1 -- 172.21.15.55:0/2086474487 >> v1:172.21.15.138:6789/0 conn(0x7ff7d4158850 legacy=0x7ff7d40cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.621+0000 7ff7d2d9d640 1 -- 172.21.15.55:0/2086474487 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d40c9090 con 0x7ff7d40cd140 2023-07-06T22:18:37.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.621+0000 7ff7d2d9d640 1 --2- 172.21.15.55:0/2086474487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d40cd140 0x7ff7d4070920 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009e50 tx=0x7ff7cc01caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd50dd71bae15ae server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:37.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d159a640 1 -- 172.21.15.55:0/2086474487 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0a66c0 con 0x7ff7d40cd140 2023-07-06T22:18:37.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d159a640 1 -- 172.21.15.55:0/2086474487 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc0a6820 con 0x7ff7d40cd140 2023-07-06T22:18:37.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d159a640 1 -- 172.21.15.55:0/2086474487 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0a6bb0 con 0x7ff7d40cd140 2023-07-06T22:18:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 -- 172.21.15.55:0/2086474487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d40cd140 msgr2=0x7ff7d4070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 --2- 172.21.15.55:0/2086474487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d40cd140 0x7ff7d4070920 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009e50 tx=0x7ff7cc01caa0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 -- 172.21.15.55:0/2086474487 shutdown_connections 2023-07-06T22:18:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 --2- 172.21.15.55:0/2086474487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d40cd140 0x7ff7d4070920 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 --2- 172.21.15.55:0/2086474487 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7d40ca130 0x7ff7d40703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 -- 172.21.15.55:0/2086474487 >> 172.21.15.55:0/2086474487 conn(0x7ff7d40cea70 msgr2=0x7ff7d40ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 -- 172.21.15.55:0/2086474487 shutdown_connections 2023-07-06T22:18:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 -- 172.21.15.55:0/2086474487 wait complete. 2023-07-06T22:18:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 Processor -- start 2023-07-06T22:18:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 -- start start 2023-07-06T22:18:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7d40ca130 0x7ff7d40c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7d40cd140 0x7ff7d41f6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d4158850 0x7ff7d41f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40adfa0 con 0x7ff7d4158850 2023-07-06T22:18:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d4150a90 con 0x7ff7d40ca130 2023-07-06T22:18:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.625+0000 7ff7d880b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d41f7b00 con 0x7ff7d40cd140 2023-07-06T22:18:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7d2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d4158850 0x7ff7d41f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7d2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d4158850 0x7ff7d41f74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43708/0 (socket says 172.21.15.55:43708) 2023-07-06T22:18:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7d2d9d640 1 -- 172.21.15.55:0/3724887058 learned_addr learned my addr 172.21.15.55:0/3724887058 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7d259c640 1 --2- 172.21.15.55:0/3724887058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7d40ca130 0x7ff7d40c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7d1d9b640 1 --2- 172.21.15.55:0/3724887058 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7d40cd140 0x7ff7d41f6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7d2d9d640 1 -- 172.21.15.55:0/3724887058 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7d40cd140 msgr2=0x7ff7d41f6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7d2d9d640 1 --2- 172.21.15.55:0/3724887058 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7d40cd140 0x7ff7d41f6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7d2d9d640 1 -- 172.21.15.55:0/3724887058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7d40ca130 msgr2=0x7ff7d40c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7d2d9d640 1 --2- 172.21.15.55:0/3724887058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7d40ca130 0x7ff7d40c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7d2d9d640 1 -- 172.21.15.55:0/3724887058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc009b30 con 0x7ff7d4158850 2023-07-06T22:18:37.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7d2d9d640 1 --2- 172.21.15.55:0/3724887058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d4158850 0x7ff7d41f74a0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0b0040 tx=0x7ff7cc019840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:37.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7c2ffd640 1 -- 172.21.15.55:0/3724887058 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0b9670 con 0x7ff7d4158850 2023-07-06T22:18:37.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7c2ffd640 1 -- 172.21.15.55:0/3724887058 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc0b97d0 con 0x7ff7d4158850 2023-07-06T22:18:37.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7c2ffd640 1 -- 172.21.15.55:0/3724887058 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0b9b60 con 0x7ff7d4158850 2023-07-06T22:18:37.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7d880b640 1 -- 172.21.15.55:0/3724887058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d41f7de0 con 0x7ff7d4158850 2023-07-06T22:18:37.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7d880b640 1 -- 172.21.15.55:0/3724887058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d40adbc0 con 0x7ff7d4158850 2023-07-06T22:18:37.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7d880b640 1 -- 172.21.15.55:0/3724887058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d40ae0e0 con 0x7ff7d4158850 2023-07-06T22:18:37.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.629+0000 7ff7c2ffd640 1 -- 172.21.15.55:0/3724887058 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff7cc0b9cc0 con 0x7ff7d4158850 2023-07-06T22:18:37.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.633+0000 7ff7c2ffd640 1 --2- 172.21.15.55:0/3724887058 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff7b40663a0 0x7ff7b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.633+0000 7ff7c2ffd640 1 -- 172.21.15.55:0/3724887058 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5558+0+0 (secure 0 0 0) 0x7ff7cc120020 con 0x7ff7d4158850 2023-07-06T22:18:37.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.633+0000 7ff7d259c640 1 --2- 172.21.15.55:0/3724887058 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff7b40663a0 0x7ff7b4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.633+0000 7ff7d259c640 1 --2- 172.21.15.55:0/3724887058 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff7b40663a0 0x7ff7b4068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4007fd0 tx=0x7ff7c4009040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:37.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.637+0000 7ff7c2ffd640 1 -- 172.21.15.55:0/3724887058 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7d40ae0e0 con 0x7ff7d4158850 2023-07-06T22:18:37.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.789+0000 7ff7d880b640 1 -- 172.21.15.55:0/3724887058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff7d40ae0e0 con 0x7ff7d4158850 2023-07-06T22:18:37.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.789+0000 7ff7c2ffd640 1 -- 172.21.15.55:0/3724887058 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v175) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff7d40ae0e0 con 0x7ff7d4158850 2023-07-06T22:18:37.791 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:18:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.793+0000 7ff7d880b640 1 -- 172.21.15.55:0/3724887058 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff7b40663a0 msgr2=0x7ff7b4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.793+0000 7ff7d880b640 1 --2- 172.21.15.55:0/3724887058 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff7b40663a0 0x7ff7b4068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4007fd0 tx=0x7ff7c4009040 comp rx=0 tx=0).stop 2023-07-06T22:18:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.793+0000 7ff7d880b640 1 -- 172.21.15.55:0/3724887058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d4158850 msgr2=0x7ff7d41f74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.793+0000 7ff7d880b640 1 --2- 172.21.15.55:0/3724887058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d4158850 0x7ff7d41f74a0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0b0040 tx=0x7ff7cc019840 comp rx=0 tx=0).stop 2023-07-06T22:18:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.793+0000 7ff7d880b640 1 -- 172.21.15.55:0/3724887058 shutdown_connections 2023-07-06T22:18:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.793+0000 7ff7d880b640 1 --2- 172.21.15.55:0/3724887058 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff7b40663a0 0x7ff7b4068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.793+0000 7ff7d880b640 1 --2- 172.21.15.55:0/3724887058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d4158850 0x7ff7d41f74a0 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.793+0000 7ff7d880b640 1 --2- 172.21.15.55:0/3724887058 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7d40cd140 0x7ff7d41f6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.793+0000 7ff7d880b640 1 --2- 172.21.15.55:0/3724887058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7d40ca130 0x7ff7d40c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.793+0000 7ff7d880b640 1 -- 172.21.15.55:0/3724887058 >> 172.21.15.55:0/3724887058 conn(0x7ff7d40cea70 msgr2=0x7ff7d40b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.793+0000 7ff7d880b640 1 -- 172.21.15.55:0/3724887058 shutdown_connections 2023-07-06T22:18:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.793+0000 7ff7d880b640 1 -- 172.21.15.55:0/3724887058 wait complete. 2023-07-06T22:18:37.812 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T22:18:37.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.953+0000 7f65af582640 1 Processor -- start 2023-07-06T22:18:37.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.953+0000 7f65af582640 1 -- start start 2023-07-06T22:18:37.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.957+0000 7f65af582640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f65a80cd330 0x7f65a80cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.957+0000 7f65af582640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f65a80cbce0 0x7f65a80cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.957+0000 7f65af582640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a806bd00 con 0x7f65a8160030 2023-07-06T22:18:37.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.957+0000 7f65af582640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a8160400 con 0x7f65a80cbce0 2023-07-06T22:18:37.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.957+0000 7f65af582640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a80cdce0 con 0x7f65a80cd330 2023-07-06T22:18:37.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.957+0000 7f65adb1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f65a80cbce0 0x7f65a80cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.957+0000 7f65adb1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f65a80cbce0 0x7f65a80cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43716/0 (socket says 172.21.15.55:43716) 2023-07-06T22:18:37.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.957+0000 7f65adb1f640 1 -- 172.21.15.55:0/3074857922 learned_addr learned my addr 172.21.15.55:0/3074857922 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:37.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.957+0000 7f65acb1d640 1 --2- 172.21.15.55:0/3074857922 >> v2:172.21.15.138:3300/0 conn(0x7f65a80cd330 0x7f65a80cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.957+0000 7f65adb1f640 1 -- 172.21.15.55:0/3074857922 >> v2:172.21.15.138:3300/0 conn(0x7f65a80cd330 msgr2=0x7f65a80cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:37.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.957+0000 7f65adb1f640 1 --2- 172.21.15.55:0/3074857922 >> v2:172.21.15.138:3300/0 conn(0x7f65a80cd330 0x7f65a80cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.957+0000 7f65adb1f640 1 -- 172.21.15.55:0/3074857922 >> v1:172.21.15.138:6789/0 conn(0x7f65a8160030 legacy=0x7f65a8070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.957+0000 7f65adb1f640 1 -- 172.21.15.55:0/3074857922 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a80c9ba0 con 0x7f65a80cbce0 2023-07-06T22:18:37.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.961+0000 7f65adb1f640 1 --2- 172.21.15.55:0/3074857922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cbce0 0x7f65a80cc120 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f65a80cefd0 tx=0x7f65a001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50aaaabaa6b422c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:37.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.961+0000 7f659ffff640 1 -- 172.21.15.55:0/3074857922 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a00a5690 con 0x7f65a80cbce0 2023-07-06T22:18:37.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.961+0000 7f659ffff640 1 -- 172.21.15.55:0/3074857922 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a00a57f0 con 0x7f65a80cbce0 2023-07-06T22:18:37.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.961+0000 7f659ffff640 1 -- 172.21.15.55:0/3074857922 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a00a5b80 con 0x7f65a80cbce0 2023-07-06T22:18:37.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.961+0000 7f65af582640 1 -- 172.21.15.55:0/3074857922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cbce0 msgr2=0x7f65a80cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.961+0000 7f65af582640 1 --2- 172.21.15.55:0/3074857922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cbce0 0x7f65a80cc120 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f65a80cefd0 tx=0x7f65a001c9d0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.961+0000 7f65af582640 1 -- 172.21.15.55:0/3074857922 shutdown_connections 2023-07-06T22:18:37.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.961+0000 7f65af582640 1 --2- 172.21.15.55:0/3074857922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cbce0 0x7f65a80cc120 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.961+0000 7f65af582640 1 --2- 172.21.15.55:0/3074857922 >> v2:172.21.15.138:3300/0 conn(0x7f65a80cd330 0x7f65a80cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.961+0000 7f65af582640 1 -- 172.21.15.55:0/3074857922 >> 172.21.15.55:0/3074857922 conn(0x7f65a80cded0 msgr2=0x7f65a80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:37.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.961+0000 7f65af582640 1 -- 172.21.15.55:0/3074857922 shutdown_connections 2023-07-06T22:18:37.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.961+0000 7f65af582640 1 -- 172.21.15.55:0/3074857922 wait complete. 2023-07-06T22:18:37.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.961+0000 7f65af582640 1 Processor -- start 2023-07-06T22:18:37.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.961+0000 7f65af582640 1 -- start start 2023-07-06T22:18:37.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65af582640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cbce0 0x7f65a815f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65af582640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65a80cd330 0x7f65a8157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65af582640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65a8160030 0x7f65a8152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65af582640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a8158160 con 0x7f65a80cbce0 2023-07-06T22:18:37.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65af582640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a8158440 con 0x7f65a80cd330 2023-07-06T22:18:37.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65af582640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a8158720 con 0x7f65a8160030 2023-07-06T22:18:37.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65ad31e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cbce0 0x7f65a815f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65ad31e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cbce0 0x7f65a815f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43728/0 (socket says 172.21.15.55:43728) 2023-07-06T22:18:37.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65ad31e640 1 -- 172.21.15.55:0/1456903797 learned_addr learned my addr 172.21.15.55:0/1456903797 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:37.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65acb1d640 1 --2- 172.21.15.55:0/1456903797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65a80cd330 0x7f65a8157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65adb1f640 1 --2- 172.21.15.55:0/1456903797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65a8160030 0x7f65a8152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65ad31e640 1 -- 172.21.15.55:0/1456903797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65a8160030 msgr2=0x7f65a8152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65ad31e640 1 --2- 172.21.15.55:0/1456903797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65a8160030 0x7f65a8152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65ad31e640 1 -- 172.21.15.55:0/1456903797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65a80cd330 msgr2=0x7f65a8157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:37.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65ad31e640 1 --2- 172.21.15.55:0/1456903797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65a80cd330 0x7f65a8157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:37.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65ad31e640 1 -- 172.21.15.55:0/1456903797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a0009b30 con 0x7f65a80cbce0 2023-07-06T22:18:37.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65ad31e640 1 --2- 172.21.15.55:0/1456903797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cbce0 0x7f65a815f390 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c3c0 tx=0x7f65a400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:37.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f659dffb640 1 -- 172.21.15.55:0/1456903797 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a40052d0 con 0x7f65a80cbce0 2023-07-06T22:18:37.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f659dffb640 1 -- 172.21.15.55:0/1456903797 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a4005430 con 0x7f65a80cbce0 2023-07-06T22:18:37.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65af582640 1 -- 172.21.15.55:0/1456903797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a8158a00 con 0x7f65a80cbce0 2023-07-06T22:18:37.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f659dffb640 1 -- 172.21.15.55:0/1456903797 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a4003840 con 0x7f65a80cbce0 2023-07-06T22:18:37.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65af582640 1 -- 172.21.15.55:0/1456903797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a8159200 con 0x7f65a80cbce0 2023-07-06T22:18:37.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f65af582640 1 -- 172.21.15.55:0/1456903797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a8066d60 con 0x7f65a80cbce0 2023-07-06T22:18:37.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.965+0000 7f659dffb640 1 -- 172.21.15.55:0/1456903797 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f65a40039a0 con 0x7f65a80cbce0 2023-07-06T22:18:37.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.969+0000 7f659dffb640 1 --2- 172.21.15.55:0/1456903797 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f658c0663d0 0x7f658c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:37.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.969+0000 7f659dffb640 1 -- 172.21.15.55:0/1456903797 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f65a4083190 con 0x7f65a80cbce0 2023-07-06T22:18:37.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.969+0000 7f65acb1d640 1 --2- 172.21.15.55:0/1456903797 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f658c0663d0 0x7f658c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:37.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.969+0000 7f65acb1d640 1 --2- 172.21.15.55:0/1456903797 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f658c0663d0 0x7f658c068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65a80cb710 tx=0x7f6598009190 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:37.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:37.973+0000 7f659dffb640 1 -- 172.21.15.55:0/1456903797 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65a4050700 con 0x7f65a80cbce0 2023-07-06T22:18:38.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.129+0000 7f65af582640 1 -- 172.21.15.55:0/1456903797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f65a8066630 con 0x7f65a80cbce0 2023-07-06T22:18:38.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.129+0000 7f659dffb640 1 -- 172.21.15.55:0/1456903797 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v175) v1 ==== 84+0+126 (secure 0 0 0) 0x7f65a4053d20 con 0x7f65a80cbce0 2023-07-06T22:18:38.130 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:38.131 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T22:18:38.131 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:38.131 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-07-06T22:18:38.131 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-07-06T22:18:38.131 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:18:38.131 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:38.131 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-07-06T22:18:38.132 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-07-06T22:18:38.132 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:38.132 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T22:18:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.133+0000 7f65af582640 1 -- 172.21.15.55:0/1456903797 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f658c0663d0 msgr2=0x7f658c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.133+0000 7f65af582640 1 --2- 172.21.15.55:0/1456903797 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f658c0663d0 0x7f658c068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65a80cb710 tx=0x7f6598009190 comp rx=0 tx=0).stop 2023-07-06T22:18:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.133+0000 7f65af582640 1 -- 172.21.15.55:0/1456903797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cbce0 msgr2=0x7f65a815f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.133+0000 7f65af582640 1 --2- 172.21.15.55:0/1456903797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cbce0 0x7f65a815f390 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c3c0 tx=0x7f65a400c880 comp rx=0 tx=0).stop 2023-07-06T22:18:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.133+0000 7f65af582640 1 -- 172.21.15.55:0/1456903797 shutdown_connections 2023-07-06T22:18:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.133+0000 7f65af582640 1 --2- 172.21.15.55:0/1456903797 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f658c0663d0 0x7f658c068880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.133+0000 7f65af582640 1 --2- 172.21.15.55:0/1456903797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65a8160030 0x7f65a8152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.133+0000 7f65af582640 1 --2- 172.21.15.55:0/1456903797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65a80cd330 0x7f65a8157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.133+0000 7f65af582640 1 --2- 172.21.15.55:0/1456903797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cbce0 0x7f65a815f390 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.133+0000 7f65af582640 1 -- 172.21.15.55:0/1456903797 >> 172.21.15.55:0/1456903797 conn(0x7f65a80cded0 msgr2=0x7f65a806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.133+0000 7f65af582640 1 -- 172.21.15.55:0/1456903797 shutdown_connections 2023-07-06T22:18:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.133+0000 7f65af582640 1 -- 172.21.15.55:0/1456903797 wait complete. 2023-07-06T22:18:38.151 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T22:18:38.152 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T22:18:38.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.297+0000 7f7c70b82640 1 Processor -- start 2023-07-06T22:18:38.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.297+0000 7f7c70b82640 1 -- start start 2023-07-06T22:18:38.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.297+0000 7f7c70b82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c6c158780 0x7f7c6c0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:38.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.297+0000 7f7c70b82640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7c6c0c89b0 0x7f7c6c0c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:38.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.297+0000 7f7c70b82640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c158b50 con 0x7f7c6c0cbfa0 2023-07-06T22:18:38.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.297+0000 7f7c70b82640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c0c9370 con 0x7f7c6c0c89b0 2023-07-06T22:18:38.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.297+0000 7f7c70b82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c06fb00 con 0x7f7c6c158780 2023-07-06T22:18:38.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.297+0000 7f7c63fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7c6c0cbfa0 0x7f7c6c06f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55246/0 (socket says 172.21.15.55:55246) 2023-07-06T22:18:38.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.297+0000 7f7c63fff640 1 -- 172.21.15.55:0/1750712512 learned_addr learned my addr 172.21.15.55:0/1750712512 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:38.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.297+0000 7f7c69d9b640 1 -- 172.21.15.55:0/1750712512 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108593769 0 0) 0x7f7c6c158b50 con 0x7f7c6c0cbfa0 2023-07-06T22:18:38.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.297+0000 7f7c69d9b640 1 -- 172.21.15.55:0/1750712512 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c58005740 con 0x7f7c6c0cbfa0 2023-07-06T22:18:38.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.297+0000 7f7c6ad9d640 1 --2- 172.21.15.55:0/1750712512 >> v2:172.21.15.138:3300/0 conn(0x7f7c6c0c89b0 0x7f7c6c0c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:38.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.297+0000 7f7c6a59c640 1 --2- 172.21.15.55:0/1750712512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c6c158780 0x7f7c6c0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:38.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c69d9b640 1 -- 172.21.15.55:0/1750712512 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2010078451 0 0) 0x7f7c58005740 con 0x7f7c6c0cbfa0 2023-07-06T22:18:38.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c69d9b640 1 -- 172.21.15.55:0/1750712512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c6c158780 msgr2=0x7f7c6c0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:38.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c69d9b640 1 --2- 172.21.15.55:0/1750712512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c6c158780 0x7f7c6c0cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:38.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c69d9b640 1 -- 172.21.15.55:0/1750712512 >> v2:172.21.15.138:3300/0 conn(0x7f7c6c0c89b0 msgr2=0x7f7c6c0c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:38.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c69d9b640 1 --2- 172.21.15.55:0/1750712512 >> v2:172.21.15.138:3300/0 conn(0x7f7c6c0c89b0 0x7f7c6c0c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:38.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c69d9b640 1 -- 172.21.15.55:0/1750712512 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c06b390 con 0x7f7c6c0cbfa0 2023-07-06T22:18:38.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c69d9b640 1 -- 172.21.15.55:0/1750712512 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f7c54001680 con 0x7f7c6c0cbfa0 2023-07-06T22:18:38.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c6ad9d640 1 --2- 172.21.15.55:0/1750712512 >> v2:172.21.15.138:3300/0 conn(0x7f7c6c0c89b0 0x7f7c6c0c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:38.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c69d9b640 1 -- 172.21.15.55:0/1750712512 >> v1:172.21.15.55:6789/0 conn(0x7f7c6c0cbfa0 legacy=0x7f7c6c06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:38.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c69d9b640 1 --2- 172.21.15.55:0/1750712512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c58005b90 0x7f7c58005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:38.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c69d9b640 1 --2- 172.21.15.55:0/1750712512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c580069e0 0x7f7c58006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:38.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c69d9b640 1 --2- 172.21.15.55:0/1750712512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c58007390 0x7f7c5800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:38.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c69d9b640 1 -- 172.21.15.55:0/1750712512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c0c9370 con 0x7f7c580069e0 2023-07-06T22:18:38.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c69d9b640 1 -- 172.21.15.55:0/1750712512 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c06fb00 con 0x7f7c58005b90 2023-07-06T22:18:38.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c69d9b640 1 -- 172.21.15.55:0/1750712512 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5800e240 con 0x7f7c58007390 2023-07-06T22:18:38.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c6a59c640 1 --2- 172.21.15.55:0/1750712512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c6c158780 0x7f7c6c0cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:38.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c63fff640 1 --2- 172.21.15.55:0/1750712512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c580069e0 0x7f7c58006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:38.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c6ad9d640 1 --2- 172.21.15.55:0/1750712512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c58007390 0x7f7c5800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:38.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c6a59c640 1 --2- 172.21.15.55:0/1750712512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c58005b90 0x7f7c58005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:38.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c63fff640 1 -- 172.21.15.55:0/1750712512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c58007390 msgr2=0x7f7c5800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:38.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c63fff640 1 --2- 172.21.15.55:0/1750712512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c58007390 0x7f7c5800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:38.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c63fff640 1 -- 172.21.15.55:0/1750712512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c58005b90 msgr2=0x7f7c58005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:38.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c63fff640 1 --2- 172.21.15.55:0/1750712512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c58005b90 0x7f7c58005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:38.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c63fff640 1 -- 172.21.15.55:0/1750712512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58005740 con 0x7f7c580069e0 2023-07-06T22:18:38.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c6a59c640 1 --2- 172.21.15.55:0/1750712512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c58005b90 0x7f7c58005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:38.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.301+0000 7f7c63fff640 1 --2- 172.21.15.55:0/1750712512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c580069e0 0x7f7c58006e50 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400c210 tx=0x7f7c5401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697e8c5c40695b0c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:38.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c69d9b640 1 -- 172.21.15.55:0/1750712512 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c540058e0 con 0x7f7c580069e0 2023-07-06T22:18:38.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c69d9b640 1 -- 172.21.15.55:0/1750712512 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c54005a40 con 0x7f7c580069e0 2023-07-06T22:18:38.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c69d9b640 1 -- 172.21.15.55:0/1750712512 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54005e10 con 0x7f7c580069e0 2023-07-06T22:18:38.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c70b82640 1 -- 172.21.15.55:0/1750712512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c580069e0 msgr2=0x7f7c58006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:38.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c70b82640 1 --2- 172.21.15.55:0/1750712512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c580069e0 0x7f7c58006e50 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400c210 tx=0x7f7c5401cc60 comp rx=0 tx=0).stop 2023-07-06T22:18:38.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c6ad9d640 1 -- 172.21.15.55:0/1750712512 reap_dead start 2023-07-06T22:18:38.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c70b82640 1 -- 172.21.15.55:0/1750712512 shutdown_connections 2023-07-06T22:18:38.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c70b82640 1 -- 172.21.15.55:0/1750712512 >> 172.21.15.55:0/1750712512 conn(0x7f7c6c0cde30 msgr2=0x7f7c6c0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:38.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c70b82640 1 -- 172.21.15.55:0/1750712512 shutdown_connections 2023-07-06T22:18:38.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c70b82640 1 -- 172.21.15.55:0/1750712512 wait complete. 2023-07-06T22:18:38.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c70b82640 1 Processor -- start 2023-07-06T22:18:38.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c70b82640 1 -- start start 2023-07-06T22:18:38.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c70b82640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c580069e0 0x7f7c6c150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:38.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c70b82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c6c069c80 0x7f7c6c06a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:38.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c70b82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6c0ab870 0x7f7c6c0abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:38.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c70b82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c06a630 con 0x7f7c6c0ab870 2023-07-06T22:18:38.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c70b82640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c0ac220 con 0x7f7c580069e0 2023-07-06T22:18:38.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c70b82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c151790 con 0x7f7c6c069c80 2023-07-06T22:18:38.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.305+0000 7f7c6ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6c0ab870 0x7f7c6c0abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:38.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c6ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6c0ab870 0x7f7c6c0abce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43746/0 (socket says 172.21.15.55:43746) 2023-07-06T22:18:38.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c6ad9d640 1 -- 172.21.15.55:0/2844461774 learned_addr learned my addr 172.21.15.55:0/2844461774 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:38.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c63fff640 1 --2- 172.21.15.55:0/2844461774 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c6c069c80 0x7f7c6c06a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:38.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c6a59c640 1 --2- 172.21.15.55:0/2844461774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c580069e0 0x7f7c6c150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:38.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c6ad9d640 1 -- 172.21.15.55:0/2844461774 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c6c069c80 msgr2=0x7f7c6c06a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:38.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c6ad9d640 1 --2- 172.21.15.55:0/2844461774 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c6c069c80 0x7f7c6c06a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:38.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c6ad9d640 1 -- 172.21.15.55:0/2844461774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c580069e0 msgr2=0x7f7c6c150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:38.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c6ad9d640 1 --2- 172.21.15.55:0/2844461774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c580069e0 0x7f7c6c150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:38.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c6ad9d640 1 -- 172.21.15.55:0/2844461774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c0c6670 con 0x7f7c6c0ab870 2023-07-06T22:18:38.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c6ad9d640 1 --2- 172.21.15.55:0/2844461774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6c0ab870 0x7f7c6c0abce0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c06efa0 tx=0x7f7c64007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:38.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c62ffd640 1 -- 172.21.15.55:0/2844461774 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6401b070 con 0x7f7c6c0ab870 2023-07-06T22:18:38.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c62ffd640 1 -- 172.21.15.55:0/2844461774 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c640039a0 con 0x7f7c6c0ab870 2023-07-06T22:18:38.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c62ffd640 1 -- 172.21.15.55:0/2844461774 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64003b30 con 0x7f7c6c0ab870 2023-07-06T22:18:38.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c70b82640 1 -- 172.21.15.55:0/2844461774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c0b0d20 con 0x7f7c6c0ab870 2023-07-06T22:18:38.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c70b82640 1 -- 172.21.15.55:0/2844461774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c0ac730 con 0x7f7c6c0ab870 2023-07-06T22:18:38.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c70b82640 1 -- 172.21.15.55:0/2844461774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6c0ac920 con 0x7f7c6c0ab870 2023-07-06T22:18:38.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.309+0000 7f7c62ffd640 1 -- 172.21.15.55:0/2844461774 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7c64003c90 con 0x7f7c6c0ab870 2023-07-06T22:18:38.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.313+0000 7f7c62ffd640 1 --2- 172.21.15.55:0/2844461774 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f7c4c0663a0 0x7f7c4c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:38.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.313+0000 7f7c62ffd640 1 -- 172.21.15.55:0/2844461774 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f7c64083ac0 con 0x7f7c6c0ab870 2023-07-06T22:18:38.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.313+0000 7f7c6a59c640 1 --2- 172.21.15.55:0/2844461774 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f7c4c0663a0 0x7f7c4c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:38.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.313+0000 7f7c6a59c640 1 --2- 172.21.15.55:0/2844461774 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f7c4c0663a0 0x7f7c4c068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c069c50 tx=0x7f7c5c008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:38.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.313+0000 7f7c62ffd640 1 -- 172.21.15.55:0/2844461774 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7c640510b0 con 0x7f7c6c0ab870 2023-07-06T22:18:38.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:38.473+0000 7f7c70b82640 1 -- 172.21.15.55:0/2844461774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7c6c066d60 con 0x7f7c6c0ab870 2023-07-06T22:18:39.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.181+0000 7f7c62ffd640 1 -- 172.21.15.55:0/2844461774 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v176) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7c640546d0 con 0x7f7c6c0ab870 2023-07-06T22:18:39.185 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-07-06T22:18:39.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.189+0000 7f7c70b82640 1 -- 172.21.15.55:0/2844461774 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f7c4c0663a0 msgr2=0x7f7c4c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:39.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.189+0000 7f7c70b82640 1 --2- 172.21.15.55:0/2844461774 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f7c4c0663a0 0x7f7c4c068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c069c50 tx=0x7f7c5c008040 comp rx=0 tx=0).stop 2023-07-06T22:18:39.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.189+0000 7f7c70b82640 1 -- 172.21.15.55:0/2844461774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6c0ab870 msgr2=0x7f7c6c0abce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:39.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.189+0000 7f7c70b82640 1 --2- 172.21.15.55:0/2844461774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6c0ab870 0x7f7c6c0abce0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c06efa0 tx=0x7f7c64007df0 comp rx=0 tx=0).stop 2023-07-06T22:18:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.189+0000 7f7c70b82640 1 -- 172.21.15.55:0/2844461774 shutdown_connections 2023-07-06T22:18:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.189+0000 7f7c70b82640 1 --2- 172.21.15.55:0/2844461774 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f7c4c0663a0 0x7f7c4c068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.189+0000 7f7c70b82640 1 --2- 172.21.15.55:0/2844461774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6c0ab870 0x7f7c6c0abce0 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.189+0000 7f7c70b82640 1 --2- 172.21.15.55:0/2844461774 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c6c069c80 0x7f7c6c06a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.189+0000 7f7c70b82640 1 --2- 172.21.15.55:0/2844461774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c580069e0 0x7f7c6c150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:39.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.189+0000 7f7c70b82640 1 -- 172.21.15.55:0/2844461774 >> 172.21.15.55:0/2844461774 conn(0x7f7c6c0cde30 msgr2=0x7f7c6c0c3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:39.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.189+0000 7f7c70b82640 1 -- 172.21.15.55:0/2844461774 shutdown_connections 2023-07-06T22:18:39.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.189+0000 7f7c70b82640 1 -- 172.21.15.55:0/2844461774 wait complete. 2023-07-06T22:18:39.214 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T22:18:39.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43be619640 1 Processor -- start 2023-07-06T22:18:39.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43be619640 1 -- start start 2023-07-06T22:18:39.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43be619640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43b8158770 0x7f43b806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43be619640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f43b80cc220 0x7f43b806b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43be619640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b8071660 con 0x7f43b80c8a30 2023-07-06T22:18:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43be619640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b806a500 con 0x7f43b8158770 2023-07-06T22:18:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43be619640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b806a750 con 0x7f43b80cc220 2023-07-06T22:18:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43b7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43b8158770 0x7f43b806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43b7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43b8158770 0x7f43b806b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43750/0 (socket says 172.21.15.55:43750) 2023-07-06T22:18:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43b7fff640 1 -- 172.21.15.55:0/2881316864 learned_addr learned my addr 172.21.15.55:0/2881316864 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:39.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43b77fe640 1 --1- 172.21.15.55:0/2881316864 >> v1:172.21.15.55:6789/0 conn(0x7f43b80c8a30 0x7f43b80cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55248/0 (socket says 172.21.15.55:55248) 2023-07-06T22:18:39.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43bcbb6640 1 --2- 172.21.15.55:0/2881316864 >> v2:172.21.15.138:3300/0 conn(0x7f43b80cc220 0x7f43b806b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:39.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43b7fff640 1 -- 172.21.15.55:0/2881316864 >> v2:172.21.15.138:3300/0 conn(0x7f43b80cc220 msgr2=0x7f43b806b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:39.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43b7fff640 1 --2- 172.21.15.55:0/2881316864 >> v2:172.21.15.138:3300/0 conn(0x7f43b80cc220 0x7f43b806b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:39.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43b7fff640 1 -- 172.21.15.55:0/2881316864 >> v1:172.21.15.55:6789/0 conn(0x7f43b80c8a30 legacy=0x7f43b80cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:39.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43b6ffd640 1 -- 172.21.15.55:0/2881316864 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559460015 0 0) 0x7f43b8071660 con 0x7f43b80c8a30 2023-07-06T22:18:39.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.369+0000 7f43b7fff640 1 -- 172.21.15.55:0/2881316864 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b806f9c0 con 0x7f43b8158770 2023-07-06T22:18:39.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.373+0000 7f43b7fff640 1 --2- 172.21.15.55:0/2881316864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b8158770 0x7f43b806b2f0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f43b80cefa0 tx=0x7f43a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454f65ee2a1d8e7d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:39.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.373+0000 7f43b6ffd640 1 -- 172.21.15.55:0/2881316864 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a80aa430 con 0x7f43b8158770 2023-07-06T22:18:39.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.373+0000 7f43b6ffd640 1 -- 172.21.15.55:0/2881316864 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a80aa590 con 0x7f43b8158770 2023-07-06T22:18:39.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.373+0000 7f43b6ffd640 1 -- 172.21.15.55:0/2881316864 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a80aa920 con 0x7f43b8158770 2023-07-06T22:18:39.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.373+0000 7f43be619640 1 -- 172.21.15.55:0/2881316864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b8158770 msgr2=0x7f43b806b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:39.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.373+0000 7f43be619640 1 --2- 172.21.15.55:0/2881316864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b8158770 0x7f43b806b2f0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f43b80cefa0 tx=0x7f43a801c4d0 comp rx=0 tx=0).stop 2023-07-06T22:18:39.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.373+0000 7f43be619640 1 -- 172.21.15.55:0/2881316864 shutdown_connections 2023-07-06T22:18:39.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.373+0000 7f43be619640 1 --2- 172.21.15.55:0/2881316864 >> v2:172.21.15.138:3300/0 conn(0x7f43b80cc220 0x7f43b806b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:39.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.373+0000 7f43be619640 1 --2- 172.21.15.55:0/2881316864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b8158770 0x7f43b806b2f0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:39.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.373+0000 7f43be619640 1 -- 172.21.15.55:0/2881316864 >> 172.21.15.55:0/2881316864 conn(0x7f43b80cdf40 msgr2=0x7f43b80ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:39.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.373+0000 7f43be619640 1 -- 172.21.15.55:0/2881316864 shutdown_connections 2023-07-06T22:18:39.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.373+0000 7f43be619640 1 -- 172.21.15.55:0/2881316864 wait complete. 2023-07-06T22:18:39.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43be619640 1 Processor -- start 2023-07-06T22:18:39.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43be619640 1 -- start start 2023-07-06T22:18:39.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43be619640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43b80c8a30 0x7f43b814ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:39.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43be619640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43b80cc220 0x7f43b80b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:39.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43be619640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b8158770 0x7f43b80adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:39.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43be619640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b814e310 con 0x7f43b8158770 2023-07-06T22:18:39.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43be619640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b8155210 con 0x7f43b80c8a30 2023-07-06T22:18:39.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43be619640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80c50b0 con 0x7f43b80cc220 2023-07-06T22:18:39.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43bcbb6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b8158770 0x7f43b80adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:39.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43bcbb6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b8158770 0x7f43b80adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43752/0 (socket says 172.21.15.55:43752) 2023-07-06T22:18:39.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43bcbb6640 1 -- 172.21.15.55:0/3038050537 learned_addr learned my addr 172.21.15.55:0/3038050537 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:39.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43b7fff640 1 --2- 172.21.15.55:0/3038050537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43b80c8a30 0x7f43b814ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:39.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43b77fe640 1 --2- 172.21.15.55:0/3038050537 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43b80cc220 0x7f43b80b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:39.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43bcbb6640 1 -- 172.21.15.55:0/3038050537 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43b80cc220 msgr2=0x7f43b80b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:39.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43bcbb6640 1 --2- 172.21.15.55:0/3038050537 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43b80cc220 0x7f43b80b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:39.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43bcbb6640 1 -- 172.21.15.55:0/3038050537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43b80c8a30 msgr2=0x7f43b814ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:39.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43bcbb6640 1 --2- 172.21.15.55:0/3038050537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43b80c8a30 0x7f43b814ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:39.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43bcbb6640 1 -- 172.21.15.55:0/3038050537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a80094d0 con 0x7f43b8158770 2023-07-06T22:18:39.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43bcbb6640 1 --2- 172.21.15.55:0/3038050537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b8158770 0x7f43b80adac0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f43b0007e60 tx=0x7f43b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:39.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43b4ff9640 1 -- 172.21.15.55:0/3038050537 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0014420 con 0x7f43b8158770 2023-07-06T22:18:39.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43b4ff9640 1 -- 172.21.15.55:0/3038050537 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b00145a0 con 0x7f43b8158770 2023-07-06T22:18:39.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43b4ff9640 1 -- 172.21.15.55:0/3038050537 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0014950 con 0x7f43b8158770 2023-07-06T22:18:39.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43be619640 1 -- 172.21.15.55:0/3038050537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b80c5390 con 0x7f43b8158770 2023-07-06T22:18:39.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43be619640 1 -- 172.21.15.55:0/3038050537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b8155460 con 0x7f43b8158770 2023-07-06T22:18:39.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.377+0000 7f43be619640 1 -- 172.21.15.55:0/3038050537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b8155680 con 0x7f43b8158770 2023-07-06T22:18:39.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.381+0000 7f43b4ff9640 1 -- 172.21.15.55:0/3038050537 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f43b0014ab0 con 0x7f43b8158770 2023-07-06T22:18:39.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.381+0000 7f43b4ff9640 1 --2- 172.21.15.55:0/3038050537 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f43a40663d0 0x7f43a4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:39.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.381+0000 7f43b4ff9640 1 -- 172.21.15.55:0/3038050537 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5928+0+0 (secure 0 0 0) 0x7f43b0084780 con 0x7f43b8158770 2023-07-06T22:18:39.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.381+0000 7f43b7fff640 1 --2- 172.21.15.55:0/3038050537 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f43a40663d0 0x7f43a4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:39.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.381+0000 7f43b7fff640 1 --2- 172.21.15.55:0/3038050537 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f43a40663d0 0x7f43a4068880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f43a80ae000 tx=0x7f43a80a7000 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:39.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.385+0000 7f43b4ff9640 1 -- 172.21.15.55:0/3038050537 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43b0051ad0 con 0x7f43b8158770 2023-07-06T22:18:39.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:39.541+0000 7f43be619640 1 -- 172.21.15.55:0/3038050537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f43b8066d60 con 0x7f43b8158770 2023-07-06T22:18:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.193+0000 7f43b4ff9640 1 -- 172.21.15.55:0/3038050537 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v177) v1 ==== 170+0+0 (secure 0 0 0) 0x7f43b00550f0 con 0x7f43b8158770 2023-07-06T22:18:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-07-06T22:18:40.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.201+0000 7f43be619640 1 -- 172.21.15.55:0/3038050537 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f43a40663d0 msgr2=0x7f43a4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:40.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.201+0000 7f43be619640 1 --2- 172.21.15.55:0/3038050537 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f43a40663d0 0x7f43a4068880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f43a80ae000 tx=0x7f43a80a7000 comp rx=0 tx=0).stop 2023-07-06T22:18:40.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.201+0000 7f43be619640 1 -- 172.21.15.55:0/3038050537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b8158770 msgr2=0x7f43b80adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:40.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.201+0000 7f43be619640 1 --2- 172.21.15.55:0/3038050537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b8158770 0x7f43b80adac0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f43b0007e60 tx=0x7f43b000e4b0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.205+0000 7f43be619640 1 -- 172.21.15.55:0/3038050537 shutdown_connections 2023-07-06T22:18:40.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.205+0000 7f43be619640 1 --2- 172.21.15.55:0/3038050537 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f43a40663d0 0x7f43a4068880 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.205+0000 7f43be619640 1 --2- 172.21.15.55:0/3038050537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b8158770 0x7f43b80adac0 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.205+0000 7f43be619640 1 --2- 172.21.15.55:0/3038050537 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43b80cc220 0x7f43b80b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.209+0000 7f43be619640 1 --2- 172.21.15.55:0/3038050537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43b80c8a30 0x7f43b814ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.209+0000 7f43be619640 1 -- 172.21.15.55:0/3038050537 >> 172.21.15.55:0/3038050537 conn(0x7f43b80cdf40 msgr2=0x7f43b80cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:40.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.209+0000 7f43be619640 1 -- 172.21.15.55:0/3038050537 shutdown_connections 2023-07-06T22:18:40.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.209+0000 7f43be619640 1 -- 172.21.15.55:0/3038050537 wait complete. 2023-07-06T22:18:40.239 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T22:18:40.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb058382640 1 Processor -- start 2023-07-06T22:18:40.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb058382640 1 -- start start 2023-07-06T22:18:40.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb058382640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0500b7b90 0x7fb0500d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:40.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb058382640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0500cc870 0x7fb0500b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:40.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb058382640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0500b5070 con 0x7fb0500b4130 2023-07-06T22:18:40.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb058382640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0500b45b0 con 0x7fb0500b7b90 2023-07-06T22:18:40.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb058382640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb050160020 con 0x7fb0500cc870 2023-07-06T22:18:40.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb05611e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0500b7b90 0x7fb0500d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:40.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb05611e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0500b7b90 0x7fb0500d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43758/0 (socket says 172.21.15.55:43758) 2023-07-06T22:18:40.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb05611e640 1 -- 172.21.15.55:0/1378159022 learned_addr learned my addr 172.21.15.55:0/1378159022 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:40.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb05591d640 1 --2- 172.21.15.55:0/1378159022 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0500cc870 0x7fb0500b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:40.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb05611e640 1 -- 172.21.15.55:0/1378159022 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0500cc870 msgr2=0x7fb0500b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:40.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb05611e640 1 --2- 172.21.15.55:0/1378159022 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0500cc870 0x7fb0500b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb05611e640 1 -- 172.21.15.55:0/1378159022 >> v1:172.21.15.55:6789/0 conn(0x7fb0500b4130 legacy=0x7fb0500d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:40.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.385+0000 7fb05611e640 1 -- 172.21.15.55:0/1378159022 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0501604b0 con 0x7fb0500b7b90 2023-07-06T22:18:40.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.389+0000 7fb05611e640 1 --2- 172.21.15.55:0/1378159022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0500b7b90 0x7fb0500d1c40 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009870 tx=0x7fb04c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726b7cae13e0d1e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:40.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.389+0000 7fb05511c640 1 -- 172.21.15.55:0/1378159022 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0ab640 con 0x7fb0500b7b90 2023-07-06T22:18:40.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.389+0000 7fb05511c640 1 -- 172.21.15.55:0/1378159022 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c0a7070 con 0x7fb0500b7b90 2023-07-06T22:18:40.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.389+0000 7fb05511c640 1 -- 172.21.15.55:0/1378159022 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0ab9c0 con 0x7fb0500b7b90 2023-07-06T22:18:40.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.389+0000 7fb058382640 1 -- 172.21.15.55:0/1378159022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0500b7b90 msgr2=0x7fb0500d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:40.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.389+0000 7fb058382640 1 --2- 172.21.15.55:0/1378159022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0500b7b90 0x7fb0500d1c40 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009870 tx=0x7fb04c01c520 comp rx=0 tx=0).stop 2023-07-06T22:18:40.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.389+0000 7fb058382640 1 -- 172.21.15.55:0/1378159022 shutdown_connections 2023-07-06T22:18:40.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.389+0000 7fb058382640 1 --2- 172.21.15.55:0/1378159022 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0500cc870 0x7fb0500b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.389+0000 7fb058382640 1 --2- 172.21.15.55:0/1378159022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0500b7b90 0x7fb0500d1c40 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.389+0000 7fb058382640 1 -- 172.21.15.55:0/1378159022 >> 172.21.15.55:0/1378159022 conn(0x7fb0500ceca0 msgr2=0x7fb0500cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:40.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.389+0000 7fb058382640 1 -- 172.21.15.55:0/1378159022 shutdown_connections 2023-07-06T22:18:40.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.389+0000 7fb058382640 1 -- 172.21.15.55:0/1378159022 wait complete. 2023-07-06T22:18:40.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb058382640 1 Processor -- start 2023-07-06T22:18:40.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb058382640 1 -- start start 2023-07-06T22:18:40.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb058382640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0500b4130 0x7fb05014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:40.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb058382640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0500b7b90 0x7fb0500b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:40.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb058382640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0500cc870 0x7fb0501527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:40.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb058382640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05014fee0 con 0x7fb0500b4130 2023-07-06T22:18:40.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb058382640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb050154760 con 0x7fb0500cc870 2023-07-06T22:18:40.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb058382640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500b5780 con 0x7fb0500b7b90 2023-07-06T22:18:40.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb05611e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0500b4130 0x7fb05014f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:40.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb05611e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0500b4130 0x7fb05014f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43774/0 (socket says 172.21.15.55:43774) 2023-07-06T22:18:40.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb05611e640 1 -- 172.21.15.55:0/2836117140 learned_addr learned my addr 172.21.15.55:0/2836117140 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:40.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb05591d640 1 --2- 172.21.15.55:0/2836117140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0500b7b90 0x7fb0500b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:40.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb05691f640 1 --2- 172.21.15.55:0/2836117140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0500cc870 0x7fb0501527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:40.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb05611e640 1 -- 172.21.15.55:0/2836117140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0500b7b90 msgr2=0x7fb0500b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:40.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb05611e640 1 --2- 172.21.15.55:0/2836117140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0500b7b90 0x7fb0500b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb05611e640 1 -- 172.21.15.55:0/2836117140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0500cc870 msgr2=0x7fb0501527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:40.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb05611e640 1 --2- 172.21.15.55:0/2836117140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0500cc870 0x7fb0501527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb05611e640 1 -- 172.21.15.55:0/2836117140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c0094d0 con 0x7fb0500b4130 2023-07-06T22:18:40.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb05611e640 1 --2- 172.21.15.55:0/2836117140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0500b4130 0x7fb05014f9a0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fb04c0ad040 tx=0x7fb04c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:40.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb046ffd640 1 -- 172.21.15.55:0/2836117140 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0be3f0 con 0x7fb0500b4130 2023-07-06T22:18:40.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb046ffd640 1 -- 172.21.15.55:0/2836117140 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c0be550 con 0x7fb0500b4130 2023-07-06T22:18:40.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb046ffd640 1 -- 172.21.15.55:0/2836117140 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0be900 con 0x7fb0500b4130 2023-07-06T22:18:40.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb058382640 1 -- 172.21.15.55:0/2836117140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb050150130 con 0x7fb0500b4130 2023-07-06T22:18:40.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.393+0000 7fb058382640 1 -- 172.21.15.55:0/2836117140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0501506f0 con 0x7fb0500b4130 2023-07-06T22:18:40.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.397+0000 7fb058382640 1 -- 172.21.15.55:0/2836117140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb050066d60 con 0x7fb0500b4130 2023-07-06T22:18:40.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.397+0000 7fb046ffd640 1 -- 172.21.15.55:0/2836117140 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb04c0c9430 con 0x7fb0500b4130 2023-07-06T22:18:40.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.397+0000 7fb046ffd640 1 --2- 172.21.15.55:0/2836117140 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fb0340663a0 0x7fb034068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:40.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.397+0000 7fb046ffd640 1 -- 172.21.15.55:0/2836117140 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6310+0+0 (secure 0 0 0) 0x7fb04c11e810 con 0x7fb0500b4130 2023-07-06T22:18:40.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.397+0000 7fb05591d640 1 --2- 172.21.15.55:0/2836117140 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fb0340663a0 0x7fb034068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:40.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.397+0000 7fb05591d640 1 --2- 172.21.15.55:0/2836117140 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fb0340663a0 0x7fb034068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb050157fa0 tx=0x7fb040008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:40.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.401+0000 7fb046ffd640 1 -- 172.21.15.55:0/2836117140 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb04c0ebb00 con 0x7fb0500b4130 2023-07-06T22:18:40.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.589+0000 7fb058382640 1 -- 172.21.15.55:0/2836117140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb050158a10 con 0x7fb0500b4130 2023-07-06T22:18:40.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.601+0000 7fb046ffd640 1 -- 172.21.15.55:0/2836117140 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v75) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb04c0ef120 con 0x7fb0500b4130 2023-07-06T22:18:40.602 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 22 and data pool 23 2023-07-06T22:18:40.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.613+0000 7fb058382640 1 -- 172.21.15.55:0/2836117140 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fb0340663a0 msgr2=0x7fb034068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:40.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.613+0000 7fb058382640 1 --2- 172.21.15.55:0/2836117140 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fb0340663a0 0x7fb034068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb050157fa0 tx=0x7fb040008040 comp rx=0 tx=0).stop 2023-07-06T22:18:40.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.613+0000 7fb058382640 1 -- 172.21.15.55:0/2836117140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0500b4130 msgr2=0x7fb05014f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:40.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.613+0000 7fb058382640 1 --2- 172.21.15.55:0/2836117140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0500b4130 0x7fb05014f9a0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fb04c0ad040 tx=0x7fb04c01ad60 comp rx=0 tx=0).stop 2023-07-06T22:18:40.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.617+0000 7fb058382640 1 -- 172.21.15.55:0/2836117140 shutdown_connections 2023-07-06T22:18:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.617+0000 7fb058382640 1 --2- 172.21.15.55:0/2836117140 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fb0340663a0 0x7fb034068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.617+0000 7fb058382640 1 --2- 172.21.15.55:0/2836117140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0500cc870 0x7fb0501527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.617+0000 7fb058382640 1 --2- 172.21.15.55:0/2836117140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb0500b7b90 0x7fb0500b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.617+0000 7fb058382640 1 --2- 172.21.15.55:0/2836117140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0500b4130 0x7fb05014f9a0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.617+0000 7fb058382640 1 -- 172.21.15.55:0/2836117140 >> 172.21.15.55:0/2836117140 conn(0x7fb0500ceca0 msgr2=0x7fb0500b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:40.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.617+0000 7fb058382640 1 -- 172.21.15.55:0/2836117140 shutdown_connections 2023-07-06T22:18:40.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.617+0000 7fb058382640 1 -- 172.21.15.55:0/2836117140 wait complete. 2023-07-06T22:18:40.650 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:18:40.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff935697640 1 Processor -- start 2023-07-06T22:18:40.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff935697640 1 -- start start 2023-07-06T22:18:40.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff935697640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9300b12e0 0x7ff9300d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:40.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff935697640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9300d00f0 0x7ff9300d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:40.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff935697640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff9300b1a40 0x7ff9300b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:40.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff935697640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9300b3be0 con 0x7ff9300d00f0 2023-07-06T22:18:40.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff935697640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9300b4590 con 0x7ff9300b1a40 2023-07-06T22:18:40.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff935697640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300cc6a0 con 0x7ff9300b12e0 2023-07-06T22:18:40.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff92f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9300d00f0 0x7ff9300d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:40.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff92f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9300d00f0 0x7ff9300d0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43780/0 (socket says 172.21.15.55:43780) 2023-07-06T22:18:40.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff92f7fe640 1 -- 172.21.15.55:0/3527450644 learned_addr learned my addr 172.21.15.55:0/3527450644 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:40.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff92ffff640 1 --2- 172.21.15.55:0/3527450644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9300b12e0 0x7ff9300d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:40.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff934e96640 1 --2- 172.21.15.55:0/3527450644 >> v2:172.21.15.138:3300/0 conn(0x7ff9300b1a40 0x7ff9300b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:40.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff92f7fe640 1 -- 172.21.15.55:0/3527450644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9300b12e0 msgr2=0x7ff9300d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:40.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff92f7fe640 1 --2- 172.21.15.55:0/3527450644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9300b12e0 0x7ff9300d1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff92f7fe640 1 -- 172.21.15.55:0/3527450644 >> v2:172.21.15.138:3300/0 conn(0x7ff9300b1a40 msgr2=0x7ff9300b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:40.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff92f7fe640 1 --2- 172.21.15.55:0/3527450644 >> v2:172.21.15.138:3300/0 conn(0x7ff9300b1a40 0x7ff9300b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff92f7fe640 1 -- 172.21.15.55:0/3527450644 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9300d0a80 con 0x7ff9300d00f0 2023-07-06T22:18:40.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.793+0000 7ff92ffff640 1 --2- 172.21.15.55:0/3527450644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9300b12e0 0x7ff9300d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:40.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.797+0000 7ff92f7fe640 1 --2- 172.21.15.55:0/3527450644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9300d00f0 0x7ff9300d0540 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7ff9300d2c80 tx=0x7ff92401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53adcb251f320420 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:40.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.797+0000 7ff92effd640 1 -- 172.21.15.55:0/3527450644 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9240ab600 con 0x7ff9300d00f0 2023-07-06T22:18:40.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.797+0000 7ff92effd640 1 -- 172.21.15.55:0/3527450644 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9240a7050 con 0x7ff9300d00f0 2023-07-06T22:18:40.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.797+0000 7ff92effd640 1 -- 172.21.15.55:0/3527450644 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9240ab980 con 0x7ff9300d00f0 2023-07-06T22:18:40.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.797+0000 7ff935697640 1 -- 172.21.15.55:0/3527450644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9300d00f0 msgr2=0x7ff9300d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:40.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.797+0000 7ff935697640 1 --2- 172.21.15.55:0/3527450644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9300d00f0 0x7ff9300d0540 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7ff9300d2c80 tx=0x7ff92401c500 comp rx=0 tx=0).stop 2023-07-06T22:18:40.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.797+0000 7ff935697640 1 -- 172.21.15.55:0/3527450644 shutdown_connections 2023-07-06T22:18:40.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.797+0000 7ff935697640 1 --2- 172.21.15.55:0/3527450644 >> v2:172.21.15.138:3300/0 conn(0x7ff9300b1a40 0x7ff9300b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.797+0000 7ff935697640 1 --2- 172.21.15.55:0/3527450644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9300d00f0 0x7ff9300d0540 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.797+0000 7ff935697640 1 --2- 172.21.15.55:0/3527450644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9300b12e0 0x7ff9300d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.797+0000 7ff935697640 1 -- 172.21.15.55:0/3527450644 >> 172.21.15.55:0/3527450644 conn(0x7ff9300d20e0 msgr2=0x7ff9300d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:40.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.797+0000 7ff935697640 1 -- 172.21.15.55:0/3527450644 shutdown_connections 2023-07-06T22:18:40.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.797+0000 7ff935697640 1 -- 172.21.15.55:0/3527450644 wait complete. 2023-07-06T22:18:40.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.797+0000 7ff935697640 1 Processor -- start 2023-07-06T22:18:40.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff935697640 1 -- start start 2023-07-06T22:18:40.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff935697640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9300b12e0 0x7ff930150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:40.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff935697640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9300b1a40 0x7ff93014e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:40.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff935697640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9300d00f0 0x7ff930151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:40.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff935697640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93015ae80 con 0x7ff9300d00f0 2023-07-06T22:18:40.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff935697640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93015d0e0 con 0x7ff9300b12e0 2023-07-06T22:18:40.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff935697640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93014ee00 con 0x7ff9300b1a40 2023-07-06T22:18:40.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff934e96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9300d00f0 0x7ff930151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:40.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff934e96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9300d00f0 0x7ff930151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43792/0 (socket says 172.21.15.55:43792) 2023-07-06T22:18:40.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff934e96640 1 -- 172.21.15.55:0/2404927176 learned_addr learned my addr 172.21.15.55:0/2404927176 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:40.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff92f7fe640 1 --2- 172.21.15.55:0/2404927176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9300b1a40 0x7ff93014e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:40.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff92ffff640 1 --2- 172.21.15.55:0/2404927176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9300b12e0 0x7ff930150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:40.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff934e96640 1 -- 172.21.15.55:0/2404927176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9300b1a40 msgr2=0x7ff93014e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:40.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff934e96640 1 --2- 172.21.15.55:0/2404927176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9300b1a40 0x7ff93014e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff934e96640 1 -- 172.21.15.55:0/2404927176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9300b12e0 msgr2=0x7ff930150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:40.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff934e96640 1 --2- 172.21.15.55:0/2404927176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9300b12e0 0x7ff930150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff934e96640 1 -- 172.21.15.55:0/2404927176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9240094d0 con 0x7ff9300d00f0 2023-07-06T22:18:40.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff934e96640 1 --2- 172.21.15.55:0/2404927176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9300d00f0 0x7ff930151650 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7ff928009dd0 tx=0x7ff92800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:40.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff92cff9640 1 -- 172.21.15.55:0/2404927176 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928014480 con 0x7ff9300d00f0 2023-07-06T22:18:40.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff92cff9640 1 -- 172.21.15.55:0/2404927176 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92800f040 con 0x7ff9300d00f0 2023-07-06T22:18:40.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff92cff9640 1 -- 172.21.15.55:0/2404927176 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928014840 con 0x7ff9300d00f0 2023-07-06T22:18:40.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff935697640 1 -- 172.21.15.55:0/2404927176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93015cd60 con 0x7ff9300d00f0 2023-07-06T22:18:40.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff935697640 1 -- 172.21.15.55:0/2404927176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93015a5e0 con 0x7ff9300d00f0 2023-07-06T22:18:40.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.801+0000 7ff935697640 1 -- 172.21.15.55:0/2404927176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93015d220 con 0x7ff9300d00f0 2023-07-06T22:18:40.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.805+0000 7ff92cff9640 1 -- 172.21.15.55:0/2404927176 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff9280149a0 con 0x7ff9300d00f0 2023-07-06T22:18:40.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.805+0000 7ff92cff9640 1 --2- 172.21.15.55:0/2404927176 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff91c0663a0 0x7ff91c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:40.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.805+0000 7ff92cff9640 1 -- 172.21.15.55:0/2404927176 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff928084b40 con 0x7ff9300d00f0 2023-07-06T22:18:40.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.805+0000 7ff92ffff640 1 --2- 172.21.15.55:0/2404927176 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff91c0663a0 0x7ff91c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:40.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.805+0000 7ff92ffff640 1 --2- 172.21.15.55:0/2404927176 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff91c0663a0 0x7ff91c068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff9200098d0 tx=0x7ff920008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:40.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.809+0000 7ff92cff9640 1 -- 172.21.15.55:0/2404927176 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff928051ce0 con 0x7ff9300d00f0 2023-07-06T22:18:40.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.965+0000 7ff935697640 1 -- 172.21.15.55:0/2404927176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff93004d790 con 0x7ff9300d00f0 2023-07-06T22:18:40.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.965+0000 7ff92cff9640 1 -- 172.21.15.55:0/2404927176 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+18603 (secure 0 0 0) 0x7ff928055300 con 0x7ff9300d00f0 2023-07-06T22:18:40.966 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:40.966 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":178,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:18:40.591859+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:18:38.520955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-07-06T22:18:39.591879+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:18:40.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.965+0000 7ff935697640 1 -- 172.21.15.55:0/2404927176 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff91c0663a0 msgr2=0x7ff91c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:40.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.965+0000 7ff935697640 1 --2- 172.21.15.55:0/2404927176 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff91c0663a0 0x7ff91c068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff9200098d0 tx=0x7ff920008040 comp rx=0 tx=0).stop 2023-07-06T22:18:40.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.965+0000 7ff935697640 1 -- 172.21.15.55:0/2404927176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9300d00f0 msgr2=0x7ff930151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:40.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.965+0000 7ff935697640 1 --2- 172.21.15.55:0/2404927176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9300d00f0 0x7ff930151650 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7ff928009dd0 tx=0x7ff92800c490 comp rx=0 tx=0).stop 2023-07-06T22:18:40.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.965+0000 7ff935697640 1 -- 172.21.15.55:0/2404927176 shutdown_connections 2023-07-06T22:18:40.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.965+0000 7ff935697640 1 --2- 172.21.15.55:0/2404927176 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff91c0663a0 0x7ff91c068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.965+0000 7ff935697640 1 --2- 172.21.15.55:0/2404927176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9300d00f0 0x7ff930151650 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.965+0000 7ff935697640 1 --2- 172.21.15.55:0/2404927176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9300b1a40 0x7ff93014e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.965+0000 7ff935697640 1 --2- 172.21.15.55:0/2404927176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9300b12e0 0x7ff930150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.965+0000 7ff935697640 1 -- 172.21.15.55:0/2404927176 >> 172.21.15.55:0/2404927176 conn(0x7ff9300d20e0 msgr2=0x7ff930069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.965+0000 7ff935697640 1 -- 172.21.15.55:0/2404927176 shutdown_connections 2023-07-06T22:18:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:40.965+0000 7ff935697640 1 -- 172.21.15.55:0/2404927176 wait complete. 2023-07-06T22:18:40.987 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:18:41.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.129+0000 7f1687ffa640 1 Processor -- start 2023-07-06T22:18:41.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.129+0000 7f1687ffa640 1 -- start start 2023-07-06T22:18:41.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.129+0000 7f1687ffa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f168015fd40 0x7f168006e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:41.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.129+0000 7f1687ffa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f168006caf0 0x7f16800ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:41.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.129+0000 7f1687ffa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16800ca880 con 0x7f1680160110 2023-07-06T22:18:41.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.129+0000 7f1687ffa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168015cd90 con 0x7f168006caf0 2023-07-06T22:18:41.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.129+0000 7f1687ffa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16800c9c90 con 0x7f168015fd40 2023-07-06T22:18:41.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.133+0000 7f1686597640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f168006caf0 0x7f16800ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:41.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.133+0000 7f1686597640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f168006caf0 0x7f16800ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43808/0 (socket says 172.21.15.55:43808) 2023-07-06T22:18:41.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.133+0000 7f1685d96640 1 --2- 172.21.15.55:0/76445135 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f168015fd40 0x7f168006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:41.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.133+0000 7f1686597640 1 -- 172.21.15.55:0/76445135 learned_addr learned my addr 172.21.15.55:0/76445135 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:41.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.133+0000 7f1686597640 1 -- 172.21.15.55:0/76445135 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f168015fd40 msgr2=0x7f168006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:41.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.133+0000 7f1686597640 1 --2- 172.21.15.55:0/76445135 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f168015fd40 0x7f168006e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.133+0000 7f1686597640 1 -- 172.21.15.55:0/76445135 >> v1:172.21.15.138:6789/0 conn(0x7f1680160110 legacy=0x7f168006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:41.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.133+0000 7f1684d94640 1 -- 172.21.15.55:0/76445135 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377341169 0 0) 0x7f16800ca880 con 0x7f1680160110 2023-07-06T22:18:41.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.133+0000 7f1686597640 1 -- 172.21.15.55:0/76445135 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16800c9f50 con 0x7f168006caf0 2023-07-06T22:18:41.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.133+0000 7f1686597640 1 --2- 172.21.15.55:0/76445135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f168006caf0 0x7f16800ccb40 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f1678009e50 tx=0x7f167801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e25adb27edb2ff server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:41.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.133+0000 7f1684d94640 1 -- 172.21.15.55:0/76445135 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16780a58a0 con 0x7f168006caf0 2023-07-06T22:18:41.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.133+0000 7f1684d94640 1 -- 172.21.15.55:0/76445135 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16780a5a00 con 0x7f168006caf0 2023-07-06T22:18:41.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.133+0000 7f1684d94640 1 -- 172.21.15.55:0/76445135 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16780a5d90 con 0x7f168006caf0 2023-07-06T22:18:41.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 -- 172.21.15.55:0/76445135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f168006caf0 msgr2=0x7f16800ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:41.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 --2- 172.21.15.55:0/76445135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f168006caf0 0x7f16800ccb40 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f1678009e50 tx=0x7f167801c9e0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 -- 172.21.15.55:0/76445135 shutdown_connections 2023-07-06T22:18:41.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 --2- 172.21.15.55:0/76445135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f168006caf0 0x7f16800ccb40 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 --2- 172.21.15.55:0/76445135 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f168015fd40 0x7f168006e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 -- 172.21.15.55:0/76445135 >> 172.21.15.55:0/76445135 conn(0x7f16800b1730 msgr2=0x7f16800cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:41.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 -- 172.21.15.55:0/76445135 shutdown_connections 2023-07-06T22:18:41.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 -- 172.21.15.55:0/76445135 wait complete. 2023-07-06T22:18:41.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 Processor -- start 2023-07-06T22:18:41.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 -- start start 2023-07-06T22:18:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f168006caf0 0x7f1680148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f168015fd40 0x7f168014c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1680160110 0x7f168014cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168015a350 con 0x7f168015fd40 2023-07-06T22:18:41.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168015a630 con 0x7f1680160110 2023-07-06T22:18:41.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1687ffa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168015a910 con 0x7f168006caf0 2023-07-06T22:18:41.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1685595640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f168015fd40 0x7f168014c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:41.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1685595640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f168015fd40 0x7f168014c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43816/0 (socket says 172.21.15.55:43816) 2023-07-06T22:18:41.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1685595640 1 -- 172.21.15.55:0/2231339941 learned_addr learned my addr 172.21.15.55:0/2231339941 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:41.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1685d96640 1 --2- 172.21.15.55:0/2231339941 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f168006caf0 0x7f1680148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:41.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1686597640 1 --2- 172.21.15.55:0/2231339941 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1680160110 0x7f168014cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:41.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1685595640 1 -- 172.21.15.55:0/2231339941 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f168006caf0 msgr2=0x7f1680148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1685595640 1 --2- 172.21.15.55:0/2231339941 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f168006caf0 0x7f1680148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1685595640 1 -- 172.21.15.55:0/2231339941 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1680160110 msgr2=0x7f168014cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1685595640 1 --2- 172.21.15.55:0/2231339941 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1680160110 0x7f168014cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.137+0000 7f1685595640 1 -- 172.21.15.55:0/2231339941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678009b30 con 0x7f168015fd40 2023-07-06T22:18:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.141+0000 7f1685595640 1 --2- 172.21.15.55:0/2231339941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f168015fd40 0x7f168014c660 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f1670001ec0 tx=0x7f167000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.141+0000 7f16767fc640 1 -- 172.21.15.55:0/2231339941 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16700054e0 con 0x7f168015fd40 2023-07-06T22:18:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.141+0000 7f16767fc640 1 -- 172.21.15.55:0/2231339941 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1670003600 con 0x7f168015fd40 2023-07-06T22:18:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.141+0000 7f16767fc640 1 -- 172.21.15.55:0/2231339941 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16700039b0 con 0x7f168015fd40 2023-07-06T22:18:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.141+0000 7f1687ffa640 1 -- 172.21.15.55:0/2231339941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168006ec50 con 0x7f168015fd40 2023-07-06T22:18:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.141+0000 7f1687ffa640 1 -- 172.21.15.55:0/2231339941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168015aed0 con 0x7f168015fd40 2023-07-06T22:18:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.141+0000 7f1687ffa640 1 -- 172.21.15.55:0/2231339941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168015b090 con 0x7f168015fd40 2023-07-06T22:18:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.141+0000 7f16767fc640 1 -- 172.21.15.55:0/2231339941 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1670003b10 con 0x7f168015fd40 2023-07-06T22:18:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.141+0000 7f16767fc640 1 --2- 172.21.15.55:0/2231339941 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f16640663a0 0x7f1664068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.145+0000 7f16767fc640 1 -- 172.21.15.55:0/2231339941 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1670083570 con 0x7f168015fd40 2023-07-06T22:18:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.145+0000 7f1685d96640 1 --2- 172.21.15.55:0/2231339941 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f16640663a0 0x7f1664068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:41.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.145+0000 7f1685d96640 1 --2- 172.21.15.55:0/2231339941 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f16640663a0 0x7f1664068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f167c009b60 tx=0x7f167c009190 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.145+0000 7f16767fc640 1 -- 172.21.15.55:0/2231339941 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1670050820 con 0x7f168015fd40 2023-07-06T22:18:41.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.301+0000 7f1687ffa640 1 -- 172.21.15.55:0/2231339941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1680066d60 con 0x7f168015fd40 2023-07-06T22:18:41.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.305+0000 7f16767fc640 1 -- 172.21.15.55:0/2231339941 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+18603 (secure 0 0 0) 0x7f1670053e40 con 0x7f168015fd40 2023-07-06T22:18:41.305 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:41.305 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":178,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:18:40.591859+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:18:38.520955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-07-06T22:18:39.591879+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:18:41.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.305+0000 7f1687ffa640 1 -- 172.21.15.55:0/2231339941 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f16640663a0 msgr2=0x7f1664068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:41.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.305+0000 7f1687ffa640 1 --2- 172.21.15.55:0/2231339941 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f16640663a0 0x7f1664068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f167c009b60 tx=0x7f167c009190 comp rx=0 tx=0).stop 2023-07-06T22:18:41.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.305+0000 7f1687ffa640 1 -- 172.21.15.55:0/2231339941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f168015fd40 msgr2=0x7f168014c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:41.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.305+0000 7f1687ffa640 1 --2- 172.21.15.55:0/2231339941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f168015fd40 0x7f168014c660 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f1670001ec0 tx=0x7f167000c8e0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.305+0000 7f1687ffa640 1 -- 172.21.15.55:0/2231339941 shutdown_connections 2023-07-06T22:18:41.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.305+0000 7f1687ffa640 1 --2- 172.21.15.55:0/2231339941 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f16640663a0 0x7f1664068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.305+0000 7f1687ffa640 1 --2- 172.21.15.55:0/2231339941 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1680160110 0x7f168014cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.305+0000 7f1687ffa640 1 --2- 172.21.15.55:0/2231339941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f168015fd40 0x7f168014c660 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.305+0000 7f1687ffa640 1 --2- 172.21.15.55:0/2231339941 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f168006caf0 0x7f1680148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.305+0000 7f1687ffa640 1 -- 172.21.15.55:0/2231339941 >> 172.21.15.55:0/2231339941 conn(0x7f16800b1730 msgr2=0x7f16800cbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:41.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.305+0000 7f1687ffa640 1 -- 172.21.15.55:0/2231339941 shutdown_connections 2023-07-06T22:18:41.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.305+0000 7f1687ffa640 1 -- 172.21.15.55:0/2231339941 wait complete. 2023-07-06T22:18:41.326 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T22:18:41.368 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:18:41.378 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:18:41.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c6ccb640 1 Processor -- start 2023-07-06T22:18:41.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c6ccb640 1 -- start start 2023-07-06T22:18:41.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c6ccb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68c00b7b90 0x7f68c00d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c6ccb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f68c00b4300 0x7f68c00b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c6ccb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c00b5070 con 0x7f68c00cc870 2023-07-06T22:18:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c6ccb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c0160020 con 0x7f68c00b7b90 2023-07-06T22:18:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c6ccb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c01604b0 con 0x7f68c00b4300 2023-07-06T22:18:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c4a67640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68c00b7b90 0x7f68c00d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c4a67640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68c00b7b90 0x7f68c00d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43820/0 (socket says 172.21.15.55:43820) 2023-07-06T22:18:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c4a67640 1 -- 172.21.15.55:0/3303640176 learned_addr learned my addr 172.21.15.55:0/3303640176 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:41.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c5268640 1 --2- 172.21.15.55:0/3303640176 >> v2:172.21.15.138:3300/0 conn(0x7f68c00b4300 0x7f68c00b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:41.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c4a67640 1 -- 172.21.15.55:0/3303640176 >> v2:172.21.15.138:3300/0 conn(0x7f68c00b4300 msgr2=0x7f68c00b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:41.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c4a67640 1 --2- 172.21.15.55:0/3303640176 >> v2:172.21.15.138:3300/0 conn(0x7f68c00b4300 0x7f68c00b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c4a67640 1 -- 172.21.15.55:0/3303640176 >> v1:172.21.15.138:6789/0 conn(0x7f68c00cc870 legacy=0x7f68c00b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:41.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.473+0000 7f68c4a67640 1 -- 172.21.15.55:0/3303640176 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00cd030 con 0x7f68c00b7b90 2023-07-06T22:18:41.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.477+0000 7f68c4a67640 1 --2- 172.21.15.55:0/3303640176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68c00b7b90 0x7f68c00d1c40 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f68c006c6a0 tx=0x7f68b401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddf0f48474ce4c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:41.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.477+0000 7f68bf7fe640 1 -- 172.21.15.55:0/3303640176 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40aa5f0 con 0x7f68c00b7b90 2023-07-06T22:18:41.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.477+0000 7f68bf7fe640 1 -- 172.21.15.55:0/3303640176 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b40aa750 con 0x7f68c00b7b90 2023-07-06T22:18:41.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.477+0000 7f68bf7fe640 1 -- 172.21.15.55:0/3303640176 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40aaae0 con 0x7f68c00b7b90 2023-07-06T22:18:41.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.477+0000 7f68c6ccb640 1 -- 172.21.15.55:0/3303640176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68c00b7b90 msgr2=0x7f68c00d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:41.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.477+0000 7f68c6ccb640 1 --2- 172.21.15.55:0/3303640176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68c00b7b90 0x7f68c00d1c40 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f68c006c6a0 tx=0x7f68b401c490 comp rx=0 tx=0).stop 2023-07-06T22:18:41.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.477+0000 7f68c6ccb640 1 -- 172.21.15.55:0/3303640176 shutdown_connections 2023-07-06T22:18:41.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.477+0000 7f68c6ccb640 1 --2- 172.21.15.55:0/3303640176 >> v2:172.21.15.138:3300/0 conn(0x7f68c00b4300 0x7f68c00b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.477+0000 7f68c6ccb640 1 --2- 172.21.15.55:0/3303640176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68c00b7b90 0x7f68c00d1c40 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.477+0000 7f68c6ccb640 1 -- 172.21.15.55:0/3303640176 >> 172.21.15.55:0/3303640176 conn(0x7f68c00ceca0 msgr2=0x7f68c00cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:41.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.477+0000 7f68c6ccb640 1 -- 172.21.15.55:0/3303640176 shutdown_connections 2023-07-06T22:18:41.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.477+0000 7f68c6ccb640 1 -- 172.21.15.55:0/3303640176 wait complete. 2023-07-06T22:18:41.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68c6ccb640 1 Processor -- start 2023-07-06T22:18:41.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68c6ccb640 1 -- start start 2023-07-06T22:18:41.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68c6ccb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68c00b4300 0x7f68c00c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:41.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68c6ccb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68c00b7b90 0x7f68c01f7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:41.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68c6ccb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68c00cc870 0x7f68c00d0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:41.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68c6ccb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00c9870 con 0x7f68c00b7b90 2023-07-06T22:18:41.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68c6ccb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c01f80a0 con 0x7f68c00b4300 2023-07-06T22:18:41.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68c6ccb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c01f7ae0 con 0x7f68c00cc870 2023-07-06T22:18:41.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68c00b7b90 0x7f68c01f7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:41.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68c00b7b90 0x7f68c01f7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43832/0 (socket says 172.21.15.55:43832) 2023-07-06T22:18:41.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68bffff640 1 -- 172.21.15.55:0/2385710235 learned_addr learned my addr 172.21.15.55:0/2385710235 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:41.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68c4a67640 1 --2- 172.21.15.55:0/2385710235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68c00b4300 0x7f68c00c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:41.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68c5268640 1 --2- 172.21.15.55:0/2385710235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68c00cc870 0x7f68c00d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:41.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68bffff640 1 -- 172.21.15.55:0/2385710235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68c00cc870 msgr2=0x7f68c00d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:41.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68bffff640 1 --2- 172.21.15.55:0/2385710235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68c00cc870 0x7f68c00d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68bffff640 1 -- 172.21.15.55:0/2385710235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68c00b4300 msgr2=0x7f68c00c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:41.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68bffff640 1 --2- 172.21.15.55:0/2385710235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68c00b4300 0x7f68c00c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:41.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68bffff640 1 -- 172.21.15.55:0/2385710235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40094d0 con 0x7f68c00b7b90 2023-07-06T22:18:41.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68bffff640 1 --2- 172.21.15.55:0/2385710235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68c00b7b90 0x7f68c01f7170 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00b410 tx=0x7f68ac00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:41.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68bd7fa640 1 -- 172.21.15.55:0/2385710235 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac004020 con 0x7f68c00b7b90 2023-07-06T22:18:41.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68bd7fa640 1 -- 172.21.15.55:0/2385710235 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac004180 con 0x7f68c00b7b90 2023-07-06T22:18:41.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68bd7fa640 1 -- 172.21.15.55:0/2385710235 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac011630 con 0x7f68c00b7b90 2023-07-06T22:18:41.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68c6ccb640 1 -- 172.21.15.55:0/2385710235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c01f7dc0 con 0x7f68c00b7b90 2023-07-06T22:18:41.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.481+0000 7f68c6ccb640 1 -- 172.21.15.55:0/2385710235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c00ca1d0 con 0x7f68c00b7b90 2023-07-06T22:18:41.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.485+0000 7f68c6ccb640 1 -- 172.21.15.55:0/2385710235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c00c99b0 con 0x7f68c00b7b90 2023-07-06T22:18:41.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.485+0000 7f68bd7fa640 1 -- 172.21.15.55:0/2385710235 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f68ac011790 con 0x7f68c00b7b90 2023-07-06T22:18:41.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.485+0000 7f68bd7fa640 1 --2- 172.21.15.55:0/2385710235 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f68a40663a0 0x7f68a4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:41.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.485+0000 7f68bd7fa640 1 -- 172.21.15.55:0/2385710235 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f68ac083be0 con 0x7f68c00b7b90 2023-07-06T22:18:41.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.485+0000 7f68c4a67640 1 --2- 172.21.15.55:0/2385710235 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f68a40663a0 0x7f68a4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:41.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.485+0000 7f68c4a67640 1 --2- 172.21.15.55:0/2385710235 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f68a40663a0 0x7f68a4068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f68b40ae000 tx=0x7f68b40b5040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:41.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.489+0000 7f68bd7fa640 1 -- 172.21.15.55:0/2385710235 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f68c00c99b0 con 0x7f68c00b7b90 2023-07-06T22:18:41.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:41.681+0000 7f68c6ccb640 1 -- 172.21.15.55:0/2385710235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f68c00c99b0 con 0x7f68c00b7b90 2023-07-06T22:18:42.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.617+0000 7f68bd7fa640 1 -- 172.21.15.55:0/2385710235 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v78) v1 ==== 118+0+0 (secure 0 0 0) 0x7f68c00c99b0 con 0x7f68c00b7b90 2023-07-06T22:18:42.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.621+0000 7f68c6ccb640 1 -- 172.21.15.55:0/2385710235 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f68a40663a0 msgr2=0x7f68a4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:42.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.621+0000 7f68c6ccb640 1 --2- 172.21.15.55:0/2385710235 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f68a40663a0 0x7f68a4068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f68b40ae000 tx=0x7f68b40b5040 comp rx=0 tx=0).stop 2023-07-06T22:18:42.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.621+0000 7f68c6ccb640 1 -- 172.21.15.55:0/2385710235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68c00b7b90 msgr2=0x7f68c01f7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:42.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.621+0000 7f68c6ccb640 1 --2- 172.21.15.55:0/2385710235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68c00b7b90 0x7f68c01f7170 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00b410 tx=0x7f68ac00b8d0 comp rx=0 tx=0).stop 2023-07-06T22:18:42.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.621+0000 7f68c6ccb640 1 -- 172.21.15.55:0/2385710235 shutdown_connections 2023-07-06T22:18:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.621+0000 7f68c6ccb640 1 --2- 172.21.15.55:0/2385710235 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f68a40663a0 0x7f68a4068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.621+0000 7f68c6ccb640 1 --2- 172.21.15.55:0/2385710235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68c00cc870 0x7f68c00d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.621+0000 7f68c6ccb640 1 --2- 172.21.15.55:0/2385710235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68c00b7b90 0x7f68c01f7170 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.621+0000 7f68c6ccb640 1 --2- 172.21.15.55:0/2385710235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68c00b4300 0x7f68c00c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.621+0000 7f68c6ccb640 1 -- 172.21.15.55:0/2385710235 >> 172.21.15.55:0/2385710235 conn(0x7f68c00ceca0 msgr2=0x7f68c00d0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.621+0000 7f68c6ccb640 1 -- 172.21.15.55:0/2385710235 shutdown_connections 2023-07-06T22:18:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.621+0000 7f68c6ccb640 1 -- 172.21.15.55:0/2385710235 wait complete. 2023-07-06T22:18:42.643 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-06T22:18:42.644 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T22:18:42.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.793+0000 7f417d034640 1 Processor -- start 2023-07-06T22:18:42.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.793+0000 7f417d034640 1 -- start start 2023-07-06T22:18:42.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.797+0000 7f417d034640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41780cd140 0x7f4178163380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:42.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.797+0000 7f417d034640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41780b2aa0 con 0x7f41780ca130 2023-07-06T22:18:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.797+0000 7f417d034640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4178158c20 con 0x7f4178158850 2023-07-06T22:18:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.797+0000 7f417d034640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c8db0 con 0x7f41780cd140 2023-07-06T22:18:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.797+0000 7f416ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f41780ca130 0x7f41780703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55268/0 (socket says 172.21.15.55:55268) 2023-07-06T22:18:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.797+0000 7f416ffff640 1 -- 172.21.15.55:0/200919629 learned_addr learned my addr 172.21.15.55:0/200919629 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.797+0000 7f417759e640 1 --2- 172.21.15.55:0/200919629 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41780cd140 0x7f4178163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:42.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.797+0000 7f417659c640 1 -- 172.21.15.55:0/200919629 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295321755 0 0) 0x7f41780b2aa0 con 0x7f41780ca130 2023-07-06T22:18:42.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.797+0000 7f417659c640 1 -- 172.21.15.55:0/200919629 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4164005740 con 0x7f41780ca130 2023-07-06T22:18:42.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.797+0000 7f417659c640 1 -- 172.21.15.55:0/200919629 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704032704 0 0) 0x7f4178158c20 con 0x7f4178158850 2023-07-06T22:18:42.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.797+0000 7f417659c640 1 -- 172.21.15.55:0/200919629 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41780b2aa0 con 0x7f4178158850 2023-07-06T22:18:42.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.797+0000 7f417759e640 1 -- 172.21.15.55:0/200919629 >> v1:172.21.15.138:6789/0 conn(0x7f4178158850 legacy=0x7f41780cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:42.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.797+0000 7f417759e640 1 -- 172.21.15.55:0/200919629 >> v1:172.21.15.55:6789/0 conn(0x7f41780ca130 legacy=0x7f41780703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:42.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.797+0000 7f417759e640 1 -- 172.21.15.55:0/200919629 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41780c9090 con 0x7f41780cd140 2023-07-06T22:18:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.801+0000 7f417759e640 1 --2- 172.21.15.55:0/200919629 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41780cd140 0x7f4178163380 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4170009dc0 tx=0x7f417001f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8af71e7620078a32 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.801+0000 7f417659c640 1 -- 172.21.15.55:0/200919629 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700af600 con 0x7f41780cd140 2023-07-06T22:18:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.801+0000 7f417659c640 1 -- 172.21.15.55:0/200919629 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41700ab050 con 0x7f41780cd140 2023-07-06T22:18:42.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.801+0000 7f417659c640 1 -- 172.21.15.55:0/200919629 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700af980 con 0x7f41780cd140 2023-07-06T22:18:42.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.801+0000 7f417d034640 1 -- 172.21.15.55:0/200919629 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41780cd140 msgr2=0x7f4178163380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:42.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.801+0000 7f417d034640 1 --2- 172.21.15.55:0/200919629 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41780cd140 0x7f4178163380 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4170009dc0 tx=0x7f417001f150 comp rx=0 tx=0).stop 2023-07-06T22:18:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.801+0000 7f417d034640 1 -- 172.21.15.55:0/200919629 shutdown_connections 2023-07-06T22:18:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.801+0000 7f417d034640 1 --2- 172.21.15.55:0/200919629 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41780cd140 0x7f4178163380 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.801+0000 7f417d034640 1 -- 172.21.15.55:0/200919629 >> 172.21.15.55:0/200919629 conn(0x7f41780cea70 msgr2=0x7f41780ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.801+0000 7f417d034640 1 -- 172.21.15.55:0/200919629 shutdown_connections 2023-07-06T22:18:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.801+0000 7f417d034640 1 -- 172.21.15.55:0/200919629 wait complete. 2023-07-06T22:18:42.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.801+0000 7f417d034640 1 Processor -- start 2023-07-06T22:18:42.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.801+0000 7f417d034640 1 -- start start 2023-07-06T22:18:42.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f417d034640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41780ca130 0x7f417806a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:42.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f417d034640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41780cd140 0x7f41781f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f417d034640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4178158850 0x7f4178155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f417d034640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417806a5e0 con 0x7f41780ca130 2023-07-06T22:18:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f417d034640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417806a8c0 con 0x7f4178158850 2023-07-06T22:18:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f417d034640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417806aba0 con 0x7f41780cd140 2023-07-06T22:18:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f4176d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41780ca130 0x7f417806a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f4176d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41780ca130 0x7f417806a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43846/0 (socket says 172.21.15.55:43846) 2023-07-06T22:18:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f4176d9d640 1 -- 172.21.15.55:0/3065268839 learned_addr learned my addr 172.21.15.55:0/3065268839 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:42.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f416ffff640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41780cd140 0x7f41781f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:42.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f417759e640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4178158850 0x7f4178155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:42.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f4176d9d640 1 -- 172.21.15.55:0/3065268839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41780cd140 msgr2=0x7f41781f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:42.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f4176d9d640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41780cd140 0x7f41781f0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:42.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f4176d9d640 1 -- 172.21.15.55:0/3065268839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4178158850 msgr2=0x7f4178155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:42.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f4176d9d640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4178158850 0x7f4178155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:42.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f4176d9d640 1 -- 172.21.15.55:0/3065268839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170009a70 con 0x7f41780ca130 2023-07-06T22:18:42.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f417759e640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4178158850 0x7f4178155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:42.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f4176d9d640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41780ca130 0x7f417806a000 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f416800c430 tx=0x7f416800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:42.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f416f7fe640 1 -- 172.21.15.55:0/3065268839 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41680052d0 con 0x7f41780ca130 2023-07-06T22:18:42.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f416f7fe640 1 -- 172.21.15.55:0/3065268839 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4168005450 con 0x7f41780ca130 2023-07-06T22:18:42.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f416f7fe640 1 -- 172.21.15.55:0/3065268839 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4168003840 con 0x7f41780ca130 2023-07-06T22:18:42.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f417d034640 1 -- 172.21.15.55:0/3065268839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41780c64e0 con 0x7f41780ca130 2023-07-06T22:18:42.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f417d034640 1 -- 172.21.15.55:0/3065268839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4178155210 con 0x7f41780ca130 2023-07-06T22:18:42.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f417d034640 1 -- 172.21.15.55:0/3065268839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41780c6340 con 0x7f41780ca130 2023-07-06T22:18:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.805+0000 7f416f7fe640 1 -- 172.21.15.55:0/3065268839 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f41680039a0 con 0x7f41780ca130 2023-07-06T22:18:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.809+0000 7f416f7fe640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f41580663a0 0x7f4158068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.809+0000 7f416f7fe640 1 -- 172.21.15.55:0/3065268839 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f41680834c0 con 0x7f41780ca130 2023-07-06T22:18:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.809+0000 7f416ffff640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f41580663a0 0x7f4158068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:42.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.809+0000 7f416ffff640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f41580663a0 0x7f4158068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f417806cd00 tx=0x7f4160007d40 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:42.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:42.813+0000 7f416f7fe640 1 -- 172.21.15.55:0/3065268839 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f41780c6340 con 0x7f41780ca130 2023-07-06T22:18:43.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.001+0000 7f417d034640 1 -- 172.21.15.55:0/3065268839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f41780c6340 con 0x7f41780ca130 2023-07-06T22:18:43.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.625+0000 7f416f7fe640 1 -- 172.21.15.55:0/3065268839 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v79) v1 ==== 122+0+0 (secure 0 0 0) 0x7f41780c6340 con 0x7f41780ca130 2023-07-06T22:18:43.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.625+0000 7f417d034640 1 -- 172.21.15.55:0/3065268839 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f41580663a0 msgr2=0x7f4158068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:43.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.625+0000 7f417d034640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f41580663a0 0x7f4158068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f417806cd00 tx=0x7f4160007d40 comp rx=0 tx=0).stop 2023-07-06T22:18:43.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.625+0000 7f417d034640 1 -- 172.21.15.55:0/3065268839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41780ca130 msgr2=0x7f417806a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:43.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.625+0000 7f417d034640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41780ca130 0x7f417806a000 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f416800c430 tx=0x7f416800c8f0 comp rx=0 tx=0).stop 2023-07-06T22:18:43.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.625+0000 7f417d034640 1 -- 172.21.15.55:0/3065268839 shutdown_connections 2023-07-06T22:18:43.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.625+0000 7f417d034640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f41580663a0 0x7f4158068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:43.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.625+0000 7f417d034640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4178158850 0x7f4178155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:43.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.625+0000 7f417d034640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f41780cd140 0x7f41781f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:43.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.625+0000 7f417d034640 1 --2- 172.21.15.55:0/3065268839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41780ca130 0x7f417806a000 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:43.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.625+0000 7f417d034640 1 -- 172.21.15.55:0/3065268839 >> 172.21.15.55:0/3065268839 conn(0x7f41780cea70 msgr2=0x7f41780b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:43.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.625+0000 7f417d034640 1 -- 172.21.15.55:0/3065268839 shutdown_connections 2023-07-06T22:18:43.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.625+0000 7f417d034640 1 -- 172.21.15.55:0/3065268839 wait complete. 2023-07-06T22:18:43.649 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T22:18:43.650 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:18:43.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc68511640 1 Processor -- start 2023-07-06T22:18:43.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc68511640 1 -- start start 2023-07-06T22:18:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc68511640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbc600b7cd0 0x7fbc600ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc68511640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc600ccab0 0x7fbc600b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:43.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc68511640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbc600ccf00 0x7fbc600b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc68511640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc600d2310 con 0x7fbc600ccf00 2023-07-06T22:18:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc68511640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc600b80a0 con 0x7fbc600b7cd0 2023-07-06T22:18:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc68511640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600d1100 con 0x7fbc600ccab0 2023-07-06T22:18:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc66aae640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbc600ccf00 0x7fbc600b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc66aae640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbc600ccf00 0x7fbc600b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37116/0 (socket says 172.21.15.55:37116) 2023-07-06T22:18:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc66aae640 1 -- 172.21.15.55:0/525559616 learned_addr learned my addr 172.21.15.55:0/525559616 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc65aac640 1 --2- 172.21.15.55:0/525559616 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc600ccab0 0x7fbc600b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc662ad640 1 --2- 172.21.15.55:0/525559616 >> v2:172.21.15.138:3300/0 conn(0x7fbc600b7cd0 0x7fbc600ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc66aae640 1 -- 172.21.15.55:0/525559616 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc600ccab0 msgr2=0x7fbc600b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc66aae640 1 --2- 172.21.15.55:0/525559616 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc600ccab0 0x7fbc600b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:43.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc66aae640 1 -- 172.21.15.55:0/525559616 >> v2:172.21.15.138:3300/0 conn(0x7fbc600b7cd0 msgr2=0x7fbc600ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:43.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc66aae640 1 --2- 172.21.15.55:0/525559616 >> v2:172.21.15.138:3300/0 conn(0x7fbc600b7cd0 0x7fbc600ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:43.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc66aae640 1 -- 172.21.15.55:0/525559616 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600cecf0 con 0x7fbc600ccf00 2023-07-06T22:18:43.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.797+0000 7fbc662ad640 1 --2- 172.21.15.55:0/525559616 >> v2:172.21.15.138:3300/0 conn(0x7fbc600b7cd0 0x7fbc600ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:43.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.801+0000 7fbc66aae640 1 --2- 172.21.15.55:0/525559616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc600ccf00 0x7fbc600b1e10 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fbc6008b5d0 tx=0x7fbc5801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487f432494266703 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:43.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.801+0000 7fbc652ab640 1 -- 172.21.15.55:0/525559616 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc580a55c0 con 0x7fbc600ccf00 2023-07-06T22:18:43.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.801+0000 7fbc652ab640 1 -- 172.21.15.55:0/525559616 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc580a5720 con 0x7fbc600ccf00 2023-07-06T22:18:43.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.801+0000 7fbc652ab640 1 -- 172.21.15.55:0/525559616 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc580a5ab0 con 0x7fbc600ccf00 2023-07-06T22:18:43.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.801+0000 7fbc68511640 1 -- 172.21.15.55:0/525559616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc600ccf00 msgr2=0x7fbc600b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:43.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.801+0000 7fbc68511640 1 --2- 172.21.15.55:0/525559616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc600ccf00 0x7fbc600b1e10 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fbc6008b5d0 tx=0x7fbc5801c940 comp rx=0 tx=0).stop 2023-07-06T22:18:43.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.801+0000 7fbc68511640 1 -- 172.21.15.55:0/525559616 shutdown_connections 2023-07-06T22:18:43.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.801+0000 7fbc68511640 1 --2- 172.21.15.55:0/525559616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc600ccf00 0x7fbc600b1e10 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:43.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.801+0000 7fbc68511640 1 --2- 172.21.15.55:0/525559616 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc600ccab0 0x7fbc600b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:43.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.801+0000 7fbc68511640 1 --2- 172.21.15.55:0/525559616 >> v2:172.21.15.138:3300/0 conn(0x7fbc600b7cd0 0x7fbc600ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.801+0000 7fbc68511640 1 -- 172.21.15.55:0/525559616 >> 172.21.15.55:0/525559616 conn(0x7fbc600ceee0 msgr2=0x7fbc600cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.801+0000 7fbc68511640 1 -- 172.21.15.55:0/525559616 shutdown_connections 2023-07-06T22:18:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.801+0000 7fbc68511640 1 -- 172.21.15.55:0/525559616 wait complete. 2023-07-06T22:18:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc68511640 1 Processor -- start 2023-07-06T22:18:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc68511640 1 -- start start 2023-07-06T22:18:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc68511640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc600b7cd0 0x7fbc60154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc68511640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc600ccab0 0x7fbc6014cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:43.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc68511640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc600ccf00 0x7fbc6014c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:43.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc68511640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6014efc0 con 0x7fbc600ccf00 2023-07-06T22:18:43.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc68511640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6014d220 con 0x7fbc600b7cd0 2023-07-06T22:18:43.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc68511640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600b6ca0 con 0x7fbc600ccab0 2023-07-06T22:18:43.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc66aae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc600ccf00 0x7fbc6014c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:43.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc66aae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc600ccf00 0x7fbc6014c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37118/0 (socket says 172.21.15.55:37118) 2023-07-06T22:18:43.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc66aae640 1 -- 172.21.15.55:0/2630179183 learned_addr learned my addr 172.21.15.55:0/2630179183 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:43.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc662ad640 1 --2- 172.21.15.55:0/2630179183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc600b7cd0 0x7fbc60154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:43.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc65aac640 1 --2- 172.21.15.55:0/2630179183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc600ccab0 0x7fbc6014cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:43.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc66aae640 1 -- 172.21.15.55:0/2630179183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc600ccab0 msgr2=0x7fbc6014cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:43.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc66aae640 1 --2- 172.21.15.55:0/2630179183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc600ccab0 0x7fbc6014cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:43.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc66aae640 1 -- 172.21.15.55:0/2630179183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc600b7cd0 msgr2=0x7fbc60154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:43.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc66aae640 1 --2- 172.21.15.55:0/2630179183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc600b7cd0 0x7fbc60154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:43.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc66aae640 1 -- 172.21.15.55:0/2630179183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc58009b30 con 0x7fbc600ccf00 2023-07-06T22:18:43.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc66aae640 1 --2- 172.21.15.55:0/2630179183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc600ccf00 0x7fbc6014c3b0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7fbc5801aff0 tx=0x7fbc580196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:43.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc56ffd640 1 -- 172.21.15.55:0/2630179183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc580b8670 con 0x7fbc600ccf00 2023-07-06T22:18:43.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc56ffd640 1 -- 172.21.15.55:0/2630179183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc580b87d0 con 0x7fbc600ccf00 2023-07-06T22:18:43.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc56ffd640 1 -- 172.21.15.55:0/2630179183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc580b8b80 con 0x7fbc600ccf00 2023-07-06T22:18:43.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc68511640 1 -- 172.21.15.55:0/2630179183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc601547e0 con 0x7fbc600ccf00 2023-07-06T22:18:43.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc68511640 1 -- 172.21.15.55:0/2630179183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc601594f0 con 0x7fbc600ccf00 2023-07-06T22:18:43.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.805+0000 7fbc68511640 1 -- 172.21.15.55:0/2630179183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc60066d60 con 0x7fbc600ccf00 2023-07-06T22:18:43.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.809+0000 7fbc56ffd640 1 -- 172.21.15.55:0/2630179183 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbc580b8ce0 con 0x7fbc600ccf00 2023-07-06T22:18:43.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.809+0000 7fbc56ffd640 1 --2- 172.21.15.55:0/2630179183 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbc440663d0 0x7fbc44068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:43.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.809+0000 7fbc56ffd640 1 -- 172.21.15.55:0/2630179183 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fbc5811efa0 con 0x7fbc600ccf00 2023-07-06T22:18:43.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.809+0000 7fbc662ad640 1 --2- 172.21.15.55:0/2630179183 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbc440663d0 0x7fbc44068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:43.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.809+0000 7fbc662ad640 1 --2- 172.21.15.55:0/2630179183 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbc440663d0 0x7fbc44068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00c880 tx=0x7fbc5c008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:43.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:43.813+0000 7fbc56ffd640 1 -- 172.21.15.55:0/2630179183 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc580ec120 con 0x7fbc600ccf00 2023-07-06T22:18:44.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.005+0000 7fbc68511640 1 -- 172.21.15.55:0/2630179183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc600b3690 con 0x7fbc600ccf00 2023-07-06T22:18:44.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.005+0000 7fbc56ffd640 1 -- 172.21.15.55:0/2630179183 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fbc58009510 con 0x7fbc600ccf00 2023-07-06T22:18:44.007 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:44.007 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8420,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/10830186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":10830186},{"type":"v1","addr":"172.21.15.138:6834","nonce":10830186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9577,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3623480690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3623480690},{"type":"v1","addr":"172.21.15.138:6835","nonce":3623480690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":10428,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2297427597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2297427597},{"type":"v1","addr":"172.21.15.55:6835","nonce":2297427597}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:18:40.592191+0000","modified":"2023-07-06T22:18:43.616817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10431":{"gid":10431,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3052024414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3052024414},{"type":"v1","addr":"172.21.15.55:6837","nonce":3052024414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-06T22:18:44.007 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 79 2023-07-06T22:18:44.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.009+0000 7fbc68511640 1 -- 172.21.15.55:0/2630179183 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbc440663d0 msgr2=0x7fbc44068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.009+0000 7fbc68511640 1 --2- 172.21.15.55:0/2630179183 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbc440663d0 0x7fbc44068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00c880 tx=0x7fbc5c008040 comp rx=0 tx=0).stop 2023-07-06T22:18:44.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.009+0000 7fbc68511640 1 -- 172.21.15.55:0/2630179183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc600ccf00 msgr2=0x7fbc6014c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.009+0000 7fbc68511640 1 --2- 172.21.15.55:0/2630179183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc600ccf00 0x7fbc6014c3b0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7fbc5801aff0 tx=0x7fbc580196e0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.009+0000 7fbc68511640 1 -- 172.21.15.55:0/2630179183 shutdown_connections 2023-07-06T22:18:44.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.009+0000 7fbc68511640 1 --2- 172.21.15.55:0/2630179183 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fbc440663d0 0x7fbc44068880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.009+0000 7fbc68511640 1 --2- 172.21.15.55:0/2630179183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc600ccf00 0x7fbc6014c3b0 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.009+0000 7fbc68511640 1 --2- 172.21.15.55:0/2630179183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc600ccab0 0x7fbc6014cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.009+0000 7fbc68511640 1 --2- 172.21.15.55:0/2630179183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc600b7cd0 0x7fbc60154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.009+0000 7fbc68511640 1 -- 172.21.15.55:0/2630179183 >> 172.21.15.55:0/2630179183 conn(0x7fbc600ceee0 msgr2=0x7fbc60154b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:44.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.009+0000 7fbc68511640 1 -- 172.21.15.55:0/2630179183 shutdown_connections 2023-07-06T22:18:44.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.009+0000 7fbc68511640 1 -- 172.21.15.55:0/2630179183 wait complete. 2023-07-06T22:18:44.028 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:18:44.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.169+0000 7fa8c4dfa640 1 Processor -- start 2023-07-06T22:18:44.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.169+0000 7fa8c4dfa640 1 -- start start 2023-07-06T22:18:44.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.169+0000 7fa8c4dfa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa8c0158750 0x7fa8c00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.173+0000 7fa8c4dfa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c0158b20 con 0x7fa8c015cd70 2023-07-06T22:18:44.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.173+0000 7fa8c4dfa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c006bb80 con 0x7fa8c006d330 2023-07-06T22:18:44.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.173+0000 7fa8c4dfa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c00adf60 con 0x7fa8c0158750 2023-07-06T22:18:44.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.173+0000 7fa8b7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa8c015cd70 0x7fa8c006cc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42740/0 (socket says 172.21.15.55:42740) 2023-07-06T22:18:44.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.173+0000 7fa8b7fff640 1 -- 172.21.15.55:0/3318388652 learned_addr learned my addr 172.21.15.55:0/3318388652 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:44.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.173+0000 7fa8be59c640 1 --2- 172.21.15.55:0/3318388652 >> v2:172.21.15.138:3300/0 conn(0x7fa8c0158750 0x7fa8c00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.173+0000 7fa8bdd9b640 1 -- 172.21.15.55:0/3318388652 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462941478 0 0) 0x7fa8c0158b20 con 0x7fa8c015cd70 2023-07-06T22:18:44.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.173+0000 7fa8bdd9b640 1 -- 172.21.15.55:0/3318388652 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8ac003530 con 0x7fa8c015cd70 2023-07-06T22:18:44.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.173+0000 7fa8be59c640 1 -- 172.21.15.55:0/3318388652 >> v1:172.21.15.138:6789/0 conn(0x7fa8c006d330 legacy=0x7fa8c00c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.173+0000 7fa8bdd9b640 1 -- 172.21.15.55:0/3318388652 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178952526 0 0) 0x7fa8c006bb80 con 0x7fa8c006d330 2023-07-06T22:18:44.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.173+0000 7fa8be59c640 1 -- 172.21.15.55:0/3318388652 >> v1:172.21.15.55:6789/0 conn(0x7fa8c015cd70 legacy=0x7fa8c006cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.173+0000 7fa8be59c640 1 -- 172.21.15.55:0/3318388652 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c006be60 con 0x7fa8c0158750 2023-07-06T22:18:44.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.173+0000 7fa8be59c640 1 --2- 172.21.15.55:0/3318388652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c0158750 0x7fa8c00ccac0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00097c0 tx=0x7fa8b001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87b3376f6f2e6b78 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:44.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8bdd9b640 1 -- 172.21.15.55:0/3318388652 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00ac620 con 0x7fa8c0158750 2023-07-06T22:18:44.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8bdd9b640 1 -- 172.21.15.55:0/3318388652 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b00ac780 con 0x7fa8c0158750 2023-07-06T22:18:44.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8bdd9b640 1 -- 172.21.15.55:0/3318388652 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00acb10 con 0x7fa8c0158750 2023-07-06T22:18:44.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/3318388652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c0158750 msgr2=0x7fa8c00ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 --2- 172.21.15.55:0/3318388652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c0158750 0x7fa8c00ccac0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00097c0 tx=0x7fa8b001c3c0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/3318388652 shutdown_connections 2023-07-06T22:18:44.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 --2- 172.21.15.55:0/3318388652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c0158750 0x7fa8c00ccac0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/3318388652 >> 172.21.15.55:0/3318388652 conn(0x7fa8c00cbd80 msgr2=0x7fa8c00ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:44.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/3318388652 shutdown_connections 2023-07-06T22:18:44.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/3318388652 wait complete. 2023-07-06T22:18:44.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 Processor -- start 2023-07-06T22:18:44.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 -- start start 2023-07-06T22:18:44.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8c006d330 0x7fa8c014f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c0158750 0x7fa8c0150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c015cd70 0x7fa8c01515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c014f5f0 con 0x7fa8c015cd70 2023-07-06T22:18:44.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c0151ae0 con 0x7fa8c0158750 2023-07-06T22:18:44.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.177+0000 7fa8c4dfa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c015af10 con 0x7fa8c006d330 2023-07-06T22:18:44.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8bed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c015cd70 0x7fa8c01515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8bed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c015cd70 0x7fa8c01515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37132/0 (socket says 172.21.15.55:37132) 2023-07-06T22:18:44.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8bed9d640 1 -- 172.21.15.55:0/2686810108 learned_addr learned my addr 172.21.15.55:0/2686810108 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:44.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8be59c640 1 --2- 172.21.15.55:0/2686810108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8c006d330 0x7fa8c014f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8b7fff640 1 --2- 172.21.15.55:0/2686810108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c0158750 0x7fa8c0150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8bed9d640 1 -- 172.21.15.55:0/2686810108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8c006d330 msgr2=0x7fa8c014f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8bed9d640 1 --2- 172.21.15.55:0/2686810108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8c006d330 0x7fa8c014f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8bed9d640 1 -- 172.21.15.55:0/2686810108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c0158750 msgr2=0x7fa8c0150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8bed9d640 1 --2- 172.21.15.55:0/2686810108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c0158750 0x7fa8c0150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8bed9d640 1 -- 172.21.15.55:0/2686810108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b0009420 con 0x7fa8c015cd70 2023-07-06T22:18:44.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8bed9d640 1 --2- 172.21.15.55:0/2686810108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c015cd70 0x7fa8c01515a0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8002240 tx=0x7fa8b800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:44.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8b6ffd640 1 -- 172.21.15.55:0/2686810108 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800cea0 con 0x7fa8c015cd70 2023-07-06T22:18:44.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8b6ffd640 1 -- 172.21.15.55:0/2686810108 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b8003db0 con 0x7fa8c015cd70 2023-07-06T22:18:44.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8b6ffd640 1 -- 172.21.15.55:0/2686810108 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80052b0 con 0x7fa8c015cd70 2023-07-06T22:18:44.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/2686810108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c015b1f0 con 0x7fa8c015cd70 2023-07-06T22:18:44.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/2686810108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c015b7b0 con 0x7fa8c015cd70 2023-07-06T22:18:44.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/2686810108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c01f7820 con 0x7fa8c015cd70 2023-07-06T22:18:44.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.181+0000 7fa8b6ffd640 1 -- 172.21.15.55:0/2686810108 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa8b8005410 con 0x7fa8c015cd70 2023-07-06T22:18:44.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.185+0000 7fa8b6ffd640 1 --2- 172.21.15.55:0/2686810108 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa8a00663a0 0x7fa8a0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.185+0000 7fa8b6ffd640 1 -- 172.21.15.55:0/2686810108 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa8b8083810 con 0x7fa8c015cd70 2023-07-06T22:18:44.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.185+0000 7fa8be59c640 1 --2- 172.21.15.55:0/2686810108 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa8a00663a0 0x7fa8a0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.185+0000 7fa8be59c640 1 --2- 172.21.15.55:0/2686810108 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa8a00663a0 0x7fa8a0068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00ae000 tx=0x7fa8b0008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:44.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.189+0000 7fa8b6ffd640 1 -- 172.21.15.55:0/2686810108 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8c01f7820 con 0x7fa8c015cd70 2023-07-06T22:18:44.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.345+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/2686810108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8c01f7820 con 0x7fa8c015cd70 2023-07-06T22:18:44.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.345+0000 7fa8b6ffd640 1 -- 172.21.15.55:0/2686810108 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+18590 (secure 0 0 0) 0x7fa8c01f7820 con 0x7fa8c015cd70 2023-07-06T22:18:44.348 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:44.348 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":179,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:18:41.594749+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:18:38.520955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-07-06T22:18:39.591879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:18:44.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.349+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/2686810108 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa8a00663a0 msgr2=0x7fa8a0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.349+0000 7fa8c4dfa640 1 --2- 172.21.15.55:0/2686810108 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa8a00663a0 0x7fa8a0068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00ae000 tx=0x7fa8b0008040 comp rx=0 tx=0).stop 2023-07-06T22:18:44.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.349+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/2686810108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c015cd70 msgr2=0x7fa8c01515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.349+0000 7fa8c4dfa640 1 --2- 172.21.15.55:0/2686810108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c015cd70 0x7fa8c01515a0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8002240 tx=0x7fa8b800cc50 comp rx=0 tx=0).stop 2023-07-06T22:18:44.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.349+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/2686810108 shutdown_connections 2023-07-06T22:18:44.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.349+0000 7fa8c4dfa640 1 --2- 172.21.15.55:0/2686810108 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa8a00663a0 0x7fa8a0068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.349+0000 7fa8c4dfa640 1 --2- 172.21.15.55:0/2686810108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c015cd70 0x7fa8c01515a0 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.349+0000 7fa8c4dfa640 1 --2- 172.21.15.55:0/2686810108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c0158750 0x7fa8c0150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.349+0000 7fa8c4dfa640 1 --2- 172.21.15.55:0/2686810108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8c006d330 0x7fa8c014f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.349+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/2686810108 >> 172.21.15.55:0/2686810108 conn(0x7fa8c00cbd80 msgr2=0x7fa8c00ab920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:44.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.349+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/2686810108 shutdown_connections 2023-07-06T22:18:44.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.349+0000 7fa8c4dfa640 1 -- 172.21.15.55:0/2686810108 wait complete. 2023-07-06T22:18:44.369 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T22:18:44.370 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:18:44.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa19b29c640 1 Processor -- start 2023-07-06T22:18:44.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa19b29c640 1 -- start start 2023-07-06T22:18:44.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa19b29c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa1940ce610 0x7fa1940b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa19b29c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1940b1e10 0x7fa19415f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa19b29c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1940cd1c0 con 0x7fa1940b7cd0 2023-07-06T22:18:44.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa19b29c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1940d2310 con 0x7fa1940b1e10 2023-07-06T22:18:44.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa19b29c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1940b80a0 con 0x7fa1940ce610 2023-07-06T22:18:44.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa199839640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1940b1e10 0x7fa19415f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa199839640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1940b1e10 0x7fa19415f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37146/0 (socket says 172.21.15.55:37146) 2023-07-06T22:18:44.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa199839640 1 -- 172.21.15.55:0/3090479287 learned_addr learned my addr 172.21.15.55:0/3090479287 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:44.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa198837640 1 --2- 172.21.15.55:0/3090479287 >> v2:172.21.15.138:3300/0 conn(0x7fa1940ce610 0x7fa1940b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa199839640 1 -- 172.21.15.55:0/3090479287 >> v2:172.21.15.138:3300/0 conn(0x7fa1940ce610 msgr2=0x7fa1940b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:44.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa199839640 1 --2- 172.21.15.55:0/3090479287 >> v2:172.21.15.138:3300/0 conn(0x7fa1940ce610 0x7fa1940b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa199839640 1 -- 172.21.15.55:0/3090479287 >> v1:172.21.15.138:6789/0 conn(0x7fa1940b7cd0 legacy=0x7fa1940ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.513+0000 7fa199839640 1 -- 172.21.15.55:0/3090479287 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1940b2270 con 0x7fa1940b1e10 2023-07-06T22:18:44.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.517+0000 7fa199839640 1 --2- 172.21.15.55:0/3090479287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1940b1e10 0x7fa19415f870 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fa194065af0 tx=0x7fa18c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4a6c4c40eee5c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:44.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.517+0000 7fa18bfff640 1 -- 172.21.15.55:0/3090479287 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0a5600 con 0x7fa1940b1e10 2023-07-06T22:18:44.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.517+0000 7fa18bfff640 1 -- 172.21.15.55:0/3090479287 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c0a5760 con 0x7fa1940b1e10 2023-07-06T22:18:44.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.517+0000 7fa18bfff640 1 -- 172.21.15.55:0/3090479287 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0a5af0 con 0x7fa1940b1e10 2023-07-06T22:18:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.517+0000 7fa19b29c640 1 -- 172.21.15.55:0/3090479287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1940b1e10 msgr2=0x7fa19415f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.517+0000 7fa19b29c640 1 --2- 172.21.15.55:0/3090479287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1940b1e10 0x7fa19415f870 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fa194065af0 tx=0x7fa18c01c940 comp rx=0 tx=0).stop 2023-07-06T22:18:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.517+0000 7fa19b29c640 1 -- 172.21.15.55:0/3090479287 shutdown_connections 2023-07-06T22:18:44.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.517+0000 7fa19b29c640 1 --2- 172.21.15.55:0/3090479287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1940b1e10 0x7fa19415f870 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.517+0000 7fa19b29c640 1 --2- 172.21.15.55:0/3090479287 >> v2:172.21.15.138:3300/0 conn(0x7fa1940ce610 0x7fa1940b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.517+0000 7fa19b29c640 1 -- 172.21.15.55:0/3090479287 >> 172.21.15.55:0/3090479287 conn(0x7fa1940ceee0 msgr2=0x7fa1940cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:44.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.517+0000 7fa19b29c640 1 -- 172.21.15.55:0/3090479287 shutdown_connections 2023-07-06T22:18:44.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.517+0000 7fa19b29c640 1 -- 172.21.15.55:0/3090479287 wait complete. 2023-07-06T22:18:44.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa19b29c640 1 Processor -- start 2023-07-06T22:18:44.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa19b29c640 1 -- start start 2023-07-06T22:18:44.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa19b29c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1940b1e10 0x7fa194154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa19b29c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1940b7cd0 0x7fa194157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa19b29c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1940ce610 0x7fa19414ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa19b29c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa194153510 con 0x7fa1940ce610 2023-07-06T22:18:44.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa19b29c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa194157940 con 0x7fa1940b7cd0 2023-07-06T22:18:44.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa19b29c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa194152be0 con 0x7fa1940b1e10 2023-07-06T22:18:44.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa199839640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1940ce610 0x7fa19414ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa199839640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1940ce610 0x7fa19414ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37148/0 (socket says 172.21.15.55:37148) 2023-07-06T22:18:44.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa199839640 1 -- 172.21.15.55:0/790897350 learned_addr learned my addr 172.21.15.55:0/790897350 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa199038640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1940b1e10 0x7fa194154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa198837640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1940b7cd0 0x7fa194157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa199839640 1 -- 172.21.15.55:0/790897350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1940b1e10 msgr2=0x7fa194154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa199839640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1940b1e10 0x7fa194154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa199839640 1 -- 172.21.15.55:0/790897350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1940b7cd0 msgr2=0x7fa194157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa199839640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1940b7cd0 0x7fa194157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa199839640 1 -- 172.21.15.55:0/790897350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c009b30 con 0x7fa1940ce610 2023-07-06T22:18:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa198837640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1940b7cd0 0x7fa194157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa199038640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1940b1e10 0x7fa194154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa199839640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1940ce610 0x7fa19414ae50 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0af040 tx=0x7fa18c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa189ffb640 1 -- 172.21.15.55:0/790897350 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0a5600 con 0x7fa1940ce610 2023-07-06T22:18:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa189ffb640 1 -- 172.21.15.55:0/790897350 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c0b8690 con 0x7fa1940ce610 2023-07-06T22:18:44.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa189ffb640 1 -- 172.21.15.55:0/790897350 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0b8a40 con 0x7fa1940ce610 2023-07-06T22:18:44.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa19b29c640 1 -- 172.21.15.55:0/790897350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa194152ec0 con 0x7fa1940ce610 2023-07-06T22:18:44.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.521+0000 7fa19b29c640 1 -- 172.21.15.55:0/790897350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19414b390 con 0x7fa1940ce610 2023-07-06T22:18:44.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.525+0000 7fa19b29c640 1 -- 172.21.15.55:0/790897350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa194153680 con 0x7fa1940ce610 2023-07-06T22:18:44.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.525+0000 7fa189ffb640 1 -- 172.21.15.55:0/790897350 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa18c0b8ba0 con 0x7fa1940ce610 2023-07-06T22:18:44.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.525+0000 7fa189ffb640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa1780663a0 0x7fa178068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.525+0000 7fa189ffb640 1 -- 172.21.15.55:0/790897350 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa18c11f470 con 0x7fa1940ce610 2023-07-06T22:18:44.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.525+0000 7fa199038640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa1780663a0 0x7fa178068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.525+0000 7fa199038640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa1780663a0 0x7fa178068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa190000f70 tx=0x7fa190009040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:44.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.529+0000 7fa189ffb640 1 -- 172.21.15.55:0/790897350 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa18c0ec7a0 con 0x7fa1940ce610 2023-07-06T22:18:44.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.685+0000 7fa19b29c640 1 -- 172.21.15.55:0/790897350 --> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1940d1d90 con 0x7fa1780663a0 2023-07-06T22:18:44.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.693+0000 7fa189ffb640 1 -- 172.21.15.55:0/790897350 <== mgr.10167 v2:172.21.15.55:6832/957337795 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299737 (secure 0 0 0) 0x7fa1900013f0 con 0x7fa1780663a0 2023-07-06T22:18:44.697 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:44.698 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:18:44.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.697+0000 7fa19b29c640 1 -- 172.21.15.55:0/790897350 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa1780663a0 msgr2=0x7fa178068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.697+0000 7fa19b29c640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa1780663a0 0x7fa178068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa190000f70 tx=0x7fa190009040 comp rx=0 tx=0).stop 2023-07-06T22:18:44.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.697+0000 7fa19b29c640 1 -- 172.21.15.55:0/790897350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1940ce610 msgr2=0x7fa19414ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.697+0000 7fa19b29c640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1940ce610 0x7fa19414ae50 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0af040 tx=0x7fa18c0196e0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.697+0000 7fa19b29c640 1 -- 172.21.15.55:0/790897350 shutdown_connections 2023-07-06T22:18:44.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.697+0000 7fa19b29c640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fa1780663a0 0x7fa178068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.697+0000 7fa19b29c640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1940ce610 0x7fa19414ae50 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.697+0000 7fa19b29c640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1940b7cd0 0x7fa194157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.697+0000 7fa19b29c640 1 --2- 172.21.15.55:0/790897350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1940b1e10 0x7fa194154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.697+0000 7fa19b29c640 1 -- 172.21.15.55:0/790897350 >> 172.21.15.55:0/790897350 conn(0x7fa1940ceee0 msgr2=0x7fa1940cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:44.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.697+0000 7fa19b29c640 1 -- 172.21.15.55:0/790897350 shutdown_connections 2023-07-06T22:18:44.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.697+0000 7fa19b29c640 1 -- 172.21.15.55:0/790897350 wait complete. 2023-07-06T22:18:44.718 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T22:18:43.575782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":379824,"kb_used_data":18288,"kb_used_omap":0,"kb_used_meta":361472,"kb_avail":754594896,"statfs":{"total":773094113280,"available":772705173504,"internally_reserved":0,"allocated":18726912,"data_stored":10584810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":370147328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.393719"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190996+0000","last_change":"2023-07-06T22:18:39.190996+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190996+0000","last_undegraded":"2023-07-06T22:18:39.190996+0000","last_fullsized":"2023-07-06T22:18:39.190996+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190528+0000","last_change":"2023-07-06T22:18:39.190528+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190528+0000","last_undegraded":"2023-07-06T22:18:39.190528+0000","last_fullsized":"2023-07-06T22:18:39.190528+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184605+0000","last_change":"2023-07-06T22:18:39.184605+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184605+0000","last_undegraded":"2023-07-06T22:18:39.184605+0000","last_fullsized":"2023-07-06T22:18:39.184605+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184642+0000","last_change":"2023-07-06T22:18:39.184642+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184642+0000","last_undegraded":"2023-07-06T22:18:39.184642+0000","last_fullsized":"2023-07-06T22:18:39.184642+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.187782+0000","last_change":"2023-07-06T22:18:39.187782+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.187782+0000","last_undegraded":"2023-07-06T22:18:39.187782+0000","last_fullsized":"2023-07-06T22:18:39.187782+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.186107+0000","last_change":"2023-07-06T22:18:39.186107+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.186107+0000","last_undegraded":"2023-07-06T22:18:39.186107+0000","last_fullsized":"2023-07-06T22:18:39.186107+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.185982+0000","last_change":"2023-07-06T22:18:39.185982+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.185982+0000","last_undegraded":"2023-07-06T22:18:39.185982+0000","last_fullsized":"2023-07-06T22:18:39.185982+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.191010+0000","last_change":"2023-07-06T22:18:39.191010+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.191010+0000","last_undegraded":"2023-07-06T22:18:39.191010+0000","last_fullsized":"2023-07-06T22:18:39.191010+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.187898+0000","last_change":"2023-07-06T22:18:39.187898+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.187898+0000","last_undegraded":"2023-07-06T22:18:39.187898+0000","last_fullsized":"2023-07-06T22:18:39.187898+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.188880+0000","last_change":"2023-07-06T22:18:39.188880+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.188880+0000","last_undegraded":"2023-07-06T22:18:39.188880+0000","last_fullsized":"2023-07-06T22:18:39.188880+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190242+0000","last_change":"2023-07-06T22:18:39.190242+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190242+0000","last_undegraded":"2023-07-06T22:18:39.190242+0000","last_fullsized":"2023-07-06T22:18:39.190242+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190833+0000","last_change":"2023-07-06T22:18:39.190833+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190833+0000","last_undegraded":"2023-07-06T22:18:39.190833+0000","last_fullsized":"2023-07-06T22:18:39.190833+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184602+0000","last_change":"2023-07-06T22:18:39.184602+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184602+0000","last_undegraded":"2023-07-06T22:18:39.184602+0000","last_fullsized":"2023-07-06T22:18:39.184602+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190336+0000","last_change":"2023-07-06T22:18:39.190336+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190336+0000","last_undegraded":"2023-07-06T22:18:39.190336+0000","last_fullsized":"2023-07-06T22:18:39.190336+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184614+0000","last_change":"2023-07-06T22:18:39.184614+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184614+0000","last_undegraded":"2023-07-06T22:18:39.184614+0000","last_fullsized":"2023-07-06T22:18:39.184614+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190208+0000","last_change":"2023-07-06T22:18:39.190208+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190208+0000","last_undegraded":"2023-07-06T22:18:39.190208+0000","last_fullsized":"2023-07-06T22:18:39.190208+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.188646+0000","last_change":"2023-07-06T22:18:39.188646+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.188646+0000","last_undegraded":"2023-07-06T22:18:39.188646+0000","last_fullsized":"2023-07-06T22:18:39.188646+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.187972+0000","last_change":"2023-07-06T22:18:39.187972+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.187972+0000","last_undegraded":"2023-07-06T22:18:39.187972+0000","last_fullsized":"2023-07-06T22:18:39.187972+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184886+0000","last_change":"2023-07-06T22:18:39.184886+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184886+0000","last_undegraded":"2023-07-06T22:18:39.184886+0000","last_fullsized":"2023-07-06T22:18:39.184886+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.188217+0000","last_change":"2023-07-06T22:18:39.188217+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.188217+0000","last_undegraded":"2023-07-06T22:18:39.188217+0000","last_fullsized":"2023-07-06T22:18:39.188217+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.189352+0000","last_change":"2023-07-06T22:18:39.189352+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.189352+0000","last_undegraded":"2023-07-06T22:18:39.189352+0000","last_fullsized":"2023-07-06T22:18:39.189352+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184631+0000","last_change":"2023-07-06T22:18:39.184631+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184631+0000","last_undegraded":"2023-07-06T22:18:39.184631+0000","last_fullsized":"2023-07-06T22:18:39.184631+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184823+0000","last_change":"2023-07-06T22:18:39.184823+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184823+0000","last_undegraded":"2023-07-06T22:18:39.184823+0000","last_fullsized":"2023-07-06T22:18:39.184823+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.189622+0000","last_change":"2023-07-06T22:18:39.189622+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.189622+0000","last_undegraded":"2023-07-06T22:18:39.189622+0000","last_fullsized":"2023-07-06T22:18:39.189622+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.189082+0000","last_change":"2023-07-06T22:18:39.189082+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.189082+0000","last_undegraded":"2023-07-06T22:18:39.189082+0000","last_fullsized":"2023-07-06T22:18:39.189082+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"167'304","reported_seq":1146,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.191871+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:18:39.191871+0000","last_peered":"2023-07-06T22:18:39.191871+0000","last_clean":"2023-07-06T22:18:39.191871+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:18:39.191871+0000","last_undegraded":"2023-07-06T22:18:39.191871+0000","last_fullsized":"2023-07-06T22:18:39.191871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:28:35.844046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":288,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.189747+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:18:39.189747+0000","last_peered":"2023-07-06T22:18:39.189747+0000","last_clean":"2023-07-06T22:18:39.189747+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:18:39.189747+0000","last_undegraded":"2023-07-06T22:18:39.189747+0000","last_fullsized":"2023-07-06T22:18:39.189747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:37:08.335890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.189565+0000","last_change":"2023-07-06T22:18:39.189565+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.189565+0000","last_undegraded":"2023-07-06T22:18:39.189565+0000","last_fullsized":"2023-07-06T22:18:39.189565+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":327,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.191736+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:18:39.191736+0000","last_peered":"2023-07-06T22:18:39.191736+0000","last_clean":"2023-07-06T22:18:39.191736+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:18:39.191736+0000","last_undegraded":"2023-07-06T22:18:39.191736+0000","last_fullsized":"2023-07-06T22:18:39.191736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:27:20.831874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.186221+0000","last_change":"2023-07-06T22:18:39.186221+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.186221+0000","last_undegraded":"2023-07-06T22:18:39.186221+0000","last_fullsized":"2023-07-06T22:18:39.186221+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":328,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.184208+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:18:39.184208+0000","last_peered":"2023-07-06T22:18:39.184208+0000","last_clean":"2023-07-06T22:18:39.184208+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:18:39.184208+0000","last_undegraded":"2023-07-06T22:18:39.184208+0000","last_fullsized":"2023-07-06T22:18:39.184208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:15:01.325637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.186214+0000","last_change":"2023-07-06T22:18:39.186214+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.186214+0000","last_undegraded":"2023-07-06T22:18:39.186214+0000","last_fullsized":"2023-07-06T22:18:39.186214+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":288,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.189416+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:18:39.189416+0000","last_peered":"2023-07-06T22:18:39.189416+0000","last_clean":"2023-07-06T22:18:39.189416+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:18:39.189416+0000","last_undegraded":"2023-07-06T22:18:39.189416+0000","last_fullsized":"2023-07-06T22:18:39.189416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:18:49.494731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190102+0000","last_change":"2023-07-06T22:18:39.190102+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190102+0000","last_undegraded":"2023-07-06T22:18:39.190102+0000","last_fullsized":"2023-07-06T22:18:39.190102+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":292,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.187105+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:18:39.187105+0000","last_peered":"2023-07-06T22:18:39.187105+0000","last_clean":"2023-07-06T22:18:39.187105+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:18:39.187105+0000","last_undegraded":"2023-07-06T22:18:39.187105+0000","last_fullsized":"2023-07-06T22:18:39.187105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:47:07.975449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.185954+0000","last_change":"2023-07-06T22:18:39.185954+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.185954+0000","last_undegraded":"2023-07-06T22:18:39.185954+0000","last_fullsized":"2023-07-06T22:18:39.185954+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":326,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.191693+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:18:39.191693+0000","last_peered":"2023-07-06T22:18:39.191693+0000","last_clean":"2023-07-06T22:18:39.191693+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:18:39.191693+0000","last_undegraded":"2023-07-06T22:18:39.191693+0000","last_fullsized":"2023-07-06T22:18:39.191693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:08:22.589157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.188292+0000","last_change":"2023-07-06T22:18:39.188292+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.188292+0000","last_undegraded":"2023-07-06T22:18:39.188292+0000","last_fullsized":"2023-07-06T22:18:39.188292+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":292,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.187433+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:18:39.187433+0000","last_peered":"2023-07-06T22:18:39.187433+0000","last_clean":"2023-07-06T22:18:39.187433+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:18:39.187433+0000","last_undegraded":"2023-07-06T22:18:39.187433+0000","last_fullsized":"2023-07-06T22:18:39.187433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:12:22.072679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.185923+0000","last_change":"2023-07-06T22:18:39.185923+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.185923+0000","last_undegraded":"2023-07-06T22:18:39.185923+0000","last_fullsized":"2023-07-06T22:18:39.185923+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":283,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.187128+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:18:39.187128+0000","last_peered":"2023-07-06T22:18:39.187128+0000","last_clean":"2023-07-06T22:18:39.187128+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:18:39.187128+0000","last_undegraded":"2023-07-06T22:18:39.187128+0000","last_fullsized":"2023-07-06T22:18:39.187128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:54:47.486928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575284,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41956,"kb_used_data":2716,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329884,"statfs":{"total":96636764160,"available":96593801216,"internally_reserved":0,"allocated":2781184,"data_stored":1762873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70599999999999996,"15min":0.72699999999999998},"min":{"1min":0.54100000000000004,"5min":0.432,"15min":0.432},"max":{"1min":0.88700000000000001,"5min":0.93300000000000005,"15min":1.0740000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70999999999999996,"15min":0.71499999999999997},"min":{"1min":0.53800000000000003,"5min":0.45700000000000002,"15min":0.42299999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.998},"last":0.65300000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92700000000000005,"5min":0.98299999999999998,"15min":1.1220000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.58399999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94599999999999995,"5min":1.006,"15min":1.012},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73499999999999999,"15min":0.74399999999999999},"min":{"1min":0.51400000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.016},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.86799999999999999,"5min":0.99299999999999999,"15min":1.149},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.55500000000000005},"min":{"1min":0.39700000000000002,"5min":0.372,"15min":0.36199999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.91300000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.443,"5min":0.40799999999999997,"15min":0.39300000000000002},"max":{"1min":0.872,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.59399999999999997},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":1.038},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.495,"5min":0.442,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":0.92400000000000004,"15min":0.995},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.443},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":1.024},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67600000000000005,"15min":0.67700000000000005},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.018},"last":0.52200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575284,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37276,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334564,"statfs":{"total":96636764160,"available":96598593536,"internally_reserved":0,"allocated":2183168,"data_stored":1171486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.376},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.7829999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.49399999999999999,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":0.877,"5min":0.95199999999999996,"15min":1.633},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.55300000000000005,"5min":0.46700000000000003,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":1.044,"15min":1.9099999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74299999999999999,"15min":0.74099999999999999},"min":{"1min":0.61199999999999999,"5min":0.46600000000000003,"15min":0.438},"max":{"1min":0.85899999999999999,"5min":0.93700000000000006,"15min":0.97799999999999998},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.45800000000000002},"max":{"1min":0.86699999999999999,"5min":0.93899999999999995,"15min":2.0299999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.56000000000000005,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.58999999999999997,"5min":0.53300000000000003,"15min":0.501},"max":{"1min":0.86399999999999999,"5min":0.97899999999999998,"15min":1.5920000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":0.877,"5min":0.95599999999999996,"15min":1.996},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":1.024,"15min":1.024},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41599999999999998,"15min":0.40999999999999998},"max":{"1min":0.74399999999999999,"5min":0.94999999999999996,"15min":0.996},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.39200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73199999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.75},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.48599999999999999,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.83999999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.621,"15min":0.623},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.436},"max":{"1min":0.82399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.45600000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.78900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575283,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55340,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316500,"statfs":{"total":96636764160,"available":96580096000,"internally_reserved":0,"allocated":2199552,"data_stored":1179023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.52900000000000003,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.92800000000000005,"5min":0.97199999999999998,"15min":0.999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.57899999999999996,"5min":0.51200000000000001,"15min":0.46400000000000002},"max":{"1min":0.92500000000000004,"5min":0.995,"15min":0.995},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.73799999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.43099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.51000000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.3200000000000001},"last":0.629}]},{"osd":2,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.443},"max":{"1min":0.998,"5min":0.998,"15min":1.4299999999999999},"last":0.749},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.67500000000000004,"5min":0.58499999999999996,"15min":0.48199999999999998},"max":{"1min":0.88500000000000001,"5min":0.999,"15min":1.0409999999999999},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.65200000000000002,"5min":0.56699999999999995,"15min":0.46800000000000003},"max":{"1min":0.94399999999999995,"5min":0.996,"15min":1.5169999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.76700000000000002},"min":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.436},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.47799999999999998,"5min":0.39500000000000002,"15min":0.34899999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59799999999999998,"15min":0.61199999999999999},"min":{"1min":0.47599999999999998,"5min":0.432,"15min":0.32600000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.96099999999999997},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.52900000000000003,"5min":0.44700000000000001,"15min":0.39600000000000002},"max":{"1min":0.88,"5min":0.96399999999999997,"15min":0.998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.42199999999999999},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.96999999999999997},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.38900000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67800000000000005,"15min":0.68500000000000005},"min":{"1min":0.52900000000000003,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":0.83299999999999996,"5min":0.97899999999999998,"15min":0.999},"last":0.66400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575282,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55340,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316500,"statfs":{"total":96636764160,"available":96580096000,"internally_reserved":0,"allocated":2199552,"data_stored":1179023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.54500000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84299999999999997,"5min":0.96699999999999997,"15min":0.98999999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.75600000000000001,"15min":0.746},"min":{"1min":0.55700000000000005,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.97299999999999998,"5min":0.97899999999999998,"15min":1.016},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.754,"15min":0.749},"min":{"1min":0.61299999999999999,"5min":0.45200000000000001,"15min":0.38300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.495},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74399999999999999,"15min":0.73499999999999999},"min":{"1min":0.58999999999999997,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.99299999999999999,"15min":0.996},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.63800000000000001,"5min":0.53100000000000003,"15min":0.47799999999999998},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":1.0760000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.60299999999999998,"5min":0.51200000000000001,"15min":0.502},"max":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.0580000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.748,"15min":0.73899999999999999},"min":{"1min":0.60099999999999998,"5min":0.51900000000000002,"15min":0.45600000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.98699999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76300000000000001},"min":{"1min":0.61599999999999999,"5min":0.52700000000000002,"15min":0.51900000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":1.03},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83899999999999997,"5min":0.91200000000000003,"15min":0.92600000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.46000000000000002,"5min":0.39900000000000002,"15min":0.39800000000000002},"max":{"1min":0.77100000000000002,"5min":0.95599999999999996,"15min":1.006},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.95899999999999996,"15min":1.0509999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88400000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.624}]},{"osd":7,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.53000000000000003,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":0.84999999999999998,"5min":0.94799999999999995,"15min":1.0469999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.55000000000000004,"5min":0.432,"15min":0.432},"max":{"1min":0.86699999999999999,"5min":1.0109999999999999,"15min":1.1100000000000001},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575283,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51244,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320596,"statfs":{"total":96636764160,"available":96584290304,"internally_reserved":0,"allocated":2199552,"data_stored":1179023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68100000000000005,"5min":0.69399999999999995,"15min":0.85899999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50900000000000001,"15min":0.49099999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69799999999999995,"5min":0.72799999999999998,"15min":0.83899999999999997},"last":0.437},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61399999999999999,"15min":0.60499999999999998},"min":{"1min":0.442,"5min":0.44,"15min":0.41299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38700000000000001},"max":{"1min":0.63800000000000001,"5min":0.72399999999999998,"15min":0.875},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.34699999999999998},"max":{"1min":0.71399999999999997,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80300000000000005,"15min":0.77700000000000002},"min":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.441},"max":{"1min":1.0449999999999999,"5min":1.081,"15min":1.474},"last":0.751},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.79200000000000004},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.54600000000000004},"max":{"1min":0.99099999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.624}]},{"osd":5,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83099999999999996,"15min":0.81100000000000005},"min":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.57499999999999996},"max":{"1min":1.175,"5min":1.175,"15min":1.3740000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82299999999999995,"15min":0.80300000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.022,"5min":1.228,"15min":1.2330000000000001},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.80200000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.51800000000000002},"max":{"1min":1.1399999999999999,"5min":1.194,"15min":1.3899999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.82999999999999996},"min":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.57299999999999995},"max":{"1min":1.0960000000000001,"5min":1.266,"15min":1.3220000000000001},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.002,"5min":1.121,"15min":1.2210000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84499999999999997,"15min":0.82699999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.244,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.68000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575283,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41376,"kb_used_data":2136,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330464,"statfs":{"total":96636764160,"available":96594395136,"internally_reserved":0,"allocated":2187264,"data_stored":1172505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.32300000000000001,"15min":0.27800000000000002},"max":{"1min":0.65100000000000002,"5min":0.76100000000000001,"15min":0.88700000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.46100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.70899999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.501}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.41899999999999998,"5min":0.35799999999999998,"15min":0.32300000000000001},"max":{"1min":0.74099999999999999,"5min":0.79400000000000004,"15min":0.84099999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.46000000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.68700000000000006,"5min":0.77100000000000002,"15min":0.97099999999999997},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.434,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":0.77200000000000002,"15min":0.997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.499,"5min":0.434,"15min":0.378},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.80400000000000005},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.64900000000000002,"5min":0.56599999999999995,"15min":0.50900000000000001},"max":{"1min":0.98399999999999999,"5min":1.45,"15min":1.45},"last":1.663},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.47399999999999998},"max":{"1min":0.90600000000000003,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.67400000000000004,"5min":0.60899999999999999,"15min":0.51100000000000001},"max":{"1min":1.0029999999999999,"5min":1.337,"15min":1.337},"last":0.872},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.53000000000000003},"max":{"1min":0.91300000000000003,"5min":1.2490000000000001,"15min":1.2829999999999999},"last":1.0409999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83699999999999997,"15min":0.82099999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.54800000000000004},"max":{"1min":1.0900000000000001,"5min":1.367,"15min":1.367},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.83599999999999997,"15min":0.83699999999999997},"min":{"1min":0.63100000000000001,"5min":0.56399999999999995,"15min":0.56100000000000005},"max":{"1min":0.97399999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.85299999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.56999999999999995},"max":{"1min":1.024,"5min":1.407,"15min":1.407},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.85199999999999998,"15min":0.84999999999999998},"min":{"1min":0.64900000000000002,"5min":0.59899999999999998,"15min":0.55600000000000005},"max":{"1min":1.0329999999999999,"5min":1.296,"15min":1.296},"last":0.98399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575284,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59424,"kb_used_data":2136,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312416,"statfs":{"total":96636764160,"available":96575913984,"internally_reserved":0,"allocated":2187264,"data_stored":1172505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.46600000000000003},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.32900000000000001},"max":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.81699999999999995},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.36899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.94299999999999995},"last":0.31},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.5}]},{"osd":3,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":0.84899999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.441}]},{"osd":4,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.018,"5min":1.083,"15min":1.1140000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.54200000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0700000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.58399999999999996,"5min":0.57299999999999995,"15min":0.48699999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.21},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81699999999999995,"15min":0.82699999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1100000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82299999999999995,"15min":0.83199999999999996},"min":{"1min":0.61899999999999999,"5min":0.53800000000000003,"15min":0.53600000000000003},"max":{"1min":1.0800000000000001,"5min":1.244,"15min":1.302},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82799999999999996,"15min":0.83299999999999996},"min":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.25,"5min":1.25,"15min":1.3360000000000001},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82599999999999996,"15min":0.83199999999999996},"min":{"1min":0.67100000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0489999999999999,"5min":1.1779999999999999,"15min":1.405},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84999999999999998,"15min":0.84099999999999997},"min":{"1min":0.68200000000000005,"5min":0.57099999999999995,"15min":0.54700000000000004},"max":{"1min":0.97699999999999998,"5min":1.2110000000000001,"15min":1.3779999999999999},"last":0.68799999999999994}]}]},{"osd":0,"up_from":13,"seq":55834575283,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37868,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333972,"statfs":{"total":96636764160,"available":96597987328,"internally_reserved":0,"allocated":2789376,"data_stored":1768372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.316},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.34000000000000002,"5min":0.33600000000000002,"15min":0.312},"max":{"1min":0.749,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52100000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.505},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76100000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.33400000000000002},"max":{"1min":0.65200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.45200000000000001,"5min":0.41099999999999998,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80900000000000005,"15min":0.80600000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.1439999999999999,"5min":1.294,"15min":1.294},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80800000000000005,"15min":0.80300000000000005},"min":{"1min":0.61899999999999999,"5min":0.53500000000000003,"15min":0.50900000000000001},"max":{"1min":1.022,"5min":1.107,"15min":1.3320000000000001},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.56000000000000005,"15min":0.48899999999999999},"max":{"1min":1.0569999999999999,"5min":1.345,"15min":1.345},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.63700000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81999999999999995,"15min":0.81399999999999995},"min":{"1min":0.628,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98199999999999998,"5min":1.0049999999999999,"15min":1.153},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.628,"5min":0.59099999999999997,"15min":0.58499999999999996},"max":{"1min":1.036,"5min":1.1910000000000001,"15min":1.272},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.82299999999999995,"15min":0.82899999999999996},"min":{"1min":0.64300000000000002,"5min":0.624,"15min":0.57999999999999996},"max":{"1min":1.083,"5min":1.125,"15min":1.26},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.82099999999999995},"min":{"1min":0.67100000000000004,"5min":0.60499999999999998,"15min":0.55700000000000005},"max":{"1min":1.022,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.79000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:18:44.725 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:18:44.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbfcc34640 1 Processor -- start 2023-07-06T22:18:44.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbfcc34640 1 -- start start 2023-07-06T22:18:44.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbfcc34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdbf80ce610 0x7fdbf80b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbfcc34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdbf80b1e10 0x7fdbf815f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbfcc34640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf80b2290 con 0x7fdbf80b7cd0 2023-07-06T22:18:44.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbfcc34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf80d2310 con 0x7fdbf80ce610 2023-07-06T22:18:44.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbfcc34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf80b80a0 con 0x7fdbf80b1e10 2023-07-06T22:18:44.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbeffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdbf80ce610 0x7fdbf80b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbeffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdbf80ce610 0x7fdbf80b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37152/0 (socket says 172.21.15.55:37152) 2023-07-06T22:18:44.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbeffff640 1 -- 172.21.15.55:0/460537958 learned_addr learned my addr 172.21.15.55:0/460537958 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:44.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbeffff640 1 -- 172.21.15.55:0/460537958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdbf80b1e10 msgr2=0x7fdbf815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:44.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbf6d9d640 1 --2- 172.21.15.55:0/460537958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdbf80b1e10 0x7fdbf815f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbeffff640 1 --2- 172.21.15.55:0/460537958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdbf80b1e10 0x7fdbf815f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbeffff640 1 -- 172.21.15.55:0/460537958 >> v1:172.21.15.138:6789/0 conn(0x7fdbf80b7cd0 legacy=0x7fdbf80ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:44.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbeffff640 1 -- 172.21.15.55:0/460537958 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf80cd1c0 con 0x7fdbf80ce610 2023-07-06T22:18:44.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.901+0000 7fdbf6d9d640 1 --2- 172.21.15.55:0/460537958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdbf80b1e10 0x7fdbf815f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:18:44.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.905+0000 7fdbeffff640 1 --2- 172.21.15.55:0/460537958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf80ce610 0x7fdbf80b18d0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009870 tx=0x7fdbe001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b557302308d89a51 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:44.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.905+0000 7fdbf5d9b640 1 -- 172.21.15.55:0/460537958 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00ab600 con 0x7fdbf80ce610 2023-07-06T22:18:44.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.905+0000 7fdbf5d9b640 1 -- 172.21.15.55:0/460537958 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe00a7050 con 0x7fdbf80ce610 2023-07-06T22:18:44.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.905+0000 7fdbf5d9b640 1 -- 172.21.15.55:0/460537958 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00ab980 con 0x7fdbf80ce610 2023-07-06T22:18:44.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.905+0000 7fdbfcc34640 1 -- 172.21.15.55:0/460537958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf80ce610 msgr2=0x7fdbf80b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.905+0000 7fdbfcc34640 1 --2- 172.21.15.55:0/460537958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf80ce610 0x7fdbf80b18d0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009870 tx=0x7fdbe001c470 comp rx=0 tx=0).stop 2023-07-06T22:18:44.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.905+0000 7fdbfcc34640 1 -- 172.21.15.55:0/460537958 shutdown_connections 2023-07-06T22:18:44.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.905+0000 7fdbfcc34640 1 --2- 172.21.15.55:0/460537958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdbf80b1e10 0x7fdbf815f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.905+0000 7fdbfcc34640 1 --2- 172.21.15.55:0/460537958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf80ce610 0x7fdbf80b18d0 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.905+0000 7fdbfcc34640 1 -- 172.21.15.55:0/460537958 >> 172.21.15.55:0/460537958 conn(0x7fdbf80ceee0 msgr2=0x7fdbf80cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:44.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.905+0000 7fdbfcc34640 1 -- 172.21.15.55:0/460537958 shutdown_connections 2023-07-06T22:18:44.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.905+0000 7fdbfcc34640 1 -- 172.21.15.55:0/460537958 wait complete. 2023-07-06T22:18:44.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbfcc34640 1 Processor -- start 2023-07-06T22:18:44.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbfcc34640 1 -- start start 2023-07-06T22:18:44.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbfcc34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdbf80b1e10 0x7fdbf81548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbfcc34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf80b7cd0 0x7fdbf8158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbfcc34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdbf80ce610 0x7fdbf806a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbfcc34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf815d520 con 0x7fdbf80b7cd0 2023-07-06T22:18:44.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbfcc34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf815c8a0 con 0x7fdbf80ce610 2023-07-06T22:18:44.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbfcc34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf815cb80 con 0x7fdbf80b1e10 2023-07-06T22:18:44.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbeffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf80b7cd0 0x7fdbf8158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbeffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf80b7cd0 0x7fdbf8158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37164/0 (socket says 172.21.15.55:37164) 2023-07-06T22:18:44.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbeffff640 1 -- 172.21.15.55:0/3348266683 learned_addr learned my addr 172.21.15.55:0/3348266683 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:44.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbf6d9d640 1 --2- 172.21.15.55:0/3348266683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdbf80ce610 0x7fdbf806a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbf659c640 1 --2- 172.21.15.55:0/3348266683 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdbf80b1e10 0x7fdbf81548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbeffff640 1 -- 172.21.15.55:0/3348266683 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdbf80b1e10 msgr2=0x7fdbf81548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbeffff640 1 --2- 172.21.15.55:0/3348266683 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdbf80b1e10 0x7fdbf81548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbeffff640 1 -- 172.21.15.55:0/3348266683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdbf80ce610 msgr2=0x7fdbf806a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:44.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbeffff640 1 --2- 172.21.15.55:0/3348266683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdbf80ce610 0x7fdbf806a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:44.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbeffff640 1 -- 172.21.15.55:0/3348266683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe00094d0 con 0x7fdbf80b7cd0 2023-07-06T22:18:44.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbeffff640 1 --2- 172.21.15.55:0/3348266683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf80b7cd0 0x7fdbf8158af0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00ae040 tx=0x7fdbe0019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:44.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbeeffd640 1 -- 172.21.15.55:0/3348266683 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00b4640 con 0x7fdbf80b7cd0 2023-07-06T22:18:44.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbeeffd640 1 -- 172.21.15.55:0/3348266683 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe00b47c0 con 0x7fdbf80b7cd0 2023-07-06T22:18:44.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbeeffd640 1 -- 172.21.15.55:0/3348266683 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00b4b70 con 0x7fdbf80b7cd0 2023-07-06T22:18:44.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbfcc34640 1 -- 172.21.15.55:0/3348266683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf815ce60 con 0x7fdbf80b7cd0 2023-07-06T22:18:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.909+0000 7fdbfcc34640 1 -- 172.21.15.55:0/3348266683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf8154e20 con 0x7fdbf80b7cd0 2023-07-06T22:18:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.913+0000 7fdbfcc34640 1 -- 172.21.15.55:0/3348266683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf815d660 con 0x7fdbf80b7cd0 2023-07-06T22:18:44.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.913+0000 7fdbeeffd640 1 -- 172.21.15.55:0/3348266683 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdbe00b2070 con 0x7fdbf80b7cd0 2023-07-06T22:18:44.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.913+0000 7fdbeeffd640 1 --2- 172.21.15.55:0/3348266683 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdbd80663a0 0x7fdbd8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:44.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.913+0000 7fdbeeffd640 1 -- 172.21.15.55:0/3348266683 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdbe011e2b0 con 0x7fdbf80b7cd0 2023-07-06T22:18:44.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.913+0000 7fdbf659c640 1 --2- 172.21.15.55:0/3348266683 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdbd80663a0 0x7fdbd8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:44.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.913+0000 7fdbf659c640 1 --2- 172.21.15.55:0/3348266683 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdbd80663a0 0x7fdbd8068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800b810 tx=0x7fdbe8008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:44.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:44.917+0000 7fdbeeffd640 1 -- 172.21.15.55:0/3348266683 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdbe00eb310 con 0x7fdbf80b7cd0 2023-07-06T22:18:45.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.069+0000 7fdbfcc34640 1 -- 172.21.15.55:0/3348266683 --> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdbf80cea60 con 0x7fdbd80663a0 2023-07-06T22:18:45.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.077+0000 7fdbeeffd640 1 -- 172.21.15.55:0/3348266683 <== mgr.10167 v2:172.21.15.55:6832/957337795 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299737 (secure 0 0 0) 0x7fdbe800b400 con 0x7fdbd80663a0 2023-07-06T22:18:45.078 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:45.079 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:18:45.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.077+0000 7fdbfcc34640 1 -- 172.21.15.55:0/3348266683 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdbd80663a0 msgr2=0x7fdbd8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:45.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.077+0000 7fdbfcc34640 1 --2- 172.21.15.55:0/3348266683 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdbd80663a0 0x7fdbd8068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800b810 tx=0x7fdbe8008040 comp rx=0 tx=0).stop 2023-07-06T22:18:45.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.077+0000 7fdbfcc34640 1 -- 172.21.15.55:0/3348266683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf80b7cd0 msgr2=0x7fdbf8158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:45.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.077+0000 7fdbfcc34640 1 --2- 172.21.15.55:0/3348266683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf80b7cd0 0x7fdbf8158af0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00ae040 tx=0x7fdbe0019210 comp rx=0 tx=0).stop 2023-07-06T22:18:45.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.077+0000 7fdbfcc34640 1 -- 172.21.15.55:0/3348266683 shutdown_connections 2023-07-06T22:18:45.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.077+0000 7fdbfcc34640 1 --2- 172.21.15.55:0/3348266683 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdbd80663a0 0x7fdbd8068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.077+0000 7fdbfcc34640 1 --2- 172.21.15.55:0/3348266683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdbf80ce610 0x7fdbf806a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.077+0000 7fdbfcc34640 1 --2- 172.21.15.55:0/3348266683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf80b7cd0 0x7fdbf8158af0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.077+0000 7fdbfcc34640 1 --2- 172.21.15.55:0/3348266683 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdbf80b1e10 0x7fdbf81548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.077+0000 7fdbfcc34640 1 -- 172.21.15.55:0/3348266683 >> 172.21.15.55:0/3348266683 conn(0x7fdbf80ceee0 msgr2=0x7fdbf8155140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:45.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.081+0000 7fdbfcc34640 1 -- 172.21.15.55:0/3348266683 shutdown_connections 2023-07-06T22:18:45.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.081+0000 7fdbfcc34640 1 -- 172.21.15.55:0/3348266683 wait complete. 2023-07-06T22:18:45.099 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T22:18:43.575782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":379824,"kb_used_data":18288,"kb_used_omap":0,"kb_used_meta":361472,"kb_avail":754594896,"statfs":{"total":773094113280,"available":772705173504,"internally_reserved":0,"allocated":18726912,"data_stored":10584810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":370147328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.393719"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190996+0000","last_change":"2023-07-06T22:18:39.190996+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190996+0000","last_undegraded":"2023-07-06T22:18:39.190996+0000","last_fullsized":"2023-07-06T22:18:39.190996+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190528+0000","last_change":"2023-07-06T22:18:39.190528+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190528+0000","last_undegraded":"2023-07-06T22:18:39.190528+0000","last_fullsized":"2023-07-06T22:18:39.190528+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184605+0000","last_change":"2023-07-06T22:18:39.184605+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184605+0000","last_undegraded":"2023-07-06T22:18:39.184605+0000","last_fullsized":"2023-07-06T22:18:39.184605+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184642+0000","last_change":"2023-07-06T22:18:39.184642+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184642+0000","last_undegraded":"2023-07-06T22:18:39.184642+0000","last_fullsized":"2023-07-06T22:18:39.184642+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.187782+0000","last_change":"2023-07-06T22:18:39.187782+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.187782+0000","last_undegraded":"2023-07-06T22:18:39.187782+0000","last_fullsized":"2023-07-06T22:18:39.187782+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.186107+0000","last_change":"2023-07-06T22:18:39.186107+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.186107+0000","last_undegraded":"2023-07-06T22:18:39.186107+0000","last_fullsized":"2023-07-06T22:18:39.186107+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.185982+0000","last_change":"2023-07-06T22:18:39.185982+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.185982+0000","last_undegraded":"2023-07-06T22:18:39.185982+0000","last_fullsized":"2023-07-06T22:18:39.185982+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.191010+0000","last_change":"2023-07-06T22:18:39.191010+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.191010+0000","last_undegraded":"2023-07-06T22:18:39.191010+0000","last_fullsized":"2023-07-06T22:18:39.191010+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.187898+0000","last_change":"2023-07-06T22:18:39.187898+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.187898+0000","last_undegraded":"2023-07-06T22:18:39.187898+0000","last_fullsized":"2023-07-06T22:18:39.187898+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.188880+0000","last_change":"2023-07-06T22:18:39.188880+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.188880+0000","last_undegraded":"2023-07-06T22:18:39.188880+0000","last_fullsized":"2023-07-06T22:18:39.188880+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190242+0000","last_change":"2023-07-06T22:18:39.190242+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190242+0000","last_undegraded":"2023-07-06T22:18:39.190242+0000","last_fullsized":"2023-07-06T22:18:39.190242+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190833+0000","last_change":"2023-07-06T22:18:39.190833+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190833+0000","last_undegraded":"2023-07-06T22:18:39.190833+0000","last_fullsized":"2023-07-06T22:18:39.190833+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184602+0000","last_change":"2023-07-06T22:18:39.184602+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184602+0000","last_undegraded":"2023-07-06T22:18:39.184602+0000","last_fullsized":"2023-07-06T22:18:39.184602+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190336+0000","last_change":"2023-07-06T22:18:39.190336+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190336+0000","last_undegraded":"2023-07-06T22:18:39.190336+0000","last_fullsized":"2023-07-06T22:18:39.190336+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184614+0000","last_change":"2023-07-06T22:18:39.184614+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184614+0000","last_undegraded":"2023-07-06T22:18:39.184614+0000","last_fullsized":"2023-07-06T22:18:39.184614+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190208+0000","last_change":"2023-07-06T22:18:39.190208+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190208+0000","last_undegraded":"2023-07-06T22:18:39.190208+0000","last_fullsized":"2023-07-06T22:18:39.190208+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.188646+0000","last_change":"2023-07-06T22:18:39.188646+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.188646+0000","last_undegraded":"2023-07-06T22:18:39.188646+0000","last_fullsized":"2023-07-06T22:18:39.188646+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.187972+0000","last_change":"2023-07-06T22:18:39.187972+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.187972+0000","last_undegraded":"2023-07-06T22:18:39.187972+0000","last_fullsized":"2023-07-06T22:18:39.187972+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184886+0000","last_change":"2023-07-06T22:18:39.184886+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184886+0000","last_undegraded":"2023-07-06T22:18:39.184886+0000","last_fullsized":"2023-07-06T22:18:39.184886+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.188217+0000","last_change":"2023-07-06T22:18:39.188217+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.188217+0000","last_undegraded":"2023-07-06T22:18:39.188217+0000","last_fullsized":"2023-07-06T22:18:39.188217+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.189352+0000","last_change":"2023-07-06T22:18:39.189352+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.189352+0000","last_undegraded":"2023-07-06T22:18:39.189352+0000","last_fullsized":"2023-07-06T22:18:39.189352+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184631+0000","last_change":"2023-07-06T22:18:39.184631+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184631+0000","last_undegraded":"2023-07-06T22:18:39.184631+0000","last_fullsized":"2023-07-06T22:18:39.184631+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184823+0000","last_change":"2023-07-06T22:18:39.184823+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184823+0000","last_undegraded":"2023-07-06T22:18:39.184823+0000","last_fullsized":"2023-07-06T22:18:39.184823+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.189622+0000","last_change":"2023-07-06T22:18:39.189622+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.189622+0000","last_undegraded":"2023-07-06T22:18:39.189622+0000","last_fullsized":"2023-07-06T22:18:39.189622+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.189082+0000","last_change":"2023-07-06T22:18:39.189082+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.189082+0000","last_undegraded":"2023-07-06T22:18:39.189082+0000","last_fullsized":"2023-07-06T22:18:39.189082+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"167'304","reported_seq":1146,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.191871+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:18:39.191871+0000","last_peered":"2023-07-06T22:18:39.191871+0000","last_clean":"2023-07-06T22:18:39.191871+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:18:39.191871+0000","last_undegraded":"2023-07-06T22:18:39.191871+0000","last_fullsized":"2023-07-06T22:18:39.191871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:28:35.844046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":288,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.189747+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:18:39.189747+0000","last_peered":"2023-07-06T22:18:39.189747+0000","last_clean":"2023-07-06T22:18:39.189747+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:18:39.189747+0000","last_undegraded":"2023-07-06T22:18:39.189747+0000","last_fullsized":"2023-07-06T22:18:39.189747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:37:08.335890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.189565+0000","last_change":"2023-07-06T22:18:39.189565+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.189565+0000","last_undegraded":"2023-07-06T22:18:39.189565+0000","last_fullsized":"2023-07-06T22:18:39.189565+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":327,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.191736+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:18:39.191736+0000","last_peered":"2023-07-06T22:18:39.191736+0000","last_clean":"2023-07-06T22:18:39.191736+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:18:39.191736+0000","last_undegraded":"2023-07-06T22:18:39.191736+0000","last_fullsized":"2023-07-06T22:18:39.191736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:27:20.831874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.186221+0000","last_change":"2023-07-06T22:18:39.186221+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.186221+0000","last_undegraded":"2023-07-06T22:18:39.186221+0000","last_fullsized":"2023-07-06T22:18:39.186221+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":328,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.184208+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:18:39.184208+0000","last_peered":"2023-07-06T22:18:39.184208+0000","last_clean":"2023-07-06T22:18:39.184208+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:18:39.184208+0000","last_undegraded":"2023-07-06T22:18:39.184208+0000","last_fullsized":"2023-07-06T22:18:39.184208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:15:01.325637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.186214+0000","last_change":"2023-07-06T22:18:39.186214+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.186214+0000","last_undegraded":"2023-07-06T22:18:39.186214+0000","last_fullsized":"2023-07-06T22:18:39.186214+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":288,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.189416+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:18:39.189416+0000","last_peered":"2023-07-06T22:18:39.189416+0000","last_clean":"2023-07-06T22:18:39.189416+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:18:39.189416+0000","last_undegraded":"2023-07-06T22:18:39.189416+0000","last_fullsized":"2023-07-06T22:18:39.189416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:18:49.494731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190102+0000","last_change":"2023-07-06T22:18:39.190102+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190102+0000","last_undegraded":"2023-07-06T22:18:39.190102+0000","last_fullsized":"2023-07-06T22:18:39.190102+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":292,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.187105+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:18:39.187105+0000","last_peered":"2023-07-06T22:18:39.187105+0000","last_clean":"2023-07-06T22:18:39.187105+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:18:39.187105+0000","last_undegraded":"2023-07-06T22:18:39.187105+0000","last_fullsized":"2023-07-06T22:18:39.187105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:47:07.975449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.185954+0000","last_change":"2023-07-06T22:18:39.185954+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.185954+0000","last_undegraded":"2023-07-06T22:18:39.185954+0000","last_fullsized":"2023-07-06T22:18:39.185954+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":326,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.191693+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:18:39.191693+0000","last_peered":"2023-07-06T22:18:39.191693+0000","last_clean":"2023-07-06T22:18:39.191693+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:18:39.191693+0000","last_undegraded":"2023-07-06T22:18:39.191693+0000","last_fullsized":"2023-07-06T22:18:39.191693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:08:22.589157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.188292+0000","last_change":"2023-07-06T22:18:39.188292+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.188292+0000","last_undegraded":"2023-07-06T22:18:39.188292+0000","last_fullsized":"2023-07-06T22:18:39.188292+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":292,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.187433+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:18:39.187433+0000","last_peered":"2023-07-06T22:18:39.187433+0000","last_clean":"2023-07-06T22:18:39.187433+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:18:39.187433+0000","last_undegraded":"2023-07-06T22:18:39.187433+0000","last_fullsized":"2023-07-06T22:18:39.187433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:12:22.072679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.185923+0000","last_change":"2023-07-06T22:18:39.185923+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.185923+0000","last_undegraded":"2023-07-06T22:18:39.185923+0000","last_fullsized":"2023-07-06T22:18:39.185923+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":283,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.187128+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:18:39.187128+0000","last_peered":"2023-07-06T22:18:39.187128+0000","last_clean":"2023-07-06T22:18:39.187128+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:18:39.187128+0000","last_undegraded":"2023-07-06T22:18:39.187128+0000","last_fullsized":"2023-07-06T22:18:39.187128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:54:47.486928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575284,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41956,"kb_used_data":2716,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329884,"statfs":{"total":96636764160,"available":96593801216,"internally_reserved":0,"allocated":2781184,"data_stored":1762873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70599999999999996,"15min":0.72699999999999998},"min":{"1min":0.54100000000000004,"5min":0.432,"15min":0.432},"max":{"1min":0.88700000000000001,"5min":0.93300000000000005,"15min":1.0740000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70999999999999996,"15min":0.71499999999999997},"min":{"1min":0.53800000000000003,"5min":0.45700000000000002,"15min":0.42299999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.998},"last":0.65300000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92700000000000005,"5min":0.98299999999999998,"15min":1.1220000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.58399999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94599999999999995,"5min":1.006,"15min":1.012},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73499999999999999,"15min":0.74399999999999999},"min":{"1min":0.51400000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.016},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.86799999999999999,"5min":0.99299999999999999,"15min":1.149},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.55500000000000005},"min":{"1min":0.39700000000000002,"5min":0.372,"15min":0.36199999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.91300000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.443,"5min":0.40799999999999997,"15min":0.39300000000000002},"max":{"1min":0.872,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.59399999999999997},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":1.038},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.495,"5min":0.442,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":0.92400000000000004,"15min":0.995},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.443},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":1.024},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67600000000000005,"15min":0.67700000000000005},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.018},"last":0.52200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575284,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37276,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334564,"statfs":{"total":96636764160,"available":96598593536,"internally_reserved":0,"allocated":2183168,"data_stored":1171486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.376},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.7829999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.49399999999999999,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":0.877,"5min":0.95199999999999996,"15min":1.633},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.55300000000000005,"5min":0.46700000000000003,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":1.044,"15min":1.9099999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74299999999999999,"15min":0.74099999999999999},"min":{"1min":0.61199999999999999,"5min":0.46600000000000003,"15min":0.438},"max":{"1min":0.85899999999999999,"5min":0.93700000000000006,"15min":0.97799999999999998},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.45800000000000002},"max":{"1min":0.86699999999999999,"5min":0.93899999999999995,"15min":2.0299999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.56000000000000005,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.58999999999999997,"5min":0.53300000000000003,"15min":0.501},"max":{"1min":0.86399999999999999,"5min":0.97899999999999998,"15min":1.5920000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":0.877,"5min":0.95599999999999996,"15min":1.996},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":1.024,"15min":1.024},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41599999999999998,"15min":0.40999999999999998},"max":{"1min":0.74399999999999999,"5min":0.94999999999999996,"15min":0.996},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.39200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73199999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.75},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.48599999999999999,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.83999999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.621,"15min":0.623},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.436},"max":{"1min":0.82399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.45600000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.78900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575283,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55340,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316500,"statfs":{"total":96636764160,"available":96580096000,"internally_reserved":0,"allocated":2199552,"data_stored":1179023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.52900000000000003,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.92800000000000005,"5min":0.97199999999999998,"15min":0.999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.57899999999999996,"5min":0.51200000000000001,"15min":0.46400000000000002},"max":{"1min":0.92500000000000004,"5min":0.995,"15min":0.995},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.73799999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.43099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.51000000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.3200000000000001},"last":0.629}]},{"osd":2,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.443},"max":{"1min":0.998,"5min":0.998,"15min":1.4299999999999999},"last":0.749},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.67500000000000004,"5min":0.58499999999999996,"15min":0.48199999999999998},"max":{"1min":0.88500000000000001,"5min":0.999,"15min":1.0409999999999999},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.65200000000000002,"5min":0.56699999999999995,"15min":0.46800000000000003},"max":{"1min":0.94399999999999995,"5min":0.996,"15min":1.5169999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.76700000000000002},"min":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.436},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.47799999999999998,"5min":0.39500000000000002,"15min":0.34899999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59799999999999998,"15min":0.61199999999999999},"min":{"1min":0.47599999999999998,"5min":0.432,"15min":0.32600000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.96099999999999997},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.52900000000000003,"5min":0.44700000000000001,"15min":0.39600000000000002},"max":{"1min":0.88,"5min":0.96399999999999997,"15min":0.998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.42199999999999999},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.96999999999999997},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.38900000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67800000000000005,"15min":0.68500000000000005},"min":{"1min":0.52900000000000003,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":0.83299999999999996,"5min":0.97899999999999998,"15min":0.999},"last":0.66400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575282,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55340,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316500,"statfs":{"total":96636764160,"available":96580096000,"internally_reserved":0,"allocated":2199552,"data_stored":1179023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.54500000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84299999999999997,"5min":0.96699999999999997,"15min":0.98999999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.75600000000000001,"15min":0.746},"min":{"1min":0.55700000000000005,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.97299999999999998,"5min":0.97899999999999998,"15min":1.016},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.754,"15min":0.749},"min":{"1min":0.61299999999999999,"5min":0.45200000000000001,"15min":0.38300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.495},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74399999999999999,"15min":0.73499999999999999},"min":{"1min":0.58999999999999997,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.99299999999999999,"15min":0.996},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.63800000000000001,"5min":0.53100000000000003,"15min":0.47799999999999998},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":1.0760000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.60299999999999998,"5min":0.51200000000000001,"15min":0.502},"max":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.0580000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.748,"15min":0.73899999999999999},"min":{"1min":0.60099999999999998,"5min":0.51900000000000002,"15min":0.45600000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.98699999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76300000000000001},"min":{"1min":0.61599999999999999,"5min":0.52700000000000002,"15min":0.51900000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":1.03},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83899999999999997,"5min":0.91200000000000003,"15min":0.92600000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.46000000000000002,"5min":0.39900000000000002,"15min":0.39800000000000002},"max":{"1min":0.77100000000000002,"5min":0.95599999999999996,"15min":1.006},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.95899999999999996,"15min":1.0509999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88400000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.624}]},{"osd":7,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.53000000000000003,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":0.84999999999999998,"5min":0.94799999999999995,"15min":1.0469999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.55000000000000004,"5min":0.432,"15min":0.432},"max":{"1min":0.86699999999999999,"5min":1.0109999999999999,"15min":1.1100000000000001},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575283,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51244,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320596,"statfs":{"total":96636764160,"available":96584290304,"internally_reserved":0,"allocated":2199552,"data_stored":1179023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68100000000000005,"5min":0.69399999999999995,"15min":0.85899999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50900000000000001,"15min":0.49099999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69799999999999995,"5min":0.72799999999999998,"15min":0.83899999999999997},"last":0.437},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61399999999999999,"15min":0.60499999999999998},"min":{"1min":0.442,"5min":0.44,"15min":0.41299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38700000000000001},"max":{"1min":0.63800000000000001,"5min":0.72399999999999998,"15min":0.875},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.34699999999999998},"max":{"1min":0.71399999999999997,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80300000000000005,"15min":0.77700000000000002},"min":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.441},"max":{"1min":1.0449999999999999,"5min":1.081,"15min":1.474},"last":0.751},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.79200000000000004},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.54600000000000004},"max":{"1min":0.99099999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.624}]},{"osd":5,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83099999999999996,"15min":0.81100000000000005},"min":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.57499999999999996},"max":{"1min":1.175,"5min":1.175,"15min":1.3740000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82299999999999995,"15min":0.80300000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.022,"5min":1.228,"15min":1.2330000000000001},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.80200000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.51800000000000002},"max":{"1min":1.1399999999999999,"5min":1.194,"15min":1.3899999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.82999999999999996},"min":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.57299999999999995},"max":{"1min":1.0960000000000001,"5min":1.266,"15min":1.3220000000000001},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.002,"5min":1.121,"15min":1.2210000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84499999999999997,"15min":0.82699999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.244,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.68000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575283,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41376,"kb_used_data":2136,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330464,"statfs":{"total":96636764160,"available":96594395136,"internally_reserved":0,"allocated":2187264,"data_stored":1172505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.32300000000000001,"15min":0.27800000000000002},"max":{"1min":0.65100000000000002,"5min":0.76100000000000001,"15min":0.88700000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.46100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.70899999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.501}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.41899999999999998,"5min":0.35799999999999998,"15min":0.32300000000000001},"max":{"1min":0.74099999999999999,"5min":0.79400000000000004,"15min":0.84099999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.46000000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.68700000000000006,"5min":0.77100000000000002,"15min":0.97099999999999997},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.434,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":0.77200000000000002,"15min":0.997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.499,"5min":0.434,"15min":0.378},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.80400000000000005},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.64900000000000002,"5min":0.56599999999999995,"15min":0.50900000000000001},"max":{"1min":0.98399999999999999,"5min":1.45,"15min":1.45},"last":1.663},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.47399999999999998},"max":{"1min":0.90600000000000003,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.67400000000000004,"5min":0.60899999999999999,"15min":0.51100000000000001},"max":{"1min":1.0029999999999999,"5min":1.337,"15min":1.337},"last":0.872},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.53000000000000003},"max":{"1min":0.91300000000000003,"5min":1.2490000000000001,"15min":1.2829999999999999},"last":1.0409999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83699999999999997,"15min":0.82099999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.54800000000000004},"max":{"1min":1.0900000000000001,"5min":1.367,"15min":1.367},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.83599999999999997,"15min":0.83699999999999997},"min":{"1min":0.63100000000000001,"5min":0.56399999999999995,"15min":0.56100000000000005},"max":{"1min":0.97399999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.85299999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.56999999999999995},"max":{"1min":1.024,"5min":1.407,"15min":1.407},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.85199999999999998,"15min":0.84999999999999998},"min":{"1min":0.64900000000000002,"5min":0.59899999999999998,"15min":0.55600000000000005},"max":{"1min":1.0329999999999999,"5min":1.296,"15min":1.296},"last":0.98399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575284,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59424,"kb_used_data":2136,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312416,"statfs":{"total":96636764160,"available":96575913984,"internally_reserved":0,"allocated":2187264,"data_stored":1172505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.46600000000000003},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.32900000000000001},"max":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.81699999999999995},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.36899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.94299999999999995},"last":0.31},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.5}]},{"osd":3,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":0.84899999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.441}]},{"osd":4,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.018,"5min":1.083,"15min":1.1140000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.54200000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0700000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.58399999999999996,"5min":0.57299999999999995,"15min":0.48699999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.21},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81699999999999995,"15min":0.82699999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1100000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82299999999999995,"15min":0.83199999999999996},"min":{"1min":0.61899999999999999,"5min":0.53800000000000003,"15min":0.53600000000000003},"max":{"1min":1.0800000000000001,"5min":1.244,"15min":1.302},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82799999999999996,"15min":0.83299999999999996},"min":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.25,"5min":1.25,"15min":1.3360000000000001},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82599999999999996,"15min":0.83199999999999996},"min":{"1min":0.67100000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0489999999999999,"5min":1.1779999999999999,"15min":1.405},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84999999999999998,"15min":0.84099999999999997},"min":{"1min":0.68200000000000005,"5min":0.57099999999999995,"15min":0.54700000000000004},"max":{"1min":0.97699999999999998,"5min":1.2110000000000001,"15min":1.3779999999999999},"last":0.68799999999999994}]}]},{"osd":0,"up_from":13,"seq":55834575283,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37868,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333972,"statfs":{"total":96636764160,"available":96597987328,"internally_reserved":0,"allocated":2789376,"data_stored":1768372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.316},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.34000000000000002,"5min":0.33600000000000002,"15min":0.312},"max":{"1min":0.749,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52100000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.505},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76100000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.33400000000000002},"max":{"1min":0.65200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.45200000000000001,"5min":0.41099999999999998,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80900000000000005,"15min":0.80600000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.1439999999999999,"5min":1.294,"15min":1.294},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80800000000000005,"15min":0.80300000000000005},"min":{"1min":0.61899999999999999,"5min":0.53500000000000003,"15min":0.50900000000000001},"max":{"1min":1.022,"5min":1.107,"15min":1.3320000000000001},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.56000000000000005,"15min":0.48899999999999999},"max":{"1min":1.0569999999999999,"5min":1.345,"15min":1.345},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.63700000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81999999999999995,"15min":0.81399999999999995},"min":{"1min":0.628,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98199999999999998,"5min":1.0049999999999999,"15min":1.153},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.628,"5min":0.59099999999999997,"15min":0.58499999999999996},"max":{"1min":1.036,"5min":1.1910000000000001,"15min":1.272},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.82299999999999995,"15min":0.82899999999999996},"min":{"1min":0.64300000000000002,"5min":0.624,"15min":0.57999999999999996},"max":{"1min":1.083,"5min":1.125,"15min":1.26},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.82099999999999995},"min":{"1min":0.67100000000000004,"5min":0.60499999999999998,"15min":0.55700000000000005},"max":{"1min":1.022,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.79000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:18:45.106 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:18:45.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.285+0000 7f350b59f640 1 Processor -- start 2023-07-06T22:18:45.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.285+0000 7f350b59f640 1 -- start start 2023-07-06T22:18:45.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.289+0000 7f350b59f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f350406f8e0 0x7f350406fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:45.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.289+0000 7f350b59f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f350415cc00 0x7f350415f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:45.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.289+0000 7f350b59f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350415c770 con 0x7f350415bc40 2023-07-06T22:18:45.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.289+0000 7f350b59f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350406d4f0 con 0x7f350415cc00 2023-07-06T22:18:45.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.289+0000 7f350b59f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35040701f0 con 0x7f350406f8e0 2023-07-06T22:18:45.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.289+0000 7f3509b3c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f350415cc00 0x7f350415f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:45.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.289+0000 7f3509b3c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f350415cc00 0x7f350415f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37166/0 (socket says 172.21.15.55:37166) 2023-07-06T22:18:45.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.289+0000 7f3509b3c640 1 -- 172.21.15.55:0/2788176449 learned_addr learned my addr 172.21.15.55:0/2788176449 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:45.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.289+0000 7f350933b640 1 --2- 172.21.15.55:0/2788176449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f350406f8e0 0x7f350406fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:45.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.289+0000 7f3509b3c640 1 -- 172.21.15.55:0/2788176449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f350406f8e0 msgr2=0x7f350406fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:45.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.289+0000 7f3509b3c640 1 --2- 172.21.15.55:0/2788176449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f350406f8e0 0x7f350406fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.289+0000 7f3509b3c640 1 -- 172.21.15.55:0/2788176449 >> v1:172.21.15.138:6789/0 conn(0x7f350415bc40 legacy=0x7f350406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:45.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.289+0000 7f3509b3c640 1 -- 172.21.15.55:0/2788176449 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350406d210 con 0x7f350415cc00 2023-07-06T22:18:45.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.289+0000 7f3509b3c640 1 --2- 172.21.15.55:0/2788176449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f350415cc00 0x7f350415f4c0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009e50 tx=0x7f34fc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4231cd2d1e64a081 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:45.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f34fbfff640 1 -- 172.21.15.55:0/2788176449 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0a57d0 con 0x7f350415cc00 2023-07-06T22:18:45.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f34fbfff640 1 -- 172.21.15.55:0/2788176449 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc0a5930 con 0x7f350415cc00 2023-07-06T22:18:45.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f34fbfff640 1 -- 172.21.15.55:0/2788176449 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0a5cc0 con 0x7f350415cc00 2023-07-06T22:18:45.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 -- 172.21.15.55:0/2788176449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f350415cc00 msgr2=0x7f350415f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:45.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 --2- 172.21.15.55:0/2788176449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f350415cc00 0x7f350415f4c0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009e50 tx=0x7f34fc01ca10 comp rx=0 tx=0).stop 2023-07-06T22:18:45.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 -- 172.21.15.55:0/2788176449 shutdown_connections 2023-07-06T22:18:45.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 --2- 172.21.15.55:0/2788176449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f350415cc00 0x7f350415f4c0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 --2- 172.21.15.55:0/2788176449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f350406f8e0 0x7f350406fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 -- 172.21.15.55:0/2788176449 >> 172.21.15.55:0/2788176449 conn(0x7f35040cbd80 msgr2=0x7f35040ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:45.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 -- 172.21.15.55:0/2788176449 shutdown_connections 2023-07-06T22:18:45.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 -- 172.21.15.55:0/2788176449 wait complete. 2023-07-06T22:18:45.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 Processor -- start 2023-07-06T22:18:45.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 -- start start 2023-07-06T22:18:45.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f350406f8e0 0x7f3504152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:45.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f350415bc40 0x7f350415d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:45.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f350415cc00 0x7f35041584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:45.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3504153d70 con 0x7f350406f8e0 2023-07-06T22:18:45.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35040cad60 con 0x7f350415bc40 2023-07-06T22:18:45.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350b59f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3504154510 con 0x7f350415cc00 2023-07-06T22:18:45.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.293+0000 7f350933b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f350406f8e0 0x7f3504152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:45.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f350933b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f350406f8e0 0x7f3504152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37178/0 (socket says 172.21.15.55:37178) 2023-07-06T22:18:45.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f350933b640 1 -- 172.21.15.55:0/3756311388 learned_addr learned my addr 172.21.15.55:0/3756311388 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:45.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f3508b3a640 1 --2- 172.21.15.55:0/3756311388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f350415bc40 0x7f350415d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:45.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f3509b3c640 1 --2- 172.21.15.55:0/3756311388 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f350415cc00 0x7f35041584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:45.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f350933b640 1 -- 172.21.15.55:0/3756311388 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f350415cc00 msgr2=0x7f35041584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f350933b640 1 --2- 172.21.15.55:0/3756311388 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f350415cc00 0x7f35041584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f350933b640 1 -- 172.21.15.55:0/3756311388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f350415bc40 msgr2=0x7f350415d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f350933b640 1 --2- 172.21.15.55:0/3756311388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f350415bc40 0x7f350415d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f350933b640 1 -- 172.21.15.55:0/3756311388 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc009b30 con 0x7f350406f8e0 2023-07-06T22:18:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f350933b640 1 --2- 172.21.15.55:0/3756311388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f350406f8e0 0x7f3504152c70 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f350000d800 tx=0x7f350000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f34f9ffb640 1 -- 172.21.15.55:0/3756311388 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350000b660 con 0x7f350406f8e0 2023-07-06T22:18:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f34f9ffb640 1 -- 172.21.15.55:0/3756311388 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350000b7c0 con 0x7f350406f8e0 2023-07-06T22:18:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f34f9ffb640 1 -- 172.21.15.55:0/3756311388 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350000bb30 con 0x7f350406f8e0 2023-07-06T22:18:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f350b59f640 1 -- 172.21.15.55:0/3756311388 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35040c9550 con 0x7f350406f8e0 2023-07-06T22:18:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f350b59f640 1 -- 172.21.15.55:0/3756311388 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3504154230 con 0x7f350406f8e0 2023-07-06T22:18:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f350b59f640 1 -- 172.21.15.55:0/3756311388 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3504066d60 con 0x7f350406f8e0 2023-07-06T22:18:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.297+0000 7f34f9ffb640 1 -- 172.21.15.55:0/3756311388 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f350000bc90 con 0x7f350406f8e0 2023-07-06T22:18:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.301+0000 7f34f9ffb640 1 --2- 172.21.15.55:0/3756311388 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f34e80663a0 0x7f34e8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.301+0000 7f34f9ffb640 1 -- 172.21.15.55:0/3756311388 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f35000843b0 con 0x7f350406f8e0 2023-07-06T22:18:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.301+0000 7f3508b3a640 1 --2- 172.21.15.55:0/3756311388 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f34e80663a0 0x7f34e8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:45.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.301+0000 7f3508b3a640 1 --2- 172.21.15.55:0/3756311388 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f34e80663a0 0x7f34e8068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3504157c00 tx=0x7f34f4009040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:45.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.305+0000 7f34f9ffb640 1 -- 172.21.15.55:0/3756311388 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3500051670 con 0x7f350406f8e0 2023-07-06T22:18:45.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.457+0000 7f350b59f640 1 -- 172.21.15.55:0/3756311388 --> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35040cf190 con 0x7f34e80663a0 2023-07-06T22:18:45.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.465+0000 7f34f9ffb640 1 -- 172.21.15.55:0/3756311388 <== mgr.10167 v2:172.21.15.55:6832/957337795 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299737 (secure 0 0 0) 0x7f35040cf190 con 0x7f34e80663a0 2023-07-06T22:18:45.468 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:18:45.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.469+0000 7f350b59f640 1 -- 172.21.15.55:0/3756311388 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f34e80663a0 msgr2=0x7f34e8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:45.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.469+0000 7f350b59f640 1 --2- 172.21.15.55:0/3756311388 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f34e80663a0 0x7f34e8068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3504157c00 tx=0x7f34f4009040 comp rx=0 tx=0).stop 2023-07-06T22:18:45.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.469+0000 7f350b59f640 1 -- 172.21.15.55:0/3756311388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f350406f8e0 msgr2=0x7f3504152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:45.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.469+0000 7f350b59f640 1 --2- 172.21.15.55:0/3756311388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f350406f8e0 0x7f3504152c70 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f350000d800 tx=0x7f350000dcc0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.469+0000 7f350b59f640 1 -- 172.21.15.55:0/3756311388 shutdown_connections 2023-07-06T22:18:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.469+0000 7f350b59f640 1 --2- 172.21.15.55:0/3756311388 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f34e80663a0 0x7f34e8068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.469+0000 7f350b59f640 1 --2- 172.21.15.55:0/3756311388 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f350415cc00 0x7f35041584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.469+0000 7f350b59f640 1 --2- 172.21.15.55:0/3756311388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f350415bc40 0x7f350415d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.469+0000 7f350b59f640 1 --2- 172.21.15.55:0/3756311388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f350406f8e0 0x7f3504152c70 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.469+0000 7f350b59f640 1 -- 172.21.15.55:0/3756311388 >> 172.21.15.55:0/3756311388 conn(0x7f35040cbd80 msgr2=0x7f35040ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.469+0000 7f350b59f640 1 -- 172.21.15.55:0/3756311388 shutdown_connections 2023-07-06T22:18:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.469+0000 7f350b59f640 1 -- 172.21.15.55:0/3756311388 wait complete. 2023-07-06T22:18:45.488 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T22:18:43.575782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":379824,"kb_used_data":18288,"kb_used_omap":0,"kb_used_meta":361472,"kb_avail":754594896,"statfs":{"total":773094113280,"available":772705173504,"internally_reserved":0,"allocated":18726912,"data_stored":10584810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":370147328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.393719"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190996+0000","last_change":"2023-07-06T22:18:39.190996+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190996+0000","last_undegraded":"2023-07-06T22:18:39.190996+0000","last_fullsized":"2023-07-06T22:18:39.190996+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190528+0000","last_change":"2023-07-06T22:18:39.190528+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190528+0000","last_undegraded":"2023-07-06T22:18:39.190528+0000","last_fullsized":"2023-07-06T22:18:39.190528+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184605+0000","last_change":"2023-07-06T22:18:39.184605+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184605+0000","last_undegraded":"2023-07-06T22:18:39.184605+0000","last_fullsized":"2023-07-06T22:18:39.184605+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184642+0000","last_change":"2023-07-06T22:18:39.184642+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184642+0000","last_undegraded":"2023-07-06T22:18:39.184642+0000","last_fullsized":"2023-07-06T22:18:39.184642+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.187782+0000","last_change":"2023-07-06T22:18:39.187782+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.187782+0000","last_undegraded":"2023-07-06T22:18:39.187782+0000","last_fullsized":"2023-07-06T22:18:39.187782+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.186107+0000","last_change":"2023-07-06T22:18:39.186107+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.186107+0000","last_undegraded":"2023-07-06T22:18:39.186107+0000","last_fullsized":"2023-07-06T22:18:39.186107+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.185982+0000","last_change":"2023-07-06T22:18:39.185982+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.185982+0000","last_undegraded":"2023-07-06T22:18:39.185982+0000","last_fullsized":"2023-07-06T22:18:39.185982+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.191010+0000","last_change":"2023-07-06T22:18:39.191010+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.191010+0000","last_undegraded":"2023-07-06T22:18:39.191010+0000","last_fullsized":"2023-07-06T22:18:39.191010+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.187898+0000","last_change":"2023-07-06T22:18:39.187898+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.187898+0000","last_undegraded":"2023-07-06T22:18:39.187898+0000","last_fullsized":"2023-07-06T22:18:39.187898+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.188880+0000","last_change":"2023-07-06T22:18:39.188880+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.188880+0000","last_undegraded":"2023-07-06T22:18:39.188880+0000","last_fullsized":"2023-07-06T22:18:39.188880+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190242+0000","last_change":"2023-07-06T22:18:39.190242+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190242+0000","last_undegraded":"2023-07-06T22:18:39.190242+0000","last_fullsized":"2023-07-06T22:18:39.190242+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190833+0000","last_change":"2023-07-06T22:18:39.190833+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190833+0000","last_undegraded":"2023-07-06T22:18:39.190833+0000","last_fullsized":"2023-07-06T22:18:39.190833+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184602+0000","last_change":"2023-07-06T22:18:39.184602+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184602+0000","last_undegraded":"2023-07-06T22:18:39.184602+0000","last_fullsized":"2023-07-06T22:18:39.184602+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190336+0000","last_change":"2023-07-06T22:18:39.190336+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190336+0000","last_undegraded":"2023-07-06T22:18:39.190336+0000","last_fullsized":"2023-07-06T22:18:39.190336+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184614+0000","last_change":"2023-07-06T22:18:39.184614+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184614+0000","last_undegraded":"2023-07-06T22:18:39.184614+0000","last_fullsized":"2023-07-06T22:18:39.184614+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190208+0000","last_change":"2023-07-06T22:18:39.190208+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190208+0000","last_undegraded":"2023-07-06T22:18:39.190208+0000","last_fullsized":"2023-07-06T22:18:39.190208+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.188646+0000","last_change":"2023-07-06T22:18:39.188646+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.188646+0000","last_undegraded":"2023-07-06T22:18:39.188646+0000","last_fullsized":"2023-07-06T22:18:39.188646+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.187972+0000","last_change":"2023-07-06T22:18:39.187972+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.187972+0000","last_undegraded":"2023-07-06T22:18:39.187972+0000","last_fullsized":"2023-07-06T22:18:39.187972+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184886+0000","last_change":"2023-07-06T22:18:39.184886+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184886+0000","last_undegraded":"2023-07-06T22:18:39.184886+0000","last_fullsized":"2023-07-06T22:18:39.184886+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.188217+0000","last_change":"2023-07-06T22:18:39.188217+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.188217+0000","last_undegraded":"2023-07-06T22:18:39.188217+0000","last_fullsized":"2023-07-06T22:18:39.188217+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.189352+0000","last_change":"2023-07-06T22:18:39.189352+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.189352+0000","last_undegraded":"2023-07-06T22:18:39.189352+0000","last_fullsized":"2023-07-06T22:18:39.189352+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184631+0000","last_change":"2023-07-06T22:18:39.184631+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184631+0000","last_undegraded":"2023-07-06T22:18:39.184631+0000","last_fullsized":"2023-07-06T22:18:39.184631+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.184823+0000","last_change":"2023-07-06T22:18:39.184823+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.184823+0000","last_undegraded":"2023-07-06T22:18:39.184823+0000","last_fullsized":"2023-07-06T22:18:39.184823+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.189622+0000","last_change":"2023-07-06T22:18:39.189622+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.189622+0000","last_undegraded":"2023-07-06T22:18:39.189622+0000","last_fullsized":"2023-07-06T22:18:39.189622+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.189082+0000","last_change":"2023-07-06T22:18:39.189082+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.189082+0000","last_undegraded":"2023-07-06T22:18:39.189082+0000","last_fullsized":"2023-07-06T22:18:39.189082+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"167'304","reported_seq":1146,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.191871+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:18:39.191871+0000","last_peered":"2023-07-06T22:18:39.191871+0000","last_clean":"2023-07-06T22:18:39.191871+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:18:39.191871+0000","last_undegraded":"2023-07-06T22:18:39.191871+0000","last_fullsized":"2023-07-06T22:18:39.191871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:28:35.844046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":288,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.189747+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:18:39.189747+0000","last_peered":"2023-07-06T22:18:39.189747+0000","last_clean":"2023-07-06T22:18:39.189747+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:18:39.189747+0000","last_undegraded":"2023-07-06T22:18:39.189747+0000","last_fullsized":"2023-07-06T22:18:39.189747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:37:08.335890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.189565+0000","last_change":"2023-07-06T22:18:39.189565+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.189565+0000","last_undegraded":"2023-07-06T22:18:39.189565+0000","last_fullsized":"2023-07-06T22:18:39.189565+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":327,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.191736+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:18:39.191736+0000","last_peered":"2023-07-06T22:18:39.191736+0000","last_clean":"2023-07-06T22:18:39.191736+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:18:39.191736+0000","last_undegraded":"2023-07-06T22:18:39.191736+0000","last_fullsized":"2023-07-06T22:18:39.191736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:27:20.831874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.186221+0000","last_change":"2023-07-06T22:18:39.186221+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.186221+0000","last_undegraded":"2023-07-06T22:18:39.186221+0000","last_fullsized":"2023-07-06T22:18:39.186221+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":328,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.184208+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:18:39.184208+0000","last_peered":"2023-07-06T22:18:39.184208+0000","last_clean":"2023-07-06T22:18:39.184208+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:18:39.184208+0000","last_undegraded":"2023-07-06T22:18:39.184208+0000","last_fullsized":"2023-07-06T22:18:39.184208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:15:01.325637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.186214+0000","last_change":"2023-07-06T22:18:39.186214+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.186214+0000","last_undegraded":"2023-07-06T22:18:39.186214+0000","last_fullsized":"2023-07-06T22:18:39.186214+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":288,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.189416+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:18:39.189416+0000","last_peered":"2023-07-06T22:18:39.189416+0000","last_clean":"2023-07-06T22:18:39.189416+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:18:39.189416+0000","last_undegraded":"2023-07-06T22:18:39.189416+0000","last_fullsized":"2023-07-06T22:18:39.189416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:18:49.494731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.190102+0000","last_change":"2023-07-06T22:18:39.190102+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.190102+0000","last_undegraded":"2023-07-06T22:18:39.190102+0000","last_fullsized":"2023-07-06T22:18:39.190102+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":292,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.187105+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:18:39.187105+0000","last_peered":"2023-07-06T22:18:39.187105+0000","last_clean":"2023-07-06T22:18:39.187105+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:18:39.187105+0000","last_undegraded":"2023-07-06T22:18:39.187105+0000","last_fullsized":"2023-07-06T22:18:39.187105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:47:07.975449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.185954+0000","last_change":"2023-07-06T22:18:39.185954+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.185954+0000","last_undegraded":"2023-07-06T22:18:39.185954+0000","last_fullsized":"2023-07-06T22:18:39.185954+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":326,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.191693+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:18:39.191693+0000","last_peered":"2023-07-06T22:18:39.191693+0000","last_clean":"2023-07-06T22:18:39.191693+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:18:39.191693+0000","last_undegraded":"2023-07-06T22:18:39.191693+0000","last_fullsized":"2023-07-06T22:18:39.191693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:08:22.589157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.188292+0000","last_change":"2023-07-06T22:18:39.188292+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.188292+0000","last_undegraded":"2023-07-06T22:18:39.188292+0000","last_fullsized":"2023-07-06T22:18:39.188292+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":292,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.187433+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:18:39.187433+0000","last_peered":"2023-07-06T22:18:39.187433+0000","last_clean":"2023-07-06T22:18:39.187433+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:18:39.187433+0000","last_undegraded":"2023-07-06T22:18:39.187433+0000","last_fullsized":"2023-07-06T22:18:39.187433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:12:22.072679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:18:40.180839+0000","last_change":"2023-07-06T22:18:40.180839+0000","last_active":"2023-07-06T22:18:40.180839+0000","last_peered":"2023-07-06T22:18:40.180839+0000","last_clean":"2023-07-06T22:18:40.180839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:40.180839+0000","last_undegraded":"2023-07-06T22:18:40.180839+0000","last_fullsized":"2023-07-06T22:18:40.180839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":176,"state":"creating+peering","last_fresh":"2023-07-06T22:18:39.185923+0000","last_change":"2023-07-06T22:18:39.185923+0000","last_active":"2023-07-06T22:18:39.169484+0000","last_peered":"2023-07-06T22:18:39.169484+0000","last_clean":"2023-07-06T22:18:39.169484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:18:39.185923+0000","last_undegraded":"2023-07-06T22:18:39.185923+0000","last_fullsized":"2023-07-06T22:18:39.185923+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":283,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-06T22:18:39.187128+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:18:39.187128+0000","last_peered":"2023-07-06T22:18:39.187128+0000","last_clean":"2023-07-06T22:18:39.187128+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:18:39.187128+0000","last_undegraded":"2023-07-06T22:18:39.187128+0000","last_fullsized":"2023-07-06T22:18:39.187128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:54:47.486928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575284,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41956,"kb_used_data":2716,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329884,"statfs":{"total":96636764160,"available":96593801216,"internally_reserved":0,"allocated":2781184,"data_stored":1762873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70599999999999996,"15min":0.72699999999999998},"min":{"1min":0.54100000000000004,"5min":0.432,"15min":0.432},"max":{"1min":0.88700000000000001,"5min":0.93300000000000005,"15min":1.0740000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70999999999999996,"15min":0.71499999999999997},"min":{"1min":0.53800000000000003,"5min":0.45700000000000002,"15min":0.42299999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.998},"last":0.65300000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92700000000000005,"5min":0.98299999999999998,"15min":1.1220000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.58399999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94599999999999995,"5min":1.006,"15min":1.012},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73499999999999999,"15min":0.74399999999999999},"min":{"1min":0.51400000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.016},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.86799999999999999,"5min":0.99299999999999999,"15min":1.149},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.55500000000000005},"min":{"1min":0.39700000000000002,"5min":0.372,"15min":0.36199999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.91300000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.443,"5min":0.40799999999999997,"15min":0.39300000000000002},"max":{"1min":0.872,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.59399999999999997},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":1.038},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.495,"5min":0.442,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":0.92400000000000004,"15min":0.995},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.443},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":1.024},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67600000000000005,"15min":0.67700000000000005},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.018},"last":0.52200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575284,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37276,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334564,"statfs":{"total":96636764160,"available":96598593536,"internally_reserved":0,"allocated":2183168,"data_stored":1171486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.376},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.7829999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.49399999999999999,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":0.877,"5min":0.95199999999999996,"15min":1.633},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.55300000000000005,"5min":0.46700000000000003,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":1.044,"15min":1.9099999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74299999999999999,"15min":0.74099999999999999},"min":{"1min":0.61199999999999999,"5min":0.46600000000000003,"15min":0.438},"max":{"1min":0.85899999999999999,"5min":0.93700000000000006,"15min":0.97799999999999998},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.45800000000000002},"max":{"1min":0.86699999999999999,"5min":0.93899999999999995,"15min":2.0299999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.56000000000000005,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.58999999999999997,"5min":0.53300000000000003,"15min":0.501},"max":{"1min":0.86399999999999999,"5min":0.97899999999999998,"15min":1.5920000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":0.877,"5min":0.95599999999999996,"15min":1.996},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":1.024,"15min":1.024},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41599999999999998,"15min":0.40999999999999998},"max":{"1min":0.74399999999999999,"5min":0.94999999999999996,"15min":0.996},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.39200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73199999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.75},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.48599999999999999,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.83999999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.621,"15min":0.623},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.436},"max":{"1min":0.82399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.45600000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.78900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575283,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55340,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316500,"statfs":{"total":96636764160,"available":96580096000,"internally_reserved":0,"allocated":2199552,"data_stored":1179023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.52900000000000003,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.92800000000000005,"5min":0.97199999999999998,"15min":0.999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.57899999999999996,"5min":0.51200000000000001,"15min":0.46400000000000002},"max":{"1min":0.92500000000000004,"5min":0.995,"15min":0.995},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.73799999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.43099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.51000000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.3200000000000001},"last":0.629}]},{"osd":2,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.443},"max":{"1min":0.998,"5min":0.998,"15min":1.4299999999999999},"last":0.749},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.67500000000000004,"5min":0.58499999999999996,"15min":0.48199999999999998},"max":{"1min":0.88500000000000001,"5min":0.999,"15min":1.0409999999999999},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.65200000000000002,"5min":0.56699999999999995,"15min":0.46800000000000003},"max":{"1min":0.94399999999999995,"5min":0.996,"15min":1.5169999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.76700000000000002},"min":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.436},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.47799999999999998,"5min":0.39500000000000002,"15min":0.34899999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59799999999999998,"15min":0.61199999999999999},"min":{"1min":0.47599999999999998,"5min":0.432,"15min":0.32600000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.96099999999999997},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.52900000000000003,"5min":0.44700000000000001,"15min":0.39600000000000002},"max":{"1min":0.88,"5min":0.96399999999999997,"15min":0.998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.42199999999999999},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.96999999999999997},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.38900000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67800000000000005,"15min":0.68500000000000005},"min":{"1min":0.52900000000000003,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":0.83299999999999996,"5min":0.97899999999999998,"15min":0.999},"last":0.66400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575282,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55340,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316500,"statfs":{"total":96636764160,"available":96580096000,"internally_reserved":0,"allocated":2199552,"data_stored":1179023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.54500000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84299999999999997,"5min":0.96699999999999997,"15min":0.98999999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.75600000000000001,"15min":0.746},"min":{"1min":0.55700000000000005,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.97299999999999998,"5min":0.97899999999999998,"15min":1.016},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.754,"15min":0.749},"min":{"1min":0.61299999999999999,"5min":0.45200000000000001,"15min":0.38300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.495},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74399999999999999,"15min":0.73499999999999999},"min":{"1min":0.58999999999999997,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.99299999999999999,"15min":0.996},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.63800000000000001,"5min":0.53100000000000003,"15min":0.47799999999999998},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":1.0760000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.60299999999999998,"5min":0.51200000000000001,"15min":0.502},"max":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.0580000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.748,"15min":0.73899999999999999},"min":{"1min":0.60099999999999998,"5min":0.51900000000000002,"15min":0.45600000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.98699999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76300000000000001},"min":{"1min":0.61599999999999999,"5min":0.52700000000000002,"15min":0.51900000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":1.03},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83899999999999997,"5min":0.91200000000000003,"15min":0.92600000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.46000000000000002,"5min":0.39900000000000002,"15min":0.39800000000000002},"max":{"1min":0.77100000000000002,"5min":0.95599999999999996,"15min":1.006},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.95899999999999996,"15min":1.0509999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88400000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.624}]},{"osd":7,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.53000000000000003,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":0.84999999999999998,"5min":0.94799999999999995,"15min":1.0469999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.55000000000000004,"5min":0.432,"15min":0.432},"max":{"1min":0.86699999999999999,"5min":1.0109999999999999,"15min":1.1100000000000001},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575283,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51244,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320596,"statfs":{"total":96636764160,"available":96584290304,"internally_reserved":0,"allocated":2199552,"data_stored":1179023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68100000000000005,"5min":0.69399999999999995,"15min":0.85899999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50900000000000001,"15min":0.49099999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69799999999999995,"5min":0.72799999999999998,"15min":0.83899999999999997},"last":0.437},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61399999999999999,"15min":0.60499999999999998},"min":{"1min":0.442,"5min":0.44,"15min":0.41299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38700000000000001},"max":{"1min":0.63800000000000001,"5min":0.72399999999999998,"15min":0.875},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.34699999999999998},"max":{"1min":0.71399999999999997,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80300000000000005,"15min":0.77700000000000002},"min":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.441},"max":{"1min":1.0449999999999999,"5min":1.081,"15min":1.474},"last":0.751},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.79200000000000004},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.54600000000000004},"max":{"1min":0.99099999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.624}]},{"osd":5,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83099999999999996,"15min":0.81100000000000005},"min":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.57499999999999996},"max":{"1min":1.175,"5min":1.175,"15min":1.3740000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82299999999999995,"15min":0.80300000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.022,"5min":1.228,"15min":1.2330000000000001},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.80200000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.51800000000000002},"max":{"1min":1.1399999999999999,"5min":1.194,"15min":1.3899999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.82999999999999996},"min":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.57299999999999995},"max":{"1min":1.0960000000000001,"5min":1.266,"15min":1.3220000000000001},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.002,"5min":1.121,"15min":1.2210000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84499999999999997,"15min":0.82699999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.244,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.68000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575283,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41376,"kb_used_data":2136,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330464,"statfs":{"total":96636764160,"available":96594395136,"internally_reserved":0,"allocated":2187264,"data_stored":1172505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.32300000000000001,"15min":0.27800000000000002},"max":{"1min":0.65100000000000002,"5min":0.76100000000000001,"15min":0.88700000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.46100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.70899999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.501}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.41899999999999998,"5min":0.35799999999999998,"15min":0.32300000000000001},"max":{"1min":0.74099999999999999,"5min":0.79400000000000004,"15min":0.84099999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.46000000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.68700000000000006,"5min":0.77100000000000002,"15min":0.97099999999999997},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.434,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":0.77200000000000002,"15min":0.997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.499,"5min":0.434,"15min":0.378},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.80400000000000005},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.64900000000000002,"5min":0.56599999999999995,"15min":0.50900000000000001},"max":{"1min":0.98399999999999999,"5min":1.45,"15min":1.45},"last":1.663},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.47399999999999998},"max":{"1min":0.90600000000000003,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.67400000000000004,"5min":0.60899999999999999,"15min":0.51100000000000001},"max":{"1min":1.0029999999999999,"5min":1.337,"15min":1.337},"last":0.872},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.53000000000000003},"max":{"1min":0.91300000000000003,"5min":1.2490000000000001,"15min":1.2829999999999999},"last":1.0409999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83699999999999997,"15min":0.82099999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.54800000000000004},"max":{"1min":1.0900000000000001,"5min":1.367,"15min":1.367},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.83599999999999997,"15min":0.83699999999999997},"min":{"1min":0.63100000000000001,"5min":0.56399999999999995,"15min":0.56100000000000005},"max":{"1min":0.97399999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.85299999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.56999999999999995},"max":{"1min":1.024,"5min":1.407,"15min":1.407},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.85199999999999998,"15min":0.84999999999999998},"min":{"1min":0.64900000000000002,"5min":0.59899999999999998,"15min":0.55600000000000005},"max":{"1min":1.0329999999999999,"5min":1.296,"15min":1.296},"last":0.98399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575284,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59424,"kb_used_data":2136,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312416,"statfs":{"total":96636764160,"available":96575913984,"internally_reserved":0,"allocated":2187264,"data_stored":1172505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.46600000000000003},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.32900000000000001},"max":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.81699999999999995},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.36899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.94299999999999995},"last":0.31},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.5}]},{"osd":3,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":0.84899999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.441}]},{"osd":4,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.018,"5min":1.083,"15min":1.1140000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.54200000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0700000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.58399999999999996,"5min":0.57299999999999995,"15min":0.48699999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.21},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81699999999999995,"15min":0.82699999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1100000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82299999999999995,"15min":0.83199999999999996},"min":{"1min":0.61899999999999999,"5min":0.53800000000000003,"15min":0.53600000000000003},"max":{"1min":1.0800000000000001,"5min":1.244,"15min":1.302},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82799999999999996,"15min":0.83299999999999996},"min":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.25,"5min":1.25,"15min":1.3360000000000001},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82599999999999996,"15min":0.83199999999999996},"min":{"1min":0.67100000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0489999999999999,"5min":1.1779999999999999,"15min":1.405},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84999999999999998,"15min":0.84099999999999997},"min":{"1min":0.68200000000000005,"5min":0.57099999999999995,"15min":0.54700000000000004},"max":{"1min":0.97699999999999998,"5min":1.2110000000000001,"15min":1.3779999999999999},"last":0.68799999999999994}]}]},{"osd":0,"up_from":13,"seq":55834575283,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37868,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333972,"statfs":{"total":96636764160,"available":96597987328,"internally_reserved":0,"allocated":2789376,"data_stored":1768372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.316},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.34000000000000002,"5min":0.33600000000000002,"15min":0.312},"max":{"1min":0.749,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52100000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.505},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76100000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.33400000000000002},"max":{"1min":0.65200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.45200000000000001,"5min":0.41099999999999998,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80900000000000005,"15min":0.80600000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.1439999999999999,"5min":1.294,"15min":1.294},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80800000000000005,"15min":0.80300000000000005},"min":{"1min":0.61899999999999999,"5min":0.53500000000000003,"15min":0.50900000000000001},"max":{"1min":1.022,"5min":1.107,"15min":1.3320000000000001},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.56000000000000005,"15min":0.48899999999999999},"max":{"1min":1.0569999999999999,"5min":1.345,"15min":1.345},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.63700000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81999999999999995,"15min":0.81399999999999995},"min":{"1min":0.628,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98199999999999998,"5min":1.0049999999999999,"15min":1.153},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.628,"5min":0.59099999999999997,"15min":0.58499999999999996},"max":{"1min":1.036,"5min":1.1910000000000001,"15min":1.272},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.82299999999999995,"15min":0.82899999999999996},"min":{"1min":0.64300000000000002,"5min":0.624,"15min":0.57999999999999996},"max":{"1min":1.083,"5min":1.125,"15min":1.26},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.82099999999999995},"min":{"1min":0.67100000000000004,"5min":0.60499999999999998,"15min":0.55700000000000005},"max":{"1min":1.022,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.79000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:18:45.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3f is not active+clean 2023-07-06T22:18:45.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3e is not active+clean 2023-07-06T22:18:45.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3d is not active+clean 2023-07-06T22:18:45.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3c is not active+clean 2023-07-06T22:18:45.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3b is not active+clean 2023-07-06T22:18:45.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3a is not active+clean 2023-07-06T22:18:45.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.39 is not active+clean 2023-07-06T22:18:45.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.38 is not active+clean 2023-07-06T22:18:45.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.37 is not active+clean 2023-07-06T22:18:45.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.36 is not active+clean 2023-07-06T22:18:45.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.35 is not active+clean 2023-07-06T22:18:45.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.34 is not active+clean 2023-07-06T22:18:45.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.33 is not active+clean 2023-07-06T22:18:45.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.32 is not active+clean 2023-07-06T22:18:45.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.31 is not active+clean 2023-07-06T22:18:45.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.30 is not active+clean 2023-07-06T22:18:45.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2f is not active+clean 2023-07-06T22:18:45.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2e is not active+clean 2023-07-06T22:18:45.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2d is not active+clean 2023-07-06T22:18:45.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2c is not active+clean 2023-07-06T22:18:45.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2b is not active+clean 2023-07-06T22:18:45.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2a is not active+clean 2023-07-06T22:18:45.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.29 is not active+clean 2023-07-06T22:18:45.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.28 is not active+clean 2023-07-06T22:18:45.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.27 is not active+clean 2023-07-06T22:18:45.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.26 is not active+clean 2023-07-06T22:18:45.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.25 is not active+clean 2023-07-06T22:18:45.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.24 is not active+clean 2023-07-06T22:18:45.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.23 is not active+clean 2023-07-06T22:18:45.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.22 is not active+clean 2023-07-06T22:18:45.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.21 is not active+clean 2023-07-06T22:18:45.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.20 is not active+clean 2023-07-06T22:18:45.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1e is not active+clean 2023-07-06T22:18:45.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1f is not active+clean 2023-07-06T22:18:45.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.190996+0000', 'last_change': '2023-07-06T22:18:39.190996+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.190996+0000', 'last_undegraded': '2023-07-06T22:18:39.190996+0000', 'last_fullsized': '2023-07-06T22:18:39.190996+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:18:45.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1f is not active+clean 2023-07-06T22:18:45.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-07-06T22:18:45.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.190528+0000', 'last_change': '2023-07-06T22:18:39.190528+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.190528+0000', 'last_undegraded': '2023-07-06T22:18:39.190528+0000', 'last_fullsized': '2023-07-06T22:18:39.190528+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T22:18:45.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1c is not active+clean 2023-07-06T22:18:45.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1d is not active+clean 2023-07-06T22:18:45.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.184605+0000', 'last_change': '2023-07-06T22:18:39.184605+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.184605+0000', 'last_undegraded': '2023-07-06T22:18:39.184605+0000', 'last_fullsized': '2023-07-06T22:18:39.184605+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:18:45.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1d is not active+clean 2023-07-06T22:18:45.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1c is not active+clean 2023-07-06T22:18:45.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.184642+0000', 'last_change': '2023-07-06T22:18:39.184642+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.184642+0000', 'last_undegraded': '2023-07-06T22:18:39.184642+0000', 'last_fullsized': '2023-07-06T22:18:39.184642+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:18:45.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1a is not active+clean 2023-07-06T22:18:45.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2023-07-06T22:18:45.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.187782+0000', 'last_change': '2023-07-06T22:18:39.187782+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.187782+0000', 'last_undegraded': '2023-07-06T22:18:39.187782+0000', 'last_fullsized': '2023-07-06T22:18:39.187782+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:18:45.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1b is not active+clean 2023-07-06T22:18:45.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1a is not active+clean 2023-07-06T22:18:45.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.186107+0000', 'last_change': '2023-07-06T22:18:39.186107+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.186107+0000', 'last_undegraded': '2023-07-06T22:18:39.186107+0000', 'last_fullsized': '2023-07-06T22:18:39.186107+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:18:45.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.18 is not active+clean 2023-07-06T22:18:45.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-07-06T22:18:45.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.185982+0000', 'last_change': '2023-07-06T22:18:39.185982+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.185982+0000', 'last_undegraded': '2023-07-06T22:18:39.185982+0000', 'last_fullsized': '2023-07-06T22:18:39.185982+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T22:18:45.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.19 is not active+clean 2023-07-06T22:18:45.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.18 is not active+clean 2023-07-06T22:18:45.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.191010+0000', 'last_change': '2023-07-06T22:18:39.191010+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.191010+0000', 'last_undegraded': '2023-07-06T22:18:39.191010+0000', 'last_fullsized': '2023-07-06T22:18:39.191010+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T22:18:45.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.e is not active+clean 2023-07-06T22:18:45.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2023-07-06T22:18:45.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.187898+0000', 'last_change': '2023-07-06T22:18:39.187898+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.187898+0000', 'last_undegraded': '2023-07-06T22:18:39.187898+0000', 'last_fullsized': '2023-07-06T22:18:39.187898+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:18:45.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.f is not active+clean 2023-07-06T22:18:45.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2023-07-06T22:18:45.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.188880+0000', 'last_change': '2023-07-06T22:18:39.188880+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.188880+0000', 'last_undegraded': '2023-07-06T22:18:39.188880+0000', 'last_fullsized': '2023-07-06T22:18:39.188880+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:18:45.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.c is not active+clean 2023-07-06T22:18:45.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.d is not active+clean 2023-07-06T22:18:45.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.190242+0000', 'last_change': '2023-07-06T22:18:39.190242+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.190242+0000', 'last_undegraded': '2023-07-06T22:18:39.190242+0000', 'last_fullsized': '2023-07-06T22:18:39.190242+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:18:45.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.d is not active+clean 2023-07-06T22:18:45.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.c is not active+clean 2023-07-06T22:18:45.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.190833+0000', 'last_change': '2023-07-06T22:18:39.190833+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.190833+0000', 'last_undegraded': '2023-07-06T22:18:39.190833+0000', 'last_fullsized': '2023-07-06T22:18:39.190833+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:18:45.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.a is not active+clean 2023-07-06T22:18:45.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.b is not active+clean 2023-07-06T22:18:45.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.184602+0000', 'last_change': '2023-07-06T22:18:39.184602+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.184602+0000', 'last_undegraded': '2023-07-06T22:18:39.184602+0000', 'last_fullsized': '2023-07-06T22:18:39.184602+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:18:45.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.b is not active+clean 2023-07-06T22:18:45.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.a is not active+clean 2023-07-06T22:18:45.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.190336+0000', 'last_change': '2023-07-06T22:18:39.190336+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.190336+0000', 'last_undegraded': '2023-07-06T22:18:39.190336+0000', 'last_fullsized': '2023-07-06T22:18:39.190336+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:18:45.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.8 is not active+clean 2023-07-06T22:18:45.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.9 is not active+clean 2023-07-06T22:18:45.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.184614+0000', 'last_change': '2023-07-06T22:18:39.184614+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.184614+0000', 'last_undegraded': '2023-07-06T22:18:39.184614+0000', 'last_fullsized': '2023-07-06T22:18:39.184614+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:18:45.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.9 is not active+clean 2023-07-06T22:18:45.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.8 is not active+clean 2023-07-06T22:18:45.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.190208+0000', 'last_change': '2023-07-06T22:18:39.190208+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.190208+0000', 'last_undegraded': '2023-07-06T22:18:39.190208+0000', 'last_fullsized': '2023-07-06T22:18:39.190208+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:18:45.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.6 is not active+clean 2023-07-06T22:18:45.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.7 is not active+clean 2023-07-06T22:18:45.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.188646+0000', 'last_change': '2023-07-06T22:18:39.188646+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.188646+0000', 'last_undegraded': '2023-07-06T22:18:39.188646+0000', 'last_fullsized': '2023-07-06T22:18:39.188646+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:18:45.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.7 is not active+clean 2023-07-06T22:18:45.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2023-07-06T22:18:45.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.187972+0000', 'last_change': '2023-07-06T22:18:39.187972+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.187972+0000', 'last_undegraded': '2023-07-06T22:18:39.187972+0000', 'last_fullsized': '2023-07-06T22:18:39.187972+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:18:45.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.4 is not active+clean 2023-07-06T22:18:45.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-07-06T22:18:45.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.184886+0000', 'last_change': '2023-07-06T22:18:39.184886+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.184886+0000', 'last_undegraded': '2023-07-06T22:18:39.184886+0000', 'last_fullsized': '2023-07-06T22:18:39.184886+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T22:18:45.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.5 is not active+clean 2023-07-06T22:18:45.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.4 is not active+clean 2023-07-06T22:18:45.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.188217+0000', 'last_change': '2023-07-06T22:18:39.188217+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.188217+0000', 'last_undegraded': '2023-07-06T22:18:39.188217+0000', 'last_fullsized': '2023-07-06T22:18:39.188217+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:18:45.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2 is not active+clean 2023-07-06T22:18:45.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-07-06T22:18:45.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.189352+0000', 'last_change': '2023-07-06T22:18:39.189352+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.189352+0000', 'last_undegraded': '2023-07-06T22:18:39.189352+0000', 'last_fullsized': '2023-07-06T22:18:39.189352+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T22:18:45.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3 is not active+clean 2023-07-06T22:18:45.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2 is not active+clean 2023-07-06T22:18:45.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.184631+0000', 'last_change': '2023-07-06T22:18:39.184631+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.184631+0000', 'last_undegraded': '2023-07-06T22:18:39.184631+0000', 'last_fullsized': '2023-07-06T22:18:39.184631+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:18:45.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.0 is not active+clean 2023-07-06T22:18:45.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-07-06T22:18:45.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.184823+0000', 'last_change': '2023-07-06T22:18:39.184823+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.184823+0000', 'last_undegraded': '2023-07-06T22:18:39.184823+0000', 'last_fullsized': '2023-07-06T22:18:39.184823+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T22:18:45.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1 is not active+clean 2023-07-06T22:18:45.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-07-06T22:18:45.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.189622+0000', 'last_change': '2023-07-06T22:18:39.189622+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.189622+0000', 'last_undegraded': '2023-07-06T22:18:39.189622+0000', 'last_fullsized': '2023-07-06T22:18:39.189622+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T22:18:45.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.16 is not active+clean 2023-07-06T22:18:45.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-07-06T22:18:45.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.189082+0000', 'last_change': '2023-07-06T22:18:39.189082+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.189082+0000', 'last_undegraded': '2023-07-06T22:18:39.189082+0000', 'last_fullsized': '2023-07-06T22:18:39.189082+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T22:18:45.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.15 is not active+clean 2023-07-06T22:18:45.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-07-06T22:18:45.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.189565+0000', 'last_change': '2023-07-06T22:18:39.189565+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.189565+0000', 'last_undegraded': '2023-07-06T22:18:39.189565+0000', 'last_fullsized': '2023-07-06T22:18:39.189565+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T22:18:45.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.14 is not active+clean 2023-07-06T22:18:45.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.15 is not active+clean 2023-07-06T22:18:45.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.186221+0000', 'last_change': '2023-07-06T22:18:39.186221+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.186221+0000', 'last_undegraded': '2023-07-06T22:18:39.186221+0000', 'last_fullsized': '2023-07-06T22:18:39.186221+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:18:45.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.17 is not active+clean 2023-07-06T22:18:45.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.16 is not active+clean 2023-07-06T22:18:45.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.186214+0000', 'last_change': '2023-07-06T22:18:39.186214+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.186214+0000', 'last_undegraded': '2023-07-06T22:18:39.186214+0000', 'last_fullsized': '2023-07-06T22:18:39.186214+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:18:45.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.11 is not active+clean 2023-07-06T22:18:45.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-07-06T22:18:45.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.190102+0000', 'last_change': '2023-07-06T22:18:39.190102+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.190102+0000', 'last_undegraded': '2023-07-06T22:18:39.190102+0000', 'last_fullsized': '2023-07-06T22:18:39.190102+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T22:18:45.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.10 is not active+clean 2023-07-06T22:18:45.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.11 is not active+clean 2023-07-06T22:18:45.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.185954+0000', 'last_change': '2023-07-06T22:18:39.185954+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.185954+0000', 'last_undegraded': '2023-07-06T22:18:39.185954+0000', 'last_fullsized': '2023-07-06T22:18:39.185954+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:18:45.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.13 is not active+clean 2023-07-06T22:18:45.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.12 is not active+clean 2023-07-06T22:18:45.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.188292+0000', 'last_change': '2023-07-06T22:18:39.188292+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.188292+0000', 'last_undegraded': '2023-07-06T22:18:39.188292+0000', 'last_fullsized': '2023-07-06T22:18:39.188292+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:18:45.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.12 is not active+clean 2023-07-06T22:18:45.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:18:40.180839+0000', 'last_change': '2023-07-06T22:18:40.180839+0000', 'last_active': '2023-07-06T22:18:40.180839+0000', 'last_peered': '2023-07-06T22:18:40.180839+0000', 'last_clean': '2023-07-06T22:18:40.180839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:40.180839+0000', 'last_undegraded': '2023-07-06T22:18:40.180839+0000', 'last_fullsized': '2023-07-06T22:18:40.180839+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:40.180839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:18:45.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.13 is not active+clean 2023-07-06T22:18:45.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 176, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:18:39.185923+0000', 'last_change': '2023-07-06T22:18:39.185923+0000', 'last_active': '2023-07-06T22:18:39.169484+0000', 'last_peered': '2023-07-06T22:18:39.169484+0000', 'last_clean': '2023-07-06T22:18:39.169484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:18:39.185923+0000', 'last_undegraded': '2023-07-06T22:18:39.185923+0000', 'last_fullsized': '2023-07-06T22:18:39.185923+0000', 'mapping_epoch': 176, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 176, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'last_clean_scrub_stamp': '2023-07-06T22:18:39.169484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:18:45.557 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-06T22:18:45.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.697+0000 7fb9bd596640 1 Processor -- start 2023-07-06T22:18:45.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.697+0000 7fb9bd596640 1 -- start start 2023-07-06T22:18:45.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9bd596640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb9b8158440 0x7fb9b80b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:45.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9bd596640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9b8158810 0x7fb9b80c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:45.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9bd596640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b80b1c30 con 0x7fb9b80c8710 2023-07-06T22:18:45.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9bd596640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b806fcb0 con 0x7fb9b8158810 2023-07-06T22:18:45.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9bd596640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b80b1eb0 con 0x7fb9b8158440 2023-07-06T22:18:45.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9affff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9b8158810 0x7fb9b80c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:45.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9affff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9b8158810 0x7fb9b80c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37188/0 (socket says 172.21.15.55:37188) 2023-07-06T22:18:45.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9b77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb9b80c8710 0x7fb9b80b2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42746/0 (socket says 172.21.15.55:42746) 2023-07-06T22:18:45.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9affff640 1 -- 172.21.15.55:0/1079906085 learned_addr learned my addr 172.21.15.55:0/1079906085 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:45.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9b6ffd640 1 --2- 172.21.15.55:0/1079906085 >> v2:172.21.15.138:3300/0 conn(0x7fb9b8158440 0x7fb9b80b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:45.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9affff640 1 -- 172.21.15.55:0/1079906085 >> v2:172.21.15.138:3300/0 conn(0x7fb9b8158440 msgr2=0x7fb9b80b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:45.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9affff640 1 --2- 172.21.15.55:0/1079906085 >> v2:172.21.15.138:3300/0 conn(0x7fb9b8158440 0x7fb9b80b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9affff640 1 -- 172.21.15.55:0/1079906085 >> v1:172.21.15.55:6789/0 conn(0x7fb9b80c8710 legacy=0x7fb9b80b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:45.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9affff640 1 -- 172.21.15.55:0/1079906085 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b80b2190 con 0x7fb9b8158810 2023-07-06T22:18:45.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.701+0000 7fb9b67fc640 1 -- 172.21.15.55:0/1079906085 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297061290 0 0) 0x7fb9b80b1c30 con 0x7fb9b80c8710 2023-07-06T22:18:45.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.705+0000 7fb9affff640 1 --2- 172.21.15.55:0/1079906085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9b8158810 0x7fb9b80c81d0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7fb9b806ec00 tx=0x7fb9a001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c117d0f880d4e7e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:45.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.705+0000 7fb9b67fc640 1 -- 172.21.15.55:0/1079906085 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00a6040 con 0x7fb9b8158810 2023-07-06T22:18:45.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.705+0000 7fb9b67fc640 1 -- 172.21.15.55:0/1079906085 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a00aa600 con 0x7fb9b8158810 2023-07-06T22:18:45.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.705+0000 7fb9b67fc640 1 -- 172.21.15.55:0/1079906085 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00aa990 con 0x7fb9b8158810 2023-07-06T22:18:45.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.705+0000 7fb9bd596640 1 -- 172.21.15.55:0/1079906085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9b8158810 msgr2=0x7fb9b80c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:45.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.705+0000 7fb9bd596640 1 --2- 172.21.15.55:0/1079906085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9b8158810 0x7fb9b80c81d0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7fb9b806ec00 tx=0x7fb9a001c500 comp rx=0 tx=0).stop 2023-07-06T22:18:45.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.705+0000 7fb9bd596640 1 -- 172.21.15.55:0/1079906085 shutdown_connections 2023-07-06T22:18:45.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.705+0000 7fb9bd596640 1 --2- 172.21.15.55:0/1079906085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9b8158810 0x7fb9b80c81d0 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.705+0000 7fb9bd596640 1 --2- 172.21.15.55:0/1079906085 >> v2:172.21.15.138:3300/0 conn(0x7fb9b8158440 0x7fb9b80b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.705+0000 7fb9bd596640 1 -- 172.21.15.55:0/1079906085 >> 172.21.15.55:0/1079906085 conn(0x7fb9b80ca690 msgr2=0x7fb9b80caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:45.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.705+0000 7fb9bd596640 1 -- 172.21.15.55:0/1079906085 shutdown_connections 2023-07-06T22:18:45.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.705+0000 7fb9bd596640 1 -- 172.21.15.55:0/1079906085 wait complete. 2023-07-06T22:18:45.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.705+0000 7fb9bd596640 1 Processor -- start 2023-07-06T22:18:45.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.705+0000 7fb9bd596640 1 -- start start 2023-07-06T22:18:45.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9bd596640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9b80c8710 0x7fb9b80c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:45.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9bd596640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9b8158440 0x7fb9b8153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:45.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9bd596640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9b8158810 0x7fb9b815ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:45.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9bd596640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b806bdb0 con 0x7fb9b80c8710 2023-07-06T22:18:45.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9bd596640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b81537a0 con 0x7fb9b8158440 2023-07-06T22:18:45.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9bd596640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b806adf0 con 0x7fb9b8158810 2023-07-06T22:18:45.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9b6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9b80c8710 0x7fb9b80c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:45.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9b6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9b80c8710 0x7fb9b80c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37194/0 (socket says 172.21.15.55:37194) 2023-07-06T22:18:45.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9b6ffd640 1 -- 172.21.15.55:0/3834528112 learned_addr learned my addr 172.21.15.55:0/3834528112 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:45.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9b77fe640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9b8158810 0x7fb9b815ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:45.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9affff640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9b8158440 0x7fb9b8153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:45.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9b6ffd640 1 -- 172.21.15.55:0/3834528112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9b8158810 msgr2=0x7fb9b815ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:45.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9b6ffd640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9b8158810 0x7fb9b815ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9b6ffd640 1 -- 172.21.15.55:0/3834528112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9b8158440 msgr2=0x7fb9b8153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:45.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9b6ffd640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9b8158440 0x7fb9b8153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9b6ffd640 1 -- 172.21.15.55:0/3834528112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a00094d0 con 0x7fb9b80c8710 2023-07-06T22:18:45.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9affff640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9b8158440 0x7fb9b8153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:18:45.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9b77fe640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9b8158810 0x7fb9b815ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:18:45.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9b6ffd640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9b80c8710 0x7fb9b80c7bb0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800e960 tx=0x7fb9a800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:45.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9af7fe640 1 -- 172.21.15.55:0/3834528112 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8009690 con 0x7fb9b80c8710 2023-07-06T22:18:45.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9af7fe640 1 -- 172.21.15.55:0/3834528112 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a800ca00 con 0x7fb9b80c8710 2023-07-06T22:18:45.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9af7fe640 1 -- 172.21.15.55:0/3834528112 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a800cd70 con 0x7fb9b80c8710 2023-07-06T22:18:45.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9bd596640 1 -- 172.21.15.55:0/3834528112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b806b780 con 0x7fb9b80c8710 2023-07-06T22:18:45.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9bd596640 1 -- 172.21.15.55:0/3834528112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b806b320 con 0x7fb9b80c8710 2023-07-06T22:18:45.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9bd596640 1 -- 172.21.15.55:0/3834528112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b806c020 con 0x7fb9b80c8710 2023-07-06T22:18:45.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.709+0000 7fb9af7fe640 1 -- 172.21.15.55:0/3834528112 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb9a8013470 con 0x7fb9b80c8710 2023-07-06T22:18:45.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.713+0000 7fb9af7fe640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fb9980663d0 0x7fb998068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:45.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.713+0000 7fb9af7fe640 1 -- 172.21.15.55:0/3834528112 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb9a80842a0 con 0x7fb9b80c8710 2023-07-06T22:18:45.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.713+0000 7fb9affff640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fb9980663d0 0x7fb998068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:45.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.713+0000 7fb9affff640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fb9980663d0 0x7fb998068880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00ae000 tx=0x7fb9a00a7000 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:45.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.717+0000 7fb9af7fe640 1 -- 172.21.15.55:0/3834528112 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9a8051410 con 0x7fb9b80c8710 2023-07-06T22:18:45.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.921+0000 7fb9bd596640 1 -- 172.21.15.55:0/3834528112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb9b804d790 con 0x7fb9b80c8710 2023-07-06T22:18:45.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.925+0000 7fb9af7fe640 1 -- 172.21.15.55:0/3834528112 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3310 (secure 0 0 0) 0x7fb9a8054a30 con 0x7fb9b80c8710 2023-07-06T22:18:45.924 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:45.924 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":2221,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":179,"num_osds":8,"num_up_osds":8,"osd_up_since":1688679717,"num_in_osds":8,"osd_in_since":1688679707,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":388939776,"bytes_avail":772705173504,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":79,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":10431}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2023-07-06T22:18:27.573090+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-06T22:18:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.925+0000 7fb9bd596640 1 -- 172.21.15.55:0/3834528112 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fb9980663d0 msgr2=0x7fb998068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.925+0000 7fb9bd596640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fb9980663d0 0x7fb998068880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00ae000 tx=0x7fb9a00a7000 comp rx=0 tx=0).stop 2023-07-06T22:18:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.925+0000 7fb9bd596640 1 -- 172.21.15.55:0/3834528112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9b80c8710 msgr2=0x7fb9b80c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.925+0000 7fb9bd596640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9b80c8710 0x7fb9b80c7bb0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800e960 tx=0x7fb9a800ee20 comp rx=0 tx=0).stop 2023-07-06T22:18:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.925+0000 7fb9bd596640 1 -- 172.21.15.55:0/3834528112 shutdown_connections 2023-07-06T22:18:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.925+0000 7fb9bd596640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fb9980663d0 0x7fb998068880 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.925+0000 7fb9bd596640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb9b8158810 0x7fb9b815ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.925+0000 7fb9bd596640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb9b8158440 0x7fb9b8153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.925+0000 7fb9bd596640 1 --2- 172.21.15.55:0/3834528112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9b80c8710 0x7fb9b80c7bb0 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.925+0000 7fb9bd596640 1 -- 172.21.15.55:0/3834528112 >> 172.21.15.55:0/3834528112 conn(0x7fb9b80ca690 msgr2=0x7fb9b80cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.925+0000 7fb9bd596640 1 -- 172.21.15.55:0/3834528112 shutdown_connections 2023-07-06T22:18:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:45.925+0000 7fb9bd596640 1 -- 172.21.15.55:0/3834528112 wait complete. 2023-07-06T22:18:45.945 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-06T22:18:45.945 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:18:46.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fc574640 1 Processor -- start 2023-07-06T22:18:46.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fc574640 1 -- start start 2023-07-06T22:18:46.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fc574640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc8f40cb000 0x7fc8f40cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:46.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fc574640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f415c960 con 0x7fc8f40ca0f0 2023-07-06T22:18:46.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fc574640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f415cdf0 con 0x7fc8f415f4f0 2023-07-06T22:18:46.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fc574640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f40cc4f0 con 0x7fc8f40cb000 2023-07-06T22:18:46.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f9b0f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc8f40ca0f0 0x7fc8f40ca520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42752/0 (socket says 172.21.15.55:42752) 2023-07-06T22:18:46.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f9b0f640 1 -- 172.21.15.55:0/444650813 learned_addr learned my addr 172.21.15.55:0/444650813 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:46.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fa310640 1 --2- 172.21.15.55:0/444650813 >> v2:172.21.15.138:3300/0 conn(0x7fc8f40cb000 0x7fc8f40cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:46.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 -- 172.21.15.55:0/444650813 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360595169 0 0) 0x7fc8f415c960 con 0x7fc8f40ca0f0 2023-07-06T22:18:46.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 -- 172.21.15.55:0/444650813 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8e0003530 con 0x7fc8f40ca0f0 2023-07-06T22:18:46.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 -- 172.21.15.55:0/444650813 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1704139834 0 0) 0x7fc8e0003530 con 0x7fc8f40ca0f0 2023-07-06T22:18:46.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 -- 172.21.15.55:0/444650813 >> v2:172.21.15.138:3300/0 conn(0x7fc8f40cb000 msgr2=0x7fc8f40cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:46.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 --2- 172.21.15.55:0/444650813 >> v2:172.21.15.138:3300/0 conn(0x7fc8f40cb000 0x7fc8f40cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:46.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 -- 172.21.15.55:0/444650813 >> v1:172.21.15.138:6789/0 conn(0x7fc8f415f4f0 legacy=0x7fc8f415f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:46.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 -- 172.21.15.55:0/444650813 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f40cb910 con 0x7fc8f40ca0f0 2023-07-06T22:18:46.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 -- 172.21.15.55:0/444650813 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fc8e4001680 con 0x7fc8f40ca0f0 2023-07-06T22:18:46.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 -- 172.21.15.55:0/444650813 >> v1:172.21.15.55:6789/0 conn(0x7fc8f40ca0f0 legacy=0x7fc8f40ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:46.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 --2- 172.21.15.55:0/444650813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e0003980 0x7fc8e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:46.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 --2- 172.21.15.55:0/444650813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8e00047d0 0x7fc8e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:46.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 --2- 172.21.15.55:0/444650813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8e0005180 0x7fc8e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:46.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 -- 172.21.15.55:0/444650813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e000bfd0 con 0x7fc8e0003980 2023-07-06T22:18:46.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 -- 172.21.15.55:0/444650813 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e000c140 con 0x7fc8e0005180 2023-07-06T22:18:46.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f930e640 1 -- 172.21.15.55:0/444650813 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e000c300 con 0x7fc8e00047d0 2023-07-06T22:18:46.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fa310640 1 --2- 172.21.15.55:0/444650813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e0003980 0x7fc8e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:46.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8f9b0f640 1 --2- 172.21.15.55:0/444650813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8e00047d0 0x7fc8e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:46.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fab11640 1 --2- 172.21.15.55:0/444650813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8e0005180 0x7fc8e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:46.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fa310640 1 -- 172.21.15.55:0/444650813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8e00047d0 msgr2=0x7fc8e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:46.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fa310640 1 --2- 172.21.15.55:0/444650813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8e00047d0 0x7fc8e0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:46.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fa310640 1 -- 172.21.15.55:0/444650813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8e0005180 msgr2=0x7fc8e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:46.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fa310640 1 --2- 172.21.15.55:0/444650813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8e0005180 0x7fc8e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:46.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fa310640 1 -- 172.21.15.55:0/444650813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e0003530 con 0x7fc8e0003980 2023-07-06T22:18:46.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fab11640 1 --2- 172.21.15.55:0/444650813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8e0005180 0x7fc8e000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:46.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.089+0000 7fc8fab11640 1 -- 172.21.15.55:0/444650813 reap_dead start 2023-07-06T22:18:46.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.093+0000 7fc8fa310640 1 --2- 172.21.15.55:0/444650813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e0003980 0x7fc8e0003d90 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009ae0 tx=0x7fc8f001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebc07f05a6b20ab server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:46.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.093+0000 7fc8f930e640 1 -- 172.21.15.55:0/444650813 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f00a6430 con 0x7fc8e0003980 2023-07-06T22:18:46.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.093+0000 7fc8f930e640 1 -- 172.21.15.55:0/444650813 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f00a6590 con 0x7fc8e0003980 2023-07-06T22:18:46.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.093+0000 7fc8f930e640 1 -- 172.21.15.55:0/444650813 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f00a6940 con 0x7fc8e0003980 2023-07-06T22:18:46.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.093+0000 7fc8fc574640 1 -- 172.21.15.55:0/444650813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e0003980 msgr2=0x7fc8e0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:46.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.093+0000 7fc8fc574640 1 --2- 172.21.15.55:0/444650813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e0003980 0x7fc8e0003d90 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009ae0 tx=0x7fc8f001ca20 comp rx=0 tx=0).stop 2023-07-06T22:18:46.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.093+0000 7fc8fc574640 1 -- 172.21.15.55:0/444650813 shutdown_connections 2023-07-06T22:18:46.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.093+0000 7fc8fc574640 1 --2- 172.21.15.55:0/444650813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e0003980 0x7fc8e0003d90 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:46.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.093+0000 7fc8fc574640 1 -- 172.21.15.55:0/444650813 >> 172.21.15.55:0/444650813 conn(0x7fc8f40b0120 msgr2=0x7fc8f40b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:46.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.093+0000 7fc8fc574640 1 -- 172.21.15.55:0/444650813 shutdown_connections 2023-07-06T22:18:46.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.093+0000 7fc8fc574640 1 -- 172.21.15.55:0/444650813 wait complete. 2023-07-06T22:18:46.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fc574640 1 Processor -- start 2023-07-06T22:18:46.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fc574640 1 -- start start 2023-07-06T22:18:46.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fc574640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8e0003980 0x7fc8f414ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:46.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fc574640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8f406fc10 0x7fc8f4070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:46.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fc574640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f40c5850 0x7fc8f40c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:46.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fc574640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40c7690 con 0x7fc8f40c5850 2023-07-06T22:18:46.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fc574640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40705c0 con 0x7fc8f406fc10 2023-07-06T22:18:46.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fc574640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40c65f0 con 0x7fc8e0003980 2023-07-06T22:18:46.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fab11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f40c5850 0x7fc8f40c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:46.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fab11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f40c5850 0x7fc8f40c5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37198/0 (socket says 172.21.15.55:37198) 2023-07-06T22:18:46.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fab11640 1 -- 172.21.15.55:0/44454148 learned_addr learned my addr 172.21.15.55:0/44454148 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:46.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fa310640 1 --2- 172.21.15.55:0/44454148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8e0003980 0x7fc8f414ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:46.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8f9b0f640 1 --2- 172.21.15.55:0/44454148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8f406fc10 0x7fc8f4070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:46.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fab11640 1 -- 172.21.15.55:0/44454148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8e0003980 msgr2=0x7fc8f414ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:46.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fab11640 1 --2- 172.21.15.55:0/44454148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8e0003980 0x7fc8f414ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:46.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fab11640 1 -- 172.21.15.55:0/44454148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8f406fc10 msgr2=0x7fc8f4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:46.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fab11640 1 --2- 172.21.15.55:0/44454148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8f406fc10 0x7fc8f4070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:46.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fab11640 1 -- 172.21.15.55:0/44454148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f40c68d0 con 0x7fc8f40c5850 2023-07-06T22:18:46.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.097+0000 7fc8fab11640 1 --2- 172.21.15.55:0/44454148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f40c5850 0x7fc8f40c5cc0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7fc8f406f740 tx=0x7fc8ec00e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:46.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.105+0000 7fc8eaffd640 1 -- 172.21.15.55:0/44454148 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec00ec60 con 0x7fc8f40c5850 2023-07-06T22:18:46.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.105+0000 7fc8eaffd640 1 -- 172.21.15.55:0/44454148 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec00edc0 con 0x7fc8f40c5850 2023-07-06T22:18:46.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.105+0000 7fc8eaffd640 1 -- 172.21.15.55:0/44454148 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec003b80 con 0x7fc8f40c5850 2023-07-06T22:18:46.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.105+0000 7fc8fc574640 1 -- 172.21.15.55:0/44454148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f40c6bb0 con 0x7fc8f40c5850 2023-07-06T22:18:46.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.105+0000 7fc8fc574640 1 -- 172.21.15.55:0/44454148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f40c7170 con 0x7fc8f40c5850 2023-07-06T22:18:46.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.105+0000 7fc8fc574640 1 -- 172.21.15.55:0/44454148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f40af770 con 0x7fc8f40c5850 2023-07-06T22:18:46.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.105+0000 7fc8eaffd640 1 -- 172.21.15.55:0/44454148 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc8ec003ce0 con 0x7fc8f40c5850 2023-07-06T22:18:46.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.105+0000 7fc8eaffd640 1 --2- 172.21.15.55:0/44454148 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fc8d80663a0 0x7fc8d8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:46.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.105+0000 7fc8eaffd640 1 -- 172.21.15.55:0/44454148 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc8ec0830b0 con 0x7fc8f40c5850 2023-07-06T22:18:46.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.105+0000 7fc8fa310640 1 --2- 172.21.15.55:0/44454148 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fc8d80663a0 0x7fc8d8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:46.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.109+0000 7fc8fa310640 1 --2- 172.21.15.55:0/44454148 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fc8d80663a0 0x7fc8d8068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00ad000 tx=0x7fc8f00b2040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:46.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.113+0000 7fc8eaffd640 1 -- 172.21.15.55:0/44454148 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc8ec0502d0 con 0x7fc8f40c5850 2023-07-06T22:18:46.165 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-07-06T22:18:46.165+0000 7fc16fcb4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T22:18:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.265+0000 7fc8fc574640 1 -- 172.21.15.55:0/44454148 --> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8f406a8b0 con 0x7fc8d80663a0 2023-07-06T22:18:46.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.273+0000 7fc8eaffd640 1 -- 172.21.15.55:0/44454148 <== mgr.10167 v2:172.21.15.55:6832/957337795 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312005 (secure 0 0 0) 0x7fc8f00a6700 con 0x7fc8d80663a0 2023-07-06T22:18:46.278 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:46.279 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:18:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.277+0000 7fc8fc574640 1 -- 172.21.15.55:0/44454148 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fc8d80663a0 msgr2=0x7fc8d8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.277+0000 7fc8fc574640 1 --2- 172.21.15.55:0/44454148 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fc8d80663a0 0x7fc8d8068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00ad000 tx=0x7fc8f00b2040 comp rx=0 tx=0).stop 2023-07-06T22:18:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.277+0000 7fc8fc574640 1 -- 172.21.15.55:0/44454148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f40c5850 msgr2=0x7fc8f40c5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.277+0000 7fc8fc574640 1 --2- 172.21.15.55:0/44454148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f40c5850 0x7fc8f40c5cc0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7fc8f406f740 tx=0x7fc8ec00e7c0 comp rx=0 tx=0).stop 2023-07-06T22:18:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.277+0000 7fc8fc574640 1 -- 172.21.15.55:0/44454148 shutdown_connections 2023-07-06T22:18:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.277+0000 7fc8fc574640 1 --2- 172.21.15.55:0/44454148 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fc8d80663a0 0x7fc8d8068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.277+0000 7fc8fc574640 1 --2- 172.21.15.55:0/44454148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f40c5850 0x7fc8f40c5cc0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.277+0000 7fc8fc574640 1 --2- 172.21.15.55:0/44454148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8f406fc10 0x7fc8f4070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.277+0000 7fc8fc574640 1 --2- 172.21.15.55:0/44454148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8e0003980 0x7fc8f414ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.277+0000 7fc8fc574640 1 -- 172.21.15.55:0/44454148 >> 172.21.15.55:0/44454148 conn(0x7fc8f40b0120 msgr2=0x7fc8f40c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.277+0000 7fc8fc574640 1 -- 172.21.15.55:0/44454148 shutdown_connections 2023-07-06T22:18:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:46.277+0000 7fc8fc574640 1 -- 172.21.15.55:0/44454148 wait complete. 2023-07-06T22:18:46.298 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-06T22:18:45.576179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":543,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":342,"ondisk_log_size":342,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":384320,"kb_used_data":18688,"kb_used_omap":0,"kb_used_meta":365568,"kb_avail":754590400,"statfs":{"total":773094113280,"available":772700569600,"internally_reserved":0,"allocated":19136512,"data_stored":10787230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":374341632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001228"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602264+0000","last_change":"2023-07-06T22:18:40.619046+0000","last_active":"2023-07-06T22:18:41.602264+0000","last_peered":"2023-07-06T22:18:41.602264+0000","last_clean":"2023-07-06T22:18:41.602264+0000","last_became_active":"2023-07-06T22:18:40.618761+0000","last_became_peered":"2023-07-06T22:18:40.618761+0000","last_unstale":"2023-07-06T22:18:41.602264+0000","last_undegraded":"2023-07-06T22:18:41.602264+0000","last_fullsized":"2023-07-06T22:18:41.602264+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:11:15.279437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602116+0000","last_change":"2023-07-06T22:18:40.622434+0000","last_active":"2023-07-06T22:18:41.602116+0000","last_peered":"2023-07-06T22:18:41.602116+0000","last_clean":"2023-07-06T22:18:41.602116+0000","last_became_active":"2023-07-06T22:18:40.622126+0000","last_became_peered":"2023-07-06T22:18:40.622126+0000","last_unstale":"2023-07-06T22:18:41.602116+0000","last_undegraded":"2023-07-06T22:18:41.602116+0000","last_fullsized":"2023-07-06T22:18:41.602116+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:22:22.611378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694475+0000","last_change":"2023-07-06T22:18:40.615518+0000","last_active":"2023-07-06T22:18:41.694475+0000","last_peered":"2023-07-06T22:18:41.694475+0000","last_clean":"2023-07-06T22:18:41.694475+0000","last_became_active":"2023-07-06T22:18:40.615079+0000","last_became_peered":"2023-07-06T22:18:40.615079+0000","last_unstale":"2023-07-06T22:18:41.694475+0000","last_undegraded":"2023-07-06T22:18:41.694475+0000","last_fullsized":"2023-07-06T22:18:41.694475+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:11:25.158510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695211+0000","last_change":"2023-07-06T22:18:40.615480+0000","last_active":"2023-07-06T22:18:41.695211+0000","last_peered":"2023-07-06T22:18:41.695211+0000","last_clean":"2023-07-06T22:18:41.695211+0000","last_became_active":"2023-07-06T22:18:40.611708+0000","last_became_peered":"2023-07-06T22:18:40.611708+0000","last_unstale":"2023-07-06T22:18:41.695211+0000","last_undegraded":"2023-07-06T22:18:41.695211+0000","last_fullsized":"2023-07-06T22:18:41.695211+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:44:32.856437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601493+0000","last_change":"2023-07-06T22:18:40.615344+0000","last_active":"2023-07-06T22:18:41.601493+0000","last_peered":"2023-07-06T22:18:41.601493+0000","last_clean":"2023-07-06T22:18:41.601493+0000","last_became_active":"2023-07-06T22:18:40.614932+0000","last_became_peered":"2023-07-06T22:18:40.614932+0000","last_unstale":"2023-07-06T22:18:41.601493+0000","last_undegraded":"2023-07-06T22:18:41.601493+0000","last_fullsized":"2023-07-06T22:18:41.601493+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:10:12.209969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603869+0000","last_change":"2023-07-06T22:18:40.620843+0000","last_active":"2023-07-06T22:18:41.603869+0000","last_peered":"2023-07-06T22:18:41.603869+0000","last_clean":"2023-07-06T22:18:41.603869+0000","last_became_active":"2023-07-06T22:18:40.620587+0000","last_became_peered":"2023-07-06T22:18:40.620587+0000","last_unstale":"2023-07-06T22:18:41.603869+0000","last_undegraded":"2023-07-06T22:18:41.603869+0000","last_fullsized":"2023-07-06T22:18:41.603869+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:25:46.061549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694628+0000","last_change":"2023-07-06T22:18:40.622331+0000","last_active":"2023-07-06T22:18:41.694628+0000","last_peered":"2023-07-06T22:18:41.694628+0000","last_clean":"2023-07-06T22:18:41.694628+0000","last_became_active":"2023-07-06T22:18:40.622045+0000","last_became_peered":"2023-07-06T22:18:40.622045+0000","last_unstale":"2023-07-06T22:18:41.694628+0000","last_undegraded":"2023-07-06T22:18:41.694628+0000","last_fullsized":"2023-07-06T22:18:41.694628+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:06:01.965819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.600844+0000","last_change":"2023-07-06T22:18:40.614091+0000","last_active":"2023-07-06T22:18:41.600844+0000","last_peered":"2023-07-06T22:18:41.600844+0000","last_clean":"2023-07-06T22:18:41.600844+0000","last_became_active":"2023-07-06T22:18:40.613811+0000","last_became_peered":"2023-07-06T22:18:40.613811+0000","last_unstale":"2023-07-06T22:18:41.600844+0000","last_undegraded":"2023-07-06T22:18:41.600844+0000","last_fullsized":"2023-07-06T22:18:41.600844+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:23:08.769778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602524+0000","last_change":"2023-07-06T22:18:40.622433+0000","last_active":"2023-07-06T22:18:41.602524+0000","last_peered":"2023-07-06T22:18:41.602524+0000","last_clean":"2023-07-06T22:18:41.602524+0000","last_became_active":"2023-07-06T22:18:40.622129+0000","last_became_peered":"2023-07-06T22:18:40.622129+0000","last_unstale":"2023-07-06T22:18:41.602524+0000","last_undegraded":"2023-07-06T22:18:41.602524+0000","last_fullsized":"2023-07-06T22:18:41.602524+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:35:05.710693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602253+0000","last_change":"2023-07-06T22:18:40.633713+0000","last_active":"2023-07-06T22:18:41.602253+0000","last_peered":"2023-07-06T22:18:41.602253+0000","last_clean":"2023-07-06T22:18:41.602253+0000","last_became_active":"2023-07-06T22:18:40.632752+0000","last_became_peered":"2023-07-06T22:18:40.632752+0000","last_unstale":"2023-07-06T22:18:41.602253+0000","last_undegraded":"2023-07-06T22:18:41.602253+0000","last_fullsized":"2023-07-06T22:18:41.602253+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:11:46.109599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602554+0000","last_change":"2023-07-06T22:18:40.615776+0000","last_active":"2023-07-06T22:18:41.602554+0000","last_peered":"2023-07-06T22:18:41.602554+0000","last_clean":"2023-07-06T22:18:41.602554+0000","last_became_active":"2023-07-06T22:18:40.615299+0000","last_became_peered":"2023-07-06T22:18:40.615299+0000","last_unstale":"2023-07-06T22:18:41.602554+0000","last_undegraded":"2023-07-06T22:18:41.602554+0000","last_fullsized":"2023-07-06T22:18:41.602554+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:55.005238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602093+0000","last_change":"2023-07-06T22:18:40.633984+0000","last_active":"2023-07-06T22:18:41.602093+0000","last_peered":"2023-07-06T22:18:41.602093+0000","last_clean":"2023-07-06T22:18:41.602093+0000","last_became_active":"2023-07-06T22:18:40.633710+0000","last_became_peered":"2023-07-06T22:18:40.633710+0000","last_unstale":"2023-07-06T22:18:41.602093+0000","last_undegraded":"2023-07-06T22:18:41.602093+0000","last_fullsized":"2023-07-06T22:18:41.602093+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:34:57.771639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694382+0000","last_change":"2023-07-06T22:18:40.621277+0000","last_active":"2023-07-06T22:18:41.694382+0000","last_peered":"2023-07-06T22:18:41.694382+0000","last_clean":"2023-07-06T22:18:41.694382+0000","last_became_active":"2023-07-06T22:18:40.620710+0000","last_became_peered":"2023-07-06T22:18:40.620710+0000","last_unstale":"2023-07-06T22:18:41.694382+0000","last_undegraded":"2023-07-06T22:18:41.694382+0000","last_fullsized":"2023-07-06T22:18:41.694382+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:32.078722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694010+0000","last_change":"2023-07-06T22:18:40.621840+0000","last_active":"2023-07-06T22:18:41.694010+0000","last_peered":"2023-07-06T22:18:41.694010+0000","last_clean":"2023-07-06T22:18:41.694010+0000","last_became_active":"2023-07-06T22:18:40.621504+0000","last_became_peered":"2023-07-06T22:18:40.621504+0000","last_unstale":"2023-07-06T22:18:41.694010+0000","last_undegraded":"2023-07-06T22:18:41.694010+0000","last_fullsized":"2023-07-06T22:18:41.694010+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:44:32.856437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601189+0000","last_change":"2023-07-06T22:18:40.624495+0000","last_active":"2023-07-06T22:18:41.601189+0000","last_peered":"2023-07-06T22:18:41.601189+0000","last_clean":"2023-07-06T22:18:41.601189+0000","last_became_active":"2023-07-06T22:18:40.624127+0000","last_became_peered":"2023-07-06T22:18:40.624127+0000","last_unstale":"2023-07-06T22:18:41.601189+0000","last_undegraded":"2023-07-06T22:18:41.601189+0000","last_fullsized":"2023-07-06T22:18:41.601189+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:10:48.494329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694034+0000","last_change":"2023-07-06T22:18:40.624044+0000","last_active":"2023-07-06T22:18:41.694034+0000","last_peered":"2023-07-06T22:18:41.694034+0000","last_clean":"2023-07-06T22:18:41.694034+0000","last_became_active":"2023-07-06T22:18:40.623766+0000","last_became_peered":"2023-07-06T22:18:40.623766+0000","last_unstale":"2023-07-06T22:18:41.694034+0000","last_undegraded":"2023-07-06T22:18:41.694034+0000","last_fullsized":"2023-07-06T22:18:41.694034+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:13:58.833359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.604036+0000","last_change":"2023-07-06T22:18:40.619171+0000","last_active":"2023-07-06T22:18:41.604036+0000","last_peered":"2023-07-06T22:18:41.604036+0000","last_clean":"2023-07-06T22:18:41.604036+0000","last_became_active":"2023-07-06T22:18:40.618882+0000","last_became_peered":"2023-07-06T22:18:40.618882+0000","last_unstale":"2023-07-06T22:18:41.604036+0000","last_undegraded":"2023-07-06T22:18:41.604036+0000","last_fullsized":"2023-07-06T22:18:41.604036+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:16:50.549237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694311+0000","last_change":"2023-07-06T22:18:40.627327+0000","last_active":"2023-07-06T22:18:41.694311+0000","last_peered":"2023-07-06T22:18:41.694311+0000","last_clean":"2023-07-06T22:18:41.694311+0000","last_became_active":"2023-07-06T22:18:40.626829+0000","last_became_peered":"2023-07-06T22:18:40.626829+0000","last_unstale":"2023-07-06T22:18:41.694311+0000","last_undegraded":"2023-07-06T22:18:41.694311+0000","last_fullsized":"2023-07-06T22:18:41.694311+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:05:01.147715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.604077+0000","last_change":"2023-07-06T22:18:40.613776+0000","last_active":"2023-07-06T22:18:41.604077+0000","last_peered":"2023-07-06T22:18:41.604077+0000","last_clean":"2023-07-06T22:18:41.604077+0000","last_became_active":"2023-07-06T22:18:40.613521+0000","last_became_peered":"2023-07-06T22:18:40.613521+0000","last_unstale":"2023-07-06T22:18:41.604077+0000","last_undegraded":"2023-07-06T22:18:41.604077+0000","last_fullsized":"2023-07-06T22:18:41.604077+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:05:11.005961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694178+0000","last_change":"2023-07-06T22:18:40.621667+0000","last_active":"2023-07-06T22:18:41.694178+0000","last_peered":"2023-07-06T22:18:41.694178+0000","last_clean":"2023-07-06T22:18:41.694178+0000","last_became_active":"2023-07-06T22:18:40.621378+0000","last_became_peered":"2023-07-06T22:18:40.621378+0000","last_unstale":"2023-07-06T22:18:41.694178+0000","last_undegraded":"2023-07-06T22:18:41.694178+0000","last_fullsized":"2023-07-06T22:18:41.694178+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:52.122067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603997+0000","last_change":"2023-07-06T22:18:40.617574+0000","last_active":"2023-07-06T22:18:41.603997+0000","last_peered":"2023-07-06T22:18:41.603997+0000","last_clean":"2023-07-06T22:18:41.603997+0000","last_became_active":"2023-07-06T22:18:40.617289+0000","last_became_peered":"2023-07-06T22:18:40.617289+0000","last_unstale":"2023-07-06T22:18:41.603997+0000","last_undegraded":"2023-07-06T22:18:41.603997+0000","last_fullsized":"2023-07-06T22:18:41.603997+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:57:51.574290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601267+0000","last_change":"2023-07-06T22:18:40.619336+0000","last_active":"2023-07-06T22:18:41.601267+0000","last_peered":"2023-07-06T22:18:41.601267+0000","last_clean":"2023-07-06T22:18:41.601267+0000","last_became_active":"2023-07-06T22:18:40.618959+0000","last_became_peered":"2023-07-06T22:18:40.618959+0000","last_unstale":"2023-07-06T22:18:41.601267+0000","last_undegraded":"2023-07-06T22:18:41.601267+0000","last_fullsized":"2023-07-06T22:18:41.601267+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:33:52.364994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603633+0000","last_change":"2023-07-06T22:18:40.622269+0000","last_active":"2023-07-06T22:18:41.603633+0000","last_peered":"2023-07-06T22:18:41.603633+0000","last_clean":"2023-07-06T22:18:41.603633+0000","last_became_active":"2023-07-06T22:18:40.621564+0000","last_became_peered":"2023-07-06T22:18:40.621564+0000","last_unstale":"2023-07-06T22:18:41.603633+0000","last_undegraded":"2023-07-06T22:18:41.603633+0000","last_fullsized":"2023-07-06T22:18:41.603633+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:05:00.389094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.600903+0000","last_change":"2023-07-06T22:18:40.618312+0000","last_active":"2023-07-06T22:18:41.600903+0000","last_peered":"2023-07-06T22:18:41.600903+0000","last_clean":"2023-07-06T22:18:41.600903+0000","last_became_active":"2023-07-06T22:18:40.618040+0000","last_became_peered":"2023-07-06T22:18:40.618040+0000","last_unstale":"2023-07-06T22:18:41.600903+0000","last_undegraded":"2023-07-06T22:18:41.600903+0000","last_fullsized":"2023-07-06T22:18:41.600903+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:58.481410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694622+0000","last_change":"2023-07-06T22:18:40.617300+0000","last_active":"2023-07-06T22:18:41.694622+0000","last_peered":"2023-07-06T22:18:41.694622+0000","last_clean":"2023-07-06T22:18:41.694622+0000","last_became_active":"2023-07-06T22:18:40.616898+0000","last_became_peered":"2023-07-06T22:18:40.616898+0000","last_unstale":"2023-07-06T22:18:41.694622+0000","last_undegraded":"2023-07-06T22:18:41.694622+0000","last_fullsized":"2023-07-06T22:18:41.694622+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:45:57.831511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694373+0000","last_change":"2023-07-06T22:18:40.629624+0000","last_active":"2023-07-06T22:18:41.694373+0000","last_peered":"2023-07-06T22:18:41.694373+0000","last_clean":"2023-07-06T22:18:41.694373+0000","last_became_active":"2023-07-06T22:18:40.629342+0000","last_became_peered":"2023-07-06T22:18:40.629342+0000","last_unstale":"2023-07-06T22:18:41.694373+0000","last_undegraded":"2023-07-06T22:18:41.694373+0000","last_fullsized":"2023-07-06T22:18:41.694373+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:40:59.122565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694718+0000","last_change":"2023-07-06T22:18:40.619299+0000","last_active":"2023-07-06T22:18:41.694718+0000","last_peered":"2023-07-06T22:18:41.694718+0000","last_clean":"2023-07-06T22:18:41.694718+0000","last_became_active":"2023-07-06T22:18:40.619008+0000","last_became_peered":"2023-07-06T22:18:40.619008+0000","last_unstale":"2023-07-06T22:18:41.694718+0000","last_undegraded":"2023-07-06T22:18:41.694718+0000","last_fullsized":"2023-07-06T22:18:41.694718+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:20:34.202966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695223+0000","last_change":"2023-07-06T22:18:40.605088+0000","last_active":"2023-07-06T22:18:41.695223+0000","last_peered":"2023-07-06T22:18:41.695223+0000","last_clean":"2023-07-06T22:18:41.695223+0000","last_became_active":"2023-07-06T22:18:40.604767+0000","last_became_peered":"2023-07-06T22:18:40.604767+0000","last_unstale":"2023-07-06T22:18:41.695223+0000","last_undegraded":"2023-07-06T22:18:41.695223+0000","last_fullsized":"2023-07-06T22:18:41.695223+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:58:08.638100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694464+0000","last_change":"2023-07-06T22:18:40.624965+0000","last_active":"2023-07-06T22:18:41.694464+0000","last_peered":"2023-07-06T22:18:41.694464+0000","last_clean":"2023-07-06T22:18:41.694464+0000","last_became_active":"2023-07-06T22:18:40.624702+0000","last_became_peered":"2023-07-06T22:18:40.624702+0000","last_unstale":"2023-07-06T22:18:41.694464+0000","last_undegraded":"2023-07-06T22:18:41.694464+0000","last_fullsized":"2023-07-06T22:18:41.694464+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:32:26.212096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693791+0000","last_change":"2023-07-06T22:18:40.614028+0000","last_active":"2023-07-06T22:18:41.693791+0000","last_peered":"2023-07-06T22:18:41.693791+0000","last_clean":"2023-07-06T22:18:41.693791+0000","last_became_active":"2023-07-06T22:18:40.613764+0000","last_became_peered":"2023-07-06T22:18:40.613764+0000","last_unstale":"2023-07-06T22:18:41.693791+0000","last_undegraded":"2023-07-06T22:18:41.693791+0000","last_fullsized":"2023-07-06T22:18:41.693791+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:57:26.538295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693789+0000","last_change":"2023-07-06T22:18:40.619882+0000","last_active":"2023-07-06T22:18:41.693789+0000","last_peered":"2023-07-06T22:18:41.693789+0000","last_clean":"2023-07-06T22:18:41.693789+0000","last_became_active":"2023-07-06T22:18:40.619604+0000","last_became_peered":"2023-07-06T22:18:40.619604+0000","last_unstale":"2023-07-06T22:18:41.693789+0000","last_undegraded":"2023-07-06T22:18:41.693789+0000","last_fullsized":"2023-07-06T22:18:41.693789+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:44:53.694217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693650+0000","last_change":"2023-07-06T22:18:40.626673+0000","last_active":"2023-07-06T22:18:41.693650+0000","last_peered":"2023-07-06T22:18:41.693650+0000","last_clean":"2023-07-06T22:18:41.693650+0000","last_became_active":"2023-07-06T22:18:40.626346+0000","last_became_peered":"2023-07-06T22:18:40.626346+0000","last_unstale":"2023-07-06T22:18:41.693650+0000","last_undegraded":"2023-07-06T22:18:41.693650+0000","last_fullsized":"2023-07-06T22:18:41.693650+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:23:31.357105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694449+0000","last_change":"2023-07-06T22:18:40.629661+0000","last_active":"2023-07-06T22:18:41.694449+0000","last_peered":"2023-07-06T22:18:41.694449+0000","last_clean":"2023-07-06T22:18:41.694449+0000","last_became_active":"2023-07-06T22:18:40.629390+0000","last_became_peered":"2023-07-06T22:18:40.629390+0000","last_unstale":"2023-07-06T22:18:41.694449+0000","last_undegraded":"2023-07-06T22:18:41.694449+0000","last_fullsized":"2023-07-06T22:18:41.694449+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:49:30.649897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"178'4","reported_seq":17,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602302+0000","last_change":"2023-07-06T22:18:40.219577+0000","last_active":"2023-07-06T22:18:41.602302+0000","last_peered":"2023-07-06T22:18:41.602302+0000","last_clean":"2023-07-06T22:18:41.602302+0000","last_became_active":"2023-07-06T22:18:40.219247+0000","last_became_peered":"2023-07-06T22:18:40.219247+0000","last_unstale":"2023-07-06T22:18:41.602302+0000","last_undegraded":"2023-07-06T22:18:41.602302+0000","last_fullsized":"2023-07-06T22:18:41.602302+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:42:01.304903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694995+0000","last_change":"2023-07-06T22:18:40.613131+0000","last_active":"2023-07-06T22:18:41.694995+0000","last_peered":"2023-07-06T22:18:41.694995+0000","last_clean":"2023-07-06T22:18:41.694995+0000","last_became_active":"2023-07-06T22:18:40.612785+0000","last_became_peered":"2023-07-06T22:18:40.612785+0000","last_unstale":"2023-07-06T22:18:41.694995+0000","last_undegraded":"2023-07-06T22:18:41.694995+0000","last_fullsized":"2023-07-06T22:18:41.694995+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:46.824254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"178'1","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694547+0000","last_change":"2023-07-06T22:18:40.209903+0000","last_active":"2023-07-06T22:18:41.694547+0000","last_peered":"2023-07-06T22:18:41.694547+0000","last_clean":"2023-07-06T22:18:41.694547+0000","last_became_active":"2023-07-06T22:18:40.209589+0000","last_became_peered":"2023-07-06T22:18:40.209589+0000","last_unstale":"2023-07-06T22:18:41.694547+0000","last_undegraded":"2023-07-06T22:18:41.694547+0000","last_fullsized":"2023-07-06T22:18:41.694547+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:58:13.259513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.604096+0000","last_change":"2023-07-06T22:18:40.618425+0000","last_active":"2023-07-06T22:18:41.604096+0000","last_peered":"2023-07-06T22:18:41.604096+0000","last_clean":"2023-07-06T22:18:41.604096+0000","last_became_active":"2023-07-06T22:18:40.618111+0000","last_became_peered":"2023-07-06T22:18:40.618111+0000","last_unstale":"2023-07-06T22:18:41.604096+0000","last_undegraded":"2023-07-06T22:18:41.604096+0000","last_fullsized":"2023-07-06T22:18:41.604096+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:13:04.802646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"178'2","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695085+0000","last_change":"2023-07-06T22:18:40.213653+0000","last_active":"2023-07-06T22:18:41.695085+0000","last_peered":"2023-07-06T22:18:41.695085+0000","last_clean":"2023-07-06T22:18:41.695085+0000","last_became_active":"2023-07-06T22:18:40.212652+0000","last_became_peered":"2023-07-06T22:18:40.212652+0000","last_unstale":"2023-07-06T22:18:41.695085+0000","last_undegraded":"2023-07-06T22:18:41.695085+0000","last_fullsized":"2023-07-06T22:18:41.695085+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:03:03.678489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694882+0000","last_change":"2023-07-06T22:18:40.624075+0000","last_active":"2023-07-06T22:18:41.694882+0000","last_peered":"2023-07-06T22:18:41.694882+0000","last_clean":"2023-07-06T22:18:41.694882+0000","last_became_active":"2023-07-06T22:18:40.623794+0000","last_became_peered":"2023-07-06T22:18:40.623794+0000","last_unstale":"2023-07-06T22:18:41.694882+0000","last_undegraded":"2023-07-06T22:18:41.694882+0000","last_fullsized":"2023-07-06T22:18:41.694882+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:41:27.625614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"178'2","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695323+0000","last_change":"2023-07-06T22:18:40.215990+0000","last_active":"2023-07-06T22:18:41.695323+0000","last_peered":"2023-07-06T22:18:41.695323+0000","last_clean":"2023-07-06T22:18:41.695323+0000","last_became_active":"2023-07-06T22:18:40.215653+0000","last_became_peered":"2023-07-06T22:18:40.215653+0000","last_unstale":"2023-07-06T22:18:41.695323+0000","last_undegraded":"2023-07-06T22:18:41.695323+0000","last_fullsized":"2023-07-06T22:18:41.695323+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:46:17.503741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694139+0000","last_change":"2023-07-06T22:18:40.617672+0000","last_active":"2023-07-06T22:18:41.694139+0000","last_peered":"2023-07-06T22:18:41.694139+0000","last_clean":"2023-07-06T22:18:41.694139+0000","last_became_active":"2023-07-06T22:18:40.617284+0000","last_became_peered":"2023-07-06T22:18:40.617284+0000","last_unstale":"2023-07-06T22:18:41.694139+0000","last_undegraded":"2023-07-06T22:18:41.694139+0000","last_fullsized":"2023-07-06T22:18:41.694139+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:15:14.236169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"178'1","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694496+0000","last_change":"2023-07-06T22:18:40.212574+0000","last_active":"2023-07-06T22:18:41.694496+0000","last_peered":"2023-07-06T22:18:41.694496+0000","last_clean":"2023-07-06T22:18:41.694496+0000","last_became_active":"2023-07-06T22:18:40.212315+0000","last_became_peered":"2023-07-06T22:18:40.212315+0000","last_unstale":"2023-07-06T22:18:41.694496+0000","last_undegraded":"2023-07-06T22:18:41.694496+0000","last_fullsized":"2023-07-06T22:18:41.694496+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:14:28.373999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695020+0000","last_change":"2023-07-06T22:18:40.625890+0000","last_active":"2023-07-06T22:18:41.695020+0000","last_peered":"2023-07-06T22:18:41.695020+0000","last_clean":"2023-07-06T22:18:41.695020+0000","last_became_active":"2023-07-06T22:18:40.625402+0000","last_became_peered":"2023-07-06T22:18:40.625402+0000","last_unstale":"2023-07-06T22:18:41.695020+0000","last_undegraded":"2023-07-06T22:18:41.695020+0000","last_fullsized":"2023-07-06T22:18:41.695020+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:05:01.147715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"178'1","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694806+0000","last_change":"2023-07-06T22:18:40.216636+0000","last_active":"2023-07-06T22:18:41.694806+0000","last_peered":"2023-07-06T22:18:41.694806+0000","last_clean":"2023-07-06T22:18:41.694806+0000","last_became_active":"2023-07-06T22:18:40.215764+0000","last_became_peered":"2023-07-06T22:18:40.215764+0000","last_unstale":"2023-07-06T22:18:41.694806+0000","last_undegraded":"2023-07-06T22:18:41.694806+0000","last_fullsized":"2023-07-06T22:18:41.694806+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:24:17.321033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693626+0000","last_change":"2023-07-06T22:18:40.614321+0000","last_active":"2023-07-06T22:18:41.693626+0000","last_peered":"2023-07-06T22:18:41.693626+0000","last_clean":"2023-07-06T22:18:41.693626+0000","last_became_active":"2023-07-06T22:18:40.614020+0000","last_became_peered":"2023-07-06T22:18:40.614020+0000","last_unstale":"2023-07-06T22:18:41.693626+0000","last_undegraded":"2023-07-06T22:18:41.693626+0000","last_fullsized":"2023-07-06T22:18:41.693626+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:11:36.944945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.600881+0000","last_change":"2023-07-06T22:18:40.214485+0000","last_active":"2023-07-06T22:18:41.600881+0000","last_peered":"2023-07-06T22:18:41.600881+0000","last_clean":"2023-07-06T22:18:41.600881+0000","last_became_active":"2023-07-06T22:18:40.214068+0000","last_became_peered":"2023-07-06T22:18:40.214068+0000","last_unstale":"2023-07-06T22:18:41.600881+0000","last_undegraded":"2023-07-06T22:18:41.600881+0000","last_fullsized":"2023-07-06T22:18:41.600881+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:56:56.728072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603706+0000","last_change":"2023-07-06T22:18:40.617123+0000","last_active":"2023-07-06T22:18:41.603706+0000","last_peered":"2023-07-06T22:18:41.603706+0000","last_clean":"2023-07-06T22:18:41.603706+0000","last_became_active":"2023-07-06T22:18:40.616855+0000","last_became_peered":"2023-07-06T22:18:40.616855+0000","last_unstale":"2023-07-06T22:18:41.603706+0000","last_undegraded":"2023-07-06T22:18:41.603706+0000","last_fullsized":"2023-07-06T22:18:41.603706+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:11:47.675157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694308+0000","last_change":"2023-07-06T22:18:40.209594+0000","last_active":"2023-07-06T22:18:41.694308+0000","last_peered":"2023-07-06T22:18:41.694308+0000","last_clean":"2023-07-06T22:18:41.694308+0000","last_became_active":"2023-07-06T22:18:40.209290+0000","last_became_peered":"2023-07-06T22:18:40.209290+0000","last_unstale":"2023-07-06T22:18:41.694308+0000","last_undegraded":"2023-07-06T22:18:41.694308+0000","last_fullsized":"2023-07-06T22:18:41.694308+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:35:17.197785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695297+0000","last_change":"2023-07-06T22:18:40.622755+0000","last_active":"2023-07-06T22:18:41.695297+0000","last_peered":"2023-07-06T22:18:41.695297+0000","last_clean":"2023-07-06T22:18:41.695297+0000","last_became_active":"2023-07-06T22:18:40.622505+0000","last_became_peered":"2023-07-06T22:18:40.622505+0000","last_unstale":"2023-07-06T22:18:41.695297+0000","last_undegraded":"2023-07-06T22:18:41.695297+0000","last_fullsized":"2023-07-06T22:18:41.695297+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:01:10.604990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"178'1","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694772+0000","last_change":"2023-07-06T22:18:40.214105+0000","last_active":"2023-07-06T22:18:41.694772+0000","last_peered":"2023-07-06T22:18:41.694772+0000","last_clean":"2023-07-06T22:18:41.694772+0000","last_became_active":"2023-07-06T22:18:40.212860+0000","last_became_peered":"2023-07-06T22:18:40.212860+0000","last_unstale":"2023-07-06T22:18:41.694772+0000","last_undegraded":"2023-07-06T22:18:41.694772+0000","last_fullsized":"2023-07-06T22:18:41.694772+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:29:49.668805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694029+0000","last_change":"2023-07-06T22:18:40.610823+0000","last_active":"2023-07-06T22:18:41.694029+0000","last_peered":"2023-07-06T22:18:41.694029+0000","last_clean":"2023-07-06T22:18:41.694029+0000","last_became_active":"2023-07-06T22:18:40.610524+0000","last_became_peered":"2023-07-06T22:18:40.610524+0000","last_unstale":"2023-07-06T22:18:41.694029+0000","last_undegraded":"2023-07-06T22:18:41.694029+0000","last_fullsized":"2023-07-06T22:18:41.694029+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:14:56.479769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"178'2","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694614+0000","last_change":"2023-07-06T22:18:40.216143+0000","last_active":"2023-07-06T22:18:41.694614+0000","last_peered":"2023-07-06T22:18:41.694614+0000","last_clean":"2023-07-06T22:18:41.694614+0000","last_became_active":"2023-07-06T22:18:40.215878+0000","last_became_peered":"2023-07-06T22:18:40.215878+0000","last_unstale":"2023-07-06T22:18:41.694614+0000","last_undegraded":"2023-07-06T22:18:41.694614+0000","last_fullsized":"2023-07-06T22:18:41.694614+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:23:47.642095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695358+0000","last_change":"2023-07-06T22:18:40.620304+0000","last_active":"2023-07-06T22:18:41.695358+0000","last_peered":"2023-07-06T22:18:41.695358+0000","last_clean":"2023-07-06T22:18:41.695358+0000","last_became_active":"2023-07-06T22:18:40.618482+0000","last_became_peered":"2023-07-06T22:18:40.618482+0000","last_unstale":"2023-07-06T22:18:41.695358+0000","last_undegraded":"2023-07-06T22:18:41.695358+0000","last_fullsized":"2023-07-06T22:18:41.695358+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:52.122067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"178'1","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601864+0000","last_change":"2023-07-06T22:18:40.221602+0000","last_active":"2023-07-06T22:18:41.601864+0000","last_peered":"2023-07-06T22:18:41.601864+0000","last_clean":"2023-07-06T22:18:41.601864+0000","last_became_active":"2023-07-06T22:18:40.221337+0000","last_became_peered":"2023-07-06T22:18:40.221337+0000","last_unstale":"2023-07-06T22:18:41.601864+0000","last_undegraded":"2023-07-06T22:18:41.601864+0000","last_fullsized":"2023-07-06T22:18:41.601864+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:24:36.573316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694602+0000","last_change":"2023-07-06T22:18:40.621973+0000","last_active":"2023-07-06T22:18:41.694602+0000","last_peered":"2023-07-06T22:18:41.694602+0000","last_clean":"2023-07-06T22:18:41.694602+0000","last_became_active":"2023-07-06T22:18:40.621708+0000","last_became_peered":"2023-07-06T22:18:40.621708+0000","last_unstale":"2023-07-06T22:18:41.694602+0000","last_undegraded":"2023-07-06T22:18:41.694602+0000","last_fullsized":"2023-07-06T22:18:41.694602+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:51:01.135230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601888+0000","last_change":"2023-07-06T22:18:40.218552+0000","last_active":"2023-07-06T22:18:41.601888+0000","last_peered":"2023-07-06T22:18:41.601888+0000","last_clean":"2023-07-06T22:18:41.601888+0000","last_became_active":"2023-07-06T22:18:40.218262+0000","last_became_peered":"2023-07-06T22:18:40.218262+0000","last_unstale":"2023-07-06T22:18:41.601888+0000","last_undegraded":"2023-07-06T22:18:41.601888+0000","last_fullsized":"2023-07-06T22:18:41.601888+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:10:10.677876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694150+0000","last_change":"2023-07-06T22:18:40.620053+0000","last_active":"2023-07-06T22:18:41.694150+0000","last_peered":"2023-07-06T22:18:41.694150+0000","last_clean":"2023-07-06T22:18:41.694150+0000","last_became_active":"2023-07-06T22:18:40.619763+0000","last_became_peered":"2023-07-06T22:18:40.619763+0000","last_unstale":"2023-07-06T22:18:41.694150+0000","last_undegraded":"2023-07-06T22:18:41.694150+0000","last_fullsized":"2023-07-06T22:18:41.694150+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:01:10.604990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"178'2","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695114+0000","last_change":"2023-07-06T22:18:40.213475+0000","last_active":"2023-07-06T22:18:41.695114+0000","last_peered":"2023-07-06T22:18:41.695114+0000","last_clean":"2023-07-06T22:18:41.695114+0000","last_became_active":"2023-07-06T22:18:40.213163+0000","last_became_peered":"2023-07-06T22:18:40.213163+0000","last_unstale":"2023-07-06T22:18:41.695114+0000","last_undegraded":"2023-07-06T22:18:41.695114+0000","last_fullsized":"2023-07-06T22:18:41.695114+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:31:13.649718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694593+0000","last_change":"2023-07-06T22:18:40.621415+0000","last_active":"2023-07-06T22:18:41.694593+0000","last_peered":"2023-07-06T22:18:41.694593+0000","last_clean":"2023-07-06T22:18:41.694593+0000","last_became_active":"2023-07-06T22:18:40.621158+0000","last_became_peered":"2023-07-06T22:18:40.621158+0000","last_unstale":"2023-07-06T22:18:41.694593+0000","last_undegraded":"2023-07-06T22:18:41.694593+0000","last_fullsized":"2023-07-06T22:18:41.694593+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:41:37.120206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601538+0000","last_change":"2023-07-06T22:18:40.217289+0000","last_active":"2023-07-06T22:18:41.601538+0000","last_peered":"2023-07-06T22:18:41.601538+0000","last_clean":"2023-07-06T22:18:41.601538+0000","last_became_active":"2023-07-06T22:18:40.216980+0000","last_became_peered":"2023-07-06T22:18:40.216980+0000","last_unstale":"2023-07-06T22:18:41.601538+0000","last_undegraded":"2023-07-06T22:18:41.601538+0000","last_fullsized":"2023-07-06T22:18:41.601538+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:24:54.233636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601074+0000","last_change":"2023-07-06T22:18:40.623314+0000","last_active":"2023-07-06T22:18:41.601074+0000","last_peered":"2023-07-06T22:18:41.601074+0000","last_clean":"2023-07-06T22:18:41.601074+0000","last_became_active":"2023-07-06T22:18:40.623042+0000","last_became_peered":"2023-07-06T22:18:40.623042+0000","last_unstale":"2023-07-06T22:18:41.601074+0000","last_undegraded":"2023-07-06T22:18:41.601074+0000","last_fullsized":"2023-07-06T22:18:41.601074+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:20:38.351410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694801+0000","last_change":"2023-07-06T22:18:40.216439+0000","last_active":"2023-07-06T22:18:41.694801+0000","last_peered":"2023-07-06T22:18:41.694801+0000","last_clean":"2023-07-06T22:18:41.694801+0000","last_became_active":"2023-07-06T22:18:40.216121+0000","last_became_peered":"2023-07-06T22:18:40.216121+0000","last_unstale":"2023-07-06T22:18:41.694801+0000","last_undegraded":"2023-07-06T22:18:41.694801+0000","last_fullsized":"2023-07-06T22:18:41.694801+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:50:32.556473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603788+0000","last_change":"2023-07-06T22:18:40.622485+0000","last_active":"2023-07-06T22:18:41.603788+0000","last_peered":"2023-07-06T22:18:41.603788+0000","last_clean":"2023-07-06T22:18:41.603788+0000","last_became_active":"2023-07-06T22:18:40.621938+0000","last_became_peered":"2023-07-06T22:18:40.621938+0000","last_unstale":"2023-07-06T22:18:41.603788+0000","last_undegraded":"2023-07-06T22:18:41.603788+0000","last_fullsized":"2023-07-06T22:18:41.603788+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:07:04.867861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601185+0000","last_change":"2023-07-06T22:18:40.219930+0000","last_active":"2023-07-06T22:18:41.601185+0000","last_peered":"2023-07-06T22:18:41.601185+0000","last_clean":"2023-07-06T22:18:41.601185+0000","last_became_active":"2023-07-06T22:18:40.219660+0000","last_became_peered":"2023-07-06T22:18:40.219660+0000","last_unstale":"2023-07-06T22:18:41.601185+0000","last_undegraded":"2023-07-06T22:18:41.601185+0000","last_fullsized":"2023-07-06T22:18:41.601185+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:47:35.515425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694541+0000","last_change":"2023-07-06T22:18:40.627095+0000","last_active":"2023-07-06T22:18:41.694541+0000","last_peered":"2023-07-06T22:18:41.694541+0000","last_clean":"2023-07-06T22:18:41.694541+0000","last_became_active":"2023-07-06T22:18:40.626480+0000","last_became_peered":"2023-07-06T22:18:40.626480+0000","last_unstale":"2023-07-06T22:18:41.694541+0000","last_undegraded":"2023-07-06T22:18:41.694541+0000","last_fullsized":"2023-07-06T22:18:41.694541+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:31:14.661073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"178'2","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694124+0000","last_change":"2023-07-06T22:18:40.211172+0000","last_active":"2023-07-06T22:18:41.694124+0000","last_peered":"2023-07-06T22:18:41.694124+0000","last_clean":"2023-07-06T22:18:41.694124+0000","last_became_active":"2023-07-06T22:18:40.210889+0000","last_became_peered":"2023-07-06T22:18:40.210889+0000","last_unstale":"2023-07-06T22:18:41.694124+0000","last_undegraded":"2023-07-06T22:18:41.694124+0000","last_fullsized":"2023-07-06T22:18:41.694124+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:50:32.556473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694518+0000","last_change":"2023-07-06T22:18:40.623080+0000","last_active":"2023-07-06T22:18:41.694518+0000","last_peered":"2023-07-06T22:18:41.694518+0000","last_clean":"2023-07-06T22:18:41.694518+0000","last_became_active":"2023-07-06T22:18:40.622829+0000","last_became_peered":"2023-07-06T22:18:40.622829+0000","last_unstale":"2023-07-06T22:18:41.694518+0000","last_undegraded":"2023-07-06T22:18:41.694518+0000","last_fullsized":"2023-07-06T22:18:41.694518+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:41:32.509615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694684+0000","last_change":"2023-07-06T22:18:40.217600+0000","last_active":"2023-07-06T22:18:41.694684+0000","last_peered":"2023-07-06T22:18:41.694684+0000","last_clean":"2023-07-06T22:18:41.694684+0000","last_became_active":"2023-07-06T22:18:40.217336+0000","last_became_peered":"2023-07-06T22:18:40.217336+0000","last_unstale":"2023-07-06T22:18:41.694684+0000","last_undegraded":"2023-07-06T22:18:41.694684+0000","last_fullsized":"2023-07-06T22:18:41.694684+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:35:46.007743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603964+0000","last_change":"2023-07-06T22:18:40.613941+0000","last_active":"2023-07-06T22:18:41.603964+0000","last_peered":"2023-07-06T22:18:41.603964+0000","last_clean":"2023-07-06T22:18:41.603964+0000","last_became_active":"2023-07-06T22:18:40.613663+0000","last_became_peered":"2023-07-06T22:18:40.613663+0000","last_unstale":"2023-07-06T22:18:41.603964+0000","last_undegraded":"2023-07-06T22:18:41.603964+0000","last_fullsized":"2023-07-06T22:18:41.603964+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:00:52.350089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602161+0000","last_change":"2023-07-06T22:18:40.216017+0000","last_active":"2023-07-06T22:18:41.602161+0000","last_peered":"2023-07-06T22:18:41.602161+0000","last_clean":"2023-07-06T22:18:41.602161+0000","last_became_active":"2023-07-06T22:18:40.215750+0000","last_became_peered":"2023-07-06T22:18:40.215750+0000","last_unstale":"2023-07-06T22:18:41.602161+0000","last_undegraded":"2023-07-06T22:18:41.602161+0000","last_fullsized":"2023-07-06T22:18:41.602161+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:50:13.328017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693865+0000","last_change":"2023-07-06T22:18:40.621049+0000","last_active":"2023-07-06T22:18:41.693865+0000","last_peered":"2023-07-06T22:18:41.693865+0000","last_clean":"2023-07-06T22:18:41.693865+0000","last_became_active":"2023-07-06T22:18:40.620671+0000","last_became_peered":"2023-07-06T22:18:40.620671+0000","last_unstale":"2023-07-06T22:18:41.693865+0000","last_undegraded":"2023-07-06T22:18:41.693865+0000","last_fullsized":"2023-07-06T22:18:41.693865+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:47:37.730407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694072+0000","last_change":"2023-07-06T22:18:40.214713+0000","last_active":"2023-07-06T22:18:41.694072+0000","last_peered":"2023-07-06T22:18:41.694072+0000","last_clean":"2023-07-06T22:18:41.694072+0000","last_became_active":"2023-07-06T22:18:40.214053+0000","last_became_peered":"2023-07-06T22:18:40.214053+0000","last_unstale":"2023-07-06T22:18:41.694072+0000","last_undegraded":"2023-07-06T22:18:41.694072+0000","last_fullsized":"2023-07-06T22:18:41.694072+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:30:18.652092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694233+0000","last_change":"2023-07-06T22:18:40.627261+0000","last_active":"2023-07-06T22:18:41.694233+0000","last_peered":"2023-07-06T22:18:41.694233+0000","last_clean":"2023-07-06T22:18:41.694233+0000","last_became_active":"2023-07-06T22:18:40.626980+0000","last_became_peered":"2023-07-06T22:18:40.626980+0000","last_unstale":"2023-07-06T22:18:41.694233+0000","last_undegraded":"2023-07-06T22:18:41.694233+0000","last_fullsized":"2023-07-06T22:18:41.694233+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:24:18.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694210+0000","last_change":"2023-07-06T22:18:40.216824+0000","last_active":"2023-07-06T22:18:41.694210+0000","last_peered":"2023-07-06T22:18:41.694210+0000","last_clean":"2023-07-06T22:18:41.694210+0000","last_became_active":"2023-07-06T22:18:40.215345+0000","last_became_peered":"2023-07-06T22:18:40.215345+0000","last_unstale":"2023-07-06T22:18:41.694210+0000","last_undegraded":"2023-07-06T22:18:41.694210+0000","last_fullsized":"2023-07-06T22:18:41.694210+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:06:49.046500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694230+0000","last_change":"2023-07-06T22:18:40.619204+0000","last_active":"2023-07-06T22:18:41.694230+0000","last_peered":"2023-07-06T22:18:41.694230+0000","last_clean":"2023-07-06T22:18:41.694230+0000","last_became_active":"2023-07-06T22:18:40.618807+0000","last_became_peered":"2023-07-06T22:18:40.618807+0000","last_unstale":"2023-07-06T22:18:41.694230+0000","last_undegraded":"2023-07-06T22:18:41.694230+0000","last_fullsized":"2023-07-06T22:18:41.694230+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:26:59.446469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694801+0000","last_change":"2023-07-06T22:18:40.215796+0000","last_active":"2023-07-06T22:18:41.694801+0000","last_peered":"2023-07-06T22:18:41.694801+0000","last_clean":"2023-07-06T22:18:41.694801+0000","last_became_active":"2023-07-06T22:18:40.215509+0000","last_became_peered":"2023-07-06T22:18:40.215509+0000","last_unstale":"2023-07-06T22:18:41.694801+0000","last_undegraded":"2023-07-06T22:18:41.694801+0000","last_fullsized":"2023-07-06T22:18:41.694801+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:30:18.652092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694163+0000","last_change":"2023-07-06T22:18:40.619821+0000","last_active":"2023-07-06T22:18:41.694163+0000","last_peered":"2023-07-06T22:18:41.694163+0000","last_clean":"2023-07-06T22:18:41.694163+0000","last_became_active":"2023-07-06T22:18:40.619554+0000","last_became_peered":"2023-07-06T22:18:40.619554+0000","last_unstale":"2023-07-06T22:18:41.694163+0000","last_undegraded":"2023-07-06T22:18:41.694163+0000","last_fullsized":"2023-07-06T22:18:41.694163+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:11:55.911389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601589+0000","last_change":"2023-07-06T22:18:40.216394+0000","last_active":"2023-07-06T22:18:41.601589+0000","last_peered":"2023-07-06T22:18:41.601589+0000","last_clean":"2023-07-06T22:18:41.601589+0000","last_became_active":"2023-07-06T22:18:40.216136+0000","last_became_peered":"2023-07-06T22:18:40.216136+0000","last_unstale":"2023-07-06T22:18:41.601589+0000","last_undegraded":"2023-07-06T22:18:41.601589+0000","last_fullsized":"2023-07-06T22:18:41.601589+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:38:10.095131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694018+0000","last_change":"2023-07-06T22:18:40.624108+0000","last_active":"2023-07-06T22:18:41.694018+0000","last_peered":"2023-07-06T22:18:41.694018+0000","last_clean":"2023-07-06T22:18:41.694018+0000","last_became_active":"2023-07-06T22:18:40.623822+0000","last_became_peered":"2023-07-06T22:18:40.623822+0000","last_unstale":"2023-07-06T22:18:41.694018+0000","last_undegraded":"2023-07-06T22:18:41.694018+0000","last_fullsized":"2023-07-06T22:18:41.694018+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:58:08.638100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693900+0000","last_change":"2023-07-06T22:18:40.212071+0000","last_active":"2023-07-06T22:18:41.693900+0000","last_peered":"2023-07-06T22:18:41.693900+0000","last_clean":"2023-07-06T22:18:41.693900+0000","last_became_active":"2023-07-06T22:18:40.211276+0000","last_became_peered":"2023-07-06T22:18:40.211276+0000","last_unstale":"2023-07-06T22:18:41.693900+0000","last_undegraded":"2023-07-06T22:18:41.693900+0000","last_fullsized":"2023-07-06T22:18:41.693900+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:48:35.113402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694424+0000","last_change":"2023-07-06T22:18:40.629943+0000","last_active":"2023-07-06T22:18:41.694424+0000","last_peered":"2023-07-06T22:18:41.694424+0000","last_clean":"2023-07-06T22:18:41.694424+0000","last_became_active":"2023-07-06T22:18:40.629674+0000","last_became_peered":"2023-07-06T22:18:40.629674+0000","last_unstale":"2023-07-06T22:18:41.694424+0000","last_undegraded":"2023-07-06T22:18:41.694424+0000","last_fullsized":"2023-07-06T22:18:41.694424+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:03:04.689844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694995+0000","last_change":"2023-07-06T22:18:40.215510+0000","last_active":"2023-07-06T22:18:41.694995+0000","last_peered":"2023-07-06T22:18:41.694995+0000","last_clean":"2023-07-06T22:18:41.694995+0000","last_became_active":"2023-07-06T22:18:40.215222+0000","last_became_peered":"2023-07-06T22:18:40.215222+0000","last_unstale":"2023-07-06T22:18:41.694995+0000","last_undegraded":"2023-07-06T22:18:41.694995+0000","last_fullsized":"2023-07-06T22:18:41.694995+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:45:36.476137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"167'304","reported_seq":1152,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601318+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:18:41.601318+0000","last_peered":"2023-07-06T22:18:41.601318+0000","last_clean":"2023-07-06T22:18:41.601318+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:18:41.601318+0000","last_undegraded":"2023-07-06T22:18:41.601318+0000","last_fullsized":"2023-07-06T22:18:41.601318+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:47:16.983800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":294,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694606+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:18:41.694606+0000","last_peered":"2023-07-06T22:18:41.694606+0000","last_clean":"2023-07-06T22:18:41.694606+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:18:41.694606+0000","last_undegraded":"2023-07-06T22:18:41.694606+0000","last_fullsized":"2023-07-06T22:18:41.694606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:58:00.162499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694385+0000","last_change":"2023-07-06T22:18:40.616454+0000","last_active":"2023-07-06T22:18:41.694385+0000","last_peered":"2023-07-06T22:18:41.694385+0000","last_clean":"2023-07-06T22:18:41.694385+0000","last_became_active":"2023-07-06T22:18:40.616128+0000","last_became_peered":"2023-07-06T22:18:40.616128+0000","last_unstale":"2023-07-06T22:18:41.694385+0000","last_undegraded":"2023-07-06T22:18:41.694385+0000","last_fullsized":"2023-07-06T22:18:41.694385+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:05:01.654590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"178'6","reported_seq":19,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693814+0000","last_change":"2023-07-06T22:18:40.216820+0000","last_active":"2023-07-06T22:18:41.693814+0000","last_peered":"2023-07-06T22:18:41.693814+0000","last_clean":"2023-07-06T22:18:41.693814+0000","last_became_active":"2023-07-06T22:18:40.216427+0000","last_became_peered":"2023-07-06T22:18:40.216427+0000","last_unstale":"2023-07-06T22:18:41.693814+0000","last_undegraded":"2023-07-06T22:18:41.693814+0000","last_fullsized":"2023-07-06T22:18:41.693814+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:13:43.117761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":333,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601273+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:18:41.601273+0000","last_peered":"2023-07-06T22:18:41.601273+0000","last_clean":"2023-07-06T22:18:41.601273+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:18:41.601273+0000","last_undegraded":"2023-07-06T22:18:41.601273+0000","last_fullsized":"2023-07-06T22:18:41.601273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:45:44.425532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694083+0000","last_change":"2023-07-06T22:18:40.610901+0000","last_active":"2023-07-06T22:18:41.694083+0000","last_peered":"2023-07-06T22:18:41.694083+0000","last_clean":"2023-07-06T22:18:41.694083+0000","last_became_active":"2023-07-06T22:18:40.610540+0000","last_became_peered":"2023-07-06T22:18:40.610540+0000","last_unstale":"2023-07-06T22:18:41.694083+0000","last_undegraded":"2023-07-06T22:18:41.694083+0000","last_fullsized":"2023-07-06T22:18:41.694083+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:11:36.944945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"178'3","reported_seq":16,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603940+0000","last_change":"2023-07-06T22:18:40.212695+0000","last_active":"2023-07-06T22:18:41.603940+0000","last_peered":"2023-07-06T22:18:41.603940+0000","last_clean":"2023-07-06T22:18:41.603940+0000","last_became_active":"2023-07-06T22:18:40.212355+0000","last_became_peered":"2023-07-06T22:18:40.212355+0000","last_unstale":"2023-07-06T22:18:41.603940+0000","last_undegraded":"2023-07-06T22:18:41.603940+0000","last_fullsized":"2023-07-06T22:18:41.603940+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:57:50.769521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":334,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603788+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:18:41.603788+0000","last_peered":"2023-07-06T22:18:41.603788+0000","last_clean":"2023-07-06T22:18:41.603788+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:18:41.603788+0000","last_undegraded":"2023-07-06T22:18:41.603788+0000","last_fullsized":"2023-07-06T22:18:41.603788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:44:32.510566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693888+0000","last_change":"2023-07-06T22:18:40.612858+0000","last_active":"2023-07-06T22:18:41.693888+0000","last_peered":"2023-07-06T22:18:41.693888+0000","last_clean":"2023-07-06T22:18:41.693888+0000","last_became_active":"2023-07-06T22:18:40.612606+0000","last_became_peered":"2023-07-06T22:18:40.612606+0000","last_unstale":"2023-07-06T22:18:41.693888+0000","last_undegraded":"2023-07-06T22:18:41.693888+0000","last_fullsized":"2023-07-06T22:18:41.693888+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:41:38.574704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.604077+0000","last_change":"2023-07-06T22:18:40.215791+0000","last_active":"2023-07-06T22:18:41.604077+0000","last_peered":"2023-07-06T22:18:41.604077+0000","last_clean":"2023-07-06T22:18:41.604077+0000","last_became_active":"2023-07-06T22:18:40.215505+0000","last_became_peered":"2023-07-06T22:18:40.215505+0000","last_unstale":"2023-07-06T22:18:41.604077+0000","last_undegraded":"2023-07-06T22:18:41.604077+0000","last_fullsized":"2023-07-06T22:18:41.604077+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:24:27.282030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":294,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694235+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:18:41.694235+0000","last_peered":"2023-07-06T22:18:41.694235+0000","last_clean":"2023-07-06T22:18:41.694235+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:18:41.694235+0000","last_undegraded":"2023-07-06T22:18:41.694235+0000","last_fullsized":"2023-07-06T22:18:41.694235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:09:42.721870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693867+0000","last_change":"2023-07-06T22:18:40.626633+0000","last_active":"2023-07-06T22:18:41.693867+0000","last_peered":"2023-07-06T22:18:41.693867+0000","last_clean":"2023-07-06T22:18:41.693867+0000","last_became_active":"2023-07-06T22:18:40.626343+0000","last_became_peered":"2023-07-06T22:18:40.626343+0000","last_unstale":"2023-07-06T22:18:41.693867+0000","last_undegraded":"2023-07-06T22:18:41.693867+0000","last_fullsized":"2023-07-06T22:18:41.693867+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:31:14.661073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"178'8","reported_seq":21,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693753+0000","last_change":"2023-07-06T22:18:40.212317+0000","last_active":"2023-07-06T22:18:41.693753+0000","last_peered":"2023-07-06T22:18:41.693753+0000","last_clean":"2023-07-06T22:18:41.693753+0000","last_became_active":"2023-07-06T22:18:40.212017+0000","last_became_peered":"2023-07-06T22:18:40.212017+0000","last_unstale":"2023-07-06T22:18:41.693753+0000","last_undegraded":"2023-07-06T22:18:41.693753+0000","last_fullsized":"2023-07-06T22:18:41.693753+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:55:24.276602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":298,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695462+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:18:41.695462+0000","last_peered":"2023-07-06T22:18:41.695462+0000","last_clean":"2023-07-06T22:18:41.695462+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:18:41.695462+0000","last_undegraded":"2023-07-06T22:18:41.695462+0000","last_fullsized":"2023-07-06T22:18:41.695462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:55:50.418871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693627+0000","last_change":"2023-07-06T22:18:40.619843+0000","last_active":"2023-07-06T22:18:41.693627+0000","last_peered":"2023-07-06T22:18:41.693627+0000","last_clean":"2023-07-06T22:18:41.693627+0000","last_became_active":"2023-07-06T22:18:40.619581+0000","last_became_peered":"2023-07-06T22:18:40.619581+0000","last_unstale":"2023-07-06T22:18:41.693627+0000","last_undegraded":"2023-07-06T22:18:41.693627+0000","last_fullsized":"2023-07-06T22:18:41.693627+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:14:56.479769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694771+0000","last_change":"2023-07-06T22:18:40.213447+0000","last_active":"2023-07-06T22:18:41.694771+0000","last_peered":"2023-07-06T22:18:41.694771+0000","last_clean":"2023-07-06T22:18:41.694771+0000","last_became_active":"2023-07-06T22:18:40.213083+0000","last_became_peered":"2023-07-06T22:18:40.213083+0000","last_unstale":"2023-07-06T22:18:41.694771+0000","last_undegraded":"2023-07-06T22:18:41.694771+0000","last_fullsized":"2023-07-06T22:18:41.694771+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:00:43.147752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601882+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:18:41.601882+0000","last_peered":"2023-07-06T22:18:41.601882+0000","last_clean":"2023-07-06T22:18:41.601882+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:18:41.601882+0000","last_undegraded":"2023-07-06T22:18:41.601882+0000","last_fullsized":"2023-07-06T22:18:41.601882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:13:41.423677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694463+0000","last_change":"2023-07-06T22:18:40.618438+0000","last_active":"2023-07-06T22:18:41.694463+0000","last_peered":"2023-07-06T22:18:41.694463+0000","last_clean":"2023-07-06T22:18:41.694463+0000","last_became_active":"2023-07-06T22:18:40.618190+0000","last_became_peered":"2023-07-06T22:18:40.618190+0000","last_unstale":"2023-07-06T22:18:41.694463+0000","last_undegraded":"2023-07-06T22:18:41.694463+0000","last_fullsized":"2023-07-06T22:18:41.694463+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:32:11.987479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694314+0000","last_change":"2023-07-06T22:18:40.210076+0000","last_active":"2023-07-06T22:18:41.694314+0000","last_peered":"2023-07-06T22:18:41.694314+0000","last_clean":"2023-07-06T22:18:41.694314+0000","last_became_active":"2023-07-06T22:18:40.209709+0000","last_became_peered":"2023-07-06T22:18:40.209709+0000","last_unstale":"2023-07-06T22:18:41.694314+0000","last_undegraded":"2023-07-06T22:18:41.694314+0000","last_fullsized":"2023-07-06T22:18:41.694314+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:46.737964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":298,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695378+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:18:41.695378+0000","last_peered":"2023-07-06T22:18:41.695378+0000","last_clean":"2023-07-06T22:18:41.695378+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:18:41.695378+0000","last_undegraded":"2023-07-06T22:18:41.695378+0000","last_fullsized":"2023-07-06T22:18:41.695378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:10:56.285496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694110+0000","last_change":"2023-07-06T22:18:40.619191+0000","last_active":"2023-07-06T22:18:41.694110+0000","last_peered":"2023-07-06T22:18:41.694110+0000","last_clean":"2023-07-06T22:18:41.694110+0000","last_became_active":"2023-07-06T22:18:40.618897+0000","last_became_peered":"2023-07-06T22:18:40.618897+0000","last_unstale":"2023-07-06T22:18:41.694110+0000","last_undegraded":"2023-07-06T22:18:41.694110+0000","last_fullsized":"2023-07-06T22:18:41.694110+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:00:44.159107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"178'2","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695002+0000","last_change":"2023-07-06T22:18:40.215114+0000","last_active":"2023-07-06T22:18:41.695002+0000","last_peered":"2023-07-06T22:18:41.695002+0000","last_clean":"2023-07-06T22:18:41.695002+0000","last_became_active":"2023-07-06T22:18:40.214790+0000","last_became_peered":"2023-07-06T22:18:40.214790+0000","last_unstale":"2023-07-06T22:18:41.695002+0000","last_undegraded":"2023-07-06T22:18:41.695002+0000","last_fullsized":"2023-07-06T22:18:41.695002+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:46.737964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":289,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602546+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:18:41.602546+0000","last_peered":"2023-07-06T22:18:41.602546+0000","last_clean":"2023-07-06T22:18:41.602546+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:18:41.602546+0000","last_undegraded":"2023-07-06T22:18:41.602546+0000","last_fullsized":"2023-07-06T22:18:41.602546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:19:01.154032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575285,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42028,"kb_used_data":2788,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329812,"statfs":{"total":96636764160,"available":96593727488,"internally_reserved":0,"allocated":2854912,"data_stored":1793150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70599999999999996,"15min":0.72699999999999998},"min":{"1min":0.54100000000000004,"5min":0.432,"15min":0.432},"max":{"1min":0.88700000000000001,"5min":0.93300000000000005,"15min":1.0740000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70999999999999996,"15min":0.71499999999999997},"min":{"1min":0.53800000000000003,"5min":0.45700000000000002,"15min":0.42299999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.998},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92700000000000005,"5min":0.98299999999999998,"15min":1.1220000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.58399999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94599999999999995,"5min":1.006,"15min":1.012},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73499999999999999,"15min":0.74399999999999999},"min":{"1min":0.51400000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.016},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.86799999999999999,"5min":0.99299999999999999,"15min":1.149},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.55500000000000005},"min":{"1min":0.39700000000000002,"5min":0.372,"15min":0.36199999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.91300000000000003},"last":0.745},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.443,"5min":0.40799999999999997,"15min":0.39300000000000002},"max":{"1min":0.872,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.59399999999999997},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":1.038},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.495,"5min":0.442,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":0.92400000000000004,"15min":0.995},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.443},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":1.024},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67600000000000005,"15min":0.67700000000000005},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.018},"last":0.77900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575285,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37328,"kb_used_data":2184,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334512,"statfs":{"total":96636764160,"available":96598540288,"internally_reserved":0,"allocated":2236416,"data_stored":1199479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.376},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.7829999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.49399999999999999,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":0.877,"5min":0.95199999999999996,"15min":1.633},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.55300000000000005,"5min":0.46700000000000003,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":1.044,"15min":1.9099999999999999},"last":0.88},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74299999999999999,"15min":0.74099999999999999},"min":{"1min":0.61199999999999999,"5min":0.46600000000000003,"15min":0.438},"max":{"1min":0.85899999999999999,"5min":0.93700000000000006,"15min":0.97799999999999998},"last":0.748}]},{"osd":2,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.45800000000000002},"max":{"1min":0.86699999999999999,"5min":0.93899999999999995,"15min":2.0299999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.56000000000000005,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.58999999999999997,"5min":0.53300000000000003,"15min":0.501},"max":{"1min":0.86399999999999999,"5min":0.97899999999999998,"15min":1.5920000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":0.877,"5min":0.95599999999999996,"15min":1.996},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":1.024,"15min":1.024},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41599999999999998,"15min":0.40999999999999998},"max":{"1min":0.74399999999999999,"5min":0.94999999999999996,"15min":0.996},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.39200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73199999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.48599999999999999,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.83999999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.621,"15min":0.623},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.436},"max":{"1min":0.82399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.45600000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575284,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59480,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312360,"statfs":{"total":96636764160,"available":96575856640,"internally_reserved":0,"allocated":2244608,"data_stored":1201080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.52900000000000003,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.92800000000000005,"5min":0.97199999999999998,"15min":0.999},"last":0.751},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.57899999999999996,"5min":0.51200000000000001,"15min":0.46400000000000002},"max":{"1min":0.92500000000000004,"5min":0.995,"15min":0.995},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.73799999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.43099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.51000000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.3200000000000001},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.443},"max":{"1min":0.998,"5min":0.998,"15min":1.4299999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.67500000000000004,"5min":0.58499999999999996,"15min":0.48199999999999998},"max":{"1min":0.88500000000000001,"5min":0.999,"15min":1.0409999999999999},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.65200000000000002,"5min":0.56699999999999995,"15min":0.46800000000000003},"max":{"1min":0.94399999999999995,"5min":0.996,"15min":1.5169999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.76700000000000002},"min":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.436},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.47799999999999998,"5min":0.39500000000000002,"15min":0.34899999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59799999999999998,"15min":0.61199999999999999},"min":{"1min":0.47599999999999998,"5min":0.432,"15min":0.32600000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.96099999999999997},"last":0.83399999999999996}]},{"osd":6,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.52900000000000003,"5min":0.44700000000000001,"15min":0.39600000000000002},"max":{"1min":0.88,"5min":0.96399999999999997,"15min":0.998},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.42199999999999999},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.96999999999999997},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.38900000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67800000000000005,"15min":0.68500000000000005},"min":{"1min":0.52900000000000003,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":0.83299999999999996,"5min":0.97899999999999998,"15min":0.999},"last":0.84499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575283,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55392,"kb_used_data":2200,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316448,"statfs":{"total":96636764160,"available":96580042752,"internally_reserved":0,"allocated":2252800,"data_stored":1202110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.54500000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84299999999999997,"5min":0.96699999999999997,"15min":0.98999999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.75600000000000001,"15min":0.746},"min":{"1min":0.55700000000000005,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.97299999999999998,"5min":0.97899999999999998,"15min":1.016},"last":0.81899999999999995}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.754,"15min":0.749},"min":{"1min":0.61299999999999999,"5min":0.45200000000000001,"15min":0.38300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74399999999999999,"15min":0.73499999999999999},"min":{"1min":0.58999999999999997,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.99299999999999999,"15min":0.996},"last":0.91300000000000003}]},{"osd":2,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.63800000000000001,"5min":0.53100000000000003,"15min":0.47799999999999998},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":1.0760000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.60299999999999998,"5min":0.51200000000000001,"15min":0.502},"max":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.0580000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.748,"15min":0.73899999999999999},"min":{"1min":0.60099999999999998,"5min":0.51900000000000002,"15min":0.45600000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.98699999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76300000000000001},"min":{"1min":0.61599999999999999,"5min":0.52700000000000002,"15min":0.51900000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":1.03},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83899999999999997,"5min":0.91200000000000003,"15min":0.92600000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.46000000000000002,"5min":0.39900000000000002,"15min":0.39800000000000002},"max":{"1min":0.77100000000000002,"5min":0.95599999999999996,"15min":1.006},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.95899999999999996,"15min":1.0509999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88400000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.86799999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.53000000000000003,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":0.84999999999999998,"5min":0.94799999999999995,"15min":1.0469999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.55000000000000004,"5min":0.432,"15min":0.432},"max":{"1min":0.86699999999999999,"5min":1.0109999999999999,"15min":1.1100000000000001},"last":0.83299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575284,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51284,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320556,"statfs":{"total":96636764160,"available":96584249344,"internally_reserved":0,"allocated":2240512,"data_stored":1200510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68100000000000005,"5min":0.69399999999999995,"15min":0.85899999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50900000000000001,"15min":0.49099999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69799999999999995,"5min":0.72799999999999998,"15min":0.83899999999999997},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61399999999999999,"15min":0.60499999999999998},"min":{"1min":0.442,"5min":0.44,"15min":0.41299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.441}]},{"osd":2,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38700000000000001},"max":{"1min":0.63800000000000001,"5min":0.72399999999999998,"15min":0.875},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.34699999999999998},"max":{"1min":0.71399999999999997,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80300000000000005,"15min":0.77700000000000002},"min":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.441},"max":{"1min":1.0449999999999999,"5min":1.081,"15min":1.474},"last":0.751},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.79200000000000004},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.54600000000000004},"max":{"1min":0.99099999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83099999999999996,"15min":0.81100000000000005},"min":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.57499999999999996},"max":{"1min":1.175,"5min":1.175,"15min":1.3740000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82299999999999995,"15min":0.80300000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.022,"5min":1.228,"15min":1.2330000000000001},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.80200000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.51800000000000002},"max":{"1min":1.1399999999999999,"5min":1.194,"15min":1.3899999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.82999999999999996},"min":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.57299999999999995},"max":{"1min":1.0960000000000001,"5min":1.266,"15min":1.3220000000000001},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.002,"5min":1.121,"15min":1.2210000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84499999999999997,"15min":0.82699999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.244,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.86299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575284,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41428,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330412,"statfs":{"total":96636764160,"available":96594341888,"internally_reserved":0,"allocated":2240512,"data_stored":1200566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.32300000000000001,"15min":0.27800000000000002},"max":{"1min":0.65100000000000002,"5min":0.76100000000000001,"15min":0.88700000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.46100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.70899999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.41899999999999998,"5min":0.35799999999999998,"15min":0.32300000000000001},"max":{"1min":0.74099999999999999,"5min":0.79400000000000004,"15min":0.84099999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.46000000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.68700000000000006,"5min":0.77100000000000002,"15min":0.97099999999999997},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.434,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":0.77200000000000002,"15min":0.997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.499,"5min":0.434,"15min":0.378},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.80400000000000005},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.64900000000000002,"5min":0.56599999999999995,"15min":0.50900000000000001},"max":{"1min":0.98399999999999999,"5min":1.45,"15min":1.45},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.47399999999999998},"max":{"1min":0.90600000000000003,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.67400000000000004,"5min":0.60899999999999999,"15min":0.51100000000000001},"max":{"1min":1.0029999999999999,"5min":1.337,"15min":1.337},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.53000000000000003},"max":{"1min":0.91300000000000003,"5min":1.2490000000000001,"15min":1.2829999999999999},"last":0.745}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83699999999999997,"15min":0.82099999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.54800000000000004},"max":{"1min":1.0900000000000001,"5min":1.367,"15min":1.367},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.83599999999999997,"15min":0.83699999999999997},"min":{"1min":0.63100000000000001,"5min":0.56399999999999995,"15min":0.56100000000000005},"max":{"1min":0.97399999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.85299999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.56999999999999995},"max":{"1min":1.024,"5min":1.407,"15min":1.407},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.85199999999999998,"15min":0.84999999999999998},"min":{"1min":0.64900000000000002,"5min":0.59899999999999998,"15min":0.55600000000000005},"max":{"1min":1.0329999999999999,"5min":1.296,"15min":1.296},"last":0.60799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575285,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59476,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312364,"statfs":{"total":96636764160,"available":96575860736,"internally_reserved":0,"allocated":2240512,"data_stored":1200510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.46600000000000003},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.32900000000000001},"max":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.81699999999999995},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.36899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.94299999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":0.84899999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.018,"5min":1.083,"15min":1.1140000000000001},"last":0.622},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.54200000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0700000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.58399999999999996,"5min":0.57299999999999995,"15min":0.48699999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.21},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81699999999999995,"15min":0.82699999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1100000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82299999999999995,"15min":0.83199999999999996},"min":{"1min":0.61899999999999999,"5min":0.53800000000000003,"15min":0.53600000000000003},"max":{"1min":1.0800000000000001,"5min":1.244,"15min":1.302},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82799999999999996,"15min":0.83299999999999996},"min":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.25,"5min":1.25,"15min":1.3360000000000001},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82599999999999996,"15min":0.83199999999999996},"min":{"1min":0.67100000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0489999999999999,"5min":1.1779999999999999,"15min":1.405},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84999999999999998,"15min":0.84099999999999997},"min":{"1min":0.68200000000000005,"5min":0.57099999999999995,"15min":0.54700000000000004},"max":{"1min":0.97699999999999998,"5min":1.2110000000000001,"15min":1.3779999999999999},"last":0.74299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575284,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37904,"kb_used_data":2760,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333936,"statfs":{"total":96636764160,"available":96597950464,"internally_reserved":0,"allocated":2826240,"data_stored":1789825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.34000000000000002,"5min":0.33600000000000002,"15min":0.312},"max":{"1min":0.749,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.435}]},{"osd":2,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52100000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76100000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.33400000000000002},"max":{"1min":0.65200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.45200000000000001,"5min":0.41099999999999998,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80900000000000005,"15min":0.80600000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.1439999999999999,"5min":1.294,"15min":1.294},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80800000000000005,"15min":0.80300000000000005},"min":{"1min":0.61899999999999999,"5min":0.53500000000000003,"15min":0.50900000000000001},"max":{"1min":1.022,"5min":1.107,"15min":1.3320000000000001},"last":1.0660000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.56000000000000005,"15min":0.48899999999999999},"max":{"1min":1.0569999999999999,"5min":1.345,"15min":1.345},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.63700000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":1.103}]},{"osd":6,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81999999999999995,"15min":0.81399999999999995},"min":{"1min":0.628,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98199999999999998,"5min":1.0049999999999999,"15min":1.153},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.628,"5min":0.59099999999999997,"15min":0.58499999999999996},"max":{"1min":1.036,"5min":1.1910000000000001,"15min":1.272},"last":1.0840000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.82299999999999995,"15min":0.82899999999999996},"min":{"1min":0.64300000000000002,"5min":0.624,"15min":0.57999999999999996},"max":{"1min":1.083,"5min":1.125,"15min":1.26},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.82099999999999995},"min":{"1min":0.67100000000000004,"5min":0.60499999999999998,"15min":0.55700000000000005},"max":{"1min":1.022,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.1220000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:18:49.305 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:18:49.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.456+0000 7fb005337640 1 Processor -- start 2023-07-06T22:18:49.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.460+0000 7fb005337640 1 -- start start 2023-07-06T22:18:49.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.460+0000 7fb005337640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0001587d0 0x7fb000070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:49.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.460+0000 7fb005337640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb0000710c0 0x7fb0000cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:49.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.460+0000 7fb005337640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00006fae0 con 0x7fb000158400 2023-07-06T22:18:49.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.460+0000 7fb005337640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00006fdc0 con 0x7fb0001587d0 2023-07-06T22:18:49.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.460+0000 7fb005337640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0000700a0 con 0x7fb0000710c0 2023-07-06T22:18:49.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.460+0000 7faff7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0001587d0 0x7fb000070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:49.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.460+0000 7faff7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0001587d0 0x7fb000070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37214/0 (socket says 172.21.15.55:37214) 2023-07-06T22:18:49.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.460+0000 7faff7fff640 1 -- 172.21.15.55:0/1314596479 learned_addr learned my addr 172.21.15.55:0/1314596479 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.460+0000 7fafff7fe640 1 --2- 172.21.15.55:0/1314596479 >> v2:172.21.15.138:3300/0 conn(0x7fb0000710c0 0x7fb0000cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.460+0000 7faff7fff640 1 -- 172.21.15.55:0/1314596479 >> v2:172.21.15.138:3300/0 conn(0x7fb0000710c0 msgr2=0x7fb0000cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.460+0000 7faff7fff640 1 --2- 172.21.15.55:0/1314596479 >> v2:172.21.15.138:3300/0 conn(0x7fb0000710c0 0x7fb0000cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.460+0000 7faff7fff640 1 -- 172.21.15.55:0/1314596479 >> v1:172.21.15.138:6789/0 conn(0x7fb000158400 legacy=0x7fb0000c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.460+0000 7faff7fff640 1 -- 172.21.15.55:0/1314596479 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000070380 con 0x7fb0001587d0 2023-07-06T22:18:49.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.464+0000 7faff7fff640 1 --2- 172.21.15.55:0/1314596479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0001587d0 0x7fb000070b80 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7fb0000ca570 tx=0x7fafe801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4546f60d56aa1cc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:49.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.464+0000 7faffe7fc640 1 -- 172.21.15.55:0/1314596479 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe80ac600 con 0x7fb0001587d0 2023-07-06T22:18:49.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.464+0000 7faffe7fc640 1 -- 172.21.15.55:0/1314596479 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe80a8050 con 0x7fb0001587d0 2023-07-06T22:18:49.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.464+0000 7faffe7fc640 1 -- 172.21.15.55:0/1314596479 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe80ac980 con 0x7fb0001587d0 2023-07-06T22:18:49.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.464+0000 7fb005337640 1 -- 172.21.15.55:0/1314596479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0001587d0 msgr2=0x7fb000070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:49.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.464+0000 7fb005337640 1 --2- 172.21.15.55:0/1314596479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0001587d0 0x7fb000070b80 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7fb0000ca570 tx=0x7fafe801c490 comp rx=0 tx=0).stop 2023-07-06T22:18:49.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.464+0000 7fb005337640 1 -- 172.21.15.55:0/1314596479 shutdown_connections 2023-07-06T22:18:49.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.464+0000 7fb005337640 1 --2- 172.21.15.55:0/1314596479 >> v2:172.21.15.138:3300/0 conn(0x7fb0000710c0 0x7fb0000cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.464+0000 7fb005337640 1 --2- 172.21.15.55:0/1314596479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0001587d0 0x7fb000070b80 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.464+0000 7fb005337640 1 -- 172.21.15.55:0/1314596479 >> 172.21.15.55:0/1314596479 conn(0x7fb0000cded0 msgr2=0x7fb0000ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:49.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.464+0000 7fb005337640 1 -- 172.21.15.55:0/1314596479 shutdown_connections 2023-07-06T22:18:49.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.464+0000 7fb005337640 1 -- 172.21.15.55:0/1314596479 wait complete. 2023-07-06T22:18:49.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.464+0000 7fb005337640 1 Processor -- start 2023-07-06T22:18:49.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.464+0000 7fb005337640 1 -- start start 2023-07-06T22:18:49.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7fb005337640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0000710c0 0x7fb0001f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:49.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7fb005337640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb000158400 0x7fb00014f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:49.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7fb005337640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0001587d0 0x7fb00014a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:49.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7fb005337640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000c4fa0 con 0x7fb0000710c0 2023-07-06T22:18:49.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7fb005337640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000c51f0 con 0x7fb0001587d0 2023-07-06T22:18:49.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7fb005337640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000c54d0 con 0x7fb000158400 2023-07-06T22:18:49.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7faffeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0000710c0 0x7fb0001f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:49.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7faffeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0000710c0 0x7fb0001f8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37218/0 (socket says 172.21.15.55:37218) 2023-07-06T22:18:49.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7faffeffd640 1 -- 172.21.15.55:0/2927149612 learned_addr learned my addr 172.21.15.55:0/2927149612 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:49.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7fafff7fe640 1 --2- 172.21.15.55:0/2927149612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0001587d0 0x7fb00014a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:49.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7faff7fff640 1 --2- 172.21.15.55:0/2927149612 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb000158400 0x7fb00014f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:49.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7faffeffd640 1 -- 172.21.15.55:0/2927149612 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb000158400 msgr2=0x7fb00014f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:49.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7faffeffd640 1 --2- 172.21.15.55:0/2927149612 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb000158400 0x7fb00014f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7faffeffd640 1 -- 172.21.15.55:0/2927149612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0001587d0 msgr2=0x7fb00014a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:49.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7faffeffd640 1 --2- 172.21.15.55:0/2927149612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0001587d0 0x7fb00014a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7faffeffd640 1 -- 172.21.15.55:0/2927149612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe80094d0 con 0x7fb0000710c0 2023-07-06T22:18:49.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7faffeffd640 1 --2- 172.21.15.55:0/2927149612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0000710c0 0x7fb0001f8f30 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7faff000c450 tx=0x7faff000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:49.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7faff77fe640 1 -- 172.21.15.55:0/2927149612 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0012830 con 0x7fb0000710c0 2023-07-06T22:18:49.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7faff77fe640 1 -- 172.21.15.55:0/2927149612 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff00129b0 con 0x7fb0000710c0 2023-07-06T22:18:49.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7fb005337640 1 -- 172.21.15.55:0/2927149612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0000c57b0 con 0x7fb0000710c0 2023-07-06T22:18:49.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7faff77fe640 1 -- 172.21.15.55:0/2927149612 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0012d60 con 0x7fb0000710c0 2023-07-06T22:18:49.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7fb005337640 1 -- 172.21.15.55:0/2927149612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0000c5e00 con 0x7fb0000710c0 2023-07-06T22:18:49.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7fb005337640 1 -- 172.21.15.55:0/2927149612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00006c580 con 0x7fb0000710c0 2023-07-06T22:18:49.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.468+0000 7faff77fe640 1 -- 172.21.15.55:0/2927149612 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faff001c460 con 0x7fb0000710c0 2023-07-06T22:18:49.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.472+0000 7faff77fe640 1 --2- 172.21.15.55:0/2927149612 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fafe00663a0 0x7fafe0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:49.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.472+0000 7faff77fe640 1 -- 172.21.15.55:0/2927149612 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7faff0083d10 con 0x7fb0000710c0 2023-07-06T22:18:49.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.472+0000 7faff7fff640 1 --2- 172.21.15.55:0/2927149612 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fafe00663a0 0x7fafe0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:49.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.472+0000 7faff7fff640 1 --2- 172.21.15.55:0/2927149612 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fafe00663a0 0x7fafe0068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fafe80ae000 tx=0x7fafe80a7000 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:49.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.476+0000 7faff77fe640 1 -- 172.21.15.55:0/2927149612 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faff0050fd0 con 0x7fb0000710c0 2023-07-06T22:18:49.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.628+0000 7fb005337640 1 -- 172.21.15.55:0/2927149612 --> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0000cc3f0 con 0x7fafe00663a0 2023-07-06T22:18:49.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.636+0000 7faff77fe640 1 -- 172.21.15.55:0/2927149612 <== mgr.10167 v2:172.21.15.55:6832/957337795 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311982 (secure 0 0 0) 0x7fafe80ac6e0 con 0x7fafe00663a0 2023-07-06T22:18:49.640 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:18:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.640+0000 7fb005337640 1 -- 172.21.15.55:0/2927149612 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fafe00663a0 msgr2=0x7fafe0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.640+0000 7fb005337640 1 --2- 172.21.15.55:0/2927149612 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fafe00663a0 0x7fafe0068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fafe80ae000 tx=0x7fafe80a7000 comp rx=0 tx=0).stop 2023-07-06T22:18:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.640+0000 7fb005337640 1 -- 172.21.15.55:0/2927149612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0000710c0 msgr2=0x7fb0001f8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.640+0000 7fb005337640 1 --2- 172.21.15.55:0/2927149612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0000710c0 0x7fb0001f8f30 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7faff000c450 tx=0x7faff000c910 comp rx=0 tx=0).stop 2023-07-06T22:18:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.640+0000 7fb005337640 1 -- 172.21.15.55:0/2927149612 shutdown_connections 2023-07-06T22:18:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.640+0000 7fb005337640 1 --2- 172.21.15.55:0/2927149612 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fafe00663a0 0x7fafe0068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.640+0000 7fb005337640 1 --2- 172.21.15.55:0/2927149612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0001587d0 0x7fb00014a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.640+0000 7fb005337640 1 --2- 172.21.15.55:0/2927149612 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb000158400 0x7fb00014f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.640+0000 7fb005337640 1 --2- 172.21.15.55:0/2927149612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0000710c0 0x7fb0001f8f30 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.640+0000 7fb005337640 1 -- 172.21.15.55:0/2927149612 >> 172.21.15.55:0/2927149612 conn(0x7fb0000cded0 msgr2=0x7fb000156ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.640+0000 7fb005337640 1 -- 172.21.15.55:0/2927149612 shutdown_connections 2023-07-06T22:18:49.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.640+0000 7fb005337640 1 -- 172.21.15.55:0/2927149612 wait complete. 2023-07-06T22:18:49.660 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-06T22:18:49.577313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":544,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":384320,"kb_used_data":18688,"kb_used_omap":0,"kb_used_meta":365568,"kb_avail":754590400,"statfs":{"total":773094113280,"available":772700569600,"internally_reserved":0,"allocated":19136512,"data_stored":10787230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":374341632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.980614"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602264+0000","last_change":"2023-07-06T22:18:40.619046+0000","last_active":"2023-07-06T22:18:41.602264+0000","last_peered":"2023-07-06T22:18:41.602264+0000","last_clean":"2023-07-06T22:18:41.602264+0000","last_became_active":"2023-07-06T22:18:40.618761+0000","last_became_peered":"2023-07-06T22:18:40.618761+0000","last_unstale":"2023-07-06T22:18:41.602264+0000","last_undegraded":"2023-07-06T22:18:41.602264+0000","last_fullsized":"2023-07-06T22:18:41.602264+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:11:15.279437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602116+0000","last_change":"2023-07-06T22:18:40.622434+0000","last_active":"2023-07-06T22:18:41.602116+0000","last_peered":"2023-07-06T22:18:41.602116+0000","last_clean":"2023-07-06T22:18:41.602116+0000","last_became_active":"2023-07-06T22:18:40.622126+0000","last_became_peered":"2023-07-06T22:18:40.622126+0000","last_unstale":"2023-07-06T22:18:41.602116+0000","last_undegraded":"2023-07-06T22:18:41.602116+0000","last_fullsized":"2023-07-06T22:18:41.602116+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:22:22.611378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694475+0000","last_change":"2023-07-06T22:18:40.615518+0000","last_active":"2023-07-06T22:18:41.694475+0000","last_peered":"2023-07-06T22:18:41.694475+0000","last_clean":"2023-07-06T22:18:41.694475+0000","last_became_active":"2023-07-06T22:18:40.615079+0000","last_became_peered":"2023-07-06T22:18:40.615079+0000","last_unstale":"2023-07-06T22:18:41.694475+0000","last_undegraded":"2023-07-06T22:18:41.694475+0000","last_fullsized":"2023-07-06T22:18:41.694475+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:11:25.158510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695211+0000","last_change":"2023-07-06T22:18:40.615480+0000","last_active":"2023-07-06T22:18:41.695211+0000","last_peered":"2023-07-06T22:18:41.695211+0000","last_clean":"2023-07-06T22:18:41.695211+0000","last_became_active":"2023-07-06T22:18:40.611708+0000","last_became_peered":"2023-07-06T22:18:40.611708+0000","last_unstale":"2023-07-06T22:18:41.695211+0000","last_undegraded":"2023-07-06T22:18:41.695211+0000","last_fullsized":"2023-07-06T22:18:41.695211+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:44:32.856437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601493+0000","last_change":"2023-07-06T22:18:40.615344+0000","last_active":"2023-07-06T22:18:41.601493+0000","last_peered":"2023-07-06T22:18:41.601493+0000","last_clean":"2023-07-06T22:18:41.601493+0000","last_became_active":"2023-07-06T22:18:40.614932+0000","last_became_peered":"2023-07-06T22:18:40.614932+0000","last_unstale":"2023-07-06T22:18:41.601493+0000","last_undegraded":"2023-07-06T22:18:41.601493+0000","last_fullsized":"2023-07-06T22:18:41.601493+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:10:12.209969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603869+0000","last_change":"2023-07-06T22:18:40.620843+0000","last_active":"2023-07-06T22:18:41.603869+0000","last_peered":"2023-07-06T22:18:41.603869+0000","last_clean":"2023-07-06T22:18:41.603869+0000","last_became_active":"2023-07-06T22:18:40.620587+0000","last_became_peered":"2023-07-06T22:18:40.620587+0000","last_unstale":"2023-07-06T22:18:41.603869+0000","last_undegraded":"2023-07-06T22:18:41.603869+0000","last_fullsized":"2023-07-06T22:18:41.603869+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:25:46.061549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694628+0000","last_change":"2023-07-06T22:18:40.622331+0000","last_active":"2023-07-06T22:18:41.694628+0000","last_peered":"2023-07-06T22:18:41.694628+0000","last_clean":"2023-07-06T22:18:41.694628+0000","last_became_active":"2023-07-06T22:18:40.622045+0000","last_became_peered":"2023-07-06T22:18:40.622045+0000","last_unstale":"2023-07-06T22:18:41.694628+0000","last_undegraded":"2023-07-06T22:18:41.694628+0000","last_fullsized":"2023-07-06T22:18:41.694628+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:06:01.965819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.600844+0000","last_change":"2023-07-06T22:18:40.614091+0000","last_active":"2023-07-06T22:18:41.600844+0000","last_peered":"2023-07-06T22:18:41.600844+0000","last_clean":"2023-07-06T22:18:41.600844+0000","last_became_active":"2023-07-06T22:18:40.613811+0000","last_became_peered":"2023-07-06T22:18:40.613811+0000","last_unstale":"2023-07-06T22:18:41.600844+0000","last_undegraded":"2023-07-06T22:18:41.600844+0000","last_fullsized":"2023-07-06T22:18:41.600844+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:23:08.769778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602524+0000","last_change":"2023-07-06T22:18:40.622433+0000","last_active":"2023-07-06T22:18:41.602524+0000","last_peered":"2023-07-06T22:18:41.602524+0000","last_clean":"2023-07-06T22:18:41.602524+0000","last_became_active":"2023-07-06T22:18:40.622129+0000","last_became_peered":"2023-07-06T22:18:40.622129+0000","last_unstale":"2023-07-06T22:18:41.602524+0000","last_undegraded":"2023-07-06T22:18:41.602524+0000","last_fullsized":"2023-07-06T22:18:41.602524+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:35:05.710693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602253+0000","last_change":"2023-07-06T22:18:40.633713+0000","last_active":"2023-07-06T22:18:41.602253+0000","last_peered":"2023-07-06T22:18:41.602253+0000","last_clean":"2023-07-06T22:18:41.602253+0000","last_became_active":"2023-07-06T22:18:40.632752+0000","last_became_peered":"2023-07-06T22:18:40.632752+0000","last_unstale":"2023-07-06T22:18:41.602253+0000","last_undegraded":"2023-07-06T22:18:41.602253+0000","last_fullsized":"2023-07-06T22:18:41.602253+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:11:46.109599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602554+0000","last_change":"2023-07-06T22:18:40.615776+0000","last_active":"2023-07-06T22:18:41.602554+0000","last_peered":"2023-07-06T22:18:41.602554+0000","last_clean":"2023-07-06T22:18:41.602554+0000","last_became_active":"2023-07-06T22:18:40.615299+0000","last_became_peered":"2023-07-06T22:18:40.615299+0000","last_unstale":"2023-07-06T22:18:41.602554+0000","last_undegraded":"2023-07-06T22:18:41.602554+0000","last_fullsized":"2023-07-06T22:18:41.602554+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:49:55.005238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602093+0000","last_change":"2023-07-06T22:18:40.633984+0000","last_active":"2023-07-06T22:18:41.602093+0000","last_peered":"2023-07-06T22:18:41.602093+0000","last_clean":"2023-07-06T22:18:41.602093+0000","last_became_active":"2023-07-06T22:18:40.633710+0000","last_became_peered":"2023-07-06T22:18:40.633710+0000","last_unstale":"2023-07-06T22:18:41.602093+0000","last_undegraded":"2023-07-06T22:18:41.602093+0000","last_fullsized":"2023-07-06T22:18:41.602093+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:34:57.771639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694382+0000","last_change":"2023-07-06T22:18:40.621277+0000","last_active":"2023-07-06T22:18:41.694382+0000","last_peered":"2023-07-06T22:18:41.694382+0000","last_clean":"2023-07-06T22:18:41.694382+0000","last_became_active":"2023-07-06T22:18:40.620710+0000","last_became_peered":"2023-07-06T22:18:40.620710+0000","last_unstale":"2023-07-06T22:18:41.694382+0000","last_undegraded":"2023-07-06T22:18:41.694382+0000","last_fullsized":"2023-07-06T22:18:41.694382+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:47:32.078722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694010+0000","last_change":"2023-07-06T22:18:40.621840+0000","last_active":"2023-07-06T22:18:41.694010+0000","last_peered":"2023-07-06T22:18:41.694010+0000","last_clean":"2023-07-06T22:18:41.694010+0000","last_became_active":"2023-07-06T22:18:40.621504+0000","last_became_peered":"2023-07-06T22:18:40.621504+0000","last_unstale":"2023-07-06T22:18:41.694010+0000","last_undegraded":"2023-07-06T22:18:41.694010+0000","last_fullsized":"2023-07-06T22:18:41.694010+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:44:32.856437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601189+0000","last_change":"2023-07-06T22:18:40.624495+0000","last_active":"2023-07-06T22:18:41.601189+0000","last_peered":"2023-07-06T22:18:41.601189+0000","last_clean":"2023-07-06T22:18:41.601189+0000","last_became_active":"2023-07-06T22:18:40.624127+0000","last_became_peered":"2023-07-06T22:18:40.624127+0000","last_unstale":"2023-07-06T22:18:41.601189+0000","last_undegraded":"2023-07-06T22:18:41.601189+0000","last_fullsized":"2023-07-06T22:18:41.601189+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:10:48.494329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694034+0000","last_change":"2023-07-06T22:18:40.624044+0000","last_active":"2023-07-06T22:18:41.694034+0000","last_peered":"2023-07-06T22:18:41.694034+0000","last_clean":"2023-07-06T22:18:41.694034+0000","last_became_active":"2023-07-06T22:18:40.623766+0000","last_became_peered":"2023-07-06T22:18:40.623766+0000","last_unstale":"2023-07-06T22:18:41.694034+0000","last_undegraded":"2023-07-06T22:18:41.694034+0000","last_fullsized":"2023-07-06T22:18:41.694034+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:13:58.833359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.604036+0000","last_change":"2023-07-06T22:18:40.619171+0000","last_active":"2023-07-06T22:18:41.604036+0000","last_peered":"2023-07-06T22:18:41.604036+0000","last_clean":"2023-07-06T22:18:41.604036+0000","last_became_active":"2023-07-06T22:18:40.618882+0000","last_became_peered":"2023-07-06T22:18:40.618882+0000","last_unstale":"2023-07-06T22:18:41.604036+0000","last_undegraded":"2023-07-06T22:18:41.604036+0000","last_fullsized":"2023-07-06T22:18:41.604036+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:16:50.549237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694311+0000","last_change":"2023-07-06T22:18:40.627327+0000","last_active":"2023-07-06T22:18:41.694311+0000","last_peered":"2023-07-06T22:18:41.694311+0000","last_clean":"2023-07-06T22:18:41.694311+0000","last_became_active":"2023-07-06T22:18:40.626829+0000","last_became_peered":"2023-07-06T22:18:40.626829+0000","last_unstale":"2023-07-06T22:18:41.694311+0000","last_undegraded":"2023-07-06T22:18:41.694311+0000","last_fullsized":"2023-07-06T22:18:41.694311+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:05:01.147715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.604077+0000","last_change":"2023-07-06T22:18:40.613776+0000","last_active":"2023-07-06T22:18:41.604077+0000","last_peered":"2023-07-06T22:18:41.604077+0000","last_clean":"2023-07-06T22:18:41.604077+0000","last_became_active":"2023-07-06T22:18:40.613521+0000","last_became_peered":"2023-07-06T22:18:40.613521+0000","last_unstale":"2023-07-06T22:18:41.604077+0000","last_undegraded":"2023-07-06T22:18:41.604077+0000","last_fullsized":"2023-07-06T22:18:41.604077+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:05:11.005961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694178+0000","last_change":"2023-07-06T22:18:40.621667+0000","last_active":"2023-07-06T22:18:41.694178+0000","last_peered":"2023-07-06T22:18:41.694178+0000","last_clean":"2023-07-06T22:18:41.694178+0000","last_became_active":"2023-07-06T22:18:40.621378+0000","last_became_peered":"2023-07-06T22:18:40.621378+0000","last_unstale":"2023-07-06T22:18:41.694178+0000","last_undegraded":"2023-07-06T22:18:41.694178+0000","last_fullsized":"2023-07-06T22:18:41.694178+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:52.122067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603997+0000","last_change":"2023-07-06T22:18:40.617574+0000","last_active":"2023-07-06T22:18:41.603997+0000","last_peered":"2023-07-06T22:18:41.603997+0000","last_clean":"2023-07-06T22:18:41.603997+0000","last_became_active":"2023-07-06T22:18:40.617289+0000","last_became_peered":"2023-07-06T22:18:40.617289+0000","last_unstale":"2023-07-06T22:18:41.603997+0000","last_undegraded":"2023-07-06T22:18:41.603997+0000","last_fullsized":"2023-07-06T22:18:41.603997+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:57:51.574290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601267+0000","last_change":"2023-07-06T22:18:40.619336+0000","last_active":"2023-07-06T22:18:41.601267+0000","last_peered":"2023-07-06T22:18:41.601267+0000","last_clean":"2023-07-06T22:18:41.601267+0000","last_became_active":"2023-07-06T22:18:40.618959+0000","last_became_peered":"2023-07-06T22:18:40.618959+0000","last_unstale":"2023-07-06T22:18:41.601267+0000","last_undegraded":"2023-07-06T22:18:41.601267+0000","last_fullsized":"2023-07-06T22:18:41.601267+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:33:52.364994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603633+0000","last_change":"2023-07-06T22:18:40.622269+0000","last_active":"2023-07-06T22:18:41.603633+0000","last_peered":"2023-07-06T22:18:41.603633+0000","last_clean":"2023-07-06T22:18:41.603633+0000","last_became_active":"2023-07-06T22:18:40.621564+0000","last_became_peered":"2023-07-06T22:18:40.621564+0000","last_unstale":"2023-07-06T22:18:41.603633+0000","last_undegraded":"2023-07-06T22:18:41.603633+0000","last_fullsized":"2023-07-06T22:18:41.603633+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:05:00.389094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.600903+0000","last_change":"2023-07-06T22:18:40.618312+0000","last_active":"2023-07-06T22:18:41.600903+0000","last_peered":"2023-07-06T22:18:41.600903+0000","last_clean":"2023-07-06T22:18:41.600903+0000","last_became_active":"2023-07-06T22:18:40.618040+0000","last_became_peered":"2023-07-06T22:18:40.618040+0000","last_unstale":"2023-07-06T22:18:41.600903+0000","last_undegraded":"2023-07-06T22:18:41.600903+0000","last_fullsized":"2023-07-06T22:18:41.600903+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:37:58.481410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694622+0000","last_change":"2023-07-06T22:18:40.617300+0000","last_active":"2023-07-06T22:18:41.694622+0000","last_peered":"2023-07-06T22:18:41.694622+0000","last_clean":"2023-07-06T22:18:41.694622+0000","last_became_active":"2023-07-06T22:18:40.616898+0000","last_became_peered":"2023-07-06T22:18:40.616898+0000","last_unstale":"2023-07-06T22:18:41.694622+0000","last_undegraded":"2023-07-06T22:18:41.694622+0000","last_fullsized":"2023-07-06T22:18:41.694622+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:45:57.831511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694373+0000","last_change":"2023-07-06T22:18:40.629624+0000","last_active":"2023-07-06T22:18:41.694373+0000","last_peered":"2023-07-06T22:18:41.694373+0000","last_clean":"2023-07-06T22:18:41.694373+0000","last_became_active":"2023-07-06T22:18:40.629342+0000","last_became_peered":"2023-07-06T22:18:40.629342+0000","last_unstale":"2023-07-06T22:18:41.694373+0000","last_undegraded":"2023-07-06T22:18:41.694373+0000","last_fullsized":"2023-07-06T22:18:41.694373+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:40:59.122565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694718+0000","last_change":"2023-07-06T22:18:40.619299+0000","last_active":"2023-07-06T22:18:41.694718+0000","last_peered":"2023-07-06T22:18:41.694718+0000","last_clean":"2023-07-06T22:18:41.694718+0000","last_became_active":"2023-07-06T22:18:40.619008+0000","last_became_peered":"2023-07-06T22:18:40.619008+0000","last_unstale":"2023-07-06T22:18:41.694718+0000","last_undegraded":"2023-07-06T22:18:41.694718+0000","last_fullsized":"2023-07-06T22:18:41.694718+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:20:34.202966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695223+0000","last_change":"2023-07-06T22:18:40.605088+0000","last_active":"2023-07-06T22:18:41.695223+0000","last_peered":"2023-07-06T22:18:41.695223+0000","last_clean":"2023-07-06T22:18:41.695223+0000","last_became_active":"2023-07-06T22:18:40.604767+0000","last_became_peered":"2023-07-06T22:18:40.604767+0000","last_unstale":"2023-07-06T22:18:41.695223+0000","last_undegraded":"2023-07-06T22:18:41.695223+0000","last_fullsized":"2023-07-06T22:18:41.695223+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:58:08.638100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694464+0000","last_change":"2023-07-06T22:18:40.624965+0000","last_active":"2023-07-06T22:18:41.694464+0000","last_peered":"2023-07-06T22:18:41.694464+0000","last_clean":"2023-07-06T22:18:41.694464+0000","last_became_active":"2023-07-06T22:18:40.624702+0000","last_became_peered":"2023-07-06T22:18:40.624702+0000","last_unstale":"2023-07-06T22:18:41.694464+0000","last_undegraded":"2023-07-06T22:18:41.694464+0000","last_fullsized":"2023-07-06T22:18:41.694464+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:32:26.212096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693791+0000","last_change":"2023-07-06T22:18:40.614028+0000","last_active":"2023-07-06T22:18:41.693791+0000","last_peered":"2023-07-06T22:18:41.693791+0000","last_clean":"2023-07-06T22:18:41.693791+0000","last_became_active":"2023-07-06T22:18:40.613764+0000","last_became_peered":"2023-07-06T22:18:40.613764+0000","last_unstale":"2023-07-06T22:18:41.693791+0000","last_undegraded":"2023-07-06T22:18:41.693791+0000","last_fullsized":"2023-07-06T22:18:41.693791+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:57:26.538295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693789+0000","last_change":"2023-07-06T22:18:40.619882+0000","last_active":"2023-07-06T22:18:41.693789+0000","last_peered":"2023-07-06T22:18:41.693789+0000","last_clean":"2023-07-06T22:18:41.693789+0000","last_became_active":"2023-07-06T22:18:40.619604+0000","last_became_peered":"2023-07-06T22:18:40.619604+0000","last_unstale":"2023-07-06T22:18:41.693789+0000","last_undegraded":"2023-07-06T22:18:41.693789+0000","last_fullsized":"2023-07-06T22:18:41.693789+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:44:53.694217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693650+0000","last_change":"2023-07-06T22:18:40.626673+0000","last_active":"2023-07-06T22:18:41.693650+0000","last_peered":"2023-07-06T22:18:41.693650+0000","last_clean":"2023-07-06T22:18:41.693650+0000","last_became_active":"2023-07-06T22:18:40.626346+0000","last_became_peered":"2023-07-06T22:18:40.626346+0000","last_unstale":"2023-07-06T22:18:41.693650+0000","last_undegraded":"2023-07-06T22:18:41.693650+0000","last_fullsized":"2023-07-06T22:18:41.693650+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:23:31.357105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694449+0000","last_change":"2023-07-06T22:18:40.629661+0000","last_active":"2023-07-06T22:18:41.694449+0000","last_peered":"2023-07-06T22:18:41.694449+0000","last_clean":"2023-07-06T22:18:41.694449+0000","last_became_active":"2023-07-06T22:18:40.629390+0000","last_became_peered":"2023-07-06T22:18:40.629390+0000","last_unstale":"2023-07-06T22:18:41.694449+0000","last_undegraded":"2023-07-06T22:18:41.694449+0000","last_fullsized":"2023-07-06T22:18:41.694449+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:49:30.649897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"178'4","reported_seq":17,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602302+0000","last_change":"2023-07-06T22:18:40.219577+0000","last_active":"2023-07-06T22:18:41.602302+0000","last_peered":"2023-07-06T22:18:41.602302+0000","last_clean":"2023-07-06T22:18:41.602302+0000","last_became_active":"2023-07-06T22:18:40.219247+0000","last_became_peered":"2023-07-06T22:18:40.219247+0000","last_unstale":"2023-07-06T22:18:41.602302+0000","last_undegraded":"2023-07-06T22:18:41.602302+0000","last_fullsized":"2023-07-06T22:18:41.602302+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:42:01.304903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694995+0000","last_change":"2023-07-06T22:18:40.613131+0000","last_active":"2023-07-06T22:18:41.694995+0000","last_peered":"2023-07-06T22:18:41.694995+0000","last_clean":"2023-07-06T22:18:41.694995+0000","last_became_active":"2023-07-06T22:18:40.612785+0000","last_became_peered":"2023-07-06T22:18:40.612785+0000","last_unstale":"2023-07-06T22:18:41.694995+0000","last_undegraded":"2023-07-06T22:18:41.694995+0000","last_fullsized":"2023-07-06T22:18:41.694995+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:46.824254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"178'1","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694547+0000","last_change":"2023-07-06T22:18:40.209903+0000","last_active":"2023-07-06T22:18:41.694547+0000","last_peered":"2023-07-06T22:18:41.694547+0000","last_clean":"2023-07-06T22:18:41.694547+0000","last_became_active":"2023-07-06T22:18:40.209589+0000","last_became_peered":"2023-07-06T22:18:40.209589+0000","last_unstale":"2023-07-06T22:18:41.694547+0000","last_undegraded":"2023-07-06T22:18:41.694547+0000","last_fullsized":"2023-07-06T22:18:41.694547+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:58:13.259513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.604096+0000","last_change":"2023-07-06T22:18:40.618425+0000","last_active":"2023-07-06T22:18:41.604096+0000","last_peered":"2023-07-06T22:18:41.604096+0000","last_clean":"2023-07-06T22:18:41.604096+0000","last_became_active":"2023-07-06T22:18:40.618111+0000","last_became_peered":"2023-07-06T22:18:40.618111+0000","last_unstale":"2023-07-06T22:18:41.604096+0000","last_undegraded":"2023-07-06T22:18:41.604096+0000","last_fullsized":"2023-07-06T22:18:41.604096+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:13:04.802646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"178'2","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695085+0000","last_change":"2023-07-06T22:18:40.213653+0000","last_active":"2023-07-06T22:18:41.695085+0000","last_peered":"2023-07-06T22:18:41.695085+0000","last_clean":"2023-07-06T22:18:41.695085+0000","last_became_active":"2023-07-06T22:18:40.212652+0000","last_became_peered":"2023-07-06T22:18:40.212652+0000","last_unstale":"2023-07-06T22:18:41.695085+0000","last_undegraded":"2023-07-06T22:18:41.695085+0000","last_fullsized":"2023-07-06T22:18:41.695085+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:03:03.678489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694882+0000","last_change":"2023-07-06T22:18:40.624075+0000","last_active":"2023-07-06T22:18:41.694882+0000","last_peered":"2023-07-06T22:18:41.694882+0000","last_clean":"2023-07-06T22:18:41.694882+0000","last_became_active":"2023-07-06T22:18:40.623794+0000","last_became_peered":"2023-07-06T22:18:40.623794+0000","last_unstale":"2023-07-06T22:18:41.694882+0000","last_undegraded":"2023-07-06T22:18:41.694882+0000","last_fullsized":"2023-07-06T22:18:41.694882+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:41:27.625614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"178'2","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695323+0000","last_change":"2023-07-06T22:18:40.215990+0000","last_active":"2023-07-06T22:18:41.695323+0000","last_peered":"2023-07-06T22:18:41.695323+0000","last_clean":"2023-07-06T22:18:41.695323+0000","last_became_active":"2023-07-06T22:18:40.215653+0000","last_became_peered":"2023-07-06T22:18:40.215653+0000","last_unstale":"2023-07-06T22:18:41.695323+0000","last_undegraded":"2023-07-06T22:18:41.695323+0000","last_fullsized":"2023-07-06T22:18:41.695323+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:46:17.503741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694139+0000","last_change":"2023-07-06T22:18:40.617672+0000","last_active":"2023-07-06T22:18:41.694139+0000","last_peered":"2023-07-06T22:18:41.694139+0000","last_clean":"2023-07-06T22:18:41.694139+0000","last_became_active":"2023-07-06T22:18:40.617284+0000","last_became_peered":"2023-07-06T22:18:40.617284+0000","last_unstale":"2023-07-06T22:18:41.694139+0000","last_undegraded":"2023-07-06T22:18:41.694139+0000","last_fullsized":"2023-07-06T22:18:41.694139+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:15:14.236169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"178'1","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694496+0000","last_change":"2023-07-06T22:18:40.212574+0000","last_active":"2023-07-06T22:18:41.694496+0000","last_peered":"2023-07-06T22:18:41.694496+0000","last_clean":"2023-07-06T22:18:41.694496+0000","last_became_active":"2023-07-06T22:18:40.212315+0000","last_became_peered":"2023-07-06T22:18:40.212315+0000","last_unstale":"2023-07-06T22:18:41.694496+0000","last_undegraded":"2023-07-06T22:18:41.694496+0000","last_fullsized":"2023-07-06T22:18:41.694496+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:14:28.373999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695020+0000","last_change":"2023-07-06T22:18:40.625890+0000","last_active":"2023-07-06T22:18:41.695020+0000","last_peered":"2023-07-06T22:18:41.695020+0000","last_clean":"2023-07-06T22:18:41.695020+0000","last_became_active":"2023-07-06T22:18:40.625402+0000","last_became_peered":"2023-07-06T22:18:40.625402+0000","last_unstale":"2023-07-06T22:18:41.695020+0000","last_undegraded":"2023-07-06T22:18:41.695020+0000","last_fullsized":"2023-07-06T22:18:41.695020+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:05:01.147715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"178'1","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694806+0000","last_change":"2023-07-06T22:18:40.216636+0000","last_active":"2023-07-06T22:18:41.694806+0000","last_peered":"2023-07-06T22:18:41.694806+0000","last_clean":"2023-07-06T22:18:41.694806+0000","last_became_active":"2023-07-06T22:18:40.215764+0000","last_became_peered":"2023-07-06T22:18:40.215764+0000","last_unstale":"2023-07-06T22:18:41.694806+0000","last_undegraded":"2023-07-06T22:18:41.694806+0000","last_fullsized":"2023-07-06T22:18:41.694806+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:24:17.321033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693626+0000","last_change":"2023-07-06T22:18:40.614321+0000","last_active":"2023-07-06T22:18:41.693626+0000","last_peered":"2023-07-06T22:18:41.693626+0000","last_clean":"2023-07-06T22:18:41.693626+0000","last_became_active":"2023-07-06T22:18:40.614020+0000","last_became_peered":"2023-07-06T22:18:40.614020+0000","last_unstale":"2023-07-06T22:18:41.693626+0000","last_undegraded":"2023-07-06T22:18:41.693626+0000","last_fullsized":"2023-07-06T22:18:41.693626+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:11:36.944945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.600881+0000","last_change":"2023-07-06T22:18:40.214485+0000","last_active":"2023-07-06T22:18:41.600881+0000","last_peered":"2023-07-06T22:18:41.600881+0000","last_clean":"2023-07-06T22:18:41.600881+0000","last_became_active":"2023-07-06T22:18:40.214068+0000","last_became_peered":"2023-07-06T22:18:40.214068+0000","last_unstale":"2023-07-06T22:18:41.600881+0000","last_undegraded":"2023-07-06T22:18:41.600881+0000","last_fullsized":"2023-07-06T22:18:41.600881+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:56:56.728072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603706+0000","last_change":"2023-07-06T22:18:40.617123+0000","last_active":"2023-07-06T22:18:41.603706+0000","last_peered":"2023-07-06T22:18:41.603706+0000","last_clean":"2023-07-06T22:18:41.603706+0000","last_became_active":"2023-07-06T22:18:40.616855+0000","last_became_peered":"2023-07-06T22:18:40.616855+0000","last_unstale":"2023-07-06T22:18:41.603706+0000","last_undegraded":"2023-07-06T22:18:41.603706+0000","last_fullsized":"2023-07-06T22:18:41.603706+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:11:47.675157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694308+0000","last_change":"2023-07-06T22:18:40.209594+0000","last_active":"2023-07-06T22:18:41.694308+0000","last_peered":"2023-07-06T22:18:41.694308+0000","last_clean":"2023-07-06T22:18:41.694308+0000","last_became_active":"2023-07-06T22:18:40.209290+0000","last_became_peered":"2023-07-06T22:18:40.209290+0000","last_unstale":"2023-07-06T22:18:41.694308+0000","last_undegraded":"2023-07-06T22:18:41.694308+0000","last_fullsized":"2023-07-06T22:18:41.694308+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:35:17.197785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695297+0000","last_change":"2023-07-06T22:18:40.622755+0000","last_active":"2023-07-06T22:18:41.695297+0000","last_peered":"2023-07-06T22:18:41.695297+0000","last_clean":"2023-07-06T22:18:41.695297+0000","last_became_active":"2023-07-06T22:18:40.622505+0000","last_became_peered":"2023-07-06T22:18:40.622505+0000","last_unstale":"2023-07-06T22:18:41.695297+0000","last_undegraded":"2023-07-06T22:18:41.695297+0000","last_fullsized":"2023-07-06T22:18:41.695297+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:01:10.604990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"178'1","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694772+0000","last_change":"2023-07-06T22:18:40.214105+0000","last_active":"2023-07-06T22:18:41.694772+0000","last_peered":"2023-07-06T22:18:41.694772+0000","last_clean":"2023-07-06T22:18:41.694772+0000","last_became_active":"2023-07-06T22:18:40.212860+0000","last_became_peered":"2023-07-06T22:18:40.212860+0000","last_unstale":"2023-07-06T22:18:41.694772+0000","last_undegraded":"2023-07-06T22:18:41.694772+0000","last_fullsized":"2023-07-06T22:18:41.694772+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:29:49.668805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694029+0000","last_change":"2023-07-06T22:18:40.610823+0000","last_active":"2023-07-06T22:18:41.694029+0000","last_peered":"2023-07-06T22:18:41.694029+0000","last_clean":"2023-07-06T22:18:41.694029+0000","last_became_active":"2023-07-06T22:18:40.610524+0000","last_became_peered":"2023-07-06T22:18:40.610524+0000","last_unstale":"2023-07-06T22:18:41.694029+0000","last_undegraded":"2023-07-06T22:18:41.694029+0000","last_fullsized":"2023-07-06T22:18:41.694029+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:14:56.479769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"178'2","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694614+0000","last_change":"2023-07-06T22:18:40.216143+0000","last_active":"2023-07-06T22:18:41.694614+0000","last_peered":"2023-07-06T22:18:41.694614+0000","last_clean":"2023-07-06T22:18:41.694614+0000","last_became_active":"2023-07-06T22:18:40.215878+0000","last_became_peered":"2023-07-06T22:18:40.215878+0000","last_unstale":"2023-07-06T22:18:41.694614+0000","last_undegraded":"2023-07-06T22:18:41.694614+0000","last_fullsized":"2023-07-06T22:18:41.694614+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:23:47.642095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695358+0000","last_change":"2023-07-06T22:18:40.620304+0000","last_active":"2023-07-06T22:18:41.695358+0000","last_peered":"2023-07-06T22:18:41.695358+0000","last_clean":"2023-07-06T22:18:41.695358+0000","last_became_active":"2023-07-06T22:18:40.618482+0000","last_became_peered":"2023-07-06T22:18:40.618482+0000","last_unstale":"2023-07-06T22:18:41.695358+0000","last_undegraded":"2023-07-06T22:18:41.695358+0000","last_fullsized":"2023-07-06T22:18:41.695358+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:52.122067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"178'1","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601864+0000","last_change":"2023-07-06T22:18:40.221602+0000","last_active":"2023-07-06T22:18:41.601864+0000","last_peered":"2023-07-06T22:18:41.601864+0000","last_clean":"2023-07-06T22:18:41.601864+0000","last_became_active":"2023-07-06T22:18:40.221337+0000","last_became_peered":"2023-07-06T22:18:40.221337+0000","last_unstale":"2023-07-06T22:18:41.601864+0000","last_undegraded":"2023-07-06T22:18:41.601864+0000","last_fullsized":"2023-07-06T22:18:41.601864+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:24:36.573316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694602+0000","last_change":"2023-07-06T22:18:40.621973+0000","last_active":"2023-07-06T22:18:41.694602+0000","last_peered":"2023-07-06T22:18:41.694602+0000","last_clean":"2023-07-06T22:18:41.694602+0000","last_became_active":"2023-07-06T22:18:40.621708+0000","last_became_peered":"2023-07-06T22:18:40.621708+0000","last_unstale":"2023-07-06T22:18:41.694602+0000","last_undegraded":"2023-07-06T22:18:41.694602+0000","last_fullsized":"2023-07-06T22:18:41.694602+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:51:01.135230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601888+0000","last_change":"2023-07-06T22:18:40.218552+0000","last_active":"2023-07-06T22:18:41.601888+0000","last_peered":"2023-07-06T22:18:41.601888+0000","last_clean":"2023-07-06T22:18:41.601888+0000","last_became_active":"2023-07-06T22:18:40.218262+0000","last_became_peered":"2023-07-06T22:18:40.218262+0000","last_unstale":"2023-07-06T22:18:41.601888+0000","last_undegraded":"2023-07-06T22:18:41.601888+0000","last_fullsized":"2023-07-06T22:18:41.601888+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:10:10.677876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694150+0000","last_change":"2023-07-06T22:18:40.620053+0000","last_active":"2023-07-06T22:18:41.694150+0000","last_peered":"2023-07-06T22:18:41.694150+0000","last_clean":"2023-07-06T22:18:41.694150+0000","last_became_active":"2023-07-06T22:18:40.619763+0000","last_became_peered":"2023-07-06T22:18:40.619763+0000","last_unstale":"2023-07-06T22:18:41.694150+0000","last_undegraded":"2023-07-06T22:18:41.694150+0000","last_fullsized":"2023-07-06T22:18:41.694150+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:01:10.604990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"178'2","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695114+0000","last_change":"2023-07-06T22:18:40.213475+0000","last_active":"2023-07-06T22:18:41.695114+0000","last_peered":"2023-07-06T22:18:41.695114+0000","last_clean":"2023-07-06T22:18:41.695114+0000","last_became_active":"2023-07-06T22:18:40.213163+0000","last_became_peered":"2023-07-06T22:18:40.213163+0000","last_unstale":"2023-07-06T22:18:41.695114+0000","last_undegraded":"2023-07-06T22:18:41.695114+0000","last_fullsized":"2023-07-06T22:18:41.695114+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:31:13.649718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694593+0000","last_change":"2023-07-06T22:18:40.621415+0000","last_active":"2023-07-06T22:18:41.694593+0000","last_peered":"2023-07-06T22:18:41.694593+0000","last_clean":"2023-07-06T22:18:41.694593+0000","last_became_active":"2023-07-06T22:18:40.621158+0000","last_became_peered":"2023-07-06T22:18:40.621158+0000","last_unstale":"2023-07-06T22:18:41.694593+0000","last_undegraded":"2023-07-06T22:18:41.694593+0000","last_fullsized":"2023-07-06T22:18:41.694593+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:41:37.120206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601538+0000","last_change":"2023-07-06T22:18:40.217289+0000","last_active":"2023-07-06T22:18:41.601538+0000","last_peered":"2023-07-06T22:18:41.601538+0000","last_clean":"2023-07-06T22:18:41.601538+0000","last_became_active":"2023-07-06T22:18:40.216980+0000","last_became_peered":"2023-07-06T22:18:40.216980+0000","last_unstale":"2023-07-06T22:18:41.601538+0000","last_undegraded":"2023-07-06T22:18:41.601538+0000","last_fullsized":"2023-07-06T22:18:41.601538+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:24:54.233636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601074+0000","last_change":"2023-07-06T22:18:40.623314+0000","last_active":"2023-07-06T22:18:41.601074+0000","last_peered":"2023-07-06T22:18:41.601074+0000","last_clean":"2023-07-06T22:18:41.601074+0000","last_became_active":"2023-07-06T22:18:40.623042+0000","last_became_peered":"2023-07-06T22:18:40.623042+0000","last_unstale":"2023-07-06T22:18:41.601074+0000","last_undegraded":"2023-07-06T22:18:41.601074+0000","last_fullsized":"2023-07-06T22:18:41.601074+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:20:38.351410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694801+0000","last_change":"2023-07-06T22:18:40.216439+0000","last_active":"2023-07-06T22:18:41.694801+0000","last_peered":"2023-07-06T22:18:41.694801+0000","last_clean":"2023-07-06T22:18:41.694801+0000","last_became_active":"2023-07-06T22:18:40.216121+0000","last_became_peered":"2023-07-06T22:18:40.216121+0000","last_unstale":"2023-07-06T22:18:41.694801+0000","last_undegraded":"2023-07-06T22:18:41.694801+0000","last_fullsized":"2023-07-06T22:18:41.694801+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:50:32.556473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603788+0000","last_change":"2023-07-06T22:18:40.622485+0000","last_active":"2023-07-06T22:18:41.603788+0000","last_peered":"2023-07-06T22:18:41.603788+0000","last_clean":"2023-07-06T22:18:41.603788+0000","last_became_active":"2023-07-06T22:18:40.621938+0000","last_became_peered":"2023-07-06T22:18:40.621938+0000","last_unstale":"2023-07-06T22:18:41.603788+0000","last_undegraded":"2023-07-06T22:18:41.603788+0000","last_fullsized":"2023-07-06T22:18:41.603788+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:07:04.867861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601185+0000","last_change":"2023-07-06T22:18:40.219930+0000","last_active":"2023-07-06T22:18:41.601185+0000","last_peered":"2023-07-06T22:18:41.601185+0000","last_clean":"2023-07-06T22:18:41.601185+0000","last_became_active":"2023-07-06T22:18:40.219660+0000","last_became_peered":"2023-07-06T22:18:40.219660+0000","last_unstale":"2023-07-06T22:18:41.601185+0000","last_undegraded":"2023-07-06T22:18:41.601185+0000","last_fullsized":"2023-07-06T22:18:41.601185+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:47:35.515425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694541+0000","last_change":"2023-07-06T22:18:40.627095+0000","last_active":"2023-07-06T22:18:41.694541+0000","last_peered":"2023-07-06T22:18:41.694541+0000","last_clean":"2023-07-06T22:18:41.694541+0000","last_became_active":"2023-07-06T22:18:40.626480+0000","last_became_peered":"2023-07-06T22:18:40.626480+0000","last_unstale":"2023-07-06T22:18:41.694541+0000","last_undegraded":"2023-07-06T22:18:41.694541+0000","last_fullsized":"2023-07-06T22:18:41.694541+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:31:14.661073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"178'2","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694124+0000","last_change":"2023-07-06T22:18:40.211172+0000","last_active":"2023-07-06T22:18:41.694124+0000","last_peered":"2023-07-06T22:18:41.694124+0000","last_clean":"2023-07-06T22:18:41.694124+0000","last_became_active":"2023-07-06T22:18:40.210889+0000","last_became_peered":"2023-07-06T22:18:40.210889+0000","last_unstale":"2023-07-06T22:18:41.694124+0000","last_undegraded":"2023-07-06T22:18:41.694124+0000","last_fullsized":"2023-07-06T22:18:41.694124+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:50:32.556473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694518+0000","last_change":"2023-07-06T22:18:40.623080+0000","last_active":"2023-07-06T22:18:41.694518+0000","last_peered":"2023-07-06T22:18:41.694518+0000","last_clean":"2023-07-06T22:18:41.694518+0000","last_became_active":"2023-07-06T22:18:40.622829+0000","last_became_peered":"2023-07-06T22:18:40.622829+0000","last_unstale":"2023-07-06T22:18:41.694518+0000","last_undegraded":"2023-07-06T22:18:41.694518+0000","last_fullsized":"2023-07-06T22:18:41.694518+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:41:32.509615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"179'1","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694721+0000","last_change":"2023-07-06T22:18:40.217600+0000","last_active":"2023-07-06T22:18:41.694721+0000","last_peered":"2023-07-06T22:18:41.694721+0000","last_clean":"2023-07-06T22:18:41.694721+0000","last_became_active":"2023-07-06T22:18:40.217336+0000","last_became_peered":"2023-07-06T22:18:40.217336+0000","last_unstale":"2023-07-06T22:18:41.694721+0000","last_undegraded":"2023-07-06T22:18:41.694721+0000","last_fullsized":"2023-07-06T22:18:41.694721+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:35:46.007743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603964+0000","last_change":"2023-07-06T22:18:40.613941+0000","last_active":"2023-07-06T22:18:41.603964+0000","last_peered":"2023-07-06T22:18:41.603964+0000","last_clean":"2023-07-06T22:18:41.603964+0000","last_became_active":"2023-07-06T22:18:40.613663+0000","last_became_peered":"2023-07-06T22:18:40.613663+0000","last_unstale":"2023-07-06T22:18:41.603964+0000","last_undegraded":"2023-07-06T22:18:41.603964+0000","last_fullsized":"2023-07-06T22:18:41.603964+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:00:52.350089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602161+0000","last_change":"2023-07-06T22:18:40.216017+0000","last_active":"2023-07-06T22:18:41.602161+0000","last_peered":"2023-07-06T22:18:41.602161+0000","last_clean":"2023-07-06T22:18:41.602161+0000","last_became_active":"2023-07-06T22:18:40.215750+0000","last_became_peered":"2023-07-06T22:18:40.215750+0000","last_unstale":"2023-07-06T22:18:41.602161+0000","last_undegraded":"2023-07-06T22:18:41.602161+0000","last_fullsized":"2023-07-06T22:18:41.602161+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:50:13.328017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693865+0000","last_change":"2023-07-06T22:18:40.621049+0000","last_active":"2023-07-06T22:18:41.693865+0000","last_peered":"2023-07-06T22:18:41.693865+0000","last_clean":"2023-07-06T22:18:41.693865+0000","last_became_active":"2023-07-06T22:18:40.620671+0000","last_became_peered":"2023-07-06T22:18:40.620671+0000","last_unstale":"2023-07-06T22:18:41.693865+0000","last_undegraded":"2023-07-06T22:18:41.693865+0000","last_fullsized":"2023-07-06T22:18:41.693865+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:47:37.730407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694072+0000","last_change":"2023-07-06T22:18:40.214713+0000","last_active":"2023-07-06T22:18:41.694072+0000","last_peered":"2023-07-06T22:18:41.694072+0000","last_clean":"2023-07-06T22:18:41.694072+0000","last_became_active":"2023-07-06T22:18:40.214053+0000","last_became_peered":"2023-07-06T22:18:40.214053+0000","last_unstale":"2023-07-06T22:18:41.694072+0000","last_undegraded":"2023-07-06T22:18:41.694072+0000","last_fullsized":"2023-07-06T22:18:41.694072+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:30:18.652092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694233+0000","last_change":"2023-07-06T22:18:40.627261+0000","last_active":"2023-07-06T22:18:41.694233+0000","last_peered":"2023-07-06T22:18:41.694233+0000","last_clean":"2023-07-06T22:18:41.694233+0000","last_became_active":"2023-07-06T22:18:40.626980+0000","last_became_peered":"2023-07-06T22:18:40.626980+0000","last_unstale":"2023-07-06T22:18:41.694233+0000","last_undegraded":"2023-07-06T22:18:41.694233+0000","last_fullsized":"2023-07-06T22:18:41.694233+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:24:18.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694210+0000","last_change":"2023-07-06T22:18:40.216824+0000","last_active":"2023-07-06T22:18:41.694210+0000","last_peered":"2023-07-06T22:18:41.694210+0000","last_clean":"2023-07-06T22:18:41.694210+0000","last_became_active":"2023-07-06T22:18:40.215345+0000","last_became_peered":"2023-07-06T22:18:40.215345+0000","last_unstale":"2023-07-06T22:18:41.694210+0000","last_undegraded":"2023-07-06T22:18:41.694210+0000","last_fullsized":"2023-07-06T22:18:41.694210+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:06:49.046500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694230+0000","last_change":"2023-07-06T22:18:40.619204+0000","last_active":"2023-07-06T22:18:41.694230+0000","last_peered":"2023-07-06T22:18:41.694230+0000","last_clean":"2023-07-06T22:18:41.694230+0000","last_became_active":"2023-07-06T22:18:40.618807+0000","last_became_peered":"2023-07-06T22:18:40.618807+0000","last_unstale":"2023-07-06T22:18:41.694230+0000","last_undegraded":"2023-07-06T22:18:41.694230+0000","last_fullsized":"2023-07-06T22:18:41.694230+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:26:59.446469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694801+0000","last_change":"2023-07-06T22:18:40.215796+0000","last_active":"2023-07-06T22:18:41.694801+0000","last_peered":"2023-07-06T22:18:41.694801+0000","last_clean":"2023-07-06T22:18:41.694801+0000","last_became_active":"2023-07-06T22:18:40.215509+0000","last_became_peered":"2023-07-06T22:18:40.215509+0000","last_unstale":"2023-07-06T22:18:41.694801+0000","last_undegraded":"2023-07-06T22:18:41.694801+0000","last_fullsized":"2023-07-06T22:18:41.694801+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:30:18.652092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694163+0000","last_change":"2023-07-06T22:18:40.619821+0000","last_active":"2023-07-06T22:18:41.694163+0000","last_peered":"2023-07-06T22:18:41.694163+0000","last_clean":"2023-07-06T22:18:41.694163+0000","last_became_active":"2023-07-06T22:18:40.619554+0000","last_became_peered":"2023-07-06T22:18:40.619554+0000","last_unstale":"2023-07-06T22:18:41.694163+0000","last_undegraded":"2023-07-06T22:18:41.694163+0000","last_fullsized":"2023-07-06T22:18:41.694163+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:11:55.911389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601589+0000","last_change":"2023-07-06T22:18:40.216394+0000","last_active":"2023-07-06T22:18:41.601589+0000","last_peered":"2023-07-06T22:18:41.601589+0000","last_clean":"2023-07-06T22:18:41.601589+0000","last_became_active":"2023-07-06T22:18:40.216136+0000","last_became_peered":"2023-07-06T22:18:40.216136+0000","last_unstale":"2023-07-06T22:18:41.601589+0000","last_undegraded":"2023-07-06T22:18:41.601589+0000","last_fullsized":"2023-07-06T22:18:41.601589+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:38:10.095131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694018+0000","last_change":"2023-07-06T22:18:40.624108+0000","last_active":"2023-07-06T22:18:41.694018+0000","last_peered":"2023-07-06T22:18:41.694018+0000","last_clean":"2023-07-06T22:18:41.694018+0000","last_became_active":"2023-07-06T22:18:40.623822+0000","last_became_peered":"2023-07-06T22:18:40.623822+0000","last_unstale":"2023-07-06T22:18:41.694018+0000","last_undegraded":"2023-07-06T22:18:41.694018+0000","last_fullsized":"2023-07-06T22:18:41.694018+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:58:08.638100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693900+0000","last_change":"2023-07-06T22:18:40.212071+0000","last_active":"2023-07-06T22:18:41.693900+0000","last_peered":"2023-07-06T22:18:41.693900+0000","last_clean":"2023-07-06T22:18:41.693900+0000","last_became_active":"2023-07-06T22:18:40.211276+0000","last_became_peered":"2023-07-06T22:18:40.211276+0000","last_unstale":"2023-07-06T22:18:41.693900+0000","last_undegraded":"2023-07-06T22:18:41.693900+0000","last_fullsized":"2023-07-06T22:18:41.693900+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:48:35.113402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694424+0000","last_change":"2023-07-06T22:18:40.629943+0000","last_active":"2023-07-06T22:18:41.694424+0000","last_peered":"2023-07-06T22:18:41.694424+0000","last_clean":"2023-07-06T22:18:41.694424+0000","last_became_active":"2023-07-06T22:18:40.629674+0000","last_became_peered":"2023-07-06T22:18:40.629674+0000","last_unstale":"2023-07-06T22:18:41.694424+0000","last_undegraded":"2023-07-06T22:18:41.694424+0000","last_fullsized":"2023-07-06T22:18:41.694424+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:03:04.689844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694995+0000","last_change":"2023-07-06T22:18:40.215510+0000","last_active":"2023-07-06T22:18:41.694995+0000","last_peered":"2023-07-06T22:18:41.694995+0000","last_clean":"2023-07-06T22:18:41.694995+0000","last_became_active":"2023-07-06T22:18:40.215222+0000","last_became_peered":"2023-07-06T22:18:40.215222+0000","last_unstale":"2023-07-06T22:18:41.694995+0000","last_undegraded":"2023-07-06T22:18:41.694995+0000","last_fullsized":"2023-07-06T22:18:41.694995+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:45:36.476137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"167'304","reported_seq":1152,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601318+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:18:41.601318+0000","last_peered":"2023-07-06T22:18:41.601318+0000","last_clean":"2023-07-06T22:18:41.601318+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:18:41.601318+0000","last_undegraded":"2023-07-06T22:18:41.601318+0000","last_fullsized":"2023-07-06T22:18:41.601318+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:47:16.983800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":294,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694606+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:18:41.694606+0000","last_peered":"2023-07-06T22:18:41.694606+0000","last_clean":"2023-07-06T22:18:41.694606+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:18:41.694606+0000","last_undegraded":"2023-07-06T22:18:41.694606+0000","last_fullsized":"2023-07-06T22:18:41.694606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:58:00.162499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694385+0000","last_change":"2023-07-06T22:18:40.616454+0000","last_active":"2023-07-06T22:18:41.694385+0000","last_peered":"2023-07-06T22:18:41.694385+0000","last_clean":"2023-07-06T22:18:41.694385+0000","last_became_active":"2023-07-06T22:18:40.616128+0000","last_became_peered":"2023-07-06T22:18:40.616128+0000","last_unstale":"2023-07-06T22:18:41.694385+0000","last_undegraded":"2023-07-06T22:18:41.694385+0000","last_fullsized":"2023-07-06T22:18:41.694385+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:05:01.654590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"178'6","reported_seq":19,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693814+0000","last_change":"2023-07-06T22:18:40.216820+0000","last_active":"2023-07-06T22:18:41.693814+0000","last_peered":"2023-07-06T22:18:41.693814+0000","last_clean":"2023-07-06T22:18:41.693814+0000","last_became_active":"2023-07-06T22:18:40.216427+0000","last_became_peered":"2023-07-06T22:18:40.216427+0000","last_unstale":"2023-07-06T22:18:41.693814+0000","last_undegraded":"2023-07-06T22:18:41.693814+0000","last_fullsized":"2023-07-06T22:18:41.693814+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:13:43.117761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":333,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601273+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:18:41.601273+0000","last_peered":"2023-07-06T22:18:41.601273+0000","last_clean":"2023-07-06T22:18:41.601273+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:18:41.601273+0000","last_undegraded":"2023-07-06T22:18:41.601273+0000","last_fullsized":"2023-07-06T22:18:41.601273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:45:44.425532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694083+0000","last_change":"2023-07-06T22:18:40.610901+0000","last_active":"2023-07-06T22:18:41.694083+0000","last_peered":"2023-07-06T22:18:41.694083+0000","last_clean":"2023-07-06T22:18:41.694083+0000","last_became_active":"2023-07-06T22:18:40.610540+0000","last_became_peered":"2023-07-06T22:18:40.610540+0000","last_unstale":"2023-07-06T22:18:41.694083+0000","last_undegraded":"2023-07-06T22:18:41.694083+0000","last_fullsized":"2023-07-06T22:18:41.694083+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:11:36.944945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"178'3","reported_seq":16,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603940+0000","last_change":"2023-07-06T22:18:40.212695+0000","last_active":"2023-07-06T22:18:41.603940+0000","last_peered":"2023-07-06T22:18:41.603940+0000","last_clean":"2023-07-06T22:18:41.603940+0000","last_became_active":"2023-07-06T22:18:40.212355+0000","last_became_peered":"2023-07-06T22:18:40.212355+0000","last_unstale":"2023-07-06T22:18:41.603940+0000","last_undegraded":"2023-07-06T22:18:41.603940+0000","last_fullsized":"2023-07-06T22:18:41.603940+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:57:50.769521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":334,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.603788+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:18:41.603788+0000","last_peered":"2023-07-06T22:18:41.603788+0000","last_clean":"2023-07-06T22:18:41.603788+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:18:41.603788+0000","last_undegraded":"2023-07-06T22:18:41.603788+0000","last_fullsized":"2023-07-06T22:18:41.603788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:44:32.510566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693888+0000","last_change":"2023-07-06T22:18:40.612858+0000","last_active":"2023-07-06T22:18:41.693888+0000","last_peered":"2023-07-06T22:18:41.693888+0000","last_clean":"2023-07-06T22:18:41.693888+0000","last_became_active":"2023-07-06T22:18:40.612606+0000","last_became_peered":"2023-07-06T22:18:40.612606+0000","last_unstale":"2023-07-06T22:18:41.693888+0000","last_undegraded":"2023-07-06T22:18:41.693888+0000","last_fullsized":"2023-07-06T22:18:41.693888+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:41:38.574704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.604077+0000","last_change":"2023-07-06T22:18:40.215791+0000","last_active":"2023-07-06T22:18:41.604077+0000","last_peered":"2023-07-06T22:18:41.604077+0000","last_clean":"2023-07-06T22:18:41.604077+0000","last_became_active":"2023-07-06T22:18:40.215505+0000","last_became_peered":"2023-07-06T22:18:40.215505+0000","last_unstale":"2023-07-06T22:18:41.604077+0000","last_undegraded":"2023-07-06T22:18:41.604077+0000","last_fullsized":"2023-07-06T22:18:41.604077+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:24:27.282030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":294,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694235+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:18:41.694235+0000","last_peered":"2023-07-06T22:18:41.694235+0000","last_clean":"2023-07-06T22:18:41.694235+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:18:41.694235+0000","last_undegraded":"2023-07-06T22:18:41.694235+0000","last_fullsized":"2023-07-06T22:18:41.694235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:09:42.721870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693867+0000","last_change":"2023-07-06T22:18:40.626633+0000","last_active":"2023-07-06T22:18:41.693867+0000","last_peered":"2023-07-06T22:18:41.693867+0000","last_clean":"2023-07-06T22:18:41.693867+0000","last_became_active":"2023-07-06T22:18:40.626343+0000","last_became_peered":"2023-07-06T22:18:40.626343+0000","last_unstale":"2023-07-06T22:18:41.693867+0000","last_undegraded":"2023-07-06T22:18:41.693867+0000","last_fullsized":"2023-07-06T22:18:41.693867+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:31:14.661073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"178'8","reported_seq":21,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693753+0000","last_change":"2023-07-06T22:18:40.212317+0000","last_active":"2023-07-06T22:18:41.693753+0000","last_peered":"2023-07-06T22:18:41.693753+0000","last_clean":"2023-07-06T22:18:41.693753+0000","last_became_active":"2023-07-06T22:18:40.212017+0000","last_became_peered":"2023-07-06T22:18:40.212017+0000","last_unstale":"2023-07-06T22:18:41.693753+0000","last_undegraded":"2023-07-06T22:18:41.693753+0000","last_fullsized":"2023-07-06T22:18:41.693753+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:55:24.276602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":298,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695462+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:18:41.695462+0000","last_peered":"2023-07-06T22:18:41.695462+0000","last_clean":"2023-07-06T22:18:41.695462+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:18:41.695462+0000","last_undegraded":"2023-07-06T22:18:41.695462+0000","last_fullsized":"2023-07-06T22:18:41.695462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:55:50.418871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.693627+0000","last_change":"2023-07-06T22:18:40.619843+0000","last_active":"2023-07-06T22:18:41.693627+0000","last_peered":"2023-07-06T22:18:41.693627+0000","last_clean":"2023-07-06T22:18:41.693627+0000","last_became_active":"2023-07-06T22:18:40.619581+0000","last_became_peered":"2023-07-06T22:18:40.619581+0000","last_unstale":"2023-07-06T22:18:41.693627+0000","last_undegraded":"2023-07-06T22:18:41.693627+0000","last_fullsized":"2023-07-06T22:18:41.693627+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:14:56.479769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694771+0000","last_change":"2023-07-06T22:18:40.213447+0000","last_active":"2023-07-06T22:18:41.694771+0000","last_peered":"2023-07-06T22:18:41.694771+0000","last_clean":"2023-07-06T22:18:41.694771+0000","last_became_active":"2023-07-06T22:18:40.213083+0000","last_became_peered":"2023-07-06T22:18:40.213083+0000","last_unstale":"2023-07-06T22:18:41.694771+0000","last_undegraded":"2023-07-06T22:18:41.694771+0000","last_fullsized":"2023-07-06T22:18:41.694771+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:00:43.147752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.601882+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:18:41.601882+0000","last_peered":"2023-07-06T22:18:41.601882+0000","last_clean":"2023-07-06T22:18:41.601882+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:18:41.601882+0000","last_undegraded":"2023-07-06T22:18:41.601882+0000","last_fullsized":"2023-07-06T22:18:41.601882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:13:41.423677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694463+0000","last_change":"2023-07-06T22:18:40.618438+0000","last_active":"2023-07-06T22:18:41.694463+0000","last_peered":"2023-07-06T22:18:41.694463+0000","last_clean":"2023-07-06T22:18:41.694463+0000","last_became_active":"2023-07-06T22:18:40.618190+0000","last_became_peered":"2023-07-06T22:18:40.618190+0000","last_unstale":"2023-07-06T22:18:41.694463+0000","last_undegraded":"2023-07-06T22:18:41.694463+0000","last_fullsized":"2023-07-06T22:18:41.694463+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:32:11.987479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694314+0000","last_change":"2023-07-06T22:18:40.210076+0000","last_active":"2023-07-06T22:18:41.694314+0000","last_peered":"2023-07-06T22:18:41.694314+0000","last_clean":"2023-07-06T22:18:41.694314+0000","last_became_active":"2023-07-06T22:18:40.209709+0000","last_became_peered":"2023-07-06T22:18:40.209709+0000","last_unstale":"2023-07-06T22:18:41.694314+0000","last_undegraded":"2023-07-06T22:18:41.694314+0000","last_fullsized":"2023-07-06T22:18:41.694314+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:46.737964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":298,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695378+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:18:41.695378+0000","last_peered":"2023-07-06T22:18:41.695378+0000","last_clean":"2023-07-06T22:18:41.695378+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:18:41.695378+0000","last_undegraded":"2023-07-06T22:18:41.695378+0000","last_fullsized":"2023-07-06T22:18:41.695378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:10:56.285496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.694110+0000","last_change":"2023-07-06T22:18:40.619191+0000","last_active":"2023-07-06T22:18:41.694110+0000","last_peered":"2023-07-06T22:18:41.694110+0000","last_clean":"2023-07-06T22:18:41.694110+0000","last_became_active":"2023-07-06T22:18:40.618897+0000","last_became_peered":"2023-07-06T22:18:40.618897+0000","last_unstale":"2023-07-06T22:18:41.694110+0000","last_undegraded":"2023-07-06T22:18:41.694110+0000","last_fullsized":"2023-07-06T22:18:41.694110+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:40.180839+0000","last_clean_scrub_stamp":"2023-07-06T22:18:40.180839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:00:44.159107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"178'2","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.695002+0000","last_change":"2023-07-06T22:18:40.215114+0000","last_active":"2023-07-06T22:18:41.695002+0000","last_peered":"2023-07-06T22:18:41.695002+0000","last_clean":"2023-07-06T22:18:41.695002+0000","last_became_active":"2023-07-06T22:18:40.214790+0000","last_became_peered":"2023-07-06T22:18:40.214790+0000","last_unstale":"2023-07-06T22:18:41.695002+0000","last_undegraded":"2023-07-06T22:18:41.695002+0000","last_fullsized":"2023-07-06T22:18:41.695002+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:18:39.169484+0000","last_clean_scrub_stamp":"2023-07-06T22:18:39.169484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:07:46.737964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":289,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-07-06T22:18:41.602546+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:18:41.602546+0000","last_peered":"2023-07-06T22:18:41.602546+0000","last_clean":"2023-07-06T22:18:41.602546+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:18:41.602546+0000","last_undegraded":"2023-07-06T22:18:41.602546+0000","last_fullsized":"2023-07-06T22:18:41.602546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:19:01.154032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575286,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42028,"kb_used_data":2788,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329812,"statfs":{"total":96636764160,"available":96593727488,"internally_reserved":0,"allocated":2854912,"data_stored":1793150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70599999999999996,"15min":0.72699999999999998},"min":{"1min":0.54100000000000004,"5min":0.432,"15min":0.432},"max":{"1min":0.88700000000000001,"5min":0.93300000000000005,"15min":1.0740000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70999999999999996,"15min":0.71499999999999997},"min":{"1min":0.53800000000000003,"5min":0.45700000000000002,"15min":0.42299999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.998},"last":0.80100000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92700000000000005,"5min":0.98299999999999998,"15min":1.1220000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.58399999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94599999999999995,"5min":1.006,"15min":1.012},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73499999999999999,"15min":0.74399999999999999},"min":{"1min":0.51400000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.016},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.86799999999999999,"5min":0.99299999999999999,"15min":1.149},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.55500000000000005},"min":{"1min":0.39700000000000002,"5min":0.372,"15min":0.36199999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.91300000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.443,"5min":0.40799999999999997,"15min":0.39300000000000002},"max":{"1min":0.872,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.59399999999999997},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":1.038},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.495,"5min":0.442,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":0.92400000000000004,"15min":0.995},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.443},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":1.024},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67600000000000005,"15min":0.67700000000000005},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.018},"last":0.57399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575285,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37328,"kb_used_data":2184,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334512,"statfs":{"total":96636764160,"available":96598540288,"internally_reserved":0,"allocated":2236416,"data_stored":1199479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.376},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.7829999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.49399999999999999,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":0.877,"5min":0.95199999999999996,"15min":1.633},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.55300000000000005,"5min":0.46700000000000003,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":1.044,"15min":1.9099999999999999},"last":0.88},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74299999999999999,"15min":0.74099999999999999},"min":{"1min":0.61199999999999999,"5min":0.46600000000000003,"15min":0.438},"max":{"1min":0.85899999999999999,"5min":0.93700000000000006,"15min":0.97799999999999998},"last":0.748}]},{"osd":2,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.45800000000000002},"max":{"1min":0.86699999999999999,"5min":0.93899999999999995,"15min":2.0299999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.56000000000000005,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.58999999999999997,"5min":0.53300000000000003,"15min":0.501},"max":{"1min":0.86399999999999999,"5min":0.97899999999999998,"15min":1.5920000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":0.877,"5min":0.95599999999999996,"15min":1.996},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":1.024,"15min":1.024},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41599999999999998,"15min":0.40999999999999998},"max":{"1min":0.74399999999999999,"5min":0.94999999999999996,"15min":0.996},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.39200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73199999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.48599999999999999,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.83999999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.621,"15min":0.623},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.436},"max":{"1min":0.82399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.45600000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575285,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59480,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312360,"statfs":{"total":96636764160,"available":96575856640,"internally_reserved":0,"allocated":2244608,"data_stored":1201080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.52900000000000003,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.92800000000000005,"5min":0.97199999999999998,"15min":0.999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.57899999999999996,"5min":0.51200000000000001,"15min":0.46400000000000002},"max":{"1min":0.92500000000000004,"5min":0.995,"15min":0.995},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.73799999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.43099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.51000000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.3200000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.443},"max":{"1min":0.998,"5min":0.998,"15min":1.4299999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.67500000000000004,"5min":0.58499999999999996,"15min":0.48199999999999998},"max":{"1min":0.88500000000000001,"5min":0.999,"15min":1.0409999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.65200000000000002,"5min":0.56699999999999995,"15min":0.46800000000000003},"max":{"1min":0.94399999999999995,"5min":0.996,"15min":1.5169999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.76700000000000002},"min":{"1min":0.58899999999999997,"5min":0.53200000000000003,"15min":0.436},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.79600000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.47799999999999998,"5min":0.39500000000000002,"15min":0.34899999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59799999999999998,"15min":0.61199999999999999},"min":{"1min":0.47599999999999998,"5min":0.432,"15min":0.32600000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.96099999999999997},"last":0.498}]},{"osd":6,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.52900000000000003,"5min":0.44700000000000001,"15min":0.39600000000000002},"max":{"1min":0.88,"5min":0.96399999999999997,"15min":0.998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.42199999999999999},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.96999999999999997},"last":0.52800000000000002}]},{"osd":7,"last update":"Thu Jul 6 22:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.38900000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67800000000000005,"15min":0.68500000000000005},"min":{"1min":0.52900000000000003,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":0.83299999999999996,"5min":0.97899999999999998,"15min":0.999},"last":0.56200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834575283,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55392,"kb_used_data":2200,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316448,"statfs":{"total":96636764160,"available":96580042752,"internally_reserved":0,"allocated":2252800,"data_stored":1202110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.54500000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84299999999999997,"5min":0.96699999999999997,"15min":0.98999999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.75600000000000001,"15min":0.746},"min":{"1min":0.55700000000000005,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.97299999999999998,"5min":0.97899999999999998,"15min":1.016},"last":0.81899999999999995}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.754,"15min":0.749},"min":{"1min":0.61299999999999999,"5min":0.45200000000000001,"15min":0.38300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0309999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74399999999999999,"15min":0.73499999999999999},"min":{"1min":0.58999999999999997,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":0.876,"5min":0.99299999999999999,"15min":0.996},"last":0.91300000000000003}]},{"osd":2,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.63800000000000001,"5min":0.53100000000000003,"15min":0.47799999999999998},"max":{"1min":0.88700000000000001,"5min":0.98699999999999999,"15min":1.0760000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.60299999999999998,"5min":0.51200000000000001,"15min":0.502},"max":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.0580000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.748,"15min":0.73899999999999999},"min":{"1min":0.60099999999999998,"5min":0.51900000000000002,"15min":0.45600000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.98699999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76700000000000002,"15min":0.76300000000000001},"min":{"1min":0.61599999999999999,"5min":0.52700000000000002,"15min":0.51900000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":1.03},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83899999999999997,"5min":0.91200000000000003,"15min":0.92600000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.46000000000000002,"5min":0.39900000000000002,"15min":0.39800000000000002},"max":{"1min":0.77100000000000002,"5min":0.95599999999999996,"15min":1.006},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.95899999999999996,"15min":1.0509999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88400000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.86799999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65700000000000003},"min":{"1min":0.53000000000000003,"5min":0.45000000000000001,"15min":0.433},"max":{"1min":0.84999999999999998,"5min":0.94799999999999995,"15min":1.0469999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.55000000000000004,"5min":0.432,"15min":0.432},"max":{"1min":0.86699999999999999,"5min":1.0109999999999999,"15min":1.1100000000000001},"last":0.83299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575285,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51284,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320556,"statfs":{"total":96636764160,"available":96584249344,"internally_reserved":0,"allocated":2240512,"data_stored":1200510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68100000000000005,"5min":0.69399999999999995,"15min":0.85899999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50900000000000001,"15min":0.49099999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69799999999999995,"5min":0.72799999999999998,"15min":0.83899999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61399999999999999,"15min":0.60499999999999998},"min":{"1min":0.442,"5min":0.44,"15min":0.41299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38700000000000001},"max":{"1min":0.63800000000000001,"5min":0.72399999999999998,"15min":0.875},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.34699999999999998},"max":{"1min":0.71399999999999997,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80300000000000005,"15min":0.77700000000000002},"min":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.441},"max":{"1min":1.0449999999999999,"5min":1.081,"15min":1.474},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.79200000000000004},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.54600000000000004},"max":{"1min":0.99099999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83099999999999996,"15min":0.81100000000000005},"min":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.57499999999999996},"max":{"1min":1.175,"5min":1.175,"15min":1.3740000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82299999999999995,"15min":0.80300000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.022,"5min":1.228,"15min":1.2330000000000001},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.80200000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.51800000000000002},"max":{"1min":1.1399999999999999,"5min":1.194,"15min":1.3899999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.82999999999999996},"min":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.57299999999999995},"max":{"1min":1.0960000000000001,"5min":1.266,"15min":1.3220000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.002,"5min":1.121,"15min":1.2210000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84499999999999997,"15min":0.82699999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.244,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.67500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575285,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41428,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330412,"statfs":{"total":96636764160,"available":96594341888,"internally_reserved":0,"allocated":2240512,"data_stored":1200566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.32300000000000001,"15min":0.27800000000000002},"max":{"1min":0.65100000000000002,"5min":0.76100000000000001,"15min":0.88700000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.46100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.70899999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.41899999999999998,"5min":0.35799999999999998,"15min":0.32300000000000001},"max":{"1min":0.74099999999999999,"5min":0.79400000000000004,"15min":0.84099999999999997},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.46000000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.68700000000000006,"5min":0.77100000000000002,"15min":0.97099999999999997},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.434,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":0.77200000000000002,"15min":0.997},"last":0.505},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.499,"5min":0.434,"15min":0.378},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.80400000000000005},"last":0.438}]},{"osd":4,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.64900000000000002,"5min":0.56599999999999995,"15min":0.50900000000000001},"max":{"1min":0.98399999999999999,"5min":1.45,"15min":1.45},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.47399999999999998},"max":{"1min":0.90600000000000003,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.67400000000000004,"5min":0.60899999999999999,"15min":0.51100000000000001},"max":{"1min":1.0029999999999999,"5min":1.337,"15min":1.337},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.53000000000000003},"max":{"1min":0.91300000000000003,"5min":1.2490000000000001,"15min":1.2829999999999999},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83699999999999997,"15min":0.82099999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.54800000000000004},"max":{"1min":1.0900000000000001,"5min":1.367,"15min":1.367},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.83599999999999997,"15min":0.83699999999999997},"min":{"1min":0.63100000000000001,"5min":0.56399999999999995,"15min":0.56100000000000005},"max":{"1min":0.97399999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.94899999999999995}]},{"osd":7,"last update":"Thu Jul 6 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.85799999999999998,"15min":0.85299999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.56999999999999995},"max":{"1min":1.024,"5min":1.407,"15min":1.407},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.85199999999999998,"15min":0.84999999999999998},"min":{"1min":0.64900000000000002,"5min":0.59899999999999998,"15min":0.55600000000000005},"max":{"1min":1.0329999999999999,"5min":1.296,"15min":1.296},"last":0.93700000000000006}]}]},{"osd":1,"up_from":13,"seq":55834575286,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59476,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312364,"statfs":{"total":96636764160,"available":96575860736,"internally_reserved":0,"allocated":2240512,"data_stored":1200510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.46600000000000003},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.29799999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.32900000000000001},"max":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.81699999999999995},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.36899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.94299999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.38600000000000001},"max":{"1min":0.84899999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.018,"5min":1.083,"15min":1.1140000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.54200000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0700000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.58399999999999996,"5min":0.57299999999999995,"15min":0.48699999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.21},"last":0.749},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81699999999999995,"15min":0.82699999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1100000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82299999999999995,"15min":0.83199999999999996},"min":{"1min":0.61899999999999999,"5min":0.53800000000000003,"15min":0.53600000000000003},"max":{"1min":1.0800000000000001,"5min":1.244,"15min":1.302},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82799999999999996,"15min":0.83299999999999996},"min":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.25,"5min":1.25,"15min":1.3360000000000001},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82599999999999996,"15min":0.83199999999999996},"min":{"1min":0.67100000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0489999999999999,"5min":1.1779999999999999,"15min":1.405},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84999999999999998,"15min":0.84099999999999997},"min":{"1min":0.68200000000000005,"5min":0.57099999999999995,"15min":0.54700000000000004},"max":{"1min":0.97699999999999998,"5min":1.2110000000000001,"15min":1.3779999999999999},"last":0.78900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575285,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37904,"kb_used_data":2760,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333936,"statfs":{"total":96636764160,"available":96597950464,"internally_reserved":0,"allocated":2826240,"data_stored":1789825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.34000000000000002,"5min":0.33600000000000002,"15min":0.312},"max":{"1min":0.749,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52100000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76100000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.33400000000000002},"max":{"1min":0.65200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.45200000000000001,"5min":0.41099999999999998,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80900000000000005,"15min":0.80600000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.1439999999999999,"5min":1.294,"15min":1.294},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80800000000000005,"15min":0.80300000000000005},"min":{"1min":0.61899999999999999,"5min":0.53500000000000003,"15min":0.50900000000000001},"max":{"1min":1.022,"5min":1.107,"15min":1.3320000000000001},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81399999999999995,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.56000000000000005,"15min":0.48899999999999999},"max":{"1min":1.0569999999999999,"5min":1.345,"15min":1.345},"last":0.751},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.63700000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81999999999999995,"15min":0.81399999999999995},"min":{"1min":0.628,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98199999999999998,"5min":1.0049999999999999,"15min":1.153},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.628,"5min":0.59099999999999997,"15min":0.58499999999999996},"max":{"1min":1.036,"5min":1.1910000000000001,"15min":1.272},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Jul 6 22:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.82299999999999995,"15min":0.82899999999999996},"min":{"1min":0.64300000000000002,"5min":0.624,"15min":0.57999999999999996},"max":{"1min":1.083,"5min":1.125,"15min":1.26},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.83599999999999997,"15min":0.82099999999999995},"min":{"1min":0.67100000000000004,"5min":0.60499999999999998,"15min":0.55700000000000005},"max":{"1min":1.022,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:18:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T22:18:49.668 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-06T22:18:49.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.852+0000 7f4553c7b640 1 Processor -- start 2023-07-06T22:18:49.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.852+0000 7f4553c7b640 1 -- start start 2023-07-06T22:18:49.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4553c7b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f454c15b990 0x7f454c06dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:49.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4553c7b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f454c15bd60 0x7f454c15f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:49.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4553c7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f454c0cad50 0x7f454c15fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:49.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4553c7b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454c06e2d0 con 0x7f454c15bd60 2023-07-06T22:18:49.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4553c7b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454c06bb00 con 0x7f454c15b990 2023-07-06T22:18:49.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4553c7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0c9510 con 0x7f454c0cad50 2023-07-06T22:18:49.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4551216640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f454c15bd60 0x7f454c15f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:49.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4551216640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f454c15bd60 0x7f454c15f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37222/0 (socket says 172.21.15.55:37222) 2023-07-06T22:18:49.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4551216640 1 -- 172.21.15.55:0/3127765531 learned_addr learned my addr 172.21.15.55:0/3127765531 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:49.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4552218640 1 --2- 172.21.15.55:0/3127765531 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f454c0cad50 0x7f454c15fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:49.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4551a17640 1 --2- 172.21.15.55:0/3127765531 >> v2:172.21.15.138:3300/0 conn(0x7f454c15b990 0x7f454c06dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:49.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4551216640 1 -- 172.21.15.55:0/3127765531 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f454c0cad50 msgr2=0x7f454c15fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:49.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4551216640 1 --2- 172.21.15.55:0/3127765531 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f454c0cad50 0x7f454c15fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4551216640 1 -- 172.21.15.55:0/3127765531 >> v2:172.21.15.138:3300/0 conn(0x7f454c15b990 msgr2=0x7f454c06dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:49.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4551216640 1 --2- 172.21.15.55:0/3127765531 >> v2:172.21.15.138:3300/0 conn(0x7f454c15b990 0x7f454c06dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4551216640 1 -- 172.21.15.55:0/3127765531 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c0c8f50 con 0x7f454c15bd60 2023-07-06T22:18:49.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4552218640 1 --2- 172.21.15.55:0/3127765531 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f454c0cad50 0x7f454c15fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:49.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.856+0000 7f4551a17640 1 --2- 172.21.15.55:0/3127765531 >> v2:172.21.15.138:3300/0 conn(0x7f454c15b990 0x7f454c06dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:49.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4551216640 1 --2- 172.21.15.55:0/3127765531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f454c15bd60 0x7f454c15f670 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f454c06f650 tx=0x7f453c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d7e6eb99960529 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:49.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4550a15640 1 -- 172.21.15.55:0/3127765531 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c0ab600 con 0x7f454c15bd60 2023-07-06T22:18:49.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4550a15640 1 -- 172.21.15.55:0/3127765531 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c0ab760 con 0x7f454c15bd60 2023-07-06T22:18:49.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4550a15640 1 -- 172.21.15.55:0/3127765531 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c0abaf0 con 0x7f454c15bd60 2023-07-06T22:18:49.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4553c7b640 1 -- 172.21.15.55:0/3127765531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f454c15bd60 msgr2=0x7f454c15f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:49.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4553c7b640 1 --2- 172.21.15.55:0/3127765531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f454c15bd60 0x7f454c15f670 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f454c06f650 tx=0x7f453c01c440 comp rx=0 tx=0).stop 2023-07-06T22:18:49.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4553c7b640 1 -- 172.21.15.55:0/3127765531 shutdown_connections 2023-07-06T22:18:49.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4553c7b640 1 --2- 172.21.15.55:0/3127765531 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f454c0cad50 0x7f454c15fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4553c7b640 1 --2- 172.21.15.55:0/3127765531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f454c15bd60 0x7f454c15f670 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4553c7b640 1 --2- 172.21.15.55:0/3127765531 >> v2:172.21.15.138:3300/0 conn(0x7f454c15b990 0x7f454c06dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4553c7b640 1 -- 172.21.15.55:0/3127765531 >> 172.21.15.55:0/3127765531 conn(0x7f454c0cf3c0 msgr2=0x7f454c0cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:49.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4553c7b640 1 -- 172.21.15.55:0/3127765531 shutdown_connections 2023-07-06T22:18:49.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4553c7b640 1 -- 172.21.15.55:0/3127765531 wait complete. 2023-07-06T22:18:49.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4553c7b640 1 Processor -- start 2023-07-06T22:18:49.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.860+0000 7f4553c7b640 1 -- start start 2023-07-06T22:18:49.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4553c7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f454c0cad50 0x7f454c15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:49.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4553c7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f454c15b990 0x7f454c14dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:49.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4553c7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f454c15bd60 0x7f454c159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:49.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4553c7b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0c5da0 con 0x7f454c15bd60 2023-07-06T22:18:49.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4553c7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0c6080 con 0x7f454c15b990 2023-07-06T22:18:49.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4553c7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0c6360 con 0x7f454c0cad50 2023-07-06T22:18:49.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4552218640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f454c15bd60 0x7f454c159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:49.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4552218640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f454c15bd60 0x7f454c159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37230/0 (socket says 172.21.15.55:37230) 2023-07-06T22:18:49.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4552218640 1 -- 172.21.15.55:0/1573086989 learned_addr learned my addr 172.21.15.55:0/1573086989 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:49.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4551a17640 1 --2- 172.21.15.55:0/1573086989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f454c0cad50 0x7f454c15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:49.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4551216640 1 --2- 172.21.15.55:0/1573086989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f454c15b990 0x7f454c14dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:49.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4552218640 1 -- 172.21.15.55:0/1573086989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f454c0cad50 msgr2=0x7f454c15a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:49.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4552218640 1 --2- 172.21.15.55:0/1573086989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f454c0cad50 0x7f454c15a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4552218640 1 -- 172.21.15.55:0/1573086989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f454c15b990 msgr2=0x7f454c14dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:49.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4552218640 1 --2- 172.21.15.55:0/1573086989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f454c15b990 0x7f454c14dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:49.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4552218640 1 -- 172.21.15.55:0/1573086989 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c0094d0 con 0x7f454c15bd60 2023-07-06T22:18:49.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4552218640 1 --2- 172.21.15.55:0/1573086989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f454c15bd60 0x7f454c159500 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f4544007e10 tx=0x7f454400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:49.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f45427fc640 1 -- 172.21.15.55:0/1573086989 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544003ba0 con 0x7f454c15bd60 2023-07-06T22:18:49.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f45427fc640 1 -- 172.21.15.55:0/1573086989 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454400f040 con 0x7f454c15bd60 2023-07-06T22:18:49.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f45427fc640 1 -- 172.21.15.55:0/1573086989 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454400de80 con 0x7f454c15bd60 2023-07-06T22:18:49.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4553c7b640 1 -- 172.21.15.55:0/1573086989 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454c0c6640 con 0x7f454c15bd60 2023-07-06T22:18:49.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4553c7b640 1 -- 172.21.15.55:0/1573086989 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454c15a620 con 0x7f454c15bd60 2023-07-06T22:18:49.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.864+0000 7f4553c7b640 1 -- 172.21.15.55:0/1573086989 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454c072e10 con 0x7f454c15bd60 2023-07-06T22:18:49.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.868+0000 7f45427fc640 1 -- 172.21.15.55:0/1573086989 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4544004030 con 0x7f454c15bd60 2023-07-06T22:18:49.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.868+0000 7f45427fc640 1 --2- 172.21.15.55:0/1573086989 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f45300663a0 0x7f4530068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:49.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.868+0000 7f45427fc640 1 -- 172.21.15.55:0/1573086989 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f4544084320 con 0x7f454c15bd60 2023-07-06T22:18:49.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.868+0000 7f4551a17640 1 --2- 172.21.15.55:0/1573086989 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f45300663a0 0x7f4530068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:49.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.868+0000 7f4551a17640 1 --2- 172.21.15.55:0/1573086989 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f45300663a0 0x7f4530068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f454c1f7130 tx=0x7f4548008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:49.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:49.872+0000 7f45427fc640 1 -- 172.21.15.55:0/1573086989 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4544051560 con 0x7f454c15bd60 2023-07-06T22:18:50.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.080+0000 7f4553c7b640 1 -- 172.21.15.55:0/1573086989 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f454c066d60 con 0x7f454c15bd60 2023-07-06T22:18:50.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.084+0000 7f45427fc640 1 -- 172.21.15.55:0/1573086989 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v29) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4544054b80 con 0x7f454c15bd60 2023-07-06T22:18:50.088 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-07-06T22:18:50.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.088+0000 7f4553c7b640 1 -- 172.21.15.55:0/1573086989 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f45300663a0 msgr2=0x7f4530068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:50.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.088+0000 7f4553c7b640 1 --2- 172.21.15.55:0/1573086989 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f45300663a0 0x7f4530068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f454c1f7130 tx=0x7f4548008040 comp rx=0 tx=0).stop 2023-07-06T22:18:50.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.088+0000 7f4553c7b640 1 -- 172.21.15.55:0/1573086989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f454c15bd60 msgr2=0x7f454c159500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:50.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.088+0000 7f4553c7b640 1 --2- 172.21.15.55:0/1573086989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f454c15bd60 0x7f454c159500 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f4544007e10 tx=0x7f454400d4a0 comp rx=0 tx=0).stop 2023-07-06T22:18:50.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.088+0000 7f4553c7b640 1 -- 172.21.15.55:0/1573086989 shutdown_connections 2023-07-06T22:18:50.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.088+0000 7f4553c7b640 1 --2- 172.21.15.55:0/1573086989 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f45300663a0 0x7f4530068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:50.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.088+0000 7f4553c7b640 1 --2- 172.21.15.55:0/1573086989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f454c15bd60 0x7f454c159500 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.088+0000 7f4553c7b640 1 --2- 172.21.15.55:0/1573086989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f454c15b990 0x7f454c14dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.088+0000 7f4553c7b640 1 --2- 172.21.15.55:0/1573086989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f454c0cad50 0x7f454c15a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.088+0000 7f4553c7b640 1 -- 172.21.15.55:0/1573086989 >> 172.21.15.55:0/1573086989 conn(0x7f454c0cf3c0 msgr2=0x7f454c15aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.088+0000 7f4553c7b640 1 -- 172.21.15.55:0/1573086989 shutdown_connections 2023-07-06T22:18:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.088+0000 7f4553c7b640 1 -- 172.21.15.55:0/1573086989 wait complete. 2023-07-06T22:18:50.110 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:18:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d113ad640 1 Processor -- start 2023-07-06T22:18:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d113ad640 1 -- start start 2023-07-06T22:18:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d113ad640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4d0c158400 0x7f4d0c0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d113ad640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c06fae0 con 0x7f4d0c1587d0 2023-07-06T22:18:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d113ad640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c06fdc0 con 0x7f4d0c0c9680 2023-07-06T22:18:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d113ad640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0c0700a0 con 0x7f4d0c158400 2023-07-06T22:18:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d0b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4d0c1587d0 0x7f4d0c0cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42754/0 (socket says 172.21.15.55:42754) 2023-07-06T22:18:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d0b7fe640 1 -- 172.21.15.55:0/2454830896 learned_addr learned my addr 172.21.15.55:0/2454830896 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d0affd640 1 --2- 172.21.15.55:0/2454830896 >> v2:172.21.15.138:3300/0 conn(0x7f4d0c158400 0x7f4d0c0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d0a7fc640 1 -- 172.21.15.55:0/2454830896 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853676083 0 0) 0x7f4d0c06fae0 con 0x7f4d0c1587d0 2023-07-06T22:18:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d0a7fc640 1 -- 172.21.15.55:0/2454830896 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cf8003530 con 0x7f4d0c1587d0 2023-07-06T22:18:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d0a7fc640 1 -- 172.21.15.55:0/2454830896 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842592343 0 0) 0x7f4d0c06fdc0 con 0x7f4d0c0c9680 2023-07-06T22:18:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d0a7fc640 1 -- 172.21.15.55:0/2454830896 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d0c06fae0 con 0x7f4d0c0c9680 2023-07-06T22:18:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d0affd640 1 -- 172.21.15.55:0/2454830896 >> v1:172.21.15.138:6789/0 conn(0x7f4d0c0c9680 legacy=0x7f4d0c070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d0affd640 1 -- 172.21.15.55:0/2454830896 >> v1:172.21.15.55:6789/0 conn(0x7f4d0c1587d0 legacy=0x7f4d0c0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d0a7fc640 1 -- 172.21.15.55:0/2454830896 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1890982420 0 0) 0x7f4cf8003530 con 0x7f4d0c1587d0 2023-07-06T22:18:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.252+0000 7f4d0affd640 1 -- 172.21.15.55:0/2454830896 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c070380 con 0x7f4d0c158400 2023-07-06T22:18:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.256+0000 7f4d0affd640 1 --2- 172.21.15.55:0/2454830896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d0c158400 0x7f4d0c0c9140 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0097c0 tx=0x7f4cfc01c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=105edf4b47b080c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.256+0000 7f4d0a7fc640 1 -- 172.21.15.55:0/2454830896 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04001a00 con 0x7f4d0c158400 2023-07-06T22:18:50.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.256+0000 7f4d0a7fc640 1 -- 172.21.15.55:0/2454830896 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc0a7050 con 0x7f4d0c158400 2023-07-06T22:18:50.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.256+0000 7f4d0a7fc640 1 -- 172.21.15.55:0/2454830896 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc0ab400 con 0x7f4d0c158400 2023-07-06T22:18:50.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.256+0000 7f4d113ad640 1 -- 172.21.15.55:0/2454830896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d0c158400 msgr2=0x7f4d0c0c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.256+0000 7f4d113ad640 1 --2- 172.21.15.55:0/2454830896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d0c158400 0x7f4d0c0c9140 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0097c0 tx=0x7f4cfc01c2e0 comp rx=0 tx=0).stop 2023-07-06T22:18:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.256+0000 7f4d113ad640 1 -- 172.21.15.55:0/2454830896 shutdown_connections 2023-07-06T22:18:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.256+0000 7f4d113ad640 1 --2- 172.21.15.55:0/2454830896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d0c158400 0x7f4d0c0c9140 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.256+0000 7f4d113ad640 1 -- 172.21.15.55:0/2454830896 >> 172.21.15.55:0/2454830896 conn(0x7f4d0c0cded0 msgr2=0x7f4d0c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.256+0000 7f4d113ad640 1 -- 172.21.15.55:0/2454830896 shutdown_connections 2023-07-06T22:18:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.256+0000 7f4d113ad640 1 -- 172.21.15.55:0/2454830896 wait complete. 2023-07-06T22:18:50.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d113ad640 1 Processor -- start 2023-07-06T22:18:50.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d113ad640 1 -- start start 2023-07-06T22:18:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d113ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d0c0c9680 0x7f4d0c152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d113ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d0c158400 0x7f4d0c0b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d113ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d0c1587d0 0x7f4d0c0a7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d113ad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0adf70 con 0x7f4d0c0c9680 2023-07-06T22:18:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d113ad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0ae250 con 0x7f4d0c1587d0 2023-07-06T22:18:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d113ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0ae530 con 0x7f4d0c158400 2023-07-06T22:18:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d0affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d0c0c9680 0x7f4d0c152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d0affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d0c0c9680 0x7f4d0c152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37232/0 (socket says 172.21.15.55:37232) 2023-07-06T22:18:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d0affd640 1 -- 172.21.15.55:0/3902331804 learned_addr learned my addr 172.21.15.55:0/3902331804 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d0b7fe640 1 --2- 172.21.15.55:0/3902331804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d0c1587d0 0x7f4d0c0a7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d03fff640 1 --2- 172.21.15.55:0/3902331804 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d0c158400 0x7f4d0c0b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d0affd640 1 -- 172.21.15.55:0/3902331804 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d0c158400 msgr2=0x7f4d0c0b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d0affd640 1 --2- 172.21.15.55:0/3902331804 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d0c158400 0x7f4d0c0b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d0affd640 1 -- 172.21.15.55:0/3902331804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d0c1587d0 msgr2=0x7f4d0c0a7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d0affd640 1 --2- 172.21.15.55:0/3902331804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d0c1587d0 0x7f4d0c0a7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d0affd640 1 -- 172.21.15.55:0/3902331804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc009420 con 0x7f4d0c0c9680 2023-07-06T22:18:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d0affd640 1 --2- 172.21.15.55:0/3902331804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d0c0c9680 0x7f4d0c152c80 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0ae040 tx=0x7f4cfc01ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d037fe640 1 -- 172.21.15.55:0/3902331804 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc0abd20 con 0x7f4d0c0c9680 2023-07-06T22:18:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d037fe640 1 -- 172.21.15.55:0/3902331804 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc0b7450 con 0x7f4d0c0c9680 2023-07-06T22:18:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d037fe640 1 -- 172.21.15.55:0/3902331804 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc0abea0 con 0x7f4d0c0c9680 2023-07-06T22:18:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d113ad640 1 -- 172.21.15.55:0/3902331804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c0ae810 con 0x7f4d0c0c9680 2023-07-06T22:18:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.260+0000 7f4d113ad640 1 -- 172.21.15.55:0/3902331804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0c1531c0 con 0x7f4d0c0c9680 2023-07-06T22:18:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.264+0000 7f4d113ad640 1 -- 172.21.15.55:0/3902331804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0c06c580 con 0x7f4d0c0c9680 2023-07-06T22:18:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.264+0000 7f4d037fe640 1 -- 172.21.15.55:0/3902331804 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4cfc0b7800 con 0x7f4d0c0c9680 2023-07-06T22:18:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.264+0000 7f4d037fe640 1 --2- 172.21.15.55:0/3902331804 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4cec0663a0 0x7f4cec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.264+0000 7f4d037fe640 1 -- 172.21.15.55:0/3902331804 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f4cfc11e580 con 0x7f4d0c0c9680 2023-07-06T22:18:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.264+0000 7f4d03fff640 1 --2- 172.21.15.55:0/3902331804 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4cec0663a0 0x7f4cec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:50.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.264+0000 7f4d03fff640 1 --2- 172.21.15.55:0/3902331804 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4cec0663a0 0x7f4cec068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0ad490 tx=0x7f4cf4009040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:50.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.268+0000 7f4d037fe640 1 -- 172.21.15.55:0/3902331804 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4cfc0eb730 con 0x7f4d0c0c9680 2023-07-06T22:18:50.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.456+0000 7f4d113ad640 1 -- 172.21.15.55:0/3902331804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d0c066d60 con 0x7f4d0c0c9680 2023-07-06T22:18:50.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.460+0000 7f4d037fe640 1 -- 172.21.15.55:0/3902331804 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f4cfc0eed50 con 0x7f4d0c0c9680 2023-07-06T22:18:50.460 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:50.461 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8420,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/10830186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":10830186},{"type":"v1","addr":"172.21.15.138:6834","nonce":10830186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9577,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3623480690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3623480690},{"type":"v1","addr":"172.21.15.138:6835","nonce":3623480690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":10428,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2297427597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2297427597},{"type":"v1","addr":"172.21.15.55:6835","nonce":2297427597}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:18:40.592191+0000","modified":"2023-07-06T22:18:43.616817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10431":{"gid":10431,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3052024414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3052024414},{"type":"v1","addr":"172.21.15.55:6837","nonce":3052024414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-06T22:18:50.461 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 79 2023-07-06T22:18:50.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.460+0000 7f4d113ad640 1 -- 172.21.15.55:0/3902331804 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4cec0663a0 msgr2=0x7f4cec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:50.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.460+0000 7f4d113ad640 1 --2- 172.21.15.55:0/3902331804 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4cec0663a0 0x7f4cec068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0ad490 tx=0x7f4cf4009040 comp rx=0 tx=0).stop 2023-07-06T22:18:50.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.460+0000 7f4d113ad640 1 -- 172.21.15.55:0/3902331804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d0c0c9680 msgr2=0x7f4d0c152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:50.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.460+0000 7f4d113ad640 1 --2- 172.21.15.55:0/3902331804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d0c0c9680 0x7f4d0c152c80 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0ae040 tx=0x7f4cfc01ab20 comp rx=0 tx=0).stop 2023-07-06T22:18:50.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.460+0000 7f4d113ad640 1 -- 172.21.15.55:0/3902331804 shutdown_connections 2023-07-06T22:18:50.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.460+0000 7f4d113ad640 1 --2- 172.21.15.55:0/3902331804 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4cec0663a0 0x7f4cec068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:50.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.460+0000 7f4d113ad640 1 --2- 172.21.15.55:0/3902331804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d0c1587d0 0x7f4d0c0a7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:50.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.460+0000 7f4d113ad640 1 --2- 172.21.15.55:0/3902331804 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d0c158400 0x7f4d0c0b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:50.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.460+0000 7f4d113ad640 1 --2- 172.21.15.55:0/3902331804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d0c0c9680 0x7f4d0c152c80 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:50.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.460+0000 7f4d113ad640 1 -- 172.21.15.55:0/3902331804 >> 172.21.15.55:0/3902331804 conn(0x7f4d0c0cded0 msgr2=0x7f4d0c156370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:50.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.460+0000 7f4d113ad640 1 -- 172.21.15.55:0/3902331804 shutdown_connections 2023-07-06T22:18:50.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:50.460+0000 7f4d113ad640 1 -- 172.21.15.55:0/3902331804 wait complete. 2023-07-06T22:18:50.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T22:18:40.592191+0000', 'modified': '2023-07-06T22:18:43.616817+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10431}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10431': {'gid': 10431, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6837/3052024414', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6836', 'nonce': 3052024414}, {'type': 'v1', 'addr': '172.21.15.55:6837', 'nonce': 3052024414}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T22:18:50.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T22:18:50.884 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-06T22:18:51.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.028+0000 7fdd05bdf640 1 Processor -- start 2023-07-06T22:18:51.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.028+0000 7fdd05bdf640 1 -- start start 2023-07-06T22:18:51.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.028+0000 7fdd05bdf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd00158850 0x7fdd000cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.028+0000 7fdd05bdf640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdd00070af0 0x7fdd000ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.028+0000 7fdd05bdf640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd00158c20 con 0x7fdd000ca130 2023-07-06T22:18:51.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.028+0000 7fdd05bdf640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd000b2aa0 con 0x7fdd00158850 2023-07-06T22:18:51.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.028+0000 7fdd05bdf640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd000c8db0 con 0x7fdd00070af0 2023-07-06T22:18:51.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.032+0000 7fdcff7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd00158850 0x7fdd000cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.032+0000 7fdcff7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd00158850 0x7fdd000cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37236/0 (socket says 172.21.15.55:37236) 2023-07-06T22:18:51.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.032+0000 7fdcff7fe640 1 -- 172.21.15.55:0/2517278080 learned_addr learned my addr 172.21.15.55:0/2517278080 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:51.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.032+0000 7fdcfffff640 1 --2- 172.21.15.55:0/2517278080 >> v2:172.21.15.138:3300/0 conn(0x7fdd00070af0 0x7fdd000ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.032+0000 7fdcff7fe640 1 -- 172.21.15.55:0/2517278080 >> v2:172.21.15.138:3300/0 conn(0x7fdd00070af0 msgr2=0x7fdd000ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.032+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/2517278080 >> v2:172.21.15.138:3300/0 conn(0x7fdd00070af0 0x7fdd000ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.032+0000 7fdcff7fe640 1 -- 172.21.15.55:0/2517278080 >> v1:172.21.15.138:6789/0 conn(0x7fdd000ca130 legacy=0x7fdd000703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.032+0000 7fdcff7fe640 1 -- 172.21.15.55:0/2517278080 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd000c9090 con 0x7fdd00158850 2023-07-06T22:18:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.032+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/2517278080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd00158850 0x7fdd000cca30 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7fdd000711e0 tx=0x7fdcf001eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2243e215a4510129 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.032+0000 7fdcfe7fc640 1 -- 172.21.15.55:0/2517278080 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00a7c30 con 0x7fdd00158850 2023-07-06T22:18:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.032+0000 7fdcfe7fc640 1 -- 172.21.15.55:0/2517278080 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf00a7d90 con 0x7fdd00158850 2023-07-06T22:18:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.032+0000 7fdcfe7fc640 1 -- 172.21.15.55:0/2517278080 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00af660 con 0x7fdd00158850 2023-07-06T22:18:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 -- 172.21.15.55:0/2517278080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd00158850 msgr2=0x7fdd000cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 --2- 172.21.15.55:0/2517278080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd00158850 0x7fdd000cca30 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7fdd000711e0 tx=0x7fdcf001eb60 comp rx=0 tx=0).stop 2023-07-06T22:18:51.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 -- 172.21.15.55:0/2517278080 shutdown_connections 2023-07-06T22:18:51.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 --2- 172.21.15.55:0/2517278080 >> v2:172.21.15.138:3300/0 conn(0x7fdd00070af0 0x7fdd000ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 --2- 172.21.15.55:0/2517278080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd00158850 0x7fdd000cca30 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 -- 172.21.15.55:0/2517278080 >> 172.21.15.55:0/2517278080 conn(0x7fdd000cea70 msgr2=0x7fdd000ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:51.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 -- 172.21.15.55:0/2517278080 shutdown_connections 2023-07-06T22:18:51.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 -- 172.21.15.55:0/2517278080 wait complete. 2023-07-06T22:18:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 Processor -- start 2023-07-06T22:18:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 -- start start 2023-07-06T22:18:51.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd00070af0 0x7fdd001f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd000ca130 0x7fdd000c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd00158850 0x7fdd000aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0006b120 con 0x7fdd000ca130 2023-07-06T22:18:51.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0006a4a0 con 0x7fdd00158850 2023-07-06T22:18:51.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdd05bdf640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0006a780 con 0x7fdd00070af0 2023-07-06T22:18:51.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdcfeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd000ca130 0x7fdd000c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdcfeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd000ca130 0x7fdd000c7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37250/0 (socket says 172.21.15.55:37250) 2023-07-06T22:18:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdcfeffd640 1 -- 172.21.15.55:0/293864691 learned_addr learned my addr 172.21.15.55:0/293864691 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd00070af0 0x7fdd001f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdcfffff640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd00158850 0x7fdd000aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdcfeffd640 1 -- 172.21.15.55:0/293864691 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd00070af0 msgr2=0x7fdd001f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdcfeffd640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd00070af0 0x7fdd001f4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdcfeffd640 1 -- 172.21.15.55:0/293864691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd00158850 msgr2=0x7fdd000aee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdcfeffd640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd00158850 0x7fdd000aee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdcfeffd640 1 -- 172.21.15.55:0/293864691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf000b770 con 0x7fdd000ca130 2023-07-06T22:18:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd00070af0 0x7fdd001f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.036+0000 7fdcfeffd640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd000ca130 0x7fdd000c7680 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c450 tx=0x7fdcf400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.040+0000 7fdce7fff640 1 -- 172.21.15.55:0/293864691 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4012830 con 0x7fdd000ca130 2023-07-06T22:18:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.040+0000 7fdce7fff640 1 -- 172.21.15.55:0/293864691 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf40129b0 con 0x7fdd000ca130 2023-07-06T22:18:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.040+0000 7fdce7fff640 1 -- 172.21.15.55:0/293864691 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4012d60 con 0x7fdd000ca130 2023-07-06T22:18:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.040+0000 7fdd05bdf640 1 -- 172.21.15.55:0/293864691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0006aa60 con 0x7fdd000ca130 2023-07-06T22:18:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.040+0000 7fdd05bdf640 1 -- 172.21.15.55:0/293864691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd000c7bc0 con 0x7fdd000ca130 2023-07-06T22:18:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.040+0000 7fdce7fff640 1 -- 172.21.15.55:0/293864691 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdcf401c460 con 0x7fdd000ca130 2023-07-06T22:18:51.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.040+0000 7fdce7fff640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdcec0663a0 0x7fdcec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.040+0000 7fdce7fff640 1 -- 172.21.15.55:0/293864691 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdcf4083e30 con 0x7fdd000ca130 2023-07-06T22:18:51.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.040+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdcec0663a0 0x7fdcec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.040+0000 7fdd08f35000 1 Processor -- start 2023-07-06T22:18:51.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.040+0000 7fdd08f35000 1 -- start start 2023-07-06T22:18:51.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdcec0663a0 0x7fdcec068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00b1000 tx=0x7fdcf0008040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:51.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f5aa740 0x555f5f5aab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5ab050 0x555f5f560840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f560d80 0x555f5f561150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f428ac0 con 0x555f5f5aa740 2023-07-06T22:18:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f362840 con 0x555f5f5ab050 2023-07-06T22:18:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f5f3b62e0 con 0x555f5f560d80 2023-07-06T22:18:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdcff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f5aa740 0x555f5f5aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdcff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f5aa740 0x555f5f5aab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37256/0 (socket says 172.21.15.55:37256) 2023-07-06T22:18:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdcff7fe640 1 -- 172.21.15.55:0/70785156 learned_addr learned my addr 172.21.15.55:0/70785156 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdcfffff640 1 --2- 172.21.15.55:0/70785156 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f560d80 0x555f5f561150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdcfeffd640 1 --2- 172.21.15.55:0/70785156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5ab050 0x555f5f560840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdcff7fe640 1 -- 172.21.15.55:0/70785156 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f560d80 msgr2=0x555f5f561150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/70785156 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f560d80 0x555f5f561150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdcff7fe640 1 -- 172.21.15.55:0/70785156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5ab050 msgr2=0x555f5f560840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/70785156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5ab050 0x555f5f560840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdcff7fe640 1 -- 172.21.15.55:0/70785156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f5f0ab890 con 0x555f5f5aa740 2023-07-06T22:18:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdcfeffd640 1 --2- 172.21.15.55:0/70785156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5ab050 0x555f5f560840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/70785156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f5aa740 0x555f5f5aab10 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0008010 tx=0x7fdcf0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b088d9450ee23d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdce57fa640 1 -- 172.21.15.55:0/70785156 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00bf070 con 0x555f5f5aa740 2023-07-06T22:18:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdce57fa640 1 -- 172.21.15.55:0/70785156 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf00baaa0 con 0x555f5f5aa740 2023-07-06T22:18:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdce57fa640 1 -- 172.21.15.55:0/70785156 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00bae10 con 0x555f5f5aa740 2023-07-06T22:18:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 -- 172.21.15.55:0/70785156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f5aa740 msgr2=0x555f5f5aab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 --2- 172.21.15.55:0/70785156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f5aa740 0x555f5f5aab10 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0008010 tx=0x7fdcf0004740 comp rx=0 tx=0).stop 2023-07-06T22:18:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 -- 172.21.15.55:0/70785156 shutdown_connections 2023-07-06T22:18:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 --2- 172.21.15.55:0/70785156 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f560d80 0x555f5f561150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 --2- 172.21.15.55:0/70785156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5ab050 0x555f5f560840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 --2- 172.21.15.55:0/70785156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f5aa740 0x555f5f5aab10 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 -- 172.21.15.55:0/70785156 >> 172.21.15.55:0/70785156 conn(0x555f5f558800 msgr2=0x555f5f567800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 -- 172.21.15.55:0/70785156 shutdown_connections 2023-07-06T22:18:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 -- 172.21.15.55:0/70785156 wait complete. 2023-07-06T22:18:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 -- start start 2023-07-06T22:18:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.044+0000 7fdd08f35000 1 Processor -- start 2023-07-06T22:18:51.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f560d80 0x555f5f566910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5aa740 0x555f5f56c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f5ab050 0x555f5f56c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f3af380 con 0x555f5f5ab050 2023-07-06T22:18:51.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f36bae0 con 0x555f5f560d80 2023-07-06T22:18:51.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f5f36b780 con 0x555f5f5aa740 2023-07-06T22:18:51.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 10 client.0 _ll_register_callbacks cb 0x555f5f54ce30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T22:18:51.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcfffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f5ab050 0x555f5f56c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcfffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f5ab050 0x555f5f56c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37264/0 (socket says 172.21.15.55:37264) 2023-07-06T22:18:51.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcfffff640 1 -- 172.21.15.55:0/2254755760 learned_addr learned my addr 172.21.15.55:0/2254755760 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:51.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcfeffd640 1 --2- 172.21.15.55:0/2254755760 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5aa740 0x555f5f56c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/2254755760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f560d80 0x555f5f566910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcfffff640 1 -- 172.21.15.55:0/2254755760 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5aa740 msgr2=0x555f5f56c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:51.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcfffff640 1 --2- 172.21.15.55:0/2254755760 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5aa740 0x555f5f56c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcfffff640 1 -- 172.21.15.55:0/2254755760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f560d80 msgr2=0x555f5f566910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:51.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcfffff640 1 --2- 172.21.15.55:0/2254755760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f560d80 0x555f5f566910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcfffff640 1 -- 172.21.15.55:0/2254755760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd000c9090 con 0x555f5f5ab050 2023-07-06T22:18:51.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcfffff640 1 --2- 172.21.15.55:0/2254755760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f5ab050 0x555f5f56c620 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80079a0 tx=0x7fdcf8007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de44134315a800e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:51.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcde7fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T22:18:51.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcde7fc640 1 -- 172.21.15.55:0/2254755760 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8011a80 con 0x555f5f5ab050 2023-07-06T22:18:51.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 1 -- 172.21.15.55:0/2254755760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f5f376a20 con 0x555f5f5ab050 2023-07-06T22:18:51.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcde7fc640 1 -- 172.21.15.55:0/2254755760 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdcf8011be0 con 0x555f5f5ab050 2023-07-06T22:18:51.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcde7fc640 1 -- 172.21.15.55:0/2254755760 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcf8011de0 con 0x555f5f5ab050 2023-07-06T22:18:51.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 10 client.10614 fetch_fsmap learned FSMap version 79 2023-07-06T22:18:51.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 1 -- 172.21.15.55:0/2254755760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x555f5f373d10 con 0x555f5f5ab050 2023-07-06T22:18:51.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcde7fc640 1 -- 172.21.15.55:0/2254755760 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f5f376a20 con 0x555f5f5ab050 2023-07-06T22:18:51.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcde7fc640 1 -- 172.21.15.55:0/2254755760 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 79) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fdcf8014070 con 0x555f5f5ab050 2023-07-06T22:18:51.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 10 client.10614 fetch_fsmap finished waiting for FSMap version 79 2023-07-06T22:18:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 10 client.10614 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T22:18:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 20 client.10614 populate_metadata read hostname 'smithi055' 2023-07-06T22:18:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 1 --2- 172.21.15.55:0/2254755760 >> [v2:172.21.15.55:6836/3052024414,v1:172.21.15.55:6837/3052024414] conn(0x555f5f5b9c80 0x555f5f5bc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 4 client.10614 mds_command: new command op to 10431 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T22:18:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdd08f35000 1 -- 172.21.15.55:0/2254755760 --> [v2:172.21.15.55:6836/3052024414,v1:172.21.15.55:6837/3052024414] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f5f3de710 con 0x555f5f5b9c80 2023-07-06T22:18:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/2254755760 >> [v2:172.21.15.55:6836/3052024414,v1:172.21.15.55:6837/3052024414] conn(0x555f5f5b9c80 0x555f5f5bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/2254755760 >> [v2:172.21.15.55:6836/3052024414,v1:172.21.15.55:6837/3052024414] conn(0x555f5f5b9c80 0x555f5f5bc060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f041a8e70c7f057 server_cookie=db37bc7ce396f85 in_seq=0 out_seq=0 2023-07-06T22:18:51.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.048+0000 7fdcde7fc640 10 client.10614 ms_handle_connect on v2:172.21.15.55:6836/3052024414 2023-07-06T22:18:51.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdcde7fc640 1 -- 172.21.15.55:0/2254755760 <== mds.0 v2:172.21.15.55:6836/3052024414 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555f5f3de710 con 0x555f5f5b9c80 2023-07-06T22:18:51.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdcde7fc640 10 client.10614 handle_command_reply: tid=0 2023-07-06T22:18:51.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdd08f35000 1 client.10614 shutdown 2023-07-06T22:18:51.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdd08f35000 1 -- 172.21.15.55:0/2254755760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f5ab050 msgr2=0x555f5f56c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdd08f35000 1 --2- 172.21.15.55:0/2254755760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f5ab050 0x555f5f56c620 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80079a0 tx=0x7fdcf8007e60 comp rx=0 tx=0).stop 2023-07-06T22:18:51.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdd08f35000 1 -- 172.21.15.55:0/2254755760 shutdown_connections 2023-07-06T22:18:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdd08f35000 1 --2- 172.21.15.55:0/2254755760 >> [v2:172.21.15.55:6836/3052024414,v1:172.21.15.55:6837/3052024414] conn(0x555f5f5b9c80 0x555f5f5bc060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdd08f35000 1 --2- 172.21.15.55:0/2254755760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f5ab050 0x555f5f56c620 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdd08f35000 1 --2- 172.21.15.55:0/2254755760 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5aa740 0x555f5f56c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdcde7fc640 0 client.10614 ms_handle_reset on v2:172.21.15.55:6836/3052024414 2023-07-06T22:18:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdd08f35000 1 --2- 172.21.15.55:0/2254755760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f560d80 0x555f5f566910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdd08f35000 1 -- 172.21.15.55:0/2254755760 >> 172.21.15.55:0/2254755760 conn(0x555f5f558800 msgr2=0x555f5f55f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdd08f35000 1 -- 172.21.15.55:0/2254755760 shutdown_connections 2023-07-06T22:18:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdd08f35000 1 -- 172.21.15.55:0/2254755760 wait complete. 2023-07-06T22:18:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.052+0000 7fdd08f35000 20 client.10614 trim_cache size 0 max 16384 2023-07-06T22:18:51.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 Processor -- start 2023-07-06T22:18:51.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 -- start start 2023-07-06T22:18:51.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f560d80 0x555f5f5bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5aa740 0x555f5f5ba050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5ab050 0x555f5f5ba590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f06c940 con 0x555f5f560d80 2023-07-06T22:18:51.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f3aacf0 con 0x555f5f5aa740 2023-07-06T22:18:51.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f5f3acb90 con 0x555f5f5ab050 2023-07-06T22:18:51.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdcff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f560d80 0x555f5f5bdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdcff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f560d80 0x555f5f5bdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37276/0 (socket says 172.21.15.55:37276) 2023-07-06T22:18:51.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdcff7fe640 1 -- 172.21.15.55:0/4235428484 learned_addr learned my addr 172.21.15.55:0/4235428484 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:51.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdcfffff640 1 --2- 172.21.15.55:0/4235428484 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5ab050 0x555f5f5ba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdcfeffd640 1 --2- 172.21.15.55:0/4235428484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5aa740 0x555f5f5ba050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdcff7fe640 1 -- 172.21.15.55:0/4235428484 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5ab050 msgr2=0x555f5f5ba590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:51.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/4235428484 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5ab050 0x555f5f5ba590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdcff7fe640 1 -- 172.21.15.55:0/4235428484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5aa740 msgr2=0x555f5f5ba050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:51.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/4235428484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5aa740 0x555f5f5ba050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdcff7fe640 1 -- 172.21.15.55:0/4235428484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f5f563450 con 0x555f5f560d80 2023-07-06T22:18:51.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/4235428484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f560d80 0x555f5f5bdfd0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000b2c0 tx=0x7fdcf00a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f883eeebd969a545 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:51.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdce5ffb640 1 -- 172.21.15.55:0/4235428484 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00bf040 con 0x555f5f560d80 2023-07-06T22:18:51.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdce5ffb640 1 -- 172.21.15.55:0/4235428484 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf00d4d20 con 0x555f5f560d80 2023-07-06T22:18:51.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdce5ffb640 1 -- 172.21.15.55:0/4235428484 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00d4320 con 0x555f5f560d80 2023-07-06T22:18:51.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 -- 172.21.15.55:0/4235428484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f560d80 msgr2=0x555f5f5bdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 --2- 172.21.15.55:0/4235428484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f560d80 0x555f5f5bdfd0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000b2c0 tx=0x7fdcf00a9000 comp rx=0 tx=0).stop 2023-07-06T22:18:51.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 -- 172.21.15.55:0/4235428484 shutdown_connections 2023-07-06T22:18:51.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 --2- 172.21.15.55:0/4235428484 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5ab050 0x555f5f5ba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 --2- 172.21.15.55:0/4235428484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5aa740 0x555f5f5ba050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 --2- 172.21.15.55:0/4235428484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f560d80 0x555f5f5bdfd0 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 -- 172.21.15.55:0/4235428484 >> 172.21.15.55:0/4235428484 conn(0x555f5f558800 msgr2=0x555f5f55feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:51.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 -- 172.21.15.55:0/4235428484 shutdown_connections 2023-07-06T22:18:51.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 -- 172.21.15.55:0/4235428484 wait complete. 2023-07-06T22:18:51.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 -- start start 2023-07-06T22:18:51.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.068+0000 7fdd08f35000 1 Processor -- start 2023-07-06T22:18:51.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f560d80 0x555f5f5bd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5aa740 0x555f5f5c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5ab050 0x555f5f5c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f56a8a0 con 0x555f5f560d80 2023-07-06T22:18:51.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5f3b1ee0 con 0x555f5f5aa740 2023-07-06T22:18:51.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f5f3ac780 con 0x555f5f5ab050 2023-07-06T22:18:51.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 10 client.0 _ll_register_callbacks cb 0x555f5f3737f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T22:18:51.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f560d80 0x555f5f5bd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f560d80 0x555f5f5bd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37284/0 (socket says 172.21.15.55:37284) 2023-07-06T22:18:51.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcff7fe640 1 -- 172.21.15.55:0/567837299 learned_addr learned my addr 172.21.15.55:0/567837299 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:51.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcfeffd640 1 --2- 172.21.15.55:0/567837299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5aa740 0x555f5f5c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcfffff640 1 --2- 172.21.15.55:0/567837299 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5ab050 0x555f5f5c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcff7fe640 1 -- 172.21.15.55:0/567837299 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5ab050 msgr2=0x555f5f5c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:51.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/567837299 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5ab050 0x555f5f5c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcff7fe640 1 -- 172.21.15.55:0/567837299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5aa740 msgr2=0x555f5f5c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:51.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/567837299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5aa740 0x555f5f5c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcff7fe640 1 -- 172.21.15.55:0/567837299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f5f0ab890 con 0x555f5f560d80 2023-07-06T22:18:51.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcff7fe640 1 --2- 172.21.15.55:0/567837299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f560d80 0x555f5f5bd710 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0004780 tx=0x7fdcf001d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9f7ede100a1962 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:51.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcde7fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T22:18:51.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcde7fc640 1 -- 172.21.15.55:0/567837299 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00bf040 con 0x555f5f560d80 2023-07-06T22:18:51.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 1 -- 172.21.15.55:0/567837299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f5f5646e0 con 0x555f5f560d80 2023-07-06T22:18:51.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcde7fc640 1 -- 172.21.15.55:0/567837299 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdcf00d4120 con 0x555f5f560d80 2023-07-06T22:18:51.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcde7fc640 1 -- 172.21.15.55:0/567837299 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcf00d42e0 con 0x555f5f560d80 2023-07-06T22:18:51.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 10 client.10620 fetch_fsmap learned FSMap version 79 2023-07-06T22:18:51.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 1 -- 172.21.15.55:0/567837299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x555f5f359fa0 con 0x555f5f560d80 2023-07-06T22:18:51.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcde7fc640 1 -- 172.21.15.55:0/567837299 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f5f5646e0 con 0x555f5f560d80 2023-07-06T22:18:51.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcde7fc640 1 -- 172.21.15.55:0/567837299 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 79) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fdcf00d4440 con 0x555f5f560d80 2023-07-06T22:18:51.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 10 client.10620 fetch_fsmap finished waiting for FSMap version 79 2023-07-06T22:18:51.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 10 client.10620 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T22:18:51.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 20 client.10620 populate_metadata read hostname 'smithi055' 2023-07-06T22:18:51.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 1 --2- 172.21.15.55:0/567837299 >> [v2:172.21.15.55:6836/3052024414,v1:172.21.15.55:6837/3052024414] conn(0x555f5f608e60 0x555f5f609230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 4 client.10620 mds_command: new command op to 10431 tid=0[{"prefix": "status"}] 2023-07-06T22:18:51.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 1 -- 172.21.15.55:0/567837299 --> [v2:172.21.15.55:6836/3052024414,v1:172.21.15.55:6837/3052024414] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555f5f3adcd0 con 0x555f5f608e60 2023-07-06T22:18:51.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcfeffd640 1 --2- 172.21.15.55:0/567837299 >> [v2:172.21.15.55:6836/3052024414,v1:172.21.15.55:6837/3052024414] conn(0x555f5f608e60 0x555f5f609230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcde7fc640 10 client.10620 ms_handle_connect on v2:172.21.15.55:6836/3052024414 2023-07-06T22:18:51.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcfeffd640 1 --2- 172.21.15.55:0/567837299 >> [v2:172.21.15.55:6836/3052024414,v1:172.21.15.55:6837/3052024414] conn(0x555f5f608e60 0x555f5f609230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e168ebb958f787d3 server_cookie=6afc68e316a4309a in_seq=0 out_seq=0 2023-07-06T22:18:51.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcde7fc640 1 -- 172.21.15.55:0/567837299 <== mds.0 v2:172.21.15.55:6836/3052024414 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x555f5f3adcd0 con 0x555f5f608e60 2023-07-06T22:18:51.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdcde7fc640 10 client.10620 handle_command_reply: tid=0 2023-07-06T22:18:51.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 1 client.10620 shutdown 2023-07-06T22:18:51.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 1 -- 172.21.15.55:0/567837299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f560d80 msgr2=0x555f5f5bd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.072+0000 7fdd08f35000 1 --2- 172.21.15.55:0/567837299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f560d80 0x555f5f5bd710 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0004780 tx=0x7fdcf001d3a0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd08f35000 1 -- 172.21.15.55:0/567837299 shutdown_connections 2023-07-06T22:18:51.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd08f35000 1 --2- 172.21.15.55:0/567837299 >> [v2:172.21.15.55:6836/3052024414,v1:172.21.15.55:6837/3052024414] conn(0x555f5f608e60 0x555f5f609230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd08f35000 1 --2- 172.21.15.55:0/567837299 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x555f5f5ab050 0x555f5f5c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd08f35000 1 --2- 172.21.15.55:0/567837299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555f5f5aa740 0x555f5f5c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd08f35000 1 --2- 172.21.15.55:0/567837299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5f560d80 0x555f5f5bd710 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdcde7fc640 0 client.10620 ms_handle_reset on v2:172.21.15.55:6836/3052024414 2023-07-06T22:18:51.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd08f35000 1 -- 172.21.15.55:0/567837299 >> 172.21.15.55:0/567837299 conn(0x555f5f558800 msgr2=0x555f5f5a90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:51.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd08f35000 1 -- 172.21.15.55:0/567837299 shutdown_connections 2023-07-06T22:18:51.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd08f35000 1 -- 172.21.15.55:0/567837299 wait complete. 2023-07-06T22:18:51.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd08f35000 20 client.10620 trim_cache size 0 max 16384 2023-07-06T22:18:51.083 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:18:51.084 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c64f3ef1-e769-47b3-ae15-a714e4e7c4f7", 2023-07-06T22:18:51.084 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-07-06T22:18:51.084 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 10431, 2023-07-06T22:18:51.084 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-07-06T22:18:51.084 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-07-06T22:18:51.084 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-07-06T22:18:51.085 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.481219416, 2023-07-06T22:18:51.085 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 79, 2023-07-06T22:18:51.085 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 179, 2023-07-06T22:18:51.085 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 179, 2023-07-06T22:18:51.085 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 15.758516368 2023-07-06T22:18:51.085 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:18:51.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd05bdf640 1 -- 172.21.15.55:0/293864691 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdcec0663a0 msgr2=0x7fdcec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd05bdf640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdcec0663a0 0x7fdcec068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00b1000 tx=0x7fdcf0008040 comp rx=0 tx=0).stop 2023-07-06T22:18:51.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd05bdf640 1 -- 172.21.15.55:0/293864691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd000ca130 msgr2=0x7fdd000c7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd05bdf640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd000ca130 0x7fdd000c7680 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c450 tx=0x7fdcf400c910 comp rx=0 tx=0).stop 2023-07-06T22:18:51.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd05bdf640 1 -- 172.21.15.55:0/293864691 shutdown_connections 2023-07-06T22:18:51.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd05bdf640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fdcec0663a0 0x7fdcec068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd05bdf640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd00158850 0x7fdd000aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd05bdf640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd000ca130 0x7fdd000c7680 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd05bdf640 1 --2- 172.21.15.55:0/293864691 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdd00070af0 0x7fdd001f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd05bdf640 1 -- 172.21.15.55:0/293864691 >> 172.21.15.55:0/293864691 conn(0x7fdd000cea70 msgr2=0x7fdd0009e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:51.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd05bdf640 1 -- 172.21.15.55:0/293864691 shutdown_connections 2023-07-06T22:18:51.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.076+0000 7fdd05bdf640 1 -- 172.21.15.55:0/293864691 wait complete. 2023-07-06T22:18:51.095 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T22:18:51.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.240+0000 7fcd96d82640 1 Processor -- start 2023-07-06T22:18:51.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.240+0000 7fcd96d82640 1 -- start start 2023-07-06T22:18:51.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.240+0000 7fcd96d82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd9015f4e0 0x7fcd900b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.240+0000 7fcd96d82640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9006a160 con 0x7fcd9015b9d0 2023-07-06T22:18:51.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.240+0000 7fcd96d82640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9015bda0 con 0x7fcd900b4250 2023-07-06T22:18:51.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.240+0000 7fcd96d82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd90069590 con 0x7fcd9015f4e0 2023-07-06T22:18:51.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.240+0000 7fcd94b1e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcd9015b9d0 0x7fcd900ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42762/0 (socket says 172.21.15.55:42762) 2023-07-06T22:18:51.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.240+0000 7fcd94b1e640 1 -- 172.21.15.55:0/3077253712 learned_addr learned my addr 172.21.15.55:0/3077253712 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:51.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.240+0000 7fcd8ffff640 1 --2- 172.21.15.55:0/3077253712 >> v2:172.21.15.55:3300/0 conn(0x7fcd9015f4e0 0x7fcd900b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.240+0000 7fcd8ffff640 1 -- 172.21.15.55:0/3077253712 >> v1:172.21.15.138:6789/0 conn(0x7fcd900b4250 legacy=0x7fcd9015c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:51.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.240+0000 7fcd8ffff640 1 -- 172.21.15.55:0/3077253712 >> v1:172.21.15.55:6789/0 conn(0x7fcd9015b9d0 legacy=0x7fcd900ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.240+0000 7fcd8ffff640 1 -- 172.21.15.55:0/3077253712 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900b4670 con 0x7fcd9015f4e0 2023-07-06T22:18:51.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.240+0000 7fcd8f7fe640 1 -- 172.21.15.55:0/3077253712 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876455385 0 0) 0x7fcd9006a160 con 0x7fcd9015b9d0 2023-07-06T22:18:51.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.244+0000 7fcd8ffff640 1 --2- 172.21.15.55:0/3077253712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd9015f4e0 0x7fcd900b3d10 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0097c0 tx=0x7fcd7c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d137f4041c0dfc40 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:51.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.244+0000 7fcd8f7fe640 1 -- 172.21.15.55:0/3077253712 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0ab610 con 0x7fcd9015f4e0 2023-07-06T22:18:51.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.244+0000 7fcd8f7fe640 1 -- 172.21.15.55:0/3077253712 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c0ab770 con 0x7fcd9015f4e0 2023-07-06T22:18:51.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.244+0000 7fcd8f7fe640 1 -- 172.21.15.55:0/3077253712 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0abb00 con 0x7fcd9015f4e0 2023-07-06T22:18:51.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.244+0000 7fcd96d82640 1 -- 172.21.15.55:0/3077253712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd9015f4e0 msgr2=0x7fcd900b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.244+0000 7fcd96d82640 1 --2- 172.21.15.55:0/3077253712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd9015f4e0 0x7fcd900b3d10 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0097c0 tx=0x7fcd7c01c410 comp rx=0 tx=0).stop 2023-07-06T22:18:51.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.244+0000 7fcd96d82640 1 -- 172.21.15.55:0/3077253712 shutdown_connections 2023-07-06T22:18:51.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.244+0000 7fcd96d82640 1 --2- 172.21.15.55:0/3077253712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd9015f4e0 0x7fcd900b3d10 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.244+0000 7fcd96d82640 1 -- 172.21.15.55:0/3077253712 >> 172.21.15.55:0/3077253712 conn(0x7fcd900ced10 msgr2=0x7fcd900cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:51.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.244+0000 7fcd96d82640 1 -- 172.21.15.55:0/3077253712 shutdown_connections 2023-07-06T22:18:51.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.244+0000 7fcd96d82640 1 -- 172.21.15.55:0/3077253712 wait complete. 2023-07-06T22:18:51.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd96d82640 1 Processor -- start 2023-07-06T22:18:51.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd96d82640 1 -- start start 2023-07-06T22:18:51.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd96d82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd900b4250 0x7fcd90160630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd96d82640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9015b9d0 0x7fcd900b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd96d82640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd9015f4e0 0x7fcd90152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd96d82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900cafc0 con 0x7fcd900b4250 2023-07-06T22:18:51.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd96d82640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900cb2a0 con 0x7fcd9015b9d0 2023-07-06T22:18:51.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd96d82640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900cb580 con 0x7fcd9015f4e0 2023-07-06T22:18:51.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd94b1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd900b4250 0x7fcd90160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd94b1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd900b4250 0x7fcd90160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37298/0 (socket says 172.21.15.55:37298) 2023-07-06T22:18:51.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd94b1e640 1 -- 172.21.15.55:0/3144685123 learned_addr learned my addr 172.21.15.55:0/3144685123 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:51.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd8ffff640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9015b9d0 0x7fcd900b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd9531f640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd9015f4e0 0x7fcd90152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd94b1e640 1 -- 172.21.15.55:0/3144685123 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd9015f4e0 msgr2=0x7fcd90152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd94b1e640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd9015f4e0 0x7fcd90152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd94b1e640 1 -- 172.21.15.55:0/3144685123 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9015b9d0 msgr2=0x7fcd900b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd94b1e640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9015b9d0 0x7fcd900b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd94b1e640 1 -- 172.21.15.55:0/3144685123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c009420 con 0x7fcd900b4250 2023-07-06T22:18:51.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd9531f640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd9015f4e0 0x7fcd90152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:18:51.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd94b1e640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd900b4250 0x7fcd90160630 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fcd840011f0 tx=0x7fcd8400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:51.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd8d7fa640 1 -- 172.21.15.55:0/3144685123 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd840074e0 con 0x7fcd900b4250 2023-07-06T22:18:51.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd8d7fa640 1 -- 172.21.15.55:0/3144685123 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd84007640 con 0x7fcd900b4250 2023-07-06T22:18:51.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd8d7fa640 1 -- 172.21.15.55:0/3144685123 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84004a10 con 0x7fcd900b4250 2023-07-06T22:18:51.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd96d82640 1 -- 172.21.15.55:0/3144685123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd900cb860 con 0x7fcd900b4250 2023-07-06T22:18:51.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.248+0000 7fcd96d82640 1 -- 172.21.15.55:0/3144685123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd900b6710 con 0x7fcd900b4250 2023-07-06T22:18:51.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.252+0000 7fcd96d82640 1 -- 172.21.15.55:0/3144685123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd90066d60 con 0x7fcd900b4250 2023-07-06T22:18:51.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.252+0000 7fcd8d7fa640 1 -- 172.21.15.55:0/3144685123 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcd84004b70 con 0x7fcd900b4250 2023-07-06T22:18:51.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.252+0000 7fcd8d7fa640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fcd740663a0 0x7fcd74068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:51.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.252+0000 7fcd8d7fa640 1 -- 172.21.15.55:0/3144685123 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fcd84083240 con 0x7fcd900b4250 2023-07-06T22:18:51.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.252+0000 7fcd8ffff640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fcd740663a0 0x7fcd74068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:51.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.252+0000 7fcd8ffff640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fcd740663a0 0x7fcd74068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0af000 tx=0x7fcd7c0a7000 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:51.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.256+0000 7fcd8d7fa640 1 -- 172.21.15.55:0/3144685123 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd840504f0 con 0x7fcd900b4250 2023-07-06T22:18:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.444+0000 7fcd96d82640 1 -- 172.21.15.55:0/3144685123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcd900cb100 con 0x7fcd900b4250 2023-07-06T22:18:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.444+0000 7fcd8d7fa640 1 -- 172.21.15.55:0/3144685123 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v79) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcd900cb100 con 0x7fcd900b4250 2023-07-06T22:18:51.447 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T22:18:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.448+0000 7fcd96d82640 1 -- 172.21.15.55:0/3144685123 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fcd740663a0 msgr2=0x7fcd74068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.448+0000 7fcd96d82640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fcd740663a0 0x7fcd74068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0af000 tx=0x7fcd7c0a7000 comp rx=0 tx=0).stop 2023-07-06T22:18:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.448+0000 7fcd96d82640 1 -- 172.21.15.55:0/3144685123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd900b4250 msgr2=0x7fcd90160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.448+0000 7fcd96d82640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd900b4250 0x7fcd90160630 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fcd840011f0 tx=0x7fcd8400c9b0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.448+0000 7fcd96d82640 1 -- 172.21.15.55:0/3144685123 shutdown_connections 2023-07-06T22:18:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.448+0000 7fcd96d82640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7fcd740663a0 0x7fcd74068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.448+0000 7fcd96d82640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd9015f4e0 0x7fcd90152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.448+0000 7fcd96d82640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd9015b9d0 0x7fcd900b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.448+0000 7fcd96d82640 1 --2- 172.21.15.55:0/3144685123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd900b4250 0x7fcd90160630 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.448+0000 7fcd96d82640 1 -- 172.21.15.55:0/3144685123 >> 172.21.15.55:0/3144685123 conn(0x7fcd900ced10 msgr2=0x7fcd90153050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.448+0000 7fcd96d82640 1 -- 172.21.15.55:0/3144685123 shutdown_connections 2023-07-06T22:18:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:51.448+0000 7fcd96d82640 1 -- 172.21.15.55:0/3144685123 wait complete. 2023-07-06T22:18:51.467 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T22:18:51.468 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T22:18:51.468 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-07-06T22:18:51.468 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T22:18:51.469 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T22:18:51.469 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T22:18:51.469 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-06T22:18:51.469 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T22:18:51.470 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:18:51.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:51.470 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-07-06T22:18:51.480 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T22:18:51.480 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T22:18:51.480 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T22:18:51.480 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:18:51.480 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T22:18:51.480 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:18:51.481 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:18:51.481 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:18:51.481 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-07-06T22:18:51.481 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:18:51.481 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:18:51.481 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-07-06T22:18:51.481 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T22:18:51.481 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:18:51.482 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-07-06T22:18:51.482 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-06T22:18:51.482 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 40225sec preferred_lft 40225sec 2023-07-06T22:18:51.482 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-07-06T22:18:51.482 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:18:51.482 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:18:51.482 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:18:51.483 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-07-06T22:18:51.483 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T22:18:51.483 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:84:fe:b8:21 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:18:51.483 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T22:18:51.483 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:18:51.483 INFO:teuthology.orchestra.run.smithi055.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T22:18:51.483 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-06T22:18:51.483 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T22:18:51.484 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:18:51.484 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-06T22:18:51.484 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:18:51.484 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T22:18:51.484 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T22:18:51.484 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-06T22:18:51.484 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:18:51.484 INFO:teuthology.orchestra.run.smithi055.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T22:18:51.485 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T22:18:51.485 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-06T22:18:51.485 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:18:51.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:51.486 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T22:18:51.550 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-07-06T22:18:51.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:51.552 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-07-06T22:18:51.609 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-07-06T22:18:51.609 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T22:18:51.609 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-06T22:18:51.609 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T22:18:51.610 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-06T22:18:51.610 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T22:18:51.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:51.610 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T22:18:51.611 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T22:18:51.611 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T22:18:51.611 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T22:18:51.612 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T22:18:51.612 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T22:18:51.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:51.708 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T22:18:51.717 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T22:18:51.717 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T22:18:51.718 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:18:51.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:51.719 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-07-06T22:18:51.780 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T22:18:51.780 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T22:18:51.831 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:18:51.832 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T22:18:51.832 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T22:18:51.883 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-06T22:18:51.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:51.883 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:18:51.979 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:18:51.979 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T22:18:51.992 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:18:51.992 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T22:18:51.992 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-07-06T22:18:51.992 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.cephfs=/ 2023-07-06T22:18:51.992 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-07-06T22:18:51.995 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T22:18:51.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:51.996 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T22:18:52.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:52.018 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T22:18:52.082 INFO:teuthology.orchestra.run.smithi055.stdout:client8540 2023-07-06T22:18:52.082 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:18:52.082 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:18:52.135 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-06T22:18:52.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.324+0000 7f9ef28cb640 1 Processor -- start 2023-07-06T22:18:52.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.324+0000 7f9ef28cb640 1 -- start start 2023-07-06T22:18:52.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9ef28cb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9eec0cd510 0x7f9eec0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9ef28cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eec0cbd50 0x7f9eec15fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9ef28cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec06c9e0 con 0x7f9eec069db0 2023-07-06T22:18:52.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9ef28cb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eec06d080 con 0x7f9eec0cd510 2023-07-06T22:18:52.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9ef28cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0adc60 con 0x7f9eec0cbd50 2023-07-06T22:18:52.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9eec069db0 0x7f9eec15f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42774/0 (socket says 172.21.15.55:42774) 2023-07-06T22:18:52.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeb7fe640 1 -- 172.21.15.55:0/3417147478 learned_addr learned my addr 172.21.15.55:0/3417147478 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:52.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9ef0e68640 1 --2- 172.21.15.55:0/3417147478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eec0cbd50 0x7f9eec15fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3417147478 >> v2:172.21.15.138:3300/0 conn(0x7f9eec0cd510 0x7f9eec0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 -- 172.21.15.55:0/3417147478 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787253232 0 0) 0x7f9eec06c9e0 con 0x7f9eec069db0 2023-07-06T22:18:52.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 -- 172.21.15.55:0/3417147478 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ed4003530 con 0x7f9eec069db0 2023-07-06T22:18:52.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 -- 172.21.15.55:0/3417147478 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 656671889 0 0) 0x7f9ed4003530 con 0x7f9eec069db0 2023-07-06T22:18:52.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 -- 172.21.15.55:0/3417147478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eec0cbd50 msgr2=0x7f9eec15fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:52.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 --2- 172.21.15.55:0/3417147478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eec0cbd50 0x7f9eec15fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 -- 172.21.15.55:0/3417147478 >> v2:172.21.15.138:3300/0 conn(0x7f9eec0cd510 msgr2=0x7f9eec0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:52.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 --2- 172.21.15.55:0/3417147478 >> v2:172.21.15.138:3300/0 conn(0x7f9eec0cd510 0x7f9eec0cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 -- 172.21.15.55:0/3417147478 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec0cde20 con 0x7f9eec069db0 2023-07-06T22:18:52.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 -- 172.21.15.55:0/3417147478 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f9ee0001680 con 0x7f9eec069db0 2023-07-06T22:18:52.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 -- 172.21.15.55:0/3417147478 >> v1:172.21.15.55:6789/0 conn(0x7f9eec069db0 legacy=0x7f9eec15f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:52.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 --2- 172.21.15.55:0/3417147478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed4003980 0x7f9ed4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 --2- 172.21.15.55:0/3417147478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ed40043b0 0x7f9ed4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 --2- 172.21.15.55:0/3417147478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed4004f80 0x7f9ed400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 -- 172.21.15.55:0/3417147478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec06d080 con 0x7f9ed4003980 2023-07-06T22:18:52.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 -- 172.21.15.55:0/3417147478 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0adc60 con 0x7f9ed40043b0 2023-07-06T22:18:52.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeaffd640 1 -- 172.21.15.55:0/3417147478 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed400bed0 con 0x7f9ed4004f80 2023-07-06T22:18:52.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9ef0e68640 1 --2- 172.21.15.55:0/3417147478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9eec0cbd50 0x7f9eec15fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:52.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3417147478 >> v2:172.21.15.138:3300/0 conn(0x7f9eec0cd510 0x7f9eec0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:52.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3417147478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed4003980 0x7f9ed4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eeb7fe640 1 --2- 172.21.15.55:0/3417147478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ed40043b0 0x7f9ed4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9ef0e68640 1 --2- 172.21.15.55:0/3417147478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed4004f80 0x7f9ed400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eebfff640 1 -- 172.21.15.55:0/3417147478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed4004f80 msgr2=0x7f9ed400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:52.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3417147478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed4004f80 0x7f9ed400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eebfff640 1 -- 172.21.15.55:0/3417147478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ed40043b0 msgr2=0x7f9ed4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:52.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3417147478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ed40043b0 0x7f9ed4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.328+0000 7f9eebfff640 1 -- 172.21.15.55:0/3417147478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed4003530 con 0x7f9ed4003980 2023-07-06T22:18:52.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.332+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3417147478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed4003980 0x7f9ed4003d90 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009c90 tx=0x7f9edc01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada32deb31ad463a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:52.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.332+0000 7f9eeaffd640 1 -- 172.21.15.55:0/3417147478 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc004020 con 0x7f9ed4003980 2023-07-06T22:18:52.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.332+0000 7f9eeaffd640 1 -- 172.21.15.55:0/3417147478 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc004180 con 0x7f9ed4003980 2023-07-06T22:18:52.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.332+0000 7f9eeaffd640 1 -- 172.21.15.55:0/3417147478 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0a58f0 con 0x7f9ed4003980 2023-07-06T22:18:52.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.332+0000 7f9ef28cb640 1 -- 172.21.15.55:0/3417147478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed4003980 msgr2=0x7f9ed4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:52.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.332+0000 7f9ef28cb640 1 --2- 172.21.15.55:0/3417147478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ed4003980 0x7f9ed4003d90 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009c90 tx=0x7f9edc01cc50 comp rx=0 tx=0).stop 2023-07-06T22:18:52.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.332+0000 7f9ef0e68640 1 -- 172.21.15.55:0/3417147478 reap_dead start 2023-07-06T22:18:52.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.332+0000 7f9ef28cb640 1 -- 172.21.15.55:0/3417147478 shutdown_connections 2023-07-06T22:18:52.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.332+0000 7f9ef28cb640 1 -- 172.21.15.55:0/3417147478 >> 172.21.15.55:0/3417147478 conn(0x7f9eec0afe60 msgr2=0x7f9eec0b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:52.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.332+0000 7f9ef28cb640 1 -- 172.21.15.55:0/3417147478 shutdown_connections 2023-07-06T22:18:52.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.332+0000 7f9ef28cb640 1 -- 172.21.15.55:0/3417147478 wait complete. 2023-07-06T22:18:52.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9ef28cb640 1 Processor -- start 2023-07-06T22:18:52.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9ef28cb640 1 -- start start 2023-07-06T22:18:52.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9ef28cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed4003980 0x7f9eec0b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9ef28cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eec15a1e0 0x7f9eec0ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9ef28cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9eec15a650 0x7f9eec0acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9ef28cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec14e570 con 0x7f9eec15a1e0 2023-07-06T22:18:52.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9ef28cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0b1160 con 0x7f9eec15a650 2023-07-06T22:18:52.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9ef28cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec161dc0 con 0x7f9ed4003980 2023-07-06T22:18:52.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9eeb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eec15a1e0 0x7f9eec0ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9eeb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eec15a1e0 0x7f9eec0ac9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37318/0 (socket says 172.21.15.55:37318) 2023-07-06T22:18:52.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9eeb7fe640 1 -- 172.21.15.55:0/26736308 learned_addr learned my addr 172.21.15.55:0/26736308 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:52.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9eebfff640 1 --2- 172.21.15.55:0/26736308 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed4003980 0x7f9eec0b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9ef0e68640 1 --2- 172.21.15.55:0/26736308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9eec15a650 0x7f9eec0acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9eeb7fe640 1 -- 172.21.15.55:0/26736308 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed4003980 msgr2=0x7f9eec0b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:52.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9eeb7fe640 1 --2- 172.21.15.55:0/26736308 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed4003980 0x7f9eec0b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9eeb7fe640 1 -- 172.21.15.55:0/26736308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9eec15a650 msgr2=0x7f9eec0acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:52.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9eeb7fe640 1 --2- 172.21.15.55:0/26736308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9eec15a650 0x7f9eec0acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9eeb7fe640 1 -- 172.21.15.55:0/26736308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec158e70 con 0x7f9eec15a1e0 2023-07-06T22:18:52.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9eeb7fe640 1 --2- 172.21.15.55:0/26736308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eec15a1e0 0x7f9eec0ac9e0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0004ed0 tx=0x7f9ee0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:52.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9ee8ff9640 1 -- 172.21.15.55:0/26736308 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000f7b0 con 0x7f9eec15a1e0 2023-07-06T22:18:52.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9ee8ff9640 1 -- 172.21.15.55:0/26736308 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee000f910 con 0x7f9eec15a1e0 2023-07-06T22:18:52.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9ee8ff9640 1 -- 172.21.15.55:0/26736308 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000fca0 con 0x7f9eec15a1e0 2023-07-06T22:18:52.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9ef28cb640 1 -- 172.21.15.55:0/26736308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec159150 con 0x7f9eec15a1e0 2023-07-06T22:18:52.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.336+0000 7f9ef28cb640 1 -- 172.21.15.55:0/26736308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec159710 con 0x7f9eec15a1e0 2023-07-06T22:18:52.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.340+0000 7f9ef28cb640 1 -- 172.21.15.55:0/26736308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec1598d0 con 0x7f9eec15a1e0 2023-07-06T22:18:52.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.340+0000 7f9ee8ff9640 1 -- 172.21.15.55:0/26736308 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9ee001d460 con 0x7f9eec15a1e0 2023-07-06T22:18:52.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.340+0000 7f9ee8ff9640 1 --2- 172.21.15.55:0/26736308 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9ed80663a0 0x7f9ed8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.340+0000 7f9ee8ff9640 1 -- 172.21.15.55:0/26736308 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9ee0083fb0 con 0x7f9eec15a1e0 2023-07-06T22:18:52.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.340+0000 7f9eebfff640 1 --2- 172.21.15.55:0/26736308 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9ed80663a0 0x7f9ed8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.340+0000 7f9eebfff640 1 --2- 172.21.15.55:0/26736308 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9ed80663a0 0x7f9ed8068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0ae000 tx=0x7f9edc0046d0 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:52.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.344+0000 7f9ee8ff9640 1 -- 172.21.15.55:0/26736308 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ee00511d0 con 0x7f9eec15a1e0 2023-07-06T22:18:52.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.520+0000 7f9ef28cb640 1 -- 172.21.15.55:0/26736308 --> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9eec06cca0 con 0x7f9ed80663a0 2023-07-06T22:18:52.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.520+0000 7f9ee8ff9640 1 -- 172.21.15.55:0/26736308 <== mgr.10167 v2:172.21.15.55:6832/957337795 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9edc0be080 con 0x7f9ed80663a0 2023-07-06T22:18:52.523 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T22:18:52.524 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:18:52.524 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-07-06T22:18:52.524 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:18:52.524 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T22:18:52.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.524+0000 7f9ef28cb640 1 -- 172.21.15.55:0/26736308 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9ed80663a0 msgr2=0x7f9ed8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:52.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.524+0000 7f9ef28cb640 1 --2- 172.21.15.55:0/26736308 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9ed80663a0 0x7f9ed8068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0ae000 tx=0x7f9edc0046d0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.524+0000 7f9ef28cb640 1 -- 172.21.15.55:0/26736308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eec15a1e0 msgr2=0x7f9eec0ac9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:52.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.524+0000 7f9ef28cb640 1 --2- 172.21.15.55:0/26736308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eec15a1e0 0x7f9eec0ac9e0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0004ed0 tx=0x7f9ee0007430 comp rx=0 tx=0).stop 2023-07-06T22:18:52.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.524+0000 7f9ef28cb640 1 -- 172.21.15.55:0/26736308 shutdown_connections 2023-07-06T22:18:52.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.524+0000 7f9ef28cb640 1 --2- 172.21.15.55:0/26736308 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f9ed80663a0 0x7f9ed8068850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.524+0000 7f9ef28cb640 1 --2- 172.21.15.55:0/26736308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9eec15a650 0x7f9eec0acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.524+0000 7f9ef28cb640 1 --2- 172.21.15.55:0/26736308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eec15a1e0 0x7f9eec0ac9e0 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.524+0000 7f9ef28cb640 1 --2- 172.21.15.55:0/26736308 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ed4003980 0x7f9eec0b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.524+0000 7f9ef28cb640 1 -- 172.21.15.55:0/26736308 >> 172.21.15.55:0/26736308 conn(0x7f9eec0afe60 msgr2=0x7f9eec06fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:52.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.524+0000 7f9ef28cb640 1 -- 172.21.15.55:0/26736308 shutdown_connections 2023-07-06T22:18:52.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.524+0000 7f9ef28cb640 1 -- 172.21.15.55:0/26736308 wait complete. 2023-07-06T22:18:52.544 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-06T22:18:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4daf8cb640 1 Processor -- start 2023-07-06T22:18:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4daf8cb640 1 -- start start 2023-07-06T22:18:52.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4daf8cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4da815b850 0x7f4da80cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4daf8cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4da80ccd30 0x7f4da80b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4daf8cb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da80b4210 con 0x7f4da80b3db0 2023-07-06T22:18:52.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4daf8cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da80b2b80 con 0x7f4da80ccd30 2023-07-06T22:18:52.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4daf8cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80cff30 con 0x7f4da815b850 2023-07-06T22:18:52.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4dace66640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4da80ccd30 0x7f4da80b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4dace66640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4da80ccd30 0x7f4da80b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37324/0 (socket says 172.21.15.55:37324) 2023-07-06T22:18:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4dace66640 1 -- 172.21.15.55:0/2597845938 learned_addr learned my addr 172.21.15.55:0/2597845938 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4dad667640 1 --2- 172.21.15.55:0/2597845938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4da815b850 0x7f4da80cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4dace66640 1 -- 172.21.15.55:0/2597845938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4da815b850 msgr2=0x7f4da80cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:52.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4dace66640 1 --2- 172.21.15.55:0/2597845938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4da815b850 0x7f4da80cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4dace66640 1 -- 172.21.15.55:0/2597845938 >> v1:172.21.15.138:6789/0 conn(0x7f4da80b3db0 legacy=0x7f4da815f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:52.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.688+0000 7f4dace66640 1 -- 172.21.15.55:0/2597845938 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da80b22e0 con 0x7f4da80ccd30 2023-07-06T22:18:52.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.692+0000 7f4dace66640 1 --2- 172.21.15.55:0/2597845938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80ccd30 0x7f4da80b3870 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009870 tx=0x7f4d9801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69c249c4fe1c54e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:52.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.692+0000 7f4d9ffff640 1 -- 172.21.15.55:0/2597845938 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d980ab5f0 con 0x7f4da80ccd30 2023-07-06T22:18:52.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.692+0000 7f4d9ffff640 1 -- 172.21.15.55:0/2597845938 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d980ab750 con 0x7f4da80ccd30 2023-07-06T22:18:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.692+0000 7f4d9ffff640 1 -- 172.21.15.55:0/2597845938 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d980abae0 con 0x7f4da80ccd30 2023-07-06T22:18:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.692+0000 7f4daf8cb640 1 -- 172.21.15.55:0/2597845938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80ccd30 msgr2=0x7f4da80b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.692+0000 7f4daf8cb640 1 --2- 172.21.15.55:0/2597845938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80ccd30 0x7f4da80b3870 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009870 tx=0x7f4d9801c3f0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.692+0000 7f4daf8cb640 1 -- 172.21.15.55:0/2597845938 shutdown_connections 2023-07-06T22:18:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.692+0000 7f4daf8cb640 1 --2- 172.21.15.55:0/2597845938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80ccd30 0x7f4da80b3870 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.692+0000 7f4daf8cb640 1 --2- 172.21.15.55:0/2597845938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4da815b850 0x7f4da80cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.692+0000 7f4daf8cb640 1 -- 172.21.15.55:0/2597845938 >> 172.21.15.55:0/2597845938 conn(0x7f4da80cec20 msgr2=0x7f4da80cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.692+0000 7f4daf8cb640 1 -- 172.21.15.55:0/2597845938 shutdown_connections 2023-07-06T22:18:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.692+0000 7f4daf8cb640 1 -- 172.21.15.55:0/2597845938 wait complete. 2023-07-06T22:18:52.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4daf8cb640 1 Processor -- start 2023-07-06T22:18:52.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4daf8cb640 1 -- start start 2023-07-06T22:18:52.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4daf8cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80b3db0 0x7f4da806a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4daf8cb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4da80ccd30 0x7f4da814e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4daf8cb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4da815b850 0x7f4da80b74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4daf8cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da814f0e0 con 0x7f4da80b3db0 2023-07-06T22:18:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4daf8cb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8157220 con 0x7f4da80ccd30 2023-07-06T22:18:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4daf8cb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8157500 con 0x7f4da815b850 2023-07-06T22:18:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4dad667640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80b3db0 0x7f4da806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4dad667640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80b3db0 0x7f4da806a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37332/0 (socket says 172.21.15.55:37332) 2023-07-06T22:18:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4dad667640 1 -- 172.21.15.55:0/3664275097 learned_addr learned my addr 172.21.15.55:0/3664275097 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4dace66640 1 --2- 172.21.15.55:0/3664275097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4da80ccd30 0x7f4da814e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4dade68640 1 --2- 172.21.15.55:0/3664275097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4da815b850 0x7f4da80b74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4dad667640 1 -- 172.21.15.55:0/3664275097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4da815b850 msgr2=0x7f4da80b74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:52.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4dad667640 1 --2- 172.21.15.55:0/3664275097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4da815b850 0x7f4da80b74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4dad667640 1 -- 172.21.15.55:0/3664275097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4da80ccd30 msgr2=0x7f4da814e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:52.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4dad667640 1 --2- 172.21.15.55:0/3664275097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4da80ccd30 0x7f4da814e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:52.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4dad667640 1 -- 172.21.15.55:0/3664275097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d980094d0 con 0x7f4da80b3db0 2023-07-06T22:18:52.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4dad667640 1 --2- 172.21.15.55:0/3664275097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80b3db0 0x7f4da806a950 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f4da400e870 tx=0x7f4da400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:52.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4d9dffb640 1 -- 172.21.15.55:0/3664275097 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4009510 con 0x7f4da80b3db0 2023-07-06T22:18:52.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4d9dffb640 1 -- 172.21.15.55:0/3664275097 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da400eec0 con 0x7f4da80b3db0 2023-07-06T22:18:52.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4daf8cb640 1 -- 172.21.15.55:0/3664275097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da815bda0 con 0x7f4da80b3db0 2023-07-06T22:18:52.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4d9dffb640 1 -- 172.21.15.55:0/3664275097 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da400cb40 con 0x7f4da80b3db0 2023-07-06T22:18:52.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.696+0000 7f4daf8cb640 1 -- 172.21.15.55:0/3664275097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da81567b0 con 0x7f4da80b3db0 2023-07-06T22:18:52.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.700+0000 7f4daf8cb640 1 -- 172.21.15.55:0/3664275097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da806a7a0 con 0x7f4da80b3db0 2023-07-06T22:18:52.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.700+0000 7f4d9dffb640 1 -- 172.21.15.55:0/3664275097 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4da400cca0 con 0x7f4da80b3db0 2023-07-06T22:18:52.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.700+0000 7f4d9dffb640 1 --2- 172.21.15.55:0/3664275097 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4d8c0663a0 0x7f4d8c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:52.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.700+0000 7f4d9dffb640 1 -- 172.21.15.55:0/3664275097 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f4da4083ff0 con 0x7f4da80b3db0 2023-07-06T22:18:52.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.700+0000 7f4dace66640 1 --2- 172.21.15.55:0/3664275097 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4d8c0663a0 0x7f4d8c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:52.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.704+0000 7f4dace66640 1 --2- 172.21.15.55:0/3664275097 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4d8c0663a0 0x7f4d8c068850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4d980af000 tx=0x7f4d980b6040 comp rx=0 tx=0).ready entity=mgr.10167 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:52.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.704+0000 7f4d9dffb640 1 -- 172.21.15.55:0/3664275097 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4da40b4700 con 0x7f4da80b3db0 2023-07-06T22:18:52.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:52.904+0000 7f4daf8cb640 1 -- 172.21.15.55:0/3664275097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f4da8066d60 con 0x7f4da80b3db0 2023-07-06T22:18:53.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.160+0000 7f4d9dffb640 1 -- 172.21.15.55:0/3664275097 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 96) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f4da40516b0 con 0x7f4da80b3db0 2023-07-06T22:18:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.164+0000 7f4d9dffb640 1 -- 172.21.15.55:0/3664275097 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v96) v1 ==== 92+0+0 (secure 0 0 0) 0x7f4da406db70 con 0x7f4da80b3db0 2023-07-06T22:18:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.164+0000 7f4daf8cb640 1 -- 172.21.15.55:0/3664275097 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4d8c0663a0 msgr2=0x7f4d8c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.164+0000 7f4daf8cb640 1 --2- 172.21.15.55:0/3664275097 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4d8c0663a0 0x7f4d8c068850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4d980af000 tx=0x7f4d980b6040 comp rx=0 tx=0).stop 2023-07-06T22:18:53.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.164+0000 7f4daf8cb640 1 -- 172.21.15.55:0/3664275097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80b3db0 msgr2=0x7f4da806a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:53.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.164+0000 7f4daf8cb640 1 --2- 172.21.15.55:0/3664275097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80b3db0 0x7f4da806a950 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f4da400e870 tx=0x7f4da400ec70 comp rx=0 tx=0).stop 2023-07-06T22:18:53.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.164+0000 7f4daf8cb640 1 -- 172.21.15.55:0/3664275097 shutdown_connections 2023-07-06T22:18:53.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.164+0000 7f4daf8cb640 1 --2- 172.21.15.55:0/3664275097 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f4d8c0663a0 0x7f4d8c068850 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.164+0000 7f4daf8cb640 1 --2- 172.21.15.55:0/3664275097 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4da815b850 0x7f4da80b74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.164+0000 7f4daf8cb640 1 --2- 172.21.15.55:0/3664275097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4da80ccd30 0x7f4da814e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.164+0000 7f4daf8cb640 1 --2- 172.21.15.55:0/3664275097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80b3db0 0x7f4da806a950 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.164+0000 7f4daf8cb640 1 -- 172.21.15.55:0/3664275097 >> 172.21.15.55:0/3664275097 conn(0x7f4da80cec20 msgr2=0x7f4da81579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:53.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.164+0000 7f4daf8cb640 1 -- 172.21.15.55:0/3664275097 shutdown_connections 2023-07-06T22:18:53.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.164+0000 7f4daf8cb640 1 -- 172.21.15.55:0/3664275097 wait complete. 2023-07-06T22:18:53.187 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-06T22:18:53.333 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:53.329+0000 7f26b0b20180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:18:53.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.336+0000 7ff440d74640 1 Processor -- start 2023-07-06T22:18:53.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.336+0000 7ff440d74640 1 -- start start 2023-07-06T22:18:53.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff440d74640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff43c0b3870 0x7ff43c0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:53.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff440d74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff43c0d03c0 0x7ff43c0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:53.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff440d74640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43c0b4210 con 0x7ff43c15b850 2023-07-06T22:18:53.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff440d74640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43c0b2b80 con 0x7ff43c0b3870 2023-07-06T22:18:53.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff440d74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c0cff30 con 0x7ff43c0d03c0 2023-07-06T22:18:53.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff433fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff43c0b3870 0x7ff43c0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:53.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff433fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff43c0b3870 0x7ff43c0b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:60358/0 (socket says 172.21.15.55:60358) 2023-07-06T22:18:53.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff433fff640 1 -- 172.21.15.55:0/3606536536 learned_addr learned my addr 172.21.15.55:0/3606536536 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:53.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff43a59c640 1 --1- 172.21.15.55:0/3606536536 >> v1:172.21.15.138:6789/0 conn(0x7ff43c15b850 0x7ff43c0cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:59832/0 (socket says 172.21.15.55:59832) 2023-07-06T22:18:53.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff43ad9d640 1 --2- 172.21.15.55:0/3606536536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff43c0d03c0 0x7ff43c0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:53.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff43ad9d640 1 -- 172.21.15.55:0/3606536536 >> v2:172.21.15.138:3300/0 conn(0x7ff43c0b3870 msgr2=0x7ff43c0b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:53.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff43ad9d640 1 --2- 172.21.15.55:0/3606536536 >> v2:172.21.15.138:3300/0 conn(0x7ff43c0b3870 0x7ff43c0b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff43ad9d640 1 -- 172.21.15.55:0/3606536536 >> v1:172.21.15.138:6789/0 conn(0x7ff43c15b850 legacy=0x7ff43c0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:53.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff43ad9d640 1 -- 172.21.15.55:0/3606536536 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c0b22e0 con 0x7ff43c0d03c0 2023-07-06T22:18:53.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.340+0000 7ff433fff640 1 --2- 172.21.15.55:0/3606536536 >> v2:172.21.15.138:3300/0 conn(0x7ff43c0b3870 0x7ff43c0b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:53.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.344+0000 7ff43ad9d640 1 --2- 172.21.15.55:0/3606536536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff43c0d03c0 0x7ff43c0d0800 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff434009d90 tx=0x7ff43401c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3ee81e78f6dc92c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:53.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.344+0000 7ff439d9b640 1 -- 172.21.15.55:0/3606536536 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340a58c0 con 0x7ff43c0d03c0 2023-07-06T22:18:53.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.344+0000 7ff439d9b640 1 -- 172.21.15.55:0/3606536536 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4340a5a20 con 0x7ff43c0d03c0 2023-07-06T22:18:53.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.344+0000 7ff439d9b640 1 -- 172.21.15.55:0/3606536536 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340a5db0 con 0x7ff43c0d03c0 2023-07-06T22:18:53.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.344+0000 7ff440d74640 1 -- 172.21.15.55:0/3606536536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff43c0d03c0 msgr2=0x7ff43c0d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:53.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.344+0000 7ff440d74640 1 --2- 172.21.15.55:0/3606536536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff43c0d03c0 0x7ff43c0d0800 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff434009d90 tx=0x7ff43401c800 comp rx=0 tx=0).stop 2023-07-06T22:18:53.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.344+0000 7ff440d74640 1 -- 172.21.15.55:0/3606536536 shutdown_connections 2023-07-06T22:18:53.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.344+0000 7ff440d74640 1 --2- 172.21.15.55:0/3606536536 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff43c0d03c0 0x7ff43c0d0800 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.344+0000 7ff440d74640 1 --2- 172.21.15.55:0/3606536536 >> v2:172.21.15.138:3300/0 conn(0x7ff43c0b3870 0x7ff43c0b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.344+0000 7ff440d74640 1 -- 172.21.15.55:0/3606536536 >> 172.21.15.55:0/3606536536 conn(0x7ff43c0cec20 msgr2=0x7ff43c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:53.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.344+0000 7ff440d74640 1 -- 172.21.15.55:0/3606536536 shutdown_connections 2023-07-06T22:18:53.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.344+0000 7ff440d74640 1 -- 172.21.15.55:0/3606536536 wait complete. 2023-07-06T22:18:53.347 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:53.344+0000 7fca29e2c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:18:53.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.344+0000 7ff440d74640 1 Processor -- start 2023-07-06T22:18:53.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.344+0000 7ff440d74640 1 -- start start 2023-07-06T22:18:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff440d74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c0b3870 0x7ff43c15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff440d74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff43c0d03c0 0x7ff43c1f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff440d74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff43c15b850 0x7ff43c15f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:53.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff440d74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c159a60 con 0x7ff43c0b3870 2023-07-06T22:18:53.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff440d74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c1f82d0 con 0x7ff43c15b850 2023-07-06T22:18:53.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff440d74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c1542c0 con 0x7ff43c0d03c0 2023-07-06T22:18:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff43a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c0b3870 0x7ff43c15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff43a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c0b3870 0x7ff43c15ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40798/0 (socket says 172.21.15.55:40798) 2023-07-06T22:18:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff43a59c640 1 -- 172.21.15.55:0/2202508806 learned_addr learned my addr 172.21.15.55:0/2202508806 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff43ad9d640 1 --2- 172.21.15.55:0/2202508806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff43c15b850 0x7ff43c15f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff433fff640 1 --2- 172.21.15.55:0/2202508806 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff43c0d03c0 0x7ff43c1f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff43ad9d640 1 -- 172.21.15.55:0/2202508806 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff43c0d03c0 msgr2=0x7ff43c1f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff43ad9d640 1 --2- 172.21.15.55:0/2202508806 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff43c0d03c0 0x7ff43c1f7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff43ad9d640 1 -- 172.21.15.55:0/2202508806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c0b3870 msgr2=0x7ff43c15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff43ad9d640 1 --2- 172.21.15.55:0/2202508806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c0b3870 0x7ff43c15ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff43ad9d640 1 -- 172.21.15.55:0/2202508806 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4240094d0 con 0x7ff43c15b850 2023-07-06T22:18:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff433fff640 1 --2- 172.21.15.55:0/2202508806 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff43c0d03c0 0x7ff43c1f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff43ad9d640 1 --2- 172.21.15.55:0/2202508806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff43c15b850 0x7ff43c15f3b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff4340ac000 tx=0x7ff4340195a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff432ffd640 1 -- 172.21.15.55:0/2202508806 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340b9860 con 0x7ff43c15b850 2023-07-06T22:18:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff432ffd640 1 -- 172.21.15.55:0/2202508806 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4340b99c0 con 0x7ff43c15b850 2023-07-06T22:18:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff432ffd640 1 -- 172.21.15.55:0/2202508806 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340b9d30 con 0x7ff43c15b850 2023-07-06T22:18:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff440d74640 1 -- 172.21.15.55:0/2202508806 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff434009a70 con 0x7ff43c15b850 2023-07-06T22:18:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff440d74640 1 -- 172.21.15.55:0/2202508806 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c159d00 con 0x7ff43c15b850 2023-07-06T22:18:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.348+0000 7ff440d74640 1 -- 172.21.15.55:0/2202508806 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43c159ef0 con 0x7ff43c15b850 2023-07-06T22:18:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.352+0000 7ff432ffd640 1 -- 172.21.15.55:0/2202508806 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 96) v1 ==== 85777+0+0 (secure 0 0 0) 0x7ff4340ad440 con 0x7ff43c15b850 2023-07-06T22:18:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.352+0000 7ff432ffd640 1 --2- 172.21.15.55:0/2202508806 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff41c0663f0 0x7ff41c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.352+0000 7ff432ffd640 1 -- 172.21.15.55:0/2202508806 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff43411fdd0 con 0x7ff43c15b850 2023-07-06T22:18:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.352+0000 7ff43a59c640 1 -- 172.21.15.55:0/2202508806 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff41c0663f0 msgr2=0x7ff41c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/957337795 2023-07-06T22:18:53.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.352+0000 7ff43a59c640 1 --2- 172.21.15.55:0/2202508806 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff41c0663f0 0x7ff41c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:18:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.360+0000 7ff432ffd640 1 -- 172.21.15.55:0/2202508806 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4340ed220 con 0x7ff43c15b850 2023-07-06T22:18:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.516+0000 7ff440d74640 1 -- 172.21.15.55:0/2202508806 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7ff43c066d60 con 0x7ff43c15b850 2023-07-06T22:18:53.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.528+0000 7ff432ffd640 1 -- 172.21.15.55:0/2202508806 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v59)=0 v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff4340bd0d0 con 0x7ff43c15b850 2023-07-06T22:18:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.528+0000 7ff440d74640 1 -- 172.21.15.55:0/2202508806 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff41c0663f0 msgr2=0x7ff41c0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:18:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.528+0000 7ff440d74640 1 --2- 172.21.15.55:0/2202508806 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff41c0663f0 0x7ff41c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.528+0000 7ff440d74640 1 -- 172.21.15.55:0/2202508806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff43c15b850 msgr2=0x7ff43c15f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.528+0000 7ff440d74640 1 --2- 172.21.15.55:0/2202508806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff43c15b850 0x7ff43c15f3b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff4340ac000 tx=0x7ff4340195a0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.528+0000 7ff440d74640 1 -- 172.21.15.55:0/2202508806 shutdown_connections 2023-07-06T22:18:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.528+0000 7ff440d74640 1 --2- 172.21.15.55:0/2202508806 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7ff41c0663f0 0x7ff41c0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.528+0000 7ff440d74640 1 --2- 172.21.15.55:0/2202508806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff43c15b850 0x7ff43c15f3b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.528+0000 7ff440d74640 1 --2- 172.21.15.55:0/2202508806 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff43c0d03c0 0x7ff43c1f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.528+0000 7ff440d74640 1 --2- 172.21.15.55:0/2202508806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c0b3870 0x7ff43c15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.528+0000 7ff440d74640 1 -- 172.21.15.55:0/2202508806 >> 172.21.15.55:0/2202508806 conn(0x7ff43c0cec20 msgr2=0x7ff43c0cc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.528+0000 7ff440d74640 1 -- 172.21.15.55:0/2202508806 shutdown_connections 2023-07-06T22:18:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.528+0000 7ff440d74640 1 -- 172.21.15.55:0/2202508806 wait complete. 2023-07-06T22:18:53.550 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-06T22:18:53.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dc21d2640 1 Processor -- start 2023-07-06T22:18:53.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dc21d2640 1 -- start start 2023-07-06T22:18:53.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dc21d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6dbc0b7b90 0x7f6dbc0d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:53.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dc21d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc0b5070 con 0x7f6dbc0cc870 2023-07-06T22:18:53.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dc21d2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc160020 con 0x7f6dbc0b4300 2023-07-06T22:18:53.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dc21d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc1604b0 con 0x7f6dbc0b7b90 2023-07-06T22:18:53.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dbaffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6dbc0cc870 0x7f6dbc0b3bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43914/0 (socket says 172.21.15.55:43914) 2023-07-06T22:18:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dbaffd640 1 -- 172.21.15.55:0/1520669162 learned_addr learned my addr 172.21.15.55:0/1520669162 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:18:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dbb7fe640 1 --2- 172.21.15.55:0/1520669162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6dbc0b7b90 0x7f6dbc0d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dba7fc640 1 -- 172.21.15.55:0/1520669162 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035652442 0 0) 0x7f6dbc0b5070 con 0x7f6dbc0cc870 2023-07-06T22:18:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dba7fc640 1 -- 172.21.15.55:0/1520669162 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da4003530 con 0x7f6dbc0cc870 2023-07-06T22:18:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dba7fc640 1 -- 172.21.15.55:0/1520669162 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426882618 0 0) 0x7f6dbc160020 con 0x7f6dbc0b4300 2023-07-06T22:18:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dba7fc640 1 -- 172.21.15.55:0/1520669162 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dbc0b5070 con 0x7f6dbc0b4300 2023-07-06T22:18:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dbb7fe640 1 -- 172.21.15.55:0/1520669162 >> v1:172.21.15.138:6789/0 conn(0x7f6dbc0b4300 legacy=0x7f6dbc0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:53.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dbb7fe640 1 -- 172.21.15.55:0/1520669162 >> v1:172.21.15.55:6789/0 conn(0x7f6dbc0cc870 legacy=0x7f6dbc0b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:53.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.696+0000 7f6dbb7fe640 1 -- 172.21.15.55:0/1520669162 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc0cd030 con 0x7f6dbc0b7b90 2023-07-06T22:18:53.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.700+0000 7f6dbb7fe640 1 --2- 172.21.15.55:0/1520669162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6dbc0b7b90 0x7f6dbc0d1c40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0097f0 tx=0x7f6dac01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfcf646a5258fc59 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:53.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.700+0000 7f6dba7fc640 1 -- 172.21.15.55:0/1520669162 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0aa5f0 con 0x7f6dbc0b7b90 2023-07-06T22:18:53.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.700+0000 7f6dba7fc640 1 -- 172.21.15.55:0/1520669162 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac0aa750 con 0x7f6dbc0b7b90 2023-07-06T22:18:53.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.700+0000 7f6dba7fc640 1 -- 172.21.15.55:0/1520669162 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0aaae0 con 0x7f6dbc0b7b90 2023-07-06T22:18:53.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.700+0000 7f6dc21d2640 1 -- 172.21.15.55:0/1520669162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6dbc0b7b90 msgr2=0x7f6dbc0d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:53.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.700+0000 7f6dc21d2640 1 --2- 172.21.15.55:0/1520669162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6dbc0b7b90 0x7f6dbc0d1c40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0097f0 tx=0x7f6dac01c490 comp rx=0 tx=0).stop 2023-07-06T22:18:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.700+0000 7f6dc21d2640 1 -- 172.21.15.55:0/1520669162 shutdown_connections 2023-07-06T22:18:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.700+0000 7f6dc21d2640 1 --2- 172.21.15.55:0/1520669162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6dbc0b7b90 0x7f6dbc0d1c40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.700+0000 7f6dc21d2640 1 -- 172.21.15.55:0/1520669162 >> 172.21.15.55:0/1520669162 conn(0x7f6dbc0ceca0 msgr2=0x7f6dbc0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.700+0000 7f6dc21d2640 1 -- 172.21.15.55:0/1520669162 shutdown_connections 2023-07-06T22:18:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.700+0000 7f6dc21d2640 1 -- 172.21.15.55:0/1520669162 wait complete. 2023-07-06T22:18:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dc21d2640 1 Processor -- start 2023-07-06T22:18:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dc21d2640 1 -- start start 2023-07-06T22:18:53.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dc21d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6dbc0b4300 0x7f6dbc1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dc21d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6dbc0b7b90 0x7f6dbc152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dc21d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dbc0cc870 0x7f6dbc154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dc21d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc15d570 con 0x7f6dbc0cc870 2023-07-06T22:18:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dc21d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc15d850 con 0x7f6dbc0b4300 2023-07-06T22:18:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dc21d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc15db30 con 0x7f6dbc0b7b90 2023-07-06T22:18:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dbbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dbc0cc870 0x7f6dbc154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dbbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dbc0cc870 0x7f6dbc154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40814/0 (socket says 172.21.15.55:40814) 2023-07-06T22:18:53.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dbbfff640 1 -- 172.21.15.55:0/3738581088 learned_addr learned my addr 172.21.15.55:0/3738581088 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:53.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dbaffd640 1 --2- 172.21.15.55:0/3738581088 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6dbc0b7b90 0x7f6dbc152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:53.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dbb7fe640 1 --2- 172.21.15.55:0/3738581088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6dbc0b4300 0x7f6dbc1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dbbfff640 1 -- 172.21.15.55:0/3738581088 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6dbc0b7b90 msgr2=0x7f6dbc152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dbbfff640 1 --2- 172.21.15.55:0/3738581088 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6dbc0b7b90 0x7f6dbc152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dbbfff640 1 -- 172.21.15.55:0/3738581088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6dbc0b4300 msgr2=0x7f6dbc1584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dbbfff640 1 --2- 172.21.15.55:0/3738581088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6dbc0b4300 0x7f6dbc1584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dbbfff640 1 -- 172.21.15.55:0/3738581088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac009420 con 0x7f6dbc0cc870 2023-07-06T22:18:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dbbfff640 1 --2- 172.21.15.55:0/3738581088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dbc0cc870 0x7f6dbc154500 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f6db400c730 tx=0x7f6db400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:53.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6da3fff640 1 -- 172.21.15.55:0/3738581088 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4003b80 con 0x7f6dbc0cc870 2023-07-06T22:18:53.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6da3fff640 1 -- 172.21.15.55:0/3738581088 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db4003ce0 con 0x7f6dbc0cc870 2023-07-06T22:18:53.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6da3fff640 1 -- 172.21.15.55:0/3738581088 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db400aa90 con 0x7f6dbc0cc870 2023-07-06T22:18:53.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.704+0000 7f6dc21d2640 1 -- 172.21.15.55:0/3738581088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc15de10 con 0x7f6dbc0cc870 2023-07-06T22:18:53.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.708+0000 7f6dc21d2640 1 -- 172.21.15.55:0/3738581088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc15e610 con 0x7f6dbc0cc870 2023-07-06T22:18:53.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.708+0000 7f6dc21d2640 1 -- 172.21.15.55:0/3738581088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc066d60 con 0x7f6dbc0cc870 2023-07-06T22:18:53.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.708+0000 7f6da3fff640 1 -- 172.21.15.55:0/3738581088 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 96) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f6db400abf0 con 0x7f6dbc0cc870 2023-07-06T22:18:53.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.708+0000 7f6da3fff640 1 --2- 172.21.15.55:0/3738581088 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f6da80663f0 0x7f6da80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:53.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.708+0000 7f6dbb7fe640 1 -- 172.21.15.55:0/3738581088 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f6da80663f0 msgr2=0x7f6da80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/957337795 2023-07-06T22:18:53.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.708+0000 7f6da3fff640 1 -- 172.21.15.55:0/3738581088 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6db4083d80 con 0x7f6dbc0cc870 2023-07-06T22:18:53.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.708+0000 7f6dbb7fe640 1 --2- 172.21.15.55:0/3738581088 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f6da80663f0 0x7f6da80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:18:53.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.712+0000 7f6da3fff640 1 -- 172.21.15.55:0/3738581088 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6db4051030 con 0x7f6dbc0cc870 2023-07-06T22:18:53.755 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:53.749+0000 7f26b0b20180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:18:53.793 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:53.792+0000 7fca29e2c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:18:53.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.868+0000 7f6dc21d2640 1 -- 172.21.15.55:0/3738581088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f6dbc15e2c0 con 0x7f6dbc0cc870 2023-07-06T22:18:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.880+0000 7f6da3fff640 1 -- 172.21.15.55:0/3738581088 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v60)=0 v60) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6db4058e60 con 0x7f6dbc0cc870 2023-07-06T22:18:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.880+0000 7f6dc21d2640 1 -- 172.21.15.55:0/3738581088 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f6da80663f0 msgr2=0x7f6da80688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:18:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.880+0000 7f6dc21d2640 1 --2- 172.21.15.55:0/3738581088 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f6da80663f0 0x7f6da80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.880+0000 7f6dc21d2640 1 -- 172.21.15.55:0/3738581088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dbc0cc870 msgr2=0x7f6dbc154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.880+0000 7f6dc21d2640 1 --2- 172.21.15.55:0/3738581088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dbc0cc870 0x7f6dbc154500 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f6db400c730 tx=0x7f6db400cbf0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.880+0000 7f6dc21d2640 1 -- 172.21.15.55:0/3738581088 shutdown_connections 2023-07-06T22:18:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.880+0000 7f6dc21d2640 1 --2- 172.21.15.55:0/3738581088 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f6da80663f0 0x7f6da80688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.880+0000 7f6dc21d2640 1 --2- 172.21.15.55:0/3738581088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dbc0cc870 0x7f6dbc154500 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.880+0000 7f6dc21d2640 1 --2- 172.21.15.55:0/3738581088 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6dbc0b7b90 0x7f6dbc152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.880+0000 7f6dc21d2640 1 --2- 172.21.15.55:0/3738581088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6dbc0b4300 0x7f6dbc1584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:53.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.880+0000 7f6dc21d2640 1 -- 172.21.15.55:0/3738581088 >> 172.21.15.55:0/3738581088 conn(0x7f6dbc0ceca0 msgr2=0x7f6dbc0b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:53.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.880+0000 7f6dc21d2640 1 -- 172.21.15.55:0/3738581088 shutdown_connections 2023-07-06T22:18:53.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:53.880+0000 7f6dc21d2640 1 -- 172.21.15.55:0/3738581088 wait complete. 2023-07-06T22:18:53.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:53.903 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-06T22:18:53.905 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:53.901+0000 7f26b0b20180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:18:53.919 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-06T22:18:53.953 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:53.952+0000 7fca29e2c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:18:54.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.100+0000 7f8157018640 1 Processor -- start 2023-07-06T22:18:54.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.100+0000 7f8157018640 1 -- start start 2023-07-06T22:18:54.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.104+0000 7f8157018640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81500d1d30 0x7f81500ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:54.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.104+0000 7f8157018640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81500ccd50 con 0x7f81500b18a0 2023-07-06T22:18:54.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.104+0000 7f8157018640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8150069ea0 con 0x7f81500b3c90 2023-07-06T22:18:54.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.104+0000 7f8157018640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81500cd0a0 con 0x7f81500d1d30 2023-07-06T22:18:54.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.104+0000 7f81555b5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81500d1d30 0x7f81500ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:54.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.104+0000 7f81555b5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81500d1d30 0x7f81500ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40828/0 (socket says 172.21.15.55:40828) 2023-07-06T22:18:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.104+0000 7f81555b5640 1 -- 172.21.15.55:0/3986829012 learned_addr learned my addr 172.21.15.55:0/3986829012 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.104+0000 7f81555b5640 1 -- 172.21.15.55:0/3986829012 >> v1:172.21.15.138:6789/0 conn(0x7f81500b3c90 legacy=0x7f81500b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.104+0000 7f81555b5640 1 -- 172.21.15.55:0/3986829012 >> v1:172.21.15.55:6789/0 conn(0x7f81500b18a0 legacy=0x7f81500cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:54.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.104+0000 7f81555b5640 1 -- 172.21.15.55:0/3986829012 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815006a140 con 0x7f81500d1d30 2023-07-06T22:18:54.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.104+0000 7f81477fe640 1 -- 172.21.15.55:0/3986829012 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997907796 0 0) 0x7f8150069ea0 con 0x7f81500b3c90 2023-07-06T22:18:54.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.108+0000 7f81555b5640 1 --2- 172.21.15.55:0/3986829012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81500d1d30 0x7f81500ce460 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f8148009e50 tx=0x7f814801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cb9e557ce338f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:54.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.108+0000 7f81477fe640 1 -- 172.21.15.55:0/3986829012 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81480a58d0 con 0x7f81500d1d30 2023-07-06T22:18:54.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.108+0000 7f81477fe640 1 -- 172.21.15.55:0/3986829012 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81480a5a30 con 0x7f81500d1d30 2023-07-06T22:18:54.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.108+0000 7f81477fe640 1 -- 172.21.15.55:0/3986829012 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81480a5dc0 con 0x7f81500d1d30 2023-07-06T22:18:54.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.108+0000 7f8157018640 1 -- 172.21.15.55:0/3986829012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81500d1d30 msgr2=0x7f81500ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.108+0000 7f8157018640 1 --2- 172.21.15.55:0/3986829012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81500d1d30 0x7f81500ce460 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f8148009e50 tx=0x7f814801c9e0 comp rx=0 tx=0).stop 2023-07-06T22:18:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.108+0000 7f8157018640 1 -- 172.21.15.55:0/3986829012 shutdown_connections 2023-07-06T22:18:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.108+0000 7f8157018640 1 --2- 172.21.15.55:0/3986829012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81500d1d30 0x7f81500ce460 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.108+0000 7f8157018640 1 -- 172.21.15.55:0/3986829012 >> 172.21.15.55:0/3986829012 conn(0x7f815006bf40 msgr2=0x7f81500cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.108+0000 7f8157018640 1 -- 172.21.15.55:0/3986829012 shutdown_connections 2023-07-06T22:18:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.108+0000 7f8157018640 1 -- 172.21.15.55:0/3986829012 wait complete. 2023-07-06T22:18:54.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.108+0000 7f8157018640 1 Processor -- start 2023-07-06T22:18:54.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.108+0000 7f8157018640 1 -- start start 2023-07-06T22:18:54.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f8157018640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81500b18a0 0x7f8150152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:54.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f8157018640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81500b3c90 0x7f81501f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:54.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f8157018640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81500d1d30 0x7f81501588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:54.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f8157018640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81501f6890 con 0x7f81500d1d30 2023-07-06T22:18:54.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f8157018640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81501530c0 con 0x7f81500b3c90 2023-07-06T22:18:54.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f8157018640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81501f5c10 con 0x7f81500b18a0 2023-07-06T22:18:54.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f81555b5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81500d1d30 0x7f81501588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:54.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f81555b5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81500d1d30 0x7f81501588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40838/0 (socket says 172.21.15.55:40838) 2023-07-06T22:18:54.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f81555b5640 1 -- 172.21.15.55:0/271323199 learned_addr learned my addr 172.21.15.55:0/271323199 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f8154db4640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81500b18a0 0x7f8150152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f8147fff640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81500b3c90 0x7f81501f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f81555b5640 1 -- 172.21.15.55:0/271323199 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81500b18a0 msgr2=0x7f8150152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f81555b5640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81500b18a0 0x7f8150152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f81555b5640 1 -- 172.21.15.55:0/271323199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81500b3c90 msgr2=0x7f81501f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f81555b5640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81500b3c90 0x7f81501f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f81555b5640 1 -- 172.21.15.55:0/271323199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8148009b30 con 0x7f81500d1d30 2023-07-06T22:18:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f8154db4640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81500b18a0 0x7f8150152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:54.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f81555b5640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81500d1d30 0x7f81501588c0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f81480af040 tx=0x7f8148019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:54.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f81457fa640 1 -- 172.21.15.55:0/271323199 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81480b8880 con 0x7f81500d1d30 2023-07-06T22:18:54.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f81457fa640 1 -- 172.21.15.55:0/271323199 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81480b8a00 con 0x7f81500d1d30 2023-07-06T22:18:54.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f81457fa640 1 -- 172.21.15.55:0/271323199 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81480b8db0 con 0x7f81500d1d30 2023-07-06T22:18:54.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f8157018640 1 -- 172.21.15.55:0/271323199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81501f5ef0 con 0x7f81500d1d30 2023-07-06T22:18:54.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f8157018640 1 -- 172.21.15.55:0/271323199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81501f64b0 con 0x7f81500d1d30 2023-07-06T22:18:54.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.112+0000 7f8157018640 1 -- 172.21.15.55:0/271323199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81501f69d0 con 0x7f81500d1d30 2023-07-06T22:18:54.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.116+0000 7f81457fa640 1 -- 172.21.15.55:0/271323199 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 96) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f81480b6440 con 0x7f81500d1d30 2023-07-06T22:18:54.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.116+0000 7f81457fa640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f813c0663f0 0x7f813c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:54.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.116+0000 7f81457fa640 1 -- 172.21.15.55:0/271323199 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f814811f500 con 0x7f81500d1d30 2023-07-06T22:18:54.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.116+0000 7f8154db4640 1 -- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f813c0663f0 msgr2=0x7f813c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/957337795 2023-07-06T22:18:54.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.116+0000 7f8154db4640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f813c0663f0 0x7f813c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:18:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.120+0000 7f81457fa640 1 -- 172.21.15.55:0/271323199 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81501f69d0 con 0x7f81500d1d30 2023-07-06T22:18:54.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.296+0000 7f8157018640 1 -- 172.21.15.55:0/271323199 --> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f81501f69d0 con 0x7f813c0663f0 2023-07-06T22:18:54.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.320+0000 7f8154db4640 1 -- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f813c0663f0 msgr2=0x7f813c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/957337795 2023-07-06T22:18:54.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.320+0000 7f8154db4640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f813c0663f0 0x7f813c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-06T22:18:54.390 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:54.385+0000 7f26b0b20180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:18:54.448 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:54.445+0000 7f26b0b20180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:18:54.465 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:54.464+0000 7fca29e2c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:18:54.504 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:54.501+0000 7f26b0b20180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:18:54.526 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:54.524+0000 7fca29e2c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:18:54.585 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:54.584+0000 7fca29e2c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:18:54.589 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:54.585+0000 7f26b0b20180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:18:54.647 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:54.641+0000 7f26b0b20180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:18:54.675 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:54.672+0000 7fca29e2c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:18:54.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.724+0000 7f8154db4640 1 -- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f813c0663f0 msgr2=0x7f813c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/957337795 2023-07-06T22:18:54.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:54.724+0000 7f8154db4640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f813c0663f0 0x7f813c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-06T22:18:54.731 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:54.725+0000 7f26b0b20180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:18:54.734 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:54.732+0000 7fca29e2c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:18:54.786 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:54.781+0000 7f26b0b20180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:18:54.822 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:54.820+0000 7fca29e2c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:18:54.881 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:54.880+0000 7fca29e2c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:18:54.927 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:54.921+0000 7f26b0b20180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:18:54.984 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:54.981+0000 7f26b0b20180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:18:55.031 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:55.028+0000 7fca29e2c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:18:55.091 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:55.088+0000 7fca29e2c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:18:55.228 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:18:55.228 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:18:55.228 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:18:55.236 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:55.233+0000 7f26b0b20180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:18:55.342 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:18:55.342 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:18:55.343 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:18:55.351 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:55.348+0000 7fca29e2c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:18:55.370 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:55.365+0000 7f26b0b20180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:18:55.491 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:55.488+0000 7fca29e2c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:18:55.494 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:55.489+0000 7f26b0b20180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:18:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:55.528+0000 7f8154db4640 1 -- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f813c0663f0 msgr2=0x7f813c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/957337795 2023-07-06T22:18:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:55.528+0000 7f8154db4640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f813c0663f0 0x7f813c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-06T22:18:55.564 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:55.561+0000 7f26b0b20180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:18:55.622 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:55.620+0000 7fca29e2c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:18:55.695 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:55.692+0000 7fca29e2c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:18:55.697 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:55.693+0000 7f26b0b20180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:18:55.835 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:55.832+0000 7fca29e2c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:18:56.234 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:56.229+0000 7f26b0b20180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:18:56.318 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:56.313+0000 7f26b0b20180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:18:56.399 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:56.396+0000 7fca29e2c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:18:56.464 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:56.461+0000 7f26b0b20180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:18:56.487 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:56.484+0000 7fca29e2c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:18:56.547 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:56.541+0000 7f26b0b20180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:18:56.645 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:56.644+0000 7fca29e2c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:18:56.734 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:56.732+0000 7fca29e2c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:18:56.819 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:56.817+0000 7f26b0b20180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:18:56.880 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:18:56.877+0000 7f26b0b20180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:18:56.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:56.940+0000 7f81457fa640 1 -- 172.21.15.55:0/271323199 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 97) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f81480ecc20 con 0x7f81500d1d30 2023-07-06T22:18:57.022 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:57.020+0000 7fca29e2c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:18:57.084 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:57.084+0000 7fca29e2c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:18:57.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:57.096+0000 7f81457fa640 1 -- 172.21.15.55:0/271323199 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 98) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f814811d730 con 0x7f81500d1d30 2023-07-06T22:18:57.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:57.096+0000 7f81457fa640 1 -- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f813c0663f0 msgr2=0x7f813c0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:18:57.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:57.096+0000 7f81457fa640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/957337795,v1:172.21.15.55:6833/957337795] conn(0x7f813c0663f0 0x7f813c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:57.215 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:57.212+0000 7fc9ab6a0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:57.215 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:57.212+0000 7fc9ab6a0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:57.215 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:57.212+0000 7fc9ab6a0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:57.215 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:57.212+0000 7fc9ab6a0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:57.215 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:57.212+0000 7fc9ab6a0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:57.216 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:57.212+0000 7fc9a869a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:57.216 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:57.212+0000 7fc9a869a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:57.216 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:57.212+0000 7fc9a869a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:57.216 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:57.212+0000 7fc9a869a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:57.217 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:18:57.212+0000 7fc9a869a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:18:58.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.100+0000 7f81457fa640 1 -- 172.21.15.55:0/271323199 <== mon.0 v2:172.21.15.55:3300/0 9 ==== mgrmap(e 99) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f814811f1b0 con 0x7f81500d1d30 2023-07-06T22:18:58.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.104+0000 7f81457fa640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f813c01bf80 0x7f813c01c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:58.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.104+0000 7f81457fa640 1 -- 172.21.15.55:0/271323199 --> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f81501f69d0 con 0x7f813c01bf80 2023-07-06T22:18:58.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.104+0000 7f8154db4640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f813c01bf80 0x7f813c01c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:58.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.104+0000 7f8154db4640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f813c01bf80 0x7f813c01c350 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f814c000f70 tx=0x7f814c007d40 comp rx=0 tx=0).ready entity=mgr.10650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:58.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.176+0000 7f81457fa640 1 -- 172.21.15.55:0/271323199 <== mgr.10650 v2:172.21.15.55:6832/628169602 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f81501f69d0 con 0x7f813c01bf80 2023-07-06T22:18:58.177 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path snap_test_dir1 2023-07-06T22:18:58.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.180+0000 7f8157018640 1 -- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f813c01bf80 msgr2=0x7f813c01c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:58.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.180+0000 7f8157018640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f813c01bf80 0x7f813c01c350 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f814c000f70 tx=0x7f814c007d40 comp rx=0 tx=0).stop 2023-07-06T22:18:58.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.180+0000 7f8157018640 1 -- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81500d1d30 msgr2=0x7f81501588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:58.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.180+0000 7f8157018640 1 --2- 172.21.15.55:0/271323199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81500d1d30 0x7f81501588c0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f81480af040 tx=0x7f8148019780 comp rx=0 tx=0).stop 2023-07-06T22:18:58.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.180+0000 7f81555b5640 1 -- 172.21.15.55:0/271323199 reap_dead start 2023-07-06T22:18:58.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.180+0000 7f8157018640 1 -- 172.21.15.55:0/271323199 shutdown_connections 2023-07-06T22:18:58.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.180+0000 7f8157018640 1 -- 172.21.15.55:0/271323199 >> 172.21.15.55:0/271323199 conn(0x7f815006bf40 msgr2=0x7f815015ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:58.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.180+0000 7f8157018640 1 -- 172.21.15.55:0/271323199 shutdown_connections 2023-07-06T22:18:58.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.180+0000 7f8157018640 1 -- 172.21.15.55:0/271323199 wait complete. 2023-07-06T22:18:58.202 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-06T22:18:58.202 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-07-06T22:18:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.352+0000 7f039ba18640 1 Processor -- start 2023-07-06T22:18:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.352+0000 7f039ba18640 1 -- start start 2023-07-06T22:18:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.352+0000 7f039ba18640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f03940ca130 0x7f03940703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f039ba18640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f03940cd140 0x7f0394070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f039ba18640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0394158c20 con 0x7f0394158850 2023-07-06T22:18:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f039ba18640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03940b2aa0 con 0x7f03940cd140 2023-07-06T22:18:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f039ba18640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03940c8db0 con 0x7f03940ca130 2023-07-06T22:18:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f0399fb5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f03940cd140 0x7f0394070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f0398fb3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f03940ca130 0x7f03940703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f0399fb5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f03940cd140 0x7f0394070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:60568/0 (socket says 172.21.15.55:60568) 2023-07-06T22:18:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f0399fb5640 1 -- 172.21.15.55:0/3437345415 learned_addr learned my addr 172.21.15.55:0/3437345415 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f0399fb5640 1 -- 172.21.15.55:0/3437345415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f03940ca130 msgr2=0x7f03940703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f0399fb5640 1 --2- 172.21.15.55:0/3437345415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f03940ca130 0x7f03940703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f0399fb5640 1 -- 172.21.15.55:0/3437345415 >> v1:172.21.15.138:6789/0 conn(0x7f0394158850 legacy=0x7f03940cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f0399fb5640 1 -- 172.21.15.55:0/3437345415 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03940c9090 con 0x7f03940cd140 2023-07-06T22:18:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f0398fb3640 1 --2- 172.21.15.55:0/3437345415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f03940ca130 0x7f03940703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:18:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f038bfff640 1 -- 172.21.15.55:0/3437345415 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027843554 0 0) 0x7f0394158c20 con 0x7f0394158850 2023-07-06T22:18:58.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.356+0000 7f0399fb5640 1 --2- 172.21.15.55:0/3437345415 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03940cd140 0x7f0394070920 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f038c00d150 tx=0x7f038c01eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2d536b52ca42a21 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:58.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f038bfff640 1 -- 172.21.15.55:0/3437345415 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c00b2d0 con 0x7f03940cd140 2023-07-06T22:18:58.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f038bfff640 1 -- 172.21.15.55:0/3437345415 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c00b430 con 0x7f03940cd140 2023-07-06T22:18:58.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f038bfff640 1 -- 172.21.15.55:0/3437345415 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c0a8ad0 con 0x7f03940cd140 2023-07-06T22:18:58.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 -- 172.21.15.55:0/3437345415 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03940cd140 msgr2=0x7f0394070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:58.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 --2- 172.21.15.55:0/3437345415 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03940cd140 0x7f0394070920 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f038c00d150 tx=0x7f038c01eca0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 -- 172.21.15.55:0/3437345415 shutdown_connections 2023-07-06T22:18:58.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 --2- 172.21.15.55:0/3437345415 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03940cd140 0x7f0394070920 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 --2- 172.21.15.55:0/3437345415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f03940ca130 0x7f03940703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 -- 172.21.15.55:0/3437345415 >> 172.21.15.55:0/3437345415 conn(0x7f03940cea70 msgr2=0x7f03940ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 -- 172.21.15.55:0/3437345415 shutdown_connections 2023-07-06T22:18:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 -- 172.21.15.55:0/3437345415 wait complete. 2023-07-06T22:18:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 Processor -- start 2023-07-06T22:18:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 -- start start 2023-07-06T22:18:58.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03940ca130 0x7f03940c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03940cd140 0x7f03940c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0394158850 0x7f039414f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039406aad0 con 0x7f03940ca130 2023-07-06T22:18:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03940c7a10 con 0x7f03940cd140 2023-07-06T22:18:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f039ba18640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039406ad70 con 0x7f0394158850 2023-07-06T22:18:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f03997b4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03940ca130 0x7f03940c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f03997b4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03940ca130 0x7f03940c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40992/0 (socket says 172.21.15.55:40992) 2023-07-06T22:18:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.360+0000 7f03997b4640 1 -- 172.21.15.55:0/3762074864 learned_addr learned my addr 172.21.15.55:0/3762074864 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:58.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f0399fb5640 1 --2- 172.21.15.55:0/3762074864 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0394158850 0x7f039414f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f0398fb3640 1 --2- 172.21.15.55:0/3762074864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03940cd140 0x7f03940c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f03997b4640 1 -- 172.21.15.55:0/3762074864 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0394158850 msgr2=0x7f039414f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f03997b4640 1 --2- 172.21.15.55:0/3762074864 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0394158850 0x7f039414f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f03997b4640 1 -- 172.21.15.55:0/3762074864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03940cd140 msgr2=0x7f03940c04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f03997b4640 1 --2- 172.21.15.55:0/3762074864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03940cd140 0x7f03940c04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f03997b4640 1 -- 172.21.15.55:0/3762074864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0384009420 con 0x7f03940ca130 2023-07-06T22:18:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f03997b4640 1 --2- 172.21.15.55:0/3762074864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03940ca130 0x7f03940c39e0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f0390001ec0 tx=0x7f039000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f0389ffb640 1 -- 172.21.15.55:0/3762074864 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900054e0 con 0x7f03940ca130 2023-07-06T22:18:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f0389ffb640 1 -- 172.21.15.55:0/3762074864 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0390003600 con 0x7f03940ca130 2023-07-06T22:18:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f0389ffb640 1 -- 172.21.15.55:0/3762074864 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900039b0 con 0x7f03940ca130 2023-07-06T22:18:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f039ba18640 1 -- 172.21.15.55:0/3762074864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038c00bd40 con 0x7f03940ca130 2023-07-06T22:18:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f039ba18640 1 -- 172.21.15.55:0/3762074864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03940c4160 con 0x7f03940ca130 2023-07-06T22:18:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f039ba18640 1 -- 172.21.15.55:0/3762074864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0394066d60 con 0x7f03940ca130 2023-07-06T22:18:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f0389ffb640 1 -- 172.21.15.55:0/3762074864 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 99) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f0390003b10 con 0x7f03940ca130 2023-07-06T22:18:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f0389ffb640 1 --2- 172.21.15.55:0/3762074864 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f0378066120 0x7f03780685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f0389ffb640 1 -- 172.21.15.55:0/3762074864 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f03900832a0 con 0x7f03940ca130 2023-07-06T22:18:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.364+0000 7f0398fb3640 1 --2- 172.21.15.55:0/3762074864 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f0378066120 0x7f03780685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:58.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.368+0000 7f0398fb3640 1 --2- 172.21.15.55:0/3762074864 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f0378066120 0x7f03780685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0394158300 tx=0x7f0384009190 comp rx=0 tx=0).ready entity=mgr.10650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.372+0000 7f0389ffb640 1 -- 172.21.15.55:0/3762074864 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0390050780 con 0x7f03940ca130 2023-07-06T22:18:58.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.544+0000 7f039ba18640 1 -- 172.21.15.55:0/3762074864 --> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f03940c9930 con 0x7f0378066120 2023-07-06T22:18:58.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.600+0000 7f0389ffb640 1 -- 172.21.15.55:0/3762074864 <== mgr.10650 v2:172.21.15.55:6832/628169602 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f0384011ec0 con 0x7f0378066120 2023-07-06T22:18:58.603 INFO:teuthology.orchestra.run.smithi055.stdout:Retention added to path snap_test_dir1 2023-07-06T22:18:58.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.604+0000 7f039ba18640 1 -- 172.21.15.55:0/3762074864 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f0378066120 msgr2=0x7f03780685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:58.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.604+0000 7f039ba18640 1 --2- 172.21.15.55:0/3762074864 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f0378066120 0x7f03780685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0394158300 tx=0x7f0384009190 comp rx=0 tx=0).stop 2023-07-06T22:18:58.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.604+0000 7f039ba18640 1 -- 172.21.15.55:0/3762074864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03940ca130 msgr2=0x7f03940c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:58.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.604+0000 7f039ba18640 1 --2- 172.21.15.55:0/3762074864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03940ca130 0x7f03940c39e0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f0390001ec0 tx=0x7f039000c8e0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.604+0000 7f039ba18640 1 -- 172.21.15.55:0/3762074864 shutdown_connections 2023-07-06T22:18:58.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.604+0000 7f039ba18640 1 --2- 172.21.15.55:0/3762074864 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f0378066120 0x7f03780685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.604+0000 7f039ba18640 1 --2- 172.21.15.55:0/3762074864 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0394158850 0x7f039414f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.604+0000 7f039ba18640 1 --2- 172.21.15.55:0/3762074864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03940cd140 0x7f03940c04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.604+0000 7f039ba18640 1 --2- 172.21.15.55:0/3762074864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03940ca130 0x7f03940c39e0 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.604+0000 7f039ba18640 1 -- 172.21.15.55:0/3762074864 >> 172.21.15.55:0/3762074864 conn(0x7f03940cea70 msgr2=0x7f03940ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:58.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.604+0000 7f039ba18640 1 -- 172.21.15.55:0/3762074864 shutdown_connections 2023-07-06T22:18:58.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.604+0000 7f039ba18640 1 -- 172.21.15.55:0/3762074864 wait complete. 2023-07-06T22:18:58.624 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-07-06T22:18:58.624 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-06-22_19_00 in ~2s... 2023-07-06T22:18:58.625 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-07-06T22:18:58.625 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-06T22:18:58.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.768+0000 7fd8c699f640 1 Processor -- start 2023-07-06T22:18:58.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.768+0000 7fd8c699f640 1 -- start start 2023-07-06T22:18:58.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8c699f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd8c00b3c90 0x7fd8c00ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:58.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8c699f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8c00d1d30 0x7fd8c00cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:58.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8c699f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c00ccd50 con 0x7fd8c00b18a0 2023-07-06T22:18:58.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8c699f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c00cd0a0 con 0x7fd8c00d1d30 2023-07-06T22:18:58.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8c699f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c0069ea0 con 0x7fd8c00b3c90 2023-07-06T22:18:58.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8c4f3c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8c00d1d30 0x7fd8c00cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:58.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8c4f3c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8c00d1d30 0x7fd8c00cfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41000/0 (socket says 172.21.15.55:41000) 2023-07-06T22:18:58.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8bf7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd8c00b18a0 0x7fd8c00b4060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43922/0 (socket says 172.21.15.55:43922) 2023-07-06T22:18:58.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8c4f3c640 1 -- 172.21.15.55:0/3907705314 learned_addr learned my addr 172.21.15.55:0/3907705314 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:58.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8bffff640 1 --2- 172.21.15.55:0/3907705314 >> v2:172.21.15.138:3300/0 conn(0x7fd8c00b3c90 0x7fd8c00ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:58.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8c4f3c640 1 -- 172.21.15.55:0/3907705314 >> v2:172.21.15.138:3300/0 conn(0x7fd8c00b3c90 msgr2=0x7fd8c00ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:18:58.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8c4f3c640 1 --2- 172.21.15.55:0/3907705314 >> v2:172.21.15.138:3300/0 conn(0x7fd8c00b3c90 0x7fd8c00ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8c4f3c640 1 -- 172.21.15.55:0/3907705314 >> v1:172.21.15.55:6789/0 conn(0x7fd8c00b18a0 legacy=0x7fd8c00b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:58.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8c4f3c640 1 -- 172.21.15.55:0/3907705314 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c006a140 con 0x7fd8c00d1d30 2023-07-06T22:18:58.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.772+0000 7fd8beffd640 1 -- 172.21.15.55:0/3907705314 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987435066 0 0) 0x7fd8c00ccd50 con 0x7fd8c00b18a0 2023-07-06T22:18:58.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.776+0000 7fd8c4f3c640 1 --2- 172.21.15.55:0/3907705314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00d1d30 0x7fd8c00cfee0 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fd8c008b300 tx=0x7fd8b801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c29213befe716f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:58.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.776+0000 7fd8beffd640 1 -- 172.21.15.55:0/3907705314 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80a5880 con 0x7fd8c00d1d30 2023-07-06T22:18:58.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.776+0000 7fd8beffd640 1 -- 172.21.15.55:0/3907705314 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b80a59e0 con 0x7fd8c00d1d30 2023-07-06T22:18:58.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.776+0000 7fd8beffd640 1 -- 172.21.15.55:0/3907705314 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80a5d70 con 0x7fd8c00d1d30 2023-07-06T22:18:58.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.776+0000 7fd8c699f640 1 -- 172.21.15.55:0/3907705314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00d1d30 msgr2=0x7fd8c00cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:58.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.776+0000 7fd8c699f640 1 --2- 172.21.15.55:0/3907705314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00d1d30 0x7fd8c00cfee0 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fd8c008b300 tx=0x7fd8b801c9a0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.776+0000 7fd8c699f640 1 -- 172.21.15.55:0/3907705314 shutdown_connections 2023-07-06T22:18:58.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.776+0000 7fd8c699f640 1 --2- 172.21.15.55:0/3907705314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00d1d30 0x7fd8c00cfee0 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.776+0000 7fd8c699f640 1 --2- 172.21.15.55:0/3907705314 >> v2:172.21.15.138:3300/0 conn(0x7fd8c00b3c90 0x7fd8c00ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.776+0000 7fd8c699f640 1 -- 172.21.15.55:0/3907705314 >> 172.21.15.55:0/3907705314 conn(0x7fd8c006bf40 msgr2=0x7fd8c00cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:58.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.776+0000 7fd8c699f640 1 -- 172.21.15.55:0/3907705314 shutdown_connections 2023-07-06T22:18:58.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.776+0000 7fd8c699f640 1 -- 172.21.15.55:0/3907705314 wait complete. 2023-07-06T22:18:58.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.776+0000 7fd8c699f640 1 Processor -- start 2023-07-06T22:18:58.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.776+0000 7fd8c699f640 1 -- start start 2023-07-06T22:18:58.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8c699f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00b18a0 0x7fd8c014f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:58.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8c699f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8c00b3c90 0x7fd8c00cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:58.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8c699f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8c00d1d30 0x7fd8c00cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:58.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8c699f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0150620 con 0x7fd8c00b18a0 2023-07-06T22:18:58.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8c699f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0150ba0 con 0x7fd8c00b3c90 2023-07-06T22:18:58.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8c699f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00c8bf0 con 0x7fd8c00d1d30 2023-07-06T22:18:58.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00b18a0 0x7fd8c014f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:58.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00b18a0 0x7fd8c014f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41016/0 (socket says 172.21.15.55:41016) 2023-07-06T22:18:58.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8bffff640 1 -- 172.21.15.55:0/3304926301 learned_addr learned my addr 172.21.15.55:0/3304926301 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:18:58.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8bf7fe640 1 --2- 172.21.15.55:0/3304926301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8c00b3c90 0x7fd8c00cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:58.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8c4f3c640 1 --2- 172.21.15.55:0/3304926301 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8c00d1d30 0x7fd8c00cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:58.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8bffff640 1 -- 172.21.15.55:0/3304926301 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8c00d1d30 msgr2=0x7fd8c00cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:58.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8bffff640 1 --2- 172.21.15.55:0/3304926301 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8c00d1d30 0x7fd8c00cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8bffff640 1 -- 172.21.15.55:0/3304926301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8c00b3c90 msgr2=0x7fd8c00cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:58.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8bffff640 1 --2- 172.21.15.55:0/3304926301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8c00b3c90 0x7fd8c00cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8bffff640 1 -- 172.21.15.55:0/3304926301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b8009b30 con 0x7fd8c00b18a0 2023-07-06T22:18:58.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8bffff640 1 --2- 172.21.15.55:0/3304926301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00b18a0 0x7fd8c014f3b0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000d800 tx=0x7fd8b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:58.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8bcff9640 1 -- 172.21.15.55:0/3304926301 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000b6c0 con 0x7fd8c00b18a0 2023-07-06T22:18:58.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8bcff9640 1 -- 172.21.15.55:0/3304926301 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b000b820 con 0x7fd8c00b18a0 2023-07-06T22:18:58.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8c699f640 1 -- 172.21.15.55:0/3304926301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c00c8ed0 con 0x7fd8c00b18a0 2023-07-06T22:18:58.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8bcff9640 1 -- 172.21.15.55:0/3304926301 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000bb90 con 0x7fd8c00b18a0 2023-07-06T22:18:58.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8c699f640 1 -- 172.21.15.55:0/3304926301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c014f8f0 con 0x7fd8c00b18a0 2023-07-06T22:18:58.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8c699f640 1 -- 172.21.15.55:0/3304926301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c0066d60 con 0x7fd8c00b18a0 2023-07-06T22:18:58.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.780+0000 7fd8bcff9640 1 -- 172.21.15.55:0/3304926301 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 99) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fd8b000bcf0 con 0x7fd8c00b18a0 2023-07-06T22:18:58.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.784+0000 7fd8bcff9640 1 --2- 172.21.15.55:0/3304926301 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fd8ac066120 0x7fd8ac0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:18:58.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.784+0000 7fd8bcff9640 1 -- 172.21.15.55:0/3304926301 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fd8b0084090 con 0x7fd8c00b18a0 2023-07-06T22:18:58.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.784+0000 7fd8bf7fe640 1 --2- 172.21.15.55:0/3304926301 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fd8ac066120 0x7fd8ac0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:18:58.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.784+0000 7fd8bf7fe640 1 --2- 172.21.15.55:0/3304926301 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fd8ac066120 0x7fd8ac0685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00d14d0 tx=0x7fd8b4007d60 comp rx=0 tx=0).ready entity=mgr.10650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:18:58.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.788+0000 7fd8bcff9640 1 -- 172.21.15.55:0/3304926301 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd8b00550d0 con 0x7fd8c00b18a0 2023-07-06T22:18:58.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.960+0000 7fd8c699f640 1 -- 172.21.15.55:0/3304926301 --> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8c0150a00 con 0x7fd8ac066120 2023-07-06T22:18:58.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.968+0000 7fd8bcff9640 1 -- 172.21.15.55:0/3304926301 <== mgr.10650 v2:172.21.15.55:6832/628169602 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7fd8b4004c80 con 0x7fd8ac066120 2023-07-06T22:18:58.968 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:18:58.969 INFO:teuthology.orchestra.run.smithi055.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-06T22:18:58.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.968+0000 7fd8c699f640 1 -- 172.21.15.55:0/3304926301 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fd8ac066120 msgr2=0x7fd8ac0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:58.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.968+0000 7fd8c699f640 1 --2- 172.21.15.55:0/3304926301 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fd8ac066120 0x7fd8ac0685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00d14d0 tx=0x7fd8b4007d60 comp rx=0 tx=0).stop 2023-07-06T22:18:58.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.968+0000 7fd8c699f640 1 -- 172.21.15.55:0/3304926301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00b18a0 msgr2=0x7fd8c014f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:18:58.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.968+0000 7fd8c699f640 1 --2- 172.21.15.55:0/3304926301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00b18a0 0x7fd8c014f3b0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000d800 tx=0x7fd8b000dcc0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.968+0000 7fd8c699f640 1 -- 172.21.15.55:0/3304926301 shutdown_connections 2023-07-06T22:18:58.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.968+0000 7fd8c699f640 1 --2- 172.21.15.55:0/3304926301 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fd8ac066120 0x7fd8ac0685d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.968+0000 7fd8c699f640 1 --2- 172.21.15.55:0/3304926301 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd8c00d1d30 0x7fd8c00cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.968+0000 7fd8c699f640 1 --2- 172.21.15.55:0/3304926301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8c00b3c90 0x7fd8c00cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.968+0000 7fd8c699f640 1 --2- 172.21.15.55:0/3304926301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00b18a0 0x7fd8c014f3b0 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:18:58.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.968+0000 7fd8c699f640 1 -- 172.21.15.55:0/3304926301 >> 172.21.15.55:0/3304926301 conn(0x7fd8c006bf40 msgr2=0x7fd8c015f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:18:58.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.968+0000 7fd8c699f640 1 -- 172.21.15.55:0/3304926301 shutdown_connections 2023-07-06T22:18:58.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:18:58.968+0000 7fd8c699f640 1 -- 172.21.15.55:0/3304926301 wait complete. 2023-07-06T22:18:58.991 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-06T22:18:58.991 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-07-06T22:18:58.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:18:58.992 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:18:59.002 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:18:59.002 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:18:59.003 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:00.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:00.004 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:00.016 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-06T22:19:00.017 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:00.017 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:00.616 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:19:00.612+0000 7fc99ae7f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:19:00.616 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:19:00.612+0000 7fc99ae7f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:19:00.616 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:19:00.612+0000 7fc99ae7f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:19:00.616 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:19:00.612+0000 7fc99ae7f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:19:00.616 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:19:00.612+0000 7fc99ae7f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:19:01.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:01.018 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:01.029 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:01.030 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:01.030 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:01.031 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:01.031 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-06-22_19_00_UTC'] 2023-07-06T22:19:01.031 DEBUG:tasks.cephfs.test_snap_schedules:exec=1688681938.6247478, now = 1688681941.031532, timo = 2 2023-07-06T22:19:02.032 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-07-06-22_19_00 in ~62s... 2023-07-06T22:19:02.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:02.033 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:02.043 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:02.044 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:02.045 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:02.045 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:03.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:03.046 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:03.057 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:03.058 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:03.058 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:03.058 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:04.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:04.060 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:04.070 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:04.071 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:04.072 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:04.072 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:05.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:05.074 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:05.085 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:05.086 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:05.086 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:05.086 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:06.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:06.088 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:06.099 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:06.099 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:06.100 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:06.100 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:07.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:07.101 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:07.112 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:07.113 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:07.113 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:07.114 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:08.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:08.115 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:08.126 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:08.127 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:08.127 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:08.127 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:09.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:09.129 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:09.140 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:09.141 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:09.141 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:09.141 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:10.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:10.143 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:10.154 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:10.155 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:10.155 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:10.156 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:11.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:11.157 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:11.168 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:11.169 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:11.169 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:11.170 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:11.498 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:19:11.502 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:19:12.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:12.171 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:12.182 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:12.183 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:12.184 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:12.184 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:13.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:13.185 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:13.195 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:13.196 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:13.197 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:13.197 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:14.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:14.199 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:14.209 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:14.210 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:14.210 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:14.211 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:15.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:15.212 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:15.223 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:15.223 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:15.224 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:15.224 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:16.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:16.226 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:16.236 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:16.237 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:16.237 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:16.238 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:17.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:17.239 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:17.249 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:17.250 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:17.251 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:17.251 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:18.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:18.252 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:18.263 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:18.264 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:18.265 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:18.265 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:19.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:19.266 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:19.277 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:19.278 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:19.279 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:19.279 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:20.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:20.280 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:20.291 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:20.292 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:20.292 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:20.293 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:21.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:21.294 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:21.305 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:21.305 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:21.306 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:21.306 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:22.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:22.308 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:22.318 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:22.319 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:22.320 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:22.320 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:23.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:23.322 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:23.332 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:23.333 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:23.334 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:23.334 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:24.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:24.336 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:24.346 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:24.347 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:24.348 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:24.348 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:25.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:25.349 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:25.360 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:25.361 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:25.362 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:25.362 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:26.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:26.364 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:26.374 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:26.375 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:26.376 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:26.376 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:27.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:27.377 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:27.388 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:27.389 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:27.389 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:27.389 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:28.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:28.391 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:28.402 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:28.403 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:28.403 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:28.403 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:29.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:29.405 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:29.415 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:29.416 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:29.416 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:29.417 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:30.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:30.418 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:30.428 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:30.429 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:30.430 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:30.430 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:31.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:31.432 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:31.442 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:31.443 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:31.444 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:31.444 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:32.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:32.445 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:32.456 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:32.457 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:32.458 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:32.458 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:33.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:33.460 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:33.471 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:33.472 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:33.472 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:33.473 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:34.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:34.474 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:34.485 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:34.486 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:34.486 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:34.486 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:35.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:35.488 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:35.498 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:35.500 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:35.500 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:35.500 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:36.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:36.502 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:36.513 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:36.514 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:36.514 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:36.514 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:37.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:37.516 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:37.526 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:37.527 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:37.528 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:37.528 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:38.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:38.530 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:38.540 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:38.541 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:38.541 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:38.542 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:39.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:39.543 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:39.554 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:39.555 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:39.555 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:39.555 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:40.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:40.557 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:40.567 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:40.568 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:40.569 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:40.569 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:41.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:41.570 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:41.580 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:41.581 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:41.582 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:41.582 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:41.637 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:19:41.641 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:19:42.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:42.583 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:42.594 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:42.595 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:42.595 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:42.596 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:43.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:43.597 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:43.608 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:43.609 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:43.609 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:43.609 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:44.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:44.612 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:44.624 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:44.625 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:44.626 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:44.626 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:45.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:45.627 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:45.638 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:45.639 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:45.639 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:45.640 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:46.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:46.641 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:46.652 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:46.653 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:46.653 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:46.653 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:47.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:47.655 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:47.665 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:47.666 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:47.667 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:47.667 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:48.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:48.668 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:48.679 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:48.680 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:48.680 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:48.681 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:49.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:49.683 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:49.693 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:49.694 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:49.694 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:49.695 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:50.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:50.697 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:50.707 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:50.708 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:50.708 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:50.709 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:51.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:51.710 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:51.721 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:51.722 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:51.722 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:51.723 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:52.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:52.724 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:52.735 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:52.736 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:52.736 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:52.736 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:53.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:53.738 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:53.749 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:53.749 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:53.750 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:53.750 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:54.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:54.751 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:54.762 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:54.763 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:54.764 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:54.764 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:55.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:55.766 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:55.777 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:55.777 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:55.778 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:55.778 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:56.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:56.779 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:56.790 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:56.791 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:56.791 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:56.791 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:57.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:57.793 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:57.804 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:57.805 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:57.805 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:57.805 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:58.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:58.807 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:58.817 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:58.818 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:58.818 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:58.819 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:19:59.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:19:59.820 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:19:59.831 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_19_00_UTC 2023-07-06T22:19:59.832 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:19:59.833 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-06T22:19:59.833 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-06T22:20:00.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:00.834 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:20:00.845 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_20_00_UTC 2023-07-06T22:20:00.846 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-06-22_20_00_UTC'} 2023-07-06T22:20:00.846 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-06-22_20_00_UTC'} 2023-07-06T22:20:00.847 INFO:tasks.cephfs.test_snap_schedules:removed: {'scheduled-2023-07-06-22_19_00_UTC'} 2023-07-06T22:20:00.847 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-07-06-22_19_00_UTC'] 2023-07-06T22:20:00.847 DEBUG:tasks.cephfs.test_snap_schedules:exec=1688681938.6247478, now = 1688682000.8477738, timo = 62 2023-07-06T22:20:01.849 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-06T22:20:02.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.003+0000 7fac47234640 1 Processor -- start 2023-07-06T22:20:02.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.003+0000 7fac47234640 1 -- start start 2023-07-06T22:20:02.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.007+0000 7fac47234640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fac401601d0 0x7fac4006a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:02.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.007+0000 7fac47234640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac4015f5a0 0x7fac4015fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:02.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.007+0000 7fac47234640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4015ff40 con 0x7fac401560a0 2023-07-06T22:20:02.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.007+0000 7fac47234640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac40069ea0 con 0x7fac401601d0 2023-07-06T22:20:02.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.007+0000 7fac47234640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac40156470 con 0x7fac4015f5a0 2023-07-06T22:20:02.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.007+0000 7fac457d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac4015f5a0 0x7fac4015fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:02.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.007+0000 7fac3ffff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fac401601d0 0x7fac4006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:02.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.007+0000 7fac457d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac4015f5a0 0x7fac4015fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:36068/0 (socket says 172.21.15.55:36068) 2023-07-06T22:20:02.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.007+0000 7fac457d1640 1 -- 172.21.15.55:0/1852292382 learned_addr learned my addr 172.21.15.55:0/1852292382 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:02.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.007+0000 7fac3ffff640 1 -- 172.21.15.55:0/1852292382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac4015f5a0 msgr2=0x7fac4015fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:02.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.007+0000 7fac3ffff640 1 --2- 172.21.15.55:0/1852292382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac4015f5a0 0x7fac4015fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:02.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.007+0000 7fac3ffff640 1 -- 172.21.15.55:0/1852292382 >> v1:172.21.15.138:6789/0 conn(0x7fac401560a0 legacy=0x7fac400cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:02.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.007+0000 7fac3ffff640 1 -- 172.21.15.55:0/1852292382 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac400cd800 con 0x7fac401601d0 2023-07-06T22:20:02.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.007+0000 7fac457d1640 1 --2- 172.21.15.55:0/1852292382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac4015f5a0 0x7fac4015fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:02.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.011+0000 7fac3ffff640 1 --2- 172.21.15.55:0/1852292382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac401601d0 0x7fac4006a910 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0097c0 tx=0x7fac2c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c176b77dac3999b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:02.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.011+0000 7fac3f7fe640 1 -- 172.21.15.55:0/1852292382 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c0ab650 con 0x7fac401601d0 2023-07-06T22:20:02.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.011+0000 7fac3f7fe640 1 -- 172.21.15.55:0/1852292382 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c0ab7b0 con 0x7fac401601d0 2023-07-06T22:20:02.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.011+0000 7fac3f7fe640 1 -- 172.21.15.55:0/1852292382 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c0abb40 con 0x7fac401601d0 2023-07-06T22:20:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.011+0000 7fac47234640 1 -- 172.21.15.55:0/1852292382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac401601d0 msgr2=0x7fac4006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.011+0000 7fac47234640 1 --2- 172.21.15.55:0/1852292382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac401601d0 0x7fac4006a910 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0097c0 tx=0x7fac2c01c450 comp rx=0 tx=0).stop 2023-07-06T22:20:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.011+0000 7fac47234640 1 -- 172.21.15.55:0/1852292382 shutdown_connections 2023-07-06T22:20:02.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.011+0000 7fac47234640 1 --2- 172.21.15.55:0/1852292382 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac4015f5a0 0x7fac4015fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.011+0000 7fac47234640 1 --2- 172.21.15.55:0/1852292382 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac401601d0 0x7fac4006a910 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.011+0000 7fac47234640 1 -- 172.21.15.55:0/1852292382 >> 172.21.15.55:0/1852292382 conn(0x7fac400cde30 msgr2=0x7fac400ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.011+0000 7fac47234640 1 -- 172.21.15.55:0/1852292382 shutdown_connections 2023-07-06T22:20:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.011+0000 7fac47234640 1 -- 172.21.15.55:0/1852292382 wait complete. 2023-07-06T22:20:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.011+0000 7fac47234640 1 Processor -- start 2023-07-06T22:20:02.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.011+0000 7fac47234640 1 -- start start 2023-07-06T22:20:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac47234640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac401560a0 0x7fac4006cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac47234640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac4015f5a0 0x7fac401465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac47234640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac40146b10 0x7fac40149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac47234640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac40146f90 con 0x7fac40146b10 2023-07-06T22:20:02.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac47234640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4014af90 con 0x7fac4015f5a0 2023-07-06T22:20:02.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac47234640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4006c500 con 0x7fac401560a0 2023-07-06T22:20:02.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac457d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac40146b10 0x7fac40149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:02.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac457d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac40146b10 0x7fac40149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45594/0 (socket says 172.21.15.55:45594) 2023-07-06T22:20:02.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac457d1640 1 -- 172.21.15.55:0/1742206904 learned_addr learned my addr 172.21.15.55:0/1742206904 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:02.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac44fd0640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac401560a0 0x7fac4006cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:02.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac3ffff640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac4015f5a0 0x7fac401465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:02.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac457d1640 1 -- 172.21.15.55:0/1742206904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac401560a0 msgr2=0x7fac4006cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:02.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac457d1640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac401560a0 0x7fac4006cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:02.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac457d1640 1 -- 172.21.15.55:0/1742206904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac4015f5a0 msgr2=0x7fac401465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:02.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac457d1640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac4015f5a0 0x7fac401465d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:02.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac457d1640 1 -- 172.21.15.55:0/1742206904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac38009b30 con 0x7fac40146b10 2023-07-06T22:20:02.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac3ffff640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac4015f5a0 0x7fac401465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:02.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac457d1640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac40146b10 0x7fac40149df0 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7fac3800efc0 tx=0x7fac3800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:02.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac3d7fa640 1 -- 172.21.15.55:0/1742206904 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38018070 con 0x7fac40146b10 2023-07-06T22:20:02.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac3d7fa640 1 -- 172.21.15.55:0/1742206904 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3800f040 con 0x7fac40146b10 2023-07-06T22:20:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac3d7fa640 1 -- 172.21.15.55:0/1742206904 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3800ce00 con 0x7fac40146b10 2023-07-06T22:20:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac47234640 1 -- 172.21.15.55:0/1742206904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c009420 con 0x7fac40146b10 2023-07-06T22:20:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac47234640 1 -- 172.21.15.55:0/1742206904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4006f390 con 0x7fac40146b10 2023-07-06T22:20:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac47234640 1 -- 172.21.15.55:0/1742206904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac40066d60 con 0x7fac40146b10 2023-07-06T22:20:02.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.015+0000 7fac3d7fa640 1 -- 172.21.15.55:0/1742206904 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 101) v1 ==== 85891+0+0 (secure 0 0 0) 0x7fac38014480 con 0x7fac40146b10 2023-07-06T22:20:02.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.019+0000 7fac3d7fa640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fac24066510 0x7fac240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:02.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.019+0000 7fac3d7fa640 1 -- 172.21.15.55:0/1742206904 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fac380848b0 con 0x7fac40146b10 2023-07-06T22:20:02.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.019+0000 7fac44fd0640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fac24066510 0x7fac240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:02.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.019+0000 7fac44fd0640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fac24066510 0x7fac240689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fac400cb4c0 tx=0x7fac34009040 comp rx=0 tx=0).ready entity=mgr.10650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.023+0000 7fac3d7fa640 1 -- 172.21.15.55:0/1742206904 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac38055080 con 0x7fac40146b10 2023-07-06T22:20:02.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.195+0000 7fac47234640 1 -- 172.21.15.55:0/1742206904 --> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fac400cdae0 con 0x7fac24066510 2023-07-06T22:20:02.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.267+0000 7fac3d7fa640 1 -- 172.21.15.55:0/1742206904 <== mgr.10650 v2:172.21.15.55:6832/628169602 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fac34001510 con 0x7fac24066510 2023-07-06T22:20:02.270 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path snap_test_dir1 2023-07-06T22:20:02.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.271+0000 7fac47234640 1 -- 172.21.15.55:0/1742206904 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fac24066510 msgr2=0x7fac240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:02.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.271+0000 7fac47234640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fac24066510 0x7fac240689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fac400cb4c0 tx=0x7fac34009040 comp rx=0 tx=0).stop 2023-07-06T22:20:02.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.271+0000 7fac47234640 1 -- 172.21.15.55:0/1742206904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac40146b10 msgr2=0x7fac40149df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:02.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.271+0000 7fac47234640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac40146b10 0x7fac40149df0 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7fac3800efc0 tx=0x7fac3800c490 comp rx=0 tx=0).stop 2023-07-06T22:20:02.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.271+0000 7fac47234640 1 -- 172.21.15.55:0/1742206904 shutdown_connections 2023-07-06T22:20:02.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.271+0000 7fac47234640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fac24066510 0x7fac240689c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:02.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.271+0000 7fac47234640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac40146b10 0x7fac40149df0 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:02.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.271+0000 7fac47234640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac4015f5a0 0x7fac401465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:02.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.271+0000 7fac47234640 1 --2- 172.21.15.55:0/1742206904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac401560a0 0x7fac4006cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:02.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.271+0000 7fac47234640 1 -- 172.21.15.55:0/1742206904 >> 172.21.15.55:0/1742206904 conn(0x7fac400cde30 msgr2=0x7fac400ae010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:02.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.271+0000 7fac47234640 1 -- 172.21.15.55:0/1742206904 shutdown_connections 2023-07-06T22:20:02.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.271+0000 7fac47234640 1 -- 172.21.15.55:0/1742206904 wait complete. 2023-07-06T22:20:02.291 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-06T22:20:02.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:02.292 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:20:02.301 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-07-06-22_20_00_UTC 2023-07-06T22:20:02.302 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-06-22_20_00_UTC 2023-07-06T22:20:02.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:02.303 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-06-22_20_00_UTC) 2023-07-06T22:20:02.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:02.357 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-06T22:20:02.410 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-06T22:20:02.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.591+0000 7f5b67911640 1 Processor -- start 2023-07-06T22:20:02.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b67911640 1 -- start start 2023-07-06T22:20:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b67911640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b60158850 0x7f5b600cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b67911640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5b600ca130 0x7f5b600ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b67911640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b600b2aa0 con 0x7f5b600703e0 2023-07-06T22:20:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b67911640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b60158c20 con 0x7f5b600ca130 2023-07-06T22:20:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b67911640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600c8db0 con 0x7f5b60158850 2023-07-06T22:20:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b65eae640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5b600703e0 0x7f5b6006eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43036/0 (socket says 172.21.15.55:43036) 2023-07-06T22:20:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b65eae640 1 -- 172.21.15.55:0/87099878 learned_addr learned my addr 172.21.15.55:0/87099878 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:02.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b656ad640 1 --2- 172.21.15.55:0/87099878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b60158850 0x7f5b600cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:02.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b64eac640 1 --2- 172.21.15.55:0/87099878 >> v2:172.21.15.138:3300/0 conn(0x7f5b600ca130 0x7f5b600ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:02.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b57fff640 1 -- 172.21.15.55:0/87099878 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288745314 0 0) 0x7f5b600b2aa0 con 0x7f5b600703e0 2023-07-06T22:20:02.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b57fff640 1 -- 172.21.15.55:0/87099878 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b4c003530 con 0x7f5b600703e0 2023-07-06T22:20:02.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b656ad640 1 -- 172.21.15.55:0/87099878 >> v2:172.21.15.138:3300/0 conn(0x7f5b600ca130 msgr2=0x7f5b600ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:02.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b656ad640 1 --2- 172.21.15.55:0/87099878 >> v2:172.21.15.138:3300/0 conn(0x7f5b600ca130 0x7f5b600ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:02.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b656ad640 1 -- 172.21.15.55:0/87099878 >> v1:172.21.15.55:6789/0 conn(0x7f5b600703e0 legacy=0x7f5b6006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:02.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b57fff640 1 -- 172.21.15.55:0/87099878 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2636115500 0 0) 0x7f5b4c003530 con 0x7f5b600703e0 2023-07-06T22:20:02.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.595+0000 7f5b656ad640 1 -- 172.21.15.55:0/87099878 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b600c9090 con 0x7f5b60158850 2023-07-06T22:20:02.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.599+0000 7f5b656ad640 1 --2- 172.21.15.55:0/87099878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b60158850 0x7f5b600cca30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0097c0 tx=0x7f5b5c01eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25082715e05cbb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:02.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.599+0000 7f5b57fff640 1 -- 172.21.15.55:0/87099878 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58001a00 con 0x7f5b60158850 2023-07-06T22:20:02.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.599+0000 7f5b57fff640 1 -- 172.21.15.55:0/87099878 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c0a85d0 con 0x7f5b60158850 2023-07-06T22:20:02.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.599+0000 7f5b57fff640 1 -- 172.21.15.55:0/87099878 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c0a8940 con 0x7f5b60158850 2023-07-06T22:20:02.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.599+0000 7f5b67911640 1 -- 172.21.15.55:0/87099878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b60158850 msgr2=0x7f5b600cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:02.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.599+0000 7f5b67911640 1 --2- 172.21.15.55:0/87099878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b60158850 0x7f5b600cca30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0097c0 tx=0x7f5b5c01eb90 comp rx=0 tx=0).stop 2023-07-06T22:20:02.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.599+0000 7f5b67911640 1 -- 172.21.15.55:0/87099878 shutdown_connections 2023-07-06T22:20:02.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.599+0000 7f5b67911640 1 --2- 172.21.15.55:0/87099878 >> v2:172.21.15.138:3300/0 conn(0x7f5b600ca130 0x7f5b600ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:02.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.599+0000 7f5b67911640 1 --2- 172.21.15.55:0/87099878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b60158850 0x7f5b600cca30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:02.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.599+0000 7f5b67911640 1 -- 172.21.15.55:0/87099878 >> 172.21.15.55:0/87099878 conn(0x7f5b600cea70 msgr2=0x7f5b600ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:02.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.599+0000 7f5b67911640 1 -- 172.21.15.55:0/87099878 shutdown_connections 2023-07-06T22:20:02.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.599+0000 7f5b67911640 1 -- 172.21.15.55:0/87099878 wait complete. 2023-07-06T22:20:02.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.599+0000 7f5b67911640 1 Processor -- start 2023-07-06T22:20:02.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b67911640 1 -- start start 2023-07-06T22:20:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b67911640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600703e0 0x7f5b601f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b67911640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b600ca130 0x7f5b6009d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b67911640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b60158850 0x7f5b6009e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b67911640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6009df10 con 0x7f5b600703e0 2023-07-06T22:20:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b67911640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b60154760 con 0x7f5b600ca130 2023-07-06T22:20:02.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b67911640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b60154a00 con 0x7f5b60158850 2023-07-06T22:20:02.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b656ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600703e0 0x7f5b601f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:02.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b656ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600703e0 0x7f5b601f0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45606/0 (socket says 172.21.15.55:45606) 2023-07-06T22:20:02.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b656ad640 1 -- 172.21.15.55:0/1821559505 learned_addr learned my addr 172.21.15.55:0/1821559505 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:02.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b64eac640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b600ca130 0x7f5b6009d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:02.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b65eae640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b60158850 0x7f5b6009e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:02.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b656ad640 1 -- 172.21.15.55:0/1821559505 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b60158850 msgr2=0x7f5b6009e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:02.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b656ad640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b60158850 0x7f5b6009e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:02.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b656ad640 1 -- 172.21.15.55:0/1821559505 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b600ca130 msgr2=0x7f5b6009d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:02.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b656ad640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b600ca130 0x7f5b6009d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:02.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b656ad640 1 -- 172.21.15.55:0/1821559505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c009420 con 0x7f5b600703e0 2023-07-06T22:20:02.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b64eac640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b600ca130 0x7f5b6009d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:02.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b656ad640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600703e0 0x7f5b601f0d00 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c000c10 tx=0x7f5b5c01b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:02.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b55ffb640 1 -- 172.21.15.55:0/1821559505 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c0c1070 con 0x7f5b600703e0 2023-07-06T22:20:02.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b55ffb640 1 -- 172.21.15.55:0/1821559505 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c006e20 con 0x7f5b600703e0 2023-07-06T22:20:02.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b55ffb640 1 -- 172.21.15.55:0/1821559505 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c0bc860 con 0x7f5b600703e0 2023-07-06T22:20:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b67911640 1 -- 172.21.15.55:0/1821559505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b60154ce0 con 0x7f5b600703e0 2023-07-06T22:20:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b67911640 1 -- 172.21.15.55:0/1821559505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b601552a0 con 0x7f5b600703e0 2023-07-06T22:20:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.603+0000 7f5b67911640 1 -- 172.21.15.55:0/1821559505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b60155490 con 0x7f5b600703e0 2023-07-06T22:20:02.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.607+0000 7f5b55ffb640 1 -- 172.21.15.55:0/1821559505 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 101) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f5b5c0bc9c0 con 0x7f5b600703e0 2023-07-06T22:20:02.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.607+0000 7f5b55ffb640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f5b44066510 0x7f5b440689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:02.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.607+0000 7f5b55ffb640 1 -- 172.21.15.55:0/1821559505 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f5b5c121ca0 con 0x7f5b600703e0 2023-07-06T22:20:02.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.607+0000 7f5b64eac640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f5b44066510 0x7f5b440689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:02.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.607+0000 7f5b64eac640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f5b44066510 0x7f5b440689c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5b6009e270 tx=0x7f5b50008040 comp rx=0 tx=0).ready entity=mgr.10650 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.611+0000 7f5b55ffb640 1 -- 172.21.15.55:0/1821559505 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5b5c0eea60 con 0x7f5b600703e0 2023-07-06T22:20:02.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:02.803+0000 7f5b67911640 1 -- 172.21.15.55:0/1821559505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f5b60066d60 con 0x7f5b600703e0 2023-07-06T22:20:03.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.163+0000 7f5b55ffb640 1 -- 172.21.15.55:0/1821559505 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 102) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f5b5c0eee30 con 0x7f5b600703e0 2023-07-06T22:20:03.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.167+0000 7f5b55ffb640 1 -- 172.21.15.55:0/1821559505 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v102) v1 ==== 93+0+0 (secure 0 0 0) 0x7f5b5c0c8c40 con 0x7f5b600703e0 2023-07-06T22:20:03.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.167+0000 7f5b67911640 1 -- 172.21.15.55:0/1821559505 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f5b44066510 msgr2=0x7f5b440689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:03.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.167+0000 7f5b67911640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f5b44066510 0x7f5b440689c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5b6009e270 tx=0x7f5b50008040 comp rx=0 tx=0).stop 2023-07-06T22:20:03.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.167+0000 7f5b67911640 1 -- 172.21.15.55:0/1821559505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600703e0 msgr2=0x7f5b601f0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:03.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.167+0000 7f5b67911640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600703e0 0x7f5b601f0d00 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c000c10 tx=0x7f5b5c01b930 comp rx=0 tx=0).stop 2023-07-06T22:20:03.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.167+0000 7f5b67911640 1 -- 172.21.15.55:0/1821559505 shutdown_connections 2023-07-06T22:20:03.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.167+0000 7f5b67911640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f5b44066510 0x7f5b440689c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.167+0000 7f5b67911640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b60158850 0x7f5b6009e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.167+0000 7f5b67911640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b600ca130 0x7f5b6009d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.167+0000 7f5b67911640 1 --2- 172.21.15.55:0/1821559505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600703e0 0x7f5b601f0d00 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.167+0000 7f5b67911640 1 -- 172.21.15.55:0/1821559505 >> 172.21.15.55:0/1821559505 conn(0x7f5b600cea70 msgr2=0x7f5b600c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:03.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.167+0000 7f5b67911640 1 -- 172.21.15.55:0/1821559505 shutdown_connections 2023-07-06T22:20:03.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.167+0000 7f5b67911640 1 -- 172.21.15.55:0/1821559505 wait complete. 2023-07-06T22:20:03.191 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T22:20:03.192 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:20:03.266 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:20:03.318 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T22:20:03.318 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:20:03.319 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:03.327 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:20:03.328 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:03.339 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:03.340+0000 7fbbbbed0180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:20:03.348 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:03.347+0000 7fa96e262180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:20:03.356 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:20:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6f0640b640 1 Processor -- start 2023-07-06T22:20:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6f0640b640 1 -- start start 2023-07-06T22:20:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6f0640b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6f001587d0 0x7f6f00070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6f0640b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f000710c0 0x7f6f000cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6f0640b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0006fae0 con 0x7f6f00158400 2023-07-06T22:20:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6f0640b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f0006fdc0 con 0x7f6f000710c0 2023-07-06T22:20:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6f0640b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f000700a0 con 0x7f6f001587d0 2023-07-06T22:20:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6f049a8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f000710c0 0x7f6f000cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6f049a8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f000710c0 0x7f6f000cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35274/0 (socket says 172.21.15.55:35274) 2023-07-06T22:20:03.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6f049a8640 1 -- 172.21.15.55:0/2886361404 learned_addr learned my addr 172.21.15.55:0/2886361404 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:03.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6eff7fe640 1 --2- 172.21.15.55:0/2886361404 >> v2:172.21.15.138:3300/0 conn(0x7f6f001587d0 0x7f6f00070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:03.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6efeffd640 1 -- 172.21.15.55:0/2886361404 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620792336 0 0) 0x7f6f0006fae0 con 0x7f6f00158400 2023-07-06T22:20:03.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6efeffd640 1 -- 172.21.15.55:0/2886361404 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ee8003530 con 0x7f6f00158400 2023-07-06T22:20:03.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6f049a8640 1 -- 172.21.15.55:0/2886361404 >> v2:172.21.15.138:3300/0 conn(0x7f6f001587d0 msgr2=0x7f6f00070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:03.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6f049a8640 1 --2- 172.21.15.55:0/2886361404 >> v2:172.21.15.138:3300/0 conn(0x7f6f001587d0 0x7f6f00070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6f049a8640 1 -- 172.21.15.55:0/2886361404 >> v1:172.21.15.138:6789/0 conn(0x7f6f00158400 legacy=0x7f6f000c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:03.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6f049a8640 1 -- 172.21.15.55:0/2886361404 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f00070380 con 0x7f6f000710c0 2023-07-06T22:20:03.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.543+0000 7f6eff7fe640 1 --2- 172.21.15.55:0/2886361404 >> v2:172.21.15.138:3300/0 conn(0x7f6f001587d0 0x7f6f00070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:03.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.547+0000 7f6f049a8640 1 --2- 172.21.15.55:0/2886361404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f000710c0 0x7f6f000cbaa0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f6f000ad960 tx=0x7f6ef801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf742b770a1062f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:03.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6efeffd640 1 -- 172.21.15.55:0/2886361404 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80a5770 con 0x7f6f000710c0 2023-07-06T22:20:03.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6efeffd640 1 -- 172.21.15.55:0/2886361404 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef80a58d0 con 0x7f6f000710c0 2023-07-06T22:20:03.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6efeffd640 1 -- 172.21.15.55:0/2886361404 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80a5c40 con 0x7f6f000710c0 2023-07-06T22:20:03.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6f0640b640 1 -- 172.21.15.55:0/2886361404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f000710c0 msgr2=0x7f6f000cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:03.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6f0640b640 1 --2- 172.21.15.55:0/2886361404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f000710c0 0x7f6f000cbaa0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f6f000ad960 tx=0x7f6ef801c9a0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6f0640b640 1 -- 172.21.15.55:0/2886361404 shutdown_connections 2023-07-06T22:20:03.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6f0640b640 1 --2- 172.21.15.55:0/2886361404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f000710c0 0x7f6f000cbaa0 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6f0640b640 1 --2- 172.21.15.55:0/2886361404 >> v2:172.21.15.138:3300/0 conn(0x7f6f001587d0 0x7f6f00070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6f0640b640 1 -- 172.21.15.55:0/2886361404 >> 172.21.15.55:0/2886361404 conn(0x7f6f000cded0 msgr2=0x7f6f000ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:03.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6f0640b640 1 -- 172.21.15.55:0/2886361404 shutdown_connections 2023-07-06T22:20:03.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6f0640b640 1 -- 172.21.15.55:0/2886361404 wait complete. 2023-07-06T22:20:03.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6f0640b640 1 Processor -- start 2023-07-06T22:20:03.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6f0640b640 1 -- start start 2023-07-06T22:20:03.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6f0640b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f000710c0 0x7f6f00149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6f0640b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f00158400 0x7f6f00162790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.551+0000 7f6f0640b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f001587d0 0x7f6f0015fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f0640b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001631e0 con 0x7f6f001587d0 2023-07-06T22:20:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f0640b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0015d4e0 con 0x7f6f000710c0 2023-07-06T22:20:03.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f0640b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0015d7c0 con 0x7f6f00158400 2023-07-06T22:20:03.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f049a8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f001587d0 0x7f6f0015fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:03.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f049a8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f001587d0 0x7f6f0015fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35286/0 (socket says 172.21.15.55:35286) 2023-07-06T22:20:03.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f049a8640 1 -- 172.21.15.55:0/2425621068 learned_addr learned my addr 172.21.15.55:0/2425621068 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:03.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6efffff640 1 --2- 172.21.15.55:0/2425621068 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f000710c0 0x7f6f00149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:03.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6eff7fe640 1 --2- 172.21.15.55:0/2425621068 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f00158400 0x7f6f00162790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:03.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f049a8640 1 -- 172.21.15.55:0/2425621068 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f00158400 msgr2=0x7f6f00162790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:03.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f049a8640 1 --2- 172.21.15.55:0/2425621068 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f00158400 0x7f6f00162790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f049a8640 1 -- 172.21.15.55:0/2425621068 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f000710c0 msgr2=0x7f6f00149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:03.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f049a8640 1 --2- 172.21.15.55:0/2425621068 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f000710c0 0x7f6f00149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f049a8640 1 -- 172.21.15.55:0/2425621068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef4009420 con 0x7f6f001587d0 2023-07-06T22:20:03.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6efffff640 1 --2- 172.21.15.55:0/2425621068 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f000710c0 0x7f6f00149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:03.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f049a8640 1 --2- 172.21.15.55:0/2425621068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f001587d0 0x7f6f0015fb00 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f6ef801a5d0 tx=0x7f6ef8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:03.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6efcff9640 1 -- 172.21.15.55:0/2425621068 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8003ba0 con 0x7f6f001587d0 2023-07-06T22:20:03.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6efcff9640 1 -- 172.21.15.55:0/2425621068 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8003d00 con 0x7f6f001587d0 2023-07-06T22:20:03.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6efcff9640 1 -- 172.21.15.55:0/2425621068 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8004240 con 0x7f6f001587d0 2023-07-06T22:20:03.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f0640b640 1 -- 172.21.15.55:0/2425621068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef8009b30 con 0x7f6f001587d0 2023-07-06T22:20:03.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f0640b640 1 -- 172.21.15.55:0/2425621068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f00149690 con 0x7f6f001587d0 2023-07-06T22:20:03.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6f0640b640 1 -- 172.21.15.55:0/2425621068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0006c580 con 0x7f6f001587d0 2023-07-06T22:20:03.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.555+0000 7f6efcff9640 1 -- 172.21.15.55:0/2425621068 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 102) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f6ef80043a0 con 0x7f6f001587d0 2023-07-06T22:20:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.559+0000 7f6efcff9640 1 --2- 172.21.15.55:0/2425621068 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f6eec0664f0 0x7f6eec0689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.559+0000 7f6efcff9640 1 -- 172.21.15.55:0/2425621068 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f6ef811f790 con 0x7f6f001587d0 2023-07-06T22:20:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.559+0000 7f6efffff640 1 -- 172.21.15.55:0/2425621068 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f6eec0664f0 msgr2=0x7f6eec0689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/628169602 2023-07-06T22:20:03.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.559+0000 7f6efffff640 1 --2- 172.21.15.55:0/2425621068 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f6eec0664f0 0x7f6eec0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:03.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.563+0000 7f6efcff9640 1 -- 172.21.15.55:0/2425621068 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ef80ec600 con 0x7f6f001587d0 2023-07-06T22:20:03.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.719+0000 7f6f0640b640 1 -- 172.21.15.55:0/2425621068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f00066d60 con 0x7f6f001587d0 2023-07-06T22:20:03.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.719+0000 7f6efcff9640 1 -- 172.21.15.55:0/2425621068 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+19085 (secure 0 0 0) 0x7f6ef8009510 con 0x7f6f001587d0 2023-07-06T22:20:03.723 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:03.724 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":180,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:18:57.087705+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:18:38.520955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-07-06T22:18:39.591879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/455359735":"2023-07-07T22:18:57.087673+0000","172.21.15.55:6833/957337795":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/2168505984":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/3159272832":"2023-07-07T22:18:57.087673+0000","172.21.15.55:6832/957337795":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/748095594":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/4040799024":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/56444713":"2023-07-07T22:18:57.087673+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:20:03.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.723+0000 7f6f0640b640 1 -- 172.21.15.55:0/2425621068 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f6eec0664f0 msgr2=0x7f6eec0689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:03.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.723+0000 7f6f0640b640 1 --2- 172.21.15.55:0/2425621068 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f6eec0664f0 0x7f6eec0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.723+0000 7f6f0640b640 1 -- 172.21.15.55:0/2425621068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f001587d0 msgr2=0x7f6f0015fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:03.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.723+0000 7f6f0640b640 1 --2- 172.21.15.55:0/2425621068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f001587d0 0x7f6f0015fb00 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f6ef801a5d0 tx=0x7f6ef8019740 comp rx=0 tx=0).stop 2023-07-06T22:20:03.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.723+0000 7f6f0640b640 1 -- 172.21.15.55:0/2425621068 shutdown_connections 2023-07-06T22:20:03.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.723+0000 7f6f0640b640 1 --2- 172.21.15.55:0/2425621068 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f6eec0664f0 0x7f6eec0689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.723+0000 7f6f0640b640 1 --2- 172.21.15.55:0/2425621068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f001587d0 0x7f6f0015fb00 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.723+0000 7f6f0640b640 1 --2- 172.21.15.55:0/2425621068 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6f00158400 0x7f6f00162790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.723+0000 7f6f0640b640 1 --2- 172.21.15.55:0/2425621068 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f000710c0 0x7f6f00149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.723+0000 7f6f0640b640 1 -- 172.21.15.55:0/2425621068 >> 172.21.15.55:0/2425621068 conn(0x7f6f000cded0 msgr2=0x7f6f00156ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:03.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.723+0000 7f6f0640b640 1 -- 172.21.15.55:0/2425621068 shutdown_connections 2023-07-06T22:20:03.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.723+0000 7f6f0640b640 1 -- 172.21.15.55:0/2425621068 wait complete. 2023-07-06T22:20:03.746 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T22:18:38.520955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '178', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T22:18:39.591879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:20:03.747 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:20:03.754 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:03.752+0000 7fbbbbed0180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:20:03.796 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:03.795+0000 7fa96e262180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:20:03.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff82f167640 1 Processor -- start 2023-07-06T22:20:03.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff82f167640 1 -- start start 2023-07-06T22:20:03.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff82f167640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8280b3870 0x7ff8280b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:03.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff82f167640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8280d03c0 0x7ff8280d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:03.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff82f167640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8280b4210 con 0x7ff82815b850 2023-07-06T22:20:03.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff82f167640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8280b2b80 con 0x7ff8280b3870 2023-07-06T22:20:03.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff82f167640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8280cff30 con 0x7ff8280d03c0 2023-07-06T22:20:03.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff827fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8280b3870 0x7ff8280b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:03.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff827fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8280b3870 0x7ff8280b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35300/0 (socket says 172.21.15.55:35300) 2023-07-06T22:20:03.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff827fff640 1 -- 172.21.15.55:0/1912825982 learned_addr learned my addr 172.21.15.55:0/1912825982 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:03.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff82d704640 1 --2- 172.21.15.55:0/1912825982 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8280d03c0 0x7ff8280d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:03.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff827fff640 1 -- 172.21.15.55:0/1912825982 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8280d03c0 msgr2=0x7ff8280d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:03.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff827fff640 1 --2- 172.21.15.55:0/1912825982 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8280d03c0 0x7ff8280d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff827fff640 1 -- 172.21.15.55:0/1912825982 >> v1:172.21.15.138:6789/0 conn(0x7ff82815b850 legacy=0x7ff8280cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:03.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.895+0000 7ff827fff640 1 -- 172.21.15.55:0/1912825982 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8280b22e0 con 0x7ff8280b3870 2023-07-06T22:20:03.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.899+0000 7ff827fff640 1 --2- 172.21.15.55:0/1912825982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8280b3870 0x7ff8280b3cd0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7ff814009870 tx=0x7ff81401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7dd0823e117c83 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:03.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.899+0000 7ff8277fe640 1 -- 172.21.15.55:0/1912825982 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8140ab5f0 con 0x7ff8280b3870 2023-07-06T22:20:03.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.899+0000 7ff8277fe640 1 -- 172.21.15.55:0/1912825982 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8140ab750 con 0x7ff8280b3870 2023-07-06T22:20:03.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.899+0000 7ff8277fe640 1 -- 172.21.15.55:0/1912825982 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8140abae0 con 0x7ff8280b3870 2023-07-06T22:20:03.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.899+0000 7ff82f167640 1 -- 172.21.15.55:0/1912825982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8280b3870 msgr2=0x7ff8280b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:03.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.899+0000 7ff82f167640 1 --2- 172.21.15.55:0/1912825982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8280b3870 0x7ff8280b3cd0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7ff814009870 tx=0x7ff81401c3f0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.899+0000 7ff82f167640 1 -- 172.21.15.55:0/1912825982 shutdown_connections 2023-07-06T22:20:03.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.899+0000 7ff82f167640 1 --2- 172.21.15.55:0/1912825982 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8280d03c0 0x7ff8280d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.899+0000 7ff82f167640 1 --2- 172.21.15.55:0/1912825982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8280b3870 0x7ff8280b3cd0 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.899+0000 7ff82f167640 1 -- 172.21.15.55:0/1912825982 >> 172.21.15.55:0/1912825982 conn(0x7ff8280cec20 msgr2=0x7ff8280cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:03.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.899+0000 7ff82f167640 1 -- 172.21.15.55:0/1912825982 shutdown_connections 2023-07-06T22:20:03.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.899+0000 7ff82f167640 1 -- 172.21.15.55:0/1912825982 wait complete. 2023-07-06T22:20:03.904 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:03.904+0000 7fbbbbed0180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:20:03.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82f167640 1 Processor -- start 2023-07-06T22:20:03.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82f167640 1 -- start start 2023-07-06T22:20:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82f167640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8280b3870 0x7ff8280cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82f167640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8280d03c0 0x7ff82815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82f167640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff82815b850 0x7ff82815c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82f167640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82815eef0 con 0x7ff8280b3870 2023-07-06T22:20:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82f167640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82815e930 con 0x7ff82815b850 2023-07-06T22:20:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82f167640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82815ec10 con 0x7ff8280d03c0 2023-07-06T22:20:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82cf03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8280b3870 0x7ff8280cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82cf03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8280b3870 0x7ff8280cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35306/0 (socket says 172.21.15.55:35306) 2023-07-06T22:20:03.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82cf03640 1 -- 172.21.15.55:0/4077016814 learned_addr learned my addr 172.21.15.55:0/4077016814 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:03.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff827fff640 1 --2- 172.21.15.55:0/4077016814 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8280d03c0 0x7ff82815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:03.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82d704640 1 --2- 172.21.15.55:0/4077016814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff82815b850 0x7ff82815c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:03.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82cf03640 1 -- 172.21.15.55:0/4077016814 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8280d03c0 msgr2=0x7ff82815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:03.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82cf03640 1 --2- 172.21.15.55:0/4077016814 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8280d03c0 0x7ff82815bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82cf03640 1 -- 172.21.15.55:0/4077016814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff82815b850 msgr2=0x7ff82815c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:03.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82cf03640 1 --2- 172.21.15.55:0/4077016814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff82815b850 0x7ff82815c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:03.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82cf03640 1 -- 172.21.15.55:0/4077016814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8140094d0 con 0x7ff8280b3870 2023-07-06T22:20:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82cf03640 1 --2- 172.21.15.55:0/4077016814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8280b3870 0x7ff8280cbf60 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00c500 tx=0x7ff81c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff8257fa640 1 -- 172.21.15.55:0/4077016814 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c005220 con 0x7ff8280b3870 2023-07-06T22:20:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff8257fa640 1 -- 172.21.15.55:0/4077016814 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c005380 con 0x7ff8280b3870 2023-07-06T22:20:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff8257fa640 1 -- 172.21.15.55:0/4077016814 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c007270 con 0x7ff8280b3870 2023-07-06T22:20:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82f167640 1 -- 172.21.15.55:0/4077016814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff828158aa0 con 0x7ff8280b3870 2023-07-06T22:20:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.903+0000 7ff82f167640 1 -- 172.21.15.55:0/4077016814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff828159060 con 0x7ff8280b3870 2023-07-06T22:20:03.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.907+0000 7ff82f167640 1 -- 172.21.15.55:0/4077016814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff828066d60 con 0x7ff8280b3870 2023-07-06T22:20:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.907+0000 7ff8257fa640 1 -- 172.21.15.55:0/4077016814 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 102) v1 ==== 85874+0+0 (secure 0 0 0) 0x7ff81c0073d0 con 0x7ff8280b3870 2023-07-06T22:20:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.907+0000 7ff8257fa640 1 --2- 172.21.15.55:0/4077016814 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7ff80c0664c0 0x7ff80c068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.907+0000 7ff827fff640 1 -- 172.21.15.55:0/4077016814 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7ff80c0664c0 msgr2=0x7ff80c068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/628169602 2023-07-06T22:20:03.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.907+0000 7ff8257fa640 1 -- 172.21.15.55:0/4077016814 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6754+0+0 (secure 0 0 0) 0x7ff81c083c60 con 0x7ff8280b3870 2023-07-06T22:20:03.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.907+0000 7ff827fff640 1 --2- 172.21.15.55:0/4077016814 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7ff80c0664c0 0x7ff80c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:03.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:03.911+0000 7ff8257fa640 1 -- 172.21.15.55:0/4077016814 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff81c050ae0 con 0x7ff8280b3870 2023-07-06T22:20:03.957 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:03.955+0000 7fa96e262180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:20:04.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.071+0000 7ff82f167640 1 -- 172.21.15.55:0/4077016814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8280ce700 con 0x7ff8280b3870 2023-07-06T22:20:04.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.071+0000 7ff8257fa640 1 -- 172.21.15.55:0/4077016814 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff81c054100 con 0x7ff8280b3870 2023-07-06T22:20:04.073 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:20:04.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.071+0000 7ff82f167640 1 -- 172.21.15.55:0/4077016814 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7ff80c0664c0 msgr2=0x7ff80c068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:04.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.071+0000 7ff82f167640 1 --2- 172.21.15.55:0/4077016814 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7ff80c0664c0 0x7ff80c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.071+0000 7ff82f167640 1 -- 172.21.15.55:0/4077016814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8280b3870 msgr2=0x7ff8280cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.071+0000 7ff82f167640 1 --2- 172.21.15.55:0/4077016814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8280b3870 0x7ff8280cbf60 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00c500 tx=0x7ff81c00c9c0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.071+0000 7ff82f167640 1 -- 172.21.15.55:0/4077016814 shutdown_connections 2023-07-06T22:20:04.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.071+0000 7ff82f167640 1 --2- 172.21.15.55:0/4077016814 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7ff80c0664c0 0x7ff80c068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.071+0000 7ff82f167640 1 --2- 172.21.15.55:0/4077016814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff82815b850 0x7ff82815c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.071+0000 7ff82f167640 1 --2- 172.21.15.55:0/4077016814 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8280d03c0 0x7ff82815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.071+0000 7ff82f167640 1 --2- 172.21.15.55:0/4077016814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8280b3870 0x7ff8280cbf60 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.071+0000 7ff82f167640 1 -- 172.21.15.55:0/4077016814 >> 172.21.15.55:0/4077016814 conn(0x7ff8280cec20 msgr2=0x7ff82806aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:04.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.071+0000 7ff82f167640 1 -- 172.21.15.55:0/4077016814 shutdown_connections 2023-07-06T22:20:04.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.071+0000 7ff82f167640 1 -- 172.21.15.55:0/4077016814 wait complete. 2023-07-06T22:20:04.095 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:20:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f857d493640 1 Processor -- start 2023-07-06T22:20:04.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f857d493640 1 -- start start 2023-07-06T22:20:04.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f857d493640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f857815b850 0x7f85780cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f857d493640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85780b2b80 con 0x7f85780ccd30 2023-07-06T22:20:04.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f857d493640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85780cff30 con 0x7f85780b3f80 2023-07-06T22:20:04.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f857d493640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85780b22e0 con 0x7f857815b850 2023-07-06T22:20:04.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f85767fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f85780ccd30 0x7f85780b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54854/0 (socket says 172.21.15.55:54854) 2023-07-06T22:20:04.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f85767fc640 1 -- 172.21.15.55:0/1301875980 learned_addr learned my addr 172.21.15.55:0/1301875980 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:04.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f8576ffd640 1 --2- 172.21.15.55:0/1301875980 >> v2:172.21.15.138:3300/0 conn(0x7f857815b850 0x7f85780cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:04.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f8575ffb640 1 -- 172.21.15.55:0/1301875980 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242095607 0 0) 0x7f85780b2b80 con 0x7f85780ccd30 2023-07-06T22:20:04.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f8575ffb640 1 -- 172.21.15.55:0/1301875980 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8560003530 con 0x7f85780ccd30 2023-07-06T22:20:04.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f8575ffb640 1 -- 172.21.15.55:0/1301875980 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670841264 0 0) 0x7f85780cff30 con 0x7f85780b3f80 2023-07-06T22:20:04.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f8575ffb640 1 -- 172.21.15.55:0/1301875980 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85780b2b80 con 0x7f85780b3f80 2023-07-06T22:20:04.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f8575ffb640 1 -- 172.21.15.55:0/1301875980 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2222896800 0 0) 0x7f8560003530 con 0x7f85780ccd30 2023-07-06T22:20:04.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f8576ffd640 1 -- 172.21.15.55:0/1301875980 >> v1:172.21.15.138:6789/0 conn(0x7f85780b3f80 legacy=0x7f85780d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f8576ffd640 1 -- 172.21.15.55:0/1301875980 >> v1:172.21.15.55:6789/0 conn(0x7f85780ccd30 legacy=0x7f85780b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.243+0000 7f8576ffd640 1 -- 172.21.15.55:0/1301875980 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85780b25c0 con 0x7f857815b850 2023-07-06T22:20:04.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.247+0000 7f8576ffd640 1 --2- 172.21.15.55:0/1301875980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f857815b850 0x7f85780cc7f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f85680097c0 tx=0x7f856801c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b43c0e46d4ad3b97 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:04.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.247+0000 7f8575ffb640 1 -- 172.21.15.55:0/1301875980 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c001680 con 0x7f857815b850 2023-07-06T22:20:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.247+0000 7f8575ffb640 1 -- 172.21.15.55:0/1301875980 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85680a7050 con 0x7f857815b850 2023-07-06T22:20:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.247+0000 7f8575ffb640 1 -- 172.21.15.55:0/1301875980 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85680ab600 con 0x7f857815b850 2023-07-06T22:20:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.247+0000 7f857d493640 1 -- 172.21.15.55:0/1301875980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f857815b850 msgr2=0x7f85780cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.247+0000 7f857d493640 1 --2- 172.21.15.55:0/1301875980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f857815b850 0x7f85780cc7f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f85680097c0 tx=0x7f856801c250 comp rx=0 tx=0).stop 2023-07-06T22:20:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.247+0000 7f857d493640 1 -- 172.21.15.55:0/1301875980 shutdown_connections 2023-07-06T22:20:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.247+0000 7f857d493640 1 --2- 172.21.15.55:0/1301875980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f857815b850 0x7f85780cc7f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.247+0000 7f857d493640 1 -- 172.21.15.55:0/1301875980 >> 172.21.15.55:0/1301875980 conn(0x7f85780cec20 msgr2=0x7f85780cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.247+0000 7f857d493640 1 -- 172.21.15.55:0/1301875980 shutdown_connections 2023-07-06T22:20:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.247+0000 7f857d493640 1 -- 172.21.15.55:0/1301875980 wait complete. 2023-07-06T22:20:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f857d493640 1 Processor -- start 2023-07-06T22:20:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f857d493640 1 -- start start 2023-07-06T22:20:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f857d493640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85780b3f80 0x7f857814ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f857d493640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85780ccd30 0x7f8578157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f857d493640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f857815b850 0x7f85780b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f857d493640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8578157ed0 con 0x7f85780b3f80 2023-07-06T22:20:04.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f857d493640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85781581b0 con 0x7f85780ccd30 2023-07-06T22:20:04.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f857d493640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8578158490 con 0x7f857815b850 2023-07-06T22:20:04.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f8576ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85780b3f80 0x7f857814ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:04.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f8576ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85780b3f80 0x7f857814ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35308/0 (socket says 172.21.15.55:35308) 2023-07-06T22:20:04.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f85777fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f857815b850 0x7f85780b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:04.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f85767fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85780ccd30 0x7f8578157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:04.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f8576ffd640 1 -- 172.21.15.55:0/78678176 learned_addr learned my addr 172.21.15.55:0/78678176 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:04.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f85777fe640 1 -- 172.21.15.55:0/78678176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85780ccd30 msgr2=0x7f8578157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f85777fe640 1 --2- 172.21.15.55:0/78678176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85780ccd30 0x7f8578157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f85777fe640 1 -- 172.21.15.55:0/78678176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85780b3f80 msgr2=0x7f857814ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f85777fe640 1 --2- 172.21.15.55:0/78678176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85780b3f80 0x7f857814ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f85777fe640 1 -- 172.21.15.55:0/78678176 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8568009420 con 0x7f857815b850 2023-07-06T22:20:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f85767fc640 1 --2- 172.21.15.55:0/78678176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85780ccd30 0x7f8578157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f8576ffd640 1 --2- 172.21.15.55:0/78678176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85780b3f80 0x7f857814ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f85777fe640 1 --2- 172.21.15.55:0/78678176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f857815b850 0x7f85780b55a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f857000c6c0 tx=0x7f857000cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f855f7fe640 1 -- 172.21.15.55:0/78678176 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570003bd0 con 0x7f857815b850 2023-07-06T22:20:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f855f7fe640 1 -- 172.21.15.55:0/78678176 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8570003d30 con 0x7f857815b850 2023-07-06T22:20:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f855f7fe640 1 -- 172.21.15.55:0/78678176 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570005310 con 0x7f857815b850 2023-07-06T22:20:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f857d493640 1 -- 172.21.15.55:0/78678176 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857815bda0 con 0x7f857815b850 2023-07-06T22:20:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.251+0000 7f857d493640 1 -- 172.21.15.55:0/78678176 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8578158a50 con 0x7f857815b850 2023-07-06T22:20:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.255+0000 7f857d493640 1 -- 172.21.15.55:0/78678176 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8578066d60 con 0x7f857815b850 2023-07-06T22:20:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.255+0000 7f855f7fe640 1 -- 172.21.15.55:0/78678176 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 102) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f8570005470 con 0x7f857815b850 2023-07-06T22:20:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.255+0000 7f855f7fe640 1 --2- 172.21.15.55:0/78678176 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f85640664c0 0x7f8564068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.255+0000 7f855f7fe640 1 -- 172.21.15.55:0/78678176 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f85700840b0 con 0x7f857815b850 2023-07-06T22:20:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.255+0000 7f8576ffd640 1 -- 172.21.15.55:0/78678176 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f85640664c0 msgr2=0x7f8564068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/628169602 2023-07-06T22:20:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.255+0000 7f8576ffd640 1 --2- 172.21.15.55:0/78678176 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f85640664c0 0x7f8564068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:04.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.259+0000 7f855f7fe640 1 -- 172.21.15.55:0/78678176 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8570051030 con 0x7f857815b850 2023-07-06T22:20:04.387 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:04.384+0000 7fbbbbed0180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:20:04.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.419+0000 7f857d493640 1 -- 172.21.15.55:0/78678176 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f85780b3420 con 0x7f857815b850 2023-07-06T22:20:04.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.419+0000 7f855f7fe640 1 -- 172.21.15.55:0/78678176 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v180) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8570058e60 con 0x7f857815b850 2023-07-06T22:20:04.421 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:20:04.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.419+0000 7f857d493640 1 -- 172.21.15.55:0/78678176 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f85640664c0 msgr2=0x7f8564068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.419+0000 7f857d493640 1 --2- 172.21.15.55:0/78678176 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f85640664c0 0x7f8564068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.419+0000 7f857d493640 1 -- 172.21.15.55:0/78678176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f857815b850 msgr2=0x7f85780b55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.419+0000 7f857d493640 1 --2- 172.21.15.55:0/78678176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f857815b850 0x7f85780b55a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f857000c6c0 tx=0x7f857000cb80 comp rx=0 tx=0).stop 2023-07-06T22:20:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.419+0000 7f857d493640 1 -- 172.21.15.55:0/78678176 shutdown_connections 2023-07-06T22:20:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.419+0000 7f857d493640 1 --2- 172.21.15.55:0/78678176 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f85640664c0 0x7f8564068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.419+0000 7f857d493640 1 --2- 172.21.15.55:0/78678176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f857815b850 0x7f85780b55a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.419+0000 7f857d493640 1 --2- 172.21.15.55:0/78678176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85780ccd30 0x7f8578157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.419+0000 7f857d493640 1 --2- 172.21.15.55:0/78678176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85780b3f80 0x7f857814ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.419+0000 7f857d493640 1 -- 172.21.15.55:0/78678176 >> 172.21.15.55:0/78678176 conn(0x7f85780cec20 msgr2=0x7f857815a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.423+0000 7f857d493640 1 -- 172.21.15.55:0/78678176 shutdown_connections 2023-07-06T22:20:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.423+0000 7f857d493640 1 -- 172.21.15.55:0/78678176 wait complete. 2023-07-06T22:20:04.444 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T22:20:04.445 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:04.444+0000 7fbbbbed0180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:20:04.472 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:04.471+0000 7fa96e262180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:20:04.501 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:04.500+0000 7fbbbbed0180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:20:04.536 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:04.535+0000 7fa96e262180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:20:04.586 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:04.584+0000 7fbbbbed0180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:20:04.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.587+0000 7fe7207fa640 1 Processor -- start 2023-07-06T22:20:04.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe7207fa640 1 -- start start 2023-07-06T22:20:04.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe7207fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe71815b850 0x7fe7180cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe7207fa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe7180ccd30 0x7fe7180b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe7207fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7180b4210 con 0x7fe7180b3db0 2023-07-06T22:20:04.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe7207fa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7180b2b80 con 0x7fe7180ccd30 2023-07-06T22:20:04.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe7207fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7180cff30 con 0x7fe71815b850 2023-07-06T22:20:04.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe71ed97640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe7180b3db0 0x7fe71815f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54860/0 (socket says 172.21.15.55:54860) 2023-07-06T22:20:04.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe71ed97640 1 -- 172.21.15.55:0/3453711610 learned_addr learned my addr 172.21.15.55:0/3453711610 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:04.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe71e596640 1 --2- 172.21.15.55:0/3453711610 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe71815b850 0x7fe7180cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe71dd95640 1 --2- 172.21.15.55:0/3453711610 >> v2:172.21.15.138:3300/0 conn(0x7fe7180ccd30 0x7fe7180b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe71d594640 1 -- 172.21.15.55:0/3453711610 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649252170 0 0) 0x7fe7180b4210 con 0x7fe7180b3db0 2023-07-06T22:20:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe71e596640 1 -- 172.21.15.55:0/3453711610 >> v2:172.21.15.138:3300/0 conn(0x7fe7180ccd30 msgr2=0x7fe7180b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe71e596640 1 --2- 172.21.15.55:0/3453711610 >> v2:172.21.15.138:3300/0 conn(0x7fe7180ccd30 0x7fe7180b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe71e596640 1 -- 172.21.15.55:0/3453711610 >> v1:172.21.15.55:6789/0 conn(0x7fe7180b3db0 legacy=0x7fe71815f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe71e596640 1 -- 172.21.15.55:0/3453711610 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7180b22e0 con 0x7fe71815b850 2023-07-06T22:20:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.591+0000 7fe71dd95640 1 --2- 172.21.15.55:0/3453711610 >> v2:172.21.15.138:3300/0 conn(0x7fe7180ccd30 0x7fe7180b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:04.596 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:04.595+0000 7fa96e262180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:20:04.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.595+0000 7fe71e596640 1 --2- 172.21.15.55:0/3453711610 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe71815b850 0x7fe7180cc7f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe7140097c0 tx=0x7fe71401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1cbaa4d1d0764d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:04.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.595+0000 7fe71d594640 1 -- 172.21.15.55:0/3453711610 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7140ab600 con 0x7fe71815b850 2023-07-06T22:20:04.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.595+0000 7fe71d594640 1 -- 172.21.15.55:0/3453711610 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7140a7050 con 0x7fe71815b850 2023-07-06T22:20:04.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.595+0000 7fe71d594640 1 -- 172.21.15.55:0/3453711610 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7140ab980 con 0x7fe71815b850 2023-07-06T22:20:04.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.595+0000 7fe7207fa640 1 -- 172.21.15.55:0/3453711610 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe71815b850 msgr2=0x7fe7180cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.595+0000 7fe7207fa640 1 --2- 172.21.15.55:0/3453711610 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe71815b850 0x7fe7180cc7f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe7140097c0 tx=0x7fe71401c330 comp rx=0 tx=0).stop 2023-07-06T22:20:04.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.595+0000 7fe7207fa640 1 -- 172.21.15.55:0/3453711610 shutdown_connections 2023-07-06T22:20:04.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.595+0000 7fe7207fa640 1 --2- 172.21.15.55:0/3453711610 >> v2:172.21.15.138:3300/0 conn(0x7fe7180ccd30 0x7fe7180b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.595+0000 7fe7207fa640 1 --2- 172.21.15.55:0/3453711610 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe71815b850 0x7fe7180cc7f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.595+0000 7fe7207fa640 1 -- 172.21.15.55:0/3453711610 >> 172.21.15.55:0/3453711610 conn(0x7fe7180cec20 msgr2=0x7fe7180cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:04.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.595+0000 7fe7207fa640 1 -- 172.21.15.55:0/3453711610 shutdown_connections 2023-07-06T22:20:04.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.595+0000 7fe7207fa640 1 -- 172.21.15.55:0/3453711610 wait complete. 2023-07-06T22:20:04.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe7207fa640 1 Processor -- start 2023-07-06T22:20:04.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe7207fa640 1 -- start start 2023-07-06T22:20:04.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe7207fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7180b3db0 0x7fe71814f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe7207fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7180ccd30 0x7fe718159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe7207fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe71815b850 0x7fe71806a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe7207fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71815ab30 con 0x7fe71815b850 2023-07-06T22:20:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe7207fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71815a850 con 0x7fe7180ccd30 2023-07-06T22:20:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe7207fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe718151f80 con 0x7fe7180b3db0 2023-07-06T22:20:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe71e596640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7180b3db0 0x7fe71814f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe71ed97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe71815b850 0x7fe71806a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe71e596640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7180b3db0 0x7fe71814f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44134/0 (socket says 172.21.15.55:44134) 2023-07-06T22:20:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe71e596640 1 -- 172.21.15.55:0/1140568082 learned_addr learned my addr 172.21.15.55:0/1140568082 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe71dd95640 1 --2- 172.21.15.55:0/1140568082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7180ccd30 0x7fe718159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe71e596640 1 -- 172.21.15.55:0/1140568082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7180ccd30 msgr2=0x7fe718159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe71e596640 1 --2- 172.21.15.55:0/1140568082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7180ccd30 0x7fe718159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe71e596640 1 -- 172.21.15.55:0/1140568082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe71815b850 msgr2=0x7fe71806a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe71e596640 1 --2- 172.21.15.55:0/1140568082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe71815b850 0x7fe71806a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe71e596640 1 -- 172.21.15.55:0/1140568082 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe708009420 con 0x7fe7180b3db0 2023-07-06T22:20:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe71e596640 1 --2- 172.21.15.55:0/1140568082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7180b3db0 0x7fe71814f820 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe71401a9e0 tx=0x7fe7140190d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe70effd640 1 -- 172.21.15.55:0/1140568082 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7140b5470 con 0x7fe7180b3db0 2023-07-06T22:20:04.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe70effd640 1 -- 172.21.15.55:0/1140568082 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7140b55d0 con 0x7fe7180b3db0 2023-07-06T22:20:04.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe70effd640 1 -- 172.21.15.55:0/1140568082 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7140b5980 con 0x7fe7180b3db0 2023-07-06T22:20:04.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe7207fa640 1 -- 172.21.15.55:0/1140568082 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe714009420 con 0x7fe7180b3db0 2023-07-06T22:20:04.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.599+0000 7fe7207fa640 1 -- 172.21.15.55:0/1140568082 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71815bda0 con 0x7fe7180b3db0 2023-07-06T22:20:04.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.603+0000 7fe7207fa640 1 -- 172.21.15.55:0/1140568082 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe718151de0 con 0x7fe7180b3db0 2023-07-06T22:20:04.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.603+0000 7fe70effd640 1 -- 172.21.15.55:0/1140568082 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 102) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fe7140b2040 con 0x7fe7180b3db0 2023-07-06T22:20:04.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.603+0000 7fe70effd640 1 --2- 172.21.15.55:0/1140568082 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fe6fc0664f0 0x7fe6fc0689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.603+0000 7fe70effd640 1 -- 172.21.15.55:0/1140568082 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fe71411e700 con 0x7fe7180b3db0 2023-07-06T22:20:04.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.603+0000 7fe71dd95640 1 -- 172.21.15.55:0/1140568082 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fe6fc0664f0 msgr2=0x7fe6fc0689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/628169602 2023-07-06T22:20:04.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.603+0000 7fe71dd95640 1 --2- 172.21.15.55:0/1140568082 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fe6fc0664f0 0x7fe6fc0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.607+0000 7fe70effd640 1 -- 172.21.15.55:0/1140568082 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe718151de0 con 0x7fe7180b3db0 2023-07-06T22:20:04.645 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:04.644+0000 7fbbbbed0180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:20:04.690 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:04.687+0000 7fa96e262180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:20:04.729 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:04.728+0000 7fbbbbed0180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:20:04.750 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:04.747+0000 7fa96e262180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:20:04.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.763+0000 7fe7207fa640 1 -- 172.21.15.55:0/1140568082 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe718151de0 con 0x7fe7180b3db0 2023-07-06T22:20:04.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.763+0000 7fe70effd640 1 -- 172.21.15.55:0/1140568082 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v180) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe718151de0 con 0x7fe7180b3db0 2023-07-06T22:20:04.767 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T22:20:04.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.767+0000 7fe7207fa640 1 -- 172.21.15.55:0/1140568082 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fe6fc0664f0 msgr2=0x7fe6fc0689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:04.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.767+0000 7fe7207fa640 1 --2- 172.21.15.55:0/1140568082 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fe6fc0664f0 0x7fe6fc0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.767+0000 7fe7207fa640 1 -- 172.21.15.55:0/1140568082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7180b3db0 msgr2=0x7fe71814f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.767+0000 7fe7207fa640 1 --2- 172.21.15.55:0/1140568082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7180b3db0 0x7fe71814f820 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe71401a9e0 tx=0x7fe7140190d0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.767+0000 7fe7207fa640 1 -- 172.21.15.55:0/1140568082 shutdown_connections 2023-07-06T22:20:04.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.767+0000 7fe7207fa640 1 --2- 172.21.15.55:0/1140568082 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fe6fc0664f0 0x7fe6fc0689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.767+0000 7fe7207fa640 1 --2- 172.21.15.55:0/1140568082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe71815b850 0x7fe71806a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.767+0000 7fe7207fa640 1 --2- 172.21.15.55:0/1140568082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe7180ccd30 0x7fe718159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.767+0000 7fe7207fa640 1 --2- 172.21.15.55:0/1140568082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe7180b3db0 0x7fe71814f820 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.767+0000 7fe7207fa640 1 -- 172.21.15.55:0/1140568082 >> 172.21.15.55:0/1140568082 conn(0x7fe7180cec20 msgr2=0x7fe7180c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:04.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.767+0000 7fe7207fa640 1 -- 172.21.15.55:0/1140568082 shutdown_connections 2023-07-06T22:20:04.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.767+0000 7fe7207fa640 1 -- 172.21.15.55:0/1140568082 wait complete. 2023-07-06T22:20:04.785 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:04.784+0000 7fbbbbed0180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:20:04.789 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T22:20:04.839 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:04.839+0000 7fa96e262180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:20:04.900 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:04.899+0000 7fa96e262180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:20:04.928 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:04.928+0000 7fbbbbed0180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:20:04.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.975+0000 7f29c6f37640 1 Processor -- start 2023-07-06T22:20:04.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.975+0000 7f29c6f37640 1 -- start start 2023-07-06T22:20:04.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.975+0000 7f29c6f37640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f29c00b3870 0x7f29c00b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.975+0000 7f29c6f37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29c00d03c0 0x7f29c00d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.975+0000 7f29c6f37640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c00b4210 con 0x7f29c015b850 2023-07-06T22:20:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.975+0000 7f29c6f37640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c00b2b80 con 0x7f29c00b3870 2023-07-06T22:20:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.975+0000 7f29c6f37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00cff30 con 0x7f29c00d03c0 2023-07-06T22:20:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.975+0000 7f29c54d4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29c00d03c0 0x7f29c00d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.975+0000 7f29bffff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f29c00b3870 0x7f29c00b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.975+0000 7f29c4cd3640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f29c015b850 0x7f29c00cc7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:57780/0 (socket says 172.21.15.55:57780) 2023-07-06T22:20:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.975+0000 7f29c4cd3640 1 -- 172.21.15.55:0/1157361120 learned_addr learned my addr 172.21.15.55:0/1157361120 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:04.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29c54d4640 1 -- 172.21.15.55:0/1157361120 >> v2:172.21.15.138:3300/0 conn(0x7f29c00b3870 msgr2=0x7f29c00b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:04.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29c54d4640 1 --2- 172.21.15.55:0/1157361120 >> v2:172.21.15.138:3300/0 conn(0x7f29c00b3870 0x7f29c00b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29c54d4640 1 -- 172.21.15.55:0/1157361120 >> v1:172.21.15.138:6789/0 conn(0x7f29c015b850 legacy=0x7f29c00cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29c54d4640 1 -- 172.21.15.55:0/1157361120 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c00b22e0 con 0x7f29c00d03c0 2023-07-06T22:20:04.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29bf7fe640 1 -- 172.21.15.55:0/1157361120 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838360148 0 0) 0x7f29c00b4210 con 0x7f29c015b850 2023-07-06T22:20:04.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29bffff640 1 --2- 172.21.15.55:0/1157361120 >> v2:172.21.15.138:3300/0 conn(0x7f29c00b3870 0x7f29c00b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29c54d4640 1 --2- 172.21.15.55:0/1157361120 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29c00d03c0 0x7f29c00d0800 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f29b8009d90 tx=0x7f29b801c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=759e549b051186b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29bf7fe640 1 -- 172.21.15.55:0/1157361120 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b80a58c0 con 0x7f29c00d03c0 2023-07-06T22:20:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29bf7fe640 1 -- 172.21.15.55:0/1157361120 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b80a5a20 con 0x7f29c00d03c0 2023-07-06T22:20:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29bf7fe640 1 -- 172.21.15.55:0/1157361120 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b80a5db0 con 0x7f29c00d03c0 2023-07-06T22:20:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29c6f37640 1 -- 172.21.15.55:0/1157361120 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29c00d03c0 msgr2=0x7f29c00d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29c6f37640 1 --2- 172.21.15.55:0/1157361120 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29c00d03c0 0x7f29c00d0800 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f29b8009d90 tx=0x7f29b801c800 comp rx=0 tx=0).stop 2023-07-06T22:20:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29c6f37640 1 -- 172.21.15.55:0/1157361120 shutdown_connections 2023-07-06T22:20:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29c6f37640 1 --2- 172.21.15.55:0/1157361120 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29c00d03c0 0x7f29c00d0800 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29c6f37640 1 --2- 172.21.15.55:0/1157361120 >> v2:172.21.15.138:3300/0 conn(0x7f29c00b3870 0x7f29c00b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29c6f37640 1 -- 172.21.15.55:0/1157361120 >> 172.21.15.55:0/1157361120 conn(0x7f29c00cec20 msgr2=0x7f29c00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.979+0000 7f29c6f37640 1 -- 172.21.15.55:0/1157361120 shutdown_connections 2023-07-06T22:20:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c6f37640 1 -- 172.21.15.55:0/1157361120 wait complete. 2023-07-06T22:20:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c6f37640 1 Processor -- start 2023-07-06T22:20:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c6f37640 1 -- start start 2023-07-06T22:20:04.986 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:04.984+0000 7fbbbbed0180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:20:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c6f37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29c00b3870 0x7f29c00c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c6f37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00d03c0 0x7f29c00caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c6f37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29c015b850 0x7f29c00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c6f37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00ca640 con 0x7f29c00d03c0 2023-07-06T22:20:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c6f37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00c97b0 con 0x7f29c015b850 2023-07-06T22:20:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c6f37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00c9a30 con 0x7f29c00b3870 2023-07-06T22:20:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c4cd3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29c00b3870 0x7f29c00c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00d03c0 0x7f29c00caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00d03c0 0x7f29c00caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35326/0 (socket says 172.21.15.55:35326) 2023-07-06T22:20:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29bffff640 1 -- 172.21.15.55:0/3569001796 learned_addr learned my addr 172.21.15.55:0/3569001796 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:04.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c54d4640 1 --2- 172.21.15.55:0/3569001796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29c015b850 0x7f29c00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:04.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c4cd3640 1 -- 172.21.15.55:0/3569001796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29c015b850 msgr2=0x7f29c00c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c4cd3640 1 --2- 172.21.15.55:0/3569001796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29c015b850 0x7f29c00c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c4cd3640 1 -- 172.21.15.55:0/3569001796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00d03c0 msgr2=0x7f29c00caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:04.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c4cd3640 1 --2- 172.21.15.55:0/3569001796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00d03c0 0x7f29c00caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:04.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.983+0000 7f29c4cd3640 1 -- 172.21.15.55:0/3569001796 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac009420 con 0x7f29c00b3870 2023-07-06T22:20:04.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.987+0000 7f29c4cd3640 1 --2- 172.21.15.55:0/3569001796 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29c00b3870 0x7f29c00c8600 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f29b400c430 tx=0x7f29b400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:04.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.987+0000 7f29bd7fa640 1 -- 172.21.15.55:0/3569001796 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40074e0 con 0x7f29c00b3870 2023-07-06T22:20:04.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.987+0000 7f29bd7fa640 1 -- 172.21.15.55:0/3569001796 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4007660 con 0x7f29c00b3870 2023-07-06T22:20:04.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.987+0000 7f29c6f37640 1 -- 172.21.15.55:0/3569001796 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b8009a70 con 0x7f29c00b3870 2023-07-06T22:20:04.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.987+0000 7f29bd7fa640 1 -- 172.21.15.55:0/3569001796 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4004a30 con 0x7f29c00b3870 2023-07-06T22:20:04.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.987+0000 7f29c6f37640 1 -- 172.21.15.55:0/3569001796 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c00c9ff0 con 0x7f29c00b3870 2023-07-06T22:20:04.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.987+0000 7f29c6f37640 1 -- 172.21.15.55:0/3569001796 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c0066d60 con 0x7f29c00b3870 2023-07-06T22:20:04.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.987+0000 7f29bd7fa640 1 -- 172.21.15.55:0/3569001796 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 102) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f29b4004b90 con 0x7f29c00b3870 2023-07-06T22:20:04.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.987+0000 7f29bd7fa640 1 --2- 172.21.15.55:0/3569001796 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f29a40664f0 0x7f29a40689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:04.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.987+0000 7f29bd7fa640 1 -- 172.21.15.55:0/3569001796 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f29b4084110 con 0x7f29c00b3870 2023-07-06T22:20:04.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.987+0000 7f29bffff640 1 -- 172.21.15.55:0/3569001796 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f29a40664f0 msgr2=0x7f29a40689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/628169602 2023-07-06T22:20:04.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.987+0000 7f29bffff640 1 --2- 172.21.15.55:0/3569001796 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f29a40664f0 0x7f29a40689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:04.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:04.991+0000 7f29bd7fa640 1 -- 172.21.15.55:0/3569001796 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29b40510e0 con 0x7f29c00b3870 2023-07-06T22:20:05.054 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:05.051+0000 7fa96e262180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:20:05.115 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:05.111+0000 7fa96e262180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:20:05.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.151+0000 7f29c6f37640 1 -- 172.21.15.55:0/3569001796 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29c00b3420 con 0x7f29c00b3870 2023-07-06T22:20:05.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.151+0000 7f29bd7fa640 1 -- 172.21.15.55:0/3569001796 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v180) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29b4054700 con 0x7f29c00b3870 2023-07-06T22:20:05.153 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T22:20:05.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.151+0000 7f29c6f37640 1 -- 172.21.15.55:0/3569001796 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f29a40664f0 msgr2=0x7f29a40689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:05.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.151+0000 7f29c6f37640 1 --2- 172.21.15.55:0/3569001796 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f29a40664f0 0x7f29a40689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.151+0000 7f29c6f37640 1 -- 172.21.15.55:0/3569001796 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29c00b3870 msgr2=0x7f29c00c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:05.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.151+0000 7f29c6f37640 1 --2- 172.21.15.55:0/3569001796 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29c00b3870 0x7f29c00c8600 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f29b400c430 tx=0x7f29b400c8f0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.151+0000 7f29c6f37640 1 -- 172.21.15.55:0/3569001796 shutdown_connections 2023-07-06T22:20:05.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.151+0000 7f29c6f37640 1 --2- 172.21.15.55:0/3569001796 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f29a40664f0 0x7f29a40689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.151+0000 7f29c6f37640 1 --2- 172.21.15.55:0/3569001796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29c015b850 0x7f29c00c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.151+0000 7f29c6f37640 1 --2- 172.21.15.55:0/3569001796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00d03c0 0x7f29c00caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.151+0000 7f29c6f37640 1 --2- 172.21.15.55:0/3569001796 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29c00b3870 0x7f29c00c8600 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.151+0000 7f29c6f37640 1 -- 172.21.15.55:0/3569001796 >> 172.21.15.55:0/3569001796 conn(0x7f29c00cec20 msgr2=0x7f29c015a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:05.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.151+0000 7f29c6f37640 1 -- 172.21.15.55:0/3569001796 shutdown_connections 2023-07-06T22:20:05.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.151+0000 7f29c6f37640 1 -- 172.21.15.55:0/3569001796 wait complete. 2023-07-06T22:20:05.178 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T22:20:05.230 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:20:05.230 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:20:05.230 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:20:05.238 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:05.236+0000 7fbbbbed0180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:20:05.372 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:20:05.372 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:20:05.372 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:20:05.374 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:05.372+0000 7fbbbbed0180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:20:05.381 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:05.379+0000 7fa96e262180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:20:05.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.395+0000 7efec8a93640 1 Processor -- start 2023-07-06T22:20:05.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.395+0000 7efec8a93640 1 -- start start 2023-07-06T22:20:05.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec8a93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efec40b3870 0x7efec40b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:05.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec8a93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efec40d03c0 0x7efec40d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:05.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec8a93640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec40b4210 con 0x7efec415b850 2023-07-06T22:20:05.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec8a93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec40b2b80 con 0x7efec40b3870 2023-07-06T22:20:05.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec8a93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec40cff30 con 0x7efec40d03c0 2023-07-06T22:20:05.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec1d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efec40b3870 0x7efec40b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:05.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec1d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efec40b3870 0x7efec40b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35330/0 (socket says 172.21.15.55:35330) 2023-07-06T22:20:05.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec1d9b640 1 -- 172.21.15.55:0/2833639944 learned_addr learned my addr 172.21.15.55:0/2833639944 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:05.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec2d9d640 1 --2- 172.21.15.55:0/2833639944 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efec40d03c0 0x7efec40d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:05.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec1d9b640 1 -- 172.21.15.55:0/2833639944 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efec40d03c0 msgr2=0x7efec40d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:05.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec1d9b640 1 --2- 172.21.15.55:0/2833639944 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efec40d03c0 0x7efec40d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec1d9b640 1 -- 172.21.15.55:0/2833639944 >> v1:172.21.15.138:6789/0 conn(0x7efec415b850 legacy=0x7efec40cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:05.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec1d9b640 1 -- 172.21.15.55:0/2833639944 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec40b22e0 con 0x7efec40b3870 2023-07-06T22:20:05.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec1d9b640 1 --2- 172.21.15.55:0/2833639944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec40b3870 0x7efec40b3cd0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009870 tx=0x7efeb801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300804ca7cc5b69a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:05.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec159a640 1 -- 172.21.15.55:0/2833639944 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb80ab5f0 con 0x7efec40b3870 2023-07-06T22:20:05.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.399+0000 7efec159a640 1 -- 172.21.15.55:0/2833639944 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb80ab750 con 0x7efec40b3870 2023-07-06T22:20:05.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.403+0000 7efec159a640 1 -- 172.21.15.55:0/2833639944 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb80abae0 con 0x7efec40b3870 2023-07-06T22:20:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.403+0000 7efec8a93640 1 -- 172.21.15.55:0/2833639944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec40b3870 msgr2=0x7efec40b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.403+0000 7efec8a93640 1 --2- 172.21.15.55:0/2833639944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec40b3870 0x7efec40b3cd0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009870 tx=0x7efeb801c3f0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.403+0000 7efec8a93640 1 -- 172.21.15.55:0/2833639944 shutdown_connections 2023-07-06T22:20:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.403+0000 7efec8a93640 1 --2- 172.21.15.55:0/2833639944 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efec40d03c0 0x7efec40d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.403+0000 7efec8a93640 1 --2- 172.21.15.55:0/2833639944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec40b3870 0x7efec40b3cd0 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.403+0000 7efec8a93640 1 -- 172.21.15.55:0/2833639944 >> 172.21.15.55:0/2833639944 conn(0x7efec40cec20 msgr2=0x7efec40cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:05.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.403+0000 7efec8a93640 1 -- 172.21.15.55:0/2833639944 shutdown_connections 2023-07-06T22:20:05.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.403+0000 7efec8a93640 1 -- 172.21.15.55:0/2833639944 wait complete. 2023-07-06T22:20:05.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.403+0000 7efec8a93640 1 Processor -- start 2023-07-06T22:20:05.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.403+0000 7efec8a93640 1 -- start start 2023-07-06T22:20:05.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.403+0000 7efec8a93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efec40b3870 0x7efec40c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:05.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.403+0000 7efec8a93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec40d03c0 0x7efec4150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:05.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec8a93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efec415b850 0x7efec41514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:05.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec8a93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec40c7ea0 con 0x7efec40d03c0 2023-07-06T22:20:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec8a93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec40c7220 con 0x7efec40b3870 2023-07-06T22:20:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec8a93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec40c7500 con 0x7efec415b850 2023-07-06T22:20:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec1d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec40d03c0 0x7efec4150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec1d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec40d03c0 0x7efec4150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35332/0 (socket says 172.21.15.55:35332) 2023-07-06T22:20:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec1d9b640 1 -- 172.21.15.55:0/3300158562 learned_addr learned my addr 172.21.15.55:0/3300158562 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec2d9d640 1 --2- 172.21.15.55:0/3300158562 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efec415b850 0x7efec41514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:05.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec259c640 1 --2- 172.21.15.55:0/3300158562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efec40b3870 0x7efec40c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:05.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec1d9b640 1 -- 172.21.15.55:0/3300158562 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efec415b850 msgr2=0x7efec41514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:05.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec1d9b640 1 --2- 172.21.15.55:0/3300158562 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efec415b850 0x7efec41514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec1d9b640 1 -- 172.21.15.55:0/3300158562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efec40b3870 msgr2=0x7efec40c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec1d9b640 1 --2- 172.21.15.55:0/3300158562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efec40b3870 0x7efec40c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec1d9b640 1 -- 172.21.15.55:0/3300158562 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb80094d0 con 0x7efec40d03c0 2023-07-06T22:20:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec1d9b640 1 --2- 172.21.15.55:0/3300158562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec40d03c0 0x7efec4150f70 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7efeb80ad040 tx=0x7efeb801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efeb2ffd640 1 -- 172.21.15.55:0/3300158562 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb80be5f0 con 0x7efec40d03c0 2023-07-06T22:20:05.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efeb2ffd640 1 -- 172.21.15.55:0/3300158562 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb80be770 con 0x7efec40d03c0 2023-07-06T22:20:05.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efeb2ffd640 1 -- 172.21.15.55:0/3300158562 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb80beb20 con 0x7efec40d03c0 2023-07-06T22:20:05.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec8a93640 1 -- 172.21.15.55:0/3300158562 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec40c77e0 con 0x7efec40d03c0 2023-07-06T22:20:05.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec8a93640 1 -- 172.21.15.55:0/3300158562 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec40c6d80 con 0x7efec40d03c0 2023-07-06T22:20:05.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efec8a93640 1 -- 172.21.15.55:0/3300158562 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec40c7fe0 con 0x7efec40d03c0 2023-07-06T22:20:05.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.407+0000 7efeb2ffd640 1 -- 172.21.15.55:0/3300158562 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 102) v1 ==== 85874+0+0 (secure 0 0 0) 0x7efeb80b43f0 con 0x7efec40d03c0 2023-07-06T22:20:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.411+0000 7efeb2ffd640 1 --2- 172.21.15.55:0/3300158562 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7efea40664c0 0x7efea4068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.411+0000 7efeb2ffd640 1 -- 172.21.15.55:0/3300158562 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6754+0+0 (secure 0 0 0) 0x7efeb80a8050 con 0x7efec40d03c0 2023-07-06T22:20:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.411+0000 7efec259c640 1 -- 172.21.15.55:0/3300158562 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7efea40664c0 msgr2=0x7efea4068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/628169602 2023-07-06T22:20:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.411+0000 7efec259c640 1 --2- 172.21.15.55:0/3300158562 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7efea40664c0 0x7efea4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:05.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.415+0000 7efeb2ffd640 1 -- 172.21.15.55:0/3300158562 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efec40c7fe0 con 0x7efec40d03c0 2023-07-06T22:20:05.500 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:05.500+0000 7fbbbbed0180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:20:05.525 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:05.523+0000 7fa96e262180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:20:05.571 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:05.568+0000 7fbbbbed0180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:20:05.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.583+0000 7efec8a93640 1 -- 172.21.15.55:0/3300158562 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efec40c7fe0 con 0x7efec40d03c0 2023-07-06T22:20:05.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.583+0000 7efeb2ffd640 1 -- 172.21.15.55:0/3300158562 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v180) v1 ==== 80+0+464 (secure 0 0 0) 0x7efec40c7fe0 con 0x7efec40d03c0 2023-07-06T22:20:05.585 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/455359735 2023-07-07T22:18:57.087673+0000 2023-07-06T22:20:05.585 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/957337795 2023-07-07T22:18:57.087673+0000 2023-07-06T22:20:05.585 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2168505984 2023-07-07T22:18:57.087673+0000 2023-07-06T22:20:05.585 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3159272832 2023-07-07T22:18:57.087673+0000 2023-07-06T22:20:05.585 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/957337795 2023-07-07T22:18:57.087673+0000 2023-07-06T22:20:05.585 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/748095594 2023-07-07T22:18:57.087673+0000 2023-07-06T22:20:05.585 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/4040799024 2023-07-07T22:18:57.087673+0000 2023-07-06T22:20:05.586 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/56444713 2023-07-07T22:18:57.087673+0000 2023-07-06T22:20:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-07-06T22:20:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.583+0000 7efec8a93640 1 -- 172.21.15.55:0/3300158562 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7efea40664c0 msgr2=0x7efea4068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.583+0000 7efec8a93640 1 --2- 172.21.15.55:0/3300158562 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7efea40664c0 0x7efea4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.583+0000 7efec8a93640 1 -- 172.21.15.55:0/3300158562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec40d03c0 msgr2=0x7efec4150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.583+0000 7efec8a93640 1 --2- 172.21.15.55:0/3300158562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec40d03c0 0x7efec4150f70 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7efeb80ad040 tx=0x7efeb801ac30 comp rx=0 tx=0).stop 2023-07-06T22:20:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.583+0000 7efec8a93640 1 -- 172.21.15.55:0/3300158562 shutdown_connections 2023-07-06T22:20:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.583+0000 7efec8a93640 1 --2- 172.21.15.55:0/3300158562 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7efea40664c0 0x7efea4068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.583+0000 7efec8a93640 1 --2- 172.21.15.55:0/3300158562 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efec415b850 0x7efec41514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.583+0000 7efec8a93640 1 --2- 172.21.15.55:0/3300158562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec40d03c0 0x7efec4150f70 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.583+0000 7efec8a93640 1 --2- 172.21.15.55:0/3300158562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efec40b3870 0x7efec40c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.583+0000 7efec8a93640 1 -- 172.21.15.55:0/3300158562 >> 172.21.15.55:0/3300158562 conn(0x7efec40cec20 msgr2=0x7efec4157eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:05.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.583+0000 7efec8a93640 1 -- 172.21.15.55:0/3300158562 shutdown_connections 2023-07-06T22:20:05.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.583+0000 7efec8a93640 1 -- 172.21.15.55:0/3300158562 wait complete. 2023-07-06T22:20:05.606 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T22:20:05.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:05.607 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-06T22:20:05.659 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:05.655+0000 7fa96e262180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:20:05.663 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T22:20:05.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:05.664 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T22:20:05.674 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:20:05.674 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:05.683 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:20:05.683 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:20:05.683 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:05.706 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:05.704+0000 7fbbbbed0180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:20:05.723 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:20:05.724 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:20:05.724 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:05.733 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:20:05.733 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:20:05.734 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:05.731+0000 7fa96e262180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:20:05.877 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fa96e262180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:20:05.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfbcc5c640 1 Processor -- start 2023-07-06T22:20:05.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfbcc5c640 1 -- start start 2023-07-06T22:20:05.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfbcc5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfb815f4e0 0x7fdfb80b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:05.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfbcc5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb80b4250 0x7fdfb815c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:05.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfbcc5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb806a160 con 0x7fdfb815b9d0 2023-07-06T22:20:05.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfbcc5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb815bda0 con 0x7fdfb815f4e0 2023-07-06T22:20:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfbcc5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb80b46b0 con 0x7fdfb80b4250 2023-07-06T22:20:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfb659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdfb815b9d0 0x7fdfb80ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54876/0 (socket says 172.21.15.55:54876) 2023-07-06T22:20:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfb659c640 1 -- 172.21.15.55:0/1062456417 learned_addr learned my addr 172.21.15.55:0/1062456417 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfaffff640 1 --2- 172.21.15.55:0/1062456417 >> v2:172.21.15.55:3300/0 conn(0x7fdfb815f4e0 0x7fdfb80b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfb6d9d640 1 --2- 172.21.15.55:0/1062456417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb80b4250 0x7fdfb815c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfaffff640 1 -- 172.21.15.55:0/1062456417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb80b4250 msgr2=0x7fdfb815c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfaffff640 1 --2- 172.21.15.55:0/1062456417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb80b4250 0x7fdfb815c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfaffff640 1 -- 172.21.15.55:0/1062456417 >> v1:172.21.15.55:6789/0 conn(0x7fdfb815b9d0 legacy=0x7fdfb80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.879+0000 7fdfaffff640 1 -- 172.21.15.55:0/1062456417 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb8069590 con 0x7fdfb815f4e0 2023-07-06T22:20:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.875+0000 7fdfb5d9b640 1 -- 172.21.15.55:0/1062456417 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426899793 0 0) 0x7fdfb806a160 con 0x7fdfb815b9d0 2023-07-06T22:20:05.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.883+0000 7fdfaffff640 1 --2- 172.21.15.55:0/1062456417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb815f4e0 0x7fdfb80b3d10 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00097c0 tx=0x7fdfa001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a222b9c6231cb8bc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:05.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.883+0000 7fdfb5d9b640 1 -- 172.21.15.55:0/1062456417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00ab480 con 0x7fdfb815f4e0 2023-07-06T22:20:05.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.883+0000 7fdfb5d9b640 1 -- 172.21.15.55:0/1062456417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa00ab5e0 con 0x7fdfb815f4e0 2023-07-06T22:20:05.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.883+0000 7fdfb5d9b640 1 -- 172.21.15.55:0/1062456417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00ab970 con 0x7fdfb815f4e0 2023-07-06T22:20:05.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.883+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1062456417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb815f4e0 msgr2=0x7fdfb80b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:05.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.883+0000 7fdfbcc5c640 1 --2- 172.21.15.55:0/1062456417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb815f4e0 0x7fdfb80b3d10 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00097c0 tx=0x7fdfa001c480 comp rx=0 tx=0).stop 2023-07-06T22:20:05.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.883+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1062456417 shutdown_connections 2023-07-06T22:20:05.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.883+0000 7fdfbcc5c640 1 --2- 172.21.15.55:0/1062456417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb80b4250 0x7fdfb815c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.883+0000 7fdfbcc5c640 1 --2- 172.21.15.55:0/1062456417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb815f4e0 0x7fdfb80b3d10 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.883+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1062456417 >> 172.21.15.55:0/1062456417 conn(0x7fdfb80ced10 msgr2=0x7fdfb80cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:05.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.883+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1062456417 shutdown_connections 2023-07-06T22:20:05.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.883+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1062456417 wait complete. 2023-07-06T22:20:05.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfbcc5c640 1 Processor -- start 2023-07-06T22:20:05.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfbcc5c640 1 -- start start 2023-07-06T22:20:05.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfbcc5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b4250 0x7fdfb81536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:05.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfbcc5c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb815b9d0 0x7fdfb81556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:05.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfbcc5c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfb815f4e0 0x7fdfb8155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:05.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfbcc5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb8166680 con 0x7fdfb80b4250 2023-07-06T22:20:05.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfbcc5c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb8154090 con 0x7fdfb815f4e0 2023-07-06T22:20:05.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfbcc5c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb8154370 con 0x7fdfb815b9d0 2023-07-06T22:20:05.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfb659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b4250 0x7fdfb81536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:05.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfaffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb815b9d0 0x7fdfb81556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:05.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfaffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb815b9d0 0x7fdfb81556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44190/0 (socket says 172.21.15.55:44190) 2023-07-06T22:20:05.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfb659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b4250 0x7fdfb81536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35352/0 (socket says 172.21.15.55:35352) 2023-07-06T22:20:05.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfaffff640 1 -- 172.21.15.55:0/1518251770 learned_addr learned my addr 172.21.15.55:0/1518251770 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:05.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfb6d9d640 1 --2- 172.21.15.55:0/1518251770 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfb815f4e0 0x7fdfb8155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:05.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfaffff640 1 -- 172.21.15.55:0/1518251770 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfb815f4e0 msgr2=0x7fdfb8155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:05.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfaffff640 1 --2- 172.21.15.55:0/1518251770 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfb815f4e0 0x7fdfb8155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfaffff640 1 -- 172.21.15.55:0/1518251770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b4250 msgr2=0x7fdfb81536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:05.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfaffff640 1 --2- 172.21.15.55:0/1518251770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b4250 0x7fdfb81536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:05.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfaffff640 1 -- 172.21.15.55:0/1518251770 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa0009420 con 0x7fdfb815b9d0 2023-07-06T22:20:05.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfb659c640 1 --2- 172.21.15.55:0/1518251770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b4250 0x7fdfb81536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:05.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfaffff640 1 --2- 172.21.15.55:0/1518251770 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb815b9d0 0x7fdfb81556f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00ad040 tx=0x7fdfa001acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:05.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfaeffd640 1 -- 172.21.15.55:0/1518251770 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00b5810 con 0x7fdfb815b9d0 2023-07-06T22:20:05.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfaeffd640 1 -- 172.21.15.55:0/1518251770 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa00b5990 con 0x7fdfb815b9d0 2023-07-06T22:20:05.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfaeffd640 1 -- 172.21.15.55:0/1518251770 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00b5d40 con 0x7fdfb815b9d0 2023-07-06T22:20:05.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1518251770 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb8154650 con 0x7fdfb815b9d0 2023-07-06T22:20:05.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.887+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1518251770 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb8156290 con 0x7fdfb815b9d0 2023-07-06T22:20:05.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.891+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1518251770 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb8066d60 con 0x7fdfb815b9d0 2023-07-06T22:20:05.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.891+0000 7fdfaeffd640 1 -- 172.21.15.55:0/1518251770 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 102) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fdfa00bf410 con 0x7fdfb815b9d0 2023-07-06T22:20:05.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.891+0000 7fdfaeffd640 1 --2- 172.21.15.55:0/1518251770 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fdf980664c0 0x7fdf98068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:05.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.891+0000 7fdfaeffd640 1 -- 172.21.15.55:0/1518251770 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fdfa011f560 con 0x7fdfb815b9d0 2023-07-06T22:20:05.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.891+0000 7fdfb659c640 1 -- 172.21.15.55:0/1518251770 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fdf980664c0 msgr2=0x7fdf98068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/628169602 2023-07-06T22:20:05.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.891+0000 7fdfb659c640 1 --2- 172.21.15.55:0/1518251770 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fdf980664c0 0x7fdf98068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:05.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:05.895+0000 7fdfaeffd640 1 -- 172.21.15.55:0/1518251770 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfa00ec5f0 con 0x7fdfb815b9d0 2023-07-06T22:20:06.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.083+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1518251770 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfb81544b0 con 0x7fdfb815b9d0 2023-07-06T22:20:06.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.083+0000 7fdfaeffd640 1 -- 172.21.15.55:0/1518251770 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fdfb81544b0 con 0x7fdfb815b9d0 2023-07-06T22:20:06.085 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:06.086 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8420,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/10830186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":10830186},{"type":"v1","addr":"172.21.15.138:6834","nonce":10830186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9577,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3623480690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3623480690},{"type":"v1","addr":"172.21.15.138:6835","nonce":3623480690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":10428,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2297427597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2297427597},{"type":"v1","addr":"172.21.15.55:6835","nonce":2297427597}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:18:40.592191+0000","modified":"2023-07-06T22:18:43.616817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10431":{"gid":10431,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3052024414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3052024414},{"type":"v1","addr":"172.21.15.55:6837","nonce":3052024414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-06T22:20:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 79 2023-07-06T22:20:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.083+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1518251770 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fdf980664c0 msgr2=0x7fdf98068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.083+0000 7fdfbcc5c640 1 --2- 172.21.15.55:0/1518251770 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fdf980664c0 0x7fdf98068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.083+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1518251770 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb815b9d0 msgr2=0x7fdfb81556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.083+0000 7fdfbcc5c640 1 --2- 172.21.15.55:0/1518251770 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb815b9d0 0x7fdfb81556f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00ad040 tx=0x7fdfa001acc0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.083+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1518251770 shutdown_connections 2023-07-06T22:20:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.083+0000 7fdfbcc5c640 1 --2- 172.21.15.55:0/1518251770 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fdf980664c0 0x7fdf98068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.083+0000 7fdfbcc5c640 1 --2- 172.21.15.55:0/1518251770 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfb815f4e0 0x7fdfb8155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.083+0000 7fdfbcc5c640 1 --2- 172.21.15.55:0/1518251770 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfb815b9d0 0x7fdfb81556f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.083+0000 7fdfbcc5c640 1 --2- 172.21.15.55:0/1518251770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b4250 0x7fdfb81536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.083+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1518251770 >> 172.21.15.55:0/1518251770 conn(0x7fdfb80ced10 msgr2=0x7fdfb80b77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:06.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.083+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1518251770 shutdown_connections 2023-07-06T22:20:06.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.083+0000 7fdfbcc5c640 1 -- 172.21.15.55:0/1518251770 wait complete. 2023-07-06T22:20:06.107 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:20:06.259 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:06.260+0000 7fbbbbed0180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:20:06.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.263+0000 7fe8a8f11640 1 Processor -- start 2023-07-06T22:20:06.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.263+0000 7fe8a8f11640 1 -- start start 2023-07-06T22:20:06.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe8a8f11640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe8a40ce610 0x7fe8a40b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:06.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe8a8f11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe8a40b1e10 0x7fe8a415f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:06.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe8a8f11640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a40cd1c0 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe8a8f11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a40d2310 con 0x7fe8a40b1e10 2023-07-06T22:20:06.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe8a8f11640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a40b80a0 con 0x7fe8a40ce610 2023-07-06T22:20:06.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe8a2d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe8a40b1e10 0x7fe8a415f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:06.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe8a259c640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fe8a40b7cd0 0x7fe8a40ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:57796/0 (socket says 172.21.15.55:57796) 2023-07-06T22:20:06.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe8a259c640 1 -- 172.21.15.55:0/3918107879 learned_addr learned my addr 172.21.15.55:0/3918107879 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:06.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe89bfff640 1 --2- 172.21.15.55:0/3918107879 >> v2:172.21.15.138:3300/0 conn(0x7fe8a40ce610 0x7fe8a40b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:06.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe8a1d9b640 1 -- 172.21.15.55:0/3918107879 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519075072 0 0) 0x7fe8a40cd1c0 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe8a1d9b640 1 -- 172.21.15.55:0/3918107879 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe890003530 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe8a2d9d640 1 -- 172.21.15.55:0/3918107879 >> v2:172.21.15.138:3300/0 conn(0x7fe8a40ce610 msgr2=0x7fe8a40b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:06.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe8a2d9d640 1 --2- 172.21.15.55:0/3918107879 >> v2:172.21.15.138:3300/0 conn(0x7fe8a40ce610 0x7fe8a40b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe8a2d9d640 1 -- 172.21.15.55:0/3918107879 >> v1:172.21.15.138:6789/0 conn(0x7fe8a40b7cd0 legacy=0x7fe8a40ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:06.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.267+0000 7fe8a2d9d640 1 -- 172.21.15.55:0/3918107879 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40b2270 con 0x7fe8a40b1e10 2023-07-06T22:20:06.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.271+0000 7fe8a2d9d640 1 --2- 172.21.15.55:0/3918107879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40b1e10 0x7fe8a415f870 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4065af0 tx=0x7fe89c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab660dd5c496fd37 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:06.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.271+0000 7fe8a1d9b640 1 -- 172.21.15.55:0/3918107879 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0a5740 con 0x7fe8a40b1e10 2023-07-06T22:20:06.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.271+0000 7fe8a1d9b640 1 -- 172.21.15.55:0/3918107879 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c0a58a0 con 0x7fe8a40b1e10 2023-07-06T22:20:06.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.271+0000 7fe8a1d9b640 1 -- 172.21.15.55:0/3918107879 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0a5c30 con 0x7fe8a40b1e10 2023-07-06T22:20:06.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.271+0000 7fe8a8f11640 1 -- 172.21.15.55:0/3918107879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40b1e10 msgr2=0x7fe8a415f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:06.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.271+0000 7fe8a8f11640 1 --2- 172.21.15.55:0/3918107879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40b1e10 0x7fe8a415f870 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4065af0 tx=0x7fe89c01c880 comp rx=0 tx=0).stop 2023-07-06T22:20:06.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.271+0000 7fe8a8f11640 1 -- 172.21.15.55:0/3918107879 shutdown_connections 2023-07-06T22:20:06.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.271+0000 7fe8a8f11640 1 --2- 172.21.15.55:0/3918107879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40b1e10 0x7fe8a415f870 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.271+0000 7fe8a8f11640 1 --2- 172.21.15.55:0/3918107879 >> v2:172.21.15.138:3300/0 conn(0x7fe8a40ce610 0x7fe8a40b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.271+0000 7fe8a8f11640 1 -- 172.21.15.55:0/3918107879 >> 172.21.15.55:0/3918107879 conn(0x7fe8a40ceee0 msgr2=0x7fe8a40cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:06.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.271+0000 7fe8a8f11640 1 -- 172.21.15.55:0/3918107879 shutdown_connections 2023-07-06T22:20:06.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.271+0000 7fe8a8f11640 1 -- 172.21.15.55:0/3918107879 wait complete. 2023-07-06T22:20:06.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe8a8f11640 1 Processor -- start 2023-07-06T22:20:06.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe8a8f11640 1 -- start start 2023-07-06T22:20:06.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe8a8f11640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8a40b1e10 0x7fe8a40b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:06.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe8a8f11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40b7cd0 0x7fe8a41576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:06.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe8a8f11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8a40ce610 0x7fe8a4157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:06.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe8a8f11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40c5ba0 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe8a8f11640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40b5290 con 0x7fe8a40b1e10 2023-07-06T22:20:06.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe8a8f11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a415ead0 con 0x7fe8a40ce610 2023-07-06T22:20:06.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe89bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40b7cd0 0x7fe8a41576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:06.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe89bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40b7cd0 0x7fe8a41576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35368/0 (socket says 172.21.15.55:35368) 2023-07-06T22:20:06.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe89bfff640 1 -- 172.21.15.55:0/514170722 learned_addr learned my addr 172.21.15.55:0/514170722 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:06.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe8a259c640 1 --2- 172.21.15.55:0/514170722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8a40b1e10 0x7fe8a40b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:06.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe8a2d9d640 1 --2- 172.21.15.55:0/514170722 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8a40ce610 0x7fe8a4157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:06.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe89bfff640 1 -- 172.21.15.55:0/514170722 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8a40ce610 msgr2=0x7fe8a4157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:06.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe89bfff640 1 --2- 172.21.15.55:0/514170722 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8a40ce610 0x7fe8a4157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe89bfff640 1 -- 172.21.15.55:0/514170722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8a40b1e10 msgr2=0x7fe8a40b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe89bfff640 1 --2- 172.21.15.55:0/514170722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8a40b1e10 0x7fe8a40b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe89bfff640 1 -- 172.21.15.55:0/514170722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c009a70 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe89bfff640 1 --2- 172.21.15.55:0/514170722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40b7cd0 0x7fe8a41576e0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00e870 tx=0x7fe88c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:06.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe89affd640 1 -- 172.21.15.55:0/514170722 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c009510 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe89affd640 1 -- 172.21.15.55:0/514170722 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c00eec0 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe8a8f11640 1 -- 172.21.15.55:0/514170722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a415edb0 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe89affd640 1 -- 172.21.15.55:0/514170722 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00cb40 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.275+0000 7fe8a8f11640 1 -- 172.21.15.55:0/514170722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a40b54e0 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.279+0000 7fe8a8f11640 1 -- 172.21.15.55:0/514170722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a4066d60 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.279+0000 7fe89affd640 1 -- 172.21.15.55:0/514170722 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 102) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fe88c00cca0 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.279+0000 7fe89affd640 1 --2- 172.21.15.55:0/514170722 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fe8840664c0 0x7fe884068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:06.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.279+0000 7fe89affd640 1 -- 172.21.15.55:0/514170722 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6842+0+0 (secure 0 0 0) 0x7fe88c0844f0 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.279+0000 7fe8a259c640 1 -- 172.21.15.55:0/514170722 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fe8840664c0 msgr2=0x7fe884068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/628169602 2023-07-06T22:20:06.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.279+0000 7fe8a259c640 1 --2- 172.21.15.55:0/514170722 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fe8840664c0 0x7fe884068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:06.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.283+0000 7fe89affd640 1 -- 172.21.15.55:0/514170722 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe88c0513a0 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.345 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:06.344+0000 7fbbbbed0180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:20:06.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.443+0000 7fe8a8f11640 1 -- 172.21.15.55:0/514170722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8a40b1350 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.443+0000 7fe89affd640 1 -- 172.21.15.55:0/514170722 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+19243 (secure 0 0 0) 0x7fe88c0549c0 con 0x7fe8a40b7cd0 2023-07-06T22:20:06.447 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:06.447 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":181,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:20:06.165439+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:18:38.520955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-07-06T22:18:39.591879+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":181,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/455359735":"2023-07-07T22:18:57.087673+0000","172.21.15.55:6833/957337795":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/2168505984":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/3159272832":"2023-07-07T22:18:57.087673+0000","172.21.15.55:6832/957337795":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/748095594":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/4040799024":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/56444713":"2023-07-07T22:18:57.087673+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]},{"pool":23,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[{"pool":23,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:20:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.447+0000 7fe8a8f11640 1 -- 172.21.15.55:0/514170722 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fe8840664c0 msgr2=0x7fe884068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.447+0000 7fe8a8f11640 1 --2- 172.21.15.55:0/514170722 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fe8840664c0 0x7fe884068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.447+0000 7fe8a8f11640 1 -- 172.21.15.55:0/514170722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40b7cd0 msgr2=0x7fe8a41576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.447+0000 7fe8a8f11640 1 --2- 172.21.15.55:0/514170722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40b7cd0 0x7fe8a41576e0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00e870 tx=0x7fe88c00ec70 comp rx=0 tx=0).stop 2023-07-06T22:20:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.447+0000 7fe8a8f11640 1 -- 172.21.15.55:0/514170722 shutdown_connections 2023-07-06T22:20:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.447+0000 7fe8a8f11640 1 --2- 172.21.15.55:0/514170722 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7fe8840664c0 0x7fe884068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.447+0000 7fe8a8f11640 1 --2- 172.21.15.55:0/514170722 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8a40ce610 0x7fe8a4157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.447+0000 7fe8a8f11640 1 --2- 172.21.15.55:0/514170722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40b7cd0 0x7fe8a41576e0 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.447+0000 7fe8a8f11640 1 --2- 172.21.15.55:0/514170722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8a40b1e10 0x7fe8a40b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.447+0000 7fe8a8f11640 1 -- 172.21.15.55:0/514170722 >> 172.21.15.55:0/514170722 conn(0x7fe8a40ceee0 msgr2=0x7fe8a40cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.447+0000 7fe8a8f11640 1 -- 172.21.15.55:0/514170722 shutdown_connections 2023-07-06T22:20:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.447+0000 7fe8a8f11640 1 -- 172.21.15.55:0/514170722 wait complete. 2023-07-06T22:20:06.469 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T22:18:38.520955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '178', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T22:18:39.591879+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '181', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 4, 'snap_epoch': 181, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:20:06.469 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:20:06.476 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:06.475+0000 7fa96e262180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:20:06.492 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:06.492+0000 7fbbbbed0180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:20:06.566 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:06.563+0000 7fa96e262180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:20:06.574 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:06.572+0000 7fbbbbed0180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:20:06.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feba0fa3640 1 Processor -- start 2023-07-06T22:20:06.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feba0fa3640 1 -- start start 2023-07-06T22:20:06.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feba0fa3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb9c0b3870 0x7feb9c0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:06.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feba0fa3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c0b2b80 con 0x7feb9c0d03c0 2023-07-06T22:20:06.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feba0fa3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c0cff30 con 0x7feb9c15b850 2023-07-06T22:20:06.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feba0fa3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0b41e0 con 0x7feb9c0b3870 2023-07-06T22:20:06.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feb9ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feb9c0d03c0 0x7feb9c0d0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54892/0 (socket says 172.21.15.55:54892) 2023-07-06T22:20:06.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feb9ad9d640 1 -- 172.21.15.55:0/1546343847 learned_addr learned my addr 172.21.15.55:0/1546343847 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:06.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feb93fff640 1 --2- 172.21.15.55:0/1546343847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb9c0b3870 0x7feb9c0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:06.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feb99d9b640 1 -- 172.21.15.55:0/1546343847 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351956620 0 0) 0x7feb9c0b2b80 con 0x7feb9c0d03c0 2023-07-06T22:20:06.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feb99d9b640 1 -- 172.21.15.55:0/1546343847 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb88003530 con 0x7feb9c0d03c0 2023-07-06T22:20:06.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feb99d9b640 1 -- 172.21.15.55:0/1546343847 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334979930 0 0) 0x7feb9c0cff30 con 0x7feb9c15b850 2023-07-06T22:20:06.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feb93fff640 1 -- 172.21.15.55:0/1546343847 >> v1:172.21.15.138:6789/0 conn(0x7feb9c15b850 legacy=0x7feb9c0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:06.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feb93fff640 1 -- 172.21.15.55:0/1546343847 >> v1:172.21.15.55:6789/0 conn(0x7feb9c0d03c0 legacy=0x7feb9c0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:06.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.615+0000 7feb93fff640 1 -- 172.21.15.55:0/1546343847 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0b22e0 con 0x7feb9c0b3870 2023-07-06T22:20:06.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.619+0000 7feb93fff640 1 --2- 172.21.15.55:0/1546343847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb9c0b3870 0x7feb9c0b3ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feb840097f0 tx=0x7feb8401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc203a3c1f20786 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:06.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.619+0000 7feb99d9b640 1 -- 172.21.15.55:0/1546343847 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840ab600 con 0x7feb9c0b3870 2023-07-06T22:20:06.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.619+0000 7feb99d9b640 1 -- 172.21.15.55:0/1546343847 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb840a7050 con 0x7feb9c0b3870 2023-07-06T22:20:06.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.619+0000 7feb99d9b640 1 -- 172.21.15.55:0/1546343847 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840ab980 con 0x7feb9c0b3870 2023-07-06T22:20:06.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.619+0000 7feba0fa3640 1 -- 172.21.15.55:0/1546343847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb9c0b3870 msgr2=0x7feb9c0b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:06.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.619+0000 7feba0fa3640 1 --2- 172.21.15.55:0/1546343847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb9c0b3870 0x7feb9c0b3ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feb840097f0 tx=0x7feb8401c370 comp rx=0 tx=0).stop 2023-07-06T22:20:06.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.619+0000 7feba0fa3640 1 -- 172.21.15.55:0/1546343847 shutdown_connections 2023-07-06T22:20:06.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.619+0000 7feba0fa3640 1 --2- 172.21.15.55:0/1546343847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb9c0b3870 0x7feb9c0b3ca0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.619+0000 7feba0fa3640 1 -- 172.21.15.55:0/1546343847 >> 172.21.15.55:0/1546343847 conn(0x7feb9c0cec20 msgr2=0x7feb9c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:06.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.619+0000 7feba0fa3640 1 -- 172.21.15.55:0/1546343847 shutdown_connections 2023-07-06T22:20:06.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.619+0000 7feba0fa3640 1 -- 172.21.15.55:0/1546343847 wait complete. 2023-07-06T22:20:06.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feba0fa3640 1 Processor -- start 2023-07-06T22:20:06.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feba0fa3640 1 -- start start 2023-07-06T22:20:06.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feba0fa3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb9c0b3870 0x7feb9c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:06.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feba0fa3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb9c0d03c0 0x7feb9c0c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:06.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feba0fa3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c15b850 0x7feb9c157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:06.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feba0fa3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c06adf0 con 0x7feb9c15b850 2023-07-06T22:20:06.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feba0fa3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c153ee0 con 0x7feb9c0d03c0 2023-07-06T22:20:06.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feba0fa3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c06a340 con 0x7feb9c0b3870 2023-07-06T22:20:06.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb9ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c15b850 0x7feb9c157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:06.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb93fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb9c0d03c0 0x7feb9c0c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:06.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb9a59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb9c0b3870 0x7feb9c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:06.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb9ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c15b850 0x7feb9c157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35370/0 (socket says 172.21.15.55:35370) 2023-07-06T22:20:06.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb9ad9d640 1 -- 172.21.15.55:0/388026551 learned_addr learned my addr 172.21.15.55:0/388026551 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:06.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb9a59c640 1 -- 172.21.15.55:0/388026551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb9c0d03c0 msgr2=0x7feb9c0c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:06.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb9a59c640 1 --2- 172.21.15.55:0/388026551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb9c0d03c0 0x7feb9c0c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb9a59c640 1 -- 172.21.15.55:0/388026551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c15b850 msgr2=0x7feb9c157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:06.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb9a59c640 1 --2- 172.21.15.55:0/388026551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c15b850 0x7feb9c157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb9a59c640 1 -- 172.21.15.55:0/388026551 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb84009420 con 0x7feb9c0b3870 2023-07-06T22:20:06.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb9ad9d640 1 --2- 172.21.15.55:0/388026551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c15b850 0x7feb9c157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:06.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb93fff640 1 --2- 172.21.15.55:0/388026551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb9c0d03c0 0x7feb9c0c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:06.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb9a59c640 1 --2- 172.21.15.55:0/388026551 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb9c0b3870 0x7feb9c069e00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00c430 tx=0x7feb8c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:06.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb92ffd640 1 -- 172.21.15.55:0/388026551 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0054e0 con 0x7feb9c0b3870 2023-07-06T22:20:06.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb92ffd640 1 -- 172.21.15.55:0/388026551 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c003600 con 0x7feb9c0b3870 2023-07-06T22:20:06.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feba0fa3640 1 -- 172.21.15.55:0/388026551 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c06a550 con 0x7feb9c0b3870 2023-07-06T22:20:06.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feb92ffd640 1 -- 172.21.15.55:0/388026551 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0039f0 con 0x7feb9c0b3870 2023-07-06T22:20:06.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.623+0000 7feba0fa3640 1 -- 172.21.15.55:0/388026551 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c06ab10 con 0x7feb9c0b3870 2023-07-06T22:20:06.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.627+0000 7feba0fa3640 1 -- 172.21.15.55:0/388026551 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c153c40 con 0x7feb9c0b3870 2023-07-06T22:20:06.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.627+0000 7feb92ffd640 1 -- 172.21.15.55:0/388026551 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 102) v1 ==== 85874+0+0 (secure 0 0 0) 0x7feb8c003b50 con 0x7feb9c0b3870 2023-07-06T22:20:06.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.627+0000 7feb92ffd640 1 --2- 172.21.15.55:0/388026551 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7feb7c0664c0 0x7feb7c068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:06.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.627+0000 7feb93fff640 1 -- 172.21.15.55:0/388026551 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7feb7c0664c0 msgr2=0x7feb7c068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/628169602 2023-07-06T22:20:06.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.627+0000 7feb92ffd640 1 -- 172.21.15.55:0/388026551 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6842+0+0 (secure 0 0 0) 0x7feb8c083a40 con 0x7feb9c0b3870 2023-07-06T22:20:06.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.627+0000 7feb93fff640 1 --2- 172.21.15.55:0/388026551 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7feb7c0664c0 0x7feb7c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:06.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.631+0000 7feb92ffd640 1 -- 172.21.15.55:0/388026551 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb9c153c40 con 0x7feb9c0b3870 2023-07-06T22:20:06.724 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:06.723+0000 7fa96e262180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:20:06.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.787+0000 7feba0fa3640 1 -- 172.21.15.55:0/388026551 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb9c154020 con 0x7feb9c0b3870 2023-07-06T22:20:06.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.791+0000 7feb92ffd640 1 -- 172.21.15.55:0/388026551 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v181) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb8c017020 con 0x7feb9c0b3870 2023-07-06T22:20:06.792 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:20:06.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.791+0000 7feba0fa3640 1 -- 172.21.15.55:0/388026551 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7feb7c0664c0 msgr2=0x7feb7c068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:06.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.791+0000 7feba0fa3640 1 --2- 172.21.15.55:0/388026551 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7feb7c0664c0 0x7feb7c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.791+0000 7feba0fa3640 1 -- 172.21.15.55:0/388026551 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb9c0b3870 msgr2=0x7feb9c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:06.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.791+0000 7feba0fa3640 1 --2- 172.21.15.55:0/388026551 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb9c0b3870 0x7feb9c069e00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00c430 tx=0x7feb8c00c8f0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.791+0000 7feba0fa3640 1 -- 172.21.15.55:0/388026551 shutdown_connections 2023-07-06T22:20:06.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.791+0000 7feba0fa3640 1 --2- 172.21.15.55:0/388026551 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7feb7c0664c0 0x7feb7c068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.791+0000 7feba0fa3640 1 --2- 172.21.15.55:0/388026551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c15b850 0x7feb9c157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.791+0000 7feba0fa3640 1 --2- 172.21.15.55:0/388026551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb9c0d03c0 0x7feb9c0c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.791+0000 7feba0fa3640 1 --2- 172.21.15.55:0/388026551 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb9c0b3870 0x7feb9c069e00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:06.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.791+0000 7feba0fa3640 1 -- 172.21.15.55:0/388026551 >> 172.21.15.55:0/388026551 conn(0x7feb9c0cec20 msgr2=0x7feb9c0cc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:06.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.791+0000 7feba0fa3640 1 -- 172.21.15.55:0/388026551 shutdown_connections 2023-07-06T22:20:06.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.791+0000 7feba0fa3640 1 -- 172.21.15.55:0/388026551 wait complete. 2023-07-06T22:20:06.813 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:06.811+0000 7fa96e262180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:20:06.814 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:20:06.846 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:06.844+0000 7fbbbbed0180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:20:06.906 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:06.904+0000 7fbbbbed0180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:20:07.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.999+0000 7f5b35893640 1 Processor -- start 2023-07-06T22:20:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.999+0000 7f5b35893640 1 -- start start 2023-07-06T22:20:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.999+0000 7f5b35893640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b300d2a10 0x7f5b300b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.999+0000 7f5b35893640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b300b54e0 0x7f5b3015f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.999+0000 7f5b35893640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b300b3660 con 0x7f5b3015f4f0 2023-07-06T22:20:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.999+0000 7f5b35893640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b300b1eb0 con 0x7f5b300d2a10 2023-07-06T22:20:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:06.999+0000 7f5b35893640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b300b2190 con 0x7f5b300b54e0 2023-07-06T22:20:07.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.003+0000 7f5b27fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b300d2a10 0x7f5b300b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.003+0000 7f5b2effd640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f5b3015f4f0 0x7f5b300b2f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:57812/0 (socket says 172.21.15.55:57812) 2023-07-06T22:20:07.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.003+0000 7f5b2effd640 1 -- 172.21.15.55:0/2980418076 learned_addr learned my addr 172.21.15.55:0/2980418076 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:07.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.003+0000 7f5b2f7fe640 1 --2- 172.21.15.55:0/2980418076 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b300b54e0 0x7f5b3015f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.003+0000 7f5b2e7fc640 1 -- 172.21.15.55:0/2980418076 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662167663 0 0) 0x7f5b300b3660 con 0x7f5b3015f4f0 2023-07-06T22:20:07.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.003+0000 7f5b2e7fc640 1 -- 172.21.15.55:0/2980418076 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b1c003530 con 0x7f5b3015f4f0 2023-07-06T22:20:07.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.003+0000 7f5b2f7fe640 1 -- 172.21.15.55:0/2980418076 >> v2:172.21.15.55:3300/0 conn(0x7f5b300d2a10 msgr2=0x7f5b300b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:07.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.003+0000 7f5b2f7fe640 1 --2- 172.21.15.55:0/2980418076 >> v2:172.21.15.55:3300/0 conn(0x7f5b300d2a10 0x7f5b300b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.003+0000 7f5b2f7fe640 1 -- 172.21.15.55:0/2980418076 >> v1:172.21.15.138:6789/0 conn(0x7f5b3015f4f0 legacy=0x7f5b300b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.003+0000 7f5b2f7fe640 1 -- 172.21.15.55:0/2980418076 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b300b2470 con 0x7f5b300b54e0 2023-07-06T22:20:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.003+0000 7f5b2f7fe640 1 --2- 172.21.15.55:0/2980418076 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b300b54e0 0x7f5b3015f8c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009d90 tx=0x7f5b2801f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=580bc376f86dc64f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.003+0000 7f5b2e7fc640 1 -- 172.21.15.55:0/2980418076 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b280af600 con 0x7f5b300b54e0 2023-07-06T22:20:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b2e7fc640 1 -- 172.21.15.55:0/2980418076 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b280ab050 con 0x7f5b300b54e0 2023-07-06T22:20:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b2e7fc640 1 -- 172.21.15.55:0/2980418076 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b280af980 con 0x7f5b300b54e0 2023-07-06T22:20:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 -- 172.21.15.55:0/2980418076 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b300b54e0 msgr2=0x7f5b3015f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 --2- 172.21.15.55:0/2980418076 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b300b54e0 0x7f5b3015f8c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009d90 tx=0x7f5b2801f130 comp rx=0 tx=0).stop 2023-07-06T22:20:07.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 -- 172.21.15.55:0/2980418076 shutdown_connections 2023-07-06T22:20:07.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 --2- 172.21.15.55:0/2980418076 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b300b54e0 0x7f5b3015f8c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 --2- 172.21.15.55:0/2980418076 >> v2:172.21.15.55:3300/0 conn(0x7f5b300d2a10 0x7f5b300b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 -- 172.21.15.55:0/2980418076 >> 172.21.15.55:0/2980418076 conn(0x7f5b300b4900 msgr2=0x7f5b300d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:07.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 -- 172.21.15.55:0/2980418076 shutdown_connections 2023-07-06T22:20:07.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 -- 172.21.15.55:0/2980418076 wait complete. 2023-07-06T22:20:07.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 Processor -- start 2023-07-06T22:20:07.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 -- start start 2023-07-06T22:20:07.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b300b54e0 0x7f5b301f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b300d2a10 0x7f5b3015bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b3015f4f0 0x7f5b300693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b301f1f30 con 0x7f5b300b54e0 2023-07-06T22:20:07.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b301f4650 con 0x7f5b300d2a10 2023-07-06T22:20:07.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b35893640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b301f48c0 con 0x7f5b3015f4f0 2023-07-06T22:20:07.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b2effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b300b54e0 0x7f5b301f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b2effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b300b54e0 0x7f5b301f19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35382/0 (socket says 172.21.15.55:35382) 2023-07-06T22:20:07.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b2effd640 1 -- 172.21.15.55:0/553623852 learned_addr learned my addr 172.21.15.55:0/553623852 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:07.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b2f7fe640 1 --2- 172.21.15.55:0/553623852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b3015f4f0 0x7f5b300693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.007+0000 7f5b27fff640 1 --2- 172.21.15.55:0/553623852 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b300d2a10 0x7f5b3015bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.011+0000 7f5b2effd640 1 -- 172.21.15.55:0/553623852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b3015f4f0 msgr2=0x7f5b300693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.011+0000 7f5b2effd640 1 --2- 172.21.15.55:0/553623852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b3015f4f0 0x7f5b300693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.011+0000 7f5b2effd640 1 -- 172.21.15.55:0/553623852 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b300d2a10 msgr2=0x7f5b3015bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.011+0000 7f5b2effd640 1 --2- 172.21.15.55:0/553623852 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b300d2a10 0x7f5b3015bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.011+0000 7f5b2effd640 1 -- 172.21.15.55:0/553623852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b28009a70 con 0x7f5b300b54e0 2023-07-06T22:20:07.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.011+0000 7f5b2f7fe640 1 --2- 172.21.15.55:0/553623852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b3015f4f0 0x7f5b300693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:07.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.011+0000 7f5b2effd640 1 --2- 172.21.15.55:0/553623852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b300b54e0 0x7f5b301f19f0 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000c420 tx=0x7f5b2000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:07.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.011+0000 7f5b2cff9640 1 -- 172.21.15.55:0/553623852 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20005cf0 con 0x7f5b300b54e0 2023-07-06T22:20:07.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.011+0000 7f5b2cff9640 1 -- 172.21.15.55:0/553623852 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b20005e50 con 0x7f5b300b54e0 2023-07-06T22:20:07.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.011+0000 7f5b35893640 1 -- 172.21.15.55:0/553623852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b301f4ba0 con 0x7f5b300b54e0 2023-07-06T22:20:07.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.011+0000 7f5b2cff9640 1 -- 172.21.15.55:0/553623852 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200072d0 con 0x7f5b300b54e0 2023-07-06T22:20:07.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.011+0000 7f5b35893640 1 -- 172.21.15.55:0/553623852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b301f5160 con 0x7f5b300b54e0 2023-07-06T22:20:07.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.011+0000 7f5b35893640 1 -- 172.21.15.55:0/553623852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3004d790 con 0x7f5b300b54e0 2023-07-06T22:20:07.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.011+0000 7f5b2cff9640 1 -- 172.21.15.55:0/553623852 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 102) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f5b20007430 con 0x7f5b300b54e0 2023-07-06T22:20:07.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.015+0000 7f5b2cff9640 1 --2- 172.21.15.55:0/553623852 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f5b100664c0 0x7f5b10068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.015+0000 7f5b27fff640 1 -- 172.21.15.55:0/553623852 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f5b100664c0 msgr2=0x7f5b10068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/628169602 2023-07-06T22:20:07.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.015+0000 7f5b2cff9640 1 -- 172.21.15.55:0/553623852 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6842+0+0 (secure 0 0 0) 0x7f5b20037020 con 0x7f5b300b54e0 2023-07-06T22:20:07.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.015+0000 7f5b27fff640 1 --2- 172.21.15.55:0/553623852 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f5b100664c0 0x7f5b10068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:07.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.015+0000 7f5b2cff9640 1 -- 172.21.15.55:0/553623852 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5b20050c50 con 0x7f5b300b54e0 2023-07-06T22:20:07.103 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:07.099+0000 7fa96e262180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:20:07.166 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:07.163+0000 7fa96e262180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:20:07.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.179+0000 7f5b35893640 1 -- 172.21.15.55:0/553623852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5b300d1ec0 con 0x7f5b300b54e0 2023-07-06T22:20:07.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.179+0000 7f5b2cff9640 1 -- 172.21.15.55:0/553623852 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 103) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f5b20051020 con 0x7f5b300b54e0 2023-07-06T22:20:07.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.183+0000 7f5b2cff9640 1 -- 172.21.15.55:0/553623852 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f5b100664c0 msgr2=0x7f5b10068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:07.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.183+0000 7f5b2cff9640 1 --2- 172.21.15.55:0/553623852 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f5b100664c0 0x7f5b10068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.183+0000 7f5b2cff9640 1 -- 172.21.15.55:0/553623852 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v183) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5b20070340 con 0x7f5b300b54e0 2023-07-06T22:20:07.187 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:20:07.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.187+0000 7f5b35893640 1 -- 172.21.15.55:0/553623852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b300b54e0 msgr2=0x7f5b301f19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.187+0000 7f5b35893640 1 --2- 172.21.15.55:0/553623852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b300b54e0 0x7f5b301f19f0 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000c420 tx=0x7f5b2000c8e0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.187+0000 7f5b35893640 1 -- 172.21.15.55:0/553623852 shutdown_connections 2023-07-06T22:20:07.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.187+0000 7f5b35893640 1 --2- 172.21.15.55:0/553623852 >> [v2:172.21.15.55:6832/628169602,v1:172.21.15.55:6833/628169602] conn(0x7f5b100664c0 0x7f5b10068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.187+0000 7f5b35893640 1 --2- 172.21.15.55:0/553623852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5b3015f4f0 0x7f5b300693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.187+0000 7f5b35893640 1 --2- 172.21.15.55:0/553623852 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b300d2a10 0x7f5b3015bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.187+0000 7f5b35893640 1 --2- 172.21.15.55:0/553623852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b300b54e0 0x7f5b301f19f0 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.187+0000 7f5b35893640 1 -- 172.21.15.55:0/553623852 >> 172.21.15.55:0/553623852 conn(0x7f5b300b4900 msgr2=0x7f5b3006ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:07.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.187+0000 7f5b35893640 1 -- 172.21.15.55:0/553623852 shutdown_connections 2023-07-06T22:20:07.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.187+0000 7f5b35893640 1 -- 172.21.15.55:0/553623852 wait complete. 2023-07-06T22:20:07.212 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T22:20:07.267 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:07.263+0000 7fa8f5cca640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:07.267 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:07.263+0000 7fa8f5cca640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:07.267 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:07.263+0000 7fa8f5cca640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:07.267 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:07.263+0000 7fa8f5cca640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:07.267 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:07.263+0000 7fa8f5cca640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:07.268 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:07.263+0000 7fa8f84cf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:07.268 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:07.263+0000 7fa8f84cf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:07.268 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:07.263+0000 7fa8f84cf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:07.268 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:07.263+0000 7fa8f84cf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:07.268 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:07.263+0000 7fa8f84cf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:07.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05c5631640 1 Processor -- start 2023-07-06T22:20:07.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05c5631640 1 -- start start 2023-07-06T22:20:07.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05c5631640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05c00d0630 0x7f05c015fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05c5631640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f05c00ce200 0x7f05c00ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05c5631640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c00cc740 con 0x7f05c00b1250 2023-07-06T22:20:07.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05c5631640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c00ccc90 con 0x7f05c00d0630 2023-07-06T22:20:07.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05c5631640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c00b29c0 con 0x7f05c00ce200 2023-07-06T22:20:07.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05bf7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05c00d0630 0x7f05c015fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05bf7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05c00d0630 0x7f05c015fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35514/0 (socket says 172.21.15.55:35514) 2023-07-06T22:20:07.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05bf7fe640 1 -- 172.21.15.55:0/777154030 learned_addr learned my addr 172.21.15.55:0/777154030 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:07.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05c4e30640 1 --2- 172.21.15.55:0/777154030 >> v2:172.21.15.138:3300/0 conn(0x7f05c00ce200 0x7f05c00ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05bf7fe640 1 -- 172.21.15.55:0/777154030 >> v2:172.21.15.138:3300/0 conn(0x7f05c00ce200 msgr2=0x7f05c00ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:07.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05bf7fe640 1 --2- 172.21.15.55:0/777154030 >> v2:172.21.15.138:3300/0 conn(0x7f05c00ce200 0x7f05c00ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05bf7fe640 1 -- 172.21.15.55:0/777154030 >> v1:172.21.15.138:6789/0 conn(0x7f05c00b1250 legacy=0x7f05c015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05bf7fe640 1 -- 172.21.15.55:0/777154030 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c00d1d10 con 0x7f05c00d0630 2023-07-06T22:20:07.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.383+0000 7f05beffd640 1 -- 172.21.15.55:0/777154030 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374095662 0 0) 0x7f05c00cc740 con 0x7f05c00b1250 2023-07-06T22:20:07.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.387+0000 7f05bf7fe640 1 --2- 172.21.15.55:0/777154030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c00d0630 0x7f05c015fa90 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f05c00cdc70 tx=0x7f05b401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d66b90df07b8f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:07.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.387+0000 7f05beffd640 1 -- 172.21.15.55:0/777154030 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40ab3f0 con 0x7f05c00d0630 2023-07-06T22:20:07.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.387+0000 7f05beffd640 1 -- 172.21.15.55:0/777154030 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b40ab550 con 0x7f05c00d0630 2023-07-06T22:20:07.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.387+0000 7f05beffd640 1 -- 172.21.15.55:0/777154030 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40ab8e0 con 0x7f05c00d0630 2023-07-06T22:20:07.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.387+0000 7f05c5631640 1 -- 172.21.15.55:0/777154030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c00d0630 msgr2=0x7f05c015fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.387+0000 7f05c5631640 1 --2- 172.21.15.55:0/777154030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c00d0630 0x7f05c015fa90 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f05c00cdc70 tx=0x7f05b401c500 comp rx=0 tx=0).stop 2023-07-06T22:20:07.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.387+0000 7f05c5631640 1 -- 172.21.15.55:0/777154030 shutdown_connections 2023-07-06T22:20:07.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.387+0000 7f05c5631640 1 --2- 172.21.15.55:0/777154030 >> v2:172.21.15.138:3300/0 conn(0x7f05c00ce200 0x7f05c00ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.387+0000 7f05c5631640 1 --2- 172.21.15.55:0/777154030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c00d0630 0x7f05c015fa90 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.387+0000 7f05c5631640 1 -- 172.21.15.55:0/777154030 >> 172.21.15.55:0/777154030 conn(0x7f05c00b3b60 msgr2=0x7f05c00b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:07.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.387+0000 7f05c5631640 1 -- 172.21.15.55:0/777154030 shutdown_connections 2023-07-06T22:20:07.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.387+0000 7f05c5631640 1 -- 172.21.15.55:0/777154030 wait complete. 2023-07-06T22:20:07.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05c5631640 1 Processor -- start 2023-07-06T22:20:07.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05c5631640 1 -- start start 2023-07-06T22:20:07.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05c5631640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c00b1250 0x7f05c015cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05c5631640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c00ce200 0x7f05c00c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05c5631640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c00d0630 0x7f05c01f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05c5631640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00c9af0 con 0x7f05c00ce200 2023-07-06T22:20:07.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05c5631640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c015d8b0 con 0x7f05c00d0630 2023-07-06T22:20:07.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05c5631640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c015db90 con 0x7f05c00b1250 2023-07-06T22:20:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05bf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c00ce200 0x7f05c00c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05bf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c00ce200 0x7f05c00c59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35522/0 (socket says 172.21.15.55:35522) 2023-07-06T22:20:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05bf7fe640 1 -- 172.21.15.55:0/1321401501 learned_addr learned my addr 172.21.15.55:0/1321401501 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05bffff640 1 --2- 172.21.15.55:0/1321401501 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c00b1250 0x7f05c015cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05c4e30640 1 --2- 172.21.15.55:0/1321401501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c00d0630 0x7f05c01f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05bf7fe640 1 -- 172.21.15.55:0/1321401501 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c00b1250 msgr2=0x7f05c015cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05bf7fe640 1 --2- 172.21.15.55:0/1321401501 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c00b1250 0x7f05c015cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05bf7fe640 1 -- 172.21.15.55:0/1321401501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c00d0630 msgr2=0x7f05c01f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05bf7fe640 1 --2- 172.21.15.55:0/1321401501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c00d0630 0x7f05c01f75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05bf7fe640 1 -- 172.21.15.55:0/1321401501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b40094d0 con 0x7f05c00ce200 2023-07-06T22:20:07.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05bf7fe640 1 --2- 172.21.15.55:0/1321401501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c00ce200 0x7f05c00c59f0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f05b40ad040 tx=0x7f05b40192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:07.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05bcff9640 1 -- 172.21.15.55:0/1321401501 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40bf610 con 0x7f05c00ce200 2023-07-06T22:20:07.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05bcff9640 1 -- 172.21.15.55:0/1321401501 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b40bf790 con 0x7f05c00ce200 2023-07-06T22:20:07.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05c5631640 1 -- 172.21.15.55:0/1321401501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c015de70 con 0x7f05c00ce200 2023-07-06T22:20:07.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05bcff9640 1 -- 172.21.15.55:0/1321401501 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40bfb40 con 0x7f05c00ce200 2023-07-06T22:20:07.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.391+0000 7f05c5631640 1 -- 172.21.15.55:0/1321401501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c015d480 con 0x7f05c00ce200 2023-07-06T22:20:07.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.395+0000 7f05c5631640 1 -- 172.21.15.55:0/1321401501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c015d670 con 0x7f05c00ce200 2023-07-06T22:20:07.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.395+0000 7f05bcff9640 1 -- 172.21.15.55:0/1321401501 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 103) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f05b40b5400 con 0x7f05c00ce200 2023-07-06T22:20:07.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.395+0000 7f05bcff9640 1 -- 172.21.15.55:0/1321401501 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 7212+0+0 (secure 0 0 0) 0x7f05b40a8050 con 0x7f05c00ce200 2023-07-06T22:20:07.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.399+0000 7f05bcff9640 1 -- 172.21.15.55:0/1321401501 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05c015d670 con 0x7f05c00ce200 2023-07-06T22:20:07.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.555+0000 7f05c5631640 1 -- 172.21.15.55:0/1321401501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05c015d670 con 0x7f05c00ce200 2023-07-06T22:20:07.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.555+0000 7f05bcff9640 1 -- 172.21.15.55:0/1321401501 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v183) v1 ==== 104+0+11 (secure 0 0 0) 0x7f05c015d670 con 0x7f05c00ce200 2023-07-06T22:20:07.558 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T22:20:07.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.559+0000 7f05c5631640 1 -- 172.21.15.55:0/1321401501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c00ce200 msgr2=0x7f05c00c59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.559+0000 7f05c5631640 1 --2- 172.21.15.55:0/1321401501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c00ce200 0x7f05c00c59f0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f05b40ad040 tx=0x7f05b40192a0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.559+0000 7f05c5631640 1 -- 172.21.15.55:0/1321401501 shutdown_connections 2023-07-06T22:20:07.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.559+0000 7f05c5631640 1 --2- 172.21.15.55:0/1321401501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c00d0630 0x7f05c01f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.559+0000 7f05c5631640 1 --2- 172.21.15.55:0/1321401501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c00ce200 0x7f05c00c59f0 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.559+0000 7f05c5631640 1 --2- 172.21.15.55:0/1321401501 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05c00b1250 0x7f05c015cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.559+0000 7f05c5631640 1 -- 172.21.15.55:0/1321401501 >> 172.21.15.55:0/1321401501 conn(0x7f05c00b3b60 msgr2=0x7f05c00cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:07.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.559+0000 7f05c5631640 1 -- 172.21.15.55:0/1321401501 shutdown_connections 2023-07-06T22:20:07.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.559+0000 7f05c5631640 1 -- 172.21.15.55:0/1321401501 wait complete. 2023-07-06T22:20:07.579 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T22:20:07.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b161c5640 1 Processor -- start 2023-07-06T22:20:07.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b161c5640 1 -- start start 2023-07-06T22:20:07.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b161c5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7b100709a0 0x7f7b100cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b161c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7b100cbe60 0x7f7b100b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b161c5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b100cc300 con 0x7f7b10070d70 2023-07-06T22:20:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b161c5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b100cc5e0 con 0x7f7b100cbe60 2023-07-06T22:20:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b161c5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b100cc8c0 con 0x7f7b100709a0 2023-07-06T22:20:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b0effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7b100cbe60 0x7f7b100b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b0effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7b100cbe60 0x7f7b100b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35530/0 (socket says 172.21.15.55:35530) 2023-07-06T22:20:07.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b0effd640 1 -- 172.21.15.55:0/3614263397 learned_addr learned my addr 172.21.15.55:0/3614263397 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:07.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b0f7fe640 1 --2- 172.21.15.55:0/3614263397 >> v2:172.21.15.138:3300/0 conn(0x7f7b100709a0 0x7f7b100cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b0effd640 1 -- 172.21.15.55:0/3614263397 >> v2:172.21.15.138:3300/0 conn(0x7f7b100709a0 msgr2=0x7f7b100cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:07.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b0effd640 1 --2- 172.21.15.55:0/3614263397 >> v2:172.21.15.138:3300/0 conn(0x7f7b100709a0 0x7f7b100cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b0e7fc640 1 -- 172.21.15.55:0/3614263397 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598096690 0 0) 0x7f7b100cc300 con 0x7f7b10070d70 2023-07-06T22:20:07.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b0effd640 1 -- 172.21.15.55:0/3614263397 >> v1:172.21.15.55:6789/0 conn(0x7f7b10070d70 legacy=0x7f7b1015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.723+0000 7f7b0effd640 1 -- 172.21.15.55:0/3614263397 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b100ccba0 con 0x7f7b100cbe60 2023-07-06T22:20:07.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.727+0000 7f7b0effd640 1 --2- 172.21.15.55:0/3614263397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b100cbe60 0x7f7b100b0c30 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f7b1006ec60 tx=0x7f7b0401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97311ba4d559d353 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:07.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.727+0000 7f7b0e7fc640 1 -- 172.21.15.55:0/3614263397 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b040ab600 con 0x7f7b100cbe60 2023-07-06T22:20:07.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.727+0000 7f7b0e7fc640 1 -- 172.21.15.55:0/3614263397 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b040a7050 con 0x7f7b100cbe60 2023-07-06T22:20:07.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.727+0000 7f7b0e7fc640 1 -- 172.21.15.55:0/3614263397 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b040ab980 con 0x7f7b100cbe60 2023-07-06T22:20:07.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.727+0000 7f7b161c5640 1 -- 172.21.15.55:0/3614263397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b100cbe60 msgr2=0x7f7b100b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.727+0000 7f7b161c5640 1 --2- 172.21.15.55:0/3614263397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b100cbe60 0x7f7b100b0c30 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f7b1006ec60 tx=0x7f7b0401c500 comp rx=0 tx=0).stop 2023-07-06T22:20:07.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.727+0000 7f7b161c5640 1 -- 172.21.15.55:0/3614263397 shutdown_connections 2023-07-06T22:20:07.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.727+0000 7f7b161c5640 1 --2- 172.21.15.55:0/3614263397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b100cbe60 0x7f7b100b0c30 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.727+0000 7f7b161c5640 1 --2- 172.21.15.55:0/3614263397 >> v2:172.21.15.138:3300/0 conn(0x7f7b100709a0 0x7f7b100cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.727+0000 7f7b161c5640 1 -- 172.21.15.55:0/3614263397 >> 172.21.15.55:0/3614263397 conn(0x7f7b100cea70 msgr2=0x7f7b100ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:07.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.727+0000 7f7b161c5640 1 -- 172.21.15.55:0/3614263397 shutdown_connections 2023-07-06T22:20:07.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.727+0000 7f7b161c5640 1 -- 172.21.15.55:0/3614263397 wait complete. 2023-07-06T22:20:07.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b161c5640 1 Processor -- start 2023-07-06T22:20:07.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b161c5640 1 -- start start 2023-07-06T22:20:07.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b161c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b100709a0 0x7f7b10155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b161c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b10070d70 0x7f7b100c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b161c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b100cbe60 0x7f7b10157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:07.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b161c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b101562b0 con 0x7f7b100cbe60 2023-07-06T22:20:07.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b161c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100c65e0 con 0x7f7b100709a0 2023-07-06T22:20:07.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b161c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100c6be0 con 0x7f7b10070d70 2023-07-06T22:20:07.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b0ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b100cbe60 0x7f7b10157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b0ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b100cbe60 0x7f7b10157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35544/0 (socket says 172.21.15.55:35544) 2023-07-06T22:20:07.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b0ffff640 1 -- 172.21.15.55:0/20241709 learned_addr learned my addr 172.21.15.55:0/20241709 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:07.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b0f7fe640 1 --2- 172.21.15.55:0/20241709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b100709a0 0x7f7b10155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b0effd640 1 --2- 172.21.15.55:0/20241709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b10070d70 0x7f7b100c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:07.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b0ffff640 1 -- 172.21.15.55:0/20241709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b10070d70 msgr2=0x7f7b100c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b0ffff640 1 --2- 172.21.15.55:0/20241709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b10070d70 0x7f7b100c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b0ffff640 1 -- 172.21.15.55:0/20241709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b100709a0 msgr2=0x7f7b10155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b0ffff640 1 --2- 172.21.15.55:0/20241709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b100709a0 0x7f7b10155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b0ffff640 1 -- 172.21.15.55:0/20241709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b040094d0 con 0x7f7b100cbe60 2023-07-06T22:20:07.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b0ffff640 1 --2- 172.21.15.55:0/20241709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b100cbe60 0x7f7b10157a20 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800c890 tx=0x7f7b0800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:07.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7af7fff640 1 -- 172.21.15.55:0/20241709 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b08003db0 con 0x7f7b100cbe60 2023-07-06T22:20:07.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7af7fff640 1 -- 172.21.15.55:0/20241709 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b08005070 con 0x7f7b100cbe60 2023-07-06T22:20:07.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7af7fff640 1 -- 172.21.15.55:0/20241709 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b08005420 con 0x7f7b100cbe60 2023-07-06T22:20:07.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b161c5640 1 -- 172.21.15.55:0/20241709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b100c5a00 con 0x7f7b100cbe60 2023-07-06T22:20:07.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.731+0000 7f7b161c5640 1 -- 172.21.15.55:0/20241709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b100c6e30 con 0x7f7b100cbe60 2023-07-06T22:20:07.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.735+0000 7f7b161c5640 1 -- 172.21.15.55:0/20241709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b10066d60 con 0x7f7b100cbe60 2023-07-06T22:20:07.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.735+0000 7f7af7fff640 1 -- 172.21.15.55:0/20241709 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 103) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f7b08005580 con 0x7f7b100cbe60 2023-07-06T22:20:07.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.735+0000 7f7af7fff640 1 -- 172.21.15.55:0/20241709 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 7212+0+0 (secure 0 0 0) 0x7f7b08083610 con 0x7f7b100cbe60 2023-07-06T22:20:07.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.739+0000 7f7af7fff640 1 -- 172.21.15.55:0/20241709 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7b08050a60 con 0x7f7b100cbe60 2023-07-06T22:20:07.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.895+0000 7f7b161c5640 1 -- 172.21.15.55:0/20241709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b100cb6e0 con 0x7f7b100cbe60 2023-07-06T22:20:07.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.895+0000 7f7af7fff640 1 -- 172.21.15.55:0/20241709 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v183) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b08054080 con 0x7f7b100cbe60 2023-07-06T22:20:07.897 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T22:20:07.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.895+0000 7f7b161c5640 1 -- 172.21.15.55:0/20241709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b100cbe60 msgr2=0x7f7b10157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.895+0000 7f7b161c5640 1 --2- 172.21.15.55:0/20241709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b100cbe60 0x7f7b10157a20 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800c890 tx=0x7f7b0800cd50 comp rx=0 tx=0).stop 2023-07-06T22:20:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.895+0000 7f7b161c5640 1 -- 172.21.15.55:0/20241709 shutdown_connections 2023-07-06T22:20:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.895+0000 7f7b161c5640 1 --2- 172.21.15.55:0/20241709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b100cbe60 0x7f7b10157a20 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.895+0000 7f7b161c5640 1 --2- 172.21.15.55:0/20241709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b10070d70 0x7f7b100c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.895+0000 7f7b161c5640 1 --2- 172.21.15.55:0/20241709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b100709a0 0x7f7b10155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.895+0000 7f7b161c5640 1 -- 172.21.15.55:0/20241709 >> 172.21.15.55:0/20241709 conn(0x7f7b100cea70 msgr2=0x7f7b100ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:07.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.895+0000 7f7b161c5640 1 -- 172.21.15.55:0/20241709 shutdown_connections 2023-07-06T22:20:07.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:07.895+0000 7f7b161c5640 1 -- 172.21.15.55:0/20241709 wait complete. 2023-07-06T22:20:07.917 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:20:08.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe46d89c640 1 Processor -- start 2023-07-06T22:20:08.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe46d89c640 1 -- start start 2023-07-06T22:20:08.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe46d89c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4680d15f0 0x7fe4680b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe46d89c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4680b4080 0x7fe4680cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe46d89c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4680cccf0 con 0x7fe4680b78a0 2023-07-06T22:20:08.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe46d89c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4680b23c0 con 0x7fe4680b4080 2023-07-06T22:20:08.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe46d89c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680b4500 con 0x7fe4680d15f0 2023-07-06T22:20:08.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe4677fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4680b4080 0x7fe4680cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe4677fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4680b4080 0x7fe4680cfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35550/0 (socket says 172.21.15.55:35550) 2023-07-06T22:20:08.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe4677fe640 1 -- 172.21.15.55:0/3094316992 learned_addr learned my addr 172.21.15.55:0/3094316992 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:08.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe4667fc640 1 --2- 172.21.15.55:0/3094316992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4680d15f0 0x7fe4680b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe4677fe640 1 -- 172.21.15.55:0/3094316992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4680d15f0 msgr2=0x7fe4680b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:08.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe4677fe640 1 --2- 172.21.15.55:0/3094316992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4680d15f0 0x7fe4680b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe4677fe640 1 -- 172.21.15.55:0/3094316992 >> v1:172.21.15.138:6789/0 conn(0x7fe4680b78a0 legacy=0x7fe4680ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.059+0000 7fe4677fe640 1 -- 172.21.15.55:0/3094316992 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4680b7c70 con 0x7fe4680b4080 2023-07-06T22:20:08.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.063+0000 7fe4677fe640 1 --2- 172.21.15.55:0/3094316992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680b4080 0x7fe4680cfdb0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fe460009e50 tx=0x7fe46001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b197588dc8c78f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:08.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.063+0000 7fe465ffb640 1 -- 172.21.15.55:0/3094316992 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600a5780 con 0x7fe4680b4080 2023-07-06T22:20:08.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.063+0000 7fe465ffb640 1 -- 172.21.15.55:0/3094316992 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4600a58e0 con 0x7fe4680b4080 2023-07-06T22:20:08.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.063+0000 7fe465ffb640 1 -- 172.21.15.55:0/3094316992 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600a5c70 con 0x7fe4680b4080 2023-07-06T22:20:08.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.063+0000 7fe46d89c640 1 -- 172.21.15.55:0/3094316992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680b4080 msgr2=0x7fe4680cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.063+0000 7fe46d89c640 1 --2- 172.21.15.55:0/3094316992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680b4080 0x7fe4680cfdb0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fe460009e50 tx=0x7fe46001c8c0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.063+0000 7fe46d89c640 1 -- 172.21.15.55:0/3094316992 shutdown_connections 2023-07-06T22:20:08.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.063+0000 7fe46d89c640 1 --2- 172.21.15.55:0/3094316992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680b4080 0x7fe4680cfdb0 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.063+0000 7fe46d89c640 1 --2- 172.21.15.55:0/3094316992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4680d15f0 0x7fe4680b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.063+0000 7fe46d89c640 1 -- 172.21.15.55:0/3094316992 >> 172.21.15.55:0/3094316992 conn(0x7fe4680cead0 msgr2=0x7fe4680ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:08.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.063+0000 7fe46d89c640 1 -- 172.21.15.55:0/3094316992 shutdown_connections 2023-07-06T22:20:08.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.063+0000 7fe46d89c640 1 -- 172.21.15.55:0/3094316992 wait complete. 2023-07-06T22:20:08.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.063+0000 7fe46d89c640 1 Processor -- start 2023-07-06T22:20:08.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe46d89c640 1 -- start start 2023-07-06T22:20:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe46d89c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4680b4080 0x7fe4680c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe46d89c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4680b78a0 0x7fe46814f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe46d89c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680d15f0 0x7fe4680c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe46d89c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46814f770 con 0x7fe4680d15f0 2023-07-06T22:20:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe46d89c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680c7b20 con 0x7fe4680b4080 2023-07-06T22:20:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe46d89c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680c7e00 con 0x7fe4680b78a0 2023-07-06T22:20:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe4677fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680d15f0 0x7fe4680c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe4677fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680d15f0 0x7fe4680c5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35564/0 (socket says 172.21.15.55:35564) 2023-07-06T22:20:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe4677fe640 1 -- 172.21.15.55:0/386749183 learned_addr learned my addr 172.21.15.55:0/386749183 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe4667fc640 1 --2- 172.21.15.55:0/386749183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4680b78a0 0x7fe46814f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe466ffd640 1 --2- 172.21.15.55:0/386749183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4680b4080 0x7fe4680c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe4677fe640 1 -- 172.21.15.55:0/386749183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4680b78a0 msgr2=0x7fe46814f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe4677fe640 1 --2- 172.21.15.55:0/386749183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4680b78a0 0x7fe46814f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe4677fe640 1 -- 172.21.15.55:0/386749183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4680b4080 msgr2=0x7fe4680c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe4677fe640 1 --2- 172.21.15.55:0/386749183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4680b4080 0x7fe4680c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe4677fe640 1 -- 172.21.15.55:0/386749183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe460009b30 con 0x7fe4680d15f0 2023-07-06T22:20:08.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe4677fe640 1 --2- 172.21.15.55:0/386749183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680d15f0 0x7fe4680c5d20 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7fe46001a4f0 tx=0x7fe460019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:08.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe44ffff640 1 -- 172.21.15.55:0/386749183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600b8670 con 0x7fe4680d15f0 2023-07-06T22:20:08.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe44ffff640 1 -- 172.21.15.55:0/386749183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4600b87d0 con 0x7fe4680d15f0 2023-07-06T22:20:08.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe46d89c640 1 -- 172.21.15.55:0/386749183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4680c80e0 con 0x7fe4680d15f0 2023-07-06T22:20:08.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe44ffff640 1 -- 172.21.15.55:0/386749183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600b8b40 con 0x7fe4680d15f0 2023-07-06T22:20:08.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe46d89c640 1 -- 172.21.15.55:0/386749183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4680c86a0 con 0x7fe4680d15f0 2023-07-06T22:20:08.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.067+0000 7fe46d89c640 1 -- 172.21.15.55:0/386749183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4680c7f40 con 0x7fe4680d15f0 2023-07-06T22:20:08.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.071+0000 7fe44ffff640 1 -- 172.21.15.55:0/386749183 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 103) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fe4600b8ca0 con 0x7fe4680d15f0 2023-07-06T22:20:08.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.071+0000 7fe44ffff640 1 -- 172.21.15.55:0/386749183 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 7212+0+0 (secure 0 0 0) 0x7fe46011f100 con 0x7fe4680d15f0 2023-07-06T22:20:08.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.075+0000 7fe44ffff640 1 -- 172.21.15.55:0/386749183 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4680c7f40 con 0x7fe4680d15f0 2023-07-06T22:20:08.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.207+0000 7fe44ffff640 1 -- 172.21.15.55:0/386749183 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 104) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fe4600ebfc0 con 0x7fe4680d15f0 2023-07-06T22:20:08.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.207+0000 7fe44ffff640 1 --2- 172.21.15.55:0/386749183 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fe45406c750 0x7fe45406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.207+0000 7fe466ffd640 1 --2- 172.21.15.55:0/386749183 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fe45406c750 0x7fe45406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.215+0000 7fe466ffd640 1 --2- 172.21.15.55:0/386749183 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fe45406c750 0x7fe45406eb30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe4681550f0 tx=0x7fe458009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:08.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.271+0000 7fe46d89c640 1 -- 172.21.15.55:0/386749183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4680c7f40 con 0x7fe4680d15f0 2023-07-06T22:20:08.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.271+0000 7fe44ffff640 1 -- 172.21.15.55:0/386749183 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fe4680c7f40 con 0x7fe4680d15f0 2023-07-06T22:20:08.274 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:08.274 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8420,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/10830186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":10830186},{"type":"v1","addr":"172.21.15.138:6834","nonce":10830186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9577,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3623480690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3623480690},{"type":"v1","addr":"172.21.15.138:6835","nonce":3623480690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":10428,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2297427597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2297427597},{"type":"v1","addr":"172.21.15.55:6835","nonce":2297427597}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:18:40.592191+0000","modified":"2023-07-06T22:18:43.616817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10431":{"gid":10431,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3052024414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3052024414},{"type":"v1","addr":"172.21.15.55:6837","nonce":3052024414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-06T22:20:08.274 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 79 2023-07-06T22:20:08.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.271+0000 7fe46d89c640 1 -- 172.21.15.55:0/386749183 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fe45406c750 msgr2=0x7fe45406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.271+0000 7fe46d89c640 1 --2- 172.21.15.55:0/386749183 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fe45406c750 0x7fe45406eb30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe4681550f0 tx=0x7fe458009040 comp rx=0 tx=0).stop 2023-07-06T22:20:08.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.271+0000 7fe46d89c640 1 -- 172.21.15.55:0/386749183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680d15f0 msgr2=0x7fe4680c5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.271+0000 7fe46d89c640 1 --2- 172.21.15.55:0/386749183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680d15f0 0x7fe4680c5d20 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7fe46001a4f0 tx=0x7fe460019660 comp rx=0 tx=0).stop 2023-07-06T22:20:08.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.271+0000 7fe46d89c640 1 -- 172.21.15.55:0/386749183 shutdown_connections 2023-07-06T22:20:08.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.271+0000 7fe46d89c640 1 --2- 172.21.15.55:0/386749183 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fe45406c750 0x7fe45406eb30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.271+0000 7fe46d89c640 1 --2- 172.21.15.55:0/386749183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4680d15f0 0x7fe4680c5d20 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.271+0000 7fe46d89c640 1 --2- 172.21.15.55:0/386749183 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4680b78a0 0x7fe46814f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.271+0000 7fe46d89c640 1 --2- 172.21.15.55:0/386749183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4680b4080 0x7fe4680c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.271+0000 7fe46d89c640 1 -- 172.21.15.55:0/386749183 >> 172.21.15.55:0/386749183 conn(0x7fe4680cead0 msgr2=0x7fe4680693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:08.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.275+0000 7fe46d89c640 1 -- 172.21.15.55:0/386749183 shutdown_connections 2023-07-06T22:20:08.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.275+0000 7fe46d89c640 1 -- 172.21.15.55:0/386749183 wait complete. 2023-07-06T22:20:08.294 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:20:08.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.435+0000 7f980d49c640 1 Processor -- start 2023-07-06T22:20:08.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.435+0000 7f980d49c640 1 -- start start 2023-07-06T22:20:08.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f980d49c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9808158400 0x7f98080c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f980d49c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98080c9680 0x7f9808070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f980d49c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f98080710c0 0x7f98080cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f980d49c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980806fae0 con 0x7f9808158400 2023-07-06T22:20:08.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f980d49c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980806fdc0 con 0x7f98080710c0 2023-07-06T22:20:08.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f980d49c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98080700a0 con 0x7f98080c9680 2023-07-06T22:20:08.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f9806ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9808158400 0x7f98080c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f9806ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9808158400 0x7f98080c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35574/0 (socket says 172.21.15.55:35574) 2023-07-06T22:20:08.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f9806ffd640 1 -- 172.21.15.55:0/3355361006 learned_addr learned my addr 172.21.15.55:0/3355361006 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:08.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f9806ffd640 1 -- 172.21.15.55:0/3355361006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98080c9680 msgr2=0x7f9808070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:08.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f9806ffd640 1 --2- 172.21.15.55:0/3355361006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98080c9680 0x7f9808070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f9806ffd640 1 -- 172.21.15.55:0/3355361006 >> v2:172.21.15.138:3300/0 conn(0x7f98080710c0 msgr2=0x7f98080cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:08.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f9806ffd640 1 --2- 172.21.15.55:0/3355361006 >> v2:172.21.15.138:3300/0 conn(0x7f98080710c0 0x7f98080cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f9806ffd640 1 -- 172.21.15.55:0/3355361006 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9808070380 con 0x7f9808158400 2023-07-06T22:20:08.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.439+0000 7f9806ffd640 1 --2- 172.21.15.55:0/3355361006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9808158400 0x7f98080c9140 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f98080ad960 tx=0x7f97f801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b45d6a07f0f800 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:08.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f98067fc640 1 -- 172.21.15.55:0/3355361006 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f80a7c50 con 0x7f9808158400 2023-07-06T22:20:08.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f98067fc640 1 -- 172.21.15.55:0/3355361006 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f80a7db0 con 0x7f9808158400 2023-07-06T22:20:08.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f98067fc640 1 -- 172.21.15.55:0/3355361006 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f80af660 con 0x7f9808158400 2023-07-06T22:20:08.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 -- 172.21.15.55:0/3355361006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9808158400 msgr2=0x7f98080c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 --2- 172.21.15.55:0/3355361006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9808158400 0x7f98080c9140 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f98080ad960 tx=0x7f97f801eba0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 -- 172.21.15.55:0/3355361006 shutdown_connections 2023-07-06T22:20:08.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 --2- 172.21.15.55:0/3355361006 >> v2:172.21.15.138:3300/0 conn(0x7f98080710c0 0x7f98080cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 --2- 172.21.15.55:0/3355361006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98080c9680 0x7f9808070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 --2- 172.21.15.55:0/3355361006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9808158400 0x7f98080c9140 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 -- 172.21.15.55:0/3355361006 >> 172.21.15.55:0/3355361006 conn(0x7f98080cded0 msgr2=0x7f98080ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:08.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 -- 172.21.15.55:0/3355361006 shutdown_connections 2023-07-06T22:20:08.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 -- 172.21.15.55:0/3355361006 wait complete. 2023-07-06T22:20:08.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 Processor -- start 2023-07-06T22:20:08.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 -- start start 2023-07-06T22:20:08.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98080710c0 0x7f980814a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98080c9680 0x7f9808155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9808158400 0x7f98081f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9808155290 con 0x7f9808158400 2023-07-06T22:20:08.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98081f5ad0 con 0x7f98080c9680 2023-07-06T22:20:08.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.443+0000 7f980d49c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98081f5db0 con 0x7f98080710c0 2023-07-06T22:20:08.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f98077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9808158400 0x7f98081f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f98077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9808158400 0x7f98081f4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35576/0 (socket says 172.21.15.55:35576) 2023-07-06T22:20:08.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f98077fe640 1 -- 172.21.15.55:0/1615905964 learned_addr learned my addr 172.21.15.55:0/1615905964 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:08.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f97fffff640 1 --2- 172.21.15.55:0/1615905964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98080c9680 0x7f9808155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f9806ffd640 1 --2- 172.21.15.55:0/1615905964 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98080710c0 0x7f980814a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f98077fe640 1 -- 172.21.15.55:0/1615905964 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98080710c0 msgr2=0x7f980814a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f98077fe640 1 --2- 172.21.15.55:0/1615905964 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98080710c0 0x7f980814a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f98077fe640 1 -- 172.21.15.55:0/1615905964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98080c9680 msgr2=0x7f9808155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f98077fe640 1 --2- 172.21.15.55:0/1615905964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98080c9680 0x7f9808155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f98077fe640 1 -- 172.21.15.55:0/1615905964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f800b770 con 0x7f9808158400 2023-07-06T22:20:08.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f98077fe640 1 --2- 172.21.15.55:0/1615905964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9808158400 0x7f98081f4f40 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f980000b970 tx=0x7f980000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:08.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f97ff7fe640 1 -- 172.21.15.55:0/1615905964 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980000cb40 con 0x7f9808158400 2023-07-06T22:20:08.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f97ff7fe640 1 -- 172.21.15.55:0/1615905964 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980000ccc0 con 0x7f9808158400 2023-07-06T22:20:08.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f980d49c640 1 -- 172.21.15.55:0/1615905964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98081554a0 con 0x7f9808158400 2023-07-06T22:20:08.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f97ff7fe640 1 -- 172.21.15.55:0/1615905964 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800014680 con 0x7f9808158400 2023-07-06T22:20:08.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f980d49c640 1 -- 172.21.15.55:0/1615905964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980814a940 con 0x7f9808158400 2023-07-06T22:20:08.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f980d49c640 1 -- 172.21.15.55:0/1615905964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980806c580 con 0x7f9808158400 2023-07-06T22:20:08.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.447+0000 7f97ff7fe640 1 -- 172.21.15.55:0/1615905964 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 104) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f980001d3b0 con 0x7f9808158400 2023-07-06T22:20:08.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.451+0000 7f97ff7fe640 1 --2- 172.21.15.55:0/1615905964 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f97e8066100 0x7f97e80685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.451+0000 7f97ff7fe640 1 -- 172.21.15.55:0/1615905964 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 7212+0+0 (secure 0 0 0) 0x7f9800083d50 con 0x7f9808158400 2023-07-06T22:20:08.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.451+0000 7f9806ffd640 1 --2- 172.21.15.55:0/1615905964 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f97e8066100 0x7f97e80685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.451+0000 7f9806ffd640 1 --2- 172.21.15.55:0/1615905964 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f97e8066100 0x7f97e80685b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f97f80b1000 tx=0x7f97f80a9070 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.451+0000 7f97ff7fe640 1 -- 172.21.15.55:0/1615905964 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9800051070 con 0x7f9808158400 2023-07-06T22:20:08.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.607+0000 7f980d49c640 1 -- 172.21.15.55:0/1615905964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98081f5f70 con 0x7f9808158400 2023-07-06T22:20:08.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.611+0000 7f97ff7fe640 1 -- 172.21.15.55:0/1615905964 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+19776 (secure 0 0 0) 0x7f9800019090 con 0x7f9808158400 2023-07-06T22:20:08.613 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:08.613 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":183,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:20:07.174911+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:18:38.520955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-07-06T22:18:39.591879+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":182,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/251532788":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/4267103658":"2023-07-07T22:20:07.174864+0000","172.21.15.55:6833/628169602":"2023-07-07T22:20:07.174864+0000","172.21.15.55:6832/628169602":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/3238640476":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/1991294440":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/3074416439":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/3954362142":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/3285408268":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/1793501954":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/455359735":"2023-07-07T22:18:57.087673+0000","172.21.15.55:6833/957337795":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/2168505984":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/3159272832":"2023-07-07T22:18:57.087673+0000","172.21.15.55:6832/957337795":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/748095594":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/4040799024":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/56444713":"2023-07-07T22:18:57.087673+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:20:08.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.611+0000 7f980d49c640 1 -- 172.21.15.55:0/1615905964 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f97e8066100 msgr2=0x7f97e80685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.611+0000 7f980d49c640 1 --2- 172.21.15.55:0/1615905964 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f97e8066100 0x7f97e80685b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f97f80b1000 tx=0x7f97f80a9070 comp rx=0 tx=0).stop 2023-07-06T22:20:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.611+0000 7f980d49c640 1 -- 172.21.15.55:0/1615905964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9808158400 msgr2=0x7f98081f4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.611+0000 7f980d49c640 1 --2- 172.21.15.55:0/1615905964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9808158400 0x7f98081f4f40 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f980000b970 tx=0x7f980000be30 comp rx=0 tx=0).stop 2023-07-06T22:20:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.611+0000 7f980d49c640 1 -- 172.21.15.55:0/1615905964 shutdown_connections 2023-07-06T22:20:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.611+0000 7f980d49c640 1 --2- 172.21.15.55:0/1615905964 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f97e8066100 0x7f97e80685b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.611+0000 7f980d49c640 1 --2- 172.21.15.55:0/1615905964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9808158400 0x7f98081f4f40 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.611+0000 7f980d49c640 1 --2- 172.21.15.55:0/1615905964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98080c9680 0x7f9808155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.611+0000 7f980d49c640 1 --2- 172.21.15.55:0/1615905964 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98080710c0 0x7f980814a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.611+0000 7f980d49c640 1 -- 172.21.15.55:0/1615905964 >> 172.21.15.55:0/1615905964 conn(0x7f98080cded0 msgr2=0x7f9808162e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.611+0000 7f980d49c640 1 -- 172.21.15.55:0/1615905964 shutdown_connections 2023-07-06T22:20:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.611+0000 7f980d49c640 1 -- 172.21.15.55:0/1615905964 wait complete. 2023-07-06T22:20:08.636 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T22:20:08.637 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:20:08.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f513da34640 1 Processor -- start 2023-07-06T22:20:08.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f513da34640 1 -- start start 2023-07-06T22:20:08.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f513da34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51380b7cd0 0x7f51380ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f513da34640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f51380b1fe0 0x7f513815f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f513da34640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51380cecf0 con 0x7f51380ccab0 2023-07-06T22:20:08.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f513da34640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51380d2310 con 0x7f51380b1fe0 2023-07-06T22:20:08.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f513da34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51380b80a0 con 0x7f51380b7cd0 2023-07-06T22:20:08.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f5136ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51380b7cd0 0x7f51380ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f51377fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f51380b1fe0 0x7f513815f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f51377fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f51380b1fe0 0x7f513815f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:40714/0 (socket says 172.21.15.55:40714) 2023-07-06T22:20:08.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f51377fe640 1 -- 172.21.15.55:0/2251035725 learned_addr learned my addr 172.21.15.55:0/2251035725 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:08.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f5136ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51380b7cd0 0x7f51380ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44414/0 (socket says 172.21.15.55:44414) 2023-07-06T22:20:08.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f5136ffd640 1 -- 172.21.15.55:0/2251035725 >> v2:172.21.15.138:3300/0 conn(0x7f51380b1fe0 msgr2=0x7f513815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:08.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f5136ffd640 1 --2- 172.21.15.55:0/2251035725 >> v2:172.21.15.138:3300/0 conn(0x7f51380b1fe0 0x7f513815f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f5136ffd640 1 -- 172.21.15.55:0/2251035725 >> v1:172.21.15.138:6789/0 conn(0x7f51380ccab0 legacy=0x7f51380b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f5136ffd640 1 -- 172.21.15.55:0/2251035725 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380d1d90 con 0x7f51380b7cd0 2023-07-06T22:20:08.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.779+0000 7f5135ffb640 1 -- 172.21.15.55:0/2251035725 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166956802 0 0) 0x7f51380cecf0 con 0x7f51380ccab0 2023-07-06T22:20:08.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.783+0000 7f5136ffd640 1 --2- 172.21.15.55:0/2251035725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51380b7cd0 0x7f51380ce610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f51280097c0 tx=0x7f512801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a33b1173e903da82 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:08.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.783+0000 7f5135ffb640 1 -- 172.21.15.55:0/2251035725 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51280ab600 con 0x7f51380b7cd0 2023-07-06T22:20:08.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.783+0000 7f5135ffb640 1 -- 172.21.15.55:0/2251035725 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51280a7050 con 0x7f51380b7cd0 2023-07-06T22:20:08.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.783+0000 7f5135ffb640 1 -- 172.21.15.55:0/2251035725 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51280ab980 con 0x7f51380b7cd0 2023-07-06T22:20:08.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.783+0000 7f513da34640 1 -- 172.21.15.55:0/2251035725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51380b7cd0 msgr2=0x7f51380ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.783+0000 7f513da34640 1 --2- 172.21.15.55:0/2251035725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51380b7cd0 0x7f51380ce610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f51280097c0 tx=0x7f512801c3f0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.783+0000 7f513da34640 1 -- 172.21.15.55:0/2251035725 shutdown_connections 2023-07-06T22:20:08.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.783+0000 7f513da34640 1 --2- 172.21.15.55:0/2251035725 >> v2:172.21.15.138:3300/0 conn(0x7f51380b1fe0 0x7f513815f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.783+0000 7f513da34640 1 --2- 172.21.15.55:0/2251035725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51380b7cd0 0x7f51380ce610 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.783+0000 7f513da34640 1 -- 172.21.15.55:0/2251035725 >> 172.21.15.55:0/2251035725 conn(0x7f51380ceee0 msgr2=0x7f51380cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:08.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.783+0000 7f513da34640 1 -- 172.21.15.55:0/2251035725 shutdown_connections 2023-07-06T22:20:08.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.783+0000 7f513da34640 1 -- 172.21.15.55:0/2251035725 wait complete. 2023-07-06T22:20:08.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f513da34640 1 Processor -- start 2023-07-06T22:20:08.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f513da34640 1 -- start start 2023-07-06T22:20:08.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f513da34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51380b1fe0 0x7f51381f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f513da34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51380b7cd0 0x7f5138156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f513da34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51380ccab0 0x7f51381567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f513da34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51381f5c70 con 0x7f51380b7cd0 2023-07-06T22:20:08.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f513da34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51381f5560 con 0x7f51380ccab0 2023-07-06T22:20:08.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f513da34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51381f4fa0 con 0x7f51380b1fe0 2023-07-06T22:20:08.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f51367fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51380b7cd0 0x7f5138156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f51367fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51380b7cd0 0x7f5138156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35580/0 (socket says 172.21.15.55:35580) 2023-07-06T22:20:08.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f51367fc640 1 -- 172.21.15.55:0/3854687630 learned_addr learned my addr 172.21.15.55:0/3854687630 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:08.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f5136ffd640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51380b1fe0 0x7f51381f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f51377fe640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51380ccab0 0x7f51381567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f51367fc640 1 -- 172.21.15.55:0/3854687630 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51380b1fe0 msgr2=0x7f51381f45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f51367fc640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51380b1fe0 0x7f51381f45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f51367fc640 1 -- 172.21.15.55:0/3854687630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51380ccab0 msgr2=0x7f51381567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f51367fc640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51380ccab0 0x7f51381567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f51367fc640 1 -- 172.21.15.55:0/3854687630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5128009420 con 0x7f51380b7cd0 2023-07-06T22:20:08.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f51377fe640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51380ccab0 0x7f51381567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:08.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f51367fc640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51380b7cd0 0x7f5138156280 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f512c001ec0 tx=0x7f512c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:08.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f511ffff640 1 -- 172.21.15.55:0/3854687630 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0054e0 con 0x7f51380b7cd0 2023-07-06T22:20:08.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f511ffff640 1 -- 172.21.15.55:0/3854687630 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c003600 con 0x7f51380b7cd0 2023-07-06T22:20:08.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f511ffff640 1 -- 172.21.15.55:0/3854687630 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0039b0 con 0x7f51380b7cd0 2023-07-06T22:20:08.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f513da34640 1 -- 172.21.15.55:0/3854687630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51381f5280 con 0x7f51380b7cd0 2023-07-06T22:20:08.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.787+0000 7f513da34640 1 -- 172.21.15.55:0/3854687630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51380cb9b0 con 0x7f51380b7cd0 2023-07-06T22:20:08.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.791+0000 7f513da34640 1 -- 172.21.15.55:0/3854687630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5138066d60 con 0x7f51380b7cd0 2023-07-06T22:20:08.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.791+0000 7f511ffff640 1 -- 172.21.15.55:0/3854687630 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 104) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f512c003b10 con 0x7f51380b7cd0 2023-07-06T22:20:08.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.791+0000 7f511ffff640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f51240660d0 0x7f5124068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:08.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.791+0000 7f511ffff640 1 -- 172.21.15.55:0/3854687630 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 7212+0+0 (secure 0 0 0) 0x7f512c0834b0 con 0x7f51380b7cd0 2023-07-06T22:20:08.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.791+0000 7f5136ffd640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f51240660d0 0x7f5124068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:08.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.791+0000 7f5136ffd640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f51240660d0 0x7f5124068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f51280ad000 tx=0x7f51280a6000 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:08.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.795+0000 7f511ffff640 1 -- 172.21.15.55:0/3854687630 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f512c050720 con 0x7f51380b7cd0 2023-07-06T22:20:08.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.983+0000 7f513da34640 1 -- 172.21.15.55:0/3854687630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51380b3690 con 0x7f51380b7cd0 2023-07-06T22:20:08.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.983+0000 7f511ffff640 1 -- 172.21.15.55:0/3854687630 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f512c017090 con 0x7f51380b7cd0 2023-07-06T22:20:08.986 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:08.986 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8420,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/10830186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":10830186},{"type":"v1","addr":"172.21.15.138:6834","nonce":10830186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9577,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3623480690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3623480690},{"type":"v1","addr":"172.21.15.138:6835","nonce":3623480690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":10428,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2297427597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2297427597},{"type":"v1","addr":"172.21.15.55:6835","nonce":2297427597}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:18:40.592191+0000","modified":"2023-07-06T22:18:43.616817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10431":{"gid":10431,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3052024414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3052024414},{"type":"v1","addr":"172.21.15.55:6837","nonce":3052024414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-06T22:20:08.987 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 79 2023-07-06T22:20:08.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.987+0000 7f513da34640 1 -- 172.21.15.55:0/3854687630 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f51240660d0 msgr2=0x7f5124068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.987+0000 7f513da34640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f51240660d0 0x7f5124068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f51280ad000 tx=0x7f51280a6000 comp rx=0 tx=0).stop 2023-07-06T22:20:08.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.987+0000 7f513da34640 1 -- 172.21.15.55:0/3854687630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51380b7cd0 msgr2=0x7f5138156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:08.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.987+0000 7f513da34640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51380b7cd0 0x7f5138156280 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f512c001ec0 tx=0x7f512c00c8e0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.987+0000 7f513da34640 1 -- 172.21.15.55:0/3854687630 shutdown_connections 2023-07-06T22:20:08.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.987+0000 7f513da34640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f51240660d0 0x7f5124068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.987+0000 7f513da34640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51380ccab0 0x7f51381567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.987+0000 7f513da34640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51380b7cd0 0x7f5138156280 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.987+0000 7f513da34640 1 --2- 172.21.15.55:0/3854687630 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f51380b1fe0 0x7f51381f45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:08.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.987+0000 7f513da34640 1 -- 172.21.15.55:0/3854687630 >> 172.21.15.55:0/3854687630 conn(0x7f51380ceee0 msgr2=0x7f5138158b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:08.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.987+0000 7f513da34640 1 -- 172.21.15.55:0/3854687630 shutdown_connections 2023-07-06T22:20:08.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:08.987+0000 7f513da34640 1 -- 172.21.15.55:0/3854687630 wait complete. 2023-07-06T22:20:09.008 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:20:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.147+0000 7f82cdf79640 1 Processor -- start 2023-07-06T22:20:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.147+0000 7f82cdf79640 1 -- start start 2023-07-06T22:20:09.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.147+0000 7f82cdf79640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f82c81450f0 0x7f82c80abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.151+0000 7f82cdf79640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c806ad30 con 0x7f82c815fa90 2023-07-06T22:20:09.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.151+0000 7f82cdf79640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c80b1d10 con 0x7f82c806b850 2023-07-06T22:20:09.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.151+0000 7f82cdf79640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c806aa50 con 0x7f82c81450f0 2023-07-06T22:20:09.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.151+0000 7f82cd778640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f82c815fa90 0x7f82c80b21a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54910/0 (socket says 172.21.15.55:54910) 2023-07-06T22:20:09.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.151+0000 7f82cd778640 1 -- 172.21.15.55:0/4034356106 learned_addr learned my addr 172.21.15.55:0/4034356106 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:09.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.151+0000 7f82ccf77640 1 --2- 172.21.15.55:0/4034356106 >> v2:172.21.15.138:3300/0 conn(0x7f82c81450f0 0x7f82c80abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:09.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.151+0000 7f82c77fe640 1 -- 172.21.15.55:0/4034356106 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063912802 0 0) 0x7f82c806ad30 con 0x7f82c815fa90 2023-07-06T22:20:09.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.151+0000 7f82c77fe640 1 -- 172.21.15.55:0/4034356106 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b8003530 con 0x7f82c815fa90 2023-07-06T22:20:09.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.151+0000 7f82c77fe640 1 -- 172.21.15.55:0/4034356106 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231162856 0 0) 0x7f82c80b1d10 con 0x7f82c806b850 2023-07-06T22:20:09.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.151+0000 7f82c77fe640 1 -- 172.21.15.55:0/4034356106 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82c806ad30 con 0x7f82c806b850 2023-07-06T22:20:09.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.151+0000 7f82ccf77640 1 -- 172.21.15.55:0/4034356106 >> v1:172.21.15.138:6789/0 conn(0x7f82c806b850 legacy=0x7f82c815f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.151+0000 7f82ccf77640 1 -- 172.21.15.55:0/4034356106 >> v1:172.21.15.55:6789/0 conn(0x7f82c815fa90 legacy=0x7f82c80b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.151+0000 7f82ccf77640 1 -- 172.21.15.55:0/4034356106 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c80b16c0 con 0x7f82c81450f0 2023-07-06T22:20:09.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.155+0000 7f82ccf77640 1 --2- 172.21.15.55:0/4034356106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c81450f0 0x7f82c80abaa0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0097c0 tx=0x7f82bc01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15d7ed674ee6ee7a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:09.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.155+0000 7f82c77fe640 1 -- 172.21.15.55:0/4034356106 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0ab600 con 0x7f82c81450f0 2023-07-06T22:20:09.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.155+0000 7f82c77fe640 1 -- 172.21.15.55:0/4034356106 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc0a7050 con 0x7f82c81450f0 2023-07-06T22:20:09.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.155+0000 7f82c77fe640 1 -- 172.21.15.55:0/4034356106 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0ab960 con 0x7f82c81450f0 2023-07-06T22:20:09.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.155+0000 7f82cdf79640 1 -- 172.21.15.55:0/4034356106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c81450f0 msgr2=0x7f82c80abaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.155+0000 7f82cdf79640 1 --2- 172.21.15.55:0/4034356106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c81450f0 0x7f82c80abaa0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0097c0 tx=0x7f82bc01c330 comp rx=0 tx=0).stop 2023-07-06T22:20:09.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.155+0000 7f82cdf79640 1 -- 172.21.15.55:0/4034356106 shutdown_connections 2023-07-06T22:20:09.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.155+0000 7f82cdf79640 1 --2- 172.21.15.55:0/4034356106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c81450f0 0x7f82c80abaa0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.155+0000 7f82cdf79640 1 -- 172.21.15.55:0/4034356106 >> 172.21.15.55:0/4034356106 conn(0x7f82c80ce600 msgr2=0x7f82c80ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:09.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.155+0000 7f82cdf79640 1 -- 172.21.15.55:0/4034356106 shutdown_connections 2023-07-06T22:20:09.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.155+0000 7f82cdf79640 1 -- 172.21.15.55:0/4034356106 wait complete. 2023-07-06T22:20:09.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.155+0000 7f82cdf79640 1 Processor -- start 2023-07-06T22:20:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.155+0000 7f82cdf79640 1 -- start start 2023-07-06T22:20:09.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cdf79640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82c806b850 0x7f82c81385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cdf79640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c81450f0 0x7f82c80cec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cdf79640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c815fa90 0x7f82c814e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cdf79640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8138c50 con 0x7f82c815fa90 2023-07-06T22:20:09.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cdf79640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c81376c0 con 0x7f82c81450f0 2023-07-06T22:20:09.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cdf79640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c81379a0 con 0x7f82c806b850 2023-07-06T22:20:09.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cd778640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c815fa90 0x7f82c814e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:09.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cd778640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c815fa90 0x7f82c814e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35590/0 (socket says 172.21.15.55:35590) 2023-07-06T22:20:09.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cd778640 1 -- 172.21.15.55:0/4238422916 learned_addr learned my addr 172.21.15.55:0/4238422916 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:09.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82ccf77640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82c806b850 0x7f82c81385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:09.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82c7fff640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c81450f0 0x7f82c80cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:09.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cd778640 1 -- 172.21.15.55:0/4238422916 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82c806b850 msgr2=0x7f82c81385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cd778640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82c806b850 0x7f82c81385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cd778640 1 -- 172.21.15.55:0/4238422916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c81450f0 msgr2=0x7f82c80cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cd778640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c81450f0 0x7f82c80cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cd778640 1 -- 172.21.15.55:0/4238422916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc009420 con 0x7f82c815fa90 2023-07-06T22:20:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82ccf77640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82c806b850 0x7f82c81385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cd778640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c815fa90 0x7f82c814e900 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f82c000caf0 tx=0x7f82c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82c57fa640 1 -- 172.21.15.55:0/4238422916 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c000aca0 con 0x7f82c815fa90 2023-07-06T22:20:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82c57fa640 1 -- 172.21.15.55:0/4238422916 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c000ae00 con 0x7f82c815fa90 2023-07-06T22:20:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82c57fa640 1 -- 172.21.15.55:0/4238422916 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0012620 con 0x7f82c815fa90 2023-07-06T22:20:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cdf79640 1 -- 172.21.15.55:0/4238422916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c8137c80 con 0x7f82c815fa90 2023-07-06T22:20:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cdf79640 1 -- 172.21.15.55:0/4238422916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c80cf170 con 0x7f82c815fa90 2023-07-06T22:20:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82cdf79640 1 -- 172.21.15.55:0/4238422916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c804d790 con 0x7f82c815fa90 2023-07-06T22:20:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.159+0000 7f82c57fa640 1 -- 172.21.15.55:0/4238422916 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 104) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f82c0007070 con 0x7f82c815fa90 2023-07-06T22:20:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.163+0000 7f82c57fa640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f82ac066100 0x7f82ac0685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.163+0000 7f82c57fa640 1 -- 172.21.15.55:0/4238422916 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 7212+0+0 (secure 0 0 0) 0x7f82c0083d90 con 0x7f82c815fa90 2023-07-06T22:20:09.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.163+0000 7f82ccf77640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f82ac066100 0x7f82ac0685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:09.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.163+0000 7f82ccf77640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f82ac066100 0x7f82ac0685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0ad000 tx=0x7f82bc0a6000 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:09.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.167+0000 7f82c57fa640 1 -- 172.21.15.55:0/4238422916 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82c00510b0 con 0x7f82c815fa90 2023-07-06T22:20:09.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.227+0000 7f82c57fa640 1 -- 172.21.15.55:0/4238422916 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f82c0051480 con 0x7f82c815fa90 2023-07-06T22:20:09.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.355+0000 7f82cdf79640 1 -- 172.21.15.55:0/4238422916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82c8159510 con 0x7f82c815fa90 2023-07-06T22:20:09.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.359+0000 7f82c57fa640 1 -- 172.21.15.55:0/4238422916 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f82c0071290 con 0x7f82c815fa90 2023-07-06T22:20:09.360 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:09.360 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8420,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/10830186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":10830186},{"type":"v1","addr":"172.21.15.138:6834","nonce":10830186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9577,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3623480690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3623480690},{"type":"v1","addr":"172.21.15.138:6835","nonce":3623480690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":10428,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2297427597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2297427597},{"type":"v1","addr":"172.21.15.55:6835","nonce":2297427597}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:18:40.592191+0000","modified":"2023-07-06T22:18:43.616817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10431":{"gid":10431,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6837/3052024414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3052024414},{"type":"v1","addr":"172.21.15.55:6837","nonce":3052024414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-06T22:20:09.361 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 79 2023-07-06T22:20:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.359+0000 7f82cdf79640 1 -- 172.21.15.55:0/4238422916 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f82ac066100 msgr2=0x7f82ac0685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.359+0000 7f82cdf79640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f82ac066100 0x7f82ac0685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0ad000 tx=0x7f82bc0a6000 comp rx=0 tx=0).stop 2023-07-06T22:20:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.359+0000 7f82cdf79640 1 -- 172.21.15.55:0/4238422916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c815fa90 msgr2=0x7f82c814e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.359+0000 7f82cdf79640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c815fa90 0x7f82c814e900 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f82c000caf0 tx=0x7f82c000a060 comp rx=0 tx=0).stop 2023-07-06T22:20:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.359+0000 7f82cdf79640 1 -- 172.21.15.55:0/4238422916 shutdown_connections 2023-07-06T22:20:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.359+0000 7f82cdf79640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f82ac066100 0x7f82ac0685b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.359+0000 7f82cdf79640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c815fa90 0x7f82c814e900 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.359+0000 7f82cdf79640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82c81450f0 0x7f82c80cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.359+0000 7f82cdf79640 1 --2- 172.21.15.55:0/4238422916 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82c806b850 0x7f82c81385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.359+0000 7f82cdf79640 1 -- 172.21.15.55:0/4238422916 >> 172.21.15.55:0/4238422916 conn(0x7f82c80ce600 msgr2=0x7f82c80aeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:09.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.359+0000 7f82cdf79640 1 -- 172.21.15.55:0/4238422916 shutdown_connections 2023-07-06T22:20:09.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.359+0000 7f82cdf79640 1 -- 172.21.15.55:0/4238422916 wait complete. 2023-07-06T22:20:09.381 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:20:09.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.519+0000 7f9c844f9640 1 Processor -- start 2023-07-06T22:20:09.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.519+0000 7f9c844f9640 1 -- start start 2023-07-06T22:20:09.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.523+0000 7f9c844f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9c7c158400 0x7f9c7c0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.523+0000 7f9c844f9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9c7c1587d0 0x7f9c7c0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.523+0000 7f9c844f9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7c06fae0 con 0x7f9c7c0c9680 2023-07-06T22:20:09.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.523+0000 7f9c844f9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7c06fdc0 con 0x7f9c7c158400 2023-07-06T22:20:09.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.523+0000 7f9c844f9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7c0700a0 con 0x7f9c7c1587d0 2023-07-06T22:20:09.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.523+0000 7f9c82295640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9c7c158400 0x7f9c7c0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:09.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.523+0000 7f9c82295640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9c7c158400 0x7f9c7c0c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35594/0 (socket says 172.21.15.55:35594) 2023-07-06T22:20:09.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.523+0000 7f9c82295640 1 -- 172.21.15.55:0/1855921913 learned_addr learned my addr 172.21.15.55:0/1855921913 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:09.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.523+0000 7f9c82a96640 1 --2- 172.21.15.55:0/1855921913 >> v2:172.21.15.138:3300/0 conn(0x7f9c7c1587d0 0x7f9c7c0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:09.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.523+0000 7f9c82295640 1 -- 172.21.15.55:0/1855921913 >> v2:172.21.15.138:3300/0 conn(0x7f9c7c1587d0 msgr2=0x7f9c7c0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:09.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.523+0000 7f9c82295640 1 --2- 172.21.15.55:0/1855921913 >> v2:172.21.15.138:3300/0 conn(0x7f9c7c1587d0 0x7f9c7c0cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.523+0000 7f9c82295640 1 -- 172.21.15.55:0/1855921913 >> v1:172.21.15.138:6789/0 conn(0x7f9c7c0c9680 legacy=0x7f9c7c070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:09.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.523+0000 7f9c82295640 1 -- 172.21.15.55:0/1855921913 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c070380 con 0x7f9c7c158400 2023-07-06T22:20:09.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.527+0000 7f9c82295640 1 --2- 172.21.15.55:0/1855921913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c7c158400 0x7f9c7c0c9140 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0ca290 tx=0x7f9c7801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eba2acbc5b77633 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:09.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.527+0000 7f9c81293640 1 -- 172.21.15.55:0/1855921913 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780ac640 con 0x7f9c7c158400 2023-07-06T22:20:09.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.527+0000 7f9c81293640 1 -- 172.21.15.55:0/1855921913 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c780ac7a0 con 0x7f9c7c158400 2023-07-06T22:20:09.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.527+0000 7f9c81293640 1 -- 172.21.15.55:0/1855921913 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780acb30 con 0x7f9c7c158400 2023-07-06T22:20:09.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.527+0000 7f9c844f9640 1 -- 172.21.15.55:0/1855921913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c7c158400 msgr2=0x7f9c7c0c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.527+0000 7f9c844f9640 1 --2- 172.21.15.55:0/1855921913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c7c158400 0x7f9c7c0c9140 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0ca290 tx=0x7f9c7801c400 comp rx=0 tx=0).stop 2023-07-06T22:20:09.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.527+0000 7f9c844f9640 1 -- 172.21.15.55:0/1855921913 shutdown_connections 2023-07-06T22:20:09.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.527+0000 7f9c844f9640 1 --2- 172.21.15.55:0/1855921913 >> v2:172.21.15.138:3300/0 conn(0x7f9c7c1587d0 0x7f9c7c0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.527+0000 7f9c844f9640 1 --2- 172.21.15.55:0/1855921913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c7c158400 0x7f9c7c0c9140 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.527+0000 7f9c844f9640 1 -- 172.21.15.55:0/1855921913 >> 172.21.15.55:0/1855921913 conn(0x7f9c7c0cded0 msgr2=0x7f9c7c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:09.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.527+0000 7f9c844f9640 1 -- 172.21.15.55:0/1855921913 shutdown_connections 2023-07-06T22:20:09.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.527+0000 7f9c844f9640 1 -- 172.21.15.55:0/1855921913 wait complete. 2023-07-06T22:20:09.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.527+0000 7f9c844f9640 1 Processor -- start 2023-07-06T22:20:09.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.527+0000 7f9c844f9640 1 -- start start 2023-07-06T22:20:09.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c844f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c7c0c9680 0x7f9c7c0c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c844f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c7c158400 0x7f9c7c0c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c844f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c7c1587d0 0x7f9c7c0b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c844f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0c5c80 con 0x7f9c7c158400 2023-07-06T22:20:09.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c844f9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0c5040 con 0x7f9c7c1587d0 2023-07-06T22:20:09.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c844f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0c52e0 con 0x7f9c7c0c9680 2023-07-06T22:20:09.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c81a94640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c7c158400 0x7f9c7c0c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:09.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c81a94640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c7c158400 0x7f9c7c0c6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35596/0 (socket says 172.21.15.55:35596) 2023-07-06T22:20:09.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c81a94640 1 -- 172.21.15.55:0/3237450780 learned_addr learned my addr 172.21.15.55:0/3237450780 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:09.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c81a94640 1 -- 172.21.15.55:0/3237450780 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c7c0c9680 msgr2=0x7f9c7c0c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c81a94640 1 --2- 172.21.15.55:0/3237450780 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c7c0c9680 0x7f9c7c0c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c81a94640 1 -- 172.21.15.55:0/3237450780 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c7c1587d0 msgr2=0x7f9c7c0b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c81a94640 1 --2- 172.21.15.55:0/3237450780 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c7c1587d0 0x7f9c7c0b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c81a94640 1 -- 172.21.15.55:0/3237450780 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c780094d0 con 0x7f9c7c158400 2023-07-06T22:20:09.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c81a94640 1 --2- 172.21.15.55:0/3237450780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c7c158400 0x7f9c7c0c6ce0 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00c410 tx=0x7f9c6c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:09.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c72ffd640 1 -- 172.21.15.55:0/3237450780 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c011790 con 0x7f9c7c158400 2023-07-06T22:20:09.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c72ffd640 1 -- 172.21.15.55:0/3237450780 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c0118f0 con 0x7f9c7c158400 2023-07-06T22:20:09.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c72ffd640 1 -- 172.21.15.55:0/3237450780 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c011ce0 con 0x7f9c7c158400 2023-07-06T22:20:09.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c844f9640 1 -- 172.21.15.55:0/3237450780 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c0c55c0 con 0x7f9c7c158400 2023-07-06T22:20:09.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c844f9640 1 -- 172.21.15.55:0/3237450780 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c0c7c60 con 0x7f9c7c158400 2023-07-06T22:20:09.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c844f9640 1 -- 172.21.15.55:0/3237450780 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7c06c580 con 0x7f9c7c158400 2023-07-06T22:20:09.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.531+0000 7f9c72ffd640 1 -- 172.21.15.55:0/3237450780 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9c6c01c460 con 0x7f9c7c158400 2023-07-06T22:20:09.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.535+0000 7f9c72ffd640 1 --2- 172.21.15.55:0/3237450780 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f9c600663a0 0x7f9c60068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.535+0000 7f9c72ffd640 1 -- 172.21.15.55:0/3237450780 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 7212+0+0 (secure 0 0 0) 0x7f9c6c084090 con 0x7f9c7c158400 2023-07-06T22:20:09.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.535+0000 7f9c82295640 1 --2- 172.21.15.55:0/3237450780 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f9c600663a0 0x7f9c60068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:09.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.535+0000 7f9c82295640 1 --2- 172.21.15.55:0/3237450780 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f9c600663a0 0x7f9c60068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9c780ae000 tx=0x7f9c78008040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:09.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.539+0000 7f9c72ffd640 1 -- 172.21.15.55:0/3237450780 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9c6c050f70 con 0x7f9c7c158400 2023-07-06T22:20:09.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.695+0000 7f9c844f9640 1 -- 172.21.15.55:0/3237450780 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c7c0c5dc0 con 0x7f9c7c158400 2023-07-06T22:20:09.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.695+0000 7f9c72ffd640 1 -- 172.21.15.55:0/3237450780 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+19776 (secure 0 0 0) 0x7f9c7c0c5dc0 con 0x7f9c7c158400 2023-07-06T22:20:09.699 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:09.699 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":183,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:20:07.174911+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:18:38.520955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-07-06T22:18:39.591879+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":182,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/251532788":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/4267103658":"2023-07-07T22:20:07.174864+0000","172.21.15.55:6833/628169602":"2023-07-07T22:20:07.174864+0000","172.21.15.55:6832/628169602":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/3238640476":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/1991294440":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/3074416439":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/3954362142":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/3285408268":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/1793501954":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/455359735":"2023-07-07T22:18:57.087673+0000","172.21.15.55:6833/957337795":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/2168505984":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/3159272832":"2023-07-07T22:18:57.087673+0000","172.21.15.55:6832/957337795":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/748095594":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/4040799024":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/56444713":"2023-07-07T22:18:57.087673+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:20:09.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.699+0000 7f9c844f9640 1 -- 172.21.15.55:0/3237450780 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f9c600663a0 msgr2=0x7f9c60068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.699+0000 7f9c844f9640 1 --2- 172.21.15.55:0/3237450780 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f9c600663a0 0x7f9c60068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9c780ae000 tx=0x7f9c78008040 comp rx=0 tx=0).stop 2023-07-06T22:20:09.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.699+0000 7f9c844f9640 1 -- 172.21.15.55:0/3237450780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c7c158400 msgr2=0x7f9c7c0c6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.699+0000 7f9c844f9640 1 --2- 172.21.15.55:0/3237450780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c7c158400 0x7f9c7c0c6ce0 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00c410 tx=0x7f9c6c00c8d0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.699+0000 7f9c844f9640 1 -- 172.21.15.55:0/3237450780 shutdown_connections 2023-07-06T22:20:09.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.699+0000 7f9c844f9640 1 --2- 172.21.15.55:0/3237450780 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f9c600663a0 0x7f9c60068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.699+0000 7f9c844f9640 1 --2- 172.21.15.55:0/3237450780 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c7c1587d0 0x7f9c7c0b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.699+0000 7f9c844f9640 1 --2- 172.21.15.55:0/3237450780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c7c158400 0x7f9c7c0c6ce0 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.699+0000 7f9c844f9640 1 --2- 172.21.15.55:0/3237450780 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c7c0c9680 0x7f9c7c0c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.699+0000 7f9c844f9640 1 -- 172.21.15.55:0/3237450780 >> 172.21.15.55:0/3237450780 conn(0x7f9c7c0cded0 msgr2=0x7f9c7c157260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:09.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.699+0000 7f9c844f9640 1 -- 172.21.15.55:0/3237450780 shutdown_connections 2023-07-06T22:20:09.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.699+0000 7f9c844f9640 1 -- 172.21.15.55:0/3237450780 wait complete. 2023-07-06T22:20:09.720 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T22:20:09.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.859+0000 7f1078fd2640 1 Processor -- start 2023-07-06T22:20:09.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.863+0000 7f1078fd2640 1 -- start start 2023-07-06T22:20:09.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.863+0000 7f1078fd2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f10740709a0 0x7f10740cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.863+0000 7f1078fd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10740cc300 con 0x7f10740b1340 2023-07-06T22:20:09.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.863+0000 7f1078fd2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10740cc5e0 con 0x7f10740cbe60 2023-07-06T22:20:09.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.863+0000 7f1078fd2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10740cc8c0 con 0x7f10740709a0 2023-07-06T22:20:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.863+0000 7f1072d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f10740b1340 0x7f107406eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54920/0 (socket says 172.21.15.55:54920) 2023-07-06T22:20:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.863+0000 7f1072d9d640 1 -- 172.21.15.55:0/4291131874 learned_addr learned my addr 172.21.15.55:0/4291131874 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.863+0000 7f107259c640 1 --2- 172.21.15.55:0/4291131874 >> v2:172.21.15.138:3300/0 conn(0x7f10740709a0 0x7f10740cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.863+0000 7f1071d9b640 1 -- 172.21.15.55:0/4291131874 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402843898 0 0) 0x7f10740cc300 con 0x7f10740b1340 2023-07-06T22:20:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.863+0000 7f1071d9b640 1 -- 172.21.15.55:0/4291131874 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1060003530 con 0x7f10740b1340 2023-07-06T22:20:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.863+0000 7f107259c640 1 -- 172.21.15.55:0/4291131874 >> v1:172.21.15.138:6789/0 conn(0x7f10740cbe60 legacy=0x7f10740b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.863+0000 7f107259c640 1 -- 172.21.15.55:0/4291131874 >> v1:172.21.15.55:6789/0 conn(0x7f10740b1340 legacy=0x7f107406eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.863+0000 7f107259c640 1 -- 172.21.15.55:0/4291131874 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10740ccba0 con 0x7f10740709a0 2023-07-06T22:20:09.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.867+0000 7f107259c640 1 --2- 172.21.15.55:0/4291131874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740709a0 0x7f10740cb920 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f10640097c0 tx=0x7f106401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f27eef5d10547d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:09.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.867+0000 7f1071d9b640 1 -- 172.21.15.55:0/4291131874 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10640a8050 con 0x7f10740709a0 2023-07-06T22:20:09.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.867+0000 7f1071d9b640 1 -- 172.21.15.55:0/4291131874 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10640ac5f0 con 0x7f10740709a0 2023-07-06T22:20:09.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.867+0000 7f1071d9b640 1 -- 172.21.15.55:0/4291131874 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10640ac980 con 0x7f10740709a0 2023-07-06T22:20:09.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.867+0000 7f1078fd2640 1 -- 172.21.15.55:0/4291131874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740709a0 msgr2=0x7f10740cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.867+0000 7f1078fd2640 1 --2- 172.21.15.55:0/4291131874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740709a0 0x7f10740cb920 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f10640097c0 tx=0x7f106401c480 comp rx=0 tx=0).stop 2023-07-06T22:20:09.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.867+0000 7f1078fd2640 1 -- 172.21.15.55:0/4291131874 shutdown_connections 2023-07-06T22:20:09.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.867+0000 7f1078fd2640 1 --2- 172.21.15.55:0/4291131874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740709a0 0x7f10740cb920 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.867+0000 7f1078fd2640 1 -- 172.21.15.55:0/4291131874 >> 172.21.15.55:0/4291131874 conn(0x7f10740cea70 msgr2=0x7f10740ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:09.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.867+0000 7f1078fd2640 1 -- 172.21.15.55:0/4291131874 shutdown_connections 2023-07-06T22:20:09.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.867+0000 7f1078fd2640 1 -- 172.21.15.55:0/4291131874 wait complete. 2023-07-06T22:20:09.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1078fd2640 1 Processor -- start 2023-07-06T22:20:09.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1078fd2640 1 -- start start 2023-07-06T22:20:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1078fd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740709a0 0x7f107415a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1078fd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10740b1340 0x7f107406a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1078fd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10740cbe60 0x7f10741630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1078fd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107406abe0 con 0x7f10740cbe60 2023-07-06T22:20:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1078fd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107406aec0 con 0x7f10740709a0 2023-07-06T22:20:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1078fd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107406b1a0 con 0x7f10740b1340 2023-07-06T22:20:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1072d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10740cbe60 0x7f10741630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1072d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10740cbe60 0x7f10741630f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35610/0 (socket says 172.21.15.55:35610) 2023-07-06T22:20:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1072d9d640 1 -- 172.21.15.55:0/3479238592 learned_addr learned my addr 172.21.15.55:0/3479238592 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f107259c640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740709a0 0x7f107415a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f106bfff640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10740b1340 0x7f107406a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1072d9d640 1 -- 172.21.15.55:0/3479238592 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10740b1340 msgr2=0x7f107406a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1072d9d640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10740b1340 0x7f107406a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1072d9d640 1 -- 172.21.15.55:0/3479238592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740709a0 msgr2=0x7f107415a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1072d9d640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740709a0 0x7f107415a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1072d9d640 1 -- 172.21.15.55:0/3479238592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1064009420 con 0x7f10740cbe60 2023-07-06T22:20:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f107259c640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740709a0 0x7f107415a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1072d9d640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10740cbe60 0x7f10741630f0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f106c00cbb0 tx=0x7f106c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f106affd640 1 -- 172.21.15.55:0/3479238592 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c00ad40 con 0x7f10740cbe60 2023-07-06T22:20:09.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f106affd640 1 -- 172.21.15.55:0/3479238592 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c012400 con 0x7f10740cbe60 2023-07-06T22:20:09.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f106affd640 1 -- 172.21.15.55:0/3479238592 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c00aea0 con 0x7f10740cbe60 2023-07-06T22:20:09.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1078fd2640 1 -- 172.21.15.55:0/3479238592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107406b480 con 0x7f10740cbe60 2023-07-06T22:20:09.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1078fd2640 1 -- 172.21.15.55:0/3479238592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107415a580 con 0x7f10740cbe60 2023-07-06T22:20:09.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.871+0000 7f1078fd2640 1 -- 172.21.15.55:0/3479238592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10740c4e20 con 0x7f10740cbe60 2023-07-06T22:20:09.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.875+0000 7f106affd640 1 -- 172.21.15.55:0/3479238592 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f106c007070 con 0x7f10740cbe60 2023-07-06T22:20:09.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.875+0000 7f106affd640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f10540663a0 0x7f1054068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:09.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.875+0000 7f106affd640 1 -- 172.21.15.55:0/3479238592 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 7212+0+0 (secure 0 0 0) 0x7f106c084200 con 0x7f10740cbe60 2023-07-06T22:20:09.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.875+0000 7f107259c640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f10540663a0 0x7f1054068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:09.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.875+0000 7f107259c640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f10540663a0 0x7f1054068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f10640ae000 tx=0x7f10640a7000 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:09.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:09.879+0000 7f106affd640 1 -- 172.21.15.55:0/3479238592 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f10740c4e20 con 0x7f10740cbe60 2023-07-06T22:20:10.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.067+0000 7f1078fd2640 1 -- 172.21.15.55:0/3479238592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f10740c4e20 con 0x7f10740cbe60 2023-07-06T22:20:10.219 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-07-06T22:20:10.215+0000 7f5b6d80c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T22:20:10.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.219+0000 7f106affd640 1 -- 172.21.15.55:0/3479238592 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v80) v1 ==== 161+0+0 (secure 0 0 0) 0x7f10740c4e20 con 0x7f10740cbe60 2023-07-06T22:20:10.223 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T22:20:10.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.223+0000 7f1078fd2640 1 -- 172.21.15.55:0/3479238592 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f10540663a0 msgr2=0x7f1054068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.223+0000 7f1078fd2640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f10540663a0 0x7f1054068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f10640ae000 tx=0x7f10640a7000 comp rx=0 tx=0).stop 2023-07-06T22:20:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.223+0000 7f1078fd2640 1 -- 172.21.15.55:0/3479238592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10740cbe60 msgr2=0x7f10741630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.223+0000 7f1078fd2640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10740cbe60 0x7f10741630f0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f106c00cbb0 tx=0x7f106c00a430 comp rx=0 tx=0).stop 2023-07-06T22:20:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.223+0000 7f1078fd2640 1 -- 172.21.15.55:0/3479238592 shutdown_connections 2023-07-06T22:20:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.223+0000 7f1078fd2640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f10540663a0 0x7f1054068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.223+0000 7f1078fd2640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10740cbe60 0x7f10741630f0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.223+0000 7f1078fd2640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f10740b1340 0x7f107406a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:10.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.223+0000 7f1078fd2640 1 --2- 172.21.15.55:0/3479238592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10740709a0 0x7f107415a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:10.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.223+0000 7f1078fd2640 1 -- 172.21.15.55:0/3479238592 >> 172.21.15.55:0/3479238592 conn(0x7f10740cea70 msgr2=0x7f10740b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:10.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.223+0000 7f1078fd2640 1 -- 172.21.15.55:0/3479238592 shutdown_connections 2023-07-06T22:20:10.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.223+0000 7f1078fd2640 1 -- 172.21.15.55:0/3479238592 wait complete. 2023-07-06T22:20:10.246 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T22:20:10.289 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T22:20:10.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb84cecb640 1 Processor -- start 2023-07-06T22:20:10.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb84cecb640 1 -- start start 2023-07-06T22:20:10.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb84cecb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8480709a0 0x7fb8480cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:10.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb84cecb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8480cbe60 0x7fb8480b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:10.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb84cecb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8480cc300 con 0x7fb848070d70 2023-07-06T22:20:10.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb84cecb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8480cc5e0 con 0x7fb8480709a0 2023-07-06T22:20:10.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb84cecb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480cc8c0 con 0x7fb8480cbe60 2023-07-06T22:20:10.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb84659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8480709a0 0x7fb8480cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:10.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb84659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8480709a0 0x7fb8480cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35648/0 (socket says 172.21.15.55:35648) 2023-07-06T22:20:10.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb84659c640 1 -- 172.21.15.55:0/1134781989 learned_addr learned my addr 172.21.15.55:0/1134781989 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:10.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb845d9b640 1 --2- 172.21.15.55:0/1134781989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8480cbe60 0x7fb8480b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:10.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb84659c640 1 -- 172.21.15.55:0/1134781989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8480cbe60 msgr2=0x7fb8480b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:10.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb84659c640 1 --2- 172.21.15.55:0/1134781989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8480cbe60 0x7fb8480b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:10.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb84659c640 1 -- 172.21.15.55:0/1134781989 >> v1:172.21.15.138:6789/0 conn(0x7fb848070d70 legacy=0x7fb84815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:10.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb84659c640 1 -- 172.21.15.55:0/1134781989 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8480ccba0 con 0x7fb8480709a0 2023-07-06T22:20:10.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.395+0000 7fb845d9b640 1 --2- 172.21.15.55:0/1134781989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8480cbe60 0x7fb8480b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:10.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.399+0000 7fb84659c640 1 --2- 172.21.15.55:0/1134781989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8480709a0 0x7fb8480cb920 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7fb838009870 tx=0x7fb83801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35d27a064380f9a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:10.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.399+0000 7fb84559a640 1 -- 172.21.15.55:0/1134781989 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380ab600 con 0x7fb8480709a0 2023-07-06T22:20:10.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.399+0000 7fb84559a640 1 -- 172.21.15.55:0/1134781989 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8380a7050 con 0x7fb8480709a0 2023-07-06T22:20:10.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.399+0000 7fb84559a640 1 -- 172.21.15.55:0/1134781989 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380ab980 con 0x7fb8480709a0 2023-07-06T22:20:10.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.399+0000 7fb84cecb640 1 -- 172.21.15.55:0/1134781989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8480709a0 msgr2=0x7fb8480cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:10.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.399+0000 7fb84cecb640 1 --2- 172.21.15.55:0/1134781989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8480709a0 0x7fb8480cb920 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7fb838009870 tx=0x7fb83801c540 comp rx=0 tx=0).stop 2023-07-06T22:20:10.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.399+0000 7fb84cecb640 1 -- 172.21.15.55:0/1134781989 shutdown_connections 2023-07-06T22:20:10.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.399+0000 7fb84cecb640 1 --2- 172.21.15.55:0/1134781989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb8480cbe60 0x7fb8480b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:10.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.399+0000 7fb84cecb640 1 --2- 172.21.15.55:0/1134781989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8480709a0 0x7fb8480cb920 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:10.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.399+0000 7fb84cecb640 1 -- 172.21.15.55:0/1134781989 >> 172.21.15.55:0/1134781989 conn(0x7fb8480cea70 msgr2=0x7fb8480ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:10.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.399+0000 7fb84cecb640 1 -- 172.21.15.55:0/1134781989 shutdown_connections 2023-07-06T22:20:10.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.399+0000 7fb84cecb640 1 -- 172.21.15.55:0/1134781989 wait complete. 2023-07-06T22:20:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84cecb640 1 Processor -- start 2023-07-06T22:20:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84cecb640 1 -- start start 2023-07-06T22:20:10.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84cecb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8480709a0 0x7fb84815b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:10.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84cecb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb848070d70 0x7fb8480989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:10.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84cecb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8480cbe60 0x7fb84809c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:10.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84cecb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84815bb90 con 0x7fb8480709a0 2023-07-06T22:20:10.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84cecb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb848099240 con 0x7fb8480cbe60 2023-07-06T22:20:10.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84cecb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb848099520 con 0x7fb848070d70 2023-07-06T22:20:10.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8480709a0 0x7fb84815b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:10.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8480709a0 0x7fb84815b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35658/0 (socket says 172.21.15.55:35658) 2023-07-06T22:20:10.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84659c640 1 -- 172.21.15.55:0/4001647724 learned_addr learned my addr 172.21.15.55:0/4001647724 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:10.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb845d9b640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb848070d70 0x7fb8480989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:10.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb846d9d640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8480cbe60 0x7fb84809c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:10.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84659c640 1 -- 172.21.15.55:0/4001647724 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb848070d70 msgr2=0x7fb8480989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:10.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84659c640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb848070d70 0x7fb8480989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84659c640 1 -- 172.21.15.55:0/4001647724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8480cbe60 msgr2=0x7fb84809c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84659c640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8480cbe60 0x7fb84809c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84659c640 1 -- 172.21.15.55:0/4001647724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8380094d0 con 0x7fb8480709a0 2023-07-06T22:20:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb846d9d640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8480cbe60 0x7fb84809c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84659c640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8480709a0 0x7fb84815b650 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7fb83801abf0 tx=0x7fb8380192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb836ffd640 1 -- 172.21.15.55:0/4001647724 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380b6640 con 0x7fb8480709a0 2023-07-06T22:20:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb836ffd640 1 -- 172.21.15.55:0/4001647724 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8380b67c0 con 0x7fb8480709a0 2023-07-06T22:20:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84cecb640 1 -- 172.21.15.55:0/4001647724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb848099800 con 0x7fb8480709a0 2023-07-06T22:20:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb836ffd640 1 -- 172.21.15.55:0/4001647724 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380b6b70 con 0x7fb8480709a0 2023-07-06T22:20:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84cecb640 1 -- 172.21.15.55:0/4001647724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb848099dc0 con 0x7fb8480709a0 2023-07-06T22:20:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.403+0000 7fb84cecb640 1 -- 172.21.15.55:0/4001647724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb848099fb0 con 0x7fb8480709a0 2023-07-06T22:20:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.407+0000 7fb836ffd640 1 -- 172.21.15.55:0/4001647724 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb8380b2040 con 0x7fb8480709a0 2023-07-06T22:20:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.407+0000 7fb836ffd640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb8280663a0 0x7fb828068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.407+0000 7fb836ffd640 1 -- 172.21.15.55:0/4001647724 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 7298+0+0 (secure 0 0 0) 0x7fb83811dc40 con 0x7fb8480709a0 2023-07-06T22:20:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.407+0000 7fb845d9b640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb8280663a0 0x7fb828068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.407+0000 7fb845d9b640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb8280663a0 0x7fb828068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb8480c9ab0 tx=0x7fb83c008040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.411+0000 7fb836ffd640 1 -- 172.21.15.55:0/4001647724 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb8380eaa30 con 0x7fb8480709a0 2023-07-06T22:20:10.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:10.599+0000 7fb84cecb640 1 -- 172.21.15.55:0/4001647724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb848066d60 con 0x7fb8480709a0 2023-07-06T22:20:11.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.235+0000 7fb836ffd640 1 -- 172.21.15.55:0/4001647724 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v81) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb8380ee050 con 0x7fb8480709a0 2023-07-06T22:20:11.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.239+0000 7fb84cecb640 1 -- 172.21.15.55:0/4001647724 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb8280663a0 msgr2=0x7fb828068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:11.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.239+0000 7fb84cecb640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb8280663a0 0x7fb828068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb8480c9ab0 tx=0x7fb83c008040 comp rx=0 tx=0).stop 2023-07-06T22:20:11.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.239+0000 7fb84cecb640 1 -- 172.21.15.55:0/4001647724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8480709a0 msgr2=0x7fb84815b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:11.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.239+0000 7fb84cecb640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8480709a0 0x7fb84815b650 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7fb83801abf0 tx=0x7fb8380192e0 comp rx=0 tx=0).stop 2023-07-06T22:20:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.239+0000 7fb84cecb640 1 -- 172.21.15.55:0/4001647724 shutdown_connections 2023-07-06T22:20:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.239+0000 7fb84cecb640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb8280663a0 0x7fb828068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.239+0000 7fb84cecb640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8480cbe60 0x7fb84809c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.239+0000 7fb84cecb640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb848070d70 0x7fb8480989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.239+0000 7fb84cecb640 1 --2- 172.21.15.55:0/4001647724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8480709a0 0x7fb84815b650 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.239+0000 7fb84cecb640 1 -- 172.21.15.55:0/4001647724 >> 172.21.15.55:0/4001647724 conn(0x7fb8480cea70 msgr2=0x7fb8480ca7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.239+0000 7fb84cecb640 1 -- 172.21.15.55:0/4001647724 shutdown_connections 2023-07-06T22:20:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.239+0000 7fb84cecb640 1 -- 172.21.15.55:0/4001647724 wait complete. 2023-07-06T22:20:11.261 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T22:20:11.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.447+0000 7fedf0e9c640 1 Processor -- start 2023-07-06T22:20:11.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.447+0000 7fedf0e9c640 1 -- start start 2023-07-06T22:20:11.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fedf0e9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c89b0 0x7fedec0c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:11.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fedf0e9c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedec158b50 con 0x7fedec0cbfa0 2023-07-06T22:20:11.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fedf0e9c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedec06fb00 con 0x7fedec158780 2023-07-06T22:20:11.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fedf0e9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0c9370 con 0x7fedec0c89b0 2023-07-06T22:20:11.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede9d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fedec0cbfa0 0x7fedec06f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54936/0 (socket says 172.21.15.55:54936) 2023-07-06T22:20:11.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede9d9b640 1 -- 172.21.15.55:0/857284445 learned_addr learned my addr 172.21.15.55:0/857284445 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fedead9d640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c89b0 0x7fedec0c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 -- 172.21.15.55:0/857284445 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417882103 0 0) 0x7fedec158b50 con 0x7fedec0cbfa0 2023-07-06T22:20:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 -- 172.21.15.55:0/857284445 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedd4003530 con 0x7fedec0cbfa0 2023-07-06T22:20:11.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 -- 172.21.15.55:0/857284445 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 941144273 0 0) 0x7fedd4003530 con 0x7fedec0cbfa0 2023-07-06T22:20:11.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 -- 172.21.15.55:0/857284445 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c89b0 msgr2=0x7fedec0c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:11.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c89b0 0x7fedec0c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:11.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 -- 172.21.15.55:0/857284445 >> v1:172.21.15.138:6789/0 conn(0x7fedec158780 legacy=0x7fedec0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:11.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 -- 172.21.15.55:0/857284445 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec06b390 con 0x7fedec0cbfa0 2023-07-06T22:20:11.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 -- 172.21.15.55:0/857284445 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fede0001680 con 0x7fedec0cbfa0 2023-07-06T22:20:11.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 -- 172.21.15.55:0/857284445 >> v1:172.21.15.55:6789/0 conn(0x7fedec0cbfa0 legacy=0x7fedec06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:11.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd40039b0 0x7fedd4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:11.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd4004350 0x7fedd4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:11.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c89b0 0x7fedd4005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:11.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 -- 172.21.15.55:0/857284445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0c9370 con 0x7fedd40039b0 2023-07-06T22:20:11.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 -- 172.21.15.55:0/857284445 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd400dc50 con 0x7fedd4004350 2023-07-06T22:20:11.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede959a640 1 -- 172.21.15.55:0/857284445 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd400dde0 con 0x7fedec0c89b0 2023-07-06T22:20:11.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fedea59c640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd40039b0 0x7fedd4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:11.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede9d9b640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd4004350 0x7fedd4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fedead9d640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c89b0 0x7fedd4005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fedea59c640 1 -- 172.21.15.55:0/857284445 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c89b0 msgr2=0x7fedd4005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fedea59c640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c89b0 0x7fedd4005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fedea59c640 1 -- 172.21.15.55:0/857284445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd4004350 msgr2=0x7fedd4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fedea59c640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd4004350 0x7fedd4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fedea59c640 1 -- 172.21.15.55:0/857284445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd4003530 con 0x7fedd40039b0 2023-07-06T22:20:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fede9d9b640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd4004350 0x7fedd4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:11.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.451+0000 7fedead9d640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c89b0 0x7fedd4005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:11.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.455+0000 7fedea59c640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd40039b0 0x7fedd4003d80 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7feddc001880 tx=0x7feddc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a819361bfdfcb1b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:11.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.455+0000 7fede959a640 1 -- 172.21.15.55:0/857284445 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc0ab600 con 0x7fedd40039b0 2023-07-06T22:20:11.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.455+0000 7fede959a640 1 -- 172.21.15.55:0/857284445 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc0a7050 con 0x7fedd40039b0 2023-07-06T22:20:11.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.455+0000 7fede959a640 1 -- 172.21.15.55:0/857284445 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc0ab9a0 con 0x7fedd40039b0 2023-07-06T22:20:11.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.455+0000 7fedf0e9c640 1 -- 172.21.15.55:0/857284445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd40039b0 msgr2=0x7fedd4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:11.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.455+0000 7fedf0e9c640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedd40039b0 0x7fedd4003d80 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7feddc001880 tx=0x7feddc01c4e0 comp rx=0 tx=0).stop 2023-07-06T22:20:11.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.455+0000 7fedead9d640 1 -- 172.21.15.55:0/857284445 reap_dead start 2023-07-06T22:20:11.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.455+0000 7fedf0e9c640 1 -- 172.21.15.55:0/857284445 shutdown_connections 2023-07-06T22:20:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.455+0000 7fedf0e9c640 1 -- 172.21.15.55:0/857284445 >> 172.21.15.55:0/857284445 conn(0x7fedec0cde30 msgr2=0x7fedec0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.455+0000 7fedf0e9c640 1 -- 172.21.15.55:0/857284445 shutdown_connections 2023-07-06T22:20:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.455+0000 7fedf0e9c640 1 -- 172.21.15.55:0/857284445 wait complete. 2023-07-06T22:20:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.455+0000 7fedf0e9c640 1 Processor -- start 2023-07-06T22:20:11.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.455+0000 7fedf0e9c640 1 -- start start 2023-07-06T22:20:11.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fedf0e9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd40039b0 0x7fedec158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:11.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fedf0e9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedec1516e0 0x7fedec159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:11.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fedf0e9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec14b220 0x7fedec1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:11.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fedf0e9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec15b220 con 0x7fedec1516e0 2023-07-06T22:20:11.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fedf0e9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec15ac60 con 0x7fedd40039b0 2023-07-06T22:20:11.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fedf0e9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec15af40 con 0x7fedec14b220 2023-07-06T22:20:11.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fede9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedec1516e0 0x7fedec159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:11.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fede9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedec1516e0 0x7fedec159090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35678/0 (socket says 172.21.15.55:35678) 2023-07-06T22:20:11.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fede9d9b640 1 -- 172.21.15.55:0/3695737801 learned_addr learned my addr 172.21.15.55:0/3695737801 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:11.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fedea59c640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd40039b0 0x7fedec158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:11.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fede9d9b640 1 -- 172.21.15.55:0/3695737801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec14b220 msgr2=0x7fedec1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:11.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fedead9d640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec14b220 0x7fedec1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:11.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fede9d9b640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec14b220 0x7fedec1595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:11.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fede9d9b640 1 -- 172.21.15.55:0/3695737801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd40039b0 msgr2=0x7fedec158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:11.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fede9d9b640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd40039b0 0x7fedec158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:11.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fede9d9b640 1 -- 172.21.15.55:0/3695737801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec0b23b0 con 0x7fedec1516e0 2023-07-06T22:20:11.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fedea59c640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd40039b0 0x7fedec158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:11.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fedead9d640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec14b220 0x7fedec1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:11.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fede9d9b640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedec1516e0 0x7fedec159090 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7fede000e7b0 tx=0x7fede000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:11.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7feddaffd640 1 -- 172.21.15.55:0/3695737801 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede000c6c0 con 0x7fedec1516e0 2023-07-06T22:20:11.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7feddaffd640 1 -- 172.21.15.55:0/3695737801 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede000c820 con 0x7fedec1516e0 2023-07-06T22:20:11.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7feddaffd640 1 -- 172.21.15.55:0/3695737801 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede000cbb0 con 0x7fedec1516e0 2023-07-06T22:20:11.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fedf0e9c640 1 -- 172.21.15.55:0/3695737801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec0b2690 con 0x7fedec1516e0 2023-07-06T22:20:11.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fedf0e9c640 1 -- 172.21.15.55:0/3695737801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedec15a810 con 0x7fedec1516e0 2023-07-06T22:20:11.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7fedf0e9c640 1 -- 172.21.15.55:0/3695737801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedec15aa30 con 0x7fedec1516e0 2023-07-06T22:20:11.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.459+0000 7feddaffd640 1 -- 172.21.15.55:0/3695737801 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fede000cd10 con 0x7fedec1516e0 2023-07-06T22:20:11.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.463+0000 7feddaffd640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fedcc0663d0 0x7fedcc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:11.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.463+0000 7feddaffd640 1 -- 172.21.15.55:0/3695737801 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 7298+0+0 (secure 0 0 0) 0x7fede0084230 con 0x7fedec1516e0 2023-07-06T22:20:11.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.463+0000 7fedea59c640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fedcc0663d0 0x7fedcc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:11.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.463+0000 7fedea59c640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fedcc0663d0 0x7fedcc068880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feddc0ad000 tx=0x7feddc0a6000 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:11.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.467+0000 7feddaffd640 1 -- 172.21.15.55:0/3695737801 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fede0051020 con 0x7fedec1516e0 2023-07-06T22:20:11.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:11.619+0000 7fedf0e9c640 1 -- 172.21.15.55:0/3695737801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fedec066d60 con 0x7fedec1516e0 2023-07-06T22:20:11.825 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:20:11.830 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:20:12.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.243+0000 7feddaffd640 1 -- 172.21.15.55:0/3695737801 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v186) v1 ==== 181+0+0 (secure 0 0 0) 0x7fede0054640 con 0x7fedec1516e0 2023-07-06T22:20:12.247 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-07-06T22:20:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.247+0000 7fedf0e9c640 1 -- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fedcc0663d0 msgr2=0x7fedcc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.247+0000 7fedf0e9c640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fedcc0663d0 0x7fedcc068880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feddc0ad000 tx=0x7feddc0a6000 comp rx=0 tx=0).stop 2023-07-06T22:20:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.247+0000 7fedf0e9c640 1 -- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedec1516e0 msgr2=0x7fedec159090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.247+0000 7fedf0e9c640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedec1516e0 0x7fedec159090 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7fede000e7b0 tx=0x7fede000ec70 comp rx=0 tx=0).stop 2023-07-06T22:20:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.247+0000 7fedf0e9c640 1 -- 172.21.15.55:0/3695737801 shutdown_connections 2023-07-06T22:20:12.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.247+0000 7fedf0e9c640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fedcc0663d0 0x7fedcc068880 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:12.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.247+0000 7fedf0e9c640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec14b220 0x7fedec1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.247+0000 7fedf0e9c640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedec1516e0 0x7fedec159090 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.247+0000 7fedf0e9c640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedd40039b0 0x7fedec158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:12.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.247+0000 7fedf0e9c640 1 -- 172.21.15.55:0/3695737801 >> 172.21.15.55:0/3695737801 conn(0x7fedec0cde30 msgr2=0x7fedec0ca8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:12.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.247+0000 7fedf0e9c640 1 -- 172.21.15.55:0/3695737801 shutdown_connections 2023-07-06T22:20:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.247+0000 7fedf0e9c640 1 -- 172.21.15.55:0/3695737801 wait complete. 2023-07-06T22:20:12.272 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T22:20:12.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0f896640 1 Processor -- start 2023-07-06T22:20:12.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0f896640 1 -- start start 2023-07-06T22:20:12.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0f896640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5d0815ff90 0x7f5d080cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:12.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0f896640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d08070ab0 0x7f5d080cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:12.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0f896640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d080ca720 con 0x7f5d080cc730 2023-07-06T22:20:12.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0f896640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d08160360 con 0x7f5d0815ff90 2023-07-06T22:20:12.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0f896640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d080cba00 con 0x7f5d08070ab0 2023-07-06T22:20:12.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0de33640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d08070ab0 0x7f5d080cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:12.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0d632640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5d0815ff90 0x7f5d080cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:12.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0de33640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d08070ab0 0x7f5d080cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:44512/0 (socket says 172.21.15.55:44512) 2023-07-06T22:20:12.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0de33640 1 -- 172.21.15.55:0/3684648839 learned_addr learned my addr 172.21.15.55:0/3684648839 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:12.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0ce31640 1 --1- 172.21.15.55:0/3684648839 >> v1:172.21.15.138:6789/0 conn(0x7f5d080cc730 0x7f5d080c0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:57876/0 (socket says 172.21.15.55:57876) 2023-07-06T22:20:12.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5cfffff640 1 -- 172.21.15.55:0/3684648839 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465366214 0 0) 0x7f5d080ca720 con 0x7f5d080cc730 2023-07-06T22:20:12.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5cfffff640 1 -- 172.21.15.55:0/3684648839 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cf4003530 con 0x7f5d080cc730 2023-07-06T22:20:12.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0de33640 1 -- 172.21.15.55:0/3684648839 >> v2:172.21.15.138:3300/0 conn(0x7f5d0815ff90 msgr2=0x7f5d080cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:12.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0de33640 1 --2- 172.21.15.55:0/3684648839 >> v2:172.21.15.138:3300/0 conn(0x7f5d0815ff90 0x7f5d080cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:12.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0de33640 1 -- 172.21.15.55:0/3684648839 >> v1:172.21.15.138:6789/0 conn(0x7f5d080cc730 legacy=0x7f5d080c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:12.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0de33640 1 -- 172.21.15.55:0/3684648839 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0806d160 con 0x7f5d08070ab0 2023-07-06T22:20:12.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.419+0000 7f5d0d632640 1 --2- 172.21.15.55:0/3684648839 >> v2:172.21.15.138:3300/0 conn(0x7f5d0815ff90 0x7f5d080cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:12.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.423+0000 7f5d0de33640 1 --2- 172.21.15.55:0/3684648839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d08070ab0 0x7f5d080cd740 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009e50 tx=0x7f5d0001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a50e538d0ae80441 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:12.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.423+0000 7f5cfffff640 1 -- 172.21.15.55:0/3684648839 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d000a5810 con 0x7f5d08070ab0 2023-07-06T22:20:12.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.423+0000 7f5cfffff640 1 -- 172.21.15.55:0/3684648839 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d000a5970 con 0x7f5d08070ab0 2023-07-06T22:20:12.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.423+0000 7f5cfffff640 1 -- 172.21.15.55:0/3684648839 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d000a5d00 con 0x7f5d08070ab0 2023-07-06T22:20:12.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.423+0000 7f5d0f896640 1 -- 172.21.15.55:0/3684648839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d08070ab0 msgr2=0x7f5d080cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:12.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.423+0000 7f5d0f896640 1 --2- 172.21.15.55:0/3684648839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d08070ab0 0x7f5d080cd740 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009e50 tx=0x7f5d0001c950 comp rx=0 tx=0).stop 2023-07-06T22:20:12.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.423+0000 7f5d0f896640 1 -- 172.21.15.55:0/3684648839 shutdown_connections 2023-07-06T22:20:12.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.423+0000 7f5d0f896640 1 --2- 172.21.15.55:0/3684648839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d08070ab0 0x7f5d080cd740 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:12.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.423+0000 7f5d0f896640 1 --2- 172.21.15.55:0/3684648839 >> v2:172.21.15.138:3300/0 conn(0x7f5d0815ff90 0x7f5d080cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:12.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.423+0000 7f5d0f896640 1 -- 172.21.15.55:0/3684648839 >> 172.21.15.55:0/3684648839 conn(0x7f5d080cde30 msgr2=0x7f5d080ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:12.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.423+0000 7f5d0f896640 1 -- 172.21.15.55:0/3684648839 shutdown_connections 2023-07-06T22:20:12.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.423+0000 7f5d0f896640 1 -- 172.21.15.55:0/3684648839 wait complete. 2023-07-06T22:20:12.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0f896640 1 Processor -- start 2023-07-06T22:20:12.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0f896640 1 -- start start 2023-07-06T22:20:12.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0f896640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d08070ab0 0x7f5d08156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:12.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0f896640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d080cc730 0x7f5d08161770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:12.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0f896640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d0815ff90 0x7f5d08161cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:12.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0f896640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d080c7dd0 con 0x7f5d0815ff90 2023-07-06T22:20:12.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0f896640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d081607d0 con 0x7f5d080cc730 2023-07-06T22:20:12.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0f896640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d080c1c80 con 0x7f5d08070ab0 2023-07-06T22:20:12.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0de33640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d0815ff90 0x7f5d08161cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:12.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0de33640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d0815ff90 0x7f5d08161cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35684/0 (socket says 172.21.15.55:35684) 2023-07-06T22:20:12.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0de33640 1 -- 172.21.15.55:0/407345378 learned_addr learned my addr 172.21.15.55:0/407345378 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:12.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0d632640 1 --2- 172.21.15.55:0/407345378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d08070ab0 0x7f5d08156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:12.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0ce31640 1 --2- 172.21.15.55:0/407345378 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d080cc730 0x7f5d08161770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:12.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0de33640 1 -- 172.21.15.55:0/407345378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d08070ab0 msgr2=0x7f5d08156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:12.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0de33640 1 --2- 172.21.15.55:0/407345378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d08070ab0 0x7f5d08156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:12.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0de33640 1 -- 172.21.15.55:0/407345378 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d080cc730 msgr2=0x7f5d08161770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:12.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0de33640 1 --2- 172.21.15.55:0/407345378 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d080cc730 0x7f5d08161770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:12.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0de33640 1 -- 172.21.15.55:0/407345378 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d04009420 con 0x7f5d0815ff90 2023-07-06T22:20:12.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0de33640 1 --2- 172.21.15.55:0/407345378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d0815ff90 0x7f5d08161cb0 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f5d000af040 tx=0x7f5d000196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:12.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5cfdffb640 1 -- 172.21.15.55:0/407345378 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d000b8670 con 0x7f5d0815ff90 2023-07-06T22:20:12.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5cfdffb640 1 -- 172.21.15.55:0/407345378 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d000b87d0 con 0x7f5d0815ff90 2023-07-06T22:20:12.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0f896640 1 -- 172.21.15.55:0/407345378 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d00009b30 con 0x7f5d0815ff90 2023-07-06T22:20:12.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5cfdffb640 1 -- 172.21.15.55:0/407345378 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d000b8b60 con 0x7f5d0815ff90 2023-07-06T22:20:12.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.427+0000 7f5d0f896640 1 -- 172.21.15.55:0/407345378 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d080c7810 con 0x7f5d0815ff90 2023-07-06T22:20:12.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.431+0000 7f5d0f896640 1 -- 172.21.15.55:0/407345378 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0806cd70 con 0x7f5d0815ff90 2023-07-06T22:20:12.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.431+0000 7f5cfdffb640 1 -- 172.21.15.55:0/407345378 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5d000b8cc0 con 0x7f5d0815ff90 2023-07-06T22:20:12.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.431+0000 7f5cfdffb640 1 --2- 172.21.15.55:0/407345378 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f5cec0663a0 0x7f5cec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:12.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.431+0000 7f5cfdffb640 1 -- 172.21.15.55:0/407345378 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6832+0+0 (secure 0 0 0) 0x7f5d0011f640 con 0x7f5d0815ff90 2023-07-06T22:20:12.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.431+0000 7f5d0d632640 1 --2- 172.21.15.55:0/407345378 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f5cec0663a0 0x7f5cec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:12.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.431+0000 7f5d0d632640 1 --2- 172.21.15.55:0/407345378 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f5cec0663a0 0x7f5cec068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009c50 tx=0x7f5d04009190 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:12.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.435+0000 7f5cfdffb640 1 -- 172.21.15.55:0/407345378 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5d000ec660 con 0x7f5d0815ff90 2023-07-06T22:20:12.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:12.599+0000 7f5d0f896640 1 -- 172.21.15.55:0/407345378 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5d08066d60 con 0x7f5d0815ff90 2023-07-06T22:20:13.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.251+0000 7f5cfdffb640 1 -- 172.21.15.55:0/407345378 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v187) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5d000efc80 con 0x7f5d0815ff90 2023-07-06T22:20:13.253 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-07-06T22:20:13.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.255+0000 7f5d0f896640 1 -- 172.21.15.55:0/407345378 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f5cec0663a0 msgr2=0x7f5cec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:13.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.255+0000 7f5d0f896640 1 --2- 172.21.15.55:0/407345378 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f5cec0663a0 0x7f5cec068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009c50 tx=0x7f5d04009190 comp rx=0 tx=0).stop 2023-07-06T22:20:13.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.255+0000 7f5d0f896640 1 -- 172.21.15.55:0/407345378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d0815ff90 msgr2=0x7f5d08161cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:13.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.255+0000 7f5d0f896640 1 --2- 172.21.15.55:0/407345378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d0815ff90 0x7f5d08161cb0 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f5d000af040 tx=0x7f5d000196f0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.255+0000 7f5d0f896640 1 -- 172.21.15.55:0/407345378 shutdown_connections 2023-07-06T22:20:13.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.255+0000 7f5d0f896640 1 --2- 172.21.15.55:0/407345378 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f5cec0663a0 0x7f5cec068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.255+0000 7f5d0f896640 1 --2- 172.21.15.55:0/407345378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d0815ff90 0x7f5d08161cb0 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.255+0000 7f5d0f896640 1 --2- 172.21.15.55:0/407345378 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d080cc730 0x7f5d08161770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.255+0000 7f5d0f896640 1 --2- 172.21.15.55:0/407345378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d08070ab0 0x7f5d08156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.255+0000 7f5d0f896640 1 -- 172.21.15.55:0/407345378 >> 172.21.15.55:0/407345378 conn(0x7f5d080cde30 msgr2=0x7f5d080ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:13.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.255+0000 7f5d0f896640 1 -- 172.21.15.55:0/407345378 shutdown_connections 2023-07-06T22:20:13.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.255+0000 7f5d0f896640 1 -- 172.21.15.55:0/407345378 wait complete. 2023-07-06T22:20:13.282 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-06T22:20:13.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.427+0000 7f017e7fa640 1 Processor -- start 2023-07-06T22:20:13.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.427+0000 7f017e7fa640 1 -- start start 2023-07-06T22:20:13.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.427+0000 7f017e7fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0178158850 0x7f01780cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:13.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.427+0000 7f017e7fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01780ca130 0x7f01780ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:13.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.427+0000 7f017e7fa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f01780703e0 0x7f0178070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:13.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.427+0000 7f017e7fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0178070dc0 con 0x7f0178158850 2023-07-06T22:20:13.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.427+0000 7f017e7fa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0178158c20 con 0x7f01780703e0 2023-07-06T22:20:13.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.427+0000 7f017e7fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01780c8db0 con 0x7f01780ca130 2023-07-06T22:20:13.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.431+0000 7f0177fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0178158850 0x7f01780cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:13.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.431+0000 7f0177fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0178158850 0x7f01780cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43542/0 (socket says 172.21.15.55:43542) 2023-07-06T22:20:13.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.431+0000 7f0177fff640 1 -- 172.21.15.55:0/2161029984 learned_addr learned my addr 172.21.15.55:0/2161029984 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:13.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.431+0000 7f017cd97640 1 --2- 172.21.15.55:0/2161029984 >> v2:172.21.15.138:3300/0 conn(0x7f01780703e0 0x7f0178070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:13.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.431+0000 7f01777fe640 1 --2- 172.21.15.55:0/2161029984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01780ca130 0x7f01780ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:13.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.431+0000 7f0177fff640 1 -- 172.21.15.55:0/2161029984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01780ca130 msgr2=0x7f01780ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:13.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.431+0000 7f0177fff640 1 --2- 172.21.15.55:0/2161029984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01780ca130 0x7f01780ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.431+0000 7f0177fff640 1 -- 172.21.15.55:0/2161029984 >> v2:172.21.15.138:3300/0 conn(0x7f01780703e0 msgr2=0x7f0178070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:13.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.431+0000 7f0177fff640 1 --2- 172.21.15.55:0/2161029984 >> v2:172.21.15.138:3300/0 conn(0x7f01780703e0 0x7f0178070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.431+0000 7f0177fff640 1 -- 172.21.15.55:0/2161029984 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01780c9090 con 0x7f0178158850 2023-07-06T22:20:13.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.431+0000 7f0177fff640 1 --2- 172.21.15.55:0/2161029984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0178158850 0x7f01780cca30 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f01780b0d60 tx=0x7f016801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00d60ef9c7dd5a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:13.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.431+0000 7f0176ffd640 1 -- 172.21.15.55:0/2161029984 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01680a89b0 con 0x7f0178158850 2023-07-06T22:20:13.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.431+0000 7f0176ffd640 1 -- 172.21.15.55:0/2161029984 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01680a8b10 con 0x7f0178158850 2023-07-06T22:20:13.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.431+0000 7f0176ffd640 1 -- 172.21.15.55:0/2161029984 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01680a8ea0 con 0x7f0178158850 2023-07-06T22:20:13.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 -- 172.21.15.55:0/2161029984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0178158850 msgr2=0x7f01780cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:13.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 --2- 172.21.15.55:0/2161029984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0178158850 0x7f01780cca30 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f01780b0d60 tx=0x7f016801ecf0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 -- 172.21.15.55:0/2161029984 shutdown_connections 2023-07-06T22:20:13.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 --2- 172.21.15.55:0/2161029984 >> v2:172.21.15.138:3300/0 conn(0x7f01780703e0 0x7f0178070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 --2- 172.21.15.55:0/2161029984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01780ca130 0x7f01780ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 --2- 172.21.15.55:0/2161029984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0178158850 0x7f01780cca30 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 -- 172.21.15.55:0/2161029984 >> 172.21.15.55:0/2161029984 conn(0x7f01780cea70 msgr2=0x7f01780ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:13.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 -- 172.21.15.55:0/2161029984 shutdown_connections 2023-07-06T22:20:13.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 -- 172.21.15.55:0/2161029984 wait complete. 2023-07-06T22:20:13.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 Processor -- start 2023-07-06T22:20:13.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 -- start start 2023-07-06T22:20:13.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01780703e0 0x7f01780693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:13.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01780ca130 0x7f01780c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:13.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0178158850 0x7f01780c0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:13.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01780bca10 con 0x7f01780ca130 2023-07-06T22:20:13.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01780c1560 con 0x7f0178158850 2023-07-06T22:20:13.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017e7fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01780c73b0 con 0x7f01780703e0 2023-07-06T22:20:13.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f01777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01780ca130 0x7f01780c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:13.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f01777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01780ca130 0x7f01780c03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43556/0 (socket says 172.21.15.55:43556) 2023-07-06T22:20:13.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f01777fe640 1 -- 172.21.15.55:0/3913223850 learned_addr learned my addr 172.21.15.55:0/3913223850 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:13.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f0177fff640 1 --2- 172.21.15.55:0/3913223850 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01780703e0 0x7f01780693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:13.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.435+0000 7f017cd97640 1 --2- 172.21.15.55:0/3913223850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0178158850 0x7f01780c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:13.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f01777fe640 1 -- 172.21.15.55:0/3913223850 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01780703e0 msgr2=0x7f01780693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:13.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f01777fe640 1 --2- 172.21.15.55:0/3913223850 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01780703e0 0x7f01780693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f01777fe640 1 -- 172.21.15.55:0/3913223850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0178158850 msgr2=0x7f01780c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:13.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f01777fe640 1 --2- 172.21.15.55:0/3913223850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0178158850 0x7f01780c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f01777fe640 1 -- 172.21.15.55:0/3913223850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680094d0 con 0x7f01780ca130 2023-07-06T22:20:13.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f01777fe640 1 --2- 172.21.15.55:0/3913223850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01780ca130 0x7f01780c03c0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f016c00d800 tx=0x7f016c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:13.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f0174ff9640 1 -- 172.21.15.55:0/3913223850 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c00b6c0 con 0x7f01780ca130 2023-07-06T22:20:13.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f0174ff9640 1 -- 172.21.15.55:0/3913223850 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c00b820 con 0x7f01780ca130 2023-07-06T22:20:13.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f0174ff9640 1 -- 172.21.15.55:0/3913223850 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c00bb90 con 0x7f01780ca130 2023-07-06T22:20:13.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f017e7fa640 1 -- 172.21.15.55:0/3913223850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01780c17b0 con 0x7f01780ca130 2023-07-06T22:20:13.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f017e7fa640 1 -- 172.21.15.55:0/3913223850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01780c1d70 con 0x7f01780ca130 2023-07-06T22:20:13.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f017e7fa640 1 -- 172.21.15.55:0/3913223850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0178066d60 con 0x7f01780ca130 2023-07-06T22:20:13.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f0174ff9640 1 -- 172.21.15.55:0/3913223850 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f016c00bcf0 con 0x7f01780ca130 2023-07-06T22:20:13.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f0174ff9640 1 --2- 172.21.15.55:0/3913223850 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f01640663a0 0x7f0164068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:13.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f0174ff9640 1 -- 172.21.15.55:0/3913223850 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f016c0843b0 con 0x7f01780ca130 2023-07-06T22:20:13.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.439+0000 7f0177fff640 1 --2- 172.21.15.55:0/3913223850 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f01640663a0 0x7f0164068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:13.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.443+0000 7f0177fff640 1 --2- 172.21.15.55:0/3913223850 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f01640663a0 0x7f0164068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f01680b2000 tx=0x7f0168009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:13.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.443+0000 7f0174ff9640 1 -- 172.21.15.55:0/3913223850 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f016c0550e0 con 0x7f01780ca130 2023-07-06T22:20:13.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.603+0000 7f017e7fa640 1 -- 172.21.15.55:0/3913223850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f01780c01a0 con 0x7f01780ca130 2023-07-06T22:20:13.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.607+0000 7f0174ff9640 1 -- 172.21.15.55:0/3913223850 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v61) v1 ==== 120+0+0 (secure 0 0 0) 0x7f016c054c70 con 0x7f01780ca130 2023-07-06T22:20:13.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.611+0000 7f017e7fa640 1 -- 172.21.15.55:0/3913223850 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f01640663a0 msgr2=0x7f0164068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:13.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.611+0000 7f017e7fa640 1 --2- 172.21.15.55:0/3913223850 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f01640663a0 0x7f0164068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f01680b2000 tx=0x7f0168009040 comp rx=0 tx=0).stop 2023-07-06T22:20:13.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.611+0000 7f017e7fa640 1 -- 172.21.15.55:0/3913223850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01780ca130 msgr2=0x7f01780c03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:13.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.611+0000 7f017e7fa640 1 --2- 172.21.15.55:0/3913223850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01780ca130 0x7f01780c03c0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f016c00d800 tx=0x7f016c00dcc0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.611+0000 7f017e7fa640 1 -- 172.21.15.55:0/3913223850 shutdown_connections 2023-07-06T22:20:13.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.611+0000 7f017e7fa640 1 --2- 172.21.15.55:0/3913223850 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f01640663a0 0x7f0164068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.611+0000 7f017e7fa640 1 --2- 172.21.15.55:0/3913223850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0178158850 0x7f01780c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.611+0000 7f017e7fa640 1 --2- 172.21.15.55:0/3913223850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01780ca130 0x7f01780c03c0 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.611+0000 7f017e7fa640 1 --2- 172.21.15.55:0/3913223850 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01780703e0 0x7f01780693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.611+0000 7f017e7fa640 1 -- 172.21.15.55:0/3913223850 >> 172.21.15.55:0/3913223850 conn(0x7f01780cea70 msgr2=0x7f01780cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:13.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.611+0000 7f017e7fa640 1 -- 172.21.15.55:0/3913223850 shutdown_connections 2023-07-06T22:20:13.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.611+0000 7f017e7fa640 1 -- 172.21.15.55:0/3913223850 wait complete. 2023-07-06T22:20:13.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-06T22:20:13.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3b3d2640 1 Processor -- start 2023-07-06T22:20:13.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3b3d2640 1 -- start start 2023-07-06T22:20:13.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3b3d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c34156180 0x7f7c340ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:13.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3b3d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7c3406e9d0 0x7f7c3406ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:13.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3b3d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3406f360 con 0x7f7c340cb7a0 2023-07-06T22:20:13.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3b3d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c34160250 con 0x7f7c3406e9d0 2023-07-06T22:20:13.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3b3d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340cc310 con 0x7f7c34156180 2023-07-06T22:20:13.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3896d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7c3406e9d0 0x7f7c3406ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:13.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3996f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7c340cb7a0 0x7f7c340cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59728/0 (socket says 172.21.15.55:59728) 2023-07-06T22:20:13.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3996f640 1 -- 172.21.15.55:0/4064877419 learned_addr learned my addr 172.21.15.55:0/4064877419 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:13.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3916e640 1 --2- 172.21.15.55:0/4064877419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c34156180 0x7f7c340ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:13.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c2bfff640 1 -- 172.21.15.55:0/4064877419 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906980246 0 0) 0x7f7c2c0014a0 con 0x7f7c340cb7a0 2023-07-06T22:20:13.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c2bfff640 1 -- 172.21.15.55:0/4064877419 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c20003530 con 0x7f7c340cb7a0 2023-07-06T22:20:13.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3896d640 1 -- 172.21.15.55:0/4064877419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c34156180 msgr2=0x7f7c340ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:13.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3896d640 1 --2- 172.21.15.55:0/4064877419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c34156180 0x7f7c340ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3896d640 1 -- 172.21.15.55:0/4064877419 >> v1:172.21.15.55:6789/0 conn(0x7f7c340cb7a0 legacy=0x7f7c340cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:13.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.787+0000 7f7c3896d640 1 -- 172.21.15.55:0/4064877419 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3415f5d0 con 0x7f7c3406e9d0 2023-07-06T22:20:13.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.791+0000 7f7c3896d640 1 --2- 172.21.15.55:0/4064877419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c3406e9d0 0x7f7c3406ee20 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f7c240097c0 tx=0x7f7c2401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bd5af222497d53 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:13.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.791+0000 7f7c2bfff640 1 -- 172.21.15.55:0/4064877419 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240ac620 con 0x7f7c3406e9d0 2023-07-06T22:20:13.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.791+0000 7f7c2bfff640 1 -- 172.21.15.55:0/4064877419 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c240ac780 con 0x7f7c3406e9d0 2023-07-06T22:20:13.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.791+0000 7f7c2bfff640 1 -- 172.21.15.55:0/4064877419 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240acb10 con 0x7f7c3406e9d0 2023-07-06T22:20:13.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.791+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/4064877419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c3406e9d0 msgr2=0x7f7c3406ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:13.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.791+0000 7f7c3b3d2640 1 --2- 172.21.15.55:0/4064877419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c3406e9d0 0x7f7c3406ee20 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f7c240097c0 tx=0x7f7c2401c3c0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.791+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/4064877419 shutdown_connections 2023-07-06T22:20:13.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.791+0000 7f7c3b3d2640 1 --2- 172.21.15.55:0/4064877419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c3406e9d0 0x7f7c3406ee20 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.791+0000 7f7c3b3d2640 1 --2- 172.21.15.55:0/4064877419 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c34156180 0x7f7c340ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.791+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/4064877419 >> 172.21.15.55:0/4064877419 conn(0x7f7c340d0c50 msgr2=0x7f7c340cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:13.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.791+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/4064877419 shutdown_connections 2023-07-06T22:20:13.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.791+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/4064877419 wait complete. 2023-07-06T22:20:13.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3b3d2640 1 Processor -- start 2023-07-06T22:20:13.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3b3d2640 1 -- start start 2023-07-06T22:20:13.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3b3d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c3406e9d0 0x7f7c34147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:13.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3b3d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c340cb7a0 0x7f7c3414ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:13.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3b3d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c34156180 0x7f7c340c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:13.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3b3d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3414f640 con 0x7f7c3406e9d0 2023-07-06T22:20:13.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3b3d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3414f920 con 0x7f7c340cb7a0 2023-07-06T22:20:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3b3d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3414fc00 con 0x7f7c34156180 2023-07-06T22:20:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3916e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c3406e9d0 0x7f7c34147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3916e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c3406e9d0 0x7f7c34147af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43578/0 (socket says 172.21.15.55:43578) 2023-07-06T22:20:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3916e640 1 -- 172.21.15.55:0/170293425 learned_addr learned my addr 172.21.15.55:0/170293425 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3996f640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c34156180 0x7f7c340c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3896d640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c340cb7a0 0x7f7c3414ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3916e640 1 -- 172.21.15.55:0/170293425 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c34156180 msgr2=0x7f7c340c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:13.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3916e640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c34156180 0x7f7c340c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3916e640 1 -- 172.21.15.55:0/170293425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c340cb7a0 msgr2=0x7f7c3414ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:13.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3916e640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c340cb7a0 0x7f7c3414ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3916e640 1 -- 172.21.15.55:0/170293425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c24009420 con 0x7f7c3406e9d0 2023-07-06T22:20:13.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3996f640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c34156180 0x7f7c340c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:13.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3896d640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c340cb7a0 0x7f7c3414ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:13.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3916e640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c3406e9d0 0x7f7c34147af0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000e870 tx=0x7f7c3000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c29ffb640 1 -- 172.21.15.55:0/170293425 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c30009510 con 0x7f7c3406e9d0 2023-07-06T22:20:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c29ffb640 1 -- 172.21.15.55:0/170293425 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3000eec0 con 0x7f7c3406e9d0 2023-07-06T22:20:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c29ffb640 1 -- 172.21.15.55:0/170293425 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3000cb40 con 0x7f7c3406e9d0 2023-07-06T22:20:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/170293425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3414fee0 con 0x7f7c3406e9d0 2023-07-06T22:20:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.795+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/170293425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c341506a0 con 0x7f7c3406e9d0 2023-07-06T22:20:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.799+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/170293425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c340b0260 con 0x7f7c3406e9d0 2023-07-06T22:20:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.799+0000 7f7c29ffb640 1 -- 172.21.15.55:0/170293425 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7c3000cca0 con 0x7f7c3406e9d0 2023-07-06T22:20:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.799+0000 7f7c29ffb640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f7c180663a0 0x7f7c18068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.799+0000 7f7c29ffb640 1 -- 172.21.15.55:0/170293425 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f7c30084150 con 0x7f7c3406e9d0 2023-07-06T22:20:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.799+0000 7f7c3896d640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f7c180663a0 0x7f7c18068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.799+0000 7f7c3896d640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f7c180663a0 0x7f7c18068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7c240ae000 tx=0x7f7c24008040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:13.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.803+0000 7f7c29ffb640 1 -- 172.21.15.55:0/170293425 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7c30051340 con 0x7f7c3406e9d0 2023-07-06T22:20:13.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.959+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/170293425 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7c34066d60 con 0x7f7c3406e9d0 2023-07-06T22:20:13.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.963+0000 7f7c29ffb640 1 -- 172.21.15.55:0/170293425 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7c30054960 con 0x7f7c3406e9d0 2023-07-06T22:20:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.967+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/170293425 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f7c180663a0 msgr2=0x7f7c18068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.967+0000 7f7c3b3d2640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f7c180663a0 0x7f7c18068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7c240ae000 tx=0x7f7c24008040 comp rx=0 tx=0).stop 2023-07-06T22:20:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.967+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/170293425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c3406e9d0 msgr2=0x7f7c34147af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.967+0000 7f7c3b3d2640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c3406e9d0 0x7f7c34147af0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000e870 tx=0x7f7c3000ec70 comp rx=0 tx=0).stop 2023-07-06T22:20:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.967+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/170293425 shutdown_connections 2023-07-06T22:20:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.967+0000 7f7c3b3d2640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f7c180663a0 0x7f7c18068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.967+0000 7f7c3b3d2640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c34156180 0x7f7c340c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.967+0000 7f7c3b3d2640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c340cb7a0 0x7f7c3414ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.967+0000 7f7c3b3d2640 1 --2- 172.21.15.55:0/170293425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c3406e9d0 0x7f7c34147af0 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.967+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/170293425 >> 172.21.15.55:0/170293425 conn(0x7f7c340d0c50 msgr2=0x7f7c340b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.967+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/170293425 shutdown_connections 2023-07-06T22:20:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:13.967+0000 7f7c3b3d2640 1 -- 172.21.15.55:0/170293425 wait complete. 2023-07-06T22:20:13.987 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-06T22:20:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa862407640 1 Processor -- start 2023-07-06T22:20:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa862407640 1 -- start start 2023-07-06T22:20:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa862407640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa85c0ca130 0x7fa85c0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa862407640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa85c0cd140 0x7fa85c070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa862407640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85c158c20 con 0x7fa85c158850 2023-07-06T22:20:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa862407640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85c0b2aa0 con 0x7fa85c0cd140 2023-07-06T22:20:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa862407640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85c0c8db0 con 0x7fa85c0ca130 2023-07-06T22:20:14.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa85bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa85c158850 0x7fa85c0cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59734/0 (socket says 172.21.15.55:59734) 2023-07-06T22:20:14.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa85bfff640 1 -- 172.21.15.55:0/3354856989 learned_addr learned my addr 172.21.15.55:0/3354856989 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:14.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa8609a4640 1 --2- 172.21.15.55:0/3354856989 >> v2:172.21.15.55:3300/0 conn(0x7fa85c0cd140 0x7fa85c070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa85b7fe640 1 --2- 172.21.15.55:0/3354856989 >> v2:172.21.15.138:3300/0 conn(0x7fa85c0ca130 0x7fa85c0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa85affd640 1 -- 172.21.15.55:0/3354856989 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056805048 0 0) 0x7fa85c158c20 con 0x7fa85c158850 2023-07-06T22:20:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa85affd640 1 -- 172.21.15.55:0/3354856989 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa844003530 con 0x7fa85c158850 2023-07-06T22:20:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa8609a4640 1 -- 172.21.15.55:0/3354856989 >> v2:172.21.15.138:3300/0 conn(0x7fa85c0ca130 msgr2=0x7fa85c0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa8609a4640 1 --2- 172.21.15.55:0/3354856989 >> v2:172.21.15.138:3300/0 conn(0x7fa85c0ca130 0x7fa85c0703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa8609a4640 1 -- 172.21.15.55:0/3354856989 >> v1:172.21.15.55:6789/0 conn(0x7fa85c158850 legacy=0x7fa85c0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.131+0000 7fa8609a4640 1 -- 172.21.15.55:0/3354856989 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c0c9090 con 0x7fa85c0cd140 2023-07-06T22:20:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.135+0000 7fa8609a4640 1 --2- 172.21.15.55:0/3354856989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa85c0cd140 0x7fa85c070920 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fa85c071490 tx=0x7fa85401eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b277dfa6ee3f431 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.135+0000 7fa85affd640 1 -- 172.21.15.55:0/3354856989 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8540a7bc0 con 0x7fa85c0cd140 2023-07-06T22:20:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.135+0000 7fa85affd640 1 -- 172.21.15.55:0/3354856989 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8540a7d20 con 0x7fa85c0cd140 2023-07-06T22:20:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.135+0000 7fa85affd640 1 -- 172.21.15.55:0/3354856989 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8540af660 con 0x7fa85c0cd140 2023-07-06T22:20:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.135+0000 7fa862407640 1 -- 172.21.15.55:0/3354856989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa85c0cd140 msgr2=0x7fa85c070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.135+0000 7fa862407640 1 --2- 172.21.15.55:0/3354856989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa85c0cd140 0x7fa85c070920 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fa85c071490 tx=0x7fa85401eaf0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.135+0000 7fa862407640 1 -- 172.21.15.55:0/3354856989 shutdown_connections 2023-07-06T22:20:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.135+0000 7fa862407640 1 --2- 172.21.15.55:0/3354856989 >> v2:172.21.15.138:3300/0 conn(0x7fa85c0ca130 0x7fa85c0703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.135+0000 7fa862407640 1 --2- 172.21.15.55:0/3354856989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa85c0cd140 0x7fa85c070920 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.135+0000 7fa862407640 1 -- 172.21.15.55:0/3354856989 >> 172.21.15.55:0/3354856989 conn(0x7fa85c0cea70 msgr2=0x7fa85c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.135+0000 7fa862407640 1 -- 172.21.15.55:0/3354856989 shutdown_connections 2023-07-06T22:20:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.135+0000 7fa862407640 1 -- 172.21.15.55:0/3354856989 wait complete. 2023-07-06T22:20:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa862407640 1 Processor -- start 2023-07-06T22:20:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa862407640 1 -- start start 2023-07-06T22:20:14.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa862407640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa85c0ca130 0x7fa85c0c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:14.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa862407640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa85c0cd140 0x7fa85c0ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:14.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa862407640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa85c158850 0x7fa85c0aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:14.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa862407640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c0693f0 con 0x7fa85c158850 2023-07-06T22:20:14.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa862407640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c14cd40 con 0x7fa85c0ca130 2023-07-06T22:20:14.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa862407640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c14d020 con 0x7fa85c0cd140 2023-07-06T22:20:14.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa8609a4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa85c158850 0x7fa85c0aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa8609a4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa85c158850 0x7fa85c0aed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43598/0 (socket says 172.21.15.55:43598) 2023-07-06T22:20:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa8609a4640 1 -- 172.21.15.55:0/3186214754 learned_addr learned my addr 172.21.15.55:0/3186214754 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa85bfff640 1 --2- 172.21.15.55:0/3186214754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa85c0ca130 0x7fa85c0c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa85b7fe640 1 --2- 172.21.15.55:0/3186214754 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa85c0cd140 0x7fa85c0ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa8609a4640 1 -- 172.21.15.55:0/3186214754 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa85c0cd140 msgr2=0x7fa85c0ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa8609a4640 1 --2- 172.21.15.55:0/3186214754 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa85c0cd140 0x7fa85c0ae7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa8609a4640 1 -- 172.21.15.55:0/3186214754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa85c0ca130 msgr2=0x7fa85c0c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa8609a4640 1 --2- 172.21.15.55:0/3186214754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa85c0ca130 0x7fa85c0c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa8609a4640 1 -- 172.21.15.55:0/3186214754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa854009a70 con 0x7fa85c158850 2023-07-06T22:20:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa8609a4640 1 --2- 172.21.15.55:0/3186214754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa85c158850 0x7fa85c0aed20 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7fa85401b700 tx=0x7fa85401b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa858ff9640 1 -- 172.21.15.55:0/3186214754 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8540b0d30 con 0x7fa85c158850 2023-07-06T22:20:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa858ff9640 1 -- 172.21.15.55:0/3186214754 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8540a7e90 con 0x7fa85c158850 2023-07-06T22:20:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa862407640 1 -- 172.21.15.55:0/3186214754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa85c14d300 con 0x7fa85c158850 2023-07-06T22:20:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa858ff9640 1 -- 172.21.15.55:0/3186214754 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8540b9650 con 0x7fa85c158850 2023-07-06T22:20:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.139+0000 7fa862407640 1 -- 172.21.15.55:0/3186214754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85c0c41a0 con 0x7fa85c158850 2023-07-06T22:20:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.143+0000 7fa862407640 1 -- 172.21.15.55:0/3186214754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85c066d60 con 0x7fa85c158850 2023-07-06T22:20:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.143+0000 7fa858ff9640 1 -- 172.21.15.55:0/3186214754 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa8540b6050 con 0x7fa85c158850 2023-07-06T22:20:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.143+0000 7fa858ff9640 1 --2- 172.21.15.55:0/3186214754 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fa8480663a0 0x7fa848068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.143+0000 7fa858ff9640 1 -- 172.21.15.55:0/3186214754 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6418+0+0 (secure 0 0 0) 0x7fa854120f60 con 0x7fa85c158850 2023-07-06T22:20:14.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.143+0000 7fa85bfff640 1 --2- 172.21.15.55:0/3186214754 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fa8480663a0 0x7fa848068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:14.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.143+0000 7fa85bfff640 1 --2- 172.21.15.55:0/3186214754 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fa8480663a0 0x7fa848068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa84c007fd0 tx=0x7fa84c009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:14.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.147+0000 7fa858ff9640 1 -- 172.21.15.55:0/3186214754 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8540ee170 con 0x7fa85c158850 2023-07-06T22:20:14.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.303+0000 7fa862407640 1 -- 172.21.15.55:0/3186214754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fa85c06cd30 con 0x7fa85c158850 2023-07-06T22:20:14.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.311+0000 7fa858ff9640 1 -- 172.21.15.55:0/3186214754 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v63) v1 ==== 115+0+0 (secure 0 0 0) 0x7fa8540b40b0 con 0x7fa85c158850 2023-07-06T22:20:14.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.311+0000 7fa862407640 1 -- 172.21.15.55:0/3186214754 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fa8480663a0 msgr2=0x7fa848068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.311+0000 7fa862407640 1 --2- 172.21.15.55:0/3186214754 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fa8480663a0 0x7fa848068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa84c007fd0 tx=0x7fa84c009040 comp rx=0 tx=0).stop 2023-07-06T22:20:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.311+0000 7fa862407640 1 -- 172.21.15.55:0/3186214754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa85c158850 msgr2=0x7fa85c0aed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.311+0000 7fa862407640 1 --2- 172.21.15.55:0/3186214754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa85c158850 0x7fa85c0aed20 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7fa85401b700 tx=0x7fa85401b890 comp rx=0 tx=0).stop 2023-07-06T22:20:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.311+0000 7fa862407640 1 -- 172.21.15.55:0/3186214754 shutdown_connections 2023-07-06T22:20:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.311+0000 7fa862407640 1 --2- 172.21.15.55:0/3186214754 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fa8480663a0 0x7fa848068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.311+0000 7fa862407640 1 --2- 172.21.15.55:0/3186214754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa85c158850 0x7fa85c0aed20 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.311+0000 7fa862407640 1 --2- 172.21.15.55:0/3186214754 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa85c0cd140 0x7fa85c0ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.311+0000 7fa862407640 1 --2- 172.21.15.55:0/3186214754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa85c0ca130 0x7fa85c0c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.311+0000 7fa862407640 1 -- 172.21.15.55:0/3186214754 >> 172.21.15.55:0/3186214754 conn(0x7fa85c0cea70 msgr2=0x7fa85c153f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:14.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.311+0000 7fa862407640 1 -- 172.21.15.55:0/3186214754 shutdown_connections 2023-07-06T22:20:14.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.311+0000 7fa862407640 1 -- 172.21.15.55:0/3186214754 wait complete. 2023-07-06T22:20:14.335 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-07-06T22:20:14.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.475+0000 7f954d493640 1 Processor -- start 2023-07-06T22:20:14.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.475+0000 7f954d493640 1 -- start start 2023-07-06T22:20:14.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.479+0000 7f954d493640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f954806f8e0 0x7f954806fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:14.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.479+0000 7f954d493640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f954815cc00 0x7f954815f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:14.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.479+0000 7f954d493640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954815c770 con 0x7f954815bc40 2023-07-06T22:20:14.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.479+0000 7f954d493640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954806d4f0 con 0x7f954815cc00 2023-07-06T22:20:14.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.479+0000 7f954d493640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95480701f0 con 0x7f954806f8e0 2023-07-06T22:20:14.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.479+0000 7f95477fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f954815cc00 0x7f954815f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:14.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.479+0000 7f9546ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f954806f8e0 0x7f954806fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:14.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.479+0000 7f95477fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f954815cc00 0x7f954815f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:50748/0 (socket says 172.21.15.55:50748) 2023-07-06T22:20:14.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.479+0000 7f95477fe640 1 -- 172.21.15.55:0/103420866 learned_addr learned my addr 172.21.15.55:0/103420866 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.479+0000 7f9546ffd640 1 -- 172.21.15.55:0/103420866 >> v2:172.21.15.138:3300/0 conn(0x7f954815cc00 msgr2=0x7f954815f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.479+0000 7f9546ffd640 1 --2- 172.21.15.55:0/103420866 >> v2:172.21.15.138:3300/0 conn(0x7f954815cc00 0x7f954815f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.479+0000 7f9546ffd640 1 -- 172.21.15.55:0/103420866 >> v1:172.21.15.138:6789/0 conn(0x7f954815bc40 legacy=0x7f954806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.479+0000 7f9546ffd640 1 -- 172.21.15.55:0/103420866 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954806d210 con 0x7f954806f8e0 2023-07-06T22:20:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.479+0000 7f95477fe640 1 --2- 172.21.15.55:0/103420866 >> v2:172.21.15.138:3300/0 conn(0x7f954815cc00 0x7f954815f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:14.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f9546ffd640 1 --2- 172.21.15.55:0/103420866 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f954806f8e0 0x7f954806fcb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f95380097c0 tx=0x7f953801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0d342c5f84005ed server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:14.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f95467fc640 1 -- 172.21.15.55:0/103420866 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95380ab600 con 0x7f954806f8e0 2023-07-06T22:20:14.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f95467fc640 1 -- 172.21.15.55:0/103420866 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95380a7050 con 0x7f954806f8e0 2023-07-06T22:20:14.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f95467fc640 1 -- 172.21.15.55:0/103420866 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95380ab980 con 0x7f954806f8e0 2023-07-06T22:20:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 -- 172.21.15.55:0/103420866 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f954806f8e0 msgr2=0x7f954806fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 --2- 172.21.15.55:0/103420866 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f954806f8e0 0x7f954806fcb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f95380097c0 tx=0x7f953801c480 comp rx=0 tx=0).stop 2023-07-06T22:20:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 -- 172.21.15.55:0/103420866 shutdown_connections 2023-07-06T22:20:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 --2- 172.21.15.55:0/103420866 >> v2:172.21.15.138:3300/0 conn(0x7f954815cc00 0x7f954815f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 --2- 172.21.15.55:0/103420866 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f954806f8e0 0x7f954806fcb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 -- 172.21.15.55:0/103420866 >> 172.21.15.55:0/103420866 conn(0x7f95480cbd80 msgr2=0x7f95480ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:14.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 -- 172.21.15.55:0/103420866 shutdown_connections 2023-07-06T22:20:14.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 -- 172.21.15.55:0/103420866 wait complete. 2023-07-06T22:20:14.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 Processor -- start 2023-07-06T22:20:14.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 -- start start 2023-07-06T22:20:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f954806f8e0 0x7f9548154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f954815bc40 0x7f9548155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f954815cc00 0x7f9548152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9548153130 con 0x7f954806f8e0 2023-07-06T22:20:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9548153410 con 0x7f954815cc00 2023-07-06T22:20:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.483+0000 7f954d493640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95481577d0 con 0x7f954815bc40 2023-07-06T22:20:14.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f9546ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f954806f8e0 0x7f9548154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:14.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f9546ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f954806f8e0 0x7f9548154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43600/0 (socket says 172.21.15.55:43600) 2023-07-06T22:20:14.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f9546ffd640 1 -- 172.21.15.55:0/471514690 learned_addr learned my addr 172.21.15.55:0/471514690 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:14.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f95477fe640 1 --2- 172.21.15.55:0/471514690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f954815cc00 0x7f9548152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:14.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f953ffff640 1 --2- 172.21.15.55:0/471514690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f954815bc40 0x7f9548155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:14.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f9546ffd640 1 -- 172.21.15.55:0/471514690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f954815bc40 msgr2=0x7f9548155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:14.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f9546ffd640 1 --2- 172.21.15.55:0/471514690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f954815bc40 0x7f9548155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f9546ffd640 1 -- 172.21.15.55:0/471514690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f954815cc00 msgr2=0x7f9548152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:14.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f9546ffd640 1 --2- 172.21.15.55:0/471514690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f954815cc00 0x7f9548152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:14.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f9546ffd640 1 -- 172.21.15.55:0/471514690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9540009b30 con 0x7f954806f8e0 2023-07-06T22:20:14.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f9546ffd640 1 --2- 172.21.15.55:0/471514690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f954806f8e0 0x7f9548154190 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f953801a0b0 tx=0x7f953801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:14.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f953f7fe640 1 -- 172.21.15.55:0/471514690 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95380b7450 con 0x7f954806f8e0 2023-07-06T22:20:14.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f953f7fe640 1 -- 172.21.15.55:0/471514690 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95380b75b0 con 0x7f954806f8e0 2023-07-06T22:20:14.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f953f7fe640 1 -- 172.21.15.55:0/471514690 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95380b7960 con 0x7f954806f8e0 2023-07-06T22:20:14.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f954d493640 1 -- 172.21.15.55:0/471514690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9538009420 con 0x7f954806f8e0 2023-07-06T22:20:14.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f954d493640 1 -- 172.21.15.55:0/471514690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9548155eb0 con 0x7f954806f8e0 2023-07-06T22:20:14.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f954d493640 1 -- 172.21.15.55:0/471514690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9548066d60 con 0x7f954806f8e0 2023-07-06T22:20:14.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.487+0000 7f953f7fe640 1 -- 172.21.15.55:0/471514690 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f95380b7ac0 con 0x7f954806f8e0 2023-07-06T22:20:14.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.491+0000 7f953f7fe640 1 --2- 172.21.15.55:0/471514690 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f95280663a0 0x7f9528068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:14.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.491+0000 7f953f7fe640 1 -- 172.21.15.55:0/471514690 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f953811e850 con 0x7f954806f8e0 2023-07-06T22:20:14.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.491+0000 7f953ffff640 1 --2- 172.21.15.55:0/471514690 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f95280663a0 0x7f9528068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:14.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.491+0000 7f953ffff640 1 --2- 172.21.15.55:0/471514690 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f95280663a0 0x7f9528068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9548152380 tx=0x7f9530009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:14.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.491+0000 7f953f7fe640 1 -- 172.21.15.55:0/471514690 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95380ebb00 con 0x7f954806f8e0 2023-07-06T22:20:14.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:14.699+0000 7f954d493640 1 -- 172.21.15.55:0/471514690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f95480704d0 con 0x7f954806f8e0 2023-07-06T22:20:15.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.259+0000 7f953f7fe640 1 -- 172.21.15.55:0/471514690 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1366) v1 ==== 163+0+0 (secure 0 0 0) 0x7f95380ef120 con 0x7f954806f8e0 2023-07-06T22:20:15.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.263+0000 7f954d493640 1 -- 172.21.15.55:0/471514690 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f95280663a0 msgr2=0x7f9528068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:15.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.263+0000 7f954d493640 1 --2- 172.21.15.55:0/471514690 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f95280663a0 0x7f9528068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9548152380 tx=0x7f9530009040 comp rx=0 tx=0).stop 2023-07-06T22:20:15.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.263+0000 7f954d493640 1 -- 172.21.15.55:0/471514690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f954806f8e0 msgr2=0x7f9548154190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:15.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.263+0000 7f954d493640 1 --2- 172.21.15.55:0/471514690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f954806f8e0 0x7f9548154190 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f953801a0b0 tx=0x7f953801acc0 comp rx=0 tx=0).stop 2023-07-06T22:20:15.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.263+0000 7f954d493640 1 -- 172.21.15.55:0/471514690 shutdown_connections 2023-07-06T22:20:15.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.263+0000 7f954d493640 1 --2- 172.21.15.55:0/471514690 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f95280663a0 0x7f9528068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:15.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.263+0000 7f954d493640 1 --2- 172.21.15.55:0/471514690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f954815cc00 0x7f9548152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:15.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.263+0000 7f954d493640 1 --2- 172.21.15.55:0/471514690 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f954815bc40 0x7f9548155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:15.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.263+0000 7f954d493640 1 --2- 172.21.15.55:0/471514690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f954806f8e0 0x7f9548154190 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:15.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.263+0000 7f954d493640 1 -- 172.21.15.55:0/471514690 >> 172.21.15.55:0/471514690 conn(0x7f95480cbd80 msgr2=0x7f95480ae0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:15.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.263+0000 7f954d493640 1 -- 172.21.15.55:0/471514690 shutdown_connections 2023-07-06T22:20:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.263+0000 7f954d493640 1 -- 172.21.15.55:0/471514690 wait complete. 2023-07-06T22:20:15.287 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-07-06T22:20:15.287 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-07-06T22:20:15.287 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-07-06T22:20:15.288 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-07-06T22:20:15.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.431+0000 7f09a6093640 1 Processor -- start 2023-07-06T22:20:15.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.431+0000 7f09a6093640 1 -- start start 2023-07-06T22:20:15.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.431+0000 7f09a6093640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f09a006f520 0x7f09a00cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:15.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.431+0000 7f09a6093640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a006fae0 con 0x7f09a0158400 2023-07-06T22:20:15.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.431+0000 7f09a6093640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a006fdc0 con 0x7f09a01587d0 2023-07-06T22:20:15.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.431+0000 7f09a6093640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a00700a0 con 0x7f09a006f520 2023-07-06T22:20:15.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.431+0000 7f099f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f09a0158400 0x7f09a00c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59746/0 (socket says 172.21.15.55:59746) 2023-07-06T22:20:15.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.431+0000 7f099f7fe640 1 -- 172.21.15.55:0/2474003492 learned_addr learned my addr 172.21.15.55:0/2474003492 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:15.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.435+0000 7f099ffff640 1 --2- 172.21.15.55:0/2474003492 >> v2:172.21.15.138:3300/0 conn(0x7f09a006f520 0x7f09a00cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:15.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.435+0000 7f099e7fc640 1 -- 172.21.15.55:0/2474003492 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592855280 0 0) 0x7f09a006fae0 con 0x7f09a0158400 2023-07-06T22:20:15.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.435+0000 7f099e7fc640 1 -- 172.21.15.55:0/2474003492 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0988003530 con 0x7f09a0158400 2023-07-06T22:20:15.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.435+0000 7f099ffff640 1 -- 172.21.15.55:0/2474003492 >> v1:172.21.15.138:6789/0 conn(0x7f09a01587d0 legacy=0x7f09a0070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:15.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.435+0000 7f099ffff640 1 -- 172.21.15.55:0/2474003492 >> v1:172.21.15.55:6789/0 conn(0x7f09a0158400 legacy=0x7f09a00c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:15.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.435+0000 7f099ffff640 1 -- 172.21.15.55:0/2474003492 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0070380 con 0x7f09a006f520 2023-07-06T22:20:15.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.435+0000 7f099ffff640 1 --2- 172.21.15.55:0/2474003492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09a006f520 0x7f09a00cbaa0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f0998009d90 tx=0x7f099801eb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f2e09c0724daaf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:15.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.435+0000 7f099e7fc640 1 -- 172.21.15.55:0/2474003492 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09980a7b10 con 0x7f09a006f520 2023-07-06T22:20:15.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.435+0000 7f099e7fc640 1 -- 172.21.15.55:0/2474003492 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09980a7c70 con 0x7f09a006f520 2023-07-06T22:20:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.435+0000 7f099e7fc640 1 -- 172.21.15.55:0/2474003492 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09980af440 con 0x7f09a006f520 2023-07-06T22:20:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 -- 172.21.15.55:0/2474003492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09a006f520 msgr2=0x7f09a00cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:15.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 --2- 172.21.15.55:0/2474003492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09a006f520 0x7f09a00cbaa0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f0998009d90 tx=0x7f099801eb30 comp rx=0 tx=0).stop 2023-07-06T22:20:15.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 -- 172.21.15.55:0/2474003492 shutdown_connections 2023-07-06T22:20:15.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 --2- 172.21.15.55:0/2474003492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09a006f520 0x7f09a00cbaa0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:15.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 -- 172.21.15.55:0/2474003492 >> 172.21.15.55:0/2474003492 conn(0x7f09a00cded0 msgr2=0x7f09a00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:15.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 -- 172.21.15.55:0/2474003492 shutdown_connections 2023-07-06T22:20:15.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 -- 172.21.15.55:0/2474003492 wait complete. 2023-07-06T22:20:15.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 Processor -- start 2023-07-06T22:20:15.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 -- start start 2023-07-06T22:20:15.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09a006f520 0x7f09a01f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:15.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09a0158400 0x7f09a01566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:15.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a01587d0 0x7f09a014ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:15.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a01f9120 con 0x7f09a01587d0 2023-07-06T22:20:15.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a01554e0 con 0x7f09a006f520 2023-07-06T22:20:15.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f09a6093640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a01557c0 con 0x7f09a0158400 2023-07-06T22:20:15.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f099ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a01587d0 0x7f09a014ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:15.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f099ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a01587d0 0x7f09a014ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43602/0 (socket says 172.21.15.55:43602) 2023-07-06T22:20:15.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f099ffff640 1 -- 172.21.15.55:0/2374736379 learned_addr learned my addr 172.21.15.55:0/2374736379 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:15.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f099f7fe640 1 --2- 172.21.15.55:0/2374736379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09a006f520 0x7f09a01f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:15.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.439+0000 7f099effd640 1 --2- 172.21.15.55:0/2374736379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09a0158400 0x7f09a01566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:15.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f099ffff640 1 -- 172.21.15.55:0/2374736379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09a0158400 msgr2=0x7f09a01566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:15.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f099ffff640 1 --2- 172.21.15.55:0/2374736379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09a0158400 0x7f09a01566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:15.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f099ffff640 1 -- 172.21.15.55:0/2374736379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09a006f520 msgr2=0x7f09a01f8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:15.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f099ffff640 1 --2- 172.21.15.55:0/2374736379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09a006f520 0x7f09a01f8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:15.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f099ffff640 1 -- 172.21.15.55:0/2374736379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0998009a70 con 0x7f09a01587d0 2023-07-06T22:20:15.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f099ffff640 1 --2- 172.21.15.55:0/2374736379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a01587d0 0x7f09a014ed20 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f099801c760 tx=0x7f099801b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:15.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f0987fff640 1 -- 172.21.15.55:0/2374736379 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09980a7b10 con 0x7f09a01587d0 2023-07-06T22:20:15.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f0987fff640 1 -- 172.21.15.55:0/2374736379 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0998009450 con 0x7f09a01587d0 2023-07-06T22:20:15.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f09a6093640 1 -- 172.21.15.55:0/2374736379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a0155aa0 con 0x7f09a01587d0 2023-07-06T22:20:15.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f0987fff640 1 -- 172.21.15.55:0/2374736379 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09980afd90 con 0x7f09a01587d0 2023-07-06T22:20:15.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f09a6093640 1 -- 172.21.15.55:0/2374736379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a0156c10 con 0x7f09a01587d0 2023-07-06T22:20:15.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f09a6093640 1 -- 172.21.15.55:0/2374736379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a006c580 con 0x7f09a01587d0 2023-07-06T22:20:15.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f0987fff640 1 -- 172.21.15.55:0/2374736379 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f09980b6070 con 0x7f09a01587d0 2023-07-06T22:20:15.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f0987fff640 1 --2- 172.21.15.55:0/2374736379 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f098c0663a0 0x7f098c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:15.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f0987fff640 1 -- 172.21.15.55:0/2374736379 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f099811edd0 con 0x7f09a01587d0 2023-07-06T22:20:15.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.443+0000 7f099f7fe640 1 --2- 172.21.15.55:0/2374736379 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f098c0663a0 0x7f098c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:15.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.447+0000 7f099f7fe640 1 --2- 172.21.15.55:0/2374736379 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f098c0663a0 0x7f098c068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f09900011f0 tx=0x7f0990009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:15.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.447+0000 7f0987fff640 1 -- 172.21.15.55:0/2374736379 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f09980ebeb0 con 0x7f09a01587d0 2023-07-06T22:20:15.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:15.659+0000 7f09a6093640 1 -- 172.21.15.55:0/2374736379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f09a0066d60 con 0x7f09a01587d0 2023-07-06T22:20:16.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.267+0000 7f0987fff640 1 -- 172.21.15.55:0/2374736379 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1367) v1 ==== 158+0+0 (secure 0 0 0) 0x7f09980ef4d0 con 0x7f09a01587d0 2023-07-06T22:20:16.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.271+0000 7f09a6093640 1 -- 172.21.15.55:0/2374736379 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f098c0663a0 msgr2=0x7f098c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:16.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.271+0000 7f09a6093640 1 --2- 172.21.15.55:0/2374736379 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f098c0663a0 0x7f098c068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f09900011f0 tx=0x7f0990009040 comp rx=0 tx=0).stop 2023-07-06T22:20:16.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.271+0000 7f09a6093640 1 -- 172.21.15.55:0/2374736379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a01587d0 msgr2=0x7f09a014ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:16.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.271+0000 7f09a6093640 1 --2- 172.21.15.55:0/2374736379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a01587d0 0x7f09a014ed20 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f099801c760 tx=0x7f099801b8d0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.271+0000 7f09a6093640 1 -- 172.21.15.55:0/2374736379 shutdown_connections 2023-07-06T22:20:16.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.271+0000 7f09a6093640 1 --2- 172.21.15.55:0/2374736379 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f098c0663a0 0x7f098c068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.271+0000 7f09a6093640 1 --2- 172.21.15.55:0/2374736379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a01587d0 0x7f09a014ed20 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.271+0000 7f09a6093640 1 --2- 172.21.15.55:0/2374736379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09a0158400 0x7f09a01566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.271+0000 7f09a6093640 1 --2- 172.21.15.55:0/2374736379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09a006f520 0x7f09a01f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.271+0000 7f09a6093640 1 -- 172.21.15.55:0/2374736379 >> 172.21.15.55:0/2374736379 conn(0x7f09a00cded0 msgr2=0x7f09a00ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:16.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.271+0000 7f09a6093640 1 -- 172.21.15.55:0/2374736379 shutdown_connections 2023-07-06T22:20:16.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.271+0000 7f09a6093640 1 -- 172.21.15.55:0/2374736379 wait complete. 2023-07-06T22:20:16.295 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:20:16.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.439+0000 7f83d6c48640 1 Processor -- start 2023-07-06T22:20:16.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.439+0000 7f83d6c48640 1 -- start start 2023-07-06T22:20:16.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.439+0000 7f83d6c48640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f83d00c89b0 0x7f83d00cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:16.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.439+0000 7f83d6c48640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d015c8a0 con 0x7f83d006bb60 2023-07-06T22:20:16.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.439+0000 7f83d6c48640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d00cdb70 con 0x7f83d00c8d80 2023-07-06T22:20:16.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.439+0000 7f83d6c48640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d00cce70 con 0x7f83d00c89b0 2023-07-06T22:20:16.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.439+0000 7f83d51e5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f83d006bb60 0x7f83d0158720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59762/0 (socket says 172.21.15.55:59762) 2023-07-06T22:20:16.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.439+0000 7f83d51e5640 1 -- 172.21.15.55:0/1564396966 learned_addr learned my addr 172.21.15.55:0/1564396966 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:16.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.439+0000 7f83d49e4640 1 --2- 172.21.15.55:0/1564396966 >> v2:172.21.15.138:3300/0 conn(0x7f83d00c89b0 0x7f83d00cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:16.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.443+0000 7f83cf7fe640 1 -- 172.21.15.55:0/1564396966 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121371812 0 0) 0x7f83d015c8a0 con 0x7f83d006bb60 2023-07-06T22:20:16.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.443+0000 7f83cf7fe640 1 -- 172.21.15.55:0/1564396966 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83c0003530 con 0x7f83d006bb60 2023-07-06T22:20:16.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.443+0000 7f83cf7fe640 1 -- 172.21.15.55:0/1564396966 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2277521083 0 0) 0x7f83c0003530 con 0x7f83d006bb60 2023-07-06T22:20:16.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.443+0000 7f83d49e4640 1 -- 172.21.15.55:0/1564396966 >> v1:172.21.15.138:6789/0 conn(0x7f83d00c8d80 legacy=0x7f83d00cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:16.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.443+0000 7f83d49e4640 1 -- 172.21.15.55:0/1564396966 >> v1:172.21.15.55:6789/0 conn(0x7f83d006bb60 legacy=0x7f83d0158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:16.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.443+0000 7f83d49e4640 1 -- 172.21.15.55:0/1564396966 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d015bc90 con 0x7f83d00c89b0 2023-07-06T22:20:16.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.443+0000 7f83d49e4640 1 --2- 172.21.15.55:0/1564396966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83d00c89b0 0x7f83d00cbe50 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f83c40097c0 tx=0x7f83c401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=396ccf9347af04f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:16.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.443+0000 7f83cf7fe640 1 -- 172.21.15.55:0/1564396966 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c8001a00 con 0x7f83d00c89b0 2023-07-06T22:20:16.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.443+0000 7f83cf7fe640 1 -- 172.21.15.55:0/1564396966 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c40a7050 con 0x7f83d00c89b0 2023-07-06T22:20:16.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.443+0000 7f83cf7fe640 1 -- 172.21.15.55:0/1564396966 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c40ab620 con 0x7f83d00c89b0 2023-07-06T22:20:16.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 -- 172.21.15.55:0/1564396966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83d00c89b0 msgr2=0x7f83d00cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 --2- 172.21.15.55:0/1564396966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83d00c89b0 0x7f83d00cbe50 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f83c40097c0 tx=0x7f83c401c370 comp rx=0 tx=0).stop 2023-07-06T22:20:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 -- 172.21.15.55:0/1564396966 shutdown_connections 2023-07-06T22:20:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 --2- 172.21.15.55:0/1564396966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83d00c89b0 0x7f83d00cbe50 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 -- 172.21.15.55:0/1564396966 >> 172.21.15.55:0/1564396966 conn(0x7f83d00cded0 msgr2=0x7f83d00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 -- 172.21.15.55:0/1564396966 shutdown_connections 2023-07-06T22:20:16.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 -- 172.21.15.55:0/1564396966 wait complete. 2023-07-06T22:20:16.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 Processor -- start 2023-07-06T22:20:16.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 -- start start 2023-07-06T22:20:16.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83d006bb60 0x7f83d014ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:16.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83d00c89b0 0x7f83d00b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:16.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83d00c8d80 0x7f83d00ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:16.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d0152bc0 con 0x7f83d00c8d80 2023-07-06T22:20:16.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00cb190 con 0x7f83d006bb60 2023-07-06T22:20:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d6c48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d0152e60 con 0x7f83d00c89b0 2023-07-06T22:20:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d51e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83d00c8d80 0x7f83d00ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d51e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83d00c8d80 0x7f83d00ac260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43608/0 (socket says 172.21.15.55:43608) 2023-07-06T22:20:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.447+0000 7f83d51e5640 1 -- 172.21.15.55:0/3716250 learned_addr learned my addr 172.21.15.55:0/3716250 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83d49e4640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83d006bb60 0x7f83d014ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83d51e5640 1 -- 172.21.15.55:0/3716250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83d00c89b0 msgr2=0x7f83d00b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83cffff640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83d00c89b0 0x7f83d00b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83d51e5640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83d00c89b0 0x7f83d00b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83d51e5640 1 -- 172.21.15.55:0/3716250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83d006bb60 msgr2=0x7f83d014ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83d51e5640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83d006bb60 0x7f83d014ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83d51e5640 1 -- 172.21.15.55:0/3716250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c4009420 con 0x7f83d00c8d80 2023-07-06T22:20:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83d49e4640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83d006bb60 0x7f83d014ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83cffff640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83d00c89b0 0x7f83d00b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83d51e5640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83d00c8d80 0x7f83d00ac260 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f83c800cc70 tx=0x7f83c800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:16.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83cd7fa640 1 -- 172.21.15.55:0/3716250 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800ce80 con 0x7f83d00c8d80 2023-07-06T22:20:16.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83cd7fa640 1 -- 172.21.15.55:0/3716250 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c8012400 con 0x7f83d00c8d80 2023-07-06T22:20:16.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83d6c48640 1 -- 172.21.15.55:0/3716250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d0153140 con 0x7f83d00c8d80 2023-07-06T22:20:16.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83cd7fa640 1 -- 172.21.15.55:0/3716250 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c80127d0 con 0x7f83d00c8d80 2023-07-06T22:20:16.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83d6c48640 1 -- 172.21.15.55:0/3716250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d00b1180 con 0x7f83d00c8d80 2023-07-06T22:20:16.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83d6c48640 1 -- 172.21.15.55:0/3716250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d0153380 con 0x7f83d00c8d80 2023-07-06T22:20:16.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.451+0000 7f83cd7fa640 1 -- 172.21.15.55:0/3716250 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f83c8007070 con 0x7f83d00c8d80 2023-07-06T22:20:16.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.455+0000 7f83cd7fa640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f83b40663a0 0x7f83b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:16.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.455+0000 7f83cd7fa640 1 -- 172.21.15.55:0/3716250 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f83c8084160 con 0x7f83d00c8d80 2023-07-06T22:20:16.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.455+0000 7f83d49e4640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f83b40663a0 0x7f83b4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:16.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.455+0000 7f83d49e4640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f83b40663a0 0x7f83b4068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f83c40ad000 tx=0x7f83c40a6000 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:16.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.459+0000 7f83cd7fa640 1 -- 172.21.15.55:0/3716250 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f83d0153380 con 0x7f83d00c8d80 2023-07-06T22:20:16.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.615+0000 7f83d6c48640 1 -- 172.21.15.55:0/3716250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83d0153380 con 0x7f83d00c8d80 2023-07-06T22:20:16.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.615+0000 7f83cd7fa640 1 -- 172.21.15.55:0/3716250 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f83d0153380 con 0x7f83d00c8d80 2023-07-06T22:20:16.618 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:16.618 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":187,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:20:13.243179+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6837/3052024414":"2023-07-07T22:20:10.070742+0000","172.21.15.55:6836/3052024414":"2023-07-07T22:20:10.070742+0000","172.21.15.55:0/251532788":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/4267103658":"2023-07-07T22:20:07.174864+0000","172.21.15.55:6833/628169602":"2023-07-07T22:20:07.174864+0000","172.21.15.55:6832/628169602":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/3238640476":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/1991294440":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/3074416439":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/3954362142":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/3285408268":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/1793501954":"2023-07-07T22:20:07.174864+0000","172.21.15.55:0/455359735":"2023-07-07T22:18:57.087673+0000","172.21.15.55:6833/957337795":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/2168505984":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/3159272832":"2023-07-07T22:18:57.087673+0000","172.21.15.55:6832/957337795":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/748095594":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/4040799024":"2023-07-07T22:18:57.087673+0000","172.21.15.55:0/56444713":"2023-07-07T22:18:57.087673+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:20:16.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.615+0000 7f83d6c48640 1 -- 172.21.15.55:0/3716250 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f83b40663a0 msgr2=0x7f83b4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.615+0000 7f83d6c48640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f83b40663a0 0x7f83b4068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f83c40ad000 tx=0x7f83c40a6000 comp rx=0 tx=0).stop 2023-07-06T22:20:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.615+0000 7f83d6c48640 1 -- 172.21.15.55:0/3716250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83d00c8d80 msgr2=0x7f83d00ac260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.615+0000 7f83d6c48640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83d00c8d80 0x7f83d00ac260 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f83c800cc70 tx=0x7f83c800a430 comp rx=0 tx=0).stop 2023-07-06T22:20:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.619+0000 7f83d6c48640 1 -- 172.21.15.55:0/3716250 shutdown_connections 2023-07-06T22:20:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.619+0000 7f83d6c48640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f83b40663a0 0x7f83b4068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.619+0000 7f83d6c48640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83d00c8d80 0x7f83d00ac260 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.619+0000 7f83d6c48640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83d00c89b0 0x7f83d00b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.619+0000 7f83d6c48640 1 --2- 172.21.15.55:0/3716250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83d006bb60 0x7f83d014ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.619+0000 7f83d6c48640 1 -- 172.21.15.55:0/3716250 >> 172.21.15.55:0/3716250 conn(0x7f83d00cded0 msgr2=0x7f83d0152360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.619+0000 7f83d6c48640 1 -- 172.21.15.55:0/3716250 shutdown_connections 2023-07-06T22:20:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.619+0000 7f83d6c48640 1 -- 172.21.15.55:0/3716250 wait complete. 2023-07-06T22:20:16.639 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:20:16.640 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:20:16.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0263c7b640 1 Processor -- start 2023-07-06T22:20:16.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0263c7b640 1 -- start start 2023-07-06T22:20:16.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0263c7b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f025c15b850 0x7f025c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:16.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0263c7b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f025c0b3f80 0x7f025c0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:16.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0263c7b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f025c0b2b80 con 0x7f025c0ccd30 2023-07-06T22:20:16.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0263c7b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c0cff30 con 0x7f025c0b3f80 2023-07-06T22:20:16.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0263c7b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c0b22e0 con 0x7f025c15b850 2023-07-06T22:20:16.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0262218640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f025c0b3f80 0x7f025c0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:16.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0262218640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f025c0b3f80 0x7f025c0d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43612/0 (socket says 172.21.15.55:43612) 2023-07-06T22:20:16.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0262218640 1 -- 172.21.15.55:0/658917601 learned_addr learned my addr 172.21.15.55:0/658917601 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:16.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0261a17640 1 --2- 172.21.15.55:0/658917601 >> v2:172.21.15.138:3300/0 conn(0x7f025c15b850 0x7f025c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:16.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0262218640 1 -- 172.21.15.55:0/658917601 >> v2:172.21.15.138:3300/0 conn(0x7f025c15b850 msgr2=0x7f025c0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:16.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0262218640 1 --2- 172.21.15.55:0/658917601 >> v2:172.21.15.138:3300/0 conn(0x7f025c15b850 0x7f025c0cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0262218640 1 -- 172.21.15.55:0/658917601 >> v1:172.21.15.138:6789/0 conn(0x7f025c0ccd30 legacy=0x7f025c0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:16.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.783+0000 7f0262218640 1 -- 172.21.15.55:0/658917601 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c0b25c0 con 0x7f025c0b3f80 2023-07-06T22:20:16.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.787+0000 7f0262218640 1 --2- 172.21.15.55:0/658917601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f025c0b3f80 0x7f025c0d03c0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f025c0b48d0 tx=0x7f025401c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c638da82e4434d09 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:16.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.787+0000 7f0260a15640 1 -- 172.21.15.55:0/658917601 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02540a5690 con 0x7f025c0b3f80 2023-07-06T22:20:16.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.787+0000 7f0260a15640 1 -- 172.21.15.55:0/658917601 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02540a57f0 con 0x7f025c0b3f80 2023-07-06T22:20:16.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.787+0000 7f0260a15640 1 -- 172.21.15.55:0/658917601 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02540a5b80 con 0x7f025c0b3f80 2023-07-06T22:20:16.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.787+0000 7f0263c7b640 1 -- 172.21.15.55:0/658917601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f025c0b3f80 msgr2=0x7f025c0d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:16.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.787+0000 7f0263c7b640 1 --2- 172.21.15.55:0/658917601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f025c0b3f80 0x7f025c0d03c0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f025c0b48d0 tx=0x7f025401c840 comp rx=0 tx=0).stop 2023-07-06T22:20:16.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.787+0000 7f0263c7b640 1 -- 172.21.15.55:0/658917601 shutdown_connections 2023-07-06T22:20:16.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.787+0000 7f0263c7b640 1 --2- 172.21.15.55:0/658917601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f025c0b3f80 0x7f025c0d03c0 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.787+0000 7f0263c7b640 1 --2- 172.21.15.55:0/658917601 >> v2:172.21.15.138:3300/0 conn(0x7f025c15b850 0x7f025c0cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.787+0000 7f0263c7b640 1 -- 172.21.15.55:0/658917601 >> 172.21.15.55:0/658917601 conn(0x7f025c0cec20 msgr2=0x7f025c0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.787+0000 7f0263c7b640 1 -- 172.21.15.55:0/658917601 shutdown_connections 2023-07-06T22:20:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.787+0000 7f0263c7b640 1 -- 172.21.15.55:0/658917601 wait complete. 2023-07-06T22:20:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0263c7b640 1 Processor -- start 2023-07-06T22:20:16.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0263c7b640 1 -- start start 2023-07-06T22:20:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0263c7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f025c0b3f80 0x7f025c0b69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0263c7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f025c0ccd30 0x7f025c150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0263c7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f025c15b850 0x7f025c0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0263c7b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c0b6f10 con 0x7f025c0ccd30 2023-07-06T22:20:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0263c7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c0c9620 con 0x7f025c0b3f80 2023-07-06T22:20:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0263c7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c151440 con 0x7f025c15b850 2023-07-06T22:20:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0261216640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f025c0ccd30 0x7f025c150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0261a17640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f025c0b3f80 0x7f025c0b69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0261216640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f025c0ccd30 0x7f025c150f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43624/0 (socket says 172.21.15.55:43624) 2023-07-06T22:20:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0261216640 1 -- 172.21.15.55:0/2965061094 learned_addr learned my addr 172.21.15.55:0/2965061094 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0262218640 1 --2- 172.21.15.55:0/2965061094 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f025c15b850 0x7f025c0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0261216640 1 -- 172.21.15.55:0/2965061094 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f025c15b850 msgr2=0x7f025c0c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0261216640 1 --2- 172.21.15.55:0/2965061094 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f025c15b850 0x7f025c0c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0261216640 1 -- 172.21.15.55:0/2965061094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f025c0b3f80 msgr2=0x7f025c0b69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0261216640 1 --2- 172.21.15.55:0/2965061094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f025c0b3f80 0x7f025c0b69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0261216640 1 -- 172.21.15.55:0/2965061094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0254009b30 con 0x7f025c0ccd30 2023-07-06T22:20:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0262218640 1 --2- 172.21.15.55:0/2965061094 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f025c15b850 0x7f025c0c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0261216640 1 --2- 172.21.15.55:0/2965061094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f025c0ccd30 0x7f025c150f00 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f024c00c450 tx=0x7f024c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f02527fc640 1 -- 172.21.15.55:0/2965061094 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c012830 con 0x7f025c0ccd30 2023-07-06T22:20:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f02527fc640 1 -- 172.21.15.55:0/2965061094 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c0129b0 con 0x7f025c0ccd30 2023-07-06T22:20:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f02527fc640 1 -- 172.21.15.55:0/2965061094 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c012d60 con 0x7f025c0ccd30 2023-07-06T22:20:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0263c7b640 1 -- 172.21.15.55:0/2965061094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025c15bda0 con 0x7f025c0ccd30 2023-07-06T22:20:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.791+0000 7f0263c7b640 1 -- 172.21.15.55:0/2965061094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c1535b0 con 0x7f025c0ccd30 2023-07-06T22:20:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.795+0000 7f0263c7b640 1 -- 172.21.15.55:0/2965061094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025c066d60 con 0x7f025c0ccd30 2023-07-06T22:20:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.795+0000 7f02527fc640 1 -- 172.21.15.55:0/2965061094 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f024c01c460 con 0x7f025c0ccd30 2023-07-06T22:20:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.795+0000 7f02527fc640 1 --2- 172.21.15.55:0/2965061094 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f02400663a0 0x7f0240068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.795+0000 7f02527fc640 1 -- 172.21.15.55:0/2965061094 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f024c083db0 con 0x7f025c0ccd30 2023-07-06T22:20:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.795+0000 7f0261a17640 1 --2- 172.21.15.55:0/2965061094 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f02400663a0 0x7f0240068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.799+0000 7f0261a17640 1 --2- 172.21.15.55:0/2965061094 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f02400663a0 0x7f0240068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f02580079c0 tx=0x7f0258008040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:16.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.799+0000 7f02527fc640 1 -- 172.21.15.55:0/2965061094 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f024c088070 con 0x7f025c0ccd30 2023-07-06T22:20:16.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.955+0000 7f0263c7b640 1 -- 172.21.15.55:0/2965061094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f025c0b3420 con 0x7f025c0ccd30 2023-07-06T22:20:16.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.955+0000 7f02527fc640 1 -- 172.21.15.55:0/2965061094 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v187) v1 ==== 93+0+10 (secure 0 0 0) 0x7f024c050fa0 con 0x7f025c0ccd30 2023-07-06T22:20:16.959 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:20:16.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.959+0000 7f0263c7b640 1 -- 172.21.15.55:0/2965061094 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f02400663a0 msgr2=0x7f0240068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:16.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.959+0000 7f0263c7b640 1 --2- 172.21.15.55:0/2965061094 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f02400663a0 0x7f0240068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f02580079c0 tx=0x7f0258008040 comp rx=0 tx=0).stop 2023-07-06T22:20:16.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.959+0000 7f0263c7b640 1 -- 172.21.15.55:0/2965061094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f025c0ccd30 msgr2=0x7f025c150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:16.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.959+0000 7f0263c7b640 1 --2- 172.21.15.55:0/2965061094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f025c0ccd30 0x7f025c150f00 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f024c00c450 tx=0x7f024c00c910 comp rx=0 tx=0).stop 2023-07-06T22:20:16.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.959+0000 7f0263c7b640 1 -- 172.21.15.55:0/2965061094 shutdown_connections 2023-07-06T22:20:16.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.959+0000 7f0263c7b640 1 --2- 172.21.15.55:0/2965061094 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f02400663a0 0x7f0240068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.959+0000 7f0263c7b640 1 --2- 172.21.15.55:0/2965061094 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f025c15b850 0x7f025c0c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.959+0000 7f0263c7b640 1 --2- 172.21.15.55:0/2965061094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f025c0ccd30 0x7f025c150f00 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.959+0000 7f0263c7b640 1 --2- 172.21.15.55:0/2965061094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f025c0b3f80 0x7f025c0b69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:16.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.959+0000 7f0263c7b640 1 -- 172.21.15.55:0/2965061094 >> 172.21.15.55:0/2965061094 conn(0x7f025c0cec20 msgr2=0x7f025c0693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:16.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.959+0000 7f0263c7b640 1 -- 172.21.15.55:0/2965061094 shutdown_connections 2023-07-06T22:20:16.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:16.959+0000 7f0263c7b640 1 -- 172.21.15.55:0/2965061094 wait complete. 2023-07-06T22:20:16.979 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:20:17.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.123+0000 7fb3967a3640 1 Processor -- start 2023-07-06T22:20:17.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.123+0000 7fb3967a3640 1 -- start start 2023-07-06T22:20:17.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.123+0000 7fb3967a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb3900b3870 0x7fb3900b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:17.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.123+0000 7fb3967a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb3900d03c0 0x7fb3900d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:17.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.123+0000 7fb3967a3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3900b4210 con 0x7fb39015b850 2023-07-06T22:20:17.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.123+0000 7fb3967a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3900b2b80 con 0x7fb3900b3870 2023-07-06T22:20:17.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.123+0000 7fb3967a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900cff30 con 0x7fb3900d03c0 2023-07-06T22:20:17.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.123+0000 7fb38f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb3900b3870 0x7fb3900b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:17.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.123+0000 7fb38f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb3900b3870 0x7fb3900b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43634/0 (socket says 172.21.15.55:43634) 2023-07-06T22:20:17.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.123+0000 7fb38f7fe640 1 -- 172.21.15.55:0/4191382343 learned_addr learned my addr 172.21.15.55:0/4191382343 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:17.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb394d40640 1 --2- 172.21.15.55:0/4191382343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb3900d03c0 0x7fb3900d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:17.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb38f7fe640 1 -- 172.21.15.55:0/4191382343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb3900d03c0 msgr2=0x7fb3900d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:17.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb38f7fe640 1 --2- 172.21.15.55:0/4191382343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb3900d03c0 0x7fb3900d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb38f7fe640 1 -- 172.21.15.55:0/4191382343 >> v1:172.21.15.138:6789/0 conn(0x7fb39015b850 legacy=0x7fb3900cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:17.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb38f7fe640 1 -- 172.21.15.55:0/4191382343 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3900b22e0 con 0x7fb3900b3870 2023-07-06T22:20:17.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb38f7fe640 1 --2- 172.21.15.55:0/4191382343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3900b3870 0x7fb3900b3cd0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fb384009870 tx=0x7fb38401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250b7ca3161a196a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:17.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb38effd640 1 -- 172.21.15.55:0/4191382343 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840ab600 con 0x7fb3900b3870 2023-07-06T22:20:17.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb38effd640 1 -- 172.21.15.55:0/4191382343 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3840a7050 con 0x7fb3900b3870 2023-07-06T22:20:17.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb38effd640 1 -- 172.21.15.55:0/4191382343 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840ab980 con 0x7fb3900b3870 2023-07-06T22:20:17.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb3967a3640 1 -- 172.21.15.55:0/4191382343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3900b3870 msgr2=0x7fb3900b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:17.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb3967a3640 1 --2- 172.21.15.55:0/4191382343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3900b3870 0x7fb3900b3cd0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fb384009870 tx=0x7fb38401c3b0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb3967a3640 1 -- 172.21.15.55:0/4191382343 shutdown_connections 2023-07-06T22:20:17.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb3967a3640 1 --2- 172.21.15.55:0/4191382343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb3900d03c0 0x7fb3900d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb3967a3640 1 --2- 172.21.15.55:0/4191382343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3900b3870 0x7fb3900b3cd0 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.127+0000 7fb3967a3640 1 -- 172.21.15.55:0/4191382343 >> 172.21.15.55:0/4191382343 conn(0x7fb3900cec20 msgr2=0x7fb3900cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:17.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb3967a3640 1 -- 172.21.15.55:0/4191382343 shutdown_connections 2023-07-06T22:20:17.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb3967a3640 1 -- 172.21.15.55:0/4191382343 wait complete. 2023-07-06T22:20:17.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb3967a3640 1 Processor -- start 2023-07-06T22:20:17.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb3967a3640 1 -- start start 2023-07-06T22:20:17.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb3967a3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3900b3870 0x7fb390069ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:17.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb3967a3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb3900d03c0 0x7fb39014dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:17.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb3967a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb39015b850 0x7fb39014e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:17.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb3967a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39006aa80 con 0x7fb39015b850 2023-07-06T22:20:17.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb3967a3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900c9b10 con 0x7fb3900b3870 2023-07-06T22:20:17.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb3967a3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39006ad40 con 0x7fb3900d03c0 2023-07-06T22:20:17.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb394d40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb39015b850 0x7fb39014e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:17.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb394d40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb39015b850 0x7fb39014e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43646/0 (socket says 172.21.15.55:43646) 2023-07-06T22:20:17.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb394d40640 1 -- 172.21.15.55:0/839684231 learned_addr learned my addr 172.21.15.55:0/839684231 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:17.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb38f7fe640 1 --2- 172.21.15.55:0/839684231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb3900d03c0 0x7fb39014dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:17.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb38ffff640 1 --2- 172.21.15.55:0/839684231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3900b3870 0x7fb390069ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:17.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb394d40640 1 -- 172.21.15.55:0/839684231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb3900d03c0 msgr2=0x7fb39014dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:17.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb394d40640 1 --2- 172.21.15.55:0/839684231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb3900d03c0 0x7fb39014dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb394d40640 1 -- 172.21.15.55:0/839684231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3900b3870 msgr2=0x7fb390069ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:17.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb394d40640 1 --2- 172.21.15.55:0/839684231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3900b3870 0x7fb390069ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb394d40640 1 -- 172.21.15.55:0/839684231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3840094d0 con 0x7fb39015b850 2023-07-06T22:20:17.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.131+0000 7fb394d40640 1 --2- 172.21.15.55:0/839684231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb39015b850 0x7fb39014e2e0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fb388007e60 tx=0x7fb38800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:17.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.135+0000 7fb38cff9640 1 -- 172.21.15.55:0/839684231 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388014420 con 0x7fb39015b850 2023-07-06T22:20:17.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.135+0000 7fb38cff9640 1 -- 172.21.15.55:0/839684231 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3880145a0 con 0x7fb39015b850 2023-07-06T22:20:17.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.135+0000 7fb38cff9640 1 -- 172.21.15.55:0/839684231 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388014950 con 0x7fb39015b850 2023-07-06T22:20:17.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.135+0000 7fb3967a3640 1 -- 172.21.15.55:0/839684231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39006b020 con 0x7fb39015b850 2023-07-06T22:20:17.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.135+0000 7fb3967a3640 1 -- 172.21.15.55:0/839684231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39006a1e0 con 0x7fb39015b850 2023-07-06T22:20:17.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.135+0000 7fb3967a3640 1 -- 172.21.15.55:0/839684231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39006a3d0 con 0x7fb39015b850 2023-07-06T22:20:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.135+0000 7fb38cff9640 1 -- 172.21.15.55:0/839684231 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb388014ab0 con 0x7fb39015b850 2023-07-06T22:20:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.135+0000 7fb38cff9640 1 --2- 172.21.15.55:0/839684231 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb37c0663a0 0x7fb37c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.135+0000 7fb38cff9640 1 -- 172.21.15.55:0/839684231 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6418+0+0 (secure 0 0 0) 0x7fb388084810 con 0x7fb39015b850 2023-07-06T22:20:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.135+0000 7fb38ffff640 1 --2- 172.21.15.55:0/839684231 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb37c0663a0 0x7fb37c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:17.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.139+0000 7fb38ffff640 1 --2- 172.21.15.55:0/839684231 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb37c0663a0 0x7fb37c068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb380007fd0 tx=0x7fb380007e40 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:17.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.139+0000 7fb38cff9640 1 -- 172.21.15.55:0/839684231 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb39006a3d0 con 0x7fb39015b850 2023-07-06T22:20:17.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.299+0000 7fb3967a3640 1 -- 172.21.15.55:0/839684231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb39006a3d0 con 0x7fb39015b850 2023-07-06T22:20:17.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.299+0000 7fb38cff9640 1 -- 172.21.15.55:0/839684231 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v187) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb39006a3d0 con 0x7fb39015b850 2023-07-06T22:20:17.302 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:20:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.303+0000 7fb3967a3640 1 -- 172.21.15.55:0/839684231 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb37c0663a0 msgr2=0x7fb37c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.303+0000 7fb3967a3640 1 --2- 172.21.15.55:0/839684231 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb37c0663a0 0x7fb37c068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb380007fd0 tx=0x7fb380007e40 comp rx=0 tx=0).stop 2023-07-06T22:20:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.303+0000 7fb3967a3640 1 -- 172.21.15.55:0/839684231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb39015b850 msgr2=0x7fb39014e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.303+0000 7fb3967a3640 1 --2- 172.21.15.55:0/839684231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb39015b850 0x7fb39014e2e0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fb388007e60 tx=0x7fb38800e4b0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.303+0000 7fb3967a3640 1 -- 172.21.15.55:0/839684231 shutdown_connections 2023-07-06T22:20:17.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.303+0000 7fb3967a3640 1 --2- 172.21.15.55:0/839684231 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb37c0663a0 0x7fb37c068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.303+0000 7fb3967a3640 1 --2- 172.21.15.55:0/839684231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb39015b850 0x7fb39014e2e0 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.303+0000 7fb3967a3640 1 --2- 172.21.15.55:0/839684231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb3900d03c0 0x7fb39014dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.303+0000 7fb3967a3640 1 --2- 172.21.15.55:0/839684231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3900b3870 0x7fb390069ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.303+0000 7fb3967a3640 1 -- 172.21.15.55:0/839684231 >> 172.21.15.55:0/839684231 conn(0x7fb3900cec20 msgr2=0x7fb3900b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:17.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.303+0000 7fb3967a3640 1 -- 172.21.15.55:0/839684231 shutdown_connections 2023-07-06T22:20:17.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.303+0000 7fb3967a3640 1 -- 172.21.15.55:0/839684231 wait complete. 2023-07-06T22:20:17.324 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-06T22:20:17.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.467+0000 7fce52007640 1 Processor -- start 2023-07-06T22:20:17.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.467+0000 7fce52007640 1 -- start start 2023-07-06T22:20:17.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.467+0000 7fce52007640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4c158850 0x7fce4c0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:17.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.467+0000 7fce52007640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce4c0ca130 0x7fce4c0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:17.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.467+0000 7fce52007640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4c0b2aa0 con 0x7fce4c0703e0 2023-07-06T22:20:17.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.467+0000 7fce52007640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4c158c20 con 0x7fce4c0ca130 2023-07-06T22:20:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.467+0000 7fce52007640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c0c8db0 con 0x7fce4c158850 2023-07-06T22:20:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.467+0000 7fce4affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce4c0ca130 0x7fce4c0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.467+0000 7fce4affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce4c0ca130 0x7fce4c0ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43656/0 (socket says 172.21.15.55:43656) 2023-07-06T22:20:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.467+0000 7fce4bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fce4c0703e0 0x7fce4c06eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59778/0 (socket says 172.21.15.55:59778) 2023-07-06T22:20:17.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.467+0000 7fce4affd640 1 -- 172.21.15.55:0/669648823 learned_addr learned my addr 172.21.15.55:0/669648823 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.467+0000 7fce4b7fe640 1 --2- 172.21.15.55:0/669648823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4c158850 0x7fce4c0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce4affd640 1 -- 172.21.15.55:0/669648823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4c158850 msgr2=0x7fce4c0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce4affd640 1 --2- 172.21.15.55:0/669648823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4c158850 0x7fce4c0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce4affd640 1 -- 172.21.15.55:0/669648823 >> v1:172.21.15.55:6789/0 conn(0x7fce4c0703e0 legacy=0x7fce4c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce4affd640 1 -- 172.21.15.55:0/669648823 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c0c9090 con 0x7fce4c0ca130 2023-07-06T22:20:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce4affd640 1 --2- 172.21.15.55:0/669648823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c0ca130 0x7fce4c0ccf70 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fce4000bb10 tx=0x7fce40021400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a947a52198389b03 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:17.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce4a7fc640 1 -- 172.21.15.55:0/669648823 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce400b1600 con 0x7fce4c0ca130 2023-07-06T22:20:17.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce4a7fc640 1 -- 172.21.15.55:0/669648823 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce400ad050 con 0x7fce4c0ca130 2023-07-06T22:20:17.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce4a7fc640 1 -- 172.21.15.55:0/669648823 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce400b1980 con 0x7fce4c0ca130 2023-07-06T22:20:17.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce52007640 1 -- 172.21.15.55:0/669648823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c0ca130 msgr2=0x7fce4c0ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:17.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce52007640 1 --2- 172.21.15.55:0/669648823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c0ca130 0x7fce4c0ccf70 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fce4000bb10 tx=0x7fce40021400 comp rx=0 tx=0).stop 2023-07-06T22:20:17.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce52007640 1 -- 172.21.15.55:0/669648823 shutdown_connections 2023-07-06T22:20:17.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce52007640 1 --2- 172.21.15.55:0/669648823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c0ca130 0x7fce4c0ccf70 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce52007640 1 --2- 172.21.15.55:0/669648823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4c158850 0x7fce4c0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce52007640 1 -- 172.21.15.55:0/669648823 >> 172.21.15.55:0/669648823 conn(0x7fce4c0cea70 msgr2=0x7fce4c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:17.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce52007640 1 -- 172.21.15.55:0/669648823 shutdown_connections 2023-07-06T22:20:17.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.471+0000 7fce52007640 1 -- 172.21.15.55:0/669648823 wait complete. 2023-07-06T22:20:17.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce52007640 1 Processor -- start 2023-07-06T22:20:17.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce52007640 1 -- start start 2023-07-06T22:20:17.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce52007640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4c0703e0 0x7fce4c06a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:17.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce52007640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c0ca130 0x7fce4c1f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:17.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce52007640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c158850 0x7fce4c06bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:17.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce52007640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c1e4980 con 0x7fce4c0ca130 2023-07-06T22:20:17.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce52007640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c06b1d0 con 0x7fce4c158850 2023-07-06T22:20:17.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce52007640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c1e45e0 con 0x7fce4c0703e0 2023-07-06T22:20:17.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce4affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c0ca130 0x7fce4c1f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:17.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce4affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c0ca130 0x7fce4c1f0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43666/0 (socket says 172.21.15.55:43666) 2023-07-06T22:20:17.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce4affd640 1 -- 172.21.15.55:0/2467950775 learned_addr learned my addr 172.21.15.55:0/2467950775 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:17.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce4b7fe640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4c0703e0 0x7fce4c06a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:17.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce4bfff640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c158850 0x7fce4c06bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:17.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce4affd640 1 -- 172.21.15.55:0/2467950775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4c0703e0 msgr2=0x7fce4c06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:17.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce4affd640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4c0703e0 0x7fce4c06a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce4affd640 1 -- 172.21.15.55:0/2467950775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c158850 msgr2=0x7fce4c06bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:17.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce4affd640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c158850 0x7fce4c06bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce4affd640 1 -- 172.21.15.55:0/2467950775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4000b770 con 0x7fce4c0ca130 2023-07-06T22:20:17.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce4bfff640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c158850 0x7fce4c06bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:17.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce4affd640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c0ca130 0x7fce4c1f0d10 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fce4001fab0 tx=0x7fce4001fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:17.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.475+0000 7fce33fff640 1 -- 172.21.15.55:0/2467950775 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce400b97c0 con 0x7fce4c0ca130 2023-07-06T22:20:17.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.479+0000 7fce33fff640 1 -- 172.21.15.55:0/2467950775 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce400b9920 con 0x7fce4c0ca130 2023-07-06T22:20:17.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.479+0000 7fce52007640 1 -- 172.21.15.55:0/2467950775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4c06ac10 con 0x7fce4c0ca130 2023-07-06T22:20:17.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.479+0000 7fce33fff640 1 -- 172.21.15.55:0/2467950775 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce400b9cb0 con 0x7fce4c0ca130 2023-07-06T22:20:17.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.479+0000 7fce52007640 1 -- 172.21.15.55:0/2467950775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4c06a7e0 con 0x7fce4c0ca130 2023-07-06T22:20:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.479+0000 7fce52007640 1 -- 172.21.15.55:0/2467950775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4c06a9d0 con 0x7fce4c0ca130 2023-07-06T22:20:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.479+0000 7fce33fff640 1 -- 172.21.15.55:0/2467950775 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fce400c5460 con 0x7fce4c0ca130 2023-07-06T22:20:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.479+0000 7fce33fff640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fce380663a0 0x7fce38068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.479+0000 7fce33fff640 1 -- 172.21.15.55:0/2467950775 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6418+0+0 (secure 0 0 0) 0x7fce401229f0 con 0x7fce4c0ca130 2023-07-06T22:20:17.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.479+0000 7fce4b7fe640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fce380663a0 0x7fce38068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:17.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.479+0000 7fce4b7fe640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fce380663a0 0x7fce38068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0079c0 tx=0x7fce3c008040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:17.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.483+0000 7fce33fff640 1 -- 172.21.15.55:0/2467950775 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce4c06a9d0 con 0x7fce4c0ca130 2023-07-06T22:20:17.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.639+0000 7fce52007640 1 -- 172.21.15.55:0/2467950775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fce4c1e4440 con 0x7fce4c0ca130 2023-07-06T22:20:17.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.647+0000 7fce33fff640 1 -- 172.21.15.55:0/2467950775 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7fce4c1e4440 con 0x7fce4c0ca130 2023-07-06T22:20:17.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.647+0000 7fce52007640 1 -- 172.21.15.55:0/2467950775 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fce380663a0 msgr2=0x7fce38068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:17.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.647+0000 7fce52007640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fce380663a0 0x7fce38068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0079c0 tx=0x7fce3c008040 comp rx=0 tx=0).stop 2023-07-06T22:20:17.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.647+0000 7fce52007640 1 -- 172.21.15.55:0/2467950775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c0ca130 msgr2=0x7fce4c1f0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:17.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.647+0000 7fce52007640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c0ca130 0x7fce4c1f0d10 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fce4001fab0 tx=0x7fce4001fc40 comp rx=0 tx=0).stop 2023-07-06T22:20:17.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.647+0000 7fce52007640 1 -- 172.21.15.55:0/2467950775 shutdown_connections 2023-07-06T22:20:17.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.647+0000 7fce52007640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fce380663a0 0x7fce38068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.647+0000 7fce52007640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce4c158850 0x7fce4c06bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.647+0000 7fce52007640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c0ca130 0x7fce4c1f0d10 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.647+0000 7fce52007640 1 --2- 172.21.15.55:0/2467950775 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4c0703e0 0x7fce4c06a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:17.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.647+0000 7fce52007640 1 -- 172.21.15.55:0/2467950775 >> 172.21.15.55:0/2467950775 conn(0x7fce4c0cea70 msgr2=0x7fce4c09df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:17.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.647+0000 7fce52007640 1 -- 172.21.15.55:0/2467950775 shutdown_connections 2023-07-06T22:20:17.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:17.647+0000 7fce52007640 1 -- 172.21.15.55:0/2467950775 wait complete. 2023-07-06T22:20:17.669 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T22:20:17.670 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:20:17.746 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:20:17.798 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T22:20:17.799 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:20:17.799 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:17.808 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:20:17.808 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:20:17.809 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:17.818 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:20:17.818 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:20:17.819 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:17.863 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:20:17.864 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:20:17.864 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:17.873 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:20:17.873 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-06T22:20:17.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:20:18.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99fb703640 1 Processor -- start 2023-07-06T22:20:18.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99fb703640 1 -- start start 2023-07-06T22:20:18.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99fb703640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f4158400 0x7f99f40c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:18.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99fb703640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99f40c9680 0x7f99f4070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:18.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99fb703640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f406fae0 con 0x7f99f40710c0 2023-07-06T22:20:18.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99fb703640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f406fdc0 con 0x7f99f40c9680 2023-07-06T22:20:18.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99fb703640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f40700a0 con 0x7f99f4158400 2023-07-06T22:20:18.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99f8c9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99f40c9680 0x7f99f4070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:18.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99f9ca0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f99f40710c0 0x7f99f40cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59784/0 (socket says 172.21.15.55:59784) 2023-07-06T22:20:18.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99f9ca0640 1 -- 172.21.15.55:0/2693136730 learned_addr learned my addr 172.21.15.55:0/2693136730 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:18.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99f8c9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99f40c9680 0x7f99f4070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43668/0 (socket says 172.21.15.55:43668) 2023-07-06T22:20:18.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99f949f640 1 --2- 172.21.15.55:0/2693136730 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f4158400 0x7f99f40c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:18.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99f8c9e640 1 -- 172.21.15.55:0/2693136730 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f4158400 msgr2=0x7f99f40c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:18.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99f8c9e640 1 --2- 172.21.15.55:0/2693136730 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f4158400 0x7f99f40c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:18.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99f8c9e640 1 -- 172.21.15.55:0/2693136730 >> v1:172.21.15.55:6789/0 conn(0x7f99f40710c0 legacy=0x7f99f40cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:18.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99f8c9e640 1 -- 172.21.15.55:0/2693136730 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f4070380 con 0x7f99f40c9680 2023-07-06T22:20:18.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.051+0000 7f99ebfff640 1 -- 172.21.15.55:0/2693136730 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143497605 0 0) 0x7f99f406fae0 con 0x7f99f40710c0 2023-07-06T22:20:18.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.055+0000 7f99f8c9e640 1 --2- 172.21.15.55:0/2693136730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99f40c9680 0x7f99f4070b80 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f99e400ba60 tx=0x7f99e401eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2787896bc880676b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:18.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.055+0000 7f99ebfff640 1 -- 172.21.15.55:0/2693136730 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e40a7c10 con 0x7f99f40c9680 2023-07-06T22:20:18.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.055+0000 7f99ebfff640 1 -- 172.21.15.55:0/2693136730 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e40a7d70 con 0x7f99f40c9680 2023-07-06T22:20:18.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.055+0000 7f99ebfff640 1 -- 172.21.15.55:0/2693136730 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e40af660 con 0x7f99f40c9680 2023-07-06T22:20:18.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.055+0000 7f99fb703640 1 -- 172.21.15.55:0/2693136730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99f40c9680 msgr2=0x7f99f4070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:18.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.055+0000 7f99fb703640 1 --2- 172.21.15.55:0/2693136730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99f40c9680 0x7f99f4070b80 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f99e400ba60 tx=0x7f99e401eb20 comp rx=0 tx=0).stop 2023-07-06T22:20:18.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.055+0000 7f99fb703640 1 -- 172.21.15.55:0/2693136730 shutdown_connections 2023-07-06T22:20:18.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.055+0000 7f99fb703640 1 --2- 172.21.15.55:0/2693136730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99f40c9680 0x7f99f4070b80 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:18.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.055+0000 7f99fb703640 1 --2- 172.21.15.55:0/2693136730 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f4158400 0x7f99f40c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:18.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.055+0000 7f99fb703640 1 -- 172.21.15.55:0/2693136730 >> 172.21.15.55:0/2693136730 conn(0x7f99f40cded0 msgr2=0x7f99f40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:18.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.055+0000 7f99fb703640 1 -- 172.21.15.55:0/2693136730 shutdown_connections 2023-07-06T22:20:18.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.055+0000 7f99fb703640 1 -- 172.21.15.55:0/2693136730 wait complete. 2023-07-06T22:20:18.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99fb703640 1 Processor -- start 2023-07-06T22:20:18.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99fb703640 1 -- start start 2023-07-06T22:20:18.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99fb703640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99f40710c0 0x7f99f41f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:18.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99fb703640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99f40c9680 0x7f99f40b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:18.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99fb703640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f4158400 0x7f99f40b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:18.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99fb703640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f41f7c00 con 0x7f99f40710c0 2023-07-06T22:20:18.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99fb703640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f40c6290 con 0x7f99f40c9680 2023-07-06T22:20:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99fb703640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f40c6570 con 0x7f99f4158400 2023-07-06T22:20:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99f949f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99f40710c0 0x7f99f41f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99f949f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99f40710c0 0x7f99f41f48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43674/0 (socket says 172.21.15.55:43674) 2023-07-06T22:20:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99f949f640 1 -- 172.21.15.55:0/162602231 learned_addr learned my addr 172.21.15.55:0/162602231 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99f949f640 1 -- 172.21.15.55:0/162602231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f4158400 msgr2=0x7f99f40b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99f949f640 1 --2- 172.21.15.55:0/162602231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f4158400 0x7f99f40b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99f949f640 1 -- 172.21.15.55:0/162602231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99f40c9680 msgr2=0x7f99f40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:18.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99f949f640 1 --2- 172.21.15.55:0/162602231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99f40c9680 0x7f99f40b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:18.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99f949f640 1 -- 172.21.15.55:0/162602231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e400b6c0 con 0x7f99f40710c0 2023-07-06T22:20:18.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99f949f640 1 --2- 172.21.15.55:0/162602231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99f40710c0 0x7f99f41f48c0 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f99f000e870 tx=0x7f99f000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99e9ffb640 1 -- 172.21.15.55:0/162602231 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0009510 con 0x7f99f40710c0 2023-07-06T22:20:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99e9ffb640 1 -- 172.21.15.55:0/162602231 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f000eec0 con 0x7f99f40710c0 2023-07-06T22:20:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99fb703640 1 -- 172.21.15.55:0/162602231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f40c6850 con 0x7f99f40710c0 2023-07-06T22:20:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.059+0000 7f99e9ffb640 1 -- 172.21.15.55:0/162602231 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000cb40 con 0x7f99f40710c0 2023-07-06T22:20:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.063+0000 7f99fb703640 1 -- 172.21.15.55:0/162602231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f414bef0 con 0x7f99f40710c0 2023-07-06T22:20:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.063+0000 7f99fb703640 1 -- 172.21.15.55:0/162602231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f406c580 con 0x7f99f40710c0 2023-07-06T22:20:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.063+0000 7f99e9ffb640 1 -- 172.21.15.55:0/162602231 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f99f000cca0 con 0x7f99f40710c0 2023-07-06T22:20:18.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.063+0000 7f99e9ffb640 1 --2- 172.21.15.55:0/162602231 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f99d80663a0 0x7f99d8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:18.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.063+0000 7f99e9ffb640 1 -- 172.21.15.55:0/162602231 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f99f0084180 con 0x7f99f40710c0 2023-07-06T22:20:18.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.063+0000 7f99f8c9e640 1 --2- 172.21.15.55:0/162602231 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f99d80663a0 0x7f99d8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:18.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.063+0000 7f99f8c9e640 1 --2- 172.21.15.55:0/162602231 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f99d80663a0 0x7f99d8068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f99e40b1000 tx=0x7f99e4004740 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:18.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.067+0000 7f99e9ffb640 1 -- 172.21.15.55:0/162602231 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99f00512e0 con 0x7f99f40710c0 2023-07-06T22:20:18.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.255+0000 7f99fb703640 1 -- 172.21.15.55:0/162602231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99f4066d60 con 0x7f99f40710c0 2023-07-06T22:20:18.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.255+0000 7f99e9ffb640 1 -- 172.21.15.55:0/162602231 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+3531 (secure 0 0 0) 0x7f99f0017de0 con 0x7f99f40710c0 2023-07-06T22:20:18.258 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:18.259 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":81,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8420,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/10830186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":10830186},{"type":"v1","addr":"172.21.15.138:6834","nonce":10830186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9577,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/3623480690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3623480690},{"type":"v1","addr":"172.21.15.138:6835","nonce":3623480690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":10428,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2297427597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2297427597},{"type":"v1","addr":"172.21.15.55:6835","nonce":2297427597}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":10893,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2276479200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":2276479200},{"type":"v1","addr":"172.21.15.55:6837","nonce":2276479200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[]} 2023-07-06T22:20:18.259 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 81 2023-07-06T22:20:18.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.259+0000 7f99fb703640 1 -- 172.21.15.55:0/162602231 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f99d80663a0 msgr2=0x7f99d8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:18.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.259+0000 7f99fb703640 1 --2- 172.21.15.55:0/162602231 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f99d80663a0 0x7f99d8068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f99e40b1000 tx=0x7f99e4004740 comp rx=0 tx=0).stop 2023-07-06T22:20:18.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.259+0000 7f99fb703640 1 -- 172.21.15.55:0/162602231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99f40710c0 msgr2=0x7f99f41f48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:18.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.259+0000 7f99fb703640 1 --2- 172.21.15.55:0/162602231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99f40710c0 0x7f99f41f48c0 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f99f000e870 tx=0x7f99f000ec70 comp rx=0 tx=0).stop 2023-07-06T22:20:18.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.259+0000 7f99fb703640 1 -- 172.21.15.55:0/162602231 shutdown_connections 2023-07-06T22:20:18.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.259+0000 7f99fb703640 1 --2- 172.21.15.55:0/162602231 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f99d80663a0 0x7f99d8068850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:18.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.259+0000 7f99fb703640 1 --2- 172.21.15.55:0/162602231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f4158400 0x7f99f40b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:18.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.259+0000 7f99fb703640 1 --2- 172.21.15.55:0/162602231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99f40c9680 0x7f99f40b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:18.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.259+0000 7f99fb703640 1 --2- 172.21.15.55:0/162602231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99f40710c0 0x7f99f41f48c0 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:18.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.259+0000 7f99fb703640 1 -- 172.21.15.55:0/162602231 >> 172.21.15.55:0/162602231 conn(0x7f99f40cded0 msgr2=0x7f99f41572d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:18.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.259+0000 7f99fb703640 1 -- 172.21.15.55:0/162602231 shutdown_connections 2023-07-06T22:20:18.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.259+0000 7f99fb703640 1 -- 172.21.15.55:0/162602231 wait complete. 2023-07-06T22:20:18.280 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T22:20:18.280 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-06T22:20:18.281 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T22:20:18.281 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:20:18.281 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T22:20:18.281 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-06T22:20:18.282 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T22:20:18.282 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:20:18.282 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T22:20:18.282 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-06T22:20:18.282 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T22:20:18.283 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:20:18.283 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T22:20:18.283 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-06T22:20:18.283 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T22:20:18.283 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:20:18.292 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T22:20:18.293 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T22:20:18.293 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T22:20:18.294 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T22:20:18.298 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T22:20:18.298 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T22:20:18.299 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T22:20:18.299 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T22:20:18.338 INFO:tasks.ceph.mds.a:Started 2023-07-06T22:20:18.338 DEBUG:teuthology.parallel:result is None 2023-07-06T22:20:18.340 INFO:tasks.ceph.mds.c:Started 2023-07-06T22:20:18.340 DEBUG:teuthology.parallel:result is None 2023-07-06T22:20:18.346 INFO:tasks.ceph.mds.b:Started 2023-07-06T22:20:18.346 DEBUG:teuthology.parallel:result is None 2023-07-06T22:20:18.348 INFO:tasks.ceph.mds.d:Started 2023-07-06T22:20:18.348 DEBUG:teuthology.parallel:result is None 2023-07-06T22:20:18.349 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-06T22:20:18.426 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-07-06T22:20:18.427 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-07-06T22:20:18.442 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-07-06T22:20:18.443 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-07-06T22:20:18.444 INFO:tasks.ceph.mds.d.smithi138.stderr:2023-07-06T22:20:18.443+0000 7f46c6e63640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-07-06T22:20:18.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78f2007640 1 Processor -- start 2023-07-06T22:20:18.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78f2007640 1 -- start start 2023-07-06T22:20:18.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78f2007640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f78ec158850 0x7f78ec0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:18.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78f2007640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78ec0ca130 0x7f78ec0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:18.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78f2007640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec0b2aa0 con 0x7f78ec0703e0 2023-07-06T22:20:18.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78f2007640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ec158c20 con 0x7f78ec158850 2023-07-06T22:20:18.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78f2007640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0c8db0 con 0x7f78ec0ca130 2023-07-06T22:20:18.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78eb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f78ec158850 0x7f78ec0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:18.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78eb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f78ec158850 0x7f78ec0cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43726/0 (socket says 172.21.15.55:43726) 2023-07-06T22:20:18.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78eb7fe640 1 -- 172.21.15.55:0/1760711251 learned_addr learned my addr 172.21.15.55:0/1760711251 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:18.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78eaffd640 1 --2- 172.21.15.55:0/1760711251 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78ec0ca130 0x7f78ec0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:18.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78eb7fe640 1 -- 172.21.15.55:0/1760711251 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78ec0ca130 msgr2=0x7f78ec0ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:18.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78eb7fe640 1 --2- 172.21.15.55:0/1760711251 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78ec0ca130 0x7f78ec0ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:18.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78eb7fe640 1 -- 172.21.15.55:0/1760711251 >> v1:172.21.15.55:6789/0 conn(0x7f78ec0703e0 legacy=0x7f78ec06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:18.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.499+0000 7f78eb7fe640 1 -- 172.21.15.55:0/1760711251 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec0c9090 con 0x7f78ec158850 2023-07-06T22:20:18.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.503+0000 7f78eb7fe640 1 --2- 172.21.15.55:0/1760711251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec158850 0x7f78ec0cca30 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009870 tx=0x7f78dc020f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8d27e5323856c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:18.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.503+0000 7f78ea7fc640 1 -- 172.21.15.55:0/1760711251 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc0aac40 con 0x7f78ec158850 2023-07-06T22:20:18.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.503+0000 7f78ea7fc640 1 -- 172.21.15.55:0/1760711251 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc0aada0 con 0x7f78ec158850 2023-07-06T22:20:18.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.503+0000 7f78ea7fc640 1 -- 172.21.15.55:0/1760711251 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc0b2660 con 0x7f78ec158850 2023-07-06T22:20:18.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.503+0000 7f78f2007640 1 -- 172.21.15.55:0/1760711251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec158850 msgr2=0x7f78ec0cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:18.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.503+0000 7f78f2007640 1 --2- 172.21.15.55:0/1760711251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec158850 0x7f78ec0cca30 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009870 tx=0x7f78dc020f40 comp rx=0 tx=0).stop 2023-07-06T22:20:18.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.503+0000 7f78f2007640 1 -- 172.21.15.55:0/1760711251 shutdown_connections 2023-07-06T22:20:18.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.503+0000 7f78f2007640 1 --2- 172.21.15.55:0/1760711251 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78ec0ca130 0x7f78ec0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:18.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.503+0000 7f78f2007640 1 --2- 172.21.15.55:0/1760711251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec158850 0x7f78ec0cca30 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:18.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.503+0000 7f78f2007640 1 -- 172.21.15.55:0/1760711251 >> 172.21.15.55:0/1760711251 conn(0x7f78ec0cea70 msgr2=0x7f78ec0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:18.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.503+0000 7f78f2007640 1 -- 172.21.15.55:0/1760711251 shutdown_connections 2023-07-06T22:20:18.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.503+0000 7f78f2007640 1 -- 172.21.15.55:0/1760711251 wait complete. 2023-07-06T22:20:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78f2007640 1 Processor -- start 2023-07-06T22:20:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78f2007640 1 -- start start 2023-07-06T22:20:18.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78f2007640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78ec0703e0 0x7f78ec1ed520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:18.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78f2007640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78ec0ca130 0x7f78ec0693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:18.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78f2007640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec158850 0x7f78ec0ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:18.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78f2007640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0c7950 con 0x7f78ec158850 2023-07-06T22:20:18.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78f2007640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec1eda60 con 0x7f78ec0ca130 2023-07-06T22:20:18.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78f2007640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0c5e70 con 0x7f78ec0703e0 2023-07-06T22:20:18.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78ebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec158850 0x7f78ec0ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:18.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78ebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec158850 0x7f78ec0ae370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43740/0 (socket says 172.21.15.55:43740) 2023-07-06T22:20:18.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78ebfff640 1 -- 172.21.15.55:0/2750688909 learned_addr learned my addr 172.21.15.55:0/2750688909 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:18.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78eaffd640 1 --2- 172.21.15.55:0/2750688909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78ec0ca130 0x7f78ec0693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:18.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78eb7fe640 1 --2- 172.21.15.55:0/2750688909 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78ec0703e0 0x7f78ec1ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78ebfff640 1 -- 172.21.15.55:0/2750688909 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78ec0703e0 msgr2=0x7f78ec1ed520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78ebfff640 1 --2- 172.21.15.55:0/2750688909 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78ec0703e0 0x7f78ec1ed520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78ebfff640 1 -- 172.21.15.55:0/2750688909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78ec0ca130 msgr2=0x7f78ec0693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78ebfff640 1 --2- 172.21.15.55:0/2750688909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78ec0ca130 0x7f78ec0693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78ebfff640 1 -- 172.21.15.55:0/2750688909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc0094d0 con 0x7f78ec158850 2023-07-06T22:20:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78ebfff640 1 --2- 172.21.15.55:0/2750688909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec158850 0x7f78ec0ae370 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f78e400c7a0 tx=0x7f78e400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:18.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78d3fff640 1 -- 172.21.15.55:0/2750688909 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e4003b80 con 0x7f78ec158850 2023-07-06T22:20:18.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78d3fff640 1 -- 172.21.15.55:0/2750688909 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e4003ce0 con 0x7f78ec158850 2023-07-06T22:20:18.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78d3fff640 1 -- 172.21.15.55:0/2750688909 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e400aa30 con 0x7f78ec158850 2023-07-06T22:20:18.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.507+0000 7f78f2007640 1 -- 172.21.15.55:0/2750688909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec069930 con 0x7f78ec158850 2023-07-06T22:20:18.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.511+0000 7f78f2007640 1 -- 172.21.15.55:0/2750688909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec1f0b40 con 0x7f78ec158850 2023-07-06T22:20:18.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.511+0000 7f78f2007640 1 -- 172.21.15.55:0/2750688909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ec066d60 con 0x7f78ec158850 2023-07-06T22:20:18.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.511+0000 7f78d3fff640 1 -- 172.21.15.55:0/2750688909 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f78e400ab90 con 0x7f78ec158850 2023-07-06T22:20:18.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.511+0000 7f78d3fff640 1 --2- 172.21.15.55:0/2750688909 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f78d80663a0 0x7f78d8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:18.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.511+0000 7f78d3fff640 1 -- 172.21.15.55:0/2750688909 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f78e4083d60 con 0x7f78ec158850 2023-07-06T22:20:18.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.511+0000 7f78eb7fe640 1 --2- 172.21.15.55:0/2750688909 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f78d80663a0 0x7f78d8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:18.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.511+0000 7f78eb7fe640 1 --2- 172.21.15.55:0/2750688909 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f78d80663a0 0x7f78d8068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0b4000 tx=0x7f78dc009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.515+0000 7f78d3fff640 1 -- 172.21.15.55:0/2750688909 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78e4050f70 con 0x7f78ec158850 2023-07-06T22:20:18.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:18.683+0000 7f78f2007640 1 -- 172.21.15.55:0/2750688909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f78ec0adc50 con 0x7f78ec158850 2023-07-06T22:20:19.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.479+0000 7f78d3fff640 1 -- 172.21.15.55:0/2750688909 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v192) v1 ==== 97+0+0 (secure 0 0 0) 0x7f78e4054590 con 0x7f78ec158850 2023-07-06T22:20:19.482 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-07-06T22:20:19.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.483+0000 7f78f2007640 1 -- 172.21.15.55:0/2750688909 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f78d80663a0 msgr2=0x7f78d8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:19.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.483+0000 7f78f2007640 1 --2- 172.21.15.55:0/2750688909 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f78d80663a0 0x7f78d8068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0b4000 tx=0x7f78dc009040 comp rx=0 tx=0).stop 2023-07-06T22:20:19.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.483+0000 7f78f2007640 1 -- 172.21.15.55:0/2750688909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec158850 msgr2=0x7f78ec0ae370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:19.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.483+0000 7f78f2007640 1 --2- 172.21.15.55:0/2750688909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec158850 0x7f78ec0ae370 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f78e400c7a0 tx=0x7f78e400cc60 comp rx=0 tx=0).stop 2023-07-06T22:20:19.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.483+0000 7f78f2007640 1 -- 172.21.15.55:0/2750688909 shutdown_connections 2023-07-06T22:20:19.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.483+0000 7f78f2007640 1 --2- 172.21.15.55:0/2750688909 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f78d80663a0 0x7f78d8068850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:19.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.483+0000 7f78f2007640 1 --2- 172.21.15.55:0/2750688909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78ec158850 0x7f78ec0ae370 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:19.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.483+0000 7f78f2007640 1 --2- 172.21.15.55:0/2750688909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78ec0ca130 0x7f78ec0693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:19.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.483+0000 7f78f2007640 1 --2- 172.21.15.55:0/2750688909 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78ec0703e0 0x7f78ec1ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:19.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.483+0000 7f78f2007640 1 -- 172.21.15.55:0/2750688909 >> 172.21.15.55:0/2750688909 conn(0x7f78ec0cea70 msgr2=0x7f78ec0af400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:19.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.483+0000 7f78f2007640 1 -- 172.21.15.55:0/2750688909 shutdown_connections 2023-07-06T22:20:19.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.483+0000 7f78f2007640 1 -- 172.21.15.55:0/2750688909 wait complete. 2023-07-06T22:20:19.507 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-06T22:20:19.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.651+0000 7f5c737fa640 1 Processor -- start 2023-07-06T22:20:19.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.651+0000 7f5c737fa640 1 -- start start 2023-07-06T22:20:19.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c737fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c6c158400 0x7f5c6c0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:19.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c737fa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5c6c0c9680 0x7f5c6c070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:19.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c737fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6c06fae0 con 0x7f5c6c0710c0 2023-07-06T22:20:19.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c737fa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6c06fdc0 con 0x7f5c6c0c9680 2023-07-06T22:20:19.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c737fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0700a0 con 0x7f5c6c158400 2023-07-06T22:20:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c71d97640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5c6c0710c0 0x7f5c6c0cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59802/0 (socket says 172.21.15.55:59802) 2023-07-06T22:20:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c71d97640 1 -- 172.21.15.55:0/2296272194 learned_addr learned my addr 172.21.15.55:0/2296272194 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c70d95640 1 --2- 172.21.15.55:0/2296272194 >> v2:172.21.15.138:3300/0 conn(0x7f5c6c0c9680 0x7f5c6c070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c71596640 1 --2- 172.21.15.55:0/2296272194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c6c158400 0x7f5c6c0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 -- 172.21.15.55:0/2296272194 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736178010 0 0) 0x7f5c6c06fae0 con 0x7f5c6c0710c0 2023-07-06T22:20:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 -- 172.21.15.55:0/2296272194 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c58003530 con 0x7f5c6c0710c0 2023-07-06T22:20:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 -- 172.21.15.55:0/2296272194 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2653545372 0 0) 0x7f5c58003530 con 0x7f5c6c0710c0 2023-07-06T22:20:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 -- 172.21.15.55:0/2296272194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c6c158400 msgr2=0x7f5c6c0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 --2- 172.21.15.55:0/2296272194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c6c158400 0x7f5c6c0c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 -- 172.21.15.55:0/2296272194 >> v2:172.21.15.138:3300/0 conn(0x7f5c6c0c9680 msgr2=0x7f5c6c070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 --2- 172.21.15.55:0/2296272194 >> v2:172.21.15.138:3300/0 conn(0x7f5c6c0c9680 0x7f5c6c070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 -- 172.21.15.55:0/2296272194 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c070380 con 0x7f5c6c0710c0 2023-07-06T22:20:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 -- 172.21.15.55:0/2296272194 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f5c64001a00 con 0x7f5c6c0710c0 2023-07-06T22:20:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 -- 172.21.15.55:0/2296272194 >> v1:172.21.15.55:6789/0 conn(0x7f5c6c0710c0 legacy=0x7f5c6c0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 --2- 172.21.15.55:0/2296272194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c6c158400 0x7f5c58003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 --2- 172.21.15.55:0/2296272194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c58003f00 0x7f5c580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 --2- 172.21.15.55:0/2296272194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c58004d10 0x7f5c58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 -- 172.21.15.55:0/2296272194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c06fdc0 con 0x7f5c58004d10 2023-07-06T22:20:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 -- 172.21.15.55:0/2296272194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0700a0 con 0x7f5c58003f00 2023-07-06T22:20:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c63fff640 1 -- 172.21.15.55:0/2296272194 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5800b990 con 0x7f5c6c158400 2023-07-06T22:20:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c71d97640 1 --2- 172.21.15.55:0/2296272194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c58004d10 0x7f5c58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c71596640 1 --2- 172.21.15.55:0/2296272194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c6c158400 0x7f5c58003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c70d95640 1 --2- 172.21.15.55:0/2296272194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c58003f00 0x7f5c580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c71d97640 1 -- 172.21.15.55:0/2296272194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c6c158400 msgr2=0x7f5c58003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c71d97640 1 --2- 172.21.15.55:0/2296272194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c6c158400 0x7f5c58003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c71d97640 1 -- 172.21.15.55:0/2296272194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c58003f00 msgr2=0x7f5c580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c71d97640 1 --2- 172.21.15.55:0/2296272194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c58003f00 0x7f5c580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.655+0000 7f5c71d97640 1 -- 172.21.15.55:0/2296272194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c58003530 con 0x7f5c58004d10 2023-07-06T22:20:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.659+0000 7f5c71d97640 1 --2- 172.21.15.55:0/2296272194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c58004d10 0x7f5c58005180 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400a830 tx=0x7f5c6401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198a71983a263b6f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.659+0000 7f5c63fff640 1 -- 172.21.15.55:0/2296272194 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c640ad630 con 0x7f5c58004d10 2023-07-06T22:20:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.659+0000 7f5c63fff640 1 -- 172.21.15.55:0/2296272194 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c640a8070 con 0x7f5c58004d10 2023-07-06T22:20:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.659+0000 7f5c63fff640 1 -- 172.21.15.55:0/2296272194 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c640ada30 con 0x7f5c58004d10 2023-07-06T22:20:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.659+0000 7f5c737fa640 1 -- 172.21.15.55:0/2296272194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c58004d10 msgr2=0x7f5c58005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.659+0000 7f5c737fa640 1 --2- 172.21.15.55:0/2296272194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c58004d10 0x7f5c58005180 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400a830 tx=0x7f5c6401d360 comp rx=0 tx=0).stop 2023-07-06T22:20:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.659+0000 7f5c71d97640 1 -- 172.21.15.55:0/2296272194 reap_dead start 2023-07-06T22:20:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.659+0000 7f5c737fa640 1 -- 172.21.15.55:0/2296272194 shutdown_connections 2023-07-06T22:20:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.659+0000 7f5c737fa640 1 -- 172.21.15.55:0/2296272194 >> 172.21.15.55:0/2296272194 conn(0x7f5c6c0cded0 msgr2=0x7f5c6c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.659+0000 7f5c737fa640 1 -- 172.21.15.55:0/2296272194 shutdown_connections 2023-07-06T22:20:19.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.659+0000 7f5c737fa640 1 -- 172.21.15.55:0/2296272194 wait complete. 2023-07-06T22:20:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.659+0000 7f5c737fa640 1 Processor -- start 2023-07-06T22:20:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.659+0000 7f5c737fa640 1 -- start start 2023-07-06T22:20:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c737fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c58004d10 0x7f5c6c1f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:19.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c737fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c6c1f5040 0x7f5c6c1f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:19.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c737fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c6c1f2750 0x7f5c6c150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:19.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c737fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c1f54b0 con 0x7f5c58004d10 2023-07-06T22:20:19.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c737fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c1f5f50 con 0x7f5c6c1f5040 2023-07-06T22:20:19.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c737fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c14edb0 con 0x7f5c6c1f2750 2023-07-06T22:20:19.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c71596640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c58004d10 0x7f5c6c1f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:19.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c71596640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c58004d10 0x7f5c6c1f1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43758/0 (socket says 172.21.15.55:43758) 2023-07-06T22:20:19.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c71596640 1 -- 172.21.15.55:0/3566510805 learned_addr learned my addr 172.21.15.55:0/3566510805 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:19.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c71d97640 1 --2- 172.21.15.55:0/3566510805 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c6c1f2750 0x7f5c6c150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:19.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c70d95640 1 --2- 172.21.15.55:0/3566510805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c6c1f5040 0x7f5c6c1f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:19.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c71596640 1 -- 172.21.15.55:0/3566510805 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c6c1f2750 msgr2=0x7f5c6c150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:19.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c71596640 1 --2- 172.21.15.55:0/3566510805 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c6c1f2750 0x7f5c6c150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:19.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c71596640 1 -- 172.21.15.55:0/3566510805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c6c1f5040 msgr2=0x7f5c6c1f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:19.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c71596640 1 --2- 172.21.15.55:0/3566510805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c6c1f5040 0x7f5c6c1f2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c71596640 1 -- 172.21.15.55:0/3566510805 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c1f56b0 con 0x7f5c58004d10 2023-07-06T22:20:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c71596640 1 --2- 172.21.15.55:0/3566510805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c58004d10 0x7f5c6c1f1a30 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f5c680119d0 tx=0x7f5c68011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c61ffb640 1 -- 172.21.15.55:0/3566510805 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800fb50 con 0x7f5c58004d10 2023-07-06T22:20:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c61ffb640 1 -- 172.21.15.55:0/3566510805 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6800fcb0 con 0x7f5c58004d10 2023-07-06T22:20:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c61ffb640 1 -- 172.21.15.55:0/3566510805 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68014440 con 0x7f5c58004d10 2023-07-06T22:20:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c737fa640 1 -- 172.21.15.55:0/3566510805 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6c1f5990 con 0x7f5c58004d10 2023-07-06T22:20:19.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c737fa640 1 -- 172.21.15.55:0/3566510805 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6c0b24d0 con 0x7f5c58004d10 2023-07-06T22:20:19.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.663+0000 7f5c737fa640 1 -- 172.21.15.55:0/3566510805 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6c06c580 con 0x7f5c58004d10 2023-07-06T22:20:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.667+0000 7f5c61ffb640 1 -- 172.21.15.55:0/3566510805 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5c680145a0 con 0x7f5c58004d10 2023-07-06T22:20:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.667+0000 7f5c61ffb640 1 --2- 172.21.15.55:0/3566510805 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f5c500663a0 0x7f5c50068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.667+0000 7f5c61ffb640 1 -- 172.21.15.55:0/3566510805 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f5c68084520 con 0x7f5c58004d10 2023-07-06T22:20:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.667+0000 7f5c70d95640 1 --2- 172.21.15.55:0/3566510805 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f5c500663a0 0x7f5c50068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.667+0000 7f5c70d95640 1 --2- 172.21.15.55:0/3566510805 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f5c500663a0 0x7f5c50068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0b3b20 tx=0x7f5c5c008040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:19.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.671+0000 7f5c61ffb640 1 -- 172.21.15.55:0/3566510805 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5c680555d0 con 0x7f5c58004d10 2023-07-06T22:20:19.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.879+0000 7f5c737fa640 1 -- 172.21.15.55:0/3566510805 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5c6c0b2330 con 0x7f5c58004d10 2023-07-06T22:20:19.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.879+0000 7f5c61ffb640 1 -- 172.21.15.55:0/3566510805 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v29) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5c6c0b2330 con 0x7f5c58004d10 2023-07-06T22:20:19.884 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:19.884 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:20:19.884 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-07-06T22:20:19.884 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.884 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-07-06T22:20:19.884 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkWjb1JxAAMmLy+dPO5qyorBnuzazx6A==", 2023-07-06T22:20:19.884 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:20:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:20:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:20:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-07-06T22:20:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkpLLENBAAxMASh3qbELQMJ3XbPEX0Zw==", 2023-07-06T22:20:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:20:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:20:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:20:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-07-06T22:20:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkvOSfLxAAMEoqAPg1pb47e5a1G1QtAw==", 2023-07-06T22:20:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:20:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:20:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:20:19.888 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.888 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.888 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.888 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.888 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-07-06T22:20:19.888 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkeQIBARAApXT5zWLUqqMSdwYygZeatw==", 2023-07-06T22:20:19.888 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:20:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:20:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:20:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-07-06T22:20:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD5NKdkSIfzJxAAlXiG8PWFXQqIeugbdp7Eiw==", 2023-07-06T22:20:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:20:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:20:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-07-06T22:20:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD8NKdkv2iwLxAAxjFucMwaaH66wPQpoYSTGw==", 2023-07-06T22:20:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:20:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:20:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-07-06T22:20:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD/NKdk5w7XOBAAuiup4mcC02ZMCPHCU1Cl3A==", 2023-07-06T22:20:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:20:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:20:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-07-06T22:20:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQADNadksvRLBBAAE1YX9VgA8pWARIEZL8tbsQ==", 2023-07-06T22:20:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:20:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:20:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-07-06T22:20:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAJNadkn2HsChAAgwb7B9lHOMq2h0BNuhB/AQ==", 2023-07-06T22:20:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:20:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:20:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-07-06T22:20:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMNadkbonPERAA2PLg4NMr+4eW+FDAfPig1A==", 2023-07-06T22:20:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:20:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:20:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-07-06T22:20:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAPNadkQw76GBAAY9SIgsTUHqvThwjdpjuwpw==", 2023-07-06T22:20:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:20:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:20:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-07-06T22:20:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQASNadkr3gRHxAALbPUtIgImIK1UUoe6vcyjg==", 2023-07-06T22:20:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-07-06T22:20:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-07-06T22:20:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-07-06T22:20:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkaZgiBRAAvyBUd+qHLh/wwhgoE1MsVA==", 2023-07-06T22:20:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:20:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-07-06T22:20:19.900 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-06T22:20:19.900 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.900 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.900 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.900 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-07-06T22:20:19.900 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkOBqoDBAASIhzvCqkSAFLX2oc99MYqw==", 2023-07-06T22:20:19.900 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.900 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:20:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:20:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:20:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:20:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-07-06T22:20:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkgt/fCBAAlQY94DrR/nFTIVwSFCEToQ==", 2023-07-06T22:20:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:20:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:20:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:20:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:20:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-07-06T22:20:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDzNKdkd5zAEhAAU0Qo6NROIKRSlOncFUoTxQ==", 2023-07-06T22:20:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-07-06T22:20:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-07-06T22:20:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-07-06T22:20:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-07-06T22:20:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-07-06T22:20:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkjvG8ChAA5rpuV6+YETQS9UjMRUynxA==", 2023-07-06T22:20:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:20:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-07-06T22:20:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-07-06T22:20:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-07-06T22:20:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdk+RUVIxAAyQpmGAeL8K+Cy+fgK5BmCQ==", 2023-07-06T22:20:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:20:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T22:20:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-07-06T22:20:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDyNKdkLH8aHxAAzzX5YxumCYWYqo0rQfFA9g==", 2023-07-06T22:20:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-07-06T22:20:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-07-06T22:20:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-07-06T22:20:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-07-06T22:20:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-07-06T22:20:19.908 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:20:19.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.883+0000 7f5c737fa640 1 -- 172.21.15.55:0/3566510805 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f5c500663a0 msgr2=0x7f5c50068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:19.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.883+0000 7f5c737fa640 1 --2- 172.21.15.55:0/3566510805 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f5c500663a0 0x7f5c50068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0b3b20 tx=0x7f5c5c008040 comp rx=0 tx=0).stop 2023-07-06T22:20:19.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.883+0000 7f5c737fa640 1 -- 172.21.15.55:0/3566510805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c58004d10 msgr2=0x7f5c6c1f1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:19.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.883+0000 7f5c737fa640 1 --2- 172.21.15.55:0/3566510805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c58004d10 0x7f5c6c1f1a30 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f5c680119d0 tx=0x7f5c68011e90 comp rx=0 tx=0).stop 2023-07-06T22:20:19.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.883+0000 7f5c737fa640 1 -- 172.21.15.55:0/3566510805 shutdown_connections 2023-07-06T22:20:19.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.883+0000 7f5c737fa640 1 --2- 172.21.15.55:0/3566510805 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f5c500663a0 0x7f5c50068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:19.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.883+0000 7f5c737fa640 1 --2- 172.21.15.55:0/3566510805 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5c6c1f2750 0x7f5c6c150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:19.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.883+0000 7f5c737fa640 1 --2- 172.21.15.55:0/3566510805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c6c1f5040 0x7f5c6c1f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:19.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.883+0000 7f5c737fa640 1 --2- 172.21.15.55:0/3566510805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c58004d10 0x7f5c6c1f1a30 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:19.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.883+0000 7f5c737fa640 1 -- 172.21.15.55:0/3566510805 >> 172.21.15.55:0/3566510805 conn(0x7f5c6c0cded0 msgr2=0x7f5c6c157680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:19.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.883+0000 7f5c737fa640 1 -- 172.21.15.55:0/3566510805 shutdown_connections 2023-07-06T22:20:19.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:19.883+0000 7f5c737fa640 1 -- 172.21.15.55:0/3566510805 wait complete. 2023-07-06T22:20:19.911 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:20:20.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b9b27b640 1 Processor -- start 2023-07-06T22:20:20.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b9b27b640 1 -- start start 2023-07-06T22:20:20.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b9b27b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b940712f0 0x7f1b9406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b9b27b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1b940b3730 0x7f1b940c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b9b27b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b940ca6a0 con 0x7f1b940ca280 2023-07-06T22:20:20.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b9b27b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b94159cd0 con 0x7f1b940712f0 2023-07-06T22:20:20.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b9b27b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b940693f0 con 0x7f1b940b3730 2023-07-06T22:20:20.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b99017640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b940712f0 0x7f1b9406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b99017640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b940712f0 0x7f1b9406a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43760/0 (socket says 172.21.15.55:43760) 2023-07-06T22:20:20.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b99017640 1 -- 172.21.15.55:0/660221053 learned_addr learned my addr 172.21.15.55:0/660221053 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:20.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b98816640 1 --2- 172.21.15.55:0/660221053 >> v2:172.21.15.138:3300/0 conn(0x7f1b940b3730 0x7f1b940c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b99017640 1 -- 172.21.15.55:0/660221053 >> v2:172.21.15.138:3300/0 conn(0x7f1b940b3730 msgr2=0x7f1b940c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:20.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b99017640 1 --2- 172.21.15.55:0/660221053 >> v2:172.21.15.138:3300/0 conn(0x7f1b940b3730 0x7f1b940c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b99017640 1 -- 172.21.15.55:0/660221053 >> v1:172.21.15.138:6789/0 conn(0x7f1b940ca280 legacy=0x7f1b940c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:20.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.055+0000 7f1b99017640 1 -- 172.21.15.55:0/660221053 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9406aca0 con 0x7f1b940712f0 2023-07-06T22:20:20.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.059+0000 7f1b99017640 1 --2- 172.21.15.55:0/660221053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b940712f0 0x7f1b9406a610 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f1b94071a70 tx=0x7f1b9001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f007b228d2684333 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:20.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.059+0000 7f1b8bfff640 1 -- 172.21.15.55:0/660221053 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900ab600 con 0x7f1b940712f0 2023-07-06T22:20:20.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.059+0000 7f1b8bfff640 1 -- 172.21.15.55:0/660221053 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b900a7050 con 0x7f1b940712f0 2023-07-06T22:20:20.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.059+0000 7f1b8bfff640 1 -- 172.21.15.55:0/660221053 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900ab980 con 0x7f1b940712f0 2023-07-06T22:20:20.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.059+0000 7f1b9b27b640 1 -- 172.21.15.55:0/660221053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b940712f0 msgr2=0x7f1b9406a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.059+0000 7f1b9b27b640 1 --2- 172.21.15.55:0/660221053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b940712f0 0x7f1b9406a610 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f1b94071a70 tx=0x7f1b9001c490 comp rx=0 tx=0).stop 2023-07-06T22:20:20.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.059+0000 7f1b9b27b640 1 -- 172.21.15.55:0/660221053 shutdown_connections 2023-07-06T22:20:20.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.059+0000 7f1b9b27b640 1 --2- 172.21.15.55:0/660221053 >> v2:172.21.15.138:3300/0 conn(0x7f1b940b3730 0x7f1b940c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.059+0000 7f1b9b27b640 1 --2- 172.21.15.55:0/660221053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b940712f0 0x7f1b9406a610 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.059+0000 7f1b9b27b640 1 -- 172.21.15.55:0/660221053 >> 172.21.15.55:0/660221053 conn(0x7f1b940cded0 msgr2=0x7f1b940ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:20.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.059+0000 7f1b9b27b640 1 -- 172.21.15.55:0/660221053 shutdown_connections 2023-07-06T22:20:20.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.059+0000 7f1b9b27b640 1 -- 172.21.15.55:0/660221053 wait complete. 2023-07-06T22:20:20.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b9b27b640 1 Processor -- start 2023-07-06T22:20:20.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b9b27b640 1 -- start start 2023-07-06T22:20:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b9b27b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b940712f0 0x7f1b9415a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b9b27b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b940b3730 0x7f1b94147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b9b27b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b940ca280 0x7f1b94155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b9b27b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b940c6490 con 0x7f1b940712f0 2023-07-06T22:20:20.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b9b27b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9415aa50 con 0x7f1b940ca280 2023-07-06T22:20:20.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b9b27b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b941478a0 con 0x7f1b940b3730 2023-07-06T22:20:20.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b99017640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b940712f0 0x7f1b9415a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b99017640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b940712f0 0x7f1b9415a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43776/0 (socket says 172.21.15.55:43776) 2023-07-06T22:20:20.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b99017640 1 -- 172.21.15.55:0/4114483942 learned_addr learned my addr 172.21.15.55:0/4114483942 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:20.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b98816640 1 --2- 172.21.15.55:0/4114483942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b940b3730 0x7f1b94147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b99818640 1 --2- 172.21.15.55:0/4114483942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b940ca280 0x7f1b94155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b99017640 1 -- 172.21.15.55:0/4114483942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b940b3730 msgr2=0x7f1b94147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b99017640 1 --2- 172.21.15.55:0/4114483942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b940b3730 0x7f1b94147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b99017640 1 -- 172.21.15.55:0/4114483942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b940ca280 msgr2=0x7f1b94155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b99017640 1 --2- 172.21.15.55:0/4114483942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b940ca280 0x7f1b94155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b99017640 1 -- 172.21.15.55:0/4114483942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b900094d0 con 0x7f1b940712f0 2023-07-06T22:20:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b99017640 1 --2- 172.21.15.55:0/4114483942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b940712f0 0x7f1b9415a510 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f1b900ae040 tx=0x7f1b90019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b89ffb640 1 -- 172.21.15.55:0/4114483942 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900b4440 con 0x7f1b940712f0 2023-07-06T22:20:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b89ffb640 1 -- 172.21.15.55:0/4114483942 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b900b45c0 con 0x7f1b940712f0 2023-07-06T22:20:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b89ffb640 1 -- 172.21.15.55:0/4114483942 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900b4970 con 0x7f1b940712f0 2023-07-06T22:20:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.063+0000 7f1b9b27b640 1 -- 172.21.15.55:0/4114483942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b940c5ed0 con 0x7f1b940712f0 2023-07-06T22:20:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.067+0000 7f1b9b27b640 1 -- 172.21.15.55:0/4114483942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b94157f90 con 0x7f1b940712f0 2023-07-06T22:20:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.067+0000 7f1b9b27b640 1 -- 172.21.15.55:0/4114483942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b94066d60 con 0x7f1b940712f0 2023-07-06T22:20:20.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.067+0000 7f1b89ffb640 1 -- 172.21.15.55:0/4114483942 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1b900b2070 con 0x7f1b940712f0 2023-07-06T22:20:20.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.067+0000 7f1b89ffb640 1 --2- 172.21.15.55:0/4114483942 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f1b780663a0 0x7f1b78068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.067+0000 7f1b89ffb640 1 -- 172.21.15.55:0/4114483942 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f1b9011db00 con 0x7f1b940712f0 2023-07-06T22:20:20.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.067+0000 7f1b98816640 1 --2- 172.21.15.55:0/4114483942 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f1b780663a0 0x7f1b78068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.067+0000 7f1b98816640 1 --2- 172.21.15.55:0/4114483942 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f1b780663a0 0x7f1b78068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1b941f7260 tx=0x7f1b84008040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.071+0000 7f1b89ffb640 1 -- 172.21.15.55:0/4114483942 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b9011fe60 con 0x7f1b940712f0 2023-07-06T22:20:20.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.227+0000 7f1b9b27b640 1 -- 172.21.15.55:0/4114483942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b94072240 con 0x7f1b940712f0 2023-07-06T22:20:20.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.231+0000 7f1b89ffb640 1 -- 172.21.15.55:0/4114483942 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+14886 (secure 0 0 0) 0x7f1b900eea80 con 0x7f1b940712f0 2023-07-06T22:20:20.232 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:20.232 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":192,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:20:19.471628+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:20:20.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.231+0000 7f1b9b27b640 1 -- 172.21.15.55:0/4114483942 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f1b780663a0 msgr2=0x7f1b78068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.231+0000 7f1b9b27b640 1 --2- 172.21.15.55:0/4114483942 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f1b780663a0 0x7f1b78068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1b941f7260 tx=0x7f1b84008040 comp rx=0 tx=0).stop 2023-07-06T22:20:20.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.231+0000 7f1b9b27b640 1 -- 172.21.15.55:0/4114483942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b940712f0 msgr2=0x7f1b9415a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.231+0000 7f1b9b27b640 1 --2- 172.21.15.55:0/4114483942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b940712f0 0x7f1b9415a510 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f1b900ae040 tx=0x7f1b90019230 comp rx=0 tx=0).stop 2023-07-06T22:20:20.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.231+0000 7f1b9b27b640 1 -- 172.21.15.55:0/4114483942 shutdown_connections 2023-07-06T22:20:20.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.231+0000 7f1b9b27b640 1 --2- 172.21.15.55:0/4114483942 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f1b780663a0 0x7f1b78068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.231+0000 7f1b9b27b640 1 --2- 172.21.15.55:0/4114483942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b940ca280 0x7f1b94155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.231+0000 7f1b9b27b640 1 --2- 172.21.15.55:0/4114483942 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b940b3730 0x7f1b94147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.231+0000 7f1b9b27b640 1 --2- 172.21.15.55:0/4114483942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b940712f0 0x7f1b9415a510 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.231+0000 7f1b9b27b640 1 -- 172.21.15.55:0/4114483942 >> 172.21.15.55:0/4114483942 conn(0x7f1b940cded0 msgr2=0x7f1b940708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:20.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.231+0000 7f1b9b27b640 1 -- 172.21.15.55:0/4114483942 shutdown_connections 2023-07-06T22:20:20.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.231+0000 7f1b9b27b640 1 -- 172.21.15.55:0/4114483942 wait complete. 2023-07-06T22:20:20.253 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:20:20.253 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:20:20.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9933607640 1 Processor -- start 2023-07-06T22:20:20.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9933607640 1 -- start start 2023-07-06T22:20:20.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9933607640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f992c0c11a0 0x7f992c0cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9933607640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f992c06eee0 0x7f992c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9933607640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f992c06f890 0x7f992c163c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9933607640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992c1605f0 con 0x7f992c06eee0 2023-07-06T22:20:20.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9933607640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992c06ce00 con 0x7f992c06f890 2023-07-06T22:20:20.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9933607640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c0c4ca0 con 0x7f992c0c11a0 2023-07-06T22:20:20.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9930ba2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f992c06eee0 0x7f992c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9930ba2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f992c06eee0 0x7f992c06f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43790/0 (socket says 172.21.15.55:43790) 2023-07-06T22:20:20.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9930ba2640 1 -- 172.21.15.55:0/3921892992 learned_addr learned my addr 172.21.15.55:0/3921892992 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:20.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f99313a3640 1 --2- 172.21.15.55:0/3921892992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f992c0c11a0 0x7f992c0cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9931ba4640 1 --2- 172.21.15.55:0/3921892992 >> v2:172.21.15.138:3300/0 conn(0x7f992c06f890 0x7f992c163c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9930ba2640 1 -- 172.21.15.55:0/3921892992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f992c0c11a0 msgr2=0x7f992c0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:20.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9930ba2640 1 --2- 172.21.15.55:0/3921892992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f992c0c11a0 0x7f992c0cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9930ba2640 1 -- 172.21.15.55:0/3921892992 >> v2:172.21.15.138:3300/0 conn(0x7f992c06f890 msgr2=0x7f992c163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:20.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9930ba2640 1 --2- 172.21.15.55:0/3921892992 >> v2:172.21.15.138:3300/0 conn(0x7f992c06f890 0x7f992c163c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.399+0000 7f9930ba2640 1 -- 172.21.15.55:0/3921892992 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c0ccd70 con 0x7f992c06eee0 2023-07-06T22:20:20.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.403+0000 7f9930ba2640 1 --2- 172.21.15.55:0/3921892992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c06eee0 0x7f992c06f350 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f992c0ca740 tx=0x7f991c01c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504f9849f1f13c5e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:20.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.403+0000 7f9923fff640 1 -- 172.21.15.55:0/3921892992 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0ab600 con 0x7f992c06eee0 2023-07-06T22:20:20.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.403+0000 7f9923fff640 1 -- 172.21.15.55:0/3921892992 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c0a7050 con 0x7f992c06eee0 2023-07-06T22:20:20.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.403+0000 7f9923fff640 1 -- 172.21.15.55:0/3921892992 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0ab980 con 0x7f992c06eee0 2023-07-06T22:20:20.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.403+0000 7f9933607640 1 -- 172.21.15.55:0/3921892992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c06eee0 msgr2=0x7f992c06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.403+0000 7f9933607640 1 --2- 172.21.15.55:0/3921892992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c06eee0 0x7f992c06f350 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f992c0ca740 tx=0x7f991c01c1b0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.403+0000 7f9933607640 1 -- 172.21.15.55:0/3921892992 shutdown_connections 2023-07-06T22:20:20.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.403+0000 7f9933607640 1 --2- 172.21.15.55:0/3921892992 >> v2:172.21.15.138:3300/0 conn(0x7f992c06f890 0x7f992c163c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.403+0000 7f9933607640 1 --2- 172.21.15.55:0/3921892992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c06eee0 0x7f992c06f350 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.403+0000 7f9933607640 1 --2- 172.21.15.55:0/3921892992 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f992c0c11a0 0x7f992c0cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.403+0000 7f9933607640 1 -- 172.21.15.55:0/3921892992 >> 172.21.15.55:0/3921892992 conn(0x7f992c0cea70 msgr2=0x7f992c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:20.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.403+0000 7f9933607640 1 -- 172.21.15.55:0/3921892992 shutdown_connections 2023-07-06T22:20:20.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.403+0000 7f9933607640 1 -- 172.21.15.55:0/3921892992 wait complete. 2023-07-06T22:20:20.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9933607640 1 Processor -- start 2023-07-06T22:20:20.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9933607640 1 -- start start 2023-07-06T22:20:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9933607640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f992c06eee0 0x7f992c0c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9933607640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f992c06f890 0x7f992c0c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9933607640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c0c11a0 0x7f992c159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9933607640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c0c7d90 con 0x7f992c0c11a0 2023-07-06T22:20:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9933607640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c0c54b0 con 0x7f992c06eee0 2023-07-06T22:20:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9933607640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c0c6150 con 0x7f992c06f890 2023-07-06T22:20:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9931ba4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c0c11a0 0x7f992c159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9931ba4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c0c11a0 0x7f992c159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43806/0 (socket says 172.21.15.55:43806) 2023-07-06T22:20:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9931ba4640 1 -- 172.21.15.55:0/3747182276 learned_addr learned my addr 172.21.15.55:0/3747182276 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f99313a3640 1 --2- 172.21.15.55:0/3747182276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f992c06eee0 0x7f992c0c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9930ba2640 1 --2- 172.21.15.55:0/3747182276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f992c06f890 0x7f992c0c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9931ba4640 1 -- 172.21.15.55:0/3747182276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f992c06f890 msgr2=0x7f992c0c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9931ba4640 1 --2- 172.21.15.55:0/3747182276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f992c06f890 0x7f992c0c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9931ba4640 1 -- 172.21.15.55:0/3747182276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f992c06eee0 msgr2=0x7f992c0c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9931ba4640 1 --2- 172.21.15.55:0/3747182276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f992c06eee0 0x7f992c0c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9931ba4640 1 -- 172.21.15.55:0/3747182276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0094d0 con 0x7f992c0c11a0 2023-07-06T22:20:20.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9931ba4640 1 --2- 172.21.15.55:0/3747182276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c0c11a0 0x7f992c159a80 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f992400eed0 tx=0x7f992400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:20.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9921ffb640 1 -- 172.21.15.55:0/3747182276 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9924010040 con 0x7f992c0c11a0 2023-07-06T22:20:20.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9921ffb640 1 -- 172.21.15.55:0/3747182276 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9924014400 con 0x7f992c0c11a0 2023-07-06T22:20:20.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9921ffb640 1 -- 172.21.15.55:0/3747182276 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9924009ea0 con 0x7f992c0c11a0 2023-07-06T22:20:20.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.407+0000 7f9933607640 1 -- 172.21.15.55:0/3747182276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992c159fc0 con 0x7f992c0c11a0 2023-07-06T22:20:20.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.411+0000 7f9933607640 1 -- 172.21.15.55:0/3747182276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992c0c51d0 con 0x7f992c0c11a0 2023-07-06T22:20:20.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.411+0000 7f9933607640 1 -- 172.21.15.55:0/3747182276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992c066d60 con 0x7f992c0c11a0 2023-07-06T22:20:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.411+0000 7f9921ffb640 1 -- 172.21.15.55:0/3747182276 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f99240147b0 con 0x7f992c0c11a0 2023-07-06T22:20:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.411+0000 7f9921ffb640 1 --2- 172.21.15.55:0/3747182276 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f99100663a0 0x7f9910068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.411+0000 7f9921ffb640 1 -- 172.21.15.55:0/3747182276 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f9924084340 con 0x7f992c0c11a0 2023-07-06T22:20:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.411+0000 7f99313a3640 1 --2- 172.21.15.55:0/3747182276 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f99100663a0 0x7f9910068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.415+0000 7f99313a3640 1 --2- 172.21.15.55:0/3747182276 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f99100663a0 0x7f9910068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9928009ac0 tx=0x7f9928009190 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:20.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.415+0000 7f9921ffb640 1 -- 172.21.15.55:0/3747182276 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9924051830 con 0x7f992c0c11a0 2023-07-06T22:20:20.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.575+0000 7f9933607640 1 -- 172.21.15.55:0/3747182276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f992c0cb6c0 con 0x7f992c0c11a0 2023-07-06T22:20:20.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.575+0000 7f9921ffb640 1 -- 172.21.15.55:0/3747182276 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v192) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9924054e50 con 0x7f992c0c11a0 2023-07-06T22:20:20.577 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:20:20.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.575+0000 7f9933607640 1 -- 172.21.15.55:0/3747182276 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f99100663a0 msgr2=0x7f9910068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.575+0000 7f9933607640 1 --2- 172.21.15.55:0/3747182276 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f99100663a0 0x7f9910068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9928009ac0 tx=0x7f9928009190 comp rx=0 tx=0).stop 2023-07-06T22:20:20.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.575+0000 7f9933607640 1 -- 172.21.15.55:0/3747182276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c0c11a0 msgr2=0x7f992c159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.575+0000 7f9933607640 1 --2- 172.21.15.55:0/3747182276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c0c11a0 0x7f992c159a80 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f992400eed0 tx=0x7f992400b480 comp rx=0 tx=0).stop 2023-07-06T22:20:20.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.575+0000 7f9933607640 1 -- 172.21.15.55:0/3747182276 shutdown_connections 2023-07-06T22:20:20.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.575+0000 7f9933607640 1 --2- 172.21.15.55:0/3747182276 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f99100663a0 0x7f9910068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.575+0000 7f9933607640 1 --2- 172.21.15.55:0/3747182276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c0c11a0 0x7f992c159a80 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.575+0000 7f9933607640 1 --2- 172.21.15.55:0/3747182276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f992c06f890 0x7f992c0c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.575+0000 7f9933607640 1 --2- 172.21.15.55:0/3747182276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f992c06eee0 0x7f992c0c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.575+0000 7f9933607640 1 -- 172.21.15.55:0/3747182276 >> 172.21.15.55:0/3747182276 conn(0x7f992c0cea70 msgr2=0x7f992c0c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:20.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.575+0000 7f9933607640 1 -- 172.21.15.55:0/3747182276 shutdown_connections 2023-07-06T22:20:20.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.575+0000 7f9933607640 1 -- 172.21.15.55:0/3747182276 wait complete. 2023-07-06T22:20:20.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:20:20.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.743+0000 7f75a4396640 1 Processor -- start 2023-07-06T22:20:20.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.743+0000 7f75a4396640 1 -- start start 2023-07-06T22:20:20.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.743+0000 7f75a4396640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f759c070d70 0x7f759c0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.743+0000 7f75a4396640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c0b15a0 con 0x7f759c0b1170 2023-07-06T22:20:20.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.743+0000 7f75a4396640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c0cc030 con 0x7f759c0709a0 2023-07-06T22:20:20.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.743+0000 7f75a4396640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759c0cc300 con 0x7f759c070d70 2023-07-06T22:20:20.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.743+0000 7f75a1931640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f759c070d70 0x7f759c0b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.743+0000 7f75a1931640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f759c070d70 0x7f759c0b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43818/0 (socket says 172.21.15.55:43818) 2023-07-06T22:20:20.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.743+0000 7f75a1931640 1 -- 172.21.15.55:0/2738207109 learned_addr learned my addr 172.21.15.55:0/2738207109 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:20.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.743+0000 7f75a1931640 1 -- 172.21.15.55:0/2738207109 >> v1:172.21.15.138:6789/0 conn(0x7f759c0709a0 legacy=0x7f759c0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.743+0000 7f75a1931640 1 -- 172.21.15.55:0/2738207109 >> v1:172.21.15.55:6789/0 conn(0x7f759c0b1170 legacy=0x7f759c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.743+0000 7f75a1931640 1 -- 172.21.15.55:0/2738207109 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c0cc5e0 con 0x7f759c070d70 2023-07-06T22:20:20.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.747+0000 7f75a1931640 1 --2- 172.21.15.55:0/2738207109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759c070d70 0x7f759c0b0c30 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f758c009870 tx=0x7f758c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7437e5c832e63d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:20.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.747+0000 7f75a1130640 1 -- 172.21.15.55:0/2738207109 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0a7070 con 0x7f759c070d70 2023-07-06T22:20:20.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.747+0000 7f75a1130640 1 -- 172.21.15.55:0/2738207109 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c0ab430 con 0x7f759c070d70 2023-07-06T22:20:20.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.747+0000 7f75a1130640 1 -- 172.21.15.55:0/2738207109 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0ab7c0 con 0x7f759c070d70 2023-07-06T22:20:20.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.747+0000 7f75a4396640 1 -- 172.21.15.55:0/2738207109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759c070d70 msgr2=0x7f759c0b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.747+0000 7f75a4396640 1 --2- 172.21.15.55:0/2738207109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759c070d70 0x7f759c0b0c30 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f758c009870 tx=0x7f758c01c540 comp rx=0 tx=0).stop 2023-07-06T22:20:20.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.747+0000 7f75a4396640 1 -- 172.21.15.55:0/2738207109 shutdown_connections 2023-07-06T22:20:20.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.747+0000 7f75a4396640 1 --2- 172.21.15.55:0/2738207109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759c070d70 0x7f759c0b0c30 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.747+0000 7f75a4396640 1 -- 172.21.15.55:0/2738207109 >> 172.21.15.55:0/2738207109 conn(0x7f759c0cea70 msgr2=0x7f759c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:20.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.747+0000 7f75a4396640 1 -- 172.21.15.55:0/2738207109 shutdown_connections 2023-07-06T22:20:20.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.747+0000 7f75a4396640 1 -- 172.21.15.55:0/2738207109 wait complete. 2023-07-06T22:20:20.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.747+0000 7f75a4396640 1 Processor -- start 2023-07-06T22:20:20.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.747+0000 7f75a4396640 1 -- start start 2023-07-06T22:20:20.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a4396640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759c0709a0 0x7f759c0af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a4396640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f759c070d70 0x7f759c155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a4396640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759c0b1170 0x7f759c06b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a4396640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c06a4b0 con 0x7f759c0b1170 2023-07-06T22:20:20.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a4396640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c156dd0 con 0x7f759c070d70 2023-07-06T22:20:20.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a4396640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759c1576a0 con 0x7f759c0709a0 2023-07-06T22:20:20.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a2933640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759c0b1170 0x7f759c06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a2933640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759c0b1170 0x7f759c06b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43826/0 (socket says 172.21.15.55:43826) 2023-07-06T22:20:20.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a2933640 1 -- 172.21.15.55:0/2837824100 learned_addr learned my addr 172.21.15.55:0/2837824100 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:20.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a2132640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759c0709a0 0x7f759c0af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a1931640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f759c070d70 0x7f759c155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a2933640 1 -- 172.21.15.55:0/2837824100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759c0709a0 msgr2=0x7f759c0af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a2933640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759c0709a0 0x7f759c0af320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a2933640 1 -- 172.21.15.55:0/2837824100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f759c070d70 msgr2=0x7f759c155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a2933640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f759c070d70 0x7f759c155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a2933640 1 -- 172.21.15.55:0/2837824100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c0094d0 con 0x7f759c0b1170 2023-07-06T22:20:20.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a1931640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f759c070d70 0x7f759c155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:20.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a2933640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759c0b1170 0x7f759c06b960 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f759400c730 tx=0x7f759400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:20.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f7592ffd640 1 -- 172.21.15.55:0/2837824100 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594003b80 con 0x7f759c0b1170 2023-07-06T22:20:20.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f7592ffd640 1 -- 172.21.15.55:0/2837824100 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7594003ce0 con 0x7f759c0b1170 2023-07-06T22:20:20.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f7592ffd640 1 -- 172.21.15.55:0/2837824100 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759400aa30 con 0x7f759c0b1170 2023-07-06T22:20:20.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a4396640 1 -- 172.21.15.55:0/2837824100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c069ef0 con 0x7f759c0b1170 2023-07-06T22:20:20.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a4396640 1 -- 172.21.15.55:0/2837824100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c156530 con 0x7f759c0b1170 2023-07-06T22:20:20.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.751+0000 7f75a4396640 1 -- 172.21.15.55:0/2837824100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759c066d60 con 0x7f759c0b1170 2023-07-06T22:20:20.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.755+0000 7f7592ffd640 1 -- 172.21.15.55:0/2837824100 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f759400ab90 con 0x7f759c0b1170 2023-07-06T22:20:20.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.755+0000 7f7592ffd640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f75800663a0 0x7f7580068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:20.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.755+0000 7f7592ffd640 1 -- 172.21.15.55:0/2837824100 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f7594083b60 con 0x7f759c0b1170 2023-07-06T22:20:20.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.755+0000 7f75a2132640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f75800663a0 0x7f7580068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:20.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.755+0000 7f75a2132640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f75800663a0 0x7f7580068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7598000f70 tx=0x7f7598009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:20.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.759+0000 7f7592ffd640 1 -- 172.21.15.55:0/2837824100 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7594051030 con 0x7f759c0b1170 2023-07-06T22:20:20.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.911+0000 7f75a4396640 1 -- 172.21.15.55:0/2837824100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f759c0c7e50 con 0x7f759c0b1170 2023-07-06T22:20:20.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.911+0000 7f7592ffd640 1 -- 172.21.15.55:0/2837824100 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v192) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7594054650 con 0x7f759c0b1170 2023-07-06T22:20:20.915 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:20:20.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.915+0000 7f75a4396640 1 -- 172.21.15.55:0/2837824100 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f75800663a0 msgr2=0x7f7580068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.915+0000 7f75a4396640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f75800663a0 0x7f7580068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7598000f70 tx=0x7f7598009040 comp rx=0 tx=0).stop 2023-07-06T22:20:20.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.915+0000 7f75a4396640 1 -- 172.21.15.55:0/2837824100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759c0b1170 msgr2=0x7f759c06b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:20.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.915+0000 7f75a4396640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759c0b1170 0x7f759c06b960 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f759400c730 tx=0x7f759400cbf0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.915+0000 7f75a4396640 1 -- 172.21.15.55:0/2837824100 shutdown_connections 2023-07-06T22:20:20.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.915+0000 7f75a4396640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f75800663a0 0x7f7580068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.915+0000 7f75a4396640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759c0b1170 0x7f759c06b960 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.915+0000 7f75a4396640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f759c070d70 0x7f759c155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.915+0000 7f75a4396640 1 --2- 172.21.15.55:0/2837824100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f759c0709a0 0x7f759c0af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:20.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.915+0000 7f75a4396640 1 -- 172.21.15.55:0/2837824100 >> 172.21.15.55:0/2837824100 conn(0x7f759c0cea70 msgr2=0x7f759c09dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:20.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.915+0000 7f75a4396640 1 -- 172.21.15.55:0/2837824100 shutdown_connections 2023-07-06T22:20:20.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:20.915+0000 7f75a4396640 1 -- 172.21.15.55:0/2837824100 wait complete. 2023-07-06T22:20:20.936 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T22:20:21.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.075+0000 7f3568740640 1 Processor -- start 2023-07-06T22:20:21.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.075+0000 7f3568740640 1 -- start start 2023-07-06T22:20:21.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f3568740640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f356006f8e0 0x7f356006fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f3568740640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356015c770 con 0x7f356015bc40 2023-07-06T22:20:21.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f3568740640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356006d4f0 con 0x7f356015cc00 2023-07-06T22:20:21.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f3568740640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35600701f0 con 0x7f356006f8e0 2023-07-06T22:20:21.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f3565cdb640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f356015bc40 0x7f356006c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59820/0 (socket says 172.21.15.55:59820) 2023-07-06T22:20:21.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f3565cdb640 1 -- 172.21.15.55:0/3876441558 learned_addr learned my addr 172.21.15.55:0/3876441558 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:21.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35664dc640 1 --2- 172.21.15.55:0/3876441558 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f356006f8e0 0x7f356006fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438474824 0 0) 0x7f356015c770 con 0x7f356015bc40 2023-07-06T22:20:21.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f354c003530 con 0x7f356015bc40 2023-07-06T22:20:21.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299045028 0 0) 0x7f356006d4f0 con 0x7f356015cc00 2023-07-06T22:20:21.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f356015c770 con 0x7f356015cc00 2023-07-06T22:20:21.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3184763044 0 0) 0x7f354c003530 con 0x7f356015bc40 2023-07-06T22:20:21.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f356006f8e0 msgr2=0x7f356006fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:21.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 --2- 172.21.15.55:0/3876441558 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f356006f8e0 0x7f356006fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 >> v1:172.21.15.138:6789/0 conn(0x7f356015cc00 legacy=0x7f356015f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:21.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356006d210 con 0x7f356015bc40 2023-07-06T22:20:21.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f3550001680 con 0x7f356015bc40 2023-07-06T22:20:21.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 >> v1:172.21.15.55:6789/0 conn(0x7f356015bc40 legacy=0x7f356006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:21.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 --2- 172.21.15.55:0/3876441558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f354c003b40 0x7f354c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 --2- 172.21.15.55:0/3876441558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f354c0047d0 0x7f354c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 --2- 172.21.15.55:0/3876441558 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f356006f8e0 0x7f354c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35600701f0 con 0x7f354c003b40 2023-07-06T22:20:21.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c00ba40 con 0x7f354c0047d0 2023-07-06T22:20:21.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354c00bc00 con 0x7f356006f8e0 2023-07-06T22:20:21.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35664dc640 1 --2- 172.21.15.55:0/3876441558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f354c003b40 0x7f354c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f3565cdb640 1 --2- 172.21.15.55:0/3876441558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f354c0047d0 0x7f354c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f3566cdd640 1 --2- 172.21.15.55:0/3876441558 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f356006f8e0 0x7f354c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35664dc640 1 -- 172.21.15.55:0/3876441558 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f356006f8e0 msgr2=0x7f354c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:21.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35664dc640 1 --2- 172.21.15.55:0/3876441558 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f356006f8e0 0x7f354c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35664dc640 1 -- 172.21.15.55:0/3876441558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f354c0047d0 msgr2=0x7f354c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:21.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35664dc640 1 --2- 172.21.15.55:0/3876441558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f354c0047d0 0x7f354c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f35664dc640 1 -- 172.21.15.55:0/3876441558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c003530 con 0x7f354c003b40 2023-07-06T22:20:21.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.079+0000 7f3565cdb640 1 --2- 172.21.15.55:0/3876441558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f354c0047d0 0x7f354c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:21.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.083+0000 7f35664dc640 1 --2- 172.21.15.55:0/3876441558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f354c003b40 0x7f354c003f30 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f355c009ab0 tx=0x7f355c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02d4385f6a58694 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:21.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.083+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0a64e0 con 0x7f354c003b40 2023-07-06T22:20:21.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.083+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c0a6640 con 0x7f354c003b40 2023-07-06T22:20:21.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.083+0000 7f35654da640 1 -- 172.21.15.55:0/3876441558 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0a69f0 con 0x7f354c003b40 2023-07-06T22:20:21.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.083+0000 7f3568740640 1 -- 172.21.15.55:0/3876441558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f354c003b40 msgr2=0x7f354c003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:21.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.083+0000 7f3568740640 1 --2- 172.21.15.55:0/3876441558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f354c003b40 0x7f354c003f30 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f355c009ab0 tx=0x7f355c01ca10 comp rx=0 tx=0).stop 2023-07-06T22:20:21.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.083+0000 7f3566cdd640 1 -- 172.21.15.55:0/3876441558 reap_dead start 2023-07-06T22:20:21.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.083+0000 7f3568740640 1 -- 172.21.15.55:0/3876441558 shutdown_connections 2023-07-06T22:20:21.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.083+0000 7f3568740640 1 -- 172.21.15.55:0/3876441558 >> 172.21.15.55:0/3876441558 conn(0x7f35600cbd80 msgr2=0x7f35600ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:21.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.083+0000 7f3568740640 1 -- 172.21.15.55:0/3876441558 shutdown_connections 2023-07-06T22:20:21.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.083+0000 7f3568740640 1 -- 172.21.15.55:0/3876441558 wait complete. 2023-07-06T22:20:21.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3568740640 1 Processor -- start 2023-07-06T22:20:21.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3568740640 1 -- start start 2023-07-06T22:20:21.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3568740640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f354c003b40 0x7f35601449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3568740640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35601598f0 0x7f35600b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3568740640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f356006b3b0 0x7f356006b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3568740640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356006bd60 con 0x7f356006b3b0 2023-07-06T22:20:21.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3568740640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35600c5740 con 0x7f35601598f0 2023-07-06T22:20:21.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3568740640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35600b3f70 con 0x7f354c003b40 2023-07-06T22:20:21.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3566cdd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f356006b3b0 0x7f356006b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3566cdd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f356006b3b0 0x7f356006b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43834/0 (socket says 172.21.15.55:43834) 2023-07-06T22:20:21.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3566cdd640 1 -- 172.21.15.55:0/2868056151 learned_addr learned my addr 172.21.15.55:0/2868056151 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:21.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f35664dc640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f354c003b40 0x7f35601449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3565cdb640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35601598f0 0x7f35600b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3566cdd640 1 -- 172.21.15.55:0/2868056151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f354c003b40 msgr2=0x7f35601449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:21.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3566cdd640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f354c003b40 0x7f35601449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3566cdd640 1 -- 172.21.15.55:0/2868056151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35601598f0 msgr2=0x7f35600b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:21.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3566cdd640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35601598f0 0x7f35600b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3566cdd640 1 -- 172.21.15.55:0/2868056151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35601603e0 con 0x7f356006b3b0 2023-07-06T22:20:21.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3565cdb640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35601598f0 0x7f35600b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:21.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f35664dc640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f354c003b40 0x7f35601449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:21.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3566cdd640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f356006b3b0 0x7f356006b820 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f356015cfd0 tx=0x7f355800e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:21.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3556ffd640 1 -- 172.21.15.55:0/2868056151 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355800ee10 con 0x7f356006b3b0 2023-07-06T22:20:21.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3556ffd640 1 -- 172.21.15.55:0/2868056151 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3558006b60 con 0x7f356006b3b0 2023-07-06T22:20:21.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3556ffd640 1 -- 172.21.15.55:0/2868056151 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558003980 con 0x7f356006b3b0 2023-07-06T22:20:21.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3568740640 1 -- 172.21.15.55:0/2868056151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35600b4250 con 0x7f356006b3b0 2023-07-06T22:20:21.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3568740640 1 -- 172.21.15.55:0/2868056151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35600c5c70 con 0x7f356006b3b0 2023-07-06T22:20:21.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.087+0000 7f3568740640 1 -- 172.21.15.55:0/2868056151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3560066d60 con 0x7f356006b3b0 2023-07-06T22:20:21.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.091+0000 7f3556ffd640 1 -- 172.21.15.55:0/2868056151 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3558003ae0 con 0x7f356006b3b0 2023-07-06T22:20:21.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.091+0000 7f3556ffd640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f35440663a0 0x7f3544068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.091+0000 7f3556ffd640 1 -- 172.21.15.55:0/2868056151 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f3558082d60 con 0x7f356006b3b0 2023-07-06T22:20:21.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.091+0000 7f35664dc640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f35440663a0 0x7f3544068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.091+0000 7f35664dc640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f35440663a0 0x7f3544068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f355c009ab0 tx=0x7f355c0046d0 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:21.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.095+0000 7f3556ffd640 1 -- 172.21.15.55:0/2868056151 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35580502b0 con 0x7f356006b3b0 2023-07-06T22:20:21.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.251+0000 7f3568740640 1 -- 172.21.15.55:0/2868056151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f35600afd30 con 0x7f356006b3b0 2023-07-06T22:20:21.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.251+0000 7f3556ffd640 1 -- 172.21.15.55:0/2868056151 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v192) v1 ==== 84+0+126 (secure 0 0 0) 0x7f355801b020 con 0x7f356006b3b0 2023-07-06T22:20:21.256 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:21.256 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T22:20:21.256 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:21.256 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-07-06T22:20:21.256 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-07-06T22:20:21.257 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-07-06T22:20:21.257 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:21.257 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-07-06T22:20:21.257 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-07-06T22:20:21.257 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:21.257 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T22:20:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.255+0000 7f3568740640 1 -- 172.21.15.55:0/2868056151 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f35440663a0 msgr2=0x7f3544068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.255+0000 7f3568740640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f35440663a0 0x7f3544068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f355c009ab0 tx=0x7f355c0046d0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.255+0000 7f3568740640 1 -- 172.21.15.55:0/2868056151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f356006b3b0 msgr2=0x7f356006b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.255+0000 7f3568740640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f356006b3b0 0x7f356006b820 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f356015cfd0 tx=0x7f355800e850 comp rx=0 tx=0).stop 2023-07-06T22:20:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.255+0000 7f3568740640 1 -- 172.21.15.55:0/2868056151 shutdown_connections 2023-07-06T22:20:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.255+0000 7f3568740640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f35440663a0 0x7f3544068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.255+0000 7f3568740640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f356006b3b0 0x7f356006b820 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.255+0000 7f3568740640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35601598f0 0x7f35600b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.255+0000 7f3568740640 1 --2- 172.21.15.55:0/2868056151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f354c003b40 0x7f35601449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.255+0000 7f3568740640 1 -- 172.21.15.55:0/2868056151 >> 172.21.15.55:0/2868056151 conn(0x7f35600cbd80 msgr2=0x7f35600aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.255+0000 7f3568740640 1 -- 172.21.15.55:0/2868056151 shutdown_connections 2023-07-06T22:20:21.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.255+0000 7f3568740640 1 -- 172.21.15.55:0/2868056151 wait complete. 2023-07-06T22:20:21.276 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T22:20:21.277 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T22:20:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6c2f37640 1 Processor -- start 2023-07-06T22:20:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6c2f37640 1 -- start start 2023-07-06T22:20:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6c2f37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc15dd50 0x7fb6bc069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6c2f37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc0b3e70 con 0x7fb6bc0c9b90 2023-07-06T22:20:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6c2f37640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc159c30 con 0x7fb6bc0ccb70 2023-07-06T22:20:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6c2f37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc0c9070 con 0x7fb6bc15dd50 2023-07-06T22:20:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6c0cd3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb6bc0c9b90 0x7fb6bc0c9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59824/0 (socket says 172.21.15.55:59824) 2023-07-06T22:20:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6c0cd3640 1 -- 172.21.15.55:0/650119300 learned_addr learned my addr 172.21.15.55:0/650119300 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 -- 172.21.15.55:0/650119300 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106241039 0 0) 0x7fb6b0001120 con 0x7fb6bc0c9b90 2023-07-06T22:20:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 -- 172.21.15.55:0/650119300 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6ac003530 con 0x7fb6bc0c9b90 2023-07-06T22:20:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6c14d4640 1 --2- 172.21.15.55:0/650119300 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc15dd50 0x7fb6bc069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 -- 172.21.15.55:0/650119300 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2571519837 0 0) 0x7fb6ac003530 con 0x7fb6bc0c9b90 2023-07-06T22:20:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 -- 172.21.15.55:0/650119300 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc15dd50 msgr2=0x7fb6bc069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 --2- 172.21.15.55:0/650119300 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc15dd50 0x7fb6bc069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 -- 172.21.15.55:0/650119300 >> v1:172.21.15.138:6789/0 conn(0x7fb6bc0ccb70 legacy=0x7fb6bc0693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 -- 172.21.15.55:0/650119300 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc15e1b0 con 0x7fb6bc0c9b90 2023-07-06T22:20:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 -- 172.21.15.55:0/650119300 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fb6b0001810 con 0x7fb6bc0c9b90 2023-07-06T22:20:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 -- 172.21.15.55:0/650119300 >> v1:172.21.15.55:6789/0 conn(0x7fb6bc0c9b90 legacy=0x7fb6bc0c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 --2- 172.21.15.55:0/650119300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0039b0 0x7fb6ac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 --2- 172.21.15.55:0/650119300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6ac0047d0 0x7fb6ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 --2- 172.21.15.55:0/650119300 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc15dd50 0x7fb6ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 -- 172.21.15.55:0/650119300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc0c9070 con 0x7fb6ac0039b0 2023-07-06T22:20:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 -- 172.21.15.55:0/650119300 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac00bac0 con 0x7fb6ac0047d0 2023-07-06T22:20:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6bb7fe640 1 -- 172.21.15.55:0/650119300 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac00bc80 con 0x7fb6bc15dd50 2023-07-06T22:20:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.423+0000 7fb6c0cd3640 1 --2- 172.21.15.55:0/650119300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0039b0 0x7fb6ac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6c14d4640 1 --2- 172.21.15.55:0/650119300 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc15dd50 0x7fb6ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6bbfff640 1 --2- 172.21.15.55:0/650119300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6ac0047d0 0x7fb6ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6c0cd3640 1 -- 172.21.15.55:0/650119300 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc15dd50 msgr2=0x7fb6ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6c0cd3640 1 --2- 172.21.15.55:0/650119300 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc15dd50 0x7fb6ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6c0cd3640 1 -- 172.21.15.55:0/650119300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6ac0047d0 msgr2=0x7fb6ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6c0cd3640 1 --2- 172.21.15.55:0/650119300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6ac0047d0 0x7fb6ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6c0cd3640 1 -- 172.21.15.55:0/650119300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac003530 con 0x7fb6ac0039b0 2023-07-06T22:20:21.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6c14d4640 1 --2- 172.21.15.55:0/650119300 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc15dd50 0x7fb6ac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:21.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6bbfff640 1 --2- 172.21.15.55:0/650119300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6ac0047d0 0x7fb6ac004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:21.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6c0cd3640 1 --2- 172.21.15.55:0/650119300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0039b0 0x7fb6ac003dc0 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c190 tx=0x7fb6b001cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c7d5ad221efa7b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:21.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6bb7fe640 1 -- 172.21.15.55:0/650119300 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0005ae0 con 0x7fb6ac0039b0 2023-07-06T22:20:21.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6bb7fe640 1 -- 172.21.15.55:0/650119300 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b0005c60 con 0x7fb6ac0039b0 2023-07-06T22:20:21.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6bb7fe640 1 -- 172.21.15.55:0/650119300 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0007070 con 0x7fb6ac0039b0 2023-07-06T22:20:21.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6c2f37640 1 -- 172.21.15.55:0/650119300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0039b0 msgr2=0x7fb6ac003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:21.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6c2f37640 1 --2- 172.21.15.55:0/650119300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0039b0 0x7fb6ac003dc0 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c190 tx=0x7fb6b001cb60 comp rx=0 tx=0).stop 2023-07-06T22:20:21.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.427+0000 7fb6c14d4640 1 -- 172.21.15.55:0/650119300 reap_dead start 2023-07-06T22:20:21.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c2f37640 1 -- 172.21.15.55:0/650119300 shutdown_connections 2023-07-06T22:20:21.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c2f37640 1 -- 172.21.15.55:0/650119300 >> 172.21.15.55:0/650119300 conn(0x7fb6bc0cde30 msgr2=0x7fb6bc0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:21.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c2f37640 1 -- 172.21.15.55:0/650119300 shutdown_connections 2023-07-06T22:20:21.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c2f37640 1 -- 172.21.15.55:0/650119300 wait complete. 2023-07-06T22:20:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c2f37640 1 Processor -- start 2023-07-06T22:20:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c2f37640 1 -- start start 2023-07-06T22:20:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c2f37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0039b0 0x7fb6bc151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c2f37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6bc1f7570 0x7fb6bc1f79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c2f37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc1587b0 0x7fb6bc158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c2f37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc159160 con 0x7fb6ac0039b0 2023-07-06T22:20:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c2f37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc0b0dd0 con 0x7fb6bc1f7570 2023-07-06T22:20:21.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c2f37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc1f8030 con 0x7fb6bc1587b0 2023-07-06T22:20:21.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c0cd3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0039b0 0x7fb6bc151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c0cd3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0039b0 0x7fb6bc151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43858/0 (socket says 172.21.15.55:43858) 2023-07-06T22:20:21.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c0cd3640 1 -- 172.21.15.55:0/2880337289 learned_addr learned my addr 172.21.15.55:0/2880337289 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:21.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c14d4640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc1587b0 0x7fb6bc158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6bbfff640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6bc1f7570 0x7fb6bc1f79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c0cd3640 1 -- 172.21.15.55:0/2880337289 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc1587b0 msgr2=0x7fb6bc158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:21.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c0cd3640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc1587b0 0x7fb6bc158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c0cd3640 1 -- 172.21.15.55:0/2880337289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6bc1f7570 msgr2=0x7fb6bc1f79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:21.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c0cd3640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6bc1f7570 0x7fb6bc1f79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:21.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c0cd3640 1 -- 172.21.15.55:0/2880337289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc1f8310 con 0x7fb6ac0039b0 2023-07-06T22:20:21.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c14d4640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc1587b0 0x7fb6bc158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:21.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6bbfff640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6bc1f7570 0x7fb6bc1f79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:21.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.431+0000 7fb6c0cd3640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0039b0 0x7fb6bc151580 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0000c10 tx=0x7fb6ac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:21.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.435+0000 7fb6b97fa640 1 -- 172.21.15.55:0/2880337289 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b00b4070 con 0x7fb6ac0039b0 2023-07-06T22:20:21.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.435+0000 7fb6b97fa640 1 -- 172.21.15.55:0/2880337289 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b00011e0 con 0x7fb6ac0039b0 2023-07-06T22:20:21.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.435+0000 7fb6b97fa640 1 -- 172.21.15.55:0/2880337289 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0007090 con 0x7fb6ac0039b0 2023-07-06T22:20:21.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.435+0000 7fb6c2f37640 1 -- 172.21.15.55:0/2880337289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6bc0b1090 con 0x7fb6ac0039b0 2023-07-06T22:20:21.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.435+0000 7fb6c2f37640 1 -- 172.21.15.55:0/2880337289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc15c7b0 con 0x7fb6ac0039b0 2023-07-06T22:20:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.435+0000 7fb6c2f37640 1 -- 172.21.15.55:0/2880337289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6bc066d60 con 0x7fb6ac0039b0 2023-07-06T22:20:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.435+0000 7fb6b97fa640 1 -- 172.21.15.55:0/2880337289 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb6b00071f0 con 0x7fb6ac0039b0 2023-07-06T22:20:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.435+0000 7fb6b97fa640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb6a00663a0 0x7fb6a0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.435+0000 7fb6b97fa640 1 -- 172.21.15.55:0/2880337289 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5558+0+0 (secure 0 0 0) 0x7fb6b011d6c0 con 0x7fb6ac0039b0 2023-07-06T22:20:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.435+0000 7fb6bbfff640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb6a00663a0 0x7fb6a0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:21.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.439+0000 7fb6bbfff640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb6a00663a0 0x7fb6a0068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc15a000 tx=0x7fb6a8009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:21.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.439+0000 7fb6b97fa640 1 -- 172.21.15.55:0/2880337289 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6b00eacb0 con 0x7fb6ac0039b0 2023-07-06T22:20:21.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:21.595+0000 7fb6c2f37640 1 -- 172.21.15.55:0/2880337289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb6bc0b3e70 con 0x7fb6ac0039b0 2023-07-06T22:20:22.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.319+0000 7fb6b97fa640 1 -- 172.21.15.55:0/2880337289 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v193) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb6bc0b3e70 con 0x7fb6ac0039b0 2023-07-06T22:20:22.320 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-07-06T22:20:22.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.319+0000 7fb6c2f37640 1 -- 172.21.15.55:0/2880337289 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb6a00663a0 msgr2=0x7fb6a0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:22.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.319+0000 7fb6c2f37640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb6a00663a0 0x7fb6a0068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc15a000 tx=0x7fb6a8009040 comp rx=0 tx=0).stop 2023-07-06T22:20:22.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.319+0000 7fb6c2f37640 1 -- 172.21.15.55:0/2880337289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0039b0 msgr2=0x7fb6bc151580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:22.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.319+0000 7fb6c2f37640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0039b0 0x7fb6bc151580 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0000c10 tx=0x7fb6ac005800 comp rx=0 tx=0).stop 2023-07-06T22:20:22.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.323+0000 7fb6c2f37640 1 -- 172.21.15.55:0/2880337289 shutdown_connections 2023-07-06T22:20:22.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.323+0000 7fb6c2f37640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fb6a00663a0 0x7fb6a0068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:22.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.323+0000 7fb6c2f37640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6bc1587b0 0x7fb6bc158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:22.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.323+0000 7fb6c2f37640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6bc1f7570 0x7fb6bc1f79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:22.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.323+0000 7fb6c2f37640 1 --2- 172.21.15.55:0/2880337289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6ac0039b0 0x7fb6bc151580 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:22.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.323+0000 7fb6c2f37640 1 -- 172.21.15.55:0/2880337289 >> 172.21.15.55:0/2880337289 conn(0x7fb6bc0cde30 msgr2=0x7fb6bc06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:22.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.323+0000 7fb6c2f37640 1 -- 172.21.15.55:0/2880337289 shutdown_connections 2023-07-06T22:20:22.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.323+0000 7fb6c2f37640 1 -- 172.21.15.55:0/2880337289 wait complete. 2023-07-06T22:20:22.351 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T22:20:22.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.499+0000 7f3945ddb640 1 Processor -- start 2023-07-06T22:20:22.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.499+0000 7f3945ddb640 1 -- start start 2023-07-06T22:20:22.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.503+0000 7f3945ddb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f394006ba00 0x7f39400c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:22.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.503+0000 7f3945ddb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39400b0d90 con 0x7f3940159ad0 2023-07-06T22:20:22.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.503+0000 7f3945ddb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3940070c50 con 0x7f394006c380 2023-07-06T22:20:22.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.503+0000 7f3945ddb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39400c8620 con 0x7f394006ba00 2023-07-06T22:20:22.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.503+0000 7f393f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3940159ad0 0x7f394006b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59834/0 (socket says 172.21.15.55:59834) 2023-07-06T22:20:22.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.503+0000 7f393f7fe640 1 -- 172.21.15.55:0/651591451 learned_addr learned my addr 172.21.15.55:0/651591451 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.503+0000 7f393ffff640 1 --2- 172.21.15.55:0/651591451 >> v2:172.21.15.138:3300/0 conn(0x7f394006ba00 0x7f39400c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.503+0000 7f393e7fc640 1 -- 172.21.15.55:0/651591451 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971658519 0 0) 0x7f39400b0d90 con 0x7f3940159ad0 2023-07-06T22:20:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.503+0000 7f393e7fc640 1 -- 172.21.15.55:0/651591451 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3928003530 con 0x7f3940159ad0 2023-07-06T22:20:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.503+0000 7f393e7fc640 1 -- 172.21.15.55:0/651591451 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2649532282 0 0) 0x7f3928003530 con 0x7f3940159ad0 2023-07-06T22:20:22.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.503+0000 7f393ffff640 1 -- 172.21.15.55:0/651591451 >> v1:172.21.15.138:6789/0 conn(0x7f394006c380 legacy=0x7f39400c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:22.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.503+0000 7f393ffff640 1 -- 172.21.15.55:0/651591451 >> v1:172.21.15.55:6789/0 conn(0x7f3940159ad0 legacy=0x7f394006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:22.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.503+0000 7f393ffff640 1 -- 172.21.15.55:0/651591451 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3940070f30 con 0x7f394006ba00 2023-07-06T22:20:22.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.507+0000 7f393ffff640 1 --2- 172.21.15.55:0/651591451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f394006ba00 0x7f39400c9180 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3938009d90 tx=0x7f393801c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8453096cbe06ceb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:22.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.507+0000 7f393e7fc640 1 -- 172.21.15.55:0/651591451 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930001680 con 0x7f394006ba00 2023-07-06T22:20:22.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.507+0000 7f393e7fc640 1 -- 172.21.15.55:0/651591451 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39380a55f0 con 0x7f394006ba00 2023-07-06T22:20:22.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.507+0000 7f393e7fc640 1 -- 172.21.15.55:0/651591451 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39380a5980 con 0x7f394006ba00 2023-07-06T22:20:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.507+0000 7f3945ddb640 1 -- 172.21.15.55:0/651591451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f394006ba00 msgr2=0x7f39400c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.507+0000 7f3945ddb640 1 --2- 172.21.15.55:0/651591451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f394006ba00 0x7f39400c9180 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3938009d90 tx=0x7f393801c7b0 comp rx=0 tx=0).stop 2023-07-06T22:20:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.507+0000 7f3945ddb640 1 -- 172.21.15.55:0/651591451 shutdown_connections 2023-07-06T22:20:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.507+0000 7f3945ddb640 1 --2- 172.21.15.55:0/651591451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f394006ba00 0x7f39400c9180 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.507+0000 7f3945ddb640 1 -- 172.21.15.55:0/651591451 >> 172.21.15.55:0/651591451 conn(0x7f39400cdf40 msgr2=0x7f39400ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.507+0000 7f3945ddb640 1 -- 172.21.15.55:0/651591451 shutdown_connections 2023-07-06T22:20:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.507+0000 7f3945ddb640 1 -- 172.21.15.55:0/651591451 wait complete. 2023-07-06T22:20:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.507+0000 7f3945ddb640 1 Processor -- start 2023-07-06T22:20:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.507+0000 7f3945ddb640 1 -- start start 2023-07-06T22:20:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f3945ddb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f394006ba00 0x7f39401529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f3945ddb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f394006c380 0x7f394015c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f3945ddb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3940159ad0 0x7f394015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f3945ddb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39400c7e70 con 0x7f394006ba00 2023-07-06T22:20:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f3945ddb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3940152f30 con 0x7f394006c380 2023-07-06T22:20:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f3945ddb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39400c7010 con 0x7f3940159ad0 2023-07-06T22:20:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f393f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f394006ba00 0x7f39401529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f393f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f394006ba00 0x7f39401529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43862/0 (socket says 172.21.15.55:43862) 2023-07-06T22:20:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f393f7fe640 1 -- 172.21.15.55:0/3733942082 learned_addr learned my addr 172.21.15.55:0/3733942082 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f393ffff640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3940159ad0 0x7f394015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f393effd640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f394006c380 0x7f394015c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f393f7fe640 1 -- 172.21.15.55:0/3733942082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3940159ad0 msgr2=0x7f394015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f393f7fe640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3940159ad0 0x7f394015a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f393f7fe640 1 -- 172.21.15.55:0/3733942082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f394006c380 msgr2=0x7f394015c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f393f7fe640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f394006c380 0x7f394015c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f393f7fe640 1 -- 172.21.15.55:0/3733942082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3938009a70 con 0x7f394006ba00 2023-07-06T22:20:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f393ffff640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3940159ad0 0x7f394015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f393f7fe640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f394006ba00 0x7f39401529f0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f393000c750 tx=0x7f393000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f3927fff640 1 -- 172.21.15.55:0/3733942082 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930005ae0 con 0x7f394006ba00 2023-07-06T22:20:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f3927fff640 1 -- 172.21.15.55:0/3733942082 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3930005c40 con 0x7f394006ba00 2023-07-06T22:20:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f3927fff640 1 -- 172.21.15.55:0/3733942082 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39300072b0 con 0x7f394006ba00 2023-07-06T22:20:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f3945ddb640 1 -- 172.21.15.55:0/3733942082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39400c72f0 con 0x7f394006ba00 2023-07-06T22:20:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f3945ddb640 1 -- 172.21.15.55:0/3733942082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39400c78b0 con 0x7f394006ba00 2023-07-06T22:20:22.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.511+0000 7f3945ddb640 1 -- 172.21.15.55:0/3733942082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3940066d60 con 0x7f394006ba00 2023-07-06T22:20:22.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.515+0000 7f3927fff640 1 -- 172.21.15.55:0/3733942082 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3930007410 con 0x7f394006ba00 2023-07-06T22:20:22.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.515+0000 7f3927fff640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f392c0663a0 0x7f392c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:22.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.515+0000 7f3927fff640 1 -- 172.21.15.55:0/3733942082 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5928+0+0 (secure 0 0 0) 0x7f39300839d0 con 0x7f394006ba00 2023-07-06T22:20:22.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.515+0000 7f393effd640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f392c0663a0 0x7f392c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:22.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.515+0000 7f393effd640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f392c0663a0 0x7f392c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f394015a480 tx=0x7f3934009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.519+0000 7f3927fff640 1 -- 172.21.15.55:0/3733942082 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3930050e60 con 0x7f394006ba00 2023-07-06T22:20:22.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:22.671+0000 7f3945ddb640 1 -- 172.21.15.55:0/3733942082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3940159320 con 0x7f394006ba00 2023-07-06T22:20:23.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.327+0000 7f3927fff640 1 -- 172.21.15.55:0/3733942082 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v194) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3930054480 con 0x7f394006ba00 2023-07-06T22:20:23.330 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-07-06T22:20:23.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.343+0000 7f3945ddb640 1 -- 172.21.15.55:0/3733942082 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f392c0663a0 msgr2=0x7f392c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:23.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.343+0000 7f3945ddb640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f392c0663a0 0x7f392c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f394015a480 tx=0x7f3934009040 comp rx=0 tx=0).stop 2023-07-06T22:20:23.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.343+0000 7f3945ddb640 1 -- 172.21.15.55:0/3733942082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f394006ba00 msgr2=0x7f39401529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:23.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.343+0000 7f3945ddb640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f394006ba00 0x7f39401529f0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f393000c750 tx=0x7f393000cc10 comp rx=0 tx=0).stop 2023-07-06T22:20:23.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.343+0000 7f3945ddb640 1 -- 172.21.15.55:0/3733942082 shutdown_connections 2023-07-06T22:20:23.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.343+0000 7f3945ddb640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f392c0663a0 0x7f392c068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.343+0000 7f3945ddb640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3940159ad0 0x7f394015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.343+0000 7f3945ddb640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f394006c380 0x7f394015c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.343+0000 7f3945ddb640 1 --2- 172.21.15.55:0/3733942082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f394006ba00 0x7f39401529f0 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.343+0000 7f3945ddb640 1 -- 172.21.15.55:0/3733942082 >> 172.21.15.55:0/3733942082 conn(0x7f39400cdf40 msgr2=0x7f39400ab870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:23.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.343+0000 7f3945ddb640 1 -- 172.21.15.55:0/3733942082 shutdown_connections 2023-07-06T22:20:23.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.343+0000 7f3945ddb640 1 -- 172.21.15.55:0/3733942082 wait complete. 2023-07-06T22:20:23.374 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T22:20:23.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.519+0000 7f592a5fa640 1 Processor -- start 2023-07-06T22:20:23.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.519+0000 7f592a5fa640 1 -- start start 2023-07-06T22:20:23.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.519+0000 7f592a5fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5924070020 0x7f592406b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:23.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.519+0000 7f592a5fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59240cdd60 con 0x7f59240ce220 2023-07-06T22:20:23.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.519+0000 7f592a5fa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59240cc5a0 con 0x7f5924157ee0 2023-07-06T22:20:23.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.519+0000 7f592a5fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5924069f30 con 0x7f5924070020 2023-07-06T22:20:23.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.519+0000 7f59237fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5924070020 0x7f592406b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:23.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.523+0000 7f59237fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5924070020 0x7f592406b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44554/0 (socket says 172.21.15.55:44554) 2023-07-06T22:20:23.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.523+0000 7f59237fe640 1 -- 172.21.15.55:0/2288813968 learned_addr learned my addr 172.21.15.55:0/2288813968 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:23.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.523+0000 7f59237fe640 1 -- 172.21.15.55:0/2288813968 >> v1:172.21.15.138:6789/0 conn(0x7f5924157ee0 legacy=0x7f592406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:23.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.523+0000 7f59237fe640 1 -- 172.21.15.55:0/2288813968 >> v1:172.21.15.55:6789/0 conn(0x7f59240ce220 legacy=0x7f592406bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:23.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.523+0000 7f59237fe640 1 -- 172.21.15.55:0/2288813968 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592406a210 con 0x7f5924070020 2023-07-06T22:20:23.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.523+0000 7f59237fe640 1 --2- 172.21.15.55:0/2288813968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5924070020 0x7f592406b690 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f5918009870 tx=0x7f591801d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44517e36f325ed93 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:23.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.523+0000 7f5922ffd640 1 -- 172.21.15.55:0/2288813968 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180ad630 con 0x7f5924070020 2023-07-06T22:20:23.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.523+0000 7f5922ffd640 1 -- 172.21.15.55:0/2288813968 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59180ad790 con 0x7f5924070020 2023-07-06T22:20:23.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.523+0000 7f5922ffd640 1 -- 172.21.15.55:0/2288813968 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180adb20 con 0x7f5924070020 2023-07-06T22:20:23.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 -- 172.21.15.55:0/2288813968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5924070020 msgr2=0x7f592406b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:23.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 --2- 172.21.15.55:0/2288813968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5924070020 0x7f592406b690 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f5918009870 tx=0x7f591801d530 comp rx=0 tx=0).stop 2023-07-06T22:20:23.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 -- 172.21.15.55:0/2288813968 shutdown_connections 2023-07-06T22:20:23.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 --2- 172.21.15.55:0/2288813968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5924070020 0x7f592406b690 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 -- 172.21.15.55:0/2288813968 >> 172.21.15.55:0/2288813968 conn(0x7f59240cbd70 msgr2=0x7f59240ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:23.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 -- 172.21.15.55:0/2288813968 shutdown_connections 2023-07-06T22:20:23.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 -- 172.21.15.55:0/2288813968 wait complete. 2023-07-06T22:20:23.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 Processor -- start 2023-07-06T22:20:23.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 -- start start 2023-07-06T22:20:23.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5924070020 0x7f59240ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:23.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59240ce220 0x7f5924153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:23.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5924157ee0 0x7f5924156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:23.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5924157550 con 0x7f5924070020 2023-07-06T22:20:23.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59240b05f0 con 0x7f59240ce220 2023-07-06T22:20:23.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f592a5fa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59240c5770 con 0x7f5924157ee0 2023-07-06T22:20:23.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f5923fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5924070020 0x7f59240ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:23.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f5923fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5924070020 0x7f59240ae1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44558/0 (socket says 172.21.15.55:44558) 2023-07-06T22:20:23.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f5923fff640 1 -- 172.21.15.55:0/760365370 learned_addr learned my addr 172.21.15.55:0/760365370 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:23.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f59237fe640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59240ce220 0x7f5924153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:23.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f5923fff640 1 -- 172.21.15.55:0/760365370 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5924157ee0 msgr2=0x7f5924156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:23.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f5928b97640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5924157ee0 0x7f5924156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:23.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f5923fff640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5924157ee0 0x7f5924156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f5923fff640 1 -- 172.21.15.55:0/760365370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59240ce220 msgr2=0x7f5924153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:23.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f5923fff640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59240ce220 0x7f5924153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f5923fff640 1 -- 172.21.15.55:0/760365370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59180094d0 con 0x7f5924070020 2023-07-06T22:20:23.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f59237fe640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59240ce220 0x7f5924153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:23.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.527+0000 7f5928b97640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5924157ee0 0x7f5924156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:23.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.531+0000 7f5923fff640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5924070020 0x7f59240ae1c0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f591400c3c0 tx=0x7f591400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:23.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.531+0000 7f5920ff9640 1 -- 172.21.15.55:0/760365370 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59140052d0 con 0x7f5924070020 2023-07-06T22:20:23.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.531+0000 7f5920ff9640 1 -- 172.21.15.55:0/760365370 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5914005430 con 0x7f5924070020 2023-07-06T22:20:23.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.531+0000 7f5920ff9640 1 -- 172.21.15.55:0/760365370 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914003840 con 0x7f5924070020 2023-07-06T22:20:23.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.531+0000 7f592a5fa640 1 -- 172.21.15.55:0/760365370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59240c5ca0 con 0x7f5924070020 2023-07-06T22:20:23.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.531+0000 7f592a5fa640 1 -- 172.21.15.55:0/760365370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59240c6260 con 0x7f5924070020 2023-07-06T22:20:23.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.531+0000 7f592a5fa640 1 -- 172.21.15.55:0/760365370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5924066d60 con 0x7f5924070020 2023-07-06T22:20:23.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.531+0000 7f5920ff9640 1 -- 172.21.15.55:0/760365370 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f59140039a0 con 0x7f5924070020 2023-07-06T22:20:23.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.531+0000 7f5920ff9640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f59100663a0 0x7f5910068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:23.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.531+0000 7f5920ff9640 1 -- 172.21.15.55:0/760365370 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6310+0+0 (secure 0 0 0) 0x7f5914083550 con 0x7f5924070020 2023-07-06T22:20:23.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.531+0000 7f59237fe640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f59100663a0 0x7f5910068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:23.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.535+0000 7f59237fe640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f59100663a0 0x7f5910068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f59180af000 tx=0x7f59180a8000 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:23.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.539+0000 7f5920ff9640 1 -- 172.21.15.55:0/760365370 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5914050720 con 0x7f5924070020 2023-07-06T22:20:23.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.723+0000 7f592a5fa640 1 -- 172.21.15.55:0/760365370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5924069830 con 0x7f5924070020 2023-07-06T22:20:23.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.735+0000 7f5920ff9640 1 -- 172.21.15.55:0/760365370 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v83) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5914053d40 con 0x7f5924070020 2023-07-06T22:20:23.738 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 24 and data pool 25 2023-07-06T22:20:23.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.739+0000 7f592a5fa640 1 -- 172.21.15.55:0/760365370 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f59100663a0 msgr2=0x7f5910068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:23.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.739+0000 7f592a5fa640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f59100663a0 0x7f5910068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f59180af000 tx=0x7f59180a8000 comp rx=0 tx=0).stop 2023-07-06T22:20:23.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.739+0000 7f592a5fa640 1 -- 172.21.15.55:0/760365370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5924070020 msgr2=0x7f59240ae1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:23.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.739+0000 7f592a5fa640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5924070020 0x7f59240ae1c0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f591400c3c0 tx=0x7f591400c880 comp rx=0 tx=0).stop 2023-07-06T22:20:23.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.739+0000 7f592a5fa640 1 -- 172.21.15.55:0/760365370 shutdown_connections 2023-07-06T22:20:23.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.739+0000 7f592a5fa640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f59100663a0 0x7f5910068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.739+0000 7f592a5fa640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5924157ee0 0x7f5924156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.739+0000 7f592a5fa640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59240ce220 0x7f5924153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.739+0000 7f592a5fa640 1 --2- 172.21.15.55:0/760365370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5924070020 0x7f59240ae1c0 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.739+0000 7f592a5fa640 1 -- 172.21.15.55:0/760365370 >> 172.21.15.55:0/760365370 conn(0x7f59240cbd70 msgr2=0x7f59240b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:23.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.739+0000 7f592a5fa640 1 -- 172.21.15.55:0/760365370 shutdown_connections 2023-07-06T22:20:23.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.739+0000 7f592a5fa640 1 -- 172.21.15.55:0/760365370 wait complete. 2023-07-06T22:20:23.785 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:20:23.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bd4aaf640 1 Processor -- start 2023-07-06T22:20:23.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bd4aaf640 1 -- start start 2023-07-06T22:20:23.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bd4aaf640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6bd00ce5e0 0x7f6bd00b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:23.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bd4aaf640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bd00b40e0 0x7f6bd00d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:23.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bd4aaf640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd00cc770 con 0x7f6bd015b9d0 2023-07-06T22:20:23.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bd4aaf640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd00b4560 con 0x7f6bd00ce5e0 2023-07-06T22:20:23.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bd4aaf640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00cc9c0 con 0x7f6bd00b40e0 2023-07-06T22:20:23.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bceffd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6bd00ce5e0 0x7f6bd00b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:23.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bcffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bd00b40e0 0x7f6bd00d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:23.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bcffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bd00b40e0 0x7f6bd00d0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:42908/0 (socket says 172.21.15.55:42908) 2023-07-06T22:20:23.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bcffff640 1 -- 172.21.15.55:0/1612437321 learned_addr learned my addr 172.21.15.55:0/1612437321 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:23.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bcf7fe640 1 --1- 172.21.15.55:0/1612437321 >> v1:172.21.15.138:6789/0 conn(0x7f6bd015b9d0 0x7f6bd00b2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:57878/0 (socket says 172.21.15.55:57878) 2023-07-06T22:20:23.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bce7fc640 1 -- 172.21.15.55:0/1612437321 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700594138 0 0) 0x7f6bd00cc770 con 0x7f6bd015b9d0 2023-07-06T22:20:23.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bcffff640 1 -- 172.21.15.55:0/1612437321 >> v2:172.21.15.138:3300/0 conn(0x7f6bd00ce5e0 msgr2=0x7f6bd00b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:23.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bcffff640 1 --2- 172.21.15.55:0/1612437321 >> v2:172.21.15.138:3300/0 conn(0x7f6bd00ce5e0 0x7f6bd00b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bcffff640 1 -- 172.21.15.55:0/1612437321 >> v1:172.21.15.138:6789/0 conn(0x7f6bd015b9d0 legacy=0x7f6bd00b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:23.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bcffff640 1 -- 172.21.15.55:0/1612437321 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd00ccca0 con 0x7f6bd00b40e0 2023-07-06T22:20:23.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.927+0000 7f6bceffd640 1 --2- 172.21.15.55:0/1612437321 >> v2:172.21.15.138:3300/0 conn(0x7f6bd00ce5e0 0x7f6bd00b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:23.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.931+0000 7f6bcffff640 1 --2- 172.21.15.55:0/1612437321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bd00b40e0 0x7f6bd00d0650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009e50 tx=0x7f6bc801ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea69f6847bcad263 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:23.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.931+0000 7f6bce7fc640 1 -- 172.21.15.55:0/1612437321 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80a58a0 con 0x7f6bd00b40e0 2023-07-06T22:20:23.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.931+0000 7f6bce7fc640 1 -- 172.21.15.55:0/1612437321 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc80a5a00 con 0x7f6bd00b40e0 2023-07-06T22:20:23.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.931+0000 7f6bce7fc640 1 -- 172.21.15.55:0/1612437321 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80a5d90 con 0x7f6bd00b40e0 2023-07-06T22:20:23.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.931+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/1612437321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bd00b40e0 msgr2=0x7f6bd00d0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:23.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.931+0000 7f6bd4aaf640 1 --2- 172.21.15.55:0/1612437321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bd00b40e0 0x7f6bd00d0650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009e50 tx=0x7f6bc801ca10 comp rx=0 tx=0).stop 2023-07-06T22:20:23.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.931+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/1612437321 shutdown_connections 2023-07-06T22:20:23.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.931+0000 7f6bd4aaf640 1 --2- 172.21.15.55:0/1612437321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bd00b40e0 0x7f6bd00d0650 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.931+0000 7f6bd4aaf640 1 --2- 172.21.15.55:0/1612437321 >> v2:172.21.15.138:3300/0 conn(0x7f6bd00ce5e0 0x7f6bd00b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.931+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/1612437321 >> 172.21.15.55:0/1612437321 conn(0x7f6bd006c2b0 msgr2=0x7f6bd00ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:23.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.931+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/1612437321 shutdown_connections 2023-07-06T22:20:23.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.931+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/1612437321 wait complete. 2023-07-06T22:20:23.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bd4aaf640 1 Processor -- start 2023-07-06T22:20:23.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bd4aaf640 1 -- start start 2023-07-06T22:20:23.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bd4aaf640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bd00b40e0 0x7f6bd00c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:23.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bd4aaf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bd00ce5e0 0x7f6bd00c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:23.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bd4aaf640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6bd015b9d0 0x7f6bd015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:23.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bd4aaf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd015e1c0 con 0x7f6bd00ce5e0 2023-07-06T22:20:23.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bd4aaf640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd015e4a0 con 0x7f6bd015b9d0 2023-07-06T22:20:23.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bd4aaf640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd015e780 con 0x7f6bd00b40e0 2023-07-06T22:20:23.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bceffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bd00ce5e0 0x7f6bd00c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:23.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bceffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bd00ce5e0 0x7f6bd00c7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44568/0 (socket says 172.21.15.55:44568) 2023-07-06T22:20:23.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bceffd640 1 -- 172.21.15.55:0/2023553601 learned_addr learned my addr 172.21.15.55:0/2023553601 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:23.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bcffff640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6bd015b9d0 0x7f6bd015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:23.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bcf7fe640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bd00b40e0 0x7f6bd00c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:23.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bceffd640 1 -- 172.21.15.55:0/2023553601 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bd00b40e0 msgr2=0x7f6bd00c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:23.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bceffd640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bd00b40e0 0x7f6bd00c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bceffd640 1 -- 172.21.15.55:0/2023553601 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6bd015b9d0 msgr2=0x7f6bd015d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:23.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bceffd640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6bd015b9d0 0x7f6bd015d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:23.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bceffd640 1 -- 172.21.15.55:0/2023553601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc4009420 con 0x7f6bd00ce5e0 2023-07-06T22:20:23.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bcf7fe640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bd00b40e0 0x7f6bd00c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:23.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bceffd640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bd00ce5e0 0x7f6bd00c7dd0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400ebe0 tx=0x7f6bc400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:23.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bb7fff640 1 -- 172.21.15.55:0/2023553601 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc400eee0 con 0x7f6bd00ce5e0 2023-07-06T22:20:23.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bb7fff640 1 -- 172.21.15.55:0/2023553601 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc400cc30 con 0x7f6bd00ce5e0 2023-07-06T22:20:23.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bb7fff640 1 -- 172.21.15.55:0/2023553601 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4013470 con 0x7f6bd00ce5e0 2023-07-06T22:20:23.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/2023553601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc8009b30 con 0x7f6bd00ce5e0 2023-07-06T22:20:23.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/2023553601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd015ed40 con 0x7f6bd00ce5e0 2023-07-06T22:20:23.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.935+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/2023553601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd004d790 con 0x7f6bd00ce5e0 2023-07-06T22:20:23.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.939+0000 7f6bb7fff640 1 -- 172.21.15.55:0/2023553601 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6bc40135d0 con 0x7f6bd00ce5e0 2023-07-06T22:20:23.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.939+0000 7f6bb7fff640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f6bbc0663a0 0x7f6bbc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:23.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.939+0000 7f6bb7fff640 1 -- 172.21.15.55:0/2023553601 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6bc4084320 con 0x7f6bd00ce5e0 2023-07-06T22:20:23.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.939+0000 7f6bcf7fe640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f6bbc0663a0 0x7f6bbc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:23.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.939+0000 7f6bcf7fe640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f6bbc0663a0 0x7f6bbc068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0000f70 tx=0x7f6bc0007cb0 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:23.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:23.943+0000 7f6bb7fff640 1 -- 172.21.15.55:0/2023553601 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6bc4054fd0 con 0x7f6bd00ce5e0 2023-07-06T22:20:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.103+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/2023553601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bd006a360 con 0x7f6bd00ce5e0 2023-07-06T22:20:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.103+0000 7f6bb7fff640 1 -- 172.21.15.55:0/2023553601 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+18611 (secure 0 0 0) 0x7f6bc4054b60 con 0x7f6bd00ce5e0 2023-07-06T22:20:24.106 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:24.106 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":195,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:20:23.728506+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:20:21.647148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-07-06T22:20:22.723236+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:20:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.107+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/2023553601 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f6bbc0663a0 msgr2=0x7f6bbc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.107+0000 7f6bd4aaf640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f6bbc0663a0 0x7f6bbc068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0000f70 tx=0x7f6bc0007cb0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.107+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/2023553601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bd00ce5e0 msgr2=0x7f6bd00c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.107+0000 7f6bd4aaf640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bd00ce5e0 0x7f6bd00c7dd0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400ebe0 tx=0x7f6bc400c520 comp rx=0 tx=0).stop 2023-07-06T22:20:24.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.107+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/2023553601 shutdown_connections 2023-07-06T22:20:24.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.107+0000 7f6bd4aaf640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f6bbc0663a0 0x7f6bbc068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.107+0000 7f6bd4aaf640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6bd015b9d0 0x7f6bd015d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.107+0000 7f6bd4aaf640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bd00ce5e0 0x7f6bd00c7dd0 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.107+0000 7f6bd4aaf640 1 --2- 172.21.15.55:0/2023553601 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6bd00b40e0 0x7f6bd00c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.107+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/2023553601 >> 172.21.15.55:0/2023553601 conn(0x7f6bd006c2b0 msgr2=0x7f6bd0152150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:24.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.107+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/2023553601 shutdown_connections 2023-07-06T22:20:24.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.107+0000 7f6bd4aaf640 1 -- 172.21.15.55:0/2023553601 wait complete. 2023-07-06T22:20:24.127 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:20:24.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.267+0000 7f7f4b25c640 1 Processor -- start 2023-07-06T22:20:24.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.267+0000 7f7f4b25c640 1 -- start start 2023-07-06T22:20:24.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.267+0000 7f7f4b25c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f441587d0 0x7f7f44070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:24.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.267+0000 7f7f4b25c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7f440710c0 0x7f7f440cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:24.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.267+0000 7f7f4b25c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f4406fae0 con 0x7f7f44158400 2023-07-06T22:20:24.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.267+0000 7f7f4b25c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f4406fdc0 con 0x7f7f441587d0 2023-07-06T22:20:24.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.267+0000 7f7f4b25c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f440700a0 con 0x7f7f440710c0 2023-07-06T22:20:24.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.271+0000 7f7f43fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f441587d0 0x7f7f44070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:24.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.271+0000 7f7f43fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f441587d0 0x7f7f44070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44570/0 (socket says 172.21.15.55:44570) 2023-07-06T22:20:24.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.271+0000 7f7f43fff640 1 -- 172.21.15.55:0/1264405023 learned_addr learned my addr 172.21.15.55:0/1264405023 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:24.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.271+0000 7f7f497f9640 1 --2- 172.21.15.55:0/1264405023 >> v2:172.21.15.138:3300/0 conn(0x7f7f440710c0 0x7f7f440cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:24.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.271+0000 7f7f43fff640 1 -- 172.21.15.55:0/1264405023 >> v2:172.21.15.138:3300/0 conn(0x7f7f440710c0 msgr2=0x7f7f440cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:24.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.271+0000 7f7f43fff640 1 --2- 172.21.15.55:0/1264405023 >> v2:172.21.15.138:3300/0 conn(0x7f7f440710c0 0x7f7f440cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.271+0000 7f7f43fff640 1 -- 172.21.15.55:0/1264405023 >> v1:172.21.15.55:6789/0 conn(0x7f7f44158400 legacy=0x7f7f440c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:24.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.271+0000 7f7f43fff640 1 -- 172.21.15.55:0/1264405023 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f44070380 con 0x7f7f441587d0 2023-07-06T22:20:24.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.271+0000 7f7f43fff640 1 --2- 172.21.15.55:0/1264405023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f441587d0 0x7f7f44070b80 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f7f440ca570 tx=0x7f7f3001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa7724755e2014a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:24.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.271+0000 7f7f437fe640 1 -- 172.21.15.55:0/1264405023 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f300ac640 con 0x7f7f441587d0 2023-07-06T22:20:24.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.271+0000 7f7f437fe640 1 -- 172.21.15.55:0/1264405023 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f300ac7a0 con 0x7f7f441587d0 2023-07-06T22:20:24.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.271+0000 7f7f437fe640 1 -- 172.21.15.55:0/1264405023 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f300acb30 con 0x7f7f441587d0 2023-07-06T22:20:24.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 -- 172.21.15.55:0/1264405023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f441587d0 msgr2=0x7f7f44070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:24.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 --2- 172.21.15.55:0/1264405023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f441587d0 0x7f7f44070b80 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f7f440ca570 tx=0x7f7f3001c4d0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 -- 172.21.15.55:0/1264405023 shutdown_connections 2023-07-06T22:20:24.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 --2- 172.21.15.55:0/1264405023 >> v2:172.21.15.138:3300/0 conn(0x7f7f440710c0 0x7f7f440cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 --2- 172.21.15.55:0/1264405023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f441587d0 0x7f7f44070b80 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 -- 172.21.15.55:0/1264405023 >> 172.21.15.55:0/1264405023 conn(0x7f7f440cded0 msgr2=0x7f7f440ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:24.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 -- 172.21.15.55:0/1264405023 shutdown_connections 2023-07-06T22:20:24.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 -- 172.21.15.55:0/1264405023 wait complete. 2023-07-06T22:20:24.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 Processor -- start 2023-07-06T22:20:24.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 -- start start 2023-07-06T22:20:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f440710c0 0x7f7f44144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f44158400 0x7f7f440c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f441587d0 0x7f7f44069790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440c47d0 con 0x7f7f441587d0 2023-07-06T22:20:24.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4415d360 con 0x7f7f440710c0 2023-07-06T22:20:24.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f4b25c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f44144970 con 0x7f7f44158400 2023-07-06T22:20:24.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f497f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f441587d0 0x7f7f44069790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:24.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f497f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f441587d0 0x7f7f44069790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44574/0 (socket says 172.21.15.55:44574) 2023-07-06T22:20:24.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f497f9640 1 -- 172.21.15.55:0/3027831902 learned_addr learned my addr 172.21.15.55:0/3027831902 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:24.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f48ff8640 1 --2- 172.21.15.55:0/3027831902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f440710c0 0x7f7f44144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:24.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.275+0000 7f7f43fff640 1 --2- 172.21.15.55:0/3027831902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f44158400 0x7f7f440c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:24.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f497f9640 1 -- 172.21.15.55:0/3027831902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f44158400 msgr2=0x7f7f440c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:24.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f497f9640 1 --2- 172.21.15.55:0/3027831902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f44158400 0x7f7f440c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f497f9640 1 -- 172.21.15.55:0/3027831902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f440710c0 msgr2=0x7f7f44144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:24.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f497f9640 1 --2- 172.21.15.55:0/3027831902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f440710c0 0x7f7f44144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f497f9640 1 -- 172.21.15.55:0/3027831902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f300094d0 con 0x7f7f441587d0 2023-07-06T22:20:24.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f497f9640 1 --2- 172.21.15.55:0/3027831902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f441587d0 0x7f7f44069790 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c007e40 tx=0x7f7f3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:24.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f417fa640 1 -- 172.21.15.55:0/3027831902 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c014620 con 0x7f7f441587d0 2023-07-06T22:20:24.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f417fa640 1 -- 172.21.15.55:0/3027831902 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c00ee90 con 0x7f7f441587d0 2023-07-06T22:20:24.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f417fa640 1 -- 172.21.15.55:0/3027831902 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c0149e0 con 0x7f7f441587d0 2023-07-06T22:20:24.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f4b25c640 1 -- 172.21.15.55:0/3027831902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f440c5cd0 con 0x7f7f441587d0 2023-07-06T22:20:24.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f4b25c640 1 -- 172.21.15.55:0/3027831902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f440c6290 con 0x7f7f441587d0 2023-07-06T22:20:24.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f4b25c640 1 -- 172.21.15.55:0/3027831902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4406c580 con 0x7f7f441587d0 2023-07-06T22:20:24.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f417fa640 1 -- 172.21.15.55:0/3027831902 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7f3c014b40 con 0x7f7f441587d0 2023-07-06T22:20:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f417fa640 1 --2- 172.21.15.55:0/3027831902 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f7f280663a0 0x7f7f28068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f417fa640 1 -- 172.21.15.55:0/3027831902 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7f3c084970 con 0x7f7f441587d0 2023-07-06T22:20:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.279+0000 7f7f48ff8640 1 --2- 172.21.15.55:0/3027831902 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f7f280663a0 0x7f7f28068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.283+0000 7f7f48ff8640 1 --2- 172.21.15.55:0/3027831902 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f7f280663a0 0x7f7f28068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f38007fd0 tx=0x7f7f38009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.283+0000 7f7f417fa640 1 -- 172.21.15.55:0/3027831902 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f3c051b00 con 0x7f7f441587d0 2023-07-06T22:20:24.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.443+0000 7f7f4b25c640 1 -- 172.21.15.55:0/3027831902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f44066d60 con 0x7f7f441587d0 2023-07-06T22:20:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.443+0000 7f7f417fa640 1 -- 172.21.15.55:0/3027831902 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+18611 (secure 0 0 0) 0x7f7f3c055120 con 0x7f7f441587d0 2023-07-06T22:20:24.445 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:24.445 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":195,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:20:23.728506+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:20:21.647148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-07-06T22:20:22.723236+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:20:24.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.443+0000 7f7f4b25c640 1 -- 172.21.15.55:0/3027831902 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f7f280663a0 msgr2=0x7f7f28068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:24.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.443+0000 7f7f4b25c640 1 --2- 172.21.15.55:0/3027831902 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f7f280663a0 0x7f7f28068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f38007fd0 tx=0x7f7f38009040 comp rx=0 tx=0).stop 2023-07-06T22:20:24.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.443+0000 7f7f4b25c640 1 -- 172.21.15.55:0/3027831902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f441587d0 msgr2=0x7f7f44069790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.443+0000 7f7f4b25c640 1 --2- 172.21.15.55:0/3027831902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f441587d0 0x7f7f44069790 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c007e40 tx=0x7f7f3c00e4b0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.443+0000 7f7f4b25c640 1 -- 172.21.15.55:0/3027831902 shutdown_connections 2023-07-06T22:20:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.443+0000 7f7f4b25c640 1 --2- 172.21.15.55:0/3027831902 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f7f280663a0 0x7f7f28068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.443+0000 7f7f4b25c640 1 --2- 172.21.15.55:0/3027831902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f441587d0 0x7f7f44069790 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.443+0000 7f7f4b25c640 1 --2- 172.21.15.55:0/3027831902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f44158400 0x7f7f440c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.443+0000 7f7f4b25c640 1 --2- 172.21.15.55:0/3027831902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f440710c0 0x7f7f44144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.443+0000 7f7f4b25c640 1 -- 172.21.15.55:0/3027831902 >> 172.21.15.55:0/3027831902 conn(0x7f7f440cded0 msgr2=0x7f7f440aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:24.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.443+0000 7f7f4b25c640 1 -- 172.21.15.55:0/3027831902 shutdown_connections 2023-07-06T22:20:24.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.443+0000 7f7f4b25c640 1 -- 172.21.15.55:0/3027831902 wait complete. 2023-07-06T22:20:24.467 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T22:20:24.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f4955434640 1 Processor -- start 2023-07-06T22:20:24.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f4955434640 1 -- start start 2023-07-06T22:20:24.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f4955434640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f49500d1c40 0x7f49500b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:24.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f4955434640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f49500b4130 0x7f49500b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:24.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f4955434640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49500b5070 con 0x7f49500b7b90 2023-07-06T22:20:24.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f4955434640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49500d20c0 con 0x7f49500d1c40 2023-07-06T22:20:24.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f4955434640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4950160020 con 0x7f49500b4130 2023-07-06T22:20:24.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f4947fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f49500d1c40 0x7f49500b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:24.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f4947fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f49500d1c40 0x7f49500b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44584/0 (socket says 172.21.15.55:44584) 2023-07-06T22:20:24.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f4947fff640 1 -- 172.21.15.55:0/213779444 learned_addr learned my addr 172.21.15.55:0/213779444 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:24.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f494f7fe640 1 --2- 172.21.15.55:0/213779444 >> v2:172.21.15.138:3300/0 conn(0x7f49500b4130 0x7f49500b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:24.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f4947fff640 1 -- 172.21.15.55:0/213779444 >> v2:172.21.15.138:3300/0 conn(0x7f49500b4130 msgr2=0x7f49500b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:24.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f4947fff640 1 --2- 172.21.15.55:0/213779444 >> v2:172.21.15.138:3300/0 conn(0x7f49500b4130 0x7f49500b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f4947fff640 1 -- 172.21.15.55:0/213779444 >> v1:172.21.15.138:6789/0 conn(0x7f49500b7b90 legacy=0x7f49500cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:24.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f4947fff640 1 -- 172.21.15.55:0/213779444 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49500b4570 con 0x7f49500d1c40 2023-07-06T22:20:24.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.611+0000 7f494f7fe640 1 --2- 172.21.15.55:0/213779444 >> v2:172.21.15.138:3300/0 conn(0x7f49500b4130 0x7f49500b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:24.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.615+0000 7f4947fff640 1 --2- 172.21.15.55:0/213779444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49500d1c40 0x7f49500b3bf0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f495006c6a0 tx=0x7f493801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acd20f6d72ba232 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:24.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.615+0000 7f494e7fc640 1 -- 172.21.15.55:0/213779444 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49380ab5f0 con 0x7f49500d1c40 2023-07-06T22:20:24.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.615+0000 7f494e7fc640 1 -- 172.21.15.55:0/213779444 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49380ab750 con 0x7f49500d1c40 2023-07-06T22:20:24.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.615+0000 7f494e7fc640 1 -- 172.21.15.55:0/213779444 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49380abae0 con 0x7f49500d1c40 2023-07-06T22:20:24.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.615+0000 7f4955434640 1 -- 172.21.15.55:0/213779444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49500d1c40 msgr2=0x7f49500b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:24.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.615+0000 7f4955434640 1 --2- 172.21.15.55:0/213779444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49500d1c40 0x7f49500b3bf0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f495006c6a0 tx=0x7f493801c500 comp rx=0 tx=0).stop 2023-07-06T22:20:24.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.615+0000 7f4955434640 1 -- 172.21.15.55:0/213779444 shutdown_connections 2023-07-06T22:20:24.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.615+0000 7f4955434640 1 --2- 172.21.15.55:0/213779444 >> v2:172.21.15.138:3300/0 conn(0x7f49500b4130 0x7f49500b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.615+0000 7f4955434640 1 --2- 172.21.15.55:0/213779444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49500d1c40 0x7f49500b3bf0 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.615+0000 7f4955434640 1 -- 172.21.15.55:0/213779444 >> 172.21.15.55:0/213779444 conn(0x7f49500ceca0 msgr2=0x7f49500cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:24.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.615+0000 7f4955434640 1 -- 172.21.15.55:0/213779444 shutdown_connections 2023-07-06T22:20:24.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.615+0000 7f4955434640 1 -- 172.21.15.55:0/213779444 wait complete. 2023-07-06T22:20:24.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4955434640 1 Processor -- start 2023-07-06T22:20:24.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4955434640 1 -- start start 2023-07-06T22:20:24.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4955434640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49500b4130 0x7f49500b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:24.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4955434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49500b7b90 0x7f49500c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:24.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4955434640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49500d1c40 0x7f495006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:24.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4955434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4950141060 con 0x7f49500b7b90 2023-07-06T22:20:24.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4955434640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49500caf00 con 0x7f49500b4130 2023-07-06T22:20:24.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4955434640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49500cc230 con 0x7f49500d1c40 2023-07-06T22:20:24.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4947fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49500b7b90 0x7f49500c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:24.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4947fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49500b7b90 0x7f49500c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44592/0 (socket says 172.21.15.55:44592) 2023-07-06T22:20:24.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4947fff640 1 -- 172.21.15.55:0/3714835469 learned_addr learned my addr 172.21.15.55:0/3714835469 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:24.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f494f7fe640 1 --2- 172.21.15.55:0/3714835469 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49500d1c40 0x7f495006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:24.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f494effd640 1 --2- 172.21.15.55:0/3714835469 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49500b4130 0x7f49500b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:24.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4947fff640 1 -- 172.21.15.55:0/3714835469 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49500d1c40 msgr2=0x7f495006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4947fff640 1 --2- 172.21.15.55:0/3714835469 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49500d1c40 0x7f495006a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4947fff640 1 -- 172.21.15.55:0/3714835469 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49500b4130 msgr2=0x7f49500b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4947fff640 1 --2- 172.21.15.55:0/3714835469 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49500b4130 0x7f49500b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4947fff640 1 -- 172.21.15.55:0/3714835469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49380094d0 con 0x7f49500b7b90 2023-07-06T22:20:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4947fff640 1 --2- 172.21.15.55:0/3714835469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49500b7b90 0x7f49500c8680 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f49380ad040 tx=0x7f49380192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f49477fe640 1 -- 172.21.15.55:0/3714835469 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49380bf610 con 0x7f49500b7b90 2023-07-06T22:20:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f49477fe640 1 -- 172.21.15.55:0/3714835469 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49380bf7b0 con 0x7f49500b7b90 2023-07-06T22:20:24.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f49477fe640 1 -- 172.21.15.55:0/3714835469 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49380bfb60 con 0x7f49500b7b90 2023-07-06T22:20:24.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4955434640 1 -- 172.21.15.55:0/3714835469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49500cb990 con 0x7f49500b7b90 2023-07-06T22:20:24.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.619+0000 7f4955434640 1 -- 172.21.15.55:0/3714835469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49500cbf50 con 0x7f49500b7b90 2023-07-06T22:20:24.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.623+0000 7f4955434640 1 -- 172.21.15.55:0/3714835469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49500b4cb0 con 0x7f49500b7b90 2023-07-06T22:20:24.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.623+0000 7f49477fe640 1 -- 172.21.15.55:0/3714835469 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f49380b5400 con 0x7f49500b7b90 2023-07-06T22:20:24.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.623+0000 7f49477fe640 1 --2- 172.21.15.55:0/3714835469 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f49300663a0 0x7f4930068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:24.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.623+0000 7f49477fe640 1 -- 172.21.15.55:0/3714835469 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f49380a8050 con 0x7f49500b7b90 2023-07-06T22:20:24.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.623+0000 7f494effd640 1 --2- 172.21.15.55:0/3714835469 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f49300663a0 0x7f4930068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:24.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.627+0000 7f494effd640 1 --2- 172.21.15.55:0/3714835469 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f49300663a0 0x7f4930068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4940007fd0 tx=0x7f4940009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:24.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.627+0000 7f49477fe640 1 -- 172.21.15.55:0/3714835469 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f49380eba60 con 0x7f49500b7b90 2023-07-06T22:20:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:24.819+0000 7f4955434640 1 -- 172.21.15.55:0/3714835469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4950066d60 con 0x7f49500b7b90 2023-07-06T22:20:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.747+0000 7f49477fe640 1 -- 172.21.15.55:0/3714835469 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v86) v1 ==== 118+0+0 (secure 0 0 0) 0x7f49380ef080 con 0x7f49500b7b90 2023-07-06T22:20:25.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.747+0000 7f4955434640 1 -- 172.21.15.55:0/3714835469 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f49300663a0 msgr2=0x7f4930068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:25.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.747+0000 7f4955434640 1 --2- 172.21.15.55:0/3714835469 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f49300663a0 0x7f4930068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4940007fd0 tx=0x7f4940009040 comp rx=0 tx=0).stop 2023-07-06T22:20:25.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.747+0000 7f4955434640 1 -- 172.21.15.55:0/3714835469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49500b7b90 msgr2=0x7f49500c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:25.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.747+0000 7f4955434640 1 --2- 172.21.15.55:0/3714835469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49500b7b90 0x7f49500c8680 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f49380ad040 tx=0x7f49380192a0 comp rx=0 tx=0).stop 2023-07-06T22:20:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.747+0000 7f4955434640 1 -- 172.21.15.55:0/3714835469 shutdown_connections 2023-07-06T22:20:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.747+0000 7f4955434640 1 --2- 172.21.15.55:0/3714835469 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f49300663a0 0x7f4930068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.747+0000 7f4955434640 1 --2- 172.21.15.55:0/3714835469 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49500d1c40 0x7f495006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.747+0000 7f4955434640 1 --2- 172.21.15.55:0/3714835469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49500b7b90 0x7f49500c8680 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.747+0000 7f4955434640 1 --2- 172.21.15.55:0/3714835469 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49500b4130 0x7f49500b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.747+0000 7f4955434640 1 -- 172.21.15.55:0/3714835469 >> 172.21.15.55:0/3714835469 conn(0x7f49500ceca0 msgr2=0x7f49500b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.747+0000 7f4955434640 1 -- 172.21.15.55:0/3714835469 shutdown_connections 2023-07-06T22:20:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.747+0000 7f4955434640 1 -- 172.21.15.55:0/3714835469 wait complete. 2023-07-06T22:20:25.773 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-06T22:20:25.774 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T22:20:25.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.919+0000 7fbc49b37640 1 Processor -- start 2023-07-06T22:20:25.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc49b37640 1 -- start start 2023-07-06T22:20:25.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc49b37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc440b7b90 0x7fbc440d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:25.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc49b37640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbc440cc870 0x7fbc440b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:25.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc49b37640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc440b5070 con 0x7fbc440b4130 2023-07-06T22:20:25.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc49b37640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc440b45b0 con 0x7fbc440cc870 2023-07-06T22:20:25.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc49b37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44160020 con 0x7fbc440b7b90 2023-07-06T22:20:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc42ffd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbc440cc870 0x7fbc440b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc437fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc440b7b90 0x7fbc440d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc437fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc440b7b90 0x7fbc440d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:42940/0 (socket says 172.21.15.55:42940) 2023-07-06T22:20:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc42ffd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbc440cc870 0x7fbc440b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:52430/0 (socket says 172.21.15.55:52430) 2023-07-06T22:20:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc437fe640 1 -- 172.21.15.55:0/4136972840 learned_addr learned my addr 172.21.15.55:0/4136972840 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc437fe640 1 -- 172.21.15.55:0/4136972840 >> v2:172.21.15.138:3300/0 conn(0x7fbc440cc870 msgr2=0x7fbc440b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc437fe640 1 --2- 172.21.15.55:0/4136972840 >> v2:172.21.15.138:3300/0 conn(0x7fbc440cc870 0x7fbc440b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc437fe640 1 -- 172.21.15.55:0/4136972840 >> v1:172.21.15.138:6789/0 conn(0x7fbc440b4130 legacy=0x7fbc440d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc437fe640 1 -- 172.21.15.55:0/4136972840 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc441604b0 con 0x7fbc440b7b90 2023-07-06T22:20:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.923+0000 7fbc42ffd640 1 --2- 172.21.15.55:0/4136972840 >> v2:172.21.15.138:3300/0 conn(0x7fbc440cc870 0x7fbc440b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.927+0000 7fbc437fe640 1 --2- 172.21.15.55:0/4136972840 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc440b7b90 0x7fbc440d1c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009870 tx=0x7fbc3401c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4825664b7e2984ed server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.927+0000 7fbc427fc640 1 -- 172.21.15.55:0/4136972840 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc340ab640 con 0x7fbc440b7b90 2023-07-06T22:20:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.927+0000 7fbc427fc640 1 -- 172.21.15.55:0/4136972840 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc340a7070 con 0x7fbc440b7b90 2023-07-06T22:20:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.927+0000 7fbc427fc640 1 -- 172.21.15.55:0/4136972840 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc340ab9c0 con 0x7fbc440b7b90 2023-07-06T22:20:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.927+0000 7fbc49b37640 1 -- 172.21.15.55:0/4136972840 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc440b7b90 msgr2=0x7fbc440d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.927+0000 7fbc49b37640 1 --2- 172.21.15.55:0/4136972840 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc440b7b90 0x7fbc440d1c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009870 tx=0x7fbc3401c520 comp rx=0 tx=0).stop 2023-07-06T22:20:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.927+0000 7fbc49b37640 1 -- 172.21.15.55:0/4136972840 shutdown_connections 2023-07-06T22:20:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.927+0000 7fbc49b37640 1 --2- 172.21.15.55:0/4136972840 >> v2:172.21.15.138:3300/0 conn(0x7fbc440cc870 0x7fbc440b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.927+0000 7fbc49b37640 1 --2- 172.21.15.55:0/4136972840 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc440b7b90 0x7fbc440d1c40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.927+0000 7fbc49b37640 1 -- 172.21.15.55:0/4136972840 >> 172.21.15.55:0/4136972840 conn(0x7fbc440ceca0 msgr2=0x7fbc440cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.927+0000 7fbc49b37640 1 -- 172.21.15.55:0/4136972840 shutdown_connections 2023-07-06T22:20:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.927+0000 7fbc49b37640 1 -- 172.21.15.55:0/4136972840 wait complete. 2023-07-06T22:20:25.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc49b37640 1 Processor -- start 2023-07-06T22:20:25.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc49b37640 1 -- start start 2023-07-06T22:20:25.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc49b37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc440b4130 0x7fbc4414c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc49b37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc440b7b90 0x7fbc441575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc49b37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc440cc870 0x7fbc44152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc49b37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4415acb0 con 0x7fbc440cc870 2023-07-06T22:20:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc49b37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4414da60 con 0x7fbc440b7b90 2023-07-06T22:20:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc49b37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc441566c0 con 0x7fbc440b4130 2023-07-06T22:20:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc43fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc440cc870 0x7fbc44152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc43fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc440cc870 0x7fbc44152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44594/0 (socket says 172.21.15.55:44594) 2023-07-06T22:20:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc43fff640 1 -- 172.21.15.55:0/763508488 learned_addr learned my addr 172.21.15.55:0/763508488 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc437fe640 1 --2- 172.21.15.55:0/763508488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc440b4130 0x7fbc4414c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc42ffd640 1 --2- 172.21.15.55:0/763508488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc440b7b90 0x7fbc441575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc43fff640 1 -- 172.21.15.55:0/763508488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc440b4130 msgr2=0x7fbc4414c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc43fff640 1 --2- 172.21.15.55:0/763508488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc440b4130 0x7fbc4414c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc43fff640 1 -- 172.21.15.55:0/763508488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc440b7b90 msgr2=0x7fbc441575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc43fff640 1 --2- 172.21.15.55:0/763508488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc440b7b90 0x7fbc441575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc43fff640 1 -- 172.21.15.55:0/763508488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38009420 con 0x7fbc440cc870 2023-07-06T22:20:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc43fff640 1 --2- 172.21.15.55:0/763508488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc440cc870 0x7fbc44152540 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00c770 tx=0x7fbc3c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc2bfff640 1 -- 172.21.15.55:0/763508488 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c003b80 con 0x7fbc440cc870 2023-07-06T22:20:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc2bfff640 1 -- 172.21.15.55:0/763508488 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c003ce0 con 0x7fbc440cc870 2023-07-06T22:20:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc49b37640 1 -- 172.21.15.55:0/763508488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc340094d0 con 0x7fbc440cc870 2023-07-06T22:20:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc2bfff640 1 -- 172.21.15.55:0/763508488 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c00aa90 con 0x7fbc440cc870 2023-07-06T22:20:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc49b37640 1 -- 172.21.15.55:0/763508488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4414d680 con 0x7fbc440cc870 2023-07-06T22:20:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.931+0000 7fbc49b37640 1 -- 172.21.15.55:0/763508488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc44066d60 con 0x7fbc440cc870 2023-07-06T22:20:25.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.935+0000 7fbc2bfff640 1 -- 172.21.15.55:0/763508488 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbc3c00abf0 con 0x7fbc440cc870 2023-07-06T22:20:25.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.935+0000 7fbc2bfff640 1 --2- 172.21.15.55:0/763508488 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fbc300663a0 0x7fbc30068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:25.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.935+0000 7fbc2bfff640 1 -- 172.21.15.55:0/763508488 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fbc3c083d30 con 0x7fbc440cc870 2023-07-06T22:20:25.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.935+0000 7fbc437fe640 1 --2- 172.21.15.55:0/763508488 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fbc300663a0 0x7fbc30068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:25.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.935+0000 7fbc437fe640 1 --2- 172.21.15.55:0/763508488 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fbc300663a0 0x7fbc30068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc340af000 tx=0x7fbc340b6040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:25.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:25.939+0000 7fbc2bfff640 1 -- 172.21.15.55:0/763508488 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc3c050fe0 con 0x7fbc440cc870 2023-07-06T22:20:26.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:26.127+0000 7fbc49b37640 1 -- 172.21.15.55:0/763508488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbc44158b40 con 0x7fbc440cc870 2023-07-06T22:20:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.127+0000 7fbc2bfff640 1 -- 172.21.15.55:0/763508488 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v87) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbc3c054600 con 0x7fbc440cc870 2023-07-06T22:20:27.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.131+0000 7fbc49b37640 1 -- 172.21.15.55:0/763508488 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fbc300663a0 msgr2=0x7fbc30068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:27.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.131+0000 7fbc49b37640 1 --2- 172.21.15.55:0/763508488 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fbc300663a0 0x7fbc30068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc340af000 tx=0x7fbc340b6040 comp rx=0 tx=0).stop 2023-07-06T22:20:27.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.131+0000 7fbc49b37640 1 -- 172.21.15.55:0/763508488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc440cc870 msgr2=0x7fbc44152540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:27.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.131+0000 7fbc49b37640 1 --2- 172.21.15.55:0/763508488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc440cc870 0x7fbc44152540 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00c770 tx=0x7fbc3c00cc30 comp rx=0 tx=0).stop 2023-07-06T22:20:27.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.131+0000 7fbc49b37640 1 -- 172.21.15.55:0/763508488 shutdown_connections 2023-07-06T22:20:27.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.131+0000 7fbc49b37640 1 --2- 172.21.15.55:0/763508488 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fbc300663a0 0x7fbc30068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.131+0000 7fbc49b37640 1 --2- 172.21.15.55:0/763508488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc440cc870 0x7fbc44152540 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.131+0000 7fbc49b37640 1 --2- 172.21.15.55:0/763508488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc440b7b90 0x7fbc441575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.131+0000 7fbc49b37640 1 --2- 172.21.15.55:0/763508488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc440b4130 0x7fbc4414c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.131+0000 7fbc49b37640 1 -- 172.21.15.55:0/763508488 >> 172.21.15.55:0/763508488 conn(0x7fbc440ceca0 msgr2=0x7fbc440d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:27.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.131+0000 7fbc49b37640 1 -- 172.21.15.55:0/763508488 shutdown_connections 2023-07-06T22:20:27.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.131+0000 7fbc49b37640 1 -- 172.21.15.55:0/763508488 wait complete. 2023-07-06T22:20:27.156 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T22:20:27.157 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:20:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.303+0000 7f0cfff40640 1 Processor -- start 2023-07-06T22:20:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.303+0000 7f0cfff40640 1 -- start start 2023-07-06T22:20:27.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.303+0000 7f0cfff40640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0cf80cde40 0x7f0cf815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:27.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.303+0000 7f0cfff40640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0cf806f8e0 0x7f0cf806fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:27.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.303+0000 7f0cfff40640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf80ce290 con 0x7f0cf8157e40 2023-07-06T22:20:27.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfff40640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf8158210 con 0x7f0cf806f8e0 2023-07-06T22:20:27.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfff40640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf815bd10 con 0x7f0cf80cde40 2023-07-06T22:20:27.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfdcdc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0cf8157e40 0x7f0cf8158dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41854/0 (socket says 172.21.15.55:41854) 2023-07-06T22:20:27.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfdcdc640 1 -- 172.21.15.55:0/3950898557 learned_addr learned my addr 172.21.15.55:0/3950898557 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfe4dd640 1 --2- 172.21.15.55:0/3950898557 >> v2:172.21.15.55:3300/0 conn(0x7f0cf806f8e0 0x7f0cf806fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfd4db640 1 --2- 172.21.15.55:0/3950898557 >> v2:172.21.15.138:3300/0 conn(0x7f0cf80cde40 0x7f0cf815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfe4dd640 1 -- 172.21.15.55:0/3950898557 >> v2:172.21.15.138:3300/0 conn(0x7f0cf80cde40 msgr2=0x7f0cf815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfe4dd640 1 --2- 172.21.15.55:0/3950898557 >> v2:172.21.15.138:3300/0 conn(0x7f0cf80cde40 0x7f0cf815c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfe4dd640 1 -- 172.21.15.55:0/3950898557 >> v1:172.21.15.55:6789/0 conn(0x7f0cf8157e40 legacy=0x7f0cf8158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfe4dd640 1 -- 172.21.15.55:0/3950898557 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf8070280 con 0x7f0cf806f8e0 2023-07-06T22:20:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfd4db640 1 --2- 172.21.15.55:0/3950898557 >> v2:172.21.15.138:3300/0 conn(0x7f0cf80cde40 0x7f0cf815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:27.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfe4dd640 1 --2- 172.21.15.55:0/3950898557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf806f8e0 0x7f0cf806fd40 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7f0cf806a640 tx=0x7f0cf001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837c89a0bc6f3c4f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:27.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfccda640 1 -- 172.21.15.55:0/3950898557 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00a6650 con 0x7f0cf806f8e0 2023-07-06T22:20:27.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfccda640 1 -- 172.21.15.55:0/3950898557 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf00a67b0 con 0x7f0cf806f8e0 2023-07-06T22:20:27.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.307+0000 7f0cfccda640 1 -- 172.21.15.55:0/3950898557 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00a6b40 con 0x7f0cf806f8e0 2023-07-06T22:20:27.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 -- 172.21.15.55:0/3950898557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf806f8e0 msgr2=0x7f0cf806fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:27.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 --2- 172.21.15.55:0/3950898557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf806f8e0 0x7f0cf806fd40 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7f0cf806a640 tx=0x7f0cf001c910 comp rx=0 tx=0).stop 2023-07-06T22:20:27.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 -- 172.21.15.55:0/3950898557 shutdown_connections 2023-07-06T22:20:27.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 --2- 172.21.15.55:0/3950898557 >> v2:172.21.15.138:3300/0 conn(0x7f0cf80cde40 0x7f0cf815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 --2- 172.21.15.55:0/3950898557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf806f8e0 0x7f0cf806fd40 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 -- 172.21.15.55:0/3950898557 >> 172.21.15.55:0/3950898557 conn(0x7f0cf80cbd80 msgr2=0x7f0cf80ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:27.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 -- 172.21.15.55:0/3950898557 shutdown_connections 2023-07-06T22:20:27.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 -- 172.21.15.55:0/3950898557 wait complete. 2023-07-06T22:20:27.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 Processor -- start 2023-07-06T22:20:27.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 -- start start 2023-07-06T22:20:27.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cf806f8e0 0x7f0cf8147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:27.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf80cde40 0x7f0cf8155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:27.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf8157e40 0x7f0cf80c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:27.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80caaf0 con 0x7f0cf8157e40 2023-07-06T22:20:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf81483f0 con 0x7f0cf806f8e0 2023-07-06T22:20:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfff40640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80c95a0 con 0x7f0cf80cde40 2023-07-06T22:20:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfe4dd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf8157e40 0x7f0cf80c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfe4dd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf8157e40 0x7f0cf80c98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44612/0 (socket says 172.21.15.55:44612) 2023-07-06T22:20:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfe4dd640 1 -- 172.21.15.55:0/3820899819 learned_addr learned my addr 172.21.15.55:0/3820899819 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfdcdc640 1 --2- 172.21.15.55:0/3820899819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cf806f8e0 0x7f0cf8147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.311+0000 7f0cfd4db640 1 --2- 172.21.15.55:0/3820899819 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf80cde40 0x7f0cf8155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cfe4dd640 1 -- 172.21.15.55:0/3820899819 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf80cde40 msgr2=0x7f0cf8155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cfe4dd640 1 --2- 172.21.15.55:0/3820899819 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf80cde40 0x7f0cf8155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cfe4dd640 1 -- 172.21.15.55:0/3820899819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cf806f8e0 msgr2=0x7f0cf8147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cfe4dd640 1 --2- 172.21.15.55:0/3820899819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cf806f8e0 0x7f0cf8147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cfe4dd640 1 -- 172.21.15.55:0/3820899819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf0009a70 con 0x7f0cf8157e40 2023-07-06T22:20:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cfe4dd640 1 --2- 172.21.15.55:0/3820899819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf8157e40 0x7f0cf80c98d0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7f0cf001a540 tx=0x7f0cf00196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cee7fc640 1 -- 172.21.15.55:0/3820899819 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00b6070 con 0x7f0cf8157e40 2023-07-06T22:20:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cee7fc640 1 -- 172.21.15.55:0/3820899819 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf00a7430 con 0x7f0cf8157e40 2023-07-06T22:20:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cee7fc640 1 -- 172.21.15.55:0/3820899819 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00a77c0 con 0x7f0cf8157e40 2023-07-06T22:20:27.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cfff40640 1 -- 172.21.15.55:0/3820899819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf80c92c0 con 0x7f0cf8157e40 2023-07-06T22:20:27.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cfff40640 1 -- 172.21.15.55:0/3820899819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf80ca780 con 0x7f0cf8157e40 2023-07-06T22:20:27.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cfff40640 1 -- 172.21.15.55:0/3820899819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf8066d60 con 0x7f0cf8157e40 2023-07-06T22:20:27.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cee7fc640 1 -- 172.21.15.55:0/3820899819 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0cf00c3430 con 0x7f0cf8157e40 2023-07-06T22:20:27.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cee7fc640 1 --2- 172.21.15.55:0/3820899819 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f0cdc0663a0 0x7f0cdc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:27.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.315+0000 7f0cee7fc640 1 -- 172.21.15.55:0/3820899819 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0cf011e1b0 con 0x7f0cf8157e40 2023-07-06T22:20:27.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.319+0000 7f0cfdcdc640 1 --2- 172.21.15.55:0/3820899819 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f0cdc0663a0 0x7f0cdc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:27.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.319+0000 7f0cfdcdc640 1 --2- 172.21.15.55:0/3820899819 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f0cdc0663a0 0x7f0cdc068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4005890 tx=0x7f0cf4009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:27.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.319+0000 7f0cee7fc640 1 -- 172.21.15.55:0/3820899819 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0cf00eb350 con 0x7f0cf8157e40 2023-07-06T22:20:27.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.507+0000 7f0cfff40640 1 -- 172.21.15.55:0/3820899819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cf806a6f0 con 0x7f0cf8157e40 2023-07-06T22:20:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.511+0000 7f0cee7fc640 1 -- 172.21.15.55:0/3820899819 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4687 (secure 0 0 0) 0x7f0cf00bf090 con 0x7f0cf8157e40 2023-07-06T22:20:27.512 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:27.512 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":87,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2023670167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2023670167},{"type":"v1","addr":"172.21.15.138:6834","nonce":2023670167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":10989,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2906978966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2906978966},{"type":"v1","addr":"172.21.15.55:6836","nonce":2906978966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":10992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1643276481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1643276481},{"type":"v1","addr":"172.21.15.55:6837","nonce":1643276481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:20:23.728829+0000","modified":"2023-07-06T22:20:27.126611+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11001":{"gid":11001,"name":"d","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6835/3113237921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3113237921},{"type":"v1","addr":"172.21.15.138:6835","nonce":3113237921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-06T22:20:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 87 2023-07-06T22:20:27.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.511+0000 7f0cfff40640 1 -- 172.21.15.55:0/3820899819 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f0cdc0663a0 msgr2=0x7f0cdc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:27.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.511+0000 7f0cfff40640 1 --2- 172.21.15.55:0/3820899819 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f0cdc0663a0 0x7f0cdc068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4005890 tx=0x7f0cf4009040 comp rx=0 tx=0).stop 2023-07-06T22:20:27.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.511+0000 7f0cfff40640 1 -- 172.21.15.55:0/3820899819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf8157e40 msgr2=0x7f0cf80c98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:27.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.511+0000 7f0cfff40640 1 --2- 172.21.15.55:0/3820899819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf8157e40 0x7f0cf80c98d0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7f0cf001a540 tx=0x7f0cf00196b0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.511+0000 7f0cfff40640 1 -- 172.21.15.55:0/3820899819 shutdown_connections 2023-07-06T22:20:27.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.511+0000 7f0cfff40640 1 --2- 172.21.15.55:0/3820899819 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f0cdc0663a0 0x7f0cdc068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.511+0000 7f0cfff40640 1 --2- 172.21.15.55:0/3820899819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf8157e40 0x7f0cf80c98d0 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.511+0000 7f0cfff40640 1 --2- 172.21.15.55:0/3820899819 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cf80cde40 0x7f0cf8155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.511+0000 7f0cfff40640 1 --2- 172.21.15.55:0/3820899819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cf806f8e0 0x7f0cf8147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.511+0000 7f0cfff40640 1 -- 172.21.15.55:0/3820899819 >> 172.21.15.55:0/3820899819 conn(0x7f0cf80cbd80 msgr2=0x7f0cf8161090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:27.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.511+0000 7f0cfff40640 1 -- 172.21.15.55:0/3820899819 shutdown_connections 2023-07-06T22:20:27.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.511+0000 7f0cfff40640 1 -- 172.21.15.55:0/3820899819 wait complete. 2023-07-06T22:20:27.533 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:20:27.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.671+0000 7efd30fad640 1 Processor -- start 2023-07-06T22:20:27.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.671+0000 7efd30fad640 1 -- start start 2023-07-06T22:20:27.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.675+0000 7efd30fad640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efd2c0ca450 0x7efd2c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:27.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.675+0000 7efd30fad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd2c0b3730 0x7efd2c15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:27.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.675+0000 7efd30fad640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2c159cd0 con 0x7efd2c0712f0 2023-07-06T22:20:27.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.675+0000 7efd30fad640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2c0693f0 con 0x7efd2c0ca450 2023-07-06T22:20:27.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.675+0000 7efd30fad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c06aca0 con 0x7efd2c0b3730 2023-07-06T22:20:27.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.675+0000 7efd23fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efd2c0ca450 0x7efd2c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.675+0000 7efd2ad9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd2c0b3730 0x7efd2c15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.675+0000 7efd23fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efd2c0ca450 0x7efd2c06a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:52456/0 (socket says 172.21.15.55:52456) 2023-07-06T22:20:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.675+0000 7efd23fff640 1 -- 172.21.15.55:0/1173856004 learned_addr learned my addr 172.21.15.55:0/1173856004 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.675+0000 7efd23fff640 1 -- 172.21.15.55:0/1173856004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd2c0b3730 msgr2=0x7efd2c15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.675+0000 7efd23fff640 1 --2- 172.21.15.55:0/1173856004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd2c0b3730 0x7efd2c15d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.675+0000 7efd23fff640 1 -- 172.21.15.55:0/1173856004 >> v1:172.21.15.138:6789/0 conn(0x7efd2c0712f0 legacy=0x7efd2c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.675+0000 7efd23fff640 1 -- 172.21.15.55:0/1173856004 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c0696b0 con 0x7efd2c0ca450 2023-07-06T22:20:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.679+0000 7efd23fff640 1 --2- 172.21.15.55:0/1173856004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd2c0ca450 0x7efd2c06a610 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efd14009870 tx=0x7efd1401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ed7ed49e8d8dd46 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.679+0000 7efd29d9b640 1 -- 172.21.15.55:0/1173856004 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd140aa670 con 0x7efd2c0ca450 2023-07-06T22:20:27.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.679+0000 7efd29d9b640 1 -- 172.21.15.55:0/1173856004 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd140aa7d0 con 0x7efd2c0ca450 2023-07-06T22:20:27.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.679+0000 7efd29d9b640 1 -- 172.21.15.55:0/1173856004 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd140aab60 con 0x7efd2c0ca450 2023-07-06T22:20:27.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.679+0000 7efd30fad640 1 -- 172.21.15.55:0/1173856004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd2c0ca450 msgr2=0x7efd2c06a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.679+0000 7efd30fad640 1 --2- 172.21.15.55:0/1173856004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd2c0ca450 0x7efd2c06a610 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efd14009870 tx=0x7efd1401c510 comp rx=0 tx=0).stop 2023-07-06T22:20:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.679+0000 7efd30fad640 1 -- 172.21.15.55:0/1173856004 shutdown_connections 2023-07-06T22:20:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.679+0000 7efd30fad640 1 --2- 172.21.15.55:0/1173856004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd2c0b3730 0x7efd2c15d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.679+0000 7efd30fad640 1 --2- 172.21.15.55:0/1173856004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd2c0ca450 0x7efd2c06a610 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.679+0000 7efd30fad640 1 -- 172.21.15.55:0/1173856004 >> 172.21.15.55:0/1173856004 conn(0x7efd2c0cded0 msgr2=0x7efd2c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.679+0000 7efd30fad640 1 -- 172.21.15.55:0/1173856004 shutdown_connections 2023-07-06T22:20:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.679+0000 7efd30fad640 1 -- 172.21.15.55:0/1173856004 wait complete. 2023-07-06T22:20:27.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.679+0000 7efd30fad640 1 Processor -- start 2023-07-06T22:20:27.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.679+0000 7efd30fad640 1 -- start start 2023-07-06T22:20:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd30fad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd2c0712f0 0x7efd2c1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd30fad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd2c0b3730 0x7efd2c150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd30fad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd2c0ca450 0x7efd2c14e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd30fad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c154710 con 0x7efd2c0b3730 2023-07-06T22:20:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd30fad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c151190 con 0x7efd2c0ca450 2023-07-06T22:20:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd30fad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c153010 con 0x7efd2c0712f0 2023-07-06T22:20:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd23fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd2c0b3730 0x7efd2c150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd23fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd2c0b3730 0x7efd2c150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44628/0 (socket says 172.21.15.55:44628) 2023-07-06T22:20:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd23fff640 1 -- 172.21.15.55:0/719337449 learned_addr learned my addr 172.21.15.55:0/719337449 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd2a59c640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd2c0712f0 0x7efd2c1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd2ad9d640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd2c0ca450 0x7efd2c14e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd23fff640 1 -- 172.21.15.55:0/719337449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd2c0712f0 msgr2=0x7efd2c1541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd23fff640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd2c0712f0 0x7efd2c1541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd23fff640 1 -- 172.21.15.55:0/719337449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd2c0ca450 msgr2=0x7efd2c14e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd23fff640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd2c0ca450 0x7efd2c14e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd23fff640 1 -- 172.21.15.55:0/719337449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd140094d0 con 0x7efd2c0b3730 2023-07-06T22:20:27.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd2a59c640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd2c0712f0 0x7efd2c1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:27.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd2ad9d640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd2c0ca450 0x7efd2c14e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:27.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd23fff640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd2c0b3730 0x7efd2c150c50 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7efd140ac040 tx=0x7efd140192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:27.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd22ffd640 1 -- 172.21.15.55:0/719337449 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd140b4810 con 0x7efd2c0b3730 2023-07-06T22:20:27.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd22ffd640 1 -- 172.21.15.55:0/719337449 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd140b49b0 con 0x7efd2c0b3730 2023-07-06T22:20:27.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd22ffd640 1 -- 172.21.15.55:0/719337449 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd140b4d60 con 0x7efd2c0b3730 2023-07-06T22:20:27.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd30fad640 1 -- 172.21.15.55:0/719337449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd2c1532f0 con 0x7efd2c0b3730 2023-07-06T22:20:27.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd30fad640 1 -- 172.21.15.55:0/719337449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2c0af160 con 0x7efd2c0b3730 2023-07-06T22:20:27.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.683+0000 7efd30fad640 1 -- 172.21.15.55:0/719337449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2c066d60 con 0x7efd2c0b3730 2023-07-06T22:20:27.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.687+0000 7efd22ffd640 1 -- 172.21.15.55:0/719337449 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efd140b3390 con 0x7efd2c0b3730 2023-07-06T22:20:27.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.687+0000 7efd22ffd640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efd0c0663a0 0x7efd0c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:27.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.687+0000 7efd22ffd640 1 -- 172.21.15.55:0/719337449 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7efd1411ec50 con 0x7efd2c0b3730 2023-07-06T22:20:27.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.687+0000 7efd2a59c640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efd0c0663a0 0x7efd0c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:27.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.687+0000 7efd2a59c640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efd0c0663a0 0x7efd0c068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0b2ac0 tx=0x7efd1c009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:27.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.691+0000 7efd22ffd640 1 -- 172.21.15.55:0/719337449 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efd140ebde0 con 0x7efd2c0b3730 2023-07-06T22:20:27.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.847+0000 7efd30fad640 1 -- 172.21.15.55:0/719337449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd2c150890 con 0x7efd2c0b3730 2023-07-06T22:20:27.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.847+0000 7efd22ffd640 1 -- 172.21.15.55:0/719337449 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+18598 (secure 0 0 0) 0x7efd140ef400 con 0x7efd2c0b3730 2023-07-06T22:20:27.850 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:27.850 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":196,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:20:24.732227+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:20:21.647148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-07-06T22:20:22.723236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:20:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.847+0000 7efd30fad640 1 -- 172.21.15.55:0/719337449 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efd0c0663a0 msgr2=0x7efd0c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.847+0000 7efd30fad640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efd0c0663a0 0x7efd0c068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0b2ac0 tx=0x7efd1c009040 comp rx=0 tx=0).stop 2023-07-06T22:20:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.847+0000 7efd30fad640 1 -- 172.21.15.55:0/719337449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd2c0b3730 msgr2=0x7efd2c150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.847+0000 7efd30fad640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd2c0b3730 0x7efd2c150c50 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7efd140ac040 tx=0x7efd140192b0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.851+0000 7efd30fad640 1 -- 172.21.15.55:0/719337449 shutdown_connections 2023-07-06T22:20:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.851+0000 7efd30fad640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efd0c0663a0 0x7efd0c068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.851+0000 7efd30fad640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd2c0ca450 0x7efd2c14e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.851+0000 7efd30fad640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd2c0b3730 0x7efd2c150c50 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.851+0000 7efd30fad640 1 --2- 172.21.15.55:0/719337449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efd2c0712f0 0x7efd2c1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.851+0000 7efd30fad640 1 -- 172.21.15.55:0/719337449 >> 172.21.15.55:0/719337449 conn(0x7efd2c0cded0 msgr2=0x7efd2c0cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.851+0000 7efd30fad640 1 -- 172.21.15.55:0/719337449 shutdown_connections 2023-07-06T22:20:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:27.851+0000 7efd30fad640 1 -- 172.21.15.55:0/719337449 wait complete. 2023-07-06T22:20:27.871 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T22:20:27.871 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:20:28.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.011+0000 7f450d5d2640 1 Processor -- start 2023-07-06T22:20:28.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.011+0000 7f450d5d2640 1 -- start start 2023-07-06T22:20:28.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.011+0000 7f450d5d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45080b7cd0 0x7f45080ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.011+0000 7f450d5d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45080cecf0 con 0x7f45080ccab0 2023-07-06T22:20:28.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.011+0000 7f450d5d2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45080d1d90 con 0x7f45080b1fe0 2023-07-06T22:20:28.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.011+0000 7f450d5d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45080d2310 con 0x7f45080b7cd0 2023-07-06T22:20:28.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.011+0000 7f4506ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45080b7cd0 0x7f45080ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.011+0000 7f4506ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45080b7cd0 0x7f45080ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44634/0 (socket says 172.21.15.55:44634) 2023-07-06T22:20:28.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.011+0000 7f4506ffd640 1 -- 172.21.15.55:0/1339785664 learned_addr learned my addr 172.21.15.55:0/1339785664 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:28.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.015+0000 7f4506ffd640 1 -- 172.21.15.55:0/1339785664 >> v1:172.21.15.138:6789/0 conn(0x7f45080b1fe0 legacy=0x7f450815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.015+0000 7f4506ffd640 1 -- 172.21.15.55:0/1339785664 >> v1:172.21.15.55:6789/0 conn(0x7f45080ccab0 legacy=0x7f45080b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.015+0000 7f4506ffd640 1 -- 172.21.15.55:0/1339785664 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45080d2030 con 0x7f45080b7cd0 2023-07-06T22:20:28.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.015+0000 7f4506ffd640 1 --2- 172.21.15.55:0/1339785664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45080b7cd0 0x7f45080ce610 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009870 tx=0x7f44f801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cb3c360e91bdc9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:28.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.015+0000 7f45067fc640 1 -- 172.21.15.55:0/1339785664 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f80ab600 con 0x7f45080b7cd0 2023-07-06T22:20:28.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.015+0000 7f45067fc640 1 -- 172.21.15.55:0/1339785664 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f80a7050 con 0x7f45080b7cd0 2023-07-06T22:20:28.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.015+0000 7f45067fc640 1 -- 172.21.15.55:0/1339785664 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f80ab980 con 0x7f45080b7cd0 2023-07-06T22:20:28.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.015+0000 7f450d5d2640 1 -- 172.21.15.55:0/1339785664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45080b7cd0 msgr2=0x7f45080ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.015+0000 7f450d5d2640 1 --2- 172.21.15.55:0/1339785664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45080b7cd0 0x7f45080ce610 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009870 tx=0x7f44f801c4b0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f450d5d2640 1 -- 172.21.15.55:0/1339785664 shutdown_connections 2023-07-06T22:20:28.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f450d5d2640 1 --2- 172.21.15.55:0/1339785664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45080b7cd0 0x7f45080ce610 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f450d5d2640 1 -- 172.21.15.55:0/1339785664 >> 172.21.15.55:0/1339785664 conn(0x7f45080ceee0 msgr2=0x7f45080cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:28.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f450d5d2640 1 -- 172.21.15.55:0/1339785664 shutdown_connections 2023-07-06T22:20:28.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f450d5d2640 1 -- 172.21.15.55:0/1339785664 wait complete. 2023-07-06T22:20:28.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f450d5d2640 1 Processor -- start 2023-07-06T22:20:28.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f450d5d2640 1 -- start start 2023-07-06T22:20:28.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f450d5d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45080b1fe0 0x7f450815d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f450d5d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45080b7cd0 0x7f45081499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f450d5d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45080ccab0 0x7f450814a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f450d5d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450815da20 con 0x7f45080b7cd0 2023-07-06T22:20:28.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f450d5d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45081521a0 con 0x7f45080ccab0 2023-07-06T22:20:28.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f450d5d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4508152480 con 0x7f45080b1fe0 2023-07-06T22:20:28.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f44fffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45080b7cd0 0x7f45081499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f44fffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45080b7cd0 0x7f45081499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44642/0 (socket says 172.21.15.55:44642) 2023-07-06T22:20:28.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f44fffff640 1 -- 172.21.15.55:0/3357378529 learned_addr learned my addr 172.21.15.55:0/3357378529 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:28.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f4506ffd640 1 --2- 172.21.15.55:0/3357378529 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45080b1fe0 0x7f450815d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f45077fe640 1 --2- 172.21.15.55:0/3357378529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45080ccab0 0x7f450814a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f44fffff640 1 -- 172.21.15.55:0/3357378529 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45080b1fe0 msgr2=0x7f450815d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f44fffff640 1 --2- 172.21.15.55:0/3357378529 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45080b1fe0 0x7f450815d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f44fffff640 1 -- 172.21.15.55:0/3357378529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45080ccab0 msgr2=0x7f450814a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f44fffff640 1 --2- 172.21.15.55:0/3357378529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45080ccab0 0x7f450814a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f44fffff640 1 -- 172.21.15.55:0/3357378529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f80094d0 con 0x7f45080b7cd0 2023-07-06T22:20:28.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.019+0000 7f44fffff640 1 --2- 172.21.15.55:0/3357378529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45080b7cd0 0x7f45081499f0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c3c0 tx=0x7f44f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:28.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.023+0000 7f44ff7fe640 1 -- 172.21.15.55:0/3357378529 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00052d0 con 0x7f45080b7cd0 2023-07-06T22:20:28.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.023+0000 7f44ff7fe640 1 -- 172.21.15.55:0/3357378529 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f0005430 con 0x7f45080b7cd0 2023-07-06T22:20:28.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.023+0000 7f450d5d2640 1 -- 172.21.15.55:0/3357378529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4508152760 con 0x7f45080b7cd0 2023-07-06T22:20:28.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.023+0000 7f44ff7fe640 1 -- 172.21.15.55:0/3357378529 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0003840 con 0x7f45080b7cd0 2023-07-06T22:20:28.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.023+0000 7f450d5d2640 1 -- 172.21.15.55:0/3357378529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4508152d20 con 0x7f45080b7cd0 2023-07-06T22:20:28.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.023+0000 7f450d5d2640 1 -- 172.21.15.55:0/3357378529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4508152f40 con 0x7f45080b7cd0 2023-07-06T22:20:28.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.023+0000 7f44ff7fe640 1 -- 172.21.15.55:0/3357378529 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f44f00039a0 con 0x7f45080b7cd0 2023-07-06T22:20:28.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.023+0000 7f44ff7fe640 1 --2- 172.21.15.55:0/3357378529 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f44e80663d0 0x7f44e8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.023+0000 7f44ff7fe640 1 -- 172.21.15.55:0/3357378529 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f44f00834e0 con 0x7f45080b7cd0 2023-07-06T22:20:28.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.023+0000 7f4506ffd640 1 --2- 172.21.15.55:0/3357378529 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f44e80663d0 0x7f44e8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.027+0000 7f4506ffd640 1 --2- 172.21.15.55:0/3357378529 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f44e80663d0 0x7f44e8068880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f44f80ad000 tx=0x7f44f80a6000 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:28.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.027+0000 7f44ff7fe640 1 -- 172.21.15.55:0/3357378529 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44f0050700 con 0x7f45080b7cd0 2023-07-06T22:20:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.183+0000 7f450d5d2640 1 -- 172.21.15.55:0/3357378529 --> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4508066d60 con 0x7f44e80663d0 2023-07-06T22:20:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.191+0000 7f44ff7fe640 1 -- 172.21.15.55:0/3357378529 <== mgr.10752 v2:172.21.15.55:6832/538997467 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299838 (secure 0 0 0) 0x7f4508066d60 con 0x7f44e80663d0 2023-07-06T22:20:28.199 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:28.200 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:20:28.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.195+0000 7f450d5d2640 1 -- 172.21.15.55:0/3357378529 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f44e80663d0 msgr2=0x7f44e8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.195+0000 7f450d5d2640 1 --2- 172.21.15.55:0/3357378529 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f44e80663d0 0x7f44e8068880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f44f80ad000 tx=0x7f44f80a6000 comp rx=0 tx=0).stop 2023-07-06T22:20:28.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.195+0000 7f450d5d2640 1 -- 172.21.15.55:0/3357378529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45080b7cd0 msgr2=0x7f45081499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.195+0000 7f450d5d2640 1 --2- 172.21.15.55:0/3357378529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45080b7cd0 0x7f45081499f0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c3c0 tx=0x7f44f000c880 comp rx=0 tx=0).stop 2023-07-06T22:20:28.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.195+0000 7f450d5d2640 1 -- 172.21.15.55:0/3357378529 shutdown_connections 2023-07-06T22:20:28.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.195+0000 7f450d5d2640 1 --2- 172.21.15.55:0/3357378529 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f44e80663d0 0x7f44e8068880 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.195+0000 7f450d5d2640 1 --2- 172.21.15.55:0/3357378529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45080ccab0 0x7f450814a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.195+0000 7f450d5d2640 1 --2- 172.21.15.55:0/3357378529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45080b7cd0 0x7f45081499f0 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.195+0000 7f450d5d2640 1 --2- 172.21.15.55:0/3357378529 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45080b1fe0 0x7f450815d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.195+0000 7f450d5d2640 1 -- 172.21.15.55:0/3357378529 >> 172.21.15.55:0/3357378529 conn(0x7f45080ceee0 msgr2=0x7f45080693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:28.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.199+0000 7f450d5d2640 1 -- 172.21.15.55:0/3357378529 shutdown_connections 2023-07-06T22:20:28.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.199+0000 7f450d5d2640 1 -- 172.21.15.55:0/3357378529 wait complete. 2023-07-06T22:20:28.219 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-06T22:20:27.200212+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":385652,"kb_used_data":20020,"kb_used_omap":0,"kb_used_meta":365568,"kb_avail":754589068,"statfs":{"total":773094113280,"available":772699205632,"internally_reserved":0,"allocated":20500480,"data_stored":11569220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":374341632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.881130"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324110+0000","last_change":"2023-07-06T22:20:22.324110+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324110+0000","last_undegraded":"2023-07-06T22:20:22.324110+0000","last_fullsized":"2023-07-06T22:20:22.324110+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.331691+0000","last_change":"2023-07-06T22:20:22.331691+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.331691+0000","last_undegraded":"2023-07-06T22:20:22.331691+0000","last_fullsized":"2023-07-06T22:20:22.331691+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.331126+0000","last_change":"2023-07-06T22:20:22.331126+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.331126+0000","last_undegraded":"2023-07-06T22:20:22.331126+0000","last_fullsized":"2023-07-06T22:20:22.331126+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329222+0000","last_change":"2023-07-06T22:20:22.329222+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329222+0000","last_undegraded":"2023-07-06T22:20:22.329222+0000","last_fullsized":"2023-07-06T22:20:22.329222+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324420+0000","last_change":"2023-07-06T22:20:22.324420+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324420+0000","last_undegraded":"2023-07-06T22:20:22.324420+0000","last_fullsized":"2023-07-06T22:20:22.324420+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.330865+0000","last_change":"2023-07-06T22:20:22.330865+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.330865+0000","last_undegraded":"2023-07-06T22:20:22.330865+0000","last_fullsized":"2023-07-06T22:20:22.330865+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.322732+0000","last_change":"2023-07-06T22:20:22.322732+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.322732+0000","last_undegraded":"2023-07-06T22:20:22.322732+0000","last_fullsized":"2023-07-06T22:20:22.322732+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324383+0000","last_change":"2023-07-06T22:20:22.324383+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324383+0000","last_undegraded":"2023-07-06T22:20:22.324383+0000","last_fullsized":"2023-07-06T22:20:22.324383+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.331802+0000","last_change":"2023-07-06T22:20:22.331802+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.331802+0000","last_undegraded":"2023-07-06T22:20:22.331802+0000","last_fullsized":"2023-07-06T22:20:22.331802+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.322677+0000","last_change":"2023-07-06T22:20:22.322677+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.322677+0000","last_undegraded":"2023-07-06T22:20:22.322677+0000","last_fullsized":"2023-07-06T22:20:22.322677+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324727+0000","last_change":"2023-07-06T22:20:22.324727+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324727+0000","last_undegraded":"2023-07-06T22:20:22.324727+0000","last_fullsized":"2023-07-06T22:20:22.324727+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324092+0000","last_change":"2023-07-06T22:20:22.324092+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324092+0000","last_undegraded":"2023-07-06T22:20:22.324092+0000","last_fullsized":"2023-07-06T22:20:22.324092+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329187+0000","last_change":"2023-07-06T22:20:22.329187+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329187+0000","last_undegraded":"2023-07-06T22:20:22.329187+0000","last_fullsized":"2023-07-06T22:20:22.329187+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.332004+0000","last_change":"2023-07-06T22:20:22.332004+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.332004+0000","last_undegraded":"2023-07-06T22:20:22.332004+0000","last_fullsized":"2023-07-06T22:20:22.332004+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329262+0000","last_change":"2023-07-06T22:20:22.329262+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329262+0000","last_undegraded":"2023-07-06T22:20:22.329262+0000","last_fullsized":"2023-07-06T22:20:22.329262+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.327529+0000","last_change":"2023-07-06T22:20:22.327529+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.327529+0000","last_undegraded":"2023-07-06T22:20:22.327529+0000","last_fullsized":"2023-07-06T22:20:22.327529+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.325255+0000","last_change":"2023-07-06T22:20:22.325255+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.325255+0000","last_undegraded":"2023-07-06T22:20:22.325255+0000","last_fullsized":"2023-07-06T22:20:22.325255+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.330952+0000","last_change":"2023-07-06T22:20:22.330952+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.330952+0000","last_undegraded":"2023-07-06T22:20:22.330952+0000","last_fullsized":"2023-07-06T22:20:22.330952+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.330811+0000","last_change":"2023-07-06T22:20:22.330811+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.330811+0000","last_undegraded":"2023-07-06T22:20:22.330811+0000","last_fullsized":"2023-07-06T22:20:22.330811+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.322478+0000","last_change":"2023-07-06T22:20:22.322478+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.322478+0000","last_undegraded":"2023-07-06T22:20:22.322478+0000","last_fullsized":"2023-07-06T22:20:22.322478+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.326843+0000","last_change":"2023-07-06T22:20:22.326843+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.326843+0000","last_undegraded":"2023-07-06T22:20:22.326843+0000","last_fullsized":"2023-07-06T22:20:22.326843+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.328316+0000","last_change":"2023-07-06T22:20:22.328316+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.328316+0000","last_undegraded":"2023-07-06T22:20:22.328316+0000","last_fullsized":"2023-07-06T22:20:22.328316+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.326084+0000","last_change":"2023-07-06T22:20:22.326084+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.326084+0000","last_undegraded":"2023-07-06T22:20:22.326084+0000","last_fullsized":"2023-07-06T22:20:22.326084+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329373+0000","last_change":"2023-07-06T22:20:22.329373+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329373+0000","last_undegraded":"2023-07-06T22:20:22.329373+0000","last_fullsized":"2023-07-06T22:20:22.329373+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324424+0000","last_change":"2023-07-06T22:20:22.324424+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324424+0000","last_undegraded":"2023-07-06T22:20:22.324424+0000","last_fullsized":"2023-07-06T22:20:22.324424+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1258,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.326120+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:20:22.326120+0000","last_peered":"2023-07-06T22:20:22.326120+0000","last_clean":"2023-07-06T22:20:22.326120+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:20:22.326120+0000","last_undegraded":"2023-07-06T22:20:22.326120+0000","last_fullsized":"2023-07-06T22:20:22.326120+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:53:19.132052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":313,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.327256+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:20:22.327256+0000","last_peered":"2023-07-06T22:20:22.327256+0000","last_clean":"2023-07-06T22:20:22.327256+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:20:22.327256+0000","last_undegraded":"2023-07-06T22:20:22.327256+0000","last_fullsized":"2023-07-06T22:20:22.327256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:22:29.408840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.322796+0000","last_change":"2023-07-06T22:20:22.322796+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.322796+0000","last_undegraded":"2023-07-06T22:20:22.322796+0000","last_fullsized":"2023-07-06T22:20:22.322796+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":361,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.325976+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:20:22.325976+0000","last_peered":"2023-07-06T22:20:22.325976+0000","last_clean":"2023-07-06T22:20:22.325976+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:20:22.325976+0000","last_undegraded":"2023-07-06T22:20:22.325976+0000","last_fullsized":"2023-07-06T22:20:22.325976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:45:35.604221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.331301+0000","last_change":"2023-07-06T22:20:22.331301+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.331301+0000","last_undegraded":"2023-07-06T22:20:22.331301+0000","last_fullsized":"2023-07-06T22:20:22.331301+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":357,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.330891+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:20:22.330891+0000","last_peered":"2023-07-06T22:20:22.330891+0000","last_clean":"2023-07-06T22:20:22.330891+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:20:22.330891+0000","last_undegraded":"2023-07-06T22:20:22.330891+0000","last_fullsized":"2023-07-06T22:20:22.330891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:58:00.162499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.325327+0000","last_change":"2023-07-06T22:20:22.325327+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.325327+0000","last_undegraded":"2023-07-06T22:20:22.325327+0000","last_fullsized":"2023-07-06T22:20:22.325327+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":313,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.328587+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:20:22.328587+0000","last_peered":"2023-07-06T22:20:22.328587+0000","last_clean":"2023-07-06T22:20:22.328587+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:20:22.328587+0000","last_undegraded":"2023-07-06T22:20:22.328587+0000","last_fullsized":"2023-07-06T22:20:22.328587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:17:20.739778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.328012+0000","last_change":"2023-07-06T22:20:22.328012+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.328012+0000","last_undegraded":"2023-07-06T22:20:22.328012+0000","last_fullsized":"2023-07-06T22:20:22.328012+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":317,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.330684+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:20:22.330684+0000","last_peered":"2023-07-06T22:20:22.330684+0000","last_clean":"2023-07-06T22:20:22.330684+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:20:22.330684+0000","last_undegraded":"2023-07-06T22:20:22.330684+0000","last_fullsized":"2023-07-06T22:20:22.330684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:50:52.904440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.332281+0000","last_change":"2023-07-06T22:20:22.332281+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.332281+0000","last_undegraded":"2023-07-06T22:20:22.332281+0000","last_fullsized":"2023-07-06T22:20:22.332281+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":361,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.326162+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:20:22.326162+0000","last_peered":"2023-07-06T22:20:22.326162+0000","last_clean":"2023-07-06T22:20:22.326162+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:20:22.326162+0000","last_undegraded":"2023-07-06T22:20:22.326162+0000","last_fullsized":"2023-07-06T22:20:22.326162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:54:04.128795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.325661+0000","last_change":"2023-07-06T22:20:22.325661+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.325661+0000","last_undegraded":"2023-07-06T22:20:22.325661+0000","last_fullsized":"2023-07-06T22:20:22.325661+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":316,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.330781+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:20:22.330781+0000","last_peered":"2023-07-06T22:20:22.330781+0000","last_clean":"2023-07-06T22:20:22.330781+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:20:22.330781+0000","last_undegraded":"2023-07-06T22:20:22.330781+0000","last_fullsized":"2023-07-06T22:20:22.330781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:43:30.428064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329222+0000","last_change":"2023-07-06T22:20:22.329222+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329222+0000","last_undegraded":"2023-07-06T22:20:22.329222+0000","last_fullsized":"2023-07-06T22:20:22.329222+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":308,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.326152+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:20:22.326152+0000","last_peered":"2023-07-06T22:20:22.326152+0000","last_clean":"2023-07-06T22:20:22.326152+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:20:22.326152+0000","last_undegraded":"2023-07-06T22:20:22.326152+0000","last_fullsized":"2023-07-06T22:20:22.326152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:23:16.000115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575304,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42180,"kb_used_data":2940,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329660,"statfs":{"total":96636764160,"available":96593571840,"internally_reserved":0,"allocated":3010560,"data_stored":1889998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.432},"max":{"1min":0.92100000000000004,"5min":0.93300000000000005,"15min":1.0740000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51600000000000001,"5min":0.45900000000000002,"15min":0.45700000000000002},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.52100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.74199999999999999,"15min":0.72399999999999998},"min":{"1min":0.57699999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.61099999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"max":{"1min":0.96399999999999997,"5min":0.96699999999999997,"15min":1.0149999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73999999999999999,"15min":0.73199999999999998},"min":{"1min":0.53100000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.84099999999999997,"15min":0.78400000000000003},"min":{"1min":0.56200000000000006,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":9.8279999999999994,"15min":9.8279999999999994},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.36799999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73499999999999999,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":2.2610000000000001,"5min":13.443,"15min":13.443},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.52400000000000002,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.76100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575304,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37500,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334340,"statfs":{"total":96636764160,"available":96598364160,"internally_reserved":0,"allocated":2412544,"data_stored":1298611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.40300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.7829999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":1.633},"last":0.95899999999999996}]},{"osd":1,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.49199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.9099999999999999},"last":0.753},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.97799999999999998},"last":0.93500000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83199999999999996,"5min":0.91100000000000003,"15min":2.0299999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":1.04,"15min":1.5920000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.61099999999999999,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.996},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.69699999999999995,"5min":1.024,"15min":1.024},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80200000000000005,"5min":0.92600000000000005,"15min":0.996},"last":0.98199999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":0.89900000000000002,"15min":0.98499999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.85999999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.83399999999999996}]},{"osd":7,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82499999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.624},"min":{"1min":0.54100000000000004,"5min":0.45600000000000002,"15min":0.439},"max":{"1min":0.78400000000000003,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.73299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575303,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59648,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312192,"statfs":{"total":96636764160,"available":96575684608,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.92100000000000004,"5min":0.97199999999999998,"15min":0.999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.628,"5min":0.46999999999999997,"15min":0.46400000000000002},"max":{"1min":0.88400000000000001,"5min":0.995,"15min":0.995},"last":0.748}]},{"osd":1,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.52200000000000002,"5min":0.44400000000000001,"15min":0.43099999999999999},"max":{"1min":0.94799999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.60599999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.006,"5min":1.006,"15min":1.3200000000000001},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.46300000000000002},"max":{"1min":0.93700000000000006,"5min":0.998,"15min":1.4299999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.749},"min":{"1min":0.56200000000000006,"5min":0.48499999999999999,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":0.999,"15min":1.0409999999999999},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.54400000000000004,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":0.996,"15min":1.5169999999999999},"last":0.621},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.623,"5min":0.51500000000000001,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61599999999999999,"15min":0.61699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.79800000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.622,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.5,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69799999999999995,"15min":0.69099999999999995},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55552,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316288,"statfs":{"total":96636764160,"available":96579878912,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.42199999999999999},"max":{"1min":0.876,"5min":0.96399999999999997,"15min":0.98999999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":0.97899999999999998,"15min":1.016},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.56899999999999995,"5min":0.47899999999999998,"15min":0.38300000000000001},"max":{"1min":0.93400000000000005,"5min":0.999,"15min":1.0309999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.996},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.622,"5min":0.54600000000000004,"15min":0.502},"max":{"1min":0.97699999999999998,"5min":0.99399999999999999,"15min":1.0580000000000001},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.53500000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.98699999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":1.022,"15min":1.03},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.36599999999999999},"max":{"1min":0.76800000000000002,"5min":0.91200000000000003,"15min":0.92600000000000005},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":0.95599999999999996,"15min":1.006},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.91500000000000004,"15min":1.0509999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.41299999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.746}]},{"osd":7,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90300000000000002,"5min":0.94799999999999995,"15min":1.0469999999999999},"last":0.876},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.432,"15min":0.432},"max":{"1min":0.90200000000000002,"5min":1.0109999999999999,"15min":1.1100000000000001},"last":0.93300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575303,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51456,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320384,"statfs":{"total":96636764160,"available":96584073216,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.27300000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.65800000000000003,"5min":0.68100000000000005,"15min":0.85899999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64900000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.27700000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64100000000000001,"5min":0.69799999999999995,"15min":0.83899999999999997},"last":0.374},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.41299999999999998},"max":{"1min":0.80200000000000005,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64500000000000002,"5min":0.72399999999999998,"15min":0.875},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.77400000000000002},"min":{"1min":0.64100000000000001,"5min":0.53500000000000003,"15min":0.441},"max":{"1min":0.93400000000000005,"5min":1.0449999999999999,"15min":1.474},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79500000000000004,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":0.93400000000000005,"5min":1.0920000000000001,"15min":1.3859999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.57499999999999996},"max":{"1min":1.085,"5min":1.175,"15min":1.3740000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.68500000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1,"5min":1.0249999999999999,"15min":1.2330000000000001},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.58199999999999996,"15min":0.51800000000000002},"max":{"1min":1,"5min":1.1399999999999999,"15min":1.3899999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.57299999999999995},"max":{"1min":1.083,"5min":1.1499999999999999,"15min":1.3220000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83899999999999997,"15min":0.82199999999999995},"min":{"1min":0.73199999999999998,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.0649999999999999,"5min":1.1160000000000001,"15min":1.2210000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83799999999999997,"15min":0.82799999999999996},"min":{"1min":0.67500000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0369999999999999,"5min":1.244,"15min":1.3200000000000001},"last":0.61499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575303,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41600,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330240,"statfs":{"total":96636764160,"available":96594165760,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.77000000000000002,"15min":0.78600000000000003},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.42499999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65600000000000003,"5min":0.74099999999999999,"15min":0.84099999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.72399999999999998,"5min":0.85099999999999998,"15min":0.97099999999999997},"last":0.441}]},{"osd":3,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.63600000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58799999999999997},"min":{"1min":0.46300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.66500000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94199999999999995,"5min":1.663,"15min":1.663},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.61099999999999999,"5min":0.54900000000000004,"15min":0.51600000000000001},"max":{"1min":0.94899999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.626}]},{"osd":5,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.66000000000000003,"5min":0.55900000000000005,"15min":0.51100000000000001},"max":{"1min":0.90900000000000003,"5min":1.337,"15min":1.337},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80700000000000005,"15min":0.82899999999999996},"min":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0189999999999999,"5min":1.228,"15min":1.2829999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.996,"5min":1.367,"15min":1.367},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81200000000000006,"15min":0.82999999999999996},"min":{"1min":0.65300000000000002,"5min":0.59999999999999998,"15min":0.56100000000000005},"max":{"1min":0.96499999999999997,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.98099999999999998,"5min":1.407,"15min":1.407},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82099999999999995,"15min":0.83999999999999997},"min":{"1min":0.67200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.024,"5min":1.296,"15min":1.296},"last":0.68799999999999994}]}]},{"osd":1,"up_from":13,"seq":55834575304,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59648,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312192,"statfs":{"total":96636764160,"available":96575684608,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.316,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.72599999999999998,"5min":1.645,"15min":1.645},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.72299999999999998,"5min":0.90700000000000003,"15min":0.94299999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.68799999999999994,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.502,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.81699999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79600000000000004,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74299999999999999,"15min":0.77600000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96999999999999997,"5min":1.083,"15min":1.1140000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78700000000000003,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.51700000000000002},"max":{"1min":0.92700000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.48699999999999999},"max":{"1min":1.012,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79800000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96399999999999997,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95399999999999996,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.56100000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94299999999999995,"5min":1.25,"15min":1.3360000000000001},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81399999999999995,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.56100000000000005},"max":{"1min":0.99199999999999999,"5min":1.155,"15min":1.405},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.61199999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98199999999999998,"5min":1.788,"15min":1.788},"last":1.008}]}]},{"osd":0,"up_from":13,"seq":55834575303,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38068,"kb_used_data":2924,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333772,"statfs":{"total":96636764160,"available":96597782528,"internally_reserved":0,"allocated":2994176,"data_stored":1882461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.45100000000000001,"15min":0.45900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.50700000000000001,"5min":0.745,"15min":0.745},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.749,"15min":1.1319999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.1599999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65300000000000002,"5min":0.72699999999999998,"15min":0.89200000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.40999999999999998},"max":{"1min":0.66500000000000004,"5min":0.77200000000000002,"15min":0.95399999999999996},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":1.294,"15min":1.294},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.50900000000000001},"max":{"1min":1.0660000000000001,"5min":1.1000000000000001,"15min":1.3320000000000001},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.79600000000000004,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.345,"15min":1.345},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.56599999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.103,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":0.748}]},{"osd":6,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.47699999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.153},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0840000000000001,"5min":1.1910000000000001,"15min":1.272},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0049999999999999,"5min":1.125,"15min":1.26},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.82399999999999995,"15min":0.81699999999999995},"min":{"1min":0.61199999999999999,"5min":0.60499999999999998,"15min":0.55700000000000005},"max":{"1min":1.1220000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:20:28.226 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:20:28.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.399+0000 7fcee13ad640 1 Processor -- start 2023-07-06T22:20:28.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.399+0000 7fcee13ad640 1 -- start start 2023-07-06T22:20:28.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.399+0000 7fcee13ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcedc15b7e0 0x7fcedc0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.399+0000 7fcee13ad640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcedc160300 0x7fcedc0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.399+0000 7fcee13ad640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc0cdc80 con 0x7fcedc0c8a60 2023-07-06T22:20:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.399+0000 7fcee13ad640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcedc0cd6c0 con 0x7fcedc160300 2023-07-06T22:20:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.399+0000 7fcee13ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0cd9a0 con 0x7fcedc15b7e0 2023-07-06T22:20:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.403+0000 7fcedb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcedc0c8a60 0x7fcedc06b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41868/0 (socket says 172.21.15.55:41868) 2023-07-06T22:20:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.403+0000 7fcedb7fe640 1 -- 172.21.15.55:0/1107215402 learned_addr learned my addr 172.21.15.55:0/1107215402 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.403+0000 7fced3fff640 1 --2- 172.21.15.55:0/1107215402 >> v2:172.21.15.138:3300/0 conn(0x7fcedc160300 0x7fcedc0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.403+0000 7fcedaffd640 1 --2- 172.21.15.55:0/1107215402 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcedc15b7e0 0x7fcedc0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.403+0000 7fceda7fc640 1 -- 172.21.15.55:0/1107215402 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853591970 0 0) 0x7fcedc0cdc80 con 0x7fcedc0c8a60 2023-07-06T22:20:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.403+0000 7fceda7fc640 1 -- 172.21.15.55:0/1107215402 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec8003530 con 0x7fcedc0c8a60 2023-07-06T22:20:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.403+0000 7fced3fff640 1 -- 172.21.15.55:0/1107215402 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcedc15b7e0 msgr2=0x7fcedc0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.403+0000 7fced3fff640 1 --2- 172.21.15.55:0/1107215402 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcedc15b7e0 0x7fcedc0cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.403+0000 7fced3fff640 1 -- 172.21.15.55:0/1107215402 >> v1:172.21.15.55:6789/0 conn(0x7fcedc0c8a60 legacy=0x7fcedc06b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.403+0000 7fced3fff640 1 -- 172.21.15.55:0/1107215402 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc069490 con 0x7fcedc160300 2023-07-06T22:20:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.403+0000 7fcedaffd640 1 --2- 172.21.15.55:0/1107215402 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcedc15b7e0 0x7fcedc0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.403+0000 7fced3fff640 1 --2- 172.21.15.55:0/1107215402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcedc160300 0x7fcedc0c8520 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fcec40097c0 tx=0x7fcec401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b02d752d301ca7e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fceda7fc640 1 -- 172.21.15.55:0/1107215402 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40ab670 con 0x7fcedc160300 2023-07-06T22:20:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fceda7fc640 1 -- 172.21.15.55:0/1107215402 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec40ab7d0 con 0x7fcedc160300 2023-07-06T22:20:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fceda7fc640 1 -- 172.21.15.55:0/1107215402 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40abb60 con 0x7fcedc160300 2023-07-06T22:20:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 -- 172.21.15.55:0/1107215402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcedc160300 msgr2=0x7fcedc0c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 --2- 172.21.15.55:0/1107215402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcedc160300 0x7fcedc0c8520 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fcec40097c0 tx=0x7fcec401c450 comp rx=0 tx=0).stop 2023-07-06T22:20:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 -- 172.21.15.55:0/1107215402 shutdown_connections 2023-07-06T22:20:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 --2- 172.21.15.55:0/1107215402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcedc160300 0x7fcedc0c8520 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 --2- 172.21.15.55:0/1107215402 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcedc15b7e0 0x7fcedc0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 -- 172.21.15.55:0/1107215402 >> 172.21.15.55:0/1107215402 conn(0x7fcedc0cded0 msgr2=0x7fcedc0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 -- 172.21.15.55:0/1107215402 shutdown_connections 2023-07-06T22:20:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 -- 172.21.15.55:0/1107215402 wait complete. 2023-07-06T22:20:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 Processor -- start 2023-07-06T22:20:28.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 -- start start 2023-07-06T22:20:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcedc0c8a60 0x7fcedc14fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcedc15b7e0 0x7fcedc14e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcedc160300 0x7fcedc159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc15aac0 con 0x7fcedc0c8a60 2023-07-06T22:20:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc1539b0 con 0x7fcedc160300 2023-07-06T22:20:28.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcee13ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc070730 con 0x7fcedc15b7e0 2023-07-06T22:20:28.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.407+0000 7fcedaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcedc0c8a60 0x7fcedc14fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fcedaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcedc0c8a60 0x7fcedc14fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44656/0 (socket says 172.21.15.55:44656) 2023-07-06T22:20:28.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fcedaffd640 1 -- 172.21.15.55:0/4033425080 learned_addr learned my addr 172.21.15.55:0/4033425080 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:28.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fced3fff640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcedc15b7e0 0x7fcedc14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fcedb7fe640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcedc160300 0x7fcedc159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fcedaffd640 1 -- 172.21.15.55:0/4033425080 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcedc15b7e0 msgr2=0x7fcedc14e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fcedaffd640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcedc15b7e0 0x7fcedc14e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fcedaffd640 1 -- 172.21.15.55:0/4033425080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcedc160300 msgr2=0x7fcedc159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fcedaffd640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcedc160300 0x7fcedc159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fcedaffd640 1 -- 172.21.15.55:0/4033425080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc009420 con 0x7fcedc0c8a60 2023-07-06T22:20:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fcedb7fe640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcedc160300 0x7fcedc159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fcedaffd640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcedc0c8a60 0x7fcedc14fe40 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00ebe0 tx=0x7fcecc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:28.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fced37fe640 1 -- 172.21.15.55:0/4033425080 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00eee0 con 0x7fcedc0c8a60 2023-07-06T22:20:28.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fced37fe640 1 -- 172.21.15.55:0/4033425080 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00cc30 con 0x7fcedc0c8a60 2023-07-06T22:20:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fced37fe640 1 -- 172.21.15.55:0/4033425080 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc013470 con 0x7fcedc0c8a60 2023-07-06T22:20:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fcee13ad640 1 -- 172.21.15.55:0/4033425080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec4009420 con 0x7fcedc0c8a60 2023-07-06T22:20:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fcee13ad640 1 -- 172.21.15.55:0/4033425080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcedc15acf0 con 0x7fcedc0c8a60 2023-07-06T22:20:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fcee13ad640 1 -- 172.21.15.55:0/4033425080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcedc066d60 con 0x7fcedc0c8a60 2023-07-06T22:20:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.411+0000 7fced37fe640 1 -- 172.21.15.55:0/4033425080 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcecc0135d0 con 0x7fcedc0c8a60 2023-07-06T22:20:28.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.415+0000 7fced37fe640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fcebc0663a0 0x7fcebc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.415+0000 7fced37fe640 1 -- 172.21.15.55:0/4033425080 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fcecc084290 con 0x7fcedc0c8a60 2023-07-06T22:20:28.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.415+0000 7fced3fff640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fcebc0663a0 0x7fcebc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.415+0000 7fced3fff640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fcebc0663a0 0x7fcebc068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcec40af000 tx=0x7fcec40a7000 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:28.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.419+0000 7fced37fe640 1 -- 172.21.15.55:0/4033425080 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcecc054f40 con 0x7fcedc0c8a60 2023-07-06T22:20:28.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.571+0000 7fcee13ad640 1 -- 172.21.15.55:0/4033425080 --> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcedc150ad0 con 0x7fcebc0663a0 2023-07-06T22:20:28.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.579+0000 7fced37fe640 1 -- 172.21.15.55:0/4033425080 <== mgr.10752 v2:172.21.15.55:6832/538997467 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299838 (secure 0 0 0) 0x7fcedc150ad0 con 0x7fcebc0663a0 2023-07-06T22:20:28.583 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:28.585 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:20:28.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.583+0000 7fcee13ad640 1 -- 172.21.15.55:0/4033425080 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fcebc0663a0 msgr2=0x7fcebc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.583+0000 7fcee13ad640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fcebc0663a0 0x7fcebc068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcec40af000 tx=0x7fcec40a7000 comp rx=0 tx=0).stop 2023-07-06T22:20:28.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.583+0000 7fcee13ad640 1 -- 172.21.15.55:0/4033425080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcedc0c8a60 msgr2=0x7fcedc14fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.583+0000 7fcee13ad640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcedc0c8a60 0x7fcedc14fe40 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00ebe0 tx=0x7fcecc00c520 comp rx=0 tx=0).stop 2023-07-06T22:20:28.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.583+0000 7fcee13ad640 1 -- 172.21.15.55:0/4033425080 shutdown_connections 2023-07-06T22:20:28.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.583+0000 7fcee13ad640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7fcebc0663a0 0x7fcebc068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.583+0000 7fcee13ad640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcedc160300 0x7fcedc159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.583+0000 7fcee13ad640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcedc15b7e0 0x7fcedc14e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.583+0000 7fcee13ad640 1 --2- 172.21.15.55:0/4033425080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcedc0c8a60 0x7fcedc14fe40 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.583+0000 7fcee13ad640 1 -- 172.21.15.55:0/4033425080 >> 172.21.15.55:0/4033425080 conn(0x7fcedc0cded0 msgr2=0x7fcedc0ae360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:28.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.583+0000 7fcee13ad640 1 -- 172.21.15.55:0/4033425080 shutdown_connections 2023-07-06T22:20:28.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.583+0000 7fcee13ad640 1 -- 172.21.15.55:0/4033425080 wait complete. 2023-07-06T22:20:28.604 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-06T22:20:27.200212+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":385652,"kb_used_data":20020,"kb_used_omap":0,"kb_used_meta":365568,"kb_avail":754589068,"statfs":{"total":773094113280,"available":772699205632,"internally_reserved":0,"allocated":20500480,"data_stored":11569220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":374341632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.881130"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324110+0000","last_change":"2023-07-06T22:20:22.324110+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324110+0000","last_undegraded":"2023-07-06T22:20:22.324110+0000","last_fullsized":"2023-07-06T22:20:22.324110+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.331691+0000","last_change":"2023-07-06T22:20:22.331691+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.331691+0000","last_undegraded":"2023-07-06T22:20:22.331691+0000","last_fullsized":"2023-07-06T22:20:22.331691+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.331126+0000","last_change":"2023-07-06T22:20:22.331126+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.331126+0000","last_undegraded":"2023-07-06T22:20:22.331126+0000","last_fullsized":"2023-07-06T22:20:22.331126+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329222+0000","last_change":"2023-07-06T22:20:22.329222+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329222+0000","last_undegraded":"2023-07-06T22:20:22.329222+0000","last_fullsized":"2023-07-06T22:20:22.329222+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324420+0000","last_change":"2023-07-06T22:20:22.324420+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324420+0000","last_undegraded":"2023-07-06T22:20:22.324420+0000","last_fullsized":"2023-07-06T22:20:22.324420+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.330865+0000","last_change":"2023-07-06T22:20:22.330865+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.330865+0000","last_undegraded":"2023-07-06T22:20:22.330865+0000","last_fullsized":"2023-07-06T22:20:22.330865+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.322732+0000","last_change":"2023-07-06T22:20:22.322732+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.322732+0000","last_undegraded":"2023-07-06T22:20:22.322732+0000","last_fullsized":"2023-07-06T22:20:22.322732+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324383+0000","last_change":"2023-07-06T22:20:22.324383+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324383+0000","last_undegraded":"2023-07-06T22:20:22.324383+0000","last_fullsized":"2023-07-06T22:20:22.324383+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.331802+0000","last_change":"2023-07-06T22:20:22.331802+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.331802+0000","last_undegraded":"2023-07-06T22:20:22.331802+0000","last_fullsized":"2023-07-06T22:20:22.331802+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.322677+0000","last_change":"2023-07-06T22:20:22.322677+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.322677+0000","last_undegraded":"2023-07-06T22:20:22.322677+0000","last_fullsized":"2023-07-06T22:20:22.322677+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324727+0000","last_change":"2023-07-06T22:20:22.324727+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324727+0000","last_undegraded":"2023-07-06T22:20:22.324727+0000","last_fullsized":"2023-07-06T22:20:22.324727+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324092+0000","last_change":"2023-07-06T22:20:22.324092+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324092+0000","last_undegraded":"2023-07-06T22:20:22.324092+0000","last_fullsized":"2023-07-06T22:20:22.324092+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329187+0000","last_change":"2023-07-06T22:20:22.329187+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329187+0000","last_undegraded":"2023-07-06T22:20:22.329187+0000","last_fullsized":"2023-07-06T22:20:22.329187+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.332004+0000","last_change":"2023-07-06T22:20:22.332004+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.332004+0000","last_undegraded":"2023-07-06T22:20:22.332004+0000","last_fullsized":"2023-07-06T22:20:22.332004+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329262+0000","last_change":"2023-07-06T22:20:22.329262+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329262+0000","last_undegraded":"2023-07-06T22:20:22.329262+0000","last_fullsized":"2023-07-06T22:20:22.329262+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.327529+0000","last_change":"2023-07-06T22:20:22.327529+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.327529+0000","last_undegraded":"2023-07-06T22:20:22.327529+0000","last_fullsized":"2023-07-06T22:20:22.327529+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.325255+0000","last_change":"2023-07-06T22:20:22.325255+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.325255+0000","last_undegraded":"2023-07-06T22:20:22.325255+0000","last_fullsized":"2023-07-06T22:20:22.325255+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.330952+0000","last_change":"2023-07-06T22:20:22.330952+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.330952+0000","last_undegraded":"2023-07-06T22:20:22.330952+0000","last_fullsized":"2023-07-06T22:20:22.330952+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.330811+0000","last_change":"2023-07-06T22:20:22.330811+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.330811+0000","last_undegraded":"2023-07-06T22:20:22.330811+0000","last_fullsized":"2023-07-06T22:20:22.330811+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.322478+0000","last_change":"2023-07-06T22:20:22.322478+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.322478+0000","last_undegraded":"2023-07-06T22:20:22.322478+0000","last_fullsized":"2023-07-06T22:20:22.322478+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.326843+0000","last_change":"2023-07-06T22:20:22.326843+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.326843+0000","last_undegraded":"2023-07-06T22:20:22.326843+0000","last_fullsized":"2023-07-06T22:20:22.326843+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.328316+0000","last_change":"2023-07-06T22:20:22.328316+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.328316+0000","last_undegraded":"2023-07-06T22:20:22.328316+0000","last_fullsized":"2023-07-06T22:20:22.328316+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.326084+0000","last_change":"2023-07-06T22:20:22.326084+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.326084+0000","last_undegraded":"2023-07-06T22:20:22.326084+0000","last_fullsized":"2023-07-06T22:20:22.326084+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329373+0000","last_change":"2023-07-06T22:20:22.329373+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329373+0000","last_undegraded":"2023-07-06T22:20:22.329373+0000","last_fullsized":"2023-07-06T22:20:22.329373+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324424+0000","last_change":"2023-07-06T22:20:22.324424+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324424+0000","last_undegraded":"2023-07-06T22:20:22.324424+0000","last_fullsized":"2023-07-06T22:20:22.324424+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1258,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.326120+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:20:22.326120+0000","last_peered":"2023-07-06T22:20:22.326120+0000","last_clean":"2023-07-06T22:20:22.326120+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:20:22.326120+0000","last_undegraded":"2023-07-06T22:20:22.326120+0000","last_fullsized":"2023-07-06T22:20:22.326120+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:53:19.132052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":313,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.327256+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:20:22.327256+0000","last_peered":"2023-07-06T22:20:22.327256+0000","last_clean":"2023-07-06T22:20:22.327256+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:20:22.327256+0000","last_undegraded":"2023-07-06T22:20:22.327256+0000","last_fullsized":"2023-07-06T22:20:22.327256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:22:29.408840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.322796+0000","last_change":"2023-07-06T22:20:22.322796+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.322796+0000","last_undegraded":"2023-07-06T22:20:22.322796+0000","last_fullsized":"2023-07-06T22:20:22.322796+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":361,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.325976+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:20:22.325976+0000","last_peered":"2023-07-06T22:20:22.325976+0000","last_clean":"2023-07-06T22:20:22.325976+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:20:22.325976+0000","last_undegraded":"2023-07-06T22:20:22.325976+0000","last_fullsized":"2023-07-06T22:20:22.325976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:45:35.604221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.331301+0000","last_change":"2023-07-06T22:20:22.331301+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.331301+0000","last_undegraded":"2023-07-06T22:20:22.331301+0000","last_fullsized":"2023-07-06T22:20:22.331301+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":357,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.330891+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:20:22.330891+0000","last_peered":"2023-07-06T22:20:22.330891+0000","last_clean":"2023-07-06T22:20:22.330891+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:20:22.330891+0000","last_undegraded":"2023-07-06T22:20:22.330891+0000","last_fullsized":"2023-07-06T22:20:22.330891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:58:00.162499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.325327+0000","last_change":"2023-07-06T22:20:22.325327+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.325327+0000","last_undegraded":"2023-07-06T22:20:22.325327+0000","last_fullsized":"2023-07-06T22:20:22.325327+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":313,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.328587+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:20:22.328587+0000","last_peered":"2023-07-06T22:20:22.328587+0000","last_clean":"2023-07-06T22:20:22.328587+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:20:22.328587+0000","last_undegraded":"2023-07-06T22:20:22.328587+0000","last_fullsized":"2023-07-06T22:20:22.328587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:17:20.739778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.328012+0000","last_change":"2023-07-06T22:20:22.328012+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.328012+0000","last_undegraded":"2023-07-06T22:20:22.328012+0000","last_fullsized":"2023-07-06T22:20:22.328012+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":317,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.330684+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:20:22.330684+0000","last_peered":"2023-07-06T22:20:22.330684+0000","last_clean":"2023-07-06T22:20:22.330684+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:20:22.330684+0000","last_undegraded":"2023-07-06T22:20:22.330684+0000","last_fullsized":"2023-07-06T22:20:22.330684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:50:52.904440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.332281+0000","last_change":"2023-07-06T22:20:22.332281+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.332281+0000","last_undegraded":"2023-07-06T22:20:22.332281+0000","last_fullsized":"2023-07-06T22:20:22.332281+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":361,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.326162+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:20:22.326162+0000","last_peered":"2023-07-06T22:20:22.326162+0000","last_clean":"2023-07-06T22:20:22.326162+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:20:22.326162+0000","last_undegraded":"2023-07-06T22:20:22.326162+0000","last_fullsized":"2023-07-06T22:20:22.326162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:54:04.128795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.325661+0000","last_change":"2023-07-06T22:20:22.325661+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.325661+0000","last_undegraded":"2023-07-06T22:20:22.325661+0000","last_fullsized":"2023-07-06T22:20:22.325661+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":316,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.330781+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:20:22.330781+0000","last_peered":"2023-07-06T22:20:22.330781+0000","last_clean":"2023-07-06T22:20:22.330781+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:20:22.330781+0000","last_undegraded":"2023-07-06T22:20:22.330781+0000","last_fullsized":"2023-07-06T22:20:22.330781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:43:30.428064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329222+0000","last_change":"2023-07-06T22:20:22.329222+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329222+0000","last_undegraded":"2023-07-06T22:20:22.329222+0000","last_fullsized":"2023-07-06T22:20:22.329222+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":308,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.326152+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:20:22.326152+0000","last_peered":"2023-07-06T22:20:22.326152+0000","last_clean":"2023-07-06T22:20:22.326152+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:20:22.326152+0000","last_undegraded":"2023-07-06T22:20:22.326152+0000","last_fullsized":"2023-07-06T22:20:22.326152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:23:16.000115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575304,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42180,"kb_used_data":2940,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329660,"statfs":{"total":96636764160,"available":96593571840,"internally_reserved":0,"allocated":3010560,"data_stored":1889998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.432},"max":{"1min":0.92100000000000004,"5min":0.93300000000000005,"15min":1.0740000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51600000000000001,"5min":0.45900000000000002,"15min":0.45700000000000002},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.52100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.74199999999999999,"15min":0.72399999999999998},"min":{"1min":0.57699999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.61099999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"max":{"1min":0.96399999999999997,"5min":0.96699999999999997,"15min":1.0149999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73999999999999999,"15min":0.73199999999999998},"min":{"1min":0.53100000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.84099999999999997,"15min":0.78400000000000003},"min":{"1min":0.56200000000000006,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":9.8279999999999994,"15min":9.8279999999999994},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.36799999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73499999999999999,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":2.2610000000000001,"5min":13.443,"15min":13.443},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.52400000000000002,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.76100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575304,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37500,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334340,"statfs":{"total":96636764160,"available":96598364160,"internally_reserved":0,"allocated":2412544,"data_stored":1298611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.40300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.7829999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":1.633},"last":0.95899999999999996}]},{"osd":1,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.49199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.9099999999999999},"last":0.753},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.97799999999999998},"last":0.93500000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83199999999999996,"5min":0.91100000000000003,"15min":2.0299999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":1.04,"15min":1.5920000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.61099999999999999,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.996},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.69699999999999995,"5min":1.024,"15min":1.024},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80200000000000005,"5min":0.92600000000000005,"15min":0.996},"last":0.98199999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":0.89900000000000002,"15min":0.98499999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.85999999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.83399999999999996}]},{"osd":7,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82499999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.624},"min":{"1min":0.54100000000000004,"5min":0.45600000000000002,"15min":0.439},"max":{"1min":0.78400000000000003,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.73299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575303,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59648,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312192,"statfs":{"total":96636764160,"available":96575684608,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.92100000000000004,"5min":0.97199999999999998,"15min":0.999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.628,"5min":0.46999999999999997,"15min":0.46400000000000002},"max":{"1min":0.88400000000000001,"5min":0.995,"15min":0.995},"last":0.748}]},{"osd":1,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.52200000000000002,"5min":0.44400000000000001,"15min":0.43099999999999999},"max":{"1min":0.94799999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.60599999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.006,"5min":1.006,"15min":1.3200000000000001},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.46300000000000002},"max":{"1min":0.93700000000000006,"5min":0.998,"15min":1.4299999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.749},"min":{"1min":0.56200000000000006,"5min":0.48499999999999999,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":0.999,"15min":1.0409999999999999},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.54400000000000004,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":0.996,"15min":1.5169999999999999},"last":0.621},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.623,"5min":0.51500000000000001,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61599999999999999,"15min":0.61699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.79800000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.622,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.5,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69799999999999995,"15min":0.69099999999999995},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55552,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316288,"statfs":{"total":96636764160,"available":96579878912,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.42199999999999999},"max":{"1min":0.876,"5min":0.96399999999999997,"15min":0.98999999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":0.97899999999999998,"15min":1.016},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.56899999999999995,"5min":0.47899999999999998,"15min":0.38300000000000001},"max":{"1min":0.93400000000000005,"5min":0.999,"15min":1.0309999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.996},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.622,"5min":0.54600000000000004,"15min":0.502},"max":{"1min":0.97699999999999998,"5min":0.99399999999999999,"15min":1.0580000000000001},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.53500000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.98699999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":1.022,"15min":1.03},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.36599999999999999},"max":{"1min":0.76800000000000002,"5min":0.91200000000000003,"15min":0.92600000000000005},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":0.95599999999999996,"15min":1.006},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.91500000000000004,"15min":1.0509999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.41299999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.746}]},{"osd":7,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90300000000000002,"5min":0.94799999999999995,"15min":1.0469999999999999},"last":0.876},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.432,"15min":0.432},"max":{"1min":0.90200000000000002,"5min":1.0109999999999999,"15min":1.1100000000000001},"last":0.93300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575303,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51456,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320384,"statfs":{"total":96636764160,"available":96584073216,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.27300000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.65800000000000003,"5min":0.68100000000000005,"15min":0.85899999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64900000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.27700000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64100000000000001,"5min":0.69799999999999995,"15min":0.83899999999999997},"last":0.374},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.41299999999999998},"max":{"1min":0.80200000000000005,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64500000000000002,"5min":0.72399999999999998,"15min":0.875},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.77400000000000002},"min":{"1min":0.64100000000000001,"5min":0.53500000000000003,"15min":0.441},"max":{"1min":0.93400000000000005,"5min":1.0449999999999999,"15min":1.474},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79500000000000004,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":0.93400000000000005,"5min":1.0920000000000001,"15min":1.3859999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.57499999999999996},"max":{"1min":1.085,"5min":1.175,"15min":1.3740000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.68500000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1,"5min":1.0249999999999999,"15min":1.2330000000000001},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.58199999999999996,"15min":0.51800000000000002},"max":{"1min":1,"5min":1.1399999999999999,"15min":1.3899999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.57299999999999995},"max":{"1min":1.083,"5min":1.1499999999999999,"15min":1.3220000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83899999999999997,"15min":0.82199999999999995},"min":{"1min":0.73199999999999998,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.0649999999999999,"5min":1.1160000000000001,"15min":1.2210000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83799999999999997,"15min":0.82799999999999996},"min":{"1min":0.67500000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0369999999999999,"5min":1.244,"15min":1.3200000000000001},"last":0.61499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575303,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41600,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330240,"statfs":{"total":96636764160,"available":96594165760,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.77000000000000002,"15min":0.78600000000000003},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.42499999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65600000000000003,"5min":0.74099999999999999,"15min":0.84099999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.72399999999999998,"5min":0.85099999999999998,"15min":0.97099999999999997},"last":0.441}]},{"osd":3,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.63600000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58799999999999997},"min":{"1min":0.46300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.66500000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94199999999999995,"5min":1.663,"15min":1.663},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.61099999999999999,"5min":0.54900000000000004,"15min":0.51600000000000001},"max":{"1min":0.94899999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.626}]},{"osd":5,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.66000000000000003,"5min":0.55900000000000005,"15min":0.51100000000000001},"max":{"1min":0.90900000000000003,"5min":1.337,"15min":1.337},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80700000000000005,"15min":0.82899999999999996},"min":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0189999999999999,"5min":1.228,"15min":1.2829999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.996,"5min":1.367,"15min":1.367},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81200000000000006,"15min":0.82999999999999996},"min":{"1min":0.65300000000000002,"5min":0.59999999999999998,"15min":0.56100000000000005},"max":{"1min":0.96499999999999997,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.98099999999999998,"5min":1.407,"15min":1.407},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82099999999999995,"15min":0.83999999999999997},"min":{"1min":0.67200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.024,"5min":1.296,"15min":1.296},"last":0.68799999999999994}]}]},{"osd":1,"up_from":13,"seq":55834575304,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59648,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312192,"statfs":{"total":96636764160,"available":96575684608,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.316,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.72599999999999998,"5min":1.645,"15min":1.645},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.72299999999999998,"5min":0.90700000000000003,"15min":0.94299999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.68799999999999994,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.502,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.81699999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79600000000000004,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74299999999999999,"15min":0.77600000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96999999999999997,"5min":1.083,"15min":1.1140000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78700000000000003,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.51700000000000002},"max":{"1min":0.92700000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.48699999999999999},"max":{"1min":1.012,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79800000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96399999999999997,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95399999999999996,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.56100000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94299999999999995,"5min":1.25,"15min":1.3360000000000001},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81399999999999995,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.56100000000000005},"max":{"1min":0.99199999999999999,"5min":1.155,"15min":1.405},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.61199999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98199999999999998,"5min":1.788,"15min":1.788},"last":1.008}]}]},{"osd":0,"up_from":13,"seq":55834575303,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38068,"kb_used_data":2924,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333772,"statfs":{"total":96636764160,"available":96597782528,"internally_reserved":0,"allocated":2994176,"data_stored":1882461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.45100000000000001,"15min":0.45900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.50700000000000001,"5min":0.745,"15min":0.745},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.749,"15min":1.1319999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.1599999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65300000000000002,"5min":0.72699999999999998,"15min":0.89200000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.40999999999999998},"max":{"1min":0.66500000000000004,"5min":0.77200000000000002,"15min":0.95399999999999996},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":1.294,"15min":1.294},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.50900000000000001},"max":{"1min":1.0660000000000001,"5min":1.1000000000000001,"15min":1.3320000000000001},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.79600000000000004,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.345,"15min":1.345},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.56599999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.103,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":0.748}]},{"osd":6,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.47699999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.153},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0840000000000001,"5min":1.1910000000000001,"15min":1.272},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0049999999999999,"5min":1.125,"15min":1.26},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.82399999999999995,"15min":0.81699999999999995},"min":{"1min":0.61199999999999999,"5min":0.60499999999999998,"15min":0.55700000000000005},"max":{"1min":1.1220000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:20:28.610 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:20:28.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcde782640 1 Processor -- start 2023-07-06T22:20:28.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcde782640 1 -- start start 2023-07-06T22:20:28.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcde782640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efcd80b7cd0 0x7efcd80ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcde782640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd80cecf0 con 0x7efcd80b1fe0 2023-07-06T22:20:28.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcde782640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd80d1d90 con 0x7efcd80ccab0 2023-07-06T22:20:28.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcde782640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd80d2310 con 0x7efcd80b7cd0 2023-07-06T22:20:28.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcdcd1f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efcd80b1fe0 0x7efcd815f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41882/0 (socket says 172.21.15.55:41882) 2023-07-06T22:20:28.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcdcd1f640 1 -- 172.21.15.55:0/3304131077 learned_addr learned my addr 172.21.15.55:0/3304131077 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcd7fff640 1 --2- 172.21.15.55:0/3304131077 >> v2:172.21.15.138:3300/0 conn(0x7efcd80b7cd0 0x7efcd80ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcd6ffd640 1 -- 172.21.15.55:0/3304131077 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502595338 0 0) 0x7efcd80cecf0 con 0x7efcd80b1fe0 2023-07-06T22:20:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcd6ffd640 1 -- 172.21.15.55:0/3304131077 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc0003530 con 0x7efcd80b1fe0 2023-07-06T22:20:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcd7fff640 1 -- 172.21.15.55:0/3304131077 >> v1:172.21.15.138:6789/0 conn(0x7efcd80ccab0 legacy=0x7efcd80b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcd6ffd640 1 -- 172.21.15.55:0/3304131077 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786484929 0 0) 0x7efcd80d1d90 con 0x7efcd80ccab0 2023-07-06T22:20:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcd7fff640 1 -- 172.21.15.55:0/3304131077 >> v1:172.21.15.55:6789/0 conn(0x7efcd80b1fe0 legacy=0x7efcd815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.791+0000 7efcd7fff640 1 -- 172.21.15.55:0/3304131077 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd80d2030 con 0x7efcd80b7cd0 2023-07-06T22:20:28.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.795+0000 7efcd7fff640 1 --2- 172.21.15.55:0/3304131077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd80b7cd0 0x7efcd80ce610 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7efcc80097c0 tx=0x7efcc801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0563ed31b16e40f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:28.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.795+0000 7efcd6ffd640 1 -- 172.21.15.55:0/3304131077 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc80ab600 con 0x7efcd80b7cd0 2023-07-06T22:20:28.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.795+0000 7efcd6ffd640 1 -- 172.21.15.55:0/3304131077 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc80a7050 con 0x7efcd80b7cd0 2023-07-06T22:20:28.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.795+0000 7efcd6ffd640 1 -- 172.21.15.55:0/3304131077 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc80ab980 con 0x7efcd80b7cd0 2023-07-06T22:20:28.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.795+0000 7efcde782640 1 -- 172.21.15.55:0/3304131077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd80b7cd0 msgr2=0x7efcd80ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.795+0000 7efcde782640 1 --2- 172.21.15.55:0/3304131077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd80b7cd0 0x7efcd80ce610 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7efcc80097c0 tx=0x7efcc801c3f0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.795+0000 7efcde782640 1 -- 172.21.15.55:0/3304131077 shutdown_connections 2023-07-06T22:20:28.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.795+0000 7efcde782640 1 --2- 172.21.15.55:0/3304131077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd80b7cd0 0x7efcd80ce610 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.795+0000 7efcde782640 1 -- 172.21.15.55:0/3304131077 >> 172.21.15.55:0/3304131077 conn(0x7efcd80ceee0 msgr2=0x7efcd80cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:28.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.795+0000 7efcde782640 1 -- 172.21.15.55:0/3304131077 shutdown_connections 2023-07-06T22:20:28.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.795+0000 7efcde782640 1 -- 172.21.15.55:0/3304131077 wait complete. 2023-07-06T22:20:28.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcde782640 1 Processor -- start 2023-07-06T22:20:28.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcde782640 1 -- start start 2023-07-06T22:20:28.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcde782640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd80b1fe0 0x7efcd814d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcde782640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd80b7cd0 0x7efcd80cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcde782640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcd80ccab0 0x7efcd80d0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcde782640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd815c610 con 0x7efcd80b1fe0 2023-07-06T22:20:28.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcde782640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80b6380 con 0x7efcd80b7cd0 2023-07-06T22:20:28.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcde782640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80b6660 con 0x7efcd80ccab0 2023-07-06T22:20:28.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcd7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd80b1fe0 0x7efcd814d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcd7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd80b1fe0 0x7efcd814d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44668/0 (socket says 172.21.15.55:44668) 2023-07-06T22:20:28.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcd7fff640 1 -- 172.21.15.55:0/2027102760 learned_addr learned my addr 172.21.15.55:0/2027102760 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:28.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcdcd1f640 1 --2- 172.21.15.55:0/2027102760 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcd80ccab0 0x7efcd80d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcd77fe640 1 --2- 172.21.15.55:0/2027102760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd80b7cd0 0x7efcd80cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcd7fff640 1 -- 172.21.15.55:0/2027102760 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcd80ccab0 msgr2=0x7efcd80d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcd7fff640 1 --2- 172.21.15.55:0/2027102760 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcd80ccab0 0x7efcd80d0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcd7fff640 1 -- 172.21.15.55:0/2027102760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd80b7cd0 msgr2=0x7efcd80cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcd7fff640 1 --2- 172.21.15.55:0/2027102760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd80b7cd0 0x7efcd80cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcd7fff640 1 -- 172.21.15.55:0/2027102760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc8009420 con 0x7efcd80b1fe0 2023-07-06T22:20:28.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcd7fff640 1 --2- 172.21.15.55:0/2027102760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd80b1fe0 0x7efcd814d930 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7efcc80097c0 tx=0x7efcc801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:28.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcd4ff9640 1 -- 172.21.15.55:0/2027102760 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc80abd80 con 0x7efcd80b1fe0 2023-07-06T22:20:28.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcd4ff9640 1 -- 172.21.15.55:0/2027102760 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc8004020 con 0x7efcd80b1fe0 2023-07-06T22:20:28.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcde782640 1 -- 172.21.15.55:0/2027102760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd80b6940 con 0x7efcd80b1fe0 2023-07-06T22:20:28.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcd4ff9640 1 -- 172.21.15.55:0/2027102760 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc80043d0 con 0x7efcd80b1fe0 2023-07-06T22:20:28.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.799+0000 7efcde782640 1 -- 172.21.15.55:0/2027102760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd80b6f00 con 0x7efcd80b1fe0 2023-07-06T22:20:28.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.803+0000 7efcde782640 1 -- 172.21.15.55:0/2027102760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd8066d60 con 0x7efcd80b1fe0 2023-07-06T22:20:28.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.803+0000 7efcd4ff9640 1 -- 172.21.15.55:0/2027102760 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efcc8003620 con 0x7efcd80b1fe0 2023-07-06T22:20:28.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.803+0000 7efcd4ff9640 1 --2- 172.21.15.55:0/2027102760 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efcc40663d0 0x7efcc4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:28.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.803+0000 7efcd4ff9640 1 -- 172.21.15.55:0/2027102760 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7efcc811e240 con 0x7efcd80b1fe0 2023-07-06T22:20:28.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.803+0000 7efcd77fe640 1 --2- 172.21.15.55:0/2027102760 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efcc40663d0 0x7efcc4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:28.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.803+0000 7efcd77fe640 1 --2- 172.21.15.55:0/2027102760 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efcc40663d0 0x7efcc4068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efcd8069570 tx=0x7efccc009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:28.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.807+0000 7efcd4ff9640 1 -- 172.21.15.55:0/2027102760 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efcc80eb2a0 con 0x7efcd80b1fe0 2023-07-06T22:20:28.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.959+0000 7efcde782640 1 -- 172.21.15.55:0/2027102760 --> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efcd8160790 con 0x7efcc40663d0 2023-07-06T22:20:28.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.967+0000 7efcd4ff9640 1 -- 172.21.15.55:0/2027102760 <== mgr.10752 v2:172.21.15.55:6832/538997467 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299838 (secure 0 0 0) 0x7efcd8160790 con 0x7efcc40663d0 2023-07-06T22:20:28.973 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:20:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.971+0000 7efcde782640 1 -- 172.21.15.55:0/2027102760 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efcc40663d0 msgr2=0x7efcc4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.971+0000 7efcde782640 1 --2- 172.21.15.55:0/2027102760 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efcc40663d0 0x7efcc4068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efcd8069570 tx=0x7efccc009040 comp rx=0 tx=0).stop 2023-07-06T22:20:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.971+0000 7efcde782640 1 -- 172.21.15.55:0/2027102760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd80b1fe0 msgr2=0x7efcd814d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.971+0000 7efcde782640 1 --2- 172.21.15.55:0/2027102760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd80b1fe0 0x7efcd814d930 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7efcc80097c0 tx=0x7efcc801ac30 comp rx=0 tx=0).stop 2023-07-06T22:20:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.971+0000 7efcde782640 1 -- 172.21.15.55:0/2027102760 shutdown_connections 2023-07-06T22:20:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.971+0000 7efcde782640 1 --2- 172.21.15.55:0/2027102760 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efcc40663d0 0x7efcc4068880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.971+0000 7efcde782640 1 --2- 172.21.15.55:0/2027102760 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efcd80ccab0 0x7efcd80d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.971+0000 7efcde782640 1 --2- 172.21.15.55:0/2027102760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd80b7cd0 0x7efcd80cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.971+0000 7efcde782640 1 --2- 172.21.15.55:0/2027102760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd80b1fe0 0x7efcd814d930 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.971+0000 7efcde782640 1 -- 172.21.15.55:0/2027102760 >> 172.21.15.55:0/2027102760 conn(0x7efcd80ceee0 msgr2=0x7efcd815b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.971+0000 7efcde782640 1 -- 172.21.15.55:0/2027102760 shutdown_connections 2023-07-06T22:20:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:28.971+0000 7efcde782640 1 -- 172.21.15.55:0/2027102760 wait complete. 2023-07-06T22:20:28.993 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-06T22:20:27.200212+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":385652,"kb_used_data":20020,"kb_used_omap":0,"kb_used_meta":365568,"kb_avail":754589068,"statfs":{"total":773094113280,"available":772699205632,"internally_reserved":0,"allocated":20500480,"data_stored":11569220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":374341632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.881130"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324110+0000","last_change":"2023-07-06T22:20:22.324110+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324110+0000","last_undegraded":"2023-07-06T22:20:22.324110+0000","last_fullsized":"2023-07-06T22:20:22.324110+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.331691+0000","last_change":"2023-07-06T22:20:22.331691+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.331691+0000","last_undegraded":"2023-07-06T22:20:22.331691+0000","last_fullsized":"2023-07-06T22:20:22.331691+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.331126+0000","last_change":"2023-07-06T22:20:22.331126+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.331126+0000","last_undegraded":"2023-07-06T22:20:22.331126+0000","last_fullsized":"2023-07-06T22:20:22.331126+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329222+0000","last_change":"2023-07-06T22:20:22.329222+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329222+0000","last_undegraded":"2023-07-06T22:20:22.329222+0000","last_fullsized":"2023-07-06T22:20:22.329222+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324420+0000","last_change":"2023-07-06T22:20:22.324420+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324420+0000","last_undegraded":"2023-07-06T22:20:22.324420+0000","last_fullsized":"2023-07-06T22:20:22.324420+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.330865+0000","last_change":"2023-07-06T22:20:22.330865+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.330865+0000","last_undegraded":"2023-07-06T22:20:22.330865+0000","last_fullsized":"2023-07-06T22:20:22.330865+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.322732+0000","last_change":"2023-07-06T22:20:22.322732+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.322732+0000","last_undegraded":"2023-07-06T22:20:22.322732+0000","last_fullsized":"2023-07-06T22:20:22.322732+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324383+0000","last_change":"2023-07-06T22:20:22.324383+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324383+0000","last_undegraded":"2023-07-06T22:20:22.324383+0000","last_fullsized":"2023-07-06T22:20:22.324383+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.331802+0000","last_change":"2023-07-06T22:20:22.331802+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.331802+0000","last_undegraded":"2023-07-06T22:20:22.331802+0000","last_fullsized":"2023-07-06T22:20:22.331802+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.322677+0000","last_change":"2023-07-06T22:20:22.322677+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.322677+0000","last_undegraded":"2023-07-06T22:20:22.322677+0000","last_fullsized":"2023-07-06T22:20:22.322677+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324727+0000","last_change":"2023-07-06T22:20:22.324727+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324727+0000","last_undegraded":"2023-07-06T22:20:22.324727+0000","last_fullsized":"2023-07-06T22:20:22.324727+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324092+0000","last_change":"2023-07-06T22:20:22.324092+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324092+0000","last_undegraded":"2023-07-06T22:20:22.324092+0000","last_fullsized":"2023-07-06T22:20:22.324092+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329187+0000","last_change":"2023-07-06T22:20:22.329187+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329187+0000","last_undegraded":"2023-07-06T22:20:22.329187+0000","last_fullsized":"2023-07-06T22:20:22.329187+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.332004+0000","last_change":"2023-07-06T22:20:22.332004+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.332004+0000","last_undegraded":"2023-07-06T22:20:22.332004+0000","last_fullsized":"2023-07-06T22:20:22.332004+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329262+0000","last_change":"2023-07-06T22:20:22.329262+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329262+0000","last_undegraded":"2023-07-06T22:20:22.329262+0000","last_fullsized":"2023-07-06T22:20:22.329262+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.327529+0000","last_change":"2023-07-06T22:20:22.327529+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.327529+0000","last_undegraded":"2023-07-06T22:20:22.327529+0000","last_fullsized":"2023-07-06T22:20:22.327529+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.325255+0000","last_change":"2023-07-06T22:20:22.325255+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.325255+0000","last_undegraded":"2023-07-06T22:20:22.325255+0000","last_fullsized":"2023-07-06T22:20:22.325255+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.330952+0000","last_change":"2023-07-06T22:20:22.330952+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.330952+0000","last_undegraded":"2023-07-06T22:20:22.330952+0000","last_fullsized":"2023-07-06T22:20:22.330952+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.330811+0000","last_change":"2023-07-06T22:20:22.330811+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.330811+0000","last_undegraded":"2023-07-06T22:20:22.330811+0000","last_fullsized":"2023-07-06T22:20:22.330811+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.322478+0000","last_change":"2023-07-06T22:20:22.322478+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.322478+0000","last_undegraded":"2023-07-06T22:20:22.322478+0000","last_fullsized":"2023-07-06T22:20:22.322478+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.326843+0000","last_change":"2023-07-06T22:20:22.326843+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.326843+0000","last_undegraded":"2023-07-06T22:20:22.326843+0000","last_fullsized":"2023-07-06T22:20:22.326843+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.328316+0000","last_change":"2023-07-06T22:20:22.328316+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.328316+0000","last_undegraded":"2023-07-06T22:20:22.328316+0000","last_fullsized":"2023-07-06T22:20:22.328316+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.326084+0000","last_change":"2023-07-06T22:20:22.326084+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.326084+0000","last_undegraded":"2023-07-06T22:20:22.326084+0000","last_fullsized":"2023-07-06T22:20:22.326084+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329373+0000","last_change":"2023-07-06T22:20:22.329373+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329373+0000","last_undegraded":"2023-07-06T22:20:22.329373+0000","last_fullsized":"2023-07-06T22:20:22.329373+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.324424+0000","last_change":"2023-07-06T22:20:22.324424+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.324424+0000","last_undegraded":"2023-07-06T22:20:22.324424+0000","last_fullsized":"2023-07-06T22:20:22.324424+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1258,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.326120+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:20:22.326120+0000","last_peered":"2023-07-06T22:20:22.326120+0000","last_clean":"2023-07-06T22:20:22.326120+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:20:22.326120+0000","last_undegraded":"2023-07-06T22:20:22.326120+0000","last_fullsized":"2023-07-06T22:20:22.326120+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:53:19.132052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":313,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.327256+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:20:22.327256+0000","last_peered":"2023-07-06T22:20:22.327256+0000","last_clean":"2023-07-06T22:20:22.327256+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:20:22.327256+0000","last_undegraded":"2023-07-06T22:20:22.327256+0000","last_fullsized":"2023-07-06T22:20:22.327256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:22:29.408840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.322796+0000","last_change":"2023-07-06T22:20:22.322796+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.322796+0000","last_undegraded":"2023-07-06T22:20:22.322796+0000","last_fullsized":"2023-07-06T22:20:22.322796+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":361,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.325976+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:20:22.325976+0000","last_peered":"2023-07-06T22:20:22.325976+0000","last_clean":"2023-07-06T22:20:22.325976+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:20:22.325976+0000","last_undegraded":"2023-07-06T22:20:22.325976+0000","last_fullsized":"2023-07-06T22:20:22.325976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:45:35.604221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.331301+0000","last_change":"2023-07-06T22:20:22.331301+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.331301+0000","last_undegraded":"2023-07-06T22:20:22.331301+0000","last_fullsized":"2023-07-06T22:20:22.331301+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":357,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.330891+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:20:22.330891+0000","last_peered":"2023-07-06T22:20:22.330891+0000","last_clean":"2023-07-06T22:20:22.330891+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:20:22.330891+0000","last_undegraded":"2023-07-06T22:20:22.330891+0000","last_fullsized":"2023-07-06T22:20:22.330891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:58:00.162499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.325327+0000","last_change":"2023-07-06T22:20:22.325327+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.325327+0000","last_undegraded":"2023-07-06T22:20:22.325327+0000","last_fullsized":"2023-07-06T22:20:22.325327+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":313,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.328587+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:20:22.328587+0000","last_peered":"2023-07-06T22:20:22.328587+0000","last_clean":"2023-07-06T22:20:22.328587+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:20:22.328587+0000","last_undegraded":"2023-07-06T22:20:22.328587+0000","last_fullsized":"2023-07-06T22:20:22.328587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:17:20.739778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.328012+0000","last_change":"2023-07-06T22:20:22.328012+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.328012+0000","last_undegraded":"2023-07-06T22:20:22.328012+0000","last_fullsized":"2023-07-06T22:20:22.328012+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":317,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.330684+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:20:22.330684+0000","last_peered":"2023-07-06T22:20:22.330684+0000","last_clean":"2023-07-06T22:20:22.330684+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:20:22.330684+0000","last_undegraded":"2023-07-06T22:20:22.330684+0000","last_fullsized":"2023-07-06T22:20:22.330684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:50:52.904440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.332281+0000","last_change":"2023-07-06T22:20:22.332281+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.332281+0000","last_undegraded":"2023-07-06T22:20:22.332281+0000","last_fullsized":"2023-07-06T22:20:22.332281+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":361,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.326162+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:20:22.326162+0000","last_peered":"2023-07-06T22:20:22.326162+0000","last_clean":"2023-07-06T22:20:22.326162+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:20:22.326162+0000","last_undegraded":"2023-07-06T22:20:22.326162+0000","last_fullsized":"2023-07-06T22:20:22.326162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:54:04.128795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.325661+0000","last_change":"2023-07-06T22:20:22.325661+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.325661+0000","last_undegraded":"2023-07-06T22:20:22.325661+0000","last_fullsized":"2023-07-06T22:20:22.325661+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":316,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.330781+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:20:22.330781+0000","last_peered":"2023-07-06T22:20:22.330781+0000","last_clean":"2023-07-06T22:20:22.330781+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:20:22.330781+0000","last_undegraded":"2023-07-06T22:20:22.330781+0000","last_fullsized":"2023-07-06T22:20:22.330781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:43:30.428064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T22:20:23.318921+0000","last_change":"2023-07-06T22:20:23.318921+0000","last_active":"2023-07-06T22:20:23.318921+0000","last_peered":"2023-07-06T22:20:23.318921+0000","last_clean":"2023-07-06T22:20:23.318921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:23.318921+0000","last_undegraded":"2023-07-06T22:20:23.318921+0000","last_fullsized":"2023-07-06T22:20:23.318921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2023-07-06T22:20:22.329222+0000","last_change":"2023-07-06T22:20:22.329222+0000","last_active":"2023-07-06T22:20:22.307275+0000","last_peered":"2023-07-06T22:20:22.307275+0000","last_clean":"2023-07-06T22:20:22.307275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T22:20:22.329222+0000","last_undegraded":"2023-07-06T22:20:22.329222+0000","last_fullsized":"2023-07-06T22:20:22.329222+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":308,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-07-06T22:20:22.326152+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:20:22.326152+0000","last_peered":"2023-07-06T22:20:22.326152+0000","last_clean":"2023-07-06T22:20:22.326152+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:20:22.326152+0000","last_undegraded":"2023-07-06T22:20:22.326152+0000","last_fullsized":"2023-07-06T22:20:22.326152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:23:16.000115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575304,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42180,"kb_used_data":2940,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329660,"statfs":{"total":96636764160,"available":96593571840,"internally_reserved":0,"allocated":3010560,"data_stored":1889998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.432},"max":{"1min":0.92100000000000004,"5min":0.93300000000000005,"15min":1.0740000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51600000000000001,"5min":0.45900000000000002,"15min":0.45700000000000002},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.52100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.74199999999999999,"15min":0.72399999999999998},"min":{"1min":0.57699999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.61099999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"max":{"1min":0.96399999999999997,"5min":0.96699999999999997,"15min":1.0149999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73999999999999999,"15min":0.73199999999999998},"min":{"1min":0.53100000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.84099999999999997,"15min":0.78400000000000003},"min":{"1min":0.56200000000000006,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":9.8279999999999994,"15min":9.8279999999999994},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.36799999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73499999999999999,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":2.2610000000000001,"5min":13.443,"15min":13.443},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.52400000000000002,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.76100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575304,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37500,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334340,"statfs":{"total":96636764160,"available":96598364160,"internally_reserved":0,"allocated":2412544,"data_stored":1298611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.40300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.7829999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":1.633},"last":0.95899999999999996}]},{"osd":1,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.49199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.9099999999999999},"last":0.753},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.97799999999999998},"last":0.93500000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83199999999999996,"5min":0.91100000000000003,"15min":2.0299999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":1.04,"15min":1.5920000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.61099999999999999,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.996},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.69699999999999995,"5min":1.024,"15min":1.024},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80200000000000005,"5min":0.92600000000000005,"15min":0.996},"last":0.98199999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":0.89900000000000002,"15min":0.98499999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.85999999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.83399999999999996}]},{"osd":7,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82499999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.624},"min":{"1min":0.54100000000000004,"5min":0.45600000000000002,"15min":0.439},"max":{"1min":0.78400000000000003,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.73299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575303,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59648,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312192,"statfs":{"total":96636764160,"available":96575684608,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.92100000000000004,"5min":0.97199999999999998,"15min":0.999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.628,"5min":0.46999999999999997,"15min":0.46400000000000002},"max":{"1min":0.88400000000000001,"5min":0.995,"15min":0.995},"last":0.748}]},{"osd":1,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.52200000000000002,"5min":0.44400000000000001,"15min":0.43099999999999999},"max":{"1min":0.94799999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.60599999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.006,"5min":1.006,"15min":1.3200000000000001},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.46300000000000002},"max":{"1min":0.93700000000000006,"5min":0.998,"15min":1.4299999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.749},"min":{"1min":0.56200000000000006,"5min":0.48499999999999999,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":0.999,"15min":1.0409999999999999},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.54400000000000004,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":0.996,"15min":1.5169999999999999},"last":0.621},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.623,"5min":0.51500000000000001,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61599999999999999,"15min":0.61699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.79800000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.622,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.5,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69799999999999995,"15min":0.69099999999999995},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55552,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316288,"statfs":{"total":96636764160,"available":96579878912,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.42199999999999999},"max":{"1min":0.876,"5min":0.96399999999999997,"15min":0.98999999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":0.97899999999999998,"15min":1.016},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.56899999999999995,"5min":0.47899999999999998,"15min":0.38300000000000001},"max":{"1min":0.93400000000000005,"5min":0.999,"15min":1.0309999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.996},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.622,"5min":0.54600000000000004,"15min":0.502},"max":{"1min":0.97699999999999998,"5min":0.99399999999999999,"15min":1.0580000000000001},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.53500000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.98699999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":1.022,"15min":1.03},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.36599999999999999},"max":{"1min":0.76800000000000002,"5min":0.91200000000000003,"15min":0.92600000000000005},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":0.95599999999999996,"15min":1.006},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.91500000000000004,"15min":1.0509999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.41299999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.746}]},{"osd":7,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90300000000000002,"5min":0.94799999999999995,"15min":1.0469999999999999},"last":0.876},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.432,"15min":0.432},"max":{"1min":0.90200000000000002,"5min":1.0109999999999999,"15min":1.1100000000000001},"last":0.93300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575303,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51456,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320384,"statfs":{"total":96636764160,"available":96584073216,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.27300000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.65800000000000003,"5min":0.68100000000000005,"15min":0.85899999999999999},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64900000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.27700000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64100000000000001,"5min":0.69799999999999995,"15min":0.83899999999999997},"last":0.374},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.41299999999999998},"max":{"1min":0.80200000000000005,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64500000000000002,"5min":0.72399999999999998,"15min":0.875},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.77400000000000002},"min":{"1min":0.64100000000000001,"5min":0.53500000000000003,"15min":0.441},"max":{"1min":0.93400000000000005,"5min":1.0449999999999999,"15min":1.474},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79500000000000004,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":0.93400000000000005,"5min":1.0920000000000001,"15min":1.3859999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.57499999999999996},"max":{"1min":1.085,"5min":1.175,"15min":1.3740000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.68500000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1,"5min":1.0249999999999999,"15min":1.2330000000000001},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.58199999999999996,"15min":0.51800000000000002},"max":{"1min":1,"5min":1.1399999999999999,"15min":1.3899999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.57299999999999995},"max":{"1min":1.083,"5min":1.1499999999999999,"15min":1.3220000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83899999999999997,"15min":0.82199999999999995},"min":{"1min":0.73199999999999998,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.0649999999999999,"5min":1.1160000000000001,"15min":1.2210000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83799999999999997,"15min":0.82799999999999996},"min":{"1min":0.67500000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0369999999999999,"5min":1.244,"15min":1.3200000000000001},"last":0.61499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575303,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41600,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330240,"statfs":{"total":96636764160,"available":96594165760,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.77000000000000002,"15min":0.78600000000000003},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.42499999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65600000000000003,"5min":0.74099999999999999,"15min":0.84099999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.72399999999999998,"5min":0.85099999999999998,"15min":0.97099999999999997},"last":0.441}]},{"osd":3,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.63600000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58799999999999997},"min":{"1min":0.46300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.66500000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94199999999999995,"5min":1.663,"15min":1.663},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.61099999999999999,"5min":0.54900000000000004,"15min":0.51600000000000001},"max":{"1min":0.94899999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.626}]},{"osd":5,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.66000000000000003,"5min":0.55900000000000005,"15min":0.51100000000000001},"max":{"1min":0.90900000000000003,"5min":1.337,"15min":1.337},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80700000000000005,"15min":0.82899999999999996},"min":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0189999999999999,"5min":1.228,"15min":1.2829999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.996,"5min":1.367,"15min":1.367},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81200000000000006,"15min":0.82999999999999996},"min":{"1min":0.65300000000000002,"5min":0.59999999999999998,"15min":0.56100000000000005},"max":{"1min":0.96499999999999997,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.98099999999999998,"5min":1.407,"15min":1.407},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82099999999999995,"15min":0.83999999999999997},"min":{"1min":0.67200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.024,"5min":1.296,"15min":1.296},"last":0.68799999999999994}]}]},{"osd":1,"up_from":13,"seq":55834575304,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59648,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312192,"statfs":{"total":96636764160,"available":96575684608,"internally_reserved":0,"allocated":2416640,"data_stored":1299630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.316,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.72599999999999998,"5min":1.645,"15min":1.645},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.72299999999999998,"5min":0.90700000000000003,"15min":0.94299999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.68799999999999994,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.502,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.81699999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79600000000000004,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74299999999999999,"15min":0.77600000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96999999999999997,"5min":1.083,"15min":1.1140000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78700000000000003,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.51700000000000002},"max":{"1min":0.92700000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.48699999999999999},"max":{"1min":1.012,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79800000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96399999999999997,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95399999999999996,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.56100000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94299999999999995,"5min":1.25,"15min":1.3360000000000001},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81399999999999995,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.56100000000000005},"max":{"1min":0.99199999999999999,"5min":1.155,"15min":1.405},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.61199999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98199999999999998,"5min":1.788,"15min":1.788},"last":1.008}]}]},{"osd":0,"up_from":13,"seq":55834575303,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38068,"kb_used_data":2924,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333772,"statfs":{"total":96636764160,"available":96597782528,"internally_reserved":0,"allocated":2994176,"data_stored":1882461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.45100000000000001,"15min":0.45900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.50700000000000001,"5min":0.745,"15min":0.745},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.749,"15min":1.1319999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.1599999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65300000000000002,"5min":0.72699999999999998,"15min":0.89200000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.40999999999999998},"max":{"1min":0.66500000000000004,"5min":0.77200000000000002,"15min":0.95399999999999996},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":1.294,"15min":1.294},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.80100000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.50900000000000001},"max":{"1min":1.0660000000000001,"5min":1.1000000000000001,"15min":1.3320000000000001},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.79600000000000004,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.345,"15min":1.345},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.56599999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.103,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":0.748}]},{"osd":6,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.81100000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.47699999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.153},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0840000000000001,"5min":1.1910000000000001,"15min":1.272},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jul 6 22:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0049999999999999,"5min":1.125,"15min":1.26},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.82399999999999995,"15min":0.81699999999999995},"min":{"1min":0.61199999999999999,"5min":0.60499999999999998,"15min":0.55700000000000005},"max":{"1min":1.1220000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:20:29.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3f is not active+clean 2023-07-06T22:20:29.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3e is not active+clean 2023-07-06T22:20:29.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3d is not active+clean 2023-07-06T22:20:29.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3c is not active+clean 2023-07-06T22:20:29.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3b is not active+clean 2023-07-06T22:20:29.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3a is not active+clean 2023-07-06T22:20:29.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.39 is not active+clean 2023-07-06T22:20:29.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.38 is not active+clean 2023-07-06T22:20:29.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.37 is not active+clean 2023-07-06T22:20:29.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.36 is not active+clean 2023-07-06T22:20:29.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.35 is not active+clean 2023-07-06T22:20:29.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.34 is not active+clean 2023-07-06T22:20:29.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.33 is not active+clean 2023-07-06T22:20:29.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.32 is not active+clean 2023-07-06T22:20:29.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.31 is not active+clean 2023-07-06T22:20:29.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.30 is not active+clean 2023-07-06T22:20:29.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2f is not active+clean 2023-07-06T22:20:29.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2e is not active+clean 2023-07-06T22:20:29.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2d is not active+clean 2023-07-06T22:20:29.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2c is not active+clean 2023-07-06T22:20:29.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2b is not active+clean 2023-07-06T22:20:29.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2a is not active+clean 2023-07-06T22:20:29.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.29 is not active+clean 2023-07-06T22:20:29.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.28 is not active+clean 2023-07-06T22:20:29.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.27 is not active+clean 2023-07-06T22:20:29.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.26 is not active+clean 2023-07-06T22:20:29.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.25 is not active+clean 2023-07-06T22:20:29.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.24 is not active+clean 2023-07-06T22:20:29.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.23 is not active+clean 2023-07-06T22:20:29.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.22 is not active+clean 2023-07-06T22:20:29.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.21 is not active+clean 2023-07-06T22:20:29.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.021 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.20 is not active+clean 2023-07-06T22:20:29.021 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.16 is not active+clean 2023-07-06T22:20:29.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.17 is not active+clean 2023-07-06T22:20:29.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.324110+0000', 'last_change': '2023-07-06T22:20:22.324110+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.324110+0000', 'last_undegraded': '2023-07-06T22:20:22.324110+0000', 'last_fullsized': '2023-07-06T22:20:22.324110+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T22:20:29.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.17 is not active+clean 2023-07-06T22:20:29.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.16 is not active+clean 2023-07-06T22:20:29.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.331691+0000', 'last_change': '2023-07-06T22:20:22.331691+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.331691+0000', 'last_undegraded': '2023-07-06T22:20:22.331691+0000', 'last_fullsized': '2023-07-06T22:20:22.331691+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:20:29.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.14 is not active+clean 2023-07-06T22:20:29.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.15 is not active+clean 2023-07-06T22:20:29.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.331126+0000', 'last_change': '2023-07-06T22:20:22.331126+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.331126+0000', 'last_undegraded': '2023-07-06T22:20:22.331126+0000', 'last_fullsized': '2023-07-06T22:20:22.331126+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:20:29.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.15 is not active+clean 2023-07-06T22:20:29.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.14 is not active+clean 2023-07-06T22:20:29.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.329222+0000', 'last_change': '2023-07-06T22:20:22.329222+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.329222+0000', 'last_undegraded': '2023-07-06T22:20:22.329222+0000', 'last_fullsized': '2023-07-06T22:20:22.329222+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:20:29.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.12 is not active+clean 2023-07-06T22:20:29.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.13 is not active+clean 2023-07-06T22:20:29.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.324420+0000', 'last_change': '2023-07-06T22:20:22.324420+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.324420+0000', 'last_undegraded': '2023-07-06T22:20:22.324420+0000', 'last_fullsized': '2023-07-06T22:20:22.324420+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:20:29.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.13 is not active+clean 2023-07-06T22:20:29.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.12 is not active+clean 2023-07-06T22:20:29.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.330865+0000', 'last_change': '2023-07-06T22:20:22.330865+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.330865+0000', 'last_undegraded': '2023-07-06T22:20:22.330865+0000', 'last_fullsized': '2023-07-06T22:20:22.330865+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T22:20:29.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.10 is not active+clean 2023-07-06T22:20:29.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.11 is not active+clean 2023-07-06T22:20:29.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.322732+0000', 'last_change': '2023-07-06T22:20:22.322732+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.322732+0000', 'last_undegraded': '2023-07-06T22:20:22.322732+0000', 'last_fullsized': '2023-07-06T22:20:22.322732+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:20:29.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.11 is not active+clean 2023-07-06T22:20:29.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.10 is not active+clean 2023-07-06T22:20:29.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.324383+0000', 'last_change': '2023-07-06T22:20:22.324383+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.324383+0000', 'last_undegraded': '2023-07-06T22:20:22.324383+0000', 'last_fullsized': '2023-07-06T22:20:22.324383+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:20:29.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.e is not active+clean 2023-07-06T22:20:29.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.f is not active+clean 2023-07-06T22:20:29.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.331802+0000', 'last_change': '2023-07-06T22:20:22.331802+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.331802+0000', 'last_undegraded': '2023-07-06T22:20:22.331802+0000', 'last_fullsized': '2023-07-06T22:20:22.331802+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:20:29.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.f is not active+clean 2023-07-06T22:20:29.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.e is not active+clean 2023-07-06T22:20:29.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.322677+0000', 'last_change': '2023-07-06T22:20:22.322677+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.322677+0000', 'last_undegraded': '2023-07-06T22:20:22.322677+0000', 'last_fullsized': '2023-07-06T22:20:22.322677+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:20:29.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.c is not active+clean 2023-07-06T22:20:29.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.d is not active+clean 2023-07-06T22:20:29.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.324727+0000', 'last_change': '2023-07-06T22:20:22.324727+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.324727+0000', 'last_undegraded': '2023-07-06T22:20:22.324727+0000', 'last_fullsized': '2023-07-06T22:20:22.324727+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:20:29.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.d is not active+clean 2023-07-06T22:20:29.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.c is not active+clean 2023-07-06T22:20:29.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.324092+0000', 'last_change': '2023-07-06T22:20:22.324092+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.324092+0000', 'last_undegraded': '2023-07-06T22:20:22.324092+0000', 'last_fullsized': '2023-07-06T22:20:22.324092+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T22:20:29.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.a is not active+clean 2023-07-06T22:20:29.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.b is not active+clean 2023-07-06T22:20:29.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.329187+0000', 'last_change': '2023-07-06T22:20:22.329187+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.329187+0000', 'last_undegraded': '2023-07-06T22:20:22.329187+0000', 'last_fullsized': '2023-07-06T22:20:22.329187+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:20:29.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.b is not active+clean 2023-07-06T22:20:29.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.a is not active+clean 2023-07-06T22:20:29.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.332004+0000', 'last_change': '2023-07-06T22:20:22.332004+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.332004+0000', 'last_undegraded': '2023-07-06T22:20:22.332004+0000', 'last_fullsized': '2023-07-06T22:20:22.332004+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:20:29.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.8 is not active+clean 2023-07-06T22:20:29.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.9 is not active+clean 2023-07-06T22:20:29.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.329262+0000', 'last_change': '2023-07-06T22:20:22.329262+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.329262+0000', 'last_undegraded': '2023-07-06T22:20:22.329262+0000', 'last_fullsized': '2023-07-06T22:20:22.329262+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:20:29.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.9 is not active+clean 2023-07-06T22:20:29.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.8 is not active+clean 2023-07-06T22:20:29.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.327529+0000', 'last_change': '2023-07-06T22:20:22.327529+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.327529+0000', 'last_undegraded': '2023-07-06T22:20:22.327529+0000', 'last_fullsized': '2023-07-06T22:20:22.327529+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:20:29.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.6 is not active+clean 2023-07-06T22:20:29.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.7 is not active+clean 2023-07-06T22:20:29.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.325255+0000', 'last_change': '2023-07-06T22:20:22.325255+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.325255+0000', 'last_undegraded': '2023-07-06T22:20:22.325255+0000', 'last_fullsized': '2023-07-06T22:20:22.325255+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:20:29.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.7 is not active+clean 2023-07-06T22:20:29.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.6 is not active+clean 2023-07-06T22:20:29.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.330952+0000', 'last_change': '2023-07-06T22:20:22.330952+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.330952+0000', 'last_undegraded': '2023-07-06T22:20:22.330952+0000', 'last_fullsized': '2023-07-06T22:20:22.330952+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T22:20:29.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.4 is not active+clean 2023-07-06T22:20:29.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.5 is not active+clean 2023-07-06T22:20:29.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.330811+0000', 'last_change': '2023-07-06T22:20:22.330811+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.330811+0000', 'last_undegraded': '2023-07-06T22:20:22.330811+0000', 'last_fullsized': '2023-07-06T22:20:22.330811+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T22:20:29.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.5 is not active+clean 2023-07-06T22:20:29.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.4 is not active+clean 2023-07-06T22:20:29.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.322478+0000', 'last_change': '2023-07-06T22:20:22.322478+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.322478+0000', 'last_undegraded': '2023-07-06T22:20:22.322478+0000', 'last_fullsized': '2023-07-06T22:20:22.322478+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:20:29.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2 is not active+clean 2023-07-06T22:20:29.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3 is not active+clean 2023-07-06T22:20:29.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.326843+0000', 'last_change': '2023-07-06T22:20:22.326843+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.326843+0000', 'last_undegraded': '2023-07-06T22:20:22.326843+0000', 'last_fullsized': '2023-07-06T22:20:22.326843+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:20:29.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3 is not active+clean 2023-07-06T22:20:29.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2 is not active+clean 2023-07-06T22:20:29.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.328316+0000', 'last_change': '2023-07-06T22:20:22.328316+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.328316+0000', 'last_undegraded': '2023-07-06T22:20:22.328316+0000', 'last_fullsized': '2023-07-06T22:20:22.328316+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:20:29.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.0 is not active+clean 2023-07-06T22:20:29.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1 is not active+clean 2023-07-06T22:20:29.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.326084+0000', 'last_change': '2023-07-06T22:20:22.326084+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.326084+0000', 'last_undegraded': '2023-07-06T22:20:22.326084+0000', 'last_fullsized': '2023-07-06T22:20:22.326084+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T22:20:29.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1 is not active+clean 2023-07-06T22:20:29.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.0 is not active+clean 2023-07-06T22:20:29.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.329373+0000', 'last_change': '2023-07-06T22:20:22.329373+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.329373+0000', 'last_undegraded': '2023-07-06T22:20:22.329373+0000', 'last_fullsized': '2023-07-06T22:20:22.329373+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:20:29.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.18 is not active+clean 2023-07-06T22:20:29.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.19 is not active+clean 2023-07-06T22:20:29.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.324424+0000', 'last_change': '2023-07-06T22:20:22.324424+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.324424+0000', 'last_undegraded': '2023-07-06T22:20:22.324424+0000', 'last_fullsized': '2023-07-06T22:20:22.324424+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:20:29.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1b is not active+clean 2023-07-06T22:20:29.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1a is not active+clean 2023-07-06T22:20:29.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.322796+0000', 'last_change': '2023-07-06T22:20:22.322796+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.322796+0000', 'last_undegraded': '2023-07-06T22:20:22.322796+0000', 'last_fullsized': '2023-07-06T22:20:22.322796+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T22:20:29.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1a is not active+clean 2023-07-06T22:20:29.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1b is not active+clean 2023-07-06T22:20:29.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.331301+0000', 'last_change': '2023-07-06T22:20:22.331301+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.331301+0000', 'last_undegraded': '2023-07-06T22:20:22.331301+0000', 'last_fullsized': '2023-07-06T22:20:22.331301+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:20:29.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.19 is not active+clean 2023-07-06T22:20:29.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.18 is not active+clean 2023-07-06T22:20:29.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.325327+0000', 'last_change': '2023-07-06T22:20:22.325327+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.325327+0000', 'last_undegraded': '2023-07-06T22:20:22.325327+0000', 'last_fullsized': '2023-07-06T22:20:22.325327+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T22:20:29.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1f is not active+clean 2023-07-06T22:20:29.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1e is not active+clean 2023-07-06T22:20:29.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.328012+0000', 'last_change': '2023-07-06T22:20:22.328012+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.328012+0000', 'last_undegraded': '2023-07-06T22:20:22.328012+0000', 'last_fullsized': '2023-07-06T22:20:22.328012+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T22:20:29.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1e is not active+clean 2023-07-06T22:20:29.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1f is not active+clean 2023-07-06T22:20:29.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.332281+0000', 'last_change': '2023-07-06T22:20:22.332281+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.332281+0000', 'last_undegraded': '2023-07-06T22:20:22.332281+0000', 'last_fullsized': '2023-07-06T22:20:22.332281+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T22:20:29.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1d is not active+clean 2023-07-06T22:20:29.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1c is not active+clean 2023-07-06T22:20:29.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.325661+0000', 'last_change': '2023-07-06T22:20:22.325661+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.325661+0000', 'last_undegraded': '2023-07-06T22:20:22.325661+0000', 'last_fullsized': '2023-07-06T22:20:22.325661+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T22:20:29.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1c is not active+clean 2023-07-06T22:20:29.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-06T22:20:23.318921+0000', 'last_change': '2023-07-06T22:20:23.318921+0000', 'last_active': '2023-07-06T22:20:23.318921+0000', 'last_peered': '2023-07-06T22:20:23.318921+0000', 'last_clean': '2023-07-06T22:20:23.318921+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:23.318921+0000', 'last_undegraded': '2023-07-06T22:20:23.318921+0000', 'last_fullsized': '2023-07-06T22:20:23.318921+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:23.318921+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-06T22:20:29.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1d is not active+clean 2023-07-06T22:20:29.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2023-07-06T22:20:22.329222+0000', 'last_change': '2023-07-06T22:20:22.329222+0000', 'last_active': '2023-07-06T22:20:22.307275+0000', 'last_peered': '2023-07-06T22:20:22.307275+0000', 'last_clean': '2023-07-06T22:20:22.307275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T22:20:22.329222+0000', 'last_undegraded': '2023-07-06T22:20:22.329222+0000', 'last_fullsized': '2023-07-06T22:20:22.329222+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'last_clean_scrub_stamp': '2023-07-06T22:20:22.307275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T22:20:29.066 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-06T22:20:29.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64be034640 1 Processor -- start 2023-07-06T22:20:29.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64be034640 1 -- start start 2023-07-06T22:20:29.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64be034640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64b815b9d0 0x7f64b815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:29.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64be034640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f64b80ce340 0x7f64b80ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:29.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64be034640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b806a160 con 0x7f64b80b3d10 2023-07-06T22:20:29.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64be034640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b815bda0 con 0x7f64b80ce340 2023-07-06T22:20:29.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64be034640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b8069590 con 0x7f64b815b9d0 2023-07-06T22:20:29.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64b7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f64b80b3d10 0x7f64b815c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41898/0 (socket says 172.21.15.55:41898) 2023-07-06T22:20:29.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64b7fff640 1 -- 172.21.15.55:0/814751878 learned_addr learned my addr 172.21.15.55:0/814751878 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:29.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64b77fe640 1 --2- 172.21.15.55:0/814751878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64b815b9d0 0x7f64b815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:29.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64b6ffd640 1 --2- 172.21.15.55:0/814751878 >> v2:172.21.15.138:3300/0 conn(0x7f64b80ce340 0x7f64b80ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:29.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64b67fc640 1 -- 172.21.15.55:0/814751878 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879805746 0 0) 0x7f64b806a160 con 0x7f64b80b3d10 2023-07-06T22:20:29.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64b67fc640 1 -- 172.21.15.55:0/814751878 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64a0003530 con 0x7f64b80b3d10 2023-07-06T22:20:29.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64b77fe640 1 -- 172.21.15.55:0/814751878 >> v2:172.21.15.138:3300/0 conn(0x7f64b80ce340 msgr2=0x7f64b80ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:29.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64b77fe640 1 --2- 172.21.15.55:0/814751878 >> v2:172.21.15.138:3300/0 conn(0x7f64b80ce340 0x7f64b80ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64b77fe640 1 -- 172.21.15.55:0/814751878 >> v1:172.21.15.55:6789/0 conn(0x7f64b80b3d10 legacy=0x7f64b815c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:29.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.207+0000 7f64b77fe640 1 -- 172.21.15.55:0/814751878 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b8069830 con 0x7f64b815b9d0 2023-07-06T22:20:29.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.211+0000 7f64b77fe640 1 --2- 172.21.15.55:0/814751878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64b815b9d0 0x7f64b815f4e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f64a80097c0 tx=0x7f64a801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=264eecfdf6172604 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:29.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.211+0000 7f64b67fc640 1 -- 172.21.15.55:0/814751878 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a80ab620 con 0x7f64b815b9d0 2023-07-06T22:20:29.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.211+0000 7f64b67fc640 1 -- 172.21.15.55:0/814751878 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a80ab780 con 0x7f64b815b9d0 2023-07-06T22:20:29.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.211+0000 7f64b67fc640 1 -- 172.21.15.55:0/814751878 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a80abb10 con 0x7f64b815b9d0 2023-07-06T22:20:29.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.211+0000 7f64be034640 1 -- 172.21.15.55:0/814751878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64b815b9d0 msgr2=0x7f64b815f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:29.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.211+0000 7f64be034640 1 --2- 172.21.15.55:0/814751878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64b815b9d0 0x7f64b815f4e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f64a80097c0 tx=0x7f64a801c450 comp rx=0 tx=0).stop 2023-07-06T22:20:29.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.211+0000 7f64be034640 1 -- 172.21.15.55:0/814751878 shutdown_connections 2023-07-06T22:20:29.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.211+0000 7f64be034640 1 --2- 172.21.15.55:0/814751878 >> v2:172.21.15.138:3300/0 conn(0x7f64b80ce340 0x7f64b80ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.211+0000 7f64be034640 1 --2- 172.21.15.55:0/814751878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64b815b9d0 0x7f64b815f4e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.211+0000 7f64be034640 1 -- 172.21.15.55:0/814751878 >> 172.21.15.55:0/814751878 conn(0x7f64b80ced10 msgr2=0x7f64b80cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:29.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.211+0000 7f64be034640 1 -- 172.21.15.55:0/814751878 shutdown_connections 2023-07-06T22:20:29.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.211+0000 7f64be034640 1 -- 172.21.15.55:0/814751878 wait complete. 2023-07-06T22:20:29.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64be034640 1 Processor -- start 2023-07-06T22:20:29.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64be034640 1 -- start start 2023-07-06T22:20:29.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64be034640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64b80b3d10 0x7f64b81538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:29.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64be034640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64b80ce340 0x7f64b8154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:29.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64be034640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64b815b9d0 0x7f64b8154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:29.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64be034640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80cac10 con 0x7f64b80ce340 2023-07-06T22:20:29.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64be034640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b81f4830 con 0x7f64b815b9d0 2023-07-06T22:20:29.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64be034640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80ca370 con 0x7f64b80b3d10 2023-07-06T22:20:29.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64b6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64b80ce340 0x7f64b8154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:29.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64b6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64b80ce340 0x7f64b8154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44672/0 (socket says 172.21.15.55:44672) 2023-07-06T22:20:29.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64b6ffd640 1 -- 172.21.15.55:0/328355112 learned_addr learned my addr 172.21.15.55:0/328355112 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:29.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64b77fe640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64b80b3d10 0x7f64b81538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:29.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64b7fff640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64b815b9d0 0x7f64b8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:29.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64b6ffd640 1 -- 172.21.15.55:0/328355112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64b80b3d10 msgr2=0x7f64b81538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:29.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64b6ffd640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64b80b3d10 0x7f64b81538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64b6ffd640 1 -- 172.21.15.55:0/328355112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64b815b9d0 msgr2=0x7f64b8154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:29.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64b6ffd640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64b815b9d0 0x7f64b8154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64b6ffd640 1 -- 172.21.15.55:0/328355112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a8009420 con 0x7f64b80ce340 2023-07-06T22:20:29.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64b7fff640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64b815b9d0 0x7f64b8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:29.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64b6ffd640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64b80ce340 0x7f64b8154100 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00e870 tx=0x7f64ac00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:29.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f649ffff640 1 -- 172.21.15.55:0/328355112 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac009510 con 0x7f64b80ce340 2023-07-06T22:20:29.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f649ffff640 1 -- 172.21.15.55:0/328355112 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac00eec0 con 0x7f64b80ce340 2023-07-06T22:20:29.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f649ffff640 1 -- 172.21.15.55:0/328355112 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac00cb40 con 0x7f64b80ce340 2023-07-06T22:20:29.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64be034640 1 -- 172.21.15.55:0/328355112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b80ca650 con 0x7f64b80ce340 2023-07-06T22:20:29.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.215+0000 7f64be034640 1 -- 172.21.15.55:0/328355112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b81f4a90 con 0x7f64b80ce340 2023-07-06T22:20:29.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.219+0000 7f64be034640 1 -- 172.21.15.55:0/328355112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b8066d60 con 0x7f64b80ce340 2023-07-06T22:20:29.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.219+0000 7f649ffff640 1 -- 172.21.15.55:0/328355112 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f64ac00cca0 con 0x7f64b80ce340 2023-07-06T22:20:29.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.219+0000 7f649ffff640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f64a40663a0 0x7f64a4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:29.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.219+0000 7f649ffff640 1 -- 172.21.15.55:0/328355112 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f64ac0840c0 con 0x7f64b80ce340 2023-07-06T22:20:29.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.219+0000 7f64b77fe640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f64a40663a0 0x7f64a4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:29.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.219+0000 7f64b77fe640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f64a40663a0 0x7f64a4068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f64a80af000 tx=0x7f64a80b6040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:29.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.223+0000 7f649ffff640 1 -- 172.21.15.55:0/328355112 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f64ac0512e0 con 0x7f64b80ce340 2023-07-06T22:20:29.305 INFO:tasks.ceph.mds.d.smithi138.stderr:2023-07-06T22:20:29.303+0000 7f46c0e57640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T22:20:29.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.431+0000 7f64be034640 1 -- 172.21.15.55:0/328355112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f64b80ce800 con 0x7f64b80ce340 2023-07-06T22:20:29.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.431+0000 7f649ffff640 1 -- 172.21.15.55:0/328355112 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3310 (secure 0 0 0) 0x7f64ac054900 con 0x7f64b80ce340 2023-07-06T22:20:29.435 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:29.435 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":2324,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":196,"num_osds":8,"num_up_osds":8,"osd_up_since":1688679717,"num_in_osds":8,"osd_in_since":1688679707,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":394907648,"bytes_avail":772699205632,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":87,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"d","status":"up:active","gid":11001}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2023-07-06T22:20:11.197072+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-06T22:20:29.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.435+0000 7f64be034640 1 -- 172.21.15.55:0/328355112 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f64a40663a0 msgr2=0x7f64a4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:29.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.435+0000 7f64be034640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f64a40663a0 0x7f64a4068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f64a80af000 tx=0x7f64a80b6040 comp rx=0 tx=0).stop 2023-07-06T22:20:29.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.435+0000 7f64be034640 1 -- 172.21.15.55:0/328355112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64b80ce340 msgr2=0x7f64b8154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:29.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.435+0000 7f64be034640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64b80ce340 0x7f64b8154100 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00e870 tx=0x7f64ac00ec70 comp rx=0 tx=0).stop 2023-07-06T22:20:29.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.435+0000 7f64be034640 1 -- 172.21.15.55:0/328355112 shutdown_connections 2023-07-06T22:20:29.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.435+0000 7f64be034640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f64a40663a0 0x7f64a4068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.435+0000 7f64be034640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64b815b9d0 0x7f64b8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.435+0000 7f64be034640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64b80ce340 0x7f64b8154100 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.435+0000 7f64be034640 1 --2- 172.21.15.55:0/328355112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64b80b3d10 0x7f64b81538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.435+0000 7f64be034640 1 -- 172.21.15.55:0/328355112 >> 172.21.15.55:0/328355112 conn(0x7f64b80ced10 msgr2=0x7f64b815d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:29.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.435+0000 7f64be034640 1 -- 172.21.15.55:0/328355112 shutdown_connections 2023-07-06T22:20:29.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.435+0000 7f64be034640 1 -- 172.21.15.55:0/328355112 wait complete. 2023-07-06T22:20:29.455 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-06T22:20:29.456 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:20:29.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.595+0000 7f084eb40640 1 Processor -- start 2023-07-06T22:20:29.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.595+0000 7f084eb40640 1 -- start start 2023-07-06T22:20:29.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.595+0000 7f084eb40640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0848158400 0x7f08480c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:29.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.595+0000 7f084eb40640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08480c9680 0x7f0848070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:29.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.595+0000 7f084eb40640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f08480710c0 0x7f08480cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:29.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.595+0000 7f084eb40640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084806fae0 con 0x7f08480c9680 2023-07-06T22:20:29.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.595+0000 7f084eb40640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084806fdc0 con 0x7f08480710c0 2023-07-06T22:20:29.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.595+0000 7f084eb40640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08480700a0 con 0x7f0848158400 2023-07-06T22:20:29.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.595+0000 7f0847fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08480c9680 0x7f0848070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:29.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.595+0000 7f0847fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08480c9680 0x7f0848070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44682/0 (socket says 172.21.15.55:44682) 2023-07-06T22:20:29.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.595+0000 7f0847fff640 1 -- 172.21.15.55:0/3192317275 learned_addr learned my addr 172.21.15.55:0/3192317275 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:29.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.595+0000 7f084c8dc640 1 --2- 172.21.15.55:0/3192317275 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0848158400 0x7f08480c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:29.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.595+0000 7f084d0dd640 1 --2- 172.21.15.55:0/3192317275 >> v2:172.21.15.138:3300/0 conn(0x7f08480710c0 0x7f08480cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:29.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f0847fff640 1 -- 172.21.15.55:0/3192317275 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0848158400 msgr2=0x7f08480c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:29.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f0847fff640 1 --2- 172.21.15.55:0/3192317275 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0848158400 0x7f08480c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f0847fff640 1 -- 172.21.15.55:0/3192317275 >> v2:172.21.15.138:3300/0 conn(0x7f08480710c0 msgr2=0x7f08480cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:29.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f0847fff640 1 --2- 172.21.15.55:0/3192317275 >> v2:172.21.15.138:3300/0 conn(0x7f08480710c0 0x7f08480cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f0847fff640 1 -- 172.21.15.55:0/3192317275 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0848070380 con 0x7f08480c9680 2023-07-06T22:20:29.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f0847fff640 1 --2- 172.21.15.55:0/3192317275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08480c9680 0x7f0848070b80 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f08480ad960 tx=0x7f083401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4391963f87f938c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f08477fe640 1 -- 172.21.15.55:0/3192317275 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08340aa610 con 0x7f08480c9680 2023-07-06T22:20:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f08477fe640 1 -- 172.21.15.55:0/3192317275 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08340a6040 con 0x7f08480c9680 2023-07-06T22:20:29.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f08477fe640 1 -- 172.21.15.55:0/3192317275 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08340aa990 con 0x7f08480c9680 2023-07-06T22:20:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f084eb40640 1 -- 172.21.15.55:0/3192317275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08480c9680 msgr2=0x7f0848070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f084eb40640 1 --2- 172.21.15.55:0/3192317275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08480c9680 0x7f0848070b80 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f08480ad960 tx=0x7f083401c4d0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f084eb40640 1 -- 172.21.15.55:0/3192317275 shutdown_connections 2023-07-06T22:20:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f084eb40640 1 --2- 172.21.15.55:0/3192317275 >> v2:172.21.15.138:3300/0 conn(0x7f08480710c0 0x7f08480cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f084eb40640 1 --2- 172.21.15.55:0/3192317275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08480c9680 0x7f0848070b80 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f084eb40640 1 --2- 172.21.15.55:0/3192317275 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0848158400 0x7f08480c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f084eb40640 1 -- 172.21.15.55:0/3192317275 >> 172.21.15.55:0/3192317275 conn(0x7f08480cded0 msgr2=0x7f08480ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:29.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f084eb40640 1 -- 172.21.15.55:0/3192317275 shutdown_connections 2023-07-06T22:20:29.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.599+0000 7f084eb40640 1 -- 172.21.15.55:0/3192317275 wait complete. 2023-07-06T22:20:29.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f084eb40640 1 Processor -- start 2023-07-06T22:20:29.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f084eb40640 1 -- start start 2023-07-06T22:20:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f084eb40640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08480710c0 0x7f08481f8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f084eb40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08480c9680 0x7f08481472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f084eb40640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0848158400 0x7f0848161770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f084eb40640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08480c7fb0 con 0x7f08480c9680 2023-07-06T22:20:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f084eb40640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08481f8eb0 con 0x7f08480710c0 2023-07-06T22:20:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f084eb40640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08481f4970 con 0x7f0848158400 2023-07-06T22:20:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f0847fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08480c9680 0x7f08481472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f0847fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08480c9680 0x7f08481472f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44698/0 (socket says 172.21.15.55:44698) 2023-07-06T22:20:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f0847fff640 1 -- 172.21.15.55:0/1698800576 learned_addr learned my addr 172.21.15.55:0/1698800576 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f084c8dc640 1 --2- 172.21.15.55:0/1698800576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08480710c0 0x7f08481f8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f084d0dd640 1 --2- 172.21.15.55:0/1698800576 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0848158400 0x7f0848161770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f0847fff640 1 -- 172.21.15.55:0/1698800576 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0848158400 msgr2=0x7f0848161770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f0847fff640 1 --2- 172.21.15.55:0/1698800576 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0848158400 0x7f0848161770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f0847fff640 1 -- 172.21.15.55:0/1698800576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08480710c0 msgr2=0x7f08481f8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f0847fff640 1 --2- 172.21.15.55:0/1698800576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08480710c0 0x7f08481f8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f0847fff640 1 -- 172.21.15.55:0/1698800576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08340094d0 con 0x7f08480c9680 2023-07-06T22:20:29.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.603+0000 7f0847fff640 1 --2- 172.21.15.55:0/1698800576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08480c9680 0x7f08481472f0 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f083401ab80 tx=0x7f083401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:29.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.607+0000 7f08457fa640 1 -- 172.21.15.55:0/1698800576 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08340bd5f0 con 0x7f08480c9680 2023-07-06T22:20:29.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.607+0000 7f08457fa640 1 -- 172.21.15.55:0/1698800576 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08340bd750 con 0x7f08480c9680 2023-07-06T22:20:29.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.607+0000 7f084eb40640 1 -- 172.21.15.55:0/1698800576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0848147830 con 0x7f08480c9680 2023-07-06T22:20:29.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.607+0000 7f08457fa640 1 -- 172.21.15.55:0/1698800576 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08340bdb00 con 0x7f08480c9680 2023-07-06T22:20:29.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.607+0000 7f084eb40640 1 -- 172.21.15.55:0/1698800576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08481f4b80 con 0x7f08480c9680 2023-07-06T22:20:29.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.607+0000 7f084eb40640 1 -- 172.21.15.55:0/1698800576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084806c580 con 0x7f08480c9680 2023-07-06T22:20:29.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.607+0000 7f08457fa640 1 -- 172.21.15.55:0/1698800576 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f08340b33f0 con 0x7f08480c9680 2023-07-06T22:20:29.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.607+0000 7f08457fa640 1 --2- 172.21.15.55:0/1698800576 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f082c0663a0 0x7f082c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:29.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.607+0000 7f08457fa640 1 -- 172.21.15.55:0/1698800576 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f083411ef20 con 0x7f08480c9680 2023-07-06T22:20:29.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.607+0000 7f084c8dc640 1 --2- 172.21.15.55:0/1698800576 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f082c0663a0 0x7f082c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:29.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.611+0000 7f084c8dc640 1 --2- 172.21.15.55:0/1698800576 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f082c0663a0 0x7f082c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f083c009ac0 tx=0x7f083c009190 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.611+0000 7f08457fa640 1 -- 172.21.15.55:0/1698800576 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08340ec0d0 con 0x7f08480c9680 2023-07-06T22:20:29.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.767+0000 7f084eb40640 1 -- 172.21.15.55:0/1698800576 --> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0848066d60 con 0x7f082c0663a0 2023-07-06T22:20:29.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.775+0000 7f08457fa640 1 -- 172.21.15.55:0/1698800576 <== mgr.10752 v2:172.21.15.55:6832/538997467 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312026 (secure 0 0 0) 0x7f0848066d60 con 0x7f082c0663a0 2023-07-06T22:20:29.780 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:29.781 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:20:29.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.779+0000 7f084eb40640 1 -- 172.21.15.55:0/1698800576 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f082c0663a0 msgr2=0x7f082c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:29.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.779+0000 7f084eb40640 1 --2- 172.21.15.55:0/1698800576 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f082c0663a0 0x7f082c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f083c009ac0 tx=0x7f083c009190 comp rx=0 tx=0).stop 2023-07-06T22:20:29.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.779+0000 7f084eb40640 1 -- 172.21.15.55:0/1698800576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08480c9680 msgr2=0x7f08481472f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:29.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.779+0000 7f084eb40640 1 --2- 172.21.15.55:0/1698800576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08480c9680 0x7f08481472f0 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f083401ab80 tx=0x7f083401ad10 comp rx=0 tx=0).stop 2023-07-06T22:20:29.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.779+0000 7f084eb40640 1 -- 172.21.15.55:0/1698800576 shutdown_connections 2023-07-06T22:20:29.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.779+0000 7f084eb40640 1 --2- 172.21.15.55:0/1698800576 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f082c0663a0 0x7f082c068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.779+0000 7f084eb40640 1 --2- 172.21.15.55:0/1698800576 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0848158400 0x7f0848161770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.779+0000 7f084eb40640 1 --2- 172.21.15.55:0/1698800576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08480c9680 0x7f08481472f0 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.779+0000 7f084eb40640 1 --2- 172.21.15.55:0/1698800576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08480710c0 0x7f08481f8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:29.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.779+0000 7f084eb40640 1 -- 172.21.15.55:0/1698800576 >> 172.21.15.55:0/1698800576 conn(0x7f08480cded0 msgr2=0x7f0848157740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:29.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.779+0000 7f084eb40640 1 -- 172.21.15.55:0/1698800576 shutdown_connections 2023-07-06T22:20:29.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:29.779+0000 7f084eb40640 1 -- 172.21.15.55:0/1698800576 wait complete. 2023-07-06T22:20:29.800 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-06T22:20:29.200599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":583,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":193,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":386016,"kb_used_data":20384,"kb_used_omap":0,"kb_used_meta":365568,"kb_avail":754588704,"statfs":{"total":773094113280,"available":772698832896,"internally_reserved":0,"allocated":20873216,"data_stored":11752086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":374341632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001150"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.746283+0000","last_change":"2023-07-06T22:20:23.765408+0000","last_active":"2023-07-06T22:20:24.746283+0000","last_peered":"2023-07-06T22:20:24.746283+0000","last_clean":"2023-07-06T22:20:24.746283+0000","last_became_active":"2023-07-06T22:20:23.765107+0000","last_became_peered":"2023-07-06T22:20:23.765107+0000","last_unstale":"2023-07-06T22:20:24.746283+0000","last_undegraded":"2023-07-06T22:20:24.746283+0000","last_fullsized":"2023-07-06T22:20:24.746283+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:10:44.166168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182578+0000","last_change":"2023-07-06T22:20:23.758299+0000","last_active":"2023-07-06T22:20:25.182578+0000","last_peered":"2023-07-06T22:20:25.182578+0000","last_clean":"2023-07-06T22:20:25.182578+0000","last_became_active":"2023-07-06T22:20:23.758005+0000","last_became_peered":"2023-07-06T22:20:23.758005+0000","last_unstale":"2023-07-06T22:20:25.182578+0000","last_undegraded":"2023-07-06T22:20:25.182578+0000","last_fullsized":"2023-07-06T22:20:25.182578+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:22:08.513210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181910+0000","last_change":"2023-07-06T22:20:23.756346+0000","last_active":"2023-07-06T22:20:25.181910+0000","last_peered":"2023-07-06T22:20:25.181910+0000","last_clean":"2023-07-06T22:20:25.181910+0000","last_became_active":"2023-07-06T22:20:23.756094+0000","last_became_peered":"2023-07-06T22:20:23.756094+0000","last_unstale":"2023-07-06T22:20:25.181910+0000","last_undegraded":"2023-07-06T22:20:25.181910+0000","last_fullsized":"2023-07-06T22:20:25.181910+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:42:24.619716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182642+0000","last_change":"2023-07-06T22:20:23.758335+0000","last_active":"2023-07-06T22:20:25.182642+0000","last_peered":"2023-07-06T22:20:25.182642+0000","last_clean":"2023-07-06T22:20:25.182642+0000","last_became_active":"2023-07-06T22:20:23.758021+0000","last_became_peered":"2023-07-06T22:20:23.758021+0000","last_unstale":"2023-07-06T22:20:25.182642+0000","last_undegraded":"2023-07-06T22:20:25.182642+0000","last_fullsized":"2023-07-06T22:20:25.182642+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:09:38.220294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182628+0000","last_change":"2023-07-06T22:20:23.754397+0000","last_active":"2023-07-06T22:20:25.182628+0000","last_peered":"2023-07-06T22:20:25.182628+0000","last_clean":"2023-07-06T22:20:25.182628+0000","last_became_active":"2023-07-06T22:20:23.753982+0000","last_became_peered":"2023-07-06T22:20:23.753982+0000","last_unstale":"2023-07-06T22:20:25.182628+0000","last_undegraded":"2023-07-06T22:20:25.182628+0000","last_fullsized":"2023-07-06T22:20:25.182628+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:18:23.667068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181629+0000","last_change":"2023-07-06T22:20:23.772660+0000","last_active":"2023-07-06T22:20:25.181629+0000","last_peered":"2023-07-06T22:20:25.181629+0000","last_clean":"2023-07-06T22:20:25.181629+0000","last_became_active":"2023-07-06T22:20:23.772371+0000","last_became_peered":"2023-07-06T22:20:23.772371+0000","last_unstale":"2023-07-06T22:20:25.181629+0000","last_undegraded":"2023-07-06T22:20:25.181629+0000","last_fullsized":"2023-07-06T22:20:25.181629+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:28:44.880931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745066+0000","last_change":"2023-07-06T22:20:23.767778+0000","last_active":"2023-07-06T22:20:24.745066+0000","last_peered":"2023-07-06T22:20:24.745066+0000","last_clean":"2023-07-06T22:20:24.745066+0000","last_became_active":"2023-07-06T22:20:23.766068+0000","last_became_peered":"2023-07-06T22:20:23.766068+0000","last_unstale":"2023-07-06T22:20:24.745066+0000","last_undegraded":"2023-07-06T22:20:24.745066+0000","last_fullsized":"2023-07-06T22:20:24.745066+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:48:12.750477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748247+0000","last_change":"2023-07-06T22:20:23.761392+0000","last_active":"2023-07-06T22:20:24.748247+0000","last_peered":"2023-07-06T22:20:24.748247+0000","last_clean":"2023-07-06T22:20:24.748247+0000","last_became_active":"2023-07-06T22:20:23.760961+0000","last_became_peered":"2023-07-06T22:20:23.760961+0000","last_unstale":"2023-07-06T22:20:24.748247+0000","last_undegraded":"2023-07-06T22:20:24.748247+0000","last_fullsized":"2023-07-06T22:20:24.748247+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:00:57.950236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182974+0000","last_change":"2023-07-06T22:20:23.758557+0000","last_active":"2023-07-06T22:20:25.182974+0000","last_peered":"2023-07-06T22:20:25.182974+0000","last_clean":"2023-07-06T22:20:25.182974+0000","last_became_active":"2023-07-06T22:20:23.758290+0000","last_became_peered":"2023-07-06T22:20:23.758290+0000","last_unstale":"2023-07-06T22:20:25.182974+0000","last_undegraded":"2023-07-06T22:20:25.182974+0000","last_fullsized":"2023-07-06T22:20:25.182974+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:09:01.145267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182625+0000","last_change":"2023-07-06T22:20:23.759284+0000","last_active":"2023-07-06T22:20:25.182625+0000","last_peered":"2023-07-06T22:20:25.182625+0000","last_clean":"2023-07-06T22:20:25.182625+0000","last_became_active":"2023-07-06T22:20:23.759059+0000","last_became_peered":"2023-07-06T22:20:23.759059+0000","last_unstale":"2023-07-06T22:20:25.182625+0000","last_undegraded":"2023-07-06T22:20:25.182625+0000","last_fullsized":"2023-07-06T22:20:25.182625+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:24:55.434381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745667+0000","last_change":"2023-07-06T22:20:23.772819+0000","last_active":"2023-07-06T22:20:24.745667+0000","last_peered":"2023-07-06T22:20:24.745667+0000","last_clean":"2023-07-06T22:20:24.745667+0000","last_became_active":"2023-07-06T22:20:23.772517+0000","last_became_peered":"2023-07-06T22:20:23.772517+0000","last_unstale":"2023-07-06T22:20:24.745667+0000","last_undegraded":"2023-07-06T22:20:24.745667+0000","last_fullsized":"2023-07-06T22:20:24.745667+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:43:51.157228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182796+0000","last_change":"2023-07-06T22:20:23.757748+0000","last_active":"2023-07-06T22:20:25.182796+0000","last_peered":"2023-07-06T22:20:25.182796+0000","last_clean":"2023-07-06T22:20:25.182796+0000","last_became_active":"2023-07-06T22:20:23.757207+0000","last_became_peered":"2023-07-06T22:20:23.757207+0000","last_unstale":"2023-07-06T22:20:25.182796+0000","last_undegraded":"2023-07-06T22:20:25.182796+0000","last_fullsized":"2023-07-06T22:20:25.182796+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:50:49.832816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182480+0000","last_change":"2023-07-06T22:20:23.752766+0000","last_active":"2023-07-06T22:20:25.182480+0000","last_peered":"2023-07-06T22:20:25.182480+0000","last_clean":"2023-07-06T22:20:25.182480+0000","last_became_active":"2023-07-06T22:20:23.749484+0000","last_became_peered":"2023-07-06T22:20:23.749484+0000","last_unstale":"2023-07-06T22:20:25.182480+0000","last_undegraded":"2023-07-06T22:20:25.182480+0000","last_fullsized":"2023-07-06T22:20:25.182480+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:42:58.673546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181777+0000","last_change":"2023-07-06T22:20:23.773432+0000","last_active":"2023-07-06T22:20:25.181777+0000","last_peered":"2023-07-06T22:20:25.181777+0000","last_clean":"2023-07-06T22:20:25.181777+0000","last_became_active":"2023-07-06T22:20:23.773162+0000","last_became_peered":"2023-07-06T22:20:23.773162+0000","last_unstale":"2023-07-06T22:20:25.181777+0000","last_undegraded":"2023-07-06T22:20:25.181777+0000","last_fullsized":"2023-07-06T22:20:25.181777+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:04:20.182124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182410+0000","last_change":"2023-07-06T22:20:23.754862+0000","last_active":"2023-07-06T22:20:25.182410+0000","last_peered":"2023-07-06T22:20:25.182410+0000","last_clean":"2023-07-06T22:20:25.182410+0000","last_became_active":"2023-07-06T22:20:23.754589+0000","last_became_peered":"2023-07-06T22:20:23.754589+0000","last_unstale":"2023-07-06T22:20:25.182410+0000","last_undegraded":"2023-07-06T22:20:25.182410+0000","last_fullsized":"2023-07-06T22:20:25.182410+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:35:45.476373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748399+0000","last_change":"2023-07-06T22:20:23.761220+0000","last_active":"2023-07-06T22:20:24.748399+0000","last_peered":"2023-07-06T22:20:24.748399+0000","last_clean":"2023-07-06T22:20:24.748399+0000","last_became_active":"2023-07-06T22:20:23.760623+0000","last_became_peered":"2023-07-06T22:20:23.760623+0000","last_unstale":"2023-07-06T22:20:24.748399+0000","last_undegraded":"2023-07-06T22:20:24.748399+0000","last_fullsized":"2023-07-06T22:20:24.748399+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:44:12.295857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182760+0000","last_change":"2023-07-06T22:20:23.757070+0000","last_active":"2023-07-06T22:20:25.182760+0000","last_peered":"2023-07-06T22:20:25.182760+0000","last_clean":"2023-07-06T22:20:25.182760+0000","last_became_active":"2023-07-06T22:20:23.756455+0000","last_became_peered":"2023-07-06T22:20:23.756455+0000","last_unstale":"2023-07-06T22:20:25.182760+0000","last_undegraded":"2023-07-06T22:20:25.182760+0000","last_fullsized":"2023-07-06T22:20:25.182760+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:22:14.875189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.746208+0000","last_change":"2023-07-06T22:20:23.754859+0000","last_active":"2023-07-06T22:20:24.746208+0000","last_peered":"2023-07-06T22:20:24.746208+0000","last_clean":"2023-07-06T22:20:24.746208+0000","last_became_active":"2023-07-06T22:20:23.754358+0000","last_became_peered":"2023-07-06T22:20:23.754358+0000","last_unstale":"2023-07-06T22:20:24.746208+0000","last_undegraded":"2023-07-06T22:20:24.746208+0000","last_fullsized":"2023-07-06T22:20:24.746208+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:34:53.906079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182634+0000","last_change":"2023-07-06T22:20:23.763856+0000","last_active":"2023-07-06T22:20:25.182634+0000","last_peered":"2023-07-06T22:20:25.182634+0000","last_clean":"2023-07-06T22:20:25.182634+0000","last_became_active":"2023-07-06T22:20:23.763590+0000","last_became_peered":"2023-07-06T22:20:23.763590+0000","last_unstale":"2023-07-06T22:20:25.182634+0000","last_undegraded":"2023-07-06T22:20:25.182634+0000","last_fullsized":"2023-07-06T22:20:25.182634+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:12:30.678255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182582+0000","last_change":"2023-07-06T22:20:23.754963+0000","last_active":"2023-07-06T22:20:25.182582+0000","last_peered":"2023-07-06T22:20:25.182582+0000","last_clean":"2023-07-06T22:20:25.182582+0000","last_became_active":"2023-07-06T22:20:23.754697+0000","last_became_peered":"2023-07-06T22:20:23.754697+0000","last_unstale":"2023-07-06T22:20:25.182582+0000","last_undegraded":"2023-07-06T22:20:25.182582+0000","last_fullsized":"2023-07-06T22:20:25.182582+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:52:13.942041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182766+0000","last_change":"2023-07-06T22:20:23.754231+0000","last_active":"2023-07-06T22:20:25.182766+0000","last_peered":"2023-07-06T22:20:25.182766+0000","last_clean":"2023-07-06T22:20:25.182766+0000","last_became_active":"2023-07-06T22:20:23.753642+0000","last_became_peered":"2023-07-06T22:20:23.753642+0000","last_unstale":"2023-07-06T22:20:25.182766+0000","last_undegraded":"2023-07-06T22:20:25.182766+0000","last_fullsized":"2023-07-06T22:20:25.182766+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:17:47.774731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182149+0000","last_change":"2023-07-06T22:20:23.768772+0000","last_active":"2023-07-06T22:20:25.182149+0000","last_peered":"2023-07-06T22:20:25.182149+0000","last_clean":"2023-07-06T22:20:25.182149+0000","last_became_active":"2023-07-06T22:20:23.768314+0000","last_became_peered":"2023-07-06T22:20:23.768314+0000","last_unstale":"2023-07-06T22:20:25.182149+0000","last_undegraded":"2023-07-06T22:20:25.182149+0000","last_fullsized":"2023-07-06T22:20:25.182149+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:39:04.671912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181560+0000","last_change":"2023-07-06T22:20:23.774280+0000","last_active":"2023-07-06T22:20:25.181560+0000","last_peered":"2023-07-06T22:20:25.181560+0000","last_clean":"2023-07-06T22:20:25.181560+0000","last_became_active":"2023-07-06T22:20:23.774017+0000","last_became_peered":"2023-07-06T22:20:23.774017+0000","last_unstale":"2023-07-06T22:20:25.181560+0000","last_undegraded":"2023-07-06T22:20:25.181560+0000","last_fullsized":"2023-07-06T22:20:25.181560+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:07:39.984448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748535+0000","last_change":"2023-07-06T22:20:23.755666+0000","last_active":"2023-07-06T22:20:24.748535+0000","last_peered":"2023-07-06T22:20:24.748535+0000","last_clean":"2023-07-06T22:20:24.748535+0000","last_became_active":"2023-07-06T22:20:23.755400+0000","last_became_peered":"2023-07-06T22:20:23.755400+0000","last_unstale":"2023-07-06T22:20:24.748535+0000","last_undegraded":"2023-07-06T22:20:24.748535+0000","last_fullsized":"2023-07-06T22:20:24.748535+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:41:28.215423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182916+0000","last_change":"2023-07-06T22:20:23.765384+0000","last_active":"2023-07-06T22:20:25.182916+0000","last_peered":"2023-07-06T22:20:25.182916+0000","last_clean":"2023-07-06T22:20:25.182916+0000","last_became_active":"2023-07-06T22:20:23.765102+0000","last_became_peered":"2023-07-06T22:20:23.765102+0000","last_unstale":"2023-07-06T22:20:25.182916+0000","last_undegraded":"2023-07-06T22:20:25.182916+0000","last_fullsized":"2023-07-06T22:20:25.182916+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:00:04.261734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745302+0000","last_change":"2023-07-06T22:20:23.766246+0000","last_active":"2023-07-06T22:20:24.745302+0000","last_peered":"2023-07-06T22:20:24.745302+0000","last_clean":"2023-07-06T22:20:24.745302+0000","last_became_active":"2023-07-06T22:20:23.765964+0000","last_became_peered":"2023-07-06T22:20:23.765964+0000","last_unstale":"2023-07-06T22:20:24.745302+0000","last_undegraded":"2023-07-06T22:20:24.745302+0000","last_fullsized":"2023-07-06T22:20:24.745302+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:55.329317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182029+0000","last_change":"2023-07-06T22:20:23.766747+0000","last_active":"2023-07-06T22:20:25.182029+0000","last_peered":"2023-07-06T22:20:25.182029+0000","last_clean":"2023-07-06T22:20:25.182029+0000","last_became_active":"2023-07-06T22:20:23.766442+0000","last_became_peered":"2023-07-06T22:20:23.766442+0000","last_unstale":"2023-07-06T22:20:25.182029+0000","last_undegraded":"2023-07-06T22:20:25.182029+0000","last_fullsized":"2023-07-06T22:20:25.182029+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:15.101449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182729+0000","last_change":"2023-07-06T22:20:23.765723+0000","last_active":"2023-07-06T22:20:25.182729+0000","last_peered":"2023-07-06T22:20:25.182729+0000","last_clean":"2023-07-06T22:20:25.182729+0000","last_became_active":"2023-07-06T22:20:23.765397+0000","last_became_peered":"2023-07-06T22:20:23.765397+0000","last_unstale":"2023-07-06T22:20:25.182729+0000","last_undegraded":"2023-07-06T22:20:25.182729+0000","last_fullsized":"2023-07-06T22:20:25.182729+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:33:14.742052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182833+0000","last_change":"2023-07-06T22:20:23.755399+0000","last_active":"2023-07-06T22:20:25.182833+0000","last_peered":"2023-07-06T22:20:25.182833+0000","last_clean":"2023-07-06T22:20:25.182833+0000","last_became_active":"2023-07-06T22:20:23.755137+0000","last_became_peered":"2023-07-06T22:20:23.755137+0000","last_unstale":"2023-07-06T22:20:25.182833+0000","last_undegraded":"2023-07-06T22:20:25.182833+0000","last_fullsized":"2023-07-06T22:20:25.182833+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:59:32.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181794+0000","last_change":"2023-07-06T22:20:23.766634+0000","last_active":"2023-07-06T22:20:25.181794+0000","last_peered":"2023-07-06T22:20:25.181794+0000","last_clean":"2023-07-06T22:20:25.181794+0000","last_became_active":"2023-07-06T22:20:23.766255+0000","last_became_peered":"2023-07-06T22:20:23.766255+0000","last_unstale":"2023-07-06T22:20:25.181794+0000","last_undegraded":"2023-07-06T22:20:25.181794+0000","last_fullsized":"2023-07-06T22:20:25.181794+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:33.488638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181615+0000","last_change":"2023-07-06T22:20:23.759918+0000","last_active":"2023-07-06T22:20:25.181615+0000","last_peered":"2023-07-06T22:20:25.181615+0000","last_clean":"2023-07-06T22:20:25.181615+0000","last_became_active":"2023-07-06T22:20:23.759632+0000","last_became_peered":"2023-07-06T22:20:23.759632+0000","last_unstale":"2023-07-06T22:20:25.181615+0000","last_undegraded":"2023-07-06T22:20:25.181615+0000","last_fullsized":"2023-07-06T22:20:25.181615+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:08:59.353493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182390+0000","last_change":"2023-07-06T22:20:23.753404+0000","last_active":"2023-07-06T22:20:25.182390+0000","last_peered":"2023-07-06T22:20:25.182390+0000","last_clean":"2023-07-06T22:20:25.182390+0000","last_became_active":"2023-07-06T22:20:23.753105+0000","last_became_peered":"2023-07-06T22:20:23.753105+0000","last_unstale":"2023-07-06T22:20:25.182390+0000","last_undegraded":"2023-07-06T22:20:25.182390+0000","last_fullsized":"2023-07-06T22:20:25.182390+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:35:07.103802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182049+0000","last_change":"2023-07-06T22:20:23.760670+0000","last_active":"2023-07-06T22:20:25.182049+0000","last_peered":"2023-07-06T22:20:25.182049+0000","last_clean":"2023-07-06T22:20:25.182049+0000","last_became_active":"2023-07-06T22:20:23.760391+0000","last_became_peered":"2023-07-06T22:20:23.760391+0000","last_unstale":"2023-07-06T22:20:25.182049+0000","last_undegraded":"2023-07-06T22:20:25.182049+0000","last_fullsized":"2023-07-06T22:20:25.182049+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:04:20.182124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745565+0000","last_change":"2023-07-06T22:20:23.353207+0000","last_active":"2023-07-06T22:20:24.745565+0000","last_peered":"2023-07-06T22:20:24.745565+0000","last_clean":"2023-07-06T22:20:24.745565+0000","last_became_active":"2023-07-06T22:20:23.352540+0000","last_became_peered":"2023-07-06T22:20:23.352540+0000","last_unstale":"2023-07-06T22:20:24.745565+0000","last_undegraded":"2023-07-06T22:20:24.745565+0000","last_fullsized":"2023-07-06T22:20:24.745565+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:27:18.568497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748761+0000","last_change":"2023-07-06T22:20:23.768158+0000","last_active":"2023-07-06T22:20:24.748761+0000","last_peered":"2023-07-06T22:20:24.748761+0000","last_clean":"2023-07-06T22:20:24.748761+0000","last_became_active":"2023-07-06T22:20:23.767874+0000","last_became_peered":"2023-07-06T22:20:23.767874+0000","last_unstale":"2023-07-06T22:20:24.748761+0000","last_undegraded":"2023-07-06T22:20:24.748761+0000","last_fullsized":"2023-07-06T22:20:24.748761+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:45:36.614200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182643+0000","last_change":"2023-07-06T22:20:23.345574+0000","last_active":"2023-07-06T22:20:25.182643+0000","last_peered":"2023-07-06T22:20:25.182643+0000","last_clean":"2023-07-06T22:20:25.182643+0000","last_became_active":"2023-07-06T22:20:23.345312+0000","last_became_peered":"2023-07-06T22:20:23.345312+0000","last_unstale":"2023-07-06T22:20:25.182643+0000","last_undegraded":"2023-07-06T22:20:25.182643+0000","last_fullsized":"2023-07-06T22:20:25.182643+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:50:08.142045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745581+0000","last_change":"2023-07-06T22:20:23.758242+0000","last_active":"2023-07-06T22:20:24.745581+0000","last_peered":"2023-07-06T22:20:24.745581+0000","last_clean":"2023-07-06T22:20:24.745581+0000","last_became_active":"2023-07-06T22:20:23.757937+0000","last_became_peered":"2023-07-06T22:20:23.757937+0000","last_unstale":"2023-07-06T22:20:24.745581+0000","last_undegraded":"2023-07-06T22:20:24.745581+0000","last_fullsized":"2023-07-06T22:20:24.745581+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:36:42.152977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"195'3","reported_seq":16,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182339+0000","last_change":"2023-07-06T22:20:23.342155+0000","last_active":"2023-07-06T22:20:25.182339+0000","last_peered":"2023-07-06T22:20:25.182339+0000","last_clean":"2023-07-06T22:20:25.182339+0000","last_became_active":"2023-07-06T22:20:23.341848+0000","last_became_peered":"2023-07-06T22:20:23.341848+0000","last_unstale":"2023-07-06T22:20:25.182339+0000","last_undegraded":"2023-07-06T22:20:25.182339+0000","last_fullsized":"2023-07-06T22:20:25.182339+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:25:26.675144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182759+0000","last_change":"2023-07-06T22:20:23.768272+0000","last_active":"2023-07-06T22:20:25.182759+0000","last_peered":"2023-07-06T22:20:25.182759+0000","last_clean":"2023-07-06T22:20:25.182759+0000","last_became_active":"2023-07-06T22:20:23.768005+0000","last_became_peered":"2023-07-06T22:20:23.768005+0000","last_unstale":"2023-07-06T22:20:25.182759+0000","last_undegraded":"2023-07-06T22:20:25.182759+0000","last_fullsized":"2023-07-06T22:20:25.182759+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:43:03.993702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"195'6","reported_seq":19,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181629+0000","last_change":"2023-07-06T22:20:23.352200+0000","last_active":"2023-07-06T22:20:25.181629+0000","last_peered":"2023-07-06T22:20:25.181629+0000","last_clean":"2023-07-06T22:20:25.181629+0000","last_became_active":"2023-07-06T22:20:23.351926+0000","last_became_peered":"2023-07-06T22:20:23.351926+0000","last_unstale":"2023-07-06T22:20:25.181629+0000","last_undegraded":"2023-07-06T22:20:25.181629+0000","last_fullsized":"2023-07-06T22:20:25.181629+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:56:55.305047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181773+0000","last_change":"2023-07-06T22:20:23.773635+0000","last_active":"2023-07-06T22:20:25.181773+0000","last_peered":"2023-07-06T22:20:25.181773+0000","last_clean":"2023-07-06T22:20:25.181773+0000","last_became_active":"2023-07-06T22:20:23.773351+0000","last_became_peered":"2023-07-06T22:20:23.773351+0000","last_unstale":"2023-07-06T22:20:25.181773+0000","last_undegraded":"2023-07-06T22:20:25.181773+0000","last_fullsized":"2023-07-06T22:20:25.181773+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:30:10.921402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.746005+0000","last_change":"2023-07-06T22:20:23.345470+0000","last_active":"2023-07-06T22:20:24.746005+0000","last_peered":"2023-07-06T22:20:24.746005+0000","last_clean":"2023-07-06T22:20:24.746005+0000","last_became_active":"2023-07-06T22:20:23.345178+0000","last_became_peered":"2023-07-06T22:20:23.345178+0000","last_unstale":"2023-07-06T22:20:24.746005+0000","last_undegraded":"2023-07-06T22:20:24.746005+0000","last_fullsized":"2023-07-06T22:20:24.746005+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:22:25.730754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745781+0000","last_change":"2023-07-06T22:20:23.764909+0000","last_active":"2023-07-06T22:20:24.745781+0000","last_peered":"2023-07-06T22:20:24.745781+0000","last_clean":"2023-07-06T22:20:24.745781+0000","last_became_active":"2023-07-06T22:20:23.764608+0000","last_became_peered":"2023-07-06T22:20:23.764608+0000","last_unstale":"2023-07-06T22:20:24.745781+0000","last_undegraded":"2023-07-06T22:20:24.745781+0000","last_fullsized":"2023-07-06T22:20:24.745781+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:41.402377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182380+0000","last_change":"2023-07-06T22:20:23.353648+0000","last_active":"2023-07-06T22:20:25.182380+0000","last_peered":"2023-07-06T22:20:25.182380+0000","last_clean":"2023-07-06T22:20:25.182380+0000","last_became_active":"2023-07-06T22:20:23.353358+0000","last_became_peered":"2023-07-06T22:20:23.353358+0000","last_unstale":"2023-07-06T22:20:25.182380+0000","last_undegraded":"2023-07-06T22:20:25.182380+0000","last_fullsized":"2023-07-06T22:20:25.182380+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:15:55.854172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181754+0000","last_change":"2023-07-06T22:20:23.768454+0000","last_active":"2023-07-06T22:20:25.181754+0000","last_peered":"2023-07-06T22:20:25.181754+0000","last_clean":"2023-07-06T22:20:25.181754+0000","last_became_active":"2023-07-06T22:20:23.768153+0000","last_became_peered":"2023-07-06T22:20:23.768153+0000","last_unstale":"2023-07-06T22:20:25.181754+0000","last_undegraded":"2023-07-06T22:20:25.181754+0000","last_fullsized":"2023-07-06T22:20:25.181754+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:15.101449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748108+0000","last_change":"2023-07-06T22:20:23.347816+0000","last_active":"2023-07-06T22:20:24.748108+0000","last_peered":"2023-07-06T22:20:24.748108+0000","last_clean":"2023-07-06T22:20:24.748108+0000","last_became_active":"2023-07-06T22:20:23.347507+0000","last_became_peered":"2023-07-06T22:20:23.347507+0000","last_unstale":"2023-07-06T22:20:24.748108+0000","last_undegraded":"2023-07-06T22:20:24.748108+0000","last_fullsized":"2023-07-06T22:20:24.748108+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:34:09.411399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182026+0000","last_change":"2023-07-06T22:20:23.764372+0000","last_active":"2023-07-06T22:20:25.182026+0000","last_peered":"2023-07-06T22:20:25.182026+0000","last_clean":"2023-07-06T22:20:25.182026+0000","last_became_active":"2023-07-06T22:20:23.764083+0000","last_became_peered":"2023-07-06T22:20:23.764083+0000","last_unstale":"2023-07-06T22:20:25.182026+0000","last_undegraded":"2023-07-06T22:20:25.182026+0000","last_fullsized":"2023-07-06T22:20:25.182026+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:22:36.308012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"195'8","reported_seq":21,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745830+0000","last_change":"2023-07-06T22:20:23.346135+0000","last_active":"2023-07-06T22:20:24.745830+0000","last_peered":"2023-07-06T22:20:24.745830+0000","last_clean":"2023-07-06T22:20:24.745830+0000","last_became_active":"2023-07-06T22:20:23.345839+0000","last_became_peered":"2023-07-06T22:20:23.345839+0000","last_unstale":"2023-07-06T22:20:24.745830+0000","last_undegraded":"2023-07-06T22:20:24.745830+0000","last_fullsized":"2023-07-06T22:20:24.745830+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:01:53.727238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182745+0000","last_change":"2023-07-06T22:20:23.757615+0000","last_active":"2023-07-06T22:20:25.182745+0000","last_peered":"2023-07-06T22:20:25.182745+0000","last_clean":"2023-07-06T22:20:25.182745+0000","last_became_active":"2023-07-06T22:20:23.757350+0000","last_became_peered":"2023-07-06T22:20:23.757350+0000","last_unstale":"2023-07-06T22:20:25.182745+0000","last_undegraded":"2023-07-06T22:20:25.182745+0000","last_fullsized":"2023-07-06T22:20:25.182745+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:34:29.344710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182980+0000","last_change":"2023-07-06T22:20:23.351289+0000","last_active":"2023-07-06T22:20:25.182980+0000","last_peered":"2023-07-06T22:20:25.182980+0000","last_clean":"2023-07-06T22:20:25.182980+0000","last_became_active":"2023-07-06T22:20:23.351002+0000","last_became_peered":"2023-07-06T22:20:23.351002+0000","last_unstale":"2023-07-06T22:20:25.182980+0000","last_undegraded":"2023-07-06T22:20:25.182980+0000","last_fullsized":"2023-07-06T22:20:25.182980+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:41:41.683036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183065+0000","last_change":"2023-07-06T22:20:23.774002+0000","last_active":"2023-07-06T22:20:25.183065+0000","last_peered":"2023-07-06T22:20:25.183065+0000","last_clean":"2023-07-06T22:20:25.183065+0000","last_became_active":"2023-07-06T22:20:23.773727+0000","last_became_peered":"2023-07-06T22:20:23.773727+0000","last_unstale":"2023-07-06T22:20:25.183065+0000","last_undegraded":"2023-07-06T22:20:25.183065+0000","last_fullsized":"2023-07-06T22:20:25.183065+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:38:31.878262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748793+0000","last_change":"2023-07-06T22:20:23.344846+0000","last_active":"2023-07-06T22:20:24.748793+0000","last_peered":"2023-07-06T22:20:24.748793+0000","last_clean":"2023-07-06T22:20:24.748793+0000","last_became_active":"2023-07-06T22:20:23.344530+0000","last_became_peered":"2023-07-06T22:20:23.344530+0000","last_unstale":"2023-07-06T22:20:24.748793+0000","last_undegraded":"2023-07-06T22:20:24.748793+0000","last_fullsized":"2023-07-06T22:20:24.748793+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:32:36.005589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182745+0000","last_change":"2023-07-06T22:20:23.772941+0000","last_active":"2023-07-06T22:20:25.182745+0000","last_peered":"2023-07-06T22:20:25.182745+0000","last_clean":"2023-07-06T22:20:25.182745+0000","last_became_active":"2023-07-06T22:20:23.772600+0000","last_became_peered":"2023-07-06T22:20:23.772600+0000","last_unstale":"2023-07-06T22:20:25.182745+0000","last_undegraded":"2023-07-06T22:20:25.182745+0000","last_fullsized":"2023-07-06T22:20:25.182745+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:06:14.081391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.746089+0000","last_change":"2023-07-06T22:20:23.345586+0000","last_active":"2023-07-06T22:20:24.746089+0000","last_peered":"2023-07-06T22:20:24.746089+0000","last_clean":"2023-07-06T22:20:24.746089+0000","last_became_active":"2023-07-06T22:20:23.345294+0000","last_became_peered":"2023-07-06T22:20:23.345294+0000","last_unstale":"2023-07-06T22:20:24.746089+0000","last_undegraded":"2023-07-06T22:20:24.746089+0000","last_fullsized":"2023-07-06T22:20:24.746089+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:42:28.866920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182446+0000","last_change":"2023-07-06T22:20:23.759697+0000","last_active":"2023-07-06T22:20:25.182446+0000","last_peered":"2023-07-06T22:20:25.182446+0000","last_clean":"2023-07-06T22:20:25.182446+0000","last_became_active":"2023-07-06T22:20:23.759420+0000","last_became_peered":"2023-07-06T22:20:23.759420+0000","last_unstale":"2023-07-06T22:20:25.182446+0000","last_undegraded":"2023-07-06T22:20:25.182446+0000","last_fullsized":"2023-07-06T22:20:25.182446+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:05:21.938850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745775+0000","last_change":"2023-07-06T22:20:23.350756+0000","last_active":"2023-07-06T22:20:24.745775+0000","last_peered":"2023-07-06T22:20:24.745775+0000","last_clean":"2023-07-06T22:20:24.745775+0000","last_became_active":"2023-07-06T22:20:23.350448+0000","last_became_peered":"2023-07-06T22:20:23.350448+0000","last_unstale":"2023-07-06T22:20:24.745775+0000","last_undegraded":"2023-07-06T22:20:24.745775+0000","last_fullsized":"2023-07-06T22:20:24.745775+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:24:51.209845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182299+0000","last_change":"2023-07-06T22:20:23.763785+0000","last_active":"2023-07-06T22:20:25.182299+0000","last_peered":"2023-07-06T22:20:25.182299+0000","last_clean":"2023-07-06T22:20:25.182299+0000","last_became_active":"2023-07-06T22:20:23.763508+0000","last_became_peered":"2023-07-06T22:20:23.763508+0000","last_unstale":"2023-07-06T22:20:25.182299+0000","last_undegraded":"2023-07-06T22:20:25.182299+0000","last_fullsized":"2023-07-06T22:20:25.182299+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:23:52.851909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181774+0000","last_change":"2023-07-06T22:20:23.353694+0000","last_active":"2023-07-06T22:20:25.181774+0000","last_peered":"2023-07-06T22:20:25.181774+0000","last_clean":"2023-07-06T22:20:25.181774+0000","last_became_active":"2023-07-06T22:20:23.353181+0000","last_became_peered":"2023-07-06T22:20:23.353181+0000","last_unstale":"2023-07-06T22:20:25.181774+0000","last_undegraded":"2023-07-06T22:20:25.181774+0000","last_fullsized":"2023-07-06T22:20:25.181774+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:53:03.781177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745355+0000","last_change":"2023-07-06T22:20:23.759360+0000","last_active":"2023-07-06T22:20:24.745355+0000","last_peered":"2023-07-06T22:20:24.745355+0000","last_clean":"2023-07-06T22:20:24.745355+0000","last_became_active":"2023-07-06T22:20:23.759075+0000","last_became_peered":"2023-07-06T22:20:23.759075+0000","last_unstale":"2023-07-06T22:20:24.745355+0000","last_undegraded":"2023-07-06T22:20:24.745355+0000","last_fullsized":"2023-07-06T22:20:24.745355+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:55:04.598052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183001+0000","last_change":"2023-07-06T22:20:23.344336+0000","last_active":"2023-07-06T22:20:25.183001+0000","last_peered":"2023-07-06T22:20:25.183001+0000","last_clean":"2023-07-06T22:20:25.183001+0000","last_became_active":"2023-07-06T22:20:23.344038+0000","last_became_peered":"2023-07-06T22:20:23.344038+0000","last_unstale":"2023-07-06T22:20:25.183001+0000","last_undegraded":"2023-07-06T22:20:25.183001+0000","last_fullsized":"2023-07-06T22:20:25.183001+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:46:07.193671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182271+0000","last_change":"2023-07-06T22:20:23.755269+0000","last_active":"2023-07-06T22:20:25.182271+0000","last_peered":"2023-07-06T22:20:25.182271+0000","last_clean":"2023-07-06T22:20:25.182271+0000","last_became_active":"2023-07-06T22:20:23.752222+0000","last_became_peered":"2023-07-06T22:20:23.752222+0000","last_unstale":"2023-07-06T22:20:25.182271+0000","last_undegraded":"2023-07-06T22:20:25.182271+0000","last_fullsized":"2023-07-06T22:20:25.182271+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:04:16.705845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181668+0000","last_change":"2023-07-06T22:20:23.353718+0000","last_active":"2023-07-06T22:20:25.181668+0000","last_peered":"2023-07-06T22:20:25.181668+0000","last_clean":"2023-07-06T22:20:25.181668+0000","last_became_active":"2023-07-06T22:20:23.353318+0000","last_became_peered":"2023-07-06T22:20:23.353318+0000","last_unstale":"2023-07-06T22:20:25.181668+0000","last_undegraded":"2023-07-06T22:20:25.181668+0000","last_fullsized":"2023-07-06T22:20:25.181668+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:17:46.858653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182335+0000","last_change":"2023-07-06T22:20:23.756960+0000","last_active":"2023-07-06T22:20:25.182335+0000","last_peered":"2023-07-06T22:20:25.182335+0000","last_clean":"2023-07-06T22:20:25.182335+0000","last_became_active":"2023-07-06T22:20:23.756622+0000","last_became_peered":"2023-07-06T22:20:23.756622+0000","last_unstale":"2023-07-06T22:20:25.182335+0000","last_undegraded":"2023-07-06T22:20:25.182335+0000","last_fullsized":"2023-07-06T22:20:25.182335+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:02:04.695117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181779+0000","last_change":"2023-07-06T22:20:23.352540+0000","last_active":"2023-07-06T22:20:25.181779+0000","last_peered":"2023-07-06T22:20:25.181779+0000","last_clean":"2023-07-06T22:20:25.181779+0000","last_became_active":"2023-07-06T22:20:23.352213+0000","last_became_peered":"2023-07-06T22:20:23.352213+0000","last_unstale":"2023-07-06T22:20:25.181779+0000","last_undegraded":"2023-07-06T22:20:25.181779+0000","last_fullsized":"2023-07-06T22:20:25.181779+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:13.829965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182551+0000","last_change":"2023-07-06T22:20:23.756234+0000","last_active":"2023-07-06T22:20:25.182551+0000","last_peered":"2023-07-06T22:20:25.182551+0000","last_clean":"2023-07-06T22:20:25.182551+0000","last_became_active":"2023-07-06T22:20:23.755933+0000","last_became_peered":"2023-07-06T22:20:23.755933+0000","last_unstale":"2023-07-06T22:20:25.182551+0000","last_undegraded":"2023-07-06T22:20:25.182551+0000","last_fullsized":"2023-07-06T22:20:25.182551+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:27:21.708917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.746282+0000","last_change":"2023-07-06T22:20:23.353671+0000","last_active":"2023-07-06T22:20:24.746282+0000","last_peered":"2023-07-06T22:20:24.746282+0000","last_clean":"2023-07-06T22:20:24.746282+0000","last_became_active":"2023-07-06T22:20:23.353347+0000","last_became_peered":"2023-07-06T22:20:23.353347+0000","last_unstale":"2023-07-06T22:20:24.746282+0000","last_undegraded":"2023-07-06T22:20:24.746282+0000","last_fullsized":"2023-07-06T22:20:24.746282+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:59.085281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183244+0000","last_change":"2023-07-06T22:20:23.772660+0000","last_active":"2023-07-06T22:20:25.183244+0000","last_peered":"2023-07-06T22:20:25.183244+0000","last_clean":"2023-07-06T22:20:25.183244+0000","last_became_active":"2023-07-06T22:20:23.772375+0000","last_became_peered":"2023-07-06T22:20:23.772375+0000","last_unstale":"2023-07-06T22:20:25.183244+0000","last_undegraded":"2023-07-06T22:20:25.183244+0000","last_fullsized":"2023-07-06T22:20:25.183244+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:29:03.073107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182823+0000","last_change":"2023-07-06T22:20:23.350255+0000","last_active":"2023-07-06T22:20:25.182823+0000","last_peered":"2023-07-06T22:20:25.182823+0000","last_clean":"2023-07-06T22:20:25.182823+0000","last_became_active":"2023-07-06T22:20:23.349944+0000","last_became_peered":"2023-07-06T22:20:23.349944+0000","last_unstale":"2023-07-06T22:20:25.182823+0000","last_undegraded":"2023-07-06T22:20:25.182823+0000","last_fullsized":"2023-07-06T22:20:25.182823+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:57.677955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748550+0000","last_change":"2023-07-06T22:20:23.758205+0000","last_active":"2023-07-06T22:20:24.748550+0000","last_peered":"2023-07-06T22:20:24.748550+0000","last_clean":"2023-07-06T22:20:24.748550+0000","last_became_active":"2023-07-06T22:20:23.757907+0000","last_became_peered":"2023-07-06T22:20:23.757907+0000","last_unstale":"2023-07-06T22:20:24.748550+0000","last_undegraded":"2023-07-06T22:20:24.748550+0000","last_fullsized":"2023-07-06T22:20:24.748550+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:39.251919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182835+0000","last_change":"2023-07-06T22:20:23.355963+0000","last_active":"2023-07-06T22:20:25.182835+0000","last_peered":"2023-07-06T22:20:25.182835+0000","last_clean":"2023-07-06T22:20:25.182835+0000","last_became_active":"2023-07-06T22:20:23.355694+0000","last_became_peered":"2023-07-06T22:20:23.355694+0000","last_unstale":"2023-07-06T22:20:25.182835+0000","last_undegraded":"2023-07-06T22:20:25.182835+0000","last_fullsized":"2023-07-06T22:20:25.182835+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:04:07.137562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748596+0000","last_change":"2023-07-06T22:20:23.758337+0000","last_active":"2023-07-06T22:20:24.748596+0000","last_peered":"2023-07-06T22:20:24.748596+0000","last_clean":"2023-07-06T22:20:24.748596+0000","last_became_active":"2023-07-06T22:20:23.758065+0000","last_became_peered":"2023-07-06T22:20:23.758065+0000","last_unstale":"2023-07-06T22:20:24.748596+0000","last_undegraded":"2023-07-06T22:20:24.748596+0000","last_fullsized":"2023-07-06T22:20:24.748596+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:21:49.359371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748532+0000","last_change":"2023-07-06T22:20:23.345084+0000","last_active":"2023-07-06T22:20:24.748532+0000","last_peered":"2023-07-06T22:20:24.748532+0000","last_clean":"2023-07-06T22:20:24.748532+0000","last_became_active":"2023-07-06T22:20:23.344595+0000","last_became_peered":"2023-07-06T22:20:23.344595+0000","last_unstale":"2023-07-06T22:20:24.748532+0000","last_undegraded":"2023-07-06T22:20:24.748532+0000","last_fullsized":"2023-07-06T22:20:24.748532+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:29:10.824101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745850+0000","last_change":"2023-07-06T22:20:23.760751+0000","last_active":"2023-07-06T22:20:24.745850+0000","last_peered":"2023-07-06T22:20:24.745850+0000","last_clean":"2023-07-06T22:20:24.745850+0000","last_became_active":"2023-07-06T22:20:23.760433+0000","last_became_peered":"2023-07-06T22:20:23.760433+0000","last_unstale":"2023-07-06T22:20:24.745850+0000","last_undegraded":"2023-07-06T22:20:24.745850+0000","last_fullsized":"2023-07-06T22:20:24.745850+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:09:01.312664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182230+0000","last_change":"2023-07-06T22:20:23.352537+0000","last_active":"2023-07-06T22:20:25.182230+0000","last_peered":"2023-07-06T22:20:25.182230+0000","last_clean":"2023-07-06T22:20:25.182230+0000","last_became_active":"2023-07-06T22:20:23.352180+0000","last_became_peered":"2023-07-06T22:20:23.352180+0000","last_unstale":"2023-07-06T22:20:25.182230+0000","last_undegraded":"2023-07-06T22:20:25.182230+0000","last_fullsized":"2023-07-06T22:20:25.182230+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:40:10.595695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745747+0000","last_change":"2023-07-06T22:20:23.751210+0000","last_active":"2023-07-06T22:20:24.745747+0000","last_peered":"2023-07-06T22:20:24.745747+0000","last_clean":"2023-07-06T22:20:24.745747+0000","last_became_active":"2023-07-06T22:20:23.750893+0000","last_became_peered":"2023-07-06T22:20:23.750893+0000","last_unstale":"2023-07-06T22:20:24.745747+0000","last_undegraded":"2023-07-06T22:20:24.745747+0000","last_fullsized":"2023-07-06T22:20:24.745747+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:41:43.699020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181904+0000","last_change":"2023-07-06T22:20:23.352510+0000","last_active":"2023-07-06T22:20:25.181904+0000","last_peered":"2023-07-06T22:20:25.181904+0000","last_clean":"2023-07-06T22:20:25.181904+0000","last_became_active":"2023-07-06T22:20:23.351929+0000","last_became_peered":"2023-07-06T22:20:23.351929+0000","last_unstale":"2023-07-06T22:20:25.181904+0000","last_undegraded":"2023-07-06T22:20:25.181904+0000","last_fullsized":"2023-07-06T22:20:25.181904+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:50:13.356330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182417+0000","last_change":"2023-07-06T22:20:23.757590+0000","last_active":"2023-07-06T22:20:25.182417+0000","last_peered":"2023-07-06T22:20:25.182417+0000","last_clean":"2023-07-06T22:20:25.182417+0000","last_became_active":"2023-07-06T22:20:23.757308+0000","last_became_peered":"2023-07-06T22:20:23.757308+0000","last_unstale":"2023-07-06T22:20:25.182417+0000","last_undegraded":"2023-07-06T22:20:25.182417+0000","last_fullsized":"2023-07-06T22:20:25.182417+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:43:12.745677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182683+0000","last_change":"2023-07-06T22:20:23.355417+0000","last_active":"2023-07-06T22:20:25.182683+0000","last_peered":"2023-07-06T22:20:25.182683+0000","last_clean":"2023-07-06T22:20:25.182683+0000","last_became_active":"2023-07-06T22:20:23.355073+0000","last_became_peered":"2023-07-06T22:20:23.355073+0000","last_unstale":"2023-07-06T22:20:25.182683+0000","last_undegraded":"2023-07-06T22:20:25.182683+0000","last_fullsized":"2023-07-06T22:20:25.182683+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:40:12.758677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182315+0000","last_change":"2023-07-06T22:20:23.754927+0000","last_active":"2023-07-06T22:20:25.182315+0000","last_peered":"2023-07-06T22:20:25.182315+0000","last_clean":"2023-07-06T22:20:25.182315+0000","last_became_active":"2023-07-06T22:20:23.754672+0000","last_became_peered":"2023-07-06T22:20:23.754672+0000","last_unstale":"2023-07-06T22:20:25.182315+0000","last_undegraded":"2023-07-06T22:20:25.182315+0000","last_fullsized":"2023-07-06T22:20:25.182315+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:19:11.328917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181548+0000","last_change":"2023-07-06T22:20:23.353389+0000","last_active":"2023-07-06T22:20:25.181548+0000","last_peered":"2023-07-06T22:20:25.181548+0000","last_clean":"2023-07-06T22:20:25.181548+0000","last_became_active":"2023-07-06T22:20:23.353067+0000","last_became_peered":"2023-07-06T22:20:23.353067+0000","last_unstale":"2023-07-06T22:20:25.181548+0000","last_undegraded":"2023-07-06T22:20:25.181548+0000","last_fullsized":"2023-07-06T22:20:25.181548+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:35:39.372069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182068+0000","last_change":"2023-07-06T22:20:23.757161+0000","last_active":"2023-07-06T22:20:25.182068+0000","last_peered":"2023-07-06T22:20:25.182068+0000","last_clean":"2023-07-06T22:20:25.182068+0000","last_became_active":"2023-07-06T22:20:23.756901+0000","last_became_peered":"2023-07-06T22:20:23.756901+0000","last_unstale":"2023-07-06T22:20:25.182068+0000","last_undegraded":"2023-07-06T22:20:25.182068+0000","last_fullsized":"2023-07-06T22:20:25.182068+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:56:08.577417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745358+0000","last_change":"2023-07-06T22:20:23.349325+0000","last_active":"2023-07-06T22:20:24.745358+0000","last_peered":"2023-07-06T22:20:24.745358+0000","last_clean":"2023-07-06T22:20:24.745358+0000","last_became_active":"2023-07-06T22:20:23.348985+0000","last_became_peered":"2023-07-06T22:20:23.348985+0000","last_unstale":"2023-07-06T22:20:24.745358+0000","last_undegraded":"2023-07-06T22:20:24.745358+0000","last_fullsized":"2023-07-06T22:20:24.745358+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:39:51.067314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1265,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.746449+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:20:24.746449+0000","last_peered":"2023-07-06T22:20:24.746449+0000","last_clean":"2023-07-06T22:20:24.746449+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:20:24.746449+0000","last_undegraded":"2023-07-06T22:20:24.746449+0000","last_fullsized":"2023-07-06T22:20:24.746449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:15.737116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":319,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182173+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:20:25.182173+0000","last_peered":"2023-07-06T22:20:25.182173+0000","last_clean":"2023-07-06T22:20:25.182173+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:20:25.182173+0000","last_undegraded":"2023-07-06T22:20:25.182173+0000","last_fullsized":"2023-07-06T22:20:25.182173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:20.931530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748393+0000","last_change":"2023-07-06T22:20:23.759287+0000","last_active":"2023-07-06T22:20:24.748393+0000","last_peered":"2023-07-06T22:20:24.748393+0000","last_clean":"2023-07-06T22:20:24.748393+0000","last_became_active":"2023-07-06T22:20:23.759026+0000","last_became_peered":"2023-07-06T22:20:23.759026+0000","last_unstale":"2023-07-06T22:20:24.748393+0000","last_undegraded":"2023-07-06T22:20:24.748393+0000","last_fullsized":"2023-07-06T22:20:24.748393+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:26:37.160169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748315+0000","last_change":"2023-07-06T22:20:23.349707+0000","last_active":"2023-07-06T22:20:24.748315+0000","last_peered":"2023-07-06T22:20:24.748315+0000","last_clean":"2023-07-06T22:20:24.748315+0000","last_became_active":"2023-07-06T22:20:23.349418+0000","last_became_peered":"2023-07-06T22:20:23.349418+0000","last_unstale":"2023-07-06T22:20:24.748315+0000","last_undegraded":"2023-07-06T22:20:24.748315+0000","last_fullsized":"2023-07-06T22:20:24.748315+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:20.961162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":367,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745789+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:20:24.745789+0000","last_peered":"2023-07-06T22:20:24.745789+0000","last_clean":"2023-07-06T22:20:24.745789+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:20:24.745789+0000","last_undegraded":"2023-07-06T22:20:24.745789+0000","last_fullsized":"2023-07-06T22:20:24.745789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:12:54.130404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183090+0000","last_change":"2023-07-06T22:20:23.768576+0000","last_active":"2023-07-06T22:20:25.183090+0000","last_peered":"2023-07-06T22:20:25.183090+0000","last_clean":"2023-07-06T22:20:25.183090+0000","last_became_active":"2023-07-06T22:20:23.767967+0000","last_became_peered":"2023-07-06T22:20:23.767967+0000","last_unstale":"2023-07-06T22:20:25.183090+0000","last_undegraded":"2023-07-06T22:20:25.183090+0000","last_fullsized":"2023-07-06T22:20:25.183090+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:32:42.536197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182851+0000","last_change":"2023-07-06T22:20:23.350544+0000","last_active":"2023-07-06T22:20:25.182851+0000","last_peered":"2023-07-06T22:20:25.182851+0000","last_clean":"2023-07-06T22:20:25.182851+0000","last_became_active":"2023-07-06T22:20:23.350270+0000","last_became_peered":"2023-07-06T22:20:23.350270+0000","last_unstale":"2023-07-06T22:20:25.182851+0000","last_undegraded":"2023-07-06T22:20:25.182851+0000","last_fullsized":"2023-07-06T22:20:25.182851+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:43:12.080006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":363,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182403+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:20:25.182403+0000","last_peered":"2023-07-06T22:20:25.182403+0000","last_clean":"2023-07-06T22:20:25.182403+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:20:25.182403+0000","last_undegraded":"2023-07-06T22:20:25.182403+0000","last_fullsized":"2023-07-06T22:20:25.182403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:28:54.236441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745167+0000","last_change":"2023-07-06T22:20:23.768583+0000","last_active":"2023-07-06T22:20:24.745167+0000","last_peered":"2023-07-06T22:20:24.745167+0000","last_clean":"2023-07-06T22:20:24.745167+0000","last_became_active":"2023-07-06T22:20:23.767870+0000","last_became_peered":"2023-07-06T22:20:23.767870+0000","last_unstale":"2023-07-06T22:20:24.745167+0000","last_undegraded":"2023-07-06T22:20:24.745167+0000","last_fullsized":"2023-07-06T22:20:24.745167+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:59:39.375448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745534+0000","last_change":"2023-07-06T22:20:23.346315+0000","last_active":"2023-07-06T22:20:24.745534+0000","last_peered":"2023-07-06T22:20:24.745534+0000","last_clean":"2023-07-06T22:20:24.745534+0000","last_became_active":"2023-07-06T22:20:23.346033+0000","last_became_peered":"2023-07-06T22:20:23.346033+0000","last_unstale":"2023-07-06T22:20:24.745534+0000","last_undegraded":"2023-07-06T22:20:24.745534+0000","last_fullsized":"2023-07-06T22:20:24.745534+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:57:00.559837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":319,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181892+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:20:25.181892+0000","last_peered":"2023-07-06T22:20:25.181892+0000","last_clean":"2023-07-06T22:20:25.181892+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:20:25.181892+0000","last_undegraded":"2023-07-06T22:20:25.181892+0000","last_fullsized":"2023-07-06T22:20:25.181892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:26:36.323849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183222+0000","last_change":"2023-07-06T22:20:23.773275+0000","last_active":"2023-07-06T22:20:25.183222+0000","last_peered":"2023-07-06T22:20:25.183222+0000","last_clean":"2023-07-06T22:20:25.183222+0000","last_became_active":"2023-07-06T22:20:23.772944+0000","last_became_peered":"2023-07-06T22:20:23.772944+0000","last_unstale":"2023-07-06T22:20:25.183222+0000","last_undegraded":"2023-07-06T22:20:25.183222+0000","last_fullsized":"2023-07-06T22:20:25.183222+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:26:53.681385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183153+0000","last_change":"2023-07-06T22:20:23.354573+0000","last_active":"2023-07-06T22:20:25.183153+0000","last_peered":"2023-07-06T22:20:25.183153+0000","last_clean":"2023-07-06T22:20:25.183153+0000","last_became_active":"2023-07-06T22:20:23.354257+0000","last_became_peered":"2023-07-06T22:20:23.354257+0000","last_unstale":"2023-07-06T22:20:25.183153+0000","last_undegraded":"2023-07-06T22:20:25.183153+0000","last_fullsized":"2023-07-06T22:20:25.183153+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:00:50.318640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":323,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181786+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:20:25.181786+0000","last_peered":"2023-07-06T22:20:25.181786+0000","last_clean":"2023-07-06T22:20:25.181786+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:20:25.181786+0000","last_undegraded":"2023-07-06T22:20:25.181786+0000","last_fullsized":"2023-07-06T22:20:25.181786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:04:42.234271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748737+0000","last_change":"2023-07-06T22:20:23.759434+0000","last_active":"2023-07-06T22:20:24.748737+0000","last_peered":"2023-07-06T22:20:24.748737+0000","last_clean":"2023-07-06T22:20:24.748737+0000","last_became_active":"2023-07-06T22:20:23.758902+0000","last_became_peered":"2023-07-06T22:20:23.758902+0000","last_unstale":"2023-07-06T22:20:24.748737+0000","last_undegraded":"2023-07-06T22:20:24.748737+0000","last_fullsized":"2023-07-06T22:20:24.748737+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:16:31.795071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"195'4","reported_seq":17,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182851+0000","last_change":"2023-07-06T22:20:23.346019+0000","last_active":"2023-07-06T22:20:25.182851+0000","last_peered":"2023-07-06T22:20:25.182851+0000","last_clean":"2023-07-06T22:20:25.182851+0000","last_became_active":"2023-07-06T22:20:23.345707+0000","last_became_peered":"2023-07-06T22:20:23.345707+0000","last_unstale":"2023-07-06T22:20:25.182851+0000","last_undegraded":"2023-07-06T22:20:25.182851+0000","last_fullsized":"2023-07-06T22:20:25.182851+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:49:03.465529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":367,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.746260+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:20:24.746260+0000","last_peered":"2023-07-06T22:20:24.746260+0000","last_clean":"2023-07-06T22:20:24.746260+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:20:24.746260+0000","last_undegraded":"2023-07-06T22:20:24.746260+0000","last_fullsized":"2023-07-06T22:20:24.746260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:31:01.685448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183048+0000","last_change":"2023-07-06T22:20:23.755074+0000","last_active":"2023-07-06T22:20:25.183048+0000","last_peered":"2023-07-06T22:20:25.183048+0000","last_clean":"2023-07-06T22:20:25.183048+0000","last_became_active":"2023-07-06T22:20:23.754809+0000","last_became_peered":"2023-07-06T22:20:23.754809+0000","last_unstale":"2023-07-06T22:20:25.183048+0000","last_undegraded":"2023-07-06T22:20:25.183048+0000","last_fullsized":"2023-07-06T22:20:25.183048+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:38:55.797793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182753+0000","last_change":"2023-07-06T22:20:23.350960+0000","last_active":"2023-07-06T22:20:25.182753+0000","last_peered":"2023-07-06T22:20:25.182753+0000","last_clean":"2023-07-06T22:20:25.182753+0000","last_became_active":"2023-07-06T22:20:23.350674+0000","last_became_peered":"2023-07-06T22:20:23.350674+0000","last_unstale":"2023-07-06T22:20:25.182753+0000","last_undegraded":"2023-07-06T22:20:25.182753+0000","last_fullsized":"2023-07-06T22:20:25.182753+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:51:47.545838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":322,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183155+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:20:25.183155+0000","last_peered":"2023-07-06T22:20:25.183155+0000","last_clean":"2023-07-06T22:20:25.183155+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:20:25.183155+0000","last_undegraded":"2023-07-06T22:20:25.183155+0000","last_fullsized":"2023-07-06T22:20:25.183155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:02:55.910303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745340+0000","last_change":"2023-07-06T22:20:23.754549+0000","last_active":"2023-07-06T22:20:24.745340+0000","last_peered":"2023-07-06T22:20:24.745340+0000","last_clean":"2023-07-06T22:20:24.745340+0000","last_became_active":"2023-07-06T22:20:23.754282+0000","last_became_peered":"2023-07-06T22:20:23.754282+0000","last_unstale":"2023-07-06T22:20:24.745340+0000","last_undegraded":"2023-07-06T22:20:24.745340+0000","last_fullsized":"2023-07-06T22:20:24.745340+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:22:48.599986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182113+0000","last_change":"2023-07-06T22:20:23.351115+0000","last_active":"2023-07-06T22:20:25.182113+0000","last_peered":"2023-07-06T22:20:25.182113+0000","last_clean":"2023-07-06T22:20:25.182113+0000","last_became_active":"2023-07-06T22:20:23.350843+0000","last_became_peered":"2023-07-06T22:20:23.350843+0000","last_unstale":"2023-07-06T22:20:25.182113+0000","last_undegraded":"2023-07-06T22:20:25.182113+0000","last_fullsized":"2023-07-06T22:20:25.182113+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:32.476992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":314,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182984+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:20:25.182984+0000","last_peered":"2023-07-06T22:20:25.182984+0000","last_clean":"2023-07-06T22:20:25.182984+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:20:25.182984+0000","last_undegraded":"2023-07-06T22:20:25.182984+0000","last_fullsized":"2023-07-06T22:20:25.182984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:27:11.900398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575305,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42224,"kb_used_data":2984,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329616,"statfs":{"total":96636764160,"available":96593526784,"internally_reserved":0,"allocated":3055616,"data_stored":1911555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.432},"max":{"1min":0.92100000000000004,"5min":0.93300000000000005,"15min":1.0740000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51600000000000001,"5min":0.45900000000000002,"15min":0.45700000000000002},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.52100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.74199999999999999,"15min":0.72399999999999998},"min":{"1min":0.57699999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.61099999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"max":{"1min":0.96399999999999997,"5min":0.96699999999999997,"15min":1.0149999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73999999999999999,"15min":0.73199999999999998},"min":{"1min":0.53100000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.84099999999999997,"15min":0.78400000000000003},"min":{"1min":0.56200000000000006,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":9.8279999999999994,"15min":9.8279999999999994},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.36799999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73499999999999999,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":2.2610000000000001,"5min":13.443,"15min":13.443},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.52400000000000002,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.76100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575305,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37536,"kb_used_data":2392,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334304,"statfs":{"total":96636764160,"available":96598327296,"internally_reserved":0,"allocated":2449408,"data_stored":1320064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.40300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.7829999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":1.633},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.49199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.9099999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.97799999999999998},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83199999999999996,"5min":0.91100000000000003,"15min":2.0299999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":1.04,"15min":1.5920000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.61099999999999999,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.996},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.69699999999999995,"5min":1.024,"15min":1.024},"last":0.626},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80200000000000005,"5min":0.92600000000000005,"15min":0.996},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":0.89900000000000002,"15min":0.98499999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.85999999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82499999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.624},"min":{"1min":0.54100000000000004,"5min":0.45600000000000002,"15min":0.439},"max":{"1min":0.78400000000000003,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575304,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59684,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312156,"statfs":{"total":96636764160,"available":96575647744,"internally_reserved":0,"allocated":2453504,"data_stored":1321083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.92100000000000004,"5min":0.97199999999999998,"15min":0.999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.628,"5min":0.46999999999999997,"15min":0.46400000000000002},"max":{"1min":0.88400000000000001,"5min":0.995,"15min":0.995},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.52200000000000002,"5min":0.44400000000000001,"15min":0.43099999999999999},"max":{"1min":0.94799999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.60599999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.006,"5min":1.006,"15min":1.3200000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.46300000000000002},"max":{"1min":0.93700000000000006,"5min":0.998,"15min":1.4299999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.749},"min":{"1min":0.56200000000000006,"5min":0.48499999999999999,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":0.999,"15min":1.0409999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.54400000000000004,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":0.996,"15min":1.5169999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.623,"5min":0.51500000000000001,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61599999999999999,"15min":0.61699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.79800000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.86199999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.622,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.998},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.872}]},{"osd":7,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.5,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69799999999999995,"15min":0.69099999999999995},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.81799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575303,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55604,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316236,"statfs":{"total":96636764160,"available":96579825664,"internally_reserved":0,"allocated":2469888,"data_stored":1323229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.42199999999999999},"max":{"1min":0.876,"5min":0.96399999999999997,"15min":0.98999999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":0.97899999999999998,"15min":1.016},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.56899999999999995,"5min":0.47899999999999998,"15min":0.38300000000000001},"max":{"1min":0.93400000000000005,"5min":0.999,"15min":1.0309999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.996},"last":0.748}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.622,"5min":0.54600000000000004,"15min":0.502},"max":{"1min":0.97699999999999998,"5min":0.99399999999999999,"15min":1.0580000000000001},"last":0.97699999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.53500000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.98699999999999999},"last":0.874},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":1.022,"15min":1.03},"last":0.995}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.36599999999999999},"max":{"1min":0.76800000000000002,"5min":0.91200000000000003,"15min":0.92600000000000005},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":0.95599999999999996,"15min":1.006},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.91500000000000004,"15min":1.0509999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.41299999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90300000000000002,"5min":0.94799999999999995,"15min":1.0469999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.432,"15min":0.432},"max":{"1min":0.90200000000000002,"5min":1.0109999999999999,"15min":1.1100000000000001},"last":0.95399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575304,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51504,"kb_used_data":2408,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320336,"statfs":{"total":96636764160,"available":96584024064,"internally_reserved":0,"allocated":2465792,"data_stored":1321277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.27300000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.65800000000000003,"5min":0.68100000000000005,"15min":0.85899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64900000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.27700000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64100000000000001,"5min":0.69799999999999995,"15min":0.83899999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.41299999999999998},"max":{"1min":0.80200000000000005,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64500000000000002,"5min":0.72399999999999998,"15min":0.875},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.77400000000000002},"min":{"1min":0.64100000000000001,"5min":0.53500000000000003,"15min":0.441},"max":{"1min":0.93400000000000005,"5min":1.0449999999999999,"15min":1.474},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79500000000000004,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":0.93400000000000005,"5min":1.0920000000000001,"15min":1.3859999999999999},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.57499999999999996},"max":{"1min":1.085,"5min":1.175,"15min":1.3740000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.68500000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1,"5min":1.0249999999999999,"15min":1.2330000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.58199999999999996,"15min":0.51800000000000002},"max":{"1min":1,"5min":1.1399999999999999,"15min":1.3899999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.57299999999999995},"max":{"1min":1.083,"5min":1.1499999999999999,"15min":1.3220000000000001},"last":0.624}]},{"osd":7,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83899999999999997,"15min":0.82199999999999995},"min":{"1min":0.73199999999999998,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.0649999999999999,"5min":1.1160000000000001,"15min":1.2210000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83799999999999997,"15min":0.82799999999999996},"min":{"1min":0.67500000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0369999999999999,"5min":1.244,"15min":1.3200000000000001},"last":0.69099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575304,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41648,"kb_used_data":2408,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330192,"statfs":{"total":96636764160,"available":96594116608,"internally_reserved":0,"allocated":2465792,"data_stored":1321777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.77000000000000002,"15min":0.78600000000000003},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.42499999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65600000000000003,"5min":0.74099999999999999,"15min":0.84099999999999997},"last":0.371},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.72399999999999998,"5min":0.85099999999999998,"15min":0.97099999999999997},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.63600000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58799999999999997},"min":{"1min":0.46300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"last":0.499}]},{"osd":4,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.66500000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94199999999999995,"5min":1.663,"15min":1.663},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.61099999999999999,"5min":0.54900000000000004,"15min":0.51600000000000001},"max":{"1min":0.94899999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.66000000000000003,"5min":0.55900000000000005,"15min":0.51100000000000001},"max":{"1min":0.90900000000000003,"5min":1.337,"15min":1.337},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80700000000000005,"15min":0.82899999999999996},"min":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0189999999999999,"5min":1.228,"15min":1.2829999999999999},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.996,"5min":1.367,"15min":1.367},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81200000000000006,"15min":0.82999999999999996},"min":{"1min":0.65300000000000002,"5min":0.59999999999999998,"15min":0.56100000000000005},"max":{"1min":0.96499999999999997,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.98099999999999998,"5min":1.407,"15min":1.407},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82099999999999995,"15min":0.83999999999999997},"min":{"1min":0.67200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.024,"5min":1.296,"15min":1.296},"last":0.88300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575305,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59696,"kb_used_data":2408,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312144,"statfs":{"total":96636764160,"available":96575635456,"internally_reserved":0,"allocated":2465792,"data_stored":1322647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.316,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.72599999999999998,"5min":1.645,"15min":1.645},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.72299999999999998,"5min":0.90700000000000003,"15min":0.94299999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.68799999999999994,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.502,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.81699999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79600000000000004,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74299999999999999,"15min":0.77600000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96999999999999997,"5min":1.083,"15min":1.1140000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78700000000000003,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.51700000000000002},"max":{"1min":0.92700000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.627}]},{"osd":5,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.48699999999999999},"max":{"1min":1.012,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79800000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96399999999999997,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95399999999999996,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.56100000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94299999999999995,"5min":1.25,"15min":1.3360000000000001},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81399999999999995,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.56100000000000005},"max":{"1min":0.99199999999999999,"5min":1.155,"15min":1.405},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.61199999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98199999999999998,"5min":1.788,"15min":1.788},"last":0.53200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575304,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38120,"kb_used_data":2976,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333720,"statfs":{"total":96636764160,"available":96597729280,"internally_reserved":0,"allocated":3047424,"data_stored":1910454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.434,"15min":0.46000000000000002},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54200000000000004,"5min":0.745,"15min":0.745},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.312},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.1319999999999999},"last":0.441}]},{"osd":2,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.39600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":1.1599999999999999},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.89200000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.40999999999999998},"max":{"1min":0.71699999999999997,"5min":0.77100000000000002,"15min":0.95399999999999996},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77000000000000002,"15min":0.79600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96299999999999997,"5min":1.1439999999999999,"15min":1.294},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90800000000000003,"5min":1.1000000000000001,"15min":1.3320000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.0569999999999999,"15min":1.345},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.76300000000000001,"15min":0.79600000000000004},"min":{"1min":0.57499999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.56000000000000005,"5min":0.498,"15min":0.47699999999999998},"max":{"1min":0.96699999999999997,"5min":1.0569999999999999,"15min":1.153},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99199999999999999,"5min":1.0840000000000001,"15min":1.272},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.52100000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.26},"last":0.753},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55700000000000005},"max":{"1min":0.97699999999999998,"5min":1.1220000000000001,"15min":1.2350000000000001},"last":0.73299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:20:32.807 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:20:32.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.959+0000 7ff6e7e34640 1 Processor -- start 2023-07-06T22:20:32.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.959+0000 7ff6e7e34640 1 -- start start 2023-07-06T22:20:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.963+0000 7ff6e7e34640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff6e00cd330 0x7ff6e00cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.963+0000 7ff6e7e34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e006bd00 con 0x7ff6e00cbce0 2023-07-06T22:20:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.963+0000 7ff6e7e34640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e00c9ba0 con 0x7ff6e0160030 2023-07-06T22:20:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.963+0000 7ff6e7e34640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e0160400 con 0x7ff6e00cd330 2023-07-06T22:20:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.963+0000 7ff6e63d1640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff6e00cbce0 0x7ff6e00cc120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41900/0 (socket says 172.21.15.55:41900) 2023-07-06T22:20:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.963+0000 7ff6e63d1640 1 -- 172.21.15.55:0/984398887 learned_addr learned my addr 172.21.15.55:0/984398887 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.963+0000 7ff6e53cf640 1 --2- 172.21.15.55:0/984398887 >> v2:172.21.15.138:3300/0 conn(0x7ff6e00cd330 0x7ff6e00cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.963+0000 7ff6e4bce640 1 -- 172.21.15.55:0/984398887 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309547557 0 0) 0x7ff6e006bd00 con 0x7ff6e00cbce0 2023-07-06T22:20:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.963+0000 7ff6e4bce640 1 -- 172.21.15.55:0/984398887 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6cc003530 con 0x7ff6e00cbce0 2023-07-06T22:20:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.963+0000 7ff6e53cf640 1 -- 172.21.15.55:0/984398887 >> v1:172.21.15.138:6789/0 conn(0x7ff6e0160030 legacy=0x7ff6e0070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.963+0000 7ff6e53cf640 1 -- 172.21.15.55:0/984398887 >> v1:172.21.15.55:6789/0 conn(0x7ff6e00cbce0 legacy=0x7ff6e00cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.963+0000 7ff6e53cf640 1 -- 172.21.15.55:0/984398887 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0071540 con 0x7ff6e00cd330 2023-07-06T22:20:32.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e53cf640 1 --2- 172.21.15.55:0/984398887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e00cd330 0x7ff6e00cd7a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00097c0 tx=0x7ff6d001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5a5b7018e90db9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e4bce640 1 -- 172.21.15.55:0/984398887 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d00ab600 con 0x7ff6e00cd330 2023-07-06T22:20:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e4bce640 1 -- 172.21.15.55:0/984398887 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d00a7050 con 0x7ff6e00cd330 2023-07-06T22:20:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e4bce640 1 -- 172.21.15.55:0/984398887 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d00ab980 con 0x7ff6e00cd330 2023-07-06T22:20:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 -- 172.21.15.55:0/984398887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e00cd330 msgr2=0x7ff6e00cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 --2- 172.21.15.55:0/984398887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e00cd330 0x7ff6e00cd7a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00097c0 tx=0x7ff6d001c480 comp rx=0 tx=0).stop 2023-07-06T22:20:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 -- 172.21.15.55:0/984398887 shutdown_connections 2023-07-06T22:20:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 --2- 172.21.15.55:0/984398887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e00cd330 0x7ff6e00cd7a0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 -- 172.21.15.55:0/984398887 >> 172.21.15.55:0/984398887 conn(0x7ff6e00cded0 msgr2=0x7ff6e00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 -- 172.21.15.55:0/984398887 shutdown_connections 2023-07-06T22:20:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 -- 172.21.15.55:0/984398887 wait complete. 2023-07-06T22:20:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 Processor -- start 2023-07-06T22:20:32.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 -- start start 2023-07-06T22:20:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e00cbce0 0x7ff6e0160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e00cd330 0x7ff6e006fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6e0160030 0x7ff6e006ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e0151560 con 0x7ff6e00cbce0 2023-07-06T22:20:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e014f1a0 con 0x7ff6e00cd330 2023-07-06T22:20:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.967+0000 7ff6e7e34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e0163480 con 0x7ff6e0160030 2023-07-06T22:20:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6e5bd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e00cbce0 0x7ff6e0160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6e5bd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e00cbce0 0x7ff6e0160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44714/0 (socket says 172.21.15.55:44714) 2023-07-06T22:20:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6e5bd0640 1 -- 172.21.15.55:0/1456347252 learned_addr learned my addr 172.21.15.55:0/1456347252 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6e53cf640 1 --2- 172.21.15.55:0/1456347252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e00cd330 0x7ff6e006fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6e63d1640 1 --2- 172.21.15.55:0/1456347252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6e0160030 0x7ff6e006ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6e5bd0640 1 -- 172.21.15.55:0/1456347252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6e0160030 msgr2=0x7ff6e006ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6e5bd0640 1 --2- 172.21.15.55:0/1456347252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6e0160030 0x7ff6e006ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6e5bd0640 1 -- 172.21.15.55:0/1456347252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e00cd330 msgr2=0x7ff6e006fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6e5bd0640 1 --2- 172.21.15.55:0/1456347252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e00cd330 0x7ff6e006fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6e5bd0640 1 -- 172.21.15.55:0/1456347252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d0009420 con 0x7ff6e00cbce0 2023-07-06T22:20:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6e5bd0640 1 --2- 172.21.15.55:0/1456347252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e00cbce0 0x7ff6e0160540 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00c3f0 tx=0x7ff6dc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6d67fc640 1 -- 172.21.15.55:0/1456347252 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0052d0 con 0x7ff6e00cbce0 2023-07-06T22:20:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6d67fc640 1 -- 172.21.15.55:0/1456347252 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc005430 con 0x7ff6e00cbce0 2023-07-06T22:20:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6d67fc640 1 -- 172.21.15.55:0/1456347252 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc003840 con 0x7ff6e00cbce0 2023-07-06T22:20:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6e7e34640 1 -- 172.21.15.55:0/1456347252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e0162c50 con 0x7ff6e00cbce0 2023-07-06T22:20:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6e7e34640 1 -- 172.21.15.55:0/1456347252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e01631a0 con 0x7ff6e00cbce0 2023-07-06T22:20:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6e7e34640 1 -- 172.21.15.55:0/1456347252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e014ef70 con 0x7ff6e00cbce0 2023-07-06T22:20:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.971+0000 7ff6d67fc640 1 -- 172.21.15.55:0/1456347252 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff6dc0039a0 con 0x7ff6e00cbce0 2023-07-06T22:20:32.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.975+0000 7ff6d67fc640 1 --2- 172.21.15.55:0/1456347252 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff6c40663a0 0x7ff6c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:32.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.975+0000 7ff6d67fc640 1 -- 172.21.15.55:0/1456347252 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff6dc083640 con 0x7ff6e00cbce0 2023-07-06T22:20:32.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.975+0000 7ff6e53cf640 1 --2- 172.21.15.55:0/1456347252 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff6c40663a0 0x7ff6c4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:32.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.975+0000 7ff6e53cf640 1 --2- 172.21.15.55:0/1456347252 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff6c40663a0 0x7ff6c4068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00ad000 tx=0x7ff6d0008040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:32.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:32.979+0000 7ff6d67fc640 1 -- 172.21.15.55:0/1456347252 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff6e014ef70 con 0x7ff6e00cbce0 2023-07-06T22:20:33.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.143+0000 7ff6e7e34640 1 -- 172.21.15.55:0/1456347252 --> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6e0071220 con 0x7ff6c40663a0 2023-07-06T22:20:33.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.151+0000 7ff6d67fc640 1 -- 172.21.15.55:0/1456347252 <== mgr.10752 v2:172.21.15.55:6832/538997467 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312026 (secure 0 0 0) 0x7ff6d00ab780 con 0x7ff6c40663a0 2023-07-06T22:20:33.158 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:33.159 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:20:33.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.155+0000 7ff6e7e34640 1 -- 172.21.15.55:0/1456347252 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff6c40663a0 msgr2=0x7ff6c4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:33.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.155+0000 7ff6e7e34640 1 --2- 172.21.15.55:0/1456347252 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff6c40663a0 0x7ff6c4068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00ad000 tx=0x7ff6d0008040 comp rx=0 tx=0).stop 2023-07-06T22:20:33.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.155+0000 7ff6e7e34640 1 -- 172.21.15.55:0/1456347252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e00cbce0 msgr2=0x7ff6e0160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:33.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.155+0000 7ff6e7e34640 1 --2- 172.21.15.55:0/1456347252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e00cbce0 0x7ff6e0160540 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00c3f0 tx=0x7ff6dc00c8b0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.155+0000 7ff6e7e34640 1 -- 172.21.15.55:0/1456347252 shutdown_connections 2023-07-06T22:20:33.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.155+0000 7ff6e7e34640 1 --2- 172.21.15.55:0/1456347252 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff6c40663a0 0x7ff6c4068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.155+0000 7ff6e7e34640 1 --2- 172.21.15.55:0/1456347252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6e0160030 0x7ff6e006ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.155+0000 7ff6e7e34640 1 --2- 172.21.15.55:0/1456347252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e00cd330 0x7ff6e006fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.155+0000 7ff6e7e34640 1 --2- 172.21.15.55:0/1456347252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e00cbce0 0x7ff6e0160540 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.155+0000 7ff6e7e34640 1 -- 172.21.15.55:0/1456347252 >> 172.21.15.55:0/1456347252 conn(0x7ff6e00cded0 msgr2=0x7ff6e015b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:33.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.155+0000 7ff6e7e34640 1 -- 172.21.15.55:0/1456347252 shutdown_connections 2023-07-06T22:20:33.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.155+0000 7ff6e7e34640 1 -- 172.21.15.55:0/1456347252 wait complete. 2023-07-06T22:20:33.178 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-06T22:20:31.201152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":583,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":193,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":386016,"kb_used_data":20384,"kb_used_omap":0,"kb_used_meta":365568,"kb_avail":754588704,"statfs":{"total":773094113280,"available":772698832896,"internally_reserved":0,"allocated":20873216,"data_stored":11752086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":374341632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.873463"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.746283+0000","last_change":"2023-07-06T22:20:23.765408+0000","last_active":"2023-07-06T22:20:24.746283+0000","last_peered":"2023-07-06T22:20:24.746283+0000","last_clean":"2023-07-06T22:20:24.746283+0000","last_became_active":"2023-07-06T22:20:23.765107+0000","last_became_peered":"2023-07-06T22:20:23.765107+0000","last_unstale":"2023-07-06T22:20:24.746283+0000","last_undegraded":"2023-07-06T22:20:24.746283+0000","last_fullsized":"2023-07-06T22:20:24.746283+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:10:44.166168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182578+0000","last_change":"2023-07-06T22:20:23.758299+0000","last_active":"2023-07-06T22:20:25.182578+0000","last_peered":"2023-07-06T22:20:25.182578+0000","last_clean":"2023-07-06T22:20:25.182578+0000","last_became_active":"2023-07-06T22:20:23.758005+0000","last_became_peered":"2023-07-06T22:20:23.758005+0000","last_unstale":"2023-07-06T22:20:25.182578+0000","last_undegraded":"2023-07-06T22:20:25.182578+0000","last_fullsized":"2023-07-06T22:20:25.182578+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:22:08.513210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181910+0000","last_change":"2023-07-06T22:20:23.756346+0000","last_active":"2023-07-06T22:20:25.181910+0000","last_peered":"2023-07-06T22:20:25.181910+0000","last_clean":"2023-07-06T22:20:25.181910+0000","last_became_active":"2023-07-06T22:20:23.756094+0000","last_became_peered":"2023-07-06T22:20:23.756094+0000","last_unstale":"2023-07-06T22:20:25.181910+0000","last_undegraded":"2023-07-06T22:20:25.181910+0000","last_fullsized":"2023-07-06T22:20:25.181910+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:42:24.619716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182642+0000","last_change":"2023-07-06T22:20:23.758335+0000","last_active":"2023-07-06T22:20:25.182642+0000","last_peered":"2023-07-06T22:20:25.182642+0000","last_clean":"2023-07-06T22:20:25.182642+0000","last_became_active":"2023-07-06T22:20:23.758021+0000","last_became_peered":"2023-07-06T22:20:23.758021+0000","last_unstale":"2023-07-06T22:20:25.182642+0000","last_undegraded":"2023-07-06T22:20:25.182642+0000","last_fullsized":"2023-07-06T22:20:25.182642+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:09:38.220294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182628+0000","last_change":"2023-07-06T22:20:23.754397+0000","last_active":"2023-07-06T22:20:25.182628+0000","last_peered":"2023-07-06T22:20:25.182628+0000","last_clean":"2023-07-06T22:20:25.182628+0000","last_became_active":"2023-07-06T22:20:23.753982+0000","last_became_peered":"2023-07-06T22:20:23.753982+0000","last_unstale":"2023-07-06T22:20:25.182628+0000","last_undegraded":"2023-07-06T22:20:25.182628+0000","last_fullsized":"2023-07-06T22:20:25.182628+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:18:23.667068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181629+0000","last_change":"2023-07-06T22:20:23.772660+0000","last_active":"2023-07-06T22:20:25.181629+0000","last_peered":"2023-07-06T22:20:25.181629+0000","last_clean":"2023-07-06T22:20:25.181629+0000","last_became_active":"2023-07-06T22:20:23.772371+0000","last_became_peered":"2023-07-06T22:20:23.772371+0000","last_unstale":"2023-07-06T22:20:25.181629+0000","last_undegraded":"2023-07-06T22:20:25.181629+0000","last_fullsized":"2023-07-06T22:20:25.181629+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:28:44.880931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745066+0000","last_change":"2023-07-06T22:20:23.767778+0000","last_active":"2023-07-06T22:20:24.745066+0000","last_peered":"2023-07-06T22:20:24.745066+0000","last_clean":"2023-07-06T22:20:24.745066+0000","last_became_active":"2023-07-06T22:20:23.766068+0000","last_became_peered":"2023-07-06T22:20:23.766068+0000","last_unstale":"2023-07-06T22:20:24.745066+0000","last_undegraded":"2023-07-06T22:20:24.745066+0000","last_fullsized":"2023-07-06T22:20:24.745066+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:48:12.750477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748247+0000","last_change":"2023-07-06T22:20:23.761392+0000","last_active":"2023-07-06T22:20:24.748247+0000","last_peered":"2023-07-06T22:20:24.748247+0000","last_clean":"2023-07-06T22:20:24.748247+0000","last_became_active":"2023-07-06T22:20:23.760961+0000","last_became_peered":"2023-07-06T22:20:23.760961+0000","last_unstale":"2023-07-06T22:20:24.748247+0000","last_undegraded":"2023-07-06T22:20:24.748247+0000","last_fullsized":"2023-07-06T22:20:24.748247+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:00:57.950236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182974+0000","last_change":"2023-07-06T22:20:23.758557+0000","last_active":"2023-07-06T22:20:25.182974+0000","last_peered":"2023-07-06T22:20:25.182974+0000","last_clean":"2023-07-06T22:20:25.182974+0000","last_became_active":"2023-07-06T22:20:23.758290+0000","last_became_peered":"2023-07-06T22:20:23.758290+0000","last_unstale":"2023-07-06T22:20:25.182974+0000","last_undegraded":"2023-07-06T22:20:25.182974+0000","last_fullsized":"2023-07-06T22:20:25.182974+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:09:01.145267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182625+0000","last_change":"2023-07-06T22:20:23.759284+0000","last_active":"2023-07-06T22:20:25.182625+0000","last_peered":"2023-07-06T22:20:25.182625+0000","last_clean":"2023-07-06T22:20:25.182625+0000","last_became_active":"2023-07-06T22:20:23.759059+0000","last_became_peered":"2023-07-06T22:20:23.759059+0000","last_unstale":"2023-07-06T22:20:25.182625+0000","last_undegraded":"2023-07-06T22:20:25.182625+0000","last_fullsized":"2023-07-06T22:20:25.182625+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:24:55.434381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745667+0000","last_change":"2023-07-06T22:20:23.772819+0000","last_active":"2023-07-06T22:20:24.745667+0000","last_peered":"2023-07-06T22:20:24.745667+0000","last_clean":"2023-07-06T22:20:24.745667+0000","last_became_active":"2023-07-06T22:20:23.772517+0000","last_became_peered":"2023-07-06T22:20:23.772517+0000","last_unstale":"2023-07-06T22:20:24.745667+0000","last_undegraded":"2023-07-06T22:20:24.745667+0000","last_fullsized":"2023-07-06T22:20:24.745667+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:43:51.157228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182796+0000","last_change":"2023-07-06T22:20:23.757748+0000","last_active":"2023-07-06T22:20:25.182796+0000","last_peered":"2023-07-06T22:20:25.182796+0000","last_clean":"2023-07-06T22:20:25.182796+0000","last_became_active":"2023-07-06T22:20:23.757207+0000","last_became_peered":"2023-07-06T22:20:23.757207+0000","last_unstale":"2023-07-06T22:20:25.182796+0000","last_undegraded":"2023-07-06T22:20:25.182796+0000","last_fullsized":"2023-07-06T22:20:25.182796+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:50:49.832816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182480+0000","last_change":"2023-07-06T22:20:23.752766+0000","last_active":"2023-07-06T22:20:25.182480+0000","last_peered":"2023-07-06T22:20:25.182480+0000","last_clean":"2023-07-06T22:20:25.182480+0000","last_became_active":"2023-07-06T22:20:23.749484+0000","last_became_peered":"2023-07-06T22:20:23.749484+0000","last_unstale":"2023-07-06T22:20:25.182480+0000","last_undegraded":"2023-07-06T22:20:25.182480+0000","last_fullsized":"2023-07-06T22:20:25.182480+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:42:58.673546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181777+0000","last_change":"2023-07-06T22:20:23.773432+0000","last_active":"2023-07-06T22:20:25.181777+0000","last_peered":"2023-07-06T22:20:25.181777+0000","last_clean":"2023-07-06T22:20:25.181777+0000","last_became_active":"2023-07-06T22:20:23.773162+0000","last_became_peered":"2023-07-06T22:20:23.773162+0000","last_unstale":"2023-07-06T22:20:25.181777+0000","last_undegraded":"2023-07-06T22:20:25.181777+0000","last_fullsized":"2023-07-06T22:20:25.181777+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:04:20.182124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182410+0000","last_change":"2023-07-06T22:20:23.754862+0000","last_active":"2023-07-06T22:20:25.182410+0000","last_peered":"2023-07-06T22:20:25.182410+0000","last_clean":"2023-07-06T22:20:25.182410+0000","last_became_active":"2023-07-06T22:20:23.754589+0000","last_became_peered":"2023-07-06T22:20:23.754589+0000","last_unstale":"2023-07-06T22:20:25.182410+0000","last_undegraded":"2023-07-06T22:20:25.182410+0000","last_fullsized":"2023-07-06T22:20:25.182410+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:35:45.476373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748399+0000","last_change":"2023-07-06T22:20:23.761220+0000","last_active":"2023-07-06T22:20:24.748399+0000","last_peered":"2023-07-06T22:20:24.748399+0000","last_clean":"2023-07-06T22:20:24.748399+0000","last_became_active":"2023-07-06T22:20:23.760623+0000","last_became_peered":"2023-07-06T22:20:23.760623+0000","last_unstale":"2023-07-06T22:20:24.748399+0000","last_undegraded":"2023-07-06T22:20:24.748399+0000","last_fullsized":"2023-07-06T22:20:24.748399+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:44:12.295857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182760+0000","last_change":"2023-07-06T22:20:23.757070+0000","last_active":"2023-07-06T22:20:25.182760+0000","last_peered":"2023-07-06T22:20:25.182760+0000","last_clean":"2023-07-06T22:20:25.182760+0000","last_became_active":"2023-07-06T22:20:23.756455+0000","last_became_peered":"2023-07-06T22:20:23.756455+0000","last_unstale":"2023-07-06T22:20:25.182760+0000","last_undegraded":"2023-07-06T22:20:25.182760+0000","last_fullsized":"2023-07-06T22:20:25.182760+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:22:14.875189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.746208+0000","last_change":"2023-07-06T22:20:23.754859+0000","last_active":"2023-07-06T22:20:24.746208+0000","last_peered":"2023-07-06T22:20:24.746208+0000","last_clean":"2023-07-06T22:20:24.746208+0000","last_became_active":"2023-07-06T22:20:23.754358+0000","last_became_peered":"2023-07-06T22:20:23.754358+0000","last_unstale":"2023-07-06T22:20:24.746208+0000","last_undegraded":"2023-07-06T22:20:24.746208+0000","last_fullsized":"2023-07-06T22:20:24.746208+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:34:53.906079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182634+0000","last_change":"2023-07-06T22:20:23.763856+0000","last_active":"2023-07-06T22:20:25.182634+0000","last_peered":"2023-07-06T22:20:25.182634+0000","last_clean":"2023-07-06T22:20:25.182634+0000","last_became_active":"2023-07-06T22:20:23.763590+0000","last_became_peered":"2023-07-06T22:20:23.763590+0000","last_unstale":"2023-07-06T22:20:25.182634+0000","last_undegraded":"2023-07-06T22:20:25.182634+0000","last_fullsized":"2023-07-06T22:20:25.182634+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:12:30.678255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182582+0000","last_change":"2023-07-06T22:20:23.754963+0000","last_active":"2023-07-06T22:20:25.182582+0000","last_peered":"2023-07-06T22:20:25.182582+0000","last_clean":"2023-07-06T22:20:25.182582+0000","last_became_active":"2023-07-06T22:20:23.754697+0000","last_became_peered":"2023-07-06T22:20:23.754697+0000","last_unstale":"2023-07-06T22:20:25.182582+0000","last_undegraded":"2023-07-06T22:20:25.182582+0000","last_fullsized":"2023-07-06T22:20:25.182582+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:52:13.942041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182766+0000","last_change":"2023-07-06T22:20:23.754231+0000","last_active":"2023-07-06T22:20:25.182766+0000","last_peered":"2023-07-06T22:20:25.182766+0000","last_clean":"2023-07-06T22:20:25.182766+0000","last_became_active":"2023-07-06T22:20:23.753642+0000","last_became_peered":"2023-07-06T22:20:23.753642+0000","last_unstale":"2023-07-06T22:20:25.182766+0000","last_undegraded":"2023-07-06T22:20:25.182766+0000","last_fullsized":"2023-07-06T22:20:25.182766+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:17:47.774731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182149+0000","last_change":"2023-07-06T22:20:23.768772+0000","last_active":"2023-07-06T22:20:25.182149+0000","last_peered":"2023-07-06T22:20:25.182149+0000","last_clean":"2023-07-06T22:20:25.182149+0000","last_became_active":"2023-07-06T22:20:23.768314+0000","last_became_peered":"2023-07-06T22:20:23.768314+0000","last_unstale":"2023-07-06T22:20:25.182149+0000","last_undegraded":"2023-07-06T22:20:25.182149+0000","last_fullsized":"2023-07-06T22:20:25.182149+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:39:04.671912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181560+0000","last_change":"2023-07-06T22:20:23.774280+0000","last_active":"2023-07-06T22:20:25.181560+0000","last_peered":"2023-07-06T22:20:25.181560+0000","last_clean":"2023-07-06T22:20:25.181560+0000","last_became_active":"2023-07-06T22:20:23.774017+0000","last_became_peered":"2023-07-06T22:20:23.774017+0000","last_unstale":"2023-07-06T22:20:25.181560+0000","last_undegraded":"2023-07-06T22:20:25.181560+0000","last_fullsized":"2023-07-06T22:20:25.181560+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:07:39.984448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748535+0000","last_change":"2023-07-06T22:20:23.755666+0000","last_active":"2023-07-06T22:20:24.748535+0000","last_peered":"2023-07-06T22:20:24.748535+0000","last_clean":"2023-07-06T22:20:24.748535+0000","last_became_active":"2023-07-06T22:20:23.755400+0000","last_became_peered":"2023-07-06T22:20:23.755400+0000","last_unstale":"2023-07-06T22:20:24.748535+0000","last_undegraded":"2023-07-06T22:20:24.748535+0000","last_fullsized":"2023-07-06T22:20:24.748535+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:41:28.215423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182916+0000","last_change":"2023-07-06T22:20:23.765384+0000","last_active":"2023-07-06T22:20:25.182916+0000","last_peered":"2023-07-06T22:20:25.182916+0000","last_clean":"2023-07-06T22:20:25.182916+0000","last_became_active":"2023-07-06T22:20:23.765102+0000","last_became_peered":"2023-07-06T22:20:23.765102+0000","last_unstale":"2023-07-06T22:20:25.182916+0000","last_undegraded":"2023-07-06T22:20:25.182916+0000","last_fullsized":"2023-07-06T22:20:25.182916+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:00:04.261734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745302+0000","last_change":"2023-07-06T22:20:23.766246+0000","last_active":"2023-07-06T22:20:24.745302+0000","last_peered":"2023-07-06T22:20:24.745302+0000","last_clean":"2023-07-06T22:20:24.745302+0000","last_became_active":"2023-07-06T22:20:23.765964+0000","last_became_peered":"2023-07-06T22:20:23.765964+0000","last_unstale":"2023-07-06T22:20:24.745302+0000","last_undegraded":"2023-07-06T22:20:24.745302+0000","last_fullsized":"2023-07-06T22:20:24.745302+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:55.329317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182029+0000","last_change":"2023-07-06T22:20:23.766747+0000","last_active":"2023-07-06T22:20:25.182029+0000","last_peered":"2023-07-06T22:20:25.182029+0000","last_clean":"2023-07-06T22:20:25.182029+0000","last_became_active":"2023-07-06T22:20:23.766442+0000","last_became_peered":"2023-07-06T22:20:23.766442+0000","last_unstale":"2023-07-06T22:20:25.182029+0000","last_undegraded":"2023-07-06T22:20:25.182029+0000","last_fullsized":"2023-07-06T22:20:25.182029+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:15.101449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182729+0000","last_change":"2023-07-06T22:20:23.765723+0000","last_active":"2023-07-06T22:20:25.182729+0000","last_peered":"2023-07-06T22:20:25.182729+0000","last_clean":"2023-07-06T22:20:25.182729+0000","last_became_active":"2023-07-06T22:20:23.765397+0000","last_became_peered":"2023-07-06T22:20:23.765397+0000","last_unstale":"2023-07-06T22:20:25.182729+0000","last_undegraded":"2023-07-06T22:20:25.182729+0000","last_fullsized":"2023-07-06T22:20:25.182729+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:33:14.742052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182833+0000","last_change":"2023-07-06T22:20:23.755399+0000","last_active":"2023-07-06T22:20:25.182833+0000","last_peered":"2023-07-06T22:20:25.182833+0000","last_clean":"2023-07-06T22:20:25.182833+0000","last_became_active":"2023-07-06T22:20:23.755137+0000","last_became_peered":"2023-07-06T22:20:23.755137+0000","last_unstale":"2023-07-06T22:20:25.182833+0000","last_undegraded":"2023-07-06T22:20:25.182833+0000","last_fullsized":"2023-07-06T22:20:25.182833+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:59:32.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181794+0000","last_change":"2023-07-06T22:20:23.766634+0000","last_active":"2023-07-06T22:20:25.181794+0000","last_peered":"2023-07-06T22:20:25.181794+0000","last_clean":"2023-07-06T22:20:25.181794+0000","last_became_active":"2023-07-06T22:20:23.766255+0000","last_became_peered":"2023-07-06T22:20:23.766255+0000","last_unstale":"2023-07-06T22:20:25.181794+0000","last_undegraded":"2023-07-06T22:20:25.181794+0000","last_fullsized":"2023-07-06T22:20:25.181794+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:33.488638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181615+0000","last_change":"2023-07-06T22:20:23.759918+0000","last_active":"2023-07-06T22:20:25.181615+0000","last_peered":"2023-07-06T22:20:25.181615+0000","last_clean":"2023-07-06T22:20:25.181615+0000","last_became_active":"2023-07-06T22:20:23.759632+0000","last_became_peered":"2023-07-06T22:20:23.759632+0000","last_unstale":"2023-07-06T22:20:25.181615+0000","last_undegraded":"2023-07-06T22:20:25.181615+0000","last_fullsized":"2023-07-06T22:20:25.181615+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:08:59.353493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182390+0000","last_change":"2023-07-06T22:20:23.753404+0000","last_active":"2023-07-06T22:20:25.182390+0000","last_peered":"2023-07-06T22:20:25.182390+0000","last_clean":"2023-07-06T22:20:25.182390+0000","last_became_active":"2023-07-06T22:20:23.753105+0000","last_became_peered":"2023-07-06T22:20:23.753105+0000","last_unstale":"2023-07-06T22:20:25.182390+0000","last_undegraded":"2023-07-06T22:20:25.182390+0000","last_fullsized":"2023-07-06T22:20:25.182390+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:35:07.103802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182049+0000","last_change":"2023-07-06T22:20:23.760670+0000","last_active":"2023-07-06T22:20:25.182049+0000","last_peered":"2023-07-06T22:20:25.182049+0000","last_clean":"2023-07-06T22:20:25.182049+0000","last_became_active":"2023-07-06T22:20:23.760391+0000","last_became_peered":"2023-07-06T22:20:23.760391+0000","last_unstale":"2023-07-06T22:20:25.182049+0000","last_undegraded":"2023-07-06T22:20:25.182049+0000","last_fullsized":"2023-07-06T22:20:25.182049+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:04:20.182124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745565+0000","last_change":"2023-07-06T22:20:23.353207+0000","last_active":"2023-07-06T22:20:24.745565+0000","last_peered":"2023-07-06T22:20:24.745565+0000","last_clean":"2023-07-06T22:20:24.745565+0000","last_became_active":"2023-07-06T22:20:23.352540+0000","last_became_peered":"2023-07-06T22:20:23.352540+0000","last_unstale":"2023-07-06T22:20:24.745565+0000","last_undegraded":"2023-07-06T22:20:24.745565+0000","last_fullsized":"2023-07-06T22:20:24.745565+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:27:18.568497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748761+0000","last_change":"2023-07-06T22:20:23.768158+0000","last_active":"2023-07-06T22:20:24.748761+0000","last_peered":"2023-07-06T22:20:24.748761+0000","last_clean":"2023-07-06T22:20:24.748761+0000","last_became_active":"2023-07-06T22:20:23.767874+0000","last_became_peered":"2023-07-06T22:20:23.767874+0000","last_unstale":"2023-07-06T22:20:24.748761+0000","last_undegraded":"2023-07-06T22:20:24.748761+0000","last_fullsized":"2023-07-06T22:20:24.748761+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:45:36.614200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182643+0000","last_change":"2023-07-06T22:20:23.345574+0000","last_active":"2023-07-06T22:20:25.182643+0000","last_peered":"2023-07-06T22:20:25.182643+0000","last_clean":"2023-07-06T22:20:25.182643+0000","last_became_active":"2023-07-06T22:20:23.345312+0000","last_became_peered":"2023-07-06T22:20:23.345312+0000","last_unstale":"2023-07-06T22:20:25.182643+0000","last_undegraded":"2023-07-06T22:20:25.182643+0000","last_fullsized":"2023-07-06T22:20:25.182643+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:50:08.142045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745581+0000","last_change":"2023-07-06T22:20:23.758242+0000","last_active":"2023-07-06T22:20:24.745581+0000","last_peered":"2023-07-06T22:20:24.745581+0000","last_clean":"2023-07-06T22:20:24.745581+0000","last_became_active":"2023-07-06T22:20:23.757937+0000","last_became_peered":"2023-07-06T22:20:23.757937+0000","last_unstale":"2023-07-06T22:20:24.745581+0000","last_undegraded":"2023-07-06T22:20:24.745581+0000","last_fullsized":"2023-07-06T22:20:24.745581+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:36:42.152977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"195'3","reported_seq":16,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182339+0000","last_change":"2023-07-06T22:20:23.342155+0000","last_active":"2023-07-06T22:20:25.182339+0000","last_peered":"2023-07-06T22:20:25.182339+0000","last_clean":"2023-07-06T22:20:25.182339+0000","last_became_active":"2023-07-06T22:20:23.341848+0000","last_became_peered":"2023-07-06T22:20:23.341848+0000","last_unstale":"2023-07-06T22:20:25.182339+0000","last_undegraded":"2023-07-06T22:20:25.182339+0000","last_fullsized":"2023-07-06T22:20:25.182339+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:25:26.675144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182759+0000","last_change":"2023-07-06T22:20:23.768272+0000","last_active":"2023-07-06T22:20:25.182759+0000","last_peered":"2023-07-06T22:20:25.182759+0000","last_clean":"2023-07-06T22:20:25.182759+0000","last_became_active":"2023-07-06T22:20:23.768005+0000","last_became_peered":"2023-07-06T22:20:23.768005+0000","last_unstale":"2023-07-06T22:20:25.182759+0000","last_undegraded":"2023-07-06T22:20:25.182759+0000","last_fullsized":"2023-07-06T22:20:25.182759+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:43:03.993702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"195'6","reported_seq":19,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181629+0000","last_change":"2023-07-06T22:20:23.352200+0000","last_active":"2023-07-06T22:20:25.181629+0000","last_peered":"2023-07-06T22:20:25.181629+0000","last_clean":"2023-07-06T22:20:25.181629+0000","last_became_active":"2023-07-06T22:20:23.351926+0000","last_became_peered":"2023-07-06T22:20:23.351926+0000","last_unstale":"2023-07-06T22:20:25.181629+0000","last_undegraded":"2023-07-06T22:20:25.181629+0000","last_fullsized":"2023-07-06T22:20:25.181629+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:56:55.305047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181773+0000","last_change":"2023-07-06T22:20:23.773635+0000","last_active":"2023-07-06T22:20:25.181773+0000","last_peered":"2023-07-06T22:20:25.181773+0000","last_clean":"2023-07-06T22:20:25.181773+0000","last_became_active":"2023-07-06T22:20:23.773351+0000","last_became_peered":"2023-07-06T22:20:23.773351+0000","last_unstale":"2023-07-06T22:20:25.181773+0000","last_undegraded":"2023-07-06T22:20:25.181773+0000","last_fullsized":"2023-07-06T22:20:25.181773+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:30:10.921402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.746005+0000","last_change":"2023-07-06T22:20:23.345470+0000","last_active":"2023-07-06T22:20:24.746005+0000","last_peered":"2023-07-06T22:20:24.746005+0000","last_clean":"2023-07-06T22:20:24.746005+0000","last_became_active":"2023-07-06T22:20:23.345178+0000","last_became_peered":"2023-07-06T22:20:23.345178+0000","last_unstale":"2023-07-06T22:20:24.746005+0000","last_undegraded":"2023-07-06T22:20:24.746005+0000","last_fullsized":"2023-07-06T22:20:24.746005+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:22:25.730754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745781+0000","last_change":"2023-07-06T22:20:23.764909+0000","last_active":"2023-07-06T22:20:24.745781+0000","last_peered":"2023-07-06T22:20:24.745781+0000","last_clean":"2023-07-06T22:20:24.745781+0000","last_became_active":"2023-07-06T22:20:23.764608+0000","last_became_peered":"2023-07-06T22:20:23.764608+0000","last_unstale":"2023-07-06T22:20:24.745781+0000","last_undegraded":"2023-07-06T22:20:24.745781+0000","last_fullsized":"2023-07-06T22:20:24.745781+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:41.402377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182380+0000","last_change":"2023-07-06T22:20:23.353648+0000","last_active":"2023-07-06T22:20:25.182380+0000","last_peered":"2023-07-06T22:20:25.182380+0000","last_clean":"2023-07-06T22:20:25.182380+0000","last_became_active":"2023-07-06T22:20:23.353358+0000","last_became_peered":"2023-07-06T22:20:23.353358+0000","last_unstale":"2023-07-06T22:20:25.182380+0000","last_undegraded":"2023-07-06T22:20:25.182380+0000","last_fullsized":"2023-07-06T22:20:25.182380+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:15:55.854172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181754+0000","last_change":"2023-07-06T22:20:23.768454+0000","last_active":"2023-07-06T22:20:25.181754+0000","last_peered":"2023-07-06T22:20:25.181754+0000","last_clean":"2023-07-06T22:20:25.181754+0000","last_became_active":"2023-07-06T22:20:23.768153+0000","last_became_peered":"2023-07-06T22:20:23.768153+0000","last_unstale":"2023-07-06T22:20:25.181754+0000","last_undegraded":"2023-07-06T22:20:25.181754+0000","last_fullsized":"2023-07-06T22:20:25.181754+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:03:15.101449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748108+0000","last_change":"2023-07-06T22:20:23.347816+0000","last_active":"2023-07-06T22:20:24.748108+0000","last_peered":"2023-07-06T22:20:24.748108+0000","last_clean":"2023-07-06T22:20:24.748108+0000","last_became_active":"2023-07-06T22:20:23.347507+0000","last_became_peered":"2023-07-06T22:20:23.347507+0000","last_unstale":"2023-07-06T22:20:24.748108+0000","last_undegraded":"2023-07-06T22:20:24.748108+0000","last_fullsized":"2023-07-06T22:20:24.748108+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:34:09.411399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182026+0000","last_change":"2023-07-06T22:20:23.764372+0000","last_active":"2023-07-06T22:20:25.182026+0000","last_peered":"2023-07-06T22:20:25.182026+0000","last_clean":"2023-07-06T22:20:25.182026+0000","last_became_active":"2023-07-06T22:20:23.764083+0000","last_became_peered":"2023-07-06T22:20:23.764083+0000","last_unstale":"2023-07-06T22:20:25.182026+0000","last_undegraded":"2023-07-06T22:20:25.182026+0000","last_fullsized":"2023-07-06T22:20:25.182026+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:22:36.308012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"195'8","reported_seq":21,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745830+0000","last_change":"2023-07-06T22:20:23.346135+0000","last_active":"2023-07-06T22:20:24.745830+0000","last_peered":"2023-07-06T22:20:24.745830+0000","last_clean":"2023-07-06T22:20:24.745830+0000","last_became_active":"2023-07-06T22:20:23.345839+0000","last_became_peered":"2023-07-06T22:20:23.345839+0000","last_unstale":"2023-07-06T22:20:24.745830+0000","last_undegraded":"2023-07-06T22:20:24.745830+0000","last_fullsized":"2023-07-06T22:20:24.745830+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:01:53.727238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182745+0000","last_change":"2023-07-06T22:20:23.757615+0000","last_active":"2023-07-06T22:20:25.182745+0000","last_peered":"2023-07-06T22:20:25.182745+0000","last_clean":"2023-07-06T22:20:25.182745+0000","last_became_active":"2023-07-06T22:20:23.757350+0000","last_became_peered":"2023-07-06T22:20:23.757350+0000","last_unstale":"2023-07-06T22:20:25.182745+0000","last_undegraded":"2023-07-06T22:20:25.182745+0000","last_fullsized":"2023-07-06T22:20:25.182745+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:34:29.344710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182980+0000","last_change":"2023-07-06T22:20:23.351289+0000","last_active":"2023-07-06T22:20:25.182980+0000","last_peered":"2023-07-06T22:20:25.182980+0000","last_clean":"2023-07-06T22:20:25.182980+0000","last_became_active":"2023-07-06T22:20:23.351002+0000","last_became_peered":"2023-07-06T22:20:23.351002+0000","last_unstale":"2023-07-06T22:20:25.182980+0000","last_undegraded":"2023-07-06T22:20:25.182980+0000","last_fullsized":"2023-07-06T22:20:25.182980+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:41:41.683036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183065+0000","last_change":"2023-07-06T22:20:23.774002+0000","last_active":"2023-07-06T22:20:25.183065+0000","last_peered":"2023-07-06T22:20:25.183065+0000","last_clean":"2023-07-06T22:20:25.183065+0000","last_became_active":"2023-07-06T22:20:23.773727+0000","last_became_peered":"2023-07-06T22:20:23.773727+0000","last_unstale":"2023-07-06T22:20:25.183065+0000","last_undegraded":"2023-07-06T22:20:25.183065+0000","last_fullsized":"2023-07-06T22:20:25.183065+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:38:31.878262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748793+0000","last_change":"2023-07-06T22:20:23.344846+0000","last_active":"2023-07-06T22:20:24.748793+0000","last_peered":"2023-07-06T22:20:24.748793+0000","last_clean":"2023-07-06T22:20:24.748793+0000","last_became_active":"2023-07-06T22:20:23.344530+0000","last_became_peered":"2023-07-06T22:20:23.344530+0000","last_unstale":"2023-07-06T22:20:24.748793+0000","last_undegraded":"2023-07-06T22:20:24.748793+0000","last_fullsized":"2023-07-06T22:20:24.748793+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:32:36.005589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182745+0000","last_change":"2023-07-06T22:20:23.772941+0000","last_active":"2023-07-06T22:20:25.182745+0000","last_peered":"2023-07-06T22:20:25.182745+0000","last_clean":"2023-07-06T22:20:25.182745+0000","last_became_active":"2023-07-06T22:20:23.772600+0000","last_became_peered":"2023-07-06T22:20:23.772600+0000","last_unstale":"2023-07-06T22:20:25.182745+0000","last_undegraded":"2023-07-06T22:20:25.182745+0000","last_fullsized":"2023-07-06T22:20:25.182745+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:06:14.081391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.746089+0000","last_change":"2023-07-06T22:20:23.345586+0000","last_active":"2023-07-06T22:20:24.746089+0000","last_peered":"2023-07-06T22:20:24.746089+0000","last_clean":"2023-07-06T22:20:24.746089+0000","last_became_active":"2023-07-06T22:20:23.345294+0000","last_became_peered":"2023-07-06T22:20:23.345294+0000","last_unstale":"2023-07-06T22:20:24.746089+0000","last_undegraded":"2023-07-06T22:20:24.746089+0000","last_fullsized":"2023-07-06T22:20:24.746089+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T09:42:28.866920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182446+0000","last_change":"2023-07-06T22:20:23.759697+0000","last_active":"2023-07-06T22:20:25.182446+0000","last_peered":"2023-07-06T22:20:25.182446+0000","last_clean":"2023-07-06T22:20:25.182446+0000","last_became_active":"2023-07-06T22:20:23.759420+0000","last_became_peered":"2023-07-06T22:20:23.759420+0000","last_unstale":"2023-07-06T22:20:25.182446+0000","last_undegraded":"2023-07-06T22:20:25.182446+0000","last_fullsized":"2023-07-06T22:20:25.182446+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:05:21.938850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745775+0000","last_change":"2023-07-06T22:20:23.350756+0000","last_active":"2023-07-06T22:20:24.745775+0000","last_peered":"2023-07-06T22:20:24.745775+0000","last_clean":"2023-07-06T22:20:24.745775+0000","last_became_active":"2023-07-06T22:20:23.350448+0000","last_became_peered":"2023-07-06T22:20:23.350448+0000","last_unstale":"2023-07-06T22:20:24.745775+0000","last_undegraded":"2023-07-06T22:20:24.745775+0000","last_fullsized":"2023-07-06T22:20:24.745775+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:24:51.209845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182299+0000","last_change":"2023-07-06T22:20:23.763785+0000","last_active":"2023-07-06T22:20:25.182299+0000","last_peered":"2023-07-06T22:20:25.182299+0000","last_clean":"2023-07-06T22:20:25.182299+0000","last_became_active":"2023-07-06T22:20:23.763508+0000","last_became_peered":"2023-07-06T22:20:23.763508+0000","last_unstale":"2023-07-06T22:20:25.182299+0000","last_undegraded":"2023-07-06T22:20:25.182299+0000","last_fullsized":"2023-07-06T22:20:25.182299+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:23:52.851909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181774+0000","last_change":"2023-07-06T22:20:23.353694+0000","last_active":"2023-07-06T22:20:25.181774+0000","last_peered":"2023-07-06T22:20:25.181774+0000","last_clean":"2023-07-06T22:20:25.181774+0000","last_became_active":"2023-07-06T22:20:23.353181+0000","last_became_peered":"2023-07-06T22:20:23.353181+0000","last_unstale":"2023-07-06T22:20:25.181774+0000","last_undegraded":"2023-07-06T22:20:25.181774+0000","last_fullsized":"2023-07-06T22:20:25.181774+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:53:03.781177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745355+0000","last_change":"2023-07-06T22:20:23.759360+0000","last_active":"2023-07-06T22:20:24.745355+0000","last_peered":"2023-07-06T22:20:24.745355+0000","last_clean":"2023-07-06T22:20:24.745355+0000","last_became_active":"2023-07-06T22:20:23.759075+0000","last_became_peered":"2023-07-06T22:20:23.759075+0000","last_unstale":"2023-07-06T22:20:24.745355+0000","last_undegraded":"2023-07-06T22:20:24.745355+0000","last_fullsized":"2023-07-06T22:20:24.745355+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:55:04.598052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183001+0000","last_change":"2023-07-06T22:20:23.344336+0000","last_active":"2023-07-06T22:20:25.183001+0000","last_peered":"2023-07-06T22:20:25.183001+0000","last_clean":"2023-07-06T22:20:25.183001+0000","last_became_active":"2023-07-06T22:20:23.344038+0000","last_became_peered":"2023-07-06T22:20:23.344038+0000","last_unstale":"2023-07-06T22:20:25.183001+0000","last_undegraded":"2023-07-06T22:20:25.183001+0000","last_fullsized":"2023-07-06T22:20:25.183001+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:46:07.193671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182271+0000","last_change":"2023-07-06T22:20:23.755269+0000","last_active":"2023-07-06T22:20:25.182271+0000","last_peered":"2023-07-06T22:20:25.182271+0000","last_clean":"2023-07-06T22:20:25.182271+0000","last_became_active":"2023-07-06T22:20:23.752222+0000","last_became_peered":"2023-07-06T22:20:23.752222+0000","last_unstale":"2023-07-06T22:20:25.182271+0000","last_undegraded":"2023-07-06T22:20:25.182271+0000","last_fullsized":"2023-07-06T22:20:25.182271+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:04:16.705845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181668+0000","last_change":"2023-07-06T22:20:23.353718+0000","last_active":"2023-07-06T22:20:25.181668+0000","last_peered":"2023-07-06T22:20:25.181668+0000","last_clean":"2023-07-06T22:20:25.181668+0000","last_became_active":"2023-07-06T22:20:23.353318+0000","last_became_peered":"2023-07-06T22:20:23.353318+0000","last_unstale":"2023-07-06T22:20:25.181668+0000","last_undegraded":"2023-07-06T22:20:25.181668+0000","last_fullsized":"2023-07-06T22:20:25.181668+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:17:46.858653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182335+0000","last_change":"2023-07-06T22:20:23.756960+0000","last_active":"2023-07-06T22:20:25.182335+0000","last_peered":"2023-07-06T22:20:25.182335+0000","last_clean":"2023-07-06T22:20:25.182335+0000","last_became_active":"2023-07-06T22:20:23.756622+0000","last_became_peered":"2023-07-06T22:20:23.756622+0000","last_unstale":"2023-07-06T22:20:25.182335+0000","last_undegraded":"2023-07-06T22:20:25.182335+0000","last_fullsized":"2023-07-06T22:20:25.182335+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:02:04.695117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181779+0000","last_change":"2023-07-06T22:20:23.352540+0000","last_active":"2023-07-06T22:20:25.181779+0000","last_peered":"2023-07-06T22:20:25.181779+0000","last_clean":"2023-07-06T22:20:25.181779+0000","last_became_active":"2023-07-06T22:20:23.352213+0000","last_became_peered":"2023-07-06T22:20:23.352213+0000","last_unstale":"2023-07-06T22:20:25.181779+0000","last_undegraded":"2023-07-06T22:20:25.181779+0000","last_fullsized":"2023-07-06T22:20:25.181779+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:13.829965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182551+0000","last_change":"2023-07-06T22:20:23.756234+0000","last_active":"2023-07-06T22:20:25.182551+0000","last_peered":"2023-07-06T22:20:25.182551+0000","last_clean":"2023-07-06T22:20:25.182551+0000","last_became_active":"2023-07-06T22:20:23.755933+0000","last_became_peered":"2023-07-06T22:20:23.755933+0000","last_unstale":"2023-07-06T22:20:25.182551+0000","last_undegraded":"2023-07-06T22:20:25.182551+0000","last_fullsized":"2023-07-06T22:20:25.182551+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:27:21.708917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.746282+0000","last_change":"2023-07-06T22:20:23.353671+0000","last_active":"2023-07-06T22:20:24.746282+0000","last_peered":"2023-07-06T22:20:24.746282+0000","last_clean":"2023-07-06T22:20:24.746282+0000","last_became_active":"2023-07-06T22:20:23.353347+0000","last_became_peered":"2023-07-06T22:20:23.353347+0000","last_unstale":"2023-07-06T22:20:24.746282+0000","last_undegraded":"2023-07-06T22:20:24.746282+0000","last_fullsized":"2023-07-06T22:20:24.746282+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:27:59.085281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183244+0000","last_change":"2023-07-06T22:20:23.772660+0000","last_active":"2023-07-06T22:20:25.183244+0000","last_peered":"2023-07-06T22:20:25.183244+0000","last_clean":"2023-07-06T22:20:25.183244+0000","last_became_active":"2023-07-06T22:20:23.772375+0000","last_became_peered":"2023-07-06T22:20:23.772375+0000","last_unstale":"2023-07-06T22:20:25.183244+0000","last_undegraded":"2023-07-06T22:20:25.183244+0000","last_fullsized":"2023-07-06T22:20:25.183244+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:29:03.073107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182823+0000","last_change":"2023-07-06T22:20:23.350255+0000","last_active":"2023-07-06T22:20:25.182823+0000","last_peered":"2023-07-06T22:20:25.182823+0000","last_clean":"2023-07-06T22:20:25.182823+0000","last_became_active":"2023-07-06T22:20:23.349944+0000","last_became_peered":"2023-07-06T22:20:23.349944+0000","last_unstale":"2023-07-06T22:20:25.182823+0000","last_undegraded":"2023-07-06T22:20:25.182823+0000","last_fullsized":"2023-07-06T22:20:25.182823+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:52:57.677955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748550+0000","last_change":"2023-07-06T22:20:23.758205+0000","last_active":"2023-07-06T22:20:24.748550+0000","last_peered":"2023-07-06T22:20:24.748550+0000","last_clean":"2023-07-06T22:20:24.748550+0000","last_became_active":"2023-07-06T22:20:23.757907+0000","last_became_peered":"2023-07-06T22:20:23.757907+0000","last_unstale":"2023-07-06T22:20:24.748550+0000","last_undegraded":"2023-07-06T22:20:24.748550+0000","last_fullsized":"2023-07-06T22:20:24.748550+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:39.251919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182835+0000","last_change":"2023-07-06T22:20:23.355963+0000","last_active":"2023-07-06T22:20:25.182835+0000","last_peered":"2023-07-06T22:20:25.182835+0000","last_clean":"2023-07-06T22:20:25.182835+0000","last_became_active":"2023-07-06T22:20:23.355694+0000","last_became_peered":"2023-07-06T22:20:23.355694+0000","last_unstale":"2023-07-06T22:20:25.182835+0000","last_undegraded":"2023-07-06T22:20:25.182835+0000","last_fullsized":"2023-07-06T22:20:25.182835+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:04:07.137562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748596+0000","last_change":"2023-07-06T22:20:23.758337+0000","last_active":"2023-07-06T22:20:24.748596+0000","last_peered":"2023-07-06T22:20:24.748596+0000","last_clean":"2023-07-06T22:20:24.748596+0000","last_became_active":"2023-07-06T22:20:23.758065+0000","last_became_peered":"2023-07-06T22:20:23.758065+0000","last_unstale":"2023-07-06T22:20:24.748596+0000","last_undegraded":"2023-07-06T22:20:24.748596+0000","last_fullsized":"2023-07-06T22:20:24.748596+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:21:49.359371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748532+0000","last_change":"2023-07-06T22:20:23.345084+0000","last_active":"2023-07-06T22:20:24.748532+0000","last_peered":"2023-07-06T22:20:24.748532+0000","last_clean":"2023-07-06T22:20:24.748532+0000","last_became_active":"2023-07-06T22:20:23.344595+0000","last_became_peered":"2023-07-06T22:20:23.344595+0000","last_unstale":"2023-07-06T22:20:24.748532+0000","last_undegraded":"2023-07-06T22:20:24.748532+0000","last_fullsized":"2023-07-06T22:20:24.748532+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:29:10.824101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745850+0000","last_change":"2023-07-06T22:20:23.760751+0000","last_active":"2023-07-06T22:20:24.745850+0000","last_peered":"2023-07-06T22:20:24.745850+0000","last_clean":"2023-07-06T22:20:24.745850+0000","last_became_active":"2023-07-06T22:20:23.760433+0000","last_became_peered":"2023-07-06T22:20:23.760433+0000","last_unstale":"2023-07-06T22:20:24.745850+0000","last_undegraded":"2023-07-06T22:20:24.745850+0000","last_fullsized":"2023-07-06T22:20:24.745850+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:09:01.312664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182230+0000","last_change":"2023-07-06T22:20:23.352537+0000","last_active":"2023-07-06T22:20:25.182230+0000","last_peered":"2023-07-06T22:20:25.182230+0000","last_clean":"2023-07-06T22:20:25.182230+0000","last_became_active":"2023-07-06T22:20:23.352180+0000","last_became_peered":"2023-07-06T22:20:23.352180+0000","last_unstale":"2023-07-06T22:20:25.182230+0000","last_undegraded":"2023-07-06T22:20:25.182230+0000","last_fullsized":"2023-07-06T22:20:25.182230+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:40:10.595695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745747+0000","last_change":"2023-07-06T22:20:23.751210+0000","last_active":"2023-07-06T22:20:24.745747+0000","last_peered":"2023-07-06T22:20:24.745747+0000","last_clean":"2023-07-06T22:20:24.745747+0000","last_became_active":"2023-07-06T22:20:23.750893+0000","last_became_peered":"2023-07-06T22:20:23.750893+0000","last_unstale":"2023-07-06T22:20:24.745747+0000","last_undegraded":"2023-07-06T22:20:24.745747+0000","last_fullsized":"2023-07-06T22:20:24.745747+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:41:43.699020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181904+0000","last_change":"2023-07-06T22:20:23.352510+0000","last_active":"2023-07-06T22:20:25.181904+0000","last_peered":"2023-07-06T22:20:25.181904+0000","last_clean":"2023-07-06T22:20:25.181904+0000","last_became_active":"2023-07-06T22:20:23.351929+0000","last_became_peered":"2023-07-06T22:20:23.351929+0000","last_unstale":"2023-07-06T22:20:25.181904+0000","last_undegraded":"2023-07-06T22:20:25.181904+0000","last_fullsized":"2023-07-06T22:20:25.181904+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:50:13.356330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182417+0000","last_change":"2023-07-06T22:20:23.757590+0000","last_active":"2023-07-06T22:20:25.182417+0000","last_peered":"2023-07-06T22:20:25.182417+0000","last_clean":"2023-07-06T22:20:25.182417+0000","last_became_active":"2023-07-06T22:20:23.757308+0000","last_became_peered":"2023-07-06T22:20:23.757308+0000","last_unstale":"2023-07-06T22:20:25.182417+0000","last_undegraded":"2023-07-06T22:20:25.182417+0000","last_fullsized":"2023-07-06T22:20:25.182417+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:43:12.745677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182683+0000","last_change":"2023-07-06T22:20:23.355417+0000","last_active":"2023-07-06T22:20:25.182683+0000","last_peered":"2023-07-06T22:20:25.182683+0000","last_clean":"2023-07-06T22:20:25.182683+0000","last_became_active":"2023-07-06T22:20:23.355073+0000","last_became_peered":"2023-07-06T22:20:23.355073+0000","last_unstale":"2023-07-06T22:20:25.182683+0000","last_undegraded":"2023-07-06T22:20:25.182683+0000","last_fullsized":"2023-07-06T22:20:25.182683+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:40:12.758677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182315+0000","last_change":"2023-07-06T22:20:23.754927+0000","last_active":"2023-07-06T22:20:25.182315+0000","last_peered":"2023-07-06T22:20:25.182315+0000","last_clean":"2023-07-06T22:20:25.182315+0000","last_became_active":"2023-07-06T22:20:23.754672+0000","last_became_peered":"2023-07-06T22:20:23.754672+0000","last_unstale":"2023-07-06T22:20:25.182315+0000","last_undegraded":"2023-07-06T22:20:25.182315+0000","last_fullsized":"2023-07-06T22:20:25.182315+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:19:11.328917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181548+0000","last_change":"2023-07-06T22:20:23.353389+0000","last_active":"2023-07-06T22:20:25.181548+0000","last_peered":"2023-07-06T22:20:25.181548+0000","last_clean":"2023-07-06T22:20:25.181548+0000","last_became_active":"2023-07-06T22:20:23.353067+0000","last_became_peered":"2023-07-06T22:20:23.353067+0000","last_unstale":"2023-07-06T22:20:25.181548+0000","last_undegraded":"2023-07-06T22:20:25.181548+0000","last_fullsized":"2023-07-06T22:20:25.181548+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:35:39.372069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182068+0000","last_change":"2023-07-06T22:20:23.757161+0000","last_active":"2023-07-06T22:20:25.182068+0000","last_peered":"2023-07-06T22:20:25.182068+0000","last_clean":"2023-07-06T22:20:25.182068+0000","last_became_active":"2023-07-06T22:20:23.756901+0000","last_became_peered":"2023-07-06T22:20:23.756901+0000","last_unstale":"2023-07-06T22:20:25.182068+0000","last_undegraded":"2023-07-06T22:20:25.182068+0000","last_fullsized":"2023-07-06T22:20:25.182068+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:56:08.577417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745358+0000","last_change":"2023-07-06T22:20:23.349325+0000","last_active":"2023-07-06T22:20:24.745358+0000","last_peered":"2023-07-06T22:20:24.745358+0000","last_clean":"2023-07-06T22:20:24.745358+0000","last_became_active":"2023-07-06T22:20:23.348985+0000","last_became_peered":"2023-07-06T22:20:23.348985+0000","last_unstale":"2023-07-06T22:20:24.745358+0000","last_undegraded":"2023-07-06T22:20:24.745358+0000","last_fullsized":"2023-07-06T22:20:24.745358+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:39:51.067314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1265,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.746449+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:20:24.746449+0000","last_peered":"2023-07-06T22:20:24.746449+0000","last_clean":"2023-07-06T22:20:24.746449+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:20:24.746449+0000","last_undegraded":"2023-07-06T22:20:24.746449+0000","last_fullsized":"2023-07-06T22:20:24.746449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:15.737116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":319,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182173+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:20:25.182173+0000","last_peered":"2023-07-06T22:20:25.182173+0000","last_clean":"2023-07-06T22:20:25.182173+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:20:25.182173+0000","last_undegraded":"2023-07-06T22:20:25.182173+0000","last_fullsized":"2023-07-06T22:20:25.182173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:20.931530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748393+0000","last_change":"2023-07-06T22:20:23.759287+0000","last_active":"2023-07-06T22:20:24.748393+0000","last_peered":"2023-07-06T22:20:24.748393+0000","last_clean":"2023-07-06T22:20:24.748393+0000","last_became_active":"2023-07-06T22:20:23.759026+0000","last_became_peered":"2023-07-06T22:20:23.759026+0000","last_unstale":"2023-07-06T22:20:24.748393+0000","last_undegraded":"2023-07-06T22:20:24.748393+0000","last_fullsized":"2023-07-06T22:20:24.748393+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:26:37.160169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748315+0000","last_change":"2023-07-06T22:20:23.349707+0000","last_active":"2023-07-06T22:20:24.748315+0000","last_peered":"2023-07-06T22:20:24.748315+0000","last_clean":"2023-07-06T22:20:24.748315+0000","last_became_active":"2023-07-06T22:20:23.349418+0000","last_became_peered":"2023-07-06T22:20:23.349418+0000","last_unstale":"2023-07-06T22:20:24.748315+0000","last_undegraded":"2023-07-06T22:20:24.748315+0000","last_fullsized":"2023-07-06T22:20:24.748315+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:20.961162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":367,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745789+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:20:24.745789+0000","last_peered":"2023-07-06T22:20:24.745789+0000","last_clean":"2023-07-06T22:20:24.745789+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:20:24.745789+0000","last_undegraded":"2023-07-06T22:20:24.745789+0000","last_fullsized":"2023-07-06T22:20:24.745789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:12:54.130404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183090+0000","last_change":"2023-07-06T22:20:23.768576+0000","last_active":"2023-07-06T22:20:25.183090+0000","last_peered":"2023-07-06T22:20:25.183090+0000","last_clean":"2023-07-06T22:20:25.183090+0000","last_became_active":"2023-07-06T22:20:23.767967+0000","last_became_peered":"2023-07-06T22:20:23.767967+0000","last_unstale":"2023-07-06T22:20:25.183090+0000","last_undegraded":"2023-07-06T22:20:25.183090+0000","last_fullsized":"2023-07-06T22:20:25.183090+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:32:42.536197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182851+0000","last_change":"2023-07-06T22:20:23.350544+0000","last_active":"2023-07-06T22:20:25.182851+0000","last_peered":"2023-07-06T22:20:25.182851+0000","last_clean":"2023-07-06T22:20:25.182851+0000","last_became_active":"2023-07-06T22:20:23.350270+0000","last_became_peered":"2023-07-06T22:20:23.350270+0000","last_unstale":"2023-07-06T22:20:25.182851+0000","last_undegraded":"2023-07-06T22:20:25.182851+0000","last_fullsized":"2023-07-06T22:20:25.182851+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:43:12.080006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":363,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182403+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:20:25.182403+0000","last_peered":"2023-07-06T22:20:25.182403+0000","last_clean":"2023-07-06T22:20:25.182403+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:20:25.182403+0000","last_undegraded":"2023-07-06T22:20:25.182403+0000","last_fullsized":"2023-07-06T22:20:25.182403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:28:54.236441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745167+0000","last_change":"2023-07-06T22:20:23.768583+0000","last_active":"2023-07-06T22:20:24.745167+0000","last_peered":"2023-07-06T22:20:24.745167+0000","last_clean":"2023-07-06T22:20:24.745167+0000","last_became_active":"2023-07-06T22:20:23.767870+0000","last_became_peered":"2023-07-06T22:20:23.767870+0000","last_unstale":"2023-07-06T22:20:24.745167+0000","last_undegraded":"2023-07-06T22:20:24.745167+0000","last_fullsized":"2023-07-06T22:20:24.745167+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:59:39.375448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745534+0000","last_change":"2023-07-06T22:20:23.346315+0000","last_active":"2023-07-06T22:20:24.745534+0000","last_peered":"2023-07-06T22:20:24.745534+0000","last_clean":"2023-07-06T22:20:24.745534+0000","last_became_active":"2023-07-06T22:20:23.346033+0000","last_became_peered":"2023-07-06T22:20:23.346033+0000","last_unstale":"2023-07-06T22:20:24.745534+0000","last_undegraded":"2023-07-06T22:20:24.745534+0000","last_fullsized":"2023-07-06T22:20:24.745534+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:57:00.559837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":319,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181892+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:20:25.181892+0000","last_peered":"2023-07-06T22:20:25.181892+0000","last_clean":"2023-07-06T22:20:25.181892+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:20:25.181892+0000","last_undegraded":"2023-07-06T22:20:25.181892+0000","last_fullsized":"2023-07-06T22:20:25.181892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:26:36.323849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183222+0000","last_change":"2023-07-06T22:20:23.773275+0000","last_active":"2023-07-06T22:20:25.183222+0000","last_peered":"2023-07-06T22:20:25.183222+0000","last_clean":"2023-07-06T22:20:25.183222+0000","last_became_active":"2023-07-06T22:20:23.772944+0000","last_became_peered":"2023-07-06T22:20:23.772944+0000","last_unstale":"2023-07-06T22:20:25.183222+0000","last_undegraded":"2023-07-06T22:20:25.183222+0000","last_fullsized":"2023-07-06T22:20:25.183222+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:26:53.681385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183153+0000","last_change":"2023-07-06T22:20:23.354573+0000","last_active":"2023-07-06T22:20:25.183153+0000","last_peered":"2023-07-06T22:20:25.183153+0000","last_clean":"2023-07-06T22:20:25.183153+0000","last_became_active":"2023-07-06T22:20:23.354257+0000","last_became_peered":"2023-07-06T22:20:23.354257+0000","last_unstale":"2023-07-06T22:20:25.183153+0000","last_undegraded":"2023-07-06T22:20:25.183153+0000","last_fullsized":"2023-07-06T22:20:25.183153+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:00:50.318640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":323,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.181786+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:20:25.181786+0000","last_peered":"2023-07-06T22:20:25.181786+0000","last_clean":"2023-07-06T22:20:25.181786+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:20:25.181786+0000","last_undegraded":"2023-07-06T22:20:25.181786+0000","last_fullsized":"2023-07-06T22:20:25.181786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:04:42.234271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.748737+0000","last_change":"2023-07-06T22:20:23.759434+0000","last_active":"2023-07-06T22:20:24.748737+0000","last_peered":"2023-07-06T22:20:24.748737+0000","last_clean":"2023-07-06T22:20:24.748737+0000","last_became_active":"2023-07-06T22:20:23.758902+0000","last_became_peered":"2023-07-06T22:20:23.758902+0000","last_unstale":"2023-07-06T22:20:24.748737+0000","last_undegraded":"2023-07-06T22:20:24.748737+0000","last_fullsized":"2023-07-06T22:20:24.748737+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:16:31.795071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"195'4","reported_seq":17,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182851+0000","last_change":"2023-07-06T22:20:23.346019+0000","last_active":"2023-07-06T22:20:25.182851+0000","last_peered":"2023-07-06T22:20:25.182851+0000","last_clean":"2023-07-06T22:20:25.182851+0000","last_became_active":"2023-07-06T22:20:23.345707+0000","last_became_peered":"2023-07-06T22:20:23.345707+0000","last_unstale":"2023-07-06T22:20:25.182851+0000","last_undegraded":"2023-07-06T22:20:25.182851+0000","last_fullsized":"2023-07-06T22:20:25.182851+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:49:03.465529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":367,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.746260+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:20:24.746260+0000","last_peered":"2023-07-06T22:20:24.746260+0000","last_clean":"2023-07-06T22:20:24.746260+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:20:24.746260+0000","last_undegraded":"2023-07-06T22:20:24.746260+0000","last_fullsized":"2023-07-06T22:20:24.746260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:31:01.685448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183048+0000","last_change":"2023-07-06T22:20:23.755074+0000","last_active":"2023-07-06T22:20:25.183048+0000","last_peered":"2023-07-06T22:20:25.183048+0000","last_clean":"2023-07-06T22:20:25.183048+0000","last_became_active":"2023-07-06T22:20:23.754809+0000","last_became_peered":"2023-07-06T22:20:23.754809+0000","last_unstale":"2023-07-06T22:20:25.183048+0000","last_undegraded":"2023-07-06T22:20:25.183048+0000","last_fullsized":"2023-07-06T22:20:25.183048+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:38:55.797793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182753+0000","last_change":"2023-07-06T22:20:23.350960+0000","last_active":"2023-07-06T22:20:25.182753+0000","last_peered":"2023-07-06T22:20:25.182753+0000","last_clean":"2023-07-06T22:20:25.182753+0000","last_became_active":"2023-07-06T22:20:23.350674+0000","last_became_peered":"2023-07-06T22:20:23.350674+0000","last_unstale":"2023-07-06T22:20:25.182753+0000","last_undegraded":"2023-07-06T22:20:25.182753+0000","last_fullsized":"2023-07-06T22:20:25.182753+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:51:47.545838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":322,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.183155+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:20:25.183155+0000","last_peered":"2023-07-06T22:20:25.183155+0000","last_clean":"2023-07-06T22:20:25.183155+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:20:25.183155+0000","last_undegraded":"2023-07-06T22:20:25.183155+0000","last_fullsized":"2023-07-06T22:20:25.183155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:02:55.910303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:24.745340+0000","last_change":"2023-07-06T22:20:23.754549+0000","last_active":"2023-07-06T22:20:24.745340+0000","last_peered":"2023-07-06T22:20:24.745340+0000","last_clean":"2023-07-06T22:20:24.745340+0000","last_became_active":"2023-07-06T22:20:23.754282+0000","last_became_peered":"2023-07-06T22:20:23.754282+0000","last_unstale":"2023-07-06T22:20:24.745340+0000","last_undegraded":"2023-07-06T22:20:24.745340+0000","last_fullsized":"2023-07-06T22:20:24.745340+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:23.318921+0000","last_clean_scrub_stamp":"2023-07-06T22:20:23.318921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:22:48.599986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182113+0000","last_change":"2023-07-06T22:20:23.351115+0000","last_active":"2023-07-06T22:20:25.182113+0000","last_peered":"2023-07-06T22:20:25.182113+0000","last_clean":"2023-07-06T22:20:25.182113+0000","last_became_active":"2023-07-06T22:20:23.350843+0000","last_became_peered":"2023-07-06T22:20:23.350843+0000","last_unstale":"2023-07-06T22:20:25.182113+0000","last_undegraded":"2023-07-06T22:20:25.182113+0000","last_fullsized":"2023-07-06T22:20:25.182113+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:20:22.307275+0000","last_clean_scrub_stamp":"2023-07-06T22:20:22.307275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:50:32.476992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":314,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-06T22:20:25.182984+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:20:25.182984+0000","last_peered":"2023-07-06T22:20:25.182984+0000","last_clean":"2023-07-06T22:20:25.182984+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:20:25.182984+0000","last_undegraded":"2023-07-06T22:20:25.182984+0000","last_fullsized":"2023-07-06T22:20:25.182984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:27:11.900398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575305,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42224,"kb_used_data":2984,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329616,"statfs":{"total":96636764160,"available":96593526784,"internally_reserved":0,"allocated":3055616,"data_stored":1911555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.432},"max":{"1min":0.92100000000000004,"5min":0.93300000000000005,"15min":1.0740000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51600000000000001,"5min":0.45900000000000002,"15min":0.45700000000000002},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.52100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.74199999999999999,"15min":0.72399999999999998},"min":{"1min":0.57699999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.61099999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"max":{"1min":0.96399999999999997,"5min":0.96699999999999997,"15min":1.0149999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73999999999999999,"15min":0.73199999999999998},"min":{"1min":0.53100000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.84099999999999997,"15min":0.78400000000000003},"min":{"1min":0.56200000000000006,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":9.8279999999999994,"15min":9.8279999999999994},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.36799999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73499999999999999,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":2.2610000000000001,"5min":13.443,"15min":13.443},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.52400000000000002,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.76100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575305,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37536,"kb_used_data":2392,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334304,"statfs":{"total":96636764160,"available":96598327296,"internally_reserved":0,"allocated":2449408,"data_stored":1320064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.40300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.7829999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":1.633},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.49199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.9099999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.97799999999999998},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83199999999999996,"5min":0.91100000000000003,"15min":2.0299999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":1.04,"15min":1.5920000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.61099999999999999,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.996},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.69699999999999995,"5min":1.024,"15min":1.024},"last":0.626},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80200000000000005,"5min":0.92600000000000005,"15min":0.996},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":0.89900000000000002,"15min":0.98499999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.85999999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82499999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.624},"min":{"1min":0.54100000000000004,"5min":0.45600000000000002,"15min":0.439},"max":{"1min":0.78400000000000003,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575304,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59684,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312156,"statfs":{"total":96636764160,"available":96575647744,"internally_reserved":0,"allocated":2453504,"data_stored":1321083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.92100000000000004,"5min":0.97199999999999998,"15min":0.999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.628,"5min":0.46999999999999997,"15min":0.46400000000000002},"max":{"1min":0.88400000000000001,"5min":0.995,"15min":0.995},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.52200000000000002,"5min":0.44400000000000001,"15min":0.43099999999999999},"max":{"1min":0.94799999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.60599999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.006,"5min":1.006,"15min":1.3200000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.46300000000000002},"max":{"1min":0.93700000000000006,"5min":0.998,"15min":1.4299999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.749},"min":{"1min":0.56200000000000006,"5min":0.48499999999999999,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":0.999,"15min":1.0409999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.54400000000000004,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":0.996,"15min":1.5169999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.623,"5min":0.51500000000000001,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61599999999999999,"15min":0.61699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.79800000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.86199999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.622,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.998},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.872}]},{"osd":7,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.5,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69799999999999995,"15min":0.69099999999999995},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.81799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575303,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55604,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316236,"statfs":{"total":96636764160,"available":96579825664,"internally_reserved":0,"allocated":2469888,"data_stored":1323229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.42199999999999999},"max":{"1min":0.876,"5min":0.96399999999999997,"15min":0.98999999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":0.97899999999999998,"15min":1.016},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.56899999999999995,"5min":0.47899999999999998,"15min":0.38300000000000001},"max":{"1min":0.93400000000000005,"5min":0.999,"15min":1.0309999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.996},"last":0.748}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.622,"5min":0.54600000000000004,"15min":0.502},"max":{"1min":0.97699999999999998,"5min":0.99399999999999999,"15min":1.0580000000000001},"last":0.97699999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.53500000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.98699999999999999},"last":0.874},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":1.022,"15min":1.03},"last":0.995}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.36599999999999999},"max":{"1min":0.76800000000000002,"5min":0.91200000000000003,"15min":0.92600000000000005},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":0.95599999999999996,"15min":1.006},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.91500000000000004,"15min":1.0509999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.41299999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90300000000000002,"5min":0.94799999999999995,"15min":1.0469999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.432,"15min":0.432},"max":{"1min":0.90200000000000002,"5min":1.0109999999999999,"15min":1.1100000000000001},"last":0.95399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575304,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51504,"kb_used_data":2408,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320336,"statfs":{"total":96636764160,"available":96584024064,"internally_reserved":0,"allocated":2465792,"data_stored":1321277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.27300000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.65800000000000003,"5min":0.68100000000000005,"15min":0.85899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64900000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.27700000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64100000000000001,"5min":0.69799999999999995,"15min":0.83899999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.41299999999999998},"max":{"1min":0.80200000000000005,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64500000000000002,"5min":0.72399999999999998,"15min":0.875},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.77400000000000002},"min":{"1min":0.64100000000000001,"5min":0.53500000000000003,"15min":0.441},"max":{"1min":0.93400000000000005,"5min":1.0449999999999999,"15min":1.474},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79500000000000004,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":0.93400000000000005,"5min":1.0920000000000001,"15min":1.3859999999999999},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.57499999999999996},"max":{"1min":1.085,"5min":1.175,"15min":1.3740000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.68500000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1,"5min":1.0249999999999999,"15min":1.2330000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.58199999999999996,"15min":0.51800000000000002},"max":{"1min":1,"5min":1.1399999999999999,"15min":1.3899999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.57299999999999995},"max":{"1min":1.083,"5min":1.1499999999999999,"15min":1.3220000000000001},"last":0.624}]},{"osd":7,"last update":"Thu Jul 6 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83899999999999997,"15min":0.82199999999999995},"min":{"1min":0.73199999999999998,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.0649999999999999,"5min":1.1160000000000001,"15min":1.2210000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83799999999999997,"15min":0.82799999999999996},"min":{"1min":0.67500000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0369999999999999,"5min":1.244,"15min":1.3200000000000001},"last":0.69099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575304,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41648,"kb_used_data":2408,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330192,"statfs":{"total":96636764160,"available":96594116608,"internally_reserved":0,"allocated":2465792,"data_stored":1321777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.77000000000000002,"15min":0.78600000000000003},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.42499999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65600000000000003,"5min":0.74099999999999999,"15min":0.84099999999999997},"last":0.371},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.72399999999999998,"5min":0.85099999999999998,"15min":0.97099999999999997},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.63600000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58799999999999997},"min":{"1min":0.46300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"last":0.499}]},{"osd":4,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.66500000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94199999999999995,"5min":1.663,"15min":1.663},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.61099999999999999,"5min":0.54900000000000004,"15min":0.51600000000000001},"max":{"1min":0.94899999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.66000000000000003,"5min":0.55900000000000005,"15min":0.51100000000000001},"max":{"1min":0.90900000000000003,"5min":1.337,"15min":1.337},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80700000000000005,"15min":0.82899999999999996},"min":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0189999999999999,"5min":1.228,"15min":1.2829999999999999},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.996,"5min":1.367,"15min":1.367},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81200000000000006,"15min":0.82999999999999996},"min":{"1min":0.65300000000000002,"5min":0.59999999999999998,"15min":0.56100000000000005},"max":{"1min":0.96499999999999997,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.98099999999999998,"5min":1.407,"15min":1.407},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82099999999999995,"15min":0.83999999999999997},"min":{"1min":0.67200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.024,"5min":1.296,"15min":1.296},"last":0.88300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575305,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59696,"kb_used_data":2408,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312144,"statfs":{"total":96636764160,"available":96575635456,"internally_reserved":0,"allocated":2465792,"data_stored":1322647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.316,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.72599999999999998,"5min":1.645,"15min":1.645},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.72299999999999998,"5min":0.90700000000000003,"15min":0.94299999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.68799999999999994,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.502,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.81699999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79600000000000004,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74299999999999999,"15min":0.77600000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96999999999999997,"5min":1.083,"15min":1.1140000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78700000000000003,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.51700000000000002},"max":{"1min":0.92700000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.627}]},{"osd":5,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.48699999999999999},"max":{"1min":1.012,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79800000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96399999999999997,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95399999999999996,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.56100000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94299999999999995,"5min":1.25,"15min":1.3360000000000001},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81399999999999995,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.56100000000000005},"max":{"1min":0.99199999999999999,"5min":1.155,"15min":1.405},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.61199999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98199999999999998,"5min":1.788,"15min":1.788},"last":0.53200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575304,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38120,"kb_used_data":2976,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333720,"statfs":{"total":96636764160,"available":96597729280,"internally_reserved":0,"allocated":3047424,"data_stored":1910454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.434,"15min":0.46000000000000002},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54200000000000004,"5min":0.745,"15min":0.745},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.312},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.1319999999999999},"last":0.441}]},{"osd":2,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.39600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":1.1599999999999999},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.89200000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.40999999999999998},"max":{"1min":0.71699999999999997,"5min":0.77100000000000002,"15min":0.95399999999999996},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77000000000000002,"15min":0.79600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96299999999999997,"5min":1.1439999999999999,"15min":1.294},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90800000000000003,"5min":1.1000000000000001,"15min":1.3320000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.0569999999999999,"15min":1.345},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.76300000000000001,"15min":0.79600000000000004},"min":{"1min":0.57499999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.56000000000000005,"5min":0.498,"15min":0.47699999999999998},"max":{"1min":0.96699999999999997,"5min":1.0569999999999999,"15min":1.153},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99199999999999999,"5min":1.0840000000000001,"15min":1.272},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.52100000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.26},"last":0.753},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55700000000000005},"max":{"1min":0.97699999999999998,"5min":1.1220000000000001,"15min":1.2350000000000001},"last":0.73299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:20:33.185 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T22:20:33.185 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-06T22:20:33.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.367+0000 7f66441ad640 1 Processor -- start 2023-07-06T22:20:33.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.367+0000 7f66441ad640 1 -- start start 2023-07-06T22:20:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f66441ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f663c1601b0 0x7f663c0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f66441ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cc050 0x7f663c0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f66441ad640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c163c50 con 0x7f663c15fde0 2023-07-06T22:20:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f66441ad640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c0cd310 con 0x7f663c1601b0 2023-07-06T22:20:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f66441ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0cddc0 con 0x7f663c0cc050 2023-07-06T22:20:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f6641f49640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f663c15fde0 0x7f663c164130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39328/0 (socket says 172.21.15.55:39328) 2023-07-06T22:20:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f6641f49640 1 -- 172.21.15.55:0/3486535015 learned_addr learned my addr 172.21.15.55:0/3486535015 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f6641748640 1 --2- 172.21.15.55:0/3486535015 >> v2:172.21.15.55:3300/0 conn(0x7f663c1601b0 0x7f663c0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f664274a640 1 --2- 172.21.15.55:0/3486535015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cc050 0x7f663c0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f6641748640 1 -- 172.21.15.55:0/3486535015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cc050 msgr2=0x7f663c0c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f6641748640 1 --2- 172.21.15.55:0/3486535015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cc050 0x7f663c0c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f6641748640 1 -- 172.21.15.55:0/3486535015 >> v1:172.21.15.55:6789/0 conn(0x7f663c15fde0 legacy=0x7f663c164130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f6641748640 1 -- 172.21.15.55:0/3486535015 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0cd520 con 0x7f663c1601b0 2023-07-06T22:20:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f664274a640 1 --2- 172.21.15.55:0/3486535015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cc050 0x7f663c0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:33.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.371+0000 7f6641748640 1 --2- 172.21.15.55:0/3486535015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c1601b0 0x7f663c0cbb10 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f662c0097c0 tx=0x7f662c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa72257a2e2eff4a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:33.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f6640f47640 1 -- 172.21.15.55:0/3486535015 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0ad660 con 0x7f663c1601b0 2023-07-06T22:20:33.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f6640f47640 1 -- 172.21.15.55:0/3486535015 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c0ad7c0 con 0x7f663c1601b0 2023-07-06T22:20:33.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f6640f47640 1 -- 172.21.15.55:0/3486535015 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0adb50 con 0x7f663c1601b0 2023-07-06T22:20:33.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 -- 172.21.15.55:0/3486535015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c1601b0 msgr2=0x7f663c0cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:33.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 --2- 172.21.15.55:0/3486535015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c1601b0 0x7f663c0cbb10 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f662c0097c0 tx=0x7f662c01c450 comp rx=0 tx=0).stop 2023-07-06T22:20:33.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 -- 172.21.15.55:0/3486535015 shutdown_connections 2023-07-06T22:20:33.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 --2- 172.21.15.55:0/3486535015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c0cc050 0x7f663c0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 --2- 172.21.15.55:0/3486535015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c1601b0 0x7f663c0cbb10 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 -- 172.21.15.55:0/3486535015 >> 172.21.15.55:0/3486535015 conn(0x7f663c0cdf40 msgr2=0x7f663c0ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 -- 172.21.15.55:0/3486535015 shutdown_connections 2023-07-06T22:20:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 -- 172.21.15.55:0/3486535015 wait complete. 2023-07-06T22:20:33.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 Processor -- start 2023-07-06T22:20:33.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 -- start start 2023-07-06T22:20:33.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c0cc050 0x7f663c148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:33.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f663c15fde0 0x7f663c0c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:33.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c1601b0 0x7f663c0cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c156500 con 0x7f663c0cc050 2023-07-06T22:20:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c1567e0 con 0x7f663c15fde0 2023-07-06T22:20:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.375+0000 7f66441ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c156ac0 con 0x7f663c1601b0 2023-07-06T22:20:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f6641f49640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c0cc050 0x7f663c148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f6641f49640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c0cc050 0x7f663c148500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58078/0 (socket says 172.21.15.55:58078) 2023-07-06T22:20:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f6641f49640 1 -- 172.21.15.55:0/3811494642 learned_addr learned my addr 172.21.15.55:0/3811494642 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f6641748640 1 --2- 172.21.15.55:0/3811494642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f663c15fde0 0x7f663c0c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f664274a640 1 --2- 172.21.15.55:0/3811494642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c1601b0 0x7f663c0cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f6641f49640 1 -- 172.21.15.55:0/3811494642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c1601b0 msgr2=0x7f663c0cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f6641f49640 1 --2- 172.21.15.55:0/3811494642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c1601b0 0x7f663c0cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f6641f49640 1 -- 172.21.15.55:0/3811494642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f663c15fde0 msgr2=0x7f663c0c1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f6641f49640 1 --2- 172.21.15.55:0/3811494642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f663c15fde0 0x7f663c0c1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f6641f49640 1 -- 172.21.15.55:0/3811494642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c009420 con 0x7f663c0cc050 2023-07-06T22:20:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f6641f49640 1 --2- 172.21.15.55:0/3811494642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c0cc050 0x7f663c148500 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f663800c400 tx=0x7f663800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f66327fc640 1 -- 172.21.15.55:0/3811494642 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6638005cf0 con 0x7f663c0cc050 2023-07-06T22:20:33.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f66327fc640 1 -- 172.21.15.55:0/3811494642 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6638005e50 con 0x7f663c0cc050 2023-07-06T22:20:33.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f66441ad640 1 -- 172.21.15.55:0/3811494642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c156da0 con 0x7f663c0cc050 2023-07-06T22:20:33.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f66327fc640 1 -- 172.21.15.55:0/3811494642 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66380072d0 con 0x7f663c0cc050 2023-07-06T22:20:33.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f66441ad640 1 -- 172.21.15.55:0/3811494642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c0c1fb0 con 0x7f663c0cc050 2023-07-06T22:20:33.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f66441ad640 1 -- 172.21.15.55:0/3811494642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c066d60 con 0x7f663c0cc050 2023-07-06T22:20:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f66327fc640 1 -- 172.21.15.55:0/3811494642 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6638007430 con 0x7f663c0cc050 2023-07-06T22:20:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.379+0000 7f66327fc640 1 --2- 172.21.15.55:0/3811494642 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f66200663a0 0x7f6620068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.383+0000 7f66327fc640 1 -- 172.21.15.55:0/3811494642 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f66380834a0 con 0x7f663c0cc050 2023-07-06T22:20:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.383+0000 7f6641748640 1 --2- 172.21.15.55:0/3811494642 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f66200663a0 0x7f6620068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.383+0000 7f6641748640 1 --2- 172.21.15.55:0/3811494642 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f66200663a0 0x7f6620068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f662c0af000 tx=0x7f662c0a7000 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.387+0000 7f66327fc640 1 -- 172.21.15.55:0/3811494642 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6638050750 con 0x7f663c0cc050 2023-07-06T22:20:33.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.595+0000 7f66441ad640 1 -- 172.21.15.55:0/3811494642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f663c06a400 con 0x7f663c0cc050 2023-07-06T22:20:33.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.599+0000 7f66327fc640 1 -- 172.21.15.55:0/3811494642 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v30) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6638053d70 con 0x7f663c0cc050 2023-07-06T22:20:33.603 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-07-06T22:20:33.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.603+0000 7f66441ad640 1 -- 172.21.15.55:0/3811494642 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f66200663a0 msgr2=0x7f6620068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.603+0000 7f66441ad640 1 --2- 172.21.15.55:0/3811494642 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f66200663a0 0x7f6620068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f662c0af000 tx=0x7f662c0a7000 comp rx=0 tx=0).stop 2023-07-06T22:20:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.603+0000 7f66441ad640 1 -- 172.21.15.55:0/3811494642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c0cc050 msgr2=0x7f663c148500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.603+0000 7f66441ad640 1 --2- 172.21.15.55:0/3811494642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c0cc050 0x7f663c148500 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f663800c400 tx=0x7f663800c8c0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.603+0000 7f66441ad640 1 -- 172.21.15.55:0/3811494642 shutdown_connections 2023-07-06T22:20:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.603+0000 7f66441ad640 1 --2- 172.21.15.55:0/3811494642 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f66200663a0 0x7f6620068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.603+0000 7f66441ad640 1 --2- 172.21.15.55:0/3811494642 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f663c1601b0 0x7f663c0cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.603+0000 7f66441ad640 1 --2- 172.21.15.55:0/3811494642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f663c15fde0 0x7f663c0c1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.603+0000 7f66441ad640 1 --2- 172.21.15.55:0/3811494642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c0cc050 0x7f663c148500 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.603+0000 7f66441ad640 1 -- 172.21.15.55:0/3811494642 >> 172.21.15.55:0/3811494642 conn(0x7f663c0cdf40 msgr2=0x7f663c164130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.603+0000 7f66441ad640 1 -- 172.21.15.55:0/3811494642 shutdown_connections 2023-07-06T22:20:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.603+0000 7f66441ad640 1 -- 172.21.15.55:0/3811494642 wait complete. 2023-07-06T22:20:33.623 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:20:33.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.763+0000 7f248cf37640 1 Processor -- start 2023-07-06T22:20:33.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.763+0000 7f248cf37640 1 -- start start 2023-07-06T22:20:33.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.763+0000 7f248cf37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2488158400 0x7f24880c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:33.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.763+0000 7f248cf37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f248806fae0 con 0x7f24881587d0 2023-07-06T22:20:33.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.763+0000 7f248cf37640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f248806fdc0 con 0x7f24880c9680 2023-07-06T22:20:33.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.763+0000 7f248cf37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24880700a0 con 0x7f2488158400 2023-07-06T22:20:33.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.763+0000 7f248659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2488158400 0x7f24880c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:33.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.763+0000 7f248659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2488158400 0x7f24880c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58094/0 (socket says 172.21.15.55:58094) 2023-07-06T22:20:33.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.763+0000 7f248659c640 1 -- 172.21.15.55:0/1099160009 learned_addr learned my addr 172.21.15.55:0/1099160009 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:33.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.767+0000 7f248659c640 1 -- 172.21.15.55:0/1099160009 >> v1:172.21.15.138:6789/0 conn(0x7f24880c9680 legacy=0x7f2488070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:33.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.767+0000 7f248659c640 1 -- 172.21.15.55:0/1099160009 >> v1:172.21.15.55:6789/0 conn(0x7f24881587d0 legacy=0x7f24880cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:33.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.767+0000 7f248659c640 1 -- 172.21.15.55:0/1099160009 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2488070380 con 0x7f2488158400 2023-07-06T22:20:33.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.767+0000 7f248659c640 1 --2- 172.21.15.55:0/1099160009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2488158400 0x7f24880c9140 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f2478009870 tx=0x7f247801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c92ea3a106e3bf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:33.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.767+0000 7f2485d9b640 1 -- 172.21.15.55:0/1099160009 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478004230 con 0x7f2488158400 2023-07-06T22:20:33.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.767+0000 7f2485d9b640 1 -- 172.21.15.55:0/1099160009 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24780a7050 con 0x7f2488158400 2023-07-06T22:20:33.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.767+0000 7f2485d9b640 1 -- 172.21.15.55:0/1099160009 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478003620 con 0x7f2488158400 2023-07-06T22:20:33.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.767+0000 7f248cf37640 1 -- 172.21.15.55:0/1099160009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2488158400 msgr2=0x7f24880c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:33.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.767+0000 7f248cf37640 1 --2- 172.21.15.55:0/1099160009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2488158400 0x7f24880c9140 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f2478009870 tx=0x7f247801c440 comp rx=0 tx=0).stop 2023-07-06T22:20:33.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.767+0000 7f248cf37640 1 -- 172.21.15.55:0/1099160009 shutdown_connections 2023-07-06T22:20:33.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.767+0000 7f248cf37640 1 --2- 172.21.15.55:0/1099160009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2488158400 0x7f24880c9140 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.767+0000 7f248cf37640 1 -- 172.21.15.55:0/1099160009 >> 172.21.15.55:0/1099160009 conn(0x7f24880cded0 msgr2=0x7f24880ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:33.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.767+0000 7f248cf37640 1 -- 172.21.15.55:0/1099160009 shutdown_connections 2023-07-06T22:20:33.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.767+0000 7f248cf37640 1 -- 172.21.15.55:0/1099160009 wait complete. 2023-07-06T22:20:33.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f248cf37640 1 Processor -- start 2023-07-06T22:20:33.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f248cf37640 1 -- start start 2023-07-06T22:20:33.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f248cf37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24880c9680 0x7f2488153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:33.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f248cf37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2488158400 0x7f24880b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:33.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f248cf37640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24881587d0 0x7f2488156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:33.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f248cf37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24880b0dc0 con 0x7f2488158400 2023-07-06T22:20:33.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f248cf37640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24880b10a0 con 0x7f24880c9680 2023-07-06T22:20:33.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f248cf37640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24880b1380 con 0x7f24881587d0 2023-07-06T22:20:33.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f247ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2488158400 0x7f24880b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:33.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f247ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2488158400 0x7f24880b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58100/0 (socket says 172.21.15.55:58100) 2023-07-06T22:20:33.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f247ffff640 1 -- 172.21.15.55:0/584677406 learned_addr learned my addr 172.21.15.55:0/584677406 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:33.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f2486d9d640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24881587d0 0x7f2488156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:33.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f248659c640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24880c9680 0x7f2488153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:33.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f247ffff640 1 -- 172.21.15.55:0/584677406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24881587d0 msgr2=0x7f2488156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:33.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f247ffff640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24881587d0 0x7f2488156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f247ffff640 1 -- 172.21.15.55:0/584677406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24880c9680 msgr2=0x7f2488153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:33.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f247ffff640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24880c9680 0x7f2488153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f247ffff640 1 -- 172.21.15.55:0/584677406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24780094d0 con 0x7f2488158400 2023-07-06T22:20:33.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f248659c640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24880c9680 0x7f2488153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:33.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.771+0000 7f247ffff640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2488158400 0x7f24880b1b80 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7f247000c410 tx=0x7f247000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:33.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.775+0000 7f247effd640 1 -- 172.21.15.55:0/584677406 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470003600 con 0x7f2488158400 2023-07-06T22:20:33.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.775+0000 7f247effd640 1 -- 172.21.15.55:0/584677406 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2470003780 con 0x7f2488158400 2023-07-06T22:20:33.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.775+0000 7f247effd640 1 -- 172.21.15.55:0/584677406 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470003b30 con 0x7f2488158400 2023-07-06T22:20:33.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.775+0000 7f248cf37640 1 -- 172.21.15.55:0/584677406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24880b1660 con 0x7f2488158400 2023-07-06T22:20:33.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.775+0000 7f248cf37640 1 -- 172.21.15.55:0/584677406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24880a8b30 con 0x7f2488158400 2023-07-06T22:20:33.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.775+0000 7f248cf37640 1 -- 172.21.15.55:0/584677406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248806c580 con 0x7f2488158400 2023-07-06T22:20:33.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.775+0000 7f247effd640 1 -- 172.21.15.55:0/584677406 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2470003c90 con 0x7f2488158400 2023-07-06T22:20:33.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.775+0000 7f247effd640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f24680663a0 0x7f2468068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:33.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.775+0000 7f247effd640 1 -- 172.21.15.55:0/584677406 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2470083270 con 0x7f2488158400 2023-07-06T22:20:33.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.775+0000 7f248659c640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f24680663a0 0x7f2468068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:33.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.779+0000 7f248659c640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f24680663a0 0x7f2468068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f24780ad000 tx=0x7f2478008040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:33.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.779+0000 7f247effd640 1 -- 172.21.15.55:0/584677406 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2470050520 con 0x7f2488158400 2023-07-06T22:20:33.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.967+0000 7f248cf37640 1 -- 172.21.15.55:0/584677406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24880b0f00 con 0x7f2488158400 2023-07-06T22:20:33.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.967+0000 7f247effd640 1 -- 172.21.15.55:0/584677406 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4687 (secure 0 0 0) 0x7f24880b0f00 con 0x7f2488158400 2023-07-06T22:20:33.968 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:33.969 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":87,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2023670167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2023670167},{"type":"v1","addr":"172.21.15.138:6834","nonce":2023670167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":10989,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2906978966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2906978966},{"type":"v1","addr":"172.21.15.55:6836","nonce":2906978966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":10992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1643276481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1643276481},{"type":"v1","addr":"172.21.15.55:6837","nonce":1643276481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:20:23.728829+0000","modified":"2023-07-06T22:20:27.126611+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11001":{"gid":11001,"name":"d","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6835/3113237921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3113237921},{"type":"v1","addr":"172.21.15.138:6835","nonce":3113237921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-06T22:20:33.969 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 87 2023-07-06T22:20:33.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.967+0000 7f248cf37640 1 -- 172.21.15.55:0/584677406 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f24680663a0 msgr2=0x7f2468068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:33.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.967+0000 7f248cf37640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f24680663a0 0x7f2468068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f24780ad000 tx=0x7f2478008040 comp rx=0 tx=0).stop 2023-07-06T22:20:33.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.967+0000 7f248cf37640 1 -- 172.21.15.55:0/584677406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2488158400 msgr2=0x7f24880b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:33.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.967+0000 7f248cf37640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2488158400 0x7f24880b1b80 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7f247000c410 tx=0x7f247000c8d0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.967+0000 7f248cf37640 1 -- 172.21.15.55:0/584677406 shutdown_connections 2023-07-06T22:20:33.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.967+0000 7f248cf37640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f24680663a0 0x7f2468068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.967+0000 7f248cf37640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24881587d0 0x7f2488156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.967+0000 7f248cf37640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2488158400 0x7f24880b1b80 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.967+0000 7f248cf37640 1 --2- 172.21.15.55:0/584677406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24880c9680 0x7f2488153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:33.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.967+0000 7f248cf37640 1 -- 172.21.15.55:0/584677406 >> 172.21.15.55:0/584677406 conn(0x7f24880cded0 msgr2=0x7f24881562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:33.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.967+0000 7f248cf37640 1 -- 172.21.15.55:0/584677406 shutdown_connections 2023-07-06T22:20:33.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:33.967+0000 7f248cf37640 1 -- 172.21.15.55:0/584677406 wait complete. 2023-07-06T22:20:34.391 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 87, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T22:20:23.728829+0000', 'modified': '2023-07-06T22:20:27.126611+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11001}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11001': {'gid': 11001, 'name': 'd', 'rank': 0, 'incarnation': 83, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.138:6835/3113237921', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6833', 'nonce': 3113237921}, {'type': 'v1', 'addr': '172.21.15.138:6835', 'nonce': 3113237921}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T22:20:34.391 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T22:20:34.392 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-06T22:20:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b38dfa640 1 Processor -- start 2023-07-06T22:20:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b38dfa640 1 -- start start 2023-07-06T22:20:34.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b38dfa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b34156180 0x7f0b340ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b38dfa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b340cbeb0 0x7f0b3406ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b38dfa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b340cc310 con 0x7f0b3406e9d0 2023-07-06T22:20:34.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b38dfa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b34160250 con 0x7f0b34156180 2023-07-06T22:20:34.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b38dfa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3406f390 con 0x7f0b340cbeb0 2023-07-06T22:20:34.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b3259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b34156180 0x7f0b340ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b3259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b34156180 0x7f0b340ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58110/0 (socket says 172.21.15.55:58110) 2023-07-06T22:20:34.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b3259c640 1 -- 172.21.15.55:0/3452950909 learned_addr learned my addr 172.21.15.55:0/3452950909 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:34.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b3259c640 1 -- 172.21.15.55:0/3452950909 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b340cbeb0 msgr2=0x7f0b3406ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:34.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b32d9d640 1 --2- 172.21.15.55:0/3452950909 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b340cbeb0 0x7f0b3406ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b3259c640 1 --2- 172.21.15.55:0/3452950909 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b340cbeb0 0x7f0b3406ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b3259c640 1 -- 172.21.15.55:0/3452950909 >> v1:172.21.15.55:6789/0 conn(0x7f0b3406e9d0 legacy=0x7f0b340cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b3259c640 1 -- 172.21.15.55:0/3452950909 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3415f5d0 con 0x7f0b34156180 2023-07-06T22:20:34.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.535+0000 7f0b32d9d640 1 --2- 172.21.15.55:0/3452950909 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b340cbeb0 0x7f0b3406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:34.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.539+0000 7f0b3259c640 1 --2- 172.21.15.55:0/3452950909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b34156180 0x7f0b340ca610 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009870 tx=0x7f0b2401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4c42a92a2bd567 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:34.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.539+0000 7f0b31d9b640 1 -- 172.21.15.55:0/3452950909 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240ab680 con 0x7f0b34156180 2023-07-06T22:20:34.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.539+0000 7f0b31d9b640 1 -- 172.21.15.55:0/3452950909 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b240ab7e0 con 0x7f0b34156180 2023-07-06T22:20:34.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.539+0000 7f0b31d9b640 1 -- 172.21.15.55:0/3452950909 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240abb70 con 0x7f0b34156180 2023-07-06T22:20:34.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.539+0000 7f0b38dfa640 1 -- 172.21.15.55:0/3452950909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b34156180 msgr2=0x7f0b340ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.539+0000 7f0b38dfa640 1 --2- 172.21.15.55:0/3452950909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b34156180 0x7f0b340ca610 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009870 tx=0x7f0b2401c480 comp rx=0 tx=0).stop 2023-07-06T22:20:34.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.539+0000 7f0b38dfa640 1 -- 172.21.15.55:0/3452950909 shutdown_connections 2023-07-06T22:20:34.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.539+0000 7f0b38dfa640 1 --2- 172.21.15.55:0/3452950909 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b340cbeb0 0x7f0b3406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.539+0000 7f0b38dfa640 1 --2- 172.21.15.55:0/3452950909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b34156180 0x7f0b340ca610 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.539+0000 7f0b38dfa640 1 -- 172.21.15.55:0/3452950909 >> 172.21.15.55:0/3452950909 conn(0x7f0b340d0c50 msgr2=0x7f0b340cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:34.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.539+0000 7f0b38dfa640 1 -- 172.21.15.55:0/3452950909 shutdown_connections 2023-07-06T22:20:34.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.539+0000 7f0b38dfa640 1 -- 172.21.15.55:0/3452950909 wait complete. 2023-07-06T22:20:34.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b38dfa640 1 Processor -- start 2023-07-06T22:20:34.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b38dfa640 1 -- start start 2023-07-06T22:20:34.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b38dfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b3406e9d0 0x7f0b34149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b38dfa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b340cbeb0 0x7f0b340c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b38dfa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b34156180 0x7f0b3415abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b38dfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b340c68f0 con 0x7f0b3406e9d0 2023-07-06T22:20:34.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b38dfa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b340b0bf0 con 0x7f0b34156180 2023-07-06T22:20:34.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b38dfa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b340b0ed0 con 0x7f0b340cbeb0 2023-07-06T22:20:34.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b3259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b3406e9d0 0x7f0b34149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b3259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b3406e9d0 0x7f0b34149d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58126/0 (socket says 172.21.15.55:58126) 2023-07-06T22:20:34.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b3259c640 1 -- 172.21.15.55:0/1732846032 learned_addr learned my addr 172.21.15.55:0/1732846032 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:34.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b340cbeb0 0x7f0b340c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b32d9d640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b34156180 0x7f0b3415abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b3259c640 1 -- 172.21.15.55:0/1732846032 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b340cbeb0 msgr2=0x7f0b340c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b3259c640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b340cbeb0 0x7f0b340c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b3259c640 1 -- 172.21.15.55:0/1732846032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b34156180 msgr2=0x7f0b3415abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b3259c640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b34156180 0x7f0b3415abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b3259c640 1 -- 172.21.15.55:0/1732846032 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b240094d0 con 0x7f0b3406e9d0 2023-07-06T22:20:34.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b340cbeb0 0x7f0b340c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:34.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b3259c640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b3406e9d0 0x7f0b34149d70 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f0b240ad040 tx=0x7f0b2401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:34.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b2affd640 1 -- 172.21.15.55:0/1732846032 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240b4800 con 0x7f0b3406e9d0 2023-07-06T22:20:34.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b2affd640 1 -- 172.21.15.55:0/1732846032 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b240b4980 con 0x7f0b3406e9d0 2023-07-06T22:20:34.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b2affd640 1 -- 172.21.15.55:0/1732846032 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240b4d30 con 0x7f0b3406e9d0 2023-07-06T22:20:34.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b38dfa640 1 -- 172.21.15.55:0/1732846032 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b340b11b0 con 0x7f0b3406e9d0 2023-07-06T22:20:34.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.543+0000 7f0b38dfa640 1 -- 172.21.15.55:0/1732846032 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b340b1770 con 0x7f0b3406e9d0 2023-07-06T22:20:34.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.547+0000 7f0b2affd640 1 -- 172.21.15.55:0/1732846032 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0b240b3380 con 0x7f0b3406e9d0 2023-07-06T22:20:34.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.547+0000 7f0b2affd640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f0b140663a0 0x7f0b14068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.547+0000 7f0b2affd640 1 -- 172.21.15.55:0/1732846032 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0b2411ebf0 con 0x7f0b3406e9d0 2023-07-06T22:20:34.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 Processor -- start 2023-07-06T22:20:34.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f0b140663a0 0x7f0b14068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 -- start start 2023-07-06T22:20:34.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f0b140663a0 0x7f0b14068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b340c3a40 tx=0x7f0b1c009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:34.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cba3740 0x55f88cba3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba4050 0x55f88cb59840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cb59d80 0x55f88cb5a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f88ca21ac0 con 0x55f88cb59d80 2023-07-06T22:20:34.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f88c95b840 con 0x55f88cba4050 2023-07-06T22:20:34.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f88c9af2e0 con 0x55f88cba3740 2023-07-06T22:20:34.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b32d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cb59d80 0x55f88cb5a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b32d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cb59d80 0x55f88cb5a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58130/0 (socket says 172.21.15.55:58130) 2023-07-06T22:20:34.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b32d9d640 1 -- 172.21.15.55:0/1867060846 learned_addr learned my addr 172.21.15.55:0/1867060846 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:34.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3259c640 1 --2- 172.21.15.55:0/1867060846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cba3740 0x55f88cba3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/1867060846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba4050 0x55f88cb59840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b32d9d640 1 -- 172.21.15.55:0/1867060846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cba3740 msgr2=0x55f88cba3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:34.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b32d9d640 1 --2- 172.21.15.55:0/1867060846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cba3740 0x55f88cba3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b32d9d640 1 -- 172.21.15.55:0/1867060846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba4050 msgr2=0x55f88cb59840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:34.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b32d9d640 1 --2- 172.21.15.55:0/1867060846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba4050 0x55f88cb59840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b32d9d640 1 -- 172.21.15.55:0/1867060846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f88c6a4890 con 0x55f88cb59d80 2023-07-06T22:20:34.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/1867060846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba4050 0x55f88cb59840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:34.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b32d9d640 1 --2- 172.21.15.55:0/1867060846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cb59d80 0x55f88cb5a150 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c00e4f0 tx=0x7f0b2c00e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b783315932622 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:34.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b13fff640 1 -- 172.21.15.55:0/1867060846 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c00c9d0 con 0x55f88cb59d80 2023-07-06T22:20:34.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b13fff640 1 -- 172.21.15.55:0/1867060846 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c00cb30 con 0x55f88cb59d80 2023-07-06T22:20:34.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b13fff640 1 -- 172.21.15.55:0/1867060846 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c00a410 con 0x55f88cb59d80 2023-07-06T22:20:34.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 -- 172.21.15.55:0/1867060846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cb59d80 msgr2=0x55f88cb5a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 --2- 172.21.15.55:0/1867060846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cb59d80 0x55f88cb5a150 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c00e4f0 tx=0x7f0b2c00e9b0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 -- 172.21.15.55:0/1867060846 shutdown_connections 2023-07-06T22:20:34.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 --2- 172.21.15.55:0/1867060846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cb59d80 0x55f88cb5a150 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 --2- 172.21.15.55:0/1867060846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba4050 0x55f88cb59840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 --2- 172.21.15.55:0/1867060846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cba3740 0x55f88cba3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 -- 172.21.15.55:0/1867060846 >> 172.21.15.55:0/1867060846 conn(0x55f88cb51800 msgr2=0x55f88cb60800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:34.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 -- 172.21.15.55:0/1867060846 shutdown_connections 2023-07-06T22:20:34.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.551+0000 7f0b3c141000 1 -- 172.21.15.55:0/1867060846 wait complete. 2023-07-06T22:20:34.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 1 -- start start 2023-07-06T22:20:34.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 1 Processor -- start 2023-07-06T22:20:34.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cb59d80 0x55f88cb5f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cba3740 0x55f88cb650e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba4050 0x55f88cb65620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f88c9a8380 con 0x55f88cba3740 2023-07-06T22:20:34.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f88c964ae0 con 0x55f88cba4050 2023-07-06T22:20:34.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f88c964780 con 0x55f88cb59d80 2023-07-06T22:20:34.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 10 client.0 _ll_register_callbacks cb 0x55f88cb45e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T22:20:34.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b2bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cba3740 0x55f88cb650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b2bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cba3740 0x55f88cb650e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58146/0 (socket says 172.21.15.55:58146) 2023-07-06T22:20:34.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b2bfff640 1 -- 172.21.15.55:0/3791342613 learned_addr learned my addr 172.21.15.55:0/3791342613 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:34.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3259c640 1 --2- 172.21.15.55:0/3791342613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cb59d80 0x55f88cb5f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b32d9d640 1 --2- 172.21.15.55:0/3791342613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba4050 0x55f88cb65620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b2bfff640 1 -- 172.21.15.55:0/3791342613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cb59d80 msgr2=0x55f88cb5f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:34.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/3791342613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cb59d80 0x55f88cb5f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b2bfff640 1 -- 172.21.15.55:0/3791342613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba4050 msgr2=0x55f88cb65620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:34.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/3791342613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba4050 0x55f88cb65620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b2bfff640 1 -- 172.21.15.55:0/3791342613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2c007cd0 con 0x55f88cba3740 2023-07-06T22:20:34.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/3791342613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cba3740 0x55f88cb650e0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0015c0 tx=0x7f0b1c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23fdff0760ecf53d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:34.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b117fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T22:20:34.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b117fa640 1 -- 172.21.15.55:0/3791342613 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c003b80 con 0x55f88cba3740 2023-07-06T22:20:34.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b117fa640 1 -- 172.21.15.55:0/3791342613 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0b1c022d50 con 0x55f88cba3740 2023-07-06T22:20:34.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 1 -- 172.21.15.55:0/3791342613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f88c96fa20 con 0x55f88cba3740 2023-07-06T22:20:34.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b117fa640 1 -- 172.21.15.55:0/3791342613 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b1c003ce0 con 0x55f88cba3740 2023-07-06T22:20:34.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 10 client.11166 fetch_fsmap learned FSMap version 87 2023-07-06T22:20:34.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 1 -- 172.21.15.55:0/3791342613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x55f88c96cd10 con 0x55f88cba3740 2023-07-06T22:20:34.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b117fa640 1 -- 172.21.15.55:0/3791342613 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f88c96fa20 con 0x55f88cba3740 2023-07-06T22:20:34.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b117fa640 1 -- 172.21.15.55:0/3791342613 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 87) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0b1c013420 con 0x55f88cba3740 2023-07-06T22:20:34.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 10 client.11166 fetch_fsmap finished waiting for FSMap version 87 2023-07-06T22:20:34.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 10 client.11166 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-06T22:20:34.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 20 client.11166 populate_metadata read hostname 'smithi055' 2023-07-06T22:20:34.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 1 --2- 172.21.15.55:0/3791342613 >> [v2:172.21.15.138:6833/3113237921,v1:172.21.15.138:6835/3113237921] conn(0x55f88cbb2c80 0x55f88cbb5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 4 client.11166 mds_command: new command op to 11001 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T22:20:34.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3c141000 1 -- 172.21.15.55:0/3791342613 --> [v2:172.21.15.138:6833/3113237921,v1:172.21.15.138:6835/3113237921] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f88c9d7710 con 0x55f88cbb2c80 2023-07-06T22:20:34.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.555+0000 7f0b3259c640 1 --2- 172.21.15.55:0/3791342613 >> [v2:172.21.15.138:6833/3113237921,v1:172.21.15.138:6835/3113237921] conn(0x55f88cbb2c80 0x55f88cbb5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b3259c640 1 --2- 172.21.15.55:0/3791342613 >> [v2:172.21.15.138:6833/3113237921,v1:172.21.15.138:6835/3113237921] conn(0x55f88cbb2c80 0x55f88cbb5060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d3e62cda099c243 server_cookie=5590a1ce3e9ccf8f in_seq=0 out_seq=0 2023-07-06T22:20:34.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b117fa640 10 client.11166 ms_handle_connect on v2:172.21.15.138:6833/3113237921 2023-07-06T22:20:34.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b117fa640 1 -- 172.21.15.55:0/3791342613 <== mds.0 v2:172.21.15.138:6833/3113237921 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f88c9d7710 con 0x55f88cbb2c80 2023-07-06T22:20:34.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b117fa640 10 client.11166 handle_command_reply: tid=0 2023-07-06T22:20:34.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b3c141000 1 client.11166 shutdown 2023-07-06T22:20:34.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b3c141000 1 -- 172.21.15.55:0/3791342613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cba3740 msgr2=0x55f88cb650e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b3c141000 1 --2- 172.21.15.55:0/3791342613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cba3740 0x55f88cb650e0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0015c0 tx=0x7f0b1c000ee0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b3c141000 1 -- 172.21.15.55:0/3791342613 shutdown_connections 2023-07-06T22:20:34.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b3c141000 1 --2- 172.21.15.55:0/3791342613 >> [v2:172.21.15.138:6833/3113237921,v1:172.21.15.138:6835/3113237921] conn(0x55f88cbb2c80 0x55f88cbb5060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b3c141000 1 --2- 172.21.15.55:0/3791342613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba4050 0x55f88cb65620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b3c141000 1 --2- 172.21.15.55:0/3791342613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cba3740 0x55f88cb650e0 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b3c141000 1 --2- 172.21.15.55:0/3791342613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cb59d80 0x55f88cb5f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b3c141000 1 -- 172.21.15.55:0/3791342613 >> 172.21.15.55:0/3791342613 conn(0x55f88cb51800 msgr2=0x55f88cb58830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:34.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b117fa640 0 client.11166 ms_handle_reset on v2:172.21.15.138:6833/3113237921 2023-07-06T22:20:34.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b3c141000 1 -- 172.21.15.55:0/3791342613 shutdown_connections 2023-07-06T22:20:34.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b3c141000 1 -- 172.21.15.55:0/3791342613 wait complete. 2023-07-06T22:20:34.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.559+0000 7f0b3c141000 20 client.11166 trim_cache size 0 max 16384 2023-07-06T22:20:34.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 Processor -- start 2023-07-06T22:20:34.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 -- start start 2023-07-06T22:20:34.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cb59d80 0x55f88cbb6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cba3740 0x55f88cbb3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cba4050 0x55f88cbb3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f88c665940 con 0x55f88cba3740 2023-07-06T22:20:34.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f88c950450 con 0x55f88cb59d80 2023-07-06T22:20:34.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f88c976e10 con 0x55f88cba4050 2023-07-06T22:20:34.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b2bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cba3740 0x55f88cbb3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b2bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cba3740 0x55f88cbb3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58150/0 (socket says 172.21.15.55:58150) 2023-07-06T22:20:34.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b2bfff640 1 -- 172.21.15.55:0/817779403 learned_addr learned my addr 172.21.15.55:0/817779403 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:34.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b2bfff640 1 -- 172.21.15.55:0/817779403 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cba4050 msgr2=0x55f88cbb3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:34.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/817779403 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cba4050 0x55f88cbb3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b2bfff640 1 -- 172.21.15.55:0/817779403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cb59d80 msgr2=0x55f88cbb6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:34.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/817779403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cb59d80 0x55f88cbb6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b2bfff640 1 -- 172.21.15.55:0/817779403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f88cb5c450 con 0x55f88cba3740 2023-07-06T22:20:34.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/817779403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cba3740 0x55f88cbb3050 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009010 tx=0x7f0b1c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bad8b722e87ffc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:34.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b28ff9640 1 -- 172.21.15.55:0/817779403 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c013980 con 0x55f88cba3740 2023-07-06T22:20:34.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b28ff9640 1 -- 172.21.15.55:0/817779403 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c00e580 con 0x55f88cba3740 2023-07-06T22:20:34.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b28ff9640 1 -- 172.21.15.55:0/817779403 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c013420 con 0x55f88cba3740 2023-07-06T22:20:34.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 -- 172.21.15.55:0/817779403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cba3740 msgr2=0x55f88cbb3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 --2- 172.21.15.55:0/817779403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cba3740 0x55f88cbb3050 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009010 tx=0x7f0b1c01f000 comp rx=0 tx=0).stop 2023-07-06T22:20:34.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 -- 172.21.15.55:0/817779403 shutdown_connections 2023-07-06T22:20:34.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 --2- 172.21.15.55:0/817779403 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cba4050 0x55f88cbb3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 --2- 172.21.15.55:0/817779403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cba3740 0x55f88cbb3050 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 --2- 172.21.15.55:0/817779403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cb59d80 0x55f88cbb6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 -- 172.21.15.55:0/817779403 >> 172.21.15.55:0/817779403 conn(0x55f88cb51800 msgr2=0x55f88cb58eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:34.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 -- 172.21.15.55:0/817779403 shutdown_connections 2023-07-06T22:20:34.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.575+0000 7f0b3c141000 1 -- 172.21.15.55:0/817779403 wait complete. 2023-07-06T22:20:34.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 1 -- start start 2023-07-06T22:20:34.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 1 Processor -- start 2023-07-06T22:20:34.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cb59d80 0x55f88cbb6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba3740 0x55f88cbbe4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cba4050 0x55f88cbbea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f88cb5e330 con 0x55f88cb59d80 2023-07-06T22:20:34.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f88c9a3cf0 con 0x55f88cba3740 2023-07-06T22:20:34.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f88c945a80 con 0x55f88cba4050 2023-07-06T22:20:34.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 10 client.0 _ll_register_callbacks cb 0x55f88c96c7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T22:20:34.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cb59d80 0x55f88cbb6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cb59d80 0x55f88cbb6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58152/0 (socket says 172.21.15.55:58152) 2023-07-06T22:20:34.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3259c640 1 -- 172.21.15.55:0/4244755654 learned_addr learned my addr 172.21.15.55:0/4244755654 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:34.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b32d9d640 1 --2- 172.21.15.55:0/4244755654 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cba4050 0x55f88cbbea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/4244755654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba3740 0x55f88cbbe4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3259c640 1 -- 172.21.15.55:0/4244755654 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cba4050 msgr2=0x55f88cbbea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:34.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3259c640 1 --2- 172.21.15.55:0/4244755654 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cba4050 0x55f88cbbea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3259c640 1 -- 172.21.15.55:0/4244755654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba3740 msgr2=0x55f88cbbe4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:34.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3259c640 1 --2- 172.21.15.55:0/4244755654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba3740 0x55f88cbbe4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3259c640 1 -- 172.21.15.55:0/4244755654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f88c96cd10 con 0x55f88cb59d80 2023-07-06T22:20:34.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3259c640 1 --2- 172.21.15.55:0/4244755654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cb59d80 0x55f88cbb6710 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f0b2401c960 tx=0x7f0b240edde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e7e521e74b6db6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:34.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b117fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-07-06T22:20:34.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b117fa640 1 -- 172.21.15.55:0/4244755654 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2411d030 con 0x55f88cb59d80 2023-07-06T22:20:34.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b117fa640 1 -- 172.21.15.55:0/4244755654 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0b240f7850 con 0x55f88cb59d80 2023-07-06T22:20:34.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 1 -- 172.21.15.55:0/4244755654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f88cb5d6a0 con 0x55f88cb59d80 2023-07-06T22:20:34.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b117fa640 1 -- 172.21.15.55:0/4244755654 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b240f7a30 con 0x55f88cb59d80 2023-07-06T22:20:34.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 10 client.11172 fetch_fsmap learned FSMap version 87 2023-07-06T22:20:34.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 1 -- 172.21.15.55:0/4244755654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x55f88c952fa0 con 0x55f88cb59d80 2023-07-06T22:20:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b117fa640 1 -- 172.21.15.55:0/4244755654 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f88cb5d6a0 con 0x55f88cb59d80 2023-07-06T22:20:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b117fa640 1 -- 172.21.15.55:0/4244755654 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 87) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0b240eb830 con 0x55f88cb59d80 2023-07-06T22:20:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 10 client.11172 fetch_fsmap finished waiting for FSMap version 87 2023-07-06T22:20:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 10 client.11172 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-06T22:20:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 20 client.11172 populate_metadata read hostname 'smithi055' 2023-07-06T22:20:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 1 --2- 172.21.15.55:0/4244755654 >> [v2:172.21.15.138:6833/3113237921,v1:172.21.15.138:6835/3113237921] conn(0x55f88cc01fd0 0x55f88cc023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 4 client.11172 mds_command: new command op to 11001 tid=0[{"prefix": "status"}] 2023-07-06T22:20:34.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b3c141000 1 -- 172.21.15.55:0/4244755654 --> [v2:172.21.15.138:6833/3113237921,v1:172.21.15.138:6835/3113237921] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f88c9a6cd0 con 0x55f88cc01fd0 2023-07-06T22:20:34.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.579+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/4244755654 >> [v2:172.21.15.138:6833/3113237921,v1:172.21.15.138:6835/3113237921] conn(0x55f88cc01fd0 0x55f88cc023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b117fa640 10 client.11172 ms_handle_connect on v2:172.21.15.138:6833/3113237921 2023-07-06T22:20:34.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b2bfff640 1 --2- 172.21.15.55:0/4244755654 >> [v2:172.21.15.138:6833/3113237921,v1:172.21.15.138:6835/3113237921] conn(0x55f88cc01fd0 0x55f88cc023a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5ad742726974600 server_cookie=d104016577e2beba in_seq=0 out_seq=0 2023-07-06T22:20:34.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b117fa640 1 -- 172.21.15.55:0/4244755654 <== mds.0 v2:172.21.15.138:6833/3113237921 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x55f88c9a6cd0 con 0x55f88cc01fd0 2023-07-06T22:20:34.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b117fa640 10 client.11172 handle_command_reply: tid=0 2023-07-06T22:20:34.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b3c141000 1 client.11172 shutdown 2023-07-06T22:20:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b3c141000 1 -- 172.21.15.55:0/4244755654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cb59d80 msgr2=0x55f88cbb6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b3c141000 1 --2- 172.21.15.55:0/4244755654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cb59d80 0x55f88cbb6710 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f0b2401c960 tx=0x7f0b240edde0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b3c141000 1 -- 172.21.15.55:0/4244755654 shutdown_connections 2023-07-06T22:20:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b3c141000 1 --2- 172.21.15.55:0/4244755654 >> [v2:172.21.15.138:6833/3113237921,v1:172.21.15.138:6835/3113237921] conn(0x55f88cc01fd0 0x55f88cc023a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b3c141000 1 --2- 172.21.15.55:0/4244755654 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55f88cba4050 0x55f88cbbea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b3c141000 1 --2- 172.21.15.55:0/4244755654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f88cba3740 0x55f88cbbe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b117fa640 0 client.11172 ms_handle_reset on v2:172.21.15.138:6833/3113237921 2023-07-06T22:20:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b3c141000 1 --2- 172.21.15.55:0/4244755654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f88cb59d80 0x55f88cbb6710 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b3c141000 1 -- 172.21.15.55:0/4244755654 >> 172.21.15.55:0/4244755654 conn(0x55f88cb51800 msgr2=0x55f88cba2070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b3c141000 1 -- 172.21.15.55:0/4244755654 shutdown_connections 2023-07-06T22:20:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b3c141000 1 -- 172.21.15.55:0/4244755654 wait complete. 2023-07-06T22:20:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b3c141000 20 client.11172 trim_cache size 0 max 16384 2023-07-06T22:20:34.594 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:20:34.594 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c64f3ef1-e769-47b3-ae15-a714e4e7c4f7", 2023-07-06T22:20:34.594 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-07-06T22:20:34.594 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 11001, 2023-07-06T22:20:34.594 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-07-06T22:20:34.594 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-07-06T22:20:34.594 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-07-06T22:20:34.595 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.853028785999999, 2023-07-06T22:20:34.595 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 87, 2023-07-06T22:20:34.595 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 196, 2023-07-06T22:20:34.595 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 196, 2023-07-06T22:20:34.595 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 16.137981713999999 2023-07-06T22:20:34.595 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:20:34.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b38dfa640 1 -- 172.21.15.55:0/1732846032 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f0b140663a0 msgr2=0x7f0b14068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b38dfa640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f0b140663a0 0x7f0b14068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b340c3a40 tx=0x7f0b1c009040 comp rx=0 tx=0).stop 2023-07-06T22:20:34.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b38dfa640 1 -- 172.21.15.55:0/1732846032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b3406e9d0 msgr2=0x7f0b34149d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b38dfa640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b3406e9d0 0x7f0b34149d70 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f0b240ad040 tx=0x7f0b2401acc0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b38dfa640 1 -- 172.21.15.55:0/1732846032 shutdown_connections 2023-07-06T22:20:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b38dfa640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f0b140663a0 0x7f0b14068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b38dfa640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b34156180 0x7f0b3415abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b38dfa640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b340cbeb0 0x7f0b340c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b38dfa640 1 --2- 172.21.15.55:0/1732846032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b3406e9d0 0x7f0b34149d70 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b38dfa640 1 -- 172.21.15.55:0/1732846032 >> 172.21.15.55:0/1732846032 conn(0x7f0b340d0c50 msgr2=0x7f0b340cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:34.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b38dfa640 1 -- 172.21.15.55:0/1732846032 shutdown_connections 2023-07-06T22:20:34.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.583+0000 7f0b38dfa640 1 -- 172.21.15.55:0/1732846032 wait complete. 2023-07-06T22:20:34.604 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T22:20:34.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.743+0000 7f1daaa19640 1 Processor -- start 2023-07-06T22:20:34.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.743+0000 7f1daaa19640 1 -- start start 2023-07-06T22:20:34.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1daaa19640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1da4158400 0x7f1da40c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1daaa19640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1da40c9680 0x7f1da4070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1daaa19640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1da40710c0 0x7f1da40cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1daaa19640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da406fae0 con 0x7f1da40c9680 2023-07-06T22:20:34.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1daaa19640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da406fdc0 con 0x7f1da4158400 2023-07-06T22:20:34.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1daaa19640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40700a0 con 0x7f1da40710c0 2023-07-06T22:20:34.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1da37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1da40c9680 0x7f1da4070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1da37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1da40c9680 0x7f1da4070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58168/0 (socket says 172.21.15.55:58168) 2023-07-06T22:20:34.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1da37fe640 1 -- 172.21.15.55:0/2259232689 learned_addr learned my addr 172.21.15.55:0/2259232689 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:34.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1da3fff640 1 --2- 172.21.15.55:0/2259232689 >> v2:172.21.15.138:3300/0 conn(0x7f1da4158400 0x7f1da40c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1da8fb6640 1 --2- 172.21.15.55:0/2259232689 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1da40710c0 0x7f1da40cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1da37fe640 1 -- 172.21.15.55:0/2259232689 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1da40710c0 msgr2=0x7f1da40cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:34.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1da37fe640 1 --2- 172.21.15.55:0/2259232689 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1da40710c0 0x7f1da40cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1da37fe640 1 -- 172.21.15.55:0/2259232689 >> v2:172.21.15.138:3300/0 conn(0x7f1da4158400 msgr2=0x7f1da40c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:34.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1da37fe640 1 --2- 172.21.15.55:0/2259232689 >> v2:172.21.15.138:3300/0 conn(0x7f1da4158400 0x7f1da40c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.747+0000 7f1da37fe640 1 -- 172.21.15.55:0/2259232689 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da4070380 con 0x7f1da40c9680 2023-07-06T22:20:34.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1da37fe640 1 --2- 172.21.15.55:0/2259232689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da40c9680 0x7f1da4070b80 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f1da406ed50 tx=0x7f1d9801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784e5af0df316050 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:34.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1da2ffd640 1 -- 172.21.15.55:0/2259232689 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d980aa610 con 0x7f1da40c9680 2023-07-06T22:20:34.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1da2ffd640 1 -- 172.21.15.55:0/2259232689 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d980a6040 con 0x7f1da40c9680 2023-07-06T22:20:34.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1da2ffd640 1 -- 172.21.15.55:0/2259232689 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d980aa990 con 0x7f1da40c9680 2023-07-06T22:20:34.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1daaa19640 1 -- 172.21.15.55:0/2259232689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da40c9680 msgr2=0x7f1da4070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1daaa19640 1 --2- 172.21.15.55:0/2259232689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da40c9680 0x7f1da4070b80 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f1da406ed50 tx=0x7f1d9801c4d0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1daaa19640 1 -- 172.21.15.55:0/2259232689 shutdown_connections 2023-07-06T22:20:34.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1daaa19640 1 --2- 172.21.15.55:0/2259232689 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1da40710c0 0x7f1da40cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1daaa19640 1 --2- 172.21.15.55:0/2259232689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da40c9680 0x7f1da4070b80 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1daaa19640 1 --2- 172.21.15.55:0/2259232689 >> v2:172.21.15.138:3300/0 conn(0x7f1da4158400 0x7f1da40c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1daaa19640 1 -- 172.21.15.55:0/2259232689 >> 172.21.15.55:0/2259232689 conn(0x7f1da40cded0 msgr2=0x7f1da40ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:34.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1daaa19640 1 -- 172.21.15.55:0/2259232689 shutdown_connections 2023-07-06T22:20:34.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1daaa19640 1 -- 172.21.15.55:0/2259232689 wait complete. 2023-07-06T22:20:34.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1daaa19640 1 Processor -- start 2023-07-06T22:20:34.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.751+0000 7f1daaa19640 1 -- start start 2023-07-06T22:20:34.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1daaa19640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1da40710c0 0x7f1da41511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1daaa19640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1da40c9680 0x7f1da40b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1daaa19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da4158400 0x7f1da414beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1daaa19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40c5740 con 0x7f1da4158400 2023-07-06T22:20:34.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1daaa19640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40c5540 con 0x7f1da40710c0 2023-07-06T22:20:34.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1daaa19640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40698f0 con 0x7f1da40c9680 2023-07-06T22:20:34.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da8fb6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da4158400 0x7f1da414beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da8fb6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da4158400 0x7f1da414beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58182/0 (socket says 172.21.15.55:58182) 2023-07-06T22:20:34.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da8fb6640 1 -- 172.21.15.55:0/2951041227 learned_addr learned my addr 172.21.15.55:0/2951041227 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:34.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da3fff640 1 --2- 172.21.15.55:0/2951041227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1da40710c0 0x7f1da41511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da37fe640 1 --2- 172.21.15.55:0/2951041227 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1da40c9680 0x7f1da40b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da8fb6640 1 -- 172.21.15.55:0/2951041227 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1da40c9680 msgr2=0x7f1da40b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da8fb6640 1 --2- 172.21.15.55:0/2951041227 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1da40c9680 0x7f1da40b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da8fb6640 1 -- 172.21.15.55:0/2951041227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1da40710c0 msgr2=0x7f1da41511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da8fb6640 1 --2- 172.21.15.55:0/2951041227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1da40710c0 0x7f1da41511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da8fb6640 1 -- 172.21.15.55:0/2951041227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d980094d0 con 0x7f1da4158400 2023-07-06T22:20:34.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da8fb6640 1 --2- 172.21.15.55:0/2951041227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da4158400 0x7f1da414beb0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c007e30 tx=0x7f1d9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:34.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da0ff9640 1 -- 172.21.15.55:0/2951041227 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c014420 con 0x7f1da4158400 2023-07-06T22:20:34.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da0ff9640 1 -- 172.21.15.55:0/2951041227 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c014580 con 0x7f1da4158400 2023-07-06T22:20:34.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da0ff9640 1 -- 172.21.15.55:0/2951041227 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c014930 con 0x7f1da4158400 2023-07-06T22:20:34.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1daaa19640 1 -- 172.21.15.55:0/2951041227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da4069c30 con 0x7f1da4158400 2023-07-06T22:20:34.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1daaa19640 1 -- 172.21.15.55:0/2951041227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da4151710 con 0x7f1da4158400 2023-07-06T22:20:34.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1daaa19640 1 -- 172.21.15.55:0/2951041227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da406c580 con 0x7f1da4158400 2023-07-06T22:20:34.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.755+0000 7f1da0ff9640 1 -- 172.21.15.55:0/2951041227 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1d9c014a90 con 0x7f1da4158400 2023-07-06T22:20:34.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.759+0000 7f1da0ff9640 1 --2- 172.21.15.55:0/2951041227 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f1d900663a0 0x7f1d90068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:34.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.759+0000 7f1da0ff9640 1 -- 172.21.15.55:0/2951041227 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1d9c084860 con 0x7f1da4158400 2023-07-06T22:20:34.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.759+0000 7f1da3fff640 1 --2- 172.21.15.55:0/2951041227 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f1d900663a0 0x7f1d90068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:34.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.759+0000 7f1da3fff640 1 --2- 172.21.15.55:0/2951041227 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f1d900663a0 0x7f1d90068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1d940079c0 tx=0x7f1d94008040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:34.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.763+0000 7f1da0ff9640 1 -- 172.21.15.55:0/2951041227 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d9c055510 con 0x7f1da4158400 2023-07-06T22:20:34.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.951+0000 7f1daaa19640 1 -- 172.21.15.55:0/2951041227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1da40c5880 con 0x7f1da4158400 2023-07-06T22:20:34.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.951+0000 7f1da0ff9640 1 -- 172.21.15.55:0/2951041227 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v87) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1d9c009960 con 0x7f1da4158400 2023-07-06T22:20:34.954 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T22:20:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.955+0000 7f1daaa19640 1 -- 172.21.15.55:0/2951041227 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f1d900663a0 msgr2=0x7f1d90068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.955+0000 7f1daaa19640 1 --2- 172.21.15.55:0/2951041227 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f1d900663a0 0x7f1d90068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1d940079c0 tx=0x7f1d94008040 comp rx=0 tx=0).stop 2023-07-06T22:20:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.955+0000 7f1daaa19640 1 -- 172.21.15.55:0/2951041227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da4158400 msgr2=0x7f1da414beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.955+0000 7f1daaa19640 1 --2- 172.21.15.55:0/2951041227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da4158400 0x7f1da414beb0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c007e30 tx=0x7f1d9c00e4b0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.955+0000 7f1daaa19640 1 -- 172.21.15.55:0/2951041227 shutdown_connections 2023-07-06T22:20:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.955+0000 7f1daaa19640 1 --2- 172.21.15.55:0/2951041227 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f1d900663a0 0x7f1d90068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.955+0000 7f1daaa19640 1 --2- 172.21.15.55:0/2951041227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da4158400 0x7f1da414beb0 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.955+0000 7f1daaa19640 1 --2- 172.21.15.55:0/2951041227 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1da40c9680 0x7f1da40b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.955+0000 7f1daaa19640 1 --2- 172.21.15.55:0/2951041227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1da40710c0 0x7f1da41511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.955+0000 7f1daaa19640 1 -- 172.21.15.55:0/2951041227 >> 172.21.15.55:0/2951041227 conn(0x7f1da40cded0 msgr2=0x7f1da4156450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.955+0000 7f1daaa19640 1 -- 172.21.15.55:0/2951041227 shutdown_connections 2023-07-06T22:20:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:34.955+0000 7f1daaa19640 1 -- 172.21.15.55:0/2951041227 wait complete. 2023-07-06T22:20:34.975 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T22:20:34.975 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T22:20:34.976 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-07-06T22:20:34.976 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T22:20:34.976 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T22:20:34.976 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T22:20:34.977 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-06T22:20:34.977 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T22:20:34.977 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:20:34.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:34.978 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-07-06T22:20:34.987 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T22:20:34.988 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T22:20:34.988 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T22:20:34.988 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:20:34.988 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-07-06T22:20:34.988 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:20:34.989 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:20:34.989 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:20:34.989 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-07-06T22:20:34.989 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:20:34.989 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:20:34.989 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-07-06T22:20:34.989 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T22:20:34.990 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:20:34.990 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-07-06T22:20:34.990 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-06T22:20:34.990 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 40122sec preferred_lft 40122sec 2023-07-06T22:20:34.990 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-07-06T22:20:34.990 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:20:34.990 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-06T22:20:34.991 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:20:34.991 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-07-06T22:20:34.991 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-06T22:20:34.991 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:84:fe:b8:21 brd ff:ff:ff:ff:ff:ff 2023-07-06T22:20:34.991 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-06T22:20:34.991 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:20:34.991 INFO:teuthology.orchestra.run.smithi055.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T22:20:34.992 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-06T22:20:34.992 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T22:20:34.992 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:20:34.992 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-06T22:20:34.992 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:20:34.992 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T22:20:34.992 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T22:20:34.993 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-06T22:20:34.993 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:20:34.993 INFO:teuthology.orchestra.run.smithi055.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T22:20:34.993 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T22:20:34.993 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-06T22:20:34.993 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-07-06T22:20:34.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:34.995 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T22:20:35.058 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-07-06T22:20:35.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:35.060 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-07-06T22:20:35.116 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-07-06T22:20:35.117 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T22:20:35.117 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-06T22:20:35.117 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-06T22:20:35.117 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-06T22:20:35.117 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T22:20:35.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:35.118 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-07-06T22:20:35.118 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-07-06T22:20:35.118 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T22:20:35.119 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T22:20:35.119 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T22:20:35.119 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-07-06T22:20:35.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:35.217 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T22:20:35.226 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T22:20:35.226 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T22:20:35.227 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:20:35.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:35.227 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-07-06T22:20:35.292 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T22:20:35.292 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T22:20:35.343 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T22:20:35.343 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T22:20:35.344 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T22:20:35.394 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-06T22:20:35.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:35.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:20:35.486 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:20:35.486 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T22:20:35.501 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T22:20:35.501 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T22:20:35.501 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-07-06T22:20:35.501 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@c64f3ef1-e769-47b3-ae15-a714e4e7c4f7.cephfs=/ 2023-07-06T22:20:35.501 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-07-06T22:20:35.504 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T22:20:35.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:35.505 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T22:20:35.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:35.526 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T22:20:35.590 INFO:teuthology.orchestra.run.smithi055.stdout:client10273 2023-07-06T22:20:35.591 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:20:35.591 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:35.639 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-06T22:20:35.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.819+0000 7ff71ada9640 1 Processor -- start 2023-07-06T22:20:35.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.819+0000 7ff71ada9640 1 -- start start 2023-07-06T22:20:35.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.819+0000 7ff71ada9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7140c8b60 0x7ff7140cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:35.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff71ada9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff71406c380 0x7ff7140cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:35.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff71ada9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71406f910 con 0x7ff71415bac0 2023-07-06T22:20:35.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff71ada9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71415be90 con 0x7ff71406c380 2023-07-06T22:20:35.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff71ada9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71406fb60 con 0x7ff7140c8b60 2023-07-06T22:20:35.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff71a5a8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff71406c380 0x7ff7140cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:35.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff71a5a8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff71406c380 0x7ff7140cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58194/0 (socket says 172.21.15.55:58194) 2023-07-06T22:20:35.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff71a5a8640 1 -- 172.21.15.55:0/3306554070 learned_addr learned my addr 172.21.15.55:0/3306554070 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:35.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff7195a6640 1 --2- 172.21.15.55:0/3306554070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7140c8b60 0x7ff7140cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:35.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff71a5a8640 1 -- 172.21.15.55:0/3306554070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7140c8b60 msgr2=0x7ff7140cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:35.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff71a5a8640 1 --2- 172.21.15.55:0/3306554070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7140c8b60 0x7ff7140cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:35.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff71a5a8640 1 -- 172.21.15.55:0/3306554070 >> v1:172.21.15.55:6789/0 conn(0x7ff71415bac0 legacy=0x7ff7140c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:35.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff71a5a8640 1 -- 172.21.15.55:0/3306554070 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71406fe40 con 0x7ff71406c380 2023-07-06T22:20:35.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff7195a6640 1 --2- 172.21.15.55:0/3306554070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7140c8b60 0x7ff7140cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:35.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff71a5a8640 1 --2- 172.21.15.55:0/3306554070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71406c380 0x7ff7140cbd00 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009e50 tx=0x7ff70c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3964e668b9131386 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:35.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff718da5640 1 -- 172.21.15.55:0/3306554070 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0a56a0 con 0x7ff71406c380 2023-07-06T22:20:35.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff718da5640 1 -- 172.21.15.55:0/3306554070 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c0a5800 con 0x7ff71406c380 2023-07-06T22:20:35.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.823+0000 7ff718da5640 1 -- 172.21.15.55:0/3306554070 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0a5b90 con 0x7ff71406c380 2023-07-06T22:20:35.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 -- 172.21.15.55:0/3306554070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71406c380 msgr2=0x7ff7140cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:35.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 --2- 172.21.15.55:0/3306554070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71406c380 0x7ff7140cbd00 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009e50 tx=0x7ff70c01c8f0 comp rx=0 tx=0).stop 2023-07-06T22:20:35.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 -- 172.21.15.55:0/3306554070 shutdown_connections 2023-07-06T22:20:35.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 --2- 172.21.15.55:0/3306554070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7140c8b60 0x7ff7140cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:35.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 --2- 172.21.15.55:0/3306554070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71406c380 0x7ff7140cbd00 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:35.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 -- 172.21.15.55:0/3306554070 >> 172.21.15.55:0/3306554070 conn(0x7ff7140b0410 msgr2=0x7ff7140cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:35.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 -- 172.21.15.55:0/3306554070 shutdown_connections 2023-07-06T22:20:35.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 -- 172.21.15.55:0/3306554070 wait complete. 2023-07-06T22:20:35.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 Processor -- start 2023-07-06T22:20:35.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 -- start start 2023-07-06T22:20:35.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff71406c380 0x7ff714161c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:35.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7140c8b60 0x7ff714143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:35.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71415bac0 0x7ff714144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:35.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140c3ca0 con 0x7ff71415bac0 2023-07-06T22:20:35.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140c3f80 con 0x7ff7140c8b60 2023-07-06T22:20:35.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71ada9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140c4260 con 0x7ff71406c380 2023-07-06T22:20:35.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71a5a8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71415bac0 0x7ff714144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:35.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71a5a8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71415bac0 0x7ff714144170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58210/0 (socket says 172.21.15.55:58210) 2023-07-06T22:20:35.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff71a5a8640 1 -- 172.21.15.55:0/2073881890 learned_addr learned my addr 172.21.15.55:0/2073881890 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:35.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff7195a6640 1 --2- 172.21.15.55:0/2073881890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7140c8b60 0x7ff714143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:35.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.827+0000 7ff719da7640 1 --2- 172.21.15.55:0/2073881890 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff71406c380 0x7ff714161c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:35.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff71a5a8640 1 -- 172.21.15.55:0/2073881890 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff71406c380 msgr2=0x7ff714161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:35.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff71a5a8640 1 --2- 172.21.15.55:0/2073881890 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff71406c380 0x7ff714161c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff71a5a8640 1 -- 172.21.15.55:0/2073881890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7140c8b60 msgr2=0x7ff714143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff71a5a8640 1 --2- 172.21.15.55:0/2073881890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7140c8b60 0x7ff714143c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff71a5a8640 1 -- 172.21.15.55:0/2073881890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c009b30 con 0x7ff71415bac0 2023-07-06T22:20:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff71a5a8640 1 --2- 172.21.15.55:0/2073881890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71415bac0 0x7ff714144170 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7ff70c01a520 tx=0x7ff70c019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff70a7fc640 1 -- 172.21.15.55:0/2073881890 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0b8670 con 0x7ff71415bac0 2023-07-06T22:20:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff70a7fc640 1 -- 172.21.15.55:0/2073881890 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c0b87d0 con 0x7ff71415bac0 2023-07-06T22:20:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff70a7fc640 1 -- 172.21.15.55:0/2073881890 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0b8b60 con 0x7ff71415bac0 2023-07-06T22:20:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff71ada9640 1 -- 172.21.15.55:0/2073881890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7140c5d70 con 0x7ff71415bac0 2023-07-06T22:20:35.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff71ada9640 1 -- 172.21.15.55:0/2073881890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7141621b0 con 0x7ff71415bac0 2023-07-06T22:20:35.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff71ada9640 1 -- 172.21.15.55:0/2073881890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff714162340 con 0x7ff71415bac0 2023-07-06T22:20:35.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff70a7fc640 1 -- 172.21.15.55:0/2073881890 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff70c0b8cc0 con 0x7ff71415bac0 2023-07-06T22:20:35.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff70a7fc640 1 --2- 172.21.15.55:0/2073881890 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff6f80663a0 0x7ff6f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:35.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.831+0000 7ff70a7fc640 1 -- 172.21.15.55:0/2073881890 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff70c11f4d0 con 0x7ff71415bac0 2023-07-06T22:20:35.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.835+0000 7ff719da7640 1 --2- 172.21.15.55:0/2073881890 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff6f80663a0 0x7ff6f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:35.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.835+0000 7ff719da7640 1 --2- 172.21.15.55:0/2073881890 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff6f80663a0 0x7ff6f8068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff710000f70 tx=0x7ff710009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:35.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:35.839+0000 7ff70a7fc640 1 -- 172.21.15.55:0/2073881890 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff70c0ec890 con 0x7ff71415bac0 2023-07-06T22:20:36.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.011+0000 7ff71ada9640 1 -- 172.21.15.55:0/2073881890 --> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff71404d790 con 0x7ff6f80663a0 2023-07-06T22:20:36.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.011+0000 7ff70a7fc640 1 -- 172.21.15.55:0/2073881890 <== mgr.10752 v2:172.21.15.55:6832/538997467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff71404d790 con 0x7ff6f80663a0 2023-07-06T22:20:36.015 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-07-06T22:20:36.015 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-07-06T22:20:36.016 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-07-06T22:20:36.016 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-07-06T22:20:36.016 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-07-06T22:20:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.015+0000 7ff71ada9640 1 -- 172.21.15.55:0/2073881890 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff6f80663a0 msgr2=0x7ff6f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.015+0000 7ff71ada9640 1 --2- 172.21.15.55:0/2073881890 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff6f80663a0 0x7ff6f8068850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff710000f70 tx=0x7ff710009040 comp rx=0 tx=0).stop 2023-07-06T22:20:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.015+0000 7ff71ada9640 1 -- 172.21.15.55:0/2073881890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71415bac0 msgr2=0x7ff714144170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.015+0000 7ff71ada9640 1 --2- 172.21.15.55:0/2073881890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71415bac0 0x7ff714144170 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7ff70c01a520 tx=0x7ff70c019690 comp rx=0 tx=0).stop 2023-07-06T22:20:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.015+0000 7ff71ada9640 1 -- 172.21.15.55:0/2073881890 shutdown_connections 2023-07-06T22:20:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.015+0000 7ff71ada9640 1 --2- 172.21.15.55:0/2073881890 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff6f80663a0 0x7ff6f8068850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.015+0000 7ff71ada9640 1 --2- 172.21.15.55:0/2073881890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71415bac0 0x7ff714144170 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.015+0000 7ff71ada9640 1 --2- 172.21.15.55:0/2073881890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7140c8b60 0x7ff714143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.015+0000 7ff71ada9640 1 --2- 172.21.15.55:0/2073881890 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff71406c380 0x7ff714161c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.015+0000 7ff71ada9640 1 -- 172.21.15.55:0/2073881890 >> 172.21.15.55:0/2073881890 conn(0x7ff7140b0410 msgr2=0x7ff714153170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.015+0000 7ff71ada9640 1 -- 172.21.15.55:0/2073881890 shutdown_connections 2023-07-06T22:20:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.015+0000 7ff71ada9640 1 -- 172.21.15.55:0/2073881890 wait complete. 2023-07-06T22:20:36.036 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-06T22:20:36.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.179+0000 7ff671234640 1 Processor -- start 2023-07-06T22:20:36.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.179+0000 7ff671234640 1 -- start start 2023-07-06T22:20:36.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.183+0000 7ff671234640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff66c0ca130 0x7ff66c0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:36.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.183+0000 7ff671234640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c158cb0 con 0x7ff66c158850 2023-07-06T22:20:36.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.183+0000 7ff671234640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c0c8db0 con 0x7ff66c0cd140 2023-07-06T22:20:36.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.183+0000 7ff671234640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0c9090 con 0x7ff66c0ca130 2023-07-06T22:20:36.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.183+0000 7ff66ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff66c158850 0x7ff66c0cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39358/0 (socket says 172.21.15.55:39358) 2023-07-06T22:20:36.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.183+0000 7ff66ad9d640 1 -- 172.21.15.55:0/1312709193 learned_addr learned my addr 172.21.15.55:0/1312709193 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:36.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.183+0000 7ff663fff640 1 --2- 172.21.15.55:0/1312709193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff66c0ca130 0x7ff66c0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:36.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.183+0000 7ff66a59c640 1 -- 172.21.15.55:0/1312709193 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419880323 0 0) 0x7ff66c158cb0 con 0x7ff66c158850 2023-07-06T22:20:36.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.183+0000 7ff66a59c640 1 -- 172.21.15.55:0/1312709193 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff658003530 con 0x7ff66c158850 2023-07-06T22:20:36.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.183+0000 7ff66a59c640 1 -- 172.21.15.55:0/1312709193 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114448246 0 0) 0x7ff66c0c8db0 con 0x7ff66c0cd140 2023-07-06T22:20:36.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.183+0000 7ff663fff640 1 -- 172.21.15.55:0/1312709193 >> v1:172.21.15.138:6789/0 conn(0x7ff66c0cd140 legacy=0x7ff66c0b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:36.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.183+0000 7ff663fff640 1 -- 172.21.15.55:0/1312709193 >> v1:172.21.15.55:6789/0 conn(0x7ff66c158850 legacy=0x7ff66c0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:36.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.183+0000 7ff663fff640 1 -- 172.21.15.55:0/1312709193 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c0c9370 con 0x7ff66c0ca130 2023-07-06T22:20:36.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.187+0000 7ff663fff640 1 --2- 172.21.15.55:0/1312709193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff66c0ca130 0x7ff66c0703e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff6540097f0 tx=0x7ff65401e4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c1c54a93f84aafd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:36.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.187+0000 7ff66a59c640 1 -- 172.21.15.55:0/1312709193 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c001600 con 0x7ff66c0ca130 2023-07-06T22:20:36.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.187+0000 7ff66a59c640 1 -- 172.21.15.55:0/1312709193 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6540a8040 con 0x7ff66c0ca130 2023-07-06T22:20:36.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.187+0000 7ff66a59c640 1 -- 172.21.15.55:0/1312709193 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540ac630 con 0x7ff66c0ca130 2023-07-06T22:20:36.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.187+0000 7ff671234640 1 -- 172.21.15.55:0/1312709193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff66c0ca130 msgr2=0x7ff66c0703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:36.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.187+0000 7ff671234640 1 --2- 172.21.15.55:0/1312709193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff66c0ca130 0x7ff66c0703e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff6540097f0 tx=0x7ff65401e4e0 comp rx=0 tx=0).stop 2023-07-06T22:20:36.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.187+0000 7ff671234640 1 -- 172.21.15.55:0/1312709193 shutdown_connections 2023-07-06T22:20:36.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.187+0000 7ff671234640 1 --2- 172.21.15.55:0/1312709193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff66c0ca130 0x7ff66c0703e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:36.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.187+0000 7ff671234640 1 -- 172.21.15.55:0/1312709193 >> 172.21.15.55:0/1312709193 conn(0x7ff66c0cea70 msgr2=0x7ff66c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:36.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.187+0000 7ff671234640 1 -- 172.21.15.55:0/1312709193 shutdown_connections 2023-07-06T22:20:36.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.187+0000 7ff671234640 1 -- 172.21.15.55:0/1312709193 wait complete. 2023-07-06T22:20:36.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.187+0000 7ff671234640 1 Processor -- start 2023-07-06T22:20:36.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.187+0000 7ff671234640 1 -- start start 2023-07-06T22:20:36.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff671234640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff66c0ca130 0x7ff66c0c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:36.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff671234640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff66c0cd140 0x7ff66c152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:36.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff671234640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff66c158850 0x7ff66c1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:36.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff671234640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c152290 con 0x7ff66c0cd140 2023-07-06T22:20:36.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff671234640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0c3f70 con 0x7ff66c0ca130 2023-07-06T22:20:36.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff671234640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c152c60 con 0x7ff66c158850 2023-07-06T22:20:36.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff663fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff66c0cd140 0x7ff66c152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:36.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff663fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff66c0cd140 0x7ff66c152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58212/0 (socket says 172.21.15.55:58212) 2023-07-06T22:20:36.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff663fff640 1 -- 172.21.15.55:0/839810470 learned_addr learned my addr 172.21.15.55:0/839810470 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:36.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff66ad9d640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff66c0ca130 0x7ff66c0c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:36.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff66b59e640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff66c158850 0x7ff66c1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:36.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff663fff640 1 -- 172.21.15.55:0/839810470 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff66c158850 msgr2=0x7ff66c1534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:36.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff663fff640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff66c158850 0x7ff66c1534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:36.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff663fff640 1 -- 172.21.15.55:0/839810470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff66c0ca130 msgr2=0x7ff66c0c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:36.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff663fff640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff66c0ca130 0x7ff66c0c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:36.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff663fff640 1 -- 172.21.15.55:0/839810470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654009420 con 0x7ff66c0cd140 2023-07-06T22:20:36.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff66ad9d640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff66c0ca130 0x7ff66c0c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:36.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff66b59e640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff66c158850 0x7ff66c1534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:36.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff663fff640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff66c0cd140 0x7ff66c152720 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7ff6540097f0 tx=0x7ff65401cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:36.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff6637fe640 1 -- 172.21.15.55:0/839810470 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540b6400 con 0x7ff66c0cd140 2023-07-06T22:20:36.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff6637fe640 1 -- 172.21.15.55:0/839810470 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6540b6580 con 0x7ff66c0cd140 2023-07-06T22:20:36.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff6637fe640 1 -- 172.21.15.55:0/839810470 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540b6930 con 0x7ff66c0cd140 2023-07-06T22:20:36.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff671234640 1 -- 172.21.15.55:0/839810470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c151680 con 0x7ff66c0cd140 2023-07-06T22:20:36.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff671234640 1 -- 172.21.15.55:0/839810470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c151c40 con 0x7ff66c0cd140 2023-07-06T22:20:36.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff671234640 1 -- 172.21.15.55:0/839810470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c152440 con 0x7ff66c0cd140 2023-07-06T22:20:36.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.191+0000 7ff6637fe640 1 -- 172.21.15.55:0/839810470 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff6540b6a90 con 0x7ff66c0cd140 2023-07-06T22:20:36.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.195+0000 7ff6637fe640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff64c0663d0 0x7ff64c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:36.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.195+0000 7ff6637fe640 1 -- 172.21.15.55:0/839810470 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff654120670 con 0x7ff66c0cd140 2023-07-06T22:20:36.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.195+0000 7ff66ad9d640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff64c0663d0 0x7ff64c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:36.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.195+0000 7ff66ad9d640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff64c0663d0 0x7ff64c068880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff65c000f70 tx=0x7ff65c009040 comp rx=0 tx=0).ready entity=mgr.10752 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:36.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.199+0000 7ff6637fe640 1 -- 172.21.15.55:0/839810470 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff66c152440 con 0x7ff66c0cd140 2023-07-06T22:20:36.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:36.391+0000 7ff671234640 1 -- 172.21.15.55:0/839810470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7ff66c066d60 con 0x7ff66c0cd140 2023-07-06T22:20:37.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.287+0000 7ff6637fe640 1 -- 172.21.15.55:0/839810470 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 106) v1 ==== 85777+0+0 (secure 0 0 0) 0x7ff6540f70f0 con 0x7ff66c0cd140 2023-07-06T22:20:37.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.287+0000 7ff6637fe640 1 -- 172.21.15.55:0/839810470 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v106) v1 ==== 92+0+0 (secure 0 0 0) 0x7ff654104f90 con 0x7ff66c0cd140 2023-07-06T22:20:37.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.291+0000 7ff671234640 1 -- 172.21.15.55:0/839810470 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff64c0663d0 msgr2=0x7ff64c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:37.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.291+0000 7ff671234640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff64c0663d0 0x7ff64c068880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff65c000f70 tx=0x7ff65c009040 comp rx=0 tx=0).stop 2023-07-06T22:20:37.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.291+0000 7ff671234640 1 -- 172.21.15.55:0/839810470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff66c0cd140 msgr2=0x7ff66c152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:37.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.291+0000 7ff671234640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff66c0cd140 0x7ff66c152720 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7ff6540097f0 tx=0x7ff65401cd20 comp rx=0 tx=0).stop 2023-07-06T22:20:37.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.291+0000 7ff671234640 1 -- 172.21.15.55:0/839810470 shutdown_connections 2023-07-06T22:20:37.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.291+0000 7ff671234640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7ff64c0663d0 0x7ff64c068880 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.291+0000 7ff671234640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff66c158850 0x7ff66c1534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.291+0000 7ff671234640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff66c0cd140 0x7ff66c152720 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.291+0000 7ff671234640 1 --2- 172.21.15.55:0/839810470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff66c0ca130 0x7ff66c0c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.291+0000 7ff671234640 1 -- 172.21.15.55:0/839810470 >> 172.21.15.55:0/839810470 conn(0x7ff66c0cea70 msgr2=0x7ff66c0c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:37.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.291+0000 7ff671234640 1 -- 172.21.15.55:0/839810470 shutdown_connections 2023-07-06T22:20:37.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.291+0000 7ff671234640 1 -- 172.21.15.55:0/839810470 wait complete. 2023-07-06T22:20:37.317 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-06T22:20:37.452 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:37.451+0000 7fe3d4076180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:20:37.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.467+0000 7f37d5b11640 1 Processor -- start 2023-07-06T22:20:37.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.467+0000 7f37d5b11640 1 -- start start 2023-07-06T22:20:37.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.467+0000 7f37d5b11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37d015b850 0x7f37d00cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.467+0000 7f37d5b11640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f37d00ccd30 0x7f37d00b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.467+0000 7f37d5b11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37d00b3db0 0x7f37d015f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.467+0000 7f37d5b11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d00b4210 con 0x7f37d015b850 2023-07-06T22:20:37.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.467+0000 7f37d5b11640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d00b2b80 con 0x7f37d00ccd30 2023-07-06T22:20:37.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.467+0000 7f37d5b11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d00cff30 con 0x7f37d00b3db0 2023-07-06T22:20:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.471+0000 7f37cf7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37d015b850 0x7f37d00cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.471+0000 7f37cf7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37d015b850 0x7f37d00cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58236/0 (socket says 172.21.15.55:58236) 2023-07-06T22:20:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.471+0000 7f37cf7fe640 1 -- 172.21.15.55:0/1378735580 learned_addr learned my addr 172.21.15.55:0/1378735580 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.471+0000 7f37ceffd640 1 --2- 172.21.15.55:0/1378735580 >> v2:172.21.15.138:3300/0 conn(0x7f37d00ccd30 0x7f37d00b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.471+0000 7f37cffff640 1 --2- 172.21.15.55:0/1378735580 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37d00b3db0 0x7f37d015f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.471+0000 7f37cf7fe640 1 -- 172.21.15.55:0/1378735580 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37d00b3db0 msgr2=0x7f37d015f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:37.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.471+0000 7f37cf7fe640 1 --2- 172.21.15.55:0/1378735580 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37d00b3db0 0x7f37d015f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.471+0000 7f37cf7fe640 1 -- 172.21.15.55:0/1378735580 >> v2:172.21.15.138:3300/0 conn(0x7f37d00ccd30 msgr2=0x7f37d00b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:37.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.471+0000 7f37cf7fe640 1 --2- 172.21.15.55:0/1378735580 >> v2:172.21.15.138:3300/0 conn(0x7f37d00ccd30 0x7f37d00b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.471+0000 7f37cf7fe640 1 -- 172.21.15.55:0/1378735580 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d00b22e0 con 0x7f37d015b850 2023-07-06T22:20:37.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.471+0000 7f37cf7fe640 1 --2- 172.21.15.55:0/1378735580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d015b850 0x7f37d00cc7f0 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f37d00cebd0 tx=0x7f37c001c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ddae45c043a466 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:37.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.471+0000 7f37ce7fc640 1 -- 172.21.15.55:0/1378735580 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c00ab600 con 0x7f37d015b850 2023-07-06T22:20:37.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.471+0000 7f37ce7fc640 1 -- 172.21.15.55:0/1378735580 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c00a7050 con 0x7f37d015b850 2023-07-06T22:20:37.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.471+0000 7f37ce7fc640 1 -- 172.21.15.55:0/1378735580 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c00ab980 con 0x7f37d015b850 2023-07-06T22:20:37.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 -- 172.21.15.55:0/1378735580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d015b850 msgr2=0x7f37d00cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:37.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 --2- 172.21.15.55:0/1378735580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d015b850 0x7f37d00cc7f0 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f37d00cebd0 tx=0x7f37c001c0f0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 -- 172.21.15.55:0/1378735580 shutdown_connections 2023-07-06T22:20:37.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 --2- 172.21.15.55:0/1378735580 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37d00b3db0 0x7f37d015f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 --2- 172.21.15.55:0/1378735580 >> v2:172.21.15.138:3300/0 conn(0x7f37d00ccd30 0x7f37d00b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 --2- 172.21.15.55:0/1378735580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d015b850 0x7f37d00cc7f0 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 -- 172.21.15.55:0/1378735580 >> 172.21.15.55:0/1378735580 conn(0x7f37d00cec20 msgr2=0x7f37d00cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:37.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 -- 172.21.15.55:0/1378735580 shutdown_connections 2023-07-06T22:20:37.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 -- 172.21.15.55:0/1378735580 wait complete. 2023-07-06T22:20:37.478 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:37.475+0000 7fcb1f22c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:20:37.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 Processor -- start 2023-07-06T22:20:37.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 -- start start 2023-07-06T22:20:37.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37d00b3db0 0x7f37d0153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37d00ccd30 0x7f37d00c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d015b850 0x7f37d0157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d0153c80 con 0x7f37d015b850 2023-07-06T22:20:37.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d00cb200 con 0x7f37d00ccd30 2023-07-06T22:20:37.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37d5b11640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d00cb690 con 0x7f37d00b3db0 2023-07-06T22:20:37.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37ceffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37d00ccd30 0x7f37d00c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:37.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37cffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d015b850 0x7f37d0157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:37.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37cf7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37d00b3db0 0x7f37d0153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:37.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37ceffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37d00ccd30 0x7f37d00c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:43662/0 (socket says 172.21.15.55:43662) 2023-07-06T22:20:37.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37cf7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37d00b3db0 0x7f37d0153740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:54758/0 (socket says 172.21.15.55:54758) 2023-07-06T22:20:37.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.475+0000 7f37ceffd640 1 -- 172.21.15.55:0/3369791615 learned_addr learned my addr 172.21.15.55:0/3369791615 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:37.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37ceffd640 1 -- 172.21.15.55:0/3369791615 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37d00b3db0 msgr2=0x7f37d0153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:37.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37ceffd640 1 --2- 172.21.15.55:0/3369791615 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37d00b3db0 0x7f37d0153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37ceffd640 1 -- 172.21.15.55:0/3369791615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d015b850 msgr2=0x7f37d0157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:37.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37ceffd640 1 --2- 172.21.15.55:0/3369791615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d015b850 0x7f37d0157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37ceffd640 1 -- 172.21.15.55:0/3369791615 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c00094d0 con 0x7f37d00ccd30 2023-07-06T22:20:37.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37cf7fe640 1 --2- 172.21.15.55:0/3369791615 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37d00b3db0 0x7f37d0153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:37.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37cffff640 1 --2- 172.21.15.55:0/3369791615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d015b850 0x7f37d0157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:37.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37ceffd640 1 --2- 172.21.15.55:0/3369791615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37d00ccd30 0x7f37d00c9c80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f37c400e960 tx=0x7f37c400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:37.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37b7fff640 1 -- 172.21.15.55:0/3369791615 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c4009690 con 0x7f37d00ccd30 2023-07-06T22:20:37.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37b7fff640 1 -- 172.21.15.55:0/3369791615 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c400ca00 con 0x7f37d00ccd30 2023-07-06T22:20:37.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37b7fff640 1 -- 172.21.15.55:0/3369791615 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c400cd70 con 0x7f37d00ccd30 2023-07-06T22:20:37.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37d5b11640 1 -- 172.21.15.55:0/3369791615 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d015bda0 con 0x7f37d00ccd30 2023-07-06T22:20:37.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37d5b11640 1 -- 172.21.15.55:0/3369791615 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d00cabb0 con 0x7f37d00ccd30 2023-07-06T22:20:37.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37d5b11640 1 -- 172.21.15.55:0/3369791615 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d00cb390 con 0x7f37d00ccd30 2023-07-06T22:20:37.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.479+0000 7f37b7fff640 1 -- 172.21.15.55:0/3369791615 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 106) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f37c4013470 con 0x7f37d00ccd30 2023-07-06T22:20:37.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.483+0000 7f37b7fff640 1 --2- 172.21.15.55:0/3369791615 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f37bc066420 0x7f37bc0688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.483+0000 7f37b7fff640 1 -- 172.21.15.55:0/3369791615 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f37c4084190 con 0x7f37d00ccd30 2023-07-06T22:20:37.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.483+0000 7f37cf7fe640 1 -- 172.21.15.55:0/3369791615 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f37bc066420 msgr2=0x7f37bc0688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/538997467 2023-07-06T22:20:37.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.483+0000 7f37cf7fe640 1 --2- 172.21.15.55:0/3369791615 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f37bc066420 0x7f37bc0688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:37.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.487+0000 7f37b7fff640 1 -- 172.21.15.55:0/3369791615 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f37c4051450 con 0x7f37d00ccd30 2023-07-06T22:20:37.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.643+0000 7f37d5b11640 1 -- 172.21.15.55:0/3369791615 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f37d0066d60 con 0x7f37d00ccd30 2023-07-06T22:20:37.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.655+0000 7f37b7fff640 1 -- 172.21.15.55:0/3369791615 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v65)=0 v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7f37c4054a70 con 0x7f37d00ccd30 2023-07-06T22:20:37.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.659+0000 7f37d5b11640 1 -- 172.21.15.55:0/3369791615 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f37bc066420 msgr2=0x7f37bc0688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:37.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.659+0000 7f37d5b11640 1 --2- 172.21.15.55:0/3369791615 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f37bc066420 0x7f37bc0688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.659+0000 7f37d5b11640 1 -- 172.21.15.55:0/3369791615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37d00ccd30 msgr2=0x7f37d00c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:37.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.659+0000 7f37d5b11640 1 --2- 172.21.15.55:0/3369791615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37d00ccd30 0x7f37d00c9c80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f37c400e960 tx=0x7f37c400ee20 comp rx=0 tx=0).stop 2023-07-06T22:20:37.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.659+0000 7f37d5b11640 1 -- 172.21.15.55:0/3369791615 shutdown_connections 2023-07-06T22:20:37.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.659+0000 7f37d5b11640 1 --2- 172.21.15.55:0/3369791615 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f37bc066420 0x7f37bc0688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.659+0000 7f37d5b11640 1 --2- 172.21.15.55:0/3369791615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d015b850 0x7f37d0157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.659+0000 7f37d5b11640 1 --2- 172.21.15.55:0/3369791615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f37d00ccd30 0x7f37d00c9c80 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.659+0000 7f37d5b11640 1 --2- 172.21.15.55:0/3369791615 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f37d00b3db0 0x7f37d0153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.659+0000 7f37d5b11640 1 -- 172.21.15.55:0/3369791615 >> 172.21.15.55:0/3369791615 conn(0x7f37d00cec20 msgr2=0x7f37d00d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:37.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.659+0000 7f37d5b11640 1 -- 172.21.15.55:0/3369791615 shutdown_connections 2023-07-06T22:20:37.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.659+0000 7f37d5b11640 1 -- 172.21.15.55:0/3369791615 wait complete. 2023-07-06T22:20:37.680 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-06T22:20:37.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.823+0000 7efdbf59e640 1 Processor -- start 2023-07-06T22:20:37.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.823+0000 7efdbf59e640 1 -- start start 2023-07-06T22:20:37.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbf59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc01646a0 0x7efdc0166a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbf59e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc00cc740 con 0x7efdc00b1250 2023-07-06T22:20:37.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbf59e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc01601a0 con 0x7efdc00d0630 2023-07-06T22:20:37.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbf59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00ccc90 con 0x7efdc01646a0 2023-07-06T22:20:37.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbe59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efdc00b1250 0x7efdc015f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39360/0 (socket says 172.21.15.55:39360) 2023-07-06T22:20:37.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbe59c640 1 -- 172.21.15.55:0/3174940594 learned_addr learned my addr 172.21.15.55:0/3174940594 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:37.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbed9d640 1 --2- 172.21.15.55:0/3174940594 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc01646a0 0x7efdc0166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:37.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443354048 0 0) 0x7efdc00cc740 con 0x7efdc00b1250 2023-07-06T22:20:37.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdac003530 con 0x7efdc00b1250 2023-07-06T22:20:37.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698249168 0 0) 0x7efdc01601a0 con 0x7efdc00d0630 2023-07-06T22:20:37.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdc00cc740 con 0x7efdc00d0630 2023-07-06T22:20:37.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1595993537 0 0) 0x7efdac003530 con 0x7efdc00b1250 2023-07-06T22:20:37.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc01646a0 msgr2=0x7efdc0166a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:37.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 --2- 172.21.15.55:0/3174940594 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc01646a0 0x7efdc0166a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 >> v1:172.21.15.138:6789/0 conn(0x7efdc00d0630 legacy=0x7efdc015fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:37.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc00b29c0 con 0x7efdc00b1250 2023-07-06T22:20:37.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7efdb0001680 con 0x7efdc00b1250 2023-07-06T22:20:37.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 >> v1:172.21.15.55:6789/0 conn(0x7efdc00b1250 legacy=0x7efdc015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:37.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 --2- 172.21.15.55:0/3174940594 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc01646a0 0x7efdac003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 --2- 172.21.15.55:0/3174940594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdac0040a0 0x7efdac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 --2- 172.21.15.55:0/3174940594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdac004d10 0x7efdac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00ccc90 con 0x7efdac0040a0 2023-07-06T22:20:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac00ba40 con 0x7efdac004d10 2023-07-06T22:20:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdac00bc00 con 0x7efdc01646a0 2023-07-06T22:20:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbe59c640 1 --2- 172.21.15.55:0/3174940594 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc01646a0 0x7efdac003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdb7fff640 1 --2- 172.21.15.55:0/3174940594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdac0040a0 0x7efdac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbed9d640 1 --2- 172.21.15.55:0/3174940594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdac004d10 0x7efdac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbe59c640 1 -- 172.21.15.55:0/3174940594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdac004d10 msgr2=0x7efdac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbe59c640 1 --2- 172.21.15.55:0/3174940594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdac004d10 0x7efdac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbe59c640 1 -- 172.21.15.55:0/3174940594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdac0040a0 msgr2=0x7efdac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:37.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbe59c640 1 --2- 172.21.15.55:0/3174940594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdac0040a0 0x7efdac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.827+0000 7efdbe59c640 1 -- 172.21.15.55:0/3174940594 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac003530 con 0x7efdc01646a0 2023-07-06T22:20:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.831+0000 7efdbe59c640 1 --2- 172.21.15.55:0/3174940594 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc01646a0 0x7efdac003b40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efdb0001ec0 tx=0x7efdb001cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=718b145c7da0f4f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.831+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb00058e0 con 0x7efdc01646a0 2023-07-06T22:20:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.831+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb0005a40 con 0x7efdc01646a0 2023-07-06T22:20:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.831+0000 7efdbdd9b640 1 -- 172.21.15.55:0/3174940594 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0005e50 con 0x7efdc01646a0 2023-07-06T22:20:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.831+0000 7efdbf59e640 1 -- 172.21.15.55:0/3174940594 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc01646a0 msgr2=0x7efdac003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.831+0000 7efdbf59e640 1 --2- 172.21.15.55:0/3174940594 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc01646a0 0x7efdac003b40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efdb0001ec0 tx=0x7efdb001cb80 comp rx=0 tx=0).stop 2023-07-06T22:20:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.831+0000 7efdbed9d640 1 -- 172.21.15.55:0/3174940594 reap_dead start 2023-07-06T22:20:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.831+0000 7efdbf59e640 1 -- 172.21.15.55:0/3174940594 shutdown_connections 2023-07-06T22:20:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.831+0000 7efdbf59e640 1 -- 172.21.15.55:0/3174940594 >> 172.21.15.55:0/3174940594 conn(0x7efdc00b3b60 msgr2=0x7efdc00b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.831+0000 7efdbf59e640 1 -- 172.21.15.55:0/3174940594 shutdown_connections 2023-07-06T22:20:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.831+0000 7efdbf59e640 1 -- 172.21.15.55:0/3174940594 wait complete. 2023-07-06T22:20:37.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.835+0000 7efdbf59e640 1 Processor -- start 2023-07-06T22:20:37.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.835+0000 7efdbf59e640 1 -- start start 2023-07-06T22:20:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.835+0000 7efdbf59e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdc01646a0 0x7efdc01f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.835+0000 7efdbf59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc0157e40 0x7efdc014e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.835+0000 7efdbf59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc0156270 0x7efdc015df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.835+0000 7efdbf59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc014eb70 con 0x7efdc0156270 2023-07-06T22:20:37.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.835+0000 7efdbf59e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc015cf40 con 0x7efdc01646a0 2023-07-06T22:20:37.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.835+0000 7efdbf59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc015da80 con 0x7efdc0157e40 2023-07-06T22:20:37.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdbed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc0156270 0x7efdc015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:37.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdbed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc0156270 0x7efdc015df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58252/0 (socket says 172.21.15.55:58252) 2023-07-06T22:20:37.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdbed9d640 1 -- 172.21.15.55:0/3032668502 learned_addr learned my addr 172.21.15.55:0/3032668502 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:37.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdbe59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdc01646a0 0x7efdc01f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:37.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdb7fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc0157e40 0x7efdc014e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdbed9d640 1 -- 172.21.15.55:0/3032668502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc0157e40 msgr2=0x7efdc014e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdbed9d640 1 --2- 172.21.15.55:0/3032668502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc0157e40 0x7efdc014e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdbed9d640 1 -- 172.21.15.55:0/3032668502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdc01646a0 msgr2=0x7efdc01f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdbed9d640 1 --2- 172.21.15.55:0/3032668502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdc01646a0 0x7efdc01f8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdbed9d640 1 -- 172.21.15.55:0/3032668502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc015d150 con 0x7efdc0156270 2023-07-06T22:20:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdbed9d640 1 --2- 172.21.15.55:0/3032668502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc0156270 0x7efdc015df10 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7efdc00b4c40 tx=0x7efdb8011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdb6ffd640 1 -- 172.21.15.55:0/3032668502 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb800e040 con 0x7efdc0156270 2023-07-06T22:20:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdb6ffd640 1 -- 172.21.15.55:0/3032668502 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb800f040 con 0x7efdc0156270 2023-07-06T22:20:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdb6ffd640 1 -- 172.21.15.55:0/3032668502 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb8004030 con 0x7efdc0156270 2023-07-06T22:20:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdbf59e640 1 -- 172.21.15.55:0/3032668502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc015d430 con 0x7efdc0156270 2023-07-06T22:20:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdbf59e640 1 -- 172.21.15.55:0/3032668502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc00c52c0 con 0x7efdc0156270 2023-07-06T22:20:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdbf59e640 1 -- 172.21.15.55:0/3032668502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc015dc30 con 0x7efdc0156270 2023-07-06T22:20:37.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.839+0000 7efdb6ffd640 1 -- 172.21.15.55:0/3032668502 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85777+0+0 (secure 0 0 0) 0x7efdb8004190 con 0x7efdc0156270 2023-07-06T22:20:37.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.843+0000 7efdb6ffd640 1 --2- 172.21.15.55:0/3032668502 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efda0066420 0x7efda00688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:37.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.843+0000 7efdb6ffd640 1 -- 172.21.15.55:0/3032668502 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7efdb80841c0 con 0x7efdc0156270 2023-07-06T22:20:37.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.843+0000 7efdbe59c640 1 -- 172.21.15.55:0/3032668502 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efda0066420 msgr2=0x7efda00688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/538997467 2023-07-06T22:20:37.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.843+0000 7efdbe59c640 1 --2- 172.21.15.55:0/3032668502 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efda0066420 0x7efda00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:37.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:37.847+0000 7efdb6ffd640 1 -- 172.21.15.55:0/3032668502 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efdc015dc30 con 0x7efdc0156270 2023-07-06T22:20:37.870 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:37.867+0000 7fe3d4076180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:20:37.926 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:37.923+0000 7fcb1f22c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:20:38.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.003+0000 7efdbf59e640 1 -- 172.21.15.55:0/3032668502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7efdc015dbf0 con 0x7efdc0156270 2023-07-06T22:20:38.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.011+0000 7efdb6ffd640 1 -- 172.21.15.55:0/3032668502 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v66)=0 v66) v1 ==== 133+0+0 (secure 0 0 0) 0x7efdb8054df0 con 0x7efdc0156270 2023-07-06T22:20:38.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.011+0000 7efdbf59e640 1 -- 172.21.15.55:0/3032668502 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efda0066420 msgr2=0x7efda00688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:38.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.011+0000 7efdbf59e640 1 --2- 172.21.15.55:0/3032668502 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efda0066420 0x7efda00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:38.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.011+0000 7efdbf59e640 1 -- 172.21.15.55:0/3032668502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc0156270 msgr2=0x7efdc015df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:38.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.011+0000 7efdbf59e640 1 --2- 172.21.15.55:0/3032668502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc0156270 0x7efdc015df10 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7efdc00b4c40 tx=0x7efdb8011c60 comp rx=0 tx=0).stop 2023-07-06T22:20:38.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.011+0000 7efdbf59e640 1 -- 172.21.15.55:0/3032668502 shutdown_connections 2023-07-06T22:20:38.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.011+0000 7efdbf59e640 1 --2- 172.21.15.55:0/3032668502 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7efda0066420 0x7efda00688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:38.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.011+0000 7efdbf59e640 1 --2- 172.21.15.55:0/3032668502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdc0156270 0x7efdc015df10 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:38.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.011+0000 7efdbf59e640 1 --2- 172.21.15.55:0/3032668502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdc0157e40 0x7efdc014e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:38.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.011+0000 7efdbf59e640 1 --2- 172.21.15.55:0/3032668502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdc01646a0 0x7efdc01f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:38.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.011+0000 7efdbf59e640 1 -- 172.21.15.55:0/3032668502 >> 172.21.15.55:0/3032668502 conn(0x7efdc00b3b60 msgr2=0x7efdc0158f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:38.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.011+0000 7efdbf59e640 1 -- 172.21.15.55:0/3032668502 shutdown_connections 2023-07-06T22:20:38.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.011+0000 7efdbf59e640 1 -- 172.21.15.55:0/3032668502 wait complete. 2023-07-06T22:20:38.021 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:38.019+0000 7fe3d4076180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:20:38.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:38.034 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-06T22:20:38.049 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-06T22:20:38.087 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:38.083+0000 7fcb1f22c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:20:38.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f635cc7b640 1 Processor -- start 2023-07-06T22:20:38.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f635cc7b640 1 -- start start 2023-07-06T22:20:38.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f635cc7b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63580b3c90 0x7f63580ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:38.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f635cc7b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f63580d1d30 0x7f63580cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:38.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f635cc7b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63580ccd50 con 0x7f63580b18a0 2023-07-06T22:20:38.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f635cc7b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63580cd0a0 con 0x7f63580b3c90 2023-07-06T22:20:38.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f635cc7b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6358069ea0 con 0x7f63580d1d30 2023-07-06T22:20:38.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f635659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63580b3c90 0x7f63580ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:38.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f6355d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f63580b18a0 0x7f63580b4060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39364/0 (socket says 172.21.15.55:39364) 2023-07-06T22:20:38.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f6355d9b640 1 -- 172.21.15.55:0/52906975 learned_addr learned my addr 172.21.15.55:0/52906975 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:38.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f6356d9d640 1 --2- 172.21.15.55:0/52906975 >> v2:172.21.15.138:3300/0 conn(0x7f63580d1d30 0x7f63580cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:38.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f635659c640 1 -- 172.21.15.55:0/52906975 >> v2:172.21.15.138:3300/0 conn(0x7f63580d1d30 msgr2=0x7f63580cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:38.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f635659c640 1 --2- 172.21.15.55:0/52906975 >> v2:172.21.15.138:3300/0 conn(0x7f63580d1d30 0x7f63580cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:38.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f635659c640 1 -- 172.21.15.55:0/52906975 >> v1:172.21.15.55:6789/0 conn(0x7f63580b18a0 legacy=0x7f63580b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:38.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.235+0000 7f635659c640 1 -- 172.21.15.55:0/52906975 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635806a140 con 0x7f63580b3c90 2023-07-06T22:20:38.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.239+0000 7f635659c640 1 --2- 172.21.15.55:0/52906975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63580b3c90 0x7f63580ce460 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f63580b8360 tx=0x7f634801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97de862644fae1f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:38.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.239+0000 7f635559a640 1 -- 172.21.15.55:0/52906975 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63480ab650 con 0x7f63580b3c90 2023-07-06T22:20:38.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.239+0000 7f635559a640 1 -- 172.21.15.55:0/52906975 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63480ab7b0 con 0x7f63580b3c90 2023-07-06T22:20:38.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.239+0000 7f635559a640 1 -- 172.21.15.55:0/52906975 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63480abb40 con 0x7f63580b3c90 2023-07-06T22:20:38.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.239+0000 7f635cc7b640 1 -- 172.21.15.55:0/52906975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63580b3c90 msgr2=0x7f63580ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:38.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.239+0000 7f635cc7b640 1 --2- 172.21.15.55:0/52906975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63580b3c90 0x7f63580ce460 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f63580b8360 tx=0x7f634801c430 comp rx=0 tx=0).stop 2023-07-06T22:20:38.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.239+0000 7f635cc7b640 1 -- 172.21.15.55:0/52906975 shutdown_connections 2023-07-06T22:20:38.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.239+0000 7f635cc7b640 1 --2- 172.21.15.55:0/52906975 >> v2:172.21.15.138:3300/0 conn(0x7f63580d1d30 0x7f63580cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:38.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.239+0000 7f635cc7b640 1 --2- 172.21.15.55:0/52906975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63580b3c90 0x7f63580ce460 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:38.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.239+0000 7f635cc7b640 1 -- 172.21.15.55:0/52906975 >> 172.21.15.55:0/52906975 conn(0x7f635806bf40 msgr2=0x7f63580cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:38.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.239+0000 7f635cc7b640 1 -- 172.21.15.55:0/52906975 shutdown_connections 2023-07-06T22:20:38.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.239+0000 7f635cc7b640 1 -- 172.21.15.55:0/52906975 wait complete. 2023-07-06T22:20:38.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f635cc7b640 1 Processor -- start 2023-07-06T22:20:38.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f635cc7b640 1 -- start start 2023-07-06T22:20:38.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f635cc7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f63580b18a0 0x7f635814f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:38.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f635cc7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63580b3c90 0x7f6358154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:38.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f635cc7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63580d1d30 0x7f63580b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:38.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f635cc7b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635814f980 con 0x7f63580b3c90 2023-07-06T22:20:38.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f635cc7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63581535e0 con 0x7f63580d1d30 2023-07-06T22:20:38.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f635cc7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63581538c0 con 0x7f63580b18a0 2023-07-06T22:20:38.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f6355d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63580b3c90 0x7f6358154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:38.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f6355d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63580b3c90 0x7f6358154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58278/0 (socket says 172.21.15.55:58278) 2023-07-06T22:20:38.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f6355d9b640 1 -- 172.21.15.55:0/2677372058 learned_addr learned my addr 172.21.15.55:0/2677372058 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:38.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f6356d9d640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63580d1d30 0x7f63580b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:38.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f635659c640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f63580b18a0 0x7f635814f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:38.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f6355d9b640 1 -- 172.21.15.55:0/2677372058 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f63580b18a0 msgr2=0x7f635814f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f6355d9b640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f63580b18a0 0x7f635814f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f6355d9b640 1 -- 172.21.15.55:0/2677372058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63580d1d30 msgr2=0x7f63580b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f6355d9b640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63580d1d30 0x7f63580b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f6355d9b640 1 -- 172.21.15.55:0/2677372058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6348009420 con 0x7f63580b3c90 2023-07-06T22:20:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f6355d9b640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63580b3c90 0x7f6358154ec0 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f634c00c4d0 tx=0x7f634c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f6346ffd640 1 -- 172.21.15.55:0/2677372058 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634c005cf0 con 0x7f63580b3c90 2023-07-06T22:20:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f6346ffd640 1 -- 172.21.15.55:0/2677372058 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634c005e50 con 0x7f63580b3c90 2023-07-06T22:20:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f6346ffd640 1 -- 172.21.15.55:0/2677372058 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634c007270 con 0x7f63580b3c90 2023-07-06T22:20:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f635cc7b640 1 -- 172.21.15.55:0/2677372058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6358153ba0 con 0x7f63580b3c90 2023-07-06T22:20:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.243+0000 7f635cc7b640 1 -- 172.21.15.55:0/2677372058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6358153290 con 0x7f63580b3c90 2023-07-06T22:20:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.247+0000 7f635cc7b640 1 -- 172.21.15.55:0/2677372058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6358066d60 con 0x7f63580b3c90 2023-07-06T22:20:38.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.247+0000 7f6346ffd640 1 -- 172.21.15.55:0/2677372058 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f634c0073d0 con 0x7f63580b3c90 2023-07-06T22:20:38.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.247+0000 7f6346ffd640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f63380663f0 0x7f63380688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:38.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.247+0000 7f6346ffd640 1 -- 172.21.15.55:0/2677372058 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f634c0834d0 con 0x7f63580b3c90 2023-07-06T22:20:38.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.247+0000 7f635659c640 1 -- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f63380663f0 msgr2=0x7f63380688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/538997467 2023-07-06T22:20:38.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.247+0000 7f635659c640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f63380663f0 0x7f63380688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.251+0000 7f6346ffd640 1 -- 172.21.15.55:0/2677372058 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f634c050780 con 0x7f63580b3c90 2023-07-06T22:20:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.427+0000 7f635cc7b640 1 -- 172.21.15.55:0/2677372058 --> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6358153750 con 0x7f63380663f0 2023-07-06T22:20:38.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.451+0000 7f635659c640 1 -- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f63380663f0 msgr2=0x7f63380688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/538997467 2023-07-06T22:20:38.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.451+0000 7f635659c640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f63380663f0 0x7f63380688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-06T22:20:38.504 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:38.503+0000 7fe3d4076180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:20:38.562 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:38.559+0000 7fe3d4076180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:20:38.600 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:38.599+0000 7fcb1f22c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:20:38.618 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:38.615+0000 7fe3d4076180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:20:38.662 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:38.659+0000 7fcb1f22c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:20:38.703 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:38.703+0000 7fe3d4076180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:20:38.720 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:38.719+0000 7fcb1f22c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:20:38.761 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:38.759+0000 7fe3d4076180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:20:38.812 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:38.811+0000 7fcb1f22c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:20:38.845 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:38.843+0000 7fe3d4076180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:20:38.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.855+0000 7f635659c640 1 -- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f63380663f0 msgr2=0x7f63380688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/538997467 2023-07-06T22:20:38.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:38.855+0000 7f635659c640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f63380663f0 0x7f63380688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-06T22:20:38.871 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:38.867+0000 7fcb1f22c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:20:38.902 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:38.899+0000 7fe3d4076180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:20:38.959 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:38.955+0000 7fcb1f22c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:20:39.018 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:39.015+0000 7fcb1f22c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:20:39.044 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:39.043+0000 7fe3d4076180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:20:39.102 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:39.099+0000 7fe3d4076180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:20:39.167 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:39.163+0000 7fcb1f22c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:20:39.229 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:39.227+0000 7fcb1f22c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:20:39.343 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:20:39.343 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:20:39.343 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:20:39.352 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:39.351+0000 7fe3d4076180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:20:39.481 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:20:39.481 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:20:39.481 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:20:39.487 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:39.483+0000 7fe3d4076180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:20:39.490 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:39.487+0000 7fcb1f22c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:20:39.612 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:39.611+0000 7fe3d4076180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:20:39.631 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:39.631+0000 7fcb1f22c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:20:39.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:39.659+0000 7f635659c640 1 -- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f63380663f0 msgr2=0x7f63380688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/538997467 2023-07-06T22:20:39.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:39.659+0000 7f635659c640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f63380663f0 0x7f63380688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-06T22:20:39.683 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:39.679+0000 7fe3d4076180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:20:39.765 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:39.763+0000 7fcb1f22c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:20:39.821 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:39.819+0000 7fe3d4076180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:20:39.840 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:39.839+0000 7fcb1f22c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:20:39.982 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:39.979+0000 7fcb1f22c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:20:40.362 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:40.359+0000 7fe3d4076180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:20:40.447 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:40.443+0000 7fe3d4076180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:20:40.549 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:40.547+0000 7fcb1f22c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:20:40.594 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:40.591+0000 7fe3d4076180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:20:40.637 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:40.635+0000 7fcb1f22c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:20:40.677 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:40.675+0000 7fe3d4076180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:20:40.792 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:40.791+0000 7fcb1f22c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:20:40.880 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:40.879+0000 7fcb1f22c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:20:40.945 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:40.943+0000 7fe3d4076180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:20:41.004 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:41.003+0000 7fe3d4076180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:20:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:41.143+0000 7f6346ffd640 1 -- 172.21.15.55:0/2677372058 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 107) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f634c050b50 con 0x7f63580b3c90 2023-07-06T22:20:41.168 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:41.167+0000 7fcb1f22c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:20:41.231 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:41.227+0000 7fcb1f22c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:20:41.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:41.243+0000 7f6346ffd640 1 -- 172.21.15.55:0/2677372058 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 108) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f634c081690 con 0x7f63580b3c90 2023-07-06T22:20:41.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:41.243+0000 7f6346ffd640 1 -- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f63380663f0 msgr2=0x7f63380688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:41.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:41.243+0000 7f6346ffd640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/538997467,v1:172.21.15.55:6833/538997467] conn(0x7f63380663f0 0x7f63380688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:41.364 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:41.363+0000 7fca9fc17640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:41.364 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:41.363+0000 7fca9fc17640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:41.364 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:41.363+0000 7fca9fc17640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:41.365 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:41.363+0000 7fca9fc17640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:41.365 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:41.363+0000 7fca9fc17640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:41.365 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:41.363+0000 7fca9d412640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:41.365 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:41.363+0000 7fca9d412640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:41.365 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:41.363+0000 7fca9d412640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:41.365 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:41.363+0000 7fca9d412640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:41.365 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:41.363+0000 7fca9d412640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:41.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:20:42.022 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:20:42.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.247+0000 7f6346ffd640 1 -- 172.21.15.55:0/2677372058 <== mon.0 v2:172.21.15.55:3300/0 9 ==== mgrmap(e 109) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f634c051420 con 0x7f63580b3c90 2023-07-06T22:20:42.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.247+0000 7f6346ffd640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f633801c370 0x7f6338070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.247+0000 7f6346ffd640 1 -- 172.21.15.55:0/2677372058 --> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6358153750 con 0x7f633801c370 2023-07-06T22:20:42.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.251+0000 7f635659c640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f633801c370 0x7f6338070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.255+0000 7f635659c640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f633801c370 0x7f6338070eb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f63480af000 tx=0x7f63480a7000 comp rx=0 tx=0).ready entity=mgr.8975 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:42.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.331+0000 7f6346ffd640 1 -- 172.21.15.55:0/2677372058 <== mgr.8975 v2:172.21.15.55:6832/3861190779 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6358153750 con 0x7f633801c370 2023-07-06T22:20:42.335 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path snap_test_dir1 2023-07-06T22:20:42.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.335+0000 7f635cc7b640 1 -- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f633801c370 msgr2=0x7f6338070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:42.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.335+0000 7f635cc7b640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f633801c370 0x7f6338070eb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f63480af000 tx=0x7f63480a7000 comp rx=0 tx=0).stop 2023-07-06T22:20:42.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.335+0000 7f635cc7b640 1 -- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63580b3c90 msgr2=0x7f6358154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:42.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.335+0000 7f635cc7b640 1 --2- 172.21.15.55:0/2677372058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63580b3c90 0x7f6358154ec0 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f634c00c4d0 tx=0x7f634c00c990 comp rx=0 tx=0).stop 2023-07-06T22:20:42.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.335+0000 7f6356d9d640 1 -- 172.21.15.55:0/2677372058 reap_dead start 2023-07-06T22:20:42.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.335+0000 7f635cc7b640 1 -- 172.21.15.55:0/2677372058 shutdown_connections 2023-07-06T22:20:42.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.335+0000 7f635cc7b640 1 -- 172.21.15.55:0/2677372058 >> 172.21.15.55:0/2677372058 conn(0x7f635806bf40 msgr2=0x7f63580b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.335+0000 7f635cc7b640 1 -- 172.21.15.55:0/2677372058 shutdown_connections 2023-07-06T22:20:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.335+0000 7f635cc7b640 1 -- 172.21.15.55:0/2677372058 wait complete. 2023-07-06T22:20:42.357 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-06T22:20:42.357 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-07-06T22:20:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.503+0000 7fc53fe6d640 1 Processor -- start 2023-07-06T22:20:42.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53fe6d640 1 -- start start 2023-07-06T22:20:42.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53fe6d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5380ca130 0x7fc5380703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53fe6d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc538158cb0 con 0x7fc538158850 2023-07-06T22:20:42.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53fe6d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5380c8db0 con 0x7fc5380cd140 2023-07-06T22:20:42.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53fe6d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5380c9090 con 0x7fc5380ca130 2023-07-06T22:20:42.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53dc09640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc538158850 0x7fc5380cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39372/0 (socket says 172.21.15.55:39372) 2023-07-06T22:20:42.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53dc09640 1 -- 172.21.15.55:0/1628921018 learned_addr learned my addr 172.21.15.55:0/1628921018 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:42.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53d408640 1 --2- 172.21.15.55:0/1628921018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5380ca130 0x7fc5380703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572234167 0 0) 0x7fc538158cb0 con 0x7fc538158850 2023-07-06T22:20:42.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc524005740 con 0x7fc538158850 2023-07-06T22:20:42.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614082256 0 0) 0x7fc5380c8db0 con 0x7fc5380cd140 2023-07-06T22:20:42.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc538158cb0 con 0x7fc5380cd140 2023-07-06T22:20:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3522049810 0 0) 0x7fc524005740 con 0x7fc538158850 2023-07-06T22:20:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5380ca130 msgr2=0x7fc5380703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 --2- 172.21.15.55:0/1628921018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5380ca130 0x7fc5380703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 >> v1:172.21.15.138:6789/0 conn(0x7fc5380cd140 legacy=0x7fc5380b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5380c9370 con 0x7fc538158850 2023-07-06T22:20:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fc534001680 con 0x7fc538158850 2023-07-06T22:20:42.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53d408640 1 --2- 172.21.15.55:0/1628921018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5380ca130 0x7fc5380703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 >> v1:172.21.15.55:6789/0 conn(0x7fc538158850 legacy=0x7fc5380cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 --2- 172.21.15.55:0/1628921018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc524005d50 0x7fc524006140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 --2- 172.21.15.55:0/1628921018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5380ca130 0x7fc5240069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 --2- 172.21.15.55:0/1628921018 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc524006f20 0x7fc524007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5380c9090 con 0x7fc524005d50 2023-07-06T22:20:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52400dc50 con 0x7fc524006f20 2023-07-06T22:20:42.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52400dd90 con 0x7fc5380ca130 2023-07-06T22:20:42.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53dc09640 1 --2- 172.21.15.55:0/1628921018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc524005d50 0x7fc524006140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53e40a640 1 --2- 172.21.15.55:0/1628921018 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc524006f20 0x7fc524007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53d408640 1 --2- 172.21.15.55:0/1628921018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5380ca130 0x7fc5240069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53dc09640 1 -- 172.21.15.55:0/1628921018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5380ca130 msgr2=0x7fc5240069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:42.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53dc09640 1 --2- 172.21.15.55:0/1628921018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5380ca130 0x7fc5240069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:42.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53dc09640 1 -- 172.21.15.55:0/1628921018 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc524006f20 msgr2=0x7fc524007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:42.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53dc09640 1 --2- 172.21.15.55:0/1628921018 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc524006f20 0x7fc524007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:42.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.507+0000 7fc53dc09640 1 -- 172.21.15.55:0/1628921018 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc528009420 con 0x7fc524005d50 2023-07-06T22:20:42.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.511+0000 7fc53dc09640 1 --2- 172.21.15.55:0/1628921018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc524005d50 0x7fc524006140 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c160 tx=0x7fc53401cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabbba824ab82214 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:42.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.511+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5340058e0 con 0x7fc524005d50 2023-07-06T22:20:42.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.511+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc534005a40 con 0x7fc524005d50 2023-07-06T22:20:42.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.511+0000 7fc53cc07640 1 -- 172.21.15.55:0/1628921018 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534005e10 con 0x7fc524005d50 2023-07-06T22:20:42.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.511+0000 7fc53fe6d640 1 -- 172.21.15.55:0/1628921018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc524005d50 msgr2=0x7fc524006140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:42.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.511+0000 7fc53fe6d640 1 --2- 172.21.15.55:0/1628921018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc524005d50 0x7fc524006140 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c160 tx=0x7fc53401cb90 comp rx=0 tx=0).stop 2023-07-06T22:20:42.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.511+0000 7fc53e40a640 1 -- 172.21.15.55:0/1628921018 reap_dead start 2023-07-06T22:20:42.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.511+0000 7fc53fe6d640 1 -- 172.21.15.55:0/1628921018 shutdown_connections 2023-07-06T22:20:42.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.511+0000 7fc53fe6d640 1 -- 172.21.15.55:0/1628921018 >> 172.21.15.55:0/1628921018 conn(0x7fc5380cea70 msgr2=0x7fc5380ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:42.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.511+0000 7fc53fe6d640 1 -- 172.21.15.55:0/1628921018 shutdown_connections 2023-07-06T22:20:42.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.511+0000 7fc53fe6d640 1 -- 172.21.15.55:0/1628921018 wait complete. 2023-07-06T22:20:42.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53fe6d640 1 Processor -- start 2023-07-06T22:20:42.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53fe6d640 1 -- start start 2023-07-06T22:20:42.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53fe6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc524005d50 0x7fc538098e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53fe6d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5381483c0 0x7fc53814c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53fe6d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5381f33b0 0x7fc5380c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53fe6d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53814d670 con 0x7fc524005d50 2023-07-06T22:20:42.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53fe6d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53814c790 con 0x7fc5381483c0 2023-07-06T22:20:42.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53fe6d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53814ca60 con 0x7fc5381f33b0 2023-07-06T22:20:42.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53dc09640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc524005d50 0x7fc538098e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53dc09640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc524005d50 0x7fc538098e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58444/0 (socket says 172.21.15.55:58444) 2023-07-06T22:20:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53dc09640 1 -- 172.21.15.55:0/2319493445 learned_addr learned my addr 172.21.15.55:0/2319493445 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53e40a640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5381f33b0 0x7fc5380c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53d408640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5381483c0 0x7fc53814c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53dc09640 1 -- 172.21.15.55:0/2319493445 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5381f33b0 msgr2=0x7fc5380c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53dc09640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5381f33b0 0x7fc5380c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53dc09640 1 -- 172.21.15.55:0/2319493445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5381483c0 msgr2=0x7fc53814c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:42.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53dc09640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5381483c0 0x7fc53814c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53dc09640 1 -- 172.21.15.55:0/2319493445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53814cd40 con 0x7fc524005d50 2023-07-06T22:20:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53e40a640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5381f33b0 0x7fc5380c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53dc09640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc524005d50 0x7fc538098e90 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7fc53401c9c0 tx=0x7fc524007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc52e7fc640 1 -- 172.21.15.55:0/2319493445 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5340a5a70 con 0x7fc524005d50 2023-07-06T22:20:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc52e7fc640 1 -- 172.21.15.55:0/2319493445 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5340a5bd0 con 0x7fc524005d50 2023-07-06T22:20:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc52e7fc640 1 -- 172.21.15.55:0/2319493445 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534001640 con 0x7fc524005d50 2023-07-06T22:20:42.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53fe6d640 1 -- 172.21.15.55:0/2319493445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53814d020 con 0x7fc524005d50 2023-07-06T22:20:42.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.515+0000 7fc53fe6d640 1 -- 172.21.15.55:0/2319493445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc538148830 con 0x7fc524005d50 2023-07-06T22:20:42.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.519+0000 7fc53fe6d640 1 -- 172.21.15.55:0/2319493445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc538066d60 con 0x7fc524005d50 2023-07-06T22:20:42.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.519+0000 7fc52e7fc640 1 -- 172.21.15.55:0/2319493445 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 109) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fc5340047f0 con 0x7fc524005d50 2023-07-06T22:20:42.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.519+0000 7fc52e7fc640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc51c066120 0x7fc51c0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.519+0000 7fc52e7fc640 1 -- 172.21.15.55:0/2319493445 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fc53411d210 con 0x7fc524005d50 2023-07-06T22:20:42.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.519+0000 7fc53d408640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc51c066120 0x7fc51c0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.519+0000 7fc53d408640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc51c066120 0x7fc51c0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc53814ea60 tx=0x7fc528008040 comp rx=0 tx=0).ready entity=mgr.8975 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.523+0000 7fc52e7fc640 1 -- 172.21.15.55:0/2319493445 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc5340ea640 con 0x7fc524005d50 2023-07-06T22:20:42.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.695+0000 7fc53fe6d640 1 -- 172.21.15.55:0/2319493445 --> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5380c9c10 con 0x7fc51c066120 2023-07-06T22:20:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.767+0000 7fc52e7fc640 1 -- 172.21.15.55:0/2319493445 <== mgr.8975 v2:172.21.15.55:6832/3861190779 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fc528009920 con 0x7fc51c066120 2023-07-06T22:20:42.769 INFO:teuthology.orchestra.run.smithi055.stdout:Retention added to path snap_test_dir1 2023-07-06T22:20:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.767+0000 7fc53fe6d640 1 -- 172.21.15.55:0/2319493445 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc51c066120 msgr2=0x7fc51c0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.767+0000 7fc53fe6d640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc51c066120 0x7fc51c0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc53814ea60 tx=0x7fc528008040 comp rx=0 tx=0).stop 2023-07-06T22:20:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.767+0000 7fc53fe6d640 1 -- 172.21.15.55:0/2319493445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc524005d50 msgr2=0x7fc538098e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.767+0000 7fc53fe6d640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc524005d50 0x7fc538098e90 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7fc53401c9c0 tx=0x7fc524007a10 comp rx=0 tx=0).stop 2023-07-06T22:20:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.767+0000 7fc53fe6d640 1 -- 172.21.15.55:0/2319493445 shutdown_connections 2023-07-06T22:20:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.767+0000 7fc53fe6d640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc51c066120 0x7fc51c0685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.767+0000 7fc53fe6d640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5381f33b0 0x7fc5380c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:42.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.767+0000 7fc53fe6d640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5381483c0 0x7fc53814c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:42.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.767+0000 7fc53fe6d640 1 --2- 172.21.15.55:0/2319493445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc524005d50 0x7fc538098e90 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:42.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.767+0000 7fc53fe6d640 1 -- 172.21.15.55:0/2319493445 >> 172.21.15.55:0/2319493445 conn(0x7fc5380cea70 msgr2=0x7fc538157dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:42.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.767+0000 7fc53fe6d640 1 -- 172.21.15.55:0/2319493445 shutdown_connections 2023-07-06T22:20:42.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.767+0000 7fc53fe6d640 1 -- 172.21.15.55:0/2319493445 wait complete. 2023-07-06T22:20:42.789 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-07-06T22:20:42.790 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-06-22_21_00 in ~18s... 2023-07-06T22:20:42.790 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-07-06T22:20:42.790 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-06T22:20:42.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9bf034640 1 Processor -- start 2023-07-06T22:20:42.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9bf034640 1 -- start start 2023-07-06T22:20:42.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9bf034640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe9b80c9b90 0x7fe9b815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9bf034640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9b80693f0 0x7fe9b8069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9bf034640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b80b3e70 con 0x7fe9b80ccb70 2023-07-06T22:20:42.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9bf034640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b8159c30 con 0x7fe9b80c9b90 2023-07-06T22:20:42.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9bf034640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80c9070 con 0x7fe9b80693f0 2023-07-06T22:20:42.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9bcdd0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe9b80c9b90 0x7fe9b815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9b7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe9b80ccb70 0x7fe9b80c9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39388/0 (socket says 172.21.15.55:39388) 2023-07-06T22:20:42.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9b7fff640 1 -- 172.21.15.55:0/3264682749 learned_addr learned my addr 172.21.15.55:0/3264682749 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:42.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9bd5d1640 1 --2- 172.21.15.55:0/3264682749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9b80693f0 0x7fe9b8069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9bcdd0640 1 -- 172.21.15.55:0/3264682749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9b80693f0 msgr2=0x7fe9b8069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:42.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9bcdd0640 1 --2- 172.21.15.55:0/3264682749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9b80693f0 0x7fe9b8069850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:42.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9bcdd0640 1 -- 172.21.15.55:0/3264682749 >> v1:172.21.15.55:6789/0 conn(0x7fe9b80ccb70 legacy=0x7fe9b80c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:42.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9bcdd0640 1 -- 172.21.15.55:0/3264682749 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b80c8480 con 0x7fe9b80c9b90 2023-07-06T22:20:42.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.935+0000 7fe9b77fe640 1 -- 172.21.15.55:0/3264682749 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318872314 0 0) 0x7fe9a4001120 con 0x7fe9b80ccb70 2023-07-06T22:20:42.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.939+0000 7fe9bcdd0640 1 --2- 172.21.15.55:0/3264682749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b80c9b90 0x7fe9b815dd50 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0097c0 tx=0x7fe9ac01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55fc8c3516f8ec8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:42.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.939+0000 7fe9b77fe640 1 -- 172.21.15.55:0/3264682749 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0ab640 con 0x7fe9b80c9b90 2023-07-06T22:20:42.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.939+0000 7fe9b77fe640 1 -- 172.21.15.55:0/3264682749 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac0a7070 con 0x7fe9b80c9b90 2023-07-06T22:20:42.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.939+0000 7fe9b77fe640 1 -- 172.21.15.55:0/3264682749 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0ab9c0 con 0x7fe9b80c9b90 2023-07-06T22:20:42.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.939+0000 7fe9bf034640 1 -- 172.21.15.55:0/3264682749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b80c9b90 msgr2=0x7fe9b815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:42.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.939+0000 7fe9bf034640 1 --2- 172.21.15.55:0/3264682749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b80c9b90 0x7fe9b815dd50 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0097c0 tx=0x7fe9ac01c440 comp rx=0 tx=0).stop 2023-07-06T22:20:42.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.939+0000 7fe9bf034640 1 -- 172.21.15.55:0/3264682749 shutdown_connections 2023-07-06T22:20:42.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.939+0000 7fe9bf034640 1 --2- 172.21.15.55:0/3264682749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9b80693f0 0x7fe9b8069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:42.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.939+0000 7fe9bf034640 1 --2- 172.21.15.55:0/3264682749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b80c9b90 0x7fe9b815dd50 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:42.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.939+0000 7fe9bf034640 1 -- 172.21.15.55:0/3264682749 >> 172.21.15.55:0/3264682749 conn(0x7fe9b80cde30 msgr2=0x7fe9b80ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:42.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.939+0000 7fe9bf034640 1 -- 172.21.15.55:0/3264682749 shutdown_connections 2023-07-06T22:20:42.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.939+0000 7fe9bf034640 1 -- 172.21.15.55:0/3264682749 wait complete. 2023-07-06T22:20:42.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9bf034640 1 Processor -- start 2023-07-06T22:20:42.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9bf034640 1 -- start start 2023-07-06T22:20:42.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9bf034640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9b80693f0 0x7fe9b8158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9bf034640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b80c9b90 0x7fe9b806c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9bf034640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9b80ccb70 0x7fe9b8162880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9bf034640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b806c510 con 0x7fe9b80c9b90 2023-07-06T22:20:42.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9bf034640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80c7db0 con 0x7fe9b80ccb70 2023-07-06T22:20:42.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9bf034640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b806bc00 con 0x7fe9b80693f0 2023-07-06T22:20:42.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9b7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b80c9b90 0x7fe9b806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9b7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b80c9b90 0x7fe9b806c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58460/0 (socket says 172.21.15.55:58460) 2023-07-06T22:20:42.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9b7fff640 1 -- 172.21.15.55:0/715169268 learned_addr learned my addr 172.21.15.55:0/715169268 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:42.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9bcdd0640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9b80693f0 0x7fe9b8158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9bd5d1640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9b80ccb70 0x7fe9b8162880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9b7fff640 1 -- 172.21.15.55:0/715169268 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9b80693f0 msgr2=0x7fe9b8158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:42.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9b7fff640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9b80693f0 0x7fe9b8158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:42.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9b7fff640 1 -- 172.21.15.55:0/715169268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9b80ccb70 msgr2=0x7fe9b8162880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:42.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9b7fff640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9b80ccb70 0x7fe9b8162880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:42.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9b7fff640 1 -- 172.21.15.55:0/715169268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac009420 con 0x7fe9b80c9b90 2023-07-06T22:20:42.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9bd5d1640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9b80ccb70 0x7fe9b8162880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:42.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9b7fff640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b80c9b90 0x7fe9b806c930 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400c7b0 tx=0x7fe9a400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:42.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9b57fa640 1 -- 172.21.15.55:0/715169268 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a40072d0 con 0x7fe9b80c9b90 2023-07-06T22:20:42.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9b57fa640 1 -- 172.21.15.55:0/715169268 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a4007450 con 0x7fe9b80c9b90 2023-07-06T22:20:42.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9bf034640 1 -- 172.21.15.55:0/715169268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b8158ba0 con 0x7fe9b80c9b90 2023-07-06T22:20:42.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9b57fa640 1 -- 172.21.15.55:0/715169268 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a40047f0 con 0x7fe9b80c9b90 2023-07-06T22:20:42.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.943+0000 7fe9bf034640 1 -- 172.21.15.55:0/715169268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b806be50 con 0x7fe9b80c9b90 2023-07-06T22:20:42.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.947+0000 7fe9bf034640 1 -- 172.21.15.55:0/715169268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b80c94e0 con 0x7fe9b80c9b90 2023-07-06T22:20:42.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.947+0000 7fe9b57fa640 1 -- 172.21.15.55:0/715169268 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 109) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fe9a4004950 con 0x7fe9b80c9b90 2023-07-06T22:20:42.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.947+0000 7fe9b57fa640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fe99c066120 0x7fe99c0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:42.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.947+0000 7fe9b57fa640 1 -- 172.21.15.55:0/715169268 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fe9a40830d0 con 0x7fe9b80c9b90 2023-07-06T22:20:42.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.947+0000 7fe9bcdd0640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fe99c066120 0x7fe99c0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:42.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.947+0000 7fe9bcdd0640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fe99c066120 0x7fe99c0685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0af000 tx=0x7fe9ac0a7000 comp rx=0 tx=0).ready entity=mgr.8975 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:42.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:42.951+0000 7fe9b57fa640 1 -- 172.21.15.55:0/715169268 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe9b80c94e0 con 0x7fe9b80c9b90 2023-07-06T22:20:43.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.123+0000 7fe9bf034640 1 -- 172.21.15.55:0/715169268 --> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9b80c8d00 con 0x7fe99c066120 2023-07-06T22:20:43.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.135+0000 7fe9b57fa640 1 -- 172.21.15.55:0/715169268 <== mgr.8975 v2:172.21.15.55:6832/3861190779 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7fe9ac0ab6a0 con 0x7fe99c066120 2023-07-06T22:20:43.137 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:43.138 INFO:teuthology.orchestra.run.smithi055.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-06T22:20:43.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.135+0000 7fe9bf034640 1 -- 172.21.15.55:0/715169268 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fe99c066120 msgr2=0x7fe99c0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:43.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.135+0000 7fe9bf034640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fe99c066120 0x7fe99c0685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0af000 tx=0x7fe9ac0a7000 comp rx=0 tx=0).stop 2023-07-06T22:20:43.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.135+0000 7fe9bf034640 1 -- 172.21.15.55:0/715169268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b80c9b90 msgr2=0x7fe9b806c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:43.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.135+0000 7fe9bf034640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b80c9b90 0x7fe9b806c930 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400c7b0 tx=0x7fe9a400cc70 comp rx=0 tx=0).stop 2023-07-06T22:20:43.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.135+0000 7fe9bf034640 1 -- 172.21.15.55:0/715169268 shutdown_connections 2023-07-06T22:20:43.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.135+0000 7fe9bf034640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fe99c066120 0x7fe99c0685d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.135+0000 7fe9bf034640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9b80ccb70 0x7fe9b8162880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.135+0000 7fe9bf034640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9b80c9b90 0x7fe9b806c930 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.135+0000 7fe9bf034640 1 --2- 172.21.15.55:0/715169268 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9b80693f0 0x7fe9b8158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.135+0000 7fe9bf034640 1 -- 172.21.15.55:0/715169268 >> 172.21.15.55:0/715169268 conn(0x7fe9b80cde30 msgr2=0x7fe9b815d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:43.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.135+0000 7fe9bf034640 1 -- 172.21.15.55:0/715169268 shutdown_connections 2023-07-06T22:20:43.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.135+0000 7fe9bf034640 1 -- 172.21.15.55:0/715169268 wait complete. 2023-07-06T22:20:43.158 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-06T22:20:43.159 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-07-06T22:20:43.159 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-06T22:20:43.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f557b937640 1 Processor -- start 2023-07-06T22:20:43.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f557b937640 1 -- start start 2023-07-06T22:20:43.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f557b937640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55740b3c90 0x7f55740ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:43.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f557b937640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f55740d1d30 0x7f55740cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:43.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f557b937640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55740ccd50 con 0x7f55740b18a0 2023-07-06T22:20:43.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f557b937640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55740cd0a0 con 0x7f55740b3c90 2023-07-06T22:20:43.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f557b937640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5574069ea0 con 0x7f55740d1d30 2023-07-06T22:20:43.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f55796d3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55740b3c90 0x7f55740ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:43.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f55796d3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55740b3c90 0x7f55740ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33428/0 (socket says 172.21.15.55:33428) 2023-07-06T22:20:43.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f55796d3640 1 -- 172.21.15.55:0/2281024736 learned_addr learned my addr 172.21.15.55:0/2281024736 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:43.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f5579ed4640 1 --2- 172.21.15.55:0/2281024736 >> v2:172.21.15.138:3300/0 conn(0x7f55740d1d30 0x7f55740cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:43.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f55796d3640 1 -- 172.21.15.55:0/2281024736 >> v2:172.21.15.138:3300/0 conn(0x7f55740d1d30 msgr2=0x7f55740cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:43.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f55796d3640 1 --2- 172.21.15.55:0/2281024736 >> v2:172.21.15.138:3300/0 conn(0x7f55740d1d30 0x7f55740cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f55796d3640 1 -- 172.21.15.55:0/2281024736 >> v1:172.21.15.138:6789/0 conn(0x7f55740b18a0 legacy=0x7f55740b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:43.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.307+0000 7f55796d3640 1 -- 172.21.15.55:0/2281024736 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557406a140 con 0x7f55740b3c90 2023-07-06T22:20:43.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.311+0000 7f55796d3640 1 --2- 172.21.15.55:0/2281024736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55740b3c90 0x7f55740ce460 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f55740b8360 tx=0x7f557001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d514cd13bcf7eed7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:43.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.311+0000 7f556bfff640 1 -- 172.21.15.55:0/2281024736 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700aa650 con 0x7f55740b3c90 2023-07-06T22:20:43.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.311+0000 7f556bfff640 1 -- 172.21.15.55:0/2281024736 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55700aa7b0 con 0x7f55740b3c90 2023-07-06T22:20:43.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.311+0000 7f556bfff640 1 -- 172.21.15.55:0/2281024736 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700aab40 con 0x7f55740b3c90 2023-07-06T22:20:43.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.311+0000 7f557b937640 1 -- 172.21.15.55:0/2281024736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55740b3c90 msgr2=0x7f55740ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:43.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.311+0000 7f557b937640 1 --2- 172.21.15.55:0/2281024736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55740b3c90 0x7f55740ce460 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f55740b8360 tx=0x7f557001c4d0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.311+0000 7f557b937640 1 -- 172.21.15.55:0/2281024736 shutdown_connections 2023-07-06T22:20:43.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.311+0000 7f557b937640 1 --2- 172.21.15.55:0/2281024736 >> v2:172.21.15.138:3300/0 conn(0x7f55740d1d30 0x7f55740cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.311+0000 7f557b937640 1 --2- 172.21.15.55:0/2281024736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55740b3c90 0x7f55740ce460 unknown :-1 s=CLOSED pgs=2288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.311+0000 7f557b937640 1 -- 172.21.15.55:0/2281024736 >> 172.21.15.55:0/2281024736 conn(0x7f557406bf40 msgr2=0x7f55740cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:43.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.311+0000 7f557b937640 1 -- 172.21.15.55:0/2281024736 shutdown_connections 2023-07-06T22:20:43.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.311+0000 7f557b937640 1 -- 172.21.15.55:0/2281024736 wait complete. 2023-07-06T22:20:43.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f557b937640 1 Processor -- start 2023-07-06T22:20:43.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f557b937640 1 -- start start 2023-07-06T22:20:43.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f557b937640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55740b18a0 0x7f557414f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:43.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f557b937640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55740b3c90 0x7f5574154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:43.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f557b937640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55740d1d30 0x7f5574155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:43.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f557b937640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55740cad40 con 0x7f55740b18a0 2023-07-06T22:20:43.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f557b937640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55740cb8c0 con 0x7f55740b3c90 2023-07-06T22:20:43.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f557b937640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55740caf90 con 0x7f55740d1d30 2023-07-06T22:20:43.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f55796d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55740b18a0 0x7f557414f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:43.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f55796d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55740b18a0 0x7f557414f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33430/0 (socket says 172.21.15.55:33430) 2023-07-06T22:20:43.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f55796d3640 1 -- 172.21.15.55:0/672816607 learned_addr learned my addr 172.21.15.55:0/672816607 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:43.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f5578ed2640 1 --2- 172.21.15.55:0/672816607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55740b3c90 0x7f5574154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:43.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f5579ed4640 1 --2- 172.21.15.55:0/672816607 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55740d1d30 0x7f5574155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:43.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f55796d3640 1 -- 172.21.15.55:0/672816607 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55740d1d30 msgr2=0x7f5574155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:43.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f55796d3640 1 --2- 172.21.15.55:0/672816607 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55740d1d30 0x7f5574155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f55796d3640 1 -- 172.21.15.55:0/672816607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55740b3c90 msgr2=0x7f5574154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:43.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f55796d3640 1 --2- 172.21.15.55:0/672816607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55740b3c90 0x7f5574154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f55796d3640 1 -- 172.21.15.55:0/672816607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55700094d0 con 0x7f55740b18a0 2023-07-06T22:20:43.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f55796d3640 1 --2- 172.21.15.55:0/672816607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55740b18a0 0x7f557414f800 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f55700190e0 tx=0x7f557001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:43.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.315+0000 7f5569ffb640 1 -- 172.21.15.55:0/672816607 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700b3800 con 0x7f55740b18a0 2023-07-06T22:20:43.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.319+0000 7f5569ffb640 1 -- 172.21.15.55:0/672816607 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55700b3960 con 0x7f55740b18a0 2023-07-06T22:20:43.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.319+0000 7f5569ffb640 1 -- 172.21.15.55:0/672816607 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700b3cf0 con 0x7f55740b18a0 2023-07-06T22:20:43.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.319+0000 7f557b937640 1 -- 172.21.15.55:0/672816607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55740cb270 con 0x7f55740b18a0 2023-07-06T22:20:43.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.319+0000 7f557b937640 1 -- 172.21.15.55:0/672816607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55741512e0 con 0x7f55740b18a0 2023-07-06T22:20:43.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.319+0000 7f557b937640 1 -- 172.21.15.55:0/672816607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5574066d60 con 0x7f55740b18a0 2023-07-06T22:20:43.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.319+0000 7f5569ffb640 1 -- 172.21.15.55:0/672816607 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 110) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f55700c6440 con 0x7f55740b18a0 2023-07-06T22:20:43.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.319+0000 7f5569ffb640 1 --2- 172.21.15.55:0/672816607 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f55580664b0 0x7f5558068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:43.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.319+0000 7f5569ffb640 1 -- 172.21.15.55:0/672816607 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f557011eee0 con 0x7f55740b18a0 2023-07-06T22:20:43.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.319+0000 7f5578ed2640 1 --2- 172.21.15.55:0/672816607 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f55580664b0 0x7f5558068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:43.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.323+0000 7f5578ed2640 1 --2- 172.21.15.55:0/672816607 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f55580664b0 0x7f5558068960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f55740cc000 tx=0x7f5564009040 comp rx=0 tx=0).ready entity=mgr.8975 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:43.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.323+0000 7f5569ffb640 1 -- 172.21.15.55:0/672816607 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55700ebf80 con 0x7f55740b18a0 2023-07-06T22:20:43.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.499+0000 7f557b937640 1 -- 172.21.15.55:0/672816607 --> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f55740cf180 con 0x7f55580664b0 2023-07-06T22:20:43.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.587+0000 7f5569ffb640 1 -- 172.21.15.55:0/672816607 <== mgr.8975 v2:172.21.15.55:6832/3861190779 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f55740cf180 con 0x7f55580664b0 2023-07-06T22:20:43.590 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path snap_test_dir1 2023-07-06T22:20:43.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.591+0000 7f557b937640 1 -- 172.21.15.55:0/672816607 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f55580664b0 msgr2=0x7f5558068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:43.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.591+0000 7f557b937640 1 --2- 172.21.15.55:0/672816607 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f55580664b0 0x7f5558068960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f55740cc000 tx=0x7f5564009040 comp rx=0 tx=0).stop 2023-07-06T22:20:43.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.591+0000 7f557b937640 1 -- 172.21.15.55:0/672816607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55740b18a0 msgr2=0x7f557414f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:43.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.591+0000 7f557b937640 1 --2- 172.21.15.55:0/672816607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55740b18a0 0x7f557414f800 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f55700190e0 tx=0x7f557001ad10 comp rx=0 tx=0).stop 2023-07-06T22:20:43.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.591+0000 7f557b937640 1 -- 172.21.15.55:0/672816607 shutdown_connections 2023-07-06T22:20:43.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.591+0000 7f557b937640 1 --2- 172.21.15.55:0/672816607 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f55580664b0 0x7f5558068960 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.591+0000 7f557b937640 1 --2- 172.21.15.55:0/672816607 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55740d1d30 0x7f5574155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.591+0000 7f557b937640 1 --2- 172.21.15.55:0/672816607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55740b3c90 0x7f5574154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.591+0000 7f557b937640 1 --2- 172.21.15.55:0/672816607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55740b18a0 0x7f557414f800 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.591+0000 7f557b937640 1 -- 172.21.15.55:0/672816607 >> 172.21.15.55:0/672816607 conn(0x7f557406bf40 msgr2=0x7f55741580c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:43.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.591+0000 7f557b937640 1 -- 172.21.15.55:0/672816607 shutdown_connections 2023-07-06T22:20:43.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.591+0000 7f557b937640 1 -- 172.21.15.55:0/672816607 wait complete. 2023-07-06T22:20:43.611 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-06T22:20:43.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:43.612 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-06T22:20:43.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:43.624 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-06T22:20:43.678 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-06T22:20:43.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.859+0000 7f8bbdcec640 1 Processor -- start 2023-07-06T22:20:43.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.859+0000 7f8bbdcec640 1 -- start start 2023-07-06T22:20:43.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bbdcec640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8bb80709a0 0x7f8bb80cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:43.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bbdcec640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bb80cbe60 0x7f8bb80b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:43.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bbdcec640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8bb8070d70 0x7f8bb80b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:43.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bbdcec640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb80cc300 con 0x7f8bb8070d70 2023-07-06T22:20:43.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bbdcec640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb80cc5e0 con 0x7f8bb80709a0 2023-07-06T22:20:43.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bbdcec640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80cc8c0 con 0x7f8bb80cbe60 2023-07-06T22:20:43.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bb7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8bb8070d70 0x7f8bb80b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:43.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bb7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8bb8070d70 0x7f8bb80b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33432/0 (socket says 172.21.15.55:33432) 2023-07-06T22:20:43.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bb7fff640 1 -- 172.21.15.55:0/2795685811 learned_addr learned my addr 172.21.15.55:0/2795685811 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:43.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bb77fe640 1 --2- 172.21.15.55:0/2795685811 >> v2:172.21.15.138:3300/0 conn(0x7f8bb80709a0 0x7f8bb80cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:43.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bb6ffd640 1 --2- 172.21.15.55:0/2795685811 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bb80cbe60 0x7f8bb80b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:43.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bb7fff640 1 -- 172.21.15.55:0/2795685811 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bb80cbe60 msgr2=0x7f8bb80b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:43.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bb7fff640 1 --2- 172.21.15.55:0/2795685811 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bb80cbe60 0x7f8bb80b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bb7fff640 1 -- 172.21.15.55:0/2795685811 >> v2:172.21.15.138:3300/0 conn(0x7f8bb80709a0 msgr2=0x7f8bb80cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:43.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bb7fff640 1 --2- 172.21.15.55:0/2795685811 >> v2:172.21.15.138:3300/0 conn(0x7f8bb80709a0 0x7f8bb80cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bb7fff640 1 -- 172.21.15.55:0/2795685811 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb80ccba0 con 0x7f8bb8070d70 2023-07-06T22:20:43.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.863+0000 7f8bb7fff640 1 --2- 172.21.15.55:0/2795685811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb8070d70 0x7f8bb80b1170 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f8bb806ec60 tx=0x7f8bb001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b281e90613e2b5f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:43.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bb67fc640 1 -- 172.21.15.55:0/2795685811 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00a5760 con 0x7f8bb8070d70 2023-07-06T22:20:43.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bb67fc640 1 -- 172.21.15.55:0/2795685811 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb00a58c0 con 0x7f8bb8070d70 2023-07-06T22:20:43.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bb67fc640 1 -- 172.21.15.55:0/2795685811 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00a5c50 con 0x7f8bb8070d70 2023-07-06T22:20:43.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 -- 172.21.15.55:0/2795685811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb8070d70 msgr2=0x7f8bb80b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:43.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 --2- 172.21.15.55:0/2795685811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb8070d70 0x7f8bb80b1170 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f8bb806ec60 tx=0x7f8bb001c9d0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 -- 172.21.15.55:0/2795685811 shutdown_connections 2023-07-06T22:20:43.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 --2- 172.21.15.55:0/2795685811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb8070d70 0x7f8bb80b1170 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 --2- 172.21.15.55:0/2795685811 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bb80cbe60 0x7f8bb80b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 --2- 172.21.15.55:0/2795685811 >> v2:172.21.15.138:3300/0 conn(0x7f8bb80709a0 0x7f8bb80cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 -- 172.21.15.55:0/2795685811 >> 172.21.15.55:0/2795685811 conn(0x7f8bb80cea70 msgr2=0x7f8bb80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:43.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 -- 172.21.15.55:0/2795685811 shutdown_connections 2023-07-06T22:20:43.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 -- 172.21.15.55:0/2795685811 wait complete. 2023-07-06T22:20:43.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 Processor -- start 2023-07-06T22:20:43.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 -- start start 2023-07-06T22:20:43.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bb80709a0 0x7f8bb80c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:43.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bb8070d70 0x7f8bb806b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:43.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb80cbe60 0x7f8bb8152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:43.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb815bda0 con 0x7f8bb80cbe60 2023-07-06T22:20:43.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb815c080 con 0x7f8bb80709a0 2023-07-06T22:20:43.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bbdcec640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb815c360 con 0x7f8bb8070d70 2023-07-06T22:20:43.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bb80709a0 0x7f8bb80c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:43.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.867+0000 7f8bb7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb80cbe60 0x7f8bb8152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:43.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8bb6ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bb8070d70 0x7f8bb806b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:43.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bb80709a0 0x7f8bb80c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:48954/0 (socket says 172.21.15.55:48954) 2023-07-06T22:20:43.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8bb77fe640 1 -- 172.21.15.55:0/3050896833 learned_addr learned my addr 172.21.15.55:0/3050896833 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:43.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8bb7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb80cbe60 0x7f8bb8152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33438/0 (socket says 172.21.15.55:33438) 2023-07-06T22:20:43.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8bb6ffd640 1 --2- 172.21.15.55:0/3050896833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bb8070d70 0x7f8bb806b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:60276/0 (socket says 172.21.15.55:60276) 2023-07-06T22:20:43.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8bb7fff640 1 -- 172.21.15.55:0/3050896833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bb8070d70 msgr2=0x7f8bb806b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:43.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8bb7fff640 1 --2- 172.21.15.55:0/3050896833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bb8070d70 0x7f8bb806b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8bb7fff640 1 -- 172.21.15.55:0/3050896833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bb80709a0 msgr2=0x7f8bb80c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:43.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8bb7fff640 1 --2- 172.21.15.55:0/3050896833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bb80709a0 0x7f8bb80c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:43.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8bb7fff640 1 -- 172.21.15.55:0/3050896833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0009b30 con 0x7f8bb80cbe60 2023-07-06T22:20:43.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8bb7fff640 1 --2- 172.21.15.55:0/3050896833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb80cbe60 0x7f8bb8152360 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00ab000 tx=0x7f8bb0019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:43.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8b9ffff640 1 -- 172.21.15.55:0/3050896833 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00b8470 con 0x7f8bb80cbe60 2023-07-06T22:20:43.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8b9ffff640 1 -- 172.21.15.55:0/3050896833 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb00b85d0 con 0x7f8bb80cbe60 2023-07-06T22:20:43.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8b9ffff640 1 -- 172.21.15.55:0/3050896833 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00b8980 con 0x7f8bb80cbe60 2023-07-06T22:20:43.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8bbdcec640 1 -- 172.21.15.55:0/3050896833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb815c640 con 0x7f8bb80cbe60 2023-07-06T22:20:43.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8bbdcec640 1 -- 172.21.15.55:0/3050896833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb80c9770 con 0x7f8bb80cbe60 2023-07-06T22:20:43.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8bbdcec640 1 -- 172.21.15.55:0/3050896833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb8158810 con 0x7f8bb80cbe60 2023-07-06T22:20:43.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.871+0000 7f8b9ffff640 1 -- 172.21.15.55:0/3050896833 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 110) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f8bb00b8ae0 con 0x7f8bb80cbe60 2023-07-06T22:20:43.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.875+0000 7f8b9ffff640 1 --2- 172.21.15.55:0/3050896833 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f8ba40664b0 0x7f8ba4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:43.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.875+0000 7f8b9ffff640 1 -- 172.21.15.55:0/3050896833 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f8bb011f0a0 con 0x7f8bb80cbe60 2023-07-06T22:20:43.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.875+0000 7f8bb77fe640 1 --2- 172.21.15.55:0/3050896833 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f8ba40664b0 0x7f8ba4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:43.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.875+0000 7f8bb77fe640 1 --2- 172.21.15.55:0/3050896833 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f8ba40664b0 0x7f8ba4068960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800bb90 tx=0x7f8ba8008040 comp rx=0 tx=0).ready entity=mgr.8975 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:43.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:43.879+0000 7f8b9ffff640 1 -- 172.21.15.55:0/3050896833 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8bb00ec260 con 0x7f8bb80cbe60 2023-07-06T22:20:44.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.071+0000 7f8bbdcec640 1 -- 172.21.15.55:0/3050896833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f8bb8066d60 con 0x7f8bb80cbe60 2023-07-06T22:20:44.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.271+0000 7f8b9ffff640 1 -- 172.21.15.55:0/3050896833 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 111) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f8bb00ec630 con 0x7f8bb80cbe60 2023-07-06T22:20:44.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.271+0000 7f8b9ffff640 1 -- 172.21.15.55:0/3050896833 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v111) v1 ==== 93+0+0 (secure 0 0 0) 0x7f8bb0118540 con 0x7f8bb80cbe60 2023-07-06T22:20:44.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.271+0000 7f8bbdcec640 1 -- 172.21.15.55:0/3050896833 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f8ba40664b0 msgr2=0x7f8ba4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:44.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.271+0000 7f8bbdcec640 1 --2- 172.21.15.55:0/3050896833 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f8ba40664b0 0x7f8ba4068960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800bb90 tx=0x7f8ba8008040 comp rx=0 tx=0).stop 2023-07-06T22:20:44.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.271+0000 7f8bbdcec640 1 -- 172.21.15.55:0/3050896833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb80cbe60 msgr2=0x7f8bb8152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:44.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.271+0000 7f8bbdcec640 1 --2- 172.21.15.55:0/3050896833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb80cbe60 0x7f8bb8152360 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00ab000 tx=0x7f8bb0019770 comp rx=0 tx=0).stop 2023-07-06T22:20:44.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.275+0000 7f8bbdcec640 1 -- 172.21.15.55:0/3050896833 shutdown_connections 2023-07-06T22:20:44.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.275+0000 7f8bbdcec640 1 --2- 172.21.15.55:0/3050896833 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f8ba40664b0 0x7f8ba4068960 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:44.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.275+0000 7f8bbdcec640 1 --2- 172.21.15.55:0/3050896833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb80cbe60 0x7f8bb8152360 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:44.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.275+0000 7f8bbdcec640 1 --2- 172.21.15.55:0/3050896833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bb8070d70 0x7f8bb806b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:44.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.275+0000 7f8bbdcec640 1 --2- 172.21.15.55:0/3050896833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bb80709a0 0x7f8bb80c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:44.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.275+0000 7f8bbdcec640 1 -- 172.21.15.55:0/3050896833 >> 172.21.15.55:0/3050896833 conn(0x7f8bb80cea70 msgr2=0x7f8bb80c8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:44.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.275+0000 7f8bbdcec640 1 -- 172.21.15.55:0/3050896833 shutdown_connections 2023-07-06T22:20:44.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.275+0000 7f8bbdcec640 1 -- 172.21.15.55:0/3050896833 wait complete. 2023-07-06T22:20:44.296 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T22:20:44.296 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:20:44.354 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T22:20:44.438 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T22:20:44.438 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:20:44.439 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:44.439 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:44.435+0000 7f2ae1013180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:20:44.448 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:20:44.448 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:44.453 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:44.451+0000 7f9e8984a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T22:20:44.461 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:20:44.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc08b231640 1 Processor -- start 2023-07-06T22:20:44.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc08b231640 1 -- start start 2023-07-06T22:20:44.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc08b231640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0840b42b0 0x7fc084166990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:44.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc08b231640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0840cc770 con 0x7fc0840ce5e0 2023-07-06T22:20:44.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc08b231640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0840cc9c0 con 0x7fc08415b9d0 2023-07-06T22:20:44.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc08b231640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840ccca0 con 0x7fc0840b42b0 2023-07-06T22:20:44.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc089a2e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc0840ce5e0 0x7fc0840b3ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56898/0 (socket says 172.21.15.55:56898) 2023-07-06T22:20:44.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc089a2e640 1 -- 172.21.15.55:0/442345613 learned_addr learned my addr 172.21.15.55:0/442345613 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:44.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc08aa30640 1 --2- 172.21.15.55:0/442345613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0840b42b0 0x7fc084166990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:44.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc08922d640 1 -- 172.21.15.55:0/442345613 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574702328 0 0) 0x7fc0840cc770 con 0x7fc0840ce5e0 2023-07-06T22:20:44.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc08922d640 1 -- 172.21.15.55:0/442345613 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc070003530 con 0x7fc0840ce5e0 2023-07-06T22:20:44.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc08922d640 1 -- 172.21.15.55:0/442345613 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677164383 0 0) 0x7fc0840cc9c0 con 0x7fc08415b9d0 2023-07-06T22:20:44.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc08922d640 1 -- 172.21.15.55:0/442345613 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0840cc770 con 0x7fc08415b9d0 2023-07-06T22:20:44.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc08aa30640 1 -- 172.21.15.55:0/442345613 >> v1:172.21.15.138:6789/0 conn(0x7fc08415b9d0 legacy=0x7fc0840b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:44.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc08aa30640 1 -- 172.21.15.55:0/442345613 >> v1:172.21.15.55:6789/0 conn(0x7fc0840ce5e0 legacy=0x7fc0840b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:44.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.647+0000 7fc08aa30640 1 -- 172.21.15.55:0/442345613 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0840d0130 con 0x7fc0840b42b0 2023-07-06T22:20:44.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.651+0000 7fc08aa30640 1 --2- 172.21.15.55:0/442345613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0840b42b0 0x7fc084166990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009dc0 tx=0x7fc07c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d0cf2ba45f561ed server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:44.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.651+0000 7fc08922d640 1 -- 172.21.15.55:0/442345613 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c0a5a50 con 0x7fc0840b42b0 2023-07-06T22:20:44.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.651+0000 7fc08922d640 1 -- 172.21.15.55:0/442345613 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c0a5bb0 con 0x7fc0840b42b0 2023-07-06T22:20:44.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.651+0000 7fc08922d640 1 -- 172.21.15.55:0/442345613 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c0ad440 con 0x7fc0840b42b0 2023-07-06T22:20:44.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.651+0000 7fc08b231640 1 -- 172.21.15.55:0/442345613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0840b42b0 msgr2=0x7fc084166990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:44.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.651+0000 7fc08b231640 1 --2- 172.21.15.55:0/442345613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0840b42b0 0x7fc084166990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009dc0 tx=0x7fc07c01c970 comp rx=0 tx=0).stop 2023-07-06T22:20:44.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.651+0000 7fc08b231640 1 -- 172.21.15.55:0/442345613 shutdown_connections 2023-07-06T22:20:44.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.651+0000 7fc08b231640 1 --2- 172.21.15.55:0/442345613 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0840b42b0 0x7fc084166990 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:44.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.651+0000 7fc08b231640 1 -- 172.21.15.55:0/442345613 >> 172.21.15.55:0/442345613 conn(0x7fc08406c2b0 msgr2=0x7fc0840ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:44.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.651+0000 7fc08b231640 1 -- 172.21.15.55:0/442345613 shutdown_connections 2023-07-06T22:20:44.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.651+0000 7fc08b231640 1 -- 172.21.15.55:0/442345613 wait complete. 2023-07-06T22:20:44.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc08b231640 1 Processor -- start 2023-07-06T22:20:44.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc08b231640 1 -- start start 2023-07-06T22:20:44.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc08b231640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0840b42b0 0x7fc0840c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:44.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc08b231640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0840ce5e0 0x7fc0840b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:44.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc08b231640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc08415b9d0 0x7fc0840c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:44.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc08b231640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840c61a0 con 0x7fc0840ce5e0 2023-07-06T22:20:44.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc08b231640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840c6480 con 0x7fc0840b42b0 2023-07-06T22:20:44.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc08b231640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840c6760 con 0x7fc08415b9d0 2023-07-06T22:20:44.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc089a2e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0840ce5e0 0x7fc0840b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:44.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc089a2e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0840ce5e0 0x7fc0840b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33476/0 (socket says 172.21.15.55:33476) 2023-07-06T22:20:44.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc089a2e640 1 -- 172.21.15.55:0/1193069644 learned_addr learned my addr 172.21.15.55:0/1193069644 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:44.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc08a22f640 1 --2- 172.21.15.55:0/1193069644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0840b42b0 0x7fc0840c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:44.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc08aa30640 1 --2- 172.21.15.55:0/1193069644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc08415b9d0 0x7fc0840c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:44.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc089a2e640 1 -- 172.21.15.55:0/1193069644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc08415b9d0 msgr2=0x7fc0840c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:44.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc089a2e640 1 --2- 172.21.15.55:0/1193069644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc08415b9d0 0x7fc0840c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:44.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc089a2e640 1 -- 172.21.15.55:0/1193069644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0840b42b0 msgr2=0x7fc0840c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:44.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc089a2e640 1 --2- 172.21.15.55:0/1193069644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0840b42b0 0x7fc0840c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:44.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc089a2e640 1 -- 172.21.15.55:0/1193069644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c009a70 con 0x7fc0840ce5e0 2023-07-06T22:20:44.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc089a2e640 1 --2- 172.21.15.55:0/1193069644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0840ce5e0 0x7fc0840b5130 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7fc07400c4d0 tx=0x7fc07400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:44.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc07affd640 1 -- 172.21.15.55:0/1193069644 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074005cf0 con 0x7fc0840ce5e0 2023-07-06T22:20:44.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc07affd640 1 -- 172.21.15.55:0/1193069644 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074005e50 con 0x7fc0840ce5e0 2023-07-06T22:20:44.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc07affd640 1 -- 172.21.15.55:0/1193069644 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074007270 con 0x7fc0840ce5e0 2023-07-06T22:20:44.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc08b231640 1 -- 172.21.15.55:0/1193069644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0840c6a40 con 0x7fc0840ce5e0 2023-07-06T22:20:44.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.655+0000 7fc08b231640 1 -- 172.21.15.55:0/1193069644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0840c8930 con 0x7fc0840ce5e0 2023-07-06T22:20:44.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.659+0000 7fc08b231640 1 -- 172.21.15.55:0/1193069644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08404d790 con 0x7fc0840ce5e0 2023-07-06T22:20:44.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.659+0000 7fc07affd640 1 -- 172.21.15.55:0/1193069644 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 111) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fc0740073d0 con 0x7fc0840ce5e0 2023-07-06T22:20:44.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.659+0000 7fc07affd640 1 --2- 172.21.15.55:0/1193069644 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc068066430 0x7fc0680688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:44.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.659+0000 7fc08a22f640 1 -- 172.21.15.55:0/1193069644 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc068066430 msgr2=0x7fc0680688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3861190779 2023-07-06T22:20:44.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.659+0000 7fc07affd640 1 -- 172.21.15.55:0/1193069644 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fc0740837f0 con 0x7fc0840ce5e0 2023-07-06T22:20:44.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.659+0000 7fc08a22f640 1 --2- 172.21.15.55:0/1193069644 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc068066430 0x7fc0680688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:44.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.663+0000 7fc07affd640 1 -- 172.21.15.55:0/1193069644 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc0740507f0 con 0x7fc0840ce5e0 2023-07-06T22:20:44.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.819+0000 7fc08b231640 1 -- 172.21.15.55:0/1193069644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0840b31e0 con 0x7fc0840ce5e0 2023-07-06T22:20:44.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.819+0000 7fc07affd640 1 -- 172.21.15.55:0/1193069644 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+19095 (secure 0 0 0) 0x7fc074053e10 con 0x7fc0840ce5e0 2023-07-06T22:20:44.823 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:44.823 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":197,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:20:41.235676+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:20:21.647148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-07-06T22:20:22.723236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3797237235":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/558674907":"2023-07-07T22:20:41.235643+0000","172.21.15.55:6833/538997467":"2023-07-07T22:20:41.235643+0000","172.21.15.55:6832/538997467":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/2063199878":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/2431773305":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/237391926":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/3850725654":"2023-07-07T22:20:41.235643+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:20:44.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.823+0000 7fc08b231640 1 -- 172.21.15.55:0/1193069644 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc068066430 msgr2=0x7fc0680688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:44.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.823+0000 7fc08b231640 1 --2- 172.21.15.55:0/1193069644 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc068066430 0x7fc0680688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:44.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.823+0000 7fc08b231640 1 -- 172.21.15.55:0/1193069644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0840ce5e0 msgr2=0x7fc0840b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:44.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.823+0000 7fc08b231640 1 --2- 172.21.15.55:0/1193069644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0840ce5e0 0x7fc0840b5130 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7fc07400c4d0 tx=0x7fc07400c990 comp rx=0 tx=0).stop 2023-07-06T22:20:44.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.823+0000 7fc08b231640 1 -- 172.21.15.55:0/1193069644 shutdown_connections 2023-07-06T22:20:44.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.823+0000 7fc08b231640 1 --2- 172.21.15.55:0/1193069644 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc068066430 0x7fc0680688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:44.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.823+0000 7fc08b231640 1 --2- 172.21.15.55:0/1193069644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc08415b9d0 0x7fc0840c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:44.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.823+0000 7fc08b231640 1 --2- 172.21.15.55:0/1193069644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0840ce5e0 0x7fc0840b5130 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:44.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.823+0000 7fc08b231640 1 --2- 172.21.15.55:0/1193069644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0840b42b0 0x7fc0840c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:44.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.823+0000 7fc08b231640 1 -- 172.21.15.55:0/1193069644 >> 172.21.15.55:0/1193069644 conn(0x7fc08406c2b0 msgr2=0x7fc0840d2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:44.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.823+0000 7fc08b231640 1 -- 172.21.15.55:0/1193069644 shutdown_connections 2023-07-06T22:20:44.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.823+0000 7fc08b231640 1 -- 172.21.15.55:0/1193069644 wait complete. 2023-07-06T22:20:44.845 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T22:20:21.647148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T22:20:22.723236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:20:44.846 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:20:44.854 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:44.851+0000 7f2ae1013180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:20:44.898 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:44.895+0000 7f9e8984a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T22:20:44.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.991+0000 7fb5a2269640 1 Processor -- start 2023-07-06T22:20:44.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.991+0000 7fb5a2269640 1 -- start start 2023-07-06T22:20:44.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb5a2269640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb59c0d0630 0x7fb59c15fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:44.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb5a2269640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb59c0ce200 0x7fb59c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:44.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb5a2269640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59c0cc740 con 0x7fb59c0b1250 2023-07-06T22:20:44.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb5a2269640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59c0ccc90 con 0x7fb59c0d0630 2023-07-06T22:20:44.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb5a2269640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c0b29c0 con 0x7fb59c0ce200 2023-07-06T22:20:44.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb5a1267640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb59c0b1250 0x7fb59c15f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56912/0 (socket says 172.21.15.55:56912) 2023-07-06T22:20:44.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb5a1267640 1 -- 172.21.15.55:0/1091901026 learned_addr learned my addr 172.21.15.55:0/1091901026 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:44.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb5a0a66640 1 --2- 172.21.15.55:0/1091901026 >> v2:172.21.15.138:3300/0 conn(0x7fb59c0d0630 0x7fb59c15fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:44.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb5a1a68640 1 --2- 172.21.15.55:0/1091901026 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb59c0ce200 0x7fb59c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:44.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb593fff640 1 -- 172.21.15.55:0/1091901026 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451781586 0 0) 0x7fb59c0cc740 con 0x7fb59c0b1250 2023-07-06T22:20:44.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb593fff640 1 -- 172.21.15.55:0/1091901026 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb588003530 con 0x7fb59c0b1250 2023-07-06T22:20:44.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb5a0a66640 1 -- 172.21.15.55:0/1091901026 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb59c0ce200 msgr2=0x7fb59c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:44.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb5a0a66640 1 --2- 172.21.15.55:0/1091901026 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb59c0ce200 0x7fb59c0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:44.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb5a0a66640 1 -- 172.21.15.55:0/1091901026 >> v1:172.21.15.55:6789/0 conn(0x7fb59c0b1250 legacy=0x7fb59c15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:44.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.995+0000 7fb5a0a66640 1 -- 172.21.15.55:0/1091901026 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c0d1d10 con 0x7fb59c0d0630 2023-07-06T22:20:45.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.999+0000 7fb5a0a66640 1 --2- 172.21.15.55:0/1091901026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb59c0d0630 0x7fb59c15fa90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0097c0 tx=0x7fb58c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c2e1aba3d0187f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:45.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.999+0000 7fb593fff640 1 -- 172.21.15.55:0/1091901026 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0ab600 con 0x7fb59c0d0630 2023-07-06T22:20:45.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.999+0000 7fb593fff640 1 -- 172.21.15.55:0/1091901026 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c0a7050 con 0x7fb59c0d0630 2023-07-06T22:20:45.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.999+0000 7fb593fff640 1 -- 172.21.15.55:0/1091901026 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0ab980 con 0x7fb59c0d0630 2023-07-06T22:20:45.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.999+0000 7fb5a2269640 1 -- 172.21.15.55:0/1091901026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb59c0d0630 msgr2=0x7fb59c15fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:45.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.999+0000 7fb5a2269640 1 --2- 172.21.15.55:0/1091901026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb59c0d0630 0x7fb59c15fa90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0097c0 tx=0x7fb58c01c480 comp rx=0 tx=0).stop 2023-07-06T22:20:45.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.999+0000 7fb5a2269640 1 -- 172.21.15.55:0/1091901026 shutdown_connections 2023-07-06T22:20:45.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.999+0000 7fb5a2269640 1 --2- 172.21.15.55:0/1091901026 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb59c0ce200 0x7fb59c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.999+0000 7fb5a2269640 1 --2- 172.21.15.55:0/1091901026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb59c0d0630 0x7fb59c15fa90 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.999+0000 7fb5a2269640 1 -- 172.21.15.55:0/1091901026 >> 172.21.15.55:0/1091901026 conn(0x7fb59c0b3b60 msgr2=0x7fb59c0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:45.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.999+0000 7fb5a2269640 1 -- 172.21.15.55:0/1091901026 shutdown_connections 2023-07-06T22:20:45.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.999+0000 7fb5a2269640 1 -- 172.21.15.55:0/1091901026 wait complete. 2023-07-06T22:20:45.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.999+0000 7fb5a2269640 1 Processor -- start 2023-07-06T22:20:45.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:44.999+0000 7fb5a2269640 1 -- start start 2023-07-06T22:20:45.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a2269640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb59c0b1250 0x7fb59c152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a2269640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb59c0ce200 0x7fb59c1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a2269640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb59c0d0630 0x7fb59c159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a2269640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c1564b0 con 0x7fb59c0d0630 2023-07-06T22:20:45.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a2269640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c155b10 con 0x7fb59c0b1250 2023-07-06T22:20:45.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a2269640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c155df0 con 0x7fb59c0ce200 2023-07-06T22:20:45.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a1a68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb59c0d0630 0x7fb59c159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:45.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a1a68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb59c0d0630 0x7fb59c159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33488/0 (socket says 172.21.15.55:33488) 2023-07-06T22:20:45.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a0a66640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb59c0ce200 0x7fb59c1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:45.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a1267640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb59c0b1250 0x7fb59c152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:45.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a1a68640 1 -- 172.21.15.55:0/2195126483 learned_addr learned my addr 172.21.15.55:0/2195126483 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:45.006 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:45.003+0000 7f2ae1013180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:20:45.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a1a68640 1 -- 172.21.15.55:0/2195126483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb59c0ce200 msgr2=0x7fb59c1579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:45.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a1a68640 1 --2- 172.21.15.55:0/2195126483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb59c0ce200 0x7fb59c1579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a1a68640 1 -- 172.21.15.55:0/2195126483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb59c0b1250 msgr2=0x7fb59c152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:45.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a1a68640 1 --2- 172.21.15.55:0/2195126483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb59c0b1250 0x7fb59c152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a1a68640 1 -- 172.21.15.55:0/2195126483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c009420 con 0x7fb59c0d0630 2023-07-06T22:20:45.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a0a66640 1 --2- 172.21.15.55:0/2195126483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb59c0ce200 0x7fb59c1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:45.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a1267640 1 --2- 172.21.15.55:0/2195126483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb59c0b1250 0x7fb59c152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:45.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a1a68640 1 --2- 172.21.15.55:0/2195126483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb59c0d0630 0x7fb59c159710 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7fb59400efc0 tx=0x7fb59400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:45.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb591ffb640 1 -- 172.21.15.55:0/2195126483 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594014480 con 0x7fb59c0d0630 2023-07-06T22:20:45.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb591ffb640 1 -- 172.21.15.55:0/2195126483 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59400f040 con 0x7fb59c0d0630 2023-07-06T22:20:45.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb591ffb640 1 -- 172.21.15.55:0/2195126483 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594014820 con 0x7fb59c0d0630 2023-07-06T22:20:45.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a2269640 1 -- 172.21.15.55:0/2195126483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59c1560d0 con 0x7fb59c0d0630 2023-07-06T22:20:45.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a2269640 1 -- 172.21.15.55:0/2195126483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59c158320 con 0x7fb59c0d0630 2023-07-06T22:20:45.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.003+0000 7fb5a2269640 1 -- 172.21.15.55:0/2195126483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59c04d790 con 0x7fb59c0d0630 2023-07-06T22:20:45.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.007+0000 7fb591ffb640 1 -- 172.21.15.55:0/2195126483 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 111) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fb594014980 con 0x7fb59c0d0630 2023-07-06T22:20:45.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.007+0000 7fb591ffb640 1 --2- 172.21.15.55:0/2195126483 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fb580066460 0x7fb580068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.007+0000 7fb591ffb640 1 -- 172.21.15.55:0/2195126483 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fb594084ea0 con 0x7fb59c0d0630 2023-07-06T22:20:45.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.007+0000 7fb5a1267640 1 -- 172.21.15.55:0/2195126483 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fb580066460 msgr2=0x7fb580068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3861190779 2023-07-06T22:20:45.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.007+0000 7fb5a1267640 1 --2- 172.21.15.55:0/2195126483 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fb580066460 0x7fb580068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:45.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.011+0000 7fb591ffb640 1 -- 172.21.15.55:0/2195126483 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb594051d70 con 0x7fb59c0d0630 2023-07-06T22:20:45.061 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:45.059+0000 7f9e8984a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T22:20:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.167+0000 7fb5a2269640 1 -- 172.21.15.55:0/2195126483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb59c06b1c0 con 0x7fb59c0d0630 2023-07-06T22:20:45.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.167+0000 7fb591ffb640 1 -- 172.21.15.55:0/2195126483 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v197) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb5940180a0 con 0x7fb59c0d0630 2023-07-06T22:20:45.170 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:20:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.171+0000 7fb5a2269640 1 -- 172.21.15.55:0/2195126483 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fb580066460 msgr2=0x7fb580068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.171+0000 7fb5a2269640 1 --2- 172.21.15.55:0/2195126483 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fb580066460 0x7fb580068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.171+0000 7fb5a2269640 1 -- 172.21.15.55:0/2195126483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb59c0d0630 msgr2=0x7fb59c159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.171+0000 7fb5a2269640 1 --2- 172.21.15.55:0/2195126483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb59c0d0630 0x7fb59c159710 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7fb59400efc0 tx=0x7fb59400c490 comp rx=0 tx=0).stop 2023-07-06T22:20:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.171+0000 7fb5a2269640 1 -- 172.21.15.55:0/2195126483 shutdown_connections 2023-07-06T22:20:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.171+0000 7fb5a2269640 1 --2- 172.21.15.55:0/2195126483 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fb580066460 0x7fb580068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.171+0000 7fb5a2269640 1 --2- 172.21.15.55:0/2195126483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb59c0d0630 0x7fb59c159710 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.171+0000 7fb5a2269640 1 --2- 172.21.15.55:0/2195126483 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb59c0ce200 0x7fb59c1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.171+0000 7fb5a2269640 1 --2- 172.21.15.55:0/2195126483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb59c0b1250 0x7fb59c152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.171+0000 7fb5a2269640 1 -- 172.21.15.55:0/2195126483 >> 172.21.15.55:0/2195126483 conn(0x7fb59c0b3b60 msgr2=0x7fb59c15e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:45.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.171+0000 7fb5a2269640 1 -- 172.21.15.55:0/2195126483 shutdown_connections 2023-07-06T22:20:45.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.171+0000 7fb5a2269640 1 -- 172.21.15.55:0/2195126483 wait complete. 2023-07-06T22:20:45.192 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:20:45.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f553660b640 1 Processor -- start 2023-07-06T22:20:45.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f553660b640 1 -- start start 2023-07-06T22:20:45.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f553660b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55300d1c40 0x7f55300b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f553660b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55300b4130 0x7f55300b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f553660b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55300b5070 con 0x7f55300b7b90 2023-07-06T22:20:45.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f553660b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55300d20c0 con 0x7f55300d1c40 2023-07-06T22:20:45.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f553660b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55300b45b0 con 0x7f55300b4130 2023-07-06T22:20:45.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f552f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55300d1c40 0x7f55300b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f552f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55300d1c40 0x7f55300b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33504/0 (socket says 172.21.15.55:33504) 2023-07-06T22:20:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f552f7fe640 1 -- 172.21.15.55:0/2669102718 learned_addr learned my addr 172.21.15.55:0/2669102718 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f5534ba8640 1 --2- 172.21.15.55:0/2669102718 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55300b4130 0x7f55300b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f552f7fe640 1 -- 172.21.15.55:0/2669102718 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55300b4130 msgr2=0x7f55300b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:45.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f552f7fe640 1 --2- 172.21.15.55:0/2669102718 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55300b4130 0x7f55300b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f552f7fe640 1 -- 172.21.15.55:0/2669102718 >> v1:172.21.15.138:6789/0 conn(0x7f55300b7b90 legacy=0x7f55300cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:45.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.339+0000 7f552f7fe640 1 -- 172.21.15.55:0/2669102718 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5530160020 con 0x7f55300d1c40 2023-07-06T22:20:45.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.343+0000 7f552f7fe640 1 --2- 172.21.15.55:0/2669102718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55300d1c40 0x7f55300b3bf0 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f5524009870 tx=0x7f552401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbdfa16cfe67cff server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:45.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.343+0000 7f552effd640 1 -- 172.21.15.55:0/2669102718 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240a7070 con 0x7f55300d1c40 2023-07-06T22:20:45.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.343+0000 7f552effd640 1 -- 172.21.15.55:0/2669102718 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55240ab430 con 0x7f55300d1c40 2023-07-06T22:20:45.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.343+0000 7f552effd640 1 -- 172.21.15.55:0/2669102718 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240ab7c0 con 0x7f55300d1c40 2023-07-06T22:20:45.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.343+0000 7f553660b640 1 -- 172.21.15.55:0/2669102718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55300d1c40 msgr2=0x7f55300b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:45.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.343+0000 7f553660b640 1 --2- 172.21.15.55:0/2669102718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55300d1c40 0x7f55300b3bf0 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f5524009870 tx=0x7f552401c540 comp rx=0 tx=0).stop 2023-07-06T22:20:45.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.343+0000 7f553660b640 1 -- 172.21.15.55:0/2669102718 shutdown_connections 2023-07-06T22:20:45.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.343+0000 7f553660b640 1 --2- 172.21.15.55:0/2669102718 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55300b4130 0x7f55300b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.343+0000 7f553660b640 1 --2- 172.21.15.55:0/2669102718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55300d1c40 0x7f55300b3bf0 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.343+0000 7f553660b640 1 -- 172.21.15.55:0/2669102718 >> 172.21.15.55:0/2669102718 conn(0x7f55300ceca0 msgr2=0x7f55300cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:45.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.343+0000 7f553660b640 1 -- 172.21.15.55:0/2669102718 shutdown_connections 2023-07-06T22:20:45.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.343+0000 7f553660b640 1 -- 172.21.15.55:0/2669102718 wait complete. 2023-07-06T22:20:45.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f553660b640 1 Processor -- start 2023-07-06T22:20:45.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f553660b640 1 -- start start 2023-07-06T22:20:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f553660b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55300b4130 0x7f55300c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f553660b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55300b7b90 0x7f5530156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f553660b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55300d1c40 0x7f553015b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f553660b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553015b3a0 con 0x7f55300b4130 2023-07-06T22:20:45.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f553660b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55301573e0 con 0x7f55300b7b90 2023-07-06T22:20:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f553660b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55301576c0 con 0x7f55300d1c40 2023-07-06T22:20:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f552ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55300b4130 0x7f55300c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f552f7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55300b7b90 0x7f5530156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f552f7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55300b7b90 0x7f5530156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:49006/0 (socket says 172.21.15.55:49006) 2023-07-06T22:20:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f552f7fe640 1 -- 172.21.15.55:0/1347662818 learned_addr learned my addr 172.21.15.55:0/1347662818 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:45.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f5534ba8640 1 --2- 172.21.15.55:0/1347662818 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55300d1c40 0x7f553015b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:45.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f552f7fe640 1 -- 172.21.15.55:0/1347662818 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55300d1c40 msgr2=0x7f553015b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:45.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f552f7fe640 1 --2- 172.21.15.55:0/1347662818 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55300d1c40 0x7f553015b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f552f7fe640 1 -- 172.21.15.55:0/1347662818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55300b4130 msgr2=0x7f55300c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:45.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f552f7fe640 1 --2- 172.21.15.55:0/1347662818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55300b4130 0x7f55300c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f552f7fe640 1 -- 172.21.15.55:0/1347662818 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55240094d0 con 0x7f55300b7b90 2023-07-06T22:20:45.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f552f7fe640 1 --2- 172.21.15.55:0/1347662818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55300b7b90 0x7f5530156a00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f55240ad040 tx=0x7f55240192e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:45.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f552cff9640 1 -- 172.21.15.55:0/1347662818 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240b4600 con 0x7f55300b7b90 2023-07-06T22:20:45.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f552cff9640 1 -- 172.21.15.55:0/1347662818 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55240b4780 con 0x7f55300b7b90 2023-07-06T22:20:45.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f552cff9640 1 -- 172.21.15.55:0/1347662818 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240b4b30 con 0x7f55300b7b90 2023-07-06T22:20:45.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.347+0000 7f553660b640 1 -- 172.21.15.55:0/1347662818 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55301579a0 con 0x7f55300b7b90 2023-07-06T22:20:45.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.351+0000 7f553660b640 1 -- 172.21.15.55:0/1347662818 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5530155c30 con 0x7f55300b7b90 2023-07-06T22:20:45.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.351+0000 7f553660b640 1 -- 172.21.15.55:0/1347662818 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5530155e20 con 0x7f55300b7b90 2023-07-06T22:20:45.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.351+0000 7f552cff9640 1 -- 172.21.15.55:0/1347662818 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 111) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f55240b4c90 con 0x7f55300b7b90 2023-07-06T22:20:45.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.351+0000 7f552cff9640 1 --2- 172.21.15.55:0/1347662818 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f551c066430 0x7f551c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.351+0000 7f552cff9640 1 -- 172.21.15.55:0/1347662818 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f552411eee0 con 0x7f55300b7b90 2023-07-06T22:20:45.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.351+0000 7f552ffff640 1 -- 172.21.15.55:0/1347662818 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f551c066430 msgr2=0x7f551c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3861190779 2023-07-06T22:20:45.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.351+0000 7f552ffff640 1 --2- 172.21.15.55:0/1347662818 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f551c066430 0x7f551c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:45.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.359+0000 7f552cff9640 1 -- 172.21.15.55:0/1347662818 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55240ebe50 con 0x7f55300b7b90 2023-07-06T22:20:45.493 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:45.491+0000 7f2ae1013180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:20:45.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.515+0000 7f553660b640 1 -- 172.21.15.55:0/1347662818 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f553015b510 con 0x7f55300b7b90 2023-07-06T22:20:45.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.515+0000 7f552cff9640 1 -- 172.21.15.55:0/1347662818 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v197) v1 ==== 92+0+10 (secure 0 0 0) 0x7f553015b510 con 0x7f55300b7b90 2023-07-06T22:20:45.518 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:20:45.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.519+0000 7f553660b640 1 -- 172.21.15.55:0/1347662818 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f551c066430 msgr2=0x7f551c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:45.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.519+0000 7f553660b640 1 --2- 172.21.15.55:0/1347662818 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f551c066430 0x7f551c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.519+0000 7f553660b640 1 -- 172.21.15.55:0/1347662818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55300b7b90 msgr2=0x7f5530156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:45.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.519+0000 7f553660b640 1 --2- 172.21.15.55:0/1347662818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55300b7b90 0x7f5530156a00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f55240ad040 tx=0x7f55240192e0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.519+0000 7f553660b640 1 -- 172.21.15.55:0/1347662818 shutdown_connections 2023-07-06T22:20:45.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.519+0000 7f553660b640 1 --2- 172.21.15.55:0/1347662818 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f551c066430 0x7f551c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.519+0000 7f553660b640 1 --2- 172.21.15.55:0/1347662818 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f55300d1c40 0x7f553015b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.519+0000 7f553660b640 1 --2- 172.21.15.55:0/1347662818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55300b7b90 0x7f5530156a00 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.519+0000 7f553660b640 1 --2- 172.21.15.55:0/1347662818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55300b4130 0x7f55300c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.519+0000 7f553660b640 1 -- 172.21.15.55:0/1347662818 >> 172.21.15.55:0/1347662818 conn(0x7f55300ceca0 msgr2=0x7f55300ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:45.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.519+0000 7f553660b640 1 -- 172.21.15.55:0/1347662818 shutdown_connections 2023-07-06T22:20:45.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.519+0000 7f553660b640 1 -- 172.21.15.55:0/1347662818 wait complete. 2023-07-06T22:20:45.540 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T22:20:45.552 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:45.551+0000 7f2ae1013180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:20:45.583 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:45.579+0000 7f9e8984a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T22:20:45.608 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:45.607+0000 7f2ae1013180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:20:45.646 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:45.643+0000 7f9e8984a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T22:20:45.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff41a9c5640 1 Processor -- start 2023-07-06T22:20:45.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff41a9c5640 1 -- start start 2023-07-06T22:20:45.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff41a9c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4140b3870 0x7ff4140b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff41a9c5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff4140d03c0 0x7ff4140d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff41a9c5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4140b2b80 con 0x7ff41415b850 2023-07-06T22:20:45.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff41a9c5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4140cff30 con 0x7ff4140d03c0 2023-07-06T22:20:45.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff41a9c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140b41e0 con 0x7ff4140b3870 2023-07-06T22:20:45.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff418f62640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff4140d03c0 0x7ff4140d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff4137fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4140b3870 0x7ff4140b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff4137fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4140b3870 0x7ff4140b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:60352/0 (socket says 172.21.15.55:60352) 2023-07-06T22:20:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff4137fe640 1 -- 172.21.15.55:0/361549444 learned_addr learned my addr 172.21.15.55:0/361549444 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff418f62640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff4140d03c0 0x7ff4140d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.55:49012/0 (socket says 172.21.15.55:49012) 2023-07-06T22:20:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff418f62640 1 -- 172.21.15.55:0/361549444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4140b3870 msgr2=0x7ff4140b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff418f62640 1 --2- 172.21.15.55:0/361549444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4140b3870 0x7ff4140b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff418f62640 1 -- 172.21.15.55:0/361549444 >> v1:172.21.15.138:6789/0 conn(0x7ff41415b850 legacy=0x7ff4140cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:45.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff418f62640 1 -- 172.21.15.55:0/361549444 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4140b22e0 con 0x7ff4140d03c0 2023-07-06T22:20:45.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.687+0000 7ff4137fe640 1 --2- 172.21.15.55:0/361549444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4140b3870 0x7ff4140b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:45.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.691+0000 7ff418f62640 1 --2- 172.21.15.55:0/361549444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4140d03c0 0x7ff4140d0820 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff40c009d90 tx=0x7ff40c01c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cd3a7f0a422936 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:45.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.691+0000 7ff412ffd640 1 -- 172.21.15.55:0/361549444 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0a58c0 con 0x7ff4140d03c0 2023-07-06T22:20:45.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.691+0000 7ff412ffd640 1 -- 172.21.15.55:0/361549444 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c0a5a20 con 0x7ff4140d03c0 2023-07-06T22:20:45.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.691+0000 7ff412ffd640 1 -- 172.21.15.55:0/361549444 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0a5db0 con 0x7ff4140d03c0 2023-07-06T22:20:45.694 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:45.691+0000 7f2ae1013180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:20:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.691+0000 7ff41a9c5640 1 -- 172.21.15.55:0/361549444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4140d03c0 msgr2=0x7ff4140d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.691+0000 7ff41a9c5640 1 --2- 172.21.15.55:0/361549444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4140d03c0 0x7ff4140d0820 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff40c009d90 tx=0x7ff40c01c800 comp rx=0 tx=0).stop 2023-07-06T22:20:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.691+0000 7ff41a9c5640 1 -- 172.21.15.55:0/361549444 shutdown_connections 2023-07-06T22:20:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.691+0000 7ff41a9c5640 1 --2- 172.21.15.55:0/361549444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4140d03c0 0x7ff4140d0820 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.691+0000 7ff41a9c5640 1 --2- 172.21.15.55:0/361549444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4140b3870 0x7ff4140b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.691+0000 7ff41a9c5640 1 -- 172.21.15.55:0/361549444 >> 172.21.15.55:0/361549444 conn(0x7ff4140cec20 msgr2=0x7ff4140cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:45.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.691+0000 7ff41a9c5640 1 -- 172.21.15.55:0/361549444 shutdown_connections 2023-07-06T22:20:45.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.691+0000 7ff41a9c5640 1 -- 172.21.15.55:0/361549444 wait complete. 2023-07-06T22:20:45.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff41a9c5640 1 Processor -- start 2023-07-06T22:20:45.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff41a9c5640 1 -- start start 2023-07-06T22:20:45.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff41a9c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4140b3870 0x7ff4140c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff41a9c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4140d03c0 0x7ff4140c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff41a9c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff41415b850 0x7ff41415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff41a9c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff414150e00 con 0x7ff4140b3870 2023-07-06T22:20:45.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff41a9c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140c9020 con 0x7ff4140d03c0 2023-07-06T22:20:45.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff41a9c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff414150180 con 0x7ff41415b850 2023-07-06T22:20:45.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff413fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4140b3870 0x7ff4140c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:45.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff413fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4140b3870 0x7ff4140c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33514/0 (socket says 172.21.15.55:33514) 2023-07-06T22:20:45.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff413fff640 1 -- 172.21.15.55:0/863828108 learned_addr learned my addr 172.21.15.55:0/863828108 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:45.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff4137fe640 1 --2- 172.21.15.55:0/863828108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4140d03c0 0x7ff4140c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:45.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff418f62640 1 --2- 172.21.15.55:0/863828108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff41415b850 0x7ff41415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:45.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff413fff640 1 -- 172.21.15.55:0/863828108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff41415b850 msgr2=0x7ff41415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:45.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff413fff640 1 --2- 172.21.15.55:0/863828108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff41415b850 0x7ff41415bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff413fff640 1 -- 172.21.15.55:0/863828108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4140d03c0 msgr2=0x7ff4140c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:45.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff413fff640 1 --2- 172.21.15.55:0/863828108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4140d03c0 0x7ff4140c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff413fff640 1 -- 172.21.15.55:0/863828108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080094d0 con 0x7ff4140b3870 2023-07-06T22:20:45.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff4137fe640 1 --2- 172.21.15.55:0/863828108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4140d03c0 0x7ff4140c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:45.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff413fff640 1 --2- 172.21.15.55:0/863828108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4140b3870 0x7ff4140c8ae0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7ff40400c500 tx=0x7ff40400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:45.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff410ff9640 1 -- 172.21.15.55:0/863828108 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404005220 con 0x7ff4140b3870 2023-07-06T22:20:45.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff410ff9640 1 -- 172.21.15.55:0/863828108 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff404005380 con 0x7ff4140b3870 2023-07-06T22:20:45.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff410ff9640 1 -- 172.21.15.55:0/863828108 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404007270 con 0x7ff4140b3870 2023-07-06T22:20:45.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff41a9c5640 1 -- 172.21.15.55:0/863828108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c009a70 con 0x7ff4140b3870 2023-07-06T22:20:45.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.695+0000 7ff41a9c5640 1 -- 172.21.15.55:0/863828108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff414150740 con 0x7ff4140b3870 2023-07-06T22:20:45.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.699+0000 7ff41a9c5640 1 -- 172.21.15.55:0/863828108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff414150f40 con 0x7ff4140b3870 2023-07-06T22:20:45.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.699+0000 7ff410ff9640 1 -- 172.21.15.55:0/863828108 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 111) v1 ==== 85817+0+0 (secure 0 0 0) 0x7ff4040073d0 con 0x7ff4140b3870 2023-07-06T22:20:45.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.699+0000 7ff410ff9640 1 --2- 172.21.15.55:0/863828108 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7ff400066430 0x7ff4000688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:45.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.699+0000 7ff410ff9640 1 -- 172.21.15.55:0/863828108 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6754+0+0 (secure 0 0 0) 0x7ff404083840 con 0x7ff4140b3870 2023-07-06T22:20:45.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.699+0000 7ff4137fe640 1 -- 172.21.15.55:0/863828108 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7ff400066430 msgr2=0x7ff4000688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3861190779 2023-07-06T22:20:45.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.699+0000 7ff4137fe640 1 --2- 172.21.15.55:0/863828108 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7ff400066430 0x7ff4000688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:45.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.703+0000 7ff410ff9640 1 -- 172.21.15.55:0/863828108 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4040507a0 con 0x7ff4140b3870 2023-07-06T22:20:45.707 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:45.707+0000 7f9e8984a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T22:20:45.752 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:45.751+0000 7f2ae1013180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:20:45.799 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:45.795+0000 7f9e8984a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T22:20:45.835 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:45.835+0000 7f2ae1013180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:20:45.858 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:45.855+0000 7f9e8984a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T22:20:45.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.859+0000 7ff41a9c5640 1 -- 172.21.15.55:0/863828108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff414066d60 con 0x7ff4140b3870 2023-07-06T22:20:45.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.859+0000 7ff410ff9640 1 -- 172.21.15.55:0/863828108 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v197) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff404053dc0 con 0x7ff4140b3870 2023-07-06T22:20:45.863 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T22:20:45.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.863+0000 7ff41a9c5640 1 -- 172.21.15.55:0/863828108 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7ff400066430 msgr2=0x7ff4000688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:45.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.863+0000 7ff41a9c5640 1 --2- 172.21.15.55:0/863828108 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7ff400066430 0x7ff4000688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.863+0000 7ff41a9c5640 1 -- 172.21.15.55:0/863828108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4140b3870 msgr2=0x7ff4140c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:45.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.863+0000 7ff41a9c5640 1 --2- 172.21.15.55:0/863828108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4140b3870 0x7ff4140c8ae0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7ff40400c500 tx=0x7ff40400c9c0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.863+0000 7ff41a9c5640 1 -- 172.21.15.55:0/863828108 shutdown_connections 2023-07-06T22:20:45.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.863+0000 7ff41a9c5640 1 --2- 172.21.15.55:0/863828108 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7ff400066430 0x7ff4000688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.863+0000 7ff41a9c5640 1 --2- 172.21.15.55:0/863828108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff41415b850 0x7ff41415bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.863+0000 7ff41a9c5640 1 --2- 172.21.15.55:0/863828108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4140d03c0 0x7ff4140c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.863+0000 7ff41a9c5640 1 --2- 172.21.15.55:0/863828108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4140b3870 0x7ff4140c8ae0 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:45.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.863+0000 7ff41a9c5640 1 -- 172.21.15.55:0/863828108 >> 172.21.15.55:0/863828108 conn(0x7ff4140cec20 msgr2=0x7ff41415aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:45.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.863+0000 7ff41a9c5640 1 -- 172.21.15.55:0/863828108 shutdown_connections 2023-07-06T22:20:45.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:45.863+0000 7ff41a9c5640 1 -- 172.21.15.55:0/863828108 wait complete. 2023-07-06T22:20:45.885 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T22:20:45.891 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:45.891+0000 7f2ae1013180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:20:45.949 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:45.947+0000 7f9e8984a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T22:20:46.009 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:46.007+0000 7f9e8984a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T22:20:46.032 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:46.031+0000 7f2ae1013180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:20:46.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80eed8640 1 Processor -- start 2023-07-06T22:20:46.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80eed8640 1 -- start start 2023-07-06T22:20:46.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80eed8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8080b7b90 0x7fc8080d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80eed8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8080b4300 0x7fc8080b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80eed8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8080b5070 con 0x7fc8080cc870 2023-07-06T22:20:46.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80eed8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc808160020 con 0x7fc8080b4300 2023-07-06T22:20:46.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80eed8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8081604b0 con 0x7fc8080b7b90 2023-07-06T22:20:46.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80d475640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8080b4300 0x7fc8080b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:46.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80d475640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8080b4300 0x7fc8080b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33528/0 (socket says 172.21.15.55:33528) 2023-07-06T22:20:46.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80d475640 1 -- 172.21.15.55:0/1429732060 learned_addr learned my addr 172.21.15.55:0/1429732060 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:46.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80cc74640 1 --2- 172.21.15.55:0/1429732060 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8080b7b90 0x7fc8080d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:46.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80d475640 1 -- 172.21.15.55:0/1429732060 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8080b7b90 msgr2=0x7fc8080d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:46.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80d475640 1 --2- 172.21.15.55:0/1429732060 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8080b7b90 0x7fc8080d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80d475640 1 -- 172.21.15.55:0/1429732060 >> v1:172.21.15.138:6789/0 conn(0x7fc8080cc870 legacy=0x7fc8080b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.071+0000 7fc80d475640 1 -- 172.21.15.55:0/1429732060 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8080cd030 con 0x7fc8080b4300 2023-07-06T22:20:46.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.075+0000 7fc80d475640 1 --2- 172.21.15.55:0/1429732060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8080b4300 0x7fc8080b1af0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fc800009e50 tx=0x7fc80001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3feb974008807f03 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:46.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.075+0000 7fc8077fe640 1 -- 172.21.15.55:0/1429732060 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8000a58a0 con 0x7fc8080b4300 2023-07-06T22:20:46.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.075+0000 7fc8077fe640 1 -- 172.21.15.55:0/1429732060 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8000a5a00 con 0x7fc8080b4300 2023-07-06T22:20:46.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.075+0000 7fc8077fe640 1 -- 172.21.15.55:0/1429732060 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8000a5d90 con 0x7fc8080b4300 2023-07-06T22:20:46.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.075+0000 7fc80eed8640 1 -- 172.21.15.55:0/1429732060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8080b4300 msgr2=0x7fc8080b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.075+0000 7fc80eed8640 1 --2- 172.21.15.55:0/1429732060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8080b4300 0x7fc8080b1af0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fc800009e50 tx=0x7fc80001c9e0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.075+0000 7fc80eed8640 1 -- 172.21.15.55:0/1429732060 shutdown_connections 2023-07-06T22:20:46.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.075+0000 7fc80eed8640 1 --2- 172.21.15.55:0/1429732060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8080b4300 0x7fc8080b1af0 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.075+0000 7fc80eed8640 1 --2- 172.21.15.55:0/1429732060 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8080b7b90 0x7fc8080d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.075+0000 7fc80eed8640 1 -- 172.21.15.55:0/1429732060 >> 172.21.15.55:0/1429732060 conn(0x7fc8080ceca0 msgr2=0x7fc8080cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:46.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.075+0000 7fc80eed8640 1 -- 172.21.15.55:0/1429732060 shutdown_connections 2023-07-06T22:20:46.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.075+0000 7fc80eed8640 1 -- 172.21.15.55:0/1429732060 wait complete. 2023-07-06T22:20:46.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80eed8640 1 Processor -- start 2023-07-06T22:20:46.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80eed8640 1 -- start start 2023-07-06T22:20:46.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80eed8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8080b4300 0x7fc808153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80eed8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8080b7b90 0x7fc8080c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80eed8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8080cc870 0x7fc808156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80eed8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80815d8a0 con 0x7fc8080b7b90 2023-07-06T22:20:46.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80eed8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80815db80 con 0x7fc8080cc870 2023-07-06T22:20:46.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80eed8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80815de60 con 0x7fc8080b4300 2023-07-06T22:20:46.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc807fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8080b7b90 0x7fc8080c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:46.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80cc74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8080b4300 0x7fc808153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:46.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80d475640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8080cc870 0x7fc808156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:46.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc807fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8080b7b90 0x7fc8080c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33538/0 (socket says 172.21.15.55:33538) 2023-07-06T22:20:46.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc807fff640 1 -- 172.21.15.55:0/4205111045 learned_addr learned my addr 172.21.15.55:0/4205111045 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:46.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80cc74640 1 -- 172.21.15.55:0/4205111045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8080cc870 msgr2=0x7fc808156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80cc74640 1 --2- 172.21.15.55:0/4205111045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8080cc870 0x7fc808156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80cc74640 1 -- 172.21.15.55:0/4205111045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8080b7b90 msgr2=0x7fc8080c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80cc74640 1 --2- 172.21.15.55:0/4205111045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8080b7b90 0x7fc8080c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80cc74640 1 -- 172.21.15.55:0/4205111045 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc800009b30 con 0x7fc8080b4300 2023-07-06T22:20:46.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc80cc74640 1 --2- 172.21.15.55:0/4205111045 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8080b4300 0x7fc808153040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00e870 tx=0x7fc7fc00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:46.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc8057fa640 1 -- 172.21.15.55:0/4205111045 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc0095d0 con 0x7fc8080b4300 2023-07-06T22:20:46.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc8057fa640 1 -- 172.21.15.55:0/4205111045 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7fc00c940 con 0x7fc8080b4300 2023-07-06T22:20:46.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.079+0000 7fc8057fa640 1 -- 172.21.15.55:0/4205111045 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00ccb0 con 0x7fc8080b4300 2023-07-06T22:20:46.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.083+0000 7fc80eed8640 1 -- 172.21.15.55:0/4205111045 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80815e140 con 0x7fc8080b4300 2023-07-06T22:20:46.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.083+0000 7fc80eed8640 1 -- 172.21.15.55:0/4205111045 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc808153580 con 0x7fc8080b4300 2023-07-06T22:20:46.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.083+0000 7fc80eed8640 1 -- 172.21.15.55:0/4205111045 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc808066d60 con 0x7fc8080b4300 2023-07-06T22:20:46.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.083+0000 7fc8057fa640 1 -- 172.21.15.55:0/4205111045 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 111) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fc7fc013470 con 0x7fc8080b4300 2023-07-06T22:20:46.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.083+0000 7fc8057fa640 1 --2- 172.21.15.55:0/4205111045 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc7ec066430 0x7fc7ec0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.083+0000 7fc807fff640 1 -- 172.21.15.55:0/4205111045 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc7ec066430 msgr2=0x7fc7ec0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3861190779 2023-07-06T22:20:46.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.083+0000 7fc8057fa640 1 -- 172.21.15.55:0/4205111045 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fc7fc084320 con 0x7fc8080b4300 2023-07-06T22:20:46.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.083+0000 7fc807fff640 1 --2- 172.21.15.55:0/4205111045 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc7ec066430 0x7fc7ec0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:46.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.087+0000 7fc8057fa640 1 -- 172.21.15.55:0/4205111045 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc7fc0513b0 con 0x7fc8080b4300 2023-07-06T22:20:46.092 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:46.091+0000 7f2ae1013180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:20:46.163 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:46.159+0000 7f9e8984a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T22:20:46.225 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:46.223+0000 7f9e8984a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T22:20:46.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.247+0000 7fc80eed8640 1 -- 172.21.15.55:0/4205111045 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8080b48e0 con 0x7fc8080b4300 2023-07-06T22:20:46.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.247+0000 7fc8057fa640 1 -- 172.21.15.55:0/4205111045 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v197) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc7fc0549d0 con 0x7fc8080b4300 2023-07-06T22:20:46.249 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T22:20:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.251+0000 7fc80eed8640 1 -- 172.21.15.55:0/4205111045 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc7ec066430 msgr2=0x7fc7ec0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.251+0000 7fc80eed8640 1 --2- 172.21.15.55:0/4205111045 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc7ec066430 0x7fc7ec0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.251+0000 7fc80eed8640 1 -- 172.21.15.55:0/4205111045 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8080b4300 msgr2=0x7fc808153040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.251+0000 7fc80eed8640 1 --2- 172.21.15.55:0/4205111045 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8080b4300 0x7fc808153040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00e870 tx=0x7fc7fc00ed30 comp rx=0 tx=0).stop 2023-07-06T22:20:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.251+0000 7fc80eed8640 1 -- 172.21.15.55:0/4205111045 shutdown_connections 2023-07-06T22:20:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.251+0000 7fc80eed8640 1 --2- 172.21.15.55:0/4205111045 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fc7ec066430 0x7fc7ec0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.251+0000 7fc80eed8640 1 --2- 172.21.15.55:0/4205111045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8080cc870 0x7fc808156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.251+0000 7fc80eed8640 1 --2- 172.21.15.55:0/4205111045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8080b7b90 0x7fc8080c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.251+0000 7fc80eed8640 1 --2- 172.21.15.55:0/4205111045 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8080b4300 0x7fc808153040 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.251+0000 7fc80eed8640 1 -- 172.21.15.55:0/4205111045 >> 172.21.15.55:0/4205111045 conn(0x7fc8080ceca0 msgr2=0x7fc8080d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.251+0000 7fc80eed8640 1 -- 172.21.15.55:0/4205111045 shutdown_connections 2023-07-06T22:20:46.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.251+0000 7fc80eed8640 1 -- 172.21.15.55:0/4205111045 wait complete. 2023-07-06T22:20:46.280 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T22:20:46.333 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:20:46.333 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:20:46.333 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:20:46.341 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:46.339+0000 7f2ae1013180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:20:46.473 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:46.471+0000 7f2ae1013180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:20:46.494 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-06T22:20:46.494 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-06T22:20:46.494 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-07-06T22:20:46.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.499+0000 7f421666d640 1 Processor -- start 2023-07-06T22:20:46.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.499+0000 7f421666d640 1 -- start start 2023-07-06T22:20:46.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.499+0000 7f421666d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f421015b850 0x7f42100cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.499+0000 7f421666d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42100ccd30 0x7f42100b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.499+0000 7f421666d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42100b4210 con 0x7f42100b3db0 2023-07-06T22:20:46.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.499+0000 7f421666d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42100b2b80 con 0x7f421015b850 2023-07-06T22:20:46.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.499+0000 7f421666d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42100cff30 con 0x7f42100ccd30 2023-07-06T22:20:46.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.499+0000 7f4214c0a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f42100b3db0 0x7f421015f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56922/0 (socket says 172.21.15.55:56922) 2023-07-06T22:20:46.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.499+0000 7f4214c0a640 1 -- 172.21.15.55:0/1598825907 learned_addr learned my addr 172.21.15.55:0/1598825907 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:46.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.499+0000 7f420f7fe640 1 --2- 172.21.15.55:0/1598825907 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42100ccd30 0x7f42100b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:46.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.499+0000 7f420ffff640 1 --2- 172.21.15.55:0/1598825907 >> v2:172.21.15.138:3300/0 conn(0x7f421015b850 0x7f42100cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:46.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.499+0000 7f420effd640 1 -- 172.21.15.55:0/1598825907 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882033428 0 0) 0x7f42100b4210 con 0x7f42100b3db0 2023-07-06T22:20:46.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.499+0000 7f420effd640 1 -- 172.21.15.55:0/1598825907 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41f8003530 con 0x7f42100b3db0 2023-07-06T22:20:46.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.503+0000 7f420f7fe640 1 -- 172.21.15.55:0/1598825907 >> v2:172.21.15.138:3300/0 conn(0x7f421015b850 msgr2=0x7f42100cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:46.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.503+0000 7f420f7fe640 1 --2- 172.21.15.55:0/1598825907 >> v2:172.21.15.138:3300/0 conn(0x7f421015b850 0x7f42100cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.503+0000 7f420f7fe640 1 -- 172.21.15.55:0/1598825907 >> v1:172.21.15.55:6789/0 conn(0x7f42100b3db0 legacy=0x7f421015f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.503+0000 7f420f7fe640 1 -- 172.21.15.55:0/1598825907 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42100b22e0 con 0x7f42100ccd30 2023-07-06T22:20:46.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.503+0000 7f420ffff640 1 --2- 172.21.15.55:0/1598825907 >> v2:172.21.15.138:3300/0 conn(0x7f421015b850 0x7f42100cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:46.506 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:46.503+0000 7f9e8984a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T22:20:46.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.503+0000 7f420f7fe640 1 --2- 172.21.15.55:0/1598825907 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42100ccd30 0x7f42100b3870 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f42040097c0 tx=0x7f420401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48699771f7066dd4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:46.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.503+0000 7f420effd640 1 -- 172.21.15.55:0/1598825907 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42040ab600 con 0x7f42100ccd30 2023-07-06T22:20:46.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.503+0000 7f420effd640 1 -- 172.21.15.55:0/1598825907 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42040a7050 con 0x7f42100ccd30 2023-07-06T22:20:46.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.503+0000 7f420effd640 1 -- 172.21.15.55:0/1598825907 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42040ab980 con 0x7f42100ccd30 2023-07-06T22:20:46.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.503+0000 7f421666d640 1 -- 172.21.15.55:0/1598825907 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42100ccd30 msgr2=0x7f42100b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.503+0000 7f421666d640 1 --2- 172.21.15.55:0/1598825907 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42100ccd30 0x7f42100b3870 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f42040097c0 tx=0x7f420401c330 comp rx=0 tx=0).stop 2023-07-06T22:20:46.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f421666d640 1 -- 172.21.15.55:0/1598825907 shutdown_connections 2023-07-06T22:20:46.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f421666d640 1 --2- 172.21.15.55:0/1598825907 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42100ccd30 0x7f42100b3870 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f421666d640 1 --2- 172.21.15.55:0/1598825907 >> v2:172.21.15.138:3300/0 conn(0x7f421015b850 0x7f42100cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f421666d640 1 -- 172.21.15.55:0/1598825907 >> 172.21.15.55:0/1598825907 conn(0x7f42100cec20 msgr2=0x7f42100cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:46.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f421666d640 1 -- 172.21.15.55:0/1598825907 shutdown_connections 2023-07-06T22:20:46.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f421666d640 1 -- 172.21.15.55:0/1598825907 wait complete. 2023-07-06T22:20:46.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f421666d640 1 Processor -- start 2023-07-06T22:20:46.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f421666d640 1 -- start start 2023-07-06T22:20:46.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f421666d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42100b3db0 0x7f4210153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f421666d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42100ccd30 0x7f42100caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f421666d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f421015b850 0x7f42101597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f421666d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42100ca650 con 0x7f42100b3db0 2023-07-06T22:20:46.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f421666d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42100c9d20 con 0x7f421015b850 2023-07-06T22:20:46.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f421666d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42100ca000 con 0x7f42100ccd30 2023-07-06T22:20:46.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f420ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42100b3db0 0x7f4210153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:46.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f420ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42100b3db0 0x7f4210153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33542/0 (socket says 172.21.15.55:33542) 2023-07-06T22:20:46.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f420ffff640 1 -- 172.21.15.55:0/2679465636 learned_addr learned my addr 172.21.15.55:0/2679465636 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:46.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f420f7fe640 1 --2- 172.21.15.55:0/2679465636 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42100ccd30 0x7f42100caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:46.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f4214c0a640 1 --2- 172.21.15.55:0/2679465636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f421015b850 0x7f42101597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:46.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f420ffff640 1 -- 172.21.15.55:0/2679465636 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42100ccd30 msgr2=0x7f42100caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f420ffff640 1 --2- 172.21.15.55:0/2679465636 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42100ccd30 0x7f42100caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f420ffff640 1 -- 172.21.15.55:0/2679465636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f421015b850 msgr2=0x7f42101597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f420ffff640 1 --2- 172.21.15.55:0/2679465636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f421015b850 0x7f42101597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.507+0000 7f420ffff640 1 -- 172.21.15.55:0/2679465636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4200009420 con 0x7f42100b3db0 2023-07-06T22:20:46.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.511+0000 7f420ffff640 1 --2- 172.21.15.55:0/2679465636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42100b3db0 0x7f4210153460 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f420000e980 tx=0x7f420000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:46.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.511+0000 7f420cff9640 1 -- 172.21.15.55:0/2679465636 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420000ca00 con 0x7f42100b3db0 2023-07-06T22:20:46.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.511+0000 7f420cff9640 1 -- 172.21.15.55:0/2679465636 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420000cb60 con 0x7f42100b3db0 2023-07-06T22:20:46.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.511+0000 7f420cff9640 1 -- 172.21.15.55:0/2679465636 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200013470 con 0x7f42100b3db0 2023-07-06T22:20:46.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.511+0000 7f421666d640 1 -- 172.21.15.55:0/2679465636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4204009420 con 0x7f42100b3db0 2023-07-06T22:20:46.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.511+0000 7f421666d640 1 -- 172.21.15.55:0/2679465636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421015bda0 con 0x7f42100b3db0 2023-07-06T22:20:46.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.511+0000 7f421666d640 1 -- 172.21.15.55:0/2679465636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4210066d60 con 0x7f42100b3db0 2023-07-06T22:20:46.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.511+0000 7f420cff9640 1 -- 172.21.15.55:0/2679465636 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 111) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f42000135d0 con 0x7f42100b3db0 2023-07-06T22:20:46.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.511+0000 7f420cff9640 1 --2- 172.21.15.55:0/2679465636 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f41fc066430 0x7f41fc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.511+0000 7f420cff9640 1 -- 172.21.15.55:0/2679465636 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f4200084870 con 0x7f42100b3db0 2023-07-06T22:20:46.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.511+0000 7f420f7fe640 1 -- 172.21.15.55:0/2679465636 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f41fc066430 msgr2=0x7f41fc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3861190779 2023-07-06T22:20:46.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.511+0000 7f420f7fe640 1 --2- 172.21.15.55:0/2679465636 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f41fc066430 0x7f41fc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:46.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.515+0000 7f420cff9640 1 -- 172.21.15.55:0/2679465636 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4200051880 con 0x7f42100b3db0 2023-07-06T22:20:46.598 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:46.595+0000 7f2ae1013180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:20:46.646 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:46.643+0000 7f9e8984a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:20:46.669 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:46.667+0000 7f2ae1013180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:20:46.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.683+0000 7f421666d640 1 -- 172.21.15.55:0/2679465636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f42100b3420 con 0x7f42100b3db0 2023-07-06T22:20:46.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.683+0000 7f420cff9640 1 -- 172.21.15.55:0/2679465636 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v197) v1 ==== 80+0+466 (secure 0 0 0) 0x7f42000211f0 con 0x7f42100b3db0 2023-07-06T22:20:46.687 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3797237235 2023-07-07T22:20:41.235643+0000 2023-07-06T22:20:46.687 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/558674907 2023-07-07T22:20:41.235643+0000 2023-07-06T22:20:46.688 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/538997467 2023-07-07T22:20:41.235643+0000 2023-07-06T22:20:46.688 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/538997467 2023-07-07T22:20:41.235643+0000 2023-07-06T22:20:46.688 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2063199878 2023-07-07T22:20:41.235643+0000 2023-07-06T22:20:46.688 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2431773305 2023-07-07T22:20:41.235643+0000 2023-07-06T22:20:46.688 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/237391926 2023-07-07T22:20:41.235643+0000 2023-07-06T22:20:46.688 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3850725654 2023-07-07T22:20:41.235643+0000 2023-07-06T22:20:46.689 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-07-06T22:20:46.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.687+0000 7f421666d640 1 -- 172.21.15.55:0/2679465636 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f41fc066430 msgr2=0x7f41fc0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:46.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.687+0000 7f421666d640 1 --2- 172.21.15.55:0/2679465636 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f41fc066430 0x7f41fc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.687+0000 7f421666d640 1 -- 172.21.15.55:0/2679465636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42100b3db0 msgr2=0x7f4210153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.687+0000 7f421666d640 1 --2- 172.21.15.55:0/2679465636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42100b3db0 0x7f4210153460 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f420000e980 tx=0x7f420000ee40 comp rx=0 tx=0).stop 2023-07-06T22:20:46.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.687+0000 7f421666d640 1 -- 172.21.15.55:0/2679465636 shutdown_connections 2023-07-06T22:20:46.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.687+0000 7f421666d640 1 --2- 172.21.15.55:0/2679465636 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f41fc066430 0x7f41fc0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.687+0000 7f421666d640 1 --2- 172.21.15.55:0/2679465636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f421015b850 0x7f42101597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.687+0000 7f421666d640 1 --2- 172.21.15.55:0/2679465636 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42100ccd30 0x7f42100caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.687+0000 7f421666d640 1 --2- 172.21.15.55:0/2679465636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42100b3db0 0x7f4210153460 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.687+0000 7f421666d640 1 -- 172.21.15.55:0/2679465636 >> 172.21.15.55:0/2679465636 conn(0x7f42100cec20 msgr2=0x7f421006a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:46.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.687+0000 7f421666d640 1 -- 172.21.15.55:0/2679465636 shutdown_connections 2023-07-06T22:20:46.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.687+0000 7f421666d640 1 -- 172.21.15.55:0/2679465636 wait complete. 2023-07-06T22:20:46.709 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T22:20:46.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:46.709 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-06T22:20:46.760 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T22:20:46.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:46.761 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T22:20:46.771 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:20:46.771 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:46.780 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:20:46.781 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:20:46.781 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:46.786 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:46.783+0000 7f9e8984a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T22:20:46.794 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:20:46.794 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:20:46.795 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:46.806 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:46.803+0000 7f2ae1013180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:20:46.814 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:20:46.815 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:20:46.860 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:46.859+0000 7f9e8984a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T22:20:46.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.975+0000 7f35476d8640 1 Processor -- start 2023-07-06T22:20:46.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.975+0000 7f35476d8640 1 -- start start 2023-07-06T22:20:46.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.979+0000 7f35476d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35400ce610 0x7f35400b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.979+0000 7f35476d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35400b2290 con 0x7f35400b7cd0 2023-07-06T22:20:46.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.979+0000 7f35476d8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35400cd1c0 con 0x7f35400b1e10 2023-07-06T22:20:46.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.979+0000 7f35476d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35400d2310 con 0x7f35400ce610 2023-07-06T22:20:46.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.979+0000 7f3545474640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f35400b7cd0 0x7f35400ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56930/0 (socket says 172.21.15.55:56930) 2023-07-06T22:20:46.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.979+0000 7f3545474640 1 -- 172.21.15.55:0/3523252425 learned_addr learned my addr 172.21.15.55:0/3523252425 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:46.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.979+0000 7f3544c73640 1 --2- 172.21.15.55:0/3523252425 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35400ce610 0x7f35400b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:46.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.979+0000 7f3537fff640 1 -- 172.21.15.55:0/3523252425 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601875638 0 0) 0x7f35400b2290 con 0x7f35400b7cd0 2023-07-06T22:20:46.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.979+0000 7f3537fff640 1 -- 172.21.15.55:0/3523252425 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f352c003530 con 0x7f35400b7cd0 2023-07-06T22:20:46.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.979+0000 7f3537fff640 1 -- 172.21.15.55:0/3523252425 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028002750 0 0) 0x7f35400cd1c0 con 0x7f35400b1e10 2023-07-06T22:20:46.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.979+0000 7f3537fff640 1 -- 172.21.15.55:0/3523252425 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35400b2290 con 0x7f35400b1e10 2023-07-06T22:20:46.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.979+0000 7f3544c73640 1 -- 172.21.15.55:0/3523252425 >> v1:172.21.15.138:6789/0 conn(0x7f35400b1e10 legacy=0x7f354015f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.979+0000 7f3544c73640 1 -- 172.21.15.55:0/3523252425 >> v1:172.21.15.55:6789/0 conn(0x7f35400b7cd0 legacy=0x7f35400ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.979+0000 7f3544c73640 1 -- 172.21.15.55:0/3523252425 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35400cecf0 con 0x7f35400ce610 2023-07-06T22:20:46.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.983+0000 7f3544c73640 1 --2- 172.21.15.55:0/3523252425 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35400ce610 0x7f35400b18d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f35300097f0 tx=0x7f353001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c1bbe2ef257b721 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:46.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.983+0000 7f3537fff640 1 -- 172.21.15.55:0/3523252425 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35300ab600 con 0x7f35400ce610 2023-07-06T22:20:46.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.983+0000 7f3537fff640 1 -- 172.21.15.55:0/3523252425 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35300a7050 con 0x7f35400ce610 2023-07-06T22:20:46.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.983+0000 7f3537fff640 1 -- 172.21.15.55:0/3523252425 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35300ab980 con 0x7f35400ce610 2023-07-06T22:20:46.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.983+0000 7f35476d8640 1 -- 172.21.15.55:0/3523252425 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35400ce610 msgr2=0x7f35400b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.983+0000 7f35476d8640 1 --2- 172.21.15.55:0/3523252425 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35400ce610 0x7f35400b18d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f35300097f0 tx=0x7f353001c430 comp rx=0 tx=0).stop 2023-07-06T22:20:46.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.983+0000 7f35476d8640 1 -- 172.21.15.55:0/3523252425 shutdown_connections 2023-07-06T22:20:46.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.983+0000 7f35476d8640 1 --2- 172.21.15.55:0/3523252425 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35400ce610 0x7f35400b18d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.983+0000 7f35476d8640 1 -- 172.21.15.55:0/3523252425 >> 172.21.15.55:0/3523252425 conn(0x7f35400ceee0 msgr2=0x7f35400cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:46.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.983+0000 7f35476d8640 1 -- 172.21.15.55:0/3523252425 shutdown_connections 2023-07-06T22:20:46.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.983+0000 7f35476d8640 1 -- 172.21.15.55:0/3523252425 wait complete. 2023-07-06T22:20:46.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.983+0000 7f35476d8640 1 Processor -- start 2023-07-06T22:20:46.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.983+0000 7f35476d8640 1 -- start start 2023-07-06T22:20:46.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f35476d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35400b1e10 0x7f35400c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f35476d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35400b7cd0 0x7f35400b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f35476d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400ce610 0x7f354015e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f35476d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35400b6d60 con 0x7f35400b1e10 2023-07-06T22:20:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f35476d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354015d8c0 con 0x7f35400ce610 2023-07-06T22:20:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f35476d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354015dba0 con 0x7f35400b7cd0 2023-07-06T22:20:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3545474640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35400b1e10 0x7f35400c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3545474640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35400b1e10 0x7f35400c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33550/0 (socket says 172.21.15.55:33550) 2023-07-06T22:20:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3545474640 1 -- 172.21.15.55:0/3172520307 learned_addr learned my addr 172.21.15.55:0/3172520307 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:46.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3544c73640 1 --2- 172.21.15.55:0/3172520307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35400b7cd0 0x7f35400b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3545c75640 1 --2- 172.21.15.55:0/3172520307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400ce610 0x7f354015e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:46.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3545474640 1 -- 172.21.15.55:0/3172520307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35400b7cd0 msgr2=0x7f35400b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3545474640 1 --2- 172.21.15.55:0/3172520307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35400b7cd0 0x7f35400b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3545474640 1 -- 172.21.15.55:0/3172520307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400ce610 msgr2=0x7f354015e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3545474640 1 --2- 172.21.15.55:0/3172520307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400ce610 0x7f354015e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3545474640 1 -- 172.21.15.55:0/3172520307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3530009420 con 0x7f35400b1e10 2023-07-06T22:20:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3544c73640 1 --2- 172.21.15.55:0/3172520307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35400b7cd0 0x7f35400b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:46.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3545474640 1 --2- 172.21.15.55:0/3172520307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35400b1e10 0x7f35400c7fa0 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f353c00c4d0 tx=0x7f353c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3535ffb640 1 -- 172.21.15.55:0/3172520307 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c005cf0 con 0x7f35400b1e10 2023-07-06T22:20:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3535ffb640 1 -- 172.21.15.55:0/3172520307 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c005e50 con 0x7f35400b1e10 2023-07-06T22:20:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f3535ffb640 1 -- 172.21.15.55:0/3172520307 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c007270 con 0x7f35400b1e10 2023-07-06T22:20:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f35476d8640 1 -- 172.21.15.55:0/3172520307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354015de80 con 0x7f35400b1e10 2023-07-06T22:20:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f35476d8640 1 -- 172.21.15.55:0/3172520307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35400b7040 con 0x7f35400b1e10 2023-07-06T22:20:46.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.987+0000 7f35476d8640 1 -- 172.21.15.55:0/3172520307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3540066d60 con 0x7f35400b1e10 2023-07-06T22:20:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.991+0000 7f3535ffb640 1 -- 172.21.15.55:0/3172520307 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 111) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f353c0073d0 con 0x7f35400b1e10 2023-07-06T22:20:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.991+0000 7f3535ffb640 1 --2- 172.21.15.55:0/3172520307 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f3524066430 0x7f35240688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:46.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.991+0000 7f3535ffb640 1 -- 172.21.15.55:0/3172520307 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f353c0837f0 con 0x7f35400b1e10 2023-07-06T22:20:46.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.991+0000 7f3544c73640 1 -- 172.21.15.55:0/3172520307 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f3524066430 msgr2=0x7f35240688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3861190779 2023-07-06T22:20:46.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.991+0000 7f3544c73640 1 --2- 172.21.15.55:0/3172520307 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f3524066430 0x7f35240688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:46.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:46.995+0000 7f3535ffb640 1 -- 172.21.15.55:0/3172520307 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f353c0507f0 con 0x7f35400b1e10 2023-07-06T22:20:47.006 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:47.003+0000 7f9e8984a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T22:20:47.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.187+0000 7f35476d8640 1 -- 172.21.15.55:0/3172520307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f354015e070 con 0x7f35400b1e10 2023-07-06T22:20:47.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.187+0000 7f3535ffb640 1 -- 172.21.15.55:0/3172520307 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4687 (secure 0 0 0) 0x7f353c053e10 con 0x7f35400b1e10 2023-07-06T22:20:47.189 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:47.190 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":87,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2023670167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2023670167},{"type":"v1","addr":"172.21.15.138:6834","nonce":2023670167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":10989,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2906978966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2906978966},{"type":"v1","addr":"172.21.15.55:6836","nonce":2906978966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":10992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1643276481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1643276481},{"type":"v1","addr":"172.21.15.55:6837","nonce":1643276481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:20:23.728829+0000","modified":"2023-07-06T22:20:27.126611+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11001":{"gid":11001,"name":"d","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6835/3113237921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3113237921},{"type":"v1","addr":"172.21.15.138:6835","nonce":3113237921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-06T22:20:47.190 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 87 2023-07-06T22:20:47.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.187+0000 7f35476d8640 1 -- 172.21.15.55:0/3172520307 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f3524066430 msgr2=0x7f35240688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:47.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.187+0000 7f35476d8640 1 --2- 172.21.15.55:0/3172520307 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f3524066430 0x7f35240688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.187+0000 7f35476d8640 1 -- 172.21.15.55:0/3172520307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35400b1e10 msgr2=0x7f35400c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:47.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.187+0000 7f35476d8640 1 --2- 172.21.15.55:0/3172520307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35400b1e10 0x7f35400c7fa0 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f353c00c4d0 tx=0x7f353c00c990 comp rx=0 tx=0).stop 2023-07-06T22:20:47.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.187+0000 7f35476d8640 1 -- 172.21.15.55:0/3172520307 shutdown_connections 2023-07-06T22:20:47.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.187+0000 7f35476d8640 1 --2- 172.21.15.55:0/3172520307 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f3524066430 0x7f35240688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.187+0000 7f35476d8640 1 --2- 172.21.15.55:0/3172520307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400ce610 0x7f354015e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.187+0000 7f35476d8640 1 --2- 172.21.15.55:0/3172520307 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35400b7cd0 0x7f35400b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.187+0000 7f35476d8640 1 --2- 172.21.15.55:0/3172520307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35400b1e10 0x7f35400c7fa0 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.187+0000 7f35476d8640 1 -- 172.21.15.55:0/3172520307 >> 172.21.15.55:0/3172520307 conn(0x7f35400ceee0 msgr2=0x7f35400693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:47.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.187+0000 7f35476d8640 1 -- 172.21.15.55:0/3172520307 shutdown_connections 2023-07-06T22:20:47.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.191+0000 7f35476d8640 1 -- 172.21.15.55:0/3172520307 wait complete. 2023-07-06T22:20:47.211 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:20:47.343 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:47.339+0000 7f2ae1013180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:20:47.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.399+0000 7f2192fc5640 1 Processor -- start 2023-07-06T22:20:47.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.399+0000 7f2192fc5640 1 -- start start 2023-07-06T22:20:47.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.403+0000 7f2192fc5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f218c0ce610 0x7f218c0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:47.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.403+0000 7f2192fc5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f218c0b1e10 0x7f218c15f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:47.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.403+0000 7f2192fc5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218c0cd1c0 con 0x7f218c0b7cd0 2023-07-06T22:20:47.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.403+0000 7f2192fc5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218c0d2310 con 0x7f218c0ce610 2023-07-06T22:20:47.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.403+0000 7f2192fc5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218c0b80a0 con 0x7f218c0b1e10 2023-07-06T22:20:47.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.403+0000 7f218bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f218c0ce610 0x7f218c0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:47.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.403+0000 7f218bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f218c0ce610 0x7f218c0b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33556/0 (socket says 172.21.15.55:33556) 2023-07-06T22:20:47.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.403+0000 7f218bfff640 1 -- 172.21.15.55:0/2912810207 learned_addr learned my addr 172.21.15.55:0/2912810207 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:47.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.403+0000 7f2191562640 1 --2- 172.21.15.55:0/2912810207 >> v2:172.21.15.138:3300/0 conn(0x7f218c0b1e10 0x7f218c15f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:47.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.403+0000 7f218bfff640 1 -- 172.21.15.55:0/2912810207 >> v2:172.21.15.138:3300/0 conn(0x7f218c0b1e10 msgr2=0x7f218c15f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:47.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.403+0000 7f218bfff640 1 --2- 172.21.15.55:0/2912810207 >> v2:172.21.15.138:3300/0 conn(0x7f218c0b1e10 0x7f218c15f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.403+0000 7f218bfff640 1 -- 172.21.15.55:0/2912810207 >> v1:172.21.15.55:6789/0 conn(0x7f218c0b7cd0 legacy=0x7f218c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:47.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.403+0000 7f218bfff640 1 -- 172.21.15.55:0/2912810207 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c0b2270 con 0x7f218c0ce610 2023-07-06T22:20:47.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.403+0000 7f218b7fe640 1 -- 172.21.15.55:0/2912810207 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126596464 0 0) 0x7f218c0cd1c0 con 0x7f218c0b7cd0 2023-07-06T22:20:47.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.407+0000 7f218bfff640 1 --2- 172.21.15.55:0/2912810207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c0ce610 0x7f218c0b18d0 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f218c0b1310 tx=0x7f217801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfcdf2ddd506f07 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:47.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.407+0000 7f218b7fe640 1 -- 172.21.15.55:0/2912810207 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21780ab600 con 0x7f218c0ce610 2023-07-06T22:20:47.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.407+0000 7f218b7fe640 1 -- 172.21.15.55:0/2912810207 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21780a7050 con 0x7f218c0ce610 2023-07-06T22:20:47.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.407+0000 7f218b7fe640 1 -- 172.21.15.55:0/2912810207 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21780ab980 con 0x7f218c0ce610 2023-07-06T22:20:47.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.407+0000 7f2192fc5640 1 -- 172.21.15.55:0/2912810207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c0ce610 msgr2=0x7f218c0b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:47.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.407+0000 7f2192fc5640 1 --2- 172.21.15.55:0/2912810207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c0ce610 0x7f218c0b18d0 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f218c0b1310 tx=0x7f217801c470 comp rx=0 tx=0).stop 2023-07-06T22:20:47.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.407+0000 7f2192fc5640 1 -- 172.21.15.55:0/2912810207 shutdown_connections 2023-07-06T22:20:47.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.407+0000 7f2192fc5640 1 --2- 172.21.15.55:0/2912810207 >> v2:172.21.15.138:3300/0 conn(0x7f218c0b1e10 0x7f218c15f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.407+0000 7f2192fc5640 1 --2- 172.21.15.55:0/2912810207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c0ce610 0x7f218c0b18d0 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.407+0000 7f2192fc5640 1 -- 172.21.15.55:0/2912810207 >> 172.21.15.55:0/2912810207 conn(0x7f218c0ceee0 msgr2=0x7f218c0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:47.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.407+0000 7f2192fc5640 1 -- 172.21.15.55:0/2912810207 shutdown_connections 2023-07-06T22:20:47.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.407+0000 7f2192fc5640 1 -- 172.21.15.55:0/2912810207 wait complete. 2023-07-06T22:20:47.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.407+0000 7f2192fc5640 1 Processor -- start 2023-07-06T22:20:47.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.407+0000 7f2192fc5640 1 -- start start 2023-07-06T22:20:47.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2192fc5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f218c0b1e10 0x7f218c14c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:47.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2192fc5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f218c0b7cd0 0x7f218c14d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:47.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2192fc5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c0ce610 0x7f218c0698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:47.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2192fc5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c1521a0 con 0x7f218c0ce610 2023-07-06T22:20:47.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2192fc5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c152480 con 0x7f218c0b1e10 2023-07-06T22:20:47.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2192fc5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c14cea0 con 0x7f218c0b7cd0 2023-07-06T22:20:47.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2191562640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c0ce610 0x7f218c0698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:47.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2191562640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c0ce610 0x7f218c0698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33558/0 (socket says 172.21.15.55:33558) 2023-07-06T22:20:47.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2190d61640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f218c0b1e10 0x7f218c14c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:47.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2191562640 1 -- 172.21.15.55:0/3621517431 learned_addr learned my addr 172.21.15.55:0/3621517431 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:47.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f218bfff640 1 --2- 172.21.15.55:0/3621517431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f218c0b7cd0 0x7f218c14d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:47.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2191562640 1 -- 172.21.15.55:0/3621517431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f218c0b7cd0 msgr2=0x7f218c14d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:47.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2191562640 1 --2- 172.21.15.55:0/3621517431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f218c0b7cd0 0x7f218c14d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2191562640 1 -- 172.21.15.55:0/3621517431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f218c0b1e10 msgr2=0x7f218c14c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:47.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2191562640 1 --2- 172.21.15.55:0/3621517431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f218c0b1e10 0x7f218c14c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2191562640 1 -- 172.21.15.55:0/3621517431 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21780094d0 con 0x7f218c0ce610 2023-07-06T22:20:47.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2190d61640 1 --2- 172.21.15.55:0/3621517431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f218c0b1e10 0x7f218c14c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:47.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2191562640 1 --2- 172.21.15.55:0/3621517431 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c0ce610 0x7f218c0698d0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f218400efc0 tx=0x7f218400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:47.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f21897fa640 1 -- 172.21.15.55:0/3621517431 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184009ba0 con 0x7f218c0ce610 2023-07-06T22:20:47.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f21897fa640 1 -- 172.21.15.55:0/3621517431 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218400f040 con 0x7f218c0ce610 2023-07-06T22:20:47.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2192fc5640 1 -- 172.21.15.55:0/3621517431 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218c14d180 con 0x7f218c0ce610 2023-07-06T22:20:47.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f21897fa640 1 -- 172.21.15.55:0/3621517431 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21840146c0 con 0x7f218c0ce610 2023-07-06T22:20:47.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2192fc5640 1 -- 172.21.15.55:0/3621517431 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218c151e50 con 0x7f218c0ce610 2023-07-06T22:20:47.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f2192fc5640 1 -- 172.21.15.55:0/3621517431 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218c066d60 con 0x7f218c0ce610 2023-07-06T22:20:47.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.411+0000 7f21897fa640 1 -- 172.21.15.55:0/3621517431 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 111) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f2184014820 con 0x7f218c0ce610 2023-07-06T22:20:47.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.415+0000 7f21897fa640 1 --2- 172.21.15.55:0/3621517431 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f2170066460 0x7f2170068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:47.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.415+0000 7f21897fa640 1 -- 172.21.15.55:0/3621517431 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f2184084e60 con 0x7f218c0ce610 2023-07-06T22:20:47.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.415+0000 7f2190d61640 1 -- 172.21.15.55:0/3621517431 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f2170066460 msgr2=0x7f2170068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3861190779 2023-07-06T22:20:47.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.415+0000 7f2190d61640 1 --2- 172.21.15.55:0/3621517431 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f2170066460 0x7f2170068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:47.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.419+0000 7f21897fa640 1 -- 172.21.15.55:0/3621517431 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2184051ca0 con 0x7f218c0ce610 2023-07-06T22:20:47.429 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:47.427+0000 7f2ae1013180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:20:47.575 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:47.575+0000 7f2ae1013180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:20:47.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.579+0000 7f2192fc5640 1 -- 172.21.15.55:0/3621517431 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f218c15bf00 con 0x7f218c0ce610 2023-07-06T22:20:47.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.579+0000 7f21897fa640 1 -- 172.21.15.55:0/3621517431 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+19095 (secure 0 0 0) 0x7f2184018090 con 0x7f218c0ce610 2023-07-06T22:20:47.581 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:47.581 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":197,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:20:41.235676+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:20:21.647148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-07-06T22:20:22.723236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3797237235":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/558674907":"2023-07-07T22:20:41.235643+0000","172.21.15.55:6833/538997467":"2023-07-07T22:20:41.235643+0000","172.21.15.55:6832/538997467":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/2063199878":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/2431773305":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/237391926":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/3850725654":"2023-07-07T22:20:41.235643+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:20:47.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.579+0000 7f2192fc5640 1 -- 172.21.15.55:0/3621517431 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f2170066460 msgr2=0x7f2170068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:47.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.579+0000 7f2192fc5640 1 --2- 172.21.15.55:0/3621517431 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f2170066460 0x7f2170068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.579+0000 7f2192fc5640 1 -- 172.21.15.55:0/3621517431 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c0ce610 msgr2=0x7f218c0698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:47.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.579+0000 7f2192fc5640 1 --2- 172.21.15.55:0/3621517431 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c0ce610 0x7f218c0698d0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f218400efc0 tx=0x7f218400c490 comp rx=0 tx=0).stop 2023-07-06T22:20:47.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.579+0000 7f2192fc5640 1 -- 172.21.15.55:0/3621517431 shutdown_connections 2023-07-06T22:20:47.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.579+0000 7f2192fc5640 1 --2- 172.21.15.55:0/3621517431 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f2170066460 0x7f2170068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.579+0000 7f2192fc5640 1 --2- 172.21.15.55:0/3621517431 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c0ce610 0x7f218c0698d0 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.579+0000 7f2192fc5640 1 --2- 172.21.15.55:0/3621517431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f218c0b7cd0 0x7f218c14d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.579+0000 7f2192fc5640 1 --2- 172.21.15.55:0/3621517431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f218c0b1e10 0x7f218c14c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.579+0000 7f2192fc5640 1 -- 172.21.15.55:0/3621517431 >> 172.21.15.55:0/3621517431 conn(0x7f218c0ceee0 msgr2=0x7f218c158480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:47.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.579+0000 7f2192fc5640 1 -- 172.21.15.55:0/3621517431 shutdown_connections 2023-07-06T22:20:47.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.579+0000 7f2192fc5640 1 -- 172.21.15.55:0/3621517431 wait complete. 2023-07-06T22:20:47.585 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:47.583+0000 7f9e8984a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T22:20:47.603 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T21:41:57.708141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T21:42:03.572007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T22:20:21.647148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T22:20:22.723236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T22:20:47.604 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T22:20:47.658 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:47.655+0000 7f2ae1013180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:20:47.676 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:47.675+0000 7f9e8984a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T22:20:47.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.747+0000 7fbf47034640 1 Processor -- start 2023-07-06T22:20:47.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.747+0000 7fbf47034640 1 -- start start 2023-07-06T22:20:47.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf47034640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf4015b850 0x7fbf400cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:47.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf47034640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbf400ccd30 0x7fbf400b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:47.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf47034640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf400b3db0 0x7fbf4015f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:47.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf47034640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf400b4210 con 0x7fbf400b3db0 2023-07-06T22:20:47.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf47034640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf400b2b80 con 0x7fbf400ccd30 2023-07-06T22:20:47.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf47034640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400cff30 con 0x7fbf4015b850 2023-07-06T22:20:47.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf455d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf400b3db0 0x7fbf4015f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:47.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf44dd0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf4015b850 0x7fbf400cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:47.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf3ffff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbf400ccd30 0x7fbf400b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:47.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf455d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf400b3db0 0x7fbf4015f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33570/0 (socket says 172.21.15.55:33570) 2023-07-06T22:20:47.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf455d1640 1 -- 172.21.15.55:0/3391334766 learned_addr learned my addr 172.21.15.55:0/3391334766 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:47.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf455d1640 1 -- 172.21.15.55:0/3391334766 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf4015b850 msgr2=0x7fbf400cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:47.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf455d1640 1 --2- 172.21.15.55:0/3391334766 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf4015b850 0x7fbf400cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf455d1640 1 -- 172.21.15.55:0/3391334766 >> v2:172.21.15.138:3300/0 conn(0x7fbf400ccd30 msgr2=0x7fbf400b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:47.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf455d1640 1 --2- 172.21.15.55:0/3391334766 >> v2:172.21.15.138:3300/0 conn(0x7fbf400ccd30 0x7fbf400b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.751+0000 7fbf455d1640 1 -- 172.21.15.55:0/3391334766 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400b22e0 con 0x7fbf400b3db0 2023-07-06T22:20:47.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.755+0000 7fbf455d1640 1 --2- 172.21.15.55:0/3391334766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf400b3db0 0x7fbf4015f4b0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7fbf40073640 tx=0x7fbf3801c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccaa36a843528a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:47.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.755+0000 7fbf3f7fe640 1 -- 172.21.15.55:0/3391334766 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf380a6450 con 0x7fbf400b3db0 2023-07-06T22:20:47.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.755+0000 7fbf3f7fe640 1 -- 172.21.15.55:0/3391334766 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf380a65b0 con 0x7fbf400b3db0 2023-07-06T22:20:47.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.755+0000 7fbf3f7fe640 1 -- 172.21.15.55:0/3391334766 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf380a6940 con 0x7fbf400b3db0 2023-07-06T22:20:47.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.755+0000 7fbf47034640 1 -- 172.21.15.55:0/3391334766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf400b3db0 msgr2=0x7fbf4015f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:47.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.755+0000 7fbf47034640 1 --2- 172.21.15.55:0/3391334766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf400b3db0 0x7fbf4015f4b0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7fbf40073640 tx=0x7fbf3801c5c0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.755+0000 7fbf47034640 1 -- 172.21.15.55:0/3391334766 shutdown_connections 2023-07-06T22:20:47.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.755+0000 7fbf47034640 1 --2- 172.21.15.55:0/3391334766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf400b3db0 0x7fbf4015f4b0 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.755+0000 7fbf47034640 1 --2- 172.21.15.55:0/3391334766 >> v2:172.21.15.138:3300/0 conn(0x7fbf400ccd30 0x7fbf400b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.755+0000 7fbf47034640 1 --2- 172.21.15.55:0/3391334766 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf4015b850 0x7fbf400cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.755+0000 7fbf47034640 1 -- 172.21.15.55:0/3391334766 >> 172.21.15.55:0/3391334766 conn(0x7fbf400cec20 msgr2=0x7fbf400cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:47.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.755+0000 7fbf47034640 1 -- 172.21.15.55:0/3391334766 shutdown_connections 2023-07-06T22:20:47.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.755+0000 7fbf47034640 1 -- 172.21.15.55:0/3391334766 wait complete. 2023-07-06T22:20:47.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf47034640 1 Processor -- start 2023-07-06T22:20:47.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf47034640 1 -- start start 2023-07-06T22:20:47.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf47034640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf400b3db0 0x7fbf40151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:47.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf47034640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf400ccd30 0x7fbf400b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:47.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf47034640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf4015b850 0x7fbf40159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:47.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf47034640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf40153a80 con 0x7fbf400b3db0 2023-07-06T22:20:47.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf47034640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf40152ed0 con 0x7fbf400ccd30 2023-07-06T22:20:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf47034640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf401531b0 con 0x7fbf4015b850 2023-07-06T22:20:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf44dd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf400b3db0 0x7fbf40151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf44dd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf400b3db0 0x7fbf40151a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33576/0 (socket says 172.21.15.55:33576) 2023-07-06T22:20:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf44dd0640 1 -- 172.21.15.55:0/1205223108 learned_addr learned my addr 172.21.15.55:0/1205223108 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf3ffff640 1 --2- 172.21.15.55:0/1205223108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf400ccd30 0x7fbf400b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf455d1640 1 --2- 172.21.15.55:0/1205223108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf4015b850 0x7fbf40159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf44dd0640 1 -- 172.21.15.55:0/1205223108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf4015b850 msgr2=0x7fbf40159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf44dd0640 1 --2- 172.21.15.55:0/1205223108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf4015b850 0x7fbf40159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf44dd0640 1 -- 172.21.15.55:0/1205223108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf400ccd30 msgr2=0x7fbf400b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf44dd0640 1 --2- 172.21.15.55:0/1205223108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf400ccd30 0x7fbf400b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf44dd0640 1 -- 172.21.15.55:0/1205223108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf38009b30 con 0x7fbf400b3db0 2023-07-06T22:20:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf3ffff640 1 --2- 172.21.15.55:0/1205223108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf400ccd30 0x7fbf400b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf44dd0640 1 --2- 172.21.15.55:0/1205223108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf400b3db0 0x7fbf40151a10 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400e870 tx=0x7fbf3400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf3d7fa640 1 -- 172.21.15.55:0/1205223108 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34009510 con 0x7fbf400b3db0 2023-07-06T22:20:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf3d7fa640 1 -- 172.21.15.55:0/1205223108 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3400eec0 con 0x7fbf400b3db0 2023-07-06T22:20:47.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf47034640 1 -- 172.21.15.55:0/1205223108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4015bda0 con 0x7fbf400b3db0 2023-07-06T22:20:47.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.759+0000 7fbf3d7fa640 1 -- 172.21.15.55:0/1205223108 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3400cb40 con 0x7fbf400b3db0 2023-07-06T22:20:47.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.763+0000 7fbf47034640 1 -- 172.21.15.55:0/1205223108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf400c9310 con 0x7fbf400b3db0 2023-07-06T22:20:47.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.763+0000 7fbf47034640 1 -- 172.21.15.55:0/1205223108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf40066d60 con 0x7fbf400b3db0 2023-07-06T22:20:47.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.763+0000 7fbf3d7fa640 1 -- 172.21.15.55:0/1205223108 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 111) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fbf3400cca0 con 0x7fbf400b3db0 2023-07-06T22:20:47.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.763+0000 7fbf3d7fa640 1 --2- 172.21.15.55:0/1205223108 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fbf24066430 0x7fbf240688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:47.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.763+0000 7fbf3ffff640 1 -- 172.21.15.55:0/1205223108 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fbf24066430 msgr2=0x7fbf240688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3861190779 2023-07-06T22:20:47.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.763+0000 7fbf3ffff640 1 --2- 172.21.15.55:0/1205223108 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fbf24066430 0x7fbf240688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:47.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.763+0000 7fbf3d7fa640 1 -- 172.21.15.55:0/1205223108 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fbf340842d0 con 0x7fbf400b3db0 2023-07-06T22:20:47.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.767+0000 7fbf3d7fa640 1 -- 172.21.15.55:0/1205223108 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf34051360 con 0x7fbf400b3db0 2023-07-06T22:20:47.838 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:47.835+0000 7f9e8984a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T22:20:47.927 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:47.923+0000 7f9e8984a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T22:20:47.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.926+0000 7fbf47034640 1 -- 172.21.15.55:0/1205223108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf400b3420 con 0x7fbf400b3db0 2023-07-06T22:20:47.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.926+0000 7fbf3d7fa640 1 -- 172.21.15.55:0/1205223108 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v197) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf34054980 con 0x7fbf400b3db0 2023-07-06T22:20:47.930 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-07-06T22:20:47.931 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:47.931+0000 7f2ae1013180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:20:47.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.930+0000 7fbf47034640 1 -- 172.21.15.55:0/1205223108 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fbf24066430 msgr2=0x7fbf240688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:47.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.930+0000 7fbf47034640 1 --2- 172.21.15.55:0/1205223108 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fbf24066430 0x7fbf240688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.930+0000 7fbf47034640 1 -- 172.21.15.55:0/1205223108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf400b3db0 msgr2=0x7fbf40151a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:47.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.930+0000 7fbf47034640 1 --2- 172.21.15.55:0/1205223108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf400b3db0 0x7fbf40151a10 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400e870 tx=0x7fbf3400ec70 comp rx=0 tx=0).stop 2023-07-06T22:20:47.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.930+0000 7fbf47034640 1 -- 172.21.15.55:0/1205223108 shutdown_connections 2023-07-06T22:20:47.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.930+0000 7fbf47034640 1 --2- 172.21.15.55:0/1205223108 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7fbf24066430 0x7fbf240688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.930+0000 7fbf47034640 1 --2- 172.21.15.55:0/1205223108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf4015b850 0x7fbf40159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.930+0000 7fbf47034640 1 --2- 172.21.15.55:0/1205223108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf400ccd30 0x7fbf400b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.930+0000 7fbf47034640 1 --2- 172.21.15.55:0/1205223108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf400b3db0 0x7fbf40151a10 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:47.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.930+0000 7fbf47034640 1 -- 172.21.15.55:0/1205223108 >> 172.21.15.55:0/1205223108 conn(0x7fbf400cec20 msgr2=0x7fbf4006a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:47.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.930+0000 7fbf47034640 1 -- 172.21.15.55:0/1205223108 shutdown_connections 2023-07-06T22:20:47.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:47.930+0000 7fbf47034640 1 -- 172.21.15.55:0/1205223108 wait complete. 2023-07-06T22:20:47.952 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T22:20:47.991 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-07-06T22:20:47.987+0000 7f2ae1013180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:20:48.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.094+0000 7f2af15a9640 1 Processor -- start 2023-07-06T22:20:48.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2af15a9640 1 -- start start 2023-07-06T22:20:48.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2af15a9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2aec0b1250 0x7f2aec15f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2af15a9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2aec0ce200 0x7f2aec0ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2af15a9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec0cc740 con 0x7f2aec0d0630 2023-07-06T22:20:48.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2af15a9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec0ccc90 con 0x7f2aec0ce200 2023-07-06T22:20:48.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2af15a9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec0b29c0 con 0x7f2aec0b1250 2023-07-06T22:20:48.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2af0da8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2aec0ce200 0x7f2aec0ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:48.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2af0da8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2aec0ce200 0x7f2aec0ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33590/0 (socket says 172.21.15.55:33590) 2023-07-06T22:20:48.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2af0da8640 1 -- 172.21.15.55:0/244797520 learned_addr learned my addr 172.21.15.55:0/244797520 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:48.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2aeb7fe640 1 --1- 172.21.15.55:0/244797520 >> v1:172.21.15.55:6789/0 conn(0x7f2aec0d0630 0x7f2aec15f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56940/0 (socket says 172.21.15.55:56940) 2023-07-06T22:20:48.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2aebfff640 1 --2- 172.21.15.55:0/244797520 >> v2:172.21.15.138:3300/0 conn(0x7f2aec0b1250 0x7f2aec15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:48.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2af0da8640 1 -- 172.21.15.55:0/244797520 >> v2:172.21.15.138:3300/0 conn(0x7f2aec0b1250 msgr2=0x7f2aec15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:48.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2af0da8640 1 --2- 172.21.15.55:0/244797520 >> v2:172.21.15.138:3300/0 conn(0x7f2aec0b1250 0x7f2aec15f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2af0da8640 1 -- 172.21.15.55:0/244797520 >> v1:172.21.15.55:6789/0 conn(0x7f2aec0d0630 legacy=0x7f2aec15f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.098+0000 7f2af0da8640 1 -- 172.21.15.55:0/244797520 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0d1d10 con 0x7f2aec0ce200 2023-07-06T22:20:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.102+0000 7f2af0da8640 1 --2- 172.21.15.55:0/244797520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aec0ce200 0x7f2aec0ce640 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f2aec08a100 tx=0x7f2ae401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40157294ffd6a667 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.102+0000 7f2aeaffd640 1 -- 172.21.15.55:0/244797520 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40090d0 con 0x7f2aec0ce200 2023-07-06T22:20:48.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.102+0000 7f2aeaffd640 1 -- 172.21.15.55:0/244797520 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae4009230 con 0x7f2aec0ce200 2023-07-06T22:20:48.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.102+0000 7f2aeaffd640 1 -- 172.21.15.55:0/244797520 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40a59a0 con 0x7f2aec0ce200 2023-07-06T22:20:48.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.102+0000 7f2af15a9640 1 -- 172.21.15.55:0/244797520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aec0ce200 msgr2=0x7f2aec0ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.102+0000 7f2af15a9640 1 --2- 172.21.15.55:0/244797520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aec0ce200 0x7f2aec0ce640 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f2aec08a100 tx=0x7f2ae401c9d0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.102+0000 7f2af15a9640 1 -- 172.21.15.55:0/244797520 shutdown_connections 2023-07-06T22:20:48.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.102+0000 7f2af15a9640 1 --2- 172.21.15.55:0/244797520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aec0ce200 0x7f2aec0ce640 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.102+0000 7f2af15a9640 1 --2- 172.21.15.55:0/244797520 >> v2:172.21.15.138:3300/0 conn(0x7f2aec0b1250 0x7f2aec15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.102+0000 7f2af15a9640 1 -- 172.21.15.55:0/244797520 >> 172.21.15.55:0/244797520 conn(0x7f2aec0b3b60 msgr2=0x7f2aec0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:48.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.102+0000 7f2af15a9640 1 -- 172.21.15.55:0/244797520 shutdown_connections 2023-07-06T22:20:48.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.102+0000 7f2af15a9640 1 -- 172.21.15.55:0/244797520 wait complete. 2023-07-06T22:20:48.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.102+0000 7f2af15a9640 1 Processor -- start 2023-07-06T22:20:48.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.102+0000 7f2af15a9640 1 -- start start 2023-07-06T22:20:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af15a9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2aec0b1250 0x7f2aec151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af15a9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2aec0ce200 0x7f2aec156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af15a9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aec0d0630 0x7f2aec157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af15a9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0c9120 con 0x7f2aec0d0630 2023-07-06T22:20:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af15a9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0c5d40 con 0x7f2aec0b1250 2023-07-06T22:20:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af15a9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0c6020 con 0x7f2aec0ce200 2023-07-06T22:20:48.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af0da8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aec0d0630 0x7f2aec157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:48.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af0da8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aec0d0630 0x7f2aec157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33604/0 (socket says 172.21.15.55:33604) 2023-07-06T22:20:48.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af0da8640 1 -- 172.21.15.55:0/989849194 learned_addr learned my addr 172.21.15.55:0/989849194 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:48.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2aebfff640 1 --2- 172.21.15.55:0/989849194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2aec0b1250 0x7f2aec151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:48.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2aeb7fe640 1 --2- 172.21.15.55:0/989849194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2aec0ce200 0x7f2aec156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:48.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af0da8640 1 -- 172.21.15.55:0/989849194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2aec0ce200 msgr2=0x7f2aec156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af0da8640 1 --2- 172.21.15.55:0/989849194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2aec0ce200 0x7f2aec156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af0da8640 1 -- 172.21.15.55:0/989849194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2aec0b1250 msgr2=0x7f2aec151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af0da8640 1 --2- 172.21.15.55:0/989849194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2aec0b1250 0x7f2aec151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af0da8640 1 -- 172.21.15.55:0/989849194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae4009b30 con 0x7f2aec0d0630 2023-07-06T22:20:48.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2aeb7fe640 1 --2- 172.21.15.55:0/989849194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2aec0ce200 0x7f2aec156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:48.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af0da8640 1 --2- 172.21.15.55:0/989849194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aec0d0630 0x7f2aec157220 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40195e0 tx=0x7f2ae4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:48.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2ae8ff9640 1 -- 172.21.15.55:0/989849194 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40090d0 con 0x7f2aec0d0630 2023-07-06T22:20:48.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2ae8ff9640 1 -- 172.21.15.55:0/989849194 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae40b88a0 con 0x7f2aec0d0630 2023-07-06T22:20:48.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2ae8ff9640 1 -- 172.21.15.55:0/989849194 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40b8c50 con 0x7f2aec0d0630 2023-07-06T22:20:48.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af15a9640 1 -- 172.21.15.55:0/989849194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec0c6300 con 0x7f2aec0d0630 2023-07-06T22:20:48.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af15a9640 1 -- 172.21.15.55:0/989849194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec151aa0 con 0x7f2aec0d0630 2023-07-06T22:20:48.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.106+0000 7f2af15a9640 1 -- 172.21.15.55:0/989849194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec1554c0 con 0x7f2aec0d0630 2023-07-06T22:20:48.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.110+0000 7f2ae8ff9640 1 -- 172.21.15.55:0/989849194 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 111) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f2ae40c1410 con 0x7f2aec0d0630 2023-07-06T22:20:48.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.110+0000 7f2ae8ff9640 1 --2- 172.21.15.55:0/989849194 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f2ad8066460 0x7f2ad8068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.110+0000 7f2ae8ff9640 1 -- 172.21.15.55:0/989849194 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f2ae411f770 con 0x7f2aec0d0630 2023-07-06T22:20:48.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.110+0000 7f2aebfff640 1 -- 172.21.15.55:0/989849194 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f2ad8066460 msgr2=0x7f2ad8068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6832/3861190779 2023-07-06T22:20:48.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.110+0000 7f2aebfff640 1 --2- 172.21.15.55:0/989849194 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f2ad8066460 0x7f2ad8068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T22:20:48.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.118+0000 7f2ae8ff9640 1 -- 172.21.15.55:0/989849194 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2aec1554c0 con 0x7f2aec0d0630 2023-07-06T22:20:48.222 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:48.218+0000 7f9e8984a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T22:20:48.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.282+0000 7f2af15a9640 1 -- 172.21.15.55:0/989849194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2aec1554c0 con 0x7f2aec0d0630 2023-07-06T22:20:48.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.282+0000 7f2ae8ff9640 1 -- 172.21.15.55:0/989849194 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v197) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2aec1554c0 con 0x7f2aec0d0630 2023-07-06T22:20:48.285 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-07-06T22:20:48.286 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:48.282+0000 7f9e8984a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T22:20:48.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.282+0000 7f2af15a9640 1 -- 172.21.15.55:0/989849194 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f2ad8066460 msgr2=0x7f2ad8068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T22:20:48.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.282+0000 7f2af15a9640 1 --2- 172.21.15.55:0/989849194 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f2ad8066460 0x7f2ad8068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.282+0000 7f2af15a9640 1 -- 172.21.15.55:0/989849194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aec0d0630 msgr2=0x7f2aec157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.282+0000 7f2af15a9640 1 --2- 172.21.15.55:0/989849194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aec0d0630 0x7f2aec157220 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40195e0 tx=0x7f2ae4019770 comp rx=0 tx=0).stop 2023-07-06T22:20:48.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.282+0000 7f2af15a9640 1 -- 172.21.15.55:0/989849194 shutdown_connections 2023-07-06T22:20:48.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.282+0000 7f2af15a9640 1 --2- 172.21.15.55:0/989849194 >> [v2:172.21.15.55:6832/3861190779,v1:172.21.15.55:6833/3861190779] conn(0x7f2ad8066460 0x7f2ad8068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.282+0000 7f2af15a9640 1 --2- 172.21.15.55:0/989849194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aec0d0630 0x7f2aec157220 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.282+0000 7f2af15a9640 1 --2- 172.21.15.55:0/989849194 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2aec0ce200 0x7f2aec156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.282+0000 7f2af15a9640 1 --2- 172.21.15.55:0/989849194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2aec0b1250 0x7f2aec151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.282+0000 7f2af15a9640 1 -- 172.21.15.55:0/989849194 >> 172.21.15.55:0/989849194 conn(0x7f2aec0b3b60 msgr2=0x7f2aec0693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:48.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.282+0000 7f2af15a9640 1 -- 172.21.15.55:0/989849194 shutdown_connections 2023-07-06T22:20:48.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.286+0000 7f2af15a9640 1 -- 172.21.15.55:0/989849194 wait complete. 2023-07-06T22:20:48.316 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T22:20:48.375 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:48.370+0000 7f9e10629640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:48.375 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:48.370+0000 7f9e10629640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:48.375 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:48.370+0000 7f9e10629640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:48.375 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:48.370+0000 7f9e10629640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:48.375 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:48.370+0000 7f9e10629640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:48.376 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:48.374+0000 7f9e13e30640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:48.376 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:48.374+0000 7f9e13e30640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:48.376 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:48.374+0000 7f9e13e30640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:48.377 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:48.374+0000 7f9e13e30640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:48.377 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-07-06T22:20:48.374+0000 7f9e13e30640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-06T22:20:48.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8cd182640 1 Processor -- start 2023-07-06T22:20:48.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8cd182640 1 -- start start 2023-07-06T22:20:48.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8cd182640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc8c8070020 0x7fc8c80ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8cd182640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8c80cef40 0x7fc8c80c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8cd182640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c815fe80 con 0x7fc8c815bb90 2023-07-06T22:20:48.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8cd182640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c815f620 con 0x7fc8c8070020 2023-07-06T22:20:48.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8cd182640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c815bf60 con 0x7fc8c80cef40 2023-07-06T22:20:48.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8c6d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc8c815bb90 0x7fc8c806f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56954/0 (socket says 172.21.15.55:56954) 2023-07-06T22:20:48.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8c6d9d640 1 -- 172.21.15.55:0/4288904843 learned_addr learned my addr 172.21.15.55:0/4288904843 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:48.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8c759e640 1 --2- 172.21.15.55:0/4288904843 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8c80cef40 0x7fc8c80c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:48.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8c659c640 1 --2- 172.21.15.55:0/4288904843 >> v2:172.21.15.138:3300/0 conn(0x7fc8c8070020 0x7fc8c80ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:48.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8c5d9b640 1 -- 172.21.15.55:0/4288904843 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211181794 0 0) 0x7fc8c815fe80 con 0x7fc8c815bb90 2023-07-06T22:20:48.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8c5d9b640 1 -- 172.21.15.55:0/4288904843 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8b0003530 con 0x7fc8c815bb90 2023-07-06T22:20:48.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8c659c640 1 -- 172.21.15.55:0/4288904843 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8c80cef40 msgr2=0x7fc8c80c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:48.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8c659c640 1 --2- 172.21.15.55:0/4288904843 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8c80cef40 0x7fc8c80c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8c659c640 1 -- 172.21.15.55:0/4288904843 >> v1:172.21.15.55:6789/0 conn(0x7fc8c815bb90 legacy=0x7fc8c806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8c659c640 1 -- 172.21.15.55:0/4288904843 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c80cf440 con 0x7fc8c8070020 2023-07-06T22:20:48.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.478+0000 7fc8c759e640 1 --2- 172.21.15.55:0/4288904843 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8c80cef40 0x7fc8c80c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:48.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.482+0000 7fc8c659c640 1 --2- 172.21.15.55:0/4288904843 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8c8070020 0x7fc8c80ce030 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0097c0 tx=0x7fc8bc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b46d56101aba4da server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:48.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.482+0000 7fc8c5d9b640 1 -- 172.21.15.55:0/4288904843 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0ab600 con 0x7fc8c8070020 2023-07-06T22:20:48.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.482+0000 7fc8c5d9b640 1 -- 172.21.15.55:0/4288904843 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc0a7050 con 0x7fc8c8070020 2023-07-06T22:20:48.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.482+0000 7fc8c5d9b640 1 -- 172.21.15.55:0/4288904843 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0ab980 con 0x7fc8c8070020 2023-07-06T22:20:48.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.482+0000 7fc8cd182640 1 -- 172.21.15.55:0/4288904843 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8c8070020 msgr2=0x7fc8c80ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.482+0000 7fc8cd182640 1 --2- 172.21.15.55:0/4288904843 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8c8070020 0x7fc8c80ce030 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0097c0 tx=0x7fc8bc01c480 comp rx=0 tx=0).stop 2023-07-06T22:20:48.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.482+0000 7fc8cd182640 1 -- 172.21.15.55:0/4288904843 shutdown_connections 2023-07-06T22:20:48.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.482+0000 7fc8cd182640 1 --2- 172.21.15.55:0/4288904843 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8c80cef40 0x7fc8c80c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.482+0000 7fc8cd182640 1 --2- 172.21.15.55:0/4288904843 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8c8070020 0x7fc8c80ce030 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.482+0000 7fc8cd182640 1 -- 172.21.15.55:0/4288904843 >> 172.21.15.55:0/4288904843 conn(0x7fc8c80cbd70 msgr2=0x7fc8c80ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:48.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.482+0000 7fc8cd182640 1 -- 172.21.15.55:0/4288904843 shutdown_connections 2023-07-06T22:20:48.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.482+0000 7fc8cd182640 1 -- 172.21.15.55:0/4288904843 wait complete. 2023-07-06T22:20:48.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8cd182640 1 Processor -- start 2023-07-06T22:20:48.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8cd182640 1 -- start start 2023-07-06T22:20:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8cd182640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8c8070020 0x7fc8c814a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8cd182640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c80cef40 0x7fc8c81544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8cd182640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8c815bb90 0x7fc8c81549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8cd182640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80b23c0 con 0x7fc8c80cef40 2023-07-06T22:20:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8cd182640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80b26a0 con 0x7fc8c8070020 2023-07-06T22:20:48.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8cd182640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80b2980 con 0x7fc8c815bb90 2023-07-06T22:20:48.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8c659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c80cef40 0x7fc8c81544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:48.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8c659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c80cef40 0x7fc8c81544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33752/0 (socket says 172.21.15.55:33752) 2023-07-06T22:20:48.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8c659c640 1 -- 172.21.15.55:0/3632660869 learned_addr learned my addr 172.21.15.55:0/3632660869 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:48.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8c759e640 1 --2- 172.21.15.55:0/3632660869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8c815bb90 0x7fc8c81549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:48.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8c6d9d640 1 --2- 172.21.15.55:0/3632660869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8c8070020 0x7fc8c814a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:48.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8c659c640 1 -- 172.21.15.55:0/3632660869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8c815bb90 msgr2=0x7fc8c81549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8c659c640 1 --2- 172.21.15.55:0/3632660869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8c815bb90 0x7fc8c81549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8c659c640 1 -- 172.21.15.55:0/3632660869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8c8070020 msgr2=0x7fc8c814a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8c659c640 1 --2- 172.21.15.55:0/3632660869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8c8070020 0x7fc8c814a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8c659c640 1 -- 172.21.15.55:0/3632660869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0009a70 con 0x7fc8c80cef40 2023-07-06T22:20:48.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8c659c640 1 --2- 172.21.15.55:0/3632660869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c80cef40 0x7fc8c81544b0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0ae040 tx=0x7fc8bc019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:48.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8af7fe640 1 -- 172.21.15.55:0/3632660869 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc006e20 con 0x7fc8c80cef40 2023-07-06T22:20:48.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8af7fe640 1 -- 172.21.15.55:0/3632660869 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc0b4430 con 0x7fc8c80cef40 2023-07-06T22:20:48.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8af7fe640 1 -- 172.21.15.55:0/3632660869 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0b4800 con 0x7fc8c80cef40 2023-07-06T22:20:48.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8cd182640 1 -- 172.21.15.55:0/3632660869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc009420 con 0x7fc8c80cef40 2023-07-06T22:20:48.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8cd182640 1 -- 172.21.15.55:0/3632660869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c80b2f40 con 0x7fc8c80cef40 2023-07-06T22:20:48.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.486+0000 7fc8cd182640 1 -- 172.21.15.55:0/3632660869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c8066d60 con 0x7fc8c80cef40 2023-07-06T22:20:48.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.490+0000 7fc8af7fe640 1 -- 172.21.15.55:0/3632660869 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 113) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fc8bc0b2040 con 0x7fc8c80cef40 2023-07-06T22:20:48.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.490+0000 7fc8af7fe640 1 -- 172.21.15.55:0/3632660869 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 7141+0+0 (secure 0 0 0) 0x7fc8bc11d950 con 0x7fc8c80cef40 2023-07-06T22:20:48.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.494+0000 7fc8af7fe640 1 -- 172.21.15.55:0/3632660869 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc8bc0eacf0 con 0x7fc8c80cef40 2023-07-06T22:20:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.650+0000 7fc8cd182640 1 -- 172.21.15.55:0/3632660869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc8c80b4620 con 0x7fc8c80cef40 2023-07-06T22:20:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.650+0000 7fc8af7fe640 1 -- 172.21.15.55:0/3632660869 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v198) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc8bc0ee310 con 0x7fc8c80cef40 2023-07-06T22:20:48.655 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-07-06T22:20:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.654+0000 7fc8cd182640 1 -- 172.21.15.55:0/3632660869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c80cef40 msgr2=0x7fc8c81544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.654+0000 7fc8cd182640 1 --2- 172.21.15.55:0/3632660869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c80cef40 0x7fc8c81544b0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0ae040 tx=0x7fc8bc019220 comp rx=0 tx=0).stop 2023-07-06T22:20:48.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.654+0000 7fc8cd182640 1 -- 172.21.15.55:0/3632660869 shutdown_connections 2023-07-06T22:20:48.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.654+0000 7fc8cd182640 1 --2- 172.21.15.55:0/3632660869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8c815bb90 0x7fc8c81549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.654+0000 7fc8cd182640 1 --2- 172.21.15.55:0/3632660869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c80cef40 0x7fc8c81544b0 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.654+0000 7fc8cd182640 1 --2- 172.21.15.55:0/3632660869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8c8070020 0x7fc8c814a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.654+0000 7fc8cd182640 1 -- 172.21.15.55:0/3632660869 >> 172.21.15.55:0/3632660869 conn(0x7fc8c80cbd70 msgr2=0x7fc8c806cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:48.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.654+0000 7fc8cd182640 1 -- 172.21.15.55:0/3632660869 shutdown_connections 2023-07-06T22:20:48.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.654+0000 7fc8cd182640 1 -- 172.21.15.55:0/3632660869 wait complete. 2023-07-06T22:20:48.675 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T22:20:48.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57e0fd2640 1 Processor -- start 2023-07-06T22:20:48.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57e0fd2640 1 -- start start 2023-07-06T22:20:48.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57e0fd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57dc06f0e0 0x7f57dc0ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57e0fd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc0cc2f0 con 0x7f57dc156180 2023-07-06T22:20:48.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57e0fd2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc15f5d0 con 0x7f57dc0cb7a0 2023-07-06T22:20:48.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57e0fd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc160250 con 0x7f57dc06f0e0 2023-07-06T22:20:48.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57da59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f57dc156180 0x7f57dc06e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56966/0 (socket says 172.21.15.55:56966) 2023-07-06T22:20:48.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57da59c640 1 -- 172.21.15.55:0/904980342 learned_addr learned my addr 172.21.15.55:0/904980342 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57d1d9b640 1 --2- 172.21.15.55:0/904980342 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57dc06f0e0 0x7f57dc0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57d9d9b640 1 -- 172.21.15.55:0/904980342 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892912804 0 0) 0x7f57dc0cc2f0 con 0x7f57dc156180 2023-07-06T22:20:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57d9d9b640 1 -- 172.21.15.55:0/904980342 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57c8003530 con 0x7f57dc156180 2023-07-06T22:20:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57d9d9b640 1 -- 172.21.15.55:0/904980342 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743314015 0 0) 0x7f57dc15f5d0 con 0x7f57dc0cb7a0 2023-07-06T22:20:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57d9d9b640 1 -- 172.21.15.55:0/904980342 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57dc0cc2f0 con 0x7f57dc0cb7a0 2023-07-06T22:20:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57d1d9b640 1 -- 172.21.15.55:0/904980342 >> v1:172.21.15.138:6789/0 conn(0x7f57dc0cb7a0 legacy=0x7f57dc0cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57d1d9b640 1 -- 172.21.15.55:0/904980342 >> v1:172.21.15.55:6789/0 conn(0x7f57dc156180 legacy=0x7f57dc06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.818+0000 7f57d1d9b640 1 -- 172.21.15.55:0/904980342 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc15f8b0 con 0x7f57dc06f0e0 2023-07-06T22:20:48.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.822+0000 7f57d1d9b640 1 --2- 172.21.15.55:0/904980342 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57dc06f0e0 0x7f57dc0ca610 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f57c40097f0 tx=0x7f57c401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a209f56cef7a2a43 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:48.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.822+0000 7f57d9d9b640 1 -- 172.21.15.55:0/904980342 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c40ab600 con 0x7f57dc06f0e0 2023-07-06T22:20:48.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.822+0000 7f57d9d9b640 1 -- 172.21.15.55:0/904980342 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c40ab760 con 0x7f57dc06f0e0 2023-07-06T22:20:48.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.822+0000 7f57d9d9b640 1 -- 172.21.15.55:0/904980342 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c40abad0 con 0x7f57dc06f0e0 2023-07-06T22:20:48.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.822+0000 7f57e0fd2640 1 -- 172.21.15.55:0/904980342 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57dc06f0e0 msgr2=0x7f57dc0ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.822+0000 7f57e0fd2640 1 --2- 172.21.15.55:0/904980342 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57dc06f0e0 0x7f57dc0ca610 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f57c40097f0 tx=0x7f57c401c400 comp rx=0 tx=0).stop 2023-07-06T22:20:48.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.822+0000 7f57e0fd2640 1 -- 172.21.15.55:0/904980342 shutdown_connections 2023-07-06T22:20:48.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.822+0000 7f57e0fd2640 1 --2- 172.21.15.55:0/904980342 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57dc06f0e0 0x7f57dc0ca610 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.822+0000 7f57e0fd2640 1 -- 172.21.15.55:0/904980342 >> 172.21.15.55:0/904980342 conn(0x7f57dc0d0c50 msgr2=0x7f57dc0cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:48.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.822+0000 7f57e0fd2640 1 -- 172.21.15.55:0/904980342 shutdown_connections 2023-07-06T22:20:48.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.822+0000 7f57e0fd2640 1 -- 172.21.15.55:0/904980342 wait complete. 2023-07-06T22:20:48.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57e0fd2640 1 Processor -- start 2023-07-06T22:20:48.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57e0fd2640 1 -- start start 2023-07-06T22:20:48.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57e0fd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57dc06f0e0 0x7f57dc0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57e0fd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57dc0cb7a0 0x7f57dc0b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57e0fd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57dc156180 0x7f57dc14f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:48.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57e0fd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0b09c0 con 0x7f57dc156180 2023-07-06T22:20:48.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57e0fd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0c6990 con 0x7f57dc06f0e0 2023-07-06T22:20:48.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57e0fd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0c8170 con 0x7f57dc0cb7a0 2023-07-06T22:20:48.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57dad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57dc156180 0x7f57dc14f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:48.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57dad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57dc156180 0x7f57dc14f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33756/0 (socket says 172.21.15.55:33756) 2023-07-06T22:20:48.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57dad9d640 1 -- 172.21.15.55:0/828651055 learned_addr learned my addr 172.21.15.55:0/828651055 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:48.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57d1d9b640 1 --2- 172.21.15.55:0/828651055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57dc0cb7a0 0x7f57dc0b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:48.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57da59c640 1 --2- 172.21.15.55:0/828651055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57dc06f0e0 0x7f57dc0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:48.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57dad9d640 1 -- 172.21.15.55:0/828651055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57dc0cb7a0 msgr2=0x7f57dc0b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57dad9d640 1 --2- 172.21.15.55:0/828651055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57dc0cb7a0 0x7f57dc0b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57dad9d640 1 -- 172.21.15.55:0/828651055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57dc06f0e0 msgr2=0x7f57dc0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57dad9d640 1 --2- 172.21.15.55:0/828651055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57dc06f0e0 0x7f57dc0c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57dad9d640 1 -- 172.21.15.55:0/828651055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4009420 con 0x7f57dc156180 2023-07-06T22:20:48.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57dad9d640 1 --2- 172.21.15.55:0/828651055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57dc156180 0x7f57dc14f4d0 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7f57d400c790 tx=0x7f57d400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:48.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57d37fe640 1 -- 172.21.15.55:0/828651055 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d400cea0 con 0x7f57dc156180 2023-07-06T22:20:48.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57d37fe640 1 -- 172.21.15.55:0/828651055 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d4003b80 con 0x7f57dc156180 2023-07-06T22:20:48.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57d37fe640 1 -- 172.21.15.55:0/828651055 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d400a850 con 0x7f57dc156180 2023-07-06T22:20:48.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.826+0000 7f57e0fd2640 1 -- 172.21.15.55:0/828651055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc0afb50 con 0x7f57dc156180 2023-07-06T22:20:48.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.830+0000 7f57e0fd2640 1 -- 172.21.15.55:0/828651055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc0b0110 con 0x7f57dc156180 2023-07-06T22:20:48.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.830+0000 7f57e0fd2640 1 -- 172.21.15.55:0/828651055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc0c82e0 con 0x7f57dc156180 2023-07-06T22:20:48.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.830+0000 7f57d37fe640 1 -- 172.21.15.55:0/828651055 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 113) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f57d400a9b0 con 0x7f57dc156180 2023-07-06T22:20:48.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.830+0000 7f57d37fe640 1 -- 172.21.15.55:0/828651055 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 7141+0+0 (secure 0 0 0) 0x7f57d4083e00 con 0x7f57dc156180 2023-07-06T22:20:48.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.834+0000 7f57d37fe640 1 -- 172.21.15.55:0/828651055 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f57d40512d0 con 0x7f57dc156180 2023-07-06T22:20:48.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.986+0000 7f57e0fd2640 1 -- 172.21.15.55:0/828651055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f57dc066d60 con 0x7f57dc156180 2023-07-06T22:20:48.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.990+0000 7f57d37fe640 1 -- 172.21.15.55:0/828651055 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v198) v1 ==== 100+0+11 (secure 0 0 0) 0x7f57d403a020 con 0x7f57dc156180 2023-07-06T22:20:48.992 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-07-06T22:20:48.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.990+0000 7f57e0fd2640 1 -- 172.21.15.55:0/828651055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57dc156180 msgr2=0x7f57dc14f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.990+0000 7f57e0fd2640 1 --2- 172.21.15.55:0/828651055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57dc156180 0x7f57dc14f4d0 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7f57d400c790 tx=0x7f57d400cc50 comp rx=0 tx=0).stop 2023-07-06T22:20:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.990+0000 7f57e0fd2640 1 -- 172.21.15.55:0/828651055 shutdown_connections 2023-07-06T22:20:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.990+0000 7f57e0fd2640 1 --2- 172.21.15.55:0/828651055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57dc156180 0x7f57dc14f4d0 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.990+0000 7f57e0fd2640 1 --2- 172.21.15.55:0/828651055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57dc0cb7a0 0x7f57dc0b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.990+0000 7f57e0fd2640 1 --2- 172.21.15.55:0/828651055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57dc06f0e0 0x7f57dc0c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.990+0000 7f57e0fd2640 1 -- 172.21.15.55:0/828651055 >> 172.21.15.55:0/828651055 conn(0x7f57dc0d0c50 msgr2=0x7f57dc06e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.990+0000 7f57e0fd2640 1 -- 172.21.15.55:0/828651055 shutdown_connections 2023-07-06T22:20:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:48.990+0000 7f57e0fd2640 1 -- 172.21.15.55:0/828651055 wait complete. 2023-07-06T22:20:49.012 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:20:49.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.150+0000 7f2373dd2640 1 Processor -- start 2023-07-06T22:20:49.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.150+0000 7f2373dd2640 1 -- start start 2023-07-06T22:20:49.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2373dd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f236c06a400 0x7f236c0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2373dd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236c06bd00 con 0x7f236c160030 2023-07-06T22:20:49.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2373dd2640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236c0c9ba0 con 0x7f236c0cd330 2023-07-06T22:20:49.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2373dd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c160400 con 0x7f236c06a400 2023-07-06T22:20:49.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2371b6e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f236c160030 0x7f236c070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56980/0 (socket says 172.21.15.55:56980) 2023-07-06T22:20:49.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2371b6e640 1 -- 172.21.15.55:0/3553469437 learned_addr learned my addr 172.21.15.55:0/3553469437 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:49.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f237236f640 1 --2- 172.21.15.55:0/3553469437 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f236c06a400 0x7f236c0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 -- 172.21.15.55:0/3553469437 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594552051 0 0) 0x7f236c06bd00 con 0x7f236c160030 2023-07-06T22:20:49.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 -- 172.21.15.55:0/3553469437 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2358003530 con 0x7f236c160030 2023-07-06T22:20:49.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 -- 172.21.15.55:0/3553469437 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3373649219 0 0) 0x7f2358003530 con 0x7f236c160030 2023-07-06T22:20:49.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 -- 172.21.15.55:0/3553469437 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f236c06a400 msgr2=0x7f236c0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:49.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 --2- 172.21.15.55:0/3553469437 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f236c06a400 0x7f236c0cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 -- 172.21.15.55:0/3553469437 >> v1:172.21.15.138:6789/0 conn(0x7f236c0cd330 legacy=0x7f236c0cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 -- 172.21.15.55:0/3553469437 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c071540 con 0x7f236c160030 2023-07-06T22:20:49.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 -- 172.21.15.55:0/3553469437 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f2368001680 con 0x7f236c160030 2023-07-06T22:20:49.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 -- 172.21.15.55:0/3553469437 >> v1:172.21.15.55:6789/0 conn(0x7f236c160030 legacy=0x7f236c070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 --2- 172.21.15.55:0/3553469437 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23580039b0 0x7f2358003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 --2- 172.21.15.55:0/3553469437 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2358004300 0x7f23580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 --2- 172.21.15.55:0/3553469437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2358004fd0 0x7f235800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 -- 172.21.15.55:0/3553469437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c160400 con 0x7f2358004fd0 2023-07-06T22:20:49.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 -- 172.21.15.55:0/3553469437 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235800bed0 con 0x7f2358004300 2023-07-06T22:20:49.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2370b6c640 1 -- 172.21.15.55:0/3553469437 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235800c090 con 0x7f23580039b0 2023-07-06T22:20:49.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f237236f640 1 --2- 172.21.15.55:0/3553469437 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f236c06a400 0x7f236c0cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:49.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2371b6e640 1 --2- 172.21.15.55:0/3553469437 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23580039b0 0x7f2358003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f237236f640 1 --2- 172.21.15.55:0/3553469437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2358004fd0 0x7f235800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f237136d640 1 --2- 172.21.15.55:0/3553469437 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2358004300 0x7f23580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f237236f640 1 -- 172.21.15.55:0/3553469437 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23580039b0 msgr2=0x7f2358003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f237236f640 1 --2- 172.21.15.55:0/3553469437 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23580039b0 0x7f2358003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f237236f640 1 -- 172.21.15.55:0/3553469437 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2358004300 msgr2=0x7f23580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f237236f640 1 --2- 172.21.15.55:0/3553469437 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2358004300 0x7f23580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f237236f640 1 -- 172.21.15.55:0/3553469437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2358003530 con 0x7f2358004fd0 2023-07-06T22:20:49.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.154+0000 7f2371b6e640 1 --2- 172.21.15.55:0/3553469437 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23580039b0 0x7f2358003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:49.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.158+0000 7f237236f640 1 --2- 172.21.15.55:0/3553469437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2358004fd0 0x7f235800b990 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7f236c06af50 tx=0x7f236401cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe6d080f56c0351 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:49.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.158+0000 7f2370b6c640 1 -- 172.21.15.55:0/3553469437 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364003c60 con 0x7f2358004fd0 2023-07-06T22:20:49.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.158+0000 7f2370b6c640 1 -- 172.21.15.55:0/3553469437 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236400f040 con 0x7f2358004fd0 2023-07-06T22:20:49.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.158+0000 7f2370b6c640 1 -- 172.21.15.55:0/3553469437 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364004030 con 0x7f2358004fd0 2023-07-06T22:20:49.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.158+0000 7f2373dd2640 1 -- 172.21.15.55:0/3553469437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2358004fd0 msgr2=0x7f235800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.158+0000 7f2373dd2640 1 --2- 172.21.15.55:0/3553469437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2358004fd0 0x7f235800b990 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7f236c06af50 tx=0x7f236401cce0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.158+0000 7f237236f640 1 -- 172.21.15.55:0/3553469437 reap_dead start 2023-07-06T22:20:49.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.158+0000 7f2373dd2640 1 -- 172.21.15.55:0/3553469437 shutdown_connections 2023-07-06T22:20:49.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.158+0000 7f2373dd2640 1 -- 172.21.15.55:0/3553469437 >> 172.21.15.55:0/3553469437 conn(0x7f236c0cded0 msgr2=0x7f236c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:49.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.158+0000 7f2373dd2640 1 -- 172.21.15.55:0/3553469437 shutdown_connections 2023-07-06T22:20:49.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.158+0000 7f2373dd2640 1 -- 172.21.15.55:0/3553469437 wait complete. 2023-07-06T22:20:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f2373dd2640 1 Processor -- start 2023-07-06T22:20:49.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f2373dd2640 1 -- start start 2023-07-06T22:20:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f2373dd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2358004fd0 0x7f236c0c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f2373dd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f236c0b1730 0x7f236c1590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f2373dd2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f236c0b3100 0x7f236c0b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f2373dd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0c5e30 con 0x7f236c0b1730 2023-07-06T22:20:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f2373dd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0c5ae0 con 0x7f2358004fd0 2023-07-06T22:20:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f2373dd2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c15a240 con 0x7f236c0b3100 2023-07-06T22:20:49.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f237136d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f236c0b1730 0x7f236c1590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f237136d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f236c0b1730 0x7f236c1590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33788/0 (socket says 172.21.15.55:33788) 2023-07-06T22:20:49.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f237136d640 1 -- 172.21.15.55:0/3934548759 learned_addr learned my addr 172.21.15.55:0/3934548759 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:49.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f237236f640 1 --2- 172.21.15.55:0/3934548759 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f236c0b3100 0x7f236c0b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f2371b6e640 1 --2- 172.21.15.55:0/3934548759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2358004fd0 0x7f236c0c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f237136d640 1 -- 172.21.15.55:0/3934548759 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f236c0b3100 msgr2=0x7f236c0b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f237136d640 1 --2- 172.21.15.55:0/3934548759 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f236c0b3100 0x7f236c0b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f237136d640 1 -- 172.21.15.55:0/3934548759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2358004fd0 msgr2=0x7f236c0c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f237136d640 1 --2- 172.21.15.55:0/3934548759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2358004fd0 0x7f236c0c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f237136d640 1 -- 172.21.15.55:0/3934548759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c0b1ca0 con 0x7f236c0b1730 2023-07-06T22:20:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f237136d640 1 --2- 172.21.15.55:0/3934548759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f236c0b1730 0x7f236c1590e0 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7f235c00f830 tx=0x7f235c00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f23627fc640 1 -- 172.21.15.55:0/3934548759 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00fe80 con 0x7f236c0b1730 2023-07-06T22:20:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f23627fc640 1 -- 172.21.15.55:0/3934548759 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c0052e0 con 0x7f236c0b1730 2023-07-06T22:20:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f23627fc640 1 -- 172.21.15.55:0/3934548759 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00d910 con 0x7f236c0b1730 2023-07-06T22:20:49.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f2373dd2640 1 -- 172.21.15.55:0/3934548759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236c0b10d0 con 0x7f236c0b1730 2023-07-06T22:20:49.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f2373dd2640 1 -- 172.21.15.55:0/3934548759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236c0b3ab0 con 0x7f236c0b1730 2023-07-06T22:20:49.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.162+0000 7f2373dd2640 1 -- 172.21.15.55:0/3934548759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236c0b1580 con 0x7f236c0b1730 2023-07-06T22:20:49.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.166+0000 7f23627fc640 1 -- 172.21.15.55:0/3934548759 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 113) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f235c00da70 con 0x7f236c0b1730 2023-07-06T22:20:49.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.166+0000 7f23627fc640 1 -- 172.21.15.55:0/3934548759 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 7141+0+0 (secure 0 0 0) 0x7f235c083ba0 con 0x7f236c0b1730 2023-07-06T22:20:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.170+0000 7f23627fc640 1 -- 172.21.15.55:0/3934548759 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f235c050f40 con 0x7f236c0b1730 2023-07-06T22:20:49.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.306+0000 7f23627fc640 1 -- 172.21.15.55:0/3934548759 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 114) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f235c00dd20 con 0x7f236c0b1730 2023-07-06T22:20:49.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.306+0000 7f23627fc640 1 --2- 172.21.15.55:0/3934548759 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f235006c6b0 0x7f235006ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.306+0000 7f2371b6e640 1 --2- 172.21.15.55:0/3934548759 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f235006c6b0 0x7f235006ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.310+0000 7f2371b6e640 1 --2- 172.21.15.55:0/3934548759 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f235006c6b0 0x7f235006ea90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2368000fe0 tx=0x7f23680047f0 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:49.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.370+0000 7f2373dd2640 1 -- 172.21.15.55:0/3934548759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f236c066d60 con 0x7f236c0b1730 2023-07-06T22:20:49.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.370+0000 7f23627fc640 1 -- 172.21.15.55:0/3934548759 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4687 (secure 0 0 0) 0x7f235c080ee0 con 0x7f236c0b1730 2023-07-06T22:20:49.374 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:49.374 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":87,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2023670167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2023670167},{"type":"v1","addr":"172.21.15.138:6834","nonce":2023670167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":10989,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2906978966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2906978966},{"type":"v1","addr":"172.21.15.55:6836","nonce":2906978966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":10992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1643276481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1643276481},{"type":"v1","addr":"172.21.15.55:6837","nonce":1643276481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:20:23.728829+0000","modified":"2023-07-06T22:20:27.126611+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11001":{"gid":11001,"name":"d","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6835/3113237921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3113237921},{"type":"v1","addr":"172.21.15.138:6835","nonce":3113237921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-06T22:20:49.375 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 87 2023-07-06T22:20:49.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.374+0000 7f2373dd2640 1 -- 172.21.15.55:0/3934548759 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f235006c6b0 msgr2=0x7f235006ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.374+0000 7f2373dd2640 1 --2- 172.21.15.55:0/3934548759 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f235006c6b0 0x7f235006ea90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2368000fe0 tx=0x7f23680047f0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.374+0000 7f2373dd2640 1 -- 172.21.15.55:0/3934548759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f236c0b1730 msgr2=0x7f236c1590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.374+0000 7f2373dd2640 1 --2- 172.21.15.55:0/3934548759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f236c0b1730 0x7f236c1590e0 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7f235c00f830 tx=0x7f235c00fc30 comp rx=0 tx=0).stop 2023-07-06T22:20:49.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.374+0000 7f2373dd2640 1 -- 172.21.15.55:0/3934548759 shutdown_connections 2023-07-06T22:20:49.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.374+0000 7f2373dd2640 1 --2- 172.21.15.55:0/3934548759 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f235006c6b0 0x7f235006ea90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.374+0000 7f2373dd2640 1 --2- 172.21.15.55:0/3934548759 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f236c0b3100 0x7f236c0b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.374+0000 7f2373dd2640 1 --2- 172.21.15.55:0/3934548759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f236c0b1730 0x7f236c1590e0 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.374+0000 7f2373dd2640 1 --2- 172.21.15.55:0/3934548759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2358004fd0 0x7f236c0c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.374+0000 7f2373dd2640 1 -- 172.21.15.55:0/3934548759 >> 172.21.15.55:0/3934548759 conn(0x7f236c0cded0 msgr2=0x7f236c0ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:49.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.374+0000 7f2373dd2640 1 -- 172.21.15.55:0/3934548759 shutdown_connections 2023-07-06T22:20:49.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.374+0000 7f2373dd2640 1 -- 172.21.15.55:0/3934548759 wait complete. 2023-07-06T22:20:49.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:20:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.534+0000 7f19c5b74640 1 Processor -- start 2023-07-06T22:20:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.534+0000 7f19c5b74640 1 -- start start 2023-07-06T22:20:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19c5b74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c0158400 0x7f19c00c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19c5b74640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f19c00c9680 0x7f19c0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19c5b74640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c006fae0 con 0x7f19c00710c0 2023-07-06T22:20:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19c5b74640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c006fdc0 con 0x7f19c00c9680 2023-07-06T22:20:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19c5b74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00700a0 con 0x7f19c0158400 2023-07-06T22:20:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19bffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f19c00710c0 0x7f19c00cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56984/0 (socket says 172.21.15.55:56984) 2023-07-06T22:20:49.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19bffff640 1 -- 172.21.15.55:0/1388944189 learned_addr learned my addr 172.21.15.55:0/1388944189 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:49.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19bf7fe640 1 --2- 172.21.15.55:0/1388944189 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c0158400 0x7f19c00c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19beffd640 1 --2- 172.21.15.55:0/1388944189 >> v2:172.21.15.138:3300/0 conn(0x7f19c00c9680 0x7f19c0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19be7fc640 1 -- 172.21.15.55:0/1388944189 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217797870 0 0) 0x7f19c006fae0 con 0x7f19c00710c0 2023-07-06T22:20:49.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19be7fc640 1 -- 172.21.15.55:0/1388944189 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a8003530 con 0x7f19c00710c0 2023-07-06T22:20:49.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19bf7fe640 1 -- 172.21.15.55:0/1388944189 >> v2:172.21.15.138:3300/0 conn(0x7f19c00c9680 msgr2=0x7f19c0070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:49.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19bf7fe640 1 --2- 172.21.15.55:0/1388944189 >> v2:172.21.15.138:3300/0 conn(0x7f19c00c9680 0x7f19c0070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19bf7fe640 1 -- 172.21.15.55:0/1388944189 >> v1:172.21.15.55:6789/0 conn(0x7f19c00710c0 legacy=0x7f19c00cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.538+0000 7f19bf7fe640 1 -- 172.21.15.55:0/1388944189 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c0070380 con 0x7f19c0158400 2023-07-06T22:20:49.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.542+0000 7f19bf7fe640 1 --2- 172.21.15.55:0/1388944189 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c0158400 0x7f19c00c9140 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f19b00097c0 tx=0x7f19b001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb7d6f66624674a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:49.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.542+0000 7f19be7fc640 1 -- 172.21.15.55:0/1388944189 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b00ab670 con 0x7f19c0158400 2023-07-06T22:20:49.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.542+0000 7f19be7fc640 1 -- 172.21.15.55:0/1388944189 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b00ab7d0 con 0x7f19c0158400 2023-07-06T22:20:49.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.542+0000 7f19be7fc640 1 -- 172.21.15.55:0/1388944189 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b00abb60 con 0x7f19c0158400 2023-07-06T22:20:49.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.542+0000 7f19c5b74640 1 -- 172.21.15.55:0/1388944189 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c0158400 msgr2=0x7f19c00c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.542+0000 7f19c5b74640 1 --2- 172.21.15.55:0/1388944189 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c0158400 0x7f19c00c9140 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f19b00097c0 tx=0x7f19b001c450 comp rx=0 tx=0).stop 2023-07-06T22:20:49.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.542+0000 7f19c5b74640 1 -- 172.21.15.55:0/1388944189 shutdown_connections 2023-07-06T22:20:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.542+0000 7f19c5b74640 1 --2- 172.21.15.55:0/1388944189 >> v2:172.21.15.138:3300/0 conn(0x7f19c00c9680 0x7f19c0070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.542+0000 7f19c5b74640 1 --2- 172.21.15.55:0/1388944189 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c0158400 0x7f19c00c9140 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.542+0000 7f19c5b74640 1 -- 172.21.15.55:0/1388944189 >> 172.21.15.55:0/1388944189 conn(0x7f19c00cded0 msgr2=0x7f19c00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.542+0000 7f19c5b74640 1 -- 172.21.15.55:0/1388944189 shutdown_connections 2023-07-06T22:20:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.542+0000 7f19c5b74640 1 -- 172.21.15.55:0/1388944189 wait complete. 2023-07-06T22:20:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.542+0000 7f19c5b74640 1 Processor -- start 2023-07-06T22:20:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.542+0000 7f19c5b74640 1 -- start start 2023-07-06T22:20:49.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19c5b74640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c00710c0 0x7f19c00c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19c5b74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c00c9680 0x7f19c01461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19c5b74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19c0158400 0x7f19c015bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19c5b74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c0162080 con 0x7f19c0158400 2023-07-06T22:20:49.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19c5b74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00c6540 con 0x7f19c00c9680 2023-07-06T22:20:49.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19c5b74640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c0161770 con 0x7f19c00710c0 2023-07-06T22:20:49.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19c0158400 0x7f19c015bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19c0158400 0x7f19c015bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33796/0 (socket says 172.21.15.55:33796) 2023-07-06T22:20:49.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19bffff640 1 -- 172.21.15.55:0/3473329182 learned_addr learned my addr 172.21.15.55:0/3473329182 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:49.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19bf7fe640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c00710c0 0x7f19c00c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19beffd640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c00c9680 0x7f19c01461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19bffff640 1 -- 172.21.15.55:0/3473329182 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c00710c0 msgr2=0x7f19c00c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19bffff640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c00710c0 0x7f19c00c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19bffff640 1 -- 172.21.15.55:0/3473329182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c00c9680 msgr2=0x7f19c01461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19bffff640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c00c9680 0x7f19c01461b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19bffff640 1 -- 172.21.15.55:0/3473329182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b0009420 con 0x7f19c0158400 2023-07-06T22:20:49.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19beffd640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c00c9680 0x7f19c01461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:20:49.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19bffff640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19c0158400 0x7f19c015bfb0 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7f19b800cb70 tx=0x7f19b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:49.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19a7fff640 1 -- 172.21.15.55:0/3473329182 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800ad40 con 0x7f19c0158400 2023-07-06T22:20:49.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19a7fff640 1 -- 172.21.15.55:0/3473329182 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b8012400 con 0x7f19c0158400 2023-07-06T22:20:49.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19c5b74640 1 -- 172.21.15.55:0/3473329182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c0155a80 con 0x7f19c0158400 2023-07-06T22:20:49.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19a7fff640 1 -- 172.21.15.55:0/3473329182 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800aea0 con 0x7f19c0158400 2023-07-06T22:20:49.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19c5b74640 1 -- 172.21.15.55:0/3473329182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c0161a30 con 0x7f19c0158400 2023-07-06T22:20:49.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19c5b74640 1 -- 172.21.15.55:0/3473329182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c006c580 con 0x7f19c0158400 2023-07-06T22:20:49.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.546+0000 7f19a7fff640 1 -- 172.21.15.55:0/3473329182 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 114) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f19b8007070 con 0x7f19c0158400 2023-07-06T22:20:49.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.550+0000 7f19a7fff640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f19ac0660d0 0x7f19ac068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.550+0000 7f19a7fff640 1 -- 172.21.15.55:0/3473329182 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 7141+0+0 (secure 0 0 0) 0x7f19b8083eb0 con 0x7f19c0158400 2023-07-06T22:20:49.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.550+0000 7f19bf7fe640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f19ac0660d0 0x7f19ac068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.550+0000 7f19bf7fe640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f19ac0660d0 0x7f19ac068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f19b00af000 tx=0x7f19b00a7000 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:49.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.554+0000 7f19a7fff640 1 -- 172.21.15.55:0/3473329182 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19b8051160 con 0x7f19c0158400 2023-07-06T22:20:49.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.710+0000 7f19c5b74640 1 -- 172.21.15.55:0/3473329182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19c0066d60 con 0x7f19c0158400 2023-07-06T22:20:49.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.710+0000 7f19a7fff640 1 -- 172.21.15.55:0/3473329182 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+19659 (secure 0 0 0) 0x7f19b8017020 con 0x7f19c0158400 2023-07-06T22:20:49.714 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:49.714 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":198,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:20:48.294310+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:20:21.647148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-07-06T22:20:22.723236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/1748099556":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/3699924180":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/1557240001":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/2892168105":"2023-07-07T22:20:48.294273+0000","172.21.15.55:6833/3861190779":"2023-07-07T22:20:48.294273+0000","172.21.15.55:6832/3861190779":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/2133543533":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/2070899305":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/3797237235":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/558674907":"2023-07-07T22:20:41.235643+0000","172.21.15.55:6833/538997467":"2023-07-07T22:20:41.235643+0000","172.21.15.55:6832/538997467":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/3471768092":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/2063199878":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/2431773305":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/237391926":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/3850725654":"2023-07-07T22:20:41.235643+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:20:49.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.714+0000 7f19c5b74640 1 -- 172.21.15.55:0/3473329182 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f19ac0660d0 msgr2=0x7f19ac068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.714+0000 7f19c5b74640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f19ac0660d0 0x7f19ac068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f19b00af000 tx=0x7f19b00a7000 comp rx=0 tx=0).stop 2023-07-06T22:20:49.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.714+0000 7f19c5b74640 1 -- 172.21.15.55:0/3473329182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19c0158400 msgr2=0x7f19c015bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.714+0000 7f19c5b74640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19c0158400 0x7f19c015bfb0 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7f19b800cb70 tx=0x7f19b800a430 comp rx=0 tx=0).stop 2023-07-06T22:20:49.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.714+0000 7f19c5b74640 1 -- 172.21.15.55:0/3473329182 shutdown_connections 2023-07-06T22:20:49.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.714+0000 7f19c5b74640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f19ac0660d0 0x7f19ac068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.714+0000 7f19c5b74640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19c0158400 0x7f19c015bfb0 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.714+0000 7f19c5b74640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19c00c9680 0x7f19c01461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.714+0000 7f19c5b74640 1 --2- 172.21.15.55:0/3473329182 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19c00710c0 0x7f19c00c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.714+0000 7f19c5b74640 1 -- 172.21.15.55:0/3473329182 >> 172.21.15.55:0/3473329182 conn(0x7f19c00cded0 msgr2=0x7f19c0065190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:49.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.714+0000 7f19c5b74640 1 -- 172.21.15.55:0/3473329182 shutdown_connections 2023-07-06T22:20:49.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.714+0000 7f19c5b74640 1 -- 172.21.15.55:0/3473329182 wait complete. 2023-07-06T22:20:49.735 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T22:20:49.736 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:20:49.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.874+0000 7fc608bfa640 1 Processor -- start 2023-07-06T22:20:49.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.874+0000 7fc608bfa640 1 -- start start 2023-07-06T22:20:49.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc608bfa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc60415b7e0 0x7fc6040cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc608bfa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc604160300 0x7fc6040c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc608bfa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc6040c8a60 0x7fc60406b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc608bfa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6040cdc80 con 0x7fc60415b7e0 2023-07-06T22:20:49.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc608bfa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6040cd6c0 con 0x7fc6040c8a60 2023-07-06T22:20:49.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc608bfa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040cd9a0 con 0x7fc604160300 2023-07-06T22:20:49.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc60259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc60415b7e0 0x7fc6040cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc60259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc60415b7e0 0x7fc6040cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33800/0 (socket says 172.21.15.55:33800) 2023-07-06T22:20:49.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc60259c640 1 -- 172.21.15.55:0/4027841744 learned_addr learned my addr 172.21.15.55:0/4027841744 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:49.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc602d9d640 1 --2- 172.21.15.55:0/4027841744 >> v2:172.21.15.138:3300/0 conn(0x7fc6040c8a60 0x7fc60406b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc5fbfff640 1 --2- 172.21.15.55:0/4027841744 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc604160300 0x7fc6040c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc60259c640 1 -- 172.21.15.55:0/4027841744 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc604160300 msgr2=0x7fc6040c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:49.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc60259c640 1 --2- 172.21.15.55:0/4027841744 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc604160300 0x7fc6040c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc60259c640 1 -- 172.21.15.55:0/4027841744 >> v2:172.21.15.138:3300/0 conn(0x7fc6040c8a60 msgr2=0x7fc60406b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:49.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc60259c640 1 --2- 172.21.15.55:0/4027841744 >> v2:172.21.15.138:3300/0 conn(0x7fc6040c8a60 0x7fc60406b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.878+0000 7fc60259c640 1 -- 172.21.15.55:0/4027841744 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604069490 con 0x7fc60415b7e0 2023-07-06T22:20:49.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc60259c640 1 --2- 172.21.15.55:0/4027841744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc60415b7e0 0x7fc6040cbaa0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fc6040cefa0 tx=0x7fc5f401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3448b37fd0df1bee server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:49.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc601d9b640 1 -- 172.21.15.55:0/4027841744 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40ac600 con 0x7fc60415b7e0 2023-07-06T22:20:49.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc601d9b640 1 -- 172.21.15.55:0/4027841744 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f40a8050 con 0x7fc60415b7e0 2023-07-06T22:20:49.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc601d9b640 1 -- 172.21.15.55:0/4027841744 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40ac980 con 0x7fc60415b7e0 2023-07-06T22:20:49.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc608bfa640 1 -- 172.21.15.55:0/4027841744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc60415b7e0 msgr2=0x7fc6040cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc608bfa640 1 --2- 172.21.15.55:0/4027841744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc60415b7e0 0x7fc6040cbaa0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fc6040cefa0 tx=0x7fc5f401c4d0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc608bfa640 1 -- 172.21.15.55:0/4027841744 shutdown_connections 2023-07-06T22:20:49.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc608bfa640 1 --2- 172.21.15.55:0/4027841744 >> v2:172.21.15.138:3300/0 conn(0x7fc6040c8a60 0x7fc60406b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc608bfa640 1 --2- 172.21.15.55:0/4027841744 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc604160300 0x7fc6040c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc608bfa640 1 --2- 172.21.15.55:0/4027841744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc60415b7e0 0x7fc6040cbaa0 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc608bfa640 1 -- 172.21.15.55:0/4027841744 >> 172.21.15.55:0/4027841744 conn(0x7fc6040cded0 msgr2=0x7fc6040ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:49.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc608bfa640 1 -- 172.21.15.55:0/4027841744 shutdown_connections 2023-07-06T22:20:49.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc608bfa640 1 -- 172.21.15.55:0/4027841744 wait complete. 2023-07-06T22:20:49.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc608bfa640 1 Processor -- start 2023-07-06T22:20:49.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.882+0000 7fc608bfa640 1 -- start start 2023-07-06T22:20:49.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc608bfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040c8a60 0x7fc6040c2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc608bfa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc60415b7e0 0x7fc604156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc608bfa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc604160300 0x7fc6040b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc608bfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6041574e0 con 0x7fc6040c8a60 2023-07-06T22:20:49.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc608bfa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040c7c80 con 0x7fc604160300 2023-07-06T22:20:49.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc608bfa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040b32d0 con 0x7fc60415b7e0 2023-07-06T22:20:49.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc60259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040c8a60 0x7fc6040c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc60259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040c8a60 0x7fc6040c2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33806/0 (socket says 172.21.15.55:33806) 2023-07-06T22:20:49.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc60259c640 1 -- 172.21.15.55:0/889199969 learned_addr learned my addr 172.21.15.55:0/889199969 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:49.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc5fbfff640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc60415b7e0 0x7fc604156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc602d9d640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc604160300 0x7fc6040b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc60259c640 1 -- 172.21.15.55:0/889199969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc60415b7e0 msgr2=0x7fc604156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc60259c640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc60415b7e0 0x7fc604156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc60259c640 1 -- 172.21.15.55:0/889199969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc604160300 msgr2=0x7fc6040b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:49.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc60259c640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc604160300 0x7fc6040b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:49.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc60259c640 1 -- 172.21.15.55:0/889199969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f40094d0 con 0x7fc6040c8a60 2023-07-06T22:20:49.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc602d9d640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc604160300 0x7fc6040b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:49.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc60259c640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040c8a60 0x7fc6040c2110 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fc5f401cd70 tx=0x7fc5f401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:49.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc5faffd640 1 -- 172.21.15.55:0/889199969 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40bc070 con 0x7fc6040c8a60 2023-07-06T22:20:49.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc5faffd640 1 -- 172.21.15.55:0/889199969 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f40ace90 con 0x7fc6040c8a60 2023-07-06T22:20:49.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc5faffd640 1 -- 172.21.15.55:0/889199969 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40b7670 con 0x7fc6040c8a60 2023-07-06T22:20:49.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc608bfa640 1 -- 172.21.15.55:0/889199969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6040b35b0 con 0x7fc6040c8a60 2023-07-06T22:20:49.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc608bfa640 1 -- 172.21.15.55:0/889199969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6040b3b70 con 0x7fc6040c8a60 2023-07-06T22:20:49.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc608bfa640 1 -- 172.21.15.55:0/889199969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc604066d60 con 0x7fc6040c8a60 2023-07-06T22:20:49.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.886+0000 7fc5faffd640 1 -- 172.21.15.55:0/889199969 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 114) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fc5f40b3070 con 0x7fc6040c8a60 2023-07-06T22:20:49.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.890+0000 7fc5faffd640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fc5e40660d0 0x7fc5e4068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:49.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.890+0000 7fc5faffd640 1 -- 172.21.15.55:0/889199969 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 7141+0+0 (secure 0 0 0) 0x7fc5f411d670 con 0x7fc6040c8a60 2023-07-06T22:20:49.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.890+0000 7fc5fbfff640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fc5e40660d0 0x7fc5e4068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:49.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.890+0000 7fc5fbfff640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fc5e40660d0 0x7fc5e4068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc6040ceff0 tx=0x7fc5ec008040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:49.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:49.894+0000 7fc5faffd640 1 -- 172.21.15.55:0/889199969 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc5f40ea920 con 0x7fc6040c8a60 2023-07-06T22:20:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.082+0000 7fc608bfa640 1 -- 172.21.15.55:0/889199969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc60406c4f0 con 0x7fc6040c8a60 2023-07-06T22:20:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.082+0000 7fc5faffd640 1 -- 172.21.15.55:0/889199969 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4687 (secure 0 0 0) 0x7fc5f40edf40 con 0x7fc6040c8a60 2023-07-06T22:20:50.085 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:50.085 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":87,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2023670167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2023670167},{"type":"v1","addr":"172.21.15.138:6834","nonce":2023670167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":10989,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2906978966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2906978966},{"type":"v1","addr":"172.21.15.55:6836","nonce":2906978966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":10992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1643276481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1643276481},{"type":"v1","addr":"172.21.15.55:6837","nonce":1643276481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:20:23.728829+0000","modified":"2023-07-06T22:20:27.126611+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11001":{"gid":11001,"name":"d","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6835/3113237921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3113237921},{"type":"v1","addr":"172.21.15.138:6835","nonce":3113237921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-06T22:20:50.085 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 87 2023-07-06T22:20:50.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.082+0000 7fc608bfa640 1 -- 172.21.15.55:0/889199969 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fc5e40660d0 msgr2=0x7fc5e4068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.082+0000 7fc608bfa640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fc5e40660d0 0x7fc5e4068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc6040ceff0 tx=0x7fc5ec008040 comp rx=0 tx=0).stop 2023-07-06T22:20:50.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.082+0000 7fc608bfa640 1 -- 172.21.15.55:0/889199969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040c8a60 msgr2=0x7fc6040c2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.082+0000 7fc608bfa640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040c8a60 0x7fc6040c2110 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fc5f401cd70 tx=0x7fc5f401ad10 comp rx=0 tx=0).stop 2023-07-06T22:20:50.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.082+0000 7fc608bfa640 1 -- 172.21.15.55:0/889199969 shutdown_connections 2023-07-06T22:20:50.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.082+0000 7fc608bfa640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fc5e40660d0 0x7fc5e4068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.082+0000 7fc608bfa640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc604160300 0x7fc6040b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.082+0000 7fc608bfa640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc60415b7e0 0x7fc604156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.082+0000 7fc608bfa640 1 --2- 172.21.15.55:0/889199969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6040c8a60 0x7fc6040c2110 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.082+0000 7fc608bfa640 1 -- 172.21.15.55:0/889199969 >> 172.21.15.55:0/889199969 conn(0x7fc6040cded0 msgr2=0x7fc6040ad1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:50.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.082+0000 7fc608bfa640 1 -- 172.21.15.55:0/889199969 shutdown_connections 2023-07-06T22:20:50.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.082+0000 7fc608bfa640 1 -- 172.21.15.55:0/889199969 wait complete. 2023-07-06T22:20:50.106 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:20:50.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f22968d8640 1 Processor -- start 2023-07-06T22:20:50.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f22968d8640 1 -- start start 2023-07-06T22:20:50.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f22968d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f229015b9d0 0x7f229015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f22968d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229006a160 con 0x7f22900b4420 2023-07-06T22:20:50.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f22968d8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229015bda0 con 0x7f22900ce340 2023-07-06T22:20:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f22968d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2290069590 con 0x7f229015b9d0 2023-07-06T22:20:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f2294e75640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f22900b4420 0x7f229015c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56990/0 (socket says 172.21.15.55:56990) 2023-07-06T22:20:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f2294e75640 1 -- 172.21.15.55:0/3119571102 learned_addr learned my addr 172.21.15.55:0/3119571102 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f228ffff640 1 --2- 172.21.15.55:0/3119571102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f229015b9d0 0x7f229015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202413823 0 0) 0x7f229006a160 con 0x7f22900b4420 2023-07-06T22:20:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2278003530 con 0x7f22900b4420 2023-07-06T22:20:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278375791 0 0) 0x7f229015bda0 con 0x7f22900ce340 2023-07-06T22:20:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f229006a160 con 0x7f22900ce340 2023-07-06T22:20:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2243073257 0 0) 0x7f2278003530 con 0x7f22900b4420 2023-07-06T22:20:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f229015b9d0 msgr2=0x7f229015f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f228effd640 1 --2- 172.21.15.55:0/3119571102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f229015b9d0 0x7f229015f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 >> v1:172.21.15.138:6789/0 conn(0x7f22900ce340 legacy=0x7f22900b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2290069830 con 0x7f22900b4420 2023-07-06T22:20:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f2288001a00 con 0x7f22900b4420 2023-07-06T22:20:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.246+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 >> v1:172.21.15.55:6789/0 conn(0x7f22900b4420 legacy=0x7f229015c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f228effd640 1 --2- 172.21.15.55:0/3119571102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2278003b40 0x7f2278003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f228effd640 1 --2- 172.21.15.55:0/3119571102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f229015b9d0 0x7f22780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f228effd640 1 --2- 172.21.15.55:0/3119571102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2278004d10 0x7f2278005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2290069590 con 0x7f2278004d10 2023-07-06T22:20:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227800b990 con 0x7f2278003b40 2023-07-06T22:20:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227800bb20 con 0x7f229015b9d0 2023-07-06T22:20:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f2294e75640 1 --2- 172.21.15.55:0/3119571102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2278004d10 0x7f2278005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f228ffff640 1 --2- 172.21.15.55:0/3119571102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2278003b40 0x7f2278003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f228f7fe640 1 --2- 172.21.15.55:0/3119571102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f229015b9d0 0x7f22780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f2294e75640 1 -- 172.21.15.55:0/3119571102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f229015b9d0 msgr2=0x7f22780047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f2294e75640 1 --2- 172.21.15.55:0/3119571102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f229015b9d0 0x7f22780047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f2294e75640 1 -- 172.21.15.55:0/3119571102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2278003b40 msgr2=0x7f2278003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f2294e75640 1 --2- 172.21.15.55:0/3119571102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2278003b40 0x7f2278003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f2294e75640 1 -- 172.21.15.55:0/3119571102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2278003530 con 0x7f2278004d10 2023-07-06T22:20:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f2294e75640 1 --2- 172.21.15.55:0/3119571102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2278004d10 0x7f2278005180 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f22900b4860 tx=0x7f228801f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b1b6a9e1da90a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22880ac650 con 0x7f2278004d10 2023-07-06T22:20:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22880ac7b0 con 0x7f2278004d10 2023-07-06T22:20:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.250+0000 7f228effd640 1 -- 172.21.15.55:0/3119571102 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22880acb60 con 0x7f2278004d10 2023-07-06T22:20:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f22968d8640 1 -- 172.21.15.55:0/3119571102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2278004d10 msgr2=0x7f2278005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f22968d8640 1 --2- 172.21.15.55:0/3119571102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2278004d10 0x7f2278005180 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f22900b4860 tx=0x7f228801f9a0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f2294e75640 1 -- 172.21.15.55:0/3119571102 reap_dead start 2023-07-06T22:20:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f22968d8640 1 -- 172.21.15.55:0/3119571102 shutdown_connections 2023-07-06T22:20:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f22968d8640 1 -- 172.21.15.55:0/3119571102 >> 172.21.15.55:0/3119571102 conn(0x7f22900ced10 msgr2=0x7f22900cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f22968d8640 1 -- 172.21.15.55:0/3119571102 shutdown_connections 2023-07-06T22:20:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f22968d8640 1 -- 172.21.15.55:0/3119571102 wait complete. 2023-07-06T22:20:50.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f22968d8640 1 Processor -- start 2023-07-06T22:20:50.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f22968d8640 1 -- start start 2023-07-06T22:20:50.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f22968d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2278004d10 0x7f22900c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f22968d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22900cb240 0x7f22901f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f22968d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22901f4b20 0x7f2290154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f22968d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22901f4fc0 con 0x7f2278004d10 2023-07-06T22:20:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f22968d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22900c9cd0 con 0x7f22901f4b20 2023-07-06T22:20:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f22968d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22900c9fb0 con 0x7f22900cb240 2023-07-06T22:20:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f228ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2278004d10 0x7f22900c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f228ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2278004d10 0x7f22900c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33824/0 (socket says 172.21.15.55:33824) 2023-07-06T22:20:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f228ffff640 1 -- 172.21.15.55:0/125735930 learned_addr learned my addr 172.21.15.55:0/125735930 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:50.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f2294e75640 1 --2- 172.21.15.55:0/125735930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22901f4b20 0x7f2290154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.254+0000 7f228f7fe640 1 --2- 172.21.15.55:0/125735930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22900cb240 0x7f22901f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f228ffff640 1 -- 172.21.15.55:0/125735930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22900cb240 msgr2=0x7f22901f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f228ffff640 1 --2- 172.21.15.55:0/125735930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22900cb240 0x7f22901f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f228ffff640 1 -- 172.21.15.55:0/125735930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22901f4b20 msgr2=0x7f2290154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f228ffff640 1 --2- 172.21.15.55:0/125735930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22901f4b20 0x7f2290154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f228ffff640 1 -- 172.21.15.55:0/125735930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22900ca290 con 0x7f2278004d10 2023-07-06T22:20:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f228ffff640 1 --2- 172.21.15.55:0/125735930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2278004d10 0x7f22900c9360 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7f22800119d0 tx=0x7f2280011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f228cff9640 1 -- 172.21.15.55:0/125735930 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228000fb50 con 0x7f2278004d10 2023-07-06T22:20:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f228cff9640 1 -- 172.21.15.55:0/125735930 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228000fcb0 con 0x7f2278004d10 2023-07-06T22:20:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f22968d8640 1 -- 172.21.15.55:0/125735930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22900ca570 con 0x7f2278004d10 2023-07-06T22:20:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f228cff9640 1 -- 172.21.15.55:0/125735930 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280014440 con 0x7f2278004d10 2023-07-06T22:20:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f22968d8640 1 -- 172.21.15.55:0/125735930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22900c98a0 con 0x7f2278004d10 2023-07-06T22:20:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f22968d8640 1 -- 172.21.15.55:0/125735930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2290066d60 con 0x7f2278004d10 2023-07-06T22:20:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f228cff9640 1 -- 172.21.15.55:0/125735930 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 114) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f228001d400 con 0x7f2278004d10 2023-07-06T22:20:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f228cff9640 1 --2- 172.21.15.55:0/125735930 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f227c0660d0 0x7f227c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.258+0000 7f228cff9640 1 -- 172.21.15.55:0/125735930 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 7141+0+0 (secure 0 0 0) 0x7f22800847b0 con 0x7f2278004d10 2023-07-06T22:20:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.262+0000 7f228f7fe640 1 --2- 172.21.15.55:0/125735930 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f227c0660d0 0x7f227c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.262+0000 7f228f7fe640 1 --2- 172.21.15.55:0/125735930 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f227c0660d0 0x7f227c068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f22900cb610 tx=0x7f2284009040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:50.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.266+0000 7f228cff9640 1 -- 172.21.15.55:0/125735930 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2280051b20 con 0x7f2278004d10 2023-07-06T22:20:50.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.454+0000 7f22968d8640 1 -- 172.21.15.55:0/125735930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f229006ac10 con 0x7f2278004d10 2023-07-06T22:20:50.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.454+0000 7f228cff9640 1 -- 172.21.15.55:0/125735930 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4687 (secure 0 0 0) 0x7f2280055140 con 0x7f2278004d10 2023-07-06T22:20:50.458 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:50.458 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":87,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2023670167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2023670167},{"type":"v1","addr":"172.21.15.138:6834","nonce":2023670167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":10989,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2906978966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2906978966},{"type":"v1","addr":"172.21.15.55:6836","nonce":2906978966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":10992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1643276481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1643276481},{"type":"v1","addr":"172.21.15.55:6837","nonce":1643276481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T22:20:23.728829+0000","modified":"2023-07-06T22:20:27.126611+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11001},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11001":{"gid":11001,"name":"d","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.138:6835/3113237921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":3113237921},{"type":"v1","addr":"172.21.15.138:6835","nonce":3113237921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-06T22:20:50.458 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 87 2023-07-06T22:20:50.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.454+0000 7f22968d8640 1 -- 172.21.15.55:0/125735930 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f227c0660d0 msgr2=0x7f227c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.454+0000 7f22968d8640 1 --2- 172.21.15.55:0/125735930 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f227c0660d0 0x7f227c068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f22900cb610 tx=0x7f2284009040 comp rx=0 tx=0).stop 2023-07-06T22:20:50.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.454+0000 7f22968d8640 1 -- 172.21.15.55:0/125735930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2278004d10 msgr2=0x7f22900c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.454+0000 7f22968d8640 1 --2- 172.21.15.55:0/125735930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2278004d10 0x7f22900c9360 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7f22800119d0 tx=0x7f2280011e90 comp rx=0 tx=0).stop 2023-07-06T22:20:50.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.454+0000 7f22968d8640 1 -- 172.21.15.55:0/125735930 shutdown_connections 2023-07-06T22:20:50.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.454+0000 7f22968d8640 1 --2- 172.21.15.55:0/125735930 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f227c0660d0 0x7f227c068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.454+0000 7f22968d8640 1 --2- 172.21.15.55:0/125735930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22901f4b20 0x7f2290154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.454+0000 7f22968d8640 1 --2- 172.21.15.55:0/125735930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22900cb240 0x7f22901f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.454+0000 7f22968d8640 1 --2- 172.21.15.55:0/125735930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2278004d10 0x7f22900c9360 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.454+0000 7f22968d8640 1 -- 172.21.15.55:0/125735930 >> 172.21.15.55:0/125735930 conn(0x7f22900ced10 msgr2=0x7f2290156680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:50.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.458+0000 7f22968d8640 1 -- 172.21.15.55:0/125735930 shutdown_connections 2023-07-06T22:20:50.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.458+0000 7f22968d8640 1 -- 172.21.15.55:0/125735930 wait complete. 2023-07-06T22:20:50.478 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:20:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.618+0000 7ff53f45c640 1 Processor -- start 2023-07-06T22:20:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.618+0000 7ff53f45c640 1 -- start start 2023-07-06T22:20:50.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.618+0000 7ff53f45c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff5380b7cd0 0x7ff5380ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.618+0000 7ff53f45c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5380cecf0 con 0x7ff5380ccab0 2023-07-06T22:20:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.618+0000 7ff53f45c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5380d1d90 con 0x7ff5380b1fe0 2023-07-06T22:20:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.618+0000 7ff53f45c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5380d2310 con 0x7ff5380b7cd0 2023-07-06T22:20:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.618+0000 7ff53c9f7640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff5380ccab0 0x7ff5380b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56996/0 (socket says 172.21.15.55:56996) 2023-07-06T22:20:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.618+0000 7ff53c9f7640 1 -- 172.21.15.55:0/2092684982 learned_addr learned my addr 172.21.15.55:0/2092684982 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.618+0000 7ff53d1f8640 1 --2- 172.21.15.55:0/2092684982 >> v2:172.21.15.138:3300/0 conn(0x7ff5380b7cd0 0x7ff5380ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.618+0000 7ff52ffff640 1 -- 172.21.15.55:0/2092684982 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425489450 0 0) 0x7ff5380cecf0 con 0x7ff5380ccab0 2023-07-06T22:20:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.618+0000 7ff52ffff640 1 -- 172.21.15.55:0/2092684982 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff524003530 con 0x7ff5380ccab0 2023-07-06T22:20:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.618+0000 7ff53d1f8640 1 -- 172.21.15.55:0/2092684982 >> v1:172.21.15.138:6789/0 conn(0x7ff5380b1fe0 legacy=0x7ff53815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.618+0000 7ff53d1f8640 1 -- 172.21.15.55:0/2092684982 >> v1:172.21.15.55:6789/0 conn(0x7ff5380ccab0 legacy=0x7ff5380b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.618+0000 7ff53d1f8640 1 -- 172.21.15.55:0/2092684982 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5380d2030 con 0x7ff5380b7cd0 2023-07-06T22:20:50.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.622+0000 7ff53d1f8640 1 --2- 172.21.15.55:0/2092684982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5380b7cd0 0x7ff5380ce610 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7ff5340097c0 tx=0x7ff53401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae2f6ba89dcf1811 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:50.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.622+0000 7ff52ffff640 1 -- 172.21.15.55:0/2092684982 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340ab600 con 0x7ff5380b7cd0 2023-07-06T22:20:50.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.622+0000 7ff52ffff640 1 -- 172.21.15.55:0/2092684982 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5340a7050 con 0x7ff5380b7cd0 2023-07-06T22:20:50.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.622+0000 7ff52ffff640 1 -- 172.21.15.55:0/2092684982 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340ab980 con 0x7ff5380b7cd0 2023-07-06T22:20:50.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.622+0000 7ff53f45c640 1 -- 172.21.15.55:0/2092684982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5380b7cd0 msgr2=0x7ff5380ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.622+0000 7ff53f45c640 1 --2- 172.21.15.55:0/2092684982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5380b7cd0 0x7ff5380ce610 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7ff5340097c0 tx=0x7ff53401c3f0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.622+0000 7ff53f45c640 1 -- 172.21.15.55:0/2092684982 shutdown_connections 2023-07-06T22:20:50.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.622+0000 7ff53f45c640 1 --2- 172.21.15.55:0/2092684982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5380b7cd0 0x7ff5380ce610 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.622+0000 7ff53f45c640 1 -- 172.21.15.55:0/2092684982 >> 172.21.15.55:0/2092684982 conn(0x7ff5380ceee0 msgr2=0x7ff5380cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:50.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.622+0000 7ff53f45c640 1 -- 172.21.15.55:0/2092684982 shutdown_connections 2023-07-06T22:20:50.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.622+0000 7ff53f45c640 1 -- 172.21.15.55:0/2092684982 wait complete. 2023-07-06T22:20:50.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53f45c640 1 Processor -- start 2023-07-06T22:20:50.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53f45c640 1 -- start start 2023-07-06T22:20:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53f45c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5380b1fe0 0x7ff53814f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53f45c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5380b7cd0 0x7ff53815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53f45c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5380ccab0 0x7ff53814c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53f45c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5380ca170 con 0x7ff5380ccab0 2023-07-06T22:20:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53f45c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5380cb330 con 0x7ff5380b1fe0 2023-07-06T22:20:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53f45c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5380ca450 con 0x7ff5380b7cd0 2023-07-06T22:20:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53d9f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5380ccab0 0x7ff53814c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53d9f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5380ccab0 0x7ff53814c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33826/0 (socket says 172.21.15.55:33826) 2023-07-06T22:20:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53d9f9640 1 -- 172.21.15.55:0/1118332377 learned_addr learned my addr 172.21.15.55:0/1118332377 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:50.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53d1f8640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5380b1fe0 0x7ff53814f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53c9f7640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5380b7cd0 0x7ff53815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53d9f9640 1 -- 172.21.15.55:0/1118332377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5380b7cd0 msgr2=0x7ff53815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53d9f9640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5380b7cd0 0x7ff53815ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53d9f9640 1 -- 172.21.15.55:0/1118332377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5380b1fe0 msgr2=0x7ff53814f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53d9f9640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5380b1fe0 0x7ff53814f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53d9f9640 1 -- 172.21.15.55:0/1118332377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534009420 con 0x7ff5380ccab0 2023-07-06T22:20:50.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53d1f8640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5380b1fe0 0x7ff53814f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53d9f9640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5380ccab0 0x7ff53814c800 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7ff53000c7a0 tx=0x7ff53000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff52dffb640 1 -- 172.21.15.55:0/1118332377 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530003b80 con 0x7ff5380ccab0 2023-07-06T22:20:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff52dffb640 1 -- 172.21.15.55:0/1118332377 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff530003ce0 con 0x7ff5380ccab0 2023-07-06T22:20:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff52dffb640 1 -- 172.21.15.55:0/1118332377 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53000aa30 con 0x7ff5380ccab0 2023-07-06T22:20:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.626+0000 7ff53f45c640 1 -- 172.21.15.55:0/1118332377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53814fc80 con 0x7ff5380ccab0 2023-07-06T22:20:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.630+0000 7ff53f45c640 1 -- 172.21.15.55:0/1118332377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5380c97d0 con 0x7ff5380ccab0 2023-07-06T22:20:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.630+0000 7ff53f45c640 1 -- 172.21.15.55:0/1118332377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5380ca2b0 con 0x7ff5380ccab0 2023-07-06T22:20:50.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.630+0000 7ff52dffb640 1 -- 172.21.15.55:0/1118332377 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 114) v1 ==== 85496+0+0 (secure 0 0 0) 0x7ff53000ab90 con 0x7ff5380ccab0 2023-07-06T22:20:50.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.630+0000 7ff52dffb640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff51c0660d0 0x7ff51c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.630+0000 7ff52dffb640 1 -- 172.21.15.55:0/1118332377 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 7141+0+0 (secure 0 0 0) 0x7ff530083b30 con 0x7ff5380ccab0 2023-07-06T22:20:50.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.630+0000 7ff53d1f8640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff51c0660d0 0x7ff51c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.630+0000 7ff53d1f8640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff51c0660d0 0x7ff51c068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5340ad000 tx=0x7ff5340a6000 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:50.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.634+0000 7ff52dffb640 1 -- 172.21.15.55:0/1118332377 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5380ca2b0 con 0x7ff5380ccab0 2023-07-06T22:20:50.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.802+0000 7ff53f45c640 1 -- 172.21.15.55:0/1118332377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff53814fc80 con 0x7ff5380ccab0 2023-07-06T22:20:50.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.806+0000 7ff52dffb640 1 -- 172.21.15.55:0/1118332377 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+19659 (secure 0 0 0) 0x7ff53814fc80 con 0x7ff5380ccab0 2023-07-06T22:20:50.809 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:50.809 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":198,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:20:48.294310+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-07-06T22:20:21.647148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-07-06T22:20:22.723236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/1748099556":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/3699924180":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/1557240001":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/2892168105":"2023-07-07T22:20:48.294273+0000","172.21.15.55:6833/3861190779":"2023-07-07T22:20:48.294273+0000","172.21.15.55:6832/3861190779":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/2133543533":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/2070899305":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/3797237235":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/558674907":"2023-07-07T22:20:41.235643+0000","172.21.15.55:6833/538997467":"2023-07-07T22:20:41.235643+0000","172.21.15.55:6832/538997467":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/3471768092":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/2063199878":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/2431773305":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/237391926":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/3850725654":"2023-07-07T22:20:41.235643+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:20:50.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.806+0000 7ff53f45c640 1 -- 172.21.15.55:0/1118332377 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff51c0660d0 msgr2=0x7ff51c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.806+0000 7ff53f45c640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff51c0660d0 0x7ff51c068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5340ad000 tx=0x7ff5340a6000 comp rx=0 tx=0).stop 2023-07-06T22:20:50.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.806+0000 7ff53f45c640 1 -- 172.21.15.55:0/1118332377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5380ccab0 msgr2=0x7ff53814c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.806+0000 7ff53f45c640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5380ccab0 0x7ff53814c800 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7ff53000c7a0 tx=0x7ff53000cc60 comp rx=0 tx=0).stop 2023-07-06T22:20:50.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.806+0000 7ff53f45c640 1 -- 172.21.15.55:0/1118332377 shutdown_connections 2023-07-06T22:20:50.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.806+0000 7ff53f45c640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff51c0660d0 0x7ff51c068580 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.806+0000 7ff53f45c640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5380ccab0 0x7ff53814c800 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.806+0000 7ff53f45c640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5380b7cd0 0x7ff53815ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.806+0000 7ff53f45c640 1 --2- 172.21.15.55:0/1118332377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5380b1fe0 0x7ff53814f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.806+0000 7ff53f45c640 1 -- 172.21.15.55:0/1118332377 >> 172.21.15.55:0/1118332377 conn(0x7ff5380ceee0 msgr2=0x7ff538157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:50.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.806+0000 7ff53f45c640 1 -- 172.21.15.55:0/1118332377 shutdown_connections 2023-07-06T22:20:50.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.806+0000 7ff53f45c640 1 -- 172.21.15.55:0/1118332377 wait complete. 2023-07-06T22:20:50.831 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T22:20:50.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.970+0000 7f8e21a48640 1 Processor -- start 2023-07-06T22:20:50.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.970+0000 7f8e21a48640 1 -- start start 2023-07-06T22:20:50.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.974+0000 7f8e21a48640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8e1c158850 0x7f8e1c0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.974+0000 7f8e21a48640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e1c070af0 0x7f8e1c0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.974+0000 7f8e21a48640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1c158c20 con 0x7f8e1c0ca130 2023-07-06T22:20:50.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.974+0000 7f8e21a48640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1c0b2aa0 con 0x7f8e1c070af0 2023-07-06T22:20:50.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.974+0000 7f8e21a48640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1c0c8db0 con 0x7f8e1c158850 2023-07-06T22:20:50.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.974+0000 7f8e1b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e1c070af0 0x7f8e1c0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.974+0000 7f8e1b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e1c070af0 0x7f8e1c0ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33836/0 (socket says 172.21.15.55:33836) 2023-07-06T22:20:50.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.974+0000 7f8e1b7fe640 1 -- 172.21.15.55:0/543919450 learned_addr learned my addr 172.21.15.55:0/543919450 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:50.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.974+0000 7f8e1affd640 1 --2- 172.21.15.55:0/543919450 >> v2:172.21.15.138:3300/0 conn(0x7f8e1c158850 0x7f8e1c0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.974+0000 7f8e1b7fe640 1 -- 172.21.15.55:0/543919450 >> v2:172.21.15.138:3300/0 conn(0x7f8e1c158850 msgr2=0x7f8e1c0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:50.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.974+0000 7f8e1b7fe640 1 --2- 172.21.15.55:0/543919450 >> v2:172.21.15.138:3300/0 conn(0x7f8e1c158850 0x7f8e1c0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.974+0000 7f8e1b7fe640 1 -- 172.21.15.55:0/543919450 >> v1:172.21.15.138:6789/0 conn(0x7f8e1c0ca130 legacy=0x7f8e1c0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.974+0000 7f8e1b7fe640 1 -- 172.21.15.55:0/543919450 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c0c9090 con 0x7f8e1c070af0 2023-07-06T22:20:50.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.978+0000 7f8e1b7fe640 1 --2- 172.21.15.55:0/543919450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e1c070af0 0x7f8e1c0ccf70 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c06eaf0 tx=0x7f8e1401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd789cdebd29fcf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:50.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.978+0000 7f8e1a7fc640 1 -- 172.21.15.55:0/543919450 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140a5860 con 0x7f8e1c070af0 2023-07-06T22:20:50.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.978+0000 7f8e1a7fc640 1 -- 172.21.15.55:0/543919450 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e140a59c0 con 0x7f8e1c070af0 2023-07-06T22:20:50.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.978+0000 7f8e1a7fc640 1 -- 172.21.15.55:0/543919450 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140a5d50 con 0x7f8e1c070af0 2023-07-06T22:20:50.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.978+0000 7f8e21a48640 1 -- 172.21.15.55:0/543919450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e1c070af0 msgr2=0x7f8e1c0ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.978+0000 7f8e21a48640 1 --2- 172.21.15.55:0/543919450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e1c070af0 0x7f8e1c0ccf70 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c06eaf0 tx=0x7f8e1401c9a0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.978+0000 7f8e21a48640 1 -- 172.21.15.55:0/543919450 shutdown_connections 2023-07-06T22:20:50.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.978+0000 7f8e21a48640 1 --2- 172.21.15.55:0/543919450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e1c070af0 0x7f8e1c0ccf70 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.978+0000 7f8e21a48640 1 --2- 172.21.15.55:0/543919450 >> v2:172.21.15.138:3300/0 conn(0x7f8e1c158850 0x7f8e1c0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.978+0000 7f8e21a48640 1 -- 172.21.15.55:0/543919450 >> 172.21.15.55:0/543919450 conn(0x7f8e1c0cea70 msgr2=0x7f8e1c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:50.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.978+0000 7f8e21a48640 1 -- 172.21.15.55:0/543919450 shutdown_connections 2023-07-06T22:20:50.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.978+0000 7f8e21a48640 1 -- 172.21.15.55:0/543919450 wait complete. 2023-07-06T22:20:50.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.978+0000 7f8e21a48640 1 Processor -- start 2023-07-06T22:20:50.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.978+0000 7f8e21a48640 1 -- start start 2023-07-06T22:20:50.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e21a48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e1c070af0 0x7f8e1c0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e21a48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c0ca130 0x7f8e1c0c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e21a48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e1c158850 0x7f8e1c0ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e21a48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0c6580 con 0x7f8e1c158850 2023-07-06T22:20:50.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e21a48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0c5bb0 con 0x7f8e1c0ca130 2023-07-06T22:20:50.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e21a48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0c7c20 con 0x7f8e1c070af0 2023-07-06T22:20:50.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e1b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e1c158850 0x7f8e1c0ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e1b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e1c158850 0x7f8e1c0ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33846/0 (socket says 172.21.15.55:33846) 2023-07-06T22:20:50.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e1b7fe640 1 -- 172.21.15.55:0/1567233051 learned_addr learned my addr 172.21.15.55:0/1567233051 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:50.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e1affd640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e1c070af0 0x7f8e1c0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e13fff640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c0ca130 0x7f8e1c0c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e1b7fe640 1 -- 172.21.15.55:0/1567233051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e1c070af0 msgr2=0x7f8e1c0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e1b7fe640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e1c070af0 0x7f8e1c0c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e1b7fe640 1 -- 172.21.15.55:0/1567233051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c0ca130 msgr2=0x7f8e1c0c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:50.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e1b7fe640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c0ca130 0x7f8e1c0c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:50.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e1b7fe640 1 -- 172.21.15.55:0/1567233051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14009b30 con 0x7f8e1c158850 2023-07-06T22:20:50.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e13fff640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c0ca130 0x7f8e1c0c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:50.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e1b7fe640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e1c158850 0x7f8e1c0ca500 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f8e140af040 tx=0x7f8e14019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:50.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e18ff9640 1 -- 172.21.15.55:0/1567233051 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140b8670 con 0x7f8e1c158850 2023-07-06T22:20:50.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e18ff9640 1 -- 172.21.15.55:0/1567233051 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e140b87d0 con 0x7f8e1c158850 2023-07-06T22:20:50.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e18ff9640 1 -- 172.21.15.55:0/1567233051 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140b8b80 con 0x7f8e1c158850 2023-07-06T22:20:50.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e21a48640 1 -- 172.21.15.55:0/1567233051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1c0c4fa0 con 0x7f8e1c158850 2023-07-06T22:20:50.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e21a48640 1 -- 172.21.15.55:0/1567233051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1c0c5560 con 0x7f8e1c158850 2023-07-06T22:20:50.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e21a48640 1 -- 172.21.15.55:0/1567233051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1c0c5d20 con 0x7f8e1c158850 2023-07-06T22:20:50.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.982+0000 7f8e18ff9640 1 -- 172.21.15.55:0/1567233051 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 114) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f8e140b8ce0 con 0x7f8e1c158850 2023-07-06T22:20:50.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.986+0000 7f8e18ff9640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f8dfc0660d0 0x7f8dfc068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:50.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.986+0000 7f8e18ff9640 1 -- 172.21.15.55:0/1567233051 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 7141+0+0 (secure 0 0 0) 0x7f8e1411f320 con 0x7f8e1c158850 2023-07-06T22:20:50.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.986+0000 7f8e1affd640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f8dfc0660d0 0x7f8dfc068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:50.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.986+0000 7f8e1affd640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f8dfc0660d0 0x7f8dfc068580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c09d250 tx=0x7f8e0c009190 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:50.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:50.990+0000 7f8e18ff9640 1 -- 172.21.15.55:0/1567233051 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e140ec880 con 0x7f8e1c158850 2023-07-06T22:20:51.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:51.134+0000 7f8e18ff9640 1 -- 172.21.15.55:0/1567233051 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8e140ecc50 con 0x7f8e1c158850 2023-07-06T22:20:51.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:51.178+0000 7f8e21a48640 1 -- 172.21.15.55:0/1567233051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8e1c066d60 con 0x7f8e1c158850 2023-07-06T22:20:52.134 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-07-06T22:20:52.134+0000 7f5b6d80c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T22:20:52.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.138+0000 7f8e18ff9640 1 -- 172.21.15.55:0/1567233051 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v88) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8e140c3460 con 0x7f8e1c158850 2023-07-06T22:20:52.140 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T22:20:52.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.138+0000 7f8e21a48640 1 -- 172.21.15.55:0/1567233051 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f8dfc0660d0 msgr2=0x7f8dfc068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:52.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.138+0000 7f8e21a48640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f8dfc0660d0 0x7f8dfc068580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c09d250 tx=0x7f8e0c009190 comp rx=0 tx=0).stop 2023-07-06T22:20:52.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.138+0000 7f8e21a48640 1 -- 172.21.15.55:0/1567233051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e1c158850 msgr2=0x7f8e1c0ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:52.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.138+0000 7f8e21a48640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e1c158850 0x7f8e1c0ca500 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f8e140af040 tx=0x7f8e14019740 comp rx=0 tx=0).stop 2023-07-06T22:20:52.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.138+0000 7f8e21a48640 1 -- 172.21.15.55:0/1567233051 shutdown_connections 2023-07-06T22:20:52.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.138+0000 7f8e21a48640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f8dfc0660d0 0x7f8dfc068580 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:52.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.138+0000 7f8e21a48640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e1c158850 0x7f8e1c0ca500 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:52.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.138+0000 7f8e21a48640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e1c0ca130 0x7f8e1c0c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:52.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.138+0000 7f8e21a48640 1 --2- 172.21.15.55:0/1567233051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e1c070af0 0x7f8e1c0c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:52.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.138+0000 7f8e21a48640 1 -- 172.21.15.55:0/1567233051 >> 172.21.15.55:0/1567233051 conn(0x7f8e1c0cea70 msgr2=0x7f8e1c09e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:52.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.138+0000 7f8e21a48640 1 -- 172.21.15.55:0/1567233051 shutdown_connections 2023-07-06T22:20:52.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.138+0000 7f8e21a48640 1 -- 172.21.15.55:0/1567233051 wait complete. 2023-07-06T22:20:52.145 INFO:tasks.ceph.mds.d.smithi138.stderr: -5300> 2023-07-06T22:20:18.443+0000 7f46c6e63640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-07-06T22:20:52.148 INFO:tasks.ceph.mds.d.smithi138.stderr: -4067> 2023-07-06T22:20:29.303+0000 7f46c0e57640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T22:20:52.166 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T22:20:52.200 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-07-06T22:20:52.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36daca640 1 Processor -- start 2023-07-06T22:20:52.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36daca640 1 -- start start 2023-07-06T22:20:52.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36daca640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe36815f710 0x7fe3680ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:52.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36daca640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe3680d0440 0x7fe3680d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:52.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36daca640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3680cfc80 con 0x7fe36815fae0 2023-07-06T22:20:52.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36daca640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36815c000 con 0x7fe36815f710 2023-07-06T22:20:52.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36daca640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3680cc700 con 0x7fe3680d0440 2023-07-06T22:20:52.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36cac8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe36815f710 0x7fe3680ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:52.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36cac8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe36815f710 0x7fe3680ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33852/0 (socket says 172.21.15.55:33852) 2023-07-06T22:20:52.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36cac8640 1 -- 172.21.15.55:0/3967065868 learned_addr learned my addr 172.21.15.55:0/3967065868 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:52.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36d2c9640 1 --2- 172.21.15.55:0/3967065868 >> v2:172.21.15.138:3300/0 conn(0x7fe3680d0440 0x7fe3680d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:52.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36cac8640 1 -- 172.21.15.55:0/3967065868 >> v2:172.21.15.138:3300/0 conn(0x7fe3680d0440 msgr2=0x7fe3680d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:52.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36cac8640 1 --2- 172.21.15.55:0/3967065868 >> v2:172.21.15.138:3300/0 conn(0x7fe3680d0440 0x7fe3680d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:52.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36cac8640 1 -- 172.21.15.55:0/3967065868 >> v1:172.21.15.55:6789/0 conn(0x7fe36815fae0 legacy=0x7fe36815ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:52.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.314+0000 7fe36cac8640 1 -- 172.21.15.55:0/3967065868 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3680cc9e0 con 0x7fe36815f710 2023-07-06T22:20:52.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe36cac8640 1 --2- 172.21.15.55:0/3967065868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36815f710 0x7fe3680ce260 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fe36808b360 tx=0x7fe35c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbecf67534d4ced server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:52.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe3677fe640 1 -- 172.21.15.55:0/3967065868 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c0ab670 con 0x7fe36815f710 2023-07-06T22:20:52.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe3677fe640 1 -- 172.21.15.55:0/3967065868 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35c0ab7d0 con 0x7fe36815f710 2023-07-06T22:20:52.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe3677fe640 1 -- 172.21.15.55:0/3967065868 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c0abb60 con 0x7fe36815f710 2023-07-06T22:20:52.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe36daca640 1 -- 172.21.15.55:0/3967065868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36815f710 msgr2=0x7fe3680ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:52.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe36daca640 1 --2- 172.21.15.55:0/3967065868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36815f710 0x7fe3680ce260 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fe36808b360 tx=0x7fe35c01c4d0 comp rx=0 tx=0).stop 2023-07-06T22:20:52.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe36daca640 1 -- 172.21.15.55:0/3967065868 shutdown_connections 2023-07-06T22:20:52.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe36daca640 1 --2- 172.21.15.55:0/3967065868 >> v2:172.21.15.138:3300/0 conn(0x7fe3680d0440 0x7fe3680d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:52.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe36daca640 1 --2- 172.21.15.55:0/3967065868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36815f710 0x7fe3680ce260 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:52.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe36daca640 1 -- 172.21.15.55:0/3967065868 >> 172.21.15.55:0/3967065868 conn(0x7fe3680b4720 msgr2=0x7fe3680d2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:52.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe36daca640 1 -- 172.21.15.55:0/3967065868 shutdown_connections 2023-07-06T22:20:52.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe36daca640 1 -- 172.21.15.55:0/3967065868 wait complete. 2023-07-06T22:20:52.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe36daca640 1 Processor -- start 2023-07-06T22:20:52.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe36daca640 1 -- start start 2023-07-06T22:20:52.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.322+0000 7fe36daca640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3680d0440 0x7fe3681561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:52.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe36daca640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36815f710 0x7fe3680c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:52.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe36daca640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe36815fae0 0x7fe3681553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:52.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe36daca640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3680cab10 con 0x7fe36815f710 2023-07-06T22:20:52.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe36daca640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36815e3d0 con 0x7fe3680d0440 2023-07-06T22:20:52.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe36daca640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36815e6b0 con 0x7fe36815fae0 2023-07-06T22:20:52.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe367fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36815f710 0x7fe3680c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:52.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe367fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36815f710 0x7fe3680c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33866/0 (socket says 172.21.15.55:33866) 2023-07-06T22:20:52.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe367fff640 1 -- 172.21.15.55:0/198090740 learned_addr learned my addr 172.21.15.55:0/198090740 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:52.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe36d2c9640 1 --2- 172.21.15.55:0/198090740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe36815fae0 0x7fe3681553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:52.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe36cac8640 1 --2- 172.21.15.55:0/198090740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3680d0440 0x7fe3681561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:52.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe367fff640 1 -- 172.21.15.55:0/198090740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe36815fae0 msgr2=0x7fe3681553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:52.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe367fff640 1 --2- 172.21.15.55:0/198090740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe36815fae0 0x7fe3681553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:52.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe367fff640 1 -- 172.21.15.55:0/198090740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3680d0440 msgr2=0x7fe3681561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:52.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe367fff640 1 --2- 172.21.15.55:0/198090740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3680d0440 0x7fe3681561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:52.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe367fff640 1 -- 172.21.15.55:0/198090740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c0094d0 con 0x7fe36815f710 2023-07-06T22:20:52.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe367fff640 1 --2- 172.21.15.55:0/198090740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36815f710 0x7fe3680c82d0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7fe35400c500 tx=0x7fe35400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:52.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe3657fa640 1 -- 172.21.15.55:0/198090740 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354005220 con 0x7fe36815f710 2023-07-06T22:20:52.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe3657fa640 1 -- 172.21.15.55:0/198090740 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354005380 con 0x7fe36815f710 2023-07-06T22:20:52.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe3657fa640 1 -- 172.21.15.55:0/198090740 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354007270 con 0x7fe36815f710 2023-07-06T22:20:52.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe36daca640 1 -- 172.21.15.55:0/198090740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36815e990 con 0x7fe36815f710 2023-07-06T22:20:52.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe36daca640 1 -- 172.21.15.55:0/198090740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3680ca730 con 0x7fe36815f710 2023-07-06T22:20:52.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe36daca640 1 -- 172.21.15.55:0/198090740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36815ebd0 con 0x7fe36815f710 2023-07-06T22:20:52.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.326+0000 7fe3657fa640 1 -- 172.21.15.55:0/198090740 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe3540073d0 con 0x7fe36815f710 2023-07-06T22:20:52.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.330+0000 7fe3657fa640 1 --2- 172.21.15.55:0/198090740 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe34c0663d0 0x7fe34c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:52.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.330+0000 7fe3657fa640 1 -- 172.21.15.55:0/198090740 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 7227+0+0 (secure 0 0 0) 0x7fe354083c90 con 0x7fe36815f710 2023-07-06T22:20:52.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.330+0000 7fe36cac8640 1 --2- 172.21.15.55:0/198090740 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe34c0663d0 0x7fe34c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:52.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.330+0000 7fe36cac8640 1 --2- 172.21.15.55:0/198090740 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe34c0663d0 0x7fe34c068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0af000 tx=0x7fe35c0a7000 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:52.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.330+0000 7fe3657fa640 1 -- 172.21.15.55:0/198090740 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe354050ae0 con 0x7fe36815f710 2023-07-06T22:20:52.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:52.526+0000 7fe36daca640 1 -- 172.21.15.55:0/198090740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe36804d790 con 0x7fe36815f710 2023-07-06T22:20:53.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.142+0000 7fe3657fa640 1 -- 172.21.15.55:0/198090740 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v89) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe354054100 con 0x7fe36815f710 2023-07-06T22:20:53.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.146+0000 7fe36daca640 1 -- 172.21.15.55:0/198090740 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe34c0663d0 msgr2=0x7fe34c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:53.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.146+0000 7fe36daca640 1 --2- 172.21.15.55:0/198090740 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe34c0663d0 0x7fe34c068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0af000 tx=0x7fe35c0a7000 comp rx=0 tx=0).stop 2023-07-06T22:20:53.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.146+0000 7fe36daca640 1 -- 172.21.15.55:0/198090740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36815f710 msgr2=0x7fe3680c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:53.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.146+0000 7fe36daca640 1 --2- 172.21.15.55:0/198090740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36815f710 0x7fe3680c82d0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7fe35400c500 tx=0x7fe35400c9c0 comp rx=0 tx=0).stop 2023-07-06T22:20:53.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.146+0000 7fe36daca640 1 -- 172.21.15.55:0/198090740 shutdown_connections 2023-07-06T22:20:53.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.146+0000 7fe36daca640 1 --2- 172.21.15.55:0/198090740 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe34c0663d0 0x7fe34c068880 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:53.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.146+0000 7fe36daca640 1 --2- 172.21.15.55:0/198090740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe36815fae0 0x7fe3681553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:53.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.146+0000 7fe36daca640 1 --2- 172.21.15.55:0/198090740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36815f710 0x7fe3680c82d0 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:53.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.146+0000 7fe36daca640 1 --2- 172.21.15.55:0/198090740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe3680d0440 0x7fe3681561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.146+0000 7fe36daca640 1 -- 172.21.15.55:0/198090740 >> 172.21.15.55:0/198090740 conn(0x7fe3680b4720 msgr2=0x7fe3680b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.146+0000 7fe36daca640 1 -- 172.21.15.55:0/198090740 shutdown_connections 2023-07-06T22:20:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.146+0000 7fe36daca640 1 -- 172.21.15.55:0/198090740 wait complete. 2023-07-06T22:20:53.172 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T22:20:53.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.318+0000 7fe2cb048640 1 Processor -- start 2023-07-06T22:20:53.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.318+0000 7fe2cb048640 1 -- start start 2023-07-06T22:20:53.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.322+0000 7fe2cb048640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2c40b7bf0 0x7fe2c40ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:53.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.322+0000 7fe2cb048640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2c4069e00 0x7fe2c40b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.322+0000 7fe2cb048640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c40b4690 con 0x7fe2c40b4240 2023-07-06T22:20:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.322+0000 7fe2cb048640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c40cfe50 con 0x7fe2c40b7bf0 2023-07-06T22:20:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.322+0000 7fe2cb048640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c40cc8d0 con 0x7fe2c4069e00 2023-07-06T22:20:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.322+0000 7fe2c8de4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2c40b7bf0 0x7fe2c40ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.322+0000 7fe2c8de4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2c40b7bf0 0x7fe2c40ce540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44310/0 (socket says 172.21.15.55:44310) 2023-07-06T22:20:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.322+0000 7fe2c8de4640 1 -- 172.21.15.55:0/177952970 learned_addr learned my addr 172.21.15.55:0/177952970 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:53.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.322+0000 7fe2bbfff640 1 --2- 172.21.15.55:0/177952970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2c4069e00 0x7fe2c40b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.322+0000 7fe2c8de4640 1 -- 172.21.15.55:0/177952970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2c4069e00 msgr2=0x7fe2c40b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.322+0000 7fe2c8de4640 1 --2- 172.21.15.55:0/177952970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2c4069e00 0x7fe2c40b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.322+0000 7fe2c8de4640 1 -- 172.21.15.55:0/177952970 >> v1:172.21.15.55:6789/0 conn(0x7fe2c40b4240 legacy=0x7fe2c415f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:53.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.322+0000 7fe2c8de4640 1 -- 172.21.15.55:0/177952970 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c406a290 con 0x7fe2c40b7bf0 2023-07-06T22:20:53.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.326+0000 7fe2c8de4640 1 --2- 172.21.15.55:0/177952970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c40b7bf0 0x7fe2c40ce540 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0009870 tx=0x7fe2c001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ecba6959d1f57ca server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:53.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.326+0000 7fe2bb7fe640 1 -- 172.21.15.55:0/177952970 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00aa670 con 0x7fe2c40b7bf0 2023-07-06T22:20:53.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.326+0000 7fe2bb7fe640 1 -- 172.21.15.55:0/177952970 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c00aa7d0 con 0x7fe2c40b7bf0 2023-07-06T22:20:53.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.326+0000 7fe2bb7fe640 1 -- 172.21.15.55:0/177952970 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00aab60 con 0x7fe2c40b7bf0 2023-07-06T22:20:53.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.326+0000 7fe2cb048640 1 -- 172.21.15.55:0/177952970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c40b7bf0 msgr2=0x7fe2c40ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:53.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.326+0000 7fe2cb048640 1 --2- 172.21.15.55:0/177952970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c40b7bf0 0x7fe2c40ce540 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0009870 tx=0x7fe2c001c510 comp rx=0 tx=0).stop 2023-07-06T22:20:53.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.326+0000 7fe2cb048640 1 -- 172.21.15.55:0/177952970 shutdown_connections 2023-07-06T22:20:53.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.326+0000 7fe2cb048640 1 --2- 172.21.15.55:0/177952970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2c4069e00 0x7fe2c40b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:53.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.326+0000 7fe2cb048640 1 --2- 172.21.15.55:0/177952970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c40b7bf0 0x7fe2c40ce540 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:53.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.326+0000 7fe2cb048640 1 -- 172.21.15.55:0/177952970 >> 172.21.15.55:0/177952970 conn(0x7fe2c4070cf0 msgr2=0x7fe2c40ced00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:53.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.326+0000 7fe2cb048640 1 -- 172.21.15.55:0/177952970 shutdown_connections 2023-07-06T22:20:53.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.326+0000 7fe2cb048640 1 -- 172.21.15.55:0/177952970 wait complete. 2023-07-06T22:20:53.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.326+0000 7fe2cb048640 1 Processor -- start 2023-07-06T22:20:53.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.326+0000 7fe2cb048640 1 -- start start 2023-07-06T22:20:53.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2cb048640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c4069e00 0x7fe2c40ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:53.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2cb048640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2c40b4240 0x7fe2c40d2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:53.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2cb048640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2c40b7bf0 0x7fe2c4154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:53.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2cb048640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c41f4960 con 0x7fe2c4069e00 2023-07-06T22:20:53.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2cb048640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c40cabd0 con 0x7fe2c40b4240 2023-07-06T22:20:53.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2cb048640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c40caeb0 con 0x7fe2c40b7bf0 2023-07-06T22:20:53.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2c8de4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c4069e00 0x7fe2c40ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:53.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2c8de4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c4069e00 0x7fe2c40ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44322/0 (socket says 172.21.15.55:44322) 2023-07-06T22:20:53.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2c8de4640 1 -- 172.21.15.55:0/3171420521 learned_addr learned my addr 172.21.15.55:0/3171420521 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:53.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2bbfff640 1 --2- 172.21.15.55:0/3171420521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2c40b4240 0x7fe2c40d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:53.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2c95e5640 1 --2- 172.21.15.55:0/3171420521 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2c40b7bf0 0x7fe2c4154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:53.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2c8de4640 1 -- 172.21.15.55:0/3171420521 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2c40b7bf0 msgr2=0x7fe2c4154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:53.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2c8de4640 1 --2- 172.21.15.55:0/3171420521 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2c40b7bf0 0x7fe2c4154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:53.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2c8de4640 1 -- 172.21.15.55:0/3171420521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2c40b4240 msgr2=0x7fe2c40d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:53.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2c8de4640 1 --2- 172.21.15.55:0/3171420521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2c40b4240 0x7fe2c40d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:53.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2c8de4640 1 -- 172.21.15.55:0/3171420521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c00094d0 con 0x7fe2c4069e00 2023-07-06T22:20:53.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2c8de4640 1 --2- 172.21.15.55:0/3171420521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c4069e00 0x7fe2c40ca3a0 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00ac040 tx=0x7fe2c001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:53.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2b97fa640 1 -- 172.21.15.55:0/3171420521 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00b3800 con 0x7fe2c4069e00 2023-07-06T22:20:53.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2b97fa640 1 -- 172.21.15.55:0/3171420521 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c00b3980 con 0x7fe2c4069e00 2023-07-06T22:20:53.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2b97fa640 1 -- 172.21.15.55:0/3171420521 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00b3d30 con 0x7fe2c4069e00 2023-07-06T22:20:53.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2cb048640 1 -- 172.21.15.55:0/3171420521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c40cb190 con 0x7fe2c4069e00 2023-07-06T22:20:53.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2cb048640 1 -- 172.21.15.55:0/3171420521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c40ca8e0 con 0x7fe2c4069e00 2023-07-06T22:20:53.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.330+0000 7fe2cb048640 1 -- 172.21.15.55:0/3171420521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c4066d60 con 0x7fe2c4069e00 2023-07-06T22:20:53.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.334+0000 7fe2b97fa640 1 -- 172.21.15.55:0/3171420521 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe2c00b2380 con 0x7fe2c4069e00 2023-07-06T22:20:53.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.334+0000 7fe2b97fa640 1 --2- 172.21.15.55:0/3171420521 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe2b00663a0 0x7fe2b0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:53.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.334+0000 7fe2b97fa640 1 -- 172.21.15.55:0/3171420521 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 7227+0+0 (secure 0 0 0) 0x7fe2c011eb90 con 0x7fe2c4069e00 2023-07-06T22:20:53.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.334+0000 7fe2bbfff640 1 --2- 172.21.15.55:0/3171420521 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe2b00663a0 0x7fe2b0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:53.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.334+0000 7fe2bbfff640 1 --2- 172.21.15.55:0/3171420521 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe2b00663a0 0x7fe2b0068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe2c41f7e30 tx=0x7fe2b4008040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:53.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.338+0000 7fe2b97fa640 1 -- 172.21.15.55:0/3171420521 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2c00eb9d0 con 0x7fe2c4069e00 2023-07-06T22:20:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:53.490+0000 7fe2cb048640 1 -- 172.21.15.55:0/3171420521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe2c406acc0 con 0x7fe2c4069e00 2023-07-06T22:20:54.345 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-07-06T22:20:54.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.342+0000 7fe2b97fa640 1 -- 172.21.15.55:0/3171420521 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v200) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe2c00aa630 con 0x7fe2c4069e00 2023-07-06T22:20:54.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.346+0000 7fe2cb048640 1 -- 172.21.15.55:0/3171420521 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe2b00663a0 msgr2=0x7fe2b0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.346+0000 7fe2cb048640 1 --2- 172.21.15.55:0/3171420521 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe2b00663a0 0x7fe2b0068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe2c41f7e30 tx=0x7fe2b4008040 comp rx=0 tx=0).stop 2023-07-06T22:20:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.346+0000 7fe2cb048640 1 -- 172.21.15.55:0/3171420521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c4069e00 msgr2=0x7fe2c40ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.346+0000 7fe2cb048640 1 --2- 172.21.15.55:0/3171420521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c4069e00 0x7fe2c40ca3a0 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00ac040 tx=0x7fe2c001ad50 comp rx=0 tx=0).stop 2023-07-06T22:20:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.346+0000 7fe2cb048640 1 -- 172.21.15.55:0/3171420521 shutdown_connections 2023-07-06T22:20:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.346+0000 7fe2cb048640 1 --2- 172.21.15.55:0/3171420521 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe2b00663a0 0x7fe2b0068850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.346+0000 7fe2cb048640 1 --2- 172.21.15.55:0/3171420521 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2c40b7bf0 0x7fe2c4154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.346+0000 7fe2cb048640 1 --2- 172.21.15.55:0/3171420521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2c40b4240 0x7fe2c40d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.346+0000 7fe2cb048640 1 --2- 172.21.15.55:0/3171420521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c4069e00 0x7fe2c40ca3a0 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.346+0000 7fe2cb048640 1 -- 172.21.15.55:0/3171420521 >> 172.21.15.55:0/3171420521 conn(0x7fe2c4070cf0 msgr2=0x7fe2c415f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.346+0000 7fe2cb048640 1 -- 172.21.15.55:0/3171420521 shutdown_connections 2023-07-06T22:20:54.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.346+0000 7fe2cb048640 1 -- 172.21.15.55:0/3171420521 wait complete. 2023-07-06T22:20:54.373 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T22:20:54.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd7b03640 1 Processor -- start 2023-07-06T22:20:54.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd7b03640 1 -- start start 2023-07-06T22:20:54.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd7b03640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdfd0158780 0x7fdfd00cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:54.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd7b03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfd00c89b0 0x7fdfd00c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:54.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd7b03640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd0158b50 con 0x7fdfd00cbfa0 2023-07-06T22:20:54.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd7b03640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd006fb00 con 0x7fdfd00c89b0 2023-07-06T22:20:54.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd7b03640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd006b390 con 0x7fdfd0158780 2023-07-06T22:20:54.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd60a0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfd00c89b0 0x7fdfd00c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:54.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd60a0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfd00c89b0 0x7fdfd00c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44336/0 (socket says 172.21.15.55:44336) 2023-07-06T22:20:54.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd60a0640 1 -- 172.21.15.55:0/3556810062 learned_addr learned my addr 172.21.15.55:0/3556810062 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:54.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd589f640 1 --2- 172.21.15.55:0/3556810062 >> v2:172.21.15.138:3300/0 conn(0x7fdfd0158780 0x7fdfd00cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:54.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd60a0640 1 -- 172.21.15.55:0/3556810062 >> v2:172.21.15.138:3300/0 conn(0x7fdfd0158780 msgr2=0x7fdfd00cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:54.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd60a0640 1 --2- 172.21.15.55:0/3556810062 >> v2:172.21.15.138:3300/0 conn(0x7fdfd0158780 0x7fdfd00cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:54.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd60a0640 1 -- 172.21.15.55:0/3556810062 >> v1:172.21.15.138:6789/0 conn(0x7fdfd00cbfa0 legacy=0x7fdfd006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:54.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.522+0000 7fdfd60a0640 1 -- 172.21.15.55:0/3556810062 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd00c9350 con 0x7fdfd00c89b0 2023-07-06T22:20:54.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.526+0000 7fdfd60a0640 1 --2- 172.21.15.55:0/3556810062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd00c89b0 0x7fdfd00c8e10 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0069c50 tx=0x7fdfc801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba35c26cd60ac6b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:54.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.526+0000 7fdfd489d640 1 -- 172.21.15.55:0/3556810062 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80a56f0 con 0x7fdfd00c89b0 2023-07-06T22:20:54.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.526+0000 7fdfd489d640 1 -- 172.21.15.55:0/3556810062 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc80a5850 con 0x7fdfd00c89b0 2023-07-06T22:20:54.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.526+0000 7fdfd489d640 1 -- 172.21.15.55:0/3556810062 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80a5be0 con 0x7fdfd00c89b0 2023-07-06T22:20:54.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.526+0000 7fdfd7b03640 1 -- 172.21.15.55:0/3556810062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd00c89b0 msgr2=0x7fdfd00c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:54.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.526+0000 7fdfd7b03640 1 --2- 172.21.15.55:0/3556810062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd00c89b0 0x7fdfd00c8e10 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0069c50 tx=0x7fdfc801c940 comp rx=0 tx=0).stop 2023-07-06T22:20:54.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.526+0000 7fdfd7b03640 1 -- 172.21.15.55:0/3556810062 shutdown_connections 2023-07-06T22:20:54.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.526+0000 7fdfd7b03640 1 --2- 172.21.15.55:0/3556810062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd00c89b0 0x7fdfd00c8e10 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.526+0000 7fdfd7b03640 1 --2- 172.21.15.55:0/3556810062 >> v2:172.21.15.138:3300/0 conn(0x7fdfd0158780 0x7fdfd00cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.526+0000 7fdfd7b03640 1 -- 172.21.15.55:0/3556810062 >> 172.21.15.55:0/3556810062 conn(0x7fdfd00cde30 msgr2=0x7fdfd00ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.526+0000 7fdfd7b03640 1 -- 172.21.15.55:0/3556810062 shutdown_connections 2023-07-06T22:20:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.526+0000 7fdfd7b03640 1 -- 172.21.15.55:0/3556810062 wait complete. 2023-07-06T22:20:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd7b03640 1 Processor -- start 2023-07-06T22:20:54.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd7b03640 1 -- start start 2023-07-06T22:20:54.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd7b03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd00c89b0 0x7fdfd0150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:54.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd7b03640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfd00cbfa0 0x7fdfd01572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:54.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd7b03640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd0158780 0x7fdfd014f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:54.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd7b03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd0156ec0 con 0x7fdfd00c89b0 2023-07-06T22:20:54.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd7b03640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd0156240 con 0x7fdfd0158780 2023-07-06T22:20:54.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd7b03640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd0156520 con 0x7fdfd00cbfa0 2023-07-06T22:20:54.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd589f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd00c89b0 0x7fdfd0150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:54.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd589f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd00c89b0 0x7fdfd0150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44348/0 (socket says 172.21.15.55:44348) 2023-07-06T22:20:54.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd589f640 1 -- 172.21.15.55:0/2899992365 learned_addr learned my addr 172.21.15.55:0/2899992365 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:54.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd60a0640 1 --2- 172.21.15.55:0/2899992365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd0158780 0x7fdfd014f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:54.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd509e640 1 --2- 172.21.15.55:0/2899992365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfd00cbfa0 0x7fdfd01572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:54.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd589f640 1 -- 172.21.15.55:0/2899992365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfd00cbfa0 msgr2=0x7fdfd01572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:54.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd589f640 1 --2- 172.21.15.55:0/2899992365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfd00cbfa0 0x7fdfd01572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:54.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd589f640 1 -- 172.21.15.55:0/2899992365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd0158780 msgr2=0x7fdfd014f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:54.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd589f640 1 --2- 172.21.15.55:0/2899992365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd0158780 0x7fdfd014f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd589f640 1 -- 172.21.15.55:0/2899992365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc8009b30 con 0x7fdfd00c89b0 2023-07-06T22:20:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd589f640 1 --2- 172.21.15.55:0/2899992365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd00c89b0 0x7fdfd0150590 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00d5f0 tx=0x7fdfcc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfc67fc640 1 -- 172.21.15.55:0/2899992365 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc0125f0 con 0x7fdfd00c89b0 2023-07-06T22:20:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfc67fc640 1 -- 172.21.15.55:0/2899992365 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc012750 con 0x7fdfd00c89b0 2023-07-06T22:20:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfc67fc640 1 -- 172.21.15.55:0/2899992365 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc012b00 con 0x7fdfd00c89b0 2023-07-06T22:20:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd7b03640 1 -- 172.21.15.55:0/2899992365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd0156800 con 0x7fdfd00c89b0 2023-07-06T22:20:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.530+0000 7fdfd7b03640 1 -- 172.21.15.55:0/2899992365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd0155f10 con 0x7fdfd00c89b0 2023-07-06T22:20:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.534+0000 7fdfd7b03640 1 -- 172.21.15.55:0/2899992365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd0066d60 con 0x7fdfd00c89b0 2023-07-06T22:20:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.534+0000 7fdfc67fc640 1 -- 172.21.15.55:0/2899992365 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdfcc012c60 con 0x7fdfd00c89b0 2023-07-06T22:20:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.534+0000 7fdfc67fc640 1 --2- 172.21.15.55:0/2899992365 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fdfb40663a0 0x7fdfb4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.534+0000 7fdfc67fc640 1 -- 172.21.15.55:0/2899992365 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6789+0+0 (secure 0 0 0) 0x7fdfcc0846e0 con 0x7fdfd00c89b0 2023-07-06T22:20:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.534+0000 7fdfd509e640 1 --2- 172.21.15.55:0/2899992365 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fdfb40663a0 0x7fdfb4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.534+0000 7fdfd509e640 1 --2- 172.21.15.55:0/2899992365 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fdfb40663a0 0x7fdfb4068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdfd006cc40 tx=0x7fdfc0009040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:54.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.538+0000 7fdfc67fc640 1 -- 172.21.15.55:0/2899992365 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfcc051770 con 0x7fdfd00c89b0 2023-07-06T22:20:54.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:54.694+0000 7fdfd7b03640 1 -- 172.21.15.55:0/2899992365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdfd00cd9d0 con 0x7fdfd00c89b0 2023-07-06T22:20:55.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.354+0000 7fdfc67fc640 1 -- 172.21.15.55:0/2899992365 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v201) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdfcc054d90 con 0x7fdfd00c89b0 2023-07-06T22:20:55.357 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-07-06T22:20:55.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.358+0000 7fdfd7b03640 1 -- 172.21.15.55:0/2899992365 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fdfb40663a0 msgr2=0x7fdfb4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:55.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.358+0000 7fdfd7b03640 1 --2- 172.21.15.55:0/2899992365 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fdfb40663a0 0x7fdfb4068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdfd006cc40 tx=0x7fdfc0009040 comp rx=0 tx=0).stop 2023-07-06T22:20:55.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.358+0000 7fdfd7b03640 1 -- 172.21.15.55:0/2899992365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd00c89b0 msgr2=0x7fdfd0150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:55.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.358+0000 7fdfd7b03640 1 --2- 172.21.15.55:0/2899992365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd00c89b0 0x7fdfd0150590 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00d5f0 tx=0x7fdfcc00dab0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.358+0000 7fdfd7b03640 1 -- 172.21.15.55:0/2899992365 shutdown_connections 2023-07-06T22:20:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.358+0000 7fdfd7b03640 1 --2- 172.21.15.55:0/2899992365 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fdfb40663a0 0x7fdfb4068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.358+0000 7fdfd7b03640 1 --2- 172.21.15.55:0/2899992365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfd0158780 0x7fdfd014f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.358+0000 7fdfd7b03640 1 --2- 172.21.15.55:0/2899992365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfd00cbfa0 0x7fdfd01572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.358+0000 7fdfd7b03640 1 --2- 172.21.15.55:0/2899992365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd00c89b0 0x7fdfd0150590 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.358+0000 7fdfd7b03640 1 -- 172.21.15.55:0/2899992365 >> 172.21.15.55:0/2899992365 conn(0x7fdfd00cde30 msgr2=0x7fdfd00ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:55.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.358+0000 7fdfd7b03640 1 -- 172.21.15.55:0/2899992365 shutdown_connections 2023-07-06T22:20:55.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.358+0000 7fdfd7b03640 1 -- 172.21.15.55:0/2899992365 wait complete. 2023-07-06T22:20:55.390 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-06T22:20:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.550+0000 7f690c3e9640 1 Processor -- start 2023-07-06T22:20:55.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.550+0000 7f690c3e9640 1 -- start start 2023-07-06T22:20:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.550+0000 7f690c3e9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f69040709a0 0x7f69040cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.550+0000 7f690c3e9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f69040cbe60 0x7f69040b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.550+0000 7f690c3e9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69040cc300 con 0x7f6904070d70 2023-07-06T22:20:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.550+0000 7f690c3e9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69040cc5e0 con 0x7f69040709a0 2023-07-06T22:20:55.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.550+0000 7f690c3e9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69040cc8c0 con 0x7f69040cbe60 2023-07-06T22:20:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.550+0000 7f690a185640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f69040709a0 0x7f69040cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.550+0000 7f690a185640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f69040709a0 0x7f69040cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44364/0 (socket says 172.21.15.55:44364) 2023-07-06T22:20:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.550+0000 7f690a185640 1 -- 172.21.15.55:0/4259489533 learned_addr learned my addr 172.21.15.55:0/4259489533 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:55.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.550+0000 7f6909984640 1 --2- 172.21.15.55:0/4259489533 >> v2:172.21.15.138:3300/0 conn(0x7f69040cbe60 0x7f69040b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:55.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.550+0000 7f690a185640 1 -- 172.21.15.55:0/4259489533 >> v2:172.21.15.138:3300/0 conn(0x7f69040cbe60 msgr2=0x7f69040b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:55.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.550+0000 7f690a185640 1 --2- 172.21.15.55:0/4259489533 >> v2:172.21.15.138:3300/0 conn(0x7f69040cbe60 0x7f69040b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.550+0000 7f690a185640 1 -- 172.21.15.55:0/4259489533 >> v1:172.21.15.138:6789/0 conn(0x7f6904070d70 legacy=0x7f690415d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:55.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.554+0000 7f690a185640 1 -- 172.21.15.55:0/4259489533 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69040ccba0 con 0x7f69040709a0 2023-07-06T22:20:55.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.554+0000 7f690a185640 1 --2- 172.21.15.55:0/4259489533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69040709a0 0x7f69040cb920 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f69040ca7c0 tx=0x7f690001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f55e92e853ee43 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:55.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.554+0000 7f6909183640 1 -- 172.21.15.55:0/4259489533 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69000ab600 con 0x7f69040709a0 2023-07-06T22:20:55.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.554+0000 7f6909183640 1 -- 172.21.15.55:0/4259489533 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69000a7050 con 0x7f69040709a0 2023-07-06T22:20:55.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.554+0000 7f6909183640 1 -- 172.21.15.55:0/4259489533 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69000ab980 con 0x7f69040709a0 2023-07-06T22:20:55.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.554+0000 7f690c3e9640 1 -- 172.21.15.55:0/4259489533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69040709a0 msgr2=0x7f69040cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:55.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.554+0000 7f690c3e9640 1 --2- 172.21.15.55:0/4259489533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69040709a0 0x7f69040cb920 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f69040ca7c0 tx=0x7f690001c500 comp rx=0 tx=0).stop 2023-07-06T22:20:55.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690c3e9640 1 -- 172.21.15.55:0/4259489533 shutdown_connections 2023-07-06T22:20:55.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690c3e9640 1 --2- 172.21.15.55:0/4259489533 >> v2:172.21.15.138:3300/0 conn(0x7f69040cbe60 0x7f69040b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690c3e9640 1 --2- 172.21.15.55:0/4259489533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69040709a0 0x7f69040cb920 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690c3e9640 1 -- 172.21.15.55:0/4259489533 >> 172.21.15.55:0/4259489533 conn(0x7f69040cea70 msgr2=0x7f69040ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:55.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690c3e9640 1 -- 172.21.15.55:0/4259489533 shutdown_connections 2023-07-06T22:20:55.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690c3e9640 1 -- 172.21.15.55:0/4259489533 wait complete. 2023-07-06T22:20:55.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690c3e9640 1 Processor -- start 2023-07-06T22:20:55.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690c3e9640 1 -- start start 2023-07-06T22:20:55.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690c3e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69040709a0 0x7f6904151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690c3e9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6904070d70 0x7f69040c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690c3e9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69040cbe60 0x7f6904156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690c3e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6904155970 con 0x7f69040709a0 2023-07-06T22:20:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690c3e9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6904155bc0 con 0x7f6904070d70 2023-07-06T22:20:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690c3e9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6904155ea0 con 0x7f69040cbe60 2023-07-06T22:20:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690a185640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69040709a0 0x7f6904151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690a185640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69040709a0 0x7f6904151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44374/0 (socket says 172.21.15.55:44374) 2023-07-06T22:20:55.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690a185640 1 -- 172.21.15.55:0/1936112750 learned_addr learned my addr 172.21.15.55:0/1936112750 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:55.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f6909984640 1 --2- 172.21.15.55:0/1936112750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6904070d70 0x7f69040c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:55.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690a986640 1 --2- 172.21.15.55:0/1936112750 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69040cbe60 0x7f6904156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:55.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690a185640 1 -- 172.21.15.55:0/1936112750 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69040cbe60 msgr2=0x7f6904156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:55.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690a185640 1 --2- 172.21.15.55:0/1936112750 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69040cbe60 0x7f6904156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690a185640 1 -- 172.21.15.55:0/1936112750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6904070d70 msgr2=0x7f69040c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:55.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690a185640 1 --2- 172.21.15.55:0/1936112750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6904070d70 0x7f69040c3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690a185640 1 -- 172.21.15.55:0/1936112750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69000094d0 con 0x7f69040709a0 2023-07-06T22:20:55.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.558+0000 7f690a185640 1 --2- 172.21.15.55:0/1936112750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69040709a0 0x7f6904151c30 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7f69000ae040 tx=0x7f69000192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:55.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.562+0000 7f68faffd640 1 -- 172.21.15.55:0/1936112750 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69000b4440 con 0x7f69040709a0 2023-07-06T22:20:55.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.562+0000 7f68faffd640 1 -- 172.21.15.55:0/1936112750 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69000b45a0 con 0x7f69040709a0 2023-07-06T22:20:55.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.562+0000 7f68faffd640 1 -- 172.21.15.55:0/1936112750 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69000b4930 con 0x7f69040709a0 2023-07-06T22:20:55.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.562+0000 7f690c3e9640 1 -- 172.21.15.55:0/1936112750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6904156180 con 0x7f69040709a0 2023-07-06T22:20:55.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.562+0000 7f690c3e9640 1 -- 172.21.15.55:0/1936112750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6904152170 con 0x7f69040709a0 2023-07-06T22:20:55.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.562+0000 7f690c3e9640 1 -- 172.21.15.55:0/1936112750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6904066d60 con 0x7f69040709a0 2023-07-06T22:20:55.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.562+0000 7f68faffd640 1 -- 172.21.15.55:0/1936112750 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f69000b2070 con 0x7f69040709a0 2023-07-06T22:20:55.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.562+0000 7f68faffd640 1 --2- 172.21.15.55:0/1936112750 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f68e80663a0 0x7f68e8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:55.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.562+0000 7f68faffd640 1 -- 172.21.15.55:0/1936112750 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f690011df30 con 0x7f69040709a0 2023-07-06T22:20:55.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.562+0000 7f6909984640 1 --2- 172.21.15.55:0/1936112750 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f68e80663a0 0x7f68e8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:55.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.566+0000 7f6909984640 1 --2- 172.21.15.55:0/1936112750 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f68e80663a0 0x7f68e8068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f69040c4a60 tx=0x7f68f4008040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:55.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.566+0000 7f68faffd640 1 -- 172.21.15.55:0/1936112750 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69000eb0f0 con 0x7f69040709a0 2023-07-06T22:20:55.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.722+0000 7f690c3e9640 1 -- 172.21.15.55:0/1936112750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f6904156630 con 0x7f69040709a0 2023-07-06T22:20:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.726+0000 7f68faffd640 1 -- 172.21.15.55:0/1936112750 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v67) v1 ==== 120+0+0 (secure 0 0 0) 0x7f69000ee710 con 0x7f69040709a0 2023-07-06T22:20:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.726+0000 7f690c3e9640 1 -- 172.21.15.55:0/1936112750 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f68e80663a0 msgr2=0x7f68e8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.726+0000 7f690c3e9640 1 --2- 172.21.15.55:0/1936112750 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f68e80663a0 0x7f68e8068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f69040c4a60 tx=0x7f68f4008040 comp rx=0 tx=0).stop 2023-07-06T22:20:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.726+0000 7f690c3e9640 1 -- 172.21.15.55:0/1936112750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69040709a0 msgr2=0x7f6904151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.726+0000 7f690c3e9640 1 --2- 172.21.15.55:0/1936112750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69040709a0 0x7f6904151c30 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7f69000ae040 tx=0x7f69000192a0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.730+0000 7f690c3e9640 1 -- 172.21.15.55:0/1936112750 shutdown_connections 2023-07-06T22:20:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.730+0000 7f690c3e9640 1 --2- 172.21.15.55:0/1936112750 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f68e80663a0 0x7f68e8068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.730+0000 7f690c3e9640 1 --2- 172.21.15.55:0/1936112750 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69040cbe60 0x7f6904156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.730+0000 7f690c3e9640 1 --2- 172.21.15.55:0/1936112750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6904070d70 0x7f69040c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.730+0000 7f690c3e9640 1 --2- 172.21.15.55:0/1936112750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69040709a0 0x7f6904151c30 unknown :-1 s=CLOSED pgs=2346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.730+0000 7f690c3e9640 1 -- 172.21.15.55:0/1936112750 >> 172.21.15.55:0/1936112750 conn(0x7f69040cea70 msgr2=0x7f69040af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.730+0000 7f690c3e9640 1 -- 172.21.15.55:0/1936112750 shutdown_connections 2023-07-06T22:20:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.730+0000 7f690c3e9640 1 -- 172.21.15.55:0/1936112750 wait complete. 2023-07-06T22:20:55.751 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-06T22:20:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f50918f9640 1 Processor -- start 2023-07-06T22:20:55.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f50918f9640 1 -- start start 2023-07-06T22:20:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f50918f9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f508c1597d0 0x7f508c0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f50918f9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c0cd490 con 0x7f508c0cac10 2023-07-06T22:20:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f50918f9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c15cf60 con 0x7f508c070700 2023-07-06T22:20:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f50918f9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c0cb040 con 0x7f508c1597d0 2023-07-06T22:20:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f508a7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f508c0cac10 0x7f508c06fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53834/0 (socket says 172.21.15.55:53834) 2023-07-06T22:20:55.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f508a7fc640 1 -- 172.21.15.55:0/2925742053 learned_addr learned my addr 172.21.15.55:0/2925742053 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f508affd640 1 --2- 172.21.15.55:0/2925742053 >> v2:172.21.15.138:3300/0 conn(0x7f508c1597d0 0x7f508c0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572442520 0 0) 0x7f508c0cd490 con 0x7f508c0cac10 2023-07-06T22:20:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5074003530 con 0x7f508c0cac10 2023-07-06T22:20:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891112564 0 0) 0x7f508c15cf60 con 0x7f508c070700 2023-07-06T22:20:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f508c0cd490 con 0x7f508c070700 2023-07-06T22:20:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3146594572 0 0) 0x7f5074003530 con 0x7f508c0cac10 2023-07-06T22:20:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 >> v2:172.21.15.138:3300/0 conn(0x7f508c1597d0 msgr2=0x7f508c0ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:55.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 --2- 172.21.15.55:0/2925742053 >> v2:172.21.15.138:3300/0 conn(0x7f508c1597d0 0x7f508c0ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 >> v1:172.21.15.138:6789/0 conn(0x7f508c070700 legacy=0x7f508c0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:55.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c0ccb60 con 0x7f508c0cac10 2023-07-06T22:20:55.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f5080001600 con 0x7f508c0cac10 2023-07-06T22:20:55.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 >> v1:172.21.15.55:6789/0 conn(0x7f508c0cac10 legacy=0x7f508c06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:55.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 --2- 172.21.15.55:0/2925742053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5074003b60 0x7f5074003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:55.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 --2- 172.21.15.55:0/2925742053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50740047d0 0x7f5074004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:55.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 --2- 172.21.15.55:0/2925742053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50740051d0 0x7f507400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507400c0b0 con 0x7f50740047d0 2023-07-06T22:20:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507400c220 con 0x7f5074003b60 2023-07-06T22:20:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507400c3e0 con 0x7f50740051d0 2023-07-06T22:20:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f508affd640 1 --2- 172.21.15.55:0/2925742053 >> v2:172.21.15.138:3300/0 conn(0x7f508c1597d0 0x7f508c0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f508a7fc640 1 --2- 172.21.15.55:0/2925742053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50740047d0 0x7f5074004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f508b7fe640 1 --2- 172.21.15.55:0/2925742053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50740051d0 0x7f507400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f508affd640 1 --2- 172.21.15.55:0/2925742053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5074003b60 0x7f5074003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f508a7fc640 1 -- 172.21.15.55:0/2925742053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50740051d0 msgr2=0x7f507400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f508a7fc640 1 --2- 172.21.15.55:0/2925742053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50740051d0 0x7f507400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f508a7fc640 1 -- 172.21.15.55:0/2925742053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5074003b60 msgr2=0x7f5074003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f508a7fc640 1 --2- 172.21.15.55:0/2925742053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5074003b60 0x7f5074003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f508a7fc640 1 -- 172.21.15.55:0/2925742053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5074003530 con 0x7f50740047d0 2023-07-06T22:20:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f508b7fe640 1 -- 172.21.15.55:0/2925742053 reap_dead start 2023-07-06T22:20:55.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.894+0000 7f508affd640 1 --2- 172.21.15.55:0/2925742053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5074003b60 0x7f5074003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:55.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.898+0000 7f508a7fc640 1 --2- 172.21.15.55:0/2925742053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50740047d0 0x7f5074004c40 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f5080007ef0 tx=0x7f508001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5838ec84a17dce8a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:55.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.898+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080005ae0 con 0x7f50740047d0 2023-07-06T22:20:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.898+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5080005c40 con 0x7f50740047d0 2023-07-06T22:20:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.898+0000 7f5089ffb640 1 -- 172.21.15.55:0/2925742053 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800a5770 con 0x7f50740047d0 2023-07-06T22:20:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.898+0000 7f50918f9640 1 -- 172.21.15.55:0/2925742053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50740047d0 msgr2=0x7f5074004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.898+0000 7f50918f9640 1 --2- 172.21.15.55:0/2925742053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50740047d0 0x7f5074004c40 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f5080007ef0 tx=0x7f508001c9f0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.898+0000 7f50918f9640 1 -- 172.21.15.55:0/2925742053 shutdown_connections 2023-07-06T22:20:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.898+0000 7f50918f9640 1 --2- 172.21.15.55:0/2925742053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50740047d0 0x7f5074004c40 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.898+0000 7f50918f9640 1 -- 172.21.15.55:0/2925742053 >> 172.21.15.55:0/2925742053 conn(0x7f508c0cb970 msgr2=0x7f508c0cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:55.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.898+0000 7f50918f9640 1 -- 172.21.15.55:0/2925742053 shutdown_connections 2023-07-06T22:20:55.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.898+0000 7f50918f9640 1 -- 172.21.15.55:0/2925742053 wait complete. 2023-07-06T22:20:55.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f50918f9640 1 Processor -- start 2023-07-06T22:20:55.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f50918f9640 1 -- start start 2023-07-06T22:20:55.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f50918f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50740047d0 0x7f508c154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:55.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f50918f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f508c14eea0 0x7f508c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:55.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f50918f9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f508c1559f0 0x7f508c155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:55.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f50918f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c14f7d0 con 0x7f508c14eea0 2023-07-06T22:20:55.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f50918f9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c1563a0 con 0x7f50740047d0 2023-07-06T22:20:55.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f50918f9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c15e1e0 con 0x7f508c1559f0 2023-07-06T22:20:55.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f508a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f508c14eea0 0x7f508c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:55.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f508a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f508c14eea0 0x7f508c15dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44394/0 (socket says 172.21.15.55:44394) 2023-07-06T22:20:55.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f508a7fc640 1 -- 172.21.15.55:0/2850539141 learned_addr learned my addr 172.21.15.55:0/2850539141 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:55.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f508b7fe640 1 --2- 172.21.15.55:0/2850539141 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f508c1559f0 0x7f508c155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:55.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f508affd640 1 --2- 172.21.15.55:0/2850539141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50740047d0 0x7f508c154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:55.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f508a7fc640 1 -- 172.21.15.55:0/2850539141 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f508c1559f0 msgr2=0x7f508c155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:55.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f508a7fc640 1 --2- 172.21.15.55:0/2850539141 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f508c1559f0 0x7f508c155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f508a7fc640 1 -- 172.21.15.55:0/2850539141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50740047d0 msgr2=0x7f508c154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:55.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f508a7fc640 1 --2- 172.21.15.55:0/2850539141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50740047d0 0x7f508c154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:55.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f508a7fc640 1 -- 172.21.15.55:0/2850539141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c154780 con 0x7f508c14eea0 2023-07-06T22:20:55.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f508a7fc640 1 --2- 172.21.15.55:0/2850539141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f508c14eea0 0x7f508c15dca0 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f508001c820 tx=0x7f5074005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:55.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f5073fff640 1 -- 172.21.15.55:0/2850539141 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800b4070 con 0x7f508c14eea0 2023-07-06T22:20:55.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f5073fff640 1 -- 172.21.15.55:0/2850539141 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50800a5770 con 0x7f508c14eea0 2023-07-06T22:20:55.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f50918f9640 1 -- 172.21.15.55:0/2850539141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c154a60 con 0x7f508c14eea0 2023-07-06T22:20:55.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f5073fff640 1 -- 172.21.15.55:0/2850539141 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800a5b00 con 0x7f508c14eea0 2023-07-06T22:20:55.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.902+0000 7f50918f9640 1 -- 172.21.15.55:0/2850539141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c155020 con 0x7f508c14eea0 2023-07-06T22:20:55.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.906+0000 7f50918f9640 1 -- 172.21.15.55:0/2850539141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c066d60 con 0x7f508c14eea0 2023-07-06T22:20:55.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.906+0000 7f5073fff640 1 -- 172.21.15.55:0/2850539141 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f50800a5c60 con 0x7f508c14eea0 2023-07-06T22:20:55.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.906+0000 7f5073fff640 1 --2- 172.21.15.55:0/2850539141 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f50780663d0 0x7f5078068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:55.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.906+0000 7f5073fff640 1 -- 172.21.15.55:0/2850539141 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f508011dbb0 con 0x7f508c14eea0 2023-07-06T22:20:55.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.906+0000 7f508affd640 1 --2- 172.21.15.55:0/2850539141 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f50780663d0 0x7f5078068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:55.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.906+0000 7f508affd640 1 --2- 172.21.15.55:0/2850539141 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f50780663d0 0x7f5078068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f508c04f0d0 tx=0x7f507c008040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:55.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:55.910+0000 7f5073fff640 1 -- 172.21.15.55:0/2850539141 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50800eacc0 con 0x7f508c14eea0 2023-07-06T22:20:56.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.066+0000 7f50918f9640 1 -- 172.21.15.55:0/2850539141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f508c06fff0 con 0x7f508c14eea0 2023-07-06T22:20:56.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.070+0000 7f5073fff640 1 -- 172.21.15.55:0/2850539141 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7f50800ee2e0 con 0x7f508c14eea0 2023-07-06T22:20:56.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.070+0000 7f50918f9640 1 -- 172.21.15.55:0/2850539141 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f50780663d0 msgr2=0x7f5078068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:56.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.070+0000 7f50918f9640 1 --2- 172.21.15.55:0/2850539141 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f50780663d0 0x7f5078068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f508c04f0d0 tx=0x7f507c008040 comp rx=0 tx=0).stop 2023-07-06T22:20:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.070+0000 7f50918f9640 1 -- 172.21.15.55:0/2850539141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f508c14eea0 msgr2=0x7f508c15dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.070+0000 7f50918f9640 1 --2- 172.21.15.55:0/2850539141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f508c14eea0 0x7f508c15dca0 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f508001c820 tx=0x7f5074005800 comp rx=0 tx=0).stop 2023-07-06T22:20:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.070+0000 7f50918f9640 1 -- 172.21.15.55:0/2850539141 shutdown_connections 2023-07-06T22:20:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.070+0000 7f50918f9640 1 --2- 172.21.15.55:0/2850539141 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f50780663d0 0x7f5078068880 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.070+0000 7f50918f9640 1 --2- 172.21.15.55:0/2850539141 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f508c1559f0 0x7f508c155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.070+0000 7f50918f9640 1 --2- 172.21.15.55:0/2850539141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f508c14eea0 0x7f508c15dca0 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.070+0000 7f50918f9640 1 --2- 172.21.15.55:0/2850539141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50740047d0 0x7f508c154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.070+0000 7f50918f9640 1 -- 172.21.15.55:0/2850539141 >> 172.21.15.55:0/2850539141 conn(0x7f508c0cb970 msgr2=0x7f508c15e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:56.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.074+0000 7f50918f9640 1 -- 172.21.15.55:0/2850539141 shutdown_connections 2023-07-06T22:20:56.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.074+0000 7f50918f9640 1 -- 172.21.15.55:0/2850539141 wait complete. 2023-07-06T22:20:56.094 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-06T22:20:56.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.238+0000 7f35aba96640 1 Processor -- start 2023-07-06T22:20:56.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.238+0000 7f35aba96640 1 -- start start 2023-07-06T22:20:56.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.238+0000 7f35aba96640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f35a40ca610 0x7f35a40cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:56.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.238+0000 7f35aba96640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a415f5d0 con 0x7f35a406f0e0 2023-07-06T22:20:56.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.238+0000 7f35aba96640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a415f8b0 con 0x7f35a4156180 2023-07-06T22:20:56.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.238+0000 7f35aba96640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a4160250 con 0x7f35a40ca610 2023-07-06T22:20:56.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.238+0000 7f35a9031640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f35a406f0e0 0x7f35a40cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53838/0 (socket says 172.21.15.55:53838) 2023-07-06T22:20:56.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.238+0000 7f35a9031640 1 -- 172.21.15.55:0/3813644223 learned_addr learned my addr 172.21.15.55:0/3813644223 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:56.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.238+0000 7f35aa033640 1 --2- 172.21.15.55:0/3813644223 >> v2:172.21.15.138:3300/0 conn(0x7f35a40ca610 0x7f35a40cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:56.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.238+0000 7f35a8830640 1 -- 172.21.15.55:0/3813644223 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061795454 0 0) 0x7f35a415f5d0 con 0x7f35a406f0e0 2023-07-06T22:20:56.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.238+0000 7f35a8830640 1 -- 172.21.15.55:0/3813644223 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3590003530 con 0x7f35a406f0e0 2023-07-06T22:20:56.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.238+0000 7f35aa033640 1 -- 172.21.15.55:0/3813644223 >> v1:172.21.15.138:6789/0 conn(0x7f35a4156180 legacy=0x7f35a406e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:56.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.238+0000 7f35aa033640 1 -- 172.21.15.55:0/3813644223 >> v1:172.21.15.55:6789/0 conn(0x7f35a406f0e0 legacy=0x7f35a40cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:56.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.238+0000 7f35aa033640 1 -- 172.21.15.55:0/3813644223 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a415fb90 con 0x7f35a40ca610 2023-07-06T22:20:56.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.242+0000 7f35aa033640 1 --2- 172.21.15.55:0/3813644223 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35a40ca610 0x7f35a40cbeb0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f359c009d90 tx=0x7f359c01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81758df293cd921 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:56.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.242+0000 7f35a8830640 1 -- 172.21.15.55:0/3813644223 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c0a5890 con 0x7f35a40ca610 2023-07-06T22:20:56.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.242+0000 7f35a8830640 1 -- 172.21.15.55:0/3813644223 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c0a59f0 con 0x7f35a40ca610 2023-07-06T22:20:56.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.242+0000 7f35a8830640 1 -- 172.21.15.55:0/3813644223 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c0a5d80 con 0x7f35a40ca610 2023-07-06T22:20:56.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.242+0000 7f35aba96640 1 -- 172.21.15.55:0/3813644223 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35a40ca610 msgr2=0x7f35a40cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:56.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.242+0000 7f35aba96640 1 --2- 172.21.15.55:0/3813644223 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35a40ca610 0x7f35a40cbeb0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f359c009d90 tx=0x7f359c01c8c0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.242+0000 7f35aba96640 1 -- 172.21.15.55:0/3813644223 shutdown_connections 2023-07-06T22:20:56.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.242+0000 7f35aba96640 1 --2- 172.21.15.55:0/3813644223 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35a40ca610 0x7f35a40cbeb0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.242+0000 7f35aba96640 1 -- 172.21.15.55:0/3813644223 >> 172.21.15.55:0/3813644223 conn(0x7f35a40d0c50 msgr2=0x7f35a40cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:56.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.242+0000 7f35aba96640 1 -- 172.21.15.55:0/3813644223 shutdown_connections 2023-07-06T22:20:56.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.242+0000 7f35aba96640 1 -- 172.21.15.55:0/3813644223 wait complete. 2023-07-06T22:20:56.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aba96640 1 Processor -- start 2023-07-06T22:20:56.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aba96640 1 -- start start 2023-07-06T22:20:56.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aba96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35a406f0e0 0x7f35a41578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:56.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aba96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35a40ca610 0x7f35a40c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:56.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aba96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4156180 0x7f35a41553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:56.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aba96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a41590c0 con 0x7f35a4156180 2023-07-06T22:20:56.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aba96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a414f140 con 0x7f35a40ca610 2023-07-06T22:20:56.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aba96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40cc0c0 con 0x7f35a406f0e0 2023-07-06T22:20:56.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aa033640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4156180 0x7f35a41553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:56.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aa033640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4156180 0x7f35a41553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44400/0 (socket says 172.21.15.55:44400) 2023-07-06T22:20:56.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aa033640 1 -- 172.21.15.55:0/3367050120 learned_addr learned my addr 172.21.15.55:0/3367050120 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:56.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35a9031640 1 --2- 172.21.15.55:0/3367050120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35a40ca610 0x7f35a40c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:56.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35a9832640 1 --2- 172.21.15.55:0/3367050120 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35a406f0e0 0x7f35a41578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:56.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aa033640 1 -- 172.21.15.55:0/3367050120 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35a406f0e0 msgr2=0x7f35a41578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aa033640 1 --2- 172.21.15.55:0/3367050120 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35a406f0e0 0x7f35a41578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aa033640 1 -- 172.21.15.55:0/3367050120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35a40ca610 msgr2=0x7f35a40c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aa033640 1 --2- 172.21.15.55:0/3367050120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35a40ca610 0x7f35a40c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aa033640 1 -- 172.21.15.55:0/3367050120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c009a70 con 0x7f35a4156180 2023-07-06T22:20:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aa033640 1 --2- 172.21.15.55:0/3367050120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4156180 0x7f35a41553b0 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f359c01a4f0 tx=0x7f359c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f359a7fc640 1 -- 172.21.15.55:0/3367050120 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c0ad8d0 con 0x7f35a4156180 2023-07-06T22:20:56.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f359a7fc640 1 -- 172.21.15.55:0/3367050120 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c0ada30 con 0x7f35a4156180 2023-07-06T22:20:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f359a7fc640 1 -- 172.21.15.55:0/3367050120 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c0adda0 con 0x7f35a4156180 2023-07-06T22:20:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aba96640 1 -- 172.21.15.55:0/3367050120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a40cbde0 con 0x7f35a4156180 2023-07-06T22:20:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aba96640 1 -- 172.21.15.55:0/3367050120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a414f4d0 con 0x7f35a4156180 2023-07-06T22:20:56.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.246+0000 7f35aba96640 1 -- 172.21.15.55:0/3367050120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a4159810 con 0x7f35a4156180 2023-07-06T22:20:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.250+0000 7f359a7fc640 1 -- 172.21.15.55:0/3367050120 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f359c0b9450 con 0x7f35a4156180 2023-07-06T22:20:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.250+0000 7f359a7fc640 1 --2- 172.21.15.55:0/3367050120 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f35880663d0 0x7f3588068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.250+0000 7f359a7fc640 1 -- 172.21.15.55:0/3367050120 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f359c11f330 con 0x7f35a4156180 2023-07-06T22:20:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.250+0000 7f35a9832640 1 --2- 172.21.15.55:0/3367050120 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f35880663d0 0x7f3588068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:56.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.250+0000 7f35a9832640 1 --2- 172.21.15.55:0/3367050120 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f35880663d0 0x7f3588068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f35a0007fd0 tx=0x7f35a0009040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:56.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.254+0000 7f359a7fc640 1 -- 172.21.15.55:0/3367050120 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35a4159810 con 0x7f35a4156180 2023-07-06T22:20:56.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.410+0000 7f35aba96640 1 -- 172.21.15.55:0/3367050120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f35a4159810 con 0x7f35a4156180 2023-07-06T22:20:56.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.414+0000 7f359a7fc640 1 -- 172.21.15.55:0/3367050120 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v69) v1 ==== 115+0+0 (secure 0 0 0) 0x7f35a4159810 con 0x7f35a4156180 2023-07-06T22:20:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.418+0000 7f35aba96640 1 -- 172.21.15.55:0/3367050120 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f35880663d0 msgr2=0x7f3588068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.418+0000 7f35aba96640 1 --2- 172.21.15.55:0/3367050120 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f35880663d0 0x7f3588068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f35a0007fd0 tx=0x7f35a0009040 comp rx=0 tx=0).stop 2023-07-06T22:20:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.418+0000 7f35aba96640 1 -- 172.21.15.55:0/3367050120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4156180 msgr2=0x7f35a41553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.418+0000 7f35aba96640 1 --2- 172.21.15.55:0/3367050120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4156180 0x7f35a41553b0 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f359c01a4f0 tx=0x7f359c019660 comp rx=0 tx=0).stop 2023-07-06T22:20:56.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.418+0000 7f35aba96640 1 -- 172.21.15.55:0/3367050120 shutdown_connections 2023-07-06T22:20:56.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.418+0000 7f35aba96640 1 --2- 172.21.15.55:0/3367050120 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f35880663d0 0x7f3588068880 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.418+0000 7f35aba96640 1 --2- 172.21.15.55:0/3367050120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4156180 0x7f35a41553b0 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.418+0000 7f35aba96640 1 --2- 172.21.15.55:0/3367050120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35a40ca610 0x7f35a40c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.418+0000 7f35aba96640 1 --2- 172.21.15.55:0/3367050120 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35a406f0e0 0x7f35a41578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.418+0000 7f35aba96640 1 -- 172.21.15.55:0/3367050120 >> 172.21.15.55:0/3367050120 conn(0x7f35a40d0c50 msgr2=0x7f35a415e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:56.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.418+0000 7f35aba96640 1 -- 172.21.15.55:0/3367050120 shutdown_connections 2023-07-06T22:20:56.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.418+0000 7f35aba96640 1 -- 172.21.15.55:0/3367050120 wait complete. 2023-07-06T22:20:56.441 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-07-06T22:20:56.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d3112640 1 Processor -- start 2023-07-06T22:20:56.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d3112640 1 -- start start 2023-07-06T22:20:56.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d3112640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff5cc150b10 0x7ff5cc0693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:56.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d3112640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5cc0c9b40 0x7ff5cc0c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:56.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d3112640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5cc071240 con 0x7ff5cc070490 2023-07-06T22:20:56.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d3112640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5cc0ca4a0 con 0x7ff5cc150b10 2023-07-06T22:20:56.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d3112640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc15a770 con 0x7ff5cc0c9b40 2023-07-06T22:20:56.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d190f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff5cc070490 0x7ff5cc159ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53842/0 (socket says 172.21.15.55:53842) 2023-07-06T22:20:56.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d190f640 1 -- 172.21.15.55:0/3704844721 learned_addr learned my addr 172.21.15.55:0/3704844721 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d2110640 1 --2- 172.21.15.55:0/3704844721 >> v2:172.21.15.138:3300/0 conn(0x7ff5cc150b10 0x7ff5cc0693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d2911640 1 --2- 172.21.15.55:0/3704844721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5cc0c9b40 0x7ff5cc0c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 -- 172.21.15.55:0/3704844721 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075093326 0 0) 0x7ff5cc071240 con 0x7ff5cc070490 2023-07-06T22:20:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 -- 172.21.15.55:0/3704844721 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5b8003530 con 0x7ff5cc070490 2023-07-06T22:20:56.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 -- 172.21.15.55:0/3704844721 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 163522905 0 0) 0x7ff5b8003530 con 0x7ff5cc070490 2023-07-06T22:20:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 -- 172.21.15.55:0/3704844721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5cc0c9b40 msgr2=0x7ff5cc0c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 --2- 172.21.15.55:0/3704844721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5cc0c9b40 0x7ff5cc0c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 -- 172.21.15.55:0/3704844721 >> v2:172.21.15.138:3300/0 conn(0x7ff5cc150b10 msgr2=0x7ff5cc0693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 --2- 172.21.15.55:0/3704844721 >> v2:172.21.15.138:3300/0 conn(0x7ff5cc150b10 0x7ff5cc0693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 -- 172.21.15.55:0/3704844721 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc15aa50 con 0x7ff5cc070490 2023-07-06T22:20:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 -- 172.21.15.55:0/3704844721 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7ff5bc0016a0 con 0x7ff5cc070490 2023-07-06T22:20:56.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 -- 172.21.15.55:0/3704844721 >> v1:172.21.15.55:6789/0 conn(0x7ff5cc070490 legacy=0x7ff5cc159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 --2- 172.21.15.55:0/3704844721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b8003980 0x7ff5b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 --2- 172.21.15.55:0/3704844721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5cc0c9b40 0x7ff5b80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 --2- 172.21.15.55:0/3704844721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b8004d10 0x7ff5b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 -- 172.21.15.55:0/3704844721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc0ca4a0 con 0x7ff5b8004d10 2023-07-06T22:20:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 -- 172.21.15.55:0/3704844721 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc15a770 con 0x7ff5b8003980 2023-07-06T22:20:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d110e640 1 -- 172.21.15.55:0/3704844721 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b800b990 con 0x7ff5cc0c9b40 2023-07-06T22:20:56.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d2911640 1 --2- 172.21.15.55:0/3704844721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b8004d10 0x7ff5b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:56.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d190f640 1 --2- 172.21.15.55:0/3704844721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5cc0c9b40 0x7ff5b80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:56.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d2110640 1 --2- 172.21.15.55:0/3704844721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b8003980 0x7ff5b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:56.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d2911640 1 -- 172.21.15.55:0/3704844721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5cc0c9b40 msgr2=0x7ff5b80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:56.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d2911640 1 --2- 172.21.15.55:0/3704844721 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5cc0c9b40 0x7ff5b80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d2911640 1 -- 172.21.15.55:0/3704844721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b8003980 msgr2=0x7ff5b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:56.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.582+0000 7ff5d2911640 1 --2- 172.21.15.55:0/3704844721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b8003980 0x7ff5b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.586+0000 7ff5d2911640 1 -- 172.21.15.55:0/3704844721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b8003530 con 0x7ff5b8004d10 2023-07-06T22:20:56.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.586+0000 7ff5d2911640 1 --2- 172.21.15.55:0/3704844721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b8004d10 0x7ff5b8005180 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009fc0 tx=0x7ff5c401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f448705fae76b0c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:56.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.586+0000 7ff5d110e640 1 -- 172.21.15.55:0/3704844721 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40a5c70 con 0x7ff5b8004d10 2023-07-06T22:20:56.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.586+0000 7ff5d110e640 1 -- 172.21.15.55:0/3704844721 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c400f040 con 0x7ff5b8004d10 2023-07-06T22:20:56.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.586+0000 7ff5d110e640 1 -- 172.21.15.55:0/3704844721 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40ad440 con 0x7ff5b8004d10 2023-07-06T22:20:56.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.586+0000 7ff5d3112640 1 -- 172.21.15.55:0/3704844721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b8004d10 msgr2=0x7ff5b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:56.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.586+0000 7ff5d3112640 1 --2- 172.21.15.55:0/3704844721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b8004d10 0x7ff5b8005180 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009fc0 tx=0x7ff5c401cc00 comp rx=0 tx=0).stop 2023-07-06T22:20:56.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.586+0000 7ff5d2911640 1 -- 172.21.15.55:0/3704844721 reap_dead start 2023-07-06T22:20:56.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.586+0000 7ff5d3112640 1 -- 172.21.15.55:0/3704844721 shutdown_connections 2023-07-06T22:20:56.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.586+0000 7ff5d3112640 1 -- 172.21.15.55:0/3704844721 >> 172.21.15.55:0/3704844721 conn(0x7ff5cc0cdcd0 msgr2=0x7ff5cc0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:56.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.586+0000 7ff5d3112640 1 -- 172.21.15.55:0/3704844721 shutdown_connections 2023-07-06T22:20:56.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.586+0000 7ff5d3112640 1 -- 172.21.15.55:0/3704844721 wait complete. 2023-07-06T22:20:56.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d3112640 1 Processor -- start 2023-07-06T22:20:56.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d3112640 1 -- start start 2023-07-06T22:20:56.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d3112640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b8004d10 0x7ff5cc1f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:56.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d3112640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5cc0caf10 0x7ff5cc0c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:56.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d3112640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5cc0ade40 0x7ff5cc0ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:56.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d3112640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc0ae820 con 0x7ff5cc0ade40 2023-07-06T22:20:56.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d3112640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc151010 con 0x7ff5b8004d10 2023-07-06T22:20:56.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d3112640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc1f4b40 con 0x7ff5cc0caf10 2023-07-06T22:20:56.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d2911640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5cc0ade40 0x7ff5cc0ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:56.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d2911640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5cc0ade40 0x7ff5cc0ae2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44430/0 (socket says 172.21.15.55:44430) 2023-07-06T22:20:56.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d2911640 1 -- 172.21.15.55:0/2550757950 learned_addr learned my addr 172.21.15.55:0/2550757950 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:56.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d2110640 1 --2- 172.21.15.55:0/2550757950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b8004d10 0x7ff5cc1f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:56.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d190f640 1 --2- 172.21.15.55:0/2550757950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5cc0caf10 0x7ff5cc0c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:56.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d2911640 1 -- 172.21.15.55:0/2550757950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5cc0caf10 msgr2=0x7ff5cc0c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:56.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d2911640 1 --2- 172.21.15.55:0/2550757950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5cc0caf10 0x7ff5cc0c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d2911640 1 -- 172.21.15.55:0/2550757950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b8004d10 msgr2=0x7ff5cc1f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:56.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d2911640 1 --2- 172.21.15.55:0/2550757950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b8004d10 0x7ff5cc1f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:56.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d2911640 1 -- 172.21.15.55:0/2550757950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc1f4e20 con 0x7ff5cc0ade40 2023-07-06T22:20:56.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.590+0000 7ff5d2911640 1 --2- 172.21.15.55:0/2550757950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5cc0ade40 0x7ff5cc0ae2e0 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40b0040 tx=0x7ff5c4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.594+0000 7ff5c2ffd640 1 -- 172.21.15.55:0/2550757950 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40039a0 con 0x7ff5cc0ade40 2023-07-06T22:20:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.594+0000 7ff5c2ffd640 1 -- 172.21.15.55:0/2550757950 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c4003b00 con 0x7ff5cc0ade40 2023-07-06T22:20:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.594+0000 7ff5d3112640 1 -- 172.21.15.55:0/2550757950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5cc1f5100 con 0x7ff5cc0ade40 2023-07-06T22:20:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.594+0000 7ff5c2ffd640 1 -- 172.21.15.55:0/2550757950 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4003e90 con 0x7ff5cc0ade40 2023-07-06T22:20:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.594+0000 7ff5d3112640 1 -- 172.21.15.55:0/2550757950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5cc0cb380 con 0x7ff5cc0ade40 2023-07-06T22:20:56.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.594+0000 7ff5d3112640 1 -- 172.21.15.55:0/2550757950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5cc04d790 con 0x7ff5cc0ade40 2023-07-06T22:20:56.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.594+0000 7ff5c2ffd640 1 -- 172.21.15.55:0/2550757950 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff5c40b4040 con 0x7ff5cc0ade40 2023-07-06T22:20:56.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.594+0000 7ff5c2ffd640 1 --2- 172.21.15.55:0/2550757950 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff5b00663d0 0x7ff5b0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:56.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.594+0000 7ff5c2ffd640 1 -- 172.21.15.55:0/2550757950 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7ff5c411e640 con 0x7ff5cc0ade40 2023-07-06T22:20:56.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.594+0000 7ff5d2110640 1 --2- 172.21.15.55:0/2550757950 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff5b00663d0 0x7ff5b0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:56.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.594+0000 7ff5d2110640 1 --2- 172.21.15.55:0/2550757950 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff5b00663d0 0x7ff5b0068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8009b20 tx=0x7ff5c8008040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:56.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.598+0000 7ff5c2ffd640 1 -- 172.21.15.55:0/2550757950 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5c40eb910 con 0x7ff5cc0ade40 2023-07-06T22:20:56.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:56.810+0000 7ff5d3112640 1 -- 172.21.15.55:0/2550757950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7ff5cc151150 con 0x7ff5cc0ade40 2023-07-06T22:20:57.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:57.362+0000 7ff5c2ffd640 1 -- 172.21.15.55:0/2550757950 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1404) v1 ==== 155+0+0 (secure 0 0 0) 0x7ff5c40eef30 con 0x7ff5cc0ade40 2023-07-06T22:20:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:57.362+0000 7ff5d3112640 1 -- 172.21.15.55:0/2550757950 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff5b00663d0 msgr2=0x7ff5b0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:57.362+0000 7ff5d3112640 1 --2- 172.21.15.55:0/2550757950 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff5b00663d0 0x7ff5b0068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8009b20 tx=0x7ff5c8008040 comp rx=0 tx=0).stop 2023-07-06T22:20:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:57.362+0000 7ff5d3112640 1 -- 172.21.15.55:0/2550757950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5cc0ade40 msgr2=0x7ff5cc0ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:57.362+0000 7ff5d3112640 1 --2- 172.21.15.55:0/2550757950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5cc0ade40 0x7ff5cc0ae2e0 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40b0040 tx=0x7ff5c4009750 comp rx=0 tx=0).stop 2023-07-06T22:20:57.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:57.366+0000 7ff5d3112640 1 -- 172.21.15.55:0/2550757950 shutdown_connections 2023-07-06T22:20:57.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:57.366+0000 7ff5d3112640 1 --2- 172.21.15.55:0/2550757950 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff5b00663d0 0x7ff5b0068880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:57.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:57.366+0000 7ff5d3112640 1 --2- 172.21.15.55:0/2550757950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5cc0ade40 0x7ff5cc0ae2e0 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:57.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:57.366+0000 7ff5d3112640 1 --2- 172.21.15.55:0/2550757950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5cc0caf10 0x7ff5cc0c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:57.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:57.366+0000 7ff5d3112640 1 --2- 172.21.15.55:0/2550757950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b8004d10 0x7ff5cc1f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:57.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:57.366+0000 7ff5d3112640 1 -- 172.21.15.55:0/2550757950 >> 172.21.15.55:0/2550757950 conn(0x7ff5cc0cdcd0 msgr2=0x7ff5cc14fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:57.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:57.366+0000 7ff5d3112640 1 -- 172.21.15.55:0/2550757950 shutdown_connections 2023-07-06T22:20:57.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:57.366+0000 7ff5d3112640 1 -- 172.21.15.55:0/2550757950 wait complete. 2023-07-06T22:20:57.390 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-07-06T22:20:57.391 INFO:tasks.cephfs_test_runner: 2023-07-06T22:20:57.391 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-06T22:20:57.391 INFO:tasks.cephfs_test_runner:Ran 10 tests in 2279.618s 2023-07-06T22:20:57.392 INFO:tasks.cephfs_test_runner: 2023-07-06T22:20:57.392 INFO:tasks.cephfs_test_runner:OK 2023-07-06T22:20:57.392 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-07-06T22:20:57.401 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-07-06T22:20:57.426 INFO:tasks.kclient:Unmounting kernel clients... 2023-07-06T22:20:57.426 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:20:57.427 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:57.436 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:20:57.436 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-07-06T22:20:57.437 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:57.487 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357864k,nr_inodes=4089466,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276012k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-06T22:20:57.487 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:20:57.488 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:57.497 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:20:57.498 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-07-06T22:20:57.498 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T22:20:57.547 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=402 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-06T22:20:57.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:57.548 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T22:20:57.557 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T22:20:57.557 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T22:20:57.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:57.558 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T22:20:57.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:57.626 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T22:20:57.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:57.696 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2023-07-06T22:20:57.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:57.906 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-07-06T22:20:57.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:57.916 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2023-07-06T22:20:57.988 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2023-07-06T22:20:57.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T22:20:57.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:57.991 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-07-06T22:20:58.000 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-06T22:20:58.001 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-06T22:20:58.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:58.002 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-06T22:20:58.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:58.066 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-06T22:20:58.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:58.152 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2023-07-06T22:20:58.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:58.350 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-07-06T22:20:58.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T22:20:58.360 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2023-07-06T22:20:58.426 INFO:teuthology.orchestra.run.smithi138.stderr:Cannot find device "ceph-brx" 2023-07-06T22:20:58.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T22:20:58.429 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-06T22:20:58.437 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-06T22:20:58.438 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:20:58.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f9084b1e640 1 Processor -- start 2023-07-06T22:20:58.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f9084b1e640 1 -- start start 2023-07-06T22:20:58.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f9084b1e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f90800ce610 0x7f90800b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:58.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f9084b1e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90800b1e10 0x7f908015f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:58.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f9084b1e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90800cd1c0 con 0x7f90800b7cd0 2023-07-06T22:20:58.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f9084b1e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90800d2310 con 0x7f90800b1e10 2023-07-06T22:20:58.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f9084b1e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90800b80a0 con 0x7f90800ce610 2023-07-06T22:20:58.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f907ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90800b1e10 0x7f908015f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:58.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f907ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90800b1e10 0x7f908015f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44440/0 (socket says 172.21.15.55:44440) 2023-07-06T22:20:58.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f907ed9d640 1 -- 172.21.15.55:0/1965979294 learned_addr learned my addr 172.21.15.55:0/1965979294 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:58.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f9077fff640 1 --2- 172.21.15.55:0/1965979294 >> v2:172.21.15.138:3300/0 conn(0x7f90800ce610 0x7f90800b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:58.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f907ed9d640 1 -- 172.21.15.55:0/1965979294 >> v2:172.21.15.138:3300/0 conn(0x7f90800ce610 msgr2=0x7f90800b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:58.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f907ed9d640 1 --2- 172.21.15.55:0/1965979294 >> v2:172.21.15.138:3300/0 conn(0x7f90800ce610 0x7f90800b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:58.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f907ed9d640 1 -- 172.21.15.55:0/1965979294 >> v1:172.21.15.138:6789/0 conn(0x7f90800b7cd0 legacy=0x7f90800ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:58.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.582+0000 7f907ed9d640 1 -- 172.21.15.55:0/1965979294 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90800b2270 con 0x7f90800b1e10 2023-07-06T22:20:58.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.586+0000 7f907ed9d640 1 --2- 172.21.15.55:0/1965979294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800b1e10 0x7f908015f870 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f9080065af0 tx=0x7f907801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdea16b82f4ed16c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:58.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.586+0000 7f907dd9b640 1 -- 172.21.15.55:0/1965979294 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90780a55c0 con 0x7f90800b1e10 2023-07-06T22:20:58.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.586+0000 7f907dd9b640 1 -- 172.21.15.55:0/1965979294 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90780a5720 con 0x7f90800b1e10 2023-07-06T22:20:58.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.586+0000 7f907dd9b640 1 -- 172.21.15.55:0/1965979294 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90780a5ab0 con 0x7f90800b1e10 2023-07-06T22:20:58.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.586+0000 7f9084b1e640 1 -- 172.21.15.55:0/1965979294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800b1e10 msgr2=0x7f908015f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:58.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.586+0000 7f9084b1e640 1 --2- 172.21.15.55:0/1965979294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800b1e10 0x7f908015f870 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f9080065af0 tx=0x7f907801c900 comp rx=0 tx=0).stop 2023-07-06T22:20:58.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.586+0000 7f9084b1e640 1 -- 172.21.15.55:0/1965979294 shutdown_connections 2023-07-06T22:20:58.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.586+0000 7f9084b1e640 1 --2- 172.21.15.55:0/1965979294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800b1e10 0x7f908015f870 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:58.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.586+0000 7f9084b1e640 1 --2- 172.21.15.55:0/1965979294 >> v2:172.21.15.138:3300/0 conn(0x7f90800ce610 0x7f90800b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:58.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.586+0000 7f9084b1e640 1 -- 172.21.15.55:0/1965979294 >> 172.21.15.55:0/1965979294 conn(0x7f90800ceee0 msgr2=0x7f90800cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:58.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.586+0000 7f9084b1e640 1 -- 172.21.15.55:0/1965979294 shutdown_connections 2023-07-06T22:20:58.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.586+0000 7f9084b1e640 1 -- 172.21.15.55:0/1965979294 wait complete. 2023-07-06T22:20:58.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.586+0000 7f9084b1e640 1 Processor -- start 2023-07-06T22:20:58.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.586+0000 7f9084b1e640 1 -- start start 2023-07-06T22:20:58.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f9084b1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800b1e10 0x7f90801596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:58.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f9084b1e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90800b7cd0 0x7f908014ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:58.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f9084b1e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90800ce610 0x7f908015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:58.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f9084b1e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908015b050 con 0x7f90800b1e10 2023-07-06T22:20:58.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f9084b1e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9080159c30 con 0x7f90800ce610 2023-07-06T22:20:58.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f9084b1e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9080155fa0 con 0x7f90800b7cd0 2023-07-06T22:20:58.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f907e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800b1e10 0x7f90801596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:58.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f907e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800b1e10 0x7f90801596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44442/0 (socket says 172.21.15.55:44442) 2023-07-06T22:20:58.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f907e59c640 1 -- 172.21.15.55:0/3301872336 learned_addr learned my addr 172.21.15.55:0/3301872336 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:58.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f907ed9d640 1 --2- 172.21.15.55:0/3301872336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90800ce610 0x7f908015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:58.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f9077fff640 1 --2- 172.21.15.55:0/3301872336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90800b7cd0 0x7f908014ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:58.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f907e59c640 1 -- 172.21.15.55:0/3301872336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90800b7cd0 msgr2=0x7f908014ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:58.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f907e59c640 1 --2- 172.21.15.55:0/3301872336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90800b7cd0 0x7f908014ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:58.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f907e59c640 1 -- 172.21.15.55:0/3301872336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90800ce610 msgr2=0x7f908015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:58.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f907e59c640 1 --2- 172.21.15.55:0/3301872336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90800ce610 0x7f908015b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:58.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f907e59c640 1 -- 172.21.15.55:0/3301872336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9078009b30 con 0x7f90800b1e10 2023-07-06T22:20:58.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f907e59c640 1 --2- 172.21.15.55:0/3301872336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800b1e10 0x7f90801596f0 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7f907000c450 tx=0x7f907000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:58.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f9076ffd640 1 -- 172.21.15.55:0/3301872336 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070012830 con 0x7f90800b1e10 2023-07-06T22:20:58.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f9076ffd640 1 -- 172.21.15.55:0/3301872336 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90700129b0 con 0x7f90800b1e10 2023-07-06T22:20:58.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f9076ffd640 1 -- 172.21.15.55:0/3301872336 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070012d60 con 0x7f90800b1e10 2023-07-06T22:20:58.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f9084b1e640 1 -- 172.21.15.55:0/3301872336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908014f4d0 con 0x7f90800b1e10 2023-07-06T22:20:58.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f9084b1e640 1 -- 172.21.15.55:0/3301872336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9080155700 con 0x7f90800b1e10 2023-07-06T22:20:58.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.590+0000 7f9084b1e640 1 -- 172.21.15.55:0/3301872336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9080066d60 con 0x7f90800b1e10 2023-07-06T22:20:58.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.594+0000 7f9076ffd640 1 -- 172.21.15.55:0/3301872336 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f907001c460 con 0x7f90800b1e10 2023-07-06T22:20:58.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.594+0000 7f9076ffd640 1 --2- 172.21.15.55:0/3301872336 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f90600663d0 0x7f9060068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:58.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.594+0000 7f9076ffd640 1 -- 172.21.15.55:0/3301872336 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f9070083c60 con 0x7f90800b1e10 2023-07-06T22:20:58.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.594+0000 7f9077fff640 1 --2- 172.21.15.55:0/3301872336 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f90600663d0 0x7f9060068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:58.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.594+0000 7f9077fff640 1 --2- 172.21.15.55:0/3301872336 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f90600663d0 0x7f9060068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f908015c0f0 tx=0x7f9068008040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:58.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.598+0000 7f9076ffd640 1 -- 172.21.15.55:0/3301872336 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9070050f30 con 0x7f90800b1e10 2023-07-06T22:20:58.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.750+0000 7f9084b1e640 1 -- 172.21.15.55:0/3301872336 --> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90800d1d90 con 0x7f90600663d0 2023-07-06T22:20:58.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.750+0000 7f9076ffd640 1 -- 172.21.15.55:0/3301872336 <== mgr.11301 v2:172.21.15.55:6832/3094866364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73021 (secure 0 0 0) 0x7f9068010960 con 0x7f90600663d0 2023-07-06T22:20:58.756 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:58.756 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:20:58.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.754+0000 7f9084b1e640 1 -- 172.21.15.55:0/3301872336 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f90600663d0 msgr2=0x7f9060068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:58.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.754+0000 7f9084b1e640 1 --2- 172.21.15.55:0/3301872336 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f90600663d0 0x7f9060068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f908015c0f0 tx=0x7f9068008040 comp rx=0 tx=0).stop 2023-07-06T22:20:58.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.754+0000 7f9084b1e640 1 -- 172.21.15.55:0/3301872336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800b1e10 msgr2=0x7f90801596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:58.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.754+0000 7f9084b1e640 1 --2- 172.21.15.55:0/3301872336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800b1e10 0x7f90801596f0 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7f907000c450 tx=0x7f907000c910 comp rx=0 tx=0).stop 2023-07-06T22:20:58.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.754+0000 7f9084b1e640 1 -- 172.21.15.55:0/3301872336 shutdown_connections 2023-07-06T22:20:58.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.754+0000 7f9084b1e640 1 --2- 172.21.15.55:0/3301872336 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f90600663d0 0x7f9060068880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:58.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.754+0000 7f9084b1e640 1 --2- 172.21.15.55:0/3301872336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90800ce610 0x7f908015b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:58.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.754+0000 7f9084b1e640 1 --2- 172.21.15.55:0/3301872336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90800b7cd0 0x7f908014ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:58.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.754+0000 7f9084b1e640 1 --2- 172.21.15.55:0/3301872336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800b1e10 0x7f90801596f0 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:58.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.754+0000 7f9084b1e640 1 -- 172.21.15.55:0/3301872336 >> 172.21.15.55:0/3301872336 conn(0x7f90800ceee0 msgr2=0x7f9080158fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:58.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.754+0000 7f9084b1e640 1 -- 172.21.15.55:0/3301872336 shutdown_connections 2023-07-06T22:20:58.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.754+0000 7f9084b1e640 1 -- 172.21.15.55:0/3301872336 wait complete. 2023-07-06T22:20:58.776 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-07-06T22:20:58.316659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":387616,"kb_used_data":21984,"kb_used_omap":0,"kb_used_meta":365568,"kb_avail":754587104,"statfs":{"total":773094113280,"available":772697194496,"internally_reserved":0,"allocated":22511616,"data_stored":13264098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":374341632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-668212,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-282,"num_write_kb":-2054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.129855"},"pg_stats":[{"pgid":"1.0","version":"198'348","reported_seq":1349,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.776473+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:20:51.776473+0000","last_peered":"2023-07-06T22:20:51.776473+0000","last_clean":"2023-07-06T22:20:51.776473+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:20:51.776473+0000","last_undegraded":"2023-07-06T22:20:51.776473+0000","last_fullsized":"2023-07-06T22:20:51.776473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:34:30.864308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":325,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.775248+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:20:51.775248+0000","last_peered":"2023-07-06T22:20:51.775248+0000","last_clean":"2023-07-06T22:20:51.775248+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:20:51.775248+0000","last_undegraded":"2023-07-06T22:20:51.775248+0000","last_fullsized":"2023-07-06T22:20:51.775248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:17:42.372224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":374,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.776289+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:20:51.776289+0000","last_peered":"2023-07-06T22:20:51.776289+0000","last_clean":"2023-07-06T22:20:51.776289+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:20:51.776289+0000","last_undegraded":"2023-07-06T22:20:51.776289+0000","last_fullsized":"2023-07-06T22:20:51.776289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:59:46.414221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":369,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.188649+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:20:51.188649+0000","last_peered":"2023-07-06T22:20:51.188649+0000","last_clean":"2023-07-06T22:20:51.188649+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:20:51.188649+0000","last_undegraded":"2023-07-06T22:20:51.188649+0000","last_fullsized":"2023-07-06T22:20:51.188649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:48:37.977885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":325,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.775105+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:20:51.775105+0000","last_peered":"2023-07-06T22:20:51.775105+0000","last_clean":"2023-07-06T22:20:51.775105+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:20:51.775105+0000","last_undegraded":"2023-07-06T22:20:51.775105+0000","last_fullsized":"2023-07-06T22:20:51.775105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:54:15.842017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":329,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.189336+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:20:51.189336+0000","last_peered":"2023-07-06T22:20:51.189336+0000","last_clean":"2023-07-06T22:20:51.189336+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:20:51.189336+0000","last_undegraded":"2023-07-06T22:20:51.189336+0000","last_fullsized":"2023-07-06T22:20:51.189336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:32:31.393366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":373,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.776799+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:20:51.776799+0000","last_peered":"2023-07-06T22:20:51.776799+0000","last_clean":"2023-07-06T22:20:51.776799+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:20:51.776799+0000","last_undegraded":"2023-07-06T22:20:51.776799+0000","last_fullsized":"2023-07-06T22:20:51.776799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:04:12.865842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":329,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.189621+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:20:51.189621+0000","last_peered":"2023-07-06T22:20:51.189621+0000","last_clean":"2023-07-06T22:20:51.189621+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:20:51.189621+0000","last_undegraded":"2023-07-06T22:20:51.189621+0000","last_fullsized":"2023-07-06T22:20:51.189621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:56:32.476128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":320,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.775465+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:20:51.775465+0000","last_peered":"2023-07-06T22:20:51.775465+0000","last_clean":"2023-07-06T22:20:51.775465+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:20:51.775465+0000","last_undegraded":"2023-07-06T22:20:51.775465+0000","last_fullsized":"2023-07-06T22:20:51.775465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:17:20.739778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575309,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42584,"kb_used_data":3344,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329256,"statfs":{"total":96636764160,"available":96593158144,"internally_reserved":0,"allocated":3424256,"data_stored":2262326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.432},"max":{"1min":0.92100000000000004,"5min":0.93300000000000005,"15min":1.0740000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51600000000000001,"5min":0.45900000000000002,"15min":0.45700000000000002},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.52100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.74199999999999999,"15min":0.72399999999999998},"min":{"1min":0.57699999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.61099999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"max":{"1min":0.96399999999999997,"5min":0.96699999999999997,"15min":1.0149999999999999},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73999999999999999,"15min":0.73199999999999998},"min":{"1min":0.53100000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.84099999999999997,"15min":0.78400000000000003},"min":{"1min":0.56200000000000006,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":9.8279999999999994,"15min":9.8279999999999994},"last":0.499}]},{"osd":4,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.36799999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73499999999999999,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":2.2610000000000001,"5min":13.443,"15min":13.443},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.52400000000000002,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.746},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.71499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575309,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37576,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334264,"statfs":{"total":96636764160,"available":96598286336,"internally_reserved":0,"allocated":2490368,"data_stored":1342704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.40300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.7829999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":1.633},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.49199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.9099999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.97799999999999998},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83199999999999996,"5min":0.91100000000000003,"15min":2.0299999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":1.04,"15min":1.5920000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.61099999999999999,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.996},"last":0.495}]},{"osd":4,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.69699999999999995,"5min":1.024,"15min":1.024},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80200000000000005,"5min":0.92600000000000005,"15min":0.996},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":0.89900000000000002,"15min":0.98499999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.85999999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82499999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.624},"min":{"1min":0.54100000000000004,"5min":0.45600000000000002,"15min":0.439},"max":{"1min":0.78400000000000003,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.53200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575308,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59724,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312116,"statfs":{"total":96636764160,"available":96575606784,"internally_reserved":0,"allocated":2494464,"data_stored":1343723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.92100000000000004,"5min":0.97199999999999998,"15min":0.999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.628,"5min":0.46999999999999997,"15min":0.46400000000000002},"max":{"1min":0.88400000000000001,"5min":0.995,"15min":0.995},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.52200000000000002,"5min":0.44400000000000001,"15min":0.43099999999999999},"max":{"1min":0.94799999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.60599999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.006,"5min":1.006,"15min":1.3200000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.46300000000000002},"max":{"1min":0.93700000000000006,"5min":0.998,"15min":1.4299999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.749},"min":{"1min":0.56200000000000006,"5min":0.48499999999999999,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":0.999,"15min":1.0409999999999999},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.54400000000000004,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":0.996,"15min":1.5169999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.623,"5min":0.51500000000000001,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.629}]},{"osd":4,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61599999999999999,"15min":0.61699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.79800000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.622,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.5,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69799999999999995,"15min":0.69099999999999995},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.66800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575307,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55648,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316192,"statfs":{"total":96636764160,"available":96579780608,"internally_reserved":0,"allocated":2514944,"data_stored":1355605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.42199999999999999},"max":{"1min":0.876,"5min":0.96399999999999997,"15min":0.98999999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":0.97899999999999998,"15min":1.016},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.56899999999999995,"5min":0.47899999999999998,"15min":0.38300000000000001},"max":{"1min":0.93400000000000005,"5min":0.999,"15min":1.0309999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.996},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.622,"5min":0.54600000000000004,"15min":0.502},"max":{"1min":0.97699999999999998,"5min":0.99399999999999999,"15min":1.0580000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.53500000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.98699999999999999},"last":0.621},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":1.022,"15min":1.03},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.36599999999999999},"max":{"1min":0.76800000000000002,"5min":0.91200000000000003,"15min":0.92600000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":0.95599999999999996,"15min":1.006},"last":0.439}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.91500000000000004,"15min":1.0509999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.41299999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.5}]},{"osd":7,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90300000000000002,"5min":0.94799999999999995,"15min":1.0469999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.432,"15min":0.432},"max":{"1min":0.90200000000000002,"5min":1.0109999999999999,"15min":1.1100000000000001},"last":0.47899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575308,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51864,"kb_used_data":2768,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94319976,"statfs":{"total":96636764160,"available":96583655424,"internally_reserved":0,"allocated":2834432,"data_stored":1672048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45900000000000002,"15min":0.46400000000000002},"min":{"1min":0.27300000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.60299999999999998,"5min":0.68100000000000005,"15min":0.85899999999999999},"last":0.44},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.623,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":0.83899999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.70099999999999996,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.875},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34699999999999998},"max":{"1min":0.73699999999999999,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.77900000000000003}]},{"osd":4,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.77400000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.441},"max":{"1min":0.98799999999999999,"5min":1.0449999999999999,"15min":1.474},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.3859999999999999},"last":0.82199999999999995}]},{"osd":5,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79300000000000004,"15min":0.80800000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.056,"5min":1.175,"15min":1.3740000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.081,"5min":1.081,"15min":1.2330000000000001},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.52200000000000002},"max":{"1min":0.97499999999999998,"5min":1.1399999999999999,"15min":1.3899999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.57299999999999995},"max":{"1min":1.028,"5min":1.1499999999999999,"15min":1.3220000000000001},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.2210000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82299999999999995,"15min":0.82799999999999996},"min":{"1min":0.61499999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0629999999999999,"5min":1.244,"15min":1.3200000000000001},"last":0.76100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575308,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41684,"kb_used_data":2444,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330156,"statfs":{"total":96636764160,"available":96594079744,"internally_reserved":0,"allocated":2502656,"data_stored":1344316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.77000000000000002,"15min":0.78600000000000003},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.42499999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65600000000000003,"5min":0.74099999999999999,"15min":0.84099999999999997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.72399999999999998,"5min":0.85099999999999998,"15min":0.97099999999999997},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.63600000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58799999999999997},"min":{"1min":0.46300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.66500000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94199999999999995,"5min":1.663,"15min":1.663},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.61099999999999999,"5min":0.54900000000000004,"15min":0.51600000000000001},"max":{"1min":0.94899999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.66000000000000003,"5min":0.55900000000000005,"15min":0.51100000000000001},"max":{"1min":0.90900000000000003,"5min":1.337,"15min":1.337},"last":0.873},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80700000000000005,"15min":0.82899999999999996},"min":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0189999999999999,"5min":1.228,"15min":1.2829999999999999},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.996,"5min":1.367,"15min":1.367},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81200000000000006,"15min":0.82999999999999996},"min":{"1min":0.65300000000000002,"5min":0.59999999999999998,"15min":0.56100000000000005},"max":{"1min":0.96499999999999997,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.995}]},{"osd":7,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.98099999999999998,"5min":1.407,"15min":1.407},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82099999999999995,"15min":0.83999999999999997},"min":{"1min":0.67200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.024,"5min":1.296,"15min":1.296},"last":0.94099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575309,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60060,"kb_used_data":2772,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311780,"statfs":{"total":96636764160,"available":96575262720,"internally_reserved":0,"allocated":2838528,"data_stored":1682703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.316,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.72599999999999998,"5min":1.645,"15min":1.645},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.72299999999999998,"5min":0.90700000000000003,"15min":0.94299999999999995},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.68799999999999994,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.502,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.81699999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79600000000000004,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.372}]},{"osd":4,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74299999999999999,"15min":0.77600000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96999999999999997,"5min":1.083,"15min":1.1140000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78700000000000003,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.51700000000000002},"max":{"1min":0.92700000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.48699999999999999},"max":{"1min":1.012,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79800000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96399999999999997,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95399999999999996,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.56100000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94299999999999995,"5min":1.25,"15min":1.3360000000000001},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81399999999999995,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.56100000000000005},"max":{"1min":0.99199999999999999,"5min":1.155,"15min":1.405},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.61199999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98199999999999998,"5min":1.788,"15min":1.788},"last":0.61399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575308,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38476,"kb_used_data":3332,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333364,"statfs":{"total":96636764160,"available":96597364736,"internally_reserved":0,"allocated":3411968,"data_stored":2260673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.434,"15min":0.46000000000000002},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54200000000000004,"5min":0.745,"15min":0.745},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.312},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.1319999999999999},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.39600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":1.1599999999999999},"last":0.82499999999999996}]},{"osd":3,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.89200000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.40999999999999998},"max":{"1min":0.71699999999999997,"5min":0.77100000000000002,"15min":0.95399999999999996},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77000000000000002,"15min":0.79600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96299999999999997,"5min":1.1439999999999999,"15min":1.294},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90800000000000003,"5min":1.1000000000000001,"15min":1.3320000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.0569999999999999,"15min":1.345},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.76300000000000001,"15min":0.79600000000000004},"min":{"1min":0.57499999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.56000000000000005,"5min":0.498,"15min":0.47699999999999998},"max":{"1min":0.96699999999999997,"5min":1.0569999999999999,"15min":1.153},"last":0.752},{"interface":"front","average":{"1min":0.747,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99199999999999999,"5min":1.0840000000000001,"15min":1.272},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.52100000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.26},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55700000000000005},"max":{"1min":0.97699999999999998,"5min":1.1220000000000001,"15min":1.2350000000000001},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:20:58.778 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:20:58.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa12b174640 1 Processor -- start 2023-07-06T22:20:58.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa12b174640 1 -- start start 2023-07-06T22:20:58.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa12b174640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa124158400 0x7fa1240c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:58.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa12b174640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1240c9680 0x7fa124070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:58.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa12b174640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12406fae0 con 0x7fa1240710c0 2023-07-06T22:20:58.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa12b174640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12406fdc0 con 0x7fa124158400 2023-07-06T22:20:58.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa12b174640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1240700a0 con 0x7fa1240c9680 2023-07-06T22:20:58.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa128f10640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa124158400 0x7fa1240c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:58.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa123fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1240c9680 0x7fa124070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:58.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa129711640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fa1240710c0 0x7fa1240cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:40302/0 (socket says 172.21.15.55:40302) 2023-07-06T22:20:58.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa129711640 1 -- 172.21.15.55:0/1897838442 learned_addr learned my addr 172.21.15.55:0/1897838442 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:58.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa1237fe640 1 -- 172.21.15.55:0/1897838442 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755175911 0 0) 0x7fa12406fae0 con 0x7fa1240710c0 2023-07-06T22:20:58.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa1237fe640 1 -- 172.21.15.55:0/1897838442 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa114005740 con 0x7fa1240710c0 2023-07-06T22:20:58.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa128f10640 1 -- 172.21.15.55:0/1897838442 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1240c9680 msgr2=0x7fa124070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:58.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa128f10640 1 --2- 172.21.15.55:0/1897838442 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1240c9680 0x7fa124070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa128f10640 1 -- 172.21.15.55:0/1897838442 >> v1:172.21.15.138:6789/0 conn(0x7fa1240710c0 legacy=0x7fa1240cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa128f10640 1 -- 172.21.15.55:0/1897838442 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa124070380 con 0x7fa124158400 2023-07-06T22:20:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.918+0000 7fa123fff640 1 --2- 172.21.15.55:0/1897838442 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1240c9680 0x7fa124070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:20:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.922+0000 7fa128f10640 1 --2- 172.21.15.55:0/1897838442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa124158400 0x7fa1240c9140 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa1180097c0 tx=0x7fa11801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d82b17ec89b65e16 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:58.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.922+0000 7fa1237fe640 1 -- 172.21.15.55:0/1897838442 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1180ab670 con 0x7fa124158400 2023-07-06T22:20:58.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.922+0000 7fa1237fe640 1 -- 172.21.15.55:0/1897838442 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1180ab7d0 con 0x7fa124158400 2023-07-06T22:20:58.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.922+0000 7fa1237fe640 1 -- 172.21.15.55:0/1897838442 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1180abb60 con 0x7fa124158400 2023-07-06T22:20:58.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.922+0000 7fa12b174640 1 -- 172.21.15.55:0/1897838442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa124158400 msgr2=0x7fa1240c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:58.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.922+0000 7fa12b174640 1 --2- 172.21.15.55:0/1897838442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa124158400 0x7fa1240c9140 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa1180097c0 tx=0x7fa11801c450 comp rx=0 tx=0).stop 2023-07-06T22:20:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.922+0000 7fa12b174640 1 -- 172.21.15.55:0/1897838442 shutdown_connections 2023-07-06T22:20:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.922+0000 7fa12b174640 1 --2- 172.21.15.55:0/1897838442 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1240c9680 0x7fa124070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.922+0000 7fa12b174640 1 --2- 172.21.15.55:0/1897838442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa124158400 0x7fa1240c9140 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.922+0000 7fa12b174640 1 -- 172.21.15.55:0/1897838442 >> 172.21.15.55:0/1897838442 conn(0x7fa1240cded0 msgr2=0x7fa1240ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.922+0000 7fa12b174640 1 -- 172.21.15.55:0/1897838442 shutdown_connections 2023-07-06T22:20:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.922+0000 7fa12b174640 1 -- 172.21.15.55:0/1897838442 wait complete. 2023-07-06T22:20:58.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa12b174640 1 Processor -- start 2023-07-06T22:20:58.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa12b174640 1 -- start start 2023-07-06T22:20:58.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa12b174640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1240710c0 0x7fa12414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:58.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa12b174640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1240c9680 0x7fa12414b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:58.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa12b174640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa124158400 0x7fa1240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:58.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa12b174640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12414af90 con 0x7fa124158400 2023-07-06T22:20:58.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa12b174640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1240c5140 con 0x7fa1240710c0 2023-07-06T22:20:58.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa12b174640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1240c5420 con 0x7fa1240c9680 2023-07-06T22:20:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa129711640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa124158400 0x7fa1240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa129711640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa124158400 0x7fa1240697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44450/0 (socket says 172.21.15.55:44450) 2023-07-06T22:20:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa129711640 1 -- 172.21.15.55:0/4097179652 learned_addr learned my addr 172.21.15.55:0/4097179652 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa128f10640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1240710c0 0x7fa12414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa123fff640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1240c9680 0x7fa12414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa129711640 1 -- 172.21.15.55:0/4097179652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1240c9680 msgr2=0x7fa12414b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa129711640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1240c9680 0x7fa12414b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:58.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa129711640 1 -- 172.21.15.55:0/4097179652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1240710c0 msgr2=0x7fa12414aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:58.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa129711640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1240710c0 0x7fa12414aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:58.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa129711640 1 -- 172.21.15.55:0/4097179652 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa110009420 con 0x7fa124158400 2023-07-06T22:20:58.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa128f10640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1240710c0 0x7fa12414aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:58.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa129711640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa124158400 0x7fa1240697e0 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00cb40 tx=0x7fa11c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:58.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa1217fa640 1 -- 172.21.15.55:0/4097179652 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c00aca0 con 0x7fa124158400 2023-07-06T22:20:58.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa1217fa640 1 -- 172.21.15.55:0/4097179652 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c00ae00 con 0x7fa124158400 2023-07-06T22:20:58.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa1217fa640 1 -- 172.21.15.55:0/4097179652 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c012620 con 0x7fa124158400 2023-07-06T22:20:58.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa12b174640 1 -- 172.21.15.55:0/4097179652 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa118009420 con 0x7fa124158400 2023-07-06T22:20:58.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.926+0000 7fa12b174640 1 -- 172.21.15.55:0/4097179652 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1240c59e0 con 0x7fa124158400 2023-07-06T22:20:58.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.930+0000 7fa12b174640 1 -- 172.21.15.55:0/4097179652 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12406c580 con 0x7fa124158400 2023-07-06T22:20:58.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.930+0000 7fa1217fa640 1 -- 172.21.15.55:0/4097179652 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa11c007070 con 0x7fa124158400 2023-07-06T22:20:58.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.930+0000 7fa1217fa640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fa1080663a0 0x7fa108068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:58.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.930+0000 7fa1217fa640 1 -- 172.21.15.55:0/4097179652 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7fa11c083ff0 con 0x7fa124158400 2023-07-06T22:20:58.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.930+0000 7fa128f10640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fa1080663a0 0x7fa108068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:58.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.934+0000 7fa128f10640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fa1080663a0 0x7fa108068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa1180af000 tx=0x7fa1180a7000 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:58.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:58.934+0000 7fa1217fa640 1 -- 172.21.15.55:0/4097179652 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa11c0b4700 con 0x7fa124158400 2023-07-06T22:20:59.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.090+0000 7fa12b174640 1 -- 172.21.15.55:0/4097179652 --> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1240693f0 con 0x7fa1080663a0 2023-07-06T22:20:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.090+0000 7fa1217fa640 1 -- 172.21.15.55:0/4097179652 <== mgr.11301 v2:172.21.15.55:6832/3094866364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73021 (secure 0 0 0) 0x7fa1180ab940 con 0x7fa1080663a0 2023-07-06T22:20:59.096 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:20:59.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.094+0000 7fa12b174640 1 -- 172.21.15.55:0/4097179652 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fa1080663a0 msgr2=0x7fa108068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.094+0000 7fa12b174640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fa1080663a0 0x7fa108068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa1180af000 tx=0x7fa1180a7000 comp rx=0 tx=0).stop 2023-07-06T22:20:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.094+0000 7fa12b174640 1 -- 172.21.15.55:0/4097179652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa124158400 msgr2=0x7fa1240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.094+0000 7fa12b174640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa124158400 0x7fa1240697e0 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00cb40 tx=0x7fa11c00a060 comp rx=0 tx=0).stop 2023-07-06T22:20:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.094+0000 7fa12b174640 1 -- 172.21.15.55:0/4097179652 shutdown_connections 2023-07-06T22:20:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.094+0000 7fa12b174640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fa1080663a0 0x7fa108068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.094+0000 7fa12b174640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa124158400 0x7fa1240697e0 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.094+0000 7fa12b174640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1240c9680 0x7fa12414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.094+0000 7fa12b174640 1 --2- 172.21.15.55:0/4097179652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1240710c0 0x7fa12414aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.094+0000 7fa12b174640 1 -- 172.21.15.55:0/4097179652 >> 172.21.15.55:0/4097179652 conn(0x7fa1240cded0 msgr2=0x7fa124153810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:59.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.094+0000 7fa12b174640 1 -- 172.21.15.55:0/4097179652 shutdown_connections 2023-07-06T22:20:59.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.094+0000 7fa12b174640 1 -- 172.21.15.55:0/4097179652 wait complete. 2023-07-06T22:20:59.116 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-07-06T22:20:58.316659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":387616,"kb_used_data":21984,"kb_used_omap":0,"kb_used_meta":365568,"kb_avail":754587104,"statfs":{"total":773094113280,"available":772697194496,"internally_reserved":0,"allocated":22511616,"data_stored":13264098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":374341632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-668212,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-282,"num_write_kb":-2054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.129855"},"pg_stats":[{"pgid":"1.0","version":"198'348","reported_seq":1349,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.776473+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:20:51.776473+0000","last_peered":"2023-07-06T22:20:51.776473+0000","last_clean":"2023-07-06T22:20:51.776473+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:20:51.776473+0000","last_undegraded":"2023-07-06T22:20:51.776473+0000","last_fullsized":"2023-07-06T22:20:51.776473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:34:30.864308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":325,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.775248+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:20:51.775248+0000","last_peered":"2023-07-06T22:20:51.775248+0000","last_clean":"2023-07-06T22:20:51.775248+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:20:51.775248+0000","last_undegraded":"2023-07-06T22:20:51.775248+0000","last_fullsized":"2023-07-06T22:20:51.775248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:17:42.372224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":374,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.776289+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:20:51.776289+0000","last_peered":"2023-07-06T22:20:51.776289+0000","last_clean":"2023-07-06T22:20:51.776289+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:20:51.776289+0000","last_undegraded":"2023-07-06T22:20:51.776289+0000","last_fullsized":"2023-07-06T22:20:51.776289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:59:46.414221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":369,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.188649+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:20:51.188649+0000","last_peered":"2023-07-06T22:20:51.188649+0000","last_clean":"2023-07-06T22:20:51.188649+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:20:51.188649+0000","last_undegraded":"2023-07-06T22:20:51.188649+0000","last_fullsized":"2023-07-06T22:20:51.188649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:48:37.977885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":325,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.775105+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:20:51.775105+0000","last_peered":"2023-07-06T22:20:51.775105+0000","last_clean":"2023-07-06T22:20:51.775105+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:20:51.775105+0000","last_undegraded":"2023-07-06T22:20:51.775105+0000","last_fullsized":"2023-07-06T22:20:51.775105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:54:15.842017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":329,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.189336+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:20:51.189336+0000","last_peered":"2023-07-06T22:20:51.189336+0000","last_clean":"2023-07-06T22:20:51.189336+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:20:51.189336+0000","last_undegraded":"2023-07-06T22:20:51.189336+0000","last_fullsized":"2023-07-06T22:20:51.189336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:32:31.393366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":373,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.776799+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:20:51.776799+0000","last_peered":"2023-07-06T22:20:51.776799+0000","last_clean":"2023-07-06T22:20:51.776799+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:20:51.776799+0000","last_undegraded":"2023-07-06T22:20:51.776799+0000","last_fullsized":"2023-07-06T22:20:51.776799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:04:12.865842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":329,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.189621+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:20:51.189621+0000","last_peered":"2023-07-06T22:20:51.189621+0000","last_clean":"2023-07-06T22:20:51.189621+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:20:51.189621+0000","last_undegraded":"2023-07-06T22:20:51.189621+0000","last_fullsized":"2023-07-06T22:20:51.189621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:56:32.476128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":320,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.775465+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:20:51.775465+0000","last_peered":"2023-07-06T22:20:51.775465+0000","last_clean":"2023-07-06T22:20:51.775465+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:20:51.775465+0000","last_undegraded":"2023-07-06T22:20:51.775465+0000","last_fullsized":"2023-07-06T22:20:51.775465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:17:20.739778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575309,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42584,"kb_used_data":3344,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329256,"statfs":{"total":96636764160,"available":96593158144,"internally_reserved":0,"allocated":3424256,"data_stored":2262326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.432},"max":{"1min":0.92100000000000004,"5min":0.93300000000000005,"15min":1.0740000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51600000000000001,"5min":0.45900000000000002,"15min":0.45700000000000002},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.52100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.74199999999999999,"15min":0.72399999999999998},"min":{"1min":0.57699999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.61099999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"max":{"1min":0.96399999999999997,"5min":0.96699999999999997,"15min":1.0149999999999999},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73999999999999999,"15min":0.73199999999999998},"min":{"1min":0.53100000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.84099999999999997,"15min":0.78400000000000003},"min":{"1min":0.56200000000000006,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":9.8279999999999994,"15min":9.8279999999999994},"last":0.499}]},{"osd":4,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.36799999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73499999999999999,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":2.2610000000000001,"5min":13.443,"15min":13.443},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.52400000000000002,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.746},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.71499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575309,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37576,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334264,"statfs":{"total":96636764160,"available":96598286336,"internally_reserved":0,"allocated":2490368,"data_stored":1342704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.40300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.7829999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":1.633},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.49199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.9099999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.97799999999999998},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83199999999999996,"5min":0.91100000000000003,"15min":2.0299999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":1.04,"15min":1.5920000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.61099999999999999,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.996},"last":0.495}]},{"osd":4,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.69699999999999995,"5min":1.024,"15min":1.024},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80200000000000005,"5min":0.92600000000000005,"15min":0.996},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":0.89900000000000002,"15min":0.98499999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.85999999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82499999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.624},"min":{"1min":0.54100000000000004,"5min":0.45600000000000002,"15min":0.439},"max":{"1min":0.78400000000000003,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.53200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575308,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59724,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312116,"statfs":{"total":96636764160,"available":96575606784,"internally_reserved":0,"allocated":2494464,"data_stored":1343723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.92100000000000004,"5min":0.97199999999999998,"15min":0.999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.628,"5min":0.46999999999999997,"15min":0.46400000000000002},"max":{"1min":0.88400000000000001,"5min":0.995,"15min":0.995},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.52200000000000002,"5min":0.44400000000000001,"15min":0.43099999999999999},"max":{"1min":0.94799999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.60599999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.006,"5min":1.006,"15min":1.3200000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.46300000000000002},"max":{"1min":0.93700000000000006,"5min":0.998,"15min":1.4299999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.749},"min":{"1min":0.56200000000000006,"5min":0.48499999999999999,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":0.999,"15min":1.0409999999999999},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.54400000000000004,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":0.996,"15min":1.5169999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.623,"5min":0.51500000000000001,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.629}]},{"osd":4,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61599999999999999,"15min":0.61699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.79800000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.622,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.5,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69799999999999995,"15min":0.69099999999999995},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.66800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575307,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55648,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316192,"statfs":{"total":96636764160,"available":96579780608,"internally_reserved":0,"allocated":2514944,"data_stored":1355605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.42199999999999999},"max":{"1min":0.876,"5min":0.96399999999999997,"15min":0.98999999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":0.97899999999999998,"15min":1.016},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.56899999999999995,"5min":0.47899999999999998,"15min":0.38300000000000001},"max":{"1min":0.93400000000000005,"5min":0.999,"15min":1.0309999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.996},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.622,"5min":0.54600000000000004,"15min":0.502},"max":{"1min":0.97699999999999998,"5min":0.99399999999999999,"15min":1.0580000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.53500000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.98699999999999999},"last":0.621},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":1.022,"15min":1.03},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.36599999999999999},"max":{"1min":0.76800000000000002,"5min":0.91200000000000003,"15min":0.92600000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":0.95599999999999996,"15min":1.006},"last":0.439}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.91500000000000004,"15min":1.0509999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.41299999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.5}]},{"osd":7,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90300000000000002,"5min":0.94799999999999995,"15min":1.0469999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.432,"15min":0.432},"max":{"1min":0.90200000000000002,"5min":1.0109999999999999,"15min":1.1100000000000001},"last":0.47899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575308,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51864,"kb_used_data":2768,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94319976,"statfs":{"total":96636764160,"available":96583655424,"internally_reserved":0,"allocated":2834432,"data_stored":1672048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45900000000000002,"15min":0.46400000000000002},"min":{"1min":0.27300000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.60299999999999998,"5min":0.68100000000000005,"15min":0.85899999999999999},"last":0.44},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.623,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":0.83899999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.70099999999999996,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.875},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34699999999999998},"max":{"1min":0.73699999999999999,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.77900000000000003}]},{"osd":4,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.77400000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.441},"max":{"1min":0.98799999999999999,"5min":1.0449999999999999,"15min":1.474},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.3859999999999999},"last":0.82199999999999995}]},{"osd":5,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79300000000000004,"15min":0.80800000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.056,"5min":1.175,"15min":1.3740000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.081,"5min":1.081,"15min":1.2330000000000001},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.52200000000000002},"max":{"1min":0.97499999999999998,"5min":1.1399999999999999,"15min":1.3899999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.57299999999999995},"max":{"1min":1.028,"5min":1.1499999999999999,"15min":1.3220000000000001},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.2210000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82299999999999995,"15min":0.82799999999999996},"min":{"1min":0.61499999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0629999999999999,"5min":1.244,"15min":1.3200000000000001},"last":0.76100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575308,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41684,"kb_used_data":2444,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330156,"statfs":{"total":96636764160,"available":96594079744,"internally_reserved":0,"allocated":2502656,"data_stored":1344316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.77000000000000002,"15min":0.78600000000000003},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.42499999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65600000000000003,"5min":0.74099999999999999,"15min":0.84099999999999997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.72399999999999998,"5min":0.85099999999999998,"15min":0.97099999999999997},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.63600000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58799999999999997},"min":{"1min":0.46300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.66500000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94199999999999995,"5min":1.663,"15min":1.663},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.61099999999999999,"5min":0.54900000000000004,"15min":0.51600000000000001},"max":{"1min":0.94899999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.66000000000000003,"5min":0.55900000000000005,"15min":0.51100000000000001},"max":{"1min":0.90900000000000003,"5min":1.337,"15min":1.337},"last":0.873},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80700000000000005,"15min":0.82899999999999996},"min":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0189999999999999,"5min":1.228,"15min":1.2829999999999999},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.996,"5min":1.367,"15min":1.367},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81200000000000006,"15min":0.82999999999999996},"min":{"1min":0.65300000000000002,"5min":0.59999999999999998,"15min":0.56100000000000005},"max":{"1min":0.96499999999999997,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.995}]},{"osd":7,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.98099999999999998,"5min":1.407,"15min":1.407},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82099999999999995,"15min":0.83999999999999997},"min":{"1min":0.67200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.024,"5min":1.296,"15min":1.296},"last":0.94099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575309,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60060,"kb_used_data":2772,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311780,"statfs":{"total":96636764160,"available":96575262720,"internally_reserved":0,"allocated":2838528,"data_stored":1682703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.316,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.72599999999999998,"5min":1.645,"15min":1.645},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.72299999999999998,"5min":0.90700000000000003,"15min":0.94299999999999995},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.68799999999999994,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.502,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.81699999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79600000000000004,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.372}]},{"osd":4,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74299999999999999,"15min":0.77600000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96999999999999997,"5min":1.083,"15min":1.1140000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78700000000000003,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.51700000000000002},"max":{"1min":0.92700000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.48699999999999999},"max":{"1min":1.012,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79800000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96399999999999997,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95399999999999996,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.56100000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94299999999999995,"5min":1.25,"15min":1.3360000000000001},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81399999999999995,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.56100000000000005},"max":{"1min":0.99199999999999999,"5min":1.155,"15min":1.405},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.61199999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98199999999999998,"5min":1.788,"15min":1.788},"last":0.61399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575308,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38476,"kb_used_data":3332,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333364,"statfs":{"total":96636764160,"available":96597364736,"internally_reserved":0,"allocated":3411968,"data_stored":2260673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.434,"15min":0.46000000000000002},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54200000000000004,"5min":0.745,"15min":0.745},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.312},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.1319999999999999},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.39600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":1.1599999999999999},"last":0.82499999999999996}]},{"osd":3,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.89200000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.40999999999999998},"max":{"1min":0.71699999999999997,"5min":0.77100000000000002,"15min":0.95399999999999996},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77000000000000002,"15min":0.79600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96299999999999997,"5min":1.1439999999999999,"15min":1.294},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90800000000000003,"5min":1.1000000000000001,"15min":1.3320000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.0569999999999999,"15min":1.345},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.76300000000000001,"15min":0.79600000000000004},"min":{"1min":0.57499999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.56000000000000005,"5min":0.498,"15min":0.47699999999999998},"max":{"1min":0.96699999999999997,"5min":1.0569999999999999,"15min":1.153},"last":0.752},{"interface":"front","average":{"1min":0.747,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99199999999999999,"5min":1.0840000000000001,"15min":1.272},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.52100000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.26},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55700000000000005},"max":{"1min":0.97699999999999998,"5min":1.1220000000000001,"15min":1.2350000000000001},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:20:59.119 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-06T22:20:59.119 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:20:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.258+0000 7f2e21407640 1 Processor -- start 2023-07-06T22:20:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.258+0000 7f2e21407640 1 -- start start 2023-07-06T22:20:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e21407640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1c15cc00 0x7f2e1c166850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e21407640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c15c770 con 0x7f2e1c15bc40 2023-07-06T22:20:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e21407640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c06d4f0 con 0x7f2e1c06f8e0 2023-07-06T22:20:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e21407640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c06d210 con 0x7f2e1c15cc00 2023-07-06T22:20:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e13fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2e1c15bc40 0x7f2e1c06c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53858/0 (socket says 172.21.15.55:53858) 2023-07-06T22:20:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e13fff640 1 -- 172.21.15.55:0/4163307717 learned_addr learned my addr 172.21.15.55:0/4163307717 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:20:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e1b7fe640 1 --2- 172.21.15.55:0/4163307717 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1c15cc00 0x7f2e1c166850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e1a7fc640 1 -- 172.21.15.55:0/4163307717 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442872723 0 0) 0x7f2e1c15c770 con 0x7f2e1c15bc40 2023-07-06T22:20:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e1a7fc640 1 -- 172.21.15.55:0/4163307717 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e08003530 con 0x7f2e1c15bc40 2023-07-06T22:20:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e1a7fc640 1 -- 172.21.15.55:0/4163307717 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126524453 0 0) 0x7f2e1c06d4f0 con 0x7f2e1c06f8e0 2023-07-06T22:20:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e1a7fc640 1 -- 172.21.15.55:0/4163307717 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e1c15c770 con 0x7f2e1c06f8e0 2023-07-06T22:20:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e1b7fe640 1 -- 172.21.15.55:0/4163307717 >> v1:172.21.15.138:6789/0 conn(0x7f2e1c06f8e0 legacy=0x7f2e1c06fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e1a7fc640 1 -- 172.21.15.55:0/4163307717 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1995432917 0 0) 0x7f2e08003530 con 0x7f2e1c15bc40 2023-07-06T22:20:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e1b7fe640 1 -- 172.21.15.55:0/4163307717 >> v1:172.21.15.55:6789/0 conn(0x7f2e1c15bc40 legacy=0x7f2e1c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.262+0000 7f2e1b7fe640 1 -- 172.21.15.55:0/4163307717 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c15c120 con 0x7f2e1c15cc00 2023-07-06T22:20:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e1b7fe640 1 --2- 172.21.15.55:0/4163307717 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1c15cc00 0x7f2e1c166850 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009df0 tx=0x7f2e1401c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2e5aa4f9c8da45b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e1a7fc640 1 -- 172.21.15.55:0/4163307717 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04001680 con 0x7f2e1c15cc00 2023-07-06T22:20:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e1a7fc640 1 -- 172.21.15.55:0/4163307717 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e140a5620 con 0x7f2e1c15cc00 2023-07-06T22:20:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e1a7fc640 1 -- 172.21.15.55:0/4163307717 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e140a59b0 con 0x7f2e1c15cc00 2023-07-06T22:20:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 -- 172.21.15.55:0/4163307717 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1c15cc00 msgr2=0x7f2e1c166850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 --2- 172.21.15.55:0/4163307717 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1c15cc00 0x7f2e1c166850 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009df0 tx=0x7f2e1401c890 comp rx=0 tx=0).stop 2023-07-06T22:20:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 -- 172.21.15.55:0/4163307717 shutdown_connections 2023-07-06T22:20:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 --2- 172.21.15.55:0/4163307717 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1c15cc00 0x7f2e1c166850 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 -- 172.21.15.55:0/4163307717 >> 172.21.15.55:0/4163307717 conn(0x7f2e1c0cbd80 msgr2=0x7f2e1c0ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 -- 172.21.15.55:0/4163307717 shutdown_connections 2023-07-06T22:20:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 -- 172.21.15.55:0/4163307717 wait complete. 2023-07-06T22:20:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 Processor -- start 2023-07-06T22:20:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 -- start start 2023-07-06T22:20:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e1c06f8e0 0x7f2e1c0ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1c15bc40 0x7f2e1c151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e1c15cc00 0x7f2e1c0c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c0abf00 con 0x7f2e1c15cc00 2023-07-06T22:20:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c151fc0 con 0x7f2e1c06f8e0 2023-07-06T22:20:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.266+0000 7f2e21407640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c159080 con 0x7f2e1c15bc40 2023-07-06T22:20:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e1b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e1c15cc00 0x7f2e1c0c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:59.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e1b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e1c15cc00 0x7f2e1c0c5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44452/0 (socket says 172.21.15.55:44452) 2023-07-06T22:20:59.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e1b7fe640 1 -- 172.21.15.55:0/1313435279 learned_addr learned my addr 172.21.15.55:0/1313435279 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:59.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e1affd640 1 --2- 172.21.15.55:0/1313435279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e1c06f8e0 0x7f2e1c0ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:59.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e13fff640 1 --2- 172.21.15.55:0/1313435279 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1c15bc40 0x7f2e1c151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:59.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e1b7fe640 1 -- 172.21.15.55:0/1313435279 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1c15bc40 msgr2=0x7f2e1c151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e1b7fe640 1 --2- 172.21.15.55:0/1313435279 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1c15bc40 0x7f2e1c151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e1b7fe640 1 -- 172.21.15.55:0/1313435279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e1c06f8e0 msgr2=0x7f2e1c0ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e1b7fe640 1 --2- 172.21.15.55:0/1313435279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e1c06f8e0 0x7f2e1c0ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e1b7fe640 1 -- 172.21.15.55:0/1313435279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e14009a70 con 0x7f2e1c15cc00 2023-07-06T22:20:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e1b7fe640 1 --2- 172.21.15.55:0/1313435279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e1c15cc00 0x7f2e1c0c5740 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009df0 tx=0x7f2e14019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e137fe640 1 -- 172.21.15.55:0/1313435279 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14003ba0 con 0x7f2e1c15cc00 2023-07-06T22:20:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e137fe640 1 -- 172.21.15.55:0/1313435279 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e14003d00 con 0x7f2e1c15cc00 2023-07-06T22:20:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e137fe640 1 -- 172.21.15.55:0/1313435279 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14004220 con 0x7f2e1c15cc00 2023-07-06T22:20:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e21407640 1 -- 172.21.15.55:0/1313435279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1c159360 con 0x7f2e1c15cc00 2023-07-06T22:20:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e21407640 1 -- 172.21.15.55:0/1313435279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1c1544c0 con 0x7f2e1c15cc00 2023-07-06T22:20:59.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e21407640 1 -- 172.21.15.55:0/1313435279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1c1594f0 con 0x7f2e1c15cc00 2023-07-06T22:20:59.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e137fe640 1 -- 172.21.15.55:0/1313435279 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2e14004380 con 0x7f2e1c15cc00 2023-07-06T22:20:59.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.270+0000 7f2e137fe640 1 --2- 172.21.15.55:0/1313435279 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f2dfc0663d0 0x7f2dfc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:59.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.274+0000 7f2e137fe640 1 -- 172.21.15.55:0/1313435279 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f2e1411ee40 con 0x7f2e1c15cc00 2023-07-06T22:20:59.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.274+0000 7f2e1affd640 1 --2- 172.21.15.55:0/1313435279 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f2dfc0663d0 0x7f2dfc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:59.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.274+0000 7f2e1affd640 1 --2- 172.21.15.55:0/1313435279 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f2dfc0663d0 0x7f2dfc068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0011f0 tx=0x7f2e0c009040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:59.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.278+0000 7f2e137fe640 1 -- 172.21.15.55:0/1313435279 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e140ec060 con 0x7f2e1c15cc00 2023-07-06T22:20:59.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.430+0000 7f2e21407640 1 -- 172.21.15.55:0/1313435279 --> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e1c066d60 con 0x7f2dfc0663d0 2023-07-06T22:20:59.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.430+0000 7f2e137fe640 1 -- 172.21.15.55:0/1313435279 <== mgr.11301 v2:172.21.15.55:6832/3094866364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73021 (secure 0 0 0) 0x7f2e1c066d60 con 0x7f2dfc0663d0 2023-07-06T22:20:59.436 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:59.436 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:20:59.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.434+0000 7f2e21407640 1 -- 172.21.15.55:0/1313435279 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f2dfc0663d0 msgr2=0x7f2dfc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.434+0000 7f2e21407640 1 --2- 172.21.15.55:0/1313435279 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f2dfc0663d0 0x7f2dfc068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0011f0 tx=0x7f2e0c009040 comp rx=0 tx=0).stop 2023-07-06T22:20:59.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.434+0000 7f2e21407640 1 -- 172.21.15.55:0/1313435279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e1c15cc00 msgr2=0x7f2e1c0c5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.434+0000 7f2e21407640 1 --2- 172.21.15.55:0/1313435279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e1c15cc00 0x7f2e1c0c5740 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009df0 tx=0x7f2e14019630 comp rx=0 tx=0).stop 2023-07-06T22:20:59.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.434+0000 7f2e21407640 1 -- 172.21.15.55:0/1313435279 shutdown_connections 2023-07-06T22:20:59.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.434+0000 7f2e21407640 1 --2- 172.21.15.55:0/1313435279 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f2dfc0663d0 0x7f2dfc068880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.434+0000 7f2e21407640 1 --2- 172.21.15.55:0/1313435279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e1c15cc00 0x7f2e1c0c5740 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.434+0000 7f2e21407640 1 --2- 172.21.15.55:0/1313435279 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1c15bc40 0x7f2e1c151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.434+0000 7f2e21407640 1 --2- 172.21.15.55:0/1313435279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e1c06f8e0 0x7f2e1c0ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.434+0000 7f2e21407640 1 -- 172.21.15.55:0/1313435279 >> 172.21.15.55:0/1313435279 conn(0x7f2e1c0cbd80 msgr2=0x7f2e1c0cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:59.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.434+0000 7f2e21407640 1 -- 172.21.15.55:0/1313435279 shutdown_connections 2023-07-06T22:20:59.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.434+0000 7f2e21407640 1 -- 172.21.15.55:0/1313435279 wait complete. 2023-07-06T22:20:59.456 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-07-06T22:20:58.316659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":387616,"kb_used_data":21984,"kb_used_omap":0,"kb_used_meta":365568,"kb_avail":754587104,"statfs":{"total":773094113280,"available":772697194496,"internally_reserved":0,"allocated":22511616,"data_stored":13264098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":374341632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-668212,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-282,"num_write_kb":-2054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.129855"},"pg_stats":[{"pgid":"1.0","version":"198'348","reported_seq":1349,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.776473+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:20:51.776473+0000","last_peered":"2023-07-06T22:20:51.776473+0000","last_clean":"2023-07-06T22:20:51.776473+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:20:51.776473+0000","last_undegraded":"2023-07-06T22:20:51.776473+0000","last_fullsized":"2023-07-06T22:20:51.776473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:34:30.864308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":325,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.775248+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:20:51.775248+0000","last_peered":"2023-07-06T22:20:51.775248+0000","last_clean":"2023-07-06T22:20:51.775248+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:20:51.775248+0000","last_undegraded":"2023-07-06T22:20:51.775248+0000","last_fullsized":"2023-07-06T22:20:51.775248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:17:42.372224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":374,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.776289+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:20:51.776289+0000","last_peered":"2023-07-06T22:20:51.776289+0000","last_clean":"2023-07-06T22:20:51.776289+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:20:51.776289+0000","last_undegraded":"2023-07-06T22:20:51.776289+0000","last_fullsized":"2023-07-06T22:20:51.776289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:59:46.414221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":369,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.188649+0000","last_change":"2023-07-06T21:42:05.839505+0000","last_active":"2023-07-06T22:20:51.188649+0000","last_peered":"2023-07-06T22:20:51.188649+0000","last_clean":"2023-07-06T22:20:51.188649+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:20:51.188649+0000","last_undegraded":"2023-07-06T22:20:51.188649+0000","last_fullsized":"2023-07-06T22:20:51.188649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:48:37.977885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":325,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.775105+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:20:51.775105+0000","last_peered":"2023-07-06T22:20:51.775105+0000","last_clean":"2023-07-06T22:20:51.775105+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:20:51.775105+0000","last_undegraded":"2023-07-06T22:20:51.775105+0000","last_fullsized":"2023-07-06T22:20:51.775105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:54:15.842017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":329,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.189336+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:20:51.189336+0000","last_peered":"2023-07-06T22:20:51.189336+0000","last_clean":"2023-07-06T22:20:51.189336+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:20:51.189336+0000","last_undegraded":"2023-07-06T22:20:51.189336+0000","last_fullsized":"2023-07-06T22:20:51.189336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:32:31.393366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":373,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.776799+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:20:51.776799+0000","last_peered":"2023-07-06T22:20:51.776799+0000","last_clean":"2023-07-06T22:20:51.776799+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:20:51.776799+0000","last_undegraded":"2023-07-06T22:20:51.776799+0000","last_fullsized":"2023-07-06T22:20:51.776799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:04:12.865842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":329,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.189621+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:20:51.189621+0000","last_peered":"2023-07-06T22:20:51.189621+0000","last_clean":"2023-07-06T22:20:51.189621+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:20:51.189621+0000","last_undegraded":"2023-07-06T22:20:51.189621+0000","last_fullsized":"2023-07-06T22:20:51.189621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:56:32.476128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":320,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-07-06T22:20:51.775465+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:20:51.775465+0000","last_peered":"2023-07-06T22:20:51.775465+0000","last_clean":"2023-07-06T22:20:51.775465+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:20:51.775465+0000","last_undegraded":"2023-07-06T22:20:51.775465+0000","last_fullsized":"2023-07-06T22:20:51.775465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:17:20.739778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575309,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42584,"kb_used_data":3344,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329256,"statfs":{"total":96636764160,"available":96593158144,"internally_reserved":0,"allocated":3424256,"data_stored":2262326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.432},"max":{"1min":0.92100000000000004,"5min":0.93300000000000005,"15min":1.0740000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51600000000000001,"5min":0.45900000000000002,"15min":0.45700000000000002},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.52100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.74199999999999999,"15min":0.72399999999999998},"min":{"1min":0.57699999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.61099999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"max":{"1min":0.96399999999999997,"5min":0.96699999999999997,"15min":1.0149999999999999},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73999999999999999,"15min":0.73199999999999998},"min":{"1min":0.53100000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.84099999999999997,"15min":0.78400000000000003},"min":{"1min":0.56200000000000006,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":9.8279999999999994,"15min":9.8279999999999994},"last":0.499}]},{"osd":4,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.36799999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73499999999999999,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":2.2610000000000001,"5min":13.443,"15min":13.443},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.52400000000000002,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.746},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.71499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575309,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37576,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334264,"statfs":{"total":96636764160,"available":96598286336,"internally_reserved":0,"allocated":2490368,"data_stored":1342704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.40300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.7829999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":1.633},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.49199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.9099999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.97799999999999998},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83199999999999996,"5min":0.91100000000000003,"15min":2.0299999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":1.04,"15min":1.5920000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.61099999999999999,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.996},"last":0.495}]},{"osd":4,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.69699999999999995,"5min":1.024,"15min":1.024},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80200000000000005,"5min":0.92600000000000005,"15min":0.996},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":0.89900000000000002,"15min":0.98499999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.85999999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82499999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.624},"min":{"1min":0.54100000000000004,"5min":0.45600000000000002,"15min":0.439},"max":{"1min":0.78400000000000003,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.53200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575308,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59724,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312116,"statfs":{"total":96636764160,"available":96575606784,"internally_reserved":0,"allocated":2494464,"data_stored":1343723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.92100000000000004,"5min":0.97199999999999998,"15min":0.999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.628,"5min":0.46999999999999997,"15min":0.46400000000000002},"max":{"1min":0.88400000000000001,"5min":0.995,"15min":0.995},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.52200000000000002,"5min":0.44400000000000001,"15min":0.43099999999999999},"max":{"1min":0.94799999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.60599999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.006,"5min":1.006,"15min":1.3200000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.46300000000000002},"max":{"1min":0.93700000000000006,"5min":0.998,"15min":1.4299999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.749},"min":{"1min":0.56200000000000006,"5min":0.48499999999999999,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":0.999,"15min":1.0409999999999999},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.54400000000000004,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":0.996,"15min":1.5169999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.623,"5min":0.51500000000000001,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.629}]},{"osd":4,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61599999999999999,"15min":0.61699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.79800000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.622,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.5,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69799999999999995,"15min":0.69099999999999995},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.66800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575307,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55648,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316192,"statfs":{"total":96636764160,"available":96579780608,"internally_reserved":0,"allocated":2514944,"data_stored":1355605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.42199999999999999},"max":{"1min":0.876,"5min":0.96399999999999997,"15min":0.98999999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":0.97899999999999998,"15min":1.016},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.56899999999999995,"5min":0.47899999999999998,"15min":0.38300000000000001},"max":{"1min":0.93400000000000005,"5min":0.999,"15min":1.0309999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.996},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.622,"5min":0.54600000000000004,"15min":0.502},"max":{"1min":0.97699999999999998,"5min":0.99399999999999999,"15min":1.0580000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.53500000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.98699999999999999},"last":0.621},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":1.022,"15min":1.03},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.36599999999999999},"max":{"1min":0.76800000000000002,"5min":0.91200000000000003,"15min":0.92600000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":0.95599999999999996,"15min":1.006},"last":0.439}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.91500000000000004,"15min":1.0509999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.41299999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.5}]},{"osd":7,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90300000000000002,"5min":0.94799999999999995,"15min":1.0469999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.432,"15min":0.432},"max":{"1min":0.90200000000000002,"5min":1.0109999999999999,"15min":1.1100000000000001},"last":0.47899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575308,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51864,"kb_used_data":2768,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94319976,"statfs":{"total":96636764160,"available":96583655424,"internally_reserved":0,"allocated":2834432,"data_stored":1672048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45900000000000002,"15min":0.46400000000000002},"min":{"1min":0.27300000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.60299999999999998,"5min":0.68100000000000005,"15min":0.85899999999999999},"last":0.44},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.623,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":0.83899999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.70099999999999996,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.875},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34699999999999998},"max":{"1min":0.73699999999999999,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.77900000000000003}]},{"osd":4,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.77400000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.441},"max":{"1min":0.98799999999999999,"5min":1.0449999999999999,"15min":1.474},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.3859999999999999},"last":0.82199999999999995}]},{"osd":5,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79300000000000004,"15min":0.80800000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.056,"5min":1.175,"15min":1.3740000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.081,"5min":1.081,"15min":1.2330000000000001},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.52200000000000002},"max":{"1min":0.97499999999999998,"5min":1.1399999999999999,"15min":1.3899999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.57299999999999995},"max":{"1min":1.028,"5min":1.1499999999999999,"15min":1.3220000000000001},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.2210000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82299999999999995,"15min":0.82799999999999996},"min":{"1min":0.61499999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0629999999999999,"5min":1.244,"15min":1.3200000000000001},"last":0.76100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575308,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41684,"kb_used_data":2444,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330156,"statfs":{"total":96636764160,"available":96594079744,"internally_reserved":0,"allocated":2502656,"data_stored":1344316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.77000000000000002,"15min":0.78600000000000003},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.42499999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65600000000000003,"5min":0.74099999999999999,"15min":0.84099999999999997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.72399999999999998,"5min":0.85099999999999998,"15min":0.97099999999999997},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.63600000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58799999999999997},"min":{"1min":0.46300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.66500000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94199999999999995,"5min":1.663,"15min":1.663},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.61099999999999999,"5min":0.54900000000000004,"15min":0.51600000000000001},"max":{"1min":0.94899999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.66000000000000003,"5min":0.55900000000000005,"15min":0.51100000000000001},"max":{"1min":0.90900000000000003,"5min":1.337,"15min":1.337},"last":0.873},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80700000000000005,"15min":0.82899999999999996},"min":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0189999999999999,"5min":1.228,"15min":1.2829999999999999},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.996,"5min":1.367,"15min":1.367},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81200000000000006,"15min":0.82999999999999996},"min":{"1min":0.65300000000000002,"5min":0.59999999999999998,"15min":0.56100000000000005},"max":{"1min":0.96499999999999997,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.995}]},{"osd":7,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.98099999999999998,"5min":1.407,"15min":1.407},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82099999999999995,"15min":0.83999999999999997},"min":{"1min":0.67200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.024,"5min":1.296,"15min":1.296},"last":0.94099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575309,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60060,"kb_used_data":2772,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311780,"statfs":{"total":96636764160,"available":96575262720,"internally_reserved":0,"allocated":2838528,"data_stored":1682703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.316,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.72599999999999998,"5min":1.645,"15min":1.645},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.72299999999999998,"5min":0.90700000000000003,"15min":0.94299999999999995},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.68799999999999994,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.502,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.81699999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79600000000000004,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.372}]},{"osd":4,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74299999999999999,"15min":0.77600000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96999999999999997,"5min":1.083,"15min":1.1140000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78700000000000003,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.51700000000000002},"max":{"1min":0.92700000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.48699999999999999},"max":{"1min":1.012,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79800000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96399999999999997,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95399999999999996,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.56100000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94299999999999995,"5min":1.25,"15min":1.3360000000000001},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81399999999999995,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.56100000000000005},"max":{"1min":0.99199999999999999,"5min":1.155,"15min":1.405},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.61199999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98199999999999998,"5min":1.788,"15min":1.788},"last":0.61399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575308,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38476,"kb_used_data":3332,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333364,"statfs":{"total":96636764160,"available":96597364736,"internally_reserved":0,"allocated":3411968,"data_stored":2260673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.434,"15min":0.46000000000000002},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54200000000000004,"5min":0.745,"15min":0.745},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.312},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.1319999999999999},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.39600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":1.1599999999999999},"last":0.82499999999999996}]},{"osd":3,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.89200000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.40999999999999998},"max":{"1min":0.71699999999999997,"5min":0.77100000000000002,"15min":0.95399999999999996},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77000000000000002,"15min":0.79600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96299999999999997,"5min":1.1439999999999999,"15min":1.294},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90800000000000003,"5min":1.1000000000000001,"15min":1.3320000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.0569999999999999,"15min":1.345},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.76300000000000001,"15min":0.79600000000000004},"min":{"1min":0.57499999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.56000000000000005,"5min":0.498,"15min":0.47699999999999998},"max":{"1min":0.96699999999999997,"5min":1.0569999999999999,"15min":1.153},"last":0.752},{"interface":"front","average":{"1min":0.747,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99199999999999999,"5min":1.0840000000000001,"15min":1.272},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.52100000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.26},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55700000000000005},"max":{"1min":0.97699999999999998,"5min":1.1220000000000001,"15min":1.2350000000000001},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:20:59.459 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T22:20:59.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f4498048640 1 Processor -- start 2023-07-06T22:20:59.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f4498048640 1 -- start start 2023-07-06T22:20:59.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f4498048640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f449015ef20 0x7f449006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:59.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f4498048640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44900ca820 0x7f44900693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:59.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f4498048640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44900ccbc0 con 0x7f449006baf0 2023-07-06T22:20:59.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f4498048640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449006bf40 con 0x7f449015ef20 2023-07-06T22:20:59.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f4498048640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44900cbfb0 con 0x7f44900ca820 2023-07-06T22:20:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f4495de4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f449015ef20 0x7f449006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f4495de4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f449015ef20 0x7f449006b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44458/0 (socket says 172.21.15.55:44458) 2023-07-06T22:20:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f4495de4640 1 -- 172.21.15.55:0/224689239 learned_addr learned my addr 172.21.15.55:0/224689239 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f44965e5640 1 --2- 172.21.15.55:0/224689239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44900ca820 0x7f44900693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f4495de4640 1 -- 172.21.15.55:0/224689239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44900ca820 msgr2=0x7f44900693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:20:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f4495de4640 1 --2- 172.21.15.55:0/224689239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44900ca820 0x7f44900693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f4495de4640 1 -- 172.21.15.55:0/224689239 >> v1:172.21.15.55:6789/0 conn(0x7f449006baf0 legacy=0x7f44900ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.598+0000 7f4495de4640 1 -- 172.21.15.55:0/224689239 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44900cc290 con 0x7f449015ef20 2023-07-06T22:20:59.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.602+0000 7f4495de4640 1 --2- 172.21.15.55:0/224689239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449015ef20 0x7f449006b5b0 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f448c009870 tx=0x7f448c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee77727a8e1f8da7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:59.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.602+0000 7f4494de2640 1 -- 172.21.15.55:0/224689239 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c0ab600 con 0x7f449015ef20 2023-07-06T22:20:59.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.602+0000 7f4494de2640 1 -- 172.21.15.55:0/224689239 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c0a7050 con 0x7f449015ef20 2023-07-06T22:20:59.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.602+0000 7f4494de2640 1 -- 172.21.15.55:0/224689239 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c0ab980 con 0x7f449015ef20 2023-07-06T22:20:59.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.602+0000 7f4498048640 1 -- 172.21.15.55:0/224689239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449015ef20 msgr2=0x7f449006b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.602+0000 7f4498048640 1 --2- 172.21.15.55:0/224689239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449015ef20 0x7f449006b5b0 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f448c009870 tx=0x7f448c01c540 comp rx=0 tx=0).stop 2023-07-06T22:20:59.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.602+0000 7f4498048640 1 -- 172.21.15.55:0/224689239 shutdown_connections 2023-07-06T22:20:59.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.602+0000 7f4498048640 1 --2- 172.21.15.55:0/224689239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f44900ca820 0x7f44900693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.602+0000 7f4498048640 1 --2- 172.21.15.55:0/224689239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449015ef20 0x7f449006b5b0 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.602+0000 7f4498048640 1 -- 172.21.15.55:0/224689239 >> 172.21.15.55:0/224689239 conn(0x7f44900ce340 msgr2=0x7f44900ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:59.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.602+0000 7f4498048640 1 -- 172.21.15.55:0/224689239 shutdown_connections 2023-07-06T22:20:59.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.602+0000 7f4498048640 1 -- 172.21.15.55:0/224689239 wait complete. 2023-07-06T22:20:59.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f4498048640 1 Processor -- start 2023-07-06T22:20:59.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f4498048640 1 -- start start 2023-07-06T22:20:59.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f4498048640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f449006baf0 0x7f44900b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:59.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f4498048640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44900ca820 0x7f4490157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f4498048640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449015ef20 0x7f4490158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f4498048640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4490143950 con 0x7f449015ef20 2023-07-06T22:20:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f4498048640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44900b4150 con 0x7f44900ca820 2023-07-06T22:20:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f4498048640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44900c2580 con 0x7f449006baf0 2023-07-06T22:20:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f44965e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449015ef20 0x7f4490158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f44965e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449015ef20 0x7f4490158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44464/0 (socket says 172.21.15.55:44464) 2023-07-06T22:20:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f44965e5640 1 -- 172.21.15.55:0/2303705583 learned_addr learned my addr 172.21.15.55:0/2303705583 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:20:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f44955e3640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44900ca820 0x7f4490157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f4495de4640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f449006baf0 0x7f44900b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f44965e5640 1 -- 172.21.15.55:0/2303705583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f449006baf0 msgr2=0x7f44900b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f44965e5640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f449006baf0 0x7f44900b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f44965e5640 1 -- 172.21.15.55:0/2303705583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44900ca820 msgr2=0x7f4490157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f44965e5640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44900ca820 0x7f4490157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f44965e5640 1 -- 172.21.15.55:0/2303705583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c0094d0 con 0x7f449015ef20 2023-07-06T22:20:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f4495de4640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f449006baf0 0x7f44900b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f44955e3640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44900ca820 0x7f4490157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:20:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f44965e5640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449015ef20 0x7f4490158120 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f448800cd70 tx=0x7f448800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f44867fc640 1 -- 172.21.15.55:0/2303705583 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488003ba0 con 0x7f449015ef20 2023-07-06T22:20:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f44867fc640 1 -- 172.21.15.55:0/2303705583 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4488003d00 con 0x7f449015ef20 2023-07-06T22:20:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f44867fc640 1 -- 172.21.15.55:0/2303705583 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488004240 con 0x7f449015ef20 2023-07-06T22:20:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f4498048640 1 -- 172.21.15.55:0/2303705583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44900b3b00 con 0x7f449015ef20 2023-07-06T22:20:59.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.606+0000 7f4498048640 1 -- 172.21.15.55:0/2303705583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44900b37f0 con 0x7f449015ef20 2023-07-06T22:20:59.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.610+0000 7f4498048640 1 -- 172.21.15.55:0/2303705583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44900c8f70 con 0x7f449015ef20 2023-07-06T22:20:59.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.610+0000 7f44867fc640 1 -- 172.21.15.55:0/2303705583 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f44880043a0 con 0x7f449015ef20 2023-07-06T22:20:59.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.610+0000 7f44867fc640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f44740663d0 0x7f4474068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:20:59.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.610+0000 7f44867fc640 1 -- 172.21.15.55:0/2303705583 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f4488012070 con 0x7f449015ef20 2023-07-06T22:20:59.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.610+0000 7f4495de4640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f44740663d0 0x7f4474068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:20:59.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.610+0000 7f4495de4640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f44740663d0 0x7f4474068880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f449006f030 tx=0x7f448c009040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:20:59.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.614+0000 7f44867fc640 1 -- 172.21.15.55:0/2303705583 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4488051bb0 con 0x7f449015ef20 2023-07-06T22:20:59.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.774+0000 7f4498048640 1 -- 172.21.15.55:0/2303705583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4490066d60 con 0x7f449015ef20 2023-07-06T22:20:59.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.774+0000 7f44867fc640 1 -- 172.21.15.55:0/2303705583 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+16079 (secure 0 0 0) 0x7f44880551d0 con 0x7f449015ef20 2023-07-06T22:20:59.779 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:20:59.779 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":201,"fsid":"c64f3ef1-e769-47b3-ae15-a714e4e7c4f7","created":"2023-07-06T21:41:44.570749+0000","modified":"2023-07-06T22:20:55.337906+0000","last_up_change":"2023-07-06T21:41:57.145121+0000","last_in_change":"2023-07-06T21:41:47.210486+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T21:41:57.708141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T21:42:03.572007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f52bc3c8-676c-4db2-a570-b168fb976d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6801","nonce":3314779935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6803","nonce":3314779935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6807","nonce":3314779935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3314779935},{"type":"v1","addr":"172.21.15.55:6805","nonce":3314779935}]},"public_addr":"172.21.15.55:6801/3314779935","cluster_addr":"172.21.15.55:6803/3314779935","heartbeat_back_addr":"172.21.15.55:6807/3314779935","heartbeat_front_addr":"172.21.15.55:6805/3314779935","state":["exists","up"]},{"osd":1,"uuid":"56a9f777-b856-4820-af52-809cbee7ba1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6818","nonce":110907122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6822","nonce":110907122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6830","nonce":110907122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":110907122},{"type":"v1","addr":"172.21.15.55:6826","nonce":110907122}]},"public_addr":"172.21.15.55:6818/110907122","cluster_addr":"172.21.15.55:6822/110907122","heartbeat_back_addr":"172.21.15.55:6830/110907122","heartbeat_front_addr":"172.21.15.55:6826/110907122","state":["exists","up"]},{"osd":2,"uuid":"e748d632-246c-4f6a-8093-9c18f6a67cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6819","nonce":4070957199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6823","nonce":4070957199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6831","nonce":4070957199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":4070957199},{"type":"v1","addr":"172.21.15.55:6827","nonce":4070957199}]},"public_addr":"172.21.15.55:6819/4070957199","cluster_addr":"172.21.15.55:6823/4070957199","heartbeat_back_addr":"172.21.15.55:6831/4070957199","heartbeat_front_addr":"172.21.15.55:6827/4070957199","state":["exists","up"]},{"osd":3,"uuid":"80a88ca7-dd19-435d-a84c-52f3299bfc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6809","nonce":2677129803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6811","nonce":2677129803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6815","nonce":2677129803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2677129803},{"type":"v1","addr":"172.21.15.55:6813","nonce":2677129803}]},"public_addr":"172.21.15.55:6809/2677129803","cluster_addr":"172.21.15.55:6811/2677129803","heartbeat_back_addr":"172.21.15.55:6815/2677129803","heartbeat_front_addr":"172.21.15.55:6813/2677129803","state":["exists","up"]},{"osd":4,"uuid":"58bc816d-379a-4c71-9f72-cd12ced7710d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6825","nonce":851191383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6827","nonce":851191383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6831","nonce":851191383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":851191383},{"type":"v1","addr":"172.21.15.138:6829","nonce":851191383}]},"public_addr":"172.21.15.138:6825/851191383","cluster_addr":"172.21.15.138:6827/851191383","heartbeat_back_addr":"172.21.15.138:6831/851191383","heartbeat_front_addr":"172.21.15.138:6829/851191383","state":["exists","up"]},{"osd":5,"uuid":"d36bd7b6-07dc-4d35-ab89-0755e0225a2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6801","nonce":1249635244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6805","nonce":1249635244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6814","nonce":1249635244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6807","nonce":1249635244},{"type":"v1","addr":"172.21.15.138:6809","nonce":1249635244}]},"public_addr":"172.21.15.138:6801/1249635244","cluster_addr":"172.21.15.138:6805/1249635244","heartbeat_back_addr":"172.21.15.138:6814/1249635244","heartbeat_front_addr":"172.21.15.138:6809/1249635244","state":["exists","up"]},{"osd":6,"uuid":"82f034e6-2722-4de8-9bee-aaf08182f83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6804","nonce":1391058734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6808","nonce":1391058734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6815","nonce":1391058734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1391058734},{"type":"v1","addr":"172.21.15.138:6812","nonce":1391058734}]},"public_addr":"172.21.15.138:6804/1391058734","cluster_addr":"172.21.15.138:6808/1391058734","heartbeat_back_addr":"172.21.15.138:6815/1391058734","heartbeat_front_addr":"172.21.15.138:6812/1391058734","state":["exists","up"]},{"osd":7,"uuid":"fa2efd3b-1c49-438b-98dd-ba6fcc2fca76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6817","nonce":3688560884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6819","nonce":3688560884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6823","nonce":3688560884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3688560884},{"type":"v1","addr":"172.21.15.138:6821","nonce":3688560884}]},"public_addr":"172.21.15.138:6817/3688560884","cluster_addr":"172.21.15.138:6819/3688560884","heartbeat_back_addr":"172.21.15.138:6823/3688560884","heartbeat_front_addr":"172.21.15.138:6821/3688560884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.841241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:53.048573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.911542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.900361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.916101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.844988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.783098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T21:41:52.877288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.138:6835/3113237921":"2023-07-07T22:20:51.183993+0000","172.21.15.138:6833/3113237921":"2023-07-07T22:20:51.183993+0000","172.21.15.55:0/1748099556":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/3699924180":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/1557240001":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/2892168105":"2023-07-07T22:20:48.294273+0000","172.21.15.55:6833/3861190779":"2023-07-07T22:20:48.294273+0000","172.21.15.55:6832/3861190779":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/2133543533":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/2070899305":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/3797237235":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/558674907":"2023-07-07T22:20:41.235643+0000","172.21.15.55:6833/538997467":"2023-07-07T22:20:41.235643+0000","172.21.15.55:6832/538997467":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/3471768092":"2023-07-07T22:20:48.294273+0000","172.21.15.55:0/2063199878":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/2431773305":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/237391926":"2023-07-07T22:20:41.235643+0000","172.21.15.55:0/3850725654":"2023-07-07T22:20:41.235643+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T22:20:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.778+0000 7f4498048640 1 -- 172.21.15.55:0/2303705583 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f44740663d0 msgr2=0x7f4474068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.778+0000 7f4498048640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f44740663d0 0x7f4474068880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f449006f030 tx=0x7f448c009040 comp rx=0 tx=0).stop 2023-07-06T22:20:59.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.778+0000 7f4498048640 1 -- 172.21.15.55:0/2303705583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449015ef20 msgr2=0x7f4490158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:20:59.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.778+0000 7f4498048640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449015ef20 0x7f4490158120 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f448800cd70 tx=0x7f448800a660 comp rx=0 tx=0).stop 2023-07-06T22:20:59.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.778+0000 7f4498048640 1 -- 172.21.15.55:0/2303705583 shutdown_connections 2023-07-06T22:20:59.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.778+0000 7f4498048640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f44740663d0 0x7f4474068880 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.778+0000 7f4498048640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449015ef20 0x7f4490158120 unknown :-1 s=CLOSED pgs=2362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.778+0000 7f4498048640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44900ca820 0x7f4490157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.778+0000 7f4498048640 1 --2- 172.21.15.55:0/2303705583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f449006baf0 0x7f44900b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:20:59.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.778+0000 7f4498048640 1 -- 172.21.15.55:0/2303705583 >> 172.21.15.55:0/2303705583 conn(0x7f44900ce340 msgr2=0x7f449015de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:20:59.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.778+0000 7f4498048640 1 -- 172.21.15.55:0/2303705583 shutdown_connections 2023-07-06T22:20:59.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:20:59.778+0000 7f4498048640 1 -- 172.21.15.55:0/2303705583 wait complete. 2023-07-06T22:21:00.801 INFO:tasks.ceph:Scrubbing osd.0 2023-07-06T22:21:00.802 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-06T22:21:00.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.954+0000 7fe43aba3640 1 Processor -- start 2023-07-06T22:21:00.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.954+0000 7fe43aba3640 1 -- start start 2023-07-06T22:21:00.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe43aba3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe434158780 0x7fe4340cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:00.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe43aba3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe434158b50 con 0x7fe4340cbfa0 2023-07-06T22:21:00.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe43aba3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43406fb00 con 0x7fe4340c89b0 2023-07-06T22:21:00.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe43aba3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43406b390 con 0x7fe434158780 2023-07-06T22:21:00.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe433fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe4340cbfa0 0x7fe43406f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53872/0 (socket says 172.21.15.55:53872) 2023-07-06T22:21:00.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe433fff640 1 -- 172.21.15.55:0/1025699701 learned_addr learned my addr 172.21.15.55:0/1025699701 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:21:00.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe43893f640 1 --2- 172.21.15.55:0/1025699701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe434158780 0x7fe4340cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:00.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970622287 0 0) 0x7fe434158b50 con 0x7fe4340cbfa0 2023-07-06T22:21:00.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe424003530 con 0x7fe4340cbfa0 2023-07-06T22:21:00.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534003947 0 0) 0x7fe42c0014a0 con 0x7fe4340c89b0 2023-07-06T22:21:00.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe434158b50 con 0x7fe4340c89b0 2023-07-06T22:21:00.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1713644651 0 0) 0x7fe424003530 con 0x7fe4340cbfa0 2023-07-06T22:21:00.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe434158780 msgr2=0x7fe4340cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:00.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 --2- 172.21.15.55:0/1025699701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe434158780 0x7fe4340cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:00.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 >> v1:172.21.15.138:6789/0 conn(0x7fe4340c89b0 legacy=0x7fe43406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:00.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4340cd3d0 con 0x7fe4340cbfa0 2023-07-06T22:21:00.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fe420001680 con 0x7fe4340cbfa0 2023-07-06T22:21:00.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 >> v1:172.21.15.55:6789/0 conn(0x7fe4340cbfa0 legacy=0x7fe43406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:00.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 --2- 172.21.15.55:0/1025699701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe424003b40 0x7fe424003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:00.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 --2- 172.21.15.55:0/1025699701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4240047d0 0x7fe424004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:00.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 --2- 172.21.15.55:0/1025699701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe424005180 0x7fe42400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:00.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43406b390 con 0x7fe4240047d0 2023-07-06T22:21:00.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42400e1f0 con 0x7fe424003b40 2023-07-06T22:21:00.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42400e3b0 con 0x7fe424005180 2023-07-06T22:21:00.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe43893f640 1 --2- 172.21.15.55:0/1025699701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe434158780 0x7fe4340cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:21:00.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe433fff640 1 --2- 172.21.15.55:0/1025699701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4240047d0 0x7fe424004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:00.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe439140640 1 --2- 172.21.15.55:0/1025699701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe424005180 0x7fe42400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:00.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe43893f640 1 --2- 172.21.15.55:0/1025699701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe424003b40 0x7fe424003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:00.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe433fff640 1 -- 172.21.15.55:0/1025699701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe424005180 msgr2=0x7fe42400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:00.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe433fff640 1 --2- 172.21.15.55:0/1025699701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe424005180 0x7fe42400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:00.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe433fff640 1 -- 172.21.15.55:0/1025699701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe424003b40 msgr2=0x7fe424003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:00.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe433fff640 1 --2- 172.21.15.55:0/1025699701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe424003b40 0x7fe424003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:00.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe433fff640 1 -- 172.21.15.55:0/1025699701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe424003530 con 0x7fe4240047d0 2023-07-06T22:21:00.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.958+0000 7fe439140640 1 --2- 172.21.15.55:0/1025699701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe424005180 0x7fe42400dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:21:00.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.962+0000 7fe433fff640 1 --2- 172.21.15.55:0/1025699701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4240047d0 0x7fe424004c40 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7fe42000c160 tx=0x7fe42001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722d65edbc49fe29 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:00.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.962+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4200058e0 con 0x7fe4240047d0 2023-07-06T22:21:00.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.962+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe420005a60 con 0x7fe4240047d0 2023-07-06T22:21:00.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.962+0000 7fe4337fe640 1 -- 172.21.15.55:0/1025699701 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe420005e10 con 0x7fe4240047d0 2023-07-06T22:21:00.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.962+0000 7fe43aba3640 1 -- 172.21.15.55:0/1025699701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4240047d0 msgr2=0x7fe424004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:00.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.962+0000 7fe43aba3640 1 --2- 172.21.15.55:0/1025699701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4240047d0 0x7fe424004c40 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7fe42000c160 tx=0x7fe42001cba0 comp rx=0 tx=0).stop 2023-07-06T22:21:00.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.962+0000 7fe439140640 1 -- 172.21.15.55:0/1025699701 reap_dead start 2023-07-06T22:21:00.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.962+0000 7fe43aba3640 1 -- 172.21.15.55:0/1025699701 shutdown_connections 2023-07-06T22:21:00.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.962+0000 7fe43aba3640 1 -- 172.21.15.55:0/1025699701 >> 172.21.15.55:0/1025699701 conn(0x7fe4340cde30 msgr2=0x7fe4340ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:00.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.962+0000 7fe43aba3640 1 -- 172.21.15.55:0/1025699701 shutdown_connections 2023-07-06T22:21:00.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.962+0000 7fe43aba3640 1 -- 172.21.15.55:0/1025699701 wait complete. 2023-07-06T22:21:00.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe43aba3640 1 Processor -- start 2023-07-06T22:21:00.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe43aba3640 1 -- start start 2023-07-06T22:21:00.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe43aba3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4240047d0 0x7fe4340c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:00.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe43aba3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4341e6830 0x7fe4341e6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:00.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe43aba3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4340c6fc0 0x7fe4340c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:00.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe43aba3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe434154420 con 0x7fe4341e6830 2023-07-06T22:21:00.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe43aba3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4341e71e0 con 0x7fe4240047d0 2023-07-06T22:21:00.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe43aba3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4340c7970 con 0x7fe4340c6fc0 2023-07-06T22:21:00.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe433fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4341e6830 0x7fe4341e6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:00.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe433fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4341e6830 0x7fe4341e6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44480/0 (socket says 172.21.15.55:44480) 2023-07-06T22:21:00.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe433fff640 1 -- 172.21.15.55:0/3303352984 learned_addr learned my addr 172.21.15.55:0/3303352984 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:00.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe43893f640 1 --2- 172.21.15.55:0/3303352984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4240047d0 0x7fe4340c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:00.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe439140640 1 --2- 172.21.15.55:0/3303352984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4340c6fc0 0x7fe4340c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:00.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe433fff640 1 -- 172.21.15.55:0/3303352984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4340c6fc0 msgr2=0x7fe4340c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:00.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe433fff640 1 --2- 172.21.15.55:0/3303352984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4340c6fc0 0x7fe4340c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:00.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe433fff640 1 -- 172.21.15.55:0/3303352984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4240047d0 msgr2=0x7fe4340c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:00.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe433fff640 1 --2- 172.21.15.55:0/3303352984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4240047d0 0x7fe4340c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:00.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe433fff640 1 -- 172.21.15.55:0/3303352984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4340c7c10 con 0x7fe4341e6830 2023-07-06T22:21:00.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe433fff640 1 --2- 172.21.15.55:0/3303352984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4341e6830 0x7fe4341e6ca0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7fe4200ab040 tx=0x7fe424005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:00.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe4317fa640 1 -- 172.21.15.55:0/3303352984 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4200047f0 con 0x7fe4341e6830 2023-07-06T22:21:00.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe4317fa640 1 -- 172.21.15.55:0/3303352984 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe420004950 con 0x7fe4341e6830 2023-07-06T22:21:00.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe43aba3640 1 -- 172.21.15.55:0/3303352984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4340c7ef0 con 0x7fe4341e6830 2023-07-06T22:21:00.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe4317fa640 1 -- 172.21.15.55:0/3303352984 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe420004cc0 con 0x7fe4341e6830 2023-07-06T22:21:00.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe43aba3640 1 -- 172.21.15.55:0/3303352984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe434140ab0 con 0x7fe4341e6830 2023-07-06T22:21:00.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.966+0000 7fe43aba3640 1 -- 172.21.15.55:0/3303352984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe43406bbf0 con 0x7fe4341e6830 2023-07-06T22:21:00.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.970+0000 7fe4317fa640 1 -- 172.21.15.55:0/3303352984 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe420005040 con 0x7fe4341e6830 2023-07-06T22:21:00.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.970+0000 7fe4317fa640 1 --2- 172.21.15.55:0/3303352984 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe418066390 0x7fe418068840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:00.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.970+0000 7fe4317fa640 1 -- 172.21.15.55:0/3303352984 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7fe42011d4a0 con 0x7fe4341e6830 2023-07-06T22:21:00.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.970+0000 7fe43893f640 1 --2- 172.21.15.55:0/3303352984 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe418066390 0x7fe418068840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:00.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.970+0000 7fe4317fa640 1 --2- 172.21.15.55:0/3303352984 >> [v2:172.21.15.55:6800/3314779935,v1:172.21.15.55:6801/3314779935] conn(0x7fe41806d2e0 0x7fe41806f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:00.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.970+0000 7fe4317fa640 1 -- 172.21.15.55:0/3303352984 --> [v2:172.21.15.55:6800/3314779935,v1:172.21.15.55:6801/3314779935] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe41806fe00 con 0x7fe41806d2e0 2023-07-06T22:21:00.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.970+0000 7fe4317fa640 1 -- 172.21.15.55:0/3303352984 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe42011fa80 con 0x7fe4341e6830 2023-07-06T22:21:00.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.970+0000 7fe439140640 1 --2- 172.21.15.55:0/3303352984 >> [v2:172.21.15.55:6800/3314779935,v1:172.21.15.55:6801/3314779935] conn(0x7fe41806d2e0 0x7fe41806f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:00.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.970+0000 7fe43893f640 1 --2- 172.21.15.55:0/3303352984 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe418066390 0x7fe418068840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe434069c50 tx=0x7fe428008040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:00.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.970+0000 7fe439140640 1 --2- 172.21.15.55:0/3303352984 >> [v2:172.21.15.55:6800/3314779935,v1:172.21.15.55:6801/3314779935] conn(0x7fe41806d2e0 0x7fe41806f730 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:00.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.970+0000 7fe4317fa640 1 -- 172.21.15.55:0/3303352984 <== osd.0 v2:172.21.15.55:6800/3314779935 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe41806fe00 con 0x7fe41806d2e0 2023-07-06T22:21:00.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.986+0000 7fe43aba3640 1 -- 172.21.15.55:0/3303352984 --> [v2:172.21.15.55:6800/3314779935,v1:172.21.15.55:6801/3314779935] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe43406cc30 con 0x7fe41806d2e0 2023-07-06T22:21:00.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.986+0000 7fe4317fa640 1 -- 172.21.15.55:0/3303352984 <== osd.0 v2:172.21.15.55:6800/3314779935 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe42c001f90 con 0x7fe41806d2e0 2023-07-06T22:21:00.989 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:21:00.989 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T22:21:00.989 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:21:00.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.986+0000 7fe43aba3640 1 -- 172.21.15.55:0/3303352984 >> [v2:172.21.15.55:6800/3314779935,v1:172.21.15.55:6801/3314779935] conn(0x7fe41806d2e0 msgr2=0x7fe41806f730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:00.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.986+0000 7fe43aba3640 1 --2- 172.21.15.55:0/3303352984 >> [v2:172.21.15.55:6800/3314779935,v1:172.21.15.55:6801/3314779935] conn(0x7fe41806d2e0 0x7fe41806f730 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:00.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.986+0000 7fe43aba3640 1 -- 172.21.15.55:0/3303352984 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe418066390 msgr2=0x7fe418068840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:00.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.986+0000 7fe43aba3640 1 --2- 172.21.15.55:0/3303352984 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe418066390 0x7fe418068840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe434069c50 tx=0x7fe428008040 comp rx=0 tx=0).stop 2023-07-06T22:21:00.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.986+0000 7fe43aba3640 1 -- 172.21.15.55:0/3303352984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4341e6830 msgr2=0x7fe4341e6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:00.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.986+0000 7fe43aba3640 1 --2- 172.21.15.55:0/3303352984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4341e6830 0x7fe4341e6ca0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7fe4200ab040 tx=0x7fe424005800 comp rx=0 tx=0).stop 2023-07-06T22:21:00.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.986+0000 7fe439140640 1 -- 172.21.15.55:0/3303352984 reap_dead start 2023-07-06T22:21:00.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.986+0000 7fe43aba3640 1 -- 172.21.15.55:0/3303352984 shutdown_connections 2023-07-06T22:21:00.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.986+0000 7fe43aba3640 1 -- 172.21.15.55:0/3303352984 >> 172.21.15.55:0/3303352984 conn(0x7fe4340cde30 msgr2=0x7fe4340c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:00.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.986+0000 7fe43aba3640 1 -- 172.21.15.55:0/3303352984 shutdown_connections 2023-07-06T22:21:00.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:00.986+0000 7fe43aba3640 1 -- 172.21.15.55:0/3303352984 wait complete. 2023-07-06T22:21:01.007 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-06T22:21:01.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f240e5d2640 1 Processor -- start 2023-07-06T22:21:01.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f240e5d2640 1 -- start start 2023-07-06T22:21:01.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f240e5d2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2408158850 0x7f24080cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f240e5d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24080ca130 0x7f24080ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f240e5d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24080b2aa0 con 0x7f24080703e0 2023-07-06T22:21:01.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f240e5d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2408158c20 con 0x7f24080ca130 2023-07-06T22:21:01.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f240e5d2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24080c8db0 con 0x7f2408158850 2023-07-06T22:21:01.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f24077fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24080ca130 0x7f24080ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f24077fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24080ca130 0x7f24080ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44488/0 (socket says 172.21.15.55:44488) 2023-07-06T22:21:01.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f24077fe640 1 -- 172.21.15.55:0/2768402519 learned_addr learned my addr 172.21.15.55:0/2768402519 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:01.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f2407fff640 1 --2- 172.21.15.55:0/2768402519 >> v2:172.21.15.138:3300/0 conn(0x7f2408158850 0x7f24080cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f24077fe640 1 -- 172.21.15.55:0/2768402519 >> v2:172.21.15.138:3300/0 conn(0x7f2408158850 msgr2=0x7f24080cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:01.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f24077fe640 1 --2- 172.21.15.55:0/2768402519 >> v2:172.21.15.138:3300/0 conn(0x7f2408158850 0x7f24080cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f24077fe640 1 -- 172.21.15.55:0/2768402519 >> v1:172.21.15.55:6789/0 conn(0x7f24080703e0 legacy=0x7f240806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.150+0000 7f24077fe640 1 -- 172.21.15.55:0/2768402519 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24080c9090 con 0x7f24080ca130 2023-07-06T22:21:01.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.154+0000 7f24077fe640 1 --2- 172.21.15.55:0/2768402519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24080ca130 0x7f24080ccf70 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7f240806eaf0 tx=0x7f23fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f87336dac7d4c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:01.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.154+0000 7f2406ffd640 1 -- 172.21.15.55:0/2768402519 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc0aa430 con 0x7f24080ca130 2023-07-06T22:21:01.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.154+0000 7f2406ffd640 1 -- 172.21.15.55:0/2768402519 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc0aa590 con 0x7f24080ca130 2023-07-06T22:21:01.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.154+0000 7f2406ffd640 1 -- 172.21.15.55:0/2768402519 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc0aa920 con 0x7f24080ca130 2023-07-06T22:21:01.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.154+0000 7f240e5d2640 1 -- 172.21.15.55:0/2768402519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24080ca130 msgr2=0x7f24080ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.154+0000 7f240e5d2640 1 --2- 172.21.15.55:0/2768402519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24080ca130 0x7f24080ccf70 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7f240806eaf0 tx=0x7f23fc01c4d0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.154+0000 7f240e5d2640 1 -- 172.21.15.55:0/2768402519 shutdown_connections 2023-07-06T22:21:01.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.154+0000 7f240e5d2640 1 --2- 172.21.15.55:0/2768402519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24080ca130 0x7f24080ccf70 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.154+0000 7f240e5d2640 1 --2- 172.21.15.55:0/2768402519 >> v2:172.21.15.138:3300/0 conn(0x7f2408158850 0x7f24080cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.154+0000 7f240e5d2640 1 -- 172.21.15.55:0/2768402519 >> 172.21.15.55:0/2768402519 conn(0x7f24080cea70 msgr2=0x7f24080ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:01.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.154+0000 7f240e5d2640 1 -- 172.21.15.55:0/2768402519 shutdown_connections 2023-07-06T22:21:01.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.154+0000 7f240e5d2640 1 -- 172.21.15.55:0/2768402519 wait complete. 2023-07-06T22:21:01.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.154+0000 7f240e5d2640 1 Processor -- start 2023-07-06T22:21:01.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.154+0000 7f240e5d2640 1 -- start start 2023-07-06T22:21:01.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f240e5d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24080703e0 0x7f24080c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f240e5d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24080ca130 0x7f24081505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f240e5d2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2408158850 0x7f2408150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f240e5d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24081f0100 con 0x7f24080ca130 2023-07-06T22:21:01.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f240e5d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2408153ec0 con 0x7f24080703e0 2023-07-06T22:21:01.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f240e5d2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24081541a0 con 0x7f2408158850 2023-07-06T22:21:01.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f24077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24080ca130 0x7f24081505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f24077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24080ca130 0x7f24081505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44492/0 (socket says 172.21.15.55:44492) 2023-07-06T22:21:01.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f24077fe640 1 -- 172.21.15.55:0/1719929667 learned_addr learned my addr 172.21.15.55:0/1719929667 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:01.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f2407fff640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24080703e0 0x7f24080c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f240cb6f640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2408158850 0x7f2408150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f24077fe640 1 -- 172.21.15.55:0/1719929667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2408158850 msgr2=0x7f2408150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f24077fe640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2408158850 0x7f2408150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f24077fe640 1 -- 172.21.15.55:0/1719929667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24080703e0 msgr2=0x7f24080c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f24077fe640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24080703e0 0x7f24080c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f24077fe640 1 -- 172.21.15.55:0/1719929667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc0094d0 con 0x7f24080ca130 2023-07-06T22:21:01.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f2407fff640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24080703e0 0x7f24080c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:21:01.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f24077fe640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24080ca130 0x7f24081505e0 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0190e0 tx=0x7f23fc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:01.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f2404ff9640 1 -- 172.21.15.55:0/1719929667 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc0b3800 con 0x7f24080ca130 2023-07-06T22:21:01.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f2404ff9640 1 -- 172.21.15.55:0/1719929667 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc0b3960 con 0x7f24080ca130 2023-07-06T22:21:01.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f2404ff9640 1 -- 172.21.15.55:0/1719929667 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc0b3cf0 con 0x7f24080ca130 2023-07-06T22:21:01.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f240e5d2640 1 -- 172.21.15.55:0/1719929667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2408154480 con 0x7f24080ca130 2023-07-06T22:21:01.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f240e5d2640 1 -- 172.21.15.55:0/1719929667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24080c67c0 con 0x7f24080ca130 2023-07-06T22:21:01.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.158+0000 7f240e5d2640 1 -- 172.21.15.55:0/1719929667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24080c69b0 con 0x7f24080ca130 2023-07-06T22:21:01.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.162+0000 7f2404ff9640 1 -- 172.21.15.55:0/1719929667 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f23fc0b2380 con 0x7f24080ca130 2023-07-06T22:21:01.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.162+0000 7f2404ff9640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f23f40663a0 0x7f23f4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.162+0000 7f2404ff9640 1 -- 172.21.15.55:0/1719929667 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f23fc11e660 con 0x7f24080ca130 2023-07-06T22:21:01.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.162+0000 7f2407fff640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f23f40663a0 0x7f23f4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.162+0000 7f2407fff640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f23f40663a0 0x7f23f4068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f23f800b9f0 tx=0x7f23f8008040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:01.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.166+0000 7f2404ff9640 1 -- 172.21.15.55:0/1719929667 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f24080c69b0 con 0x7f24080ca130 2023-07-06T22:21:01.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.318+0000 7f240e5d2640 1 -- 172.21.15.55:0/1719929667 --> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f24080c9c10 con 0x7f23f40663a0 2023-07-06T22:21:01.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.322+0000 7f2404ff9640 1 -- 172.21.15.55:0/1719929667 <== mgr.11301 v2:172.21.15.55:6832/3094866364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f23f800f860 con 0x7f23f40663a0 2023-07-06T22:21:01.324 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 0 to deep-scrub 2023-07-06T22:21:01.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.322+0000 7f240e5d2640 1 -- 172.21.15.55:0/1719929667 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f23f40663a0 msgr2=0x7f23f4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.322+0000 7f240e5d2640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f23f40663a0 0x7f23f4068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f23f800b9f0 tx=0x7f23f8008040 comp rx=0 tx=0).stop 2023-07-06T22:21:01.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.322+0000 7f240e5d2640 1 -- 172.21.15.55:0/1719929667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24080ca130 msgr2=0x7f24081505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.322+0000 7f240e5d2640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24080ca130 0x7f24081505e0 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0190e0 tx=0x7f23fc01ad10 comp rx=0 tx=0).stop 2023-07-06T22:21:01.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.322+0000 7f240e5d2640 1 -- 172.21.15.55:0/1719929667 shutdown_connections 2023-07-06T22:21:01.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.322+0000 7f240e5d2640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f23f40663a0 0x7f23f4068850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.322+0000 7f240e5d2640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2408158850 0x7f2408150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.322+0000 7f240e5d2640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24080ca130 0x7f24081505e0 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.322+0000 7f240e5d2640 1 --2- 172.21.15.55:0/1719929667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24080703e0 0x7f24080c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.322+0000 7f240e5d2640 1 -- 172.21.15.55:0/1719929667 >> 172.21.15.55:0/1719929667 conn(0x7f24080cea70 msgr2=0x7f24080b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:01.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.322+0000 7f240e5d2640 1 -- 172.21.15.55:0/1719929667 shutdown_connections 2023-07-06T22:21:01.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.322+0000 7f240e5d2640 1 -- 172.21.15.55:0/1719929667 wait complete. 2023-07-06T22:21:01.344 INFO:tasks.ceph:Scrubbing osd.1 2023-07-06T22:21:01.345 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-06T22:21:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.486+0000 7fe321007640 1 Processor -- start 2023-07-06T22:21:01.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.486+0000 7fe321007640 1 -- start start 2023-07-06T22:21:01.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.490+0000 7fe321007640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe31c06a460 0x7fe31c0caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.490+0000 7fe321007640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe31c06cb40 0x7fe31c0693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.490+0000 7fe321007640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31c0cc6a0 con 0x7fe31c069930 2023-07-06T22:21:01.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.490+0000 7fe321007640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31c06d780 con 0x7fe31c06a460 2023-07-06T22:21:01.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.490+0000 7fe321007640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c06d1c0 con 0x7fe31c06cb40 2023-07-06T22:21:01.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.490+0000 7fe31ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe31c06a460 0x7fe31c0caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.490+0000 7fe31ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe31c06a460 0x7fe31c0caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44496/0 (socket says 172.21.15.55:44496) 2023-07-06T22:21:01.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.490+0000 7fe31ad9d640 1 -- 172.21.15.55:0/736234462 learned_addr learned my addr 172.21.15.55:0/736234462 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:01.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.490+0000 7fe313fff640 1 --2- 172.21.15.55:0/736234462 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe31c06cb40 0x7fe31c0693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.490+0000 7fe31ad9d640 1 -- 172.21.15.55:0/736234462 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe31c06cb40 msgr2=0x7fe31c0693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:01.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.490+0000 7fe31ad9d640 1 --2- 172.21.15.55:0/736234462 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe31c06cb40 0x7fe31c0693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.490+0000 7fe31ad9d640 1 -- 172.21.15.55:0/736234462 >> v1:172.21.15.138:6789/0 conn(0x7fe31c069930 legacy=0x7fe31c06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.490+0000 7fe31ad9d640 1 -- 172.21.15.55:0/736234462 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c06d4a0 con 0x7fe31c06a460 2023-07-06T22:21:01.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.490+0000 7fe313fff640 1 --2- 172.21.15.55:0/736234462 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe31c06cb40 0x7fe31c0693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:21:01.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.494+0000 7fe31ad9d640 1 --2- 172.21.15.55:0/736234462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe31c06a460 0x7fe31c0caa80 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7fe30c006fd0 tx=0x7fe30c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50902c89107853d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:01.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.494+0000 7fe31a59c640 1 -- 172.21.15.55:0/736234462 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0ab600 con 0x7fe31c06a460 2023-07-06T22:21:01.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.494+0000 7fe31a59c640 1 -- 172.21.15.55:0/736234462 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c0a7050 con 0x7fe31c06a460 2023-07-06T22:21:01.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.494+0000 7fe31a59c640 1 -- 172.21.15.55:0/736234462 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0ab980 con 0x7fe31c06a460 2023-07-06T22:21:01.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.494+0000 7fe321007640 1 -- 172.21.15.55:0/736234462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe31c06a460 msgr2=0x7fe31c0caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.494+0000 7fe321007640 1 --2- 172.21.15.55:0/736234462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe31c06a460 0x7fe31c0caa80 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7fe30c006fd0 tx=0x7fe30c01c460 comp rx=0 tx=0).stop 2023-07-06T22:21:01.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.494+0000 7fe321007640 1 -- 172.21.15.55:0/736234462 shutdown_connections 2023-07-06T22:21:01.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.494+0000 7fe321007640 1 --2- 172.21.15.55:0/736234462 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe31c06cb40 0x7fe31c0693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.494+0000 7fe321007640 1 --2- 172.21.15.55:0/736234462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe31c06a460 0x7fe31c0caa80 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.494+0000 7fe321007640 1 -- 172.21.15.55:0/736234462 >> 172.21.15.55:0/736234462 conn(0x7fe31c0ce7f0 msgr2=0x7fe31c0cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:01.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.494+0000 7fe321007640 1 -- 172.21.15.55:0/736234462 shutdown_connections 2023-07-06T22:21:01.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.494+0000 7fe321007640 1 -- 172.21.15.55:0/736234462 wait complete. 2023-07-06T22:21:01.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.494+0000 7fe321007640 1 Processor -- start 2023-07-06T22:21:01.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.494+0000 7fe321007640 1 -- start start 2023-07-06T22:21:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe321007640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe31c069930 0x7fe31c0c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe321007640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe31c06a460 0x7fe31c0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe321007640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe31c06cb40 0x7fe31c14bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe321007640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c157260 con 0x7fe31c06a460 2023-07-06T22:21:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe321007640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c0c8560 con 0x7fe31c069930 2023-07-06T22:21:01.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe321007640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c15afa0 con 0x7fe31c06cb40 2023-07-06T22:21:01.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe313fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe31c06a460 0x7fe31c0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe313fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe31c06a460 0x7fe31c0c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44506/0 (socket says 172.21.15.55:44506) 2023-07-06T22:21:01.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe313fff640 1 -- 172.21.15.55:0/4025688828 learned_addr learned my addr 172.21.15.55:0/4025688828 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:01.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe31ad9d640 1 --2- 172.21.15.55:0/4025688828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe31c069930 0x7fe31c0c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe31b59e640 1 --2- 172.21.15.55:0/4025688828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe31c06cb40 0x7fe31c14bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe313fff640 1 -- 172.21.15.55:0/4025688828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe31c06cb40 msgr2=0x7fe31c14bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe313fff640 1 --2- 172.21.15.55:0/4025688828 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe31c06cb40 0x7fe31c14bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe313fff640 1 -- 172.21.15.55:0/4025688828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe31c069930 msgr2=0x7fe31c0c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe313fff640 1 --2- 172.21.15.55:0/4025688828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe31c069930 0x7fe31c0c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe313fff640 1 -- 172.21.15.55:0/4025688828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c009480 con 0x7fe31c06a460 2023-07-06T22:21:01.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe313fff640 1 --2- 172.21.15.55:0/4025688828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe31c06a460 0x7fe31c0c8020 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7fe30400e840 tx=0x7fe30400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:01.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe3137fe640 1 -- 172.21.15.55:0/4025688828 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30400c8d0 con 0x7fe31c06a460 2023-07-06T22:21:01.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe3137fe640 1 -- 172.21.15.55:0/4025688828 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30400ca30 con 0x7fe31c06a460 2023-07-06T22:21:01.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe321007640 1 -- 172.21.15.55:0/4025688828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31c15b280 con 0x7fe31c06a460 2023-07-06T22:21:01.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe3137fe640 1 -- 172.21.15.55:0/4025688828 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30400cdc0 con 0x7fe31c06a460 2023-07-06T22:21:01.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe321007640 1 -- 172.21.15.55:0/4025688828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31c14c190 con 0x7fe31c06a460 2023-07-06T22:21:01.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.498+0000 7fe321007640 1 -- 172.21.15.55:0/4025688828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe31c06a830 con 0x7fe31c06a460 2023-07-06T22:21:01.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.502+0000 7fe3137fe640 1 -- 172.21.15.55:0/4025688828 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe304013410 con 0x7fe31c06a460 2023-07-06T22:21:01.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.502+0000 7fe3137fe640 1 --2- 172.21.15.55:0/4025688828 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe2fc0663a0 0x7fe2fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.502+0000 7fe3137fe640 1 -- 172.21.15.55:0/4025688828 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7fe304083df0 con 0x7fe31c06a460 2023-07-06T22:21:01.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.502+0000 7fe31ad9d640 1 --2- 172.21.15.55:0/4025688828 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe2fc0663a0 0x7fe2fc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.502+0000 7fe3137fe640 1 --2- 172.21.15.55:0/4025688828 >> [v2:172.21.15.55:6816/110907122,v1:172.21.15.55:6818/110907122] conn(0x7fe2fc06d2f0 0x7fe2fc06f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.502+0000 7fe3137fe640 1 -- 172.21.15.55:0/4025688828 --> [v2:172.21.15.55:6816/110907122,v1:172.21.15.55:6818/110907122] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2fc06fe10 con 0x7fe2fc06d2f0 2023-07-06T22:21:01.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.502+0000 7fe3137fe640 1 -- 172.21.15.55:0/4025688828 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3040863d0 con 0x7fe31c06a460 2023-07-06T22:21:01.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.502+0000 7fe31b59e640 1 --2- 172.21.15.55:0/4025688828 >> [v2:172.21.15.55:6816/110907122,v1:172.21.15.55:6818/110907122] conn(0x7fe2fc06d2f0 0x7fe2fc06f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.502+0000 7fe31ad9d640 1 --2- 172.21.15.55:0/4025688828 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe2fc0663a0 0x7fe2fc068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0ad000 tx=0x7fe30c0a6000 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:01.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.502+0000 7fe31b59e640 1 --2- 172.21.15.55:0/4025688828 >> [v2:172.21.15.55:6816/110907122,v1:172.21.15.55:6818/110907122] conn(0x7fe2fc06d2f0 0x7fe2fc06f740 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:01.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.502+0000 7fe3137fe640 1 -- 172.21.15.55:0/4025688828 <== osd.1 v2:172.21.15.55:6816/110907122 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe2fc06fe10 con 0x7fe2fc06d2f0 2023-07-06T22:21:01.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.514+0000 7fe321007640 1 -- 172.21.15.55:0/4025688828 --> [v2:172.21.15.55:6816/110907122,v1:172.21.15.55:6818/110907122] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe31c15b110 con 0x7fe2fc06d2f0 2023-07-06T22:21:01.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.514+0000 7fe3137fe640 1 -- 172.21.15.55:0/4025688828 <== osd.1 v2:172.21.15.55:6816/110907122 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe31c15b110 con 0x7fe2fc06d2f0 2023-07-06T22:21:01.519 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:21:01.520 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T22:21:01.520 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:21:01.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.518+0000 7fe321007640 1 -- 172.21.15.55:0/4025688828 >> [v2:172.21.15.55:6816/110907122,v1:172.21.15.55:6818/110907122] conn(0x7fe2fc06d2f0 msgr2=0x7fe2fc06f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.518+0000 7fe321007640 1 --2- 172.21.15.55:0/4025688828 >> [v2:172.21.15.55:6816/110907122,v1:172.21.15.55:6818/110907122] conn(0x7fe2fc06d2f0 0x7fe2fc06f740 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.518+0000 7fe321007640 1 -- 172.21.15.55:0/4025688828 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe2fc0663a0 msgr2=0x7fe2fc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.518+0000 7fe321007640 1 --2- 172.21.15.55:0/4025688828 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fe2fc0663a0 0x7fe2fc068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0ad000 tx=0x7fe30c0a6000 comp rx=0 tx=0).stop 2023-07-06T22:21:01.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.518+0000 7fe321007640 1 -- 172.21.15.55:0/4025688828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe31c06a460 msgr2=0x7fe31c0c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.518+0000 7fe321007640 1 --2- 172.21.15.55:0/4025688828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe31c06a460 0x7fe31c0c8020 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7fe30400e840 tx=0x7fe30400ed00 comp rx=0 tx=0).stop 2023-07-06T22:21:01.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.518+0000 7fe31b59e640 1 -- 172.21.15.55:0/4025688828 reap_dead start 2023-07-06T22:21:01.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.518+0000 7fe321007640 1 -- 172.21.15.55:0/4025688828 shutdown_connections 2023-07-06T22:21:01.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.518+0000 7fe321007640 1 -- 172.21.15.55:0/4025688828 >> 172.21.15.55:0/4025688828 conn(0x7fe31c0ce7f0 msgr2=0x7fe31c0ad130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:01.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.518+0000 7fe321007640 1 -- 172.21.15.55:0/4025688828 shutdown_connections 2023-07-06T22:21:01.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.518+0000 7fe321007640 1 -- 172.21.15.55:0/4025688828 wait complete. 2023-07-06T22:21:01.537 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-06T22:21:01.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.678+0000 7fc5d85ad640 1 Processor -- start 2023-07-06T22:21:01.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.678+0000 7fc5d85ad640 1 -- start start 2023-07-06T22:21:01.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.678+0000 7fc5d85ad640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc5d0158850 0x7fc5d00cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.678+0000 7fc5d85ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc5d00ca130 0x7fc5d00ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.678+0000 7fc5d85ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5d00703e0 0x7fc5d0070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.678+0000 7fc5d85ad640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d0070dc0 con 0x7fc5d00ca130 2023-07-06T22:21:01.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.678+0000 7fc5d85ad640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d0158c20 con 0x7fc5d0158850 2023-07-06T22:21:01.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.678+0000 7fc5d85ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00c8db0 con 0x7fc5d00703e0 2023-07-06T22:21:01.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.678+0000 7fc5d5b48640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc5d00ca130 0x7fc5d00ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.678+0000 7fc5d5b48640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc5d00ca130 0x7fc5d00ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44518/0 (socket says 172.21.15.55:44518) 2023-07-06T22:21:01.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.678+0000 7fc5d5b48640 1 -- 172.21.15.55:0/3965784949 learned_addr learned my addr 172.21.15.55:0/3965784949 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:01.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.678+0000 7fc5d6b4a640 1 --2- 172.21.15.55:0/3965784949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5d00703e0 0x7fc5d0070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.678+0000 7fc5d6349640 1 --2- 172.21.15.55:0/3965784949 >> v2:172.21.15.138:3300/0 conn(0x7fc5d0158850 0x7fc5d00cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.682+0000 7fc5d5b48640 1 -- 172.21.15.55:0/3965784949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5d00703e0 msgr2=0x7fc5d0070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.682+0000 7fc5d5b48640 1 --2- 172.21.15.55:0/3965784949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5d00703e0 0x7fc5d0070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.682+0000 7fc5d5b48640 1 -- 172.21.15.55:0/3965784949 >> v2:172.21.15.138:3300/0 conn(0x7fc5d0158850 msgr2=0x7fc5d00cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:01.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.682+0000 7fc5d5b48640 1 --2- 172.21.15.55:0/3965784949 >> v2:172.21.15.138:3300/0 conn(0x7fc5d0158850 0x7fc5d00cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.682+0000 7fc5d5b48640 1 -- 172.21.15.55:0/3965784949 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d00c9090 con 0x7fc5d00ca130 2023-07-06T22:21:01.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.682+0000 7fc5d5b48640 1 --2- 172.21.15.55:0/3965784949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5d00ca130 0x7fc5d00ccf70 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7fc5d006eaf0 tx=0x7fc5c00213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b304a74d24788f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:01.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.682+0000 7fc5d5347640 1 -- 172.21.15.55:0/3965784949 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00b1600 con 0x7fc5d00ca130 2023-07-06T22:21:01.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.682+0000 7fc5d5347640 1 -- 172.21.15.55:0/3965784949 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c00ad050 con 0x7fc5d00ca130 2023-07-06T22:21:01.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.682+0000 7fc5d5347640 1 -- 172.21.15.55:0/3965784949 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00b1980 con 0x7fc5d00ca130 2023-07-06T22:21:01.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 -- 172.21.15.55:0/3965784949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5d00ca130 msgr2=0x7fc5d00ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 --2- 172.21.15.55:0/3965784949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5d00ca130 0x7fc5d00ccf70 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7fc5d006eaf0 tx=0x7fc5c00213c0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 -- 172.21.15.55:0/3965784949 shutdown_connections 2023-07-06T22:21:01.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 --2- 172.21.15.55:0/3965784949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5d00703e0 0x7fc5d0070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 --2- 172.21.15.55:0/3965784949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5d00ca130 0x7fc5d00ccf70 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 --2- 172.21.15.55:0/3965784949 >> v2:172.21.15.138:3300/0 conn(0x7fc5d0158850 0x7fc5d00cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 -- 172.21.15.55:0/3965784949 >> 172.21.15.55:0/3965784949 conn(0x7fc5d00cea70 msgr2=0x7fc5d00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:01.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 -- 172.21.15.55:0/3965784949 shutdown_connections 2023-07-06T22:21:01.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 -- 172.21.15.55:0/3965784949 wait complete. 2023-07-06T22:21:01.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 Processor -- start 2023-07-06T22:21:01.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 -- start start 2023-07-06T22:21:01.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5d00703e0 0x7fc5d009d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5d00ca130 0x7fc5d01515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5d0158850 0x7fc5d0151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00c40d0 con 0x7fc5d0158850 2023-07-06T22:21:01.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00c5740 con 0x7fc5d00ca130 2023-07-06T22:21:01.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d85ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d009ddf0 con 0x7fc5d00703e0 2023-07-06T22:21:01.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d6b4a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5d0158850 0x7fc5d0151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d6b4a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5d0158850 0x7fc5d0151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44528/0 (socket says 172.21.15.55:44528) 2023-07-06T22:21:01.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d6b4a640 1 -- 172.21.15.55:0/215856119 learned_addr learned my addr 172.21.15.55:0/215856119 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:01.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d6349640 1 --2- 172.21.15.55:0/215856119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5d00703e0 0x7fc5d009d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d5b48640 1 --2- 172.21.15.55:0/215856119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5d00ca130 0x7fc5d01515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d6b4a640 1 -- 172.21.15.55:0/215856119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5d00703e0 msgr2=0x7fc5d009d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d6b4a640 1 --2- 172.21.15.55:0/215856119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5d00703e0 0x7fc5d009d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d6b4a640 1 -- 172.21.15.55:0/215856119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5d00ca130 msgr2=0x7fc5d01515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d6b4a640 1 --2- 172.21.15.55:0/215856119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5d00ca130 0x7fc5d01515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.686+0000 7fc5d6b4a640 1 -- 172.21.15.55:0/215856119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c000b770 con 0x7fc5d0158850 2023-07-06T22:21:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.690+0000 7fc5d6b4a640 1 --2- 172.21.15.55:0/215856119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5d0158850 0x7fc5d0151b20 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800efc0 tx=0x7fc5c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.690+0000 7fc5c6ffd640 1 -- 172.21.15.55:0/215856119 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8014480 con 0x7fc5d0158850 2023-07-06T22:21:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.690+0000 7fc5c6ffd640 1 -- 172.21.15.55:0/215856119 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c800f040 con 0x7fc5d0158850 2023-07-06T22:21:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.690+0000 7fc5d85ad640 1 -- 172.21.15.55:0/215856119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d009e0d0 con 0x7fc5d0158850 2023-07-06T22:21:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.690+0000 7fc5c6ffd640 1 -- 172.21.15.55:0/215856119 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8014820 con 0x7fc5d0158850 2023-07-06T22:21:01.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.690+0000 7fc5d85ad640 1 -- 172.21.15.55:0/215856119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d009e690 con 0x7fc5d0158850 2023-07-06T22:21:01.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.690+0000 7fc5d85ad640 1 -- 172.21.15.55:0/215856119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d00c5910 con 0x7fc5d0158850 2023-07-06T22:21:01.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.690+0000 7fc5c6ffd640 1 -- 172.21.15.55:0/215856119 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc5c8014980 con 0x7fc5d0158850 2023-07-06T22:21:01.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.690+0000 7fc5c6ffd640 1 --2- 172.21.15.55:0/215856119 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fc5b40663a0 0x7fc5b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:01.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.690+0000 7fc5c6ffd640 1 -- 172.21.15.55:0/215856119 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7fc5c8084bb0 con 0x7fc5d0158850 2023-07-06T22:21:01.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.690+0000 7fc5d6349640 1 --2- 172.21.15.55:0/215856119 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fc5b40663a0 0x7fc5b4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:01.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.694+0000 7fc5d6349640 1 --2- 172.21.15.55:0/215856119 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fc5b40663a0 0x7fc5b4068850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009a40 tx=0x7fc5cc009190 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:01.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.694+0000 7fc5c6ffd640 1 -- 172.21.15.55:0/215856119 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc5d00c5910 con 0x7fc5d0158850 2023-07-06T22:21:01.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.850+0000 7fc5d85ad640 1 -- 172.21.15.55:0/215856119 --> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5d00c9650 con 0x7fc5b40663a0 2023-07-06T22:21:01.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.850+0000 7fc5c6ffd640 1 -- 172.21.15.55:0/215856119 <== mgr.11301 v2:172.21.15.55:6832/3094866364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc5cc011a00 con 0x7fc5b40663a0 2023-07-06T22:21:01.853 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 1 to deep-scrub 2023-07-06T22:21:01.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.850+0000 7fc5d85ad640 1 -- 172.21.15.55:0/215856119 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fc5b40663a0 msgr2=0x7fc5b4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.850+0000 7fc5d85ad640 1 --2- 172.21.15.55:0/215856119 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fc5b40663a0 0x7fc5b4068850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009a40 tx=0x7fc5cc009190 comp rx=0 tx=0).stop 2023-07-06T22:21:01.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.850+0000 7fc5d85ad640 1 -- 172.21.15.55:0/215856119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5d0158850 msgr2=0x7fc5d0151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:01.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.850+0000 7fc5d85ad640 1 --2- 172.21.15.55:0/215856119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5d0158850 0x7fc5d0151b20 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800efc0 tx=0x7fc5c800c490 comp rx=0 tx=0).stop 2023-07-06T22:21:01.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.850+0000 7fc5d85ad640 1 -- 172.21.15.55:0/215856119 shutdown_connections 2023-07-06T22:21:01.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.850+0000 7fc5d85ad640 1 --2- 172.21.15.55:0/215856119 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fc5b40663a0 0x7fc5b4068850 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.850+0000 7fc5d85ad640 1 --2- 172.21.15.55:0/215856119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5d0158850 0x7fc5d0151b20 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.850+0000 7fc5d85ad640 1 --2- 172.21.15.55:0/215856119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5d00ca130 0x7fc5d01515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.850+0000 7fc5d85ad640 1 --2- 172.21.15.55:0/215856119 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc5d00703e0 0x7fc5d009d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:01.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.850+0000 7fc5d85ad640 1 -- 172.21.15.55:0/215856119 >> 172.21.15.55:0/215856119 conn(0x7fc5d00cea70 msgr2=0x7fc5d00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:01.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.850+0000 7fc5d85ad640 1 -- 172.21.15.55:0/215856119 shutdown_connections 2023-07-06T22:21:01.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:01.850+0000 7fc5d85ad640 1 -- 172.21.15.55:0/215856119 wait complete. 2023-07-06T22:21:01.873 INFO:tasks.ceph:Scrubbing osd.2 2023-07-06T22:21:01.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-06T22:21:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74b5e34640 1 Processor -- start 2023-07-06T22:21:02.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74b5e34640 1 -- start start 2023-07-06T22:21:02.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74b5e34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74b00c9b90 0x7f74b015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74b5e34640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f74b00ccb70 0x7f74b00c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74b5e34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b00b3e70 con 0x7f74b0070410 2023-07-06T22:21:02.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74b5e34640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b0159c30 con 0x7f74b00ccb70 2023-07-06T22:21:02.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74b5e34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00c9070 con 0x7f74b00c9b90 2023-07-06T22:21:02.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74affff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f74b0070410 0x7f74b0070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53902/0 (socket says 172.21.15.55:53902) 2023-07-06T22:21:02.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74affff640 1 -- 172.21.15.55:0/1132867027 learned_addr learned my addr 172.21.15.55:0/1132867027 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:21:02.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74aeffd640 1 --2- 172.21.15.55:0/1132867027 >> v2:172.21.15.138:3300/0 conn(0x7f74b00ccb70 0x7f74b00c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74af7fe640 1 --2- 172.21.15.55:0/1132867027 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74b00c9b90 0x7f74b015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74ae7fc640 1 -- 172.21.15.55:0/1132867027 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103457935 0 0) 0x7f74a80014a0 con 0x7f74b0070410 2023-07-06T22:21:02.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74ae7fc640 1 -- 172.21.15.55:0/1132867027 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7498003530 con 0x7f74b0070410 2023-07-06T22:21:02.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74af7fe640 1 -- 172.21.15.55:0/1132867027 >> v2:172.21.15.138:3300/0 conn(0x7f74b00ccb70 msgr2=0x7f74b00c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74af7fe640 1 --2- 172.21.15.55:0/1132867027 >> v2:172.21.15.138:3300/0 conn(0x7f74b00ccb70 0x7f74b00c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74af7fe640 1 -- 172.21.15.55:0/1132867027 >> v1:172.21.15.55:6789/0 conn(0x7f74b0070410 legacy=0x7f74b0070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74af7fe640 1 -- 172.21.15.55:0/1132867027 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b006a400 con 0x7f74b00c9b90 2023-07-06T22:21:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.018+0000 7f74aeffd640 1 --2- 172.21.15.55:0/1132867027 >> v2:172.21.15.138:3300/0 conn(0x7f74b00ccb70 0x7f74b00c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:21:02.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.022+0000 7f74af7fe640 1 --2- 172.21.15.55:0/1132867027 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74b00c9b90 0x7f74b015dd50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f74a00097c0 tx=0x7f74a001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b716464b5277478 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:02.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.022+0000 7f74ae7fc640 1 -- 172.21.15.55:0/1132867027 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a00ad640 con 0x7f74b00c9b90 2023-07-06T22:21:02.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.022+0000 7f74ae7fc640 1 -- 172.21.15.55:0/1132867027 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a00ad7a0 con 0x7f74b00c9b90 2023-07-06T22:21:02.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.022+0000 7f74ae7fc640 1 -- 172.21.15.55:0/1132867027 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a00adb30 con 0x7f74b00c9b90 2023-07-06T22:21:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.022+0000 7f74b5e34640 1 -- 172.21.15.55:0/1132867027 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74b00c9b90 msgr2=0x7f74b015dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.022+0000 7f74b5e34640 1 --2- 172.21.15.55:0/1132867027 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74b00c9b90 0x7f74b015dd50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f74a00097c0 tx=0x7f74a001c480 comp rx=0 tx=0).stop 2023-07-06T22:21:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.022+0000 7f74b5e34640 1 -- 172.21.15.55:0/1132867027 shutdown_connections 2023-07-06T22:21:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.022+0000 7f74b5e34640 1 --2- 172.21.15.55:0/1132867027 >> v2:172.21.15.138:3300/0 conn(0x7f74b00ccb70 0x7f74b00c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.022+0000 7f74b5e34640 1 --2- 172.21.15.55:0/1132867027 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74b00c9b90 0x7f74b015dd50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.022+0000 7f74b5e34640 1 -- 172.21.15.55:0/1132867027 >> 172.21.15.55:0/1132867027 conn(0x7f74b00cde30 msgr2=0x7f74b00ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.022+0000 7f74b5e34640 1 -- 172.21.15.55:0/1132867027 shutdown_connections 2023-07-06T22:21:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.022+0000 7f74b5e34640 1 -- 172.21.15.55:0/1132867027 wait complete. 2023-07-06T22:21:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74b5e34640 1 Processor -- start 2023-07-06T22:21:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74b5e34640 1 -- start start 2023-07-06T22:21:02.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74b5e34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74b0070410 0x7f74b00c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74b5e34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74b00c9b90 0x7f74b01f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74b5e34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74b00ccb70 0x7f74b015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74b5e34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00c4800 con 0x7f74b00c9b90 2023-07-06T22:21:02.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74b5e34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b015c120 con 0x7f74b00ccb70 2023-07-06T22:21:02.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74b5e34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00c4610 con 0x7f74b0070410 2023-07-06T22:21:02.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74aeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74b00c9b90 0x7f74b01f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74aeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74b00c9b90 0x7f74b01f7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44544/0 (socket says 172.21.15.55:44544) 2023-07-06T22:21:02.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74aeffd640 1 -- 172.21.15.55:0/2544465514 learned_addr learned my addr 172.21.15.55:0/2544465514 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:02.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74af7fe640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74b0070410 0x7f74b00c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74affff640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74b00ccb70 0x7f74b015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74aeffd640 1 -- 172.21.15.55:0/2544465514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74b0070410 msgr2=0x7f74b00c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74aeffd640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74b0070410 0x7f74b00c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74aeffd640 1 -- 172.21.15.55:0/2544465514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74b00ccb70 msgr2=0x7f74b015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74aeffd640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74b00ccb70 0x7f74b015c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74aeffd640 1 -- 172.21.15.55:0/2544465514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a4009420 con 0x7f74b00c9b90 2023-07-06T22:21:02.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74affff640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74b00ccb70 0x7f74b015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:21:02.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74aeffd640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74b00c9b90 0x7f74b01f7030 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f74a400ec10 tx=0x7f74a400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:02.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f7497fff640 1 -- 172.21.15.55:0/2544465514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a400cc30 con 0x7f74b00c9b90 2023-07-06T22:21:02.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f7497fff640 1 -- 172.21.15.55:0/2544465514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a400cd90 con 0x7f74b00c9b90 2023-07-06T22:21:02.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f7497fff640 1 -- 172.21.15.55:0/2544465514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4013690 con 0x7f74b00c9b90 2023-07-06T22:21:02.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74b5e34640 1 -- 172.21.15.55:0/2544465514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a0009420 con 0x7f74b00c9b90 2023-07-06T22:21:02.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.026+0000 7f74b5e34640 1 -- 172.21.15.55:0/2544465514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b015b530 con 0x7f74b00c9b90 2023-07-06T22:21:02.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.030+0000 7f74b5e34640 1 -- 172.21.15.55:0/2544465514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74b00c8a20 con 0x7f74b00c9b90 2023-07-06T22:21:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.030+0000 7f7497fff640 1 -- 172.21.15.55:0/2544465514 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f74a40137f0 con 0x7f74b00c9b90 2023-07-06T22:21:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.030+0000 7f7497fff640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f749c0663a0 0x7f749c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.030+0000 7f7497fff640 1 -- 172.21.15.55:0/2544465514 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f74a4084650 con 0x7f74b00c9b90 2023-07-06T22:21:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.030+0000 7f74af7fe640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f749c0663a0 0x7f749c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.030+0000 7f7497fff640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.55:6817/4070957199,v1:172.21.15.55:6819/4070957199] conn(0x7f749c06d2f0 0x7f749c06f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.030+0000 7f7497fff640 1 -- 172.21.15.55:0/2544465514 --> [v2:172.21.15.55:6817/4070957199,v1:172.21.15.55:6819/4070957199] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f749c06fe10 con 0x7f749c06d2f0 2023-07-06T22:21:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.030+0000 7f7497fff640 1 -- 172.21.15.55:0/2544465514 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74a40849c0 con 0x7f74b00c9b90 2023-07-06T22:21:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.030+0000 7f74affff640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.55:6817/4070957199,v1:172.21.15.55:6819/4070957199] conn(0x7f749c06d2f0 0x7f749c06f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.030+0000 7f74af7fe640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f749c0663a0 0x7f749c068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f74a00af000 tx=0x7f74a00a7070 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.030+0000 7f74affff640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.55:6817/4070957199,v1:172.21.15.55:6819/4070957199] conn(0x7f749c06d2f0 0x7f749c06f740 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.034+0000 7f7497fff640 1 -- 172.21.15.55:0/2544465514 <== osd.2 v2:172.21.15.55:6817/4070957199 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f749c06fe10 con 0x7f749c06d2f0 2023-07-06T22:21:02.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.046+0000 7f74b5e34640 1 -- 172.21.15.55:0/2544465514 --> [v2:172.21.15.55:6817/4070957199,v1:172.21.15.55:6819/4070957199] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f74b00c8740 con 0x7f749c06d2f0 2023-07-06T22:21:02.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.046+0000 7f7497fff640 1 -- 172.21.15.55:0/2544465514 <== osd.2 v2:172.21.15.55:6817/4070957199 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f74a80070f0 con 0x7f749c06d2f0 2023-07-06T22:21:02.049 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:21:02.049 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T22:21:02.049 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:21:02.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.046+0000 7f74b5e34640 1 -- 172.21.15.55:0/2544465514 >> [v2:172.21.15.55:6817/4070957199,v1:172.21.15.55:6819/4070957199] conn(0x7f749c06d2f0 msgr2=0x7f749c06f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.046+0000 7f74b5e34640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.55:6817/4070957199,v1:172.21.15.55:6819/4070957199] conn(0x7f749c06d2f0 0x7f749c06f740 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.046+0000 7f74b5e34640 1 -- 172.21.15.55:0/2544465514 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f749c0663a0 msgr2=0x7f749c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.046+0000 7f74b5e34640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f749c0663a0 0x7f749c068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f74a00af000 tx=0x7f74a00a7070 comp rx=0 tx=0).stop 2023-07-06T22:21:02.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.046+0000 7f74b5e34640 1 -- 172.21.15.55:0/2544465514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74b00c9b90 msgr2=0x7f74b01f7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.046+0000 7f74b5e34640 1 --2- 172.21.15.55:0/2544465514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74b00c9b90 0x7f74b01f7030 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f74a400ec10 tx=0x7f74a400c520 comp rx=0 tx=0).stop 2023-07-06T22:21:02.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.046+0000 7f74affff640 1 -- 172.21.15.55:0/2544465514 reap_dead start 2023-07-06T22:21:02.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.046+0000 7f74b5e34640 1 -- 172.21.15.55:0/2544465514 shutdown_connections 2023-07-06T22:21:02.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.046+0000 7f74b5e34640 1 -- 172.21.15.55:0/2544465514 >> 172.21.15.55:0/2544465514 conn(0x7f74b00cde30 msgr2=0x7f74b0159180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:02.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.046+0000 7f74b5e34640 1 -- 172.21.15.55:0/2544465514 shutdown_connections 2023-07-06T22:21:02.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.046+0000 7f74b5e34640 1 -- 172.21.15.55:0/2544465514 wait complete. 2023-07-06T22:21:02.067 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-06T22:21:02.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.206+0000 7f8a2940b640 1 Processor -- start 2023-07-06T22:21:02.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a2940b640 1 -- start start 2023-07-06T22:21:02.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a2940b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8a24158850 0x7f8a240cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a2940b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a24070af0 0x7f8a240ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a2940b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a24158c20 con 0x7f8a240ca130 2023-07-06T22:21:02.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a2940b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a240b2aa0 con 0x7f8a24158850 2023-07-06T22:21:02.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a2940b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a240c8db0 con 0x7f8a24070af0 2023-07-06T22:21:02.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a1bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8a240ca130 0x7f8a240703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53906/0 (socket says 172.21.15.55:53906) 2023-07-06T22:21:02.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a1bfff640 1 -- 172.21.15.55:0/743088713 learned_addr learned my addr 172.21.15.55:0/743088713 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:21:02.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a22ffd640 1 --2- 172.21.15.55:0/743088713 >> v2:172.21.15.138:3300/0 conn(0x7f8a24158850 0x7f8a240cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a237fe640 1 --2- 172.21.15.55:0/743088713 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a24070af0 0x7f8a240ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a227fc640 1 -- 172.21.15.55:0/743088713 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616636007 0 0) 0x7f8a24158c20 con 0x7f8a240ca130 2023-07-06T22:21:02.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a227fc640 1 -- 172.21.15.55:0/743088713 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a10003530 con 0x7f8a240ca130 2023-07-06T22:21:02.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a237fe640 1 -- 172.21.15.55:0/743088713 >> v2:172.21.15.138:3300/0 conn(0x7f8a24158850 msgr2=0x7f8a240cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:02.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a237fe640 1 --2- 172.21.15.55:0/743088713 >> v2:172.21.15.138:3300/0 conn(0x7f8a24158850 0x7f8a240cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a237fe640 1 -- 172.21.15.55:0/743088713 >> v1:172.21.15.55:6789/0 conn(0x7f8a240ca130 legacy=0x7f8a240703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a227fc640 1 -- 172.21.15.55:0/743088713 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3209493823 0 0) 0x7f8a10003530 con 0x7f8a240ca130 2023-07-06T22:21:02.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a237fe640 1 -- 172.21.15.55:0/743088713 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a240c9090 con 0x7f8a24070af0 2023-07-06T22:21:02.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.210+0000 7f8a22ffd640 1 --2- 172.21.15.55:0/743088713 >> v2:172.21.15.138:3300/0 conn(0x7f8a24158850 0x7f8a240cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:21:02.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.214+0000 7f8a237fe640 1 --2- 172.21.15.55:0/743088713 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a24070af0 0x7f8a240ccf70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009d90 tx=0x7f8a1c01f060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5829fb8ef7e1dc8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:02.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.214+0000 7f8a227fc640 1 -- 172.21.15.55:0/743088713 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c001680 con 0x7f8a24070af0 2023-07-06T22:21:02.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.214+0000 7f8a227fc640 1 -- 172.21.15.55:0/743088713 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c0a8bb0 con 0x7f8a24070af0 2023-07-06T22:21:02.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.214+0000 7f8a227fc640 1 -- 172.21.15.55:0/743088713 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0b0440 con 0x7f8a24070af0 2023-07-06T22:21:02.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.214+0000 7f8a2940b640 1 -- 172.21.15.55:0/743088713 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a24070af0 msgr2=0x7f8a240ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.214+0000 7f8a2940b640 1 --2- 172.21.15.55:0/743088713 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a24070af0 0x7f8a240ccf70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009d90 tx=0x7f8a1c01f060 comp rx=0 tx=0).stop 2023-07-06T22:21:02.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.214+0000 7f8a2940b640 1 -- 172.21.15.55:0/743088713 shutdown_connections 2023-07-06T22:21:02.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.214+0000 7f8a2940b640 1 --2- 172.21.15.55:0/743088713 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a24070af0 0x7f8a240ccf70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.214+0000 7f8a2940b640 1 --2- 172.21.15.55:0/743088713 >> v2:172.21.15.138:3300/0 conn(0x7f8a24158850 0x7f8a240cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.214+0000 7f8a2940b640 1 -- 172.21.15.55:0/743088713 >> 172.21.15.55:0/743088713 conn(0x7f8a240cea70 msgr2=0x7f8a240ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.214+0000 7f8a2940b640 1 -- 172.21.15.55:0/743088713 shutdown_connections 2023-07-06T22:21:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.214+0000 7f8a2940b640 1 -- 172.21.15.55:0/743088713 wait complete. 2023-07-06T22:21:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a2940b640 1 Processor -- start 2023-07-06T22:21:02.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a2940b640 1 -- start start 2023-07-06T22:21:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a2940b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24070af0 0x7f8a2406bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a2940b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a240ca130 0x7f8a241f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a2940b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a24158850 0x7f8a241f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a2940b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241f9690 con 0x7f8a24070af0 2023-07-06T22:21:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a2940b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241f2b40 con 0x7f8a24158850 2023-07-06T22:21:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a2940b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241f5b90 con 0x7f8a240ca130 2023-07-06T22:21:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a22ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24070af0 0x7f8a2406bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a22ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24070af0 0x7f8a2406bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44550/0 (socket says 172.21.15.55:44550) 2023-07-06T22:21:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a22ffd640 1 -- 172.21.15.55:0/2397923885 learned_addr learned my addr 172.21.15.55:0/2397923885 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a1bfff640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a240ca130 0x7f8a241f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a237fe640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a24158850 0x7f8a241f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a22ffd640 1 -- 172.21.15.55:0/2397923885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a240ca130 msgr2=0x7f8a241f9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a22ffd640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a240ca130 0x7f8a241f9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a22ffd640 1 -- 172.21.15.55:0/2397923885 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a24158850 msgr2=0x7f8a241f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a22ffd640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a24158850 0x7f8a241f2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a22ffd640 1 -- 172.21.15.55:0/2397923885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1400b6c0 con 0x7f8a24070af0 2023-07-06T22:21:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a237fe640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a24158850 0x7f8a241f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:21:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a22ffd640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24070af0 0x7f8a2406bbd0 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400ed40 tx=0x7f8a1400d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:02.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a1b7fe640 1 -- 172.21.15.55:0/2397923885 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a14010440 con 0x7f8a24070af0 2023-07-06T22:21:02.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a1b7fe640 1 -- 172.21.15.55:0/2397923885 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a140105a0 con 0x7f8a24070af0 2023-07-06T22:21:02.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a2940b640 1 -- 172.21.15.55:0/2397923885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1c009a70 con 0x7f8a24070af0 2023-07-06T22:21:02.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a1b7fe640 1 -- 172.21.15.55:0/2397923885 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a14010910 con 0x7f8a24070af0 2023-07-06T22:21:02.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.218+0000 7f8a2940b640 1 -- 172.21.15.55:0/2397923885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a241f6020 con 0x7f8a24070af0 2023-07-06T22:21:02.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.222+0000 7f8a2940b640 1 -- 172.21.15.55:0/2397923885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a24066d60 con 0x7f8a24070af0 2023-07-06T22:21:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.222+0000 7f8a1b7fe640 1 -- 172.21.15.55:0/2397923885 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8a14010a70 con 0x7f8a24070af0 2023-07-06T22:21:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.222+0000 7f8a1b7fe640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f8a040663a0 0x7f8a04068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.222+0000 7f8a1b7fe640 1 -- 172.21.15.55:0/2397923885 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f8a14084a80 con 0x7f8a24070af0 2023-07-06T22:21:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.222+0000 7f8a1bfff640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f8a040663a0 0x7f8a04068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.222+0000 7f8a1bfff640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f8a040663a0 0x7f8a04068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a2406faa0 tx=0x7f8a0c0016e0 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:02.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.226+0000 7f8a1b7fe640 1 -- 172.21.15.55:0/2397923885 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a14055590 con 0x7f8a24070af0 2023-07-06T22:21:02.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.382+0000 7f8a2940b640 1 -- 172.21.15.55:0/2397923885 --> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a240c9650 con 0x7f8a040663a0 2023-07-06T22:21:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.382+0000 7f8a1b7fe640 1 -- 172.21.15.55:0/2397923885 <== mgr.11301 v2:172.21.15.55:6832/3094866364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8a0c00f9a0 con 0x7f8a040663a0 2023-07-06T22:21:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 2 to deep-scrub 2023-07-06T22:21:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.382+0000 7f8a2940b640 1 -- 172.21.15.55:0/2397923885 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f8a040663a0 msgr2=0x7f8a04068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.382+0000 7f8a2940b640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f8a040663a0 0x7f8a04068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a2406faa0 tx=0x7f8a0c0016e0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.382+0000 7f8a2940b640 1 -- 172.21.15.55:0/2397923885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24070af0 msgr2=0x7f8a2406bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.382+0000 7f8a2940b640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24070af0 0x7f8a2406bbd0 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400ed40 tx=0x7f8a1400d720 comp rx=0 tx=0).stop 2023-07-06T22:21:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.382+0000 7f8a2940b640 1 -- 172.21.15.55:0/2397923885 shutdown_connections 2023-07-06T22:21:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.382+0000 7f8a2940b640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f8a040663a0 0x7f8a04068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.382+0000 7f8a2940b640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a24158850 0x7f8a241f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.382+0000 7f8a2940b640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8a240ca130 0x7f8a241f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.382+0000 7f8a2940b640 1 --2- 172.21.15.55:0/2397923885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a24070af0 0x7f8a2406bbd0 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.382+0000 7f8a2940b640 1 -- 172.21.15.55:0/2397923885 >> 172.21.15.55:0/2397923885 conn(0x7f8a240cea70 msgr2=0x7f8a240b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:02.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.386+0000 7f8a2940b640 1 -- 172.21.15.55:0/2397923885 shutdown_connections 2023-07-06T22:21:02.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.386+0000 7f8a2940b640 1 -- 172.21.15.55:0/2397923885 wait complete. 2023-07-06T22:21:02.407 INFO:tasks.ceph:Scrubbing osd.3 2023-07-06T22:21:02.407 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-06T22:21:02.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.550+0000 7ff450c48640 1 Processor -- start 2023-07-06T22:21:02.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.550+0000 7ff450c48640 1 -- start start 2023-07-06T22:21:02.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.550+0000 7ff450c48640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff44c1601d0 0x7ff44c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.550+0000 7ff450c48640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff44c15f5a0 0x7ff44c15f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.550+0000 7ff450c48640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c069ea0 con 0x7ff44c1560a0 2023-07-06T22:21:02.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.550+0000 7ff450c48640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c15ff00 con 0x7ff44c15f5a0 2023-07-06T22:21:02.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.550+0000 7ff450c48640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c156470 con 0x7ff44c1601d0 2023-07-06T22:21:02.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.554+0000 7ff44a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff44c1560a0 0x7ff44c0cba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53912/0 (socket says 172.21.15.55:53912) 2023-07-06T22:21:02.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.554+0000 7ff44a59c640 1 -- 172.21.15.55:0/2149344661 learned_addr learned my addr 172.21.15.55:0/2149344661 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:21:02.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.554+0000 7ff44ad9d640 1 --2- 172.21.15.55:0/2149344661 >> v2:172.21.15.55:3300/0 conn(0x7ff44c15f5a0 0x7ff44c15f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.554+0000 7ff443fff640 1 --2- 172.21.15.55:0/2149344661 >> v2:172.21.15.138:3300/0 conn(0x7ff44c1601d0 0x7ff44c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.554+0000 7ff44ad9d640 1 -- 172.21.15.55:0/2149344661 >> v2:172.21.15.138:3300/0 conn(0x7ff44c1601d0 msgr2=0x7ff44c06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:02.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.554+0000 7ff44ad9d640 1 --2- 172.21.15.55:0/2149344661 >> v2:172.21.15.138:3300/0 conn(0x7ff44c1601d0 0x7ff44c06a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.554+0000 7ff44ad9d640 1 -- 172.21.15.55:0/2149344661 >> v1:172.21.15.55:6789/0 conn(0x7ff44c1560a0 legacy=0x7ff44c0cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.554+0000 7ff44ad9d640 1 -- 172.21.15.55:0/2149344661 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c0cd800 con 0x7ff44c15f5a0 2023-07-06T22:21:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.554+0000 7ff449d9b640 1 -- 172.21.15.55:0/2149344661 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451919850 0 0) 0x7ff44c069ea0 con 0x7ff44c1560a0 2023-07-06T22:21:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.554+0000 7ff44ad9d640 1 --2- 172.21.15.55:0/2149344661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff44c15f5a0 0x7ff44c15f9c0 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0ac970 tx=0x7ff44401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c672a6508842a0d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:02.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.554+0000 7ff449d9b640 1 -- 172.21.15.55:0/2149344661 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4440a59a0 con 0x7ff44c15f5a0 2023-07-06T22:21:02.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.554+0000 7ff449d9b640 1 -- 172.21.15.55:0/2149344661 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4440a5b00 con 0x7ff44c15f5a0 2023-07-06T22:21:02.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.554+0000 7ff449d9b640 1 -- 172.21.15.55:0/2149344661 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4440a5e90 con 0x7ff44c15f5a0 2023-07-06T22:21:02.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 -- 172.21.15.55:0/2149344661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff44c15f5a0 msgr2=0x7ff44c15f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 --2- 172.21.15.55:0/2149344661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff44c15f5a0 0x7ff44c15f9c0 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0ac970 tx=0x7ff44401c8e0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 -- 172.21.15.55:0/2149344661 shutdown_connections 2023-07-06T22:21:02.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 --2- 172.21.15.55:0/2149344661 >> v2:172.21.15.138:3300/0 conn(0x7ff44c1601d0 0x7ff44c06a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 --2- 172.21.15.55:0/2149344661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff44c15f5a0 0x7ff44c15f9c0 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 -- 172.21.15.55:0/2149344661 >> 172.21.15.55:0/2149344661 conn(0x7ff44c0cde30 msgr2=0x7ff44c0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:02.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 -- 172.21.15.55:0/2149344661 shutdown_connections 2023-07-06T22:21:02.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 -- 172.21.15.55:0/2149344661 wait complete. 2023-07-06T22:21:02.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 Processor -- start 2023-07-06T22:21:02.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 -- start start 2023-07-06T22:21:02.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff44c1560a0 0x7ff44c06ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff44c15f5a0 0x7ff44c1f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff44c1f7d70 0x7ff44c14b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c14cad0 con 0x7ff44c1560a0 2023-07-06T22:21:02.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c14e960 con 0x7ff44c15f5a0 2023-07-06T22:21:02.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff450c48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c14c230 con 0x7ff44c1f7d70 2023-07-06T22:21:02.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff44a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff44c1560a0 0x7ff44c06ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff44a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff44c1560a0 0x7ff44c06ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44560/0 (socket says 172.21.15.55:44560) 2023-07-06T22:21:02.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff44a59c640 1 -- 172.21.15.55:0/3279263902 learned_addr learned my addr 172.21.15.55:0/3279263902 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:02.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff443fff640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff44c15f5a0 0x7ff44c1f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff44ad9d640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff44c1f7d70 0x7ff44c14b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff44a59c640 1 -- 172.21.15.55:0/3279263902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff44c1f7d70 msgr2=0x7ff44c14b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff44a59c640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff44c1f7d70 0x7ff44c14b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff44a59c640 1 -- 172.21.15.55:0/3279263902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff44c15f5a0 msgr2=0x7ff44c1f7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.558+0000 7ff44a59c640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff44c15f5a0 0x7ff44c1f7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.562+0000 7ff44a59c640 1 -- 172.21.15.55:0/3279263902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff444009a70 con 0x7ff44c1560a0 2023-07-06T22:21:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.562+0000 7ff443fff640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff44c15f5a0 0x7ff44c1f7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:21:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.562+0000 7ff44ad9d640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff44c1f7d70 0x7ff44c14b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:21:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.562+0000 7ff44a59c640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff44c1560a0 0x7ff44c06ef10 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00c480 tx=0x7ff43c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.562+0000 7ff442ffd640 1 -- 172.21.15.55:0/3279263902 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0074e0 con 0x7ff44c1560a0 2023-07-06T22:21:02.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.562+0000 7ff442ffd640 1 -- 172.21.15.55:0/3279263902 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c007660 con 0x7ff44c1560a0 2023-07-06T22:21:02.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.562+0000 7ff442ffd640 1 -- 172.21.15.55:0/3279263902 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c004a30 con 0x7ff44c1560a0 2023-07-06T22:21:02.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.562+0000 7ff450c48640 1 -- 172.21.15.55:0/3279263902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44c14c510 con 0x7ff44c1560a0 2023-07-06T22:21:02.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.562+0000 7ff450c48640 1 -- 172.21.15.55:0/3279263902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c1f7380 con 0x7ff44c1560a0 2023-07-06T22:21:02.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.562+0000 7ff450c48640 1 -- 172.21.15.55:0/3279263902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff44c0cdae0 con 0x7ff44c1560a0 2023-07-06T22:21:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.562+0000 7ff442ffd640 1 -- 172.21.15.55:0/3279263902 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff43c004b90 con 0x7ff44c1560a0 2023-07-06T22:21:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.562+0000 7ff442ffd640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff42c0663a0 0x7ff42c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.562+0000 7ff442ffd640 1 -- 172.21.15.55:0/3279263902 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7ff43c0831d0 con 0x7ff44c1560a0 2023-07-06T22:21:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.566+0000 7ff443fff640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff42c0663a0 0x7ff42c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.566+0000 7ff442ffd640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.55:6808/2677129803,v1:172.21.15.55:6809/2677129803] conn(0x7ff42c06d2f0 0x7ff42c06f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.566+0000 7ff442ffd640 1 -- 172.21.15.55:0/3279263902 --> [v2:172.21.15.55:6808/2677129803,v1:172.21.15.55:6809/2677129803] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff42c06fe10 con 0x7ff42c06d2f0 2023-07-06T22:21:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.566+0000 7ff442ffd640 1 -- 172.21.15.55:0/3279263902 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff43c0857b0 con 0x7ff44c1560a0 2023-07-06T22:21:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.566+0000 7ff44ad9d640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.55:6808/2677129803,v1:172.21.15.55:6809/2677129803] conn(0x7ff42c06d2f0 0x7ff42c06f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.566+0000 7ff443fff640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff42c0663a0 0x7ff42c068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0ae320 tx=0x7ff434008040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.566+0000 7ff44ad9d640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.55:6808/2677129803,v1:172.21.15.55:6809/2677129803] conn(0x7ff42c06d2f0 0x7ff42c06f740 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:02.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.566+0000 7ff442ffd640 1 -- 172.21.15.55:0/3279263902 <== osd.3 v2:172.21.15.55:6808/2677129803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff42c06fe10 con 0x7ff42c06d2f0 2023-07-06T22:21:02.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.578+0000 7ff450c48640 1 -- 172.21.15.55:0/3279263902 --> [v2:172.21.15.55:6808/2677129803,v1:172.21.15.55:6809/2677129803] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff44c14eaa0 con 0x7ff42c06d2f0 2023-07-06T22:21:02.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.578+0000 7ff442ffd640 1 -- 172.21.15.55:0/3279263902 <== osd.3 v2:172.21.15.55:6808/2677129803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff4440ad4c0 con 0x7ff42c06d2f0 2023-07-06T22:21:02.582 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:21:02.582 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T22:21:02.582 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:21:02.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.578+0000 7ff450c48640 1 -- 172.21.15.55:0/3279263902 >> [v2:172.21.15.55:6808/2677129803,v1:172.21.15.55:6809/2677129803] conn(0x7ff42c06d2f0 msgr2=0x7ff42c06f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.578+0000 7ff450c48640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.55:6808/2677129803,v1:172.21.15.55:6809/2677129803] conn(0x7ff42c06d2f0 0x7ff42c06f740 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.578+0000 7ff450c48640 1 -- 172.21.15.55:0/3279263902 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff42c0663a0 msgr2=0x7ff42c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.578+0000 7ff450c48640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7ff42c0663a0 0x7ff42c068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0ae320 tx=0x7ff434008040 comp rx=0 tx=0).stop 2023-07-06T22:21:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.578+0000 7ff450c48640 1 -- 172.21.15.55:0/3279263902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff44c1560a0 msgr2=0x7ff44c06ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.578+0000 7ff450c48640 1 --2- 172.21.15.55:0/3279263902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff44c1560a0 0x7ff44c06ef10 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00c480 tx=0x7ff43c00c940 comp rx=0 tx=0).stop 2023-07-06T22:21:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.578+0000 7ff44ad9d640 1 -- 172.21.15.55:0/3279263902 reap_dead start 2023-07-06T22:21:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.578+0000 7ff450c48640 1 -- 172.21.15.55:0/3279263902 shutdown_connections 2023-07-06T22:21:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.578+0000 7ff450c48640 1 -- 172.21.15.55:0/3279263902 >> 172.21.15.55:0/3279263902 conn(0x7ff44c0cde30 msgr2=0x7ff44c15c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.578+0000 7ff450c48640 1 -- 172.21.15.55:0/3279263902 shutdown_connections 2023-07-06T22:21:02.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.578+0000 7ff450c48640 1 -- 172.21.15.55:0/3279263902 wait complete. 2023-07-06T22:21:02.600 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-06T22:21:02.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b215c5640 1 Processor -- start 2023-07-06T22:21:02.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b215c5640 1 -- start start 2023-07-06T22:21:02.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b215c5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b1c06f0e0 0x7f3b1c0ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b215c5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3b1c0cb7a0 0x7f3b1c0cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b215c5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1c15f5d0 con 0x7f3b1c156180 2023-07-06T22:21:02.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b215c5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1c160250 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b215c5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1c15f8b0 con 0x7f3b1c0cb7a0 2023-07-06T22:21:02.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b13fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b1c06f0e0 0x7f3b1c0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b13fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b1c06f0e0 0x7f3b1c0ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44572/0 (socket says 172.21.15.55:44572) 2023-07-06T22:21:02.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b13fff640 1 -- 172.21.15.55:0/200030495 learned_addr learned my addr 172.21.15.55:0/200030495 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:02.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b1b7fe640 1 --2- 172.21.15.55:0/200030495 >> v2:172.21.15.138:3300/0 conn(0x7f3b1c0cb7a0 0x7f3b1c0cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b13fff640 1 -- 172.21.15.55:0/200030495 >> v2:172.21.15.138:3300/0 conn(0x7f3b1c0cb7a0 msgr2=0x7f3b1c0cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:02.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b13fff640 1 --2- 172.21.15.55:0/200030495 >> v2:172.21.15.138:3300/0 conn(0x7f3b1c0cb7a0 0x7f3b1c0cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b13fff640 1 -- 172.21.15.55:0/200030495 >> v1:172.21.15.138:6789/0 conn(0x7f3b1c156180 legacy=0x7f3b1c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:02.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b13fff640 1 -- 172.21.15.55:0/200030495 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c15fb90 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.742+0000 7f3b1b7fe640 1 --2- 172.21.15.55:0/200030495 >> v2:172.21.15.138:3300/0 conn(0x7f3b1c0cb7a0 0x7f3b1c0cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:21:02.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.746+0000 7f3b13fff640 1 --2- 172.21.15.55:0/200030495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c06f0e0 0x7f3b1c0ca610 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0af9d0 tx=0x7f3b0401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d91659c731909d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:02.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.746+0000 7f3b1a7fc640 1 -- 172.21.15.55:0/200030495 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b040ab620 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.746+0000 7f3b1a7fc640 1 -- 172.21.15.55:0/200030495 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b040ab780 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.746+0000 7f3b1a7fc640 1 -- 172.21.15.55:0/200030495 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b040abb10 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.746+0000 7f3b215c5640 1 -- 172.21.15.55:0/200030495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c06f0e0 msgr2=0x7f3b1c0ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.746+0000 7f3b215c5640 1 --2- 172.21.15.55:0/200030495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c06f0e0 0x7f3b1c0ca610 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0af9d0 tx=0x7f3b0401c400 comp rx=0 tx=0).stop 2023-07-06T22:21:02.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.746+0000 7f3b215c5640 1 -- 172.21.15.55:0/200030495 shutdown_connections 2023-07-06T22:21:02.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.746+0000 7f3b215c5640 1 --2- 172.21.15.55:0/200030495 >> v2:172.21.15.138:3300/0 conn(0x7f3b1c0cb7a0 0x7f3b1c0cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.746+0000 7f3b215c5640 1 --2- 172.21.15.55:0/200030495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c06f0e0 0x7f3b1c0ca610 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.746+0000 7f3b215c5640 1 -- 172.21.15.55:0/200030495 >> 172.21.15.55:0/200030495 conn(0x7f3b1c0d0c50 msgr2=0x7f3b1c0cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:02.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.746+0000 7f3b215c5640 1 -- 172.21.15.55:0/200030495 shutdown_connections 2023-07-06T22:21:02.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.746+0000 7f3b215c5640 1 -- 172.21.15.55:0/200030495 wait complete. 2023-07-06T22:21:02.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b215c5640 1 Processor -- start 2023-07-06T22:21:02.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b215c5640 1 -- start start 2023-07-06T22:21:02.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b215c5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c06f0e0 0x7f3b1c14d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b215c5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b1c0cb7a0 0x7f3b1c0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b215c5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b1c156180 0x7f3b1c14aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b215c5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c0b1630 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b215c5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c14dac0 con 0x7f3b1c156180 2023-07-06T22:21:02.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b215c5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c0b2960 con 0x7f3b1c0cb7a0 2023-07-06T22:21:02.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b1affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c06f0e0 0x7f3b1c14d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b1affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c06f0e0 0x7f3b1c14d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44582/0 (socket says 172.21.15.55:44582) 2023-07-06T22:21:02.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b1affd640 1 -- 172.21.15.55:0/551664232 learned_addr learned my addr 172.21.15.55:0/551664232 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:02.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b13fff640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b1c0cb7a0 0x7f3b1c0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b1b7fe640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b1c156180 0x7f3b1c14aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b1affd640 1 -- 172.21.15.55:0/551664232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b1c0cb7a0 msgr2=0x7f3b1c0b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b1affd640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b1c0cb7a0 0x7f3b1c0b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b1affd640 1 -- 172.21.15.55:0/551664232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b1c156180 msgr2=0x7f3b1c14aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b1affd640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b1c156180 0x7f3b1c14aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b1affd640 1 -- 172.21.15.55:0/551664232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b040094d0 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b13fff640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b1c0cb7a0 0x7f3b1c0b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:21:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b1b7fe640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b1c156180 0x7f3b1c14aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:21:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b1affd640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c06f0e0 0x7f3b1c14d3c0 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00b410 tx=0x7f3b0c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b137fe640 1 -- 172.21.15.55:0/551664232 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c004020 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b137fe640 1 -- 172.21.15.55:0/551664232 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c004180 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b137fe640 1 -- 172.21.15.55:0/551664232 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c011630 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b215c5640 1 -- 172.21.15.55:0/551664232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1c143dd0 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b215c5640 1 -- 172.21.15.55:0/551664232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1c0b1af0 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.750+0000 7f3b215c5640 1 -- 172.21.15.55:0/551664232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1c066d60 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.754+0000 7f3b137fe640 1 -- 172.21.15.55:0/551664232 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3b0c011790 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.754+0000 7f3b137fe640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f3afc0663a0 0x7f3afc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:02.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.754+0000 7f3b137fe640 1 -- 172.21.15.55:0/551664232 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f3b0c083dc0 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.754+0000 7f3b13fff640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f3afc0663a0 0x7f3afc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:02.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.754+0000 7f3b13fff640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f3afc0663a0 0x7f3afc068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3b040af000 tx=0x7f3b04008040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:02.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.758+0000 7f3b137fe640 1 -- 172.21.15.55:0/551664232 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b0c050f50 con 0x7f3b1c06f0e0 2023-07-06T22:21:02.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.910+0000 7f3b215c5640 1 -- 172.21.15.55:0/551664232 --> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b1c0cd930 con 0x7f3afc0663a0 2023-07-06T22:21:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.910+0000 7f3b137fe640 1 -- 172.21.15.55:0/551664232 <== mgr.11301 v2:172.21.15.55:6832/3094866364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3b1c0cd930 con 0x7f3afc0663a0 2023-07-06T22:21:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 3 to deep-scrub 2023-07-06T22:21:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.914+0000 7f3b215c5640 1 -- 172.21.15.55:0/551664232 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f3afc0663a0 msgr2=0x7f3afc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.914+0000 7f3b215c5640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f3afc0663a0 0x7f3afc068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3b040af000 tx=0x7f3b04008040 comp rx=0 tx=0).stop 2023-07-06T22:21:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.914+0000 7f3b215c5640 1 -- 172.21.15.55:0/551664232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c06f0e0 msgr2=0x7f3b1c14d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.914+0000 7f3b215c5640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c06f0e0 0x7f3b1c14d3c0 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00b410 tx=0x7f3b0c00b8d0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.914+0000 7f3b215c5640 1 -- 172.21.15.55:0/551664232 shutdown_connections 2023-07-06T22:21:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.914+0000 7f3b215c5640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f3afc0663a0 0x7f3afc068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.914+0000 7f3b215c5640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b1c156180 0x7f3b1c14aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.914+0000 7f3b215c5640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b1c0cb7a0 0x7f3b1c0b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.914+0000 7f3b215c5640 1 --2- 172.21.15.55:0/551664232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b1c06f0e0 0x7f3b1c14d3c0 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:02.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.914+0000 7f3b215c5640 1 -- 172.21.15.55:0/551664232 >> 172.21.15.55:0/551664232 conn(0x7f3b1c0d0c50 msgr2=0x7f3b1c15ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:02.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.914+0000 7f3b215c5640 1 -- 172.21.15.55:0/551664232 shutdown_connections 2023-07-06T22:21:02.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:02.914+0000 7f3b215c5640 1 -- 172.21.15.55:0/551664232 wait complete. 2023-07-06T22:21:02.934 INFO:tasks.ceph:Scrubbing osd.4 2023-07-06T22:21:02.935 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-06T22:21:03.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565fe48640 1 Processor -- start 2023-07-06T22:21:03.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565fe48640 1 -- start start 2023-07-06T22:21:03.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565fe48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56580b4010 0x7f565806a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565fe48640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5658070bb0 con 0x7f5658070070 2023-07-06T22:21:03.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565fe48640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565806acc0 con 0x7f56581598e0 2023-07-06T22:21:03.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565fe48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56580b4800 con 0x7f56580b4010 2023-07-06T22:21:03.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565d3e3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5658070070 0x7f56580cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53926/0 (socket says 172.21.15.55:53926) 2023-07-06T22:21:03.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565d3e3640 1 -- 172.21.15.55:0/1321650248 learned_addr learned my addr 172.21.15.55:0/1321650248 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:21:03.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565e3e5640 1 --2- 172.21.15.55:0/1321650248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56580b4010 0x7f565806a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565cbe2640 1 -- 172.21.15.55:0/1321650248 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401249979 0 0) 0x7f5658070bb0 con 0x7f5658070070 2023-07-06T22:21:03.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565cbe2640 1 -- 172.21.15.55:0/1321650248 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5644003530 con 0x7f5658070070 2023-07-06T22:21:03.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565cbe2640 1 -- 172.21.15.55:0/1321650248 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305593551 0 0) 0x7f565806acc0 con 0x7f56581598e0 2023-07-06T22:21:03.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565cbe2640 1 -- 172.21.15.55:0/1321650248 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5658070bb0 con 0x7f56581598e0 2023-07-06T22:21:03.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565e3e5640 1 -- 172.21.15.55:0/1321650248 >> v1:172.21.15.138:6789/0 conn(0x7f56581598e0 legacy=0x7f565806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565cbe2640 1 -- 172.21.15.55:0/1321650248 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4040926774 0 0) 0x7f5644003530 con 0x7f5658070070 2023-07-06T22:21:03.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565e3e5640 1 -- 172.21.15.55:0/1321650248 >> v1:172.21.15.55:6789/0 conn(0x7f5658070070 legacy=0x7f56580cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.078+0000 7f565e3e5640 1 -- 172.21.15.55:0/1321650248 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56580ca2a0 con 0x7f56580b4010 2023-07-06T22:21:03.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.082+0000 7f565e3e5640 1 --2- 172.21.15.55:0/1321650248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56580b4010 0x7f565806a780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5650009dc0 tx=0x7f565001c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2f2f4fc2d9b1d4d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:03.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.082+0000 7f565cbe2640 1 -- 172.21.15.55:0/1321650248 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648001680 con 0x7f56580b4010 2023-07-06T22:21:03.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.082+0000 7f565cbe2640 1 -- 172.21.15.55:0/1321650248 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56500a5680 con 0x7f56580b4010 2023-07-06T22:21:03.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.082+0000 7f565cbe2640 1 -- 172.21.15.55:0/1321650248 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500a5a10 con 0x7f56580b4010 2023-07-06T22:21:03.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.082+0000 7f565fe48640 1 -- 172.21.15.55:0/1321650248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56580b4010 msgr2=0x7f565806a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.082+0000 7f565fe48640 1 --2- 172.21.15.55:0/1321650248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56580b4010 0x7f565806a780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5650009dc0 tx=0x7f565001c860 comp rx=0 tx=0).stop 2023-07-06T22:21:03.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.082+0000 7f565fe48640 1 -- 172.21.15.55:0/1321650248 shutdown_connections 2023-07-06T22:21:03.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.082+0000 7f565fe48640 1 --2- 172.21.15.55:0/1321650248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56580b4010 0x7f565806a780 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.082+0000 7f565fe48640 1 -- 172.21.15.55:0/1321650248 >> 172.21.15.55:0/1321650248 conn(0x7f56580ce7f0 msgr2=0x7f56580cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:03.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.082+0000 7f565fe48640 1 -- 172.21.15.55:0/1321650248 shutdown_connections 2023-07-06T22:21:03.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.082+0000 7f565fe48640 1 -- 172.21.15.55:0/1321650248 wait complete. 2023-07-06T22:21:03.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565fe48640 1 Processor -- start 2023-07-06T22:21:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565fe48640 1 -- start start 2023-07-06T22:21:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565fe48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5658070070 0x7f56580af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565fe48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56580b4010 0x7f56580c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565fe48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56581598e0 0x7f56580b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565fe48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56580b3aa0 con 0x7f5658070070 2023-07-06T22:21:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565fe48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56580c7e80 con 0x7f56580b4010 2023-07-06T22:21:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565fe48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56580b3170 con 0x7f56581598e0 2023-07-06T22:21:03.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565dbe4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5658070070 0x7f56580af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565dbe4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5658070070 0x7f56580af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44588/0 (socket says 172.21.15.55:44588) 2023-07-06T22:21:03.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565dbe4640 1 -- 172.21.15.55:0/4060271083 learned_addr learned my addr 172.21.15.55:0/4060271083 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565e3e5640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56581598e0 0x7f56580b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565d3e3640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56580b4010 0x7f56580c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565dbe4640 1 -- 172.21.15.55:0/4060271083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56581598e0 msgr2=0x7f56580b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565dbe4640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56581598e0 0x7f56580b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565dbe4640 1 -- 172.21.15.55:0/4060271083 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56580b4010 msgr2=0x7f56580c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565dbe4640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56580b4010 0x7f56580c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565dbe4640 1 -- 172.21.15.55:0/4060271083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5650009a70 con 0x7f5658070070 2023-07-06T22:21:03.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565d3e3640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56580b4010 0x7f56580c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:21:03.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565dbe4640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5658070070 0x7f56580af510 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f565400c420 tx=0x7f565400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:03.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f564e7fc640 1 -- 172.21.15.55:0/4060271083 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56540052d0 con 0x7f5658070070 2023-07-06T22:21:03.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f564e7fc640 1 -- 172.21.15.55:0/4060271083 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5654005430 con 0x7f5658070070 2023-07-06T22:21:03.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f564e7fc640 1 -- 172.21.15.55:0/4060271083 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654003870 con 0x7f5658070070 2023-07-06T22:21:03.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565fe48640 1 -- 172.21.15.55:0/4060271083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56580b3450 con 0x7f5658070070 2023-07-06T22:21:03.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.086+0000 7f565fe48640 1 -- 172.21.15.55:0/4060271083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5658154720 con 0x7f5658070070 2023-07-06T22:21:03.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.090+0000 7f565fe48640 1 -- 172.21.15.55:0/4060271083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56580caae0 con 0x7f5658070070 2023-07-06T22:21:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.090+0000 7f564e7fc640 1 -- 172.21.15.55:0/4060271083 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f56540039d0 con 0x7f5658070070 2023-07-06T22:21:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.090+0000 7f564e7fc640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f563c0663a0 0x7f563c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.090+0000 7f564e7fc640 1 -- 172.21.15.55:0/4060271083 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f5654083670 con 0x7f5658070070 2023-07-06T22:21:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.090+0000 7f565d3e3640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f563c0663a0 0x7f563c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.090+0000 7f564e7fc640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.138:6824/851191383,v1:172.21.15.138:6825/851191383] conn(0x7f563c06d2f0 0x7f563c06f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.090+0000 7f564e7fc640 1 -- 172.21.15.55:0/4060271083 --> [v2:172.21.15.138:6824/851191383,v1:172.21.15.138:6825/851191383] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f563c06fe10 con 0x7f563c06d2f0 2023-07-06T22:21:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.090+0000 7f564e7fc640 1 -- 172.21.15.55:0/4060271083 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5654085c50 con 0x7f5658070070 2023-07-06T22:21:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.090+0000 7f565d3e3640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f563c0663a0 0x7f563c068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5648001350 tx=0x7f5648009040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.090+0000 7f565e3e5640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.138:6824/851191383,v1:172.21.15.138:6825/851191383] conn(0x7f563c06d2f0 0x7f563c06f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.090+0000 7f565e3e5640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.138:6824/851191383,v1:172.21.15.138:6825/851191383] conn(0x7f563c06d2f0 0x7f563c06f740 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.094+0000 7f564e7fc640 1 -- 172.21.15.55:0/4060271083 <== osd.4 v2:172.21.15.138:6824/851191383 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f563c06fe10 con 0x7f563c06d2f0 2023-07-06T22:21:03.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.106+0000 7f565fe48640 1 -- 172.21.15.55:0/4060271083 --> [v2:172.21.15.138:6824/851191383,v1:172.21.15.138:6825/851191383] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f56580ca840 con 0x7f563c06d2f0 2023-07-06T22:21:03.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.106+0000 7f564e7fc640 1 -- 172.21.15.55:0/4060271083 <== osd.4 v2:172.21.15.138:6824/851191383 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5650009450 con 0x7f563c06d2f0 2023-07-06T22:21:03.110 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:21:03.110 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T22:21:03.110 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:21:03.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.106+0000 7f565fe48640 1 -- 172.21.15.55:0/4060271083 >> [v2:172.21.15.138:6824/851191383,v1:172.21.15.138:6825/851191383] conn(0x7f563c06d2f0 msgr2=0x7f563c06f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.106+0000 7f565fe48640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.138:6824/851191383,v1:172.21.15.138:6825/851191383] conn(0x7f563c06d2f0 0x7f563c06f740 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.106+0000 7f565fe48640 1 -- 172.21.15.55:0/4060271083 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f563c0663a0 msgr2=0x7f563c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.106+0000 7f565fe48640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f563c0663a0 0x7f563c068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5648001350 tx=0x7f5648009040 comp rx=0 tx=0).stop 2023-07-06T22:21:03.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.106+0000 7f565fe48640 1 -- 172.21.15.55:0/4060271083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5658070070 msgr2=0x7f56580af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.106+0000 7f565fe48640 1 --2- 172.21.15.55:0/4060271083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5658070070 0x7f56580af510 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f565400c420 tx=0x7f565400c8e0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.106+0000 7f565e3e5640 1 -- 172.21.15.55:0/4060271083 reap_dead start 2023-07-06T22:21:03.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.106+0000 7f565fe48640 1 -- 172.21.15.55:0/4060271083 shutdown_connections 2023-07-06T22:21:03.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.106+0000 7f565fe48640 1 -- 172.21.15.55:0/4060271083 >> 172.21.15.55:0/4060271083 conn(0x7f56580ce7f0 msgr2=0x7f56580ab870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:03.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.106+0000 7f565fe48640 1 -- 172.21.15.55:0/4060271083 shutdown_connections 2023-07-06T22:21:03.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.106+0000 7f565fe48640 1 -- 172.21.15.55:0/4060271083 wait complete. 2023-07-06T22:21:03.128 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-06T22:21:03.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.270+0000 7f799ad94640 1 Processor -- start 2023-07-06T22:21:03.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.270+0000 7f799ad94640 1 -- start start 2023-07-06T22:21:03.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f799ad94640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f79940d0630 0x7f799415fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f799ad94640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79940cc740 con 0x7f79940b1250 2023-07-06T22:21:03.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f799ad94640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79940ccc90 con 0x7f79940ce200 2023-07-06T22:21:03.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f799ad94640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79940b29c0 con 0x7f79940d0630 2023-07-06T22:21:03.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7999d92640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f79940b1250 0x7f799415f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40662/0 (socket says 172.21.15.55:40662) 2023-07-06T22:21:03.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7999d92640 1 -- 172.21.15.55:0/3009993621 learned_addr learned my addr 172.21.15.55:0/3009993621 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:21:03.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 -- 172.21.15.55:0/3009993621 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994514088 0 0) 0x7f79940cc740 con 0x7f79940b1250 2023-07-06T22:21:03.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7999591640 1 --2- 172.21.15.55:0/3009993621 >> v2:172.21.15.138:3300/0 conn(0x7f79940d0630 0x7f799415fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 -- 172.21.15.55:0/3009993621 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7980003530 con 0x7f79940b1250 2023-07-06T22:21:03.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 -- 172.21.15.55:0/3009993621 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3805768010 0 0) 0x7f7980003530 con 0x7f79940b1250 2023-07-06T22:21:03.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 -- 172.21.15.55:0/3009993621 >> v2:172.21.15.138:3300/0 conn(0x7f79940d0630 msgr2=0x7f799415fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:03.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 --2- 172.21.15.55:0/3009993621 >> v2:172.21.15.138:3300/0 conn(0x7f79940d0630 0x7f799415fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 -- 172.21.15.55:0/3009993621 >> v1:172.21.15.138:6789/0 conn(0x7f79940ce200 legacy=0x7f79940ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 -- 172.21.15.55:0/3009993621 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79940d1d10 con 0x7f79940b1250 2023-07-06T22:21:03.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 -- 172.21.15.55:0/3009993621 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f7990001680 con 0x7f79940b1250 2023-07-06T22:21:03.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 -- 172.21.15.55:0/3009993621 >> v1:172.21.15.55:6789/0 conn(0x7f79940b1250 legacy=0x7f799415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 --2- 172.21.15.55:0/3009993621 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7980003980 0x7f7980003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 --2- 172.21.15.55:0/3009993621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79800047d0 0x7f7980004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 --2- 172.21.15.55:0/3009993621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7980005180 0x7f798000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 -- 172.21.15.55:0/3009993621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79940b29c0 con 0x7f7980005180 2023-07-06T22:21:03.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 -- 172.21.15.55:0/3009993621 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798000c000 con 0x7f79800047d0 2023-07-06T22:21:03.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7998d90640 1 -- 172.21.15.55:0/3009993621 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798000c1c0 con 0x7f7980003980 2023-07-06T22:21:03.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f799a593640 1 --2- 172.21.15.55:0/3009993621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7980005180 0x7f798000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7999d92640 1 --2- 172.21.15.55:0/3009993621 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7980003980 0x7f7980003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f7999591640 1 --2- 172.21.15.55:0/3009993621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79800047d0 0x7f7980004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f799a593640 1 -- 172.21.15.55:0/3009993621 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7980003980 msgr2=0x7f7980003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:03.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f799a593640 1 --2- 172.21.15.55:0/3009993621 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7980003980 0x7f7980003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f799a593640 1 -- 172.21.15.55:0/3009993621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79800047d0 msgr2=0x7f7980004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:03.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f799a593640 1 --2- 172.21.15.55:0/3009993621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79800047d0 0x7f7980004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.274+0000 7f799a593640 1 -- 172.21.15.55:0/3009993621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7980003530 con 0x7f7980005180 2023-07-06T22:21:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.278+0000 7f799a593640 1 -- 172.21.15.55:0/3009993621 reap_dead start 2023-07-06T22:21:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.278+0000 7f799a593640 1 --2- 172.21.15.55:0/3009993621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7980005180 0x7f798000b990 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f798c001e70 tx=0x7f798c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32133a6450aed28 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.278+0000 7f7998d90640 1 -- 172.21.15.55:0/3009993621 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c003b80 con 0x7f7980005180 2023-07-06T22:21:03.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.278+0000 7f7998d90640 1 -- 172.21.15.55:0/3009993621 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c003d20 con 0x7f7980005180 2023-07-06T22:21:03.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.278+0000 7f7998d90640 1 -- 172.21.15.55:0/3009993621 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c005260 con 0x7f7980005180 2023-07-06T22:21:03.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.278+0000 7f799ad94640 1 -- 172.21.15.55:0/3009993621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7980005180 msgr2=0x7f798000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.278+0000 7f799ad94640 1 --2- 172.21.15.55:0/3009993621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7980005180 0x7f798000b990 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f798c001e70 tx=0x7f798c01c760 comp rx=0 tx=0).stop 2023-07-06T22:21:03.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.278+0000 7f799ad94640 1 -- 172.21.15.55:0/3009993621 shutdown_connections 2023-07-06T22:21:03.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.278+0000 7f799ad94640 1 --2- 172.21.15.55:0/3009993621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7980005180 0x7f798000b990 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.278+0000 7f799ad94640 1 -- 172.21.15.55:0/3009993621 >> 172.21.15.55:0/3009993621 conn(0x7f79940b3b60 msgr2=0x7f79940b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:03.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.278+0000 7f799ad94640 1 -- 172.21.15.55:0/3009993621 shutdown_connections 2023-07-06T22:21:03.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.278+0000 7f799ad94640 1 -- 172.21.15.55:0/3009993621 wait complete. 2023-07-06T22:21:03.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.278+0000 7f799ad94640 1 Processor -- start 2023-07-06T22:21:03.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.278+0000 7f799ad94640 1 -- start start 2023-07-06T22:21:03.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f799ad94640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7980005180 0x7f79940c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f799ad94640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79940c6ad0 0x7f79940ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f799ad94640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79940ca700 0x7f7994156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f799ad94640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79940c9120 con 0x7f7980005180 2023-07-06T22:21:03.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f799ad94640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79940c9400 con 0x7f79940c6ad0 2023-07-06T22:21:03.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f799ad94640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79940c96e0 con 0x7f79940ca700 2023-07-06T22:21:03.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f7999d92640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7980005180 0x7f79940c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f7999d92640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7980005180 0x7f79940c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32878/0 (socket says 172.21.15.55:32878) 2023-07-06T22:21:03.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f7999d92640 1 -- 172.21.15.55:0/3499712398 learned_addr learned my addr 172.21.15.55:0/3499712398 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:03.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f799a593640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79940ca700 0x7f7994156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f7999d92640 1 -- 172.21.15.55:0/3499712398 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79940ca700 msgr2=0x7f7994156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f7999591640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79940c6ad0 0x7f79940ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f7999d92640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79940ca700 0x7f7994156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f7999d92640 1 -- 172.21.15.55:0/3499712398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79940c6ad0 msgr2=0x7f79940ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f7999d92640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79940c6ad0 0x7f79940ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f7999d92640 1 -- 172.21.15.55:0/3499712398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79940c99c0 con 0x7f7980005180 2023-07-06T22:21:03.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f7999591640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79940c6ad0 0x7f79940ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:21:03.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f7999d92640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7980005180 0x7f79940c6590 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f7990007290 tx=0x7f7990007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:03.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f798a7fc640 1 -- 172.21.15.55:0/3499712398 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799000f940 con 0x7f7980005180 2023-07-06T22:21:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f798a7fc640 1 -- 172.21.15.55:0/3499712398 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799000fac0 con 0x7f7980005180 2023-07-06T22:21:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f799ad94640 1 -- 172.21.15.55:0/3499712398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79940c9ca0 con 0x7f7980005180 2023-07-06T22:21:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f798a7fc640 1 -- 172.21.15.55:0/3499712398 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799000fe70 con 0x7f7980005180 2023-07-06T22:21:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f799ad94640 1 -- 172.21.15.55:0/3499712398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7994156670 con 0x7f7980005180 2023-07-06T22:21:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.282+0000 7f799ad94640 1 -- 172.21.15.55:0/3499712398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79940caad0 con 0x7f7980005180 2023-07-06T22:21:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.286+0000 7f798a7fc640 1 -- 172.21.15.55:0/3499712398 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f799001d460 con 0x7f7980005180 2023-07-06T22:21:03.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.286+0000 7f798a7fc640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f79780663d0 0x7f7978068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.286+0000 7f798a7fc640 1 -- 172.21.15.55:0/3499712398 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f7990084140 con 0x7f7980005180 2023-07-06T22:21:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.286+0000 7f7999591640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f79780663d0 0x7f7978068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.286+0000 7f7999591640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f79780663d0 0x7f7978068880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f79840093f0 tx=0x7f7984008040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:03.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.290+0000 7f798a7fc640 1 -- 172.21.15.55:0/3499712398 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79900512d0 con 0x7f7980005180 2023-07-06T22:21:03.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.446+0000 7f799ad94640 1 -- 172.21.15.55:0/3499712398 --> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f79940c9570 con 0x7f79780663d0 2023-07-06T22:21:03.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.450+0000 7f798a7fc640 1 -- 172.21.15.55:0/3499712398 <== mgr.11301 v2:172.21.15.55:6832/3094866364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f79940c9570 con 0x7f79780663d0 2023-07-06T22:21:03.452 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 4 to deep-scrub 2023-07-06T22:21:03.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.450+0000 7f799ad94640 1 -- 172.21.15.55:0/3499712398 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f79780663d0 msgr2=0x7f7978068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.450+0000 7f799ad94640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f79780663d0 0x7f7978068880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f79840093f0 tx=0x7f7984008040 comp rx=0 tx=0).stop 2023-07-06T22:21:03.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.450+0000 7f799ad94640 1 -- 172.21.15.55:0/3499712398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7980005180 msgr2=0x7f79940c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.450+0000 7f799ad94640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7980005180 0x7f79940c6590 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f7990007290 tx=0x7f7990007750 comp rx=0 tx=0).stop 2023-07-06T22:21:03.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.450+0000 7f799ad94640 1 -- 172.21.15.55:0/3499712398 shutdown_connections 2023-07-06T22:21:03.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.450+0000 7f799ad94640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f79780663d0 0x7f7978068880 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.450+0000 7f799ad94640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79940ca700 0x7f7994156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.450+0000 7f799ad94640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79940c6ad0 0x7f79940ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.450+0000 7f799ad94640 1 --2- 172.21.15.55:0/3499712398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7980005180 0x7f79940c6590 unknown :-1 s=CLOSED pgs=2386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.450+0000 7f799ad94640 1 -- 172.21.15.55:0/3499712398 >> 172.21.15.55:0/3499712398 conn(0x7f79940b3b60 msgr2=0x7f79940b6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:03.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.450+0000 7f799ad94640 1 -- 172.21.15.55:0/3499712398 shutdown_connections 2023-07-06T22:21:03.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.450+0000 7f799ad94640 1 -- 172.21.15.55:0/3499712398 wait complete. 2023-07-06T22:21:03.472 INFO:tasks.ceph:Scrubbing osd.5 2023-07-06T22:21:03.473 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-06T22:21:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.614+0000 7f2219d67640 1 Processor -- start 2023-07-06T22:21:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.614+0000 7f2219d67640 1 -- start start 2023-07-06T22:21:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.618+0000 7f2219d67640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f221406cb40 0x7f22140caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.618+0000 7f2219d67640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22140cc650 con 0x7f221406f960 2023-07-06T22:21:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.618+0000 7f2219d67640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221406d130 con 0x7f221406a460 2023-07-06T22:21:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.618+0000 7f2219d67640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221406bac0 con 0x7f221406cb40 2023-07-06T22:21:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.618+0000 7f2213fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f221406f960 0x7f221406bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40672/0 (socket says 172.21.15.55:40672) 2023-07-06T22:21:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.618+0000 7f2213fff640 1 -- 172.21.15.55:0/2516289238 learned_addr learned my addr 172.21.15.55:0/2516289238 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:21:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.618+0000 7f2212ffd640 1 --2- 172.21.15.55:0/2516289238 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f221406cb40 0x7f22140caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.618+0000 7f22127fc640 1 -- 172.21.15.55:0/2516289238 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581021706 0 0) 0x7f22140cc650 con 0x7f221406f960 2023-07-06T22:21:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.618+0000 7f22127fc640 1 -- 172.21.15.55:0/2516289238 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21fc003530 con 0x7f221406f960 2023-07-06T22:21:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.618+0000 7f22127fc640 1 -- 172.21.15.55:0/2516289238 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416398264 0 0) 0x7f221406d130 con 0x7f221406a460 2023-07-06T22:21:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.618+0000 7f22127fc640 1 -- 172.21.15.55:0/2516289238 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22140cc650 con 0x7f221406a460 2023-07-06T22:21:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.618+0000 7f2212ffd640 1 -- 172.21.15.55:0/2516289238 >> v1:172.21.15.138:6789/0 conn(0x7f221406a460 legacy=0x7f22140693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.618+0000 7f2212ffd640 1 -- 172.21.15.55:0/2516289238 >> v1:172.21.15.55:6789/0 conn(0x7f221406f960 legacy=0x7f221406bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.618+0000 7f2212ffd640 1 -- 172.21.15.55:0/2516289238 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221406d3d0 con 0x7f221406cb40 2023-07-06T22:21:03.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f2212ffd640 1 --2- 172.21.15.55:0/2516289238 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f221406cb40 0x7f22140caa80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f22080097f0 tx=0x7f220801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de12d5f9d4f43c8c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:03.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f22127fc640 1 -- 172.21.15.55:0/2516289238 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22080ab600 con 0x7f221406cb40 2023-07-06T22:21:03.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f22127fc640 1 -- 172.21.15.55:0/2516289238 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22080a7050 con 0x7f221406cb40 2023-07-06T22:21:03.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f22127fc640 1 -- 172.21.15.55:0/2516289238 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22080ab980 con 0x7f221406cb40 2023-07-06T22:21:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f2219d67640 1 -- 172.21.15.55:0/2516289238 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f221406cb40 msgr2=0x7f22140caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f2219d67640 1 --2- 172.21.15.55:0/2516289238 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f221406cb40 0x7f22140caa80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f22080097f0 tx=0x7f220801c430 comp rx=0 tx=0).stop 2023-07-06T22:21:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f2219d67640 1 -- 172.21.15.55:0/2516289238 shutdown_connections 2023-07-06T22:21:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f2219d67640 1 --2- 172.21.15.55:0/2516289238 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f221406cb40 0x7f22140caa80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f2219d67640 1 -- 172.21.15.55:0/2516289238 >> 172.21.15.55:0/2516289238 conn(0x7f22140ce7f0 msgr2=0x7f22140cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:03.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f2219d67640 1 -- 172.21.15.55:0/2516289238 shutdown_connections 2023-07-06T22:21:03.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f2219d67640 1 -- 172.21.15.55:0/2516289238 wait complete. 2023-07-06T22:21:03.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f2219d67640 1 Processor -- start 2023-07-06T22:21:03.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f2219d67640 1 -- start start 2023-07-06T22:21:03.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f2219d67640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f221406a460 0x7f221415ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f2219d67640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f221406cb40 0x7f2214160290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.622+0000 7f2219d67640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221406f960 0x7f22140ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2219d67640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2214157340 con 0x7f221406f960 2023-07-06T22:21:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2219d67640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221415b080 con 0x7f221406cb40 2023-07-06T22:21:03.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2219d67640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221415d220 con 0x7f221406a460 2023-07-06T22:21:03.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2213fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221406f960 0x7f22140ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2213fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221406f960 0x7f22140ab870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32890/0 (socket says 172.21.15.55:32890) 2023-07-06T22:21:03.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2213fff640 1 -- 172.21.15.55:0/2465458726 learned_addr learned my addr 172.21.15.55:0/2465458726 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:03.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2212ffd640 1 --2- 172.21.15.55:0/2465458726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f221406cb40 0x7f2214160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f22137fe640 1 --2- 172.21.15.55:0/2465458726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f221406a460 0x7f221415ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2213fff640 1 -- 172.21.15.55:0/2465458726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f221406a460 msgr2=0x7f221415ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2213fff640 1 --2- 172.21.15.55:0/2465458726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f221406a460 0x7f221415ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2213fff640 1 -- 172.21.15.55:0/2465458726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f221406cb40 msgr2=0x7f2214160290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2213fff640 1 --2- 172.21.15.55:0/2465458726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f221406cb40 0x7f2214160290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2213fff640 1 -- 172.21.15.55:0/2465458726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2208009420 con 0x7f221406f960 2023-07-06T22:21:03.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2213fff640 1 --2- 172.21.15.55:0/2465458726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221406f960 0x7f22140ab870 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f220c00caa0 tx=0x7f220c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:03.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f21fbfff640 1 -- 172.21.15.55:0/2465458726 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c00ac00 con 0x7f221406f960 2023-07-06T22:21:03.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f21fbfff640 1 -- 172.21.15.55:0/2465458726 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220c00ad60 con 0x7f221406f960 2023-07-06T22:21:03.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2219d67640 1 -- 172.21.15.55:0/2465458726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221415b320 con 0x7f221406f960 2023-07-06T22:21:03.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f21fbfff640 1 -- 172.21.15.55:0/2465458726 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c012620 con 0x7f221406f960 2023-07-06T22:21:03.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2219d67640 1 -- 172.21.15.55:0/2465458726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221415d4e0 con 0x7f221406f960 2023-07-06T22:21:03.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f2219d67640 1 -- 172.21.15.55:0/2465458726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f221406a830 con 0x7f221406f960 2023-07-06T22:21:03.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.626+0000 7f21fbfff640 1 -- 172.21.15.55:0/2465458726 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f220c007070 con 0x7f221406f960 2023-07-06T22:21:03.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.630+0000 7f21fbfff640 1 --2- 172.21.15.55:0/2465458726 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f22000663a0 0x7f2200068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.630+0000 7f21fbfff640 1 -- 172.21.15.55:0/2465458726 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f220c083f70 con 0x7f221406f960 2023-07-06T22:21:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.630+0000 7f21fbfff640 1 --2- 172.21.15.55:0/2465458726 >> [v2:172.21.15.138:6800/1249635244,v1:172.21.15.138:6801/1249635244] conn(0x7f220006d2f0 0x7f220006f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.630+0000 7f22137fe640 1 --2- 172.21.15.55:0/2465458726 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f22000663a0 0x7f2200068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.630+0000 7f21fbfff640 1 -- 172.21.15.55:0/2465458726 --> [v2:172.21.15.138:6800/1249635244,v1:172.21.15.138:6801/1249635244] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f220006fe10 con 0x7f220006d2f0 2023-07-06T22:21:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.630+0000 7f21fbfff640 1 -- 172.21.15.55:0/2465458726 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7f220c086550 con 0x7f221406f960 2023-07-06T22:21:03.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.630+0000 7f2212ffd640 1 --2- 172.21.15.55:0/2465458726 >> [v2:172.21.15.138:6800/1249635244,v1:172.21.15.138:6801/1249635244] conn(0x7f220006d2f0 0x7f220006f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.630+0000 7f22137fe640 1 --2- 172.21.15.55:0/2465458726 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f22000663a0 0x7f2200068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2204001240 tx=0x7f2204009040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:03.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.630+0000 7f2212ffd640 1 --2- 172.21.15.55:0/2465458726 >> [v2:172.21.15.138:6800/1249635244,v1:172.21.15.138:6801/1249635244] conn(0x7f220006d2f0 0x7f220006f740 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:03.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.630+0000 7f21fbfff640 1 -- 172.21.15.55:0/2465458726 <== osd.5 v2:172.21.15.138:6800/1249635244 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f220006fe10 con 0x7f220006d2f0 2023-07-06T22:21:03.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.642+0000 7f2219d67640 1 -- 172.21.15.55:0/2465458726 --> [v2:172.21.15.138:6800/1249635244,v1:172.21.15.138:6801/1249635244] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2214066d60 con 0x7f220006d2f0 2023-07-06T22:21:03.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.642+0000 7f21fbfff640 1 -- 172.21.15.55:0/2465458726 <== osd.5 v2:172.21.15.138:6800/1249635244 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2214066d60 con 0x7f220006d2f0 2023-07-06T22:21:03.647 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:21:03.647 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T22:21:03.648 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:21:03.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.646+0000 7f2219d67640 1 -- 172.21.15.55:0/2465458726 >> [v2:172.21.15.138:6800/1249635244,v1:172.21.15.138:6801/1249635244] conn(0x7f220006d2f0 msgr2=0x7f220006f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.646+0000 7f2219d67640 1 --2- 172.21.15.55:0/2465458726 >> [v2:172.21.15.138:6800/1249635244,v1:172.21.15.138:6801/1249635244] conn(0x7f220006d2f0 0x7f220006f740 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.646+0000 7f2219d67640 1 -- 172.21.15.55:0/2465458726 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f22000663a0 msgr2=0x7f2200068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.646+0000 7f2219d67640 1 --2- 172.21.15.55:0/2465458726 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f22000663a0 0x7f2200068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2204001240 tx=0x7f2204009040 comp rx=0 tx=0).stop 2023-07-06T22:21:03.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.646+0000 7f2219d67640 1 -- 172.21.15.55:0/2465458726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221406f960 msgr2=0x7f22140ab870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.646+0000 7f2219d67640 1 --2- 172.21.15.55:0/2465458726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221406f960 0x7f22140ab870 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f220c00caa0 tx=0x7f220c00cf60 comp rx=0 tx=0).stop 2023-07-06T22:21:03.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.646+0000 7f2213fff640 1 -- 172.21.15.55:0/2465458726 reap_dead start 2023-07-06T22:21:03.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.646+0000 7f2219d67640 1 -- 172.21.15.55:0/2465458726 shutdown_connections 2023-07-06T22:21:03.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.646+0000 7f2219d67640 1 -- 172.21.15.55:0/2465458726 >> 172.21.15.55:0/2465458726 conn(0x7f22140ce7f0 msgr2=0x7f22140af7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:03.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.646+0000 7f2219d67640 1 -- 172.21.15.55:0/2465458726 shutdown_connections 2023-07-06T22:21:03.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.646+0000 7f2219d67640 1 -- 172.21.15.55:0/2465458726 wait complete. 2023-07-06T22:21:03.666 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-06T22:21:03.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f4455f9f640 1 Processor -- start 2023-07-06T22:21:03.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f4455f9f640 1 -- start start 2023-07-06T22:21:03.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f4455f9f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4450158850 0x7f44500cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f4455f9f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44500ca130 0x7f44500ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f4455f9f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44500b2aa0 con 0x7f44500703e0 2023-07-06T22:21:03.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f4455f9f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4450158c20 con 0x7f44500ca130 2023-07-06T22:21:03.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f4455f9f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44500c8db0 con 0x7f4450158850 2023-07-06T22:21:03.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f444effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44500ca130 0x7f44500ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f444ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f44500703e0 0x7f445006eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40674/0 (socket says 172.21.15.55:40674) 2023-07-06T22:21:03.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f444ffff640 1 -- 172.21.15.55:0/1218546593 learned_addr learned my addr 172.21.15.55:0/1218546593 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:21:03.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f444f7fe640 1 --2- 172.21.15.55:0/1218546593 >> v2:172.21.15.138:3300/0 conn(0x7f4450158850 0x7f44500cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f444effd640 1 -- 172.21.15.55:0/1218546593 >> v2:172.21.15.138:3300/0 conn(0x7f4450158850 msgr2=0x7f44500cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:03.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f444effd640 1 --2- 172.21.15.55:0/1218546593 >> v2:172.21.15.138:3300/0 conn(0x7f4450158850 0x7f44500cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f444effd640 1 -- 172.21.15.55:0/1218546593 >> v1:172.21.15.55:6789/0 conn(0x7f44500703e0 legacy=0x7f445006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.818+0000 7f444effd640 1 -- 172.21.15.55:0/1218546593 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44500c9090 con 0x7f44500ca130 2023-07-06T22:21:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.822+0000 7f444effd640 1 --2- 172.21.15.55:0/1218546593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44500ca130 0x7f44500ccf70 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f445006eaf0 tx=0x7f444401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddabfb8d17bd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.822+0000 7f444e7fc640 1 -- 172.21.15.55:0/1218546593 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44440a7070 con 0x7f44500ca130 2023-07-06T22:21:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.822+0000 7f444e7fc640 1 -- 172.21.15.55:0/1218546593 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44440ab430 con 0x7f44500ca130 2023-07-06T22:21:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.822+0000 7f444e7fc640 1 -- 172.21.15.55:0/1218546593 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44440ab7c0 con 0x7f44500ca130 2023-07-06T22:21:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.822+0000 7f4455f9f640 1 -- 172.21.15.55:0/1218546593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44500ca130 msgr2=0x7f44500ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.822+0000 7f4455f9f640 1 --2- 172.21.15.55:0/1218546593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44500ca130 0x7f44500ccf70 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f445006eaf0 tx=0x7f444401c430 comp rx=0 tx=0).stop 2023-07-06T22:21:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.822+0000 7f4455f9f640 1 -- 172.21.15.55:0/1218546593 shutdown_connections 2023-07-06T22:21:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.822+0000 7f4455f9f640 1 --2- 172.21.15.55:0/1218546593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44500ca130 0x7f44500ccf70 unknown :-1 s=CLOSED pgs=2390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.822+0000 7f4455f9f640 1 --2- 172.21.15.55:0/1218546593 >> v2:172.21.15.138:3300/0 conn(0x7f4450158850 0x7f44500cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.822+0000 7f4455f9f640 1 -- 172.21.15.55:0/1218546593 >> 172.21.15.55:0/1218546593 conn(0x7f44500cea70 msgr2=0x7f44500ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.822+0000 7f4455f9f640 1 -- 172.21.15.55:0/1218546593 shutdown_connections 2023-07-06T22:21:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.822+0000 7f4455f9f640 1 -- 172.21.15.55:0/1218546593 wait complete. 2023-07-06T22:21:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f4455f9f640 1 Processor -- start 2023-07-06T22:21:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f4455f9f640 1 -- start start 2023-07-06T22:21:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f4455f9f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44500703e0 0x7f44500c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f4455f9f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44500ca130 0x7f445006bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f4455f9f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4450158850 0x7f4450069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f4455f9f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44501f5440 con 0x7f44500ca130 2023-07-06T22:21:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f4455f9f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44501f4fb0 con 0x7f44500703e0 2023-07-06T22:21:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f4455f9f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44501f43a0 con 0x7f4450158850 2023-07-06T22:21:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f444effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44500ca130 0x7f445006bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f444effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44500ca130 0x7f445006bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32912/0 (socket says 172.21.15.55:32912) 2023-07-06T22:21:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f444effd640 1 -- 172.21.15.55:0/3225980822 learned_addr learned my addr 172.21.15.55:0/3225980822 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f444effd640 1 -- 172.21.15.55:0/3225980822 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4450158850 msgr2=0x7f4450069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f444effd640 1 --2- 172.21.15.55:0/3225980822 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4450158850 0x7f4450069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f444effd640 1 -- 172.21.15.55:0/3225980822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44500703e0 msgr2=0x7f44500c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f444effd640 1 --2- 172.21.15.55:0/3225980822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44500703e0 0x7f44500c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f444effd640 1 -- 172.21.15.55:0/3225980822 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4444009420 con 0x7f44500ca130 2023-07-06T22:21:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f444effd640 1 --2- 172.21.15.55:0/3225980822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44500ca130 0x7f445006bf90 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f44440ad040 tx=0x7f444401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:03.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f4437fff640 1 -- 172.21.15.55:0/3225980822 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44440bf610 con 0x7f44500ca130 2023-07-06T22:21:03.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f4437fff640 1 -- 172.21.15.55:0/3225980822 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44440bf790 con 0x7f44500ca130 2023-07-06T22:21:03.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f4455f9f640 1 -- 172.21.15.55:0/3225980822 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44501f4680 con 0x7f44500ca130 2023-07-06T22:21:03.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f4437fff640 1 -- 172.21.15.55:0/3225980822 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44440bfb40 con 0x7f44500ca130 2023-07-06T22:21:03.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f4455f9f640 1 -- 172.21.15.55:0/3225980822 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44501f4c40 con 0x7f44500ca130 2023-07-06T22:21:03.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.826+0000 7f4455f9f640 1 -- 172.21.15.55:0/3225980822 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4450066d60 con 0x7f44500ca130 2023-07-06T22:21:03.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.830+0000 7f4437fff640 1 -- 172.21.15.55:0/3225980822 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f44440b5400 con 0x7f44500ca130 2023-07-06T22:21:03.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.830+0000 7f4437fff640 1 --2- 172.21.15.55:0/3225980822 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f443c0663a0 0x7f443c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:03.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.830+0000 7f4437fff640 1 -- 172.21.15.55:0/3225980822 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f444411ee60 con 0x7f44500ca130 2023-07-06T22:21:03.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.830+0000 7f444f7fe640 1 --2- 172.21.15.55:0/3225980822 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f443c0663a0 0x7f443c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:03.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.830+0000 7f444f7fe640 1 --2- 172.21.15.55:0/3225980822 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f443c0663a0 0x7f443c068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4440006aa0 tx=0x7f4440006a30 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:03.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.834+0000 7f4437fff640 1 -- 172.21.15.55:0/3225980822 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44440ebee0 con 0x7f44500ca130 2023-07-06T22:21:03.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.990+0000 7f4455f9f640 1 -- 172.21.15.55:0/3225980822 --> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f44500c9c10 con 0x7f443c0663a0 2023-07-06T22:21:03.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.994+0000 7f4437fff640 1 -- 172.21.15.55:0/3225980822 <== mgr.11301 v2:172.21.15.55:6832/3094866364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f444000e7d0 con 0x7f443c0663a0 2023-07-06T22:21:03.996 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 5 to deep-scrub 2023-07-06T22:21:03.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.994+0000 7f4455f9f640 1 -- 172.21.15.55:0/3225980822 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f443c0663a0 msgr2=0x7f443c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.994+0000 7f4455f9f640 1 --2- 172.21.15.55:0/3225980822 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f443c0663a0 0x7f443c068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4440006aa0 tx=0x7f4440006a30 comp rx=0 tx=0).stop 2023-07-06T22:21:03.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.994+0000 7f4455f9f640 1 -- 172.21.15.55:0/3225980822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44500ca130 msgr2=0x7f445006bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:03.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.994+0000 7f4455f9f640 1 --2- 172.21.15.55:0/3225980822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44500ca130 0x7f445006bf90 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f44440ad040 tx=0x7f444401ac70 comp rx=0 tx=0).stop 2023-07-06T22:21:03.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.994+0000 7f4455f9f640 1 -- 172.21.15.55:0/3225980822 shutdown_connections 2023-07-06T22:21:03.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.994+0000 7f4455f9f640 1 --2- 172.21.15.55:0/3225980822 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f443c0663a0 0x7f443c068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.994+0000 7f4455f9f640 1 --2- 172.21.15.55:0/3225980822 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4450158850 0x7f4450069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.994+0000 7f4455f9f640 1 --2- 172.21.15.55:0/3225980822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44500ca130 0x7f445006bf90 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.994+0000 7f4455f9f640 1 --2- 172.21.15.55:0/3225980822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44500703e0 0x7f44500c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:03.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.994+0000 7f4455f9f640 1 -- 172.21.15.55:0/3225980822 >> 172.21.15.55:0/3225980822 conn(0x7f44500cea70 msgr2=0x7f44500af980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:03.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.994+0000 7f4455f9f640 1 -- 172.21.15.55:0/3225980822 shutdown_connections 2023-07-06T22:21:03.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:03.994+0000 7f4455f9f640 1 -- 172.21.15.55:0/3225980822 wait complete. 2023-07-06T22:21:04.017 INFO:tasks.ceph:Scrubbing osd.6 2023-07-06T22:21:04.017 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-06T22:21:04.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fe080b640 1 Processor -- start 2023-07-06T22:21:04.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fe080b640 1 -- start start 2023-07-06T22:21:04.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fe080b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fdc0c9b90 0x7f1fdc15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fe080b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1fdc0693f0 0x7f1fdc069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fe080b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc0b3e70 con 0x7f1fdc0ccb70 2023-07-06T22:21:04.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fe080b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc159c30 con 0x7f1fdc0c9b90 2023-07-06T22:21:04.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fe080b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc0c9070 con 0x7f1fdc0693f0 2023-07-06T22:21:04.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fda59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fdc0c9b90 0x7f1fdc15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fda59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fdc0c9b90 0x7f1fdc15dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32916/0 (socket says 172.21.15.55:32916) 2023-07-06T22:21:04.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fda59c640 1 -- 172.21.15.55:0/1895209814 learned_addr learned my addr 172.21.15.55:0/1895209814 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:04.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fdad9d640 1 --2- 172.21.15.55:0/1895209814 >> v2:172.21.15.138:3300/0 conn(0x7f1fdc0693f0 0x7f1fdc069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fda59c640 1 -- 172.21.15.55:0/1895209814 >> v2:172.21.15.138:3300/0 conn(0x7f1fdc0693f0 msgr2=0x7f1fdc069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:04.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fda59c640 1 --2- 172.21.15.55:0/1895209814 >> v2:172.21.15.138:3300/0 conn(0x7f1fdc0693f0 0x7f1fdc069810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fda59c640 1 -- 172.21.15.55:0/1895209814 >> v1:172.21.15.55:6789/0 conn(0x7f1fdc0ccb70 legacy=0x7f1fdc0c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.162+0000 7f1fda59c640 1 -- 172.21.15.55:0/1895209814 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0c8480 con 0x7f1fdc0c9b90 2023-07-06T22:21:04.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.166+0000 7f1fda59c640 1 --2- 172.21.15.55:0/1895209814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0c9b90 0x7f1fdc15dd50 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0cee10 tx=0x7f1fcc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67216af5e99c9b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:04.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.166+0000 7f1fd9d9b640 1 -- 172.21.15.55:0/1895209814 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0a8050 con 0x7f1fdc0c9b90 2023-07-06T22:21:04.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.166+0000 7f1fd9d9b640 1 -- 172.21.15.55:0/1895209814 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0ac5f0 con 0x7f1fdc0c9b90 2023-07-06T22:21:04.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.166+0000 7f1fd9d9b640 1 -- 172.21.15.55:0/1895209814 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0ac980 con 0x7f1fdc0c9b90 2023-07-06T22:21:04.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.166+0000 7f1fe080b640 1 -- 172.21.15.55:0/1895209814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0c9b90 msgr2=0x7f1fdc15dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.166+0000 7f1fe080b640 1 --2- 172.21.15.55:0/1895209814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0c9b90 0x7f1fdc15dd50 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0cee10 tx=0x7f1fcc01c500 comp rx=0 tx=0).stop 2023-07-06T22:21:04.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.166+0000 7f1fe080b640 1 -- 172.21.15.55:0/1895209814 shutdown_connections 2023-07-06T22:21:04.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.166+0000 7f1fe080b640 1 --2- 172.21.15.55:0/1895209814 >> v2:172.21.15.138:3300/0 conn(0x7f1fdc0693f0 0x7f1fdc069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.166+0000 7f1fe080b640 1 --2- 172.21.15.55:0/1895209814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0c9b90 0x7f1fdc15dd50 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.166+0000 7f1fe080b640 1 -- 172.21.15.55:0/1895209814 >> 172.21.15.55:0/1895209814 conn(0x7f1fdc0cde30 msgr2=0x7f1fdc0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:04.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.166+0000 7f1fe080b640 1 -- 172.21.15.55:0/1895209814 shutdown_connections 2023-07-06T22:21:04.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.166+0000 7f1fe080b640 1 -- 172.21.15.55:0/1895209814 wait complete. 2023-07-06T22:21:04.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fe080b640 1 Processor -- start 2023-07-06T22:21:04.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fe080b640 1 -- start start 2023-07-06T22:21:04.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fe080b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0693f0 0x7f1fdc1f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fe080b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fdc0c9b90 0x7f1fdc152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fe080b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fdc0ccb70 0x7f1fdc162880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fe080b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1528b0 con 0x7f1fdc0693f0 2023-07-06T22:21:04.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fe080b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1f4ed0 con 0x7f1fdc0c9b90 2023-07-06T22:21:04.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fe080b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc15cbe0 con 0x7f1fdc0ccb70 2023-07-06T22:21:04.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fda59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0693f0 0x7f1fdc1f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fda59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0693f0 0x7f1fdc1f3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32928/0 (socket says 172.21.15.55:32928) 2023-07-06T22:21:04.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fda59c640 1 -- 172.21.15.55:0/3914863659 learned_addr learned my addr 172.21.15.55:0/3914863659 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:04.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fdad9d640 1 --2- 172.21.15.55:0/3914863659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fdc0ccb70 0x7f1fdc162880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fd3fff640 1 --2- 172.21.15.55:0/3914863659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fdc0c9b90 0x7f1fdc152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fda59c640 1 -- 172.21.15.55:0/3914863659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fdc0ccb70 msgr2=0x7f1fdc162880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fda59c640 1 --2- 172.21.15.55:0/3914863659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fdc0ccb70 0x7f1fdc162880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fda59c640 1 -- 172.21.15.55:0/3914863659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fdc0c9b90 msgr2=0x7f1fdc152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fda59c640 1 --2- 172.21.15.55:0/3914863659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fdc0c9b90 0x7f1fdc152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fda59c640 1 -- 172.21.15.55:0/3914863659 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc0094d0 con 0x7f1fdc0693f0 2023-07-06T22:21:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fda59c640 1 --2- 172.21.15.55:0/3914863659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0693f0 0x7f1fdc1f3f20 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc01abb0 tx=0x7f1fcc0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fd2ffd640 1 -- 172.21.15.55:0/3914863659 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0a8040 con 0x7f1fdc0693f0 2023-07-06T22:21:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fd2ffd640 1 -- 172.21.15.55:0/3914863659 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0b45c0 con 0x7f1fdc0693f0 2023-07-06T22:21:04.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fd2ffd640 1 -- 172.21.15.55:0/3914863659 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0b4950 con 0x7f1fdc0693f0 2023-07-06T22:21:04.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.170+0000 7f1fe080b640 1 -- 172.21.15.55:0/3914863659 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc1f4630 con 0x7f1fdc0693f0 2023-07-06T22:21:04.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.174+0000 7f1fe080b640 1 -- 172.21.15.55:0/3914863659 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc1f4bf0 con 0x7f1fdc0693f0 2023-07-06T22:21:04.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.174+0000 7f1fe080b640 1 -- 172.21.15.55:0/3914863659 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1fdc0c9500 con 0x7f1fdc0693f0 2023-07-06T22:21:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.174+0000 7f1fd2ffd640 1 -- 172.21.15.55:0/3914863659 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1fcc0b4ab0 con 0x7f1fdc0693f0 2023-07-06T22:21:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.174+0000 7f1fd2ffd640 1 --2- 172.21.15.55:0/3914863659 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f1fbc0663d0 0x7f1fbc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.174+0000 7f1fd2ffd640 1 -- 172.21.15.55:0/3914863659 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f1fcc11edb0 con 0x7f1fdc0693f0 2023-07-06T22:21:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.174+0000 7f1fd3fff640 1 --2- 172.21.15.55:0/3914863659 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f1fbc0663d0 0x7f1fbc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.174+0000 7f1fd2ffd640 1 --2- 172.21.15.55:0/3914863659 >> [v2:172.21.15.138:6802/1391058734,v1:172.21.15.138:6804/1391058734] conn(0x7f1fbc06d320 0x7f1fbc06f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.174+0000 7f1fd2ffd640 1 -- 172.21.15.55:0/3914863659 --> [v2:172.21.15.138:6802/1391058734,v1:172.21.15.138:6804/1391058734] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fbc06fe40 con 0x7f1fbc06d320 2023-07-06T22:21:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.174+0000 7f1fd2ffd640 1 -- 172.21.15.55:0/3914863659 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fcc11f120 con 0x7f1fdc0693f0 2023-07-06T22:21:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.174+0000 7f1fdad9d640 1 --2- 172.21.15.55:0/3914863659 >> [v2:172.21.15.138:6802/1391058734,v1:172.21.15.138:6804/1391058734] conn(0x7f1fbc06d320 0x7f1fbc06f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.174+0000 7f1fd3fff640 1 --2- 172.21.15.55:0/3914863659 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f1fbc0663d0 0x7f1fbc068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc06d4d0 tx=0x7f1fc4009040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.178+0000 7f1fdad9d640 1 --2- 172.21.15.55:0/3914863659 >> [v2:172.21.15.138:6802/1391058734,v1:172.21.15.138:6804/1391058734] conn(0x7f1fbc06d320 0x7f1fbc06f770 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:04.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.178+0000 7f1fd2ffd640 1 -- 172.21.15.55:0/3914863659 <== osd.6 v2:172.21.15.138:6802/1391058734 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1fbc06fe40 con 0x7f1fbc06d320 2023-07-06T22:21:04.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.190+0000 7f1fe080b640 1 -- 172.21.15.55:0/3914863659 --> [v2:172.21.15.138:6802/1391058734,v1:172.21.15.138:6804/1391058734] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1fdc0c8d00 con 0x7f1fbc06d320 2023-07-06T22:21:04.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.190+0000 7f1fd2ffd640 1 -- 172.21.15.55:0/3914863659 <== osd.6 v2:172.21.15.138:6802/1391058734 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1fd4009ad0 con 0x7f1fbc06d320 2023-07-06T22:21:04.194 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:21:04.194 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T22:21:04.194 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:21:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.190+0000 7f1fe080b640 1 -- 172.21.15.55:0/3914863659 >> [v2:172.21.15.138:6802/1391058734,v1:172.21.15.138:6804/1391058734] conn(0x7f1fbc06d320 msgr2=0x7f1fbc06f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.190+0000 7f1fe080b640 1 --2- 172.21.15.55:0/3914863659 >> [v2:172.21.15.138:6802/1391058734,v1:172.21.15.138:6804/1391058734] conn(0x7f1fbc06d320 0x7f1fbc06f770 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.190+0000 7f1fe080b640 1 -- 172.21.15.55:0/3914863659 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f1fbc0663d0 msgr2=0x7f1fbc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.190+0000 7f1fe080b640 1 --2- 172.21.15.55:0/3914863659 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f1fbc0663d0 0x7f1fbc068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc06d4d0 tx=0x7f1fc4009040 comp rx=0 tx=0).stop 2023-07-06T22:21:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.190+0000 7f1fe080b640 1 -- 172.21.15.55:0/3914863659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0693f0 msgr2=0x7f1fdc1f3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.190+0000 7f1fe080b640 1 --2- 172.21.15.55:0/3914863659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0693f0 0x7f1fdc1f3f20 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc01abb0 tx=0x7f1fcc0192a0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.190+0000 7f1fdad9d640 1 -- 172.21.15.55:0/3914863659 reap_dead start 2023-07-06T22:21:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.190+0000 7f1fe080b640 1 -- 172.21.15.55:0/3914863659 shutdown_connections 2023-07-06T22:21:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.190+0000 7f1fe080b640 1 -- 172.21.15.55:0/3914863659 >> 172.21.15.55:0/3914863659 conn(0x7f1fdc0cde30 msgr2=0x7f1fdc0ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.190+0000 7f1fe080b640 1 -- 172.21.15.55:0/3914863659 shutdown_connections 2023-07-06T22:21:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.190+0000 7f1fe080b640 1 -- 172.21.15.55:0/3914863659 wait complete. 2023-07-06T22:21:04.213 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-06T22:21:04.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.354+0000 7f2fde19f640 1 Processor -- start 2023-07-06T22:21:04.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.354+0000 7f2fde19f640 1 -- start start 2023-07-06T22:21:04.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fde19f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2fd80ca610 0x7f2fd80cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fde19f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd815f5d0 con 0x7f2fd806f0e0 2023-07-06T22:21:04.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fde19f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd815f8b0 con 0x7f2fd8156180 2023-07-06T22:21:04.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fde19f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd8160250 con 0x7f2fd80ca610 2023-07-06T22:21:04.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd6ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2fd806f0e0 0x7f2fd80cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40684/0 (socket says 172.21.15.55:40684) 2023-07-06T22:21:04.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd6ffd640 1 -- 172.21.15.55:0/4287409381 learned_addr learned my addr 172.21.15.55:0/4287409381 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:21:04.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd7fff640 1 --2- 172.21.15.55:0/4287409381 >> v2:172.21.15.138:3300/0 conn(0x7f2fd80ca610 0x7f2fd80cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 -- 172.21.15.55:0/4287409381 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319321880 0 0) 0x7f2fd815f5d0 con 0x7f2fd806f0e0 2023-07-06T22:21:04.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 -- 172.21.15.55:0/4287409381 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc0003530 con 0x7f2fd806f0e0 2023-07-06T22:21:04.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 -- 172.21.15.55:0/4287409381 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1203865864 0 0) 0x7f2fc0003530 con 0x7f2fd806f0e0 2023-07-06T22:21:04.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 -- 172.21.15.55:0/4287409381 >> v2:172.21.15.138:3300/0 conn(0x7f2fd80ca610 msgr2=0x7f2fd80cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:04.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 --2- 172.21.15.55:0/4287409381 >> v2:172.21.15.138:3300/0 conn(0x7f2fd80ca610 0x7f2fd80cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 -- 172.21.15.55:0/4287409381 >> v1:172.21.15.138:6789/0 conn(0x7f2fd8156180 legacy=0x7f2fd806e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 -- 172.21.15.55:0/4287409381 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd815fb90 con 0x7f2fd806f0e0 2023-07-06T22:21:04.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 -- 172.21.15.55:0/4287409381 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7f2fcc001680 con 0x7f2fd806f0e0 2023-07-06T22:21:04.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 -- 172.21.15.55:0/4287409381 >> v1:172.21.15.55:6789/0 conn(0x7f2fd806f0e0 legacy=0x7f2fd80cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 --2- 172.21.15.55:0/4287409381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc0003980 0x7f2fc0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 --2- 172.21.15.55:0/4287409381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc0004370 0x7f2fc0004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 --2- 172.21.15.55:0/4287409381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc00050d0 0x7f2fc000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 -- 172.21.15.55:0/4287409381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd8160250 con 0x7f2fc0003980 2023-07-06T22:21:04.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 -- 172.21.15.55:0/4287409381 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc000c000 con 0x7f2fc0004370 2023-07-06T22:21:04.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd67fc640 1 -- 172.21.15.55:0/4287409381 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc000c1c0 con 0x7f2fc00050d0 2023-07-06T22:21:04.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd77fe640 1 --2- 172.21.15.55:0/4287409381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc0003980 0x7f2fc0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd6ffd640 1 --2- 172.21.15.55:0/4287409381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc0004370 0x7f2fc0004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd7fff640 1 --2- 172.21.15.55:0/4287409381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc00050d0 0x7f2fc000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd77fe640 1 -- 172.21.15.55:0/4287409381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc00050d0 msgr2=0x7f2fc000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:04.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd77fe640 1 --2- 172.21.15.55:0/4287409381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc00050d0 0x7f2fc000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd77fe640 1 -- 172.21.15.55:0/4287409381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc0004370 msgr2=0x7f2fc0004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:04.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd77fe640 1 --2- 172.21.15.55:0/4287409381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc0004370 0x7f2fc0004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd77fe640 1 -- 172.21.15.55:0/4287409381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc0003530 con 0x7f2fc0003980 2023-07-06T22:21:04.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd7fff640 1 --2- 172.21.15.55:0/4287409381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fc00050d0 0x7f2fc000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:21:04.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd6ffd640 1 --2- 172.21.15.55:0/4287409381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fc0004370 0x7f2fc0004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:21:04.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.358+0000 7f2fd7fff640 1 -- 172.21.15.55:0/4287409381 reap_dead start 2023-07-06T22:21:04.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.362+0000 7f2fd77fe640 1 --2- 172.21.15.55:0/4287409381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc0003980 0x7f2fc0003d50 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8001910 tx=0x7f2fc801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da331302b581782d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:04.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.362+0000 7f2fd67fc640 1 -- 172.21.15.55:0/4287409381 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80ab600 con 0x7f2fc0003980 2023-07-06T22:21:04.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.362+0000 7f2fd67fc640 1 -- 172.21.15.55:0/4287409381 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc80a7050 con 0x7f2fc0003980 2023-07-06T22:21:04.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.362+0000 7f2fd67fc640 1 -- 172.21.15.55:0/4287409381 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80ab9c0 con 0x7f2fc0003980 2023-07-06T22:21:04.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.362+0000 7f2fde19f640 1 -- 172.21.15.55:0/4287409381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc0003980 msgr2=0x7f2fc0003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.362+0000 7f2fde19f640 1 --2- 172.21.15.55:0/4287409381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc0003980 0x7f2fc0003d50 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8001910 tx=0x7f2fc801c540 comp rx=0 tx=0).stop 2023-07-06T22:21:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.362+0000 7f2fde19f640 1 -- 172.21.15.55:0/4287409381 shutdown_connections 2023-07-06T22:21:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.362+0000 7f2fde19f640 1 --2- 172.21.15.55:0/4287409381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc0003980 0x7f2fc0003d50 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.362+0000 7f2fde19f640 1 -- 172.21.15.55:0/4287409381 >> 172.21.15.55:0/4287409381 conn(0x7f2fd80d0c50 msgr2=0x7f2fd80cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.362+0000 7f2fde19f640 1 -- 172.21.15.55:0/4287409381 shutdown_connections 2023-07-06T22:21:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.362+0000 7f2fde19f640 1 -- 172.21.15.55:0/4287409381 wait complete. 2023-07-06T22:21:04.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.362+0000 7f2fde19f640 1 Processor -- start 2023-07-06T22:21:04.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fde19f640 1 -- start start 2023-07-06T22:21:04.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fde19f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc0003980 0x7f2fd80c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fde19f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd80c7090 0x7f2fd80c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fde19f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fd8148fb0 0x7f2fd80c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fde19f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd80c8be0 con 0x7f2fc0003980 2023-07-06T22:21:04.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fde19f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd80c7600 con 0x7f2fd80c7090 2023-07-06T22:21:04.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fde19f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd80c78e0 con 0x7f2fd8148fb0 2023-07-06T22:21:04.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fd77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc0003980 0x7f2fd80c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fd77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc0003980 0x7f2fd80c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32940/0 (socket says 172.21.15.55:32940) 2023-07-06T22:21:04.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fd77fe640 1 -- 172.21.15.55:0/957127041 learned_addr learned my addr 172.21.15.55:0/957127041 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:04.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fd7fff640 1 --2- 172.21.15.55:0/957127041 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fd8148fb0 0x7f2fd80c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fd6ffd640 1 --2- 172.21.15.55:0/957127041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd80c7090 0x7f2fd80c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fd77fe640 1 -- 172.21.15.55:0/957127041 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fd8148fb0 msgr2=0x7f2fd80c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fd77fe640 1 --2- 172.21.15.55:0/957127041 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fd8148fb0 0x7f2fd80c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fd77fe640 1 -- 172.21.15.55:0/957127041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd80c7090 msgr2=0x7f2fd80c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fd77fe640 1 --2- 172.21.15.55:0/957127041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd80c7090 0x7f2fd80c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fd77fe640 1 -- 172.21.15.55:0/957127041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd80c7bc0 con 0x7f2fc0003980 2023-07-06T22:21:04.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fd77fe640 1 --2- 172.21.15.55:0/957127041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc0003980 0x7f2fd80c86a0 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8001910 tx=0x7f2fc0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:04.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fbffff640 1 -- 172.21.15.55:0/957127041 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80abce0 con 0x7f2fc0003980 2023-07-06T22:21:04.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fde19f640 1 -- 172.21.15.55:0/957127041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd80c7ea0 con 0x7f2fc0003980 2023-07-06T22:21:04.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fbffff640 1 -- 172.21.15.55:0/957127041 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc80abe40 con 0x7f2fc0003980 2023-07-06T22:21:04.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fbffff640 1 -- 172.21.15.55:0/957127041 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8007260 con 0x7f2fc0003980 2023-07-06T22:21:04.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fde19f640 1 -- 172.21.15.55:0/957127041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd80c6220 con 0x7f2fc0003980 2023-07-06T22:21:04.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.366+0000 7f2fde19f640 1 -- 172.21.15.55:0/957127041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd8066d60 con 0x7f2fc0003980 2023-07-06T22:21:04.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.370+0000 7f2fbffff640 1 -- 172.21.15.55:0/957127041 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2fc80b2040 con 0x7f2fc0003980 2023-07-06T22:21:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.370+0000 7f2fbffff640 1 --2- 172.21.15.55:0/957127041 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f2fc40663a0 0x7f2fc4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.370+0000 7f2fbffff640 1 -- 172.21.15.55:0/957127041 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f2fc811d540 con 0x7f2fc0003980 2023-07-06T22:21:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.370+0000 7f2fd6ffd640 1 --2- 172.21.15.55:0/957127041 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f2fc40663a0 0x7f2fc4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.370+0000 7f2fd6ffd640 1 --2- 172.21.15.55:0/957127041 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f2fc40663a0 0x7f2fc4068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc001210 tx=0x7f2fcc007040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.374+0000 7f2fbffff640 1 -- 172.21.15.55:0/957127041 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2fc80ea5f0 con 0x7f2fc0003980 2023-07-06T22:21:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.526+0000 7f2fde19f640 1 -- 172.21.15.55:0/957127041 --> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fd80c8350 con 0x7f2fc40663a0 2023-07-06T22:21:04.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.526+0000 7f2fbffff640 1 -- 172.21.15.55:0/957127041 <== mgr.11301 v2:172.21.15.55:6832/3094866364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2fcc0047f0 con 0x7f2fc40663a0 2023-07-06T22:21:04.531 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 6 to deep-scrub 2023-07-06T22:21:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.530+0000 7f2fde19f640 1 -- 172.21.15.55:0/957127041 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f2fc40663a0 msgr2=0x7f2fc4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.530+0000 7f2fde19f640 1 --2- 172.21.15.55:0/957127041 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f2fc40663a0 0x7f2fc4068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc001210 tx=0x7f2fcc007040 comp rx=0 tx=0).stop 2023-07-06T22:21:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.530+0000 7f2fde19f640 1 -- 172.21.15.55:0/957127041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc0003980 msgr2=0x7f2fd80c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.530+0000 7f2fde19f640 1 --2- 172.21.15.55:0/957127041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc0003980 0x7f2fd80c86a0 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8001910 tx=0x7f2fc0005800 comp rx=0 tx=0).stop 2023-07-06T22:21:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.530+0000 7f2fde19f640 1 -- 172.21.15.55:0/957127041 shutdown_connections 2023-07-06T22:21:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.530+0000 7f2fde19f640 1 --2- 172.21.15.55:0/957127041 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f2fc40663a0 0x7f2fc4068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.530+0000 7f2fde19f640 1 --2- 172.21.15.55:0/957127041 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2fd8148fb0 0x7f2fd80c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.530+0000 7f2fde19f640 1 --2- 172.21.15.55:0/957127041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd80c7090 0x7f2fd80c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.530+0000 7f2fde19f640 1 --2- 172.21.15.55:0/957127041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fc0003980 0x7f2fd80c86a0 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.530+0000 7f2fde19f640 1 -- 172.21.15.55:0/957127041 >> 172.21.15.55:0/957127041 conn(0x7f2fd80d0c50 msgr2=0x7f2fd80b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:04.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.530+0000 7f2fde19f640 1 -- 172.21.15.55:0/957127041 shutdown_connections 2023-07-06T22:21:04.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.530+0000 7f2fde19f640 1 -- 172.21.15.55:0/957127041 wait complete. 2023-07-06T22:21:04.552 INFO:tasks.ceph:Scrubbing osd.7 2023-07-06T22:21:04.552 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-06T22:21:04.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.694+0000 7f86ca174640 1 Processor -- start 2023-07-06T22:21:04.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.694+0000 7f86ca174640 1 -- start start 2023-07-06T22:21:04.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86ca174640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f86c406a460 0x7f86c40caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86ca174640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86c406cb40 0x7f86c40693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86ca174640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86c406f960 0x7f86c406fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86ca174640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c406bac0 con 0x7f86c406f960 2023-07-06T22:21:04.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86ca174640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c4070320 con 0x7f86c406a460 2023-07-06T22:21:04.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86ca174640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40cc650 con 0x7f86c406cb40 2023-07-06T22:21:04.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86c3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86c406f960 0x7f86c406fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86c3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86c406f960 0x7f86c406fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32952/0 (socket says 172.21.15.55:32952) 2023-07-06T22:21:04.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86c3fff640 1 -- 172.21.15.55:0/2803687339 learned_addr learned my addr 172.21.15.55:0/2803687339 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:04.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86c2ffd640 1 --2- 172.21.15.55:0/2803687339 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86c406cb40 0x7f86c40693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86c37fe640 1 --2- 172.21.15.55:0/2803687339 >> v2:172.21.15.138:3300/0 conn(0x7f86c406a460 0x7f86c40caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86c3fff640 1 -- 172.21.15.55:0/2803687339 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86c406cb40 msgr2=0x7f86c40693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:04.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86c3fff640 1 --2- 172.21.15.55:0/2803687339 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86c406cb40 0x7f86c40693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86c3fff640 1 -- 172.21.15.55:0/2803687339 >> v2:172.21.15.138:3300/0 conn(0x7f86c406a460 msgr2=0x7f86c40caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:04.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86c3fff640 1 --2- 172.21.15.55:0/2803687339 >> v2:172.21.15.138:3300/0 conn(0x7f86c406a460 0x7f86c40caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86c3fff640 1 -- 172.21.15.55:0/2803687339 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c406d130 con 0x7f86c406f960 2023-07-06T22:21:04.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.698+0000 7f86c37fe640 1 --2- 172.21.15.55:0/2803687339 >> v2:172.21.15.138:3300/0 conn(0x7f86c406a460 0x7f86c40caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:21:04.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86c3fff640 1 --2- 172.21.15.55:0/2803687339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86c406f960 0x7f86c406fde0 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7f86c4065eb0 tx=0x7f86bc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f0021794760b2d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:04.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86c27fc640 1 -- 172.21.15.55:0/2803687339 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0a56a0 con 0x7f86c406f960 2023-07-06T22:21:04.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86c27fc640 1 -- 172.21.15.55:0/2803687339 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc0a5800 con 0x7f86c406f960 2023-07-06T22:21:04.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86c27fc640 1 -- 172.21.15.55:0/2803687339 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0a5b90 con 0x7f86c406f960 2023-07-06T22:21:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86ca174640 1 -- 172.21.15.55:0/2803687339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86c406f960 msgr2=0x7f86c406fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86ca174640 1 --2- 172.21.15.55:0/2803687339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86c406f960 0x7f86c406fde0 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7f86c4065eb0 tx=0x7f86bc01c910 comp rx=0 tx=0).stop 2023-07-06T22:21:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86ca174640 1 -- 172.21.15.55:0/2803687339 shutdown_connections 2023-07-06T22:21:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86ca174640 1 --2- 172.21.15.55:0/2803687339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86c406f960 0x7f86c406fde0 unknown :-1 s=CLOSED pgs=2398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86ca174640 1 --2- 172.21.15.55:0/2803687339 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86c406cb40 0x7f86c40693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86ca174640 1 --2- 172.21.15.55:0/2803687339 >> v2:172.21.15.138:3300/0 conn(0x7f86c406a460 0x7f86c40caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86ca174640 1 -- 172.21.15.55:0/2803687339 >> 172.21.15.55:0/2803687339 conn(0x7f86c40ce7f0 msgr2=0x7f86c40cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86ca174640 1 -- 172.21.15.55:0/2803687339 shutdown_connections 2023-07-06T22:21:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86ca174640 1 -- 172.21.15.55:0/2803687339 wait complete. 2023-07-06T22:21:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86ca174640 1 Processor -- start 2023-07-06T22:21:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86ca174640 1 -- start start 2023-07-06T22:21:04.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.702+0000 7f86ca174640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86c406a460 0x7f86c40ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86ca174640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86c406cb40 0x7f86c4151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86ca174640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86c406f960 0x7f86c40c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86ca174640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40adec0 con 0x7f86c406f960 2023-07-06T22:21:04.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86ca174640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40acd80 con 0x7f86c406cb40 2023-07-06T22:21:04.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86ca174640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c414ff00 con 0x7f86c406a460 2023-07-06T22:21:04.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86c406f960 0x7f86c40c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86c37fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86c406a460 0x7f86c40ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86c2ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86c406cb40 0x7f86c4151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86c37fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86c406a460 0x7f86c40ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:54292/0 (socket says 172.21.15.55:54292) 2023-07-06T22:21:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86c406f960 0x7f86c40c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32968/0 (socket says 172.21.15.55:32968) 2023-07-06T22:21:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86c37fe640 1 -- 172.21.15.55:0/3367693002 learned_addr learned my addr 172.21.15.55:0/3367693002 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86c3fff640 1 -- 172.21.15.55:0/3367693002 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86c406a460 msgr2=0x7f86c40ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86c3fff640 1 --2- 172.21.15.55:0/3367693002 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86c406a460 0x7f86c40ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86c3fff640 1 -- 172.21.15.55:0/3367693002 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86c406cb40 msgr2=0x7f86c4151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86c3fff640 1 --2- 172.21.15.55:0/3367693002 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86c406cb40 0x7f86c4151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86c3fff640 1 -- 172.21.15.55:0/3367693002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc009b30 con 0x7f86c406f960 2023-07-06T22:21:04.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86c3fff640 1 --2- 172.21.15.55:0/3367693002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86c406f960 0x7f86c40c4650 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0ab000 tx=0x7f86bc0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:04.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86abfff640 1 -- 172.21.15.55:0/3367693002 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0b8670 con 0x7f86c406f960 2023-07-06T22:21:04.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86abfff640 1 -- 172.21.15.55:0/3367693002 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc0b87d0 con 0x7f86c406f960 2023-07-06T22:21:04.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86ca174640 1 -- 172.21.15.55:0/3367693002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c4153f40 con 0x7f86c406f960 2023-07-06T22:21:04.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86abfff640 1 -- 172.21.15.55:0/3367693002 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0b8b80 con 0x7f86c406f960 2023-07-06T22:21:04.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86ca174640 1 -- 172.21.15.55:0/3367693002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c4154500 con 0x7f86c406f960 2023-07-06T22:21:04.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86ca174640 1 -- 172.21.15.55:0/3367693002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f86c406a830 con 0x7f86c406f960 2023-07-06T22:21:04.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.706+0000 7f86abfff640 1 -- 172.21.15.55:0/3367693002 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f86bc0b8ce0 con 0x7f86c406f960 2023-07-06T22:21:04.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.710+0000 7f86abfff640 1 --2- 172.21.15.55:0/3367693002 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f86b00663a0 0x7f86b0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.710+0000 7f86abfff640 1 -- 172.21.15.55:0/3367693002 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f86bc11ec20 con 0x7f86c406f960 2023-07-06T22:21:04.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.710+0000 7f86c37fe640 1 --2- 172.21.15.55:0/3367693002 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f86b00663a0 0x7f86b0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.710+0000 7f86abfff640 1 --2- 172.21.15.55:0/3367693002 >> [v2:172.21.15.138:6816/3688560884,v1:172.21.15.138:6817/3688560884] conn(0x7f86b006d2f0 0x7f86b006f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.710+0000 7f86abfff640 1 -- 172.21.15.55:0/3367693002 --> [v2:172.21.15.138:6816/3688560884,v1:172.21.15.138:6817/3688560884] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86b006fe10 con 0x7f86b006d2f0 2023-07-06T22:21:04.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.710+0000 7f86abfff640 1 -- 172.21.15.55:0/3367693002 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86bc123220 con 0x7f86c406f960 2023-07-06T22:21:04.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.710+0000 7f86c2ffd640 1 --2- 172.21.15.55:0/3367693002 >> [v2:172.21.15.138:6816/3688560884,v1:172.21.15.138:6817/3688560884] conn(0x7f86b006d2f0 0x7f86b006f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.710+0000 7f86c37fe640 1 --2- 172.21.15.55:0/3367693002 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f86b00663a0 0x7f86b0068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f86b4006cf0 tx=0x7f86b4008040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:04.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.710+0000 7f86c2ffd640 1 --2- 172.21.15.55:0/3367693002 >> [v2:172.21.15.138:6816/3688560884,v1:172.21.15.138:6817/3688560884] conn(0x7f86b006d2f0 0x7f86b006f740 crc :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:04.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.710+0000 7f86abfff640 1 -- 172.21.15.55:0/3367693002 <== osd.7 v2:172.21.15.138:6816/3688560884 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f86b006fe10 con 0x7f86b006d2f0 2023-07-06T22:21:04.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.722+0000 7f86ca174640 1 -- 172.21.15.55:0/3367693002 --> [v2:172.21.15.138:6816/3688560884,v1:172.21.15.138:6817/3688560884] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f86c406b6e0 con 0x7f86b006d2f0 2023-07-06T22:21:04.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.722+0000 7f86abfff640 1 -- 172.21.15.55:0/3367693002 <== osd.7 v2:172.21.15.138:6816/3688560884 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f86b8009d70 con 0x7f86b006d2f0 2023-07-06T22:21:04.727 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-07-06T22:21:04.728 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T22:21:04.728 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-07-06T22:21:04.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.726+0000 7f86ca174640 1 -- 172.21.15.55:0/3367693002 >> [v2:172.21.15.138:6816/3688560884,v1:172.21.15.138:6817/3688560884] conn(0x7f86b006d2f0 msgr2=0x7f86b006f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.726+0000 7f86ca174640 1 --2- 172.21.15.55:0/3367693002 >> [v2:172.21.15.138:6816/3688560884,v1:172.21.15.138:6817/3688560884] conn(0x7f86b006d2f0 0x7f86b006f740 crc :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.726+0000 7f86ca174640 1 -- 172.21.15.55:0/3367693002 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f86b00663a0 msgr2=0x7f86b0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.726+0000 7f86ca174640 1 --2- 172.21.15.55:0/3367693002 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f86b00663a0 0x7f86b0068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f86b4006cf0 tx=0x7f86b4008040 comp rx=0 tx=0).stop 2023-07-06T22:21:04.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.726+0000 7f86ca174640 1 -- 172.21.15.55:0/3367693002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86c406f960 msgr2=0x7f86c40c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.726+0000 7f86ca174640 1 --2- 172.21.15.55:0/3367693002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86c406f960 0x7f86c40c4650 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0ab000 tx=0x7f86bc0196b0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.726+0000 7f86c3fff640 1 -- 172.21.15.55:0/3367693002 reap_dead start 2023-07-06T22:21:04.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.726+0000 7f86ca174640 1 -- 172.21.15.55:0/3367693002 shutdown_connections 2023-07-06T22:21:04.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.726+0000 7f86ca174640 1 -- 172.21.15.55:0/3367693002 >> 172.21.15.55:0/3367693002 conn(0x7f86c40ce7f0 msgr2=0x7f86c40c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:04.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.726+0000 7f86ca174640 1 -- 172.21.15.55:0/3367693002 shutdown_connections 2023-07-06T22:21:04.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.726+0000 7f86ca174640 1 -- 172.21.15.55:0/3367693002 wait complete. 2023-07-06T22:21:04.746 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-06T22:21:04.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.886+0000 7f93f4a93640 1 Processor -- start 2023-07-06T22:21:04.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.886+0000 7f93f4a93640 1 -- start start 2023-07-06T22:21:04.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.886+0000 7f93f4a93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93f0158850 0x7f93f00cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.886+0000 7f93f4a93640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f93f0070af0 0x7f93f00ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.886+0000 7f93f4a93640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f0158c20 con 0x7f93f00ca130 2023-07-06T22:21:04.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.886+0000 7f93f4a93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f00b2aa0 con 0x7f93f0158850 2023-07-06T22:21:04.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.886+0000 7f93f4a93640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f00c8db0 con 0x7f93f0070af0 2023-07-06T22:21:04.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.886+0000 7f93ee59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93f0158850 0x7f93f00cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.886+0000 7f93ee59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93f0158850 0x7f93f00cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32974/0 (socket says 172.21.15.55:32974) 2023-07-06T22:21:04.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.886+0000 7f93ee59c640 1 -- 172.21.15.55:0/837918991 learned_addr learned my addr 172.21.15.55:0/837918991 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:04.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.890+0000 7f93eed9d640 1 --2- 172.21.15.55:0/837918991 >> v2:172.21.15.138:3300/0 conn(0x7f93f0070af0 0x7f93f00ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.890+0000 7f93ee59c640 1 -- 172.21.15.55:0/837918991 >> v2:172.21.15.138:3300/0 conn(0x7f93f0070af0 msgr2=0x7f93f00ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:04.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.890+0000 7f93ee59c640 1 --2- 172.21.15.55:0/837918991 >> v2:172.21.15.138:3300/0 conn(0x7f93f0070af0 0x7f93f00ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.890+0000 7f93ee59c640 1 -- 172.21.15.55:0/837918991 >> v1:172.21.15.138:6789/0 conn(0x7f93f00ca130 legacy=0x7f93f00703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:04.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.890+0000 7f93ee59c640 1 -- 172.21.15.55:0/837918991 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00c9090 con 0x7f93f0158850 2023-07-06T22:21:04.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.890+0000 7f93eed9d640 1 --2- 172.21.15.55:0/837918991 >> v2:172.21.15.138:3300/0 conn(0x7f93f0070af0 0x7f93f00ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T22:21:04.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.890+0000 7f93ee59c640 1 --2- 172.21.15.55:0/837918991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f0158850 0x7f93f00cca30 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7f93f00711e0 tx=0x7f93e001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d181fb0213087f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:04.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.890+0000 7f93edd9b640 1 -- 172.21.15.55:0/837918991 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e00aa5f0 con 0x7f93f0158850 2023-07-06T22:21:04.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.890+0000 7f93edd9b640 1 -- 172.21.15.55:0/837918991 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e00aa750 con 0x7f93f0158850 2023-07-06T22:21:04.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.890+0000 7f93edd9b640 1 -- 172.21.15.55:0/837918991 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e00aaae0 con 0x7f93f0158850 2023-07-06T22:21:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 -- 172.21.15.55:0/837918991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f0158850 msgr2=0x7f93f00cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 --2- 172.21.15.55:0/837918991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f0158850 0x7f93f00cca30 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7f93f00711e0 tx=0x7f93e001c490 comp rx=0 tx=0).stop 2023-07-06T22:21:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 -- 172.21.15.55:0/837918991 shutdown_connections 2023-07-06T22:21:04.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 --2- 172.21.15.55:0/837918991 >> v2:172.21.15.138:3300/0 conn(0x7f93f0070af0 0x7f93f00ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 --2- 172.21.15.55:0/837918991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f0158850 0x7f93f00cca30 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 -- 172.21.15.55:0/837918991 >> 172.21.15.55:0/837918991 conn(0x7f93f00cea70 msgr2=0x7f93f00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:04.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 -- 172.21.15.55:0/837918991 shutdown_connections 2023-07-06T22:21:04.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 -- 172.21.15.55:0/837918991 wait complete. 2023-07-06T22:21:04.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 Processor -- start 2023-07-06T22:21:04.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 -- start start 2023-07-06T22:21:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f0070af0 0x7f93f0150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93f00ca130 0x7f93f0151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f0158850 0x7f93f006b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f006ac20 con 0x7f93f0158850 2023-07-06T22:21:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00bfe40 con 0x7f93f0070af0 2023-07-06T22:21:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93f4a93640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0069fa0 con 0x7f93f00ca130 2023-07-06T22:21:04.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93eed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f0158850 0x7f93f006b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93eed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f0158850 0x7f93f006b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32984/0 (socket says 172.21.15.55:32984) 2023-07-06T22:21:04.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93eed9d640 1 -- 172.21.15.55:0/3557696451 learned_addr learned my addr 172.21.15.55:0/3557696451 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:04.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93ee59c640 1 --2- 172.21.15.55:0/3557696451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f0070af0 0x7f93f0150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93e7fff640 1 --2- 172.21.15.55:0/3557696451 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93f00ca130 0x7f93f0151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93eed9d640 1 -- 172.21.15.55:0/3557696451 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93f00ca130 msgr2=0x7f93f0151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93eed9d640 1 --2- 172.21.15.55:0/3557696451 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93f00ca130 0x7f93f0151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93eed9d640 1 -- 172.21.15.55:0/3557696451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f0070af0 msgr2=0x7f93f0150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:04.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93eed9d640 1 --2- 172.21.15.55:0/3557696451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f0070af0 0x7f93f0150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.894+0000 7f93eed9d640 1 -- 172.21.15.55:0/3557696451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e00094d0 con 0x7f93f0158850 2023-07-06T22:21:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.898+0000 7f93eed9d640 1 --2- 172.21.15.55:0/3557696451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f0158850 0x7f93f006b040 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7f93e800cf20 tx=0x7f93e800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.898+0000 7f93e6ffd640 1 -- 172.21.15.55:0/3557696451 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e800d840 con 0x7f93f0158850 2023-07-06T22:21:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.898+0000 7f93e6ffd640 1 -- 172.21.15.55:0/3557696451 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e800d9a0 con 0x7f93f0158850 2023-07-06T22:21:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.898+0000 7f93f4a93640 1 -- 172.21.15.55:0/3557696451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f006a280 con 0x7f93f0158850 2023-07-06T22:21:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.898+0000 7f93e6ffd640 1 -- 172.21.15.55:0/3557696451 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e800dd50 con 0x7f93f0158850 2023-07-06T22:21:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.898+0000 7f93f4a93640 1 -- 172.21.15.55:0/3557696451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f006a840 con 0x7f93f0158850 2023-07-06T22:21:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.898+0000 7f93f4a93640 1 -- 172.21.15.55:0/3557696451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f006ad60 con 0x7f93f0158850 2023-07-06T22:21:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.898+0000 7f93e6ffd640 1 -- 172.21.15.55:0/3557696451 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f93e801e3b0 con 0x7f93f0158850 2023-07-06T22:21:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.898+0000 7f93e6ffd640 1 --2- 172.21.15.55:0/3557696451 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f93d00663a0 0x7f93d0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.902+0000 7f93e6ffd640 1 -- 172.21.15.55:0/3557696451 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f93e80849c0 con 0x7f93f0158850 2023-07-06T22:21:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.902+0000 7f93ee59c640 1 --2- 172.21.15.55:0/3557696451 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f93d00663a0 0x7f93d0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:04.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.902+0000 7f93ee59c640 1 --2- 172.21.15.55:0/3557696451 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f93d00663a0 0x7f93d0068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f93e00ae000 tx=0x7f93e00b5040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:04.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:04.902+0000 7f93e6ffd640 1 -- 172.21.15.55:0/3557696451 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93f006ad60 con 0x7f93f0158850 2023-07-06T22:21:05.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.058+0000 7f93f4a93640 1 -- 172.21.15.55:0/3557696451 --> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f93f00c9c10 con 0x7f93d00663a0 2023-07-06T22:21:05.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.058+0000 7f93e6ffd640 1 -- 172.21.15.55:0/3557696451 <== mgr.11301 v2:172.21.15.55:6832/3094866364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f93e00aa8c0 con 0x7f93d00663a0 2023-07-06T22:21:05.062 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 7 to deep-scrub 2023-07-06T22:21:05.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.062+0000 7f93f4a93640 1 -- 172.21.15.55:0/3557696451 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f93d00663a0 msgr2=0x7f93d0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:05.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.062+0000 7f93f4a93640 1 --2- 172.21.15.55:0/3557696451 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f93d00663a0 0x7f93d0068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f93e00ae000 tx=0x7f93e00b5040 comp rx=0 tx=0).stop 2023-07-06T22:21:05.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.062+0000 7f93f4a93640 1 -- 172.21.15.55:0/3557696451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f0158850 msgr2=0x7f93f006b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:05.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.062+0000 7f93f4a93640 1 --2- 172.21.15.55:0/3557696451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f0158850 0x7f93f006b040 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7f93e800cf20 tx=0x7f93e800a7d0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.062+0000 7f93f4a93640 1 -- 172.21.15.55:0/3557696451 shutdown_connections 2023-07-06T22:21:05.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.062+0000 7f93f4a93640 1 --2- 172.21.15.55:0/3557696451 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f93d00663a0 0x7f93d0068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.062+0000 7f93f4a93640 1 --2- 172.21.15.55:0/3557696451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f0158850 0x7f93f006b040 unknown :-1 s=CLOSED pgs=2401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.062+0000 7f93f4a93640 1 --2- 172.21.15.55:0/3557696451 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93f00ca130 0x7f93f0151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.062+0000 7f93f4a93640 1 --2- 172.21.15.55:0/3557696451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93f0070af0 0x7f93f0150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.062+0000 7f93f4a93640 1 -- 172.21.15.55:0/3557696451 >> 172.21.15.55:0/3557696451 conn(0x7f93f00cea70 msgr2=0x7f93f00af190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:05.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.062+0000 7f93f4a93640 1 -- 172.21.15.55:0/3557696451 shutdown_connections 2023-07-06T22:21:05.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.062+0000 7f93f4a93640 1 -- 172.21.15.55:0/3557696451 wait complete. 2023-07-06T22:21:05.083 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:21:05.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb0c234640 1 Processor -- start 2023-07-06T22:21:05.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb0c234640 1 -- start start 2023-07-06T22:21:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb0c234640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7feb040ca450 0x7feb0406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb0c234640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb040b3730 0x7feb0415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb0c234640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb04159cd0 con 0x7feb040712f0 2023-07-06T22:21:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb0c234640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb040693f0 con 0x7feb040ca450 2023-07-06T22:21:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb0c234640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0406aca0 con 0x7feb040b3730 2023-07-06T22:21:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb09fd0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feb040712f0 0x7feb040c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40700/0 (socket says 172.21.15.55:40700) 2023-07-06T22:21:05.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb09fd0640 1 -- 172.21.15.55:0/2827698503 learned_addr learned my addr 172.21.15.55:0/2827698503 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:21:05.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb0a7d1640 1 --2- 172.21.15.55:0/2827698503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb040b3730 0x7feb0415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:05.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb097cf640 1 --2- 172.21.15.55:0/2827698503 >> v2:172.21.15.138:3300/0 conn(0x7feb040ca450 0x7feb0406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:05.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 -- 172.21.15.55:0/2827698503 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970615399 0 0) 0x7feb04159cd0 con 0x7feb040712f0 2023-07-06T22:21:05.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 -- 172.21.15.55:0/2827698503 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaf0003530 con 0x7feb040712f0 2023-07-06T22:21:05.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 -- 172.21.15.55:0/2827698503 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2013407929 0 0) 0x7feaf0003530 con 0x7feb040712f0 2023-07-06T22:21:05.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 -- 172.21.15.55:0/2827698503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb040b3730 msgr2=0x7feb0415d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:05.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 --2- 172.21.15.55:0/2827698503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb040b3730 0x7feb0415d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 -- 172.21.15.55:0/2827698503 >> v2:172.21.15.138:3300/0 conn(0x7feb040ca450 msgr2=0x7feb0406a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:05.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 --2- 172.21.15.55:0/2827698503 >> v2:172.21.15.138:3300/0 conn(0x7feb040ca450 0x7feb0406a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 -- 172.21.15.55:0/2827698503 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb040696b0 con 0x7feb040712f0 2023-07-06T22:21:05.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 -- 172.21.15.55:0/2827698503 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7feb00001680 con 0x7feb040712f0 2023-07-06T22:21:05.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 -- 172.21.15.55:0/2827698503 >> v1:172.21.15.55:6789/0 conn(0x7feb040712f0 legacy=0x7feb040c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:05.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 --2- 172.21.15.55:0/2827698503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaf0003980 0x7feaf0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:05.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 --2- 172.21.15.55:0/2827698503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaf00043b0 0x7feaf0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:05.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 --2- 172.21.15.55:0/2827698503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb040b3730 0x7feaf0004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:05.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 -- 172.21.15.55:0/2827698503 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb040693f0 con 0x7feaf00043b0 2023-07-06T22:21:05.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 -- 172.21.15.55:0/2827698503 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0406aca0 con 0x7feaf0003980 2023-07-06T22:21:05.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb08fce640 1 -- 172.21.15.55:0/2827698503 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf000b990 con 0x7feb040b3730 2023-07-06T22:21:05.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb097cf640 1 --2- 172.21.15.55:0/2827698503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaf00043b0 0x7feaf0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:05.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb09fd0640 1 --2- 172.21.15.55:0/2827698503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaf0003980 0x7feaf0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:05.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.226+0000 7feb0a7d1640 1 --2- 172.21.15.55:0/2827698503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb040b3730 0x7feaf0004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:05.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.230+0000 7feb097cf640 1 -- 172.21.15.55:0/2827698503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb040b3730 msgr2=0x7feaf0004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:05.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.230+0000 7feb097cf640 1 --2- 172.21.15.55:0/2827698503 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb040b3730 0x7feaf0004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.230+0000 7feb097cf640 1 -- 172.21.15.55:0/2827698503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaf0003980 msgr2=0x7feaf0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:05.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.230+0000 7feb097cf640 1 --2- 172.21.15.55:0/2827698503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaf0003980 0x7feaf0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.230+0000 7feb097cf640 1 -- 172.21.15.55:0/2827698503 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf0003530 con 0x7feaf00043b0 2023-07-06T22:21:05.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.230+0000 7feb097cf640 1 --2- 172.21.15.55:0/2827698503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaf00043b0 0x7feaf0004870 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009ab0 tx=0x7feaf401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bb7819aaa9213c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:05.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.230+0000 7feb08fce640 1 -- 172.21.15.55:0/2827698503 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf40a5660 con 0x7feaf00043b0 2023-07-06T22:21:05.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.230+0000 7feb08fce640 1 -- 172.21.15.55:0/2827698503 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf40a57c0 con 0x7feaf00043b0 2023-07-06T22:21:05.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.230+0000 7feb08fce640 1 -- 172.21.15.55:0/2827698503 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf40a5b70 con 0x7feaf00043b0 2023-07-06T22:21:05.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.230+0000 7feb0c234640 1 -- 172.21.15.55:0/2827698503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaf00043b0 msgr2=0x7feaf0004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:05.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.230+0000 7feb0c234640 1 --2- 172.21.15.55:0/2827698503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaf00043b0 0x7feaf0004870 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009ab0 tx=0x7feaf401ca70 comp rx=0 tx=0).stop 2023-07-06T22:21:05.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.230+0000 7feb0a7d1640 1 -- 172.21.15.55:0/2827698503 reap_dead start 2023-07-06T22:21:05.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.230+0000 7feb0c234640 1 -- 172.21.15.55:0/2827698503 shutdown_connections 2023-07-06T22:21:05.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.230+0000 7feb0c234640 1 -- 172.21.15.55:0/2827698503 >> 172.21.15.55:0/2827698503 conn(0x7feb040cded0 msgr2=0x7feb040ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:05.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0c234640 1 -- 172.21.15.55:0/2827698503 shutdown_connections 2023-07-06T22:21:05.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0c234640 1 -- 172.21.15.55:0/2827698503 wait complete. 2023-07-06T22:21:05.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0c234640 1 Processor -- start 2023-07-06T22:21:05.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0c234640 1 -- start start 2023-07-06T22:21:05.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0c234640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaf00043b0 0x7feb041f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:05.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0c234640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb0415a690 0x7feb040b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:05.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0c234640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb040b23a0 0x7feb04153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:05.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0c234640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb040b2840 con 0x7feb040b23a0 2023-07-06T22:21:05.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0c234640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb04156cf0 con 0x7feaf00043b0 2023-07-06T22:21:05.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0c234640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0415c3f0 con 0x7feb0415a690 2023-07-06T22:21:05.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0a7d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb040b23a0 0x7feb04153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:05.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0a7d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb040b23a0 0x7feb04153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33010/0 (socket says 172.21.15.55:33010) 2023-07-06T22:21:05.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0a7d1640 1 -- 172.21.15.55:0/2449185510 learned_addr learned my addr 172.21.15.55:0/2449185510 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:05.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb09fd0640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaf00043b0 0x7feb041f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:05.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb097cf640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb0415a690 0x7feb040b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:05.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0a7d1640 1 -- 172.21.15.55:0/2449185510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb0415a690 msgr2=0x7feb040b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:05.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0a7d1640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb0415a690 0x7feb040b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0a7d1640 1 -- 172.21.15.55:0/2449185510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaf00043b0 msgr2=0x7feb041f1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:05.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0a7d1640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaf00043b0 0x7feb041f1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0a7d1640 1 -- 172.21.15.55:0/2449185510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0415b500 con 0x7feb040b23a0 2023-07-06T22:21:05.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb097cf640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb0415a690 0x7feb040b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:21:05.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb09fd0640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaf00043b0 0x7feb041f1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:21:05.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.234+0000 7feb0a7d1640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb040b23a0 0x7feb04153be0 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7feb040ca900 tx=0x7feafc011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:05.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.238+0000 7feafa7fc640 1 -- 172.21.15.55:0/2449185510 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc00e040 con 0x7feb040b23a0 2023-07-06T22:21:05.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.238+0000 7feafa7fc640 1 -- 172.21.15.55:0/2449185510 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc00f040 con 0x7feb040b23a0 2023-07-06T22:21:05.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.238+0000 7feafa7fc640 1 -- 172.21.15.55:0/2449185510 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc015a80 con 0x7feb040b23a0 2023-07-06T22:21:05.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.238+0000 7feb0c234640 1 -- 172.21.15.55:0/2449185510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0415b7e0 con 0x7feb040b23a0 2023-07-06T22:21:05.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.238+0000 7feb0c234640 1 -- 172.21.15.55:0/2449185510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0415bda0 con 0x7feb040b23a0 2023-07-06T22:21:05.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.238+0000 7feb0c234640 1 -- 172.21.15.55:0/2449185510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb04066d60 con 0x7feb040b23a0 2023-07-06T22:21:05.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.238+0000 7feafa7fc640 1 -- 172.21.15.55:0/2449185510 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feafc015be0 con 0x7feb040b23a0 2023-07-06T22:21:05.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.238+0000 7feafa7fc640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7feae80663a0 0x7feae8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:05.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.238+0000 7feafa7fc640 1 -- 172.21.15.55:0/2449185510 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7feafc084060 con 0x7feb040b23a0 2023-07-06T22:21:05.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.238+0000 7feb09fd0640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7feae80663a0 0x7feae8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:05.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.242+0000 7feb09fd0640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7feae80663a0 0x7feae8068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feb00005180 tx=0x7feb00009040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:05.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.242+0000 7feafa7fc640 1 -- 172.21.15.55:0/2449185510 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feafc054b70 con 0x7feb040b23a0 2023-07-06T22:21:05.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.398+0000 7feb0c234640 1 -- 172.21.15.55:0/2449185510 --> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb04069c70 con 0x7feae80663a0 2023-07-06T22:21:05.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.398+0000 7feafa7fc640 1 -- 172.21.15.55:0/2449185510 <== mgr.11301 v2:172.21.15.55:6832/3094866364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72990 (secure 0 0 0) 0x7feb000015e0 con 0x7feae80663a0 2023-07-06T22:21:05.403 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:21:05.403 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:21:05.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.402+0000 7feb0c234640 1 -- 172.21.15.55:0/2449185510 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7feae80663a0 msgr2=0x7feae8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:05.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.402+0000 7feb0c234640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7feae80663a0 0x7feae8068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feb00005180 tx=0x7feb00009040 comp rx=0 tx=0).stop 2023-07-06T22:21:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.402+0000 7feb0c234640 1 -- 172.21.15.55:0/2449185510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb040b23a0 msgr2=0x7feb04153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.402+0000 7feb0c234640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb040b23a0 0x7feb04153be0 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7feb040ca900 tx=0x7feafc011cb0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.402+0000 7feb0c234640 1 -- 172.21.15.55:0/2449185510 shutdown_connections 2023-07-06T22:21:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.402+0000 7feb0c234640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7feae80663a0 0x7feae8068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.402+0000 7feb0c234640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb040b23a0 0x7feb04153be0 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.402+0000 7feb0c234640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feb0415a690 0x7feb040b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.402+0000 7feb0c234640 1 --2- 172.21.15.55:0/2449185510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaf00043b0 0x7feb041f1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:05.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.402+0000 7feb0c234640 1 -- 172.21.15.55:0/2449185510 >> 172.21.15.55:0/2449185510 conn(0x7feb040cded0 msgr2=0x7feb0406b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:05.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.402+0000 7feb0c234640 1 -- 172.21.15.55:0/2449185510 shutdown_connections 2023-07-06T22:21:05.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:05.402+0000 7feb0c234640 1 -- 172.21.15.55:0/2449185510 wait complete. 2023-07-06T22:21:05.425 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-07-06T22:21:04.317818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":386496,"kb_used_data":20864,"kb_used_omap":0,"kb_used_meta":365568,"kb_avail":754588224,"statfs":{"total":773094113280,"available":772698341376,"internally_reserved":0,"allocated":21364736,"data_stored":12043130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":374341632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.975680"},"pg_stats":[{"pgid":"1.0","version":"198'348","reported_seq":1353,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:20:55.357818+0000","last_change":"2023-07-06T21:41:59.448847+0000","last_active":"2023-07-06T22:20:55.357818+0000","last_peered":"2023-07-06T22:20:55.357818+0000","last_clean":"2023-07-06T22:20:55.357818+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:20:55.357818+0000","last_undegraded":"2023-07-06T22:20:55.357818+0000","last_fullsized":"2023-07-06T22:20:55.357818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:41:58.149280+0000","last_clean_scrub_stamp":"2023-07-06T21:41:58.149280+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:37:19.554850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":327,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:20:55.388856+0000","last_change":"2023-07-06T21:42:05.415938+0000","last_active":"2023-07-06T22:20:55.388856+0000","last_peered":"2023-07-06T22:20:55.388856+0000","last_clean":"2023-07-06T22:20:55.388856+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:20:55.388856+0000","last_undegraded":"2023-07-06T22:20:55.388856+0000","last_fullsized":"2023-07-06T22:20:55.388856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:06:20.856287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":378,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:20:55.357664+0000","last_change":"2023-07-06T21:42:05.416729+0000","last_active":"2023-07-06T22:20:55.357664+0000","last_peered":"2023-07-06T22:20:55.357664+0000","last_clean":"2023-07-06T22:20:55.357664+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:20:55.357664+0000","last_undegraded":"2023-07-06T22:20:55.357664+0000","last_fullsized":"2023-07-06T22:20:55.357664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:20:37.764224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":382,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:21:03.335577+0000","last_change":"2023-07-06T22:21:03.335626+0000","last_active":"2023-07-06T22:21:03.335577+0000","last_peered":"2023-07-06T22:21:03.335577+0000","last_clean":"2023-07-06T22:21:03.335577+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:21:03.335577+0000","last_undegraded":"2023-07-06T22:21:03.335577+0000","last_fullsized":"2023-07-06T22:21:03.335577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:21:03.335491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:21:03.335491+0000","last_clean_scrub_stamp":"2023-07-06T22:21:03.335491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:43:38.690116+0000","scrub_duration":0.003412984,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":327,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:20:55.388232+0000","last_change":"2023-07-06T21:42:05.416567+0000","last_active":"2023-07-06T22:20:55.388232+0000","last_peered":"2023-07-06T22:20:55.388232+0000","last_clean":"2023-07-06T22:20:55.388232+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:20:55.388232+0000","last_undegraded":"2023-07-06T22:20:55.388232+0000","last_fullsized":"2023-07-06T22:20:55.388232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:00.291329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":331,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:20:55.393156+0000","last_change":"2023-07-06T21:42:05.848338+0000","last_active":"2023-07-06T22:20:55.393156+0000","last_peered":"2023-07-06T22:20:55.393156+0000","last_clean":"2023-07-06T22:20:55.393156+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:20:55.393156+0000","last_undegraded":"2023-07-06T22:20:55.393156+0000","last_fullsized":"2023-07-06T22:20:55.393156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:47:16.809737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":377,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:20:55.358753+0000","last_change":"2023-07-06T21:42:05.849710+0000","last_active":"2023-07-06T22:20:55.358753+0000","last_peered":"2023-07-06T22:20:55.358753+0000","last_clean":"2023-07-06T22:20:55.358753+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:20:55.358753+0000","last_undegraded":"2023-07-06T22:20:55.358753+0000","last_fullsized":"2023-07-06T22:20:55.358753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:10:05.832558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":331,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:20:55.391432+0000","last_change":"2023-07-06T21:42:05.415074+0000","last_active":"2023-07-06T22:20:55.391432+0000","last_peered":"2023-07-06T22:20:55.391432+0000","last_clean":"2023-07-06T22:20:55.391432+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:20:55.391432+0000","last_undegraded":"2023-07-06T22:20:55.391432+0000","last_fullsized":"2023-07-06T22:20:55.391432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:53:33.142642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":324,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:20:55.389970+0000","last_change":"2023-07-06T21:42:05.415783+0000","last_active":"2023-07-06T22:20:55.389970+0000","last_peered":"2023-07-06T22:20:55.389970+0000","last_clean":"2023-07-06T22:20:55.389970+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:20:55.389970+0000","last_undegraded":"2023-07-06T22:20:55.389970+0000","last_fullsized":"2023-07-06T22:20:55.389970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T21:42:04.387613+0000","last_clean_scrub_stamp":"2023-07-06T21:42:04.387613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:24:56.170141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575310,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42284,"kb_used_data":3044,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329556,"statfs":{"total":96636764160,"available":96593465344,"internally_reserved":0,"allocated":3117056,"data_stored":1948422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.432},"max":{"1min":0.92100000000000004,"5min":0.93300000000000005,"15min":1.0740000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.51600000000000001,"5min":0.45900000000000002,"15min":0.45700000000000002},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72299999999999998,"15min":0.72399999999999998},"min":{"1min":0.52100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.73299999999999998},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.752}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.74199999999999999,"15min":0.72399999999999998},"min":{"1min":0.57699999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.61099999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"max":{"1min":0.96399999999999997,"5min":0.96699999999999997,"15min":1.0149999999999999},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73999999999999999,"15min":0.73199999999999998},"min":{"1min":0.53100000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.84099999999999997,"15min":0.78400000000000003},"min":{"1min":0.56200000000000006,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":9.8279999999999994,"15min":9.8279999999999994},"last":0.73599999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.36799999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73499999999999999,"15min":0.625},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":2.2610000000000001,"5min":13.443,"15min":13.443},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.52400000000000002,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.70799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575310,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37604,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334236,"statfs":{"total":96636764160,"available":96598257664,"internally_reserved":0,"allocated":2519040,"data_stored":1357035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.40300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.7829999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":1.633},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.49199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.9099999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.73399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.97799999999999998},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83199999999999996,"5min":0.91100000000000003,"15min":2.0299999999999998},"last":0.75},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90300000000000002,"5min":1.04,"15min":1.5920000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.61099999999999999,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.996},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.69699999999999995,"5min":1.024,"15min":1.024},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80200000000000005,"5min":0.92600000000000005,"15min":0.996},"last":0.5}]},{"osd":5,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.45400000000000001,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":0.89900000000000002,"15min":0.98499999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.85999999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jul 6 22:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.627,"15min":0.623},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82499999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.624},"min":{"1min":0.54100000000000004,"5min":0.45600000000000002,"15min":0.439},"max":{"1min":0.78400000000000003,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.56200000000000006}]}]},{"osd":5,"up_from":13,"seq":55834575309,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59752,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312088,"statfs":{"total":96636764160,"available":96575578112,"internally_reserved":0,"allocated":2523136,"data_stored":1358054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.92100000000000004,"5min":0.97199999999999998,"15min":0.999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.628,"5min":0.46999999999999997,"15min":0.46400000000000002},"max":{"1min":0.88400000000000001,"5min":0.995,"15min":0.995},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.52200000000000002,"5min":0.44400000000000001,"15min":0.43099999999999999},"max":{"1min":0.94799999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.72999999999999998,"15min":0.73199999999999998},"min":{"1min":0.60599999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.006,"5min":1.006,"15min":1.3200000000000001},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.46300000000000002},"max":{"1min":0.93700000000000006,"5min":0.998,"15min":1.4299999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.749},"min":{"1min":0.56200000000000006,"5min":0.48499999999999999,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":0.999,"15min":1.0409999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76600000000000001,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.54400000000000004,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":0.996,"15min":1.5169999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.623,"5min":0.51500000000000001,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.623}]},{"osd":4,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61599999999999999,"15min":0.61699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.79800000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.622,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jul 6 22:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.5,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69799999999999995,"15min":0.69099999999999995},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.55300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575308,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55656,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316184,"statfs":{"total":96636764160,"available":96579772416,"internally_reserved":0,"allocated":2523136,"data_stored":1358054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.42199999999999999},"max":{"1min":0.876,"5min":0.96399999999999997,"15min":0.98999999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":0.97899999999999998,"15min":1.016},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.56899999999999995,"5min":0.47899999999999998,"15min":0.38300000000000001},"max":{"1min":0.93400000000000005,"5min":0.999,"15min":1.0309999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.44600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.996},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.97799999999999998,"15min":1.0760000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.622,"5min":0.54600000000000004,"15min":0.502},"max":{"1min":0.97699999999999998,"5min":0.99399999999999999,"15min":1.0580000000000001},"last":0.80000000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.53500000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.98699999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.51900000000000002},"max":{"1min":0.92500000000000004,"5min":1.022,"15min":1.03},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59699999999999998,"15min":0.59599999999999997},"min":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.36599999999999999},"max":{"1min":0.76800000000000002,"5min":0.91200000000000003,"15min":0.92600000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78300000000000003,"5min":0.95599999999999996,"15min":1.006},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":0.91500000000000004,"15min":1.0509999999999999},"last":0.629},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.41299999999999998},"max":{"1min":0.83599999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90300000000000002,"5min":0.94799999999999995,"15min":1.0469999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.432,"15min":0.432},"max":{"1min":0.90200000000000002,"5min":1.0109999999999999,"15min":1.1100000000000001},"last":0.81599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575310,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51560,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320280,"statfs":{"total":96636764160,"available":96583966720,"internally_reserved":0,"allocated":2523136,"data_stored":1358054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45900000000000002,"15min":0.46400000000000002},"min":{"1min":0.27300000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.60299999999999998,"5min":0.68100000000000005,"15min":0.85899999999999999},"last":0.378},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.623,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":0.83899999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.70099999999999996,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.439}]},{"osd":2,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.875},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34699999999999998},"max":{"1min":0.73699999999999999,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.77400000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.441},"max":{"1min":0.98799999999999999,"5min":1.0449999999999999,"15min":1.474},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.3859999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79300000000000004,"15min":0.80800000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.056,"5min":1.175,"15min":1.3740000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.081,"5min":1.081,"15min":1.2330000000000001},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.52200000000000002},"max":{"1min":0.97499999999999998,"5min":1.1399999999999999,"15min":1.3899999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.57299999999999995},"max":{"1min":1.028,"5min":1.1499999999999999,"15min":1.3220000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.2210000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82299999999999995,"15min":0.82799999999999996},"min":{"1min":0.61499999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0629999999999999,"5min":1.244,"15min":1.3200000000000001},"last":0.72199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575310,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41704,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330136,"statfs":{"total":96636764160,"available":96594059264,"internally_reserved":0,"allocated":2523136,"data_stored":1358054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55000000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.77000000000000002,"15min":0.78600000000000003},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.42499999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65600000000000003,"5min":0.74099999999999999,"15min":0.84099999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.72399999999999998,"5min":0.85099999999999998,"15min":0.97099999999999997},"last":0.433}]},{"osd":3,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.63600000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58799999999999997},"min":{"1min":0.46300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.66500000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94199999999999995,"5min":1.663,"15min":1.663},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.61099999999999999,"5min":0.54900000000000004,"15min":0.51600000000000001},"max":{"1min":0.94899999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.66000000000000003,"5min":0.55900000000000005,"15min":0.51100000000000001},"max":{"1min":0.90900000000000003,"5min":1.337,"15min":1.337},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80700000000000005,"15min":0.82899999999999996},"min":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0189999999999999,"5min":1.228,"15min":1.2829999999999999},"last":0.871}]},{"osd":6,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80500000000000005,"15min":0.81299999999999994},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.996,"5min":1.367,"15min":1.367},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81200000000000006,"15min":0.82999999999999996},"min":{"1min":0.65300000000000002,"5min":0.59999999999999998,"15min":0.56100000000000005},"max":{"1min":0.96499999999999997,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jul 6 22:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.98099999999999998,"5min":1.407,"15min":1.407},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82099999999999995,"15min":0.83999999999999997},"min":{"1min":0.67200000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.024,"5min":1.296,"15min":1.296},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575310,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59752,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312088,"statfs":{"total":96636764160,"available":96575578112,"internally_reserved":0,"allocated":2523136,"data_stored":1358054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.316,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.72599999999999998,"5min":1.645,"15min":1.645},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.72299999999999998,"5min":0.90700000000000003,"15min":0.94299999999999995},"last":0.372},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.41999999999999998,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.68799999999999994,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.502,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.81699999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79600000000000004,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74299999999999999,"15min":0.77600000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96999999999999997,"5min":1.083,"15min":1.1140000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78700000000000003,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.51700000000000002},"max":{"1min":0.92700000000000005,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.48699999999999999},"max":{"1min":1.012,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79800000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96399999999999997,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95399999999999996,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.56100000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94299999999999995,"5min":1.25,"15min":1.3360000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81399999999999995,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.56100000000000005},"max":{"1min":0.99199999999999999,"5min":1.155,"15min":1.405},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.61199999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98199999999999998,"5min":1.788,"15min":1.788},"last":0.67600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575310,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38184,"kb_used_data":3040,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333656,"statfs":{"total":96636764160,"available":96597663744,"internally_reserved":0,"allocated":3112960,"data_stored":1947403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.434,"15min":0.46000000000000002},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54200000000000004,"5min":0.745,"15min":0.745},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.312},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.1319999999999999},"last":0.497}]},{"osd":2,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.39600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":1.1599999999999999},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.89200000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.40999999999999998},"max":{"1min":0.71699999999999997,"5min":0.77100000000000002,"15min":0.95399999999999996},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77000000000000002,"15min":0.79600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96299999999999997,"5min":1.1439999999999999,"15min":1.294},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90800000000000003,"5min":1.1000000000000001,"15min":1.3320000000000001},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.0569999999999999,"15min":1.345},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.76300000000000001,"15min":0.79600000000000004},"min":{"1min":0.57499999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.56000000000000005,"5min":0.498,"15min":0.47699999999999998},"max":{"1min":0.96699999999999997,"5min":1.0569999999999999,"15min":1.153},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99199999999999999,"5min":1.0840000000000001,"15min":1.272},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.52100000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.26},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55700000000000005},"max":{"1min":0.97699999999999998,"5min":1.1220000000000001,"15min":1.2350000000000001},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:21:05.429 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-06T21:41:58.149280+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=21, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=22, tm_min=20, tm_sec=59, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T22:21:05.430 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-06T21:42:04.387613+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=21, tm_min=42, tm_sec=4, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=22, tm_min=20, tm_sec=59, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T22:21:05.430 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-06T21:42:04.387613+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=21, tm_min=42, tm_sec=4, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=22, tm_min=20, tm_sec=59, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T22:21:05.430 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-06T21:42:04.387613+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=21, tm_min=42, tm_sec=4, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=22, tm_min=20, tm_sec=59, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T22:21:05.430 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-07-06T21:42:04.387613+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=21, tm_min=42, tm_sec=4, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=22, tm_min=20, tm_sec=59, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T22:21:05.431 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-07-06T21:42:04.387613+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=21, tm_min=42, tm_sec=4, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=22, tm_min=20, tm_sec=59, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T22:21:05.431 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-07-06T21:42:04.387613+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=21, tm_min=42, tm_sec=4, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=22, tm_min=20, tm_sec=59, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T22:21:05.431 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-07-06T21:42:04.387613+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=21, tm_min=42, tm_sec=4, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=22, tm_min=20, tm_sec=59, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T22:21:05.431 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-06T22:21:12.074 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:21:12.078 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:21:25.432 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T22:21:25.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.582+0000 7fde559ad640 1 Processor -- start 2023-07-06T22:21:25.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.582+0000 7fde559ad640 1 -- start start 2023-07-06T22:21:25.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde559ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde50158400 0x7fde500c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde559ad640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fde500c9680 0x7fde50070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde559ad640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5006fae0 con 0x7fde500710c0 2023-07-06T22:21:25.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde559ad640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5006fdc0 con 0x7fde500c9680 2023-07-06T22:21:25.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde559ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde500700a0 con 0x7fde50158400 2023-07-06T22:21:25.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fde500710c0 0x7fde500cbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33356/0 (socket says 172.21.15.55:33356) 2023-07-06T22:21:25.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4f7fe640 1 -- 172.21.15.55:0/2649024734 learned_addr learned my addr 172.21.15.55:0/2649024734 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-07-06T22:21:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4effd640 1 --2- 172.21.15.55:0/2649024734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde50158400 0x7fde500c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4e7fc640 1 --2- 172.21.15.55:0/2649024734 >> v2:172.21.15.138:3300/0 conn(0x7fde500c9680 0x7fde50070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 -- 172.21.15.55:0/2649024734 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701008540 0 0) 0x7fde5006fae0 con 0x7fde500710c0 2023-07-06T22:21:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 -- 172.21.15.55:0/2649024734 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde38003530 con 0x7fde500710c0 2023-07-06T22:21:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 -- 172.21.15.55:0/2649024734 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3015618112 0 0) 0x7fde38003530 con 0x7fde500710c0 2023-07-06T22:21:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 -- 172.21.15.55:0/2649024734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde50158400 msgr2=0x7fde500c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 --2- 172.21.15.55:0/2649024734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde50158400 0x7fde500c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 -- 172.21.15.55:0/2649024734 >> v2:172.21.15.138:3300/0 conn(0x7fde500c9680 msgr2=0x7fde50070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 --2- 172.21.15.55:0/2649024734 >> v2:172.21.15.138:3300/0 conn(0x7fde500c9680 0x7fde50070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 -- 172.21.15.55:0/2649024734 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50070380 con 0x7fde500710c0 2023-07-06T22:21:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 -- 172.21.15.55:0/2649024734 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471458309 0 0) 0x7fde48001a00 con 0x7fde500710c0 2023-07-06T22:21:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 -- 172.21.15.55:0/2649024734 >> v1:172.21.15.55:6789/0 conn(0x7fde500710c0 legacy=0x7fde500cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 --2- 172.21.15.55:0/2649024734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde38003980 0x7fde38003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 --2- 172.21.15.55:0/2649024734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde380043b0 0x7fde38004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 --2- 172.21.15.55:0/2649024734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde50158400 0x7fde38004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 -- 172.21.15.55:0/2649024734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5006fdc0 con 0x7fde38003980 2023-07-06T22:21:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 -- 172.21.15.55:0/2649024734 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde500700a0 con 0x7fde380043b0 2023-07-06T22:21:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4dffb640 1 -- 172.21.15.55:0/2649024734 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3800dba0 con 0x7fde50158400 2023-07-06T22:21:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4effd640 1 --2- 172.21.15.55:0/2649024734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde38003980 0x7fde38003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4e7fc640 1 --2- 172.21.15.55:0/2649024734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde380043b0 0x7fde38004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4f7fe640 1 --2- 172.21.15.55:0/2649024734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde50158400 0x7fde38004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4effd640 1 -- 172.21.15.55:0/2649024734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde50158400 msgr2=0x7fde38004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:25.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4effd640 1 --2- 172.21.15.55:0/2649024734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde50158400 0x7fde38004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4effd640 1 -- 172.21.15.55:0/2649024734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde380043b0 msgr2=0x7fde38004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:25.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4effd640 1 --2- 172.21.15.55:0/2649024734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde380043b0 0x7fde38004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.586+0000 7fde4effd640 1 -- 172.21.15.55:0/2649024734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde38003530 con 0x7fde38003980 2023-07-06T22:21:25.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.590+0000 7fde4effd640 1 --2- 172.21.15.55:0/2649024734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde38003980 0x7fde38003d90 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7fde40009ae0 tx=0x7fde4001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd74b15a1a96c9a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:25.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.590+0000 7fde4dffb640 1 -- 172.21.15.55:0/2649024734 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400a5610 con 0x7fde38003980 2023-07-06T22:21:25.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.590+0000 7fde4dffb640 1 -- 172.21.15.55:0/2649024734 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde400a5770 con 0x7fde38003980 2023-07-06T22:21:25.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.590+0000 7fde4dffb640 1 -- 172.21.15.55:0/2649024734 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400a5b20 con 0x7fde38003980 2023-07-06T22:21:25.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.590+0000 7fde559ad640 1 -- 172.21.15.55:0/2649024734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde38003980 msgr2=0x7fde38003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:25.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.590+0000 7fde559ad640 1 --2- 172.21.15.55:0/2649024734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde38003980 0x7fde38003d90 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7fde40009ae0 tx=0x7fde4001ca20 comp rx=0 tx=0).stop 2023-07-06T22:21:25.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.590+0000 7fde4f7fe640 1 -- 172.21.15.55:0/2649024734 reap_dead start 2023-07-06T22:21:25.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.590+0000 7fde559ad640 1 -- 172.21.15.55:0/2649024734 shutdown_connections 2023-07-06T22:21:25.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.590+0000 7fde559ad640 1 -- 172.21.15.55:0/2649024734 >> 172.21.15.55:0/2649024734 conn(0x7fde500cded0 msgr2=0x7fde500ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:25.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.590+0000 7fde559ad640 1 -- 172.21.15.55:0/2649024734 shutdown_connections 2023-07-06T22:21:25.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.590+0000 7fde559ad640 1 -- 172.21.15.55:0/2649024734 wait complete. 2023-07-06T22:21:25.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde559ad640 1 Processor -- start 2023-07-06T22:21:25.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde559ad640 1 -- start start 2023-07-06T22:21:25.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde559ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde38003980 0x7fde500a8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde559ad640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde50156fa0 0x7fde50156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde559ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde500a7460 0x7fde500ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde559ad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde500a7cb0 con 0x7fde38003980 2023-07-06T22:21:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde559ad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde500a7f90 con 0x7fde500a7460 2023-07-06T22:21:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde559ad640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde500a8270 con 0x7fde50156fa0 2023-07-06T22:21:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde4effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde38003980 0x7fde500a8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde4effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde38003980 0x7fde500a8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33586/0 (socket says 172.21.15.55:33586) 2023-07-06T22:21:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde4effd640 1 -- 172.21.15.55:0/3241082850 learned_addr learned my addr 172.21.15.55:0/3241082850 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde4effd640 1 -- 172.21.15.55:0/3241082850 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde50156fa0 msgr2=0x7fde50156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde4effd640 1 --2- 172.21.15.55:0/3241082850 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde50156fa0 0x7fde50156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde4effd640 1 -- 172.21.15.55:0/3241082850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde500a7460 msgr2=0x7fde500ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:25.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde4effd640 1 --2- 172.21.15.55:0/3241082850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde500a7460 0x7fde500ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde4effd640 1 -- 172.21.15.55:0/3241082850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500a8550 con 0x7fde38003980 2023-07-06T22:21:25.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde4effd640 1 --2- 172.21.15.55:0/3241082850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde38003980 0x7fde500a8d50 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7fde400b0040 tx=0x7fde38005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:25.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde37fff640 1 -- 172.21.15.55:0/3241082850 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400a5e60 con 0x7fde38003980 2023-07-06T22:21:25.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde37fff640 1 -- 172.21.15.55:0/3241082850 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40004020 con 0x7fde38003980 2023-07-06T22:21:25.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde559ad640 1 -- 172.21.15.55:0/3241082850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde500a8830 con 0x7fde38003980 2023-07-06T22:21:25.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde37fff640 1 -- 172.21.15.55:0/3241082850 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400043b0 con 0x7fde38003980 2023-07-06T22:21:25.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.594+0000 7fde559ad640 1 -- 172.21.15.55:0/3241082850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde500a78d0 con 0x7fde38003980 2023-07-06T22:21:25.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.598+0000 7fde559ad640 1 -- 172.21.15.55:0/3241082850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5006c580 con 0x7fde38003980 2023-07-06T22:21:25.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.598+0000 7fde37fff640 1 -- 172.21.15.55:0/3241082850 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fde400b4040 con 0x7fde38003980 2023-07-06T22:21:25.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.598+0000 7fde37fff640 1 --2- 172.21.15.55:0/3241082850 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fde3c0663a0 0x7fde3c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.598+0000 7fde37fff640 1 -- 172.21.15.55:0/3241082850 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7fde4011e3c0 con 0x7fde38003980 2023-07-06T22:21:25.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.598+0000 7fde4e7fc640 1 --2- 172.21.15.55:0/3241082850 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fde3c0663a0 0x7fde3c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:25.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.598+0000 7fde4e7fc640 1 --2- 172.21.15.55:0/3241082850 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fde3c0663a0 0x7fde3c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fde44006b20 tx=0x7fde44006ab0 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:25.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.602+0000 7fde37fff640 1 -- 172.21.15.55:0/3241082850 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde400eb7b0 con 0x7fde38003980 2023-07-06T22:21:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.754+0000 7fde559ad640 1 -- 172.21.15.55:0/3241082850 --> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde500c9140 con 0x7fde3c0663a0 2023-07-06T22:21:25.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.758+0000 7fde37fff640 1 -- 172.21.15.55:0/3241082850 <== mgr.11301 v2:172.21.15.55:6832/3094866364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73057 (secure 0 0 0) 0x7fde44011890 con 0x7fde3c0663a0 2023-07-06T22:21:25.761 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:21:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-07-06T22:21:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.758+0000 7fde559ad640 1 -- 172.21.15.55:0/3241082850 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fde3c0663a0 msgr2=0x7fde3c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.758+0000 7fde559ad640 1 --2- 172.21.15.55:0/3241082850 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fde3c0663a0 0x7fde3c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fde44006b20 tx=0x7fde44006ab0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.758+0000 7fde559ad640 1 -- 172.21.15.55:0/3241082850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde38003980 msgr2=0x7fde500a8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.758+0000 7fde559ad640 1 --2- 172.21.15.55:0/3241082850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde38003980 0x7fde500a8d50 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7fde400b0040 tx=0x7fde38005800 comp rx=0 tx=0).stop 2023-07-06T22:21:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.758+0000 7fde559ad640 1 -- 172.21.15.55:0/3241082850 shutdown_connections 2023-07-06T22:21:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.758+0000 7fde559ad640 1 --2- 172.21.15.55:0/3241082850 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7fde3c0663a0 0x7fde3c068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.758+0000 7fde559ad640 1 --2- 172.21.15.55:0/3241082850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fde500a7460 0x7fde500ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.758+0000 7fde559ad640 1 --2- 172.21.15.55:0/3241082850 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fde50156fa0 0x7fde50156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.758+0000 7fde559ad640 1 --2- 172.21.15.55:0/3241082850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde38003980 0x7fde500a8d50 unknown :-1 s=CLOSED pgs=2407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.758+0000 7fde559ad640 1 -- 172.21.15.55:0/3241082850 >> 172.21.15.55:0/3241082850 conn(0x7fde500cded0 msgr2=0x7fde500cab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.758+0000 7fde559ad640 1 -- 172.21.15.55:0/3241082850 shutdown_connections 2023-07-06T22:21:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.758+0000 7fde559ad640 1 -- 172.21.15.55:0/3241082850 wait complete. 2023-07-06T22:21:25.782 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-06T22:21:24.322311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":386496,"kb_used_data":20864,"kb_used_omap":0,"kb_used_meta":365568,"kb_avail":754588224,"statfs":{"total":773094113280,"available":772698341376,"internally_reserved":0,"allocated":21364736,"data_stored":12043130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":374341632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002768"},"pg_stats":[{"pgid":"1.0","version":"201'349","reported_seq":1363,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:21:11.601903+0000","last_change":"2023-07-06T22:21:11.601954+0000","last_active":"2023-07-06T22:21:11.601903+0000","last_peered":"2023-07-06T22:21:11.601903+0000","last_clean":"2023-07-06T22:21:11.601903+0000","last_became_active":"2023-07-06T21:41:59.447922+0000","last_became_peered":"2023-07-06T21:41:59.447922+0000","last_unstale":"2023-07-06T22:21:11.601903+0000","last_undegraded":"2023-07-06T22:21:11.601903+0000","last_fullsized":"2023-07-06T22:21:11.601903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'349","last_scrub_stamp":"2023-07-06T22:21:11.601820+0000","last_deep_scrub":"201'349","last_deep_scrub_stamp":"2023-07-06T22:21:11.601820+0000","last_clean_scrub_stamp":"2023-07-06T22:21:11.601820+0000","objects_scrubbed":2,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:05:58.540596+0000","scrub_duration":0.0077620390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":336,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:21:06.248422+0000","last_change":"2023-07-06T22:21:06.248473+0000","last_active":"2023-07-06T22:21:06.248422+0000","last_peered":"2023-07-06T22:21:06.248422+0000","last_clean":"2023-07-06T22:21:06.248422+0000","last_became_active":"2023-07-06T21:42:05.415471+0000","last_became_peered":"2023-07-06T21:42:05.415471+0000","last_unstale":"2023-07-06T22:21:06.248422+0000","last_undegraded":"2023-07-06T22:21:06.248422+0000","last_fullsized":"2023-07-06T22:21:06.248422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:21:06.248327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:21:06.248327+0000","last_clean_scrub_stamp":"2023-07-06T22:21:06.248327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:33:02.235465+0000","scrub_duration":0.0040020280000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":387,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:21:14.598015+0000","last_change":"2023-07-06T22:21:14.598085+0000","last_active":"2023-07-06T22:21:14.598015+0000","last_peered":"2023-07-06T22:21:14.598015+0000","last_clean":"2023-07-06T22:21:14.598015+0000","last_became_active":"2023-07-06T21:42:05.416428+0000","last_became_peered":"2023-07-06T21:42:05.416428+0000","last_unstale":"2023-07-06T22:21:14.598015+0000","last_undegraded":"2023-07-06T22:21:14.598015+0000","last_fullsized":"2023-07-06T22:21:14.598015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:21:14.597906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:21:14.597906+0000","last_clean_scrub_stamp":"2023-07-06T22:21:14.597906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:43:51.911511+0000","scrub_duration":0.0040321250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":383,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:21:03.335626+0000","last_change":"2023-07-06T22:21:03.335626+0000","last_active":"2023-07-06T22:21:03.335626+0000","last_peered":"2023-07-06T22:21:03.335626+0000","last_clean":"2023-07-06T22:21:03.335626+0000","last_became_active":"2023-07-06T21:42:05.839148+0000","last_became_peered":"2023-07-06T21:42:05.839148+0000","last_unstale":"2023-07-06T22:21:03.335626+0000","last_undegraded":"2023-07-06T22:21:03.335626+0000","last_fullsized":"2023-07-06T22:21:03.335626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:21:03.335491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:21:03.335491+0000","last_clean_scrub_stamp":"2023-07-06T22:21:03.335491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:43:38.690116+0000","scrub_duration":0.003412984,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":336,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:21:09.276996+0000","last_change":"2023-07-06T22:21:09.277065+0000","last_active":"2023-07-06T22:21:09.276996+0000","last_peered":"2023-07-06T22:21:09.276996+0000","last_clean":"2023-07-06T22:21:09.276996+0000","last_became_active":"2023-07-06T21:42:05.416162+0000","last_became_peered":"2023-07-06T21:42:05.416162+0000","last_unstale":"2023-07-06T22:21:09.276996+0000","last_undegraded":"2023-07-06T22:21:09.276996+0000","last_fullsized":"2023-07-06T22:21:09.276996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:21:09.276899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:21:09.276899+0000","last_clean_scrub_stamp":"2023-07-06T22:21:09.276899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:32:58.508290+0000","scrub_duration":0.0038035870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":340,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:21:05.201740+0000","last_change":"2023-07-06T22:21:05.201779+0000","last_active":"2023-07-06T22:21:05.201740+0000","last_peered":"2023-07-06T22:21:05.201740+0000","last_clean":"2023-07-06T22:21:05.201740+0000","last_became_active":"2023-07-06T21:42:05.847941+0000","last_became_peered":"2023-07-06T21:42:05.847941+0000","last_unstale":"2023-07-06T22:21:05.201740+0000","last_undegraded":"2023-07-06T22:21:05.201740+0000","last_fullsized":"2023-07-06T22:21:05.201740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:21:05.201668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:21:05.201668+0000","last_clean_scrub_stamp":"2023-07-06T22:21:05.201668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:06:21.645929+0000","scrub_duration":0.0028369670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":386,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:21:15.588315+0000","last_change":"2023-07-06T22:21:15.588363+0000","last_active":"2023-07-06T22:21:15.588315+0000","last_peered":"2023-07-06T22:21:15.588315+0000","last_clean":"2023-07-06T22:21:15.588315+0000","last_became_active":"2023-07-06T21:42:05.849361+0000","last_became_peered":"2023-07-06T21:42:05.849361+0000","last_unstale":"2023-07-06T22:21:15.588315+0000","last_undegraded":"2023-07-06T22:21:15.588315+0000","last_fullsized":"2023-07-06T22:21:15.588315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:21:15.588193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:21:15.588193+0000","last_clean_scrub_stamp":"2023-07-06T22:21:15.588193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:11:54.346742+0000","scrub_duration":0.0044799710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":340,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:21:02.224524+0000","last_change":"2023-07-06T22:21:02.224583+0000","last_active":"2023-07-06T22:21:02.224524+0000","last_peered":"2023-07-06T22:21:02.224524+0000","last_clean":"2023-07-06T22:21:02.224524+0000","last_became_active":"2023-07-06T21:42:05.414738+0000","last_became_peered":"2023-07-06T21:42:05.414738+0000","last_unstale":"2023-07-06T22:21:02.224524+0000","last_undegraded":"2023-07-06T22:21:02.224524+0000","last_fullsized":"2023-07-06T22:21:02.224524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:21:02.224406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:21:02.224406+0000","last_clean_scrub_stamp":"2023-07-06T22:21:02.224406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T08:22:58.587247+0000","scrub_duration":0.0040645569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":334,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-06T22:21:05.091236+0000","last_change":"2023-07-06T22:21:05.091236+0000","last_active":"2023-07-06T22:21:05.091236+0000","last_peered":"2023-07-06T22:21:05.091236+0000","last_clean":"2023-07-06T22:21:05.091236+0000","last_became_active":"2023-07-06T21:42:05.415420+0000","last_became_peered":"2023-07-06T21:42:05.415420+0000","last_unstale":"2023-07-06T22:21:05.091236+0000","last_undegraded":"2023-07-06T22:21:05.091236+0000","last_fullsized":"2023-07-06T22:21:05.091236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T22:21:05.091069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T22:21:05.091069+0000","last_clean_scrub_stamp":"2023-07-06T22:21:05.091069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:55:00.082853+0000","scrub_duration":0.0035482510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575314,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42284,"kb_used_data":3044,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329556,"statfs":{"total":96636764160,"available":96593465344,"internally_reserved":0,"allocated":3117056,"data_stored":1948422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.50800000000000001,"5min":0.47399999999999998,"15min":0.432},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70299999999999996,"15min":0.70599999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.113,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jul 6 22:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.69899999999999995,"15min":0.71399999999999997},"min":{"1min":0.45800000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89500000000000002,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.51400000000000001,"5min":0.48299999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu Jul 6 22:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.47499999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.831,"5min":2.145,"15min":2.145},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.70699999999999996,"15min":0.72899999999999998},"min":{"1min":0.53400000000000003,"5min":0.47299999999999998,"15min":0.46899999999999997},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jul 6 22:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.46000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.8759999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.82199999999999995,"15min":0.77700000000000002},"min":{"1min":0.495,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92200000000000004,"5min":9.8279999999999994,"15min":9.8279999999999994},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.377,"15min":0.36799999999999999},"max":{"1min":0.83199999999999996,"5min":1.486,"15min":1.486},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.75900000000000001,"15min":0.63600000000000001},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":2.3420000000000001,"5min":13.443,"15min":13.443},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jul 6 22:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.60999999999999999,"15min":0.59599999999999997},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.38500000000000001},"max":{"1min":0.86099999999999999,"5min":1.97,"15min":1.97},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.41699999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86399999999999999,"5min":1.417,"15min":1.417},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jul 6 22:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72399999999999998,"15min":0.70999999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.47199999999999998},"max":{"1min":0.89900000000000002,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70599999999999996,"15min":0.67900000000000005},"min":{"1min":0.46600000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.9219999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.45400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575314,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37604,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334236,"statfs":{"total":96636764160,"available":96598257664,"internally_reserved":0,"allocated":2519040,"data_stored":1357035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.42099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.92700000000000005,"5min":1.0329999999999999,"15min":1.7829999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69599999999999995,"15min":0.72999999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.633},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jul 6 22:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.71199999999999997,"15min":0.72999999999999998},"min":{"1min":0.47899999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":1.0660000000000001,"15min":1.9099999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70999999999999996,"15min":0.72799999999999998},"min":{"1min":0.46999999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93500000000000005,"5min":0.95299999999999996,"15min":0.97399999999999998},"last":0.88700000000000001}]},{"osd":2,"last update":"Thu Jul 6 22:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.68999999999999995,"15min":0.71799999999999997},"min":{"1min":0.505,"5min":0.434,"15min":0.434},"max":{"1min":0.84699999999999998,"5min":0.91100000000000003,"15min":2.0299999999999998},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.52000000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.96399999999999997,"5min":1,"15min":1},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Jul 6 22:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.746},"min":{"1min":0.53800000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90900000000000003,"5min":1.04,"15min":1.5920000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.73199999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81100000000000005,"5min":1.0069999999999999,"15min":1.996},"last":0.78400000000000003}]},{"osd":4,"last update":"Thu Jul 6 22:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56100000000000005,"15min":0.54800000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.36199999999999999},"max":{"1min":0.84999999999999998,"5min":1.024,"15min":1.024},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.41499999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.996},"last":0.75}]},{"osd":5,"last update":"Thu Jul 6 22:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59799999999999998,"15min":0.61099999999999999},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.77800000000000002,"5min":0.89900000000000002,"15min":0.98499999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69499999999999995,"15min":0.67900000000000005},"min":{"1min":0.49199999999999999,"5min":0.46899999999999997,"15min":0.42999999999999999},"max":{"1min":0.89600000000000002,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63300000000000001,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85699999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63800000000000001,"15min":0.624},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.84099999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575314,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59752,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312088,"statfs":{"total":96636764160,"available":96575578112,"internally_reserved":0,"allocated":2523136,"data_stored":1358054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.41799999999999998},"max":{"1min":0.85499999999999998,"5min":0.94599999999999995,"15min":0.99299999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88600000000000001,"5min":0.96199999999999997,"15min":0.995},"last":0.755}]},{"osd":1,"last update":"Thu Jul 6 22:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70999999999999996,"15min":0.73399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.43099999999999999},"max":{"1min":0.90600000000000003,"5min":0.96299999999999997,"15min":1.0249999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91700000000000004,"5min":1.006,"15min":1.3200000000000001},"last":0.73699999999999999}]},{"osd":2,"last update":"Thu Jul 6 22:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73799999999999999,"15min":0.75600000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.46300000000000002},"max":{"1min":0.88700000000000001,"5min":0.998,"15min":1.4299999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.74299999999999999,"15min":0.749},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93700000000000006,"5min":0.998,"15min":1.0409999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Thu Jul 6 22:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.46800000000000003},"max":{"1min":0.90900000000000003,"5min":0.996,"15min":1.5169999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.48899999999999999},"max":{"1min":0.94899999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.77600000000000002}]},{"osd":4,"last update":"Thu Jul 6 22:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61699999999999999,"15min":0.59199999999999997},"min":{"1min":0.41099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.2450000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63800000000000001,"15min":0.62},"min":{"1min":0.47099999999999997,"5min":0.41399999999999998,"15min":0.40999999999999998},"max":{"1min":0.92200000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jul 6 22:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65300000000000002,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.432,"15min":0.42299999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.65400000000000003},"min":{"1min":0.45900000000000002,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jul 6 22:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69799999999999995,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.42499999999999999},"max":{"1min":0.94999999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71099999999999997,"15min":0.69399999999999995},"min":{"1min":0.51300000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96799999999999997,"5min":1.026,"15min":1.026},"last":0.623}]}]},{"osd":4,"up_from":13,"seq":55834575313,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55656,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316184,"statfs":{"total":96636764160,"available":96579772416,"internally_reserved":0,"allocated":2523136,"data_stored":1358054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.72299999999999998,"15min":0.74199999999999999},"min":{"1min":0.46500000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Jul 6 22:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72999999999999998,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.47899999999999998,"15min":0.38300000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70099999999999996,"15min":0.72199999999999998},"min":{"1min":0.44400000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88800000000000001,"5min":0.99299999999999999,"15min":0.996},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jul 6 22:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72099999999999997,"15min":0.73999999999999999},"min":{"1min":0.498,"5min":0.49199999999999999,"15min":0.47799999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.502},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Jul 6 22:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72399999999999998,"15min":0.73499999999999999},"min":{"1min":0.54200000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.874,"5min":0.95299999999999996,"15min":0.98699999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.754,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jul 6 22:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61499999999999999,"15min":0.60099999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.006},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jul 6 22:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.67100000000000004,"15min":0.66300000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:21:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67000000000000004,"15min":0.66000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.69599999999999995,"15min":0.68600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.626}]}]},{"osd":3,"up_from":13,"seq":55834575314,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51560,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320280,"statfs":{"total":96636764160,"available":96583966720,"internally_reserved":0,"allocated":2523136,"data_stored":1358054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45900000000000002,"15min":0.46400000000000002},"min":{"1min":0.27300000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.60299999999999998,"5min":0.68100000000000005,"15min":0.85899999999999999},"last":0.498},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.623,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":0.83899999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.70099999999999996,"5min":0.88700000000000001,"15min":0.97999999999999998},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.875},"last":0.433},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34699999999999998},"max":{"1min":0.73699999999999999,"5min":0.80300000000000005,"15min":0.92400000000000004},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.77400000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.441},"max":{"1min":0.98799999999999999,"5min":1.0449999999999999,"15min":1.474},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.3859999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79300000000000004,"15min":0.80800000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.056,"5min":1.175,"15min":1.3740000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.081,"5min":1.081,"15min":1.2330000000000001},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.52200000000000002},"max":{"1min":0.97499999999999998,"5min":1.1399999999999999,"15min":1.3899999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.57299999999999995},"max":{"1min":1.028,"5min":1.1499999999999999,"15min":1.3220000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:20:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.56999999999999995},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.2210000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82299999999999995,"15min":0.82799999999999996},"min":{"1min":0.61499999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0629999999999999,"5min":1.244,"15min":1.3200000000000001},"last":0.73899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575314,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41704,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330136,"statfs":{"total":96636764160,"available":96594059264,"internally_reserved":0,"allocated":2523136,"data_stored":1358054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42899999999999999,"15min":0.45100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.57199999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69599999999999995,"5min":0.77000000000000002,"15min":0.78600000000000003},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jul 6 22:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.495,"15min":0.51800000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69999999999999996,"5min":0.74099999999999999,"15min":0.84099999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52700000000000002,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.373,"15min":0.373},"max":{"1min":0.75,"5min":0.85099999999999998,"15min":0.97099999999999997},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jul 6 22:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51100000000000001,"15min":0.51900000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.34499999999999997},"max":{"1min":0.72899999999999998,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.58699999999999997},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72899999999999998,"5min":0.79000000000000004,"15min":0.79400000000000004},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jul 6 22:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.78500000000000003,"15min":0.81200000000000006},"min":{"1min":0.52300000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98499999999999999,"5min":1.663,"15min":1.663},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75800000000000001,"15min":0.80200000000000005},"min":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.51600000000000001},"max":{"1min":0.92000000000000004,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.94999999999999996}]},{"osd":5,"last update":"Thu Jul 6 22:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.76300000000000001,"15min":0.80400000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.51100000000000001},"max":{"1min":0.89200000000000002,"5min":1.1990000000000001,"15min":1.337},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78600000000000003,"15min":0.82499999999999996},"min":{"1min":0.55800000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0389999999999999,"5min":1.1539999999999999,"15min":1.2829999999999999},"last":1.0109999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78200000000000003,"15min":0.81000000000000005},"min":{"1min":0.59499999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97699999999999998,"5min":1.1160000000000001,"15min":1.367},"last":0.997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79400000000000004,"15min":0.82599999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0589999999999999,"5min":1.0860000000000001,"15min":1.1759999999999999},"last":0.96699999999999997}]},{"osd":7,"last update":"Thu Jul 6 22:21:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.79600000000000004,"15min":0.83899999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0129999999999999,"5min":1.1000000000000001,"15min":1.407},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80300000000000005,"15min":0.83599999999999997},"min":{"1min":0.58499999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.95499999999999996,"5min":1.266,"15min":1.296},"last":1.0309999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575315,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59752,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312088,"statfs":{"total":96636764160,"available":96575578112,"internally_reserved":0,"allocated":2523136,"data_stored":1358054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 22:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45600000000000002,"15min":0.46300000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.63900000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":1.645,"15min":1.645},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Jul 6 22:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.47699999999999998,"15min":0.48799999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63100000000000001,"5min":0.90700000000000003,"15min":0.94299999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.5,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.35199999999999998},"max":{"1min":0.73099999999999998,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jul 6 22:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.38100000000000001},"max":{"1min":0.69899999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.372,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71799999999999997,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.67900000000000005}]},{"osd":4,"last update":"Thu Jul 6 22:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.71199999999999997,"15min":0.76500000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93000000000000005,"5min":1.083,"15min":1.1140000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.75900000000000001,"15min":0.80100000000000005},"min":{"1min":0.55400000000000005,"5min":0.52900000000000003,"15min":0.51700000000000002},"max":{"1min":0.99399999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.0820000000000001}]},{"osd":5,"last update":"Thu Jul 6 22:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76700000000000002,"15min":0.79800000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.48699999999999999},"max":{"1min":1.0329999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.76000000000000001,"15min":0.80800000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97299999999999998,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.0509999999999999}]},{"osd":6,"last update":"Thu Jul 6 22:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.53200000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0369999999999999,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.153},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76400000000000001,"15min":0.81200000000000006},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96399999999999997,"5min":1.25,"15min":1.3360000000000001},"last":1.024}]},{"osd":7,"last update":"Thu Jul 6 22:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.79500000000000004,"15min":0.81799999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.014,"5min":1.155,"15min":1.405},"last":1.032},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.80200000000000005,"15min":0.82999999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.788,"15min":1.788},"last":1.1160000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575314,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38184,"kb_used_data":3040,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333656,"statfs":{"total":96636764160,"available":96597663744,"internally_reserved":0,"allocated":3112960,"data_stored":1947403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.434,"15min":0.46000000000000002},"min":{"1min":0.28299999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54200000000000004,"5min":0.745,"15min":0.745},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.312},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.1319999999999999},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.39600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":1.1599999999999999},"last":0.75}]},{"osd":3,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.89200000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.40999999999999998},"max":{"1min":0.71699999999999997,"5min":0.77100000000000002,"15min":0.95399999999999996},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77000000000000002,"15min":0.79600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96299999999999997,"5min":1.1439999999999999,"15min":1.294},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90800000000000003,"5min":1.1000000000000001,"15min":1.3320000000000001},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":0.94799999999999995,"5min":1.0569999999999999,"15min":1.345},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.749,"5min":0.76300000000000001,"15min":0.79600000000000004},"min":{"1min":0.57499999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1,"5min":1.1200000000000001,"15min":1.2130000000000001},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.56000000000000005,"5min":0.498,"15min":0.47699999999999998},"max":{"1min":0.96699999999999997,"5min":1.0569999999999999,"15min":1.153},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99199999999999999,"5min":1.0840000000000001,"15min":1.272},"last":0.88800000000000001}]},{"osd":7,"last update":"Thu Jul 6 22:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.52100000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.26},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55700000000000005},"max":{"1min":0.97699999999999998,"5min":1.1220000000000001,"15min":1.2350000000000001},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T22:21:25.786 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-06T22:21:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.922+0000 7f0aef382640 1 Processor -- start 2023-07-06T22:21:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.922+0000 7f0aef382640 1 -- start start 2023-07-06T22:21:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.922+0000 7f0aef382640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0ae80c11a0 0x7f0ae80cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.922+0000 7f0aef382640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ae806eee0 0x7f0ae806f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.922+0000 7f0aef382640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ae806f8c0 0x7f0ae8163c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.922+0000 7f0aef382640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae81605f0 con 0x7f0ae806eee0 2023-07-06T22:21:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.922+0000 7f0aef382640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae806ce00 con 0x7f0ae80c11a0 2023-07-06T22:21:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.922+0000 7f0aef382640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80c4ca0 con 0x7f0ae806f8c0 2023-07-06T22:21:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0aec91d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ae806eee0 0x7f0ae806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0aec91d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ae806eee0 0x7f0ae806f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33592/0 (socket says 172.21.15.55:33592) 2023-07-06T22:21:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0aec91d640 1 -- 172.21.15.55:0/2987933234 learned_addr learned my addr 172.21.15.55:0/2987933234 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0aed11e640 1 --2- 172.21.15.55:0/2987933234 >> v2:172.21.15.138:3300/0 conn(0x7f0ae80c11a0 0x7f0ae80cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0aed91f640 1 --2- 172.21.15.55:0/2987933234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ae806f8c0 0x7f0ae8163c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0aec91d640 1 -- 172.21.15.55:0/2987933234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ae806f8c0 msgr2=0x7f0ae8163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0aec91d640 1 --2- 172.21.15.55:0/2987933234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ae806f8c0 0x7f0ae8163c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0aec91d640 1 -- 172.21.15.55:0/2987933234 >> v2:172.21.15.138:3300/0 conn(0x7f0ae80c11a0 msgr2=0x7f0ae80cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0aec91d640 1 --2- 172.21.15.55:0/2987933234 >> v2:172.21.15.138:3300/0 conn(0x7f0ae80c11a0 0x7f0ae80cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0aec91d640 1 -- 172.21.15.55:0/2987933234 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae80ccd70 con 0x7f0ae806eee0 2023-07-06T22:21:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0aed91f640 1 --2- 172.21.15.55:0/2987933234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ae806f8c0 0x7f0ae8163c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:21:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0aed11e640 1 --2- 172.21.15.55:0/2987933234 >> v2:172.21.15.138:3300/0 conn(0x7f0ae80c11a0 0x7f0ae80cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:21:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0aec91d640 1 --2- 172.21.15.55:0/2987933234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae806eee0 0x7f0ae806f380 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f0ae806d100 tx=0x7f0ad801c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b7b19f1f0015f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0adffff640 1 -- 172.21.15.55:0/2987933234 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80ab600 con 0x7f0ae806eee0 2023-07-06T22:21:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0adffff640 1 -- 172.21.15.55:0/2987933234 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad80a7050 con 0x7f0ae806eee0 2023-07-06T22:21:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.926+0000 7f0adffff640 1 -- 172.21.15.55:0/2987933234 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80ab980 con 0x7f0ae806eee0 2023-07-06T22:21:25.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 -- 172.21.15.55:0/2987933234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae806eee0 msgr2=0x7f0ae806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:25.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 --2- 172.21.15.55:0/2987933234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae806eee0 0x7f0ae806f380 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f0ae806d100 tx=0x7f0ad801c1b0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 -- 172.21.15.55:0/2987933234 shutdown_connections 2023-07-06T22:21:25.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 --2- 172.21.15.55:0/2987933234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ae806f8c0 0x7f0ae8163c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 --2- 172.21.15.55:0/2987933234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae806eee0 0x7f0ae806f380 unknown :-1 s=CLOSED pgs=2408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 --2- 172.21.15.55:0/2987933234 >> v2:172.21.15.138:3300/0 conn(0x7f0ae80c11a0 0x7f0ae80cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 -- 172.21.15.55:0/2987933234 >> 172.21.15.55:0/2987933234 conn(0x7f0ae80cea70 msgr2=0x7f0ae80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:25.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 -- 172.21.15.55:0/2987933234 shutdown_connections 2023-07-06T22:21:25.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 -- 172.21.15.55:0/2987933234 wait complete. 2023-07-06T22:21:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 Processor -- start 2023-07-06T22:21:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 -- start start 2023-07-06T22:21:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ae806eee0 0x7f0ae8159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ae806f8c0 0x7f0ae8160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae80c11a0 0x7f0ae8160e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae815a0a0 con 0x7f0ae80c11a0 2023-07-06T22:21:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae806a560 con 0x7f0ae806eee0 2023-07-06T22:21:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aef382640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8161510 con 0x7f0ae806f8c0 2023-07-06T22:21:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aed91f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae80c11a0 0x7f0ae8160e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aed91f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae80c11a0 0x7f0ae8160e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33608/0 (socket says 172.21.15.55:33608) 2023-07-06T22:21:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aed91f640 1 -- 172.21.15.55:0/1518274473 learned_addr learned my addr 172.21.15.55:0/1518274473 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aed11e640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ae806eee0 0x7f0ae8159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.930+0000 7f0aec91d640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ae806f8c0 0x7f0ae8160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0aed91f640 1 -- 172.21.15.55:0/1518274473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ae806f8c0 msgr2=0x7f0ae8160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:25.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0aed91f640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ae806f8c0 0x7f0ae8160940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0aed91f640 1 -- 172.21.15.55:0/1518274473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ae806eee0 msgr2=0x7f0ae8159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:25.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0aed91f640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ae806eee0 0x7f0ae8159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:25.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0aed91f640 1 -- 172.21.15.55:0/1518274473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad80094d0 con 0x7f0ae80c11a0 2023-07-06T22:21:25.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0aed11e640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ae806eee0 0x7f0ae8159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T22:21:25.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0aed91f640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae80c11a0 0x7f0ae8160e80 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0007e10 tx=0x7f0ae000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:25.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0addffb640 1 -- 172.21.15.55:0/1518274473 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0003ba0 con 0x7f0ae80c11a0 2023-07-06T22:21:25.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0addffb640 1 -- 172.21.15.55:0/1518274473 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae000f040 con 0x7f0ae80c11a0 2023-07-06T22:21:25.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0addffb640 1 -- 172.21.15.55:0/1518274473 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae000de80 con 0x7f0ae80c11a0 2023-07-06T22:21:25.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0aef382640 1 -- 172.21.15.55:0/1518274473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae81617f0 con 0x7f0ae80c11a0 2023-07-06T22:21:25.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0aef382640 1 -- 172.21.15.55:0/1518274473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae806a180 con 0x7f0ae80c11a0 2023-07-06T22:21:25.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0aef382640 1 -- 172.21.15.55:0/1518274473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae8066d60 con 0x7f0ae80c11a0 2023-07-06T22:21:25.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0addffb640 1 -- 172.21.15.55:0/1518274473 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0ae0004030 con 0x7f0ae80c11a0 2023-07-06T22:21:25.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0addffb640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f0acc0663d0 0x7f0acc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:25.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0addffb640 1 -- 172.21.15.55:0/1518274473 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f0ae00844b0 con 0x7f0ae80c11a0 2023-07-06T22:21:25.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.934+0000 7f0aed11e640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f0acc0663d0 0x7f0acc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:25.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.938+0000 7f0aed11e640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f0acc0663d0 0x7f0acc068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400b990 tx=0x7f0ae4008040 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:25.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:25.938+0000 7f0addffb640 1 -- 172.21.15.55:0/1518274473 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ae0051530 con 0x7f0ae80c11a0 2023-07-06T22:21:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.098+0000 7f0aef382640 1 -- 172.21.15.55:0/1518274473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f0ae81633d0 con 0x7f0ae80c11a0 2023-07-06T22:21:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.102+0000 7f0addffb640 1 -- 172.21.15.55:0/1518274473 <== mon.0 v2:172.21.15.55:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0ae0051530 con 0x7f0ae80c11a0 2023-07-06T22:21:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.102+0000 7f0addffb640 1 -- 172.21.15.55:0/1518274473 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v70)=0 v70) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0ae0054b50 con 0x7f0ae80c11a0 2023-07-06T22:21:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.106+0000 7f0aef382640 1 -- 172.21.15.55:0/1518274473 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f0acc0663d0 msgr2=0x7f0acc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.106+0000 7f0aef382640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f0acc0663d0 0x7f0acc068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400b990 tx=0x7f0ae4008040 comp rx=0 tx=0).stop 2023-07-06T22:21:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.106+0000 7f0aef382640 1 -- 172.21.15.55:0/1518274473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae80c11a0 msgr2=0x7f0ae8160e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.106+0000 7f0aef382640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae80c11a0 0x7f0ae8160e80 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0007e10 tx=0x7f0ae000d4a0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.106+0000 7f0aef382640 1 -- 172.21.15.55:0/1518274473 shutdown_connections 2023-07-06T22:21:26.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.106+0000 7f0aef382640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f0acc0663d0 0x7f0acc068880 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.106+0000 7f0aef382640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ae80c11a0 0x7f0ae8160e80 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.106+0000 7f0aef382640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ae806f8c0 0x7f0ae8160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.106+0000 7f0aef382640 1 --2- 172.21.15.55:0/1518274473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ae806eee0 0x7f0ae8159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.106+0000 7f0aef382640 1 -- 172.21.15.55:0/1518274473 >> 172.21.15.55:0/1518274473 conn(0x7f0ae80cea70 msgr2=0x7f0ae80c4060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:26.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.106+0000 7f0aef382640 1 -- 172.21.15.55:0/1518274473 shutdown_connections 2023-07-06T22:21:26.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.106+0000 7f0aef382640 1 -- 172.21.15.55:0/1518274473 wait complete. 2023-07-06T22:21:26.127 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T22:21:26.128 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T22:21:26.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32c520b640 1 Processor -- start 2023-07-06T22:21:26.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32c520b640 1 -- start start 2023-07-06T22:21:26.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32c520b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f32c015b9d0 0x7f32c00b2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:26.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32c520b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32c00ce5e0 0x7f32c00b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:26.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32c520b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c00cc770 con 0x7f32c00b40e0 2023-07-06T22:21:26.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32c520b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c00b4560 con 0x7f32c015b9d0 2023-07-06T22:21:26.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32c520b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00cc9c0 con 0x7f32c00ce5e0 2023-07-06T22:21:26.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32bf7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32c00ce5e0 0x7f32c00b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:26.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32bffff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f32c015b9d0 0x7f32c00b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:26.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32bf7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32c00ce5e0 0x7f32c00b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.55:32850/0 (socket says 172.21.15.55:32850) 2023-07-06T22:21:26.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32c4a0a640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f32c00b40e0 0x7f32c015f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.55:37680/0 (socket says 172.21.15.55:37680) 2023-07-06T22:21:26.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32bf7fe640 1 -- 172.21.15.55:0/740913683 learned_addr learned my addr 172.21.15.55:0/740913683 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:26.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32beffd640 1 -- 172.21.15.55:0/740913683 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858660890 0 0) 0x7f32c00cc770 con 0x7f32c00b40e0 2023-07-06T22:21:26.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32beffd640 1 -- 172.21.15.55:0/740913683 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32a8003530 con 0x7f32c00b40e0 2023-07-06T22:21:26.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32bf7fe640 1 -- 172.21.15.55:0/740913683 >> v2:172.21.15.138:3300/0 conn(0x7f32c015b9d0 msgr2=0x7f32c00b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T22:21:26.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32bf7fe640 1 --2- 172.21.15.55:0/740913683 >> v2:172.21.15.138:3300/0 conn(0x7f32c015b9d0 0x7f32c00b2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32bf7fe640 1 -- 172.21.15.55:0/740913683 >> v1:172.21.15.138:6789/0 conn(0x7f32c00b40e0 legacy=0x7f32c015f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:26.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32bf7fe640 1 -- 172.21.15.55:0/740913683 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c00ccca0 con 0x7f32c00ce5e0 2023-07-06T22:21:26.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.270+0000 7f32bffff640 1 --2- 172.21.15.55:0/740913683 >> v2:172.21.15.138:3300/0 conn(0x7f32c015b9d0 0x7f32c00b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T22:21:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.274+0000 7f32bf7fe640 1 --2- 172.21.15.55:0/740913683 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32c00ce5e0 0x7f32c00b3ba0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009870 tx=0x7f32b401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85b82c33e5ddf97 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.274+0000 7f32beffd640 1 -- 172.21.15.55:0/740913683 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40aa680 con 0x7f32c00ce5e0 2023-07-06T22:21:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.274+0000 7f32beffd640 1 -- 172.21.15.55:0/740913683 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f32b40aa7e0 con 0x7f32c00ce5e0 2023-07-06T22:21:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.274+0000 7f32beffd640 1 -- 172.21.15.55:0/740913683 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40aab90 con 0x7f32c00ce5e0 2023-07-06T22:21:26.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.274+0000 7f32c520b640 1 -- 172.21.15.55:0/740913683 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32c00ce5e0 msgr2=0x7f32c00b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:26.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.274+0000 7f32c520b640 1 --2- 172.21.15.55:0/740913683 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32c00ce5e0 0x7f32c00b3ba0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009870 tx=0x7f32b401c540 comp rx=0 tx=0).stop 2023-07-06T22:21:26.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.274+0000 7f32c520b640 1 -- 172.21.15.55:0/740913683 shutdown_connections 2023-07-06T22:21:26.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.274+0000 7f32c520b640 1 --2- 172.21.15.55:0/740913683 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32c00ce5e0 0x7f32c00b3ba0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.274+0000 7f32c520b640 1 --2- 172.21.15.55:0/740913683 >> v2:172.21.15.138:3300/0 conn(0x7f32c015b9d0 0x7f32c00b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.274+0000 7f32c520b640 1 -- 172.21.15.55:0/740913683 >> 172.21.15.55:0/740913683 conn(0x7f32c006c2b0 msgr2=0x7f32c00ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:26.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.274+0000 7f32c520b640 1 -- 172.21.15.55:0/740913683 shutdown_connections 2023-07-06T22:21:26.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.274+0000 7f32c520b640 1 -- 172.21.15.55:0/740913683 wait complete. 2023-07-06T22:21:26.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c520b640 1 Processor -- start 2023-07-06T22:21:26.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c520b640 1 -- start start 2023-07-06T22:21:26.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c520b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c00b40e0 0x7f32c0150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:26.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c520b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32c00ce5e0 0x7f32c00b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:26.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c520b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32c015b9d0 0x7f32c00b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:26.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c520b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c015cc30 con 0x7f32c015b9d0 2023-07-06T22:21:26.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c520b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c015dcb0 con 0x7f32c00b40e0 2023-07-06T22:21:26.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c520b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c015e230 con 0x7f32c00ce5e0 2023-07-06T22:21:26.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c4a0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32c015b9d0 0x7f32c00b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:26.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c4a0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32c015b9d0 0x7f32c00b66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33624/0 (socket says 172.21.15.55:33624) 2023-07-06T22:21:26.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c4a0a640 1 -- 172.21.15.55:0/2875597709 learned_addr learned my addr 172.21.15.55:0/2875597709 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-07-06T22:21:26.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32bf7fe640 1 --2- 172.21.15.55:0/2875597709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32c00ce5e0 0x7f32c00b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:26.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32bffff640 1 --2- 172.21.15.55:0/2875597709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c00b40e0 0x7f32c0150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:26.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c4a0a640 1 -- 172.21.15.55:0/2875597709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32c00ce5e0 msgr2=0x7f32c00b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:26.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c4a0a640 1 --2- 172.21.15.55:0/2875597709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32c00ce5e0 0x7f32c00b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c4a0a640 1 -- 172.21.15.55:0/2875597709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c00b40e0 msgr2=0x7f32c0150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:26.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c4a0a640 1 --2- 172.21.15.55:0/2875597709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c00b40e0 0x7f32c0150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c4a0a640 1 -- 172.21.15.55:0/2875597709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0009420 con 0x7f32c015b9d0 2023-07-06T22:21:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c4a0a640 1 --2- 172.21.15.55:0/2875597709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32c015b9d0 0x7f32c00b66c0 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f32b800c7f0 tx=0x7f32b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32bcff9640 1 -- 172.21.15.55:0/2875597709 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b800a640 con 0x7f32c015b9d0 2023-07-06T22:21:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32bcff9640 1 -- 172.21.15.55:0/2875597709 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f32b800a7a0 con 0x7f32c015b9d0 2023-07-06T22:21:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32bcff9640 1 -- 172.21.15.55:0/2875597709 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b800ab30 con 0x7f32c015b9d0 2023-07-06T22:21:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c520b640 1 -- 172.21.15.55:0/2875597709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b40094d0 con 0x7f32c015b9d0 2023-07-06T22:21:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c520b640 1 -- 172.21.15.55:0/2875597709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c015ede0 con 0x7f32c015b9d0 2023-07-06T22:21:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.278+0000 7f32c520b640 1 -- 172.21.15.55:0/2875597709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c004d790 con 0x7f32c015b9d0 2023-07-06T22:21:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.282+0000 7f32bcff9640 1 -- 172.21.15.55:0/2875597709 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f32b800ac90 con 0x7f32c015b9d0 2023-07-06T22:21:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.282+0000 7f32bcff9640 1 --2- 172.21.15.55:0/2875597709 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f32ac0663a0 0x7f32ac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T22:21:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.282+0000 7f32bcff9640 1 -- 172.21.15.55:0/2875597709 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f32b80839b0 con 0x7f32c015b9d0 2023-07-06T22:21:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.282+0000 7f32bffff640 1 --2- 172.21.15.55:0/2875597709 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f32ac0663a0 0x7f32ac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T22:21:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.282+0000 7f32bffff640 1 --2- 172.21.15.55:0/2875597709 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f32ac0663a0 0x7f32ac068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f32c0070af0 tx=0x7f32b0009190 comp rx=0 tx=0).ready entity=mgr.11301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T22:21:26.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.286+0000 7f32bcff9640 1 -- 172.21.15.55:0/2875597709 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f32b8050b60 con 0x7f32c015b9d0 2023-07-06T22:21:26.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.474+0000 7f32c520b640 1 -- 172.21.15.55:0/2875597709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32c015e370 con 0x7f32c015b9d0 2023-07-06T22:21:26.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.474+0000 7f32bcff9640 1 -- 172.21.15.55:0/2875597709 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+3539 (secure 0 0 0) 0x7f32b8017020 con 0x7f32c015b9d0 2023-07-06T22:21:26.477 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-06T22:21:26.477 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":89,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10108,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6834/2023670167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2023670167},{"type":"v1","addr":"172.21.15.138:6834","nonce":2023670167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":10534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2939622121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6833","nonce":2939622121},{"type":"v1","addr":"172.21.15.138:6835","nonce":2939622121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89},{"gid":10989,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2906978966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2906978966},{"type":"v1","addr":"172.21.15.55:6836","nonce":2906978966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":10992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1643276481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1643276481},{"type":"v1","addr":"172.21.15.55:6837","nonce":1643276481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[]} 2023-07-06T22:21:26.477 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 89 2023-07-06T22:21:26.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.474+0000 7f32c520b640 1 -- 172.21.15.55:0/2875597709 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f32ac0663a0 msgr2=0x7f32ac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:26.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.474+0000 7f32c520b640 1 --2- 172.21.15.55:0/2875597709 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f32ac0663a0 0x7f32ac068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f32c0070af0 tx=0x7f32b0009190 comp rx=0 tx=0).stop 2023-07-06T22:21:26.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.474+0000 7f32c520b640 1 -- 172.21.15.55:0/2875597709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32c015b9d0 msgr2=0x7f32c00b66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T22:21:26.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.474+0000 7f32c520b640 1 --2- 172.21.15.55:0/2875597709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32c015b9d0 0x7f32c00b66c0 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f32b800c7f0 tx=0x7f32b800ccb0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.474+0000 7f32c520b640 1 -- 172.21.15.55:0/2875597709 shutdown_connections 2023-07-06T22:21:26.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.474+0000 7f32c520b640 1 --2- 172.21.15.55:0/2875597709 >> [v2:172.21.15.55:6832/3094866364,v1:172.21.15.55:6833/3094866364] conn(0x7f32ac0663a0 0x7f32ac068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.474+0000 7f32c520b640 1 --2- 172.21.15.55:0/2875597709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32c015b9d0 0x7f32c00b66c0 unknown :-1 s=CLOSED pgs=2410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.474+0000 7f32c520b640 1 --2- 172.21.15.55:0/2875597709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f32c00ce5e0 0x7f32c00b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.474+0000 7f32c520b640 1 --2- 172.21.15.55:0/2875597709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c00b40e0 0x7f32c0150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T22:21:26.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.474+0000 7f32c520b640 1 -- 172.21.15.55:0/2875597709 >> 172.21.15.55:0/2875597709 conn(0x7f32c006c2b0 msgr2=0x7f32c006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T22:21:26.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.474+0000 7f32c520b640 1 -- 172.21.15.55:0/2875597709 shutdown_connections 2023-07-06T22:21:26.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-07-06T22:21:26.474+0000 7f32c520b640 1 -- 172.21.15.55:0/2875597709 wait complete. 2023-07-06T22:21:26.498 DEBUG:tasks.cephfs.filesystem:already dead... 2023-07-06T22:21:26.499 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-06T22:21:26.499 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T22:21:26.499 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:26.511 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T22:21:26.512 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T22:21:26.512 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:26.567 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T22:21:26.567 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T22:21:26.567 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:26.582 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T22:21:26.582 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T22:21:26.583 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:26.641 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T22:21:26.641 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-06T22:21:26.642 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-06T22:21:26.642 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:26.723 INFO:tasks.ceph.osd.0:Stopped 2023-07-06T22:21:26.723 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-06T22:21:26.724 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:26.799 INFO:tasks.ceph.osd.1:Stopped 2023-07-06T22:21:26.800 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-06T22:21:26.800 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:32.901 INFO:tasks.ceph.osd.2:Stopped 2023-07-06T22:21:32.902 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-06T22:21:32.902 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:32.988 INFO:tasks.ceph.osd.3:Stopped 2023-07-06T22:21:32.988 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-06T22:21:32.988 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:33.084 INFO:tasks.ceph.osd.4:Stopped 2023-07-06T22:21:33.085 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-06T22:21:33.085 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:33.167 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-07-06T22:21:33.181 INFO:tasks.ceph.osd.5:Stopped 2023-07-06T22:21:33.182 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-06T22:21:33.182 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:33.283 INFO:tasks.ceph.osd.6:Stopped 2023-07-06T22:21:33.283 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-06T22:21:33.283 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:33.359 INFO:tasks.ceph.osd.7:Stopped 2023-07-06T22:21:33.359 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-06T22:21:33.360 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-06T22:21:33.360 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:33.425 INFO:tasks.ceph.mgr.y:Stopped 2023-07-06T22:21:33.425 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-06T22:21:33.425 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:33.479 INFO:tasks.ceph.mgr.x:Stopped 2023-07-06T22:21:33.479 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-06T22:21:33.479 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-06T22:21:33.480 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:33.504 INFO:tasks.ceph.mon.a:Stopped 2023-07-06T22:21:33.505 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-06T22:21:33.505 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:33.524 INFO:tasks.ceph.mon.b:Stopped 2023-07-06T22:21:33.524 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-06T22:21:33.525 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T22:21:33.585 INFO:tasks.ceph.mon.c:Stopped 2023-07-06T22:21:33.586 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-06T22:21:33.586 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-06T22:21:33.616 INFO:teuthology.orchestra.run.smithi055.stdout:2023-07-06T21:44:47.495505+0000 mon.a (mon.0) 521 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-07-06T22:21:33.616 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-07-06T22:21:33.617 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-06T22:21:33.692 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-06T22:21:33.768 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-06T22:21:33.844 INFO:teuthology.orchestra.run.smithi055.stdout:2023-07-06T21:44:47.495505+0000 mon.a (mon.0) 521 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-07-06T22:21:33.845 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T22:21:33.845 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-06T22:21:34.326 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T22:21:34.327 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-06T22:21:34.666 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T22:21:34.666 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-06T22:21:35.178 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T22:21:35.178 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-06T22:21:35.554 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi138.front.sepia.ceph.com 2023-07-06T22:21:35.554 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-06T22:21:36.029 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi138.front.sepia.ceph.com 2023-07-06T22:21:36.030 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-06T22:21:36.469 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi138.front.sepia.ceph.com 2023-07-06T22:21:36.470 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-06T22:21:36.805 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi138.front.sepia.ceph.com 2023-07-06T22:21:36.806 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-06T22:21:37.290 INFO:tasks.ceph:Archiving mon data... 2023-07-06T22:21:37.291 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249/data/mon.a.tgz 2023-07-06T22:21:37.292 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2023-07-06T22:21:37.301 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.4wv8a8ZGTu 2023-07-06T22:21:37.301 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4wv8a8ZGTu 2023-07-06T22:21:37.809 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.4wv8a8ZGTu 2023-07-06T22:21:37.899 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.4wv8a8ZGTu is 3MB 2023-07-06T22:21:37.987 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.4wv8a8ZGTu 2023-07-06T22:21:37.996 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249/data/mon.b.tgz 2023-07-06T22:21:37.996 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2023-07-06T22:21:38.005 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.4gPNPGVbuP 2023-07-06T22:21:38.006 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.4gPNPGVbuP 2023-07-06T22:21:38.168 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-07-06T22:21:38.532 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.4gPNPGVbuP 2023-07-06T22:21:38.610 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.4gPNPGVbuP is 3MB 2023-07-06T22:21:38.703 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.4gPNPGVbuP 2023-07-06T22:21:38.712 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249/data/mon.c.tgz 2023-07-06T22:21:38.712 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2023-07-06T22:21:38.762 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.mpc6z6iLCS 2023-07-06T22:21:38.762 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.mpc6z6iLCS 2023-07-06T22:21:39.288 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.mpc6z6iLCS 2023-07-06T22:21:39.362 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.mpc6z6iLCS is 3MB 2023-07-06T22:21:39.446 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.mpc6z6iLCS 2023-07-06T22:21:39.456 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-06T22:21:39.456 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-06T22:21:39.460 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-06T22:21:39.521 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-06T22:21:39.522 DEBUG:teuthology.orchestra.run.smithi055:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-06T22:21:39.526 DEBUG:teuthology.orchestra.run.smithi138:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-06T22:21:39.562 INFO:teuthology.orchestra.run.smithi055.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-06T22:21:39.595 INFO:teuthology.orchestra.run.smithi138.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-06T22:21:39.602 INFO:tasks.ceph:Archiving crash dumps... 2023-07-06T22:21:39.604 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249/remote/smithi055/crash 2023-07-06T22:21:39.605 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-06T22:21:39.637 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249/remote/smithi138/crash 2023-07-06T22:21:39.638 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-06T22:21:39.661 INFO:tasks.ceph:Shutting down logrotate 2023-07-06T22:21:39.661 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:21:39.685 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:21:39.757 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-06T22:21:39.779 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-06T22:21:39.798 INFO:tasks.ceph:Compressing logs... 2023-07-06T22:21:39.799 DEBUG:teuthology.orchestra.run.smithi055:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-06T22:21:39.825 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-06T22:21:39.855 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64401.log 2023-07-06T22:21:39.856 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43287.log 2023-07-06T22:21:39.857 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62002.log 2023-07-06T22:21:39.857 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64401.log.gz 2023-07-06T22:21:39.858 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69239.log 2023-07-06T22:21:39.858 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43287.log.gz 2023-07-06T22:21:39.859 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45222.log 2023-07-06T22:21:39.859 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62002.log.gz 2023-07-06T22:21:39.860 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72262.log 2023-07-06T22:21:39.860 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69239.log.gz 2023-07-06T22:21:39.861 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45222.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45222.log.gz 2023-07-06T22:21:39.861 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53095.log 2023-07-06T22:21:39.862 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72262.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72262.log.gz 2023-07-06T22:21:39.862 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72704.log 2023-07-06T22:21:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.53095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53095.log.gz 2023-07-06T22:21:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60486.log 2023-07-06T22:21:39.864 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43881.log 2023-07-06T22:21:39.865 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72704.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72704.log.gz 2023-07-06T22:21:39.865 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54786.log 2023-07-06T22:21:39.865 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-07-06T22:21:39.866 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60486.log: gzip 87.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.60486.log.gz 2023-07-06T22:21:39.866 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56456.log 2023-07-06T22:21:39.867 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54786.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54786.log.gz 2023-07-06T22:21:39.867 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50634.log 2023-07-06T22:21:39.867 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.3.43881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43881.log.gz 2023-07-06T22:21:39.868 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-07-06T22:21:39.868 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37590.log 2023-07-06T22:21:39.869 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37542.log 2023-07-06T22:21:39.869 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56456.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56456.log.gz 2023-07-06T22:21:39.869 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59013.log 2023-07-06T22:21:39.869 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50634.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50634.log.gz 2023-07-06T22:21:39.870 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55364.log 2023-07-06T22:21:39.871 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59013.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59013.log.gz 2023-07-06T22:21:39.871 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64546.log 2023-07-06T22:21:39.871 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.55364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55364.log.gz 2023-07-06T22:21:39.872 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58905.log 2023-07-06T22:21:39.872 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37710.log 2023-07-06T22:21:39.873 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37590.log.gz 2023-07-06T22:21:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37614.log 2023-07-06T22:21:39.873 INFO:teuthology.orchestra.run.smithi138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37542.log.gz 2023-07-06T22:21:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37710.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37710.log.gz 2023-07-06T22:21:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-07-06T22:21:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37614.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37614.log.gz 2023-07-06T22:21:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37686.log 2023-07-06T22:21:39.874 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37638.log 2023-07-06T22:21:39.875 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46964.log 2023-07-06T22:21:39.876 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64546.log.gz 2023-07-06T22:21:39.876 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58905.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58905.log.gz 2023-07-06T22:21:39.876 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43817.log 2023-07-06T22:21:39.876 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46964.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46964.log.gz 2023-07-06T22:21:39.876 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44996.log 2023-07-06T22:21:39.876 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43817.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43817.log.gz 2023-07-06T22:21:39.877 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50312.log 2023-07-06T22:21:39.878 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44996.log: gzip -5 --verbose -- 88.0% /var/log/ceph/ceph-client.admin.50606.log -- replaced with /var/log/ceph/ceph-client.admin.44996.log.gz 2023-07-06T22:21:39.878 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-07-06T22:21:39.878 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50312.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50312.log.gz 2023-07-06T22:21:39.878 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58462.log 2023-07-06T22:21:39.879 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37686.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37686.log.gz 2023-07-06T22:21:39.879 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43795.log 2023-07-06T22:21:39.879 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37638.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37638.log.gz 2023-07-06T22:21:39.879 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-07-06T22:21:39.880 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.1.43795.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-06T22:21:39.880 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43795.log.gz 2023-07-06T22:21:39.881 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-07-06T22:21:39.881 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-06T22:21:39.882 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69837.log 2023-07-06T22:21:39.882 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50606.log.gz 2023-07-06T22:21:39.882 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58462.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58462.log.gz 2023-07-06T22:21:39.882 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58235.log 2023-07-06T22:21:39.883 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69837.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69837.log.gz 2023-07-06T22:21:39.883 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45014.log 2023-07-06T22:21:39.883 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58235.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58235.log.gz 2023-07-06T22:21:39.883 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56229.log 2023-07-06T22:21:39.885 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45014.log: gzip 89.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.45014.log.gz 2023-07-06T22:21:39.885 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54343.log 2023-07-06T22:21:39.885 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56229.log: gzip -5 --verbose 89.5% -- -- replaced with /var/log/ceph/ceph-client.admin.56229.log.gz /var/log/ceph/ceph-mgr.y.log 2023-07-06T22:21:39.885 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-07-06T22:21:39.886 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-07-06T22:21:39.886 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-07-06T22:21:39.887 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54343.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54343.log.gz 2023-07-06T22:21:39.887 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57071.log 2023-07-06T22:21:39.887 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60096.log 2023-07-06T22:21:39.888 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57071.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57071.log.gz 2023-07-06T22:21:39.888 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58618.log 2023-07-06T22:21:39.889 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mds.d.log: 93.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-06T22:21:39.889 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69707.log 2023-07-06T22:21:39.889 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60096.log.gz 2023-07-06T22:21:39.890 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58618.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58618.log.gz 2023-07-06T22:21:39.890 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47606.log 2023-07-06T22:21:39.890 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-07-06T22:21:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69707.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69707.log.gz 2023-07-06T22:21:39.891 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54655.log 2023-07-06T22:21:39.892 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47606.log: gzip 87.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.47606.log.gz --verbose 2023-07-06T22:21:39.892 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.64493.log 2023-07-06T22:21:39.892 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54655.log: gzip -5 88.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.54655.log.gz 2023-07-06T22:21:39.893 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.59882.log 2023-07-06T22:21:39.893 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mds.b.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-06T22:21:39.894 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64493.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64493.log.gz 2023-07-06T22:21:39.894 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51460.log 2023-07-06T22:21:39.895 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59882.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59882.log.gz 2023-07-06T22:21:39.895 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61707.log 2023-07-06T22:21:39.895 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37566.log 2023-07-06T22:21:39.896 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51460.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.58853.log -- replaced with /var/log/ceph/ceph-client.admin.51460.log.gz 2023-07-06T22:21:39.896 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-07-06T22:21:39.897 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63120.log 2023-07-06T22:21:39.897 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61707.log.gz 2023-07-06T22:21:39.897 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58853.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58853.log.gzgzip 2023-07-06T22:21:39.898 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64792.log 2023-07-06T22:21:39.898 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63120.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.63120.log.gz 2023-07-06T22:21:39.898 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52817.log 2023-07-06T22:21:39.899 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64792.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64792.log.gz 2023-07-06T22:21:39.899 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52895.log 2023-07-06T22:21:39.900 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48079.log 2023-07-06T22:21:39.901 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52817.log.gz 2023-07-06T22:21:39.901 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52895.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52895.log.gz 2023-07-06T22:21:39.902 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49336.log 2023-07-06T22:21:39.902 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48079.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48079.log.gz 2023-07-06T22:21:39.903 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62092.log 2023-07-06T22:21:39.903 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49336.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49336.log.gz 2023-07-06T22:21:39.904 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59327.log 2023-07-06T22:21:39.905 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62092.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62092.log.gz 2023-07-06T22:21:39.905 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58417.log 2023-07-06T22:21:39.906 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59327.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59327.log.gz 2023-07-06T22:21:39.906 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45795.log 2023-07-06T22:21:39.907 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58417.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58417.log.gzgzip 2023-07-06T22:21:39.907 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.72782.log 2023-07-06T22:21:39.908 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66746.log 2023-07-06T22:21:39.908 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45795.log.gz 2023-07-06T22:21:39.909 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72782.log: gzip 89.6% -- replaced with /var/log/ceph/ceph-client.admin.72782.log.gz 2023-07-06T22:21:39.909 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.72080.log 2023-07-06T22:21:39.910 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66746.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66746.log.gz 2023-07-06T22:21:39.910 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61733.log 2023-07-06T22:21:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72080.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72080.log.gz 2023-07-06T22:21:39.911 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66972.log 2023-07-06T22:21:39.912 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61733.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61733.log.gz 2023-07-06T22:21:39.912 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46339.log 2023-07-06T22:21:39.913 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66972.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66972.log.gz 2023-07-06T22:21:39.913 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45431.log 2023-07-06T22:21:39.914 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46339.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46339.log.gz 2023-07-06T22:21:39.914 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69182.log 2023-07-06T22:21:39.915 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45431.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45431.log.gz 2023-07-06T22:21:39.917 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60161.log 2023-07-06T22:21:39.918 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-07-06T22:21:39.919 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69182.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69182.log.gz 2023-07-06T22:21:39.919 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55216.log 2023-07-06T22:21:39.919 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60161.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60161.log.gz 2023-07-06T22:21:39.920 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58514.log 2023-07-06T22:21:39.921 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55216.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55216.log.gz 2023-07-06T22:21:39.921 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57097.log 2023-07-06T22:21:39.921 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58514.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58514.log.gz 2023-07-06T22:21:39.922 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61309.log 2023-07-06T22:21:39.922 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57097.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57097.log.gz 2023-07-06T22:21:39.923 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46313.log 2023-07-06T22:21:39.924 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61309.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61309.log.gz 2023-07-06T22:21:39.924 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45002.log 2023-07-06T22:21:39.925 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46313.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46313.log.gz 2023-07-06T22:21:39.925 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44384.log 2023-07-06T22:21:39.926 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45002.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45002.log.gz 2023-07-06T22:21:39.926 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71506.log 2023-07-06T22:21:39.927 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.37566.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37566.log.gz 2023-07-06T22:21:39.927 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44384.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44384.log.gz 2023-07-06T22:21:39.928 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53964.log 2023-07-06T22:21:39.929 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71506.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.56281.log 2023-07-06T22:21:39.929 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71506.log.gz 2023-07-06T22:21:39.930 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53964.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53964.log.gz 2023-07-06T22:21:39.930 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60943.log 2023-07-06T22:21:39.931 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56281.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56281.log.gz 2023-07-06T22:21:39.931 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52551.log 2023-07-06T22:21:39.932 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60943.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60943.log.gz 2023-07-06T22:21:39.932 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56009.log 2023-07-06T22:21:39.933 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52551.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52551.log.gz 2023-07-06T22:21:39.933 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53242.log 2023-07-06T22:21:39.934 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56009.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56009.log.gz 2023-07-06T22:21:39.934 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71067.log 2023-07-06T22:21:39.936 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53242.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53242.log.gz 2023-07-06T22:21:39.936 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59119.log 2023-07-06T22:21:39.936 INFO:teuthology.orchestra.run.smithi138.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-07-06T22:21:39.937 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37662.log 2023-07-06T22:21:39.937 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71067.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71067.log.gz 2023-07-06T22:21:39.938 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50260.log 2023-07-06T22:21:39.938 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59119.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59119.log.gz 2023-07-06T22:21:39.938 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60852.log 2023-07-06T22:21:39.939 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50260.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50260.log.gz 2023-07-06T22:21:39.939 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61517.log 2023-07-06T22:21:39.940 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60852.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60852.log.gz 2023-07-06T22:21:39.940 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61139.log 2023-07-06T22:21:39.941 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61517.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61517.log.gz 2023-07-06T22:21:39.941 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-07-06T22:21:39.942 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61139.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61139.log.gz 2023-07-06T22:21:39.942 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60826.log 2023-07-06T22:21:39.943 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58041.log 2023-07-06T22:21:39.944 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60826.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60826.log.gz 2023-07-06T22:21:39.945 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64818.log 2023-07-06T22:21:39.946 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58041.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58041.log.gz 2023-07-06T22:21:39.946 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55838.log 2023-07-06T22:21:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64818.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64818.log.gz 2023-07-06T22:21:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70565.log 2023-07-06T22:21:39.948 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55838.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55838.log.gz 2023-07-06T22:21:39.948 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49591.log 2023-07-06T22:21:39.949 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70565.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70565.log.gz 2023-07-06T22:21:39.949 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43895.log 2023-07-06T22:21:39.950 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.37662.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37662.log.gz 2023-07-06T22:21:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47767.log 2023-07-06T22:21:39.951 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49591.log.gz 2023-07-06T22:21:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49900.log 2023-07-06T22:21:39.952 INFO:teuthology.orchestra.run.smithi055.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43895.log.gz 2023-07-06T22:21:39.953 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47767.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47767.log.gz 2023-07-06T22:21:39.953 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68142.log 2023-07-06T22:21:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49900.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49900.log.gz 2023-07-06T22:21:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47258.log 2023-07-06T22:21:39.955 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68142.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68142.log.gz 2023-07-06T22:21:39.955 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48860.log 2023-07-06T22:21:39.956 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47258.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47258.log.gz 2023-07-06T22:21:39.956 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66191.log 2023-07-06T22:21:39.957 INFO:teuthology.orchestra.run.smithi138.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-07-06T22:21:39.958 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48860.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48860.log.gz 2023-07-06T22:21:39.958 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54812.log 2023-07-06T22:21:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66191.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66191.log.gz 2023-07-06T22:21:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62905.log 2023-07-06T22:21:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54812.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54812.log.gz 2023-07-06T22:21:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69733.log 2023-07-06T22:21:39.961 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62905.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62905.log.gz 2023-07-06T22:21:39.961 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67890.log 2023-07-06T22:21:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69733.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69733.log.gz 2023-07-06T22:21:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54629.log 2023-07-06T22:21:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67890.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67890.log.gz 2023-07-06T22:21:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67720.log 2023-07-06T22:21:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54629.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54629.log.gz 2023-07-06T22:21:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69759.log 2023-07-06T22:21:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67720.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67720.log.gz 2023-07-06T22:21:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72496.log 2023-07-06T22:21:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69759.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69759.log.gz 2023-07-06T22:21:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50690.log 2023-07-06T22:21:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72496.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72496.log.gz 2023-07-06T22:21:39.968 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59145.log 2023-07-06T22:21:39.969 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50690.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50690.log.gz 2023-07-06T22:21:39.969 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65791.log 2023-07-06T22:21:39.970 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59145.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59145.log.gz 2023-07-06T22:21:39.970 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47632.log 2023-07-06T22:21:39.971 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65791.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65791.log.gz 2023-07-06T22:21:39.971 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55058.log 2023-07-06T22:21:39.972 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47632.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47632.log.gz 2023-07-06T22:21:39.973 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69265.log 2023-07-06T22:21:39.973 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55058.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55058.log.gz 2023-07-06T22:21:39.974 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72678.log 2023-07-06T22:21:39.974 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69265.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69265.log.gz 2023-07-06T22:21:39.975 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48990.log 2023-07-06T22:21:39.976 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72678.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72678.log.gz 2023-07-06T22:21:39.976 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57123.log 2023-07-06T22:21:39.977 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48990.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48990.log.gz 2023-07-06T22:21:39.977 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57573.log 2023-07-06T22:21:39.978 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57123.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57123.log.gz 2023-07-06T22:21:39.978 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70275.log 2023-07-06T22:21:39.979 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57573.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57573.log.gz 2023-07-06T22:21:39.979 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71428.log 2023-07-06T22:21:39.981 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70275.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70275.log.gz 2023-07-06T22:21:39.981 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70618.log 2023-07-06T22:21:39.981 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71428.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71428.log.gz 2023-07-06T22:21:39.982 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60214.log 2023-07-06T22:21:39.983 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70618.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70618.log.gz 2023-07-06T22:21:39.983 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65439.log 2023-07-06T22:21:39.984 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60214.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60214.log.gz 2023-07-06T22:21:39.984 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43657.log 2023-07-06T22:21:39.985 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65439.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65439.log.gz 2023-07-06T22:21:39.985 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43623.log 2023-07-06T22:21:39.986 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43657.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43657.log.gz 2023-07-06T22:21:39.987 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61465.log 2023-07-06T22:21:39.987 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51272.log 2023-07-06T22:21:39.988 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43623.log.gz 2023-07-06T22:21:39.989 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61465.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61465.log.gz 2023-07-06T22:21:39.989 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55380.log 2023-07-06T22:21:39.990 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51272.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51272.log.gz 2023-07-06T22:21:39.990 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68414.log 2023-07-06T22:21:39.991 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64897.log 2023-07-06T22:21:39.991 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55380.log.gz 2023-07-06T22:21:39.992 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68414.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68414.log.gz 2023-07-06T22:21:39.993 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69150.log 2023-07-06T22:21:39.994 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48834.log 2023-07-06T22:21:39.994 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64897.log.gz 2023-07-06T22:21:39.994 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69150.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69150.log.gz 2023-07-06T22:21:39.995 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72758.log 2023-07-06T22:21:39.996 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51980.log 2023-07-06T22:21:39.996 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48834.log.gz 2023-07-06T22:21:39.997 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72758.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72758.log.gz 2023-07-06T22:21:39.998 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55760.log 2023-07-06T22:21:39.998 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60644.log 2023-07-06T22:21:39.999 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51980.log.gz 2023-07-06T22:21:39.999 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55760.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55760.log.gz 2023-07-06T22:21:40.000 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51408.log 2023-07-06T22:21:40.001 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72418.log 2023-07-06T22:21:40.001 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60644.log.gz 2023-07-06T22:21:40.002 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51408.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51408.log.gz 2023-07-06T22:21:40.002 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60240.log 2023-07-06T22:21:40.003 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72418.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72418.log.gz 2023-07-06T22:21:40.004 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65176.log 2023-07-06T22:21:40.004 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60240.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60240.log.gz 2023-07-06T22:21:40.005 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43489.log 2023-07-06T22:21:40.006 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63902.log 2023-07-06T22:21:40.006 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65176.log.gz 2023-07-06T22:21:40.006 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43489.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43489.log.gz 2023-07-06T22:21:40.007 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62678.log 2023-07-06T22:21:40.008 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.63902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63902.log.gz 2023-07-06T22:21:40.008 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68008.log 2023-07-06T22:21:40.009 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62879.log 2023-07-06T22:21:40.010 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62678.log.gz 2023-07-06T22:21:40.011 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48560.log 2023-07-06T22:21:40.011 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68008.log.gz 2023-07-06T22:21:40.011 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62879.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62879.log.gz 2023-07-06T22:21:40.012 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62652.log 2023-07-06T22:21:40.013 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64020.log 2023-07-06T22:21:40.013 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48560.log.gz 2023-07-06T22:21:40.014 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62652.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62652.log.gz 2023-07-06T22:21:40.014 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50662.log 2023-07-06T22:21:40.015 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56822.log 2023-07-06T22:21:40.016 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64020.log.gz 2023-07-06T22:21:40.016 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50662.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50662.log.gz 2023-07-06T22:21:40.017 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68362.log 2023-07-06T22:21:40.018 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46235.log 2023-07-06T22:21:40.018 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56822.log.gz 2023-07-06T22:21:40.019 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68362.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68362.log.gz 2023-07-06T22:21:40.019 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53847.log 2023-07-06T22:21:40.020 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46235.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46235.log.gz 2023-07-06T22:21:40.020 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54499.log 2023-07-06T22:21:40.021 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53847.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53847.log.gz 2023-07-06T22:21:40.021 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66477.log 2023-07-06T22:21:40.022 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52633.log 2023-07-06T22:21:40.023 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54499.log.gz 2023-07-06T22:21:40.023 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66477.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66477.log.gz 2023-07-06T22:21:40.024 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54944.log 2023-07-06T22:21:40.025 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55006.log 2023-07-06T22:21:40.025 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52633.log.gz 2023-07-06T22:21:40.025 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54944.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54944.log.gz 2023-07-06T22:21:40.026 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67169.log 2023-07-06T22:21:40.027 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49954.log 2023-07-06T22:21:40.027 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55006.log.gz 2023-07-06T22:21:40.028 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67169.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67169.log.gz 2023-07-06T22:21:40.028 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54688.log 2023-07-06T22:21:40.029 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72236.log 2023-07-06T22:21:40.029 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49954.log.gz 2023-07-06T22:21:40.030 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54688.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54688.log.gz 2023-07-06T22:21:40.030 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37444.log 2023-07-06T22:21:40.031 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72236.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72236.log.gz 2023-07-06T22:21:40.032 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43843.log 2023-07-06T22:21:40.032 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.37444.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37444.log.gz 2023-07-06T22:21:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45561.log 2023-07-06T22:21:40.034 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56151.log 2023-07-06T22:21:40.034 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43843.log.gz 2023-07-06T22:21:40.035 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45561.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45561.log.gz 2023-07-06T22:21:40.035 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64994.log 2023-07-06T22:21:40.036 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49678.log 2023-07-06T22:21:40.037 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56151.log.gz 2023-07-06T22:21:40.037 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64994.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64994.log.gz 2023-07-06T22:21:40.038 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72548.log 2023-07-06T22:21:40.039 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65713.log 2023-07-06T22:21:40.039 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49678.log.gz 2023-07-06T22:21:40.040 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72548.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72548.log.gz 2023-07-06T22:21:40.040 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44798.log 2023-07-06T22:21:40.041 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70774.log 2023-07-06T22:21:40.041 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65713.log.gz 2023-07-06T22:21:40.042 INFO:teuthology.orchestra.run.smithi138.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-07-06T22:21:40.042 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44798.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44798.log.gz 2023-07-06T22:21:40.043 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56177.log 2023-07-06T22:21:40.043 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57359.log 2023-07-06T22:21:40.044 INFO:teuthology.orchestra.run.smithi055.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.70774.log.gz 2023-07-06T22:21:40.044 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56177.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56177.log.gz 2023-07-06T22:21:40.045 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59067.log 2023-07-06T22:21:40.046 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47016.log 2023-07-06T22:21:40.046 INFO:teuthology.orchestra.run.smithi055.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57359.log.gz 2023-07-06T22:21:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59067.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59067.log.gz 2023-07-06T22:21:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50035.log 2023-07-06T22:21:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60044.log 2023-07-06T22:21:40.048 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47016.log.gz 2023-07-06T22:21:40.049 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50035.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50035.log.gz 2023-07-06T22:21:40.049 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43541.log 2023-07-06T22:21:40.050 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60044.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-07-06T22:21:40.051 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60044.log.gz 2023-07-06T22:21:40.051 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43541.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43541.log.gz 2023-07-06T22:21:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44788.log 2023-07-06T22:21:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54447.log 2023-07-06T22:21:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44788.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44788.log.gz 2023-07-06T22:21:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56875.log 2023-07-06T22:21:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54447.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54447.log.gz 2023-07-06T22:21:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63322.log 2023-07-06T22:21:40.057 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56875.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56875.log.gz 2023-07-06T22:21:40.058 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54317.log 2023-07-06T22:21:40.059 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63322.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz 2023-07-06T22:21:40.059 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62377.log 2023-07-06T22:21:40.061 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72210.log 2023-07-06T22:21:40.061 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54317.log.gz 2023-07-06T22:21:40.062 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62377.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62377.log.gz 2023-07-06T22:21:40.062 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51434.log 2023-07-06T22:21:40.063 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49792.log 2023-07-06T22:21:40.064 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72210.log.gz 2023-07-06T22:21:40.064 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51434.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51434.log.gz 2023-07-06T22:21:40.065 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66998.log 2023-07-06T22:21:40.066 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49792.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49792.log.gz 2023-07-06T22:21:40.067 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56672.log 2023-07-06T22:21:40.068 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66998.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66998.log.gz 2023-07-06T22:21:40.068 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51220.log 2023-07-06T22:21:40.069 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56672.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56672.log.gz 2023-07-06T22:21:40.070 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56482.log 2023-07-06T22:21:40.071 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51220.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51220.log.gz 2023-07-06T22:21:40.071 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57845.log 2023-07-06T22:21:40.073 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56482.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56482.log.gz 2023-07-06T22:21:40.073 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48720.log 2023-07-06T22:21:40.074 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57845.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57845.log.gz 2023-07-06T22:21:40.075 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65547.log 2023-07-06T22:21:40.076 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48720.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48720.log.gz 2023-07-06T22:21:40.076 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51824.log 2023-07-06T22:21:40.077 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65547.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65547.log.gz 2023-07-06T22:21:40.078 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71872.log 2023-07-06T22:21:40.079 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45221.log 2023-07-06T22:21:40.080 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51824.log.gz 2023-07-06T22:21:40.081 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46782.log 2023-07-06T22:21:40.081 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71872.log.gz 2023-07-06T22:21:40.083 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52496.log 2023-07-06T22:21:40.083 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45221.log.gz 2023-07-06T22:21:40.084 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57175.log 2023-07-06T22:21:40.084 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46782.log.gz 2023-07-06T22:21:40.086 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52496.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52496.log.gz 2023-07-06T22:21:40.086 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56957.log 2023-07-06T22:21:40.087 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57175.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57175.log.gz 2023-07-06T22:21:40.087 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70040.log 2023-07-06T22:21:40.089 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56957.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56957.log.gz 2023-07-06T22:21:40.089 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44804.log 2023-07-06T22:21:40.090 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70040.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70040.log.gz 2023-07-06T22:21:40.091 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53993.log 2023-07-06T22:21:40.092 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44804.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44804.log.gz 2023-07-06T22:21:40.092 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71095.log 2023-07-06T22:21:40.094 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53993.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53993.log.gz 2023-07-06T22:21:40.094 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47154.log 2023-07-06T22:21:40.095 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71095.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71095.log.gz 2023-07-06T22:21:40.095 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70066.log 2023-07-06T22:21:40.097 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47154.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47154.log.gz 2023-07-06T22:21:40.097 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59671.log 2023-07-06T22:21:40.098 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70066.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70066.log.gz 2023-07-06T22:21:40.099 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63728.log 2023-07-06T22:21:40.100 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59671.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59671.log.gz 2023-07-06T22:21:40.100 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50416.log 2023-07-06T22:21:40.102 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63728.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63728.log.gz 2023-07-06T22:21:40.102 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46729.log 2023-07-06T22:21:40.103 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50416.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-07-06T22:21:40.104 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50416.log.gz 2023-07-06T22:21:40.104 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46729.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46729.log.gz 2023-07-06T22:21:40.105 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59379.log 2023-07-06T22:21:40.106 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70965.log 2023-07-06T22:21:40.107 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59379.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59379.log.gz 2023-07-06T22:21:40.108 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71950.log 2023-07-06T22:21:40.109 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70965.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70965.log.gz 2023-07-06T22:21:40.109 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48228.log 2023-07-06T22:21:40.110 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71950.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71950.log.gz 2023-07-06T22:21:40.111 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46391.log 2023-07-06T22:21:40.112 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48228.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48228.log.gz 2023-07-06T22:21:40.112 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56849.log 2023-07-06T22:21:40.114 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46391.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46391.log.gz 2023-07-06T22:21:40.114 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71846.log 2023-07-06T22:21:40.115 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56849.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56849.log.gz 2023-07-06T22:21:40.116 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49620.log 2023-07-06T22:21:40.117 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71846.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71846.log.gz 2023-07-06T22:21:40.117 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58014.log 2023-07-06T22:21:40.118 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49620.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49620.log.gz 2023-07-06T22:21:40.119 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46834.log 2023-07-06T22:21:40.120 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60018.log 2023-07-06T22:21:40.121 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58014.log.gz 2023-07-06T22:21:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46834.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46834.log.gz 2023-07-06T22:21:40.122 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44791.log 2023-07-06T22:21:40.123 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53795.log 2023-07-06T22:21:40.123 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60018.log.gz 2023-07-06T22:21:40.124 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44791.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44791.log.gz 2023-07-06T22:21:40.124 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67564.log 2023-07-06T22:21:40.125 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53795.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53795.log.gz 2023-07-06T22:21:40.126 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66774.log 2023-07-06T22:21:40.127 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67564.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67564.log.gz 2023-07-06T22:21:40.128 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46209.log 2023-07-06T22:21:40.129 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66774.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66774.log.gz 2023-07-06T22:21:40.129 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44807.log 2023-07-06T22:21:40.130 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46209.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46209.log.gz 2023-07-06T22:21:40.131 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46860.log 2023-07-06T22:21:40.132 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44807.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44807.log.gz 2023-07-06T22:21:40.132 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67090.log 2023-07-06T22:21:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46860.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46860.log.gz 2023-07-06T22:21:40.134 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57819.log 2023-07-06T22:21:40.135 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67090.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67090.log.gz 2023-07-06T22:21:40.136 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70379.log 2023-07-06T22:21:40.137 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57819.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57819.log.gz 2023-07-06T22:21:40.137 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49366.log 2023-07-06T22:21:40.138 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70379.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70379.log.gz 2023-07-06T22:21:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48456.log 2023-07-06T22:21:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49366.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49366.log.gz 2023-07-06T22:21:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52791.log 2023-07-06T22:21:40.142 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48456.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48456.log.gz 2023-07-06T22:21:40.142 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47528.log 2023-07-06T22:21:40.143 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52791.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52791.log.gz 2023-07-06T22:21:40.144 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50468.log 2023-07-06T22:21:40.145 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47528.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47528.log.gz 2023-07-06T22:21:40.146 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56534.log 2023-07-06T22:21:40.147 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50468.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50468.log.gz 2023-07-06T22:21:40.147 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67858.log 2023-07-06T22:21:40.148 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56534.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56534.log.gz 2023-07-06T22:21:40.149 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45219.log 2023-07-06T22:21:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67858.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.67858.log.gz 2023-07-06T22:21:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48806.log 2023-07-06T22:21:40.151 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45219.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45219.log.gz 2023-07-06T22:21:40.152 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63009.log 2023-07-06T22:21:40.153 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48806.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48806.log.gz 2023-07-06T22:21:40.153 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67389.log 2023-07-06T22:21:40.155 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63009.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.63009.log.gz 2023-07-06T22:21:40.155 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58124.log 2023-07-06T22:21:40.156 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67389.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67389.log.gz 2023-07-06T22:21:40.157 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67694.log 2023-07-06T22:21:40.158 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58124.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58124.log.gz 2023-07-06T22:21:40.158 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58957.log 2023-07-06T22:21:40.159 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67694.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67694.log.gz 2023-07-06T22:21:40.160 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48404.log 2023-07-06T22:21:40.161 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70405.log 2023-07-06T22:21:40.161 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58957.log.gz 2023-07-06T22:21:40.162 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48404.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48404.log.gz 2023-07-06T22:21:40.163 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64870.log 2023-07-06T22:21:40.164 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70405.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70405.log.gz 2023-07-06T22:21:40.165 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44571.log 2023-07-06T22:21:40.165 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64870.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64870.log.gz 2023-07-06T22:21:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44493.log 2023-07-06T22:21:40.167 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44571.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44571.log.gz 2023-07-06T22:21:40.168 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49707.log 2023-07-06T22:21:40.169 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44493.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44493.log.gz 2023-07-06T22:21:40.169 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43945.log 2023-07-06T22:21:40.170 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49707.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49707.log.gz 2023-07-06T22:21:40.171 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62286.log 2023-07-06T22:21:40.172 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43945.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43945.log.gz 2023-07-06T22:21:40.172 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46599.log 2023-07-06T22:21:40.174 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62286.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62286.log.gz 2023-07-06T22:21:40.174 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48964.log 2023-07-06T22:21:40.175 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46599.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46599.log.gz 2023-07-06T22:21:40.175 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55904.log 2023-07-06T22:21:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71532.log 2023-07-06T22:21:40.177 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48964.log.gz 2023-07-06T22:21:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55904.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55904.log.gz 2023-07-06T22:21:40.179 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50390.log 2023-07-06T22:21:40.180 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71532.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71532.log.gz 2023-07-06T22:21:40.180 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54838.log 2023-07-06T22:21:40.181 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50390.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50390.log.gz 2023-07-06T22:21:40.182 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63648.log 2023-07-06T22:21:40.183 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54838.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54838.log.gz 2023-07-06T22:21:40.184 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60070.log 2023-07-06T22:21:40.185 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63648.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63648.log.gz 2023-07-06T22:21:40.185 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68388.log 2023-07-06T22:21:40.186 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60070.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60070.log.gz 2023-07-06T22:21:40.187 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70301.log 2023-07-06T22:21:40.188 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68388.log: gzip 88.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.52051.log 2023-07-06T22:21:40.188 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68388.log.gz 2023-07-06T22:21:40.189 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70301.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70301.log.gz 2023-07-06T22:21:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44795.log 2023-07-06T22:21:40.191 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69962.log 2023-07-06T22:21:40.192 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52051.log.gz 2023-07-06T22:21:40.192 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44795.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44795.log.gz 2023-07-06T22:21:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54056.log 2023-07-06T22:21:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69962.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69962.log.gz 2023-07-06T22:21:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65817.log 2023-07-06T22:21:40.195 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54056.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54056.log.gz 2023-07-06T22:21:40.196 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64453.log 2023-07-06T22:21:40.197 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65817.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65817.log.gz 2023-07-06T22:21:40.198 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70852.log 2023-07-06T22:21:40.199 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64453.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64453.log.gz 2023-07-06T22:21:40.200 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50364.log 2023-07-06T22:21:40.201 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70852.log: gzip 91.2% -- replaced with /var/log/ceph/ceph-client.admin.70852.log.gz 2023-07-06T22:21:40.201 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54720.log 2023-07-06T22:21:40.202 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50364.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50364.log.gz 2023-07-06T22:21:40.202 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46287.log 2023-07-06T22:21:40.204 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54720.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54720.log.gz 2023-07-06T22:21:40.204 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47975.log 2023-07-06T22:21:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46287.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46287.log.gz 2023-07-06T22:21:40.206 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55112.log 2023-07-06T22:21:40.207 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47975.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47975.log.gz 2023-07-06T22:21:40.207 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46187.log 2023-07-06T22:21:40.209 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55112.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55112.log.gz 2023-07-06T22:21:40.209 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69910.log 2023-07-06T22:21:40.210 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.2.46187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46187.log.gz 2023-07-06T22:21:40.211 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56586.log 2023-07-06T22:21:40.212 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69910.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69910.log.gz 2023-07-06T22:21:40.212 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44436.log 2023-07-06T22:21:40.214 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56586.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56586.log.gz 2023-07-06T22:21:40.214 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63270.log 2023-07-06T22:21:40.215 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44436.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44436.log.gz 2023-07-06T22:21:40.216 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58755.log 2023-07-06T22:21:40.217 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48378.log 2023-07-06T22:21:40.218 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63270.log.gz 2023-07-06T22:21:40.219 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58755.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58755.log.gz 2023-07-06T22:21:40.220 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51850.log 2023-07-06T22:21:40.221 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48378.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48378.log.gz 2023-07-06T22:21:40.221 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65765.log 2023-07-06T22:21:40.221 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51850.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51850.log.gz 2023-07-06T22:21:40.222 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69461.log 2023-07-06T22:21:40.223 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65765.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65765.log.gz 2023-07-06T22:21:40.224 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71820.log 2023-07-06T22:21:40.225 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69461.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69461.log.gz 2023-07-06T22:21:40.226 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65293.log 2023-07-06T22:21:40.226 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71820.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.71820.log.gz 2023-07-06T22:21:40.227 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49044.log 2023-07-06T22:21:40.228 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65293.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65293.log.gz 2023-07-06T22:21:40.229 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63674.log 2023-07-06T22:21:40.230 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49044.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49044.log.gz 2023-07-06T22:21:40.231 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43515.log 2023-07-06T22:21:40.231 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63674.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63674.log.gz 2023-07-06T22:21:40.232 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52025.log 2023-07-06T22:21:40.233 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43515.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43515.log.gz 2023-07-06T22:21:40.234 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57949.log 2023-07-06T22:21:40.235 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52025.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52025.log.gz 2023-07-06T22:21:40.235 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66862.log 2023-07-06T22:21:40.236 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57949.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57949.log.gz 2023-07-06T22:21:40.237 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71262.log 2023-07-06T22:21:40.238 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66862.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66862.log.gz 2023-07-06T22:21:40.239 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61035.log 2023-07-06T22:21:40.240 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71262.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71262.log.gz 2023-07-06T22:21:40.240 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54019.log 2023-07-06T22:21:40.241 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61035.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61035.log.gz 2023-07-06T22:21:40.242 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46625.log 2023-07-06T22:21:40.243 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54019.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54019.log.gz 2023-07-06T22:21:40.244 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62626.log 2023-07-06T22:21:40.245 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46625.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46625.log.gz 2023-07-06T22:21:40.246 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63806.log 2023-07-06T22:21:40.246 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62626.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62626.log.gz 2023-07-06T22:21:40.247 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46547.log 2023-07-06T22:21:40.249 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48912.log 2023-07-06T22:21:40.249 INFO:teuthology.orchestra.run.smithi055.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.63806.log.gz 2023-07-06T22:21:40.250 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46547.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46547.log.gz 2023-07-06T22:21:40.250 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53899.log 2023-07-06T22:21:40.251 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62124.log 2023-07-06T22:21:40.252 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48912.log.gz 2023-07-06T22:21:40.253 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53899.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53899.log.gz 2023-07-06T22:21:40.254 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49096.log 2023-07-06T22:21:40.254 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62124.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62124.log.gz 2023-07-06T22:21:40.255 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43436.log 2023-07-06T22:21:40.256 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49096.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49096.log.gz 2023-07-06T22:21:40.257 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59543.log 2023-07-06T22:21:40.258 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43436.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43436.log.gz 2023-07-06T22:21:40.258 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53164.log 2023-07-06T22:21:40.259 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59543.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59543.log.gz 2023-07-06T22:21:40.260 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69579.log 2023-07-06T22:21:40.261 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53164.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53164.log.gz 2023-07-06T22:21:40.261 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70826.log 2023-07-06T22:21:40.262 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69579.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69579.log.gz 2023-07-06T22:21:40.263 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48638.log 2023-07-06T22:21:40.265 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63544.log 2023-07-06T22:21:40.265 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70826.log.gz 2023-07-06T22:21:40.266 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48638.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48638.log.gz 2023-07-06T22:21:40.266 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66356.log 2023-07-06T22:21:40.267 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45509.log 2023-07-06T22:21:40.267 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63544.log.gz 2023-07-06T22:21:40.268 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66356.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.66356.log.gz 2023-07-06T22:21:40.269 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43869.log 2023-07-06T22:21:40.270 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45509.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45509.log.gz 2023-07-06T22:21:40.270 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70670.log 2023-07-06T22:21:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43869.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43869.log.gz 2023-07-06T22:21:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50957.log 2023-07-06T22:21:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70670.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70670.log.gz 2023-07-06T22:21:40.274 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67415.log 2023-07-06T22:21:40.275 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50957.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.50957.log.gz 2023-07-06T22:21:40.275 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63856.log 2023-07-06T22:21:40.276 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67415.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67415.log.gz 2023-07-06T22:21:40.277 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43765.log 2023-07-06T22:21:40.278 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47715.log 2023-07-06T22:21:40.278 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63856.log.gz 2023-07-06T22:21:40.279 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43765.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43765.log.gz 2023-07-06T22:21:40.279 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58983.log 2023-07-06T22:21:40.280 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62782.log 2023-07-06T22:21:40.281 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47715.log.gz 2023-07-06T22:21:40.281 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58983.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58983.log.gz 2023-07-06T22:21:40.282 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70592.log 2023-07-06T22:21:40.283 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72652.log 2023-07-06T22:21:40.283 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62782.log.gz 2023-07-06T22:21:40.284 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70592.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70592.log.gz 2023-07-06T22:21:40.284 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45873.log 2023-07-06T22:21:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47819.log 2023-07-06T22:21:40.285 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72652.log.gz 2023-07-06T22:21:40.286 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45873.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45873.log.gz 2023-07-06T22:21:40.286 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72730.log 2023-07-06T22:21:40.287 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65098.log 2023-07-06T22:21:40.288 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47819.log.gz 2023-07-06T22:21:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72730.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72730.log.gz 2023-07-06T22:21:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70092.log 2023-07-06T22:21:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71573.log 2023-07-06T22:21:40.290 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65098.log.gz 2023-07-06T22:21:40.291 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70092.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70092.log.gz 2023-07-06T22:21:40.292 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70177.log 2023-07-06T22:21:40.293 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59249.log 2023-07-06T22:21:40.293 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71573.log.gz 2023-07-06T22:21:40.294 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70177.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70177.log.gz 2023-07-06T22:21:40.294 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51009.log 2023-07-06T22:21:40.296 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59249.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59249.log.gz 2023-07-06T22:21:40.296 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60266.log 2023-07-06T22:21:40.297 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51009.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51009.log.gz 2023-07-06T22:21:40.298 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55138.log 2023-07-06T22:21:40.299 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60266.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60266.log.gz 2023-07-06T22:21:40.299 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47689.log 2023-07-06T22:21:40.301 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55138.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55138.log.gz 2023-07-06T22:21:40.301 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72288.log 2023-07-06T22:21:40.302 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47689.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47689.log.gz 2023-07-06T22:21:40.302 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64766.log 2023-07-06T22:21:40.304 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72288.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72288.log.gz 2023-07-06T22:21:40.304 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43319.log 2023-07-06T22:21:40.305 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64766.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64766.log.gz 2023-07-06T22:21:40.306 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71599.log 2023-07-06T22:21:40.307 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43319.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43319.log.gz 2023-07-06T22:21:40.307 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68310.log 2023-07-06T22:21:40.309 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71599.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71599.log.gz 2023-07-06T22:21:40.309 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44332.log 2023-07-06T22:21:40.310 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68310.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68310.log.gz 2023-07-06T22:21:40.311 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58261.log 2023-07-06T22:21:40.312 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44332.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44332.log.gz 2023-07-06T22:21:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47042.log 2023-07-06T22:21:40.314 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58261.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58261.log.gz 2023-07-06T22:21:40.314 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65020.log 2023-07-06T22:21:40.316 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57497.log 2023-07-06T22:21:40.316 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47042.log.gz 2023-07-06T22:21:40.317 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65020.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65020.log.gz 2023-07-06T22:21:40.317 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44801.log 2023-07-06T22:21:40.318 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68034.log 2023-07-06T22:21:40.319 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57497.log.gz 2023-07-06T22:21:40.320 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44801.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44801.log.gz 2023-07-06T22:21:40.320 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54473.log 2023-07-06T22:21:40.321 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68034.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68034.log.gz 2023-07-06T22:21:40.322 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65947.log 2023-07-06T22:21:40.323 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54473.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54473.log.gz 2023-07-06T22:21:40.323 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47897.log 2023-07-06T22:21:40.325 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58670.log 2023-07-06T22:21:40.325 INFO:teuthology.orchestra.run.smithi055.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.65947.log.gz 2023-07-06T22:21:40.326 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47897.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47897.log.gz 2023-07-06T22:21:40.326 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63700.log 2023-07-06T22:21:40.328 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46443.log 2023-07-06T22:21:40.328 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58670.log.gz 2023-07-06T22:21:40.328 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63700.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63700.log.gz 2023-07-06T22:21:40.329 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45665.log 2023-07-06T22:21:40.330 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46443.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46443.log.gz 2023-07-06T22:21:40.331 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47580.log 2023-07-06T22:21:40.332 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45665.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45665.log.gz 2023-07-06T22:21:40.332 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61361.log 2023-07-06T22:21:40.333 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47580.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47580.log.gz 2023-07-06T22:21:40.334 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58592.log 2023-07-06T22:21:40.335 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61361.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61361.log.gz 2023-07-06T22:21:40.336 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57988.log 2023-07-06T22:21:40.337 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58592.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58592.log.gz 2023-07-06T22:21:40.338 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-07-06T22:21:40.339 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70461.log 2023-07-06T22:21:40.340 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57988.log.gz 2023-07-06T22:21:40.341 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71898.log 2023-07-06T22:21:40.342 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70461.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64923.log 2023-07-06T22:21:40.343 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70461.log.gz 2023-07-06T22:21:40.344 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47663.log 2023-07-06T22:21:40.344 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71898.log.gz 2023-07-06T22:21:40.346 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43713.log 2023-07-06T22:21:40.346 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64923.log.gz 2023-07-06T22:21:40.347 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47663.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47663.log.gz -5 2023-07-06T22:21:40.347 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46105.log 2023-07-06T22:21:40.349 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71626.log 2023-07-06T22:21:40.349 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43713.log.gz 2023-07-06T22:21:40.350 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46105.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46105.log.gz -5 2023-07-06T22:21:40.350 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52947.log 2023-07-06T22:21:40.352 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71626.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67982.log 2023-07-06T22:21:40.352 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71626.log.gz 2023-07-06T22:21:40.353 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59934.log 88.7% 2023-07-06T22:21:40.353 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52947.log.gz 2023-07-06T22:21:40.355 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63918.log 2023-07-06T22:21:40.355 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67982.log.gz 2023-07-06T22:21:40.356 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65519.log 2023-07-06T22:21:40.356 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59934.log.gz 2023-07-06T22:21:40.358 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61691.log 2023-07-06T22:21:40.358 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63918.log.gz 2023-07-06T22:21:40.359 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72028.log 2023-07-06T22:21:40.359 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65519.log.gz 2023-07-06T22:21:40.360 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.61691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.61691.log.gz 2023-07-06T22:21:40.360 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58787.log 2023-07-06T22:21:40.362 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61837.log 2023-07-06T22:21:40.362 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72028.log.gz 2023-07-06T22:21:40.364 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59481.log 2023-07-06T22:21:40.364 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58787.log.gz 2023-07-06T22:21:40.365 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60911.log 2023-07-06T22:21:40.365 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61837.log.gz 2023-07-06T22:21:40.366 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57409.log 2023-07-06T22:21:40.367 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59481.log.gz 2023-07-06T22:21:40.368 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60911.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60911.log.gz 2023-07-06T22:21:40.368 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65921.log 2023-07-06T22:21:40.369 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57409.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57923.log 2023-07-06T22:21:40.370 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57409.log.gz 2023-07-06T22:21:40.371 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52181.log 2023-07-06T22:21:40.371 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65921.log.gz 2023-07-06T22:21:40.372 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69811.log 2023-07-06T22:21:40.373 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57923.log.gz 2023-07-06T22:21:40.374 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68518.log 2023-07-06T22:21:40.374 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52181.log.gz 2023-07-06T22:21:40.376 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69811.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59837.log 2023-07-06T22:21:40.376 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69811.log.gz 2023-07-06T22:21:40.377 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55510.log 2023-07-06T22:21:40.377 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68518.log.gz 2023-07-06T22:21:40.378 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67116.log 2023-07-06T22:21:40.379 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59837.log.gz 2023-07-06T22:21:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61195.log 2023-07-06T22:21:40.381 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67116.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55510.log.gz 2023-07-06T22:21:40.382 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67668.log 2023-07-06T22:21:40.382 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67116.log.gz 2023-07-06T22:21:40.383 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62351.log 2023-07-06T22:21:40.383 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61195.log.gz 2023-07-06T22:21:40.385 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72366.log 2023-07-06T22:21:40.385 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67668.log.gz 2023-07-06T22:21:40.386 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62351.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62351.log.gz 2023-07-06T22:21:40.386 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65261.log 2023-07-06T22:21:40.388 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43234.log 2023-07-06T22:21:40.388 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72366.log.gz 2023-07-06T22:21:40.389 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70327.log 2023-07-06T22:21:40.389 INFO:teuthology.orchestra.run.smithi055.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.65261.log.gz 2023-07-06T22:21:40.391 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65843.log 87.8% 2023-07-06T22:21:40.391 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43234.log.gz 2023-07-06T22:21:40.392 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48534.log 2023-07-06T22:21:40.392 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70327.log.gz 2023-07-06T22:21:40.394 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65843.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.65739.log 2023-07-06T22:21:40.394 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65843.log.gz 2023-07-06T22:21:40.395 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47068.log 2023-07-06T22:21:40.395 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48534.log.gz 2023-07-06T22:21:40.397 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65739.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65739.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59405.log 2023-07-06T22:21:40.397 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-07-06T22:21:40.398 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43463.log 2023-07-06T22:21:40.399 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59405.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47068.log.gz 2023-07-06T22:21:40.400 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63970.log 2023-07-06T22:21:40.400 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59405.log.gz 2023-07-06T22:21:40.401 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43463.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68060.log 2023-07-06T22:21:40.401 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43463.log.gz 2023-07-06T22:21:40.402 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58722.log 2023-07-06T22:21:40.403 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63970.log.gz 2023-07-06T22:21:40.404 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70644.log 2023-07-06T22:21:40.405 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68060.log.gz 2023-07-06T22:21:40.406 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64968.log 2023-07-06T22:21:40.406 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58722.log.gz 2023-07-06T22:21:40.407 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70644.log: gzip -5 --verbose 87.9% -- /var/log/ceph/ceph-client.admin.53112.log -- replaced with /var/log/ceph/ceph-client.admin.70644.log.gz 2023-07-06T22:21:40.407 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-07-06T22:21:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64968.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64968.log.gz 2023-07-06T22:21:40.409 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62957.log 2023-07-06T22:21:40.410 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53112.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56929.log 2023-07-06T22:21:40.411 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53112.log.gz 2023-07-06T22:21:40.412 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45209.log 2023-07-06T22:21:40.412 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62957.log.gz 2023-07-06T22:21:40.413 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70014.log 2023-07-06T22:21:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45209.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56929.log.gz 2023-07-06T22:21:40.415 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62182.log 2023-07-06T22:21:40.415 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45209.log.gz 2023-07-06T22:21:40.416 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63061.log 2023-07-06T22:21:40.417 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70014.log.gz 2023-07-06T22:21:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68708.log 2023-07-06T22:21:40.418 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62182.log.gz 2023-07-06T22:21:40.419 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63061.log: gzip -5 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63061.log.gz 2023-07-06T22:21:40.420 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47502.log 2023-07-06T22:21:40.421 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61113.log 2023-07-06T22:21:40.421 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68708.log.gz 2023-07-06T22:21:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47502.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.0.59527.log 2023-07-06T22:21:40.423 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47502.log.gz 2023-07-06T22:21:40.424 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61113.log: gzip 88.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.61113.log.gz -- 2023-07-06T22:21:40.424 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.admin.60774.log 2023-07-06T22:21:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.59527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59527.log.gz 2023-07-06T22:21:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60670.log 2023-07-06T22:21:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50800.log 2023-07-06T22:21:40.427 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60774.log.gz 2023-07-06T22:21:40.428 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71289.log 2023-07-06T22:21:40.429 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60670.log.gz 2023-07-06T22:21:40.430 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47923.log 2023-07-06T22:21:40.430 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50800.log.gz 2023-07-06T22:21:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63490.log 2023-07-06T22:21:40.431 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71289.log.gz 2023-07-06T22:21:40.433 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44279.log 2023-07-06T22:21:40.433 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47923.log.gz 2023-07-06T22:21:40.434 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63490.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61167.log 2023-07-06T22:21:40.434 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63490.log.gz 2023-07-06T22:21:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62931.log 2023-07-06T22:21:40.436 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44279.log.gz 2023-07-06T22:21:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59197.log 2023-07-06T22:21:40.438 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62931.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61167.log.gz 2023-07-06T22:21:40.439 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45965.log 2023-07-06T22:21:40.439 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62931.log.gz 2023-07-06T22:21:40.440 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68258.log 2023-07-06T22:21:40.441 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59197.log.gz 2023-07-06T22:21:40.442 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45965.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68440.log 2023-07-06T22:21:40.442 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45965.log.gz 2023-07-06T22:21:40.443 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55432.log 2023-07-06T22:21:40.443 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68258.log.gz 2023-07-06T22:21:40.445 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48312.log 2023-07-06T22:21:40.446 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55432.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68440.log.gz 2023-07-06T22:21:40.446 INFO:teuthology.orchestra.run.smithi055.stderr:gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55432.log.gz -5 2023-07-06T22:21:40.447 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67799.log 2023-07-06T22:21:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48312.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48312.log.gz 2023-07-06T22:21:40.448 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53434.log 2023-07-06T22:21:40.449 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67799.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-07-06T22:21:40.450 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67799.log.gz 2023-07-06T22:21:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72002.log 2023-07-06T22:21:40.451 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53434.log.gz 2023-07-06T22:21:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57227.log 2023-07-06T22:21:40.454 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57523.log 2023-07-06T22:21:40.454 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72002.log.gz 2023-07-06T22:21:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57227.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57227.log.gz 2023-07-06T22:21:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53678.log 2023-07-06T22:21:40.457 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57523.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57523.log.gz 2023-07-06T22:21:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56991.log 2023-07-06T22:21:40.461 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53678.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57471.log 2023-07-06T22:21:40.461 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53678.log.gz 2023-07-06T22:21:40.462 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72808.log 2023-07-06T22:21:40.463 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57471.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56991.log.gz 2023-07-06T22:21:40.464 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57471.log.gz 2023-07-06T22:21:40.464 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63570.log 2023-07-06T22:21:40.466 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65633.log 2023-07-06T22:21:40.467 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63570.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72808.log.gz 2023-07-06T22:21:40.468 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63570.log.gz 2023-07-06T22:21:40.468 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56560.log 2023-07-06T22:21:40.470 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48027.log 2023-07-06T22:21:40.471 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56560.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65633.log.gz 2023-07-06T22:21:40.472 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56560.log.gz 2023-07-06T22:21:40.472 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52260.log 2023-07-06T22:21:40.474 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63348.log 2023-07-06T22:21:40.475 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52260.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48027.log.gz 2023-07-06T22:21:40.476 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52260.log.gz 2023-07-06T22:21:40.476 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56638.log 2023-07-06T22:21:40.478 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61439.log 2023-07-06T22:21:40.479 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56638.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63348.log.gz 2023-07-06T22:21:40.479 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56638.log.gz 2023-07-06T22:21:40.480 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58365.log 2023-07-06T22:21:40.482 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52685.log 2023-07-06T22:21:40.483 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58365.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61439.log.gz 2023-07-06T22:21:40.484 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58365.log.gz 2023-07-06T22:21:40.484 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55786.log 2023-07-06T22:21:40.486 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61759.log 2023-07-06T22:21:40.487 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55786.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52685.log.gz 2023-07-06T22:21:40.488 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55786.log.gz 2023-07-06T22:21:40.488 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45613.log 2023-07-06T22:21:40.490 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67311.log 2023-07-06T22:21:40.491 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45613.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61759.log.gz 2023-07-06T22:21:40.492 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45613.log.gz 2023-07-06T22:21:40.492 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45015.log 2023-07-06T22:21:40.494 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65228.log 2023-07-06T22:21:40.495 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45015.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67311.log.gz 2023-07-06T22:21:40.496 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45015.log.gz 2023-07-06T22:21:40.496 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54213.log 2023-07-06T22:21:40.498 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51604.log 2023-07-06T22:21:40.499 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54213.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65228.log.gz 2023-07-06T22:21:40.500 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54213.log.gz 2023-07-06T22:21:40.500 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45223.log 2023-07-06T22:21:40.502 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72444.log 2023-07-06T22:21:40.502 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45223.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51604.log.gz 2023-07-06T22:21:40.503 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45223.log.gz 2023-07-06T22:21:40.504 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64048.log 2023-07-06T22:21:40.506 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62260.log 2023-07-06T22:21:40.506 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64048.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72444.log.gz 2023-07-06T22:21:40.507 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64048.log.gz 2023-07-06T22:21:40.508 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68656.log 2023-07-06T22:21:40.510 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61387.log 2023-07-06T22:21:40.511 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62260.log.gz 2023-07-06T22:21:40.512 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68656.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68656.log.gz 2023-07-06T22:21:40.512 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66161.log 2023-07-06T22:21:40.514 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70539.log 2023-07-06T22:21:40.515 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66161.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61387.log.gz 2023-07-06T22:21:40.515 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66161.log.gz 2023-07-06T22:21:40.517 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64427.log 2023-07-06T22:21:40.518 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70539.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68466.log 2023-07-06T22:21:40.518 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70539.log.gz 2023-07-06T22:21:40.520 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58566.log 2023-07-06T22:21:40.521 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68466.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64427.log.gz 2023-07-06T22:21:40.521 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68466.log.gz 2023-07-06T22:21:40.523 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54239.log 2023-07-06T22:21:40.524 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68682.log 2023-07-06T22:21:40.524 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58566.log.gz 2023-07-06T22:21:40.526 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64375.log 2023-07-06T22:21:40.527 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68682.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54239.log.gz 2023-07-06T22:21:40.527 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68682.log.gz 2023-07-06T22:21:40.529 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47315.log 2023-07-06T22:21:40.530 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49533.log 2023-07-06T22:21:40.530 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64375.log.gz 2023-07-06T22:21:40.531 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46703.log 2023-07-06T22:21:40.533 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47315.log: /var/log/ceph/ceph-client.admin.49533.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47315.log.gz 2023-07-06T22:21:40.533 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49533.log.gz 2023-07-06T22:21:40.534 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57043.log 2023-07-06T22:21:40.536 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63438.log 2023-07-06T22:21:40.537 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57043.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46703.log.gz 2023-07-06T22:21:40.538 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57043.log.gz 2023-07-06T22:21:40.538 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51486.log 2023-07-06T22:21:40.540 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59595.log 2023-07-06T22:21:40.541 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51486.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63438.log.gz 2023-07-06T22:21:40.541 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51486.log.gz 2023-07-06T22:21:40.542 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59353.log 2023-07-06T22:21:40.544 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57149.log 2023-07-06T22:21:40.545 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59353.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59595.log.gz 2023-07-06T22:21:40.545 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59353.log.gz 2023-07-06T22:21:40.546 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43259.log 2023-07-06T22:21:40.548 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54603.log 2023-07-06T22:21:40.549 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43259.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57149.log.gz 2023-07-06T22:21:40.550 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43259.log.gz 2023-07-06T22:21:40.550 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62827.log 2023-07-06T22:21:40.552 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65359.log 2023-07-06T22:21:40.553 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54603.log: /var/log/ceph/ceph-client.admin.62827.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54603.log.gz 2023-07-06T22:21:40.554 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62827.log.gz 2023-07-06T22:21:40.554 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45207.log 2023-07-06T22:21:40.556 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59171.log 2023-07-06T22:21:40.557 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45207.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65359.log.gz 2023-07-06T22:21:40.558 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45207.log.gz 2023-07-06T22:21:40.558 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57897.log 2023-07-06T22:21:40.560 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65046.log 2023-07-06T22:21:40.561 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57897.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59171.log.gz 2023-07-06T22:21:40.562 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57897.log.gz 2023-07-06T22:21:40.562 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65124.log 2023-07-06T22:21:40.564 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52843.log 2023-07-06T22:21:40.565 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65124.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65046.log.gz 2023-07-06T22:21:40.566 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65124.log.gz 2023-07-06T22:21:40.566 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62983.log 2023-07-06T22:21:40.568 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69936.log 2023-07-06T22:21:40.569 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62983.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52843.log.gz 2023-07-06T22:21:40.570 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62983.log.gz 2023-07-06T22:21:40.570 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43567.log 2023-07-06T22:21:40.572 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65997.log 2023-07-06T22:21:40.573 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43567.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.69936.log.gz 2023-07-06T22:21:40.574 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43567.log.gz 2023-07-06T22:21:40.574 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50008.log 2023-07-06T22:21:40.576 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57017.log 2023-07-06T22:21:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50008.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65997.log.gz 2023-07-06T22:21:40.578 INFO:teuthology.orchestra.run.smithi055.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50008.log.gz 2023-07-06T22:21:40.578 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45535.log 2023-07-06T22:21:40.580 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70144.log 2023-07-06T22:21:40.581 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45535.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57017.log.gz 2023-07-06T22:21:40.582 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45535.log.gz 2023-07-06T22:21:40.583 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56255.log 2023-07-06T22:21:40.584 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44410.log 2023-07-06T22:21:40.585 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56255.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70144.log.gz 2023-07-06T22:21:40.586 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56255.log.gz 2023-07-06T22:21:40.586 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48664.log 2023-07-06T22:21:40.589 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52418.log 2023-07-06T22:21:40.589 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48664.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44410.log.gz 2023-07-06T22:21:40.590 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48664.log.gz 2023-07-06T22:21:40.590 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67825.log 2023-07-06T22:21:40.592 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67956.log 2023-07-06T22:21:40.593 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52418.log: /var/log/ceph/ceph-client.admin.67825.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52418.log.gz 2023-07-06T22:21:40.594 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67825.log.gz 2023-07-06T22:21:40.594 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45821.log 2023-07-06T22:21:40.596 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48280.log 2023-07-06T22:21:40.597 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45821.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67956.log.gz 2023-07-06T22:21:40.598 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45821.log.gz 2023-07-06T22:21:40.598 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50338.log 2023-07-06T22:21:40.600 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59569.log 2023-07-06T22:21:40.601 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50338.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48280.log.gz 2023-07-06T22:21:40.602 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50338.log.gz 2023-07-06T22:21:40.602 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64519.log 2023-07-06T22:21:40.604 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51928.log 2023-07-06T22:21:40.605 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64519.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59569.log.gz 2023-07-06T22:21:40.606 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64519.log.gz 2023-07-06T22:21:40.606 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48183.log 2023-07-06T22:21:40.608 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68114.log 2023-07-06T22:21:40.609 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51928.log: /var/log/ceph/ceph-client.admin.48183.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51928.log.gz 2023-07-06T22:21:40.610 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48183.log.gz 2023-07-06T22:21:40.610 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.32519.log 2023-07-06T22:21:40.612 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63244.log 2023-07-06T22:21:40.613 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph.tmp-client.admin.32519.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68114.log.gz 2023-07-06T22:21:40.614 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.32519.log.gz 2023-07-06T22:21:40.614 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45587.log 2023-07-06T22:21:40.616 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52155.log 2023-07-06T22:21:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45587.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63244.log.gz 2023-07-06T22:21:40.618 INFO:teuthology.orchestra.run.smithi055.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45587.log.gz 2023-07-06T22:21:40.618 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69369.log 2023-07-06T22:21:40.620 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49286.log 2023-07-06T22:21:40.621 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69369.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52155.log.gz 2023-07-06T22:21:40.622 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69369.log.gz 2023-07-06T22:21:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65150.log 2023-07-06T22:21:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56704.log 2023-07-06T22:21:40.625 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49286.log.gz/var/log/ceph/ceph-client.admin.65150.log: 2023-07-06T22:21:40.626 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65150.log.gz 2023-07-06T22:21:40.626 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55482.log 2023-07-06T22:21:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48886.log 2023-07-06T22:21:40.629 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56704.log: /var/log/ceph/ceph-client.admin.55482.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56704.log.gz 2023-07-06T22:21:40.630 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55482.log.gz 2023-07-06T22:21:40.631 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48001.log 2023-07-06T22:21:40.633 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49016.log 2023-07-06T22:21:40.633 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48001.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48886.log.gz 2023-07-06T22:21:40.634 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48001.log.gz 2023-07-06T22:21:40.635 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43595.log 2023-07-06T22:21:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54890.log 2023-07-06T22:21:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43595.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49016.log.gz 2023-07-06T22:21:40.638 INFO:teuthology.orchestra.run.smithi055.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43595.log.gz 2023-07-06T22:21:40.639 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62404.log 2023-07-06T22:21:40.641 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54890.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-06T22:21:40.641 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62404.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54890.log.gz 2023-07-06T22:21:40.642 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62404.log.gz 2023-07-06T22:21:40.642 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64266.log 2023-07-06T22:21:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52607.log 2023-07-06T22:21:40.646 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.64266.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64266.log.gz 2023-07-06T22:21:40.647 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63087.log 2023-07-06T22:21:40.649 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52607.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52607.log.gz 2023-07-06T22:21:40.651 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65072.log 2023-07-06T22:21:40.652 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63087.log: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-06T22:21:40.652 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63087.log.gz 2023-07-06T22:21:40.653 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49873.log 2023-07-06T22:21:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60460.log 2023-07-06T22:21:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65072.log: /var/log/ceph/ceph-client.admin.49873.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65072.log.gz 2023-07-06T22:21:40.657 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49873.log.gz 2023-07-06T22:21:40.657 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66800.log 2023-07-06T22:21:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67493.log 2023-07-06T22:21:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66800.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60460.log.gz 2023-07-06T22:21:40.661 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66800.log.gz 2023-07-06T22:21:40.661 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48586.log 2023-07-06T22:21:40.663 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70948.log 2023-07-06T22:21:40.664 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48586.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67493.log.gz 2023-07-06T22:21:40.665 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48586.log.gz 2023-07-06T22:21:40.665 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68786.log 2023-07-06T22:21:40.667 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.70948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62430.log 2023-07-06T22:21:40.668 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70948.log.gz/var/log/ceph/ceph-client.admin.68786.log: 2023-07-06T22:21:40.668 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68786.log.gz 2023-07-06T22:21:40.669 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48938.log 2023-07-06T22:21:40.671 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69408.log 2023-07-06T22:21:40.672 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0%/var/log/ceph/ceph-client.admin.48938.log: -- replaced with /var/log/ceph/ceph-client.admin.62430.log.gz 2023-07-06T22:21:40.672 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48938.log.gz 2023-07-06T22:21:40.673 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52999.log 2023-07-06T22:21:40.675 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63218.log 2023-07-06T22:21:40.676 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52999.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69408.log.gz 2023-07-06T22:21:40.677 INFO:teuthology.orchestra.run.smithi055.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52999.log.gz 2023-07-06T22:21:40.678 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64349.log 2023-07-06T22:21:40.679 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70487.log 2023-07-06T22:21:40.680 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64349.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63218.log.gz 2023-07-06T22:21:40.681 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64349.log.gz 2023-07-06T22:21:40.681 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58488.log 2023-07-06T22:21:40.683 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50442.log 2023-07-06T22:21:40.684 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58488.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70487.log.gz 2023-07-06T22:21:40.685 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58488.log.gz 2023-07-06T22:21:40.685 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61283.log 2023-07-06T22:21:40.688 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48254.log 2023-07-06T22:21:40.691 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9%/var/log/ceph/ceph-client.admin.61283.log: -- replaced with /var/log/ceph/ceph-client.admin.50442.log.gz 2023-07-06T22:21:40.692 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61283.log.gz 2023-07-06T22:21:40.692 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65895.log 2023-07-06T22:21:40.692 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68202.log 2023-07-06T22:21:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65895.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48254.log.gz 2023-07-06T22:21:40.693 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65895.log.gz 2023-07-06T22:21:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51772.log 2023-07-06T22:21:40.695 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56333.log 2023-07-06T22:21:40.696 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51772.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68202.log.gz 2023-07-06T22:21:40.697 INFO:teuthology.orchestra.run.smithi055.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51772.log.gz 2023-07-06T22:21:40.697 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58879.log 2023-07-06T22:21:40.699 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65491.log 2023-07-06T22:21:40.700 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58879.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56333.log.gz 2023-07-06T22:21:40.701 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58879.log.gz 2023-07-06T22:21:40.702 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47206.log 2023-07-06T22:21:40.704 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69343.log 2023-07-06T22:21:40.705 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65491.log: /var/log/ceph/ceph-client.admin.47206.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47206.log.gz 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65491.log.gz 2023-07-06T22:21:40.705 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-07-06T22:21:40.706 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46076.log 2023-07-06T22:21:40.708 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60748.log 2023-07-06T22:21:40.708 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.46076.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69343.log.gz 2023-07-06T22:21:40.709 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46076.log.gz 2023-07-06T22:21:40.710 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57281.log 2023-07-06T22:21:40.712 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47554.log 2023-07-06T22:21:40.712 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57281.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60748.log.gz 2023-07-06T22:21:40.713 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57281.log.gz 2023-07-06T22:21:40.714 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51324.log 2023-07-06T22:21:40.716 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37546.log 2023-07-06T22:21:40.716 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51324.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47554.log.gz 2023-07-06T22:21:40.717 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51324.log.gz 2023-07-06T22:21:40.718 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71721.log 2023-07-06T22:21:40.720 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.37546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44675.log 2023-07-06T22:21:40.720 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71721.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37546.log.gz 2023-07-06T22:21:40.721 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71721.log.gz 2023-07-06T22:21:40.722 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44753.log 2023-07-06T22:21:40.724 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54525.log 2023-07-06T22:21:40.724 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44753.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44675.log.gz 2023-07-06T22:21:40.725 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44753.log.gz 2023-07-06T22:21:40.726 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48131.log 2023-07-06T22:21:40.727 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72626.log 2023-07-06T22:21:40.729 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54525.log: /var/log/ceph/ceph-client.admin.48131.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54525.log.gz 2023-07-06T22:21:40.729 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48131.log.gz 2023-07-06T22:21:40.730 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46651.log 2023-07-06T22:21:40.732 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59093.log 2023-07-06T22:21:40.733 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46651.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72626.log.gz 2023-07-06T22:21:40.733 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46651.log.gz 2023-07-06T22:21:40.734 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71976.log 2023-07-06T22:21:40.736 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70118.log 2023-07-06T22:21:40.736 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71976.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59093.log.gz 2023-07-06T22:21:40.737 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71976.log.gz 2023-07-06T22:21:40.738 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47289.log 2023-07-06T22:21:40.740 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56612.log 2023-07-06T22:21:40.740 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47289.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70118.log.gz 2023-07-06T22:21:40.741 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47289.log.gz 2023-07-06T22:21:40.742 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44201.log 2023-07-06T22:21:40.744 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50550.log 2023-07-06T22:21:40.744 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44201.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56612.log.gz 2023-07-06T22:21:40.745 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44201.log.gz 2023-07-06T22:21:40.746 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60878.log 2023-07-06T22:21:40.748 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47343.log 2023-07-06T22:21:40.748 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60878.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50550.log.gz 2023-07-06T22:21:40.749 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60878.log.gz 2023-07-06T22:21:40.750 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52765.log 2023-07-06T22:21:40.752 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51168.log 2023-07-06T22:21:40.752 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52765.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47343.log.gz 2023-07-06T22:21:40.753 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52765.log.gz 2023-07-06T22:21:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44227.log 2023-07-06T22:21:40.755 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66111.log 2023-07-06T22:21:40.756 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51168.log.gz 2023-07-06T22:21:40.757 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44227.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44227.log.gz 2023-07-06T22:21:40.758 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44175.log 2023-07-06T22:21:40.759 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66111.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66111.log.gz 2023-07-06T22:21:40.759 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45743.log 2023-07-06T22:21:40.761 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47232.log 2023-07-06T22:21:40.762 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45743.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44175.log.gz 2023-07-06T22:21:40.763 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45743.log.gz 2023-07-06T22:21:40.763 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61645.log 2023-07-06T22:21:40.765 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63780.log 2023-07-06T22:21:40.765 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47232.log.gz 2023-07-06T22:21:40.767 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53407.log 2023-07-06T22:21:40.768 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61645.log.gz 2023-07-06T22:21:40.768 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63780.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63780.log.gz 2023-07-06T22:21:40.770 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47871.log 2023-07-06T22:21:40.771 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54551.log 2023-07-06T22:21:40.772 INFO:teuthology.orchestra.run.smithi138.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-07-06T22:21:40.772 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53407.log.gz 2023-07-06T22:21:40.774 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55164.log 2023-07-06T22:21:40.774 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6%/var/log/ceph/ceph-client.admin.54551.log: -- replaced with /var/log/ceph/ceph-client.admin.47871.log.gz 2023-07-06T22:21:40.775 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54551.log.gz 2023-07-06T22:21:40.776 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44623.log 2023-07-06T22:21:40.778 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47793.log 2023-07-06T22:21:40.778 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44623.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55164.log.gz 2023-07-06T22:21:40.779 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44623.log.gz 2023-07-06T22:21:40.780 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56430.log 2023-07-06T22:21:40.782 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61061.log 2023-07-06T22:21:40.782 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47793.log.gz 2023-07-06T22:21:40.784 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56430.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56430.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54864.log 2023-07-06T22:21:40.784 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-07-06T22:21:40.786 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54972.log 2023-07-06T22:21:40.786 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54864.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61061.log.gz 2023-07-06T22:21:40.787 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54864.log.gz 2023-07-06T22:21:40.788 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58391.log 2023-07-06T22:21:40.790 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72470.log 2023-07-06T22:21:40.790 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58391.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54972.log.gz 2023-07-06T22:21:40.791 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58391.log.gz 2023-07-06T22:21:40.792 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56770.log 2023-07-06T22:21:40.793 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56307.log 2023-07-06T22:21:40.794 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56770.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72470.log.gz 2023-07-06T22:21:40.795 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56770.log.gz 2023-07-06T22:21:40.796 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54265.log 2023-07-06T22:21:40.798 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56307.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56307.log.gz 2023-07-06T22:21:40.798 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53769.log 2023-07-06T22:21:40.799 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70800.log 2023-07-06T22:21:40.800 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54265.log.gz 2023-07-06T22:21:40.801 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53769.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53769.log.gz 2023-07-06T22:21:40.802 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61543.log 2023-07-06T22:21:40.803 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70800.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70800.log.gz 2023-07-06T22:21:40.804 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48508.log 2023-07-06T22:21:40.805 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67024.log 2023-07-06T22:21:40.806 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48508.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61543.log.gz 2023-07-06T22:21:40.807 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48508.log.gz 2023-07-06T22:21:40.808 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59992.log 2023-07-06T22:21:40.809 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71480.log 2023-07-06T22:21:40.810 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67024.log.gz 2023-07-06T22:21:40.811 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59992.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68176.log 2023-07-06T22:21:40.812 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59992.log.gz 2023-07-06T22:21:40.813 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61569.log 2023-07-06T22:21:40.814 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68176.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71480.log.gz 2023-07-06T22:21:40.815 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.68176.log.gz 2023-07-06T22:21:40.815 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69785.log 2023-07-06T22:21:40.817 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55242.log 2023-07-06T22:21:40.818 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69785.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61569.log.gz 2023-07-06T22:21:40.819 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69785.log.gz 2023-07-06T22:21:40.819 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44805.log 2023-07-06T22:21:40.821 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68228.log 2023-07-06T22:21:40.822 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44805.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55242.log.gz 2023-07-06T22:21:40.822 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44805.log.gz 2023-07-06T22:21:40.824 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48692.log 2023-07-06T22:21:40.826 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67050.log 2023-07-06T22:21:40.826 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68228.log.gz 2023-07-06T22:21:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48692.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48692.log.gz 2023-07-06T22:21:40.829 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54395.log 2023-07-06T22:21:40.829 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67050.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67050.log.gz 2023-07-06T22:21:40.831 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63754.log 2023-07-06T22:21:40.833 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46495.log 2023-07-06T22:21:40.833 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54395.log.gz 2023-07-06T22:21:40.834 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60538.log 2023-07-06T22:21:40.835 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46495.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63754.log.gz 2023-07-06T22:21:40.836 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46495.log.gz 2023-07-06T22:21:40.837 INFO:teuthology.orchestra.run.smithi138.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-07-06T22:21:40.837 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63376.log 2023-07-06T22:21:40.839 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60538.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68544.log 2023-07-06T22:21:40.839 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60538.log.gz 2023-07-06T22:21:40.840 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44306.log 2023-07-06T22:21:40.841 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68544.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63376.log.gz 2023-07-06T22:21:40.842 INFO:teuthology.orchestra.run.smithi055.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.68544.log.gz 2023-07-06T22:21:40.844 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55268.log 2023-07-06T22:21:40.845 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46886.log 2023-07-06T22:21:40.846 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44306.log.gz 2023-07-06T22:21:40.847 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44149.log 2023-07-06T22:21:40.848 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46886.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46886.log.gz 2023-07-06T22:21:40.849 INFO:teuthology.orchestra.run.smithi055.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55268.log.gz 2023-07-06T22:21:40.850 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70722.log 2023-07-06T22:21:40.851 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44358.log 2023-07-06T22:21:40.851 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44149.log.gz 2023-07-06T22:21:40.853 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60408.log 2023-07-06T22:21:40.854 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44358.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70722.log.gz 2023-07-06T22:21:40.854 INFO:teuthology.orchestra.run.smithi055.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44358.log.gz 2023-07-06T22:21:40.855 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47741.log 2023-07-06T22:21:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69434.log 2023-07-06T22:21:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47741.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60408.log.gz 2023-07-06T22:21:40.858 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47741.log.gz 2023-07-06T22:21:40.859 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46573.log 2023-07-06T22:21:40.861 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54421.log 2023-07-06T22:21:40.862 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46573.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69434.log.gz 2023-07-06T22:21:40.862 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46573.log.gz 2023-07-06T22:21:40.863 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49172.log 2023-07-06T22:21:40.865 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52234.log 2023-07-06T22:21:40.865 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54421.log.gz 2023-07-06T22:21:40.867 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49172.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67773.log 2023-07-06T22:21:40.868 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49172.log.gz 2023-07-06T22:21:40.868 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52234.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52234.log.gz 2023-07-06T22:21:40.869 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63622.log 2023-07-06T22:21:40.870 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46417.log 2023-07-06T22:21:40.871 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67773.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67773.log.gz 2023-07-06T22:21:40.873 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58339.log 2023-07-06T22:21:40.873 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63622.log.gz 2023-07-06T22:21:40.875 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68086.log 2023-07-06T22:21:40.875 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58339.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46417.log.gz 2023-07-06T22:21:40.876 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58339.log.gz 2023-07-06T22:21:40.877 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67746.log 2023-07-06T22:21:40.878 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68336.log 2023-07-06T22:21:40.879 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67746.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68086.log.gz 2023-07-06T22:21:40.880 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67746.log.gz 2023-07-06T22:21:40.881 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52711.log 2023-07-06T22:21:40.883 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46365.log 2023-07-06T22:21:40.883 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52711.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68336.log.gz 2023-07-06T22:21:40.884 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52711.log.gz 2023-07-06T22:21:40.885 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61009.log 2023-07-06T22:21:40.887 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61491.log 2023-07-06T22:21:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61009.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61009.log.gz 2023-07-06T22:21:40.888 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46365.log.gz 2023-07-06T22:21:40.889 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55406.log 2023-07-06T22:21:40.891 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58540.log 2023-07-06T22:21:40.892 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5%/var/log/ceph/ceph-client.admin.55406.log: -- replaced with /var/log/ceph/ceph-client.admin.61491.log.gz 2023-07-06T22:21:40.893 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55406.log.gz 2023-07-06T22:21:40.893 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71924.log 2023-07-06T22:21:40.895 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45215.log 2023-07-06T22:21:40.896 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71924.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58540.log.gz 2023-07-06T22:21:40.897 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71924.log.gz 2023-07-06T22:21:40.897 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61257.log 2023-07-06T22:21:40.899 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70353.log 2023-07-06T22:21:40.900 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61257.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45215.log.gz 2023-07-06T22:21:40.901 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61257.log.gz 2023-07-06T22:21:40.901 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45405.log 2023-07-06T22:21:40.903 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50494.log 2023-07-06T22:21:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45405.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70353.log.gz 2023-07-06T22:21:40.905 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45405.log.gz 2023-07-06T22:21:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58287.log 2023-07-06T22:21:40.908 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58067.log 2023-07-06T22:21:40.908 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58287.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50494.log.gz 2023-07-06T22:21:40.909 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58287.log.gz 2023-07-06T22:21:40.910 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51382.log 2023-07-06T22:21:40.911 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64844.log 2023-07-06T22:21:40.912 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58067.log.gz 2023-07-06T22:21:40.914 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51382.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51382.log.gz 2023-07-06T22:21:40.914 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66085.log 2023-07-06T22:21:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64844.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64844.log.gz 2023-07-06T22:21:40.916 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52444.log 2023-07-06T22:21:40.917 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45010.log 2023-07-06T22:21:40.918 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66085.log.gz 2023-07-06T22:21:40.919 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52444.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52444.log.gz 2023-07-06T22:21:40.920 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56901.log 2023-07-06T22:21:40.921 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67642.log 2023-07-06T22:21:40.922 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45010.log.gz 2023-07-06T22:21:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68758.log 2023-07-06T22:21:40.924 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67642.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56901.log.gz 2023-07-06T22:21:40.924 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67642.log.gz 2023-07-06T22:21:40.925 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64323.log 2023-07-06T22:21:40.927 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54291.log 2023-07-06T22:21:40.928 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68758.log.gz 2023-07-06T22:21:40.929 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64323.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64323.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68979.log 2023-07-06T22:21:40.930 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-07-06T22:21:40.931 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54291.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54291.log.gz 2023-07-06T22:21:40.931 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66059.log 2023-07-06T22:21:40.933 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63035.log 2023-07-06T22:21:40.933 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66059.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68979.log.gz 2023-07-06T22:21:40.934 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66059.log.gz 2023-07-06T22:21:40.935 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69487.log 2023-07-06T22:21:40.937 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52659.log 2023-07-06T22:21:40.938 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69487.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63035.log.gz 2023-07-06T22:21:40.938 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69487.log.gz 2023-07-06T22:21:40.940 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63404.log 2023-07-06T22:21:40.941 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60616.log 2023-07-06T22:21:40.941 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52659.log.gz 2023-07-06T22:21:40.943 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60122.log 2023-07-06T22:21:40.944 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60616.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63404.log.gz 2023-07-06T22:21:40.944 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60616.log.gz 2023-07-06T22:21:40.945 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55734.log 2023-07-06T22:21:40.947 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71315.log 2023-07-06T22:21:40.948 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55734.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60122.log.gz 2023-07-06T22:21:40.949 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55734.log.gz 2023-07-06T22:21:40.949 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48430.log 2023-07-06T22:21:40.951 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72574.log 2023-07-06T22:21:40.952 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48430.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71315.log.gz 2023-07-06T22:21:40.952 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48430.log.gz 2023-07-06T22:21:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59645.log 2023-07-06T22:21:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46938.log 2023-07-06T22:21:40.956 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72574.log.gz 2023-07-06T22:21:40.957 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45691.log 2023-07-06T22:21:40.958 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1%/var/log/ceph/ceph-client.admin.46938.log: -- replaced with /var/log/ceph/ceph-client.admin.59645.log.gz 2023-07-06T22:21:40.958 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46938.log.gz 2023-07-06T22:21:40.960 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47128.log 2023-07-06T22:21:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43166.log 2023-07-06T22:21:40.962 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45691.log.gz 2023-07-06T22:21:40.963 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44998.log 2023-07-06T22:21:40.964 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47128.log.gz 2023-07-06T22:21:40.964 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43166.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43166.log.gz 2023-07-06T22:21:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62234.log 2023-07-06T22:21:40.968 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60187.log 2023-07-06T22:21:40.968 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44998.log.gz 2023-07-06T22:21:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45639.log 2023-07-06T22:21:40.970 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60187.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62234.log.gz 2023-07-06T22:21:40.971 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60187.log.gz 2023-07-06T22:21:40.971 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67616.log 2023-07-06T22:21:40.973 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47421.log 2023-07-06T22:21:40.974 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67616.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45639.log.gz 2023-07-06T22:21:40.975 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67616.log.gz 2023-07-06T22:21:40.975 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52103.log 2023-07-06T22:21:40.977 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70696.log 2023-07-06T22:21:40.978 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47421.log.gz 2023-07-06T22:21:40.979 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52103.log: gzip 88.6% -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-06T22:21:40.980 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52103.log.gz 2023-07-06T22:21:40.981 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69655.log 2023-07-06T22:21:40.982 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph.audit.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70696.log.gz 2023-07-06T22:21:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37327.log 2023-07-06T22:21:40.986 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69655.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69655.log.gz 2023-07-06T22:21:40.987 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52470.log 2023-07-06T22:21:40.989 INFO:teuthology.orchestra.run.smithi055.stderr: 90.0%/var/log/ceph/ceph-client.admin.37327.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-06T22:21:40.989 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37327.log.gz 2023-07-06T22:21:40.991 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-07-06T22:21:40.992 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54577.log 2023-07-06T22:21:40.992 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52470.log.gz 2023-07-06T22:21:40.994 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46808.log 2023-07-06T22:21:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54577.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54577.log.gz 2023-07-06T22:21:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43791.log 2023-07-06T22:21:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46808.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46808.log.gz 2023-07-06T22:21:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50286.log 2023-07-06T22:21:41.001 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43791.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43791.log.gz 2023-07-06T22:21:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57871.log 2023-07-06T22:21:41.005 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50286.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50286.log.gz 2023-07-06T22:21:41.007 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53712.log 2023-07-06T22:21:41.008 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57871.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57871.log.gz 2023-07-06T22:21:41.010 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51954.log 2023-07-06T22:21:41.011 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53712.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53712.log.gz 2023-07-06T22:21:41.013 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65387.log 2023-07-06T22:21:41.014 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51954.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51954.log.gz 2023-07-06T22:21:41.016 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67143.log 2023-07-06T22:21:41.018 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65387.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65387.log.gz 2023-07-06T22:21:41.019 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-07-06T22:21:41.021 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67143.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67143.log.gz 2023-07-06T22:21:41.023 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64572.log 2023-07-06T22:21:41.029 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mds.a.log: 92.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-07-06T22:21:41.031 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70991.log 2023-07-06T22:21:41.033 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64572.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64572.log.gz 2023-07-06T22:21:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52208.log 2023-07-06T22:21:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70991.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70991.log.gz 2023-07-06T22:21:41.038 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55864.log 2023-07-06T22:21:41.039 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52208.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52208.log.gz 2023-07-06T22:21:41.041 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66503.log 2023-07-06T22:21:41.042 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55864.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55864.log.gz 2023-07-06T22:21:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46261.log 2023-07-06T22:21:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66503.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66503.log.gz 2023-07-06T22:21:41.047 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43685.log 2023-07-06T22:21:41.048 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46261.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46261.log.gz 2023-07-06T22:21:41.050 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57599.log 2023-07-06T22:21:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43685.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43685.log.gz 2023-07-06T22:21:41.053 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49234.log 2023-07-06T22:21:41.055 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57599.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57599.log.gz 2023-07-06T22:21:41.056 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57201.log 2023-07-06T22:21:41.058 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49234.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49234.log.gz 2023-07-06T22:21:41.059 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65869.log 2023-07-06T22:21:41.061 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57201.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57201.log.gz 2023-07-06T22:21:41.063 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50905.log 2023-07-06T22:21:41.064 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65869.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65869.log.gz 2023-07-06T22:21:41.066 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46912.log 2023-07-06T22:21:41.067 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50905.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50905.log.gz 2023-07-06T22:21:41.069 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67363.log 2023-07-06T22:21:41.070 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46912.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46912.log.gz 2023-07-06T22:21:41.071 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69988.log 2023-07-06T22:21:41.073 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67363.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67363.log.gz 2023-07-06T22:21:41.075 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65581.log 2023-07-06T22:21:41.076 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69988.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69988.log.gz 2023-07-06T22:21:41.078 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62730.log 2023-07-06T22:21:41.079 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65581.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65581.log.gz 2023-07-06T22:21:41.081 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52320.log 2023-07-06T22:21:41.083 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62730.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62730.log.gz 2023-07-06T22:21:41.084 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55812.log 2023-07-06T22:21:41.086 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52320.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52320.log.gz 2023-07-06T22:21:41.087 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59908.log 2023-07-06T22:21:41.089 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55812.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55812.log.gz 2023-07-06T22:21:41.091 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50746.log 2023-07-06T22:21:41.093 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59908.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59908.log.gz 2023-07-06T22:21:41.094 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62704.log 2023-07-06T22:21:41.096 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50746.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50746.log.gz 2023-07-06T22:21:41.098 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44545.log 2023-07-06T22:21:41.099 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62704.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62704.log.gz 2023-07-06T22:21:41.101 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57253.log 2023-07-06T22:21:41.102 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44545.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44545.log.gz 2023-07-06T22:21:41.103 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69681.log 2023-07-06T22:21:41.105 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57253.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57253.log.gz 2023-07-06T22:21:41.107 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59041.log 2023-07-06T22:21:41.108 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69681.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69681.log.gz 2023-07-06T22:21:41.110 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67441.log 2023-07-06T22:21:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59041.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59041.log.gz 2023-07-06T22:21:41.113 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44701.log 2023-07-06T22:21:41.114 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67441.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67441.log.gz 2023-07-06T22:21:41.116 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45769.log 2023-07-06T22:21:41.117 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44701.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44701.log.gz 2023-07-06T22:21:41.118 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54369.log 2023-07-06T22:21:41.120 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45769.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45769.log.gz 2023-07-06T22:21:41.121 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58313.log 2023-07-06T22:21:41.123 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54369.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54369.log.gz 2023-07-06T22:21:41.125 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66920.log 2023-07-06T22:21:41.126 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58313.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58313.log.gz 2023-07-06T22:21:41.128 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62208.log 2023-07-06T22:21:41.129 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66920.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66920.log.gz 2023-07-06T22:21:41.131 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50578.log 2023-07-06T22:21:41.132 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62208.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62208.log.gz 2023-07-06T22:21:41.134 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70209.log 2023-07-06T22:21:41.135 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50578.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50578.log.gz 2023-07-06T22:21:41.137 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61335.log 2023-07-06T22:21:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70209.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70209.log.gz 2023-07-06T22:21:41.140 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45847.log 2023-07-06T22:21:41.142 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61335.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61335.log.gz 2023-07-06T22:21:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61595.log 2023-07-06T22:21:41.145 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45847.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45847.log.gz 2023-07-06T22:21:41.147 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49981.log 2023-07-06T22:21:41.149 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61595.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61595.log.gz 2023-07-06T22:21:41.150 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48754.log 2023-07-06T22:21:41.152 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49981.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49981.log.gz 2023-07-06T22:21:41.153 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71652.log 2023-07-06T22:21:41.155 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48754.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48754.log.gz 2023-07-06T22:21:41.157 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66043.log 2023-07-06T22:21:41.158 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71652.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71652.log.gz 2023-07-06T22:21:41.160 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51630.log 2023-07-06T22:21:41.161 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.66043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66043.log.gz 2023-07-06T22:21:41.163 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48482.log 2023-07-06T22:21:41.164 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51630.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51630.log.gz 2023-07-06T22:21:41.166 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50852.log 2023-07-06T22:21:41.167 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48482.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48482.log.gz 2023-07-06T22:21:41.169 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63296.log 2023-07-06T22:21:41.170 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50852.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50852.log.gz 2023-07-06T22:21:41.172 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69317.log 2023-07-06T22:21:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63296.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63296.log.gz 2023-07-06T22:21:41.174 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45899.log 2023-07-06T22:21:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69317.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69317.log.gz 2023-07-06T22:21:41.178 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71402.log 2023-07-06T22:21:41.179 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45899.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.45899.log.gz 2023-07-06T22:21:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71017.log 2023-07-06T22:21:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71402.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71402.log.gz 2023-07-06T22:21:41.184 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72106.log 2023-07-06T22:21:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71017.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71017.log.gz 2023-07-06T22:21:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68594.log 2023-07-06T22:21:41.190 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72106.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72106.log.gz 2023-07-06T22:21:41.191 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50774.log 2023-07-06T22:21:41.193 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68594.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68594.log.gz 2023-07-06T22:21:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45013.log 2023-07-06T22:21:41.196 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50774.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50774.log.gz 2023-07-06T22:21:41.198 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69291.log 2023-07-06T22:21:41.199 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45013.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45013.log.gz 2023-07-06T22:21:41.201 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44597.log 2023-07-06T22:21:41.202 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69291.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69291.log.gz 2023-07-06T22:21:41.204 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49736.log 2023-07-06T22:21:41.205 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44597.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44597.log.gz 2023-07-06T22:21:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48612.log 2023-07-06T22:21:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49736.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49736.log.gz 2023-07-06T22:21:41.210 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72158.log 2023-07-06T22:21:41.211 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48612.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48612.log.gz 2023-07-06T22:21:41.213 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47845.log 2023-07-06T22:21:41.214 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72158.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72158.log.gz 2023-07-06T22:21:41.216 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70513.log 2023-07-06T22:21:41.217 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47845.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47845.log.gz 2023-07-06T22:21:41.219 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60434.log 2023-07-06T22:21:41.220 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70513.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70513.log.gz 2023-07-06T22:21:41.221 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62598.log 2023-07-06T22:21:41.223 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60434.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.60434.log.gz 2023-07-06T22:21:41.225 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65413.log 2023-07-06T22:21:41.226 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62598.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62598.log.gz 2023-07-06T22:21:41.228 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55032.log 2023-07-06T22:21:41.230 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65413.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65413.log.gz 2023-07-06T22:21:41.230 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63464.log 2023-07-06T22:21:41.232 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55032.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55032.log.gz 2023-07-06T22:21:41.233 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54916.log 2023-07-06T22:21:41.234 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63464.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63464.log.gz 2023-07-06T22:21:41.236 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67467.log 2023-07-06T22:21:41.237 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54916.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54916.log.gz 2023-07-06T22:21:41.239 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70902.log 2023-07-06T22:21:41.240 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67467.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67467.log.gz 2023-07-06T22:21:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59275.log 2023-07-06T22:21:41.243 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70902.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.70902.log.gz 2023-07-06T22:21:41.245 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47102.log 2023-07-06T22:21:41.247 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59275.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59275.log.gz 2023-07-06T22:21:41.249 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60512.log 2023-07-06T22:21:41.250 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47102.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47102.log.gz 2023-07-06T22:21:41.252 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51902.log 2023-07-06T22:21:41.253 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60512.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60512.log.gz 2023-07-06T22:21:41.255 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67590.log 2023-07-06T22:21:41.256 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51902.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51902.log.gz 2023-07-06T22:21:41.258 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44727.log 2023-07-06T22:21:41.259 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67590.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67590.log.gz 2023-07-06T22:21:41.261 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69882.log 2023-07-06T22:21:41.262 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44727.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44727.log.gz 2023-07-06T22:21:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64598.log 2023-07-06T22:21:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69882.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69882.log.gz 2023-07-06T22:21:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57307.log 2023-07-06T22:21:41.268 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64598.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64598.log.gz 2023-07-06T22:21:41.270 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49819.log 2023-07-06T22:21:41.271 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57307.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57307.log.gz 2023-07-06T22:21:41.273 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57455.log 2023-07-06T22:21:41.274 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49819.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49819.log.gz 2023-07-06T22:21:41.276 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72392.log 2023-07-06T22:21:41.277 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.57455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57455.log.gz 2023-07-06T22:21:41.279 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52739.log 2023-07-06T22:21:41.280 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72392.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72392.log.gz 2023-07-06T22:21:41.282 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59431.log 2023-07-06T22:21:41.283 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52739.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52739.log.gz 2023-07-06T22:21:41.285 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45717.log 2023-07-06T22:21:41.286 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59431.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59431.log.gz 2023-07-06T22:21:41.288 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52352.log 2023-07-06T22:21:41.289 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45717.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.45717.log.gz 2023-07-06T22:21:41.291 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60696.log 2023-07-06T22:21:41.292 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52352.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52352.log.gz 2023-07-06T22:21:41.294 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48105.log 2023-07-06T22:21:41.295 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60696.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60696.log.gz 2023-07-06T22:21:41.297 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55677.log 2023-07-06T22:21:41.298 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48105.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48105.log.gz 2023-07-06T22:21:41.300 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47476.log 2023-07-06T22:21:41.301 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55677.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55677.log.gz 2023-07-06T22:21:41.303 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57762.log 2023-07-06T22:21:41.304 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47476.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47476.log.gz 2023-07-06T22:21:41.306 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70748.log 2023-07-06T22:21:41.307 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57762.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57762.log.gz 2023-07-06T22:21:41.309 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56796.log 2023-07-06T22:21:41.310 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70748.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70748.log.gz 2023-07-06T22:21:41.312 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61413.log 2023-07-06T22:21:41.313 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56796.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56796.log.gz 2023-07-06T22:21:41.315 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62312.log 2023-07-06T22:21:41.316 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61413.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61413.log.gz 2023-07-06T22:21:41.318 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52579.log 2023-07-06T22:21:41.319 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62312.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62312.log.gz 2023-07-06T22:21:41.321 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55957.log 2023-07-06T22:21:41.322 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52579.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52579.log.gz 2023-07-06T22:21:41.324 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53938.log 2023-07-06T22:21:41.325 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55957.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55957.log.gz 2023-07-06T22:21:41.327 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56378.log 2023-07-06T22:21:41.328 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53938.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53938.log.gz 2023-07-06T22:21:41.330 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57333.log 2023-07-06T22:21:41.331 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56378.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56378.log.gz 2023-07-06T22:21:41.333 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60722.log 2023-07-06T22:21:41.334 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57333.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57333.log.gz 2023-07-06T22:21:41.336 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49260.log 2023-07-06T22:21:41.337 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60722.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60722.log.gz 2023-07-06T22:21:41.339 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72132.log 2023-07-06T22:21:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49260.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49260.log.gz 2023-07-06T22:21:41.341 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58644.log 2023-07-06T22:21:41.343 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72132.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72132.log.gz 2023-07-06T22:21:41.344 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45008.log 2023-07-06T22:21:41.346 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58644.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58644.log.gz 2023-07-06T22:21:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51061.log 2023-07-06T22:21:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45008.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45008.log.gz 2023-07-06T22:21:41.351 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55190.log 2023-07-06T22:21:41.352 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51061.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51061.log.gz 2023-07-06T22:21:41.355 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46990.log 2023-07-06T22:21:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55190.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55190.log.gz 2023-07-06T22:21:41.358 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49927.log 2023-07-06T22:21:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46990.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46990.log.gz 2023-07-06T22:21:41.361 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60590.log 2023-07-06T22:21:41.362 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49927.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49927.log.gz 2023-07-06T22:21:41.364 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51512.log 2023-07-06T22:21:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60590.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60590.log.gz 2023-07-06T22:21:41.367 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58696.log 2023-07-06T22:21:41.368 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51512.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51512.log.gz 2023-07-06T22:21:41.370 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60564.log 2023-07-06T22:21:41.371 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58696.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58696.log.gz 2023-07-06T22:21:41.372 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58931.log 2023-07-06T22:21:41.374 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60564.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60564.log.gz 2023-07-06T22:21:41.375 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50522.log 2023-07-06T22:21:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58931.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58931.log.gz 2023-07-06T22:21:41.379 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45483.log 2023-07-06T22:21:41.380 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50522.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50522.log.gz 2023-07-06T22:21:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65202.log 2023-07-06T22:21:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45483.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45483.log.gz 2023-07-06T22:21:41.384 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66946.log 2023-07-06T22:21:41.385 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65202.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.65202.log.gz 2023-07-06T22:21:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71454.log 2023-07-06T22:21:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66946.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66946.log.gz 2023-07-06T22:21:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46755.log 2023-07-06T22:21:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71454.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71454.log.gz 2023-07-06T22:21:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43739.log 2023-07-06T22:21:41.394 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46755.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46755.log.gz 2023-07-06T22:21:41.396 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64213.log 2023-07-06T22:21:41.397 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43739.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43739.log.gz 2023-07-06T22:21:41.399 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49122.log 2023-07-06T22:21:41.400 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64213.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64213.log.gz 2023-07-06T22:21:41.402 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65465.log 2023-07-06T22:21:41.404 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49122.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.49122.log.gz 2023-07-06T22:21:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52286.log 2023-07-06T22:21:41.406 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65465.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.65465.log.gz 2023-07-06T22:21:41.408 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51577.log 2023-07-06T22:21:41.409 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52286.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52286.log.gz 2023-07-06T22:21:41.411 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43384.log 2023-07-06T22:21:41.412 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51577.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51577.log.gz 2023-07-06T22:21:41.414 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61087.log 2023-07-06T22:21:41.416 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43384.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43384.log.gz 2023-07-06T22:21:41.418 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68952.log 2023-07-06T22:21:41.419 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61087.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61087.log.gz 2023-07-06T22:21:41.421 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52921.log 2023-07-06T22:21:41.422 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68952.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68952.log.gz 2023-07-06T22:21:41.423 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44649.log 2023-07-06T22:21:41.425 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52921.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52921.log.gz 2023-07-06T22:21:41.426 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68492.log 2023-07-06T22:21:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44649.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44649.log.gz 2023-07-06T22:21:41.430 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67337.log 2023-07-06T22:21:41.431 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68492.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68492.log.gz 2023-07-06T22:21:41.433 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47180.log 2023-07-06T22:21:41.434 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67337.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67337.log.gz 2023-07-06T22:21:41.436 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72600.log 2023-07-06T22:21:41.437 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47180.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47180.log.gz 2023-07-06T22:21:41.438 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53214.log 2023-07-06T22:21:41.440 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72600.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72600.log.gz 2023-07-06T22:21:41.441 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65661.log 2023-07-06T22:21:41.442 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53214.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53214.log.gz 2023-07-06T22:21:41.444 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63944.log 2023-07-06T22:21:41.445 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65661.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65661.log.gz 2023-07-06T22:21:41.447 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65687.log 2023-07-06T22:21:41.448 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63944.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63944.log.gz 2023-07-06T22:21:41.450 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47949.log 2023-07-06T22:21:41.451 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65687.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65687.log.gz 2023-07-06T22:21:41.453 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53138.log 2023-07-06T22:21:41.454 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47949.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47949.log.gz 2023-07-06T22:21:41.456 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51876.log 2023-07-06T22:21:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53138.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53138.log.gz 2023-07-06T22:21:41.459 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46677.log 2023-07-06T22:21:41.460 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51876.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51876.log.gz 2023-07-06T22:21:41.462 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53873.log 2023-07-06T22:21:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46677.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46677.log.gz 2023-07-06T22:21:41.465 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60800.log 2023-07-06T22:21:41.466 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53873.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53873.log.gz 2023-07-06T22:21:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48053.log 2023-07-06T22:21:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60800.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60800.log.gz 2023-07-06T22:21:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63172.log 2023-07-06T22:21:41.472 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48053.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48053.log.gz 2023-07-06T22:21:41.474 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49562.log 2023-07-06T22:21:41.475 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63172.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63172.log.gz 2023-07-06T22:21:41.477 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51551.log 2023-07-06T22:21:41.479 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49562.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49562.log.gz 2023-07-06T22:21:41.480 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70433.log 2023-07-06T22:21:41.481 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51551.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51551.log.gz 2023-07-06T22:21:41.483 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53821.log 2023-07-06T22:21:41.484 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70433.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70433.log.gz 2023-07-06T22:21:41.486 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63596.log 2023-07-06T22:21:41.487 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53821.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53821.log.gz 2023-07-06T22:21:41.489 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49218.log 2023-07-06T22:21:41.490 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63596.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63596.log.gz 2023-07-06T22:21:41.492 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47369.log 2023-07-06T22:21:41.493 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.49218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49218.log.gz 2023-07-06T22:21:41.494 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44068.log 2023-07-06T22:21:41.496 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47369.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47369.log.gz 2023-07-06T22:21:41.497 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52522.log 2023-07-06T22:21:41.500 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44068.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.44068.log.gz 2023-07-06T22:21:41.502 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47395.log 2023-07-06T22:21:41.504 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52522.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52522.log.gz 2023-07-06T22:21:41.505 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71345.log 2023-07-06T22:21:41.507 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47395.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47395.log.gz 2023-07-06T22:21:41.508 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55983.log 2023-07-06T22:21:41.510 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.71345.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.71345.log.gz 2023-07-06T22:21:41.511 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72522.log 2023-07-06T22:21:41.513 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55983.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55983.log.gz 2023-07-06T22:21:41.514 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51114.log 2023-07-06T22:21:41.516 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72522.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72522.log.gz 2023-07-06T22:21:41.517 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45195.log 2023-07-06T22:21:41.519 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51114.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51114.log.gz 2023-07-06T22:21:41.520 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63518.log 2023-07-06T22:21:41.522 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45195.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45195.log.gz 2023-07-06T22:21:41.523 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47447.log 2023-07-06T22:21:41.524 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63518.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63518.log.gz 2023-07-06T22:21:41.526 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49846.log 2023-07-06T22:21:41.528 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47447.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47447.log.gz 2023-07-06T22:21:41.530 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65607.log 2023-07-06T22:21:41.531 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49846.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49846.log.gz 2023-07-06T22:21:41.532 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52973.log 2023-07-06T22:21:41.534 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65607.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65607.log.gz 2023-07-06T22:21:41.535 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54187.log 2023-07-06T22:21:41.537 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52973.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52973.log.gz 2023-07-06T22:21:41.538 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49765.log 2023-07-06T22:21:41.540 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54187.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54187.log.gz 2023-07-06T22:21:41.541 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49649.log 2023-07-06T22:21:41.543 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49765.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49765.log.gz 2023-07-06T22:21:41.544 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55930.log 2023-07-06T22:21:41.545 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49649.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49649.log.gz 2023-07-06T22:21:41.547 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46469.log 2023-07-06T22:21:41.548 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55930.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55930.log.gz 2023-07-06T22:21:41.550 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44462.log 2023-07-06T22:21:41.552 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46469.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46469.log.gz 2023-07-06T22:21:41.553 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72340.log 2023-07-06T22:21:41.555 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44462.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44462.log.gz 2023-07-06T22:21:41.556 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61229.log 2023-07-06T22:21:41.557 INFO:teuthology.orchestra.run.smithi055.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-07-06T22:21:41.558 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72340.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72340.log.gz 2023-07-06T22:21:41.559 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49070.log 2023-07-06T22:21:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48780.log 2023-07-06T22:21:41.561 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61229.log.gz 2023-07-06T22:21:41.563 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62456.log 2023-07-06T22:21:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49070.log: /var/log/ceph/ceph-client.admin.48780.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49070.log.gz 2023-07-06T22:21:41.564 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48780.log.gz 2023-07-06T22:21:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55318.log 2023-07-06T22:21:41.567 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44253.log 2023-07-06T22:21:41.567 INFO:teuthology.orchestra.run.smithi055.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.62456.log.gz 2023-07-06T22:21:41.569 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55318.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55318.log.gz 2023-07-06T22:21:41.569 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67519.log 2023-07-06T22:21:41.570 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72314.log 2023-07-06T22:21:41.571 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67519.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44253.log.gz 2023-07-06T22:21:41.572 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67519.log.gz 2023-07-06T22:21:41.573 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44123.log 2023-07-06T22:21:41.574 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64740.log 2023-07-06T22:21:41.575 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44123.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72314.log.gz 2023-07-06T22:21:41.576 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44123.log.gz 2023-07-06T22:21:41.576 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62756.log 2023-07-06T22:21:41.578 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50718.log 2023-07-06T22:21:41.580 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62756.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.64740.log.gz 2023-07-06T22:21:41.580 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62756.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.68640.log 2023-07-06T22:21:41.581 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-07-06T22:21:41.582 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46521.log 2023-07-06T22:21:41.583 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.68640.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50718.log.gz 2023-07-06T22:21:41.583 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68640.log.gz 2023-07-06T22:21:41.584 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56508.log 2023-07-06T22:21:41.586 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55086.log 2023-07-06T22:21:41.587 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56508.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46521.log.gz 2023-07-06T22:21:41.588 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56508.log.gz 2023-07-06T22:21:41.588 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51798.log 2023-07-06T22:21:41.590 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52129.log 2023-07-06T22:21:41.591 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51798.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55086.log.gz 2023-07-06T22:21:41.592 INFO:teuthology.orchestra.run.smithi055.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51798.log.gz 2023-07-06T22:21:41.592 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48157.log 2023-07-06T22:21:41.594 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64239.log 2023-07-06T22:21:41.595 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48157.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52129.log.gz 2023-07-06T22:21:41.596 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48157.log.gz 2023-07-06T22:21:41.596 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68284.log 2023-07-06T22:21:41.598 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61809.log 2023-07-06T22:21:41.599 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68284.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.64239.log.gz 2023-07-06T22:21:41.599 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68284.log.gz 2023-07-06T22:21:41.600 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44519.log 2023-07-06T22:21:41.602 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53049.log 2023-07-06T22:21:41.603 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44519.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61809.log.gz 2023-07-06T22:21:41.603 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44519.log.gz 2023-07-06T22:21:41.604 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72054.log 2023-07-06T22:21:41.606 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43410.log 2023-07-06T22:21:41.607 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.72054.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53049.log.gz 2023-07-06T22:21:41.607 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72054.log.gz 2023-07-06T22:21:41.608 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56404.log 2023-07-06T22:21:41.610 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59223.log 2023-07-06T22:21:41.610 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43410.log.gz 2023-07-06T22:21:41.612 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56404.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56404.log.gz 2023-07-06T22:21:41.613 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62853.log 2023-07-06T22:21:41.614 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59223.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59223.log.gz 2023-07-06T22:21:41.615 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59301.log 2023-07-06T22:21:41.616 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52077.log 2023-07-06T22:21:41.617 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62853.log.gz 2023-07-06T22:21:41.618 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59301.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59301.log.gz 2023-07-06T22:21:41.618 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56203.log 2023-07-06T22:21:41.620 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52077.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52077.log.gz 2023-07-06T22:21:41.621 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45457.log 2023-07-06T22:21:41.623 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52869.log 2023-07-06T22:21:41.623 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56203.log.gz 2023-07-06T22:21:41.625 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45457.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45457.log.gz 2023-07-06T22:21:41.626 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52869.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52869.log.gz 2023-07-06T22:21:41.827 INFO:teuthology.orchestra.run.smithi055.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-07-06T22:21:42.224 INFO:teuthology.orchestra.run.smithi055.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-07-06T22:21:42.295 INFO:teuthology.orchestra.run.smithi138.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-07-06T22:21:42.796 INFO:teuthology.orchestra.run.smithi138.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-07-06T22:21:42.907 INFO:teuthology.orchestra.run.smithi138.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-07-06T22:21:42.969 INFO:teuthology.orchestra.run.smithi138.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-07-06T22:21:42.972 INFO:teuthology.orchestra.run.smithi138.stderr: 2023-07-06T22:21:42.972 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m3.127s 2023-07-06T22:21:42.972 INFO:teuthology.orchestra.run.smithi138.stderr:user 0m12.540s 2023-07-06T22:21:42.972 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m1.081s 2023-07-06T22:21:42.979 INFO:teuthology.orchestra.run.smithi055.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-07-06T22:21:43.117 INFO:teuthology.orchestra.run.smithi055.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-07-06T22:21:43.847 INFO:teuthology.orchestra.run.smithi055.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-07-06T22:21:44.900 INFO:teuthology.orchestra.run.smithi055.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-07-06T22:21:44.902 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-07-06T22:21:44.902 INFO:teuthology.orchestra.run.smithi055.stderr:real 0m5.073s 2023-07-06T22:21:44.902 INFO:teuthology.orchestra.run.smithi055.stderr:user 0m18.195s 2023-07-06T22:21:44.902 INFO:teuthology.orchestra.run.smithi055.stderr:sys 0m3.314s 2023-07-06T22:21:44.903 INFO:tasks.ceph:Archiving logs... 2023-07-06T22:21:44.904 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249/remote/smithi055/log 2023-07-06T22:21:44.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-06T22:21:46.930 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249/remote/smithi138/log 2023-07-06T22:21:46.931 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-06T22:21:48.183 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-06T22:21:48.192 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-06T22:21:48.193 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-06T22:21:48.196 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-06T22:21:48.300 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-06T22:21:48.309 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-06T22:21:48.309 DEBUG:teuthology.orchestra.run.smithi055:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-06T22:21:48.313 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-06T22:21:48.326 INFO:teuthology.orchestra.run.smithi055.stdout: remote refid st t when poll reach delay offset jitter 2023-07-06T22:21:48.326 INFO:teuthology.orchestra.run.smithi055.stdout:============================================================================== 2023-07-06T22:21:48.326 INFO:teuthology.orchestra.run.smithi055.stdout:*hv01.front.sepi 44.4.53.2 2 u 57 128 377 0.114 -4.733 1.030 2023-07-06T22:21:48.326 INFO:teuthology.orchestra.run.smithi055.stdout:+hv02.front.sepi 63.231.80.2 3 u 106 128 377 0.100 -2.362 1.044 2023-07-06T22:21:48.326 INFO:teuthology.orchestra.run.smithi055.stdout:+hv03.front.sepi 74.6.168.72 3 u 115 128 377 0.132 -4.247 0.779 2023-07-06T22:21:48.327 INFO:teuthology.orchestra.run.smithi055.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-07-06T22:21:48.329 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2023-07-06T22:21:48.329 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2023-07-06T22:21:48.329 INFO:teuthology.orchestra.run.smithi138.stdout:*hv01.front.sepi 44.4.53.2 2 u 51 128 377 0.126 -6.680 2.210 2023-07-06T22:21:48.330 INFO:teuthology.orchestra.run.smithi138.stdout:+hv02.front.sepi 63.231.80.2 3 u 107 128 377 0.088 -4.108 1.992 2023-07-06T22:21:48.330 INFO:teuthology.orchestra.run.smithi138.stdout:+hv03.front.sepi 74.6.168.72 3 u 100 128 377 0.146 -6.180 1.879 2023-07-06T22:21:48.330 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-07-06T22:21:48.331 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-06T22:21:48.342 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-06T22:21:48.343 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-06T22:21:48.357 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-06T22:21:48.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-06T22:21:48.385 INFO:teuthology.task.internal:Duration was 3117.197414 seconds 2023-07-06T22:21:48.386 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-06T22:21:48.400 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-06T22:21:48.400 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-06T22:21:48.404 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-06T22:21:48.537 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-06T22:21:48.538 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi055.front.sepia.ceph.com 2023-07-06T22:21:48.538 DEBUG:teuthology.orchestra.run.smithi055:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-06T22:21:48.561 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2023-07-06T22:21:48.561 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-06T22:21:48.583 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-06T22:21:48.583 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-06T22:21:48.610 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-06T22:21:48.660 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-06T22:21:48.660 DEBUG:teuthology.orchestra.run.smithi055:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-06T22:21:48.698 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-06T22:21:48.787 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-06T22:21:48.797 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-06T22:21:48.798 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-06T22:21:48.819 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-06T22:21:48.840 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-06T22:21:48.849 DEBUG:teuthology.orchestra.run.smithi055:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-06T22:21:48.865 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-06T22:21:48.881 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = core 2023-07-06T22:21:48.904 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2023-07-06T22:21:48.923 DEBUG:teuthology.orchestra.run.smithi055:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-06T22:21:48.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T22:21:48.950 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-06T22:21:48.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T22:21:48.974 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-06T22:21:48.983 INFO:teuthology.task.internal:Transferring archived files... 2023-07-06T22:21:48.984 DEBUG:teuthology.misc:Transferring archived files from smithi055:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249/remote/smithi055 2023-07-06T22:21:48.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-06T22:21:49.015 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249/remote/smithi138 2023-07-06T22:21:49.015 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-06T22:21:49.039 INFO:teuthology.task.internal:Removing archive directory... 2023-07-06T22:21:49.039 DEBUG:teuthology.orchestra.run.smithi055:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-06T22:21:49.065 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-06T22:21:49.090 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-06T22:21:49.100 INFO:teuthology.task.internal:Not uploading archives. 2023-07-06T22:21:49.100 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-06T22:21:49.112 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-06T22:21:49.112 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-06T22:21:49.121 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-06T22:21:49.127 INFO:teuthology.orchestra.run.smithi055.stdout: 657846 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 6 22:21 /home/ubuntu/cephtest 2023-07-06T22:21:49.138 INFO:teuthology.orchestra.run.smithi138.stdout: 657844 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 6 22:21 /home/ubuntu/cephtest 2023-07-06T22:21:49.140 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-06T22:21:49.152 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-06T22:21:49.183 INFO:teuthology.nuke:Checking targets against current locks 2023-07-06T22:21:49.211 DEBUG:teuthology.nuke:shortname: smithi055 2023-07-06T22:21:49.212 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T22:21:49.237 DEBUG:teuthology.nuke:shortname: smithi138 2023-07-06T22:21:49.238 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T22:21:49.240 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 21:18:53.761621', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCGh6RzmvW0LNZxxY/5BzuRMJiLLWmj07AGtdHV8B7eE5bAoke+2j3Bce8/TNdZMEfA2Xm6EQ0h8YobfoKgHjRM='} 2023-07-06T22:21:49.266 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328249', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 21:18:53.763527', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLHJXxRw1EQ6ZypCaOEujvNGKSNwsbniQv3/PY+e+Br1Cvwgg6EhYVUzQ2VCR2IMFNQRUOX1mXQ3CWsg+O/eF6g='} 2023-07-06T22:21:49.295 INFO:teuthology.orchestra.console:Power off smithi055 2023-07-06T22:21:49.296 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T22:21:49.317 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T22:21:49.337 INFO:teuthology.orchestra.console:Power off smithi138 2023-07-06T22:21:49.338 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T22:21:49.358 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T22:21:53.347 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T22:21:53.378 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T22:21:57.462 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T22:21:57.489 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T22:21:57.674 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2023-07-06T22:21:57.699 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2023-07-06T22:21:57.804 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd client.1-kernel-sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 3117.1974136829376 failure_reason: '"2023-07-06T21:44:47.495505+0000 mon.a (mon.0) 521 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_rishabh@teuthology success: false 2023-07-06T22:21:57.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T22:21:57.891 INFO:teuthology.run:FAIL